2024-09-12T16:59:18.831 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-12T16:59:18.855 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-12T16:59:18.945 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902711 branch: wip-rgw-meta-handlers description: rgw/verify/{0-install accounts$/{none} clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec-profile s3tests-branch sharding$/{default} striping$/{stripe-greater-than-chunk} supported-random-distro$/{centos_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/valgrind} email: null first_in_suite: false job_id: '7902711' kernel: kdb: 1 sha1: distro last_in_suite: false machine_type: smithi name: cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 10 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-rgw-meta-handlers ceph: conf: client: debug rgw: 20 debug rgw notification: 20 rgw bucket counters cache: true rgw crypt require ssl: false rgw crypt s3 kms backend: testing rgw crypt s3 kms encryption keys: testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= rgw d3n l1 datacache persistent path: /tmp/rgw_datacache/ rgw d3n l1 datacache size: 10737418240 rgw d3n l1 local datacache enabled: true rgw enable ops log: true rgw max chunk size: 4194304 rgw obj stripe size: 6291456 rgw reshard progress judge interval: 10 rgw s3 auth use sts: true rgw sts key: abcdefghijklmnop rgw torrent flag: true rgw user counters cache: true setgroup: ceph setuser: ceph global: mon client directed command retry: 5 ms inject socket failures: 5000 osd heartbeat grace: 40 osd_max_pg_log_entries: 10 osd_min_pg_log_entries: 10 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon osd crush smoke test: false osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug objclass: 20 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd fast shutdown: false osd objectstore: bluestore osd shutdown pgref assert: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) - \(POOL_APP_NOT_ENABLED\) - not have an application enabled - \(OSD_SLOW_PING_TIME sha1: bad475c18c96ec20c5778159aa33ba72b84e9c1b ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: bad475c18c96ec20c5778159aa33ba72b84e9c1b rgw: client.0: valgrind: - --tool=memcheck - --max-threads=1024 compression type: random datacache: true datacache_path: /tmp/rgw_datacache ec-data-pool: true erasure_code_profile: crush-failure-domain: osd k: 3 m: 1 name: testprofile frontend: beast storage classes: LUKEWARM, FROZEN s3tests: accounts: iam alt root: RGW99999999999999999 iam root: RGW88888888888888888 force-branch: ceph-master slow_backend: true storage classes: LUKEWARM, FROZEN thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-rgw-meta-handlers sha1: bad475c18c96ec20c5778159aa33ba72b84e9c1b owner: scheduled_cbodley@teuthology priority: 90 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - node-exporter.b seed: 6279 sha1: bad475c18c96ec20c5778159aa33ba72b84e9c1b sleep_before_teardown: 0 suite: rgw suite_branch: wip-rgw-meta-handlers suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_bad475c18c96ec20c5778159aa33ba72b84e9c1b/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: bad475c18c96ec20c5778159aa33ba72b84e9c1b targets: smithi037.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBGAhRw41FuHuy5Iv7xRIO9Q/6JDidEVorpOjOF4A4t55UlvT4RSCPc17L7x1yJJs8WSwNmuzkPK/yw9tYBa7Xs= smithi040.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKxlcDw2UzZOD/UXVwHiu6PNn4X5IxbOPq2HU6Yz6q2PPWcsHIl+TBjN9RdtLbgLMhyRfnKNQITsk6BJUJEqYbk= tasks: - install: extra_system_packages: deb: - s3cmd - maven rpm: - s3cmd - maven - ceph: null - openssl_keys: null - rgw: client.0: null - tox: - client.0 - workunit: clients: client.0: - rgw/run-datacache.sh env: RGW_DATACACHE_PATH: /tmp/rgw_datacache - workunit: clients: client.0: - rgw/run-bucket-check.sh - workunit: clients: client.0: - cls/test_cls_lock.sh - cls/test_cls_log.sh - cls/test_cls_refcount.sh - cls/test_cls_rgw.sh - cls/test_cls_rgw_gc.sh - cls/test_cls_rgw_stats.sh - cls/test_cls_cmpomap.sh - cls/test_cls_2pc_queue.sh - cls/test_cls_user.sh - rgw/test_rgw_gc_log.sh - rgw/test_rgw_obj.sh - rgw/test_librgw_file.sh - rgw/test_awssdkv4_sig.sh - workunit: clients: client.0: - rgw/test_rgw_s3_mp_reupload.sh - ragweed: client.0: default-branch: ceph-master rgw_server: client.0 stages: prepare,check - workunit: clients: client.0: - rgw/run-reshard.sh - s3tests-java: client.0: force-branch: ceph-master force-repo: https://github.com/ceph/java_s3tests.git - s3tests: client.0: rgw_server: client.0 - workunit: clients: client.0: - rgw/run-versioning.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-12_15:39:52 tube: smithi user: cbodley verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-12T16:59:18.945 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_bad475c18c96ec20c5778159aa33ba72b84e9c1b/qa; will attempt to use it 2024-09-12T16:59:18.946 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_bad475c18c96ec20c5778159aa33ba72b84e9c1b/qa/tasks 2024-09-12T16:59:18.946 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-12T16:59:18.947 INFO:teuthology.task.internal:Checking packages... 2024-09-12T16:59:18.972 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'bad475c18c96ec20c5778159aa33ba72b84e9c1b' 2024-09-12T16:59:18.972 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-12T16:59:18.972 INFO:teuthology.packaging:ref: None 2024-09-12T16:59:18.972 INFO:teuthology.packaging:tag: None 2024-09-12T16:59:18.972 INFO:teuthology.packaging:branch: wip-rgw-meta-handlers 2024-09-12T16:59:18.972 INFO:teuthology.packaging:sha1: bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T16:59:18.973 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-rgw-meta-handlers 2024-09-12T16:59:19.119 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4762.gbad475c1 2024-09-12T16:59:19.120 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-12T16:59:19.127 INFO:teuthology.task.internal:no buildpackages task found 2024-09-12T16:59:19.127 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-12T16:59:19.168 INFO:teuthology.task.internal:Saving configuration 2024-09-12T16:59:19.186 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-12T16:59:19.219 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-12T16:59:19.245 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi037.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902711', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-12 16:54:39.473913', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBGAhRw41FuHuy5Iv7xRIO9Q/6JDidEVorpOjOF4A4t55UlvT4RSCPc17L7x1yJJs8WSwNmuzkPK/yw9tYBa7Xs='} 2024-09-12T16:59:19.270 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi040.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902711', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-12 16:54:39.475791', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKxlcDw2UzZOD/UXVwHiu6PNn4X5IxbOPq2HU6Yz6q2PPWcsHIl+TBjN9RdtLbgLMhyRfnKNQITsk6BJUJEqYbk='} 2024-09-12T16:59:19.270 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-12T16:59:19.276 INFO:teuthology.task.internal:roles: ubuntu@smithi037.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2024-09-12T16:59:19.276 INFO:teuthology.task.internal:roles: ubuntu@smithi040.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-09-12T16:59:19.276 INFO:teuthology.run_tasks:Running task console_log... 2024-09-12T16:59:19.373 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f68c4fbbac0>, signals=[15]) 2024-09-12T16:59:19.373 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-12T16:59:19.380 INFO:teuthology.task.internal:Opening connections... 2024-09-12T16:59:19.380 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi037.front.sepia.ceph.com 2024-09-12T16:59:19.381 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T16:59:19.456 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi040.front.sepia.ceph.com 2024-09-12T16:59:19.457 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T16:59:19.534 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-12T16:59:19.541 DEBUG:teuthology.orchestra.run.smithi037:> uname -m 2024-09-12T16:59:19.562 INFO:teuthology.orchestra.run.smithi037.stdout:x86_64 2024-09-12T16:59:19.562 DEBUG:teuthology.orchestra.run.smithi037:> cat /etc/os-release 2024-09-12T16:59:19.619 INFO:teuthology.orchestra.run.smithi037.stdout:NAME="CentOS Stream" 2024-09-12T16:59:19.619 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION="9" 2024-09-12T16:59:19.619 INFO:teuthology.orchestra.run.smithi037.stdout:ID="centos" 2024-09-12T16:59:19.619 INFO:teuthology.orchestra.run.smithi037.stdout:ID_LIKE="rhel fedora" 2024-09-12T16:59:19.619 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION_ID="9" 2024-09-12T16:59:19.619 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM_ID="platform:el9" 2024-09-12T16:59:19.620 INFO:teuthology.orchestra.run.smithi037.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-12T16:59:19.620 INFO:teuthology.orchestra.run.smithi037.stdout:ANSI_COLOR="0;31" 2024-09-12T16:59:19.620 INFO:teuthology.orchestra.run.smithi037.stdout:LOGO="fedora-logo-icon" 2024-09-12T16:59:19.620 INFO:teuthology.orchestra.run.smithi037.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-12T16:59:19.620 INFO:teuthology.orchestra.run.smithi037.stdout:HOME_URL="https://centos.org/" 2024-09-12T16:59:19.620 INFO:teuthology.orchestra.run.smithi037.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-12T16:59:19.620 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-12T16:59:19.620 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-12T16:59:19.621 INFO:teuthology.lock.ops:Updating smithi037.front.sepia.ceph.com on lock server 2024-09-12T16:59:19.640 DEBUG:teuthology.orchestra.run.smithi040:> uname -m 2024-09-12T16:59:19.658 INFO:teuthology.orchestra.run.smithi040.stdout:x86_64 2024-09-12T16:59:19.658 DEBUG:teuthology.orchestra.run.smithi040:> cat /etc/os-release 2024-09-12T16:59:19.716 INFO:teuthology.orchestra.run.smithi040.stdout:NAME="CentOS Stream" 2024-09-12T16:59:19.716 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION="9" 2024-09-12T16:59:19.716 INFO:teuthology.orchestra.run.smithi040.stdout:ID="centos" 2024-09-12T16:59:19.716 INFO:teuthology.orchestra.run.smithi040.stdout:ID_LIKE="rhel fedora" 2024-09-12T16:59:19.716 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION_ID="9" 2024-09-12T16:59:19.716 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM_ID="platform:el9" 2024-09-12T16:59:19.716 INFO:teuthology.orchestra.run.smithi040.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-12T16:59:19.716 INFO:teuthology.orchestra.run.smithi040.stdout:ANSI_COLOR="0;31" 2024-09-12T16:59:19.716 INFO:teuthology.orchestra.run.smithi040.stdout:LOGO="fedora-logo-icon" 2024-09-12T16:59:19.717 INFO:teuthology.orchestra.run.smithi040.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-12T16:59:19.717 INFO:teuthology.orchestra.run.smithi040.stdout:HOME_URL="https://centos.org/" 2024-09-12T16:59:19.717 INFO:teuthology.orchestra.run.smithi040.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-12T16:59:19.717 INFO:teuthology.orchestra.run.smithi040.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-12T16:59:19.717 INFO:teuthology.orchestra.run.smithi040.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-12T16:59:19.717 INFO:teuthology.lock.ops:Updating smithi040.front.sepia.ceph.com on lock server 2024-09-12T16:59:19.799 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-12T16:59:19.809 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-12T16:59:19.844 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-12T16:59:19.844 DEBUG:teuthology.orchestra.run.smithi037:> test '!' -e /home/ubuntu/cephtest 2024-09-12T16:59:19.847 DEBUG:teuthology.orchestra.run.smithi040:> test '!' -e /home/ubuntu/cephtest 2024-09-12T16:59:19.863 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-12T16:59:19.894 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-12T16:59:19.894 DEBUG:teuthology.orchestra.run.smithi037:> test -z $(ls -A /var/lib/ceph) 2024-09-12T16:59:19.904 DEBUG:teuthology.orchestra.run.smithi040:> test -z $(ls -A /var/lib/ceph) 2024-09-12T16:59:19.930 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-12T16:59:20.035 INFO:teuthology.run_tasks:Running task kernel... 2024-09-12T16:59:20.049 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-12T16:59:20.050 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-12T16:59:20.050 DEBUG:teuthology.orchestra.run.smithi037:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-12T16:59:20.050 DEBUG:teuthology.orchestra.run.smithi040:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-12T16:59:20.067 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T16:59:20.067 DEBUG:teuthology.orchestra.run.smithi037:> uname -r 2024-09-12T16:59:20.068 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T16:59:20.068 DEBUG:teuthology.orchestra.run.smithi040:> uname -r 2024-09-12T16:59:20.125 INFO:teuthology.orchestra.run.smithi040.stdout:5.14.0-503.el9.x86_64 2024-09-12T16:59:20.125 INFO:teuthology.task.kernel:Running kernel on smithi040: 5.14.0-503.el9.x86_64 2024-09-12T16:59:20.126 DEBUG:teuthology.orchestra.run.smithi040:> sudo yum install -y kernel 2024-09-12T16:59:20.126 INFO:teuthology.orchestra.run.smithi037.stdout:5.14.0-503.el9.x86_64 2024-09-12T16:59:20.127 INFO:teuthology.task.kernel:Running kernel on smithi037: 5.14.0-503.el9.x86_64 2024-09-12T16:59:20.127 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum install -y kernel 2024-09-12T16:59:22.850 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 9 - BaseOS 7.9 MB/s | 8.2 MB 00:01 2024-09-12T16:59:24.393 INFO:teuthology.orchestra.run.smithi040.stdout:CentOS Stream 9 - BaseOS 3.3 MB/s | 8.2 MB 00:02 2024-09-12T16:59:25.360 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 9 - AppStream 15 MB/s | 20 MB 00:01 2024-09-12T16:59:28.418 INFO:teuthology.orchestra.run.smithi040.stdout:CentOS Stream 9 - AppStream 7.2 MB/s | 20 MB 00:02 2024-09-12T16:59:29.744 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 9 - CRB 15 MB/s | 6.5 MB 00:00 2024-09-12T16:59:31.412 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 9 - Extras packages 46 kB/s | 19 kB 00:00 2024-09-12T16:59:32.332 INFO:teuthology.orchestra.run.smithi037.stdout:Extra Packages for Enterprise Linux 29 MB/s | 23 MB 00:00 2024-09-12T16:59:32.927 INFO:teuthology.orchestra.run.smithi040.stdout:CentOS Stream 9 - CRB 12 MB/s | 6.5 MB 00:00 2024-09-12T16:59:34.603 INFO:teuthology.orchestra.run.smithi040.stdout:CentOS Stream 9 - Extras packages 46 kB/s | 19 kB 00:00 2024-09-12T16:59:35.541 INFO:teuthology.orchestra.run.smithi040.stdout:Extra Packages for Enterprise Linux 28 MB/s | 23 MB 00:00 2024-09-12T16:59:38.072 INFO:teuthology.orchestra.run.smithi037.stdout:lab-extras 22 kB/s | 1.7 kB 00:00 2024-09-12T16:59:40.162 INFO:teuthology.orchestra.run.smithi037.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-12T16:59:40.162 INFO:teuthology.orchestra.run.smithi037.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-12T16:59:40.258 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2024-09-12T16:59:40.269 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-09-12T16:59:40.269 INFO:teuthology.orchestra.run.smithi037.stdout: Package Architecture Version Repository Size 2024-09-12T16:59:40.269 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-09-12T16:59:40.269 INFO:teuthology.orchestra.run.smithi037.stdout:Installing: 2024-09-12T16:59:40.269 INFO:teuthology.orchestra.run.smithi037.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-12T16:59:40.269 INFO:teuthology.orchestra.run.smithi037.stdout:Installing dependencies: 2024-09-12T16:59:40.270 INFO:teuthology.orchestra.run.smithi037.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-12T16:59:40.270 INFO:teuthology.orchestra.run.smithi037.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-12T16:59:40.270 INFO:teuthology.orchestra.run.smithi037.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-12T16:59:40.270 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T16:59:40.270 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2024-09-12T16:59:40.270 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-09-12T16:59:40.270 INFO:teuthology.orchestra.run.smithi037.stdout:Install 4 Packages 2024-09-12T16:59:40.270 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T16:59:40.271 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 79 M 2024-09-12T16:59:40.271 INFO:teuthology.orchestra.run.smithi037.stdout:Installed size: 126 M 2024-09-12T16:59:40.271 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading Packages: 2024-09-12T16:59:40.415 INFO:teuthology.orchestra.run.smithi037.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 244 kB/s | 23 kB 00:00 2024-09-12T16:59:40.815 INFO:teuthology.orchestra.run.smithi037.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 32 MB/s | 16 MB 00:00 2024-09-12T16:59:41.188 INFO:teuthology.orchestra.run.smithi040.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-09-12T16:59:41.199 INFO:teuthology.orchestra.run.smithi037.stdout:(3/4): kernel-modules-core-5.14.0-505.el9.x86_6 36 MB/s | 29 MB 00:00 2024-09-12T16:59:41.508 INFO:teuthology.orchestra.run.smithi037.stdout:(4/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 29 MB/s | 35 MB 00:01 2024-09-12T16:59:41.508 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2024-09-12T16:59:41.508 INFO:teuthology.orchestra.run.smithi037.stdout:Total 64 MB/s | 79 MB 00:01 2024-09-12T16:59:42.218 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2024-09-12T16:59:42.608 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction check succeeded. 2024-09-12T16:59:42.608 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2024-09-12T16:59:43.253 INFO:teuthology.orchestra.run.smithi040.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-12T16:59:43.253 INFO:teuthology.orchestra.run.smithi040.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-12T16:59:43.340 INFO:teuthology.orchestra.run.smithi040.stdout:Dependencies resolved. 2024-09-12T16:59:43.350 INFO:teuthology.orchestra.run.smithi040.stdout:================================================================================ 2024-09-12T16:59:43.350 INFO:teuthology.orchestra.run.smithi040.stdout: Package Architecture Version Repository Size 2024-09-12T16:59:43.350 INFO:teuthology.orchestra.run.smithi040.stdout:================================================================================ 2024-09-12T16:59:43.350 INFO:teuthology.orchestra.run.smithi040.stdout:Installing: 2024-09-12T16:59:43.350 INFO:teuthology.orchestra.run.smithi040.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-12T16:59:43.350 INFO:teuthology.orchestra.run.smithi040.stdout:Installing dependencies: 2024-09-12T16:59:43.351 INFO:teuthology.orchestra.run.smithi040.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-12T16:59:43.351 INFO:teuthology.orchestra.run.smithi040.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-12T16:59:43.351 INFO:teuthology.orchestra.run.smithi040.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-12T16:59:43.351 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-12T16:59:43.351 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction Summary 2024-09-12T16:59:43.351 INFO:teuthology.orchestra.run.smithi040.stdout:================================================================================ 2024-09-12T16:59:43.351 INFO:teuthology.orchestra.run.smithi040.stdout:Install 4 Packages 2024-09-12T16:59:43.351 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-12T16:59:43.352 INFO:teuthology.orchestra.run.smithi040.stdout:Total download size: 79 M 2024-09-12T16:59:43.352 INFO:teuthology.orchestra.run.smithi040.stdout:Installed size: 126 M 2024-09-12T16:59:43.352 INFO:teuthology.orchestra.run.smithi040.stdout:Downloading Packages: 2024-09-12T16:59:43.473 INFO:teuthology.orchestra.run.smithi040.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 227 kB/s | 23 kB 00:00 2024-09-12T16:59:43.566 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded. 2024-09-12T16:59:43.566 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2024-09-12T16:59:43.857 INFO:teuthology.orchestra.run.smithi040.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 32 MB/s | 16 MB 00:00 2024-09-12T16:59:44.240 INFO:teuthology.orchestra.run.smithi040.stdout:(3/4): kernel-modules-core-5.14.0-505.el9.x86_6 37 MB/s | 29 MB 00:00 2024-09-12T16:59:44.549 INFO:teuthology.orchestra.run.smithi040.stdout:(4/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 29 MB/s | 35 MB 00:01 2024-09-12T16:59:44.549 INFO:teuthology.orchestra.run.smithi040.stdout:-------------------------------------------------------------------------------- 2024-09-12T16:59:44.549 INFO:teuthology.orchestra.run.smithi040.stdout:Total 66 MB/s | 79 MB 00:01 2024-09-12T16:59:45.259 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction check 2024-09-12T16:59:45.633 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction check succeeded. 2024-09-12T16:59:45.633 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction test 2024-09-12T16:59:46.137 INFO:teuthology.orchestra.run.smithi037.stdout: Preparing : 1/1 2024-09-12T16:59:46.597 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction test succeeded. 2024-09-12T16:59:46.597 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction 2024-09-12T16:59:46.826 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-12T16:59:46.916 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T16:59:49.166 INFO:teuthology.orchestra.run.smithi040.stdout: Preparing : 1/1 2024-09-12T16:59:49.713 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T16:59:49.834 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-12T16:59:49.853 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T16:59:49.949 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T16:59:52.748 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T16:59:52.877 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T16:59:54.983 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T16:59:55.029 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-12T16:59:58.003 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T16:59:58.047 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-12T17:00:00.168 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T17:00:03.187 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T17:00:39.054 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T17:00:39.095 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-12T17:00:39.425 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-12T17:00:39.425 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-12T17:00:39.425 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T17:00:39.426 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T17:00:40.342 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T17:00:40.342 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:00:40.342 INFO:teuthology.orchestra.run.smithi037.stdout:Installed: 2024-09-12T17:00:40.342 INFO:teuthology.orchestra.run.smithi037.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-12T17:00:40.342 INFO:teuthology.orchestra.run.smithi037.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-12T17:00:40.342 INFO:teuthology.orchestra.run.smithi037.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-12T17:00:40.342 INFO:teuthology.orchestra.run.smithi037.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-12T17:00:40.342 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:00:40.343 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2024-09-12T17:00:40.700 DEBUG:teuthology.orchestra.run.smithi037:> rpm -q kernel | sort -rV | head -n 1 2024-09-12T17:00:40.795 INFO:teuthology.orchestra.run.smithi037.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-12T17:00:40.796 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-12T17:00:40.796 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-12T17:00:40.796 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-12T17:00:40.796 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-12T17:00:40.796 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-12T17:00:40.796 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi037.front.sepia.ceph.com, path=None, version=distro) 2024-09-12T17:00:40.796 DEBUG:teuthology.orchestra.run.smithi037:> rpm -q kernel | sort -rV | head -n 1 2024-09-12T17:00:40.856 INFO:teuthology.orchestra.run.smithi037.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-12T17:00:40.857 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-12T17:00:40.857 DEBUG:teuthology.orchestra.run.smithi037:> sudo rpm -qi grub2-tools 2024-09-12T17:00:40.888 INFO:teuthology.orchestra.run.smithi037.stdout:Name : grub2-tools 2024-09-12T17:00:40.889 INFO:teuthology.orchestra.run.smithi037.stdout:Epoch : 1 2024-09-12T17:00:40.889 INFO:teuthology.orchestra.run.smithi037.stdout:Version : 2.06 2024-09-12T17:00:40.889 INFO:teuthology.orchestra.run.smithi037.stdout:Release : 82.el9 2024-09-12T17:00:40.889 INFO:teuthology.orchestra.run.smithi037.stdout:Architecture: x86_64 2024-09-12T17:00:40.889 INFO:teuthology.orchestra.run.smithi037.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-12T17:00:40.889 INFO:teuthology.orchestra.run.smithi037.stdout:Group : Unspecified 2024-09-12T17:00:40.889 INFO:teuthology.orchestra.run.smithi037.stdout:Size : 8274670 2024-09-12T17:00:40.889 INFO:teuthology.orchestra.run.smithi037.stdout:License : GPLv3+ 2024-09-12T17:00:40.889 INFO:teuthology.orchestra.run.smithi037.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-12T17:00:40.889 INFO:teuthology.orchestra.run.smithi037.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-12T17:00:40.889 INFO:teuthology.orchestra.run.smithi037.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-12T17:00:40.889 INFO:teuthology.orchestra.run.smithi037.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-12T17:00:40.890 INFO:teuthology.orchestra.run.smithi037.stdout:Packager : builder@centos.org 2024-09-12T17:00:40.890 INFO:teuthology.orchestra.run.smithi037.stdout:Vendor : CentOS 2024-09-12T17:00:40.890 INFO:teuthology.orchestra.run.smithi037.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-12T17:00:40.890 INFO:teuthology.orchestra.run.smithi037.stdout:Summary : Support tools for GRUB. 2024-09-12T17:00:40.890 INFO:teuthology.orchestra.run.smithi037.stdout:Description : 2024-09-12T17:00:40.890 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:00:40.890 INFO:teuthology.orchestra.run.smithi037.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-12T17:00:40.890 INFO:teuthology.orchestra.run.smithi037.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-12T17:00:40.890 INFO:teuthology.orchestra.run.smithi037.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-12T17:00:40.890 INFO:teuthology.orchestra.run.smithi037.stdout:hardware devices. 2024-09-12T17:00:40.890 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:00:40.890 INFO:teuthology.orchestra.run.smithi037.stdout:This subpackage provides tools for support of all platforms. 2024-09-12T17:00:40.891 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-12T17:00:40.891 INFO:teuthology.task.kernel:Updating grub on smithi037 to boot 5.14.0-505.el9.x86_64 2024-09-12T17:00:40.891 DEBUG:teuthology.orchestra.run.smithi037:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-12T17:00:41.580 INFO:teuthology.orchestra.run.smithi037.stderr:Generating grub configuration file ... 2024-09-12T17:00:42.487 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T17:00:42.529 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-12T17:00:42.862 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-12T17:00:42.862 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-12T17:00:42.863 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T17:00:42.863 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T17:00:42.898 INFO:teuthology.orchestra.run.smithi037.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-12T17:00:42.927 INFO:teuthology.orchestra.run.smithi037.stderr:done 2024-09-12T17:00:42.932 DEBUG:teuthology.orchestra.run.smithi037:> mktemp 2024-09-12T17:00:42.992 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/tmp.zD7ygiGvjc 2024-09-12T17:00:42.993 DEBUG:teuthology.orchestra.run.smithi037:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.zD7ygiGvjc 2024-09-12T17:00:43.018 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 0666 /tmp/tmp.zD7ygiGvjc 2024-09-12T17:00:43.153 DEBUG:teuthology.orchestra.remote:smithi037:/tmp/tmp.zD7ygiGvjc is 6KB 2024-09-12T17:00:43.203 DEBUG:teuthology.orchestra.run.smithi037:> rm -fr /tmp/tmp.zD7ygiGvjc 2024-09-12T17:00:43.217 DEBUG:teuthology.orchestra.run.smithi037:> sudo /bin/ls /boot/loader/entries || true 2024-09-12T17:00:43.287 INFO:teuthology.orchestra.run.smithi037.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-12T17:00:43.287 INFO:teuthology.orchestra.run.smithi037.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-12T17:00:43.287 INFO:teuthology.orchestra.run.smithi037.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-12T17:00:43.288 INFO:teuthology.orchestra.run.smithi037.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-12T17:00:43.289 DEBUG:teuthology.orchestra.run.smithi037:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-12T17:00:43.438 DEBUG:teuthology.orchestra.run.smithi037:> sudo shutdown -r now 2024-09-12T17:00:43.669 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T17:00:43.669 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-12T17:00:43.669 INFO:teuthology.orchestra.run.smithi040.stdout:Installed: 2024-09-12T17:00:43.669 INFO:teuthology.orchestra.run.smithi040.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-12T17:00:43.669 INFO:teuthology.orchestra.run.smithi040.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-12T17:00:43.670 INFO:teuthology.orchestra.run.smithi040.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-12T17:00:43.670 INFO:teuthology.orchestra.run.smithi040.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-12T17:00:43.670 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-12T17:00:43.670 INFO:teuthology.orchestra.run.smithi040.stdout:Complete! 2024-09-12T17:00:43.999 DEBUG:teuthology.orchestra.run.smithi040:> rpm -q kernel | sort -rV | head -n 1 2024-09-12T17:00:44.094 INFO:teuthology.orchestra.run.smithi040.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-12T17:00:44.094 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-12T17:00:44.095 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-12T17:00:44.095 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-12T17:00:44.095 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-12T17:00:44.095 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-09-12T17:00:44.095 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi040.front.sepia.ceph.com, path=None, version=distro) 2024-09-12T17:00:44.095 DEBUG:teuthology.orchestra.run.smithi040:> rpm -q kernel | sort -rV | head -n 1 2024-09-12T17:00:44.154 INFO:teuthology.orchestra.run.smithi040.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-12T17:00:44.154 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-12T17:00:44.154 DEBUG:teuthology.orchestra.run.smithi040:> sudo rpm -qi grub2-tools 2024-09-12T17:00:44.185 INFO:teuthology.orchestra.run.smithi040.stdout:Name : grub2-tools 2024-09-12T17:00:44.186 INFO:teuthology.orchestra.run.smithi040.stdout:Epoch : 1 2024-09-12T17:00:44.186 INFO:teuthology.orchestra.run.smithi040.stdout:Version : 2.06 2024-09-12T17:00:44.186 INFO:teuthology.orchestra.run.smithi040.stdout:Release : 82.el9 2024-09-12T17:00:44.186 INFO:teuthology.orchestra.run.smithi040.stdout:Architecture: x86_64 2024-09-12T17:00:44.186 INFO:teuthology.orchestra.run.smithi040.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-12T17:00:44.186 INFO:teuthology.orchestra.run.smithi040.stdout:Group : Unspecified 2024-09-12T17:00:44.186 INFO:teuthology.orchestra.run.smithi040.stdout:Size : 8274670 2024-09-12T17:00:44.186 INFO:teuthology.orchestra.run.smithi040.stdout:License : GPLv3+ 2024-09-12T17:00:44.186 INFO:teuthology.orchestra.run.smithi040.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-12T17:00:44.186 INFO:teuthology.orchestra.run.smithi040.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-12T17:00:44.186 INFO:teuthology.orchestra.run.smithi040.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-12T17:00:44.186 INFO:teuthology.orchestra.run.smithi040.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-12T17:00:44.186 INFO:teuthology.orchestra.run.smithi040.stdout:Packager : builder@centos.org 2024-09-12T17:00:44.187 INFO:teuthology.orchestra.run.smithi040.stdout:Vendor : CentOS 2024-09-12T17:00:44.187 INFO:teuthology.orchestra.run.smithi040.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-12T17:00:44.187 INFO:teuthology.orchestra.run.smithi040.stdout:Summary : Support tools for GRUB. 2024-09-12T17:00:44.187 INFO:teuthology.orchestra.run.smithi040.stdout:Description : 2024-09-12T17:00:44.187 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-12T17:00:44.187 INFO:teuthology.orchestra.run.smithi040.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-12T17:00:44.187 INFO:teuthology.orchestra.run.smithi040.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-12T17:00:44.187 INFO:teuthology.orchestra.run.smithi040.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-12T17:00:44.187 INFO:teuthology.orchestra.run.smithi040.stdout:hardware devices. 2024-09-12T17:00:44.187 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-12T17:00:44.187 INFO:teuthology.orchestra.run.smithi040.stdout:This subpackage provides tools for support of all platforms. 2024-09-12T17:00:44.188 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-12T17:00:44.188 INFO:teuthology.task.kernel:Updating grub on smithi040 to boot 5.14.0-505.el9.x86_64 2024-09-12T17:00:44.188 DEBUG:teuthology.orchestra.run.smithi040:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-12T17:00:44.878 INFO:teuthology.orchestra.run.smithi040.stderr:Generating grub configuration file ... 2024-09-12T17:00:46.204 INFO:teuthology.orchestra.run.smithi040.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-12T17:00:46.241 INFO:teuthology.orchestra.run.smithi040.stderr:done 2024-09-12T17:00:46.248 DEBUG:teuthology.orchestra.run.smithi040:> mktemp 2024-09-12T17:00:46.264 INFO:teuthology.orchestra.run.smithi040.stdout:/tmp/tmp.qw8I19an0W 2024-09-12T17:00:46.264 DEBUG:teuthology.orchestra.run.smithi040:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.qw8I19an0W 2024-09-12T17:00:46.330 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod 0666 /tmp/tmp.qw8I19an0W 2024-09-12T17:00:46.478 DEBUG:teuthology.orchestra.remote:smithi040:/tmp/tmp.qw8I19an0W is 6KB 2024-09-12T17:00:46.529 DEBUG:teuthology.orchestra.run.smithi040:> rm -fr /tmp/tmp.qw8I19an0W 2024-09-12T17:00:46.545 DEBUG:teuthology.orchestra.run.smithi040:> sudo /bin/ls /boot/loader/entries || true 2024-09-12T17:00:46.607 INFO:teuthology.orchestra.run.smithi040.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-12T17:00:46.607 INFO:teuthology.orchestra.run.smithi040.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-12T17:00:46.607 INFO:teuthology.orchestra.run.smithi040.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-12T17:00:46.607 INFO:teuthology.orchestra.run.smithi040.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-12T17:00:46.608 DEBUG:teuthology.orchestra.run.smithi040:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-12T17:00:46.765 DEBUG:teuthology.orchestra.run.smithi040:> sudo shutdown -r now 2024-09-12T17:01:13.466 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-12T17:01:13.467 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi037.front.sepia.ceph.com' 2024-09-12T17:01:13.468 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T17:01:16.771 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-09-12T17:01:16.772 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi040.front.sepia.ceph.com' 2024-09-12T17:01:16.772 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T17:02:13.526 DEBUG:teuthology.orchestra.remote:timed out 2024-09-12T17:02:16.777 DEBUG:teuthology.orchestra.remote:timed out 2024-09-12T17:02:22.529 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi037.front.sepia.ceph.com' 2024-09-12T17:02:22.530 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T17:02:22.892 DEBUG:teuthology.orchestra.run.smithi037:> true 2024-09-12T17:02:23.330 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi037.front.sepia.ceph.com' 2024-09-12T17:02:23.330 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-505.el9.x86_64"... 2024-09-12T17:02:23.330 DEBUG:teuthology.orchestra.run.smithi037:> uname -r 2024-09-12T17:02:23.346 INFO:teuthology.orchestra.run.smithi037.stdout:5.14.0-505.el9.x86_64 2024-09-12T17:02:23.346 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-12T17:02:23.346 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-12T17:02:23.346 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-12T17:02:24.347 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-12T17:02:24.348 DEBUG:teuthology.orchestra.run.smithi037:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-12T17:02:24.401 INFO:teuthology.orchestra.run.smithi037.stdout:ttyS1 2024-09-12T17:02:24.421 DEBUG:teuthology.parallel:result is None 2024-09-12T17:02:25.778 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi040.front.sepia.ceph.com' 2024-09-12T17:02:25.779 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T17:02:26.372 DEBUG:teuthology.orchestra.run.smithi040:> true 2024-09-12T17:02:26.838 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi040.front.sepia.ceph.com' 2024-09-12T17:02:26.838 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-505.el9.x86_64"... 2024-09-12T17:02:26.838 DEBUG:teuthology.orchestra.run.smithi040:> uname -r 2024-09-12T17:02:26.854 INFO:teuthology.orchestra.run.smithi040.stdout:5.14.0-505.el9.x86_64 2024-09-12T17:02:26.854 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-12T17:02:26.854 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-12T17:02:26.855 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-12T17:02:27.856 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-09-12T17:02:27.856 DEBUG:teuthology.orchestra.run.smithi040:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-12T17:02:27.964 INFO:teuthology.orchestra.run.smithi040.stdout:ttyS1 2024-09-12T17:02:27.994 DEBUG:teuthology.parallel:result is None 2024-09-12T17:02:27.994 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-12T17:02:28.003 INFO:teuthology.task.internal:Creating test directory... 2024-09-12T17:02:28.003 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-12T17:02:28.006 DEBUG:teuthology.orchestra.run.smithi040:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-12T17:02:28.023 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-12T17:02:28.042 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-12T17:02:28.075 INFO:teuthology.task.internal:Creating archive directory... 2024-09-12T17:02:28.075 DEBUG:teuthology.orchestra.run.smithi037:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-12T17:02:28.078 DEBUG:teuthology.orchestra.run.smithi040:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-12T17:02:28.110 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-12T17:02:28.117 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-12T17:02:28.117 DEBUG:teuthology.orchestra.run.smithi037:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-12T17:02:28.148 DEBUG:teuthology.orchestra.run.smithi040:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-12T17:02:28.181 INFO:teuthology.orchestra.run.smithi040.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T17:02:28.185 INFO:teuthology.orchestra.run.smithi037.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T17:02:28.191 INFO:teuthology.orchestra.run.smithi040.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T17:02:28.198 INFO:teuthology.orchestra.run.smithi037.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T17:02:28.200 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-12T17:02:28.206 INFO:teuthology.task.internal:Configuring sudo... 2024-09-12T17:02:28.206 DEBUG:teuthology.orchestra.run.smithi037:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-12T17:02:28.243 DEBUG:teuthology.orchestra.run.smithi040:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-12T17:02:28.270 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-12T17:02:28.279 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-12T17:02:28.279 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-12T17:02:28.313 DEBUG:teuthology.orchestra.run.smithi040:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-12T17:02:28.328 DEBUG:teuthology.orchestra.run.smithi037:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T17:02:28.412 DEBUG:teuthology.orchestra.run.smithi037:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T17:02:28.458 DEBUG:teuthology.orchestra.run.smithi037:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T17:02:28.542 DEBUG:teuthology.orchestra.run.smithi037:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T17:02:28.586 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-09-12T17:02:28.586 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-12T17:02:28.654 DEBUG:teuthology.orchestra.run.smithi040:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T17:02:28.697 DEBUG:teuthology.orchestra.run.smithi040:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T17:02:28.748 DEBUG:teuthology.orchestra.run.smithi040:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T17:02:28.832 DEBUG:teuthology.orchestra.run.smithi040:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T17:02:28.876 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-09-12T17:02:28.876 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-12T17:02:28.972 DEBUG:teuthology.orchestra.run.smithi037:> sudo service rsyslog restart 2024-09-12T17:02:28.974 DEBUG:teuthology.orchestra.run.smithi040:> sudo service rsyslog restart 2024-09-12T17:02:29.017 INFO:teuthology.orchestra.run.smithi037.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T17:02:29.058 INFO:teuthology.orchestra.run.smithi040.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T17:02:29.535 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-12T17:02:29.777 INFO:teuthology.task.internal:Starting timer... 2024-09-12T17:02:29.777 INFO:teuthology.run_tasks:Running task pcp... 2024-09-12T17:02:29.841 INFO:teuthology.run_tasks:Running task selinux... 2024-09-12T17:02:29.854 DEBUG:teuthology.orchestra.run.smithi037:> sudo service auditd rotate 2024-09-12T17:02:29.906 INFO:teuthology.orchestra.run.smithi037.stdout:Rotating logs: 2024-09-12T17:02:29.908 DEBUG:teuthology.orchestra.run.smithi040:> sudo service auditd rotate 2024-09-12T17:02:29.982 INFO:teuthology.orchestra.run.smithi040.stdout:Rotating logs: 2024-09-12T17:02:29.984 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-12T17:02:29.984 DEBUG:teuthology.orchestra.run.smithi037:> /usr/sbin/getenforce 2024-09-12T17:02:30.046 INFO:teuthology.orchestra.run.smithi037.stdout:Permissive 2024-09-12T17:02:30.046 DEBUG:teuthology.orchestra.run.smithi040:> /usr/sbin/getenforce 2024-09-12T17:02:30.070 INFO:teuthology.orchestra.run.smithi040.stdout:Permissive 2024-09-12T17:02:30.070 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi037.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi040.front.sepia.ceph.com': 'permissive'} 2024-09-12T17:02:30.070 DEBUG:teuthology.orchestra.run.smithi037:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-12T17:02:30.098 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T17:02:30.098 DEBUG:teuthology.orchestra.run.smithi040:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-12T17:02:30.134 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T17:02:30.135 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-12T17:02:30.135 DEBUG:teuthology.orchestra.run.smithi037:> sudo /usr/sbin/setenforce permissive 2024-09-12T17:02:30.174 DEBUG:teuthology.orchestra.run.smithi040:> sudo /usr/sbin/setenforce permissive 2024-09-12T17:02:30.211 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-12T17:02:30.220 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-12T17:02:30.235 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-12T17:02:30.236 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi037.front.sepia.ceph.com,smithi040.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-12T17:06:26.121 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi037.front.sepia.ceph.com'), Remote(name='ubuntu@smithi040.front.sepia.ceph.com')] 2024-09-12T17:06:26.123 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi037.front.sepia.ceph.com' 2024-09-12T17:06:26.124 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T17:06:26.213 DEBUG:teuthology.orchestra.run.smithi037:> true 2024-09-12T17:06:26.289 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi037.front.sepia.ceph.com' 2024-09-12T17:06:26.289 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi040.front.sepia.ceph.com' 2024-09-12T17:06:26.290 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T17:06:26.368 DEBUG:teuthology.orchestra.run.smithi040:> true 2024-09-12T17:06:26.446 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi040.front.sepia.ceph.com' 2024-09-12T17:06:26.446 INFO:teuthology.run_tasks:Running task clock... 2024-09-12T17:06:26.510 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-12T17:06:26.510 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-12T17:06:26.511 DEBUG:teuthology.orchestra.run.smithi037:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T17:06:26.513 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-12T17:06:26.513 DEBUG:teuthology.orchestra.run.smithi040:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T17:06:26.542 INFO:teuthology.orchestra.run.smithi037.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-12T17:06:26.546 INFO:teuthology.orchestra.run.smithi040.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-12T17:06:26.559 INFO:teuthology.orchestra.run.smithi037.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-12T17:06:26.562 INFO:teuthology.orchestra.run.smithi040.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-12T17:06:26.585 INFO:teuthology.orchestra.run.smithi037.stderr:sudo: ntpd: command not found 2024-09-12T17:06:26.588 INFO:teuthology.orchestra.run.smithi040.stderr:sudo: ntpd: command not found 2024-09-12T17:06:26.597 INFO:teuthology.orchestra.run.smithi037.stdout:506 Cannot talk to daemon 2024-09-12T17:06:26.600 INFO:teuthology.orchestra.run.smithi040.stdout:506 Cannot talk to daemon 2024-09-12T17:06:26.613 INFO:teuthology.orchestra.run.smithi037.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-12T17:06:26.615 INFO:teuthology.orchestra.run.smithi040.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-12T17:06:26.628 INFO:teuthology.orchestra.run.smithi037.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-12T17:06:26.630 INFO:teuthology.orchestra.run.smithi040.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-12T17:06:26.686 INFO:teuthology.orchestra.run.smithi040.stderr:bash: line 1: ntpq: command not found 2024-09-12T17:06:26.690 INFO:teuthology.orchestra.run.smithi040.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T17:06:26.690 INFO:teuthology.orchestra.run.smithi040.stdout:=============================================================================== 2024-09-12T17:06:26.690 INFO:teuthology.orchestra.run.smithi040.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T17:06:26.690 INFO:teuthology.orchestra.run.smithi040.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T17:06:26.690 INFO:teuthology.orchestra.run.smithi040.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T17:06:26.690 INFO:teuthology.orchestra.run.smithi040.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T17:06:26.694 INFO:teuthology.orchestra.run.smithi037.stderr:bash: line 1: ntpq: command not found 2024-09-12T17:06:26.698 INFO:teuthology.orchestra.run.smithi037.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T17:06:26.698 INFO:teuthology.orchestra.run.smithi037.stdout:=============================================================================== 2024-09-12T17:06:26.698 INFO:teuthology.orchestra.run.smithi037.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T17:06:26.698 INFO:teuthology.orchestra.run.smithi037.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T17:06:26.698 INFO:teuthology.orchestra.run.smithi037.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T17:06:26.698 INFO:teuthology.orchestra.run.smithi037.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T17:06:26.699 INFO:teuthology.run_tasks:Running task install... 2024-09-12T17:06:26.707 DEBUG:teuthology.task.install:project ceph 2024-09-12T17:06:26.707 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'}} 2024-09-12T17:06:26.707 DEBUG:teuthology.task.install:config {'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'flavor': 'default', 'sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'} 2024-09-12T17:06:26.707 INFO:teuthology.task.install:Using flavor: default 2024-09-12T17:06:26.713 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-12T17:06:26.713 INFO:teuthology.task.install:extra packages: [] 2024-09-12T17:06:26.713 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b', 'tag': None, 'wait_for_package': False} 2024-09-12T17:06:26.714 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T17:06:26.716 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b', 'tag': None, 'wait_for_package': False} 2024-09-12T17:06:26.716 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T17:06:26.857 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/centos/9/flavors/default/ 2024-09-12T17:06:26.857 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4762.gbad475c1 2024-09-12T17:06:26.864 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/centos/9/flavors/default/ 2024-09-12T17:06:26.864 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4762.gbad475c1 2024-09-12T17:06:26.969 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-12T17:06:26.969 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-09-12T17:06:26.969 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-12T17:06:26.972 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-12T17:06:26.973 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-09-12T17:06:26.973 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-12T17:06:26.997 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, s3cmd, maven, s3cmd, maven, s3cmd, maven on remote rpm x86_64 2024-09-12T17:06:26.997 DEBUG:teuthology.orchestra.run.smithi037:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/bad475c18c96ec20c5778159aa33ba72b84e9c1b/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-12T17:06:27.000 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, s3cmd, maven, s3cmd, maven, s3cmd, maven, s3cmd, maven on remote rpm x86_64 2024-09-12T17:06:27.000 DEBUG:teuthology.orchestra.run.smithi040:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/bad475c18c96ec20c5778159aa33ba72b84e9c1b/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-12T17:06:27.064 DEBUG:teuthology.orchestra.run.smithi037:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-12T17:06:27.068 DEBUG:teuthology.orchestra.run.smithi040:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-12T17:06:27.140 DEBUG:teuthology.orchestra.run.smithi037:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-12T17:06:27.145 DEBUG:teuthology.orchestra.run.smithi040:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-12T17:06:27.205 INFO:teuthology.orchestra.run.smithi037.stdout:check_obsoletes = 1 2024-09-12T17:06:27.207 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum clean all 2024-09-12T17:06:27.209 INFO:teuthology.orchestra.run.smithi040.stdout:check_obsoletes = 1 2024-09-12T17:06:27.211 DEBUG:teuthology.orchestra.run.smithi040:> sudo yum clean all 2024-09-12T17:06:27.445 INFO:teuthology.orchestra.run.smithi040.stdout:45 files removed 2024-09-12T17:06:27.455 INFO:teuthology.orchestra.run.smithi037.stdout:45 files removed 2024-09-12T17:06:27.472 DEBUG:teuthology.orchestra.run.smithi040:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd s3cmd maven s3cmd maven s3cmd maven s3cmd maven 2024-09-12T17:06:27.482 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd s3cmd maven s3cmd maven s3cmd maven s3cmd maven 2024-09-12T17:06:28.040 INFO:teuthology.orchestra.run.smithi040.stdout:ceph packages for x86_64 316 kB/s | 84 kB 00:00 2024-09-12T17:06:28.049 INFO:teuthology.orchestra.run.smithi037.stdout:ceph packages for x86_64 316 kB/s | 84 kB 00:00 2024-09-12T17:06:28.340 INFO:teuthology.orchestra.run.smithi040.stdout:ceph noarch packages 95 kB/s | 24 kB 00:00 2024-09-12T17:06:28.350 INFO:teuthology.orchestra.run.smithi037.stdout:ceph noarch packages 95 kB/s | 24 kB 00:00 2024-09-12T17:06:28.624 INFO:teuthology.orchestra.run.smithi040.stdout:ceph source packages 7.9 kB/s | 1.9 kB 00:00 2024-09-12T17:06:28.625 INFO:teuthology.orchestra.run.smithi037.stdout:ceph source packages 8.2 kB/s | 1.9 kB 00:00 2024-09-12T17:06:30.332 INFO:teuthology.orchestra.run.smithi040.stdout:CentOS Stream 9 - BaseOS 4.9 MB/s | 8.2 MB 00:01 2024-09-12T17:06:30.417 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 9 - BaseOS 4.7 MB/s | 8.2 MB 00:01 2024-09-12T17:06:32.461 INFO:teuthology.orchestra.run.smithi040.stdout:CentOS Stream 9 - AppStream 21 MB/s | 20 MB 00:00 2024-09-12T17:06:36.937 INFO:teuthology.orchestra.run.smithi040.stdout:CentOS Stream 9 - CRB 13 MB/s | 6.5 MB 00:00 2024-09-12T17:06:38.604 INFO:teuthology.orchestra.run.smithi040.stdout:CentOS Stream 9 - Extras packages 46 kB/s | 19 kB 00:00 2024-09-12T17:06:39.417 INFO:teuthology.orchestra.run.smithi040.stdout:Extra Packages for Enterprise Linux 34 MB/s | 23 MB 00:00 2024-09-12T17:06:45.106 INFO:teuthology.orchestra.run.smithi040.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-09-12T17:06:47.486 INFO:teuthology.orchestra.run.smithi040.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T17:06:47.487 INFO:teuthology.orchestra.run.smithi040.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T17:06:47.585 INFO:teuthology.orchestra.run.smithi040.stdout:Dependencies resolved. 2024-09-12T17:06:47.606 INFO:teuthology.orchestra.run.smithi040.stdout:====================================================================================================== 2024-09-12T17:06:47.606 INFO:teuthology.orchestra.run.smithi040.stdout: Package Arch Version Repository Size 2024-09-12T17:06:47.606 INFO:teuthology.orchestra.run.smithi040.stdout:====================================================================================================== 2024-09-12T17:06:47.606 INFO:teuthology.orchestra.run.smithi040.stdout:Installing: 2024-09-12T17:06:47.606 INFO:teuthology.orchestra.run.smithi040.stdout: ceph x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 6.6 k 2024-09-12T17:06:47.606 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-base x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 5.5 M 2024-09-12T17:06:47.606 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-fuse x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 900 k 2024-09-12T17:06:47.606 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 145 k 2024-09-12T17:06:47.606 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 1.5 M 2024-09-12T17:06:47.607 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 154 k 2024-09-12T17:06:47.607 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 14 M 2024-09-12T17:06:47.607 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 7.4 M 2024-09-12T17:06:47.607 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-rook noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 49 k 2024-09-12T17:06:47.607 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-radosgw x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 11 M 2024-09-12T17:06:47.607 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-test x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 45 M 2024-09-12T17:06:47.607 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-volume noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 285 k 2024-09-12T17:06:47.607 INFO:teuthology.orchestra.run.smithi040.stdout: cephadm noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 783 k 2024-09-12T17:06:47.607 INFO:teuthology.orchestra.run.smithi040.stdout: libcephfs-devel x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 32 k 2024-09-12T17:06:47.607 INFO:teuthology.orchestra.run.smithi040.stdout: libcephfs2 x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 756 k 2024-09-12T17:06:47.607 INFO:teuthology.orchestra.run.smithi040.stdout: librados-devel x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 126 k 2024-09-12T17:06:47.607 INFO:teuthology.orchestra.run.smithi040.stdout: maven noarch 1:3.6.3-15.el9 appstream 18 k 2024-09-12T17:06:47.607 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cephfs x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 161 k 2024-09-12T17:06:47.608 INFO:teuthology.orchestra.run.smithi040.stdout: python3-rados x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 321 k 2024-09-12T17:06:47.608 INFO:teuthology.orchestra.run.smithi040.stdout: python3-rbd x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 305 k 2024-09-12T17:06:47.608 INFO:teuthology.orchestra.run.smithi040.stdout: python3-rgw x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 99 k 2024-09-12T17:06:47.608 INFO:teuthology.orchestra.run.smithi040.stdout: rbd-fuse x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 85 k 2024-09-12T17:06:47.608 INFO:teuthology.orchestra.run.smithi040.stdout: rbd-mirror x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 3.2 M 2024-09-12T17:06:47.608 INFO:teuthology.orchestra.run.smithi040.stdout: rbd-nbd x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 170 k 2024-09-12T17:06:47.608 INFO:teuthology.orchestra.run.smithi040.stdout: s3cmd noarch 2.4.0-1.el9 epel 206 k 2024-09-12T17:06:47.608 INFO:teuthology.orchestra.run.smithi040.stdout:Upgrading: 2024-09-12T17:06:47.608 INFO:teuthology.orchestra.run.smithi040.stdout: librados2 x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 3.5 M 2024-09-12T17:06:47.608 INFO:teuthology.orchestra.run.smithi040.stdout: librbd1 x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 3.2 M 2024-09-12T17:06:47.608 INFO:teuthology.orchestra.run.smithi040.stdout:Installing dependencies: 2024-09-12T17:06:47.608 INFO:teuthology.orchestra.run.smithi040.stdout: ModemManager-glib x86_64 1.20.2-1.el9 baseos 335 k 2024-09-12T17:06:47.608 INFO:teuthology.orchestra.run.smithi040.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-12T17:06:47.609 INFO:teuthology.orchestra.run.smithi040.stdout: adwaita-cursor-theme noarch 40.1.1-3.el9 appstream 650 k 2024-09-12T17:06:47.609 INFO:teuthology.orchestra.run.smithi040.stdout: adwaita-icon-theme noarch 40.1.1-3.el9 appstream 12 M 2024-09-12T17:06:47.609 INFO:teuthology.orchestra.run.smithi040.stdout: alsa-lib x86_64 1.2.12-1.el9 appstream 523 k 2024-09-12T17:06:47.609 INFO:teuthology.orchestra.run.smithi040.stdout: apache-commons-cli noarch 1.4-17.el9 appstream 71 k 2024-09-12T17:06:47.609 INFO:teuthology.orchestra.run.smithi040.stdout: apache-commons-codec noarch 1.15-7.el9 appstream 302 k 2024-09-12T17:06:47.609 INFO:teuthology.orchestra.run.smithi040.stdout: apache-commons-io noarch 1:2.8.0-8.el9 appstream 283 k 2024-09-12T17:06:47.609 INFO:teuthology.orchestra.run.smithi040.stdout: apache-commons-lang3 noarch 3.12.0-6.el9 appstream 559 k 2024-09-12T17:06:47.609 INFO:teuthology.orchestra.run.smithi040.stdout: at-spi2-atk x86_64 2.38.0-4.el9 appstream 87 k 2024-09-12T17:06:47.609 INFO:teuthology.orchestra.run.smithi040.stdout: at-spi2-core x86_64 2.40.3-1.el9 appstream 195 k 2024-09-12T17:06:47.609 INFO:teuthology.orchestra.run.smithi040.stdout: atinject noarch 1.0.3-6.el9 appstream 23 k 2024-09-12T17:06:47.609 INFO:teuthology.orchestra.run.smithi040.stdout: atk x86_64 2.36.0-5.el9 appstream 292 k 2024-09-12T17:06:47.609 INFO:teuthology.orchestra.run.smithi040.stdout: avahi-glib x86_64 0.8-21.el9 appstream 15 k 2024-09-12T17:06:47.609 INFO:teuthology.orchestra.run.smithi040.stdout: bluez-libs x86_64 5.56-6.el9 baseos 85 k 2024-09-12T17:06:47.609 INFO:teuthology.orchestra.run.smithi040.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-12T17:06:47.610 INFO:teuthology.orchestra.run.smithi040.stdout: bubblewrap x86_64 0.4.1-7.el9 baseos 49 k 2024-09-12T17:06:47.610 INFO:teuthology.orchestra.run.smithi040.stdout: cdi-api noarch 2.0.2-6.el9 appstream 53 k 2024-09-12T17:06:47.610 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-common x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 22 M 2024-09-12T17:06:47.610 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 34 k 2024-09-12T17:06:47.610 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mds x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 2.4 M 2024-09-12T17:06:47.610 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 291 k 2024-09-12T17:06:47.610 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mon x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 4.8 M 2024-09-12T17:06:47.610 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-osd x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 17 M 2024-09-12T17:06:47.610 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 16 k 2024-09-12T17:06:47.610 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-selinux x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 25 k 2024-09-12T17:06:47.610 INFO:teuthology.orchestra.run.smithi040.stdout: colord-libs x86_64 1.4.5-4.el9 appstream 229 k 2024-09-12T17:06:47.610 INFO:teuthology.orchestra.run.smithi040.stdout: composefs-libs x86_64 1.0.5-1.el9 appstream 61 k 2024-09-12T17:06:47.611 INFO:teuthology.orchestra.run.smithi040.stdout: copy-jdk-configs noarch 4.0-3.el9 appstream 28 k 2024-09-12T17:06:47.611 INFO:teuthology.orchestra.run.smithi040.stdout: cups-libs x86_64 1:2.3.3op2-30.el9 baseos 262 k 2024-09-12T17:06:47.611 INFO:teuthology.orchestra.run.smithi040.stdout: exempi x86_64 2.6.0-0.2.20211007gite23c213.el9 appstream 525 k 2024-09-12T17:06:47.611 INFO:teuthology.orchestra.run.smithi040.stdout: exiv2-libs x86_64 0.27.5-2.el9 appstream 781 k 2024-09-12T17:06:47.611 INFO:teuthology.orchestra.run.smithi040.stdout: fdk-aac-free x86_64 2.0.0-8.el9 appstream 325 k 2024-09-12T17:06:47.611 INFO:teuthology.orchestra.run.smithi040.stdout: flac-libs x86_64 1.3.3-12.el9 appstream 218 k 2024-09-12T17:06:47.611 INFO:teuthology.orchestra.run.smithi040.stdout: flatpak-selinux noarch 1.12.9-1.el9 appstream 22 k 2024-09-12T17:06:47.611 INFO:teuthology.orchestra.run.smithi040.stdout: flatpak-session-helper x86_64 1.12.9-1.el9 appstream 73 k 2024-09-12T17:06:47.611 INFO:teuthology.orchestra.run.smithi040.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-12T17:06:47.611 INFO:teuthology.orchestra.run.smithi040.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-12T17:06:47.611 INFO:teuthology.orchestra.run.smithi040.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-12T17:06:47.611 INFO:teuthology.orchestra.run.smithi040.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-12T17:06:47.612 INFO:teuthology.orchestra.run.smithi040.stdout: gdk-pixbuf2-modules x86_64 2.42.6-4.el9 appstream 89 k 2024-09-12T17:06:47.612 INFO:teuthology.orchestra.run.smithi040.stdout: geoclue2 x86_64 2.6.0-7.el9 appstream 124 k 2024-09-12T17:06:47.612 INFO:teuthology.orchestra.run.smithi040.stdout: giflib x86_64 5.2.1-9.el9 appstream 49 k 2024-09-12T17:06:47.612 INFO:teuthology.orchestra.run.smithi040.stdout: google-guice noarch 4.2.3-9.el9 appstream 473 k 2024-09-12T17:06:47.612 INFO:teuthology.orchestra.run.smithi040.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-12T17:06:47.612 INFO:teuthology.orchestra.run.smithi040.stdout: graphene x86_64 1.10.6-2.el9 appstream 64 k 2024-09-12T17:06:47.612 INFO:teuthology.orchestra.run.smithi040.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-12T17:06:47.612 INFO:teuthology.orchestra.run.smithi040.stdout: gsm x86_64 1.0.19-6.el9 appstream 34 k 2024-09-12T17:06:47.612 INFO:teuthology.orchestra.run.smithi040.stdout: gstreamer1 x86_64 1.22.1-2.el9 appstream 1.4 M 2024-09-12T17:06:47.612 INFO:teuthology.orchestra.run.smithi040.stdout: gstreamer1-plugins-base x86_64 1.22.1-2.el9 appstream 2.2 M 2024-09-12T17:06:47.612 INFO:teuthology.orchestra.run.smithi040.stdout: gtk-update-icon-cache x86_64 3.24.31-5.el9 appstream 33 k 2024-09-12T17:06:47.612 INFO:teuthology.orchestra.run.smithi040.stdout: guava noarch 30.1-6.el9 appstream 2.3 M 2024-09-12T17:06:47.613 INFO:teuthology.orchestra.run.smithi040.stdout: hicolor-icon-theme noarch 0.17-13.el9 appstream 219 k 2024-09-12T17:06:47.613 INFO:teuthology.orchestra.run.smithi040.stdout: httpcomponents-client noarch 4.5.13-3.el9 appstream 657 k 2024-09-12T17:06:47.613 INFO:teuthology.orchestra.run.smithi040.stdout: httpcomponents-core noarch 4.4.13-7.el9 appstream 632 k 2024-09-12T17:06:47.613 INFO:teuthology.orchestra.run.smithi040.stdout: iso-codes noarch 4.6.0-3.el9 appstream 3.5 M 2024-09-12T17:06:47.613 INFO:teuthology.orchestra.run.smithi040.stdout: jakarta-annotations noarch 1.3.5-13.el9 appstream 45 k 2024-09-12T17:06:47.613 INFO:teuthology.orchestra.run.smithi040.stdout: jansi x86_64 2.3.3-6.el9 appstream 110 k 2024-09-12T17:06:47.613 INFO:teuthology.orchestra.run.smithi040.stdout: java-11-openjdk x86_64 1:11.0.20.1.1-2.el9 appstream 413 k 2024-09-12T17:06:47.613 INFO:teuthology.orchestra.run.smithi040.stdout: java-11-openjdk-headless x86_64 1:11.0.20.1.1-2.el9 appstream 39 M 2024-09-12T17:06:47.613 INFO:teuthology.orchestra.run.smithi040.stdout: javapackages-filesystem noarch 6.0.0-4.el9 appstream 13 k 2024-09-12T17:06:47.613 INFO:teuthology.orchestra.run.smithi040.stdout: jbigkit-libs x86_64 2.1-23.el9 appstream 53 k 2024-09-12T17:06:47.613 INFO:teuthology.orchestra.run.smithi040.stdout: jcl-over-slf4j noarch 1.7.30-13.el9 appstream 24 k 2024-09-12T17:06:47.613 INFO:teuthology.orchestra.run.smithi040.stdout: jsoup noarch 1.13.1-10.el9 appstream 377 k 2024-09-12T17:06:47.613 INFO:teuthology.orchestra.run.smithi040.stdout: jsr-305 noarch 3.0.2-6.el9 appstream 35 k 2024-09-12T17:06:47.614 INFO:teuthology.orchestra.run.smithi040.stdout: lcms2 x86_64 2.12-3.el9 appstream 168 k 2024-09-12T17:06:47.614 INFO:teuthology.orchestra.run.smithi040.stdout: libX11-xcb x86_64 1.7.0-9.el9 appstream 11 k 2024-09-12T17:06:47.614 INFO:teuthology.orchestra.run.smithi040.stdout: libXcomposite x86_64 0.4.5-7.el9 appstream 24 k 2024-09-12T17:06:47.614 INFO:teuthology.orchestra.run.smithi040.stdout: libXcursor x86_64 1.2.0-7.el9 appstream 31 k 2024-09-12T17:06:47.614 INFO:teuthology.orchestra.run.smithi040.stdout: libXdamage x86_64 1.1.5-7.el9 appstream 23 k 2024-09-12T17:06:47.614 INFO:teuthology.orchestra.run.smithi040.stdout: libXfixes x86_64 5.0.3-16.el9 appstream 20 k 2024-09-12T17:06:47.614 INFO:teuthology.orchestra.run.smithi040.stdout: libXi x86_64 1.7.10-8.el9 appstream 40 k 2024-09-12T17:06:47.614 INFO:teuthology.orchestra.run.smithi040.stdout: libXinerama x86_64 1.1.4-10.el9 appstream 15 k 2024-09-12T17:06:47.614 INFO:teuthology.orchestra.run.smithi040.stdout: libXrandr x86_64 1.5.2-8.el9 appstream 28 k 2024-09-12T17:06:47.614 INFO:teuthology.orchestra.run.smithi040.stdout: libXtst x86_64 1.2.3-16.el9 appstream 21 k 2024-09-12T17:06:47.614 INFO:teuthology.orchestra.run.smithi040.stdout: libXv x86_64 1.0.11-16.el9 appstream 19 k 2024-09-12T17:06:47.614 INFO:teuthology.orchestra.run.smithi040.stdout: libXxf86vm x86_64 1.1.4-18.el9 appstream 19 k 2024-09-12T17:06:47.614 INFO:teuthology.orchestra.run.smithi040.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-12T17:06:47.614 INFO:teuthology.orchestra.run.smithi040.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-12T17:06:47.615 INFO:teuthology.orchestra.run.smithi040.stdout: libasyncns x86_64 0.8-22.el9 appstream 30 k 2024-09-12T17:06:47.615 INFO:teuthology.orchestra.run.smithi040.stdout: libcanberra x86_64 0.30-27.el9 appstream 86 k 2024-09-12T17:06:47.615 INFO:teuthology.orchestra.run.smithi040.stdout: libcephsqlite x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 161 k 2024-09-12T17:06:47.615 INFO:teuthology.orchestra.run.smithi040.stdout: libdrm x86_64 2.4.121-1.el9 appstream 161 k 2024-09-12T17:06:47.615 INFO:teuthology.orchestra.run.smithi040.stdout: libepoxy x86_64 1.5.5-4.el9 appstream 241 k 2024-09-12T17:06:47.615 INFO:teuthology.orchestra.run.smithi040.stdout: libexif x86_64 0.6.22-6.el9 appstream 435 k 2024-09-12T17:06:47.615 INFO:teuthology.orchestra.run.smithi040.stdout: libfontenc x86_64 1.1.3-17.el9 appstream 31 k 2024-09-12T17:06:47.615 INFO:teuthology.orchestra.run.smithi040.stdout: libgexiv2 x86_64 0.12.3-1.el9 appstream 83 k 2024-09-12T17:06:47.615 INFO:teuthology.orchestra.run.smithi040.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-12T17:06:47.615 INFO:teuthology.orchestra.run.smithi040.stdout: libglvnd x86_64 1:1.3.4-1.el9 appstream 135 k 2024-09-12T17:06:47.615 INFO:teuthology.orchestra.run.smithi040.stdout: libglvnd-egl x86_64 1:1.3.4-1.el9 appstream 37 k 2024-09-12T17:06:47.615 INFO:teuthology.orchestra.run.smithi040.stdout: libglvnd-glx x86_64 1:1.3.4-1.el9 appstream 142 k 2024-09-12T17:06:47.615 INFO:teuthology.orchestra.run.smithi040.stdout: libgsf x86_64 1.14.47-5.el9 appstream 256 k 2024-09-12T17:06:47.616 INFO:teuthology.orchestra.run.smithi040.stdout: libgxps x86_64 0.3.2-3.el9 appstream 79 k 2024-09-12T17:06:47.616 INFO:teuthology.orchestra.run.smithi040.stdout: libiptcdata x86_64 1.0.5-10.el9 appstream 61 k 2024-09-12T17:06:47.616 INFO:teuthology.orchestra.run.smithi040.stdout: libldac x86_64 2.0.2.3-10.el9 appstream 41 k 2024-09-12T17:06:47.616 INFO:teuthology.orchestra.run.smithi040.stdout: libnotify x86_64 0.7.9-8.el9 appstream 44 k 2024-09-12T17:06:47.616 INFO:teuthology.orchestra.run.smithi040.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-12T17:06:47.616 INFO:teuthology.orchestra.run.smithi040.stdout: libogg x86_64 2:1.3.4-6.el9 appstream 34 k 2024-09-12T17:06:47.616 INFO:teuthology.orchestra.run.smithi040.stdout: libosinfo x86_64 1.10.0-1.el9 appstream 319 k 2024-09-12T17:06:47.616 INFO:teuthology.orchestra.run.smithi040.stdout: libpciaccess x86_64 0.16-7.el9 baseos 27 k 2024-09-12T17:06:47.616 INFO:teuthology.orchestra.run.smithi040.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-12T17:06:47.616 INFO:teuthology.orchestra.run.smithi040.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-12T17:06:47.616 INFO:teuthology.orchestra.run.smithi040.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-12T17:06:47.616 INFO:teuthology.orchestra.run.smithi040.stdout: libradosstriper1 x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 508 k 2024-09-12T17:06:47.616 INFO:teuthology.orchestra.run.smithi040.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-12T17:06:47.617 INFO:teuthology.orchestra.run.smithi040.stdout: librgw2 x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 5.5 M 2024-09-12T17:06:47.617 INFO:teuthology.orchestra.run.smithi040.stdout: libsbc x86_64 1.4-9.el9 appstream 45 k 2024-09-12T17:06:47.617 INFO:teuthology.orchestra.run.smithi040.stdout: libsndfile x86_64 1.0.31-8.el9 appstream 206 k 2024-09-12T17:06:47.617 INFO:teuthology.orchestra.run.smithi040.stdout: libtheora x86_64 1:1.1.1-31.el9 appstream 164 k 2024-09-12T17:06:47.617 INFO:teuthology.orchestra.run.smithi040.stdout: libtiff x86_64 4.4.0-13.el9 appstream 198 k 2024-09-12T17:06:47.617 INFO:teuthology.orchestra.run.smithi040.stdout: libtool-ltdl x86_64 2.4.6-46.el9 appstream 36 k 2024-09-12T17:06:47.617 INFO:teuthology.orchestra.run.smithi040.stdout: libtracker-sparql x86_64 3.1.2-3.el9 appstream 324 k 2024-09-12T17:06:47.617 INFO:teuthology.orchestra.run.smithi040.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-12T17:06:47.617 INFO:teuthology.orchestra.run.smithi040.stdout: libvisual x86_64 1:0.4.0-34.el9 appstream 144 k 2024-09-12T17:06:47.617 INFO:teuthology.orchestra.run.smithi040.stdout: libvorbis x86_64 1:1.3.7-5.el9 appstream 193 k 2024-09-12T17:06:47.617 INFO:teuthology.orchestra.run.smithi040.stdout: libwayland-client x86_64 1.21.0-1.el9 appstream 33 k 2024-09-12T17:06:47.617 INFO:teuthology.orchestra.run.smithi040.stdout: libwayland-cursor x86_64 1.21.0-1.el9 appstream 19 k 2024-09-12T17:06:47.618 INFO:teuthology.orchestra.run.smithi040.stdout: libwayland-egl x86_64 1.21.0-1.el9 appstream 13 k 2024-09-12T17:06:47.618 INFO:teuthology.orchestra.run.smithi040.stdout: libwayland-server x86_64 1.21.0-1.el9 appstream 42 k 2024-09-12T17:06:47.618 INFO:teuthology.orchestra.run.smithi040.stdout: libwebp x86_64 1.2.0-8.el9 appstream 277 k 2024-09-12T17:06:47.618 INFO:teuthology.orchestra.run.smithi040.stdout: libxkbcommon x86_64 1.0.3-4.el9 appstream 133 k 2024-09-12T17:06:47.618 INFO:teuthology.orchestra.run.smithi040.stdout: libxshmfence x86_64 1.3-10.el9 appstream 13 k 2024-09-12T17:06:47.618 INFO:teuthology.orchestra.run.smithi040.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2024-09-12T17:06:47.618 INFO:teuthology.orchestra.run.smithi040.stdout: low-memory-monitor x86_64 2.1-4.el9 appstream 36 k 2024-09-12T17:06:47.618 INFO:teuthology.orchestra.run.smithi040.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-12T17:06:47.618 INFO:teuthology.orchestra.run.smithi040.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-12T17:06:47.618 INFO:teuthology.orchestra.run.smithi040.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-12T17:06:47.618 INFO:teuthology.orchestra.run.smithi040.stdout: lua-posix x86_64 35.0-8.el9 appstream 151 k 2024-09-12T17:06:47.619 INFO:teuthology.orchestra.run.smithi040.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-12T17:06:47.619 INFO:teuthology.orchestra.run.smithi040.stdout: maven-lib noarch 1:3.6.3-15.el9 appstream 1.5 M 2024-09-12T17:06:47.619 INFO:teuthology.orchestra.run.smithi040.stdout: maven-openjdk11 noarch 1:3.6.3-15.el9 appstream 9.0 k 2024-09-12T17:06:47.619 INFO:teuthology.orchestra.run.smithi040.stdout: maven-resolver noarch 1:1.6.1-10.el9 appstream 517 k 2024-09-12T17:06:47.619 INFO:teuthology.orchestra.run.smithi040.stdout: maven-shared-utils noarch 3.3.4-3.el9 appstream 151 k 2024-09-12T17:06:47.619 INFO:teuthology.orchestra.run.smithi040.stdout: maven-wagon noarch 3.4.2-7.el9 appstream 112 k 2024-09-12T17:06:47.619 INFO:teuthology.orchestra.run.smithi040.stdout: mesa-filesystem x86_64 24.1.2-3.el9 appstream 11 k 2024-09-12T17:06:47.619 INFO:teuthology.orchestra.run.smithi040.stdout: mesa-libEGL x86_64 24.1.2-3.el9 appstream 139 k 2024-09-12T17:06:47.619 INFO:teuthology.orchestra.run.smithi040.stdout: mesa-libGL x86_64 24.1.2-3.el9 appstream 171 k 2024-09-12T17:06:47.619 INFO:teuthology.orchestra.run.smithi040.stdout: mesa-libgbm x86_64 24.1.2-3.el9 appstream 36 k 2024-09-12T17:06:47.619 INFO:teuthology.orchestra.run.smithi040.stdout: mesa-libglapi x86_64 24.1.2-3.el9 appstream 46 k 2024-09-12T17:06:47.619 INFO:teuthology.orchestra.run.smithi040.stdout: mkfontscale x86_64 1.2.1-3.el9 appstream 32 k 2024-09-12T17:06:47.620 INFO:teuthology.orchestra.run.smithi040.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-12T17:06:47.620 INFO:teuthology.orchestra.run.smithi040.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-12T17:06:47.620 INFO:teuthology.orchestra.run.smithi040.stdout: openjpeg2 x86_64 2.4.0-7.el9 appstream 163 k 2024-09-12T17:06:47.620 INFO:teuthology.orchestra.run.smithi040.stdout: opus x86_64 1.3.1-10.el9 appstream 200 k 2024-09-12T17:06:47.620 INFO:teuthology.orchestra.run.smithi040.stdout: orc x86_64 0.4.31-8.el9 appstream 183 k 2024-09-12T17:06:47.620 INFO:teuthology.orchestra.run.smithi040.stdout: osinfo-db noarch 20240701-2.el9 appstream 531 k 2024-09-12T17:06:47.620 INFO:teuthology.orchestra.run.smithi040.stdout: osinfo-db-tools x86_64 1.10.0-1.el9 appstream 74 k 2024-09-12T17:06:47.620 INFO:teuthology.orchestra.run.smithi040.stdout: ostree-libs x86_64 2024.7-2.el9 appstream 468 k 2024-09-12T17:06:47.620 INFO:teuthology.orchestra.run.smithi040.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-12T17:06:47.620 INFO:teuthology.orchestra.run.smithi040.stdout: pipewire-jack-audio-connection-kit-libs x86_64 1.0.1-1.el9 appstream 135 k 2024-09-12T17:06:47.620 INFO:teuthology.orchestra.run.smithi040.stdout: pipewire-libs x86_64 1.0.1-1.el9 appstream 1.9 M 2024-09-12T17:06:47.620 INFO:teuthology.orchestra.run.smithi040.stdout: plexus-cipher noarch 1.7-27.el9 appstream 26 k 2024-09-12T17:06:47.620 INFO:teuthology.orchestra.run.smithi040.stdout: plexus-classworlds noarch 2.6.0-11.el9 appstream 60 k 2024-09-12T17:06:47.621 INFO:teuthology.orchestra.run.smithi040.stdout: plexus-containers-component-annotations noarch 2.1.0-10.el9 appstream 18 k 2024-09-12T17:06:47.621 INFO:teuthology.orchestra.run.smithi040.stdout: plexus-interpolation noarch 1.26-11.el9 appstream 80 k 2024-09-12T17:06:47.621 INFO:teuthology.orchestra.run.smithi040.stdout: plexus-sec-dispatcher noarch 1.4-37.el9 appstream 34 k 2024-09-12T17:06:47.621 INFO:teuthology.orchestra.run.smithi040.stdout: plexus-utils noarch 3.3.0-10.el9 appstream 254 k 2024-09-12T17:06:47.621 INFO:teuthology.orchestra.run.smithi040.stdout: poppler x86_64 21.01.0-21.el9 appstream 1.1 M 2024-09-12T17:06:47.621 INFO:teuthology.orchestra.run.smithi040.stdout: poppler-data noarch 0.4.9-9.el9 appstream 1.9 M 2024-09-12T17:06:47.621 INFO:teuthology.orchestra.run.smithi040.stdout: poppler-glib x86_64 21.01.0-21.el9 appstream 152 k 2024-09-12T17:06:47.621 INFO:teuthology.orchestra.run.smithi040.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-12T17:06:47.621 INFO:teuthology.orchestra.run.smithi040.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-12T17:06:47.621 INFO:teuthology.orchestra.run.smithi040.stdout: publicsuffix-list noarch 20210518-3.el9 appstream 83 k 2024-09-12T17:06:47.621 INFO:teuthology.orchestra.run.smithi040.stdout: pulseaudio-libs x86_64 15.0-2.el9 appstream 679 k 2024-09-12T17:06:47.621 INFO:teuthology.orchestra.run.smithi040.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-12T17:06:47.622 INFO:teuthology.orchestra.run.smithi040.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-12T17:06:47.622 INFO:teuthology.orchestra.run.smithi040.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-12T17:06:47.622 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-12T17:06:47.622 INFO:teuthology.orchestra.run.smithi040.stdout: python3-ceph-argparse x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 45 k 2024-09-12T17:06:47.622 INFO:teuthology.orchestra.run.smithi040.stdout: python3-ceph-common x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 143 k 2024-09-12T17:06:47.622 INFO:teuthology.orchestra.run.smithi040.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-12T17:06:47.622 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-12T17:06:47.622 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-12T17:06:47.622 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-12T17:06:47.622 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-12T17:06:47.622 INFO:teuthology.orchestra.run.smithi040.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-12T17:06:47.622 INFO:teuthology.orchestra.run.smithi040.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-12T17:06:47.622 INFO:teuthology.orchestra.run.smithi040.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-12T17:06:47.623 INFO:teuthology.orchestra.run.smithi040.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-12T17:06:47.623 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-12T17:06:47.623 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-12T17:06:47.623 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-12T17:06:47.623 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-12T17:06:47.623 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-12T17:06:47.623 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-12T17:06:47.623 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-12T17:06:47.623 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-12T17:06:47.623 INFO:teuthology.orchestra.run.smithi040.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-12T17:06:47.623 INFO:teuthology.orchestra.run.smithi040.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-12T17:06:47.623 INFO:teuthology.orchestra.run.smithi040.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-12T17:06:47.624 INFO:teuthology.orchestra.run.smithi040.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-12T17:06:47.624 INFO:teuthology.orchestra.run.smithi040.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-12T17:06:47.624 INFO:teuthology.orchestra.run.smithi040.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-12T17:06:47.624 INFO:teuthology.orchestra.run.smithi040.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-12T17:06:47.624 INFO:teuthology.orchestra.run.smithi040.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-12T17:06:47.624 INFO:teuthology.orchestra.run.smithi040.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-12T17:06:47.624 INFO:teuthology.orchestra.run.smithi040.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-12T17:06:47.624 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-12T17:06:47.624 INFO:teuthology.orchestra.run.smithi040.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-12T17:06:47.624 INFO:teuthology.orchestra.run.smithi040.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-12T17:06:47.624 INFO:teuthology.orchestra.run.smithi040.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-12T17:06:47.624 INFO:teuthology.orchestra.run.smithi040.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-12T17:06:47.624 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-12T17:06:47.624 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-12T17:06:47.625 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-12T17:06:47.625 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-12T17:06:47.625 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-12T17:06:47.625 INFO:teuthology.orchestra.run.smithi040.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-12T17:06:47.625 INFO:teuthology.orchestra.run.smithi040.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-12T17:06:47.625 INFO:teuthology.orchestra.run.smithi040.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-12T17:06:47.625 INFO:teuthology.orchestra.run.smithi040.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-12T17:06:47.625 INFO:teuthology.orchestra.run.smithi040.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-12T17:06:47.625 INFO:teuthology.orchestra.run.smithi040.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-12T17:06:47.625 INFO:teuthology.orchestra.run.smithi040.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-12T17:06:47.625 INFO:teuthology.orchestra.run.smithi040.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-12T17:06:47.625 INFO:teuthology.orchestra.run.smithi040.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-12T17:06:47.625 INFO:teuthology.orchestra.run.smithi040.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-12T17:06:47.626 INFO:teuthology.orchestra.run.smithi040.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-12T17:06:47.626 INFO:teuthology.orchestra.run.smithi040.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-12T17:06:47.626 INFO:teuthology.orchestra.run.smithi040.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-12T17:06:47.626 INFO:teuthology.orchestra.run.smithi040.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-12T17:06:47.626 INFO:teuthology.orchestra.run.smithi040.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-12T17:06:47.626 INFO:teuthology.orchestra.run.smithi040.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-12T17:06:47.626 INFO:teuthology.orchestra.run.smithi040.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-12T17:06:47.626 INFO:teuthology.orchestra.run.smithi040.stdout: rtkit x86_64 0.11-29.el9 appstream 56 k 2024-09-12T17:06:47.626 INFO:teuthology.orchestra.run.smithi040.stdout: sisu noarch 1:0.3.4-10.el9 appstream 510 k 2024-09-12T17:06:47.626 INFO:teuthology.orchestra.run.smithi040.stdout: slf4j noarch 1.7.30-13.el9 appstream 69 k 2024-09-12T17:06:47.626 INFO:teuthology.orchestra.run.smithi040.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-12T17:06:47.626 INFO:teuthology.orchestra.run.smithi040.stdout: sound-theme-freedesktop noarch 0.8-17.el9 appstream 383 k 2024-09-12T17:06:47.626 INFO:teuthology.orchestra.run.smithi040.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-12T17:06:47.626 INFO:teuthology.orchestra.run.smithi040.stdout: totem-pl-parser x86_64 3.26.6-2.el9 appstream 152 k 2024-09-12T17:06:47.626 INFO:teuthology.orchestra.run.smithi040.stdout: tracker x86_64 3.1.2-3.el9 appstream 555 k 2024-09-12T17:06:47.627 INFO:teuthology.orchestra.run.smithi040.stdout: ttmkfdir x86_64 3.0.9-65.el9 appstream 53 k 2024-09-12T17:06:47.627 INFO:teuthology.orchestra.run.smithi040.stdout: tzdata-java noarch 2024a-2.el9 appstream 230 k 2024-09-12T17:06:47.627 INFO:teuthology.orchestra.run.smithi040.stdout: upower x86_64 0.99.11-11.el9 appstream 173 k 2024-09-12T17:06:47.627 INFO:teuthology.orchestra.run.smithi040.stdout: webrtc-audio-processing x86_64 0.3.1-8.el9 appstream 306 k 2024-09-12T17:06:47.627 INFO:teuthology.orchestra.run.smithi040.stdout: wireplumber x86_64 0.4.14-1.el9 appstream 96 k 2024-09-12T17:06:47.627 INFO:teuthology.orchestra.run.smithi040.stdout: wireplumber-libs x86_64 0.4.14-1.el9 appstream 358 k 2024-09-12T17:06:47.627 INFO:teuthology.orchestra.run.smithi040.stdout: xdg-dbus-proxy x86_64 0.1.3-1.el9 appstream 42 k 2024-09-12T17:06:47.627 INFO:teuthology.orchestra.run.smithi040.stdout: xdg-desktop-portal x86_64 1.12.6-1.el9 appstream 385 k 2024-09-12T17:06:47.627 INFO:teuthology.orchestra.run.smithi040.stdout: xkeyboard-config noarch 2.33-2.el9 appstream 859 k 2024-09-12T17:06:47.627 INFO:teuthology.orchestra.run.smithi040.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-12T17:06:47.627 INFO:teuthology.orchestra.run.smithi040.stdout: xorg-x11-fonts-Type1 noarch 7.5-33.el9 appstream 505 k 2024-09-12T17:06:47.627 INFO:teuthology.orchestra.run.smithi040.stdout:Installing weak dependencies: 2024-09-12T17:06:47.627 INFO:teuthology.orchestra.run.smithi040.stdout: dconf x86_64 0.40.0-6.el9 appstream 113 k 2024-09-12T17:06:47.627 INFO:teuthology.orchestra.run.smithi040.stdout: exiv2 x86_64 0.27.5-2.el9 appstream 980 k 2024-09-12T17:06:47.628 INFO:teuthology.orchestra.run.smithi040.stdout: flatpak x86_64 1.12.9-1.el9 appstream 1.7 M 2024-09-12T17:06:47.628 INFO:teuthology.orchestra.run.smithi040.stdout: gtk3 x86_64 3.24.31-5.el9 appstream 4.9 M 2024-09-12T17:06:47.628 INFO:teuthology.orchestra.run.smithi040.stdout: java-11-openjdk-devel x86_64 1:11.0.20.1.1-2.el9 appstream 3.3 M 2024-09-12T17:06:47.628 INFO:teuthology.orchestra.run.smithi040.stdout: libcanberra-gtk3 x86_64 0.30-27.el9 appstream 32 k 2024-09-12T17:06:47.628 INFO:teuthology.orchestra.run.smithi040.stdout: mesa-dri-drivers x86_64 24.1.2-3.el9 appstream 8.8 M 2024-09-12T17:06:47.628 INFO:teuthology.orchestra.run.smithi040.stdout: p11-kit-server x86_64 0.25.3-2.el9 appstream 246 k 2024-09-12T17:06:47.628 INFO:teuthology.orchestra.run.smithi040.stdout: pipewire x86_64 1.0.1-1.el9 appstream 107 k 2024-09-12T17:06:47.628 INFO:teuthology.orchestra.run.smithi040.stdout: pipewire-alsa x86_64 1.0.1-1.el9 appstream 57 k 2024-09-12T17:06:47.628 INFO:teuthology.orchestra.run.smithi040.stdout: pipewire-jack-audio-connection-kit x86_64 1.0.1-1.el9 appstream 9.1 k 2024-09-12T17:06:47.628 INFO:teuthology.orchestra.run.smithi040.stdout: pipewire-pulseaudio x86_64 1.0.1-1.el9 appstream 192 k 2024-09-12T17:06:47.628 INFO:teuthology.orchestra.run.smithi040.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-12T17:06:47.628 INFO:teuthology.orchestra.run.smithi040.stdout: tracker-miners x86_64 3.1.2-4.el9 appstream 944 k 2024-09-12T17:06:47.628 INFO:teuthology.orchestra.run.smithi040.stdout: xdg-desktop-portal-gtk x86_64 1.12.0-3.el9 appstream 134 k 2024-09-12T17:06:47.629 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-12T17:06:47.629 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction Summary 2024-09-12T17:06:47.629 INFO:teuthology.orchestra.run.smithi040.stdout:====================================================================================================== 2024-09-12T17:06:47.629 INFO:teuthology.orchestra.run.smithi040.stdout:Install 283 Packages 2024-09-12T17:06:47.629 INFO:teuthology.orchestra.run.smithi040.stdout:Upgrade 2 Packages 2024-09-12T17:06:47.629 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-12T17:06:47.629 INFO:teuthology.orchestra.run.smithi040.stdout:Total download size: 322 M 2024-09-12T17:06:47.630 INFO:teuthology.orchestra.run.smithi040.stdout:Downloading Packages: 2024-09-12T17:06:48.146 INFO:teuthology.orchestra.run.smithi040.stdout:(1/285): ceph-19.3.0-4762.gbad475c1.el9.x86_64. 46 kB/s | 6.6 kB 00:00 2024-09-12T17:06:48.641 INFO:teuthology.orchestra.run.smithi040.stdout:(2/285): ceph-fuse-19.3.0-4762.gbad475c1.el9.x8 1.8 MB/s | 900 kB 00:00 2024-09-12T17:06:48.783 INFO:teuthology.orchestra.run.smithi040.stdout:(3/285): ceph-immutable-object-cache-19.3.0-476 1.0 MB/s | 145 kB 00:00 2024-09-12T17:06:49.109 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 9 - AppStream 1.2 MB/s | 20 MB 00:17 2024-09-12T17:06:49.183 INFO:teuthology.orchestra.run.smithi040.stdout:(4/285): ceph-base-19.3.0-4762.gbad475c1.el9.x8 4.7 MB/s | 5.5 MB 00:01 2024-09-12T17:06:49.333 INFO:teuthology.orchestra.run.smithi040.stdout:(5/285): ceph-mds-19.3.0-4762.gbad475c1.el9.x86 4.3 MB/s | 2.4 MB 00:00 2024-09-12T17:06:49.375 INFO:teuthology.orchestra.run.smithi040.stdout:(6/285): ceph-mgr-19.3.0-4762.gbad475c1.el9.x86 8.0 MB/s | 1.5 MB 00:00 2024-09-12T17:06:50.334 INFO:teuthology.orchestra.run.smithi040.stdout:(7/285): ceph-mon-19.3.0-4762.gbad475c1.el9.x86 4.8 MB/s | 4.8 MB 00:00 2024-09-12T17:06:50.759 INFO:teuthology.orchestra.run.smithi040.stdout:(8/285): ceph-common-19.3.0-4762.gbad475c1.el9. 7.8 MB/s | 22 MB 00:02 2024-09-12T17:06:50.826 INFO:teuthology.orchestra.run.smithi040.stdout:(9/285): ceph-selinux-19.3.0-4762.gbad475c1.el9 378 kB/s | 25 kB 00:00 2024-09-12T17:06:51.543 INFO:teuthology.orchestra.run.smithi040.stdout:(10/285): ceph-osd-19.3.0-4762.gbad475c1.el9.x8 7.9 MB/s | 17 MB 00:02 2024-09-12T17:06:51.627 INFO:teuthology.orchestra.run.smithi040.stdout:(11/285): libcephfs-devel-19.3.0-4762.gbad475c1 382 kB/s | 32 kB 00:00 2024-09-12T17:06:51.710 INFO:teuthology.orchestra.run.smithi040.stdout:(12/285): libcephfs2-19.3.0-4762.gbad475c1.el9. 8.9 MB/s | 756 kB 00:00 2024-09-12T17:06:51.869 INFO:teuthology.orchestra.run.smithi040.stdout:(13/285): libcephsqlite-19.3.0-4762.gbad475c1.e 1.0 MB/s | 161 kB 00:00 2024-09-12T17:06:51.911 INFO:teuthology.orchestra.run.smithi040.stdout:(14/285): librados-devel-19.3.0-4762.gbad475c1. 3.0 MB/s | 126 kB 00:00 2024-09-12T17:06:51.986 INFO:teuthology.orchestra.run.smithi040.stdout:(15/285): libradosstriper1-19.3.0-4762.gbad475c 6.6 MB/s | 508 kB 00:00 2024-09-12T17:06:52.311 INFO:teuthology.orchestra.run.smithi040.stdout:(16/285): ceph-radosgw-19.3.0-4762.gbad475c1.el 5.5 MB/s | 11 MB 00:01 2024-09-12T17:06:52.353 INFO:teuthology.orchestra.run.smithi040.stdout:(17/285): python3-ceph-argparse-19.3.0-4762.gba 1.1 MB/s | 45 kB 00:00 2024-09-12T17:06:52.420 INFO:teuthology.orchestra.run.smithi040.stdout:(18/285): librgw2-19.3.0-4762.gbad475c1.el9.x86 13 MB/s | 5.5 MB 00:00 2024-09-12T17:06:52.445 INFO:teuthology.orchestra.run.smithi040.stdout:(19/285): python3-ceph-common-19.3.0-4762.gbad4 1.5 MB/s | 143 kB 00:00 2024-09-12T17:06:52.479 INFO:teuthology.orchestra.run.smithi040.stdout:(20/285): python3-cephfs-19.3.0-4762.gbad475c1. 2.7 MB/s | 161 kB 00:00 2024-09-12T17:06:52.512 INFO:teuthology.orchestra.run.smithi040.stdout:(21/285): python3-rados-19.3.0-4762.gbad475c1.e 4.7 MB/s | 321 kB 00:00 2024-09-12T17:06:52.538 INFO:teuthology.orchestra.run.smithi040.stdout:(22/285): python3-rbd-19.3.0-4762.gbad475c1.el9 5.1 MB/s | 305 kB 00:00 2024-09-12T17:06:52.563 INFO:teuthology.orchestra.run.smithi040.stdout:(23/285): python3-rgw-19.3.0-4762.gbad475c1.el9 1.9 MB/s | 99 kB 00:00 2024-09-12T17:06:52.588 INFO:teuthology.orchestra.run.smithi040.stdout:(24/285): rbd-fuse-19.3.0-4762.gbad475c1.el9.x8 1.7 MB/s | 85 kB 00:00 2024-09-12T17:06:52.638 INFO:teuthology.orchestra.run.smithi040.stdout:(25/285): rbd-nbd-19.3.0-4762.gbad475c1.el9.x86 3.3 MB/s | 170 kB 00:00 2024-09-12T17:06:52.689 INFO:teuthology.orchestra.run.smithi040.stdout:(26/285): ceph-grafana-dashboards-19.3.0-4762.g 689 kB/s | 34 kB 00:00 2024-09-12T17:06:52.739 INFO:teuthology.orchestra.run.smithi040.stdout:(27/285): ceph-mgr-cephadm-19.3.0-4762.gbad475c 3.0 MB/s | 154 kB 00:00 2024-09-12T17:06:52.914 INFO:teuthology.orchestra.run.smithi040.stdout:(28/285): rbd-mirror-19.3.0-4762.gbad475c1.el9. 9.0 MB/s | 3.2 MB 00:00 2024-09-12T17:06:53.823 INFO:teuthology.orchestra.run.smithi040.stdout:(29/285): ceph-test-19.3.0-4762.gbad475c1.el9.x 15 MB/s | 45 MB 00:02 2024-09-12T17:06:53.990 INFO:teuthology.orchestra.run.smithi040.stdout:(30/285): ceph-mgr-dashboard-19.3.0-4762.gbad47 11 MB/s | 14 MB 00:01 2024-09-12T17:06:54.023 INFO:teuthology.orchestra.run.smithi040.stdout:(31/285): ceph-mgr-modules-core-19.3.0-4762.gba 1.4 MB/s | 291 kB 00:00 2024-09-12T17:06:54.041 INFO:teuthology.orchestra.run.smithi040.stdout:(32/285): ceph-mgr-rook-19.3.0-4762.gbad475c1.e 987 kB/s | 49 kB 00:00 2024-09-12T17:06:54.124 INFO:teuthology.orchestra.run.smithi040.stdout:(33/285): ceph-mgr-diskprediction-local-19.3.0- 6.1 MB/s | 7.4 MB 00:01 2024-09-12T17:06:54.141 INFO:teuthology.orchestra.run.smithi040.stdout:(34/285): ceph-prometheus-alerts-19.3.0-4762.gb 140 kB/s | 16 kB 00:00 2024-09-12T17:06:54.166 INFO:teuthology.orchestra.run.smithi040.stdout:(35/285): ceph-volume-19.3.0-4762.gbad475c1.el9 2.2 MB/s | 285 kB 00:00 2024-09-12T17:06:54.233 INFO:teuthology.orchestra.run.smithi040.stdout:(36/285): cephadm-19.3.0-4762.gbad475c1.el9.noa 7.0 MB/s | 783 kB 00:00 2024-09-12T17:06:54.317 INFO:teuthology.orchestra.run.smithi040.stdout:(37/285): bluez-libs-5.56-6.el9.x86_64.rpm 564 kB/s | 85 kB 00:00 2024-09-12T17:06:54.367 INFO:teuthology.orchestra.run.smithi040.stdout:(38/285): ModemManager-glib-1.20.2-1.el9.x86_64 1.4 MB/s | 335 kB 00:00 2024-09-12T17:06:54.392 INFO:teuthology.orchestra.run.smithi040.stdout:(39/285): bubblewrap-0.4.1-7.el9.x86_64.rpm 311 kB/s | 49 kB 00:00 2024-09-12T17:06:54.418 INFO:teuthology.orchestra.run.smithi040.stdout:(40/285): fuse-2.9.9-16.el9.x86_64.rpm 1.6 MB/s | 80 kB 00:00 2024-09-12T17:06:54.443 INFO:teuthology.orchestra.run.smithi040.stdout:(41/285): cups-libs-2.3.3op2-30.el9.x86_64.rpm 2.0 MB/s | 262 kB 00:00 2024-09-12T17:06:54.468 INFO:teuthology.orchestra.run.smithi040.stdout:(42/285): libpciaccess-0.16-7.el9.x86_64.rpm 537 kB/s | 27 kB 00:00 2024-09-12T17:06:54.493 INFO:teuthology.orchestra.run.smithi040.stdout:(43/285): libquadmath-11.5.0-2.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-12T17:06:54.536 INFO:teuthology.orchestra.run.smithi040.stdout:(44/285): lksctp-tools-1.0.19-2.el9.x86_64.rpm 1.4 MB/s | 94 kB 00:00 2024-09-12T17:06:54.561 INFO:teuthology.orchestra.run.smithi040.stdout:(45/285): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.7 MB/s | 253 kB 00:00 2024-09-12T17:06:54.628 INFO:teuthology.orchestra.run.smithi040.stdout:(46/285): python3-ply-3.11-14.el9.noarch.rpm 1.6 MB/s | 106 kB 00:00 2024-09-12T17:06:54.661 INFO:teuthology.orchestra.run.smithi040.stdout:(47/285): python3-cryptography-36.0.1-4.el9.x86 9.8 MB/s | 1.2 MB 00:00 2024-09-12T17:06:54.678 INFO:teuthology.orchestra.run.smithi040.stdout:(48/285): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-09-12T17:06:54.712 INFO:teuthology.orchestra.run.smithi040.stdout:(49/285): libgfortran-11.5.0-2.el9.x86_64.rpm 2.5 MB/s | 801 kB 00:00 2024-09-12T17:06:54.737 INFO:teuthology.orchestra.run.smithi040.stdout:(50/285): python3-requests-2.25.1-8.el9.noarch. 1.6 MB/s | 125 kB 00:00 2024-09-12T17:06:54.762 INFO:teuthology.orchestra.run.smithi040.stdout:(51/285): python3-urllib3-1.26.5-6.el9.noarch.r 2.5 MB/s | 215 kB 00:00 2024-09-12T17:06:55.854 INFO:teuthology.orchestra.run.smithi040.stdout:(52/285): alsa-lib-1.2.12-1.el9.x86_64.rpm 480 kB/s | 523 kB 00:01 2024-09-12T17:06:55.877 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 9 - CRB 2.3 MB/s | 6.5 MB 00:02 2024-09-12T17:06:55.904 INFO:teuthology.orchestra.run.smithi040.stdout:(53/285): adwaita-cursor-theme-40.1.1-3.el9.noa 545 kB/s | 650 kB 00:01 2024-09-12T17:06:56.413 INFO:teuthology.orchestra.run.smithi040.stdout:(54/285): adwaita-icon-theme-40.1.1-3.el9.noarc 7.1 MB/s | 12 MB 00:01 2024-09-12T17:06:56.488 INFO:teuthology.orchestra.run.smithi040.stdout:(55/285): apache-commons-cli-1.4-17.el9.noarch. 112 kB/s | 71 kB 00:00 2024-09-12T17:06:56.930 INFO:teuthology.orchestra.run.smithi040.stdout:(56/285): apache-commons-codec-1.15-7.el9.noarc 294 kB/s | 302 kB 00:01 2024-09-12T17:06:57.305 INFO:teuthology.orchestra.run.smithi040.stdout:(57/285): apache-commons-io-2.8.0-8.el9.noarch. 318 kB/s | 283 kB 00:00 2024-09-12T17:06:57.586 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 9 - Extras packages 44 kB/s | 19 kB 00:00 2024-09-12T17:06:57.622 INFO:teuthology.orchestra.run.smithi040.stdout:(58/285): at-spi2-atk-2.38.0-4.el9.x86_64.rpm 125 kB/s | 87 kB 00:00 2024-09-12T17:06:57.647 INFO:teuthology.orchestra.run.smithi040.stdout:(59/285): apache-commons-lang3-3.12.0-6.el9.noa 482 kB/s | 559 kB 00:01 2024-09-12T17:06:58.031 INFO:teuthology.orchestra.run.smithi040.stdout:(60/285): at-spi2-core-2.40.3-1.el9.x86_64.rpm 269 kB/s | 195 kB 00:00 2024-09-12T17:06:58.156 INFO:teuthology.orchestra.run.smithi040.stdout:(61/285): atinject-1.0.3-6.el9.noarch.rpm 44 kB/s | 23 kB 00:00 2024-09-12T17:06:58.398 INFO:teuthology.orchestra.run.smithi037.stdout:Extra Packages for Enterprise Linux 33 MB/s | 23 MB 00:00 2024-09-12T17:06:58.440 INFO:teuthology.orchestra.run.smithi040.stdout:(62/285): atk-2.36.0-5.el9.x86_64.rpm 368 kB/s | 292 kB 00:00 2024-09-12T17:06:58.566 INFO:teuthology.orchestra.run.smithi040.stdout:(63/285): avahi-glib-0.8-21.el9.x86_64.rpm 28 kB/s | 15 kB 00:00 2024-09-12T17:06:58.832 INFO:teuthology.orchestra.run.smithi040.stdout:(64/285): boost-program-options-1.75.0-8.el9.x8 158 kB/s | 107 kB 00:00 2024-09-12T17:06:59.041 INFO:teuthology.orchestra.run.smithi040.stdout:(65/285): cdi-api-2.0.2-6.el9.noarch.rpm 89 kB/s | 53 kB 00:00 2024-09-12T17:06:59.383 INFO:teuthology.orchestra.run.smithi040.stdout:(66/285): colord-libs-1.4.5-4.el9.x86_64.rpm 281 kB/s | 229 kB 00:00 2024-09-12T17:06:59.491 INFO:teuthology.orchestra.run.smithi040.stdout:(67/285): composefs-libs-1.0.5-1.el9.x86_64.rpm 93 kB/s | 61 kB 00:00 2024-09-12T17:06:59.583 INFO:teuthology.orchestra.run.smithi040.stdout:(68/285): copy-jdk-configs-4.0-3.el9.noarch.rpm 52 kB/s | 28 kB 00:00 2024-09-12T17:07:00.050 INFO:teuthology.orchestra.run.smithi040.stdout:(69/285): dconf-0.40.0-6.el9.x86_64.rpm 169 kB/s | 113 kB 00:00 2024-09-12T17:07:00.353 INFO:teuthology.orchestra.run.smithi040.stdout:(70/285): exempi-2.6.0-0.2.20211007gite23c213.e 611 kB/s | 525 kB 00:00 2024-09-12T17:07:00.501 INFO:teuthology.orchestra.run.smithi040.stdout:(71/285): exiv2-0.27.5-2.el9.x86_64.rpm 1.0 MB/s | 980 kB 00:00 2024-09-12T17:07:01.251 INFO:teuthology.orchestra.run.smithi040.stdout:(72/285): exiv2-libs-0.27.5-2.el9.x86_64.rpm 651 kB/s | 781 kB 00:01 2024-09-12T17:07:01.309 INFO:teuthology.orchestra.run.smithi040.stdout:(73/285): fdk-aac-free-2.0.0-8.el9.x86_64.rpm 340 kB/s | 325 kB 00:00 2024-09-12T17:07:01.335 INFO:teuthology.orchestra.run.smithi040.stdout:(74/285): flac-libs-1.3.3-12.el9.x86_64.rpm 262 kB/s | 218 kB 00:00 2024-09-12T17:07:01.860 INFO:teuthology.orchestra.run.smithi040.stdout:(75/285): flatpak-selinux-1.12.9-1.el9.noarch.r 41 kB/s | 22 kB 00:00 2024-09-12T17:07:01.968 INFO:teuthology.orchestra.run.smithi040.stdout:(76/285): flatpak-session-helper-1.12.9-1.el9.x 115 kB/s | 73 kB 00:00 2024-09-12T17:07:02.227 INFO:teuthology.orchestra.run.smithi040.stdout:(77/285): flatpak-1.12.9-1.el9.x86_64.rpm 1.8 MB/s | 1.7 MB 00:00 2024-09-12T17:07:02.410 INFO:teuthology.orchestra.run.smithi040.stdout:(78/285): flexiblas-3.0.4-8.el9.x86_64.rpm 59 kB/s | 33 kB 00:00 2024-09-12T17:07:02.744 INFO:teuthology.orchestra.run.smithi040.stdout:(79/285): flexiblas-openblas-openmp-3.0.4-8.el9 36 kB/s | 18 kB 00:00 2024-09-12T17:07:03.086 INFO:teuthology.orchestra.run.smithi040.stdout:(80/285): gdk-pixbuf2-modules-2.42.6-4.el9.x86_ 132 kB/s | 89 kB 00:00 2024-09-12T17:07:03.445 INFO:teuthology.orchestra.run.smithi040.stdout:(81/285): geoclue2-2.6.0-7.el9.x86_64.rpm 178 kB/s | 124 kB 00:00 2024-09-12T17:07:03.661 INFO:teuthology.orchestra.run.smithi040.stdout:(82/285): giflib-5.2.1-9.el9.x86_64.rpm 84 kB/s | 49 kB 00:00 2024-09-12T17:07:04.063 INFO:teuthology.orchestra.run.smithi037.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-12T17:07:04.287 INFO:teuthology.orchestra.run.smithi040.stdout:(83/285): graphene-1.10.6-2.el9.x86_64.rpm 104 kB/s | 64 kB 00:00 2024-09-12T17:07:04.570 INFO:teuthology.orchestra.run.smithi040.stdout:(84/285): google-guice-4.2.3-9.el9.noarch.rpm 421 kB/s | 473 kB 00:01 2024-09-12T17:07:04.904 INFO:teuthology.orchestra.run.smithi040.stdout:(85/285): flexiblas-netlib-3.0.4-8.el9.x86_64.r 1.0 MB/s | 3.0 MB 00:02 2024-09-12T17:07:04.929 INFO:teuthology.orchestra.run.smithi040.stdout:(86/285): gsm-1.0.19-6.el9.x86_64.rpm 53 kB/s | 34 kB 00:00 2024-09-12T17:07:05.513 INFO:teuthology.orchestra.run.smithi040.stdout:(87/285): gtk-update-icon-cache-3.24.31-5.el9.x 57 kB/s | 33 kB 00:00 2024-09-12T17:07:05.571 INFO:teuthology.orchestra.run.smithi040.stdout:(88/285): gstreamer1-1.22.1-2.el9.x86_64.rpm 1.4 MB/s | 1.4 MB 00:00 2024-09-12T17:07:05.913 INFO:teuthology.orchestra.run.smithi040.stdout:(89/285): gstreamer1-plugins-base-1.22.1-2.el9. 2.2 MB/s | 2.2 MB 00:01 2024-09-12T17:07:06.441 INFO:teuthology.orchestra.run.smithi037.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T17:07:06.442 INFO:teuthology.orchestra.run.smithi037.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T17:07:06.541 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2024-09-12T17:07:06.569 INFO:teuthology.orchestra.run.smithi037.stdout:====================================================================================================== 2024-09-12T17:07:06.569 INFO:teuthology.orchestra.run.smithi037.stdout: Package Arch Version Repository Size 2024-09-12T17:07:06.569 INFO:teuthology.orchestra.run.smithi037.stdout:====================================================================================================== 2024-09-12T17:07:06.570 INFO:teuthology.orchestra.run.smithi037.stdout:Installing: 2024-09-12T17:07:06.570 INFO:teuthology.orchestra.run.smithi037.stdout: ceph x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 6.6 k 2024-09-12T17:07:06.570 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-base x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 5.5 M 2024-09-12T17:07:06.570 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-fuse x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 900 k 2024-09-12T17:07:06.570 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 145 k 2024-09-12T17:07:06.570 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 1.5 M 2024-09-12T17:07:06.570 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 154 k 2024-09-12T17:07:06.570 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 14 M 2024-09-12T17:07:06.570 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 7.4 M 2024-09-12T17:07:06.570 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-rook noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 49 k 2024-09-12T17:07:06.570 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-radosgw x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 11 M 2024-09-12T17:07:06.570 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-test x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 45 M 2024-09-12T17:07:06.570 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-volume noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 285 k 2024-09-12T17:07:06.571 INFO:teuthology.orchestra.run.smithi037.stdout: cephadm noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 783 k 2024-09-12T17:07:06.571 INFO:teuthology.orchestra.run.smithi037.stdout: libcephfs-devel x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 32 k 2024-09-12T17:07:06.571 INFO:teuthology.orchestra.run.smithi037.stdout: libcephfs2 x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 756 k 2024-09-12T17:07:06.571 INFO:teuthology.orchestra.run.smithi037.stdout: librados-devel x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 126 k 2024-09-12T17:07:06.571 INFO:teuthology.orchestra.run.smithi037.stdout: maven noarch 1:3.6.3-15.el9 appstream 18 k 2024-09-12T17:07:06.571 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cephfs x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 161 k 2024-09-12T17:07:06.571 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rados x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 321 k 2024-09-12T17:07:06.571 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rbd x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 305 k 2024-09-12T17:07:06.571 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rgw x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 99 k 2024-09-12T17:07:06.571 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-fuse x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 85 k 2024-09-12T17:07:06.571 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-mirror x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 3.2 M 2024-09-12T17:07:06.571 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-nbd x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 170 k 2024-09-12T17:07:06.572 INFO:teuthology.orchestra.run.smithi037.stdout: s3cmd noarch 2.4.0-1.el9 epel 206 k 2024-09-12T17:07:06.572 INFO:teuthology.orchestra.run.smithi037.stdout:Upgrading: 2024-09-12T17:07:06.572 INFO:teuthology.orchestra.run.smithi037.stdout: librados2 x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 3.5 M 2024-09-12T17:07:06.572 INFO:teuthology.orchestra.run.smithi037.stdout: librbd1 x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 3.2 M 2024-09-12T17:07:06.572 INFO:teuthology.orchestra.run.smithi037.stdout:Installing dependencies: 2024-09-12T17:07:06.572 INFO:teuthology.orchestra.run.smithi037.stdout: ModemManager-glib x86_64 1.20.2-1.el9 baseos 335 k 2024-09-12T17:07:06.572 INFO:teuthology.orchestra.run.smithi037.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-12T17:07:06.572 INFO:teuthology.orchestra.run.smithi037.stdout: adwaita-cursor-theme noarch 40.1.1-3.el9 appstream 650 k 2024-09-12T17:07:06.572 INFO:teuthology.orchestra.run.smithi037.stdout: adwaita-icon-theme noarch 40.1.1-3.el9 appstream 12 M 2024-09-12T17:07:06.572 INFO:teuthology.orchestra.run.smithi037.stdout: alsa-lib x86_64 1.2.12-1.el9 appstream 523 k 2024-09-12T17:07:06.572 INFO:teuthology.orchestra.run.smithi037.stdout: apache-commons-cli noarch 1.4-17.el9 appstream 71 k 2024-09-12T17:07:06.572 INFO:teuthology.orchestra.run.smithi037.stdout: apache-commons-codec noarch 1.15-7.el9 appstream 302 k 2024-09-12T17:07:06.573 INFO:teuthology.orchestra.run.smithi037.stdout: apache-commons-io noarch 1:2.8.0-8.el9 appstream 283 k 2024-09-12T17:07:06.573 INFO:teuthology.orchestra.run.smithi037.stdout: apache-commons-lang3 noarch 3.12.0-6.el9 appstream 559 k 2024-09-12T17:07:06.573 INFO:teuthology.orchestra.run.smithi037.stdout: at-spi2-atk x86_64 2.38.0-4.el9 appstream 87 k 2024-09-12T17:07:06.573 INFO:teuthology.orchestra.run.smithi037.stdout: at-spi2-core x86_64 2.40.3-1.el9 appstream 195 k 2024-09-12T17:07:06.573 INFO:teuthology.orchestra.run.smithi037.stdout: atinject noarch 1.0.3-6.el9 appstream 23 k 2024-09-12T17:07:06.573 INFO:teuthology.orchestra.run.smithi037.stdout: atk x86_64 2.36.0-5.el9 appstream 292 k 2024-09-12T17:07:06.573 INFO:teuthology.orchestra.run.smithi037.stdout: avahi-glib x86_64 0.8-21.el9 appstream 15 k 2024-09-12T17:07:06.573 INFO:teuthology.orchestra.run.smithi037.stdout: bluez-libs x86_64 5.56-6.el9 baseos 85 k 2024-09-12T17:07:06.573 INFO:teuthology.orchestra.run.smithi037.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-12T17:07:06.573 INFO:teuthology.orchestra.run.smithi037.stdout: bubblewrap x86_64 0.4.1-7.el9 baseos 49 k 2024-09-12T17:07:06.573 INFO:teuthology.orchestra.run.smithi037.stdout: cdi-api noarch 2.0.2-6.el9 appstream 53 k 2024-09-12T17:07:06.573 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-common x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 22 M 2024-09-12T17:07:06.573 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 34 k 2024-09-12T17:07:06.574 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mds x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 2.4 M 2024-09-12T17:07:06.574 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 291 k 2024-09-12T17:07:06.574 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mon x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 4.8 M 2024-09-12T17:07:06.574 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-osd x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 17 M 2024-09-12T17:07:06.574 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4762.gbad475c1.el9 ceph-noarch 16 k 2024-09-12T17:07:06.574 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-selinux x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 25 k 2024-09-12T17:07:06.574 INFO:teuthology.orchestra.run.smithi037.stdout: colord-libs x86_64 1.4.5-4.el9 appstream 229 k 2024-09-12T17:07:06.574 INFO:teuthology.orchestra.run.smithi037.stdout: composefs-libs x86_64 1.0.5-1.el9 appstream 61 k 2024-09-12T17:07:06.574 INFO:teuthology.orchestra.run.smithi037.stdout: copy-jdk-configs noarch 4.0-3.el9 appstream 28 k 2024-09-12T17:07:06.574 INFO:teuthology.orchestra.run.smithi037.stdout: cups-libs x86_64 1:2.3.3op2-30.el9 baseos 262 k 2024-09-12T17:07:06.574 INFO:teuthology.orchestra.run.smithi037.stdout: exempi x86_64 2.6.0-0.2.20211007gite23c213.el9 appstream 525 k 2024-09-12T17:07:06.574 INFO:teuthology.orchestra.run.smithi037.stdout: exiv2-libs x86_64 0.27.5-2.el9 appstream 781 k 2024-09-12T17:07:06.575 INFO:teuthology.orchestra.run.smithi037.stdout: fdk-aac-free x86_64 2.0.0-8.el9 appstream 325 k 2024-09-12T17:07:06.575 INFO:teuthology.orchestra.run.smithi037.stdout: flac-libs x86_64 1.3.3-12.el9 appstream 218 k 2024-09-12T17:07:06.575 INFO:teuthology.orchestra.run.smithi037.stdout: flatpak-selinux noarch 1.12.9-1.el9 appstream 22 k 2024-09-12T17:07:06.575 INFO:teuthology.orchestra.run.smithi037.stdout: flatpak-session-helper x86_64 1.12.9-1.el9 appstream 73 k 2024-09-12T17:07:06.575 INFO:teuthology.orchestra.run.smithi037.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-12T17:07:06.575 INFO:teuthology.orchestra.run.smithi037.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-12T17:07:06.575 INFO:teuthology.orchestra.run.smithi037.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-12T17:07:06.575 INFO:teuthology.orchestra.run.smithi037.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-12T17:07:06.575 INFO:teuthology.orchestra.run.smithi037.stdout: gdk-pixbuf2-modules x86_64 2.42.6-4.el9 appstream 89 k 2024-09-12T17:07:06.575 INFO:teuthology.orchestra.run.smithi037.stdout: geoclue2 x86_64 2.6.0-7.el9 appstream 124 k 2024-09-12T17:07:06.575 INFO:teuthology.orchestra.run.smithi037.stdout: giflib x86_64 5.2.1-9.el9 appstream 49 k 2024-09-12T17:07:06.575 INFO:teuthology.orchestra.run.smithi037.stdout: google-guice noarch 4.2.3-9.el9 appstream 473 k 2024-09-12T17:07:06.575 INFO:teuthology.orchestra.run.smithi037.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-12T17:07:06.576 INFO:teuthology.orchestra.run.smithi037.stdout: graphene x86_64 1.10.6-2.el9 appstream 64 k 2024-09-12T17:07:06.576 INFO:teuthology.orchestra.run.smithi037.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-12T17:07:06.576 INFO:teuthology.orchestra.run.smithi037.stdout: gsm x86_64 1.0.19-6.el9 appstream 34 k 2024-09-12T17:07:06.576 INFO:teuthology.orchestra.run.smithi037.stdout: gstreamer1 x86_64 1.22.1-2.el9 appstream 1.4 M 2024-09-12T17:07:06.576 INFO:teuthology.orchestra.run.smithi037.stdout: gstreamer1-plugins-base x86_64 1.22.1-2.el9 appstream 2.2 M 2024-09-12T17:07:06.576 INFO:teuthology.orchestra.run.smithi037.stdout: gtk-update-icon-cache x86_64 3.24.31-5.el9 appstream 33 k 2024-09-12T17:07:06.576 INFO:teuthology.orchestra.run.smithi037.stdout: guava noarch 30.1-6.el9 appstream 2.3 M 2024-09-12T17:07:06.576 INFO:teuthology.orchestra.run.smithi037.stdout: hicolor-icon-theme noarch 0.17-13.el9 appstream 219 k 2024-09-12T17:07:06.576 INFO:teuthology.orchestra.run.smithi037.stdout: httpcomponents-client noarch 4.5.13-3.el9 appstream 657 k 2024-09-12T17:07:06.576 INFO:teuthology.orchestra.run.smithi037.stdout: httpcomponents-core noarch 4.4.13-7.el9 appstream 632 k 2024-09-12T17:07:06.576 INFO:teuthology.orchestra.run.smithi037.stdout: iso-codes noarch 4.6.0-3.el9 appstream 3.5 M 2024-09-12T17:07:06.576 INFO:teuthology.orchestra.run.smithi037.stdout: jakarta-annotations noarch 1.3.5-13.el9 appstream 45 k 2024-09-12T17:07:06.576 INFO:teuthology.orchestra.run.smithi037.stdout: jansi x86_64 2.3.3-6.el9 appstream 110 k 2024-09-12T17:07:06.577 INFO:teuthology.orchestra.run.smithi037.stdout: java-11-openjdk x86_64 1:11.0.20.1.1-2.el9 appstream 413 k 2024-09-12T17:07:06.577 INFO:teuthology.orchestra.run.smithi037.stdout: java-11-openjdk-headless x86_64 1:11.0.20.1.1-2.el9 appstream 39 M 2024-09-12T17:07:06.577 INFO:teuthology.orchestra.run.smithi037.stdout: javapackages-filesystem noarch 6.0.0-4.el9 appstream 13 k 2024-09-12T17:07:06.577 INFO:teuthology.orchestra.run.smithi037.stdout: jbigkit-libs x86_64 2.1-23.el9 appstream 53 k 2024-09-12T17:07:06.577 INFO:teuthology.orchestra.run.smithi037.stdout: jcl-over-slf4j noarch 1.7.30-13.el9 appstream 24 k 2024-09-12T17:07:06.577 INFO:teuthology.orchestra.run.smithi037.stdout: jsoup noarch 1.13.1-10.el9 appstream 377 k 2024-09-12T17:07:06.577 INFO:teuthology.orchestra.run.smithi037.stdout: jsr-305 noarch 3.0.2-6.el9 appstream 35 k 2024-09-12T17:07:06.577 INFO:teuthology.orchestra.run.smithi037.stdout: lcms2 x86_64 2.12-3.el9 appstream 168 k 2024-09-12T17:07:06.577 INFO:teuthology.orchestra.run.smithi037.stdout: libX11-xcb x86_64 1.7.0-9.el9 appstream 11 k 2024-09-12T17:07:06.577 INFO:teuthology.orchestra.run.smithi037.stdout: libXcomposite x86_64 0.4.5-7.el9 appstream 24 k 2024-09-12T17:07:06.577 INFO:teuthology.orchestra.run.smithi037.stdout: libXcursor x86_64 1.2.0-7.el9 appstream 31 k 2024-09-12T17:07:06.577 INFO:teuthology.orchestra.run.smithi037.stdout: libXdamage x86_64 1.1.5-7.el9 appstream 23 k 2024-09-12T17:07:06.577 INFO:teuthology.orchestra.run.smithi037.stdout: libXfixes x86_64 5.0.3-16.el9 appstream 20 k 2024-09-12T17:07:06.578 INFO:teuthology.orchestra.run.smithi037.stdout: libXi x86_64 1.7.10-8.el9 appstream 40 k 2024-09-12T17:07:06.578 INFO:teuthology.orchestra.run.smithi037.stdout: libXinerama x86_64 1.1.4-10.el9 appstream 15 k 2024-09-12T17:07:06.578 INFO:teuthology.orchestra.run.smithi037.stdout: libXrandr x86_64 1.5.2-8.el9 appstream 28 k 2024-09-12T17:07:06.578 INFO:teuthology.orchestra.run.smithi037.stdout: libXtst x86_64 1.2.3-16.el9 appstream 21 k 2024-09-12T17:07:06.578 INFO:teuthology.orchestra.run.smithi037.stdout: libXv x86_64 1.0.11-16.el9 appstream 19 k 2024-09-12T17:07:06.578 INFO:teuthology.orchestra.run.smithi037.stdout: libXxf86vm x86_64 1.1.4-18.el9 appstream 19 k 2024-09-12T17:07:06.578 INFO:teuthology.orchestra.run.smithi037.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-12T17:07:06.578 INFO:teuthology.orchestra.run.smithi037.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-12T17:07:06.578 INFO:teuthology.orchestra.run.smithi037.stdout: libasyncns x86_64 0.8-22.el9 appstream 30 k 2024-09-12T17:07:06.578 INFO:teuthology.orchestra.run.smithi037.stdout: libcanberra x86_64 0.30-27.el9 appstream 86 k 2024-09-12T17:07:06.578 INFO:teuthology.orchestra.run.smithi037.stdout: libcephsqlite x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 161 k 2024-09-12T17:07:06.578 INFO:teuthology.orchestra.run.smithi037.stdout: libdrm x86_64 2.4.121-1.el9 appstream 161 k 2024-09-12T17:07:06.578 INFO:teuthology.orchestra.run.smithi037.stdout: libepoxy x86_64 1.5.5-4.el9 appstream 241 k 2024-09-12T17:07:06.579 INFO:teuthology.orchestra.run.smithi037.stdout: libexif x86_64 0.6.22-6.el9 appstream 435 k 2024-09-12T17:07:06.579 INFO:teuthology.orchestra.run.smithi037.stdout: libfontenc x86_64 1.1.3-17.el9 appstream 31 k 2024-09-12T17:07:06.579 INFO:teuthology.orchestra.run.smithi037.stdout: libgexiv2 x86_64 0.12.3-1.el9 appstream 83 k 2024-09-12T17:07:06.579 INFO:teuthology.orchestra.run.smithi037.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-12T17:07:06.579 INFO:teuthology.orchestra.run.smithi037.stdout: libglvnd x86_64 1:1.3.4-1.el9 appstream 135 k 2024-09-12T17:07:06.579 INFO:teuthology.orchestra.run.smithi037.stdout: libglvnd-egl x86_64 1:1.3.4-1.el9 appstream 37 k 2024-09-12T17:07:06.579 INFO:teuthology.orchestra.run.smithi037.stdout: libglvnd-glx x86_64 1:1.3.4-1.el9 appstream 142 k 2024-09-12T17:07:06.579 INFO:teuthology.orchestra.run.smithi037.stdout: libgsf x86_64 1.14.47-5.el9 appstream 256 k 2024-09-12T17:07:06.579 INFO:teuthology.orchestra.run.smithi037.stdout: libgxps x86_64 0.3.2-3.el9 appstream 79 k 2024-09-12T17:07:06.579 INFO:teuthology.orchestra.run.smithi037.stdout: libiptcdata x86_64 1.0.5-10.el9 appstream 61 k 2024-09-12T17:07:06.579 INFO:teuthology.orchestra.run.smithi037.stdout: libldac x86_64 2.0.2.3-10.el9 appstream 41 k 2024-09-12T17:07:06.579 INFO:teuthology.orchestra.run.smithi037.stdout: libnotify x86_64 0.7.9-8.el9 appstream 44 k 2024-09-12T17:07:06.579 INFO:teuthology.orchestra.run.smithi037.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-12T17:07:06.580 INFO:teuthology.orchestra.run.smithi037.stdout: libogg x86_64 2:1.3.4-6.el9 appstream 34 k 2024-09-12T17:07:06.580 INFO:teuthology.orchestra.run.smithi037.stdout: libosinfo x86_64 1.10.0-1.el9 appstream 319 k 2024-09-12T17:07:06.580 INFO:teuthology.orchestra.run.smithi037.stdout: libpciaccess x86_64 0.16-7.el9 baseos 27 k 2024-09-12T17:07:06.580 INFO:teuthology.orchestra.run.smithi037.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-12T17:07:06.580 INFO:teuthology.orchestra.run.smithi037.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-12T17:07:06.580 INFO:teuthology.orchestra.run.smithi037.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-12T17:07:06.580 INFO:teuthology.orchestra.run.smithi037.stdout: libradosstriper1 x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 508 k 2024-09-12T17:07:06.580 INFO:teuthology.orchestra.run.smithi037.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-12T17:07:06.580 INFO:teuthology.orchestra.run.smithi037.stdout: librgw2 x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 5.5 M 2024-09-12T17:07:06.580 INFO:teuthology.orchestra.run.smithi037.stdout: libsbc x86_64 1.4-9.el9 appstream 45 k 2024-09-12T17:07:06.580 INFO:teuthology.orchestra.run.smithi037.stdout: libsndfile x86_64 1.0.31-8.el9 appstream 206 k 2024-09-12T17:07:06.580 INFO:teuthology.orchestra.run.smithi037.stdout: libtheora x86_64 1:1.1.1-31.el9 appstream 164 k 2024-09-12T17:07:06.580 INFO:teuthology.orchestra.run.smithi037.stdout: libtiff x86_64 4.4.0-13.el9 appstream 198 k 2024-09-12T17:07:06.580 INFO:teuthology.orchestra.run.smithi037.stdout: libtool-ltdl x86_64 2.4.6-46.el9 appstream 36 k 2024-09-12T17:07:06.581 INFO:teuthology.orchestra.run.smithi037.stdout: libtracker-sparql x86_64 3.1.2-3.el9 appstream 324 k 2024-09-12T17:07:06.581 INFO:teuthology.orchestra.run.smithi037.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-12T17:07:06.581 INFO:teuthology.orchestra.run.smithi037.stdout: libvisual x86_64 1:0.4.0-34.el9 appstream 144 k 2024-09-12T17:07:06.581 INFO:teuthology.orchestra.run.smithi037.stdout: libvorbis x86_64 1:1.3.7-5.el9 appstream 193 k 2024-09-12T17:07:06.581 INFO:teuthology.orchestra.run.smithi037.stdout: libwayland-client x86_64 1.21.0-1.el9 appstream 33 k 2024-09-12T17:07:06.581 INFO:teuthology.orchestra.run.smithi037.stdout: libwayland-cursor x86_64 1.21.0-1.el9 appstream 19 k 2024-09-12T17:07:06.581 INFO:teuthology.orchestra.run.smithi037.stdout: libwayland-egl x86_64 1.21.0-1.el9 appstream 13 k 2024-09-12T17:07:06.581 INFO:teuthology.orchestra.run.smithi037.stdout: libwayland-server x86_64 1.21.0-1.el9 appstream 42 k 2024-09-12T17:07:06.581 INFO:teuthology.orchestra.run.smithi037.stdout: libwebp x86_64 1.2.0-8.el9 appstream 277 k 2024-09-12T17:07:06.581 INFO:teuthology.orchestra.run.smithi037.stdout: libxkbcommon x86_64 1.0.3-4.el9 appstream 133 k 2024-09-12T17:07:06.581 INFO:teuthology.orchestra.run.smithi037.stdout: libxshmfence x86_64 1.3-10.el9 appstream 13 k 2024-09-12T17:07:06.581 INFO:teuthology.orchestra.run.smithi037.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2024-09-12T17:07:06.581 INFO:teuthology.orchestra.run.smithi037.stdout: low-memory-monitor x86_64 2.1-4.el9 appstream 36 k 2024-09-12T17:07:06.582 INFO:teuthology.orchestra.run.smithi037.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-12T17:07:06.582 INFO:teuthology.orchestra.run.smithi037.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-12T17:07:06.582 INFO:teuthology.orchestra.run.smithi037.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-12T17:07:06.582 INFO:teuthology.orchestra.run.smithi037.stdout: lua-posix x86_64 35.0-8.el9 appstream 151 k 2024-09-12T17:07:06.582 INFO:teuthology.orchestra.run.smithi037.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-12T17:07:06.582 INFO:teuthology.orchestra.run.smithi037.stdout: maven-lib noarch 1:3.6.3-15.el9 appstream 1.5 M 2024-09-12T17:07:06.582 INFO:teuthology.orchestra.run.smithi037.stdout: maven-openjdk11 noarch 1:3.6.3-15.el9 appstream 9.0 k 2024-09-12T17:07:06.582 INFO:teuthology.orchestra.run.smithi037.stdout: maven-resolver noarch 1:1.6.1-10.el9 appstream 517 k 2024-09-12T17:07:06.582 INFO:teuthology.orchestra.run.smithi037.stdout: maven-shared-utils noarch 3.3.4-3.el9 appstream 151 k 2024-09-12T17:07:06.582 INFO:teuthology.orchestra.run.smithi037.stdout: maven-wagon noarch 3.4.2-7.el9 appstream 112 k 2024-09-12T17:07:06.582 INFO:teuthology.orchestra.run.smithi037.stdout: mesa-filesystem x86_64 24.1.2-3.el9 appstream 11 k 2024-09-12T17:07:06.582 INFO:teuthology.orchestra.run.smithi037.stdout: mesa-libEGL x86_64 24.1.2-3.el9 appstream 139 k 2024-09-12T17:07:06.582 INFO:teuthology.orchestra.run.smithi037.stdout: mesa-libGL x86_64 24.1.2-3.el9 appstream 171 k 2024-09-12T17:07:06.583 INFO:teuthology.orchestra.run.smithi037.stdout: mesa-libgbm x86_64 24.1.2-3.el9 appstream 36 k 2024-09-12T17:07:06.583 INFO:teuthology.orchestra.run.smithi037.stdout: mesa-libglapi x86_64 24.1.2-3.el9 appstream 46 k 2024-09-12T17:07:06.583 INFO:teuthology.orchestra.run.smithi037.stdout: mkfontscale x86_64 1.2.1-3.el9 appstream 32 k 2024-09-12T17:07:06.583 INFO:teuthology.orchestra.run.smithi037.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-12T17:07:06.583 INFO:teuthology.orchestra.run.smithi037.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-12T17:07:06.583 INFO:teuthology.orchestra.run.smithi037.stdout: openjpeg2 x86_64 2.4.0-7.el9 appstream 163 k 2024-09-12T17:07:06.583 INFO:teuthology.orchestra.run.smithi037.stdout: opus x86_64 1.3.1-10.el9 appstream 200 k 2024-09-12T17:07:06.583 INFO:teuthology.orchestra.run.smithi037.stdout: orc x86_64 0.4.31-8.el9 appstream 183 k 2024-09-12T17:07:06.583 INFO:teuthology.orchestra.run.smithi037.stdout: osinfo-db noarch 20240701-2.el9 appstream 531 k 2024-09-12T17:07:06.583 INFO:teuthology.orchestra.run.smithi037.stdout: osinfo-db-tools x86_64 1.10.0-1.el9 appstream 74 k 2024-09-12T17:07:06.583 INFO:teuthology.orchestra.run.smithi037.stdout: ostree-libs x86_64 2024.7-2.el9 appstream 468 k 2024-09-12T17:07:06.583 INFO:teuthology.orchestra.run.smithi037.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-12T17:07:06.583 INFO:teuthology.orchestra.run.smithi037.stdout: pipewire-jack-audio-connection-kit-libs x86_64 1.0.1-1.el9 appstream 135 k 2024-09-12T17:07:06.584 INFO:teuthology.orchestra.run.smithi037.stdout: pipewire-libs x86_64 1.0.1-1.el9 appstream 1.9 M 2024-09-12T17:07:06.584 INFO:teuthology.orchestra.run.smithi037.stdout: plexus-cipher noarch 1.7-27.el9 appstream 26 k 2024-09-12T17:07:06.584 INFO:teuthology.orchestra.run.smithi037.stdout: plexus-classworlds noarch 2.6.0-11.el9 appstream 60 k 2024-09-12T17:07:06.584 INFO:teuthology.orchestra.run.smithi037.stdout: plexus-containers-component-annotations noarch 2.1.0-10.el9 appstream 18 k 2024-09-12T17:07:06.584 INFO:teuthology.orchestra.run.smithi037.stdout: plexus-interpolation noarch 1.26-11.el9 appstream 80 k 2024-09-12T17:07:06.584 INFO:teuthology.orchestra.run.smithi037.stdout: plexus-sec-dispatcher noarch 1.4-37.el9 appstream 34 k 2024-09-12T17:07:06.584 INFO:teuthology.orchestra.run.smithi037.stdout: plexus-utils noarch 3.3.0-10.el9 appstream 254 k 2024-09-12T17:07:06.584 INFO:teuthology.orchestra.run.smithi037.stdout: poppler x86_64 21.01.0-21.el9 appstream 1.1 M 2024-09-12T17:07:06.584 INFO:teuthology.orchestra.run.smithi037.stdout: poppler-data noarch 0.4.9-9.el9 appstream 1.9 M 2024-09-12T17:07:06.584 INFO:teuthology.orchestra.run.smithi037.stdout: poppler-glib x86_64 21.01.0-21.el9 appstream 152 k 2024-09-12T17:07:06.584 INFO:teuthology.orchestra.run.smithi037.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-12T17:07:06.584 INFO:teuthology.orchestra.run.smithi037.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-12T17:07:06.584 INFO:teuthology.orchestra.run.smithi037.stdout: publicsuffix-list noarch 20210518-3.el9 appstream 83 k 2024-09-12T17:07:06.584 INFO:teuthology.orchestra.run.smithi037.stdout: pulseaudio-libs x86_64 15.0-2.el9 appstream 679 k 2024-09-12T17:07:06.585 INFO:teuthology.orchestra.run.smithi037.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-12T17:07:06.585 INFO:teuthology.orchestra.run.smithi037.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-12T17:07:06.585 INFO:teuthology.orchestra.run.smithi037.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-12T17:07:06.585 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-12T17:07:06.585 INFO:teuthology.orchestra.run.smithi037.stdout: python3-ceph-argparse x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 45 k 2024-09-12T17:07:06.585 INFO:teuthology.orchestra.run.smithi037.stdout: python3-ceph-common x86_64 2:19.3.0-4762.gbad475c1.el9 ceph 143 k 2024-09-12T17:07:06.585 INFO:teuthology.orchestra.run.smithi037.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-12T17:07:06.585 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-12T17:07:06.585 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-12T17:07:06.585 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-12T17:07:06.585 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-12T17:07:06.585 INFO:teuthology.orchestra.run.smithi037.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-12T17:07:06.585 INFO:teuthology.orchestra.run.smithi037.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-12T17:07:06.586 INFO:teuthology.orchestra.run.smithi037.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-12T17:07:06.586 INFO:teuthology.orchestra.run.smithi037.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-12T17:07:06.586 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-12T17:07:06.586 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-12T17:07:06.586 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-12T17:07:06.586 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-12T17:07:06.586 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-12T17:07:06.586 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-12T17:07:06.586 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-12T17:07:06.586 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-12T17:07:06.586 INFO:teuthology.orchestra.run.smithi037.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-12T17:07:06.586 INFO:teuthology.orchestra.run.smithi037.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-12T17:07:06.587 INFO:teuthology.orchestra.run.smithi037.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-12T17:07:06.587 INFO:teuthology.orchestra.run.smithi037.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-12T17:07:06.587 INFO:teuthology.orchestra.run.smithi037.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-12T17:07:06.587 INFO:teuthology.orchestra.run.smithi037.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-12T17:07:06.587 INFO:teuthology.orchestra.run.smithi037.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-12T17:07:06.587 INFO:teuthology.orchestra.run.smithi037.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-12T17:07:06.587 INFO:teuthology.orchestra.run.smithi037.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-12T17:07:06.587 INFO:teuthology.orchestra.run.smithi037.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-12T17:07:06.587 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-12T17:07:06.587 INFO:teuthology.orchestra.run.smithi037.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-12T17:07:06.587 INFO:teuthology.orchestra.run.smithi037.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-12T17:07:06.587 INFO:teuthology.orchestra.run.smithi037.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-12T17:07:06.587 INFO:teuthology.orchestra.run.smithi037.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-12T17:07:06.587 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-12T17:07:06.588 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-12T17:07:06.588 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-12T17:07:06.588 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-12T17:07:06.588 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-12T17:07:06.588 INFO:teuthology.orchestra.run.smithi037.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-12T17:07:06.588 INFO:teuthology.orchestra.run.smithi037.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-12T17:07:06.588 INFO:teuthology.orchestra.run.smithi037.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-12T17:07:06.588 INFO:teuthology.orchestra.run.smithi037.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-12T17:07:06.588 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-12T17:07:06.588 INFO:teuthology.orchestra.run.smithi037.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-12T17:07:06.588 INFO:teuthology.orchestra.run.smithi037.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-12T17:07:06.588 INFO:teuthology.orchestra.run.smithi037.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-12T17:07:06.589 INFO:teuthology.orchestra.run.smithi037.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-12T17:07:06.589 INFO:teuthology.orchestra.run.smithi037.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-12T17:07:06.589 INFO:teuthology.orchestra.run.smithi037.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-12T17:07:06.589 INFO:teuthology.orchestra.run.smithi037.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-12T17:07:06.589 INFO:teuthology.orchestra.run.smithi037.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-12T17:07:06.589 INFO:teuthology.orchestra.run.smithi037.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-12T17:07:06.589 INFO:teuthology.orchestra.run.smithi037.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-12T17:07:06.589 INFO:teuthology.orchestra.run.smithi037.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-12T17:07:06.589 INFO:teuthology.orchestra.run.smithi037.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-12T17:07:06.589 INFO:teuthology.orchestra.run.smithi037.stdout: rtkit x86_64 0.11-29.el9 appstream 56 k 2024-09-12T17:07:06.589 INFO:teuthology.orchestra.run.smithi037.stdout: sisu noarch 1:0.3.4-10.el9 appstream 510 k 2024-09-12T17:07:06.589 INFO:teuthology.orchestra.run.smithi037.stdout: slf4j noarch 1.7.30-13.el9 appstream 69 k 2024-09-12T17:07:06.589 INFO:teuthology.orchestra.run.smithi037.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-12T17:07:06.589 INFO:teuthology.orchestra.run.smithi037.stdout: sound-theme-freedesktop noarch 0.8-17.el9 appstream 383 k 2024-09-12T17:07:06.590 INFO:teuthology.orchestra.run.smithi037.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-12T17:07:06.590 INFO:teuthology.orchestra.run.smithi037.stdout: totem-pl-parser x86_64 3.26.6-2.el9 appstream 152 k 2024-09-12T17:07:06.590 INFO:teuthology.orchestra.run.smithi037.stdout: tracker x86_64 3.1.2-3.el9 appstream 555 k 2024-09-12T17:07:06.590 INFO:teuthology.orchestra.run.smithi037.stdout: ttmkfdir x86_64 3.0.9-65.el9 appstream 53 k 2024-09-12T17:07:06.590 INFO:teuthology.orchestra.run.smithi037.stdout: tzdata-java noarch 2024a-2.el9 appstream 230 k 2024-09-12T17:07:06.590 INFO:teuthology.orchestra.run.smithi037.stdout: upower x86_64 0.99.11-11.el9 appstream 173 k 2024-09-12T17:07:06.590 INFO:teuthology.orchestra.run.smithi037.stdout: webrtc-audio-processing x86_64 0.3.1-8.el9 appstream 306 k 2024-09-12T17:07:06.590 INFO:teuthology.orchestra.run.smithi037.stdout: wireplumber x86_64 0.4.14-1.el9 appstream 96 k 2024-09-12T17:07:06.590 INFO:teuthology.orchestra.run.smithi037.stdout: wireplumber-libs x86_64 0.4.14-1.el9 appstream 358 k 2024-09-12T17:07:06.590 INFO:teuthology.orchestra.run.smithi037.stdout: xdg-dbus-proxy x86_64 0.1.3-1.el9 appstream 42 k 2024-09-12T17:07:06.590 INFO:teuthology.orchestra.run.smithi037.stdout: xdg-desktop-portal x86_64 1.12.6-1.el9 appstream 385 k 2024-09-12T17:07:06.590 INFO:teuthology.orchestra.run.smithi037.stdout: xkeyboard-config noarch 2.33-2.el9 appstream 859 k 2024-09-12T17:07:06.590 INFO:teuthology.orchestra.run.smithi037.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-12T17:07:06.591 INFO:teuthology.orchestra.run.smithi037.stdout: xorg-x11-fonts-Type1 noarch 7.5-33.el9 appstream 505 k 2024-09-12T17:07:06.591 INFO:teuthology.orchestra.run.smithi037.stdout:Installing weak dependencies: 2024-09-12T17:07:06.591 INFO:teuthology.orchestra.run.smithi037.stdout: dconf x86_64 0.40.0-6.el9 appstream 113 k 2024-09-12T17:07:06.591 INFO:teuthology.orchestra.run.smithi037.stdout: exiv2 x86_64 0.27.5-2.el9 appstream 980 k 2024-09-12T17:07:06.591 INFO:teuthology.orchestra.run.smithi037.stdout: flatpak x86_64 1.12.9-1.el9 appstream 1.7 M 2024-09-12T17:07:06.591 INFO:teuthology.orchestra.run.smithi037.stdout: gtk3 x86_64 3.24.31-5.el9 appstream 4.9 M 2024-09-12T17:07:06.591 INFO:teuthology.orchestra.run.smithi037.stdout: java-11-openjdk-devel x86_64 1:11.0.20.1.1-2.el9 appstream 3.3 M 2024-09-12T17:07:06.591 INFO:teuthology.orchestra.run.smithi037.stdout: libcanberra-gtk3 x86_64 0.30-27.el9 appstream 32 k 2024-09-12T17:07:06.591 INFO:teuthology.orchestra.run.smithi037.stdout: mesa-dri-drivers x86_64 24.1.2-3.el9 appstream 8.8 M 2024-09-12T17:07:06.591 INFO:teuthology.orchestra.run.smithi037.stdout: p11-kit-server x86_64 0.25.3-2.el9 appstream 246 k 2024-09-12T17:07:06.591 INFO:teuthology.orchestra.run.smithi037.stdout: pipewire x86_64 1.0.1-1.el9 appstream 107 k 2024-09-12T17:07:06.591 INFO:teuthology.orchestra.run.smithi037.stdout: pipewire-alsa x86_64 1.0.1-1.el9 appstream 57 k 2024-09-12T17:07:06.591 INFO:teuthology.orchestra.run.smithi037.stdout: pipewire-jack-audio-connection-kit x86_64 1.0.1-1.el9 appstream 9.1 k 2024-09-12T17:07:06.592 INFO:teuthology.orchestra.run.smithi037.stdout: pipewire-pulseaudio x86_64 1.0.1-1.el9 appstream 192 k 2024-09-12T17:07:06.592 INFO:teuthology.orchestra.run.smithi037.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-12T17:07:06.592 INFO:teuthology.orchestra.run.smithi037.stdout: tracker-miners x86_64 3.1.2-4.el9 appstream 944 k 2024-09-12T17:07:06.592 INFO:teuthology.orchestra.run.smithi037.stdout: xdg-desktop-portal-gtk x86_64 1.12.0-3.el9 appstream 134 k 2024-09-12T17:07:06.592 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:07:06.592 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2024-09-12T17:07:06.592 INFO:teuthology.orchestra.run.smithi037.stdout:====================================================================================================== 2024-09-12T17:07:06.592 INFO:teuthology.orchestra.run.smithi037.stdout:Install 283 Packages 2024-09-12T17:07:06.592 INFO:teuthology.orchestra.run.smithi037.stdout:Upgrade 2 Packages 2024-09-12T17:07:06.592 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:07:06.593 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 322 M 2024-09-12T17:07:06.593 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading Packages: 2024-09-12T17:07:06.647 INFO:teuthology.orchestra.run.smithi040.stdout:(90/285): gtk3-3.24.31-5.el9.x86_64.rpm 4.3 MB/s | 4.9 MB 00:01 2024-09-12T17:07:06.672 INFO:teuthology.orchestra.run.smithi040.stdout:(91/285): hicolor-icon-theme-0.17-13.el9.noarch 289 kB/s | 219 kB 00:00 2024-09-12T17:07:06.731 INFO:teuthology.orchestra.run.smithi040.stdout:(92/285): guava-30.1-6.el9.noarch.rpm 2.0 MB/s | 2.3 MB 00:01 2024-09-12T17:07:07.222 INFO:teuthology.orchestra.run.smithi037.stdout:(1/285): ceph-19.3.0-4762.gbad475c1.el9.x86_64. 47 kB/s | 6.6 kB 00:00 2024-09-12T17:07:07.398 INFO:teuthology.orchestra.run.smithi037.stdout:(2/285): ceph-fuse-19.3.0-4762.gbad475c1.el9.x8 5.0 MB/s | 900 kB 00:00 2024-09-12T17:07:07.456 INFO:teuthology.orchestra.run.smithi037.stdout:(3/285): ceph-immutable-object-cache-19.3.0-476 2.4 MB/s | 145 kB 00:00 2024-09-12T17:07:07.523 INFO:teuthology.orchestra.run.smithi040.stdout:(93/285): httpcomponents-core-4.4.13-7.el9.noar 743 kB/s | 632 kB 00:00 2024-09-12T17:07:07.606 INFO:teuthology.orchestra.run.smithi040.stdout:(94/285): httpcomponents-client-4.5.13-3.el9.no 685 kB/s | 657 kB 00:00 2024-09-12T17:07:07.665 INFO:teuthology.orchestra.run.smithi037.stdout:(4/285): ceph-base-19.3.0-4762.gbad475c1.el9.x8 9.5 MB/s | 5.5 MB 00:00 2024-09-12T17:07:07.723 INFO:teuthology.orchestra.run.smithi037.stdout:(5/285): ceph-mds-19.3.0-4762.gbad475c1.el9.x86 8.9 MB/s | 2.4 MB 00:00 2024-09-12T17:07:07.815 INFO:teuthology.orchestra.run.smithi037.stdout:(6/285): ceph-mgr-19.3.0-4762.gbad475c1.el9.x86 10 MB/s | 1.5 MB 00:00 2024-09-12T17:07:07.823 INFO:teuthology.orchestra.run.smithi040.stdout:(95/285): iso-codes-4.6.0-3.el9.noarch.rpm 3.2 MB/s | 3.5 MB 00:01 2024-09-12T17:07:08.099 INFO:teuthology.orchestra.run.smithi037.stdout:(7/285): ceph-mon-19.3.0-4762.gbad475c1.el9.x86 13 MB/s | 4.8 MB 00:00 2024-09-12T17:07:08.216 INFO:teuthology.orchestra.run.smithi040.stdout:(96/285): jakarta-annotations-1.3.5-13.el9.noar 65 kB/s | 45 kB 00:00 2024-09-12T17:07:08.374 INFO:teuthology.orchestra.run.smithi040.stdout:(97/285): jansi-2.3.3-6.el9.x86_64.rpm 143 kB/s | 110 kB 00:00 2024-09-12T17:07:08.499 INFO:teuthology.orchestra.run.smithi037.stdout:(8/285): ceph-common-19.3.0-4762.gbad475c1.el9. 15 MB/s | 22 MB 00:01 2024-09-12T17:07:08.549 INFO:teuthology.orchestra.run.smithi037.stdout:(9/285): ceph-selinux-19.3.0-4762.gbad475c1.el9 503 kB/s | 25 kB 00:00 2024-09-12T17:07:08.741 INFO:teuthology.orchestra.run.smithi040.stdout:(98/285): java-11-openjdk-11.0.20.1.1-2.el9.x86 450 kB/s | 413 kB 00:00 2024-09-12T17:07:08.849 INFO:teuthology.orchestra.run.smithi037.stdout:(10/285): ceph-osd-19.3.0-4762.gbad475c1.el9.x8 17 MB/s | 17 MB 00:01 2024-09-12T17:07:08.975 INFO:teuthology.orchestra.run.smithi037.stdout:(11/285): ceph-radosgw-19.3.0-4762.gbad475c1.el 12 MB/s | 11 MB 00:00 2024-09-12T17:07:09.000 INFO:teuthology.orchestra.run.smithi037.stdout:(12/285): libcephfs-devel-19.3.0-4762.gbad475c1 211 kB/s | 32 kB 00:00 2024-09-12T17:07:09.042 INFO:teuthology.orchestra.run.smithi037.stdout:(13/285): libcephfs2-19.3.0-4762.gbad475c1.el9. 11 MB/s | 756 kB 00:00 2024-09-12T17:07:09.068 INFO:teuthology.orchestra.run.smithi037.stdout:(14/285): libcephsqlite-19.3.0-4762.gbad475c1.e 2.4 MB/s | 161 kB 00:00 2024-09-12T17:07:09.101 INFO:teuthology.orchestra.run.smithi037.stdout:(15/285): librados-devel-19.3.0-4762.gbad475c1. 2.1 MB/s | 126 kB 00:00 2024-09-12T17:07:09.143 INFO:teuthology.orchestra.run.smithi037.stdout:(16/285): libradosstriper1-19.3.0-4762.gbad475c 6.6 MB/s | 508 kB 00:00 2024-09-12T17:07:09.227 INFO:teuthology.orchestra.run.smithi037.stdout:(17/285): python3-ceph-argparse-19.3.0-4762.gba 542 kB/s | 45 kB 00:00 2024-09-12T17:07:09.241 INFO:teuthology.orchestra.run.smithi040.stdout:(99/285): javapackages-filesystem-6.0.0-4.el9.n 26 kB/s | 13 kB 00:00 2024-09-12T17:07:09.294 INFO:teuthology.orchestra.run.smithi040.stdout:(100/285): java-11-openjdk-devel-11.0.20.1.1-2. 3.1 MB/s | 3.3 MB 00:01 2024-09-12T17:07:09.367 INFO:teuthology.orchestra.run.smithi037.stdout:(18/285): python3-ceph-common-19.3.0-4762.gbad4 1.7 MB/s | 143 kB 00:00 2024-09-12T17:07:09.438 INFO:teuthology.orchestra.run.smithi037.stdout:(19/285): librgw2-19.3.0-4762.gbad475c1.el9.x86 16 MB/s | 5.5 MB 00:00 2024-09-12T17:07:09.461 INFO:teuthology.orchestra.run.smithi037.stdout:(20/285): python3-cephfs-19.3.0-4762.gbad475c1. 1.1 MB/s | 161 kB 00:00 2024-09-12T17:07:09.487 INFO:teuthology.orchestra.run.smithi037.stdout:(21/285): python3-rados-19.3.0-4762.gbad475c1.e 6.3 MB/s | 321 kB 00:00 2024-09-12T17:07:09.511 INFO:teuthology.orchestra.run.smithi037.stdout:(22/285): python3-rbd-19.3.0-4762.gbad475c1.el9 5.9 MB/s | 305 kB 00:00 2024-09-12T17:07:09.537 INFO:teuthology.orchestra.run.smithi037.stdout:(23/285): python3-rgw-19.3.0-4762.gbad475c1.el9 1.9 MB/s | 99 kB 00:00 2024-09-12T17:07:09.562 INFO:teuthology.orchestra.run.smithi037.stdout:(24/285): rbd-fuse-19.3.0-4762.gbad475c1.el9.x8 1.7 MB/s | 85 kB 00:00 2024-09-12T17:07:09.621 INFO:teuthology.orchestra.run.smithi037.stdout:(25/285): rbd-nbd-19.3.0-4762.gbad475c1.el9.x86 2.9 MB/s | 170 kB 00:00 2024-09-12T17:07:09.687 INFO:teuthology.orchestra.run.smithi037.stdout:(26/285): rbd-mirror-19.3.0-4762.gbad475c1.el9. 21 MB/s | 3.2 MB 00:00 2024-09-12T17:07:09.713 INFO:teuthology.orchestra.run.smithi037.stdout:(27/285): ceph-grafana-dashboards-19.3.0-4762.g 372 kB/s | 34 kB 00:00 2024-09-12T17:07:09.738 INFO:teuthology.orchestra.run.smithi037.stdout:(28/285): ceph-mgr-cephadm-19.3.0-4762.gbad475c 3.0 MB/s | 154 kB 00:00 2024-09-12T17:07:09.825 INFO:teuthology.orchestra.run.smithi040.stdout:(101/285): jcl-over-slf4j-1.7.30-13.el9.noarch. 45 kB/s | 24 kB 00:00 2024-09-12T17:07:09.850 INFO:teuthology.orchestra.run.smithi040.stdout:(102/285): jbigkit-libs-2.1-23.el9.x86_64.rpm 87 kB/s | 53 kB 00:00 2024-09-12T17:07:10.213 INFO:teuthology.orchestra.run.smithi037.stdout:(29/285): ceph-mgr-diskprediction-local-19.3.0- 16 MB/s | 7.4 MB 00:00 2024-09-12T17:07:10.272 INFO:teuthology.orchestra.run.smithi037.stdout:(30/285): ceph-mgr-modules-core-19.3.0-4762.gba 4.9 MB/s | 291 kB 00:00 2024-09-12T17:07:10.355 INFO:teuthology.orchestra.run.smithi037.stdout:(31/285): ceph-mgr-rook-19.3.0-4762.gbad475c1.e 593 kB/s | 49 kB 00:00 2024-09-12T17:07:10.667 INFO:teuthology.orchestra.run.smithi040.stdout:(103/285): java-11-openjdk-headless-11.0.20.1.1 17 MB/s | 39 MB 00:02 2024-09-12T17:07:10.692 INFO:teuthology.orchestra.run.smithi040.stdout:(104/285): jsr-305-3.0.2-6.el9.noarch.rpm 42 kB/s | 35 kB 00:00 2024-09-12T17:07:10.772 INFO:teuthology.orchestra.run.smithi037.stdout:(32/285): ceph-test-19.3.0-4762.gbad475c1.el9.x 20 MB/s | 45 MB 00:02 2024-09-12T17:07:10.798 INFO:teuthology.orchestra.run.smithi037.stdout:(33/285): ceph-prometheus-alerts-19.3.0-4762.gb 37 kB/s | 16 kB 00:00 2024-09-12T17:07:10.823 INFO:teuthology.orchestra.run.smithi037.stdout:(34/285): ceph-volume-19.3.0-4762.gbad475c1.el9 5.6 MB/s | 285 kB 00:00 2024-09-12T17:07:10.973 INFO:teuthology.orchestra.run.smithi037.stdout:(35/285): ceph-mgr-dashboard-19.3.0-4762.gbad47 11 MB/s | 14 MB 00:01 2024-09-12T17:07:11.015 INFO:teuthology.orchestra.run.smithi037.stdout:(36/285): cephadm-19.3.0-4762.gbad475c1.el9.noa 3.5 MB/s | 783 kB 00:00 2024-09-12T17:07:11.124 INFO:teuthology.orchestra.run.smithi037.stdout:(37/285): bluez-libs-5.56-6.el9.x86_64.rpm 565 kB/s | 85 kB 00:00 2024-09-12T17:07:11.149 INFO:teuthology.orchestra.run.smithi037.stdout:(38/285): bubblewrap-0.4.1-7.el9.x86_64.rpm 370 kB/s | 49 kB 00:00 2024-09-12T17:07:11.174 INFO:teuthology.orchestra.run.smithi037.stdout:(39/285): ModemManager-glib-1.20.2-1.el9.x86_64 955 kB/s | 335 kB 00:00 2024-09-12T17:07:11.192 INFO:teuthology.orchestra.run.smithi040.stdout:(105/285): libX11-xcb-1.7.0-9.el9.x86_64.rpm 22 kB/s | 11 kB 00:00 2024-09-12T17:07:11.225 INFO:teuthology.orchestra.run.smithi037.stdout:(40/285): fuse-2.9.9-16.el9.x86_64.rpm 1.0 MB/s | 80 kB 00:00 2024-09-12T17:07:11.250 INFO:teuthology.orchestra.run.smithi037.stdout:(41/285): cups-libs-2.3.3op2-30.el9.x86_64.rpm 2.0 MB/s | 262 kB 00:00 2024-09-12T17:07:11.275 INFO:teuthology.orchestra.run.smithi037.stdout:(42/285): libpciaccess-0.16-7.el9.x86_64.rpm 536 kB/s | 27 kB 00:00 2024-09-12T17:07:11.317 INFO:teuthology.orchestra.run.smithi037.stdout:(43/285): libgfortran-11.5.0-2.el9.x86_64.rpm 5.5 MB/s | 801 kB 00:00 2024-09-12T17:07:11.343 INFO:teuthology.orchestra.run.smithi040.stdout:(106/285): jsoup-1.13.1-10.el9.noarch.rpm 249 kB/s | 377 kB 00:01 2024-09-12T17:07:11.343 INFO:teuthology.orchestra.run.smithi037.stdout:(44/285): libquadmath-11.5.0-2.el9.x86_64.rpm 2.0 MB/s | 191 kB 00:00 2024-09-12T17:07:11.368 INFO:teuthology.orchestra.run.smithi037.stdout:(45/285): lksctp-tools-1.0.19-2.el9.x86_64.rpm 1.0 MB/s | 94 kB 00:00 2024-09-12T17:07:11.384 INFO:teuthology.orchestra.run.smithi040.stdout:(107/285): lcms2-2.12-3.el9.x86_64.rpm 234 kB/s | 168 kB 00:00 2024-09-12T17:07:11.393 INFO:teuthology.orchestra.run.smithi037.stdout:(46/285): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.3 MB/s | 253 kB 00:00 2024-09-12T17:07:11.427 INFO:teuthology.orchestra.run.smithi037.stdout:(47/285): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 106 kB 00:00 2024-09-12T17:07:11.452 INFO:teuthology.orchestra.run.smithi037.stdout:(48/285): python3-pycparser-2.20-6.el9.noarch.r 2.3 MB/s | 135 kB 00:00 2024-09-12T17:07:11.485 INFO:teuthology.orchestra.run.smithi037.stdout:(49/285): python3-cryptography-36.0.1-4.el9.x86 10 MB/s | 1.2 MB 00:00 2024-09-12T17:07:11.519 INFO:teuthology.orchestra.run.smithi037.stdout:(50/285): python3-requests-2.25.1-8.el9.noarch. 1.3 MB/s | 125 kB 00:00 2024-09-12T17:07:11.553 INFO:teuthology.orchestra.run.smithi037.stdout:(51/285): python3-urllib3-1.26.5-6.el9.noarch.r 2.1 MB/s | 215 kB 00:00 2024-09-12T17:07:11.735 INFO:teuthology.orchestra.run.smithi040.stdout:(108/285): libXcomposite-0.4.5-7.el9.x86_64.rpm 45 kB/s | 24 kB 00:00 2024-09-12T17:07:11.770 INFO:teuthology.orchestra.run.smithi037.stdout:(52/285): adwaita-cursor-theme-40.1.1-3.el9.noa 2.2 MB/s | 650 kB 00:00 2024-09-12T17:07:11.820 INFO:teuthology.orchestra.run.smithi037.stdout:(53/285): alsa-lib-1.2.12-1.el9.x86_64.rpm 1.9 MB/s | 523 kB 00:00 2024-09-12T17:07:11.853 INFO:teuthology.orchestra.run.smithi037.stdout:(54/285): apache-commons-cli-1.4-17.el9.noarch. 849 kB/s | 71 kB 00:00 2024-09-12T17:07:11.893 INFO:teuthology.orchestra.run.smithi040.stdout:(109/285): libXcursor-1.2.0-7.el9.x86_64.rpm 56 kB/s | 31 kB 00:00 2024-09-12T17:07:11.910 INFO:teuthology.orchestra.run.smithi040.stdout:(110/285): libXdamage-1.1.5-7.el9.x86_64.rpm 43 kB/s | 23 kB 00:00 2024-09-12T17:07:11.920 INFO:teuthology.orchestra.run.smithi037.stdout:(55/285): apache-commons-codec-1.15-7.el9.noarc 2.9 MB/s | 302 kB 00:00 2024-09-12T17:07:11.946 INFO:teuthology.orchestra.run.smithi037.stdout:(56/285): apache-commons-io-2.8.0-8.el9.noarch. 3.0 MB/s | 283 kB 00:00 2024-09-12T17:07:12.021 INFO:teuthology.orchestra.run.smithi037.stdout:(57/285): at-spi2-atk-2.38.0-4.el9.x86_64.rpm 1.1 MB/s | 87 kB 00:00 2024-09-12T17:07:12.046 INFO:teuthology.orchestra.run.smithi037.stdout:(58/285): apache-commons-lang3-3.12.0-6.el9.noa 4.3 MB/s | 559 kB 00:00 2024-09-12T17:07:12.180 INFO:teuthology.orchestra.run.smithi037.stdout:(59/285): adwaita-icon-theme-40.1.1-3.el9.noarc 18 MB/s | 12 MB 00:00 2024-09-12T17:07:12.205 INFO:teuthology.orchestra.run.smithi037.stdout:(60/285): atinject-1.0.3-6.el9.noarch.rpm 147 kB/s | 23 kB 00:00 2024-09-12T17:07:12.231 INFO:teuthology.orchestra.run.smithi037.stdout:(61/285): at-spi2-core-2.40.3-1.el9.x86_64.rpm 932 kB/s | 195 kB 00:00 2024-09-12T17:07:12.235 INFO:teuthology.orchestra.run.smithi040.stdout:(111/285): libXfixes-5.0.3-16.el9.x86_64.rpm 40 kB/s | 20 kB 00:00 2024-09-12T17:07:12.281 INFO:teuthology.orchestra.run.smithi037.stdout:(62/285): atk-2.36.0-5.el9.x86_64.rpm 2.8 MB/s | 292 kB 00:00 2024-09-12T17:07:12.306 INFO:teuthology.orchestra.run.smithi037.stdout:(63/285): avahi-glib-0.8-21.el9.x86_64.rpm 148 kB/s | 15 kB 00:00 2024-09-12T17:07:12.331 INFO:teuthology.orchestra.run.smithi037.stdout:(64/285): boost-program-options-1.75.0-8.el9.x8 1.0 MB/s | 107 kB 00:00 2024-09-12T17:07:12.373 INFO:teuthology.orchestra.run.smithi037.stdout:(65/285): cdi-api-2.0.2-6.el9.noarch.rpm 579 kB/s | 53 kB 00:00 2024-09-12T17:07:12.398 INFO:teuthology.orchestra.run.smithi037.stdout:(66/285): colord-libs-1.4.5-4.el9.x86_64.rpm 2.4 MB/s | 229 kB 00:00 2024-09-12T17:07:12.402 INFO:teuthology.orchestra.run.smithi040.stdout:(112/285): libXinerama-1.1.4-10.el9.x86_64.rpm 31 kB/s | 15 kB 00:00 2024-09-12T17:07:12.423 INFO:teuthology.orchestra.run.smithi037.stdout:(67/285): composefs-libs-1.0.5-1.el9.x86_64.rpm 663 kB/s | 61 kB 00:00 2024-09-12T17:07:12.452 INFO:teuthology.orchestra.run.smithi040.stdout:(113/285): libXi-1.7.10-8.el9.x86_64.rpm 71 kB/s | 40 kB 00:00 2024-09-12T17:07:12.465 INFO:teuthology.orchestra.run.smithi037.stdout:(68/285): copy-jdk-configs-4.0-3.el9.noarch.rpm 306 kB/s | 28 kB 00:00 2024-09-12T17:07:12.499 INFO:teuthology.orchestra.run.smithi037.stdout:(69/285): dconf-0.40.0-6.el9.x86_64.rpm 1.1 MB/s | 113 kB 00:00 2024-09-12T17:07:12.533 INFO:teuthology.orchestra.run.smithi037.stdout:(70/285): exempi-2.6.0-0.2.20211007gite23c213.e 4.7 MB/s | 525 kB 00:00 2024-09-12T17:07:12.608 INFO:teuthology.orchestra.run.smithi037.stdout:(71/285): exiv2-0.27.5-2.el9.x86_64.rpm 6.7 MB/s | 980 kB 00:00 2024-09-12T17:07:12.634 INFO:teuthology.orchestra.run.smithi037.stdout:(72/285): fdk-aac-free-2.0.0-8.el9.x86_64.rpm 3.2 MB/s | 325 kB 00:00 2024-09-12T17:07:12.667 INFO:teuthology.orchestra.run.smithi037.stdout:(73/285): exiv2-libs-0.27.5-2.el9.x86_64.rpm 4.5 MB/s | 781 kB 00:00 2024-09-12T17:07:12.701 INFO:teuthology.orchestra.run.smithi037.stdout:(74/285): flac-libs-1.3.3-12.el9.x86_64.rpm 2.3 MB/s | 218 kB 00:00 2024-09-12T17:07:12.759 INFO:teuthology.orchestra.run.smithi037.stdout:(75/285): flatpak-1.12.9-1.el9.x86_64.rpm 14 MB/s | 1.7 MB 00:00 2024-09-12T17:07:12.776 INFO:teuthology.orchestra.run.smithi037.stdout:(76/285): flatpak-selinux-1.12.9-1.el9.noarch.r 199 kB/s | 22 kB 00:00 2024-09-12T17:07:12.794 INFO:teuthology.orchestra.run.smithi040.stdout:(114/285): libXrandr-1.5.2-8.el9.x86_64.rpm 51 kB/s | 28 kB 00:00 2024-09-12T17:07:12.801 INFO:teuthology.orchestra.run.smithi037.stdout:(77/285): flatpak-session-helper-1.12.9-1.el9.x 727 kB/s | 73 kB 00:00 2024-09-12T17:07:12.818 INFO:teuthology.orchestra.run.smithi037.stdout:(78/285): flexiblas-3.0.4-8.el9.x86_64.rpm 558 kB/s | 33 kB 00:00 2024-09-12T17:07:12.877 INFO:teuthology.orchestra.run.smithi037.stdout:(79/285): flexiblas-openblas-openmp-3.0.4-8.el9 242 kB/s | 18 kB 00:00 2024-09-12T17:07:12.902 INFO:teuthology.orchestra.run.smithi037.stdout:(80/285): gdk-pixbuf2-modules-2.42.6-4.el9.x86_ 1.0 MB/s | 89 kB 00:00 2024-09-12T17:07:12.936 INFO:teuthology.orchestra.run.smithi040.stdout:(115/285): libXtst-1.2.3-16.el9.x86_64.rpm 40 kB/s | 21 kB 00:00 2024-09-12T17:07:12.961 INFO:teuthology.orchestra.run.smithi037.stdout:(81/285): geoclue2-2.6.0-7.el9.x86_64.rpm 1.5 MB/s | 124 kB 00:00 2024-09-12T17:07:12.970 INFO:teuthology.orchestra.run.smithi040.stdout:(116/285): libXv-1.0.11-16.el9.x86_64.rpm 37 kB/s | 19 kB 00:00 2024-09-12T17:07:12.978 INFO:teuthology.orchestra.run.smithi037.stdout:(82/285): giflib-5.2.1-9.el9.x86_64.rpm 645 kB/s | 49 kB 00:00 2024-09-12T17:07:13.028 INFO:teuthology.orchestra.run.smithi037.stdout:(83/285): flexiblas-netlib-3.0.4-8.el9.x86_64.r 12 MB/s | 3.0 MB 00:00 2024-09-12T17:07:13.053 INFO:teuthology.orchestra.run.smithi037.stdout:(84/285): graphene-1.10.6-2.el9.x86_64.rpm 857 kB/s | 64 kB 00:00 2024-09-12T17:07:13.079 INFO:teuthology.orchestra.run.smithi037.stdout:(85/285): google-guice-4.2.3-9.el9.noarch.rpm 3.9 MB/s | 473 kB 00:00 2024-09-12T17:07:13.112 INFO:teuthology.orchestra.run.smithi037.stdout:(86/285): gsm-1.0.19-6.el9.x86_64.rpm 406 kB/s | 34 kB 00:00 2024-09-12T17:07:13.154 INFO:teuthology.orchestra.run.smithi037.stdout:(87/285): gstreamer1-1.22.1-2.el9.x86_64.rpm 14 MB/s | 1.4 MB 00:00 2024-09-12T17:07:13.213 INFO:teuthology.orchestra.run.smithi037.stdout:(88/285): gstreamer1-plugins-base-1.22.1-2.el9. 17 MB/s | 2.2 MB 00:00 2024-09-12T17:07:13.238 INFO:teuthology.orchestra.run.smithi037.stdout:(89/285): gtk-update-icon-cache-3.24.31-5.el9.x 263 kB/s | 33 kB 00:00 2024-09-12T17:07:13.287 INFO:teuthology.orchestra.run.smithi040.stdout:(117/285): libXxf86vm-1.1.4-18.el9.x86_64.rpm 38 kB/s | 19 kB 00:00 2024-09-12T17:07:13.368 INFO:teuthology.orchestra.run.smithi037.stdout:(90/285): hicolor-icon-theme-0.17-13.el9.noarch 1.6 MB/s | 219 kB 00:00 2024-09-12T17:07:13.439 INFO:teuthology.orchestra.run.smithi037.stdout:(91/285): gtk3-3.24.31-5.el9.x86_64.rpm 17 MB/s | 4.9 MB 00:00 2024-09-12T17:07:13.472 INFO:teuthology.orchestra.run.smithi037.stdout:(92/285): httpcomponents-client-4.5.13-3.el9.no 6.2 MB/s | 657 kB 00:00 2024-09-12T17:07:13.479 INFO:teuthology.orchestra.run.smithi040.stdout:(118/285): libasyncns-0.8-22.el9.x86_64.rpm 56 kB/s | 30 kB 00:00 2024-09-12T17:07:13.531 INFO:teuthology.orchestra.run.smithi037.stdout:(93/285): guava-30.1-6.el9.noarch.rpm 7.3 MB/s | 2.3 MB 00:00 2024-09-12T17:07:13.573 INFO:teuthology.orchestra.run.smithi037.stdout:(94/285): httpcomponents-core-4.4.13-7.el9.noar 4.6 MB/s | 632 kB 00:00 2024-09-12T17:07:13.621 INFO:teuthology.orchestra.run.smithi040.stdout:(119/285): libcanberra-0.30-27.el9.x86_64.rpm 133 kB/s | 86 kB 00:00 2024-09-12T17:07:13.631 INFO:teuthology.orchestra.run.smithi037.stdout:(95/285): jakarta-annotations-1.3.5-13.el9.noar 450 kB/s | 45 kB 00:00 2024-09-12T17:07:13.657 INFO:teuthology.orchestra.run.smithi037.stdout:(96/285): jansi-2.3.3-6.el9.x86_64.rpm 1.3 MB/s | 110 kB 00:00 2024-09-12T17:07:13.715 INFO:teuthology.orchestra.run.smithi037.stdout:(97/285): iso-codes-4.6.0-3.el9.noarch.rpm 15 MB/s | 3.5 MB 00:00 2024-09-12T17:07:13.740 INFO:teuthology.orchestra.run.smithi037.stdout:(98/285): java-11-openjdk-11.0.20.1.1-2.el9.x86 3.7 MB/s | 413 kB 00:00 2024-09-12T17:07:13.799 INFO:teuthology.orchestra.run.smithi037.stdout:(99/285): java-11-openjdk-devel-11.0.20.1.1-2.e 23 MB/s | 3.3 MB 00:00 2024-09-12T17:07:13.824 INFO:teuthology.orchestra.run.smithi037.stdout:(100/285): javapackages-filesystem-6.0.0-4.el9. 156 kB/s | 13 kB 00:00 2024-09-12T17:07:13.866 INFO:teuthology.orchestra.run.smithi037.stdout:(101/285): jbigkit-libs-2.1-23.el9.x86_64.rpm 794 kB/s | 53 kB 00:00 2024-09-12T17:07:13.908 INFO:teuthology.orchestra.run.smithi037.stdout:(102/285): jcl-over-slf4j-1.7.30-13.el9.noarch. 287 kB/s | 24 kB 00:00 2024-09-12T17:07:13.934 INFO:teuthology.orchestra.run.smithi037.stdout:(103/285): jsoup-1.13.1-10.el9.noarch.rpm 5.5 MB/s | 377 kB 00:00 2024-09-12T17:07:13.938 INFO:teuthology.orchestra.run.smithi040.stdout:(120/285): libcanberra-gtk3-0.30-27.el9.x86_64. 49 kB/s | 32 kB 00:00 2024-09-12T17:07:14.001 INFO:teuthology.orchestra.run.smithi037.stdout:(104/285): jsr-305-3.0.2-6.el9.noarch.rpm 385 kB/s | 35 kB 00:00 2024-09-12T17:07:14.026 INFO:teuthology.orchestra.run.smithi037.stdout:(105/285): lcms2-2.12-3.el9.x86_64.rpm 1.8 MB/s | 168 kB 00:00 2024-09-12T17:07:14.068 INFO:teuthology.orchestra.run.smithi037.stdout:(106/285): libX11-xcb-1.7.0-9.el9.x86_64.rpm 166 kB/s | 11 kB 00:00 2024-09-12T17:07:14.093 INFO:teuthology.orchestra.run.smithi037.stdout:(107/285): libXcomposite-0.4.5-7.el9.x86_64.rpm 362 kB/s | 24 kB 00:00 2024-09-12T17:07:14.135 INFO:teuthology.orchestra.run.smithi037.stdout:(108/285): libXcursor-1.2.0-7.el9.x86_64.rpm 459 kB/s | 31 kB 00:00 2024-09-12T17:07:14.185 INFO:teuthology.orchestra.run.smithi037.stdout:(109/285): libXdamage-1.1.5-7.el9.x86_64.rpm 248 kB/s | 23 kB 00:00 2024-09-12T17:07:14.204 INFO:teuthology.orchestra.run.smithi040.stdout:(121/285): libdrm-2.4.121-1.el9.x86_64.rpm 222 kB/s | 161 kB 00:00 2024-09-12T17:07:14.236 INFO:teuthology.orchestra.run.smithi037.stdout:(110/285): libXfixes-5.0.3-16.el9.x86_64.rpm 197 kB/s | 20 kB 00:00 2024-09-12T17:07:14.261 INFO:teuthology.orchestra.run.smithi037.stdout:(111/285): libXi-1.7.10-8.el9.x86_64.rpm 526 kB/s | 40 kB 00:00 2024-09-12T17:07:14.320 INFO:teuthology.orchestra.run.smithi037.stdout:(112/285): libXinerama-1.1.4-10.el9.x86_64.rpm 180 kB/s | 15 kB 00:00 2024-09-12T17:07:14.345 INFO:teuthology.orchestra.run.smithi037.stdout:(113/285): libXrandr-1.5.2-8.el9.x86_64.rpm 340 kB/s | 28 kB 00:00 2024-09-12T17:07:14.395 INFO:teuthology.orchestra.run.smithi037.stdout:(114/285): libXtst-1.2.3-16.el9.x86_64.rpm 286 kB/s | 21 kB 00:00 2024-09-12T17:07:14.405 INFO:teuthology.orchestra.run.smithi040.stdout:(122/285): libepoxy-1.5.5-4.el9.x86_64.rpm 308 kB/s | 241 kB 00:00 2024-09-12T17:07:14.420 INFO:teuthology.orchestra.run.smithi037.stdout:(115/285): libXv-1.0.11-16.el9.x86_64.rpm 254 kB/s | 19 kB 00:00 2024-09-12T17:07:14.471 INFO:teuthology.orchestra.run.smithi037.stdout:(116/285): libXxf86vm-1.1.4-18.el9.x86_64.rpm 250 kB/s | 19 kB 00:00 2024-09-12T17:07:14.496 INFO:teuthology.orchestra.run.smithi037.stdout:(117/285): libasyncns-0.8-22.el9.x86_64.rpm 405 kB/s | 30 kB 00:00 2024-09-12T17:07:14.546 INFO:teuthology.orchestra.run.smithi037.stdout:(118/285): libcanberra-gtk3-0.30-27.el9.x86_64. 635 kB/s | 32 kB 00:00 2024-09-12T17:07:14.571 INFO:teuthology.orchestra.run.smithi037.stdout:(119/285): libcanberra-0.30-27.el9.x86_64.rpm 859 kB/s | 86 kB 00:00 2024-09-12T17:07:14.613 INFO:teuthology.orchestra.run.smithi037.stdout:(120/285): libdrm-2.4.121-1.el9.x86_64.rpm 2.4 MB/s | 161 kB 00:00 2024-09-12T17:07:14.755 INFO:teuthology.orchestra.run.smithi040.stdout:(123/285): libfontenc-1.1.3-17.el9.x86_64.rpm 56 kB/s | 31 kB 00:00 2024-09-12T17:07:14.847 INFO:teuthology.orchestra.run.smithi040.stdout:(124/285): libexif-0.6.22-6.el9.x86_64.rpm 480 kB/s | 435 kB 00:00 2024-09-12T17:07:14.964 INFO:teuthology.orchestra.run.smithi037.stdout:(121/285): java-11-openjdk-headless-11.0.20.1.1 31 MB/s | 39 MB 00:01 2024-09-12T17:07:14.989 INFO:teuthology.orchestra.run.smithi037.stdout:(122/285): libepoxy-1.5.5-4.el9.x86_64.rpm 579 kB/s | 241 kB 00:00 2024-09-12T17:07:15.014 INFO:teuthology.orchestra.run.smithi037.stdout:(123/285): libexif-0.6.22-6.el9.x86_64.rpm 1.1 MB/s | 435 kB 00:00 2024-09-12T17:07:15.048 INFO:teuthology.orchestra.run.smithi040.stdout:(125/285): libgexiv2-0.12.3-1.el9.x86_64.rpm 129 kB/s | 83 kB 00:00 2024-09-12T17:07:15.056 INFO:teuthology.orchestra.run.smithi037.stdout:(124/285): libfontenc-1.1.3-17.el9.x86_64.rpm 337 kB/s | 31 kB 00:00 2024-09-12T17:07:15.082 INFO:teuthology.orchestra.run.smithi037.stdout:(125/285): libgexiv2-0.12.3-1.el9.x86_64.rpm 896 kB/s | 83 kB 00:00 2024-09-12T17:07:15.107 INFO:teuthology.orchestra.run.smithi037.stdout:(126/285): libglvnd-1.3.4-1.el9.x86_64.rpm 1.4 MB/s | 135 kB 00:00 2024-09-12T17:07:15.132 INFO:teuthology.orchestra.run.smithi037.stdout:(127/285): libglvnd-egl-1.3.4-1.el9.x86_64.rpm 486 kB/s | 37 kB 00:00 2024-09-12T17:07:15.157 INFO:teuthology.orchestra.run.smithi037.stdout:(128/285): libglvnd-glx-1.3.4-1.el9.x86_64.rpm 1.8 MB/s | 142 kB 00:00 2024-09-12T17:07:15.182 INFO:teuthology.orchestra.run.smithi037.stdout:(129/285): libgsf-1.14.47-5.el9.x86_64.rpm 3.3 MB/s | 256 kB 00:00 2024-09-12T17:07:15.216 INFO:teuthology.orchestra.run.smithi037.stdout:(130/285): libgxps-0.3.2-3.el9.x86_64.rpm 941 kB/s | 79 kB 00:00 2024-09-12T17:07:15.250 INFO:teuthology.orchestra.run.smithi037.stdout:(131/285): libldac-2.0.2.3-10.el9.x86_64.rpm 617 kB/s | 41 kB 00:00 2024-09-12T17:07:15.300 INFO:teuthology.orchestra.run.smithi037.stdout:(132/285): libnotify-0.7.9-8.el9.x86_64.rpm 519 kB/s | 44 kB 00:00 2024-09-12T17:07:15.325 INFO:teuthology.orchestra.run.smithi037.stdout:(133/285): libogg-1.3.4-6.el9.x86_64.rpm 444 kB/s | 34 kB 00:00 2024-09-12T17:07:15.376 INFO:teuthology.orchestra.run.smithi037.stdout:(134/285): libiptcdata-1.0.5-10.el9.x86_64.rpm 281 kB/s | 61 kB 00:00 2024-09-12T17:07:15.401 INFO:teuthology.orchestra.run.smithi037.stdout:(135/285): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.1 MB/s | 160 kB 00:00 2024-09-12T17:07:15.426 INFO:teuthology.orchestra.run.smithi037.stdout:(136/285): libosinfo-1.10.0-1.el9.x86_64.rpm 2.5 MB/s | 319 kB 00:00 2024-09-12T17:07:15.447 INFO:teuthology.orchestra.run.smithi040.stdout:(126/285): libglvnd-egl-1.3.4-1.el9.x86_64.rpm 61 kB/s | 37 kB 00:00 2024-09-12T17:07:15.460 INFO:teuthology.orchestra.run.smithi037.stdout:(137/285): librabbitmq-0.11.0-7.el9.x86_64.rpm 539 kB/s | 45 kB 00:00 2024-09-12T17:07:15.473 INFO:teuthology.orchestra.run.smithi040.stdout:(127/285): libglvnd-1.3.4-1.el9.x86_64.rpm 189 kB/s | 135 kB 00:00 2024-09-12T17:07:15.502 INFO:teuthology.orchestra.run.smithi037.stdout:(138/285): librdkafka-1.6.1-102.el9.x86_64.rpm 6.4 MB/s | 662 kB 00:00 2024-09-12T17:07:15.527 INFO:teuthology.orchestra.run.smithi037.stdout:(139/285): libsbc-1.4-9.el9.x86_64.rpm 445 kB/s | 45 kB 00:00 2024-09-12T17:07:15.561 INFO:teuthology.orchestra.run.smithi037.stdout:(140/285): libtheora-1.1.1-31.el9.x86_64.rpm 2.7 MB/s | 164 kB 00:00 2024-09-12T17:07:15.586 INFO:teuthology.orchestra.run.smithi037.stdout:(141/285): libsndfile-1.0.31-8.el9.x86_64.rpm 1.6 MB/s | 206 kB 00:00 2024-09-12T17:07:15.620 INFO:teuthology.orchestra.run.smithi037.stdout:(142/285): libtiff-4.4.0-13.el9.x86_64.rpm 2.1 MB/s | 198 kB 00:00 2024-09-12T17:07:15.645 INFO:teuthology.orchestra.run.smithi037.stdout:(143/285): libtool-ltdl-2.4.6-46.el9.x86_64.rpm 424 kB/s | 36 kB 00:00 2024-09-12T17:07:15.687 INFO:teuthology.orchestra.run.smithi037.stdout:(144/285): libtracker-sparql-3.1.2-3.el9.x86_64 3.1 MB/s | 324 kB 00:00 2024-09-12T17:07:15.721 INFO:teuthology.orchestra.run.smithi037.stdout:(145/285): libvisual-0.4.0-34.el9.x86_64.rpm 1.4 MB/s | 144 kB 00:00 2024-09-12T17:07:15.746 INFO:teuthology.orchestra.run.smithi037.stdout:(146/285): libvorbis-1.3.7-5.el9.x86_64.rpm 1.9 MB/s | 193 kB 00:00 2024-09-12T17:07:15.779 INFO:teuthology.orchestra.run.smithi037.stdout:(147/285): libwayland-client-1.21.0-1.el9.x86_6 364 kB/s | 33 kB 00:00 2024-09-12T17:07:15.804 INFO:teuthology.orchestra.run.smithi037.stdout:(148/285): libwayland-cursor-1.21.0-1.el9.x86_6 233 kB/s | 19 kB 00:00 2024-09-12T17:07:15.806 INFO:teuthology.orchestra.run.smithi040.stdout:(128/285): libglvnd-glx-1.3.4-1.el9.x86_64.rpm 188 kB/s | 142 kB 00:00 2024-09-12T17:07:15.830 INFO:teuthology.orchestra.run.smithi037.stdout:(149/285): libwayland-egl-1.21.0-1.el9.x86_64.r 154 kB/s | 13 kB 00:00 2024-09-12T17:07:15.863 INFO:teuthology.orchestra.run.smithi037.stdout:(150/285): libwayland-server-1.21.0-1.el9.x86_6 498 kB/s | 42 kB 00:00 2024-09-12T17:07:15.888 INFO:teuthology.orchestra.run.smithi037.stdout:(151/285): libwebp-1.2.0-8.el9.x86_64.rpm 3.2 MB/s | 277 kB 00:00 2024-09-12T17:07:15.914 INFO:teuthology.orchestra.run.smithi037.stdout:(152/285): libxkbcommon-1.0.3-4.el9.x86_64.rpm 1.6 MB/s | 133 kB 00:00 2024-09-12T17:07:15.947 INFO:teuthology.orchestra.run.smithi037.stdout:(153/285): libxshmfence-1.3-10.el9.x86_64.rpm 151 kB/s | 13 kB 00:00 2024-09-12T17:07:15.981 INFO:teuthology.orchestra.run.smithi037.stdout:(154/285): low-memory-monitor-2.1-4.el9.x86_64. 389 kB/s | 36 kB 00:00 2024-09-12T17:07:16.006 INFO:teuthology.orchestra.run.smithi037.stdout:(155/285): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.1 MB/s | 292 kB 00:00 2024-09-12T17:07:16.048 INFO:teuthology.orchestra.run.smithi037.stdout:(156/285): lua-5.4.4-4.el9.x86_64.rpm 1.8 MB/s | 188 kB 00:00 2024-09-12T17:07:16.073 INFO:teuthology.orchestra.run.smithi037.stdout:(157/285): lua-posix-35.0-8.el9.x86_64.rpm 1.6 MB/s | 151 kB 00:00 2024-09-12T17:07:16.098 INFO:teuthology.orchestra.run.smithi037.stdout:(158/285): maven-3.6.3-15.el9.noarch.rpm 192 kB/s | 18 kB 00:00 2024-09-12T17:07:16.106 INFO:teuthology.orchestra.run.smithi040.stdout:(129/285): libgxps-0.3.2-3.el9.x86_64.rpm 124 kB/s | 79 kB 00:00 2024-09-12T17:07:16.132 INFO:teuthology.orchestra.run.smithi037.stdout:(159/285): maven-openjdk11-3.6.3-15.el9.noarch. 153 kB/s | 9.0 kB 00:00 2024-09-12T17:07:16.174 INFO:teuthology.orchestra.run.smithi037.stdout:(160/285): maven-lib-3.6.3-15.el9.noarch.rpm 12 MB/s | 1.5 MB 00:00 2024-09-12T17:07:16.199 INFO:teuthology.orchestra.run.smithi037.stdout:(161/285): maven-resolver-1.6.1-10.el9.noarch.r 5.0 MB/s | 517 kB 00:00 2024-09-12T17:07:16.215 INFO:teuthology.orchestra.run.smithi040.stdout:(130/285): libgsf-1.14.47-5.el9.x86_64.rpm 334 kB/s | 256 kB 00:00 2024-09-12T17:07:16.225 INFO:teuthology.orchestra.run.smithi037.stdout:(162/285): maven-shared-utils-3.3.4-3.el9.noarc 1.6 MB/s | 151 kB 00:00 2024-09-12T17:07:16.267 INFO:teuthology.orchestra.run.smithi037.stdout:(163/285): maven-wagon-3.4.2-7.el9.noarch.rpm 1.2 MB/s | 112 kB 00:00 2024-09-12T17:07:16.292 INFO:teuthology.orchestra.run.smithi037.stdout:(164/285): mesa-filesystem-24.1.2-3.el9.x86_64. 168 kB/s | 11 kB 00:00 2024-09-12T17:07:16.325 INFO:teuthology.orchestra.run.smithi037.stdout:(165/285): mesa-libEGL-24.1.2-3.el9.x86_64.rpm 2.3 MB/s | 139 kB 00:00 2024-09-12T17:07:16.384 INFO:teuthology.orchestra.run.smithi037.stdout:(166/285): mesa-libGL-24.1.2-3.el9.x86_64.rpm 1.8 MB/s | 171 kB 00:00 2024-09-12T17:07:16.409 INFO:teuthology.orchestra.run.smithi037.stdout:(167/285): mesa-libgbm-24.1.2-3.el9.x86_64.rpm 433 kB/s | 36 kB 00:00 2024-09-12T17:07:16.424 INFO:teuthology.orchestra.run.smithi040.stdout:(131/285): libiptcdata-1.0.5-10.el9.x86_64.rpm 99 kB/s | 61 kB 00:00 2024-09-12T17:07:16.543 INFO:teuthology.orchestra.run.smithi037.stdout:(168/285): mesa-dri-drivers-24.1.2-3.el9.x86_64 26 MB/s | 8.8 MB 00:00 2024-09-12T17:07:16.568 INFO:teuthology.orchestra.run.smithi037.stdout:(169/285): mesa-libglapi-24.1.2-3.el9.x86_64.rp 249 kB/s | 46 kB 00:00 2024-09-12T17:07:16.593 INFO:teuthology.orchestra.run.smithi037.stdout:(170/285): mkfontscale-1.2.1-3.el9.x86_64.rpm 175 kB/s | 32 kB 00:00 2024-09-12T17:07:16.636 INFO:teuthology.orchestra.run.smithi037.stdout:(171/285): openblas-0.3.26-2.el9.x86_64.rpm 418 kB/s | 38 kB 00:00 2024-09-12T17:07:16.669 INFO:teuthology.orchestra.run.smithi037.stdout:(172/285): openjpeg2-2.4.0-7.el9.x86_64.rpm 2.1 MB/s | 163 kB 00:00 2024-09-12T17:07:16.719 INFO:teuthology.orchestra.run.smithi037.stdout:(173/285): opus-1.3.1-10.el9.x86_64.rpm 2.3 MB/s | 200 kB 00:00 2024-09-12T17:07:16.724 INFO:teuthology.orchestra.run.smithi040.stdout:(132/285): libldac-2.0.2.3-10.el9.x86_64.rpm 67 kB/s | 41 kB 00:00 2024-09-12T17:07:16.786 INFO:teuthology.orchestra.run.smithi037.stdout:(174/285): openblas-openmp-0.3.26-2.el9.x86_64. 26 MB/s | 4.9 MB 00:00 2024-09-12T17:07:16.791 INFO:teuthology.orchestra.run.smithi040.stdout:(133/285): libnotify-0.7.9-8.el9.x86_64.rpm 76 kB/s | 44 kB 00:00 2024-09-12T17:07:16.811 INFO:teuthology.orchestra.run.smithi037.stdout:(175/285): orc-0.4.31-8.el9.x86_64.rpm 1.3 MB/s | 183 kB 00:00 2024-09-12T17:07:16.837 INFO:teuthology.orchestra.run.smithi037.stdout:(176/285): osinfo-db-20240701-2.el9.noarch.rpm 4.4 MB/s | 531 kB 00:00 2024-09-12T17:07:16.862 INFO:teuthology.orchestra.run.smithi037.stdout:(177/285): osinfo-db-tools-1.10.0-1.el9.x86_64. 977 kB/s | 74 kB 00:00 2024-09-12T17:07:16.912 INFO:teuthology.orchestra.run.smithi037.stdout:(178/285): ostree-libs-2024.7-2.el9.x86_64.rpm 4.5 MB/s | 468 kB 00:00 2024-09-12T17:07:16.937 INFO:teuthology.orchestra.run.smithi037.stdout:(179/285): pipewire-1.0.1-1.el9.x86_64.rpm 1.4 MB/s | 107 kB 00:00 2024-09-12T17:07:16.963 INFO:teuthology.orchestra.run.smithi037.stdout:(180/285): p11-kit-server-0.25.3-2.el9.x86_64.r 1.9 MB/s | 246 kB 00:00 2024-09-12T17:07:16.996 INFO:teuthology.orchestra.run.smithi037.stdout:(181/285): pipewire-alsa-1.0.1-1.el9.x86_64.rpm 683 kB/s | 57 kB 00:00 2024-09-12T17:07:17.016 INFO:teuthology.orchestra.run.smithi040.stdout:(134/285): libogg-1.3.4-6.el9.x86_64.rpm 57 kB/s | 34 kB 00:00 2024-09-12T17:07:17.021 INFO:teuthology.orchestra.run.smithi037.stdout:(182/285): pipewire-jack-audio-connection-kit-1 109 kB/s | 9.1 kB 00:00 2024-09-12T17:07:17.047 INFO:teuthology.orchestra.run.smithi037.stdout:(183/285): pipewire-jack-audio-connection-kit-l 1.6 MB/s | 135 kB 00:00 2024-09-12T17:07:17.097 INFO:teuthology.orchestra.run.smithi037.stdout:(184/285): pipewire-libs-1.0.1-1.el9.x86_64.rpm 19 MB/s | 1.9 MB 00:00 2024-09-12T17:07:17.122 INFO:teuthology.orchestra.run.smithi037.stdout:(185/285): plexus-cipher-1.7-27.el9.noarch.rpm 343 kB/s | 26 kB 00:00 2024-09-12T17:07:17.148 INFO:teuthology.orchestra.run.smithi037.stdout:(186/285): pipewire-pulseaudio-1.0.1-1.el9.x86_ 1.5 MB/s | 192 kB 00:00 2024-09-12T17:07:17.173 INFO:teuthology.orchestra.run.smithi037.stdout:(187/285): plexus-classworlds-2.6.0-11.el9.noar 796 kB/s | 60 kB 00:00 2024-09-12T17:07:17.190 INFO:teuthology.orchestra.run.smithi037.stdout:(188/285): plexus-containers-component-annotati 274 kB/s | 18 kB 00:00 2024-09-12T17:07:17.232 INFO:teuthology.orchestra.run.smithi037.stdout:(189/285): plexus-sec-dispatcher-1.4-37.el9.noa 574 kB/s | 34 kB 00:00 2024-09-12T17:07:17.257 INFO:teuthology.orchestra.run.smithi037.stdout:(190/285): plexus-interpolation-1.26-11.el9.noa 732 kB/s | 80 kB 00:00 2024-09-12T17:07:17.282 INFO:teuthology.orchestra.run.smithi037.stdout:(191/285): plexus-utils-3.3.0-10.el9.noarch.rpm 2.7 MB/s | 254 kB 00:00 2024-09-12T17:07:17.358 INFO:teuthology.orchestra.run.smithi037.stdout:(192/285): poppler-glib-21.01.0-21.el9.x86_64.r 2.0 MB/s | 152 kB 00:00 2024-09-12T17:07:17.392 INFO:teuthology.orchestra.run.smithi037.stdout:(193/285): poppler-21.01.0-21.el9.x86_64.rpm 6.7 MB/s | 1.1 MB 00:00 2024-09-12T17:07:17.434 INFO:teuthology.orchestra.run.smithi037.stdout:(194/285): poppler-data-0.4.9-9.el9.noarch.rpm 11 MB/s | 1.9 MB 00:00 2024-09-12T17:07:17.458 INFO:teuthology.orchestra.run.smithi037.stdout:(195/285): publicsuffix-list-20210518-3.el9.noa 1.2 MB/s | 83 kB 00:00 2024-09-12T17:07:17.500 INFO:teuthology.orchestra.run.smithi037.stdout:(196/285): protobuf-3.14.0-13.el9.x86_64.rpm 7.1 MB/s | 1.0 MB 00:00 2024-09-12T17:07:17.516 INFO:teuthology.orchestra.run.smithi040.stdout:(135/285): libpmemobj-1.12.1-1.el9.x86_64.rpm 221 kB/s | 160 kB 00:00 2024-09-12T17:07:17.534 INFO:teuthology.orchestra.run.smithi037.stdout:(197/285): pulseaudio-libs-15.0-2.el9.x86_64.rp 6.6 MB/s | 679 kB 00:00 2024-09-12T17:07:17.575 INFO:teuthology.orchestra.run.smithi040.stdout:(136/285): libosinfo-1.10.0-1.el9.x86_64.rpm 375 kB/s | 319 kB 00:00 2024-09-12T17:07:17.584 INFO:teuthology.orchestra.run.smithi037.stdout:(198/285): python3-devel-3.9.19-8.el9.x86_64.rp 2.9 MB/s | 245 kB 00:00 2024-09-12T17:07:17.634 INFO:teuthology.orchestra.run.smithi040.stdout:(137/285): librabbitmq-0.11.0-7.el9.x86_64.rpm 74 kB/s | 45 kB 00:00 2024-09-12T17:07:17.659 INFO:teuthology.orchestra.run.smithi037.stdout:(199/285): python3-babel-2.9.1-2.el9.noarch.rpm 30 MB/s | 6.0 MB 00:00 2024-09-12T17:07:17.685 INFO:teuthology.orchestra.run.smithi037.stdout:(200/285): python3-jsonpatch-1.21-16.el9.noarch 256 kB/s | 26 kB 00:00 2024-09-12T17:07:17.719 INFO:teuthology.orchestra.run.smithi037.stdout:(201/285): python3-jinja2-2.11.3-6.el9.noarch.r 1.3 MB/s | 248 kB 00:00 2024-09-12T17:07:17.744 INFO:teuthology.orchestra.run.smithi037.stdout:(202/285): python3-jsonpointer-2.0-4.el9.noarch 228 kB/s | 19 kB 00:00 2024-09-12T17:07:17.769 INFO:teuthology.orchestra.run.smithi037.stdout:(203/285): python3-mako-1.1.4-6.el9.noarch.rpm 2.0 MB/s | 172 kB 00:00 2024-09-12T17:07:17.811 INFO:teuthology.orchestra.run.smithi037.stdout:(204/285): python3-markupsafe-1.1.1-12.el9.x86_ 378 kB/s | 35 kB 00:00 2024-09-12T17:07:17.870 INFO:teuthology.orchestra.run.smithi037.stdout:(205/285): python3-numpy-f2py-1.20.1-5.el9.x86_ 2.4 MB/s | 250 kB 00:00 2024-09-12T17:07:17.895 INFO:teuthology.orchestra.run.smithi037.stdout:(206/285): python3-oauthlib-3.1.1-5.el9.noarch. 2.6 MB/s | 222 kB 00:00 2024-09-12T17:07:17.945 INFO:teuthology.orchestra.run.smithi037.stdout:(207/285): python3-packaging-20.9-5.el9.noarch. 1.0 MB/s | 77 kB 00:00 2024-09-12T17:07:17.979 INFO:teuthology.orchestra.run.smithi037.stdout:(208/285): python3-prettytable-0.7.2-27.el9.noa 506 kB/s | 42 kB 00:00 2024-09-12T17:07:18.054 INFO:teuthology.orchestra.run.smithi037.stdout:(209/285): python3-numpy-1.20.1-5.el9.x86_64.rp 16 MB/s | 5.1 MB 00:00 2024-09-12T17:07:18.080 INFO:teuthology.orchestra.run.smithi037.stdout:(210/285): python3-pyasn1-0.4.8-6.el9.noarch.rp 1.5 MB/s | 159 kB 00:00 2024-09-12T17:07:18.104 INFO:teuthology.orchestra.run.smithi037.stdout:(211/285): python3-protobuf-3.14.0-13.el9.noarc 1.7 MB/s | 269 kB 00:00 2024-09-12T17:07:18.146 INFO:teuthology.orchestra.run.smithi037.stdout:(212/285): python3-pytz-2021.1-5.el9.noarch.rpm 762 kB/s | 51 kB 00:00 2024-09-12T17:07:18.167 INFO:teuthology.orchestra.run.smithi040.stdout:(138/285): libsbc-1.4-9.el9.x86_64.rpm 76 kB/s | 45 kB 00:00 2024-09-12T17:07:18.172 INFO:teuthology.orchestra.run.smithi037.stdout:(213/285): python3-pyasn1-modules-0.4.8-6.el9.n 2.3 MB/s | 279 kB 00:00 2024-09-12T17:07:18.197 INFO:teuthology.orchestra.run.smithi037.stdout:(214/285): python3-requests-oauthlib-1.3.0-12.e 581 kB/s | 54 kB 00:00 2024-09-12T17:07:18.222 INFO:teuthology.orchestra.run.smithi037.stdout:(215/285): python3-toml-0.10.2-6.el9.noarch.rpm 831 kB/s | 42 kB 00:00 2024-09-12T17:07:18.272 INFO:teuthology.orchestra.run.smithi037.stdout:(216/285): qatlib-24.02.0-1.el9.x86_64.rpm 2.9 MB/s | 221 kB 00:00 2024-09-12T17:07:18.298 INFO:teuthology.orchestra.run.smithi037.stdout:(217/285): qatlib-service-24.02.0-1.el9.x86_64. 477 kB/s | 36 kB 00:00 2024-09-12T17:07:18.356 INFO:teuthology.orchestra.run.smithi037.stdout:(218/285): qatzip-libs-1.2.0-1.el9.x86_64.rpm 567 kB/s | 47 kB 00:00 2024-09-12T17:07:18.367 INFO:teuthology.orchestra.run.smithi040.stdout:(139/285): libsndfile-1.0.31-8.el9.x86_64.rpm 282 kB/s | 206 kB 00:00 2024-09-12T17:07:18.382 INFO:teuthology.orchestra.run.smithi037.stdout:(219/285): rtkit-0.11-29.el9.x86_64.rpm 670 kB/s | 56 kB 00:00 2024-09-12T17:07:18.401 INFO:teuthology.orchestra.run.smithi040.stdout:(140/285): librdkafka-1.6.1-102.el9.x86_64.rpm 749 kB/s | 662 kB 00:00 2024-09-12T17:07:18.457 INFO:teuthology.orchestra.run.smithi037.stdout:(220/285): sisu-0.3.4-10.el9.noarch.rpm 5.0 MB/s | 510 kB 00:00 2024-09-12T17:07:18.482 INFO:teuthology.orchestra.run.smithi037.stdout:(221/285): slf4j-1.7.30-13.el9.noarch.rpm 688 kB/s | 69 kB 00:00 2024-09-12T17:07:18.566 INFO:teuthology.orchestra.run.smithi037.stdout:(222/285): sound-theme-freedesktop-0.8-17.el9.n 4.5 MB/s | 383 kB 00:00 2024-09-12T17:07:18.599 INFO:teuthology.orchestra.run.smithi037.stdout:(223/285): socat-1.7.4.1-6.el9.x86_64.rpm 2.1 MB/s | 304 kB 00:00 2024-09-12T17:07:18.758 INFO:teuthology.orchestra.run.smithi037.stdout:(224/285): python3-scipy-1.6.2-8.el9.x86_64.rpm 27 MB/s | 16 MB 00:00 2024-09-12T17:07:18.783 INFO:teuthology.orchestra.run.smithi037.stdout:(225/285): totem-pl-parser-3.26.6-2.el9.x86_64. 703 kB/s | 152 kB 00:00 2024-09-12T17:07:18.809 INFO:teuthology.orchestra.run.smithi037.stdout:(226/285): tracker-3.1.2-3.el9.x86_64.rpm 2.6 MB/s | 555 kB 00:00 2024-09-12T17:07:18.842 INFO:teuthology.orchestra.run.smithi037.stdout:(227/285): tracker-miners-3.1.2-4.el9.x86_64.rp 11 MB/s | 944 kB 00:00 2024-09-12T17:07:18.867 INFO:teuthology.orchestra.run.smithi037.stdout:(228/285): ttmkfdir-3.0.9-65.el9.x86_64.rpm 635 kB/s | 53 kB 00:00 2024-09-12T17:07:18.893 INFO:teuthology.orchestra.run.smithi037.stdout:(229/285): tzdata-java-2024a-2.el9.noarch.rpm 2.7 MB/s | 230 kB 00:00 2024-09-12T17:07:18.918 INFO:teuthology.orchestra.run.smithi037.stdout:(230/285): upower-0.99.11-11.el9.x86_64.rpm 2.2 MB/s | 173 kB 00:00 2024-09-12T17:07:18.952 INFO:teuthology.orchestra.run.smithi037.stdout:(231/285): webrtc-audio-processing-0.3.1-8.el9. 3.6 MB/s | 306 kB 00:00 2024-09-12T17:07:18.976 INFO:teuthology.orchestra.run.smithi040.stdout:(141/285): libtheora-1.1.1-31.el9.x86_64.rpm 203 kB/s | 164 kB 00:00 2024-09-12T17:07:18.977 INFO:teuthology.orchestra.run.smithi037.stdout:(232/285): wireplumber-0.4.14-1.el9.x86_64.rpm 1.1 MB/s | 96 kB 00:00 2024-09-12T17:07:19.002 INFO:teuthology.orchestra.run.smithi040.stdout:(142/285): libtool-ltdl-2.4.6-46.el9.x86_64.rpm 60 kB/s | 36 kB 00:00 2024-09-12T17:07:19.011 INFO:teuthology.orchestra.run.smithi037.stdout:(233/285): wireplumber-libs-0.4.14-1.el9.x86_64 3.8 MB/s | 358 kB 00:00 2024-09-12T17:07:19.036 INFO:teuthology.orchestra.run.smithi037.stdout:(234/285): xdg-dbus-proxy-0.1.3-1.el9.x86_64.rp 505 kB/s | 42 kB 00:00 2024-09-12T17:07:19.070 INFO:teuthology.orchestra.run.smithi037.stdout:(235/285): xdg-desktop-portal-1.12.6-1.el9.x86_ 4.1 MB/s | 385 kB 00:00 2024-09-12T17:07:19.095 INFO:teuthology.orchestra.run.smithi037.stdout:(236/285): xdg-desktop-portal-gtk-1.12.0-3.el9. 1.6 MB/s | 134 kB 00:00 2024-09-12T17:07:19.137 INFO:teuthology.orchestra.run.smithi037.stdout:(237/285): xkeyboard-config-2.33-2.el9.noarch.r 8.4 MB/s | 859 kB 00:00 2024-09-12T17:07:19.162 INFO:teuthology.orchestra.run.smithi037.stdout:(238/285): xmlstarlet-1.6.1-20.el9.x86_64.rpm 692 kB/s | 64 kB 00:00 2024-09-12T17:07:19.194 INFO:teuthology.orchestra.run.smithi040.stdout:(143/285): libtiff-4.4.0-13.el9.x86_64.rpm 240 kB/s | 198 kB 00:00 2024-09-12T17:07:19.196 INFO:teuthology.orchestra.run.smithi037.stdout:(239/285): xorg-x11-fonts-Type1-7.5-33.el9.noar 4.9 MB/s | 505 kB 00:00 2024-09-12T17:07:19.255 INFO:teuthology.orchestra.run.smithi037.stdout:(240/285): abseil-cpp-20211102.0-3.el9.x86_64.r 9.2 MB/s | 548 kB 00:00 2024-09-12T17:07:19.271 INFO:teuthology.orchestra.run.smithi037.stdout:(241/285): lua-devel-5.4.4-4.el9.x86_64.rpm 166 kB/s | 22 kB 00:00 2024-09-12T17:07:19.305 INFO:teuthology.orchestra.run.smithi037.stdout:(242/285): gperftools-libs-2.9.1-3.el9.x86_64.r 6.0 MB/s | 308 kB 00:00 2024-09-12T17:07:19.322 INFO:teuthology.orchestra.run.smithi037.stdout:(243/285): grpc-data-1.46.7-10.el9.noarch.rpm 387 kB/s | 19 kB 00:00 2024-09-12T17:07:19.339 INFO:teuthology.orchestra.run.smithi037.stdout:(244/285): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.5 MB/s | 26 kB 00:00 2024-09-12T17:07:19.355 INFO:teuthology.orchestra.run.smithi037.stdout:(245/285): liboath-2.6.7-2.el9.x86_64.rpm 2.9 MB/s | 49 kB 00:00 2024-09-12T17:07:19.389 INFO:teuthology.orchestra.run.smithi037.stdout:(246/285): libunwind-1.6.2-1.el9.x86_64.rpm 2.0 MB/s | 67 kB 00:00 2024-09-12T17:07:19.415 INFO:teuthology.orchestra.run.smithi037.stdout:(247/285): luarocks-3.9.2-5.el9.noarch.rpm 5.9 MB/s | 151 kB 00:00 2024-09-12T17:07:19.448 INFO:teuthology.orchestra.run.smithi037.stdout:(248/285): protobuf-compiler-3.14.0-13.el9.x86_ 3.0 MB/s | 863 kB 00:00 2024-09-12T17:07:19.509 INFO:teuthology.orchestra.run.smithi037.stdout:(249/285): parquet-libs-9.0.0-11.el9.x86_64.rpm 8.9 MB/s | 839 kB 00:00 2024-09-12T17:07:19.532 INFO:teuthology.orchestra.run.smithi037.stdout:(250/285): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-12T17:07:19.557 INFO:teuthology.orchestra.run.smithi037.stdout:(251/285): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-12T17:07:19.582 INFO:teuthology.orchestra.run.smithi037.stdout:(252/285): python3-certifi-2023.05.07-4.el9.noa 569 kB/s | 14 kB 00:00 2024-09-12T17:07:19.616 INFO:teuthology.orchestra.run.smithi037.stdout:(253/285): python3-cheroot-8.6.0-4.el9.noarch.r 5.0 MB/s | 172 kB 00:00 2024-09-12T17:07:19.641 INFO:teuthology.orchestra.run.smithi037.stdout:(254/285): python3-asyncssh-2.13.2-5.el9.noarch 2.8 MB/s | 548 kB 00:00 2024-09-12T17:07:19.675 INFO:teuthology.orchestra.run.smithi037.stdout:(255/285): python3-google-auth-2.34.0-1.el9.noa 6.5 MB/s | 220 kB 00:00 2024-09-12T17:07:19.700 INFO:teuthology.orchestra.run.smithi037.stdout:(256/285): python3-cherrypy-18.6.1-2.el9.noarch 4.2 MB/s | 358 kB 00:00 2024-09-12T17:07:19.743 INFO:teuthology.orchestra.run.smithi037.stdout:(257/285): python3-grpcio-tools-1.46.7-10.el9.x 3.4 MB/s | 144 kB 00:00 2024-09-12T17:07:19.760 INFO:teuthology.orchestra.run.smithi040.stdout:(144/285): libvisual-0.4.0-34.el9.x86_64.rpm 190 kB/s | 144 kB 00:00 2024-09-12T17:07:19.768 INFO:teuthology.orchestra.run.smithi037.stdout:(258/285): python3-jaraco-8.2.1-3.el9.noarch.rp 432 kB/s | 11 kB 00:00 2024-09-12T17:07:19.793 INFO:teuthology.orchestra.run.smithi037.stdout:(259/285): python3-jaraco-classes-3.2.1-5.el9.n 716 kB/s | 18 kB 00:00 2024-09-12T17:07:19.818 INFO:teuthology.orchestra.run.smithi037.stdout:(260/285): python3-jaraco-collections-3.0.0-8.e 927 kB/s | 23 kB 00:00 2024-09-12T17:07:19.844 INFO:teuthology.orchestra.run.smithi037.stdout:(261/285): python3-jaraco-functools-3.5.0-2.el9 776 kB/s | 19 kB 00:00 2024-09-12T17:07:19.869 INFO:teuthology.orchestra.run.smithi037.stdout:(262/285): python3-jaraco-text-3.2.0-6.el9.noar 792 kB/s | 20 kB 00:00 2024-09-12T17:07:19.927 INFO:teuthology.orchestra.run.smithi037.stdout:(263/285): python3-kubernetes-26.1.0-2.el9.noar 18 MB/s | 1.0 MB 00:00 2024-09-12T17:07:19.953 INFO:teuthology.orchestra.run.smithi037.stdout:(264/285): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-12T17:07:19.978 INFO:teuthology.orchestra.run.smithi037.stdout:(265/285): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-12T17:07:19.994 INFO:teuthology.orchestra.run.smithi040.stdout:(145/285): libtracker-sparql-3.1.2-3.el9.x86_64 318 kB/s | 324 kB 00:01 2024-09-12T17:07:20.003 INFO:teuthology.orchestra.run.smithi037.stdout:(266/285): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-12T17:07:20.052 INFO:teuthology.orchestra.run.smithi040.stdout:(146/285): libvorbis-1.3.7-5.el9.x86_64.rpm 227 kB/s | 193 kB 00:00 2024-09-12T17:07:20.054 INFO:teuthology.orchestra.run.smithi037.stdout:(267/285): python3-grpcio-1.46.7-10.el9.x86_64. 5.4 MB/s | 2.0 MB 00:00 2024-09-12T17:07:20.087 INFO:teuthology.orchestra.run.smithi037.stdout:(268/285): python3-pecan-1.4.2-3.el9.noarch.rpm 3.2 MB/s | 272 kB 00:00 2024-09-12T17:07:20.113 INFO:teuthology.orchestra.run.smithi037.stdout:(269/285): python3-portend-3.1.0-2.el9.noarch.r 280 kB/s | 16 kB 00:00 2024-09-12T17:07:20.138 INFO:teuthology.orchestra.run.smithi037.stdout:(270/285): python3-repoze-lru-0.7-16.el9.noarch 1.2 MB/s | 31 kB 00:00 2024-09-12T17:07:20.197 INFO:teuthology.orchestra.run.smithi037.stdout:(271/285): libarrow-9.0.0-11.el9.x86_64.rpm 5.0 MB/s | 4.4 MB 00:00 2024-09-12T17:07:20.222 INFO:teuthology.orchestra.run.smithi037.stdout:(272/285): python3-pyOpenSSL-21.0.0-1.el9.noarc 670 kB/s | 90 kB 00:00 2024-09-12T17:07:20.247 INFO:teuthology.orchestra.run.smithi037.stdout:(273/285): python3-rsa-4.9-2.el9.noarch.rpm 1.2 MB/s | 59 kB 00:00 2024-09-12T17:07:20.273 INFO:teuthology.orchestra.run.smithi037.stdout:(274/285): python3-tempora-5.0.0-2.el9.noarch.r 714 kB/s | 36 kB 00:00 2024-09-12T17:07:20.298 INFO:teuthology.orchestra.run.smithi037.stdout:(275/285): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-09-12T17:07:20.323 INFO:teuthology.orchestra.run.smithi037.stdout:(276/285): python3-routes-2.5.1-5.el9.noarch.rp 1.0 MB/s | 188 kB 00:00 2024-09-12T17:07:20.336 INFO:teuthology.orchestra.run.smithi040.stdout:(147/285): libwayland-client-1.21.0-1.el9.x86_6 58 kB/s | 33 kB 00:00 2024-09-12T17:07:20.348 INFO:teuthology.orchestra.run.smithi037.stdout:(277/285): python3-websocket-client-1.2.3-2.el9 1.8 MB/s | 90 kB 00:00 2024-09-12T17:07:20.365 INFO:teuthology.orchestra.run.smithi037.stdout:(278/285): python3-zc-lockfile-2.0-10.el9.noarc 1.2 MB/s | 20 kB 00:00 2024-09-12T17:07:20.390 INFO:teuthology.orchestra.run.smithi037.stdout:(279/285): python3-webob-1.8.8-2.el9.noarch.rpm 1.9 MB/s | 230 kB 00:00 2024-09-12T17:07:20.416 INFO:teuthology.orchestra.run.smithi037.stdout:(280/285): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-12T17:07:20.441 INFO:teuthology.orchestra.run.smithi037.stdout:(281/285): s3cmd-2.4.0-1.el9.noarch.rpm 4.0 MB/s | 206 kB 00:00 2024-09-12T17:07:20.466 INFO:teuthology.orchestra.run.smithi037.stdout:(282/285): python3-werkzeug-2.0.3-3.el9.1.noarc 2.9 MB/s | 427 kB 00:00 2024-09-12T17:07:20.486 INFO:teuthology.orchestra.run.smithi040.stdout:(148/285): libwayland-cursor-1.21.0-1.el9.x86_6 40 kB/s | 19 kB 00:00 2024-09-12T17:07:20.520 INFO:teuthology.orchestra.run.smithi040.stdout:(149/285): libwayland-egl-1.21.0-1.el9.x86_64.r 27 kB/s | 13 kB 00:00 2024-09-12T17:07:20.525 INFO:teuthology.orchestra.run.smithi037.stdout:(283/285): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-09-12T17:07:20.700 INFO:teuthology.orchestra.run.smithi037.stdout:(284/285): librados2-19.3.0-4762.gbad475c1.el9. 13 MB/s | 3.5 MB 00:00 2024-09-12T17:07:20.758 INFO:teuthology.orchestra.run.smithi037.stdout:(285/285): librbd1-19.3.0-4762.gbad475c1.el9.x8 11 MB/s | 3.2 MB 00:00 2024-09-12T17:07:20.765 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2024-09-12T17:07:20.766 INFO:teuthology.orchestra.run.smithi037.stdout:Total 23 MB/s | 322 MB 00:14 2024-09-12T17:07:20.970 INFO:teuthology.orchestra.run.smithi040.stdout:(150/285): libwayland-server-1.21.0-1.el9.x86_6 66 kB/s | 42 kB 00:00 2024-09-12T17:07:21.229 INFO:teuthology.orchestra.run.smithi040.stdout:(151/285): libxkbcommon-1.0.3-4.el9.x86_64.rpm 188 kB/s | 133 kB 00:00 2024-09-12T17:07:21.387 INFO:teuthology.orchestra.run.smithi040.stdout:(152/285): libwebp-1.2.0-8.el9.x86_64.rpm 308 kB/s | 277 kB 00:00 2024-09-12T17:07:21.438 INFO:teuthology.orchestra.run.smithi040.stdout:(153/285): libxshmfence-1.3-10.el9.x86_64.rpm 27 kB/s | 13 kB 00:00 2024-09-12T17:07:21.813 INFO:teuthology.orchestra.run.smithi040.stdout:(154/285): low-memory-monitor-2.1-4.el9.x86_64. 61 kB/s | 36 kB 00:00 2024-09-12T17:07:22.222 INFO:teuthology.orchestra.run.smithi040.stdout:(155/285): lttng-ust-2.12.0-6.el9.x86_64.rpm 351 kB/s | 292 kB 00:00 2024-09-12T17:07:22.247 INFO:teuthology.orchestra.run.smithi040.stdout:(156/285): lua-5.4.4-4.el9.x86_64.rpm 233 kB/s | 188 kB 00:00 2024-09-12T17:07:22.564 INFO:teuthology.orchestra.run.smithi040.stdout:(157/285): lua-posix-35.0-8.el9.x86_64.rpm 201 kB/s | 151 kB 00:00 2024-09-12T17:07:22.697 INFO:teuthology.orchestra.run.smithi040.stdout:(158/285): maven-3.6.3-15.el9.noarch.rpm 37 kB/s | 18 kB 00:00 2024-09-12T17:07:23.073 INFO:teuthology.orchestra.run.smithi040.stdout:(159/285): maven-openjdk11-3.6.3-15.el9.noarch. 18 kB/s | 9.0 kB 00:00 2024-09-12T17:07:23.840 INFO:teuthology.orchestra.run.smithi040.stdout:(160/285): maven-shared-utils-3.3.4-3.el9.noarc 197 kB/s | 151 kB 00:00 2024-09-12T17:07:23.865 INFO:teuthology.orchestra.run.smithi040.stdout:(161/285): maven-resolver-1.6.1-10.el9.noarch.r 443 kB/s | 517 kB 00:01 2024-09-12T17:07:23.957 INFO:teuthology.orchestra.run.smithi040.stdout:(162/285): maven-lib-3.6.3-15.el9.noarch.rpm 889 kB/s | 1.5 MB 00:01 2024-09-12T17:07:23.993 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2024-09-12T17:07:24.198 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction check succeeded. 2024-09-12T17:07:24.198 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2024-09-12T17:07:24.440 INFO:teuthology.orchestra.run.smithi040.stdout:(163/285): mesa-filesystem-24.1.2-3.el9.x86_64. 23 kB/s | 11 kB 00:00 2024-09-12T17:07:24.524 INFO:teuthology.orchestra.run.smithi040.stdout:(164/285): maven-wagon-3.4.2-7.el9.noarch.rpm 164 kB/s | 112 kB 00:00 2024-09-12T17:07:25.166 INFO:teuthology.orchestra.run.smithi040.stdout:(165/285): mesa-libEGL-24.1.2-3.el9.x86_64.rpm 191 kB/s | 139 kB 00:00 2024-09-12T17:07:25.366 INFO:teuthology.orchestra.run.smithi040.stdout:(166/285): mesa-libGL-24.1.2-3.el9.x86_64.rpm 203 kB/s | 171 kB 00:00 2024-09-12T17:07:25.708 INFO:teuthology.orchestra.run.smithi040.stdout:(167/285): mesa-libgbm-24.1.2-3.el9.x86_64.rpm 67 kB/s | 36 kB 00:00 2024-09-12T17:07:25.933 INFO:teuthology.orchestra.run.smithi040.stdout:(168/285): mesa-libglapi-24.1.2-3.el9.x86_64.rp 81 kB/s | 46 kB 00:00 2024-09-12T17:07:26.267 INFO:teuthology.orchestra.run.smithi040.stdout:(169/285): mkfontscale-1.2.1-3.el9.x86_64.rpm 58 kB/s | 32 kB 00:00 2024-09-12T17:07:26.534 INFO:teuthology.orchestra.run.smithi040.stdout:(170/285): openblas-0.3.26-2.el9.x86_64.rpm 65 kB/s | 38 kB 00:00 2024-09-12T17:07:27.376 INFO:teuthology.orchestra.run.smithi040.stdout:(171/285): openjpeg2-2.4.0-7.el9.x86_64.rpm 194 kB/s | 163 kB 00:00 2024-09-12T17:07:27.528 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded. 2024-09-12T17:07:27.529 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2024-09-12T17:07:28.201 INFO:teuthology.orchestra.run.smithi040.stdout:(172/285): opus-1.3.1-10.el9.x86_64.rpm 242 kB/s | 200 kB 00:00 2024-09-12T17:07:28.984 INFO:teuthology.orchestra.run.smithi040.stdout:(173/285): orc-0.4.31-8.el9.x86_64.rpm 234 kB/s | 183 kB 00:00 2024-09-12T17:07:29.218 INFO:teuthology.orchestra.run.smithi040.stdout:(174/285): openblas-openmp-0.3.26-2.el9.x86_64. 1.7 MB/s | 4.9 MB 00:02 2024-09-12T17:07:29.585 INFO:teuthology.orchestra.run.smithi040.stdout:(175/285): mesa-dri-drivers-24.1.2-3.el9.x86_64 1.5 MB/s | 8.8 MB 00:05 2024-09-12T17:07:29.927 INFO:teuthology.orchestra.run.smithi040.stdout:(176/285): osinfo-db-tools-1.10.0-1.el9.x86_64. 105 kB/s | 74 kB 00:00 2024-09-12T17:07:30.102 INFO:teuthology.orchestra.run.smithi040.stdout:(177/285): osinfo-db-20240701-2.el9.noarch.rpm 475 kB/s | 531 kB 00:01 2024-09-12T17:07:30.587 INFO:teuthology.orchestra.run.smithi040.stdout:(178/285): ostree-libs-2024.7-2.el9.x86_64.rpm 468 kB/s | 468 kB 00:01 2024-09-12T17:07:30.687 INFO:teuthology.orchestra.run.smithi040.stdout:(179/285): p11-kit-server-0.25.3-2.el9.x86_64.r 324 kB/s | 246 kB 00:00 2024-09-12T17:07:30.788 INFO:teuthology.orchestra.run.smithi040.stdout:(180/285): pipewire-1.0.1-1.el9.x86_64.rpm 155 kB/s | 107 kB 00:00 2024-09-12T17:07:31.174 INFO:teuthology.orchestra.run.smithi040.stdout:(181/285): pipewire-jack-audio-connection-kit-1 19 kB/s | 9.1 kB 00:00 2024-09-12T17:07:31.196 INFO:teuthology.orchestra.run.smithi040.stdout:(182/285): pipewire-alsa-1.0.1-1.el9.x86_64.rpm 94 kB/s | 57 kB 00:00 2024-09-12T17:07:31.538 INFO:teuthology.orchestra.run.smithi040.stdout:(183/285): pipewire-jack-audio-connection-kit-l 180 kB/s | 135 kB 00:00 2024-09-12T17:07:31.938 INFO:teuthology.orchestra.run.smithi040.stdout:(184/285): pipewire-pulseaudio-1.0.1-1.el9.x86_ 259 kB/s | 192 kB 00:00 2024-09-12T17:07:32.072 INFO:teuthology.orchestra.run.smithi040.stdout:(185/285): plexus-cipher-1.7-27.el9.noarch.rpm 48 kB/s | 26 kB 00:00 2024-09-12T17:07:32.298 INFO:teuthology.orchestra.run.smithi040.stdout:(186/285): pipewire-libs-1.0.1-1.el9.x86_64.rpm 1.7 MB/s | 1.9 MB 00:01 2024-09-12T17:07:32.573 INFO:teuthology.orchestra.run.smithi040.stdout:(187/285): plexus-containers-component-annotati 37 kB/s | 18 kB 00:00 2024-09-12T17:07:32.610 INFO:teuthology.orchestra.run.smithi040.stdout:(188/285): plexus-classworlds-2.6.0-11.el9.noar 90 kB/s | 60 kB 00:00 2024-09-12T17:07:32.948 INFO:teuthology.orchestra.run.smithi040.stdout:(189/285): plexus-interpolation-1.26-11.el9.noa 124 kB/s | 80 kB 00:00 2024-09-12T17:07:33.149 INFO:teuthology.orchestra.run.smithi040.stdout:(190/285): plexus-sec-dispatcher-1.4-37.el9.noa 59 kB/s | 34 kB 00:00 2024-09-12T17:07:33.482 INFO:teuthology.orchestra.run.smithi040.stdout:(191/285): plexus-utils-3.3.0-10.el9.noarch.rpm 290 kB/s | 254 kB 00:00 2024-09-12T17:07:34.199 INFO:teuthology.orchestra.run.smithi040.stdout:(192/285): poppler-glib-21.01.0-21.el9.x86_64.r 213 kB/s | 152 kB 00:00 2024-09-12T17:07:34.774 INFO:teuthology.orchestra.run.smithi040.stdout:(193/285): poppler-21.01.0-21.el9.x86_64.rpm 596 kB/s | 1.1 MB 00:01 2024-09-12T17:07:35.158 INFO:teuthology.orchestra.run.smithi040.stdout:(194/285): poppler-data-0.4.9-9.el9.noarch.rpm 956 kB/s | 1.9 MB 00:02 2024-09-12T17:07:35.191 INFO:teuthology.orchestra.run.smithi040.stdout:(195/285): protobuf-3.14.0-13.el9.x86_64.rpm 1.0 MB/s | 1.0 MB 00:00 2024-09-12T17:07:35.475 INFO:teuthology.orchestra.run.smithi040.stdout:(196/285): publicsuffix-list-20210518-3.el9.noa 118 kB/s | 83 kB 00:00 2024-09-12T17:07:36.050 INFO:teuthology.orchestra.run.smithi040.stdout:(197/285): pulseaudio-libs-15.0-2.el9.x86_64.rp 761 kB/s | 679 kB 00:00 2024-09-12T17:07:36.225 INFO:teuthology.orchestra.run.smithi040.stdout:(198/285): python3-devel-3.9.19-8.el9.x86_64.rp 327 kB/s | 245 kB 00:00 2024-09-12T17:07:36.375 INFO:teuthology.orchestra.run.smithi040.stdout:(199/285): python3-babel-2.9.1-2.el9.noarch.rpm 5.0 MB/s | 6.0 MB 00:01 2024-09-12T17:07:36.817 INFO:teuthology.orchestra.run.smithi040.stdout:(200/285): python3-jsonpatch-1.21-16.el9.noarch 43 kB/s | 26 kB 00:00 2024-09-12T17:07:36.843 INFO:teuthology.orchestra.run.smithi040.stdout:(201/285): python3-jinja2-2.11.3-6.el9.noarch.r 313 kB/s | 248 kB 00:00 2024-09-12T17:07:36.868 INFO:teuthology.orchestra.run.smithi040.stdout:(202/285): python3-jsonpointer-2.0-4.el9.noarch 39 kB/s | 19 kB 00:00 2024-09-12T17:07:37.435 INFO:teuthology.orchestra.run.smithi040.stdout:(203/285): python3-markupsafe-1.1.1-12.el9.x86_ 59 kB/s | 35 kB 00:00 2024-09-12T17:07:37.585 INFO:teuthology.orchestra.run.smithi040.stdout:(204/285): python3-mako-1.1.4-6.el9.noarch.rpm 224 kB/s | 172 kB 00:00 2024-09-12T17:07:37.891 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: copy-jdk-configs-4.0-3.el9.noarch 1/1 2024-09-12T17:07:38.076 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86_64 1/1 2024-09-12T17:07:38.093 INFO:teuthology.orchestra.run.smithi040.stdout:(205/285): python3-numpy-1.20.1-5.el9.x86_64.rp 4.2 MB/s | 5.1 MB 00:01 2024-09-12T17:07:38.219 INFO:teuthology.orchestra.run.smithi040.stdout:(206/285): python3-numpy-f2py-1.20.1-5.el9.x86_ 320 kB/s | 250 kB 00:00 2024-09-12T17:07:38.241 INFO:teuthology.orchestra.run.smithi037.stdout: Preparing : 1/1 2024-09-12T17:07:38.302 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : javapackages-filesystem-6.0.0-4.el9.noarch 1/287 2024-09-12T17:07:38.338 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libogg-2:1.3.4-6.el9.x86_64 2/287 2024-09-12T17:07:38.377 INFO:teuthology.orchestra.run.smithi040.stdout:(207/285): python3-oauthlib-3.1.1-5.el9.noarch. 281 kB/s | 222 kB 00:00 2024-09-12T17:07:38.411 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libXi-1.7.10-8.el9.x86_64 3/287 2024-09-12T17:07:38.473 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : alsa-lib-1.2.12-1.el9.x86_64 4/287 2024-09-12T17:07:38.533 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libvorbis-1:1.3.7-5.el9.x86_64 5/287 2024-09-12T17:07:38.624 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/287 2024-09-12T17:07:38.707 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/287 2024-09-12T17:07:38.719 INFO:teuthology.orchestra.run.smithi040.stdout:(208/285): python3-packaging-20.9-5.el9.noarch. 123 kB/s | 77 kB 00:00 2024-09-12T17:07:38.754 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/287 2024-09-12T17:07:38.811 INFO:teuthology.orchestra.run.smithi040.stdout:(209/285): python3-prettytable-0.7.2-27.el9.noa 71 kB/s | 42 kB 00:00 2024-09-12T17:07:39.122 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/287 2024-09-12T17:07:39.211 INFO:teuthology.orchestra.run.smithi040.stdout:(210/285): python3-protobuf-3.14.0-13.el9.noarc 323 kB/s | 269 kB 00:00 2024-09-12T17:07:39.233 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : librados2-2:19.3.0-4762.gbad475c1.el9.x86_64 10/287 2024-09-12T17:07:39.362 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: librados2-2:19.3.0-4762.gbad475c1.el9.x86_64 10/287 2024-09-12T17:07:39.393 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libcephfs2-2:19.3.0-4762.gbad475c1.el9.x86_64 11/287 2024-09-12T17:07:39.486 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: libcephfs2-2:19.3.0-4762.gbad475c1.el9.x86_64 11/287 2024-09-12T17:07:39.512 INFO:teuthology.orchestra.run.smithi040.stdout:(211/285): python3-pyasn1-0.4.8-6.el9.noarch.rp 200 kB/s | 159 kB 00:00 2024-09-12T17:07:39.513 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-rados-2:19.3.0-4762.gbad475c1.el9.x86_64 12/287 2024-09-12T17:07:39.563 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libwayland-client-1.21.0-1.el9.x86_64 13/287 2024-09-12T17:07:39.579 INFO:teuthology.orchestra.run.smithi040.stdout:(212/285): python3-pyasn1-modules-0.4.8-6.el9.n 364 kB/s | 279 kB 00:00 2024-09-12T17:07:39.606 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 14/287 2024-09-12T17:07:39.632 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 15/287 2024-09-12T17:07:39.658 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libXfixes-5.0.3-16.el9.x86_64 16/287 2024-09-12T17:07:39.690 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : opus-1.3.1-10.el9.x86_64 17/287 2024-09-12T17:07:39.715 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : lua-5.4.4-4.el9.x86_64 18/287 2024-09-12T17:07:39.743 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libX11-xcb-1.7.0-9.el9.x86_64 19/287 2024-09-12T17:07:39.829 INFO:teuthology.orchestra.run.smithi040.stdout:(213/285): python3-pytz-2021.1-5.el9.noarch.rpm 83 kB/s | 51 kB 00:00 2024-09-12T17:07:39.896 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : lcms2-2.12-3.el9.x86_64 20/287 2024-09-12T17:07:40.042 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : gstreamer1-1.22.1-2.el9.x86_64 21/287 2024-09-12T17:07:40.086 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : atk-2.36.0-5.el9.x86_64 22/287 2024-09-12T17:07:40.122 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libwayland-cursor-1.21.0-1.el9.x86_64 23/287 2024-09-12T17:07:40.129 INFO:teuthology.orchestra.run.smithi040.stdout:(214/285): python3-requests-oauthlib-1.3.0-12.e 87 kB/s | 54 kB 00:00 2024-09-12T17:07:40.150 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libcephsqlite-2:19.3.0-4762.gbad475c1.el9.x86_64 24/287 2024-09-12T17:07:40.256 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4762.gbad475c1.el9.x86_64 24/287 2024-09-12T17:07:40.285 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libradosstriper1-2:19.3.0-4762.gbad475c1.el9.x86 25/287 2024-09-12T17:07:40.348 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4762.gbad475c1.el9.x86 25/287 2024-09-12T17:07:40.372 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libXtst-1.2.3-16.el9.x86_64 26/287 2024-09-12T17:07:40.394 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 27/287 2024-09-12T17:07:40.414 INFO:teuthology.orchestra.run.smithi040.stdout:(215/285): python3-toml-0.10.2-6.el9.noarch.rpm 71 kB/s | 42 kB 00:00 2024-09-12T17:07:40.415 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 27/287 2024-09-12T17:07:40.617 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 28/287 2024-09-12T17:07:40.653 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 28/287 2024-09-12T17:07:40.772 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : re2-1:20211101-20.el9.x86_64 29/287 2024-09-12T17:07:40.800 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 30/287 2024-09-12T17:07:40.861 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : liboath-2.6.7-2.el9.x86_64 31/287 2024-09-12T17:07:40.938 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 32/287 2024-09-12T17:07:40.988 INFO:teuthology.orchestra.run.smithi040.stdout:(216/285): python3-scipy-1.6.2-8.el9.x86_64.rpm 12 MB/s | 16 MB 00:01 2024-09-12T17:07:40.996 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 33/287 2024-09-12T17:07:41.013 INFO:teuthology.orchestra.run.smithi040.stdout:(217/285): qatlib-24.02.0-1.el9.x86_64.rpm 250 kB/s | 221 kB 00:00 2024-09-12T17:07:41.038 INFO:teuthology.orchestra.run.smithi040.stdout:(218/285): qatlib-service-24.02.0-1.el9.x86_64. 57 kB/s | 36 kB 00:00 2024-09-12T17:07:41.044 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-packaging-20.9-5.el9.noarch 34/287 2024-09-12T17:07:41.095 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 35/287 2024-09-12T17:07:41.128 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 36/287 2024-09-12T17:07:41.155 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libxshmfence-1.3-10.el9.x86_64 37/287 2024-09-12T17:07:41.197 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libwayland-server-1.21.0-1.el9.x86_64 38/287 2024-09-12T17:07:41.222 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libwayland-egl-1.21.0-1.el9.x86_64 39/287 2024-09-12T17:07:41.251 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libtool-ltdl-2.4.6-46.el9.x86_64 40/287 2024-09-12T17:07:41.283 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libglvnd-1:1.3.4-1.el9.x86_64 41/287 2024-09-12T17:07:41.308 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libXcomposite-0.4.5-7.el9.x86_64 42/287 2024-09-12T17:07:41.355 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 43/287 2024-09-12T17:07:41.381 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : dconf-0.40.0-6.el9.x86_64 44/287 2024-09-12T17:07:41.456 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: dconf-0.40.0-6.el9.x86_64 44/287 2024-09-12T17:07:41.508 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 45/287 2024-09-12T17:07:41.545 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 46/287 2024-09-12T17:07:41.564 INFO:teuthology.orchestra.run.smithi040.stdout:(219/285): qatzip-libs-1.2.0-1.el9.x86_64.rpm 82 kB/s | 47 kB 00:00 2024-09-12T17:07:41.619 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 47/287 2024-09-12T17:07:41.658 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 48/287 2024-09-12T17:07:41.690 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : fuse-2.9.9-16.el9.x86_64 49/287 2024-09-12T17:07:41.697 INFO:teuthology.orchestra.run.smithi040.stdout:(220/285): rtkit-0.11-29.el9.x86_64.rpm 85 kB/s | 56 kB 00:00 2024-09-12T17:07:41.770 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : cups-libs-1:2.3.3op2-30.el9.x86_64 50/287 2024-09-12T17:07:41.800 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-ceph-common-2:19.3.0-4762.gbad475c1.el9. 51/287 2024-09-12T17:07:41.844 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-ceph-argparse-2:19.3.0-4762.gbad475c1.el 52/287 2024-09-12T17:07:41.894 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cephfs-2:19.3.0-4762.gbad475c1.el9.x86_6 53/287 2024-09-12T17:07:41.982 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 54/287 2024-09-12T17:07:42.006 INFO:teuthology.orchestra.run.smithi040.stdout:(221/285): sisu-0.3.4-10.el9.noarch.rpm 528 kB/s | 510 kB 00:00 2024-09-12T17:07:42.132 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 55/287 2024-09-12T17:07:42.198 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 56/287 2024-09-12T17:07:42.239 INFO:teuthology.orchestra.run.smithi040.stdout:(222/285): slf4j-1.7.30-13.el9.noarch.rpm 102 kB/s | 69 kB 00:00 2024-09-12T17:07:42.556 INFO:teuthology.orchestra.run.smithi040.stdout:(223/285): socat-1.7.4.1-6.el9.x86_64.rpm 354 kB/s | 304 kB 00:00 2024-09-12T17:07:42.773 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-rsa-4.9-2.el9.noarch 57/287 2024-09-12T17:07:42.840 INFO:teuthology.orchestra.run.smithi040.stdout:(224/285): sound-theme-freedesktop-0.8-17.el9.n 459 kB/s | 383 kB 00:00 2024-09-12T17:07:42.862 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 58/287 2024-09-12T17:07:42.896 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 59/287 2024-09-12T17:07:42.965 INFO:teuthology.orchestra.run.smithi040.stdout:(225/285): totem-pl-parser-3.26.6-2.el9.x86_64. 213 kB/s | 152 kB 00:00 2024-09-12T17:07:42.969 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 60/287 2024-09-12T17:07:43.009 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : at-spi2-core-2.40.3-1.el9.x86_64 61/287 2024-09-12T17:07:43.054 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : at-spi2-atk-2.38.0-4.el9.x86_64 62/287 2024-09-12T17:07:43.083 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : colord-libs-1.4.5-4.el9.x86_64 63/287 2024-09-12T17:07:43.159 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 64/287 2024-09-12T17:07:43.202 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : luarocks-3.9.2-5.el9.noarch 65/287 2024-09-12T17:07:43.236 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libXcursor-1.2.0-7.el9.x86_64 66/287 2024-09-12T17:07:43.271 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libXdamage-1.1.5-7.el9.x86_64 67/287 2024-09-12T17:07:43.309 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : librados-devel-2:19.3.0-4762.gbad475c1.el9.x86_6 68/287 2024-09-12T17:07:43.342 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 69/287 2024-09-12T17:07:43.395 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : flac-libs-1.3.3-12.el9.x86_64 70/287 2024-09-12T17:07:43.441 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libtheora-1:1.1.1-31.el9.x86_64 71/287 2024-09-12T17:07:43.490 INFO:teuthology.orchestra.run.smithi040.stdout:(226/285): tracker-3.1.2-3.el9.x86_64.rpm 595 kB/s | 555 kB 00:00 2024-09-12T17:07:43.500 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : exiv2-libs-0.27.5-2.el9.x86_64 72/287 2024-09-12T17:07:43.535 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : exiv2-0.27.5-2.el9.x86_64 73/287 2024-09-12T17:07:43.557 INFO:teuthology.orchestra.run.smithi040.stdout:(227/285): ttmkfdir-3.0.9-65.el9.x86_64.rpm 90 kB/s | 53 kB 00:00 2024-09-12T17:07:43.572 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libgexiv2-0.12.3-1.el9.x86_64 74/287 2024-09-12T17:07:43.669 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 75/287 2024-09-12T17:07:43.739 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 76/287 2024-09-12T17:07:43.757 INFO:teuthology.orchestra.run.smithi040.stdout:(228/285): tracker-miners-3.1.2-4.el9.x86_64.rp 1.0 MB/s | 944 kB 00:00 2024-09-12T17:07:43.822 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 77/287 2024-09-12T17:07:43.858 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 78/287 2024-09-12T17:07:43.894 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 79/287 2024-09-12T17:07:43.942 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 80/287 2024-09-12T17:07:43.994 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 81/287 2024-09-12T17:07:44.045 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 82/287 2024-09-12T17:07:44.193 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 83/287 2024-09-12T17:07:44.238 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 84/287 2024-09-12T17:07:44.274 INFO:teuthology.orchestra.run.smithi040.stdout:(229/285): upower-0.99.11-11.el9.x86_64.rpm 241 kB/s | 173 kB 00:00 2024-09-12T17:07:44.280 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 85/287 2024-09-12T17:07:44.308 INFO:teuthology.orchestra.run.smithi040.stdout:(230/285): tzdata-java-2024a-2.el9.noarch.rpm 281 kB/s | 230 kB 00:00 2024-09-12T17:07:44.389 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 86/287 2024-09-12T17:07:44.421 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 87/287 2024-09-12T17:07:44.462 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 88/287 2024-09-12T17:07:44.511 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 89/287 2024-09-12T17:07:44.536 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 90/287 2024-09-12T17:07:44.541 INFO:teuthology.orchestra.run.smithi040.stdout:(231/285): webrtc-audio-processing-0.3.1-8.el9. 390 kB/s | 306 kB 00:00 2024-09-12T17:07:44.630 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 91/287 2024-09-12T17:07:44.772 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 92/287 2024-09-12T17:07:44.813 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 93/287 2024-09-12T17:07:44.925 INFO:teuthology.orchestra.run.smithi040.stdout:(232/285): wireplumber-0.4.14-1.el9.x86_64.rpm 148 kB/s | 96 kB 00:00 2024-09-12T17:07:45.031 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 94/287 2024-09-12T17:07:45.081 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : xkeyboard-config-2.33-2.el9.noarch 95/287 2024-09-12T17:07:45.120 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libxkbcommon-1.0.3-4.el9.x86_64 96/287 2024-09-12T17:07:45.125 INFO:teuthology.orchestra.run.smithi040.stdout:(233/285): wireplumber-libs-0.4.14-1.el9.x86_64 438 kB/s | 358 kB 00:00 2024-09-12T17:07:45.166 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : xdg-dbus-proxy-0.1.3-1.el9.x86_64 97/287 2024-09-12T17:07:45.175 INFO:teuthology.orchestra.run.smithi040.stdout:(234/285): xdg-dbus-proxy-0.1.3-1.el9.x86_64.rp 68 kB/s | 42 kB 00:00 2024-09-12T17:07:45.208 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : webrtc-audio-processing-0.3.1-8.el9.x86_64 98/287 2024-09-12T17:07:45.237 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : upower-0.99.11-11.el9.x86_64 99/287 2024-09-12T17:07:45.250 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: upower-0.99.11-11.el9.x86_64 99/287 2024-09-12T17:07:45.251 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/graphical.target.wants/upower.service → /usr/lib/systemd/system/upower.service. 2024-09-12T17:07:45.251 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:07:45.449 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : tzdata-java-2024a-2.el9.noarch 100/287 2024-09-12T17:07:45.529 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ttmkfdir-3.0.9-65.el9.x86_64 101/287 2024-09-12T17:07:45.586 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : totem-pl-parser-3.26.6-2.el9.x86_64 102/287 2024-09-12T17:07:45.643 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : sound-theme-freedesktop-0.8-17.el9.noarch 103/287 2024-09-12T17:07:45.669 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: sound-theme-freedesktop-0.8-17.el9.noarch 103/287 2024-09-12T17:07:45.694 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 104/287 2024-09-12T17:07:45.851 INFO:teuthology.orchestra.run.smithi040.stdout:(235/285): xdg-desktop-portal-1.12.6-1.el9.x86_ 417 kB/s | 385 kB 00:00 2024-09-12T17:07:45.876 INFO:teuthology.orchestra.run.smithi040.stdout:(236/285): xdg-desktop-portal-gtk-1.12.0-3.el9. 179 kB/s | 134 kB 00:00 2024-09-12T17:07:46.121 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: rtkit-0.11-29.el9.x86_64 105/287 2024-09-12T17:07:46.148 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : rtkit-0.11-29.el9.x86_64 105/287 2024-09-12T17:07:46.162 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: rtkit-0.11-29.el9.x86_64 105/287 2024-09-12T17:07:46.163 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/graphical.target.wants/rtkit-daemon.service → /usr/lib/systemd/system/rtkit-daemon.service. 2024-09-12T17:07:46.163 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:07:46.204 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 106/287 2024-09-12T17:07:46.239 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 107/287 2024-09-12T17:07:46.272 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 108/287 2024-09-12T17:07:46.314 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 109/287 2024-09-12T17:07:46.356 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 110/287 2024-09-12T17:07:46.457 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 111/287 2024-09-12T17:07:46.468 INFO:teuthology.orchestra.run.smithi040.stdout:(237/285): xmlstarlet-1.6.1-20.el9.x86_64.rpm 103 kB/s | 64 kB 00:00 2024-09-12T17:07:46.512 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 112/287 2024-09-12T17:07:46.551 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 113/287 2024-09-12T17:07:46.661 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 114/287 2024-09-12T17:07:46.712 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 115/287 2024-09-12T17:07:46.743 INFO:teuthology.orchestra.run.smithi040.stdout:(238/285): xkeyboard-config-2.33-2.el9.noarch.r 548 kB/s | 859 kB 00:01 2024-09-12T17:07:46.768 INFO:teuthology.orchestra.run.smithi040.stdout:(239/285): lua-devel-5.4.4-4.el9.x86_64.rpm 74 kB/s | 22 kB 00:00 2024-09-12T17:07:46.827 INFO:teuthology.orchestra.run.smithi040.stdout:(240/285): abseil-cpp-20211102.0-3.el9.x86_64.r 9.2 MB/s | 548 kB 00:00 2024-09-12T17:07:46.860 INFO:teuthology.orchestra.run.smithi040.stdout:(241/285): gperftools-libs-2.9.1-3.el9.x86_64.r 9.1 MB/s | 308 kB 00:00 2024-09-12T17:07:46.894 INFO:teuthology.orchestra.run.smithi040.stdout:(242/285): grpc-data-1.46.7-10.el9.noarch.rpm 578 kB/s | 19 kB 00:00 2024-09-12T17:07:47.028 INFO:teuthology.orchestra.run.smithi040.stdout:(243/285): libarrow-9.0.0-11.el9.x86_64.rpm 33 MB/s | 4.4 MB 00:00 2024-09-12T17:07:47.053 INFO:teuthology.orchestra.run.smithi040.stdout:(244/285): xorg-x11-fonts-Type1-7.5-33.el9.noar 429 kB/s | 505 kB 00:01 2024-09-12T17:07:47.070 INFO:teuthology.orchestra.run.smithi040.stdout:(245/285): libarrow-doc-9.0.0-11.el9.noarch.rpm 623 kB/s | 26 kB 00:00 2024-09-12T17:07:47.095 INFO:teuthology.orchestra.run.smithi040.stdout:(246/285): libunwind-1.6.2-1.el9.x86_64.rpm 3.9 MB/s | 67 kB 00:00 2024-09-12T17:07:47.120 INFO:teuthology.orchestra.run.smithi040.stdout:(247/285): liboath-2.6.7-2.el9.x86_64.rpm 724 kB/s | 49 kB 00:00 2024-09-12T17:07:47.146 INFO:teuthology.orchestra.run.smithi040.stdout:(248/285): luarocks-3.9.2-5.el9.noarch.rpm 3.1 MB/s | 151 kB 00:00 2024-09-12T17:07:47.188 INFO:teuthology.orchestra.run.smithi040.stdout:(249/285): parquet-libs-9.0.0-11.el9.x86_64.rpm 12 MB/s | 839 kB 00:00 2024-09-12T17:07:47.213 INFO:teuthology.orchestra.run.smithi040.stdout:(250/285): python3-asyncssh-2.13.2-5.el9.noarch 8.0 MB/s | 548 kB 00:00 2024-09-12T17:07:47.238 INFO:teuthology.orchestra.run.smithi040.stdout:(251/285): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-12T17:07:47.255 INFO:teuthology.orchestra.run.smithi040.stdout:(252/285): python3-cachetools-4.2.4-1.el9.noarc 770 kB/s | 32 kB 00:00 2024-09-12T17:07:47.272 INFO:teuthology.orchestra.run.smithi040.stdout:(253/285): python3-certifi-2023.05.07-4.el9.noa 419 kB/s | 14 kB 00:00 2024-09-12T17:07:47.297 INFO:teuthology.orchestra.run.smithi040.stdout:(254/285): python3-cheroot-8.6.0-4.el9.noarch.r 4.0 MB/s | 172 kB 00:00 2024-09-12T17:07:47.331 INFO:teuthology.orchestra.run.smithi040.stdout:(255/285): python3-cherrypy-18.6.1-2.el9.noarch 6.0 MB/s | 358 kB 00:00 2024-09-12T17:07:47.365 INFO:teuthology.orchestra.run.smithi040.stdout:(256/285): python3-google-auth-2.34.0-1.el9.noa 3.2 MB/s | 220 kB 00:00 2024-09-12T17:07:47.390 INFO:teuthology.orchestra.run.smithi040.stdout:(257/285): python3-grpcio-tools-1.46.7-10.el9.x 5.7 MB/s | 144 kB 00:00 2024-09-12T17:07:47.407 INFO:teuthology.orchestra.run.smithi040.stdout:(258/285): python3-jaraco-8.2.1-3.el9.noarch.rp 647 kB/s | 11 kB 00:00 2024-09-12T17:07:47.424 INFO:teuthology.orchestra.run.smithi040.stdout:(259/285): python3-jaraco-classes-3.2.1-5.el9.n 1.0 MB/s | 18 kB 00:00 2024-09-12T17:07:47.441 INFO:teuthology.orchestra.run.smithi040.stdout:(260/285): python3-jaraco-collections-3.0.0-8.e 1.4 MB/s | 23 kB 00:00 2024-09-12T17:07:47.458 INFO:teuthology.orchestra.run.smithi040.stdout:(261/285): python3-jaraco-functools-3.5.0-2.el9 1.2 MB/s | 19 kB 00:00 2024-09-12T17:07:47.475 INFO:teuthology.orchestra.run.smithi040.stdout:(262/285): python3-jaraco-text-3.2.0-6.el9.noar 1.2 MB/s | 20 kB 00:00 2024-09-12T17:07:47.507 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 116/287 2024-09-12T17:07:47.508 INFO:teuthology.orchestra.run.smithi040.stdout:(263/285): protobuf-compiler-3.14.0-13.el9.x86_ 1.1 MB/s | 863 kB 00:00 2024-09-12T17:07:47.549 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 117/287 2024-09-12T17:07:47.576 INFO:teuthology.orchestra.run.smithi040.stdout:(264/285): python3-grpcio-1.46.7-10.el9.x86_64. 8.4 MB/s | 2.0 MB 00:00 2024-09-12T17:07:47.583 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 118/287 2024-09-12T17:07:47.601 INFO:teuthology.orchestra.run.smithi040.stdout:(265/285): python3-logutils-0.3.5-21.el9.noarch 504 kB/s | 46 kB 00:00 2024-09-12T17:07:47.626 INFO:teuthology.orchestra.run.smithi040.stdout:(266/285): python3-more-itertools-8.12.0-2.el9. 1.5 MB/s | 79 kB 00:00 2024-09-12T17:07:47.651 INFO:teuthology.orchestra.run.smithi040.stdout:(267/285): python3-natsort-7.1.1-5.el9.noarch.r 1.1 MB/s | 58 kB 00:00 2024-09-12T17:07:47.676 INFO:teuthology.orchestra.run.smithi040.stdout:(268/285): python3-portend-3.1.0-2.el9.noarch.r 658 kB/s | 16 kB 00:00 2024-09-12T17:07:47.691 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 119/287 2024-09-12T17:07:47.718 INFO:teuthology.orchestra.run.smithi040.stdout:(269/285): python3-kubernetes-26.1.0-2.el9.noar 4.2 MB/s | 1.0 MB 00:00 2024-09-12T17:07:47.738 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 120/287 2024-09-12T17:07:47.743 INFO:teuthology.orchestra.run.smithi040.stdout:(270/285): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.3 MB/s | 90 kB 00:00 2024-09-12T17:07:47.769 INFO:teuthology.orchestra.run.smithi040.stdout:(271/285): python3-pecan-1.4.2-3.el9.noarch.rpm 1.9 MB/s | 272 kB 00:00 2024-09-12T17:07:47.794 INFO:teuthology.orchestra.run.smithi040.stdout:(272/285): python3-repoze-lru-0.7-16.el9.noarch 407 kB/s | 31 kB 00:00 2024-09-12T17:07:47.819 INFO:teuthology.orchestra.run.smithi040.stdout:(273/285): python3-rsa-4.9-2.el9.noarch.rpm 1.1 MB/s | 59 kB 00:00 2024-09-12T17:07:47.845 INFO:teuthology.orchestra.run.smithi040.stdout:(274/285): python3-tempora-5.0.0-2.el9.noarch.r 712 kB/s | 36 kB 00:00 2024-09-12T17:07:47.870 INFO:teuthology.orchestra.run.smithi040.stdout:(275/285): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-09-12T17:07:47.895 INFO:teuthology.orchestra.run.smithi040.stdout:(276/285): python3-routes-2.5.1-5.el9.noarch.rp 1.2 MB/s | 188 kB 00:00 2024-09-12T17:07:47.912 INFO:teuthology.orchestra.run.smithi040.stdout:(277/285): python3-websocket-client-1.2.3-2.el9 2.1 MB/s | 90 kB 00:00 2024-09-12T17:07:47.938 INFO:teuthology.orchestra.run.smithi040.stdout:(278/285): python3-zc-lockfile-2.0-10.el9.noarc 804 kB/s | 20 kB 00:00 2024-09-12T17:07:47.949 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : publicsuffix-list-20210518-3.el9.noarch 121/287 2024-09-12T17:07:47.963 INFO:teuthology.orchestra.run.smithi040.stdout:(279/285): python3-webob-1.8.8-2.el9.noarch.rpm 1.9 MB/s | 230 kB 00:00 2024-09-12T17:07:47.988 INFO:teuthology.orchestra.run.smithi040.stdout:(280/285): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-12T17:07:47.989 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : poppler-data-0.4.9-9.el9.noarch 122/287 2024-09-12T17:07:48.013 INFO:teuthology.orchestra.run.smithi040.stdout:(281/285): python3-werkzeug-2.0.3-3.el9.1.noarc 3.6 MB/s | 427 kB 00:00 2024-09-12T17:07:48.036 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : p11-kit-server-0.25.3-2.el9.x86_64 123/287 2024-09-12T17:07:48.047 INFO:teuthology.orchestra.run.smithi040.stdout:(282/285): s3cmd-2.4.0-1.el9.noarch.rpm 2.4 MB/s | 206 kB 00:00 2024-09-12T17:07:48.097 INFO:teuthology.orchestra.run.smithi040.stdout:(283/285): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-09-12T17:07:48.339 INFO:teuthology.orchestra.run.smithi040.stdout:(284/285): librbd1-19.3.0-4762.gbad475c1.el9.x8 11 MB/s | 3.2 MB 00:00 2024-09-12T17:07:48.439 INFO:teuthology.orchestra.run.smithi040.stdout:(285/285): librados2-19.3.0-4762.gbad475c1.el9. 8.1 MB/s | 3.5 MB 00:00 2024-09-12T17:07:48.446 INFO:teuthology.orchestra.run.smithi040.stdout:-------------------------------------------------------------------------------- 2024-09-12T17:07:48.446 INFO:teuthology.orchestra.run.smithi040.stdout:Total 5.3 MB/s | 322 MB 01:00 2024-09-12T17:07:48.596 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : osinfo-db-tools-1.10.0-1.el9.x86_64 124/287 2024-09-12T17:07:48.657 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : osinfo-db-20240701-2.el9.noarch 125/287 2024-09-12T17:07:48.692 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libosinfo-1.10.0-1.el9.x86_64 126/287 2024-09-12T17:07:48.727 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : orc-0.4.31-8.el9.x86_64 127/287 2024-09-12T17:07:48.760 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : openjpeg2-2.4.0-7.el9.x86_64 128/287 2024-09-12T17:07:48.950 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : openblas-0.3.26-2.el9.x86_64 129/287 2024-09-12T17:07:48.973 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 130/287 2024-09-12T17:07:49.062 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 131/287 2024-09-12T17:07:49.797 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 132/287 2024-09-12T17:07:49.921 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 133/287 2024-09-12T17:07:51.316 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 134/287 2024-09-12T17:07:51.393 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 135/287 2024-09-12T17:07:51.455 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : mesa-filesystem-24.1.2-3.el9.x86_64 136/287 2024-09-12T17:07:51.486 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : lua-posix-35.0-8.el9.x86_64 137/287 2024-09-12T17:07:51.515 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : copy-jdk-configs-4.0-3.el9.noarch 138/287 2024-09-12T17:07:51.543 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : low-memory-monitor-2.1-4.el9.x86_64 139/287 2024-09-12T17:07:51.555 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: low-memory-monitor-2.1-4.el9.x86_64 139/287 2024-09-12T17:07:51.555 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/basic.target.wants/low-memory-monitor.service → /usr/lib/systemd/system/low-memory-monitor.service. 2024-09-12T17:07:51.555 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:07:51.610 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libwebp-1.2.0-8.el9.x86_64 140/287 2024-09-12T17:07:51.611 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction check 2024-09-12T17:07:51.647 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libvisual-1:0.4.0-34.el9.x86_64 141/287 2024-09-12T17:07:51.684 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libsbc-1.4-9.el9.x86_64 142/287 2024-09-12T17:07:51.812 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction check succeeded. 2024-09-12T17:07:51.812 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction test 2024-09-12T17:07:52.021 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 143/287 2024-09-12T17:07:52.062 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : librbd1-2:19.3.0-4762.gbad475c1.el9.x86_64 144/287 2024-09-12T17:07:52.164 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: librbd1-2:19.3.0-4762.gbad475c1.el9.x86_64 144/287 2024-09-12T17:07:52.204 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-rbd-2:19.3.0-4762.gbad475c1.el9.x86_64 145/287 2024-09-12T17:07:52.235 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libnotify-0.7.9-8.el9.x86_64 146/287 2024-09-12T17:07:52.265 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libldac-2.0.2.3-10.el9.x86_64 147/287 2024-09-12T17:07:52.331 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libiptcdata-1.0.5-10.el9.x86_64 148/287 2024-09-12T17:07:52.364 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libgsf-1.14.47-5.el9.x86_64 149/287 2024-09-12T17:07:52.389 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libfontenc-1.1.3-17.el9.x86_64 150/287 2024-09-12T17:07:52.430 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : mkfontscale-1.2.1-3.el9.x86_64 151/287 2024-09-12T17:07:52.453 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : xorg-x11-fonts-Type1-7.5-33.el9.noarch 152/287 2024-09-12T17:07:52.731 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: xorg-x11-fonts-Type1-7.5-33.el9.noarch 152/287 2024-09-12T17:07:52.772 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libexif-0.6.22-6.el9.x86_64 153/287 2024-09-12T17:07:52.801 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libepoxy-1.5.5-4.el9.x86_64 154/287 2024-09-12T17:07:52.826 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libasyncns-0.8-22.el9.x86_64 155/287 2024-09-12T17:07:52.851 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libXxf86vm-1.1.4-18.el9.x86_64 156/287 2024-09-12T17:07:52.877 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libXv-1.0.11-16.el9.x86_64 157/287 2024-09-12T17:07:52.902 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libXrandr-1.5.2-8.el9.x86_64 158/287 2024-09-12T17:07:52.930 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libXinerama-1.1.4-10.el9.x86_64 159/287 2024-09-12T17:07:52.966 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : jbigkit-libs-2.1-23.el9.x86_64 160/287 2024-09-12T17:07:53.011 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libtiff-4.4.0-13.el9.x86_64 161/287 2024-09-12T17:07:53.042 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : gdk-pixbuf2-modules-2.42.6-4.el9.x86_64 162/287 2024-09-12T17:07:53.090 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libgxps-0.3.2-3.el9.x86_64 163/287 2024-09-12T17:07:53.125 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : poppler-21.01.0-21.el9.x86_64 164/287 2024-09-12T17:07:53.597 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : poppler-glib-21.01.0-21.el9.x86_64 165/287 2024-09-12T17:07:53.735 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : iso-codes-4.6.0-3.el9.noarch 166/287 2024-09-12T17:07:53.789 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : hicolor-icon-theme-0.17-13.el9.noarch 167/287 2024-09-12T17:07:53.814 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : gtk-update-icon-cache-3.24.31-5.el9.x86_64 168/287 2024-09-12T17:07:53.843 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : gsm-1.0.19-6.el9.x86_64 169/287 2024-09-12T17:07:53.913 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libsndfile-1.0.31-8.el9.x86_64 170/287 2024-09-12T17:07:53.970 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : pulseaudio-libs-15.0-2.el9.x86_64 171/287 2024-09-12T17:07:53.999 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libcanberra-0.30-27.el9.x86_64 172/287 2024-09-12T17:07:54.019 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: libcanberra-0.30-27.el9.x86_64 172/287 2024-09-12T17:07:54.053 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : graphene-1.10.6-2.el9.x86_64 173/287 2024-09-12T17:07:54.079 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : giflib-5.2.1-9.el9.x86_64 174/287 2024-09-12T17:07:54.123 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : flatpak-session-helper-1.12.9-1.el9.x86_64 175/287 2024-09-12T17:07:54.159 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : flatpak-selinux-1.12.9-1.el9.noarch 176/287 2024-09-12T17:07:55.140 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction test succeeded. 2024-09-12T17:07:55.140 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction 2024-09-12T17:08:05.248 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: copy-jdk-configs-4.0-3.el9.noarch 1/1 2024-09-12T17:08:05.442 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86_64 1/1 2024-09-12T17:08:05.606 INFO:teuthology.orchestra.run.smithi040.stdout: Preparing : 1/1 2024-09-12T17:08:05.681 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : javapackages-filesystem-6.0.0-4.el9.noarch 1/287 2024-09-12T17:08:05.709 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libogg-2:1.3.4-6.el9.x86_64 2/287 2024-09-12T17:08:05.787 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libXi-1.7.10-8.el9.x86_64 3/287 2024-09-12T17:08:05.835 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : alsa-lib-1.2.12-1.el9.x86_64 4/287 2024-09-12T17:08:05.888 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libvorbis-1:1.3.7-5.el9.x86_64 5/287 2024-09-12T17:08:05.938 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/287 2024-09-12T17:08:05.971 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/287 2024-09-12T17:08:06.010 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: flatpak-selinux-1.12.9-1.el9.noarch 176/287 2024-09-12T17:08:06.017 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/287 2024-09-12T17:08:06.050 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : fdk-aac-free-2.0.0-8.el9.x86_64 177/287 2024-09-12T17:08:06.086 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 178/287 2024-09-12T17:08:06.131 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : composefs-libs-1.0.5-1.el9.x86_64 179/287 2024-09-12T17:08:06.161 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ostree-libs-2024.7-2.el9.x86_64 180/287 2024-09-12T17:08:06.198 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 181/287 2024-09-12T17:08:06.378 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/287 2024-09-12T17:08:06.496 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : librados2-2:19.3.0-4762.gbad475c1.el9.x86_64 10/287 2024-09-12T17:08:06.616 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: librados2-2:19.3.0-4762.gbad475c1.el9.x86_64 10/287 2024-09-12T17:08:06.647 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libcephfs2-2:19.3.0-4762.gbad475c1.el9.x86_64 11/287 2024-09-12T17:08:06.724 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: libcephfs2-2:19.3.0-4762.gbad475c1.el9.x86_64 11/287 2024-09-12T17:08:06.730 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 182/287 2024-09-12T17:08:06.751 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-rados-2:19.3.0-4762.gbad475c1.el9.x86_64 12/287 2024-09-12T17:08:06.769 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : librgw2-2:19.3.0-4762.gbad475c1.el9.x86_64 183/287 2024-09-12T17:08:06.797 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libwayland-client-1.21.0-1.el9.x86_64 13/287 2024-09-12T17:08:06.836 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 14/287 2024-09-12T17:08:06.849 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: librgw2-2:19.3.0-4762.gbad475c1.el9.x86_64 183/287 2024-09-12T17:08:06.862 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 15/287 2024-09-12T17:08:06.887 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-rgw-2:19.3.0-4762.gbad475c1.el9.x86_64 184/287 2024-09-12T17:08:06.888 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libXfixes-5.0.3-16.el9.x86_64 16/287 2024-09-12T17:08:06.920 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : opus-1.3.1-10.el9.x86_64 17/287 2024-09-12T17:08:06.945 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : lua-5.4.4-4.el9.x86_64 18/287 2024-09-12T17:08:06.974 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libX11-xcb-1.7.0-9.el9.x86_64 19/287 2024-09-12T17:08:07.126 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : lcms2-2.12-3.el9.x86_64 20/287 2024-09-12T17:08:07.273 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : gstreamer1-1.22.1-2.el9.x86_64 21/287 2024-09-12T17:08:07.313 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : atk-2.36.0-5.el9.x86_64 22/287 2024-09-12T17:08:07.349 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libwayland-cursor-1.21.0-1.el9.x86_64 23/287 2024-09-12T17:08:07.377 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libcephsqlite-2:19.3.0-4762.gbad475c1.el9.x86_64 24/287 2024-09-12T17:08:07.483 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4762.gbad475c1.el9.x86_64 24/287 2024-09-12T17:08:07.512 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libradosstriper1-2:19.3.0-4762.gbad475c1.el9.x86 25/287 2024-09-12T17:08:07.558 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4762.gbad475c1.el9.x86 25/287 2024-09-12T17:08:07.582 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libXtst-1.2.3-16.el9.x86_64 26/287 2024-09-12T17:08:07.605 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 27/287 2024-09-12T17:08:07.628 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 27/287 2024-09-12T17:08:07.774 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 28/287 2024-09-12T17:08:07.805 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 28/287 2024-09-12T17:08:07.923 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : re2-1:20211101-20.el9.x86_64 29/287 2024-09-12T17:08:07.953 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 30/287 2024-09-12T17:08:07.988 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : liboath-2.6.7-2.el9.x86_64 31/287 2024-09-12T17:08:08.076 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 32/287 2024-09-12T17:08:08.141 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 33/287 2024-09-12T17:08:08.184 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-packaging-20.9-5.el9.noarch 34/287 2024-09-12T17:08:08.227 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 35/287 2024-09-12T17:08:08.260 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 36/287 2024-09-12T17:08:08.286 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libxshmfence-1.3-10.el9.x86_64 37/287 2024-09-12T17:08:08.312 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libwayland-server-1.21.0-1.el9.x86_64 38/287 2024-09-12T17:08:08.337 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libwayland-egl-1.21.0-1.el9.x86_64 39/287 2024-09-12T17:08:08.371 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libtool-ltdl-2.4.6-46.el9.x86_64 40/287 2024-09-12T17:08:08.401 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libglvnd-1:1.3.4-1.el9.x86_64 41/287 2024-09-12T17:08:08.440 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libXcomposite-0.4.5-7.el9.x86_64 42/287 2024-09-12T17:08:08.492 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 43/287 2024-09-12T17:08:08.529 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : dconf-0.40.0-6.el9.x86_64 44/287 2024-09-12T17:08:08.614 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: dconf-0.40.0-6.el9.x86_64 44/287 2024-09-12T17:08:08.675 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 45/287 2024-09-12T17:08:08.703 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 46/287 2024-09-12T17:08:08.746 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 47/287 2024-09-12T17:08:08.782 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 48/287 2024-09-12T17:08:08.815 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : fuse-2.9.9-16.el9.x86_64 49/287 2024-09-12T17:08:08.895 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : cups-libs-1:2.3.3op2-30.el9.x86_64 50/287 2024-09-12T17:08:08.933 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-ceph-common-2:19.3.0-4762.gbad475c1.el9. 51/287 2024-09-12T17:08:08.985 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-ceph-argparse-2:19.3.0-4762.gbad475c1.el 52/287 2024-09-12T17:08:09.027 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-cephfs-2:19.3.0-4762.gbad475c1.el9.x86_6 53/287 2024-09-12T17:08:09.248 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 54/287 2024-09-12T17:08:09.324 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-common-2:19.3.0-4762.gbad475c1.el9.x86_64 185/287 2024-09-12T17:08:09.361 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-common-2:19.3.0-4762.gbad475c1.el9.x86_64 185/287 2024-09-12T17:08:09.503 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 55/287 2024-09-12T17:08:09.565 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 56/287 2024-09-12T17:08:09.958 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-common-2:19.3.0-4762.gbad475c1.el9.x86_64 185/287 2024-09-12T17:08:10.005 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-base-2:19.3.0-4762.gbad475c1.el9.x86_64 186/287 2024-09-12T17:08:10.084 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-base-2:19.3.0-4762.gbad475c1.el9.x86_64 186/287 2024-09-12T17:08:10.084 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-12T17:08:10.084 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-12T17:08:10.084 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:08:10.115 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-selinux-2:19.3.0-4762.gbad475c1.el9.x86_64 187/287 2024-09-12T17:08:10.133 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-rsa-4.9-2.el9.noarch 57/287 2024-09-12T17:08:10.221 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 58/287 2024-09-12T17:08:10.254 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 59/287 2024-09-12T17:08:10.338 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 60/287 2024-09-12T17:08:10.387 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : at-spi2-core-2.40.3-1.el9.x86_64 61/287 2024-09-12T17:08:10.423 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : at-spi2-atk-2.38.0-4.el9.x86_64 62/287 2024-09-12T17:08:10.452 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : colord-libs-1.4.5-4.el9.x86_64 63/287 2024-09-12T17:08:10.527 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 64/287 2024-09-12T17:08:10.563 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : luarocks-3.9.2-5.el9.noarch 65/287 2024-09-12T17:08:10.611 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libXcursor-1.2.0-7.el9.x86_64 66/287 2024-09-12T17:08:10.666 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libXdamage-1.1.5-7.el9.x86_64 67/287 2024-09-12T17:08:10.705 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : librados-devel-2:19.3.0-4762.gbad475c1.el9.x86_6 68/287 2024-09-12T17:08:10.751 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 69/287 2024-09-12T17:08:10.768 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : flac-libs-1.3.3-12.el9.x86_64 70/287 2024-09-12T17:08:10.813 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libtheora-1:1.1.1-31.el9.x86_64 71/287 2024-09-12T17:08:10.869 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : exiv2-libs-0.27.5-2.el9.x86_64 72/287 2024-09-12T17:08:10.903 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : exiv2-0.27.5-2.el9.x86_64 73/287 2024-09-12T17:08:10.940 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libgexiv2-0.12.3-1.el9.x86_64 74/287 2024-09-12T17:08:11.037 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 75/287 2024-09-12T17:08:11.106 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 76/287 2024-09-12T17:08:11.189 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 77/287 2024-09-12T17:08:11.225 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 78/287 2024-09-12T17:08:11.262 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 79/287 2024-09-12T17:08:11.318 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 80/287 2024-09-12T17:08:11.363 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 81/287 2024-09-12T17:08:11.405 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 82/287 2024-09-12T17:08:11.549 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 83/287 2024-09-12T17:08:11.597 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 84/287 2024-09-12T17:08:11.648 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 85/287 2024-09-12T17:08:11.755 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 86/287 2024-09-12T17:08:11.789 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 87/287 2024-09-12T17:08:11.830 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 88/287 2024-09-12T17:08:11.862 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 89/287 2024-09-12T17:08:11.887 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 90/287 2024-09-12T17:08:11.976 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 91/287 2024-09-12T17:08:12.113 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 92/287 2024-09-12T17:08:12.157 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 93/287 2024-09-12T17:08:12.371 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 94/287 2024-09-12T17:08:12.416 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : xkeyboard-config-2.33-2.el9.noarch 95/287 2024-09-12T17:08:12.447 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libxkbcommon-1.0.3-4.el9.x86_64 96/287 2024-09-12T17:08:12.478 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : xdg-dbus-proxy-0.1.3-1.el9.x86_64 97/287 2024-09-12T17:08:12.527 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : webrtc-audio-processing-0.3.1-8.el9.x86_64 98/287 2024-09-12T17:08:12.564 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : upower-0.99.11-11.el9.x86_64 99/287 2024-09-12T17:08:12.578 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: upower-0.99.11-11.el9.x86_64 99/287 2024-09-12T17:08:12.578 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/graphical.target.wants/upower.service → /usr/lib/systemd/system/upower.service. 2024-09-12T17:08:12.578 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-12T17:08:12.777 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : tzdata-java-2024a-2.el9.noarch 100/287 2024-09-12T17:08:12.859 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ttmkfdir-3.0.9-65.el9.x86_64 101/287 2024-09-12T17:08:12.913 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : totem-pl-parser-3.26.6-2.el9.x86_64 102/287 2024-09-12T17:08:12.947 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : sound-theme-freedesktop-0.8-17.el9.noarch 103/287 2024-09-12T17:08:12.973 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: sound-theme-freedesktop-0.8-17.el9.noarch 103/287 2024-09-12T17:08:13.007 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 104/287 2024-09-12T17:08:13.490 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: rtkit-0.11-29.el9.x86_64 105/287 2024-09-12T17:08:13.527 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : rtkit-0.11-29.el9.x86_64 105/287 2024-09-12T17:08:13.542 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: rtkit-0.11-29.el9.x86_64 105/287 2024-09-12T17:08:13.542 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/graphical.target.wants/rtkit-daemon.service → /usr/lib/systemd/system/rtkit-daemon.service. 2024-09-12T17:08:13.542 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-12T17:08:13.593 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 106/287 2024-09-12T17:08:13.635 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 107/287 2024-09-12T17:08:13.669 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 108/287 2024-09-12T17:08:13.711 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 109/287 2024-09-12T17:08:13.745 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 110/287 2024-09-12T17:08:13.836 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 111/287 2024-09-12T17:08:13.884 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 112/287 2024-09-12T17:08:13.915 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 113/287 2024-09-12T17:08:14.025 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 114/287 2024-09-12T17:08:14.084 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 115/287 2024-09-12T17:08:14.866 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 116/287 2024-09-12T17:08:14.921 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 117/287 2024-09-12T17:08:14.963 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 118/287 2024-09-12T17:08:15.069 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 119/287 2024-09-12T17:08:15.118 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 120/287 2024-09-12T17:08:15.315 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : publicsuffix-list-20210518-3.el9.noarch 121/287 2024-09-12T17:08:15.369 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : poppler-data-0.4.9-9.el9.noarch 122/287 2024-09-12T17:08:15.415 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : p11-kit-server-0.25.3-2.el9.x86_64 123/287 2024-09-12T17:08:15.953 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : osinfo-db-tools-1.10.0-1.el9.x86_64 124/287 2024-09-12T17:08:16.012 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : osinfo-db-20240701-2.el9.noarch 125/287 2024-09-12T17:08:16.049 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libosinfo-1.10.0-1.el9.x86_64 126/287 2024-09-12T17:08:16.083 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : orc-0.4.31-8.el9.x86_64 127/287 2024-09-12T17:08:16.116 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : openjpeg2-2.4.0-7.el9.x86_64 128/287 2024-09-12T17:08:16.306 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : openblas-0.3.26-2.el9.x86_64 129/287 2024-09-12T17:08:16.329 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 130/287 2024-09-12T17:08:16.409 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 131/287 2024-09-12T17:08:17.124 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 132/287 2024-09-12T17:08:17.242 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 133/287 2024-09-12T17:08:18.587 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 134/287 2024-09-12T17:08:18.674 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 135/287 2024-09-12T17:08:18.733 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : mesa-filesystem-24.1.2-3.el9.x86_64 136/287 2024-09-12T17:08:18.785 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : lua-posix-35.0-8.el9.x86_64 137/287 2024-09-12T17:08:18.812 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : copy-jdk-configs-4.0-3.el9.noarch 138/287 2024-09-12T17:08:18.842 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : low-memory-monitor-2.1-4.el9.x86_64 139/287 2024-09-12T17:08:18.854 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: low-memory-monitor-2.1-4.el9.x86_64 139/287 2024-09-12T17:08:18.854 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/basic.target.wants/low-memory-monitor.service → /usr/lib/systemd/system/low-memory-monitor.service. 2024-09-12T17:08:18.854 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-12T17:08:18.913 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libwebp-1.2.0-8.el9.x86_64 140/287 2024-09-12T17:08:18.937 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libvisual-1:0.4.0-34.el9.x86_64 141/287 2024-09-12T17:08:18.966 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libsbc-1.4-9.el9.x86_64 142/287 2024-09-12T17:08:19.304 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 143/287 2024-09-12T17:08:19.345 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : librbd1-2:19.3.0-4762.gbad475c1.el9.x86_64 144/287 2024-09-12T17:08:19.446 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: librbd1-2:19.3.0-4762.gbad475c1.el9.x86_64 144/287 2024-09-12T17:08:19.478 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-rbd-2:19.3.0-4762.gbad475c1.el9.x86_64 145/287 2024-09-12T17:08:19.509 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libnotify-0.7.9-8.el9.x86_64 146/287 2024-09-12T17:08:19.539 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libldac-2.0.2.3-10.el9.x86_64 147/287 2024-09-12T17:08:19.602 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libiptcdata-1.0.5-10.el9.x86_64 148/287 2024-09-12T17:08:19.647 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libgsf-1.14.47-5.el9.x86_64 149/287 2024-09-12T17:08:19.672 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libfontenc-1.1.3-17.el9.x86_64 150/287 2024-09-12T17:08:19.716 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : mkfontscale-1.2.1-3.el9.x86_64 151/287 2024-09-12T17:08:19.753 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : xorg-x11-fonts-Type1-7.5-33.el9.noarch 152/287 2024-09-12T17:08:20.001 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4762.gbad475c1.el9.x86_64 187/287 2024-09-12T17:08:20.002 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /sys 2024-09-12T17:08:20.002 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /proc 2024-09-12T17:08:20.002 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /mnt 2024-09-12T17:08:20.002 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /var/tmp 2024-09-12T17:08:20.002 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /home 2024-09-12T17:08:20.002 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /root 2024-09-12T17:08:20.002 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /tmp 2024-09-12T17:08:20.002 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:08:20.013 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: xorg-x11-fonts-Type1-7.5-33.el9.noarch 152/287 2024-09-12T17:08:20.055 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libexif-0.6.22-6.el9.x86_64 153/287 2024-09-12T17:08:20.083 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libepoxy-1.5.5-4.el9.x86_64 154/287 2024-09-12T17:08:20.109 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libasyncns-0.8-22.el9.x86_64 155/287 2024-09-12T17:08:20.143 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libXxf86vm-1.1.4-18.el9.x86_64 156/287 2024-09-12T17:08:20.168 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libXv-1.0.11-16.el9.x86_64 157/287 2024-09-12T17:08:20.179 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-volume-2:19.3.0-4762.gbad475c1.el9.noarch 188/287 2024-09-12T17:08:20.193 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libXrandr-1.5.2-8.el9.x86_64 158/287 2024-09-12T17:08:20.196 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-volume-2:19.3.0-4762.gbad475c1.el9.noarch 188/287 2024-09-12T17:08:20.197 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T17:08:20.197 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-12T17:08:20.197 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:08:20.230 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libXinerama-1.1.4-10.el9.x86_64 159/287 2024-09-12T17:08:20.265 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : jbigkit-libs-2.1-23.el9.x86_64 160/287 2024-09-12T17:08:20.307 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libtiff-4.4.0-13.el9.x86_64 161/287 2024-09-12T17:08:20.342 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : gdk-pixbuf2-modules-2.42.6-4.el9.x86_64 162/287 2024-09-12T17:08:20.390 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libgxps-0.3.2-3.el9.x86_64 163/287 2024-09-12T17:08:20.424 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : poppler-21.01.0-21.el9.x86_64 164/287 2024-09-12T17:08:20.915 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : poppler-glib-21.01.0-21.el9.x86_64 165/287 2024-09-12T17:08:21.058 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : iso-codes-4.6.0-3.el9.noarch 166/287 2024-09-12T17:08:21.115 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : hicolor-icon-theme-0.17-13.el9.noarch 167/287 2024-09-12T17:08:21.149 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : gtk-update-icon-cache-3.24.31-5.el9.x86_64 168/287 2024-09-12T17:08:21.177 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : gsm-1.0.19-6.el9.x86_64 169/287 2024-09-12T17:08:21.248 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libsndfile-1.0.31-8.el9.x86_64 170/287 2024-09-12T17:08:21.300 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : pulseaudio-libs-15.0-2.el9.x86_64 171/287 2024-09-12T17:08:21.333 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libcanberra-0.30-27.el9.x86_64 172/287 2024-09-12T17:08:21.354 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: libcanberra-0.30-27.el9.x86_64 172/287 2024-09-12T17:08:21.388 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : graphene-1.10.6-2.el9.x86_64 173/287 2024-09-12T17:08:21.414 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : giflib-5.2.1-9.el9.x86_64 174/287 2024-09-12T17:08:21.450 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : flatpak-session-helper-1.12.9-1.el9.x86_64 175/287 2024-09-12T17:08:21.477 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : flatpak-selinux-1.12.9-1.el9.noarch 176/287 2024-09-12T17:08:21.746 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-osd-2:19.3.0-4762.gbad475c1.el9.x86_64 189/287 2024-09-12T17:08:21.775 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-osd-2:19.3.0-4762.gbad475c1.el9.x86_64 189/287 2024-09-12T17:08:21.775 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T17:08:21.775 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-12T17:08:21.775 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T17:08:21.775 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T17:08:21.775 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:08:22.013 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mds-2:19.3.0-4762.gbad475c1.el9.x86_64 190/287 2024-09-12T17:08:22.038 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mds-2:19.3.0-4762.gbad475c1.el9.x86_64 190/287 2024-09-12T17:08:22.039 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T17:08:22.039 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-12T17:08:22.039 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T17:08:22.039 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T17:08:22.039 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:08:22.514 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mon-2:19.3.0-4762.gbad475c1.el9.x86_64 191/287 2024-09-12T17:08:22.539 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mon-2:19.3.0-4762.gbad475c1.el9.x86_64 191/287 2024-09-12T17:08:22.540 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T17:08:22.540 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-12T17:08:22.540 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T17:08:22.540 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T17:08:22.540 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:08:22.645 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : avahi-glib-0.8-21.el9.x86_64 192/287 2024-09-12T17:08:25.833 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : adwaita-cursor-theme-40.1.1-3.el9.noarch 193/287 2024-09-12T17:08:25.949 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : adwaita-icon-theme-40.1.1-3.el9.noarch 194/287 2024-09-12T17:08:26.007 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-ply-3.11-14.el9.noarch 195/287 2024-09-12T17:08:26.073 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 196/287 2024-09-12T17:08:26.278 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 197/287 2024-09-12T17:08:26.327 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 198/287 2024-09-12T17:08:26.408 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 199/287 2024-09-12T17:08:26.507 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 200/287 2024-09-12T17:08:26.661 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 201/287 2024-09-12T17:08:26.702 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 202/287 2024-09-12T17:08:26.738 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 203/287 2024-09-12T17:08:27.658 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 204/287 2024-09-12T17:08:27.709 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 205/287 2024-09-12T17:08:28.085 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 205/287 2024-09-12T17:08:28.131 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : plexus-utils-3.3.0-10.el9.noarch 206/287 2024-09-12T17:08:28.162 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : slf4j-1.7.30-13.el9.noarch 207/287 2024-09-12T17:08:28.190 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : atinject-1.0.3-6.el9.noarch 208/287 2024-09-12T17:08:28.233 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : apache-commons-io-1:2.8.0-8.el9.noarch 209/287 2024-09-12T17:08:28.270 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : apache-commons-lang3-3.12.0-6.el9.noarch 210/287 2024-09-12T17:08:28.297 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : httpcomponents-core-4.4.13-7.el9.noarch 211/287 2024-09-12T17:08:28.323 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : plexus-cipher-1.7-27.el9.noarch 212/287 2024-09-12T17:08:28.349 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : plexus-classworlds-2.6.0-11.el9.noarch 213/287 2024-09-12T17:08:28.373 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : plexus-containers-component-annotations-2.1.0-10 214/287 2024-09-12T17:08:28.400 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : plexus-sec-dispatcher-1.4-37.el9.noarch 215/287 2024-09-12T17:08:28.425 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : maven-shared-utils-3.3.4-3.el9.noarch 216/287 2024-09-12T17:08:28.452 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : cdi-api-2.0.2-6.el9.noarch 217/287 2024-09-12T17:08:28.482 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : sisu-1:0.3.4-10.el9.noarch 218/287 2024-09-12T17:08:28.510 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : jcl-over-slf4j-1.7.30-13.el9.noarch 219/287 2024-09-12T17:08:28.545 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : apache-commons-cli-1.4-17.el9.noarch 220/287 2024-09-12T17:08:28.583 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : apache-commons-codec-1.15-7.el9.noarch 221/287 2024-09-12T17:08:28.614 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : httpcomponents-client-4.5.13-3.el9.noarch 222/287 2024-09-12T17:08:28.648 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : jakarta-annotations-1.3.5-13.el9.noarch 223/287 2024-09-12T17:08:28.683 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : jansi-2.3.3-6.el9.x86_64 224/287 2024-09-12T17:08:28.719 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : jsoup-1.13.1-10.el9.noarch 225/287 2024-09-12T17:08:28.759 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : maven-wagon-3.4.2-7.el9.noarch 226/287 2024-09-12T17:08:28.810 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : maven-resolver-1:1.6.1-10.el9.noarch 227/287 2024-09-12T17:08:28.854 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : jsr-305-3.0.2-6.el9.noarch 228/287 2024-09-12T17:08:28.884 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : guava-30.1-6.el9.noarch 229/287 2024-09-12T17:08:28.916 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : google-guice-4.2.3-9.el9.noarch 230/287 2024-09-12T17:08:28.973 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : plexus-interpolation-1.26-11.el9.noarch 231/287 2024-09-12T17:08:29.001 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : maven-lib-1:3.6.3-15.el9.noarch 232/287 2024-09-12T17:08:29.043 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libpciaccess-0.16-7.el9.x86_64 233/287 2024-09-12T17:08:29.078 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libdrm-2.4.121-1.el9.x86_64 234/287 2024-09-12T17:08:29.103 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libglvnd-egl-1:1.3.4-1.el9.x86_64 235/287 2024-09-12T17:08:29.280 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : mesa-libglapi-24.1.2-3.el9.x86_64 236/287 2024-09-12T17:08:29.312 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : mesa-dri-drivers-24.1.2-3.el9.x86_64 237/287 2024-09-12T17:08:29.347 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : mesa-libgbm-24.1.2-3.el9.x86_64 238/287 2024-09-12T17:08:29.391 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : mesa-libEGL-24.1.2-3.el9.x86_64 239/287 2024-09-12T17:08:29.423 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libglvnd-glx-1:1.3.4-1.el9.x86_64 240/287 2024-09-12T17:08:29.551 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : mesa-libGL-24.1.2-3.el9.x86_64 241/287 2024-09-12T17:08:29.607 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : gstreamer1-plugins-base-1.22.1-2.el9.x86_64 242/287 2024-09-12T17:08:29.678 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libtracker-sparql-3.1.2-3.el9.x86_64 243/287 2024-09-12T17:08:29.711 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : tracker-3.1.2-3.el9.x86_64 244/287 2024-09-12T17:08:29.827 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: tracker-3.1.2-3.el9.x86_64 244/287 2024-09-12T17:08:29.874 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : tracker-miners-3.1.2-4.el9.x86_64 245/287 2024-09-12T17:08:29.898 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: tracker-miners-3.1.2-4.el9.x86_64 245/287 2024-09-12T17:08:29.936 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : bubblewrap-0.4.1-7.el9.x86_64 246/287 2024-09-12T17:08:29.959 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : bluez-libs-5.56-6.el9.x86_64 247/287 2024-09-12T17:08:30.418 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: pipewire-1.0.1-1.el9.x86_64 248/287 2024-09-12T17:08:30.446 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : pipewire-1.0.1-1.el9.x86_64 248/287 2024-09-12T17:08:30.463 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: pipewire-1.0.1-1.el9.x86_64 248/287 2024-09-12T17:08:30.463 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/user/sockets.target.wants/pipewire.socket → /usr/lib/systemd/user/pipewire.socket. 2024-09-12T17:08:30.463 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:08:30.717 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : pipewire-libs-1.0.1-1.el9.x86_64 249/287 2024-09-12T17:08:30.795 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : wireplumber-0.4.14-1.el9.x86_64 250/287 2024-09-12T17:08:30.847 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : wireplumber-libs-0.4.14-1.el9.x86_64 251/287 2024-09-12T17:08:30.884 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : pipewire-jack-audio-connection-kit-libs-1.0.1-1. 252/287 2024-09-12T17:08:30.908 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ModemManager-glib-1.20.2-1.el9.x86_64 253/287 2024-09-12T17:08:31.317 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: geoclue2-2.6.0-7.el9.x86_64 254/287 2024-09-12T17:08:31.353 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : geoclue2-2.6.0-7.el9.x86_64 254/287 2024-09-12T17:08:31.370 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: geoclue2-2.6.0-7.el9.x86_64 254/287 2024-09-12T17:08:31.883 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: flatpak-1.12.9-1.el9.x86_64 255/287 2024-09-12T17:08:31.969 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : flatpak-1.12.9-1.el9.x86_64 255/287 2024-09-12T17:08:32.028 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : xdg-desktop-portal-1.12.6-1.el9.x86_64 256/287 2024-09-12T17:08:32.058 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: xdg-desktop-portal-1.12.6-1.el9.x86_64 256/287 2024-09-12T17:08:32.265 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libcanberra-gtk3-0.30-27.el9.x86_64 257/287 2024-09-12T17:08:32.329 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : gtk3-3.24.31-5.el9.x86_64 258/287 2024-09-12T17:08:32.369 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 259/287 2024-09-12T17:08:32.392 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 259/287 2024-09-12T17:08:32.420 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 260/287 2024-09-12T17:08:32.493 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 260/287 2024-09-12T17:08:32.523 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 261/287 2024-09-12T17:08:32.534 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 261/287 2024-09-12T17:08:32.565 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : maven-1:3.6.3-15.el9.noarch 262/287 2024-09-12T17:08:32.585 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: maven-1:3.6.3-15.el9.noarch 262/287 2024-09-12T17:08:32.615 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : maven-openjdk11-1:3.6.3-15.el9.noarch 263/287 2024-09-12T17:08:33.066 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: cephadm-2:19.3.0-4762.gbad475c1.el9.noarch 264/287 2024-09-12T17:08:33.097 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : cephadm-2:19.3.0-4762.gbad475c1.el9.noarch 264/287 2024-09-12T17:08:33.131 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4762.gbad475c1.e 265/287 2024-09-12T17:08:33.210 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4762.gbad475c1. 266/287 2024-09-12T17:08:33.238 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4762.gbad475c1.el9.noa 267/287 2024-09-12T17:08:33.273 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: flatpak-selinux-1.12.9-1.el9.noarch 176/287 2024-09-12T17:08:33.321 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : fdk-aac-free-2.0.0-8.el9.x86_64 177/287 2024-09-12T17:08:33.357 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 178/287 2024-09-12T17:08:33.410 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : composefs-libs-1.0.5-1.el9.x86_64 179/287 2024-09-12T17:08:33.440 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ostree-libs-2024.7-2.el9.x86_64 180/287 2024-09-12T17:08:33.476 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 181/287 2024-09-12T17:08:33.994 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 182/287 2024-09-12T17:08:34.020 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : librgw2-2:19.3.0-4762.gbad475c1.el9.x86_64 183/287 2024-09-12T17:08:34.101 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: librgw2-2:19.3.0-4762.gbad475c1.el9.x86_64 183/287 2024-09-12T17:08:34.139 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-rgw-2:19.3.0-4762.gbad475c1.el9.x86_64 184/287 2024-09-12T17:08:36.611 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-common-2:19.3.0-4762.gbad475c1.el9.x86_64 185/287 2024-09-12T17:08:36.656 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-common-2:19.3.0-4762.gbad475c1.el9.x86_64 185/287 2024-09-12T17:08:36.658 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4762.gbad475c1.el9.noa 267/287 2024-09-12T17:08:36.719 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4762.gbad475c1.el9.n 268/287 2024-09-12T17:08:37.251 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-common-2:19.3.0-4762.gbad475c1.el9.x86_64 185/287 2024-09-12T17:08:37.293 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-base-2:19.3.0-4762.gbad475c1.el9.x86_64 186/287 2024-09-12T17:08:37.387 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-base-2:19.3.0-4762.gbad475c1.el9.x86_64 186/287 2024-09-12T17:08:37.387 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-12T17:08:37.387 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-12T17:08:37.387 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-12T17:08:37.419 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-selinux-2:19.3.0-4762.gbad475c1.el9.x86_64 187/287 2024-09-12T17:08:37.735 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4762.gbad475c1.el9.n 268/287 2024-09-12T17:08:37.760 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4762.gbad 269/287 2024-09-12T17:08:37.883 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4762.gbad 269/287 2024-09-12T17:08:38.055 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4762.gbad475c1.el 270/287 2024-09-12T17:08:38.087 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-2:19.3.0-4762.gbad475c1.el9.x86_64 271/287 2024-09-12T17:08:38.113 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4762.gbad475c1.el9.x86_64 271/287 2024-09-12T17:08:38.113 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T17:08:38.113 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-12T17:08:38.113 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T17:08:38.113 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T17:08:38.113 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:08:38.171 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-rook-2:19.3.0-4762.gbad475c1.el9.noarch 272/287 2024-09-12T17:08:38.184 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4762.gbad475c1.el9.noarch 272/287 2024-09-12T17:08:38.206 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-2:19.3.0-4762.gbad475c1.el9.x86_64 273/287 2024-09-12T17:08:38.235 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : pipewire-jack-audio-connection-kit-1.0.1-1.el9.x 274/287 2024-09-12T17:08:38.285 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : pipewire-alsa-1.0.1-1.el9.x86_64 275/287 2024-09-12T17:08:38.315 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : pipewire-pulseaudio-1.0.1-1.el9.x86_64 276/287 2024-09-12T17:08:38.332 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: pipewire-pulseaudio-1.0.1-1.el9.x86_64 276/287 2024-09-12T17:08:38.332 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/user/sockets.target.wants/pipewire-pulse.socket → /usr/lib/systemd/user/pipewire-pulse.socket. 2024-09-12T17:08:38.332 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:08:39.451 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-radosgw-2:19.3.0-4762.gbad475c1.el9.x86_64 277/287 2024-09-12T17:08:39.478 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4762.gbad475c1.el9.x86_64 277/287 2024-09-12T17:08:39.479 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T17:08:39.479 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-12T17:08:39.479 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T17:08:39.479 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T17:08:39.479 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:08:39.519 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4762.gbad47 278/287 2024-09-12T17:08:39.543 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4762.gbad47 278/287 2024-09-12T17:08:39.544 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T17:08:39.544 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-12T17:08:39.544 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:08:39.879 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : rbd-mirror-2:19.3.0-4762.gbad475c1.el9.x86_64 279/287 2024-09-12T17:08:39.904 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4762.gbad475c1.el9.x86_64 279/287 2024-09-12T17:08:39.904 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T17:08:39.905 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-12T17:08:39.905 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T17:08:39.905 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T17:08:39.905 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:08:44.441 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-test-2:19.3.0-4762.gbad475c1.el9.x86_64 280/287 2024-09-12T17:08:44.482 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : rbd-fuse-2:19.3.0-4762.gbad475c1.el9.x86_64 281/287 2024-09-12T17:08:44.514 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : rbd-nbd-2:19.3.0-4762.gbad475c1.el9.x86_64 282/287 2024-09-12T17:08:44.631 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libcephfs-devel-2:19.3.0-4762.gbad475c1.el9.x86_ 283/287 2024-09-12T17:08:44.701 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-fuse-2:19.3.0-4762.gbad475c1.el9.x86_64 284/287 2024-09-12T17:08:44.738 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : s3cmd-2.4.0-1.el9.noarch 285/287 2024-09-12T17:08:44.739 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 286/287 2024-09-12T17:08:44.839 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 286/287 2024-09-12T17:08:44.839 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 287/287 2024-09-12T17:08:44.930 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 287/287 2024-09-12T17:08:44.950 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: dconf-0.40.0-6.el9.x86_64 287/287 2024-09-12T17:08:44.957 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: copy-jdk-configs-4.0-3.el9.noarch 287/287 2024-09-12T17:08:44.967 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 287/287 2024-09-12T17:08:44.978 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: wireplumber-0.4.14-1.el9.x86_64 287/287 2024-09-12T17:08:44.978 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/user/pipewire-session-manager.service → /usr/lib/systemd/user/wireplumber.service. 2024-09-12T17:08:44.979 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/user/pipewire.service.wants/wireplumber.service → /usr/lib/systemd/user/wireplumber.service. 2024-09-12T17:08:44.979 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:08:45.047 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 287/287 2024-09-12T17:08:45.120 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 287/287 2024-09-12T17:08:47.160 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4762.gbad475c1.el9.x86_64 187/287 2024-09-12T17:08:47.160 INFO:teuthology.orchestra.run.smithi040.stdout:skipping the directory /sys 2024-09-12T17:08:47.161 INFO:teuthology.orchestra.run.smithi040.stdout:skipping the directory /proc 2024-09-12T17:08:47.161 INFO:teuthology.orchestra.run.smithi040.stdout:skipping the directory /mnt 2024-09-12T17:08:47.161 INFO:teuthology.orchestra.run.smithi040.stdout:skipping the directory /var/tmp 2024-09-12T17:08:47.161 INFO:teuthology.orchestra.run.smithi040.stdout:skipping the directory /home 2024-09-12T17:08:47.161 INFO:teuthology.orchestra.run.smithi040.stdout:skipping the directory /root 2024-09-12T17:08:47.161 INFO:teuthology.orchestra.run.smithi040.stdout:skipping the directory /tmp 2024-09-12T17:08:47.161 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-12T17:08:47.342 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-volume-2:19.3.0-4762.gbad475c1.el9.noarch 188/287 2024-09-12T17:08:47.359 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-volume-2:19.3.0-4762.gbad475c1.el9.noarch 188/287 2024-09-12T17:08:47.359 INFO:teuthology.orchestra.run.smithi040.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T17:08:47.359 INFO:teuthology.orchestra.run.smithi040.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-12T17:08:47.359 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-12T17:08:48.901 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-osd-2:19.3.0-4762.gbad475c1.el9.x86_64 189/287 2024-09-12T17:08:48.930 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-osd-2:19.3.0-4762.gbad475c1.el9.x86_64 189/287 2024-09-12T17:08:48.930 INFO:teuthology.orchestra.run.smithi040.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T17:08:48.930 INFO:teuthology.orchestra.run.smithi040.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-12T17:08:48.930 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T17:08:48.930 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T17:08:48.930 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-12T17:08:49.169 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-mds-2:19.3.0-4762.gbad475c1.el9.x86_64 190/287 2024-09-12T17:08:49.194 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-mds-2:19.3.0-4762.gbad475c1.el9.x86_64 190/287 2024-09-12T17:08:49.194 INFO:teuthology.orchestra.run.smithi040.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T17:08:49.194 INFO:teuthology.orchestra.run.smithi040.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-12T17:08:49.194 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T17:08:49.194 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T17:08:49.195 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-12T17:08:49.661 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-mon-2:19.3.0-4762.gbad475c1.el9.x86_64 191/287 2024-09-12T17:08:49.686 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-mon-2:19.3.0-4762.gbad475c1.el9.x86_64 191/287 2024-09-12T17:08:49.686 INFO:teuthology.orchestra.run.smithi040.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T17:08:49.686 INFO:teuthology.orchestra.run.smithi040.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-12T17:08:49.686 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T17:08:49.686 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T17:08:49.686 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-12T17:08:49.792 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : avahi-glib-0.8-21.el9.x86_64 192/287 2024-09-12T17:08:52.859 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : adwaita-cursor-theme-40.1.1-3.el9.noarch 193/287 2024-09-12T17:08:52.972 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : adwaita-icon-theme-40.1.1-3.el9.noarch 194/287 2024-09-12T17:08:53.038 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-ply-3.11-14.el9.noarch 195/287 2024-09-12T17:08:53.103 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 196/287 2024-09-12T17:08:53.310 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 197/287 2024-09-12T17:08:53.358 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 198/287 2024-09-12T17:08:53.439 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 199/287 2024-09-12T17:08:53.530 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 200/287 2024-09-12T17:08:53.671 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 201/287 2024-09-12T17:08:53.716 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 202/287 2024-09-12T17:08:53.755 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 203/287 2024-09-12T17:08:54.668 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 204/287 2024-09-12T17:08:54.714 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 205/287 2024-09-12T17:08:55.098 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 205/287 2024-09-12T17:08:55.138 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : plexus-utils-3.3.0-10.el9.noarch 206/287 2024-09-12T17:08:55.168 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : slf4j-1.7.30-13.el9.noarch 207/287 2024-09-12T17:08:55.196 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : atinject-1.0.3-6.el9.noarch 208/287 2024-09-12T17:08:55.231 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : apache-commons-io-1:2.8.0-8.el9.noarch 209/287 2024-09-12T17:08:55.268 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : apache-commons-lang3-3.12.0-6.el9.noarch 210/287 2024-09-12T17:08:55.295 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : httpcomponents-core-4.4.13-7.el9.noarch 211/287 2024-09-12T17:08:55.307 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 287/287 2024-09-12T17:08:55.307 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-2:19.3.0-4762.gbad475c1.el9.x86_64 1/287 2024-09-12T17:08:55.307 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-base-2:19.3.0-4762.gbad475c1.el9.x86_64 2/287 2024-09-12T17:08:55.307 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-common-2:19.3.0-4762.gbad475c1.el9.x86_64 3/287 2024-09-12T17:08:55.307 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-fuse-2:19.3.0-4762.gbad475c1.el9.x86_64 4/287 2024-09-12T17:08:55.307 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4762.gbad47 5/287 2024-09-12T17:08:55.307 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mds-2:19.3.0-4762.gbad475c1.el9.x86_64 6/287 2024-09-12T17:08:55.307 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-2:19.3.0-4762.gbad475c1.el9.x86_64 7/287 2024-09-12T17:08:55.307 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mon-2:19.3.0-4762.gbad475c1.el9.x86_64 8/287 2024-09-12T17:08:55.307 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-osd-2:19.3.0-4762.gbad475c1.el9.x86_64 9/287 2024-09-12T17:08:55.307 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-radosgw-2:19.3.0-4762.gbad475c1.el9.x86_64 10/287 2024-09-12T17:08:55.308 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-selinux-2:19.3.0-4762.gbad475c1.el9.x86_64 11/287 2024-09-12T17:08:55.308 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-test-2:19.3.0-4762.gbad475c1.el9.x86_64 12/287 2024-09-12T17:08:55.308 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libcephfs-devel-2:19.3.0-4762.gbad475c1.el9.x86_ 13/287 2024-09-12T17:08:55.308 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libcephfs2-2:19.3.0-4762.gbad475c1.el9.x86_64 14/287 2024-09-12T17:08:55.308 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libcephsqlite-2:19.3.0-4762.gbad475c1.el9.x86_64 15/287 2024-09-12T17:08:55.308 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librados-devel-2:19.3.0-4762.gbad475c1.el9.x86_6 16/287 2024-09-12T17:08:55.308 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libradosstriper1-2:19.3.0-4762.gbad475c1.el9.x86 17/287 2024-09-12T17:08:55.308 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librgw2-2:19.3.0-4762.gbad475c1.el9.x86_64 18/287 2024-09-12T17:08:55.308 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4762.gbad475c1.el 19/287 2024-09-12T17:08:55.309 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-ceph-common-2:19.3.0-4762.gbad475c1.el9. 20/287 2024-09-12T17:08:55.309 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cephfs-2:19.3.0-4762.gbad475c1.el9.x86_6 21/287 2024-09-12T17:08:55.309 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-rados-2:19.3.0-4762.gbad475c1.el9.x86_64 22/287 2024-09-12T17:08:55.309 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-rbd-2:19.3.0-4762.gbad475c1.el9.x86_64 23/287 2024-09-12T17:08:55.309 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-rgw-2:19.3.0-4762.gbad475c1.el9.x86_64 24/287 2024-09-12T17:08:55.309 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : rbd-fuse-2:19.3.0-4762.gbad475c1.el9.x86_64 25/287 2024-09-12T17:08:55.309 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : rbd-mirror-2:19.3.0-4762.gbad475c1.el9.x86_64 26/287 2024-09-12T17:08:55.309 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : rbd-nbd-2:19.3.0-4762.gbad475c1.el9.x86_64 27/287 2024-09-12T17:08:55.309 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4762.gbad475c1. 28/287 2024-09-12T17:08:55.309 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4762.gbad475c1.el9.noa 29/287 2024-09-12T17:08:55.331 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : plexus-cipher-1.7-27.el9.noarch 212/287 2024-09-12T17:08:55.333 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4762.gbad475c1.el9.n 30/287 2024-09-12T17:08:55.334 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4762.gbad 31/287 2024-09-12T17:08:55.334 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4762.gbad475c1.el 32/287 2024-09-12T17:08:55.334 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4762.gbad475c1.el9.noarch 33/287 2024-09-12T17:08:55.334 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4762.gbad475c1.e 34/287 2024-09-12T17:08:55.334 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-volume-2:19.3.0-4762.gbad475c1.el9.noarch 35/287 2024-09-12T17:08:55.334 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : cephadm-2:19.3.0-4762.gbad475c1.el9.noarch 36/287 2024-09-12T17:08:55.334 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ModemManager-glib-1.20.2-1.el9.x86_64 37/287 2024-09-12T17:08:55.334 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : bluez-libs-5.56-6.el9.x86_64 38/287 2024-09-12T17:08:55.334 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : bubblewrap-0.4.1-7.el9.x86_64 39/287 2024-09-12T17:08:55.334 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : cups-libs-1:2.3.3op2-30.el9.x86_64 40/287 2024-09-12T17:08:55.334 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 41/287 2024-09-12T17:08:55.334 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 42/287 2024-09-12T17:08:55.335 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libpciaccess-0.16-7.el9.x86_64 43/287 2024-09-12T17:08:55.335 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 44/287 2024-09-12T17:08:55.335 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 45/287 2024-09-12T17:08:55.335 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 46/287 2024-09-12T17:08:55.335 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 47/287 2024-09-12T17:08:55.335 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-ply-3.11-14.el9.noarch 48/287 2024-09-12T17:08:55.335 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 49/287 2024-09-12T17:08:55.335 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 50/287 2024-09-12T17:08:55.335 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 51/287 2024-09-12T17:08:55.335 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : adwaita-cursor-theme-40.1.1-3.el9.noarch 52/287 2024-09-12T17:08:55.335 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : adwaita-icon-theme-40.1.1-3.el9.noarch 53/287 2024-09-12T17:08:55.335 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : alsa-lib-1.2.12-1.el9.x86_64 54/287 2024-09-12T17:08:55.336 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : apache-commons-cli-1.4-17.el9.noarch 55/287 2024-09-12T17:08:55.336 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : apache-commons-codec-1.15-7.el9.noarch 56/287 2024-09-12T17:08:55.336 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : apache-commons-io-1:2.8.0-8.el9.noarch 57/287 2024-09-12T17:08:55.336 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : apache-commons-lang3-3.12.0-6.el9.noarch 58/287 2024-09-12T17:08:55.336 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : at-spi2-atk-2.38.0-4.el9.x86_64 59/287 2024-09-12T17:08:55.336 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : at-spi2-core-2.40.3-1.el9.x86_64 60/287 2024-09-12T17:08:55.336 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : atinject-1.0.3-6.el9.noarch 61/287 2024-09-12T17:08:55.336 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : atk-2.36.0-5.el9.x86_64 62/287 2024-09-12T17:08:55.336 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : avahi-glib-0.8-21.el9.x86_64 63/287 2024-09-12T17:08:55.336 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 64/287 2024-09-12T17:08:55.336 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : cdi-api-2.0.2-6.el9.noarch 65/287 2024-09-12T17:08:55.336 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : colord-libs-1.4.5-4.el9.x86_64 66/287 2024-09-12T17:08:55.337 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : composefs-libs-1.0.5-1.el9.x86_64 67/287 2024-09-12T17:08:55.337 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : copy-jdk-configs-4.0-3.el9.noarch 68/287 2024-09-12T17:08:55.337 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : dconf-0.40.0-6.el9.x86_64 69/287 2024-09-12T17:08:55.337 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 70/287 2024-09-12T17:08:55.337 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : exiv2-0.27.5-2.el9.x86_64 71/287 2024-09-12T17:08:55.337 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : exiv2-libs-0.27.5-2.el9.x86_64 72/287 2024-09-12T17:08:55.337 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : fdk-aac-free-2.0.0-8.el9.x86_64 73/287 2024-09-12T17:08:55.337 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : flac-libs-1.3.3-12.el9.x86_64 74/287 2024-09-12T17:08:55.337 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : flatpak-1.12.9-1.el9.x86_64 75/287 2024-09-12T17:08:55.337 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : flatpak-selinux-1.12.9-1.el9.noarch 76/287 2024-09-12T17:08:55.337 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : flatpak-session-helper-1.12.9-1.el9.x86_64 77/287 2024-09-12T17:08:55.337 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 78/287 2024-09-12T17:08:55.337 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 79/287 2024-09-12T17:08:55.337 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 80/287 2024-09-12T17:08:55.338 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : gdk-pixbuf2-modules-2.42.6-4.el9.x86_64 81/287 2024-09-12T17:08:55.338 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : geoclue2-2.6.0-7.el9.x86_64 82/287 2024-09-12T17:08:55.338 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : giflib-5.2.1-9.el9.x86_64 83/287 2024-09-12T17:08:55.338 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : google-guice-4.2.3-9.el9.noarch 84/287 2024-09-12T17:08:55.338 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : graphene-1.10.6-2.el9.x86_64 85/287 2024-09-12T17:08:55.338 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : gsm-1.0.19-6.el9.x86_64 86/287 2024-09-12T17:08:55.338 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : gstreamer1-1.22.1-2.el9.x86_64 87/287 2024-09-12T17:08:55.338 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : gstreamer1-plugins-base-1.22.1-2.el9.x86_64 88/287 2024-09-12T17:08:55.339 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : gtk-update-icon-cache-3.24.31-5.el9.x86_64 89/287 2024-09-12T17:08:55.339 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : gtk3-3.24.31-5.el9.x86_64 90/287 2024-09-12T17:08:55.339 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : guava-30.1-6.el9.noarch 91/287 2024-09-12T17:08:55.339 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : hicolor-icon-theme-0.17-13.el9.noarch 92/287 2024-09-12T17:08:55.339 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : httpcomponents-client-4.5.13-3.el9.noarch 93/287 2024-09-12T17:08:55.339 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : httpcomponents-core-4.4.13-7.el9.noarch 94/287 2024-09-12T17:08:55.339 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : iso-codes-4.6.0-3.el9.noarch 95/287 2024-09-12T17:08:55.339 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : jakarta-annotations-1.3.5-13.el9.noarch 96/287 2024-09-12T17:08:55.339 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : jansi-2.3.3-6.el9.x86_64 97/287 2024-09-12T17:08:55.339 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 98/287 2024-09-12T17:08:55.339 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 99/287 2024-09-12T17:08:55.339 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 100/287 2024-09-12T17:08:55.339 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : javapackages-filesystem-6.0.0-4.el9.noarch 101/287 2024-09-12T17:08:55.340 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : jbigkit-libs-2.1-23.el9.x86_64 102/287 2024-09-12T17:08:55.340 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : jcl-over-slf4j-1.7.30-13.el9.noarch 103/287 2024-09-12T17:08:55.340 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : jsoup-1.13.1-10.el9.noarch 104/287 2024-09-12T17:08:55.340 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : jsr-305-3.0.2-6.el9.noarch 105/287 2024-09-12T17:08:55.340 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : lcms2-2.12-3.el9.x86_64 106/287 2024-09-12T17:08:55.340 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libX11-xcb-1.7.0-9.el9.x86_64 107/287 2024-09-12T17:08:55.340 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libXcomposite-0.4.5-7.el9.x86_64 108/287 2024-09-12T17:08:55.340 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libXcursor-1.2.0-7.el9.x86_64 109/287 2024-09-12T17:08:55.340 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libXdamage-1.1.5-7.el9.x86_64 110/287 2024-09-12T17:08:55.340 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libXfixes-5.0.3-16.el9.x86_64 111/287 2024-09-12T17:08:55.340 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libXi-1.7.10-8.el9.x86_64 112/287 2024-09-12T17:08:55.340 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libXinerama-1.1.4-10.el9.x86_64 113/287 2024-09-12T17:08:55.340 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libXrandr-1.5.2-8.el9.x86_64 114/287 2024-09-12T17:08:55.341 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libXtst-1.2.3-16.el9.x86_64 115/287 2024-09-12T17:08:55.341 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libXv-1.0.11-16.el9.x86_64 116/287 2024-09-12T17:08:55.341 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libXxf86vm-1.1.4-18.el9.x86_64 117/287 2024-09-12T17:08:55.341 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libasyncns-0.8-22.el9.x86_64 118/287 2024-09-12T17:08:55.341 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libcanberra-0.30-27.el9.x86_64 119/287 2024-09-12T17:08:55.341 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libcanberra-gtk3-0.30-27.el9.x86_64 120/287 2024-09-12T17:08:55.341 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libdrm-2.4.121-1.el9.x86_64 121/287 2024-09-12T17:08:55.341 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libepoxy-1.5.5-4.el9.x86_64 122/287 2024-09-12T17:08:55.341 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libexif-0.6.22-6.el9.x86_64 123/287 2024-09-12T17:08:55.341 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libfontenc-1.1.3-17.el9.x86_64 124/287 2024-09-12T17:08:55.341 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libgexiv2-0.12.3-1.el9.x86_64 125/287 2024-09-12T17:08:55.341 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libglvnd-1:1.3.4-1.el9.x86_64 126/287 2024-09-12T17:08:55.341 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libglvnd-egl-1:1.3.4-1.el9.x86_64 127/287 2024-09-12T17:08:55.341 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libglvnd-glx-1:1.3.4-1.el9.x86_64 128/287 2024-09-12T17:08:55.342 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libgsf-1.14.47-5.el9.x86_64 129/287 2024-09-12T17:08:55.342 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libgxps-0.3.2-3.el9.x86_64 130/287 2024-09-12T17:08:55.342 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libiptcdata-1.0.5-10.el9.x86_64 131/287 2024-09-12T17:08:55.342 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libldac-2.0.2.3-10.el9.x86_64 132/287 2024-09-12T17:08:55.342 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libnotify-0.7.9-8.el9.x86_64 133/287 2024-09-12T17:08:55.342 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libogg-2:1.3.4-6.el9.x86_64 134/287 2024-09-12T17:08:55.342 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libosinfo-1.10.0-1.el9.x86_64 135/287 2024-09-12T17:08:55.342 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 136/287 2024-09-12T17:08:55.342 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 137/287 2024-09-12T17:08:55.342 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 138/287 2024-09-12T17:08:55.342 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libsbc-1.4-9.el9.x86_64 139/287 2024-09-12T17:08:55.342 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libsndfile-1.0.31-8.el9.x86_64 140/287 2024-09-12T17:08:55.342 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libtheora-1:1.1.1-31.el9.x86_64 141/287 2024-09-12T17:08:55.343 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libtiff-4.4.0-13.el9.x86_64 142/287 2024-09-12T17:08:55.343 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libtool-ltdl-2.4.6-46.el9.x86_64 143/287 2024-09-12T17:08:55.343 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libtracker-sparql-3.1.2-3.el9.x86_64 144/287 2024-09-12T17:08:55.343 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libvisual-1:0.4.0-34.el9.x86_64 145/287 2024-09-12T17:08:55.343 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libvorbis-1:1.3.7-5.el9.x86_64 146/287 2024-09-12T17:08:55.343 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libwayland-client-1.21.0-1.el9.x86_64 147/287 2024-09-12T17:08:55.343 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libwayland-cursor-1.21.0-1.el9.x86_64 148/287 2024-09-12T17:08:55.343 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libwayland-egl-1.21.0-1.el9.x86_64 149/287 2024-09-12T17:08:55.343 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libwayland-server-1.21.0-1.el9.x86_64 150/287 2024-09-12T17:08:55.343 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libwebp-1.2.0-8.el9.x86_64 151/287 2024-09-12T17:08:55.343 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libxkbcommon-1.0.3-4.el9.x86_64 152/287 2024-09-12T17:08:55.343 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libxshmfence-1.3-10.el9.x86_64 153/287 2024-09-12T17:08:55.343 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : low-memory-monitor-2.1-4.el9.x86_64 154/287 2024-09-12T17:08:55.344 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 155/287 2024-09-12T17:08:55.344 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : lua-5.4.4-4.el9.x86_64 156/287 2024-09-12T17:08:55.344 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : lua-posix-35.0-8.el9.x86_64 157/287 2024-09-12T17:08:55.344 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : maven-1:3.6.3-15.el9.noarch 158/287 2024-09-12T17:08:55.344 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : maven-lib-1:3.6.3-15.el9.noarch 159/287 2024-09-12T17:08:55.344 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : maven-openjdk11-1:3.6.3-15.el9.noarch 160/287 2024-09-12T17:08:55.344 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : maven-resolver-1:1.6.1-10.el9.noarch 161/287 2024-09-12T17:08:55.344 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : maven-shared-utils-3.3.4-3.el9.noarch 162/287 2024-09-12T17:08:55.344 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : maven-wagon-3.4.2-7.el9.noarch 163/287 2024-09-12T17:08:55.344 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : mesa-dri-drivers-24.1.2-3.el9.x86_64 164/287 2024-09-12T17:08:55.344 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : mesa-filesystem-24.1.2-3.el9.x86_64 165/287 2024-09-12T17:08:55.345 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : mesa-libEGL-24.1.2-3.el9.x86_64 166/287 2024-09-12T17:08:55.345 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : mesa-libGL-24.1.2-3.el9.x86_64 167/287 2024-09-12T17:08:55.345 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : mesa-libgbm-24.1.2-3.el9.x86_64 168/287 2024-09-12T17:08:55.345 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : mesa-libglapi-24.1.2-3.el9.x86_64 169/287 2024-09-12T17:08:55.345 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : mkfontscale-1.2.1-3.el9.x86_64 170/287 2024-09-12T17:08:55.345 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 171/287 2024-09-12T17:08:55.345 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 172/287 2024-09-12T17:08:55.345 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : openjpeg2-2.4.0-7.el9.x86_64 173/287 2024-09-12T17:08:55.345 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : opus-1.3.1-10.el9.x86_64 174/287 2024-09-12T17:08:55.345 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : orc-0.4.31-8.el9.x86_64 175/287 2024-09-12T17:08:55.345 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : osinfo-db-20240701-2.el9.noarch 176/287 2024-09-12T17:08:55.345 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : osinfo-db-tools-1.10.0-1.el9.x86_64 177/287 2024-09-12T17:08:55.345 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ostree-libs-2024.7-2.el9.x86_64 178/287 2024-09-12T17:08:55.346 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : p11-kit-server-0.25.3-2.el9.x86_64 179/287 2024-09-12T17:08:55.346 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : pipewire-1.0.1-1.el9.x86_64 180/287 2024-09-12T17:08:55.346 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : pipewire-alsa-1.0.1-1.el9.x86_64 181/287 2024-09-12T17:08:55.346 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : pipewire-jack-audio-connection-kit-1.0.1-1.el9.x 182/287 2024-09-12T17:08:55.346 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : pipewire-jack-audio-connection-kit-libs-1.0.1-1. 183/287 2024-09-12T17:08:55.346 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : pipewire-libs-1.0.1-1.el9.x86_64 184/287 2024-09-12T17:08:55.346 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : pipewire-pulseaudio-1.0.1-1.el9.x86_64 185/287 2024-09-12T17:08:55.346 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : plexus-cipher-1.7-27.el9.noarch 186/287 2024-09-12T17:08:55.346 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : plexus-classworlds-2.6.0-11.el9.noarch 187/287 2024-09-12T17:08:55.346 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : plexus-containers-component-annotations-2.1.0-10 188/287 2024-09-12T17:08:55.346 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : plexus-interpolation-1.26-11.el9.noarch 189/287 2024-09-12T17:08:55.346 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : plexus-sec-dispatcher-1.4-37.el9.noarch 190/287 2024-09-12T17:08:55.346 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : plexus-utils-3.3.0-10.el9.noarch 191/287 2024-09-12T17:08:55.346 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : poppler-21.01.0-21.el9.x86_64 192/287 2024-09-12T17:08:55.347 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : poppler-data-0.4.9-9.el9.noarch 193/287 2024-09-12T17:08:55.347 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : poppler-glib-21.01.0-21.el9.x86_64 194/287 2024-09-12T17:08:55.347 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 195/287 2024-09-12T17:08:55.347 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : publicsuffix-list-20210518-3.el9.noarch 196/287 2024-09-12T17:08:55.347 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : pulseaudio-libs-15.0-2.el9.x86_64 197/287 2024-09-12T17:08:55.347 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 198/287 2024-09-12T17:08:55.347 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 199/287 2024-09-12T17:08:55.347 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 200/287 2024-09-12T17:08:55.347 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 201/287 2024-09-12T17:08:55.347 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 202/287 2024-09-12T17:08:55.347 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 203/287 2024-09-12T17:08:55.347 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 204/287 2024-09-12T17:08:55.347 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 205/287 2024-09-12T17:08:55.348 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 206/287 2024-09-12T17:08:55.348 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 207/287 2024-09-12T17:08:55.348 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 208/287 2024-09-12T17:08:55.348 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 209/287 2024-09-12T17:08:55.348 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 210/287 2024-09-12T17:08:55.348 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 211/287 2024-09-12T17:08:55.348 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 212/287 2024-09-12T17:08:55.348 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 213/287 2024-09-12T17:08:55.348 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 214/287 2024-09-12T17:08:55.348 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 215/287 2024-09-12T17:08:55.348 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 216/287 2024-09-12T17:08:55.348 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 217/287 2024-09-12T17:08:55.348 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 218/287 2024-09-12T17:08:55.348 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 219/287 2024-09-12T17:08:55.349 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : rtkit-0.11-29.el9.x86_64 220/287 2024-09-12T17:08:55.349 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : sisu-1:0.3.4-10.el9.noarch 221/287 2024-09-12T17:08:55.349 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : slf4j-1.7.30-13.el9.noarch 222/287 2024-09-12T17:08:55.349 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 223/287 2024-09-12T17:08:55.349 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : sound-theme-freedesktop-0.8-17.el9.noarch 224/287 2024-09-12T17:08:55.349 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : totem-pl-parser-3.26.6-2.el9.x86_64 225/287 2024-09-12T17:08:55.349 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : tracker-3.1.2-3.el9.x86_64 226/287 2024-09-12T17:08:55.349 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : tracker-miners-3.1.2-4.el9.x86_64 227/287 2024-09-12T17:08:55.349 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ttmkfdir-3.0.9-65.el9.x86_64 228/287 2024-09-12T17:08:55.349 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : tzdata-java-2024a-2.el9.noarch 229/287 2024-09-12T17:08:55.349 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : upower-0.99.11-11.el9.x86_64 230/287 2024-09-12T17:08:55.349 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : webrtc-audio-processing-0.3.1-8.el9.x86_64 231/287 2024-09-12T17:08:55.349 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : wireplumber-0.4.14-1.el9.x86_64 232/287 2024-09-12T17:08:55.350 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : wireplumber-libs-0.4.14-1.el9.x86_64 233/287 2024-09-12T17:08:55.350 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : xdg-dbus-proxy-0.1.3-1.el9.x86_64 234/287 2024-09-12T17:08:55.350 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : xdg-desktop-portal-1.12.6-1.el9.x86_64 235/287 2024-09-12T17:08:55.350 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 236/287 2024-09-12T17:08:55.350 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : xkeyboard-config-2.33-2.el9.noarch 237/287 2024-09-12T17:08:55.350 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 238/287 2024-09-12T17:08:55.350 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : xorg-x11-fonts-Type1-7.5-33.el9.noarch 239/287 2024-09-12T17:08:55.350 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 240/287 2024-09-12T17:08:55.350 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 241/287 2024-09-12T17:08:55.350 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 242/287 2024-09-12T17:08:55.350 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 243/287 2024-09-12T17:08:55.350 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 244/287 2024-09-12T17:08:55.350 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 245/287 2024-09-12T17:08:55.351 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 246/287 2024-09-12T17:08:55.351 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 247/287 2024-09-12T17:08:55.351 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 248/287 2024-09-12T17:08:55.351 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 249/287 2024-09-12T17:08:55.351 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 250/287 2024-09-12T17:08:55.351 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 251/287 2024-09-12T17:08:55.351 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 252/287 2024-09-12T17:08:55.351 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 253/287 2024-09-12T17:08:55.351 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 254/287 2024-09-12T17:08:55.351 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 255/287 2024-09-12T17:08:55.351 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 256/287 2024-09-12T17:08:55.351 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 257/287 2024-09-12T17:08:55.351 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 258/287 2024-09-12T17:08:55.352 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 259/287 2024-09-12T17:08:55.352 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 260/287 2024-09-12T17:08:55.352 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 261/287 2024-09-12T17:08:55.352 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 262/287 2024-09-12T17:08:55.352 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 263/287 2024-09-12T17:08:55.352 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 264/287 2024-09-12T17:08:55.352 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 265/287 2024-09-12T17:08:55.352 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 266/287 2024-09-12T17:08:55.352 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 267/287 2024-09-12T17:08:55.352 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 268/287 2024-09-12T17:08:55.352 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 269/287 2024-09-12T17:08:55.352 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 270/287 2024-09-12T17:08:55.352 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 271/287 2024-09-12T17:08:55.352 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 272/287 2024-09-12T17:08:55.353 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 273/287 2024-09-12T17:08:55.353 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 274/287 2024-09-12T17:08:55.353 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 275/287 2024-09-12T17:08:55.353 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 276/287 2024-09-12T17:08:55.353 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 277/287 2024-09-12T17:08:55.353 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 278/287 2024-09-12T17:08:55.353 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 279/287 2024-09-12T17:08:55.353 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 280/287 2024-09-12T17:08:55.353 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : re2-1:20211101-20.el9.x86_64 281/287 2024-09-12T17:08:55.353 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : s3cmd-2.4.0-1.el9.noarch 282/287 2024-09-12T17:08:55.353 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 283/287 2024-09-12T17:08:55.353 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librados2-2:19.3.0-4762.gbad475c1.el9.x86_64 284/287 2024-09-12T17:08:55.353 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 285/287 2024-09-12T17:08:55.354 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librbd1-2:19.3.0-4762.gbad475c1.el9.x86_64 286/287 2024-09-12T17:08:55.355 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : plexus-classworlds-2.6.0-11.el9.noarch 213/287 2024-09-12T17:08:55.380 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : plexus-containers-component-annotations-2.1.0-10 214/287 2024-09-12T17:08:55.406 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : plexus-sec-dispatcher-1.4-37.el9.noarch 215/287 2024-09-12T17:08:55.432 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : maven-shared-utils-3.3.4-3.el9.noarch 216/287 2024-09-12T17:08:55.459 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : cdi-api-2.0.2-6.el9.noarch 217/287 2024-09-12T17:08:55.489 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : sisu-1:0.3.4-10.el9.noarch 218/287 2024-09-12T17:08:55.517 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : jcl-over-slf4j-1.7.30-13.el9.noarch 219/287 2024-09-12T17:08:55.552 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : apache-commons-cli-1.4-17.el9.noarch 220/287 2024-09-12T17:08:55.588 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : apache-commons-codec-1.15-7.el9.noarch 221/287 2024-09-12T17:08:55.743 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : httpcomponents-client-4.5.13-3.el9.noarch 222/287 2024-09-12T17:08:55.778 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : jakarta-annotations-1.3.5-13.el9.noarch 223/287 2024-09-12T17:08:55.813 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : jansi-2.3.3-6.el9.x86_64 224/287 2024-09-12T17:08:55.849 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : jsoup-1.13.1-10.el9.noarch 225/287 2024-09-12T17:08:55.897 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : maven-wagon-3.4.2-7.el9.noarch 226/287 2024-09-12T17:08:55.940 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : maven-resolver-1:1.6.1-10.el9.noarch 227/287 2024-09-12T17:08:55.983 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : jsr-305-3.0.2-6.el9.noarch 228/287 2024-09-12T17:08:56.014 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : guava-30.1-6.el9.noarch 229/287 2024-09-12T17:08:56.046 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : google-guice-4.2.3-9.el9.noarch 230/287 2024-09-12T17:08:56.101 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : plexus-interpolation-1.26-11.el9.noarch 231/287 2024-09-12T17:08:56.131 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : maven-lib-1:3.6.3-15.el9.noarch 232/287 2024-09-12T17:08:56.162 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libpciaccess-0.16-7.el9.x86_64 233/287 2024-09-12T17:08:56.199 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libdrm-2.4.121-1.el9.x86_64 234/287 2024-09-12T17:08:56.224 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libglvnd-egl-1:1.3.4-1.el9.x86_64 235/287 2024-09-12T17:08:56.400 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : mesa-libglapi-24.1.2-3.el9.x86_64 236/287 2024-09-12T17:08:56.433 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : mesa-dri-drivers-24.1.2-3.el9.x86_64 237/287 2024-09-12T17:08:56.460 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : mesa-libgbm-24.1.2-3.el9.x86_64 238/287 2024-09-12T17:08:56.487 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : mesa-libEGL-24.1.2-3.el9.x86_64 239/287 2024-09-12T17:08:56.520 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libglvnd-glx-1:1.3.4-1.el9.x86_64 240/287 2024-09-12T17:08:56.668 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : mesa-libGL-24.1.2-3.el9.x86_64 241/287 2024-09-12T17:08:56.728 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : gstreamer1-plugins-base-1.22.1-2.el9.x86_64 242/287 2024-09-12T17:08:56.798 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libtracker-sparql-3.1.2-3.el9.x86_64 243/287 2024-09-12T17:08:56.833 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : tracker-3.1.2-3.el9.x86_64 244/287 2024-09-12T17:08:56.947 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: tracker-3.1.2-3.el9.x86_64 244/287 2024-09-12T17:08:56.996 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : tracker-miners-3.1.2-4.el9.x86_64 245/287 2024-09-12T17:08:57.012 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: tracker-miners-3.1.2-4.el9.x86_64 245/287 2024-09-12T17:08:57.041 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : bubblewrap-0.4.1-7.el9.x86_64 246/287 2024-09-12T17:08:57.064 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : bluez-libs-5.56-6.el9.x86_64 247/287 2024-09-12T17:08:57.523 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: pipewire-1.0.1-1.el9.x86_64 248/287 2024-09-12T17:08:57.552 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : pipewire-1.0.1-1.el9.x86_64 248/287 2024-09-12T17:08:57.569 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: pipewire-1.0.1-1.el9.x86_64 248/287 2024-09-12T17:08:57.569 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/user/sockets.target.wants/pipewire.socket → /usr/lib/systemd/user/pipewire.socket. 2024-09-12T17:08:57.569 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-12T17:08:57.806 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : pipewire-libs-1.0.1-1.el9.x86_64 249/287 2024-09-12T17:08:57.876 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : wireplumber-0.4.14-1.el9.x86_64 250/287 2024-09-12T17:08:57.919 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : wireplumber-libs-0.4.14-1.el9.x86_64 251/287 2024-09-12T17:08:57.964 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : pipewire-jack-audio-connection-kit-libs-1.0.1-1. 252/287 2024-09-12T17:08:57.989 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ModemManager-glib-1.20.2-1.el9.x86_64 253/287 2024-09-12T17:08:58.459 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: geoclue2-2.6.0-7.el9.x86_64 254/287 2024-09-12T17:08:58.487 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : geoclue2-2.6.0-7.el9.x86_64 254/287 2024-09-12T17:08:58.504 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: geoclue2-2.6.0-7.el9.x86_64 254/287 2024-09-12T17:08:58.839 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 287/287 2024-09-12T17:08:58.840 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:08:58.840 INFO:teuthology.orchestra.run.smithi037.stdout:Upgraded: 2024-09-12T17:08:58.840 INFO:teuthology.orchestra.run.smithi037.stdout: librados2-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:08:58.840 INFO:teuthology.orchestra.run.smithi037.stdout: librbd1-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:08:58.841 INFO:teuthology.orchestra.run.smithi037.stdout:Installed: 2024-09-12T17:08:58.841 INFO:teuthology.orchestra.run.smithi037.stdout: ModemManager-glib-1.20.2-1.el9.x86_64 2024-09-12T17:08:58.841 INFO:teuthology.orchestra.run.smithi037.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-12T17:08:58.841 INFO:teuthology.orchestra.run.smithi037.stdout: adwaita-cursor-theme-40.1.1-3.el9.noarch 2024-09-12T17:08:58.842 INFO:teuthology.orchestra.run.smithi037.stdout: adwaita-icon-theme-40.1.1-3.el9.noarch 2024-09-12T17:08:58.842 INFO:teuthology.orchestra.run.smithi037.stdout: alsa-lib-1.2.12-1.el9.x86_64 2024-09-12T17:08:58.842 INFO:teuthology.orchestra.run.smithi037.stdout: apache-commons-cli-1.4-17.el9.noarch 2024-09-12T17:08:58.842 INFO:teuthology.orchestra.run.smithi037.stdout: apache-commons-codec-1.15-7.el9.noarch 2024-09-12T17:08:58.843 INFO:teuthology.orchestra.run.smithi037.stdout: apache-commons-io-1:2.8.0-8.el9.noarch 2024-09-12T17:08:58.843 INFO:teuthology.orchestra.run.smithi037.stdout: apache-commons-lang3-3.12.0-6.el9.noarch 2024-09-12T17:08:58.843 INFO:teuthology.orchestra.run.smithi037.stdout: at-spi2-atk-2.38.0-4.el9.x86_64 2024-09-12T17:08:58.843 INFO:teuthology.orchestra.run.smithi037.stdout: at-spi2-core-2.40.3-1.el9.x86_64 2024-09-12T17:08:58.844 INFO:teuthology.orchestra.run.smithi037.stdout: atinject-1.0.3-6.el9.noarch 2024-09-12T17:08:58.845 INFO:teuthology.orchestra.run.smithi037.stdout: atk-2.36.0-5.el9.x86_64 2024-09-12T17:08:58.845 INFO:teuthology.orchestra.run.smithi037.stdout: avahi-glib-0.8-21.el9.x86_64 2024-09-12T17:08:58.845 INFO:teuthology.orchestra.run.smithi037.stdout: bluez-libs-5.56-6.el9.x86_64 2024-09-12T17:08:58.845 INFO:teuthology.orchestra.run.smithi037.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-12T17:08:58.845 INFO:teuthology.orchestra.run.smithi037.stdout: bubblewrap-0.4.1-7.el9.x86_64 2024-09-12T17:08:58.845 INFO:teuthology.orchestra.run.smithi037.stdout: cdi-api-2.0.2-6.el9.noarch 2024-09-12T17:08:58.845 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:08:58.845 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-base-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:08:58.845 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-common-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:08:58.846 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-fuse-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:08:58.846 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-grafana-dashboards-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-12T17:08:58.846 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-immutable-object-cache-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:08:58.846 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mds-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:08:58.846 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:08:58.846 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-cephadm-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-12T17:08:58.846 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-dashboard-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-12T17:08:58.846 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-12T17:08:58.846 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-modules-core-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-12T17:08:58.846 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-rook-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-12T17:08:58.847 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mon-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:08:58.847 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-osd-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:08:58.847 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-prometheus-alerts-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-12T17:08:58.847 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-radosgw-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:08:58.847 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-selinux-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:08:58.847 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-test-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:08:58.847 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-volume-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-12T17:08:58.847 INFO:teuthology.orchestra.run.smithi037.stdout: cephadm-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-12T17:08:58.847 INFO:teuthology.orchestra.run.smithi037.stdout: colord-libs-1.4.5-4.el9.x86_64 2024-09-12T17:08:58.847 INFO:teuthology.orchestra.run.smithi037.stdout: composefs-libs-1.0.5-1.el9.x86_64 2024-09-12T17:08:58.847 INFO:teuthology.orchestra.run.smithi037.stdout: copy-jdk-configs-4.0-3.el9.noarch 2024-09-12T17:08:58.847 INFO:teuthology.orchestra.run.smithi037.stdout: cups-libs-1:2.3.3op2-30.el9.x86_64 2024-09-12T17:08:58.848 INFO:teuthology.orchestra.run.smithi037.stdout: dconf-0.40.0-6.el9.x86_64 2024-09-12T17:08:58.848 INFO:teuthology.orchestra.run.smithi037.stdout: exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 2024-09-12T17:08:58.848 INFO:teuthology.orchestra.run.smithi037.stdout: exiv2-0.27.5-2.el9.x86_64 2024-09-12T17:08:58.848 INFO:teuthology.orchestra.run.smithi037.stdout: exiv2-libs-0.27.5-2.el9.x86_64 2024-09-12T17:08:58.848 INFO:teuthology.orchestra.run.smithi037.stdout: fdk-aac-free-2.0.0-8.el9.x86_64 2024-09-12T17:08:58.848 INFO:teuthology.orchestra.run.smithi037.stdout: flac-libs-1.3.3-12.el9.x86_64 2024-09-12T17:08:58.848 INFO:teuthology.orchestra.run.smithi037.stdout: flatpak-1.12.9-1.el9.x86_64 2024-09-12T17:08:58.848 INFO:teuthology.orchestra.run.smithi037.stdout: flatpak-selinux-1.12.9-1.el9.noarch 2024-09-12T17:08:58.848 INFO:teuthology.orchestra.run.smithi037.stdout: flatpak-session-helper-1.12.9-1.el9.x86_64 2024-09-12T17:08:58.849 INFO:teuthology.orchestra.run.smithi037.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-12T17:08:58.849 INFO:teuthology.orchestra.run.smithi037.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-12T17:08:58.849 INFO:teuthology.orchestra.run.smithi037.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-12T17:08:58.849 INFO:teuthology.orchestra.run.smithi037.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-12T17:08:58.849 INFO:teuthology.orchestra.run.smithi037.stdout: gdk-pixbuf2-modules-2.42.6-4.el9.x86_64 2024-09-12T17:08:58.849 INFO:teuthology.orchestra.run.smithi037.stdout: geoclue2-2.6.0-7.el9.x86_64 2024-09-12T17:08:58.849 INFO:teuthology.orchestra.run.smithi037.stdout: giflib-5.2.1-9.el9.x86_64 2024-09-12T17:08:58.849 INFO:teuthology.orchestra.run.smithi037.stdout: google-guice-4.2.3-9.el9.noarch 2024-09-12T17:08:58.850 INFO:teuthology.orchestra.run.smithi037.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-12T17:08:58.850 INFO:teuthology.orchestra.run.smithi037.stdout: graphene-1.10.6-2.el9.x86_64 2024-09-12T17:08:58.850 INFO:teuthology.orchestra.run.smithi037.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-12T17:08:58.850 INFO:teuthology.orchestra.run.smithi037.stdout: gsm-1.0.19-6.el9.x86_64 2024-09-12T17:08:58.850 INFO:teuthology.orchestra.run.smithi037.stdout: gstreamer1-1.22.1-2.el9.x86_64 2024-09-12T17:08:58.850 INFO:teuthology.orchestra.run.smithi037.stdout: gstreamer1-plugins-base-1.22.1-2.el9.x86_64 2024-09-12T17:08:58.850 INFO:teuthology.orchestra.run.smithi037.stdout: gtk-update-icon-cache-3.24.31-5.el9.x86_64 2024-09-12T17:08:58.850 INFO:teuthology.orchestra.run.smithi037.stdout: gtk3-3.24.31-5.el9.x86_64 2024-09-12T17:08:58.850 INFO:teuthology.orchestra.run.smithi037.stdout: guava-30.1-6.el9.noarch 2024-09-12T17:08:58.850 INFO:teuthology.orchestra.run.smithi037.stdout: hicolor-icon-theme-0.17-13.el9.noarch 2024-09-12T17:08:58.850 INFO:teuthology.orchestra.run.smithi037.stdout: httpcomponents-client-4.5.13-3.el9.noarch 2024-09-12T17:08:58.850 INFO:teuthology.orchestra.run.smithi037.stdout: httpcomponents-core-4.4.13-7.el9.noarch 2024-09-12T17:08:58.850 INFO:teuthology.orchestra.run.smithi037.stdout: iso-codes-4.6.0-3.el9.noarch 2024-09-12T17:08:58.851 INFO:teuthology.orchestra.run.smithi037.stdout: jakarta-annotations-1.3.5-13.el9.noarch 2024-09-12T17:08:58.851 INFO:teuthology.orchestra.run.smithi037.stdout: jansi-2.3.3-6.el9.x86_64 2024-09-12T17:08:58.851 INFO:teuthology.orchestra.run.smithi037.stdout: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 2024-09-12T17:08:58.851 INFO:teuthology.orchestra.run.smithi037.stdout: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 2024-09-12T17:08:58.851 INFO:teuthology.orchestra.run.smithi037.stdout: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86_64 2024-09-12T17:08:58.851 INFO:teuthology.orchestra.run.smithi037.stdout: javapackages-filesystem-6.0.0-4.el9.noarch 2024-09-12T17:08:58.851 INFO:teuthology.orchestra.run.smithi037.stdout: jbigkit-libs-2.1-23.el9.x86_64 2024-09-12T17:08:58.851 INFO:teuthology.orchestra.run.smithi037.stdout: jcl-over-slf4j-1.7.30-13.el9.noarch 2024-09-12T17:08:58.851 INFO:teuthology.orchestra.run.smithi037.stdout: jsoup-1.13.1-10.el9.noarch 2024-09-12T17:08:58.851 INFO:teuthology.orchestra.run.smithi037.stdout: jsr-305-3.0.2-6.el9.noarch 2024-09-12T17:08:58.851 INFO:teuthology.orchestra.run.smithi037.stdout: lcms2-2.12-3.el9.x86_64 2024-09-12T17:08:58.852 INFO:teuthology.orchestra.run.smithi037.stdout: libX11-xcb-1.7.0-9.el9.x86_64 2024-09-12T17:08:58.852 INFO:teuthology.orchestra.run.smithi037.stdout: libXcomposite-0.4.5-7.el9.x86_64 2024-09-12T17:08:58.852 INFO:teuthology.orchestra.run.smithi037.stdout: libXcursor-1.2.0-7.el9.x86_64 2024-09-12T17:08:58.852 INFO:teuthology.orchestra.run.smithi037.stdout: libXdamage-1.1.5-7.el9.x86_64 2024-09-12T17:08:58.852 INFO:teuthology.orchestra.run.smithi037.stdout: libXfixes-5.0.3-16.el9.x86_64 2024-09-12T17:08:58.852 INFO:teuthology.orchestra.run.smithi037.stdout: libXi-1.7.10-8.el9.x86_64 2024-09-12T17:08:58.852 INFO:teuthology.orchestra.run.smithi037.stdout: libXinerama-1.1.4-10.el9.x86_64 2024-09-12T17:08:58.852 INFO:teuthology.orchestra.run.smithi037.stdout: libXrandr-1.5.2-8.el9.x86_64 2024-09-12T17:08:58.853 INFO:teuthology.orchestra.run.smithi037.stdout: libXtst-1.2.3-16.el9.x86_64 2024-09-12T17:08:58.853 INFO:teuthology.orchestra.run.smithi037.stdout: libXv-1.0.11-16.el9.x86_64 2024-09-12T17:08:58.853 INFO:teuthology.orchestra.run.smithi037.stdout: libXxf86vm-1.1.4-18.el9.x86_64 2024-09-12T17:08:58.853 INFO:teuthology.orchestra.run.smithi037.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-12T17:08:58.853 INFO:teuthology.orchestra.run.smithi037.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-12T17:08:58.854 INFO:teuthology.orchestra.run.smithi037.stdout: libasyncns-0.8-22.el9.x86_64 2024-09-12T17:08:58.854 INFO:teuthology.orchestra.run.smithi037.stdout: libcanberra-0.30-27.el9.x86_64 2024-09-12T17:08:58.854 INFO:teuthology.orchestra.run.smithi037.stdout: libcanberra-gtk3-0.30-27.el9.x86_64 2024-09-12T17:08:58.854 INFO:teuthology.orchestra.run.smithi037.stdout: libcephfs-devel-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:08:58.854 INFO:teuthology.orchestra.run.smithi037.stdout: libcephfs2-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:08:58.855 INFO:teuthology.orchestra.run.smithi037.stdout: libcephsqlite-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:08:58.855 INFO:teuthology.orchestra.run.smithi037.stdout: libdrm-2.4.121-1.el9.x86_64 2024-09-12T17:08:58.855 INFO:teuthology.orchestra.run.smithi037.stdout: libepoxy-1.5.5-4.el9.x86_64 2024-09-12T17:08:58.855 INFO:teuthology.orchestra.run.smithi037.stdout: libexif-0.6.22-6.el9.x86_64 2024-09-12T17:08:58.855 INFO:teuthology.orchestra.run.smithi037.stdout: libfontenc-1.1.3-17.el9.x86_64 2024-09-12T17:08:58.855 INFO:teuthology.orchestra.run.smithi037.stdout: libgexiv2-0.12.3-1.el9.x86_64 2024-09-12T17:08:58.855 INFO:teuthology.orchestra.run.smithi037.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-12T17:08:58.856 INFO:teuthology.orchestra.run.smithi037.stdout: libglvnd-1:1.3.4-1.el9.x86_64 2024-09-12T17:08:58.856 INFO:teuthology.orchestra.run.smithi037.stdout: libglvnd-egl-1:1.3.4-1.el9.x86_64 2024-09-12T17:08:58.856 INFO:teuthology.orchestra.run.smithi037.stdout: libglvnd-glx-1:1.3.4-1.el9.x86_64 2024-09-12T17:08:58.856 INFO:teuthology.orchestra.run.smithi037.stdout: libgsf-1.14.47-5.el9.x86_64 2024-09-12T17:08:58.856 INFO:teuthology.orchestra.run.smithi037.stdout: libgxps-0.3.2-3.el9.x86_64 2024-09-12T17:08:58.856 INFO:teuthology.orchestra.run.smithi037.stdout: libiptcdata-1.0.5-10.el9.x86_64 2024-09-12T17:08:58.856 INFO:teuthology.orchestra.run.smithi037.stdout: libldac-2.0.2.3-10.el9.x86_64 2024-09-12T17:08:58.857 INFO:teuthology.orchestra.run.smithi037.stdout: libnotify-0.7.9-8.el9.x86_64 2024-09-12T17:08:58.857 INFO:teuthology.orchestra.run.smithi037.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-12T17:08:58.857 INFO:teuthology.orchestra.run.smithi037.stdout: libogg-2:1.3.4-6.el9.x86_64 2024-09-12T17:08:58.857 INFO:teuthology.orchestra.run.smithi037.stdout: libosinfo-1.10.0-1.el9.x86_64 2024-09-12T17:08:58.857 INFO:teuthology.orchestra.run.smithi037.stdout: libpciaccess-0.16-7.el9.x86_64 2024-09-12T17:08:58.857 INFO:teuthology.orchestra.run.smithi037.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-12T17:08:58.857 INFO:teuthology.orchestra.run.smithi037.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-12T17:08:58.858 INFO:teuthology.orchestra.run.smithi037.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-12T17:08:58.858 INFO:teuthology.orchestra.run.smithi037.stdout: librados-devel-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:08:58.858 INFO:teuthology.orchestra.run.smithi037.stdout: libradosstriper1-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:08:58.858 INFO:teuthology.orchestra.run.smithi037.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-12T17:08:58.858 INFO:teuthology.orchestra.run.smithi037.stdout: librgw2-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:08:58.858 INFO:teuthology.orchestra.run.smithi037.stdout: libsbc-1.4-9.el9.x86_64 2024-09-12T17:08:58.858 INFO:teuthology.orchestra.run.smithi037.stdout: libsndfile-1.0.31-8.el9.x86_64 2024-09-12T17:08:58.859 INFO:teuthology.orchestra.run.smithi037.stdout: libtheora-1:1.1.1-31.el9.x86_64 2024-09-12T17:08:58.859 INFO:teuthology.orchestra.run.smithi037.stdout: libtiff-4.4.0-13.el9.x86_64 2024-09-12T17:08:58.859 INFO:teuthology.orchestra.run.smithi037.stdout: libtool-ltdl-2.4.6-46.el9.x86_64 2024-09-12T17:08:58.859 INFO:teuthology.orchestra.run.smithi037.stdout: libtracker-sparql-3.1.2-3.el9.x86_64 2024-09-12T17:08:58.859 INFO:teuthology.orchestra.run.smithi037.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-12T17:08:58.859 INFO:teuthology.orchestra.run.smithi037.stdout: libvisual-1:0.4.0-34.el9.x86_64 2024-09-12T17:08:58.859 INFO:teuthology.orchestra.run.smithi037.stdout: libvorbis-1:1.3.7-5.el9.x86_64 2024-09-12T17:08:58.860 INFO:teuthology.orchestra.run.smithi037.stdout: libwayland-client-1.21.0-1.el9.x86_64 2024-09-12T17:08:58.860 INFO:teuthology.orchestra.run.smithi037.stdout: libwayland-cursor-1.21.0-1.el9.x86_64 2024-09-12T17:08:58.860 INFO:teuthology.orchestra.run.smithi037.stdout: libwayland-egl-1.21.0-1.el9.x86_64 2024-09-12T17:08:58.860 INFO:teuthology.orchestra.run.smithi037.stdout: libwayland-server-1.21.0-1.el9.x86_64 2024-09-12T17:08:58.860 INFO:teuthology.orchestra.run.smithi037.stdout: libwebp-1.2.0-8.el9.x86_64 2024-09-12T17:08:58.860 INFO:teuthology.orchestra.run.smithi037.stdout: libxkbcommon-1.0.3-4.el9.x86_64 2024-09-12T17:08:58.861 INFO:teuthology.orchestra.run.smithi037.stdout: libxshmfence-1.3-10.el9.x86_64 2024-09-12T17:08:58.861 INFO:teuthology.orchestra.run.smithi037.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2024-09-12T17:08:58.861 INFO:teuthology.orchestra.run.smithi037.stdout: low-memory-monitor-2.1-4.el9.x86_64 2024-09-12T17:08:58.861 INFO:teuthology.orchestra.run.smithi037.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-12T17:08:58.861 INFO:teuthology.orchestra.run.smithi037.stdout: lua-5.4.4-4.el9.x86_64 2024-09-12T17:08:58.861 INFO:teuthology.orchestra.run.smithi037.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-12T17:08:58.862 INFO:teuthology.orchestra.run.smithi037.stdout: lua-posix-35.0-8.el9.x86_64 2024-09-12T17:08:58.862 INFO:teuthology.orchestra.run.smithi037.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-12T17:08:58.862 INFO:teuthology.orchestra.run.smithi037.stdout: maven-1:3.6.3-15.el9.noarch 2024-09-12T17:08:58.862 INFO:teuthology.orchestra.run.smithi037.stdout: maven-lib-1:3.6.3-15.el9.noarch 2024-09-12T17:08:58.862 INFO:teuthology.orchestra.run.smithi037.stdout: maven-openjdk11-1:3.6.3-15.el9.noarch 2024-09-12T17:08:58.862 INFO:teuthology.orchestra.run.smithi037.stdout: maven-resolver-1:1.6.1-10.el9.noarch 2024-09-12T17:08:58.863 INFO:teuthology.orchestra.run.smithi037.stdout: maven-shared-utils-3.3.4-3.el9.noarch 2024-09-12T17:08:58.863 INFO:teuthology.orchestra.run.smithi037.stdout: maven-wagon-3.4.2-7.el9.noarch 2024-09-12T17:08:58.863 INFO:teuthology.orchestra.run.smithi037.stdout: mesa-dri-drivers-24.1.2-3.el9.x86_64 2024-09-12T17:08:58.863 INFO:teuthology.orchestra.run.smithi037.stdout: mesa-filesystem-24.1.2-3.el9.x86_64 2024-09-12T17:08:58.863 INFO:teuthology.orchestra.run.smithi037.stdout: mesa-libEGL-24.1.2-3.el9.x86_64 2024-09-12T17:08:58.863 INFO:teuthology.orchestra.run.smithi037.stdout: mesa-libGL-24.1.2-3.el9.x86_64 2024-09-12T17:08:58.863 INFO:teuthology.orchestra.run.smithi037.stdout: mesa-libgbm-24.1.2-3.el9.x86_64 2024-09-12T17:08:58.863 INFO:teuthology.orchestra.run.smithi037.stdout: mesa-libglapi-24.1.2-3.el9.x86_64 2024-09-12T17:08:58.863 INFO:teuthology.orchestra.run.smithi037.stdout: mkfontscale-1.2.1-3.el9.x86_64 2024-09-12T17:08:58.863 INFO:teuthology.orchestra.run.smithi037.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-12T17:08:58.863 INFO:teuthology.orchestra.run.smithi037.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-12T17:08:58.863 INFO:teuthology.orchestra.run.smithi037.stdout: openjpeg2-2.4.0-7.el9.x86_64 2024-09-12T17:08:58.864 INFO:teuthology.orchestra.run.smithi037.stdout: opus-1.3.1-10.el9.x86_64 2024-09-12T17:08:58.864 INFO:teuthology.orchestra.run.smithi037.stdout: orc-0.4.31-8.el9.x86_64 2024-09-12T17:08:58.864 INFO:teuthology.orchestra.run.smithi037.stdout: osinfo-db-20240701-2.el9.noarch 2024-09-12T17:08:58.864 INFO:teuthology.orchestra.run.smithi037.stdout: osinfo-db-tools-1.10.0-1.el9.x86_64 2024-09-12T17:08:58.864 INFO:teuthology.orchestra.run.smithi037.stdout: ostree-libs-2024.7-2.el9.x86_64 2024-09-12T17:08:58.864 INFO:teuthology.orchestra.run.smithi037.stdout: p11-kit-server-0.25.3-2.el9.x86_64 2024-09-12T17:08:58.864 INFO:teuthology.orchestra.run.smithi037.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-12T17:08:58.864 INFO:teuthology.orchestra.run.smithi037.stdout: pipewire-1.0.1-1.el9.x86_64 2024-09-12T17:08:58.864 INFO:teuthology.orchestra.run.smithi037.stdout: pipewire-alsa-1.0.1-1.el9.x86_64 2024-09-12T17:08:58.864 INFO:teuthology.orchestra.run.smithi037.stdout: pipewire-jack-audio-connection-kit-1.0.1-1.el9.x86_64 2024-09-12T17:08:58.864 INFO:teuthology.orchestra.run.smithi037.stdout: pipewire-jack-audio-connection-kit-libs-1.0.1-1.el9.x86_64 2024-09-12T17:08:58.864 INFO:teuthology.orchestra.run.smithi037.stdout: pipewire-libs-1.0.1-1.el9.x86_64 2024-09-12T17:08:58.864 INFO:teuthology.orchestra.run.smithi037.stdout: pipewire-pulseaudio-1.0.1-1.el9.x86_64 2024-09-12T17:08:58.865 INFO:teuthology.orchestra.run.smithi037.stdout: plexus-cipher-1.7-27.el9.noarch 2024-09-12T17:08:58.865 INFO:teuthology.orchestra.run.smithi037.stdout: plexus-classworlds-2.6.0-11.el9.noarch 2024-09-12T17:08:58.865 INFO:teuthology.orchestra.run.smithi037.stdout: plexus-containers-component-annotations-2.1.0-10.el9.noarch 2024-09-12T17:08:58.865 INFO:teuthology.orchestra.run.smithi037.stdout: plexus-interpolation-1.26-11.el9.noarch 2024-09-12T17:08:58.865 INFO:teuthology.orchestra.run.smithi037.stdout: plexus-sec-dispatcher-1.4-37.el9.noarch 2024-09-12T17:08:58.865 INFO:teuthology.orchestra.run.smithi037.stdout: plexus-utils-3.3.0-10.el9.noarch 2024-09-12T17:08:58.865 INFO:teuthology.orchestra.run.smithi037.stdout: poppler-21.01.0-21.el9.x86_64 2024-09-12T17:08:58.865 INFO:teuthology.orchestra.run.smithi037.stdout: poppler-data-0.4.9-9.el9.noarch 2024-09-12T17:08:58.865 INFO:teuthology.orchestra.run.smithi037.stdout: poppler-glib-21.01.0-21.el9.x86_64 2024-09-12T17:08:58.865 INFO:teuthology.orchestra.run.smithi037.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-12T17:08:58.865 INFO:teuthology.orchestra.run.smithi037.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-12T17:08:58.865 INFO:teuthology.orchestra.run.smithi037.stdout: publicsuffix-list-20210518-3.el9.noarch 2024-09-12T17:08:58.865 INFO:teuthology.orchestra.run.smithi037.stdout: pulseaudio-libs-15.0-2.el9.x86_64 2024-09-12T17:08:58.866 INFO:teuthology.orchestra.run.smithi037.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-12T17:08:58.866 INFO:teuthology.orchestra.run.smithi037.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-12T17:08:58.866 INFO:teuthology.orchestra.run.smithi037.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-12T17:08:58.866 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-12T17:08:58.866 INFO:teuthology.orchestra.run.smithi037.stdout: python3-ceph-argparse-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:08:58.866 INFO:teuthology.orchestra.run.smithi037.stdout: python3-ceph-common-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:08:58.866 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cephfs-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:08:58.866 INFO:teuthology.orchestra.run.smithi037.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-12T17:08:58.866 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-12T17:08:58.866 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-12T17:08:58.866 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-12T17:08:58.866 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-12T17:08:58.867 INFO:teuthology.orchestra.run.smithi037.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-12T17:08:58.867 INFO:teuthology.orchestra.run.smithi037.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-12T17:08:58.867 INFO:teuthology.orchestra.run.smithi037.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-12T17:08:58.867 INFO:teuthology.orchestra.run.smithi037.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-12T17:08:58.867 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-12T17:08:58.867 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-12T17:08:58.867 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-12T17:08:58.867 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-12T17:08:58.867 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-12T17:08:58.867 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-12T17:08:58.867 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-12T17:08:58.867 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-12T17:08:58.867 INFO:teuthology.orchestra.run.smithi037.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-12T17:08:58.868 INFO:teuthology.orchestra.run.smithi037.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-12T17:08:58.868 INFO:teuthology.orchestra.run.smithi037.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-12T17:08:58.868 INFO:teuthology.orchestra.run.smithi037.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-12T17:08:58.868 INFO:teuthology.orchestra.run.smithi037.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-12T17:08:58.868 INFO:teuthology.orchestra.run.smithi037.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-12T17:08:58.868 INFO:teuthology.orchestra.run.smithi037.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-12T17:08:58.868 INFO:teuthology.orchestra.run.smithi037.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-12T17:08:58.868 INFO:teuthology.orchestra.run.smithi037.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-12T17:08:58.868 INFO:teuthology.orchestra.run.smithi037.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-12T17:08:58.868 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-12T17:08:58.868 INFO:teuthology.orchestra.run.smithi037.stdout: python3-ply-3.11-14.el9.noarch 2024-09-12T17:08:58.868 INFO:teuthology.orchestra.run.smithi037.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-12T17:08:58.868 INFO:teuthology.orchestra.run.smithi037.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-12T17:08:58.869 INFO:teuthology.orchestra.run.smithi037.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-12T17:08:58.869 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-12T17:08:58.869 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-12T17:08:58.869 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-12T17:08:58.869 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-12T17:08:58.869 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-12T17:08:58.869 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rados-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:08:58.869 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rbd-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:08:58.869 INFO:teuthology.orchestra.run.smithi037.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-12T17:08:58.869 INFO:teuthology.orchestra.run.smithi037.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-12T17:08:58.869 INFO:teuthology.orchestra.run.smithi037.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-12T17:08:58.869 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rgw-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:08:58.869 INFO:teuthology.orchestra.run.smithi037.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-12T17:08:58.870 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-12T17:08:58.870 INFO:teuthology.orchestra.run.smithi037.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-12T17:08:58.870 INFO:teuthology.orchestra.run.smithi037.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-12T17:08:58.870 INFO:teuthology.orchestra.run.smithi037.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-12T17:08:58.870 INFO:teuthology.orchestra.run.smithi037.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-12T17:08:58.870 INFO:teuthology.orchestra.run.smithi037.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-12T17:08:58.870 INFO:teuthology.orchestra.run.smithi037.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-12T17:08:58.870 INFO:teuthology.orchestra.run.smithi037.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-12T17:08:58.870 INFO:teuthology.orchestra.run.smithi037.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-12T17:08:58.870 INFO:teuthology.orchestra.run.smithi037.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-12T17:08:58.870 INFO:teuthology.orchestra.run.smithi037.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-12T17:08:58.870 INFO:teuthology.orchestra.run.smithi037.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-12T17:08:58.870 INFO:teuthology.orchestra.run.smithi037.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-12T17:08:58.870 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-fuse-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:08:58.871 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-mirror-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:08:58.871 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-nbd-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:08:58.871 INFO:teuthology.orchestra.run.smithi037.stdout: re2-1:20211101-20.el9.x86_64 2024-09-12T17:08:58.871 INFO:teuthology.orchestra.run.smithi037.stdout: rtkit-0.11-29.el9.x86_64 2024-09-12T17:08:58.871 INFO:teuthology.orchestra.run.smithi037.stdout: s3cmd-2.4.0-1.el9.noarch 2024-09-12T17:08:58.871 INFO:teuthology.orchestra.run.smithi037.stdout: sisu-1:0.3.4-10.el9.noarch 2024-09-12T17:08:58.871 INFO:teuthology.orchestra.run.smithi037.stdout: slf4j-1.7.30-13.el9.noarch 2024-09-12T17:08:58.871 INFO:teuthology.orchestra.run.smithi037.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-12T17:08:58.871 INFO:teuthology.orchestra.run.smithi037.stdout: sound-theme-freedesktop-0.8-17.el9.noarch 2024-09-12T17:08:58.871 INFO:teuthology.orchestra.run.smithi037.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-12T17:08:58.871 INFO:teuthology.orchestra.run.smithi037.stdout: totem-pl-parser-3.26.6-2.el9.x86_64 2024-09-12T17:08:58.871 INFO:teuthology.orchestra.run.smithi037.stdout: tracker-3.1.2-3.el9.x86_64 2024-09-12T17:08:58.871 INFO:teuthology.orchestra.run.smithi037.stdout: tracker-miners-3.1.2-4.el9.x86_64 2024-09-12T17:08:58.871 INFO:teuthology.orchestra.run.smithi037.stdout: ttmkfdir-3.0.9-65.el9.x86_64 2024-09-12T17:08:58.872 INFO:teuthology.orchestra.run.smithi037.stdout: tzdata-java-2024a-2.el9.noarch 2024-09-12T17:08:58.872 INFO:teuthology.orchestra.run.smithi037.stdout: upower-0.99.11-11.el9.x86_64 2024-09-12T17:08:58.872 INFO:teuthology.orchestra.run.smithi037.stdout: webrtc-audio-processing-0.3.1-8.el9.x86_64 2024-09-12T17:08:58.872 INFO:teuthology.orchestra.run.smithi037.stdout: wireplumber-0.4.14-1.el9.x86_64 2024-09-12T17:08:58.872 INFO:teuthology.orchestra.run.smithi037.stdout: wireplumber-libs-0.4.14-1.el9.x86_64 2024-09-12T17:08:58.872 INFO:teuthology.orchestra.run.smithi037.stdout: xdg-dbus-proxy-0.1.3-1.el9.x86_64 2024-09-12T17:08:58.872 INFO:teuthology.orchestra.run.smithi037.stdout: xdg-desktop-portal-1.12.6-1.el9.x86_64 2024-09-12T17:08:58.872 INFO:teuthology.orchestra.run.smithi037.stdout: xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 2024-09-12T17:08:58.872 INFO:teuthology.orchestra.run.smithi037.stdout: xkeyboard-config-2.33-2.el9.noarch 2024-09-12T17:08:58.872 INFO:teuthology.orchestra.run.smithi037.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-12T17:08:58.872 INFO:teuthology.orchestra.run.smithi037.stdout: xorg-x11-fonts-Type1-7.5-33.el9.noarch 2024-09-12T17:08:58.872 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:08:58.873 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2024-09-12T17:08:59.002 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: flatpak-1.12.9-1.el9.x86_64 255/287 2024-09-12T17:08:59.096 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : flatpak-1.12.9-1.el9.x86_64 255/287 2024-09-12T17:08:59.137 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : xdg-desktop-portal-1.12.6-1.el9.x86_64 256/287 2024-09-12T17:08:59.166 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: xdg-desktop-portal-1.12.6-1.el9.x86_64 256/287 2024-09-12T17:08:59.362 DEBUG:teuthology.parallel:result is None 2024-09-12T17:08:59.373 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libcanberra-gtk3-0.30-27.el9.x86_64 257/287 2024-09-12T17:08:59.428 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : gtk3-3.24.31-5.el9.x86_64 258/287 2024-09-12T17:08:59.453 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 259/287 2024-09-12T17:08:59.476 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 259/287 2024-09-12T17:08:59.504 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 260/287 2024-09-12T17:08:59.572 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 260/287 2024-09-12T17:08:59.606 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 261/287 2024-09-12T17:08:59.617 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 261/287 2024-09-12T17:08:59.649 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : maven-1:3.6.3-15.el9.noarch 262/287 2024-09-12T17:08:59.666 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: maven-1:3.6.3-15.el9.noarch 262/287 2024-09-12T17:08:59.691 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : maven-openjdk11-1:3.6.3-15.el9.noarch 263/287 2024-09-12T17:09:00.148 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: cephadm-2:19.3.0-4762.gbad475c1.el9.noarch 264/287 2024-09-12T17:09:00.180 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : cephadm-2:19.3.0-4762.gbad475c1.el9.noarch 264/287 2024-09-12T17:09:00.214 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4762.gbad475c1.e 265/287 2024-09-12T17:09:00.284 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4762.gbad475c1. 266/287 2024-09-12T17:09:00.313 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4762.gbad475c1.el9.noa 267/287 2024-09-12T17:09:03.703 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4762.gbad475c1.el9.noa 267/287 2024-09-12T17:09:03.760 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4762.gbad475c1.el9.n 268/287 2024-09-12T17:09:04.775 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4762.gbad475c1.el9.n 268/287 2024-09-12T17:09:04.803 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4762.gbad 269/287 2024-09-12T17:09:04.926 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4762.gbad 269/287 2024-09-12T17:09:05.097 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4762.gbad475c1.el 270/287 2024-09-12T17:09:05.130 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-mgr-2:19.3.0-4762.gbad475c1.el9.x86_64 271/287 2024-09-12T17:09:05.155 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4762.gbad475c1.el9.x86_64 271/287 2024-09-12T17:09:05.155 INFO:teuthology.orchestra.run.smithi040.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T17:09:05.155 INFO:teuthology.orchestra.run.smithi040.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-12T17:09:05.155 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T17:09:05.155 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T17:09:05.155 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-12T17:09:05.214 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-mgr-rook-2:19.3.0-4762.gbad475c1.el9.noarch 272/287 2024-09-12T17:09:05.225 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4762.gbad475c1.el9.noarch 272/287 2024-09-12T17:09:05.248 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-2:19.3.0-4762.gbad475c1.el9.x86_64 273/287 2024-09-12T17:09:05.277 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : pipewire-jack-audio-connection-kit-1.0.1-1.el9.x 274/287 2024-09-12T17:09:05.327 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : pipewire-alsa-1.0.1-1.el9.x86_64 275/287 2024-09-12T17:09:05.357 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : pipewire-pulseaudio-1.0.1-1.el9.x86_64 276/287 2024-09-12T17:09:05.374 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: pipewire-pulseaudio-1.0.1-1.el9.x86_64 276/287 2024-09-12T17:09:05.374 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/user/sockets.target.wants/pipewire-pulse.socket → /usr/lib/systemd/user/pipewire-pulse.socket. 2024-09-12T17:09:05.374 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-12T17:09:06.383 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-radosgw-2:19.3.0-4762.gbad475c1.el9.x86_64 277/287 2024-09-12T17:09:06.408 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4762.gbad475c1.el9.x86_64 277/287 2024-09-12T17:09:06.408 INFO:teuthology.orchestra.run.smithi040.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T17:09:06.408 INFO:teuthology.orchestra.run.smithi040.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-12T17:09:06.408 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T17:09:06.408 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T17:09:06.408 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-12T17:09:06.451 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4762.gbad47 278/287 2024-09-12T17:09:06.475 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4762.gbad47 278/287 2024-09-12T17:09:06.475 INFO:teuthology.orchestra.run.smithi040.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T17:09:06.475 INFO:teuthology.orchestra.run.smithi040.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-12T17:09:06.475 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-12T17:09:06.810 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : rbd-mirror-2:19.3.0-4762.gbad475c1.el9.x86_64 279/287 2024-09-12T17:09:06.834 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4762.gbad475c1.el9.x86_64 279/287 2024-09-12T17:09:06.834 INFO:teuthology.orchestra.run.smithi040.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T17:09:06.834 INFO:teuthology.orchestra.run.smithi040.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-12T17:09:06.835 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T17:09:06.835 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T17:09:06.835 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-12T17:09:11.391 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-test-2:19.3.0-4762.gbad475c1.el9.x86_64 280/287 2024-09-12T17:09:11.441 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : rbd-fuse-2:19.3.0-4762.gbad475c1.el9.x86_64 281/287 2024-09-12T17:09:11.481 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : rbd-nbd-2:19.3.0-4762.gbad475c1.el9.x86_64 282/287 2024-09-12T17:09:11.589 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libcephfs-devel-2:19.3.0-4762.gbad475c1.el9.x86_ 283/287 2024-09-12T17:09:11.651 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-fuse-2:19.3.0-4762.gbad475c1.el9.x86_64 284/287 2024-09-12T17:09:11.680 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : s3cmd-2.4.0-1.el9.noarch 285/287 2024-09-12T17:09:11.681 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 286/287 2024-09-12T17:09:11.756 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 286/287 2024-09-12T17:09:11.756 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 287/287 2024-09-12T17:09:11.847 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 287/287 2024-09-12T17:09:11.869 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: dconf-0.40.0-6.el9.x86_64 287/287 2024-09-12T17:09:11.876 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: copy-jdk-configs-4.0-3.el9.noarch 287/287 2024-09-12T17:09:11.885 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 287/287 2024-09-12T17:09:11.895 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: wireplumber-0.4.14-1.el9.x86_64 287/287 2024-09-12T17:09:11.896 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/user/pipewire-session-manager.service → /usr/lib/systemd/user/wireplumber.service. 2024-09-12T17:09:11.896 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/user/pipewire.service.wants/wireplumber.service → /usr/lib/systemd/user/wireplumber.service. 2024-09-12T17:09:11.896 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-12T17:09:11.965 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 287/287 2024-09-12T17:09:12.038 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 287/287 2024-09-12T17:09:21.922 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 287/287 2024-09-12T17:09:21.922 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-2:19.3.0-4762.gbad475c1.el9.x86_64 1/287 2024-09-12T17:09:21.922 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-base-2:19.3.0-4762.gbad475c1.el9.x86_64 2/287 2024-09-12T17:09:21.922 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-common-2:19.3.0-4762.gbad475c1.el9.x86_64 3/287 2024-09-12T17:09:21.922 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-fuse-2:19.3.0-4762.gbad475c1.el9.x86_64 4/287 2024-09-12T17:09:21.922 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4762.gbad47 5/287 2024-09-12T17:09:21.922 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-mds-2:19.3.0-4762.gbad475c1.el9.x86_64 6/287 2024-09-12T17:09:21.923 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-mgr-2:19.3.0-4762.gbad475c1.el9.x86_64 7/287 2024-09-12T17:09:21.923 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-mon-2:19.3.0-4762.gbad475c1.el9.x86_64 8/287 2024-09-12T17:09:21.923 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-osd-2:19.3.0-4762.gbad475c1.el9.x86_64 9/287 2024-09-12T17:09:21.923 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-radosgw-2:19.3.0-4762.gbad475c1.el9.x86_64 10/287 2024-09-12T17:09:21.923 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-selinux-2:19.3.0-4762.gbad475c1.el9.x86_64 11/287 2024-09-12T17:09:21.923 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-test-2:19.3.0-4762.gbad475c1.el9.x86_64 12/287 2024-09-12T17:09:21.923 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libcephfs-devel-2:19.3.0-4762.gbad475c1.el9.x86_ 13/287 2024-09-12T17:09:21.923 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libcephfs2-2:19.3.0-4762.gbad475c1.el9.x86_64 14/287 2024-09-12T17:09:21.923 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libcephsqlite-2:19.3.0-4762.gbad475c1.el9.x86_64 15/287 2024-09-12T17:09:21.923 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : librados-devel-2:19.3.0-4762.gbad475c1.el9.x86_6 16/287 2024-09-12T17:09:21.923 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libradosstriper1-2:19.3.0-4762.gbad475c1.el9.x86 17/287 2024-09-12T17:09:21.923 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : librgw2-2:19.3.0-4762.gbad475c1.el9.x86_64 18/287 2024-09-12T17:09:21.924 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4762.gbad475c1.el 19/287 2024-09-12T17:09:21.924 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-ceph-common-2:19.3.0-4762.gbad475c1.el9. 20/287 2024-09-12T17:09:21.924 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-cephfs-2:19.3.0-4762.gbad475c1.el9.x86_6 21/287 2024-09-12T17:09:21.924 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-rados-2:19.3.0-4762.gbad475c1.el9.x86_64 22/287 2024-09-12T17:09:21.924 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-rbd-2:19.3.0-4762.gbad475c1.el9.x86_64 23/287 2024-09-12T17:09:21.924 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-rgw-2:19.3.0-4762.gbad475c1.el9.x86_64 24/287 2024-09-12T17:09:21.924 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : rbd-fuse-2:19.3.0-4762.gbad475c1.el9.x86_64 25/287 2024-09-12T17:09:21.924 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : rbd-mirror-2:19.3.0-4762.gbad475c1.el9.x86_64 26/287 2024-09-12T17:09:21.924 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : rbd-nbd-2:19.3.0-4762.gbad475c1.el9.x86_64 27/287 2024-09-12T17:09:21.924 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4762.gbad475c1. 28/287 2024-09-12T17:09:21.924 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4762.gbad475c1.el9.noa 29/287 2024-09-12T17:09:21.924 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4762.gbad475c1.el9.n 30/287 2024-09-12T17:09:21.925 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4762.gbad 31/287 2024-09-12T17:09:21.925 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4762.gbad475c1.el 32/287 2024-09-12T17:09:21.925 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4762.gbad475c1.el9.noarch 33/287 2024-09-12T17:09:21.925 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4762.gbad475c1.e 34/287 2024-09-12T17:09:21.925 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-volume-2:19.3.0-4762.gbad475c1.el9.noarch 35/287 2024-09-12T17:09:21.925 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : cephadm-2:19.3.0-4762.gbad475c1.el9.noarch 36/287 2024-09-12T17:09:21.925 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ModemManager-glib-1.20.2-1.el9.x86_64 37/287 2024-09-12T17:09:21.925 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : bluez-libs-5.56-6.el9.x86_64 38/287 2024-09-12T17:09:21.925 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : bubblewrap-0.4.1-7.el9.x86_64 39/287 2024-09-12T17:09:21.925 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : cups-libs-1:2.3.3op2-30.el9.x86_64 40/287 2024-09-12T17:09:21.925 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 41/287 2024-09-12T17:09:21.925 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 42/287 2024-09-12T17:09:21.925 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libpciaccess-0.16-7.el9.x86_64 43/287 2024-09-12T17:09:21.926 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 44/287 2024-09-12T17:09:21.926 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 45/287 2024-09-12T17:09:21.926 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 46/287 2024-09-12T17:09:21.926 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 47/287 2024-09-12T17:09:21.926 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-ply-3.11-14.el9.noarch 48/287 2024-09-12T17:09:21.926 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 49/287 2024-09-12T17:09:21.926 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 50/287 2024-09-12T17:09:21.926 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 51/287 2024-09-12T17:09:21.926 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : adwaita-cursor-theme-40.1.1-3.el9.noarch 52/287 2024-09-12T17:09:21.926 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : adwaita-icon-theme-40.1.1-3.el9.noarch 53/287 2024-09-12T17:09:21.926 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : alsa-lib-1.2.12-1.el9.x86_64 54/287 2024-09-12T17:09:21.926 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : apache-commons-cli-1.4-17.el9.noarch 55/287 2024-09-12T17:09:21.926 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : apache-commons-codec-1.15-7.el9.noarch 56/287 2024-09-12T17:09:21.927 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : apache-commons-io-1:2.8.0-8.el9.noarch 57/287 2024-09-12T17:09:21.927 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : apache-commons-lang3-3.12.0-6.el9.noarch 58/287 2024-09-12T17:09:21.927 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : at-spi2-atk-2.38.0-4.el9.x86_64 59/287 2024-09-12T17:09:21.927 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : at-spi2-core-2.40.3-1.el9.x86_64 60/287 2024-09-12T17:09:21.927 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : atinject-1.0.3-6.el9.noarch 61/287 2024-09-12T17:09:21.927 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : atk-2.36.0-5.el9.x86_64 62/287 2024-09-12T17:09:21.927 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : avahi-glib-0.8-21.el9.x86_64 63/287 2024-09-12T17:09:21.927 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 64/287 2024-09-12T17:09:21.927 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : cdi-api-2.0.2-6.el9.noarch 65/287 2024-09-12T17:09:21.927 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : colord-libs-1.4.5-4.el9.x86_64 66/287 2024-09-12T17:09:21.927 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : composefs-libs-1.0.5-1.el9.x86_64 67/287 2024-09-12T17:09:21.927 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : copy-jdk-configs-4.0-3.el9.noarch 68/287 2024-09-12T17:09:21.928 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : dconf-0.40.0-6.el9.x86_64 69/287 2024-09-12T17:09:21.928 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 70/287 2024-09-12T17:09:21.928 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : exiv2-0.27.5-2.el9.x86_64 71/287 2024-09-12T17:09:21.928 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : exiv2-libs-0.27.5-2.el9.x86_64 72/287 2024-09-12T17:09:21.928 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : fdk-aac-free-2.0.0-8.el9.x86_64 73/287 2024-09-12T17:09:21.928 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : flac-libs-1.3.3-12.el9.x86_64 74/287 2024-09-12T17:09:21.928 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : flatpak-1.12.9-1.el9.x86_64 75/287 2024-09-12T17:09:21.928 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : flatpak-selinux-1.12.9-1.el9.noarch 76/287 2024-09-12T17:09:21.928 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : flatpak-session-helper-1.12.9-1.el9.x86_64 77/287 2024-09-12T17:09:21.928 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 78/287 2024-09-12T17:09:21.928 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 79/287 2024-09-12T17:09:21.929 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 80/287 2024-09-12T17:09:21.929 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : gdk-pixbuf2-modules-2.42.6-4.el9.x86_64 81/287 2024-09-12T17:09:21.929 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : geoclue2-2.6.0-7.el9.x86_64 82/287 2024-09-12T17:09:21.929 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : giflib-5.2.1-9.el9.x86_64 83/287 2024-09-12T17:09:21.929 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : google-guice-4.2.3-9.el9.noarch 84/287 2024-09-12T17:09:21.929 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : graphene-1.10.6-2.el9.x86_64 85/287 2024-09-12T17:09:21.929 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : gsm-1.0.19-6.el9.x86_64 86/287 2024-09-12T17:09:21.929 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : gstreamer1-1.22.1-2.el9.x86_64 87/287 2024-09-12T17:09:21.929 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : gstreamer1-plugins-base-1.22.1-2.el9.x86_64 88/287 2024-09-12T17:09:21.929 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : gtk-update-icon-cache-3.24.31-5.el9.x86_64 89/287 2024-09-12T17:09:21.929 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : gtk3-3.24.31-5.el9.x86_64 90/287 2024-09-12T17:09:21.929 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : guava-30.1-6.el9.noarch 91/287 2024-09-12T17:09:21.929 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : hicolor-icon-theme-0.17-13.el9.noarch 92/287 2024-09-12T17:09:21.930 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : httpcomponents-client-4.5.13-3.el9.noarch 93/287 2024-09-12T17:09:21.930 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : httpcomponents-core-4.4.13-7.el9.noarch 94/287 2024-09-12T17:09:21.930 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : iso-codes-4.6.0-3.el9.noarch 95/287 2024-09-12T17:09:21.930 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : jakarta-annotations-1.3.5-13.el9.noarch 96/287 2024-09-12T17:09:21.930 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : jansi-2.3.3-6.el9.x86_64 97/287 2024-09-12T17:09:21.930 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 98/287 2024-09-12T17:09:21.930 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 99/287 2024-09-12T17:09:21.930 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 100/287 2024-09-12T17:09:21.930 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : javapackages-filesystem-6.0.0-4.el9.noarch 101/287 2024-09-12T17:09:21.930 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : jbigkit-libs-2.1-23.el9.x86_64 102/287 2024-09-12T17:09:21.930 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : jcl-over-slf4j-1.7.30-13.el9.noarch 103/287 2024-09-12T17:09:21.930 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : jsoup-1.13.1-10.el9.noarch 104/287 2024-09-12T17:09:21.930 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : jsr-305-3.0.2-6.el9.noarch 105/287 2024-09-12T17:09:21.930 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : lcms2-2.12-3.el9.x86_64 106/287 2024-09-12T17:09:21.931 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libX11-xcb-1.7.0-9.el9.x86_64 107/287 2024-09-12T17:09:21.931 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libXcomposite-0.4.5-7.el9.x86_64 108/287 2024-09-12T17:09:21.931 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libXcursor-1.2.0-7.el9.x86_64 109/287 2024-09-12T17:09:21.931 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libXdamage-1.1.5-7.el9.x86_64 110/287 2024-09-12T17:09:21.931 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libXfixes-5.0.3-16.el9.x86_64 111/287 2024-09-12T17:09:21.931 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libXi-1.7.10-8.el9.x86_64 112/287 2024-09-12T17:09:21.931 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libXinerama-1.1.4-10.el9.x86_64 113/287 2024-09-12T17:09:21.931 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libXrandr-1.5.2-8.el9.x86_64 114/287 2024-09-12T17:09:21.931 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libXtst-1.2.3-16.el9.x86_64 115/287 2024-09-12T17:09:21.931 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libXv-1.0.11-16.el9.x86_64 116/287 2024-09-12T17:09:21.931 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libXxf86vm-1.1.4-18.el9.x86_64 117/287 2024-09-12T17:09:21.931 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libasyncns-0.8-22.el9.x86_64 118/287 2024-09-12T17:09:21.932 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libcanberra-0.30-27.el9.x86_64 119/287 2024-09-12T17:09:21.932 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libcanberra-gtk3-0.30-27.el9.x86_64 120/287 2024-09-12T17:09:21.932 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libdrm-2.4.121-1.el9.x86_64 121/287 2024-09-12T17:09:21.932 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libepoxy-1.5.5-4.el9.x86_64 122/287 2024-09-12T17:09:21.932 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libexif-0.6.22-6.el9.x86_64 123/287 2024-09-12T17:09:21.932 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libfontenc-1.1.3-17.el9.x86_64 124/287 2024-09-12T17:09:21.932 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libgexiv2-0.12.3-1.el9.x86_64 125/287 2024-09-12T17:09:21.932 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libglvnd-1:1.3.4-1.el9.x86_64 126/287 2024-09-12T17:09:21.932 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libglvnd-egl-1:1.3.4-1.el9.x86_64 127/287 2024-09-12T17:09:21.932 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libglvnd-glx-1:1.3.4-1.el9.x86_64 128/287 2024-09-12T17:09:21.932 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libgsf-1.14.47-5.el9.x86_64 129/287 2024-09-12T17:09:21.932 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libgxps-0.3.2-3.el9.x86_64 130/287 2024-09-12T17:09:21.932 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libiptcdata-1.0.5-10.el9.x86_64 131/287 2024-09-12T17:09:21.932 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libldac-2.0.2.3-10.el9.x86_64 132/287 2024-09-12T17:09:21.933 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libnotify-0.7.9-8.el9.x86_64 133/287 2024-09-12T17:09:21.933 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libogg-2:1.3.4-6.el9.x86_64 134/287 2024-09-12T17:09:21.933 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libosinfo-1.10.0-1.el9.x86_64 135/287 2024-09-12T17:09:21.933 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 136/287 2024-09-12T17:09:21.933 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 137/287 2024-09-12T17:09:21.933 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 138/287 2024-09-12T17:09:21.933 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libsbc-1.4-9.el9.x86_64 139/287 2024-09-12T17:09:21.933 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libsndfile-1.0.31-8.el9.x86_64 140/287 2024-09-12T17:09:21.933 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libtheora-1:1.1.1-31.el9.x86_64 141/287 2024-09-12T17:09:21.933 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libtiff-4.4.0-13.el9.x86_64 142/287 2024-09-12T17:09:21.933 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libtool-ltdl-2.4.6-46.el9.x86_64 143/287 2024-09-12T17:09:21.933 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libtracker-sparql-3.1.2-3.el9.x86_64 144/287 2024-09-12T17:09:21.934 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libvisual-1:0.4.0-34.el9.x86_64 145/287 2024-09-12T17:09:21.934 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libvorbis-1:1.3.7-5.el9.x86_64 146/287 2024-09-12T17:09:21.934 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libwayland-client-1.21.0-1.el9.x86_64 147/287 2024-09-12T17:09:21.934 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libwayland-cursor-1.21.0-1.el9.x86_64 148/287 2024-09-12T17:09:21.934 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libwayland-egl-1.21.0-1.el9.x86_64 149/287 2024-09-12T17:09:21.934 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libwayland-server-1.21.0-1.el9.x86_64 150/287 2024-09-12T17:09:21.934 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libwebp-1.2.0-8.el9.x86_64 151/287 2024-09-12T17:09:21.934 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libxkbcommon-1.0.3-4.el9.x86_64 152/287 2024-09-12T17:09:21.934 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libxshmfence-1.3-10.el9.x86_64 153/287 2024-09-12T17:09:21.934 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : low-memory-monitor-2.1-4.el9.x86_64 154/287 2024-09-12T17:09:21.934 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 155/287 2024-09-12T17:09:21.934 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : lua-5.4.4-4.el9.x86_64 156/287 2024-09-12T17:09:21.934 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : lua-posix-35.0-8.el9.x86_64 157/287 2024-09-12T17:09:21.934 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : maven-1:3.6.3-15.el9.noarch 158/287 2024-09-12T17:09:21.935 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : maven-lib-1:3.6.3-15.el9.noarch 159/287 2024-09-12T17:09:21.935 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : maven-openjdk11-1:3.6.3-15.el9.noarch 160/287 2024-09-12T17:09:21.935 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : maven-resolver-1:1.6.1-10.el9.noarch 161/287 2024-09-12T17:09:21.935 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : maven-shared-utils-3.3.4-3.el9.noarch 162/287 2024-09-12T17:09:21.935 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : maven-wagon-3.4.2-7.el9.noarch 163/287 2024-09-12T17:09:21.935 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : mesa-dri-drivers-24.1.2-3.el9.x86_64 164/287 2024-09-12T17:09:21.935 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : mesa-filesystem-24.1.2-3.el9.x86_64 165/287 2024-09-12T17:09:21.935 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : mesa-libEGL-24.1.2-3.el9.x86_64 166/287 2024-09-12T17:09:21.935 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : mesa-libGL-24.1.2-3.el9.x86_64 167/287 2024-09-12T17:09:21.935 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : mesa-libgbm-24.1.2-3.el9.x86_64 168/287 2024-09-12T17:09:21.935 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : mesa-libglapi-24.1.2-3.el9.x86_64 169/287 2024-09-12T17:09:21.935 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : mkfontscale-1.2.1-3.el9.x86_64 170/287 2024-09-12T17:09:21.935 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 171/287 2024-09-12T17:09:21.936 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 172/287 2024-09-12T17:09:21.936 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : openjpeg2-2.4.0-7.el9.x86_64 173/287 2024-09-12T17:09:21.936 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : opus-1.3.1-10.el9.x86_64 174/287 2024-09-12T17:09:21.936 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : orc-0.4.31-8.el9.x86_64 175/287 2024-09-12T17:09:21.936 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : osinfo-db-20240701-2.el9.noarch 176/287 2024-09-12T17:09:21.936 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : osinfo-db-tools-1.10.0-1.el9.x86_64 177/287 2024-09-12T17:09:21.936 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ostree-libs-2024.7-2.el9.x86_64 178/287 2024-09-12T17:09:21.936 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : p11-kit-server-0.25.3-2.el9.x86_64 179/287 2024-09-12T17:09:21.936 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : pipewire-1.0.1-1.el9.x86_64 180/287 2024-09-12T17:09:21.936 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : pipewire-alsa-1.0.1-1.el9.x86_64 181/287 2024-09-12T17:09:21.936 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : pipewire-jack-audio-connection-kit-1.0.1-1.el9.x 182/287 2024-09-12T17:09:21.936 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : pipewire-jack-audio-connection-kit-libs-1.0.1-1. 183/287 2024-09-12T17:09:21.936 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : pipewire-libs-1.0.1-1.el9.x86_64 184/287 2024-09-12T17:09:21.937 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : pipewire-pulseaudio-1.0.1-1.el9.x86_64 185/287 2024-09-12T17:09:21.937 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : plexus-cipher-1.7-27.el9.noarch 186/287 2024-09-12T17:09:21.937 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : plexus-classworlds-2.6.0-11.el9.noarch 187/287 2024-09-12T17:09:21.937 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : plexus-containers-component-annotations-2.1.0-10 188/287 2024-09-12T17:09:21.937 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : plexus-interpolation-1.26-11.el9.noarch 189/287 2024-09-12T17:09:21.937 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : plexus-sec-dispatcher-1.4-37.el9.noarch 190/287 2024-09-12T17:09:21.937 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : plexus-utils-3.3.0-10.el9.noarch 191/287 2024-09-12T17:09:21.937 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : poppler-21.01.0-21.el9.x86_64 192/287 2024-09-12T17:09:21.937 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : poppler-data-0.4.9-9.el9.noarch 193/287 2024-09-12T17:09:21.937 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : poppler-glib-21.01.0-21.el9.x86_64 194/287 2024-09-12T17:09:21.937 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 195/287 2024-09-12T17:09:21.937 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : publicsuffix-list-20210518-3.el9.noarch 196/287 2024-09-12T17:09:21.937 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : pulseaudio-libs-15.0-2.el9.x86_64 197/287 2024-09-12T17:09:21.938 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 198/287 2024-09-12T17:09:21.938 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 199/287 2024-09-12T17:09:21.938 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 200/287 2024-09-12T17:09:21.938 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 201/287 2024-09-12T17:09:21.938 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 202/287 2024-09-12T17:09:21.938 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 203/287 2024-09-12T17:09:21.938 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 204/287 2024-09-12T17:09:21.938 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 205/287 2024-09-12T17:09:21.938 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 206/287 2024-09-12T17:09:21.938 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 207/287 2024-09-12T17:09:21.938 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 208/287 2024-09-12T17:09:21.938 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 209/287 2024-09-12T17:09:21.938 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 210/287 2024-09-12T17:09:21.938 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 211/287 2024-09-12T17:09:21.939 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 212/287 2024-09-12T17:09:21.939 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 213/287 2024-09-12T17:09:21.939 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 214/287 2024-09-12T17:09:21.939 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 215/287 2024-09-12T17:09:21.939 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 216/287 2024-09-12T17:09:21.939 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 217/287 2024-09-12T17:09:21.939 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 218/287 2024-09-12T17:09:21.939 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 219/287 2024-09-12T17:09:21.939 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : rtkit-0.11-29.el9.x86_64 220/287 2024-09-12T17:09:21.939 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : sisu-1:0.3.4-10.el9.noarch 221/287 2024-09-12T17:09:21.939 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : slf4j-1.7.30-13.el9.noarch 222/287 2024-09-12T17:09:21.939 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 223/287 2024-09-12T17:09:21.939 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : sound-theme-freedesktop-0.8-17.el9.noarch 224/287 2024-09-12T17:09:21.940 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : totem-pl-parser-3.26.6-2.el9.x86_64 225/287 2024-09-12T17:09:21.940 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : tracker-3.1.2-3.el9.x86_64 226/287 2024-09-12T17:09:21.940 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : tracker-miners-3.1.2-4.el9.x86_64 227/287 2024-09-12T17:09:21.940 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ttmkfdir-3.0.9-65.el9.x86_64 228/287 2024-09-12T17:09:21.940 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : tzdata-java-2024a-2.el9.noarch 229/287 2024-09-12T17:09:21.940 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : upower-0.99.11-11.el9.x86_64 230/287 2024-09-12T17:09:21.940 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : webrtc-audio-processing-0.3.1-8.el9.x86_64 231/287 2024-09-12T17:09:21.940 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : wireplumber-0.4.14-1.el9.x86_64 232/287 2024-09-12T17:09:21.940 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : wireplumber-libs-0.4.14-1.el9.x86_64 233/287 2024-09-12T17:09:21.940 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : xdg-dbus-proxy-0.1.3-1.el9.x86_64 234/287 2024-09-12T17:09:21.940 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : xdg-desktop-portal-1.12.6-1.el9.x86_64 235/287 2024-09-12T17:09:21.940 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 236/287 2024-09-12T17:09:21.941 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : xkeyboard-config-2.33-2.el9.noarch 237/287 2024-09-12T17:09:21.941 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 238/287 2024-09-12T17:09:21.941 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : xorg-x11-fonts-Type1-7.5-33.el9.noarch 239/287 2024-09-12T17:09:21.941 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 240/287 2024-09-12T17:09:21.941 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 241/287 2024-09-12T17:09:21.941 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 242/287 2024-09-12T17:09:21.941 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 243/287 2024-09-12T17:09:21.941 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 244/287 2024-09-12T17:09:21.941 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 245/287 2024-09-12T17:09:21.941 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 246/287 2024-09-12T17:09:21.941 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 247/287 2024-09-12T17:09:21.941 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 248/287 2024-09-12T17:09:21.941 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 249/287 2024-09-12T17:09:21.942 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 250/287 2024-09-12T17:09:21.942 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 251/287 2024-09-12T17:09:21.942 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 252/287 2024-09-12T17:09:21.944 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 253/287 2024-09-12T17:09:21.944 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 254/287 2024-09-12T17:09:21.944 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 255/287 2024-09-12T17:09:21.944 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 256/287 2024-09-12T17:09:21.944 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 257/287 2024-09-12T17:09:21.945 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 258/287 2024-09-12T17:09:21.945 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 259/287 2024-09-12T17:09:21.945 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 260/287 2024-09-12T17:09:21.945 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 261/287 2024-09-12T17:09:21.945 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 262/287 2024-09-12T17:09:21.945 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 263/287 2024-09-12T17:09:21.945 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 264/287 2024-09-12T17:09:21.945 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 265/287 2024-09-12T17:09:21.945 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 266/287 2024-09-12T17:09:21.945 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 267/287 2024-09-12T17:09:21.945 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 268/287 2024-09-12T17:09:21.945 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 269/287 2024-09-12T17:09:21.945 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 270/287 2024-09-12T17:09:21.946 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 271/287 2024-09-12T17:09:21.946 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 272/287 2024-09-12T17:09:21.946 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 273/287 2024-09-12T17:09:21.946 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 274/287 2024-09-12T17:09:21.946 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 275/287 2024-09-12T17:09:21.946 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 276/287 2024-09-12T17:09:21.946 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 277/287 2024-09-12T17:09:21.946 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 278/287 2024-09-12T17:09:21.946 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 279/287 2024-09-12T17:09:21.946 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 280/287 2024-09-12T17:09:21.946 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : re2-1:20211101-20.el9.x86_64 281/287 2024-09-12T17:09:21.946 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : s3cmd-2.4.0-1.el9.noarch 282/287 2024-09-12T17:09:21.946 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 283/287 2024-09-12T17:09:21.946 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : librados2-2:19.3.0-4762.gbad475c1.el9.x86_64 284/287 2024-09-12T17:09:21.947 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 285/287 2024-09-12T17:09:21.947 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : librbd1-2:19.3.0-4762.gbad475c1.el9.x86_64 286/287 2024-09-12T17:09:25.364 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 287/287 2024-09-12T17:09:25.364 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-12T17:09:25.364 INFO:teuthology.orchestra.run.smithi040.stdout:Upgraded: 2024-09-12T17:09:25.364 INFO:teuthology.orchestra.run.smithi040.stdout: librados2-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:09:25.364 INFO:teuthology.orchestra.run.smithi040.stdout: librbd1-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:09:25.365 INFO:teuthology.orchestra.run.smithi040.stdout:Installed: 2024-09-12T17:09:25.365 INFO:teuthology.orchestra.run.smithi040.stdout: ModemManager-glib-1.20.2-1.el9.x86_64 2024-09-12T17:09:25.365 INFO:teuthology.orchestra.run.smithi040.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-12T17:09:25.365 INFO:teuthology.orchestra.run.smithi040.stdout: adwaita-cursor-theme-40.1.1-3.el9.noarch 2024-09-12T17:09:25.365 INFO:teuthology.orchestra.run.smithi040.stdout: adwaita-icon-theme-40.1.1-3.el9.noarch 2024-09-12T17:09:25.365 INFO:teuthology.orchestra.run.smithi040.stdout: alsa-lib-1.2.12-1.el9.x86_64 2024-09-12T17:09:25.365 INFO:teuthology.orchestra.run.smithi040.stdout: apache-commons-cli-1.4-17.el9.noarch 2024-09-12T17:09:25.365 INFO:teuthology.orchestra.run.smithi040.stdout: apache-commons-codec-1.15-7.el9.noarch 2024-09-12T17:09:25.365 INFO:teuthology.orchestra.run.smithi040.stdout: apache-commons-io-1:2.8.0-8.el9.noarch 2024-09-12T17:09:25.365 INFO:teuthology.orchestra.run.smithi040.stdout: apache-commons-lang3-3.12.0-6.el9.noarch 2024-09-12T17:09:25.365 INFO:teuthology.orchestra.run.smithi040.stdout: at-spi2-atk-2.38.0-4.el9.x86_64 2024-09-12T17:09:25.366 INFO:teuthology.orchestra.run.smithi040.stdout: at-spi2-core-2.40.3-1.el9.x86_64 2024-09-12T17:09:25.366 INFO:teuthology.orchestra.run.smithi040.stdout: atinject-1.0.3-6.el9.noarch 2024-09-12T17:09:25.366 INFO:teuthology.orchestra.run.smithi040.stdout: atk-2.36.0-5.el9.x86_64 2024-09-12T17:09:25.366 INFO:teuthology.orchestra.run.smithi040.stdout: avahi-glib-0.8-21.el9.x86_64 2024-09-12T17:09:25.366 INFO:teuthology.orchestra.run.smithi040.stdout: bluez-libs-5.56-6.el9.x86_64 2024-09-12T17:09:25.366 INFO:teuthology.orchestra.run.smithi040.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-12T17:09:25.366 INFO:teuthology.orchestra.run.smithi040.stdout: bubblewrap-0.4.1-7.el9.x86_64 2024-09-12T17:09:25.366 INFO:teuthology.orchestra.run.smithi040.stdout: cdi-api-2.0.2-6.el9.noarch 2024-09-12T17:09:25.366 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:09:25.366 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-base-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:09:25.366 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-common-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:09:25.366 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-fuse-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:09:25.367 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-grafana-dashboards-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-12T17:09:25.367 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-immutable-object-cache-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:09:25.367 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mds-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:09:25.367 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:09:25.367 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-cephadm-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-12T17:09:25.367 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-dashboard-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-12T17:09:25.367 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-12T17:09:25.367 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-modules-core-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-12T17:09:25.367 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-rook-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-12T17:09:25.367 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mon-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:09:25.367 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-osd-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:09:25.367 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-prometheus-alerts-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-12T17:09:25.367 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-radosgw-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:09:25.368 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-selinux-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:09:25.368 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-test-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:09:25.368 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-volume-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-12T17:09:25.368 INFO:teuthology.orchestra.run.smithi040.stdout: cephadm-2:19.3.0-4762.gbad475c1.el9.noarch 2024-09-12T17:09:25.368 INFO:teuthology.orchestra.run.smithi040.stdout: colord-libs-1.4.5-4.el9.x86_64 2024-09-12T17:09:25.368 INFO:teuthology.orchestra.run.smithi040.stdout: composefs-libs-1.0.5-1.el9.x86_64 2024-09-12T17:09:25.368 INFO:teuthology.orchestra.run.smithi040.stdout: copy-jdk-configs-4.0-3.el9.noarch 2024-09-12T17:09:25.368 INFO:teuthology.orchestra.run.smithi040.stdout: cups-libs-1:2.3.3op2-30.el9.x86_64 2024-09-12T17:09:25.368 INFO:teuthology.orchestra.run.smithi040.stdout: dconf-0.40.0-6.el9.x86_64 2024-09-12T17:09:25.368 INFO:teuthology.orchestra.run.smithi040.stdout: exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 2024-09-12T17:09:25.368 INFO:teuthology.orchestra.run.smithi040.stdout: exiv2-0.27.5-2.el9.x86_64 2024-09-12T17:09:25.368 INFO:teuthology.orchestra.run.smithi040.stdout: exiv2-libs-0.27.5-2.el9.x86_64 2024-09-12T17:09:25.369 INFO:teuthology.orchestra.run.smithi040.stdout: fdk-aac-free-2.0.0-8.el9.x86_64 2024-09-12T17:09:25.369 INFO:teuthology.orchestra.run.smithi040.stdout: flac-libs-1.3.3-12.el9.x86_64 2024-09-12T17:09:25.369 INFO:teuthology.orchestra.run.smithi040.stdout: flatpak-1.12.9-1.el9.x86_64 2024-09-12T17:09:25.369 INFO:teuthology.orchestra.run.smithi040.stdout: flatpak-selinux-1.12.9-1.el9.noarch 2024-09-12T17:09:25.369 INFO:teuthology.orchestra.run.smithi040.stdout: flatpak-session-helper-1.12.9-1.el9.x86_64 2024-09-12T17:09:25.369 INFO:teuthology.orchestra.run.smithi040.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-12T17:09:25.369 INFO:teuthology.orchestra.run.smithi040.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-12T17:09:25.369 INFO:teuthology.orchestra.run.smithi040.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-12T17:09:25.369 INFO:teuthology.orchestra.run.smithi040.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-12T17:09:25.369 INFO:teuthology.orchestra.run.smithi040.stdout: gdk-pixbuf2-modules-2.42.6-4.el9.x86_64 2024-09-12T17:09:25.369 INFO:teuthology.orchestra.run.smithi040.stdout: geoclue2-2.6.0-7.el9.x86_64 2024-09-12T17:09:25.369 INFO:teuthology.orchestra.run.smithi040.stdout: giflib-5.2.1-9.el9.x86_64 2024-09-12T17:09:25.369 INFO:teuthology.orchestra.run.smithi040.stdout: google-guice-4.2.3-9.el9.noarch 2024-09-12T17:09:25.370 INFO:teuthology.orchestra.run.smithi040.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-12T17:09:25.370 INFO:teuthology.orchestra.run.smithi040.stdout: graphene-1.10.6-2.el9.x86_64 2024-09-12T17:09:25.370 INFO:teuthology.orchestra.run.smithi040.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-12T17:09:25.370 INFO:teuthology.orchestra.run.smithi040.stdout: gsm-1.0.19-6.el9.x86_64 2024-09-12T17:09:25.370 INFO:teuthology.orchestra.run.smithi040.stdout: gstreamer1-1.22.1-2.el9.x86_64 2024-09-12T17:09:25.370 INFO:teuthology.orchestra.run.smithi040.stdout: gstreamer1-plugins-base-1.22.1-2.el9.x86_64 2024-09-12T17:09:25.370 INFO:teuthology.orchestra.run.smithi040.stdout: gtk-update-icon-cache-3.24.31-5.el9.x86_64 2024-09-12T17:09:25.370 INFO:teuthology.orchestra.run.smithi040.stdout: gtk3-3.24.31-5.el9.x86_64 2024-09-12T17:09:25.370 INFO:teuthology.orchestra.run.smithi040.stdout: guava-30.1-6.el9.noarch 2024-09-12T17:09:25.370 INFO:teuthology.orchestra.run.smithi040.stdout: hicolor-icon-theme-0.17-13.el9.noarch 2024-09-12T17:09:25.370 INFO:teuthology.orchestra.run.smithi040.stdout: httpcomponents-client-4.5.13-3.el9.noarch 2024-09-12T17:09:25.370 INFO:teuthology.orchestra.run.smithi040.stdout: httpcomponents-core-4.4.13-7.el9.noarch 2024-09-12T17:09:25.370 INFO:teuthology.orchestra.run.smithi040.stdout: iso-codes-4.6.0-3.el9.noarch 2024-09-12T17:09:25.371 INFO:teuthology.orchestra.run.smithi040.stdout: jakarta-annotations-1.3.5-13.el9.noarch 2024-09-12T17:09:25.371 INFO:teuthology.orchestra.run.smithi040.stdout: jansi-2.3.3-6.el9.x86_64 2024-09-12T17:09:25.371 INFO:teuthology.orchestra.run.smithi040.stdout: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 2024-09-12T17:09:25.371 INFO:teuthology.orchestra.run.smithi040.stdout: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 2024-09-12T17:09:25.371 INFO:teuthology.orchestra.run.smithi040.stdout: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86_64 2024-09-12T17:09:25.371 INFO:teuthology.orchestra.run.smithi040.stdout: javapackages-filesystem-6.0.0-4.el9.noarch 2024-09-12T17:09:25.371 INFO:teuthology.orchestra.run.smithi040.stdout: jbigkit-libs-2.1-23.el9.x86_64 2024-09-12T17:09:25.371 INFO:teuthology.orchestra.run.smithi040.stdout: jcl-over-slf4j-1.7.30-13.el9.noarch 2024-09-12T17:09:25.371 INFO:teuthology.orchestra.run.smithi040.stdout: jsoup-1.13.1-10.el9.noarch 2024-09-12T17:09:25.371 INFO:teuthology.orchestra.run.smithi040.stdout: jsr-305-3.0.2-6.el9.noarch 2024-09-12T17:09:25.371 INFO:teuthology.orchestra.run.smithi040.stdout: lcms2-2.12-3.el9.x86_64 2024-09-12T17:09:25.371 INFO:teuthology.orchestra.run.smithi040.stdout: libX11-xcb-1.7.0-9.el9.x86_64 2024-09-12T17:09:25.372 INFO:teuthology.orchestra.run.smithi040.stdout: libXcomposite-0.4.5-7.el9.x86_64 2024-09-12T17:09:25.372 INFO:teuthology.orchestra.run.smithi040.stdout: libXcursor-1.2.0-7.el9.x86_64 2024-09-12T17:09:25.372 INFO:teuthology.orchestra.run.smithi040.stdout: libXdamage-1.1.5-7.el9.x86_64 2024-09-12T17:09:25.372 INFO:teuthology.orchestra.run.smithi040.stdout: libXfixes-5.0.3-16.el9.x86_64 2024-09-12T17:09:25.372 INFO:teuthology.orchestra.run.smithi040.stdout: libXi-1.7.10-8.el9.x86_64 2024-09-12T17:09:25.372 INFO:teuthology.orchestra.run.smithi040.stdout: libXinerama-1.1.4-10.el9.x86_64 2024-09-12T17:09:25.372 INFO:teuthology.orchestra.run.smithi040.stdout: libXrandr-1.5.2-8.el9.x86_64 2024-09-12T17:09:25.372 INFO:teuthology.orchestra.run.smithi040.stdout: libXtst-1.2.3-16.el9.x86_64 2024-09-12T17:09:25.372 INFO:teuthology.orchestra.run.smithi040.stdout: libXv-1.0.11-16.el9.x86_64 2024-09-12T17:09:25.372 INFO:teuthology.orchestra.run.smithi040.stdout: libXxf86vm-1.1.4-18.el9.x86_64 2024-09-12T17:09:25.372 INFO:teuthology.orchestra.run.smithi040.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-12T17:09:25.372 INFO:teuthology.orchestra.run.smithi040.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-12T17:09:25.373 INFO:teuthology.orchestra.run.smithi040.stdout: libasyncns-0.8-22.el9.x86_64 2024-09-12T17:09:25.373 INFO:teuthology.orchestra.run.smithi040.stdout: libcanberra-0.30-27.el9.x86_64 2024-09-12T17:09:25.373 INFO:teuthology.orchestra.run.smithi040.stdout: libcanberra-gtk3-0.30-27.el9.x86_64 2024-09-12T17:09:25.373 INFO:teuthology.orchestra.run.smithi040.stdout: libcephfs-devel-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:09:25.373 INFO:teuthology.orchestra.run.smithi040.stdout: libcephfs2-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:09:25.373 INFO:teuthology.orchestra.run.smithi040.stdout: libcephsqlite-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:09:25.373 INFO:teuthology.orchestra.run.smithi040.stdout: libdrm-2.4.121-1.el9.x86_64 2024-09-12T17:09:25.373 INFO:teuthology.orchestra.run.smithi040.stdout: libepoxy-1.5.5-4.el9.x86_64 2024-09-12T17:09:25.373 INFO:teuthology.orchestra.run.smithi040.stdout: libexif-0.6.22-6.el9.x86_64 2024-09-12T17:09:25.373 INFO:teuthology.orchestra.run.smithi040.stdout: libfontenc-1.1.3-17.el9.x86_64 2024-09-12T17:09:25.373 INFO:teuthology.orchestra.run.smithi040.stdout: libgexiv2-0.12.3-1.el9.x86_64 2024-09-12T17:09:25.373 INFO:teuthology.orchestra.run.smithi040.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-12T17:09:25.374 INFO:teuthology.orchestra.run.smithi040.stdout: libglvnd-1:1.3.4-1.el9.x86_64 2024-09-12T17:09:25.374 INFO:teuthology.orchestra.run.smithi040.stdout: libglvnd-egl-1:1.3.4-1.el9.x86_64 2024-09-12T17:09:25.374 INFO:teuthology.orchestra.run.smithi040.stdout: libglvnd-glx-1:1.3.4-1.el9.x86_64 2024-09-12T17:09:25.374 INFO:teuthology.orchestra.run.smithi040.stdout: libgsf-1.14.47-5.el9.x86_64 2024-09-12T17:09:25.374 INFO:teuthology.orchestra.run.smithi040.stdout: libgxps-0.3.2-3.el9.x86_64 2024-09-12T17:09:25.374 INFO:teuthology.orchestra.run.smithi040.stdout: libiptcdata-1.0.5-10.el9.x86_64 2024-09-12T17:09:25.374 INFO:teuthology.orchestra.run.smithi040.stdout: libldac-2.0.2.3-10.el9.x86_64 2024-09-12T17:09:25.374 INFO:teuthology.orchestra.run.smithi040.stdout: libnotify-0.7.9-8.el9.x86_64 2024-09-12T17:09:25.374 INFO:teuthology.orchestra.run.smithi040.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-12T17:09:25.374 INFO:teuthology.orchestra.run.smithi040.stdout: libogg-2:1.3.4-6.el9.x86_64 2024-09-12T17:09:25.374 INFO:teuthology.orchestra.run.smithi040.stdout: libosinfo-1.10.0-1.el9.x86_64 2024-09-12T17:09:25.374 INFO:teuthology.orchestra.run.smithi040.stdout: libpciaccess-0.16-7.el9.x86_64 2024-09-12T17:09:25.374 INFO:teuthology.orchestra.run.smithi040.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-12T17:09:25.374 INFO:teuthology.orchestra.run.smithi040.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-12T17:09:25.375 INFO:teuthology.orchestra.run.smithi040.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-12T17:09:25.375 INFO:teuthology.orchestra.run.smithi040.stdout: librados-devel-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:09:25.375 INFO:teuthology.orchestra.run.smithi040.stdout: libradosstriper1-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:09:25.375 INFO:teuthology.orchestra.run.smithi040.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-12T17:09:25.375 INFO:teuthology.orchestra.run.smithi040.stdout: librgw2-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:09:25.375 INFO:teuthology.orchestra.run.smithi040.stdout: libsbc-1.4-9.el9.x86_64 2024-09-12T17:09:25.375 INFO:teuthology.orchestra.run.smithi040.stdout: libsndfile-1.0.31-8.el9.x86_64 2024-09-12T17:09:25.375 INFO:teuthology.orchestra.run.smithi040.stdout: libtheora-1:1.1.1-31.el9.x86_64 2024-09-12T17:09:25.375 INFO:teuthology.orchestra.run.smithi040.stdout: libtiff-4.4.0-13.el9.x86_64 2024-09-12T17:09:25.375 INFO:teuthology.orchestra.run.smithi040.stdout: libtool-ltdl-2.4.6-46.el9.x86_64 2024-09-12T17:09:25.375 INFO:teuthology.orchestra.run.smithi040.stdout: libtracker-sparql-3.1.2-3.el9.x86_64 2024-09-12T17:09:25.375 INFO:teuthology.orchestra.run.smithi040.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-12T17:09:25.375 INFO:teuthology.orchestra.run.smithi040.stdout: libvisual-1:0.4.0-34.el9.x86_64 2024-09-12T17:09:25.376 INFO:teuthology.orchestra.run.smithi040.stdout: libvorbis-1:1.3.7-5.el9.x86_64 2024-09-12T17:09:25.376 INFO:teuthology.orchestra.run.smithi040.stdout: libwayland-client-1.21.0-1.el9.x86_64 2024-09-12T17:09:25.376 INFO:teuthology.orchestra.run.smithi040.stdout: libwayland-cursor-1.21.0-1.el9.x86_64 2024-09-12T17:09:25.376 INFO:teuthology.orchestra.run.smithi040.stdout: libwayland-egl-1.21.0-1.el9.x86_64 2024-09-12T17:09:25.376 INFO:teuthology.orchestra.run.smithi040.stdout: libwayland-server-1.21.0-1.el9.x86_64 2024-09-12T17:09:25.376 INFO:teuthology.orchestra.run.smithi040.stdout: libwebp-1.2.0-8.el9.x86_64 2024-09-12T17:09:25.376 INFO:teuthology.orchestra.run.smithi040.stdout: libxkbcommon-1.0.3-4.el9.x86_64 2024-09-12T17:09:25.376 INFO:teuthology.orchestra.run.smithi040.stdout: libxshmfence-1.3-10.el9.x86_64 2024-09-12T17:09:25.376 INFO:teuthology.orchestra.run.smithi040.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2024-09-12T17:09:25.376 INFO:teuthology.orchestra.run.smithi040.stdout: low-memory-monitor-2.1-4.el9.x86_64 2024-09-12T17:09:25.376 INFO:teuthology.orchestra.run.smithi040.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-12T17:09:25.376 INFO:teuthology.orchestra.run.smithi040.stdout: lua-5.4.4-4.el9.x86_64 2024-09-12T17:09:25.377 INFO:teuthology.orchestra.run.smithi040.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-12T17:09:25.377 INFO:teuthology.orchestra.run.smithi040.stdout: lua-posix-35.0-8.el9.x86_64 2024-09-12T17:09:25.377 INFO:teuthology.orchestra.run.smithi040.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-12T17:09:25.377 INFO:teuthology.orchestra.run.smithi040.stdout: maven-1:3.6.3-15.el9.noarch 2024-09-12T17:09:25.377 INFO:teuthology.orchestra.run.smithi040.stdout: maven-lib-1:3.6.3-15.el9.noarch 2024-09-12T17:09:25.377 INFO:teuthology.orchestra.run.smithi040.stdout: maven-openjdk11-1:3.6.3-15.el9.noarch 2024-09-12T17:09:25.377 INFO:teuthology.orchestra.run.smithi040.stdout: maven-resolver-1:1.6.1-10.el9.noarch 2024-09-12T17:09:25.377 INFO:teuthology.orchestra.run.smithi040.stdout: maven-shared-utils-3.3.4-3.el9.noarch 2024-09-12T17:09:25.377 INFO:teuthology.orchestra.run.smithi040.stdout: maven-wagon-3.4.2-7.el9.noarch 2024-09-12T17:09:25.377 INFO:teuthology.orchestra.run.smithi040.stdout: mesa-dri-drivers-24.1.2-3.el9.x86_64 2024-09-12T17:09:25.377 INFO:teuthology.orchestra.run.smithi040.stdout: mesa-filesystem-24.1.2-3.el9.x86_64 2024-09-12T17:09:25.377 INFO:teuthology.orchestra.run.smithi040.stdout: mesa-libEGL-24.1.2-3.el9.x86_64 2024-09-12T17:09:25.378 INFO:teuthology.orchestra.run.smithi040.stdout: mesa-libGL-24.1.2-3.el9.x86_64 2024-09-12T17:09:25.378 INFO:teuthology.orchestra.run.smithi040.stdout: mesa-libgbm-24.1.2-3.el9.x86_64 2024-09-12T17:09:25.378 INFO:teuthology.orchestra.run.smithi040.stdout: mesa-libglapi-24.1.2-3.el9.x86_64 2024-09-12T17:09:25.378 INFO:teuthology.orchestra.run.smithi040.stdout: mkfontscale-1.2.1-3.el9.x86_64 2024-09-12T17:09:25.378 INFO:teuthology.orchestra.run.smithi040.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-12T17:09:25.378 INFO:teuthology.orchestra.run.smithi040.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-12T17:09:25.378 INFO:teuthology.orchestra.run.smithi040.stdout: openjpeg2-2.4.0-7.el9.x86_64 2024-09-12T17:09:25.378 INFO:teuthology.orchestra.run.smithi040.stdout: opus-1.3.1-10.el9.x86_64 2024-09-12T17:09:25.378 INFO:teuthology.orchestra.run.smithi040.stdout: orc-0.4.31-8.el9.x86_64 2024-09-12T17:09:25.378 INFO:teuthology.orchestra.run.smithi040.stdout: osinfo-db-20240701-2.el9.noarch 2024-09-12T17:09:25.378 INFO:teuthology.orchestra.run.smithi040.stdout: osinfo-db-tools-1.10.0-1.el9.x86_64 2024-09-12T17:09:25.378 INFO:teuthology.orchestra.run.smithi040.stdout: ostree-libs-2024.7-2.el9.x86_64 2024-09-12T17:09:25.378 INFO:teuthology.orchestra.run.smithi040.stdout: p11-kit-server-0.25.3-2.el9.x86_64 2024-09-12T17:09:25.379 INFO:teuthology.orchestra.run.smithi040.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-12T17:09:25.379 INFO:teuthology.orchestra.run.smithi040.stdout: pipewire-1.0.1-1.el9.x86_64 2024-09-12T17:09:25.379 INFO:teuthology.orchestra.run.smithi040.stdout: pipewire-alsa-1.0.1-1.el9.x86_64 2024-09-12T17:09:25.379 INFO:teuthology.orchestra.run.smithi040.stdout: pipewire-jack-audio-connection-kit-1.0.1-1.el9.x86_64 2024-09-12T17:09:25.379 INFO:teuthology.orchestra.run.smithi040.stdout: pipewire-jack-audio-connection-kit-libs-1.0.1-1.el9.x86_64 2024-09-12T17:09:25.379 INFO:teuthology.orchestra.run.smithi040.stdout: pipewire-libs-1.0.1-1.el9.x86_64 2024-09-12T17:09:25.379 INFO:teuthology.orchestra.run.smithi040.stdout: pipewire-pulseaudio-1.0.1-1.el9.x86_64 2024-09-12T17:09:25.379 INFO:teuthology.orchestra.run.smithi040.stdout: plexus-cipher-1.7-27.el9.noarch 2024-09-12T17:09:25.379 INFO:teuthology.orchestra.run.smithi040.stdout: plexus-classworlds-2.6.0-11.el9.noarch 2024-09-12T17:09:25.379 INFO:teuthology.orchestra.run.smithi040.stdout: plexus-containers-component-annotations-2.1.0-10.el9.noarch 2024-09-12T17:09:25.379 INFO:teuthology.orchestra.run.smithi040.stdout: plexus-interpolation-1.26-11.el9.noarch 2024-09-12T17:09:25.379 INFO:teuthology.orchestra.run.smithi040.stdout: plexus-sec-dispatcher-1.4-37.el9.noarch 2024-09-12T17:09:25.379 INFO:teuthology.orchestra.run.smithi040.stdout: plexus-utils-3.3.0-10.el9.noarch 2024-09-12T17:09:25.379 INFO:teuthology.orchestra.run.smithi040.stdout: poppler-21.01.0-21.el9.x86_64 2024-09-12T17:09:25.380 INFO:teuthology.orchestra.run.smithi040.stdout: poppler-data-0.4.9-9.el9.noarch 2024-09-12T17:09:25.380 INFO:teuthology.orchestra.run.smithi040.stdout: poppler-glib-21.01.0-21.el9.x86_64 2024-09-12T17:09:25.380 INFO:teuthology.orchestra.run.smithi040.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-12T17:09:25.380 INFO:teuthology.orchestra.run.smithi040.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-12T17:09:25.380 INFO:teuthology.orchestra.run.smithi040.stdout: publicsuffix-list-20210518-3.el9.noarch 2024-09-12T17:09:25.380 INFO:teuthology.orchestra.run.smithi040.stdout: pulseaudio-libs-15.0-2.el9.x86_64 2024-09-12T17:09:25.380 INFO:teuthology.orchestra.run.smithi040.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-12T17:09:25.380 INFO:teuthology.orchestra.run.smithi040.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-12T17:09:25.380 INFO:teuthology.orchestra.run.smithi040.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-12T17:09:25.380 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-12T17:09:25.380 INFO:teuthology.orchestra.run.smithi040.stdout: python3-ceph-argparse-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:09:25.380 INFO:teuthology.orchestra.run.smithi040.stdout: python3-ceph-common-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:09:25.380 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cephfs-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:09:25.381 INFO:teuthology.orchestra.run.smithi040.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-12T17:09:25.381 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-12T17:09:25.381 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-12T17:09:25.381 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-12T17:09:25.381 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-12T17:09:25.381 INFO:teuthology.orchestra.run.smithi040.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-12T17:09:25.381 INFO:teuthology.orchestra.run.smithi040.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-12T17:09:25.381 INFO:teuthology.orchestra.run.smithi040.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-12T17:09:25.381 INFO:teuthology.orchestra.run.smithi040.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-12T17:09:25.381 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-12T17:09:25.381 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-12T17:09:25.381 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-12T17:09:25.381 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-12T17:09:25.382 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-12T17:09:25.382 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-12T17:09:25.382 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-12T17:09:25.382 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-12T17:09:25.382 INFO:teuthology.orchestra.run.smithi040.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-12T17:09:25.382 INFO:teuthology.orchestra.run.smithi040.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-12T17:09:25.382 INFO:teuthology.orchestra.run.smithi040.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-12T17:09:25.382 INFO:teuthology.orchestra.run.smithi040.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-12T17:09:25.382 INFO:teuthology.orchestra.run.smithi040.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-12T17:09:25.382 INFO:teuthology.orchestra.run.smithi040.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-12T17:09:25.382 INFO:teuthology.orchestra.run.smithi040.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-12T17:09:25.382 INFO:teuthology.orchestra.run.smithi040.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-12T17:09:25.383 INFO:teuthology.orchestra.run.smithi040.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-12T17:09:25.383 INFO:teuthology.orchestra.run.smithi040.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-12T17:09:25.383 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-12T17:09:25.383 INFO:teuthology.orchestra.run.smithi040.stdout: python3-ply-3.11-14.el9.noarch 2024-09-12T17:09:25.383 INFO:teuthology.orchestra.run.smithi040.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-12T17:09:25.383 INFO:teuthology.orchestra.run.smithi040.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-12T17:09:25.383 INFO:teuthology.orchestra.run.smithi040.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-12T17:09:25.383 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-12T17:09:25.383 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-12T17:09:25.383 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-12T17:09:25.383 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-12T17:09:25.383 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-12T17:09:25.383 INFO:teuthology.orchestra.run.smithi040.stdout: python3-rados-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:09:25.384 INFO:teuthology.orchestra.run.smithi040.stdout: python3-rbd-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:09:25.384 INFO:teuthology.orchestra.run.smithi040.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-12T17:09:25.384 INFO:teuthology.orchestra.run.smithi040.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-12T17:09:25.384 INFO:teuthology.orchestra.run.smithi040.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-12T17:09:25.384 INFO:teuthology.orchestra.run.smithi040.stdout: python3-rgw-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:09:25.384 INFO:teuthology.orchestra.run.smithi040.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-12T17:09:25.384 INFO:teuthology.orchestra.run.smithi040.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-12T17:09:25.384 INFO:teuthology.orchestra.run.smithi040.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-12T17:09:25.384 INFO:teuthology.orchestra.run.smithi040.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-12T17:09:25.384 INFO:teuthology.orchestra.run.smithi040.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-12T17:09:25.384 INFO:teuthology.orchestra.run.smithi040.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-12T17:09:25.384 INFO:teuthology.orchestra.run.smithi040.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-12T17:09:25.384 INFO:teuthology.orchestra.run.smithi040.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-12T17:09:25.384 INFO:teuthology.orchestra.run.smithi040.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-12T17:09:25.385 INFO:teuthology.orchestra.run.smithi040.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-12T17:09:25.385 INFO:teuthology.orchestra.run.smithi040.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-12T17:09:25.385 INFO:teuthology.orchestra.run.smithi040.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-12T17:09:25.385 INFO:teuthology.orchestra.run.smithi040.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-12T17:09:25.385 INFO:teuthology.orchestra.run.smithi040.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-12T17:09:25.385 INFO:teuthology.orchestra.run.smithi040.stdout: rbd-fuse-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:09:25.385 INFO:teuthology.orchestra.run.smithi040.stdout: rbd-mirror-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:09:25.385 INFO:teuthology.orchestra.run.smithi040.stdout: rbd-nbd-2:19.3.0-4762.gbad475c1.el9.x86_64 2024-09-12T17:09:25.385 INFO:teuthology.orchestra.run.smithi040.stdout: re2-1:20211101-20.el9.x86_64 2024-09-12T17:09:25.385 INFO:teuthology.orchestra.run.smithi040.stdout: rtkit-0.11-29.el9.x86_64 2024-09-12T17:09:25.385 INFO:teuthology.orchestra.run.smithi040.stdout: s3cmd-2.4.0-1.el9.noarch 2024-09-12T17:09:25.385 INFO:teuthology.orchestra.run.smithi040.stdout: sisu-1:0.3.4-10.el9.noarch 2024-09-12T17:09:25.385 INFO:teuthology.orchestra.run.smithi040.stdout: slf4j-1.7.30-13.el9.noarch 2024-09-12T17:09:25.386 INFO:teuthology.orchestra.run.smithi040.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-12T17:09:25.386 INFO:teuthology.orchestra.run.smithi040.stdout: sound-theme-freedesktop-0.8-17.el9.noarch 2024-09-12T17:09:25.386 INFO:teuthology.orchestra.run.smithi040.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-12T17:09:25.386 INFO:teuthology.orchestra.run.smithi040.stdout: totem-pl-parser-3.26.6-2.el9.x86_64 2024-09-12T17:09:25.386 INFO:teuthology.orchestra.run.smithi040.stdout: tracker-3.1.2-3.el9.x86_64 2024-09-12T17:09:25.386 INFO:teuthology.orchestra.run.smithi040.stdout: tracker-miners-3.1.2-4.el9.x86_64 2024-09-12T17:09:25.386 INFO:teuthology.orchestra.run.smithi040.stdout: ttmkfdir-3.0.9-65.el9.x86_64 2024-09-12T17:09:25.386 INFO:teuthology.orchestra.run.smithi040.stdout: tzdata-java-2024a-2.el9.noarch 2024-09-12T17:09:25.386 INFO:teuthology.orchestra.run.smithi040.stdout: upower-0.99.11-11.el9.x86_64 2024-09-12T17:09:25.386 INFO:teuthology.orchestra.run.smithi040.stdout: webrtc-audio-processing-0.3.1-8.el9.x86_64 2024-09-12T17:09:25.386 INFO:teuthology.orchestra.run.smithi040.stdout: wireplumber-0.4.14-1.el9.x86_64 2024-09-12T17:09:25.386 INFO:teuthology.orchestra.run.smithi040.stdout: wireplumber-libs-0.4.14-1.el9.x86_64 2024-09-12T17:09:25.386 INFO:teuthology.orchestra.run.smithi040.stdout: xdg-dbus-proxy-0.1.3-1.el9.x86_64 2024-09-12T17:09:25.387 INFO:teuthology.orchestra.run.smithi040.stdout: xdg-desktop-portal-1.12.6-1.el9.x86_64 2024-09-12T17:09:25.387 INFO:teuthology.orchestra.run.smithi040.stdout: xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 2024-09-12T17:09:25.387 INFO:teuthology.orchestra.run.smithi040.stdout: xkeyboard-config-2.33-2.el9.noarch 2024-09-12T17:09:25.387 INFO:teuthology.orchestra.run.smithi040.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-12T17:09:25.387 INFO:teuthology.orchestra.run.smithi040.stdout: xorg-x11-fonts-Type1-7.5-33.el9.noarch 2024-09-12T17:09:25.387 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-12T17:09:25.387 INFO:teuthology.orchestra.run.smithi040.stdout:Complete! 2024-09-12T17:09:25.804 DEBUG:teuthology.parallel:result is None 2024-09-12T17:09:25.805 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T17:09:25.966 DEBUG:teuthology.orchestra.run.smithi037:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-12T17:09:26.039 INFO:teuthology.orchestra.run.smithi037.stdout:19.3.0-4762.gbad475c1.el9 2024-09-12T17:09:26.040 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4762.gbad475c1.el9 2024-09-12T17:09:26.040 INFO:teuthology.task.install:The correct ceph version 19.3.0-4762.gbad475c1 is installed. 2024-09-12T17:09:26.046 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T17:09:26.197 DEBUG:teuthology.orchestra.run.smithi040:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-12T17:09:26.265 INFO:teuthology.orchestra.run.smithi040.stdout:19.3.0-4762.gbad475c1.el9 2024-09-12T17:09:26.266 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4762.gbad475c1.el9 2024-09-12T17:09:26.266 INFO:teuthology.task.install:The correct ceph version 19.3.0-4762.gbad475c1 is installed. 2024-09-12T17:09:26.268 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-12T17:09:26.268 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-09-12T17:09:26.268 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T17:09:26.317 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-09-12T17:09:26.317 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T17:09:26.365 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-12T17:09:26.365 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-09-12T17:09:26.366 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T17:09:26.412 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T17:09:26.496 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-09-12T17:09:26.496 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T17:09:26.542 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T17:09:26.626 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-12T17:09:26.627 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-09-12T17:09:26.627 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T17:09:26.671 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T17:09:26.752 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-09-12T17:09:26.752 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T17:09:26.797 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T17:09:26.880 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-12T17:09:26.880 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-09-12T17:09:26.880 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T17:09:26.921 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T17:09:27.003 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-09-12T17:09:27.003 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T17:09:27.047 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T17:09:27.129 INFO:teuthology.run_tasks:Running task ceph... 2024-09-12T17:09:27.211 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-12T17:09:27.211 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 777 /var/log/ceph 2024-09-12T17:09:27.214 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod 777 /var/log/ceph 2024-09-12T17:09:27.255 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-12T17:09:27.255 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-12T17:09:27.296 DEBUG:teuthology.orchestra.run.smithi040:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-12T17:09:27.335 INFO:tasks.ceph:Creating extra log directories... 2024-09-12T17:09:27.336 DEBUG:teuthology.orchestra.run.smithi037:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-12T17:09:27.375 DEBUG:teuthology.orchestra.run.smithi040:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-12T17:09:27.427 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-12T17:09:27.427 INFO:tasks.ceph:config {'conf': {'client': {'debug rgw': 20, 'debug rgw notification': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw d3n l1 datacache persistent path': '/tmp/rgw_datacache/', 'rgw d3n l1 datacache size': 10737418240, 'rgw d3n l1 local datacache enabled': True, 'rgw enable ops log': True, 'rgw max chunk size': 4194304, 'rgw obj stripe size': 6291456, 'rgw reshard progress judge interval': 10, 'rgw s3 auth use sts': True, 'rgw sts key': 'abcdefghijklmnop', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'global': {'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd heartbeat grace': 40, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon osd crush smoke test': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug objclass': 20, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', '\\(OSD_SLOW_PING_TIME'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-12T17:09:27.427 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902711', 'branch': 'wip-rgw-meta-handlers', 'description': 'rgw/verify/{0-install accounts$/{none} clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec-profile s3tests-branch sharding$/{default} striping$/{stripe-greater-than-chunk} supported-random-distro$/{centos_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/valgrind}', 'email': None, 'first_in_suite': False, 'job_id': '7902711', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 10}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-rgw-meta-handlers'}, 'ceph': {'conf': {'client': {'debug rgw': 20, 'debug rgw notification': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw d3n l1 datacache persistent path': '/tmp/rgw_datacache/', 'rgw d3n l1 datacache size': 10737418240, 'rgw d3n l1 local datacache enabled': True, 'rgw enable ops log': True, 'rgw max chunk size': 4194304, 'rgw obj stripe size': 6291456, 'rgw reshard progress judge interval': 10, 'rgw s3 auth use sts': True, 'rgw sts key': 'abcdefghijklmnop', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'global': {'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd heartbeat grace': 40, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon osd crush smoke test': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug objclass': 20, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', '\\(OSD_SLOW_PING_TIME'], 'sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'}}, 'rgw': {'client.0': {'valgrind': ['--tool=memcheck', '--max-threads=1024']}, 'compression type': 'random', 'datacache': True, 'datacache_path': '/tmp/rgw_datacache', 'ec-data-pool': True, 'erasure_code_profile': {'crush-failure-domain': 'osd', 'k': 3, 'm': 1, 'name': 'testprofile'}, 'frontend': 'beast', 'storage classes': 'LUKEWARM, FROZEN'}, 's3tests': {'accounts': {'iam alt root': 'RGW99999999999999999', 'iam root': 'RGW88888888888888888'}, 'force-branch': 'ceph-master', 'slow_backend': True, 'storage classes': 'LUKEWARM, FROZEN'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-rgw-meta-handlers', 'sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'}}, 'owner': 'scheduled_cbodley@teuthology', 'priority': 90, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'], ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']], 'seed': 6279, 'sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b', 'sleep_before_teardown': 0, 'suite': 'rgw', 'suite_branch': 'wip-rgw-meta-handlers', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_bad475c18c96ec20c5778159aa33ba72b84e9c1b/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b', 'targets': {'smithi037.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBGAhRw41FuHuy5Iv7xRIO9Q/6JDidEVorpOjOF4A4t55UlvT4RSCPc17L7x1yJJs8WSwNmuzkPK/yw9tYBa7Xs=', 'smithi040.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKxlcDw2UzZOD/UXVwHiu6PNn4X5IxbOPq2HU6Yz6q2PPWcsHIl+TBjN9RdtLbgLMhyRfnKNQITsk6BJUJEqYbk='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'flavor': 'default', 'sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'}}, {'ceph': None}, {'openssl_keys': None}, {'rgw': {'client.0': None}}, {'tox': ['client.0']}, {'workunit': {'clients': {'client.0': ['rgw/run-datacache.sh']}, 'env': {'RGW_DATACACHE_PATH': '/tmp/rgw_datacache'}}}, {'workunit': {'clients': {'client.0': ['rgw/run-bucket-check.sh']}}}, {'workunit': {'clients': {'client.0': ['cls/test_cls_lock.sh', 'cls/test_cls_log.sh', 'cls/test_cls_refcount.sh', 'cls/test_cls_rgw.sh', 'cls/test_cls_rgw_gc.sh', 'cls/test_cls_rgw_stats.sh', 'cls/test_cls_cmpomap.sh', 'cls/test_cls_2pc_queue.sh', 'cls/test_cls_user.sh', 'rgw/test_rgw_gc_log.sh', 'rgw/test_rgw_obj.sh', 'rgw/test_librgw_file.sh', 'rgw/test_awssdkv4_sig.sh']}}}, {'workunit': {'clients': {'client.0': ['rgw/test_rgw_s3_mp_reupload.sh']}}}, {'ragweed': {'client.0': {'default-branch': 'ceph-master', 'rgw_server': 'client.0', 'stages': 'prepare,check'}}}, {'workunit': {'clients': {'client.0': ['rgw/run-reshard.sh']}}}, {'s3tests-java': {'client.0': {'force-branch': 'ceph-master', 'force-repo': 'https://github.com/ceph/java_s3tests.git'}}}, {'s3tests': {'client.0': {'rgw_server': 'client.0'}}}, {'workunit': {'clients': {'client.0': ['rgw/run-versioning.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-12_15:39:52', 'tube': 'smithi', 'user': 'cbodley', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-12T17:09:27.427 DEBUG:teuthology.orchestra.run.smithi037:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-12T17:09:27.456 DEBUG:teuthology.orchestra.run.smithi040:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-12T17:09:27.487 DEBUG:teuthology.orchestra.run.smithi037:> sudo install -d -m0777 -- /var/run/ceph 2024-09-12T17:09:27.526 DEBUG:teuthology.orchestra.run.smithi040:> sudo install -d -m0777 -- /var/run/ceph 2024-09-12T17:09:27.566 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-09-12T17:09:27.567 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/scratch_devs of=/dev/stdout 2024-09-12T17:09:27.634 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-12T17:09:27.634 DEBUG:teuthology.orchestra.run.smithi037:> stat /dev/vg_nvme/lv_1 2024-09-12T17:09:27.703 INFO:teuthology.orchestra.run.smithi037.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-12T17:09:27.703 INFO:teuthology.orchestra.run.smithi037.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T17:09:27.704 INFO:teuthology.orchestra.run.smithi037.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-12T17:09:27.704 INFO:teuthology.orchestra.run.smithi037.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T17:09:27.704 INFO:teuthology.orchestra.run.smithi037.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T17:09:27.704 INFO:teuthology.orchestra.run.smithi037.stdout:Access: 2024-09-12 17:08:46.214410596 +0000 2024-09-12T17:09:27.704 INFO:teuthology.orchestra.run.smithi037.stdout:Modify: 2024-09-12 17:06:04.280124383 +0000 2024-09-12T17:09:27.704 INFO:teuthology.orchestra.run.smithi037.stdout:Change: 2024-09-12 17:06:04.280124383 +0000 2024-09-12T17:09:27.704 INFO:teuthology.orchestra.run.smithi037.stdout: Birth: 2024-09-12 17:06:04.280124383 +0000 2024-09-12T17:09:27.704 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-12T17:09:27.783 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records in 2024-09-12T17:09:27.783 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records out 2024-09-12T17:09:27.783 INFO:teuthology.orchestra.run.smithi037.stderr:512 bytes copied, 0.000191454 s, 2.7 MB/s 2024-09-12T17:09:27.784 DEBUG:teuthology.orchestra.run.smithi037:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-12T17:09:27.855 DEBUG:teuthology.orchestra.run.smithi037:> stat /dev/vg_nvme/lv_2 2024-09-12T17:09:27.925 INFO:teuthology.orchestra.run.smithi037.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-12T17:09:27.925 INFO:teuthology.orchestra.run.smithi037.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T17:09:27.925 INFO:teuthology.orchestra.run.smithi037.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-09-12T17:09:27.925 INFO:teuthology.orchestra.run.smithi037.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T17:09:27.925 INFO:teuthology.orchestra.run.smithi037.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T17:09:27.925 INFO:teuthology.orchestra.run.smithi037.stdout:Access: 2024-09-12 17:08:46.214410596 +0000 2024-09-12T17:09:27.925 INFO:teuthology.orchestra.run.smithi037.stdout:Modify: 2024-09-12 17:06:04.617119752 +0000 2024-09-12T17:09:27.925 INFO:teuthology.orchestra.run.smithi037.stdout:Change: 2024-09-12 17:06:04.617119752 +0000 2024-09-12T17:09:27.925 INFO:teuthology.orchestra.run.smithi037.stdout: Birth: 2024-09-12 17:06:04.617119752 +0000 2024-09-12T17:09:27.925 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-12T17:09:28.003 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records in 2024-09-12T17:09:28.004 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records out 2024-09-12T17:09:28.004 INFO:teuthology.orchestra.run.smithi037.stderr:512 bytes copied, 0.000207276 s, 2.5 MB/s 2024-09-12T17:09:28.005 DEBUG:teuthology.orchestra.run.smithi037:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-12T17:09:28.076 DEBUG:teuthology.orchestra.run.smithi037:> stat /dev/vg_nvme/lv_3 2024-09-12T17:09:28.146 INFO:teuthology.orchestra.run.smithi037.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-12T17:09:28.146 INFO:teuthology.orchestra.run.smithi037.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T17:09:28.146 INFO:teuthology.orchestra.run.smithi037.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-09-12T17:09:28.146 INFO:teuthology.orchestra.run.smithi037.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T17:09:28.146 INFO:teuthology.orchestra.run.smithi037.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T17:09:28.146 INFO:teuthology.orchestra.run.smithi037.stdout:Access: 2024-09-12 17:08:46.215410582 +0000 2024-09-12T17:09:28.146 INFO:teuthology.orchestra.run.smithi037.stdout:Modify: 2024-09-12 17:06:04.948115203 +0000 2024-09-12T17:09:28.146 INFO:teuthology.orchestra.run.smithi037.stdout:Change: 2024-09-12 17:06:04.948115203 +0000 2024-09-12T17:09:28.147 INFO:teuthology.orchestra.run.smithi037.stdout: Birth: 2024-09-12 17:06:04.948115203 +0000 2024-09-12T17:09:28.147 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-12T17:09:28.224 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records in 2024-09-12T17:09:28.224 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records out 2024-09-12T17:09:28.224 INFO:teuthology.orchestra.run.smithi037.stderr:512 bytes copied, 0.000172657 s, 3.0 MB/s 2024-09-12T17:09:28.225 DEBUG:teuthology.orchestra.run.smithi037:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-12T17:09:28.296 DEBUG:teuthology.orchestra.run.smithi037:> stat /dev/vg_nvme/lv_4 2024-09-12T17:09:28.367 INFO:teuthology.orchestra.run.smithi037.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-12T17:09:28.368 INFO:teuthology.orchestra.run.smithi037.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T17:09:28.368 INFO:teuthology.orchestra.run.smithi037.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-12T17:09:28.368 INFO:teuthology.orchestra.run.smithi037.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T17:09:28.368 INFO:teuthology.orchestra.run.smithi037.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T17:09:28.368 INFO:teuthology.orchestra.run.smithi037.stdout:Access: 2024-09-12 17:08:46.215410582 +0000 2024-09-12T17:09:28.368 INFO:teuthology.orchestra.run.smithi037.stdout:Modify: 2024-09-12 17:06:05.271110763 +0000 2024-09-12T17:09:28.368 INFO:teuthology.orchestra.run.smithi037.stdout:Change: 2024-09-12 17:06:05.271110763 +0000 2024-09-12T17:09:28.368 INFO:teuthology.orchestra.run.smithi037.stdout: Birth: 2024-09-12 17:06:05.271110763 +0000 2024-09-12T17:09:28.369 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-12T17:09:28.446 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records in 2024-09-12T17:09:28.446 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records out 2024-09-12T17:09:28.446 INFO:teuthology.orchestra.run.smithi037.stderr:512 bytes copied, 0.000185055 s, 2.8 MB/s 2024-09-12T17:09:28.447 DEBUG:teuthology.orchestra.run.smithi037:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-12T17:09:28.517 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T17:09:28.518 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-09-12T17:09:28.518 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/scratch_devs of=/dev/stdout 2024-09-12T17:09:28.553 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-12T17:09:28.554 DEBUG:teuthology.orchestra.run.smithi040:> stat /dev/vg_nvme/lv_1 2024-09-12T17:09:28.627 INFO:teuthology.orchestra.run.smithi040.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-12T17:09:28.628 INFO:teuthology.orchestra.run.smithi040.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T17:09:28.628 INFO:teuthology.orchestra.run.smithi040.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-09-12T17:09:28.628 INFO:teuthology.orchestra.run.smithi040.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T17:09:28.628 INFO:teuthology.orchestra.run.smithi040.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T17:09:28.628 INFO:teuthology.orchestra.run.smithi040.stdout:Access: 2024-09-12 17:09:13.005229712 +0000 2024-09-12T17:09:28.628 INFO:teuthology.orchestra.run.smithi040.stdout:Modify: 2024-09-12 17:06:06.272959747 +0000 2024-09-12T17:09:28.628 INFO:teuthology.orchestra.run.smithi040.stdout:Change: 2024-09-12 17:06:06.272959747 +0000 2024-09-12T17:09:28.628 INFO:teuthology.orchestra.run.smithi040.stdout: Birth: 2024-09-12 17:06:06.272959747 +0000 2024-09-12T17:09:28.629 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-12T17:09:28.711 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records in 2024-09-12T17:09:28.711 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records out 2024-09-12T17:09:28.711 INFO:teuthology.orchestra.run.smithi040.stderr:512 bytes copied, 0.000255018 s, 2.0 MB/s 2024-09-12T17:09:28.712 DEBUG:teuthology.orchestra.run.smithi040:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-12T17:09:28.786 DEBUG:teuthology.orchestra.run.smithi040:> stat /dev/vg_nvme/lv_2 2024-09-12T17:09:28.858 INFO:teuthology.orchestra.run.smithi040.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-12T17:09:28.859 INFO:teuthology.orchestra.run.smithi040.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T17:09:28.859 INFO:teuthology.orchestra.run.smithi040.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-12T17:09:28.859 INFO:teuthology.orchestra.run.smithi040.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T17:09:28.859 INFO:teuthology.orchestra.run.smithi040.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T17:09:28.859 INFO:teuthology.orchestra.run.smithi040.stdout:Access: 2024-09-12 17:09:13.006229700 +0000 2024-09-12T17:09:28.859 INFO:teuthology.orchestra.run.smithi040.stdout:Modify: 2024-09-12 17:06:06.619955623 +0000 2024-09-12T17:09:28.859 INFO:teuthology.orchestra.run.smithi040.stdout:Change: 2024-09-12 17:06:06.619955623 +0000 2024-09-12T17:09:28.859 INFO:teuthology.orchestra.run.smithi040.stdout: Birth: 2024-09-12 17:06:06.619955623 +0000 2024-09-12T17:09:28.859 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-12T17:09:28.937 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records in 2024-09-12T17:09:28.938 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records out 2024-09-12T17:09:28.938 INFO:teuthology.orchestra.run.smithi040.stderr:512 bytes copied, 0.000214362 s, 2.4 MB/s 2024-09-12T17:09:28.939 DEBUG:teuthology.orchestra.run.smithi040:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-12T17:09:29.011 DEBUG:teuthology.orchestra.run.smithi040:> stat /dev/vg_nvme/lv_3 2024-09-12T17:09:29.082 INFO:teuthology.orchestra.run.smithi040.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-12T17:09:29.082 INFO:teuthology.orchestra.run.smithi040.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T17:09:29.082 INFO:teuthology.orchestra.run.smithi040.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-12T17:09:29.082 INFO:teuthology.orchestra.run.smithi040.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T17:09:29.082 INFO:teuthology.orchestra.run.smithi040.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T17:09:29.082 INFO:teuthology.orchestra.run.smithi040.stdout:Access: 2024-09-12 17:09:13.006229700 +0000 2024-09-12T17:09:29.082 INFO:teuthology.orchestra.run.smithi040.stdout:Modify: 2024-09-12 17:06:06.953951654 +0000 2024-09-12T17:09:29.082 INFO:teuthology.orchestra.run.smithi040.stdout:Change: 2024-09-12 17:06:06.953951654 +0000 2024-09-12T17:09:29.083 INFO:teuthology.orchestra.run.smithi040.stdout: Birth: 2024-09-12 17:06:06.953951654 +0000 2024-09-12T17:09:29.083 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-12T17:09:29.161 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records in 2024-09-12T17:09:29.162 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records out 2024-09-12T17:09:29.162 INFO:teuthology.orchestra.run.smithi040.stderr:512 bytes copied, 0.000210707 s, 2.4 MB/s 2024-09-12T17:09:29.163 DEBUG:teuthology.orchestra.run.smithi040:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-12T17:09:29.234 DEBUG:teuthology.orchestra.run.smithi040:> stat /dev/vg_nvme/lv_4 2024-09-12T17:09:29.305 INFO:teuthology.orchestra.run.smithi040.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-12T17:09:29.305 INFO:teuthology.orchestra.run.smithi040.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T17:09:29.305 INFO:teuthology.orchestra.run.smithi040.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-09-12T17:09:29.305 INFO:teuthology.orchestra.run.smithi040.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T17:09:29.305 INFO:teuthology.orchestra.run.smithi040.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T17:09:29.305 INFO:teuthology.orchestra.run.smithi040.stdout:Access: 2024-09-12 17:09:13.007229687 +0000 2024-09-12T17:09:29.305 INFO:teuthology.orchestra.run.smithi040.stdout:Modify: 2024-09-12 17:06:07.284947721 +0000 2024-09-12T17:09:29.306 INFO:teuthology.orchestra.run.smithi040.stdout:Change: 2024-09-12 17:06:07.284947721 +0000 2024-09-12T17:09:29.306 INFO:teuthology.orchestra.run.smithi040.stdout: Birth: 2024-09-12 17:06:07.284947721 +0000 2024-09-12T17:09:29.306 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-12T17:09:29.384 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records in 2024-09-12T17:09:29.384 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records out 2024-09-12T17:09:29.384 INFO:teuthology.orchestra.run.smithi040.stderr:512 bytes copied, 0.000183009 s, 2.8 MB/s 2024-09-12T17:09:29.385 DEBUG:teuthology.orchestra.run.smithi040:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-12T17:09:29.455 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T17:09:29.456 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi037.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi040.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-12T17:09:29.456 INFO:tasks.ceph:Generating config... 2024-09-12T17:09:29.457 INFO:tasks.ceph:[client] debug rgw = 20 2024-09-12T17:09:29.457 INFO:tasks.ceph:[client] debug rgw notification = 20 2024-09-12T17:09:29.457 INFO:tasks.ceph:[client] rgw bucket counters cache = True 2024-09-12T17:09:29.457 INFO:tasks.ceph:[client] rgw crypt require ssl = False 2024-09-12T17:09:29.457 INFO:tasks.ceph:[client] rgw crypt s3 kms backend = testing 2024-09-12T17:09:29.457 INFO:tasks.ceph:[client] rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-09-12T17:09:29.458 INFO:tasks.ceph:[client] rgw d3n l1 datacache persistent path = /tmp/rgw_datacache/ 2024-09-12T17:09:29.458 INFO:tasks.ceph:[client] rgw d3n l1 datacache size = 10737418240 2024-09-12T17:09:29.458 INFO:tasks.ceph:[client] rgw d3n l1 local datacache enabled = True 2024-09-12T17:09:29.458 INFO:tasks.ceph:[client] rgw enable ops log = True 2024-09-12T17:09:29.458 INFO:tasks.ceph:[client] rgw max chunk size = 4194304 2024-09-12T17:09:29.458 INFO:tasks.ceph:[client] rgw obj stripe size = 6291456 2024-09-12T17:09:29.458 INFO:tasks.ceph:[client] rgw reshard progress judge interval = 10 2024-09-12T17:09:29.458 INFO:tasks.ceph:[client] rgw s3 auth use sts = True 2024-09-12T17:09:29.458 INFO:tasks.ceph:[client] rgw sts key = abcdefghijklmnop 2024-09-12T17:09:29.458 INFO:tasks.ceph:[client] rgw torrent flag = True 2024-09-12T17:09:29.458 INFO:tasks.ceph:[client] rgw user counters cache = True 2024-09-12T17:09:29.458 INFO:tasks.ceph:[client] setgroup = ceph 2024-09-12T17:09:29.458 INFO:tasks.ceph:[client] setuser = ceph 2024-09-12T17:09:29.458 INFO:tasks.ceph:[global] mon client directed command retry = 5 2024-09-12T17:09:29.459 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2024-09-12T17:09:29.459 INFO:tasks.ceph:[global] osd heartbeat grace = 40 2024-09-12T17:09:29.459 INFO:tasks.ceph:[global] osd_max_pg_log_entries = 10 2024-09-12T17:09:29.459 INFO:tasks.ceph:[global] osd_min_pg_log_entries = 10 2024-09-12T17:09:29.459 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-12T17:09:29.459 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-12T17:09:29.459 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-12T17:09:29.459 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-12T17:09:29.459 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-12T17:09:29.459 INFO:tasks.ceph:[mon] mon osd crush smoke test = False 2024-09-12T17:09:29.459 INFO:tasks.ceph:[osd] bdev async discard = True 2024-09-12T17:09:29.459 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-09-12T17:09:29.459 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-09-12T17:09:29.459 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-12T17:09:29.459 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-12T17:09:29.460 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-12T17:09:29.460 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-12T17:09:29.460 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-12T17:09:29.460 INFO:tasks.ceph:[osd] debug objclass = 20 2024-09-12T17:09:29.460 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-12T17:09:29.460 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-12T17:09:29.460 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-12T17:09:29.460 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-12T17:09:29.460 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-12T17:09:29.460 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-12T17:09:29.460 INFO:tasks.ceph:[osd] osd fast shutdown = False 2024-09-12T17:09:29.460 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-12T17:09:29.460 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2024-09-12T17:09:29.461 INFO:tasks.ceph:Setting up mon.a... 2024-09-12T17:09:29.461 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-12T17:09:29.537 INFO:teuthology.orchestra.run.smithi037.stdout:creating /etc/ceph/ceph.keyring 2024-09-12T17:09:29.541 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-12T17:09:29.602 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T17:09:29.643 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.37'), ('mon.c', '[v2:172.21.15.37:3301,v1:172.21.15.37:6790]'), ('mon.b', '172.21.15.40')] 2024-09-12T17:09:29.643 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.37,[v2:172.21.15.37:3301,v1:172.21.15.37:6790],172.21.15.40', 'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd heartbeat grace': 40, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug objclass': 20, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon osd crush smoke test': False}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': True, 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug rgw': 20, 'debug rgw notification': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw d3n l1 datacache persistent path': '/tmp/rgw_datacache/', 'rgw d3n l1 datacache size': 10737418240, 'rgw d3n l1 local datacache enabled': True, 'rgw max chunk size': 4194304, 'rgw obj stripe size': 6291456, 'rgw reshard progress judge interval': 10, 'rgw s3 auth use sts': True, 'rgw sts key': 'abcdefghijklmnop', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mon.a': {}, 'mon.c': {}, 'mon.b': {}} 2024-09-12T17:09:29.644 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-09-12T17:09:29.644 DEBUG:teuthology.orchestra.run.smithi037:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-12T17:09:29.713 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.37 --addv c '[v2:172.21.15.37:3301,v1:172.21.15.37:6790]' --add b 172.21.15.40 --print /home/ubuntu/cephtest/ceph.monmap 2024-09-12T17:09:29.814 INFO:teuthology.orchestra.run.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:09:29.814 INFO:teuthology.orchestra.run.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:09:29.814 INFO:teuthology.orchestra.run.smithi037.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-12T17:09:29.815 INFO:teuthology.orchestra.run.smithi037.stdout:monmaptool: generated fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:09:29.815 INFO:teuthology.orchestra.run.smithi037.stdout:setting min_mon_release = quincy 2024-09-12T17:09:29.815 INFO:teuthology.orchestra.run.smithi037.stdout:epoch 0 2024-09-12T17:09:29.815 INFO:teuthology.orchestra.run.smithi037.stdout:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:09:29.815 INFO:teuthology.orchestra.run.smithi037.stdout:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:09:29.815 INFO:teuthology.orchestra.run.smithi037.stdout:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:09:29.815 INFO:teuthology.orchestra.run.smithi037.stdout:min_mon_release 17 (quincy) 2024-09-12T17:09:29.816 INFO:teuthology.orchestra.run.smithi037.stdout:election_strategy: 1 2024-09-12T17:09:29.816 INFO:teuthology.orchestra.run.smithi037.stdout:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:09:29.816 INFO:teuthology.orchestra.run.smithi037.stdout:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:09:29.816 INFO:teuthology.orchestra.run.smithi037.stdout:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:09:29.816 INFO:teuthology.orchestra.run.smithi037.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-12T17:09:29.817 DEBUG:teuthology.orchestra.run.smithi037:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-12T17:09:29.846 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 46ca2ab5-4447-4511-b6c4-0ec801120127... 2024-09-12T17:09:29.847 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-12T17:09:29.889 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-12T17:09:29.945 INFO:teuthology.orchestra.run.smithi037.stdout:[global] 2024-09-12T17:09:29.945 INFO:teuthology.orchestra.run.smithi037.stdout: chdir = "" 2024-09-12T17:09:29.945 INFO:teuthology.orchestra.run.smithi037.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-12T17:09:29.945 INFO:teuthology.orchestra.run.smithi037.stdout: auth supported = cephx 2024-09-12T17:09:29.945 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:09:29.945 INFO:teuthology.orchestra.run.smithi037.stdout: filestore xattr use omap = true 2024-09-12T17:09:29.945 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:09:29.945 INFO:teuthology.orchestra.run.smithi037.stdout: mon clock drift allowed = 1.000 2024-09-12T17:09:29.945 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:09:29.946 INFO:teuthology.orchestra.run.smithi037.stdout: osd crush chooseleaf type = 0 2024-09-12T17:09:29.946 INFO:teuthology.orchestra.run.smithi037.stdout: auth debug = true 2024-09-12T17:09:29.946 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:09:29.946 INFO:teuthology.orchestra.run.smithi037.stdout: ms die on old message = true 2024-09-12T17:09:29.946 INFO:teuthology.orchestra.run.smithi037.stdout: ms die on bug = true 2024-09-12T17:09:29.946 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:09:29.946 INFO:teuthology.orchestra.run.smithi037.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-12T17:09:29.946 INFO:teuthology.orchestra.run.smithi037.stdout: mon pg warn max object skew = 0 2024-09-12T17:09:29.946 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:09:29.946 INFO:teuthology.orchestra.run.smithi037.stdout: # disable pg_autoscaler by default for new pools 2024-09-12T17:09:29.946 INFO:teuthology.orchestra.run.smithi037.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-12T17:09:29.946 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:09:29.947 INFO:teuthology.orchestra.run.smithi037.stdout: osd pool default size = 2 2024-09-12T17:09:29.947 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:09:29.947 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd allow primary affinity = true 2024-09-12T17:09:29.947 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd allow pg remap = true 2024-09-12T17:09:29.947 INFO:teuthology.orchestra.run.smithi037.stdout: mon warn on legacy crush tunables = false 2024-09-12T17:09:29.947 INFO:teuthology.orchestra.run.smithi037.stdout: mon warn on crush straw calc version zero = false 2024-09-12T17:09:29.947 INFO:teuthology.orchestra.run.smithi037.stdout: mon warn on no sortbitwise = false 2024-09-12T17:09:29.947 INFO:teuthology.orchestra.run.smithi037.stdout: mon warn on osd down out interval zero = false 2024-09-12T17:09:29.947 INFO:teuthology.orchestra.run.smithi037.stdout: mon warn on too few osds = false 2024-09-12T17:09:29.947 INFO:teuthology.orchestra.run.smithi037.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-12T17:09:29.947 INFO:teuthology.orchestra.run.smithi037.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-12T17:09:29.947 INFO:teuthology.orchestra.run.smithi037.stdout: mon_allow_pool_size_one = true 2024-09-12T17:09:29.947 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:09:29.947 INFO:teuthology.orchestra.run.smithi037.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-12T17:09:29.948 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:09:29.948 INFO:teuthology.orchestra.run.smithi037.stdout: osd default data pool replay window = 5 2024-09-12T17:09:29.948 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:09:29.948 INFO:teuthology.orchestra.run.smithi037.stdout: mon allow pool delete = true 2024-09-12T17:09:29.948 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:09:29.948 INFO:teuthology.orchestra.run.smithi037.stdout: mon cluster log file level = debug 2024-09-12T17:09:29.948 INFO:teuthology.orchestra.run.smithi037.stdout: debug asserts on shutdown = true 2024-09-12T17:09:29.948 INFO:teuthology.orchestra.run.smithi037.stdout: mon health detail to clog = false 2024-09-12T17:09:29.948 INFO:teuthology.orchestra.run.smithi037.stdout: mon host = "172.21.15.37,[v2:172.21.15.37:3301,v1:172.21.15.37:6790],172.21.15.40" 2024-09-12T17:09:29.948 INFO:teuthology.orchestra.run.smithi037.stdout: mon client directed command retry = 5 2024-09-12T17:09:29.948 INFO:teuthology.orchestra.run.smithi037.stdout: ms inject socket failures = 5000 2024-09-12T17:09:29.948 INFO:teuthology.orchestra.run.smithi037.stdout: osd heartbeat grace = 40 2024-09-12T17:09:29.948 INFO:teuthology.orchestra.run.smithi037.stdout: osd_max_pg_log_entries = 10 2024-09-12T17:09:29.949 INFO:teuthology.orchestra.run.smithi037.stdout: osd_min_pg_log_entries = 10 2024-09-12T17:09:29.949 INFO:teuthology.orchestra.run.smithi037.stdout: fsid = 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:09:29.949 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:09:29.949 INFO:teuthology.orchestra.run.smithi037.stdout:[osd] 2024-09-12T17:09:29.949 INFO:teuthology.orchestra.run.smithi037.stdout: osd journal size = 100 2024-09-12T17:09:29.949 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:09:29.949 INFO:teuthology.orchestra.run.smithi037.stdout: osd scrub load threshold = 5.0 2024-09-12T17:09:29.949 INFO:teuthology.orchestra.run.smithi037.stdout: osd scrub max interval = 600 2024-09-12T17:09:29.949 INFO:teuthology.orchestra.run.smithi037.stdout: osd mclock profile = high_recovery_ops 2024-09-12T17:09:29.949 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:09:29.949 INFO:teuthology.orchestra.run.smithi037.stdout: osd recover clone overlap = true 2024-09-12T17:09:29.950 INFO:teuthology.orchestra.run.smithi037.stdout: osd recovery max chunk = 1048576 2024-09-12T17:09:29.950 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:09:29.950 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug shutdown = true 2024-09-12T17:09:29.950 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug op order = true 2024-09-12T17:09:29.950 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug verify stray on activate = true 2024-09-12T17:09:29.950 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug trim objects = true 2024-09-12T17:09:29.950 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:09:29.950 INFO:teuthology.orchestra.run.smithi037.stdout: osd open classes on start = true 2024-09-12T17:09:29.950 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug pg log writeout = true 2024-09-12T17:09:29.950 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:09:29.950 INFO:teuthology.orchestra.run.smithi037.stdout: osd deep scrub update digest min age = 30 2024-09-12T17:09:29.950 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:09:29.950 INFO:teuthology.orchestra.run.smithi037.stdout: osd map max advance = 10 2024-09-12T17:09:29.951 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:09:29.951 INFO:teuthology.orchestra.run.smithi037.stdout: journal zero on create = true 2024-09-12T17:09:29.951 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:09:29.951 INFO:teuthology.orchestra.run.smithi037.stdout: filestore ondisk finisher threads = 3 2024-09-12T17:09:29.951 INFO:teuthology.orchestra.run.smithi037.stdout: filestore apply finisher threads = 3 2024-09-12T17:09:29.951 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:09:29.951 INFO:teuthology.orchestra.run.smithi037.stdout: bdev debug aio = true 2024-09-12T17:09:29.951 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug misdirected ops = true 2024-09-12T17:09:29.951 INFO:teuthology.orchestra.run.smithi037.stdout: bdev async discard = True 2024-09-12T17:09:29.951 INFO:teuthology.orchestra.run.smithi037.stdout: bdev enable discard = True 2024-09-12T17:09:29.951 INFO:teuthology.orchestra.run.smithi037.stdout: bluestore allocator = bitmap 2024-09-12T17:09:29.951 INFO:teuthology.orchestra.run.smithi037.stdout: bluestore block size = 96636764160 2024-09-12T17:09:29.951 INFO:teuthology.orchestra.run.smithi037.stdout: bluestore fsck on mount = True 2024-09-12T17:09:29.951 INFO:teuthology.orchestra.run.smithi037.stdout: debug bluefs = 1/20 2024-09-12T17:09:29.952 INFO:teuthology.orchestra.run.smithi037.stdout: debug bluestore = 1/20 2024-09-12T17:09:29.952 INFO:teuthology.orchestra.run.smithi037.stdout: debug ms = 1 2024-09-12T17:09:29.952 INFO:teuthology.orchestra.run.smithi037.stdout: debug objclass = 20 2024-09-12T17:09:29.952 INFO:teuthology.orchestra.run.smithi037.stdout: debug osd = 20 2024-09-12T17:09:29.952 INFO:teuthology.orchestra.run.smithi037.stdout: debug rocksdb = 4/10 2024-09-12T17:09:29.952 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd backfillfull_ratio = 0.85 2024-09-12T17:09:29.952 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd full ratio = 0.9 2024-09-12T17:09:29.952 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd nearfull ratio = 0.8 2024-09-12T17:09:29.952 INFO:teuthology.orchestra.run.smithi037.stdout: osd failsafe full ratio = 0.95 2024-09-12T17:09:29.952 INFO:teuthology.orchestra.run.smithi037.stdout: osd fast shutdown = False 2024-09-12T17:09:29.952 INFO:teuthology.orchestra.run.smithi037.stdout: osd objectstore = bluestore 2024-09-12T17:09:29.952 INFO:teuthology.orchestra.run.smithi037.stdout: osd shutdown pgref assert = True 2024-09-12T17:09:29.952 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:09:29.952 INFO:teuthology.orchestra.run.smithi037.stdout:[mgr] 2024-09-12T17:09:29.953 INFO:teuthology.orchestra.run.smithi037.stdout: debug ms = 1 2024-09-12T17:09:29.953 INFO:teuthology.orchestra.run.smithi037.stdout: debug mgr = 20 2024-09-12T17:09:29.953 INFO:teuthology.orchestra.run.smithi037.stdout: debug mon = 20 2024-09-12T17:09:29.953 INFO:teuthology.orchestra.run.smithi037.stdout: debug auth = 20 2024-09-12T17:09:29.953 INFO:teuthology.orchestra.run.smithi037.stdout: mon reweight min pgs per osd = 4 2024-09-12T17:09:29.953 INFO:teuthology.orchestra.run.smithi037.stdout: mon reweight min bytes per osd = 10 2024-09-12T17:09:29.953 INFO:teuthology.orchestra.run.smithi037.stdout: mgr/telemetry/nag = false 2024-09-12T17:09:29.953 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:09:29.953 INFO:teuthology.orchestra.run.smithi037.stdout:[mon] 2024-09-12T17:09:29.953 INFO:teuthology.orchestra.run.smithi037.stdout: debug ms = 1 2024-09-12T17:09:29.953 INFO:teuthology.orchestra.run.smithi037.stdout: debug mon = 20 2024-09-12T17:09:29.953 INFO:teuthology.orchestra.run.smithi037.stdout: debug paxos = 20 2024-09-12T17:09:29.953 INFO:teuthology.orchestra.run.smithi037.stdout: debug auth = 20 2024-09-12T17:09:29.953 INFO:teuthology.orchestra.run.smithi037.stdout: mon data avail warn = 5 2024-09-12T17:09:29.954 INFO:teuthology.orchestra.run.smithi037.stdout: mon mgr mkfs grace = 240 2024-09-12T17:09:29.954 INFO:teuthology.orchestra.run.smithi037.stdout: mon reweight min pgs per osd = 4 2024-09-12T17:09:29.954 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd reporter subtree level = osd 2024-09-12T17:09:29.954 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd prime pg temp = true 2024-09-12T17:09:29.954 INFO:teuthology.orchestra.run.smithi037.stdout: mon reweight min bytes per osd = 10 2024-09-12T17:09:29.954 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:09:29.954 INFO:teuthology.orchestra.run.smithi037.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-12T17:09:29.954 INFO:teuthology.orchestra.run.smithi037.stdout: auth mon ticket ttl = 660 # 11m 2024-09-12T17:09:29.954 INFO:teuthology.orchestra.run.smithi037.stdout: auth service ticket ttl = 240 # 4m 2024-09-12T17:09:29.954 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:09:29.954 INFO:teuthology.orchestra.run.smithi037.stdout: # don't complain about insecure global_id in the test suite 2024-09-12T17:09:29.954 INFO:teuthology.orchestra.run.smithi037.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-12T17:09:29.954 INFO:teuthology.orchestra.run.smithi037.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-12T17:09:29.955 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:09:29.955 INFO:teuthology.orchestra.run.smithi037.stdout: # 1m isn't quite enough 2024-09-12T17:09:29.955 INFO:teuthology.orchestra.run.smithi037.stdout: mon_down_mkfs_grace = 2m 2024-09-12T17:09:29.955 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:09:29.955 INFO:teuthology.orchestra.run.smithi037.stdout: mon_warn_on_filestore_osds = false 2024-09-12T17:09:29.955 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd crush smoke test = False 2024-09-12T17:09:29.955 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:09:29.955 INFO:teuthology.orchestra.run.smithi037.stdout:[client] 2024-09-12T17:09:29.955 INFO:teuthology.orchestra.run.smithi037.stdout: rgw cache enabled = true 2024-09-12T17:09:29.955 INFO:teuthology.orchestra.run.smithi037.stdout: rgw enable ops log = True 2024-09-12T17:09:29.955 INFO:teuthology.orchestra.run.smithi037.stdout: rgw enable usage log = true 2024-09-12T17:09:29.955 INFO:teuthology.orchestra.run.smithi037.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-12T17:09:29.955 INFO:teuthology.orchestra.run.smithi037.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-12T17:09:29.955 INFO:teuthology.orchestra.run.smithi037.stdout: debug rgw = 20 2024-09-12T17:09:29.955 INFO:teuthology.orchestra.run.smithi037.stdout: debug rgw notification = 20 2024-09-12T17:09:29.956 INFO:teuthology.orchestra.run.smithi037.stdout: rgw bucket counters cache = True 2024-09-12T17:09:29.956 INFO:teuthology.orchestra.run.smithi037.stdout: rgw crypt require ssl = False 2024-09-12T17:09:29.956 INFO:teuthology.orchestra.run.smithi037.stdout: rgw crypt s3 kms backend = testing 2024-09-12T17:09:29.956 INFO:teuthology.orchestra.run.smithi037.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-09-12T17:09:29.956 INFO:teuthology.orchestra.run.smithi037.stdout: rgw d3n l1 datacache persistent path = /tmp/rgw_datacache/ 2024-09-12T17:09:29.956 INFO:teuthology.orchestra.run.smithi037.stdout: rgw d3n l1 datacache size = 10737418240 2024-09-12T17:09:29.956 INFO:teuthology.orchestra.run.smithi037.stdout: rgw d3n l1 local datacache enabled = True 2024-09-12T17:09:29.956 INFO:teuthology.orchestra.run.smithi037.stdout: rgw max chunk size = 4194304 2024-09-12T17:09:29.956 INFO:teuthology.orchestra.run.smithi037.stdout: rgw obj stripe size = 6291456 2024-09-12T17:09:29.956 INFO:teuthology.orchestra.run.smithi037.stdout: rgw reshard progress judge interval = 10 2024-09-12T17:09:29.956 INFO:teuthology.orchestra.run.smithi037.stdout: rgw s3 auth use sts = True 2024-09-12T17:09:29.956 INFO:teuthology.orchestra.run.smithi037.stdout: rgw sts key = abcdefghijklmnop 2024-09-12T17:09:29.956 INFO:teuthology.orchestra.run.smithi037.stdout: rgw torrent flag = True 2024-09-12T17:09:29.957 INFO:teuthology.orchestra.run.smithi037.stdout: rgw user counters cache = True 2024-09-12T17:09:29.957 INFO:teuthology.orchestra.run.smithi037.stdout: setgroup = ceph 2024-09-12T17:09:29.957 INFO:teuthology.orchestra.run.smithi037.stdout: setuser = ceph 2024-09-12T17:09:29.957 INFO:teuthology.orchestra.run.smithi037.stdout:[mon.a] 2024-09-12T17:09:29.957 INFO:teuthology.orchestra.run.smithi037.stdout:[mon.c] 2024-09-12T17:09:29.957 INFO:teuthology.orchestra.run.smithi037.stdout:[mon.b] 2024-09-12T17:09:29.958 INFO:teuthology.orchestra.run.smithi040.stdout:[global] 2024-09-12T17:09:29.958 INFO:teuthology.orchestra.run.smithi040.stdout: chdir = "" 2024-09-12T17:09:29.958 INFO:teuthology.orchestra.run.smithi040.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-12T17:09:29.958 INFO:teuthology.orchestra.run.smithi040.stdout: auth supported = cephx 2024-09-12T17:09:29.958 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-12T17:09:29.958 INFO:teuthology.orchestra.run.smithi040.stdout: filestore xattr use omap = true 2024-09-12T17:09:29.958 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-12T17:09:29.958 INFO:teuthology.orchestra.run.smithi040.stdout: mon clock drift allowed = 1.000 2024-09-12T17:09:29.958 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-12T17:09:29.958 INFO:teuthology.orchestra.run.smithi040.stdout: osd crush chooseleaf type = 0 2024-09-12T17:09:29.958 INFO:teuthology.orchestra.run.smithi040.stdout: auth debug = true 2024-09-12T17:09:29.958 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-12T17:09:29.958 INFO:teuthology.orchestra.run.smithi040.stdout: ms die on old message = true 2024-09-12T17:09:29.959 INFO:teuthology.orchestra.run.smithi040.stdout: ms die on bug = true 2024-09-12T17:09:29.959 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-12T17:09:29.959 INFO:teuthology.orchestra.run.smithi040.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-12T17:09:29.959 INFO:teuthology.orchestra.run.smithi040.stdout: mon pg warn max object skew = 0 2024-09-12T17:09:29.959 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-12T17:09:29.959 INFO:teuthology.orchestra.run.smithi040.stdout: # disable pg_autoscaler by default for new pools 2024-09-12T17:09:29.959 INFO:teuthology.orchestra.run.smithi040.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-12T17:09:29.959 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-12T17:09:29.959 INFO:teuthology.orchestra.run.smithi040.stdout: osd pool default size = 2 2024-09-12T17:09:29.959 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-12T17:09:29.959 INFO:teuthology.orchestra.run.smithi040.stdout: mon osd allow primary affinity = true 2024-09-12T17:09:29.959 INFO:teuthology.orchestra.run.smithi040.stdout: mon osd allow pg remap = true 2024-09-12T17:09:29.959 INFO:teuthology.orchestra.run.smithi040.stdout: mon warn on legacy crush tunables = false 2024-09-12T17:09:29.959 INFO:teuthology.orchestra.run.smithi040.stdout: mon warn on crush straw calc version zero = false 2024-09-12T17:09:29.960 INFO:teuthology.orchestra.run.smithi040.stdout: mon warn on no sortbitwise = false 2024-09-12T17:09:29.960 INFO:teuthology.orchestra.run.smithi040.stdout: mon warn on osd down out interval zero = false 2024-09-12T17:09:29.960 INFO:teuthology.orchestra.run.smithi040.stdout: mon warn on too few osds = false 2024-09-12T17:09:29.960 INFO:teuthology.orchestra.run.smithi040.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-12T17:09:29.960 INFO:teuthology.orchestra.run.smithi040.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-12T17:09:29.960 INFO:teuthology.orchestra.run.smithi040.stdout: mon_allow_pool_size_one = true 2024-09-12T17:09:29.960 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-12T17:09:29.960 INFO:teuthology.orchestra.run.smithi040.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-12T17:09:29.960 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-12T17:09:29.960 INFO:teuthology.orchestra.run.smithi040.stdout: osd default data pool replay window = 5 2024-09-12T17:09:29.960 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-12T17:09:29.960 INFO:teuthology.orchestra.run.smithi040.stdout: mon allow pool delete = true 2024-09-12T17:09:29.960 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-12T17:09:29.961 INFO:teuthology.orchestra.run.smithi040.stdout: mon cluster log file level = debug 2024-09-12T17:09:29.961 INFO:teuthology.orchestra.run.smithi040.stdout: debug asserts on shutdown = true 2024-09-12T17:09:29.961 INFO:teuthology.orchestra.run.smithi040.stdout: mon health detail to clog = false 2024-09-12T17:09:29.961 INFO:teuthology.orchestra.run.smithi040.stdout: mon host = "172.21.15.37,[v2:172.21.15.37:3301,v1:172.21.15.37:6790],172.21.15.40" 2024-09-12T17:09:29.961 INFO:teuthology.orchestra.run.smithi040.stdout: mon client directed command retry = 5 2024-09-12T17:09:29.961 INFO:teuthology.orchestra.run.smithi040.stdout: ms inject socket failures = 5000 2024-09-12T17:09:29.961 INFO:teuthology.orchestra.run.smithi040.stdout: osd heartbeat grace = 40 2024-09-12T17:09:29.961 INFO:teuthology.orchestra.run.smithi040.stdout: osd_max_pg_log_entries = 10 2024-09-12T17:09:29.961 INFO:teuthology.orchestra.run.smithi040.stdout: osd_min_pg_log_entries = 10 2024-09-12T17:09:29.961 INFO:teuthology.orchestra.run.smithi040.stdout: fsid = 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:09:29.961 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-12T17:09:29.961 INFO:teuthology.orchestra.run.smithi040.stdout:[osd] 2024-09-12T17:09:29.961 INFO:teuthology.orchestra.run.smithi040.stdout: osd journal size = 100 2024-09-12T17:09:29.962 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-12T17:09:29.962 INFO:teuthology.orchestra.run.smithi040.stdout: osd scrub load threshold = 5.0 2024-09-12T17:09:29.962 INFO:teuthology.orchestra.run.smithi040.stdout: osd scrub max interval = 600 2024-09-12T17:09:29.962 INFO:teuthology.orchestra.run.smithi040.stdout: osd mclock profile = high_recovery_ops 2024-09-12T17:09:29.962 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-12T17:09:29.962 INFO:teuthology.orchestra.run.smithi040.stdout: osd recover clone overlap = true 2024-09-12T17:09:29.962 INFO:teuthology.orchestra.run.smithi040.stdout: osd recovery max chunk = 1048576 2024-09-12T17:09:29.962 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-12T17:09:29.962 INFO:teuthology.orchestra.run.smithi040.stdout: osd debug shutdown = true 2024-09-12T17:09:29.962 INFO:teuthology.orchestra.run.smithi040.stdout: osd debug op order = true 2024-09-12T17:09:29.962 INFO:teuthology.orchestra.run.smithi040.stdout: osd debug verify stray on activate = true 2024-09-12T17:09:29.962 INFO:teuthology.orchestra.run.smithi040.stdout: osd debug trim objects = true 2024-09-12T17:09:29.962 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-12T17:09:29.963 INFO:teuthology.orchestra.run.smithi040.stdout: osd open classes on start = true 2024-09-12T17:09:29.963 INFO:teuthology.orchestra.run.smithi040.stdout: osd debug pg log writeout = true 2024-09-12T17:09:29.963 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-12T17:09:29.963 INFO:teuthology.orchestra.run.smithi040.stdout: osd deep scrub update digest min age = 30 2024-09-12T17:09:29.963 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-12T17:09:29.963 INFO:teuthology.orchestra.run.smithi040.stdout: osd map max advance = 10 2024-09-12T17:09:29.963 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-12T17:09:29.963 INFO:teuthology.orchestra.run.smithi040.stdout: journal zero on create = true 2024-09-12T17:09:29.963 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-12T17:09:29.963 INFO:teuthology.orchestra.run.smithi040.stdout: filestore ondisk finisher threads = 3 2024-09-12T17:09:29.963 INFO:teuthology.orchestra.run.smithi040.stdout: filestore apply finisher threads = 3 2024-09-12T17:09:29.963 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-12T17:09:29.963 INFO:teuthology.orchestra.run.smithi040.stdout: bdev debug aio = true 2024-09-12T17:09:29.963 INFO:teuthology.orchestra.run.smithi040.stdout: osd debug misdirected ops = true 2024-09-12T17:09:29.964 INFO:teuthology.orchestra.run.smithi040.stdout: bdev async discard = True 2024-09-12T17:09:29.964 INFO:teuthology.orchestra.run.smithi040.stdout: bdev enable discard = True 2024-09-12T17:09:29.964 INFO:teuthology.orchestra.run.smithi040.stdout: bluestore allocator = bitmap 2024-09-12T17:09:29.964 INFO:teuthology.orchestra.run.smithi040.stdout: bluestore block size = 96636764160 2024-09-12T17:09:29.964 INFO:teuthology.orchestra.run.smithi040.stdout: bluestore fsck on mount = True 2024-09-12T17:09:29.964 INFO:teuthology.orchestra.run.smithi040.stdout: debug bluefs = 1/20 2024-09-12T17:09:29.964 INFO:teuthology.orchestra.run.smithi040.stdout: debug bluestore = 1/20 2024-09-12T17:09:29.964 INFO:teuthology.orchestra.run.smithi040.stdout: debug ms = 1 2024-09-12T17:09:29.964 INFO:teuthology.orchestra.run.smithi040.stdout: debug objclass = 20 2024-09-12T17:09:29.964 INFO:teuthology.orchestra.run.smithi040.stdout: debug osd = 20 2024-09-12T17:09:29.964 INFO:teuthology.orchestra.run.smithi040.stdout: debug rocksdb = 4/10 2024-09-12T17:09:29.964 INFO:teuthology.orchestra.run.smithi040.stdout: mon osd backfillfull_ratio = 0.85 2024-09-12T17:09:29.964 INFO:teuthology.orchestra.run.smithi040.stdout: mon osd full ratio = 0.9 2024-09-12T17:09:29.964 INFO:teuthology.orchestra.run.smithi040.stdout: mon osd nearfull ratio = 0.8 2024-09-12T17:09:29.965 INFO:teuthology.orchestra.run.smithi040.stdout: osd failsafe full ratio = 0.95 2024-09-12T17:09:29.965 INFO:teuthology.orchestra.run.smithi040.stdout: osd fast shutdown = False 2024-09-12T17:09:29.965 INFO:teuthology.orchestra.run.smithi040.stdout: osd objectstore = bluestore 2024-09-12T17:09:29.965 INFO:teuthology.orchestra.run.smithi040.stdout: osd shutdown pgref assert = True 2024-09-12T17:09:29.965 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-12T17:09:29.965 INFO:teuthology.orchestra.run.smithi040.stdout:[mgr] 2024-09-12T17:09:29.965 INFO:teuthology.orchestra.run.smithi040.stdout: debug ms = 1 2024-09-12T17:09:29.965 INFO:teuthology.orchestra.run.smithi040.stdout: debug mgr = 20 2024-09-12T17:09:29.965 INFO:teuthology.orchestra.run.smithi040.stdout: debug mon = 20 2024-09-12T17:09:29.965 INFO:teuthology.orchestra.run.smithi040.stdout: debug auth = 20 2024-09-12T17:09:29.966 INFO:teuthology.orchestra.run.smithi040.stdout: mon reweight min pgs per osd = 4 2024-09-12T17:09:29.966 INFO:teuthology.orchestra.run.smithi040.stdout: mon reweight min bytes per osd = 10 2024-09-12T17:09:29.966 INFO:teuthology.orchestra.run.smithi040.stdout: mgr/telemetry/nag = false 2024-09-12T17:09:29.966 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-12T17:09:29.966 INFO:teuthology.orchestra.run.smithi040.stdout:[mon] 2024-09-12T17:09:29.966 INFO:teuthology.orchestra.run.smithi040.stdout: debug ms = 1 2024-09-12T17:09:29.966 INFO:teuthology.orchestra.run.smithi040.stdout: debug mon = 20 2024-09-12T17:09:29.966 INFO:teuthology.orchestra.run.smithi040.stdout: debug paxos = 20 2024-09-12T17:09:29.966 INFO:teuthology.orchestra.run.smithi040.stdout: debug auth = 20 2024-09-12T17:09:29.966 INFO:teuthology.orchestra.run.smithi040.stdout: mon data avail warn = 5 2024-09-12T17:09:29.966 INFO:teuthology.orchestra.run.smithi040.stdout: mon mgr mkfs grace = 240 2024-09-12T17:09:29.966 INFO:teuthology.orchestra.run.smithi040.stdout: mon reweight min pgs per osd = 4 2024-09-12T17:09:29.966 INFO:teuthology.orchestra.run.smithi040.stdout: mon osd reporter subtree level = osd 2024-09-12T17:09:29.967 INFO:teuthology.orchestra.run.smithi040.stdout: mon osd prime pg temp = true 2024-09-12T17:09:29.967 INFO:teuthology.orchestra.run.smithi040.stdout: mon reweight min bytes per osd = 10 2024-09-12T17:09:29.967 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-12T17:09:29.967 INFO:teuthology.orchestra.run.smithi040.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-12T17:09:29.967 INFO:teuthology.orchestra.run.smithi040.stdout: auth mon ticket ttl = 660 # 11m 2024-09-12T17:09:29.967 INFO:teuthology.orchestra.run.smithi040.stdout: auth service ticket ttl = 240 # 4m 2024-09-12T17:09:29.967 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-12T17:09:29.967 INFO:teuthology.orchestra.run.smithi040.stdout: # don't complain about insecure global_id in the test suite 2024-09-12T17:09:29.967 INFO:teuthology.orchestra.run.smithi040.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-12T17:09:29.967 INFO:teuthology.orchestra.run.smithi040.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-12T17:09:29.967 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-12T17:09:29.968 INFO:teuthology.orchestra.run.smithi040.stdout: # 1m isn't quite enough 2024-09-12T17:09:29.968 INFO:teuthology.orchestra.run.smithi040.stdout: mon_down_mkfs_grace = 2m 2024-09-12T17:09:29.968 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-12T17:09:29.968 INFO:teuthology.orchestra.run.smithi040.stdout: mon_warn_on_filestore_osds = false 2024-09-12T17:09:29.968 INFO:teuthology.orchestra.run.smithi040.stdout: mon osd crush smoke test = False 2024-09-12T17:09:29.968 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-12T17:09:29.968 INFO:teuthology.orchestra.run.smithi040.stdout:[client] 2024-09-12T17:09:29.968 INFO:teuthology.orchestra.run.smithi040.stdout: rgw cache enabled = true 2024-09-12T17:09:29.968 INFO:teuthology.orchestra.run.smithi040.stdout: rgw enable ops log = True 2024-09-12T17:09:29.969 INFO:teuthology.orchestra.run.smithi040.stdout: rgw enable usage log = true 2024-09-12T17:09:29.969 INFO:teuthology.orchestra.run.smithi040.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-12T17:09:29.969 INFO:teuthology.orchestra.run.smithi040.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-12T17:09:29.969 INFO:teuthology.orchestra.run.smithi040.stdout: debug rgw = 20 2024-09-12T17:09:29.969 INFO:teuthology.orchestra.run.smithi040.stdout: debug rgw notification = 20 2024-09-12T17:09:29.969 INFO:teuthology.orchestra.run.smithi040.stdout: rgw bucket counters cache = True 2024-09-12T17:09:29.969 INFO:teuthology.orchestra.run.smithi040.stdout: rgw crypt require ssl = False 2024-09-12T17:09:29.969 INFO:teuthology.orchestra.run.smithi040.stdout: rgw crypt s3 kms backend = testing 2024-09-12T17:09:29.970 INFO:teuthology.orchestra.run.smithi040.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-09-12T17:09:29.970 INFO:teuthology.orchestra.run.smithi040.stdout: rgw d3n l1 datacache persistent path = /tmp/rgw_datacache/ 2024-09-12T17:09:29.970 INFO:teuthology.orchestra.run.smithi040.stdout: rgw d3n l1 datacache size = 10737418240 2024-09-12T17:09:29.970 INFO:teuthology.orchestra.run.smithi040.stdout: rgw d3n l1 local datacache enabled = True 2024-09-12T17:09:29.970 INFO:teuthology.orchestra.run.smithi040.stdout: rgw max chunk size = 4194304 2024-09-12T17:09:29.970 INFO:teuthology.orchestra.run.smithi040.stdout: rgw obj stripe size = 6291456 2024-09-12T17:09:29.970 INFO:teuthology.orchestra.run.smithi040.stdout: rgw reshard progress judge interval = 10 2024-09-12T17:09:29.970 INFO:teuthology.orchestra.run.smithi040.stdout: rgw s3 auth use sts = True 2024-09-12T17:09:29.970 INFO:teuthology.orchestra.run.smithi040.stdout: rgw sts key = abcdefghijklmnop 2024-09-12T17:09:29.970 INFO:teuthology.orchestra.run.smithi040.stdout: rgw torrent flag = True 2024-09-12T17:09:29.970 INFO:teuthology.orchestra.run.smithi040.stdout: rgw user counters cache = True 2024-09-12T17:09:29.970 INFO:teuthology.orchestra.run.smithi040.stdout: setgroup = ceph 2024-09-12T17:09:29.970 INFO:teuthology.orchestra.run.smithi040.stdout: setuser = ceph 2024-09-12T17:09:29.970 INFO:teuthology.orchestra.run.smithi040.stdout:[mon.a] 2024-09-12T17:09:29.970 INFO:teuthology.orchestra.run.smithi040.stdout:[mon.c] 2024-09-12T17:09:29.971 INFO:teuthology.orchestra.run.smithi040.stdout:[mon.b] 2024-09-12T17:09:29.972 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-12T17:09:29.972 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-12T17:09:30.042 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-12T17:09:30.043 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-09-12T17:09:30.043 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-12T17:09:30.072 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-09-12T17:09:30.072 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-12T17:09:30.141 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi037.front.sepia.ceph.com 2024-09-12T17:09:30.142 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-09-12T17:09:30.142 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-12T17:09:30.142 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T17:09:30.233 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-09-12T17:09:30.233 DEBUG:teuthology.orchestra.run.smithi037:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-12T17:09:30.303 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi040.front.sepia.ceph.com 2024-09-12T17:09:30.303 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-09-12T17:09:30.303 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-12T17:09:30.303 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T17:09:30.358 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-09-12T17:09:30.358 DEBUG:teuthology.orchestra.run.smithi040:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-12T17:09:30.429 INFO:tasks.ceph:Setting up mon nodes... 2024-09-12T17:09:30.429 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-12T17:09:30.429 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-12T17:09:30.497 INFO:teuthology.orchestra.run.smithi037.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-12T17:09:30.500 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-12T17:09:30.581 INFO:teuthology.orchestra.run.smithi040.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-12T17:09:30.584 INFO:tasks.ceph:Setting up mds nodes... 2024-09-12T17:09:30.584 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-12T17:09:30.584 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-12T17:09:30.640 INFO:teuthology.orchestra.run.smithi037.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-12T17:09:30.654 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-12T17:09:30.710 INFO:teuthology.orchestra.run.smithi040.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-12T17:09:30.723 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-12T17:09:30.723 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi037.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi040.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-12T17:09:30.723 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-12T17:09:30.764 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T17:09:30.764 INFO:tasks.ceph:role: osd.0 2024-09-12T17:09:30.764 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi037.front.sepia.ceph.com 2024-09-12T17:09:30.764 DEBUG:teuthology.orchestra.run.smithi037:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-12T17:09:30.851 INFO:teuthology.orchestra.run.smithi037.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T17:09:30.851 INFO:teuthology.orchestra.run.smithi037.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T17:09:30.851 INFO:teuthology.orchestra.run.smithi037.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T17:09:30.851 INFO:teuthology.orchestra.run.smithi037.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T17:09:30.851 INFO:teuthology.orchestra.run.smithi037.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T17:09:30.851 INFO:teuthology.orchestra.run.smithi037.stdout: = sunit=0 swidth=0 blks 2024-09-12T17:09:30.851 INFO:teuthology.orchestra.run.smithi037.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T17:09:30.852 INFO:teuthology.orchestra.run.smithi037.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T17:09:30.852 INFO:teuthology.orchestra.run.smithi037.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T17:09:30.852 INFO:teuthology.orchestra.run.smithi037.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T17:09:31.373 INFO:teuthology.orchestra.run.smithi037.stdout:Discarding blocks...Done. 2024-09-12T17:09:31.375 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi037.front.sepia.ceph.com -o noatime 2024-09-12T17:09:31.375 DEBUG:teuthology.orchestra.run.smithi037:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-12T17:09:31.489 DEBUG:teuthology.orchestra.run.smithi037:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-12T17:09:31.537 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-12T17:09:31.577 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T17:09:31.577 INFO:tasks.ceph:role: osd.1 2024-09-12T17:09:31.577 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi037.front.sepia.ceph.com 2024-09-12T17:09:31.577 DEBUG:teuthology.orchestra.run.smithi037:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-12T17:09:31.664 INFO:teuthology.orchestra.run.smithi037.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T17:09:31.664 INFO:teuthology.orchestra.run.smithi037.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T17:09:31.665 INFO:teuthology.orchestra.run.smithi037.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T17:09:31.665 INFO:teuthology.orchestra.run.smithi037.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T17:09:31.665 INFO:teuthology.orchestra.run.smithi037.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T17:09:31.665 INFO:teuthology.orchestra.run.smithi037.stdout: = sunit=0 swidth=0 blks 2024-09-12T17:09:31.665 INFO:teuthology.orchestra.run.smithi037.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T17:09:31.665 INFO:teuthology.orchestra.run.smithi037.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T17:09:31.665 INFO:teuthology.orchestra.run.smithi037.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T17:09:31.665 INFO:teuthology.orchestra.run.smithi037.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T17:09:32.122 INFO:teuthology.orchestra.run.smithi037.stdout:Discarding blocks...Done. 2024-09-12T17:09:32.124 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi037.front.sepia.ceph.com -o noatime 2024-09-12T17:09:32.124 DEBUG:teuthology.orchestra.run.smithi037:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-12T17:09:32.189 DEBUG:teuthology.orchestra.run.smithi037:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-12T17:09:32.233 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-12T17:09:32.313 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T17:09:32.313 INFO:tasks.ceph:role: osd.2 2024-09-12T17:09:32.313 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi037.front.sepia.ceph.com 2024-09-12T17:09:32.313 DEBUG:teuthology.orchestra.run.smithi037:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-12T17:09:32.401 INFO:teuthology.orchestra.run.smithi037.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T17:09:32.401 INFO:teuthology.orchestra.run.smithi037.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T17:09:32.401 INFO:teuthology.orchestra.run.smithi037.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T17:09:32.401 INFO:teuthology.orchestra.run.smithi037.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T17:09:32.401 INFO:teuthology.orchestra.run.smithi037.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T17:09:32.401 INFO:teuthology.orchestra.run.smithi037.stdout: = sunit=0 swidth=0 blks 2024-09-12T17:09:32.401 INFO:teuthology.orchestra.run.smithi037.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T17:09:32.402 INFO:teuthology.orchestra.run.smithi037.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T17:09:32.402 INFO:teuthology.orchestra.run.smithi037.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T17:09:32.402 INFO:teuthology.orchestra.run.smithi037.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T17:09:32.881 INFO:teuthology.orchestra.run.smithi037.stdout:Discarding blocks...Done. 2024-09-12T17:09:32.883 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi037.front.sepia.ceph.com -o noatime 2024-09-12T17:09:32.884 DEBUG:teuthology.orchestra.run.smithi037:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-12T17:09:32.996 DEBUG:teuthology.orchestra.run.smithi037:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-12T17:09:33.041 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-12T17:09:33.081 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T17:09:33.082 INFO:tasks.ceph:role: osd.3 2024-09-12T17:09:33.082 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi037.front.sepia.ceph.com 2024-09-12T17:09:33.082 DEBUG:teuthology.orchestra.run.smithi037:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-12T17:09:33.169 INFO:teuthology.orchestra.run.smithi037.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T17:09:33.169 INFO:teuthology.orchestra.run.smithi037.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T17:09:33.169 INFO:teuthology.orchestra.run.smithi037.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T17:09:33.169 INFO:teuthology.orchestra.run.smithi037.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T17:09:33.169 INFO:teuthology.orchestra.run.smithi037.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T17:09:33.169 INFO:teuthology.orchestra.run.smithi037.stdout: = sunit=0 swidth=0 blks 2024-09-12T17:09:33.170 INFO:teuthology.orchestra.run.smithi037.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T17:09:33.170 INFO:teuthology.orchestra.run.smithi037.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T17:09:33.170 INFO:teuthology.orchestra.run.smithi037.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T17:09:33.170 INFO:teuthology.orchestra.run.smithi037.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T17:09:33.662 INFO:teuthology.orchestra.run.smithi037.stdout:Discarding blocks...Done. 2024-09-12T17:09:33.664 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi037.front.sepia.ceph.com -o noatime 2024-09-12T17:09:33.664 DEBUG:teuthology.orchestra.run.smithi037:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-12T17:09:33.773 DEBUG:teuthology.orchestra.run.smithi037:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-12T17:09:33.823 DEBUG:teuthology.orchestra.run.smithi037:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T17:09:33.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:09:33.889+0000 7f8115030640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-12T17:09:33.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:09:33.889+0000 7f8115030640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-12T17:09:33.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:09:33.889+0000 7f8115030640 -1 bdev(0x559d33b19800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-12T17:09:33.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:09:33.889+0000 7f8115030640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-12T17:09:37.067 DEBUG:teuthology.orchestra.run.smithi037:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-12T17:09:37.113 DEBUG:teuthology.orchestra.run.smithi037:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T17:09:37.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:09:37.176+0000 7f88d000e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-12T17:09:37.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:09:37.176+0000 7f88d000e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-12T17:09:37.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:09:37.176+0000 7f88d000e640 -1 bdev(0x5624d3101800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-12T17:09:37.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:09:37.176+0000 7f88d000e640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-12T17:09:40.335 DEBUG:teuthology.orchestra.run.smithi037:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-12T17:09:40.381 DEBUG:teuthology.orchestra.run.smithi037:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T17:09:40.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:09:40.454+0000 7f0a91e44640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-12T17:09:40.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:09:40.454+0000 7f0a91e44640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-12T17:09:40.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:09:40.454+0000 7f0a91e44640 -1 bdev(0x55a043007800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-12T17:09:40.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:09:40.454+0000 7f0a91e44640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-12T17:09:43.385 DEBUG:teuthology.orchestra.run.smithi037:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-12T17:09:43.431 DEBUG:teuthology.orchestra.run.smithi037:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T17:09:43.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:09:43.495+0000 7f9e86814640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-12T17:09:43.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:09:43.495+0000 7f9e86814640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-12T17:09:43.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:09:43.495+0000 7f9e86814640 -1 bdev(0x55d94561b800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-12T17:09:43.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:09:43.495+0000 7f9e86814640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-12T17:09:46.660 DEBUG:teuthology.orchestra.run.smithi037:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-12T17:09:46.706 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-12T17:09:46.753 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T17:09:46.753 INFO:tasks.ceph:role: osd.4 2024-09-12T17:09:46.754 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi040.front.sepia.ceph.com 2024-09-12T17:09:46.754 DEBUG:teuthology.orchestra.run.smithi040:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-12T17:09:46.804 INFO:teuthology.orchestra.run.smithi040.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T17:09:46.804 INFO:teuthology.orchestra.run.smithi040.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T17:09:46.804 INFO:teuthology.orchestra.run.smithi040.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T17:09:46.804 INFO:teuthology.orchestra.run.smithi040.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T17:09:46.804 INFO:teuthology.orchestra.run.smithi040.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T17:09:46.804 INFO:teuthology.orchestra.run.smithi040.stdout: = sunit=0 swidth=0 blks 2024-09-12T17:09:46.804 INFO:teuthology.orchestra.run.smithi040.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T17:09:46.804 INFO:teuthology.orchestra.run.smithi040.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T17:09:46.805 INFO:teuthology.orchestra.run.smithi040.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T17:09:46.805 INFO:teuthology.orchestra.run.smithi040.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T17:09:47.300 INFO:teuthology.orchestra.run.smithi040.stdout:Discarding blocks...Done. 2024-09-12T17:09:47.303 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi040.front.sepia.ceph.com -o noatime 2024-09-12T17:09:47.303 DEBUG:teuthology.orchestra.run.smithi040:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-12T17:09:47.404 DEBUG:teuthology.orchestra.run.smithi040:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-12T17:09:47.451 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-12T17:09:47.491 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T17:09:47.492 INFO:tasks.ceph:role: osd.5 2024-09-12T17:09:47.492 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi040.front.sepia.ceph.com 2024-09-12T17:09:47.492 DEBUG:teuthology.orchestra.run.smithi040:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-12T17:09:47.580 INFO:teuthology.orchestra.run.smithi040.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T17:09:47.580 INFO:teuthology.orchestra.run.smithi040.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T17:09:47.580 INFO:teuthology.orchestra.run.smithi040.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T17:09:47.580 INFO:teuthology.orchestra.run.smithi040.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T17:09:47.580 INFO:teuthology.orchestra.run.smithi040.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T17:09:47.580 INFO:teuthology.orchestra.run.smithi040.stdout: = sunit=0 swidth=0 blks 2024-09-12T17:09:47.580 INFO:teuthology.orchestra.run.smithi040.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T17:09:47.580 INFO:teuthology.orchestra.run.smithi040.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T17:09:47.581 INFO:teuthology.orchestra.run.smithi040.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T17:09:47.581 INFO:teuthology.orchestra.run.smithi040.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T17:09:48.039 INFO:teuthology.orchestra.run.smithi040.stdout:Discarding blocks...Done. 2024-09-12T17:09:48.041 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi040.front.sepia.ceph.com -o noatime 2024-09-12T17:09:48.041 DEBUG:teuthology.orchestra.run.smithi040:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-12T17:09:48.104 DEBUG:teuthology.orchestra.run.smithi040:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-12T17:09:48.148 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-12T17:09:48.228 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T17:09:48.228 INFO:tasks.ceph:role: osd.6 2024-09-12T17:09:48.228 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi040.front.sepia.ceph.com 2024-09-12T17:09:48.228 DEBUG:teuthology.orchestra.run.smithi040:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-12T17:09:48.316 INFO:teuthology.orchestra.run.smithi040.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T17:09:48.316 INFO:teuthology.orchestra.run.smithi040.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T17:09:48.316 INFO:teuthology.orchestra.run.smithi040.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T17:09:48.316 INFO:teuthology.orchestra.run.smithi040.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T17:09:48.316 INFO:teuthology.orchestra.run.smithi040.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T17:09:48.317 INFO:teuthology.orchestra.run.smithi040.stdout: = sunit=0 swidth=0 blks 2024-09-12T17:09:48.317 INFO:teuthology.orchestra.run.smithi040.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T17:09:48.317 INFO:teuthology.orchestra.run.smithi040.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T17:09:48.317 INFO:teuthology.orchestra.run.smithi040.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T17:09:48.317 INFO:teuthology.orchestra.run.smithi040.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T17:09:48.803 INFO:teuthology.orchestra.run.smithi040.stdout:Discarding blocks...Done. 2024-09-12T17:09:48.806 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi040.front.sepia.ceph.com -o noatime 2024-09-12T17:09:48.806 DEBUG:teuthology.orchestra.run.smithi040:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-12T17:09:48.903 DEBUG:teuthology.orchestra.run.smithi040:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-12T17:09:48.949 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-12T17:09:48.988 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T17:09:48.989 INFO:tasks.ceph:role: osd.7 2024-09-12T17:09:48.989 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi040.front.sepia.ceph.com 2024-09-12T17:09:48.989 DEBUG:teuthology.orchestra.run.smithi040:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-12T17:09:49.076 INFO:teuthology.orchestra.run.smithi040.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T17:09:49.076 INFO:teuthology.orchestra.run.smithi040.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T17:09:49.076 INFO:teuthology.orchestra.run.smithi040.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T17:09:49.077 INFO:teuthology.orchestra.run.smithi040.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T17:09:49.077 INFO:teuthology.orchestra.run.smithi040.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T17:09:49.077 INFO:teuthology.orchestra.run.smithi040.stdout: = sunit=0 swidth=0 blks 2024-09-12T17:09:49.077 INFO:teuthology.orchestra.run.smithi040.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T17:09:49.077 INFO:teuthology.orchestra.run.smithi040.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T17:09:49.077 INFO:teuthology.orchestra.run.smithi040.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T17:09:49.077 INFO:teuthology.orchestra.run.smithi040.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T17:09:49.594 INFO:teuthology.orchestra.run.smithi040.stdout:Discarding blocks...Done. 2024-09-12T17:09:49.596 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi040.front.sepia.ceph.com -o noatime 2024-09-12T17:09:49.597 DEBUG:teuthology.orchestra.run.smithi040:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-12T17:09:49.721 DEBUG:teuthology.orchestra.run.smithi040:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-12T17:09:49.768 DEBUG:teuthology.orchestra.run.smithi040:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T17:09:49.837 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-12T17:09:49.835+0000 7f0ec780d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-12T17:09:49.838 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-12T17:09:49.836+0000 7f0ec780d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-12T17:09:49.839 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-12T17:09:49.837+0000 7f0ec780d640 -1 bdev(0x56388f103800 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2024-09-12T17:09:49.839 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-12T17:09:49.837+0000 7f0ec780d640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-12T17:09:53.010 DEBUG:teuthology.orchestra.run.smithi040:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-12T17:09:53.057 DEBUG:teuthology.orchestra.run.smithi040:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T17:09:53.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-12T17:09:53.121+0000 7f3dd11b2640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-12T17:09:53.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-12T17:09:53.121+0000 7f3dd11b2640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-12T17:09:53.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-12T17:09:53.121+0000 7f3dd11b2640 -1 bdev(0x5591ce499800 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2024-09-12T17:09:53.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-12T17:09:53.121+0000 7f3dd11b2640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-12T17:09:56.537 DEBUG:teuthology.orchestra.run.smithi040:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-12T17:09:56.584 DEBUG:teuthology.orchestra.run.smithi040:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T17:09:56.649 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-12T17:09:56.647+0000 7f5ed4219640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-12T17:09:56.649 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-12T17:09:56.647+0000 7f5ed4219640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-12T17:09:56.649 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-12T17:09:56.647+0000 7f5ed4219640 -1 bdev(0x5650bb113800 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2024-09-12T17:09:56.649 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-12T17:09:56.648+0000 7f5ed4219640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-09-12T17:09:59.820 DEBUG:teuthology.orchestra.run.smithi040:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-12T17:09:59.866 DEBUG:teuthology.orchestra.run.smithi040:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T17:09:59.932 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-12T17:09:59.930+0000 7f12f0a83640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-12T17:09:59.932 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-12T17:09:59.930+0000 7f12f0a83640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-12T17:09:59.932 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-12T17:09:59.930+0000 7f12f0a83640 -1 bdev(0x55d9cb675800 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2024-09-12T17:09:59.932 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-12T17:09:59.930+0000 7f12f0a83640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-09-12T17:10:02.851 DEBUG:teuthology.orchestra.run.smithi040:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-12T17:10:02.898 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-12T17:10:02.898 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-09-12T17:10:02.898 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-12T17:10:02.947 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-09-12T17:10:02.947 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-12T17:10:03.032 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-09-12T17:10:03.032 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-12T17:10:03.114 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-09-12T17:10:03.115 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-12T17:10:03.195 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-09-12T17:10:03.195 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-12T17:10:03.276 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-09-12T17:10:03.276 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-12T17:10:03.325 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-09-12T17:10:03.325 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-12T17:10:03.410 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-09-12T17:10:03.410 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-12T17:10:03.493 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-09-12T17:10:03.493 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-12T17:10:03.575 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-09-12T17:10:03.575 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-12T17:10:03.656 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-09-12T17:10:03.657 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-12T17:10:03.690 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-09-12T17:10:03.690 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-12T17:10:03.726 INFO:tasks.ceph:Adding keys to all mons... 2024-09-12T17:10:03.727 DEBUG:teuthology.orchestra.run.smithi037:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-12T17:10:03.733 DEBUG:teuthology.orchestra.run.smithi040:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-12T17:10:03.772 INFO:teuthology.orchestra.run.smithi037.stdout:[mgr.y] 2024-09-12T17:10:03.772 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQBKIONmQNyjHRAAJsmNe5xXwvuy44pFai4dCw== 2024-09-12T17:10:03.772 INFO:teuthology.orchestra.run.smithi037.stdout:[osd.0] 2024-09-12T17:10:03.772 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQBNIONmhQEYNRAABYnAvUah1IkFWaReg6bVDg== 2024-09-12T17:10:03.773 INFO:teuthology.orchestra.run.smithi037.stdout:[osd.1] 2024-09-12T17:10:03.773 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQBRIONmuECYChAA9pP9O8wCvLn3V8SD1DT6KQ== 2024-09-12T17:10:03.773 INFO:teuthology.orchestra.run.smithi037.stdout:[osd.2] 2024-09-12T17:10:03.773 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQBUIONmd0khGxAANCSfdX+8Rj9Ia8PjKKFzag== 2024-09-12T17:10:03.773 INFO:teuthology.orchestra.run.smithi037.stdout:[osd.3] 2024-09-12T17:10:03.773 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQBXIONmV9GNHRAAIBkWM7M7R7YGdwH1D0amlQ== 2024-09-12T17:10:03.773 INFO:teuthology.orchestra.run.smithi037.stdout:[mgr.x] 2024-09-12T17:10:03.774 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQBKIONmivWfIhAAGpIa+x0GlMgyZdiiVJTWig== 2024-09-12T17:10:03.774 INFO:teuthology.orchestra.run.smithi037.stdout:[osd.4] 2024-09-12T17:10:03.774 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQBdIONmqRLbMRAAPDWDKwhJAqHQEMvxgJRZbw== 2024-09-12T17:10:03.774 INFO:teuthology.orchestra.run.smithi037.stdout:[osd.5] 2024-09-12T17:10:03.774 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQBhIONmK0hIBxAAj4KiKNZ8OXVQ+2vikRVH0A== 2024-09-12T17:10:03.774 INFO:teuthology.orchestra.run.smithi037.stdout:[osd.6] 2024-09-12T17:10:03.774 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQBkIONm5JunJhAAwvoMjdhZ0ChxS/dptSBJkg== 2024-09-12T17:10:03.774 INFO:teuthology.orchestra.run.smithi037.stdout:[osd.7] 2024-09-12T17:10:03.774 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQBnIONmZj1/NxAAcwak2YnZKvU9a+CT+vMwYA== 2024-09-12T17:10:03.774 INFO:teuthology.orchestra.run.smithi037.stdout:[client.0] 2024-09-12T17:10:03.774 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQBKIONmQoUkJhAA7PjEh/VksLhgy5vH14M+Dw== 2024-09-12T17:10:03.774 INFO:teuthology.orchestra.run.smithi037.stdout:[client.1] 2024-09-12T17:10:03.774 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQBKIONmhbpKKhAATJefDNIpzkvYi/xlSFBybQ== 2024-09-12T17:10:03.805 INFO:teuthology.orchestra.run.smithi040.stdout:[mgr.y] 2024-09-12T17:10:03.805 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQBKIONmQNyjHRAAJsmNe5xXwvuy44pFai4dCw== 2024-09-12T17:10:03.805 INFO:teuthology.orchestra.run.smithi040.stdout:[osd.0] 2024-09-12T17:10:03.805 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQBNIONmhQEYNRAABYnAvUah1IkFWaReg6bVDg== 2024-09-12T17:10:03.805 INFO:teuthology.orchestra.run.smithi040.stdout:[osd.1] 2024-09-12T17:10:03.805 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQBRIONmuECYChAA9pP9O8wCvLn3V8SD1DT6KQ== 2024-09-12T17:10:03.805 INFO:teuthology.orchestra.run.smithi040.stdout:[osd.2] 2024-09-12T17:10:03.806 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQBUIONmd0khGxAANCSfdX+8Rj9Ia8PjKKFzag== 2024-09-12T17:10:03.806 INFO:teuthology.orchestra.run.smithi040.stdout:[osd.3] 2024-09-12T17:10:03.806 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQBXIONmV9GNHRAAIBkWM7M7R7YGdwH1D0amlQ== 2024-09-12T17:10:03.806 INFO:teuthology.orchestra.run.smithi040.stdout:[mgr.x] 2024-09-12T17:10:03.806 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQBKIONmivWfIhAAGpIa+x0GlMgyZdiiVJTWig== 2024-09-12T17:10:03.806 INFO:teuthology.orchestra.run.smithi040.stdout:[osd.4] 2024-09-12T17:10:03.806 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQBdIONmqRLbMRAAPDWDKwhJAqHQEMvxgJRZbw== 2024-09-12T17:10:03.806 INFO:teuthology.orchestra.run.smithi040.stdout:[osd.5] 2024-09-12T17:10:03.806 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQBhIONmK0hIBxAAj4KiKNZ8OXVQ+2vikRVH0A== 2024-09-12T17:10:03.806 INFO:teuthology.orchestra.run.smithi040.stdout:[osd.6] 2024-09-12T17:10:03.806 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQBkIONm5JunJhAAwvoMjdhZ0ChxS/dptSBJkg== 2024-09-12T17:10:03.807 INFO:teuthology.orchestra.run.smithi040.stdout:[osd.7] 2024-09-12T17:10:03.807 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQBnIONmZj1/NxAAcwak2YnZKvU9a+CT+vMwYA== 2024-09-12T17:10:03.807 INFO:teuthology.orchestra.run.smithi040.stdout:[client.0] 2024-09-12T17:10:03.807 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQBKIONmQoUkJhAA7PjEh/VksLhgy5vH14M+Dw== 2024-09-12T17:10:03.808 INFO:teuthology.orchestra.run.smithi040.stdout:[client.1] 2024-09-12T17:10:03.808 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQBKIONmhbpKKhAATJefDNIpzkvYi/xlSFBybQ== 2024-09-12T17:10:03.812 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T17:10:03.818 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T17:10:03.916 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:10:03.920 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:10:03.988 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:10:03.991 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:10:04.057 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:10:04.059 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:10:04.125 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:10:04.128 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:10:04.193 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T17:10:04.196 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T17:10:04.263 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:10:04.265 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:10:04.331 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:10:04.334 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:10:04.400 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:10:04.403 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:10:04.469 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:10:04.471 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:10:04.537 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T17:10:04.540 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T17:10:04.609 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T17:10:04.611 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T17:10:04.680 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-12T17:10:04.681 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-12T17:10:04.720 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-12T17:10:04.831 DEBUG:teuthology.orchestra.run.smithi037:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-12T17:10:04.871 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-12T17:10:04.951 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-12T17:10:05.064 DEBUG:teuthology.orchestra.run.smithi037:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-12T17:10:05.103 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-12T17:10:05.146 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-12T17:10:05.260 DEBUG:teuthology.orchestra.run.smithi040:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-12T17:10:05.299 DEBUG:teuthology.orchestra.run.smithi037:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-12T17:10:05.302 DEBUG:teuthology.orchestra.run.smithi040:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-12T17:10:05.368 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-12T17:10:05.369 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-12T17:10:05.369 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-12T17:10:05.371 INFO:tasks.ceph.mon.a:Started 2024-09-12T17:10:05.372 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-12T17:10:05.372 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-12T17:10:05.374 INFO:tasks.ceph.mon.c:Started 2024-09-12T17:10:05.374 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-12T17:10:05.374 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-12T17:10:05.411 INFO:tasks.ceph.mon.b:Started 2024-09-12T17:10:05.411 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-12T17:10:05.411 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-12T17:10:05.411 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-12T17:10:05.413 INFO:tasks.ceph.mgr.y:Started 2024-09-12T17:10:05.413 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-12T17:10:05.414 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-12T17:10:05.415 INFO:tasks.ceph.mgr.x:Started 2024-09-12T17:10:05.416 DEBUG:tasks.ceph:set 0 configs 2024-09-12T17:10:05.416 INFO:tasks.ceph:Setting crush tunables to default 2024-09-12T17:10:05.416 DEBUG:teuthology.orchestra.run.smithi037:> sudo ceph --cluster ceph osd crush tunables default 2024-09-12T17:10:11.617 INFO:teuthology.orchestra.run.smithi037.stderr:adjusted tunables profile to default 2024-09-12T17:10:11.630 INFO:tasks.ceph:check_enable_crimson: False 2024-09-12T17:10:11.630 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-12T17:10:11.630 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-09-12T17:10:11.630 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-12T17:10:11.671 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-09-12T17:10:11.672 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-12T17:10:11.751 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-09-12T17:10:11.751 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-12T17:10:11.831 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-09-12T17:10:11.831 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-12T17:10:11.911 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-09-12T17:10:11.912 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-12T17:10:11.952 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-09-12T17:10:11.952 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-12T17:10:12.033 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-09-12T17:10:12.033 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-12T17:10:12.113 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-09-12T17:10:12.113 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-12T17:10:12.194 DEBUG:teuthology.orchestra.run.smithi040:> sudo ceph --cluster ceph osd new 85173859-eaf8-4da6-b3f3-7e633fa9dff4 0 2024-09-12T17:10:12.432 INFO:teuthology.orchestra.run.smithi040.stdout:0 2024-09-12T17:10:12.445 DEBUG:teuthology.orchestra.run.smithi040:> sudo ceph --cluster ceph osd new 9d40d17a-300b-457e-8324-34516d02eff7 1 2024-09-12T17:10:12.652 INFO:teuthology.orchestra.run.smithi040.stdout:1 2024-09-12T17:10:12.663 DEBUG:teuthology.orchestra.run.smithi040:> sudo ceph --cluster ceph osd new 684d7179-44ff-4207-99d6-83d95d5db0bd 2 2024-09-12T17:10:12.868 INFO:teuthology.orchestra.run.smithi040.stdout:2 2024-09-12T17:10:12.880 DEBUG:teuthology.orchestra.run.smithi040:> sudo ceph --cluster ceph osd new 4e13403e-0956-4353-87cf-374da1cd2935 3 2024-09-12T17:10:13.081 INFO:teuthology.orchestra.run.smithi040.stdout:3 2024-09-12T17:10:13.093 DEBUG:teuthology.orchestra.run.smithi040:> sudo ceph --cluster ceph osd new 2b281492-b877-4995-a762-c5568301e966 4 2024-09-12T17:10:13.297 INFO:teuthology.orchestra.run.smithi040.stdout:4 2024-09-12T17:10:13.309 DEBUG:teuthology.orchestra.run.smithi040:> sudo ceph --cluster ceph osd new 5f576703-45a0-4ba6-9bbe-eb19b2734279 5 2024-09-12T17:10:13.516 INFO:teuthology.orchestra.run.smithi040.stdout:5 2024-09-12T17:10:13.527 DEBUG:teuthology.orchestra.run.smithi040:> sudo ceph --cluster ceph osd new 4f8ab3f8-603e-4c9d-a1ec-7ad004f0df28 6 2024-09-12T17:10:13.727 INFO:teuthology.orchestra.run.smithi040.stdout:6 2024-09-12T17:10:13.739 DEBUG:teuthology.orchestra.run.smithi040:> sudo ceph --cluster ceph osd new 62b270ee-ab06-4020-a5f1-9b01ec22a5ae 7 2024-09-12T17:10:13.940 INFO:teuthology.orchestra.run.smithi040.stdout:7 2024-09-12T17:10:13.951 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-12T17:10:13.951 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-12T17:10:13.953 INFO:tasks.ceph.osd.0:Started 2024-09-12T17:10:13.953 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-12T17:10:13.953 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-12T17:10:13.955 INFO:tasks.ceph.osd.1:Started 2024-09-12T17:10:13.955 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-12T17:10:13.956 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-12T17:10:13.958 INFO:tasks.ceph.osd.2:Started 2024-09-12T17:10:13.958 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-12T17:10:13.958 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-12T17:10:13.960 INFO:tasks.ceph.osd.3:Started 2024-09-12T17:10:13.960 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-12T17:10:13.961 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-12T17:10:13.963 INFO:tasks.ceph.osd.4:Started 2024-09-12T17:10:13.963 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-12T17:10:13.963 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-12T17:10:13.965 INFO:tasks.ceph.osd.5:Started 2024-09-12T17:10:13.966 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-12T17:10:13.966 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-12T17:10:13.968 INFO:tasks.ceph.osd.6:Started 2024-09-12T17:10:13.968 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-12T17:10:13.968 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-12T17:10:13.970 INFO:tasks.ceph.osd.7:Started 2024-09-12T17:10:13.971 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T17:10:14.196 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:10:14.197 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":10,"fsid":"46ca2ab5-4447-4511-b6c4-0ec801120127","created":"2024-09-12T17:10:10.692676+0000","modified":"2024-09-12T17:10:13.936520+0000","last_up_change":"0.000000","last_in_change":"2024-09-12T17:10:13.936520+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"85173859-eaf8-4da6-b3f3-7e633fa9dff4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"9d40d17a-300b-457e-8324-34516d02eff7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"684d7179-44ff-4207-99d6-83d95d5db0bd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"4e13403e-0956-4353-87cf-374da1cd2935","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"2b281492-b877-4995-a762-c5568301e966","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"5f576703-45a0-4ba6-9bbe-eb19b2734279","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"4f8ab3f8-603e-4c9d-a1ec-7ad004f0df28","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"62b270ee-ab06-4020-a5f1-9b01ec22a5ae","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T17:10:14.211 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-12T17:10:14.211 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-12T17:10:14.947 INFO:tasks.ceph.osd.4.smithi040.stderr:2024-09-12T17:10:14.945+0000 7f1c5f20d640 -1 Falling back to public interface 2024-09-12T17:10:14.966 INFO:tasks.ceph.osd.6.smithi040.stderr:2024-09-12T17:10:14.964+0000 7f18a271d640 -1 Falling back to public interface 2024-09-12T17:10:15.017 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-12T17:10:15.181 INFO:tasks.ceph.osd.7.smithi040.stderr:2024-09-12T17:10:15.179+0000 7feae5e19640 -1 Falling back to public interface 2024-09-12T17:10:15.202 INFO:tasks.ceph.osd.5.smithi040.stderr:2024-09-12T17:10:15.201+0000 7f7d50cb2640 -1 Falling back to public interface 2024-09-12T17:10:15.250 INFO:teuthology.misc.health.smithi037.stdout: 2024-09-12T17:10:15.250 INFO:teuthology.misc.health.smithi037.stdout:{"epoch":10,"fsid":"46ca2ab5-4447-4511-b6c4-0ec801120127","created":"2024-09-12T17:10:10.692676+0000","modified":"2024-09-12T17:10:13.936520+0000","last_up_change":"0.000000","last_in_change":"2024-09-12T17:10:13.936520+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"85173859-eaf8-4da6-b3f3-7e633fa9dff4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"9d40d17a-300b-457e-8324-34516d02eff7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"684d7179-44ff-4207-99d6-83d95d5db0bd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"4e13403e-0956-4353-87cf-374da1cd2935","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"2b281492-b877-4995-a762-c5568301e966","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"5f576703-45a0-4ba6-9bbe-eb19b2734279","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"4f8ab3f8-603e-4c9d-a1ec-7ad004f0df28","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"62b270ee-ab06-4020-a5f1-9b01ec22a5ae","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T17:10:15.261 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-12T17:10:15.444 INFO:tasks.ceph.osd.2.smithi037.stderr:2024-09-12T17:10:15.442+0000 7f9ca13b2640 -1 Falling back to public interface 2024-09-12T17:10:15.451 INFO:tasks.ceph.osd.0.smithi037.stderr:2024-09-12T17:10:15.449+0000 7f974361e640 -1 Falling back to public interface 2024-09-12T17:10:15.700 INFO:tasks.ceph.osd.3.smithi037.stderr:2024-09-12T17:10:15.698+0000 7f964b040640 -1 Falling back to public interface 2024-09-12T17:10:15.718 INFO:tasks.ceph.osd.1.smithi037.stderr:2024-09-12T17:10:15.717+0000 7fce687b9640 -1 Falling back to public interface 2024-09-12T17:10:16.177 INFO:tasks.ceph.mgr.x.smithi040.stderr:2024-09-12T17:10:16.175+0000 7f3701fe8640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-12T17:10:16.177 INFO:tasks.ceph.mgr.x.smithi040.stderr:2024-09-12T17:10:16.176+0000 7f3701fe8640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-12T17:10:18.771 INFO:tasks.ceph.osd.6.smithi040.stderr:2024-09-12T17:10:18.769+0000 7f18a271d640 -1 osd.6 0 log_to_monitors true 2024-09-12T17:10:18.795 INFO:tasks.ceph.osd.4.smithi040.stderr:2024-09-12T17:10:18.793+0000 7f1c5f20d640 -1 osd.4 0 log_to_monitors true 2024-09-12T17:10:18.961 INFO:tasks.ceph.osd.7.smithi040.stderr:2024-09-12T17:10:18.959+0000 7feae5e19640 -1 osd.7 0 log_to_monitors true 2024-09-12T17:10:19.053 INFO:tasks.ceph.osd.2.smithi037.stderr:2024-09-12T17:10:19.052+0000 7f9ca13b2640 -1 osd.2 0 log_to_monitors true 2024-09-12T17:10:19.329 INFO:tasks.ceph.osd.0.smithi037.stderr:2024-09-12T17:10:19.328+0000 7f974361e640 -1 osd.0 0 log_to_monitors true 2024-09-12T17:10:19.491 INFO:tasks.ceph.osd.5.smithi040.stderr:2024-09-12T17:10:19.490+0000 7f7d50cb2640 -1 osd.5 0 log_to_monitors true 2024-09-12T17:10:19.545 INFO:tasks.ceph.osd.1.smithi037.stderr:2024-09-12T17:10:19.544+0000 7fce687b9640 -1 osd.1 0 log_to_monitors true 2024-09-12T17:10:19.688 INFO:tasks.ceph.osd.3.smithi037.stderr:2024-09-12T17:10:19.686+0000 7f964b040640 -1 osd.3 0 log_to_monitors true 2024-09-12T17:10:22.068 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-12T17:10:22.599 INFO:teuthology.misc.health.smithi037.stdout: 2024-09-12T17:10:22.600 INFO:teuthology.misc.health.smithi037.stdout:{"epoch":12,"fsid":"46ca2ab5-4447-4511-b6c4-0ec801120127","created":"2024-09-12T17:10:10.692676+0000","modified":"2024-09-12T17:10:20.721859+0000","last_up_change":"0.000000","last_in_change":"2024-09-12T17:10:13.936520+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"85173859-eaf8-4da6-b3f3-7e633fa9dff4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"9d40d17a-300b-457e-8324-34516d02eff7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"684d7179-44ff-4207-99d6-83d95d5db0bd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"4e13403e-0956-4353-87cf-374da1cd2935","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"2b281492-b877-4995-a762-c5568301e966","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"5f576703-45a0-4ba6-9bbe-eb19b2734279","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"4f8ab3f8-603e-4c9d-a1ec-7ad004f0df28","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"62b270ee-ab06-4020-a5f1-9b01ec22a5ae","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T17:10:22.617 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-12T17:10:22.789 INFO:tasks.ceph.osd.1.smithi037.stderr:2024-09-12T17:10:22.788+0000 7fce64f61640 -1 osd.1 0 waiting for initial osdmap 2024-09-12T17:10:22.805 INFO:tasks.ceph.osd.1.smithi037.stderr:2024-09-12T17:10:22.804+0000 7fce5c56c640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T17:10:22.809 INFO:tasks.ceph.osd.4.smithi040.stderr:2024-09-12T17:10:22.807+0000 7f1c5b464640 -1 osd.4 0 waiting for initial osdmap 2024-09-12T17:10:22.816 INFO:tasks.ceph.osd.7.smithi040.stderr:2024-09-12T17:10:22.815+0000 7feae1dad640 -1 osd.7 0 waiting for initial osdmap 2024-09-12T17:10:22.822 INFO:tasks.ceph.osd.4.smithi040.stderr:2024-09-12T17:10:22.821+0000 7f1c52a6f640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T17:10:22.828 INFO:tasks.ceph.osd.7.smithi040.stderr:2024-09-12T17:10:22.827+0000 7fead9bcc640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T17:10:22.831 INFO:tasks.ceph.osd.6.smithi040.stderr:2024-09-12T17:10:22.830+0000 7f189eec5640 -1 osd.6 0 waiting for initial osdmap 2024-09-12T17:10:22.847 INFO:tasks.ceph.osd.6.smithi040.stderr:2024-09-12T17:10:22.846+0000 7f18964d0640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T17:10:22.853 INFO:tasks.ceph.osd.5.smithi040.stderr:2024-09-12T17:10:22.852+0000 7f7d4cc46640 -1 osd.5 0 waiting for initial osdmap 2024-09-12T17:10:22.860 INFO:tasks.ceph.osd.3.smithi037.stderr:2024-09-12T17:10:22.859+0000 7f96477e8640 -1 osd.3 0 waiting for initial osdmap 2024-09-12T17:10:22.862 INFO:tasks.ceph.osd.5.smithi040.stderr:2024-09-12T17:10:22.861+0000 7f7d44a65640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T17:10:22.873 INFO:tasks.ceph.osd.3.smithi037.stderr:2024-09-12T17:10:22.872+0000 7f963edf3640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T17:10:22.911 INFO:tasks.ceph.osd.2.smithi037.stderr:2024-09-12T17:10:22.909+0000 7f9c9d346640 -1 osd.2 0 waiting for initial osdmap 2024-09-12T17:10:22.912 INFO:tasks.ceph.osd.0.smithi037.stderr:2024-09-12T17:10:22.911+0000 7f973ef20640 -1 osd.0 0 waiting for initial osdmap 2024-09-12T17:10:22.924 INFO:tasks.ceph.osd.2.smithi037.stderr:2024-09-12T17:10:22.923+0000 7f9c95165640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T17:10:22.933 INFO:tasks.ceph.osd.0.smithi037.stderr:2024-09-12T17:10:22.932+0000 7f9736d3f640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T17:10:29.424 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-12T17:10:29.745 INFO:teuthology.misc.health.smithi037.stdout: 2024-09-12T17:10:29.745 INFO:teuthology.misc.health.smithi037.stdout:{"epoch":17,"fsid":"46ca2ab5-4447-4511-b6c4-0ec801120127","created":"2024-09-12T17:10:10.692676+0000","modified":"2024-09-12T17:10:27.806204+0000","last_up_change":"2024-09-12T17:10:23.790424+0000","last_in_change":"2024-09-12T17:10:13.936520+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T17:10:25.183922+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"85173859-eaf8-4da6-b3f3-7e633fa9dff4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":167247030},{"type":"v1","addr":"172.21.15.37:6809","nonce":167247030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":167247030},{"type":"v1","addr":"172.21.15.37:6811","nonce":167247030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":167247030},{"type":"v1","addr":"172.21.15.37:6815","nonce":167247030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":167247030},{"type":"v1","addr":"172.21.15.37:6813","nonce":167247030}]},"public_addr":"172.21.15.37:6809/167247030","cluster_addr":"172.21.15.37:6811/167247030","heartbeat_back_addr":"172.21.15.37:6815/167247030","heartbeat_front_addr":"172.21.15.37:6813/167247030","state":["exists","up"]},{"osd":1,"uuid":"9d40d17a-300b-457e-8324-34516d02eff7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":3990661154},{"type":"v1","addr":"172.21.15.37:6825","nonce":3990661154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":3990661154},{"type":"v1","addr":"172.21.15.37:6827","nonce":3990661154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":3990661154},{"type":"v1","addr":"172.21.15.37:6831","nonce":3990661154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":3990661154},{"type":"v1","addr":"172.21.15.37:6829","nonce":3990661154}]},"public_addr":"172.21.15.37:6825/3990661154","cluster_addr":"172.21.15.37:6827/3990661154","heartbeat_back_addr":"172.21.15.37:6831/3990661154","heartbeat_front_addr":"172.21.15.37:6829/3990661154","state":["exists","up"]},{"osd":2,"uuid":"684d7179-44ff-4207-99d6-83d95d5db0bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1206746176},{"type":"v1","addr":"172.21.15.37:6801","nonce":1206746176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1206746176},{"type":"v1","addr":"172.21.15.37:6803","nonce":1206746176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1206746176},{"type":"v1","addr":"172.21.15.37:6807","nonce":1206746176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1206746176},{"type":"v1","addr":"172.21.15.37:6805","nonce":1206746176}]},"public_addr":"172.21.15.37:6801/1206746176","cluster_addr":"172.21.15.37:6803/1206746176","heartbeat_back_addr":"172.21.15.37:6807/1206746176","heartbeat_front_addr":"172.21.15.37:6805/1206746176","state":["exists","up"]},{"osd":3,"uuid":"4e13403e-0956-4353-87cf-374da1cd2935","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":2964054205},{"type":"v1","addr":"172.21.15.37:6817","nonce":2964054205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":2964054205},{"type":"v1","addr":"172.21.15.37:6819","nonce":2964054205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":2964054205},{"type":"v1","addr":"172.21.15.37:6823","nonce":2964054205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":2964054205},{"type":"v1","addr":"172.21.15.37:6821","nonce":2964054205}]},"public_addr":"172.21.15.37:6817/2964054205","cluster_addr":"172.21.15.37:6819/2964054205","heartbeat_back_addr":"172.21.15.37:6823/2964054205","heartbeat_front_addr":"172.21.15.37:6821/2964054205","state":["exists","up"]},{"osd":4,"uuid":"2b281492-b877-4995-a762-c5568301e966","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":2441293461},{"type":"v1","addr":"172.21.15.40:6801","nonce":2441293461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":2441293461},{"type":"v1","addr":"172.21.15.40:6803","nonce":2441293461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":2441293461},{"type":"v1","addr":"172.21.15.40:6807","nonce":2441293461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":2441293461},{"type":"v1","addr":"172.21.15.40:6805","nonce":2441293461}]},"public_addr":"172.21.15.40:6801/2441293461","cluster_addr":"172.21.15.40:6803/2441293461","heartbeat_back_addr":"172.21.15.40:6807/2441293461","heartbeat_front_addr":"172.21.15.40:6805/2441293461","state":["exists","up"]},{"osd":5,"uuid":"5f576703-45a0-4ba6-9bbe-eb19b2734279","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":4130399962},{"type":"v1","addr":"172.21.15.40:6827","nonce":4130399962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":4130399962},{"type":"v1","addr":"172.21.15.40:6829","nonce":4130399962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":4130399962},{"type":"v1","addr":"172.21.15.40:6833","nonce":4130399962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":4130399962},{"type":"v1","addr":"172.21.15.40:6831","nonce":4130399962}]},"public_addr":"172.21.15.40:6827/4130399962","cluster_addr":"172.21.15.40:6829/4130399962","heartbeat_back_addr":"172.21.15.40:6833/4130399962","heartbeat_front_addr":"172.21.15.40:6831/4130399962","state":["exists","up"]},{"osd":6,"uuid":"4f8ab3f8-603e-4c9d-a1ec-7ad004f0df28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":2253405131},{"type":"v1","addr":"172.21.15.40:6809","nonce":2253405131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":2253405131},{"type":"v1","addr":"172.21.15.40:6811","nonce":2253405131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":2253405131},{"type":"v1","addr":"172.21.15.40:6815","nonce":2253405131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":2253405131},{"type":"v1","addr":"172.21.15.40:6813","nonce":2253405131}]},"public_addr":"172.21.15.40:6809/2253405131","cluster_addr":"172.21.15.40:6811/2253405131","heartbeat_back_addr":"172.21.15.40:6815/2253405131","heartbeat_front_addr":"172.21.15.40:6813/2253405131","state":["exists","up"]},{"osd":7,"uuid":"62b270ee-ab06-4020-a5f1-9b01ec22a5ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":1210108009},{"type":"v1","addr":"172.21.15.40:6819","nonce":1210108009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":1210108009},{"type":"v1","addr":"172.21.15.40:6821","nonce":1210108009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":1210108009},{"type":"v1","addr":"172.21.15.40:6825","nonce":1210108009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":1210108009},{"type":"v1","addr":"172.21.15.40:6823","nonce":1210108009}]},"public_addr":"172.21.15.40:6819/1210108009","cluster_addr":"172.21.15.40:6821/1210108009","heartbeat_back_addr":"172.21.15.40:6825/1210108009","heartbeat_front_addr":"172.21.15.40:6823/1210108009","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:10:20.324419+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:10:20.548440+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:10:20.046599+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:10:20.703116+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:10:19.792341+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:10:20.456210+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:10:19.803964+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:10:19.932197+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T17:10:29.757 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-12T17:10:29.758 INFO:tasks.ceph:Creating RBD pool 2024-09-12T17:10:29.758 DEBUG:teuthology.orchestra.run.smithi037:> sudo ceph --cluster ceph osd pool create rbd 8 2024-09-12T17:10:30.833 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'rbd' created 2024-09-12T17:10:30.850 DEBUG:teuthology.orchestra.run.smithi037:> rbd --cluster ceph pool init rbd 2024-09-12T17:10:30.914 INFO:teuthology.orchestra.run.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:10:30.915 INFO:teuthology.orchestra.run.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:10:33.860 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-12T17:10:33.860 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2024-09-12T17:10:33.861 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-12T17:10:34.189 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:10:34.202 INFO:teuthology.orchestra.run.smithi037.stdout:[{"version":9,"timestamp":"2024-09-12T17:10:22.915159+0000","name":"","changes":[{"name":"osd.0/osd_mclock_max_capacity_iops_ssd","new_value":"4306.450423"}]}] 2024-09-12T17:10:34.202 INFO:tasks.ceph_manager:config epoch is 9 2024-09-12T17:10:34.203 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-12T17:10:34.203 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-12T17:10:34.203 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-12T17:10:34.568 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:10:34.578 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":5,"flags":0,"active_gid":4099,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":3916250676},{"type":"v1","addr":"172.21.15.40:6817","nonce":3916250676}]},"active_addr":"172.21.15.40:6817/3916250676","active_change":"2024-09-12T17:10:15.162154+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[{"gid":4106,"name":"y","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.40:0","nonce":2054654457}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.40:0","nonce":2155210553}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.40:0","nonce":1848987248}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.40:0","nonce":2765242519}]}]} 2024-09-12T17:10:34.583 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-12T17:10:34.583 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-12T17:10:34.583 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T17:10:34.897 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:10:34.897 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":21,"fsid":"46ca2ab5-4447-4511-b6c4-0ec801120127","created":"2024-09-12T17:10:10.692676+0000","modified":"2024-09-12T17:10:33.840756+0000","last_up_change":"2024-09-12T17:10:23.790424+0000","last_in_change":"2024-09-12T17:10:13.936520+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T17:10:25.183922+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T17:10:30.069092+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":21,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"85173859-eaf8-4da6-b3f3-7e633fa9dff4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":167247030},{"type":"v1","addr":"172.21.15.37:6809","nonce":167247030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":167247030},{"type":"v1","addr":"172.21.15.37:6811","nonce":167247030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":167247030},{"type":"v1","addr":"172.21.15.37:6815","nonce":167247030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":167247030},{"type":"v1","addr":"172.21.15.37:6813","nonce":167247030}]},"public_addr":"172.21.15.37:6809/167247030","cluster_addr":"172.21.15.37:6811/167247030","heartbeat_back_addr":"172.21.15.37:6815/167247030","heartbeat_front_addr":"172.21.15.37:6813/167247030","state":["exists","up"]},{"osd":1,"uuid":"9d40d17a-300b-457e-8324-34516d02eff7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":3990661154},{"type":"v1","addr":"172.21.15.37:6825","nonce":3990661154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":3990661154},{"type":"v1","addr":"172.21.15.37:6827","nonce":3990661154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":3990661154},{"type":"v1","addr":"172.21.15.37:6831","nonce":3990661154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":3990661154},{"type":"v1","addr":"172.21.15.37:6829","nonce":3990661154}]},"public_addr":"172.21.15.37:6825/3990661154","cluster_addr":"172.21.15.37:6827/3990661154","heartbeat_back_addr":"172.21.15.37:6831/3990661154","heartbeat_front_addr":"172.21.15.37:6829/3990661154","state":["exists","up"]},{"osd":2,"uuid":"684d7179-44ff-4207-99d6-83d95d5db0bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1206746176},{"type":"v1","addr":"172.21.15.37:6801","nonce":1206746176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1206746176},{"type":"v1","addr":"172.21.15.37:6803","nonce":1206746176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1206746176},{"type":"v1","addr":"172.21.15.37:6807","nonce":1206746176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1206746176},{"type":"v1","addr":"172.21.15.37:6805","nonce":1206746176}]},"public_addr":"172.21.15.37:6801/1206746176","cluster_addr":"172.21.15.37:6803/1206746176","heartbeat_back_addr":"172.21.15.37:6807/1206746176","heartbeat_front_addr":"172.21.15.37:6805/1206746176","state":["exists","up"]},{"osd":3,"uuid":"4e13403e-0956-4353-87cf-374da1cd2935","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":2964054205},{"type":"v1","addr":"172.21.15.37:6817","nonce":2964054205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":2964054205},{"type":"v1","addr":"172.21.15.37:6819","nonce":2964054205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":2964054205},{"type":"v1","addr":"172.21.15.37:6823","nonce":2964054205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":2964054205},{"type":"v1","addr":"172.21.15.37:6821","nonce":2964054205}]},"public_addr":"172.21.15.37:6817/2964054205","cluster_addr":"172.21.15.37:6819/2964054205","heartbeat_back_addr":"172.21.15.37:6823/2964054205","heartbeat_front_addr":"172.21.15.37:6821/2964054205","state":["exists","up"]},{"osd":4,"uuid":"2b281492-b877-4995-a762-c5568301e966","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":2441293461},{"type":"v1","addr":"172.21.15.40:6801","nonce":2441293461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":2441293461},{"type":"v1","addr":"172.21.15.40:6803","nonce":2441293461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":2441293461},{"type":"v1","addr":"172.21.15.40:6807","nonce":2441293461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":2441293461},{"type":"v1","addr":"172.21.15.40:6805","nonce":2441293461}]},"public_addr":"172.21.15.40:6801/2441293461","cluster_addr":"172.21.15.40:6803/2441293461","heartbeat_back_addr":"172.21.15.40:6807/2441293461","heartbeat_front_addr":"172.21.15.40:6805/2441293461","state":["exists","up"]},{"osd":5,"uuid":"5f576703-45a0-4ba6-9bbe-eb19b2734279","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":4130399962},{"type":"v1","addr":"172.21.15.40:6827","nonce":4130399962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":4130399962},{"type":"v1","addr":"172.21.15.40:6829","nonce":4130399962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":4130399962},{"type":"v1","addr":"172.21.15.40:6833","nonce":4130399962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":4130399962},{"type":"v1","addr":"172.21.15.40:6831","nonce":4130399962}]},"public_addr":"172.21.15.40:6827/4130399962","cluster_addr":"172.21.15.40:6829/4130399962","heartbeat_back_addr":"172.21.15.40:6833/4130399962","heartbeat_front_addr":"172.21.15.40:6831/4130399962","state":["exists","up"]},{"osd":6,"uuid":"4f8ab3f8-603e-4c9d-a1ec-7ad004f0df28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":2253405131},{"type":"v1","addr":"172.21.15.40:6809","nonce":2253405131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":2253405131},{"type":"v1","addr":"172.21.15.40:6811","nonce":2253405131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":2253405131},{"type":"v1","addr":"172.21.15.40:6815","nonce":2253405131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":2253405131},{"type":"v1","addr":"172.21.15.40:6813","nonce":2253405131}]},"public_addr":"172.21.15.40:6809/2253405131","cluster_addr":"172.21.15.40:6811/2253405131","heartbeat_back_addr":"172.21.15.40:6815/2253405131","heartbeat_front_addr":"172.21.15.40:6813/2253405131","state":["exists","up"]},{"osd":7,"uuid":"62b270ee-ab06-4020-a5f1-9b01ec22a5ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":1210108009},{"type":"v1","addr":"172.21.15.40:6819","nonce":1210108009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":1210108009},{"type":"v1","addr":"172.21.15.40:6821","nonce":1210108009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":1210108009},{"type":"v1","addr":"172.21.15.40:6825","nonce":1210108009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":1210108009},{"type":"v1","addr":"172.21.15.40:6823","nonce":1210108009}]},"public_addr":"172.21.15.40:6819/1210108009","cluster_addr":"172.21.15.40:6821/1210108009","heartbeat_back_addr":"172.21.15.40:6825/1210108009","heartbeat_front_addr":"172.21.15.40:6823/1210108009","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:10:20.324419+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:10:20.548440+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:10:20.046599+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:10:20.703116+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:10:19.792341+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:10:20.456210+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:10:19.803964+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:10:19.932197+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T17:10:34.910 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-12T17:10:34.910 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T17:10:35.225 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:10:35.225 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":21,"fsid":"46ca2ab5-4447-4511-b6c4-0ec801120127","created":"2024-09-12T17:10:10.692676+0000","modified":"2024-09-12T17:10:33.840756+0000","last_up_change":"2024-09-12T17:10:23.790424+0000","last_in_change":"2024-09-12T17:10:13.936520+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T17:10:25.183922+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T17:10:30.069092+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":21,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"85173859-eaf8-4da6-b3f3-7e633fa9dff4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":167247030},{"type":"v1","addr":"172.21.15.37:6809","nonce":167247030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":167247030},{"type":"v1","addr":"172.21.15.37:6811","nonce":167247030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":167247030},{"type":"v1","addr":"172.21.15.37:6815","nonce":167247030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":167247030},{"type":"v1","addr":"172.21.15.37:6813","nonce":167247030}]},"public_addr":"172.21.15.37:6809/167247030","cluster_addr":"172.21.15.37:6811/167247030","heartbeat_back_addr":"172.21.15.37:6815/167247030","heartbeat_front_addr":"172.21.15.37:6813/167247030","state":["exists","up"]},{"osd":1,"uuid":"9d40d17a-300b-457e-8324-34516d02eff7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":3990661154},{"type":"v1","addr":"172.21.15.37:6825","nonce":3990661154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":3990661154},{"type":"v1","addr":"172.21.15.37:6827","nonce":3990661154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":3990661154},{"type":"v1","addr":"172.21.15.37:6831","nonce":3990661154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":3990661154},{"type":"v1","addr":"172.21.15.37:6829","nonce":3990661154}]},"public_addr":"172.21.15.37:6825/3990661154","cluster_addr":"172.21.15.37:6827/3990661154","heartbeat_back_addr":"172.21.15.37:6831/3990661154","heartbeat_front_addr":"172.21.15.37:6829/3990661154","state":["exists","up"]},{"osd":2,"uuid":"684d7179-44ff-4207-99d6-83d95d5db0bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1206746176},{"type":"v1","addr":"172.21.15.37:6801","nonce":1206746176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1206746176},{"type":"v1","addr":"172.21.15.37:6803","nonce":1206746176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1206746176},{"type":"v1","addr":"172.21.15.37:6807","nonce":1206746176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1206746176},{"type":"v1","addr":"172.21.15.37:6805","nonce":1206746176}]},"public_addr":"172.21.15.37:6801/1206746176","cluster_addr":"172.21.15.37:6803/1206746176","heartbeat_back_addr":"172.21.15.37:6807/1206746176","heartbeat_front_addr":"172.21.15.37:6805/1206746176","state":["exists","up"]},{"osd":3,"uuid":"4e13403e-0956-4353-87cf-374da1cd2935","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":2964054205},{"type":"v1","addr":"172.21.15.37:6817","nonce":2964054205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":2964054205},{"type":"v1","addr":"172.21.15.37:6819","nonce":2964054205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":2964054205},{"type":"v1","addr":"172.21.15.37:6823","nonce":2964054205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":2964054205},{"type":"v1","addr":"172.21.15.37:6821","nonce":2964054205}]},"public_addr":"172.21.15.37:6817/2964054205","cluster_addr":"172.21.15.37:6819/2964054205","heartbeat_back_addr":"172.21.15.37:6823/2964054205","heartbeat_front_addr":"172.21.15.37:6821/2964054205","state":["exists","up"]},{"osd":4,"uuid":"2b281492-b877-4995-a762-c5568301e966","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":2441293461},{"type":"v1","addr":"172.21.15.40:6801","nonce":2441293461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":2441293461},{"type":"v1","addr":"172.21.15.40:6803","nonce":2441293461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":2441293461},{"type":"v1","addr":"172.21.15.40:6807","nonce":2441293461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":2441293461},{"type":"v1","addr":"172.21.15.40:6805","nonce":2441293461}]},"public_addr":"172.21.15.40:6801/2441293461","cluster_addr":"172.21.15.40:6803/2441293461","heartbeat_back_addr":"172.21.15.40:6807/2441293461","heartbeat_front_addr":"172.21.15.40:6805/2441293461","state":["exists","up"]},{"osd":5,"uuid":"5f576703-45a0-4ba6-9bbe-eb19b2734279","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":4130399962},{"type":"v1","addr":"172.21.15.40:6827","nonce":4130399962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":4130399962},{"type":"v1","addr":"172.21.15.40:6829","nonce":4130399962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":4130399962},{"type":"v1","addr":"172.21.15.40:6833","nonce":4130399962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":4130399962},{"type":"v1","addr":"172.21.15.40:6831","nonce":4130399962}]},"public_addr":"172.21.15.40:6827/4130399962","cluster_addr":"172.21.15.40:6829/4130399962","heartbeat_back_addr":"172.21.15.40:6833/4130399962","heartbeat_front_addr":"172.21.15.40:6831/4130399962","state":["exists","up"]},{"osd":6,"uuid":"4f8ab3f8-603e-4c9d-a1ec-7ad004f0df28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":2253405131},{"type":"v1","addr":"172.21.15.40:6809","nonce":2253405131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":2253405131},{"type":"v1","addr":"172.21.15.40:6811","nonce":2253405131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":2253405131},{"type":"v1","addr":"172.21.15.40:6815","nonce":2253405131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":2253405131},{"type":"v1","addr":"172.21.15.40:6813","nonce":2253405131}]},"public_addr":"172.21.15.40:6809/2253405131","cluster_addr":"172.21.15.40:6811/2253405131","heartbeat_back_addr":"172.21.15.40:6815/2253405131","heartbeat_front_addr":"172.21.15.40:6813/2253405131","state":["exists","up"]},{"osd":7,"uuid":"62b270ee-ab06-4020-a5f1-9b01ec22a5ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":1210108009},{"type":"v1","addr":"172.21.15.40:6819","nonce":1210108009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":1210108009},{"type":"v1","addr":"172.21.15.40:6821","nonce":1210108009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":1210108009},{"type":"v1","addr":"172.21.15.40:6825","nonce":1210108009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":1210108009},{"type":"v1","addr":"172.21.15.40:6823","nonce":1210108009}]},"public_addr":"172.21.15.40:6819/1210108009","cluster_addr":"172.21.15.40:6821/1210108009","heartbeat_back_addr":"172.21.15.40:6825/1210108009","heartbeat_front_addr":"172.21.15.40:6823/1210108009","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:10:20.324419+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:10:20.548440+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:10:20.046599+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:10:20.703116+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:10:19.792341+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:10:20.456210+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:10:19.803964+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:10:19.932197+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T17:10:35.238 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-12T17:10:35.239 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-12T17:10:35.239 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-12T17:10:35.240 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-12T17:10:35.240 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-12T17:10:35.240 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-12T17:10:35.241 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-12T17:10:35.241 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-12T17:10:35.518 INFO:teuthology.orchestra.run.smithi037.stdout:55834574854 2024-09-12T17:10:35.518 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-12T17:10:35.520 INFO:teuthology.orchestra.run.smithi037.stdout:55834574854 2024-09-12T17:10:35.520 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-12T17:10:35.522 INFO:teuthology.orchestra.run.smithi037.stdout:55834574854 2024-09-12T17:10:35.522 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-12T17:10:35.523 INFO:teuthology.orchestra.run.smithi037.stdout:55834574855 2024-09-12T17:10:35.524 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-12T17:10:35.524 INFO:teuthology.orchestra.run.smithi037.stdout:55834574854 2024-09-12T17:10:35.525 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-12T17:10:35.525 INFO:teuthology.orchestra.run.smithi037.stdout:55834574854 2024-09-12T17:10:35.526 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-12T17:10:35.527 INFO:teuthology.orchestra.run.smithi037.stdout:55834574854 2024-09-12T17:10:35.527 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-12T17:10:35.528 INFO:teuthology.orchestra.run.smithi037.stdout:55834574854 2024-09-12T17:10:35.528 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-12T17:10:36.194 INFO:teuthology.orchestra.run.smithi037.stdout:55834574854 2024-09-12T17:10:36.214 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.3 2024-09-12T17:10:36.214 INFO:teuthology.orchestra.run.smithi037.stdout:55834574853 2024-09-12T17:10:36.215 INFO:teuthology.orchestra.run.smithi037.stdout:55834574853 2024-09-12T17:10:36.218 INFO:teuthology.orchestra.run.smithi037.stdout:55834574853 2024-09-12T17:10:36.222 INFO:teuthology.orchestra.run.smithi037.stdout:55834574853 2024-09-12T17:10:36.229 INFO:teuthology.orchestra.run.smithi037.stdout:55834574853 2024-09-12T17:10:36.233 INFO:teuthology.orchestra.run.smithi037.stdout:55834574853 2024-09-12T17:10:36.234 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.5 2024-09-12T17:10:36.236 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.4 2024-09-12T17:10:36.236 INFO:teuthology.orchestra.run.smithi037.stdout:55834574853 2024-09-12T17:10:36.242 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.1 2024-09-12T17:10:36.245 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.7 2024-09-12T17:10:36.250 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.0 2024-09-12T17:10:36.253 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.2 2024-09-12T17:10:36.253 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.6 2024-09-12T17:10:37.215 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-12T17:10:37.235 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-12T17:10:37.237 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-12T17:10:37.244 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-12T17:10:37.246 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-12T17:10:37.251 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-12T17:10:37.253 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-12T17:10:37.254 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-12T17:10:37.884 INFO:teuthology.orchestra.run.smithi037.stdout:55834574855 2024-09-12T17:10:37.900 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.3 2024-09-12T17:10:37.901 DEBUG:teuthology.parallel:result is None 2024-09-12T17:10:37.906 INFO:teuthology.orchestra.run.smithi037.stdout:55834574854 2024-09-12T17:10:37.920 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.6 2024-09-12T17:10:37.920 DEBUG:teuthology.parallel:result is None 2024-09-12T17:10:37.922 INFO:teuthology.orchestra.run.smithi037.stdout:55834574854 2024-09-12T17:10:37.924 INFO:teuthology.orchestra.run.smithi037.stdout:55834574854 2024-09-12T17:10:37.928 INFO:teuthology.orchestra.run.smithi037.stdout:55834574854 2024-09-12T17:10:37.929 INFO:teuthology.orchestra.run.smithi037.stdout:55834574854 2024-09-12T17:10:37.944 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.7 2024-09-12T17:10:37.945 DEBUG:teuthology.parallel:result is None 2024-09-12T17:10:37.945 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.4 2024-09-12T17:10:37.945 DEBUG:teuthology.parallel:result is None 2024-09-12T17:10:37.948 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.0 2024-09-12T17:10:37.948 INFO:teuthology.orchestra.run.smithi037.stdout:55834574854 2024-09-12T17:10:37.949 DEBUG:teuthology.parallel:result is None 2024-09-12T17:10:37.949 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.5 2024-09-12T17:10:37.949 DEBUG:teuthology.parallel:result is None 2024-09-12T17:10:37.952 INFO:teuthology.orchestra.run.smithi037.stdout:55834574854 2024-09-12T17:10:37.963 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.2 2024-09-12T17:10:37.963 DEBUG:teuthology.parallel:result is None 2024-09-12T17:10:37.966 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.1 2024-09-12T17:10:37.966 DEBUG:teuthology.parallel:result is None 2024-09-12T17:10:37.966 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T17:10:37.966 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T17:10:38.316 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:10:38.317 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-09-12T17:10:38.329 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-09-12T17:10:37.171236+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":11,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":219100,"kb_used_data":2864,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755620,"statfs":{"total":773094113280,"available":772869754880,"internally_reserved":0,"allocated":2932736,"data_stored":1769310,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001356"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T17:10:33.848505+0000","last_change":"2024-09-12T17:10:33.848505+0000","last_active":"2024-09-12T17:10:33.848505+0000","last_peered":"2024-09-12T17:10:33.848505+0000","last_clean":"2024-09-12T17:10:33.848505+0000","last_became_active":"2024-09-12T17:10:31.846123+0000","last_became_peered":"2024-09-12T17:10:31.846123+0000","last_unstale":"2024-09-12T17:10:33.848505+0000","last_undegraded":"2024-09-12T17:10:33.848505+0000","last_fullsized":"2024-09-12T17:10:33.848505+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:30.818274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:30.818274+0000","last_clean_scrub_stamp":"2024-09-12T17:10:30.818274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:48:25.408756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042024599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T17:10:33.854523+0000","last_change":"2024-09-12T17:10:33.854523+0000","last_active":"2024-09-12T17:10:33.854523+0000","last_peered":"2024-09-12T17:10:33.854523+0000","last_clean":"2024-09-12T17:10:33.854523+0000","last_became_active":"2024-09-12T17:10:31.845481+0000","last_became_peered":"2024-09-12T17:10:31.845481+0000","last_unstale":"2024-09-12T17:10:33.854523+0000","last_undegraded":"2024-09-12T17:10:33.854523+0000","last_fullsized":"2024-09-12T17:10:33.854523+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:30.818274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:30.818274+0000","last_clean_scrub_stamp":"2024-09-12T17:10:30.818274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:06:13.863048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060466100000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T17:10:33.955366+0000","last_change":"2024-09-12T17:10:33.955366+0000","last_active":"2024-09-12T17:10:33.955366+0000","last_peered":"2024-09-12T17:10:33.955366+0000","last_clean":"2024-09-12T17:10:33.955366+0000","last_became_active":"2024-09-12T17:10:32.177457+0000","last_became_peered":"2024-09-12T17:10:32.177457+0000","last_unstale":"2024-09-12T17:10:33.955366+0000","last_undegraded":"2024-09-12T17:10:33.955366+0000","last_fullsized":"2024-09-12T17:10:33.955366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:30.818274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:30.818274+0000","last_clean_scrub_stamp":"2024-09-12T17:10:30.818274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:40:39.661808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000468751,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T17:10:33.854505+0000","last_change":"2024-09-12T17:10:33.854505+0000","last_active":"2024-09-12T17:10:33.854505+0000","last_peered":"2024-09-12T17:10:33.854505+0000","last_clean":"2024-09-12T17:10:33.854505+0000","last_became_active":"2024-09-12T17:10:32.177463+0000","last_became_peered":"2024-09-12T17:10:32.177463+0000","last_unstale":"2024-09-12T17:10:33.854505+0000","last_undegraded":"2024-09-12T17:10:33.854505+0000","last_fullsized":"2024-09-12T17:10:33.854505+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:30.818274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:30.818274+0000","last_clean_scrub_stamp":"2024-09-12T17:10:30.818274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:37:29.735097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059857599999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"21'2","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T17:10:33.853441+0000","last_change":"2024-09-12T17:10:33.852654+0000","last_active":"2024-09-12T17:10:33.853441+0000","last_peered":"2024-09-12T17:10:33.853441+0000","last_clean":"2024-09-12T17:10:33.853441+0000","last_became_active":"2024-09-12T17:10:31.849085+0000","last_became_peered":"2024-09-12T17:10:31.849085+0000","last_unstale":"2024-09-12T17:10:33.853441+0000","last_undegraded":"2024-09-12T17:10:33.853441+0000","last_fullsized":"2024-09-12T17:10:33.853441+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:30.818274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:30.818274+0000","last_clean_scrub_stamp":"2024-09-12T17:10:30.818274+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:06:13.863048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011727,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T17:10:34.162797+0000","last_change":"2024-09-12T17:10:34.162797+0000","last_active":"2024-09-12T17:10:34.162797+0000","last_peered":"2024-09-12T17:10:34.162797+0000","last_clean":"2024-09-12T17:10:34.162797+0000","last_became_active":"2024-09-12T17:10:31.841982+0000","last_became_peered":"2024-09-12T17:10:31.841982+0000","last_unstale":"2024-09-12T17:10:34.162797+0000","last_undegraded":"2024-09-12T17:10:34.162797+0000","last_fullsized":"2024-09-12T17:10:34.162797+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:30.818274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:30.818274+0000","last_clean_scrub_stamp":"2024-09-12T17:10:30.818274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:00:41.985746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00030998799999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T17:10:33.955353+0000","last_change":"2024-09-12T17:10:33.955353+0000","last_active":"2024-09-12T17:10:33.955353+0000","last_peered":"2024-09-12T17:10:33.955353+0000","last_clean":"2024-09-12T17:10:33.955353+0000","last_became_active":"2024-09-12T17:10:31.848972+0000","last_became_peered":"2024-09-12T17:10:31.848972+0000","last_unstale":"2024-09-12T17:10:33.955353+0000","last_undegraded":"2024-09-12T17:10:33.955353+0000","last_fullsized":"2024-09-12T17:10:33.955353+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:30.818274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:30.818274+0000","last_clean_scrub_stamp":"2024-09-12T17:10:30.818274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:42:53.392909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054881099999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"19'1","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T17:10:33.852086+0000","last_change":"2024-09-12T17:10:33.852086+0000","last_active":"2024-09-12T17:10:33.852086+0000","last_peered":"2024-09-12T17:10:33.852086+0000","last_clean":"2024-09-12T17:10:33.852086+0000","last_became_active":"2024-09-12T17:10:31.846572+0000","last_became_peered":"2024-09-12T17:10:31.846572+0000","last_unstale":"2024-09-12T17:10:33.852086+0000","last_undegraded":"2024-09-12T17:10:33.852086+0000","last_fullsized":"2024-09-12T17:10:33.852086+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:30.818274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:30.818274+0000","last_clean_scrub_stamp":"2024-09-12T17:10:30.818274+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:56:58.387797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060306800000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"16'72","reported_seq":110,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T17:10:33.954790+0000","last_change":"2024-09-12T17:10:26.808302+0000","last_active":"2024-09-12T17:10:33.954790+0000","last_peered":"2024-09-12T17:10:33.954790+0000","last_clean":"2024-09-12T17:10:33.954790+0000","last_became_active":"2024-09-12T17:10:26.807964+0000","last_became_peered":"2024-09-12T17:10:26.807964+0000","last_unstale":"2024-09-12T17:10:33.954790+0000","last_undegraded":"2024-09-12T17:10:33.954790+0000","last_fullsized":"2024-09-12T17:10:33.954790+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:25.795895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:25.795895+0000","last_clean_scrub_stamp":"2024-09-12T17:10:25.795895+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:28:36.202819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":811008,"data_stored":663935,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":73567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":221184,"data_stored":73586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":73567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":73567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":73567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":221184,"data_stored":73586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":811008,"data_stored":663935,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T17:10:38.331 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T17:10:38.642 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:10:38.642 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-09-12T17:10:38.654 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-09-12T17:10:37.171236+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":11,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":219100,"kb_used_data":2864,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755620,"statfs":{"total":773094113280,"available":772869754880,"internally_reserved":0,"allocated":2932736,"data_stored":1769310,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001356"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T17:10:33.848505+0000","last_change":"2024-09-12T17:10:33.848505+0000","last_active":"2024-09-12T17:10:33.848505+0000","last_peered":"2024-09-12T17:10:33.848505+0000","last_clean":"2024-09-12T17:10:33.848505+0000","last_became_active":"2024-09-12T17:10:31.846123+0000","last_became_peered":"2024-09-12T17:10:31.846123+0000","last_unstale":"2024-09-12T17:10:33.848505+0000","last_undegraded":"2024-09-12T17:10:33.848505+0000","last_fullsized":"2024-09-12T17:10:33.848505+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:30.818274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:30.818274+0000","last_clean_scrub_stamp":"2024-09-12T17:10:30.818274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:48:25.408756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042024599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T17:10:33.854523+0000","last_change":"2024-09-12T17:10:33.854523+0000","last_active":"2024-09-12T17:10:33.854523+0000","last_peered":"2024-09-12T17:10:33.854523+0000","last_clean":"2024-09-12T17:10:33.854523+0000","last_became_active":"2024-09-12T17:10:31.845481+0000","last_became_peered":"2024-09-12T17:10:31.845481+0000","last_unstale":"2024-09-12T17:10:33.854523+0000","last_undegraded":"2024-09-12T17:10:33.854523+0000","last_fullsized":"2024-09-12T17:10:33.854523+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:30.818274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:30.818274+0000","last_clean_scrub_stamp":"2024-09-12T17:10:30.818274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:06:13.863048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060466100000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T17:10:33.955366+0000","last_change":"2024-09-12T17:10:33.955366+0000","last_active":"2024-09-12T17:10:33.955366+0000","last_peered":"2024-09-12T17:10:33.955366+0000","last_clean":"2024-09-12T17:10:33.955366+0000","last_became_active":"2024-09-12T17:10:32.177457+0000","last_became_peered":"2024-09-12T17:10:32.177457+0000","last_unstale":"2024-09-12T17:10:33.955366+0000","last_undegraded":"2024-09-12T17:10:33.955366+0000","last_fullsized":"2024-09-12T17:10:33.955366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:30.818274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:30.818274+0000","last_clean_scrub_stamp":"2024-09-12T17:10:30.818274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:40:39.661808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000468751,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T17:10:33.854505+0000","last_change":"2024-09-12T17:10:33.854505+0000","last_active":"2024-09-12T17:10:33.854505+0000","last_peered":"2024-09-12T17:10:33.854505+0000","last_clean":"2024-09-12T17:10:33.854505+0000","last_became_active":"2024-09-12T17:10:32.177463+0000","last_became_peered":"2024-09-12T17:10:32.177463+0000","last_unstale":"2024-09-12T17:10:33.854505+0000","last_undegraded":"2024-09-12T17:10:33.854505+0000","last_fullsized":"2024-09-12T17:10:33.854505+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:30.818274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:30.818274+0000","last_clean_scrub_stamp":"2024-09-12T17:10:30.818274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:37:29.735097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059857599999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"21'2","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T17:10:33.853441+0000","last_change":"2024-09-12T17:10:33.852654+0000","last_active":"2024-09-12T17:10:33.853441+0000","last_peered":"2024-09-12T17:10:33.853441+0000","last_clean":"2024-09-12T17:10:33.853441+0000","last_became_active":"2024-09-12T17:10:31.849085+0000","last_became_peered":"2024-09-12T17:10:31.849085+0000","last_unstale":"2024-09-12T17:10:33.853441+0000","last_undegraded":"2024-09-12T17:10:33.853441+0000","last_fullsized":"2024-09-12T17:10:33.853441+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:30.818274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:30.818274+0000","last_clean_scrub_stamp":"2024-09-12T17:10:30.818274+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:06:13.863048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011727,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T17:10:34.162797+0000","last_change":"2024-09-12T17:10:34.162797+0000","last_active":"2024-09-12T17:10:34.162797+0000","last_peered":"2024-09-12T17:10:34.162797+0000","last_clean":"2024-09-12T17:10:34.162797+0000","last_became_active":"2024-09-12T17:10:31.841982+0000","last_became_peered":"2024-09-12T17:10:31.841982+0000","last_unstale":"2024-09-12T17:10:34.162797+0000","last_undegraded":"2024-09-12T17:10:34.162797+0000","last_fullsized":"2024-09-12T17:10:34.162797+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:30.818274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:30.818274+0000","last_clean_scrub_stamp":"2024-09-12T17:10:30.818274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:00:41.985746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00030998799999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T17:10:33.955353+0000","last_change":"2024-09-12T17:10:33.955353+0000","last_active":"2024-09-12T17:10:33.955353+0000","last_peered":"2024-09-12T17:10:33.955353+0000","last_clean":"2024-09-12T17:10:33.955353+0000","last_became_active":"2024-09-12T17:10:31.848972+0000","last_became_peered":"2024-09-12T17:10:31.848972+0000","last_unstale":"2024-09-12T17:10:33.955353+0000","last_undegraded":"2024-09-12T17:10:33.955353+0000","last_fullsized":"2024-09-12T17:10:33.955353+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:30.818274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:30.818274+0000","last_clean_scrub_stamp":"2024-09-12T17:10:30.818274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:42:53.392909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054881099999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"19'1","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T17:10:33.852086+0000","last_change":"2024-09-12T17:10:33.852086+0000","last_active":"2024-09-12T17:10:33.852086+0000","last_peered":"2024-09-12T17:10:33.852086+0000","last_clean":"2024-09-12T17:10:33.852086+0000","last_became_active":"2024-09-12T17:10:31.846572+0000","last_became_peered":"2024-09-12T17:10:31.846572+0000","last_unstale":"2024-09-12T17:10:33.852086+0000","last_undegraded":"2024-09-12T17:10:33.852086+0000","last_fullsized":"2024-09-12T17:10:33.852086+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:30.818274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:30.818274+0000","last_clean_scrub_stamp":"2024-09-12T17:10:30.818274+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:56:58.387797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060306800000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"16'72","reported_seq":110,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T17:10:33.954790+0000","last_change":"2024-09-12T17:10:26.808302+0000","last_active":"2024-09-12T17:10:33.954790+0000","last_peered":"2024-09-12T17:10:33.954790+0000","last_clean":"2024-09-12T17:10:33.954790+0000","last_became_active":"2024-09-12T17:10:26.807964+0000","last_became_peered":"2024-09-12T17:10:26.807964+0000","last_unstale":"2024-09-12T17:10:33.954790+0000","last_undegraded":"2024-09-12T17:10:33.954790+0000","last_fullsized":"2024-09-12T17:10:33.954790+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:25.795895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:25.795895+0000","last_clean_scrub_stamp":"2024-09-12T17:10:25.795895+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:28:36.202819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":811008,"data_stored":663935,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":73567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":221184,"data_stored":73586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":73567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":73567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":73567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":221184,"data_stored":73586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":811008,"data_stored":663935,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T17:10:38.655 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T17:10:38.655 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-12T17:10:38.655 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-12T17:10:38.656 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-12T17:10:39.005 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:10:39.006 INFO:teuthology.orchestra.run.smithi037.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-12T17:10:39.018 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-12T17:10:39.019 INFO:teuthology.run_tasks:Running task openssl_keys... 2024-09-12T17:10:39.031 INFO:teuthology.run_tasks:Running task rgw... 2024-09-12T17:10:39.082 DEBUG:tasks.rgw:config is {'client.0': {'valgrind': ['--tool=memcheck', '--max-threads=1024']}} 2024-09-12T17:10:39.082 DEBUG:tasks.rgw:client list is dict_keys(['client.0']) 2024-09-12T17:10:39.082 INFO:tasks.rgw:Creating data pools 2024-09-12T17:10:39.082 DEBUG:tasks.rgw:Obtaining remote for client client.0 2024-09-12T17:10:39.082 DEBUG:teuthology.orchestra.run.smithi037:> sudo ceph osd erasure-code-profile set client.0 crush-failure-domain=osd k=3 m=1 name=testprofile --cluster ceph 2024-09-12T17:10:39.891 DEBUG:teuthology.orchestra.run.smithi037:> sudo ceph osd pool create default.rgw.buckets.data 64 64 erasure client.0 --cluster ceph 2024-09-12T17:10:41.483 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'default.rgw.buckets.data' created 2024-09-12T17:10:41.507 DEBUG:teuthology.orchestra.run.smithi037:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster ceph 2024-09-12T17:10:42.494 INFO:teuthology.orchestra.run.smithi037.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2024-09-12T17:10:42.534 DEBUG:teuthology.orchestra.run.smithi037:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster ceph 2024-09-12T17:10:43.497 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'default.rgw.buckets.index' created 2024-09-12T17:10:43.522 DEBUG:teuthology.orchestra.run.smithi037:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster ceph 2024-09-12T17:10:44.496 INFO:teuthology.orchestra.run.smithi037.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2024-09-12T17:10:44.535 DEBUG:tasks.rgw:Pools created 2024-09-12T17:10:44.535 INFO:tasks.rgw:Configuring compression type = random 2024-09-12T17:10:44.535 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2024-09-12T17:10:44.535 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2024-09-12T17:10:44.536 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2024-09-12T17:10:44.648 INFO:teuthology.orchestra.run.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:10:44.648 INFO:teuthology.orchestra.run.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:10:46.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:46.563+0000 7f78896de640 0 -- 172.21.15.37:0/411062879 >> [v2:172.21.15.40:6816/3916250676,v1:172.21.15.40:6817/3916250676] conn(0x7f7764076380 msgr2=0x7f7764078840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:10:46.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:46.567+0000 7f788d12e800 20 rados->read ofs=0 len=0 2024-09-12T17:10:46.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:46.569+0000 7f78886dc640 0 -- 172.21.15.37:0/966568751 >> [v2:172.21.15.37:6824/3990661154,v1:172.21.15.37:6825/3990661154] conn(0x5595e75e7a00 msgr2=0x5595e75e9e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:10:46.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:46.770+0000 7f788d12e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:10:46.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:46.770+0000 7f788d12e800 20 realm 2024-09-12T17:10:46.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:46.770+0000 7f788d12e800 20 rados->read ofs=0 len=0 2024-09-12T17:10:46.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:46.771+0000 7f788d12e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:10:46.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:46.771+0000 7f788d12e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:10:46.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:46.771+0000 7f788d12e800 20 rados->read ofs=0 len=0 2024-09-12T17:10:46.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:46.771+0000 7f788d12e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:10:46.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:46.771+0000 7f788d12e800 20 rados->read ofs=0 len=0 2024-09-12T17:10:46.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:46.772+0000 7f788d12e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:10:46.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:46.772+0000 7f788d12e800 20 rados->read ofs=0 len=0 2024-09-12T17:10:46.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:46.773+0000 7f788d12e800 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:10:46.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:46.773+0000 7f788d12e800 20 searching for the correct realm 2024-09-12T17:10:46.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:46.788+0000 7f788d12e800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:10:46.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:46.788+0000 7f788d12e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:10:46.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:46.788+0000 7f788d12e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:10:46.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:46.788+0000 7f788d12e800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:10:46.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:46.788+0000 7f788d12e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:10:46.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:46.788+0000 7f788d12e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:10:46.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:46.788+0000 7f788d12e800 20 rados->read ofs=0 len=0 2024-09-12T17:10:46.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:46.788+0000 7f788d12e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:10:46.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:46.788+0000 7f788d12e800 20 rados->read ofs=0 len=0 2024-09-12T17:10:46.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:46.792+0000 7f788d12e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:10:46.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:46.792+0000 7f788d12e800 20 rados->read ofs=0 len=0 2024-09-12T17:10:46.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:46.792+0000 7f788d12e800 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:10:46.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:46.792+0000 7f788d12e800 20 zone default found 2024-09-12T17:10:46.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:46.792+0000 7f788d12e800 4 Realm: () 2024-09-12T17:10:46.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:46.792+0000 7f788d12e800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:10:46.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:46.792+0000 7f788d12e800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:10:46.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:46.792+0000 7f788d12e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:10:46.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:46.792+0000 7f788d12e800 20 zonegroup default 2024-09-12T17:10:46.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:46.792+0000 7f788d12e800 20 rados->read ofs=0 len=0 2024-09-12T17:10:46.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:46.793+0000 7f788d12e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:10:46.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:46.793+0000 7f788d12e800 20 rados->read ofs=0 len=0 2024-09-12T17:10:48.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:48.542+0000 7f788d12e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:10:48.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:48.542+0000 7f788d12e800 20 rados->read ofs=0 len=0 2024-09-12T17:10:48.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:48.543+0000 7f788d12e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:10:48.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:48.543+0000 7f788d12e800 20 started sync module instance, tier type = 2024-09-12T17:10:48.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:48.543+0000 7f788d12e800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:10:50.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.581+0000 7f788d12e800 20 add_watcher() i=0 2024-09-12T17:10:50.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.581+0000 7f788d12e800 20 add_watcher() i=1 2024-09-12T17:10:50.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.581+0000 7f788d12e800 20 add_watcher() i=2 2024-09-12T17:10:50.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.581+0000 7f788d12e800 20 add_watcher() i=3 2024-09-12T17:10:50.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.581+0000 7f788d12e800 20 add_watcher() i=4 2024-09-12T17:10:50.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.581+0000 7f788d12e800 20 add_watcher() i=5 2024-09-12T17:10:50.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.581+0000 7f788d12e800 20 add_watcher() i=6 2024-09-12T17:10:50.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.582+0000 7f788d12e800 20 add_watcher() i=7 2024-09-12T17:10:50.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.582+0000 7f788d12e800 2 all 8 watchers are set, enabling cache 2024-09-12T17:10:50.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.582+0000 7f788d12e800 5 tl::expected, obj_version>, boost::system::error_code> logback_generations::read(const DoutPrefixProvider*, optional_yield):410: oid=data_loggenerations_metadata not found 2024-09-12T17:10:50.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.583+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.0 2024-09-12T17:10:50.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.583+0000 7f788d12e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:50.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.583+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.0 does not exist 2024-09-12T17:10:50.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.583+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.1 2024-09-12T17:10:50.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.583+0000 7f788d12e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:50.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.583+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.1 does not exist 2024-09-12T17:10:50.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.583+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.2 2024-09-12T17:10:50.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.583+0000 7f788d12e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:50.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.584+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.2 does not exist 2024-09-12T17:10:50.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.584+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.3 2024-09-12T17:10:50.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.584+0000 7f788d12e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:50.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.584+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.3 does not exist 2024-09-12T17:10:50.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.584+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.4 2024-09-12T17:10:50.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.584+0000 7f788d12e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:50.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.584+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.4 does not exist 2024-09-12T17:10:50.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.584+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.5 2024-09-12T17:10:50.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.584+0000 7f788d12e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:50.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.585+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.5 does not exist 2024-09-12T17:10:50.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.585+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.6 2024-09-12T17:10:50.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.585+0000 7f788d12e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:50.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.585+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.6 does not exist 2024-09-12T17:10:50.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.585+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.7 2024-09-12T17:10:50.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.585+0000 7f788d12e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:50.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.585+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.7 does not exist 2024-09-12T17:10:50.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.585+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.8 2024-09-12T17:10:50.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.585+0000 7f788d12e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:50.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.586+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.8 does not exist 2024-09-12T17:10:50.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.586+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.9 2024-09-12T17:10:50.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.586+0000 7f788d12e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:50.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.586+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.9 does not exist 2024-09-12T17:10:50.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.586+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.10 2024-09-12T17:10:50.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.586+0000 7f788d12e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:50.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.586+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.10 does not exist 2024-09-12T17:10:50.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.586+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.11 2024-09-12T17:10:50.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.586+0000 7f788d12e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:50.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.586+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.11 does not exist 2024-09-12T17:10:50.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.586+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.12 2024-09-12T17:10:50.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.586+0000 7f788d12e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:50.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.587+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.12 does not exist 2024-09-12T17:10:50.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.587+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.13 2024-09-12T17:10:50.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.587+0000 7f788d12e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:50.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.587+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.13 does not exist 2024-09-12T17:10:50.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.587+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.14 2024-09-12T17:10:50.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.587+0000 7f788d12e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:50.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.588+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.14 does not exist 2024-09-12T17:10:50.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.588+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.15 2024-09-12T17:10:50.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.588+0000 7f788d12e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:50.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.588+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.15 does not exist 2024-09-12T17:10:50.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.588+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.16 2024-09-12T17:10:50.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.588+0000 7f788d12e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:50.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.588+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.16 does not exist 2024-09-12T17:10:50.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.588+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.17 2024-09-12T17:10:50.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.588+0000 7f788d12e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:50.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.589+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.17 does not exist 2024-09-12T17:10:50.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.589+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.18 2024-09-12T17:10:50.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.589+0000 7f788d12e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:50.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.589+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.18 does not exist 2024-09-12T17:10:50.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.589+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.19 2024-09-12T17:10:50.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.589+0000 7f788d12e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:50.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.589+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.19 does not exist 2024-09-12T17:10:50.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.589+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.20 2024-09-12T17:10:50.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.589+0000 7f788d12e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:50.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.589+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.20 does not exist 2024-09-12T17:10:50.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.589+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.21 2024-09-12T17:10:50.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.589+0000 7f788d12e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:50.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.590+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.21 does not exist 2024-09-12T17:10:50.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.590+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.22 2024-09-12T17:10:50.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.590+0000 7f788d12e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:50.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.590+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.22 does not exist 2024-09-12T17:10:50.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.590+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.23 2024-09-12T17:10:50.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.590+0000 7f788d12e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:50.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.590+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.23 does not exist 2024-09-12T17:10:50.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.590+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.24 2024-09-12T17:10:50.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.590+0000 7f788d12e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:50.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.591+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.24 does not exist 2024-09-12T17:10:50.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.591+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.25 2024-09-12T17:10:50.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.591+0000 7f788d12e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:50.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.591+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.25 does not exist 2024-09-12T17:10:50.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.591+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.26 2024-09-12T17:10:50.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.591+0000 7f788d12e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:50.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.591+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.26 does not exist 2024-09-12T17:10:50.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.591+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.27 2024-09-12T17:10:50.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.591+0000 7f788d12e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:50.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.591+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.27 does not exist 2024-09-12T17:10:50.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.591+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.28 2024-09-12T17:10:50.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.591+0000 7f788d12e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:50.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.592+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.28 does not exist 2024-09-12T17:10:50.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.592+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.29 2024-09-12T17:10:50.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.592+0000 7f788d12e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:50.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.592+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.29 does not exist 2024-09-12T17:10:50.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.592+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.30 2024-09-12T17:10:50.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.592+0000 7f788d12e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:50.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.592+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.30 does not exist 2024-09-12T17:10:50.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.592+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.31 2024-09-12T17:10:50.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.592+0000 7f788d12e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:50.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.593+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.31 does not exist 2024-09-12T17:10:50.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.593+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.32 2024-09-12T17:10:50.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.593+0000 7f788d12e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:50.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.593+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.32 does not exist 2024-09-12T17:10:50.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.593+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.33 2024-09-12T17:10:50.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.593+0000 7f788d12e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:50.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.593+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.33 does not exist 2024-09-12T17:10:50.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.593+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.34 2024-09-12T17:10:50.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.593+0000 7f788d12e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:50.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.594+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.34 does not exist 2024-09-12T17:10:50.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.594+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.35 2024-09-12T17:10:50.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.594+0000 7f788d12e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:50.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.594+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.35 does not exist 2024-09-12T17:10:50.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.594+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.36 2024-09-12T17:10:50.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.594+0000 7f788d12e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:50.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.594+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.36 does not exist 2024-09-12T17:10:50.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.594+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.37 2024-09-12T17:10:50.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.594+0000 7f788d12e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:50.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.595+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.37 does not exist 2024-09-12T17:10:50.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.595+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.38 2024-09-12T17:10:50.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.595+0000 7f788d12e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:50.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.595+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.38 does not exist 2024-09-12T17:10:50.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.595+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.39 2024-09-12T17:10:50.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.595+0000 7f788d12e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:50.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.595+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.39 does not exist 2024-09-12T17:10:50.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.595+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.40 2024-09-12T17:10:50.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.595+0000 7f788d12e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:50.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.595+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.40 does not exist 2024-09-12T17:10:50.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.595+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.41 2024-09-12T17:10:50.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.595+0000 7f788d12e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:50.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.596+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.41 does not exist 2024-09-12T17:10:50.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.596+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.42 2024-09-12T17:10:50.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.596+0000 7f788d12e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:50.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.596+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.42 does not exist 2024-09-12T17:10:50.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.596+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.43 2024-09-12T17:10:50.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.596+0000 7f788d12e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:50.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.596+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.43 does not exist 2024-09-12T17:10:50.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.596+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.44 2024-09-12T17:10:50.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.596+0000 7f788d12e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:50.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.596+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.44 does not exist 2024-09-12T17:10:50.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.596+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.45 2024-09-12T17:10:50.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.596+0000 7f788d12e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:50.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.597+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.45 does not exist 2024-09-12T17:10:50.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.597+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.46 2024-09-12T17:10:50.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.597+0000 7f788d12e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:50.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.597+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.46 does not exist 2024-09-12T17:10:50.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.597+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.47 2024-09-12T17:10:50.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.597+0000 7f788d12e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:50.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.597+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.47 does not exist 2024-09-12T17:10:50.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.597+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.48 2024-09-12T17:10:50.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.597+0000 7f788d12e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:50.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.597+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.48 does not exist 2024-09-12T17:10:50.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.597+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.49 2024-09-12T17:10:50.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.597+0000 7f788d12e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:50.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.598+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.49 does not exist 2024-09-12T17:10:50.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.598+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.50 2024-09-12T17:10:50.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.598+0000 7f788d12e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:50.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.598+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.50 does not exist 2024-09-12T17:10:50.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.598+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.51 2024-09-12T17:10:50.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.598+0000 7f788d12e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:50.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.598+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.51 does not exist 2024-09-12T17:10:50.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.598+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.52 2024-09-12T17:10:50.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.598+0000 7f788d12e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:50.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.598+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.52 does not exist 2024-09-12T17:10:50.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.598+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.53 2024-09-12T17:10:50.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.598+0000 7f788d12e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:50.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.599+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.53 does not exist 2024-09-12T17:10:50.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.599+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.54 2024-09-12T17:10:50.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.599+0000 7f788d12e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:50.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.599+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.54 does not exist 2024-09-12T17:10:50.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.599+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.55 2024-09-12T17:10:50.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.599+0000 7f788d12e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:50.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.599+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.55 does not exist 2024-09-12T17:10:50.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.599+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.56 2024-09-12T17:10:50.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.599+0000 7f788d12e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:50.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.599+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.56 does not exist 2024-09-12T17:10:50.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.599+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.57 2024-09-12T17:10:50.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.599+0000 7f788d12e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:50.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.600+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.57 does not exist 2024-09-12T17:10:50.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.600+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.58 2024-09-12T17:10:50.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.600+0000 7f788d12e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:50.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.600+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.58 does not exist 2024-09-12T17:10:50.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.600+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.59 2024-09-12T17:10:50.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.600+0000 7f788d12e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:50.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.600+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.59 does not exist 2024-09-12T17:10:50.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.600+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.60 2024-09-12T17:10:50.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.600+0000 7f788d12e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:50.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.600+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.60 does not exist 2024-09-12T17:10:50.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.600+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.61 2024-09-12T17:10:50.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.600+0000 7f788d12e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:50.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.601+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.61 does not exist 2024-09-12T17:10:50.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.601+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.62 2024-09-12T17:10:50.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.601+0000 7f788d12e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:50.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.601+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.62 does not exist 2024-09-12T17:10:50.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.601+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.63 2024-09-12T17:10:50.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.601+0000 7f788d12e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:50.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.601+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.63 does not exist 2024-09-12T17:10:50.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.601+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.64 2024-09-12T17:10:50.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.601+0000 7f788d12e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:50.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.601+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.64 does not exist 2024-09-12T17:10:50.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.601+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.65 2024-09-12T17:10:50.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.601+0000 7f788d12e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:50.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.602+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.65 does not exist 2024-09-12T17:10:50.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.602+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.66 2024-09-12T17:10:50.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.602+0000 7f788d12e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:50.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.602+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.66 does not exist 2024-09-12T17:10:50.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.602+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.67 2024-09-12T17:10:50.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.602+0000 7f788d12e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:50.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.602+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.67 does not exist 2024-09-12T17:10:50.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.602+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.68 2024-09-12T17:10:50.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.602+0000 7f788d12e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:50.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.602+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.68 does not exist 2024-09-12T17:10:50.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.602+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.69 2024-09-12T17:10:50.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.602+0000 7f788d12e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:50.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.603+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.69 does not exist 2024-09-12T17:10:50.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.603+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.70 2024-09-12T17:10:50.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.603+0000 7f788d12e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:50.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.603+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.70 does not exist 2024-09-12T17:10:50.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.603+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.71 2024-09-12T17:10:50.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.603+0000 7f788d12e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:50.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.603+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.71 does not exist 2024-09-12T17:10:50.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.603+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.72 2024-09-12T17:10:50.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.603+0000 7f788d12e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:50.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.604+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.72 does not exist 2024-09-12T17:10:50.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.604+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.73 2024-09-12T17:10:50.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.604+0000 7f788d12e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:50.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.604+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.73 does not exist 2024-09-12T17:10:50.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.604+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.74 2024-09-12T17:10:50.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.604+0000 7f788d12e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:50.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.604+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.74 does not exist 2024-09-12T17:10:50.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.604+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.75 2024-09-12T17:10:50.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.604+0000 7f788d12e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:50.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.605+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.75 does not exist 2024-09-12T17:10:50.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.605+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.76 2024-09-12T17:10:50.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.605+0000 7f788d12e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:50.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.605+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.76 does not exist 2024-09-12T17:10:50.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.605+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.77 2024-09-12T17:10:50.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.605+0000 7f788d12e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:50.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.605+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.77 does not exist 2024-09-12T17:10:50.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.605+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.78 2024-09-12T17:10:50.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.605+0000 7f788d12e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:50.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.606+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.78 does not exist 2024-09-12T17:10:50.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.606+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.79 2024-09-12T17:10:50.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.606+0000 7f788d12e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:50.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.606+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.79 does not exist 2024-09-12T17:10:50.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.606+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.80 2024-09-12T17:10:50.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.606+0000 7f788d12e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:50.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.606+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.80 does not exist 2024-09-12T17:10:50.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.606+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.81 2024-09-12T17:10:50.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.606+0000 7f788d12e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:50.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.607+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.81 does not exist 2024-09-12T17:10:50.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.607+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.82 2024-09-12T17:10:50.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.607+0000 7f788d12e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:50.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.607+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.82 does not exist 2024-09-12T17:10:50.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.607+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.83 2024-09-12T17:10:50.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.607+0000 7f788d12e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:50.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.607+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.83 does not exist 2024-09-12T17:10:50.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.607+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.84 2024-09-12T17:10:50.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.607+0000 7f788d12e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:50.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.608+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.84 does not exist 2024-09-12T17:10:50.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.608+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.85 2024-09-12T17:10:50.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.608+0000 7f788d12e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:50.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.608+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.85 does not exist 2024-09-12T17:10:50.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.608+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.86 2024-09-12T17:10:50.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.608+0000 7f788d12e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:50.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.608+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.86 does not exist 2024-09-12T17:10:50.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.608+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.87 2024-09-12T17:10:50.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.608+0000 7f788d12e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:50.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.609+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.87 does not exist 2024-09-12T17:10:50.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.609+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.88 2024-09-12T17:10:50.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.609+0000 7f788d12e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:50.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.609+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.88 does not exist 2024-09-12T17:10:50.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.609+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.89 2024-09-12T17:10:50.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.609+0000 7f788d12e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:50.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.609+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.89 does not exist 2024-09-12T17:10:50.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.609+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.90 2024-09-12T17:10:50.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.609+0000 7f788d12e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:50.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.609+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.90 does not exist 2024-09-12T17:10:50.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.609+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.91 2024-09-12T17:10:50.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.609+0000 7f788d12e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:50.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.610+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.91 does not exist 2024-09-12T17:10:50.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.610+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.92 2024-09-12T17:10:50.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.610+0000 7f788d12e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:50.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.610+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.92 does not exist 2024-09-12T17:10:50.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.610+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.93 2024-09-12T17:10:50.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.610+0000 7f788d12e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:50.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.610+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.93 does not exist 2024-09-12T17:10:50.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.610+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.94 2024-09-12T17:10:50.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.610+0000 7f788d12e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:50.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.611+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.94 does not exist 2024-09-12T17:10:50.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.611+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.95 2024-09-12T17:10:50.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.611+0000 7f788d12e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:50.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.611+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.95 does not exist 2024-09-12T17:10:50.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.611+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.96 2024-09-12T17:10:50.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.611+0000 7f788d12e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:50.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.611+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.96 does not exist 2024-09-12T17:10:50.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.611+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.97 2024-09-12T17:10:50.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.611+0000 7f788d12e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:50.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.612+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.97 does not exist 2024-09-12T17:10:50.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.612+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.98 2024-09-12T17:10:50.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.612+0000 7f788d12e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:50.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.612+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.98 does not exist 2024-09-12T17:10:50.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.612+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.99 2024-09-12T17:10:50.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.612+0000 7f788d12e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:50.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.612+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.99 does not exist 2024-09-12T17:10:50.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.612+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.100 2024-09-12T17:10:50.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.612+0000 7f788d12e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:50.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.612+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.100 does not exist 2024-09-12T17:10:50.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.612+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.101 2024-09-12T17:10:50.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.612+0000 7f788d12e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:50.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.613+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.101 does not exist 2024-09-12T17:10:50.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.613+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.102 2024-09-12T17:10:50.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.613+0000 7f788d12e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:50.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.613+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.102 does not exist 2024-09-12T17:10:50.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.613+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.103 2024-09-12T17:10:50.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.613+0000 7f788d12e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:50.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.613+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.103 does not exist 2024-09-12T17:10:50.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.613+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.104 2024-09-12T17:10:50.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.613+0000 7f788d12e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:50.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.614+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.104 does not exist 2024-09-12T17:10:50.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.614+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.105 2024-09-12T17:10:50.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.614+0000 7f788d12e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:50.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.614+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.105 does not exist 2024-09-12T17:10:50.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.614+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.106 2024-09-12T17:10:50.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.614+0000 7f788d12e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:50.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.614+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.106 does not exist 2024-09-12T17:10:50.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.614+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.107 2024-09-12T17:10:50.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.614+0000 7f788d12e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:50.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.614+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.107 does not exist 2024-09-12T17:10:50.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.614+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.108 2024-09-12T17:10:50.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.614+0000 7f788d12e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:50.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.615+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.108 does not exist 2024-09-12T17:10:50.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.615+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.109 2024-09-12T17:10:50.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.615+0000 7f788d12e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:50.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.615+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.109 does not exist 2024-09-12T17:10:50.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.615+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.110 2024-09-12T17:10:50.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.615+0000 7f788d12e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:50.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.615+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.110 does not exist 2024-09-12T17:10:50.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.615+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.111 2024-09-12T17:10:50.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.615+0000 7f788d12e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:50.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.615+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.111 does not exist 2024-09-12T17:10:50.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.615+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.112 2024-09-12T17:10:50.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.615+0000 7f788d12e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:50.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.616+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.112 does not exist 2024-09-12T17:10:50.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.616+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.113 2024-09-12T17:10:50.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.616+0000 7f788d12e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:50.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.616+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.113 does not exist 2024-09-12T17:10:50.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.616+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.114 2024-09-12T17:10:50.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.616+0000 7f788d12e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:50.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.616+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.114 does not exist 2024-09-12T17:10:50.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.616+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.115 2024-09-12T17:10:50.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.616+0000 7f788d12e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:50.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.616+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.115 does not exist 2024-09-12T17:10:50.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.616+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.116 2024-09-12T17:10:50.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.616+0000 7f788d12e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:50.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.617+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.116 does not exist 2024-09-12T17:10:50.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.617+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.117 2024-09-12T17:10:50.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.617+0000 7f788d12e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:50.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.617+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.117 does not exist 2024-09-12T17:10:50.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.617+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.118 2024-09-12T17:10:50.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.617+0000 7f788d12e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:50.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.617+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.118 does not exist 2024-09-12T17:10:50.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.617+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.119 2024-09-12T17:10:50.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.617+0000 7f788d12e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:50.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.617+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.119 does not exist 2024-09-12T17:10:50.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.617+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.120 2024-09-12T17:10:50.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.617+0000 7f788d12e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:50.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.618+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.120 does not exist 2024-09-12T17:10:50.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.618+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.121 2024-09-12T17:10:50.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.618+0000 7f788d12e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:50.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.618+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.121 does not exist 2024-09-12T17:10:50.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.618+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.122 2024-09-12T17:10:50.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.618+0000 7f788d12e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:50.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.618+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.122 does not exist 2024-09-12T17:10:50.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.618+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.123 2024-09-12T17:10:50.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.618+0000 7f788d12e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:50.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.619+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.123 does not exist 2024-09-12T17:10:50.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.619+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.124 2024-09-12T17:10:50.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.619+0000 7f788d12e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:50.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.619+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.124 does not exist 2024-09-12T17:10:50.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.619+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.125 2024-09-12T17:10:50.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.619+0000 7f788d12e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:50.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.619+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.125 does not exist 2024-09-12T17:10:50.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.619+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.126 2024-09-12T17:10:50.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.619+0000 7f788d12e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:50.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.619+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.126 does not exist 2024-09-12T17:10:50.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.619+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.127 2024-09-12T17:10:50.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.619+0000 7f788d12e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:50.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.620+0000 7f788d12e800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.127 does not exist 2024-09-12T17:10:50.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.620+0000 7f788d12e800 20 static int rgw::cls::fifo::FIFO::create(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, std::optional >, bool, uint64_t, uint64_t):1211 entering 2024-09-12T17:10:50.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.621+0000 7f788d12e800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:10:50.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.626+0000 7f773b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:10:50.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.626+0000 7f788d12e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:10:50.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:50.626+0000 7f788d12e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:10:53.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:53.577+0000 7f788d12e800 10 rgw_init_ioctx warning: failed to set recovery_priority on default.rgw.meta 2024-09-12T17:10:53.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:53.577+0000 7f788d12e800 5 note: GC not initialized 2024-09-12T17:10:53.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:53.577+0000 7f773a7e4640 20 reqs_thread_entry: start 2024-09-12T17:10:53.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:53.578+0000 7f788d12e800 20 init_complete bucket index max shards: 11 2024-09-12T17:10:53.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:53.578+0000 7f788d12e800 20 Filter name: none 2024-09-12T17:10:53.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:53.578+0000 7f77337fe640 20 reqs_thread_entry: start 2024-09-12T17:10:53.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:53.608+0000 7f773b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:10:53.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:53.611+0000 7f788d12e800 20 remove_watcher() i=0 2024-09-12T17:10:53.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:53.611+0000 7f788d12e800 2 removed watcher, disabling cache 2024-09-12T17:10:53.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:53.612+0000 7f788d12e800 20 remove_watcher() i=1 2024-09-12T17:10:53.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:53.615+0000 7f788d12e800 20 remove_watcher() i=2 2024-09-12T17:10:53.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:53.616+0000 7f788d12e800 20 remove_watcher() i=3 2024-09-12T17:10:53.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:53.618+0000 7f788d12e800 20 remove_watcher() i=4 2024-09-12T17:10:53.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:53.619+0000 7f788d12e800 20 remove_watcher() i=5 2024-09-12T17:10:53.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:53.620+0000 7f788d12e800 20 remove_watcher() i=6 2024-09-12T17:10:53.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:53.622+0000 7f788d12e800 20 remove_watcher() i=7 2024-09-12T17:10:53.637 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-09-12T17:10:53.638 DEBUG:tasks.util.rgw: json result: [] 2024-09-12T17:10:53.638 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2024-09-12T17:10:53.638 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2024-09-12T17:10:53.638 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement modify --rgw-zone default --placement-id default-placement --compression random 2024-09-12T17:10:53.706 INFO:teuthology.orchestra.run.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:10:53.706 INFO:teuthology.orchestra.run.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:10:53.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:53.733+0000 7f4f3931f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:10:53.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:53.733+0000 7f4f3931f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:10:53.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:53.737+0000 7f4d737fe640 20 reqs_thread_entry: start 2024-09-12T17:10:53.758 INFO:teuthology.orchestra.run.smithi037.stdout:{"id":"722b129a-cf7a-4aca-b594-5b9492d130e2","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-09-12T17:10:53.759 DEBUG:tasks.util.rgw: json result: {'id': '722b129a-cf7a-4aca-b594-5b9492d130e2', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-09-12T17:10:53.759 INFO:tasks.rgw:Preparing directory for rgw datacache at /tmp/rgw_datacache 2024-09-12T17:10:53.759 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -p /tmp/rgw_datacache 2024-09-12T17:10:53.790 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod a+rwx /tmp/rgw_datacache 2024-09-12T17:10:53.870 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2024-09-12T17:10:53.871 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2024-09-12T17:10:53.871 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2024-09-12T17:10:53.969 INFO:teuthology.orchestra.run.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:10:53.969 INFO:teuthology.orchestra.run.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:10:54.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:54.003+0000 7f5df2f0c800 20 rados->read ofs=0 len=0 2024-09-12T17:10:54.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:54.005+0000 7f5df2f0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:10:54.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:54.005+0000 7f5df2f0c800 20 realm 2024-09-12T17:10:54.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:54.005+0000 7f5df2f0c800 20 rados->read ofs=0 len=0 2024-09-12T17:10:54.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:54.005+0000 7f5df2f0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:10:54.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:54.005+0000 7f5df2f0c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:10:54.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:54.005+0000 7f5df2f0c800 20 rados->read ofs=0 len=0 2024-09-12T17:10:54.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:54.005+0000 7f5df2f0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:10:54.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:54.005+0000 7f5df2f0c800 20 rados->read ofs=0 len=0 2024-09-12T17:10:54.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:54.007+0000 7f5df2f0c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:10:54.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:54.007+0000 7f5df2f0c800 20 rados->read ofs=0 len=0 2024-09-12T17:10:54.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:54.007+0000 7f5df2f0c800 20 rados_obj.operate() r=0 bl.length=1009 2024-09-12T17:10:54.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:54.007+0000 7f5df2f0c800 20 searching for the correct realm 2024-09-12T17:10:54.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:54.011+0000 7f5df11f7640 0 -- 172.21.15.37:0/2111443672 >> [v2:172.21.15.40:6808/2253405131,v1:172.21.15.40:6809/2253405131] conn(0x7f5de408f040 msgr2=0x7f5de4060770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:10:54.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:54.218+0000 7f5df09f6640 0 -- 172.21.15.37:0/2111443672 >> [v2:172.21.15.40:6826/4130399962,v1:172.21.15.40:6827/4130399962] conn(0x56273594b550 msgr2=0x56273594d940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:10:54.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:54.221+0000 7f5df2f0c800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:10:54.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:54.221+0000 7f5df2f0c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:10:54.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:54.221+0000 7f5df2f0c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:10:54.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:54.221+0000 7f5df2f0c800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:10:54.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:54.221+0000 7f5df2f0c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:10:54.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:54.221+0000 7f5df2f0c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:10:54.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:54.221+0000 7f5df2f0c800 20 rados->read ofs=0 len=0 2024-09-12T17:10:54.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:54.221+0000 7f5df2f0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:10:54.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:54.221+0000 7f5df2f0c800 20 rados->read ofs=0 len=0 2024-09-12T17:10:54.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:54.221+0000 7f5df2f0c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:10:54.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:54.221+0000 7f5df2f0c800 20 rados->read ofs=0 len=0 2024-09-12T17:10:54.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:54.222+0000 7f5df2f0c800 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:10:54.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:54.222+0000 7f5df2f0c800 20 zone default found 2024-09-12T17:10:54.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:54.222+0000 7f5df2f0c800 4 Realm: () 2024-09-12T17:10:54.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:54.222+0000 7f5df2f0c800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:10:54.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:54.222+0000 7f5df2f0c800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:10:54.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:54.222+0000 7f5df2f0c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:10:54.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:54.222+0000 7f5df2f0c800 20 zonegroup default 2024-09-12T17:10:54.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:54.222+0000 7f5df2f0c800 20 rados->read ofs=0 len=0 2024-09-12T17:10:54.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:54.222+0000 7f5df2f0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:10:54.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:54.222+0000 7f5df2f0c800 20 rados->read ofs=0 len=0 2024-09-12T17:10:54.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:54.222+0000 7f5df2f0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:10:54.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:54.222+0000 7f5df2f0c800 20 rados->read ofs=0 len=0 2024-09-12T17:10:54.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:54.222+0000 7f5df2f0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:10:54.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:54.222+0000 7f5df2f0c800 20 started sync module instance, tier type = 2024-09-12T17:10:54.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:54.222+0000 7f5df2f0c800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:10:54.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:54.240+0000 7f5df2f0c800 20 add_watcher() i=0 2024-09-12T17:10:54.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:54.240+0000 7f5df2f0c800 20 add_watcher() i=1 2024-09-12T17:10:54.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:54.240+0000 7f5df2f0c800 20 add_watcher() i=2 2024-09-12T17:10:54.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:54.240+0000 7f5df2f0c800 20 add_watcher() i=3 2024-09-12T17:10:54.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:54.240+0000 7f5df2f0c800 20 add_watcher() i=4 2024-09-12T17:10:54.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:54.240+0000 7f5df2f0c800 20 add_watcher() i=5 2024-09-12T17:10:54.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:54.240+0000 7f5df2f0c800 20 add_watcher() i=6 2024-09-12T17:10:54.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:54.241+0000 7f5df2f0c800 20 add_watcher() i=7 2024-09-12T17:10:54.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:54.241+0000 7f5df2f0c800 2 all 8 watchers are set, enabling cache 2024-09-12T17:10:54.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:54.243+0000 7f5ca6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:10:54.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:54.243+0000 7f5df2f0c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:10:54.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:54.243+0000 7f5df2f0c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:10:54.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:54.243+0000 7f5df2f0c800 5 note: GC not initialized 2024-09-12T17:10:54.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:54.243+0000 7f5ca5fe3640 20 reqs_thread_entry: start 2024-09-12T17:10:54.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:54.243+0000 7f5df2f0c800 20 init_complete bucket index max shards: 11 2024-09-12T17:10:54.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:54.244+0000 7f5df2f0c800 20 Filter name: none 2024-09-12T17:10:54.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:54.244+0000 7f5c177fe640 20 reqs_thread_entry: start 2024-09-12T17:10:54.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:54.254+0000 7f5ca6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:10:54.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:54.263+0000 7f5df2f0c800 20 remove_watcher() i=0 2024-09-12T17:10:54.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:54.263+0000 7f5df2f0c800 2 removed watcher, disabling cache 2024-09-12T17:10:54.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:54.265+0000 7f5df2f0c800 20 remove_watcher() i=1 2024-09-12T17:10:54.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:54.266+0000 7f5df2f0c800 20 remove_watcher() i=2 2024-09-12T17:10:54.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:54.267+0000 7f5df2f0c800 20 remove_watcher() i=3 2024-09-12T17:10:54.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:54.268+0000 7f5df2f0c800 20 remove_watcher() i=4 2024-09-12T17:10:54.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:54.269+0000 7f5df2f0c800 20 remove_watcher() i=5 2024-09-12T17:10:54.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:54.272+0000 7f5df2f0c800 20 remove_watcher() i=6 2024-09-12T17:10:54.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:54.274+0000 7f5df2f0c800 20 remove_watcher() i=7 2024-09-12T17:10:54.286 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-09-12T17:10:54.287 DEBUG:tasks.util.rgw: json result: [] 2024-09-12T17:10:54.287 INFO:tasks.rgw:Configuring storage class type = LUKEWARM 2024-09-12T17:10:54.287 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM'] 2024-09-12T17:10:54.287 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM'] 2024-09-12T17:10:54.287 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup placement add --rgw-zone default --placement-id default-placement --storage-class LUKEWARM 2024-09-12T17:10:54.350 INFO:teuthology.orchestra.run.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:10:54.351 INFO:teuthology.orchestra.run.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:10:54.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:54.376+0000 7f438b735800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:10:54.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:54.376+0000 7f438b735800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:10:54.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:54.380+0000 7f4205ffb640 20 reqs_thread_entry: start 2024-09-12T17:10:54.397 INFO:teuthology.orchestra.run.smithi037.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["LUKEWARM","STANDARD"]}}] 2024-09-12T17:10:54.398 DEBUG:tasks.util.rgw: json result: [{'key': 'default-placement', 'val': {'name': 'default-placement', 'tags': [], 'storage_classes': ['LUKEWARM', 'STANDARD']}}] 2024-09-12T17:10:54.398 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM', '--data-pool', 'default.rgw.buckets.data.lukewarm'] 2024-09-12T17:10:54.398 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM', '--data-pool', 'default.rgw.buckets.data.lukewarm'] 2024-09-12T17:10:54.398 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement add --rgw-zone default --placement-id default-placement --storage-class LUKEWARM --data-pool default.rgw.buckets.data.lukewarm 2024-09-12T17:10:54.464 INFO:teuthology.orchestra.run.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:10:54.464 INFO:teuthology.orchestra.run.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:10:54.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:54.489+0000 7fe46400f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:10:54.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:54.489+0000 7fe46400f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:10:54.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:54.493+0000 7fe324fe1640 20 reqs_thread_entry: start 2024-09-12T17:10:54.511 INFO:teuthology.orchestra.run.smithi037.stdout:{"id":"722b129a-cf7a-4aca-b594-5b9492d130e2","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"LUKEWARM":{"data_pool":"default.rgw.buckets.data.lukewarm"},"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-09-12T17:10:54.511 DEBUG:tasks.util.rgw: json result: {'id': '722b129a-cf7a-4aca-b594-5b9492d130e2', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'LUKEWARM': {'data_pool': 'default.rgw.buckets.data.lukewarm'}, 'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-09-12T17:10:54.511 INFO:tasks.rgw:Configuring storage class type = FROZEN 2024-09-12T17:10:54.512 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN'] 2024-09-12T17:10:54.512 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN'] 2024-09-12T17:10:54.512 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup placement add --rgw-zone default --placement-id default-placement --storage-class FROZEN 2024-09-12T17:10:54.576 INFO:teuthology.orchestra.run.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:10:54.576 INFO:teuthology.orchestra.run.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:10:54.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:54.602+0000 7f3b4440e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:10:54.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:54.602+0000 7f3b4440e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:10:54.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:54.606+0000 7f39c5ffb640 20 reqs_thread_entry: start 2024-09-12T17:10:54.624 INFO:teuthology.orchestra.run.smithi037.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["FROZEN","LUKEWARM","STANDARD"]}}] 2024-09-12T17:10:54.624 DEBUG:tasks.util.rgw: json result: [{'key': 'default-placement', 'val': {'name': 'default-placement', 'tags': [], 'storage_classes': ['FROZEN', 'LUKEWARM', 'STANDARD']}}] 2024-09-12T17:10:54.625 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN', '--data-pool', 'default.rgw.buckets.data.frozen'] 2024-09-12T17:10:54.625 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN', '--data-pool', 'default.rgw.buckets.data.frozen'] 2024-09-12T17:10:54.625 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement add --rgw-zone default --placement-id default-placement --storage-class FROZEN --data-pool default.rgw.buckets.data.frozen 2024-09-12T17:10:54.691 INFO:teuthology.orchestra.run.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:10:54.691 INFO:teuthology.orchestra.run.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:10:54.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:54.717+0000 7f86bbd08800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:10:54.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:54.717+0000 7f86bbd08800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:10:54.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:10:54.721+0000 7f84f77fe640 20 reqs_thread_entry: start 2024-09-12T17:10:54.738 INFO:teuthology.orchestra.run.smithi037.stdout:{"id":"722b129a-cf7a-4aca-b594-5b9492d130e2","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"FROZEN":{"data_pool":"default.rgw.buckets.data.frozen"},"LUKEWARM":{"data_pool":"default.rgw.buckets.data.lukewarm"},"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-09-12T17:10:54.739 DEBUG:tasks.util.rgw: json result: {'id': '722b129a-cf7a-4aca-b594-5b9492d130e2', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'FROZEN': {'data_pool': 'default.rgw.buckets.data.frozen'}, 'LUKEWARM': {'data_pool': 'default.rgw.buckets.data.lukewarm'}, 'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-09-12T17:10:54.739 INFO:tasks.rgw:Starting rgw... 2024-09-12T17:10:54.739 INFO:tasks.rgw:rgw client.0 config is {'valgrind': ['--tool=memcheck', '--max-threads=1024']} 2024-09-12T17:10:54.739 INFO:tasks.rgw:Using beast as radosgw frontend 2024-09-12T17:10:54.739 DEBUG:teuthology.orchestra.run.smithi037:> sudo echo -n http://smithi037.front.sepia.ceph.com:80 | sudo tee /home/ubuntu/cephtest/url_file 2024-09-12T17:10:54.780 INFO:teuthology.orchestra.run.smithi037.stdout:http://smithi037.front.sepia.ceph.com:80 2024-09-12T17:10:54.780 DEBUG:teuthology.orchestra.run.smithi037:> sudo chown ceph /home/ubuntu/cephtest/url_file 2024-09-12T17:10:54.859 DEBUG:tasks.ceph_manager:running ceph.client.0 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/ceph.client.0.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck', '--max-threads=1024'] 2024-09-12T17:10:54.860 INFO:tasks.rgw.client.0:Restarting daemon 2024-09-12T17:10:54.860 DEBUG:teuthology.orchestra.run.smithi037:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/ceph.client.0.log --time-stamp=yes --vgdb=yes --tool=memcheck --max-threads=1024 radosgw --rgw-frontends 'beast port=80' -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.ceph.client.0.stdout 2>&1 2024-09-12T17:10:54.903 INFO:tasks.rgw.client.0:Started 2024-09-12T17:10:54.903 INFO:tasks.rgw:Polling client.0 until it starts accepting connections on http://smithi037.front.sepia.ceph.com:80/ 2024-09-12T17:10:54.903 DEBUG:teuthology.orchestra.run.smithi037:> curl http://smithi037.front.sepia.ceph.com:80/ 2024-09-12T17:10:54.943 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-12T17:10:54.944 INFO:teuthology.orchestra.run.smithi037.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-12T17:10:54.944 INFO:teuthology.orchestra.run.smithi037.stderr: Dload Upload Total Spent Left Speed 2024-09-12T17:10:54.944 INFO:teuthology.orchestra.run.smithi037.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-12T17:10:54.944 INFO:teuthology.orchestra.run.smithi037.stderr:curl: (7) Failed to connect to smithi037.front.sepia.ceph.com port 80: Connection refused 2024-09-12T17:10:55.945 DEBUG:teuthology.orchestra.run.smithi037:> curl http://smithi037.front.sepia.ceph.com:80/ 2024-09-12T17:10:55.979 INFO:teuthology.orchestra.run.smithi037.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-12T17:10:55.979 INFO:teuthology.orchestra.run.smithi037.stderr: Dload Upload Total Spent Left Speed 2024-09-12T17:10:55.979 INFO:teuthology.orchestra.run.smithi037.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-12T17:10:55.981 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-12T17:10:55.982 INFO:teuthology.orchestra.run.smithi037.stderr:curl: (7) Failed to connect to smithi037.front.sepia.ceph.com port 80: Connection refused 2024-09-12T17:10:57.984 DEBUG:teuthology.orchestra.run.smithi037:> curl http://smithi037.front.sepia.ceph.com:80/ 2024-09-12T17:10:58.018 INFO:teuthology.orchestra.run.smithi037.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-12T17:10:58.018 INFO:teuthology.orchestra.run.smithi037.stderr: Dload Upload Total Spent Left Speed 2024-09-12T17:10:58.020 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-12T17:10:58.020 INFO:teuthology.orchestra.run.smithi037.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-12T17:10:58.020 INFO:teuthology.orchestra.run.smithi037.stderr:curl: (7) Failed to connect to smithi037.front.sepia.ceph.com port 80: Connection refused 2024-09-12T17:11:02.021 DEBUG:teuthology.orchestra.run.smithi037:> curl http://smithi037.front.sepia.ceph.com:80/ 2024-09-12T17:11:02.056 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-12T17:11:02.057 INFO:teuthology.orchestra.run.smithi037.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-12T17:11:02.057 INFO:teuthology.orchestra.run.smithi037.stderr: Dload Upload Total Spent Left Speed 2024-09-12T17:11:02.057 INFO:teuthology.orchestra.run.smithi037.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-12T17:11:02.057 INFO:teuthology.orchestra.run.smithi037.stderr:curl: (7) Failed to connect to smithi037.front.sepia.ceph.com port 80: Connection refused 2024-09-12T17:11:10.058 DEBUG:teuthology.orchestra.run.smithi037:> curl http://smithi037.front.sepia.ceph.com:80/ 2024-09-12T17:11:10.093 INFO:teuthology.orchestra.run.smithi037.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-12T17:11:10.093 INFO:teuthology.orchestra.run.smithi037.stderr: Dload Upload Total Spent Left Speed 2024-09-12T17:11:10.095 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-12T17:11:10.095 INFO:teuthology.orchestra.run.smithi037.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-12T17:11:10.095 INFO:teuthology.orchestra.run.smithi037.stderr:curl: (7) Failed to connect to smithi037.front.sepia.ceph.com port 80: Connection refused 2024-09-12T17:11:26.096 DEBUG:teuthology.orchestra.run.smithi037:> curl http://smithi037.front.sepia.ceph.com:80/ 2024-09-12T17:11:26.140 INFO:teuthology.orchestra.run.smithi037.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-12T17:11:26.140 INFO:teuthology.orchestra.run.smithi037.stderr: Dload Upload Total Spent Left Speed 2024-09-12T17:11:26.465 INFO:teuthology.orchestra.run.smithi037.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 187 0 187 0 0 571 0 --:--:-- --:--:-- --:--:-- 571 2024-09-12T17:11:26.465 INFO:teuthology.orchestra.run.smithi037.stdout:anonymous 2024-09-12T17:11:26.466 INFO:teuthology.run_tasks:Running task tox... 2024-09-12T17:11:26.478 INFO:tasks.tox:Deploying tox from pip... 2024-09-12T17:11:26.479 DEBUG:teuthology.orchestra.run.smithi037:> python3 -m venv /home/ubuntu/cephtest/tox-venv 2024-09-12T17:11:28.859 DEBUG:teuthology.orchestra.run.smithi037:> source /home/ubuntu/cephtest/tox-venv/bin/activate && pip install tox==3.15.0 2024-09-12T17:11:29.389 INFO:teuthology.orchestra.run.smithi037.stdout:Collecting tox==3.15.0 2024-09-12T17:11:29.442 INFO:teuthology.orchestra.run.smithi037.stdout: Downloading tox-3.15.0-py2.py3-none-any.whl (82 kB) 2024-09-12T17:11:29.772 INFO:teuthology.orchestra.run.smithi037.stdout:Collecting virtualenv!=20.0.0,!=20.0.1,!=20.0.2,!=20.0.3,!=20.0.4,!=20.0.5,!=20.0.6,!=20.0.7,>=16.0.0 2024-09-12T17:11:29.788 INFO:teuthology.orchestra.run.smithi037.stdout: Downloading virtualenv-20.26.4-py3-none-any.whl (6.0 MB) 2024-09-12T17:11:30.023 INFO:teuthology.orchestra.run.smithi037.stdout:Collecting py<2,>=1.4.17 2024-09-12T17:11:30.037 INFO:teuthology.orchestra.run.smithi037.stdout: Downloading py-1.11.0-py2.py3-none-any.whl (98 kB) 2024-09-12T17:11:30.124 INFO:teuthology.orchestra.run.smithi037.stdout:Collecting pluggy<1,>=0.12.0 2024-09-12T17:11:30.138 INFO:teuthology.orchestra.run.smithi037.stdout: Downloading pluggy-0.13.1-py2.py3-none-any.whl (18 kB) 2024-09-12T17:11:30.213 INFO:teuthology.orchestra.run.smithi037.stdout:Collecting toml>=0.9.4 2024-09-12T17:11:30.227 INFO:teuthology.orchestra.run.smithi037.stdout: Downloading toml-0.10.2-py2.py3-none-any.whl (16 kB) 2024-09-12T17:11:30.341 INFO:teuthology.orchestra.run.smithi037.stdout:Collecting filelock<4,>=3.0.0 2024-09-12T17:11:30.355 INFO:teuthology.orchestra.run.smithi037.stdout: Downloading filelock-3.16.0-py3-none-any.whl (16 kB) 2024-09-12T17:11:30.439 INFO:teuthology.orchestra.run.smithi037.stdout:Collecting six<2,>=1.14.0 2024-09-12T17:11:30.453 INFO:teuthology.orchestra.run.smithi037.stdout: Downloading six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-12T17:11:30.562 INFO:teuthology.orchestra.run.smithi037.stdout:Collecting packaging>=14 2024-09-12T17:11:30.576 INFO:teuthology.orchestra.run.smithi037.stdout: Downloading packaging-24.1-py3-none-any.whl (53 kB) 2024-09-12T17:11:30.703 INFO:teuthology.orchestra.run.smithi037.stdout:Collecting distlib<1,>=0.3.7 2024-09-12T17:11:30.717 INFO:teuthology.orchestra.run.smithi037.stdout: Downloading distlib-0.3.8-py2.py3-none-any.whl (468 kB) 2024-09-12T17:11:30.826 INFO:teuthology.orchestra.run.smithi037.stdout:Collecting platformdirs<5,>=3.9.1 2024-09-12T17:11:30.840 INFO:teuthology.orchestra.run.smithi037.stdout: Downloading platformdirs-4.3.2-py3-none-any.whl (18 kB) 2024-09-12T17:11:30.975 INFO:teuthology.orchestra.run.smithi037.stdout:Installing collected packages: platformdirs, filelock, distlib, virtualenv, toml, six, py, pluggy, packaging, tox 2024-09-12T17:11:31.968 INFO:teuthology.orchestra.run.smithi037.stdout:Successfully installed distlib-0.3.8 filelock-3.16.0 packaging-24.1 platformdirs-4.3.2 pluggy-0.13.1 py-1.11.0 six-1.16.0 toml-0.10.2 tox-3.15.0 virtualenv-20.26.4 2024-09-12T17:11:32.300 INFO:teuthology.orchestra.run.smithi037.stderr:WARNING: You are using pip version 21.3.1; however, version 24.2 is available. 2024-09-12T17:11:32.300 INFO:teuthology.orchestra.run.smithi037.stderr:You should consider upgrading via the '/home/ubuntu/cephtest/tox-venv/bin/python3 -m pip install --upgrade pip' command. 2024-09-12T17:11:32.363 INFO:teuthology.run_tasks:Running task workunit... 2024-09-12T17:11:32.379 INFO:tasks.workunit:Pulling workunits from ref bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T17:11:32.379 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T17:11:32.380 DEBUG:teuthology.orchestra.run.smithi037:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T17:11:32.411 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T17:11:32.412 INFO:teuthology.orchestra.run.smithi037.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T17:11:32.412 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T17:11:32.482 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-12T17:11:32.482 DEBUG:teuthology.orchestra.run.smithi037:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-12T17:11:32.551 INFO:tasks.workunit:timeout=3h 2024-09-12T17:11:32.552 INFO:tasks.workunit:cleanup=True 2024-09-12T17:11:32.552 DEBUG:teuthology.orchestra.run.smithi037:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T17:11:32.623 INFO:tasks.workunit.client.0.smithi037.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T17:12:32.550 INFO:tasks.workunit.client.0.smithi037.stderr:Updating files: 92% (11778/12697) Updating files: 93% (11809/12697) Updating files: 94% (11936/12697) Updating files: 95% (12063/12697) Updating files: 96% (12190/12697) Updating files: 97% (12317/12697) Updating files: 98% (12444/12697) Updating files: 99% (12571/12697) Updating files: 100% (12697/12697) Updating files: 100% (12697/12697), done. 2024-09-12T17:12:33.308 INFO:tasks.workunit.client.0.smithi037.stderr:Note: switching to 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'. 2024-09-12T17:12:33.308 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:12:33.308 INFO:tasks.workunit.client.0.smithi037.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T17:12:33.308 INFO:tasks.workunit.client.0.smithi037.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T17:12:33.309 INFO:tasks.workunit.client.0.smithi037.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T17:12:33.309 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:12:33.309 INFO:tasks.workunit.client.0.smithi037.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T17:12:33.309 INFO:tasks.workunit.client.0.smithi037.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T17:12:33.309 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:12:33.309 INFO:tasks.workunit.client.0.smithi037.stderr: git switch -c 2024-09-12T17:12:33.309 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:12:33.309 INFO:tasks.workunit.client.0.smithi037.stderr:Or undo this operation with: 2024-09-12T17:12:33.309 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:12:33.309 INFO:tasks.workunit.client.0.smithi037.stderr: git switch - 2024-09-12T17:12:33.309 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:12:33.309 INFO:tasks.workunit.client.0.smithi037.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T17:12:33.309 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:12:33.309 INFO:tasks.workunit.client.0.smithi037.stderr:HEAD is now at bad475c18c9 rgw: clear output keys in RGWMetadataLister::get_next() 2024-09-12T17:12:33.313 DEBUG:teuthology.orchestra.run.smithi037:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T17:12:33.394 INFO:tasks.workunit.client.0.smithi037.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T17:12:33.396 INFO:tasks.workunit.client.0.smithi037.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T17:12:33.397 INFO:tasks.workunit.client.0.smithi037.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T17:12:34.073 INFO:tasks.workunit.client.0.smithi037.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T17:12:34.144 INFO:tasks.workunit.client.0.smithi037.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T17:12:34.186 INFO:tasks.workunit.client.0.smithi037.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T17:12:34.188 INFO:tasks.workunit.client.0.smithi037.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T17:12:34.188 INFO:tasks.workunit.client.0.smithi037.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T17:12:34.229 INFO:tasks.workunit.client.0.smithi037.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T17:12:34.233 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-09-12T17:12:34.233 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T17:12:34.303 INFO:tasks.workunit:Running workunits matching rgw/run-datacache.sh on client.0... 2024-09-12T17:12:34.304 INFO:tasks.workunit:Running workunit rgw/run-datacache.sh... 2024-09-12T17:12:34.304 DEBUG:teuthology.orchestra.run.smithi037:workunit test rgw/run-datacache.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 RGW_DATACACHE_PATH=/tmp/rgw_datacache adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-datacache.sh 2024-09-12T17:12:34.378 INFO:tasks.workunit.client.0.smithi037.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-datacache.sh 2024-09-12T17:12:34.379 INFO:tasks.workunit.client.0.smithi037.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T17:12:34.379 INFO:tasks.workunit.client.0.smithi037.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T17:12:36.773 INFO:tasks.workunit.client.0.smithi037.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-09-12T17:12:36.773 INFO:tasks.workunit.client.0.smithi037.stderr:++ deactivate nondestructive 2024-09-12T17:12:36.773 INFO:tasks.workunit.client.0.smithi037.stderr:++ '[' -n '' ']' 2024-09-12T17:12:36.773 INFO:tasks.workunit.client.0.smithi037.stderr:++ '[' -n '' ']' 2024-09-12T17:12:36.773 INFO:tasks.workunit.client.0.smithi037.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T17:12:36.774 INFO:tasks.workunit.client.0.smithi037.stderr:++ hash -r 2024-09-12T17:12:36.774 INFO:tasks.workunit.client.0.smithi037.stderr:++ '[' -n '' ']' 2024-09-12T17:12:36.774 INFO:tasks.workunit.client.0.smithi037.stderr:++ unset VIRTUAL_ENV 2024-09-12T17:12:36.774 INFO:tasks.workunit.client.0.smithi037.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-09-12T17:12:36.774 INFO:tasks.workunit.client.0.smithi037.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T17:12:36.774 INFO:tasks.workunit.client.0.smithi037.stderr:++ export VIRTUAL_ENV 2024-09-12T17:12:36.774 INFO:tasks.workunit.client.0.smithi037.stderr:++ _OLD_VIRTUAL_PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-12T17:12:36.774 INFO:tasks.workunit.client.0.smithi037.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-12T17:12:36.774 INFO:tasks.workunit.client.0.smithi037.stderr:++ export PATH 2024-09-12T17:12:36.775 INFO:tasks.workunit.client.0.smithi037.stderr:++ '[' -n '' ']' 2024-09-12T17:12:36.775 INFO:tasks.workunit.client.0.smithi037.stderr:++ '[' -z '' ']' 2024-09-12T17:12:36.775 INFO:tasks.workunit.client.0.smithi037.stderr:++ _OLD_VIRTUAL_PS1= 2024-09-12T17:12:36.775 INFO:tasks.workunit.client.0.smithi037.stderr:++ PS1='(rgw) ' 2024-09-12T17:12:36.775 INFO:tasks.workunit.client.0.smithi037.stderr:++ export PS1 2024-09-12T17:12:36.775 INFO:tasks.workunit.client.0.smithi037.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T17:12:36.775 INFO:tasks.workunit.client.0.smithi037.stderr:++ hash -r 2024-09-12T17:12:36.775 INFO:tasks.workunit.client.0.smithi037.stderr:+ pip install pip --upgrade 2024-09-12T17:12:37.013 INFO:tasks.workunit.client.0.smithi037.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.9/site-packages (21.3.1) 2024-09-12T17:12:37.202 INFO:tasks.workunit.client.0.smithi037.stdout:Collecting pip 2024-09-12T17:12:37.253 INFO:tasks.workunit.client.0.smithi037.stdout: Downloading pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-12T17:12:37.414 INFO:tasks.workunit.client.0.smithi037.stdout:Installing collected packages: pip 2024-09-12T17:12:37.414 INFO:tasks.workunit.client.0.smithi037.stdout: Attempting uninstall: pip 2024-09-12T17:12:37.414 INFO:tasks.workunit.client.0.smithi037.stdout: Found existing installation: pip 21.3.1 2024-09-12T17:12:37.578 INFO:tasks.workunit.client.0.smithi037.stdout: Uninstalling pip-21.3.1: 2024-09-12T17:12:37.584 INFO:tasks.workunit.client.0.smithi037.stdout: Successfully uninstalled pip-21.3.1 2024-09-12T17:12:38.349 INFO:tasks.workunit.client.0.smithi037.stdout:Successfully installed pip-24.2 2024-09-12T17:12:38.595 INFO:tasks.workunit.client.0.smithi037.stderr:+ pip install configobj 2024-09-12T17:12:38.995 INFO:tasks.workunit.client.0.smithi037.stdout:Collecting configobj 2024-09-12T17:12:39.037 INFO:tasks.workunit.client.0.smithi037.stdout: Downloading configobj-5.0.8-py2.py3-none-any.whl.metadata (3.4 kB) 2024-09-12T17:12:39.161 INFO:tasks.workunit.client.0.smithi037.stdout:Collecting six (from configobj) 2024-09-12T17:12:39.175 INFO:tasks.workunit.client.0.smithi037.stdout: Downloading six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-12T17:12:39.239 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading configobj-5.0.8-py2.py3-none-any.whl (36 kB) 2024-09-12T17:12:39.313 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-12T17:12:39.376 INFO:tasks.workunit.client.0.smithi037.stdout:Installing collected packages: six, configobj 2024-09-12T17:12:39.618 INFO:tasks.workunit.client.0.smithi037.stdout:Successfully installed configobj-5.0.8 six-1.16.0 2024-09-12T17:12:39.676 INFO:tasks.workunit.client.0.smithi037.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_datacache.py 2024-09-12T17:12:39.710 INFO:tasks.workunit.client.0.smithi037.stderr:DEBUG:root:datacache dir from config is: /tmp/rgw_datacache 2024-09-12T17:12:39.711 INFO:tasks.workunit.client.0.smithi037.stderr:DEBUG:root:exec_cmd(pwd) 2024-09-12T17:12:39.712 INFO:tasks.workunit.client.0.smithi037.stderr:INFO:root:command succeeded 2024-09-12T17:12:39.713 INFO:tasks.workunit.client.0.smithi037.stderr:INFO:root:b'/home/ubuntu/cephtest/mnt.0/client.0/tmp\n' 2024-09-12T17:12:39.713 INFO:tasks.workunit.client.0.smithi037.stderr:DEBUG:root:pwd is: /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:12:39.713 INFO:tasks.workunit.client.0.smithi037.stderr:DEBUG:root:exec_cmd(sudo netstat -nltp | egrep "rados|valgr") 2024-09-12T17:12:39.765 INFO:tasks.workunit.client.0.smithi037.stderr:INFO:root:command succeeded 2024-09-12T17:12:39.765 INFO:tasks.workunit.client.0.smithi037.stderr:INFO:root:b'tcp 0 0 0.0.0.0:80 0.0.0.0:* LISTEN 44559/valgrind \ntcp6 0 0 :::80 :::* LISTEN 44559/valgrind \n' 2024-09-12T17:12:39.766 INFO:tasks.workunit.client.0.smithi037.stderr:INFO:root:radosgw port: 80 2024-09-12T17:12:39.766 INFO:tasks.workunit.client.0.smithi037.stderr:INFO:root:radosgw endpoint is: 127.0.0.1 2024-09-12T17:12:39.766 INFO:tasks.workunit.client.0.smithi037.stderr:DEBUG:root:exec_cmd(dd if=/dev/urandom of=/home/ubuntu/cephtest/mnt.0/client.0/tmp/7M.dat bs=1M count=7) 2024-09-12T17:12:39.787 INFO:tasks.workunit.client.0.smithi037.stderr:INFO:root:command succeeded 2024-09-12T17:12:39.787 INFO:tasks.workunit.client.0.smithi037.stderr:INFO:root:b'' 2024-09-12T17:12:39.787 INFO:tasks.workunit.client.0.smithi037.stderr:DEBUG:root:exec_cmd(radosgw-admin user create --uid rgw_datacache_user --display-name DatacacheUser --access-key NX5QOQKC6BH2IDN8HC7A --secret LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn) 2024-09-12T17:12:40.161 INFO:tasks.workunit.client.0.smithi037.stderr:INFO:root:command succeeded 2024-09-12T17:12:40.161 INFO:tasks.workunit.client.0.smithi037.stderr:INFO:root:b'{\n "user_id": "rgw_datacache_user",\n "display_name": "DatacacheUser",\n "email": "",\n "suspended": 0,\n "max_buckets": 1000,\n "subusers": [],\n "keys": [\n {\n "user": "rgw_datacache_user",\n "access_key": "NX5QOQKC6BH2IDN8HC7A",\n "secret_key": "LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn",\n "active": true,\n "create_date": "2024-09-12T17:12:40.103432Z"\n }\n ],\n "swift_keys": [],\n "caps": [],\n "op_mask": "read, write, delete",\n "default_placement": "",\n "default_storage_class": "",\n "placement_tags": [],\n "bucket_quota": {\n "enabled": false,\n "check_on_raw": false,\n "max_size": -1,\n "max_size_kb": 0,\n "max_objects": -1\n },\n "user_quota": {\n "enabled": false,\n "check_on_raw": false,\n "max_size": -1,\n "max_size_kb": 0,\n "max_objects": -1\n },\n "temp_url_keys": [],\n "type": "rgw",\n "mfa_ids": [],\n "account_id": "",\n "path": "/",\n "create_date": "2024-09-12T17:12:40.103416Z",\n "tags": [],\n "group_ids": []\n}\n\n' 2024-09-12T17:12:40.161 INFO:tasks.workunit.client.0.smithi037.stderr:INFO:root:Creating s3cmd config... 2024-09-12T17:12:40.161 INFO:tasks.workunit.client.0.smithi037.stderr:INFO:root:proto for s3cmd config is http 2024-09-12T17:12:40.161 INFO:tasks.workunit.client.0.smithi037.stderr:INFO:root:s3cmd config written 2024-09-12T17:12:40.161 INFO:tasks.workunit.client.0.smithi037.stderr:DEBUG:root:exec_cmd(s3cmd --access_key=NX5QOQKC6BH2IDN8HC7A --secret_key=LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn --config=/home/ubuntu/cephtest/mnt.0/client.0/tmp/s3cfg --no-check-hostname --host=127.0.0.1 mb s3://datacachebucket) 2024-09-12T17:12:40.727 INFO:tasks.workunit.client.0.smithi037.stderr:INFO:root:command succeeded 2024-09-12T17:12:40.728 INFO:tasks.workunit.client.0.smithi037.stderr:INFO:root:b"Bucket 's3://datacachebucket/' created\n" 2024-09-12T17:12:40.728 INFO:tasks.workunit.client.0.smithi037.stderr:DEBUG:root:exec_cmd(s3cmd --access_key=NX5QOQKC6BH2IDN8HC7A --secret_key=LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn --config=/home/ubuntu/cephtest/mnt.0/client.0/tmp/s3cfg --no-check-hostname --host=127.0.0.1 put /home/ubuntu/cephtest/mnt.0/client.0/tmp/7M.dat s3://datacachebucket) 2024-09-12T17:12:42.371 INFO:tasks.workunit.client.0.smithi037.stderr:INFO:root:command succeeded 2024-09-12T17:12:42.371 INFO:tasks.workunit.client.0.smithi037.stderr:INFO:root:b"upload: '/home/ubuntu/cephtest/mnt.0/client.0/tmp/7M.dat' -> 's3://datacachebucket/7M.dat' (7340032 bytes in 1.4 seconds, 5.00 MB/s) [1 of 1]\n" 2024-09-12T17:12:42.371 INFO:tasks.workunit.client.0.smithi037.stderr:DEBUG:root:exec_cmd(s3cmd --access_key=NX5QOQKC6BH2IDN8HC7A --secret_key=LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn --config=/home/ubuntu/cephtest/mnt.0/client.0/tmp/s3cfg --no-check-hostname --host=127.0.0.1 get s3://datacachebucket/7M.dat /home/ubuntu/cephtest/mnt.0/client.0/tmp/7M-get.dat --force) 2024-09-12T17:12:42.916 INFO:tasks.workunit.client.0.smithi037.stderr:INFO:root:command succeeded 2024-09-12T17:12:42.916 INFO:tasks.workunit.client.0.smithi037.stderr:INFO:root:b"download: 's3://datacachebucket/7M.dat' -> '/home/ubuntu/cephtest/mnt.0/client.0/tmp/7M-get.dat' (7340032 bytes in 0.3 seconds, 23.87 MB/s)\n" 2024-09-12T17:12:42.916 INFO:tasks.workunit.client.0.smithi037.stderr:DEBUG:root:exec_cmd(radosgw-admin object stat --bucket=datacachebucket --object=7M.dat) 2024-09-12T17:12:43.253 INFO:tasks.workunit.client.0.smithi037.stderr:INFO:root:command succeeded 2024-09-12T17:12:43.253 INFO:tasks.workunit.client.0.smithi037.stderr:INFO:root:b'{\n "name": "7M.dat",\n "size": 7368844,\n "policy": {\n "acl": {\n "acl_user_map": [\n {\n "user": "rgw_datacache_user",\n "acl": 15\n }\n ],\n "acl_group_map": [],\n "grant_map": [\n {\n "id": "rgw_datacache_user",\n "grant": {\n "type": {\n "type": 0\n },\n "id": "rgw_datacache_user",\n "name": "DatacacheUser",\n "permission": {\n "flags": 15\n }\n }\n }\n ]\n },\n "owner": {\n "id": "rgw_datacache_user",\n "display_name": "DatacacheUser"\n }\n },\n "compression": {\n "compression_type": "lz4",\n "orig_size": 7340032,\n "blocks": [\n {\n "old_ofs": 0,\n "new_ofs": 0,\n "len": 4210766\n },\n {\n "old_ofs": 4194304,\n "new_ofs": 4210766,\n "len": 3158078\n }\n ]\n },\n "etag": "2b6c5f2269e060175a22823d38fdc32d",\n "tag": "722b129a-cf7a-4aca-b594-5b9492d130e2.4623.1804844219964646086",\n "manifest": {\n "objs": [],\n "obj_size": 7368844,\n "explicit_objs": false,\n "head_size": 4190208,\n "max_head_size": 4190208,\n "prefix": ".Q730kC_yEVlaLb2MZLTyGwArvLh-G0Z_",\n "rules": [\n {\n "key": 0,\n "val": {\n "start_part_num": 0,\n "start_ofs": 4190208,\n "part_size": 0,\n "stripe_max_size": 6291456,\n "override_prefix": ""\n }\n }\n ],\n "tail_instance": "",\n "tail_placement": {\n "bucket": {\n "name": "datacachebucket",\n "marker": "722b129a-cf7a-4aca-b594-5b9492d130e2.4623.1",\n "bucket_id": "722b129a-cf7a-4aca-b594-5b9492d130e2.4623.1",\n "tenant": "",\n "explicit_placement": {\n "data_pool": "",\n "data_extra_pool": "",\n "index_pool": ""\n }\n },\n "placement_rule": "default-placement"\n },\n "tier_type": "",\n "begin_iter": {\n "part_ofs": 0,\n "stripe_ofs": 0,\n "ofs": 0,\n "stripe_size": 4190208,\n "cur_part_id": 0,\n "cur_stripe": 0,\n "cur_override_prefix": "",\n "location": {\n "placement_rule": "default-placement",\n "obj": {\n "bucket": {\n "name": "datacachebucket",\n "marker": "722b129a-cf7a-4aca-b594-5b9492d130e2.4623.1",\n "bucket_id": "722b129a-cf7a-4aca-b594-5b9492d130e2.4623.1",\n "tenant": "",\n "explicit_placement": {\n "data_pool": "",\n "data_extra_pool": "",\n "index_pool": ""\n }\n },\n "key": {\n "name": "7M.dat",\n "instance": "",\n "ns": ""\n }\n },\n "raw_obj": {\n "pool": "",\n "oid": "",\n "loc": ""\n },\n "is_raw": false\n }\n },\n "end_iter": {\n "part_ofs": 4190208,\n "stripe_ofs": 4190208,\n "ofs": 7368844,\n "stripe_size": 3178636,\n "cur_part_id": 0,\n "cur_stripe": 1,\n "cur_override_prefix": "",\n "location": {\n "placement_rule": "default-placement",\n "obj": {\n "bucket": {\n "name": "datacachebucket",\n "marker": "722b129a-cf7a-4aca-b594-5b9492d130e2.4623.1",\n "bucket_id": "722b129a-cf7a-4aca-b594-5b9492d130e2.4623.1",\n "tenant": "",\n "explicit_placement": {\n "data_pool": "",\n "data_extra_pool": "",\n "index_pool": ""\n }\n },\n "key": {\n "name": ".Q730kC_yEVlaLb2MZLTyGwArvLh-G0Z_1",\n "instance": "",\n "ns": "shadow"\n }\n },\n "raw_obj": {\n "pool": "",\n "oid": "",\n "loc": ""\n },\n "is_raw": false\n }\n }\n },\n "pg_ver": 0,\n "source_zone": 0,\n "torrent": "",\n "mtime": "2024-09-12T17:12:42.196206Z",\n "attrs": {\n "user.rgw.content_type": "application/octet-stream",\n "user.rgw.storage_class": "STANDARD",\n "user.rgw.tail_tag": "722b129a-cf7a-4aca-b594-5b9492d130e2.4623.1804844219964646086",\n "user.rgw.x-amz-meta-s3cmd-attrs": "atime:1726161159/ctime:1726161159/gid:1333/gname:ubuntu/md5:2b6c5f2269e060175a22823d38fdc32d/mode:33188/mtime:1726161159/uid:1000/uname:ubuntu"\n }\n}\n' 2024-09-12T17:12:43.253 INFO:tasks.workunit.client.0.smithi037.stderr:DEBUG:root:Cached object name is: .Q730kC_yEVlaLb2MZLTyGwArvLh-G0Z_ 2024-09-12T17:12:43.253 INFO:tasks.workunit.client.0.smithi037.stderr:DEBUG:root:exec_cmd(find /tmp/rgw_datacache -type f | wc -l) 2024-09-12T17:12:43.256 INFO:tasks.workunit.client.0.smithi037.stderr:INFO:root:command succeeded 2024-09-12T17:12:43.257 INFO:tasks.workunit.client.0.smithi037.stderr:INFO:root:b'0\n' 2024-09-12T17:12:43.257 INFO:tasks.workunit.client.0.smithi037.stderr:DEBUG:root:Check cache dir content: 0 2024-09-12T17:12:43.257 INFO:tasks.workunit.client.0.smithi037.stderr:INFO:root:NOTICE: datacache test object not found, inspect if datacache was bypassed or disabled during this check. 2024-09-12T17:12:43.257 INFO:tasks.workunit.client.0.smithi037.stderr:INFO:root:Completed Datacache tests 2024-09-12T17:12:43.262 INFO:tasks.workunit.client.0.smithi037.stderr:+ deactivate 2024-09-12T17:12:43.263 INFO:tasks.workunit.client.0.smithi037.stderr:+ '[' -n /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin ']' 2024-09-12T17:12:43.263 INFO:tasks.workunit.client.0.smithi037.stderr:+ PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-12T17:12:43.263 INFO:tasks.workunit.client.0.smithi037.stderr:+ export PATH 2024-09-12T17:12:43.263 INFO:tasks.workunit.client.0.smithi037.stderr:+ unset _OLD_VIRTUAL_PATH 2024-09-12T17:12:43.263 INFO:tasks.workunit.client.0.smithi037.stderr:+ '[' -n '' ']' 2024-09-12T17:12:43.263 INFO:tasks.workunit.client.0.smithi037.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T17:12:43.264 INFO:tasks.workunit.client.0.smithi037.stderr:+ hash -r 2024-09-12T17:12:43.264 INFO:tasks.workunit.client.0.smithi037.stderr:+ '[' -n '' ']' 2024-09-12T17:12:43.264 INFO:tasks.workunit.client.0.smithi037.stderr:+ unset VIRTUAL_ENV 2024-09-12T17:12:43.264 INFO:tasks.workunit.client.0.smithi037.stderr:+ '[' '!' '' = nondestructive ']' 2024-09-12T17:12:43.265 INFO:tasks.workunit.client.0.smithi037.stderr:+ unset -f deactivate 2024-09-12T17:12:43.265 INFO:tasks.workunit.client.0.smithi037.stderr:+ echo OK. 2024-09-12T17:12:43.266 INFO:tasks.workunit.client.0.smithi037.stdout:OK. 2024-09-12T17:12:43.266 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:12:43.267 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:12:43.350 INFO:tasks.workunit:Stopping ['rgw/run-datacache.sh'] on client.0... 2024-09-12T17:12:43.350 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T17:12:43.678 DEBUG:teuthology.parallel:result is None 2024-09-12T17:12:43.678 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T17:12:43.719 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T17:12:43.719 DEBUG:teuthology.orchestra.run.smithi037:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T17:12:43.798 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T17:12:43.798 INFO:teuthology.run_tasks:Running task workunit... 2024-09-12T17:12:43.809 INFO:tasks.workunit:Pulling workunits from ref bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T17:12:43.809 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T17:12:43.810 DEBUG:teuthology.orchestra.run.smithi037:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T17:12:43.867 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T17:12:43.868 INFO:teuthology.orchestra.run.smithi037.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T17:12:43.868 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T17:12:43.938 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-12T17:12:43.938 DEBUG:teuthology.orchestra.run.smithi037:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-12T17:12:44.009 INFO:tasks.workunit:timeout=3h 2024-09-12T17:12:44.009 INFO:tasks.workunit:cleanup=True 2024-09-12T17:12:44.009 DEBUG:teuthology.orchestra.run.smithi037:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T17:12:44.079 INFO:tasks.workunit.client.0.smithi037.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T17:13:44.689 INFO:tasks.workunit.client.0.smithi037.stderr:Updating files: 92% (11713/12697) Updating files: 93% (11809/12697) Updating files: 94% (11936/12697) Updating files: 95% (12063/12697) Updating files: 96% (12190/12697) Updating files: 97% (12317/12697) Updating files: 98% (12444/12697) Updating files: 99% (12571/12697) Updating files: 100% (12697/12697) Updating files: 100% (12697/12697), done. 2024-09-12T17:13:45.510 INFO:tasks.workunit.client.0.smithi037.stderr:Note: switching to 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'. 2024-09-12T17:13:45.510 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:13:45.510 INFO:tasks.workunit.client.0.smithi037.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T17:13:45.510 INFO:tasks.workunit.client.0.smithi037.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T17:13:45.510 INFO:tasks.workunit.client.0.smithi037.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T17:13:45.510 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:13:45.510 INFO:tasks.workunit.client.0.smithi037.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T17:13:45.511 INFO:tasks.workunit.client.0.smithi037.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T17:13:45.511 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:13:45.511 INFO:tasks.workunit.client.0.smithi037.stderr: git switch -c 2024-09-12T17:13:45.511 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:13:45.511 INFO:tasks.workunit.client.0.smithi037.stderr:Or undo this operation with: 2024-09-12T17:13:45.511 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:13:45.511 INFO:tasks.workunit.client.0.smithi037.stderr: git switch - 2024-09-12T17:13:45.511 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:13:45.511 INFO:tasks.workunit.client.0.smithi037.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T17:13:45.511 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:13:45.511 INFO:tasks.workunit.client.0.smithi037.stderr:HEAD is now at bad475c18c9 rgw: clear output keys in RGWMetadataLister::get_next() 2024-09-12T17:13:45.516 DEBUG:teuthology.orchestra.run.smithi037:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T17:13:45.586 INFO:tasks.workunit.client.0.smithi037.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T17:13:45.588 INFO:tasks.workunit.client.0.smithi037.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T17:13:45.588 INFO:tasks.workunit.client.0.smithi037.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T17:13:45.638 INFO:tasks.workunit.client.0.smithi037.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T17:13:45.689 INFO:tasks.workunit.client.0.smithi037.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T17:13:45.730 INFO:tasks.workunit.client.0.smithi037.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T17:13:45.731 INFO:tasks.workunit.client.0.smithi037.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T17:13:45.731 INFO:tasks.workunit.client.0.smithi037.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T17:13:45.772 INFO:tasks.workunit.client.0.smithi037.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T17:13:45.775 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-09-12T17:13:45.775 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T17:13:45.845 INFO:tasks.workunit:Running workunits matching rgw/run-bucket-check.sh on client.0... 2024-09-12T17:13:45.847 INFO:tasks.workunit:Running workunit rgw/run-bucket-check.sh... 2024-09-12T17:13:45.847 DEBUG:teuthology.orchestra.run.smithi037:workunit test rgw/run-bucket-check.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-bucket-check.sh 2024-09-12T17:13:45.920 INFO:tasks.workunit.client.0.smithi037.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-bucket-check.sh 2024-09-12T17:13:45.921 INFO:tasks.workunit.client.0.smithi037.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T17:13:45.921 INFO:tasks.workunit.client.0.smithi037.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T17:13:48.281 INFO:tasks.workunit.client.0.smithi037.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-09-12T17:13:48.281 INFO:tasks.workunit.client.0.smithi037.stderr:++ deactivate nondestructive 2024-09-12T17:13:48.281 INFO:tasks.workunit.client.0.smithi037.stderr:++ '[' -n '' ']' 2024-09-12T17:13:48.281 INFO:tasks.workunit.client.0.smithi037.stderr:++ '[' -n '' ']' 2024-09-12T17:13:48.281 INFO:tasks.workunit.client.0.smithi037.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T17:13:48.281 INFO:tasks.workunit.client.0.smithi037.stderr:++ hash -r 2024-09-12T17:13:48.282 INFO:tasks.workunit.client.0.smithi037.stderr:++ '[' -n '' ']' 2024-09-12T17:13:48.282 INFO:tasks.workunit.client.0.smithi037.stderr:++ unset VIRTUAL_ENV 2024-09-12T17:13:48.282 INFO:tasks.workunit.client.0.smithi037.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-09-12T17:13:48.282 INFO:tasks.workunit.client.0.smithi037.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T17:13:48.282 INFO:tasks.workunit.client.0.smithi037.stderr:++ export VIRTUAL_ENV 2024-09-12T17:13:48.282 INFO:tasks.workunit.client.0.smithi037.stderr:++ _OLD_VIRTUAL_PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-12T17:13:48.283 INFO:tasks.workunit.client.0.smithi037.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-12T17:13:48.283 INFO:tasks.workunit.client.0.smithi037.stderr:++ export PATH 2024-09-12T17:13:48.283 INFO:tasks.workunit.client.0.smithi037.stderr:++ '[' -n '' ']' 2024-09-12T17:13:48.283 INFO:tasks.workunit.client.0.smithi037.stderr:++ '[' -z '' ']' 2024-09-12T17:13:48.283 INFO:tasks.workunit.client.0.smithi037.stderr:++ _OLD_VIRTUAL_PS1= 2024-09-12T17:13:48.283 INFO:tasks.workunit.client.0.smithi037.stderr:++ PS1='(rgw) ' 2024-09-12T17:13:48.283 INFO:tasks.workunit.client.0.smithi037.stderr:++ export PS1 2024-09-12T17:13:48.283 INFO:tasks.workunit.client.0.smithi037.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T17:13:48.284 INFO:tasks.workunit.client.0.smithi037.stderr:++ hash -r 2024-09-12T17:13:48.284 INFO:tasks.workunit.client.0.smithi037.stderr:+ pip install pip --upgrade 2024-09-12T17:13:48.522 INFO:tasks.workunit.client.0.smithi037.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.9/site-packages (21.3.1) 2024-09-12T17:13:48.704 INFO:tasks.workunit.client.0.smithi037.stdout:Collecting pip 2024-09-12T17:13:48.710 INFO:tasks.workunit.client.0.smithi037.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-12T17:13:48.757 INFO:tasks.workunit.client.0.smithi037.stdout:Installing collected packages: pip 2024-09-12T17:13:48.757 INFO:tasks.workunit.client.0.smithi037.stdout: Attempting uninstall: pip 2024-09-12T17:13:48.757 INFO:tasks.workunit.client.0.smithi037.stdout: Found existing installation: pip 21.3.1 2024-09-12T17:13:48.924 INFO:tasks.workunit.client.0.smithi037.stdout: Uninstalling pip-21.3.1: 2024-09-12T17:13:48.930 INFO:tasks.workunit.client.0.smithi037.stdout: Successfully uninstalled pip-21.3.1 2024-09-12T17:13:49.700 INFO:tasks.workunit.client.0.smithi037.stdout:Successfully installed pip-24.2 2024-09-12T17:13:49.748 INFO:tasks.workunit.client.0.smithi037.stderr:+ pip install boto3 2024-09-12T17:13:50.637 INFO:tasks.workunit.client.0.smithi037.stdout:Collecting boto3 2024-09-12T17:13:50.679 INFO:tasks.workunit.client.0.smithi037.stdout: Downloading boto3-1.35.17-py3-none-any.whl.metadata (6.6 kB) 2024-09-12T17:13:51.373 INFO:tasks.workunit.client.0.smithi037.stdout:Collecting botocore<1.36.0,>=1.35.17 (from boto3) 2024-09-12T17:13:51.389 INFO:tasks.workunit.client.0.smithi037.stdout: Downloading botocore-1.35.17-py3-none-any.whl.metadata (5.7 kB) 2024-09-12T17:13:51.494 INFO:tasks.workunit.client.0.smithi037.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-12T17:13:51.508 INFO:tasks.workunit.client.0.smithi037.stdout: Downloading jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-12T17:13:51.643 INFO:tasks.workunit.client.0.smithi037.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-12T17:13:51.657 INFO:tasks.workunit.client.0.smithi037.stdout: Downloading s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-12T17:13:51.786 INFO:tasks.workunit.client.0.smithi037.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T17:13:51.799 INFO:tasks.workunit.client.0.smithi037.stdout: Downloading python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-12T17:13:51.958 INFO:tasks.workunit.client.0.smithi037.stdout:Collecting urllib3<1.27,>=1.25.4 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T17:13:51.973 INFO:tasks.workunit.client.0.smithi037.stdout: Downloading urllib3-1.26.20-py2.py3-none-any.whl.metadata (50 kB) 2024-09-12T17:13:52.284 INFO:tasks.workunit.client.0.smithi037.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T17:13:52.286 INFO:tasks.workunit.client.0.smithi037.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-12T17:13:52.304 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading boto3-1.35.17-py3-none-any.whl (139 kB) 2024-09-12T17:13:52.388 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading botocore-1.35.17-py3-none-any.whl (12.5 MB) 2024-09-12T17:13:52.615 INFO:tasks.workunit.client.0.smithi037.stdout: ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 12.5/12.5 MB 57.6 MB/s eta 0:00:00 2024-09-12T17:13:52.629 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-12T17:13:52.692 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-12T17:13:52.759 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-12T17:13:52.827 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading urllib3-1.26.20-py2.py3-none-any.whl (144 kB) 2024-09-12T17:13:52.882 INFO:tasks.workunit.client.0.smithi037.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-12T17:13:52.959 INFO:tasks.workunit.client.0.smithi037.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-12T17:13:54.035 INFO:tasks.workunit.client.0.smithi037.stdout:Successfully installed boto3-1.35.17 botocore-1.35.17 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-1.26.20 2024-09-12T17:13:54.153 INFO:tasks.workunit.client.0.smithi037.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_bucket_check.py 2024-09-12T17:13:54.290 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin user create --uid check-tester --display-name "Check Testing" --access-key OJODXSLNX4LUNHQG99PA --secret 3l6ffld34qaymfomuh832j94738aie2x4p2o8h6n 2024-09-12T17:13:54.326 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:13:54.326 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:13:54.367 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:54.366+0000 7f6eb5d23800 20 rados->read ofs=0 len=0 2024-09-12T17:13:54.369 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:54.368+0000 7f6eb5d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:54.369 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:54.368+0000 7f6eb5d23800 20 realm 2024-09-12T17:13:54.369 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:54.368+0000 7f6eb5d23800 20 rados->read ofs=0 len=0 2024-09-12T17:13:54.369 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:54.368+0000 7f6eb5d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:54.370 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:54.368+0000 7f6eb5d23800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:13:54.370 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:54.368+0000 7f6eb5d23800 20 rados->read ofs=0 len=0 2024-09-12T17:13:54.370 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:54.368+0000 7f6eb5d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:54.370 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:54.368+0000 7f6eb5d23800 20 rados->read ofs=0 len=0 2024-09-12T17:13:54.370 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:54.369+0000 7f6eb5d23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:13:54.370 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:54.369+0000 7f6eb5d23800 20 rados->read ofs=0 len=0 2024-09-12T17:13:54.371 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:54.370+0000 7f6eb5d23800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:13:54.371 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:54.370+0000 7f6eb5d23800 20 searching for the correct realm 2024-09-12T17:13:54.374 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:54.373+0000 7f6eb1212640 0 -- 172.21.15.37:0/1135135944 >> [v2:172.21.15.37:6816/2964054205,v1:172.21.15.37:6817/2964054205] conn(0x55ffb8e92c90 msgr2=0x55ffb8e95150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:13:54.378 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:54.377+0000 7f6eb1a13640 0 -- 172.21.15.37:0/1135135944 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7f6ea8068a70 msgr2=0x7f6ea80a10b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:13:54.383 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:54.382+0000 7f6eb5d23800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:13:54.383 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:54.382+0000 7f6eb5d23800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:13:54.383 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:54.382+0000 7f6eb5d23800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:13:54.384 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:54.382+0000 7f6eb5d23800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:13:54.384 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:54.382+0000 7f6eb5d23800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:13:54.384 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:54.382+0000 7f6eb5d23800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:13:54.384 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:54.382+0000 7f6eb5d23800 20 rados->read ofs=0 len=0 2024-09-12T17:13:54.384 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:54.382+0000 7f6eb5d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:54.384 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:54.382+0000 7f6eb5d23800 20 rados->read ofs=0 len=0 2024-09-12T17:13:54.385 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:54.383+0000 7f6eb5d23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:13:54.385 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:54.383+0000 7f6eb5d23800 20 rados->read ofs=0 len=0 2024-09-12T17:13:54.386 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:54.383+0000 7f6eb5d23800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:13:54.386 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:54.383+0000 7f6eb5d23800 20 zone default found 2024-09-12T17:13:54.386 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:54.383+0000 7f6eb5d23800 4 Realm: () 2024-09-12T17:13:54.386 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:54.383+0000 7f6eb5d23800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:13:54.386 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:54.383+0000 7f6eb5d23800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:13:54.386 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:54.383+0000 7f6eb5d23800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:13:54.386 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:54.383+0000 7f6eb5d23800 20 zonegroup default 2024-09-12T17:13:54.386 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:54.383+0000 7f6eb5d23800 20 rados->read ofs=0 len=0 2024-09-12T17:13:54.386 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:54.383+0000 7f6eb5d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:54.387 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:54.384+0000 7f6eb5d23800 20 rados->read ofs=0 len=0 2024-09-12T17:13:54.387 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:54.384+0000 7f6eb5d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:54.387 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:54.384+0000 7f6eb5d23800 20 rados->read ofs=0 len=0 2024-09-12T17:13:54.387 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:54.384+0000 7f6eb5d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:54.387 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:54.384+0000 7f6eb5d23800 20 started sync module instance, tier type = 2024-09-12T17:13:54.387 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:54.384+0000 7f6eb5d23800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:13:54.400 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:54.399+0000 7f6eb5d23800 20 add_watcher() i=0 2024-09-12T17:13:54.400 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:54.399+0000 7f6eb5d23800 20 add_watcher() i=1 2024-09-12T17:13:54.400 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:54.399+0000 7f6eb5d23800 20 add_watcher() i=2 2024-09-12T17:13:54.400 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:54.399+0000 7f6eb5d23800 20 add_watcher() i=3 2024-09-12T17:13:54.400 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:54.399+0000 7f6eb5d23800 20 add_watcher() i=4 2024-09-12T17:13:54.400 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:54.399+0000 7f6eb5d23800 20 add_watcher() i=5 2024-09-12T17:13:54.401 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:54.399+0000 7f6eb5d23800 20 add_watcher() i=6 2024-09-12T17:13:54.401 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:54.400+0000 7f6eb5d23800 20 add_watcher() i=7 2024-09-12T17:13:54.401 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:54.400+0000 7f6eb5d23800 2 all 8 watchers are set, enabling cache 2024-09-12T17:13:54.403 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:54.402+0000 7f6d637fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:13:54.403 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:54.402+0000 7f6eb5d23800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:13:54.404 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:54.402+0000 7f6eb5d23800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:13:54.404 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:54.402+0000 7f6eb5d23800 5 note: GC not initialized 2024-09-12T17:13:54.404 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:54.402+0000 7f6d627fc640 20 reqs_thread_entry: start 2024-09-12T17:13:54.404 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:54.402+0000 7f6eb5d23800 20 init_complete bucket index max shards: 11 2024-09-12T17:13:54.404 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:54.402+0000 7f6eb5d23800 20 Filter name: none 2024-09-12T17:13:54.404 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:54.402+0000 7f6cd3fff640 20 reqs_thread_entry: start 2024-09-12T17:13:54.404 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:54.403+0000 7f6eb5d23800 10 cache get: name=default.rgw.meta+users.uid+check-tester : miss 2024-09-12T17:13:54.404 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:54.403+0000 7f6eb5d23800 20 rados->read ofs=0 len=0 2024-09-12T17:13:54.405 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:54.403+0000 7f6eb5d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:54.405 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:54.403+0000 7f6eb5d23800 10 cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x0 2024-09-12T17:13:54.405 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:54.403+0000 7f6eb5d23800 10 adding default.rgw.meta+users.uid+check-tester to cache LRU end 2024-09-12T17:13:54.405 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:54.403+0000 7f6eb5d23800 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : miss 2024-09-12T17:13:54.405 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:54.403+0000 7f6eb5d23800 20 rados->read ofs=0 len=0 2024-09-12T17:13:54.405 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:54.403+0000 7f6eb5d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:54.405 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:54.403+0000 7f6eb5d23800 10 cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x0 2024-09-12T17:13:54.405 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:54.403+0000 7f6eb5d23800 10 adding default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-09-12T17:13:54.406 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:54.403+0000 7f6eb5d23800 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : hit (negative entry) 2024-09-12T17:13:54.406 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:54.403+0000 7f6eb5d23800 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : hit (negative entry) 2024-09-12T17:13:54.406 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:54.405+0000 7f6eb5d23800 10 cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x17 2024-09-12T17:13:54.406 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:54.405+0000 7f6eb5d23800 10 moving default.rgw.meta+users.uid+check-tester to cache LRU end 2024-09-12T17:13:54.406 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:54.405+0000 7f6eb5d23800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:check-tester, ofs0, ns] 2024-09-12T17:13:54.406 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:54.405+0000 7f6d957fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 163208757249 cookie 94556807326064 notifier 4680 bl.length()=593 2024-09-12T17:13:54.407 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:54.405+0000 7f6d957fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x17 2024-09-12T17:13:54.407 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:54.405+0000 7f6d957fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+check-tester to cache LRU end 2024-09-12T17:13:54.410 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:54.409+0000 7f6eb5d23800 10 cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x7 2024-09-12T17:13:54.410 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:54.409+0000 7f6eb5d23800 10 moving default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-09-12T17:13:54.410 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:54.409+0000 7f6eb5d23800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.keys:OJODXSLNX4LUNHQG99PA, ofs0, ns] 2024-09-12T17:13:54.411 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:54.410+0000 7f6d957fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 163208757248 cookie 94556807317456 notifier 4680 bl.length()=186 2024-09-12T17:13:54.411 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:54.410+0000 7f6d957fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x7 2024-09-12T17:13:54.411 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:54.410+0000 7f6d957fa640 10 rgw watcher librados: moving default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-09-12T17:13:54.414 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:54.413+0000 7f6d637fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:13:54.417 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:54.416+0000 7f6eb5d23800 20 remove_watcher() i=0 2024-09-12T17:13:54.417 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:54.416+0000 7f6eb5d23800 2 removed watcher, disabling cache 2024-09-12T17:13:54.418 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:54.417+0000 7f6eb5d23800 20 remove_watcher() i=1 2024-09-12T17:13:54.419 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:54.418+0000 7f6eb5d23800 20 remove_watcher() i=2 2024-09-12T17:13:54.421 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:54.420+0000 7f6eb5d23800 20 remove_watcher() i=3 2024-09-12T17:13:54.422 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:54.421+0000 7f6eb5d23800 20 remove_watcher() i=4 2024-09-12T17:13:54.423 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:54.422+0000 7f6eb5d23800 20 remove_watcher() i=5 2024-09-12T17:13:54.424 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:54.423+0000 7f6eb5d23800 20 remove_watcher() i=6 2024-09-12T17:13:54.425 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:54.425+0000 7f6eb5d23800 20 remove_watcher() i=7 2024-09-12T17:13:55.368 INFO:tasks.workunit.client.0.smithi037.stderr:TEST: recalculated bucket check stats are correct 2024-09-12T17:13:55.369 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:13:55.370 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bucket check --fix --bucket check-bucket 2024-09-12T17:13:55.400 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:13:55.401 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:13:55.440 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.438+0000 7f2a2df2a800 20 rados->read ofs=0 len=0 2024-09-12T17:13:55.442 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.439+0000 7f2a2df2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:55.442 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.439+0000 7f2a2df2a800 20 realm 2024-09-12T17:13:55.442 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.439+0000 7f2a2df2a800 20 rados->read ofs=0 len=0 2024-09-12T17:13:55.442 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.440+0000 7f2a2df2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:55.442 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.440+0000 7f2a2df2a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:13:55.442 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.440+0000 7f2a2df2a800 20 rados->read ofs=0 len=0 2024-09-12T17:13:55.442 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.440+0000 7f2a2df2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:55.442 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.440+0000 7f2a2df2a800 20 rados->read ofs=0 len=0 2024-09-12T17:13:55.443 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.441+0000 7f2a2df2a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:13:55.443 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.441+0000 7f2a2df2a800 20 rados->read ofs=0 len=0 2024-09-12T17:13:55.443 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.441+0000 7f2a2df2a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:13:55.443 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.441+0000 7f2a2df2a800 20 searching for the correct realm 2024-09-12T17:13:55.447 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.445+0000 7f2a294d9640 0 -- 172.21.15.37:0/1915384163 >> [v2:172.21.15.37:6816/2964054205,v1:172.21.15.37:6817/2964054205] conn(0x55ca517ba220 msgr2=0x55ca517bc6e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:13:55.450 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.449+0000 7f2a29cda640 0 -- 172.21.15.37:0/1915384163 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7f2a20064940 msgr2=0x7f2a200963b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:13:55.455 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.453+0000 7f2a2df2a800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:13:55.455 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.453+0000 7f2a2df2a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:13:55.455 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.453+0000 7f2a2df2a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:13:55.455 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.453+0000 7f2a2df2a800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:13:55.455 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.453+0000 7f2a2df2a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:13:55.456 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.453+0000 7f2a2df2a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:13:55.456 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.453+0000 7f2a2df2a800 20 rados->read ofs=0 len=0 2024-09-12T17:13:55.458 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.453+0000 7f2a2df2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:55.458 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.453+0000 7f2a2df2a800 20 rados->read ofs=0 len=0 2024-09-12T17:13:55.458 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.454+0000 7f2a2df2a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:13:55.458 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.454+0000 7f2a2df2a800 20 rados->read ofs=0 len=0 2024-09-12T17:13:55.458 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.454+0000 7f2a2df2a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:13:55.458 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.454+0000 7f2a2df2a800 20 zone default found 2024-09-12T17:13:55.458 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.454+0000 7f2a2df2a800 4 Realm: () 2024-09-12T17:13:55.458 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.454+0000 7f2a2df2a800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:13:55.458 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.454+0000 7f2a2df2a800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:13:55.458 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.454+0000 7f2a2df2a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:13:55.458 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.454+0000 7f2a2df2a800 20 zonegroup default 2024-09-12T17:13:55.458 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.454+0000 7f2a2df2a800 20 rados->read ofs=0 len=0 2024-09-12T17:13:55.459 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.454+0000 7f2a2df2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:55.459 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.454+0000 7f2a2df2a800 20 rados->read ofs=0 len=0 2024-09-12T17:13:55.459 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.455+0000 7f2a2df2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:55.459 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.455+0000 7f2a2df2a800 20 rados->read ofs=0 len=0 2024-09-12T17:13:55.459 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.455+0000 7f2a2df2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:55.459 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.455+0000 7f2a2df2a800 20 started sync module instance, tier type = 2024-09-12T17:13:55.459 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.455+0000 7f2a2df2a800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:13:55.472 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.469+0000 7f2a2df2a800 20 add_watcher() i=0 2024-09-12T17:13:55.472 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.469+0000 7f2a2df2a800 20 add_watcher() i=1 2024-09-12T17:13:55.472 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.469+0000 7f2a2df2a800 20 add_watcher() i=2 2024-09-12T17:13:55.472 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.469+0000 7f2a2df2a800 20 add_watcher() i=3 2024-09-12T17:13:55.472 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.469+0000 7f2a2df2a800 20 add_watcher() i=4 2024-09-12T17:13:55.472 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.469+0000 7f2a2df2a800 20 add_watcher() i=5 2024-09-12T17:13:55.472 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.469+0000 7f2a2df2a800 20 add_watcher() i=6 2024-09-12T17:13:55.473 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.470+0000 7f2a2df2a800 20 add_watcher() i=7 2024-09-12T17:13:55.473 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.470+0000 7f2a2df2a800 2 all 8 watchers are set, enabling cache 2024-09-12T17:13:55.474 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.472+0000 7f28db7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:13:55.476 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.473+0000 7f2a2df2a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:13:55.476 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.473+0000 7f2a2df2a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:13:55.476 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.473+0000 7f2a2df2a800 5 note: GC not initialized 2024-09-12T17:13:55.476 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.473+0000 7f28da7fc640 20 reqs_thread_entry: start 2024-09-12T17:13:55.476 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.473+0000 7f2a2df2a800 20 init_complete bucket index max shards: 11 2024-09-12T17:13:55.476 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.473+0000 7f2a2df2a800 20 Filter name: none 2024-09-12T17:13:55.476 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.473+0000 7f284bfff640 20 reqs_thread_entry: start 2024-09-12T17:13:55.477 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.473+0000 7f2a2df2a800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T17:13:55.477 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.473+0000 7f2a2df2a800 20 rados->read ofs=0 len=0 2024-09-12T17:13:55.477 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.474+0000 7f2a2df2a800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:13:55.477 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.474+0000 7f2a2df2a800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T17:13:55.477 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.474+0000 7f2a2df2a800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T17:13:55.477 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.474+0000 7f2a2df2a800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2 : miss 2024-09-12T17:13:55.477 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.474+0000 7f2a2df2a800 20 rados->read ofs=0 len=0 2024-09-12T17:13:55.478 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.474+0000 7f2a2df2a800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:13:55.478 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.474+0000 7f2a2df2a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2 info.flags=0x17 2024-09-12T17:13:55.478 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.474+0000 7f2a2df2a800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2 to cache LRU end 2024-09-12T17:13:55.478 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.474+0000 7f2a2df2a800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:13:55.478 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.474+0000 7f2a2df2a800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T17:13:55.478 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.474+0000 7f2a2df2a800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2 2024-09-12T17:13:55.478 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.475+0000 7f2a2df2a800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.0 2024-09-12T17:13:55.478 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.475+0000 7f2a2df2a800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.1 2024-09-12T17:13:55.479 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.476+0000 7f2a2df2a800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.2 2024-09-12T17:13:55.479 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.477+0000 7f2a2df2a800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.3 2024-09-12T17:13:55.479 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.477+0000 7f2a2df2a800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.4 2024-09-12T17:13:55.480 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.478+0000 7f2a2df2a800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.5 2024-09-12T17:13:55.481 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.479+0000 7f2a2df2a800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.6 2024-09-12T17:13:55.481 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.479+0000 7f2a2df2a800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.7 2024-09-12T17:13:55.482 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.480+0000 7f2a2df2a800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.8 2024-09-12T17:13:55.483 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.481+0000 7f2a2df2a800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.9 2024-09-12T17:13:55.483 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.481+0000 7f2a2df2a800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.10 2024-09-12T17:13:55.490 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.488+0000 7f28db7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:13:55.493 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.491+0000 7f2a2df2a800 20 remove_watcher() i=0 2024-09-12T17:13:55.493 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.491+0000 7f2a2df2a800 2 removed watcher, disabling cache 2024-09-12T17:13:55.494 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.492+0000 7f2a2df2a800 20 remove_watcher() i=1 2024-09-12T17:13:55.495 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.493+0000 7f2a2df2a800 20 remove_watcher() i=2 2024-09-12T17:13:55.496 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.494+0000 7f2a2df2a800 20 remove_watcher() i=3 2024-09-12T17:13:55.497 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.495+0000 7f2a2df2a800 20 remove_watcher() i=4 2024-09-12T17:13:55.498 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.497+0000 7f2a2df2a800 20 remove_watcher() i=5 2024-09-12T17:13:55.499 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.498+0000 7f2a2df2a800 20 remove_watcher() i=6 2024-09-12T17:13:55.501 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.499+0000 7f2a2df2a800 20 remove_watcher() i=7 2024-09-12T17:13:55.513 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bucket stats --bucket check-bucket 2024-09-12T17:13:55.543 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:13:55.543 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:13:55.583 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.581+0000 7fc892cbb800 20 rados->read ofs=0 len=0 2024-09-12T17:13:55.585 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.583+0000 7fc892cbb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:55.585 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.583+0000 7fc892cbb800 20 realm 2024-09-12T17:13:55.585 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.583+0000 7fc892cbb800 20 rados->read ofs=0 len=0 2024-09-12T17:13:55.586 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.583+0000 7fc892cbb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:55.586 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.583+0000 7fc892cbb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:13:55.586 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.583+0000 7fc892cbb800 20 rados->read ofs=0 len=0 2024-09-12T17:13:55.586 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.583+0000 7fc892cbb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:55.586 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.583+0000 7fc892cbb800 20 rados->read ofs=0 len=0 2024-09-12T17:13:55.586 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.584+0000 7fc892cbb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:13:55.587 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.584+0000 7fc892cbb800 20 rados->read ofs=0 len=0 2024-09-12T17:13:55.587 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.584+0000 7fc892cbb800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:13:55.587 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.584+0000 7fc892cbb800 20 searching for the correct realm 2024-09-12T17:13:55.589 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.587+0000 7fc88ffa4640 0 -- 172.21.15.37:0/1708561762 >> [v2:172.21.15.40:6800/2441293461,v1:172.21.15.40:6801/2441293461] conn(0x7fc880074040 msgr2=0x7fc88008a460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:13:55.594 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.592+0000 7fc8907a5640 0 -- 172.21.15.37:0/1708561762 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7fc88400d8f0 msgr2=0x7fc88404e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:13:55.802 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.799+0000 7fc892cbb800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:13:55.802 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.799+0000 7fc892cbb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:13:55.802 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.799+0000 7fc892cbb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:13:55.802 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.799+0000 7fc892cbb800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:13:55.802 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.799+0000 7fc892cbb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:13:55.802 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.799+0000 7fc892cbb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:13:55.803 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.799+0000 7fc892cbb800 20 rados->read ofs=0 len=0 2024-09-12T17:13:55.803 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.800+0000 7fc892cbb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:55.803 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.800+0000 7fc892cbb800 20 rados->read ofs=0 len=0 2024-09-12T17:13:55.803 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.800+0000 7fc892cbb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:13:55.803 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.800+0000 7fc892cbb800 20 rados->read ofs=0 len=0 2024-09-12T17:13:55.804 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.800+0000 7fc892cbb800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:13:55.804 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.800+0000 7fc892cbb800 20 zone default found 2024-09-12T17:13:55.804 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.800+0000 7fc892cbb800 4 Realm: () 2024-09-12T17:13:55.804 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.800+0000 7fc892cbb800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:13:55.804 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.800+0000 7fc892cbb800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:13:55.804 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.800+0000 7fc892cbb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:13:55.805 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.800+0000 7fc892cbb800 20 zonegroup default 2024-09-12T17:13:55.805 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.800+0000 7fc892cbb800 20 rados->read ofs=0 len=0 2024-09-12T17:13:55.805 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.801+0000 7fc892cbb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:55.805 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.801+0000 7fc892cbb800 20 rados->read ofs=0 len=0 2024-09-12T17:13:55.805 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.801+0000 7fc892cbb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:55.805 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.801+0000 7fc892cbb800 20 rados->read ofs=0 len=0 2024-09-12T17:13:55.805 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.801+0000 7fc892cbb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:55.805 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.801+0000 7fc892cbb800 20 started sync module instance, tier type = 2024-09-12T17:13:55.805 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.802+0000 7fc892cbb800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:13:55.819 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.817+0000 7fc892cbb800 20 add_watcher() i=0 2024-09-12T17:13:55.820 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.817+0000 7fc892cbb800 20 add_watcher() i=1 2024-09-12T17:13:55.820 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.817+0000 7fc892cbb800 20 add_watcher() i=2 2024-09-12T17:13:55.820 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.817+0000 7fc892cbb800 20 add_watcher() i=3 2024-09-12T17:13:55.820 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.817+0000 7fc892cbb800 20 add_watcher() i=4 2024-09-12T17:13:55.820 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.817+0000 7fc892cbb800 20 add_watcher() i=5 2024-09-12T17:13:55.822 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.820+0000 7fc892cbb800 20 add_watcher() i=6 2024-09-12T17:13:55.822 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.820+0000 7fc892cbb800 20 add_watcher() i=7 2024-09-12T17:13:55.822 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.820+0000 7fc892cbb800 2 all 8 watchers are set, enabling cache 2024-09-12T17:13:55.824 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.822+0000 7fc7467e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:13:55.825 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.822+0000 7fc892cbb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:13:55.825 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.822+0000 7fc892cbb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:13:55.825 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.822+0000 7fc892cbb800 5 note: GC not initialized 2024-09-12T17:13:55.825 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.822+0000 7fc7457e2640 20 reqs_thread_entry: start 2024-09-12T17:13:55.825 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.822+0000 7fc892cbb800 20 init_complete bucket index max shards: 11 2024-09-12T17:13:55.825 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.823+0000 7fc892cbb800 20 Filter name: none 2024-09-12T17:13:55.826 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.823+0000 7fc6b6ffd640 20 reqs_thread_entry: start 2024-09-12T17:13:55.826 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.823+0000 7fc892cbb800 20 rados->read ofs=0 len=0 2024-09-12T17:13:55.826 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.823+0000 7fc892cbb800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:13:55.826 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.823+0000 7fc892cbb800 20 rados->read ofs=0 len=0 2024-09-12T17:13:55.827 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.824+0000 7fc892cbb800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:13:55.827 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.824+0000 7fc892cbb800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:13:55.827 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.824+0000 7fc892cbb800 20 rados->read ofs=0 len=0 2024-09-12T17:13:55.827 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.824+0000 7fc892cbb800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:13:55.827 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.824+0000 7fc892cbb800 20 rados->read ofs=0 len=0 2024-09-12T17:13:55.827 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.825+0000 7fc892cbb800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:13:55.827 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.825+0000 7fc892cbb800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:13:55.829 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.827+0000 7fc7467e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:13:55.831 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.829+0000 7fc892cbb800 20 remove_watcher() i=0 2024-09-12T17:13:55.831 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.829+0000 7fc892cbb800 2 removed watcher, disabling cache 2024-09-12T17:13:55.833 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.831+0000 7fc892cbb800 20 remove_watcher() i=1 2024-09-12T17:13:55.834 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.832+0000 7fc892cbb800 20 remove_watcher() i=2 2024-09-12T17:13:55.835 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.833+0000 7fc892cbb800 20 remove_watcher() i=3 2024-09-12T17:13:55.836 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.834+0000 7fc892cbb800 20 remove_watcher() i=4 2024-09-12T17:13:55.837 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.835+0000 7fc892cbb800 20 remove_watcher() i=5 2024-09-12T17:13:55.839 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.837+0000 7fc892cbb800 20 remove_watcher() i=6 2024-09-12T17:13:55.840 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.838+0000 7fc892cbb800 20 remove_watcher() i=7 2024-09-12T17:13:55.851 INFO:tasks.workunit.client.0.smithi037.stderr:{'rgw.main': {'size': 54, 'size_actual': 24576, 'size_utilized': 66, 'size_kb': 1, 'size_kb_actual': 24, 'size_kb_utilized': 1, 'num_objects': 6}} 2024-09-12T17:13:55.851 INFO:tasks.workunit.client.0.smithi037.stderr:TEST: bucket check unlinked does not report normal entries 2024-09-12T17:13:55.852 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:13:55.853 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-09-12T17:13:55.886 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:13:55.886 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:13:55.926 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.923+0000 7ff8c3d21800 20 rados->read ofs=0 len=0 2024-09-12T17:13:55.928 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.925+0000 7ff8c3d21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:55.928 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.925+0000 7ff8c3d21800 20 realm 2024-09-12T17:13:55.928 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.925+0000 7ff8c3d21800 20 rados->read ofs=0 len=0 2024-09-12T17:13:55.928 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.925+0000 7ff8c3d21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:55.928 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.925+0000 7ff8c3d21800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:13:55.928 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.925+0000 7ff8c3d21800 20 rados->read ofs=0 len=0 2024-09-12T17:13:55.928 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.925+0000 7ff8c3d21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:55.928 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.925+0000 7ff8c3d21800 20 rados->read ofs=0 len=0 2024-09-12T17:13:55.932 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.926+0000 7ff8c3d21800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:13:55.932 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.926+0000 7ff8c3d21800 20 rados->read ofs=0 len=0 2024-09-12T17:13:55.932 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.927+0000 7ff8c3d21800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:13:55.932 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.927+0000 7ff8c3d21800 20 searching for the correct realm 2024-09-12T17:13:55.933 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.930+0000 7ff8c0157640 0 -- 172.21.15.37:0/1853355353 >> [v2:172.21.15.37:6824/3990661154,v1:172.21.15.37:6825/3990661154] conn(0x55a18abd0a40 msgr2=0x55a18abd2eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:13:55.936 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.934+0000 7ff8bf155640 0 -- 172.21.15.37:0/1853355353 >> [v2:172.21.15.40:6800/2441293461,v1:172.21.15.40:6801/2441293461] conn(0x7ff8b0038060 msgr2=0x7ff8b0066990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:13:55.940 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.938+0000 7ff8c3d21800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:13:55.940 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.938+0000 7ff8c3d21800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:13:55.940 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.938+0000 7ff8c3d21800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:13:55.941 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.938+0000 7ff8c3d21800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:13:55.941 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.938+0000 7ff8c3d21800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:13:55.941 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.938+0000 7ff8c3d21800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:13:55.941 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.938+0000 7ff8c3d21800 20 rados->read ofs=0 len=0 2024-09-12T17:13:55.941 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.938+0000 7ff8c3d21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:55.941 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.938+0000 7ff8c3d21800 20 rados->read ofs=0 len=0 2024-09-12T17:13:55.943 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.939+0000 7ff8c3d21800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:13:55.943 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.939+0000 7ff8c3d21800 20 rados->read ofs=0 len=0 2024-09-12T17:13:55.943 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.940+0000 7ff8c3d21800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:13:55.943 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.940+0000 7ff8c3d21800 20 zone default found 2024-09-12T17:13:55.943 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.940+0000 7ff8c3d21800 4 Realm: () 2024-09-12T17:13:55.943 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.940+0000 7ff8c3d21800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:13:55.943 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.940+0000 7ff8c3d21800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:13:55.943 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.940+0000 7ff8c3d21800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:13:55.943 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.940+0000 7ff8c3d21800 20 zonegroup default 2024-09-12T17:13:55.944 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.940+0000 7ff8c3d21800 20 rados->read ofs=0 len=0 2024-09-12T17:13:55.944 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.940+0000 7ff8c3d21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:55.944 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.940+0000 7ff8c3d21800 20 rados->read ofs=0 len=0 2024-09-12T17:13:55.944 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.940+0000 7ff8c3d21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:55.944 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.940+0000 7ff8c3d21800 20 rados->read ofs=0 len=0 2024-09-12T17:13:55.944 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.940+0000 7ff8c3d21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:55.944 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.940+0000 7ff8c3d21800 20 started sync module instance, tier type = 2024-09-12T17:13:55.944 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.940+0000 7ff8c3d21800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:13:55.952 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.950+0000 7ff8c3d21800 20 add_watcher() i=0 2024-09-12T17:13:55.952 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.950+0000 7ff8c3d21800 20 add_watcher() i=1 2024-09-12T17:13:55.953 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.950+0000 7ff8c3d21800 20 add_watcher() i=2 2024-09-12T17:13:55.953 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.950+0000 7ff8c3d21800 20 add_watcher() i=3 2024-09-12T17:13:55.953 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.950+0000 7ff8c3d21800 20 add_watcher() i=4 2024-09-12T17:13:55.953 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.950+0000 7ff8c3d21800 20 add_watcher() i=5 2024-09-12T17:13:55.953 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.950+0000 7ff8c3d21800 20 add_watcher() i=6 2024-09-12T17:13:55.953 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.951+0000 7ff8c3d21800 20 add_watcher() i=7 2024-09-12T17:13:55.953 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.951+0000 7ff8c3d21800 2 all 8 watchers are set, enabling cache 2024-09-12T17:13:55.955 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.953+0000 7ff775fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:13:55.956 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.953+0000 7ff8c3d21800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:13:55.956 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.953+0000 7ff8c3d21800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:13:55.956 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.953+0000 7ff8c3d21800 5 note: GC not initialized 2024-09-12T17:13:55.957 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.953+0000 7ff774fe1640 20 reqs_thread_entry: start 2024-09-12T17:13:55.957 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.954+0000 7ff8c3d21800 20 init_complete bucket index max shards: 11 2024-09-12T17:13:55.957 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.954+0000 7ff8c3d21800 20 Filter name: none 2024-09-12T17:13:55.957 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.954+0000 7ff6ee7fc640 20 reqs_thread_entry: start 2024-09-12T17:13:55.957 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.954+0000 7ff8c3d21800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T17:13:55.957 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.954+0000 7ff8c3d21800 20 rados->read ofs=0 len=0 2024-09-12T17:13:55.957 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.954+0000 7ff8c3d21800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:13:55.957 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.954+0000 7ff8c3d21800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T17:13:55.957 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.954+0000 7ff8c3d21800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T17:13:55.957 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.954+0000 7ff8c3d21800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2 : miss 2024-09-12T17:13:55.957 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.954+0000 7ff8c3d21800 20 rados->read ofs=0 len=0 2024-09-12T17:13:55.958 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.955+0000 7ff8c3d21800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:13:55.959 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.955+0000 7ff8c3d21800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2 info.flags=0x17 2024-09-12T17:13:55.959 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.955+0000 7ff8c3d21800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2 to cache LRU end 2024-09-12T17:13:55.959 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.955+0000 7ff8c3d21800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:13:55.959 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.955+0000 7ff8c3d21800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T17:13:55.959 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.955+0000 7ff8c3d21800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2 2024-09-12T17:13:55.959 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.955+0000 7ff8c3d21800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.0 2024-09-12T17:13:55.959 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.955+0000 7ff8c3d21800 1 NOTICE: finished shard 0 (0 entries found) 2024-09-12T17:13:55.959 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.955+0000 7ff8c3d21800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.1 2024-09-12T17:13:55.959 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.956+0000 7ff8c3d21800 1 NOTICE: finished shard 1 (0 entries found) 2024-09-12T17:13:55.959 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.956+0000 7ff8c3d21800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.2 2024-09-12T17:13:55.960 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.957+0000 7ff8c3d21800 1 NOTICE: finished shard 2 (0 entries found) 2024-09-12T17:13:55.960 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.957+0000 7ff8c3d21800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.3 2024-09-12T17:13:55.960 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.957+0000 7ff8c3d21800 1 NOTICE: finished shard 3 (0 entries found) 2024-09-12T17:13:55.960 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.957+0000 7ff8c3d21800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.4 2024-09-12T17:13:55.960 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.958+0000 7ff8c3d21800 1 NOTICE: finished shard 4 (0 entries found) 2024-09-12T17:13:55.960 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.958+0000 7ff8c3d21800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.5 2024-09-12T17:13:55.961 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.958+0000 7ff8c3d21800 1 NOTICE: finished shard 5 (0 entries found) 2024-09-12T17:13:55.961 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.958+0000 7ff8c3d21800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.6 2024-09-12T17:13:55.961 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.959+0000 7ff8c3d21800 1 NOTICE: finished shard 6 (0 entries found) 2024-09-12T17:13:55.961 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.959+0000 7ff8c3d21800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.7 2024-09-12T17:13:55.961 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.959+0000 7ff8c3d21800 1 NOTICE: finished shard 7 (0 entries found) 2024-09-12T17:13:55.962 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.959+0000 7ff8c3d21800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.8 2024-09-12T17:13:55.962 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.960+0000 7ff8c3d21800 1 NOTICE: finished shard 8 (0 entries found) 2024-09-12T17:13:55.962 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.960+0000 7ff8c3d21800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.9 2024-09-12T17:13:55.963 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.961+0000 7ff8c3d21800 1 NOTICE: finished shard 9 (0 entries found) 2024-09-12T17:13:55.963 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.961+0000 7ff8c3d21800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.10 2024-09-12T17:13:55.963 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.961+0000 7ff8c3d21800 1 NOTICE: finished shard 10 (0 entries found) 2024-09-12T17:13:55.963 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.961+0000 7ff8c3d21800 1 NOTICE: finished all shards (0 entries found) 2024-09-12T17:13:55.964 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.962+0000 7ff775fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:13:55.967 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.965+0000 7ff8c3d21800 20 remove_watcher() i=0 2024-09-12T17:13:55.967 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.965+0000 7ff8c3d21800 2 removed watcher, disabling cache 2024-09-12T17:13:55.968 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.966+0000 7ff8c3d21800 20 remove_watcher() i=1 2024-09-12T17:13:55.969 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.967+0000 7ff8c3d21800 20 remove_watcher() i=2 2024-09-12T17:13:55.970 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.968+0000 7ff8c3d21800 20 remove_watcher() i=3 2024-09-12T17:13:55.971 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.969+0000 7ff8c3d21800 20 remove_watcher() i=4 2024-09-12T17:13:55.973 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.970+0000 7ff8c3d21800 20 remove_watcher() i=5 2024-09-12T17:13:55.974 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.972+0000 7ff8c3d21800 20 remove_watcher() i=6 2024-09-12T17:13:55.975 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:55.973+0000 7ff8c3d21800 20 remove_watcher() i=7 2024-09-12T17:13:55.988 INFO:tasks.workunit.client.0.smithi037.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-12T17:13:56.414 INFO:tasks.workunit.client.0.smithi037.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-09-12T17:13:57.925 INFO:tasks.workunit.client.0.smithi037.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T17:13:57.927 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-12T17:13:57.961 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:13:57.961 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:13:58.004 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.002+0000 7efc76a20800 20 rados->read ofs=0 len=0 2024-09-12T17:13:58.005 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.003+0000 7efc76a20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:58.005 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.003+0000 7efc76a20800 20 realm 2024-09-12T17:13:58.005 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.003+0000 7efc76a20800 20 rados->read ofs=0 len=0 2024-09-12T17:13:58.006 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.003+0000 7efc76a20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:58.006 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.003+0000 7efc76a20800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:13:58.006 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.003+0000 7efc76a20800 20 rados->read ofs=0 len=0 2024-09-12T17:13:58.006 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.003+0000 7efc76a20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:58.006 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.003+0000 7efc76a20800 20 rados->read ofs=0 len=0 2024-09-12T17:13:58.006 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.004+0000 7efc76a20800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:13:58.006 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.004+0000 7efc76a20800 20 rados->read ofs=0 len=0 2024-09-12T17:13:58.007 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.005+0000 7efc76a20800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:13:58.007 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.005+0000 7efc76a20800 20 searching for the correct realm 2024-09-12T17:13:58.011 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.008+0000 7efc74d0b640 0 -- 172.21.15.37:0/3023446408 >> [v2:172.21.15.40:6818/1210108009,v1:172.21.15.40:6819/1210108009] conn(0x7efc68087030 msgr2=0x7efc68087410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:13:58.014 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.012+0000 7efc7450a640 0 -- 172.21.15.37:0/3023446408 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7efc6807b920 msgr2=0x7efc68063420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:13:58.020 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.017+0000 7efc76a20800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:13:58.020 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.017+0000 7efc76a20800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:13:58.020 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.017+0000 7efc76a20800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:13:58.020 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.017+0000 7efc76a20800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:13:58.020 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.017+0000 7efc76a20800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:13:58.020 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.017+0000 7efc76a20800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:13:58.020 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.017+0000 7efc76a20800 20 rados->read ofs=0 len=0 2024-09-12T17:13:58.020 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.018+0000 7efc76a20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:58.020 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.018+0000 7efc76a20800 20 rados->read ofs=0 len=0 2024-09-12T17:13:58.021 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.018+0000 7efc76a20800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:13:58.021 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.018+0000 7efc76a20800 20 rados->read ofs=0 len=0 2024-09-12T17:13:58.022 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.018+0000 7efc76a20800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:13:58.022 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.018+0000 7efc76a20800 20 zone default found 2024-09-12T17:13:58.022 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.018+0000 7efc76a20800 4 Realm: () 2024-09-12T17:13:58.022 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.018+0000 7efc76a20800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:13:58.022 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.018+0000 7efc76a20800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:13:58.022 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.018+0000 7efc76a20800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:13:58.022 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.018+0000 7efc76a20800 20 zonegroup default 2024-09-12T17:13:58.022 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.018+0000 7efc76a20800 20 rados->read ofs=0 len=0 2024-09-12T17:13:58.022 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.019+0000 7efc76a20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:58.022 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.019+0000 7efc76a20800 20 rados->read ofs=0 len=0 2024-09-12T17:13:58.022 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.019+0000 7efc76a20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:58.022 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.019+0000 7efc76a20800 20 rados->read ofs=0 len=0 2024-09-12T17:13:58.022 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.019+0000 7efc76a20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:58.022 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.019+0000 7efc76a20800 20 started sync module instance, tier type = 2024-09-12T17:13:58.023 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.019+0000 7efc76a20800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:13:58.035 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.033+0000 7efc76a20800 20 add_watcher() i=0 2024-09-12T17:13:58.035 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.033+0000 7efc76a20800 20 add_watcher() i=1 2024-09-12T17:13:58.035 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.033+0000 7efc76a20800 20 add_watcher() i=2 2024-09-12T17:13:58.035 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.033+0000 7efc76a20800 20 add_watcher() i=3 2024-09-12T17:13:58.035 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.033+0000 7efc76a20800 20 add_watcher() i=4 2024-09-12T17:13:58.035 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.033+0000 7efc76a20800 20 add_watcher() i=5 2024-09-12T17:13:58.035 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.033+0000 7efc76a20800 20 add_watcher() i=6 2024-09-12T17:13:58.036 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.034+0000 7efc76a20800 20 add_watcher() i=7 2024-09-12T17:13:58.036 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.034+0000 7efc76a20800 2 all 8 watchers are set, enabling cache 2024-09-12T17:13:58.039 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.037+0000 7efb2afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:13:58.040 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.037+0000 7efc76a20800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:13:58.040 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.037+0000 7efc76a20800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:13:58.040 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.037+0000 7efc76a20800 5 note: GC not initialized 2024-09-12T17:13:58.040 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.037+0000 7efb29fdb640 20 reqs_thread_entry: start 2024-09-12T17:13:58.040 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.037+0000 7efc76a20800 20 init_complete bucket index max shards: 11 2024-09-12T17:13:58.040 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.037+0000 7efc76a20800 20 Filter name: none 2024-09-12T17:13:58.040 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.037+0000 7efa9b7fe640 20 reqs_thread_entry: start 2024-09-12T17:13:58.040 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.038+0000 7efc76a20800 20 rados->read ofs=0 len=0 2024-09-12T17:13:58.040 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.038+0000 7efc76a20800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:13:58.040 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.038+0000 7efc76a20800 20 rados->read ofs=0 len=0 2024-09-12T17:13:58.041 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.039+0000 7efc76a20800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:13:58.041 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.039+0000 7efc76a20800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:13:58.041 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.039+0000 7efc76a20800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T17:13:58.041 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.039+0000 7efc76a20800 20 INFO: main: starting shard=0 2024-09-12T17:13:58.041 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.039+0000 7efc76a20800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.0 2024-09-12T17:13:58.042 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.039+0000 7efc76a20800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:13:58.042 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.039+0000 7efc76a20800 20 INFO: main: starting shard=1 2024-09-12T17:13:58.042 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.039+0000 7efc76a20800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.1 2024-09-12T17:13:58.042 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.040+0000 7efc76a20800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:13:58.042 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.040+0000 7efc76a20800 20 INFO: main: starting shard=2 2024-09-12T17:13:58.042 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.040+0000 7efc76a20800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.2 2024-09-12T17:13:58.043 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.040+0000 7efc76a20800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:13:58.043 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.040+0000 7efc76a20800 20 INFO: main: starting shard=3 2024-09-12T17:13:58.043 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.040+0000 7efc76a20800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.3 2024-09-12T17:13:58.043 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.041+0000 7efc76a20800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:13:58.043 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.041+0000 7efc76a20800 20 INFO: main: starting shard=4 2024-09-12T17:13:58.043 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.041+0000 7efc76a20800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.4 2024-09-12T17:13:58.043 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.041+0000 7efc76a20800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:13:58.044 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.041+0000 7efc76a20800 20 INFO: main: starting shard=5 2024-09-12T17:13:58.044 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.041+0000 7efc76a20800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.5 2024-09-12T17:13:58.044 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.042+0000 7efc76a20800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:13:58.044 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.042+0000 7efc76a20800 20 INFO: main: starting shard=6 2024-09-12T17:13:58.044 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.042+0000 7efc76a20800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.6 2024-09-12T17:13:58.044 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.042+0000 7efc76a20800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:13:58.045 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.042+0000 7efc76a20800 20 INFO: main: starting shard=7 2024-09-12T17:13:58.045 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.042+0000 7efc76a20800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.7 2024-09-12T17:13:58.045 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.043+0000 7efc76a20800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:13:58.045 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.043+0000 7efc76a20800 20 INFO: main: starting shard=8 2024-09-12T17:13:58.045 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.043+0000 7efc76a20800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.8 2024-09-12T17:13:58.046 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.044+0000 7efc76a20800 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-12T17:13:58.046 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.044+0000 7efc76a20800 20 INFO: main: starting shard=9 2024-09-12T17:13:58.046 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.044+0000 7efc76a20800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.9 2024-09-12T17:13:58.046 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.044+0000 7efc76a20800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:13:58.046 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.044+0000 7efc76a20800 20 INFO: main: starting shard=10 2024-09-12T17:13:58.047 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.044+0000 7efc76a20800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.10 2024-09-12T17:13:58.047 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.045+0000 7efc76a20800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:13:58.047 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.045+0000 7efc76a20800 20 INFO: main: done 2024-09-12T17:13:58.048 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.046+0000 7efb2afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:13:58.050 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.049+0000 7efc76a20800 20 remove_watcher() i=0 2024-09-12T17:13:58.051 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.049+0000 7efc76a20800 2 removed watcher, disabling cache 2024-09-12T17:13:58.052 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.050+0000 7efc76a20800 20 remove_watcher() i=1 2024-09-12T17:13:58.053 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.051+0000 7efc76a20800 20 remove_watcher() i=2 2024-09-12T17:13:58.055 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.053+0000 7efc76a20800 20 remove_watcher() i=3 2024-09-12T17:13:58.056 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.054+0000 7efc76a20800 20 remove_watcher() i=4 2024-09-12T17:13:58.058 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.056+0000 7efc76a20800 20 remove_watcher() i=5 2024-09-12T17:13:58.059 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.057+0000 7efc76a20800 20 remove_watcher() i=6 2024-09-12T17:13:58.061 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.059+0000 7efc76a20800 20 remove_watcher() i=7 2024-09-12T17:13:58.181 INFO:tasks.workunit.client.0.smithi037.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T17:13:58.183 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-12T17:13:58.214 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:13:58.214 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:13:58.458 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.456+0000 7fedb1ebb800 20 rados->read ofs=0 len=0 2024-09-12T17:13:58.460 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.458+0000 7fedb1ebb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:58.460 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.458+0000 7fedb1ebb800 20 realm 2024-09-12T17:13:58.460 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.458+0000 7fedb1ebb800 20 rados->read ofs=0 len=0 2024-09-12T17:13:58.461 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.458+0000 7fedb1ebb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:58.461 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.458+0000 7fedb1ebb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:13:58.461 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.458+0000 7fedb1ebb800 20 rados->read ofs=0 len=0 2024-09-12T17:13:58.461 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.458+0000 7fedb1ebb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:58.461 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.458+0000 7fedb1ebb800 20 rados->read ofs=0 len=0 2024-09-12T17:13:58.461 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.459+0000 7fedb1ebb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:13:58.461 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.459+0000 7fedb1ebb800 20 rados->read ofs=0 len=0 2024-09-12T17:13:58.462 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.460+0000 7fedb1ebb800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:13:58.462 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.460+0000 7fedb1ebb800 20 searching for the correct realm 2024-09-12T17:13:58.463 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.461+0000 7fedb01a6640 0 -- 172.21.15.37:0/436986867 >> [v2:172.21.15.40:6818/1210108009,v1:172.21.15.40:6819/1210108009] conn(0x7feda4053c30 msgr2=0x7feda40a2ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:13:58.668 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.666+0000 7fedb01a6640 0 -- 172.21.15.37:0/436986867 >> [v2:172.21.15.40:6808/2253405131,v1:172.21.15.40:6809/2253405131] conn(0x7feda4084020 msgr2=0x7feda4085040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:13:58.879 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.876+0000 7fedb1ebb800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:13:58.880 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.876+0000 7fedb1ebb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:13:58.880 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.876+0000 7fedb1ebb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:13:58.880 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.876+0000 7fedb1ebb800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:13:58.880 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.876+0000 7fedb1ebb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:13:58.880 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.876+0000 7fedb1ebb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:13:58.880 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.877+0000 7fedb1ebb800 20 rados->read ofs=0 len=0 2024-09-12T17:13:58.881 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.877+0000 7fedb1ebb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:58.881 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.877+0000 7fedb1ebb800 20 rados->read ofs=0 len=0 2024-09-12T17:13:58.881 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.877+0000 7fedb1ebb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:13:58.881 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.877+0000 7fedb1ebb800 20 rados->read ofs=0 len=0 2024-09-12T17:13:58.883 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.878+0000 7fedb1ebb800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:13:58.883 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.878+0000 7fedb1ebb800 20 zone default found 2024-09-12T17:13:58.884 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.878+0000 7fedb1ebb800 4 Realm: () 2024-09-12T17:13:58.884 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.878+0000 7fedb1ebb800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:13:58.884 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.878+0000 7fedb1ebb800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:13:58.884 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.878+0000 7fedb1ebb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:13:58.884 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.878+0000 7fedb1ebb800 20 zonegroup default 2024-09-12T17:13:58.884 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.878+0000 7fedb1ebb800 20 rados->read ofs=0 len=0 2024-09-12T17:13:58.885 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.878+0000 7fedb1ebb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:58.885 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.878+0000 7fedb1ebb800 20 rados->read ofs=0 len=0 2024-09-12T17:13:58.885 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.879+0000 7fedb1ebb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:58.885 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.879+0000 7fedb1ebb800 20 rados->read ofs=0 len=0 2024-09-12T17:13:58.885 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.879+0000 7fedb1ebb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:58.885 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.879+0000 7fedb1ebb800 20 started sync module instance, tier type = 2024-09-12T17:13:58.886 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.879+0000 7fedb1ebb800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:13:58.899 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.897+0000 7fedb1ebb800 20 add_watcher() i=0 2024-09-12T17:13:58.899 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.897+0000 7fedb1ebb800 20 add_watcher() i=1 2024-09-12T17:13:58.899 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.897+0000 7fedb1ebb800 20 add_watcher() i=2 2024-09-12T17:13:58.899 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.897+0000 7fedb1ebb800 20 add_watcher() i=3 2024-09-12T17:13:58.900 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.897+0000 7fedb1ebb800 20 add_watcher() i=4 2024-09-12T17:13:58.900 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.897+0000 7fedb1ebb800 20 add_watcher() i=5 2024-09-12T17:13:58.900 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.897+0000 7fedb1ebb800 20 add_watcher() i=6 2024-09-12T17:13:58.901 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.899+0000 7fedb1ebb800 20 add_watcher() i=7 2024-09-12T17:13:58.901 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.899+0000 7fedb1ebb800 2 all 8 watchers are set, enabling cache 2024-09-12T17:13:58.904 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.902+0000 7fec65fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:13:58.906 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.902+0000 7fedb1ebb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:13:58.906 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.902+0000 7fedb1ebb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:13:58.906 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.902+0000 7fedb1ebb800 5 note: GC not initialized 2024-09-12T17:13:58.906 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.902+0000 7fec64fe1640 20 reqs_thread_entry: start 2024-09-12T17:13:58.906 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.903+0000 7fedb1ebb800 20 init_complete bucket index max shards: 11 2024-09-12T17:13:58.906 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.903+0000 7fedb1ebb800 20 Filter name: none 2024-09-12T17:13:58.907 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.903+0000 7febde7fc640 20 reqs_thread_entry: start 2024-09-12T17:13:58.907 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.903+0000 7fedb1ebb800 20 rados->read ofs=0 len=0 2024-09-12T17:13:58.907 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.903+0000 7fedb1ebb800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:13:58.907 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.903+0000 7fedb1ebb800 20 rados->read ofs=0 len=0 2024-09-12T17:13:58.908 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.904+0000 7fedb1ebb800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:13:58.909 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.904+0000 7fedb1ebb800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:13:58.909 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.904+0000 7fedb1ebb800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T17:13:58.909 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.904+0000 7fedb1ebb800 20 INFO: main: starting shard=0 2024-09-12T17:13:58.909 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.904+0000 7fedb1ebb800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.0 2024-09-12T17:13:58.909 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.905+0000 7fedb1ebb800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:13:58.909 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.905+0000 7fedb1ebb800 20 INFO: main: starting shard=1 2024-09-12T17:13:58.909 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.905+0000 7fedb1ebb800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.1 2024-09-12T17:13:58.909 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.906+0000 7fedb1ebb800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:13:58.910 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.906+0000 7fedb1ebb800 20 INFO: main: starting shard=2 2024-09-12T17:13:58.910 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.906+0000 7fedb1ebb800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.2 2024-09-12T17:13:58.910 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.906+0000 7fedb1ebb800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:13:58.910 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.906+0000 7fedb1ebb800 20 INFO: main: starting shard=3 2024-09-12T17:13:58.910 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.906+0000 7fedb1ebb800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.3 2024-09-12T17:13:58.911 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.907+0000 7fedb1ebb800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:13:58.911 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.907+0000 7fedb1ebb800 20 INFO: main: starting shard=4 2024-09-12T17:13:58.912 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.907+0000 7fedb1ebb800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.4 2024-09-12T17:13:58.912 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.908+0000 7fedb1ebb800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:13:58.912 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.908+0000 7fedb1ebb800 20 INFO: main: starting shard=5 2024-09-12T17:13:58.912 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.908+0000 7fedb1ebb800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.5 2024-09-12T17:13:58.912 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.909+0000 7fedb1ebb800 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-12T17:13:58.912 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.909+0000 7fedb1ebb800 20 INFO: main: starting shard=6 2024-09-12T17:13:58.912 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.909+0000 7fedb1ebb800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.6 2024-09-12T17:13:58.913 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.909+0000 7fedb1ebb800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:13:58.913 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.909+0000 7fedb1ebb800 20 INFO: main: starting shard=7 2024-09-12T17:13:58.913 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.909+0000 7fedb1ebb800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.7 2024-09-12T17:13:58.914 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.910+0000 7fedb1ebb800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:13:58.914 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.910+0000 7fedb1ebb800 20 INFO: main: starting shard=8 2024-09-12T17:13:58.915 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.910+0000 7fedb1ebb800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.8 2024-09-12T17:13:58.915 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.910+0000 7fedb1ebb800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:13:58.915 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.910+0000 7fedb1ebb800 20 INFO: main: starting shard=9 2024-09-12T17:13:58.915 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.910+0000 7fedb1ebb800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.9 2024-09-12T17:13:58.915 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.911+0000 7fedb1ebb800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:13:58.916 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.911+0000 7fedb1ebb800 20 INFO: main: starting shard=10 2024-09-12T17:13:58.916 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.911+0000 7fedb1ebb800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.10 2024-09-12T17:13:58.916 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.912+0000 7fedb1ebb800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:13:58.916 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.912+0000 7fedb1ebb800 20 INFO: main: done 2024-09-12T17:13:58.916 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.913+0000 7fec65fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:13:58.918 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.916+0000 7fedb1ebb800 20 remove_watcher() i=0 2024-09-12T17:13:58.918 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.916+0000 7fedb1ebb800 2 removed watcher, disabling cache 2024-09-12T17:13:58.919 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.917+0000 7fedb1ebb800 20 remove_watcher() i=1 2024-09-12T17:13:58.920 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.919+0000 7fedb1ebb800 20 remove_watcher() i=2 2024-09-12T17:13:58.922 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.920+0000 7fedb1ebb800 20 remove_watcher() i=3 2024-09-12T17:13:58.924 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.921+0000 7fedb1ebb800 20 remove_watcher() i=4 2024-09-12T17:13:58.924 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.922+0000 7fedb1ebb800 20 remove_watcher() i=5 2024-09-12T17:13:58.925 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.924+0000 7fedb1ebb800 20 remove_watcher() i=6 2024-09-12T17:13:58.927 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:58.925+0000 7fedb1ebb800 20 remove_watcher() i=7 2024-09-12T17:13:59.050 INFO:tasks.workunit.client.0.smithi037.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T17:13:59.052 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bi list --bucket check-bucket --object e 2024-09-12T17:13:59.086 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:13:59.086 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:13:59.126 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:59.124+0000 7fb11dd25800 20 rados->read ofs=0 len=0 2024-09-12T17:13:59.128 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:59.126+0000 7fb11dd25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:59.128 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:59.126+0000 7fb11dd25800 20 realm 2024-09-12T17:13:59.128 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:59.126+0000 7fb11dd25800 20 rados->read ofs=0 len=0 2024-09-12T17:13:59.128 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:59.126+0000 7fb11dd25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:59.128 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:59.126+0000 7fb11dd25800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:13:59.128 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:59.126+0000 7fb11dd25800 20 rados->read ofs=0 len=0 2024-09-12T17:13:59.129 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:59.126+0000 7fb11dd25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:59.129 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:59.126+0000 7fb11dd25800 20 rados->read ofs=0 len=0 2024-09-12T17:13:59.129 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:59.127+0000 7fb11dd25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:13:59.129 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:59.127+0000 7fb11dd25800 20 rados->read ofs=0 len=0 2024-09-12T17:13:59.130 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:59.127+0000 7fb11dd25800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:13:59.130 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:59.127+0000 7fb11dd25800 20 searching for the correct realm 2024-09-12T17:13:59.133 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:59.131+0000 7fb1191ad640 0 -- 172.21.15.37:0/37637197 >> [v2:172.21.15.37:6824/3990661154,v1:172.21.15.37:6825/3990661154] conn(0x7fafe4084080 msgr2=0x7fafe40864b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:13:59.339 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:59.337+0000 7fb1199ae640 0 -- 172.21.15.37:0/37637197 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7fb11008b920 msgr2=0x7fb110064410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:13:59.344 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:59.341+0000 7fb11dd25800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:13:59.344 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:59.341+0000 7fb11dd25800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:13:59.344 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:59.341+0000 7fb11dd25800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:13:59.344 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:59.341+0000 7fb11dd25800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:13:59.344 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:59.341+0000 7fb11dd25800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:13:59.344 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:59.341+0000 7fb11dd25800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:13:59.344 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:59.341+0000 7fb11dd25800 20 rados->read ofs=0 len=0 2024-09-12T17:13:59.344 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:59.342+0000 7fb11dd25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:59.344 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:59.342+0000 7fb11dd25800 20 rados->read ofs=0 len=0 2024-09-12T17:13:59.346 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:59.342+0000 7fb11dd25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:13:59.346 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:59.342+0000 7fb11dd25800 20 rados->read ofs=0 len=0 2024-09-12T17:13:59.346 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:59.343+0000 7fb11dd25800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:13:59.346 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:59.343+0000 7fb11dd25800 20 zone default found 2024-09-12T17:13:59.346 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:59.343+0000 7fb11dd25800 4 Realm: () 2024-09-12T17:13:59.346 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:59.343+0000 7fb11dd25800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:13:59.347 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:59.343+0000 7fb11dd25800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:13:59.347 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:59.343+0000 7fb11dd25800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:13:59.347 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:59.343+0000 7fb11dd25800 20 zonegroup default 2024-09-12T17:13:59.347 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:59.343+0000 7fb11dd25800 20 rados->read ofs=0 len=0 2024-09-12T17:13:59.347 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:59.343+0000 7fb11dd25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:59.347 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:59.343+0000 7fb11dd25800 20 rados->read ofs=0 len=0 2024-09-12T17:13:59.347 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:59.343+0000 7fb11dd25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:59.347 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:59.343+0000 7fb11dd25800 20 rados->read ofs=0 len=0 2024-09-12T17:13:59.347 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:59.344+0000 7fb11dd25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:59.347 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:59.344+0000 7fb11dd25800 20 started sync module instance, tier type = 2024-09-12T17:13:59.347 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:59.344+0000 7fb11dd25800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:13:59.357 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:59.355+0000 7fb11dd25800 20 add_watcher() i=0 2024-09-12T17:13:59.357 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:59.355+0000 7fb11dd25800 20 add_watcher() i=1 2024-09-12T17:13:59.357 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:59.355+0000 7fb11dd25800 20 add_watcher() i=2 2024-09-12T17:13:59.358 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:59.355+0000 7fb11dd25800 20 add_watcher() i=3 2024-09-12T17:13:59.358 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:59.355+0000 7fb11dd25800 20 add_watcher() i=4 2024-09-12T17:13:59.358 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:59.355+0000 7fb11dd25800 20 add_watcher() i=5 2024-09-12T17:13:59.358 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:59.355+0000 7fb11dd25800 20 add_watcher() i=6 2024-09-12T17:13:59.358 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:59.356+0000 7fb11dd25800 20 add_watcher() i=7 2024-09-12T17:13:59.358 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:59.356+0000 7fb11dd25800 2 all 8 watchers are set, enabling cache 2024-09-12T17:13:59.360 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:59.358+0000 7fafcbfff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:13:59.361 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:59.358+0000 7fb11dd25800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:13:59.361 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:59.358+0000 7fb11dd25800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:13:59.361 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:59.358+0000 7fb11dd25800 5 note: GC not initialized 2024-09-12T17:13:59.361 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:59.358+0000 7fafcaffd640 20 reqs_thread_entry: start 2024-09-12T17:13:59.361 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:59.359+0000 7fb11dd25800 20 init_complete bucket index max shards: 11 2024-09-12T17:13:59.361 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:59.359+0000 7fb11dd25800 20 Filter name: none 2024-09-12T17:13:59.361 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:59.359+0000 7fafc8ff9640 20 reqs_thread_entry: start 2024-09-12T17:13:59.361 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:59.359+0000 7fb11dd25800 20 rados->read ofs=0 len=0 2024-09-12T17:13:59.362 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:59.359+0000 7fb11dd25800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:13:59.362 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:59.359+0000 7fb11dd25800 20 rados->read ofs=0 len=0 2024-09-12T17:13:59.362 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:59.360+0000 7fb11dd25800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:13:59.362 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:59.360+0000 7fb11dd25800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:13:59.362 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:59.360+0000 7fb11dd25800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T17:13:59.363 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:59.360+0000 7fb11dd25800 20 INFO: main: starting shard=0 2024-09-12T17:13:59.363 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:59.360+0000 7fb11dd25800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.0 2024-09-12T17:13:59.363 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:59.361+0000 7fb11dd25800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:13:59.363 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:59.361+0000 7fb11dd25800 20 INFO: main: starting shard=1 2024-09-12T17:13:59.364 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:59.361+0000 7fb11dd25800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.1 2024-09-12T17:13:59.364 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:59.361+0000 7fb11dd25800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T17:13:59.364 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:59.361+0000 7fb11dd25800 20 INFO: main: starting shard=2 2024-09-12T17:13:59.364 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:59.361+0000 7fb11dd25800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.2 2024-09-12T17:13:59.364 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:59.362+0000 7fb11dd25800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:13:59.364 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:59.362+0000 7fb11dd25800 20 INFO: main: starting shard=3 2024-09-12T17:13:59.364 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:59.362+0000 7fb11dd25800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.3 2024-09-12T17:13:59.365 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:59.363+0000 7fb11dd25800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:13:59.365 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:59.363+0000 7fb11dd25800 20 INFO: main: starting shard=4 2024-09-12T17:13:59.365 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:59.363+0000 7fb11dd25800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.4 2024-09-12T17:13:59.365 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:59.363+0000 7fb11dd25800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:13:59.365 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:59.363+0000 7fb11dd25800 20 INFO: main: starting shard=5 2024-09-12T17:13:59.365 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:59.363+0000 7fb11dd25800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.5 2024-09-12T17:13:59.366 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:59.364+0000 7fb11dd25800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:13:59.366 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:59.364+0000 7fb11dd25800 20 INFO: main: starting shard=6 2024-09-12T17:13:59.366 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:59.364+0000 7fb11dd25800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.6 2024-09-12T17:13:59.366 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:59.364+0000 7fb11dd25800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:13:59.366 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:59.364+0000 7fb11dd25800 20 INFO: main: starting shard=7 2024-09-12T17:13:59.366 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:59.364+0000 7fb11dd25800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.7 2024-09-12T17:13:59.367 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:59.365+0000 7fb11dd25800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:13:59.367 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:59.365+0000 7fb11dd25800 20 INFO: main: starting shard=8 2024-09-12T17:13:59.367 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:59.365+0000 7fb11dd25800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.8 2024-09-12T17:13:59.368 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:59.365+0000 7fb11dd25800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:13:59.368 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:59.365+0000 7fb11dd25800 20 INFO: main: starting shard=9 2024-09-12T17:13:59.368 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:59.365+0000 7fb11dd25800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.9 2024-09-12T17:13:59.368 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:59.366+0000 7fb11dd25800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:13:59.369 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:59.366+0000 7fb11dd25800 20 INFO: main: starting shard=10 2024-09-12T17:13:59.369 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:59.366+0000 7fb11dd25800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.10 2024-09-12T17:13:59.369 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:59.366+0000 7fb11dd25800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:13:59.369 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:59.366+0000 7fb11dd25800 20 INFO: main: done 2024-09-12T17:13:59.369 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:59.367+0000 7fafcbfff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:13:59.372 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:59.370+0000 7fb11dd25800 20 remove_watcher() i=0 2024-09-12T17:13:59.372 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:59.370+0000 7fb11dd25800 2 removed watcher, disabling cache 2024-09-12T17:13:59.373 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:59.371+0000 7fb11dd25800 20 remove_watcher() i=1 2024-09-12T17:13:59.374 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:59.372+0000 7fb11dd25800 20 remove_watcher() i=2 2024-09-12T17:13:59.376 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:59.374+0000 7fb11dd25800 20 remove_watcher() i=3 2024-09-12T17:13:59.377 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:59.375+0000 7fb11dd25800 20 remove_watcher() i=4 2024-09-12T17:13:59.378 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:59.376+0000 7fb11dd25800 20 remove_watcher() i=5 2024-09-12T17:13:59.379 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:59.377+0000 7fb11dd25800 20 remove_watcher() i=6 2024-09-12T17:13:59.380 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:59.378+0000 7fb11dd25800 20 remove_watcher() i=7 2024-09-12T17:13:59.531 INFO:tasks.workunit.client.0.smithi037.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T17:13:59.533 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bi list --bucket check-bucket --object f 2024-09-12T17:13:59.564 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:13:59.564 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:13:59.604 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:59.602+0000 7f0a81c15800 20 rados->read ofs=0 len=0 2024-09-12T17:13:59.606 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:59.603+0000 7f0a81c15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:59.606 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:59.603+0000 7f0a81c15800 20 realm 2024-09-12T17:13:59.606 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:59.603+0000 7f0a81c15800 20 rados->read ofs=0 len=0 2024-09-12T17:13:59.606 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:59.604+0000 7f0a81c15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:59.606 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:59.604+0000 7f0a81c15800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:13:59.606 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:59.604+0000 7f0a81c15800 20 rados->read ofs=0 len=0 2024-09-12T17:13:59.606 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:59.604+0000 7f0a81c15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:59.607 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:59.604+0000 7f0a81c15800 20 rados->read ofs=0 len=0 2024-09-12T17:13:59.607 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:59.605+0000 7f0a81c15800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:13:59.607 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:59.605+0000 7f0a81c15800 20 rados->read ofs=0 len=0 2024-09-12T17:13:59.607 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:59.605+0000 7f0a81c15800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:13:59.608 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:59.605+0000 7f0a81c15800 20 searching for the correct realm 2024-09-12T17:13:59.610 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:59.608+0000 7f0a7cb91640 0 -- 172.21.15.37:0/1755735113 >> [v2:172.21.15.40:6800/2441293461,v1:172.21.15.40:6801/2441293461] conn(0x7f0a70080040 msgr2=0x7f0a7008d410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:13:59.817 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:13:59.814+0000 7f0a7d392640 0 -- 172.21.15.37:0/1755735113 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7f0a7406b270 msgr2=0x7f0a7407a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:14:00.023 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:00.021+0000 7f0a81c15800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:14:00.024 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:00.021+0000 7f0a81c15800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:14:00.024 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:00.021+0000 7f0a81c15800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:14:00.024 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:00.021+0000 7f0a81c15800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:14:00.024 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:00.021+0000 7f0a81c15800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:14:00.024 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:00.021+0000 7f0a81c15800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:14:00.024 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:00.021+0000 7f0a81c15800 20 rados->read ofs=0 len=0 2024-09-12T17:14:00.024 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:00.021+0000 7f0a81c15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:00.024 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:00.022+0000 7f0a81c15800 20 rados->read ofs=0 len=0 2024-09-12T17:14:00.025 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:00.022+0000 7f0a81c15800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:14:00.026 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:00.022+0000 7f0a81c15800 20 rados->read ofs=0 len=0 2024-09-12T17:14:00.026 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:00.022+0000 7f0a81c15800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:14:00.026 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:00.022+0000 7f0a81c15800 20 zone default found 2024-09-12T17:14:00.026 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:00.022+0000 7f0a81c15800 4 Realm: () 2024-09-12T17:14:00.026 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:00.022+0000 7f0a81c15800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:14:00.026 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:00.022+0000 7f0a81c15800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:14:00.026 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:00.022+0000 7f0a81c15800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:14:00.026 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:00.022+0000 7f0a81c15800 20 zonegroup default 2024-09-12T17:14:00.026 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:00.022+0000 7f0a81c15800 20 rados->read ofs=0 len=0 2024-09-12T17:14:00.026 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:00.023+0000 7f0a81c15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:00.026 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:00.023+0000 7f0a81c15800 20 rados->read ofs=0 len=0 2024-09-12T17:14:00.026 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:00.023+0000 7f0a81c15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:00.026 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:00.023+0000 7f0a81c15800 20 rados->read ofs=0 len=0 2024-09-12T17:14:00.027 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:00.023+0000 7f0a81c15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:00.027 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:00.024+0000 7f0a81c15800 20 started sync module instance, tier type = 2024-09-12T17:14:00.027 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:00.024+0000 7f0a81c15800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:14:00.042 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:00.040+0000 7f0a81c15800 20 add_watcher() i=0 2024-09-12T17:14:00.043 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:00.040+0000 7f0a81c15800 20 add_watcher() i=1 2024-09-12T17:14:00.043 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:00.040+0000 7f0a81c15800 20 add_watcher() i=2 2024-09-12T17:14:00.043 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:00.040+0000 7f0a81c15800 20 add_watcher() i=3 2024-09-12T17:14:00.043 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:00.040+0000 7f0a81c15800 20 add_watcher() i=4 2024-09-12T17:14:00.043 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:00.040+0000 7f0a81c15800 20 add_watcher() i=5 2024-09-12T17:14:00.043 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:00.040+0000 7f0a81c15800 20 add_watcher() i=6 2024-09-12T17:14:00.045 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:00.043+0000 7f0a81c15800 20 add_watcher() i=7 2024-09-12T17:14:00.045 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:00.043+0000 7f0a81c15800 2 all 8 watchers are set, enabling cache 2024-09-12T17:14:00.047 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:00.045+0000 7f09337e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:14:00.048 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:00.045+0000 7f0a81c15800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:14:00.048 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:00.045+0000 7f0a81c15800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:14:00.048 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:00.045+0000 7f0a81c15800 5 note: GC not initialized 2024-09-12T17:14:00.048 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:00.046+0000 7f09327e4640 20 reqs_thread_entry: start 2024-09-12T17:14:00.048 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:00.046+0000 7f0a81c15800 20 init_complete bucket index max shards: 11 2024-09-12T17:14:00.048 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:00.046+0000 7f0a81c15800 20 Filter name: none 2024-09-12T17:14:00.048 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:00.046+0000 7f08a3fff640 20 reqs_thread_entry: start 2024-09-12T17:14:00.048 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:00.046+0000 7f0a81c15800 20 rados->read ofs=0 len=0 2024-09-12T17:14:00.049 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:00.046+0000 7f0a81c15800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:14:00.049 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:00.046+0000 7f0a81c15800 20 rados->read ofs=0 len=0 2024-09-12T17:14:00.049 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:00.047+0000 7f0a81c15800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:14:00.049 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:00.047+0000 7f0a81c15800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:14:00.049 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:00.047+0000 7f0a81c15800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T17:14:00.050 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:00.047+0000 7f0a81c15800 20 INFO: main: starting shard=0 2024-09-12T17:14:00.050 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:00.047+0000 7f0a81c15800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.0 2024-09-12T17:14:00.050 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:00.048+0000 7f0a81c15800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:14:00.050 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:00.048+0000 7f0a81c15800 20 INFO: main: starting shard=1 2024-09-12T17:14:00.050 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:00.048+0000 7f0a81c15800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.1 2024-09-12T17:14:00.051 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:00.049+0000 7f0a81c15800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:14:00.051 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:00.049+0000 7f0a81c15800 20 INFO: main: starting shard=2 2024-09-12T17:14:00.051 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:00.049+0000 7f0a81c15800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.2 2024-09-12T17:14:00.052 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:00.050+0000 7f0a81c15800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:14:00.052 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:00.050+0000 7f0a81c15800 20 INFO: main: starting shard=3 2024-09-12T17:14:00.052 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:00.050+0000 7f0a81c15800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.3 2024-09-12T17:14:00.052 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:00.050+0000 7f0a81c15800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:14:00.052 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:00.050+0000 7f0a81c15800 20 INFO: main: starting shard=4 2024-09-12T17:14:00.052 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:00.050+0000 7f0a81c15800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.4 2024-09-12T17:14:00.053 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:00.051+0000 7f0a81c15800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:14:00.053 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:00.051+0000 7f0a81c15800 20 INFO: main: starting shard=5 2024-09-12T17:14:00.053 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:00.051+0000 7f0a81c15800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.5 2024-09-12T17:14:00.053 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:00.051+0000 7f0a81c15800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:14:00.053 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:00.051+0000 7f0a81c15800 20 INFO: main: starting shard=6 2024-09-12T17:14:00.054 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:00.051+0000 7f0a81c15800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.6 2024-09-12T17:14:00.054 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:00.052+0000 7f0a81c15800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:14:00.054 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:00.052+0000 7f0a81c15800 20 INFO: main: starting shard=7 2024-09-12T17:14:00.054 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:00.052+0000 7f0a81c15800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.7 2024-09-12T17:14:00.055 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:00.053+0000 7f0a81c15800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:14:00.055 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:00.053+0000 7f0a81c15800 20 INFO: main: starting shard=8 2024-09-12T17:14:00.055 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:00.053+0000 7f0a81c15800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.8 2024-09-12T17:14:00.055 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:00.054+0000 7f0a81c15800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:14:00.056 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:00.054+0000 7f0a81c15800 20 INFO: main: starting shard=9 2024-09-12T17:14:00.056 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:00.054+0000 7f0a81c15800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.9 2024-09-12T17:14:00.056 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:00.054+0000 7f0a81c15800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:14:00.056 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:00.054+0000 7f0a81c15800 20 INFO: main: starting shard=10 2024-09-12T17:14:00.056 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:00.054+0000 7f0a81c15800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.10 2024-09-12T17:14:00.057 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:00.055+0000 7f0a81c15800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T17:14:00.057 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:00.055+0000 7f0a81c15800 20 INFO: main: done 2024-09-12T17:14:00.058 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:00.056+0000 7f09337e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:14:00.061 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:00.059+0000 7f0a81c15800 20 remove_watcher() i=0 2024-09-12T17:14:00.061 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:00.059+0000 7f0a81c15800 2 removed watcher, disabling cache 2024-09-12T17:14:00.063 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:00.061+0000 7f0a81c15800 20 remove_watcher() i=1 2024-09-12T17:14:00.064 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:00.062+0000 7f0a81c15800 20 remove_watcher() i=2 2024-09-12T17:14:00.066 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:00.063+0000 7f0a81c15800 20 remove_watcher() i=3 2024-09-12T17:14:00.066 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:00.064+0000 7f0a81c15800 20 remove_watcher() i=4 2024-09-12T17:14:00.067 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:00.066+0000 7f0a81c15800 20 remove_watcher() i=5 2024-09-12T17:14:00.070 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:00.068+0000 7f0a81c15800 20 remove_watcher() i=6 2024-09-12T17:14:00.071 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:00.070+0000 7f0a81c15800 20 remove_watcher() i=7 2024-09-12T17:14:00.111 INFO:tasks.workunit.client.0.smithi037.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-12T17:14:00.529 INFO:tasks.workunit.client.0.smithi037.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-09-12T17:14:00.951 INFO:tasks.workunit.client.0.smithi037.stderr:TEST: bucket check unlinked finds unlistable entries 2024-09-12T17:14:00.951 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:14:00.952 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-09-12T17:14:00.987 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:14:00.987 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:14:01.027 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.025+0000 7fb2e1814800 20 rados->read ofs=0 len=0 2024-09-12T17:14:01.029 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.027+0000 7fb2e1814800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:01.029 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.027+0000 7fb2e1814800 20 realm 2024-09-12T17:14:01.029 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.027+0000 7fb2e1814800 20 rados->read ofs=0 len=0 2024-09-12T17:14:01.029 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.027+0000 7fb2e1814800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:01.029 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.027+0000 7fb2e1814800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:14:01.030 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.027+0000 7fb2e1814800 20 rados->read ofs=0 len=0 2024-09-12T17:14:01.030 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.027+0000 7fb2e1814800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:01.030 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.027+0000 7fb2e1814800 20 rados->read ofs=0 len=0 2024-09-12T17:14:01.032 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.028+0000 7fb2e1814800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:14:01.032 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.028+0000 7fb2e1814800 20 rados->read ofs=0 len=0 2024-09-12T17:14:01.032 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.029+0000 7fb2e1814800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:14:01.032 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.029+0000 7fb2e1814800 20 searching for the correct realm 2024-09-12T17:14:01.034 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.032+0000 7fb2dd6cc640 0 -- 172.21.15.37:0/2522884432 >> [v2:172.21.15.37:6824/3990661154,v1:172.21.15.37:6825/3990661154] conn(0x55b975bee120 msgr2=0x55b975bf0590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:14:01.038 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.037+0000 7fb2dcecb640 0 -- 172.21.15.37:0/2522884432 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7fb2d008a040 msgr2=0x7fb2d0066be0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:14:01.043 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.041+0000 7fb2e1814800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:14:01.043 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.041+0000 7fb2e1814800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:14:01.043 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.041+0000 7fb2e1814800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:14:01.043 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.041+0000 7fb2e1814800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:14:01.043 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.041+0000 7fb2e1814800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:14:01.044 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.041+0000 7fb2e1814800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:14:01.044 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.041+0000 7fb2e1814800 20 rados->read ofs=0 len=0 2024-09-12T17:14:01.045 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.042+0000 7fb2e1814800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:01.045 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.042+0000 7fb2e1814800 20 rados->read ofs=0 len=0 2024-09-12T17:14:01.045 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.042+0000 7fb2e1814800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:14:01.045 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.042+0000 7fb2e1814800 20 rados->read ofs=0 len=0 2024-09-12T17:14:01.045 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.042+0000 7fb2e1814800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:14:01.045 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.042+0000 7fb2e1814800 20 zone default found 2024-09-12T17:14:01.045 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.042+0000 7fb2e1814800 4 Realm: () 2024-09-12T17:14:01.045 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.042+0000 7fb2e1814800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:14:01.045 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.042+0000 7fb2e1814800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:14:01.045 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.042+0000 7fb2e1814800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:14:01.046 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.042+0000 7fb2e1814800 20 zonegroup default 2024-09-12T17:14:01.046 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.042+0000 7fb2e1814800 20 rados->read ofs=0 len=0 2024-09-12T17:14:01.046 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.043+0000 7fb2e1814800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:01.046 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.043+0000 7fb2e1814800 20 rados->read ofs=0 len=0 2024-09-12T17:14:01.046 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.043+0000 7fb2e1814800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:01.046 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.043+0000 7fb2e1814800 20 rados->read ofs=0 len=0 2024-09-12T17:14:01.046 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.043+0000 7fb2e1814800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:01.046 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.043+0000 7fb2e1814800 20 started sync module instance, tier type = 2024-09-12T17:14:01.047 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.043+0000 7fb2e1814800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:14:01.063 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.061+0000 7fb2e1814800 20 add_watcher() i=0 2024-09-12T17:14:01.063 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.061+0000 7fb2e1814800 20 add_watcher() i=1 2024-09-12T17:14:01.063 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.061+0000 7fb2e1814800 20 add_watcher() i=2 2024-09-12T17:14:01.063 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.061+0000 7fb2e1814800 20 add_watcher() i=3 2024-09-12T17:14:01.063 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.061+0000 7fb2e1814800 20 add_watcher() i=4 2024-09-12T17:14:01.063 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.061+0000 7fb2e1814800 20 add_watcher() i=5 2024-09-12T17:14:01.065 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.063+0000 7fb2e1814800 20 add_watcher() i=6 2024-09-12T17:14:01.065 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.063+0000 7fb2e1814800 20 add_watcher() i=7 2024-09-12T17:14:01.065 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.063+0000 7fb2e1814800 2 all 8 watchers are set, enabling cache 2024-09-12T17:14:01.067 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.065+0000 7fb192fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:14:01.068 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.065+0000 7fb2e1814800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:14:01.068 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.065+0000 7fb2e1814800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:14:01.068 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.065+0000 7fb2e1814800 5 note: GC not initialized 2024-09-12T17:14:01.068 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.065+0000 7fb191fe3640 20 reqs_thread_entry: start 2024-09-12T17:14:01.068 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.065+0000 7fb2e1814800 20 init_complete bucket index max shards: 11 2024-09-12T17:14:01.068 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.065+0000 7fb2e1814800 20 Filter name: none 2024-09-12T17:14:01.068 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.066+0000 7fb1037fe640 20 reqs_thread_entry: start 2024-09-12T17:14:01.068 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.066+0000 7fb2e1814800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T17:14:01.068 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.066+0000 7fb2e1814800 20 rados->read ofs=0 len=0 2024-09-12T17:14:01.069 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.066+0000 7fb2e1814800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:14:01.069 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.066+0000 7fb2e1814800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T17:14:01.069 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.066+0000 7fb2e1814800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T17:14:01.069 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.066+0000 7fb2e1814800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2 : miss 2024-09-12T17:14:01.069 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.066+0000 7fb2e1814800 20 rados->read ofs=0 len=0 2024-09-12T17:14:01.070 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.066+0000 7fb2e1814800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:14:01.070 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.066+0000 7fb2e1814800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2 info.flags=0x17 2024-09-12T17:14:01.070 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.066+0000 7fb2e1814800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2 to cache LRU end 2024-09-12T17:14:01.070 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.066+0000 7fb2e1814800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:14:01.070 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.066+0000 7fb2e1814800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T17:14:01.070 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.066+0000 7fb2e1814800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2 2024-09-12T17:14:01.070 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.067+0000 7fb2e1814800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.0 2024-09-12T17:14:01.070 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.067+0000 7fb2e1814800 1 NOTICE: finished shard 0 (0 entries found) 2024-09-12T17:14:01.070 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.067+0000 7fb2e1814800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.1 2024-09-12T17:14:01.071 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.068+0000 7fb2e1814800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.2 2024-09-12T17:14:01.071 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.068+0000 7fb2e1814800 1 NOTICE: finished shard 2 (0 entries found) 2024-09-12T17:14:01.071 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.068+0000 7fb2e1814800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.3 2024-09-12T17:14:01.071 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.069+0000 7fb2e1814800 1 NOTICE: finished shard 3 (0 entries found) 2024-09-12T17:14:01.071 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.069+0000 7fb2e1814800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.4 2024-09-12T17:14:01.072 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.070+0000 7fb2e1814800 1 NOTICE: finished shard 4 (0 entries found) 2024-09-12T17:14:01.072 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.070+0000 7fb2e1814800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.5 2024-09-12T17:14:01.072 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.070+0000 7fb2e1814800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.6 2024-09-12T17:14:01.073 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.071+0000 7fb2e1814800 1 NOTICE: finished shard 6 (0 entries found) 2024-09-12T17:14:01.073 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.071+0000 7fb2e1814800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.7 2024-09-12T17:14:01.073 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.071+0000 7fb2e1814800 1 NOTICE: finished shard 7 (0 entries found) 2024-09-12T17:14:01.073 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.071+0000 7fb2e1814800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.8 2024-09-12T17:14:01.074 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.072+0000 7fb2e1814800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.9 2024-09-12T17:14:01.075 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.073+0000 7fb2e1814800 1 NOTICE: finished shard 9 (0 entries found) 2024-09-12T17:14:01.075 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.073+0000 7fb2e1814800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.10 2024-09-12T17:14:01.075 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.073+0000 7fb2e1814800 1 NOTICE: finished shard 1 (1 entries found) 2024-09-12T17:14:01.075 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.073+0000 7fb2e1814800 1 NOTICE: finished shard 5 (1 entries found) 2024-09-12T17:14:01.076 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.073+0000 7fb2e1814800 1 NOTICE: finished shard 8 (1 entries found) 2024-09-12T17:14:01.076 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.074+0000 7fb2e1814800 1 NOTICE: finished shard 10 (1 entries found) 2024-09-12T17:14:01.076 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.074+0000 7fb2e1814800 1 NOTICE: finished all shards (4 entries found) 2024-09-12T17:14:01.076 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.075+0000 7fb192fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:14:01.079 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.077+0000 7fb2e1814800 20 remove_watcher() i=0 2024-09-12T17:14:01.079 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.077+0000 7fb2e1814800 2 removed watcher, disabling cache 2024-09-12T17:14:01.080 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.078+0000 7fb2e1814800 20 remove_watcher() i=1 2024-09-12T17:14:01.081 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.079+0000 7fb2e1814800 20 remove_watcher() i=2 2024-09-12T17:14:01.082 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.080+0000 7fb2e1814800 20 remove_watcher() i=3 2024-09-12T17:14:01.083 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.081+0000 7fb2e1814800 20 remove_watcher() i=4 2024-09-12T17:14:01.084 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.082+0000 7fb2e1814800 20 remove_watcher() i=5 2024-09-12T17:14:01.085 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.083+0000 7fb2e1814800 20 remove_watcher() i=6 2024-09-12T17:14:01.086 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.085+0000 7fb2e1814800 20 remove_watcher() i=7 2024-09-12T17:14:01.098 INFO:tasks.workunit.client.0.smithi037.stderr:TEST: unlinked entries are not listable 2024-09-12T17:14:01.098 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:14:01.220 INFO:tasks.workunit.client.0.smithi037.stderr:TEST: GET returns 404 for unlinked entry keys that have no other versions 2024-09-12T17:14:01.220 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:14:01.351 INFO:tasks.workunit.client.0.smithi037.stderr:TEST: bucket check unlinked fixes unlistable entries 2024-09-12T17:14:01.351 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:14:01.353 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-12T17:14:01.390 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:14:01.390 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:14:01.430 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.427+0000 7f2d02b46800 20 rados->read ofs=0 len=0 2024-09-12T17:14:01.431 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.429+0000 7f2d02b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:01.431 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.429+0000 7f2d02b46800 20 realm 2024-09-12T17:14:01.431 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.429+0000 7f2d02b46800 20 rados->read ofs=0 len=0 2024-09-12T17:14:01.431 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.429+0000 7f2d02b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:01.431 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.429+0000 7f2d02b46800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:14:01.431 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.429+0000 7f2d02b46800 20 rados->read ofs=0 len=0 2024-09-12T17:14:01.431 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.429+0000 7f2d02b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:01.431 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.429+0000 7f2d02b46800 20 rados->read ofs=0 len=0 2024-09-12T17:14:01.432 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.430+0000 7f2d02b46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:14:01.432 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.430+0000 7f2d02b46800 20 rados->read ofs=0 len=0 2024-09-12T17:14:01.432 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.430+0000 7f2d02b46800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:14:01.433 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.430+0000 7f2d02b46800 20 searching for the correct realm 2024-09-12T17:14:01.436 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.434+0000 7f2d00e31640 0 -- 172.21.15.37:0/1715340042 >> [v2:172.21.15.37:6824/3990661154,v1:172.21.15.37:6825/3990661154] conn(0x5637120c96c0 msgr2=0x5637120cbaf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:14:01.440 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.438+0000 7f2d00630640 0 -- 172.21.15.37:0/1715340042 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7f2ce8008420 msgr2=0x7f2ce80088a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:14:01.444 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.442+0000 7f2d02b46800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:14:01.445 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.442+0000 7f2d02b46800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:14:01.445 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.442+0000 7f2d02b46800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:14:01.445 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.442+0000 7f2d02b46800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:14:01.445 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.442+0000 7f2d02b46800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:14:01.445 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.442+0000 7f2d02b46800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:14:01.445 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.442+0000 7f2d02b46800 20 rados->read ofs=0 len=0 2024-09-12T17:14:01.445 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.442+0000 7f2d02b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:01.445 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.442+0000 7f2d02b46800 20 rados->read ofs=0 len=0 2024-09-12T17:14:01.445 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.443+0000 7f2d02b46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:14:01.445 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.443+0000 7f2d02b46800 20 rados->read ofs=0 len=0 2024-09-12T17:14:01.446 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.443+0000 7f2d02b46800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:14:01.447 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.443+0000 7f2d02b46800 20 zone default found 2024-09-12T17:14:01.447 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.443+0000 7f2d02b46800 4 Realm: () 2024-09-12T17:14:01.447 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.443+0000 7f2d02b46800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:14:01.447 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.443+0000 7f2d02b46800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:14:01.447 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.443+0000 7f2d02b46800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:14:01.447 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.443+0000 7f2d02b46800 20 zonegroup default 2024-09-12T17:14:01.447 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.443+0000 7f2d02b46800 20 rados->read ofs=0 len=0 2024-09-12T17:14:01.447 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.443+0000 7f2d02b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:01.447 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.443+0000 7f2d02b46800 20 rados->read ofs=0 len=0 2024-09-12T17:14:01.447 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.444+0000 7f2d02b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:01.447 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.444+0000 7f2d02b46800 20 rados->read ofs=0 len=0 2024-09-12T17:14:01.448 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.444+0000 7f2d02b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:01.448 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.444+0000 7f2d02b46800 20 started sync module instance, tier type = 2024-09-12T17:14:01.448 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.444+0000 7f2d02b46800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:14:01.460 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.457+0000 7f2d02b46800 20 add_watcher() i=0 2024-09-12T17:14:01.460 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.457+0000 7f2d02b46800 20 add_watcher() i=1 2024-09-12T17:14:01.460 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.457+0000 7f2d02b46800 20 add_watcher() i=2 2024-09-12T17:14:01.460 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.457+0000 7f2d02b46800 20 add_watcher() i=3 2024-09-12T17:14:01.460 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.457+0000 7f2d02b46800 20 add_watcher() i=4 2024-09-12T17:14:01.460 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.457+0000 7f2d02b46800 20 add_watcher() i=5 2024-09-12T17:14:01.460 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.457+0000 7f2d02b46800 20 add_watcher() i=6 2024-09-12T17:14:01.462 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.460+0000 7f2d02b46800 20 add_watcher() i=7 2024-09-12T17:14:01.462 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.460+0000 7f2d02b46800 2 all 8 watchers are set, enabling cache 2024-09-12T17:14:01.464 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.462+0000 7f2bb6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:14:01.466 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.463+0000 7f2d02b46800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:14:01.466 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.463+0000 7f2d02b46800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:14:01.466 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.463+0000 7f2d02b46800 5 note: GC not initialized 2024-09-12T17:14:01.467 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.463+0000 7f2bb5fdb640 20 reqs_thread_entry: start 2024-09-12T17:14:01.467 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.463+0000 7f2d02b46800 20 init_complete bucket index max shards: 11 2024-09-12T17:14:01.467 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.463+0000 7f2d02b46800 20 Filter name: none 2024-09-12T17:14:01.467 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.463+0000 7f2b277fe640 20 reqs_thread_entry: start 2024-09-12T17:14:01.467 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.463+0000 7f2d02b46800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T17:14:01.467 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.463+0000 7f2d02b46800 20 rados->read ofs=0 len=0 2024-09-12T17:14:01.467 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.464+0000 7f2d02b46800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:14:01.467 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.464+0000 7f2d02b46800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T17:14:01.467 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.464+0000 7f2d02b46800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T17:14:01.467 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.464+0000 7f2d02b46800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2 : miss 2024-09-12T17:14:01.468 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.464+0000 7f2d02b46800 20 rados->read ofs=0 len=0 2024-09-12T17:14:01.468 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.464+0000 7f2d02b46800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:14:01.468 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.464+0000 7f2d02b46800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2 info.flags=0x17 2024-09-12T17:14:01.468 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.464+0000 7f2d02b46800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2 to cache LRU end 2024-09-12T17:14:01.468 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.464+0000 7f2d02b46800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:14:01.468 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.464+0000 7f2d02b46800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T17:14:01.468 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.464+0000 7f2d02b46800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2 2024-09-12T17:14:01.468 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.464+0000 7f2d02b46800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.0 2024-09-12T17:14:01.469 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.465+0000 7f2d02b46800 1 NOTICE: finished shard 0 (0 entries removed) 2024-09-12T17:14:01.469 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.465+0000 7f2d02b46800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.1 2024-09-12T17:14:01.469 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.465+0000 7f2d02b46800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.2 2024-09-12T17:14:01.469 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.466+0000 7f2d02b46800 1 NOTICE: finished shard 2 (0 entries removed) 2024-09-12T17:14:01.469 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.466+0000 7f2d02b46800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.3 2024-09-12T17:14:01.469 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.467+0000 7f2d02b46800 1 NOTICE: finished shard 3 (0 entries removed) 2024-09-12T17:14:01.469 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.467+0000 7f2d02b46800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.4 2024-09-12T17:14:01.470 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.467+0000 7f2d02b46800 1 NOTICE: finished shard 4 (0 entries removed) 2024-09-12T17:14:01.470 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.467+0000 7f2d02b46800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.5 2024-09-12T17:14:01.470 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.468+0000 7f2d02b46800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.6 2024-09-12T17:14:01.470 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.468+0000 7f2d02b46800 1 NOTICE: finished shard 6 (0 entries removed) 2024-09-12T17:14:01.470 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.468+0000 7f2d02b46800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.7 2024-09-12T17:14:01.471 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.469+0000 7f2d02b46800 1 NOTICE: finished shard 7 (0 entries removed) 2024-09-12T17:14:01.471 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.469+0000 7f2d02b46800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.8 2024-09-12T17:14:01.472 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.470+0000 7f2d02b46800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.9 2024-09-12T17:14:01.472 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.470+0000 7f2d02b46800 1 NOTICE: finished shard 9 (0 entries removed) 2024-09-12T17:14:01.472 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.470+0000 7f2d02b46800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.10 2024-09-12T17:14:01.473 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.471+0000 7f2d02b46800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.1 2024-09-12T17:14:01.473 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.472+0000 7f2d02b46800 20 get_obj_state: octx=0x563711e3f190 obj=check-bucket:e state=0x563712105658 s->prefetch_data=0 2024-09-12T17:14:01.474 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.472+0000 7f2d02b46800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.5 2024-09-12T17:14:01.474 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.472+0000 7f2d02b46800 20 get_obj_state: octx=0x563711e67cb0 obj=check-bucket:d state=0x563712102b88 s->prefetch_data=0 2024-09-12T17:14:01.474 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.472+0000 7f2d02b46800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.8 2024-09-12T17:14:01.474 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.472+0000 7f2d02b46800 20 get_obj_state: octx=0x5637121025b0 obj=check-bucket:c state=0x563712106f78 s->prefetch_data=0 2024-09-12T17:14:01.475 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.472+0000 7f2d02b46800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.10 2024-09-12T17:14:01.475 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.473+0000 7f2d02b46800 20 get_obj_state: octx=0x563712104e10 obj=check-bucket:f state=0x5637121a1a58 s->prefetch_data=0 2024-09-12T17:14:01.475 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.473+0000 7f2d02b46800 20 get_obj_state: setting s->obj_tag to 093dz3zuoqaakhw63nsj1xs7geptf2g7 2024-09-12T17:14:01.476 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.473+0000 7f2d02b46800 20 get_obj_state_impl: setting s->olh_tag to 949bsimtw6nnt0k51ho19sba0zi78gft 2024-09-12T17:14:01.476 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.473+0000 7f2d02b46800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=949bsimtw6nnt0k51ho19sba0zi78gft 2024-09-12T17:14:01.476 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.473+0000 7f2d02b46800 20 get_obj_state: setting s->obj_tag to q3vmtj0q63nejoejzayhwqebxs6caccp 2024-09-12T17:14:01.476 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.473+0000 7f2d02b46800 20 get_obj_state_impl: setting s->olh_tag to o7ymm23te4db4z6zegcvgi4jg6mt6u9o 2024-09-12T17:14:01.476 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.473+0000 7f2d02b46800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=o7ymm23te4db4z6zegcvgi4jg6mt6u9o 2024-09-12T17:14:01.476 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.473+0000 7f2d02b46800 20 get_obj_state: setting s->obj_tag to 7s2ccz0b9x2zvpne2npw6zkbnv1knxwx 2024-09-12T17:14:01.476 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.473+0000 7f2d02b46800 20 get_obj_state_impl: setting s->olh_tag to w3uys5lxsfuehltotgdse33gelais8ol 2024-09-12T17:14:01.476 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.473+0000 7f2d02b46800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=w3uys5lxsfuehltotgdse33gelais8ol 2024-09-12T17:14:01.476 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.473+0000 7f2d02b46800 20 get_obj_state: setting s->obj_tag to 42m9mrqe1eauow3wckuvvoks3thqy5tp 2024-09-12T17:14:01.476 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.473+0000 7f2d02b46800 20 get_obj_state_impl: setting s->olh_tag to 9fv6g67imc3l3h3peve0wawx8ihbc5q2 2024-09-12T17:14:01.476 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.473+0000 7f2d02b46800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=9fv6g67imc3l3h3peve0wawx8ihbc5q2 2024-09-12T17:14:01.477 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.475+0000 7f2d02b46800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.5 2024-09-12T17:14:01.477 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.475+0000 7f2d02b46800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.1 2024-09-12T17:14:01.479 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.477+0000 7f2d02b46800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.10 2024-09-12T17:14:01.479 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.477+0000 7f2d02b46800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.8 2024-09-12T17:14:01.481 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.479+0000 7f2d02b46800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.8 2024-09-12T17:14:01.481 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.479+0000 7f2d02b46800 20 olh_log_entry: epoch=3 op=3 key=c[8fAhfC3XXneaZzzNz2gx.CBwUAVgSaY] 2024-09-12T17:14:01.481 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.479+0000 7f2d02b46800 20 get_obj_state: octx=0x5637121025b0 obj=check-bucket:_:8fAhfC3XXneaZzzNz2gx.CBwUAVgSaY_c state=0x5637121bcf28 s->prefetch_data=0 2024-09-12T17:14:01.483 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.480+0000 7f2d02b46800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.1 2024-09-12T17:14:01.483 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.480+0000 7f2d02b46800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.5 2024-09-12T17:14:01.483 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.480+0000 7f2d02b46800 10 manifest: total_size = 22 2024-09-12T17:14:01.483 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.480+0000 7f2d02b46800 20 get_obj_state: setting s->obj_tag to 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.9566490590361861543 2024-09-12T17:14:01.483 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.480+0000 7f2d02b46800 20 get_obj_state: octx=0x5637121025b0 obj=check-bucket:_:8fAhfC3XXneaZzzNz2gx.CBwUAVgSaY_c state=0x5637121bcf28 s->prefetch_data=0 2024-09-12T17:14:01.483 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.480+0000 7f2d02b46800 20 prepare_atomic_modification: state is not atomic. state=0x5637121bcf28 2024-09-12T17:14:01.483 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.480+0000 7f2d02b46800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.8 2024-09-12T17:14:01.483 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.480+0000 7f2d02b46800 20 olh_log_entry: epoch=2 op=2 key=e[] 2024-09-12T17:14:01.483 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.480+0000 7f2d02b46800 20 olh_log_entry: epoch=2 op=3 key=e[p5czJEMPeixarFzBSCJYH6jE.inI.wG] 2024-09-12T17:14:01.483 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.480+0000 7f2d02b46800 20 get_obj_state: octx=0x563711e3f190 obj=check-bucket:_:p5czJEMPeixarFzBSCJYH6jE.inI.wG_e state=0x5637121c4958 s->prefetch_data=0 2024-09-12T17:14:01.483 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.480+0000 7f2d02b46800 20 olh_log_entry: epoch=3 op=3 key=d[50w1sPwphMesxxS5uIqruVfktILLF8M] 2024-09-12T17:14:01.484 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.480+0000 7f2d02b46800 20 get_obj_state: octx=0x563711e67cb0 obj=check-bucket:_:50w1sPwphMesxxS5uIqruVfktILLF8M_d state=0x5637121a7668 s->prefetch_data=0 2024-09-12T17:14:01.484 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.481+0000 7f2d02b46800 10 manifest: total_size = 9 2024-09-12T17:14:01.484 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.481+0000 7f2d02b46800 20 get_obj_state: setting s->obj_tag to 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.17290491380895689515 2024-09-12T17:14:01.484 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.481+0000 7f2d02b46800 20 get_obj_state: octx=0x563711e3f190 obj=check-bucket:_:p5czJEMPeixarFzBSCJYH6jE.inI.wG_e state=0x5637121c4958 s->prefetch_data=0 2024-09-12T17:14:01.484 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.481+0000 7f2d02b46800 20 prepare_atomic_modification: state is not atomic. state=0x5637121c4958 2024-09-12T17:14:01.484 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.481+0000 7f2d02b46800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.1 2024-09-12T17:14:01.484 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.481+0000 7f2d02b46800 10 manifest: total_size = 12 2024-09-12T17:14:01.484 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.481+0000 7f2d02b46800 20 get_obj_state: setting s->obj_tag to 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2674043529414321300 2024-09-12T17:14:01.484 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.481+0000 7f2d02b46800 20 get_obj_state: octx=0x563711e67cb0 obj=check-bucket:_:50w1sPwphMesxxS5uIqruVfktILLF8M_d state=0x5637121a7668 s->prefetch_data=0 2024-09-12T17:14:01.484 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.481+0000 7f2d02b46800 20 prepare_atomic_modification: state is not atomic. state=0x5637121a7668 2024-09-12T17:14:01.484 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.481+0000 7f2d02b46800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.5 2024-09-12T17:14:01.487 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.485+0000 7f2d02b46800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.10 2024-09-12T17:14:01.488 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.486+0000 7f2d02b46800 20 olh_log_entry: epoch=2 op=2 key=f[] 2024-09-12T17:14:01.488 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.486+0000 7f2d02b46800 20 olh_log_entry: epoch=2 op=3 key=f[L-RKsJnlKTTjtNy8T30yTVvtxSPfuQi] 2024-09-12T17:14:01.488 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.486+0000 7f2d02b46800 20 get_obj_state: octx=0x563712104e10 obj=check-bucket:_:L-RKsJnlKTTjtNy8T30yTVvtxSPfuQi_f state=0x5637121d2de8 s->prefetch_data=0 2024-09-12T17:14:01.488 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.486+0000 7f2d02b46800 10 manifest: total_size = 22 2024-09-12T17:14:01.488 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.486+0000 7f2d02b46800 20 get_obj_state: setting s->obj_tag to 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.5267733684331243604 2024-09-12T17:14:01.488 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.486+0000 7f2d02b46800 20 get_obj_state: octx=0x563712104e10 obj=check-bucket:_:L-RKsJnlKTTjtNy8T30yTVvtxSPfuQi_f state=0x5637121d2de8 s->prefetch_data=0 2024-09-12T17:14:01.489 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.486+0000 7f2d02b46800 20 prepare_atomic_modification: state is not atomic. state=0x5637121d2de8 2024-09-12T17:14:01.489 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.486+0000 7f2d02b46800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.10 2024-09-12T17:14:01.493 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.491+0000 7f2bd6ffd640 20 handle_completion(): completion ok for obj=c[8fAhfC3XXneaZzzNz2gx.CBwUAVgSaY] 2024-09-12T17:14:01.493 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.492+0000 7f2bd6ffd640 20 handle_completion(): completion ok for obj=d[50w1sPwphMesxxS5uIqruVfktILLF8M] 2024-09-12T17:14:01.494 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.492+0000 7f2d02b46800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.5 2024-09-12T17:14:01.494 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.492+0000 7f2d02b46800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.5 2024-09-12T17:14:01.496 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.494+0000 7f2bd6ffd640 20 handle_completion(): completion ok for obj=e[p5czJEMPeixarFzBSCJYH6jE.inI.wG] 2024-09-12T17:14:01.499 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.497+0000 7f2d02b46800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.8 2024-09-12T17:14:01.499 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.497+0000 7f2d02b46800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.8 2024-09-12T17:14:01.499 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.497+0000 7f2d02b46800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.5 2024-09-12T17:14:01.500 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.497+0000 7f2d02b46800 1 NOTICE: finished shard 5 (1 entries removed) 2024-09-12T17:14:01.500 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.497+0000 7f2d02b46800 20 get_obj_state: octx=0x563711e3f190 obj=check-bucket:e state=0x563712105658 s->prefetch_data=0 2024-09-12T17:14:01.500 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.497+0000 7f2d02b46800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=949bsimtw6nnt0k51ho19sba0zi78gft 2024-09-12T17:14:01.501 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.499+0000 7f2d02b46800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.8 2024-09-12T17:14:01.501 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.499+0000 7f2d02b46800 1 NOTICE: finished shard 8 (1 entries removed) 2024-09-12T17:14:01.505 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.502+0000 7f2bd77fe640 20 handle_completion(): completion ok for obj=f[L-RKsJnlKTTjtNy8T30yTVvtxSPfuQi] 2024-09-12T17:14:01.505 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.502+0000 7f2d02b46800 20 get_obj_state: octx=0x563712104e10 obj=check-bucket:f state=0x5637121a1a58 s->prefetch_data=0 2024-09-12T17:14:01.505 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.502+0000 7f2d02b46800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=9fv6g67imc3l3h3peve0wawx8ihbc5q2 2024-09-12T17:14:01.510 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.508+0000 7f2d02b46800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.1 2024-09-12T17:14:01.512 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.511+0000 7f2d02b46800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.10 2024-09-12T17:14:01.513 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.511+0000 7f2d02b46800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.1 2024-09-12T17:14:01.513 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.511+0000 7f2d02b46800 1 NOTICE: finished shard 1 (1 entries removed) 2024-09-12T17:14:01.514 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.512+0000 7f2d02b46800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.10 2024-09-12T17:14:01.514 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.512+0000 7f2d02b46800 1 NOTICE: finished shard 10 (1 entries removed) 2024-09-12T17:14:01.514 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.512+0000 7f2d02b46800 1 NOTICE: finished all shards (4 entries removed) 2024-09-12T17:14:01.514 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.513+0000 7f2bb6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:14:01.517 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.515+0000 7f2d02b46800 20 remove_watcher() i=0 2024-09-12T17:14:01.517 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.515+0000 7f2d02b46800 2 removed watcher, disabling cache 2024-09-12T17:14:01.518 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.516+0000 7f2d02b46800 20 remove_watcher() i=1 2024-09-12T17:14:01.519 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.517+0000 7f2d02b46800 20 remove_watcher() i=2 2024-09-12T17:14:01.521 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.519+0000 7f2d02b46800 20 remove_watcher() i=3 2024-09-12T17:14:01.522 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.520+0000 7f2d02b46800 20 remove_watcher() i=4 2024-09-12T17:14:01.523 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.521+0000 7f2d02b46800 20 remove_watcher() i=5 2024-09-12T17:14:01.524 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.522+0000 7f2d02b46800 20 remove_watcher() i=6 2024-09-12T17:14:01.525 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.523+0000 7f2d02b46800 20 remove_watcher() i=7 2024-09-12T17:14:01.619 INFO:tasks.workunit.client.0.smithi037.stderr:TEST: bucket check unlinked does not affect normal entries 2024-09-12T17:14:01.619 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:14:01.794 INFO:tasks.workunit.client.0.smithi037.stderr:TEST: bucket check unlinked does not find new unlistable entries after fix 2024-09-12T17:14:01.794 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:14:01.795 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-09-12T17:14:01.829 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:14:01.829 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:14:01.869 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.867+0000 7f55f1325800 20 rados->read ofs=0 len=0 2024-09-12T17:14:01.871 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.868+0000 7f55f1325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:01.872 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.869+0000 7f55f1325800 20 realm 2024-09-12T17:14:01.872 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.869+0000 7f55f1325800 20 rados->read ofs=0 len=0 2024-09-12T17:14:01.872 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.869+0000 7f55f1325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:01.872 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.869+0000 7f55f1325800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:14:01.872 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.869+0000 7f55f1325800 20 rados->read ofs=0 len=0 2024-09-12T17:14:01.872 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.869+0000 7f55f1325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:01.872 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.869+0000 7f55f1325800 20 rados->read ofs=0 len=0 2024-09-12T17:14:01.873 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.870+0000 7f55f1325800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:14:01.873 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.870+0000 7f55f1325800 20 rados->read ofs=0 len=0 2024-09-12T17:14:01.873 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.870+0000 7f55f1325800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:14:01.873 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.870+0000 7f55f1325800 20 searching for the correct realm 2024-09-12T17:14:01.876 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:01.874+0000 7f55ed7af640 0 -- 172.21.15.37:0/2477283256 >> [v2:172.21.15.40:6818/1210108009,v1:172.21.15.40:6819/1210108009] conn(0x7f55e0043040 msgr2=0x7f55e0045440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:14:02.082 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.080+0000 7f55ecfae640 0 -- 172.21.15.37:0/2477283256 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7f55e0036910 msgr2=0x7f55e00403f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:14:02.288 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.286+0000 7f55f1325800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:14:02.289 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.286+0000 7f55f1325800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:14:02.289 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.286+0000 7f55f1325800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:14:02.289 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.286+0000 7f55f1325800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:14:02.289 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.286+0000 7f55f1325800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:14:02.289 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.286+0000 7f55f1325800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:14:02.289 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.286+0000 7f55f1325800 20 rados->read ofs=0 len=0 2024-09-12T17:14:02.289 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.286+0000 7f55f1325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:02.289 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.286+0000 7f55f1325800 20 rados->read ofs=0 len=0 2024-09-12T17:14:02.290 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.287+0000 7f55f1325800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:14:02.290 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.287+0000 7f55f1325800 20 rados->read ofs=0 len=0 2024-09-12T17:14:02.290 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.287+0000 7f55f1325800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:14:02.290 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.287+0000 7f55f1325800 20 zone default found 2024-09-12T17:14:02.290 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.287+0000 7f55f1325800 4 Realm: () 2024-09-12T17:14:02.290 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.287+0000 7f55f1325800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:14:02.290 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.287+0000 7f55f1325800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:14:02.290 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.287+0000 7f55f1325800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:14:02.290 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.287+0000 7f55f1325800 20 zonegroup default 2024-09-12T17:14:02.290 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.287+0000 7f55f1325800 20 rados->read ofs=0 len=0 2024-09-12T17:14:02.291 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.288+0000 7f55f1325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:02.291 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.288+0000 7f55f1325800 20 rados->read ofs=0 len=0 2024-09-12T17:14:02.291 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.288+0000 7f55f1325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:02.291 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.288+0000 7f55f1325800 20 rados->read ofs=0 len=0 2024-09-12T17:14:02.292 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.289+0000 7f55f1325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:02.292 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.289+0000 7f55f1325800 20 started sync module instance, tier type = 2024-09-12T17:14:02.292 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.289+0000 7f55f1325800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:14:02.305 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.303+0000 7f55f1325800 20 add_watcher() i=0 2024-09-12T17:14:02.305 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.303+0000 7f55f1325800 20 add_watcher() i=1 2024-09-12T17:14:02.305 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.303+0000 7f55f1325800 20 add_watcher() i=2 2024-09-12T17:14:02.305 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.303+0000 7f55f1325800 20 add_watcher() i=3 2024-09-12T17:14:02.305 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.303+0000 7f55f1325800 20 add_watcher() i=4 2024-09-12T17:14:02.306 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.303+0000 7f55f1325800 20 add_watcher() i=5 2024-09-12T17:14:02.306 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.303+0000 7f55f1325800 20 add_watcher() i=6 2024-09-12T17:14:02.306 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.304+0000 7f55f1325800 20 add_watcher() i=7 2024-09-12T17:14:02.306 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.304+0000 7f55f1325800 2 all 8 watchers are set, enabling cache 2024-09-12T17:14:02.309 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.307+0000 7f54a37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:14:02.310 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.307+0000 7f55f1325800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:14:02.310 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.307+0000 7f55f1325800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:14:02.310 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.307+0000 7f55f1325800 5 note: GC not initialized 2024-09-12T17:14:02.310 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.307+0000 7f54a27e4640 20 reqs_thread_entry: start 2024-09-12T17:14:02.310 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.308+0000 7f55f1325800 20 init_complete bucket index max shards: 11 2024-09-12T17:14:02.310 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.308+0000 7f55f1325800 20 Filter name: none 2024-09-12T17:14:02.310 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.308+0000 7f549b7fe640 20 reqs_thread_entry: start 2024-09-12T17:14:02.310 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.308+0000 7f55f1325800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T17:14:02.310 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.308+0000 7f55f1325800 20 rados->read ofs=0 len=0 2024-09-12T17:14:02.311 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.308+0000 7f55f1325800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:14:02.311 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.308+0000 7f55f1325800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T17:14:02.311 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.308+0000 7f55f1325800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T17:14:02.311 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.308+0000 7f55f1325800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2 : miss 2024-09-12T17:14:02.311 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.308+0000 7f55f1325800 20 rados->read ofs=0 len=0 2024-09-12T17:14:02.311 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.309+0000 7f55f1325800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:14:02.312 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.309+0000 7f55f1325800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2 info.flags=0x17 2024-09-12T17:14:02.312 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.309+0000 7f55f1325800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2 to cache LRU end 2024-09-12T17:14:02.312 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.309+0000 7f55f1325800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:14:02.312 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.309+0000 7f55f1325800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T17:14:02.312 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.309+0000 7f55f1325800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2 2024-09-12T17:14:02.312 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.309+0000 7f55f1325800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.0 2024-09-12T17:14:02.312 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.310+0000 7f55f1325800 1 NOTICE: finished shard 0 (0 entries found) 2024-09-12T17:14:02.312 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.310+0000 7f55f1325800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.1 2024-09-12T17:14:02.313 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.311+0000 7f55f1325800 1 NOTICE: finished shard 1 (0 entries found) 2024-09-12T17:14:02.313 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.311+0000 7f55f1325800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.2 2024-09-12T17:14:02.313 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.311+0000 7f55f1325800 1 NOTICE: finished shard 2 (0 entries found) 2024-09-12T17:14:02.313 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.311+0000 7f55f1325800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.3 2024-09-12T17:14:02.314 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.312+0000 7f55f1325800 1 NOTICE: finished shard 3 (0 entries found) 2024-09-12T17:14:02.314 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.312+0000 7f55f1325800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.4 2024-09-12T17:14:02.315 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.312+0000 7f55f1325800 1 NOTICE: finished shard 4 (0 entries found) 2024-09-12T17:14:02.315 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.312+0000 7f55f1325800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.5 2024-09-12T17:14:02.315 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.313+0000 7f55f1325800 1 NOTICE: finished shard 5 (0 entries found) 2024-09-12T17:14:02.315 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.313+0000 7f55f1325800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.6 2024-09-12T17:14:02.316 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.314+0000 7f55f1325800 1 NOTICE: finished shard 6 (0 entries found) 2024-09-12T17:14:02.316 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.314+0000 7f55f1325800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.7 2024-09-12T17:14:02.316 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.314+0000 7f55f1325800 1 NOTICE: finished shard 7 (0 entries found) 2024-09-12T17:14:02.316 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.314+0000 7f55f1325800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.8 2024-09-12T17:14:02.317 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.315+0000 7f55f1325800 1 NOTICE: finished shard 8 (0 entries found) 2024-09-12T17:14:02.317 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.315+0000 7f55f1325800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.9 2024-09-12T17:14:02.318 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.316+0000 7f55f1325800 1 NOTICE: finished shard 9 (0 entries found) 2024-09-12T17:14:02.318 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.316+0000 7f55f1325800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.10 2024-09-12T17:14:02.319 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.317+0000 7f55f1325800 1 NOTICE: finished shard 10 (0 entries found) 2024-09-12T17:14:02.319 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.317+0000 7f55f1325800 1 NOTICE: finished all shards (0 entries found) 2024-09-12T17:14:02.320 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.318+0000 7f54a37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:14:02.323 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.321+0000 7f55f1325800 20 remove_watcher() i=0 2024-09-12T17:14:02.323 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.321+0000 7f55f1325800 2 removed watcher, disabling cache 2024-09-12T17:14:02.324 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.322+0000 7f55f1325800 20 remove_watcher() i=1 2024-09-12T17:14:02.327 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.325+0000 7f55f1325800 20 remove_watcher() i=2 2024-09-12T17:14:02.328 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.326+0000 7f55f1325800 20 remove_watcher() i=3 2024-09-12T17:14:02.329 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.327+0000 7f55f1325800 20 remove_watcher() i=4 2024-09-12T17:14:02.331 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.329+0000 7f55f1325800 20 remove_watcher() i=5 2024-09-12T17:14:02.332 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.330+0000 7f55f1325800 20 remove_watcher() i=6 2024-09-12T17:14:02.333 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.331+0000 7f55f1325800 20 remove_watcher() i=7 2024-09-12T17:14:02.521 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-12T17:14:02.552 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:14:02.552 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:14:02.593 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.591+0000 7fd087411800 20 rados->read ofs=0 len=0 2024-09-12T17:14:02.595 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.593+0000 7fd087411800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:02.595 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.593+0000 7fd087411800 20 realm 2024-09-12T17:14:02.595 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.593+0000 7fd087411800 20 rados->read ofs=0 len=0 2024-09-12T17:14:02.595 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.593+0000 7fd087411800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:02.596 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.593+0000 7fd087411800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:14:02.596 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.593+0000 7fd087411800 20 rados->read ofs=0 len=0 2024-09-12T17:14:02.596 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.593+0000 7fd087411800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:02.596 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.593+0000 7fd087411800 20 rados->read ofs=0 len=0 2024-09-12T17:14:02.596 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.594+0000 7fd087411800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:14:02.596 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.594+0000 7fd087411800 20 rados->read ofs=0 len=0 2024-09-12T17:14:02.597 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.594+0000 7fd087411800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:14:02.597 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.594+0000 7fd087411800 20 searching for the correct realm 2024-09-12T17:14:02.601 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.599+0000 7fd082347640 0 -- 172.21.15.37:0/1223561768 >> [v2:172.21.15.40:6800/2441293461,v1:172.21.15.40:6801/2441293461] conn(0x7fd07406b020 msgr2=0x7fd074003440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:14:02.604 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.602+0000 7fd083349640 0 -- 172.21.15.37:0/1223561768 >> [v2:172.21.15.40:6808/2253405131,v1:172.21.15.40:6809/2253405131] conn(0x7fd0780374e0 msgr2=0x7fd07802b420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:14:02.608 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.606+0000 7fd087411800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:14:02.609 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.606+0000 7fd087411800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:14:02.609 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.606+0000 7fd087411800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:14:02.609 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.606+0000 7fd087411800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:14:02.609 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.606+0000 7fd087411800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:14:02.609 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.606+0000 7fd087411800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:14:02.609 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.606+0000 7fd087411800 20 rados->read ofs=0 len=0 2024-09-12T17:14:02.609 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.606+0000 7fd087411800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:02.609 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.606+0000 7fd087411800 20 rados->read ofs=0 len=0 2024-09-12T17:14:02.609 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.607+0000 7fd087411800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:14:02.609 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.607+0000 7fd087411800 20 rados->read ofs=0 len=0 2024-09-12T17:14:02.611 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.607+0000 7fd087411800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:14:02.611 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.607+0000 7fd087411800 20 zone default found 2024-09-12T17:14:02.611 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.607+0000 7fd087411800 4 Realm: () 2024-09-12T17:14:02.611 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.607+0000 7fd087411800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:14:02.611 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.607+0000 7fd087411800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:14:02.611 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.607+0000 7fd087411800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:14:02.612 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.607+0000 7fd087411800 20 zonegroup default 2024-09-12T17:14:02.612 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.607+0000 7fd087411800 20 rados->read ofs=0 len=0 2024-09-12T17:14:02.612 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.607+0000 7fd087411800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:02.612 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.607+0000 7fd087411800 20 rados->read ofs=0 len=0 2024-09-12T17:14:02.612 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.607+0000 7fd087411800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:02.612 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.607+0000 7fd087411800 20 rados->read ofs=0 len=0 2024-09-12T17:14:02.612 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.608+0000 7fd087411800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:02.612 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.608+0000 7fd087411800 20 started sync module instance, tier type = 2024-09-12T17:14:02.612 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.608+0000 7fd087411800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:14:02.623 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.621+0000 7fd087411800 20 add_watcher() i=0 2024-09-12T17:14:02.623 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.621+0000 7fd087411800 20 add_watcher() i=1 2024-09-12T17:14:02.623 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.621+0000 7fd087411800 20 add_watcher() i=2 2024-09-12T17:14:02.623 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.621+0000 7fd087411800 20 add_watcher() i=3 2024-09-12T17:14:02.623 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.621+0000 7fd087411800 20 add_watcher() i=4 2024-09-12T17:14:02.623 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.621+0000 7fd087411800 20 add_watcher() i=5 2024-09-12T17:14:02.623 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.621+0000 7fd087411800 20 add_watcher() i=6 2024-09-12T17:14:02.625 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.623+0000 7fd087411800 20 add_watcher() i=7 2024-09-12T17:14:02.625 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.623+0000 7fd087411800 2 all 8 watchers are set, enabling cache 2024-09-12T17:14:02.627 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.625+0000 7fcf397e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:14:02.629 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.625+0000 7fd087411800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:14:02.629 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.625+0000 7fd087411800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:14:02.629 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.625+0000 7fd087411800 5 note: GC not initialized 2024-09-12T17:14:02.629 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.625+0000 7fceb3fff640 20 reqs_thread_entry: start 2024-09-12T17:14:02.629 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.625+0000 7fd087411800 20 init_complete bucket index max shards: 11 2024-09-12T17:14:02.629 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.626+0000 7fd087411800 20 Filter name: none 2024-09-12T17:14:02.629 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.626+0000 7fceb1ffb640 20 reqs_thread_entry: start 2024-09-12T17:14:02.629 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.626+0000 7fd087411800 20 rados->read ofs=0 len=0 2024-09-12T17:14:02.629 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.626+0000 7fd087411800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:14:02.629 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.626+0000 7fd087411800 20 rados->read ofs=0 len=0 2024-09-12T17:14:02.629 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.627+0000 7fd087411800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:14:02.629 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.627+0000 7fd087411800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:14:02.630 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.627+0000 7fd087411800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T17:14:02.630 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.627+0000 7fd087411800 20 INFO: main: starting shard=0 2024-09-12T17:14:02.630 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.627+0000 7fd087411800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.0 2024-09-12T17:14:02.630 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.627+0000 7fd087411800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:14:02.631 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.627+0000 7fd087411800 20 INFO: main: starting shard=1 2024-09-12T17:14:02.631 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.627+0000 7fd087411800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.1 2024-09-12T17:14:02.631 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.628+0000 7fd087411800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:14:02.631 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.628+0000 7fd087411800 20 INFO: main: starting shard=2 2024-09-12T17:14:02.631 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.628+0000 7fd087411800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.2 2024-09-12T17:14:02.632 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.628+0000 7fd087411800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:14:02.632 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.628+0000 7fd087411800 20 INFO: main: starting shard=3 2024-09-12T17:14:02.632 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.628+0000 7fd087411800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.3 2024-09-12T17:14:02.632 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.629+0000 7fd087411800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:14:02.632 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.629+0000 7fd087411800 20 INFO: main: starting shard=4 2024-09-12T17:14:02.633 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.629+0000 7fd087411800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.4 2024-09-12T17:14:02.633 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.629+0000 7fd087411800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:14:02.633 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.629+0000 7fd087411800 20 INFO: main: starting shard=5 2024-09-12T17:14:02.633 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.629+0000 7fd087411800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.5 2024-09-12T17:14:02.633 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.630+0000 7fd087411800 20 INFO: main: bi_list() returned without error; entries.size()=2, is_truncated=0, marker= 2024-09-12T17:14:02.633 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.630+0000 7fd087411800 20 INFO: main: starting shard=6 2024-09-12T17:14:02.633 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.630+0000 7fd087411800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.6 2024-09-12T17:14:02.633 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.631+0000 7fd087411800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:14:02.633 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.631+0000 7fd087411800 20 INFO: main: starting shard=7 2024-09-12T17:14:02.634 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.631+0000 7fd087411800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.7 2024-09-12T17:14:02.634 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.632+0000 7fd087411800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:14:02.634 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.632+0000 7fd087411800 20 INFO: main: starting shard=8 2024-09-12T17:14:02.634 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.632+0000 7fd087411800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.8 2024-09-12T17:14:02.635 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.633+0000 7fd087411800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:14:02.635 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.633+0000 7fd087411800 20 INFO: main: starting shard=9 2024-09-12T17:14:02.635 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.633+0000 7fd087411800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.9 2024-09-12T17:14:02.635 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.633+0000 7fd087411800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:14:02.635 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.633+0000 7fd087411800 20 INFO: main: starting shard=10 2024-09-12T17:14:02.636 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.633+0000 7fd087411800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.10 2024-09-12T17:14:02.636 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.634+0000 7fd087411800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:14:02.636 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.634+0000 7fd087411800 20 INFO: main: done 2024-09-12T17:14:02.637 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.634+0000 7fcf397e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:14:02.639 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.637+0000 7fd087411800 20 remove_watcher() i=0 2024-09-12T17:14:02.639 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.637+0000 7fd087411800 2 removed watcher, disabling cache 2024-09-12T17:14:02.641 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.639+0000 7fd087411800 20 remove_watcher() i=1 2024-09-12T17:14:02.642 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.640+0000 7fd087411800 20 remove_watcher() i=2 2024-09-12T17:14:02.643 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.642+0000 7fd087411800 20 remove_watcher() i=3 2024-09-12T17:14:02.645 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.643+0000 7fd087411800 20 remove_watcher() i=4 2024-09-12T17:14:02.646 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.644+0000 7fd087411800 20 remove_watcher() i=5 2024-09-12T17:14:02.647 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.645+0000 7fd087411800 20 remove_watcher() i=6 2024-09-12T17:14:02.648 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.646+0000 7fd087411800 20 remove_watcher() i=7 2024-09-12T17:14:02.661 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-12T17:14:02.693 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:14:02.693 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:14:02.732 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.730+0000 7f1502b26800 20 rados->read ofs=0 len=0 2024-09-12T17:14:02.735 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.732+0000 7f1502b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:02.735 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.732+0000 7f1502b26800 20 realm 2024-09-12T17:14:02.735 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.732+0000 7f1502b26800 20 rados->read ofs=0 len=0 2024-09-12T17:14:02.735 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.732+0000 7f1502b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:02.735 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.732+0000 7f1502b26800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:14:02.735 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.732+0000 7f1502b26800 20 rados->read ofs=0 len=0 2024-09-12T17:14:02.735 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.733+0000 7f1502b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:02.735 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.733+0000 7f1502b26800 20 rados->read ofs=0 len=0 2024-09-12T17:14:02.736 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.733+0000 7f1502b26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:14:02.736 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.733+0000 7f1502b26800 20 rados->read ofs=0 len=0 2024-09-12T17:14:02.736 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.734+0000 7f1502b26800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:14:02.736 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.734+0000 7f1502b26800 20 searching for the correct realm 2024-09-12T17:14:02.739 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.737+0000 7f14ff04c640 0 -- 172.21.15.37:0/2086817166 >> [v2:172.21.15.40:6818/1210108009,v1:172.21.15.40:6819/1210108009] conn(0x7f14f402b410 msgr2=0x7f14f402b890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:14:02.742 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.741+0000 7f14fe84b640 0 -- 172.21.15.37:0/2086817166 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7f14f402b890 msgr2=0x7f14f401c3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:14:02.951 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.948+0000 7f1502b26800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:14:02.951 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.948+0000 7f1502b26800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:14:02.951 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.948+0000 7f1502b26800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:14:02.951 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.948+0000 7f1502b26800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:14:02.951 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.948+0000 7f1502b26800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:14:02.951 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.948+0000 7f1502b26800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:14:02.952 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.948+0000 7f1502b26800 20 rados->read ofs=0 len=0 2024-09-12T17:14:02.952 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.949+0000 7f1502b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:02.952 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.949+0000 7f1502b26800 20 rados->read ofs=0 len=0 2024-09-12T17:14:02.952 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.949+0000 7f1502b26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:14:02.952 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.949+0000 7f1502b26800 20 rados->read ofs=0 len=0 2024-09-12T17:14:02.953 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.949+0000 7f1502b26800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:14:02.953 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.949+0000 7f1502b26800 20 zone default found 2024-09-12T17:14:02.953 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.949+0000 7f1502b26800 4 Realm: () 2024-09-12T17:14:02.953 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.949+0000 7f1502b26800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:14:02.953 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.949+0000 7f1502b26800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:14:02.953 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.949+0000 7f1502b26800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:14:02.954 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.949+0000 7f1502b26800 20 zonegroup default 2024-09-12T17:14:02.954 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.949+0000 7f1502b26800 20 rados->read ofs=0 len=0 2024-09-12T17:14:02.954 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.950+0000 7f1502b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:02.954 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.950+0000 7f1502b26800 20 rados->read ofs=0 len=0 2024-09-12T17:14:02.954 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.950+0000 7f1502b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:02.954 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.950+0000 7f1502b26800 20 rados->read ofs=0 len=0 2024-09-12T17:14:02.954 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.950+0000 7f1502b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:02.954 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.950+0000 7f1502b26800 20 started sync module instance, tier type = 2024-09-12T17:14:02.954 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.950+0000 7f1502b26800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:14:02.971 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.969+0000 7f1502b26800 20 add_watcher() i=0 2024-09-12T17:14:02.972 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.969+0000 7f1502b26800 20 add_watcher() i=1 2024-09-12T17:14:02.972 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.969+0000 7f1502b26800 20 add_watcher() i=2 2024-09-12T17:14:02.972 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.969+0000 7f1502b26800 20 add_watcher() i=3 2024-09-12T17:14:02.972 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.969+0000 7f1502b26800 20 add_watcher() i=4 2024-09-12T17:14:02.972 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.969+0000 7f1502b26800 20 add_watcher() i=5 2024-09-12T17:14:02.972 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.969+0000 7f1502b26800 20 add_watcher() i=6 2024-09-12T17:14:02.972 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.970+0000 7f1502b26800 20 add_watcher() i=7 2024-09-12T17:14:02.973 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.970+0000 7f1502b26800 2 all 8 watchers are set, enabling cache 2024-09-12T17:14:02.974 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.972+0000 7f13b57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:14:02.976 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.972+0000 7f1502b26800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:14:02.976 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.972+0000 7f1502b26800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:14:02.976 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.972+0000 7f1502b26800 5 note: GC not initialized 2024-09-12T17:14:02.976 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.973+0000 7f132ffff640 20 reqs_thread_entry: start 2024-09-12T17:14:02.977 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.973+0000 7f1502b26800 20 init_complete bucket index max shards: 11 2024-09-12T17:14:02.977 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.973+0000 7f1502b26800 20 Filter name: none 2024-09-12T17:14:02.977 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.973+0000 7f132dffb640 20 reqs_thread_entry: start 2024-09-12T17:14:02.977 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.973+0000 7f1502b26800 20 rados->read ofs=0 len=0 2024-09-12T17:14:02.977 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.973+0000 7f1502b26800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:14:02.977 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.973+0000 7f1502b26800 20 rados->read ofs=0 len=0 2024-09-12T17:14:02.977 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.974+0000 7f1502b26800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:14:02.977 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.974+0000 7f1502b26800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:14:02.977 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.974+0000 7f1502b26800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T17:14:02.977 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.974+0000 7f1502b26800 20 INFO: main: starting shard=0 2024-09-12T17:14:02.978 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.974+0000 7f1502b26800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.0 2024-09-12T17:14:02.978 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.974+0000 7f1502b26800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:14:02.978 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.974+0000 7f1502b26800 20 INFO: main: starting shard=1 2024-09-12T17:14:02.978 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.974+0000 7f1502b26800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.1 2024-09-12T17:14:02.978 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.975+0000 7f1502b26800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:14:02.979 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.975+0000 7f1502b26800 20 INFO: main: starting shard=2 2024-09-12T17:14:02.979 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.975+0000 7f1502b26800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.2 2024-09-12T17:14:02.979 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.976+0000 7f1502b26800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:14:02.979 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.976+0000 7f1502b26800 20 INFO: main: starting shard=3 2024-09-12T17:14:02.979 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.976+0000 7f1502b26800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.3 2024-09-12T17:14:02.980 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.977+0000 7f1502b26800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:14:02.980 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.977+0000 7f1502b26800 20 INFO: main: starting shard=4 2024-09-12T17:14:02.980 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.977+0000 7f1502b26800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.4 2024-09-12T17:14:02.980 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.977+0000 7f1502b26800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:14:02.980 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.977+0000 7f1502b26800 20 INFO: main: starting shard=5 2024-09-12T17:14:02.980 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.977+0000 7f1502b26800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.5 2024-09-12T17:14:02.980 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.978+0000 7f1502b26800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:14:02.980 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.978+0000 7f1502b26800 20 INFO: main: starting shard=6 2024-09-12T17:14:02.981 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.978+0000 7f1502b26800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.6 2024-09-12T17:14:02.982 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.978+0000 7f1502b26800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:14:02.982 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.978+0000 7f1502b26800 20 INFO: main: starting shard=7 2024-09-12T17:14:02.982 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.978+0000 7f1502b26800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.7 2024-09-12T17:14:02.982 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.979+0000 7f1502b26800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:14:02.982 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.979+0000 7f1502b26800 20 INFO: main: starting shard=8 2024-09-12T17:14:02.982 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.979+0000 7f1502b26800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.8 2024-09-12T17:14:02.982 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.980+0000 7f1502b26800 20 INFO: main: bi_list() returned without error; entries.size()=2, is_truncated=0, marker= 2024-09-12T17:14:02.982 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.980+0000 7f1502b26800 20 INFO: main: starting shard=9 2024-09-12T17:14:02.982 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.980+0000 7f1502b26800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.9 2024-09-12T17:14:02.983 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.980+0000 7f1502b26800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:14:02.983 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.980+0000 7f1502b26800 20 INFO: main: starting shard=10 2024-09-12T17:14:02.983 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.980+0000 7f1502b26800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.10 2024-09-12T17:14:02.983 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.981+0000 7f1502b26800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:14:02.984 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.981+0000 7f1502b26800 20 INFO: main: done 2024-09-12T17:14:02.984 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.982+0000 7f13b57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:14:02.987 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.985+0000 7f1502b26800 20 remove_watcher() i=0 2024-09-12T17:14:02.987 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.985+0000 7f1502b26800 2 removed watcher, disabling cache 2024-09-12T17:14:02.988 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.986+0000 7f1502b26800 20 remove_watcher() i=1 2024-09-12T17:14:02.989 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.987+0000 7f1502b26800 20 remove_watcher() i=2 2024-09-12T17:14:02.990 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.989+0000 7f1502b26800 20 remove_watcher() i=3 2024-09-12T17:14:02.992 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.990+0000 7f1502b26800 20 remove_watcher() i=4 2024-09-12T17:14:02.993 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.991+0000 7f1502b26800 20 remove_watcher() i=5 2024-09-12T17:14:02.994 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.992+0000 7f1502b26800 20 remove_watcher() i=6 2024-09-12T17:14:02.995 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:02.993+0000 7f1502b26800 20 remove_watcher() i=7 2024-09-12T17:14:03.006 INFO:tasks.workunit.client.0.smithi037.stderr:TEST: bucket check olh finds leftover OLH entries 2024-09-12T17:14:03.007 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:14:03.008 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bucket check olh --bucket check-bucket --dump-keys 2024-09-12T17:14:03.040 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:14:03.040 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:14:03.080 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.078+0000 7f36f6f33800 20 rados->read ofs=0 len=0 2024-09-12T17:14:03.081 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.079+0000 7f36f6f33800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:03.081 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.079+0000 7f36f6f33800 20 realm 2024-09-12T17:14:03.081 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.079+0000 7f36f6f33800 20 rados->read ofs=0 len=0 2024-09-12T17:14:03.082 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.079+0000 7f36f6f33800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:03.082 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.079+0000 7f36f6f33800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:14:03.082 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.079+0000 7f36f6f33800 20 rados->read ofs=0 len=0 2024-09-12T17:14:03.082 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.079+0000 7f36f6f33800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:03.082 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.079+0000 7f36f6f33800 20 rados->read ofs=0 len=0 2024-09-12T17:14:03.082 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.080+0000 7f36f6f33800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:14:03.082 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.080+0000 7f36f6f33800 20 rados->read ofs=0 len=0 2024-09-12T17:14:03.083 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.081+0000 7f36f6f33800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:14:03.083 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.081+0000 7f36f6f33800 20 searching for the correct realm 2024-09-12T17:14:03.086 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.084+0000 7f36ebfff640 0 -- 172.21.15.37:0/2766272066 >> [v2:172.21.15.37:6816/2964054205,v1:172.21.15.37:6817/2964054205] conn(0x556df93d1be0 msgr2=0x556df93d4080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:14:03.091 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.088+0000 7f36f2c76640 0 -- 172.21.15.37:0/2766272066 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7f36dc098780 msgr2=0x7f36dc060900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:14:03.096 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.093+0000 7f36f6f33800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:14:03.096 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.093+0000 7f36f6f33800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:14:03.096 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.093+0000 7f36f6f33800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:14:03.097 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.093+0000 7f36f6f33800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:14:03.097 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.093+0000 7f36f6f33800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:14:03.097 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.093+0000 7f36f6f33800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:14:03.097 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.093+0000 7f36f6f33800 20 rados->read ofs=0 len=0 2024-09-12T17:14:03.097 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.093+0000 7f36f6f33800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:03.097 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.093+0000 7f36f6f33800 20 rados->read ofs=0 len=0 2024-09-12T17:14:03.097 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.093+0000 7f36f6f33800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:14:03.097 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.093+0000 7f36f6f33800 20 rados->read ofs=0 len=0 2024-09-12T17:14:03.098 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.094+0000 7f36f6f33800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:14:03.098 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.094+0000 7f36f6f33800 20 zone default found 2024-09-12T17:14:03.098 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.094+0000 7f36f6f33800 4 Realm: () 2024-09-12T17:14:03.098 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.094+0000 7f36f6f33800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:14:03.098 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.094+0000 7f36f6f33800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:14:03.098 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.094+0000 7f36f6f33800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:14:03.098 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.094+0000 7f36f6f33800 20 zonegroup default 2024-09-12T17:14:03.098 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.094+0000 7f36f6f33800 20 rados->read ofs=0 len=0 2024-09-12T17:14:03.098 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.094+0000 7f36f6f33800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:03.098 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.094+0000 7f36f6f33800 20 rados->read ofs=0 len=0 2024-09-12T17:14:03.098 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.094+0000 7f36f6f33800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:03.098 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.094+0000 7f36f6f33800 20 rados->read ofs=0 len=0 2024-09-12T17:14:03.099 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.095+0000 7f36f6f33800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:03.099 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.095+0000 7f36f6f33800 20 started sync module instance, tier type = 2024-09-12T17:14:03.099 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.095+0000 7f36f6f33800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:14:03.109 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.107+0000 7f36f6f33800 20 add_watcher() i=0 2024-09-12T17:14:03.109 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.107+0000 7f36f6f33800 20 add_watcher() i=1 2024-09-12T17:14:03.109 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.107+0000 7f36f6f33800 20 add_watcher() i=2 2024-09-12T17:14:03.110 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.107+0000 7f36f6f33800 20 add_watcher() i=3 2024-09-12T17:14:03.110 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.107+0000 7f36f6f33800 20 add_watcher() i=4 2024-09-12T17:14:03.110 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.107+0000 7f36f6f33800 20 add_watcher() i=5 2024-09-12T17:14:03.111 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.109+0000 7f36f6f33800 20 add_watcher() i=6 2024-09-12T17:14:03.111 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.109+0000 7f36f6f33800 20 add_watcher() i=7 2024-09-12T17:14:03.111 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.109+0000 7f36f6f33800 2 all 8 watchers are set, enabling cache 2024-09-12T17:14:03.113 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.111+0000 7f35a97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:14:03.114 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.112+0000 7f36f6f33800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:14:03.114 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.112+0000 7f36f6f33800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:14:03.115 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.112+0000 7f36f6f33800 5 note: GC not initialized 2024-09-12T17:14:03.115 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.112+0000 7f3523fff640 20 reqs_thread_entry: start 2024-09-12T17:14:03.115 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.112+0000 7f36f6f33800 20 init_complete bucket index max shards: 11 2024-09-12T17:14:03.115 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.112+0000 7f36f6f33800 20 Filter name: none 2024-09-12T17:14:03.115 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.112+0000 7f3521ffb640 20 reqs_thread_entry: start 2024-09-12T17:14:03.115 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.112+0000 7f36f6f33800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T17:14:03.115 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.112+0000 7f36f6f33800 20 rados->read ofs=0 len=0 2024-09-12T17:14:03.116 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.113+0000 7f36f6f33800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:14:03.116 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.113+0000 7f36f6f33800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T17:14:03.116 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.113+0000 7f36f6f33800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T17:14:03.117 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.113+0000 7f36f6f33800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2 : miss 2024-09-12T17:14:03.117 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.113+0000 7f36f6f33800 20 rados->read ofs=0 len=0 2024-09-12T17:14:03.117 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.113+0000 7f36f6f33800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:14:03.117 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.113+0000 7f36f6f33800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2 info.flags=0x17 2024-09-12T17:14:03.117 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.113+0000 7f36f6f33800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2 to cache LRU end 2024-09-12T17:14:03.117 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.113+0000 7f36f6f33800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:14:03.117 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.113+0000 7f36f6f33800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T17:14:03.117 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.113+0000 7f36f6f33800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2 2024-09-12T17:14:03.117 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.113+0000 7f36f6f33800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.0 2024-09-12T17:14:03.117 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.114+0000 7f36f6f33800 1 NOTICE: finished shard 0 (0 entries found) 2024-09-12T17:14:03.117 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.114+0000 7f36f6f33800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.1 2024-09-12T17:14:03.117 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.114+0000 7f36f6f33800 1 NOTICE: finished shard 1 (0 entries found) 2024-09-12T17:14:03.117 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.114+0000 7f36f6f33800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.2 2024-09-12T17:14:03.118 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.115+0000 7f36f6f33800 1 NOTICE: finished shard 2 (0 entries found) 2024-09-12T17:14:03.118 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.115+0000 7f36f6f33800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.3 2024-09-12T17:14:03.118 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.115+0000 7f36f6f33800 1 NOTICE: finished shard 3 (0 entries found) 2024-09-12T17:14:03.118 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.115+0000 7f36f6f33800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.4 2024-09-12T17:14:03.118 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.116+0000 7f36f6f33800 1 NOTICE: finished shard 4 (0 entries found) 2024-09-12T17:14:03.118 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.116+0000 7f36f6f33800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.5 2024-09-12T17:14:03.119 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.117+0000 7f36f6f33800 1 NOTICE: finished shard 5 (1 entries found) 2024-09-12T17:14:03.119 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.117+0000 7f36f6f33800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.6 2024-09-12T17:14:03.119 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.117+0000 7f36f6f33800 1 NOTICE: finished shard 6 (0 entries found) 2024-09-12T17:14:03.119 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.117+0000 7f36f6f33800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.7 2024-09-12T17:14:03.120 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.118+0000 7f36f6f33800 1 NOTICE: finished shard 7 (0 entries found) 2024-09-12T17:14:03.120 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.118+0000 7f36f6f33800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.8 2024-09-12T17:14:03.120 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.118+0000 7f36f6f33800 1 NOTICE: finished shard 8 (1 entries found) 2024-09-12T17:14:03.120 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.118+0000 7f36f6f33800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.9 2024-09-12T17:14:03.121 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.119+0000 7f36f6f33800 1 NOTICE: finished shard 9 (0 entries found) 2024-09-12T17:14:03.121 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.119+0000 7f36f6f33800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.10 2024-09-12T17:14:03.121 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.119+0000 7f36f6f33800 1 NOTICE: finished shard 10 (0 entries found) 2024-09-12T17:14:03.122 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.119+0000 7f36f6f33800 1 NOTICE: finished all shards (2 entries found) 2024-09-12T17:14:03.122 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.120+0000 7f35a97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:14:03.125 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.123+0000 7f36f6f33800 20 remove_watcher() i=0 2024-09-12T17:14:03.125 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.123+0000 7f36f6f33800 2 removed watcher, disabling cache 2024-09-12T17:14:03.126 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.124+0000 7f36f6f33800 20 remove_watcher() i=1 2024-09-12T17:14:03.127 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.125+0000 7f36f6f33800 20 remove_watcher() i=2 2024-09-12T17:14:03.128 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.126+0000 7f36f6f33800 20 remove_watcher() i=3 2024-09-12T17:14:03.129 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.127+0000 7f36f6f33800 20 remove_watcher() i=4 2024-09-12T17:14:03.130 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.129+0000 7f36f6f33800 20 remove_watcher() i=5 2024-09-12T17:14:03.132 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.130+0000 7f36f6f33800 20 remove_watcher() i=6 2024-09-12T17:14:03.133 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.131+0000 7f36f6f33800 20 remove_watcher() i=7 2024-09-12T17:14:03.144 INFO:tasks.workunit.client.0.smithi037.stderr:TEST: bucket check olh fixes leftover OLH entries 2024-09-12T17:14:03.145 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:14:03.146 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bucket check olh --bucket check-bucket --fix --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-12T17:14:03.179 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:14:03.179 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:14:03.218 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.216+0000 7f29d3c40800 20 rados->read ofs=0 len=0 2024-09-12T17:14:03.220 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.218+0000 7f29d3c40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:03.220 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.218+0000 7f29d3c40800 20 realm 2024-09-12T17:14:03.220 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.218+0000 7f29d3c40800 20 rados->read ofs=0 len=0 2024-09-12T17:14:03.220 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.218+0000 7f29d3c40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:03.220 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.218+0000 7f29d3c40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:14:03.220 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.218+0000 7f29d3c40800 20 rados->read ofs=0 len=0 2024-09-12T17:14:03.220 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.218+0000 7f29d3c40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:03.221 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.218+0000 7f29d3c40800 20 rados->read ofs=0 len=0 2024-09-12T17:14:03.221 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.219+0000 7f29d3c40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:14:03.221 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.219+0000 7f29d3c40800 20 rados->read ofs=0 len=0 2024-09-12T17:14:03.222 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.219+0000 7f29d3c40800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:14:03.222 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.219+0000 7f29d3c40800 20 searching for the correct realm 2024-09-12T17:14:03.425 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.423+0000 7f29c8f30640 0 -- 172.21.15.37:0/692321141 >> [v2:172.21.15.40:6800/2441293461,v1:172.21.15.40:6801/2441293461] conn(0x7f29c404fc60 msgr2=0x7f29c40d9600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:14:03.429 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.427+0000 7f29d1731640 0 -- 172.21.15.37:0/692321141 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7f29bc02abd0 msgr2=0x7f29bc05d3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:14:03.636 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.634+0000 7f29d3c40800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:14:03.636 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.634+0000 7f29d3c40800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:14:03.637 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.634+0000 7f29d3c40800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:14:03.637 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.634+0000 7f29d3c40800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:14:03.637 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.634+0000 7f29d3c40800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:14:03.637 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.634+0000 7f29d3c40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:14:03.637 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.634+0000 7f29d3c40800 20 rados->read ofs=0 len=0 2024-09-12T17:14:03.637 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.634+0000 7f29d3c40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:03.637 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.634+0000 7f29d3c40800 20 rados->read ofs=0 len=0 2024-09-12T17:14:03.638 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.635+0000 7f29d3c40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:14:03.638 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.635+0000 7f29d3c40800 20 rados->read ofs=0 len=0 2024-09-12T17:14:03.638 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.635+0000 7f29d3c40800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:14:03.638 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.635+0000 7f29d3c40800 20 zone default found 2024-09-12T17:14:03.638 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.635+0000 7f29d3c40800 4 Realm: () 2024-09-12T17:14:03.639 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.635+0000 7f29d3c40800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:14:03.639 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.635+0000 7f29d3c40800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:14:03.639 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.635+0000 7f29d3c40800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:14:03.639 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.635+0000 7f29d3c40800 20 zonegroup default 2024-09-12T17:14:03.639 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.635+0000 7f29d3c40800 20 rados->read ofs=0 len=0 2024-09-12T17:14:03.639 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.635+0000 7f29d3c40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:03.639 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.635+0000 7f29d3c40800 20 rados->read ofs=0 len=0 2024-09-12T17:14:03.639 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.636+0000 7f29d3c40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:03.639 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.636+0000 7f29d3c40800 20 rados->read ofs=0 len=0 2024-09-12T17:14:03.639 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.636+0000 7f29d3c40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:03.639 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.636+0000 7f29d3c40800 20 started sync module instance, tier type = 2024-09-12T17:14:03.639 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.636+0000 7f29d3c40800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:14:03.661 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.658+0000 7f29d3c40800 20 add_watcher() i=0 2024-09-12T17:14:03.661 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.658+0000 7f29d3c40800 20 add_watcher() i=1 2024-09-12T17:14:03.661 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.658+0000 7f29d3c40800 20 add_watcher() i=2 2024-09-12T17:14:03.661 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.658+0000 7f29d3c40800 20 add_watcher() i=3 2024-09-12T17:14:03.661 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.658+0000 7f29d3c40800 20 add_watcher() i=4 2024-09-12T17:14:03.661 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.658+0000 7f29d3c40800 20 add_watcher() i=5 2024-09-12T17:14:03.661 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.658+0000 7f29d3c40800 20 add_watcher() i=6 2024-09-12T17:14:03.662 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.659+0000 7f29d3c40800 20 add_watcher() i=7 2024-09-12T17:14:03.662 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.659+0000 7f29d3c40800 2 all 8 watchers are set, enabling cache 2024-09-12T17:14:03.664 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.662+0000 7f28877e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:14:03.665 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.662+0000 7f29d3c40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:14:03.665 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.662+0000 7f29d3c40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:14:03.666 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.662+0000 7f29d3c40800 5 note: GC not initialized 2024-09-12T17:14:03.666 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.663+0000 7f28867e4640 20 reqs_thread_entry: start 2024-09-12T17:14:03.666 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.663+0000 7f29d3c40800 20 init_complete bucket index max shards: 11 2024-09-12T17:14:03.666 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.663+0000 7f29d3c40800 20 Filter name: none 2024-09-12T17:14:03.666 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.663+0000 7f27f7fff640 20 reqs_thread_entry: start 2024-09-12T17:14:03.666 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.663+0000 7f29d3c40800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T17:14:03.666 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.663+0000 7f29d3c40800 20 rados->read ofs=0 len=0 2024-09-12T17:14:03.666 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.663+0000 7f29d3c40800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:14:03.666 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.663+0000 7f29d3c40800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T17:14:03.666 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.663+0000 7f29d3c40800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T17:14:03.666 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.663+0000 7f29d3c40800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2 : miss 2024-09-12T17:14:03.666 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.663+0000 7f29d3c40800 20 rados->read ofs=0 len=0 2024-09-12T17:14:03.667 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.664+0000 7f29d3c40800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:14:03.667 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.664+0000 7f29d3c40800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2 info.flags=0x17 2024-09-12T17:14:03.667 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.664+0000 7f29d3c40800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2 to cache LRU end 2024-09-12T17:14:03.668 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.664+0000 7f29d3c40800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:14:03.668 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.664+0000 7f29d3c40800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T17:14:03.668 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.664+0000 7f29d3c40800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2 2024-09-12T17:14:03.668 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.664+0000 7f29d3c40800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.0 2024-09-12T17:14:03.668 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.665+0000 7f29d3c40800 1 NOTICE: finished shard 0 (0 entries removed) 2024-09-12T17:14:03.668 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.665+0000 7f29d3c40800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.1 2024-09-12T17:14:03.668 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.665+0000 7f29d3c40800 1 NOTICE: finished shard 1 (0 entries removed) 2024-09-12T17:14:03.668 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.665+0000 7f29d3c40800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.2 2024-09-12T17:14:03.669 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.666+0000 7f29d3c40800 1 NOTICE: finished shard 2 (0 entries removed) 2024-09-12T17:14:03.669 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.666+0000 7f29d3c40800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.3 2024-09-12T17:14:03.669 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.667+0000 7f29d3c40800 1 NOTICE: finished shard 3 (0 entries removed) 2024-09-12T17:14:03.669 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.667+0000 7f29d3c40800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.4 2024-09-12T17:14:03.669 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.667+0000 7f29d3c40800 1 NOTICE: finished shard 4 (0 entries removed) 2024-09-12T17:14:03.669 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.667+0000 7f29d3c40800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.5 2024-09-12T17:14:03.670 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.668+0000 7f29d3c40800 20 get_obj_state: octx=0x565215c12180 obj=check-bucket:d state=0x565215edc678 s->prefetch_data=0 2024-09-12T17:14:03.670 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.668+0000 7f29d3c40800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.6 2024-09-12T17:14:03.671 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.669+0000 7f29d3c40800 1 NOTICE: finished shard 6 (0 entries removed) 2024-09-12T17:14:03.671 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.669+0000 7f29d3c40800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.7 2024-09-12T17:14:03.671 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.669+0000 7f29d3c40800 1 NOTICE: finished shard 7 (0 entries removed) 2024-09-12T17:14:03.671 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.669+0000 7f29d3c40800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.8 2024-09-12T17:14:03.672 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.670+0000 7f29d3c40800 20 get_obj_state: octx=0x565215c3aca0 obj=check-bucket:c state=0x565215edd1d8 s->prefetch_data=0 2024-09-12T17:14:03.672 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.670+0000 7f29d3c40800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.9 2024-09-12T17:14:03.673 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.671+0000 7f29d3c40800 1 NOTICE: finished shard 9 (0 entries removed) 2024-09-12T17:14:03.673 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.671+0000 7f29d3c40800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.10 2024-09-12T17:14:03.673 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.671+0000 7f29d3c40800 1 NOTICE: finished shard 10 (0 entries removed) 2024-09-12T17:14:03.673 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.671+0000 7f29d3c40800 20 get_obj_state: setting s->obj_tag to q3vmtj0q63nejoejzayhwqebxs6caccp 2024-09-12T17:14:03.673 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.671+0000 7f29d3c40800 20 get_obj_state_impl: setting s->olh_tag to o7ymm23te4db4z6zegcvgi4jg6mt6u9o 2024-09-12T17:14:03.674 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.671+0000 7f29d3c40800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.5 2024-09-12T17:14:03.674 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.671+0000 7f29d3c40800 20 get_obj_state: setting s->obj_tag to 7s2ccz0b9x2zvpne2npw6zkbnv1knxwx 2024-09-12T17:14:03.674 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.671+0000 7f29d3c40800 20 get_obj_state_impl: setting s->olh_tag to w3uys5lxsfuehltotgdse33gelais8ol 2024-09-12T17:14:03.674 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.671+0000 7f29d3c40800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.8 2024-09-12T17:14:03.674 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.672+0000 7f29d3c40800 20 olh_log_entry: epoch=4 op=2 key=d[] 2024-09-12T17:14:03.675 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.672+0000 7f29d3c40800 20 olh_log_entry: epoch=4 op=3 key=d[lzROWfmAw5xImfzT-tEwKVDZkDghKuc] 2024-09-12T17:14:03.675 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.672+0000 7f29d3c40800 20 get_obj_state: octx=0x565215f166b0 obj=check-bucket:_:lzROWfmAw5xImfzT-tEwKVDZkDghKuc_d state=0x565215f3c638 s->prefetch_data=0 2024-09-12T17:14:03.675 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.672+0000 7f29d3c40800 20 olh_log_entry: epoch=4 op=2 key=c[] 2024-09-12T17:14:03.675 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.672+0000 7f29d3c40800 20 olh_log_entry: epoch=4 op=3 key=c[8ufpdsUY0fGRUAswdGK543R1gLlaFXZ] 2024-09-12T17:14:03.675 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.672+0000 7f29d3c40800 20 get_obj_state: octx=0x565215f366b0 obj=check-bucket:_:8ufpdsUY0fGRUAswdGK543R1gLlaFXZ_c state=0x565215f42cb8 s->prefetch_data=0 2024-09-12T17:14:03.678 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.676+0000 7f29d3c40800 20 get_obj_state: octx=0x565215f166b0 obj=check-bucket:d state=0x565215f42cb8 s->prefetch_data=0 2024-09-12T17:14:03.679 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.677+0000 7f29d3c40800 20 get_obj_state: octx=0x565215f366b0 obj=check-bucket:c state=0x565215f3dc68 s->prefetch_data=0 2024-09-12T17:14:03.679 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.677+0000 7f29d3c40800 20 get_obj_state: setting s->obj_tag to q3vmtj0q63nejoejzayhwqebxs6caccp 2024-09-12T17:14:03.679 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.677+0000 7f29d3c40800 20 get_obj_state_impl: setting s->olh_tag to o7ymm23te4db4z6zegcvgi4jg6mt6u9o 2024-09-12T17:14:03.679 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.677+0000 7f29d3c40800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=o7ymm23te4db4z6zegcvgi4jg6mt6u9o 2024-09-12T17:14:03.680 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.678+0000 7f29d3c40800 20 get_obj_state: setting s->obj_tag to 7s2ccz0b9x2zvpne2npw6zkbnv1knxwx 2024-09-12T17:14:03.680 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.678+0000 7f29d3c40800 20 get_obj_state_impl: setting s->olh_tag to w3uys5lxsfuehltotgdse33gelais8ol 2024-09-12T17:14:03.680 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.678+0000 7f29d3c40800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=w3uys5lxsfuehltotgdse33gelais8ol 2024-09-12T17:14:03.684 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.682+0000 7f29d3c40800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.5 2024-09-12T17:14:03.687 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.685+0000 7f29d3c40800 1 NOTICE: finished shard 5 (1 entries removed) 2024-09-12T17:14:03.687 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.685+0000 7f29d3c40800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.8 2024-09-12T17:14:03.688 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.687+0000 7f29d3c40800 1 NOTICE: finished shard 8 (1 entries removed) 2024-09-12T17:14:03.689 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.687+0000 7f29d3c40800 1 NOTICE: finished all shards (2 entries removed) 2024-09-12T17:14:03.690 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.688+0000 7f28877e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:14:03.692 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.690+0000 7f29d3c40800 20 remove_watcher() i=0 2024-09-12T17:14:03.692 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.690+0000 7f29d3c40800 2 removed watcher, disabling cache 2024-09-12T17:14:03.693 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.691+0000 7f29d3c40800 20 remove_watcher() i=1 2024-09-12T17:14:03.696 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.693+0000 7f29d3c40800 20 remove_watcher() i=2 2024-09-12T17:14:03.696 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.694+0000 7f29d3c40800 20 remove_watcher() i=3 2024-09-12T17:14:03.697 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.695+0000 7f29d3c40800 20 remove_watcher() i=4 2024-09-12T17:14:03.698 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.696+0000 7f29d3c40800 20 remove_watcher() i=5 2024-09-12T17:14:03.701 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.699+0000 7f29d3c40800 20 remove_watcher() i=6 2024-09-12T17:14:03.702 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.700+0000 7f29d3c40800 20 remove_watcher() i=7 2024-09-12T17:14:03.715 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-12T17:14:03.747 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:14:03.747 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:14:03.787 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.785+0000 7f5c0d119800 20 rados->read ofs=0 len=0 2024-09-12T17:14:03.789 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.786+0000 7f5c0d119800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:03.789 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.786+0000 7f5c0d119800 20 realm 2024-09-12T17:14:03.790 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.786+0000 7f5c0d119800 20 rados->read ofs=0 len=0 2024-09-12T17:14:03.790 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.787+0000 7f5c0d119800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:03.790 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.787+0000 7f5c0d119800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:14:03.790 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.787+0000 7f5c0d119800 20 rados->read ofs=0 len=0 2024-09-12T17:14:03.790 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.787+0000 7f5c0d119800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:03.790 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.787+0000 7f5c0d119800 20 rados->read ofs=0 len=0 2024-09-12T17:14:03.791 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.788+0000 7f5c0d119800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:14:03.791 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.788+0000 7f5c0d119800 20 rados->read ofs=0 len=0 2024-09-12T17:14:03.791 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.788+0000 7f5c0d119800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:14:03.791 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.788+0000 7f5c0d119800 20 searching for the correct realm 2024-09-12T17:14:03.793 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.791+0000 7f5c0a402640 0 -- 172.21.15.37:0/2269505655 >> [v2:172.21.15.37:6816/2964054205,v1:172.21.15.37:6817/2964054205] conn(0x559e263528f0 msgr2=0x559e26354ce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:14:03.797 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.795+0000 7f5c0ac03640 0 -- 172.21.15.37:0/2269505655 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7f5c00076870 msgr2=0x7f5c00045820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:14:03.801 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.799+0000 7f5c0d119800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:14:03.802 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.799+0000 7f5c0d119800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:14:03.802 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.799+0000 7f5c0d119800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:14:03.802 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.799+0000 7f5c0d119800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:14:03.802 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.799+0000 7f5c0d119800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:14:03.802 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.799+0000 7f5c0d119800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:14:03.802 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.799+0000 7f5c0d119800 20 rados->read ofs=0 len=0 2024-09-12T17:14:03.802 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.799+0000 7f5c0d119800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:03.802 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.799+0000 7f5c0d119800 20 rados->read ofs=0 len=0 2024-09-12T17:14:03.803 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.800+0000 7f5c0d119800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:14:03.803 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.800+0000 7f5c0d119800 20 rados->read ofs=0 len=0 2024-09-12T17:14:03.803 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.800+0000 7f5c0d119800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:14:03.803 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.800+0000 7f5c0d119800 20 zone default found 2024-09-12T17:14:03.803 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.800+0000 7f5c0d119800 4 Realm: () 2024-09-12T17:14:03.804 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.800+0000 7f5c0d119800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:14:03.804 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.800+0000 7f5c0d119800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:14:03.804 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.800+0000 7f5c0d119800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:14:03.804 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.800+0000 7f5c0d119800 20 zonegroup default 2024-09-12T17:14:03.804 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.800+0000 7f5c0d119800 20 rados->read ofs=0 len=0 2024-09-12T17:14:03.804 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.800+0000 7f5c0d119800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:03.804 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.800+0000 7f5c0d119800 20 rados->read ofs=0 len=0 2024-09-12T17:14:03.804 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.801+0000 7f5c0d119800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:03.804 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.801+0000 7f5c0d119800 20 rados->read ofs=0 len=0 2024-09-12T17:14:03.804 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.801+0000 7f5c0d119800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:03.804 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.801+0000 7f5c0d119800 20 started sync module instance, tier type = 2024-09-12T17:14:03.804 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.801+0000 7f5c0d119800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:14:03.824 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.822+0000 7f5c0d119800 20 add_watcher() i=0 2024-09-12T17:14:03.824 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.822+0000 7f5c0d119800 20 add_watcher() i=1 2024-09-12T17:14:03.824 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.822+0000 7f5c0d119800 20 add_watcher() i=2 2024-09-12T17:14:03.824 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.822+0000 7f5c0d119800 20 add_watcher() i=3 2024-09-12T17:14:03.824 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.822+0000 7f5c0d119800 20 add_watcher() i=4 2024-09-12T17:14:03.825 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.823+0000 7f5c0d119800 20 add_watcher() i=5 2024-09-12T17:14:03.828 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.826+0000 7f5c0d119800 20 add_watcher() i=6 2024-09-12T17:14:03.828 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.826+0000 7f5c0d119800 20 add_watcher() i=7 2024-09-12T17:14:03.828 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.826+0000 7f5c0d119800 2 all 8 watchers are set, enabling cache 2024-09-12T17:14:03.830 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.828+0000 7f5ac17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:14:03.831 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.828+0000 7f5c0d119800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:14:03.831 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.828+0000 7f5c0d119800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:14:03.831 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.828+0000 7f5c0d119800 5 note: GC not initialized 2024-09-12T17:14:03.831 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.828+0000 7f5a3bfff640 20 reqs_thread_entry: start 2024-09-12T17:14:03.831 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.828+0000 7f5c0d119800 20 init_complete bucket index max shards: 11 2024-09-12T17:14:03.831 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.828+0000 7f5c0d119800 20 Filter name: none 2024-09-12T17:14:03.831 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.829+0000 7f5a39ffb640 20 reqs_thread_entry: start 2024-09-12T17:14:03.831 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.829+0000 7f5c0d119800 20 rados->read ofs=0 len=0 2024-09-12T17:14:03.832 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.829+0000 7f5c0d119800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:14:03.832 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.829+0000 7f5c0d119800 20 rados->read ofs=0 len=0 2024-09-12T17:14:03.832 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.829+0000 7f5c0d119800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:14:03.833 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.829+0000 7f5c0d119800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:14:03.833 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.829+0000 7f5c0d119800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T17:14:03.833 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.829+0000 7f5c0d119800 20 INFO: main: starting shard=0 2024-09-12T17:14:03.833 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.830+0000 7f5c0d119800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.0 2024-09-12T17:14:03.833 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.830+0000 7f5c0d119800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:14:03.833 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.830+0000 7f5c0d119800 20 INFO: main: starting shard=1 2024-09-12T17:14:03.833 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.830+0000 7f5c0d119800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.1 2024-09-12T17:14:03.833 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.831+0000 7f5c0d119800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:14:03.834 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.831+0000 7f5c0d119800 20 INFO: main: starting shard=2 2024-09-12T17:14:03.834 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.831+0000 7f5c0d119800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.2 2024-09-12T17:14:03.834 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.832+0000 7f5c0d119800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:14:03.834 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.832+0000 7f5c0d119800 20 INFO: main: starting shard=3 2024-09-12T17:14:03.834 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.832+0000 7f5c0d119800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.3 2024-09-12T17:14:03.835 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.832+0000 7f5c0d119800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:14:03.835 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.832+0000 7f5c0d119800 20 INFO: main: starting shard=4 2024-09-12T17:14:03.835 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.832+0000 7f5c0d119800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.4 2024-09-12T17:14:03.835 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.833+0000 7f5c0d119800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:14:03.835 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.833+0000 7f5c0d119800 20 INFO: main: starting shard=5 2024-09-12T17:14:03.835 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.833+0000 7f5c0d119800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.5 2024-09-12T17:14:03.836 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.834+0000 7f5c0d119800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:14:03.836 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.834+0000 7f5c0d119800 20 INFO: main: starting shard=6 2024-09-12T17:14:03.836 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.834+0000 7f5c0d119800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.6 2024-09-12T17:14:03.837 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.834+0000 7f5c0d119800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:14:03.837 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.834+0000 7f5c0d119800 20 INFO: main: starting shard=7 2024-09-12T17:14:03.837 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.834+0000 7f5c0d119800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.7 2024-09-12T17:14:03.837 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.835+0000 7f5c0d119800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:14:03.837 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.835+0000 7f5c0d119800 20 INFO: main: starting shard=8 2024-09-12T17:14:03.837 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.835+0000 7f5c0d119800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.8 2024-09-12T17:14:03.838 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.835+0000 7f5c0d119800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:14:03.838 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.835+0000 7f5c0d119800 20 INFO: main: starting shard=9 2024-09-12T17:14:03.838 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.835+0000 7f5c0d119800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.9 2024-09-12T17:14:03.838 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.836+0000 7f5c0d119800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:14:03.838 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.836+0000 7f5c0d119800 20 INFO: main: starting shard=10 2024-09-12T17:14:03.838 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.836+0000 7f5c0d119800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.10 2024-09-12T17:14:03.838 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.836+0000 7f5c0d119800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:14:03.839 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.836+0000 7f5c0d119800 20 INFO: main: done 2024-09-12T17:14:03.839 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.837+0000 7f5ac17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:14:03.841 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.839+0000 7f5c0d119800 20 remove_watcher() i=0 2024-09-12T17:14:03.841 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.839+0000 7f5c0d119800 2 removed watcher, disabling cache 2024-09-12T17:14:03.842 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.840+0000 7f5c0d119800 20 remove_watcher() i=1 2024-09-12T17:14:03.844 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.842+0000 7f5c0d119800 20 remove_watcher() i=2 2024-09-12T17:14:03.846 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.844+0000 7f5c0d119800 20 remove_watcher() i=3 2024-09-12T17:14:03.847 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.845+0000 7f5c0d119800 20 remove_watcher() i=4 2024-09-12T17:14:03.848 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.846+0000 7f5c0d119800 20 remove_watcher() i=5 2024-09-12T17:14:03.849 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.847+0000 7f5c0d119800 20 remove_watcher() i=6 2024-09-12T17:14:03.850 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.848+0000 7f5c0d119800 20 remove_watcher() i=7 2024-09-12T17:14:03.863 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-12T17:14:03.894 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:14:03.895 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:14:03.933 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.931+0000 7f7de8725800 20 rados->read ofs=0 len=0 2024-09-12T17:14:03.935 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.933+0000 7f7de8725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:03.935 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.933+0000 7f7de8725800 20 realm 2024-09-12T17:14:03.935 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.933+0000 7f7de8725800 20 rados->read ofs=0 len=0 2024-09-12T17:14:03.935 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.933+0000 7f7de8725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:03.935 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.933+0000 7f7de8725800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:14:03.936 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.933+0000 7f7de8725800 20 rados->read ofs=0 len=0 2024-09-12T17:14:03.936 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.933+0000 7f7de8725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:03.936 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.933+0000 7f7de8725800 20 rados->read ofs=0 len=0 2024-09-12T17:14:03.936 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.934+0000 7f7de8725800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:14:03.936 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.934+0000 7f7de8725800 20 rados->read ofs=0 len=0 2024-09-12T17:14:03.937 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.934+0000 7f7de8725800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:14:03.937 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.934+0000 7f7de8725800 20 searching for the correct realm 2024-09-12T17:14:03.940 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.938+0000 7f7ddbbad640 0 -- 172.21.15.37:0/3279594233 >> [v2:172.21.15.37:6816/2964054205,v1:172.21.15.37:6817/2964054205] conn(0x55ee54e94240 msgr2=0x55ee54e96670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:14:03.943 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.941+0000 7f7de43ae640 0 -- 172.21.15.37:0/3279594233 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7f7dcc0e6790 msgr2=0x7f7dcc071050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:14:03.948 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.946+0000 7f7de8725800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:14:03.949 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.946+0000 7f7de8725800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:14:03.949 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.946+0000 7f7de8725800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:14:03.949 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.946+0000 7f7de8725800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:14:03.949 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.946+0000 7f7de8725800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:14:03.949 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.946+0000 7f7de8725800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:14:03.949 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.946+0000 7f7de8725800 20 rados->read ofs=0 len=0 2024-09-12T17:14:03.949 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.946+0000 7f7de8725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:03.949 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.946+0000 7f7de8725800 20 rados->read ofs=0 len=0 2024-09-12T17:14:03.949 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.946+0000 7f7de8725800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:14:03.949 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.946+0000 7f7de8725800 20 rados->read ofs=0 len=0 2024-09-12T17:14:03.950 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.947+0000 7f7de8725800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:14:03.950 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.947+0000 7f7de8725800 20 zone default found 2024-09-12T17:14:03.951 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.947+0000 7f7de8725800 4 Realm: () 2024-09-12T17:14:03.951 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.947+0000 7f7de8725800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:14:03.951 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.947+0000 7f7de8725800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:14:03.951 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.947+0000 7f7de8725800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:14:03.951 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.947+0000 7f7de8725800 20 zonegroup default 2024-09-12T17:14:03.951 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.947+0000 7f7de8725800 20 rados->read ofs=0 len=0 2024-09-12T17:14:03.951 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.947+0000 7f7de8725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:03.951 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.947+0000 7f7de8725800 20 rados->read ofs=0 len=0 2024-09-12T17:14:03.951 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.948+0000 7f7de8725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:03.951 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.948+0000 7f7de8725800 20 rados->read ofs=0 len=0 2024-09-12T17:14:03.951 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.948+0000 7f7de8725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:03.951 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.948+0000 7f7de8725800 20 started sync module instance, tier type = 2024-09-12T17:14:03.951 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.948+0000 7f7de8725800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:14:03.964 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.962+0000 7f7de8725800 20 add_watcher() i=0 2024-09-12T17:14:03.964 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.962+0000 7f7de8725800 20 add_watcher() i=1 2024-09-12T17:14:03.965 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.962+0000 7f7de8725800 20 add_watcher() i=2 2024-09-12T17:14:03.965 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.962+0000 7f7de8725800 20 add_watcher() i=3 2024-09-12T17:14:03.965 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.962+0000 7f7de8725800 20 add_watcher() i=4 2024-09-12T17:14:03.965 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.962+0000 7f7de8725800 20 add_watcher() i=5 2024-09-12T17:14:03.965 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.962+0000 7f7de8725800 20 add_watcher() i=6 2024-09-12T17:14:03.966 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.964+0000 7f7de8725800 20 add_watcher() i=7 2024-09-12T17:14:03.966 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.964+0000 7f7de8725800 2 all 8 watchers are set, enabling cache 2024-09-12T17:14:03.967 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.965+0000 7f7c9afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:14:03.969 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.966+0000 7f7de8725800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:14:03.969 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.966+0000 7f7de8725800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:14:03.969 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.966+0000 7f7de8725800 5 note: GC not initialized 2024-09-12T17:14:03.969 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.966+0000 7f7c99fdb640 20 reqs_thread_entry: start 2024-09-12T17:14:03.969 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.966+0000 7f7de8725800 20 init_complete bucket index max shards: 11 2024-09-12T17:14:03.969 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.966+0000 7f7de8725800 20 Filter name: none 2024-09-12T17:14:03.970 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.966+0000 7f7c0b7fe640 20 reqs_thread_entry: start 2024-09-12T17:14:03.970 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.966+0000 7f7de8725800 20 rados->read ofs=0 len=0 2024-09-12T17:14:03.970 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.967+0000 7f7de8725800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:14:03.970 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.967+0000 7f7de8725800 20 rados->read ofs=0 len=0 2024-09-12T17:14:03.971 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.967+0000 7f7de8725800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:14:03.971 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.967+0000 7f7de8725800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:14:03.971 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.967+0000 7f7de8725800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T17:14:03.971 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.967+0000 7f7de8725800 20 INFO: main: starting shard=0 2024-09-12T17:14:03.971 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.967+0000 7f7de8725800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.0 2024-09-12T17:14:03.971 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.968+0000 7f7de8725800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:14:03.972 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.968+0000 7f7de8725800 20 INFO: main: starting shard=1 2024-09-12T17:14:03.972 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.968+0000 7f7de8725800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.1 2024-09-12T17:14:03.972 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.968+0000 7f7de8725800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:14:03.972 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.968+0000 7f7de8725800 20 INFO: main: starting shard=2 2024-09-12T17:14:03.972 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.968+0000 7f7de8725800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.2 2024-09-12T17:14:03.972 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.969+0000 7f7de8725800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:14:03.972 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.969+0000 7f7de8725800 20 INFO: main: starting shard=3 2024-09-12T17:14:03.972 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.969+0000 7f7de8725800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.3 2024-09-12T17:14:03.973 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.969+0000 7f7de8725800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:14:03.973 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.969+0000 7f7de8725800 20 INFO: main: starting shard=4 2024-09-12T17:14:03.973 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.969+0000 7f7de8725800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.4 2024-09-12T17:14:03.973 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.970+0000 7f7de8725800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:14:03.973 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.970+0000 7f7de8725800 20 INFO: main: starting shard=5 2024-09-12T17:14:03.974 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.970+0000 7f7de8725800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.5 2024-09-12T17:14:03.974 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.970+0000 7f7de8725800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:14:03.974 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.971+0000 7f7de8725800 20 INFO: main: starting shard=6 2024-09-12T17:14:03.974 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.971+0000 7f7de8725800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.6 2024-09-12T17:14:03.974 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.971+0000 7f7de8725800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:14:03.974 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.971+0000 7f7de8725800 20 INFO: main: starting shard=7 2024-09-12T17:14:03.974 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.971+0000 7f7de8725800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.7 2024-09-12T17:14:03.975 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.972+0000 7f7de8725800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:14:03.975 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.972+0000 7f7de8725800 20 INFO: main: starting shard=8 2024-09-12T17:14:03.975 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.972+0000 7f7de8725800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.8 2024-09-12T17:14:03.975 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.972+0000 7f7de8725800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:14:03.975 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.972+0000 7f7de8725800 20 INFO: main: starting shard=9 2024-09-12T17:14:03.975 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.972+0000 7f7de8725800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.9 2024-09-12T17:14:03.975 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.973+0000 7f7de8725800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:14:03.975 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.973+0000 7f7de8725800 20 INFO: main: starting shard=10 2024-09-12T17:14:03.975 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.973+0000 7f7de8725800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.10 2024-09-12T17:14:03.976 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.973+0000 7f7de8725800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:14:03.976 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.973+0000 7f7de8725800 20 INFO: main: done 2024-09-12T17:14:03.976 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.974+0000 7f7c9afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:14:03.978 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.976+0000 7f7de8725800 20 remove_watcher() i=0 2024-09-12T17:14:03.978 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.976+0000 7f7de8725800 2 removed watcher, disabling cache 2024-09-12T17:14:03.979 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.977+0000 7f7de8725800 20 remove_watcher() i=1 2024-09-12T17:14:03.981 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.979+0000 7f7de8725800 20 remove_watcher() i=2 2024-09-12T17:14:03.982 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.980+0000 7f7de8725800 20 remove_watcher() i=3 2024-09-12T17:14:03.983 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.981+0000 7f7de8725800 20 remove_watcher() i=4 2024-09-12T17:14:03.984 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.982+0000 7f7de8725800 20 remove_watcher() i=5 2024-09-12T17:14:03.985 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.983+0000 7f7de8725800 20 remove_watcher() i=6 2024-09-12T17:14:03.986 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:03.984+0000 7f7de8725800 20 remove_watcher() i=7 2024-09-12T17:14:03.997 INFO:tasks.workunit.client.0.smithi037.stderr:TEST: bucket check olh does not find new leftover OLH entries after fix 2024-09-12T17:14:03.997 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:14:03.999 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bucket check olh --bucket check-bucket --dump-keys 2024-09-12T17:14:04.031 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:14:04.031 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:14:04.070 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:04.068+0000 7fb68d71f800 20 rados->read ofs=0 len=0 2024-09-12T17:14:04.072 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:04.069+0000 7fb68d71f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:04.072 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:04.069+0000 7fb68d71f800 20 realm 2024-09-12T17:14:04.072 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:04.069+0000 7fb68d71f800 20 rados->read ofs=0 len=0 2024-09-12T17:14:04.072 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:04.070+0000 7fb68d71f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:04.072 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:04.070+0000 7fb68d71f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:14:04.072 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:04.070+0000 7fb68d71f800 20 rados->read ofs=0 len=0 2024-09-12T17:14:04.072 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:04.070+0000 7fb68d71f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:04.072 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:04.070+0000 7fb68d71f800 20 rados->read ofs=0 len=0 2024-09-12T17:14:04.073 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:04.071+0000 7fb68d71f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:14:04.073 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:04.071+0000 7fb68d71f800 20 rados->read ofs=0 len=0 2024-09-12T17:14:04.073 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:04.071+0000 7fb68d71f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:14:04.073 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:04.071+0000 7fb68d71f800 20 searching for the correct realm 2024-09-12T17:14:04.076 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:04.074+0000 7fb688ca1640 0 -- 172.21.15.37:0/15435572 >> [v2:172.21.15.40:6800/2441293461,v1:172.21.15.40:6801/2441293461] conn(0x7fb67c06cb70 msgr2=0x7fb67c089780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:14:04.080 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:04.077+0000 7fb6894a2640 0 -- 172.21.15.37:0/15435572 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7fb68009c4b0 msgr2=0x7fb68009c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:14:04.285 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:04.283+0000 7fb68d71f800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:14:04.286 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:04.283+0000 7fb68d71f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:14:04.286 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:04.283+0000 7fb68d71f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:14:04.286 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:04.283+0000 7fb68d71f800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:14:04.286 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:04.283+0000 7fb68d71f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:14:04.286 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:04.283+0000 7fb68d71f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:14:04.286 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:04.283+0000 7fb68d71f800 20 rados->read ofs=0 len=0 2024-09-12T17:14:04.286 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:04.283+0000 7fb68d71f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:04.286 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:04.283+0000 7fb68d71f800 20 rados->read ofs=0 len=0 2024-09-12T17:14:04.287 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:04.284+0000 7fb68d71f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:14:04.288 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:04.284+0000 7fb68d71f800 20 rados->read ofs=0 len=0 2024-09-12T17:14:04.288 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:04.284+0000 7fb68d71f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:14:04.288 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:04.284+0000 7fb68d71f800 20 zone default found 2024-09-12T17:14:04.288 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:04.284+0000 7fb68d71f800 4 Realm: () 2024-09-12T17:14:04.288 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:04.284+0000 7fb68d71f800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:14:04.288 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:04.284+0000 7fb68d71f800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:14:04.288 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:04.284+0000 7fb68d71f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:14:04.288 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:04.284+0000 7fb68d71f800 20 zonegroup default 2024-09-12T17:14:04.288 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:04.284+0000 7fb68d71f800 20 rados->read ofs=0 len=0 2024-09-12T17:14:04.289 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:04.285+0000 7fb68d71f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:04.289 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:04.285+0000 7fb68d71f800 20 rados->read ofs=0 len=0 2024-09-12T17:14:04.289 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:04.285+0000 7fb68d71f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:04.289 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:04.285+0000 7fb68d71f800 20 rados->read ofs=0 len=0 2024-09-12T17:14:04.289 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:04.285+0000 7fb68d71f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:04.289 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:04.285+0000 7fb68d71f800 20 started sync module instance, tier type = 2024-09-12T17:14:04.289 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:04.285+0000 7fb68d71f800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:14:04.302 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:04.300+0000 7fb68d71f800 20 add_watcher() i=0 2024-09-12T17:14:04.302 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:04.300+0000 7fb68d71f800 20 add_watcher() i=1 2024-09-12T17:14:04.302 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:04.300+0000 7fb68d71f800 20 add_watcher() i=2 2024-09-12T17:14:04.302 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:04.300+0000 7fb68d71f800 20 add_watcher() i=3 2024-09-12T17:14:04.302 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:04.300+0000 7fb68d71f800 20 add_watcher() i=4 2024-09-12T17:14:04.302 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:04.300+0000 7fb68d71f800 20 add_watcher() i=5 2024-09-12T17:14:04.303 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:04.301+0000 7fb68d71f800 20 add_watcher() i=6 2024-09-12T17:14:04.303 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:04.301+0000 7fb68d71f800 20 add_watcher() i=7 2024-09-12T17:14:04.303 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:04.301+0000 7fb68d71f800 2 all 8 watchers are set, enabling cache 2024-09-12T17:14:04.307 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:04.303+0000 7fb53f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:14:04.307 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:04.303+0000 7fb68d71f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:14:04.307 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:04.303+0000 7fb68d71f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:14:04.307 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:04.303+0000 7fb68d71f800 5 note: GC not initialized 2024-09-12T17:14:04.307 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:04.304+0000 7fb53e7e4640 20 reqs_thread_entry: start 2024-09-12T17:14:04.307 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:04.304+0000 7fb68d71f800 20 init_complete bucket index max shards: 11 2024-09-12T17:14:04.307 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:04.304+0000 7fb68d71f800 20 Filter name: none 2024-09-12T17:14:04.307 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:04.304+0000 7fb4affff640 20 reqs_thread_entry: start 2024-09-12T17:14:04.307 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:04.304+0000 7fb68d71f800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T17:14:04.308 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:04.304+0000 7fb68d71f800 20 rados->read ofs=0 len=0 2024-09-12T17:14:04.308 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:04.304+0000 7fb68d71f800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:14:04.308 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:04.304+0000 7fb68d71f800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T17:14:04.308 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:04.304+0000 7fb68d71f800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T17:14:04.308 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:04.304+0000 7fb68d71f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2 : miss 2024-09-12T17:14:04.308 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:04.304+0000 7fb68d71f800 20 rados->read ofs=0 len=0 2024-09-12T17:14:04.309 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:04.305+0000 7fb68d71f800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:14:04.310 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:04.305+0000 7fb68d71f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2 info.flags=0x17 2024-09-12T17:14:04.310 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:04.305+0000 7fb68d71f800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2 to cache LRU end 2024-09-12T17:14:04.310 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:04.305+0000 7fb68d71f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:14:04.310 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:04.305+0000 7fb68d71f800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T17:14:04.310 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:04.305+0000 7fb68d71f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2 2024-09-12T17:14:04.310 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:04.305+0000 7fb68d71f800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.0 2024-09-12T17:14:04.310 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:04.306+0000 7fb68d71f800 1 NOTICE: finished shard 0 (0 entries found) 2024-09-12T17:14:04.310 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:04.306+0000 7fb68d71f800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.1 2024-09-12T17:14:04.310 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:04.306+0000 7fb68d71f800 1 NOTICE: finished shard 1 (0 entries found) 2024-09-12T17:14:04.310 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:04.306+0000 7fb68d71f800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.2 2024-09-12T17:14:04.310 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:04.307+0000 7fb68d71f800 1 NOTICE: finished shard 2 (0 entries found) 2024-09-12T17:14:04.310 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:04.307+0000 7fb68d71f800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.3 2024-09-12T17:14:04.311 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:04.307+0000 7fb68d71f800 1 NOTICE: finished shard 3 (0 entries found) 2024-09-12T17:14:04.311 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:04.307+0000 7fb68d71f800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.4 2024-09-12T17:14:04.311 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:04.308+0000 7fb68d71f800 1 NOTICE: finished shard 4 (0 entries found) 2024-09-12T17:14:04.311 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:04.308+0000 7fb68d71f800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.5 2024-09-12T17:14:04.311 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:04.309+0000 7fb68d71f800 1 NOTICE: finished shard 5 (0 entries found) 2024-09-12T17:14:04.311 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:04.309+0000 7fb68d71f800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.6 2024-09-12T17:14:04.312 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:04.310+0000 7fb68d71f800 1 NOTICE: finished shard 6 (0 entries found) 2024-09-12T17:14:04.313 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:04.310+0000 7fb68d71f800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.7 2024-09-12T17:14:04.313 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:04.310+0000 7fb68d71f800 1 NOTICE: finished shard 7 (0 entries found) 2024-09-12T17:14:04.313 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:04.310+0000 7fb68d71f800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.8 2024-09-12T17:14:04.314 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:04.311+0000 7fb68d71f800 1 NOTICE: finished shard 8 (0 entries found) 2024-09-12T17:14:04.314 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:04.311+0000 7fb68d71f800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.9 2024-09-12T17:14:04.314 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:04.311+0000 7fb68d71f800 1 NOTICE: finished shard 9 (0 entries found) 2024-09-12T17:14:04.314 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:04.311+0000 7fb68d71f800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.10 2024-09-12T17:14:04.314 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:04.311+0000 7fb68d71f800 1 NOTICE: finished shard 10 (0 entries found) 2024-09-12T17:14:04.314 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:04.311+0000 7fb68d71f800 1 NOTICE: finished all shards (0 entries found) 2024-09-12T17:14:04.314 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:04.312+0000 7fb53f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:14:04.317 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:04.315+0000 7fb68d71f800 20 remove_watcher() i=0 2024-09-12T17:14:04.317 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:04.315+0000 7fb68d71f800 2 removed watcher, disabling cache 2024-09-12T17:14:04.318 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:04.316+0000 7fb68d71f800 20 remove_watcher() i=1 2024-09-12T17:14:04.319 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:04.317+0000 7fb68d71f800 20 remove_watcher() i=2 2024-09-12T17:14:04.320 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:04.319+0000 7fb68d71f800 20 remove_watcher() i=3 2024-09-12T17:14:04.322 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:04.320+0000 7fb68d71f800 20 remove_watcher() i=4 2024-09-12T17:14:04.324 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:04.322+0000 7fb68d71f800 20 remove_watcher() i=5 2024-09-12T17:14:04.326 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:04.324+0000 7fb68d71f800 20 remove_watcher() i=6 2024-09-12T17:14:04.327 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:04.325+0000 7fb68d71f800 20 remove_watcher() i=7 2024-09-12T17:14:04.338 INFO:tasks.workunit.client.0.smithi037.stderr:TEST: verify that bucket check fixes do not affect null version objects 2024-09-12T17:14:04.338 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:14:04.458 INFO:tasks.workunit.client.0.smithi037.stderr:TEST: bucket check stats are correct in the presence of unlinked entries 2024-09-12T17:14:04.459 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:14:05.204 INFO:tasks.workunit.client.0.smithi037.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-12T17:14:05.613 INFO:tasks.workunit.client.0.smithi037.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-09-12T17:14:07.164 INFO:tasks.workunit.client.0.smithi037.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T17:14:07.166 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-12T17:14:07.198 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:14:07.198 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:14:07.238 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.235+0000 7fe8bd339800 20 rados->read ofs=0 len=0 2024-09-12T17:14:07.240 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.237+0000 7fe8bd339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:07.240 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.237+0000 7fe8bd339800 20 realm 2024-09-12T17:14:07.240 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.237+0000 7fe8bd339800 20 rados->read ofs=0 len=0 2024-09-12T17:14:07.240 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.237+0000 7fe8bd339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:07.240 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.237+0000 7fe8bd339800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:14:07.240 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.237+0000 7fe8bd339800 20 rados->read ofs=0 len=0 2024-09-12T17:14:07.240 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.238+0000 7fe8bd339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:07.240 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.238+0000 7fe8bd339800 20 rados->read ofs=0 len=0 2024-09-12T17:14:07.241 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.239+0000 7fe8bd339800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:14:07.241 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.239+0000 7fe8bd339800 20 rados->read ofs=0 len=0 2024-09-12T17:14:07.241 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.239+0000 7fe8bd339800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:14:07.241 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.239+0000 7fe8bd339800 20 searching for the correct realm 2024-09-12T17:14:07.244 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.242+0000 7fe8b97c8640 0 -- 172.21.15.37:0/4224984812 >> [v2:172.21.15.40:6818/1210108009,v1:172.21.15.40:6819/1210108009] conn(0x7fe8ac08d040 msgr2=0x7fe8ac0671e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:14:07.248 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.246+0000 7fe8b8fc7640 0 -- 172.21.15.37:0/4224984812 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7fe8ac071260 msgr2=0x7fe8ac0668e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:14:07.457 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.453+0000 7fe8bd339800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:14:07.457 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.453+0000 7fe8bd339800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:14:07.457 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.453+0000 7fe8bd339800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:14:07.457 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.453+0000 7fe8bd339800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:14:07.458 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.453+0000 7fe8bd339800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:14:07.458 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.453+0000 7fe8bd339800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:14:07.458 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.453+0000 7fe8bd339800 20 rados->read ofs=0 len=0 2024-09-12T17:14:07.458 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.453+0000 7fe8bd339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:07.459 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.453+0000 7fe8bd339800 20 rados->read ofs=0 len=0 2024-09-12T17:14:07.459 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.453+0000 7fe8bd339800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:14:07.459 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.453+0000 7fe8bd339800 20 rados->read ofs=0 len=0 2024-09-12T17:14:07.459 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.454+0000 7fe8bd339800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:14:07.459 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.454+0000 7fe8bd339800 20 zone default found 2024-09-12T17:14:07.459 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.454+0000 7fe8bd339800 4 Realm: () 2024-09-12T17:14:07.460 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.454+0000 7fe8bd339800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:14:07.460 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.454+0000 7fe8bd339800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:14:07.460 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.454+0000 7fe8bd339800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:14:07.460 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.454+0000 7fe8bd339800 20 zonegroup default 2024-09-12T17:14:07.460 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.454+0000 7fe8bd339800 20 rados->read ofs=0 len=0 2024-09-12T17:14:07.461 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.454+0000 7fe8bd339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:07.461 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.454+0000 7fe8bd339800 20 rados->read ofs=0 len=0 2024-09-12T17:14:07.461 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.454+0000 7fe8bd339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:07.461 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.454+0000 7fe8bd339800 20 rados->read ofs=0 len=0 2024-09-12T17:14:07.461 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.455+0000 7fe8bd339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:07.461 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.455+0000 7fe8bd339800 20 started sync module instance, tier type = 2024-09-12T17:14:07.462 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.455+0000 7fe8bd339800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:14:07.473 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.471+0000 7fe8bd339800 20 add_watcher() i=0 2024-09-12T17:14:07.473 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.471+0000 7fe8bd339800 20 add_watcher() i=1 2024-09-12T17:14:07.474 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.471+0000 7fe8bd339800 20 add_watcher() i=2 2024-09-12T17:14:07.474 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.471+0000 7fe8bd339800 20 add_watcher() i=3 2024-09-12T17:14:07.474 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.471+0000 7fe8bd339800 20 add_watcher() i=4 2024-09-12T17:14:07.474 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.471+0000 7fe8bd339800 20 add_watcher() i=5 2024-09-12T17:14:07.474 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.471+0000 7fe8bd339800 20 add_watcher() i=6 2024-09-12T17:14:07.475 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.472+0000 7fe8bd339800 20 add_watcher() i=7 2024-09-12T17:14:07.475 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.472+0000 7fe8bd339800 2 all 8 watchers are set, enabling cache 2024-09-12T17:14:07.477 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.475+0000 7fe76efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:14:07.479 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.475+0000 7fe8bd339800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:14:07.479 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.475+0000 7fe8bd339800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:14:07.479 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.475+0000 7fe8bd339800 5 note: GC not initialized 2024-09-12T17:14:07.479 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.475+0000 7fe76dfe3640 20 reqs_thread_entry: start 2024-09-12T17:14:07.480 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.475+0000 7fe8bd339800 20 init_complete bucket index max shards: 11 2024-09-12T17:14:07.480 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.475+0000 7fe8bd339800 20 Filter name: none 2024-09-12T17:14:07.480 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.476+0000 7fe6df7fe640 20 reqs_thread_entry: start 2024-09-12T17:14:07.480 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.476+0000 7fe8bd339800 20 rados->read ofs=0 len=0 2024-09-12T17:14:07.480 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.476+0000 7fe8bd339800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:14:07.480 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.476+0000 7fe8bd339800 20 rados->read ofs=0 len=0 2024-09-12T17:14:07.480 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.476+0000 7fe8bd339800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:14:07.480 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.476+0000 7fe8bd339800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:14:07.480 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.476+0000 7fe8bd339800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T17:14:07.481 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.476+0000 7fe8bd339800 20 INFO: main: starting shard=0 2024-09-12T17:14:07.481 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.476+0000 7fe8bd339800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.0 2024-09-12T17:14:07.481 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.477+0000 7fe8bd339800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:14:07.481 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.477+0000 7fe8bd339800 20 INFO: main: starting shard=1 2024-09-12T17:14:07.481 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.477+0000 7fe8bd339800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.1 2024-09-12T17:14:07.482 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.478+0000 7fe8bd339800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:14:07.482 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.478+0000 7fe8bd339800 20 INFO: main: starting shard=2 2024-09-12T17:14:07.482 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.478+0000 7fe8bd339800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.2 2024-09-12T17:14:07.482 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.479+0000 7fe8bd339800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:14:07.482 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.479+0000 7fe8bd339800 20 INFO: main: starting shard=3 2024-09-12T17:14:07.482 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.479+0000 7fe8bd339800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.3 2024-09-12T17:14:07.482 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.479+0000 7fe8bd339800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:14:07.482 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.479+0000 7fe8bd339800 20 INFO: main: starting shard=4 2024-09-12T17:14:07.483 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.479+0000 7fe8bd339800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.4 2024-09-12T17:14:07.483 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.480+0000 7fe8bd339800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:14:07.483 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.480+0000 7fe8bd339800 20 INFO: main: starting shard=5 2024-09-12T17:14:07.483 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.480+0000 7fe8bd339800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.5 2024-09-12T17:14:07.483 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.480+0000 7fe8bd339800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:14:07.483 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.480+0000 7fe8bd339800 20 INFO: main: starting shard=6 2024-09-12T17:14:07.484 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.480+0000 7fe8bd339800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.6 2024-09-12T17:14:07.484 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.481+0000 7fe8bd339800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:14:07.484 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.481+0000 7fe8bd339800 20 INFO: main: starting shard=7 2024-09-12T17:14:07.484 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.481+0000 7fe8bd339800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.7 2024-09-12T17:14:07.485 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.482+0000 7fe8bd339800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:14:07.485 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.482+0000 7fe8bd339800 20 INFO: main: starting shard=8 2024-09-12T17:14:07.485 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.482+0000 7fe8bd339800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.8 2024-09-12T17:14:07.485 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.482+0000 7fe8bd339800 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-12T17:14:07.486 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.483+0000 7fe8bd339800 20 INFO: main: starting shard=9 2024-09-12T17:14:07.486 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.483+0000 7fe8bd339800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.9 2024-09-12T17:14:07.486 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.483+0000 7fe8bd339800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:14:07.486 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.483+0000 7fe8bd339800 20 INFO: main: starting shard=10 2024-09-12T17:14:07.486 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.483+0000 7fe8bd339800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.10 2024-09-12T17:14:07.486 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.484+0000 7fe8bd339800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:14:07.486 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.484+0000 7fe8bd339800 20 INFO: main: done 2024-09-12T17:14:07.487 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.485+0000 7fe76efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:14:07.489 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.487+0000 7fe8bd339800 20 remove_watcher() i=0 2024-09-12T17:14:07.489 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.487+0000 7fe8bd339800 2 removed watcher, disabling cache 2024-09-12T17:14:07.490 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.488+0000 7fe8bd339800 20 remove_watcher() i=1 2024-09-12T17:14:07.491 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.490+0000 7fe8bd339800 20 remove_watcher() i=2 2024-09-12T17:14:07.493 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.491+0000 7fe8bd339800 20 remove_watcher() i=3 2024-09-12T17:14:07.494 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.492+0000 7fe8bd339800 20 remove_watcher() i=4 2024-09-12T17:14:07.495 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.493+0000 7fe8bd339800 20 remove_watcher() i=5 2024-09-12T17:14:07.498 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.496+0000 7fe8bd339800 20 remove_watcher() i=6 2024-09-12T17:14:07.499 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.497+0000 7fe8bd339800 20 remove_watcher() i=7 2024-09-12T17:14:07.647 INFO:tasks.workunit.client.0.smithi037.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T17:14:07.816 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-12T17:14:07.816 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:14:07.816 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:14:07.817 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.719+0000 7f9fd3a20800 20 rados->read ofs=0 len=0 2024-09-12T17:14:07.817 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.721+0000 7f9fd3a20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:07.817 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.721+0000 7f9fd3a20800 20 realm 2024-09-12T17:14:07.817 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.721+0000 7f9fd3a20800 20 rados->read ofs=0 len=0 2024-09-12T17:14:07.817 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.721+0000 7f9fd3a20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:07.817 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.721+0000 7f9fd3a20800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:14:07.817 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.721+0000 7f9fd3a20800 20 rados->read ofs=0 len=0 2024-09-12T17:14:07.817 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.721+0000 7f9fd3a20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:07.817 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.721+0000 7f9fd3a20800 20 rados->read ofs=0 len=0 2024-09-12T17:14:07.817 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.722+0000 7f9fd3a20800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:14:07.817 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.722+0000 7f9fd3a20800 20 rados->read ofs=0 len=0 2024-09-12T17:14:07.817 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.722+0000 7f9fd3a20800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:14:07.817 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.722+0000 7f9fd3a20800 20 searching for the correct realm 2024-09-12T17:14:07.818 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.726+0000 7f9fd1d0b640 0 -- 172.21.15.37:0/4058460547 >> [v2:172.21.15.40:6818/1210108009,v1:172.21.15.40:6819/1210108009] conn(0x7f9fc8098040 msgr2=0x7f9fc8015980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:14:07.818 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.730+0000 7f9fd150a640 0 -- 172.21.15.37:0/4058460547 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7f9fc80834c0 msgr2=0x7f9fc80467a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:14:07.938 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.936+0000 7f9fd3a20800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:14:07.939 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.936+0000 7f9fd3a20800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:14:07.939 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.936+0000 7f9fd3a20800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:14:07.939 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.936+0000 7f9fd3a20800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:14:07.939 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.936+0000 7f9fd3a20800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:14:07.939 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.936+0000 7f9fd3a20800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:14:07.939 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.936+0000 7f9fd3a20800 20 rados->read ofs=0 len=0 2024-09-12T17:14:07.939 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.936+0000 7f9fd3a20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:07.939 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.936+0000 7f9fd3a20800 20 rados->read ofs=0 len=0 2024-09-12T17:14:07.941 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.937+0000 7f9fd3a20800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:14:07.941 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.937+0000 7f9fd3a20800 20 rados->read ofs=0 len=0 2024-09-12T17:14:07.941 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.937+0000 7f9fd3a20800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:14:07.941 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.937+0000 7f9fd3a20800 20 zone default found 2024-09-12T17:14:07.941 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.937+0000 7f9fd3a20800 4 Realm: () 2024-09-12T17:14:07.941 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.937+0000 7f9fd3a20800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:14:07.941 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.937+0000 7f9fd3a20800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:14:07.941 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.937+0000 7f9fd3a20800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:14:07.941 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.937+0000 7f9fd3a20800 20 zonegroup default 2024-09-12T17:14:07.941 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.937+0000 7f9fd3a20800 20 rados->read ofs=0 len=0 2024-09-12T17:14:07.942 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.938+0000 7f9fd3a20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:07.942 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.938+0000 7f9fd3a20800 20 rados->read ofs=0 len=0 2024-09-12T17:14:07.942 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.938+0000 7f9fd3a20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:07.942 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.938+0000 7f9fd3a20800 20 rados->read ofs=0 len=0 2024-09-12T17:14:07.942 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.938+0000 7f9fd3a20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:07.942 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.938+0000 7f9fd3a20800 20 started sync module instance, tier type = 2024-09-12T17:14:07.942 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.938+0000 7f9fd3a20800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:14:07.956 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.954+0000 7f9fd3a20800 20 add_watcher() i=0 2024-09-12T17:14:07.956 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.954+0000 7f9fd3a20800 20 add_watcher() i=1 2024-09-12T17:14:07.956 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.954+0000 7f9fd3a20800 20 add_watcher() i=2 2024-09-12T17:14:07.956 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.954+0000 7f9fd3a20800 20 add_watcher() i=3 2024-09-12T17:14:07.956 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.954+0000 7f9fd3a20800 20 add_watcher() i=4 2024-09-12T17:14:07.956 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.954+0000 7f9fd3a20800 20 add_watcher() i=5 2024-09-12T17:14:07.959 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.957+0000 7f9fd3a20800 20 add_watcher() i=6 2024-09-12T17:14:07.959 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.957+0000 7f9fd3a20800 20 add_watcher() i=7 2024-09-12T17:14:07.959 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.957+0000 7f9fd3a20800 2 all 8 watchers are set, enabling cache 2024-09-12T17:14:07.960 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.958+0000 7f9e87fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:14:07.962 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.959+0000 7f9fd3a20800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:14:07.962 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.959+0000 7f9fd3a20800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:14:07.962 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.959+0000 7f9fd3a20800 5 note: GC not initialized 2024-09-12T17:14:07.963 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.959+0000 7f9e86fe5640 20 reqs_thread_entry: start 2024-09-12T17:14:07.963 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.959+0000 7f9fd3a20800 20 init_complete bucket index max shards: 11 2024-09-12T17:14:07.963 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.959+0000 7f9fd3a20800 20 Filter name: none 2024-09-12T17:14:07.963 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.959+0000 7f9e84fe1640 20 reqs_thread_entry: start 2024-09-12T17:14:07.963 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.959+0000 7f9fd3a20800 20 rados->read ofs=0 len=0 2024-09-12T17:14:07.963 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.960+0000 7f9fd3a20800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:14:07.963 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.960+0000 7f9fd3a20800 20 rados->read ofs=0 len=0 2024-09-12T17:14:07.963 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.960+0000 7f9fd3a20800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:14:07.963 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.960+0000 7f9fd3a20800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:14:07.963 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.960+0000 7f9fd3a20800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T17:14:07.964 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.960+0000 7f9fd3a20800 20 INFO: main: starting shard=0 2024-09-12T17:14:07.964 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.960+0000 7f9fd3a20800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.0 2024-09-12T17:14:07.965 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.961+0000 7f9fd3a20800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:14:07.965 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.961+0000 7f9fd3a20800 20 INFO: main: starting shard=1 2024-09-12T17:14:07.965 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.961+0000 7f9fd3a20800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.1 2024-09-12T17:14:07.966 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.961+0000 7f9fd3a20800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:14:07.966 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.961+0000 7f9fd3a20800 20 INFO: main: starting shard=2 2024-09-12T17:14:07.966 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.961+0000 7f9fd3a20800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.2 2024-09-12T17:14:07.966 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.962+0000 7f9fd3a20800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:14:07.966 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.962+0000 7f9fd3a20800 20 INFO: main: starting shard=3 2024-09-12T17:14:07.966 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.962+0000 7f9fd3a20800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.3 2024-09-12T17:14:07.966 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.963+0000 7f9fd3a20800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:14:07.966 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.963+0000 7f9fd3a20800 20 INFO: main: starting shard=4 2024-09-12T17:14:07.966 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.963+0000 7f9fd3a20800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.4 2024-09-12T17:14:07.967 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.964+0000 7f9fd3a20800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:14:07.968 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.964+0000 7f9fd3a20800 20 INFO: main: starting shard=5 2024-09-12T17:14:07.968 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.964+0000 7f9fd3a20800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.5 2024-09-12T17:14:07.968 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.964+0000 7f9fd3a20800 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-12T17:14:07.968 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.964+0000 7f9fd3a20800 20 INFO: main: starting shard=6 2024-09-12T17:14:07.968 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.964+0000 7f9fd3a20800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.6 2024-09-12T17:14:07.968 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.965+0000 7f9fd3a20800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:14:07.968 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.965+0000 7f9fd3a20800 20 INFO: main: starting shard=7 2024-09-12T17:14:07.968 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.965+0000 7f9fd3a20800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.7 2024-09-12T17:14:07.969 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.966+0000 7f9fd3a20800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:14:07.969 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.966+0000 7f9fd3a20800 20 INFO: main: starting shard=8 2024-09-12T17:14:07.969 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.966+0000 7f9fd3a20800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.8 2024-09-12T17:14:07.969 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.966+0000 7f9fd3a20800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:14:07.969 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.966+0000 7f9fd3a20800 20 INFO: main: starting shard=9 2024-09-12T17:14:07.970 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.966+0000 7f9fd3a20800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.9 2024-09-12T17:14:07.970 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.967+0000 7f9fd3a20800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:14:07.970 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.967+0000 7f9fd3a20800 20 INFO: main: starting shard=10 2024-09-12T17:14:07.970 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.967+0000 7f9fd3a20800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.10 2024-09-12T17:14:07.970 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.968+0000 7f9fd3a20800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:14:07.970 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.968+0000 7f9fd3a20800 20 INFO: main: done 2024-09-12T17:14:07.971 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.969+0000 7f9e87fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:14:07.973 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.971+0000 7f9fd3a20800 20 remove_watcher() i=0 2024-09-12T17:14:07.973 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.971+0000 7f9fd3a20800 2 removed watcher, disabling cache 2024-09-12T17:14:07.974 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.973+0000 7f9fd3a20800 20 remove_watcher() i=1 2024-09-12T17:14:07.976 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.974+0000 7f9fd3a20800 20 remove_watcher() i=2 2024-09-12T17:14:07.977 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.975+0000 7f9fd3a20800 20 remove_watcher() i=3 2024-09-12T17:14:07.978 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.976+0000 7f9fd3a20800 20 remove_watcher() i=4 2024-09-12T17:14:07.979 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.977+0000 7f9fd3a20800 20 remove_watcher() i=5 2024-09-12T17:14:07.981 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.979+0000 7f9fd3a20800 20 remove_watcher() i=6 2024-09-12T17:14:07.982 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:07.980+0000 7f9fd3a20800 20 remove_watcher() i=7 2024-09-12T17:14:08.125 INFO:tasks.workunit.client.0.smithi037.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T17:14:08.127 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bi list --bucket check-bucket --object e 2024-09-12T17:14:08.158 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:14:08.158 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:14:08.201 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.196+0000 7f5205d25800 20 rados->read ofs=0 len=0 2024-09-12T17:14:08.202 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.197+0000 7f5205d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:08.202 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.197+0000 7f5205d25800 20 realm 2024-09-12T17:14:08.202 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.197+0000 7f5205d25800 20 rados->read ofs=0 len=0 2024-09-12T17:14:08.202 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.197+0000 7f5205d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:08.202 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.197+0000 7f5205d25800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:14:08.202 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.197+0000 7f5205d25800 20 rados->read ofs=0 len=0 2024-09-12T17:14:08.202 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.197+0000 7f5205d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:08.202 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.197+0000 7f5205d25800 20 rados->read ofs=0 len=0 2024-09-12T17:14:08.202 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.198+0000 7f5205d25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:14:08.202 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.198+0000 7f5205d25800 20 rados->read ofs=0 len=0 2024-09-12T17:14:08.202 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.199+0000 7f5205d25800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:14:08.203 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.199+0000 7f5205d25800 20 searching for the correct realm 2024-09-12T17:14:08.204 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.202+0000 7f5202134640 0 -- 172.21.15.37:0/1534383667 >> [v2:172.21.15.40:6818/1210108009,v1:172.21.15.40:6819/1210108009] conn(0x7f51f80ad960 msgr2=0x7f51f80d3ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:14:08.208 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.206+0000 7f5201933640 0 -- 172.21.15.37:0/1534383667 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7f51f80c6210 msgr2=0x7f51f80bf790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:14:08.415 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.412+0000 7f5205d25800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:14:08.415 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.412+0000 7f5205d25800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:14:08.415 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.412+0000 7f5205d25800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:14:08.415 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.412+0000 7f5205d25800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:14:08.415 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.412+0000 7f5205d25800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:14:08.415 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.412+0000 7f5205d25800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:14:08.415 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.412+0000 7f5205d25800 20 rados->read ofs=0 len=0 2024-09-12T17:14:08.415 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.413+0000 7f5205d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:08.416 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.413+0000 7f5205d25800 20 rados->read ofs=0 len=0 2024-09-12T17:14:08.417 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.413+0000 7f5205d25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:14:08.417 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.413+0000 7f5205d25800 20 rados->read ofs=0 len=0 2024-09-12T17:14:08.417 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.414+0000 7f5205d25800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:14:08.417 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.414+0000 7f5205d25800 20 zone default found 2024-09-12T17:14:08.417 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.414+0000 7f5205d25800 4 Realm: () 2024-09-12T17:14:08.417 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.414+0000 7f5205d25800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:14:08.417 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.414+0000 7f5205d25800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:14:08.417 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.414+0000 7f5205d25800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:14:08.417 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.414+0000 7f5205d25800 20 zonegroup default 2024-09-12T17:14:08.418 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.414+0000 7f5205d25800 20 rados->read ofs=0 len=0 2024-09-12T17:14:08.418 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.414+0000 7f5205d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:08.418 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.414+0000 7f5205d25800 20 rados->read ofs=0 len=0 2024-09-12T17:14:08.418 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.414+0000 7f5205d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:08.418 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.414+0000 7f5205d25800 20 rados->read ofs=0 len=0 2024-09-12T17:14:08.418 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.414+0000 7f5205d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:08.418 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.414+0000 7f5205d25800 20 started sync module instance, tier type = 2024-09-12T17:14:08.418 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.414+0000 7f5205d25800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:14:08.433 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.430+0000 7f5205d25800 20 add_watcher() i=0 2024-09-12T17:14:08.433 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.430+0000 7f5205d25800 20 add_watcher() i=1 2024-09-12T17:14:08.433 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.430+0000 7f5205d25800 20 add_watcher() i=2 2024-09-12T17:14:08.433 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.430+0000 7f5205d25800 20 add_watcher() i=3 2024-09-12T17:14:08.433 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.430+0000 7f5205d25800 20 add_watcher() i=4 2024-09-12T17:14:08.433 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.430+0000 7f5205d25800 20 add_watcher() i=5 2024-09-12T17:14:08.435 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.433+0000 7f5205d25800 20 add_watcher() i=6 2024-09-12T17:14:08.435 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.433+0000 7f5205d25800 20 add_watcher() i=7 2024-09-12T17:14:08.435 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.433+0000 7f5205d25800 2 all 8 watchers are set, enabling cache 2024-09-12T17:14:08.437 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.435+0000 7f50b37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:14:08.438 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.435+0000 7f5205d25800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:14:08.438 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.435+0000 7f5205d25800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:14:08.438 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.435+0000 7f5205d25800 5 note: GC not initialized 2024-09-12T17:14:08.438 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.435+0000 7f50b27fc640 20 reqs_thread_entry: start 2024-09-12T17:14:08.438 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.435+0000 7f5205d25800 20 init_complete bucket index max shards: 11 2024-09-12T17:14:08.438 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.435+0000 7f5205d25800 20 Filter name: none 2024-09-12T17:14:08.438 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.436+0000 7f5023fff640 20 reqs_thread_entry: start 2024-09-12T17:14:08.438 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.436+0000 7f5205d25800 20 rados->read ofs=0 len=0 2024-09-12T17:14:08.438 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.436+0000 7f5205d25800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:14:08.438 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.436+0000 7f5205d25800 20 rados->read ofs=0 len=0 2024-09-12T17:14:08.439 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.436+0000 7f5205d25800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:14:08.439 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.436+0000 7f5205d25800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:14:08.439 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.436+0000 7f5205d25800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T17:14:08.439 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.436+0000 7f5205d25800 20 INFO: main: starting shard=0 2024-09-12T17:14:08.440 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.436+0000 7f5205d25800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.0 2024-09-12T17:14:08.440 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.437+0000 7f5205d25800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:14:08.440 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.437+0000 7f5205d25800 20 INFO: main: starting shard=1 2024-09-12T17:14:08.440 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.437+0000 7f5205d25800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.1 2024-09-12T17:14:08.440 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.438+0000 7f5205d25800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T17:14:08.440 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.438+0000 7f5205d25800 20 INFO: main: starting shard=2 2024-09-12T17:14:08.441 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.438+0000 7f5205d25800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.2 2024-09-12T17:14:08.441 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.438+0000 7f5205d25800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:14:08.441 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.438+0000 7f5205d25800 20 INFO: main: starting shard=3 2024-09-12T17:14:08.441 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.438+0000 7f5205d25800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.3 2024-09-12T17:14:08.441 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.439+0000 7f5205d25800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:14:08.441 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.439+0000 7f5205d25800 20 INFO: main: starting shard=4 2024-09-12T17:14:08.441 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.439+0000 7f5205d25800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.4 2024-09-12T17:14:08.442 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.440+0000 7f5205d25800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:14:08.442 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.440+0000 7f5205d25800 20 INFO: main: starting shard=5 2024-09-12T17:14:08.442 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.440+0000 7f5205d25800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.5 2024-09-12T17:14:08.443 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.441+0000 7f5205d25800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:14:08.443 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.441+0000 7f5205d25800 20 INFO: main: starting shard=6 2024-09-12T17:14:08.443 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.441+0000 7f5205d25800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.6 2024-09-12T17:14:08.443 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.441+0000 7f5205d25800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:14:08.443 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.441+0000 7f5205d25800 20 INFO: main: starting shard=7 2024-09-12T17:14:08.443 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.441+0000 7f5205d25800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.7 2024-09-12T17:14:08.444 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.442+0000 7f5205d25800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:14:08.444 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.442+0000 7f5205d25800 20 INFO: main: starting shard=8 2024-09-12T17:14:08.444 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.442+0000 7f5205d25800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.8 2024-09-12T17:14:08.444 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.443+0000 7f5205d25800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:14:08.445 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.443+0000 7f5205d25800 20 INFO: main: starting shard=9 2024-09-12T17:14:08.445 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.443+0000 7f5205d25800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.9 2024-09-12T17:14:08.445 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.443+0000 7f5205d25800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:14:08.445 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.443+0000 7f5205d25800 20 INFO: main: starting shard=10 2024-09-12T17:14:08.445 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.443+0000 7f5205d25800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.10 2024-09-12T17:14:08.446 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.444+0000 7f5205d25800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:14:08.446 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.444+0000 7f5205d25800 20 INFO: main: done 2024-09-12T17:14:08.446 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.445+0000 7f50b37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:14:08.449 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.447+0000 7f5205d25800 20 remove_watcher() i=0 2024-09-12T17:14:08.450 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.447+0000 7f5205d25800 2 removed watcher, disabling cache 2024-09-12T17:14:08.450 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.449+0000 7f5205d25800 20 remove_watcher() i=1 2024-09-12T17:14:08.452 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.450+0000 7f5205d25800 20 remove_watcher() i=2 2024-09-12T17:14:08.453 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.451+0000 7f5205d25800 20 remove_watcher() i=3 2024-09-12T17:14:08.454 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.452+0000 7f5205d25800 20 remove_watcher() i=4 2024-09-12T17:14:08.455 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.453+0000 7f5205d25800 20 remove_watcher() i=5 2024-09-12T17:14:08.457 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.455+0000 7f5205d25800 20 remove_watcher() i=6 2024-09-12T17:14:08.457 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.456+0000 7f5205d25800 20 remove_watcher() i=7 2024-09-12T17:14:08.574 INFO:tasks.workunit.client.0.smithi037.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T17:14:08.575 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bi list --bucket check-bucket --object f 2024-09-12T17:14:08.609 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:14:08.609 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:14:08.649 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.646+0000 7f4586115800 20 rados->read ofs=0 len=0 2024-09-12T17:14:08.650 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.648+0000 7f4586115800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:08.650 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.648+0000 7f4586115800 20 realm 2024-09-12T17:14:08.650 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.648+0000 7f4586115800 20 rados->read ofs=0 len=0 2024-09-12T17:14:08.651 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.648+0000 7f4586115800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:08.651 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.648+0000 7f4586115800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:14:08.651 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.648+0000 7f4586115800 20 rados->read ofs=0 len=0 2024-09-12T17:14:08.651 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.648+0000 7f4586115800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:08.651 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.648+0000 7f4586115800 20 rados->read ofs=0 len=0 2024-09-12T17:14:08.652 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.649+0000 7f4586115800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:14:08.652 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.649+0000 7f4586115800 20 rados->read ofs=0 len=0 2024-09-12T17:14:08.652 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.650+0000 7f4586115800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:14:08.652 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.650+0000 7f4586115800 20 searching for the correct realm 2024-09-12T17:14:08.655 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.653+0000 7f45833fe640 0 -- 172.21.15.37:0/1891081659 >> [v2:172.21.15.37:6816/2964054205,v1:172.21.15.37:6817/2964054205] conn(0x5558ece24e20 msgr2=0x5558ece272c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:14:08.659 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.657+0000 7f4583bff640 0 -- 172.21.15.37:0/1891081659 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7f457802f040 msgr2=0x7f457802e950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:14:08.664 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.661+0000 7f4586115800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:14:08.664 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.661+0000 7f4586115800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:14:08.664 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.661+0000 7f4586115800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:14:08.664 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.661+0000 7f4586115800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:14:08.664 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.661+0000 7f4586115800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:14:08.664 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.661+0000 7f4586115800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:14:08.665 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.661+0000 7f4586115800 20 rados->read ofs=0 len=0 2024-09-12T17:14:08.665 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.662+0000 7f4586115800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:08.665 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.662+0000 7f4586115800 20 rados->read ofs=0 len=0 2024-09-12T17:14:08.665 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.662+0000 7f4586115800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:14:08.665 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.662+0000 7f4586115800 20 rados->read ofs=0 len=0 2024-09-12T17:14:08.666 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.662+0000 7f4586115800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:14:08.666 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.662+0000 7f4586115800 20 zone default found 2024-09-12T17:14:08.666 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.662+0000 7f4586115800 4 Realm: () 2024-09-12T17:14:08.666 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.662+0000 7f4586115800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:14:08.667 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.662+0000 7f4586115800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:14:08.667 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.662+0000 7f4586115800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:14:08.667 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.662+0000 7f4586115800 20 zonegroup default 2024-09-12T17:14:08.667 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.662+0000 7f4586115800 20 rados->read ofs=0 len=0 2024-09-12T17:14:08.667 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.663+0000 7f4586115800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:08.667 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.663+0000 7f4586115800 20 rados->read ofs=0 len=0 2024-09-12T17:14:08.667 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.663+0000 7f4586115800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:08.667 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.663+0000 7f4586115800 20 rados->read ofs=0 len=0 2024-09-12T17:14:08.667 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.663+0000 7f4586115800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:08.667 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.663+0000 7f4586115800 20 started sync module instance, tier type = 2024-09-12T17:14:08.668 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.663+0000 7f4586115800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:14:08.679 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.677+0000 7f4586115800 20 add_watcher() i=0 2024-09-12T17:14:08.679 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.677+0000 7f4586115800 20 add_watcher() i=1 2024-09-12T17:14:08.679 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.677+0000 7f4586115800 20 add_watcher() i=2 2024-09-12T17:14:08.679 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.677+0000 7f4586115800 20 add_watcher() i=3 2024-09-12T17:14:08.679 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.677+0000 7f4586115800 20 add_watcher() i=4 2024-09-12T17:14:08.679 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.677+0000 7f4586115800 20 add_watcher() i=5 2024-09-12T17:14:08.679 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.677+0000 7f4586115800 20 add_watcher() i=6 2024-09-12T17:14:08.680 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.678+0000 7f4586115800 20 add_watcher() i=7 2024-09-12T17:14:08.680 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.678+0000 7f4586115800 2 all 8 watchers are set, enabling cache 2024-09-12T17:14:08.681 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.679+0000 7f4439fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:14:08.682 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.680+0000 7f4586115800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:14:08.682 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.680+0000 7f4586115800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:14:08.682 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.680+0000 7f4586115800 5 note: GC not initialized 2024-09-12T17:14:08.683 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.680+0000 7f4438fe1640 20 reqs_thread_entry: start 2024-09-12T17:14:08.683 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.680+0000 7f4586115800 20 init_complete bucket index max shards: 11 2024-09-12T17:14:08.683 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.680+0000 7f4586115800 20 Filter name: none 2024-09-12T17:14:08.683 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.680+0000 7f43b27fc640 20 reqs_thread_entry: start 2024-09-12T17:14:08.683 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.680+0000 7f4586115800 20 rados->read ofs=0 len=0 2024-09-12T17:14:08.684 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.681+0000 7f4586115800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:14:08.684 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.681+0000 7f4586115800 20 rados->read ofs=0 len=0 2024-09-12T17:14:08.684 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.681+0000 7f4586115800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:14:08.684 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.681+0000 7f4586115800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:14:08.684 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.681+0000 7f4586115800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T17:14:08.684 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.681+0000 7f4586115800 20 INFO: main: starting shard=0 2024-09-12T17:14:08.684 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.681+0000 7f4586115800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.0 2024-09-12T17:14:08.685 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.682+0000 7f4586115800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:14:08.685 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.682+0000 7f4586115800 20 INFO: main: starting shard=1 2024-09-12T17:14:08.685 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.682+0000 7f4586115800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.1 2024-09-12T17:14:08.685 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.683+0000 7f4586115800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:14:08.685 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.683+0000 7f4586115800 20 INFO: main: starting shard=2 2024-09-12T17:14:08.685 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.683+0000 7f4586115800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.2 2024-09-12T17:14:08.685 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.683+0000 7f4586115800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:14:08.685 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.683+0000 7f4586115800 20 INFO: main: starting shard=3 2024-09-12T17:14:08.686 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.683+0000 7f4586115800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.3 2024-09-12T17:14:08.686 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.684+0000 7f4586115800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:14:08.686 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.684+0000 7f4586115800 20 INFO: main: starting shard=4 2024-09-12T17:14:08.686 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.684+0000 7f4586115800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.4 2024-09-12T17:14:08.686 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.684+0000 7f4586115800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:14:08.687 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.684+0000 7f4586115800 20 INFO: main: starting shard=5 2024-09-12T17:14:08.687 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.684+0000 7f4586115800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.5 2024-09-12T17:14:08.687 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.685+0000 7f4586115800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:14:08.687 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.685+0000 7f4586115800 20 INFO: main: starting shard=6 2024-09-12T17:14:08.687 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.685+0000 7f4586115800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.6 2024-09-12T17:14:08.688 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.686+0000 7f4586115800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:14:08.688 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.686+0000 7f4586115800 20 INFO: main: starting shard=7 2024-09-12T17:14:08.688 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.686+0000 7f4586115800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.7 2024-09-12T17:14:08.688 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.686+0000 7f4586115800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:14:08.689 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.686+0000 7f4586115800 20 INFO: main: starting shard=8 2024-09-12T17:14:08.689 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.686+0000 7f4586115800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.8 2024-09-12T17:14:08.689 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.687+0000 7f4586115800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:14:08.689 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.687+0000 7f4586115800 20 INFO: main: starting shard=9 2024-09-12T17:14:08.689 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.687+0000 7f4586115800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.9 2024-09-12T17:14:08.689 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.687+0000 7f4586115800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:14:08.690 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.687+0000 7f4586115800 20 INFO: main: starting shard=10 2024-09-12T17:14:08.690 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.687+0000 7f4586115800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.10 2024-09-12T17:14:08.690 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.688+0000 7f4586115800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T17:14:08.690 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.688+0000 7f4586115800 20 INFO: main: done 2024-09-12T17:14:08.691 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.689+0000 7f4439fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:14:08.693 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.691+0000 7f4586115800 20 remove_watcher() i=0 2024-09-12T17:14:08.693 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.691+0000 7f4586115800 2 removed watcher, disabling cache 2024-09-12T17:14:08.694 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.693+0000 7f4586115800 20 remove_watcher() i=1 2024-09-12T17:14:08.696 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.694+0000 7f4586115800 20 remove_watcher() i=2 2024-09-12T17:14:08.697 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.695+0000 7f4586115800 20 remove_watcher() i=3 2024-09-12T17:14:08.698 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.696+0000 7f4586115800 20 remove_watcher() i=4 2024-09-12T17:14:08.699 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.697+0000 7f4586115800 20 remove_watcher() i=5 2024-09-12T17:14:08.701 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.699+0000 7f4586115800 20 remove_watcher() i=6 2024-09-12T17:14:08.702 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:08.700+0000 7f4586115800 20 remove_watcher() i=7 2024-09-12T17:14:08.738 INFO:tasks.workunit.client.0.smithi037.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-12T17:14:09.162 INFO:tasks.workunit.client.0.smithi037.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-09-12T17:14:09.573 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bucket check --fix --bucket check-bucket 2024-09-12T17:14:09.603 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:14:09.603 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:14:09.643 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:09.641+0000 7f0a8a125800 20 rados->read ofs=0 len=0 2024-09-12T17:14:09.645 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:09.642+0000 7f0a8a125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:09.645 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:09.642+0000 7f0a8a125800 20 realm 2024-09-12T17:14:09.645 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:09.642+0000 7f0a8a125800 20 rados->read ofs=0 len=0 2024-09-12T17:14:09.645 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:09.643+0000 7f0a8a125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:09.645 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:09.643+0000 7f0a8a125800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:14:09.645 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:09.643+0000 7f0a8a125800 20 rados->read ofs=0 len=0 2024-09-12T17:14:09.645 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:09.643+0000 7f0a8a125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:09.645 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:09.643+0000 7f0a8a125800 20 rados->read ofs=0 len=0 2024-09-12T17:14:09.646 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:09.644+0000 7f0a8a125800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:14:09.646 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:09.644+0000 7f0a8a125800 20 rados->read ofs=0 len=0 2024-09-12T17:14:09.646 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:09.644+0000 7f0a8a125800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:14:09.646 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:09.644+0000 7f0a8a125800 20 searching for the correct realm 2024-09-12T17:14:09.648 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:09.646+0000 7f0a85db5640 0 -- 172.21.15.37:0/4049804415 >> [v2:172.21.15.37:6800/1206746176,v1:172.21.15.37:6801/1206746176] conn(0x7f0a80021060 msgr2=0x7f0a8008a7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:14:09.855 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:09.852+0000 7f0a865b6640 0 -- 172.21.15.37:0/4049804415 >> [v2:172.21.15.40:6818/1210108009,v1:172.21.15.40:6819/1210108009] conn(0x7f0a7002d070 msgr2=0x7f0a7002d450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:14:09.861 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:09.859+0000 7f0a8a125800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:14:09.861 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:09.859+0000 7f0a8a125800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:14:09.861 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:09.859+0000 7f0a8a125800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:14:09.861 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:09.859+0000 7f0a8a125800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:14:09.861 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:09.859+0000 7f0a8a125800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:14:09.861 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:09.859+0000 7f0a8a125800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:14:09.861 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:09.859+0000 7f0a8a125800 20 rados->read ofs=0 len=0 2024-09-12T17:14:09.861 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:09.859+0000 7f0a8a125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:09.862 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:09.859+0000 7f0a8a125800 20 rados->read ofs=0 len=0 2024-09-12T17:14:09.862 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:09.860+0000 7f0a8a125800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:14:09.862 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:09.860+0000 7f0a8a125800 20 rados->read ofs=0 len=0 2024-09-12T17:14:09.863 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:09.860+0000 7f0a8a125800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:14:09.863 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:09.860+0000 7f0a8a125800 20 zone default found 2024-09-12T17:14:09.863 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:09.860+0000 7f0a8a125800 4 Realm: () 2024-09-12T17:14:09.863 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:09.860+0000 7f0a8a125800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:14:09.863 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:09.860+0000 7f0a8a125800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:14:09.863 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:09.860+0000 7f0a8a125800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:14:09.863 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:09.860+0000 7f0a8a125800 20 zonegroup default 2024-09-12T17:14:09.863 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:09.860+0000 7f0a8a125800 20 rados->read ofs=0 len=0 2024-09-12T17:14:09.863 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:09.860+0000 7f0a8a125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:09.863 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:09.860+0000 7f0a8a125800 20 rados->read ofs=0 len=0 2024-09-12T17:14:09.864 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:09.861+0000 7f0a8a125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:09.864 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:09.861+0000 7f0a8a125800 20 rados->read ofs=0 len=0 2024-09-12T17:14:09.864 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:09.861+0000 7f0a8a125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:09.864 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:09.861+0000 7f0a8a125800 20 started sync module instance, tier type = 2024-09-12T17:14:09.864 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:09.861+0000 7f0a8a125800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:14:09.874 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:09.872+0000 7f0a8a125800 20 add_watcher() i=0 2024-09-12T17:14:09.874 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:09.872+0000 7f0a8a125800 20 add_watcher() i=1 2024-09-12T17:14:09.874 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:09.872+0000 7f0a8a125800 20 add_watcher() i=2 2024-09-12T17:14:09.874 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:09.872+0000 7f0a8a125800 20 add_watcher() i=3 2024-09-12T17:14:09.874 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:09.872+0000 7f0a8a125800 20 add_watcher() i=4 2024-09-12T17:14:09.874 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:09.872+0000 7f0a8a125800 20 add_watcher() i=5 2024-09-12T17:14:09.876 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:09.874+0000 7f0a8a125800 20 add_watcher() i=6 2024-09-12T17:14:09.877 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:09.874+0000 7f0a8a125800 20 add_watcher() i=7 2024-09-12T17:14:09.877 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:09.874+0000 7f0a8a125800 2 all 8 watchers are set, enabling cache 2024-09-12T17:14:09.878 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:09.876+0000 7f0937fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:14:09.880 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:09.877+0000 7f0a8a125800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:14:09.880 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:09.877+0000 7f0a8a125800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:14:09.880 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:09.877+0000 7f0a8a125800 5 note: GC not initialized 2024-09-12T17:14:09.880 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:09.877+0000 7f0936ffd640 20 reqs_thread_entry: start 2024-09-12T17:14:09.880 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:09.877+0000 7f0a8a125800 20 init_complete bucket index max shards: 11 2024-09-12T17:14:09.880 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:09.877+0000 7f0a8a125800 20 Filter name: none 2024-09-12T17:14:09.880 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:09.877+0000 7f0934ff9640 20 reqs_thread_entry: start 2024-09-12T17:14:09.880 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:09.877+0000 7f0a8a125800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T17:14:09.881 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:09.877+0000 7f0a8a125800 20 rados->read ofs=0 len=0 2024-09-12T17:14:09.881 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:09.878+0000 7f0a8a125800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:14:09.881 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:09.878+0000 7f0a8a125800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T17:14:09.881 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:09.878+0000 7f0a8a125800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T17:14:09.881 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:09.878+0000 7f0a8a125800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2 : miss 2024-09-12T17:14:09.881 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:09.878+0000 7f0a8a125800 20 rados->read ofs=0 len=0 2024-09-12T17:14:09.882 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:09.878+0000 7f0a8a125800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:14:09.882 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:09.878+0000 7f0a8a125800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2 info.flags=0x17 2024-09-12T17:14:09.882 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:09.878+0000 7f0a8a125800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2 to cache LRU end 2024-09-12T17:14:09.882 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:09.878+0000 7f0a8a125800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:14:09.882 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:09.878+0000 7f0a8a125800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T17:14:09.882 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:09.878+0000 7f0a8a125800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2 2024-09-12T17:14:09.882 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:09.878+0000 7f0a8a125800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.0 2024-09-12T17:14:09.882 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:09.879+0000 7f0a8a125800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.1 2024-09-12T17:14:09.883 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:09.880+0000 7f0a8a125800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.2 2024-09-12T17:14:09.883 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:09.881+0000 7f0a8a125800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.3 2024-09-12T17:14:09.883 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:09.881+0000 7f0a8a125800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.4 2024-09-12T17:14:09.884 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:09.882+0000 7f0a8a125800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.5 2024-09-12T17:14:09.885 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:09.883+0000 7f0a8a125800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.6 2024-09-12T17:14:09.885 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:09.883+0000 7f0a8a125800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.7 2024-09-12T17:14:09.886 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:09.884+0000 7f0a8a125800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.8 2024-09-12T17:14:09.887 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:09.885+0000 7f0a8a125800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.9 2024-09-12T17:14:09.887 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:09.886+0000 7f0a8a125800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.10 2024-09-12T17:14:09.897 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:09.895+0000 7f0937fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:14:09.900 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:09.898+0000 7f0a8a125800 20 remove_watcher() i=0 2024-09-12T17:14:09.900 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:09.898+0000 7f0a8a125800 2 removed watcher, disabling cache 2024-09-12T17:14:09.901 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:09.899+0000 7f0a8a125800 20 remove_watcher() i=1 2024-09-12T17:14:09.902 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:09.900+0000 7f0a8a125800 20 remove_watcher() i=2 2024-09-12T17:14:09.903 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:09.902+0000 7f0a8a125800 20 remove_watcher() i=3 2024-09-12T17:14:09.905 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:09.903+0000 7f0a8a125800 20 remove_watcher() i=4 2024-09-12T17:14:09.906 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:09.904+0000 7f0a8a125800 20 remove_watcher() i=5 2024-09-12T17:14:09.910 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:09.908+0000 7f0a8a125800 20 remove_watcher() i=6 2024-09-12T17:14:09.911 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:09.909+0000 7f0a8a125800 20 remove_watcher() i=7 2024-09-12T17:14:09.923 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-12T17:14:09.959 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:14:09.959 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:14:09.999 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:09.996+0000 7f3d4c330800 20 rados->read ofs=0 len=0 2024-09-12T17:14:10.000 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:09.998+0000 7f3d4c330800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:10.000 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:09.998+0000 7f3d4c330800 20 realm 2024-09-12T17:14:10.000 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:09.998+0000 7f3d4c330800 20 rados->read ofs=0 len=0 2024-09-12T17:14:10.000 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:09.998+0000 7f3d4c330800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:10.001 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:09.998+0000 7f3d4c330800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:14:10.001 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:09.998+0000 7f3d4c330800 20 rados->read ofs=0 len=0 2024-09-12T17:14:10.001 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:09.998+0000 7f3d4c330800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:10.001 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:09.998+0000 7f3d4c330800 20 rados->read ofs=0 len=0 2024-09-12T17:14:10.001 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:09.999+0000 7f3d4c330800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:14:10.001 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:09.999+0000 7f3d4c330800 20 rados->read ofs=0 len=0 2024-09-12T17:14:10.002 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:09.999+0000 7f3d4c330800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:14:10.002 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:09.999+0000 7f3d4c330800 20 searching for the correct realm 2024-09-12T17:14:10.005 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.003+0000 7f3d478af640 0 -- 172.21.15.37:0/2691446871 >> [v2:172.21.15.40:6800/2441293461,v1:172.21.15.40:6801/2441293461] conn(0x7f3d3801e060 msgr2=0x7f3d380899a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:14:10.009 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.007+0000 7f3d478af640 0 -- 172.21.15.37:0/2691446871 >> [v2:172.21.15.40:6800/2441293461,v1:172.21.15.40:6801/2441293461] conn(0x7f3c18084050 msgr2=0x7f3c18086480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:14:10.014 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.011+0000 7f3d4c330800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:14:10.014 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.011+0000 7f3d4c330800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:14:10.014 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.011+0000 7f3d4c330800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:14:10.014 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.011+0000 7f3d4c330800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:14:10.014 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.011+0000 7f3d4c330800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:14:10.014 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.011+0000 7f3d4c330800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:14:10.014 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.011+0000 7f3d4c330800 20 rados->read ofs=0 len=0 2024-09-12T17:14:10.014 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.011+0000 7f3d4c330800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:10.015 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.011+0000 7f3d4c330800 20 rados->read ofs=0 len=0 2024-09-12T17:14:10.015 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.012+0000 7f3d4c330800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:14:10.015 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.012+0000 7f3d4c330800 20 rados->read ofs=0 len=0 2024-09-12T17:14:10.016 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.012+0000 7f3d4c330800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:14:10.016 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.012+0000 7f3d4c330800 20 zone default found 2024-09-12T17:14:10.016 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.012+0000 7f3d4c330800 4 Realm: () 2024-09-12T17:14:10.016 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.012+0000 7f3d4c330800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:14:10.016 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.012+0000 7f3d4c330800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:14:10.016 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.012+0000 7f3d4c330800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:14:10.016 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.012+0000 7f3d4c330800 20 zonegroup default 2024-09-12T17:14:10.016 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.012+0000 7f3d4c330800 20 rados->read ofs=0 len=0 2024-09-12T17:14:10.016 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.012+0000 7f3d4c330800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:10.016 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.012+0000 7f3d4c330800 20 rados->read ofs=0 len=0 2024-09-12T17:14:10.016 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.013+0000 7f3d4c330800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:10.017 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.013+0000 7f3d4c330800 20 rados->read ofs=0 len=0 2024-09-12T17:14:10.017 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.013+0000 7f3d4c330800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:10.017 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.013+0000 7f3d4c330800 20 started sync module instance, tier type = 2024-09-12T17:14:10.017 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.013+0000 7f3d4c330800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:14:10.030 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.028+0000 7f3d4c330800 20 add_watcher() i=0 2024-09-12T17:14:10.031 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.028+0000 7f3d4c330800 20 add_watcher() i=1 2024-09-12T17:14:10.031 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.028+0000 7f3d4c330800 20 add_watcher() i=2 2024-09-12T17:14:10.031 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.028+0000 7f3d4c330800 20 add_watcher() i=3 2024-09-12T17:14:10.031 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.028+0000 7f3d4c330800 20 add_watcher() i=4 2024-09-12T17:14:10.034 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.031+0000 7f3d4c330800 20 add_watcher() i=5 2024-09-12T17:14:10.037 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.035+0000 7f3d4c330800 20 add_watcher() i=6 2024-09-12T17:14:10.038 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.035+0000 7f3d4c330800 20 add_watcher() i=7 2024-09-12T17:14:10.038 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.035+0000 7f3d4c330800 2 all 8 watchers are set, enabling cache 2024-09-12T17:14:10.039 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.037+0000 7f3bfe7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:14:10.042 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.037+0000 7f3d4c330800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:14:10.042 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.037+0000 7f3d4c330800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:14:10.042 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.037+0000 7f3d4c330800 5 note: GC not initialized 2024-09-12T17:14:10.043 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.037+0000 7f3bfd7e2640 20 reqs_thread_entry: start 2024-09-12T17:14:10.043 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.037+0000 7f3d4c330800 20 init_complete bucket index max shards: 11 2024-09-12T17:14:10.043 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.037+0000 7f3d4c330800 20 Filter name: none 2024-09-12T17:14:10.043 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.038+0000 7f3b6effd640 20 reqs_thread_entry: start 2024-09-12T17:14:10.043 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.038+0000 7f3d4c330800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T17:14:10.043 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.038+0000 7f3d4c330800 20 rados->read ofs=0 len=0 2024-09-12T17:14:10.043 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.038+0000 7f3d4c330800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:14:10.043 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.038+0000 7f3d4c330800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T17:14:10.043 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.038+0000 7f3d4c330800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T17:14:10.044 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.038+0000 7f3d4c330800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2 : miss 2024-09-12T17:14:10.044 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.038+0000 7f3d4c330800 20 rados->read ofs=0 len=0 2024-09-12T17:14:10.044 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.039+0000 7f3d4c330800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:14:10.044 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.039+0000 7f3d4c330800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2 info.flags=0x17 2024-09-12T17:14:10.044 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.039+0000 7f3d4c330800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2 to cache LRU end 2024-09-12T17:14:10.044 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.039+0000 7f3d4c330800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:14:10.044 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.039+0000 7f3d4c330800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T17:14:10.044 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.039+0000 7f3d4c330800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2 2024-09-12T17:14:10.044 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.039+0000 7f3d4c330800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.0 2024-09-12T17:14:10.044 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.039+0000 7f3d4c330800 1 NOTICE: finished shard 0 (0 entries removed) 2024-09-12T17:14:10.044 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.039+0000 7f3d4c330800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.1 2024-09-12T17:14:10.045 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.040+0000 7f3d4c330800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.2 2024-09-12T17:14:10.045 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.041+0000 7f3d4c330800 1 NOTICE: finished shard 2 (0 entries removed) 2024-09-12T17:14:10.045 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.041+0000 7f3d4c330800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.3 2024-09-12T17:14:10.046 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.041+0000 7f3d4c330800 1 NOTICE: finished shard 3 (0 entries removed) 2024-09-12T17:14:10.046 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.041+0000 7f3d4c330800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.4 2024-09-12T17:14:10.046 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.042+0000 7f3d4c330800 1 NOTICE: finished shard 4 (0 entries removed) 2024-09-12T17:14:10.046 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.042+0000 7f3d4c330800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.5 2024-09-12T17:14:10.046 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.042+0000 7f3d4c330800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.6 2024-09-12T17:14:10.046 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.043+0000 7f3d4c330800 1 NOTICE: finished shard 6 (0 entries removed) 2024-09-12T17:14:10.046 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.043+0000 7f3d4c330800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.7 2024-09-12T17:14:10.046 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.043+0000 7f3d4c330800 1 NOTICE: finished shard 7 (0 entries removed) 2024-09-12T17:14:10.046 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.043+0000 7f3d4c330800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.8 2024-09-12T17:14:10.047 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.044+0000 7f3d4c330800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.9 2024-09-12T17:14:10.047 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.045+0000 7f3d4c330800 1 NOTICE: finished shard 9 (0 entries removed) 2024-09-12T17:14:10.047 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.045+0000 7f3d4c330800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.10 2024-09-12T17:14:10.047 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.045+0000 7f3d4c330800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.1 2024-09-12T17:14:10.048 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.046+0000 7f3d4c330800 20 get_obj_state: octx=0x559dde425190 obj=check-bucket:e state=0x559dde6e8d28 s->prefetch_data=0 2024-09-12T17:14:10.048 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.046+0000 7f3d4c330800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.5 2024-09-12T17:14:10.048 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.046+0000 7f3d4c330800 20 get_obj_state: octx=0x559dde44dcb0 obj=check-bucket:d state=0x559dde6eacf8 s->prefetch_data=0 2024-09-12T17:14:10.048 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.046+0000 7f3d4c330800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.8 2024-09-12T17:14:10.050 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.047+0000 7f3d4c330800 20 get_obj_state: octx=0x559dde6ea110 obj=check-bucket:c state=0x559dde6ecc08 s->prefetch_data=0 2024-09-12T17:14:10.050 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.047+0000 7f3d4c330800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.10 2024-09-12T17:14:10.050 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.047+0000 7f3d4c330800 20 get_obj_state: octx=0x559dde6ea530 obj=check-bucket:f state=0x559dde6ed798 s->prefetch_data=0 2024-09-12T17:14:10.050 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.047+0000 7f3d4c330800 20 get_obj_state: setting s->obj_tag to 31awjpqwpiwtyixxxg65rp6huftdtclq 2024-09-12T17:14:10.050 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.047+0000 7f3d4c330800 20 get_obj_state_impl: setting s->olh_tag to anhwyaqdhn2trf59ydnof5u2xkcp7g3g 2024-09-12T17:14:10.050 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.047+0000 7f3d4c330800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=anhwyaqdhn2trf59ydnof5u2xkcp7g3g 2024-09-12T17:14:10.050 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.047+0000 7f3d4c330800 20 get_obj_state: setting s->obj_tag to vjesnxvxexip8zd2u6ooo9yj2uk7m4sx 2024-09-12T17:14:10.050 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.047+0000 7f3d4c330800 20 get_obj_state_impl: setting s->olh_tag to 9a6jptru16umrgqw4jpt9b3oyknncerk 2024-09-12T17:14:10.050 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.047+0000 7f3d4c330800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=9a6jptru16umrgqw4jpt9b3oyknncerk 2024-09-12T17:14:10.050 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.047+0000 7f3d4c330800 20 get_obj_state: setting s->obj_tag to 6r9m5p9nemfg1htfszubfeakbuk5v3pp 2024-09-12T17:14:10.051 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.047+0000 7f3d4c330800 20 get_obj_state_impl: setting s->olh_tag to 53mh2oceam0gxqoec0wm0ogfoidlhj01 2024-09-12T17:14:10.051 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.047+0000 7f3d4c330800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=53mh2oceam0gxqoec0wm0ogfoidlhj01 2024-09-12T17:14:10.051 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.047+0000 7f3d4c330800 20 get_obj_state: setting s->obj_tag to qw1b1cp8lpnoowb3xb6chorfj2ihugko 2024-09-12T17:14:10.051 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.047+0000 7f3d4c330800 20 get_obj_state_impl: setting s->olh_tag to cit8ol2nj3zqa7bhn28sjmz2lj9l0l8l 2024-09-12T17:14:10.051 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.047+0000 7f3d4c330800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=cit8ol2nj3zqa7bhn28sjmz2lj9l0l8l 2024-09-12T17:14:10.052 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.049+0000 7f3d4c330800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.1 2024-09-12T17:14:10.054 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.052+0000 7f3d4c330800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.10 2024-09-12T17:14:10.059 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.055+0000 7f3d4c330800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.5 2024-09-12T17:14:10.278 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.055+0000 7f3d4c330800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.1 2024-09-12T17:14:10.278 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.055+0000 7f3d4c330800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.10 2024-09-12T17:14:10.278 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.055+0000 7f3d4c330800 20 olh_log_entry: epoch=2 op=2 key=f[] 2024-09-12T17:14:10.278 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.055+0000 7f3d4c330800 20 olh_log_entry: epoch=2 op=3 key=f[6B0TvVkmeuZSTTJJoEzeobd2FGHc6fE] 2024-09-12T17:14:10.279 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.055+0000 7f3d4c330800 20 get_obj_state: octx=0x559dde6ea530 obj=check-bucket:_:6B0TvVkmeuZSTTJJoEzeobd2FGHc6fE_f state=0x559dde79d2f8 s->prefetch_data=0 2024-09-12T17:14:10.279 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.055+0000 7f3d4c330800 20 olh_log_entry: epoch=2 op=2 key=e[] 2024-09-12T17:14:10.279 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.055+0000 7f3d4c330800 20 olh_log_entry: epoch=2 op=3 key=e[bJYt7otpL6Kt9icYsxoFDVs.vV6lJhj] 2024-09-12T17:14:10.279 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.055+0000 7f3d4c330800 20 get_obj_state: octx=0x559dde425190 obj=check-bucket:_:bJYt7otpL6Kt9icYsxoFDVs.vV6lJhj_e state=0x559dde7a59c8 s->prefetch_data=0 2024-09-12T17:14:10.279 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.056+0000 7f3d4c330800 10 manifest: total_size = 12 2024-09-12T17:14:10.279 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.056+0000 7f3d4c330800 20 get_obj_state: setting s->obj_tag to 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.10010082810891671769 2024-09-12T17:14:10.279 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.056+0000 7f3d4c330800 20 get_obj_state: octx=0x559dde6ea530 obj=check-bucket:_:6B0TvVkmeuZSTTJJoEzeobd2FGHc6fE_f state=0x559dde79d2f8 s->prefetch_data=0 2024-09-12T17:14:10.280 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.056+0000 7f3d4c330800 20 prepare_atomic_modification: state is not atomic. state=0x559dde79d2f8 2024-09-12T17:14:10.280 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.056+0000 7f3d4c330800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.10 2024-09-12T17:14:10.280 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.056+0000 7f3d4c330800 10 manifest: total_size = 9 2024-09-12T17:14:10.280 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.056+0000 7f3d4c330800 20 get_obj_state: setting s->obj_tag to 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.4767978251673273417 2024-09-12T17:14:10.280 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.056+0000 7f3d4c330800 20 get_obj_state: octx=0x559dde425190 obj=check-bucket:_:bJYt7otpL6Kt9icYsxoFDVs.vV6lJhj_e state=0x559dde7a59c8 s->prefetch_data=0 2024-09-12T17:14:10.280 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.056+0000 7f3d4c330800 20 prepare_atomic_modification: state is not atomic. state=0x559dde7a59c8 2024-09-12T17:14:10.280 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.056+0000 7f3d4c330800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.1 2024-09-12T17:14:10.280 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.056+0000 7f3d4c330800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.8 2024-09-12T17:14:10.286 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.058+0000 7f3d4c330800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.8 2024-09-12T17:14:10.286 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.058+0000 7f3d4c330800 20 olh_log_entry: epoch=3 op=3 key=c[Y3PCDSw8G5rLQfXXUwrcLArZNWrg.SH] 2024-09-12T17:14:10.286 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.058+0000 7f3d4c330800 20 get_obj_state: octx=0x559dde6ea110 obj=check-bucket:_:Y3PCDSw8G5rLQfXXUwrcLArZNWrg.SH_c state=0x559dde7b5488 s->prefetch_data=0 2024-09-12T17:14:10.286 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.059+0000 7f3d4c330800 10 manifest: total_size = 11 2024-09-12T17:14:10.286 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.059+0000 7f3d4c330800 20 get_obj_state: setting s->obj_tag to 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.15892320019678207146 2024-09-12T17:14:10.286 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.059+0000 7f3d4c330800 20 get_obj_state: octx=0x559dde6ea110 obj=check-bucket:_:Y3PCDSw8G5rLQfXXUwrcLArZNWrg.SH_c state=0x559dde7b5488 s->prefetch_data=0 2024-09-12T17:14:10.286 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.059+0000 7f3d4c330800 20 prepare_atomic_modification: state is not atomic. state=0x559dde7b5488 2024-09-12T17:14:10.286 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.059+0000 7f3d4c330800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.8 2024-09-12T17:14:10.286 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.065+0000 7f3d4c330800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.5 2024-09-12T17:14:10.286 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.066+0000 7f3d4c330800 20 olh_log_entry: epoch=3 op=3 key=d[cPLxN8aecNIzJHvBdd.TvMoEohsBlU9] 2024-09-12T17:14:10.287 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.066+0000 7f3d4c330800 20 get_obj_state: octx=0x559dde44dcb0 obj=check-bucket:_:cPLxN8aecNIzJHvBdd.TvMoEohsBlU9_d state=0x559dde7bbca8 s->prefetch_data=0 2024-09-12T17:14:10.287 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.066+0000 7f3d4c330800 10 manifest: total_size = 22 2024-09-12T17:14:10.287 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.066+0000 7f3d4c330800 20 get_obj_state: setting s->obj_tag to 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.11426867084674042125 2024-09-12T17:14:10.287 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.066+0000 7f3d4c330800 20 get_obj_state: octx=0x559dde44dcb0 obj=check-bucket:_:cPLxN8aecNIzJHvBdd.TvMoEohsBlU9_d state=0x559dde7bbca8 s->prefetch_data=0 2024-09-12T17:14:10.287 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.066+0000 7f3d4c330800 20 prepare_atomic_modification: state is not atomic. state=0x559dde7bbca8 2024-09-12T17:14:10.287 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.066+0000 7f3d4c330800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.5 2024-09-12T17:14:10.287 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.068+0000 7f3c277fe640 20 handle_completion(): completion ok for obj=c[Y3PCDSw8G5rLQfXXUwrcLArZNWrg.SH] 2024-09-12T17:14:10.287 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.069+0000 7f3d4c330800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.8 2024-09-12T17:14:10.287 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.069+0000 7f3d4c330800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.8 2024-09-12T17:14:10.287 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.071+0000 7f3d4c330800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.8 2024-09-12T17:14:10.287 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.071+0000 7f3d4c330800 1 NOTICE: finished shard 8 (1 entries removed) 2024-09-12T17:14:10.287 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.072+0000 7f3d4c330800 20 get_obj_state: octx=0x559dde6ea530 obj=check-bucket:f state=0x559dde6ed798 s->prefetch_data=0 2024-09-12T17:14:10.287 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.072+0000 7f3d4c330800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=cit8ol2nj3zqa7bhn28sjmz2lj9l0l8l 2024-09-12T17:14:10.287 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.072+0000 7f3c26ffd640 20 handle_completion(): completion ok for obj=f[6B0TvVkmeuZSTTJJoEzeobd2FGHc6fE] 2024-09-12T17:14:10.288 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.076+0000 7f3d4c330800 20 get_obj_state: octx=0x559dde425190 obj=check-bucket:e state=0x559dde6e8d28 s->prefetch_data=0 2024-09-12T17:14:10.288 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.076+0000 7f3d4c330800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=anhwyaqdhn2trf59ydnof5u2xkcp7g3g 2024-09-12T17:14:10.288 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.076+0000 7f3c277fe640 20 handle_completion(): completion ok for obj=e[bJYt7otpL6Kt9icYsxoFDVs.vV6lJhj] 2024-09-12T17:14:10.288 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.076+0000 7f3c277fe640 20 handle_completion(): completion ok for obj=d[cPLxN8aecNIzJHvBdd.TvMoEohsBlU9] 2024-09-12T17:14:10.288 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.076+0000 7f3d4c330800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.5 2024-09-12T17:14:10.288 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.076+0000 7f3d4c330800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.5 2024-09-12T17:14:10.288 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.076+0000 7f3d4c330800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.10 2024-09-12T17:14:10.288 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.079+0000 7f3d4c330800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.5 2024-09-12T17:14:10.288 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.079+0000 7f3d4c330800 1 NOTICE: finished shard 5 (1 entries removed) 2024-09-12T17:14:10.288 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.081+0000 7f3d4c330800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.10 2024-09-12T17:14:10.288 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.081+0000 7f3d4c330800 1 NOTICE: finished shard 10 (1 entries removed) 2024-09-12T17:14:10.288 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.082+0000 7f3d4c330800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.1 2024-09-12T17:14:10.288 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.085+0000 7f3d4c330800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2.1 2024-09-12T17:14:10.288 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.085+0000 7f3d4c330800 1 NOTICE: finished shard 1 (1 entries removed) 2024-09-12T17:14:10.289 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.085+0000 7f3d4c330800 1 NOTICE: finished all shards (4 entries removed) 2024-09-12T17:14:10.289 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.086+0000 7f3bfe7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:14:10.289 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.088+0000 7f3d4c330800 20 remove_watcher() i=0 2024-09-12T17:14:10.289 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.088+0000 7f3d4c330800 2 removed watcher, disabling cache 2024-09-12T17:14:10.289 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.089+0000 7f3d4c330800 20 remove_watcher() i=1 2024-09-12T17:14:10.289 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.090+0000 7f3d4c330800 20 remove_watcher() i=2 2024-09-12T17:14:10.289 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.092+0000 7f3d4c330800 20 remove_watcher() i=3 2024-09-12T17:14:10.289 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.093+0000 7f3d4c330800 20 remove_watcher() i=4 2024-09-12T17:14:10.289 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.094+0000 7f3d4c330800 20 remove_watcher() i=5 2024-09-12T17:14:10.289 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.095+0000 7f3d4c330800 20 remove_watcher() i=6 2024-09-12T17:14:10.289 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.096+0000 7f3d4c330800 20 remove_watcher() i=7 2024-09-12T17:14:10.321 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bucket stats --bucket check-bucket 2024-09-12T17:14:10.350 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:14:10.350 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:14:10.388 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.386+0000 7fda4a146800 20 rados->read ofs=0 len=0 2024-09-12T17:14:10.390 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.388+0000 7fda4a146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:10.390 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.388+0000 7fda4a146800 20 realm 2024-09-12T17:14:10.391 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.388+0000 7fda4a146800 20 rados->read ofs=0 len=0 2024-09-12T17:14:10.391 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.388+0000 7fda4a146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:10.391 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.388+0000 7fda4a146800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:14:10.391 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.388+0000 7fda4a146800 20 rados->read ofs=0 len=0 2024-09-12T17:14:10.391 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.389+0000 7fda4a146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:10.391 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.389+0000 7fda4a146800 20 rados->read ofs=0 len=0 2024-09-12T17:14:10.391 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.389+0000 7fda4a146800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:14:10.391 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.389+0000 7fda4a146800 20 rados->read ofs=0 len=0 2024-09-12T17:14:10.392 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.390+0000 7fda4a146800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:14:10.392 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.390+0000 7fda4a146800 20 searching for the correct realm 2024-09-12T17:14:10.395 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.393+0000 7fda48438640 0 -- 172.21.15.37:0/3305440049 >> [v2:172.21.15.40:6818/1210108009,v1:172.21.15.40:6819/1210108009] conn(0x7fda300800e0 msgr2=0x7fda300473c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:14:10.398 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.396+0000 7fda47c37640 0 -- 172.21.15.37:0/3305440049 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7fda300614b0 msgr2=0x7fda30083890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:14:10.604 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.602+0000 7fda4a146800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:14:10.605 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.602+0000 7fda4a146800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:14:10.605 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.602+0000 7fda4a146800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:14:10.605 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.602+0000 7fda4a146800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:14:10.605 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.602+0000 7fda4a146800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:14:10.605 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.602+0000 7fda4a146800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:14:10.605 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.602+0000 7fda4a146800 20 rados->read ofs=0 len=0 2024-09-12T17:14:10.605 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.602+0000 7fda4a146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:10.605 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.602+0000 7fda4a146800 20 rados->read ofs=0 len=0 2024-09-12T17:14:10.605 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.602+0000 7fda4a146800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:14:10.606 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.602+0000 7fda4a146800 20 rados->read ofs=0 len=0 2024-09-12T17:14:10.607 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.603+0000 7fda4a146800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:14:10.607 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.603+0000 7fda4a146800 20 zone default found 2024-09-12T17:14:10.607 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.603+0000 7fda4a146800 4 Realm: () 2024-09-12T17:14:10.607 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.603+0000 7fda4a146800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:14:10.607 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.603+0000 7fda4a146800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:14:10.607 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.603+0000 7fda4a146800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:14:10.607 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.603+0000 7fda4a146800 20 zonegroup default 2024-09-12T17:14:10.607 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.603+0000 7fda4a146800 20 rados->read ofs=0 len=0 2024-09-12T17:14:10.607 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.603+0000 7fda4a146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:10.608 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.603+0000 7fda4a146800 20 rados->read ofs=0 len=0 2024-09-12T17:14:10.608 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.604+0000 7fda4a146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:10.608 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.604+0000 7fda4a146800 20 rados->read ofs=0 len=0 2024-09-12T17:14:10.608 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.604+0000 7fda4a146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:10.608 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.604+0000 7fda4a146800 20 started sync module instance, tier type = 2024-09-12T17:14:10.608 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.604+0000 7fda4a146800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:14:10.615 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.613+0000 7fda4a146800 20 add_watcher() i=0 2024-09-12T17:14:10.616 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.613+0000 7fda4a146800 20 add_watcher() i=1 2024-09-12T17:14:10.616 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.613+0000 7fda4a146800 20 add_watcher() i=2 2024-09-12T17:14:10.616 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.613+0000 7fda4a146800 20 add_watcher() i=3 2024-09-12T17:14:10.616 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.613+0000 7fda4a146800 20 add_watcher() i=4 2024-09-12T17:14:10.616 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.613+0000 7fda4a146800 20 add_watcher() i=5 2024-09-12T17:14:10.616 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.613+0000 7fda4a146800 20 add_watcher() i=6 2024-09-12T17:14:10.617 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.614+0000 7fda4a146800 20 add_watcher() i=7 2024-09-12T17:14:10.617 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.614+0000 7fda4a146800 2 all 8 watchers are set, enabling cache 2024-09-12T17:14:10.619 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.616+0000 7fd8fdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:14:10.619 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.616+0000 7fda4a146800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:14:10.619 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.616+0000 7fda4a146800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:14:10.619 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.616+0000 7fda4a146800 5 note: GC not initialized 2024-09-12T17:14:10.619 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.616+0000 7fd8fcfe1640 20 reqs_thread_entry: start 2024-09-12T17:14:10.620 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.616+0000 7fda4a146800 20 init_complete bucket index max shards: 11 2024-09-12T17:14:10.620 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.617+0000 7fda4a146800 20 Filter name: none 2024-09-12T17:14:10.620 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.617+0000 7fd8767fc640 20 reqs_thread_entry: start 2024-09-12T17:14:10.620 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.617+0000 7fda4a146800 20 rados->read ofs=0 len=0 2024-09-12T17:14:10.620 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.617+0000 7fda4a146800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:14:10.620 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.617+0000 7fda4a146800 20 rados->read ofs=0 len=0 2024-09-12T17:14:10.621 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.617+0000 7fda4a146800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:14:10.621 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.617+0000 7fda4a146800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:14:10.621 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.617+0000 7fda4a146800 20 rados->read ofs=0 len=0 2024-09-12T17:14:10.621 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.618+0000 7fda4a146800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:14:10.622 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.618+0000 7fda4a146800 20 rados->read ofs=0 len=0 2024-09-12T17:14:10.622 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.618+0000 7fda4a146800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:14:10.622 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.618+0000 7fda4a146800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:14:10.622 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.620+0000 7fd8fdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:14:10.624 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.622+0000 7fda4a146800 20 remove_watcher() i=0 2024-09-12T17:14:10.624 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.622+0000 7fda4a146800 2 removed watcher, disabling cache 2024-09-12T17:14:10.625 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.623+0000 7fda4a146800 20 remove_watcher() i=1 2024-09-12T17:14:10.626 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.624+0000 7fda4a146800 20 remove_watcher() i=2 2024-09-12T17:14:10.627 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.625+0000 7fda4a146800 20 remove_watcher() i=3 2024-09-12T17:14:10.628 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.626+0000 7fda4a146800 20 remove_watcher() i=4 2024-09-12T17:14:10.629 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.627+0000 7fda4a146800 20 remove_watcher() i=5 2024-09-12T17:14:10.630 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.628+0000 7fda4a146800 20 remove_watcher() i=6 2024-09-12T17:14:10.631 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:14:10.629+0000 7fda4a146800 20 remove_watcher() i=7 2024-09-12T17:14:10.642 INFO:tasks.workunit.client.0.smithi037.stderr:{'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}} 2024-09-12T17:14:10.642 INFO:tasks.workunit.client.0.smithi037.stderr:Deleting bucket check-bucket 2024-09-12T17:14:10.878 INFO:tasks.workunit.client.0.smithi037.stderr:Completed bucket check tests 2024-09-12T17:14:10.878 INFO:tasks.workunit.client.0.smithi037.stdout:connected to http://localhost:80 2024-09-12T17:14:10.941 INFO:tasks.workunit.client.0.smithi037.stderr:+ deactivate 2024-09-12T17:14:10.941 INFO:tasks.workunit.client.0.smithi037.stderr:+ '[' -n /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin ']' 2024-09-12T17:14:10.941 INFO:tasks.workunit.client.0.smithi037.stderr:+ PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-12T17:14:10.941 INFO:tasks.workunit.client.0.smithi037.stderr:+ export PATH 2024-09-12T17:14:10.941 INFO:tasks.workunit.client.0.smithi037.stderr:+ unset _OLD_VIRTUAL_PATH 2024-09-12T17:14:10.941 INFO:tasks.workunit.client.0.smithi037.stderr:+ '[' -n '' ']' 2024-09-12T17:14:10.941 INFO:tasks.workunit.client.0.smithi037.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T17:14:10.941 INFO:tasks.workunit.client.0.smithi037.stderr:+ hash -r 2024-09-12T17:14:10.942 INFO:tasks.workunit.client.0.smithi037.stderr:+ '[' -n '' ']' 2024-09-12T17:14:10.942 INFO:tasks.workunit.client.0.smithi037.stderr:+ unset VIRTUAL_ENV 2024-09-12T17:14:10.942 INFO:tasks.workunit.client.0.smithi037.stderr:+ '[' '!' '' = nondestructive ']' 2024-09-12T17:14:10.942 INFO:tasks.workunit.client.0.smithi037.stderr:+ unset -f deactivate 2024-09-12T17:14:10.942 INFO:tasks.workunit.client.0.smithi037.stderr:+ echo OK. 2024-09-12T17:14:10.943 INFO:tasks.workunit.client.0.smithi037.stdout:OK. 2024-09-12T17:14:10.943 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:14:10.943 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:14:11.024 INFO:tasks.workunit:Stopping ['rgw/run-bucket-check.sh'] on client.0... 2024-09-12T17:14:11.025 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T17:14:11.399 DEBUG:teuthology.parallel:result is None 2024-09-12T17:14:11.400 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T17:14:11.439 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T17:14:11.440 DEBUG:teuthology.orchestra.run.smithi037:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T17:14:11.510 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T17:14:11.510 INFO:teuthology.run_tasks:Running task workunit... 2024-09-12T17:14:11.519 INFO:tasks.workunit:Pulling workunits from ref bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T17:14:11.520 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T17:14:11.520 DEBUG:teuthology.orchestra.run.smithi037:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T17:14:11.579 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T17:14:11.580 INFO:teuthology.orchestra.run.smithi037.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T17:14:11.580 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T17:14:11.650 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-12T17:14:11.650 DEBUG:teuthology.orchestra.run.smithi037:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-12T17:14:11.719 INFO:tasks.workunit:timeout=3h 2024-09-12T17:14:11.720 INFO:tasks.workunit:cleanup=True 2024-09-12T17:14:11.720 DEBUG:teuthology.orchestra.run.smithi037:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T17:14:11.790 INFO:tasks.workunit.client.0.smithi037.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T17:15:12.758 INFO:tasks.workunit.client.0.smithi037.stderr:Updating files: 91% (11673/12697) Updating files: 92% (11682/12697) Updating files: 93% (11809/12697) Updating files: 94% (11936/12697) Updating files: 95% (12063/12697) Updating files: 96% (12190/12697) Updating files: 97% (12317/12697) Updating files: 98% (12444/12697) Updating files: 99% (12571/12697) Updating files: 100% (12697/12697) Updating files: 100% (12697/12697), done. 2024-09-12T17:15:13.606 INFO:tasks.workunit.client.0.smithi037.stderr:Note: switching to 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'. 2024-09-12T17:15:13.606 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:15:13.606 INFO:tasks.workunit.client.0.smithi037.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T17:15:13.606 INFO:tasks.workunit.client.0.smithi037.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T17:15:13.606 INFO:tasks.workunit.client.0.smithi037.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T17:15:13.606 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:15:13.606 INFO:tasks.workunit.client.0.smithi037.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T17:15:13.607 INFO:tasks.workunit.client.0.smithi037.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T17:15:13.607 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:15:13.607 INFO:tasks.workunit.client.0.smithi037.stderr: git switch -c 2024-09-12T17:15:13.607 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:15:13.607 INFO:tasks.workunit.client.0.smithi037.stderr:Or undo this operation with: 2024-09-12T17:15:13.607 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:15:13.607 INFO:tasks.workunit.client.0.smithi037.stderr: git switch - 2024-09-12T17:15:13.607 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:15:13.607 INFO:tasks.workunit.client.0.smithi037.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T17:15:13.607 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:15:13.607 INFO:tasks.workunit.client.0.smithi037.stderr:HEAD is now at bad475c18c9 rgw: clear output keys in RGWMetadataLister::get_next() 2024-09-12T17:15:13.611 DEBUG:teuthology.orchestra.run.smithi037:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T17:15:13.681 INFO:tasks.workunit.client.0.smithi037.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T17:15:13.683 INFO:tasks.workunit.client.0.smithi037.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T17:15:13.683 INFO:tasks.workunit.client.0.smithi037.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T17:15:13.733 INFO:tasks.workunit.client.0.smithi037.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T17:15:13.783 INFO:tasks.workunit.client.0.smithi037.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T17:15:13.824 INFO:tasks.workunit.client.0.smithi037.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T17:15:13.825 INFO:tasks.workunit.client.0.smithi037.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T17:15:13.825 INFO:tasks.workunit.client.0.smithi037.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T17:15:13.866 INFO:tasks.workunit.client.0.smithi037.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T17:15:13.870 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-09-12T17:15:13.870 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T17:15:13.940 INFO:tasks.workunit:Running workunits matching cls/test_cls_lock.sh on client.0... 2024-09-12T17:15:13.941 INFO:tasks.workunit:Running workunit cls/test_cls_lock.sh... 2024-09-12T17:15:13.942 DEBUG:teuthology.orchestra.run.smithi037:workunit test cls/test_cls_lock.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_lock.sh 2024-09-12T17:15:14.025 INFO:tasks.workunit.client.0.smithi037.stdout:Running main() from gmock_main.cc 2024-09-12T17:15:14.026 INFO:tasks.workunit.client.0.smithi037.stdout:[==========] Running 11 tests from 1 test suite. 2024-09-12T17:15:14.026 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] Global test environment set-up. 2024-09-12T17:15:14.026 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 11 tests from ClsLock 2024-09-12T17:15:14.026 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] ClsLock.TestMultiLocking 2024-09-12T17:15:15.998 INFO:tasks.workunit.client.0.smithi037.stdout:lock: mylock 2024-09-12T17:15:15.998 INFO:tasks.workunit.client.0.smithi037.stdout: lock_type: exclusive 2024-09-12T17:15:15.998 INFO:tasks.workunit.client.0.smithi037.stdout: tag: 2024-09-12T17:15:15.998 INFO:tasks.workunit.client.0.smithi037.stdout: lockers: 2024-09-12T17:15:15.998 INFO:tasks.workunit.client.0.smithi037.stdout: client.5033 expiration=2024-09-12T17:17:15.992603+0000 addr=v1:172.21.15.37:0/4222733599 cookie= 2024-09-12T17:15:16.003 INFO:tasks.workunit.client.0.smithi037.stdout:lock: mylock 2024-09-12T17:15:16.003 INFO:tasks.workunit.client.0.smithi037.stdout: lock_type: shared 2024-09-12T17:15:16.003 INFO:tasks.workunit.client.0.smithi037.stdout: tag: 2024-09-12T17:15:16.003 INFO:tasks.workunit.client.0.smithi037.stdout: lockers: 2024-09-12T17:15:16.003 INFO:tasks.workunit.client.0.smithi037.stdout: client.5033 expiration=2024-09-12T17:17:16.001412+0000 addr=v1:172.21.15.37:0/4222733599 cookie= 2024-09-12T17:15:16.003 INFO:tasks.workunit.client.0.smithi037.stdout: client.5196 expiration=0.000000 addr=v1:172.21.15.37:0/3506713574 cookie= 2024-09-12T17:15:16.005 INFO:tasks.workunit.client.0.smithi037.stdout:lock: mylock 2024-09-12T17:15:16.005 INFO:tasks.workunit.client.0.smithi037.stdout: lock_type: shared 2024-09-12T17:15:16.005 INFO:tasks.workunit.client.0.smithi037.stdout: tag: 2024-09-12T17:15:16.005 INFO:tasks.workunit.client.0.smithi037.stdout: lockers: 2024-09-12T17:15:16.005 INFO:tasks.workunit.client.0.smithi037.stdout: client.5196 expiration=0.000000 addr=v1:172.21.15.37:0/3506713574 cookie= 2024-09-12T17:15:16.598 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] ClsLock.TestMultiLocking (2573 ms) 2024-09-12T17:15:16.598 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] ClsLock.TestMeta 2024-09-12T17:15:18.855 INFO:tasks.workunit.client.0.smithi037.stdout:lock: mylock 2024-09-12T17:15:18.855 INFO:tasks.workunit.client.0.smithi037.stdout: lock_type: shared 2024-09-12T17:15:18.855 INFO:tasks.workunit.client.0.smithi037.stdout: tag: 2024-09-12T17:15:18.855 INFO:tasks.workunit.client.0.smithi037.stdout: lockers: 2024-09-12T17:15:18.855 INFO:tasks.workunit.client.0.smithi037.stdout: client.5048 expiration=0.000000 addr=v1:172.21.15.37:0/127643251 cookie= 2024-09-12T17:15:18.858 INFO:tasks.workunit.client.0.smithi037.stdout:lock: mylock 2024-09-12T17:15:18.858 INFO:tasks.workunit.client.0.smithi037.stdout: lock_type: exclusive 2024-09-12T17:15:18.859 INFO:tasks.workunit.client.0.smithi037.stdout: tag: new_tag 2024-09-12T17:15:18.859 INFO:tasks.workunit.client.0.smithi037.stdout: lockers: 2024-09-12T17:15:18.859 INFO:tasks.workunit.client.0.smithi037.stdout: client.5042 expiration=0.000000 addr=v1:172.21.15.37:0/3029651196 cookie= 2024-09-12T17:15:19.622 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] ClsLock.TestMeta (3023 ms) 2024-09-12T17:15:19.622 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] ClsLock.TestCookie 2024-09-12T17:15:21.644 INFO:tasks.workunit.client.0.smithi037.stdout:lock: mylock 2024-09-12T17:15:21.644 INFO:tasks.workunit.client.0.smithi037.stdout: lock_type: exclusive 2024-09-12T17:15:21.645 INFO:tasks.workunit.client.0.smithi037.stdout: tag: 2024-09-12T17:15:21.645 INFO:tasks.workunit.client.0.smithi037.stdout: lockers: 2024-09-12T17:15:21.647 INFO:tasks.workunit.client.0.smithi037.stdout:lock: mylock 2024-09-12T17:15:21.647 INFO:tasks.workunit.client.0.smithi037.stdout: lock_type: shared 2024-09-12T17:15:21.647 INFO:tasks.workunit.client.0.smithi037.stdout: tag: 2024-09-12T17:15:21.647 INFO:tasks.workunit.client.0.smithi037.stdout: lockers: 2024-09-12T17:15:21.647 INFO:tasks.workunit.client.0.smithi037.stdout: client.5054 expiration=0.000000 addr=v1:172.21.15.37:0/2821371752 cookie= 2024-09-12T17:15:21.647 INFO:tasks.workunit.client.0.smithi037.stdout: client.5054 expiration=0.000000 addr=v1:172.21.15.37:0/2821371752 cookie=new cookie 2024-09-12T17:15:22.639 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] ClsLock.TestCookie (3017 ms) 2024-09-12T17:15:22.639 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] ClsLock.TestMultipleLocks 2024-09-12T17:15:25.666 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] ClsLock.TestMultipleLocks (3027 ms) 2024-09-12T17:15:25.666 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] ClsLock.TestLockDuration 2024-09-12T17:15:32.753 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] ClsLock.TestLockDuration (7085 ms) 2024-09-12T17:15:32.753 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] ClsLock.TestAssertLocked 2024-09-12T17:15:35.785 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] ClsLock.TestAssertLocked (3034 ms) 2024-09-12T17:15:35.785 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] ClsLock.TestSetCookie 2024-09-12T17:15:38.800 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] ClsLock.TestSetCookie (3015 ms) 2024-09-12T17:15:38.800 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] ClsLock.TestRenew 2024-09-12T17:15:59.355 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] ClsLock.TestRenew (20556 ms) 2024-09-12T17:15:59.356 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralBasic 2024-09-12T17:16:05.450 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] ClsLock.TestExclusiveEphemeralBasic (6094 ms) 2024-09-12T17:16:05.450 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralStealEphemeral 2024-09-12T17:16:12.518 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] ClsLock.TestExclusiveEphemeralStealEphemeral (7068 ms) 2024-09-12T17:16:12.518 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralStealExclusive 2024-09-12T17:16:20.553 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] ClsLock.TestExclusiveEphemeralStealExclusive (8035 ms) 2024-09-12T17:16:20.553 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 11 tests from ClsLock (66527 ms total) 2024-09-12T17:16:20.553 INFO:tasks.workunit.client.0.smithi037.stdout: 2024-09-12T17:16:20.553 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] Global test environment tear-down 2024-09-12T17:16:20.554 INFO:tasks.workunit.client.0.smithi037.stdout:[==========] 11 tests from 1 test suite ran. (66527 ms total) 2024-09-12T17:16:20.554 INFO:tasks.workunit.client.0.smithi037.stdout:[ PASSED ] 11 tests. 2024-09-12T17:16:20.557 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:16:20.557 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:16:20.602 INFO:tasks.workunit:Running workunits matching cls/test_cls_log.sh on client.0... 2024-09-12T17:16:20.603 INFO:tasks.workunit:Running workunit cls/test_cls_log.sh... 2024-09-12T17:16:20.603 DEBUG:teuthology.orchestra.run.smithi037:workunit test cls/test_cls_log.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_log.sh 2024-09-12T17:16:20.651 INFO:tasks.workunit.client.0.smithi037.stdout:Running main() from gmock_main.cc 2024-09-12T17:16:20.651 INFO:tasks.workunit.client.0.smithi037.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-12T17:16:20.652 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] Global test environment set-up. 2024-09-12T17:16:20.652 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 4 tests from cls_log 2024-09-12T17:16:20.652 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] cls_log.test_log_add_same_time 2024-09-12T17:16:23.571 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] cls_log.test_log_add_same_time (2920 ms) 2024-09-12T17:16:23.571 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] cls_log.test_log_add_different_time 2024-09-12T17:16:26.607 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] cls_log.test_log_add_different_time (3035 ms) 2024-09-12T17:16:26.607 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] cls_log.trim_by_time 2024-09-12T17:16:29.632 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] cls_log.trim_by_time (3025 ms) 2024-09-12T17:16:29.632 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] cls_log.trim_by_marker 2024-09-12T17:16:32.638 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] cls_log.trim_by_marker (3006 ms) 2024-09-12T17:16:32.638 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 4 tests from cls_log (11986 ms total) 2024-09-12T17:16:32.638 INFO:tasks.workunit.client.0.smithi037.stdout: 2024-09-12T17:16:32.638 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] Global test environment tear-down 2024-09-12T17:16:32.638 INFO:tasks.workunit.client.0.smithi037.stdout:[==========] 4 tests from 1 test suite ran. (11986 ms total) 2024-09-12T17:16:32.638 INFO:tasks.workunit.client.0.smithi037.stdout:[ PASSED ] 4 tests. 2024-09-12T17:16:32.641 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:16:32.642 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:16:32.685 INFO:tasks.workunit:Running workunits matching cls/test_cls_refcount.sh on client.0... 2024-09-12T17:16:32.687 INFO:tasks.workunit:Running workunit cls/test_cls_refcount.sh... 2024-09-12T17:16:32.687 DEBUG:teuthology.orchestra.run.smithi037:workunit test cls/test_cls_refcount.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_refcount.sh 2024-09-12T17:16:32.775 INFO:tasks.workunit.client.0.smithi037.stdout:Running main() from gmock_main.cc 2024-09-12T17:16:32.775 INFO:tasks.workunit.client.0.smithi037.stdout:[==========] Running 10 tests from 1 test suite. 2024-09-12T17:16:32.775 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] Global test environment set-up. 2024-09-12T17:16:32.776 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 10 tests from cls_refcount 2024-09-12T17:16:32.776 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] cls_refcount.test_implicit 2024-09-12T17:16:35.670 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] cls_refcount.test_implicit (2896 ms) 2024-09-12T17:16:35.671 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] cls_refcount.test_implicit_idempotent 2024-09-12T17:16:38.680 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] cls_refcount.test_implicit_idempotent (3009 ms) 2024-09-12T17:16:38.680 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] cls_refcount.test_put_snap 2024-09-12T17:16:47.728 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] cls_refcount.test_put_snap (9048 ms) 2024-09-12T17:16:47.728 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] cls_refcount.test_explicit 2024-09-12T17:16:50.740 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] cls_refcount.test_explicit (3013 ms) 2024-09-12T17:16:50.741 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] cls_refcount.set 2024-09-12T17:16:53.772 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] cls_refcount.set (3032 ms) 2024-09-12T17:16:53.772 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] cls_refcount.test_implicit_ec 2024-09-12T17:17:00.793 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] cls_refcount.test_implicit_ec (7021 ms) 2024-09-12T17:17:00.793 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] cls_refcount.test_implicit_idempotent_ec 2024-09-12T17:17:07.827 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] cls_refcount.test_implicit_idempotent_ec (7033 ms) 2024-09-12T17:17:07.827 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] cls_refcount.test_put_snap_ec 2024-09-12T17:17:19.902 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] cls_refcount.test_put_snap_ec (12075 ms) 2024-09-12T17:17:19.902 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] cls_refcount.test_explicit_ec 2024-09-12T17:17:26.924 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] cls_refcount.test_explicit_ec (7023 ms) 2024-09-12T17:17:26.925 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] cls_refcount.set_ec 2024-09-12T17:17:33.965 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] cls_refcount.set_ec (7041 ms) 2024-09-12T17:17:33.966 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 10 tests from cls_refcount (61191 ms total) 2024-09-12T17:17:33.966 INFO:tasks.workunit.client.0.smithi037.stdout: 2024-09-12T17:17:33.966 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] Global test environment tear-down 2024-09-12T17:17:33.966 INFO:tasks.workunit.client.0.smithi037.stdout:[==========] 10 tests from 1 test suite ran. (61191 ms total) 2024-09-12T17:17:33.966 INFO:tasks.workunit.client.0.smithi037.stdout:[ PASSED ] 10 tests. 2024-09-12T17:17:33.968 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:17:33.969 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:17:34.015 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw.sh on client.0... 2024-09-12T17:17:34.016 INFO:tasks.workunit:Running workunit cls/test_cls_rgw.sh... 2024-09-12T17:17:34.016 DEBUG:teuthology.orchestra.run.smithi037:workunit test cls/test_cls_rgw.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw.sh 2024-09-12T17:17:34.065 INFO:tasks.workunit.client.0.smithi037.stdout:Running main() from gmock_main.cc 2024-09-12T17:17:34.066 INFO:tasks.workunit.client.0.smithi037.stdout:[==========] Running 18 tests from 1 test suite. 2024-09-12T17:17:34.066 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] Global test environment set-up. 2024-09-12T17:17:34.066 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 18 tests from cls_rgw 2024-09-12T17:17:35.970 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] cls_rgw.index_basic 2024-09-12T17:17:36.020 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] cls_rgw.index_basic (49 ms) 2024-09-12T17:17:36.020 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] cls_rgw.index_multiple_obj_writers 2024-09-12T17:17:36.058 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] cls_rgw.index_multiple_obj_writers (39 ms) 2024-09-12T17:17:36.058 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] cls_rgw.index_remove_object 2024-09-12T17:17:36.107 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] cls_rgw.index_remove_object (48 ms) 2024-09-12T17:17:36.107 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] cls_rgw.index_suggest 2024-09-12T17:17:37.610 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] cls_rgw.index_suggest (1504 ms) 2024-09-12T17:17:37.610 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] cls_rgw.index_suggest_complete 2024-09-12T17:17:37.618 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] cls_rgw.index_suggest_complete (8 ms) 2024-09-12T17:17:37.618 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] cls_rgw.index_list 2024-09-12T17:17:37.642 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] cls_rgw.index_list (24 ms) 2024-09-12T17:17:37.642 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] cls_rgw.index_list_delimited 2024-09-12T17:17:58.114 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] cls_rgw.index_list_delimited (20472 ms) 2024-09-12T17:17:58.115 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] cls_rgw.bi_list 2024-09-12T17:17:58.191 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] cls_rgw.bi_list (76 ms) 2024-09-12T17:17:58.191 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] cls_rgw.gc_set 2024-09-12T17:17:58.202 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] cls_rgw.gc_set (12 ms) 2024-09-12T17:17:58.203 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] cls_rgw.gc_list 2024-09-12T17:17:58.213 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] cls_rgw.gc_list (11 ms) 2024-09-12T17:17:58.213 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] cls_rgw.gc_defer 2024-09-12T17:18:05.428 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] cls_rgw.gc_defer (7215 ms) 2024-09-12T17:18:05.428 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] cls_rgw.usage_basic 2024-09-12T17:18:05.732 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] cls_rgw.usage_basic (304 ms) 2024-09-12T17:18:05.733 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] cls_rgw.usage_clear_no_obj 2024-09-12T17:18:05.733 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] cls_rgw.usage_clear_no_obj (1 ms) 2024-09-12T17:18:05.733 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] cls_rgw.usage_clear 2024-09-12T17:18:05.857 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] cls_rgw.usage_clear (124 ms) 2024-09-12T17:18:05.857 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] cls_rgw.bi_log_trim 2024-09-12T17:18:05.902 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] cls_rgw.bi_log_trim (44 ms) 2024-09-12T17:18:05.902 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] cls_rgw.index_racing_removes 2024-09-12T17:18:05.914 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] cls_rgw.index_racing_removes (13 ms) 2024-09-12T17:18:05.914 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] cls_rgw.reshardlog_list 2024-09-12T17:18:05.930 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] cls_rgw.reshardlog_list (15 ms) 2024-09-12T17:18:05.930 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] cls_rgw.reshardlog_num 2024-09-12T17:18:05.941 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] cls_rgw.reshardlog_num (12 ms) 2024-09-12T17:18:06.439 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 18 tests from cls_rgw (29971 ms total) 2024-09-12T17:18:06.439 INFO:tasks.workunit.client.0.smithi037.stdout: 2024-09-12T17:18:06.439 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] Global test environment tear-down 2024-09-12T17:18:06.439 INFO:tasks.workunit.client.0.smithi037.stdout:[==========] 18 tests from 1 test suite ran. (32373 ms total) 2024-09-12T17:18:06.439 INFO:tasks.workunit.client.0.smithi037.stdout:[ PASSED ] 18 tests. 2024-09-12T17:18:06.442 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:18:06.442 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:18:06.488 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw_gc.sh on client.0... 2024-09-12T17:18:06.489 INFO:tasks.workunit:Running workunit cls/test_cls_rgw_gc.sh... 2024-09-12T17:18:06.489 DEBUG:teuthology.orchestra.run.smithi037:workunit test cls/test_cls_rgw_gc.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw_gc.sh 2024-09-12T17:18:06.536 INFO:tasks.workunit.client.0.smithi037.stdout:Running main() from gmock_main.cc 2024-09-12T17:18:06.536 INFO:tasks.workunit.client.0.smithi037.stdout:[==========] Running 9 tests from 1 test suite. 2024-09-12T17:18:06.536 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] Global test environment set-up. 2024-09-12T17:18:06.536 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 9 tests from cls_rgw_gc 2024-09-12T17:18:06.536 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] cls_rgw_gc.init 2024-09-12T17:18:08.448 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] cls_rgw_gc.init (1911 ms) 2024-09-12T17:18:08.448 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops1 2024-09-12T17:18:08.481 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] cls_rgw_gc.gc_queue_ops1 (33 ms) 2024-09-12T17:18:08.481 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops2 2024-09-12T17:18:08.481 INFO:tasks.workunit.client.0.smithi037.stderr:[ ] list info tag = chain-0 2024-09-12T17:18:08.490 INFO:tasks.workunit.client.0.smithi037.stderr:[ ] next_marker is: = 0/4263 2024-09-12T17:18:08.490 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] cls_rgw_gc.gc_queue_ops2 (10 ms) 2024-09-12T17:18:08.490 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops5 2024-09-12T17:18:08.500 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] cls_rgw_gc.gc_queue_ops5 (10 ms) 2024-09-12T17:18:08.500 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops6 2024-09-12T17:18:09.164 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] cls_rgw_gc.gc_queue_ops6 (663 ms) 2024-09-12T17:18:09.164 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops7 2024-09-12T17:18:09.176 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] cls_rgw_gc.gc_queue_ops7 (13 ms) 2024-09-12T17:18:09.176 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops8 2024-09-12T17:18:09.186 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] cls_rgw_gc.gc_queue_ops8 (10 ms) 2024-09-12T17:18:09.186 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops9 2024-09-12T17:18:09.196 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] cls_rgw_gc.gc_queue_ops9 (9 ms) 2024-09-12T17:18:09.196 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] cls_rgw_gc.finalize 2024-09-12T17:18:09.462 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] cls_rgw_gc.finalize (266 ms) 2024-09-12T17:18:09.462 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 9 tests from cls_rgw_gc (2925 ms total) 2024-09-12T17:18:09.462 INFO:tasks.workunit.client.0.smithi037.stdout: 2024-09-12T17:18:09.462 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] Global test environment tear-down 2024-09-12T17:18:09.462 INFO:tasks.workunit.client.0.smithi037.stdout:[==========] 9 tests from 1 test suite ran. (2925 ms total) 2024-09-12T17:18:09.462 INFO:tasks.workunit.client.0.smithi037.stdout:[ PASSED ] 9 tests. 2024-09-12T17:18:09.465 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:18:09.465 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:18:09.510 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw_stats.sh on client.0... 2024-09-12T17:18:09.511 INFO:tasks.workunit:Running workunit cls/test_cls_rgw_stats.sh... 2024-09-12T17:18:09.511 DEBUG:teuthology.orchestra.run.smithi037:workunit test cls/test_cls_rgw_stats.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw_stats.sh 2024-09-12T17:18:09.567 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:18:09.568 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:18:09.568 INFO:tasks.workunit.client.0.smithi037.stdout:[==========] Running 1 test from 1 test suite. 2024-09-12T17:18:09.568 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] Global test environment set-up. 2024-09-12T17:18:11.467 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 1 test from cls_rgw_stats 2024-09-12T17:18:11.467 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] cls_rgw_stats.simulate 2024-09-12T17:18:11.490 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.489+0000 7f574d1ea780 1 > prepared part key=_multipart_GEGOEB05R0PK.2~7MC1HLNSG985.0 size=1048576 2024-09-12T17:18:11.493 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.492+0000 7f574d1ea780 1 > prepared part key=_multipart_GEGOEB05R0PK.2~7MC1HLNSG985.1 size=49496 2024-09-12T17:18:11.493 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.492+0000 7f574d1ea780 1 > prepared multipart upload key=GEGOEB05R0PK upload=7MC1HLNSG985 tag=KIHMK5NGKIXE type=write size=2146648 2024-09-12T17:18:11.496 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.495+0000 7f574d1ea780 1 > prepared part key=_multipart_UFKM4I8RMT0W.2~6BDTQMI8D4FY.0 size=190061 2024-09-12T17:18:11.496 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.495+0000 7f574d1ea780 1 > prepared multipart upload key=UFKM4I8RMT0W upload=6BDTQMI8D4FY tag=V9FAW7SPLIHH type=write size=1238637 2024-09-12T17:18:11.497 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.496+0000 7f574d1ea780 1 > prepared operation key=SQQMJ61CA0QW tag=MM8928JPYPDV type=write size=621423 2024-09-12T17:18:11.499 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.498+0000 7f574d1ea780 1 > prepared operation key=HFWA7DNUMWF2 tag=VFAC9JIJ44PD type=del size=4128925 2024-09-12T17:18:11.501 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.501+0000 7f574d1ea780 1 > prepared part key=_multipart_RNI86YYLADT0.2~XEH4N4DDSFF8.0 size=1048576 2024-09-12T17:18:11.503 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.502+0000 7f574d1ea780 1 > prepared part key=_multipart_RNI86YYLADT0.2~XEH4N4DDSFF8.1 size=1048576 2024-09-12T17:18:11.504 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.503+0000 7f574d1ea780 1 > prepared part key=_multipart_RNI86YYLADT0.2~XEH4N4DDSFF8.2 size=792917 2024-09-12T17:18:11.504 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.503+0000 7f574d1ea780 1 > prepared multipart upload key=RNI86YYLADT0 upload=XEH4N4DDSFF8 tag=U0NU7OOVBKG0 type=write size=3938645 2024-09-12T17:18:11.505 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.504+0000 7f574d1ea780 1 > prepared operation key=Q2Q3B1J3DAVD tag=C1J3IBNGLXN4 type=del size=1322311 2024-09-12T17:18:11.508 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.507+0000 7f574d1ea780 1 > prepared part key=_multipart_OI51GO639LFK.2~0XQCMVDIF13Y.0 size=1048576 2024-09-12T17:18:11.509 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.508+0000 7f574d1ea780 1 > prepared part key=_multipart_OI51GO639LFK.2~0XQCMVDIF13Y.1 size=73658 2024-09-12T17:18:11.509 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.508+0000 7f574d1ea780 1 > prepared multipart upload key=OI51GO639LFK upload=0XQCMVDIF13Y tag=XBHL9XTO1933 type=write size=2170810 2024-09-12T17:18:11.510 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.509+0000 7f574d1ea780 1 > prepared operation key=QXD8UG2K4STQ tag=5TU4G8DRY874 type=write size=289438 2024-09-12T17:18:11.512 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.511+0000 7f574d1ea780 1 > prepared operation key=7BX38Q7723EB tag=44UANB2I97KU type=del size=1093137 2024-09-12T17:18:11.513 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.512+0000 7f574d1ea780 1 > prepared operation key=TIKBUXFPVTN1 tag=H2FQCFX7YQ1L type=del size=1116037 2024-09-12T17:18:11.514 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.513+0000 7f574d1ea780 1 > prepared operation key=ENFNIFHQ3SHW tag=RPY9OKKQ4XPL type=del size=2814291 2024-09-12T17:18:11.516 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.515+0000 7f574d1ea780 1 > prepared operation key=55V137SY4E4P tag=UJS8CBEJXKJZ type=del size=117318 2024-09-12T17:18:11.517 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.516+0000 7f574d1ea780 1 > prepared operation key=DH02JGZP64MN tag=TL42V7T1UGNJ type=write size=605609 2024-09-12T17:18:11.518 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.518+0000 7f574d1ea780 1 > prepared operation key=C9IYR9CET1I8 tag=UAO1BJK47AZO type=del size=3370844 2024-09-12T17:18:11.521 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.520+0000 7f574d1ea780 1 > prepared part key=_multipart_YXIDO0U18839.2~DTE13W73O5PK.0 size=1048576 2024-09-12T17:18:11.522 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.521+0000 7f574d1ea780 1 > prepared part key=_multipart_YXIDO0U18839.2~DTE13W73O5PK.1 size=385521 2024-09-12T17:18:11.522 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.521+0000 7f574d1ea780 1 > prepared multipart upload key=YXIDO0U18839 upload=DTE13W73O5PK tag=ZGMJOM14MZKO type=write size=2482673 2024-09-12T17:18:11.525 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.524+0000 7f574d1ea780 1 > prepared part key=_multipart_8VW3XCUHLF2L.2~IJ7ASBH147DY.0 size=160698 2024-09-12T17:18:11.525 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.524+0000 7f574d1ea780 1 > prepared multipart upload key=8VW3XCUHLF2L upload=IJ7ASBH147DY tag=EOBAXWWQHOSP type=write size=1209274 2024-09-12T17:18:11.526 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.526+0000 7f574d1ea780 1 < completed part key=_multipart_GEGOEB05R0PK.2~7MC1HLNSG985.0 size=1048576 2024-09-12T17:18:11.527 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.527+0000 7f574d1ea780 1 < completed part key=_multipart_GEGOEB05R0PK.2~7MC1HLNSG985.1 size=49496 2024-09-12T17:18:11.530 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.529+0000 7f574d1ea780 1 < completed multipart upload key=GEGOEB05R0PK upload=7MC1HLNSG985 tag=KIHMK5NGKIXE type=write size=2146648 2024-09-12T17:18:11.531 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.530+0000 7f574d1ea780 1 > prepared operation key=UFKM4I8RMT0W tag=VV09P7IAL4TH type=del size=4087297 2024-09-12T17:18:11.533 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.532+0000 7f574d1ea780 1 < completed part key=_multipart_UFKM4I8RMT0W.2~6BDTQMI8D4FY.0 size=190061 2024-09-12T17:18:11.535 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.534+0000 7f574d1ea780 1 < completed multipart upload key=UFKM4I8RMT0W upload=6BDTQMI8D4FY tag=V9FAW7SPLIHH type=write size=1238637 2024-09-12T17:18:11.537 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.537+0000 7f574d1ea780 1 > prepared part key=_multipart_8SG7DJO4HWPI.2~3G50I15SMH0Q.0 size=1048576 2024-09-12T17:18:11.539 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.538+0000 7f574d1ea780 1 > prepared part key=_multipart_8SG7DJO4HWPI.2~3G50I15SMH0Q.1 size=909461 2024-09-12T17:18:11.539 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.538+0000 7f574d1ea780 1 > prepared multipart upload key=8SG7DJO4HWPI upload=3G50I15SMH0Q tag=OS4EWBYRPGT0 type=write size=3006613 2024-09-12T17:18:11.541 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.541+0000 7f574d1ea780 1 < suggested remove operation key=SQQMJ61CA0QW tag=MM8928JPYPDV type=write 2024-09-12T17:18:11.544 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.543+0000 7f574d1ea780 1 > prepared part key=_multipart_A1TIP3RXHBCZ.2~DCJ9JBT0EPGB.0 size=1048576 2024-09-12T17:18:11.545 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.544+0000 7f574d1ea780 1 > prepared part key=_multipart_A1TIP3RXHBCZ.2~DCJ9JBT0EPGB.1 size=1048576 2024-09-12T17:18:11.546 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.545+0000 7f574d1ea780 1 > prepared part key=_multipart_A1TIP3RXHBCZ.2~DCJ9JBT0EPGB.2 size=412437 2024-09-12T17:18:11.546 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.545+0000 7f574d1ea780 1 > prepared multipart upload key=A1TIP3RXHBCZ upload=DCJ9JBT0EPGB tag=FQAFIU043BN8 type=write size=3558165 2024-09-12T17:18:11.548 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.547+0000 7f574d1ea780 1 < canceled operation key=HFWA7DNUMWF2 tag=VFAC9JIJ44PD type=del size=4128925 2024-09-12T17:18:11.550 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.549+0000 7f574d1ea780 1 > prepared part key=_multipart_A1TIP3RXHBCZ.2~YWTURW112BNY.0 size=1048576 2024-09-12T17:18:11.551 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.550+0000 7f574d1ea780 1 > prepared part key=_multipart_A1TIP3RXHBCZ.2~YWTURW112BNY.1 size=1048576 2024-09-12T17:18:11.552 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.551+0000 7f574d1ea780 1 > prepared part key=_multipart_A1TIP3RXHBCZ.2~YWTURW112BNY.2 size=903971 2024-09-12T17:18:11.553 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.551+0000 7f574d1ea780 1 > prepared multipart upload key=A1TIP3RXHBCZ upload=YWTURW112BNY tag=1OMB5T34CGMT type=write size=4049699 2024-09-12T17:18:11.554 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.553+0000 7f574d1ea780 1 < completed part key=_multipart_RNI86YYLADT0.2~XEH4N4DDSFF8.0 size=1048576 2024-09-12T17:18:11.555 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.554+0000 7f574d1ea780 1 < completed part key=_multipart_RNI86YYLADT0.2~XEH4N4DDSFF8.1 size=1048576 2024-09-12T17:18:11.556 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.555+0000 7f574d1ea780 1 < completed part key=_multipart_RNI86YYLADT0.2~XEH4N4DDSFF8.2 size=792917 2024-09-12T17:18:11.558 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.557+0000 7f574d1ea780 1 < completed multipart upload key=RNI86YYLADT0 upload=XEH4N4DDSFF8 tag=U0NU7OOVBKG0 type=write size=3938645 2024-09-12T17:18:11.559 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.558+0000 7f574d1ea780 1 > prepared operation key=ZGH8XC39FGTC tag=OV4SZCBCV48Y type=del size=3560612 2024-09-12T17:18:11.561 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.560+0000 7f574d1ea780 1 < completed delete operation key=Q2Q3B1J3DAVD tag=C1J3IBNGLXN4 type=del 2024-09-12T17:18:11.562 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.561+0000 7f574d1ea780 1 > prepared operation key=TIKBUXFPVTN1 tag=ZPAWRBRRCUMC type=write size=560105 2024-09-12T17:18:11.562 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.561+0000 7f574d1ea780 1 < canceled part key=_multipart_OI51GO639LFK.2~0XQCMVDIF13Y.0 size=1048576 2024-09-12T17:18:11.563 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.562+0000 7f574d1ea780 1 < completed part key=_multipart_OI51GO639LFK.2~0XQCMVDIF13Y.1 size=73658 2024-09-12T17:18:11.565 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.565+0000 7f574d1ea780 1 < canceled multipart upload key=OI51GO639LFK upload=0XQCMVDIF13Y tag=XBHL9XTO1933 type=write size=2170810 2024-09-12T17:18:11.567 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.566+0000 7f574d1ea780 1 > prepared operation key=ZGH8XC39FGTC tag=GNB8JVY7471T type=del size=3610858 2024-09-12T17:18:11.568 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.567+0000 7f574d1ea780 1 < completed write operation key=QXD8UG2K4STQ tag=5TU4G8DRY874 type=write size=289438 2024-09-12T17:18:11.569 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.568+0000 7f574d1ea780 1 > prepared operation key=ZGH8XC39FGTC tag=N50BH5NSVRBM type=del size=3676888 2024-09-12T17:18:11.571 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.570+0000 7f574d1ea780 1 < completed delete operation key=7BX38Q7723EB tag=44UANB2I97KU type=del 2024-09-12T17:18:11.572 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.571+0000 7f574d1ea780 1 > prepared operation key=YXIDO0U18839 tag=0IDEOIXH8RCX type=del size=1671443 2024-09-12T17:18:11.574 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.573+0000 7f574d1ea780 1 < completed delete operation key=TIKBUXFPVTN1 tag=H2FQCFX7YQ1L type=del 2024-09-12T17:18:11.576 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.575+0000 7f574d1ea780 1 > prepared part key=_multipart_UFKM4I8RMT0W.2~AX9F1JJYFNSB.0 size=1048576 2024-09-12T17:18:11.577 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.576+0000 7f574d1ea780 1 > prepared part key=_multipart_UFKM4I8RMT0W.2~AX9F1JJYFNSB.1 size=435668 2024-09-12T17:18:11.577 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.576+0000 7f574d1ea780 1 > prepared multipart upload key=UFKM4I8RMT0W upload=AX9F1JJYFNSB tag=DBWOCXDMBXID type=write size=2532820 2024-09-12T17:18:11.579 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.578+0000 7f574d1ea780 1 < completed delete operation key=ENFNIFHQ3SHW tag=RPY9OKKQ4XPL type=del 2024-09-12T17:18:11.581 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.580+0000 7f574d1ea780 1 > prepared part key=_multipart_UTCKL1F42X8A.2~KDH9975WO8AV.0 size=1048576 2024-09-12T17:18:11.582 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.581+0000 7f574d1ea780 1 > prepared part key=_multipart_UTCKL1F42X8A.2~KDH9975WO8AV.1 size=1048576 2024-09-12T17:18:11.584 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.583+0000 7f574d1ea780 1 > prepared part key=_multipart_UTCKL1F42X8A.2~KDH9975WO8AV.2 size=76941 2024-09-12T17:18:11.584 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.583+0000 7f574d1ea780 1 > prepared multipart upload key=UTCKL1F42X8A upload=KDH9975WO8AV tag=JDGQFWM1L6GT type=write size=3222669 2024-09-12T17:18:11.586 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.585+0000 7f574d1ea780 1 < completed delete operation key=55V137SY4E4P tag=UJS8CBEJXKJZ type=del 2024-09-12T17:18:11.588 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.587+0000 7f574d1ea780 1 > prepared part key=_multipart_ZGH8XC39FGTC.2~VX83HLLBD9CW.0 size=1048576 2024-09-12T17:18:11.589 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.588+0000 7f574d1ea780 1 > prepared part key=_multipart_ZGH8XC39FGTC.2~VX83HLLBD9CW.1 size=1048576 2024-09-12T17:18:11.590 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.589+0000 7f574d1ea780 1 > prepared part key=_multipart_ZGH8XC39FGTC.2~VX83HLLBD9CW.2 size=452016 2024-09-12T17:18:11.590 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.589+0000 7f574d1ea780 1 > prepared multipart upload key=ZGH8XC39FGTC upload=VX83HLLBD9CW tag=BV4E9LMYJIWL type=write size=3597744 2024-09-12T17:18:11.592 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.591+0000 7f574d1ea780 1 < completed write operation key=DH02JGZP64MN tag=TL42V7T1UGNJ type=write size=605609 2024-09-12T17:18:11.593 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.592+0000 7f574d1ea780 1 > prepared operation key=RNI86YYLADT0 tag=4X8E2JK2SSV5 type=del size=2597221 2024-09-12T17:18:11.594 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.593+0000 7f574d1ea780 1 < completed delete operation key=C9IYR9CET1I8 tag=UAO1BJK47AZO type=del 2024-09-12T17:18:11.595 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.595+0000 7f574d1ea780 1 > prepared operation key=TIKBUXFPVTN1 tag=HN4A07QZOWBC type=write size=675733 2024-09-12T17:18:11.597 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.596+0000 7f574d1ea780 1 < completed part key=_multipart_YXIDO0U18839.2~DTE13W73O5PK.0 size=1048576 2024-09-12T17:18:11.597 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.596+0000 7f574d1ea780 1 < canceled part key=_multipart_YXIDO0U18839.2~DTE13W73O5PK.1 size=385521 2024-09-12T17:18:11.599 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.598+0000 7f574d1ea780 1 < canceled multipart upload key=YXIDO0U18839 upload=DTE13W73O5PK tag=ZGMJOM14MZKO type=write size=2482673 2024-09-12T17:18:11.600 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.600+0000 7f574d1ea780 1 > prepared operation key=GEGOEB05R0PK tag=TFQ3W0TANQBM type=del size=3740683 2024-09-12T17:18:11.601 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.600+0000 7f574d1ea780 1 < canceled part key=_multipart_8VW3XCUHLF2L.2~IJ7ASBH147DY.0 size=160698 2024-09-12T17:18:11.603 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.602+0000 7f574d1ea780 1 < canceled multipart upload key=8VW3XCUHLF2L upload=IJ7ASBH147DY tag=EOBAXWWQHOSP type=write size=1209274 2024-09-12T17:18:11.605 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.604+0000 7f574d1ea780 1 > prepared part key=_multipart_HFWA7DNUMWF2.2~G6JJ95XD2PPU.0 size=1048576 2024-09-12T17:18:11.606 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.605+0000 7f574d1ea780 1 > prepared part key=_multipart_HFWA7DNUMWF2.2~G6JJ95XD2PPU.1 size=1048576 2024-09-12T17:18:11.607 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.606+0000 7f574d1ea780 1 > prepared part key=_multipart_HFWA7DNUMWF2.2~G6JJ95XD2PPU.2 size=762269 2024-09-12T17:18:11.607 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.606+0000 7f574d1ea780 1 > prepared multipart upload key=HFWA7DNUMWF2 upload=G6JJ95XD2PPU tag=R98QHAO3P408 type=write size=3907997 2024-09-12T17:18:11.610 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.609+0000 7f574d1ea780 1 < suggested update operation key=UFKM4I8RMT0W tag=VV09P7IAL4TH type=del size=4087297 2024-09-12T17:18:11.612 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.611+0000 7f574d1ea780 1 > prepared part key=_multipart_OI51GO639LFK.2~XXW1Q5SGDTEK.0 size=1048576 2024-09-12T17:18:11.613 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.612+0000 7f574d1ea780 1 > prepared part key=_multipart_OI51GO639LFK.2~XXW1Q5SGDTEK.1 size=1048576 2024-09-12T17:18:11.614 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.613+0000 7f574d1ea780 1 > prepared part key=_multipart_OI51GO639LFK.2~XXW1Q5SGDTEK.2 size=413306 2024-09-12T17:18:11.614 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.613+0000 7f574d1ea780 1 > prepared multipart upload key=OI51GO639LFK upload=XXW1Q5SGDTEK tag=1N34CA5PTAD2 type=write size=3559034 2024-09-12T17:18:11.615 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.614+0000 7f574d1ea780 1 < completed part key=_multipart_8SG7DJO4HWPI.2~3G50I15SMH0Q.0 size=1048576 2024-09-12T17:18:11.616 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.615+0000 7f574d1ea780 1 < completed part key=_multipart_8SG7DJO4HWPI.2~3G50I15SMH0Q.1 size=909461 2024-09-12T17:18:11.619 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.618+0000 7f574d1ea780 1 < completed multipart upload key=8SG7DJO4HWPI upload=3G50I15SMH0Q tag=OS4EWBYRPGT0 type=write size=3006613 2024-09-12T17:18:11.620 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.619+0000 7f574d1ea780 1 > prepared operation key=DH02JGZP64MN tag=2Z6NN9YBCM6Y type=write size=814203 2024-09-12T17:18:11.621 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.620+0000 7f574d1ea780 1 < completed part key=_multipart_A1TIP3RXHBCZ.2~DCJ9JBT0EPGB.0 size=1048576 2024-09-12T17:18:11.623 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.622+0000 7f574d1ea780 1 < completed part key=_multipart_A1TIP3RXHBCZ.2~DCJ9JBT0EPGB.1 size=1048576 2024-09-12T17:18:11.624 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.623+0000 7f574d1ea780 1 < completed part key=_multipart_A1TIP3RXHBCZ.2~DCJ9JBT0EPGB.2 size=412437 2024-09-12T17:18:11.626 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.625+0000 7f574d1ea780 1 < completed multipart upload key=A1TIP3RXHBCZ upload=DCJ9JBT0EPGB tag=FQAFIU043BN8 type=write size=3558165 2024-09-12T17:18:11.629 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.628+0000 7f574d1ea780 1 > prepared part key=_multipart_GEGOEB05R0PK.2~IMPYVNO824GU.0 size=677308 2024-09-12T17:18:11.629 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.628+0000 7f574d1ea780 1 > prepared multipart upload key=GEGOEB05R0PK upload=IMPYVNO824GU tag=0BJ66VC8DIGM type=write size=1725884 2024-09-12T17:18:11.630 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.629+0000 7f574d1ea780 1 < completed part key=_multipart_A1TIP3RXHBCZ.2~YWTURW112BNY.0 size=1048576 2024-09-12T17:18:11.631 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.630+0000 7f574d1ea780 1 < completed part key=_multipart_A1TIP3RXHBCZ.2~YWTURW112BNY.1 size=1048576 2024-09-12T17:18:11.631 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.630+0000 7f574d1ea780 1 < canceled part key=_multipart_A1TIP3RXHBCZ.2~YWTURW112BNY.2 size=903971 2024-09-12T17:18:11.633 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.632+0000 7f574d1ea780 1 < canceled multipart upload key=A1TIP3RXHBCZ upload=YWTURW112BNY tag=1OMB5T34CGMT type=write size=4049699 2024-09-12T17:18:11.636 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.635+0000 7f574d1ea780 1 > prepared part key=_multipart_55V137SY4E4P.2~C2MG9HMI9IJZ.0 size=1048576 2024-09-12T17:18:11.637 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.636+0000 7f574d1ea780 1 > prepared part key=_multipart_55V137SY4E4P.2~C2MG9HMI9IJZ.1 size=1048576 2024-09-12T17:18:11.638 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.637+0000 7f574d1ea780 1 > prepared part key=_multipart_55V137SY4E4P.2~C2MG9HMI9IJZ.2 size=29985 2024-09-12T17:18:11.638 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.637+0000 7f574d1ea780 1 > prepared multipart upload key=55V137SY4E4P upload=C2MG9HMI9IJZ tag=MCQ32JQGFCHK type=write size=3175713 2024-09-12T17:18:11.639 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.638+0000 7f574d1ea780 1 < completed delete operation key=ZGH8XC39FGTC tag=OV4SZCBCV48Y type=del 2024-09-12T17:18:11.640 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.639+0000 7f574d1ea780 1 > prepared operation key=HGZMN894YYC0 tag=21C7PKCBKPGX type=del size=1999303 2024-09-12T17:18:11.642 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.641+0000 7f574d1ea780 1 < completed write operation key=TIKBUXFPVTN1 tag=ZPAWRBRRCUMC type=write size=560105 2024-09-12T17:18:11.643 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.643+0000 7f574d1ea780 1 > prepared operation key=YXIDO0U18839 tag=7UXCACA6ABVO type=del size=2656682 2024-09-12T17:18:11.645 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.644+0000 7f574d1ea780 1 < completed delete operation key=ZGH8XC39FGTC tag=GNB8JVY7471T type=del 2024-09-12T17:18:11.647 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.646+0000 7f574d1ea780 1 > prepared part key=_multipart_OI51GO639LFK.2~LLVEYGZM48ZP.0 size=1048576 2024-09-12T17:18:11.648 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.647+0000 7f574d1ea780 1 > prepared part key=_multipart_OI51GO639LFK.2~LLVEYGZM48ZP.1 size=318221 2024-09-12T17:18:11.648 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.647+0000 7f574d1ea780 1 > prepared multipart upload key=OI51GO639LFK upload=LLVEYGZM48ZP tag=AM5PUVY0X7SW type=write size=2415373 2024-09-12T17:18:11.649 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.648+0000 7f574d1ea780 1 < completed delete operation key=ZGH8XC39FGTC tag=N50BH5NSVRBM type=del 2024-09-12T17:18:11.651 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.650+0000 7f574d1ea780 1 > prepared part key=_multipart_HFWA7DNUMWF2.2~L3P2DIAQRNT6.0 size=1048576 2024-09-12T17:18:11.652 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.651+0000 7f574d1ea780 1 > prepared part key=_multipart_HFWA7DNUMWF2.2~L3P2DIAQRNT6.1 size=1048576 2024-09-12T17:18:11.653 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.652+0000 7f574d1ea780 1 > prepared part key=_multipart_HFWA7DNUMWF2.2~L3P2DIAQRNT6.2 size=899613 2024-09-12T17:18:11.653 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.652+0000 7f574d1ea780 1 > prepared multipart upload key=HFWA7DNUMWF2 upload=L3P2DIAQRNT6 tag=J8VWRIDUDCUR type=write size=4045341 2024-09-12T17:18:11.654 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.653+0000 7f574d1ea780 1 < completed delete operation key=YXIDO0U18839 tag=0IDEOIXH8RCX type=del 2024-09-12T17:18:11.657 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.656+0000 7f574d1ea780 1 > prepared part key=_multipart_YXIDO0U18839.2~G9M1NKQUICST.0 size=1048576 2024-09-12T17:18:11.658 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.657+0000 7f574d1ea780 1 > prepared part key=_multipart_YXIDO0U18839.2~G9M1NKQUICST.1 size=439837 2024-09-12T17:18:11.658 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.657+0000 7f574d1ea780 1 > prepared multipart upload key=YXIDO0U18839 upload=G9M1NKQUICST tag=L9EU25DY3CH2 type=write size=2536989 2024-09-12T17:18:11.659 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.658+0000 7f574d1ea780 1 < completed part key=_multipart_UFKM4I8RMT0W.2~AX9F1JJYFNSB.0 size=1048576 2024-09-12T17:18:11.660 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.659+0000 7f574d1ea780 1 < completed part key=_multipart_UFKM4I8RMT0W.2~AX9F1JJYFNSB.1 size=435668 2024-09-12T17:18:11.662 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.661+0000 7f574d1ea780 1 < completed multipart upload key=UFKM4I8RMT0W upload=AX9F1JJYFNSB tag=DBWOCXDMBXID type=write size=2532820 2024-09-12T17:18:11.664 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.663+0000 7f574d1ea780 1 > prepared operation key=UFKM4I8RMT0W tag=633DP51009OC type=del size=3259243 2024-09-12T17:18:11.665 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.664+0000 7f574d1ea780 1 < completed part key=_multipart_UTCKL1F42X8A.2~KDH9975WO8AV.0 size=1048576 2024-09-12T17:18:11.666 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.665+0000 7f574d1ea780 1 < completed part key=_multipart_UTCKL1F42X8A.2~KDH9975WO8AV.1 size=1048576 2024-09-12T17:18:11.667 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.666+0000 7f574d1ea780 1 < completed part key=_multipart_UTCKL1F42X8A.2~KDH9975WO8AV.2 size=76941 2024-09-12T17:18:11.669 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.668+0000 7f574d1ea780 1 < completed multipart upload key=UTCKL1F42X8A upload=KDH9975WO8AV tag=JDGQFWM1L6GT type=write size=3222669 2024-09-12T17:18:11.671 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.670+0000 7f574d1ea780 1 > prepared part key=_multipart_55JI541K1WP2.2~GU1ZZB21I0OZ.0 size=430001 2024-09-12T17:18:11.671 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.670+0000 7f574d1ea780 1 > prepared multipart upload key=55JI541K1WP2 upload=GU1ZZB21I0OZ tag=WS02W11TRLPH type=write size=1478577 2024-09-12T17:18:11.673 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.672+0000 7f574d1ea780 1 < completed part key=_multipart_ZGH8XC39FGTC.2~VX83HLLBD9CW.0 size=1048576 2024-09-12T17:18:11.674 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.673+0000 7f574d1ea780 1 < completed part key=_multipart_ZGH8XC39FGTC.2~VX83HLLBD9CW.1 size=1048576 2024-09-12T17:18:11.674 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.673+0000 7f574d1ea780 1 < canceled part key=_multipart_ZGH8XC39FGTC.2~VX83HLLBD9CW.2 size=452016 2024-09-12T17:18:11.676 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.675+0000 7f574d1ea780 1 < canceled multipart upload key=ZGH8XC39FGTC upload=VX83HLLBD9CW tag=BV4E9LMYJIWL type=write size=3597744 2024-09-12T17:18:11.677 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.676+0000 7f574d1ea780 1 > prepared operation key=43GV2N9VBBKE tag=1BTA500PWXCC type=del size=1899328 2024-09-12T17:18:11.681 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.677+0000 7f574d1ea780 1 < completed delete operation key=RNI86YYLADT0 tag=4X8E2JK2SSV5 type=del 2024-09-12T17:18:11.681 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.679+0000 7f574d1ea780 1 > prepared part key=_multipart_SQQMJ61CA0QW.2~CDNEIH67MSCI.0 size=1048576 2024-09-12T17:18:11.681 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.680+0000 7f574d1ea780 1 > prepared part key=_multipart_SQQMJ61CA0QW.2~CDNEIH67MSCI.1 size=986436 2024-09-12T17:18:11.681 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.680+0000 7f574d1ea780 1 > prepared multipart upload key=SQQMJ61CA0QW upload=CDNEIH67MSCI tag=0302HJ35JB8B type=write size=3083588 2024-09-12T17:18:11.683 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.683+0000 7f574d1ea780 1 < suggested update operation key=TIKBUXFPVTN1 tag=HN4A07QZOWBC type=write size=675733 2024-09-12T17:18:11.685 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.684+0000 7f574d1ea780 1 > prepared operation key=ZGE1860DMGHA tag=33KEXC53P3HV type=del size=1707035 2024-09-12T17:18:11.686 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.685+0000 7f574d1ea780 1 < completed delete operation key=GEGOEB05R0PK tag=TFQ3W0TANQBM type=del 2024-09-12T17:18:11.688 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.687+0000 7f574d1ea780 1 > prepared part key=_multipart_YXIDO0U18839.2~TJAHIBRMBHUA.0 size=14660 2024-09-12T17:18:11.688 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.687+0000 7f574d1ea780 1 > prepared multipart upload key=YXIDO0U18839 upload=TJAHIBRMBHUA tag=9TPA2QERQH77 type=write size=1063236 2024-09-12T17:18:11.689 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.688+0000 7f574d1ea780 1 < completed part key=_multipart_HFWA7DNUMWF2.2~G6JJ95XD2PPU.0 size=1048576 2024-09-12T17:18:11.690 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.689+0000 7f574d1ea780 1 < completed part key=_multipart_HFWA7DNUMWF2.2~G6JJ95XD2PPU.1 size=1048576 2024-09-12T17:18:11.691 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.690+0000 7f574d1ea780 1 < completed part key=_multipart_HFWA7DNUMWF2.2~G6JJ95XD2PPU.2 size=762269 2024-09-12T17:18:11.693 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.692+0000 7f574d1ea780 1 < completed multipart upload key=HFWA7DNUMWF2 upload=G6JJ95XD2PPU tag=R98QHAO3P408 type=write size=3907997 2024-09-12T17:18:11.694 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.694+0000 7f574d1ea780 1 > prepared operation key=54LQ91UMBJAN tag=31G58LEF01EU type=del size=3893265 2024-09-12T17:18:11.696 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.695+0000 7f574d1ea780 1 < completed part key=_multipart_OI51GO639LFK.2~XXW1Q5SGDTEK.0 size=1048576 2024-09-12T17:18:11.697 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.696+0000 7f574d1ea780 1 < completed part key=_multipart_OI51GO639LFK.2~XXW1Q5SGDTEK.1 size=1048576 2024-09-12T17:18:11.697 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.696+0000 7f574d1ea780 1 < canceled part key=_multipart_OI51GO639LFK.2~XXW1Q5SGDTEK.2 size=413306 2024-09-12T17:18:11.699 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.698+0000 7f574d1ea780 1 < canceled multipart upload key=OI51GO639LFK upload=XXW1Q5SGDTEK tag=1N34CA5PTAD2 type=write size=3559034 2024-09-12T17:18:11.700 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.699+0000 7f574d1ea780 1 > prepared operation key=ZGH8XC39FGTC tag=IOH48Z69SUMC type=del size=1989470 2024-09-12T17:18:11.701 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.700+0000 7f574d1ea780 1 < completed write operation key=DH02JGZP64MN tag=2Z6NN9YBCM6Y type=write size=814203 2024-09-12T17:18:11.703 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.702+0000 7f574d1ea780 1 > prepared operation key=7BX38Q7723EB tag=LKF2NDCDIQZK type=del size=2337387 2024-09-12T17:18:11.704 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.703+0000 7f574d1ea780 1 < completed part key=_multipart_GEGOEB05R0PK.2~IMPYVNO824GU.0 size=677308 2024-09-12T17:18:11.706 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.705+0000 7f574d1ea780 1 < completed multipart upload key=GEGOEB05R0PK upload=IMPYVNO824GU tag=0BJ66VC8DIGM type=write size=1725884 2024-09-12T17:18:11.707 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.706+0000 7f574d1ea780 1 > prepared operation key=RWVWJHVZE95H tag=K6ORDH927ARO type=del size=2239844 2024-09-12T17:18:11.708 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.708+0000 7f574d1ea780 1 < completed part key=_multipart_55V137SY4E4P.2~C2MG9HMI9IJZ.0 size=1048576 2024-09-12T17:18:11.709 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.708+0000 7f574d1ea780 1 < completed part key=_multipart_55V137SY4E4P.2~C2MG9HMI9IJZ.1 size=1048576 2024-09-12T17:18:11.710 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.710+0000 7f574d1ea780 1 < completed part key=_multipart_55V137SY4E4P.2~C2MG9HMI9IJZ.2 size=29985 2024-09-12T17:18:11.713 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.712+0000 7f574d1ea780 1 < completed multipart upload key=55V137SY4E4P upload=C2MG9HMI9IJZ tag=MCQ32JQGFCHK type=write size=3175713 2024-09-12T17:18:11.714 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.713+0000 7f574d1ea780 1 > prepared operation key=DH02JGZP64MN tag=AOYK1W1SB2KZ type=write size=810681 2024-09-12T17:18:11.716 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.715+0000 7f574d1ea780 1 < suggested update operation key=HGZMN894YYC0 tag=21C7PKCBKPGX type=del size=1999303 2024-09-12T17:18:11.718 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.718+0000 7f574d1ea780 1 > prepared part key=_multipart_ZGE1860DMGHA.2~RCR2PBFIUMVR.0 size=1048576 2024-09-12T17:18:11.719 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.719+0000 7f574d1ea780 1 > prepared part key=_multipart_ZGE1860DMGHA.2~RCR2PBFIUMVR.1 size=160230 2024-09-12T17:18:11.719 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.719+0000 7f574d1ea780 1 > prepared multipart upload key=ZGE1860DMGHA upload=RCR2PBFIUMVR tag=ENYJU8CFTVFM type=write size=2257382 2024-09-12T17:18:11.721 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.720+0000 7f574d1ea780 1 < completed delete operation key=YXIDO0U18839 tag=7UXCACA6ABVO type=del 2024-09-12T17:18:11.722 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.721+0000 7f574d1ea780 1 > prepared operation key=8SG7DJO4HWPI tag=ZHJ4QT3HADA8 type=write size=740545 2024-09-12T17:18:11.723 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.722+0000 7f574d1ea780 1 < completed part key=_multipart_OI51GO639LFK.2~LLVEYGZM48ZP.0 size=1048576 2024-09-12T17:18:11.724 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.723+0000 7f574d1ea780 1 < completed part key=_multipart_OI51GO639LFK.2~LLVEYGZM48ZP.1 size=318221 2024-09-12T17:18:11.726 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.725+0000 7f574d1ea780 1 < completed multipart upload key=OI51GO639LFK upload=LLVEYGZM48ZP tag=AM5PUVY0X7SW type=write size=2415373 2024-09-12T17:18:11.727 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.726+0000 7f574d1ea780 1 > prepared operation key=QXD8UG2K4STQ tag=BGHJRKK5GHQ5 type=del size=1261959 2024-09-12T17:18:11.728 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.728+0000 7f574d1ea780 1 < completed part key=_multipart_HFWA7DNUMWF2.2~L3P2DIAQRNT6.0 size=1048576 2024-09-12T17:18:11.729 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.729+0000 7f574d1ea780 1 < completed part key=_multipart_HFWA7DNUMWF2.2~L3P2DIAQRNT6.1 size=1048576 2024-09-12T17:18:11.730 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.730+0000 7f574d1ea780 1 < completed part key=_multipart_HFWA7DNUMWF2.2~L3P2DIAQRNT6.2 size=899613 2024-09-12T17:18:11.733 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.732+0000 7f574d1ea780 1 < completed multipart upload key=HFWA7DNUMWF2 upload=L3P2DIAQRNT6 tag=J8VWRIDUDCUR type=write size=4045341 2024-09-12T17:18:11.734 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.733+0000 7f574d1ea780 1 > prepared operation key=R00F69ON5P6Z tag=CZYPD655VX73 type=del size=3109191 2024-09-12T17:18:11.735 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.734+0000 7f574d1ea780 1 < completed part key=_multipart_YXIDO0U18839.2~G9M1NKQUICST.0 size=1048576 2024-09-12T17:18:11.736 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.735+0000 7f574d1ea780 1 < completed part key=_multipart_YXIDO0U18839.2~G9M1NKQUICST.1 size=439837 2024-09-12T17:18:11.738 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.737+0000 7f574d1ea780 1 < completed multipart upload key=YXIDO0U18839 upload=G9M1NKQUICST tag=L9EU25DY3CH2 type=write size=2536989 2024-09-12T17:18:11.741 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.740+0000 7f574d1ea780 1 > prepared part key=_multipart_A1TIP3RXHBCZ.2~UC5HMDR2XECS.0 size=878186 2024-09-12T17:18:11.741 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.740+0000 7f574d1ea780 1 > prepared multipart upload key=A1TIP3RXHBCZ upload=UC5HMDR2XECS tag=7ENPUO4M3J3H type=write size=1926762 2024-09-12T17:18:11.742 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.742+0000 7f574d1ea780 1 < completed delete operation key=UFKM4I8RMT0W tag=633DP51009OC type=del 2024-09-12T17:18:11.744 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.743+0000 7f574d1ea780 1 > prepared operation key=8SG7DJO4HWPI tag=Z9D90C361152 type=write size=154747 2024-09-12T17:18:11.745 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.744+0000 7f574d1ea780 1 < completed part key=_multipart_55JI541K1WP2.2~GU1ZZB21I0OZ.0 size=430001 2024-09-12T17:18:11.747 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.746+0000 7f574d1ea780 1 < completed multipart upload key=55JI541K1WP2 upload=GU1ZZB21I0OZ tag=WS02W11TRLPH type=write size=1478577 2024-09-12T17:18:11.748 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.748+0000 7f574d1ea780 1 > prepared operation key=DH02JGZP64MN tag=80EA9A8AEQT2 type=write size=993775 2024-09-12T17:18:11.750 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.749+0000 7f574d1ea780 1 < completed delete operation key=43GV2N9VBBKE tag=1BTA500PWXCC type=del 2024-09-12T17:18:11.751 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.750+0000 7f574d1ea780 1 > prepared operation key=U6E9A5OH4GUW tag=218NS840E82C type=del size=1692170 2024-09-12T17:18:11.752 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.751+0000 7f574d1ea780 1 < completed part key=_multipart_SQQMJ61CA0QW.2~CDNEIH67MSCI.0 size=1048576 2024-09-12T17:18:11.753 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.752+0000 7f574d1ea780 1 < completed part key=_multipart_SQQMJ61CA0QW.2~CDNEIH67MSCI.1 size=986436 2024-09-12T17:18:11.756 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.755+0000 7f574d1ea780 1 < completed multipart upload key=SQQMJ61CA0QW upload=CDNEIH67MSCI tag=0302HJ35JB8B type=write size=3083588 2024-09-12T17:18:11.758 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.757+0000 7f574d1ea780 1 > prepared part key=_multipart_HFWA7DNUMWF2.2~116N5XYN2TVL.0 size=1048576 2024-09-12T17:18:11.759 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.758+0000 7f574d1ea780 1 > prepared part key=_multipart_HFWA7DNUMWF2.2~116N5XYN2TVL.1 size=1048576 2024-09-12T17:18:11.760 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.759+0000 7f574d1ea780 1 > prepared part key=_multipart_HFWA7DNUMWF2.2~116N5XYN2TVL.2 size=641520 2024-09-12T17:18:11.760 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.759+0000 7f574d1ea780 1 > prepared multipart upload key=HFWA7DNUMWF2 upload=116N5XYN2TVL tag=D429J5A4I5T2 type=write size=3787248 2024-09-12T17:18:11.762 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.761+0000 7f574d1ea780 1 < suggested remove operation key=ZGE1860DMGHA tag=33KEXC53P3HV type=del 2024-09-12T17:18:11.763 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.762+0000 7f574d1ea780 1 > prepared operation key=55V137SY4E4P tag=GDRSE5N54MEU type=write size=368177 2024-09-12T17:18:11.765 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.764+0000 7f574d1ea780 1 < completed part key=_multipart_YXIDO0U18839.2~TJAHIBRMBHUA.0 size=14660 2024-09-12T17:18:11.767 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.766+0000 7f574d1ea780 1 < completed multipart upload key=YXIDO0U18839 upload=TJAHIBRMBHUA tag=9TPA2QERQH77 type=write size=1063236 2024-09-12T17:18:11.768 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.767+0000 7f574d1ea780 1 > prepared operation key=C9IYR9CET1I8 tag=VZL1M3OXK9N7 type=del size=608518 2024-09-12T17:18:11.769 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.768+0000 7f574d1ea780 1 < completed delete operation key=54LQ91UMBJAN tag=31G58LEF01EU type=del 2024-09-12T17:18:11.771 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.770+0000 7f574d1ea780 1 > prepared part key=_multipart_C9IYR9CET1I8.2~60IXBXKGZTES.0 size=1048576 2024-09-12T17:18:11.772 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.771+0000 7f574d1ea780 1 > prepared part key=_multipart_C9IYR9CET1I8.2~60IXBXKGZTES.1 size=607553 2024-09-12T17:18:11.772 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.771+0000 7f574d1ea780 1 > prepared multipart upload key=C9IYR9CET1I8 upload=60IXBXKGZTES tag=425OIE0BVZLJ type=write size=2704705 2024-09-12T17:18:11.773 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.773+0000 7f574d1ea780 1 < completed delete operation key=ZGH8XC39FGTC tag=IOH48Z69SUMC type=del 2024-09-12T17:18:11.775 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.774+0000 7f574d1ea780 1 > prepared operation key=8VW3XCUHLF2L tag=M41YZM8L6LSA type=del size=61469 2024-09-12T17:18:11.776 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.775+0000 7f574d1ea780 1 < completed delete operation key=7BX38Q7723EB tag=LKF2NDCDIQZK type=del 2024-09-12T17:18:11.778 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.777+0000 7f574d1ea780 1 > prepared part key=_multipart_54LQ91UMBJAN.2~BMJT26DV7043.0 size=148475 2024-09-12T17:18:11.778 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.777+0000 7f574d1ea780 1 > prepared multipart upload key=54LQ91UMBJAN upload=BMJT26DV7043 tag=IASNH7NGT5VX type=write size=1197051 2024-09-12T17:18:11.779 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.778+0000 7f574d1ea780 1 < completed delete operation key=RWVWJHVZE95H tag=K6ORDH927ARO type=del 2024-09-12T17:18:11.780 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.780+0000 7f574d1ea780 1 > prepared operation key=R00F69ON5P6Z tag=7IE5ZKLF7VFN type=del size=1940618 2024-09-12T17:18:11.782 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.781+0000 7f574d1ea780 1 < canceled operation key=DH02JGZP64MN tag=AOYK1W1SB2KZ type=write size=810681 2024-09-12T17:18:11.783 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.782+0000 7f574d1ea780 1 > prepared operation key=DH02JGZP64MN tag=JY8FZADW4BFJ type=del size=3991971 2024-09-12T17:18:11.784 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.783+0000 7f574d1ea780 1 < completed part key=_multipart_ZGE1860DMGHA.2~RCR2PBFIUMVR.0 size=1048576 2024-09-12T17:18:11.785 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.784+0000 7f574d1ea780 1 < completed part key=_multipart_ZGE1860DMGHA.2~RCR2PBFIUMVR.1 size=160230 2024-09-12T17:18:11.787 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.786+0000 7f574d1ea780 1 < completed multipart upload key=ZGE1860DMGHA upload=RCR2PBFIUMVR tag=ENYJU8CFTVFM type=write size=2257382 2024-09-12T17:18:11.788 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.788+0000 7f574d1ea780 1 > prepared operation key=U6E9A5OH4GUW tag=8O0MRA66N35V type=del size=1710678 2024-09-12T17:18:11.790 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.789+0000 7f574d1ea780 1 < completed write operation key=8SG7DJO4HWPI tag=ZHJ4QT3HADA8 type=write size=740545 2024-09-12T17:18:11.792 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.791+0000 7f574d1ea780 1 > prepared part key=_multipart_54LQ91UMBJAN.2~MTPZPDX0AJDA.0 size=410230 2024-09-12T17:18:11.792 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.791+0000 7f574d1ea780 1 > prepared multipart upload key=54LQ91UMBJAN upload=MTPZPDX0AJDA tag=YOI21ITPFPJQ type=write size=1458806 2024-09-12T17:18:11.794 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.794+0000 7f574d1ea780 1 < suggested update operation key=QXD8UG2K4STQ tag=BGHJRKK5GHQ5 type=del size=1261959 2024-09-12T17:18:11.797 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.796+0000 7f574d1ea780 1 > prepared part key=_multipart_55JI541K1WP2.2~OEPKP3WCBDS8.0 size=82615 2024-09-12T17:18:11.797 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.796+0000 7f574d1ea780 1 > prepared multipart upload key=55JI541K1WP2 upload=OEPKP3WCBDS8 tag=7XUV1TB0JBZJ type=write size=1131191 2024-09-12T17:18:11.798 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.797+0000 7f574d1ea780 1 < completed delete operation key=R00F69ON5P6Z tag=CZYPD655VX73 type=del 2024-09-12T17:18:11.799 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.798+0000 7f574d1ea780 1 > prepared operation key=OI51GO639LFK tag=PTFZHHMSAU90 type=del size=3489423 2024-09-12T17:18:11.800 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.800+0000 7f574d1ea780 1 < completed part key=_multipart_A1TIP3RXHBCZ.2~UC5HMDR2XECS.0 size=878186 2024-09-12T17:18:11.802 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.802+0000 7f574d1ea780 1 < completed multipart upload key=A1TIP3RXHBCZ upload=UC5HMDR2XECS tag=7ENPUO4M3J3H type=write size=1926762 2024-09-12T17:18:11.805 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.804+0000 7f574d1ea780 1 > prepared part key=_multipart_7BX38Q7723EB.2~G889B5YCWJQX.0 size=1048576 2024-09-12T17:18:11.806 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.805+0000 7f574d1ea780 1 > prepared part key=_multipart_7BX38Q7723EB.2~G889B5YCWJQX.1 size=1048576 2024-09-12T17:18:11.807 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.806+0000 7f574d1ea780 1 > prepared part key=_multipart_7BX38Q7723EB.2~G889B5YCWJQX.2 size=915450 2024-09-12T17:18:11.807 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.806+0000 7f574d1ea780 1 > prepared multipart upload key=7BX38Q7723EB upload=G889B5YCWJQX tag=TCON9T5EXBLD type=write size=4061178 2024-09-12T17:18:11.808 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.807+0000 7f574d1ea780 1 < completed write operation key=8SG7DJO4HWPI tag=Z9D90C361152 type=write size=154747 2024-09-12T17:18:11.810 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.809+0000 7f574d1ea780 1 > prepared part key=_multipart_RNI86YYLADT0.2~034YU0W9AWM4.0 size=841720 2024-09-12T17:18:11.810 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.809+0000 7f574d1ea780 1 > prepared multipart upload key=RNI86YYLADT0 upload=034YU0W9AWM4 tag=7ELEILCZ0B18 type=write size=1890296 2024-09-12T17:18:11.811 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.811+0000 7f574d1ea780 1 < completed write operation key=DH02JGZP64MN tag=80EA9A8AEQT2 type=write size=993775 2024-09-12T17:18:11.814 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.813+0000 7f574d1ea780 1 > prepared part key=_multipart_55V137SY4E4P.2~GQYL4M6OA9YJ.0 size=1048576 2024-09-12T17:18:11.815 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.814+0000 7f574d1ea780 1 > prepared part key=_multipart_55V137SY4E4P.2~GQYL4M6OA9YJ.1 size=1048576 2024-09-12T17:18:11.816 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.815+0000 7f574d1ea780 1 > prepared part key=_multipart_55V137SY4E4P.2~GQYL4M6OA9YJ.2 size=796843 2024-09-12T17:18:11.816 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.815+0000 7f574d1ea780 1 > prepared multipart upload key=55V137SY4E4P upload=GQYL4M6OA9YJ tag=9NV2LS4ZCAVL type=write size=3942571 2024-09-12T17:18:11.817 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.816+0000 7f574d1ea780 1 < completed delete operation key=U6E9A5OH4GUW tag=218NS840E82C type=del 2024-09-12T17:18:11.819 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.818+0000 7f574d1ea780 1 > prepared part key=_multipart_DH02JGZP64MN.2~43NHIOPY3TI1.0 size=461079 2024-09-12T17:18:11.819 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.818+0000 7f574d1ea780 1 > prepared multipart upload key=DH02JGZP64MN upload=43NHIOPY3TI1 tag=K015STB3VE63 type=write size=1509655 2024-09-12T17:18:11.821 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.820+0000 7f574d1ea780 1 < completed part key=_multipart_HFWA7DNUMWF2.2~116N5XYN2TVL.0 size=1048576 2024-09-12T17:18:11.822 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.821+0000 7f574d1ea780 1 < completed part key=_multipart_HFWA7DNUMWF2.2~116N5XYN2TVL.1 size=1048576 2024-09-12T17:18:11.823 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.822+0000 7f574d1ea780 1 < completed part key=_multipart_HFWA7DNUMWF2.2~116N5XYN2TVL.2 size=641520 2024-09-12T17:18:11.825 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.824+0000 7f574d1ea780 1 < completed multipart upload key=HFWA7DNUMWF2 upload=116N5XYN2TVL tag=D429J5A4I5T2 type=write size=3787248 2024-09-12T17:18:11.826 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.825+0000 7f574d1ea780 1 > prepared operation key=UTCKL1F42X8A tag=Z7J134FFL5WD type=write size=1011031 2024-09-12T17:18:11.827 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.826+0000 7f574d1ea780 1 < completed write operation key=55V137SY4E4P tag=GDRSE5N54MEU type=write size=368177 2024-09-12T17:18:11.829 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.828+0000 7f574d1ea780 1 > prepared part key=_multipart_DH02JGZP64MN.2~B1N0X499M101.0 size=194960 2024-09-12T17:18:11.829 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.828+0000 7f574d1ea780 1 > prepared multipart upload key=DH02JGZP64MN upload=B1N0X499M101 tag=CWUOZBPJRP0C type=write size=1243536 2024-09-12T17:18:11.832 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.831+0000 7f574d1ea780 1 < suggested remove operation key=C9IYR9CET1I8 tag=VZL1M3OXK9N7 type=del 2024-09-12T17:18:11.833 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.832+0000 7f574d1ea780 1 > prepared operation key=Q2Q3B1J3DAVD tag=UTXM4EU7YD1H type=del size=360184 2024-09-12T17:18:11.834 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.834+0000 7f574d1ea780 1 < completed part key=_multipart_C9IYR9CET1I8.2~60IXBXKGZTES.0 size=1048576 2024-09-12T17:18:11.835 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.835+0000 7f574d1ea780 1 < completed part key=_multipart_C9IYR9CET1I8.2~60IXBXKGZTES.1 size=607553 2024-09-12T17:18:11.837 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.837+0000 7f574d1ea780 1 < completed multipart upload key=C9IYR9CET1I8 upload=60IXBXKGZTES tag=425OIE0BVZLJ type=write size=2704705 2024-09-12T17:18:11.840 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.839+0000 7f574d1ea780 1 > prepared part key=_multipart_HFWA7DNUMWF2.2~FIYSXRABMT8X.0 size=1048576 2024-09-12T17:18:11.841 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.840+0000 7f574d1ea780 1 > prepared part key=_multipart_HFWA7DNUMWF2.2~FIYSXRABMT8X.1 size=1048576 2024-09-12T17:18:11.842 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.841+0000 7f574d1ea780 1 > prepared part key=_multipart_HFWA7DNUMWF2.2~FIYSXRABMT8X.2 size=64612 2024-09-12T17:18:11.842 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.841+0000 7f574d1ea780 1 > prepared multipart upload key=HFWA7DNUMWF2 upload=FIYSXRABMT8X tag=N41Q63N080YT type=write size=3210340 2024-09-12T17:18:11.843 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.843+0000 7f574d1ea780 1 < canceled operation key=8VW3XCUHLF2L tag=M41YZM8L6LSA type=del size=61469 2024-09-12T17:18:11.845 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.844+0000 7f574d1ea780 1 > prepared operation key=RNI86YYLADT0 tag=RFIRPHUB93XR type=del size=2441931 2024-09-12T17:18:11.846 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.845+0000 7f574d1ea780 1 < completed part key=_multipart_54LQ91UMBJAN.2~BMJT26DV7043.0 size=148475 2024-09-12T17:18:11.848 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.847+0000 7f574d1ea780 1 < completed multipart upload key=54LQ91UMBJAN upload=BMJT26DV7043 tag=IASNH7NGT5VX type=write size=1197051 2024-09-12T17:18:11.849 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.848+0000 7f574d1ea780 1 > prepared operation key=UFKM4I8RMT0W tag=ZCFOU56PCRRG type=del size=2182702 2024-09-12T17:18:11.851 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.851+0000 7f574d1ea780 1 < suggested remove operation key=R00F69ON5P6Z tag=7IE5ZKLF7VFN type=del 2024-09-12T17:18:11.854 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.853+0000 7f574d1ea780 1 > prepared part key=_multipart_8SG7DJO4HWPI.2~WMZ46QXLJH65.0 size=409513 2024-09-12T17:18:11.854 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.853+0000 7f574d1ea780 1 > prepared multipart upload key=8SG7DJO4HWPI upload=WMZ46QXLJH65 tag=XNZ30WR58JUY type=write size=1458089 2024-09-12T17:18:11.857 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.856+0000 7f574d1ea780 1 < suggested remove operation key=DH02JGZP64MN tag=JY8FZADW4BFJ type=del 2024-09-12T17:18:11.858 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.858+0000 7f574d1ea780 1 > prepared operation key=54LQ91UMBJAN tag=2ZDABE08RNSM type=write size=931182 2024-09-12T17:18:11.860 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.859+0000 7f574d1ea780 1 < canceled operation key=U6E9A5OH4GUW tag=8O0MRA66N35V type=del size=1710678 2024-09-12T17:18:11.861 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.860+0000 7f574d1ea780 1 > prepared operation key=U6E9A5OH4GUW tag=O6DWEZ7O5YQ9 type=del size=1047037 2024-09-12T17:18:11.862 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.861+0000 7f574d1ea780 1 < completed part key=_multipart_54LQ91UMBJAN.2~MTPZPDX0AJDA.0 size=410230 2024-09-12T17:18:11.864 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.863+0000 7f574d1ea780 1 < completed multipart upload key=54LQ91UMBJAN upload=MTPZPDX0AJDA tag=YOI21ITPFPJQ type=write size=1458806 2024-09-12T17:18:11.866 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.865+0000 7f574d1ea780 1 > prepared operation key=UFKM4I8RMT0W tag=Z76DXIU25PYP type=del size=1823498 2024-09-12T17:18:11.867 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.866+0000 7f574d1ea780 1 < completed part key=_multipart_55JI541K1WP2.2~OEPKP3WCBDS8.0 size=82615 2024-09-12T17:18:11.868 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.868+0000 7f574d1ea780 1 < completed multipart upload key=55JI541K1WP2 upload=OEPKP3WCBDS8 tag=7XUV1TB0JBZJ type=write size=1131191 2024-09-12T17:18:11.870 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.869+0000 7f574d1ea780 1 > prepared operation key=YXIDO0U18839 tag=PGWDCHLWBEYN type=del size=1943472 2024-09-12T17:18:11.871 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.870+0000 7f574d1ea780 1 < completed delete operation key=OI51GO639LFK tag=PTFZHHMSAU90 type=del 2024-09-12T17:18:11.872 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.871+0000 7f574d1ea780 1 > prepared operation key=8SG7DJO4HWPI tag=UCCI5DC02ACZ type=del size=3926906 2024-09-12T17:18:11.873 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.872+0000 7f574d1ea780 1 < completed part key=_multipart_7BX38Q7723EB.2~G889B5YCWJQX.0 size=1048576 2024-09-12T17:18:11.874 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.873+0000 7f574d1ea780 1 < completed part key=_multipart_7BX38Q7723EB.2~G889B5YCWJQX.1 size=1048576 2024-09-12T17:18:11.875 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.874+0000 7f574d1ea780 1 < completed part key=_multipart_7BX38Q7723EB.2~G889B5YCWJQX.2 size=915450 2024-09-12T17:18:11.877 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.876+0000 7f574d1ea780 1 < completed multipart upload key=7BX38Q7723EB upload=G889B5YCWJQX tag=TCON9T5EXBLD type=write size=4061178 2024-09-12T17:18:11.879 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.878+0000 7f574d1ea780 1 > prepared operation key=7BX38Q7723EB tag=OPLBREYE79UO type=del size=2239484 2024-09-12T17:18:11.880 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.879+0000 7f574d1ea780 1 < completed part key=_multipart_RNI86YYLADT0.2~034YU0W9AWM4.0 size=841720 2024-09-12T17:18:11.882 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.881+0000 7f574d1ea780 1 < completed multipart upload key=RNI86YYLADT0 upload=034YU0W9AWM4 tag=7ELEILCZ0B18 type=write size=1890296 2024-09-12T17:18:11.884 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.883+0000 7f574d1ea780 1 > prepared part key=_multipart_ZGH8XC39FGTC.2~96Z7D0MUXQVL.0 size=855988 2024-09-12T17:18:11.884 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.883+0000 7f574d1ea780 1 > prepared multipart upload key=ZGH8XC39FGTC upload=96Z7D0MUXQVL tag=3KJ2T193QGNM type=write size=1904564 2024-09-12T17:18:11.885 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.884+0000 7f574d1ea780 1 < completed part key=_multipart_55V137SY4E4P.2~GQYL4M6OA9YJ.0 size=1048576 2024-09-12T17:18:11.886 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.885+0000 7f574d1ea780 1 < completed part key=_multipart_55V137SY4E4P.2~GQYL4M6OA9YJ.1 size=1048576 2024-09-12T17:18:11.887 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.886+0000 7f574d1ea780 1 < completed part key=_multipart_55V137SY4E4P.2~GQYL4M6OA9YJ.2 size=796843 2024-09-12T17:18:11.889 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.888+0000 7f574d1ea780 1 < completed multipart upload key=55V137SY4E4P upload=GQYL4M6OA9YJ tag=9NV2LS4ZCAVL type=write size=3942571 2024-09-12T17:18:11.890 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.890+0000 7f574d1ea780 1 > prepared operation key=DH02JGZP64MN tag=WVQHVMOZ6X6R type=del size=3908126 2024-09-12T17:18:11.892 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.891+0000 7f574d1ea780 1 < completed part key=_multipart_DH02JGZP64MN.2~43NHIOPY3TI1.0 size=461079 2024-09-12T17:18:11.894 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.893+0000 7f574d1ea780 1 < completed multipart upload key=DH02JGZP64MN upload=43NHIOPY3TI1 tag=K015STB3VE63 type=write size=1509655 2024-09-12T17:18:11.895 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.894+0000 7f574d1ea780 1 > prepared operation key=HFWA7DNUMWF2 tag=JMYJU5RJVFKM type=del size=361083 2024-09-12T17:18:11.896 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.895+0000 7f574d1ea780 1 < canceled operation key=UTCKL1F42X8A tag=Z7J134FFL5WD type=write size=1011031 2024-09-12T17:18:11.898 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.898+0000 7f574d1ea780 1 > prepared part key=_multipart_54LQ91UMBJAN.2~89QOHYUEETIS.0 size=1048576 2024-09-12T17:18:11.900 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.899+0000 7f574d1ea780 1 > prepared part key=_multipart_54LQ91UMBJAN.2~89QOHYUEETIS.1 size=222763 2024-09-12T17:18:11.900 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.899+0000 7f574d1ea780 1 > prepared multipart upload key=54LQ91UMBJAN upload=89QOHYUEETIS tag=8QJGIMFVBX2B type=write size=2319915 2024-09-12T17:18:11.901 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.900+0000 7f574d1ea780 1 < completed part key=_multipart_DH02JGZP64MN.2~B1N0X499M101.0 size=194960 2024-09-12T17:18:11.903 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.902+0000 7f574d1ea780 1 < completed multipart upload key=DH02JGZP64MN upload=B1N0X499M101 tag=CWUOZBPJRP0C type=write size=1243536 2024-09-12T17:18:11.905 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.904+0000 7f574d1ea780 1 > prepared part key=_multipart_DH02JGZP64MN.2~4ZKEYG4LFH2F.0 size=831966 2024-09-12T17:18:11.905 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.904+0000 7f574d1ea780 1 > prepared multipart upload key=DH02JGZP64MN upload=4ZKEYG4LFH2F tag=9UJ5HSORGYIK type=write size=1880542 2024-09-12T17:18:11.906 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.905+0000 7f574d1ea780 1 < completed delete operation key=Q2Q3B1J3DAVD tag=UTXM4EU7YD1H type=del 2024-09-12T17:18:11.909 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.908+0000 7f574d1ea780 1 > prepared part key=_multipart_C9IYR9CET1I8.2~LU5V2PCMEPEB.0 size=1048576 2024-09-12T17:18:11.910 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.909+0000 7f574d1ea780 1 > prepared part key=_multipart_C9IYR9CET1I8.2~LU5V2PCMEPEB.1 size=1048576 2024-09-12T17:18:11.911 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.910+0000 7f574d1ea780 1 > prepared part key=_multipart_C9IYR9CET1I8.2~LU5V2PCMEPEB.2 size=244105 2024-09-12T17:18:11.911 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.910+0000 7f574d1ea780 1 > prepared multipart upload key=C9IYR9CET1I8 upload=LU5V2PCMEPEB tag=W2TP33XPX21E type=write size=3389833 2024-09-12T17:18:11.912 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.911+0000 7f574d1ea780 1 < completed part key=_multipart_HFWA7DNUMWF2.2~FIYSXRABMT8X.0 size=1048576 2024-09-12T17:18:11.912 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.911+0000 7f574d1ea780 1 < canceled part key=_multipart_HFWA7DNUMWF2.2~FIYSXRABMT8X.1 size=1048576 2024-09-12T17:18:11.913 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.912+0000 7f574d1ea780 1 < completed part key=_multipart_HFWA7DNUMWF2.2~FIYSXRABMT8X.2 size=64612 2024-09-12T17:18:11.915 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.914+0000 7f574d1ea780 1 < canceled multipart upload key=HFWA7DNUMWF2 upload=FIYSXRABMT8X tag=N41Q63N080YT type=write size=3210340 2024-09-12T17:18:11.916 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.915+0000 7f574d1ea780 1 > prepared operation key=43GV2N9VBBKE tag=21AHPHYK9N27 type=del size=2988157 2024-09-12T17:18:11.917 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.917+0000 7f574d1ea780 1 < completed delete operation key=RNI86YYLADT0 tag=RFIRPHUB93XR type=del 2024-09-12T17:18:11.920 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.919+0000 7f574d1ea780 1 > prepared part key=_multipart_7BX38Q7723EB.2~8AKCI28BKPBE.0 size=1048576 2024-09-12T17:18:11.921 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.920+0000 7f574d1ea780 1 > prepared part key=_multipart_7BX38Q7723EB.2~8AKCI28BKPBE.1 size=1048576 2024-09-12T17:18:11.922 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.921+0000 7f574d1ea780 1 > prepared part key=_multipart_7BX38Q7723EB.2~8AKCI28BKPBE.2 size=50262 2024-09-12T17:18:11.922 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.921+0000 7f574d1ea780 1 > prepared multipart upload key=7BX38Q7723EB upload=8AKCI28BKPBE tag=04RG0ZM8RPK0 type=write size=3195990 2024-09-12T17:18:11.923 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.922+0000 7f574d1ea780 1 < completed delete operation key=UFKM4I8RMT0W tag=ZCFOU56PCRRG type=del 2024-09-12T17:18:11.924 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.923+0000 7f574d1ea780 1 > prepared operation key=54CM8800AT9V tag=G7S8BEW3CKP3 type=del size=2141916 2024-09-12T17:18:11.926 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.925+0000 7f574d1ea780 1 < completed part key=_multipart_8SG7DJO4HWPI.2~WMZ46QXLJH65.0 size=409513 2024-09-12T17:18:11.928 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.927+0000 7f574d1ea780 1 < completed multipart upload key=8SG7DJO4HWPI upload=WMZ46QXLJH65 tag=XNZ30WR58JUY type=write size=1458089 2024-09-12T17:18:11.930 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.929+0000 7f574d1ea780 1 > prepared part key=_multipart_HGZMN894YYC0.2~REBQ00YEWXL2.0 size=1048576 2024-09-12T17:18:11.931 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.930+0000 7f574d1ea780 1 > prepared part key=_multipart_HGZMN894YYC0.2~REBQ00YEWXL2.1 size=866349 2024-09-12T17:18:11.931 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.930+0000 7f574d1ea780 1 > prepared multipart upload key=HGZMN894YYC0 upload=REBQ00YEWXL2 tag=WDHFH10I8VBO type=write size=2963501 2024-09-12T17:18:11.932 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.932+0000 7f574d1ea780 1 < completed write operation key=54LQ91UMBJAN tag=2ZDABE08RNSM type=write size=931182 2024-09-12T17:18:11.934 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.933+0000 7f574d1ea780 1 > prepared operation key=ZGE1860DMGHA tag=DE1G343BAJE9 type=del size=3644574 2024-09-12T17:18:11.935 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.934+0000 7f574d1ea780 1 < completed delete operation key=U6E9A5OH4GUW tag=O6DWEZ7O5YQ9 type=del 2024-09-12T17:18:11.937 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.936+0000 7f574d1ea780 1 > prepared part key=_multipart_YXIDO0U18839.2~6ZECWQZ6LJ7Z.0 size=1048576 2024-09-12T17:18:11.938 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.937+0000 7f574d1ea780 1 > prepared part key=_multipart_YXIDO0U18839.2~6ZECWQZ6LJ7Z.1 size=1048576 2024-09-12T17:18:11.939 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.938+0000 7f574d1ea780 1 > prepared part key=_multipart_YXIDO0U18839.2~6ZECWQZ6LJ7Z.2 size=602318 2024-09-12T17:18:11.939 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.938+0000 7f574d1ea780 1 > prepared multipart upload key=YXIDO0U18839 upload=6ZECWQZ6LJ7Z tag=X41OALGH5UGL type=write size=3748046 2024-09-12T17:18:11.940 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.940+0000 7f574d1ea780 1 < completed delete operation key=UFKM4I8RMT0W tag=Z76DXIU25PYP type=del 2024-09-12T17:18:11.943 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.942+0000 7f574d1ea780 1 > prepared part key=_multipart_OI51GO639LFK.2~0GGDLDMISGAI.0 size=1048576 2024-09-12T17:18:11.944 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.943+0000 7f574d1ea780 1 > prepared part key=_multipart_OI51GO639LFK.2~0GGDLDMISGAI.1 size=1048576 2024-09-12T17:18:11.945 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.944+0000 7f574d1ea780 1 > prepared part key=_multipart_OI51GO639LFK.2~0GGDLDMISGAI.2 size=195737 2024-09-12T17:18:11.945 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.944+0000 7f574d1ea780 1 > prepared multipart upload key=OI51GO639LFK upload=0GGDLDMISGAI tag=XC75CA0BJ48M type=write size=3341465 2024-09-12T17:18:11.946 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.945+0000 7f574d1ea780 1 < completed delete operation key=YXIDO0U18839 tag=PGWDCHLWBEYN type=del 2024-09-12T17:18:11.947 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.946+0000 7f574d1ea780 1 > prepared operation key=DH02JGZP64MN tag=P5WFGOUKAVHC type=del size=3511313 2024-09-12T17:18:11.948 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.948+0000 7f574d1ea780 1 < completed delete operation key=8SG7DJO4HWPI tag=UCCI5DC02ACZ type=del 2024-09-12T17:18:11.950 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.949+0000 7f574d1ea780 1 > prepared operation key=OI51GO639LFK tag=TGCQ8L4GJXTU type=del size=3650621 2024-09-12T17:18:11.951 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.950+0000 7f574d1ea780 1 < completed delete operation key=7BX38Q7723EB tag=OPLBREYE79UO type=del 2024-09-12T17:18:11.952 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.951+0000 7f574d1ea780 1 > prepared operation key=43GV2N9VBBKE tag=JR0AA0AW1JUS type=write size=829268 2024-09-12T17:18:11.953 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.953+0000 7f574d1ea780 1 < completed part key=_multipart_ZGH8XC39FGTC.2~96Z7D0MUXQVL.0 size=855988 2024-09-12T17:18:11.956 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.955+0000 7f574d1ea780 1 < completed multipart upload key=ZGH8XC39FGTC upload=96Z7D0MUXQVL tag=3KJ2T193QGNM type=write size=1904564 2024-09-12T17:18:11.958 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.957+0000 7f574d1ea780 1 > prepared operation key=54CM8800AT9V tag=CGUSZZ2JV1KO type=del size=449978 2024-09-12T17:18:11.960 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.959+0000 7f574d1ea780 1 < completed delete operation key=DH02JGZP64MN tag=WVQHVMOZ6X6R type=del 2024-09-12T17:18:11.961 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.960+0000 7f574d1ea780 1 > prepared operation key=RNI86YYLADT0 tag=GKEB62VAUA2N type=del size=910643 2024-09-12T17:18:11.962 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.962+0000 7f574d1ea780 1 < completed delete operation key=HFWA7DNUMWF2 tag=JMYJU5RJVFKM type=del 2024-09-12T17:18:11.964 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.964+0000 7f574d1ea780 1 > prepared part key=_multipart_ZGE1860DMGHA.2~PMPZJJJBACS4.0 size=184208 2024-09-12T17:18:11.965 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.964+0000 7f574d1ea780 1 > prepared multipart upload key=ZGE1860DMGHA upload=PMPZJJJBACS4 tag=TN5CNSSKTZYG type=write size=1232784 2024-09-12T17:18:11.966 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.965+0000 7f574d1ea780 1 < completed part key=_multipart_54LQ91UMBJAN.2~89QOHYUEETIS.0 size=1048576 2024-09-12T17:18:11.967 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.966+0000 7f574d1ea780 1 < completed part key=_multipart_54LQ91UMBJAN.2~89QOHYUEETIS.1 size=222763 2024-09-12T17:18:11.969 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.968+0000 7f574d1ea780 1 < completed multipart upload key=54LQ91UMBJAN upload=89QOHYUEETIS tag=8QJGIMFVBX2B type=write size=2319915 2024-09-12T17:18:11.970 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.969+0000 7f574d1ea780 1 > prepared operation key=43GV2N9VBBKE tag=YDHT1H04RIAR type=del size=1640764 2024-09-12T17:18:11.971 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.971+0000 7f574d1ea780 1 < completed part key=_multipart_DH02JGZP64MN.2~4ZKEYG4LFH2F.0 size=831966 2024-09-12T17:18:11.975 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.974+0000 7f574d1ea780 1 < completed multipart upload key=DH02JGZP64MN upload=4ZKEYG4LFH2F tag=9UJ5HSORGYIK type=write size=1880542 2024-09-12T17:18:11.977 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.976+0000 7f574d1ea780 1 > prepared part key=_multipart_HFWA7DNUMWF2.2~7XG3V6MXTLA0.0 size=1048576 2024-09-12T17:18:11.978 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.977+0000 7f574d1ea780 1 > prepared part key=_multipart_HFWA7DNUMWF2.2~7XG3V6MXTLA0.1 size=668094 2024-09-12T17:18:11.978 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.977+0000 7f574d1ea780 1 > prepared multipart upload key=HFWA7DNUMWF2 upload=7XG3V6MXTLA0 tag=5D2NA617D4PY type=write size=2765246 2024-09-12T17:18:11.979 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.978+0000 7f574d1ea780 1 < completed part key=_multipart_C9IYR9CET1I8.2~LU5V2PCMEPEB.0 size=1048576 2024-09-12T17:18:11.980 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.979+0000 7f574d1ea780 1 < completed part key=_multipart_C9IYR9CET1I8.2~LU5V2PCMEPEB.1 size=1048576 2024-09-12T17:18:11.981 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.980+0000 7f574d1ea780 1 < completed part key=_multipart_C9IYR9CET1I8.2~LU5V2PCMEPEB.2 size=244105 2024-09-12T17:18:11.983 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.982+0000 7f574d1ea780 1 < completed multipart upload key=C9IYR9CET1I8 upload=LU5V2PCMEPEB tag=W2TP33XPX21E type=write size=3389833 2024-09-12T17:18:11.984 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.983+0000 7f574d1ea780 1 > prepared operation key=D1GEG3MKPOM3 tag=MIUFJ68MBNB8 type=del size=2335588 2024-09-12T17:18:11.985 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.985+0000 7f574d1ea780 1 < completed delete operation key=43GV2N9VBBKE tag=21AHPHYK9N27 type=del 2024-09-12T17:18:11.987 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.986+0000 7f574d1ea780 1 > prepared operation key=RWVWJHVZE95H tag=Z760USE01NU3 type=del size=95770 2024-09-12T17:18:11.987 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.986+0000 7f574d1ea780 1 < canceled part key=_multipart_7BX38Q7723EB.2~8AKCI28BKPBE.0 size=1048576 2024-09-12T17:18:11.988 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.987+0000 7f574d1ea780 1 < completed part key=_multipart_7BX38Q7723EB.2~8AKCI28BKPBE.1 size=1048576 2024-09-12T17:18:11.989 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.988+0000 7f574d1ea780 1 < completed part key=_multipart_7BX38Q7723EB.2~8AKCI28BKPBE.2 size=50262 2024-09-12T17:18:11.991 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.990+0000 7f574d1ea780 1 < canceled multipart upload key=7BX38Q7723EB upload=8AKCI28BKPBE tag=04RG0ZM8RPK0 type=write size=3195990 2024-09-12T17:18:11.992 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.991+0000 7f574d1ea780 1 > prepared operation key=D1GEG3MKPOM3 tag=NTA1PVT4TV5Q type=del size=2647904 2024-09-12T17:18:11.994 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.993+0000 7f574d1ea780 1 < completed delete operation key=54CM8800AT9V tag=G7S8BEW3CKP3 type=del 2024-09-12T17:18:11.995 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.994+0000 7f574d1ea780 1 > prepared operation key=54CM8800AT9V tag=J9I8IO0F7ZG4 type=del size=1776575 2024-09-12T17:18:11.995 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.994+0000 7f574d1ea780 1 < canceled part key=_multipart_HGZMN894YYC0.2~REBQ00YEWXL2.0 size=1048576 2024-09-12T17:18:11.996 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.995+0000 7f574d1ea780 1 < completed part key=_multipart_HGZMN894YYC0.2~REBQ00YEWXL2.1 size=866349 2024-09-12T17:18:11.998 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.998+0000 7f574d1ea780 1 < canceled multipart upload key=HGZMN894YYC0 upload=REBQ00YEWXL2 tag=WDHFH10I8VBO type=write size=2963501 2024-09-12T17:18:12.000 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:11.999+0000 7f574d1ea780 1 > prepared operation key=RNI86YYLADT0 tag=NMTB2KK0ID6E type=del size=2775625 2024-09-12T17:18:12.001 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.000+0000 7f574d1ea780 1 < completed delete operation key=ZGE1860DMGHA tag=DE1G343BAJE9 type=del 2024-09-12T17:18:12.003 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.002+0000 7f574d1ea780 1 > prepared part key=_multipart_YXIDO0U18839.2~M78SM2PK36N1.0 size=718653 2024-09-12T17:18:12.003 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.002+0000 7f574d1ea780 1 > prepared multipart upload key=YXIDO0U18839 upload=M78SM2PK36N1 tag=EMLD40L0QJYA type=write size=1767229 2024-09-12T17:18:12.004 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.003+0000 7f574d1ea780 1 < completed part key=_multipart_YXIDO0U18839.2~6ZECWQZ6LJ7Z.0 size=1048576 2024-09-12T17:18:12.005 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.004+0000 7f574d1ea780 1 < completed part key=_multipart_YXIDO0U18839.2~6ZECWQZ6LJ7Z.1 size=1048576 2024-09-12T17:18:12.006 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.005+0000 7f574d1ea780 1 < completed part key=_multipart_YXIDO0U18839.2~6ZECWQZ6LJ7Z.2 size=602318 2024-09-12T17:18:12.008 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.007+0000 7f574d1ea780 1 < completed multipart upload key=YXIDO0U18839 upload=6ZECWQZ6LJ7Z tag=X41OALGH5UGL type=write size=3748046 2024-09-12T17:18:12.010 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.009+0000 7f574d1ea780 1 > prepared operation key=DH02JGZP64MN tag=995EXFT1Y7EJ type=del size=3173498 2024-09-12T17:18:12.011 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.010+0000 7f574d1ea780 1 < completed part key=_multipart_OI51GO639LFK.2~0GGDLDMISGAI.0 size=1048576 2024-09-12T17:18:12.012 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.011+0000 7f574d1ea780 1 < completed part key=_multipart_OI51GO639LFK.2~0GGDLDMISGAI.1 size=1048576 2024-09-12T17:18:12.013 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.012+0000 7f574d1ea780 1 < completed part key=_multipart_OI51GO639LFK.2~0GGDLDMISGAI.2 size=195737 2024-09-12T17:18:12.015 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.014+0000 7f574d1ea780 1 < completed multipart upload key=OI51GO639LFK upload=0GGDLDMISGAI tag=XC75CA0BJ48M type=write size=3341465 2024-09-12T17:18:12.017 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.016+0000 7f574d1ea780 1 > prepared part key=_multipart_7BX38Q7723EB.2~QA196OMD9G12.0 size=75673 2024-09-12T17:18:12.017 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.016+0000 7f574d1ea780 1 > prepared multipart upload key=7BX38Q7723EB upload=QA196OMD9G12 tag=WBV28DWNJNZ1 type=write size=1124249 2024-09-12T17:18:12.020 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.019+0000 7f574d1ea780 1 < suggested update operation key=DH02JGZP64MN tag=P5WFGOUKAVHC type=del size=3511313 2024-09-12T17:18:12.021 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.020+0000 7f574d1ea780 1 > prepared operation key=HFWA7DNUMWF2 tag=5IGB4ZO3QN4N type=del size=4105225 2024-09-12T17:18:12.022 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.021+0000 7f574d1ea780 1 < completed delete operation key=OI51GO639LFK tag=TGCQ8L4GJXTU type=del 2024-09-12T17:18:12.025 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.024+0000 7f574d1ea780 1 > prepared part key=_multipart_55JI541K1WP2.2~I0YG4QUT27CM.0 size=1048576 2024-09-12T17:18:12.025 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.025+0000 7f574d1ea780 1 > prepared part key=_multipart_55JI541K1WP2.2~I0YG4QUT27CM.1 size=97247 2024-09-12T17:18:12.026 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.025+0000 7f574d1ea780 1 > prepared multipart upload key=55JI541K1WP2 upload=I0YG4QUT27CM tag=IMJKD81BMNJV type=write size=2194399 2024-09-12T17:18:12.027 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.026+0000 7f574d1ea780 1 < canceled operation key=43GV2N9VBBKE tag=JR0AA0AW1JUS type=write size=829268 2024-09-12T17:18:12.029 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.028+0000 7f574d1ea780 1 > prepared part key=_multipart_SQQMJ61CA0QW.2~GUIKZ2TQR261.0 size=362023 2024-09-12T17:18:12.029 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.028+0000 7f574d1ea780 1 > prepared multipart upload key=SQQMJ61CA0QW upload=GUIKZ2TQR261 tag=SS90FNY3L6IY type=write size=1410599 2024-09-12T17:18:12.030 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.029+0000 7f574d1ea780 1 < completed delete operation key=54CM8800AT9V tag=CGUSZZ2JV1KO type=del 2024-09-12T17:18:12.031 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.031+0000 7f574d1ea780 1 > prepared operation key=VWWA5IB0L4N1 tag=KRPFO2HJOR0L type=del size=1400841 2024-09-12T17:18:12.033 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.032+0000 7f574d1ea780 1 < completed delete operation key=RNI86YYLADT0 tag=GKEB62VAUA2N type=del 2024-09-12T17:18:12.034 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.033+0000 7f574d1ea780 1 > prepared operation key=K12MVG618809 tag=C4JO54GU8J7W type=del size=3762695 2024-09-12T17:18:12.035 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.033+0000 7f574d1ea780 1 < canceled part key=_multipart_ZGE1860DMGHA.2~PMPZJJJBACS4.0 size=184208 2024-09-12T17:18:12.036 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.035+0000 7f574d1ea780 1 < canceled multipart upload key=ZGE1860DMGHA upload=PMPZJJJBACS4 tag=TN5CNSSKTZYG type=write size=1232784 2024-09-12T17:18:12.038 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.038+0000 7f574d1ea780 1 > prepared part key=_multipart_RNI86YYLADT0.2~BBNX4Z0HETGG.0 size=1048576 2024-09-12T17:18:12.039 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.039+0000 7f574d1ea780 1 > prepared part key=_multipart_RNI86YYLADT0.2~BBNX4Z0HETGG.1 size=1048576 2024-09-12T17:18:12.040 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.040+0000 7f574d1ea780 1 > prepared part key=_multipart_RNI86YYLADT0.2~BBNX4Z0HETGG.2 size=825901 2024-09-12T17:18:12.041 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.040+0000 7f574d1ea780 1 > prepared multipart upload key=RNI86YYLADT0 upload=BBNX4Z0HETGG tag=1LUE7JOJJALN type=write size=3971629 2024-09-12T17:18:12.042 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.041+0000 7f574d1ea780 1 < completed delete operation key=43GV2N9VBBKE tag=YDHT1H04RIAR type=del 2024-09-12T17:18:12.043 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.042+0000 7f574d1ea780 1 > prepared operation key=K12MVG618809 tag=1KZZOW52CXGY type=write size=169390 2024-09-12T17:18:12.044 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.043+0000 7f574d1ea780 1 < completed part key=_multipart_HFWA7DNUMWF2.2~7XG3V6MXTLA0.0 size=1048576 2024-09-12T17:18:12.045 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.044+0000 7f574d1ea780 1 < completed part key=_multipart_HFWA7DNUMWF2.2~7XG3V6MXTLA0.1 size=668094 2024-09-12T17:18:12.047 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.046+0000 7f574d1ea780 1 < completed multipart upload key=HFWA7DNUMWF2 upload=7XG3V6MXTLA0 tag=5D2NA617D4PY type=write size=2765246 2024-09-12T17:18:12.049 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.048+0000 7f574d1ea780 1 > prepared part key=_multipart_D1GEG3MKPOM3.2~3NI1P3MQWDTH.0 size=117546 2024-09-12T17:18:12.049 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.048+0000 7f574d1ea780 1 > prepared multipart upload key=D1GEG3MKPOM3 upload=3NI1P3MQWDTH tag=Z5GGXQNLXKZV type=write size=1166122 2024-09-12T17:18:12.050 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.050+0000 7f574d1ea780 1 < completed delete operation key=D1GEG3MKPOM3 tag=MIUFJ68MBNB8 type=del 2024-09-12T17:18:12.053 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.052+0000 7f574d1ea780 1 > prepared part key=_multipart_OI51GO639LFK.2~WJ91W27CHT22.0 size=720309 2024-09-12T17:18:12.053 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.052+0000 7f574d1ea780 1 > prepared multipart upload key=OI51GO639LFK upload=WJ91W27CHT22 tag=TFFXAU0YD546 type=write size=1768885 2024-09-12T17:18:12.055 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.054+0000 7f574d1ea780 1 < suggested remove operation key=RWVWJHVZE95H tag=Z760USE01NU3 type=del 2024-09-12T17:18:12.056 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.056+0000 7f574d1ea780 1 > prepared operation key=43GV2N9VBBKE tag=ZWEL52SE1JRW type=write size=303151 2024-09-12T17:18:12.058 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.057+0000 7f574d1ea780 1 < completed delete operation key=D1GEG3MKPOM3 tag=NTA1PVT4TV5Q type=del 2024-09-12T17:18:12.060 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.059+0000 7f574d1ea780 1 > prepared part key=_multipart_UFKM4I8RMT0W.2~R1F8J6IVOVJ7.0 size=1048576 2024-09-12T17:18:12.061 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.060+0000 7f574d1ea780 1 > prepared part key=_multipart_UFKM4I8RMT0W.2~R1F8J6IVOVJ7.1 size=890716 2024-09-12T17:18:12.061 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.060+0000 7f574d1ea780 1 > prepared multipart upload key=UFKM4I8RMT0W upload=R1F8J6IVOVJ7 tag=Y9NULIHQJDU7 type=write size=2987868 2024-09-12T17:18:12.062 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.061+0000 7f574d1ea780 1 < completed delete operation key=54CM8800AT9V tag=J9I8IO0F7ZG4 type=del 2024-09-12T17:18:12.063 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.062+0000 7f574d1ea780 1 > prepared operation key=SQQMJ61CA0QW tag=6H58YTS6XBUU type=write size=1014988 2024-09-12T17:18:12.066 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.065+0000 7f574d1ea780 1 < suggested remove operation key=RNI86YYLADT0 tag=NMTB2KK0ID6E type=del 2024-09-12T17:18:12.067 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.066+0000 7f574d1ea780 1 > prepared operation key=UTCKL1F42X8A tag=MN2B98GGT86F type=del size=2990188 2024-09-12T17:18:12.068 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.067+0000 7f574d1ea780 1 < completed part key=_multipart_YXIDO0U18839.2~M78SM2PK36N1.0 size=718653 2024-09-12T17:18:12.070 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.069+0000 7f574d1ea780 1 < completed multipart upload key=YXIDO0U18839 upload=M78SM2PK36N1 tag=EMLD40L0QJYA type=write size=1767229 2024-09-12T17:18:12.072 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.071+0000 7f574d1ea780 1 > prepared part key=_multipart_ENFNIFHQ3SHW.2~QIXV9TJLNKN3.0 size=69987 2024-09-12T17:18:12.072 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.071+0000 7f574d1ea780 1 > prepared multipart upload key=ENFNIFHQ3SHW upload=QIXV9TJLNKN3 tag=1EUK210V744X type=write size=1118563 2024-09-12T17:18:12.073 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.073+0000 7f574d1ea780 -1 < failed to complete operation key=DH02JGZP64MN tag=995EXFT1Y7EJ type=del size=3173498: (22) Invalid argument 2024-09-12T17:18:12.075 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.074+0000 7f574d1ea780 1 > prepared operation key=SQQMJ61CA0QW tag=YAO50OLW3EOE type=write size=956891 2024-09-12T17:18:12.076 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.075+0000 7f574d1ea780 1 < completed part key=_multipart_7BX38Q7723EB.2~QA196OMD9G12.0 size=75673 2024-09-12T17:18:12.078 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.077+0000 7f574d1ea780 1 < completed multipart upload key=7BX38Q7723EB upload=QA196OMD9G12 tag=WBV28DWNJNZ1 type=write size=1124249 2024-09-12T17:18:12.079 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.078+0000 7f574d1ea780 1 > prepared operation key=D1GEG3MKPOM3 tag=CSAHKQETIX2F type=del size=4086244 2024-09-12T17:18:12.080 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.079+0000 7f574d1ea780 1 < canceled operation key=HFWA7DNUMWF2 tag=5IGB4ZO3QN4N type=del size=4105225 2024-09-12T17:18:12.082 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.081+0000 7f574d1ea780 1 > prepared part key=_multipart_HGZMN894YYC0.2~APY8PHX7PXR5.0 size=865226 2024-09-12T17:18:12.082 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.081+0000 7f574d1ea780 1 > prepared multipart upload key=HGZMN894YYC0 upload=APY8PHX7PXR5 tag=9D03ASTNEOP2 type=write size=1913802 2024-09-12T17:18:12.083 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.083+0000 7f574d1ea780 1 < completed part key=_multipart_55JI541K1WP2.2~I0YG4QUT27CM.0 size=1048576 2024-09-12T17:18:12.084 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.084+0000 7f574d1ea780 1 < completed part key=_multipart_55JI541K1WP2.2~I0YG4QUT27CM.1 size=97247 2024-09-12T17:18:12.087 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.087+0000 7f574d1ea780 1 < completed multipart upload key=55JI541K1WP2 upload=I0YG4QUT27CM tag=IMJKD81BMNJV type=write size=2194399 2024-09-12T17:18:12.089 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.088+0000 7f574d1ea780 1 > prepared operation key=RWVWJHVZE95H tag=D4WDVZT8K6DK type=del size=3025179 2024-09-12T17:18:12.090 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.089+0000 7f574d1ea780 1 < completed part key=_multipart_SQQMJ61CA0QW.2~GUIKZ2TQR261.0 size=362023 2024-09-12T17:18:12.092 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.091+0000 7f574d1ea780 1 < completed multipart upload key=SQQMJ61CA0QW upload=GUIKZ2TQR261 tag=SS90FNY3L6IY type=write size=1410599 2024-09-12T17:18:12.093 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.092+0000 7f574d1ea780 1 > prepared operation key=8SG7DJO4HWPI tag=FWQJG9NPC0D9 type=del size=3770779 2024-09-12T17:18:12.094 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.093+0000 7f574d1ea780 1 < completed delete operation key=VWWA5IB0L4N1 tag=KRPFO2HJOR0L type=del 2024-09-12T17:18:12.095 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.095+0000 7f574d1ea780 1 > prepared operation key=RNI86YYLADT0 tag=18WNNKYD8FJP type=del size=157148 2024-09-12T17:18:12.097 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.096+0000 7f574d1ea780 1 < completed delete operation key=K12MVG618809 tag=C4JO54GU8J7W type=del 2024-09-12T17:18:12.098 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.097+0000 7f574d1ea780 1 > prepared operation key=HGZMN894YYC0 tag=PMJC8PMDKQKV type=write size=981378 2024-09-12T17:18:12.099 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.098+0000 7f574d1ea780 1 < completed part key=_multipart_RNI86YYLADT0.2~BBNX4Z0HETGG.0 size=1048576 2024-09-12T17:18:12.100 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.099+0000 7f574d1ea780 1 < completed part key=_multipart_RNI86YYLADT0.2~BBNX4Z0HETGG.1 size=1048576 2024-09-12T17:18:12.101 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.100+0000 7f574d1ea780 1 < completed part key=_multipart_RNI86YYLADT0.2~BBNX4Z0HETGG.2 size=825901 2024-09-12T17:18:12.103 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.102+0000 7f574d1ea780 1 < completed multipart upload key=RNI86YYLADT0 upload=BBNX4Z0HETGG tag=1LUE7JOJJALN type=write size=3971629 2024-09-12T17:18:12.104 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.104+0000 7f574d1ea780 1 > prepared operation key=HFWA7DNUMWF2 tag=KR1UANG0IGO3 type=del size=3477126 2024-09-12T17:18:12.106 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.105+0000 7f574d1ea780 1 < completed write operation key=K12MVG618809 tag=1KZZOW52CXGY type=write size=169390 2024-09-12T17:18:12.108 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.107+0000 7f574d1ea780 1 > prepared part key=_multipart_ZGH8XC39FGTC.2~BUDJP2F3042R.0 size=1048576 2024-09-12T17:18:12.109 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.108+0000 7f574d1ea780 1 > prepared part key=_multipart_ZGH8XC39FGTC.2~BUDJP2F3042R.1 size=1048576 2024-09-12T17:18:12.110 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.109+0000 7f574d1ea780 1 > prepared part key=_multipart_ZGH8XC39FGTC.2~BUDJP2F3042R.2 size=918110 2024-09-12T17:18:12.110 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.109+0000 7f574d1ea780 1 > prepared multipart upload key=ZGH8XC39FGTC upload=BUDJP2F3042R tag=Z5E2N488TX1Y type=write size=4063838 2024-09-12T17:18:12.111 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.110+0000 7f574d1ea780 1 < completed part key=_multipart_D1GEG3MKPOM3.2~3NI1P3MQWDTH.0 size=117546 2024-09-12T17:18:12.113 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.112+0000 7f574d1ea780 1 < completed multipart upload key=D1GEG3MKPOM3 upload=3NI1P3MQWDTH tag=Z5GGXQNLXKZV type=write size=1166122 2024-09-12T17:18:12.115 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.114+0000 7f574d1ea780 1 > prepared part key=_multipart_TIKBUXFPVTN1.2~XSVVQQ2Z2JCU.0 size=1048576 2024-09-12T17:18:12.116 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.115+0000 7f574d1ea780 1 > prepared part key=_multipart_TIKBUXFPVTN1.2~XSVVQQ2Z2JCU.1 size=1048576 2024-09-12T17:18:12.117 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.116+0000 7f574d1ea780 1 > prepared part key=_multipart_TIKBUXFPVTN1.2~XSVVQQ2Z2JCU.2 size=820918 2024-09-12T17:18:12.117 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.116+0000 7f574d1ea780 1 > prepared multipart upload key=TIKBUXFPVTN1 upload=XSVVQQ2Z2JCU tag=JFKZ92F62LKQ type=write size=3966646 2024-09-12T17:18:12.118 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.117+0000 7f574d1ea780 1 < completed part key=_multipart_OI51GO639LFK.2~WJ91W27CHT22.0 size=720309 2024-09-12T17:18:12.120 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.119+0000 7f574d1ea780 1 < completed multipart upload key=OI51GO639LFK upload=WJ91W27CHT22 tag=TFFXAU0YD546 type=write size=1768885 2024-09-12T17:18:12.121 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.120+0000 7f574d1ea780 1 > prepared operation key=55V137SY4E4P tag=JP1J8DCJMWXW type=del size=1507224 2024-09-12T17:18:12.122 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.122+0000 7f574d1ea780 1 < completed write operation key=43GV2N9VBBKE tag=ZWEL52SE1JRW type=write size=303151 2024-09-12T17:18:12.124 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.123+0000 7f574d1ea780 1 > prepared operation key=ZGE1860DMGHA tag=KH9VMCCIPRL8 type=del size=1568241 2024-09-12T17:18:12.125 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.124+0000 7f574d1ea780 1 < completed part key=_multipart_UFKM4I8RMT0W.2~R1F8J6IVOVJ7.0 size=1048576 2024-09-12T17:18:12.126 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.125+0000 7f574d1ea780 1 < completed part key=_multipart_UFKM4I8RMT0W.2~R1F8J6IVOVJ7.1 size=890716 2024-09-12T17:18:12.128 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.127+0000 7f574d1ea780 1 < completed multipart upload key=UFKM4I8RMT0W upload=R1F8J6IVOVJ7 tag=Y9NULIHQJDU7 type=write size=2987868 2024-09-12T17:18:12.129 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.128+0000 7f574d1ea780 1 > prepared operation key=C9IYR9CET1I8 tag=9JIVRYEFZ8Q6 type=write size=475410 2024-09-12T17:18:12.131 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.131+0000 7f574d1ea780 1 < suggested remove operation key=SQQMJ61CA0QW tag=6H58YTS6XBUU type=write 2024-09-12T17:18:12.134 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.133+0000 7f574d1ea780 1 > prepared part key=_multipart_55JI541K1WP2.2~9HWHPVVMLXP1.0 size=1048576 2024-09-12T17:18:12.135 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.134+0000 7f574d1ea780 1 > prepared part key=_multipart_55JI541K1WP2.2~9HWHPVVMLXP1.1 size=1048576 2024-09-12T17:18:12.136 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.135+0000 7f574d1ea780 1 > prepared part key=_multipart_55JI541K1WP2.2~9HWHPVVMLXP1.2 size=930523 2024-09-12T17:18:12.136 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.135+0000 7f574d1ea780 1 > prepared multipart upload key=55JI541K1WP2 upload=9HWHPVVMLXP1 tag=0B0ZNR97T35M type=write size=4076251 2024-09-12T17:18:12.137 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.136+0000 7f574d1ea780 1 < canceled operation key=UTCKL1F42X8A tag=MN2B98GGT86F type=del size=2990188 2024-09-12T17:18:12.138 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.137+0000 7f574d1ea780 1 > prepared operation key=54LQ91UMBJAN tag=NL9TVJ944SDZ type=del size=1738454 2024-09-12T17:18:12.139 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.138+0000 7f574d1ea780 1 < completed part key=_multipart_ENFNIFHQ3SHW.2~QIXV9TJLNKN3.0 size=69987 2024-09-12T17:18:12.141 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.140+0000 7f574d1ea780 1 < completed multipart upload key=ENFNIFHQ3SHW upload=QIXV9TJLNKN3 tag=1EUK210V744X type=write size=1118563 2024-09-12T17:18:12.142 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.141+0000 7f574d1ea780 1 > prepared operation key=55V137SY4E4P tag=051MZZ1Q0QMI type=del size=1711037 2024-09-12T17:18:12.144 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.143+0000 7f574d1ea780 -1 < failed to complete operation key=SQQMJ61CA0QW tag=YAO50OLW3EOE type=write size=956891: (22) Invalid argument 2024-09-12T17:18:12.145 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.144+0000 7f574d1ea780 1 > prepared operation key=C9IYR9CET1I8 tag=VP3F59PWA1QO type=del size=1098448 2024-09-12T17:18:12.146 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.145+0000 7f574d1ea780 1 < completed delete operation key=D1GEG3MKPOM3 tag=CSAHKQETIX2F type=del 2024-09-12T17:18:12.147 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.146+0000 7f574d1ea780 1 > prepared operation key=YXIDO0U18839 tag=X8Z8ERJOMC0G type=del size=3144934 2024-09-12T17:18:12.148 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.147+0000 7f574d1ea780 1 < completed part key=_multipart_HGZMN894YYC0.2~APY8PHX7PXR5.0 size=865226 2024-09-12T17:18:12.150 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.149+0000 7f574d1ea780 1 < completed multipart upload key=HGZMN894YYC0 upload=APY8PHX7PXR5 tag=9D03ASTNEOP2 type=write size=1913802 2024-09-12T17:18:12.152 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.151+0000 7f574d1ea780 1 > prepared part key=_multipart_HFWA7DNUMWF2.2~6HB6A1LV2X31.0 size=898105 2024-09-12T17:18:12.152 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.151+0000 7f574d1ea780 1 > prepared multipart upload key=HFWA7DNUMWF2 upload=6HB6A1LV2X31 tag=K9A9NV5M9WZY type=write size=1946681 2024-09-12T17:18:12.153 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.153+0000 7f574d1ea780 1 < completed delete operation key=RWVWJHVZE95H tag=D4WDVZT8K6DK type=del 2024-09-12T17:18:12.155 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.154+0000 7f574d1ea780 1 > prepared operation key=U6E9A5OH4GUW tag=L1FD2EANLYE1 type=del size=1258920 2024-09-12T17:18:12.156 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.155+0000 7f574d1ea780 1 < completed delete operation key=8SG7DJO4HWPI tag=FWQJG9NPC0D9 type=del 2024-09-12T17:18:12.158 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.157+0000 7f574d1ea780 1 > prepared operation key=HGZMN894YYC0 tag=91X5H34WHRUD type=del size=2208811 2024-09-12T17:18:12.159 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.158+0000 7f574d1ea780 1 < completed delete operation key=RNI86YYLADT0 tag=18WNNKYD8FJP type=del 2024-09-12T17:18:12.160 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.159+0000 7f574d1ea780 1 > prepared operation key=ENFNIFHQ3SHW tag=QCZHAZII6J7T type=del size=2811405 2024-09-12T17:18:12.161 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.161+0000 7f574d1ea780 1 < completed write operation key=HGZMN894YYC0 tag=PMJC8PMDKQKV type=write size=981378 2024-09-12T17:18:12.163 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.162+0000 7f574d1ea780 1 > prepared operation key=55V137SY4E4P tag=CCD7JONVWXVP type=del size=3863498 2024-09-12T17:18:12.165 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.165+0000 7f574d1ea780 1 < suggested update operation key=HFWA7DNUMWF2 tag=KR1UANG0IGO3 type=del size=3477126 2024-09-12T17:18:12.167 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.166+0000 7f574d1ea780 1 > prepared operation key=RNI86YYLADT0 tag=Z3WM5GYEE73R type=write size=225386 2024-09-12T17:18:12.168 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.167+0000 7f574d1ea780 1 < completed part key=_multipart_ZGH8XC39FGTC.2~BUDJP2F3042R.0 size=1048576 2024-09-12T17:18:12.169 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.168+0000 7f574d1ea780 1 < completed part key=_multipart_ZGH8XC39FGTC.2~BUDJP2F3042R.1 size=1048576 2024-09-12T17:18:12.170 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.169+0000 7f574d1ea780 1 < completed part key=_multipart_ZGH8XC39FGTC.2~BUDJP2F3042R.2 size=918110 2024-09-12T17:18:12.172 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.171+0000 7f574d1ea780 1 < completed multipart upload key=ZGH8XC39FGTC upload=BUDJP2F3042R tag=Z5E2N488TX1Y type=write size=4063838 2024-09-12T17:18:12.175 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.174+0000 7f574d1ea780 1 > prepared part key=_multipart_OI51GO639LFK.2~908SR42HPH37.0 size=587076 2024-09-12T17:18:12.175 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.174+0000 7f574d1ea780 1 > prepared multipart upload key=OI51GO639LFK upload=908SR42HPH37 tag=PQID9XSQAV2H type=write size=1635652 2024-09-12T17:18:12.176 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.175+0000 7f574d1ea780 1 < completed part key=_multipart_TIKBUXFPVTN1.2~XSVVQQ2Z2JCU.0 size=1048576 2024-09-12T17:18:12.177 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.176+0000 7f574d1ea780 1 < completed part key=_multipart_TIKBUXFPVTN1.2~XSVVQQ2Z2JCU.1 size=1048576 2024-09-12T17:18:12.178 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.177+0000 7f574d1ea780 1 < completed part key=_multipart_TIKBUXFPVTN1.2~XSVVQQ2Z2JCU.2 size=820918 2024-09-12T17:18:12.181 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.180+0000 7f574d1ea780 1 < completed multipart upload key=TIKBUXFPVTN1 upload=XSVVQQ2Z2JCU tag=JFKZ92F62LKQ type=write size=3966646 2024-09-12T17:18:12.182 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.181+0000 7f574d1ea780 1 > prepared operation key=VWWA5IB0L4N1 tag=A434K0S4BXW1 type=del size=2022454 2024-09-12T17:18:12.183 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.182+0000 7f574d1ea780 1 < completed delete operation key=55V137SY4E4P tag=JP1J8DCJMWXW type=del 2024-09-12T17:18:12.185 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.184+0000 7f574d1ea780 1 > prepared operation key=54CM8800AT9V tag=RKRBUNPO53WO type=del size=3798390 2024-09-12T17:18:12.186 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.185+0000 7f574d1ea780 1 < completed delete operation key=ZGE1860DMGHA tag=KH9VMCCIPRL8 type=del 2024-09-12T17:18:12.187 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.187+0000 7f574d1ea780 1 > prepared operation key=55V137SY4E4P tag=YT3JL0Y0XO4W type=del size=909246 2024-09-12T17:18:12.189 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.188+0000 7f574d1ea780 1 < completed write operation key=C9IYR9CET1I8 tag=9JIVRYEFZ8Q6 type=write size=475410 2024-09-12T17:18:12.190 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.190+0000 7f574d1ea780 1 > prepared operation key=HGZMN894YYC0 tag=YN7GW2EUQ537 type=del size=1523229 2024-09-12T17:18:12.192 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.191+0000 7f574d1ea780 1 < completed part key=_multipart_55JI541K1WP2.2~9HWHPVVMLXP1.0 size=1048576 2024-09-12T17:18:12.193 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.192+0000 7f574d1ea780 1 < completed part key=_multipart_55JI541K1WP2.2~9HWHPVVMLXP1.1 size=1048576 2024-09-12T17:18:12.194 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.193+0000 7f574d1ea780 1 < completed part key=_multipart_55JI541K1WP2.2~9HWHPVVMLXP1.2 size=930523 2024-09-12T17:18:12.196 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.195+0000 7f574d1ea780 1 < completed multipart upload key=55JI541K1WP2 upload=9HWHPVVMLXP1 tag=0B0ZNR97T35M type=write size=4076251 2024-09-12T17:18:12.198 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.197+0000 7f574d1ea780 1 > prepared part key=_multipart_HGZMN894YYC0.2~YI1QIK5KEU1E.0 size=604688 2024-09-12T17:18:12.198 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.197+0000 7f574d1ea780 1 > prepared multipart upload key=HGZMN894YYC0 upload=YI1QIK5KEU1E tag=1GLSHLO800XI type=write size=1653264 2024-09-12T17:18:12.199 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.199+0000 7f574d1ea780 1 < completed delete operation key=54LQ91UMBJAN tag=NL9TVJ944SDZ type=del 2024-09-12T17:18:12.201 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.201+0000 7f574d1ea780 1 > prepared part key=_multipart_RNI86YYLADT0.2~0IOV9TVCY0BO.0 size=1048576 2024-09-12T17:18:12.203 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.202+0000 7f574d1ea780 1 > prepared part key=_multipart_RNI86YYLADT0.2~0IOV9TVCY0BO.1 size=1048576 2024-09-12T17:18:12.204 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.203+0000 7f574d1ea780 1 > prepared part key=_multipart_RNI86YYLADT0.2~0IOV9TVCY0BO.2 size=805836 2024-09-12T17:18:12.204 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.203+0000 7f574d1ea780 1 > prepared multipart upload key=RNI86YYLADT0 upload=0IOV9TVCY0BO tag=BXTNZN22KCF5 type=write size=3951564 2024-09-12T17:18:12.207 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.206+0000 7f574d1ea780 1 < completed delete operation key=55V137SY4E4P tag=051MZZ1Q0QMI type=del 2024-09-12T17:18:12.208 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.207+0000 7f574d1ea780 1 > prepared operation key=HFWA7DNUMWF2 tag=RESRB2BQBEQ3 type=del size=1404476 2024-09-12T17:18:12.209 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.209+0000 7f574d1ea780 1 < completed delete operation key=C9IYR9CET1I8 tag=VP3F59PWA1QO type=del 2024-09-12T17:18:12.212 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.211+0000 7f574d1ea780 1 > prepared part key=_multipart_55V137SY4E4P.2~GFARN2HCGSC3.0 size=1048576 2024-09-12T17:18:12.212 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.212+0000 7f574d1ea780 1 > prepared part key=_multipart_55V137SY4E4P.2~GFARN2HCGSC3.1 size=1048576 2024-09-12T17:18:12.213 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.213+0000 7f574d1ea780 1 > prepared part key=_multipart_55V137SY4E4P.2~GFARN2HCGSC3.2 size=634067 2024-09-12T17:18:12.214 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.213+0000 7f574d1ea780 1 > prepared multipart upload key=55V137SY4E4P upload=GFARN2HCGSC3 tag=JT5X8L6HBBUX type=write size=3779795 2024-09-12T17:18:12.215 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.214+0000 7f574d1ea780 1 < completed delete operation key=YXIDO0U18839 tag=X8Z8ERJOMC0G type=del 2024-09-12T17:18:12.217 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.216+0000 7f574d1ea780 1 > prepared part key=_multipart_UTCKL1F42X8A.2~DFWGRIA1FJKR.0 size=1048576 2024-09-12T17:18:12.218 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.217+0000 7f574d1ea780 1 > prepared part key=_multipart_UTCKL1F42X8A.2~DFWGRIA1FJKR.1 size=1048576 2024-09-12T17:18:12.219 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.218+0000 7f574d1ea780 1 > prepared part key=_multipart_UTCKL1F42X8A.2~DFWGRIA1FJKR.2 size=111212 2024-09-12T17:18:12.219 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.218+0000 7f574d1ea780 1 > prepared multipart upload key=UTCKL1F42X8A upload=DFWGRIA1FJKR tag=UC7WBYHXWAHZ type=write size=3256940 2024-09-12T17:18:12.220 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.219+0000 7f574d1ea780 1 < completed part key=_multipart_HFWA7DNUMWF2.2~6HB6A1LV2X31.0 size=898105 2024-09-12T17:18:12.222 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.221+0000 7f574d1ea780 1 < completed multipart upload key=HFWA7DNUMWF2 upload=6HB6A1LV2X31 tag=K9A9NV5M9WZY type=write size=1946681 2024-09-12T17:18:12.223 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.223+0000 7f574d1ea780 1 > prepared operation key=55JI541K1WP2 tag=05CYRDS9ATXF type=del size=243925 2024-09-12T17:18:12.225 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.224+0000 7f574d1ea780 1 < completed delete operation key=U6E9A5OH4GUW tag=L1FD2EANLYE1 type=del 2024-09-12T17:18:12.227 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.226+0000 7f574d1ea780 1 > prepared part key=_multipart_DH02JGZP64MN.2~CFRLULN4X8TA.0 size=388096 2024-09-12T17:18:12.227 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.226+0000 7f574d1ea780 1 > prepared multipart upload key=DH02JGZP64MN upload=CFRLULN4X8TA tag=RZSB251Z3RPA type=write size=1436672 2024-09-12T17:18:12.228 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.227+0000 7f574d1ea780 1 < completed delete operation key=HGZMN894YYC0 tag=91X5H34WHRUD type=del 2024-09-12T17:18:12.230 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.229+0000 7f574d1ea780 1 > prepared part key=_multipart_GEGOEB05R0PK.2~L40I196L51XI.0 size=391790 2024-09-12T17:18:12.230 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.229+0000 7f574d1ea780 1 > prepared multipart upload key=GEGOEB05R0PK upload=L40I196L51XI tag=GA6M7A52T7V0 type=write size=1440366 2024-09-12T17:18:12.231 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.231+0000 7f574d1ea780 1 < completed delete operation key=ENFNIFHQ3SHW tag=QCZHAZII6J7T type=del 2024-09-12T17:18:12.233 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.232+0000 7f574d1ea780 1 > prepared operation key=D1GEG3MKPOM3 tag=4YUJY8N94HQG type=del size=3291712 2024-09-12T17:18:12.234 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.233+0000 7f574d1ea780 1 < completed delete operation key=55V137SY4E4P tag=CCD7JONVWXVP type=del 2024-09-12T17:18:12.235 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.234+0000 7f574d1ea780 1 > prepared operation key=8VW3XCUHLF2L tag=I64B634IAVWQ type=del size=2092649 2024-09-12T17:18:12.236 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.235+0000 7f574d1ea780 1 < canceled operation key=RNI86YYLADT0 tag=Z3WM5GYEE73R type=write size=225386 2024-09-12T17:18:12.239 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.238+0000 7f574d1ea780 1 > prepared part key=_multipart_UFKM4I8RMT0W.2~NFSBWG0UT511.0 size=1048576 2024-09-12T17:18:12.240 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.239+0000 7f574d1ea780 1 > prepared part key=_multipart_UFKM4I8RMT0W.2~NFSBWG0UT511.1 size=1048576 2024-09-12T17:18:12.241 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.240+0000 7f574d1ea780 1 > prepared part key=_multipart_UFKM4I8RMT0W.2~NFSBWG0UT511.2 size=962935 2024-09-12T17:18:12.241 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.240+0000 7f574d1ea780 1 > prepared multipart upload key=UFKM4I8RMT0W upload=NFSBWG0UT511 tag=L1OYDETA79NQ type=write size=4108663 2024-09-12T17:18:12.242 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.241+0000 7f574d1ea780 1 < completed part key=_multipart_OI51GO639LFK.2~908SR42HPH37.0 size=587076 2024-09-12T17:18:12.244 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.243+0000 7f574d1ea780 1 < completed multipart upload key=OI51GO639LFK upload=908SR42HPH37 tag=PQID9XSQAV2H type=write size=1635652 2024-09-12T17:18:12.246 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.246+0000 7f574d1ea780 1 > prepared part key=_multipart_8SG7DJO4HWPI.2~JLUA5WYFNU14.0 size=336694 2024-09-12T17:18:12.247 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.246+0000 7f574d1ea780 1 > prepared multipart upload key=8SG7DJO4HWPI upload=JLUA5WYFNU14 tag=OYO3DPY7WGK6 type=write size=1385270 2024-09-12T17:18:12.248 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.247+0000 7f574d1ea780 1 < canceled operation key=VWWA5IB0L4N1 tag=A434K0S4BXW1 type=del size=2022454 2024-09-12T17:18:12.249 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.248+0000 7f574d1ea780 1 > prepared operation key=ZGH8XC39FGTC tag=4J24YHQOF7TY type=del size=377450 2024-09-12T17:18:12.250 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.249+0000 7f574d1ea780 1 < completed delete operation key=54CM8800AT9V tag=RKRBUNPO53WO type=del 2024-09-12T17:18:12.252 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.251+0000 7f574d1ea780 1 > prepared operation key=U6E9A5OH4GUW tag=HF91AWKWBHJE type=del size=1535085 2024-09-12T17:18:12.254 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.253+0000 7f574d1ea780 1 < suggested remove operation key=55V137SY4E4P tag=YT3JL0Y0XO4W type=del 2024-09-12T17:18:12.255 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.254+0000 7f574d1ea780 1 > prepared operation key=ZGE1860DMGHA tag=NG1AZY3ZMTJD type=del size=3066149 2024-09-12T17:18:12.256 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.256+0000 7f574d1ea780 1 < completed delete operation key=HGZMN894YYC0 tag=YN7GW2EUQ537 type=del 2024-09-12T17:18:12.258 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.257+0000 7f574d1ea780 1 > prepared operation key=UFKM4I8RMT0W tag=HJB7O348GARO type=del size=2484078 2024-09-12T17:18:12.259 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.258+0000 7f574d1ea780 1 < completed part key=_multipart_HGZMN894YYC0.2~YI1QIK5KEU1E.0 size=604688 2024-09-12T17:18:12.261 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.260+0000 7f574d1ea780 1 < completed multipart upload key=HGZMN894YYC0 upload=YI1QIK5KEU1E tag=1GLSHLO800XI type=write size=1653264 2024-09-12T17:18:12.262 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.261+0000 7f574d1ea780 1 > prepared operation key=GEGOEB05R0PK tag=2EHSVSFW9K5O type=del size=2614390 2024-09-12T17:18:12.265 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.263+0000 7f574d1ea780 1 < completed part key=_multipart_RNI86YYLADT0.2~0IOV9TVCY0BO.0 size=1048576 2024-09-12T17:18:12.265 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.264+0000 7f574d1ea780 1 < completed part key=_multipart_RNI86YYLADT0.2~0IOV9TVCY0BO.1 size=1048576 2024-09-12T17:18:12.265 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.264+0000 7f574d1ea780 1 < canceled part key=_multipart_RNI86YYLADT0.2~0IOV9TVCY0BO.2 size=805836 2024-09-12T17:18:12.266 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.266+0000 7f574d1ea780 1 < canceled multipart upload key=RNI86YYLADT0 upload=0IOV9TVCY0BO tag=BXTNZN22KCF5 type=write size=3951564 2024-09-12T17:18:12.270 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.269+0000 7f574d1ea780 1 > prepared part key=_multipart_ZGH8XC39FGTC.2~B84ROSIZ30YP.0 size=1048576 2024-09-12T17:18:12.271 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.271+0000 7f574d1ea780 1 > prepared part key=_multipart_ZGH8XC39FGTC.2~B84ROSIZ30YP.1 size=1048576 2024-09-12T17:18:12.272 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.272+0000 7f574d1ea780 1 > prepared part key=_multipart_ZGH8XC39FGTC.2~B84ROSIZ30YP.2 size=627784 2024-09-12T17:18:12.273 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.272+0000 7f574d1ea780 1 > prepared multipart upload key=ZGH8XC39FGTC upload=B84ROSIZ30YP tag=3RGPDQOB2UEX type=write size=3773512 2024-09-12T17:18:12.274 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.273+0000 7f574d1ea780 1 < completed delete operation key=HFWA7DNUMWF2 tag=RESRB2BQBEQ3 type=del 2024-09-12T17:18:12.275 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.274+0000 7f574d1ea780 1 > prepared operation key=UTCKL1F42X8A tag=678YE6EM4FZ0 type=del size=3219205 2024-09-12T17:18:12.276 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.275+0000 7f574d1ea780 1 < completed part key=_multipart_55V137SY4E4P.2~GFARN2HCGSC3.0 size=1048576 2024-09-12T17:18:12.277 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.277+0000 7f574d1ea780 1 < completed part key=_multipart_55V137SY4E4P.2~GFARN2HCGSC3.1 size=1048576 2024-09-12T17:18:12.278 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.278+0000 7f574d1ea780 1 < completed part key=_multipart_55V137SY4E4P.2~GFARN2HCGSC3.2 size=634067 2024-09-12T17:18:12.281 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.280+0000 7f574d1ea780 1 < completed multipart upload key=55V137SY4E4P upload=GFARN2HCGSC3 tag=JT5X8L6HBBUX type=write size=3779795 2024-09-12T17:18:12.283 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.282+0000 7f574d1ea780 1 > prepared part key=_multipart_A1TIP3RXHBCZ.2~T9G8N2GMHWKQ.0 size=1048576 2024-09-12T17:18:12.284 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.283+0000 7f574d1ea780 1 > prepared part key=_multipart_A1TIP3RXHBCZ.2~T9G8N2GMHWKQ.1 size=1048576 2024-09-12T17:18:12.285 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.284+0000 7f574d1ea780 1 > prepared part key=_multipart_A1TIP3RXHBCZ.2~T9G8N2GMHWKQ.2 size=852015 2024-09-12T17:18:12.285 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.284+0000 7f574d1ea780 1 > prepared multipart upload key=A1TIP3RXHBCZ upload=T9G8N2GMHWKQ tag=9288SBC40N8K type=write size=3997743 2024-09-12T17:18:12.285 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.284+0000 7f574d1ea780 1 < canceled part key=_multipart_UTCKL1F42X8A.2~DFWGRIA1FJKR.0 size=1048576 2024-09-12T17:18:12.286 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.285+0000 7f574d1ea780 1 < completed part key=_multipart_UTCKL1F42X8A.2~DFWGRIA1FJKR.1 size=1048576 2024-09-12T17:18:12.287 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.286+0000 7f574d1ea780 1 < completed part key=_multipart_UTCKL1F42X8A.2~DFWGRIA1FJKR.2 size=111212 2024-09-12T17:18:12.289 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.288+0000 7f574d1ea780 1 < canceled multipart upload key=UTCKL1F42X8A upload=DFWGRIA1FJKR tag=UC7WBYHXWAHZ type=write size=3256940 2024-09-12T17:18:12.290 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.289+0000 7f574d1ea780 1 > prepared operation key=GEGOEB05R0PK tag=B4ABNNKFE1N6 type=del size=339477 2024-09-12T17:18:12.292 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.291+0000 7f574d1ea780 1 < completed delete operation key=55JI541K1WP2 tag=05CYRDS9ATXF type=del 2024-09-12T17:18:12.294 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.293+0000 7f574d1ea780 1 > prepared part key=_multipart_8SG7DJO4HWPI.2~3BRQ18HMJSAF.0 size=1048576 2024-09-12T17:18:12.295 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.294+0000 7f574d1ea780 1 > prepared part key=_multipart_8SG7DJO4HWPI.2~3BRQ18HMJSAF.1 size=1048576 2024-09-12T17:18:12.296 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.295+0000 7f574d1ea780 1 > prepared part key=_multipart_8SG7DJO4HWPI.2~3BRQ18HMJSAF.2 size=1033321 2024-09-12T17:18:12.296 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.295+0000 7f574d1ea780 1 > prepared multipart upload key=8SG7DJO4HWPI upload=3BRQ18HMJSAF tag=1NQCPLHYF3FI type=write size=4179049 2024-09-12T17:18:12.297 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.296+0000 7f574d1ea780 1 < completed part key=_multipart_DH02JGZP64MN.2~CFRLULN4X8TA.0 size=388096 2024-09-12T17:18:12.299 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.299+0000 7f574d1ea780 1 < completed multipart upload key=DH02JGZP64MN upload=CFRLULN4X8TA tag=RZSB251Z3RPA type=write size=1436672 2024-09-12T17:18:12.301 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.300+0000 7f574d1ea780 1 > prepared operation key=54LQ91UMBJAN tag=DSGZ6LNVU5ZO type=del size=3036003 2024-09-12T17:18:12.302 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.301+0000 7f574d1ea780 1 < completed part key=_multipart_GEGOEB05R0PK.2~L40I196L51XI.0 size=391790 2024-09-12T17:18:12.304 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.303+0000 7f574d1ea780 1 < completed multipart upload key=GEGOEB05R0PK upload=L40I196L51XI tag=GA6M7A52T7V0 type=write size=1440366 2024-09-12T17:18:12.305 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.304+0000 7f574d1ea780 1 > prepared operation key=55JI541K1WP2 tag=FUMU05H8K6GK type=del size=2476099 2024-09-12T17:18:12.306 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.306+0000 7f574d1ea780 1 < completed delete operation key=D1GEG3MKPOM3 tag=4YUJY8N94HQG type=del 2024-09-12T17:18:12.308 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.307+0000 7f574d1ea780 1 > prepared operation key=DH02JGZP64MN tag=BDWRSAGIRPMU type=del size=3835209 2024-09-12T17:18:12.309 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.308+0000 7f574d1ea780 1 < canceled operation key=8VW3XCUHLF2L tag=I64B634IAVWQ type=del size=2092649 2024-09-12T17:18:12.311 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.310+0000 7f574d1ea780 1 > prepared part key=_multipart_55JI541K1WP2.2~T2C7VG9QH4ON.0 size=1048576 2024-09-12T17:18:12.312 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.311+0000 7f574d1ea780 1 > prepared part key=_multipart_55JI541K1WP2.2~T2C7VG9QH4ON.1 size=1048576 2024-09-12T17:18:12.313 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.312+0000 7f574d1ea780 1 > prepared part key=_multipart_55JI541K1WP2.2~T2C7VG9QH4ON.2 size=844531 2024-09-12T17:18:12.313 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.312+0000 7f574d1ea780 1 > prepared multipart upload key=55JI541K1WP2 upload=T2C7VG9QH4ON tag=LJ80X9QL3JF0 type=write size=3990259 2024-09-12T17:18:12.314 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.313+0000 7f574d1ea780 1 < completed part key=_multipart_UFKM4I8RMT0W.2~NFSBWG0UT511.0 size=1048576 2024-09-12T17:18:12.314 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.313+0000 7f574d1ea780 1 < canceled part key=_multipart_UFKM4I8RMT0W.2~NFSBWG0UT511.1 size=1048576 2024-09-12T17:18:12.314 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.313+0000 7f574d1ea780 1 < canceled part key=_multipart_UFKM4I8RMT0W.2~NFSBWG0UT511.2 size=962935 2024-09-12T17:18:12.316 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.315+0000 7f574d1ea780 1 < canceled multipart upload key=UFKM4I8RMT0W upload=NFSBWG0UT511 tag=L1OYDETA79NQ type=write size=4108663 2024-09-12T17:18:12.317 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.317+0000 7f574d1ea780 1 > prepared operation key=UTCKL1F42X8A tag=1FD23U0F8I7I type=del size=4184476 2024-09-12T17:18:12.320 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.318+0000 7f574d1ea780 1 < completed part key=_multipart_8SG7DJO4HWPI.2~JLUA5WYFNU14.0 size=336694 2024-09-12T17:18:12.322 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.321+0000 7f574d1ea780 1 < completed multipart upload key=8SG7DJO4HWPI upload=JLUA5WYFNU14 tag=OYO3DPY7WGK6 type=write size=1385270 2024-09-12T17:18:12.324 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.323+0000 7f574d1ea780 1 > prepared part key=_multipart_54LQ91UMBJAN.2~L1IPI80OG8XH.0 size=965664 2024-09-12T17:18:12.324 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.323+0000 7f574d1ea780 1 > prepared multipart upload key=54LQ91UMBJAN upload=L1IPI80OG8XH tag=6I7KUMETW5T2 type=write size=2014240 2024-09-12T17:18:12.325 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.325+0000 7f574d1ea780 1 < completed delete operation key=ZGH8XC39FGTC tag=4J24YHQOF7TY type=del 2024-09-12T17:18:12.328 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.327+0000 7f574d1ea780 1 > prepared part key=_multipart_VWWA5IB0L4N1.2~F9U76PC3FM3K.0 size=56998 2024-09-12T17:18:12.328 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.327+0000 7f574d1ea780 1 > prepared multipart upload key=VWWA5IB0L4N1 upload=F9U76PC3FM3K tag=EH60V4V8M4J7 type=write size=1105574 2024-09-12T17:18:12.329 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.328+0000 7f574d1ea780 1 < completed delete operation key=U6E9A5OH4GUW tag=HF91AWKWBHJE type=del 2024-09-12T17:18:12.330 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.329+0000 7f574d1ea780 1 > prepared operation key=R00F69ON5P6Z tag=AZMPJO3CJY8U type=write size=478708 2024-09-12T17:18:12.332 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.331+0000 7f574d1ea780 1 < completed delete operation key=ZGE1860DMGHA tag=NG1AZY3ZMTJD type=del 2024-09-12T17:18:12.334 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.333+0000 7f574d1ea780 1 > prepared part key=_multipart_UTCKL1F42X8A.2~49MV74QVOBOJ.0 size=1048576 2024-09-12T17:18:12.335 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.334+0000 7f574d1ea780 1 > prepared part key=_multipart_UTCKL1F42X8A.2~49MV74QVOBOJ.1 size=776012 2024-09-12T17:18:12.335 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.334+0000 7f574d1ea780 1 > prepared multipart upload key=UTCKL1F42X8A upload=49MV74QVOBOJ tag=9KIKWXQ7V9KQ type=write size=2873164 2024-09-12T17:18:12.336 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.335+0000 7f574d1ea780 1 < completed delete operation key=UFKM4I8RMT0W tag=HJB7O348GARO type=del 2024-09-12T17:18:12.338 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.338+0000 7f574d1ea780 1 > prepared part key=_multipart_Q2Q3B1J3DAVD.2~LT47XQ5Q3B69.0 size=1048576 2024-09-12T17:18:12.339 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.339+0000 7f574d1ea780 1 > prepared part key=_multipart_Q2Q3B1J3DAVD.2~LT47XQ5Q3B69.1 size=733939 2024-09-12T17:18:12.339 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.339+0000 7f574d1ea780 1 > prepared multipart upload key=Q2Q3B1J3DAVD upload=LT47XQ5Q3B69 tag=5A3KRKXLJVZ5 type=write size=2831091 2024-09-12T17:18:12.341 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.340+0000 7f574d1ea780 1 < completed delete operation key=GEGOEB05R0PK tag=2EHSVSFW9K5O type=del 2024-09-12T17:18:12.343 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.342+0000 7f574d1ea780 1 > prepared part key=_multipart_HFWA7DNUMWF2.2~WFJUIXRA656V.0 size=1048576 2024-09-12T17:18:12.344 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.343+0000 7f574d1ea780 1 > prepared part key=_multipart_HFWA7DNUMWF2.2~WFJUIXRA656V.1 size=324943 2024-09-12T17:18:12.344 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.343+0000 7f574d1ea780 1 > prepared multipart upload key=HFWA7DNUMWF2 upload=WFJUIXRA656V tag=IG4I0K685JFE type=write size=2422095 2024-09-12T17:18:12.345 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.345+0000 7f574d1ea780 1 < completed part key=_multipart_ZGH8XC39FGTC.2~B84ROSIZ30YP.0 size=1048576 2024-09-12T17:18:12.346 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.346+0000 7f574d1ea780 1 < completed part key=_multipart_ZGH8XC39FGTC.2~B84ROSIZ30YP.1 size=1048576 2024-09-12T17:18:12.347 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.347+0000 7f574d1ea780 1 < completed part key=_multipart_ZGH8XC39FGTC.2~B84ROSIZ30YP.2 size=627784 2024-09-12T17:18:12.350 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.349+0000 7f574d1ea780 1 < completed multipart upload key=ZGH8XC39FGTC upload=B84ROSIZ30YP tag=3RGPDQOB2UEX type=write size=3773512 2024-09-12T17:18:12.351 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.350+0000 7f574d1ea780 1 > prepared operation key=55V137SY4E4P tag=T1U8W8PR8U8S type=write size=782809 2024-09-12T17:18:12.352 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.351+0000 7f574d1ea780 1 < completed delete operation key=UTCKL1F42X8A tag=678YE6EM4FZ0 type=del 2024-09-12T17:18:12.353 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.353+0000 7f574d1ea780 1 > prepared operation key=RNI86YYLADT0 tag=D9ZRD642RE21 type=del size=1463970 2024-09-12T17:18:12.355 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.354+0000 7f574d1ea780 1 < completed part key=_multipart_A1TIP3RXHBCZ.2~T9G8N2GMHWKQ.0 size=1048576 2024-09-12T17:18:12.356 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.355+0000 7f574d1ea780 1 < completed part key=_multipart_A1TIP3RXHBCZ.2~T9G8N2GMHWKQ.1 size=1048576 2024-09-12T17:18:12.357 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.356+0000 7f574d1ea780 1 < completed part key=_multipart_A1TIP3RXHBCZ.2~T9G8N2GMHWKQ.2 size=852015 2024-09-12T17:18:12.359 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.358+0000 7f574d1ea780 1 < completed multipart upload key=A1TIP3RXHBCZ upload=T9G8N2GMHWKQ tag=9288SBC40N8K type=write size=3997743 2024-09-12T17:18:12.360 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.359+0000 7f574d1ea780 1 > prepared operation key=8SG7DJO4HWPI tag=RPW9LF61HC7N type=write size=319023 2024-09-12T17:18:12.361 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.361+0000 7f574d1ea780 1 < completed delete operation key=GEGOEB05R0PK tag=B4ABNNKFE1N6 type=del 2024-09-12T17:18:12.363 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.362+0000 7f574d1ea780 1 > prepared operation key=QXD8UG2K4STQ tag=PI77XCHIYH5Y type=write size=425296 2024-09-12T17:18:12.364 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.363+0000 7f574d1ea780 1 < completed part key=_multipart_8SG7DJO4HWPI.2~3BRQ18HMJSAF.0 size=1048576 2024-09-12T17:18:12.365 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.364+0000 7f574d1ea780 1 < completed part key=_multipart_8SG7DJO4HWPI.2~3BRQ18HMJSAF.1 size=1048576 2024-09-12T17:18:12.366 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.365+0000 7f574d1ea780 1 < completed part key=_multipart_8SG7DJO4HWPI.2~3BRQ18HMJSAF.2 size=1033321 2024-09-12T17:18:12.368 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.367+0000 7f574d1ea780 1 < completed multipart upload key=8SG7DJO4HWPI upload=3BRQ18HMJSAF tag=1NQCPLHYF3FI type=write size=4179049 2024-09-12T17:18:12.369 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.368+0000 7f574d1ea780 1 > prepared operation key=U6E9A5OH4GUW tag=WKPPW48IPD82 type=del size=1278163 2024-09-12T17:18:12.370 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.370+0000 7f574d1ea780 1 < completed delete operation key=54LQ91UMBJAN tag=DSGZ6LNVU5ZO type=del 2024-09-12T17:18:12.373 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.372+0000 7f574d1ea780 1 > prepared part key=_multipart_U6E9A5OH4GUW.2~8VFDB856Y9K0.0 size=1048576 2024-09-12T17:18:12.374 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.373+0000 7f574d1ea780 1 > prepared part key=_multipart_U6E9A5OH4GUW.2~8VFDB856Y9K0.1 size=1048576 2024-09-12T17:18:12.375 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.374+0000 7f574d1ea780 1 > prepared part key=_multipart_U6E9A5OH4GUW.2~8VFDB856Y9K0.2 size=341601 2024-09-12T17:18:12.375 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.374+0000 7f574d1ea780 1 > prepared multipart upload key=U6E9A5OH4GUW upload=8VFDB856Y9K0 tag=LC7BF5LQZJ4O type=write size=3487329 2024-09-12T17:18:12.376 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.375+0000 7f574d1ea780 1 < completed delete operation key=55JI541K1WP2 tag=FUMU05H8K6GK type=del 2024-09-12T17:18:12.378 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.377+0000 7f574d1ea780 1 > prepared operation key=UTCKL1F42X8A tag=D9BFMJJAMH10 type=del size=2629080 2024-09-12T17:18:12.379 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.378+0000 7f574d1ea780 1 < completed delete operation key=DH02JGZP64MN tag=BDWRSAGIRPMU type=del 2024-09-12T17:18:12.380 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.379+0000 7f574d1ea780 1 > prepared operation key=K12MVG618809 tag=829PX7H563DD type=del size=2524961 2024-09-12T17:18:12.380 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.380+0000 7f574d1ea780 1 < canceled part key=_multipart_55JI541K1WP2.2~T2C7VG9QH4ON.0 size=1048576 2024-09-12T17:18:12.381 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.381+0000 7f574d1ea780 1 < completed part key=_multipart_55JI541K1WP2.2~T2C7VG9QH4ON.1 size=1048576 2024-09-12T17:18:12.382 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.382+0000 7f574d1ea780 1 < completed part key=_multipart_55JI541K1WP2.2~T2C7VG9QH4ON.2 size=844531 2024-09-12T17:18:12.384 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.384+0000 7f574d1ea780 1 < canceled multipart upload key=55JI541K1WP2 upload=T2C7VG9QH4ON tag=LJ80X9QL3JF0 type=write size=3990259 2024-09-12T17:18:12.387 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.386+0000 7f574d1ea780 1 > prepared part key=_multipart_R00F69ON5P6Z.2~AOVTZE76A3NI.0 size=672975 2024-09-12T17:18:12.387 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.386+0000 7f574d1ea780 1 > prepared multipart upload key=R00F69ON5P6Z upload=AOVTZE76A3NI tag=HNVSUGWNL33L type=write size=1721551 2024-09-12T17:18:12.388 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.387+0000 7f574d1ea780 1 < completed delete operation key=UTCKL1F42X8A tag=1FD23U0F8I7I type=del 2024-09-12T17:18:12.389 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.389+0000 7f574d1ea780 1 > prepared operation key=ZGH8XC39FGTC tag=1B6TNJUEQUO0 type=del size=373759 2024-09-12T17:18:12.391 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.390+0000 7f574d1ea780 1 < completed part key=_multipart_54LQ91UMBJAN.2~L1IPI80OG8XH.0 size=965664 2024-09-12T17:18:12.393 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.392+0000 7f574d1ea780 1 < completed multipart upload key=54LQ91UMBJAN upload=L1IPI80OG8XH tag=6I7KUMETW5T2 type=write size=2014240 2024-09-12T17:18:12.394 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.393+0000 7f574d1ea780 1 > prepared operation key=GEGOEB05R0PK tag=B6RR3S4336I3 type=del size=58793 2024-09-12T17:18:12.395 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.394+0000 7f574d1ea780 1 < completed part key=_multipart_VWWA5IB0L4N1.2~F9U76PC3FM3K.0 size=56998 2024-09-12T17:18:12.397 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.396+0000 7f574d1ea780 1 < completed multipart upload key=VWWA5IB0L4N1 upload=F9U76PC3FM3K tag=EH60V4V8M4J7 type=write size=1105574 2024-09-12T17:18:12.398 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.397+0000 7f574d1ea780 1 > prepared operation key=ENFNIFHQ3SHW tag=3P1NOVHO7MS3 type=del size=2955597 2024-09-12T17:18:12.400 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.400+0000 7f574d1ea780 1 < suggested remove operation key=R00F69ON5P6Z tag=AZMPJO3CJY8U type=write 2024-09-12T17:18:12.401 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.401+0000 7f574d1ea780 1 > prepared operation key=UTCKL1F42X8A tag=MUAF64EVXM91 type=write size=949051 2024-09-12T17:18:12.403 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.402+0000 7f574d1ea780 1 < completed part key=_multipart_UTCKL1F42X8A.2~49MV74QVOBOJ.0 size=1048576 2024-09-12T17:18:12.404 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.403+0000 7f574d1ea780 1 < completed part key=_multipart_UTCKL1F42X8A.2~49MV74QVOBOJ.1 size=776012 2024-09-12T17:18:12.406 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.405+0000 7f574d1ea780 1 < completed multipart upload key=UTCKL1F42X8A upload=49MV74QVOBOJ tag=9KIKWXQ7V9KQ type=write size=2873164 2024-09-12T17:18:12.407 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.406+0000 7f574d1ea780 1 > prepared operation key=HFWA7DNUMWF2 tag=YL73G6CIAKCZ type=del size=2500022 2024-09-12T17:18:12.408 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.407+0000 7f574d1ea780 1 < completed part key=_multipart_Q2Q3B1J3DAVD.2~LT47XQ5Q3B69.0 size=1048576 2024-09-12T17:18:12.409 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.408+0000 7f574d1ea780 1 < completed part key=_multipart_Q2Q3B1J3DAVD.2~LT47XQ5Q3B69.1 size=733939 2024-09-12T17:18:12.411 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.410+0000 7f574d1ea780 1 < completed multipart upload key=Q2Q3B1J3DAVD upload=LT47XQ5Q3B69 tag=5A3KRKXLJVZ5 type=write size=2831091 2024-09-12T17:18:12.412 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.411+0000 7f574d1ea780 1 > prepared operation key=SQQMJ61CA0QW tag=N971N169INSF type=del size=2430368 2024-09-12T17:18:12.413 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.412+0000 7f574d1ea780 1 < completed part key=_multipart_HFWA7DNUMWF2.2~WFJUIXRA656V.0 size=1048576 2024-09-12T17:18:12.414 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.413+0000 7f574d1ea780 1 < completed part key=_multipart_HFWA7DNUMWF2.2~WFJUIXRA656V.1 size=324943 2024-09-12T17:18:12.416 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.415+0000 7f574d1ea780 1 < completed multipart upload key=HFWA7DNUMWF2 upload=WFJUIXRA656V tag=IG4I0K685JFE type=write size=2422095 2024-09-12T17:18:12.418 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.417+0000 7f574d1ea780 1 > prepared part key=_multipart_Q2Q3B1J3DAVD.2~84Z7CIRZU790.0 size=1020761 2024-09-12T17:18:12.418 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.417+0000 7f574d1ea780 1 > prepared multipart upload key=Q2Q3B1J3DAVD upload=84Z7CIRZU790 tag=R6IH8JVJF1NG type=write size=2069337 2024-09-12T17:18:12.419 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.419+0000 7f574d1ea780 1 < completed write operation key=55V137SY4E4P tag=T1U8W8PR8U8S type=write size=782809 2024-09-12T17:18:12.421 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.420+0000 7f574d1ea780 1 > prepared operation key=ZGE1860DMGHA tag=2PB9PL299FD5 type=del size=3364555 2024-09-12T17:18:12.422 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.421+0000 7f574d1ea780 1 < completed delete operation key=RNI86YYLADT0 tag=D9ZRD642RE21 type=del 2024-09-12T17:18:12.424 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.423+0000 7f574d1ea780 1 > prepared part key=_multipart_55V137SY4E4P.2~GCP80POH3D11.0 size=677923 2024-09-12T17:18:12.424 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.423+0000 7f574d1ea780 1 > prepared multipart upload key=55V137SY4E4P upload=GCP80POH3D11 tag=R2H908CYTMHP type=write size=1726499 2024-09-12T17:18:12.425 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.424+0000 7f574d1ea780 1 < completed write operation key=8SG7DJO4HWPI tag=RPW9LF61HC7N type=write size=319023 2024-09-12T17:18:12.427 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.427+0000 7f574d1ea780 1 > prepared part key=_multipart_54CM8800AT9V.2~27P3ZYF4IZJ0.0 size=1048576 2024-09-12T17:18:12.428 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.427+0000 7f574d1ea780 1 > prepared part key=_multipart_54CM8800AT9V.2~27P3ZYF4IZJ0.1 size=1048576 2024-09-12T17:18:12.429 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.428+0000 7f574d1ea780 1 > prepared part key=_multipart_54CM8800AT9V.2~27P3ZYF4IZJ0.2 size=236939 2024-09-12T17:18:12.429 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.428+0000 7f574d1ea780 1 > prepared multipart upload key=54CM8800AT9V upload=27P3ZYF4IZJ0 tag=YOGH0KH9YIE6 type=write size=3382667 2024-09-12T17:18:12.431 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.431+0000 7f574d1ea780 1 < suggested remove operation key=QXD8UG2K4STQ tag=PI77XCHIYH5Y type=write 2024-09-12T17:18:12.433 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.432+0000 7f574d1ea780 1 > prepared operation key=55JI541K1WP2 tag=G6938XAIXUSX type=del size=186214 2024-09-12T17:18:12.434 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.434+0000 7f574d1ea780 1 < completed delete operation key=U6E9A5OH4GUW tag=WKPPW48IPD82 type=del 2024-09-12T17:18:12.437 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.436+0000 7f574d1ea780 1 > prepared part key=_multipart_54CM8800AT9V.2~1VIQEYRYMDVB.0 size=950605 2024-09-12T17:18:12.437 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.436+0000 7f574d1ea780 1 > prepared multipart upload key=54CM8800AT9V upload=1VIQEYRYMDVB tag=AIYNPP3UW0G2 type=write size=1999181 2024-09-12T17:18:12.438 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.438+0000 7f574d1ea780 1 < completed part key=_multipart_U6E9A5OH4GUW.2~8VFDB856Y9K0.0 size=1048576 2024-09-12T17:18:12.439 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.439+0000 7f574d1ea780 1 < completed part key=_multipart_U6E9A5OH4GUW.2~8VFDB856Y9K0.1 size=1048576 2024-09-12T17:18:12.440 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.440+0000 7f574d1ea780 1 < completed part key=_multipart_U6E9A5OH4GUW.2~8VFDB856Y9K0.2 size=341601 2024-09-12T17:18:12.443 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.442+0000 7f574d1ea780 1 < completed multipart upload key=U6E9A5OH4GUW upload=8VFDB856Y9K0 tag=LC7BF5LQZJ4O type=write size=3487329 2024-09-12T17:18:12.444 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.443+0000 7f574d1ea780 1 > prepared operation key=UTCKL1F42X8A tag=YR5CXL5QZAAJ type=del size=3752643 2024-09-12T17:18:12.445 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.444+0000 7f574d1ea780 1 < completed delete operation key=UTCKL1F42X8A tag=D9BFMJJAMH10 type=del 2024-09-12T17:18:12.447 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.446+0000 7f574d1ea780 1 > prepared operation key=55JI541K1WP2 tag=TY0S6IFCZ7Y4 type=del size=1137167 2024-09-12T17:18:12.448 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.447+0000 7f574d1ea780 1 < completed delete operation key=K12MVG618809 tag=829PX7H563DD type=del 2024-09-12T17:18:12.449 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.448+0000 7f574d1ea780 1 > prepared operation key=HGZMN894YYC0 tag=MI25M646EU1H type=del size=164011 2024-09-12T17:18:12.450 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.450+0000 7f574d1ea780 1 < completed part key=_multipart_R00F69ON5P6Z.2~AOVTZE76A3NI.0 size=672975 2024-09-12T17:18:12.452 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.452+0000 7f574d1ea780 1 < completed multipart upload key=R00F69ON5P6Z upload=AOVTZE76A3NI tag=HNVSUGWNL33L type=write size=1721551 2024-09-12T17:18:12.454 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.453+0000 7f574d1ea780 1 > prepared operation key=7BX38Q7723EB tag=VPUBJKO6WAAF type=del size=3527364 2024-09-12T17:18:12.455 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.454+0000 7f574d1ea780 1 < completed delete operation key=ZGH8XC39FGTC tag=1B6TNJUEQUO0 type=del 2024-09-12T17:18:12.456 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.455+0000 7f574d1ea780 1 > prepared operation key=ZGE1860DMGHA tag=PZWSKFQ0IU09 type=del size=1211417 2024-09-12T17:18:12.457 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.457+0000 7f574d1ea780 1 < completed delete operation key=GEGOEB05R0PK tag=B6RR3S4336I3 type=del 2024-09-12T17:18:12.458 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.458+0000 7f574d1ea780 1 > prepared operation key=A1TIP3RXHBCZ tag=FY9IVL9OE7BC type=del size=3277285 2024-09-12T17:18:12.460 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.459+0000 7f574d1ea780 1 < completed delete operation key=ENFNIFHQ3SHW tag=3P1NOVHO7MS3 type=del 2024-09-12T17:18:12.461 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.461+0000 7f574d1ea780 1 > prepared operation key=ENFNIFHQ3SHW tag=TNGOXT7XIQ3N type=del size=1842222 2024-09-12T17:18:12.462 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.462+0000 7f574d1ea780 1 < completed write operation key=UTCKL1F42X8A tag=MUAF64EVXM91 type=write size=949051 2024-09-12T17:18:12.465 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.464+0000 7f574d1ea780 1 > prepared part key=_multipart_RNI86YYLADT0.2~WTY2AT1PWBE6.0 size=280774 2024-09-12T17:18:12.465 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.464+0000 7f574d1ea780 1 > prepared multipart upload key=RNI86YYLADT0 upload=WTY2AT1PWBE6 tag=WN69ZTZMXEUM type=write size=1329350 2024-09-12T17:18:12.466 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.465+0000 7f574d1ea780 1 < completed delete operation key=HFWA7DNUMWF2 tag=YL73G6CIAKCZ type=del 2024-09-12T17:18:12.468 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.467+0000 7f574d1ea780 1 > prepared part key=_multipart_YXIDO0U18839.2~T1DCLV09V10O.0 size=869966 2024-09-12T17:18:12.468 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.467+0000 7f574d1ea780 1 > prepared multipart upload key=YXIDO0U18839 upload=T1DCLV09V10O tag=C2FIHREXO8J1 type=write size=1918542 2024-09-12T17:18:12.469 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.468+0000 7f574d1ea780 1 < completed delete operation key=SQQMJ61CA0QW tag=N971N169INSF type=del 2024-09-12T17:18:12.480 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.479+0000 7f574d1ea780 1 > prepared part key=_multipart_54CM8800AT9V.2~0ZAFWC8SAGY0.0 size=1048576 2024-09-12T17:18:12.482 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.481+0000 7f574d1ea780 1 > prepared part key=_multipart_54CM8800AT9V.2~0ZAFWC8SAGY0.1 size=1048576 2024-09-12T17:18:12.483 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.482+0000 7f574d1ea780 1 > prepared part key=_multipart_54CM8800AT9V.2~0ZAFWC8SAGY0.2 size=966325 2024-09-12T17:18:12.483 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.482+0000 7f574d1ea780 1 > prepared multipart upload key=54CM8800AT9V upload=0ZAFWC8SAGY0 tag=DWZ492AUA6NJ type=write size=4112053 2024-09-12T17:18:12.484 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.484+0000 7f574d1ea780 1 < completed part key=_multipart_Q2Q3B1J3DAVD.2~84Z7CIRZU790.0 size=1020761 2024-09-12T17:18:12.487 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.486+0000 7f574d1ea780 1 < completed multipart upload key=Q2Q3B1J3DAVD upload=84Z7CIRZU790 tag=R6IH8JVJF1NG type=write size=2069337 2024-09-12T17:18:12.489 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.488+0000 7f574d1ea780 1 > prepared part key=_multipart_RWVWJHVZE95H.2~MQL1AQP8S50W.0 size=1048576 2024-09-12T17:18:12.490 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.489+0000 7f574d1ea780 1 > prepared part key=_multipart_RWVWJHVZE95H.2~MQL1AQP8S50W.1 size=1048576 2024-09-12T17:18:12.491 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.490+0000 7f574d1ea780 1 > prepared part key=_multipart_RWVWJHVZE95H.2~MQL1AQP8S50W.2 size=1015771 2024-09-12T17:18:12.491 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.490+0000 7f574d1ea780 1 > prepared multipart upload key=RWVWJHVZE95H upload=MQL1AQP8S50W tag=UGX5OJVC04O5 type=write size=4161499 2024-09-12T17:18:12.492 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.491+0000 7f574d1ea780 1 < completed delete operation key=ZGE1860DMGHA tag=2PB9PL299FD5 type=del 2024-09-12T17:18:12.495 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.494+0000 7f574d1ea780 1 > prepared part key=_multipart_55V137SY4E4P.2~YNJNZE5SCXZ9.0 size=315549 2024-09-12T17:18:12.495 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.494+0000 7f574d1ea780 1 > prepared multipart upload key=55V137SY4E4P upload=YNJNZE5SCXZ9 tag=QFSW6D2ERINF type=write size=1364125 2024-09-12T17:18:12.496 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.495+0000 7f574d1ea780 1 < completed part key=_multipart_55V137SY4E4P.2~GCP80POH3D11.0 size=677923 2024-09-12T17:18:12.498 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.497+0000 7f574d1ea780 1 < completed multipart upload key=55V137SY4E4P upload=GCP80POH3D11 tag=R2H908CYTMHP type=write size=1726499 2024-09-12T17:18:12.499 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.498+0000 7f574d1ea780 1 > prepared operation key=54LQ91UMBJAN tag=YP792V7KNWZZ type=del size=2150933 2024-09-12T17:18:12.500 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.500+0000 7f574d1ea780 1 < completed part key=_multipart_54CM8800AT9V.2~27P3ZYF4IZJ0.0 size=1048576 2024-09-12T17:18:12.501 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.501+0000 7f574d1ea780 1 < completed part key=_multipart_54CM8800AT9V.2~27P3ZYF4IZJ0.1 size=1048576 2024-09-12T17:18:12.503 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.502+0000 7f574d1ea780 1 < completed part key=_multipart_54CM8800AT9V.2~27P3ZYF4IZJ0.2 size=236939 2024-09-12T17:18:12.505 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.504+0000 7f574d1ea780 1 < completed multipart upload key=54CM8800AT9V upload=27P3ZYF4IZJ0 tag=YOGH0KH9YIE6 type=write size=3382667 2024-09-12T17:18:12.507 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.506+0000 7f574d1ea780 1 > prepared part key=_multipart_HGZMN894YYC0.2~WU0MQCERELMC.0 size=907949 2024-09-12T17:18:12.507 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.506+0000 7f574d1ea780 1 > prepared multipart upload key=HGZMN894YYC0 upload=WU0MQCERELMC tag=C4SH7I29K3J7 type=write size=1956525 2024-09-12T17:18:12.508 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.508+0000 7f574d1ea780 1 < completed delete operation key=55JI541K1WP2 tag=G6938XAIXUSX type=del 2024-09-12T17:18:12.510 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.509+0000 7f574d1ea780 1 > prepared operation key=SQQMJ61CA0QW tag=9J1C5CWZB1UO type=del size=1510801 2024-09-12T17:18:12.511 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.510+0000 7f574d1ea780 1 < completed part key=_multipart_54CM8800AT9V.2~1VIQEYRYMDVB.0 size=950605 2024-09-12T17:18:12.513 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.512+0000 7f574d1ea780 1 < completed multipart upload key=54CM8800AT9V upload=1VIQEYRYMDVB tag=AIYNPP3UW0G2 type=write size=1999181 2024-09-12T17:18:12.515 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.515+0000 7f574d1ea780 1 > prepared part key=_multipart_YXIDO0U18839.2~SL0560CATKHG.0 size=1048576 2024-09-12T17:18:12.516 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.516+0000 7f574d1ea780 1 > prepared part key=_multipart_YXIDO0U18839.2~SL0560CATKHG.1 size=789721 2024-09-12T17:18:12.517 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.516+0000 7f574d1ea780 1 > prepared multipart upload key=YXIDO0U18839 upload=SL0560CATKHG tag=DRY3BQ1IJFBB type=write size=2886873 2024-09-12T17:18:12.518 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.517+0000 7f574d1ea780 1 < completed delete operation key=UTCKL1F42X8A tag=YR5CXL5QZAAJ type=del 2024-09-12T17:18:12.521 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.520+0000 7f574d1ea780 1 > prepared part key=_multipart_UTCKL1F42X8A.2~8914RIIE7QXD.0 size=1048576 2024-09-12T17:18:12.522 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.521+0000 7f574d1ea780 1 > prepared part key=_multipart_UTCKL1F42X8A.2~8914RIIE7QXD.1 size=1048576 2024-09-12T17:18:12.523 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.522+0000 7f574d1ea780 1 > prepared part key=_multipart_UTCKL1F42X8A.2~8914RIIE7QXD.2 size=1018321 2024-09-12T17:18:12.523 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.522+0000 7f574d1ea780 1 > prepared multipart upload key=UTCKL1F42X8A upload=8914RIIE7QXD tag=C3I4DC2R3V04 type=write size=4164049 2024-09-12T17:18:12.526 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.525+0000 7f574d1ea780 1 < suggested update operation key=55JI541K1WP2 tag=TY0S6IFCZ7Y4 type=del size=1137167 2024-09-12T17:18:12.527 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.526+0000 7f574d1ea780 1 > prepared operation key=U6E9A5OH4GUW tag=0W6YV1YMRURK type=del size=2577383 2024-09-12T17:18:12.528 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.528+0000 7f574d1ea780 1 < completed delete operation key=HGZMN894YYC0 tag=MI25M646EU1H type=del 2024-09-12T17:18:12.531 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.530+0000 7f574d1ea780 1 > prepared part key=_multipart_8SG7DJO4HWPI.2~MX95EWT621JR.0 size=588149 2024-09-12T17:18:12.531 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.530+0000 7f574d1ea780 1 > prepared multipart upload key=8SG7DJO4HWPI upload=MX95EWT621JR tag=T4FH39OOAX5H type=write size=1636725 2024-09-12T17:18:12.532 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.531+0000 7f574d1ea780 1 < completed delete operation key=7BX38Q7723EB tag=VPUBJKO6WAAF type=del 2024-09-12T17:18:12.534 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.533+0000 7f574d1ea780 1 > prepared part key=_multipart_U6E9A5OH4GUW.2~R64ETMYYEVB3.0 size=1048576 2024-09-12T17:18:12.535 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.534+0000 7f574d1ea780 1 > prepared part key=_multipart_U6E9A5OH4GUW.2~R64ETMYYEVB3.1 size=1015047 2024-09-12T17:18:12.535 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.534+0000 7f574d1ea780 1 > prepared multipart upload key=U6E9A5OH4GUW upload=R64ETMYYEVB3 tag=5S6EILIPDDHQ type=write size=3112199 2024-09-12T17:18:12.536 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.536+0000 7f574d1ea780 1 < completed delete operation key=ZGE1860DMGHA tag=PZWSKFQ0IU09 type=del 2024-09-12T17:18:12.538 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.537+0000 7f574d1ea780 1 > prepared operation key=43GV2N9VBBKE tag=ISXAYFPLF1F1 type=write size=939986 2024-09-12T17:18:12.540 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.539+0000 7f574d1ea780 1 < suggested remove operation key=A1TIP3RXHBCZ tag=FY9IVL9OE7BC type=del 2024-09-12T17:18:12.543 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.542+0000 7f574d1ea780 1 > prepared part key=_multipart_8SG7DJO4HWPI.2~EWD23O7XF8ZM.0 size=1048576 2024-09-12T17:18:12.544 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.543+0000 7f574d1ea780 1 > prepared part key=_multipart_8SG7DJO4HWPI.2~EWD23O7XF8ZM.1 size=1048576 2024-09-12T17:18:12.545 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.544+0000 7f574d1ea780 1 > prepared part key=_multipart_8SG7DJO4HWPI.2~EWD23O7XF8ZM.2 size=32888 2024-09-12T17:18:12.545 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.544+0000 7f574d1ea780 1 > prepared multipart upload key=8SG7DJO4HWPI upload=EWD23O7XF8ZM tag=6HXDOJ94B26A type=write size=3178616 2024-09-12T17:18:12.547 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.546+0000 7f574d1ea780 1 < suggested update operation key=ENFNIFHQ3SHW tag=TNGOXT7XIQ3N type=del size=1842222 2024-09-12T17:18:12.549 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.548+0000 7f574d1ea780 1 > prepared operation key=U6E9A5OH4GUW tag=AY0A8XM2W35N type=del size=2964808 2024-09-12T17:18:12.549 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.548+0000 7f574d1ea780 1 < canceled part key=_multipart_RNI86YYLADT0.2~WTY2AT1PWBE6.0 size=280774 2024-09-12T17:18:12.551 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.550+0000 7f574d1ea780 1 < canceled multipart upload key=RNI86YYLADT0 upload=WTY2AT1PWBE6 tag=WN69ZTZMXEUM type=write size=1329350 2024-09-12T17:18:12.552 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.551+0000 7f574d1ea780 1 > prepared operation key=ENFNIFHQ3SHW tag=PYF808YZMZZ2 type=del size=2170906 2024-09-12T17:18:12.552 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.551+0000 7f574d1ea780 1 < canceled part key=_multipart_YXIDO0U18839.2~T1DCLV09V10O.0 size=869966 2024-09-12T17:18:12.554 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.553+0000 7f574d1ea780 1 < canceled multipart upload key=YXIDO0U18839 upload=T1DCLV09V10O tag=C2FIHREXO8J1 type=write size=1918542 2024-09-12T17:18:12.557 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.556+0000 7f574d1ea780 1 > prepared part key=_multipart_YXIDO0U18839.2~KH0FFD9OAZA1.0 size=55935 2024-09-12T17:18:12.557 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.556+0000 7f574d1ea780 1 > prepared multipart upload key=YXIDO0U18839 upload=KH0FFD9OAZA1 tag=FUM8QZSFL7B0 type=write size=1104511 2024-09-12T17:18:12.558 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.557+0000 7f574d1ea780 1 < completed part key=_multipart_54CM8800AT9V.2~0ZAFWC8SAGY0.0 size=1048576 2024-09-12T17:18:12.559 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.558+0000 7f574d1ea780 1 < completed part key=_multipart_54CM8800AT9V.2~0ZAFWC8SAGY0.1 size=1048576 2024-09-12T17:18:12.560 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.559+0000 7f574d1ea780 1 < completed part key=_multipart_54CM8800AT9V.2~0ZAFWC8SAGY0.2 size=966325 2024-09-12T17:18:12.563 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.563+0000 7f574d1ea780 1 < completed multipart upload key=54CM8800AT9V upload=0ZAFWC8SAGY0 tag=DWZ492AUA6NJ type=write size=4112053 2024-09-12T17:18:12.567 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.566+0000 7f574d1ea780 1 > prepared part key=_multipart_SQQMJ61CA0QW.2~OFOMN9T05D3A.0 size=573146 2024-09-12T17:18:12.567 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.566+0000 7f574d1ea780 1 > prepared multipart upload key=SQQMJ61CA0QW upload=OFOMN9T05D3A tag=V91NAIJU1482 type=write size=1621722 2024-09-12T17:18:12.569 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.568+0000 7f574d1ea780 1 < completed part key=_multipart_RWVWJHVZE95H.2~MQL1AQP8S50W.0 size=1048576 2024-09-12T17:18:12.570 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.569+0000 7f574d1ea780 1 < completed part key=_multipart_RWVWJHVZE95H.2~MQL1AQP8S50W.1 size=1048576 2024-09-12T17:18:12.571 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.570+0000 7f574d1ea780 1 < completed part key=_multipart_RWVWJHVZE95H.2~MQL1AQP8S50W.2 size=1015771 2024-09-12T17:18:12.573 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.572+0000 7f574d1ea780 1 < completed multipart upload key=RWVWJHVZE95H upload=MQL1AQP8S50W tag=UGX5OJVC04O5 type=write size=4161499 2024-09-12T17:18:12.575 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.574+0000 7f574d1ea780 1 > prepared part key=_multipart_54CM8800AT9V.2~U37DXJBIYVC2.0 size=487254 2024-09-12T17:18:12.575 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.574+0000 7f574d1ea780 1 > prepared multipart upload key=54CM8800AT9V upload=U37DXJBIYVC2 tag=PD6CMIP7DLAU type=write size=1535830 2024-09-12T17:18:12.576 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.575+0000 7f574d1ea780 1 < completed part key=_multipart_55V137SY4E4P.2~YNJNZE5SCXZ9.0 size=315549 2024-09-12T17:18:12.578 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.578+0000 7f574d1ea780 1 < completed multipart upload key=55V137SY4E4P upload=YNJNZE5SCXZ9 tag=QFSW6D2ERINF type=write size=1364125 2024-09-12T17:18:12.580 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.579+0000 7f574d1ea780 1 > prepared operation key=DH02JGZP64MN tag=52FMR4271VIV type=del size=2749353 2024-09-12T17:18:12.581 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.580+0000 7f574d1ea780 1 < completed delete operation key=54LQ91UMBJAN tag=YP792V7KNWZZ type=del 2024-09-12T17:18:12.582 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.582+0000 7f574d1ea780 1 > prepared operation key=8SG7DJO4HWPI tag=HDYNTKN4BSR1 type=del size=2180086 2024-09-12T17:18:12.584 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.583+0000 7f574d1ea780 1 < completed part key=_multipart_HGZMN894YYC0.2~WU0MQCERELMC.0 size=907949 2024-09-12T17:18:12.586 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.585+0000 7f574d1ea780 1 < completed multipart upload key=HGZMN894YYC0 upload=WU0MQCERELMC tag=C4SH7I29K3J7 type=write size=1956525 2024-09-12T17:18:12.588 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.587+0000 7f574d1ea780 1 > prepared part key=_multipart_RNI86YYLADT0.2~H293FCI0AHJK.0 size=1048576 2024-09-12T17:18:12.589 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.588+0000 7f574d1ea780 1 > prepared part key=_multipart_RNI86YYLADT0.2~H293FCI0AHJK.1 size=342942 2024-09-12T17:18:12.589 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.588+0000 7f574d1ea780 1 > prepared multipart upload key=RNI86YYLADT0 upload=H293FCI0AHJK tag=W88P2EJ2USOG type=write size=2440094 2024-09-12T17:18:12.590 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.590+0000 7f574d1ea780 1 < completed delete operation key=SQQMJ61CA0QW tag=9J1C5CWZB1UO type=del 2024-09-12T17:18:12.592 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.591+0000 7f574d1ea780 1 > prepared operation key=C9IYR9CET1I8 tag=YU7RB7GD4AU6 type=del size=2693858 2024-09-12T17:18:12.593 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.592+0000 7f574d1ea780 1 < completed part key=_multipart_YXIDO0U18839.2~SL0560CATKHG.0 size=1048576 2024-09-12T17:18:12.594 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.593+0000 7f574d1ea780 1 < completed part key=_multipart_YXIDO0U18839.2~SL0560CATKHG.1 size=789721 2024-09-12T17:18:12.596 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.595+0000 7f574d1ea780 1 < completed multipart upload key=YXIDO0U18839 upload=SL0560CATKHG tag=DRY3BQ1IJFBB type=write size=2886873 2024-09-12T17:18:12.597 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.596+0000 7f574d1ea780 1 > prepared operation key=TIKBUXFPVTN1 tag=W503UYJFXKF5 type=write size=443061 2024-09-12T17:18:12.598 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.598+0000 7f574d1ea780 1 < completed part key=_multipart_UTCKL1F42X8A.2~8914RIIE7QXD.0 size=1048576 2024-09-12T17:18:12.600 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.599+0000 7f574d1ea780 1 < completed part key=_multipart_UTCKL1F42X8A.2~8914RIIE7QXD.1 size=1048576 2024-09-12T17:18:12.601 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.600+0000 7f574d1ea780 1 < completed part key=_multipart_UTCKL1F42X8A.2~8914RIIE7QXD.2 size=1018321 2024-09-12T17:18:12.603 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.602+0000 7f574d1ea780 1 < completed multipart upload key=UTCKL1F42X8A upload=8914RIIE7QXD tag=C3I4DC2R3V04 type=write size=4164049 2024-09-12T17:18:12.604 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.603+0000 7f574d1ea780 1 > prepared operation key=R00F69ON5P6Z tag=LM6XYW2YNE0I type=del size=1371031 2024-09-12T17:18:12.607 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.606+0000 7f574d1ea780 1 < suggested update operation key=U6E9A5OH4GUW tag=0W6YV1YMRURK type=del size=2577383 2024-09-12T17:18:12.608 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.607+0000 7f574d1ea780 1 > prepared operation key=Q2Q3B1J3DAVD tag=0HV3O3BY7122 type=del size=2180775 2024-09-12T17:18:12.609 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.608+0000 7f574d1ea780 1 < completed part key=_multipart_8SG7DJO4HWPI.2~MX95EWT621JR.0 size=588149 2024-09-12T17:18:12.611 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.610+0000 7f574d1ea780 1 < completed multipart upload key=8SG7DJO4HWPI upload=MX95EWT621JR tag=T4FH39OOAX5H type=write size=1636725 2024-09-12T17:18:12.613 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.612+0000 7f574d1ea780 1 > prepared operation key=55V137SY4E4P tag=OQMMEXSMNXAY type=del size=2707610 2024-09-12T17:18:12.614 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.613+0000 7f574d1ea780 1 < completed part key=_multipart_U6E9A5OH4GUW.2~R64ETMYYEVB3.0 size=1048576 2024-09-12T17:18:12.615 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.614+0000 7f574d1ea780 1 < completed part key=_multipart_U6E9A5OH4GUW.2~R64ETMYYEVB3.1 size=1015047 2024-09-12T17:18:12.617 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.616+0000 7f574d1ea780 1 < completed multipart upload key=U6E9A5OH4GUW upload=R64ETMYYEVB3 tag=5S6EILIPDDHQ type=write size=3112199 2024-09-12T17:18:12.618 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.617+0000 7f574d1ea780 1 > prepared operation key=DH02JGZP64MN tag=02ZZGTXWTOFA type=write size=738511 2024-09-12T17:18:12.620 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.619+0000 7f574d1ea780 1 < completed write operation key=43GV2N9VBBKE tag=ISXAYFPLF1F1 type=write size=939986 2024-09-12T17:18:12.621 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.621+0000 7f574d1ea780 1 > prepared operation key=R00F69ON5P6Z tag=X2XPKR0DHZO0 type=del size=2649275 2024-09-12T17:18:12.623 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.622+0000 7f574d1ea780 1 < completed part key=_multipart_8SG7DJO4HWPI.2~EWD23O7XF8ZM.0 size=1048576 2024-09-12T17:18:12.624 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.623+0000 7f574d1ea780 1 < completed part key=_multipart_8SG7DJO4HWPI.2~EWD23O7XF8ZM.1 size=1048576 2024-09-12T17:18:12.625 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.624+0000 7f574d1ea780 1 < completed part key=_multipart_8SG7DJO4HWPI.2~EWD23O7XF8ZM.2 size=32888 2024-09-12T17:18:12.627 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.626+0000 7f574d1ea780 1 < completed multipart upload key=8SG7DJO4HWPI upload=EWD23O7XF8ZM tag=6HXDOJ94B26A type=write size=3178616 2024-09-12T17:18:12.629 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.628+0000 7f574d1ea780 1 > prepared part key=_multipart_GEGOEB05R0PK.2~HBZDSMNAW6OS.0 size=1048576 2024-09-12T17:18:12.630 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.629+0000 7f574d1ea780 1 > prepared part key=_multipart_GEGOEB05R0PK.2~HBZDSMNAW6OS.1 size=141226 2024-09-12T17:18:12.630 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.629+0000 7f574d1ea780 1 > prepared multipart upload key=GEGOEB05R0PK upload=HBZDSMNAW6OS tag=TU2KAT0SZFJZ type=write size=2238378 2024-09-12T17:18:12.631 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.630+0000 7f574d1ea780 -1 < failed to complete operation key=U6E9A5OH4GUW tag=AY0A8XM2W35N type=del size=2964808: (22) Invalid argument 2024-09-12T17:18:12.633 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.632+0000 7f574d1ea780 1 > prepared part key=_multipart_QXD8UG2K4STQ.2~QFHRVVBKXDFO.0 size=1048576 2024-09-12T17:18:12.634 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.633+0000 7f574d1ea780 1 > prepared part key=_multipart_QXD8UG2K4STQ.2~QFHRVVBKXDFO.1 size=1048576 2024-09-12T17:18:12.635 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.634+0000 7f574d1ea780 1 > prepared part key=_multipart_QXD8UG2K4STQ.2~QFHRVVBKXDFO.2 size=584826 2024-09-12T17:18:12.635 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.634+0000 7f574d1ea780 1 > prepared multipart upload key=QXD8UG2K4STQ upload=QFHRVVBKXDFO tag=OUWIVX31K1KT type=write size=3730554 2024-09-12T17:18:12.636 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.636+0000 7f574d1ea780 1 < completed delete operation key=ENFNIFHQ3SHW tag=PYF808YZMZZ2 type=del 2024-09-12T17:18:12.638 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.637+0000 7f574d1ea780 1 > prepared operation key=UFKM4I8RMT0W tag=F90607D18YOX type=del size=2832833 2024-09-12T17:18:12.639 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.638+0000 7f574d1ea780 1 < completed part key=_multipart_YXIDO0U18839.2~KH0FFD9OAZA1.0 size=55935 2024-09-12T17:18:12.641 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.640+0000 7f574d1ea780 1 < completed multipart upload key=YXIDO0U18839 upload=KH0FFD9OAZA1 tag=FUM8QZSFL7B0 type=write size=1104511 2024-09-12T17:18:12.643 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.643+0000 7f574d1ea780 1 > prepared part key=_multipart_DH02JGZP64MN.2~W85GE1S1NXEM.0 size=1031994 2024-09-12T17:18:12.643 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.643+0000 7f574d1ea780 1 > prepared multipart upload key=DH02JGZP64MN upload=W85GE1S1NXEM tag=RKREARB3K6BF type=write size=2080570 2024-09-12T17:18:12.645 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.644+0000 7f574d1ea780 1 < completed part key=_multipart_SQQMJ61CA0QW.2~OFOMN9T05D3A.0 size=573146 2024-09-12T17:18:12.647 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.646+0000 7f574d1ea780 1 < completed multipart upload key=SQQMJ61CA0QW upload=OFOMN9T05D3A tag=V91NAIJU1482 type=write size=1621722 2024-09-12T17:18:12.648 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.648+0000 7f574d1ea780 1 > prepared operation key=OI51GO639LFK tag=OZDY7RVNSDD5 type=del size=2817747 2024-09-12T17:18:12.650 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.649+0000 7f574d1ea780 1 < completed part key=_multipart_54CM8800AT9V.2~U37DXJBIYVC2.0 size=487254 2024-09-12T17:18:12.652 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.651+0000 7f574d1ea780 1 < completed multipart upload key=54CM8800AT9V upload=U37DXJBIYVC2 tag=PD6CMIP7DLAU type=write size=1535830 2024-09-12T17:18:12.653 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.652+0000 7f574d1ea780 1 > prepared operation key=OI51GO639LFK tag=1PHMHM3N7WYW type=del size=1722718 2024-09-12T17:18:12.654 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.654+0000 7f574d1ea780 1 < completed delete operation key=DH02JGZP64MN tag=52FMR4271VIV type=del 2024-09-12T17:18:12.657 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.656+0000 7f574d1ea780 1 > prepared part key=_multipart_8SG7DJO4HWPI.2~PHMNOYTFKGDI.0 size=1048576 2024-09-12T17:18:12.657 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.657+0000 7f574d1ea780 1 > prepared part key=_multipart_8SG7DJO4HWPI.2~PHMNOYTFKGDI.1 size=102220 2024-09-12T17:18:12.658 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.657+0000 7f574d1ea780 1 > prepared multipart upload key=8SG7DJO4HWPI upload=PHMNOYTFKGDI tag=L79TSIZN32WN type=write size=2199372 2024-09-12T17:18:12.659 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.658+0000 7f574d1ea780 1 < completed delete operation key=8SG7DJO4HWPI tag=HDYNTKN4BSR1 type=del 2024-09-12T17:18:12.661 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.660+0000 7f574d1ea780 1 > prepared part key=_multipart_TIKBUXFPVTN1.2~25H12B3KLLA8.0 size=1034804 2024-09-12T17:18:12.661 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.660+0000 7f574d1ea780 1 > prepared multipart upload key=TIKBUXFPVTN1 upload=25H12B3KLLA8 tag=P4T6HZBFJW2C type=write size=2083380 2024-09-12T17:18:12.661 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.660+0000 7f574d1ea780 1 < canceled part key=_multipart_RNI86YYLADT0.2~H293FCI0AHJK.0 size=1048576 2024-09-12T17:18:12.662 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.661+0000 7f574d1ea780 1 < completed part key=_multipart_RNI86YYLADT0.2~H293FCI0AHJK.1 size=342942 2024-09-12T17:18:12.664 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.663+0000 7f574d1ea780 1 < canceled multipart upload key=RNI86YYLADT0 upload=H293FCI0AHJK tag=W88P2EJ2USOG type=write size=2440094 2024-09-12T17:18:12.666 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.666+0000 7f574d1ea780 1 > prepared part key=_multipart_YXIDO0U18839.2~XSRGJUI9ZGOE.0 size=988348 2024-09-12T17:18:12.667 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.666+0000 7f574d1ea780 1 > prepared multipart upload key=YXIDO0U18839 upload=XSRGJUI9ZGOE tag=SXV89CPQNWI0 type=write size=2036924 2024-09-12T17:18:12.669 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.668+0000 7f574d1ea780 1 < suggested remove operation key=C9IYR9CET1I8 tag=YU7RB7GD4AU6 type=del 2024-09-12T17:18:12.670 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.669+0000 7f574d1ea780 1 > prepared operation key=55V137SY4E4P tag=BVO81LEOERPX type=del size=2890906 2024-09-12T17:18:12.671 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.671+0000 7f574d1ea780 1 < completed write operation key=TIKBUXFPVTN1 tag=W503UYJFXKF5 type=write size=443061 2024-09-12T17:18:12.673 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.672+0000 7f574d1ea780 1 > prepared operation key=Q2Q3B1J3DAVD tag=ESC3MLJCE7N4 type=del size=2919014 2024-09-12T17:18:12.674 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.673+0000 7f574d1ea780 1 < completed delete operation key=R00F69ON5P6Z tag=LM6XYW2YNE0I type=del 2024-09-12T17:18:12.676 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.675+0000 7f574d1ea780 1 > prepared part key=_multipart_8VW3XCUHLF2L.2~WGRJZWPDJRPC.0 size=1048576 2024-09-12T17:18:12.677 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.676+0000 7f574d1ea780 1 > prepared part key=_multipart_8VW3XCUHLF2L.2~WGRJZWPDJRPC.1 size=1048576 2024-09-12T17:18:12.678 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.677+0000 7f574d1ea780 1 > prepared part key=_multipart_8VW3XCUHLF2L.2~WGRJZWPDJRPC.2 size=5968 2024-09-12T17:18:12.678 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.677+0000 7f574d1ea780 1 > prepared multipart upload key=8VW3XCUHLF2L upload=WGRJZWPDJRPC tag=9QXSOT1JGZ1Y type=write size=3151696 2024-09-12T17:18:12.679 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.679+0000 7f574d1ea780 1 < completed delete operation key=Q2Q3B1J3DAVD tag=0HV3O3BY7122 type=del 2024-09-12T17:18:12.682 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.682+0000 7f574d1ea780 1 > prepared part key=_multipart_HFWA7DNUMWF2.2~5A7OJ032L1OT.0 size=760135 2024-09-12T17:18:12.683 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.682+0000 7f574d1ea780 1 > prepared multipart upload key=HFWA7DNUMWF2 upload=5A7OJ032L1OT tag=FPY9OM6QUSGU type=write size=1808711 2024-09-12T17:18:12.684 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.683+0000 7f574d1ea780 1 < completed delete operation key=55V137SY4E4P tag=OQMMEXSMNXAY type=del 2024-09-12T17:18:12.686 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.685+0000 7f574d1ea780 1 > prepared part key=_multipart_54LQ91UMBJAN.2~OQFAEHWQZULL.0 size=709396 2024-09-12T17:18:12.686 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.685+0000 7f574d1ea780 1 > prepared multipart upload key=54LQ91UMBJAN upload=OQFAEHWQZULL tag=8FZ8FH9TP2SQ type=write size=1757972 2024-09-12T17:18:12.687 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.686+0000 7f574d1ea780 1 < completed write operation key=DH02JGZP64MN tag=02ZZGTXWTOFA type=write size=738511 2024-09-12T17:18:12.688 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.688+0000 7f574d1ea780 1 > prepared operation key=OI51GO639LFK tag=UUH2K9CCG18F type=write size=12981 2024-09-12T17:18:12.690 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.689+0000 7f574d1ea780 1 < completed delete operation key=R00F69ON5P6Z tag=X2XPKR0DHZO0 type=del 2024-09-12T17:18:12.691 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.690+0000 7f574d1ea780 1 > prepared operation key=UTCKL1F42X8A tag=2M2O6IEITH7B type=del size=2220875 2024-09-12T17:18:12.692 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.692+0000 7f574d1ea780 1 < completed part key=_multipart_GEGOEB05R0PK.2~HBZDSMNAW6OS.0 size=1048576 2024-09-12T17:18:12.693 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.693+0000 7f574d1ea780 1 < completed part key=_multipart_GEGOEB05R0PK.2~HBZDSMNAW6OS.1 size=141226 2024-09-12T17:18:12.695 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.695+0000 7f574d1ea780 1 < completed multipart upload key=GEGOEB05R0PK upload=HBZDSMNAW6OS tag=TU2KAT0SZFJZ type=write size=2238378 2024-09-12T17:18:12.697 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.697+0000 7f574d1ea780 1 > prepared part key=_multipart_R00F69ON5P6Z.2~KNOV2TKOJ84O.0 size=1048576 2024-09-12T17:18:12.698 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.698+0000 7f574d1ea780 1 > prepared part key=_multipart_R00F69ON5P6Z.2~KNOV2TKOJ84O.1 size=1048576 2024-09-12T17:18:12.699 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.699+0000 7f574d1ea780 1 > prepared part key=_multipart_R00F69ON5P6Z.2~KNOV2TKOJ84O.2 size=461277 2024-09-12T17:18:12.699 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.699+0000 7f574d1ea780 1 > prepared multipart upload key=R00F69ON5P6Z upload=KNOV2TKOJ84O tag=TS9ASTOK50TU type=write size=3607005 2024-09-12T17:18:12.701 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.700+0000 7f574d1ea780 1 < completed part key=_multipart_QXD8UG2K4STQ.2~QFHRVVBKXDFO.0 size=1048576 2024-09-12T17:18:12.702 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.701+0000 7f574d1ea780 1 < completed part key=_multipart_QXD8UG2K4STQ.2~QFHRVVBKXDFO.1 size=1048576 2024-09-12T17:18:12.702 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.701+0000 7f574d1ea780 1 < canceled part key=_multipart_QXD8UG2K4STQ.2~QFHRVVBKXDFO.2 size=584826 2024-09-12T17:18:12.704 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.703+0000 7f574d1ea780 1 < canceled multipart upload key=QXD8UG2K4STQ upload=QFHRVVBKXDFO tag=OUWIVX31K1KT type=write size=3730554 2024-09-12T17:18:12.705 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.704+0000 7f574d1ea780 1 > prepared operation key=7BX38Q7723EB tag=JXO591OD1F20 type=del size=953130 2024-09-12T17:18:12.706 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.705+0000 7f574d1ea780 1 < completed delete operation key=UFKM4I8RMT0W tag=F90607D18YOX type=del 2024-09-12T17:18:12.707 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.706+0000 7f574d1ea780 1 > prepared operation key=RNI86YYLADT0 tag=UVH4AN4W5PG7 type=del size=2049451 2024-09-12T17:18:12.709 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.708+0000 7f574d1ea780 1 < completed part key=_multipart_DH02JGZP64MN.2~W85GE1S1NXEM.0 size=1031994 2024-09-12T17:18:12.711 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.710+0000 7f574d1ea780 1 < completed multipart upload key=DH02JGZP64MN upload=W85GE1S1NXEM tag=RKREARB3K6BF type=write size=2080570 2024-09-12T17:18:12.713 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.712+0000 7f574d1ea780 1 > prepared part key=_multipart_8VW3XCUHLF2L.2~V0VRUZPEA596.0 size=604524 2024-09-12T17:18:12.713 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.712+0000 7f574d1ea780 1 > prepared multipart upload key=8VW3XCUHLF2L upload=V0VRUZPEA596 tag=X4GW9CHYONKG type=write size=1653100 2024-09-12T17:18:12.715 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.714+0000 7f574d1ea780 1 < suggested remove operation key=OI51GO639LFK tag=OZDY7RVNSDD5 type=del 2024-09-12T17:18:12.716 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.716+0000 7f574d1ea780 1 > prepared operation key=8SG7DJO4HWPI tag=QT4MLHWRL0SE type=del size=3312934 2024-09-12T17:18:12.718 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.717+0000 7f574d1ea780 -1 < failed to complete operation key=OI51GO639LFK tag=1PHMHM3N7WYW type=del size=1722718: (22) Invalid argument 2024-09-12T17:18:12.719 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.718+0000 7f574d1ea780 1 > prepared operation key=C9IYR9CET1I8 tag=GIXK5N3PASV6 type=del size=2798261 2024-09-12T17:18:12.719 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.718+0000 7f574d1ea780 1 < canceled part key=_multipart_8SG7DJO4HWPI.2~PHMNOYTFKGDI.0 size=1048576 2024-09-12T17:18:12.720 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.719+0000 7f574d1ea780 1 < completed part key=_multipart_8SG7DJO4HWPI.2~PHMNOYTFKGDI.1 size=102220 2024-09-12T17:18:12.722 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.721+0000 7f574d1ea780 1 < canceled multipart upload key=8SG7DJO4HWPI upload=PHMNOYTFKGDI tag=L79TSIZN32WN type=write size=2199372 2024-09-12T17:18:12.723 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.723+0000 7f574d1ea780 1 > prepared operation key=SQQMJ61CA0QW tag=5TDKIR1PHSRE type=del size=2929533 2024-09-12T17:18:12.724 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.723+0000 7f574d1ea780 1 < canceled part key=_multipart_TIKBUXFPVTN1.2~25H12B3KLLA8.0 size=1034804 2024-09-12T17:18:12.729 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.725+0000 7f574d1ea780 1 < canceled multipart upload key=TIKBUXFPVTN1 upload=25H12B3KLLA8 tag=P4T6HZBFJW2C type=write size=2083380 2024-09-12T17:18:12.729 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.726+0000 7f574d1ea780 1 > prepared operation key=VWWA5IB0L4N1 tag=0SRSOM82KUN7 type=del size=3287243 2024-09-12T17:18:12.729 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.727+0000 7f574d1ea780 1 < completed part key=_multipart_YXIDO0U18839.2~XSRGJUI9ZGOE.0 size=988348 2024-09-12T17:18:12.730 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.729+0000 7f574d1ea780 1 < completed multipart upload key=YXIDO0U18839 upload=XSRGJUI9ZGOE tag=SXV89CPQNWI0 type=write size=2036924 2024-09-12T17:18:12.733 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.732+0000 7f574d1ea780 1 > prepared part key=_multipart_UFKM4I8RMT0W.2~UL6ZBBWG5BRV.0 size=1048576 2024-09-12T17:18:12.733 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.733+0000 7f574d1ea780 1 > prepared part key=_multipart_UFKM4I8RMT0W.2~UL6ZBBWG5BRV.1 size=603909 2024-09-12T17:18:12.734 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.733+0000 7f574d1ea780 1 > prepared multipart upload key=UFKM4I8RMT0W upload=UL6ZBBWG5BRV tag=3E7YMG5Z58EJ type=write size=2701061 2024-09-12T17:18:12.736 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.735+0000 7f574d1ea780 1 < suggested remove operation key=55V137SY4E4P tag=BVO81LEOERPX type=del 2024-09-12T17:18:12.737 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.737+0000 7f574d1ea780 1 > prepared operation key=8VW3XCUHLF2L tag=UTJJGLYE9S5M type=write size=41469 2024-09-12T17:18:12.739 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.738+0000 7f574d1ea780 1 < completed delete operation key=Q2Q3B1J3DAVD tag=ESC3MLJCE7N4 type=del 2024-09-12T17:18:12.740 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.739+0000 7f574d1ea780 1 > prepared operation key=VWWA5IB0L4N1 tag=JHPUMCZV7HD4 type=del size=900014 2024-09-12T17:18:12.741 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.740+0000 7f574d1ea780 1 < completed part key=_multipart_8VW3XCUHLF2L.2~WGRJZWPDJRPC.0 size=1048576 2024-09-12T17:18:12.742 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.741+0000 7f574d1ea780 1 < completed part key=_multipart_8VW3XCUHLF2L.2~WGRJZWPDJRPC.1 size=1048576 2024-09-12T17:18:12.743 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.742+0000 7f574d1ea780 1 < completed part key=_multipart_8VW3XCUHLF2L.2~WGRJZWPDJRPC.2 size=5968 2024-09-12T17:18:12.745 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.745+0000 7f574d1ea780 1 < completed multipart upload key=8VW3XCUHLF2L upload=WGRJZWPDJRPC tag=9QXSOT1JGZ1Y type=write size=3151696 2024-09-12T17:18:12.748 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.747+0000 7f574d1ea780 1 > prepared part key=_multipart_43GV2N9VBBKE.2~VHW1LU2DTAOO.0 size=114837 2024-09-12T17:18:12.748 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.747+0000 7f574d1ea780 1 > prepared multipart upload key=43GV2N9VBBKE upload=VHW1LU2DTAOO tag=9M7K1LLUOI12 type=write size=1163413 2024-09-12T17:18:12.749 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.748+0000 7f574d1ea780 1 < completed part key=_multipart_HFWA7DNUMWF2.2~5A7OJ032L1OT.0 size=760135 2024-09-12T17:18:12.751 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.750+0000 7f574d1ea780 1 < completed multipart upload key=HFWA7DNUMWF2 upload=5A7OJ032L1OT tag=FPY9OM6QUSGU type=write size=1808711 2024-09-12T17:18:12.752 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.751+0000 7f574d1ea780 1 > prepared operation key=55JI541K1WP2 tag=NBJLIPEEOE7R type=del size=3721296 2024-09-12T17:18:12.753 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.753+0000 7f574d1ea780 1 < completed part key=_multipart_54LQ91UMBJAN.2~OQFAEHWQZULL.0 size=709396 2024-09-12T17:18:12.755 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.755+0000 7f574d1ea780 1 < completed multipart upload key=54LQ91UMBJAN upload=OQFAEHWQZULL tag=8FZ8FH9TP2SQ type=write size=1757972 2024-09-12T17:18:12.757 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.756+0000 7f574d1ea780 1 > prepared operation key=ZGE1860DMGHA tag=CCTG7G5ODCS3 type=del size=2743345 2024-09-12T17:18:12.758 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.757+0000 7f574d1ea780 -1 < failed to complete operation key=OI51GO639LFK tag=UUH2K9CCG18F type=write size=12981: (22) Invalid argument 2024-09-12T17:18:12.759 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.758+0000 7f574d1ea780 1 > prepared operation key=54LQ91UMBJAN tag=1PBAJRCGG112 type=write size=717691 2024-09-12T17:18:12.762 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.761+0000 7f574d1ea780 1 < suggested remove operation key=UTCKL1F42X8A tag=2M2O6IEITH7B type=del 2024-09-12T17:18:12.763 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.762+0000 7f574d1ea780 1 > prepared operation key=UTCKL1F42X8A tag=1UMITAGKOBY2 type=del size=401302 2024-09-12T17:18:12.764 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.763+0000 7f574d1ea780 1 < completed part key=_multipart_R00F69ON5P6Z.2~KNOV2TKOJ84O.0 size=1048576 2024-09-12T17:18:12.764 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.763+0000 7f574d1ea780 1 < canceled part key=_multipart_R00F69ON5P6Z.2~KNOV2TKOJ84O.1 size=1048576 2024-09-12T17:18:12.765 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.764+0000 7f574d1ea780 1 < completed part key=_multipart_R00F69ON5P6Z.2~KNOV2TKOJ84O.2 size=461277 2024-09-12T17:18:12.767 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.766+0000 7f574d1ea780 1 < canceled multipart upload key=R00F69ON5P6Z upload=KNOV2TKOJ84O tag=TS9ASTOK50TU type=write size=3607005 2024-09-12T17:18:12.768 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.767+0000 7f574d1ea780 1 > prepared operation key=RWVWJHVZE95H tag=C1RRXF9PS1HJ type=write size=430123 2024-09-12T17:18:12.771 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.770+0000 7f574d1ea780 1 < suggested update operation key=7BX38Q7723EB tag=JXO591OD1F20 type=del size=953130 2024-09-12T17:18:12.773 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.772+0000 7f574d1ea780 1 > prepared part key=_multipart_ZGH8XC39FGTC.2~IYXCWPFKR676.0 size=1048576 2024-09-12T17:18:12.774 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.773+0000 7f574d1ea780 1 > prepared part key=_multipart_ZGH8XC39FGTC.2~IYXCWPFKR676.1 size=1048576 2024-09-12T17:18:12.775 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.774+0000 7f574d1ea780 1 > prepared part key=_multipart_ZGH8XC39FGTC.2~IYXCWPFKR676.2 size=525674 2024-09-12T17:18:12.775 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.774+0000 7f574d1ea780 1 > prepared multipart upload key=ZGH8XC39FGTC upload=IYXCWPFKR676 tag=3FNQ2Q6D7G5K type=write size=3671402 2024-09-12T17:18:12.776 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.775+0000 7f574d1ea780 1 < completed delete operation key=RNI86YYLADT0 tag=UVH4AN4W5PG7 type=del 2024-09-12T17:18:12.777 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.777+0000 7f574d1ea780 1 > prepared operation key=ZGE1860DMGHA tag=GG0CIITQTZ9R type=del size=3922974 2024-09-12T17:18:12.778 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.777+0000 7f574d1ea780 1 < canceled part key=_multipart_8VW3XCUHLF2L.2~V0VRUZPEA596.0 size=604524 2024-09-12T17:18:12.780 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.779+0000 7f574d1ea780 1 < canceled multipart upload key=8VW3XCUHLF2L upload=V0VRUZPEA596 tag=X4GW9CHYONKG type=write size=1653100 2024-09-12T17:18:12.781 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.780+0000 7f574d1ea780 1 > prepared operation key=43GV2N9VBBKE tag=5H2Y4RLEDMRO type=del size=1004397 2024-09-12T17:18:12.782 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.782+0000 7f574d1ea780 1 < completed delete operation key=8SG7DJO4HWPI tag=QT4MLHWRL0SE type=del 2024-09-12T17:18:12.784 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.783+0000 7f574d1ea780 1 > prepared operation key=UFKM4I8RMT0W tag=K0D34KE5T59U type=del size=3454765 2024-09-12T17:18:12.785 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.784+0000 7f574d1ea780 1 < completed delete operation key=C9IYR9CET1I8 tag=GIXK5N3PASV6 type=del 2024-09-12T17:18:12.786 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.785+0000 7f574d1ea780 1 > prepared operation key=QXD8UG2K4STQ tag=RMM656AMC6FL type=del size=2819411 2024-09-12T17:18:12.787 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.787+0000 7f574d1ea780 1 < completed delete operation key=SQQMJ61CA0QW tag=5TDKIR1PHSRE type=del 2024-09-12T17:18:12.789 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.788+0000 7f574d1ea780 1 > prepared operation key=DH02JGZP64MN tag=1YF10B0NL3XV type=del size=1454874 2024-09-12T17:18:12.790 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.789+0000 7f574d1ea780 1 < completed delete operation key=VWWA5IB0L4N1 tag=0SRSOM82KUN7 type=del 2024-09-12T17:18:12.792 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.791+0000 7f574d1ea780 1 > prepared part key=_multipart_QXD8UG2K4STQ.2~HU9O7CZM4G5W.0 size=577918 2024-09-12T17:18:12.792 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.791+0000 7f574d1ea780 1 > prepared multipart upload key=QXD8UG2K4STQ upload=HU9O7CZM4G5W tag=O83CZVD1WGHU type=write size=1626494 2024-09-12T17:18:12.793 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.793+0000 7f574d1ea780 1 < completed part key=_multipart_UFKM4I8RMT0W.2~UL6ZBBWG5BRV.0 size=1048576 2024-09-12T17:18:12.794 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.794+0000 7f574d1ea780 1 < completed part key=_multipart_UFKM4I8RMT0W.2~UL6ZBBWG5BRV.1 size=603909 2024-09-12T17:18:12.797 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.796+0000 7f574d1ea780 1 < completed multipart upload key=UFKM4I8RMT0W upload=UL6ZBBWG5BRV tag=3E7YMG5Z58EJ type=write size=2701061 2024-09-12T17:18:12.799 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.798+0000 7f574d1ea780 1 > prepared operation key=Q2Q3B1J3DAVD tag=L4WNO9LRDD39 type=del size=4190520 2024-09-12T17:18:12.801 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.800+0000 7f574d1ea780 1 < canceled operation key=8VW3XCUHLF2L tag=UTJJGLYE9S5M type=write size=41469 2024-09-12T17:18:12.803 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.803+0000 7f574d1ea780 1 > prepared part key=_multipart_54LQ91UMBJAN.2~ZPXEVD6TIYSH.0 size=1048576 2024-09-12T17:18:12.804 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.804+0000 7f574d1ea780 1 > prepared part key=_multipart_54LQ91UMBJAN.2~ZPXEVD6TIYSH.1 size=46607 2024-09-12T17:18:12.805 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.804+0000 7f574d1ea780 1 > prepared multipart upload key=54LQ91UMBJAN upload=ZPXEVD6TIYSH tag=715RM4T6GIDG type=write size=2143759 2024-09-12T17:18:12.806 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.805+0000 7f574d1ea780 1 < completed delete operation key=VWWA5IB0L4N1 tag=JHPUMCZV7HD4 type=del 2024-09-12T17:18:12.808 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.808+0000 7f574d1ea780 1 > prepared part key=_multipart_55V137SY4E4P.2~W9367UVFXGXF.0 size=875783 2024-09-12T17:18:12.809 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.808+0000 7f574d1ea780 1 > prepared multipart upload key=55V137SY4E4P upload=W9367UVFXGXF tag=YS6RUCCSKANP type=write size=1924359 2024-09-12T17:18:12.809 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.808+0000 7f574d1ea780 1 < canceled part key=_multipart_43GV2N9VBBKE.2~VHW1LU2DTAOO.0 size=114837 2024-09-12T17:18:12.811 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.810+0000 7f574d1ea780 1 < canceled multipart upload key=43GV2N9VBBKE upload=VHW1LU2DTAOO tag=9M7K1LLUOI12 type=write size=1163413 2024-09-12T17:18:12.814 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.813+0000 7f574d1ea780 1 > prepared part key=_multipart_RNI86YYLADT0.2~QTKD3MGTAIDF.0 size=1048576 2024-09-12T17:18:12.815 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.814+0000 7f574d1ea780 1 > prepared part key=_multipart_RNI86YYLADT0.2~QTKD3MGTAIDF.1 size=233446 2024-09-12T17:18:12.815 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.814+0000 7f574d1ea780 1 > prepared multipart upload key=RNI86YYLADT0 upload=QTKD3MGTAIDF tag=6UZAA3ZB1ZL8 type=write size=2330598 2024-09-12T17:18:12.816 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.815+0000 7f574d1ea780 1 < completed delete operation key=55JI541K1WP2 tag=NBJLIPEEOE7R type=del 2024-09-12T17:18:12.819 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.818+0000 7f574d1ea780 1 > prepared part key=_multipart_43GV2N9VBBKE.2~K8X1A23BZE9T.0 size=1048576 2024-09-12T17:18:12.820 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.819+0000 7f574d1ea780 1 > prepared part key=_multipart_43GV2N9VBBKE.2~K8X1A23BZE9T.1 size=202161 2024-09-12T17:18:12.820 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.819+0000 7f574d1ea780 1 > prepared multipart upload key=43GV2N9VBBKE upload=K8X1A23BZE9T tag=MUP5NBK3T0TG type=write size=2299313 2024-09-12T17:18:12.821 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.820+0000 7f574d1ea780 1 < completed delete operation key=ZGE1860DMGHA tag=CCTG7G5ODCS3 type=del 2024-09-12T17:18:12.822 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.821+0000 7f574d1ea780 1 > prepared operation key=A1TIP3RXHBCZ tag=TWZVXBAF6W3J type=del size=3736046 2024-09-12T17:18:12.823 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.823+0000 7f574d1ea780 1 < completed write operation key=54LQ91UMBJAN tag=1PBAJRCGG112 type=write size=717691 2024-09-12T17:18:12.825 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.824+0000 7f574d1ea780 1 > prepared operation key=QXD8UG2K4STQ tag=TOKR1JD31AJH type=write size=1002063 2024-09-12T17:18:12.826 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.825+0000 7f574d1ea780 1 < completed delete operation key=UTCKL1F42X8A tag=1UMITAGKOBY2 type=del 2024-09-12T17:18:12.828 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.828+0000 7f574d1ea780 1 > prepared part key=_multipart_C9IYR9CET1I8.2~PUJZD8UO9A8N.0 size=1048576 2024-09-12T17:18:12.829 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.829+0000 7f574d1ea780 1 > prepared part key=_multipart_C9IYR9CET1I8.2~PUJZD8UO9A8N.1 size=1048576 2024-09-12T17:18:12.830 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.830+0000 7f574d1ea780 1 > prepared part key=_multipart_C9IYR9CET1I8.2~PUJZD8UO9A8N.2 size=480823 2024-09-12T17:18:12.830 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.830+0000 7f574d1ea780 1 > prepared multipart upload key=C9IYR9CET1I8 upload=PUJZD8UO9A8N tag=FMGF62ASIRQF type=write size=3626551 2024-09-12T17:18:12.831 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.831+0000 7f574d1ea780 1 < completed write operation key=RWVWJHVZE95H tag=C1RRXF9PS1HJ type=write size=430123 2024-09-12T17:18:12.834 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.833+0000 7f574d1ea780 1 > prepared part key=_multipart_RWVWJHVZE95H.2~EDZ69WQYYC2K.0 size=1048576 2024-09-12T17:18:12.835 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.834+0000 7f574d1ea780 1 > prepared part key=_multipart_RWVWJHVZE95H.2~EDZ69WQYYC2K.1 size=1048576 2024-09-12T17:18:12.836 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.835+0000 7f574d1ea780 1 > prepared part key=_multipart_RWVWJHVZE95H.2~EDZ69WQYYC2K.2 size=100085 2024-09-12T17:18:12.836 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.835+0000 7f574d1ea780 1 > prepared multipart upload key=RWVWJHVZE95H upload=EDZ69WQYYC2K tag=AFMHVB4HTZM6 type=write size=3245813 2024-09-12T17:18:12.838 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.837+0000 7f574d1ea780 1 < completed part key=_multipart_ZGH8XC39FGTC.2~IYXCWPFKR676.0 size=1048576 2024-09-12T17:18:12.839 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.838+0000 7f574d1ea780 1 < completed part key=_multipart_ZGH8XC39FGTC.2~IYXCWPFKR676.1 size=1048576 2024-09-12T17:18:12.841 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.839+0000 7f574d1ea780 1 < completed part key=_multipart_ZGH8XC39FGTC.2~IYXCWPFKR676.2 size=525674 2024-09-12T17:18:12.842 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.841+0000 7f574d1ea780 1 < completed multipart upload key=ZGH8XC39FGTC upload=IYXCWPFKR676 tag=3FNQ2Q6D7G5K type=write size=3671402 2024-09-12T17:18:12.844 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.843+0000 7f574d1ea780 1 > prepared operation key=RNI86YYLADT0 tag=3PGYYSZ8IAU3 type=del size=1362136 2024-09-12T17:18:12.845 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.844+0000 7f574d1ea780 1 < completed delete operation key=ZGE1860DMGHA tag=GG0CIITQTZ9R type=del 2024-09-12T17:18:12.847 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.846+0000 7f574d1ea780 1 > prepared operation key=A1TIP3RXHBCZ tag=BT5X3LDITVZY type=del size=503919 2024-09-12T17:18:12.848 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.847+0000 7f574d1ea780 1 < completed delete operation key=43GV2N9VBBKE tag=5H2Y4RLEDMRO type=del 2024-09-12T17:18:12.850 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.849+0000 7f574d1ea780 1 > prepared operation key=D1GEG3MKPOM3 tag=V7I7CIGBCCPL type=del size=2535045 2024-09-12T17:18:12.851 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.850+0000 7f574d1ea780 1 < completed delete operation key=UFKM4I8RMT0W tag=K0D34KE5T59U type=del 2024-09-12T17:18:12.853 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.852+0000 7f574d1ea780 1 > prepared operation key=8SG7DJO4HWPI tag=WRVEYR7JTOTJ type=write size=202299 2024-09-12T17:18:12.854 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.853+0000 7f574d1ea780 1 < canceled operation key=QXD8UG2K4STQ tag=RMM656AMC6FL type=del size=2819411 2024-09-12T17:18:12.856 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.855+0000 7f574d1ea780 1 > prepared operation key=RWVWJHVZE95H tag=A5SHSSC4UC7C type=del size=3422616 2024-09-12T17:18:12.857 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.856+0000 7f574d1ea780 1 < completed delete operation key=DH02JGZP64MN tag=1YF10B0NL3XV type=del 2024-09-12T17:18:12.858 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.858+0000 7f574d1ea780 1 > prepared operation key=Q2Q3B1J3DAVD tag=2QWBFICLYHOP type=del size=3139665 2024-09-12T17:18:12.860 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.859+0000 7f574d1ea780 1 < completed part key=_multipart_QXD8UG2K4STQ.2~HU9O7CZM4G5W.0 size=577918 2024-09-12T17:18:12.862 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.861+0000 7f574d1ea780 1 < completed multipart upload key=QXD8UG2K4STQ upload=HU9O7CZM4G5W tag=O83CZVD1WGHU type=write size=1626494 2024-09-12T17:18:12.863 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.862+0000 7f574d1ea780 1 > prepared operation key=R00F69ON5P6Z tag=5V56WXSWPJ6S type=del size=3659703 2024-09-12T17:18:12.865 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.864+0000 7f574d1ea780 1 < suggested update operation key=Q2Q3B1J3DAVD tag=L4WNO9LRDD39 type=del size=4190520 2024-09-12T17:18:12.867 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.867+0000 7f574d1ea780 1 > prepared part key=_multipart_RWVWJHVZE95H.2~ACWFXJ2SUX54.0 size=1048576 2024-09-12T17:18:12.869 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.868+0000 7f574d1ea780 1 > prepared part key=_multipart_RWVWJHVZE95H.2~ACWFXJ2SUX54.1 size=1048576 2024-09-12T17:18:12.870 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.869+0000 7f574d1ea780 1 > prepared part key=_multipart_RWVWJHVZE95H.2~ACWFXJ2SUX54.2 size=275651 2024-09-12T17:18:12.870 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.869+0000 7f574d1ea780 1 > prepared multipart upload key=RWVWJHVZE95H upload=ACWFXJ2SUX54 tag=Y1K22BKMYBA6 type=write size=3421379 2024-09-12T17:18:12.870 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.869+0000 7f574d1ea780 1 < canceled part key=_multipart_54LQ91UMBJAN.2~ZPXEVD6TIYSH.0 size=1048576 2024-09-12T17:18:12.871 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.870+0000 7f574d1ea780 1 < completed part key=_multipart_54LQ91UMBJAN.2~ZPXEVD6TIYSH.1 size=46607 2024-09-12T17:18:12.873 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.872+0000 7f574d1ea780 1 < canceled multipart upload key=54LQ91UMBJAN upload=ZPXEVD6TIYSH tag=715RM4T6GIDG type=write size=2143759 2024-09-12T17:18:12.875 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.875+0000 7f574d1ea780 1 > prepared part key=_multipart_VWWA5IB0L4N1.2~3C8DHCXO3RRX.0 size=512676 2024-09-12T17:18:12.876 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.875+0000 7f574d1ea780 1 > prepared multipart upload key=VWWA5IB0L4N1 upload=3C8DHCXO3RRX tag=H2VSPRXVVZ5E type=write size=1561252 2024-09-12T17:18:12.877 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.876+0000 7f574d1ea780 1 < completed part key=_multipart_55V137SY4E4P.2~W9367UVFXGXF.0 size=875783 2024-09-12T17:18:12.879 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.878+0000 7f574d1ea780 1 < completed multipart upload key=55V137SY4E4P upload=W9367UVFXGXF tag=YS6RUCCSKANP type=write size=1924359 2024-09-12T17:18:12.881 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.880+0000 7f574d1ea780 1 > prepared part key=_multipart_ZGE1860DMGHA.2~CZZ7V2QB40U8.0 size=211673 2024-09-12T17:18:12.881 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.880+0000 7f574d1ea780 1 > prepared multipart upload key=ZGE1860DMGHA upload=CZZ7V2QB40U8 tag=GNTTOG9OYVHR type=write size=1260249 2024-09-12T17:18:12.881 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.881+0000 7f574d1ea780 1 < canceled part key=_multipart_RNI86YYLADT0.2~QTKD3MGTAIDF.0 size=1048576 2024-09-12T17:18:12.882 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.882+0000 7f574d1ea780 1 < completed part key=_multipart_RNI86YYLADT0.2~QTKD3MGTAIDF.1 size=233446 2024-09-12T17:18:12.884 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.883+0000 7f574d1ea780 1 < canceled multipart upload key=RNI86YYLADT0 upload=QTKD3MGTAIDF tag=6UZAA3ZB1ZL8 type=write size=2330598 2024-09-12T17:18:12.887 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.886+0000 7f574d1ea780 1 > prepared part key=_multipart_RNI86YYLADT0.2~2ANMD419NPHC.0 size=264951 2024-09-12T17:18:12.887 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.886+0000 7f574d1ea780 1 > prepared multipart upload key=RNI86YYLADT0 upload=2ANMD419NPHC tag=XH1088H2ENKO type=write size=1313527 2024-09-12T17:18:12.888 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.887+0000 7f574d1ea780 1 < completed part key=_multipart_43GV2N9VBBKE.2~K8X1A23BZE9T.0 size=1048576 2024-09-12T17:18:12.889 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.888+0000 7f574d1ea780 1 < completed part key=_multipart_43GV2N9VBBKE.2~K8X1A23BZE9T.1 size=202161 2024-09-12T17:18:12.891 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.890+0000 7f574d1ea780 1 < completed multipart upload key=43GV2N9VBBKE upload=K8X1A23BZE9T tag=MUP5NBK3T0TG type=write size=2299313 2024-09-12T17:18:12.892 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.891+0000 7f574d1ea780 1 > prepared operation key=43GV2N9VBBKE tag=5L31PI2MOSX7 type=del size=817643 2024-09-12T17:18:12.893 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.892+0000 7f574d1ea780 1 < completed delete operation key=A1TIP3RXHBCZ tag=TWZVXBAF6W3J type=del 2024-09-12T17:18:12.894 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.894+0000 7f574d1ea780 1 > prepared operation key=UTCKL1F42X8A tag=8YO3HHQDQPSQ type=write size=660272 2024-09-12T17:18:12.895 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.895+0000 7f574d1ea780 1 < completed write operation key=QXD8UG2K4STQ tag=TOKR1JD31AJH type=write size=1002063 2024-09-12T17:18:12.898 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.897+0000 7f574d1ea780 1 > prepared part key=_multipart_TIKBUXFPVTN1.2~CMIC34SPZ93I.0 size=1048576 2024-09-12T17:18:12.899 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.898+0000 7f574d1ea780 1 > prepared part key=_multipart_TIKBUXFPVTN1.2~CMIC34SPZ93I.1 size=1048576 2024-09-12T17:18:12.900 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.899+0000 7f574d1ea780 1 > prepared part key=_multipart_TIKBUXFPVTN1.2~CMIC34SPZ93I.2 size=787557 2024-09-12T17:18:12.900 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.899+0000 7f574d1ea780 1 > prepared multipart upload key=TIKBUXFPVTN1 upload=CMIC34SPZ93I tag=11P734A8EUBC type=write size=3933285 2024-09-12T17:18:12.901 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.900+0000 7f574d1ea780 1 < completed part key=_multipart_C9IYR9CET1I8.2~PUJZD8UO9A8N.0 size=1048576 2024-09-12T17:18:12.902 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.901+0000 7f574d1ea780 1 < completed part key=_multipart_C9IYR9CET1I8.2~PUJZD8UO9A8N.1 size=1048576 2024-09-12T17:18:12.903 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.902+0000 7f574d1ea780 1 < completed part key=_multipart_C9IYR9CET1I8.2~PUJZD8UO9A8N.2 size=480823 2024-09-12T17:18:12.905 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.904+0000 7f574d1ea780 1 < completed multipart upload key=C9IYR9CET1I8 upload=PUJZD8UO9A8N tag=FMGF62ASIRQF type=write size=3626551 2024-09-12T17:18:12.906 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.905+0000 7f574d1ea780 1 > prepared operation key=A1TIP3RXHBCZ tag=11TX2A52DVEO type=write size=401441 2024-09-12T17:18:12.908 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.907+0000 7f574d1ea780 1 < completed part key=_multipart_RWVWJHVZE95H.2~EDZ69WQYYC2K.0 size=1048576 2024-09-12T17:18:12.908 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.907+0000 7f574d1ea780 1 < canceled part key=_multipart_RWVWJHVZE95H.2~EDZ69WQYYC2K.1 size=1048576 2024-09-12T17:18:12.909 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.908+0000 7f574d1ea780 1 < completed part key=_multipart_RWVWJHVZE95H.2~EDZ69WQYYC2K.2 size=100085 2024-09-12T17:18:12.911 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.910+0000 7f574d1ea780 1 < canceled multipart upload key=RWVWJHVZE95H upload=EDZ69WQYYC2K tag=AFMHVB4HTZM6 type=write size=3245813 2024-09-12T17:18:12.912 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.911+0000 7f574d1ea780 1 > prepared operation key=K12MVG618809 tag=UB64G7Y3YAO5 type=del size=3189226 2024-09-12T17:18:12.913 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.912+0000 7f574d1ea780 1 < completed delete operation key=RNI86YYLADT0 tag=3PGYYSZ8IAU3 type=del 2024-09-12T17:18:12.916 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.915+0000 7f574d1ea780 1 > prepared part key=_multipart_8SG7DJO4HWPI.2~BN0P8EIDSHN5.0 size=458558 2024-09-12T17:18:12.916 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.915+0000 7f574d1ea780 1 > prepared multipart upload key=8SG7DJO4HWPI upload=BN0P8EIDSHN5 tag=SV05YJ7IP4NT type=write size=1507134 2024-09-12T17:18:12.917 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.916+0000 7f574d1ea780 1 < completed delete operation key=A1TIP3RXHBCZ tag=BT5X3LDITVZY type=del 2024-09-12T17:18:12.921 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.920+0000 7f574d1ea780 1 > prepared part key=_multipart_ZGE1860DMGHA.2~1XJAA75SNW3N.0 size=1048576 2024-09-12T17:18:12.922 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.922+0000 7f574d1ea780 1 > prepared part key=_multipart_ZGE1860DMGHA.2~1XJAA75SNW3N.1 size=816549 2024-09-12T17:18:12.923 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.922+0000 7f574d1ea780 1 > prepared multipart upload key=ZGE1860DMGHA upload=1XJAA75SNW3N tag=35IHHSCK7ZOU type=write size=2913701 2024-09-12T17:18:12.924 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.923+0000 7f574d1ea780 1 < completed delete operation key=D1GEG3MKPOM3 tag=V7I7CIGBCCPL type=del 2024-09-12T17:18:12.925 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.924+0000 7f574d1ea780 1 > prepared operation key=YXIDO0U18839 tag=BV8FI3MWMZTT type=del size=4029278 2024-09-12T17:18:12.928 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.927+0000 7f574d1ea780 1 < suggested update operation key=8SG7DJO4HWPI tag=WRVEYR7JTOTJ type=write size=202299 2024-09-12T17:18:12.930 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.929+0000 7f574d1ea780 1 > prepared part key=_multipart_8SG7DJO4HWPI.2~3KRDPAV0P4OT.0 size=1048576 2024-09-12T17:18:12.931 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.930+0000 7f574d1ea780 1 > prepared part key=_multipart_8SG7DJO4HWPI.2~3KRDPAV0P4OT.1 size=317983 2024-09-12T17:18:12.931 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.930+0000 7f574d1ea780 1 > prepared multipart upload key=8SG7DJO4HWPI upload=3KRDPAV0P4OT tag=VIJQ9C13JYZ7 type=write size=2415135 2024-09-12T17:18:12.933 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.932+0000 7f574d1ea780 1 < completed delete operation key=RWVWJHVZE95H tag=A5SHSSC4UC7C type=del 2024-09-12T17:18:12.934 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.933+0000 7f574d1ea780 1 > prepared operation key=HFWA7DNUMWF2 tag=Y0WEFFB8KGNG type=del size=537778 2024-09-12T17:18:12.935 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.934+0000 7f574d1ea780 -1 < failed to complete operation key=Q2Q3B1J3DAVD tag=2QWBFICLYHOP type=del size=3139665: (22) Invalid argument 2024-09-12T17:18:12.937 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.937+0000 7f574d1ea780 1 > prepared part key=_multipart_8VW3XCUHLF2L.2~M6C51R2XUIWS.0 size=1048576 2024-09-12T17:18:12.939 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.938+0000 7f574d1ea780 1 > prepared part key=_multipart_8VW3XCUHLF2L.2~M6C51R2XUIWS.1 size=698990 2024-09-12T17:18:12.939 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.938+0000 7f574d1ea780 1 > prepared multipart upload key=8VW3XCUHLF2L upload=M6C51R2XUIWS tag=R0E1M2FNL42A type=write size=2796142 2024-09-12T17:18:12.940 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.939+0000 7f574d1ea780 1 < completed delete operation key=R00F69ON5P6Z tag=5V56WXSWPJ6S type=del 2024-09-12T17:18:12.941 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.940+0000 7f574d1ea780 1 > prepared operation key=VWWA5IB0L4N1 tag=2NM5WVBPIP3B type=del size=3280011 2024-09-12T17:18:12.942 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.941+0000 7f574d1ea780 1 < completed part key=_multipart_RWVWJHVZE95H.2~ACWFXJ2SUX54.0 size=1048576 2024-09-12T17:18:12.943 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.942+0000 7f574d1ea780 1 < completed part key=_multipart_RWVWJHVZE95H.2~ACWFXJ2SUX54.1 size=1048576 2024-09-12T17:18:12.944 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.943+0000 7f574d1ea780 1 < completed part key=_multipart_RWVWJHVZE95H.2~ACWFXJ2SUX54.2 size=275651 2024-09-12T17:18:12.946 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.946+0000 7f574d1ea780 1 < completed multipart upload key=RWVWJHVZE95H upload=ACWFXJ2SUX54 tag=Y1K22BKMYBA6 type=write size=3421379 2024-09-12T17:18:12.948 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.947+0000 7f574d1ea780 1 > prepared operation key=VWWA5IB0L4N1 tag=Y6ZBFTGTAJD1 type=del size=2137296 2024-09-12T17:18:12.949 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.948+0000 7f574d1ea780 1 < completed part key=_multipart_VWWA5IB0L4N1.2~3C8DHCXO3RRX.0 size=512676 2024-09-12T17:18:12.951 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.950+0000 7f574d1ea780 1 < completed multipart upload key=VWWA5IB0L4N1 upload=3C8DHCXO3RRX tag=H2VSPRXVVZ5E type=write size=1561252 2024-09-12T17:18:12.952 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.951+0000 7f574d1ea780 1 > prepared operation key=54CM8800AT9V tag=8SVP2YDK4EFH type=del size=3630762 2024-09-12T17:18:12.954 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.953+0000 7f574d1ea780 1 < completed part key=_multipart_ZGE1860DMGHA.2~CZZ7V2QB40U8.0 size=211673 2024-09-12T17:18:12.956 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.955+0000 7f574d1ea780 1 < completed multipart upload key=ZGE1860DMGHA upload=CZZ7V2QB40U8 tag=GNTTOG9OYVHR type=write size=1260249 2024-09-12T17:18:12.957 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.956+0000 7f574d1ea780 1 > prepared operation key=43GV2N9VBBKE tag=22CRPEY4WRAW type=del size=368729 2024-09-12T17:18:12.958 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.957+0000 7f574d1ea780 1 < completed part key=_multipart_RNI86YYLADT0.2~2ANMD419NPHC.0 size=264951 2024-09-12T17:18:12.960 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.959+0000 7f574d1ea780 1 < completed multipart upload key=RNI86YYLADT0 upload=2ANMD419NPHC tag=XH1088H2ENKO type=write size=1313527 2024-09-12T17:18:12.962 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.961+0000 7f574d1ea780 1 > prepared operation key=C9IYR9CET1I8 tag=5JK61WU5TUOZ type=write size=193990 2024-09-12T17:18:12.963 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.962+0000 7f574d1ea780 1 < completed delete operation key=43GV2N9VBBKE tag=5L31PI2MOSX7 type=del 2024-09-12T17:18:12.965 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.964+0000 7f574d1ea780 1 > prepared part key=_multipart_UFKM4I8RMT0W.2~0N9TNMIO5Y1L.0 size=1048576 2024-09-12T17:18:12.966 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.965+0000 7f574d1ea780 1 > prepared part key=_multipart_UFKM4I8RMT0W.2~0N9TNMIO5Y1L.1 size=815795 2024-09-12T17:18:12.966 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.965+0000 7f574d1ea780 1 > prepared multipart upload key=UFKM4I8RMT0W upload=0N9TNMIO5Y1L tag=CPYCTJCC21DB type=write size=2912947 2024-09-12T17:18:12.967 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.967+0000 7f574d1ea780 1 < completed write operation key=UTCKL1F42X8A tag=8YO3HHQDQPSQ type=write size=660272 2024-09-12T17:18:12.969 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.968+0000 7f574d1ea780 1 > prepared operation key=SQQMJ61CA0QW tag=AOCS10202LIN type=del size=1303251 2024-09-12T17:18:12.969 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.968+0000 7f574d1ea780 1 < canceled part key=_multipart_TIKBUXFPVTN1.2~CMIC34SPZ93I.0 size=1048576 2024-09-12T17:18:12.970 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.969+0000 7f574d1ea780 1 < completed part key=_multipart_TIKBUXFPVTN1.2~CMIC34SPZ93I.1 size=1048576 2024-09-12T17:18:12.971 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.970+0000 7f574d1ea780 1 < completed part key=_multipart_TIKBUXFPVTN1.2~CMIC34SPZ93I.2 size=787557 2024-09-12T17:18:12.973 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.972+0000 7f574d1ea780 1 < canceled multipart upload key=TIKBUXFPVTN1 upload=CMIC34SPZ93I tag=11P734A8EUBC type=write size=3933285 2024-09-12T17:18:12.975 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.975+0000 7f574d1ea780 1 > prepared part key=_multipart_54CM8800AT9V.2~ZHPOH0GNPLFD.0 size=1048576 2024-09-12T17:18:12.976 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.975+0000 7f574d1ea780 1 > prepared part key=_multipart_54CM8800AT9V.2~ZHPOH0GNPLFD.1 size=1048576 2024-09-12T17:18:12.977 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.976+0000 7f574d1ea780 1 > prepared part key=_multipart_54CM8800AT9V.2~ZHPOH0GNPLFD.2 size=288139 2024-09-12T17:18:12.977 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.976+0000 7f574d1ea780 1 > prepared multipart upload key=54CM8800AT9V upload=ZHPOH0GNPLFD tag=DYSMCRXEC4BX type=write size=3433867 2024-09-12T17:18:12.979 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.978+0000 7f574d1ea780 1 < completed write operation key=A1TIP3RXHBCZ tag=11TX2A52DVEO type=write size=401441 2024-09-12T17:18:12.980 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.979+0000 7f574d1ea780 1 > prepared operation key=RNI86YYLADT0 tag=ORXKBRLEGYW9 type=del size=3551336 2024-09-12T17:18:12.981 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.980+0000 7f574d1ea780 1 < completed delete operation key=K12MVG618809 tag=UB64G7Y3YAO5 type=del 2024-09-12T17:18:12.983 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.983+0000 7f574d1ea780 1 > prepared part key=_multipart_55V137SY4E4P.2~5VC9NN00T31M.0 size=73486 2024-09-12T17:18:12.984 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.983+0000 7f574d1ea780 1 > prepared multipart upload key=55V137SY4E4P upload=5VC9NN00T31M tag=N3ARX3X51L8I type=write size=1122062 2024-09-12T17:18:12.985 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.984+0000 7f574d1ea780 1 < completed part key=_multipart_8SG7DJO4HWPI.2~BN0P8EIDSHN5.0 size=458558 2024-09-12T17:18:12.987 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.986+0000 7f574d1ea780 1 < completed multipart upload key=8SG7DJO4HWPI upload=BN0P8EIDSHN5 tag=SV05YJ7IP4NT type=write size=1507134 2024-09-12T17:18:12.988 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.988+0000 7f574d1ea780 1 > prepared operation key=OI51GO639LFK tag=7PK4UC1W6H74 type=del size=12235 2024-09-12T17:18:12.990 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.989+0000 7f574d1ea780 1 < completed part key=_multipart_ZGE1860DMGHA.2~1XJAA75SNW3N.0 size=1048576 2024-09-12T17:18:12.991 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.990+0000 7f574d1ea780 1 < completed part key=_multipart_ZGE1860DMGHA.2~1XJAA75SNW3N.1 size=816549 2024-09-12T17:18:12.993 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.993+0000 7f574d1ea780 1 < completed multipart upload key=ZGE1860DMGHA upload=1XJAA75SNW3N tag=35IHHSCK7ZOU type=write size=2913701 2024-09-12T17:18:12.995 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.994+0000 7f574d1ea780 1 > prepared operation key=Q2Q3B1J3DAVD tag=EOELLHEV8THX type=del size=2290045 2024-09-12T17:18:12.996 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.995+0000 7f574d1ea780 1 < completed delete operation key=YXIDO0U18839 tag=BV8FI3MWMZTT type=del 2024-09-12T17:18:12.997 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.997+0000 7f574d1ea780 1 > prepared operation key=GEGOEB05R0PK tag=UVZJ8AZ4CXZY type=write size=793485 2024-09-12T17:18:12.999 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.998+0000 7f574d1ea780 1 < completed part key=_multipart_8SG7DJO4HWPI.2~3KRDPAV0P4OT.0 size=1048576 2024-09-12T17:18:13.000 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:12.999+0000 7f574d1ea780 1 < completed part key=_multipart_8SG7DJO4HWPI.2~3KRDPAV0P4OT.1 size=317983 2024-09-12T17:18:13.002 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.001+0000 7f574d1ea780 1 < completed multipart upload key=8SG7DJO4HWPI upload=3KRDPAV0P4OT tag=VIJQ9C13JYZ7 type=write size=2415135 2024-09-12T17:18:13.003 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.003+0000 7f574d1ea780 1 > prepared operation key=55V137SY4E4P tag=S10WPQ4NFRGX type=write size=203903 2024-09-12T17:18:13.005 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.004+0000 7f574d1ea780 1 < completed delete operation key=HFWA7DNUMWF2 tag=Y0WEFFB8KGNG type=del 2024-09-12T17:18:13.006 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.005+0000 7f574d1ea780 1 > prepared operation key=ENFNIFHQ3SHW tag=SKWIGKOHCK2F type=del size=2766758 2024-09-12T17:18:13.007 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.006+0000 7f574d1ea780 1 < canceled part key=_multipart_8VW3XCUHLF2L.2~M6C51R2XUIWS.0 size=1048576 2024-09-12T17:18:13.008 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.007+0000 7f574d1ea780 1 < completed part key=_multipart_8VW3XCUHLF2L.2~M6C51R2XUIWS.1 size=698990 2024-09-12T17:18:13.010 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.009+0000 7f574d1ea780 1 < canceled multipart upload key=8VW3XCUHLF2L upload=M6C51R2XUIWS tag=R0E1M2FNL42A type=write size=2796142 2024-09-12T17:18:13.011 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.011+0000 7f574d1ea780 1 > prepared operation key=HGZMN894YYC0 tag=B42U71IIRBZH type=del size=884328 2024-09-12T17:18:13.013 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.012+0000 7f574d1ea780 1 < completed delete operation key=VWWA5IB0L4N1 tag=2NM5WVBPIP3B type=del 2024-09-12T17:18:13.016 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.015+0000 7f574d1ea780 1 > prepared part key=_multipart_R00F69ON5P6Z.2~W6M2R0UWNZMH.0 size=1048576 2024-09-12T17:18:13.017 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.016+0000 7f574d1ea780 1 > prepared part key=_multipart_R00F69ON5P6Z.2~W6M2R0UWNZMH.1 size=1048576 2024-09-12T17:18:13.018 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.017+0000 7f574d1ea780 1 > prepared part key=_multipart_R00F69ON5P6Z.2~W6M2R0UWNZMH.2 size=232968 2024-09-12T17:18:13.018 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.017+0000 7f574d1ea780 1 > prepared multipart upload key=R00F69ON5P6Z upload=W6M2R0UWNZMH tag=AV2SWSGBRVRH type=write size=3378696 2024-09-12T17:18:13.019 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.018+0000 7f574d1ea780 1 < completed delete operation key=VWWA5IB0L4N1 tag=Y6ZBFTGTAJD1 type=del 2024-09-12T17:18:13.021 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.020+0000 7f574d1ea780 1 > prepared operation key=DH02JGZP64MN tag=203SI0SRKZMJ type=del size=3412954 2024-09-12T17:18:13.022 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.021+0000 7f574d1ea780 1 < completed delete operation key=54CM8800AT9V tag=8SVP2YDK4EFH type=del 2024-09-12T17:18:13.025 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.024+0000 7f574d1ea780 1 > prepared part key=_multipart_HFWA7DNUMWF2.2~30NN5XA0001P.0 size=148635 2024-09-12T17:18:13.025 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.024+0000 7f574d1ea780 1 > prepared multipart upload key=HFWA7DNUMWF2 upload=30NN5XA0001P tag=E2VY9HGDBXE9 type=write size=1197211 2024-09-12T17:18:13.026 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.025+0000 7f574d1ea780 1 < completed delete operation key=43GV2N9VBBKE tag=22CRPEY4WRAW type=del 2024-09-12T17:18:13.030 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.029+0000 7f574d1ea780 1 > prepared part key=_multipart_A1TIP3RXHBCZ.2~QV59DSTQAR1N.0 size=1048576 2024-09-12T17:18:13.031 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.031+0000 7f574d1ea780 1 > prepared part key=_multipart_A1TIP3RXHBCZ.2~QV59DSTQAR1N.1 size=133099 2024-09-12T17:18:13.031 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.031+0000 7f574d1ea780 1 > prepared multipart upload key=A1TIP3RXHBCZ upload=QV59DSTQAR1N tag=32VLHN7H0FUV type=write size=2230251 2024-09-12T17:18:13.033 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.032+0000 7f574d1ea780 1 < completed write operation key=C9IYR9CET1I8 tag=5JK61WU5TUOZ type=write size=193990 2024-09-12T17:18:13.034 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.034+0000 7f574d1ea780 1 > prepared operation key=HGZMN894YYC0 tag=521MU8W83BD3 type=del size=1494430 2024-09-12T17:18:13.036 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.035+0000 7f574d1ea780 1 < completed part key=_multipart_UFKM4I8RMT0W.2~0N9TNMIO5Y1L.0 size=1048576 2024-09-12T17:18:13.037 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.036+0000 7f574d1ea780 1 < completed part key=_multipart_UFKM4I8RMT0W.2~0N9TNMIO5Y1L.1 size=815795 2024-09-12T17:18:13.040 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.039+0000 7f574d1ea780 1 < completed multipart upload key=UFKM4I8RMT0W upload=0N9TNMIO5Y1L tag=CPYCTJCC21DB type=write size=2912947 2024-09-12T17:18:13.042 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.041+0000 7f574d1ea780 1 > prepared part key=_multipart_D1GEG3MKPOM3.2~2IQKVZV98GXF.0 size=1048576 2024-09-12T17:18:13.043 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.042+0000 7f574d1ea780 1 > prepared part key=_multipart_D1GEG3MKPOM3.2~2IQKVZV98GXF.1 size=1048576 2024-09-12T17:18:13.045 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.045+0000 7f574d1ea780 1 > prepared part key=_multipart_D1GEG3MKPOM3.2~2IQKVZV98GXF.2 size=801395 2024-09-12T17:18:13.045 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.045+0000 7f574d1ea780 1 > prepared multipart upload key=D1GEG3MKPOM3 upload=2IQKVZV98GXF tag=C0ALIJDX6UJN type=write size=3947123 2024-09-12T17:18:13.047 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.046+0000 7f574d1ea780 1 < completed delete operation key=SQQMJ61CA0QW tag=AOCS10202LIN type=del 2024-09-12T17:18:13.049 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.048+0000 7f574d1ea780 1 > prepared part key=_multipart_A1TIP3RXHBCZ.2~ZWD4C5YNZXEP.0 size=1048576 2024-09-12T17:18:13.050 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.049+0000 7f574d1ea780 1 > prepared part key=_multipart_A1TIP3RXHBCZ.2~ZWD4C5YNZXEP.1 size=1048576 2024-09-12T17:18:13.051 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.050+0000 7f574d1ea780 1 > prepared part key=_multipart_A1TIP3RXHBCZ.2~ZWD4C5YNZXEP.2 size=815134 2024-09-12T17:18:13.051 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.050+0000 7f574d1ea780 1 > prepared multipart upload key=A1TIP3RXHBCZ upload=ZWD4C5YNZXEP tag=BA70AQK6W6SV type=write size=3960862 2024-09-12T17:18:13.052 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.051+0000 7f574d1ea780 1 < completed part key=_multipart_54CM8800AT9V.2~ZHPOH0GNPLFD.0 size=1048576 2024-09-12T17:18:13.053 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.052+0000 7f574d1ea780 1 < completed part key=_multipart_54CM8800AT9V.2~ZHPOH0GNPLFD.1 size=1048576 2024-09-12T17:18:13.054 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.053+0000 7f574d1ea780 1 < completed part key=_multipart_54CM8800AT9V.2~ZHPOH0GNPLFD.2 size=288139 2024-09-12T17:18:13.056 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.055+0000 7f574d1ea780 1 < completed multipart upload key=54CM8800AT9V upload=ZHPOH0GNPLFD tag=DYSMCRXEC4BX type=write size=3433867 2024-09-12T17:18:13.057 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.056+0000 7f574d1ea780 1 > prepared operation key=ZGH8XC39FGTC tag=0EEBVTFOUY02 type=del size=146122 2024-09-12T17:18:13.058 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.058+0000 7f574d1ea780 1 < completed delete operation key=RNI86YYLADT0 tag=ORXKBRLEGYW9 type=del 2024-09-12T17:18:13.060 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.059+0000 7f574d1ea780 1 > prepared operation key=GEGOEB05R0PK tag=HRG44B16T56P type=del size=3054373 2024-09-12T17:18:13.061 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.060+0000 7f574d1ea780 1 < completed part key=_multipart_55V137SY4E4P.2~5VC9NN00T31M.0 size=73486 2024-09-12T17:18:13.063 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.062+0000 7f574d1ea780 1 < completed multipart upload key=55V137SY4E4P upload=5VC9NN00T31M tag=N3ARX3X51L8I type=write size=1122062 2024-09-12T17:18:13.064 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.063+0000 7f574d1ea780 1 > prepared operation key=UTCKL1F42X8A tag=PUBTWV7YEPRP type=del size=478193 2024-09-12T17:18:13.065 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.065+0000 7f574d1ea780 1 < completed delete operation key=OI51GO639LFK tag=7PK4UC1W6H74 type=del 2024-09-12T17:18:13.067 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.066+0000 7f574d1ea780 1 > prepared operation key=TIKBUXFPVTN1 tag=LUEB0EENQLIV type=write size=876293 2024-09-12T17:18:13.068 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.067+0000 7f574d1ea780 1 < completed delete operation key=Q2Q3B1J3DAVD tag=EOELLHEV8THX type=del 2024-09-12T17:18:13.069 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.068+0000 7f574d1ea780 1 > prepared operation key=RWVWJHVZE95H tag=YCNW93RQXR8M type=del size=2253515 2024-09-12T17:18:13.070 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.070+0000 7f574d1ea780 1 < completed write operation key=GEGOEB05R0PK tag=UVZJ8AZ4CXZY type=write size=793485 2024-09-12T17:18:13.073 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.072+0000 7f574d1ea780 1 > prepared part key=_multipart_R00F69ON5P6Z.2~LYWE9SKCZ9D0.0 size=800403 2024-09-12T17:18:13.073 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.072+0000 7f574d1ea780 1 > prepared multipart upload key=R00F69ON5P6Z upload=LYWE9SKCZ9D0 tag=JB5UN4H12AG2 type=write size=1848979 2024-09-12T17:18:13.074 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.073+0000 7f574d1ea780 1 < completed write operation key=55V137SY4E4P tag=S10WPQ4NFRGX type=write size=203903 2024-09-12T17:18:13.075 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.074+0000 7f574d1ea780 1 > prepared operation key=ZGE1860DMGHA tag=KIIDUHBBLG36 type=write size=900393 2024-09-12T17:18:13.076 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.075+0000 7f574d1ea780 1 < completed delete operation key=ENFNIFHQ3SHW tag=SKWIGKOHCK2F type=del 2024-09-12T17:18:13.077 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.077+0000 7f574d1ea780 1 > prepared operation key=Q2Q3B1J3DAVD tag=MGHMHHFW1K11 type=write size=130765 2024-09-12T17:18:13.079 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.078+0000 7f574d1ea780 1 < completed delete operation key=HGZMN894YYC0 tag=B42U71IIRBZH type=del 2024-09-12T17:18:13.080 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.079+0000 7f574d1ea780 1 > prepared operation key=VWWA5IB0L4N1 tag=UOPORT5H8CGH type=del size=1030593 2024-09-12T17:18:13.081 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.080+0000 7f574d1ea780 1 < completed part key=_multipart_R00F69ON5P6Z.2~W6M2R0UWNZMH.0 size=1048576 2024-09-12T17:18:13.082 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.081+0000 7f574d1ea780 1 < completed part key=_multipart_R00F69ON5P6Z.2~W6M2R0UWNZMH.1 size=1048576 2024-09-12T17:18:13.083 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.082+0000 7f574d1ea780 1 < completed part key=_multipart_R00F69ON5P6Z.2~W6M2R0UWNZMH.2 size=232968 2024-09-12T17:18:13.085 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.084+0000 7f574d1ea780 1 < completed multipart upload key=R00F69ON5P6Z upload=W6M2R0UWNZMH tag=AV2SWSGBRVRH type=write size=3378696 2024-09-12T17:18:13.086 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.086+0000 7f574d1ea780 1 > prepared operation key=HGZMN894YYC0 tag=DHO6IY72NAGK type=del size=3225687 2024-09-12T17:18:13.088 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.087+0000 7f574d1ea780 1 < completed delete operation key=DH02JGZP64MN tag=203SI0SRKZMJ type=del 2024-09-12T17:18:13.089 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.088+0000 7f574d1ea780 1 > prepared operation key=A1TIP3RXHBCZ tag=B12DAUCD7FHO type=del size=2241861 2024-09-12T17:18:13.090 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.089+0000 7f574d1ea780 1 < completed part key=_multipart_HFWA7DNUMWF2.2~30NN5XA0001P.0 size=148635 2024-09-12T17:18:13.092 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.092+0000 7f574d1ea780 1 < completed multipart upload key=HFWA7DNUMWF2 upload=30NN5XA0001P tag=E2VY9HGDBXE9 type=write size=1197211 2024-09-12T17:18:13.094 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.093+0000 7f574d1ea780 1 > prepared operation key=R00F69ON5P6Z tag=50DL19VY0TWZ type=write size=700712 2024-09-12T17:18:13.095 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.095+0000 7f574d1ea780 1 < completed part key=_multipart_A1TIP3RXHBCZ.2~QV59DSTQAR1N.0 size=1048576 2024-09-12T17:18:13.097 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.096+0000 7f574d1ea780 1 < completed part key=_multipart_A1TIP3RXHBCZ.2~QV59DSTQAR1N.1 size=133099 2024-09-12T17:18:13.099 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.098+0000 7f574d1ea780 1 < completed multipart upload key=A1TIP3RXHBCZ upload=QV59DSTQAR1N tag=32VLHN7H0FUV type=write size=2230251 2024-09-12T17:18:13.100 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.099+0000 7f574d1ea780 1 > prepared operation key=GEGOEB05R0PK tag=EW4XTT6KRZDP type=del size=2767297 2024-09-12T17:18:13.102 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.102+0000 7f574d1ea780 1 < suggested update operation key=HGZMN894YYC0 tag=521MU8W83BD3 type=del size=1494430 2024-09-12T17:18:13.104 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.103+0000 7f574d1ea780 1 > prepared operation key=R00F69ON5P6Z tag=1NTN21PX9KRV type=write size=794600 2024-09-12T17:18:13.105 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.104+0000 7f574d1ea780 1 < completed part key=_multipart_D1GEG3MKPOM3.2~2IQKVZV98GXF.0 size=1048576 2024-09-12T17:18:13.106 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.105+0000 7f574d1ea780 1 < completed part key=_multipart_D1GEG3MKPOM3.2~2IQKVZV98GXF.1 size=1048576 2024-09-12T17:18:13.107 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.106+0000 7f574d1ea780 1 < completed part key=_multipart_D1GEG3MKPOM3.2~2IQKVZV98GXF.2 size=801395 2024-09-12T17:18:13.109 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.108+0000 7f574d1ea780 1 < completed multipart upload key=D1GEG3MKPOM3 upload=2IQKVZV98GXF tag=C0ALIJDX6UJN type=write size=3947123 2024-09-12T17:18:13.111 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.110+0000 7f574d1ea780 1 > prepared part key=_multipart_RNI86YYLADT0.2~C5UISJRJ71RY.0 size=1048576 2024-09-12T17:18:13.112 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.111+0000 7f574d1ea780 1 > prepared part key=_multipart_RNI86YYLADT0.2~C5UISJRJ71RY.1 size=964791 2024-09-12T17:18:13.112 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.111+0000 7f574d1ea780 1 > prepared multipart upload key=RNI86YYLADT0 upload=C5UISJRJ71RY tag=CM31F2UD8RI3 type=write size=3061943 2024-09-12T17:18:13.113 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.113+0000 7f574d1ea780 1 < completed part key=_multipart_A1TIP3RXHBCZ.2~ZWD4C5YNZXEP.0 size=1048576 2024-09-12T17:18:13.115 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.114+0000 7f574d1ea780 1 < completed part key=_multipart_A1TIP3RXHBCZ.2~ZWD4C5YNZXEP.1 size=1048576 2024-09-12T17:18:13.117 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.116+0000 7f574d1ea780 1 < completed part key=_multipart_A1TIP3RXHBCZ.2~ZWD4C5YNZXEP.2 size=815134 2024-09-12T17:18:13.119 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.119+0000 7f574d1ea780 1 < completed multipart upload key=A1TIP3RXHBCZ upload=ZWD4C5YNZXEP tag=BA70AQK6W6SV type=write size=3960862 2024-09-12T17:18:13.121 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.120+0000 7f574d1ea780 1 > prepared operation key=43GV2N9VBBKE tag=F2DJPXUV5AAR type=write size=776299 2024-09-12T17:18:13.122 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.121+0000 7f574d1ea780 1 < completed delete operation key=ZGH8XC39FGTC tag=0EEBVTFOUY02 type=del 2024-09-12T17:18:13.124 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.123+0000 7f574d1ea780 1 > prepared part key=_multipart_OI51GO639LFK.2~58PFU7SEIJES.0 size=1048576 2024-09-12T17:18:13.125 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.124+0000 7f574d1ea780 1 > prepared part key=_multipart_OI51GO639LFK.2~58PFU7SEIJES.1 size=1048576 2024-09-12T17:18:13.126 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.125+0000 7f574d1ea780 1 > prepared part key=_multipart_OI51GO639LFK.2~58PFU7SEIJES.2 size=142396 2024-09-12T17:18:13.126 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.125+0000 7f574d1ea780 1 > prepared multipart upload key=OI51GO639LFK upload=58PFU7SEIJES tag=3Q2YE48Y2RZ1 type=write size=3288124 2024-09-12T17:18:13.129 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.128+0000 7f574d1ea780 1 < suggested update operation key=GEGOEB05R0PK tag=HRG44B16T56P type=del size=3054373 2024-09-12T17:18:13.131 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.130+0000 7f574d1ea780 1 > prepared part key=_multipart_8VW3XCUHLF2L.2~31S8BTM2SRLA.0 size=1048576 2024-09-12T17:18:13.132 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.131+0000 7f574d1ea780 1 > prepared part key=_multipart_8VW3XCUHLF2L.2~31S8BTM2SRLA.1 size=1048576 2024-09-12T17:18:13.133 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.132+0000 7f574d1ea780 1 > prepared part key=_multipart_8VW3XCUHLF2L.2~31S8BTM2SRLA.2 size=585686 2024-09-12T17:18:13.136 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.132+0000 7f574d1ea780 1 > prepared multipart upload key=8VW3XCUHLF2L upload=31S8BTM2SRLA tag=74UIU2336NQL type=write size=3731414 2024-09-12T17:18:13.137 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.134+0000 7f574d1ea780 1 < completed delete operation key=UTCKL1F42X8A tag=PUBTWV7YEPRP type=del 2024-09-12T17:18:13.137 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.135+0000 7f574d1ea780 1 > prepared operation key=8SG7DJO4HWPI tag=M9PKIAALABAB type=del size=66839 2024-09-12T17:18:13.137 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.136+0000 7f574d1ea780 1 < completed write operation key=TIKBUXFPVTN1 tag=LUEB0EENQLIV type=write size=876293 2024-09-12T17:18:13.139 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.138+0000 7f574d1ea780 1 > prepared part key=_multipart_43GV2N9VBBKE.2~HCPQ41BGZ5UW.0 size=1048576 2024-09-12T17:18:13.140 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.139+0000 7f574d1ea780 1 > prepared part key=_multipart_43GV2N9VBBKE.2~HCPQ41BGZ5UW.1 size=1048576 2024-09-12T17:18:13.141 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.140+0000 7f574d1ea780 1 > prepared part key=_multipart_43GV2N9VBBKE.2~HCPQ41BGZ5UW.2 size=703944 2024-09-12T17:18:13.141 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.140+0000 7f574d1ea780 1 > prepared multipart upload key=43GV2N9VBBKE upload=HCPQ41BGZ5UW tag=QW9HXMS555QX type=write size=3849672 2024-09-12T17:18:13.142 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.142+0000 7f574d1ea780 1 < completed delete operation key=RWVWJHVZE95H tag=YCNW93RQXR8M type=del 2024-09-12T17:18:13.145 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.144+0000 7f574d1ea780 1 > prepared part key=_multipart_8SG7DJO4HWPI.2~0276NYY9QQUT.0 size=1048576 2024-09-12T17:18:13.146 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.145+0000 7f574d1ea780 1 > prepared part key=_multipart_8SG7DJO4HWPI.2~0276NYY9QQUT.1 size=742822 2024-09-12T17:18:13.146 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.145+0000 7f574d1ea780 1 > prepared multipart upload key=8SG7DJO4HWPI upload=0276NYY9QQUT tag=9VOLW33D7MRL type=write size=2839974 2024-09-12T17:18:13.147 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.146+0000 7f574d1ea780 1 < completed part key=_multipart_R00F69ON5P6Z.2~LYWE9SKCZ9D0.0 size=800403 2024-09-12T17:18:13.149 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.148+0000 7f574d1ea780 1 < completed multipart upload key=R00F69ON5P6Z upload=LYWE9SKCZ9D0 tag=JB5UN4H12AG2 type=write size=1848979 2024-09-12T17:18:13.151 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.151+0000 7f574d1ea780 1 > prepared part key=_multipart_A1TIP3RXHBCZ.2~RJ5KNT2AK6TB.0 size=1048576 2024-09-12T17:18:13.152 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.152+0000 7f574d1ea780 1 > prepared part key=_multipart_A1TIP3RXHBCZ.2~RJ5KNT2AK6TB.1 size=551215 2024-09-12T17:18:13.153 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.152+0000 7f574d1ea780 1 > prepared multipart upload key=A1TIP3RXHBCZ upload=RJ5KNT2AK6TB tag=X4QZ2H70YK0X type=write size=2648367 2024-09-12T17:18:13.154 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.153+0000 7f574d1ea780 1 < completed write operation key=ZGE1860DMGHA tag=KIIDUHBBLG36 type=write size=900393 2024-09-12T17:18:13.155 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.154+0000 7f574d1ea780 1 > prepared operation key=ZGH8XC39FGTC tag=ZBI1R5B9VBS2 type=del size=1167384 2024-09-12T17:18:13.156 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.155+0000 7f574d1ea780 1 < completed write operation key=Q2Q3B1J3DAVD tag=MGHMHHFW1K11 type=write size=130765 2024-09-12T17:18:13.158 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.158+0000 7f574d1ea780 1 > prepared part key=_multipart_54CM8800AT9V.2~BB6XY0C1ZKEI.0 size=1048576 2024-09-12T17:18:13.159 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.159+0000 7f574d1ea780 1 > prepared part key=_multipart_54CM8800AT9V.2~BB6XY0C1ZKEI.1 size=1048576 2024-09-12T17:18:13.160 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.160+0000 7f574d1ea780 1 > prepared part key=_multipart_54CM8800AT9V.2~BB6XY0C1ZKEI.2 size=564746 2024-09-12T17:18:13.161 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.160+0000 7f574d1ea780 1 > prepared multipart upload key=54CM8800AT9V upload=BB6XY0C1ZKEI tag=0J988HC31UCN type=write size=3710474 2024-09-12T17:18:13.166 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.165+0000 7f574d1ea780 1 < suggested remove operation key=VWWA5IB0L4N1 tag=UOPORT5H8CGH type=del 2024-09-12T17:18:13.167 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.166+0000 7f574d1ea780 1 > prepared operation key=C9IYR9CET1I8 tag=1YIA7T8867PW type=del size=1455261 2024-09-12T17:18:13.168 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.167+0000 7f574d1ea780 -1 < failed to complete operation key=HGZMN894YYC0 tag=DHO6IY72NAGK type=del size=3225687: (22) Invalid argument 2024-09-12T17:18:13.169 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.168+0000 7f574d1ea780 1 > prepared operation key=Q2Q3B1J3DAVD tag=NXU0403I9RX9 type=del size=3281944 2024-09-12T17:18:13.171 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.170+0000 7f574d1ea780 1 < completed delete operation key=A1TIP3RXHBCZ tag=B12DAUCD7FHO type=del 2024-09-12T17:18:13.173 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.172+0000 7f574d1ea780 1 > prepared part key=_multipart_TIKBUXFPVTN1.2~Y9620LQR4YDC.0 size=1048576 2024-09-12T17:18:13.174 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.173+0000 7f574d1ea780 1 > prepared part key=_multipart_TIKBUXFPVTN1.2~Y9620LQR4YDC.1 size=984427 2024-09-12T17:18:13.174 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.173+0000 7f574d1ea780 1 > prepared multipart upload key=TIKBUXFPVTN1 upload=Y9620LQR4YDC tag=ZR66H9W5AKHV type=write size=3081579 2024-09-12T17:18:13.175 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.174+0000 7f574d1ea780 1 < canceled operation key=R00F69ON5P6Z tag=50DL19VY0TWZ type=write size=700712 2024-09-12T17:18:13.177 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.177+0000 7f574d1ea780 1 > prepared part key=_multipart_TIKBUXFPVTN1.2~ZW1SXYQRQMB9.0 size=1048576 2024-09-12T17:18:13.178 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.178+0000 7f574d1ea780 1 > prepared part key=_multipart_TIKBUXFPVTN1.2~ZW1SXYQRQMB9.1 size=1048576 2024-09-12T17:18:13.179 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.179+0000 7f574d1ea780 1 > prepared part key=_multipart_TIKBUXFPVTN1.2~ZW1SXYQRQMB9.2 size=116549 2024-09-12T17:18:13.180 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.179+0000 7f574d1ea780 1 > prepared multipart upload key=TIKBUXFPVTN1 upload=ZW1SXYQRQMB9 tag=YO9R1X2WF2L5 type=write size=3262277 2024-09-12T17:18:13.181 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.180+0000 7f574d1ea780 -1 < failed to complete operation key=GEGOEB05R0PK tag=EW4XTT6KRZDP type=del size=2767297: (22) Invalid argument 2024-09-12T17:18:13.182 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.181+0000 7f574d1ea780 1 > prepared operation key=HFWA7DNUMWF2 tag=HAZ6LOKPWHNC type=del size=2870675 2024-09-12T17:18:13.183 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.182+0000 7f574d1ea780 1 < completed write operation key=R00F69ON5P6Z tag=1NTN21PX9KRV type=write size=794600 2024-09-12T17:18:13.186 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.185+0000 7f574d1ea780 1 > prepared part key=_multipart_GEGOEB05R0PK.2~8FSM86CNBV5T.0 size=1048576 2024-09-12T17:18:13.187 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.186+0000 7f574d1ea780 1 > prepared part key=_multipart_GEGOEB05R0PK.2~8FSM86CNBV5T.1 size=1048576 2024-09-12T17:18:13.188 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.187+0000 7f574d1ea780 1 > prepared part key=_multipart_GEGOEB05R0PK.2~8FSM86CNBV5T.2 size=641594 2024-09-12T17:18:13.188 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.187+0000 7f574d1ea780 1 > prepared multipart upload key=GEGOEB05R0PK upload=8FSM86CNBV5T tag=28X0R1Z9O9GU type=write size=3787322 2024-09-12T17:18:13.189 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.188+0000 7f574d1ea780 1 < completed part key=_multipart_RNI86YYLADT0.2~C5UISJRJ71RY.0 size=1048576 2024-09-12T17:18:13.190 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.189+0000 7f574d1ea780 1 < completed part key=_multipart_RNI86YYLADT0.2~C5UISJRJ71RY.1 size=964791 2024-09-12T17:18:13.192 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.191+0000 7f574d1ea780 1 < completed multipart upload key=RNI86YYLADT0 upload=C5UISJRJ71RY tag=CM31F2UD8RI3 type=write size=3061943 2024-09-12T17:18:13.193 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.193+0000 7f574d1ea780 1 > prepared operation key=QXD8UG2K4STQ tag=R4M9VIK8YI6V type=del size=3110677 2024-09-12T17:18:13.195 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.194+0000 7f574d1ea780 1 < completed write operation key=43GV2N9VBBKE tag=F2DJPXUV5AAR type=write size=776299 2024-09-12T17:18:13.196 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.195+0000 7f574d1ea780 1 > prepared operation key=HGZMN894YYC0 tag=A7623ZFVW6AK type=write size=445092 2024-09-12T17:18:13.196 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.195+0000 7f574d1ea780 1 < canceled part key=_multipart_OI51GO639LFK.2~58PFU7SEIJES.0 size=1048576 2024-09-12T17:18:13.197 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.196+0000 7f574d1ea780 1 < completed part key=_multipart_OI51GO639LFK.2~58PFU7SEIJES.1 size=1048576 2024-09-12T17:18:13.198 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.197+0000 7f574d1ea780 1 < completed part key=_multipart_OI51GO639LFK.2~58PFU7SEIJES.2 size=142396 2024-09-12T17:18:13.200 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.199+0000 7f574d1ea780 1 < canceled multipart upload key=OI51GO639LFK upload=58PFU7SEIJES tag=3Q2YE48Y2RZ1 type=write size=3288124 2024-09-12T17:18:13.201 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.201+0000 7f574d1ea780 1 > prepared operation key=OI51GO639LFK tag=QX4B4F8WHU4P type=del size=1640166 2024-09-12T17:18:13.203 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.202+0000 7f574d1ea780 1 < completed part key=_multipart_8VW3XCUHLF2L.2~31S8BTM2SRLA.0 size=1048576 2024-09-12T17:18:13.204 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.203+0000 7f574d1ea780 1 < completed part key=_multipart_8VW3XCUHLF2L.2~31S8BTM2SRLA.1 size=1048576 2024-09-12T17:18:13.204 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.203+0000 7f574d1ea780 1 < canceled part key=_multipart_8VW3XCUHLF2L.2~31S8BTM2SRLA.2 size=585686 2024-09-12T17:18:13.206 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.205+0000 7f574d1ea780 1 < canceled multipart upload key=8VW3XCUHLF2L upload=31S8BTM2SRLA tag=74UIU2336NQL type=write size=3731414 2024-09-12T17:18:13.207 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.206+0000 7f574d1ea780 1 > prepared operation key=TIKBUXFPVTN1 tag=8NKXU3OJFQ8O type=del size=3696090 2024-09-12T17:18:13.208 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.207+0000 7f574d1ea780 1 < completed delete operation key=8SG7DJO4HWPI tag=M9PKIAALABAB type=del 2024-09-12T17:18:13.211 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.210+0000 7f574d1ea780 1 > prepared part key=_multipart_55JI541K1WP2.2~52TX40YZUI96.0 size=1048576 2024-09-12T17:18:13.212 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.211+0000 7f574d1ea780 1 > prepared part key=_multipart_55JI541K1WP2.2~52TX40YZUI96.1 size=572347 2024-09-12T17:18:13.212 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.211+0000 7f574d1ea780 1 > prepared multipart upload key=55JI541K1WP2 upload=52TX40YZUI96 tag=RC16A1DD9BFU type=write size=2669499 2024-09-12T17:18:13.212 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.211+0000 7f574d1ea780 1 < canceled part key=_multipart_43GV2N9VBBKE.2~HCPQ41BGZ5UW.0 size=1048576 2024-09-12T17:18:13.212 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.211+0000 7f574d1ea780 1 < canceled part key=_multipart_43GV2N9VBBKE.2~HCPQ41BGZ5UW.1 size=1048576 2024-09-12T17:18:13.213 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.212+0000 7f574d1ea780 1 < completed part key=_multipart_43GV2N9VBBKE.2~HCPQ41BGZ5UW.2 size=703944 2024-09-12T17:18:13.215 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.214+0000 7f574d1ea780 1 < canceled multipart upload key=43GV2N9VBBKE upload=HCPQ41BGZ5UW tag=QW9HXMS555QX type=write size=3849672 2024-09-12T17:18:13.217 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.216+0000 7f574d1ea780 1 > prepared part key=_multipart_8VW3XCUHLF2L.2~QRM3A3ALX90Q.0 size=575571 2024-09-12T17:18:13.217 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.216+0000 7f574d1ea780 1 > prepared multipart upload key=8VW3XCUHLF2L upload=QRM3A3ALX90Q tag=DLL3I10ZSVEI type=write size=1624147 2024-09-12T17:18:13.218 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.217+0000 7f574d1ea780 1 < completed part key=_multipart_8SG7DJO4HWPI.2~0276NYY9QQUT.0 size=1048576 2024-09-12T17:18:13.219 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.218+0000 7f574d1ea780 1 < completed part key=_multipart_8SG7DJO4HWPI.2~0276NYY9QQUT.1 size=742822 2024-09-12T17:18:13.221 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.220+0000 7f574d1ea780 1 < completed multipart upload key=8SG7DJO4HWPI upload=0276NYY9QQUT tag=9VOLW33D7MRL type=write size=2839974 2024-09-12T17:18:13.222 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.222+0000 7f574d1ea780 1 > prepared operation key=QXD8UG2K4STQ tag=59NSKWWGTTM1 type=del size=2771590 2024-09-12T17:18:13.224 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.223+0000 7f574d1ea780 1 < completed part key=_multipart_A1TIP3RXHBCZ.2~RJ5KNT2AK6TB.0 size=1048576 2024-09-12T17:18:13.225 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.224+0000 7f574d1ea780 1 < completed part key=_multipart_A1TIP3RXHBCZ.2~RJ5KNT2AK6TB.1 size=551215 2024-09-12T17:18:13.227 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.226+0000 7f574d1ea780 1 < completed multipart upload key=A1TIP3RXHBCZ upload=RJ5KNT2AK6TB tag=X4QZ2H70YK0X type=write size=2648367 2024-09-12T17:18:13.229 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.228+0000 7f574d1ea780 1 > prepared part key=_multipart_TIKBUXFPVTN1.2~WKJ093EA3S9M.0 size=895321 2024-09-12T17:18:13.229 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.228+0000 7f574d1ea780 1 > prepared multipart upload key=TIKBUXFPVTN1 upload=WKJ093EA3S9M tag=3I8APULM2FRZ type=write size=1943897 2024-09-12T17:18:13.231 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.230+0000 7f574d1ea780 1 < suggested update operation key=ZGH8XC39FGTC tag=ZBI1R5B9VBS2 type=del size=1167384 2024-09-12T17:18:13.233 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.232+0000 7f574d1ea780 1 > prepared operation key=TIKBUXFPVTN1 tag=91IW0OV14XG5 type=del size=344363 2024-09-12T17:18:13.234 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.233+0000 7f574d1ea780 1 < completed part key=_multipart_54CM8800AT9V.2~BB6XY0C1ZKEI.0 size=1048576 2024-09-12T17:18:13.235 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.234+0000 7f574d1ea780 1 < completed part key=_multipart_54CM8800AT9V.2~BB6XY0C1ZKEI.1 size=1048576 2024-09-12T17:18:13.235 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.234+0000 7f574d1ea780 1 < canceled part key=_multipart_54CM8800AT9V.2~BB6XY0C1ZKEI.2 size=564746 2024-09-12T17:18:13.237 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.236+0000 7f574d1ea780 1 < canceled multipart upload key=54CM8800AT9V upload=BB6XY0C1ZKEI tag=0J988HC31UCN type=write size=3710474 2024-09-12T17:18:13.238 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.237+0000 7f574d1ea780 1 > prepared operation key=8SG7DJO4HWPI tag=7GP1GT5T4LVD type=write size=416602 2024-09-12T17:18:13.240 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.240+0000 7f574d1ea780 1 < suggested update operation key=C9IYR9CET1I8 tag=1YIA7T8867PW type=del size=1455261 2024-09-12T17:18:13.242 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.241+0000 7f574d1ea780 1 > prepared operation key=RNI86YYLADT0 tag=SKYUFB1UZX60 type=del size=2802435 2024-09-12T17:18:13.243 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.242+0000 7f574d1ea780 1 < completed delete operation key=Q2Q3B1J3DAVD tag=NXU0403I9RX9 type=del 2024-09-12T17:18:13.244 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.243+0000 7f574d1ea780 1 > prepared operation key=OI51GO639LFK tag=0XTPZTI9G2XA type=del size=1492952 2024-09-12T17:18:13.245 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.244+0000 7f574d1ea780 1 < completed part key=_multipart_TIKBUXFPVTN1.2~Y9620LQR4YDC.0 size=1048576 2024-09-12T17:18:13.245 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.244+0000 7f574d1ea780 1 < canceled part key=_multipart_TIKBUXFPVTN1.2~Y9620LQR4YDC.1 size=984427 2024-09-12T17:18:13.247 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.247+0000 7f574d1ea780 1 < canceled multipart upload key=TIKBUXFPVTN1 upload=Y9620LQR4YDC tag=ZR66H9W5AKHV type=write size=3081579 2024-09-12T17:18:13.248 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.248+0000 7f574d1ea780 1 > prepared operation key=54LQ91UMBJAN tag=QLK59P38WCYH type=del size=1107333 2024-09-12T17:18:13.250 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.249+0000 7f574d1ea780 1 < completed part key=_multipart_TIKBUXFPVTN1.2~ZW1SXYQRQMB9.0 size=1048576 2024-09-12T17:18:13.251 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.250+0000 7f574d1ea780 1 < completed part key=_multipart_TIKBUXFPVTN1.2~ZW1SXYQRQMB9.1 size=1048576 2024-09-12T17:18:13.252 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.251+0000 7f574d1ea780 1 < completed part key=_multipart_TIKBUXFPVTN1.2~ZW1SXYQRQMB9.2 size=116549 2024-09-12T17:18:13.254 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.253+0000 7f574d1ea780 1 < completed multipart upload key=TIKBUXFPVTN1 upload=ZW1SXYQRQMB9 tag=YO9R1X2WF2L5 type=write size=3262277 2024-09-12T17:18:13.255 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.254+0000 7f574d1ea780 1 > prepared operation key=A1TIP3RXHBCZ tag=SMSON65Z4271 type=write size=83824 2024-09-12T17:18:13.257 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.256+0000 7f574d1ea780 1 < suggested remove operation key=HFWA7DNUMWF2 tag=HAZ6LOKPWHNC type=del 2024-09-12T17:18:13.259 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.259+0000 7f574d1ea780 1 > prepared part key=_multipart_ZGE1860DMGHA.2~Y9WCQCYDP3CE.0 size=1048576 2024-09-12T17:18:13.260 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.260+0000 7f574d1ea780 1 > prepared part key=_multipart_ZGE1860DMGHA.2~Y9WCQCYDP3CE.1 size=834466 2024-09-12T17:18:13.261 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.260+0000 7f574d1ea780 1 > prepared multipart upload key=ZGE1860DMGHA upload=Y9WCQCYDP3CE tag=07S9G3E8K1JA type=write size=2931618 2024-09-12T17:18:13.262 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.261+0000 7f574d1ea780 1 < completed part key=_multipart_GEGOEB05R0PK.2~8FSM86CNBV5T.0 size=1048576 2024-09-12T17:18:13.262 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.261+0000 7f574d1ea780 1 < canceled part key=_multipart_GEGOEB05R0PK.2~8FSM86CNBV5T.1 size=1048576 2024-09-12T17:18:13.263 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.262+0000 7f574d1ea780 1 < completed part key=_multipart_GEGOEB05R0PK.2~8FSM86CNBV5T.2 size=641594 2024-09-12T17:18:13.265 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.264+0000 7f574d1ea780 1 < canceled multipart upload key=GEGOEB05R0PK upload=8FSM86CNBV5T tag=28X0R1Z9O9GU type=write size=3787322 2024-09-12T17:18:13.267 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.266+0000 7f574d1ea780 1 > prepared part key=_multipart_HFWA7DNUMWF2.2~6W6DE2HYQLV9.0 size=953177 2024-09-12T17:18:13.267 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.266+0000 7f574d1ea780 1 > prepared multipart upload key=HFWA7DNUMWF2 upload=6W6DE2HYQLV9 tag=GLRWYB362DSA type=write size=2001753 2024-09-12T17:18:13.268 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.267+0000 7f574d1ea780 1 < completed delete operation key=QXD8UG2K4STQ tag=R4M9VIK8YI6V type=del 2024-09-12T17:18:13.271 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.270+0000 7f574d1ea780 1 > prepared part key=_multipart_K12MVG618809.2~J74AYGI4X7M3.0 size=1048576 2024-09-12T17:18:13.272 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.271+0000 7f574d1ea780 1 > prepared part key=_multipart_K12MVG618809.2~J74AYGI4X7M3.1 size=1048576 2024-09-12T17:18:13.273 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.272+0000 7f574d1ea780 1 > prepared part key=_multipart_K12MVG618809.2~J74AYGI4X7M3.2 size=948438 2024-09-12T17:18:13.273 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.272+0000 7f574d1ea780 1 > prepared multipart upload key=K12MVG618809 upload=J74AYGI4X7M3 tag=NK6QOU18JPZV type=write size=4094166 2024-09-12T17:18:13.274 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.273+0000 7f574d1ea780 1 < completed write operation key=HGZMN894YYC0 tag=A7623ZFVW6AK type=write size=445092 2024-09-12T17:18:13.275 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.274+0000 7f574d1ea780 1 > prepared operation key=ZGH8XC39FGTC tag=1XK93DI4URCL type=del size=3424514 2024-09-12T17:18:13.276 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.276+0000 7f574d1ea780 1 < completed delete operation key=OI51GO639LFK tag=QX4B4F8WHU4P type=del 2024-09-12T17:18:13.279 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.279+0000 7f574d1ea780 1 > prepared part key=_multipart_DH02JGZP64MN.2~M57XVJPNVXC6.0 size=1048576 2024-09-12T17:18:13.280 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.279+0000 7f574d1ea780 1 > prepared part key=_multipart_DH02JGZP64MN.2~M57XVJPNVXC6.1 size=1048576 2024-09-12T17:18:13.281 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.281+0000 7f574d1ea780 1 > prepared part key=_multipart_DH02JGZP64MN.2~M57XVJPNVXC6.2 size=987165 2024-09-12T17:18:13.281 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.281+0000 7f574d1ea780 1 > prepared multipart upload key=DH02JGZP64MN upload=M57XVJPNVXC6 tag=G6HBGOH9FT5M type=write size=4132893 2024-09-12T17:18:13.283 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.282+0000 7f574d1ea780 1 < completed delete operation key=TIKBUXFPVTN1 tag=8NKXU3OJFQ8O type=del 2024-09-12T17:18:13.285 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.284+0000 7f574d1ea780 1 > prepared part key=_multipart_ZGE1860DMGHA.2~TL62H9KK5Z0N.0 size=1048576 2024-09-12T17:18:13.286 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.285+0000 7f574d1ea780 1 > prepared part key=_multipart_ZGE1860DMGHA.2~TL62H9KK5Z0N.1 size=992079 2024-09-12T17:18:13.286 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.285+0000 7f574d1ea780 1 > prepared multipart upload key=ZGE1860DMGHA upload=TL62H9KK5Z0N tag=B5ORKA0RD9TT type=write size=3089231 2024-09-12T17:18:13.287 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.287+0000 7f574d1ea780 1 < completed part key=_multipart_55JI541K1WP2.2~52TX40YZUI96.0 size=1048576 2024-09-12T17:18:13.289 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.288+0000 7f574d1ea780 1 < completed part key=_multipart_55JI541K1WP2.2~52TX40YZUI96.1 size=572347 2024-09-12T17:18:13.291 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.290+0000 7f574d1ea780 1 < completed multipart upload key=55JI541K1WP2 upload=52TX40YZUI96 tag=RC16A1DD9BFU type=write size=2669499 2024-09-12T17:18:13.293 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.292+0000 7f574d1ea780 1 > prepared part key=_multipart_43GV2N9VBBKE.2~STAM6CA657NO.0 size=1048576 2024-09-12T17:18:13.294 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.293+0000 7f574d1ea780 1 > prepared part key=_multipart_43GV2N9VBBKE.2~STAM6CA657NO.1 size=85190 2024-09-12T17:18:13.294 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.293+0000 7f574d1ea780 1 > prepared multipart upload key=43GV2N9VBBKE upload=STAM6CA657NO tag=XK5FR4YK7V9C type=write size=2182342 2024-09-12T17:18:13.295 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.295+0000 7f574d1ea780 1 < completed part key=_multipart_8VW3XCUHLF2L.2~QRM3A3ALX90Q.0 size=575571 2024-09-12T17:18:13.297 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.297+0000 7f574d1ea780 1 < completed multipart upload key=8VW3XCUHLF2L upload=QRM3A3ALX90Q tag=DLL3I10ZSVEI type=write size=1624147 2024-09-12T17:18:13.299 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.299+0000 7f574d1ea780 1 > prepared part key=_multipart_D1GEG3MKPOM3.2~PO53AD30O0HP.0 size=1048576 2024-09-12T17:18:13.300 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.300+0000 7f574d1ea780 1 > prepared part key=_multipart_D1GEG3MKPOM3.2~PO53AD30O0HP.1 size=1048576 2024-09-12T17:18:13.301 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.301+0000 7f574d1ea780 1 > prepared part key=_multipart_D1GEG3MKPOM3.2~PO53AD30O0HP.2 size=143044 2024-09-12T17:18:13.302 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.301+0000 7f574d1ea780 1 > prepared multipart upload key=D1GEG3MKPOM3 upload=PO53AD30O0HP tag=6L8Z0IZ0U4DN type=write size=3288772 2024-09-12T17:18:13.303 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.302+0000 7f574d1ea780 1 < completed delete operation key=QXD8UG2K4STQ tag=59NSKWWGTTM1 type=del 2024-09-12T17:18:13.304 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.303+0000 7f574d1ea780 1 > prepared operation key=8SG7DJO4HWPI tag=EHG2SJZAGD34 type=del size=3688481 2024-09-12T17:18:13.305 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.304+0000 7f574d1ea780 1 < completed part key=_multipart_TIKBUXFPVTN1.2~WKJ093EA3S9M.0 size=895321 2024-09-12T17:18:13.307 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.306+0000 7f574d1ea780 1 < completed multipart upload key=TIKBUXFPVTN1 upload=WKJ093EA3S9M tag=3I8APULM2FRZ type=write size=1943897 2024-09-12T17:18:13.308 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.307+0000 7f574d1ea780 1 > prepared operation key=55V137SY4E4P tag=RSQ103SG6U1U type=del size=839971 2024-09-12T17:18:13.311 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.310+0000 7f574d1ea780 1 < suggested remove operation key=TIKBUXFPVTN1 tag=91IW0OV14XG5 type=del 2024-09-12T17:18:13.312 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.311+0000 7f574d1ea780 1 > prepared operation key=DH02JGZP64MN tag=HS7W1D3ICVKD type=del size=1683184 2024-09-12T17:18:13.313 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.312+0000 7f574d1ea780 1 < completed write operation key=8SG7DJO4HWPI tag=7GP1GT5T4LVD type=write size=416602 2024-09-12T17:18:13.314 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.313+0000 7f574d1ea780 1 > prepared operation key=8VW3XCUHLF2L tag=VTAO0Y81FDP1 type=del size=2287956 2024-09-12T17:18:13.316 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.316+0000 7f574d1ea780 1 < suggested update operation key=RNI86YYLADT0 tag=SKYUFB1UZX60 type=del size=2802435 2024-09-12T17:18:13.319 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.318+0000 7f574d1ea780 1 > prepared part key=_multipart_8SG7DJO4HWPI.2~DX621Q4OJR4C.0 size=1048576 2024-09-12T17:18:13.319 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.319+0000 7f574d1ea780 1 > prepared part key=_multipart_8SG7DJO4HWPI.2~DX621Q4OJR4C.1 size=1048576 2024-09-12T17:18:13.321 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.320+0000 7f574d1ea780 1 > prepared part key=_multipart_8SG7DJO4HWPI.2~DX621Q4OJR4C.2 size=77969 2024-09-12T17:18:13.321 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.320+0000 7f574d1ea780 1 > prepared multipart upload key=8SG7DJO4HWPI upload=DX621Q4OJR4C tag=RGKVKOJ0TLQ9 type=write size=3223697 2024-09-12T17:18:13.322 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.321+0000 7f574d1ea780 1 < completed delete operation key=OI51GO639LFK tag=0XTPZTI9G2XA type=del 2024-09-12T17:18:13.323 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.322+0000 7f574d1ea780 1 > prepared operation key=RWVWJHVZE95H tag=PM0KS9I4Z48N type=del size=331368 2024-09-12T17:18:13.326 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.325+0000 7f574d1ea780 1 < suggested remove operation key=54LQ91UMBJAN tag=QLK59P38WCYH type=del 2024-09-12T17:18:13.327 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.326+0000 7f574d1ea780 1 > prepared operation key=43GV2N9VBBKE tag=D7QLY7C379IH type=del size=981780 2024-09-12T17:18:13.328 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.327+0000 7f574d1ea780 1 < completed write operation key=A1TIP3RXHBCZ tag=SMSON65Z4271 type=write size=83824 2024-09-12T17:18:13.329 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.329+0000 7f574d1ea780 1 > prepared operation key=VWWA5IB0L4N1 tag=UZ4FBHL3P1YO type=write size=462728 2024-09-12T17:18:13.331 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.330+0000 7f574d1ea780 1 < completed part key=_multipart_ZGE1860DMGHA.2~Y9WCQCYDP3CE.0 size=1048576 2024-09-12T17:18:13.332 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.331+0000 7f574d1ea780 1 < completed part key=_multipart_ZGE1860DMGHA.2~Y9WCQCYDP3CE.1 size=834466 2024-09-12T17:18:13.334 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.333+0000 7f574d1ea780 1 < completed multipart upload key=ZGE1860DMGHA upload=Y9WCQCYDP3CE tag=07S9G3E8K1JA type=write size=2931618 2024-09-12T17:18:13.335 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.334+0000 7f574d1ea780 1 > prepared operation key=VWWA5IB0L4N1 tag=PBQCPJ00YHV0 type=del size=976999 2024-09-12T17:18:13.336 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.336+0000 7f574d1ea780 1 < completed part key=_multipart_HFWA7DNUMWF2.2~6W6DE2HYQLV9.0 size=953177 2024-09-12T17:18:13.338 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.338+0000 7f574d1ea780 1 < completed multipart upload key=HFWA7DNUMWF2 upload=6W6DE2HYQLV9 tag=GLRWYB362DSA type=write size=2001753 2024-09-12T17:18:13.340 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.339+0000 7f574d1ea780 1 > prepared operation key=U6E9A5OH4GUW tag=ZKB0HTS5IM7I type=del size=1845149 2024-09-12T17:18:13.341 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.340+0000 7f574d1ea780 1 < completed part key=_multipart_K12MVG618809.2~J74AYGI4X7M3.0 size=1048576 2024-09-12T17:18:13.342 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.341+0000 7f574d1ea780 1 < completed part key=_multipart_K12MVG618809.2~J74AYGI4X7M3.1 size=1048576 2024-09-12T17:18:13.343 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.342+0000 7f574d1ea780 1 < completed part key=_multipart_K12MVG618809.2~J74AYGI4X7M3.2 size=948438 2024-09-12T17:18:13.345 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.344+0000 7f574d1ea780 1 < completed multipart upload key=K12MVG618809 upload=J74AYGI4X7M3 tag=NK6QOU18JPZV type=write size=4094166 2024-09-12T17:18:13.348 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.347+0000 7f574d1ea780 1 > prepared part key=_multipart_DH02JGZP64MN.2~9X0UMT03N27O.0 size=788120 2024-09-12T17:18:13.348 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.347+0000 7f574d1ea780 1 > prepared multipart upload key=DH02JGZP64MN upload=9X0UMT03N27O tag=Y0BAUWVB1SG3 type=write size=1836696 2024-09-12T17:18:13.349 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.348+0000 7f574d1ea780 1 < completed delete operation key=ZGH8XC39FGTC tag=1XK93DI4URCL type=del 2024-09-12T17:18:13.350 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.349+0000 7f574d1ea780 1 > prepared operation key=RNI86YYLADT0 tag=Q94KGHXUT4BX type=del size=673291 2024-09-12T17:18:13.351 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.351+0000 7f574d1ea780 1 < completed part key=_multipart_DH02JGZP64MN.2~M57XVJPNVXC6.0 size=1048576 2024-09-12T17:18:13.352 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.352+0000 7f574d1ea780 1 < completed part key=_multipart_DH02JGZP64MN.2~M57XVJPNVXC6.1 size=1048576 2024-09-12T17:18:13.353 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.353+0000 7f574d1ea780 1 < completed part key=_multipart_DH02JGZP64MN.2~M57XVJPNVXC6.2 size=987165 2024-09-12T17:18:13.356 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.355+0000 7f574d1ea780 1 < completed multipart upload key=DH02JGZP64MN upload=M57XVJPNVXC6 tag=G6HBGOH9FT5M type=write size=4132893 2024-09-12T17:18:13.357 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.356+0000 7f574d1ea780 1 > prepared operation key=HFWA7DNUMWF2 tag=IK0IT5TPU31S type=del size=688008 2024-09-12T17:18:13.358 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.358+0000 7f574d1ea780 1 < completed part key=_multipart_ZGE1860DMGHA.2~TL62H9KK5Z0N.0 size=1048576 2024-09-12T17:18:13.359 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.359+0000 7f574d1ea780 1 < completed part key=_multipart_ZGE1860DMGHA.2~TL62H9KK5Z0N.1 size=992079 2024-09-12T17:18:13.361 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.361+0000 7f574d1ea780 1 < completed multipart upload key=ZGE1860DMGHA upload=TL62H9KK5Z0N tag=B5ORKA0RD9TT type=write size=3089231 2024-09-12T17:18:13.364 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.363+0000 7f574d1ea780 1 > prepared part key=_multipart_UFKM4I8RMT0W.2~ZNKLVOQX2HTF.0 size=449645 2024-09-12T17:18:13.364 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.363+0000 7f574d1ea780 1 > prepared multipart upload key=UFKM4I8RMT0W upload=ZNKLVOQX2HTF tag=PUBIPS9ENQHM type=write size=1498221 2024-09-12T17:18:13.365 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.364+0000 7f574d1ea780 1 < completed part key=_multipart_43GV2N9VBBKE.2~STAM6CA657NO.0 size=1048576 2024-09-12T17:18:13.366 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.365+0000 7f574d1ea780 1 < completed part key=_multipart_43GV2N9VBBKE.2~STAM6CA657NO.1 size=85190 2024-09-12T17:18:13.368 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.367+0000 7f574d1ea780 1 < completed multipart upload key=43GV2N9VBBKE upload=STAM6CA657NO tag=XK5FR4YK7V9C type=write size=2182342 2024-09-12T17:18:13.369 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.368+0000 7f574d1ea780 1 > prepared operation key=HFWA7DNUMWF2 tag=Y61ZUHLM4B70 type=del size=1970586 2024-09-12T17:18:13.370 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.370+0000 7f574d1ea780 1 < completed part key=_multipart_D1GEG3MKPOM3.2~PO53AD30O0HP.0 size=1048576 2024-09-12T17:18:13.371 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.371+0000 7f574d1ea780 1 < completed part key=_multipart_D1GEG3MKPOM3.2~PO53AD30O0HP.1 size=1048576 2024-09-12T17:18:13.372 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.372+0000 7f574d1ea780 1 < completed part key=_multipart_D1GEG3MKPOM3.2~PO53AD30O0HP.2 size=143044 2024-09-12T17:18:13.375 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.374+0000 7f574d1ea780 1 < completed multipart upload key=D1GEG3MKPOM3 upload=PO53AD30O0HP tag=6L8Z0IZ0U4DN type=write size=3288772 2024-09-12T17:18:13.376 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.375+0000 7f574d1ea780 1 > prepared operation key=55V137SY4E4P tag=PMJS2J8R408A type=del size=2975459 2024-09-12T17:18:13.377 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.376+0000 7f574d1ea780 1 < completed delete operation key=8SG7DJO4HWPI tag=EHG2SJZAGD34 type=del 2024-09-12T17:18:13.378 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.378+0000 7f574d1ea780 1 > prepared operation key=OI51GO639LFK tag=CCL2JAO1CSPR type=del size=1620953 2024-09-12T17:18:13.380 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.379+0000 7f574d1ea780 1 < completed delete operation key=55V137SY4E4P tag=RSQ103SG6U1U type=del 2024-09-12T17:18:13.381 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.380+0000 7f574d1ea780 1 > prepared operation key=43GV2N9VBBKE tag=GQ6EQ8HOZN0K type=write size=924579 2024-09-12T17:18:13.382 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.381+0000 7f574d1ea780 1 < completed delete operation key=DH02JGZP64MN tag=HS7W1D3ICVKD type=del 2024-09-12T17:18:13.384 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.384+0000 7f574d1ea780 1 > prepared part key=_multipart_QXD8UG2K4STQ.2~VRL7PPKZA4P4.0 size=1048576 2024-09-12T17:18:13.386 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.385+0000 7f574d1ea780 1 > prepared part key=_multipart_QXD8UG2K4STQ.2~VRL7PPKZA4P4.1 size=1048576 2024-09-12T17:18:13.386 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.386+0000 7f574d1ea780 1 > prepared part key=_multipart_QXD8UG2K4STQ.2~VRL7PPKZA4P4.2 size=190525 2024-09-12T17:18:13.387 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.386+0000 7f574d1ea780 1 > prepared multipart upload key=QXD8UG2K4STQ upload=VRL7PPKZA4P4 tag=5NARCGCJHTMK type=write size=3336253 2024-09-12T17:18:13.388 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.387+0000 7f574d1ea780 1 < completed delete operation key=8VW3XCUHLF2L tag=VTAO0Y81FDP1 type=del 2024-09-12T17:18:13.390 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.389+0000 7f574d1ea780 1 > prepared part key=_multipart_R00F69ON5P6Z.2~2S4AZYF5SKE6.0 size=1048576 2024-09-12T17:18:13.391 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.390+0000 7f574d1ea780 1 > prepared part key=_multipart_R00F69ON5P6Z.2~2S4AZYF5SKE6.1 size=110047 2024-09-12T17:18:13.391 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.390+0000 7f574d1ea780 1 > prepared multipart upload key=R00F69ON5P6Z upload=2S4AZYF5SKE6 tag=94VJGII734QL type=write size=2207199 2024-09-12T17:18:13.393 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.392+0000 7f574d1ea780 1 < completed part key=_multipart_8SG7DJO4HWPI.2~DX621Q4OJR4C.0 size=1048576 2024-09-12T17:18:13.394 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.393+0000 7f574d1ea780 1 < completed part key=_multipart_8SG7DJO4HWPI.2~DX621Q4OJR4C.1 size=1048576 2024-09-12T17:18:13.395 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.395+0000 7f574d1ea780 1 < completed part key=_multipart_8SG7DJO4HWPI.2~DX621Q4OJR4C.2 size=77969 2024-09-12T17:18:13.397 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.397+0000 7f574d1ea780 1 < completed multipart upload key=8SG7DJO4HWPI upload=DX621Q4OJR4C tag=RGKVKOJ0TLQ9 type=write size=3223697 2024-09-12T17:18:13.399 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.398+0000 7f574d1ea780 1 > prepared operation key=A1TIP3RXHBCZ tag=GGOA3E2VPJSE type=write size=33309 2024-09-12T17:18:13.401 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.400+0000 7f574d1ea780 1 < suggested remove operation key=RWVWJHVZE95H tag=PM0KS9I4Z48N type=del 2024-09-12T17:18:13.402 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.402+0000 7f574d1ea780 1 > prepared operation key=QXD8UG2K4STQ tag=40DP9F7WVTKG type=write size=849143 2024-09-12T17:18:13.404 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.403+0000 7f574d1ea780 1 < completed delete operation key=43GV2N9VBBKE tag=D7QLY7C379IH type=del 2024-09-12T17:18:13.405 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.404+0000 7f574d1ea780 1 > prepared operation key=UTCKL1F42X8A tag=5W08G6Y3ZOGA type=del size=712815 2024-09-12T17:18:13.406 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.405+0000 7f574d1ea780 1 < completed write operation key=VWWA5IB0L4N1 tag=UZ4FBHL3P1YO type=write size=462728 2024-09-12T17:18:13.408 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.408+0000 7f574d1ea780 1 > prepared part key=_multipart_ZGH8XC39FGTC.2~FYOODKVGY81N.0 size=79910 2024-09-12T17:18:13.409 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.408+0000 7f574d1ea780 1 > prepared multipart upload key=ZGH8XC39FGTC upload=FYOODKVGY81N tag=KY2VPVP0RIXG type=write size=1128486 2024-09-12T17:18:13.411 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.410+0000 7f574d1ea780 1 < suggested update operation key=VWWA5IB0L4N1 tag=PBQCPJ00YHV0 type=del size=976999 2024-09-12T17:18:13.412 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.411+0000 7f574d1ea780 1 > prepared operation key=ENFNIFHQ3SHW tag=V84HD8K3K8RU type=del size=1110998 2024-09-12T17:18:13.414 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.414+0000 7f574d1ea780 1 < suggested update operation key=U6E9A5OH4GUW tag=ZKB0HTS5IM7I type=del size=1845149 2024-09-12T17:18:13.417 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.416+0000 7f574d1ea780 1 > prepared part key=_multipart_8SG7DJO4HWPI.2~2DALAOOVMOX1.0 size=1048576 2024-09-12T17:18:13.418 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.417+0000 7f574d1ea780 1 > prepared part key=_multipart_8SG7DJO4HWPI.2~2DALAOOVMOX1.1 size=875586 2024-09-12T17:18:13.418 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.417+0000 7f574d1ea780 1 > prepared multipart upload key=8SG7DJO4HWPI upload=2DALAOOVMOX1 tag=NBVZHX9Q61A7 type=write size=2972738 2024-09-12T17:18:13.419 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.418+0000 7f574d1ea780 1 < completed part key=_multipart_DH02JGZP64MN.2~9X0UMT03N27O.0 size=788120 2024-09-12T17:18:13.421 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.420+0000 7f574d1ea780 1 < completed multipart upload key=DH02JGZP64MN upload=9X0UMT03N27O tag=Y0BAUWVB1SG3 type=write size=1836696 2024-09-12T17:18:13.423 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.422+0000 7f574d1ea780 1 > prepared part key=_multipart_54CM8800AT9V.2~6789K73WY0AT.0 size=1048576 2024-09-12T17:18:13.424 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.423+0000 7f574d1ea780 1 > prepared part key=_multipart_54CM8800AT9V.2~6789K73WY0AT.1 size=1048576 2024-09-12T17:18:13.425 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.424+0000 7f574d1ea780 1 > prepared part key=_multipart_54CM8800AT9V.2~6789K73WY0AT.2 size=626789 2024-09-12T17:18:13.425 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.424+0000 7f574d1ea780 1 > prepared multipart upload key=54CM8800AT9V upload=6789K73WY0AT tag=OP16QP8L9LUC type=write size=3772517 2024-09-12T17:18:13.426 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.425+0000 7f574d1ea780 1 < completed delete operation key=RNI86YYLADT0 tag=Q94KGHXUT4BX type=del 2024-09-12T17:18:13.428 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.428+0000 7f574d1ea780 1 > prepared part key=_multipart_ENFNIFHQ3SHW.2~5662TO4FY1KH.0 size=758950 2024-09-12T17:18:13.429 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.428+0000 7f574d1ea780 1 > prepared multipart upload key=ENFNIFHQ3SHW upload=5662TO4FY1KH tag=MZJQXGDZH8F5 type=write size=1807526 2024-09-12T17:18:13.430 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.429+0000 7f574d1ea780 1 < completed delete operation key=HFWA7DNUMWF2 tag=IK0IT5TPU31S type=del 2024-09-12T17:18:13.431 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.430+0000 7f574d1ea780 1 > prepared operation key=HFWA7DNUMWF2 tag=Q5HDEWEQ7UZP type=del size=3112487 2024-09-12T17:18:13.433 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.432+0000 7f574d1ea780 1 < completed part key=_multipart_UFKM4I8RMT0W.2~ZNKLVOQX2HTF.0 size=449645 2024-09-12T17:18:13.434 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.434+0000 7f574d1ea780 1 < completed multipart upload key=UFKM4I8RMT0W upload=ZNKLVOQX2HTF tag=PUBIPS9ENQHM type=write size=1498221 2024-09-12T17:18:13.437 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.436+0000 7f574d1ea780 1 > prepared part key=_multipart_TIKBUXFPVTN1.2~ABK49LTCFQ57.0 size=1048576 2024-09-12T17:18:13.438 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.437+0000 7f574d1ea780 1 > prepared part key=_multipart_TIKBUXFPVTN1.2~ABK49LTCFQ57.1 size=167017 2024-09-12T17:18:13.438 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.437+0000 7f574d1ea780 1 > prepared multipart upload key=TIKBUXFPVTN1 upload=ABK49LTCFQ57 tag=23A4OYBBRYZA type=write size=2264169 2024-09-12T17:18:13.439 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.438+0000 7f574d1ea780 1 < canceled operation key=HFWA7DNUMWF2 tag=Y61ZUHLM4B70 type=del size=1970586 2024-09-12T17:18:13.440 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.439+0000 7f574d1ea780 1 > prepared operation key=7BX38Q7723EB tag=HBZ5QEW2TD8L type=del size=2173530 2024-09-12T17:18:13.441 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.441+0000 7f574d1ea780 1 < completed delete operation key=55V137SY4E4P tag=PMJS2J8R408A type=del 2024-09-12T17:18:13.442 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.442+0000 7f574d1ea780 1 > prepared operation key=TIKBUXFPVTN1 tag=4A05DDPKRB2U type=del size=3403263 2024-09-12T17:18:13.444 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.443+0000 7f574d1ea780 1 < completed delete operation key=OI51GO639LFK tag=CCL2JAO1CSPR type=del 2024-09-12T17:18:13.445 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.444+0000 7f574d1ea780 1 > prepared operation key=K12MVG618809 tag=INZFVXX6R8N0 type=del size=1095878 2024-09-12T17:18:13.446 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.445+0000 7f574d1ea780 1 < completed write operation key=43GV2N9VBBKE tag=GQ6EQ8HOZN0K type=write size=924579 2024-09-12T17:18:13.448 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.448+0000 7f574d1ea780 1 > prepared part key=_multipart_VWWA5IB0L4N1.2~4LSY2VZUGVDI.0 size=1048576 2024-09-12T17:18:13.449 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.449+0000 7f574d1ea780 1 > prepared part key=_multipart_VWWA5IB0L4N1.2~4LSY2VZUGVDI.1 size=166444 2024-09-12T17:18:13.450 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.449+0000 7f574d1ea780 1 > prepared multipart upload key=VWWA5IB0L4N1 upload=4LSY2VZUGVDI tag=8BEJXAQFCIQR type=write size=2263596 2024-09-12T17:18:13.451 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.450+0000 7f574d1ea780 1 < completed part key=_multipart_QXD8UG2K4STQ.2~VRL7PPKZA4P4.0 size=1048576 2024-09-12T17:18:13.452 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.451+0000 7f574d1ea780 1 < completed part key=_multipart_QXD8UG2K4STQ.2~VRL7PPKZA4P4.1 size=1048576 2024-09-12T17:18:13.453 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.452+0000 7f574d1ea780 1 < completed part key=_multipart_QXD8UG2K4STQ.2~VRL7PPKZA4P4.2 size=190525 2024-09-12T17:18:13.455 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.454+0000 7f574d1ea780 1 < completed multipart upload key=QXD8UG2K4STQ upload=VRL7PPKZA4P4 tag=5NARCGCJHTMK type=write size=3336253 2024-09-12T17:18:13.457 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.456+0000 7f574d1ea780 1 > prepared part key=_multipart_OI51GO639LFK.2~SXOWG3RYAGMZ.0 size=1048576 2024-09-12T17:18:13.458 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.457+0000 7f574d1ea780 1 > prepared part key=_multipart_OI51GO639LFK.2~SXOWG3RYAGMZ.1 size=744011 2024-09-12T17:18:13.458 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.457+0000 7f574d1ea780 1 > prepared multipart upload key=OI51GO639LFK upload=SXOWG3RYAGMZ tag=F52AAQ9B4NWX type=write size=2841163 2024-09-12T17:18:13.459 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.459+0000 7f574d1ea780 1 < completed part key=_multipart_R00F69ON5P6Z.2~2S4AZYF5SKE6.0 size=1048576 2024-09-12T17:18:13.460 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.460+0000 7f574d1ea780 1 < completed part key=_multipart_R00F69ON5P6Z.2~2S4AZYF5SKE6.1 size=110047 2024-09-12T17:18:13.463 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.462+0000 7f574d1ea780 1 < completed multipart upload key=R00F69ON5P6Z upload=2S4AZYF5SKE6 tag=94VJGII734QL type=write size=2207199 2024-09-12T17:18:13.464 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.463+0000 7f574d1ea780 1 > prepared operation key=A1TIP3RXHBCZ tag=2DGZLRKNP4IS type=del size=879629 2024-09-12T17:18:13.465 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.465+0000 7f574d1ea780 1 < completed write operation key=A1TIP3RXHBCZ tag=GGOA3E2VPJSE type=write size=33309 2024-09-12T17:18:13.467 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.466+0000 7f574d1ea780 1 > prepared operation key=U6E9A5OH4GUW tag=WRNYDS6GGZ3F type=del size=732169 2024-09-12T17:18:13.469 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.469+0000 7f574d1ea780 1 < suggested update operation key=QXD8UG2K4STQ tag=40DP9F7WVTKG type=write size=849143 2024-09-12T17:18:13.471 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.470+0000 7f574d1ea780 1 > prepared operation key=ENFNIFHQ3SHW tag=ZH31M2L6Y214 type=del size=2612849 2024-09-12T17:18:13.478 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.478+0000 7f574d1ea780 1 < completed delete operation key=UTCKL1F42X8A tag=5W08G6Y3ZOGA type=del 2024-09-12T17:18:13.480 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.479+0000 7f574d1ea780 1 > prepared operation key=K12MVG618809 tag=Q8VHKUGU30JL type=del size=2685717 2024-09-12T17:18:13.481 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.480+0000 7f574d1ea780 1 < completed part key=_multipart_ZGH8XC39FGTC.2~FYOODKVGY81N.0 size=79910 2024-09-12T17:18:13.484 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.483+0000 7f574d1ea780 1 < completed multipart upload key=ZGH8XC39FGTC upload=FYOODKVGY81N tag=KY2VPVP0RIXG type=write size=1128486 2024-09-12T17:18:13.487 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.486+0000 7f574d1ea780 1 > prepared part key=_multipart_ZGH8XC39FGTC.2~3Y12JHD4WYD6.0 size=1016214 2024-09-12T17:18:13.487 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.486+0000 7f574d1ea780 1 > prepared multipart upload key=ZGH8XC39FGTC upload=3Y12JHD4WYD6 tag=TV32M0RLVKC6 type=write size=2064790 2024-09-12T17:18:13.488 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.488+0000 7f574d1ea780 1 < completed delete operation key=ENFNIFHQ3SHW tag=V84HD8K3K8RU type=del 2024-09-12T17:18:13.491 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.490+0000 7f574d1ea780 1 > prepared part key=_multipart_Q2Q3B1J3DAVD.2~8OXDBMTYNQJR.0 size=1048576 2024-09-12T17:18:13.492 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.491+0000 7f574d1ea780 1 > prepared part key=_multipart_Q2Q3B1J3DAVD.2~8OXDBMTYNQJR.1 size=183740 2024-09-12T17:18:13.492 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.491+0000 7f574d1ea780 1 > prepared multipart upload key=Q2Q3B1J3DAVD upload=8OXDBMTYNQJR tag=755SGTN31A4H type=write size=2280892 2024-09-12T17:18:13.493 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.492+0000 7f574d1ea780 1 < completed part key=_multipart_8SG7DJO4HWPI.2~2DALAOOVMOX1.0 size=1048576 2024-09-12T17:18:13.494 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.493+0000 7f574d1ea780 1 < completed part key=_multipart_8SG7DJO4HWPI.2~2DALAOOVMOX1.1 size=875586 2024-09-12T17:18:13.496 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.495+0000 7f574d1ea780 1 < completed multipart upload key=8SG7DJO4HWPI upload=2DALAOOVMOX1 tag=NBVZHX9Q61A7 type=write size=2972738 2024-09-12T17:18:13.497 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.496+0000 7f574d1ea780 1 > prepared operation key=A1TIP3RXHBCZ tag=23N4C2MNAZ49 type=del size=643822 2024-09-12T17:18:13.499 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.498+0000 7f574d1ea780 1 < completed part key=_multipart_54CM8800AT9V.2~6789K73WY0AT.0 size=1048576 2024-09-12T17:18:13.499 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.498+0000 7f574d1ea780 1 < canceled part key=_multipart_54CM8800AT9V.2~6789K73WY0AT.1 size=1048576 2024-09-12T17:18:13.500 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.499+0000 7f574d1ea780 1 < completed part key=_multipart_54CM8800AT9V.2~6789K73WY0AT.2 size=626789 2024-09-12T17:18:13.502 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.501+0000 7f574d1ea780 1 < canceled multipart upload key=54CM8800AT9V upload=6789K73WY0AT tag=OP16QP8L9LUC type=write size=3772517 2024-09-12T17:18:13.504 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.503+0000 7f574d1ea780 1 > prepared part key=_multipart_DH02JGZP64MN.2~QXGYSY7P8B2K.0 size=1048576 2024-09-12T17:18:13.505 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.504+0000 7f574d1ea780 1 > prepared part key=_multipart_DH02JGZP64MN.2~QXGYSY7P8B2K.1 size=1048576 2024-09-12T17:18:13.506 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.505+0000 7f574d1ea780 1 > prepared part key=_multipart_DH02JGZP64MN.2~QXGYSY7P8B2K.2 size=332939 2024-09-12T17:18:13.506 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.505+0000 7f574d1ea780 1 > prepared multipart upload key=DH02JGZP64MN upload=QXGYSY7P8B2K tag=VGLABPMT1HKM type=write size=3478667 2024-09-12T17:18:13.508 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.507+0000 7f574d1ea780 1 < completed part key=_multipart_ENFNIFHQ3SHW.2~5662TO4FY1KH.0 size=758950 2024-09-12T17:18:13.510 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.509+0000 7f574d1ea780 1 < completed multipart upload key=ENFNIFHQ3SHW upload=5662TO4FY1KH tag=MZJQXGDZH8F5 type=write size=1807526 2024-09-12T17:18:13.512 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.511+0000 7f574d1ea780 1 > prepared part key=_multipart_YXIDO0U18839.2~5XU72QPS533Q.0 size=1048576 2024-09-12T17:18:13.513 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.512+0000 7f574d1ea780 1 > prepared part key=_multipart_YXIDO0U18839.2~5XU72QPS533Q.1 size=48310 2024-09-12T17:18:13.513 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.512+0000 7f574d1ea780 1 > prepared multipart upload key=YXIDO0U18839 upload=5XU72QPS533Q tag=1JOG6ETC8F3Y type=write size=2145462 2024-09-12T17:18:13.516 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.515+0000 7f574d1ea780 1 < suggested remove operation key=HFWA7DNUMWF2 tag=Q5HDEWEQ7UZP type=del 2024-09-12T17:18:13.518 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.517+0000 7f574d1ea780 1 > prepared operation key=TIKBUXFPVTN1 tag=PK73RDRCKMEW type=del size=1667603 2024-09-12T17:18:13.519 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.518+0000 7f574d1ea780 1 < completed part key=_multipart_TIKBUXFPVTN1.2~ABK49LTCFQ57.0 size=1048576 2024-09-12T17:18:13.520 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.519+0000 7f574d1ea780 1 < completed part key=_multipart_TIKBUXFPVTN1.2~ABK49LTCFQ57.1 size=167017 2024-09-12T17:18:13.522 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.521+0000 7f574d1ea780 1 < completed multipart upload key=TIKBUXFPVTN1 upload=ABK49LTCFQ57 tag=23A4OYBBRYZA type=write size=2264169 2024-09-12T17:18:13.523 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.522+0000 7f574d1ea780 1 > prepared operation key=55V137SY4E4P tag=W16KP2AP7LV5 type=del size=2214682 2024-09-12T17:18:13.526 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.525+0000 7f574d1ea780 1 < suggested update operation key=7BX38Q7723EB tag=HBZ5QEW2TD8L type=del size=2173530 2024-09-12T17:18:13.529 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.528+0000 7f574d1ea780 1 > prepared part key=_multipart_Q2Q3B1J3DAVD.2~IIEG16F67RZB.0 size=1048576 2024-09-12T17:18:13.530 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.529+0000 7f574d1ea780 1 > prepared part key=_multipart_Q2Q3B1J3DAVD.2~IIEG16F67RZB.1 size=1048576 2024-09-12T17:18:13.531 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.530+0000 7f574d1ea780 1 > prepared part key=_multipart_Q2Q3B1J3DAVD.2~IIEG16F67RZB.2 size=541886 2024-09-12T17:18:13.531 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.530+0000 7f574d1ea780 1 > prepared multipart upload key=Q2Q3B1J3DAVD upload=IIEG16F67RZB tag=WVHNDTZ35W4P type=write size=3687614 2024-09-12T17:18:13.532 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.532+0000 7f574d1ea780 1 < completed delete operation key=TIKBUXFPVTN1 tag=4A05DDPKRB2U type=del 2024-09-12T17:18:13.535 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.534+0000 7f574d1ea780 1 > prepared part key=_multipart_HGZMN894YYC0.2~A6TMBWZVCIYD.0 size=990271 2024-09-12T17:18:13.535 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.534+0000 7f574d1ea780 1 > prepared multipart upload key=HGZMN894YYC0 upload=A6TMBWZVCIYD tag=CYSIF9270XZS type=write size=2038847 2024-09-12T17:18:13.536 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.536+0000 7f574d1ea780 1 < completed delete operation key=K12MVG618809 tag=INZFVXX6R8N0 type=del 2024-09-12T17:18:13.538 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.537+0000 7f574d1ea780 1 > prepared operation key=VWWA5IB0L4N1 tag=QMUH5EJMFYZE type=del size=59999 2024-09-12T17:18:13.539 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.539+0000 7f574d1ea780 1 < completed part key=_multipart_VWWA5IB0L4N1.2~4LSY2VZUGVDI.0 size=1048576 2024-09-12T17:18:13.541 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.540+0000 7f574d1ea780 1 < completed part key=_multipart_VWWA5IB0L4N1.2~4LSY2VZUGVDI.1 size=166444 2024-09-12T17:18:13.543 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.542+0000 7f574d1ea780 1 < completed multipart upload key=VWWA5IB0L4N1 upload=4LSY2VZUGVDI tag=8BEJXAQFCIQR type=write size=2263596 2024-09-12T17:18:13.544 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.544+0000 7f574d1ea780 1 > prepared operation key=ENFNIFHQ3SHW tag=WTIOE4E688O0 type=del size=790762 2024-09-12T17:18:13.546 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.545+0000 7f574d1ea780 1 < completed part key=_multipart_OI51GO639LFK.2~SXOWG3RYAGMZ.0 size=1048576 2024-09-12T17:18:13.547 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.546+0000 7f574d1ea780 1 < completed part key=_multipart_OI51GO639LFK.2~SXOWG3RYAGMZ.1 size=744011 2024-09-12T17:18:13.549 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.549+0000 7f574d1ea780 1 < completed multipart upload key=OI51GO639LFK upload=SXOWG3RYAGMZ tag=F52AAQ9B4NWX type=write size=2841163 2024-09-12T17:18:13.551 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.550+0000 7f574d1ea780 1 > prepared operation key=QXD8UG2K4STQ tag=YBRKJ5ZUKMAX type=del size=2584057 2024-09-12T17:18:13.552 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.551+0000 7f574d1ea780 1 < completed delete operation key=A1TIP3RXHBCZ tag=2DGZLRKNP4IS type=del 2024-09-12T17:18:13.553 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.552+0000 7f574d1ea780 1 > prepared operation key=55JI541K1WP2 tag=0CA6XCBLMFMC type=del size=161665 2024-09-12T17:18:13.554 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.553+0000 7f574d1ea780 1 < completed delete operation key=U6E9A5OH4GUW tag=WRNYDS6GGZ3F type=del 2024-09-12T17:18:13.556 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.555+0000 7f574d1ea780 1 > prepared part key=_multipart_GEGOEB05R0PK.2~47EJUZSQ43EV.0 size=1048576 2024-09-12T17:18:13.557 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.556+0000 7f574d1ea780 1 > prepared part key=_multipart_GEGOEB05R0PK.2~47EJUZSQ43EV.1 size=1004306 2024-09-12T17:18:13.557 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.556+0000 7f574d1ea780 1 > prepared multipart upload key=GEGOEB05R0PK upload=47EJUZSQ43EV tag=RONVC69UYF1S type=write size=3101458 2024-09-12T17:18:13.558 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.558+0000 7f574d1ea780 1 < completed delete operation key=ENFNIFHQ3SHW tag=ZH31M2L6Y214 type=del 2024-09-12T17:18:13.561 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.560+0000 7f574d1ea780 1 > prepared part key=_multipart_GEGOEB05R0PK.2~873A0MBM8ZRY.0 size=1048576 2024-09-12T17:18:13.562 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.561+0000 7f574d1ea780 1 > prepared part key=_multipart_GEGOEB05R0PK.2~873A0MBM8ZRY.1 size=1048576 2024-09-12T17:18:13.563 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.562+0000 7f574d1ea780 1 > prepared part key=_multipart_GEGOEB05R0PK.2~873A0MBM8ZRY.2 size=1012025 2024-09-12T17:18:13.563 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.562+0000 7f574d1ea780 1 > prepared multipart upload key=GEGOEB05R0PK upload=873A0MBM8ZRY tag=CYD8WOTNA2OC type=write size=4157753 2024-09-12T17:18:13.564 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.563+0000 7f574d1ea780 1 < completed delete operation key=K12MVG618809 tag=Q8VHKUGU30JL type=del 2024-09-12T17:18:13.565 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.564+0000 7f574d1ea780 1 > prepared operation key=UFKM4I8RMT0W tag=BOAZM512T2T7 type=del size=228315 2024-09-12T17:18:13.565 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.564+0000 7f574d1ea780 1 < canceled part key=_multipart_ZGH8XC39FGTC.2~3Y12JHD4WYD6.0 size=1016214 2024-09-12T17:18:13.567 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.566+0000 7f574d1ea780 1 < canceled multipart upload key=ZGH8XC39FGTC upload=3Y12JHD4WYD6 tag=TV32M0RLVKC6 type=write size=2064790 2024-09-12T17:18:13.568 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.568+0000 7f574d1ea780 1 > prepared operation key=R00F69ON5P6Z tag=5HOA19NLE7BN type=del size=3349394 2024-09-12T17:18:13.570 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.569+0000 7f574d1ea780 1 < completed part key=_multipart_Q2Q3B1J3DAVD.2~8OXDBMTYNQJR.0 size=1048576 2024-09-12T17:18:13.571 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.570+0000 7f574d1ea780 1 < completed part key=_multipart_Q2Q3B1J3DAVD.2~8OXDBMTYNQJR.1 size=183740 2024-09-12T17:18:13.573 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.572+0000 7f574d1ea780 1 < completed multipart upload key=Q2Q3B1J3DAVD upload=8OXDBMTYNQJR tag=755SGTN31A4H type=write size=2280892 2024-09-12T17:18:13.574 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.573+0000 7f574d1ea780 1 > prepared operation key=UFKM4I8RMT0W tag=I1WIQEVZXAOR type=del size=2549407 2024-09-12T17:18:13.576 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.575+0000 7f574d1ea780 1 < completed delete operation key=A1TIP3RXHBCZ tag=23N4C2MNAZ49 type=del 2024-09-12T17:18:13.577 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.576+0000 7f574d1ea780 1 > prepared operation key=8VW3XCUHLF2L tag=4H05Q8TFI25N type=del size=4135998 2024-09-12T17:18:13.578 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.577+0000 7f574d1ea780 1 < completed part key=_multipart_DH02JGZP64MN.2~QXGYSY7P8B2K.0 size=1048576 2024-09-12T17:18:13.579 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.578+0000 7f574d1ea780 1 < completed part key=_multipart_DH02JGZP64MN.2~QXGYSY7P8B2K.1 size=1048576 2024-09-12T17:18:13.580 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.579+0000 7f574d1ea780 1 < completed part key=_multipart_DH02JGZP64MN.2~QXGYSY7P8B2K.2 size=332939 2024-09-12T17:18:13.582 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.581+0000 7f574d1ea780 1 < completed multipart upload key=DH02JGZP64MN upload=QXGYSY7P8B2K tag=VGLABPMT1HKM type=write size=3478667 2024-09-12T17:18:13.584 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.584+0000 7f574d1ea780 1 > prepared part key=_multipart_ZGE1860DMGHA.2~F1AGUTBQW99W.0 size=1048576 2024-09-12T17:18:13.585 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.585+0000 7f574d1ea780 1 > prepared part key=_multipart_ZGE1860DMGHA.2~F1AGUTBQW99W.1 size=381891 2024-09-12T17:18:13.585 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.585+0000 7f574d1ea780 1 > prepared multipart upload key=ZGE1860DMGHA upload=F1AGUTBQW99W tag=1WJF12F1ZRK2 type=write size=2479043 2024-09-12T17:18:13.587 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.586+0000 7f574d1ea780 1 < completed part key=_multipart_YXIDO0U18839.2~5XU72QPS533Q.0 size=1048576 2024-09-12T17:18:13.588 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.587+0000 7f574d1ea780 1 < completed part key=_multipart_YXIDO0U18839.2~5XU72QPS533Q.1 size=48310 2024-09-12T17:18:13.590 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.589+0000 7f574d1ea780 1 < completed multipart upload key=YXIDO0U18839 upload=5XU72QPS533Q tag=1JOG6ETC8F3Y type=write size=2145462 2024-09-12T17:18:13.591 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.590+0000 7f574d1ea780 1 > prepared operation key=DH02JGZP64MN tag=M6IW0GYXNX08 type=del size=2680396 2024-09-12T17:18:13.592 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.591+0000 7f574d1ea780 1 < completed delete operation key=TIKBUXFPVTN1 tag=PK73RDRCKMEW type=del 2024-09-12T17:18:13.594 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.592+0000 7f574d1ea780 1 > prepared operation key=8SG7DJO4HWPI tag=C4TBKDJA8SB9 type=del size=858121 2024-09-12T17:18:13.595 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.594+0000 7f574d1ea780 1 < completed delete operation key=55V137SY4E4P tag=W16KP2AP7LV5 type=del 2024-09-12T17:18:13.596 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.595+0000 7f574d1ea780 1 > prepared operation key=8VW3XCUHLF2L tag=681U7EKC26SH type=del size=717341 2024-09-12T17:18:13.597 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.596+0000 7f574d1ea780 1 < completed part key=_multipart_Q2Q3B1J3DAVD.2~IIEG16F67RZB.0 size=1048576 2024-09-12T17:18:13.598 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.597+0000 7f574d1ea780 1 < completed part key=_multipart_Q2Q3B1J3DAVD.2~IIEG16F67RZB.1 size=1048576 2024-09-12T17:18:13.599 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.598+0000 7f574d1ea780 1 < completed part key=_multipart_Q2Q3B1J3DAVD.2~IIEG16F67RZB.2 size=541886 2024-09-12T17:18:13.601 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.600+0000 7f574d1ea780 1 < completed multipart upload key=Q2Q3B1J3DAVD upload=IIEG16F67RZB tag=WVHNDTZ35W4P type=write size=3687614 2024-09-12T17:18:13.602 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.601+0000 7f574d1ea780 1 > prepared operation key=HGZMN894YYC0 tag=MYLZ3T97A5TE type=del size=1393427 2024-09-12T17:18:13.604 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.603+0000 7f574d1ea780 1 < completed part key=_multipart_HGZMN894YYC0.2~A6TMBWZVCIYD.0 size=990271 2024-09-12T17:18:13.606 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.605+0000 7f574d1ea780 1 < completed multipart upload key=HGZMN894YYC0 upload=A6TMBWZVCIYD tag=CYSIF9270XZS type=write size=2038847 2024-09-12T17:18:13.607 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.606+0000 7f574d1ea780 1 > prepared operation key=54CM8800AT9V tag=ANYXONTYXQVA type=del size=688384 2024-09-12T17:18:13.608 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.607+0000 7f574d1ea780 1 < canceled operation key=VWWA5IB0L4N1 tag=QMUH5EJMFYZE type=del size=59999 2024-09-12T17:18:13.609 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.608+0000 7f574d1ea780 1 > prepared operation key=YXIDO0U18839 tag=L83H4PM2ADE8 type=del size=1510924 2024-09-12T17:18:13.610 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.610+0000 7f574d1ea780 1 < completed delete operation key=ENFNIFHQ3SHW tag=WTIOE4E688O0 type=del 2024-09-12T17:18:13.613 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.612+0000 7f574d1ea780 1 > prepared part key=_multipart_HFWA7DNUMWF2.2~GJO4PT0P0501.0 size=1048576 2024-09-12T17:18:13.614 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.613+0000 7f574d1ea780 1 > prepared part key=_multipart_HFWA7DNUMWF2.2~GJO4PT0P0501.1 size=894235 2024-09-12T17:18:13.614 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.613+0000 7f574d1ea780 1 > prepared multipart upload key=HFWA7DNUMWF2 upload=GJO4PT0P0501 tag=E68B8AIIWWSM type=write size=2991387 2024-09-12T17:18:13.615 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.614+0000 7f574d1ea780 1 < completed delete operation key=QXD8UG2K4STQ tag=YBRKJ5ZUKMAX type=del 2024-09-12T17:18:13.617 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.616+0000 7f574d1ea780 1 > prepared part key=_multipart_QXD8UG2K4STQ.2~50WPM18LDOJC.0 size=1048576 2024-09-12T17:18:13.619 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.619+0000 7f574d1ea780 1 > prepared part key=_multipart_QXD8UG2K4STQ.2~50WPM18LDOJC.1 size=1048576 2024-09-12T17:18:13.620 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.620+0000 7f574d1ea780 1 > prepared part key=_multipart_QXD8UG2K4STQ.2~50WPM18LDOJC.2 size=833042 2024-09-12T17:18:13.621 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.620+0000 7f574d1ea780 1 > prepared multipart upload key=QXD8UG2K4STQ upload=50WPM18LDOJC tag=H03GCISDM24D type=write size=3978770 2024-09-12T17:18:13.623 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.622+0000 7f574d1ea780 1 < suggested update operation key=55JI541K1WP2 tag=0CA6XCBLMFMC type=del size=161665 2024-09-12T17:18:13.625 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.624+0000 7f574d1ea780 1 > prepared part key=_multipart_55V137SY4E4P.2~RY0QW6TKD44G.0 size=1048576 2024-09-12T17:18:13.626 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.625+0000 7f574d1ea780 1 > prepared part key=_multipart_55V137SY4E4P.2~RY0QW6TKD44G.1 size=883112 2024-09-12T17:18:13.626 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.625+0000 7f574d1ea780 1 > prepared multipart upload key=55V137SY4E4P upload=RY0QW6TKD44G tag=0IWGCD4X47SY type=write size=2980264 2024-09-12T17:18:13.627 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.626+0000 7f574d1ea780 1 < completed part key=_multipart_GEGOEB05R0PK.2~47EJUZSQ43EV.0 size=1048576 2024-09-12T17:18:13.628 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.627+0000 7f574d1ea780 1 < completed part key=_multipart_GEGOEB05R0PK.2~47EJUZSQ43EV.1 size=1004306 2024-09-12T17:18:13.630 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.630+0000 7f574d1ea780 1 < completed multipart upload key=GEGOEB05R0PK upload=47EJUZSQ43EV tag=RONVC69UYF1S type=write size=3101458 2024-09-12T17:18:13.632 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.631+0000 7f574d1ea780 1 > prepared operation key=ZGE1860DMGHA tag=45LCSVJ460S1 type=write size=160866 2024-09-12T17:18:13.633 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.632+0000 7f574d1ea780 1 < completed part key=_multipart_GEGOEB05R0PK.2~873A0MBM8ZRY.0 size=1048576 2024-09-12T17:18:13.634 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.633+0000 7f574d1ea780 1 < completed part key=_multipart_GEGOEB05R0PK.2~873A0MBM8ZRY.1 size=1048576 2024-09-12T17:18:13.636 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.635+0000 7f574d1ea780 1 < completed part key=_multipart_GEGOEB05R0PK.2~873A0MBM8ZRY.2 size=1012025 2024-09-12T17:18:13.639 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.638+0000 7f574d1ea780 1 < completed multipart upload key=GEGOEB05R0PK upload=873A0MBM8ZRY tag=CYD8WOTNA2OC type=write size=4157753 2024-09-12T17:18:13.642 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.641+0000 7f574d1ea780 1 > prepared part key=_multipart_HFWA7DNUMWF2.2~KOE0AKSKBS8F.0 size=1048576 2024-09-12T17:18:13.643 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.642+0000 7f574d1ea780 1 > prepared part key=_multipart_HFWA7DNUMWF2.2~KOE0AKSKBS8F.1 size=921072 2024-09-12T17:18:13.643 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.642+0000 7f574d1ea780 1 > prepared multipart upload key=HFWA7DNUMWF2 upload=KOE0AKSKBS8F tag=FEVRMH8CKOAI type=write size=3018224 2024-09-12T17:18:13.644 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.643+0000 7f574d1ea780 1 < completed delete operation key=UFKM4I8RMT0W tag=BOAZM512T2T7 type=del 2024-09-12T17:18:13.646 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.646+0000 7f574d1ea780 1 > prepared part key=_multipart_R00F69ON5P6Z.2~WOCCI0DOQ9P9.0 size=1048576 2024-09-12T17:18:13.647 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.647+0000 7f574d1ea780 1 > prepared part key=_multipart_R00F69ON5P6Z.2~WOCCI0DOQ9P9.1 size=1048576 2024-09-12T17:18:13.648 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.648+0000 7f574d1ea780 1 > prepared part key=_multipart_R00F69ON5P6Z.2~WOCCI0DOQ9P9.2 size=539444 2024-09-12T17:18:13.649 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.648+0000 7f574d1ea780 1 > prepared multipart upload key=R00F69ON5P6Z upload=WOCCI0DOQ9P9 tag=HDBUYCOW4YA8 type=write size=3685172 2024-09-12T17:18:13.650 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.649+0000 7f574d1ea780 1 < canceled operation key=R00F69ON5P6Z tag=5HOA19NLE7BN type=del size=3349394 2024-09-12T17:18:13.651 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.650+0000 7f574d1ea780 1 > prepared operation key=QXD8UG2K4STQ tag=YMKTPDPF5QIF type=write size=666203 2024-09-12T17:18:13.652 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.651+0000 7f574d1ea780 1 < completed delete operation key=UFKM4I8RMT0W tag=I1WIQEVZXAOR type=del 2024-09-12T17:18:13.653 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.652+0000 7f574d1ea780 1 > prepared operation key=QXD8UG2K4STQ tag=QRY917OTUS3Y type=del size=1308625 2024-09-12T17:18:13.654 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.654+0000 7f574d1ea780 1 < completed delete operation key=8VW3XCUHLF2L tag=4H05Q8TFI25N type=del 2024-09-12T17:18:13.656 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.655+0000 7f574d1ea780 1 > prepared operation key=54CM8800AT9V tag=10A59XF1WRMU type=del size=1969646 2024-09-12T17:18:13.657 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.656+0000 7f574d1ea780 1 < completed part key=_multipart_ZGE1860DMGHA.2~F1AGUTBQW99W.0 size=1048576 2024-09-12T17:18:13.658 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.657+0000 7f574d1ea780 1 < completed part key=_multipart_ZGE1860DMGHA.2~F1AGUTBQW99W.1 size=381891 2024-09-12T17:18:13.660 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.659+0000 7f574d1ea780 1 < completed multipart upload key=ZGE1860DMGHA upload=F1AGUTBQW99W tag=1WJF12F1ZRK2 type=write size=2479043 2024-09-12T17:18:13.662 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.661+0000 7f574d1ea780 1 > prepared part key=_multipart_43GV2N9VBBKE.2~4C82CNTK05HR.0 size=1048576 2024-09-12T17:18:13.663 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.662+0000 7f574d1ea780 1 > prepared part key=_multipart_43GV2N9VBBKE.2~4C82CNTK05HR.1 size=1048576 2024-09-12T17:18:13.664 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.663+0000 7f574d1ea780 1 > prepared part key=_multipart_43GV2N9VBBKE.2~4C82CNTK05HR.2 size=1046083 2024-09-12T17:18:13.664 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.663+0000 7f574d1ea780 1 > prepared multipart upload key=43GV2N9VBBKE upload=4C82CNTK05HR tag=BP2Q8PYZFFPT type=write size=4191811 2024-09-12T17:18:13.666 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.665+0000 7f574d1ea780 1 < suggested remove operation key=DH02JGZP64MN tag=M6IW0GYXNX08 type=del 2024-09-12T17:18:13.667 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.666+0000 7f574d1ea780 1 > prepared operation key=SQQMJ61CA0QW tag=E1Y8JHIQUEHH type=write size=672149 2024-09-12T17:18:13.670 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.669+0000 7f574d1ea780 1 < suggested update operation key=8SG7DJO4HWPI tag=C4TBKDJA8SB9 type=del size=858121 2024-09-12T17:18:13.672 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.671+0000 7f574d1ea780 1 > prepared part key=_multipart_54CM8800AT9V.2~CWOZA0OZEPB3.0 size=1048576 2024-09-12T17:18:13.673 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.672+0000 7f574d1ea780 1 > prepared part key=_multipart_54CM8800AT9V.2~CWOZA0OZEPB3.1 size=18446 2024-09-12T17:18:13.673 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.672+0000 7f574d1ea780 1 > prepared multipart upload key=54CM8800AT9V upload=CWOZA0OZEPB3 tag=00W12WY64HUC type=write size=2115598 2024-09-12T17:18:13.674 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.673+0000 7f574d1ea780 1 < completed delete operation key=8VW3XCUHLF2L tag=681U7EKC26SH type=del 2024-09-12T17:18:13.675 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.674+0000 7f574d1ea780 1 > prepared operation key=UTCKL1F42X8A tag=G40DYGN4IZUE type=del size=4167074 2024-09-12T17:18:13.677 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.677+0000 7f574d1ea780 1 < suggested remove operation key=HGZMN894YYC0 tag=MYLZ3T97A5TE type=del 2024-09-12T17:18:13.680 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.679+0000 7f574d1ea780 1 > prepared part key=_multipart_54LQ91UMBJAN.2~F6GKT9X5MOON.0 size=1048576 2024-09-12T17:18:13.681 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.680+0000 7f574d1ea780 1 > prepared part key=_multipart_54LQ91UMBJAN.2~F6GKT9X5MOON.1 size=1048576 2024-09-12T17:18:13.682 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.681+0000 7f574d1ea780 1 > prepared part key=_multipart_54LQ91UMBJAN.2~F6GKT9X5MOON.2 size=775493 2024-09-12T17:18:13.682 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.681+0000 7f574d1ea780 1 > prepared multipart upload key=54LQ91UMBJAN upload=F6GKT9X5MOON tag=J9QOQ0QSD5L6 type=write size=3921221 2024-09-12T17:18:13.683 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.682+0000 7f574d1ea780 1 < canceled operation key=54CM8800AT9V tag=ANYXONTYXQVA type=del size=688384 2024-09-12T17:18:13.685 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.684+0000 7f574d1ea780 1 > prepared part key=_multipart_HFWA7DNUMWF2.2~TBKICRESZ0AR.0 size=1048576 2024-09-12T17:18:13.686 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.685+0000 7f574d1ea780 1 > prepared part key=_multipart_HFWA7DNUMWF2.2~TBKICRESZ0AR.1 size=1048576 2024-09-12T17:18:13.688 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.687+0000 7f574d1ea780 1 > prepared part key=_multipart_HFWA7DNUMWF2.2~TBKICRESZ0AR.2 size=390734 2024-09-12T17:18:13.688 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.687+0000 7f574d1ea780 1 > prepared multipart upload key=HFWA7DNUMWF2 upload=TBKICRESZ0AR tag=1E2EE1D6HGHH type=write size=3536462 2024-09-12T17:18:13.690 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.689+0000 7f574d1ea780 1 < suggested remove operation key=YXIDO0U18839 tag=L83H4PM2ADE8 type=del 2024-09-12T17:18:13.692 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.691+0000 7f574d1ea780 1 > prepared operation key=UTCKL1F42X8A tag=EWA67IDDUE40 type=del size=595891 2024-09-12T17:18:13.693 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.692+0000 7f574d1ea780 1 < completed part key=_multipart_HFWA7DNUMWF2.2~GJO4PT0P0501.0 size=1048576 2024-09-12T17:18:13.697 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.693+0000 7f574d1ea780 1 < completed part key=_multipart_HFWA7DNUMWF2.2~GJO4PT0P0501.1 size=894235 2024-09-12T17:18:13.697 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.696+0000 7f574d1ea780 1 < completed multipart upload key=HFWA7DNUMWF2 upload=GJO4PT0P0501 tag=E68B8AIIWWSM type=write size=2991387 2024-09-12T17:18:13.698 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.697+0000 7f574d1ea780 1 > prepared operation key=55V137SY4E4P tag=Y6VCC1QJF9P2 type=del size=2945948 2024-09-12T17:18:13.699 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.698+0000 7f574d1ea780 1 < completed part key=_multipart_QXD8UG2K4STQ.2~50WPM18LDOJC.0 size=1048576 2024-09-12T17:18:13.700 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.699+0000 7f574d1ea780 1 < completed part key=_multipart_QXD8UG2K4STQ.2~50WPM18LDOJC.1 size=1048576 2024-09-12T17:18:13.701 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.700+0000 7f574d1ea780 1 < completed part key=_multipart_QXD8UG2K4STQ.2~50WPM18LDOJC.2 size=833042 2024-09-12T17:18:13.703 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.702+0000 7f574d1ea780 1 < completed multipart upload key=QXD8UG2K4STQ upload=50WPM18LDOJC tag=H03GCISDM24D type=write size=3978770 2024-09-12T17:18:13.704 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.704+0000 7f574d1ea780 1 > prepared operation key=U6E9A5OH4GUW tag=XCDBZTH398Y2 type=write size=362474 2024-09-12T17:18:13.706 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.705+0000 7f574d1ea780 1 < completed part key=_multipart_55V137SY4E4P.2~RY0QW6TKD44G.0 size=1048576 2024-09-12T17:18:13.707 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.706+0000 7f574d1ea780 1 < completed part key=_multipart_55V137SY4E4P.2~RY0QW6TKD44G.1 size=883112 2024-09-12T17:18:13.709 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.708+0000 7f574d1ea780 1 < completed multipart upload key=55V137SY4E4P upload=RY0QW6TKD44G tag=0IWGCD4X47SY type=write size=2980264 2024-09-12T17:18:13.711 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.710+0000 7f574d1ea780 1 > prepared part key=_multipart_8SG7DJO4HWPI.2~9PF6IR7HKKSW.0 size=1048576 2024-09-12T17:18:13.712 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.711+0000 7f574d1ea780 1 > prepared part key=_multipart_8SG7DJO4HWPI.2~9PF6IR7HKKSW.1 size=624670 2024-09-12T17:18:13.712 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.711+0000 7f574d1ea780 1 > prepared multipart upload key=8SG7DJO4HWPI upload=9PF6IR7HKKSW tag=ZKFY0CDLC4BN type=write size=2721822 2024-09-12T17:18:13.713 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.713+0000 7f574d1ea780 1 < completed write operation key=ZGE1860DMGHA tag=45LCSVJ460S1 type=write size=160866 2024-09-12T17:18:13.715 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.714+0000 7f574d1ea780 1 > prepared operation key=HGZMN894YYC0 tag=6YP9JCFHXTZ9 type=write size=834695 2024-09-12T17:18:13.716 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.715+0000 7f574d1ea780 1 < completed part key=_multipart_HFWA7DNUMWF2.2~KOE0AKSKBS8F.0 size=1048576 2024-09-12T17:18:13.717 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.716+0000 7f574d1ea780 1 < completed part key=_multipart_HFWA7DNUMWF2.2~KOE0AKSKBS8F.1 size=921072 2024-09-12T17:18:13.719 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.718+0000 7f574d1ea780 1 < completed multipart upload key=HFWA7DNUMWF2 upload=KOE0AKSKBS8F tag=FEVRMH8CKOAI type=write size=3018224 2024-09-12T17:18:13.720 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.719+0000 7f574d1ea780 1 > prepared operation key=ZGH8XC39FGTC tag=D5XQQDNFMYQB type=del size=2290524 2024-09-12T17:18:13.722 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.721+0000 7f574d1ea780 1 < completed part key=_multipart_R00F69ON5P6Z.2~WOCCI0DOQ9P9.0 size=1048576 2024-09-12T17:18:13.723 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.723+0000 7f574d1ea780 1 < completed part key=_multipart_R00F69ON5P6Z.2~WOCCI0DOQ9P9.1 size=1048576 2024-09-12T17:18:13.724 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.724+0000 7f574d1ea780 1 < completed part key=_multipart_R00F69ON5P6Z.2~WOCCI0DOQ9P9.2 size=539444 2024-09-12T17:18:13.726 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.726+0000 7f574d1ea780 1 < completed multipart upload key=R00F69ON5P6Z upload=WOCCI0DOQ9P9 tag=HDBUYCOW4YA8 type=write size=3685172 2024-09-12T17:18:13.728 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.727+0000 7f574d1ea780 1 > prepared operation key=HGZMN894YYC0 tag=6NDZHDUGR5YC type=write size=117236 2024-09-12T17:18:13.729 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.728+0000 7f574d1ea780 1 < completed write operation key=QXD8UG2K4STQ tag=YMKTPDPF5QIF type=write size=666203 2024-09-12T17:18:13.731 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.730+0000 7f574d1ea780 1 > prepared part key=_multipart_RWVWJHVZE95H.2~U2IMPWERSWUU.0 size=1048576 2024-09-12T17:18:13.732 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.731+0000 7f574d1ea780 1 > prepared part key=_multipart_RWVWJHVZE95H.2~U2IMPWERSWUU.1 size=36728 2024-09-12T17:18:13.732 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.731+0000 7f574d1ea780 1 > prepared multipart upload key=RWVWJHVZE95H upload=U2IMPWERSWUU tag=90JW1CH8QIPZ type=write size=2133880 2024-09-12T17:18:13.734 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.733+0000 7f574d1ea780 1 < completed delete operation key=QXD8UG2K4STQ tag=QRY917OTUS3Y type=del 2024-09-12T17:18:13.736 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.735+0000 7f574d1ea780 1 > prepared part key=_multipart_8SG7DJO4HWPI.2~K47HC2PET8A4.0 size=1048576 2024-09-12T17:18:13.737 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.736+0000 7f574d1ea780 1 > prepared part key=_multipart_8SG7DJO4HWPI.2~K47HC2PET8A4.1 size=44973 2024-09-12T17:18:13.737 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.736+0000 7f574d1ea780 1 > prepared multipart upload key=8SG7DJO4HWPI upload=K47HC2PET8A4 tag=FB92ARUASW7S type=write size=2142125 2024-09-12T17:18:13.738 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.737+0000 7f574d1ea780 1 < completed delete operation key=54CM8800AT9V tag=10A59XF1WRMU type=del 2024-09-12T17:18:13.739 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.738+0000 7f574d1ea780 1 > prepared operation key=OI51GO639LFK tag=GYVIGCBKBVGX type=write size=464621 2024-09-12T17:18:13.741 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.740+0000 7f574d1ea780 1 < completed part key=_multipart_43GV2N9VBBKE.2~4C82CNTK05HR.0 size=1048576 2024-09-12T17:18:13.741 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.740+0000 7f574d1ea780 1 < canceled part key=_multipart_43GV2N9VBBKE.2~4C82CNTK05HR.1 size=1048576 2024-09-12T17:18:13.742 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.741+0000 7f574d1ea780 1 < completed part key=_multipart_43GV2N9VBBKE.2~4C82CNTK05HR.2 size=1046083 2024-09-12T17:18:13.744 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.743+0000 7f574d1ea780 1 < canceled multipart upload key=43GV2N9VBBKE upload=4C82CNTK05HR tag=BP2Q8PYZFFPT type=write size=4191811 2024-09-12T17:18:13.745 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.744+0000 7f574d1ea780 1 > prepared operation key=54LQ91UMBJAN tag=SR3DRZ8RY1QG type=del size=2547659 2024-09-12T17:18:13.746 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.745+0000 7f574d1ea780 1 < completed write operation key=SQQMJ61CA0QW tag=E1Y8JHIQUEHH type=write size=672149 2024-09-12T17:18:13.748 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.747+0000 7f574d1ea780 1 > prepared operation key=54LQ91UMBJAN tag=0GW4L4ROM3SW type=del size=1174637 2024-09-12T17:18:13.749 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.748+0000 7f574d1ea780 1 < completed part key=_multipart_54CM8800AT9V.2~CWOZA0OZEPB3.0 size=1048576 2024-09-12T17:18:13.750 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.749+0000 7f574d1ea780 1 < completed part key=_multipart_54CM8800AT9V.2~CWOZA0OZEPB3.1 size=18446 2024-09-12T17:18:13.753 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.752+0000 7f574d1ea780 1 < completed multipart upload key=54CM8800AT9V upload=CWOZA0OZEPB3 tag=00W12WY64HUC type=write size=2115598 2024-09-12T17:18:13.757 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.756+0000 7f574d1ea780 1 > prepared part key=_multipart_QXD8UG2K4STQ.2~B7RE7F5A4DVQ.0 size=1048576 2024-09-12T17:18:13.758 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.757+0000 7f574d1ea780 1 > prepared part key=_multipart_QXD8UG2K4STQ.2~B7RE7F5A4DVQ.1 size=1048576 2024-09-12T17:18:13.759 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.758+0000 7f574d1ea780 1 > prepared part key=_multipart_QXD8UG2K4STQ.2~B7RE7F5A4DVQ.2 size=446185 2024-09-12T17:18:13.759 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.758+0000 7f574d1ea780 1 > prepared multipart upload key=QXD8UG2K4STQ upload=B7RE7F5A4DVQ tag=VIHWHCM9S9C4 type=write size=3591913 2024-09-12T17:18:13.760 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.760+0000 7f574d1ea780 1 < canceled operation key=UTCKL1F42X8A tag=G40DYGN4IZUE type=del size=4167074 2024-09-12T17:18:13.762 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.761+0000 7f574d1ea780 1 > prepared operation key=ENFNIFHQ3SHW tag=ZCN7VZDG42YG type=del size=605393 2024-09-12T17:18:13.763 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.762+0000 7f574d1ea780 1 < completed part key=_multipart_54LQ91UMBJAN.2~F6GKT9X5MOON.0 size=1048576 2024-09-12T17:18:13.764 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.763+0000 7f574d1ea780 1 < completed part key=_multipart_54LQ91UMBJAN.2~F6GKT9X5MOON.1 size=1048576 2024-09-12T17:18:13.765 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.764+0000 7f574d1ea780 1 < completed part key=_multipart_54LQ91UMBJAN.2~F6GKT9X5MOON.2 size=775493 2024-09-12T17:18:13.767 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.766+0000 7f574d1ea780 1 < completed multipart upload key=54LQ91UMBJAN upload=F6GKT9X5MOON tag=J9QOQ0QSD5L6 type=write size=3921221 2024-09-12T17:18:13.768 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.767+0000 7f574d1ea780 1 > prepared operation key=54LQ91UMBJAN tag=CL6VB2FRDXTT type=del size=1649516 2024-09-12T17:18:13.769 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.769+0000 7f574d1ea780 1 < completed part key=_multipart_HFWA7DNUMWF2.2~TBKICRESZ0AR.0 size=1048576 2024-09-12T17:18:13.770 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.770+0000 7f574d1ea780 1 < completed part key=_multipart_HFWA7DNUMWF2.2~TBKICRESZ0AR.1 size=1048576 2024-09-12T17:18:13.772 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.771+0000 7f574d1ea780 1 < completed part key=_multipart_HFWA7DNUMWF2.2~TBKICRESZ0AR.2 size=390734 2024-09-12T17:18:13.773 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.773+0000 7f574d1ea780 1 < completed multipart upload key=HFWA7DNUMWF2 upload=TBKICRESZ0AR tag=1E2EE1D6HGHH type=write size=3536462 2024-09-12T17:18:13.776 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.775+0000 7f574d1ea780 1 > prepared part key=_multipart_43GV2N9VBBKE.2~SEW723BQZKRQ.0 size=538752 2024-09-12T17:18:13.776 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.775+0000 7f574d1ea780 1 > prepared multipart upload key=43GV2N9VBBKE upload=SEW723BQZKRQ tag=MENOY0514MRY type=write size=1587328 2024-09-12T17:18:13.778 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.777+0000 7f574d1ea780 1 < suggested update operation key=UTCKL1F42X8A tag=EWA67IDDUE40 type=del size=595891 2024-09-12T17:18:13.779 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.779+0000 7f574d1ea780 1 > prepared operation key=QXD8UG2K4STQ tag=QSOLBPHZ06VJ type=write size=816044 2024-09-12T17:18:13.781 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.780+0000 7f574d1ea780 1 < completed delete operation key=55V137SY4E4P tag=Y6VCC1QJF9P2 type=del 2024-09-12T17:18:13.782 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.781+0000 7f574d1ea780 1 > prepared operation key=K12MVG618809 tag=8FJ8RMN0PQET type=del size=1095879 2024-09-12T17:18:13.783 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.782+0000 7f574d1ea780 1 < completed write operation key=U6E9A5OH4GUW tag=XCDBZTH398Y2 type=write size=362474 2024-09-12T17:18:13.784 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.784+0000 7f574d1ea780 1 > prepared operation key=54LQ91UMBJAN tag=YH3SGIKFKHTA type=del size=3439940 2024-09-12T17:18:13.786 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.785+0000 7f574d1ea780 1 < completed part key=_multipart_8SG7DJO4HWPI.2~9PF6IR7HKKSW.0 size=1048576 2024-09-12T17:18:13.787 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.786+0000 7f574d1ea780 1 < completed part key=_multipart_8SG7DJO4HWPI.2~9PF6IR7HKKSW.1 size=624670 2024-09-12T17:18:13.789 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.788+0000 7f574d1ea780 1 < completed multipart upload key=8SG7DJO4HWPI upload=9PF6IR7HKKSW tag=ZKFY0CDLC4BN type=write size=2721822 2024-09-12T17:18:13.791 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.790+0000 7f574d1ea780 1 > prepared part key=_multipart_8SG7DJO4HWPI.2~O0SO39JQK0WC.0 size=1048576 2024-09-12T17:18:13.792 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.791+0000 7f574d1ea780 1 > prepared part key=_multipart_8SG7DJO4HWPI.2~O0SO39JQK0WC.1 size=47673 2024-09-12T17:18:13.792 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.791+0000 7f574d1ea780 1 > prepared multipart upload key=8SG7DJO4HWPI upload=O0SO39JQK0WC tag=FI4PC0LAMZR1 type=write size=2144825 2024-09-12T17:18:13.793 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.793+0000 7f574d1ea780 1 < completed write operation key=HGZMN894YYC0 tag=6YP9JCFHXTZ9 type=write size=834695 2024-09-12T17:18:13.796 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.795+0000 7f574d1ea780 1 > prepared part key=_multipart_55V137SY4E4P.2~X2Q7PAHSS6HS.0 size=203259 2024-09-12T17:18:13.796 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.795+0000 7f574d1ea780 1 > prepared multipart upload key=55V137SY4E4P upload=X2Q7PAHSS6HS tag=ZGVKOZX3LLGB type=write size=1251835 2024-09-12T17:18:13.797 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.796+0000 7f574d1ea780 1 < completed delete operation key=ZGH8XC39FGTC tag=D5XQQDNFMYQB type=del 2024-09-12T17:18:13.798 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.797+0000 7f574d1ea780 1 > prepared operation key=54CM8800AT9V tag=A00PRF92IJB4 type=del size=4114823 2024-09-12T17:18:13.799 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.799+0000 7f574d1ea780 1 < completed write operation key=HGZMN894YYC0 tag=6NDZHDUGR5YC type=write size=117236 2024-09-12T17:18:13.801 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.800+0000 7f574d1ea780 1 > prepared operation key=QXD8UG2K4STQ tag=44I6YO9Z1E5W type=del size=1975738 2024-09-12T17:18:13.802 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.801+0000 7f574d1ea780 1 < completed part key=_multipart_RWVWJHVZE95H.2~U2IMPWERSWUU.0 size=1048576 2024-09-12T17:18:13.803 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.802+0000 7f574d1ea780 1 < completed part key=_multipart_RWVWJHVZE95H.2~U2IMPWERSWUU.1 size=36728 2024-09-12T17:18:13.805 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.804+0000 7f574d1ea780 1 < completed multipart upload key=RWVWJHVZE95H upload=U2IMPWERSWUU tag=90JW1CH8QIPZ type=write size=2133880 2024-09-12T17:18:13.807 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.806+0000 7f574d1ea780 1 > prepared part key=_multipart_VWWA5IB0L4N1.2~2Q65SBQ4INY0.0 size=1048576 2024-09-12T17:18:13.808 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.807+0000 7f574d1ea780 1 > prepared part key=_multipart_VWWA5IB0L4N1.2~2Q65SBQ4INY0.1 size=548731 2024-09-12T17:18:13.808 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.807+0000 7f574d1ea780 1 > prepared multipart upload key=VWWA5IB0L4N1 upload=2Q65SBQ4INY0 tag=QD1C186EFYBP type=write size=2645883 2024-09-12T17:18:13.809 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.808+0000 7f574d1ea780 1 < completed part key=_multipart_8SG7DJO4HWPI.2~K47HC2PET8A4.0 size=1048576 2024-09-12T17:18:13.810 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.809+0000 7f574d1ea780 1 < completed part key=_multipart_8SG7DJO4HWPI.2~K47HC2PET8A4.1 size=44973 2024-09-12T17:18:13.812 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.811+0000 7f574d1ea780 1 < completed multipart upload key=8SG7DJO4HWPI upload=K47HC2PET8A4 tag=FB92ARUASW7S type=write size=2142125 2024-09-12T17:18:13.814 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.813+0000 7f574d1ea780 1 > prepared part key=_multipart_VWWA5IB0L4N1.2~6G26Z74H1U9K.0 size=1048576 2024-09-12T17:18:13.815 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.814+0000 7f574d1ea780 1 > prepared part key=_multipart_VWWA5IB0L4N1.2~6G26Z74H1U9K.1 size=584929 2024-09-12T17:18:13.815 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.814+0000 7f574d1ea780 1 > prepared multipart upload key=VWWA5IB0L4N1 upload=6G26Z74H1U9K tag=LFVRKVB71DHW type=write size=2682081 2024-09-12T17:18:13.817 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.816+0000 7f574d1ea780 1 < completed write operation key=OI51GO639LFK tag=GYVIGCBKBVGX type=write size=464621 2024-09-12T17:18:13.819 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.818+0000 7f574d1ea780 1 > prepared part key=_multipart_ZGH8XC39FGTC.2~7GVQRQZ1GFUS.0 size=997150 2024-09-12T17:18:13.819 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.818+0000 7f574d1ea780 1 > prepared multipart upload key=ZGH8XC39FGTC upload=7GVQRQZ1GFUS tag=RCZTJ6EWTKBH type=write size=2045726 2024-09-12T17:18:13.820 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.819+0000 7f574d1ea780 1 < completed delete operation key=54LQ91UMBJAN tag=SR3DRZ8RY1QG type=del 2024-09-12T17:18:13.821 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.820+0000 7f574d1ea780 1 > prepared operation key=8VW3XCUHLF2L tag=BSVRBBIG8XYN type=del size=1781024 2024-09-12T17:18:13.822 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.822+0000 7f574d1ea780 1 < completed delete operation key=54LQ91UMBJAN tag=0GW4L4ROM3SW type=del 2024-09-12T17:18:13.825 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.824+0000 7f574d1ea780 1 > prepared part key=_multipart_K12MVG618809.2~B2AIWK8EML9X.0 size=1048576 2024-09-12T17:18:13.826 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.825+0000 7f574d1ea780 1 > prepared part key=_multipart_K12MVG618809.2~B2AIWK8EML9X.1 size=871524 2024-09-12T17:18:13.826 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.825+0000 7f574d1ea780 1 > prepared multipart upload key=K12MVG618809 upload=B2AIWK8EML9X tag=AGDPMYR5Y731 type=write size=2968676 2024-09-12T17:18:13.827 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.826+0000 7f574d1ea780 1 < completed part key=_multipart_QXD8UG2K4STQ.2~B7RE7F5A4DVQ.0 size=1048576 2024-09-12T17:18:13.828 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.827+0000 7f574d1ea780 1 < completed part key=_multipart_QXD8UG2K4STQ.2~B7RE7F5A4DVQ.1 size=1048576 2024-09-12T17:18:13.829 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.828+0000 7f574d1ea780 1 < completed part key=_multipart_QXD8UG2K4STQ.2~B7RE7F5A4DVQ.2 size=446185 2024-09-12T17:18:13.831 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.830+0000 7f574d1ea780 1 < completed multipart upload key=QXD8UG2K4STQ upload=B7RE7F5A4DVQ tag=VIHWHCM9S9C4 type=write size=3591913 2024-09-12T17:18:13.832 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.832+0000 7f574d1ea780 1 > prepared operation key=UFKM4I8RMT0W tag=UR1O9W0QMDTT type=del size=3210812 2024-09-12T17:18:13.834 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.833+0000 7f574d1ea780 1 < completed delete operation key=ENFNIFHQ3SHW tag=ZCN7VZDG42YG type=del 2024-09-12T17:18:13.836 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.835+0000 7f574d1ea780 1 > prepared part key=_multipart_55V137SY4E4P.2~NHWM5S79H3P3.0 size=1048576 2024-09-12T17:18:13.837 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.836+0000 7f574d1ea780 1 > prepared part key=_multipart_55V137SY4E4P.2~NHWM5S79H3P3.1 size=1048576 2024-09-12T17:18:13.838 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.837+0000 7f574d1ea780 1 > prepared part key=_multipart_55V137SY4E4P.2~NHWM5S79H3P3.2 size=515643 2024-09-12T17:18:13.838 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.837+0000 7f574d1ea780 1 > prepared multipart upload key=55V137SY4E4P upload=NHWM5S79H3P3 tag=GOW9JK6XX1D7 type=write size=3661371 2024-09-12T17:18:13.839 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.838+0000 7f574d1ea780 1 < completed delete operation key=54LQ91UMBJAN tag=CL6VB2FRDXTT type=del 2024-09-12T17:18:13.840 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.840+0000 7f574d1ea780 1 > prepared operation key=8VW3XCUHLF2L tag=PSZUZYXGXQ7O type=del size=21171 2024-09-12T17:18:13.842 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.841+0000 7f574d1ea780 1 < completed part key=_multipart_43GV2N9VBBKE.2~SEW723BQZKRQ.0 size=538752 2024-09-12T17:18:13.844 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.843+0000 7f574d1ea780 1 < completed multipart upload key=43GV2N9VBBKE upload=SEW723BQZKRQ tag=MENOY0514MRY type=write size=1587328 2024-09-12T17:18:13.845 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.844+0000 7f574d1ea780 1 > prepared operation key=8SG7DJO4HWPI tag=EZDIM29PLN0I type=del size=504353 2024-09-12T17:18:13.846 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.846+0000 7f574d1ea780 1 < canceled operation key=QXD8UG2K4STQ tag=QSOLBPHZ06VJ type=write size=816044 2024-09-12T17:18:13.848 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.847+0000 7f574d1ea780 1 > prepared operation key=54CM8800AT9V tag=LL9WULSEJYAR type=del size=2115274 2024-09-12T17:18:13.849 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.848+0000 7f574d1ea780 1 < completed delete operation key=K12MVG618809 tag=8FJ8RMN0PQET type=del 2024-09-12T17:18:13.851 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.850+0000 7f574d1ea780 1 > prepared part key=_multipart_SQQMJ61CA0QW.2~KGX0U0FI6FQL.0 size=1048576 2024-09-12T17:18:13.852 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.851+0000 7f574d1ea780 1 > prepared part key=_multipart_SQQMJ61CA0QW.2~KGX0U0FI6FQL.1 size=1048576 2024-09-12T17:18:13.853 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.852+0000 7f574d1ea780 1 > prepared part key=_multipart_SQQMJ61CA0QW.2~KGX0U0FI6FQL.2 size=760153 2024-09-12T17:18:13.853 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.852+0000 7f574d1ea780 1 > prepared multipart upload key=SQQMJ61CA0QW upload=KGX0U0FI6FQL tag=VU772ZF31C3K type=write size=3905881 2024-09-12T17:18:13.854 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.854+0000 7f574d1ea780 1 < completed delete operation key=54LQ91UMBJAN tag=YH3SGIKFKHTA type=del 2024-09-12T17:18:13.856 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.855+0000 7f574d1ea780 1 > prepared operation key=RWVWJHVZE95H tag=LQUVH4ZM3UI3 type=del size=1802125 2024-09-12T17:18:13.857 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.856+0000 7f574d1ea780 1 < completed part key=_multipart_8SG7DJO4HWPI.2~O0SO39JQK0WC.0 size=1048576 2024-09-12T17:18:13.858 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.857+0000 7f574d1ea780 1 < completed part key=_multipart_8SG7DJO4HWPI.2~O0SO39JQK0WC.1 size=47673 2024-09-12T17:18:13.860 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.859+0000 7f574d1ea780 1 < completed multipart upload key=8SG7DJO4HWPI upload=O0SO39JQK0WC tag=FI4PC0LAMZR1 type=write size=2144825 2024-09-12T17:18:13.861 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.861+0000 7f574d1ea780 1 > prepared operation key=OI51GO639LFK tag=WF5A9E6QVAKL type=del size=3268108 2024-09-12T17:18:13.862 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.861+0000 7f574d1ea780 1 < canceled part key=_multipart_55V137SY4E4P.2~X2Q7PAHSS6HS.0 size=203259 2024-09-12T17:18:13.864 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.863+0000 7f574d1ea780 1 < canceled multipart upload key=55V137SY4E4P upload=X2Q7PAHSS6HS tag=ZGVKOZX3LLGB type=write size=1251835 2024-09-12T17:18:13.866 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.865+0000 7f574d1ea780 1 > prepared part key=_multipart_ZGE1860DMGHA.2~HYI3VLP0T4UZ.0 size=1048576 2024-09-12T17:18:13.867 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.866+0000 7f574d1ea780 1 > prepared part key=_multipart_ZGE1860DMGHA.2~HYI3VLP0T4UZ.1 size=650084 2024-09-12T17:18:13.867 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.866+0000 7f574d1ea780 1 > prepared multipart upload key=ZGE1860DMGHA upload=HYI3VLP0T4UZ tag=2X1GOM9KW29R type=write size=2747236 2024-09-12T17:18:13.869 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.868+0000 7f574d1ea780 1 < completed delete operation key=54CM8800AT9V tag=A00PRF92IJB4 type=del 2024-09-12T17:18:13.870 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.870+0000 7f574d1ea780 1 > prepared operation key=55JI541K1WP2 tag=VAAQM4GN113L type=del size=1623615 2024-09-12T17:18:13.874 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.873+0000 7f574d1ea780 1 < suggested remove operation key=QXD8UG2K4STQ tag=44I6YO9Z1E5W type=del 2024-09-12T17:18:13.876 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.875+0000 7f574d1ea780 1 > prepared operation key=C9IYR9CET1I8 tag=Z4TPF2W1IVWD type=write size=390142 2024-09-12T17:18:13.877 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.876+0000 7f574d1ea780 1 < completed part key=_multipart_VWWA5IB0L4N1.2~2Q65SBQ4INY0.0 size=1048576 2024-09-12T17:18:13.877 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.876+0000 7f574d1ea780 1 < canceled part key=_multipart_VWWA5IB0L4N1.2~2Q65SBQ4INY0.1 size=548731 2024-09-12T17:18:13.880 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.879+0000 7f574d1ea780 1 < canceled multipart upload key=VWWA5IB0L4N1 upload=2Q65SBQ4INY0 tag=QD1C186EFYBP type=write size=2645883 2024-09-12T17:18:13.881 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.880+0000 7f574d1ea780 1 > prepared operation key=SQQMJ61CA0QW tag=LFRXGRQIAPG4 type=del size=360431 2024-09-12T17:18:13.882 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.882+0000 7f574d1ea780 1 < completed part key=_multipart_VWWA5IB0L4N1.2~6G26Z74H1U9K.0 size=1048576 2024-09-12T17:18:13.883 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.883+0000 7f574d1ea780 1 < completed part key=_multipart_VWWA5IB0L4N1.2~6G26Z74H1U9K.1 size=584929 2024-09-12T17:18:13.885 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.885+0000 7f574d1ea780 1 < completed multipart upload key=VWWA5IB0L4N1 upload=6G26Z74H1U9K tag=LFVRKVB71DHW type=write size=2682081 2024-09-12T17:18:13.888 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.887+0000 7f574d1ea780 1 > prepared part key=_multipart_43GV2N9VBBKE.2~KGZBAV8ZY1YG.0 size=1048576 2024-09-12T17:18:13.889 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.888+0000 7f574d1ea780 1 > prepared part key=_multipart_43GV2N9VBBKE.2~KGZBAV8ZY1YG.1 size=1048576 2024-09-12T17:18:13.890 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.889+0000 7f574d1ea780 1 > prepared part key=_multipart_43GV2N9VBBKE.2~KGZBAV8ZY1YG.2 size=996158 2024-09-12T17:18:13.890 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.889+0000 7f574d1ea780 1 > prepared multipart upload key=43GV2N9VBBKE upload=KGZBAV8ZY1YG tag=JHIGT0K6MS71 type=write size=4141886 2024-09-12T17:18:13.891 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.890+0000 7f574d1ea780 1 < completed part key=_multipart_ZGH8XC39FGTC.2~7GVQRQZ1GFUS.0 size=997150 2024-09-12T17:18:13.893 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.892+0000 7f574d1ea780 1 < completed multipart upload key=ZGH8XC39FGTC upload=7GVQRQZ1GFUS tag=RCZTJ6EWTKBH type=write size=2045726 2024-09-12T17:18:13.894 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.893+0000 7f574d1ea780 1 > prepared operation key=A1TIP3RXHBCZ tag=JBPLHG528KCS type=del size=960712 2024-09-12T17:18:13.897 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.896+0000 7f574d1ea780 1 < suggested update operation key=8VW3XCUHLF2L tag=BSVRBBIG8XYN type=del size=1781024 2024-09-12T17:18:13.898 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.897+0000 7f574d1ea780 1 > prepared operation key=8SG7DJO4HWPI tag=5DWM1JF1H2TD type=write size=231119 2024-09-12T17:18:13.899 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.898+0000 7f574d1ea780 1 < completed part key=_multipart_K12MVG618809.2~B2AIWK8EML9X.0 size=1048576 2024-09-12T17:18:13.900 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.899+0000 7f574d1ea780 1 < completed part key=_multipart_K12MVG618809.2~B2AIWK8EML9X.1 size=871524 2024-09-12T17:18:13.902 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.901+0000 7f574d1ea780 1 < completed multipart upload key=K12MVG618809 upload=B2AIWK8EML9X tag=AGDPMYR5Y731 type=write size=2968676 2024-09-12T17:18:13.903 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.902+0000 7f574d1ea780 1 > prepared operation key=DH02JGZP64MN tag=7C1W2KIIHCES type=del size=182304 2024-09-12T17:18:13.904 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.904+0000 7f574d1ea780 1 < canceled operation key=UFKM4I8RMT0W tag=UR1O9W0QMDTT type=del size=3210812 2024-09-12T17:18:13.907 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.906+0000 7f574d1ea780 1 > prepared part key=_multipart_7BX38Q7723EB.2~MDPT6A3YM2UN.0 size=1039743 2024-09-12T17:18:13.907 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.906+0000 7f574d1ea780 1 > prepared multipart upload key=7BX38Q7723EB upload=MDPT6A3YM2UN tag=O89A4YX627JY type=write size=2088319 2024-09-12T17:18:13.908 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.907+0000 7f574d1ea780 1 < completed part key=_multipart_55V137SY4E4P.2~NHWM5S79H3P3.0 size=1048576 2024-09-12T17:18:13.909 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.908+0000 7f574d1ea780 1 < completed part key=_multipart_55V137SY4E4P.2~NHWM5S79H3P3.1 size=1048576 2024-09-12T17:18:13.910 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.909+0000 7f574d1ea780 1 < completed part key=_multipart_55V137SY4E4P.2~NHWM5S79H3P3.2 size=515643 2024-09-12T17:18:13.912 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.912+0000 7f574d1ea780 1 < completed multipart upload key=55V137SY4E4P upload=NHWM5S79H3P3 tag=GOW9JK6XX1D7 type=write size=3661371 2024-09-12T17:18:13.914 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.913+0000 7f574d1ea780 1 > prepared operation key=8SG7DJO4HWPI tag=5FU4BTX0THT7 type=del size=2612296 2024-09-12T17:18:13.916 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.915+0000 7f574d1ea780 1 < suggested remove operation key=8VW3XCUHLF2L tag=PSZUZYXGXQ7O type=del 2024-09-12T17:18:13.917 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.917+0000 7f574d1ea780 1 > prepared operation key=54CM8800AT9V tag=MA03BGTQEH1D type=del size=2245390 2024-09-12T17:18:13.919 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.918+0000 7f574d1ea780 1 < completed delete operation key=8SG7DJO4HWPI tag=EZDIM29PLN0I type=del 2024-09-12T17:18:13.921 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.921+0000 7f574d1ea780 1 > prepared part key=_multipart_SQQMJ61CA0QW.2~HV2A8RBZ7MT1.0 size=1048576 2024-09-12T17:18:13.923 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.922+0000 7f574d1ea780 1 > prepared part key=_multipart_SQQMJ61CA0QW.2~HV2A8RBZ7MT1.1 size=817139 2024-09-12T17:18:13.923 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.922+0000 7f574d1ea780 1 > prepared multipart upload key=SQQMJ61CA0QW upload=HV2A8RBZ7MT1 tag=CEOL2G4CSGL8 type=write size=2914291 2024-09-12T17:18:13.924 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.923+0000 7f574d1ea780 1 < canceled operation key=54CM8800AT9V tag=LL9WULSEJYAR type=del size=2115274 2024-09-12T17:18:13.926 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.925+0000 7f574d1ea780 1 > prepared operation key=7BX38Q7723EB tag=C8VODHK1TUT6 type=del size=4181332 2024-09-12T17:18:13.927 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.926+0000 7f574d1ea780 1 < completed part key=_multipart_SQQMJ61CA0QW.2~KGX0U0FI6FQL.0 size=1048576 2024-09-12T17:18:13.931 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.927+0000 7f574d1ea780 1 < completed part key=_multipart_SQQMJ61CA0QW.2~KGX0U0FI6FQL.1 size=1048576 2024-09-12T17:18:13.931 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.928+0000 7f574d1ea780 1 < completed part key=_multipart_SQQMJ61CA0QW.2~KGX0U0FI6FQL.2 size=760153 2024-09-12T17:18:13.932 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.930+0000 7f574d1ea780 1 < completed multipart upload key=SQQMJ61CA0QW upload=KGX0U0FI6FQL tag=VU772ZF31C3K type=write size=3905881 2024-09-12T17:18:13.933 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.932+0000 7f574d1ea780 1 > prepared operation key=OI51GO639LFK tag=2LPRUN0C0TW0 type=del size=2058901 2024-09-12T17:18:13.935 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.934+0000 7f574d1ea780 1 < suggested update operation key=RWVWJHVZE95H tag=LQUVH4ZM3UI3 type=del size=1802125 2024-09-12T17:18:13.937 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.936+0000 7f574d1ea780 1 > prepared operation key=ENFNIFHQ3SHW tag=G06605CUKD0W type=write size=290372 2024-09-12T17:18:13.939 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.939+0000 7f574d1ea780 1 < suggested remove operation key=OI51GO639LFK tag=WF5A9E6QVAKL type=del 2024-09-12T17:18:13.941 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.940+0000 7f574d1ea780 1 > prepared operation key=HGZMN894YYC0 tag=V80HBNRP01OQ type=del size=4025534 2024-09-12T17:18:13.942 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.941+0000 7f574d1ea780 1 < completed part key=_multipart_ZGE1860DMGHA.2~HYI3VLP0T4UZ.0 size=1048576 2024-09-12T17:18:13.943 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.943+0000 7f574d1ea780 1 < completed part key=_multipart_ZGE1860DMGHA.2~HYI3VLP0T4UZ.1 size=650084 2024-09-12T17:18:13.945 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.945+0000 7f574d1ea780 1 < completed multipart upload key=ZGE1860DMGHA upload=HYI3VLP0T4UZ tag=2X1GOM9KW29R type=write size=2747236 2024-09-12T17:18:13.947 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.946+0000 7f574d1ea780 1 > prepared operation key=DH02JGZP64MN tag=H4YJ1R3DO9CB type=del size=2910734 2024-09-12T17:18:13.948 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.947+0000 7f574d1ea780 1 < completed delete operation key=55JI541K1WP2 tag=VAAQM4GN113L type=del 2024-09-12T17:18:13.950 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.950+0000 7f574d1ea780 1 > prepared part key=_multipart_K12MVG618809.2~UXTM7CCP2AJW.0 size=1048576 2024-09-12T17:18:13.952 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.951+0000 7f574d1ea780 1 > prepared part key=_multipart_K12MVG618809.2~UXTM7CCP2AJW.1 size=1048576 2024-09-12T17:18:13.952 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.952+0000 7f574d1ea780 1 > prepared part key=_multipart_K12MVG618809.2~UXTM7CCP2AJW.2 size=946788 2024-09-12T17:18:13.953 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.952+0000 7f574d1ea780 1 > prepared multipart upload key=K12MVG618809 upload=UXTM7CCP2AJW tag=2GQO3H0AK878 type=write size=4092516 2024-09-12T17:18:13.954 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.953+0000 7f574d1ea780 1 < canceled operation key=C9IYR9CET1I8 tag=Z4TPF2W1IVWD type=write size=390142 2024-09-12T17:18:13.955 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.954+0000 7f574d1ea780 1 > prepared operation key=Q2Q3B1J3DAVD tag=LBLEB2LGO0DK type=del size=1964870 2024-09-12T17:18:13.958 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.957+0000 7f574d1ea780 1 < canceled operation key=SQQMJ61CA0QW tag=LFRXGRQIAPG4 type=del size=360431 2024-09-12T17:18:13.960 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.959+0000 7f574d1ea780 1 > prepared part key=_multipart_K12MVG618809.2~JMF4VKV1MDJ8.0 size=1048576 2024-09-12T17:18:13.961 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.960+0000 7f574d1ea780 1 > prepared part key=_multipart_K12MVG618809.2~JMF4VKV1MDJ8.1 size=577899 2024-09-12T17:18:13.961 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.960+0000 7f574d1ea780 1 > prepared multipart upload key=K12MVG618809 upload=JMF4VKV1MDJ8 tag=GICIUAE5TTEB type=write size=2675051 2024-09-12T17:18:13.962 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.961+0000 7f574d1ea780 1 < completed part key=_multipart_43GV2N9VBBKE.2~KGZBAV8ZY1YG.0 size=1048576 2024-09-12T17:18:13.963 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.962+0000 7f574d1ea780 1 < completed part key=_multipart_43GV2N9VBBKE.2~KGZBAV8ZY1YG.1 size=1048576 2024-09-12T17:18:13.964 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.963+0000 7f574d1ea780 1 < completed part key=_multipart_43GV2N9VBBKE.2~KGZBAV8ZY1YG.2 size=996158 2024-09-12T17:18:13.966 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.966+0000 7f574d1ea780 1 < completed multipart upload key=43GV2N9VBBKE upload=KGZBAV8ZY1YG tag=JHIGT0K6MS71 type=write size=4141886 2024-09-12T17:18:13.969 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.968+0000 7f574d1ea780 1 > prepared part key=_multipart_ZGE1860DMGHA.2~5FH6PRZJF6Y8.0 size=1048576 2024-09-12T17:18:13.970 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.969+0000 7f574d1ea780 1 > prepared part key=_multipart_ZGE1860DMGHA.2~5FH6PRZJF6Y8.1 size=1022492 2024-09-12T17:18:13.970 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.969+0000 7f574d1ea780 1 > prepared multipart upload key=ZGE1860DMGHA upload=5FH6PRZJF6Y8 tag=NSCAGDWOTXWQ type=write size=3119644 2024-09-12T17:18:13.971 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.970+0000 7f574d1ea780 1 < completed delete operation key=A1TIP3RXHBCZ tag=JBPLHG528KCS type=del 2024-09-12T17:18:13.973 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.972+0000 7f574d1ea780 1 > prepared part key=_multipart_VWWA5IB0L4N1.2~68O0M4YWOP13.0 size=355263 2024-09-12T17:18:13.973 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.972+0000 7f574d1ea780 1 > prepared multipart upload key=VWWA5IB0L4N1 upload=68O0M4YWOP13 tag=VS26HGOKJIJ9 type=write size=1403839 2024-09-12T17:18:13.975 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.974+0000 7f574d1ea780 1 < completed write operation key=8SG7DJO4HWPI tag=5DWM1JF1H2TD type=write size=231119 2024-09-12T17:18:13.976 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.975+0000 7f574d1ea780 1 > prepared operation key=R00F69ON5P6Z tag=FUHZ73UW07J4 type=del size=42428 2024-09-12T17:18:13.977 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.976+0000 7f574d1ea780 1 < completed delete operation key=DH02JGZP64MN tag=7C1W2KIIHCES type=del 2024-09-12T17:18:13.978 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.977+0000 7f574d1ea780 1 > prepared operation key=SQQMJ61CA0QW tag=N7JJ7E6BCSMK type=del size=905974 2024-09-12T17:18:13.980 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.979+0000 7f574d1ea780 1 < completed part key=_multipart_7BX38Q7723EB.2~MDPT6A3YM2UN.0 size=1039743 2024-09-12T17:18:13.982 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.981+0000 7f574d1ea780 1 < completed multipart upload key=7BX38Q7723EB upload=MDPT6A3YM2UN tag=O89A4YX627JY type=write size=2088319 2024-09-12T17:18:13.984 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.983+0000 7f574d1ea780 1 > prepared part key=_multipart_QXD8UG2K4STQ.2~N7XQWEBYEKVI.0 size=1048576 2024-09-12T17:18:13.985 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.984+0000 7f574d1ea780 1 > prepared part key=_multipart_QXD8UG2K4STQ.2~N7XQWEBYEKVI.1 size=697840 2024-09-12T17:18:13.985 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.984+0000 7f574d1ea780 1 > prepared multipart upload key=QXD8UG2K4STQ upload=N7XQWEBYEKVI tag=XCMO2227Z9V0 type=write size=2794992 2024-09-12T17:18:13.986 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.985+0000 7f574d1ea780 1 < completed delete operation key=8SG7DJO4HWPI tag=5FU4BTX0THT7 type=del 2024-09-12T17:18:13.987 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.987+0000 7f574d1ea780 1 > prepared operation key=HGZMN894YYC0 tag=RJBDKESDRBRN type=del size=2179385 2024-09-12T17:18:13.989 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.988+0000 7f574d1ea780 1 < completed delete operation key=54CM8800AT9V tag=MA03BGTQEH1D type=del 2024-09-12T17:18:13.992 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.991+0000 7f574d1ea780 1 > prepared part key=_multipart_A1TIP3RXHBCZ.2~F4IYW7PLWB19.0 size=1048576 2024-09-12T17:18:13.993 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.992+0000 7f574d1ea780 1 > prepared part key=_multipart_A1TIP3RXHBCZ.2~F4IYW7PLWB19.1 size=1048576 2024-09-12T17:18:13.995 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.994+0000 7f574d1ea780 1 > prepared part key=_multipart_A1TIP3RXHBCZ.2~F4IYW7PLWB19.2 size=606366 2024-09-12T17:18:13.995 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.994+0000 7f574d1ea780 1 > prepared multipart upload key=A1TIP3RXHBCZ upload=F4IYW7PLWB19 tag=IBH5O3X3VRVG type=write size=3752094 2024-09-12T17:18:13.997 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.996+0000 7f574d1ea780 1 < completed part key=_multipart_SQQMJ61CA0QW.2~HV2A8RBZ7MT1.0 size=1048576 2024-09-12T17:18:13.998 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.997+0000 7f574d1ea780 1 < completed part key=_multipart_SQQMJ61CA0QW.2~HV2A8RBZ7MT1.1 size=817139 2024-09-12T17:18:14.000 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:13.999+0000 7f574d1ea780 1 < completed multipart upload key=SQQMJ61CA0QW upload=HV2A8RBZ7MT1 tag=CEOL2G4CSGL8 type=write size=2914291 2024-09-12T17:18:14.001 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.000+0000 7f574d1ea780 1 > prepared operation key=54LQ91UMBJAN tag=FWCNUU45G0AO type=del size=3143001 2024-09-12T17:18:14.002 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.001+0000 7f574d1ea780 1 < completed delete operation key=7BX38Q7723EB tag=C8VODHK1TUT6 type=del 2024-09-12T17:18:14.003 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.002+0000 7f574d1ea780 1 > prepared operation key=SQQMJ61CA0QW tag=P86P5UACZBGJ type=del size=2108370 2024-09-12T17:18:14.004 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.003+0000 7f574d1ea780 -1 < failed to complete operation key=OI51GO639LFK tag=2LPRUN0C0TW0 type=del size=2058901: (22) Invalid argument 2024-09-12T17:18:14.005 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.005+0000 7f574d1ea780 1 > prepared operation key=SQQMJ61CA0QW tag=6OAS2Y5TNFKM type=del size=4169506 2024-09-12T17:18:14.007 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.006+0000 7f574d1ea780 1 < completed write operation key=ENFNIFHQ3SHW tag=G06605CUKD0W type=write size=290372 2024-09-12T17:18:14.008 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.007+0000 7f574d1ea780 1 > prepared operation key=8SG7DJO4HWPI tag=1H9ZE6I021ZZ type=del size=1364234 2024-09-12T17:18:14.009 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.008+0000 7f574d1ea780 1 < completed delete operation key=HGZMN894YYC0 tag=V80HBNRP01OQ type=del 2024-09-12T17:18:14.011 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.010+0000 7f574d1ea780 1 > prepared operation key=A1TIP3RXHBCZ tag=X8O54T7B8QIM type=del size=858945 2024-09-12T17:18:14.013 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.012+0000 7f574d1ea780 1 < suggested update operation key=DH02JGZP64MN tag=H4YJ1R3DO9CB type=del size=2910734 2024-09-12T17:18:14.015 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.014+0000 7f574d1ea780 1 > prepared part key=_multipart_DH02JGZP64MN.2~2CSNARM3E8AE.0 size=107085 2024-09-12T17:18:14.015 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.014+0000 7f574d1ea780 1 > prepared multipart upload key=DH02JGZP64MN upload=2CSNARM3E8AE tag=SC2N6AORVTLG type=write size=1155661 2024-09-12T17:18:14.017 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.016+0000 7f574d1ea780 1 < completed part key=_multipart_K12MVG618809.2~UXTM7CCP2AJW.0 size=1048576 2024-09-12T17:18:14.018 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.017+0000 7f574d1ea780 1 < completed part key=_multipart_K12MVG618809.2~UXTM7CCP2AJW.1 size=1048576 2024-09-12T17:18:14.019 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.018+0000 7f574d1ea780 1 < completed part key=_multipart_K12MVG618809.2~UXTM7CCP2AJW.2 size=946788 2024-09-12T17:18:14.021 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.020+0000 7f574d1ea780 1 < completed multipart upload key=K12MVG618809 upload=UXTM7CCP2AJW tag=2GQO3H0AK878 type=write size=4092516 2024-09-12T17:18:14.022 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.022+0000 7f574d1ea780 1 > prepared operation key=UFKM4I8RMT0W tag=YZ2SVFK67ZN2 type=write size=599818 2024-09-12T17:18:14.024 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.023+0000 7f574d1ea780 1 < completed delete operation key=Q2Q3B1J3DAVD tag=LBLEB2LGO0DK type=del 2024-09-12T17:18:14.026 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.026+0000 7f574d1ea780 1 > prepared part key=_multipart_K12MVG618809.2~NDFN7P8YTAJK.0 size=1048576 2024-09-12T17:18:14.028 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.027+0000 7f574d1ea780 1 > prepared part key=_multipart_K12MVG618809.2~NDFN7P8YTAJK.1 size=488416 2024-09-12T17:18:14.028 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.027+0000 7f574d1ea780 1 > prepared multipart upload key=K12MVG618809 upload=NDFN7P8YTAJK tag=1BO08YW4I0SF type=write size=2585568 2024-09-12T17:18:14.029 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.028+0000 7f574d1ea780 1 < completed part key=_multipart_K12MVG618809.2~JMF4VKV1MDJ8.0 size=1048576 2024-09-12T17:18:14.030 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.029+0000 7f574d1ea780 1 < completed part key=_multipart_K12MVG618809.2~JMF4VKV1MDJ8.1 size=577899 2024-09-12T17:18:14.032 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.032+0000 7f574d1ea780 1 < completed multipart upload key=K12MVG618809 upload=JMF4VKV1MDJ8 tag=GICIUAE5TTEB type=write size=2675051 2024-09-12T17:18:14.034 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.033+0000 7f574d1ea780 1 > prepared operation key=8SG7DJO4HWPI tag=P5JJ5Y4K3T8R type=del size=1442719 2024-09-12T17:18:14.035 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.034+0000 7f574d1ea780 1 < completed part key=_multipart_ZGE1860DMGHA.2~5FH6PRZJF6Y8.0 size=1048576 2024-09-12T17:18:14.036 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.035+0000 7f574d1ea780 1 < completed part key=_multipart_ZGE1860DMGHA.2~5FH6PRZJF6Y8.1 size=1022492 2024-09-12T17:18:14.038 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.038+0000 7f574d1ea780 1 < completed multipart upload key=ZGE1860DMGHA upload=5FH6PRZJF6Y8 tag=NSCAGDWOTXWQ type=write size=3119644 2024-09-12T17:18:14.040 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.039+0000 7f574d1ea780 1 > prepared operation key=7BX38Q7723EB tag=INY6PFO3X9JX type=del size=903928 2024-09-12T17:18:14.040 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.039+0000 7f574d1ea780 1 < canceled part key=_multipart_VWWA5IB0L4N1.2~68O0M4YWOP13.0 size=355263 2024-09-12T17:18:14.042 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.042+0000 7f574d1ea780 1 < canceled multipart upload key=VWWA5IB0L4N1 upload=68O0M4YWOP13 tag=VS26HGOKJIJ9 type=write size=1403839 2024-09-12T17:18:14.044 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.043+0000 7f574d1ea780 1 > prepared operation key=VWWA5IB0L4N1 tag=FV37NDIL72F3 type=write size=114506 2024-09-12T17:18:14.045 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.044+0000 7f574d1ea780 1 < completed delete operation key=R00F69ON5P6Z tag=FUHZ73UW07J4 type=del 2024-09-12T17:18:14.049 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.048+0000 7f574d1ea780 1 > prepared part key=_multipart_7BX38Q7723EB.2~34KTO1GKI1Q0.0 size=1048576 2024-09-12T17:18:14.050 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.049+0000 7f574d1ea780 1 > prepared part key=_multipart_7BX38Q7723EB.2~34KTO1GKI1Q0.1 size=1048576 2024-09-12T17:18:14.051 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.050+0000 7f574d1ea780 1 > prepared part key=_multipart_7BX38Q7723EB.2~34KTO1GKI1Q0.2 size=244113 2024-09-12T17:18:14.051 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.050+0000 7f574d1ea780 1 > prepared multipart upload key=7BX38Q7723EB upload=34KTO1GKI1Q0 tag=WSN61IWRO33N type=write size=3389841 2024-09-12T17:18:14.052 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.051+0000 7f574d1ea780 1 < completed delete operation key=SQQMJ61CA0QW tag=N7JJ7E6BCSMK type=del 2024-09-12T17:18:14.053 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.052+0000 7f574d1ea780 1 > prepared operation key=HFWA7DNUMWF2 tag=RNQ6O1948WJL type=del size=2399630 2024-09-12T17:18:14.054 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.053+0000 7f574d1ea780 1 < completed part key=_multipart_QXD8UG2K4STQ.2~N7XQWEBYEKVI.0 size=1048576 2024-09-12T17:18:14.055 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.054+0000 7f574d1ea780 1 < completed part key=_multipart_QXD8UG2K4STQ.2~N7XQWEBYEKVI.1 size=697840 2024-09-12T17:18:14.057 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.056+0000 7f574d1ea780 1 < completed multipart upload key=QXD8UG2K4STQ upload=N7XQWEBYEKVI tag=XCMO2227Z9V0 type=write size=2794992 2024-09-12T17:18:14.059 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.059+0000 7f574d1ea780 1 > prepared part key=_multipart_OI51GO639LFK.2~RE9A255L7FG5.0 size=1048576 2024-09-12T17:18:14.060 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.060+0000 7f574d1ea780 1 > prepared part key=_multipart_OI51GO639LFK.2~RE9A255L7FG5.1 size=495585 2024-09-12T17:18:14.061 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.060+0000 7f574d1ea780 1 > prepared multipart upload key=OI51GO639LFK upload=RE9A255L7FG5 tag=X21EA39H4GHS type=write size=2592737 2024-09-12T17:18:14.062 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.061+0000 7f574d1ea780 1 < canceled operation key=HGZMN894YYC0 tag=RJBDKESDRBRN type=del size=2179385 2024-09-12T17:18:14.063 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.062+0000 7f574d1ea780 1 > prepared operation key=K12MVG618809 tag=U0FJ1ON3B4QV type=write size=255352 2024-09-12T17:18:14.064 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.063+0000 7f574d1ea780 1 < completed part key=_multipart_A1TIP3RXHBCZ.2~F4IYW7PLWB19.0 size=1048576 2024-09-12T17:18:14.065 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.064+0000 7f574d1ea780 1 < completed part key=_multipart_A1TIP3RXHBCZ.2~F4IYW7PLWB19.1 size=1048576 2024-09-12T17:18:14.066 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.065+0000 7f574d1ea780 1 < completed part key=_multipart_A1TIP3RXHBCZ.2~F4IYW7PLWB19.2 size=606366 2024-09-12T17:18:14.068 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.067+0000 7f574d1ea780 1 < completed multipart upload key=A1TIP3RXHBCZ upload=F4IYW7PLWB19 tag=IBH5O3X3VRVG type=write size=3752094 2024-09-12T17:18:14.070 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.069+0000 7f574d1ea780 1 > prepared part key=_multipart_ZGE1860DMGHA.2~RDC2AEGAD3FH.0 size=934407 2024-09-12T17:18:14.070 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.069+0000 7f574d1ea780 1 > prepared multipart upload key=ZGE1860DMGHA upload=RDC2AEGAD3FH tag=6BQ2IGWAWLOR type=write size=1982983 2024-09-12T17:18:14.071 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.071+0000 7f574d1ea780 1 < completed delete operation key=54LQ91UMBJAN tag=FWCNUU45G0AO type=del 2024-09-12T17:18:14.073 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.072+0000 7f574d1ea780 1 > prepared operation key=DH02JGZP64MN tag=YGOWB11HN8BR type=del size=3639356 2024-09-12T17:18:14.074 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.073+0000 7f574d1ea780 1 < completed delete operation key=SQQMJ61CA0QW tag=P86P5UACZBGJ type=del 2024-09-12T17:18:14.075 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.074+0000 7f574d1ea780 1 > prepared operation key=TIKBUXFPVTN1 tag=I0P3F3WMRV75 type=del size=1799503 2024-09-12T17:18:14.076 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.075+0000 7f574d1ea780 1 < completed delete operation key=SQQMJ61CA0QW tag=6OAS2Y5TNFKM type=del 2024-09-12T17:18:14.077 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.077+0000 7f574d1ea780 1 > prepared operation key=55JI541K1WP2 tag=VE5NKIR15IPO type=del size=3533747 2024-09-12T17:18:14.079 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.078+0000 7f574d1ea780 1 < completed delete operation key=8SG7DJO4HWPI tag=1H9ZE6I021ZZ type=del 2024-09-12T17:18:14.081 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.080+0000 7f574d1ea780 1 > prepared part key=_multipart_UTCKL1F42X8A.2~O6EMTV5YGUWZ.0 size=1048576 2024-09-12T17:18:14.082 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.081+0000 7f574d1ea780 1 > prepared part key=_multipart_UTCKL1F42X8A.2~O6EMTV5YGUWZ.1 size=1048576 2024-09-12T17:18:14.083 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.082+0000 7f574d1ea780 1 > prepared part key=_multipart_UTCKL1F42X8A.2~O6EMTV5YGUWZ.2 size=655642 2024-09-12T17:18:14.083 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.082+0000 7f574d1ea780 1 > prepared multipart upload key=UTCKL1F42X8A upload=O6EMTV5YGUWZ tag=UUCQCTP3GB2T type=write size=3801370 2024-09-12T17:18:14.084 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.083+0000 7f574d1ea780 1 < completed delete operation key=A1TIP3RXHBCZ tag=X8O54T7B8QIM type=del 2024-09-12T17:18:14.085 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.084+0000 7f574d1ea780 1 > prepared operation key=UFKM4I8RMT0W tag=BBVVKMXSJGJ3 type=write size=399095 2024-09-12T17:18:14.086 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.085+0000 7f574d1ea780 1 < canceled part key=_multipart_DH02JGZP64MN.2~2CSNARM3E8AE.0 size=107085 2024-09-12T17:18:14.088 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.087+0000 7f574d1ea780 1 < canceled multipart upload key=DH02JGZP64MN upload=2CSNARM3E8AE tag=SC2N6AORVTLG type=write size=1155661 2024-09-12T17:18:14.089 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.088+0000 7f574d1ea780 1 > prepared operation key=ZGH8XC39FGTC tag=TGUGNDJJEIDD type=del size=2749089 2024-09-12T17:18:14.090 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.089+0000 7f574d1ea780 1 < completed write operation key=UFKM4I8RMT0W tag=YZ2SVFK67ZN2 type=write size=599818 2024-09-12T17:18:14.092 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.092+0000 7f574d1ea780 1 > prepared part key=_multipart_VWWA5IB0L4N1.2~4QYI9A72Q6FY.0 size=1048576 2024-09-12T17:18:14.093 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.093+0000 7f574d1ea780 1 > prepared part key=_multipart_VWWA5IB0L4N1.2~4QYI9A72Q6FY.1 size=655125 2024-09-12T17:18:14.094 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.093+0000 7f574d1ea780 1 > prepared multipart upload key=VWWA5IB0L4N1 upload=4QYI9A72Q6FY tag=2TA443UNTTWT type=write size=2752277 2024-09-12T17:18:14.095 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.094+0000 7f574d1ea780 1 < completed part key=_multipart_K12MVG618809.2~NDFN7P8YTAJK.0 size=1048576 2024-09-12T17:18:14.096 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.095+0000 7f574d1ea780 1 < completed part key=_multipart_K12MVG618809.2~NDFN7P8YTAJK.1 size=488416 2024-09-12T17:18:14.098 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.097+0000 7f574d1ea780 1 < completed multipart upload key=K12MVG618809 upload=NDFN7P8YTAJK tag=1BO08YW4I0SF type=write size=2585568 2024-09-12T17:18:14.099 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.098+0000 7f574d1ea780 1 > prepared operation key=ZGH8XC39FGTC tag=7CEDOC41FSV4 type=del size=3063231 2024-09-12T17:18:14.101 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.100+0000 7f574d1ea780 1 < completed delete operation key=8SG7DJO4HWPI tag=P5JJ5Y4K3T8R type=del 2024-09-12T17:18:14.102 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.101+0000 7f574d1ea780 1 > prepared operation key=8SG7DJO4HWPI tag=P0U56BQ4H4LA type=del size=12459 2024-09-12T17:18:14.103 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.102+0000 7f574d1ea780 1 < completed delete operation key=7BX38Q7723EB tag=INY6PFO3X9JX type=del 2024-09-12T17:18:14.104 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.103+0000 7f574d1ea780 1 > prepared operation key=D1GEG3MKPOM3 tag=1N4ZV2RL58AI type=write size=492441 2024-09-12T17:18:14.106 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.105+0000 7f574d1ea780 1 < completed write operation key=VWWA5IB0L4N1 tag=FV37NDIL72F3 type=write size=114506 2024-09-12T17:18:14.107 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.106+0000 7f574d1ea780 1 > prepared operation key=55JI541K1WP2 tag=C02MAGMBE69Z type=del size=2904776 2024-09-12T17:18:14.108 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.107+0000 7f574d1ea780 1 < completed part key=_multipart_7BX38Q7723EB.2~34KTO1GKI1Q0.0 size=1048576 2024-09-12T17:18:14.109 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.109+0000 7f574d1ea780 1 < completed part key=_multipart_7BX38Q7723EB.2~34KTO1GKI1Q0.1 size=1048576 2024-09-12T17:18:14.110 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.110+0000 7f574d1ea780 1 < completed part key=_multipart_7BX38Q7723EB.2~34KTO1GKI1Q0.2 size=244113 2024-09-12T17:18:14.113 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.112+0000 7f574d1ea780 1 < completed multipart upload key=7BX38Q7723EB upload=34KTO1GKI1Q0 tag=WSN61IWRO33N type=write size=3389841 2024-09-12T17:18:14.116 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.115+0000 7f574d1ea780 1 > prepared part key=_multipart_UTCKL1F42X8A.2~K4R34XY8YZZ1.0 size=1048576 2024-09-12T17:18:14.117 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.116+0000 7f574d1ea780 1 > prepared part key=_multipart_UTCKL1F42X8A.2~K4R34XY8YZZ1.1 size=1048576 2024-09-12T17:18:14.118 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.117+0000 7f574d1ea780 1 > prepared part key=_multipart_UTCKL1F42X8A.2~K4R34XY8YZZ1.2 size=861814 2024-09-12T17:18:14.118 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.117+0000 7f574d1ea780 1 > prepared multipart upload key=UTCKL1F42X8A upload=K4R34XY8YZZ1 tag=Y4GNGL783GRW type=write size=4007542 2024-09-12T17:18:14.121 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.120+0000 7f574d1ea780 1 < suggested remove operation key=HFWA7DNUMWF2 tag=RNQ6O1948WJL type=del 2024-09-12T17:18:14.122 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.121+0000 7f574d1ea780 1 > prepared operation key=54CM8800AT9V tag=B2IQ8252R7N2 type=del size=3143862 2024-09-12T17:18:14.123 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.122+0000 7f574d1ea780 1 < completed part key=_multipart_OI51GO639LFK.2~RE9A255L7FG5.0 size=1048576 2024-09-12T17:18:14.124 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.123+0000 7f574d1ea780 1 < completed part key=_multipart_OI51GO639LFK.2~RE9A255L7FG5.1 size=495585 2024-09-12T17:18:14.126 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.125+0000 7f574d1ea780 1 < completed multipart upload key=OI51GO639LFK upload=RE9A255L7FG5 tag=X21EA39H4GHS type=write size=2592737 2024-09-12T17:18:14.127 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.126+0000 7f574d1ea780 1 > prepared operation key=7BX38Q7723EB tag=CEIBFMPF7MV9 type=write size=323749 2024-09-12T17:18:14.128 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.128+0000 7f574d1ea780 1 < completed write operation key=K12MVG618809 tag=U0FJ1ON3B4QV type=write size=255352 2024-09-12T17:18:14.131 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.130+0000 7f574d1ea780 1 > prepared part key=_multipart_43GV2N9VBBKE.2~7J9HHECF8FPQ.0 size=903276 2024-09-12T17:18:14.131 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.130+0000 7f574d1ea780 1 > prepared multipart upload key=43GV2N9VBBKE upload=7J9HHECF8FPQ tag=2BZOKUEI0G1G type=write size=1951852 2024-09-12T17:18:14.132 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.131+0000 7f574d1ea780 1 < completed part key=_multipart_ZGE1860DMGHA.2~RDC2AEGAD3FH.0 size=934407 2024-09-12T17:18:14.134 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.133+0000 7f574d1ea780 1 < completed multipart upload key=ZGE1860DMGHA upload=RDC2AEGAD3FH tag=6BQ2IGWAWLOR type=write size=1982983 2024-09-12T17:18:14.136 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.135+0000 7f574d1ea780 1 > prepared part key=_multipart_8SG7DJO4HWPI.2~5EHGV8LI41Q0.0 size=446977 2024-09-12T17:18:14.136 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.135+0000 7f574d1ea780 1 > prepared multipart upload key=8SG7DJO4HWPI upload=5EHGV8LI41Q0 tag=TNVBA37B6O05 type=write size=1495553 2024-09-12T17:18:14.139 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.138+0000 7f574d1ea780 1 < suggested update operation key=DH02JGZP64MN tag=YGOWB11HN8BR type=del size=3639356 2024-09-12T17:18:14.140 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.139+0000 7f574d1ea780 1 > prepared operation key=GEGOEB05R0PK tag=TK1GC5HI1688 type=write size=765648 2024-09-12T17:18:14.141 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.140+0000 7f574d1ea780 1 < canceled operation key=TIKBUXFPVTN1 tag=I0P3F3WMRV75 type=del size=1799503 2024-09-12T17:18:14.143 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.143+0000 7f574d1ea780 1 > prepared part key=_multipart_D1GEG3MKPOM3.2~7ZXB2F9H8N6D.0 size=604435 2024-09-12T17:18:14.144 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.143+0000 7f574d1ea780 1 > prepared multipart upload key=D1GEG3MKPOM3 upload=7ZXB2F9H8N6D tag=PJX3U2SLD5KT type=write size=1653011 2024-09-12T17:18:14.145 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.144+0000 7f574d1ea780 1 < completed delete operation key=55JI541K1WP2 tag=VE5NKIR15IPO type=del 2024-09-12T17:18:14.147 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.146+0000 7f574d1ea780 1 > prepared part key=_multipart_RWVWJHVZE95H.2~BJF3QPUKT1R3.0 size=1048576 2024-09-12T17:18:14.148 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.147+0000 7f574d1ea780 1 > prepared part key=_multipart_RWVWJHVZE95H.2~BJF3QPUKT1R3.1 size=511845 2024-09-12T17:18:14.148 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.147+0000 7f574d1ea780 1 > prepared multipart upload key=RWVWJHVZE95H upload=BJF3QPUKT1R3 tag=UG4V3DW0LLA7 type=write size=2608997 2024-09-12T17:18:14.149 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.148+0000 7f574d1ea780 1 < canceled part key=_multipart_UTCKL1F42X8A.2~O6EMTV5YGUWZ.0 size=1048576 2024-09-12T17:18:14.149 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.149+0000 7f574d1ea780 1 < completed part key=_multipart_UTCKL1F42X8A.2~O6EMTV5YGUWZ.1 size=1048576 2024-09-12T17:18:14.151 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.150+0000 7f574d1ea780 1 < completed part key=_multipart_UTCKL1F42X8A.2~O6EMTV5YGUWZ.2 size=655642 2024-09-12T17:18:14.153 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.152+0000 7f574d1ea780 1 < canceled multipart upload key=UTCKL1F42X8A upload=O6EMTV5YGUWZ tag=UUCQCTP3GB2T type=write size=3801370 2024-09-12T17:18:14.155 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.154+0000 7f574d1ea780 1 > prepared part key=_multipart_7BX38Q7723EB.2~P3WUJT1YC6NX.0 size=118998 2024-09-12T17:18:14.155 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.154+0000 7f574d1ea780 1 > prepared multipart upload key=7BX38Q7723EB upload=P3WUJT1YC6NX tag=P9A5RLN2G6IT type=write size=1167574 2024-09-12T17:18:14.156 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.155+0000 7f574d1ea780 1 < completed write operation key=UFKM4I8RMT0W tag=BBVVKMXSJGJ3 type=write size=399095 2024-09-12T17:18:14.158 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.157+0000 7f574d1ea780 1 > prepared part key=_multipart_8VW3XCUHLF2L.2~N8T9TNOYRUAF.0 size=1048576 2024-09-12T17:18:14.159 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.158+0000 7f574d1ea780 1 > prepared part key=_multipart_8VW3XCUHLF2L.2~N8T9TNOYRUAF.1 size=550943 2024-09-12T17:18:14.159 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.158+0000 7f574d1ea780 1 > prepared multipart upload key=8VW3XCUHLF2L upload=N8T9TNOYRUAF tag=AMS51U16TL6D type=write size=2648095 2024-09-12T17:18:14.160 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.159+0000 7f574d1ea780 1 < completed delete operation key=ZGH8XC39FGTC tag=TGUGNDJJEIDD type=del 2024-09-12T17:18:14.162 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.161+0000 7f574d1ea780 1 > prepared operation key=OI51GO639LFK tag=VVLS579C43XJ type=del size=1009628 2024-09-12T17:18:14.164 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.163+0000 7f574d1ea780 1 < completed part key=_multipart_VWWA5IB0L4N1.2~4QYI9A72Q6FY.0 size=1048576 2024-09-12T17:18:14.165 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.164+0000 7f574d1ea780 1 < completed part key=_multipart_VWWA5IB0L4N1.2~4QYI9A72Q6FY.1 size=655125 2024-09-12T17:18:14.167 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.166+0000 7f574d1ea780 1 < completed multipart upload key=VWWA5IB0L4N1 upload=4QYI9A72Q6FY tag=2TA443UNTTWT type=write size=2752277 2024-09-12T17:18:14.169 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.169+0000 7f574d1ea780 1 > prepared part key=_multipart_RWVWJHVZE95H.2~V24RGM2CTMWD.0 size=1048576 2024-09-12T17:18:14.170 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.170+0000 7f574d1ea780 1 > prepared part key=_multipart_RWVWJHVZE95H.2~V24RGM2CTMWD.1 size=282077 2024-09-12T17:18:14.171 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.170+0000 7f574d1ea780 1 > prepared multipart upload key=RWVWJHVZE95H upload=V24RGM2CTMWD tag=DPF2II4FB0UO type=write size=2379229 2024-09-12T17:18:14.173 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.172+0000 7f574d1ea780 1 < suggested update operation key=ZGH8XC39FGTC tag=7CEDOC41FSV4 type=del size=3063231 2024-09-12T17:18:14.174 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.173+0000 7f574d1ea780 1 > prepared operation key=A1TIP3RXHBCZ tag=RNYM8MHP9NQR type=write size=652350 2024-09-12T17:18:14.176 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.175+0000 7f574d1ea780 1 < completed delete operation key=8SG7DJO4HWPI tag=P0U56BQ4H4LA type=del 2024-09-12T17:18:14.178 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.177+0000 7f574d1ea780 1 > prepared part key=_multipart_ZGH8XC39FGTC.2~YVP6UA9GUU9C.0 size=43785 2024-09-12T17:18:14.178 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.177+0000 7f574d1ea780 1 > prepared multipart upload key=ZGH8XC39FGTC upload=YVP6UA9GUU9C tag=FIC8NS1V5AWK type=write size=1092361 2024-09-12T17:18:14.180 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.179+0000 7f574d1ea780 1 < completed write operation key=D1GEG3MKPOM3 tag=1N4ZV2RL58AI type=write size=492441 2024-09-12T17:18:14.181 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.180+0000 7f574d1ea780 1 > prepared operation key=ENFNIFHQ3SHW tag=6LMCF11A6435 type=write size=799612 2024-09-12T17:18:14.182 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.182+0000 7f574d1ea780 1 < completed delete operation key=55JI541K1WP2 tag=C02MAGMBE69Z type=del 2024-09-12T17:18:14.184 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.183+0000 7f574d1ea780 1 > prepared operation key=54LQ91UMBJAN tag=QW1NJMFUX7XM type=del size=3253071 2024-09-12T17:18:14.185 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.184+0000 7f574d1ea780 1 < completed part key=_multipart_UTCKL1F42X8A.2~K4R34XY8YZZ1.0 size=1048576 2024-09-12T17:18:14.186 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.185+0000 7f574d1ea780 1 < completed part key=_multipart_UTCKL1F42X8A.2~K4R34XY8YZZ1.1 size=1048576 2024-09-12T17:18:14.187 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.186+0000 7f574d1ea780 1 < completed part key=_multipart_UTCKL1F42X8A.2~K4R34XY8YZZ1.2 size=861814 2024-09-12T17:18:14.189 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.188+0000 7f574d1ea780 1 < completed multipart upload key=UTCKL1F42X8A upload=K4R34XY8YZZ1 tag=Y4GNGL783GRW type=write size=4007542 2024-09-12T17:18:14.190 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.190+0000 7f574d1ea780 1 > prepared operation key=R00F69ON5P6Z tag=NI5R2NFNWO1J type=write size=867477 2024-09-12T17:18:14.193 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.192+0000 7f574d1ea780 1 < suggested remove operation key=54CM8800AT9V tag=B2IQ8252R7N2 type=del 2024-09-12T17:18:14.195 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.194+0000 7f574d1ea780 1 > prepared part key=_multipart_VWWA5IB0L4N1.2~ZTTD7O8TW7QV.0 size=622888 2024-09-12T17:18:14.195 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.194+0000 7f574d1ea780 1 > prepared multipart upload key=VWWA5IB0L4N1 upload=ZTTD7O8TW7QV tag=HVNA7E0CKC3O type=write size=1671464 2024-09-12T17:18:14.197 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.196+0000 7f574d1ea780 1 < completed write operation key=7BX38Q7723EB tag=CEIBFMPF7MV9 type=write size=323749 2024-09-12T17:18:14.200 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.199+0000 7f574d1ea780 1 > prepared part key=_multipart_YXIDO0U18839.2~TZ3D3H2GWD84.0 size=1048576 2024-09-12T17:18:14.201 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.200+0000 7f574d1ea780 1 > prepared part key=_multipart_YXIDO0U18839.2~TZ3D3H2GWD84.1 size=1048576 2024-09-12T17:18:14.202 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.201+0000 7f574d1ea780 1 > prepared part key=_multipart_YXIDO0U18839.2~TZ3D3H2GWD84.2 size=712766 2024-09-12T17:18:14.202 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.201+0000 7f574d1ea780 1 > prepared multipart upload key=YXIDO0U18839 upload=TZ3D3H2GWD84 tag=CF66FG8DVTUS type=write size=3858494 2024-09-12T17:18:14.203 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.202+0000 7f574d1ea780 1 < completed part key=_multipart_43GV2N9VBBKE.2~7J9HHECF8FPQ.0 size=903276 2024-09-12T17:18:14.205 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.204+0000 7f574d1ea780 1 < completed multipart upload key=43GV2N9VBBKE upload=7J9HHECF8FPQ tag=2BZOKUEI0G1G type=write size=1951852 2024-09-12T17:18:14.207 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.206+0000 7f574d1ea780 1 > prepared operation key=Q2Q3B1J3DAVD tag=L8QFIR9ABLGV type=del size=2925992 2024-09-12T17:18:14.208 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.207+0000 7f574d1ea780 1 < completed part key=_multipart_8SG7DJO4HWPI.2~5EHGV8LI41Q0.0 size=446977 2024-09-12T17:18:14.210 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.209+0000 7f574d1ea780 1 < completed multipart upload key=8SG7DJO4HWPI upload=5EHGV8LI41Q0 tag=TNVBA37B6O05 type=write size=1495553 2024-09-12T17:18:14.211 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.210+0000 7f574d1ea780 1 > prepared operation key=UFKM4I8RMT0W tag=CDSDMC0H5LOU type=write size=468112 2024-09-12T17:18:14.214 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.213+0000 7f574d1ea780 1 < suggested update operation key=GEGOEB05R0PK tag=TK1GC5HI1688 type=write size=765648 2024-09-12T17:18:14.216 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.215+0000 7f574d1ea780 1 > prepared part key=_multipart_ZGH8XC39FGTC.2~0PLSYAUE30H1.0 size=1048576 2024-09-12T17:18:14.217 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.216+0000 7f574d1ea780 1 > prepared part key=_multipart_ZGH8XC39FGTC.2~0PLSYAUE30H1.1 size=1048576 2024-09-12T17:18:14.218 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.217+0000 7f574d1ea780 1 > prepared part key=_multipart_ZGH8XC39FGTC.2~0PLSYAUE30H1.2 size=430463 2024-09-12T17:18:14.218 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.217+0000 7f574d1ea780 1 > prepared multipart upload key=ZGH8XC39FGTC upload=0PLSYAUE30H1 tag=2MST9W9PW11D type=write size=3576191 2024-09-12T17:18:14.219 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.218+0000 7f574d1ea780 1 < completed part key=_multipart_D1GEG3MKPOM3.2~7ZXB2F9H8N6D.0 size=604435 2024-09-12T17:18:14.221 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.220+0000 7f574d1ea780 1 < completed multipart upload key=D1GEG3MKPOM3 upload=7ZXB2F9H8N6D tag=PJX3U2SLD5KT type=write size=1653011 2024-09-12T17:18:14.223 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.222+0000 7f574d1ea780 1 > prepared part key=_multipart_ENFNIFHQ3SHW.2~N93PW0PC6IN8.0 size=1002181 2024-09-12T17:18:14.223 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.222+0000 7f574d1ea780 1 > prepared multipart upload key=ENFNIFHQ3SHW upload=N93PW0PC6IN8 tag=YJ1FW7VEU4BG type=write size=2050757 2024-09-12T17:18:14.225 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.224+0000 7f574d1ea780 1 < completed part key=_multipart_RWVWJHVZE95H.2~BJF3QPUKT1R3.0 size=1048576 2024-09-12T17:18:14.226 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.225+0000 7f574d1ea780 1 < completed part key=_multipart_RWVWJHVZE95H.2~BJF3QPUKT1R3.1 size=511845 2024-09-12T17:18:14.228 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.227+0000 7f574d1ea780 1 < completed multipart upload key=RWVWJHVZE95H upload=BJF3QPUKT1R3 tag=UG4V3DW0LLA7 type=write size=2608997 2024-09-12T17:18:14.229 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.228+0000 7f574d1ea780 1 > prepared operation key=SQQMJ61CA0QW tag=YZQ0V8U2E1PJ type=del size=3028520 2024-09-12T17:18:14.231 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.230+0000 7f574d1ea780 1 < completed part key=_multipart_7BX38Q7723EB.2~P3WUJT1YC6NX.0 size=118998 2024-09-12T17:18:14.233 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.232+0000 7f574d1ea780 1 < completed multipart upload key=7BX38Q7723EB upload=P3WUJT1YC6NX tag=P9A5RLN2G6IT type=write size=1167574 2024-09-12T17:18:14.234 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.234+0000 7f574d1ea780 1 > prepared operation key=TIKBUXFPVTN1 tag=2OLEXQS4NQRP type=del size=1156128 2024-09-12T17:18:14.236 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.235+0000 7f574d1ea780 1 < completed part key=_multipart_8VW3XCUHLF2L.2~N8T9TNOYRUAF.0 size=1048576 2024-09-12T17:18:14.237 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.236+0000 7f574d1ea780 1 < completed part key=_multipart_8VW3XCUHLF2L.2~N8T9TNOYRUAF.1 size=550943 2024-09-12T17:18:14.239 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.238+0000 7f574d1ea780 1 < completed multipart upload key=8VW3XCUHLF2L upload=N8T9TNOYRUAF tag=AMS51U16TL6D type=write size=2648095 2024-09-12T17:18:14.241 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.240+0000 7f574d1ea780 1 > prepared part key=_multipart_R00F69ON5P6Z.2~53Q92UYX35H4.0 size=1048576 2024-09-12T17:18:14.242 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.242+0000 7f574d1ea780 1 > prepared part key=_multipart_R00F69ON5P6Z.2~53Q92UYX35H4.1 size=143421 2024-09-12T17:18:14.243 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.242+0000 7f574d1ea780 1 > prepared multipart upload key=R00F69ON5P6Z upload=53Q92UYX35H4 tag=WGPC7A0C7ZIK type=write size=2240573 2024-09-12T17:18:14.244 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.243+0000 7f574d1ea780 1 < completed delete operation key=OI51GO639LFK tag=VVLS579C43XJ type=del 2024-09-12T17:18:14.246 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.245+0000 7f574d1ea780 1 > prepared part key=_multipart_D1GEG3MKPOM3.2~8RGMTWQGZRM3.0 size=1048576 2024-09-12T17:18:14.247 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.246+0000 7f574d1ea780 1 > prepared part key=_multipart_D1GEG3MKPOM3.2~8RGMTWQGZRM3.1 size=1048576 2024-09-12T17:18:14.248 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.247+0000 7f574d1ea780 1 > prepared part key=_multipart_D1GEG3MKPOM3.2~8RGMTWQGZRM3.2 size=534250 2024-09-12T17:18:14.248 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.247+0000 7f574d1ea780 1 > prepared multipart upload key=D1GEG3MKPOM3 upload=8RGMTWQGZRM3 tag=L3EVXVFTHZ5H type=write size=3679978 2024-09-12T17:18:14.249 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.248+0000 7f574d1ea780 1 < completed part key=_multipart_RWVWJHVZE95H.2~V24RGM2CTMWD.0 size=1048576 2024-09-12T17:18:14.250 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.249+0000 7f574d1ea780 1 < completed part key=_multipart_RWVWJHVZE95H.2~V24RGM2CTMWD.1 size=282077 2024-09-12T17:18:14.252 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.251+0000 7f574d1ea780 1 < completed multipart upload key=RWVWJHVZE95H upload=V24RGM2CTMWD tag=DPF2II4FB0UO type=write size=2379229 2024-09-12T17:18:14.254 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.253+0000 7f574d1ea780 1 > prepared operation key=ZGH8XC39FGTC tag=LF8ZGARFRQRQ type=write size=527277 2024-09-12T17:18:14.255 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.254+0000 7f574d1ea780 1 < completed write operation key=A1TIP3RXHBCZ tag=RNYM8MHP9NQR type=write size=652350 2024-09-12T17:18:14.256 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.255+0000 7f574d1ea780 1 > prepared operation key=UTCKL1F42X8A tag=1VJC0OVQDK3G type=del size=2106973 2024-09-12T17:18:14.257 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.256+0000 7f574d1ea780 1 < completed part key=_multipart_ZGH8XC39FGTC.2~YVP6UA9GUU9C.0 size=43785 2024-09-12T17:18:14.259 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.259+0000 7f574d1ea780 1 < completed multipart upload key=ZGH8XC39FGTC upload=YVP6UA9GUU9C tag=FIC8NS1V5AWK type=write size=1092361 2024-09-12T17:18:14.261 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.260+0000 7f574d1ea780 1 > prepared operation key=OI51GO639LFK tag=GUYL72X5AA3I type=write size=387213 2024-09-12T17:18:14.262 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.261+0000 7f574d1ea780 1 < completed write operation key=ENFNIFHQ3SHW tag=6LMCF11A6435 type=write size=799612 2024-09-12T17:18:14.263 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.262+0000 7f574d1ea780 1 > prepared operation key=SQQMJ61CA0QW tag=LG6X50SLTVQV type=del size=3736528 2024-09-12T17:18:14.264 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.263+0000 7f574d1ea780 1 < completed delete operation key=54LQ91UMBJAN tag=QW1NJMFUX7XM type=del 2024-09-12T17:18:14.266 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.265+0000 7f574d1ea780 1 > prepared part key=_multipart_7BX38Q7723EB.2~0O54DXX0R3BV.0 size=1048576 2024-09-12T17:18:14.267 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.266+0000 7f574d1ea780 1 > prepared part key=_multipart_7BX38Q7723EB.2~0O54DXX0R3BV.1 size=746137 2024-09-12T17:18:14.267 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.266+0000 7f574d1ea780 1 > prepared multipart upload key=7BX38Q7723EB upload=0O54DXX0R3BV tag=352CFRMR5HQ9 type=write size=2843289 2024-09-12T17:18:14.269 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.268+0000 7f574d1ea780 1 < canceled operation key=R00F69ON5P6Z tag=NI5R2NFNWO1J type=write size=867477 2024-09-12T17:18:14.271 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.270+0000 7f574d1ea780 1 > prepared part key=_multipart_HGZMN894YYC0.2~8O7VBIAOIY7L.0 size=1048576 2024-09-12T17:18:14.272 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.271+0000 7f574d1ea780 1 > prepared part key=_multipart_HGZMN894YYC0.2~8O7VBIAOIY7L.1 size=1048576 2024-09-12T17:18:14.273 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.272+0000 7f574d1ea780 1 > prepared part key=_multipart_HGZMN894YYC0.2~8O7VBIAOIY7L.2 size=576454 2024-09-12T17:18:14.273 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.272+0000 7f574d1ea780 1 > prepared multipart upload key=HGZMN894YYC0 upload=8O7VBIAOIY7L tag=IRJRG1WFBRVX type=write size=3722182 2024-09-12T17:18:14.273 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.272+0000 7f574d1ea780 1 < canceled part key=_multipart_VWWA5IB0L4N1.2~ZTTD7O8TW7QV.0 size=622888 2024-09-12T17:18:14.275 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.274+0000 7f574d1ea780 1 < canceled multipart upload key=VWWA5IB0L4N1 upload=ZTTD7O8TW7QV tag=HVNA7E0CKC3O type=write size=1671464 2024-09-12T17:18:14.276 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.276+0000 7f574d1ea780 1 > prepared operation key=TIKBUXFPVTN1 tag=H5YYK4B5VMQ8 type=del size=3203935 2024-09-12T17:18:14.278 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.277+0000 7f574d1ea780 1 < completed part key=_multipart_YXIDO0U18839.2~TZ3D3H2GWD84.0 size=1048576 2024-09-12T17:18:14.279 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.278+0000 7f574d1ea780 1 < completed part key=_multipart_YXIDO0U18839.2~TZ3D3H2GWD84.1 size=1048576 2024-09-12T17:18:14.280 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.279+0000 7f574d1ea780 1 < completed part key=_multipart_YXIDO0U18839.2~TZ3D3H2GWD84.2 size=712766 2024-09-12T17:18:14.282 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.281+0000 7f574d1ea780 1 < completed multipart upload key=YXIDO0U18839 upload=TZ3D3H2GWD84 tag=CF66FG8DVTUS type=write size=3858494 2024-09-12T17:18:14.283 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.282+0000 7f574d1ea780 1 > prepared operation key=55V137SY4E4P tag=JQ260DWZ13A5 type=del size=1116799 2024-09-12T17:18:14.284 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.284+0000 7f574d1ea780 1 < completed delete operation key=Q2Q3B1J3DAVD tag=L8QFIR9ABLGV type=del 2024-09-12T17:18:14.287 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.286+0000 7f574d1ea780 1 > prepared part key=_multipart_ZGE1860DMGHA.2~5Y7GKU2B9WNI.0 size=1048576 2024-09-12T17:18:14.288 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.287+0000 7f574d1ea780 1 > prepared part key=_multipart_ZGE1860DMGHA.2~5Y7GKU2B9WNI.1 size=1048576 2024-09-12T17:18:14.289 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.288+0000 7f574d1ea780 1 > prepared part key=_multipart_ZGE1860DMGHA.2~5Y7GKU2B9WNI.2 size=264633 2024-09-12T17:18:14.289 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.288+0000 7f574d1ea780 1 > prepared multipart upload key=ZGE1860DMGHA upload=5Y7GKU2B9WNI tag=695JY7UTOL2T type=write size=3410361 2024-09-12T17:18:14.290 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.289+0000 7f574d1ea780 1 < completed write operation key=UFKM4I8RMT0W tag=CDSDMC0H5LOU type=write size=468112 2024-09-12T17:18:14.292 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.291+0000 7f574d1ea780 1 > prepared operation key=C9IYR9CET1I8 tag=JDTPFW87RCJO type=del size=3075241 2024-09-12T17:18:14.293 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.292+0000 7f574d1ea780 1 < completed part key=_multipart_ZGH8XC39FGTC.2~0PLSYAUE30H1.0 size=1048576 2024-09-12T17:18:14.294 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.293+0000 7f574d1ea780 1 < completed part key=_multipart_ZGH8XC39FGTC.2~0PLSYAUE30H1.1 size=1048576 2024-09-12T17:18:14.295 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.294+0000 7f574d1ea780 1 < completed part key=_multipart_ZGH8XC39FGTC.2~0PLSYAUE30H1.2 size=430463 2024-09-12T17:18:14.297 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.296+0000 7f574d1ea780 1 < completed multipart upload key=ZGH8XC39FGTC upload=0PLSYAUE30H1 tag=2MST9W9PW11D type=write size=3576191 2024-09-12T17:18:14.299 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.298+0000 7f574d1ea780 1 > prepared operation key=R00F69ON5P6Z tag=C4PYRJGMQ4M4 type=write size=937701 2024-09-12T17:18:14.300 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.299+0000 7f574d1ea780 1 < completed part key=_multipart_ENFNIFHQ3SHW.2~N93PW0PC6IN8.0 size=1002181 2024-09-12T17:18:14.302 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.301+0000 7f574d1ea780 1 < completed multipart upload key=ENFNIFHQ3SHW upload=N93PW0PC6IN8 tag=YJ1FW7VEU4BG type=write size=2050757 2024-09-12T17:18:14.304 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.303+0000 7f574d1ea780 1 > prepared operation key=8VW3XCUHLF2L tag=N8E9626T4870 type=del size=3781737 2024-09-12T17:18:14.306 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.305+0000 7f574d1ea780 1 < suggested remove operation key=SQQMJ61CA0QW tag=YZQ0V8U2E1PJ type=del 2024-09-12T17:18:14.307 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.306+0000 7f574d1ea780 1 > prepared operation key=55JI541K1WP2 tag=62MJV0RQPNMW type=del size=1835775 2024-09-12T17:18:14.309 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.308+0000 7f574d1ea780 1 < completed delete operation key=TIKBUXFPVTN1 tag=2OLEXQS4NQRP type=del 2024-09-12T17:18:14.310 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.309+0000 7f574d1ea780 1 > prepared operation key=Q2Q3B1J3DAVD tag=DP92T1VU7X0H type=del size=874686 2024-09-12T17:18:14.312 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.311+0000 7f574d1ea780 1 < completed part key=_multipart_R00F69ON5P6Z.2~53Q92UYX35H4.0 size=1048576 2024-09-12T17:18:14.312 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.311+0000 7f574d1ea780 1 < canceled part key=_multipart_R00F69ON5P6Z.2~53Q92UYX35H4.1 size=143421 2024-09-12T17:18:14.314 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.313+0000 7f574d1ea780 1 < canceled multipart upload key=R00F69ON5P6Z upload=53Q92UYX35H4 tag=WGPC7A0C7ZIK type=write size=2240573 2024-09-12T17:18:14.318 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.317+0000 7f574d1ea780 1 > prepared part key=_multipart_TIKBUXFPVTN1.2~KE0K5JDZHFZG.0 size=1033776 2024-09-12T17:18:14.318 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.317+0000 7f574d1ea780 1 > prepared multipart upload key=TIKBUXFPVTN1 upload=KE0K5JDZHFZG tag=04LQOAM8CNES type=write size=2082352 2024-09-12T17:18:14.320 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.319+0000 7f574d1ea780 1 < completed part key=_multipart_D1GEG3MKPOM3.2~8RGMTWQGZRM3.0 size=1048576 2024-09-12T17:18:14.320 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.319+0000 7f574d1ea780 1 < canceled part key=_multipart_D1GEG3MKPOM3.2~8RGMTWQGZRM3.1 size=1048576 2024-09-12T17:18:14.321 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.320+0000 7f574d1ea780 1 < completed part key=_multipart_D1GEG3MKPOM3.2~8RGMTWQGZRM3.2 size=534250 2024-09-12T17:18:14.323 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.322+0000 7f574d1ea780 1 < canceled multipart upload key=D1GEG3MKPOM3 upload=8RGMTWQGZRM3 tag=L3EVXVFTHZ5H type=write size=3679978 2024-09-12T17:18:14.325 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.324+0000 7f574d1ea780 1 > prepared operation key=54CM8800AT9V tag=V1PCFLGED4S2 type=del size=3887063 2024-09-12T17:18:14.326 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.325+0000 7f574d1ea780 1 < completed write operation key=ZGH8XC39FGTC tag=LF8ZGARFRQRQ type=write size=527277 2024-09-12T17:18:14.329 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.328+0000 7f574d1ea780 1 > prepared part key=_multipart_ZGH8XC39FGTC.2~OJTD0QN0OE03.0 size=1048576 2024-09-12T17:18:14.330 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.329+0000 7f574d1ea780 1 > prepared part key=_multipart_ZGH8XC39FGTC.2~OJTD0QN0OE03.1 size=1048576 2024-09-12T17:18:14.331 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.330+0000 7f574d1ea780 1 > prepared part key=_multipart_ZGH8XC39FGTC.2~OJTD0QN0OE03.2 size=270913 2024-09-12T17:18:14.331 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.330+0000 7f574d1ea780 1 > prepared multipart upload key=ZGH8XC39FGTC upload=OJTD0QN0OE03 tag=7TK93W111KOM type=write size=3416641 2024-09-12T17:18:14.333 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.332+0000 7f574d1ea780 1 < canceled operation key=UTCKL1F42X8A tag=1VJC0OVQDK3G type=del size=2106973 2024-09-12T17:18:14.334 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.334+0000 7f574d1ea780 1 > prepared operation key=A1TIP3RXHBCZ tag=7MCI9SFLO63F type=del size=1068023 2024-09-12T17:18:14.336 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.335+0000 7f574d1ea780 1 < completed write operation key=OI51GO639LFK tag=GUYL72X5AA3I type=write size=387213 2024-09-12T17:18:14.337 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.336+0000 7f574d1ea780 1 > prepared operation key=8VW3XCUHLF2L tag=3NZQ93ECLD2C type=del size=3207824 2024-09-12T17:18:14.339 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.338+0000 7f574d1ea780 -1 < failed to complete operation key=SQQMJ61CA0QW tag=LG6X50SLTVQV type=del size=3736528: (22) Invalid argument 2024-09-12T17:18:14.340 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.340+0000 7f574d1ea780 1 > prepared operation key=Q2Q3B1J3DAVD tag=K2T8XN5JI2W5 type=write size=385420 2024-09-12T17:18:14.342 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.341+0000 7f574d1ea780 1 < completed part key=_multipart_7BX38Q7723EB.2~0O54DXX0R3BV.0 size=1048576 2024-09-12T17:18:14.343 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.343+0000 7f574d1ea780 1 < completed part key=_multipart_7BX38Q7723EB.2~0O54DXX0R3BV.1 size=746137 2024-09-12T17:18:14.345 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.345+0000 7f574d1ea780 1 < completed multipart upload key=7BX38Q7723EB upload=0O54DXX0R3BV tag=352CFRMR5HQ9 type=write size=2843289 2024-09-12T17:18:14.347 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.346+0000 7f574d1ea780 1 > prepared operation key=VWWA5IB0L4N1 tag=8YA1R76B769Z type=del size=2414168 2024-09-12T17:18:14.348 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.347+0000 7f574d1ea780 1 < completed part key=_multipart_HGZMN894YYC0.2~8O7VBIAOIY7L.0 size=1048576 2024-09-12T17:18:14.349 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.348+0000 7f574d1ea780 1 < completed part key=_multipart_HGZMN894YYC0.2~8O7VBIAOIY7L.1 size=1048576 2024-09-12T17:18:14.350 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.349+0000 7f574d1ea780 1 < completed part key=_multipart_HGZMN894YYC0.2~8O7VBIAOIY7L.2 size=576454 2024-09-12T17:18:14.352 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.351+0000 7f574d1ea780 1 < completed multipart upload key=HGZMN894YYC0 upload=8O7VBIAOIY7L tag=IRJRG1WFBRVX type=write size=3722182 2024-09-12T17:18:14.356 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.354+0000 7f574d1ea780 1 > prepared part key=_multipart_U6E9A5OH4GUW.2~6UZG0YVXRS8C.0 size=166072 2024-09-12T17:18:14.356 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.354+0000 7f574d1ea780 1 > prepared multipart upload key=U6E9A5OH4GUW upload=6UZG0YVXRS8C tag=3D7PYRS2YKZ9 type=write size=1214648 2024-09-12T17:18:14.357 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.356+0000 7f574d1ea780 1 < completed delete operation key=TIKBUXFPVTN1 tag=H5YYK4B5VMQ8 type=del 2024-09-12T17:18:14.358 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.357+0000 7f574d1ea780 1 > prepared operation key=ENFNIFHQ3SHW tag=8IYQXP1BV3HL type=del size=3113282 2024-09-12T17:18:14.359 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.358+0000 7f574d1ea780 1 < completed delete operation key=55V137SY4E4P tag=JQ260DWZ13A5 type=del 2024-09-12T17:18:14.360 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.360+0000 7f574d1ea780 1 > prepared operation key=8SG7DJO4HWPI tag=LBC9EGBV46HR type=del size=2476529 2024-09-12T17:18:14.362 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.361+0000 7f574d1ea780 1 < completed part key=_multipart_ZGE1860DMGHA.2~5Y7GKU2B9WNI.0 size=1048576 2024-09-12T17:18:14.363 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.362+0000 7f574d1ea780 1 < completed part key=_multipart_ZGE1860DMGHA.2~5Y7GKU2B9WNI.1 size=1048576 2024-09-12T17:18:14.364 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.363+0000 7f574d1ea780 1 < completed part key=_multipart_ZGE1860DMGHA.2~5Y7GKU2B9WNI.2 size=264633 2024-09-12T17:18:14.366 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.365+0000 7f574d1ea780 1 < completed multipart upload key=ZGE1860DMGHA upload=5Y7GKU2B9WNI tag=695JY7UTOL2T type=write size=3410361 2024-09-12T17:18:14.368 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.367+0000 7f574d1ea780 1 > prepared part key=_multipart_HFWA7DNUMWF2.2~MV9MBNI0VVUO.0 size=898778 2024-09-12T17:18:14.368 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.367+0000 7f574d1ea780 1 > prepared multipart upload key=HFWA7DNUMWF2 upload=MV9MBNI0VVUO tag=1TBIACBU4X4A type=write size=1947354 2024-09-12T17:18:14.369 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.369+0000 7f574d1ea780 1 < canceled operation key=C9IYR9CET1I8 tag=JDTPFW87RCJO type=del size=3075241 2024-09-12T17:18:14.371 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.370+0000 7f574d1ea780 1 > prepared operation key=43GV2N9VBBKE tag=N05L9DROOEW2 type=del size=1126866 2024-09-12T17:18:14.372 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.371+0000 7f574d1ea780 1 < completed write operation key=R00F69ON5P6Z tag=C4PYRJGMQ4M4 type=write size=937701 2024-09-12T17:18:14.373 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.372+0000 7f574d1ea780 1 > prepared operation key=UFKM4I8RMT0W tag=ZDZDX6G081NE type=del size=1111669 2024-09-12T17:18:14.375 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.374+0000 7f574d1ea780 1 < completed delete operation key=8VW3XCUHLF2L tag=N8E9626T4870 type=del 2024-09-12T17:18:14.377 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.376+0000 7f574d1ea780 1 > prepared part key=_multipart_U6E9A5OH4GUW.2~UEVBHDMXJUXF.0 size=126654 2024-09-12T17:18:14.377 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.376+0000 7f574d1ea780 1 > prepared multipart upload key=U6E9A5OH4GUW upload=UEVBHDMXJUXF tag=VR7MN5X3G23D type=write size=1175230 2024-09-12T17:18:14.378 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.377+0000 7f574d1ea780 1 < canceled operation key=55JI541K1WP2 tag=62MJV0RQPNMW type=del size=1835775 2024-09-12T17:18:14.379 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.379+0000 7f574d1ea780 1 > prepared operation key=54LQ91UMBJAN tag=5XRB9MRY43Y6 type=del size=3510912 2024-09-12T17:18:14.382 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.381+0000 7f574d1ea780 1 < suggested update operation key=Q2Q3B1J3DAVD tag=DP92T1VU7X0H type=del size=874686 2024-09-12T17:18:14.386 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.385+0000 7f574d1ea780 1 > prepared part key=_multipart_SQQMJ61CA0QW.2~Q9RG5TZ8LCRF.0 size=1048576 2024-09-12T17:18:14.387 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.386+0000 7f574d1ea780 1 > prepared part key=_multipart_SQQMJ61CA0QW.2~Q9RG5TZ8LCRF.1 size=610889 2024-09-12T17:18:14.387 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.386+0000 7f574d1ea780 1 > prepared multipart upload key=SQQMJ61CA0QW upload=Q9RG5TZ8LCRF tag=1MXEZD1IHO9E type=write size=2708041 2024-09-12T17:18:14.388 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.387+0000 7f574d1ea780 1 < completed part key=_multipart_TIKBUXFPVTN1.2~KE0K5JDZHFZG.0 size=1033776 2024-09-12T17:18:14.390 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.390+0000 7f574d1ea780 1 < completed multipart upload key=TIKBUXFPVTN1 upload=KE0K5JDZHFZG tag=04LQOAM8CNES type=write size=2082352 2024-09-12T17:18:14.392 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.391+0000 7f574d1ea780 1 > prepared operation key=K12MVG618809 tag=1AZJ4TLL4EBP type=del size=2902397 2024-09-12T17:18:14.393 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.392+0000 7f574d1ea780 1 < completed delete operation key=54CM8800AT9V tag=V1PCFLGED4S2 type=del 2024-09-12T17:18:14.396 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.395+0000 7f574d1ea780 1 > prepared part key=_multipart_UFKM4I8RMT0W.2~27P9A2AM9TE3.0 size=1048576 2024-09-12T17:18:14.397 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.396+0000 7f574d1ea780 1 > prepared part key=_multipart_UFKM4I8RMT0W.2~27P9A2AM9TE3.1 size=1048576 2024-09-12T17:18:14.398 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.397+0000 7f574d1ea780 1 > prepared part key=_multipart_UFKM4I8RMT0W.2~27P9A2AM9TE3.2 size=764174 2024-09-12T17:18:14.398 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.397+0000 7f574d1ea780 1 > prepared multipart upload key=UFKM4I8RMT0W upload=27P9A2AM9TE3 tag=6FVN92DD1CEG type=write size=3909902 2024-09-12T17:18:14.399 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.398+0000 7f574d1ea780 1 < completed part key=_multipart_ZGH8XC39FGTC.2~OJTD0QN0OE03.0 size=1048576 2024-09-12T17:18:14.400 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.399+0000 7f574d1ea780 1 < completed part key=_multipart_ZGH8XC39FGTC.2~OJTD0QN0OE03.1 size=1048576 2024-09-12T17:18:14.400 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.399+0000 7f574d1ea780 1 < canceled part key=_multipart_ZGH8XC39FGTC.2~OJTD0QN0OE03.2 size=270913 2024-09-12T17:18:14.402 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.401+0000 7f574d1ea780 1 < canceled multipart upload key=ZGH8XC39FGTC upload=OJTD0QN0OE03 tag=7TK93W111KOM type=write size=3416641 2024-09-12T17:18:14.403 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.402+0000 7f574d1ea780 1 > prepared operation key=55JI541K1WP2 tag=IDB34U2IKXTL type=del size=2721812 2024-09-12T17:18:14.406 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.405+0000 7f574d1ea780 1 < suggested remove operation key=A1TIP3RXHBCZ tag=7MCI9SFLO63F type=del 2024-09-12T17:18:14.407 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.406+0000 7f574d1ea780 1 > prepared operation key=C9IYR9CET1I8 tag=GD3S2C5IEM60 type=write size=508341 2024-09-12T17:18:14.408 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.407+0000 7f574d1ea780 1 < completed delete operation key=8VW3XCUHLF2L tag=3NZQ93ECLD2C type=del 2024-09-12T17:18:14.409 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.408+0000 7f574d1ea780 1 > prepared operation key=UFKM4I8RMT0W tag=PUZIUD6EOCDL type=del size=3812104 2024-09-12T17:18:14.410 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.410+0000 7f574d1ea780 -1 < failed to complete operation key=Q2Q3B1J3DAVD tag=K2T8XN5JI2W5 type=write size=385420: (22) Invalid argument 2024-09-12T17:18:14.413 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.412+0000 7f574d1ea780 1 > prepared part key=_multipart_QXD8UG2K4STQ.2~5OLE3OL89ZLG.0 size=821474 2024-09-12T17:18:14.413 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.412+0000 7f574d1ea780 1 > prepared multipart upload key=QXD8UG2K4STQ upload=5OLE3OL89ZLG tag=RKZQ7OYPP1I8 type=write size=1870050 2024-09-12T17:18:14.414 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.413+0000 7f574d1ea780 1 < completed delete operation key=VWWA5IB0L4N1 tag=8YA1R76B769Z type=del 2024-09-12T17:18:14.415 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.414+0000 7f574d1ea780 1 > prepared operation key=C9IYR9CET1I8 tag=5EKQX838DJ7J type=del size=3999859 2024-09-12T17:18:14.416 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.416+0000 7f574d1ea780 1 < completed part key=_multipart_U6E9A5OH4GUW.2~6UZG0YVXRS8C.0 size=166072 2024-09-12T17:18:14.418 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.418+0000 7f574d1ea780 1 < completed multipart upload key=U6E9A5OH4GUW upload=6UZG0YVXRS8C tag=3D7PYRS2YKZ9 type=write size=1214648 2024-09-12T17:18:14.420 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.419+0000 7f574d1ea780 1 > prepared operation key=8SG7DJO4HWPI tag=P688O0PON4K5 type=write size=404835 2024-09-12T17:18:14.421 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.420+0000 7f574d1ea780 1 < canceled operation key=ENFNIFHQ3SHW tag=8IYQXP1BV3HL type=del size=3113282 2024-09-12T17:18:14.423 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.422+0000 7f574d1ea780 1 > prepared part key=_multipart_54CM8800AT9V.2~4MZ3SK37HL9N.0 size=513802 2024-09-12T17:18:14.423 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.422+0000 7f574d1ea780 1 > prepared multipart upload key=54CM8800AT9V upload=4MZ3SK37HL9N tag=9XDYT9K60OBM type=write size=1562378 2024-09-12T17:18:14.424 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.424+0000 7f574d1ea780 1 < completed delete operation key=8SG7DJO4HWPI tag=LBC9EGBV46HR type=del 2024-09-12T17:18:14.427 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.426+0000 7f574d1ea780 1 > prepared part key=_multipart_OI51GO639LFK.2~4CBCY21T1VKT.0 size=1048576 2024-09-12T17:18:14.428 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.427+0000 7f574d1ea780 1 > prepared part key=_multipart_OI51GO639LFK.2~4CBCY21T1VKT.1 size=552417 2024-09-12T17:18:14.428 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.427+0000 7f574d1ea780 1 > prepared multipart upload key=OI51GO639LFK upload=4CBCY21T1VKT tag=T1977DGOPJNM type=write size=2649569 2024-09-12T17:18:14.429 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.428+0000 7f574d1ea780 1 < completed part key=_multipart_HFWA7DNUMWF2.2~MV9MBNI0VVUO.0 size=898778 2024-09-12T17:18:14.431 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.430+0000 7f574d1ea780 1 < completed multipart upload key=HFWA7DNUMWF2 upload=MV9MBNI0VVUO tag=1TBIACBU4X4A type=write size=1947354 2024-09-12T17:18:14.433 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.433+0000 7f574d1ea780 1 > prepared part key=_multipart_7BX38Q7723EB.2~U6QT1W9MENYK.0 size=1048576 2024-09-12T17:18:14.434 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.434+0000 7f574d1ea780 1 > prepared part key=_multipart_7BX38Q7723EB.2~U6QT1W9MENYK.1 size=1048576 2024-09-12T17:18:14.436 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.435+0000 7f574d1ea780 1 > prepared part key=_multipart_7BX38Q7723EB.2~U6QT1W9MENYK.2 size=835642 2024-09-12T17:18:14.436 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.435+0000 7f574d1ea780 1 > prepared multipart upload key=7BX38Q7723EB upload=U6QT1W9MENYK tag=G913ZAQ25V2D type=write size=3981370 2024-09-12T17:18:14.437 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.436+0000 7f574d1ea780 1 < completed delete operation key=43GV2N9VBBKE tag=N05L9DROOEW2 type=del 2024-09-12T17:18:14.439 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.438+0000 7f574d1ea780 1 > prepared part key=_multipart_UTCKL1F42X8A.2~EV6F9P6YS2ZS.0 size=548149 2024-09-12T17:18:14.439 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.438+0000 7f574d1ea780 1 > prepared multipart upload key=UTCKL1F42X8A upload=EV6F9P6YS2ZS tag=BLSGZ8R1V3SU type=write size=1596725 2024-09-12T17:18:14.440 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.439+0000 7f574d1ea780 1 < completed delete operation key=UFKM4I8RMT0W tag=ZDZDX6G081NE type=del 2024-09-12T17:18:14.443 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.442+0000 7f574d1ea780 1 > prepared part key=_multipart_TIKBUXFPVTN1.2~W7GRT75JX4BO.0 size=211101 2024-09-12T17:18:14.443 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.442+0000 7f574d1ea780 1 > prepared multipart upload key=TIKBUXFPVTN1 upload=W7GRT75JX4BO tag=NSJJPZ6NLWJF type=write size=1259677 2024-09-12T17:18:14.444 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.443+0000 7f574d1ea780 1 < completed part key=_multipart_U6E9A5OH4GUW.2~UEVBHDMXJUXF.0 size=126654 2024-09-12T17:18:14.446 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.445+0000 7f574d1ea780 1 < completed multipart upload key=U6E9A5OH4GUW upload=UEVBHDMXJUXF tag=VR7MN5X3G23D type=write size=1175230 2024-09-12T17:18:14.448 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.448+0000 7f574d1ea780 1 > prepared part key=_multipart_TIKBUXFPVTN1.2~R91Y14A9HGKZ.0 size=1048576 2024-09-12T17:18:14.449 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.449+0000 7f574d1ea780 1 > prepared part key=_multipart_TIKBUXFPVTN1.2~R91Y14A9HGKZ.1 size=552317 2024-09-12T17:18:14.450 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.449+0000 7f574d1ea780 1 > prepared multipart upload key=TIKBUXFPVTN1 upload=R91Y14A9HGKZ tag=0C2TJLZT79F7 type=write size=2649469 2024-09-12T17:18:14.451 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.450+0000 7f574d1ea780 1 < completed delete operation key=54LQ91UMBJAN tag=5XRB9MRY43Y6 type=del 2024-09-12T17:18:14.452 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.451+0000 7f574d1ea780 1 > prepared operation key=DH02JGZP64MN tag=5MLHXA69GEOG type=del size=1936461 2024-09-12T17:18:14.453 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.452+0000 7f574d1ea780 1 < completed part key=_multipart_SQQMJ61CA0QW.2~Q9RG5TZ8LCRF.0 size=1048576 2024-09-12T17:18:14.454 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.453+0000 7f574d1ea780 1 < completed part key=_multipart_SQQMJ61CA0QW.2~Q9RG5TZ8LCRF.1 size=610889 2024-09-12T17:18:14.456 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.456+0000 7f574d1ea780 1 < completed multipart upload key=SQQMJ61CA0QW upload=Q9RG5TZ8LCRF tag=1MXEZD1IHO9E type=write size=2708041 2024-09-12T17:18:14.459 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.458+0000 7f574d1ea780 1 > prepared part key=_multipart_Q2Q3B1J3DAVD.2~NEMV45RVJXQ1.0 size=1048576 2024-09-12T17:18:14.459 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.459+0000 7f574d1ea780 1 > prepared part key=_multipart_Q2Q3B1J3DAVD.2~NEMV45RVJXQ1.1 size=1048576 2024-09-12T17:18:14.460 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.460+0000 7f574d1ea780 1 > prepared part key=_multipart_Q2Q3B1J3DAVD.2~NEMV45RVJXQ1.2 size=5978 2024-09-12T17:18:14.461 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.460+0000 7f574d1ea780 1 > prepared multipart upload key=Q2Q3B1J3DAVD upload=NEMV45RVJXQ1 tag=5Z0PJ3C7QFB0 type=write size=3151706 2024-09-12T17:18:14.462 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.461+0000 7f574d1ea780 1 < completed delete operation key=K12MVG618809 tag=1AZJ4TLL4EBP type=del 2024-09-12T17:18:14.463 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.462+0000 7f574d1ea780 1 > prepared operation key=TIKBUXFPVTN1 tag=8CF1JI0TQJK3 type=write size=1032450 2024-09-12T17:18:14.463 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.462+0000 7f574d1ea780 1 < canceled part key=_multipart_UFKM4I8RMT0W.2~27P9A2AM9TE3.0 size=1048576 2024-09-12T17:18:14.464 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.463+0000 7f574d1ea780 1 < completed part key=_multipart_UFKM4I8RMT0W.2~27P9A2AM9TE3.1 size=1048576 2024-09-12T17:18:14.464 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.463+0000 7f574d1ea780 1 < canceled part key=_multipart_UFKM4I8RMT0W.2~27P9A2AM9TE3.2 size=764174 2024-09-12T17:18:14.466 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.465+0000 7f574d1ea780 1 < canceled multipart upload key=UFKM4I8RMT0W upload=27P9A2AM9TE3 tag=6FVN92DD1CEG type=write size=3909902 2024-09-12T17:18:14.468 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.467+0000 7f574d1ea780 1 > prepared operation key=HFWA7DNUMWF2 tag=WH0R11MS497O type=del size=1876546 2024-09-12T17:18:14.469 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.468+0000 7f574d1ea780 1 < completed delete operation key=55JI541K1WP2 tag=IDB34U2IKXTL type=del 2024-09-12T17:18:14.471 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.470+0000 7f574d1ea780 1 > prepared part key=_multipart_HGZMN894YYC0.2~E9YMZ1JD3CK9.0 size=297910 2024-09-12T17:18:14.471 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.470+0000 7f574d1ea780 1 > prepared multipart upload key=HGZMN894YYC0 upload=E9YMZ1JD3CK9 tag=YFZJ9QE093LZ type=write size=1346486 2024-09-12T17:18:14.473 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.472+0000 7f574d1ea780 1 < completed write operation key=C9IYR9CET1I8 tag=GD3S2C5IEM60 type=write size=508341 2024-09-12T17:18:14.474 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.474+0000 7f574d1ea780 1 > prepared operation key=ZGH8XC39FGTC tag=UIK4MGH9RFYG type=del size=3124740 2024-09-12T17:18:14.476 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.475+0000 7f574d1ea780 1 < completed delete operation key=UFKM4I8RMT0W tag=PUZIUD6EOCDL type=del 2024-09-12T17:18:14.478 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.477+0000 7f574d1ea780 1 > prepared part key=_multipart_GEGOEB05R0PK.2~TPJ44BR1FPR0.0 size=499405 2024-09-12T17:18:14.478 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.477+0000 7f574d1ea780 1 > prepared multipart upload key=GEGOEB05R0PK upload=TPJ44BR1FPR0 tag=ZTOFXSSFGRHG type=write size=1547981 2024-09-12T17:18:14.479 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.478+0000 7f574d1ea780 1 < completed part key=_multipart_QXD8UG2K4STQ.2~5OLE3OL89ZLG.0 size=821474 2024-09-12T17:18:14.481 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.480+0000 7f574d1ea780 1 < completed multipart upload key=QXD8UG2K4STQ upload=5OLE3OL89ZLG tag=RKZQ7OYPP1I8 type=write size=1870050 2024-09-12T17:18:14.482 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.481+0000 7f574d1ea780 1 > prepared operation key=HGZMN894YYC0 tag=QC7KNQTC9YUD type=del size=4021183 2024-09-12T17:18:14.484 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.483+0000 7f574d1ea780 1 < completed delete operation key=C9IYR9CET1I8 tag=5EKQX838DJ7J type=del 2024-09-12T17:18:14.485 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.484+0000 7f574d1ea780 1 > prepared operation key=54LQ91UMBJAN tag=8JMMXEOUFTXG type=del size=4025930 2024-09-12T17:18:14.486 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.485+0000 7f574d1ea780 1 < completed write operation key=8SG7DJO4HWPI tag=P688O0PON4K5 type=write size=404835 2024-09-12T17:18:14.488 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.487+0000 7f574d1ea780 1 > prepared operation key=U6E9A5OH4GUW tag=QXYOPWLLTKZR type=del size=302796 2024-09-12T17:18:14.489 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.488+0000 7f574d1ea780 1 < completed part key=_multipart_54CM8800AT9V.2~4MZ3SK37HL9N.0 size=513802 2024-09-12T17:18:14.491 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.490+0000 7f574d1ea780 1 < completed multipart upload key=54CM8800AT9V upload=4MZ3SK37HL9N tag=9XDYT9K60OBM type=write size=1562378 2024-09-12T17:18:14.493 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.492+0000 7f574d1ea780 1 > prepared operation key=ENFNIFHQ3SHW tag=3JAMA1Y47Q0I type=write size=275837 2024-09-12T17:18:14.494 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.493+0000 7f574d1ea780 1 < completed part key=_multipart_OI51GO639LFK.2~4CBCY21T1VKT.0 size=1048576 2024-09-12T17:18:14.495 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.494+0000 7f574d1ea780 1 < completed part key=_multipart_OI51GO639LFK.2~4CBCY21T1VKT.1 size=552417 2024-09-12T17:18:14.497 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.496+0000 7f574d1ea780 1 < completed multipart upload key=OI51GO639LFK upload=4CBCY21T1VKT tag=T1977DGOPJNM type=write size=2649569 2024-09-12T17:18:14.498 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.497+0000 7f574d1ea780 1 > prepared operation key=43GV2N9VBBKE tag=0BFBFFW5KCNV type=del size=1641417 2024-09-12T17:18:14.499 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.499+0000 7f574d1ea780 1 < completed part key=_multipart_7BX38Q7723EB.2~U6QT1W9MENYK.0 size=1048576 2024-09-12T17:18:14.501 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.500+0000 7f574d1ea780 1 < completed part key=_multipart_7BX38Q7723EB.2~U6QT1W9MENYK.1 size=1048576 2024-09-12T17:18:14.502 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.501+0000 7f574d1ea780 1 < completed part key=_multipart_7BX38Q7723EB.2~U6QT1W9MENYK.2 size=835642 2024-09-12T17:18:14.504 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.503+0000 7f574d1ea780 1 < completed multipart upload key=7BX38Q7723EB upload=U6QT1W9MENYK tag=G913ZAQ25V2D type=write size=3981370 2024-09-12T17:18:14.505 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.504+0000 7f574d1ea780 1 > prepared operation key=7BX38Q7723EB tag=WFV5H8KVP4L4 type=del size=796540 2024-09-12T17:18:14.506 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.505+0000 7f574d1ea780 1 < completed part key=_multipart_UTCKL1F42X8A.2~EV6F9P6YS2ZS.0 size=548149 2024-09-12T17:18:14.508 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.508+0000 7f574d1ea780 1 < completed multipart upload key=UTCKL1F42X8A upload=EV6F9P6YS2ZS tag=BLSGZ8R1V3SU type=write size=1596725 2024-09-12T17:18:14.510 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.509+0000 7f574d1ea780 1 > prepared operation key=TIKBUXFPVTN1 tag=MH6BPGRD4BPB type=del size=4046394 2024-09-12T17:18:14.511 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.510+0000 7f574d1ea780 1 < completed part key=_multipart_TIKBUXFPVTN1.2~W7GRT75JX4BO.0 size=211101 2024-09-12T17:18:14.513 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.512+0000 7f574d1ea780 1 < completed multipart upload key=TIKBUXFPVTN1 upload=W7GRT75JX4BO tag=NSJJPZ6NLWJF type=write size=1259677 2024-09-12T17:18:14.514 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.513+0000 7f574d1ea780 1 > prepared operation key=8VW3XCUHLF2L tag=8QATZBGU305G type=write size=499915 2024-09-12T17:18:14.516 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.515+0000 7f574d1ea780 1 < completed part key=_multipart_TIKBUXFPVTN1.2~R91Y14A9HGKZ.0 size=1048576 2024-09-12T17:18:14.517 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.516+0000 7f574d1ea780 1 < completed part key=_multipart_TIKBUXFPVTN1.2~R91Y14A9HGKZ.1 size=552317 2024-09-12T17:18:14.519 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.518+0000 7f574d1ea780 1 < completed multipart upload key=TIKBUXFPVTN1 upload=R91Y14A9HGKZ tag=0C2TJLZT79F7 type=write size=2649469 2024-09-12T17:18:14.520 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.519+0000 7f574d1ea780 1 > prepared operation key=DH02JGZP64MN tag=3ELXKBPEIU74 type=del size=61151 2024-09-12T17:18:14.521 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.520+0000 7f574d1ea780 1 < completed delete operation key=DH02JGZP64MN tag=5MLHXA69GEOG type=del 2024-09-12T17:18:14.522 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.522+0000 7f574d1ea780 1 > prepared operation key=D1GEG3MKPOM3 tag=PY30XIPYPFD7 type=del size=2587044 2024-09-12T17:18:14.524 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.523+0000 7f574d1ea780 1 < completed part key=_multipart_Q2Q3B1J3DAVD.2~NEMV45RVJXQ1.0 size=1048576 2024-09-12T17:18:14.525 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.524+0000 7f574d1ea780 1 < completed part key=_multipart_Q2Q3B1J3DAVD.2~NEMV45RVJXQ1.1 size=1048576 2024-09-12T17:18:14.526 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.525+0000 7f574d1ea780 1 < completed part key=_multipart_Q2Q3B1J3DAVD.2~NEMV45RVJXQ1.2 size=5978 2024-09-12T17:18:14.528 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.527+0000 7f574d1ea780 1 < completed multipart upload key=Q2Q3B1J3DAVD upload=NEMV45RVJXQ1 tag=5Z0PJ3C7QFB0 type=write size=3151706 2024-09-12T17:18:14.530 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.529+0000 7f574d1ea780 1 > prepared part key=_multipart_ZGH8XC39FGTC.2~NX2KBGULQHFT.0 size=152601 2024-09-12T17:18:14.530 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.529+0000 7f574d1ea780 1 > prepared multipart upload key=ZGH8XC39FGTC upload=NX2KBGULQHFT tag=F48FR6S7CHU0 type=write size=1201177 2024-09-12T17:18:14.532 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.531+0000 7f574d1ea780 1 < completed write operation key=TIKBUXFPVTN1 tag=8CF1JI0TQJK3 type=write size=1032450 2024-09-12T17:18:14.534 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.533+0000 7f574d1ea780 1 > prepared part key=_multipart_R00F69ON5P6Z.2~UP8375PWR2SE.0 size=979652 2024-09-12T17:18:14.534 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.533+0000 7f574d1ea780 1 > prepared multipart upload key=R00F69ON5P6Z upload=UP8375PWR2SE tag=TL9GGAAIGJQR type=write size=2028228 2024-09-12T17:18:14.536 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.535+0000 7f574d1ea780 1 < completed delete operation key=HFWA7DNUMWF2 tag=WH0R11MS497O type=del 2024-09-12T17:18:14.538 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.538+0000 7f574d1ea780 1 > prepared part key=_multipart_OI51GO639LFK.2~KETNUZ3G1GTN.0 size=1048576 2024-09-12T17:18:14.539 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.538+0000 7f574d1ea780 1 > prepared part key=_multipart_OI51GO639LFK.2~KETNUZ3G1GTN.1 size=1048576 2024-09-12T17:18:14.540 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.540+0000 7f574d1ea780 1 > prepared part key=_multipart_OI51GO639LFK.2~KETNUZ3G1GTN.2 size=893798 2024-09-12T17:18:14.540 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.540+0000 7f574d1ea780 1 > prepared multipart upload key=OI51GO639LFK upload=KETNUZ3G1GTN tag=T6XSYDWAJWMK type=write size=4039526 2024-09-12T17:18:14.542 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.541+0000 7f574d1ea780 1 < completed part key=_multipart_HGZMN894YYC0.2~E9YMZ1JD3CK9.0 size=297910 2024-09-12T17:18:14.544 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.543+0000 7f574d1ea780 1 < completed multipart upload key=HGZMN894YYC0 upload=E9YMZ1JD3CK9 tag=YFZJ9QE093LZ type=write size=1346486 2024-09-12T17:18:14.545 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.544+0000 7f574d1ea780 1 > prepared operation key=43GV2N9VBBKE tag=MI8YG3MV66UZ type=del size=629135 2024-09-12T17:18:14.546 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.545+0000 7f574d1ea780 1 < canceled operation key=ZGH8XC39FGTC tag=UIK4MGH9RFYG type=del size=3124740 2024-09-12T17:18:14.547 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.546+0000 7f574d1ea780 1 > prepared operation key=HFWA7DNUMWF2 tag=YSPEKXO8IM2C type=write size=322150 2024-09-12T17:18:14.548 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.548+0000 7f574d1ea780 1 < completed part key=_multipart_GEGOEB05R0PK.2~TPJ44BR1FPR0.0 size=499405 2024-09-12T17:18:14.550 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.549+0000 7f574d1ea780 1 < completed multipart upload key=GEGOEB05R0PK upload=TPJ44BR1FPR0 tag=ZTOFXSSFGRHG type=write size=1547981 2024-09-12T17:18:14.551 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.551+0000 7f574d1ea780 1 > prepared operation key=UFKM4I8RMT0W tag=NI069OMORPOA type=del size=845369 2024-09-12T17:18:14.552 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.552+0000 7f574d1ea780 1 < completed delete operation key=HGZMN894YYC0 tag=QC7KNQTC9YUD type=del 2024-09-12T17:18:14.554 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.554+0000 7f574d1ea780 1 > prepared part key=_multipart_8SG7DJO4HWPI.2~KU2C2SAJ00LY.0 size=471303 2024-09-12T17:18:14.555 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.554+0000 7f574d1ea780 1 > prepared multipart upload key=8SG7DJO4HWPI upload=KU2C2SAJ00LY tag=TND1I2EMR6AA type=write size=1519879 2024-09-12T17:18:14.556 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.555+0000 7f574d1ea780 1 < completed delete operation key=54LQ91UMBJAN tag=8JMMXEOUFTXG type=del 2024-09-12T17:18:14.558 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.557+0000 7f574d1ea780 1 > prepared part key=_multipart_Q2Q3B1J3DAVD.2~WFR3SJDUBB1N.0 size=1048576 2024-09-12T17:18:14.559 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.558+0000 7f574d1ea780 1 > prepared part key=_multipart_Q2Q3B1J3DAVD.2~WFR3SJDUBB1N.1 size=622136 2024-09-12T17:18:14.559 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.558+0000 7f574d1ea780 1 > prepared multipart upload key=Q2Q3B1J3DAVD upload=WFR3SJDUBB1N tag=90QJ523OIBC2 type=write size=2719288 2024-09-12T17:18:14.561 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.560+0000 7f574d1ea780 1 < suggested update operation key=U6E9A5OH4GUW tag=QXYOPWLLTKZR type=del size=302796 2024-09-12T17:18:14.563 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.562+0000 7f574d1ea780 1 > prepared part key=_multipart_K12MVG618809.2~2TVEWXIPS2BX.0 size=28824 2024-09-12T17:18:14.563 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.562+0000 7f574d1ea780 1 > prepared multipart upload key=K12MVG618809 upload=2TVEWXIPS2BX tag=UCSXH6NW2R7I type=write size=1077400 2024-09-12T17:18:14.564 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.563+0000 7f574d1ea780 1 < completed write operation key=ENFNIFHQ3SHW tag=3JAMA1Y47Q0I type=write size=275837 2024-09-12T17:18:14.565 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.565+0000 7f574d1ea780 1 > prepared operation key=8VW3XCUHLF2L tag=TP911S8C86ZQ type=del size=3504093 2024-09-12T17:18:14.566 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.566+0000 7f574d1ea780 1 < completed delete operation key=43GV2N9VBBKE tag=0BFBFFW5KCNV type=del 2024-09-12T17:18:14.569 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.568+0000 7f574d1ea780 1 > prepared part key=_multipart_TIKBUXFPVTN1.2~A43GQLOD3Y1F.0 size=1048576 2024-09-12T17:18:14.569 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.569+0000 7f574d1ea780 1 > prepared part key=_multipart_TIKBUXFPVTN1.2~A43GQLOD3Y1F.1 size=1048576 2024-09-12T17:18:14.570 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.570+0000 7f574d1ea780 1 > prepared part key=_multipart_TIKBUXFPVTN1.2~A43GQLOD3Y1F.2 size=156784 2024-09-12T17:18:14.571 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.570+0000 7f574d1ea780 1 > prepared multipart upload key=TIKBUXFPVTN1 upload=A43GQLOD3Y1F tag=VE6QTZGVQ4AJ type=write size=3302512 2024-09-12T17:18:14.572 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.571+0000 7f574d1ea780 1 < completed delete operation key=7BX38Q7723EB tag=WFV5H8KVP4L4 type=del 2024-09-12T17:18:14.573 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.572+0000 7f574d1ea780 1 > prepared operation key=43GV2N9VBBKE tag=CJ42NAQGL4L5 type=del size=1346212 2024-09-12T17:18:14.574 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.573+0000 7f574d1ea780 1 < completed delete operation key=TIKBUXFPVTN1 tag=MH6BPGRD4BPB type=del 2024-09-12T17:18:14.575 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.574+0000 7f574d1ea780 1 > prepared operation key=54LQ91UMBJAN tag=5FKPRAKX51RS type=del size=548426 2024-09-12T17:18:14.576 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.575+0000 7f574d1ea780 1 < completed write operation key=8VW3XCUHLF2L tag=8QATZBGU305G type=write size=499915 2024-09-12T17:18:14.578 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.577+0000 7f574d1ea780 1 > prepared part key=_multipart_UTCKL1F42X8A.2~SQQSRP463MDQ.0 size=1048576 2024-09-12T17:18:14.579 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.578+0000 7f574d1ea780 1 > prepared part key=_multipart_UTCKL1F42X8A.2~SQQSRP463MDQ.1 size=1048576 2024-09-12T17:18:14.580 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.579+0000 7f574d1ea780 1 > prepared part key=_multipart_UTCKL1F42X8A.2~SQQSRP463MDQ.2 size=794452 2024-09-12T17:18:14.580 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.579+0000 7f574d1ea780 1 > prepared multipart upload key=UTCKL1F42X8A upload=SQQSRP463MDQ tag=0AW2EQ9UWY9L type=write size=3940180 2024-09-12T17:18:14.581 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.580+0000 7f574d1ea780 1 < completed delete operation key=DH02JGZP64MN tag=3ELXKBPEIU74 type=del 2024-09-12T17:18:14.582 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.581+0000 7f574d1ea780 1 > prepared operation key=A1TIP3RXHBCZ tag=RXNL3NITF942 type=del size=3875676 2024-09-12T17:18:14.583 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.583+0000 7f574d1ea780 1 < completed delete operation key=D1GEG3MKPOM3 tag=PY30XIPYPFD7 type=del 2024-09-12T17:18:14.585 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.585+0000 7f574d1ea780 1 > prepared part key=_multipart_A1TIP3RXHBCZ.2~N3YXAEWSSGSY.0 size=930734 2024-09-12T17:18:14.585 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.585+0000 7f574d1ea780 1 > prepared multipart upload key=A1TIP3RXHBCZ upload=N3YXAEWSSGSY tag=JLH3AQNOBVQL type=write size=1979310 2024-09-12T17:18:14.587 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.586+0000 7f574d1ea780 1 < completed part key=_multipart_ZGH8XC39FGTC.2~NX2KBGULQHFT.0 size=152601 2024-09-12T17:18:14.589 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.588+0000 7f574d1ea780 1 < completed multipart upload key=ZGH8XC39FGTC upload=NX2KBGULQHFT tag=F48FR6S7CHU0 type=write size=1201177 2024-09-12T17:18:14.591 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.590+0000 7f574d1ea780 1 > prepared part key=_multipart_TIKBUXFPVTN1.2~OLHO9OFOQXA1.0 size=1048576 2024-09-12T17:18:14.592 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.591+0000 7f574d1ea780 1 > prepared part key=_multipart_TIKBUXFPVTN1.2~OLHO9OFOQXA1.1 size=1048576 2024-09-12T17:18:14.593 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.592+0000 7f574d1ea780 1 > prepared part key=_multipart_TIKBUXFPVTN1.2~OLHO9OFOQXA1.2 size=1040583 2024-09-12T17:18:14.593 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.592+0000 7f574d1ea780 1 > prepared multipart upload key=TIKBUXFPVTN1 upload=OLHO9OFOQXA1 tag=16A1KISMBT59 type=write size=4186311 2024-09-12T17:18:14.594 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.593+0000 7f574d1ea780 1 < completed part key=_multipart_R00F69ON5P6Z.2~UP8375PWR2SE.0 size=979652 2024-09-12T17:18:14.596 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.595+0000 7f574d1ea780 1 < completed multipart upload key=R00F69ON5P6Z upload=UP8375PWR2SE tag=TL9GGAAIGJQR type=write size=2028228 2024-09-12T17:18:14.599 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.598+0000 7f574d1ea780 1 > prepared part key=_multipart_D1GEG3MKPOM3.2~JP51LUDC1IOE.0 size=1048576 2024-09-12T17:18:14.600 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.599+0000 7f574d1ea780 1 > prepared part key=_multipart_D1GEG3MKPOM3.2~JP51LUDC1IOE.1 size=312904 2024-09-12T17:18:14.600 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.599+0000 7f574d1ea780 1 > prepared multipart upload key=D1GEG3MKPOM3 upload=JP51LUDC1IOE tag=PU9W8YIO5H4H type=write size=2410056 2024-09-12T17:18:14.601 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.600+0000 7f574d1ea780 1 < completed part key=_multipart_OI51GO639LFK.2~KETNUZ3G1GTN.0 size=1048576 2024-09-12T17:18:14.602 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.601+0000 7f574d1ea780 1 < completed part key=_multipart_OI51GO639LFK.2~KETNUZ3G1GTN.1 size=1048576 2024-09-12T17:18:14.603 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.602+0000 7f574d1ea780 1 < completed part key=_multipart_OI51GO639LFK.2~KETNUZ3G1GTN.2 size=893798 2024-09-12T17:18:14.605 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.604+0000 7f574d1ea780 1 < completed multipart upload key=OI51GO639LFK upload=KETNUZ3G1GTN tag=T6XSYDWAJWMK type=write size=4039526 2024-09-12T17:18:14.607 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.607+0000 7f574d1ea780 1 > prepared part key=_multipart_8VW3XCUHLF2L.2~WMQ7GGLKE2GO.0 size=1048576 2024-09-12T17:18:14.608 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.608+0000 7f574d1ea780 1 > prepared part key=_multipart_8VW3XCUHLF2L.2~WMQ7GGLKE2GO.1 size=819056 2024-09-12T17:18:14.609 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.608+0000 7f574d1ea780 1 > prepared multipart upload key=8VW3XCUHLF2L upload=WMQ7GGLKE2GO tag=QLIJ8UZY1O2Y type=write size=2916208 2024-09-12T17:18:14.610 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.609+0000 7f574d1ea780 1 < completed delete operation key=43GV2N9VBBKE tag=MI8YG3MV66UZ type=del 2024-09-12T17:18:14.612 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.611+0000 7f574d1ea780 1 > prepared part key=_multipart_RWVWJHVZE95H.2~8ZZU1QPHO0SU.0 size=1048576 2024-09-12T17:18:14.613 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.612+0000 7f574d1ea780 1 > prepared part key=_multipart_RWVWJHVZE95H.2~8ZZU1QPHO0SU.1 size=1048576 2024-09-12T17:18:14.614 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.613+0000 7f574d1ea780 1 > prepared part key=_multipart_RWVWJHVZE95H.2~8ZZU1QPHO0SU.2 size=25047 2024-09-12T17:18:14.614 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.613+0000 7f574d1ea780 1 > prepared multipart upload key=RWVWJHVZE95H upload=8ZZU1QPHO0SU tag=M3M7010CJ225 type=write size=3170775 2024-09-12T17:18:14.615 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.614+0000 7f574d1ea780 1 < completed write operation key=HFWA7DNUMWF2 tag=YSPEKXO8IM2C type=write size=322150 2024-09-12T17:18:14.616 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.615+0000 7f574d1ea780 1 > prepared operation key=C9IYR9CET1I8 tag=VQELJQJN37II type=del size=461141 2024-09-12T17:18:14.619 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.618+0000 7f574d1ea780 1 < suggested remove operation key=UFKM4I8RMT0W tag=NI069OMORPOA type=del 2024-09-12T17:18:14.620 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.619+0000 7f574d1ea780 1 > prepared operation key=55JI541K1WP2 tag=6LLMMUFD8E81 type=write size=85011 2024-09-12T17:18:14.621 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.620+0000 7f574d1ea780 1 < completed part key=_multipart_8SG7DJO4HWPI.2~KU2C2SAJ00LY.0 size=471303 2024-09-12T17:18:14.623 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.622+0000 7f574d1ea780 1 < completed multipart upload key=8SG7DJO4HWPI upload=KU2C2SAJ00LY tag=TND1I2EMR6AA type=write size=1519879 2024-09-12T17:18:14.624 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.624+0000 7f574d1ea780 1 > prepared operation key=QXD8UG2K4STQ tag=B5UT2ZP552D5 type=write size=102848 2024-09-12T17:18:14.626 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.625+0000 7f574d1ea780 1 < completed part key=_multipart_Q2Q3B1J3DAVD.2~WFR3SJDUBB1N.0 size=1048576 2024-09-12T17:18:14.627 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.626+0000 7f574d1ea780 1 < completed part key=_multipart_Q2Q3B1J3DAVD.2~WFR3SJDUBB1N.1 size=622136 2024-09-12T17:18:14.629 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.628+0000 7f574d1ea780 1 < completed multipart upload key=Q2Q3B1J3DAVD upload=WFR3SJDUBB1N tag=90QJ523OIBC2 type=write size=2719288 2024-09-12T17:18:14.632 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.629+0000 7f574d1ea780 1 > prepared operation key=K12MVG618809 tag=YRQM24IO0233 type=del size=2573814 2024-09-12T17:18:14.634 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.631+0000 7f574d1ea780 1 < completed part key=_multipart_K12MVG618809.2~2TVEWXIPS2BX.0 size=28824 2024-09-12T17:18:14.636 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.633+0000 7f574d1ea780 1 < completed multipart upload key=K12MVG618809 upload=2TVEWXIPS2BX tag=UCSXH6NW2R7I type=write size=1077400 2024-09-12T17:18:14.638 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.634+0000 7f574d1ea780 1 > prepared operation key=DH02JGZP64MN tag=1RKCPSR3FQWN type=del size=1295799 2024-09-12T17:18:14.638 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.636+0000 7f574d1ea780 1 < suggested remove operation key=8VW3XCUHLF2L tag=TP911S8C86ZQ type=del 2024-09-12T17:18:14.640 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.639+0000 7f574d1ea780 1 > prepared part key=_multipart_U6E9A5OH4GUW.2~0YAGRSJ2SZ2K.0 size=1048576 2024-09-12T17:18:14.641 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.640+0000 7f574d1ea780 1 > prepared part key=_multipart_U6E9A5OH4GUW.2~0YAGRSJ2SZ2K.1 size=1048576 2024-09-12T17:18:14.642 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.641+0000 7f574d1ea780 1 > prepared part key=_multipart_U6E9A5OH4GUW.2~0YAGRSJ2SZ2K.2 size=480748 2024-09-12T17:18:14.642 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.641+0000 7f574d1ea780 1 > prepared multipart upload key=U6E9A5OH4GUW upload=0YAGRSJ2SZ2K tag=WTLRWXCA5ZUT type=write size=3626476 2024-09-12T17:18:14.643 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.642+0000 7f574d1ea780 1 < completed part key=_multipart_TIKBUXFPVTN1.2~A43GQLOD3Y1F.0 size=1048576 2024-09-12T17:18:14.644 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.643+0000 7f574d1ea780 1 < completed part key=_multipart_TIKBUXFPVTN1.2~A43GQLOD3Y1F.1 size=1048576 2024-09-12T17:18:14.644 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.643+0000 7f574d1ea780 1 < canceled part key=_multipart_TIKBUXFPVTN1.2~A43GQLOD3Y1F.2 size=156784 2024-09-12T17:18:14.646 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.645+0000 7f574d1ea780 1 < canceled multipart upload key=TIKBUXFPVTN1 upload=A43GQLOD3Y1F tag=VE6QTZGVQ4AJ type=write size=3302512 2024-09-12T17:18:14.648 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.648+0000 7f574d1ea780 1 > prepared part key=_multipart_ENFNIFHQ3SHW.2~NGZKS48C3IRW.0 size=1048576 2024-09-12T17:18:14.649 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.649+0000 7f574d1ea780 1 > prepared part key=_multipart_ENFNIFHQ3SHW.2~NGZKS48C3IRW.1 size=611272 2024-09-12T17:18:14.649 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.649+0000 7f574d1ea780 1 > prepared multipart upload key=ENFNIFHQ3SHW upload=NGZKS48C3IRW tag=O33SAJNT6EU8 type=write size=2708424 2024-09-12T17:18:14.651 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.650+0000 7f574d1ea780 1 < completed delete operation key=43GV2N9VBBKE tag=CJ42NAQGL4L5 type=del 2024-09-12T17:18:14.652 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.651+0000 7f574d1ea780 1 > prepared operation key=VWWA5IB0L4N1 tag=5GOGNR9TFFU6 type=del size=2293157 2024-09-12T17:18:14.653 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.652+0000 7f574d1ea780 1 < completed delete operation key=54LQ91UMBJAN tag=5FKPRAKX51RS type=del 2024-09-12T17:18:14.656 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.655+0000 7f574d1ea780 1 > prepared part key=_multipart_VWWA5IB0L4N1.2~QVPJ4SLABVP6.0 size=1048576 2024-09-12T17:18:14.657 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.656+0000 7f574d1ea780 1 > prepared part key=_multipart_VWWA5IB0L4N1.2~QVPJ4SLABVP6.1 size=7237 2024-09-12T17:18:14.658 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.656+0000 7f574d1ea780 1 > prepared multipart upload key=VWWA5IB0L4N1 upload=QVPJ4SLABVP6 tag=7XX4DW77T1GZ type=write size=2104389 2024-09-12T17:18:14.658 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.656+0000 7f574d1ea780 1 < canceled part key=_multipart_UTCKL1F42X8A.2~SQQSRP463MDQ.0 size=1048576 2024-09-12T17:18:14.658 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.657+0000 7f574d1ea780 1 < completed part key=_multipart_UTCKL1F42X8A.2~SQQSRP463MDQ.1 size=1048576 2024-09-12T17:18:14.659 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.657+0000 7f574d1ea780 1 < canceled part key=_multipart_UTCKL1F42X8A.2~SQQSRP463MDQ.2 size=794452 2024-09-12T17:18:14.661 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.660+0000 7f574d1ea780 1 < canceled multipart upload key=UTCKL1F42X8A upload=SQQSRP463MDQ tag=0AW2EQ9UWY9L type=write size=3940180 2024-09-12T17:18:14.663 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.662+0000 7f574d1ea780 1 > prepared part key=_multipart_SQQMJ61CA0QW.2~01K0DMFN6EMH.0 size=1048576 2024-09-12T17:18:14.664 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.664+0000 7f574d1ea780 1 > prepared part key=_multipart_SQQMJ61CA0QW.2~01K0DMFN6EMH.1 size=815850 2024-09-12T17:18:14.665 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.664+0000 7f574d1ea780 1 > prepared multipart upload key=SQQMJ61CA0QW upload=01K0DMFN6EMH tag=OQHNIUJI69RK type=write size=2913002 2024-09-12T17:18:14.666 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.665+0000 7f574d1ea780 1 < completed delete operation key=A1TIP3RXHBCZ tag=RXNL3NITF942 type=del 2024-09-12T17:18:14.668 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.668+0000 7f574d1ea780 1 > prepared part key=_multipart_U6E9A5OH4GUW.2~LRHTR45SJRS0.0 size=135896 2024-09-12T17:18:14.669 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.668+0000 7f574d1ea780 1 > prepared multipart upload key=U6E9A5OH4GUW upload=LRHTR45SJRS0 tag=AYAY0JLP5NNZ type=write size=1184472 2024-09-12T17:18:14.669 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.668+0000 7f574d1ea780 1 < canceled part key=_multipart_A1TIP3RXHBCZ.2~N3YXAEWSSGSY.0 size=930734 2024-09-12T17:18:14.671 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.670+0000 7f574d1ea780 1 < canceled multipart upload key=A1TIP3RXHBCZ upload=N3YXAEWSSGSY tag=JLH3AQNOBVQL type=write size=1979310 2024-09-12T17:18:14.674 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.673+0000 7f574d1ea780 1 > prepared part key=_multipart_7BX38Q7723EB.2~0HS389AZ33UW.0 size=1048576 2024-09-12T17:18:14.675 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.674+0000 7f574d1ea780 1 > prepared part key=_multipart_7BX38Q7723EB.2~0HS389AZ33UW.1 size=1048576 2024-09-12T17:18:14.676 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.675+0000 7f574d1ea780 1 > prepared part key=_multipart_7BX38Q7723EB.2~0HS389AZ33UW.2 size=203076 2024-09-12T17:18:14.676 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.675+0000 7f574d1ea780 1 > prepared multipart upload key=7BX38Q7723EB upload=0HS389AZ33UW tag=25EFX4LY2MQ7 type=write size=3348804 2024-09-12T17:18:14.677 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.677+0000 7f574d1ea780 1 < completed part key=_multipart_TIKBUXFPVTN1.2~OLHO9OFOQXA1.0 size=1048576 2024-09-12T17:18:14.679 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.678+0000 7f574d1ea780 1 < completed part key=_multipart_TIKBUXFPVTN1.2~OLHO9OFOQXA1.1 size=1048576 2024-09-12T17:18:14.681 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.681+0000 7f574d1ea780 1 < completed part key=_multipart_TIKBUXFPVTN1.2~OLHO9OFOQXA1.2 size=1040583 2024-09-12T17:18:14.684 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.683+0000 7f574d1ea780 1 < completed multipart upload key=TIKBUXFPVTN1 upload=OLHO9OFOQXA1 tag=16A1KISMBT59 type=write size=4186311 2024-09-12T17:18:14.685 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.684+0000 7f574d1ea780 1 > prepared operation key=43GV2N9VBBKE tag=QY1T2FDYNWFR type=del size=3896657 2024-09-12T17:18:14.686 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.686+0000 7f574d1ea780 1 < completed part key=_multipart_D1GEG3MKPOM3.2~JP51LUDC1IOE.0 size=1048576 2024-09-12T17:18:14.688 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.687+0000 7f574d1ea780 1 < completed part key=_multipart_D1GEG3MKPOM3.2~JP51LUDC1IOE.1 size=312904 2024-09-12T17:18:14.690 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.689+0000 7f574d1ea780 1 < completed multipart upload key=D1GEG3MKPOM3 upload=JP51LUDC1IOE tag=PU9W8YIO5H4H type=write size=2410056 2024-09-12T17:18:14.692 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.692+0000 7f574d1ea780 1 > prepared part key=_multipart_ZGH8XC39FGTC.2~R5E764FX5VXF.0 size=1048576 2024-09-12T17:18:14.694 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.693+0000 7f574d1ea780 1 > prepared part key=_multipart_ZGH8XC39FGTC.2~R5E764FX5VXF.1 size=1048576 2024-09-12T17:18:14.695 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.694+0000 7f574d1ea780 1 > prepared part key=_multipart_ZGH8XC39FGTC.2~R5E764FX5VXF.2 size=65169 2024-09-12T17:18:14.695 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.694+0000 7f574d1ea780 1 > prepared multipart upload key=ZGH8XC39FGTC upload=R5E764FX5VXF tag=VK8ZG0PKBVQP type=write size=3210897 2024-09-12T17:18:14.696 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.695+0000 7f574d1ea780 1 < completed part key=_multipart_8VW3XCUHLF2L.2~WMQ7GGLKE2GO.0 size=1048576 2024-09-12T17:18:14.697 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.696+0000 7f574d1ea780 1 < completed part key=_multipart_8VW3XCUHLF2L.2~WMQ7GGLKE2GO.1 size=819056 2024-09-12T17:18:14.699 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.698+0000 7f574d1ea780 1 < completed multipart upload key=8VW3XCUHLF2L upload=WMQ7GGLKE2GO tag=QLIJ8UZY1O2Y type=write size=2916208 2024-09-12T17:18:14.701 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.700+0000 7f574d1ea780 1 > prepared operation key=R00F69ON5P6Z tag=5OWGFRLQ4V5O type=del size=727925 2024-09-12T17:18:14.702 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.701+0000 7f574d1ea780 1 < completed part key=_multipart_RWVWJHVZE95H.2~8ZZU1QPHO0SU.0 size=1048576 2024-09-12T17:18:14.703 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.702+0000 7f574d1ea780 1 < completed part key=_multipart_RWVWJHVZE95H.2~8ZZU1QPHO0SU.1 size=1048576 2024-09-12T17:18:14.704 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.704+0000 7f574d1ea780 1 < completed part key=_multipart_RWVWJHVZE95H.2~8ZZU1QPHO0SU.2 size=25047 2024-09-12T17:18:14.708 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.707+0000 7f574d1ea780 1 < completed multipart upload key=RWVWJHVZE95H upload=8ZZU1QPHO0SU tag=M3M7010CJ225 type=write size=3170775 2024-09-12T17:18:14.709 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.708+0000 7f574d1ea780 1 > prepared operation key=ZGE1860DMGHA tag=N3FNIXGVATYC type=write size=511462 2024-09-12T17:18:14.711 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.709+0000 7f574d1ea780 1 < completed delete operation key=C9IYR9CET1I8 tag=VQELJQJN37II type=del 2024-09-12T17:18:14.713 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.712+0000 7f574d1ea780 1 > prepared part key=_multipart_U6E9A5OH4GUW.2~AQGJR56770X4.0 size=192380 2024-09-12T17:18:14.713 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.712+0000 7f574d1ea780 1 > prepared multipart upload key=U6E9A5OH4GUW upload=AQGJR56770X4 tag=D9QK1TN38YZ5 type=write size=1240956 2024-09-12T17:18:14.714 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.713+0000 7f574d1ea780 1 < completed write operation key=55JI541K1WP2 tag=6LLMMUFD8E81 type=write size=85011 2024-09-12T17:18:14.715 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.714+0000 7f574d1ea780 1 > prepared operation key=SQQMJ61CA0QW tag=K0KPZ8PS1EC8 type=del size=3728609 2024-09-12T17:18:14.716 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.716+0000 7f574d1ea780 1 < completed write operation key=QXD8UG2K4STQ tag=B5UT2ZP552D5 type=write size=102848 2024-09-12T17:18:14.719 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.718+0000 7f574d1ea780 1 > prepared part key=_multipart_HGZMN894YYC0.2~L6PXTYONPW75.0 size=1048576 2024-09-12T17:18:14.720 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.719+0000 7f574d1ea780 1 > prepared part key=_multipart_HGZMN894YYC0.2~L6PXTYONPW75.1 size=585285 2024-09-12T17:18:14.720 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.719+0000 7f574d1ea780 1 > prepared multipart upload key=HGZMN894YYC0 upload=L6PXTYONPW75 tag=QAYRNFERBF0U type=write size=2682437 2024-09-12T17:18:14.721 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.720+0000 7f574d1ea780 1 < completed delete operation key=K12MVG618809 tag=YRQM24IO0233 type=del 2024-09-12T17:18:14.722 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.722+0000 7f574d1ea780 1 > prepared operation key=TIKBUXFPVTN1 tag=BFXNQIRORY7L type=write size=559175 2024-09-12T17:18:14.725 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.724+0000 7f574d1ea780 1 < suggested remove operation key=DH02JGZP64MN tag=1RKCPSR3FQWN type=del 2024-09-12T17:18:14.727 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.726+0000 7f574d1ea780 1 > prepared operation key=HFWA7DNUMWF2 tag=EHX71YX02R9C type=del size=2103712 2024-09-12T17:18:14.728 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.727+0000 7f574d1ea780 1 < completed part key=_multipart_U6E9A5OH4GUW.2~0YAGRSJ2SZ2K.0 size=1048576 2024-09-12T17:18:14.729 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.728+0000 7f574d1ea780 1 < completed part key=_multipart_U6E9A5OH4GUW.2~0YAGRSJ2SZ2K.1 size=1048576 2024-09-12T17:18:14.730 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.729+0000 7f574d1ea780 1 < completed part key=_multipart_U6E9A5OH4GUW.2~0YAGRSJ2SZ2K.2 size=480748 2024-09-12T17:18:14.732 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.731+0000 7f574d1ea780 1 < completed multipart upload key=U6E9A5OH4GUW upload=0YAGRSJ2SZ2K tag=WTLRWXCA5ZUT type=write size=3626476 2024-09-12T17:18:14.734 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.733+0000 7f574d1ea780 1 > prepared operation key=RNI86YYLADT0 tag=FTL6VYXC7N28 type=del size=3423736 2024-09-12T17:18:14.735 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.734+0000 7f574d1ea780 1 < completed part key=_multipart_ENFNIFHQ3SHW.2~NGZKS48C3IRW.0 size=1048576 2024-09-12T17:18:14.736 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.735+0000 7f574d1ea780 1 < completed part key=_multipart_ENFNIFHQ3SHW.2~NGZKS48C3IRW.1 size=611272 2024-09-12T17:18:14.738 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.737+0000 7f574d1ea780 1 < completed multipart upload key=ENFNIFHQ3SHW upload=NGZKS48C3IRW tag=O33SAJNT6EU8 type=write size=2708424 2024-09-12T17:18:14.740 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.739+0000 7f574d1ea780 1 > prepared operation key=RNI86YYLADT0 tag=Y9F7IVQWR5X6 type=del size=1287102 2024-09-12T17:18:14.741 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.740+0000 7f574d1ea780 1 < completed delete operation key=VWWA5IB0L4N1 tag=5GOGNR9TFFU6 type=del 2024-09-12T17:18:14.742 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.741+0000 7f574d1ea780 1 > prepared operation key=UTCKL1F42X8A tag=MB7KTGU700FC type=del size=253060 2024-09-12T17:18:14.742 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.742+0000 7f574d1ea780 1 < canceled part key=_multipart_VWWA5IB0L4N1.2~QVPJ4SLABVP6.0 size=1048576 2024-09-12T17:18:14.743 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.742+0000 7f574d1ea780 1 < canceled part key=_multipart_VWWA5IB0L4N1.2~QVPJ4SLABVP6.1 size=7237 2024-09-12T17:18:14.745 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.744+0000 7f574d1ea780 1 < canceled multipart upload key=VWWA5IB0L4N1 upload=QVPJ4SLABVP6 tag=7XX4DW77T1GZ type=write size=2104389 2024-09-12T17:18:14.746 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.745+0000 7f574d1ea780 1 > prepared operation key=UFKM4I8RMT0W tag=2DIAK1IWGA51 type=del size=2156054 2024-09-12T17:18:14.747 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.746+0000 7f574d1ea780 1 < completed part key=_multipart_SQQMJ61CA0QW.2~01K0DMFN6EMH.0 size=1048576 2024-09-12T17:18:14.748 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.747+0000 7f574d1ea780 1 < completed part key=_multipart_SQQMJ61CA0QW.2~01K0DMFN6EMH.1 size=815850 2024-09-12T17:18:14.750 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.749+0000 7f574d1ea780 1 < completed multipart upload key=SQQMJ61CA0QW upload=01K0DMFN6EMH tag=OQHNIUJI69RK type=write size=2913002 2024-09-12T17:18:14.752 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.751+0000 7f574d1ea780 1 > prepared operation key=DH02JGZP64MN tag=C279RA6H54AV type=write size=83741 2024-09-12T17:18:14.753 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.752+0000 7f574d1ea780 1 < completed part key=_multipart_U6E9A5OH4GUW.2~LRHTR45SJRS0.0 size=135896 2024-09-12T17:18:14.755 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.754+0000 7f574d1ea780 1 < completed multipart upload key=U6E9A5OH4GUW upload=LRHTR45SJRS0 tag=AYAY0JLP5NNZ type=write size=1184472 2024-09-12T17:18:14.757 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.756+0000 7f574d1ea780 1 > prepared part key=_multipart_55V137SY4E4P.2~3Z3YGBCET8W8.0 size=1048576 2024-09-12T17:18:14.758 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.757+0000 7f574d1ea780 1 > prepared part key=_multipart_55V137SY4E4P.2~3Z3YGBCET8W8.1 size=1048576 2024-09-12T17:18:14.759 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.758+0000 7f574d1ea780 1 > prepared part key=_multipart_55V137SY4E4P.2~3Z3YGBCET8W8.2 size=926818 2024-09-12T17:18:14.759 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.758+0000 7f574d1ea780 1 > prepared multipart upload key=55V137SY4E4P upload=3Z3YGBCET8W8 tag=IJ5FJ6IDVZTS type=write size=4072546 2024-09-12T17:18:14.760 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.760+0000 7f574d1ea780 1 < completed part key=_multipart_7BX38Q7723EB.2~0HS389AZ33UW.0 size=1048576 2024-09-12T17:18:14.761 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.761+0000 7f574d1ea780 1 < completed part key=_multipart_7BX38Q7723EB.2~0HS389AZ33UW.1 size=1048576 2024-09-12T17:18:14.762 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.762+0000 7f574d1ea780 1 < completed part key=_multipart_7BX38Q7723EB.2~0HS389AZ33UW.2 size=203076 2024-09-12T17:18:14.765 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.764+0000 7f574d1ea780 1 < completed multipart upload key=7BX38Q7723EB upload=0HS389AZ33UW tag=25EFX4LY2MQ7 type=write size=3348804 2024-09-12T17:18:14.766 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.765+0000 7f574d1ea780 1 > prepared operation key=GEGOEB05R0PK tag=0109QALMFRCG type=del size=136045 2024-09-12T17:18:14.769 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.766+0000 7f574d1ea780 1 < canceled operation key=43GV2N9VBBKE tag=QY1T2FDYNWFR type=del size=3896657 2024-09-12T17:18:14.769 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.767+0000 7f574d1ea780 1 > prepared operation key=ZGE1860DMGHA tag=I10SV14F3CSG type=del size=290832 2024-09-12T17:18:14.770 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.769+0000 7f574d1ea780 1 < completed part key=_multipart_ZGH8XC39FGTC.2~R5E764FX5VXF.0 size=1048576 2024-09-12T17:18:14.771 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.770+0000 7f574d1ea780 1 < completed part key=_multipart_ZGH8XC39FGTC.2~R5E764FX5VXF.1 size=1048576 2024-09-12T17:18:14.772 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.771+0000 7f574d1ea780 1 < completed part key=_multipart_ZGH8XC39FGTC.2~R5E764FX5VXF.2 size=65169 2024-09-12T17:18:14.774 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.773+0000 7f574d1ea780 1 < completed multipart upload key=ZGH8XC39FGTC upload=R5E764FX5VXF tag=VK8ZG0PKBVQP type=write size=3210897 2024-09-12T17:18:14.775 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.774+0000 7f574d1ea780 1 > prepared operation key=OI51GO639LFK tag=HY64DY5T4YNK type=del size=1271415 2024-09-12T17:18:14.776 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.776+0000 7f574d1ea780 1 < completed delete operation key=R00F69ON5P6Z tag=5OWGFRLQ4V5O type=del 2024-09-12T17:18:14.778 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.777+0000 7f574d1ea780 1 > prepared operation key=7BX38Q7723EB tag=BU5KP27ERJTG type=del size=633469 2024-09-12T17:18:14.779 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.778+0000 7f574d1ea780 1 < completed write operation key=ZGE1860DMGHA tag=N3FNIXGVATYC type=write size=511462 2024-09-12T17:18:14.780 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.779+0000 7f574d1ea780 1 > prepared operation key=UFKM4I8RMT0W tag=N2N54VWCWCSU type=del size=1414371 2024-09-12T17:18:14.781 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.781+0000 7f574d1ea780 1 < completed part key=_multipart_U6E9A5OH4GUW.2~AQGJR56770X4.0 size=192380 2024-09-12T17:18:14.783 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.783+0000 7f574d1ea780 1 < completed multipart upload key=U6E9A5OH4GUW upload=AQGJR56770X4 tag=D9QK1TN38YZ5 type=write size=1240956 2024-09-12T17:18:14.786 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.785+0000 7f574d1ea780 1 > prepared part key=_multipart_GEGOEB05R0PK.2~6EINDXKNHZEC.0 size=232435 2024-09-12T17:18:14.786 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.785+0000 7f574d1ea780 1 > prepared multipart upload key=GEGOEB05R0PK upload=6EINDXKNHZEC tag=UEBZI62DZ5ZM type=write size=1281011 2024-09-12T17:18:14.788 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.787+0000 7f574d1ea780 1 < suggested update operation key=SQQMJ61CA0QW tag=K0KPZ8PS1EC8 type=del size=3728609 2024-09-12T17:18:14.791 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.790+0000 7f574d1ea780 1 > prepared part key=_multipart_43GV2N9VBBKE.2~3G8MY81VCS92.0 size=1048576 2024-09-12T17:18:14.791 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.791+0000 7f574d1ea780 1 > prepared part key=_multipart_43GV2N9VBBKE.2~3G8MY81VCS92.1 size=614814 2024-09-12T17:18:14.792 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.791+0000 7f574d1ea780 1 > prepared multipart upload key=43GV2N9VBBKE upload=3G8MY81VCS92 tag=005CPYLVSY9B type=write size=2711966 2024-09-12T17:18:14.793 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.792+0000 7f574d1ea780 1 < completed part key=_multipart_HGZMN894YYC0.2~L6PXTYONPW75.0 size=1048576 2024-09-12T17:18:14.794 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.793+0000 7f574d1ea780 1 < completed part key=_multipart_HGZMN894YYC0.2~L6PXTYONPW75.1 size=585285 2024-09-12T17:18:14.796 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.795+0000 7f574d1ea780 1 < completed multipart upload key=HGZMN894YYC0 upload=L6PXTYONPW75 tag=QAYRNFERBF0U type=write size=2682437 2024-09-12T17:18:14.797 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.796+0000 7f574d1ea780 1 > prepared operation key=55JI541K1WP2 tag=Q23PQQAF30AY type=del size=2550290 2024-09-12T17:18:14.799 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.798+0000 7f574d1ea780 1 < completed write operation key=TIKBUXFPVTN1 tag=BFXNQIRORY7L type=write size=559175 2024-09-12T17:18:14.800 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.799+0000 7f574d1ea780 1 > prepared operation key=8VW3XCUHLF2L tag=S12D5RC7264D type=del size=2801360 2024-09-12T17:18:14.801 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.800+0000 7f574d1ea780 1 < completed delete operation key=HFWA7DNUMWF2 tag=EHX71YX02R9C type=del 2024-09-12T17:18:14.802 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.802+0000 7f574d1ea780 1 > prepared operation key=RWVWJHVZE95H tag=5Z9KD27PEZF3 type=del size=768458 2024-09-12T17:18:14.805 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.804+0000 7f574d1ea780 1 < suggested remove operation key=RNI86YYLADT0 tag=FTL6VYXC7N28 type=del 2024-09-12T17:18:14.806 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.805+0000 7f574d1ea780 1 > prepared operation key=GEGOEB05R0PK tag=K3RZ16TL0WDG type=del size=3341163 2024-09-12T17:18:14.806 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.806+0000 7f574d1ea780 -1 < no bi entry to suggest for operation key=RNI86YYLADT0 tag=Y9F7IVQWR5X6 type=del size=1287102: (2) No such file or directory 2024-09-12T17:18:14.809 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.808+0000 7f574d1ea780 1 > prepared part key=_multipart_VWWA5IB0L4N1.2~42BQKB334L0S.0 size=970513 2024-09-12T17:18:14.809 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.808+0000 7f574d1ea780 1 > prepared multipart upload key=VWWA5IB0L4N1 upload=42BQKB334L0S tag=JML9XMONLY1Y type=write size=2019089 2024-09-12T17:18:14.810 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.809+0000 7f574d1ea780 1 < completed delete operation key=UTCKL1F42X8A tag=MB7KTGU700FC type=del 2024-09-12T17:18:14.811 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.811+0000 7f574d1ea780 1 > prepared operation key=YXIDO0U18839 tag=MKICG61GG041 type=write size=861277 2024-09-12T17:18:14.813 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.812+0000 7f574d1ea780 1 < completed delete operation key=UFKM4I8RMT0W tag=2DIAK1IWGA51 type=del 2024-09-12T17:18:14.814 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.813+0000 7f574d1ea780 1 > prepared operation key=ZGH8XC39FGTC tag=97OLHHCBF4V5 type=del size=3341007 2024-09-12T17:18:14.815 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.814+0000 7f574d1ea780 1 < completed write operation key=DH02JGZP64MN tag=C279RA6H54AV type=write size=83741 2024-09-12T17:18:14.816 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.816+0000 7f574d1ea780 1 > prepared operation key=Q2Q3B1J3DAVD tag=DK2HSCCXMIEO type=write size=338754 2024-09-12T17:18:14.818 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.817+0000 7f574d1ea780 1 < completed part key=_multipart_55V137SY4E4P.2~3Z3YGBCET8W8.0 size=1048576 2024-09-12T17:18:14.819 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.818+0000 7f574d1ea780 1 < completed part key=_multipart_55V137SY4E4P.2~3Z3YGBCET8W8.1 size=1048576 2024-09-12T17:18:14.820 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.819+0000 7f574d1ea780 1 < completed part key=_multipart_55V137SY4E4P.2~3Z3YGBCET8W8.2 size=926818 2024-09-12T17:18:14.822 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.821+0000 7f574d1ea780 1 < completed multipart upload key=55V137SY4E4P upload=3Z3YGBCET8W8 tag=IJ5FJ6IDVZTS type=write size=4072546 2024-09-12T17:18:14.823 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.822+0000 7f574d1ea780 1 > prepared operation key=7BX38Q7723EB tag=44XEWCU30R5Q type=del size=972209 2024-09-12T17:18:14.827 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.827+0000 7f574d1ea780 1 < suggested update operation key=GEGOEB05R0PK tag=0109QALMFRCG type=del size=136045 2024-09-12T17:18:14.830 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.829+0000 7f574d1ea780 1 > prepared part key=_multipart_ENFNIFHQ3SHW.2~XCN9NZRL5ZR0.0 size=1048576 2024-09-12T17:18:14.833 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.832+0000 7f574d1ea780 1 > prepared part key=_multipart_ENFNIFHQ3SHW.2~XCN9NZRL5ZR0.1 size=366555 2024-09-12T17:18:14.833 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.832+0000 7f574d1ea780 1 > prepared multipart upload key=ENFNIFHQ3SHW upload=XCN9NZRL5ZR0 tag=QMOD0HX2EWA5 type=write size=2463707 2024-09-12T17:18:14.834 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.833+0000 7f574d1ea780 1 < canceled operation key=ZGE1860DMGHA tag=I10SV14F3CSG type=del size=290832 2024-09-12T17:18:14.835 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.834+0000 7f574d1ea780 1 > prepared operation key=RWVWJHVZE95H tag=UBJZN1ZUKW42 type=del size=1442935 2024-09-12T17:18:14.836 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.836+0000 7f574d1ea780 1 < completed delete operation key=OI51GO639LFK tag=HY64DY5T4YNK type=del 2024-09-12T17:18:14.839 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.838+0000 7f574d1ea780 1 > prepared part key=_multipart_ENFNIFHQ3SHW.2~LPBA25ICRJ61.0 size=1048576 2024-09-12T17:18:14.840 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.839+0000 7f574d1ea780 1 > prepared part key=_multipart_ENFNIFHQ3SHW.2~LPBA25ICRJ61.1 size=1048576 2024-09-12T17:18:14.841 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.840+0000 7f574d1ea780 1 > prepared part key=_multipart_ENFNIFHQ3SHW.2~LPBA25ICRJ61.2 size=14669 2024-09-12T17:18:14.841 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.840+0000 7f574d1ea780 1 > prepared multipart upload key=ENFNIFHQ3SHW upload=LPBA25ICRJ61 tag=TYXBNKNS948T type=write size=3160397 2024-09-12T17:18:14.843 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.842+0000 7f574d1ea780 1 < suggested remove operation key=7BX38Q7723EB tag=BU5KP27ERJTG type=del 2024-09-12T17:18:14.844 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.843+0000 7f574d1ea780 1 > prepared operation key=A1TIP3RXHBCZ tag=86ESSF373I60 type=del size=3096333 2024-09-12T17:18:14.846 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.845+0000 7f574d1ea780 1 < canceled operation key=UFKM4I8RMT0W tag=N2N54VWCWCSU type=del size=1414371 2024-09-12T17:18:14.847 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.846+0000 7f574d1ea780 1 > prepared operation key=RWVWJHVZE95H tag=V84QDPW7R11B type=del size=1548504 2024-09-12T17:18:14.848 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.847+0000 7f574d1ea780 1 < completed part key=_multipart_GEGOEB05R0PK.2~6EINDXKNHZEC.0 size=232435 2024-09-12T17:18:14.850 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.849+0000 7f574d1ea780 1 < completed multipart upload key=GEGOEB05R0PK upload=6EINDXKNHZEC tag=UEBZI62DZ5ZM type=write size=1281011 2024-09-12T17:18:14.852 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.851+0000 7f574d1ea780 1 > prepared part key=_multipart_55V137SY4E4P.2~3TBLO83D8185.0 size=722195 2024-09-12T17:18:14.852 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.851+0000 7f574d1ea780 1 > prepared multipart upload key=55V137SY4E4P upload=3TBLO83D8185 tag=HVW748TNIXSD type=write size=1770771 2024-09-12T17:18:14.853 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.853+0000 7f574d1ea780 1 < completed part key=_multipart_43GV2N9VBBKE.2~3G8MY81VCS92.0 size=1048576 2024-09-12T17:18:14.854 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.853+0000 7f574d1ea780 1 < canceled part key=_multipart_43GV2N9VBBKE.2~3G8MY81VCS92.1 size=614814 2024-09-12T17:18:14.855 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.854+0000 7f574d1ea780 1 < canceled multipart upload key=43GV2N9VBBKE upload=3G8MY81VCS92 tag=005CPYLVSY9B type=write size=2711966 2024-09-12T17:18:14.857 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.856+0000 7f574d1ea780 1 > prepared operation key=A1TIP3RXHBCZ tag=M3YLAXWK2XBN type=del size=3280721 2024-09-12T17:18:14.858 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.857+0000 7f574d1ea780 1 < completed delete operation key=55JI541K1WP2 tag=Q23PQQAF30AY type=del 2024-09-12T17:18:14.859 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.858+0000 7f574d1ea780 1 > prepared operation key=ZGE1860DMGHA tag=QSDU262LLWW8 type=del size=2761002 2024-09-12T17:18:14.860 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.859+0000 7f574d1ea780 1 < canceled operation key=8VW3XCUHLF2L tag=S12D5RC7264D type=del size=2801360 2024-09-12T17:18:14.861 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.861+0000 7f574d1ea780 1 > prepared operation key=ENFNIFHQ3SHW tag=U2C0JG3PKJVU type=del size=3516653 2024-09-12T17:18:14.863 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.862+0000 7f574d1ea780 1 < canceled operation key=RWVWJHVZE95H tag=5Z9KD27PEZF3 type=del size=768458 2024-09-12T17:18:14.864 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.863+0000 7f574d1ea780 1 > prepared operation key=ENFNIFHQ3SHW tag=N5YY3HY8Z9WJ type=del size=3708361 2024-09-12T17:18:14.865 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.864+0000 7f574d1ea780 -1 < failed to complete operation key=GEGOEB05R0PK tag=K3RZ16TL0WDG type=del size=3341163: (22) Invalid argument 2024-09-12T17:18:14.866 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.866+0000 7f574d1ea780 1 > prepared operation key=YXIDO0U18839 tag=2BI72CBFALU9 type=del size=1114082 2024-09-12T17:18:14.868 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.867+0000 7f574d1ea780 1 < completed part key=_multipart_VWWA5IB0L4N1.2~42BQKB334L0S.0 size=970513 2024-09-12T17:18:14.870 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.869+0000 7f574d1ea780 1 < completed multipart upload key=VWWA5IB0L4N1 upload=42BQKB334L0S tag=JML9XMONLY1Y type=write size=2019089 2024-09-12T17:18:14.871 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.870+0000 7f574d1ea780 1 > prepared operation key=A1TIP3RXHBCZ tag=3MZHQYT3AG3K type=del size=2175907 2024-09-12T17:18:14.872 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.872+0000 7f574d1ea780 1 < canceled operation key=YXIDO0U18839 tag=MKICG61GG041 type=write size=861277 2024-09-12T17:18:14.874 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.873+0000 7f574d1ea780 1 > prepared operation key=55JI541K1WP2 tag=YCJT4W7TE12S type=del size=3621550 2024-09-12T17:18:14.875 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.874+0000 7f574d1ea780 1 < completed delete operation key=ZGH8XC39FGTC tag=97OLHHCBF4V5 type=del 2024-09-12T17:18:14.877 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.876+0000 7f574d1ea780 1 > prepared part key=_multipart_55V137SY4E4P.2~WMB2K1AXBYS9.0 size=1048576 2024-09-12T17:18:14.878 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.877+0000 7f574d1ea780 1 > prepared part key=_multipart_55V137SY4E4P.2~WMB2K1AXBYS9.1 size=928780 2024-09-12T17:18:14.878 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.877+0000 7f574d1ea780 1 > prepared multipart upload key=55V137SY4E4P upload=WMB2K1AXBYS9 tag=5L34OCJ8DULP type=write size=3025932 2024-09-12T17:18:14.879 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.879+0000 7f574d1ea780 1 < completed write operation key=Q2Q3B1J3DAVD tag=DK2HSCCXMIEO type=write size=338754 2024-09-12T17:18:14.882 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.881+0000 7f574d1ea780 1 > prepared part key=_multipart_RNI86YYLADT0.2~R00BSNX4PGJW.0 size=1048576 2024-09-12T17:18:14.883 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.882+0000 7f574d1ea780 1 > prepared part key=_multipart_RNI86YYLADT0.2~R00BSNX4PGJW.1 size=1048576 2024-09-12T17:18:14.884 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.883+0000 7f574d1ea780 1 > prepared part key=_multipart_RNI86YYLADT0.2~R00BSNX4PGJW.2 size=175486 2024-09-12T17:18:14.884 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.883+0000 7f574d1ea780 1 > prepared multipart upload key=RNI86YYLADT0 upload=R00BSNX4PGJW tag=6P48SC896A7T type=write size=3321214 2024-09-12T17:18:14.885 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.884+0000 7f574d1ea780 -1 < failed to complete operation key=7BX38Q7723EB tag=44XEWCU30R5Q type=del size=972209: (22) Invalid argument 2024-09-12T17:18:14.886 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.886+0000 7f574d1ea780 1 > prepared operation key=A1TIP3RXHBCZ tag=RO0CJOF6KX36 type=del size=3692996 2024-09-12T17:18:14.888 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.887+0000 7f574d1ea780 1 < completed part key=_multipart_ENFNIFHQ3SHW.2~XCN9NZRL5ZR0.0 size=1048576 2024-09-12T17:18:14.888 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.888+0000 7f574d1ea780 1 < completed part key=_multipart_ENFNIFHQ3SHW.2~XCN9NZRL5ZR0.1 size=366555 2024-09-12T17:18:14.891 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.890+0000 7f574d1ea780 1 < completed multipart upload key=ENFNIFHQ3SHW upload=XCN9NZRL5ZR0 tag=QMOD0HX2EWA5 type=write size=2463707 2024-09-12T17:18:14.893 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.892+0000 7f574d1ea780 1 > prepared operation key=VWWA5IB0L4N1 tag=BVM30OPJXGE2 type=del size=2666858 2024-09-12T17:18:14.894 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.893+0000 7f574d1ea780 1 < completed delete operation key=RWVWJHVZE95H tag=UBJZN1ZUKW42 type=del 2024-09-12T17:18:14.895 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.895+0000 7f574d1ea780 1 > prepared operation key=R00F69ON5P6Z tag=IXRN3Y3ZAZH2 type=write size=714329 2024-09-12T17:18:14.897 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.896+0000 7f574d1ea780 1 < completed part key=_multipart_ENFNIFHQ3SHW.2~LPBA25ICRJ61.0 size=1048576 2024-09-12T17:18:14.897 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.896+0000 7f574d1ea780 1 < canceled part key=_multipart_ENFNIFHQ3SHW.2~LPBA25ICRJ61.1 size=1048576 2024-09-12T17:18:14.897 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.896+0000 7f574d1ea780 1 < canceled part key=_multipart_ENFNIFHQ3SHW.2~LPBA25ICRJ61.2 size=14669 2024-09-12T17:18:14.899 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.898+0000 7f574d1ea780 1 < canceled multipart upload key=ENFNIFHQ3SHW upload=LPBA25ICRJ61 tag=TYXBNKNS948T type=write size=3160397 2024-09-12T17:18:14.900 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.899+0000 7f574d1ea780 1 > prepared operation key=GEGOEB05R0PK tag=GRMUQ43RMIRR type=write size=424688 2024-09-12T17:18:14.902 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.901+0000 7f574d1ea780 1 < completed delete operation key=A1TIP3RXHBCZ tag=86ESSF373I60 type=del 2024-09-12T17:18:14.904 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.903+0000 7f574d1ea780 1 > prepared part key=_multipart_HFWA7DNUMWF2.2~3A52NVOTUBAQ.0 size=585532 2024-09-12T17:18:14.904 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.903+0000 7f574d1ea780 1 > prepared multipart upload key=HFWA7DNUMWF2 upload=3A52NVOTUBAQ tag=VTBAP8R7CSQP type=write size=1634108 2024-09-12T17:18:14.907 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.906+0000 7f574d1ea780 1 < suggested remove operation key=RWVWJHVZE95H tag=V84QDPW7R11B type=del 2024-09-12T17:18:14.908 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.907+0000 7f574d1ea780 1 > prepared operation key=7BX38Q7723EB tag=KFTR6KSNOP2I type=del size=4118298 2024-09-12T17:18:14.909 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.909+0000 7f574d1ea780 1 < completed part key=_multipart_55V137SY4E4P.2~3TBLO83D8185.0 size=722195 2024-09-12T17:18:14.911 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.911+0000 7f574d1ea780 1 < completed multipart upload key=55V137SY4E4P upload=3TBLO83D8185 tag=HVW748TNIXSD type=write size=1770771 2024-09-12T17:18:14.913 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.912+0000 7f574d1ea780 1 > prepared operation key=ZGE1860DMGHA tag=MUB1BH0OGRFJ type=del size=3277246 2024-09-12T17:18:14.914 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.913+0000 7f574d1ea780 1 < completed delete operation key=A1TIP3RXHBCZ tag=M3YLAXWK2XBN type=del 2024-09-12T17:18:14.916 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.915+0000 7f574d1ea780 1 > prepared part key=_multipart_U6E9A5OH4GUW.2~3QWXK4OZPHZO.0 size=1048576 2024-09-12T17:18:14.917 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.916+0000 7f574d1ea780 1 > prepared part key=_multipart_U6E9A5OH4GUW.2~3QWXK4OZPHZO.1 size=1048576 2024-09-12T17:18:14.918 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.917+0000 7f574d1ea780 1 > prepared part key=_multipart_U6E9A5OH4GUW.2~3QWXK4OZPHZO.2 size=930448 2024-09-12T17:18:14.918 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.917+0000 7f574d1ea780 1 > prepared multipart upload key=U6E9A5OH4GUW upload=3QWXK4OZPHZO tag=0RURXM8FGIL0 type=write size=4076176 2024-09-12T17:18:14.919 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.918+0000 7f574d1ea780 1 < completed delete operation key=ZGE1860DMGHA tag=QSDU262LLWW8 type=del 2024-09-12T17:18:14.920 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.920+0000 7f574d1ea780 1 > prepared operation key=DH02JGZP64MN tag=C93Z5CM35BZ4 type=del size=1426226 2024-09-12T17:18:14.922 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.921+0000 7f574d1ea780 1 < completed delete operation key=ENFNIFHQ3SHW tag=U2C0JG3PKJVU type=del 2024-09-12T17:18:14.923 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.922+0000 7f574d1ea780 1 > prepared operation key=UFKM4I8RMT0W tag=QEWDQFLFTOYW type=del size=949976 2024-09-12T17:18:14.925 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.925+0000 7f574d1ea780 1 < suggested remove operation key=ENFNIFHQ3SHW tag=N5YY3HY8Z9WJ type=del 2024-09-12T17:18:14.927 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.926+0000 7f574d1ea780 1 > prepared operation key=SQQMJ61CA0QW tag=A4OQX8RL9UOM type=del size=765820 2024-09-12T17:18:14.928 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.927+0000 7f574d1ea780 1 < completed delete operation key=YXIDO0U18839 tag=2BI72CBFALU9 type=del 2024-09-12T17:18:14.930 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.930+0000 7f574d1ea780 1 > prepared part key=_multipart_RNI86YYLADT0.2~KQK6LQQYYEOV.0 size=483038 2024-09-12T17:18:14.930 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.930+0000 7f574d1ea780 1 > prepared multipart upload key=RNI86YYLADT0 upload=KQK6LQQYYEOV tag=RN0EBE8K10I3 type=write size=1531614 2024-09-12T17:18:14.931 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.931+0000 7f574d1ea780 1 < completed delete operation key=A1TIP3RXHBCZ tag=3MZHQYT3AG3K type=del 2024-09-12T17:18:14.933 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.932+0000 7f574d1ea780 1 > prepared operation key=54LQ91UMBJAN tag=IWEWTSZRQU9C type=write size=343952 2024-09-12T17:18:14.934 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.933+0000 7f574d1ea780 1 < completed delete operation key=55JI541K1WP2 tag=YCJT4W7TE12S type=del 2024-09-12T17:18:14.936 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.936+0000 7f574d1ea780 1 > prepared part key=_multipart_DH02JGZP64MN.2~GYNGUP1U6DTB.0 size=1048576 2024-09-12T17:18:14.937 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.936+0000 7f574d1ea780 1 > prepared part key=_multipart_DH02JGZP64MN.2~GYNGUP1U6DTB.1 size=1048576 2024-09-12T17:18:14.938 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.938+0000 7f574d1ea780 1 > prepared part key=_multipart_DH02JGZP64MN.2~GYNGUP1U6DTB.2 size=30627 2024-09-12T17:18:14.939 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.938+0000 7f574d1ea780 1 > prepared multipart upload key=DH02JGZP64MN upload=GYNGUP1U6DTB tag=14FO423V7L9C type=write size=3176355 2024-09-12T17:18:14.940 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.939+0000 7f574d1ea780 1 < completed part key=_multipart_55V137SY4E4P.2~WMB2K1AXBYS9.0 size=1048576 2024-09-12T17:18:14.941 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.940+0000 7f574d1ea780 1 < completed part key=_multipart_55V137SY4E4P.2~WMB2K1AXBYS9.1 size=928780 2024-09-12T17:18:14.943 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.942+0000 7f574d1ea780 1 < completed multipart upload key=55V137SY4E4P upload=WMB2K1AXBYS9 tag=5L34OCJ8DULP type=write size=3025932 2024-09-12T17:18:14.945 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.945+0000 7f574d1ea780 1 > prepared part key=_multipart_QXD8UG2K4STQ.2~BWXBUPG2E4TM.0 size=1048576 2024-09-12T17:18:14.947 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.946+0000 7f574d1ea780 1 > prepared part key=_multipart_QXD8UG2K4STQ.2~BWXBUPG2E4TM.1 size=1031491 2024-09-12T17:18:14.947 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.946+0000 7f574d1ea780 1 > prepared multipart upload key=QXD8UG2K4STQ upload=BWXBUPG2E4TM tag=XXMIPNYH6PYR type=write size=3128643 2024-09-12T17:18:14.949 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.948+0000 7f574d1ea780 1 < completed part key=_multipart_RNI86YYLADT0.2~R00BSNX4PGJW.0 size=1048576 2024-09-12T17:18:14.950 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.949+0000 7f574d1ea780 1 < completed part key=_multipart_RNI86YYLADT0.2~R00BSNX4PGJW.1 size=1048576 2024-09-12T17:18:14.953 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.952+0000 7f574d1ea780 1 < completed part key=_multipart_RNI86YYLADT0.2~R00BSNX4PGJW.2 size=175486 2024-09-12T17:18:14.955 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.954+0000 7f574d1ea780 1 < completed multipart upload key=RNI86YYLADT0 upload=R00BSNX4PGJW tag=6P48SC896A7T type=write size=3321214 2024-09-12T17:18:14.956 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.955+0000 7f574d1ea780 1 > prepared operation key=ZGH8XC39FGTC tag=L88LFHLKVMCL type=del size=1646949 2024-09-12T17:18:14.957 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.957+0000 7f574d1ea780 1 < completed delete operation key=A1TIP3RXHBCZ tag=RO0CJOF6KX36 type=del 2024-09-12T17:18:14.959 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.958+0000 7f574d1ea780 1 > prepared operation key=YXIDO0U18839 tag=N6GC35PTGTI9 type=del size=989599 2024-09-12T17:18:14.960 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.959+0000 7f574d1ea780 1 < completed delete operation key=VWWA5IB0L4N1 tag=BVM30OPJXGE2 type=del 2024-09-12T17:18:14.962 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.961+0000 7f574d1ea780 1 > prepared part key=_multipart_R00F69ON5P6Z.2~SJR1ZBN3YHRZ.0 size=1048576 2024-09-12T17:18:14.963 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.962+0000 7f574d1ea780 1 > prepared part key=_multipart_R00F69ON5P6Z.2~SJR1ZBN3YHRZ.1 size=835934 2024-09-12T17:18:14.963 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.962+0000 7f574d1ea780 1 > prepared multipart upload key=R00F69ON5P6Z upload=SJR1ZBN3YHRZ tag=XBDLG0XN05FJ type=write size=2933086 2024-09-12T17:18:14.966 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.965+0000 7f574d1ea780 1 < suggested remove operation key=R00F69ON5P6Z tag=IXRN3Y3ZAZH2 type=write 2024-09-12T17:18:14.967 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.966+0000 7f574d1ea780 1 > prepared operation key=54LQ91UMBJAN tag=R0KG2RA2NI2L type=del size=2303945 2024-09-12T17:18:14.973 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.969+0000 7f574d1ea780 1 < suggested update operation key=GEGOEB05R0PK tag=GRMUQ43RMIRR type=write size=424688 2024-09-12T17:18:14.973 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.970+0000 7f574d1ea780 1 > prepared operation key=ZGE1860DMGHA tag=ABL8QNWLKDE4 type=del size=888069 2024-09-12T17:18:14.973 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.971+0000 7f574d1ea780 1 < completed part key=_multipart_HFWA7DNUMWF2.2~3A52NVOTUBAQ.0 size=585532 2024-09-12T17:18:14.975 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.974+0000 7f574d1ea780 1 < completed multipart upload key=HFWA7DNUMWF2 upload=3A52NVOTUBAQ tag=VTBAP8R7CSQP type=write size=1634108 2024-09-12T17:18:14.976 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.975+0000 7f574d1ea780 1 > prepared operation key=QXD8UG2K4STQ tag=HF1D293C1M7R type=del size=2391893 2024-09-12T17:18:14.977 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.976+0000 7f574d1ea780 1 < completed delete operation key=7BX38Q7723EB tag=KFTR6KSNOP2I type=del 2024-09-12T17:18:14.979 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.978+0000 7f574d1ea780 1 > prepared operation key=A1TIP3RXHBCZ tag=5ALA3PHRQJR6 type=write size=765623 2024-09-12T17:18:14.980 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.979+0000 7f574d1ea780 1 < completed delete operation key=ZGE1860DMGHA tag=MUB1BH0OGRFJ type=del 2024-09-12T17:18:14.982 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.981+0000 7f574d1ea780 1 > prepared operation key=RWVWJHVZE95H tag=1A7J165RH3BF type=del size=42245 2024-09-12T17:18:14.983 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.982+0000 7f574d1ea780 1 < completed part key=_multipart_U6E9A5OH4GUW.2~3QWXK4OZPHZO.0 size=1048576 2024-09-12T17:18:14.984 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.983+0000 7f574d1ea780 1 < completed part key=_multipart_U6E9A5OH4GUW.2~3QWXK4OZPHZO.1 size=1048576 2024-09-12T17:18:14.985 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.984+0000 7f574d1ea780 1 < completed part key=_multipart_U6E9A5OH4GUW.2~3QWXK4OZPHZO.2 size=930448 2024-09-12T17:18:14.988 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.987+0000 7f574d1ea780 1 < completed multipart upload key=U6E9A5OH4GUW upload=3QWXK4OZPHZO tag=0RURXM8FGIL0 type=write size=4076176 2024-09-12T17:18:14.989 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.988+0000 7f574d1ea780 1 > prepared operation key=UFKM4I8RMT0W tag=JH9PLT2UIVPY type=del size=182249 2024-09-12T17:18:14.990 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.989+0000 7f574d1ea780 1 < completed delete operation key=DH02JGZP64MN tag=C93Z5CM35BZ4 type=del 2024-09-12T17:18:14.993 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.992+0000 7f574d1ea780 1 > prepared part key=_multipart_ENFNIFHQ3SHW.2~BZ94J3LXAQIR.0 size=245657 2024-09-12T17:18:14.993 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.992+0000 7f574d1ea780 1 > prepared multipart upload key=ENFNIFHQ3SHW upload=BZ94J3LXAQIR tag=MB7I9LTXV4R1 type=write size=1294233 2024-09-12T17:18:14.994 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.993+0000 7f574d1ea780 1 < completed delete operation key=UFKM4I8RMT0W tag=QEWDQFLFTOYW type=del 2024-09-12T17:18:14.995 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.994+0000 7f574d1ea780 1 > prepared operation key=55JI541K1WP2 tag=WYGEZUWSORN1 type=write size=909884 2024-09-12T17:18:14.996 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.995+0000 7f574d1ea780 1 < completed delete operation key=SQQMJ61CA0QW tag=A4OQX8RL9UOM type=del 2024-09-12T17:18:14.997 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.997+0000 7f574d1ea780 1 > prepared operation key=TIKBUXFPVTN1 tag=VEJ4T6F6PJUM type=del size=2260486 2024-09-12T17:18:14.999 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:14.998+0000 7f574d1ea780 1 < completed part key=_multipart_RNI86YYLADT0.2~KQK6LQQYYEOV.0 size=483038 2024-09-12T17:18:15.001 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.000+0000 7f574d1ea780 1 < completed multipart upload key=RNI86YYLADT0 upload=KQK6LQQYYEOV tag=RN0EBE8K10I3 type=write size=1531614 2024-09-12T17:18:15.003 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.002+0000 7f574d1ea780 1 > prepared part key=_multipart_43GV2N9VBBKE.2~ZU3A5ATV257L.0 size=1048576 2024-09-12T17:18:15.004 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.003+0000 7f574d1ea780 1 > prepared part key=_multipart_43GV2N9VBBKE.2~ZU3A5ATV257L.1 size=1048576 2024-09-12T17:18:15.005 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.004+0000 7f574d1ea780 1 > prepared part key=_multipart_43GV2N9VBBKE.2~ZU3A5ATV257L.2 size=581821 2024-09-12T17:18:15.005 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.004+0000 7f574d1ea780 1 > prepared multipart upload key=43GV2N9VBBKE upload=ZU3A5ATV257L tag=HHWK6VUQEW8N type=write size=3727549 2024-09-12T17:18:15.006 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.005+0000 7f574d1ea780 1 < completed write operation key=54LQ91UMBJAN tag=IWEWTSZRQU9C type=write size=343952 2024-09-12T17:18:15.008 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.008+0000 7f574d1ea780 1 > prepared part key=_multipart_54LQ91UMBJAN.2~FM0KQ174M6TI.0 size=1048576 2024-09-12T17:18:15.009 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.009+0000 7f574d1ea780 1 > prepared part key=_multipart_54LQ91UMBJAN.2~FM0KQ174M6TI.1 size=482062 2024-09-12T17:18:15.009 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.009+0000 7f574d1ea780 1 > prepared multipart upload key=54LQ91UMBJAN upload=FM0KQ174M6TI tag=ZMDIASEQ96TE type=write size=2579214 2024-09-12T17:18:15.011 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.010+0000 7f574d1ea780 1 < completed part key=_multipart_DH02JGZP64MN.2~GYNGUP1U6DTB.0 size=1048576 2024-09-12T17:18:15.012 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.011+0000 7f574d1ea780 1 < completed part key=_multipart_DH02JGZP64MN.2~GYNGUP1U6DTB.1 size=1048576 2024-09-12T17:18:15.013 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.012+0000 7f574d1ea780 1 < completed part key=_multipart_DH02JGZP64MN.2~GYNGUP1U6DTB.2 size=30627 2024-09-12T17:18:15.015 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.014+0000 7f574d1ea780 1 < completed multipart upload key=DH02JGZP64MN upload=GYNGUP1U6DTB tag=14FO423V7L9C type=write size=3176355 2024-09-12T17:18:15.016 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.015+0000 7f574d1ea780 1 > prepared operation key=55JI541K1WP2 tag=0LPNV0K0QHD7 type=del size=2891319 2024-09-12T17:18:15.017 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.016+0000 7f574d1ea780 1 < completed part key=_multipart_QXD8UG2K4STQ.2~BWXBUPG2E4TM.0 size=1048576 2024-09-12T17:18:15.018 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.017+0000 7f574d1ea780 1 < completed part key=_multipart_QXD8UG2K4STQ.2~BWXBUPG2E4TM.1 size=1031491 2024-09-12T17:18:15.020 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.019+0000 7f574d1ea780 1 < completed multipart upload key=QXD8UG2K4STQ upload=BWXBUPG2E4TM tag=XXMIPNYH6PYR type=write size=3128643 2024-09-12T17:18:15.021 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.021+0000 7f574d1ea780 1 > prepared operation key=R00F69ON5P6Z tag=PT0WGPGM5FWK type=del size=3097883 2024-09-12T17:18:15.023 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.023+0000 7f574d1ea780 1 < suggested remove operation key=ZGH8XC39FGTC tag=L88LFHLKVMCL type=del 2024-09-12T17:18:15.025 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.024+0000 7f574d1ea780 1 > prepared operation key=UFKM4I8RMT0W tag=D3CJ3YVCUVBY type=del size=2099771 2024-09-12T17:18:15.026 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.025+0000 7f574d1ea780 1 < completed delete operation key=YXIDO0U18839 tag=N6GC35PTGTI9 type=del 2024-09-12T17:18:15.027 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.026+0000 7f574d1ea780 1 > prepared operation key=ZGH8XC39FGTC tag=45E5EAJ04Q8R type=del size=809799 2024-09-12T17:18:15.028 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.028+0000 7f574d1ea780 1 < completed part key=_multipart_R00F69ON5P6Z.2~SJR1ZBN3YHRZ.0 size=1048576 2024-09-12T17:18:15.029 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.029+0000 7f574d1ea780 1 < completed part key=_multipart_R00F69ON5P6Z.2~SJR1ZBN3YHRZ.1 size=835934 2024-09-12T17:18:15.031 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.031+0000 7f574d1ea780 1 < completed multipart upload key=R00F69ON5P6Z upload=SJR1ZBN3YHRZ tag=XBDLG0XN05FJ type=write size=2933086 2024-09-12T17:18:15.033 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.032+0000 7f574d1ea780 1 > prepared operation key=RNI86YYLADT0 tag=NNFJV1SUPTQV type=write size=313735 2024-09-12T17:18:15.034 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.033+0000 7f574d1ea780 1 < completed delete operation key=54LQ91UMBJAN tag=R0KG2RA2NI2L type=del 2024-09-12T17:18:15.035 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.034+0000 7f574d1ea780 1 > prepared operation key=GEGOEB05R0PK tag=LI2H11UVZUC2 type=del size=1715171 2024-09-12T17:18:15.036 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.035+0000 7f574d1ea780 1 < completed delete operation key=ZGE1860DMGHA tag=ABL8QNWLKDE4 type=del 2024-09-12T17:18:15.038 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.038+0000 7f574d1ea780 1 > prepared part key=_multipart_K12MVG618809.2~KQ2AQW5813E1.0 size=1048576 2024-09-12T17:18:15.039 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.039+0000 7f574d1ea780 1 > prepared part key=_multipart_K12MVG618809.2~KQ2AQW5813E1.1 size=1019289 2024-09-12T17:18:15.040 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.039+0000 7f574d1ea780 1 > prepared multipart upload key=K12MVG618809 upload=KQ2AQW5813E1 tag=DGRNNT2X2LGT type=write size=3116441 2024-09-12T17:18:15.041 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.040+0000 7f574d1ea780 1 < completed delete operation key=QXD8UG2K4STQ tag=HF1D293C1M7R type=del 2024-09-12T17:18:15.043 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.042+0000 7f574d1ea780 1 > prepared part key=_multipart_8VW3XCUHLF2L.2~I1I11D0N71DX.0 size=1048576 2024-09-12T17:18:15.044 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.043+0000 7f574d1ea780 1 > prepared part key=_multipart_8VW3XCUHLF2L.2~I1I11D0N71DX.1 size=757488 2024-09-12T17:18:15.044 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.043+0000 7f574d1ea780 1 > prepared multipart upload key=8VW3XCUHLF2L upload=I1I11D0N71DX tag=SJZZ7XY10J8N type=write size=2854640 2024-09-12T17:18:15.045 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.044+0000 7f574d1ea780 1 < completed write operation key=A1TIP3RXHBCZ tag=5ALA3PHRQJR6 type=write size=765623 2024-09-12T17:18:15.047 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.047+0000 7f574d1ea780 1 > prepared part key=_multipart_SQQMJ61CA0QW.2~KLYZ3GBAQDJM.0 size=176535 2024-09-12T17:18:15.048 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.047+0000 7f574d1ea780 1 > prepared multipart upload key=SQQMJ61CA0QW upload=KLYZ3GBAQDJM tag=81GZIV9KPIVK type=write size=1225111 2024-09-12T17:18:15.049 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.048+0000 7f574d1ea780 1 < completed delete operation key=RWVWJHVZE95H tag=1A7J165RH3BF type=del 2024-09-12T17:18:15.051 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.050+0000 7f574d1ea780 1 > prepared part key=_multipart_GEGOEB05R0PK.2~I8GM0WIY6IYP.0 size=1048576 2024-09-12T17:18:15.052 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.051+0000 7f574d1ea780 1 > prepared part key=_multipart_GEGOEB05R0PK.2~I8GM0WIY6IYP.1 size=156051 2024-09-12T17:18:15.052 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.051+0000 7f574d1ea780 1 > prepared multipart upload key=GEGOEB05R0PK upload=I8GM0WIY6IYP tag=GY9AJOW72KMO type=write size=2253203 2024-09-12T17:18:15.054 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.054+0000 7f574d1ea780 1 < suggested update operation key=UFKM4I8RMT0W tag=JH9PLT2UIVPY type=del size=182249 2024-09-12T17:18:15.057 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.056+0000 7f574d1ea780 1 > prepared part key=_multipart_ENFNIFHQ3SHW.2~33TGE40CS50P.0 size=1048576 2024-09-12T17:18:15.057 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.057+0000 7f574d1ea780 1 > prepared part key=_multipart_ENFNIFHQ3SHW.2~33TGE40CS50P.1 size=779491 2024-09-12T17:18:15.058 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.057+0000 7f574d1ea780 1 > prepared multipart upload key=ENFNIFHQ3SHW upload=33TGE40CS50P tag=J95CY3B0O2G8 type=write size=2876643 2024-09-12T17:18:15.059 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.058+0000 7f574d1ea780 1 < completed part key=_multipart_ENFNIFHQ3SHW.2~BZ94J3LXAQIR.0 size=245657 2024-09-12T17:18:15.061 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.060+0000 7f574d1ea780 1 < completed multipart upload key=ENFNIFHQ3SHW upload=BZ94J3LXAQIR tag=MB7I9LTXV4R1 type=write size=1294233 2024-09-12T17:18:15.062 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.061+0000 7f574d1ea780 1 > prepared operation key=RWVWJHVZE95H tag=GCCZ7IQH15WY type=del size=3433062 2024-09-12T17:18:15.063 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.062+0000 7f574d1ea780 1 < completed write operation key=55JI541K1WP2 tag=WYGEZUWSORN1 type=write size=909884 2024-09-12T17:18:15.064 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.064+0000 7f574d1ea780 1 > prepared operation key=RNI86YYLADT0 tag=8713V5NECXJU type=del size=2685237 2024-09-12T17:18:15.066 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.065+0000 7f574d1ea780 1 < completed delete operation key=TIKBUXFPVTN1 tag=VEJ4T6F6PJUM type=del 2024-09-12T17:18:15.068 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.067+0000 7f574d1ea780 1 > prepared operation key=R00F69ON5P6Z tag=MLVALYX6EUI7 type=del size=2993599 2024-09-12T17:18:15.069 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.068+0000 7f574d1ea780 1 < completed part key=_multipart_43GV2N9VBBKE.2~ZU3A5ATV257L.0 size=1048576 2024-09-12T17:18:15.070 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.069+0000 7f574d1ea780 1 < completed part key=_multipart_43GV2N9VBBKE.2~ZU3A5ATV257L.1 size=1048576 2024-09-12T17:18:15.071 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.070+0000 7f574d1ea780 1 < completed part key=_multipart_43GV2N9VBBKE.2~ZU3A5ATV257L.2 size=581821 2024-09-12T17:18:15.073 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.072+0000 7f574d1ea780 1 < completed multipart upload key=43GV2N9VBBKE upload=ZU3A5ATV257L tag=HHWK6VUQEW8N type=write size=3727549 2024-09-12T17:18:15.075 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.074+0000 7f574d1ea780 1 > prepared part key=_multipart_7BX38Q7723EB.2~MKAQ4QLSCOL9.0 size=1048576 2024-09-12T17:18:15.076 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.075+0000 7f574d1ea780 1 > prepared part key=_multipart_7BX38Q7723EB.2~MKAQ4QLSCOL9.1 size=768506 2024-09-12T17:18:15.076 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.075+0000 7f574d1ea780 1 > prepared multipart upload key=7BX38Q7723EB upload=MKAQ4QLSCOL9 tag=GYXTW8YB823I type=write size=2865658 2024-09-12T17:18:15.077 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.077+0000 7f574d1ea780 1 < completed part key=_multipart_54LQ91UMBJAN.2~FM0KQ174M6TI.0 size=1048576 2024-09-12T17:18:15.078 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.078+0000 7f574d1ea780 1 < completed part key=_multipart_54LQ91UMBJAN.2~FM0KQ174M6TI.1 size=482062 2024-09-12T17:18:15.081 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.080+0000 7f574d1ea780 1 < completed multipart upload key=54LQ91UMBJAN upload=FM0KQ174M6TI tag=ZMDIASEQ96TE type=write size=2579214 2024-09-12T17:18:15.083 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.082+0000 7f574d1ea780 1 > prepared part key=_multipart_55V137SY4E4P.2~48SLXM6CYIW2.0 size=855441 2024-09-12T17:18:15.083 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.082+0000 7f574d1ea780 1 > prepared multipart upload key=55V137SY4E4P upload=48SLXM6CYIW2 tag=RMNI3DO5I0KC type=write size=1904017 2024-09-12T17:18:15.084 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.083+0000 7f574d1ea780 1 < completed delete operation key=55JI541K1WP2 tag=0LPNV0K0QHD7 type=del 2024-09-12T17:18:15.086 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.085+0000 7f574d1ea780 1 > prepared part key=_multipart_54CM8800AT9V.2~NBI5ZPS6XN3A.0 size=1048576 2024-09-12T17:18:15.087 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.086+0000 7f574d1ea780 1 > prepared part key=_multipart_54CM8800AT9V.2~NBI5ZPS6XN3A.1 size=424483 2024-09-12T17:18:15.087 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.086+0000 7f574d1ea780 1 > prepared multipart upload key=54CM8800AT9V upload=NBI5ZPS6XN3A tag=NM02WNO30GWK type=write size=2521635 2024-09-12T17:18:15.088 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.088+0000 7f574d1ea780 1 < completed delete operation key=R00F69ON5P6Z tag=PT0WGPGM5FWK type=del 2024-09-12T17:18:15.089 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.089+0000 7f574d1ea780 1 > prepared operation key=ENFNIFHQ3SHW tag=GWW9A60O4GZV type=del size=4063178 2024-09-12T17:18:15.091 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.090+0000 7f574d1ea780 -1 < failed to complete operation key=UFKM4I8RMT0W tag=D3CJ3YVCUVBY type=del size=2099771: (22) Invalid argument 2024-09-12T17:18:15.093 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.092+0000 7f574d1ea780 1 > prepared part key=_multipart_ZGE1860DMGHA.2~FOQ2EBMKIOQZ.0 size=1048576 2024-09-12T17:18:15.094 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.093+0000 7f574d1ea780 1 > prepared part key=_multipart_ZGE1860DMGHA.2~FOQ2EBMKIOQZ.1 size=1048576 2024-09-12T17:18:15.095 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.094+0000 7f574d1ea780 1 > prepared part key=_multipart_ZGE1860DMGHA.2~FOQ2EBMKIOQZ.2 size=513919 2024-09-12T17:18:15.095 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.094+0000 7f574d1ea780 1 > prepared multipart upload key=ZGE1860DMGHA upload=FOQ2EBMKIOQZ tag=M7F8U97PTWUE type=write size=3659647 2024-09-12T17:18:15.096 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.095+0000 7f574d1ea780 1 < completed delete operation key=ZGH8XC39FGTC tag=45E5EAJ04Q8R type=del 2024-09-12T17:18:15.097 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.096+0000 7f574d1ea780 1 > prepared operation key=GEGOEB05R0PK tag=HZGDI8RQXJT4 type=del size=4035678 2024-09-12T17:18:15.098 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.097+0000 7f574d1ea780 1 < completed write operation key=RNI86YYLADT0 tag=NNFJV1SUPTQV type=write size=313735 2024-09-12T17:18:15.099 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.099+0000 7f574d1ea780 1 > prepared operation key=R00F69ON5P6Z tag=TPM9MUALULUI type=write size=868352 2024-09-12T17:18:15.101 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.100+0000 7f574d1ea780 1 < completed delete operation key=GEGOEB05R0PK tag=LI2H11UVZUC2 type=del 2024-09-12T17:18:15.102 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.101+0000 7f574d1ea780 1 > prepared operation key=TIKBUXFPVTN1 tag=UDL2WFJIMZL3 type=del size=3917037 2024-09-12T17:18:15.103 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.102+0000 7f574d1ea780 1 < completed part key=_multipart_K12MVG618809.2~KQ2AQW5813E1.0 size=1048576 2024-09-12T17:18:15.104 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.103+0000 7f574d1ea780 1 < completed part key=_multipart_K12MVG618809.2~KQ2AQW5813E1.1 size=1019289 2024-09-12T17:18:15.106 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.105+0000 7f574d1ea780 1 < completed multipart upload key=K12MVG618809 upload=KQ2AQW5813E1 tag=DGRNNT2X2LGT type=write size=3116441 2024-09-12T17:18:15.108 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.107+0000 7f574d1ea780 1 > prepared part key=_multipart_TIKBUXFPVTN1.2~O3314RTQM3ZF.0 size=1048576 2024-09-12T17:18:15.109 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.108+0000 7f574d1ea780 1 > prepared part key=_multipart_TIKBUXFPVTN1.2~O3314RTQM3ZF.1 size=754882 2024-09-12T17:18:15.109 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.108+0000 7f574d1ea780 1 > prepared multipart upload key=TIKBUXFPVTN1 upload=O3314RTQM3ZF tag=4X8ANEK61F91 type=write size=2852034 2024-09-12T17:18:15.110 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.109+0000 7f574d1ea780 1 < canceled part key=_multipart_8VW3XCUHLF2L.2~I1I11D0N71DX.0 size=1048576 2024-09-12T17:18:15.110 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.109+0000 7f574d1ea780 1 < canceled part key=_multipart_8VW3XCUHLF2L.2~I1I11D0N71DX.1 size=757488 2024-09-12T17:18:15.111 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.110+0000 7f574d1ea780 1 < canceled multipart upload key=8VW3XCUHLF2L upload=I1I11D0N71DX tag=SJZZ7XY10J8N type=write size=2854640 2024-09-12T17:18:15.113 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.112+0000 7f574d1ea780 1 > prepared operation key=R00F69ON5P6Z tag=SO57WQT9R855 type=write size=1043908 2024-09-12T17:18:15.114 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.113+0000 7f574d1ea780 1 < completed part key=_multipart_SQQMJ61CA0QW.2~KLYZ3GBAQDJM.0 size=176535 2024-09-12T17:18:15.116 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.115+0000 7f574d1ea780 1 < completed multipart upload key=SQQMJ61CA0QW upload=KLYZ3GBAQDJM tag=81GZIV9KPIVK type=write size=1225111 2024-09-12T17:18:15.117 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.116+0000 7f574d1ea780 1 > prepared operation key=ENFNIFHQ3SHW tag=RWIFXG2AZ2VV type=del size=1613337 2024-09-12T17:18:15.118 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.117+0000 7f574d1ea780 1 < completed part key=_multipart_GEGOEB05R0PK.2~I8GM0WIY6IYP.0 size=1048576 2024-09-12T17:18:15.119 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.118+0000 7f574d1ea780 1 < completed part key=_multipart_GEGOEB05R0PK.2~I8GM0WIY6IYP.1 size=156051 2024-09-12T17:18:15.121 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.120+0000 7f574d1ea780 1 < completed multipart upload key=GEGOEB05R0PK upload=I8GM0WIY6IYP tag=GY9AJOW72KMO type=write size=2253203 2024-09-12T17:18:15.122 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.121+0000 7f574d1ea780 1 > prepared operation key=TIKBUXFPVTN1 tag=F7QMGIYUI7HT type=del size=2655367 2024-09-12T17:18:15.124 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.123+0000 7f574d1ea780 1 < completed part key=_multipart_ENFNIFHQ3SHW.2~33TGE40CS50P.0 size=1048576 2024-09-12T17:18:15.125 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.124+0000 7f574d1ea780 1 < completed part key=_multipart_ENFNIFHQ3SHW.2~33TGE40CS50P.1 size=779491 2024-09-12T17:18:15.127 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.126+0000 7f574d1ea780 1 < completed multipart upload key=ENFNIFHQ3SHW upload=33TGE40CS50P tag=J95CY3B0O2G8 type=write size=2876643 2024-09-12T17:18:15.128 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.127+0000 7f574d1ea780 1 > prepared operation key=TIKBUXFPVTN1 tag=DG52CHVQS5BP type=del size=2431586 2024-09-12T17:18:15.129 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.128+0000 7f574d1ea780 1 < completed delete operation key=RWVWJHVZE95H tag=GCCZ7IQH15WY type=del 2024-09-12T17:18:15.130 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.129+0000 7f574d1ea780 1 > prepared operation key=43GV2N9VBBKE tag=1MAXDIY9BBVX type=del size=1623918 2024-09-12T17:18:15.132 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.131+0000 7f574d1ea780 1 < completed delete operation key=RNI86YYLADT0 tag=8713V5NECXJU type=del 2024-09-12T17:18:15.133 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.132+0000 7f574d1ea780 1 > prepared operation key=RWVWJHVZE95H tag=EAOQOWQD0SDG type=del size=1131228 2024-09-12T17:18:15.134 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.133+0000 7f574d1ea780 1 < canceled operation key=R00F69ON5P6Z tag=MLVALYX6EUI7 type=del size=2993599 2024-09-12T17:18:15.136 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.135+0000 7f574d1ea780 1 > prepared operation key=OI51GO639LFK tag=J0SV3YGUTL5U type=del size=3928196 2024-09-12T17:18:15.137 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.136+0000 7f574d1ea780 1 < completed part key=_multipart_7BX38Q7723EB.2~MKAQ4QLSCOL9.0 size=1048576 2024-09-12T17:18:15.137 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.136+0000 7f574d1ea780 1 < canceled part key=_multipart_7BX38Q7723EB.2~MKAQ4QLSCOL9.1 size=768506 2024-09-12T17:18:15.139 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.138+0000 7f574d1ea780 1 < canceled multipart upload key=7BX38Q7723EB upload=MKAQ4QLSCOL9 tag=GYXTW8YB823I type=write size=2865658 2024-09-12T17:18:15.141 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.140+0000 7f574d1ea780 1 > prepared part key=_multipart_54CM8800AT9V.2~GCSU0U58BWS3.0 size=926905 2024-09-12T17:18:15.141 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.140+0000 7f574d1ea780 1 > prepared multipart upload key=54CM8800AT9V upload=GCSU0U58BWS3 tag=E2BKQQMV4JK8 type=write size=1975481 2024-09-12T17:18:15.142 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.141+0000 7f574d1ea780 1 < completed part key=_multipart_55V137SY4E4P.2~48SLXM6CYIW2.0 size=855441 2024-09-12T17:18:15.144 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.143+0000 7f574d1ea780 1 < completed multipart upload key=55V137SY4E4P upload=48SLXM6CYIW2 tag=RMNI3DO5I0KC type=write size=1904017 2024-09-12T17:18:15.146 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.145+0000 7f574d1ea780 1 > prepared operation key=GEGOEB05R0PK tag=T2A5NQURFQEF type=write size=588154 2024-09-12T17:18:15.147 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.146+0000 7f574d1ea780 1 < completed part key=_multipart_54CM8800AT9V.2~NBI5ZPS6XN3A.0 size=1048576 2024-09-12T17:18:15.148 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.147+0000 7f574d1ea780 1 < completed part key=_multipart_54CM8800AT9V.2~NBI5ZPS6XN3A.1 size=424483 2024-09-12T17:18:15.150 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.149+0000 7f574d1ea780 1 < completed multipart upload key=54CM8800AT9V upload=NBI5ZPS6XN3A tag=NM02WNO30GWK type=write size=2521635 2024-09-12T17:18:15.152 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.151+0000 7f574d1ea780 1 > prepared part key=_multipart_UTCKL1F42X8A.2~7IGJOR9GC9X6.0 size=948202 2024-09-12T17:18:15.152 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.151+0000 7f574d1ea780 1 > prepared multipart upload key=UTCKL1F42X8A upload=7IGJOR9GC9X6 tag=ZVIVX2EUZQGY type=write size=1996778 2024-09-12T17:18:15.154 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.153+0000 7f574d1ea780 1 < completed delete operation key=ENFNIFHQ3SHW tag=GWW9A60O4GZV type=del 2024-09-12T17:18:15.156 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.155+0000 7f574d1ea780 1 > prepared part key=_multipart_TIKBUXFPVTN1.2~29ZYHRY7VFN4.0 size=1048576 2024-09-12T17:18:15.157 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.156+0000 7f574d1ea780 1 > prepared part key=_multipart_TIKBUXFPVTN1.2~29ZYHRY7VFN4.1 size=1048576 2024-09-12T17:18:15.158 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.157+0000 7f574d1ea780 1 > prepared part key=_multipart_TIKBUXFPVTN1.2~29ZYHRY7VFN4.2 size=10213 2024-09-12T17:18:15.158 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.157+0000 7f574d1ea780 1 > prepared multipart upload key=TIKBUXFPVTN1 upload=29ZYHRY7VFN4 tag=UF7G9C7WVZ9O type=write size=3155941 2024-09-12T17:18:15.159 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.158+0000 7f574d1ea780 1 < completed part key=_multipart_ZGE1860DMGHA.2~FOQ2EBMKIOQZ.0 size=1048576 2024-09-12T17:18:15.160 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.159+0000 7f574d1ea780 1 < completed part key=_multipart_ZGE1860DMGHA.2~FOQ2EBMKIOQZ.1 size=1048576 2024-09-12T17:18:15.161 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.160+0000 7f574d1ea780 1 < completed part key=_multipart_ZGE1860DMGHA.2~FOQ2EBMKIOQZ.2 size=513919 2024-09-12T17:18:15.163 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.163+0000 7f574d1ea780 1 < completed multipart upload key=ZGE1860DMGHA upload=FOQ2EBMKIOQZ tag=M7F8U97PTWUE type=write size=3659647 2024-09-12T17:18:15.166 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.165+0000 7f574d1ea780 1 > prepared part key=_multipart_HGZMN894YYC0.2~JO0E1DXYDKJ1.0 size=1048576 2024-09-12T17:18:15.167 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.166+0000 7f574d1ea780 1 > prepared part key=_multipart_HGZMN894YYC0.2~JO0E1DXYDKJ1.1 size=178501 2024-09-12T17:18:15.167 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.166+0000 7f574d1ea780 1 > prepared multipart upload key=HGZMN894YYC0 upload=JO0E1DXYDKJ1 tag=USPSGKHAIXQ8 type=write size=2275653 2024-09-12T17:18:15.168 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.167+0000 7f574d1ea780 1 < completed delete operation key=GEGOEB05R0PK tag=HZGDI8RQXJT4 type=del 2024-09-12T17:18:15.170 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.169+0000 7f574d1ea780 1 > prepared operation key=55V137SY4E4P tag=5ODCFPL9UAJD type=del size=239066 2024-09-12T17:18:15.171 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.170+0000 7f574d1ea780 1 < canceled operation key=R00F69ON5P6Z tag=TPM9MUALULUI type=write size=868352 2024-09-12T17:18:15.172 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.171+0000 7f574d1ea780 1 > prepared operation key=55JI541K1WP2 tag=88WSXPIT7E3P type=write size=146318 2024-09-12T17:18:15.177 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.174+0000 7f574d1ea780 1 < suggested update operation key=TIKBUXFPVTN1 tag=UDL2WFJIMZL3 type=del size=3917037 2024-09-12T17:18:15.177 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.176+0000 7f574d1ea780 1 > prepared part key=_multipart_54LQ91UMBJAN.2~ZO44BNAOJQRT.0 size=1048576 2024-09-12T17:18:15.178 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.177+0000 7f574d1ea780 1 > prepared part key=_multipart_54LQ91UMBJAN.2~ZO44BNAOJQRT.1 size=667080 2024-09-12T17:18:15.178 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.177+0000 7f574d1ea780 1 > prepared multipart upload key=54LQ91UMBJAN upload=ZO44BNAOJQRT tag=YZZPI801XIFD type=write size=2764232 2024-09-12T17:18:15.179 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.178+0000 7f574d1ea780 1 < completed part key=_multipart_TIKBUXFPVTN1.2~O3314RTQM3ZF.0 size=1048576 2024-09-12T17:18:15.182 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.180+0000 7f574d1ea780 1 < completed part key=_multipart_TIKBUXFPVTN1.2~O3314RTQM3ZF.1 size=754882 2024-09-12T17:18:15.186 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.185+0000 7f574d1ea780 1 < completed multipart upload key=TIKBUXFPVTN1 upload=O3314RTQM3ZF tag=4X8ANEK61F91 type=write size=2852034 2024-09-12T17:18:15.189 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.188+0000 7f574d1ea780 1 > prepared part key=_multipart_D1GEG3MKPOM3.2~NRD2V8IGK6FJ.0 size=1048576 2024-09-12T17:18:15.190 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.189+0000 7f574d1ea780 1 > prepared part key=_multipart_D1GEG3MKPOM3.2~NRD2V8IGK6FJ.1 size=1048576 2024-09-12T17:18:15.191 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.190+0000 7f574d1ea780 1 > prepared part key=_multipart_D1GEG3MKPOM3.2~NRD2V8IGK6FJ.2 size=80413 2024-09-12T17:18:15.191 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.190+0000 7f574d1ea780 1 > prepared multipart upload key=D1GEG3MKPOM3 upload=NRD2V8IGK6FJ tag=PYR6RH3PUPVD type=write size=3226141 2024-09-12T17:18:15.194 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.193+0000 7f574d1ea780 1 < suggested remove operation key=R00F69ON5P6Z tag=SO57WQT9R855 type=write 2024-09-12T17:18:15.195 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.194+0000 7f574d1ea780 1 > prepared operation key=54CM8800AT9V tag=AIIBY680MG9W type=del size=1054626 2024-09-12T17:18:15.196 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.195+0000 7f574d1ea780 1 < completed delete operation key=ENFNIFHQ3SHW tag=RWIFXG2AZ2VV type=del 2024-09-12T17:18:15.199 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.198+0000 7f574d1ea780 1 > prepared part key=_multipart_54CM8800AT9V.2~1EASFBDLCJBV.0 size=1048576 2024-09-12T17:18:15.200 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.199+0000 7f574d1ea780 1 > prepared part key=_multipart_54CM8800AT9V.2~1EASFBDLCJBV.1 size=1048576 2024-09-12T17:18:15.201 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.200+0000 7f574d1ea780 1 > prepared part key=_multipart_54CM8800AT9V.2~1EASFBDLCJBV.2 size=921322 2024-09-12T17:18:15.201 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.200+0000 7f574d1ea780 1 > prepared multipart upload key=54CM8800AT9V upload=1EASFBDLCJBV tag=U8LKZGNL4ABB type=write size=4067050 2024-09-12T17:18:15.203 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.202+0000 7f574d1ea780 1 < suggested remove operation key=TIKBUXFPVTN1 tag=F7QMGIYUI7HT type=del 2024-09-12T17:18:15.204 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.203+0000 7f574d1ea780 1 > prepared operation key=UTCKL1F42X8A tag=31712Z0GPAL9 type=del size=2239034 2024-09-12T17:18:15.205 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.205+0000 7f574d1ea780 -1 < failed to complete operation key=TIKBUXFPVTN1 tag=DG52CHVQS5BP type=del size=2431586: (22) Invalid argument 2024-09-12T17:18:15.208 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.207+0000 7f574d1ea780 1 > prepared part key=_multipart_QXD8UG2K4STQ.2~WDWE2A8Q5OKR.0 size=1048576 2024-09-12T17:18:15.209 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.208+0000 7f574d1ea780 1 > prepared part key=_multipart_QXD8UG2K4STQ.2~WDWE2A8Q5OKR.1 size=1048576 2024-09-12T17:18:15.210 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.209+0000 7f574d1ea780 1 > prepared part key=_multipart_QXD8UG2K4STQ.2~WDWE2A8Q5OKR.2 size=381102 2024-09-12T17:18:15.210 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.209+0000 7f574d1ea780 1 > prepared multipart upload key=QXD8UG2K4STQ upload=WDWE2A8Q5OKR tag=D7SKXGX52SDD type=write size=3526830 2024-09-12T17:18:15.211 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.210+0000 7f574d1ea780 1 < completed delete operation key=43GV2N9VBBKE tag=1MAXDIY9BBVX type=del 2024-09-12T17:18:15.212 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.211+0000 7f574d1ea780 1 > prepared operation key=ZGH8XC39FGTC tag=V78KVLRL9MXS type=write size=239595 2024-09-12T17:18:15.215 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.214+0000 7f574d1ea780 1 < suggested remove operation key=RWVWJHVZE95H tag=EAOQOWQD0SDG type=del 2024-09-12T17:18:15.216 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.215+0000 7f574d1ea780 1 > prepared operation key=U6E9A5OH4GUW tag=FMQCS3JQS4XG type=del size=1486364 2024-09-12T17:18:15.218 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.217+0000 7f574d1ea780 1 < completed delete operation key=OI51GO639LFK tag=J0SV3YGUTL5U type=del 2024-09-12T17:18:15.219 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.218+0000 7f574d1ea780 1 > prepared operation key=54CM8800AT9V tag=W4IH7ZI3NIY0 type=del size=4007210 2024-09-12T17:18:15.220 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.220+0000 7f574d1ea780 1 < completed part key=_multipart_54CM8800AT9V.2~GCSU0U58BWS3.0 size=926905 2024-09-12T17:18:15.223 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.222+0000 7f574d1ea780 1 < completed multipart upload key=54CM8800AT9V upload=GCSU0U58BWS3 tag=E2BKQQMV4JK8 type=write size=1975481 2024-09-12T17:18:15.225 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.224+0000 7f574d1ea780 1 > prepared part key=_multipart_YXIDO0U18839.2~35KBNVATZ65S.0 size=1048576 2024-09-12T17:18:15.226 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.225+0000 7f574d1ea780 1 > prepared part key=_multipart_YXIDO0U18839.2~35KBNVATZ65S.1 size=1048576 2024-09-12T17:18:15.227 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.226+0000 7f574d1ea780 1 > prepared part key=_multipart_YXIDO0U18839.2~35KBNVATZ65S.2 size=207432 2024-09-12T17:18:15.227 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.226+0000 7f574d1ea780 1 > prepared multipart upload key=YXIDO0U18839 upload=35KBNVATZ65S tag=NBJT84MCCATC type=write size=3353160 2024-09-12T17:18:15.230 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.229+0000 7f574d1ea780 1 < suggested remove operation key=GEGOEB05R0PK tag=T2A5NQURFQEF type=write 2024-09-12T17:18:15.231 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.230+0000 7f574d1ea780 1 > prepared operation key=UTCKL1F42X8A tag=R3B1JSZ3P1JS type=del size=3987365 2024-09-12T17:18:15.232 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.231+0000 7f574d1ea780 1 < completed part key=_multipart_UTCKL1F42X8A.2~7IGJOR9GC9X6.0 size=948202 2024-09-12T17:18:15.234 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.233+0000 7f574d1ea780 1 < completed multipart upload key=UTCKL1F42X8A upload=7IGJOR9GC9X6 tag=ZVIVX2EUZQGY type=write size=1996778 2024-09-12T17:18:15.235 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.235+0000 7f574d1ea780 1 > prepared operation key=ZGH8XC39FGTC tag=FITTGEGAYNK3 type=del size=282256 2024-09-12T17:18:15.237 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.236+0000 7f574d1ea780 1 < completed part key=_multipart_TIKBUXFPVTN1.2~29ZYHRY7VFN4.0 size=1048576 2024-09-12T17:18:15.238 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.237+0000 7f574d1ea780 1 < completed part key=_multipart_TIKBUXFPVTN1.2~29ZYHRY7VFN4.1 size=1048576 2024-09-12T17:18:15.239 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.238+0000 7f574d1ea780 1 < completed part key=_multipart_TIKBUXFPVTN1.2~29ZYHRY7VFN4.2 size=10213 2024-09-12T17:18:15.241 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.240+0000 7f574d1ea780 1 < completed multipart upload key=TIKBUXFPVTN1 upload=29ZYHRY7VFN4 tag=UF7G9C7WVZ9O type=write size=3155941 2024-09-12T17:18:15.242 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.242+0000 7f574d1ea780 1 > prepared operation key=A1TIP3RXHBCZ tag=MKLCXSXYJWXF type=del size=789149 2024-09-12T17:18:15.243 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.242+0000 7f574d1ea780 1 < canceled part key=_multipart_HGZMN894YYC0.2~JO0E1DXYDKJ1.0 size=1048576 2024-09-12T17:18:15.244 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.243+0000 7f574d1ea780 1 < completed part key=_multipart_HGZMN894YYC0.2~JO0E1DXYDKJ1.1 size=178501 2024-09-12T17:18:15.246 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.245+0000 7f574d1ea780 1 < canceled multipart upload key=HGZMN894YYC0 upload=JO0E1DXYDKJ1 tag=USPSGKHAIXQ8 type=write size=2275653 2024-09-12T17:18:15.248 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.247+0000 7f574d1ea780 1 > prepared part key=_multipart_TIKBUXFPVTN1.2~OMDBYN9JES62.0 size=1048576 2024-09-12T17:18:15.249 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.248+0000 7f574d1ea780 1 > prepared part key=_multipart_TIKBUXFPVTN1.2~OMDBYN9JES62.1 size=849924 2024-09-12T17:18:15.249 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.248+0000 7f574d1ea780 1 > prepared multipart upload key=TIKBUXFPVTN1 upload=OMDBYN9JES62 tag=1WAL1JFEO870 type=write size=2947076 2024-09-12T17:18:15.251 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.251+0000 7f574d1ea780 1 < suggested update operation key=55V137SY4E4P tag=5ODCFPL9UAJD type=del size=239066 2024-09-12T17:18:15.253 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.253+0000 7f574d1ea780 1 > prepared part key=_multipart_A1TIP3RXHBCZ.2~3P1S021SWMVL.0 size=1048576 2024-09-12T17:18:15.254 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.254+0000 7f574d1ea780 1 > prepared part key=_multipart_A1TIP3RXHBCZ.2~3P1S021SWMVL.1 size=1048576 2024-09-12T17:18:15.255 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.255+0000 7f574d1ea780 1 > prepared part key=_multipart_A1TIP3RXHBCZ.2~3P1S021SWMVL.2 size=182370 2024-09-12T17:18:15.255 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.255+0000 7f574d1ea780 1 > prepared multipart upload key=A1TIP3RXHBCZ upload=3P1S021SWMVL tag=XUINX8OWUC1P type=write size=3328098 2024-09-12T17:18:15.257 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.256+0000 7f574d1ea780 1 < completed write operation key=55JI541K1WP2 tag=88WSXPIT7E3P type=write size=146318 2024-09-12T17:18:15.258 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.257+0000 7f574d1ea780 1 > prepared operation key=43GV2N9VBBKE tag=SVHHL3HURHYU type=del size=711546 2024-09-12T17:18:15.259 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.258+0000 7f574d1ea780 1 < completed part key=_multipart_54LQ91UMBJAN.2~ZO44BNAOJQRT.0 size=1048576 2024-09-12T17:18:15.260 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.259+0000 7f574d1ea780 1 < completed part key=_multipart_54LQ91UMBJAN.2~ZO44BNAOJQRT.1 size=667080 2024-09-12T17:18:15.262 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.261+0000 7f574d1ea780 1 < completed multipart upload key=54LQ91UMBJAN upload=ZO44BNAOJQRT tag=YZZPI801XIFD type=write size=2764232 2024-09-12T17:18:15.264 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.264+0000 7f574d1ea780 1 > prepared part key=_multipart_ZGH8XC39FGTC.2~Z0F3QO2QKEYY.0 size=904422 2024-09-12T17:18:15.265 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.264+0000 7f574d1ea780 1 > prepared multipart upload key=ZGH8XC39FGTC upload=Z0F3QO2QKEYY tag=5NHANQJEU99G type=write size=1952998 2024-09-12T17:18:15.266 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.265+0000 7f574d1ea780 1 < completed part key=_multipart_D1GEG3MKPOM3.2~NRD2V8IGK6FJ.0 size=1048576 2024-09-12T17:18:15.267 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.266+0000 7f574d1ea780 1 < completed part key=_multipart_D1GEG3MKPOM3.2~NRD2V8IGK6FJ.1 size=1048576 2024-09-12T17:18:15.268 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.267+0000 7f574d1ea780 1 < completed part key=_multipart_D1GEG3MKPOM3.2~NRD2V8IGK6FJ.2 size=80413 2024-09-12T17:18:15.270 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.269+0000 7f574d1ea780 1 < completed multipart upload key=D1GEG3MKPOM3 upload=NRD2V8IGK6FJ tag=PYR6RH3PUPVD type=write size=3226141 2024-09-12T17:18:15.271 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.270+0000 7f574d1ea780 1 > prepared operation key=DH02JGZP64MN tag=KYK3KNQYEFKK type=del size=1036123 2024-09-12T17:18:15.273 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.272+0000 7f574d1ea780 1 < completed delete operation key=54CM8800AT9V tag=AIIBY680MG9W type=del 2024-09-12T17:18:15.274 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.273+0000 7f574d1ea780 1 > prepared operation key=HGZMN894YYC0 tag=IUYK3UKR3DXX type=del size=3480973 2024-09-12T17:18:15.275 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.274+0000 7f574d1ea780 1 < completed part key=_multipart_54CM8800AT9V.2~1EASFBDLCJBV.0 size=1048576 2024-09-12T17:18:15.275 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.274+0000 7f574d1ea780 1 < canceled part key=_multipart_54CM8800AT9V.2~1EASFBDLCJBV.1 size=1048576 2024-09-12T17:18:15.276 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.275+0000 7f574d1ea780 1 < completed part key=_multipart_54CM8800AT9V.2~1EASFBDLCJBV.2 size=921322 2024-09-12T17:18:15.278 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.278+0000 7f574d1ea780 1 < canceled multipart upload key=54CM8800AT9V upload=1EASFBDLCJBV tag=U8LKZGNL4ABB type=write size=4067050 2024-09-12T17:18:15.280 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.279+0000 7f574d1ea780 1 > prepared operation key=ZGE1860DMGHA tag=RJF38TWFA532 type=del size=2849388 2024-09-12T17:18:15.281 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.280+0000 7f574d1ea780 1 < completed delete operation key=UTCKL1F42X8A tag=31712Z0GPAL9 type=del 2024-09-12T17:18:15.283 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.282+0000 7f574d1ea780 1 > prepared part key=_multipart_K12MVG618809.2~WS8883643EKB.0 size=1048576 2024-09-12T17:18:15.285 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.283+0000 7f574d1ea780 1 > prepared part key=_multipart_K12MVG618809.2~WS8883643EKB.1 size=510680 2024-09-12T17:18:15.285 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.283+0000 7f574d1ea780 1 > prepared multipart upload key=K12MVG618809 upload=WS8883643EKB tag=Y7CEMNQ6IHYY type=write size=2607832 2024-09-12T17:18:15.286 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.285+0000 7f574d1ea780 1 < completed part key=_multipart_QXD8UG2K4STQ.2~WDWE2A8Q5OKR.0 size=1048576 2024-09-12T17:18:15.286 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.285+0000 7f574d1ea780 1 < canceled part key=_multipart_QXD8UG2K4STQ.2~WDWE2A8Q5OKR.1 size=1048576 2024-09-12T17:18:15.286 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.285+0000 7f574d1ea780 1 < canceled part key=_multipart_QXD8UG2K4STQ.2~WDWE2A8Q5OKR.2 size=381102 2024-09-12T17:18:15.288 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.287+0000 7f574d1ea780 1 < canceled multipart upload key=QXD8UG2K4STQ upload=WDWE2A8Q5OKR tag=D7SKXGX52SDD type=write size=3526830 2024-09-12T17:18:15.289 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.288+0000 7f574d1ea780 1 > prepared operation key=55V137SY4E4P tag=CBJIT3WZTCV0 type=del size=3113043 2024-09-12T17:18:15.290 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.289+0000 7f574d1ea780 1 < completed write operation key=ZGH8XC39FGTC tag=V78KVLRL9MXS type=write size=239595 2024-09-12T17:18:15.292 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.292+0000 7f574d1ea780 1 > prepared part key=_multipart_RNI86YYLADT0.2~LLCYKUEBAJVT.0 size=1048576 2024-09-12T17:18:15.293 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.293+0000 7f574d1ea780 1 > prepared part key=_multipart_RNI86YYLADT0.2~LLCYKUEBAJVT.1 size=1048576 2024-09-12T17:18:15.294 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.294+0000 7f574d1ea780 1 > prepared part key=_multipart_RNI86YYLADT0.2~LLCYKUEBAJVT.2 size=345274 2024-09-12T17:18:15.294 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.294+0000 7f574d1ea780 1 > prepared multipart upload key=RNI86YYLADT0 upload=LLCYKUEBAJVT tag=00S7WO1P122O type=write size=3491002 2024-09-12T17:18:15.296 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.295+0000 7f574d1ea780 1 < completed delete operation key=U6E9A5OH4GUW tag=FMQCS3JQS4XG type=del 2024-09-12T17:18:15.297 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.296+0000 7f574d1ea780 1 > prepared operation key=ENFNIFHQ3SHW tag=5T2UY8VZDV7J type=del size=971650 2024-09-12T17:18:15.298 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.297+0000 7f574d1ea780 1 < completed delete operation key=54CM8800AT9V tag=W4IH7ZI3NIY0 type=del 2024-09-12T17:18:15.299 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.299+0000 7f574d1ea780 1 > prepared operation key=VWWA5IB0L4N1 tag=RGUCF1SO2XTY type=del size=1534784 2024-09-12T17:18:15.300 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.299+0000 7f574d1ea780 1 < canceled part key=_multipart_YXIDO0U18839.2~35KBNVATZ65S.0 size=1048576 2024-09-12T17:18:15.302 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.301+0000 7f574d1ea780 1 < completed part key=_multipart_YXIDO0U18839.2~35KBNVATZ65S.1 size=1048576 2024-09-12T17:18:15.302 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.301+0000 7f574d1ea780 1 < canceled part key=_multipart_YXIDO0U18839.2~35KBNVATZ65S.2 size=207432 2024-09-12T17:18:15.305 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.304+0000 7f574d1ea780 1 < canceled multipart upload key=YXIDO0U18839 upload=35KBNVATZ65S tag=NBJT84MCCATC type=write size=3353160 2024-09-12T17:18:15.306 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.305+0000 7f574d1ea780 1 > prepared operation key=R00F69ON5P6Z tag=714G7BW2S0JE type=del size=2081669 2024-09-12T17:18:15.308 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.307+0000 7f574d1ea780 1 < suggested update operation key=UTCKL1F42X8A tag=R3B1JSZ3P1JS type=del size=3987365 2024-09-12T17:18:15.310 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.309+0000 7f574d1ea780 1 > prepared operation key=A1TIP3RXHBCZ tag=OC92IJ4X9P0U type=del size=4070555 2024-09-12T17:18:15.313 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.312+0000 7f574d1ea780 1 < suggested remove operation key=ZGH8XC39FGTC tag=FITTGEGAYNK3 type=del 2024-09-12T17:18:15.315 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.314+0000 7f574d1ea780 1 > prepared part key=_multipart_U6E9A5OH4GUW.2~25417M4SBFCR.0 size=856312 2024-09-12T17:18:15.315 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.314+0000 7f574d1ea780 1 > prepared multipart upload key=U6E9A5OH4GUW upload=25417M4SBFCR tag=3MPSN7ILVSVF type=write size=1904888 2024-09-12T17:18:15.317 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.316+0000 7f574d1ea780 1 < suggested update operation key=A1TIP3RXHBCZ tag=MKLCXSXYJWXF type=del size=789149 2024-09-12T17:18:15.320 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.319+0000 7f574d1ea780 1 > prepared part key=_multipart_55JI541K1WP2.2~6NL9KXJQQVNS.0 size=1048576 2024-09-12T17:18:15.321 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.320+0000 7f574d1ea780 1 > prepared part key=_multipart_55JI541K1WP2.2~6NL9KXJQQVNS.1 size=1048576 2024-09-12T17:18:15.322 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.321+0000 7f574d1ea780 1 > prepared part key=_multipart_55JI541K1WP2.2~6NL9KXJQQVNS.2 size=487428 2024-09-12T17:18:15.322 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.321+0000 7f574d1ea780 1 > prepared multipart upload key=55JI541K1WP2 upload=6NL9KXJQQVNS tag=9L6ZAEFT7KO7 type=write size=3633156 2024-09-12T17:18:15.323 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.322+0000 7f574d1ea780 1 < completed part key=_multipart_TIKBUXFPVTN1.2~OMDBYN9JES62.0 size=1048576 2024-09-12T17:18:15.323 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.322+0000 7f574d1ea780 1 < canceled part key=_multipart_TIKBUXFPVTN1.2~OMDBYN9JES62.1 size=849924 2024-09-12T17:18:15.325 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.324+0000 7f574d1ea780 1 < canceled multipart upload key=TIKBUXFPVTN1 upload=OMDBYN9JES62 tag=1WAL1JFEO870 type=write size=2947076 2024-09-12T17:18:15.326 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.325+0000 7f574d1ea780 1 > prepared operation key=RWVWJHVZE95H tag=69ZJB7850SAQ type=del size=3719472 2024-09-12T17:18:15.327 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.327+0000 7f574d1ea780 1 < completed part key=_multipart_A1TIP3RXHBCZ.2~3P1S021SWMVL.0 size=1048576 2024-09-12T17:18:15.328 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.328+0000 7f574d1ea780 1 < completed part key=_multipart_A1TIP3RXHBCZ.2~3P1S021SWMVL.1 size=1048576 2024-09-12T17:18:15.329 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.329+0000 7f574d1ea780 1 < completed part key=_multipart_A1TIP3RXHBCZ.2~3P1S021SWMVL.2 size=182370 2024-09-12T17:18:15.332 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.331+0000 7f574d1ea780 1 < completed multipart upload key=A1TIP3RXHBCZ upload=3P1S021SWMVL tag=XUINX8OWUC1P type=write size=3328098 2024-09-12T17:18:15.333 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.332+0000 7f574d1ea780 1 > prepared operation key=R00F69ON5P6Z tag=I1I2MH25UGTO type=del size=2599877 2024-09-12T17:18:15.334 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.333+0000 7f574d1ea780 1 < completed delete operation key=43GV2N9VBBKE tag=SVHHL3HURHYU type=del 2024-09-12T17:18:15.336 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.335+0000 7f574d1ea780 1 > prepared part key=_multipart_R00F69ON5P6Z.2~U2LHCXOUD30X.0 size=1048576 2024-09-12T17:18:15.337 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.337+0000 7f574d1ea780 1 > prepared part key=_multipart_R00F69ON5P6Z.2~U2LHCXOUD30X.1 size=1048576 2024-09-12T17:18:15.338 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.338+0000 7f574d1ea780 1 > prepared part key=_multipart_R00F69ON5P6Z.2~U2LHCXOUD30X.2 size=767494 2024-09-12T17:18:15.339 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.338+0000 7f574d1ea780 1 > prepared multipart upload key=R00F69ON5P6Z upload=U2LHCXOUD30X tag=R3M7ZWD0XTNB type=write size=3913222 2024-09-12T17:18:15.339 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.338+0000 7f574d1ea780 1 < canceled part key=_multipart_ZGH8XC39FGTC.2~Z0F3QO2QKEYY.0 size=904422 2024-09-12T17:18:15.341 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.340+0000 7f574d1ea780 1 < canceled multipart upload key=ZGH8XC39FGTC upload=Z0F3QO2QKEYY tag=5NHANQJEU99G type=write size=1952998 2024-09-12T17:18:15.342 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.341+0000 7f574d1ea780 1 > prepared operation key=VWWA5IB0L4N1 tag=SD5037ELL5BG type=del size=3091920 2024-09-12T17:18:15.343 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.343+0000 7f574d1ea780 1 < completed delete operation key=DH02JGZP64MN tag=KYK3KNQYEFKK type=del 2024-09-12T17:18:15.345 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.345+0000 7f574d1ea780 1 > prepared part key=_multipart_ENFNIFHQ3SHW.2~9X5MIMCK4APZ.0 size=1048576 2024-09-12T17:18:15.347 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.346+0000 7f574d1ea780 1 > prepared part key=_multipart_ENFNIFHQ3SHW.2~9X5MIMCK4APZ.1 size=388318 2024-09-12T17:18:15.347 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.346+0000 7f574d1ea780 1 > prepared multipart upload key=ENFNIFHQ3SHW upload=9X5MIMCK4APZ tag=06JQVWWIF36D type=write size=2485470 2024-09-12T17:18:15.348 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.347+0000 7f574d1ea780 1 < canceled operation key=HGZMN894YYC0 tag=IUYK3UKR3DXX type=del size=3480973 2024-09-12T17:18:15.349 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.348+0000 7f574d1ea780 1 > prepared operation key=VWWA5IB0L4N1 tag=MUOPOH9Q7KK3 type=del size=3724 2024-09-12T17:18:15.350 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.350+0000 7f574d1ea780 1 < completed delete operation key=ZGE1860DMGHA tag=RJF38TWFA532 type=del 2024-09-12T17:18:15.352 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.351+0000 7f574d1ea780 1 > prepared operation key=C9IYR9CET1I8 tag=Q6I80HAN7VYJ type=write size=48072 2024-09-12T17:18:15.353 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.352+0000 7f574d1ea780 1 < completed part key=_multipart_K12MVG618809.2~WS8883643EKB.0 size=1048576 2024-09-12T17:18:15.353 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.352+0000 7f574d1ea780 1 < canceled part key=_multipart_K12MVG618809.2~WS8883643EKB.1 size=510680 2024-09-12T17:18:15.355 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.354+0000 7f574d1ea780 1 < canceled multipart upload key=K12MVG618809 upload=WS8883643EKB tag=Y7CEMNQ6IHYY type=write size=2607832 2024-09-12T17:18:15.356 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.355+0000 7f574d1ea780 1 > prepared operation key=YXIDO0U18839 tag=UMW1ZS5IUSTR type=del size=3483402 2024-09-12T17:18:15.357 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.357+0000 7f574d1ea780 1 < canceled operation key=55V137SY4E4P tag=CBJIT3WZTCV0 type=del size=3113043 2024-09-12T17:18:15.359 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.358+0000 7f574d1ea780 1 > prepared operation key=54CM8800AT9V tag=4Y37ZUGJ5W3R type=del size=4172402 2024-09-12T17:18:15.360 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.359+0000 7f574d1ea780 1 < completed part key=_multipart_RNI86YYLADT0.2~LLCYKUEBAJVT.0 size=1048576 2024-09-12T17:18:15.361 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.360+0000 7f574d1ea780 1 < completed part key=_multipart_RNI86YYLADT0.2~LLCYKUEBAJVT.1 size=1048576 2024-09-12T17:18:15.361 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.360+0000 7f574d1ea780 1 < canceled part key=_multipart_RNI86YYLADT0.2~LLCYKUEBAJVT.2 size=345274 2024-09-12T17:18:15.363 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.362+0000 7f574d1ea780 1 < canceled multipart upload key=RNI86YYLADT0 upload=LLCYKUEBAJVT tag=00S7WO1P122O type=write size=3491002 2024-09-12T17:18:15.365 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.364+0000 7f574d1ea780 1 > prepared part key=_multipart_RWVWJHVZE95H.2~WAAQGT1LOCVA.0 size=1048576 2024-09-12T17:18:15.366 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.365+0000 7f574d1ea780 1 > prepared part key=_multipart_RWVWJHVZE95H.2~WAAQGT1LOCVA.1 size=1048576 2024-09-12T17:18:15.367 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.366+0000 7f574d1ea780 1 > prepared part key=_multipart_RWVWJHVZE95H.2~WAAQGT1LOCVA.2 size=755371 2024-09-12T17:18:15.367 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.366+0000 7f574d1ea780 1 > prepared multipart upload key=RWVWJHVZE95H upload=WAAQGT1LOCVA tag=BMA8T1YAJYTZ type=write size=3901099 2024-09-12T17:18:15.368 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.367+0000 7f574d1ea780 1 < completed delete operation key=ENFNIFHQ3SHW tag=5T2UY8VZDV7J type=del 2024-09-12T17:18:15.369 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.368+0000 7f574d1ea780 1 > prepared operation key=54LQ91UMBJAN tag=XFXP8X19O28K type=del size=2098165 2024-09-12T17:18:15.372 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.371+0000 7f574d1ea780 1 < suggested update operation key=VWWA5IB0L4N1 tag=RGUCF1SO2XTY type=del size=1534784 2024-09-12T17:18:15.373 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.372+0000 7f574d1ea780 1 > prepared operation key=UTCKL1F42X8A tag=LMIMMLNJL5NN type=write size=1006534 2024-09-12T17:18:15.374 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.373+0000 7f574d1ea780 1 < completed delete operation key=R00F69ON5P6Z tag=714G7BW2S0JE type=del 2024-09-12T17:18:15.376 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.376+0000 7f574d1ea780 1 > prepared part key=_multipart_ZGE1860DMGHA.2~PE2RV23WKA0A.0 size=718976 2024-09-12T17:18:15.376 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.376+0000 7f574d1ea780 1 > prepared multipart upload key=ZGE1860DMGHA upload=PE2RV23WKA0A tag=Q6ARIXGFMZ8N type=write size=1767552 2024-09-12T17:18:15.377 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.377+0000 7f574d1ea780 -1 < failed to complete operation key=A1TIP3RXHBCZ tag=OC92IJ4X9P0U type=del size=4070555: (22) Invalid argument 2024-09-12T17:18:15.379 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.378+0000 7f574d1ea780 1 > prepared operation key=VWWA5IB0L4N1 tag=VQ5QN3N7OPOL type=del size=319920 2024-09-12T17:18:15.380 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.379+0000 7f574d1ea780 1 < completed part key=_multipart_U6E9A5OH4GUW.2~25417M4SBFCR.0 size=856312 2024-09-12T17:18:15.382 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.381+0000 7f574d1ea780 1 < completed multipart upload key=U6E9A5OH4GUW upload=25417M4SBFCR tag=3MPSN7ILVSVF type=write size=1904888 2024-09-12T17:18:15.383 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.383+0000 7f574d1ea780 1 > prepared operation key=TIKBUXFPVTN1 tag=C31V2KEU33UX type=del size=1387721 2024-09-12T17:18:15.385 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.384+0000 7f574d1ea780 1 < completed part key=_multipart_55JI541K1WP2.2~6NL9KXJQQVNS.0 size=1048576 2024-09-12T17:18:15.386 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.385+0000 7f574d1ea780 1 < completed part key=_multipart_55JI541K1WP2.2~6NL9KXJQQVNS.1 size=1048576 2024-09-12T17:18:15.387 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.386+0000 7f574d1ea780 1 < completed part key=_multipart_55JI541K1WP2.2~6NL9KXJQQVNS.2 size=487428 2024-09-12T17:18:15.389 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.388+0000 7f574d1ea780 1 < completed multipart upload key=55JI541K1WP2 upload=6NL9KXJQQVNS tag=9L6ZAEFT7KO7 type=write size=3633156 2024-09-12T17:18:15.391 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.390+0000 7f574d1ea780 1 > prepared part key=_multipart_GEGOEB05R0PK.2~4ZMK0WVNE21V.0 size=1048576 2024-09-12T17:18:15.392 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.391+0000 7f574d1ea780 1 > prepared part key=_multipart_GEGOEB05R0PK.2~4ZMK0WVNE21V.1 size=376370 2024-09-12T17:18:15.392 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.391+0000 7f574d1ea780 1 > prepared multipart upload key=GEGOEB05R0PK upload=4ZMK0WVNE21V tag=RXQ81NU36X8C type=write size=2473522 2024-09-12T17:18:15.395 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.394+0000 7f574d1ea780 1 < suggested remove operation key=RWVWJHVZE95H tag=69ZJB7850SAQ type=del 2024-09-12T17:18:15.396 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.396+0000 7f574d1ea780 1 > prepared operation key=8VW3XCUHLF2L tag=II828NO0R3W1 type=del size=2988818 2024-09-12T17:18:15.399 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.398+0000 7f574d1ea780 1 < suggested update operation key=R00F69ON5P6Z tag=I1I2MH25UGTO type=del size=2599877 2024-09-12T17:18:15.401 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.400+0000 7f574d1ea780 1 > prepared part key=_multipart_K12MVG618809.2~FKX47RK7VGJD.0 size=1048576 2024-09-12T17:18:15.402 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.401+0000 7f574d1ea780 1 > prepared part key=_multipart_K12MVG618809.2~FKX47RK7VGJD.1 size=872471 2024-09-12T17:18:15.402 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.401+0000 7f574d1ea780 1 > prepared multipart upload key=K12MVG618809 upload=FKX47RK7VGJD tag=9Y1R6NHZFBR8 type=write size=2969623 2024-09-12T17:18:15.403 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.402+0000 7f574d1ea780 1 < completed part key=_multipart_R00F69ON5P6Z.2~U2LHCXOUD30X.0 size=1048576 2024-09-12T17:18:15.404 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.403+0000 7f574d1ea780 1 < completed part key=_multipart_R00F69ON5P6Z.2~U2LHCXOUD30X.1 size=1048576 2024-09-12T17:18:15.405 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.404+0000 7f574d1ea780 1 < completed part key=_multipart_R00F69ON5P6Z.2~U2LHCXOUD30X.2 size=767494 2024-09-12T17:18:15.407 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.407+0000 7f574d1ea780 1 < completed multipart upload key=R00F69ON5P6Z upload=U2LHCXOUD30X tag=R3M7ZWD0XTNB type=write size=3913222 2024-09-12T17:18:15.409 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.408+0000 7f574d1ea780 1 > prepared operation key=R00F69ON5P6Z tag=QAG86DYT3BB8 type=del size=1753476 2024-09-12T17:18:15.410 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.409+0000 7f574d1ea780 -1 < failed to complete operation key=VWWA5IB0L4N1 tag=SD5037ELL5BG type=del size=3091920: (22) Invalid argument 2024-09-12T17:18:15.413 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.412+0000 7f574d1ea780 1 > prepared part key=_multipart_54CM8800AT9V.2~46GWUVYGOBMM.0 size=1046229 2024-09-12T17:18:15.413 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.412+0000 7f574d1ea780 1 > prepared multipart upload key=54CM8800AT9V upload=46GWUVYGOBMM tag=44A64S76OBZC type=write size=2094805 2024-09-12T17:18:15.414 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.413+0000 7f574d1ea780 1 < completed part key=_multipart_ENFNIFHQ3SHW.2~9X5MIMCK4APZ.0 size=1048576 2024-09-12T17:18:15.415 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.414+0000 7f574d1ea780 1 < completed part key=_multipart_ENFNIFHQ3SHW.2~9X5MIMCK4APZ.1 size=388318 2024-09-12T17:18:15.417 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.416+0000 7f574d1ea780 1 < completed multipart upload key=ENFNIFHQ3SHW upload=9X5MIMCK4APZ tag=06JQVWWIF36D type=write size=2485470 2024-09-12T17:18:15.420 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.419+0000 7f574d1ea780 1 > prepared operation key=A1TIP3RXHBCZ tag=UX9FC3WMXH5V type=del size=1372940 2024-09-12T17:18:15.421 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.420+0000 7f574d1ea780 -1 < failed to complete operation key=VWWA5IB0L4N1 tag=MUOPOH9Q7KK3 type=del size=3724: (22) Invalid argument 2024-09-12T17:18:15.422 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.421+0000 7f574d1ea780 1 > prepared operation key=HGZMN894YYC0 tag=DL0UROFHRLZ6 type=del size=476154 2024-09-12T17:18:15.425 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.424+0000 7f574d1ea780 1 < suggested remove operation key=C9IYR9CET1I8 tag=Q6I80HAN7VYJ type=write 2024-09-12T17:18:15.426 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.425+0000 7f574d1ea780 1 > prepared operation key=54LQ91UMBJAN tag=OBCNHMMDE2D9 type=del size=2137742 2024-09-12T17:18:15.429 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.428+0000 7f574d1ea780 1 < completed delete operation key=YXIDO0U18839 tag=UMW1ZS5IUSTR type=del 2024-09-12T17:18:15.431 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.430+0000 7f574d1ea780 1 > prepared part key=_multipart_UTCKL1F42X8A.2~3U4QL6WYPD5V.0 size=1048576 2024-09-12T17:18:15.432 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.431+0000 7f574d1ea780 1 > prepared part key=_multipart_UTCKL1F42X8A.2~3U4QL6WYPD5V.1 size=285463 2024-09-12T17:18:15.432 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.431+0000 7f574d1ea780 1 > prepared multipart upload key=UTCKL1F42X8A upload=3U4QL6WYPD5V tag=MH7FXF6NDMKM type=write size=2382615 2024-09-12T17:18:15.433 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.432+0000 7f574d1ea780 1 < completed delete operation key=54CM8800AT9V tag=4Y37ZUGJ5W3R type=del 2024-09-12T17:18:15.434 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.434+0000 7f574d1ea780 1 > prepared operation key=TIKBUXFPVTN1 tag=O65F1MTOVYUL type=del size=3906414 2024-09-12T17:18:15.436 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.435+0000 7f574d1ea780 1 < completed part key=_multipart_RWVWJHVZE95H.2~WAAQGT1LOCVA.0 size=1048576 2024-09-12T17:18:15.437 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.436+0000 7f574d1ea780 1 < completed part key=_multipart_RWVWJHVZE95H.2~WAAQGT1LOCVA.1 size=1048576 2024-09-12T17:18:15.438 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.437+0000 7f574d1ea780 1 < completed part key=_multipart_RWVWJHVZE95H.2~WAAQGT1LOCVA.2 size=755371 2024-09-12T17:18:15.440 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.439+0000 7f574d1ea780 1 < completed multipart upload key=RWVWJHVZE95H upload=WAAQGT1LOCVA tag=BMA8T1YAJYTZ type=write size=3901099 2024-09-12T17:18:15.441 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.440+0000 7f574d1ea780 1 > prepared operation key=GEGOEB05R0PK tag=58U6K5S1K98U type=del size=4031719 2024-09-12T17:18:15.442 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.441+0000 7f574d1ea780 1 < completed delete operation key=54LQ91UMBJAN tag=XFXP8X19O28K type=del 2024-09-12T17:18:15.443 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.443+0000 7f574d1ea780 1 > prepared operation key=R00F69ON5P6Z tag=KM8GOYTFEC22 type=write size=657894 2024-09-12T17:18:15.445 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.444+0000 7f574d1ea780 1 < canceled operation key=UTCKL1F42X8A tag=LMIMMLNJL5NN type=write size=1006534 2024-09-12T17:18:15.447 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.447+0000 7f574d1ea780 1 > prepared part key=_multipart_54LQ91UMBJAN.2~ITMZ8WB6IWD4.0 size=1048576 2024-09-12T17:18:15.449 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.448+0000 7f574d1ea780 1 > prepared part key=_multipart_54LQ91UMBJAN.2~ITMZ8WB6IWD4.1 size=1048576 2024-09-12T17:18:15.450 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.449+0000 7f574d1ea780 1 > prepared part key=_multipart_54LQ91UMBJAN.2~ITMZ8WB6IWD4.2 size=54102 2024-09-12T17:18:15.450 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.449+0000 7f574d1ea780 1 > prepared multipart upload key=54LQ91UMBJAN upload=ITMZ8WB6IWD4 tag=J6ONU4GT89LA type=write size=3199830 2024-09-12T17:18:15.451 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.450+0000 7f574d1ea780 1 < completed part key=_multipart_ZGE1860DMGHA.2~PE2RV23WKA0A.0 size=718976 2024-09-12T17:18:15.453 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.453+0000 7f574d1ea780 1 < completed multipart upload key=ZGE1860DMGHA upload=PE2RV23WKA0A tag=Q6ARIXGFMZ8N type=write size=1767552 2024-09-12T17:18:15.455 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.454+0000 7f574d1ea780 1 > prepared operation key=A1TIP3RXHBCZ tag=X1LGQYYCOMQ3 type=del size=986933 2024-09-12T17:18:15.456 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.455+0000 7f574d1ea780 1 < canceled operation key=VWWA5IB0L4N1 tag=VQ5QN3N7OPOL type=del size=319920 2024-09-12T17:18:15.457 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.456+0000 7f574d1ea780 1 > prepared operation key=ENFNIFHQ3SHW tag=960CS5O9G51W type=write size=597703 2024-09-12T17:18:15.458 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.458+0000 7f574d1ea780 1 < completed delete operation key=TIKBUXFPVTN1 tag=C31V2KEU33UX type=del 2024-09-12T17:18:15.461 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.460+0000 7f574d1ea780 1 > prepared part key=_multipart_RWVWJHVZE95H.2~KI40FH03WJWI.0 size=1048576 2024-09-12T17:18:15.462 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.461+0000 7f574d1ea780 1 > prepared part key=_multipart_RWVWJHVZE95H.2~KI40FH03WJWI.1 size=1048576 2024-09-12T17:18:15.463 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.462+0000 7f574d1ea780 1 > prepared part key=_multipart_RWVWJHVZE95H.2~KI40FH03WJWI.2 size=537033 2024-09-12T17:18:15.463 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.462+0000 7f574d1ea780 1 > prepared multipart upload key=RWVWJHVZE95H upload=KI40FH03WJWI tag=8ORBBDG31OQ4 type=write size=3682761 2024-09-12T17:18:15.464 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.463+0000 7f574d1ea780 1 < completed part key=_multipart_GEGOEB05R0PK.2~4ZMK0WVNE21V.0 size=1048576 2024-09-12T17:18:15.465 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.464+0000 7f574d1ea780 1 < completed part key=_multipart_GEGOEB05R0PK.2~4ZMK0WVNE21V.1 size=376370 2024-09-12T17:18:15.467 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.466+0000 7f574d1ea780 1 < completed multipart upload key=GEGOEB05R0PK upload=4ZMK0WVNE21V tag=RXQ81NU36X8C type=write size=2473522 2024-09-12T17:18:15.470 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.469+0000 7f574d1ea780 1 > prepared part key=_multipart_ZGH8XC39FGTC.2~9J75NTT71K39.0 size=619014 2024-09-12T17:18:15.470 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.469+0000 7f574d1ea780 1 > prepared multipart upload key=ZGH8XC39FGTC upload=9J75NTT71K39 tag=52JDHZEA8RCR type=write size=1667590 2024-09-12T17:18:15.472 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.472+0000 7f574d1ea780 1 < suggested update operation key=8VW3XCUHLF2L tag=II828NO0R3W1 type=del size=2988818 2024-09-12T17:18:15.474 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.473+0000 7f574d1ea780 1 > prepared operation key=C9IYR9CET1I8 tag=QQKZRL5GNHLW type=del size=1256521 2024-09-12T17:18:15.475 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.474+0000 7f574d1ea780 1 < completed part key=_multipart_K12MVG618809.2~FKX47RK7VGJD.0 size=1048576 2024-09-12T17:18:15.476 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.475+0000 7f574d1ea780 1 < completed part key=_multipart_K12MVG618809.2~FKX47RK7VGJD.1 size=872471 2024-09-12T17:18:15.478 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.477+0000 7f574d1ea780 1 < completed multipart upload key=K12MVG618809 upload=FKX47RK7VGJD tag=9Y1R6NHZFBR8 type=write size=2969623 2024-09-12T17:18:15.479 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.478+0000 7f574d1ea780 1 > prepared operation key=UFKM4I8RMT0W tag=QDSICXZADDHC type=del size=2542969 2024-09-12T17:18:15.480 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.480+0000 7f574d1ea780 1 < canceled operation key=R00F69ON5P6Z tag=QAG86DYT3BB8 type=del size=1753476 2024-09-12T17:18:15.482 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.481+0000 7f574d1ea780 1 > prepared operation key=55JI541K1WP2 tag=5A71TZY06N2Y type=del size=937780 2024-09-12T17:18:15.483 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.482+0000 7f574d1ea780 1 < completed part key=_multipart_54CM8800AT9V.2~46GWUVYGOBMM.0 size=1046229 2024-09-12T17:18:15.485 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.484+0000 7f574d1ea780 1 < completed multipart upload key=54CM8800AT9V upload=46GWUVYGOBMM tag=44A64S76OBZC type=write size=2094805 2024-09-12T17:18:15.487 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.486+0000 7f574d1ea780 1 > prepared operation key=D1GEG3MKPOM3 tag=GTOEVXY2BI35 type=write size=705981 2024-09-12T17:18:15.488 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.487+0000 7f574d1ea780 1 < completed delete operation key=A1TIP3RXHBCZ tag=UX9FC3WMXH5V type=del 2024-09-12T17:18:15.489 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.488+0000 7f574d1ea780 1 > prepared operation key=SQQMJ61CA0QW tag=ZOBRZE68VIFU type=write size=1045642 2024-09-12T17:18:15.490 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.490+0000 7f574d1ea780 1 < completed delete operation key=HGZMN894YYC0 tag=DL0UROFHRLZ6 type=del 2024-09-12T17:18:15.492 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.491+0000 7f574d1ea780 1 > prepared operation key=UTCKL1F42X8A tag=HE3IDZAFBVT5 type=del size=2505231 2024-09-12T17:18:15.494 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.493+0000 7f574d1ea780 1 < suggested update operation key=54LQ91UMBJAN tag=OBCNHMMDE2D9 type=del size=2137742 2024-09-12T17:18:15.495 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.494+0000 7f574d1ea780 1 > prepared operation key=54LQ91UMBJAN tag=MPD4Q2EO5XJN type=write size=991779 2024-09-12T17:18:15.496 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.496+0000 7f574d1ea780 1 < completed part key=_multipart_UTCKL1F42X8A.2~3U4QL6WYPD5V.0 size=1048576 2024-09-12T17:18:15.497 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.497+0000 7f574d1ea780 1 < completed part key=_multipart_UTCKL1F42X8A.2~3U4QL6WYPD5V.1 size=285463 2024-09-12T17:18:15.500 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.499+0000 7f574d1ea780 1 < completed multipart upload key=UTCKL1F42X8A upload=3U4QL6WYPD5V tag=MH7FXF6NDMKM type=write size=2382615 2024-09-12T17:18:15.502 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.501+0000 7f574d1ea780 1 > prepared part key=_multipart_U6E9A5OH4GUW.2~IZ0FDXFI9U9Y.0 size=1048576 2024-09-12T17:18:15.503 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.502+0000 7f574d1ea780 1 > prepared part key=_multipart_U6E9A5OH4GUW.2~IZ0FDXFI9U9Y.1 size=1048576 2024-09-12T17:18:15.504 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.503+0000 7f574d1ea780 1 > prepared part key=_multipart_U6E9A5OH4GUW.2~IZ0FDXFI9U9Y.2 size=252401 2024-09-12T17:18:15.504 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.503+0000 7f574d1ea780 1 > prepared multipart upload key=U6E9A5OH4GUW upload=IZ0FDXFI9U9Y tag=05V7OTYYPVNQ type=write size=3398129 2024-09-12T17:18:15.505 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.504+0000 7f574d1ea780 1 < canceled operation key=TIKBUXFPVTN1 tag=O65F1MTOVYUL type=del size=3906414 2024-09-12T17:18:15.507 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.507+0000 7f574d1ea780 1 > prepared part key=_multipart_R00F69ON5P6Z.2~D9PH274FIV6I.0 size=1048576 2024-09-12T17:18:15.509 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.508+0000 7f574d1ea780 1 > prepared part key=_multipart_R00F69ON5P6Z.2~D9PH274FIV6I.1 size=1048576 2024-09-12T17:18:15.509 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.509+0000 7f574d1ea780 1 > prepared part key=_multipart_R00F69ON5P6Z.2~D9PH274FIV6I.2 size=79773 2024-09-12T17:18:15.510 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.509+0000 7f574d1ea780 1 > prepared multipart upload key=R00F69ON5P6Z upload=D9PH274FIV6I tag=ZHZ0FHH5OR9F type=write size=3225501 2024-09-12T17:18:15.511 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.510+0000 7f574d1ea780 1 < completed delete operation key=GEGOEB05R0PK tag=58U6K5S1K98U type=del 2024-09-12T17:18:15.512 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.512+0000 7f574d1ea780 1 > prepared operation key=HGZMN894YYC0 tag=MXJWSX18KTOK type=write size=267733 2024-09-12T17:18:15.514 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.513+0000 7f574d1ea780 1 < completed write operation key=R00F69ON5P6Z tag=KM8GOYTFEC22 type=write size=657894 2024-09-12T17:18:15.515 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.514+0000 7f574d1ea780 1 > prepared operation key=HFWA7DNUMWF2 tag=9BMR2DZPKAZ9 type=del size=520902 2024-09-12T17:18:15.516 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.516+0000 7f574d1ea780 1 < completed part key=_multipart_54LQ91UMBJAN.2~ITMZ8WB6IWD4.0 size=1048576 2024-09-12T17:18:15.517 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.516+0000 7f574d1ea780 1 < canceled part key=_multipart_54LQ91UMBJAN.2~ITMZ8WB6IWD4.1 size=1048576 2024-09-12T17:18:15.517 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.517+0000 7f574d1ea780 1 < completed part key=_multipart_54LQ91UMBJAN.2~ITMZ8WB6IWD4.2 size=54102 2024-09-12T17:18:15.519 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.519+0000 7f574d1ea780 1 < canceled multipart upload key=54LQ91UMBJAN upload=ITMZ8WB6IWD4 tag=J6ONU4GT89LA type=write size=3199830 2024-09-12T17:18:15.521 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.520+0000 7f574d1ea780 1 > prepared operation key=Q2Q3B1J3DAVD tag=Q6CL9ND5CKZ3 type=del size=1692482 2024-09-12T17:18:15.522 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.521+0000 7f574d1ea780 1 < completed delete operation key=A1TIP3RXHBCZ tag=X1LGQYYCOMQ3 type=del 2024-09-12T17:18:15.524 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.523+0000 7f574d1ea780 1 > prepared part key=_multipart_RWVWJHVZE95H.2~DCDQRRWMN1FW.0 size=1048576 2024-09-12T17:18:15.525 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.524+0000 7f574d1ea780 1 > prepared part key=_multipart_RWVWJHVZE95H.2~DCDQRRWMN1FW.1 size=47551 2024-09-12T17:18:15.525 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.524+0000 7f574d1ea780 1 > prepared multipart upload key=RWVWJHVZE95H upload=DCDQRRWMN1FW tag=OPQ6AOT1KQD8 type=write size=2144703 2024-09-12T17:18:15.528 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.527+0000 7f574d1ea780 1 < suggested remove operation key=ENFNIFHQ3SHW tag=960CS5O9G51W type=write 2024-09-12T17:18:15.530 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.529+0000 7f574d1ea780 1 > prepared part key=_multipart_54CM8800AT9V.2~CDTQIGFFNBML.0 size=1048576 2024-09-12T17:18:15.531 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.531+0000 7f574d1ea780 1 > prepared part key=_multipart_54CM8800AT9V.2~CDTQIGFFNBML.1 size=1048576 2024-09-12T17:18:15.532 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.532+0000 7f574d1ea780 1 > prepared part key=_multipart_54CM8800AT9V.2~CDTQIGFFNBML.2 size=122755 2024-09-12T17:18:15.533 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.532+0000 7f574d1ea780 1 > prepared multipart upload key=54CM8800AT9V upload=CDTQIGFFNBML tag=B2AGWGJJN0PZ type=write size=3268483 2024-09-12T17:18:15.534 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.533+0000 7f574d1ea780 1 < completed part key=_multipart_RWVWJHVZE95H.2~KI40FH03WJWI.0 size=1048576 2024-09-12T17:18:15.535 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.534+0000 7f574d1ea780 1 < completed part key=_multipart_RWVWJHVZE95H.2~KI40FH03WJWI.1 size=1048576 2024-09-12T17:18:15.535 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.534+0000 7f574d1ea780 1 < canceled part key=_multipart_RWVWJHVZE95H.2~KI40FH03WJWI.2 size=537033 2024-09-12T17:18:15.537 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.537+0000 7f574d1ea780 1 < canceled multipart upload key=RWVWJHVZE95H upload=KI40FH03WJWI tag=8ORBBDG31OQ4 type=write size=3682761 2024-09-12T17:18:15.539 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.538+0000 7f574d1ea780 1 > prepared operation key=Q2Q3B1J3DAVD tag=ZPJOUTUU28D7 type=write size=922917 2024-09-12T17:18:15.541 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.541+0000 7f574d1ea780 1 < completed part key=_multipart_ZGH8XC39FGTC.2~9J75NTT71K39.0 size=619014 2024-09-12T17:18:15.544 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.543+0000 7f574d1ea780 1 < completed multipart upload key=ZGH8XC39FGTC upload=9J75NTT71K39 tag=52JDHZEA8RCR type=write size=1667590 2024-09-12T17:18:15.545 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.545+0000 7f574d1ea780 1 > prepared operation key=TIKBUXFPVTN1 tag=V90HFMXC79DZ type=write size=521884 2024-09-12T17:18:15.548 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.547+0000 7f574d1ea780 1 < suggested update operation key=C9IYR9CET1I8 tag=QQKZRL5GNHLW type=del size=1256521 2024-09-12T17:18:15.549 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.548+0000 7f574d1ea780 1 > prepared operation key=8VW3XCUHLF2L tag=TFFDXZO2L11I type=del size=827462 2024-09-12T17:18:15.551 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.550+0000 7f574d1ea780 1 < suggested remove operation key=UFKM4I8RMT0W tag=QDSICXZADDHC type=del 2024-09-12T17:18:15.552 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.552+0000 7f574d1ea780 1 > prepared operation key=8SG7DJO4HWPI tag=GQDD2YWZZBWK type=del size=3783612 2024-09-12T17:18:15.554 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.553+0000 7f574d1ea780 1 < completed delete operation key=55JI541K1WP2 tag=5A71TZY06N2Y type=del 2024-09-12T17:18:15.556 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.555+0000 7f574d1ea780 1 > prepared part key=_multipart_GEGOEB05R0PK.2~QS7DRJSIBTLZ.0 size=1048576 2024-09-12T17:18:15.557 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.556+0000 7f574d1ea780 1 > prepared part key=_multipart_GEGOEB05R0PK.2~QS7DRJSIBTLZ.1 size=1048576 2024-09-12T17:18:15.558 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.557+0000 7f574d1ea780 1 > prepared part key=_multipart_GEGOEB05R0PK.2~QS7DRJSIBTLZ.2 size=928576 2024-09-12T17:18:15.558 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.557+0000 7f574d1ea780 1 > prepared multipart upload key=GEGOEB05R0PK upload=QS7DRJSIBTLZ tag=IIBTTBYW1TZK type=write size=4074304 2024-09-12T17:18:15.560 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.559+0000 7f574d1ea780 1 < suggested remove operation key=D1GEG3MKPOM3 tag=GTOEVXY2BI35 type=write 2024-09-12T17:18:15.561 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.560+0000 7f574d1ea780 1 > prepared operation key=UTCKL1F42X8A tag=VNT8OTOXL6LA type=del size=3881285 2024-09-12T17:18:15.563 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.562+0000 7f574d1ea780 1 < completed write operation key=SQQMJ61CA0QW tag=ZOBRZE68VIFU type=write size=1045642 2024-09-12T17:18:15.564 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.563+0000 7f574d1ea780 1 > prepared operation key=8VW3XCUHLF2L tag=NLWZ4M8AGT7L type=del size=2672641 2024-09-12T17:18:15.565 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.564+0000 7f574d1ea780 1 < completed delete operation key=UTCKL1F42X8A tag=HE3IDZAFBVT5 type=del 2024-09-12T17:18:15.568 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.567+0000 7f574d1ea780 1 > prepared operation key=55JI541K1WP2 tag=GPYXULOVY9R1 type=del size=1939065 2024-09-12T17:18:15.569 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.568+0000 7f574d1ea780 1 < completed write operation key=54LQ91UMBJAN tag=MPD4Q2EO5XJN type=write size=991779 2024-09-12T17:18:15.571 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.570+0000 7f574d1ea780 1 > prepared operation key=D1GEG3MKPOM3 tag=O712TNVRR80C type=write size=297065 2024-09-12T17:18:15.571 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.570+0000 7f574d1ea780 1 < canceled part key=_multipart_U6E9A5OH4GUW.2~IZ0FDXFI9U9Y.0 size=1048576 2024-09-12T17:18:15.572 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.571+0000 7f574d1ea780 1 < completed part key=_multipart_U6E9A5OH4GUW.2~IZ0FDXFI9U9Y.1 size=1048576 2024-09-12T17:18:15.573 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.572+0000 7f574d1ea780 1 < completed part key=_multipart_U6E9A5OH4GUW.2~IZ0FDXFI9U9Y.2 size=252401 2024-09-12T17:18:15.575 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.574+0000 7f574d1ea780 1 < canceled multipart upload key=U6E9A5OH4GUW upload=IZ0FDXFI9U9Y tag=05V7OTYYPVNQ type=write size=3398129 2024-09-12T17:18:15.577 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.576+0000 7f574d1ea780 1 > prepared part key=_multipart_RWVWJHVZE95H.2~0Y8A8MEPH6BW.0 size=1048576 2024-09-12T17:18:15.578 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.577+0000 7f574d1ea780 1 > prepared part key=_multipart_RWVWJHVZE95H.2~0Y8A8MEPH6BW.1 size=1048576 2024-09-12T17:18:15.579 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.578+0000 7f574d1ea780 1 > prepared part key=_multipart_RWVWJHVZE95H.2~0Y8A8MEPH6BW.2 size=938995 2024-09-12T17:18:15.579 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.578+0000 7f574d1ea780 1 > prepared multipart upload key=RWVWJHVZE95H upload=0Y8A8MEPH6BW tag=HL0KSJBUMZH4 type=write size=4084723 2024-09-12T17:18:15.580 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.579+0000 7f574d1ea780 1 < completed part key=_multipart_R00F69ON5P6Z.2~D9PH274FIV6I.0 size=1048576 2024-09-12T17:18:15.581 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.581+0000 7f574d1ea780 1 < completed part key=_multipart_R00F69ON5P6Z.2~D9PH274FIV6I.1 size=1048576 2024-09-12T17:18:15.582 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.582+0000 7f574d1ea780 1 < completed part key=_multipart_R00F69ON5P6Z.2~D9PH274FIV6I.2 size=79773 2024-09-12T17:18:15.585 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.584+0000 7f574d1ea780 1 < completed multipart upload key=R00F69ON5P6Z upload=D9PH274FIV6I tag=ZHZ0FHH5OR9F type=write size=3225501 2024-09-12T17:18:15.587 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.586+0000 7f574d1ea780 1 > prepared part key=_multipart_U6E9A5OH4GUW.2~0RBOO7AGF4JA.0 size=1048576 2024-09-12T17:18:15.588 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.587+0000 7f574d1ea780 1 > prepared part key=_multipart_U6E9A5OH4GUW.2~0RBOO7AGF4JA.1 size=37610 2024-09-12T17:18:15.588 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.587+0000 7f574d1ea780 1 > prepared multipart upload key=U6E9A5OH4GUW upload=0RBOO7AGF4JA tag=Z105L4F48XA4 type=write size=2134762 2024-09-12T17:18:15.589 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.588+0000 7f574d1ea780 1 < completed write operation key=HGZMN894YYC0 tag=MXJWSX18KTOK type=write size=267733 2024-09-12T17:18:15.590 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.590+0000 7f574d1ea780 1 > prepared operation key=D1GEG3MKPOM3 tag=620XWPNEVDK7 type=del size=2065934 2024-09-12T17:18:15.593 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.592+0000 7f574d1ea780 1 < suggested remove operation key=HFWA7DNUMWF2 tag=9BMR2DZPKAZ9 type=del 2024-09-12T17:18:15.594 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.593+0000 7f574d1ea780 1 > prepared operation key=54CM8800AT9V tag=YAWZ2KF3XMKV type=del size=2539481 2024-09-12T17:18:15.596 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.595+0000 7f574d1ea780 1 < canceled operation key=Q2Q3B1J3DAVD tag=Q6CL9ND5CKZ3 type=del size=1692482 2024-09-12T17:18:15.597 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.596+0000 7f574d1ea780 1 > prepared operation key=RWVWJHVZE95H tag=6096AJ46MK9T type=del size=2977612 2024-09-12T17:18:15.598 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.597+0000 7f574d1ea780 1 < completed part key=_multipart_RWVWJHVZE95H.2~DCDQRRWMN1FW.0 size=1048576 2024-09-12T17:18:15.599 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.598+0000 7f574d1ea780 1 < completed part key=_multipart_RWVWJHVZE95H.2~DCDQRRWMN1FW.1 size=47551 2024-09-12T17:18:15.601 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.600+0000 7f574d1ea780 1 < completed multipart upload key=RWVWJHVZE95H upload=DCDQRRWMN1FW tag=OPQ6AOT1KQD8 type=write size=2144703 2024-09-12T17:18:15.602 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.601+0000 7f574d1ea780 1 > prepared operation key=K12MVG618809 tag=U2GJ66OOBQ2T type=del size=1655461 2024-09-12T17:18:15.603 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.603+0000 7f574d1ea780 1 < completed part key=_multipart_54CM8800AT9V.2~CDTQIGFFNBML.0 size=1048576 2024-09-12T17:18:15.604 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.603+0000 7f574d1ea780 1 < canceled part key=_multipart_54CM8800AT9V.2~CDTQIGFFNBML.1 size=1048576 2024-09-12T17:18:15.604 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.604+0000 7f574d1ea780 1 < completed part key=_multipart_54CM8800AT9V.2~CDTQIGFFNBML.2 size=122755 2024-09-12T17:18:15.606 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.606+0000 7f574d1ea780 1 < canceled multipart upload key=54CM8800AT9V upload=CDTQIGFFNBML tag=B2AGWGJJN0PZ type=write size=3268483 2024-09-12T17:18:15.609 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.608+0000 7f574d1ea780 1 > prepared part key=_multipart_U6E9A5OH4GUW.2~16VHW1TYXCSX.0 size=1048576 2024-09-12T17:18:15.609 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.609+0000 7f574d1ea780 1 > prepared part key=_multipart_U6E9A5OH4GUW.2~16VHW1TYXCSX.1 size=387984 2024-09-12T17:18:15.610 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.609+0000 7f574d1ea780 1 > prepared multipart upload key=U6E9A5OH4GUW upload=16VHW1TYXCSX tag=H878RTAMU3IM type=write size=2485136 2024-09-12T17:18:15.611 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.610+0000 7f574d1ea780 1 < completed write operation key=Q2Q3B1J3DAVD tag=ZPJOUTUU28D7 type=write size=922917 2024-09-12T17:18:15.613 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.612+0000 7f574d1ea780 1 > prepared part key=_multipart_YXIDO0U18839.2~4T2ZEW2CPHM0.0 size=323106 2024-09-12T17:18:15.613 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.612+0000 7f574d1ea780 1 > prepared multipart upload key=YXIDO0U18839 upload=4T2ZEW2CPHM0 tag=01UH5I0PBCSY type=write size=1371682 2024-09-12T17:18:15.615 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.613+0000 7f574d1ea780 1 < completed write operation key=TIKBUXFPVTN1 tag=V90HFMXC79DZ type=write size=521884 2024-09-12T17:18:15.615 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.615+0000 7f574d1ea780 1 > prepared operation key=54LQ91UMBJAN tag=B9ZAOUPLKEKW type=del size=649318 2024-09-12T17:18:15.617 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.616+0000 7f574d1ea780 1 < completed delete operation key=8VW3XCUHLF2L tag=TFFDXZO2L11I type=del 2024-09-12T17:18:15.618 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.617+0000 7f574d1ea780 1 > prepared operation key=SQQMJ61CA0QW tag=O8ZMIDHE79OJ type=del size=1778787 2024-09-12T17:18:15.619 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.619+0000 7f574d1ea780 1 < completed delete operation key=8SG7DJO4HWPI tag=GQDD2YWZZBWK type=del 2024-09-12T17:18:15.622 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.621+0000 7f574d1ea780 1 > prepared part key=_multipart_HFWA7DNUMWF2.2~KXDM2HKHS5N0.0 size=1048576 2024-09-12T17:18:15.623 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.622+0000 7f574d1ea780 1 > prepared part key=_multipart_HFWA7DNUMWF2.2~KXDM2HKHS5N0.1 size=2591 2024-09-12T17:18:15.623 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.622+0000 7f574d1ea780 1 > prepared multipart upload key=HFWA7DNUMWF2 upload=KXDM2HKHS5N0 tag=M3ZFB916C7AM type=write size=2099743 2024-09-12T17:18:15.624 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.623+0000 7f574d1ea780 1 < completed part key=_multipart_GEGOEB05R0PK.2~QS7DRJSIBTLZ.0 size=1048576 2024-09-12T17:18:15.625 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.624+0000 7f574d1ea780 1 < completed part key=_multipart_GEGOEB05R0PK.2~QS7DRJSIBTLZ.1 size=1048576 2024-09-12T17:18:15.626 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.625+0000 7f574d1ea780 1 < completed part key=_multipart_GEGOEB05R0PK.2~QS7DRJSIBTLZ.2 size=928576 2024-09-12T17:18:15.628 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.627+0000 7f574d1ea780 1 < completed multipart upload key=GEGOEB05R0PK upload=QS7DRJSIBTLZ tag=IIBTTBYW1TZK type=write size=4074304 2024-09-12T17:18:15.629 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.628+0000 7f574d1ea780 1 > prepared operation key=54LQ91UMBJAN tag=00Z0JM1EE9M1 type=del size=173580 2024-09-12T17:18:15.632 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.631+0000 7f574d1ea780 1 < suggested update operation key=UTCKL1F42X8A tag=VNT8OTOXL6LA type=del size=3881285 2024-09-12T17:18:15.634 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.633+0000 7f574d1ea780 1 > prepared part key=_multipart_Q2Q3B1J3DAVD.2~89EZ7EXOYNJS.0 size=1048576 2024-09-12T17:18:15.635 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.634+0000 7f574d1ea780 1 > prepared part key=_multipart_Q2Q3B1J3DAVD.2~89EZ7EXOYNJS.1 size=1048576 2024-09-12T17:18:15.636 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.635+0000 7f574d1ea780 1 > prepared part key=_multipart_Q2Q3B1J3DAVD.2~89EZ7EXOYNJS.2 size=765813 2024-09-12T17:18:15.636 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.635+0000 7f574d1ea780 1 > prepared multipart upload key=Q2Q3B1J3DAVD upload=89EZ7EXOYNJS tag=ZB47QR9BZ30B type=write size=3911541 2024-09-12T17:18:15.637 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.636+0000 7f574d1ea780 1 < completed delete operation key=8VW3XCUHLF2L tag=NLWZ4M8AGT7L type=del 2024-09-12T17:18:15.638 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.638+0000 7f574d1ea780 1 > prepared operation key=UFKM4I8RMT0W tag=993PHQZ03W22 type=del size=1746003 2024-09-12T17:18:15.640 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.639+0000 7f574d1ea780 1 < completed delete operation key=55JI541K1WP2 tag=GPYXULOVY9R1 type=del 2024-09-12T17:18:15.641 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.640+0000 7f574d1ea780 1 > prepared operation key=8VW3XCUHLF2L tag=TM2Z7JA4QX7U type=del size=2079923 2024-09-12T17:18:15.644 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.643+0000 7f574d1ea780 1 < suggested update operation key=D1GEG3MKPOM3 tag=O712TNVRR80C type=write size=297065 2024-09-12T17:18:15.646 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.645+0000 7f574d1ea780 1 > prepared part key=_multipart_7BX38Q7723EB.2~DOREIHJF54ID.0 size=1048576 2024-09-12T17:18:15.647 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.646+0000 7f574d1ea780 1 > prepared part key=_multipart_7BX38Q7723EB.2~DOREIHJF54ID.1 size=1048576 2024-09-12T17:18:15.648 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.647+0000 7f574d1ea780 1 > prepared part key=_multipart_7BX38Q7723EB.2~DOREIHJF54ID.2 size=821498 2024-09-12T17:18:15.648 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.647+0000 7f574d1ea780 1 > prepared multipart upload key=7BX38Q7723EB upload=DOREIHJF54ID tag=AWGIQWVD8HFU type=write size=3967226 2024-09-12T17:18:15.648 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.647+0000 7f574d1ea780 1 < canceled part key=_multipart_RWVWJHVZE95H.2~0Y8A8MEPH6BW.0 size=1048576 2024-09-12T17:18:15.649 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.648+0000 7f574d1ea780 1 < completed part key=_multipart_RWVWJHVZE95H.2~0Y8A8MEPH6BW.1 size=1048576 2024-09-12T17:18:15.650 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.649+0000 7f574d1ea780 1 < completed part key=_multipart_RWVWJHVZE95H.2~0Y8A8MEPH6BW.2 size=938995 2024-09-12T17:18:15.652 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.651+0000 7f574d1ea780 1 < canceled multipart upload key=RWVWJHVZE95H upload=0Y8A8MEPH6BW tag=HL0KSJBUMZH4 type=write size=4084723 2024-09-12T17:18:15.654 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.654+0000 7f574d1ea780 1 > prepared part key=_multipart_Q2Q3B1J3DAVD.2~7RVSHH86D4SX.0 size=1048576 2024-09-12T17:18:15.655 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.655+0000 7f574d1ea780 1 > prepared part key=_multipart_Q2Q3B1J3DAVD.2~7RVSHH86D4SX.1 size=1048576 2024-09-12T17:18:15.656 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.656+0000 7f574d1ea780 1 > prepared part key=_multipart_Q2Q3B1J3DAVD.2~7RVSHH86D4SX.2 size=109049 2024-09-12T17:18:15.657 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.656+0000 7f574d1ea780 1 > prepared multipart upload key=Q2Q3B1J3DAVD upload=7RVSHH86D4SX tag=D10YUFDYVZT0 type=write size=3254777 2024-09-12T17:18:15.659 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.658+0000 7f574d1ea780 1 < completed part key=_multipart_U6E9A5OH4GUW.2~0RBOO7AGF4JA.0 size=1048576 2024-09-12T17:18:15.661 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.660+0000 7f574d1ea780 1 < completed part key=_multipart_U6E9A5OH4GUW.2~0RBOO7AGF4JA.1 size=37610 2024-09-12T17:18:15.663 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.662+0000 7f574d1ea780 1 < completed multipart upload key=U6E9A5OH4GUW upload=0RBOO7AGF4JA tag=Z105L4F48XA4 type=write size=2134762 2024-09-12T17:18:15.665 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.665+0000 7f574d1ea780 1 > prepared part key=_multipart_DH02JGZP64MN.2~KHZ4WJ4ODH5G.0 size=1048576 2024-09-12T17:18:15.666 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.666+0000 7f574d1ea780 1 > prepared part key=_multipart_DH02JGZP64MN.2~KHZ4WJ4ODH5G.1 size=1048576 2024-09-12T17:18:15.667 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.667+0000 7f574d1ea780 1 > prepared part key=_multipart_DH02JGZP64MN.2~KHZ4WJ4ODH5G.2 size=1029248 2024-09-12T17:18:15.667 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.667+0000 7f574d1ea780 1 > prepared multipart upload key=DH02JGZP64MN upload=KHZ4WJ4ODH5G tag=BRF50JQSJOZR type=write size=4174976 2024-09-12T17:18:15.668 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.668+0000 7f574d1ea780 -1 < failed to complete operation key=D1GEG3MKPOM3 tag=620XWPNEVDK7 type=del size=2065934: (22) Invalid argument 2024-09-12T17:18:15.670 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.669+0000 7f574d1ea780 1 > prepared operation key=RWVWJHVZE95H tag=ORPUSU0X4TX8 type=del size=3890452 2024-09-12T17:18:15.671 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.670+0000 7f574d1ea780 1 < completed delete operation key=54CM8800AT9V tag=YAWZ2KF3XMKV type=del 2024-09-12T17:18:15.672 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.671+0000 7f574d1ea780 1 > prepared operation key=55V137SY4E4P tag=PW0WNU3KK79X type=write size=937894 2024-09-12T17:18:15.673 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.672+0000 7f574d1ea780 1 < completed delete operation key=RWVWJHVZE95H tag=6096AJ46MK9T type=del 2024-09-12T17:18:15.674 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.674+0000 7f574d1ea780 1 > prepared operation key=QXD8UG2K4STQ tag=ZM0HZPMTE3OD type=write size=492001 2024-09-12T17:18:15.675 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.675+0000 7f574d1ea780 1 < completed delete operation key=K12MVG618809 tag=U2GJ66OOBQ2T type=del 2024-09-12T17:18:15.677 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.676+0000 7f574d1ea780 1 > prepared operation key=A1TIP3RXHBCZ tag=XWB244NY30FZ type=del size=2582297 2024-09-12T17:18:15.678 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.677+0000 7f574d1ea780 1 < completed part key=_multipart_U6E9A5OH4GUW.2~16VHW1TYXCSX.0 size=1048576 2024-09-12T17:18:15.679 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.678+0000 7f574d1ea780 1 < completed part key=_multipart_U6E9A5OH4GUW.2~16VHW1TYXCSX.1 size=387984 2024-09-12T17:18:15.681 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.680+0000 7f574d1ea780 1 < completed multipart upload key=U6E9A5OH4GUW upload=16VHW1TYXCSX tag=H878RTAMU3IM type=write size=2485136 2024-09-12T17:18:15.682 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.681+0000 7f574d1ea780 1 > prepared operation key=7BX38Q7723EB tag=ZN209YA1DL7Y type=write size=849195 2024-09-12T17:18:15.683 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.682+0000 7f574d1ea780 1 < completed part key=_multipart_YXIDO0U18839.2~4T2ZEW2CPHM0.0 size=323106 2024-09-12T17:18:15.685 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.684+0000 7f574d1ea780 1 < completed multipart upload key=YXIDO0U18839 upload=4T2ZEW2CPHM0 tag=01UH5I0PBCSY type=write size=1371682 2024-09-12T17:18:15.686 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.686+0000 7f574d1ea780 1 > prepared operation key=TIKBUXFPVTN1 tag=ESGYSPO062V6 type=del size=1898704 2024-09-12T17:18:15.688 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.687+0000 7f574d1ea780 1 < completed delete operation key=54LQ91UMBJAN tag=B9ZAOUPLKEKW type=del 2024-09-12T17:18:15.690 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.689+0000 7f574d1ea780 1 > prepared part key=_multipart_R00F69ON5P6Z.2~YM99O18QQJ7V.0 size=1048576 2024-09-12T17:18:15.691 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.690+0000 7f574d1ea780 1 > prepared part key=_multipart_R00F69ON5P6Z.2~YM99O18QQJ7V.1 size=95733 2024-09-12T17:18:15.691 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.690+0000 7f574d1ea780 1 > prepared multipart upload key=R00F69ON5P6Z upload=YM99O18QQJ7V tag=1CZ60P00BFT5 type=write size=2192885 2024-09-12T17:18:15.692 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.691+0000 7f574d1ea780 1 < completed delete operation key=SQQMJ61CA0QW tag=O8ZMIDHE79OJ type=del 2024-09-12T17:18:15.693 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.692+0000 7f574d1ea780 1 > prepared operation key=HGZMN894YYC0 tag=H99UZ2B36XKN type=write size=599081 2024-09-12T17:18:15.694 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.694+0000 7f574d1ea780 1 < completed part key=_multipart_HFWA7DNUMWF2.2~KXDM2HKHS5N0.0 size=1048576 2024-09-12T17:18:15.695 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.695+0000 7f574d1ea780 1 < completed part key=_multipart_HFWA7DNUMWF2.2~KXDM2HKHS5N0.1 size=2591 2024-09-12T17:18:15.697 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.697+0000 7f574d1ea780 1 < completed multipart upload key=HFWA7DNUMWF2 upload=KXDM2HKHS5N0 tag=M3ZFB916C7AM type=write size=2099743 2024-09-12T17:18:15.700 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.699+0000 7f574d1ea780 1 > prepared part key=_multipart_A1TIP3RXHBCZ.2~IOW43QS8EVR0.0 size=86553 2024-09-12T17:18:15.700 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.699+0000 7f574d1ea780 1 > prepared multipart upload key=A1TIP3RXHBCZ upload=IOW43QS8EVR0 tag=RSV9GY0C9CNX type=write size=1135129 2024-09-12T17:18:15.701 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.700+0000 7f574d1ea780 1 < completed delete operation key=54LQ91UMBJAN tag=00Z0JM1EE9M1 type=del 2024-09-12T17:18:15.703 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.702+0000 7f574d1ea780 1 > prepared part key=_multipart_HFWA7DNUMWF2.2~HTBQDJV7UYML.0 size=510587 2024-09-12T17:18:15.703 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.702+0000 7f574d1ea780 1 > prepared multipart upload key=HFWA7DNUMWF2 upload=HTBQDJV7UYML tag=2LWQG5VLSREC type=write size=1559163 2024-09-12T17:18:15.704 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.703+0000 7f574d1ea780 1 < completed part key=_multipart_Q2Q3B1J3DAVD.2~89EZ7EXOYNJS.0 size=1048576 2024-09-12T17:18:15.705 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.704+0000 7f574d1ea780 1 < completed part key=_multipart_Q2Q3B1J3DAVD.2~89EZ7EXOYNJS.1 size=1048576 2024-09-12T17:18:15.705 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.704+0000 7f574d1ea780 1 < canceled part key=_multipart_Q2Q3B1J3DAVD.2~89EZ7EXOYNJS.2 size=765813 2024-09-12T17:18:15.707 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.706+0000 7f574d1ea780 1 < canceled multipart upload key=Q2Q3B1J3DAVD upload=89EZ7EXOYNJS tag=ZB47QR9BZ30B type=write size=3911541 2024-09-12T17:18:15.713 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.709+0000 7f574d1ea780 1 > prepared part key=_multipart_YXIDO0U18839.2~5DL0RPAXR98H.0 size=1048576 2024-09-12T17:18:15.713 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.710+0000 7f574d1ea780 1 > prepared part key=_multipart_YXIDO0U18839.2~5DL0RPAXR98H.1 size=269383 2024-09-12T17:18:15.713 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.710+0000 7f574d1ea780 1 > prepared multipart upload key=YXIDO0U18839 upload=5DL0RPAXR98H tag=H8E3KGIIOF35 type=write size=2366535 2024-09-12T17:18:15.713 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.711+0000 7f574d1ea780 1 < completed delete operation key=UFKM4I8RMT0W tag=993PHQZ03W22 type=del 2024-09-12T17:18:15.714 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.713+0000 7f574d1ea780 1 > prepared part key=_multipart_8VW3XCUHLF2L.2~H15O0LFWN0F0.0 size=1048576 2024-09-12T17:18:15.715 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.714+0000 7f574d1ea780 1 > prepared part key=_multipart_8VW3XCUHLF2L.2~H15O0LFWN0F0.1 size=772671 2024-09-12T17:18:15.715 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.714+0000 7f574d1ea780 1 > prepared multipart upload key=8VW3XCUHLF2L upload=H15O0LFWN0F0 tag=IH3YEVQZ52YG type=write size=2869823 2024-09-12T17:18:15.718 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.717+0000 7f574d1ea780 1 < suggested remove operation key=8VW3XCUHLF2L tag=TM2Z7JA4QX7U type=del 2024-09-12T17:18:15.719 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.718+0000 7f574d1ea780 1 > prepared operation key=HGZMN894YYC0 tag=DJIJJ221584G type=del size=1524908 2024-09-12T17:18:15.721 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.720+0000 7f574d1ea780 1 < completed part key=_multipart_7BX38Q7723EB.2~DOREIHJF54ID.0 size=1048576 2024-09-12T17:18:15.722 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.721+0000 7f574d1ea780 1 < completed part key=_multipart_7BX38Q7723EB.2~DOREIHJF54ID.1 size=1048576 2024-09-12T17:18:15.723 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.722+0000 7f574d1ea780 1 < completed part key=_multipart_7BX38Q7723EB.2~DOREIHJF54ID.2 size=821498 2024-09-12T17:18:15.726 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.725+0000 7f574d1ea780 1 < completed multipart upload key=7BX38Q7723EB upload=DOREIHJF54ID tag=AWGIQWVD8HFU type=write size=3967226 2024-09-12T17:18:15.728 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.727+0000 7f574d1ea780 1 > prepared part key=_multipart_ENFNIFHQ3SHW.2~Q1VIHGNZDM3S.0 size=937767 2024-09-12T17:18:15.728 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.727+0000 7f574d1ea780 1 > prepared multipart upload key=ENFNIFHQ3SHW upload=Q1VIHGNZDM3S tag=KBOQWP76R569 type=write size=1986343 2024-09-12T17:18:15.730 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.729+0000 7f574d1ea780 1 < completed part key=_multipart_Q2Q3B1J3DAVD.2~7RVSHH86D4SX.0 size=1048576 2024-09-12T17:18:15.730 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.729+0000 7f574d1ea780 1 < canceled part key=_multipart_Q2Q3B1J3DAVD.2~7RVSHH86D4SX.1 size=1048576 2024-09-12T17:18:15.731 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.730+0000 7f574d1ea780 1 < completed part key=_multipart_Q2Q3B1J3DAVD.2~7RVSHH86D4SX.2 size=109049 2024-09-12T17:18:15.733 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.732+0000 7f574d1ea780 1 < canceled multipart upload key=Q2Q3B1J3DAVD upload=7RVSHH86D4SX tag=D10YUFDYVZT0 type=write size=3254777 2024-09-12T17:18:15.734 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.733+0000 7f574d1ea780 1 > prepared operation key=ZGH8XC39FGTC tag=SNTX4OL9NLZH type=del size=3804584 2024-09-12T17:18:15.735 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.735+0000 7f574d1ea780 1 < completed part key=_multipart_DH02JGZP64MN.2~KHZ4WJ4ODH5G.0 size=1048576 2024-09-12T17:18:15.737 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.736+0000 7f574d1ea780 1 < completed part key=_multipart_DH02JGZP64MN.2~KHZ4WJ4ODH5G.1 size=1048576 2024-09-12T17:18:15.738 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.737+0000 7f574d1ea780 1 < completed part key=_multipart_DH02JGZP64MN.2~KHZ4WJ4ODH5G.2 size=1029248 2024-09-12T17:18:15.740 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.739+0000 7f574d1ea780 1 < completed multipart upload key=DH02JGZP64MN upload=KHZ4WJ4ODH5G tag=BRF50JQSJOZR type=write size=4174976 2024-09-12T17:18:15.741 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.741+0000 7f574d1ea780 1 > prepared operation key=A1TIP3RXHBCZ tag=5ESIP4K62NC5 type=del size=3895820 2024-09-12T17:18:15.742 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.742+0000 7f574d1ea780 1 < completed delete operation key=RWVWJHVZE95H tag=ORPUSU0X4TX8 type=del 2024-09-12T17:18:15.744 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.743+0000 7f574d1ea780 1 > prepared operation key=HFWA7DNUMWF2 tag=AV4EIQNCT3XA type=del size=454736 2024-09-12T17:18:15.745 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.744+0000 7f574d1ea780 1 < completed write operation key=55V137SY4E4P tag=PW0WNU3KK79X type=write size=937894 2024-09-12T17:18:15.747 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.746+0000 7f574d1ea780 1 > prepared part key=_multipart_8VW3XCUHLF2L.2~IYF8XJZKZ7QQ.0 size=609790 2024-09-12T17:18:15.747 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.746+0000 7f574d1ea780 1 > prepared multipart upload key=8VW3XCUHLF2L upload=IYF8XJZKZ7QQ tag=URS9E62T096E type=write size=1658366 2024-09-12T17:18:15.749 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.749+0000 7f574d1ea780 1 < suggested remove operation key=QXD8UG2K4STQ tag=ZM0HZPMTE3OD type=write 2024-09-12T17:18:15.751 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.750+0000 7f574d1ea780 1 > prepared operation key=ENFNIFHQ3SHW tag=AQ2YIQ8QW9BR type=del size=1322678 2024-09-12T17:18:15.752 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.751+0000 7f574d1ea780 1 < completed delete operation key=A1TIP3RXHBCZ tag=XWB244NY30FZ type=del 2024-09-12T17:18:15.754 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.753+0000 7f574d1ea780 1 > prepared part key=_multipart_7BX38Q7723EB.2~165QU0EU12O9.0 size=1048576 2024-09-12T17:18:15.755 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.754+0000 7f574d1ea780 1 > prepared part key=_multipart_7BX38Q7723EB.2~165QU0EU12O9.1 size=551206 2024-09-12T17:18:15.755 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.754+0000 7f574d1ea780 1 > prepared multipart upload key=7BX38Q7723EB upload=165QU0EU12O9 tag=KKLFZFQ326NL type=write size=2648358 2024-09-12T17:18:15.756 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.756+0000 7f574d1ea780 1 < completed write operation key=7BX38Q7723EB tag=ZN209YA1DL7Y type=write size=849195 2024-09-12T17:18:15.758 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.757+0000 7f574d1ea780 1 > prepared operation key=ZGH8XC39FGTC tag=F92R192E5EBV type=write size=563282 2024-09-12T17:18:15.759 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.758+0000 7f574d1ea780 1 < completed delete operation key=TIKBUXFPVTN1 tag=ESGYSPO062V6 type=del 2024-09-12T17:18:15.761 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.760+0000 7f574d1ea780 1 > prepared part key=_multipart_GEGOEB05R0PK.2~NHP0G7CMK4WX.0 size=1048576 2024-09-12T17:18:15.762 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.761+0000 7f574d1ea780 1 > prepared part key=_multipart_GEGOEB05R0PK.2~NHP0G7CMK4WX.1 size=1048576 2024-09-12T17:18:15.763 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.762+0000 7f574d1ea780 1 > prepared part key=_multipart_GEGOEB05R0PK.2~NHP0G7CMK4WX.2 size=833571 2024-09-12T17:18:15.763 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.762+0000 7f574d1ea780 1 > prepared multipart upload key=GEGOEB05R0PK upload=NHP0G7CMK4WX tag=K3CZHPKP2RK7 type=write size=3979299 2024-09-12T17:18:15.764 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.763+0000 7f574d1ea780 1 < completed part key=_multipart_R00F69ON5P6Z.2~YM99O18QQJ7V.0 size=1048576 2024-09-12T17:18:15.765 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.764+0000 7f574d1ea780 1 < completed part key=_multipart_R00F69ON5P6Z.2~YM99O18QQJ7V.1 size=95733 2024-09-12T17:18:15.767 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.766+0000 7f574d1ea780 1 < completed multipart upload key=R00F69ON5P6Z upload=YM99O18QQJ7V tag=1CZ60P00BFT5 type=write size=2192885 2024-09-12T17:18:15.768 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.768+0000 7f574d1ea780 1 > prepared operation key=DH02JGZP64MN tag=G6K4F7PP5KKR type=del size=3706942 2024-09-12T17:18:15.770 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.769+0000 7f574d1ea780 1 < canceled operation key=HGZMN894YYC0 tag=H99UZ2B36XKN type=write size=599081 2024-09-12T17:18:15.771 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.770+0000 7f574d1ea780 1 > prepared operation key=D1GEG3MKPOM3 tag=678E7VYIH09Z type=del size=1746787 2024-09-12T17:18:15.772 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.771+0000 7f574d1ea780 1 < completed part key=_multipart_A1TIP3RXHBCZ.2~IOW43QS8EVR0.0 size=86553 2024-09-12T17:18:15.776 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.775+0000 7f574d1ea780 1 < completed multipart upload key=A1TIP3RXHBCZ upload=IOW43QS8EVR0 tag=RSV9GY0C9CNX type=write size=1135129 2024-09-12T17:18:15.778 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.777+0000 7f574d1ea780 1 > prepared operation key=YXIDO0U18839 tag=IIYJ8E59D4CP type=del size=1898095 2024-09-12T17:18:15.778 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.777+0000 7f574d1ea780 1 < canceled part key=_multipart_HFWA7DNUMWF2.2~HTBQDJV7UYML.0 size=510587 2024-09-12T17:18:15.780 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.780+0000 7f574d1ea780 1 < canceled multipart upload key=HFWA7DNUMWF2 upload=HTBQDJV7UYML tag=2LWQG5VLSREC type=write size=1559163 2024-09-12T17:18:15.782 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.781+0000 7f574d1ea780 1 > prepared operation key=SQQMJ61CA0QW tag=F3PL7T3LGCMZ type=del size=3189760 2024-09-12T17:18:15.783 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.782+0000 7f574d1ea780 1 < completed part key=_multipart_YXIDO0U18839.2~5DL0RPAXR98H.0 size=1048576 2024-09-12T17:18:15.784 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.783+0000 7f574d1ea780 1 < completed part key=_multipart_YXIDO0U18839.2~5DL0RPAXR98H.1 size=269383 2024-09-12T17:18:15.786 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.785+0000 7f574d1ea780 1 < completed multipart upload key=YXIDO0U18839 upload=5DL0RPAXR98H tag=H8E3KGIIOF35 type=write size=2366535 2024-09-12T17:18:15.787 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.786+0000 7f574d1ea780 1 > prepared operation key=TIKBUXFPVTN1 tag=072YPLV50KKM type=del size=725737 2024-09-12T17:18:15.788 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.788+0000 7f574d1ea780 1 < completed part key=_multipart_8VW3XCUHLF2L.2~H15O0LFWN0F0.0 size=1048576 2024-09-12T17:18:15.789 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.788+0000 7f574d1ea780 1 < completed part key=_multipart_8VW3XCUHLF2L.2~H15O0LFWN0F0.1 size=772671 2024-09-12T17:18:15.791 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.791+0000 7f574d1ea780 1 < completed multipart upload key=8VW3XCUHLF2L upload=H15O0LFWN0F0 tag=IH3YEVQZ52YG type=write size=2869823 2024-09-12T17:18:15.794 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.793+0000 7f574d1ea780 1 > prepared part key=_multipart_54CM8800AT9V.2~DM01A5C9NHL0.0 size=974190 2024-09-12T17:18:15.794 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.793+0000 7f574d1ea780 1 > prepared multipart upload key=54CM8800AT9V upload=DM01A5C9NHL0 tag=GR0C6BH9JQ71 type=write size=2022766 2024-09-12T17:18:15.795 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.794+0000 7f574d1ea780 1 < completed delete operation key=HGZMN894YYC0 tag=DJIJJ221584G type=del 2024-09-12T17:18:15.798 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.797+0000 7f574d1ea780 1 > prepared part key=_multipart_GEGOEB05R0PK.2~9GYYV3VEZG0X.0 size=1048576 2024-09-12T17:18:15.799 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.798+0000 7f574d1ea780 1 > prepared part key=_multipart_GEGOEB05R0PK.2~9GYYV3VEZG0X.1 size=645552 2024-09-12T17:18:15.799 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.798+0000 7f574d1ea780 1 > prepared multipart upload key=GEGOEB05R0PK upload=9GYYV3VEZG0X tag=T9VM8E2IYON8 type=write size=2742704 2024-09-12T17:18:15.801 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.800+0000 7f574d1ea780 1 < completed part key=_multipart_ENFNIFHQ3SHW.2~Q1VIHGNZDM3S.0 size=937767 2024-09-12T17:18:15.804 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.803+0000 7f574d1ea780 1 < completed multipart upload key=ENFNIFHQ3SHW upload=Q1VIHGNZDM3S tag=KBOQWP76R569 type=write size=1986343 2024-09-12T17:18:15.806 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.805+0000 7f574d1ea780 1 > prepared part key=_multipart_TIKBUXFPVTN1.2~O419076ZU6F1.0 size=1048576 2024-09-12T17:18:15.807 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.806+0000 7f574d1ea780 1 > prepared part key=_multipart_TIKBUXFPVTN1.2~O419076ZU6F1.1 size=1048576 2024-09-12T17:18:15.808 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.807+0000 7f574d1ea780 1 > prepared part key=_multipart_TIKBUXFPVTN1.2~O419076ZU6F1.2 size=632176 2024-09-12T17:18:15.808 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.807+0000 7f574d1ea780 1 > prepared multipart upload key=TIKBUXFPVTN1 upload=O419076ZU6F1 tag=HT7DKVLH9GLO type=write size=3777904 2024-09-12T17:18:15.809 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.808+0000 7f574d1ea780 1 < completed delete operation key=ZGH8XC39FGTC tag=SNTX4OL9NLZH type=del 2024-09-12T17:18:15.810 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.809+0000 7f574d1ea780 1 > prepared operation key=OI51GO639LFK tag=RJMLDH30Z5IL type=del size=1905312 2024-09-12T17:18:15.811 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.811+0000 7f574d1ea780 1 < completed delete operation key=A1TIP3RXHBCZ tag=5ESIP4K62NC5 type=del 2024-09-12T17:18:15.813 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.812+0000 7f574d1ea780 1 > prepared operation key=OI51GO639LFK tag=KO5L25P2CCWO type=del size=3232613 2024-09-12T17:18:15.815 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.814+0000 7f574d1ea780 1 < suggested update operation key=HFWA7DNUMWF2 tag=AV4EIQNCT3XA type=del size=454736 2024-09-12T17:18:15.817 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.817+0000 7f574d1ea780 1 > prepared part key=_multipart_ZGE1860DMGHA.2~89UEF9D2C1GE.0 size=483684 2024-09-12T17:18:15.818 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.817+0000 7f574d1ea780 1 > prepared multipart upload key=ZGE1860DMGHA upload=89UEF9D2C1GE tag=A05CBSU7AGXS type=write size=1532260 2024-09-12T17:18:15.819 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.818+0000 7f574d1ea780 1 < completed part key=_multipart_8VW3XCUHLF2L.2~IYF8XJZKZ7QQ.0 size=609790 2024-09-12T17:18:15.821 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.820+0000 7f574d1ea780 1 < completed multipart upload key=8VW3XCUHLF2L upload=IYF8XJZKZ7QQ tag=URS9E62T096E type=write size=1658366 2024-09-12T17:18:15.822 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.822+0000 7f574d1ea780 1 > prepared operation key=HFWA7DNUMWF2 tag=OH6RNA7K9H1O type=del size=1711368 2024-09-12T17:18:15.825 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.824+0000 7f574d1ea780 1 < suggested remove operation key=ENFNIFHQ3SHW tag=AQ2YIQ8QW9BR type=del 2024-09-12T17:18:15.827 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.826+0000 7f574d1ea780 1 > prepared operation key=YXIDO0U18839 tag=X0DOQTJISSV3 type=del size=284019 2024-09-12T17:18:15.828 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.827+0000 7f574d1ea780 1 < completed part key=_multipart_7BX38Q7723EB.2~165QU0EU12O9.0 size=1048576 2024-09-12T17:18:15.829 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.828+0000 7f574d1ea780 1 < completed part key=_multipart_7BX38Q7723EB.2~165QU0EU12O9.1 size=551206 2024-09-12T17:18:15.831 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.830+0000 7f574d1ea780 1 < completed multipart upload key=7BX38Q7723EB upload=165QU0EU12O9 tag=KKLFZFQ326NL type=write size=2648358 2024-09-12T17:18:15.832 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.831+0000 7f574d1ea780 1 > prepared operation key=VWWA5IB0L4N1 tag=KVU23LK7NV5R type=del size=2306175 2024-09-12T17:18:15.834 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.833+0000 7f574d1ea780 1 < canceled operation key=ZGH8XC39FGTC tag=F92R192E5EBV type=write size=563282 2024-09-12T17:18:15.836 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.835+0000 7f574d1ea780 1 > prepared part key=_multipart_HFWA7DNUMWF2.2~Z2T1X0VHIHTP.0 size=1048576 2024-09-12T17:18:15.837 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.836+0000 7f574d1ea780 1 > prepared part key=_multipart_HFWA7DNUMWF2.2~Z2T1X0VHIHTP.1 size=236023 2024-09-12T17:18:15.837 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.836+0000 7f574d1ea780 1 > prepared multipart upload key=HFWA7DNUMWF2 upload=Z2T1X0VHIHTP tag=KYYUH61353AC type=write size=2333175 2024-09-12T17:18:15.837 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.836+0000 7f574d1ea780 1 < canceled part key=_multipart_GEGOEB05R0PK.2~NHP0G7CMK4WX.0 size=1048576 2024-09-12T17:18:15.838 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.837+0000 7f574d1ea780 1 < completed part key=_multipart_GEGOEB05R0PK.2~NHP0G7CMK4WX.1 size=1048576 2024-09-12T17:18:15.839 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.838+0000 7f574d1ea780 1 < completed part key=_multipart_GEGOEB05R0PK.2~NHP0G7CMK4WX.2 size=833571 2024-09-12T17:18:15.841 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.840+0000 7f574d1ea780 1 < canceled multipart upload key=GEGOEB05R0PK upload=NHP0G7CMK4WX tag=K3CZHPKP2RK7 type=write size=3979299 2024-09-12T17:18:15.842 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.842+0000 7f574d1ea780 1 > prepared operation key=54CM8800AT9V tag=CDJWNLIMQ8A7 type=del size=1131925 2024-09-12T17:18:15.844 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.843+0000 7f574d1ea780 1 < completed delete operation key=DH02JGZP64MN tag=G6K4F7PP5KKR type=del 2024-09-12T17:18:15.847 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.846+0000 7f574d1ea780 1 > prepared part key=_multipart_HFWA7DNUMWF2.2~GO1B7S8FHC4F.0 size=48174 2024-09-12T17:18:15.847 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.846+0000 7f574d1ea780 1 > prepared multipart upload key=HFWA7DNUMWF2 upload=GO1B7S8FHC4F tag=GVAYMSTNPAEI type=write size=1096750 2024-09-12T17:18:15.849 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.848+0000 7f574d1ea780 1 < suggested remove operation key=D1GEG3MKPOM3 tag=678E7VYIH09Z type=del 2024-09-12T17:18:15.850 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.850+0000 7f574d1ea780 1 > prepared operation key=RNI86YYLADT0 tag=2JYESASNJFPU type=del size=850363 2024-09-12T17:18:15.852 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.851+0000 7f574d1ea780 1 < completed delete operation key=YXIDO0U18839 tag=IIYJ8E59D4CP type=del 2024-09-12T17:18:15.853 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.852+0000 7f574d1ea780 1 > prepared operation key=RWVWJHVZE95H tag=DDTY7QB3CZ6Q type=del size=1742754 2024-09-12T17:18:15.855 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.854+0000 7f574d1ea780 1 < completed delete operation key=SQQMJ61CA0QW tag=F3PL7T3LGCMZ type=del 2024-09-12T17:18:15.856 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.855+0000 7f574d1ea780 1 > prepared operation key=TIKBUXFPVTN1 tag=J2F7RFVJM492 type=del size=774209 2024-09-12T17:18:15.858 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.858+0000 7f574d1ea780 1 < suggested remove operation key=TIKBUXFPVTN1 tag=072YPLV50KKM type=del 2024-09-12T17:18:15.861 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.860+0000 7f574d1ea780 1 > prepared part key=_multipart_55V137SY4E4P.2~6FZFWDDHOZT6.0 size=1048576 2024-09-12T17:18:15.862 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.861+0000 7f574d1ea780 1 > prepared part key=_multipart_55V137SY4E4P.2~6FZFWDDHOZT6.1 size=894892 2024-09-12T17:18:15.862 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.861+0000 7f574d1ea780 1 > prepared multipart upload key=55V137SY4E4P upload=6FZFWDDHOZT6 tag=DJTFVJJ4STCO type=write size=2992044 2024-09-12T17:18:15.862 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.862+0000 7f574d1ea780 1 < canceled part key=_multipart_54CM8800AT9V.2~DM01A5C9NHL0.0 size=974190 2024-09-12T17:18:15.864 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.864+0000 7f574d1ea780 1 < canceled multipart upload key=54CM8800AT9V upload=DM01A5C9NHL0 tag=GR0C6BH9JQ71 type=write size=2022766 2024-09-12T17:18:15.866 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.865+0000 7f574d1ea780 1 > prepared operation key=U6E9A5OH4GUW tag=OX99GXX1DHXO type=del size=3724894 2024-09-12T17:18:15.867 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.866+0000 7f574d1ea780 1 < completed part key=_multipart_GEGOEB05R0PK.2~9GYYV3VEZG0X.0 size=1048576 2024-09-12T17:18:15.868 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.867+0000 7f574d1ea780 1 < completed part key=_multipart_GEGOEB05R0PK.2~9GYYV3VEZG0X.1 size=645552 2024-09-12T17:18:15.870 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.869+0000 7f574d1ea780 1 < completed multipart upload key=GEGOEB05R0PK upload=9GYYV3VEZG0X tag=T9VM8E2IYON8 type=write size=2742704 2024-09-12T17:18:15.871 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.871+0000 7f574d1ea780 1 > prepared operation key=YXIDO0U18839 tag=WV2CKC873AO5 type=del size=2698299 2024-09-12T17:18:15.873 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.872+0000 7f574d1ea780 1 < completed part key=_multipart_TIKBUXFPVTN1.2~O419076ZU6F1.0 size=1048576 2024-09-12T17:18:15.874 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.873+0000 7f574d1ea780 1 < completed part key=_multipart_TIKBUXFPVTN1.2~O419076ZU6F1.1 size=1048576 2024-09-12T17:18:15.875 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.874+0000 7f574d1ea780 1 < completed part key=_multipart_TIKBUXFPVTN1.2~O419076ZU6F1.2 size=632176 2024-09-12T17:18:15.877 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.876+0000 7f574d1ea780 1 < completed multipart upload key=TIKBUXFPVTN1 upload=O419076ZU6F1 tag=HT7DKVLH9GLO type=write size=3777904 2024-09-12T17:18:15.878 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.877+0000 7f574d1ea780 1 > prepared operation key=R00F69ON5P6Z tag=CFG9N90G11K3 type=del size=3107486 2024-09-12T17:18:15.879 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.878+0000 7f574d1ea780 1 < completed delete operation key=OI51GO639LFK tag=RJMLDH30Z5IL type=del 2024-09-12T17:18:15.880 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.879+0000 7f574d1ea780 1 > prepared operation key=54LQ91UMBJAN tag=3T5Z8BCMSTNH type=del size=3308629 2024-09-12T17:18:15.882 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.882+0000 7f574d1ea780 1 < suggested update operation key=OI51GO639LFK tag=KO5L25P2CCWO type=del size=3232613 2024-09-12T17:18:15.884 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.883+0000 7f574d1ea780 1 > prepared operation key=K12MVG618809 tag=R49D9OP2RH5F type=del size=1232977 2024-09-12T17:18:15.884 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.883+0000 7f574d1ea780 1 < canceled part key=_multipart_ZGE1860DMGHA.2~89UEF9D2C1GE.0 size=483684 2024-09-12T17:18:15.886 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.885+0000 7f574d1ea780 1 < canceled multipart upload key=ZGE1860DMGHA upload=89UEF9D2C1GE tag=A05CBSU7AGXS type=write size=1532260 2024-09-12T17:18:15.887 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.886+0000 7f574d1ea780 1 > prepared operation key=ZGE1860DMGHA tag=CT1P7U8UPTOI type=del size=3343434 2024-09-12T17:18:15.888 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.888+0000 7f574d1ea780 1 < completed delete operation key=HFWA7DNUMWF2 tag=OH6RNA7K9H1O type=del 2024-09-12T17:18:15.890 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.889+0000 7f574d1ea780 1 > prepared operation key=54LQ91UMBJAN tag=3G13Y76157MI type=del size=173332 2024-09-12T17:18:15.892 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.891+0000 7f574d1ea780 1 < suggested remove operation key=YXIDO0U18839 tag=X0DOQTJISSV3 type=del 2024-09-12T17:18:15.893 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.892+0000 7f574d1ea780 1 > prepared operation key=K12MVG618809 tag=X1R85OZJZZ36 type=del size=1475669 2024-09-12T17:18:15.895 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.894+0000 7f574d1ea780 1 < completed delete operation key=VWWA5IB0L4N1 tag=KVU23LK7NV5R type=del 2024-09-12T17:18:15.898 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.897+0000 7f574d1ea780 1 > prepared part key=_multipart_OI51GO639LFK.2~NSHYJJTV18RT.0 size=867579 2024-09-12T17:18:15.898 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.897+0000 7f574d1ea780 1 > prepared multipart upload key=OI51GO639LFK upload=NSHYJJTV18RT tag=RUAM09FET8XM type=write size=1916155 2024-09-12T17:18:15.899 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.898+0000 7f574d1ea780 1 < completed part key=_multipart_HFWA7DNUMWF2.2~Z2T1X0VHIHTP.0 size=1048576 2024-09-12T17:18:15.900 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.899+0000 7f574d1ea780 1 < completed part key=_multipart_HFWA7DNUMWF2.2~Z2T1X0VHIHTP.1 size=236023 2024-09-12T17:18:15.902 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.901+0000 7f574d1ea780 1 < completed multipart upload key=HFWA7DNUMWF2 upload=Z2T1X0VHIHTP tag=KYYUH61353AC type=write size=2333175 2024-09-12T17:18:15.904 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.904+0000 7f574d1ea780 1 > prepared part key=_multipart_54CM8800AT9V.2~572919TS9438.0 size=159950 2024-09-12T17:18:15.905 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.904+0000 7f574d1ea780 1 > prepared multipart upload key=54CM8800AT9V upload=572919TS9438 tag=7EDJYM1DP1NE type=write size=1208526 2024-09-12T17:18:15.907 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.906+0000 7f574d1ea780 1 < suggested remove operation key=54CM8800AT9V tag=CDJWNLIMQ8A7 type=del 2024-09-12T17:18:15.908 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.907+0000 7f574d1ea780 1 > prepared operation key=K12MVG618809 tag=7I8LRVSDSOLT type=del size=630512 2024-09-12T17:18:15.909 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.908+0000 7f574d1ea780 1 < completed part key=_multipart_HFWA7DNUMWF2.2~GO1B7S8FHC4F.0 size=48174 2024-09-12T17:18:15.911 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.910+0000 7f574d1ea780 1 < completed multipart upload key=HFWA7DNUMWF2 upload=GO1B7S8FHC4F tag=GVAYMSTNPAEI type=write size=1096750 2024-09-12T17:18:15.913 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.912+0000 7f574d1ea780 1 > prepared operation key=ENFNIFHQ3SHW tag=6K00SO1GF4GV type=write size=231887 2024-09-12T17:18:15.914 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.913+0000 7f574d1ea780 1 < completed delete operation key=RNI86YYLADT0 tag=2JYESASNJFPU type=del 2024-09-12T17:18:15.915 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.914+0000 7f574d1ea780 1 > prepared operation key=55V137SY4E4P tag=YLUVDP1729CO type=write size=266455 2024-09-12T17:18:15.916 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.915+0000 7f574d1ea780 1 < completed delete operation key=RWVWJHVZE95H tag=DDTY7QB3CZ6Q type=del 2024-09-12T17:18:15.917 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.917+0000 7f574d1ea780 1 > prepared operation key=55JI541K1WP2 tag=RT68OA0IP9AX type=del size=2600028 2024-09-12T17:18:15.920 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.919+0000 7f574d1ea780 1 < suggested remove operation key=TIKBUXFPVTN1 tag=J2F7RFVJM492 type=del 2024-09-12T17:18:15.922 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.921+0000 7f574d1ea780 1 > prepared part key=_multipart_RWVWJHVZE95H.2~ZRF9R0F8TNQG.0 size=1048576 2024-09-12T17:18:15.923 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.922+0000 7f574d1ea780 1 > prepared part key=_multipart_RWVWJHVZE95H.2~ZRF9R0F8TNQG.1 size=83392 2024-09-12T17:18:15.923 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.922+0000 7f574d1ea780 1 > prepared multipart upload key=RWVWJHVZE95H upload=ZRF9R0F8TNQG tag=RPO69QCR97F4 type=write size=2180544 2024-09-12T17:18:15.924 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.923+0000 7f574d1ea780 1 < completed part key=_multipart_55V137SY4E4P.2~6FZFWDDHOZT6.0 size=1048576 2024-09-12T17:18:15.925 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.924+0000 7f574d1ea780 1 < completed part key=_multipart_55V137SY4E4P.2~6FZFWDDHOZT6.1 size=894892 2024-09-12T17:18:15.927 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.926+0000 7f574d1ea780 1 < completed multipart upload key=55V137SY4E4P upload=6FZFWDDHOZT6 tag=DJTFVJJ4STCO type=write size=2992044 2024-09-12T17:18:15.928 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.927+0000 7f574d1ea780 1 > prepared operation key=QXD8UG2K4STQ tag=YWJHTV24QVDB type=del size=44218 2024-09-12T17:18:15.929 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.928+0000 7f574d1ea780 1 < completed delete operation key=U6E9A5OH4GUW tag=OX99GXX1DHXO type=del 2024-09-12T17:18:15.930 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.929+0000 7f574d1ea780 1 > prepared operation key=HGZMN894YYC0 tag=QJER72F6BWPI type=write size=1021842 2024-09-12T17:18:15.931 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.931+0000 7f574d1ea780 -1 < failed to complete operation key=YXIDO0U18839 tag=WV2CKC873AO5 type=del size=2698299: (22) Invalid argument 2024-09-12T17:18:15.934 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.933+0000 7f574d1ea780 1 > prepared part key=_multipart_A1TIP3RXHBCZ.2~FUXPZQQGO3DB.0 size=190258 2024-09-12T17:18:15.934 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.933+0000 7f574d1ea780 1 > prepared multipart upload key=A1TIP3RXHBCZ upload=FUXPZQQGO3DB tag=XUBTK3IJ05SR type=write size=1238834 2024-09-12T17:18:15.935 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.934+0000 7f574d1ea780 1 < completed delete operation key=R00F69ON5P6Z tag=CFG9N90G11K3 type=del 2024-09-12T17:18:15.937 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.936+0000 7f574d1ea780 1 > prepared part key=_multipart_GEGOEB05R0PK.2~96QTJC3WBNI6.0 size=1048576 2024-09-12T17:18:15.938 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.937+0000 7f574d1ea780 1 > prepared part key=_multipart_GEGOEB05R0PK.2~96QTJC3WBNI6.1 size=1048576 2024-09-12T17:18:15.939 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.938+0000 7f574d1ea780 1 > prepared part key=_multipart_GEGOEB05R0PK.2~96QTJC3WBNI6.2 size=176862 2024-09-12T17:18:15.939 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.938+0000 7f574d1ea780 1 > prepared multipart upload key=GEGOEB05R0PK upload=96QTJC3WBNI6 tag=56F7SA8E9F8I type=write size=3322590 2024-09-12T17:18:15.940 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.939+0000 7f574d1ea780 1 < completed delete operation key=54LQ91UMBJAN tag=3T5Z8BCMSTNH type=del 2024-09-12T17:18:15.941 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.941+0000 7f574d1ea780 1 > prepared operation key=GEGOEB05R0PK tag=R9MLH2TBJPIC type=del size=3521144 2024-09-12T17:18:15.943 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.942+0000 7f574d1ea780 1 < canceled operation key=K12MVG618809 tag=R49D9OP2RH5F type=del size=1232977 2024-09-12T17:18:15.945 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.944+0000 7f574d1ea780 1 > prepared part key=_multipart_54LQ91UMBJAN.2~3GL392FQFKEK.0 size=1048576 2024-09-12T17:18:15.946 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.945+0000 7f574d1ea780 1 > prepared part key=_multipart_54LQ91UMBJAN.2~3GL392FQFKEK.1 size=185181 2024-09-12T17:18:15.946 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.945+0000 7f574d1ea780 1 > prepared multipart upload key=54LQ91UMBJAN upload=3GL392FQFKEK tag=1D0SL8VS6R68 type=write size=2282333 2024-09-12T17:18:15.947 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.946+0000 7f574d1ea780 1 < completed delete operation key=ZGE1860DMGHA tag=CT1P7U8UPTOI type=del 2024-09-12T17:18:15.949 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.948+0000 7f574d1ea780 1 > prepared part key=_multipart_54LQ91UMBJAN.2~9T3NEKHO5X7Z.0 size=1048576 2024-09-12T17:18:15.950 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.949+0000 7f574d1ea780 1 > prepared part key=_multipart_54LQ91UMBJAN.2~9T3NEKHO5X7Z.1 size=383157 2024-09-12T17:18:15.950 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.949+0000 7f574d1ea780 1 > prepared multipart upload key=54LQ91UMBJAN upload=9T3NEKHO5X7Z tag=20RX3M7IU9XG type=write size=2480309 2024-09-12T17:18:15.951 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.951+0000 7f574d1ea780 1 < completed delete operation key=54LQ91UMBJAN tag=3G13Y76157MI type=del 2024-09-12T17:18:15.954 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.953+0000 7f574d1ea780 1 > prepared part key=_multipart_RWVWJHVZE95H.2~ZZ33BQ1HMASW.0 size=786532 2024-09-12T17:18:15.954 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.953+0000 7f574d1ea780 1 > prepared multipart upload key=RWVWJHVZE95H upload=ZZ33BQ1HMASW tag=B5MG9QKBS0W2 type=write size=1835108 2024-09-12T17:18:15.955 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.954+0000 7f574d1ea780 1 < canceled operation key=K12MVG618809 tag=X1R85OZJZZ36 type=del size=1475669 2024-09-12T17:18:15.957 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.957+0000 7f574d1ea780 1 > prepared part key=_multipart_HFWA7DNUMWF2.2~73ECKJN1MAWU.0 size=1048576 2024-09-12T17:18:15.958 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.958+0000 7f574d1ea780 1 > prepared part key=_multipart_HFWA7DNUMWF2.2~73ECKJN1MAWU.1 size=1048576 2024-09-12T17:18:15.959 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.958+0000 7f574d1ea780 1 > prepared part key=_multipart_HFWA7DNUMWF2.2~73ECKJN1MAWU.2 size=596614 2024-09-12T17:18:15.959 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.958+0000 7f574d1ea780 1 > prepared multipart upload key=HFWA7DNUMWF2 upload=73ECKJN1MAWU tag=QP8X2ZTN7U5D type=write size=3742342 2024-09-12T17:18:15.961 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.960+0000 7f574d1ea780 1 < completed part key=_multipart_OI51GO639LFK.2~NSHYJJTV18RT.0 size=867579 2024-09-12T17:18:15.963 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.962+0000 7f574d1ea780 1 < completed multipart upload key=OI51GO639LFK upload=NSHYJJTV18RT tag=RUAM09FET8XM type=write size=1916155 2024-09-12T17:18:15.965 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.964+0000 7f574d1ea780 1 > prepared part key=_multipart_UFKM4I8RMT0W.2~EO4P7W6DSB5H.0 size=910404 2024-09-12T17:18:15.965 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.964+0000 7f574d1ea780 1 > prepared multipart upload key=UFKM4I8RMT0W upload=EO4P7W6DSB5H tag=KSHLD3VEINSF type=write size=1958980 2024-09-12T17:18:15.966 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.965+0000 7f574d1ea780 1 < completed part key=_multipart_54CM8800AT9V.2~572919TS9438.0 size=159950 2024-09-12T17:18:15.968 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.967+0000 7f574d1ea780 1 < completed multipart upload key=54CM8800AT9V upload=572919TS9438 tag=7EDJYM1DP1NE type=write size=1208526 2024-09-12T17:18:15.970 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.970+0000 7f574d1ea780 1 > prepared part key=_multipart_54CM8800AT9V.2~UHIVLNOOGQIW.0 size=1048576 2024-09-12T17:18:15.971 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.970+0000 7f574d1ea780 1 > prepared part key=_multipart_54CM8800AT9V.2~UHIVLNOOGQIW.1 size=413110 2024-09-12T17:18:15.971 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.970+0000 7f574d1ea780 1 > prepared multipart upload key=54CM8800AT9V upload=UHIVLNOOGQIW tag=GO8P2CTXXKV5 type=write size=2510262 2024-09-12T17:18:15.974 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.973+0000 7f574d1ea780 1 < suggested remove operation key=K12MVG618809 tag=7I8LRVSDSOLT type=del 2024-09-12T17:18:15.975 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.974+0000 7f574d1ea780 1 > prepared operation key=D1GEG3MKPOM3 tag=3I6BC33NZVTJ type=del size=2542200 2024-09-12T17:18:15.976 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.975+0000 7f574d1ea780 1 < completed write operation key=ENFNIFHQ3SHW tag=6K00SO1GF4GV type=write size=231887 2024-09-12T17:18:15.978 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.977+0000 7f574d1ea780 1 > prepared part key=_multipart_VWWA5IB0L4N1.2~WL0YQC8V4APA.0 size=1048576 2024-09-12T17:18:15.979 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.978+0000 7f574d1ea780 1 > prepared part key=_multipart_VWWA5IB0L4N1.2~WL0YQC8V4APA.1 size=1048576 2024-09-12T17:18:15.980 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.979+0000 7f574d1ea780 1 > prepared part key=_multipart_VWWA5IB0L4N1.2~WL0YQC8V4APA.2 size=13360 2024-09-12T17:18:15.980 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.979+0000 7f574d1ea780 1 > prepared multipart upload key=VWWA5IB0L4N1 upload=WL0YQC8V4APA tag=03RU727BB5U4 type=write size=3159088 2024-09-12T17:18:15.981 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.981+0000 7f574d1ea780 1 < canceled operation key=55V137SY4E4P tag=YLUVDP1729CO type=write size=266455 2024-09-12T17:18:15.983 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.982+0000 7f574d1ea780 1 > prepared operation key=ZGE1860DMGHA tag=3E9YWTOAU7MJ type=del size=2123420 2024-09-12T17:18:15.985 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.984+0000 7f574d1ea780 1 < suggested update operation key=55JI541K1WP2 tag=RT68OA0IP9AX type=del size=2600028 2024-09-12T17:18:15.986 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.985+0000 7f574d1ea780 1 > prepared operation key=ZGH8XC39FGTC tag=B1282O3KE25L type=del size=2011165 2024-09-12T17:18:15.988 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.987+0000 7f574d1ea780 1 < completed part key=_multipart_RWVWJHVZE95H.2~ZRF9R0F8TNQG.0 size=1048576 2024-09-12T17:18:15.989 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.988+0000 7f574d1ea780 1 < completed part key=_multipart_RWVWJHVZE95H.2~ZRF9R0F8TNQG.1 size=83392 2024-09-12T17:18:15.991 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.990+0000 7f574d1ea780 1 < completed multipart upload key=RWVWJHVZE95H upload=ZRF9R0F8TNQG tag=RPO69QCR97F4 type=write size=2180544 2024-09-12T17:18:15.993 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.992+0000 7f574d1ea780 1 > prepared part key=_multipart_SQQMJ61CA0QW.2~NO9P7BSQSCID.0 size=1048576 2024-09-12T17:18:15.994 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.993+0000 7f574d1ea780 1 > prepared part key=_multipart_SQQMJ61CA0QW.2~NO9P7BSQSCID.1 size=1048576 2024-09-12T17:18:15.995 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.994+0000 7f574d1ea780 1 > prepared part key=_multipart_SQQMJ61CA0QW.2~NO9P7BSQSCID.2 size=327946 2024-09-12T17:18:15.995 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.994+0000 7f574d1ea780 1 > prepared multipart upload key=SQQMJ61CA0QW upload=NO9P7BSQSCID tag=SUNLV2RCIOT2 type=write size=3473674 2024-09-12T17:18:15.997 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.996+0000 7f574d1ea780 1 < suggested update operation key=QXD8UG2K4STQ tag=YWJHTV24QVDB type=del size=44218 2024-09-12T17:18:15.998 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.998+0000 7f574d1ea780 1 > prepared operation key=54LQ91UMBJAN tag=67TAOTOBEN0Q type=del size=2046466 2024-09-12T17:18:16.000 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:15.999+0000 7f574d1ea780 1 < completed write operation key=HGZMN894YYC0 tag=QJER72F6BWPI type=write size=1021842 2024-09-12T17:18:16.002 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.001+0000 7f574d1ea780 1 > prepared part key=_multipart_ZGE1860DMGHA.2~PFDIY76A415O.0 size=853676 2024-09-12T17:18:16.002 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.001+0000 7f574d1ea780 1 > prepared multipart upload key=ZGE1860DMGHA upload=PFDIY76A415O tag=G2Y4C40K2VCP type=write size=1902252 2024-09-12T17:18:16.003 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.002+0000 7f574d1ea780 1 < completed part key=_multipart_A1TIP3RXHBCZ.2~FUXPZQQGO3DB.0 size=190258 2024-09-12T17:18:16.005 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.005+0000 7f574d1ea780 1 < completed multipart upload key=A1TIP3RXHBCZ upload=FUXPZQQGO3DB tag=XUBTK3IJ05SR type=write size=1238834 2024-09-12T17:18:16.007 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.006+0000 7f574d1ea780 1 > prepared operation key=UFKM4I8RMT0W tag=FH09ML73BEPO type=del size=4018498 2024-09-12T17:18:16.007 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.006+0000 7f574d1ea780 1 < canceled part key=_multipart_GEGOEB05R0PK.2~96QTJC3WBNI6.0 size=1048576 2024-09-12T17:18:16.008 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.007+0000 7f574d1ea780 1 < completed part key=_multipart_GEGOEB05R0PK.2~96QTJC3WBNI6.1 size=1048576 2024-09-12T17:18:16.009 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.008+0000 7f574d1ea780 1 < completed part key=_multipart_GEGOEB05R0PK.2~96QTJC3WBNI6.2 size=176862 2024-09-12T17:18:16.013 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.012+0000 7f574d1ea780 1 < canceled multipart upload key=GEGOEB05R0PK upload=96QTJC3WBNI6 tag=56F7SA8E9F8I type=write size=3322590 2024-09-12T17:18:16.016 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.015+0000 7f574d1ea780 1 > prepared operation key=HFWA7DNUMWF2 tag=NPQUASRL74LW type=del size=3073642 2024-09-12T17:18:16.017 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.016+0000 7f574d1ea780 1 < completed delete operation key=GEGOEB05R0PK tag=R9MLH2TBJPIC type=del 2024-09-12T17:18:16.018 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.018+0000 7f574d1ea780 1 > prepared operation key=8VW3XCUHLF2L tag=G5K2QO8RTVA9 type=del size=2110994 2024-09-12T17:18:16.020 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.019+0000 7f574d1ea780 1 < completed part key=_multipart_54LQ91UMBJAN.2~3GL392FQFKEK.0 size=1048576 2024-09-12T17:18:16.021 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.020+0000 7f574d1ea780 1 < completed part key=_multipart_54LQ91UMBJAN.2~3GL392FQFKEK.1 size=185181 2024-09-12T17:18:16.023 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.022+0000 7f574d1ea780 1 < completed multipart upload key=54LQ91UMBJAN upload=3GL392FQFKEK tag=1D0SL8VS6R68 type=write size=2282333 2024-09-12T17:18:16.024 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.024+0000 7f574d1ea780 1 > prepared operation key=SQQMJ61CA0QW tag=P7U9YNWPXHPR type=write size=753540 2024-09-12T17:18:16.026 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.025+0000 7f574d1ea780 1 < completed part key=_multipart_54LQ91UMBJAN.2~9T3NEKHO5X7Z.0 size=1048576 2024-09-12T17:18:16.027 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.026+0000 7f574d1ea780 1 < completed part key=_multipart_54LQ91UMBJAN.2~9T3NEKHO5X7Z.1 size=383157 2024-09-12T17:18:16.029 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.028+0000 7f574d1ea780 1 < completed multipart upload key=54LQ91UMBJAN upload=9T3NEKHO5X7Z tag=20RX3M7IU9XG type=write size=2480309 2024-09-12T17:18:16.031 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.031+0000 7f574d1ea780 1 > prepared part key=_multipart_RNI86YYLADT0.2~D11P9VRGCVYI.0 size=1048576 2024-09-12T17:18:16.032 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.031+0000 7f574d1ea780 1 > prepared part key=_multipart_RNI86YYLADT0.2~D11P9VRGCVYI.1 size=155085 2024-09-12T17:18:16.032 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.031+0000 7f574d1ea780 1 > prepared multipart upload key=RNI86YYLADT0 upload=D11P9VRGCVYI tag=GRMZO7X8JNYL type=write size=2252237 2024-09-12T17:18:16.034 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.033+0000 7f574d1ea780 1 < completed part key=_multipart_RWVWJHVZE95H.2~ZZ33BQ1HMASW.0 size=786532 2024-09-12T17:18:16.036 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.035+0000 7f574d1ea780 1 < completed multipart upload key=RWVWJHVZE95H upload=ZZ33BQ1HMASW tag=B5MG9QKBS0W2 type=write size=1835108 2024-09-12T17:18:16.037 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.036+0000 7f574d1ea780 1 > prepared operation key=YXIDO0U18839 tag=YQ2V6OQEVSJA type=del size=1928859 2024-09-12T17:18:16.037 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.036+0000 7f574d1ea780 1 < canceled part key=_multipart_HFWA7DNUMWF2.2~73ECKJN1MAWU.0 size=1048576 2024-09-12T17:18:16.038 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.037+0000 7f574d1ea780 1 < completed part key=_multipart_HFWA7DNUMWF2.2~73ECKJN1MAWU.1 size=1048576 2024-09-12T17:18:16.039 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.038+0000 7f574d1ea780 1 < completed part key=_multipart_HFWA7DNUMWF2.2~73ECKJN1MAWU.2 size=596614 2024-09-12T17:18:16.041 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.040+0000 7f574d1ea780 1 < canceled multipart upload key=HFWA7DNUMWF2 upload=73ECKJN1MAWU tag=QP8X2ZTN7U5D type=write size=3742342 2024-09-12T17:18:16.043 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.042+0000 7f574d1ea780 1 > prepared part key=_multipart_K12MVG618809.2~XINYN5X7AAVD.0 size=94713 2024-09-12T17:18:16.043 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.042+0000 7f574d1ea780 1 > prepared multipart upload key=K12MVG618809 upload=XINYN5X7AAVD tag=9VCMIHL3R1TU type=write size=1143289 2024-09-12T17:18:16.045 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.044+0000 7f574d1ea780 1 < completed part key=_multipart_UFKM4I8RMT0W.2~EO4P7W6DSB5H.0 size=910404 2024-09-12T17:18:16.046 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.046+0000 7f574d1ea780 1 < completed multipart upload key=UFKM4I8RMT0W upload=EO4P7W6DSB5H tag=KSHLD3VEINSF type=write size=1958980 2024-09-12T17:18:16.049 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.048+0000 7f574d1ea780 1 > prepared part key=_multipart_OI51GO639LFK.2~R0AKXHSKKBUD.0 size=1048576 2024-09-12T17:18:16.050 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.049+0000 7f574d1ea780 1 > prepared part key=_multipart_OI51GO639LFK.2~R0AKXHSKKBUD.1 size=963044 2024-09-12T17:18:16.050 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.049+0000 7f574d1ea780 1 > prepared multipart upload key=OI51GO639LFK upload=R0AKXHSKKBUD tag=IIW0CF7NFZBO type=write size=3060196 2024-09-12T17:18:16.051 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.050+0000 7f574d1ea780 1 < completed part key=_multipart_54CM8800AT9V.2~UHIVLNOOGQIW.0 size=1048576 2024-09-12T17:18:16.052 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.051+0000 7f574d1ea780 1 < completed part key=_multipart_54CM8800AT9V.2~UHIVLNOOGQIW.1 size=413110 2024-09-12T17:18:16.054 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.053+0000 7f574d1ea780 1 < completed multipart upload key=54CM8800AT9V upload=UHIVLNOOGQIW tag=GO8P2CTXXKV5 type=write size=2510262 2024-09-12T17:18:16.055 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.055+0000 7f574d1ea780 1 > prepared operation key=54LQ91UMBJAN tag=ZF9FHWFYURUS type=del size=1814213 2024-09-12T17:18:16.057 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.056+0000 7f574d1ea780 1 < completed delete operation key=D1GEG3MKPOM3 tag=3I6BC33NZVTJ type=del 2024-09-12T17:18:16.059 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.058+0000 7f574d1ea780 1 > prepared part key=_multipart_R00F69ON5P6Z.2~02E1BO50Z31S.0 size=383290 2024-09-12T17:18:16.059 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.058+0000 7f574d1ea780 1 > prepared multipart upload key=R00F69ON5P6Z upload=02E1BO50Z31S tag=FU6SJ3JFYY03 type=write size=1431866 2024-09-12T17:18:16.060 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.059+0000 7f574d1ea780 1 < completed part key=_multipart_VWWA5IB0L4N1.2~WL0YQC8V4APA.0 size=1048576 2024-09-12T17:18:16.061 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.061+0000 7f574d1ea780 1 < completed part key=_multipart_VWWA5IB0L4N1.2~WL0YQC8V4APA.1 size=1048576 2024-09-12T17:18:16.062 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.062+0000 7f574d1ea780 1 < completed part key=_multipart_VWWA5IB0L4N1.2~WL0YQC8V4APA.2 size=13360 2024-09-12T17:18:16.065 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.064+0000 7f574d1ea780 1 < completed multipart upload key=VWWA5IB0L4N1 upload=WL0YQC8V4APA tag=03RU727BB5U4 type=write size=3159088 2024-09-12T17:18:16.066 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.065+0000 7f574d1ea780 1 > prepared operation key=54CM8800AT9V tag=0JQGSXO2SSUN type=write size=523318 2024-09-12T17:18:16.067 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.066+0000 7f574d1ea780 1 < completed delete operation key=ZGE1860DMGHA tag=3E9YWTOAU7MJ type=del 2024-09-12T17:18:16.069 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.068+0000 7f574d1ea780 1 > prepared operation key=R00F69ON5P6Z tag=FOZ49WG6LS8U type=del size=278732 2024-09-12T17:18:16.070 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.069+0000 7f574d1ea780 1 < completed delete operation key=ZGH8XC39FGTC tag=B1282O3KE25L type=del 2024-09-12T17:18:16.071 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.070+0000 7f574d1ea780 1 > prepared operation key=ZGH8XC39FGTC tag=Q3ECO26TBVCI type=del size=3047274 2024-09-12T17:18:16.072 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.071+0000 7f574d1ea780 1 < completed part key=_multipart_SQQMJ61CA0QW.2~NO9P7BSQSCID.0 size=1048576 2024-09-12T17:18:16.074 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.073+0000 7f574d1ea780 1 < completed part key=_multipart_SQQMJ61CA0QW.2~NO9P7BSQSCID.1 size=1048576 2024-09-12T17:18:16.074 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.073+0000 7f574d1ea780 1 < canceled part key=_multipart_SQQMJ61CA0QW.2~NO9P7BSQSCID.2 size=327946 2024-09-12T17:18:16.076 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.075+0000 7f574d1ea780 1 < canceled multipart upload key=SQQMJ61CA0QW upload=NO9P7BSQSCID tag=SUNLV2RCIOT2 type=write size=3473674 2024-09-12T17:18:16.077 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.076+0000 7f574d1ea780 1 > prepared operation key=D1GEG3MKPOM3 tag=ZQAVU8084DMK type=del size=358703 2024-09-12T17:18:16.078 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.078+0000 7f574d1ea780 1 < completed delete operation key=54LQ91UMBJAN tag=67TAOTOBEN0Q type=del 2024-09-12T17:18:16.080 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.080+0000 7f574d1ea780 1 > prepared part key=_multipart_TIKBUXFPVTN1.2~N700ULFNILY3.0 size=588035 2024-09-12T17:18:16.081 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.080+0000 7f574d1ea780 1 > prepared multipart upload key=TIKBUXFPVTN1 upload=N700ULFNILY3 tag=Z5I9D7T2E0NH type=write size=1636611 2024-09-12T17:18:16.082 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.081+0000 7f574d1ea780 1 < completed part key=_multipart_ZGE1860DMGHA.2~PFDIY76A415O.0 size=853676 2024-09-12T17:18:16.084 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.083+0000 7f574d1ea780 1 < completed multipart upload key=ZGE1860DMGHA upload=PFDIY76A415O tag=G2Y4C40K2VCP type=write size=1902252 2024-09-12T17:18:16.085 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.084+0000 7f574d1ea780 1 > prepared operation key=A1TIP3RXHBCZ tag=DTB153SS99YT type=del size=1212877 2024-09-12T17:18:16.086 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.085+0000 7f574d1ea780 1 < completed delete operation key=UFKM4I8RMT0W tag=FH09ML73BEPO type=del 2024-09-12T17:18:16.088 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.087+0000 7f574d1ea780 1 > prepared operation key=8VW3XCUHLF2L tag=RDTCWA39J43N type=del size=1217296 2024-09-12T17:18:16.090 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.089+0000 7f574d1ea780 1 < suggested remove operation key=HFWA7DNUMWF2 tag=NPQUASRL74LW type=del 2024-09-12T17:18:16.091 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.090+0000 7f574d1ea780 1 > prepared operation key=TIKBUXFPVTN1 tag=31PN4V8JLN12 type=del size=4018760 2024-09-12T17:18:16.094 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.093+0000 7f574d1ea780 1 < suggested update operation key=8VW3XCUHLF2L tag=G5K2QO8RTVA9 type=del size=2110994 2024-09-12T17:18:16.095 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.094+0000 7f574d1ea780 1 > prepared operation key=HFWA7DNUMWF2 tag=LH6PUAC9FY4T type=del size=2642854 2024-09-12T17:18:16.096 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.095+0000 7f574d1ea780 1 < completed write operation key=SQQMJ61CA0QW tag=P7U9YNWPXHPR type=write size=753540 2024-09-12T17:18:16.097 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.096+0000 7f574d1ea780 1 > prepared operation key=A1TIP3RXHBCZ tag=71I07F27ZFA2 type=del size=3656008 2024-09-12T17:18:16.098 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.098+0000 7f574d1ea780 1 < completed part key=_multipart_RNI86YYLADT0.2~D11P9VRGCVYI.0 size=1048576 2024-09-12T17:18:16.099 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.099+0000 7f574d1ea780 1 < completed part key=_multipart_RNI86YYLADT0.2~D11P9VRGCVYI.1 size=155085 2024-09-12T17:18:16.101 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.101+0000 7f574d1ea780 1 < completed multipart upload key=RNI86YYLADT0 upload=D11P9VRGCVYI tag=GRMZO7X8JNYL type=write size=2252237 2024-09-12T17:18:16.103 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.102+0000 7f574d1ea780 1 > prepared operation key=HFWA7DNUMWF2 tag=EHCATEDBVTWN type=del size=3331108 2024-09-12T17:18:16.104 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.103+0000 7f574d1ea780 1 < canceled operation key=YXIDO0U18839 tag=YQ2V6OQEVSJA type=del size=1928859 2024-09-12T17:18:16.106 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.105+0000 7f574d1ea780 1 > prepared part key=_multipart_RWVWJHVZE95H.2~5LK0VV5XT04L.0 size=1048576 2024-09-12T17:18:16.107 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.106+0000 7f574d1ea780 1 > prepared part key=_multipart_RWVWJHVZE95H.2~5LK0VV5XT04L.1 size=1048576 2024-09-12T17:18:16.108 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.107+0000 7f574d1ea780 1 > prepared part key=_multipart_RWVWJHVZE95H.2~5LK0VV5XT04L.2 size=792975 2024-09-12T17:18:16.108 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.107+0000 7f574d1ea780 1 > prepared multipart upload key=RWVWJHVZE95H upload=5LK0VV5XT04L tag=N6S3PEWRADPD type=write size=3938703 2024-09-12T17:18:16.109 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.108+0000 7f574d1ea780 1 < completed part key=_multipart_K12MVG618809.2~XINYN5X7AAVD.0 size=94713 2024-09-12T17:18:16.111 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.111+0000 7f574d1ea780 1 < completed multipart upload key=K12MVG618809 upload=XINYN5X7AAVD tag=9VCMIHL3R1TU type=write size=1143289 2024-09-12T17:18:16.113 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.112+0000 7f574d1ea780 1 > prepared operation key=VWWA5IB0L4N1 tag=N2COCWBPZKXZ type=write size=21571 2024-09-12T17:18:16.114 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.113+0000 7f574d1ea780 1 < completed part key=_multipart_OI51GO639LFK.2~R0AKXHSKKBUD.0 size=1048576 2024-09-12T17:18:16.115 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.114+0000 7f574d1ea780 1 < completed part key=_multipart_OI51GO639LFK.2~R0AKXHSKKBUD.1 size=963044 2024-09-12T17:18:16.117 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.117+0000 7f574d1ea780 1 < completed multipart upload key=OI51GO639LFK upload=R0AKXHSKKBUD tag=IIW0CF7NFZBO type=write size=3060196 2024-09-12T17:18:16.119 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.118+0000 7f574d1ea780 1 > prepared operation key=RNI86YYLADT0 tag=2QKYQQRIJZ90 type=del size=4118337 2024-09-12T17:18:16.120 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.119+0000 7f574d1ea780 1 < completed delete operation key=54LQ91UMBJAN tag=ZF9FHWFYURUS type=del 2024-09-12T17:18:16.121 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.121+0000 7f574d1ea780 1 > prepared operation key=43GV2N9VBBKE tag=ZIR5ROBWMZV9 type=del size=3861512 2024-09-12T17:18:16.123 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.122+0000 7f574d1ea780 1 < completed part key=_multipart_R00F69ON5P6Z.2~02E1BO50Z31S.0 size=383290 2024-09-12T17:18:16.125 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.124+0000 7f574d1ea780 1 < completed multipart upload key=R00F69ON5P6Z upload=02E1BO50Z31S tag=FU6SJ3JFYY03 type=write size=1431866 2024-09-12T17:18:16.126 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.125+0000 7f574d1ea780 1 > prepared operation key=D1GEG3MKPOM3 tag=3QTAY9FHO0ZZ type=write size=1028883 2024-09-12T17:18:16.128 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.127+0000 7f574d1ea780 1 < completed write operation key=54CM8800AT9V tag=0JQGSXO2SSUN type=write size=523318 2024-09-12T17:18:16.131 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.130+0000 7f574d1ea780 1 > prepared part key=_multipart_VWWA5IB0L4N1.2~K72ZIEB2R0B2.0 size=1048576 2024-09-12T17:18:16.132 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.131+0000 7f574d1ea780 1 > prepared part key=_multipart_VWWA5IB0L4N1.2~K72ZIEB2R0B2.1 size=1048576 2024-09-12T17:18:16.133 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.132+0000 7f574d1ea780 1 > prepared part key=_multipart_VWWA5IB0L4N1.2~K72ZIEB2R0B2.2 size=940422 2024-09-12T17:18:16.133 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.132+0000 7f574d1ea780 1 > prepared multipart upload key=VWWA5IB0L4N1 upload=K72ZIEB2R0B2 tag=I4YBVJNB1IE0 type=write size=4086150 2024-09-12T17:18:16.134 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.133+0000 7f574d1ea780 1 < completed delete operation key=R00F69ON5P6Z tag=FOZ49WG6LS8U type=del 2024-09-12T17:18:16.135 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.135+0000 7f574d1ea780 1 > prepared operation key=U6E9A5OH4GUW tag=KXKRKAA02I7Q type=del size=2564684 2024-09-12T17:18:16.137 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.136+0000 7f574d1ea780 1 < completed delete operation key=ZGH8XC39FGTC tag=Q3ECO26TBVCI type=del 2024-09-12T17:18:16.138 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.137+0000 7f574d1ea780 1 > prepared operation key=8VW3XCUHLF2L tag=OQHYKBMN1HM2 type=del size=53828 2024-09-12T17:18:16.140 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.139+0000 7f574d1ea780 1 < suggested remove operation key=D1GEG3MKPOM3 tag=ZQAVU8084DMK type=del 2024-09-12T17:18:16.141 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.141+0000 7f574d1ea780 1 > prepared operation key=ZGE1860DMGHA tag=8X6BH1GMLD9A type=del size=1239147 2024-09-12T17:18:16.143 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.142+0000 7f574d1ea780 1 < completed part key=_multipart_TIKBUXFPVTN1.2~N700ULFNILY3.0 size=588035 2024-09-12T17:18:16.145 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.144+0000 7f574d1ea780 1 < completed multipart upload key=TIKBUXFPVTN1 upload=N700ULFNILY3 tag=Z5I9D7T2E0NH type=write size=1636611 2024-09-12T17:18:16.147 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.146+0000 7f574d1ea780 1 > prepared part key=_multipart_A1TIP3RXHBCZ.2~AEVSX5C307R6.0 size=1048576 2024-09-12T17:18:16.148 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.147+0000 7f574d1ea780 1 > prepared part key=_multipart_A1TIP3RXHBCZ.2~AEVSX5C307R6.1 size=1048576 2024-09-12T17:18:16.149 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.148+0000 7f574d1ea780 1 > prepared part key=_multipart_A1TIP3RXHBCZ.2~AEVSX5C307R6.2 size=984753 2024-09-12T17:18:16.149 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.148+0000 7f574d1ea780 1 > prepared multipart upload key=A1TIP3RXHBCZ upload=AEVSX5C307R6 tag=HVWJHA0CAZL7 type=write size=4130481 2024-09-12T17:18:16.150 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.149+0000 7f574d1ea780 1 < completed delete operation key=A1TIP3RXHBCZ tag=DTB153SS99YT type=del 2024-09-12T17:18:16.151 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.151+0000 7f574d1ea780 1 > prepared operation key=SQQMJ61CA0QW tag=8VYI401V0G9H type=del size=2579630 2024-09-12T17:18:16.153 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.152+0000 7f574d1ea780 -1 < failed to complete operation key=8VW3XCUHLF2L tag=RDTCWA39J43N type=del size=1217296: (22) Invalid argument 2024-09-12T17:18:16.154 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.153+0000 7f574d1ea780 1 > prepared operation key=8SG7DJO4HWPI tag=0G59AMWBSCNL type=write size=930588 2024-09-12T17:18:16.155 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.155+0000 7f574d1ea780 1 < completed delete operation key=TIKBUXFPVTN1 tag=31PN4V8JLN12 type=del 2024-09-12T17:18:16.157 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.156+0000 7f574d1ea780 1 > prepared operation key=QXD8UG2K4STQ tag=VGSXFJDGT8XI type=del size=1742493 2024-09-12T17:18:16.158 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.157+0000 7f574d1ea780 1 < completed delete operation key=HFWA7DNUMWF2 tag=LH6PUAC9FY4T type=del 2024-09-12T17:18:16.159 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.158+0000 7f574d1ea780 1 > prepared operation key=SQQMJ61CA0QW tag=EM4O4FOLBXRF type=del size=4082517 2024-09-12T17:18:16.162 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.161+0000 7f574d1ea780 1 < suggested update operation key=A1TIP3RXHBCZ tag=71I07F27ZFA2 type=del size=3656008 2024-09-12T17:18:16.165 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.164+0000 7f574d1ea780 1 > prepared operation key=HFWA7DNUMWF2 tag=PDF4H91NSQFP type=del size=1454794 2024-09-12T17:18:16.167 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.166+0000 7f574d1ea780 1 < suggested update operation key=HFWA7DNUMWF2 tag=EHCATEDBVTWN type=del size=3331108 2024-09-12T17:18:16.169 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.168+0000 7f574d1ea780 1 > prepared operation key=54LQ91UMBJAN tag=IWJGSPVQJXHC type=del size=2914880 2024-09-12T17:18:16.170 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.169+0000 7f574d1ea780 1 < completed part key=_multipart_RWVWJHVZE95H.2~5LK0VV5XT04L.0 size=1048576 2024-09-12T17:18:16.171 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.170+0000 7f574d1ea780 1 < completed part key=_multipart_RWVWJHVZE95H.2~5LK0VV5XT04L.1 size=1048576 2024-09-12T17:18:16.172 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.172+0000 7f574d1ea780 1 < completed part key=_multipart_RWVWJHVZE95H.2~5LK0VV5XT04L.2 size=792975 2024-09-12T17:18:16.174 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.174+0000 7f574d1ea780 1 < completed multipart upload key=RWVWJHVZE95H upload=5LK0VV5XT04L tag=N6S3PEWRADPD type=write size=3938703 2024-09-12T17:18:16.177 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.176+0000 7f574d1ea780 1 > prepared part key=_multipart_HGZMN894YYC0.2~0M9GT5B31CK0.0 size=916337 2024-09-12T17:18:16.177 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.176+0000 7f574d1ea780 1 > prepared multipart upload key=HGZMN894YYC0 upload=0M9GT5B31CK0 tag=UP6XDH5PQY8P type=write size=1964913 2024-09-12T17:18:16.179 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.178+0000 7f574d1ea780 1 < suggested remove operation key=VWWA5IB0L4N1 tag=N2COCWBPZKXZ type=write 2024-09-12T17:18:16.181 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.180+0000 7f574d1ea780 1 > prepared part key=_multipart_UFKM4I8RMT0W.2~HFWQ88NTRZXA.0 size=1048576 2024-09-12T17:18:16.182 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.181+0000 7f574d1ea780 1 > prepared part key=_multipart_UFKM4I8RMT0W.2~HFWQ88NTRZXA.1 size=1048576 2024-09-12T17:18:16.183 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.182+0000 7f574d1ea780 1 > prepared part key=_multipart_UFKM4I8RMT0W.2~HFWQ88NTRZXA.2 size=518632 2024-09-12T17:18:16.183 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.182+0000 7f574d1ea780 1 > prepared multipart upload key=UFKM4I8RMT0W upload=HFWQ88NTRZXA tag=0O84R41COT3P type=write size=3664360 2024-09-12T17:18:16.184 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.183+0000 7f574d1ea780 1 < completed delete operation key=RNI86YYLADT0 tag=2QKYQQRIJZ90 type=del 2024-09-12T17:18:16.185 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.185+0000 7f574d1ea780 1 > prepared operation key=8VW3XCUHLF2L tag=G7DB5VKZQCDU type=del size=2046534 2024-09-12T17:18:16.187 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.186+0000 7f574d1ea780 1 < completed delete operation key=43GV2N9VBBKE tag=ZIR5ROBWMZV9 type=del 2024-09-12T17:18:16.188 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.187+0000 7f574d1ea780 1 > prepared operation key=Q2Q3B1J3DAVD tag=YNRML5BSP820 type=del size=2540927 2024-09-12T17:18:16.189 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.188+0000 7f574d1ea780 -1 < failed to complete operation key=D1GEG3MKPOM3 tag=3QTAY9FHO0ZZ type=write size=1028883: (22) Invalid argument 2024-09-12T17:18:16.191 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.190+0000 7f574d1ea780 1 > prepared part key=_multipart_SQQMJ61CA0QW.2~Y383C2IXMCY5.0 size=82469 2024-09-12T17:18:16.191 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.190+0000 7f574d1ea780 1 > prepared multipart upload key=SQQMJ61CA0QW upload=Y383C2IXMCY5 tag=D67I9VUSTF32 type=write size=1131045 2024-09-12T17:18:16.193 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.192+0000 7f574d1ea780 1 < completed part key=_multipart_VWWA5IB0L4N1.2~K72ZIEB2R0B2.0 size=1048576 2024-09-12T17:18:16.197 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.193+0000 7f574d1ea780 1 < completed part key=_multipart_VWWA5IB0L4N1.2~K72ZIEB2R0B2.1 size=1048576 2024-09-12T17:18:16.197 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.194+0000 7f574d1ea780 1 < completed part key=_multipart_VWWA5IB0L4N1.2~K72ZIEB2R0B2.2 size=940422 2024-09-12T17:18:16.197 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.196+0000 7f574d1ea780 1 < completed multipart upload key=VWWA5IB0L4N1 upload=K72ZIEB2R0B2 tag=I4YBVJNB1IE0 type=write size=4086150 2024-09-12T17:18:16.199 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.198+0000 7f574d1ea780 1 > prepared part key=_multipart_ZGE1860DMGHA.2~053PHO6DZOV8.0 size=1048576 2024-09-12T17:18:16.200 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.199+0000 7f574d1ea780 1 > prepared part key=_multipart_ZGE1860DMGHA.2~053PHO6DZOV8.1 size=230563 2024-09-12T17:18:16.200 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.199+0000 7f574d1ea780 1 > prepared multipart upload key=ZGE1860DMGHA upload=053PHO6DZOV8 tag=9S2HE4S5SWFE type=write size=2327715 2024-09-12T17:18:16.202 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.201+0000 7f574d1ea780 1 < suggested update operation key=U6E9A5OH4GUW tag=KXKRKAA02I7Q type=del size=2564684 2024-09-12T17:18:16.204 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.203+0000 7f574d1ea780 1 > prepared part key=_multipart_U6E9A5OH4GUW.2~NYEA6SQ1FW16.0 size=819955 2024-09-12T17:18:16.205 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.203+0000 7f574d1ea780 1 > prepared multipart upload key=U6E9A5OH4GUW upload=NYEA6SQ1FW16 tag=IHRQUSEH2HEA type=write size=1868531 2024-09-12T17:18:16.205 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.205+0000 7f574d1ea780 1 < completed delete operation key=8VW3XCUHLF2L tag=OQHYKBMN1HM2 type=del 2024-09-12T17:18:16.208 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.207+0000 7f574d1ea780 1 > prepared part key=_multipart_C9IYR9CET1I8.2~7WXHEC2O0XKE.0 size=1048576 2024-09-12T17:18:16.209 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.208+0000 7f574d1ea780 1 > prepared part key=_multipart_C9IYR9CET1I8.2~7WXHEC2O0XKE.1 size=1048576 2024-09-12T17:18:16.210 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.209+0000 7f574d1ea780 1 > prepared part key=_multipart_C9IYR9CET1I8.2~7WXHEC2O0XKE.2 size=95244 2024-09-12T17:18:16.210 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.209+0000 7f574d1ea780 1 > prepared multipart upload key=C9IYR9CET1I8 upload=7WXHEC2O0XKE tag=AGG6BRR3543H type=write size=3240972 2024-09-12T17:18:16.211 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.210+0000 7f574d1ea780 1 < completed delete operation key=ZGE1860DMGHA tag=8X6BH1GMLD9A type=del 2024-09-12T17:18:16.213 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.212+0000 7f574d1ea780 1 > prepared part key=_multipart_UTCKL1F42X8A.2~ESZJ8NS02FPP.0 size=991109 2024-09-12T17:18:16.213 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.212+0000 7f574d1ea780 1 > prepared multipart upload key=UTCKL1F42X8A upload=ESZJ8NS02FPP tag=6APNUNQ0UJJE type=write size=2039685 2024-09-12T17:18:16.214 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.214+0000 7f574d1ea780 1 < completed part key=_multipart_A1TIP3RXHBCZ.2~AEVSX5C307R6.0 size=1048576 2024-09-12T17:18:16.216 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.215+0000 7f574d1ea780 1 < completed part key=_multipart_A1TIP3RXHBCZ.2~AEVSX5C307R6.1 size=1048576 2024-09-12T17:18:16.217 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.216+0000 7f574d1ea780 1 < completed part key=_multipart_A1TIP3RXHBCZ.2~AEVSX5C307R6.2 size=984753 2024-09-12T17:18:16.219 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.218+0000 7f574d1ea780 1 < completed multipart upload key=A1TIP3RXHBCZ upload=AEVSX5C307R6 tag=HVWJHA0CAZL7 type=write size=4130481 2024-09-12T17:18:16.221 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.220+0000 7f574d1ea780 1 > prepared part key=_multipart_R00F69ON5P6Z.2~P883N9FR8R08.0 size=792972 2024-09-12T17:18:16.222 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.220+0000 7f574d1ea780 1 > prepared multipart upload key=R00F69ON5P6Z upload=P883N9FR8R08 tag=0LFZ6MH9TCQJ type=write size=1841548 2024-09-12T17:18:16.223 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.222+0000 7f574d1ea780 1 < completed delete operation key=SQQMJ61CA0QW tag=8VYI401V0G9H type=del 2024-09-12T17:18:16.225 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.224+0000 7f574d1ea780 1 > prepared part key=_multipart_C9IYR9CET1I8.2~LXHWLYMYTCNQ.0 size=816419 2024-09-12T17:18:16.225 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.224+0000 7f574d1ea780 1 > prepared multipart upload key=C9IYR9CET1I8 upload=LXHWLYMYTCNQ tag=G78XH8MYL28L type=write size=1864995 2024-09-12T17:18:16.226 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.225+0000 7f574d1ea780 1 < completed write operation key=8SG7DJO4HWPI tag=0G59AMWBSCNL type=write size=930588 2024-09-12T17:18:16.227 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.227+0000 7f574d1ea780 1 > prepared operation key=7BX38Q7723EB tag=7KXJWCO2MGNF type=del size=3317205 2024-09-12T17:18:16.229 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.228+0000 7f574d1ea780 1 < completed delete operation key=QXD8UG2K4STQ tag=VGSXFJDGT8XI type=del 2024-09-12T17:18:16.230 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.229+0000 7f574d1ea780 1 > prepared operation key=SQQMJ61CA0QW tag=C2VO8VIV67L2 type=del size=3914433 2024-09-12T17:18:16.231 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.231+0000 7f574d1ea780 1 < completed delete operation key=SQQMJ61CA0QW tag=EM4O4FOLBXRF type=del 2024-09-12T17:18:16.233 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.232+0000 7f574d1ea780 1 > prepared operation key=54CM8800AT9V tag=XFPJPMV8VUUQ type=del size=2688959 2024-09-12T17:18:16.234 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.233+0000 7f574d1ea780 -1 < failed to complete operation key=HFWA7DNUMWF2 tag=PDF4H91NSQFP type=del size=1454794: (22) Invalid argument 2024-09-12T17:18:16.235 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.234+0000 7f574d1ea780 1 > prepared operation key=D1GEG3MKPOM3 tag=2OEB4KAX8ZTY type=write size=1044389 2024-09-12T17:18:16.237 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.236+0000 7f574d1ea780 1 < completed delete operation key=54LQ91UMBJAN tag=IWJGSPVQJXHC type=del 2024-09-12T17:18:16.239 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.238+0000 7f574d1ea780 1 > prepared part key=_multipart_HFWA7DNUMWF2.2~N12TDBQ5C9EY.0 size=1048576 2024-09-12T17:18:16.240 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.239+0000 7f574d1ea780 1 > prepared part key=_multipart_HFWA7DNUMWF2.2~N12TDBQ5C9EY.1 size=1048576 2024-09-12T17:18:16.241 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.240+0000 7f574d1ea780 1 > prepared part key=_multipart_HFWA7DNUMWF2.2~N12TDBQ5C9EY.2 size=802389 2024-09-12T17:18:16.241 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.240+0000 7f574d1ea780 1 > prepared multipart upload key=HFWA7DNUMWF2 upload=N12TDBQ5C9EY tag=Z5OQMFL1N7OK type=write size=3948117 2024-09-12T17:18:16.242 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.242+0000 7f574d1ea780 1 < completed part key=_multipart_HGZMN894YYC0.2~0M9GT5B31CK0.0 size=916337 2024-09-12T17:18:16.244 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.244+0000 7f574d1ea780 1 < completed multipart upload key=HGZMN894YYC0 upload=0M9GT5B31CK0 tag=UP6XDH5PQY8P type=write size=1964913 2024-09-12T17:18:16.246 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.245+0000 7f574d1ea780 1 > prepared operation key=UFKM4I8RMT0W tag=PNG0J3RUS88C type=write size=151482 2024-09-12T17:18:16.247 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.246+0000 7f574d1ea780 1 < completed part key=_multipart_UFKM4I8RMT0W.2~HFWQ88NTRZXA.0 size=1048576 2024-09-12T17:18:16.248 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.247+0000 7f574d1ea780 1 < completed part key=_multipart_UFKM4I8RMT0W.2~HFWQ88NTRZXA.1 size=1048576 2024-09-12T17:18:16.248 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.247+0000 7f574d1ea780 1 < canceled part key=_multipart_UFKM4I8RMT0W.2~HFWQ88NTRZXA.2 size=518632 2024-09-12T17:18:16.252 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.251+0000 7f574d1ea780 1 < canceled multipart upload key=UFKM4I8RMT0W upload=HFWQ88NTRZXA tag=0O84R41COT3P type=write size=3664360 2024-09-12T17:18:16.253 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.252+0000 7f574d1ea780 1 > prepared operation key=VWWA5IB0L4N1 tag=TCJWNWOG7GUS type=del size=75204 2024-09-12T17:18:16.255 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.254+0000 7f574d1ea780 1 < completed delete operation key=8VW3XCUHLF2L tag=G7DB5VKZQCDU type=del 2024-09-12T17:18:16.257 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.256+0000 7f574d1ea780 1 > prepared operation key=ENFNIFHQ3SHW tag=JV401WRPY6VM type=write size=291705 2024-09-12T17:18:16.258 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.257+0000 7f574d1ea780 1 < completed delete operation key=Q2Q3B1J3DAVD tag=YNRML5BSP820 type=del 2024-09-12T17:18:16.259 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.258+0000 7f574d1ea780 1 > prepared operation key=ZGH8XC39FGTC tag=14P8SQBXSQU0 type=del size=2582696 2024-09-12T17:18:16.261 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.260+0000 7f574d1ea780 1 < completed part key=_multipart_SQQMJ61CA0QW.2~Y383C2IXMCY5.0 size=82469 2024-09-12T17:18:16.262 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.262+0000 7f574d1ea780 1 < completed multipart upload key=SQQMJ61CA0QW upload=Y383C2IXMCY5 tag=D67I9VUSTF32 type=write size=1131045 2024-09-12T17:18:16.265 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.264+0000 7f574d1ea780 1 > prepared part key=_multipart_R00F69ON5P6Z.2~FG3RPCFBWTXF.0 size=1048576 2024-09-12T17:18:16.266 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.265+0000 7f574d1ea780 1 > prepared part key=_multipart_R00F69ON5P6Z.2~FG3RPCFBWTXF.1 size=719248 2024-09-12T17:18:16.266 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.265+0000 7f574d1ea780 1 > prepared multipart upload key=R00F69ON5P6Z upload=FG3RPCFBWTXF tag=48KPF91HK4L4 type=write size=2816400 2024-09-12T17:18:16.267 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.266+0000 7f574d1ea780 1 < completed part key=_multipart_ZGE1860DMGHA.2~053PHO6DZOV8.0 size=1048576 2024-09-12T17:18:16.268 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.267+0000 7f574d1ea780 1 < completed part key=_multipart_ZGE1860DMGHA.2~053PHO6DZOV8.1 size=230563 2024-09-12T17:18:16.270 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.269+0000 7f574d1ea780 1 < completed multipart upload key=ZGE1860DMGHA upload=053PHO6DZOV8 tag=9S2HE4S5SWFE type=write size=2327715 2024-09-12T17:18:16.271 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.271+0000 7f574d1ea780 1 > prepared operation key=OI51GO639LFK tag=OPZRI11RGJA1 type=del size=2177189 2024-09-12T17:18:16.273 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.272+0000 7f574d1ea780 1 < completed part key=_multipart_U6E9A5OH4GUW.2~NYEA6SQ1FW16.0 size=819955 2024-09-12T17:18:16.275 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.274+0000 7f574d1ea780 1 < completed multipart upload key=U6E9A5OH4GUW upload=NYEA6SQ1FW16 tag=IHRQUSEH2HEA type=write size=1868531 2024-09-12T17:18:16.276 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.275+0000 7f574d1ea780 1 > prepared operation key=55V137SY4E4P tag=FEX0DAOT7VTJ type=del size=1166340 2024-09-12T17:18:16.278 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.277+0000 7f574d1ea780 1 < completed part key=_multipart_C9IYR9CET1I8.2~7WXHEC2O0XKE.0 size=1048576 2024-09-12T17:18:16.279 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.278+0000 7f574d1ea780 1 < completed part key=_multipart_C9IYR9CET1I8.2~7WXHEC2O0XKE.1 size=1048576 2024-09-12T17:18:16.280 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.279+0000 7f574d1ea780 1 < completed part key=_multipart_C9IYR9CET1I8.2~7WXHEC2O0XKE.2 size=95244 2024-09-12T17:18:16.282 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.281+0000 7f574d1ea780 1 < completed multipart upload key=C9IYR9CET1I8 upload=7WXHEC2O0XKE tag=AGG6BRR3543H type=write size=3240972 2024-09-12T17:18:16.284 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.283+0000 7f574d1ea780 1 > prepared operation key=8VW3XCUHLF2L tag=8VI4QZ3N92S1 type=del size=3250297 2024-09-12T17:18:16.285 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.284+0000 7f574d1ea780 1 < completed part key=_multipart_UTCKL1F42X8A.2~ESZJ8NS02FPP.0 size=991109 2024-09-12T17:18:16.287 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.286+0000 7f574d1ea780 1 < completed multipart upload key=UTCKL1F42X8A upload=ESZJ8NS02FPP tag=6APNUNQ0UJJE type=write size=2039685 2024-09-12T17:18:16.288 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.287+0000 7f574d1ea780 1 > prepared operation key=ENFNIFHQ3SHW tag=8KQLNC3K1Q92 type=del size=3301214 2024-09-12T17:18:16.289 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.289+0000 7f574d1ea780 1 < completed part key=_multipart_R00F69ON5P6Z.2~P883N9FR8R08.0 size=792972 2024-09-12T17:18:16.292 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.291+0000 7f574d1ea780 1 < completed multipart upload key=R00F69ON5P6Z upload=P883N9FR8R08 tag=0LFZ6MH9TCQJ type=write size=1841548 2024-09-12T17:18:16.294 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.293+0000 7f574d1ea780 1 > prepared part key=_multipart_7BX38Q7723EB.2~3O2QFSQBGQFH.0 size=1048576 2024-09-12T17:18:16.295 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.294+0000 7f574d1ea780 1 > prepared part key=_multipart_7BX38Q7723EB.2~3O2QFSQBGQFH.1 size=288119 2024-09-12T17:18:16.295 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.294+0000 7f574d1ea780 1 > prepared multipart upload key=7BX38Q7723EB upload=3O2QFSQBGQFH tag=3FBVUUDKOYXY type=write size=2385271 2024-09-12T17:18:16.296 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.295+0000 7f574d1ea780 1 < completed part key=_multipart_C9IYR9CET1I8.2~LXHWLYMYTCNQ.0 size=816419 2024-09-12T17:18:16.298 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.297+0000 7f574d1ea780 1 < completed multipart upload key=C9IYR9CET1I8 upload=LXHWLYMYTCNQ tag=G78XH8MYL28L type=write size=1864995 2024-09-12T17:18:16.299 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.299+0000 7f574d1ea780 1 > prepared operation key=VWWA5IB0L4N1 tag=M3HPV5532W76 type=del size=1457312 2024-09-12T17:18:16.302 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.301+0000 7f574d1ea780 1 < suggested update operation key=7BX38Q7723EB tag=7KXJWCO2MGNF type=del size=3317205 2024-09-12T17:18:16.304 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.303+0000 7f574d1ea780 1 > prepared part key=_multipart_SQQMJ61CA0QW.2~1SYR4HO2X2H9.0 size=1048576 2024-09-12T17:18:16.305 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.304+0000 7f574d1ea780 1 > prepared part key=_multipart_SQQMJ61CA0QW.2~1SYR4HO2X2H9.1 size=1048576 2024-09-12T17:18:16.306 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.305+0000 7f574d1ea780 1 > prepared part key=_multipart_SQQMJ61CA0QW.2~1SYR4HO2X2H9.2 size=423173 2024-09-12T17:18:16.306 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.305+0000 7f574d1ea780 1 > prepared multipart upload key=SQQMJ61CA0QW upload=1SYR4HO2X2H9 tag=IL9JQDEQ9HT7 type=write size=3568901 2024-09-12T17:18:16.307 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.306+0000 7f574d1ea780 1 < canceled operation key=SQQMJ61CA0QW tag=C2VO8VIV67L2 type=del size=3914433 2024-09-12T17:18:16.310 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.309+0000 7f574d1ea780 1 > prepared part key=_multipart_TIKBUXFPVTN1.2~FDFTHH0DWHLX.0 size=1048576 2024-09-12T17:18:16.311 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.310+0000 7f574d1ea780 1 > prepared part key=_multipart_TIKBUXFPVTN1.2~FDFTHH0DWHLX.1 size=968548 2024-09-12T17:18:16.311 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.310+0000 7f574d1ea780 1 > prepared multipart upload key=TIKBUXFPVTN1 upload=FDFTHH0DWHLX tag=FUH6EZSB1TY3 type=write size=3065700 2024-09-12T17:18:16.312 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.311+0000 7f574d1ea780 1 < completed delete operation key=54CM8800AT9V tag=XFPJPMV8VUUQ type=del 2024-09-12T17:18:16.313 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.312+0000 7f574d1ea780 1 > prepared operation key=RWVWJHVZE95H tag=N3DMNU3Y1DJZ type=write size=73418 2024-09-12T17:18:16.315 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.314+0000 7f574d1ea780 1 < completed write operation key=D1GEG3MKPOM3 tag=2OEB4KAX8ZTY type=write size=1044389 2024-09-12T17:18:16.317 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.316+0000 7f574d1ea780 1 > prepared part key=_multipart_Q2Q3B1J3DAVD.2~46YD4JI1KHEJ.0 size=740599 2024-09-12T17:18:16.317 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.316+0000 7f574d1ea780 1 > prepared multipart upload key=Q2Q3B1J3DAVD upload=46YD4JI1KHEJ tag=04KCC47NIDPT type=write size=1789175 2024-09-12T17:18:16.318 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.317+0000 7f574d1ea780 1 < completed part key=_multipart_HFWA7DNUMWF2.2~N12TDBQ5C9EY.0 size=1048576 2024-09-12T17:18:16.319 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.318+0000 7f574d1ea780 1 < completed part key=_multipart_HFWA7DNUMWF2.2~N12TDBQ5C9EY.1 size=1048576 2024-09-12T17:18:16.320 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.319+0000 7f574d1ea780 1 < completed part key=_multipart_HFWA7DNUMWF2.2~N12TDBQ5C9EY.2 size=802389 2024-09-12T17:18:16.322 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.321+0000 7f574d1ea780 1 < completed multipart upload key=HFWA7DNUMWF2 upload=N12TDBQ5C9EY tag=Z5OQMFL1N7OK type=write size=3948117 2024-09-12T17:18:16.324 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.323+0000 7f574d1ea780 1 > prepared part key=_multipart_YXIDO0U18839.2~S7S37IPUBNAK.0 size=315418 2024-09-12T17:18:16.324 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.323+0000 7f574d1ea780 1 > prepared multipart upload key=YXIDO0U18839 upload=S7S37IPUBNAK tag=QX4FKYZ1IFSF type=write size=1363994 2024-09-12T17:18:16.325 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.325+0000 7f574d1ea780 1 < completed write operation key=UFKM4I8RMT0W tag=PNG0J3RUS88C type=write size=151482 2024-09-12T17:18:16.327 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.326+0000 7f574d1ea780 1 > prepared operation key=54CM8800AT9V tag=7CAQWRLRG09C type=del size=815059 2024-09-12T17:18:16.328 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.327+0000 7f574d1ea780 1 < completed delete operation key=VWWA5IB0L4N1 tag=TCJWNWOG7GUS type=del 2024-09-12T17:18:16.329 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.328+0000 7f574d1ea780 1 > prepared operation key=HGZMN894YYC0 tag=I0BOWZVLBPVD type=del size=106412 2024-09-12T17:18:16.330 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.330+0000 7f574d1ea780 1 < completed write operation key=ENFNIFHQ3SHW tag=JV401WRPY6VM type=write size=291705 2024-09-12T17:18:16.332 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.331+0000 7f574d1ea780 1 > prepared operation key=ENFNIFHQ3SHW tag=VLD2AZAQNX1N type=del size=1021791 2024-09-12T17:18:16.333 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.332+0000 7f574d1ea780 1 < completed delete operation key=ZGH8XC39FGTC tag=14P8SQBXSQU0 type=del 2024-09-12T17:18:16.334 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.333+0000 7f574d1ea780 1 > prepared operation key=43GV2N9VBBKE tag=WRMMOF7BJ5E2 type=del size=2371717 2024-09-12T17:18:16.335 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.334+0000 7f574d1ea780 1 < completed part key=_multipart_R00F69ON5P6Z.2~FG3RPCFBWTXF.0 size=1048576 2024-09-12T17:18:16.336 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.335+0000 7f574d1ea780 1 < completed part key=_multipart_R00F69ON5P6Z.2~FG3RPCFBWTXF.1 size=719248 2024-09-12T17:18:16.338 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.337+0000 7f574d1ea780 1 < completed multipart upload key=R00F69ON5P6Z upload=FG3RPCFBWTXF tag=48KPF91HK4L4 type=write size=2816400 2024-09-12T17:18:16.339 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.339+0000 7f574d1ea780 1 > prepared operation key=HGZMN894YYC0 tag=1IW43D09XN1D type=del size=3472619 2024-09-12T17:18:16.341 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.340+0000 7f574d1ea780 1 < completed delete operation key=OI51GO639LFK tag=OPZRI11RGJA1 type=del 2024-09-12T17:18:16.343 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.342+0000 7f574d1ea780 1 > prepared part key=_multipart_R00F69ON5P6Z.2~KMFF91USSKS9.0 size=1048576 2024-09-12T17:18:16.344 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.343+0000 7f574d1ea780 1 > prepared part key=_multipart_R00F69ON5P6Z.2~KMFF91USSKS9.1 size=174925 2024-09-12T17:18:16.344 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.343+0000 7f574d1ea780 1 > prepared multipart upload key=R00F69ON5P6Z upload=KMFF91USSKS9 tag=7TDKY4ZDPRDX type=write size=2272077 2024-09-12T17:18:16.345 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.344+0000 7f574d1ea780 1 < completed delete operation key=55V137SY4E4P tag=FEX0DAOT7VTJ type=del 2024-09-12T17:18:16.346 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.345+0000 7f574d1ea780 1 > prepared operation key=VWWA5IB0L4N1 tag=UZS2S6ER5W4D type=del size=893623 2024-09-12T17:18:16.348 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.347+0000 7f574d1ea780 1 < completed delete operation key=8VW3XCUHLF2L tag=8VI4QZ3N92S1 type=del 2024-09-12T17:18:16.349 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.348+0000 7f574d1ea780 1 > prepared operation key=C9IYR9CET1I8 tag=Q4NRPMR0J5KC type=write size=621240 2024-09-12T17:18:16.350 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.349+0000 7f574d1ea780 1 < completed delete operation key=ENFNIFHQ3SHW tag=8KQLNC3K1Q92 type=del 2024-09-12T17:18:16.352 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.351+0000 7f574d1ea780 1 > prepared operation key=RWVWJHVZE95H tag=Y1UNUNP1I7YN type=del size=2874680 2024-09-12T17:18:16.353 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.352+0000 7f574d1ea780 1 < completed part key=_multipart_7BX38Q7723EB.2~3O2QFSQBGQFH.0 size=1048576 2024-09-12T17:18:16.354 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.353+0000 7f574d1ea780 1 < completed part key=_multipart_7BX38Q7723EB.2~3O2QFSQBGQFH.1 size=288119 2024-09-12T17:18:16.356 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.355+0000 7f574d1ea780 1 < completed multipart upload key=7BX38Q7723EB upload=3O2QFSQBGQFH tag=3FBVUUDKOYXY type=write size=2385271 2024-09-12T17:18:16.358 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.357+0000 7f574d1ea780 1 > prepared operation key=ZGH8XC39FGTC tag=2DDBF96IX134 type=del size=377655 2024-09-12T17:18:16.359 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.358+0000 7f574d1ea780 1 < completed delete operation key=VWWA5IB0L4N1 tag=M3HPV5532W76 type=del 2024-09-12T17:18:16.360 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.359+0000 7f574d1ea780 1 > prepared operation key=7BX38Q7723EB tag=48XIKINXX41Y type=del size=1000085 2024-09-12T17:18:16.361 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.360+0000 7f574d1ea780 1 < completed part key=_multipart_SQQMJ61CA0QW.2~1SYR4HO2X2H9.0 size=1048576 2024-09-12T17:18:16.361 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.360+0000 7f574d1ea780 1 < canceled part key=_multipart_SQQMJ61CA0QW.2~1SYR4HO2X2H9.1 size=1048576 2024-09-12T17:18:16.362 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.362+0000 7f574d1ea780 1 < completed part key=_multipart_SQQMJ61CA0QW.2~1SYR4HO2X2H9.2 size=423173 2024-09-12T17:18:16.364 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.364+0000 7f574d1ea780 1 < canceled multipart upload key=SQQMJ61CA0QW upload=1SYR4HO2X2H9 tag=IL9JQDEQ9HT7 type=write size=3568901 2024-09-12T17:18:16.366 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.365+0000 7f574d1ea780 1 > prepared operation key=8VW3XCUHLF2L tag=KB3GBLLYSQX6 type=del size=446553 2024-09-12T17:18:16.367 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.366+0000 7f574d1ea780 1 < completed part key=_multipart_TIKBUXFPVTN1.2~FDFTHH0DWHLX.0 size=1048576 2024-09-12T17:18:16.369 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.368+0000 7f574d1ea780 1 < completed part key=_multipart_TIKBUXFPVTN1.2~FDFTHH0DWHLX.1 size=968548 2024-09-12T17:18:16.371 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.371+0000 7f574d1ea780 1 < completed multipart upload key=TIKBUXFPVTN1 upload=FDFTHH0DWHLX tag=FUH6EZSB1TY3 type=write size=3065700 2024-09-12T17:18:16.373 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.372+0000 7f574d1ea780 1 > prepared operation key=VWWA5IB0L4N1 tag=HIN5R0QUI9U2 type=del size=2541993 2024-09-12T17:18:16.375 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.374+0000 7f574d1ea780 1 < suggested update operation key=RWVWJHVZE95H tag=N3DMNU3Y1DJZ type=write size=73418 2024-09-12T17:18:16.377 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.375+0000 7f574d1ea780 1 > prepared operation key=55V137SY4E4P tag=2CDT4E28MLT3 type=del size=554379 2024-09-12T17:18:16.378 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.377+0000 7f574d1ea780 1 < completed part key=_multipart_Q2Q3B1J3DAVD.2~46YD4JI1KHEJ.0 size=740599 2024-09-12T17:18:16.379 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.379+0000 7f574d1ea780 1 < completed multipart upload key=Q2Q3B1J3DAVD upload=46YD4JI1KHEJ tag=04KCC47NIDPT type=write size=1789175 2024-09-12T17:18:16.382 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.381+0000 7f574d1ea780 1 > prepared part key=_multipart_DH02JGZP64MN.2~OCD2DU3MD7WW.0 size=1048576 2024-09-12T17:18:16.382 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.382+0000 7f574d1ea780 1 > prepared part key=_multipart_DH02JGZP64MN.2~OCD2DU3MD7WW.1 size=1048576 2024-09-12T17:18:16.383 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.383+0000 7f574d1ea780 1 > prepared part key=_multipart_DH02JGZP64MN.2~OCD2DU3MD7WW.2 size=290347 2024-09-12T17:18:16.384 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.383+0000 7f574d1ea780 1 > prepared multipart upload key=DH02JGZP64MN upload=OCD2DU3MD7WW tag=9PIUIA84K4HG type=write size=3436075 2024-09-12T17:18:16.385 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.384+0000 7f574d1ea780 1 < completed part key=_multipart_YXIDO0U18839.2~S7S37IPUBNAK.0 size=315418 2024-09-12T17:18:16.387 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.386+0000 7f574d1ea780 1 < completed multipart upload key=YXIDO0U18839 upload=S7S37IPUBNAK tag=QX4FKYZ1IFSF type=write size=1363994 2024-09-12T17:18:16.388 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.387+0000 7f574d1ea780 1 > prepared operation key=YXIDO0U18839 tag=MTBG7Y4DJJGB type=write size=441096 2024-09-12T17:18:16.389 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.388+0000 7f574d1ea780 1 < canceled operation key=54CM8800AT9V tag=7CAQWRLRG09C type=del size=815059 2024-09-12T17:18:16.392 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.391+0000 7f574d1ea780 1 > prepared part key=_multipart_K12MVG618809.2~GR9AF9FL5KET.0 size=1048576 2024-09-12T17:18:16.392 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.392+0000 7f574d1ea780 1 > prepared part key=_multipart_K12MVG618809.2~GR9AF9FL5KET.1 size=422774 2024-09-12T17:18:16.393 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.392+0000 7f574d1ea780 1 > prepared multipart upload key=K12MVG618809 upload=GR9AF9FL5KET tag=WZT85RVN4PG5 type=write size=2519926 2024-09-12T17:18:16.394 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.393+0000 7f574d1ea780 1 < completed delete operation key=HGZMN894YYC0 tag=I0BOWZVLBPVD type=del 2024-09-12T17:18:16.395 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.394+0000 7f574d1ea780 1 > prepared operation key=GEGOEB05R0PK tag=L6O2RASLG40S type=del size=2061652 2024-09-12T17:18:16.398 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.397+0000 7f574d1ea780 1 < suggested update operation key=ENFNIFHQ3SHW tag=VLD2AZAQNX1N type=del size=1021791 2024-09-12T17:18:16.401 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.399+0000 7f574d1ea780 1 > prepared operation key=43GV2N9VBBKE tag=EVIZ7Y8IU8QI type=del size=172300 2024-09-12T17:18:16.401 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.400+0000 7f574d1ea780 1 < canceled operation key=43GV2N9VBBKE tag=WRMMOF7BJ5E2 type=del size=2371717 2024-09-12T17:18:16.402 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.401+0000 7f574d1ea780 1 > prepared operation key=C9IYR9CET1I8 tag=MH6PEENM5IVV type=del size=2721184 2024-09-12T17:18:16.403 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.402+0000 7f574d1ea780 1 < completed delete operation key=HGZMN894YYC0 tag=1IW43D09XN1D type=del 2024-09-12T17:18:16.404 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.404+0000 7f574d1ea780 1 > prepared operation key=8VW3XCUHLF2L tag=HGOVCM0PLQWC type=write size=1012269 2024-09-12T17:18:16.406 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.405+0000 7f574d1ea780 1 < completed part key=_multipart_R00F69ON5P6Z.2~KMFF91USSKS9.0 size=1048576 2024-09-12T17:18:16.407 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.406+0000 7f574d1ea780 1 < completed part key=_multipart_R00F69ON5P6Z.2~KMFF91USSKS9.1 size=174925 2024-09-12T17:18:16.409 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.408+0000 7f574d1ea780 1 < completed multipart upload key=R00F69ON5P6Z upload=KMFF91USSKS9 tag=7TDKY4ZDPRDX type=write size=2272077 2024-09-12T17:18:16.412 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.411+0000 7f574d1ea780 1 > prepared part key=_multipart_ZGE1860DMGHA.2~K5L6JW53T2HS.0 size=1048576 2024-09-12T17:18:16.413 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.412+0000 7f574d1ea780 1 > prepared part key=_multipart_ZGE1860DMGHA.2~K5L6JW53T2HS.1 size=663599 2024-09-12T17:18:16.413 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.412+0000 7f574d1ea780 1 > prepared multipart upload key=ZGE1860DMGHA upload=K5L6JW53T2HS tag=UFQ5DBBH1FXX type=write size=2760751 2024-09-12T17:18:16.414 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.413+0000 7f574d1ea780 1 < completed delete operation key=VWWA5IB0L4N1 tag=UZS2S6ER5W4D type=del 2024-09-12T17:18:16.416 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.415+0000 7f574d1ea780 1 > prepared operation key=55V137SY4E4P tag=5RC915L0ZCSD type=del size=4111394 2024-09-12T17:18:16.417 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.416+0000 7f574d1ea780 1 < completed write operation key=C9IYR9CET1I8 tag=Q4NRPMR0J5KC type=write size=621240 2024-09-12T17:18:16.418 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.418+0000 7f574d1ea780 1 > prepared operation key=ZGH8XC39FGTC tag=A88DI8EY9C31 type=del size=860284 2024-09-12T17:18:16.420 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.419+0000 7f574d1ea780 -1 < failed to complete operation key=RWVWJHVZE95H tag=Y1UNUNP1I7YN type=del size=2874680: (22) Invalid argument 2024-09-12T17:18:16.421 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.420+0000 7f574d1ea780 1 > prepared operation key=K12MVG618809 tag=YE5CE1DI91FB type=write size=772633 2024-09-12T17:18:16.423 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.422+0000 7f574d1ea780 1 < completed delete operation key=ZGH8XC39FGTC tag=2DDBF96IX134 type=del 2024-09-12T17:18:16.424 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.423+0000 7f574d1ea780 1 > prepared operation key=DH02JGZP64MN tag=N8CH3HDPDNPZ type=del size=3386717 2024-09-12T17:18:16.426 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.425+0000 7f574d1ea780 1 < completed delete operation key=7BX38Q7723EB tag=48XIKINXX41Y type=del 2024-09-12T17:18:16.428 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.427+0000 7f574d1ea780 1 > prepared part key=_multipart_54CM8800AT9V.2~7VJMNBJMZ40A.0 size=1048576 2024-09-12T17:18:16.429 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.428+0000 7f574d1ea780 1 > prepared part key=_multipart_54CM8800AT9V.2~7VJMNBJMZ40A.1 size=413291 2024-09-12T17:18:16.429 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.428+0000 7f574d1ea780 1 > prepared multipart upload key=54CM8800AT9V upload=7VJMNBJMZ40A tag=F6A3OP4AF7U9 type=write size=2510443 2024-09-12T17:18:16.431 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.430+0000 7f574d1ea780 1 < completed delete operation key=8VW3XCUHLF2L tag=KB3GBLLYSQX6 type=del 2024-09-12T17:18:16.432 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.431+0000 7f574d1ea780 1 > prepared operation key=K12MVG618809 tag=795OLSE6274I type=del size=1003530 2024-09-12T17:18:16.433 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.433+0000 7f574d1ea780 1 < completed delete operation key=VWWA5IB0L4N1 tag=HIN5R0QUI9U2 type=del 2024-09-12T17:18:16.435 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.434+0000 7f574d1ea780 1 > prepared operation key=RNI86YYLADT0 tag=1TRENNU1MRID type=del size=3700964 2024-09-12T17:18:16.438 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.437+0000 7f574d1ea780 1 < suggested update operation key=55V137SY4E4P tag=2CDT4E28MLT3 type=del size=554379 2024-09-12T17:18:16.440 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.440+0000 7f574d1ea780 1 > prepared part key=_multipart_RNI86YYLADT0.2~A7SZOSUA31L3.0 size=502450 2024-09-12T17:18:16.440 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.440+0000 7f574d1ea780 1 > prepared multipart upload key=RNI86YYLADT0 upload=A7SZOSUA31L3 tag=ZF0Z94OBR5IZ type=write size=1551026 2024-09-12T17:18:16.442 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.441+0000 7f574d1ea780 1 < completed part key=_multipart_DH02JGZP64MN.2~OCD2DU3MD7WW.0 size=1048576 2024-09-12T17:18:16.443 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.442+0000 7f574d1ea780 1 < completed part key=_multipart_DH02JGZP64MN.2~OCD2DU3MD7WW.1 size=1048576 2024-09-12T17:18:16.444 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.443+0000 7f574d1ea780 1 < completed part key=_multipart_DH02JGZP64MN.2~OCD2DU3MD7WW.2 size=290347 2024-09-12T17:18:16.446 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.446+0000 7f574d1ea780 1 < completed multipart upload key=DH02JGZP64MN upload=OCD2DU3MD7WW tag=9PIUIA84K4HG type=write size=3436075 2024-09-12T17:18:16.448 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.447+0000 7f574d1ea780 1 > prepared operation key=54LQ91UMBJAN tag=D7FJF46R36SF type=del size=3784681 2024-09-12T17:18:16.449 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.448+0000 7f574d1ea780 1 < completed write operation key=YXIDO0U18839 tag=MTBG7Y4DJJGB type=write size=441096 2024-09-12T17:18:16.451 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.450+0000 7f574d1ea780 1 > prepared operation key=GEGOEB05R0PK tag=FCXD6J90AGKV type=del size=3143682 2024-09-12T17:18:16.452 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.451+0000 7f574d1ea780 1 < completed part key=_multipart_K12MVG618809.2~GR9AF9FL5KET.0 size=1048576 2024-09-12T17:18:16.453 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.452+0000 7f574d1ea780 1 < completed part key=_multipart_K12MVG618809.2~GR9AF9FL5KET.1 size=422774 2024-09-12T17:18:16.455 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.455+0000 7f574d1ea780 1 < completed multipart upload key=K12MVG618809 upload=GR9AF9FL5KET tag=WZT85RVN4PG5 type=write size=2519926 2024-09-12T17:18:16.458 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.457+0000 7f574d1ea780 1 > prepared part key=_multipart_OI51GO639LFK.2~AM9Q27F2180Y.0 size=617674 2024-09-12T17:18:16.458 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.457+0000 7f574d1ea780 1 > prepared multipart upload key=OI51GO639LFK upload=AM9Q27F2180Y tag=L91MXLR1967Q type=write size=1666250 2024-09-12T17:18:16.459 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.458+0000 7f574d1ea780 1 < completed delete operation key=GEGOEB05R0PK tag=L6O2RASLG40S type=del 2024-09-12T17:18:16.460 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.459+0000 7f574d1ea780 1 > prepared operation key=Q2Q3B1J3DAVD tag=Q0PMHRTBH7E3 type=del size=3555243 2024-09-12T17:18:16.462 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.461+0000 7f574d1ea780 1 < completed delete operation key=43GV2N9VBBKE tag=EVIZ7Y8IU8QI type=del 2024-09-12T17:18:16.464 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.463+0000 7f574d1ea780 1 > prepared part key=_multipart_K12MVG618809.2~Z034LGFHA0WX.0 size=1048576 2024-09-12T17:18:16.465 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.465+0000 7f574d1ea780 1 > prepared part key=_multipart_K12MVG618809.2~Z034LGFHA0WX.1 size=1048576 2024-09-12T17:18:16.466 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.466+0000 7f574d1ea780 1 > prepared part key=_multipart_K12MVG618809.2~Z034LGFHA0WX.2 size=991538 2024-09-12T17:18:16.467 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.466+0000 7f574d1ea780 1 > prepared multipart upload key=K12MVG618809 upload=Z034LGFHA0WX tag=WQK9G9S48PLE type=write size=4137266 2024-09-12T17:18:16.468 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.467+0000 7f574d1ea780 1 < canceled operation key=C9IYR9CET1I8 tag=MH6PEENM5IVV type=del size=2721184 2024-09-12T17:18:16.470 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.469+0000 7f574d1ea780 1 > prepared part key=_multipart_RWVWJHVZE95H.2~CYLSKCF9SMMA.0 size=1048576 2024-09-12T17:18:16.471 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.470+0000 7f574d1ea780 1 > prepared part key=_multipart_RWVWJHVZE95H.2~CYLSKCF9SMMA.1 size=445652 2024-09-12T17:18:16.471 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.470+0000 7f574d1ea780 1 > prepared multipart upload key=RWVWJHVZE95H upload=CYLSKCF9SMMA tag=I2UFPDDXZ1HU type=write size=2542804 2024-09-12T17:18:16.473 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.472+0000 7f574d1ea780 1 < completed write operation key=8VW3XCUHLF2L tag=HGOVCM0PLQWC type=write size=1012269 2024-09-12T17:18:16.474 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.473+0000 7f574d1ea780 1 > prepared operation key=8VW3XCUHLF2L tag=CDCIC7O2CEOO type=write size=131528 2024-09-12T17:18:16.474 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.473+0000 7f574d1ea780 1 < canceled part key=_multipart_ZGE1860DMGHA.2~K5L6JW53T2HS.0 size=1048576 2024-09-12T17:18:16.475 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.474+0000 7f574d1ea780 1 < completed part key=_multipart_ZGE1860DMGHA.2~K5L6JW53T2HS.1 size=663599 2024-09-12T17:18:16.477 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.476+0000 7f574d1ea780 1 < canceled multipart upload key=ZGE1860DMGHA upload=K5L6JW53T2HS tag=UFQ5DBBH1FXX type=write size=2760751 2024-09-12T17:18:16.478 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.478+0000 7f574d1ea780 1 > prepared operation key=8VW3XCUHLF2L tag=WPQ5BSP13SRV type=del size=2682307 2024-09-12T17:18:16.481 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.480+0000 7f574d1ea780 1 < suggested remove operation key=55V137SY4E4P tag=5RC915L0ZCSD type=del 2024-09-12T17:18:16.483 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.482+0000 7f574d1ea780 1 > prepared part key=_multipart_R00F69ON5P6Z.2~QJYF9X2L8273.0 size=113996 2024-09-12T17:18:16.483 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.482+0000 7f574d1ea780 1 > prepared multipart upload key=R00F69ON5P6Z upload=QJYF9X2L8273 tag=HZ7GV6PPP019 type=write size=1162572 2024-09-12T17:18:16.485 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.484+0000 7f574d1ea780 1 < completed delete operation key=ZGH8XC39FGTC tag=A88DI8EY9C31 type=del 2024-09-12T17:18:16.487 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.486+0000 7f574d1ea780 1 > prepared part key=_multipart_D1GEG3MKPOM3.2~FKOHJ2LW146G.0 size=1048576 2024-09-12T17:18:16.488 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.487+0000 7f574d1ea780 1 > prepared part key=_multipart_D1GEG3MKPOM3.2~FKOHJ2LW146G.1 size=1048576 2024-09-12T17:18:16.489 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.488+0000 7f574d1ea780 1 > prepared part key=_multipart_D1GEG3MKPOM3.2~FKOHJ2LW146G.2 size=638755 2024-09-12T17:18:16.489 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.488+0000 7f574d1ea780 1 > prepared multipart upload key=D1GEG3MKPOM3 upload=FKOHJ2LW146G tag=V49O4S255NYY type=write size=3784483 2024-09-12T17:18:16.492 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.491+0000 7f574d1ea780 1 < suggested update operation key=K12MVG618809 tag=YE5CE1DI91FB type=write size=772633 2024-09-12T17:18:16.495 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.494+0000 7f574d1ea780 1 > prepared operation key=RWVWJHVZE95H tag=HMNMZ1IY3FZQ type=del size=1330859 2024-09-12T17:18:16.496 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.496+0000 7f574d1ea780 1 < completed delete operation key=DH02JGZP64MN tag=N8CH3HDPDNPZ type=del 2024-09-12T17:18:16.498 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.497+0000 7f574d1ea780 1 > prepared operation key=QXD8UG2K4STQ tag=KUNT2RFGRXQU type=del size=1997634 2024-09-12T17:18:16.498 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.497+0000 7f574d1ea780 1 < canceled part key=_multipart_54CM8800AT9V.2~7VJMNBJMZ40A.0 size=1048576 2024-09-12T17:18:16.499 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.498+0000 7f574d1ea780 1 < completed part key=_multipart_54CM8800AT9V.2~7VJMNBJMZ40A.1 size=413291 2024-09-12T17:18:16.502 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.501+0000 7f574d1ea780 1 < canceled multipart upload key=54CM8800AT9V upload=7VJMNBJMZ40A tag=F6A3OP4AF7U9 type=write size=2510443 2024-09-12T17:18:16.504 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.503+0000 7f574d1ea780 1 > prepared part key=_multipart_OI51GO639LFK.2~DIVUCVZ2KYQB.0 size=788394 2024-09-12T17:18:16.504 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.503+0000 7f574d1ea780 1 > prepared multipart upload key=OI51GO639LFK upload=DIVUCVZ2KYQB tag=HOG8U4YF18JS type=write size=1836970 2024-09-12T17:18:16.506 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.505+0000 7f574d1ea780 -1 < failed to complete operation key=K12MVG618809 tag=795OLSE6274I type=del size=1003530: (22) Invalid argument 2024-09-12T17:18:16.507 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.506+0000 7f574d1ea780 1 > prepared operation key=8VW3XCUHLF2L tag=C4HI54Q2JYS4 type=write size=541619 2024-09-12T17:18:16.509 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.508+0000 7f574d1ea780 1 < canceled operation key=RNI86YYLADT0 tag=1TRENNU1MRID type=del size=3700964 2024-09-12T17:18:16.510 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.509+0000 7f574d1ea780 1 > prepared operation key=DH02JGZP64MN tag=J4EKEIWK18KB type=del size=3892096 2024-09-12T17:18:16.511 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.510+0000 7f574d1ea780 1 < completed part key=_multipart_RNI86YYLADT0.2~A7SZOSUA31L3.0 size=502450 2024-09-12T17:18:16.514 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.513+0000 7f574d1ea780 1 < completed multipart upload key=RNI86YYLADT0 upload=A7SZOSUA31L3 tag=ZF0Z94OBR5IZ type=write size=1551026 2024-09-12T17:18:16.516 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.515+0000 7f574d1ea780 1 > prepared part key=_multipart_TIKBUXFPVTN1.2~EMH23KMT236O.0 size=640629 2024-09-12T17:18:16.516 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.515+0000 7f574d1ea780 1 > prepared multipart upload key=TIKBUXFPVTN1 upload=EMH23KMT236O tag=Q2MA31XY9QIA type=write size=1689205 2024-09-12T17:18:16.518 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.517+0000 7f574d1ea780 1 < completed delete operation key=54LQ91UMBJAN tag=D7FJF46R36SF type=del 2024-09-12T17:18:16.519 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.518+0000 7f574d1ea780 1 > prepared operation key=43GV2N9VBBKE tag=J9VO1L1U5HGR type=del size=3467131 2024-09-12T17:18:16.520 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.519+0000 7f574d1ea780 1 < canceled operation key=GEGOEB05R0PK tag=FCXD6J90AGKV type=del size=3143682 2024-09-12T17:18:16.522 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.522+0000 7f574d1ea780 1 > prepared part key=_multipart_43GV2N9VBBKE.2~8WN49UUW0Y8A.0 size=962582 2024-09-12T17:18:16.523 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.522+0000 7f574d1ea780 1 > prepared multipart upload key=43GV2N9VBBKE upload=8WN49UUW0Y8A tag=6RYD5I8KWKPB type=write size=2011158 2024-09-12T17:18:16.524 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.523+0000 7f574d1ea780 1 < completed part key=_multipart_OI51GO639LFK.2~AM9Q27F2180Y.0 size=617674 2024-09-12T17:18:16.526 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.525+0000 7f574d1ea780 1 < completed multipart upload key=OI51GO639LFK upload=AM9Q27F2180Y tag=L91MXLR1967Q type=write size=1666250 2024-09-12T17:18:16.527 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.526+0000 7f574d1ea780 1 > prepared operation key=SQQMJ61CA0QW tag=UB3F32EPWKN3 type=del size=1914195 2024-09-12T17:18:16.528 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.527+0000 7f574d1ea780 1 < completed delete operation key=Q2Q3B1J3DAVD tag=Q0PMHRTBH7E3 type=del 2024-09-12T17:18:16.529 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.529+0000 7f574d1ea780 1 > prepared operation key=GEGOEB05R0PK tag=NMJ8NSFYZKJ0 type=del size=3714504 2024-09-12T17:18:16.531 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.530+0000 7f574d1ea780 1 < completed part key=_multipart_K12MVG618809.2~Z034LGFHA0WX.0 size=1048576 2024-09-12T17:18:16.532 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.531+0000 7f574d1ea780 1 < completed part key=_multipart_K12MVG618809.2~Z034LGFHA0WX.1 size=1048576 2024-09-12T17:18:16.533 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.532+0000 7f574d1ea780 1 < completed part key=_multipart_K12MVG618809.2~Z034LGFHA0WX.2 size=991538 2024-09-12T17:18:16.535 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.535+0000 7f574d1ea780 1 < completed multipart upload key=K12MVG618809 upload=Z034LGFHA0WX tag=WQK9G9S48PLE type=write size=4137266 2024-09-12T17:18:16.537 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.536+0000 7f574d1ea780 1 > prepared operation key=8VW3XCUHLF2L tag=250DOJE5QWXE type=del size=3593197 2024-09-12T17:18:16.538 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.537+0000 7f574d1ea780 1 < completed part key=_multipart_RWVWJHVZE95H.2~CYLSKCF9SMMA.0 size=1048576 2024-09-12T17:18:16.539 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.538+0000 7f574d1ea780 1 < completed part key=_multipart_RWVWJHVZE95H.2~CYLSKCF9SMMA.1 size=445652 2024-09-12T17:18:16.543 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.542+0000 7f574d1ea780 1 < completed multipart upload key=RWVWJHVZE95H upload=CYLSKCF9SMMA tag=I2UFPDDXZ1HU type=write size=2542804 2024-09-12T17:18:16.547 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.546+0000 7f574d1ea780 1 > prepared part key=_multipart_8SG7DJO4HWPI.2~ANP9WE0E9GUK.0 size=1048576 2024-09-12T17:18:16.548 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.547+0000 7f574d1ea780 1 > prepared part key=_multipart_8SG7DJO4HWPI.2~ANP9WE0E9GUK.1 size=1048576 2024-09-12T17:18:16.549 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.548+0000 7f574d1ea780 1 > prepared part key=_multipart_8SG7DJO4HWPI.2~ANP9WE0E9GUK.2 size=54247 2024-09-12T17:18:16.549 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.548+0000 7f574d1ea780 1 > prepared multipart upload key=8SG7DJO4HWPI upload=ANP9WE0E9GUK tag=OH7J2BUCIOZY type=write size=3199975 2024-09-12T17:18:16.550 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.549+0000 7f574d1ea780 1 < completed write operation key=8VW3XCUHLF2L tag=CDCIC7O2CEOO type=write size=131528 2024-09-12T17:18:16.553 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.552+0000 7f574d1ea780 1 > prepared part key=_multipart_ZGE1860DMGHA.2~941L5BMC3L8W.0 size=1048576 2024-09-12T17:18:16.554 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.553+0000 7f574d1ea780 1 > prepared part key=_multipart_ZGE1860DMGHA.2~941L5BMC3L8W.1 size=297841 2024-09-12T17:18:16.554 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.553+0000 7f574d1ea780 1 > prepared multipart upload key=ZGE1860DMGHA upload=941L5BMC3L8W tag=AP2PV3QTII0J type=write size=2394993 2024-09-12T17:18:16.556 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.555+0000 7f574d1ea780 1 < suggested remove operation key=8VW3XCUHLF2L tag=WPQ5BSP13SRV type=del 2024-09-12T17:18:16.557 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.557+0000 7f574d1ea780 1 > prepared operation key=HFWA7DNUMWF2 tag=CXB0MCT67OR7 type=del size=755719 2024-09-12T17:18:16.559 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.558+0000 7f574d1ea780 1 < completed part key=_multipart_R00F69ON5P6Z.2~QJYF9X2L8273.0 size=113996 2024-09-12T17:18:16.561 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.560+0000 7f574d1ea780 1 < completed multipart upload key=R00F69ON5P6Z upload=QJYF9X2L8273 tag=HZ7GV6PPP019 type=write size=1162572 2024-09-12T17:18:16.562 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.561+0000 7f574d1ea780 1 > prepared operation key=HFWA7DNUMWF2 tag=ZA3TD8P457HQ type=del size=728631 2024-09-12T17:18:16.563 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.563+0000 7f574d1ea780 1 < completed part key=_multipart_D1GEG3MKPOM3.2~FKOHJ2LW146G.0 size=1048576 2024-09-12T17:18:16.564 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.564+0000 7f574d1ea780 1 < completed part key=_multipart_D1GEG3MKPOM3.2~FKOHJ2LW146G.1 size=1048576 2024-09-12T17:18:16.565 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.564+0000 7f574d1ea780 1 < canceled part key=_multipart_D1GEG3MKPOM3.2~FKOHJ2LW146G.2 size=638755 2024-09-12T17:18:16.567 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.566+0000 7f574d1ea780 1 < canceled multipart upload key=D1GEG3MKPOM3 upload=FKOHJ2LW146G tag=V49O4S255NYY type=write size=3784483 2024-09-12T17:18:16.568 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.567+0000 7f574d1ea780 1 > prepared operation key=A1TIP3RXHBCZ tag=0OV6ZPGB4XND type=write size=905374 2024-09-12T17:18:16.570 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.569+0000 7f574d1ea780 1 < completed delete operation key=RWVWJHVZE95H tag=HMNMZ1IY3FZQ type=del 2024-09-12T17:18:16.571 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.570+0000 7f574d1ea780 1 > prepared operation key=8VW3XCUHLF2L tag=WYP7IICI1AAW type=del size=3287459 2024-09-12T17:18:16.572 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.571+0000 7f574d1ea780 1 < completed delete operation key=QXD8UG2K4STQ tag=KUNT2RFGRXQU type=del 2024-09-12T17:18:16.573 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.573+0000 7f574d1ea780 1 > prepared operation key=Q2Q3B1J3DAVD tag=G46MVO24B250 type=write size=984244 2024-09-12T17:18:16.575 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.574+0000 7f574d1ea780 1 < completed part key=_multipart_OI51GO639LFK.2~DIVUCVZ2KYQB.0 size=788394 2024-09-12T17:18:16.577 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.576+0000 7f574d1ea780 1 < completed multipart upload key=OI51GO639LFK upload=DIVUCVZ2KYQB tag=HOG8U4YF18JS type=write size=1836970 2024-09-12T17:18:16.580 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.579+0000 7f574d1ea780 1 > prepared part key=_multipart_55JI541K1WP2.2~PHPYTHERKKV9.0 size=1048576 2024-09-12T17:18:16.581 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.580+0000 7f574d1ea780 1 > prepared part key=_multipart_55JI541K1WP2.2~PHPYTHERKKV9.1 size=568375 2024-09-12T17:18:16.581 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.580+0000 7f574d1ea780 1 > prepared multipart upload key=55JI541K1WP2 upload=PHPYTHERKKV9 tag=EMHYRCUARLDS type=write size=2665527 2024-09-12T17:18:16.583 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.582+0000 7f574d1ea780 1 < suggested update operation key=8VW3XCUHLF2L tag=C4HI54Q2JYS4 type=write size=541619 2024-09-12T17:18:16.585 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.584+0000 7f574d1ea780 1 > prepared part key=_multipart_SQQMJ61CA0QW.2~TY9BQI1XZ2XA.0 size=1048576 2024-09-12T17:18:16.586 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.585+0000 7f574d1ea780 1 > prepared part key=_multipart_SQQMJ61CA0QW.2~TY9BQI1XZ2XA.1 size=1048576 2024-09-12T17:18:16.587 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.586+0000 7f574d1ea780 1 > prepared part key=_multipart_SQQMJ61CA0QW.2~TY9BQI1XZ2XA.2 size=383427 2024-09-12T17:18:16.587 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.586+0000 7f574d1ea780 1 > prepared multipart upload key=SQQMJ61CA0QW upload=TY9BQI1XZ2XA tag=PWV2RY00BF7A type=write size=3529155 2024-09-12T17:18:16.588 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.587+0000 7f574d1ea780 1 < canceled operation key=DH02JGZP64MN tag=J4EKEIWK18KB type=del size=3892096 2024-09-12T17:18:16.591 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.590+0000 7f574d1ea780 1 > prepared part key=_multipart_R00F69ON5P6Z.2~U2ZWJLLYP8M4.0 size=1048576 2024-09-12T17:18:16.591 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.591+0000 7f574d1ea780 1 > prepared part key=_multipart_R00F69ON5P6Z.2~U2ZWJLLYP8M4.1 size=528392 2024-09-12T17:18:16.592 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.591+0000 7f574d1ea780 1 > prepared multipart upload key=R00F69ON5P6Z upload=U2ZWJLLYP8M4 tag=5ULVWGZMHUZQ type=write size=2625544 2024-09-12T17:18:16.593 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.592+0000 7f574d1ea780 1 < completed part key=_multipart_TIKBUXFPVTN1.2~EMH23KMT236O.0 size=640629 2024-09-12T17:18:16.595 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.594+0000 7f574d1ea780 1 < completed multipart upload key=TIKBUXFPVTN1 upload=EMH23KMT236O tag=Q2MA31XY9QIA type=write size=1689205 2024-09-12T17:18:16.596 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.595+0000 7f574d1ea780 1 > prepared operation key=C9IYR9CET1I8 tag=QM735PQ1VLNM type=del size=2850919 2024-09-12T17:18:16.597 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.597+0000 7f574d1ea780 1 < completed delete operation key=43GV2N9VBBKE tag=J9VO1L1U5HGR type=del 2024-09-12T17:18:16.599 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.598+0000 7f574d1ea780 1 > prepared operation key=R00F69ON5P6Z tag=0LYCMOZ1S4ZJ type=del size=1352520 2024-09-12T17:18:16.599 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.598+0000 7f574d1ea780 1 < canceled part key=_multipart_43GV2N9VBBKE.2~8WN49UUW0Y8A.0 size=962582 2024-09-12T17:18:16.604 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.600+0000 7f574d1ea780 1 < canceled multipart upload key=43GV2N9VBBKE upload=8WN49UUW0Y8A tag=6RYD5I8KWKPB type=write size=2011158 2024-09-12T17:18:16.605 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.602+0000 7f574d1ea780 1 > prepared part key=_multipart_D1GEG3MKPOM3.2~HJ8GLOFK4V37.0 size=1048576 2024-09-12T17:18:16.605 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.603+0000 7f574d1ea780 1 > prepared part key=_multipart_D1GEG3MKPOM3.2~HJ8GLOFK4V37.1 size=1048576 2024-09-12T17:18:16.605 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.604+0000 7f574d1ea780 1 > prepared part key=_multipart_D1GEG3MKPOM3.2~HJ8GLOFK4V37.2 size=155780 2024-09-12T17:18:16.606 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.604+0000 7f574d1ea780 1 > prepared multipart upload key=D1GEG3MKPOM3 upload=HJ8GLOFK4V37 tag=SU34RJ57JSR3 type=write size=3301508 2024-09-12T17:18:16.606 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.606+0000 7f574d1ea780 1 < completed delete operation key=SQQMJ61CA0QW tag=UB3F32EPWKN3 type=del 2024-09-12T17:18:16.609 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.608+0000 7f574d1ea780 1 > prepared part key=_multipart_A1TIP3RXHBCZ.2~71DZBUUD9ZTV.0 size=1048576 2024-09-12T17:18:16.610 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.609+0000 7f574d1ea780 1 > prepared part key=_multipart_A1TIP3RXHBCZ.2~71DZBUUD9ZTV.1 size=1048576 2024-09-12T17:18:16.611 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.610+0000 7f574d1ea780 1 > prepared part key=_multipart_A1TIP3RXHBCZ.2~71DZBUUD9ZTV.2 size=573035 2024-09-12T17:18:16.611 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.610+0000 7f574d1ea780 1 > prepared multipart upload key=A1TIP3RXHBCZ upload=71DZBUUD9ZTV tag=EC1TO4PPTFX9 type=write size=3718763 2024-09-12T17:18:16.612 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.611+0000 7f574d1ea780 1 < completed delete operation key=GEGOEB05R0PK tag=NMJ8NSFYZKJ0 type=del 2024-09-12T17:18:16.615 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.614+0000 7f574d1ea780 1 > prepared part key=_multipart_55JI541K1WP2.2~SW06T6UA0U7Y.0 size=1048576 2024-09-12T17:18:16.616 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.615+0000 7f574d1ea780 1 > prepared part key=_multipart_55JI541K1WP2.2~SW06T6UA0U7Y.1 size=1048576 2024-09-12T17:18:16.617 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.616+0000 7f574d1ea780 1 > prepared part key=_multipart_55JI541K1WP2.2~SW06T6UA0U7Y.2 size=569332 2024-09-12T17:18:16.617 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.616+0000 7f574d1ea780 1 > prepared multipart upload key=55JI541K1WP2 upload=SW06T6UA0U7Y tag=FG0OUHJU4MH8 type=write size=3715060 2024-09-12T17:18:16.619 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.618+0000 7f574d1ea780 -1 < failed to complete operation key=8VW3XCUHLF2L tag=250DOJE5QWXE type=del size=3593197: (22) Invalid argument 2024-09-12T17:18:16.621 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.620+0000 7f574d1ea780 1 > prepared operation key=TIKBUXFPVTN1 tag=3N2YV73E0IEK type=write size=914031 2024-09-12T17:18:16.623 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.622+0000 7f574d1ea780 1 < completed part key=_multipart_8SG7DJO4HWPI.2~ANP9WE0E9GUK.0 size=1048576 2024-09-12T17:18:16.624 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.623+0000 7f574d1ea780 1 < completed part key=_multipart_8SG7DJO4HWPI.2~ANP9WE0E9GUK.1 size=1048576 2024-09-12T17:18:16.625 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.624+0000 7f574d1ea780 1 < completed part key=_multipart_8SG7DJO4HWPI.2~ANP9WE0E9GUK.2 size=54247 2024-09-12T17:18:16.627 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.626+0000 7f574d1ea780 1 < completed multipart upload key=8SG7DJO4HWPI upload=ANP9WE0E9GUK tag=OH7J2BUCIOZY type=write size=3199975 2024-09-12T17:18:16.628 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.627+0000 7f574d1ea780 1 > prepared operation key=55JI541K1WP2 tag=3FEU353AQAQW type=del size=3127075 2024-09-12T17:18:16.629 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.628+0000 7f574d1ea780 1 < canceled part key=_multipart_ZGE1860DMGHA.2~941L5BMC3L8W.0 size=1048576 2024-09-12T17:18:16.629 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.629+0000 7f574d1ea780 1 < completed part key=_multipart_ZGE1860DMGHA.2~941L5BMC3L8W.1 size=297841 2024-09-12T17:18:16.631 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.631+0000 7f574d1ea780 1 < canceled multipart upload key=ZGE1860DMGHA upload=941L5BMC3L8W tag=AP2PV3QTII0J type=write size=2394993 2024-09-12T17:18:16.633 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.632+0000 7f574d1ea780 1 > prepared operation key=8SG7DJO4HWPI tag=0OH0LJK5RQV8 type=del size=3997342 2024-09-12T17:18:16.634 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.633+0000 7f574d1ea780 1 < completed delete operation key=HFWA7DNUMWF2 tag=CXB0MCT67OR7 type=del 2024-09-12T17:18:16.635 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.634+0000 7f574d1ea780 1 > prepared operation key=54CM8800AT9V tag=U5UJRHTJ0N2X type=del size=3773401 2024-09-12T17:18:16.636 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.636+0000 7f574d1ea780 1 < completed delete operation key=HFWA7DNUMWF2 tag=ZA3TD8P457HQ type=del 2024-09-12T17:18:16.638 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.638+0000 7f574d1ea780 1 > prepared part key=_multipart_SQQMJ61CA0QW.2~4XBJZYMJMM9K.0 size=1048576 2024-09-12T17:18:16.639 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.638+0000 7f574d1ea780 1 > prepared part key=_multipart_SQQMJ61CA0QW.2~4XBJZYMJMM9K.1 size=668448 2024-09-12T17:18:16.639 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.638+0000 7f574d1ea780 1 > prepared multipart upload key=SQQMJ61CA0QW upload=4XBJZYMJMM9K tag=DSLNV36L3A89 type=write size=2765600 2024-09-12T17:18:16.640 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.640+0000 7f574d1ea780 1 < completed write operation key=A1TIP3RXHBCZ tag=0OV6ZPGB4XND type=write size=905374 2024-09-12T17:18:16.642 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.641+0000 7f574d1ea780 1 > prepared operation key=55JI541K1WP2 tag=C2KF31B7TOB5 type=del size=1414107 2024-09-12T17:18:16.643 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.642+0000 7f574d1ea780 -1 < failed to complete operation key=8VW3XCUHLF2L tag=WYP7IICI1AAW type=del size=3287459: (22) Invalid argument 2024-09-12T17:18:16.645 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.644+0000 7f574d1ea780 1 > prepared part key=_multipart_ENFNIFHQ3SHW.2~K5V8MRBGDSBE.0 size=1048576 2024-09-12T17:18:16.646 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.645+0000 7f574d1ea780 1 > prepared part key=_multipart_ENFNIFHQ3SHW.2~K5V8MRBGDSBE.1 size=1048576 2024-09-12T17:18:16.647 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.646+0000 7f574d1ea780 1 > prepared part key=_multipart_ENFNIFHQ3SHW.2~K5V8MRBGDSBE.2 size=347385 2024-09-12T17:18:16.647 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.646+0000 7f574d1ea780 1 > prepared multipart upload key=ENFNIFHQ3SHW upload=K5V8MRBGDSBE tag=MUNICQ5GAL90 type=write size=3493113 2024-09-12T17:18:16.648 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.647+0000 7f574d1ea780 1 < completed write operation key=Q2Q3B1J3DAVD tag=G46MVO24B250 type=write size=984244 2024-09-12T17:18:16.650 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.649+0000 7f574d1ea780 1 > prepared part key=_multipart_UTCKL1F42X8A.2~LYR966AMF6AB.0 size=1048576 2024-09-12T17:18:16.651 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.650+0000 7f574d1ea780 1 > prepared part key=_multipart_UTCKL1F42X8A.2~LYR966AMF6AB.1 size=1048576 2024-09-12T17:18:16.652 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.651+0000 7f574d1ea780 1 > prepared part key=_multipart_UTCKL1F42X8A.2~LYR966AMF6AB.2 size=556186 2024-09-12T17:18:16.652 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.651+0000 7f574d1ea780 1 > prepared multipart upload key=UTCKL1F42X8A upload=LYR966AMF6AB tag=8GFO8NGBTL1V type=write size=3701914 2024-09-12T17:18:16.653 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.653+0000 7f574d1ea780 1 < completed part key=_multipart_55JI541K1WP2.2~PHPYTHERKKV9.0 size=1048576 2024-09-12T17:18:16.654 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.654+0000 7f574d1ea780 1 < completed part key=_multipart_55JI541K1WP2.2~PHPYTHERKKV9.1 size=568375 2024-09-12T17:18:16.657 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.656+0000 7f574d1ea780 1 < completed multipart upload key=55JI541K1WP2 upload=PHPYTHERKKV9 tag=EMHYRCUARLDS type=write size=2665527 2024-09-12T17:18:16.659 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.658+0000 7f574d1ea780 1 > prepared part key=_multipart_54CM8800AT9V.2~VV7VZN60YOWY.0 size=954898 2024-09-12T17:18:16.659 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.658+0000 7f574d1ea780 1 > prepared multipart upload key=54CM8800AT9V upload=VV7VZN60YOWY tag=X479D97R2OH1 type=write size=2003474 2024-09-12T17:18:16.661 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.660+0000 7f574d1ea780 1 < completed part key=_multipart_SQQMJ61CA0QW.2~TY9BQI1XZ2XA.0 size=1048576 2024-09-12T17:18:16.661 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.660+0000 7f574d1ea780 1 < canceled part key=_multipart_SQQMJ61CA0QW.2~TY9BQI1XZ2XA.1 size=1048576 2024-09-12T17:18:16.661 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.660+0000 7f574d1ea780 1 < canceled part key=_multipart_SQQMJ61CA0QW.2~TY9BQI1XZ2XA.2 size=383427 2024-09-12T17:18:16.663 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.662+0000 7f574d1ea780 1 < canceled multipart upload key=SQQMJ61CA0QW upload=TY9BQI1XZ2XA tag=PWV2RY00BF7A type=write size=3529155 2024-09-12T17:18:16.666 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.665+0000 7f574d1ea780 1 > prepared part key=_multipart_R00F69ON5P6Z.2~HDHES99YR2ID.0 size=1048576 2024-09-12T17:18:16.667 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.666+0000 7f574d1ea780 1 > prepared part key=_multipart_R00F69ON5P6Z.2~HDHES99YR2ID.1 size=687398 2024-09-12T17:18:16.667 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.666+0000 7f574d1ea780 1 > prepared multipart upload key=R00F69ON5P6Z upload=HDHES99YR2ID tag=TJW29SPFHUQQ type=write size=2784550 2024-09-12T17:18:16.668 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.667+0000 7f574d1ea780 1 < completed part key=_multipart_R00F69ON5P6Z.2~U2ZWJLLYP8M4.0 size=1048576 2024-09-12T17:18:16.669 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.668+0000 7f574d1ea780 1 < completed part key=_multipart_R00F69ON5P6Z.2~U2ZWJLLYP8M4.1 size=528392 2024-09-12T17:18:16.672 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.671+0000 7f574d1ea780 1 < completed multipart upload key=R00F69ON5P6Z upload=U2ZWJLLYP8M4 tag=5ULVWGZMHUZQ type=write size=2625544 2024-09-12T17:18:16.674 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.674+0000 7f574d1ea780 1 > prepared part key=_multipart_ZGH8XC39FGTC.2~WNIS1UEY3HJP.0 size=1048576 2024-09-12T17:18:16.675 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.675+0000 7f574d1ea780 1 > prepared part key=_multipart_ZGH8XC39FGTC.2~WNIS1UEY3HJP.1 size=1048576 2024-09-12T17:18:16.677 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.676+0000 7f574d1ea780 1 > prepared part key=_multipart_ZGH8XC39FGTC.2~WNIS1UEY3HJP.2 size=254533 2024-09-12T17:18:16.677 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.676+0000 7f574d1ea780 1 > prepared multipart upload key=ZGH8XC39FGTC upload=WNIS1UEY3HJP tag=YAS5J1MMD1DW type=write size=3400261 2024-09-12T17:18:16.678 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.677+0000 7f574d1ea780 1 < completed delete operation key=C9IYR9CET1I8 tag=QM735PQ1VLNM type=del 2024-09-12T17:18:16.680 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.680+0000 7f574d1ea780 1 > prepared part key=_multipart_SQQMJ61CA0QW.2~QMASSYL3UO3F.0 size=574295 2024-09-12T17:18:16.680 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.680+0000 7f574d1ea780 1 > prepared multipart upload key=SQQMJ61CA0QW upload=QMASSYL3UO3F tag=ZWNJSPY9F883 type=write size=1622871 2024-09-12T17:18:16.682 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.681+0000 7f574d1ea780 1 < completed delete operation key=R00F69ON5P6Z tag=0LYCMOZ1S4ZJ type=del 2024-09-12T17:18:16.684 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.683+0000 7f574d1ea780 1 > prepared part key=_multipart_DH02JGZP64MN.2~73XWEPT7YLH5.0 size=135683 2024-09-12T17:18:16.684 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.683+0000 7f574d1ea780 1 > prepared multipart upload key=DH02JGZP64MN upload=73XWEPT7YLH5 tag=CB9KFKUFIC0E type=write size=1184259 2024-09-12T17:18:16.686 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.685+0000 7f574d1ea780 1 < completed part key=_multipart_D1GEG3MKPOM3.2~HJ8GLOFK4V37.0 size=1048576 2024-09-12T17:18:16.687 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.686+0000 7f574d1ea780 1 < completed part key=_multipart_D1GEG3MKPOM3.2~HJ8GLOFK4V37.1 size=1048576 2024-09-12T17:18:16.688 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.687+0000 7f574d1ea780 1 < completed part key=_multipart_D1GEG3MKPOM3.2~HJ8GLOFK4V37.2 size=155780 2024-09-12T17:18:16.690 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.690+0000 7f574d1ea780 1 < completed multipart upload key=D1GEG3MKPOM3 upload=HJ8GLOFK4V37 tag=SU34RJ57JSR3 type=write size=3301508 2024-09-12T17:18:16.692 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.691+0000 7f574d1ea780 1 > prepared operation key=DH02JGZP64MN tag=61ZOUL5PON3J type=write size=739947 2024-09-12T17:18:16.693 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.693+0000 7f574d1ea780 1 < completed part key=_multipart_A1TIP3RXHBCZ.2~71DZBUUD9ZTV.0 size=1048576 2024-09-12T17:18:16.695 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.694+0000 7f574d1ea780 1 < completed part key=_multipart_A1TIP3RXHBCZ.2~71DZBUUD9ZTV.1 size=1048576 2024-09-12T17:18:16.696 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.695+0000 7f574d1ea780 1 < completed part key=_multipart_A1TIP3RXHBCZ.2~71DZBUUD9ZTV.2 size=573035 2024-09-12T17:18:16.698 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.698+0000 7f574d1ea780 1 < completed multipart upload key=A1TIP3RXHBCZ upload=71DZBUUD9ZTV tag=EC1TO4PPTFX9 type=write size=3718763 2024-09-12T17:18:16.701 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.700+0000 7f574d1ea780 1 > prepared part key=_multipart_TIKBUXFPVTN1.2~KATHCEIP26XO.0 size=1048576 2024-09-12T17:18:16.702 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.701+0000 7f574d1ea780 1 > prepared part key=_multipart_TIKBUXFPVTN1.2~KATHCEIP26XO.1 size=602367 2024-09-12T17:18:16.702 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.701+0000 7f574d1ea780 1 > prepared multipart upload key=TIKBUXFPVTN1 upload=KATHCEIP26XO tag=C4XU0KM3L016 type=write size=2699519 2024-09-12T17:18:16.703 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.703+0000 7f574d1ea780 1 < completed part key=_multipart_55JI541K1WP2.2~SW06T6UA0U7Y.0 size=1048576 2024-09-12T17:18:16.705 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.704+0000 7f574d1ea780 1 < completed part key=_multipart_55JI541K1WP2.2~SW06T6UA0U7Y.1 size=1048576 2024-09-12T17:18:16.706 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.705+0000 7f574d1ea780 1 < completed part key=_multipart_55JI541K1WP2.2~SW06T6UA0U7Y.2 size=569332 2024-09-12T17:18:16.708 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.707+0000 7f574d1ea780 1 < completed multipart upload key=55JI541K1WP2 upload=SW06T6UA0U7Y tag=FG0OUHJU4MH8 type=write size=3715060 2024-09-12T17:18:16.711 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.710+0000 7f574d1ea780 1 > prepared part key=_multipart_UTCKL1F42X8A.2~601PFRW12QH2.0 size=1048576 2024-09-12T17:18:16.712 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.711+0000 7f574d1ea780 1 > prepared part key=_multipart_UTCKL1F42X8A.2~601PFRW12QH2.1 size=1048576 2024-09-12T17:18:16.713 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.712+0000 7f574d1ea780 1 > prepared part key=_multipart_UTCKL1F42X8A.2~601PFRW12QH2.2 size=211259 2024-09-12T17:18:16.713 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.712+0000 7f574d1ea780 1 > prepared multipart upload key=UTCKL1F42X8A upload=601PFRW12QH2 tag=MVZB3D9DKPE6 type=write size=3356987 2024-09-12T17:18:16.714 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.713+0000 7f574d1ea780 1 < completed write operation key=TIKBUXFPVTN1 tag=3N2YV73E0IEK type=write size=914031 2024-09-12T17:18:16.716 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.715+0000 7f574d1ea780 1 > prepared operation key=RNI86YYLADT0 tag=T7D0G5MMBKUO type=del size=3017781 2024-09-12T17:18:16.717 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.716+0000 7f574d1ea780 1 < completed delete operation key=55JI541K1WP2 tag=3FEU353AQAQW type=del 2024-09-12T17:18:16.718 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.717+0000 7f574d1ea780 1 > prepared operation key=ENFNIFHQ3SHW tag=E88QWNO0J6KO type=write size=464848 2024-09-12T17:18:16.719 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.718+0000 7f574d1ea780 1 < canceled operation key=8SG7DJO4HWPI tag=0OH0LJK5RQV8 type=del size=3997342 2024-09-12T17:18:16.720 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.720+0000 7f574d1ea780 1 > prepared operation key=ZGE1860DMGHA tag=PDCKURLE5HVN type=del size=3618466 2024-09-12T17:18:16.723 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.723+0000 7f574d1ea780 1 < suggested remove operation key=54CM8800AT9V tag=U5UJRHTJ0N2X type=del 2024-09-12T17:18:16.725 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.724+0000 7f574d1ea780 1 > prepared operation key=ZGH8XC39FGTC tag=CO91FWTZ3VW5 type=del size=3379360 2024-09-12T17:18:16.726 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.725+0000 7f574d1ea780 1 < completed part key=_multipart_SQQMJ61CA0QW.2~4XBJZYMJMM9K.0 size=1048576 2024-09-12T17:18:16.727 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.726+0000 7f574d1ea780 1 < completed part key=_multipart_SQQMJ61CA0QW.2~4XBJZYMJMM9K.1 size=668448 2024-09-12T17:18:16.729 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.728+0000 7f574d1ea780 1 < completed multipart upload key=SQQMJ61CA0QW upload=4XBJZYMJMM9K tag=DSLNV36L3A89 type=write size=2765600 2024-09-12T17:18:16.731 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.730+0000 7f574d1ea780 1 > prepared part key=_multipart_TIKBUXFPVTN1.2~S5P82W20DCED.0 size=1048576 2024-09-12T17:18:16.732 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.731+0000 7f574d1ea780 1 > prepared part key=_multipart_TIKBUXFPVTN1.2~S5P82W20DCED.1 size=656275 2024-09-12T17:18:16.732 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.731+0000 7f574d1ea780 1 > prepared multipart upload key=TIKBUXFPVTN1 upload=S5P82W20DCED tag=QSYECOM1XYAG type=write size=2753427 2024-09-12T17:18:16.733 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.732+0000 7f574d1ea780 1 < completed delete operation key=55JI541K1WP2 tag=C2KF31B7TOB5 type=del 2024-09-12T17:18:16.735 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.735+0000 7f574d1ea780 1 > prepared part key=_multipart_8SG7DJO4HWPI.2~9LJHCLSZ7N32.0 size=610340 2024-09-12T17:18:16.736 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.735+0000 7f574d1ea780 1 > prepared multipart upload key=8SG7DJO4HWPI upload=9LJHCLSZ7N32 tag=3MYY3U4WAJIH type=write size=1658916 2024-09-12T17:18:16.737 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.736+0000 7f574d1ea780 1 < completed part key=_multipart_ENFNIFHQ3SHW.2~K5V8MRBGDSBE.0 size=1048576 2024-09-12T17:18:16.738 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.737+0000 7f574d1ea780 1 < completed part key=_multipart_ENFNIFHQ3SHW.2~K5V8MRBGDSBE.1 size=1048576 2024-09-12T17:18:16.740 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.739+0000 7f574d1ea780 1 < completed part key=_multipart_ENFNIFHQ3SHW.2~K5V8MRBGDSBE.2 size=347385 2024-09-12T17:18:16.742 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.741+0000 7f574d1ea780 1 < completed multipart upload key=ENFNIFHQ3SHW upload=K5V8MRBGDSBE tag=MUNICQ5GAL90 type=write size=3493113 2024-09-12T17:18:16.744 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.743+0000 7f574d1ea780 1 > prepared operation key=8VW3XCUHLF2L tag=7H7ZAGLRP6SZ type=del size=33754 2024-09-12T17:18:16.745 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.744+0000 7f574d1ea780 1 < completed part key=_multipart_UTCKL1F42X8A.2~LYR966AMF6AB.0 size=1048576 2024-09-12T17:18:16.746 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.745+0000 7f574d1ea780 1 < completed part key=_multipart_UTCKL1F42X8A.2~LYR966AMF6AB.1 size=1048576 2024-09-12T17:18:16.747 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.746+0000 7f574d1ea780 1 < completed part key=_multipart_UTCKL1F42X8A.2~LYR966AMF6AB.2 size=556186 2024-09-12T17:18:16.749 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.748+0000 7f574d1ea780 1 < completed multipart upload key=UTCKL1F42X8A upload=LYR966AMF6AB tag=8GFO8NGBTL1V type=write size=3701914 2024-09-12T17:18:16.750 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.749+0000 7f574d1ea780 1 > prepared operation key=C9IYR9CET1I8 tag=9WENCDQZCYU8 type=del size=3951179 2024-09-12T17:18:16.753 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.752+0000 7f574d1ea780 1 < completed part key=_multipart_54CM8800AT9V.2~VV7VZN60YOWY.0 size=954898 2024-09-12T17:18:16.755 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.754+0000 7f574d1ea780 1 < completed multipart upload key=54CM8800AT9V upload=VV7VZN60YOWY tag=X479D97R2OH1 type=write size=2003474 2024-09-12T17:18:16.757 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.756+0000 7f574d1ea780 1 > prepared part key=_multipart_U6E9A5OH4GUW.2~1PWRD52ETUJD.0 size=1048576 2024-09-12T17:18:16.758 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.757+0000 7f574d1ea780 1 > prepared part key=_multipart_U6E9A5OH4GUW.2~1PWRD52ETUJD.1 size=98454 2024-09-12T17:18:16.758 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.757+0000 7f574d1ea780 1 > prepared multipart upload key=U6E9A5OH4GUW upload=1PWRD52ETUJD tag=F0N3OJ46WVBV type=write size=2195606 2024-09-12T17:18:16.760 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.759+0000 7f574d1ea780 1 < completed part key=_multipart_R00F69ON5P6Z.2~HDHES99YR2ID.0 size=1048576 2024-09-12T17:18:16.761 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.760+0000 7f574d1ea780 1 < completed part key=_multipart_R00F69ON5P6Z.2~HDHES99YR2ID.1 size=687398 2024-09-12T17:18:16.763 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.762+0000 7f574d1ea780 1 < completed multipart upload key=R00F69ON5P6Z upload=HDHES99YR2ID tag=TJW29SPFHUQQ type=write size=2784550 2024-09-12T17:18:16.764 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.763+0000 7f574d1ea780 1 > prepared operation key=55V137SY4E4P tag=07A80PSGRV7J type=del size=1126909 2024-09-12T17:18:16.765 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.764+0000 7f574d1ea780 1 < completed part key=_multipart_ZGH8XC39FGTC.2~WNIS1UEY3HJP.0 size=1048576 2024-09-12T17:18:16.766 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.766+0000 7f574d1ea780 1 < completed part key=_multipart_ZGH8XC39FGTC.2~WNIS1UEY3HJP.1 size=1048576 2024-09-12T17:18:16.768 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.767+0000 7f574d1ea780 1 < completed part key=_multipart_ZGH8XC39FGTC.2~WNIS1UEY3HJP.2 size=254533 2024-09-12T17:18:16.770 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.769+0000 7f574d1ea780 1 < completed multipart upload key=ZGH8XC39FGTC upload=WNIS1UEY3HJP tag=YAS5J1MMD1DW type=write size=3400261 2024-09-12T17:18:16.771 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.770+0000 7f574d1ea780 1 > prepared operation key=DH02JGZP64MN tag=PAG346G56AB1 type=write size=358632 2024-09-12T17:18:16.772 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.772+0000 7f574d1ea780 1 < completed part key=_multipart_SQQMJ61CA0QW.2~QMASSYL3UO3F.0 size=574295 2024-09-12T17:18:16.775 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.774+0000 7f574d1ea780 1 < completed multipart upload key=SQQMJ61CA0QW upload=QMASSYL3UO3F tag=ZWNJSPY9F883 type=write size=1622871 2024-09-12T17:18:16.776 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.775+0000 7f574d1ea780 1 > prepared operation key=U6E9A5OH4GUW tag=S54J3G716K5P type=del size=912418 2024-09-12T17:18:16.776 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.775+0000 7f574d1ea780 1 < canceled part key=_multipart_DH02JGZP64MN.2~73XWEPT7YLH5.0 size=135683 2024-09-12T17:18:16.778 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.777+0000 7f574d1ea780 1 < canceled multipart upload key=DH02JGZP64MN upload=73XWEPT7YLH5 tag=CB9KFKUFIC0E type=write size=1184259 2024-09-12T17:18:16.779 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.779+0000 7f574d1ea780 1 > prepared operation key=VWWA5IB0L4N1 tag=2JUY02WL3Y11 type=del size=887143 2024-09-12T17:18:16.781 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.780+0000 7f574d1ea780 1 < completed write operation key=DH02JGZP64MN tag=61ZOUL5PON3J type=write size=739947 2024-09-12T17:18:16.782 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.781+0000 7f574d1ea780 1 > prepared operation key=DH02JGZP64MN tag=1DH4FJMZH6NY type=del size=711918 2024-09-12T17:18:16.783 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.782+0000 7f574d1ea780 1 < completed part key=_multipart_TIKBUXFPVTN1.2~KATHCEIP26XO.0 size=1048576 2024-09-12T17:18:16.784 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.783+0000 7f574d1ea780 1 < completed part key=_multipart_TIKBUXFPVTN1.2~KATHCEIP26XO.1 size=602367 2024-09-12T17:18:16.786 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.785+0000 7f574d1ea780 1 < completed multipart upload key=TIKBUXFPVTN1 upload=KATHCEIP26XO tag=C4XU0KM3L016 type=write size=2699519 2024-09-12T17:18:16.787 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.787+0000 7f574d1ea780 1 > prepared operation key=ENFNIFHQ3SHW tag=7S3Z8TAFFDTK type=del size=1013352 2024-09-12T17:18:16.789 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.788+0000 7f574d1ea780 1 < completed part key=_multipart_UTCKL1F42X8A.2~601PFRW12QH2.0 size=1048576 2024-09-12T17:18:16.790 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.789+0000 7f574d1ea780 1 < completed part key=_multipart_UTCKL1F42X8A.2~601PFRW12QH2.1 size=1048576 2024-09-12T17:18:16.791 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.790+0000 7f574d1ea780 1 < completed part key=_multipart_UTCKL1F42X8A.2~601PFRW12QH2.2 size=211259 2024-09-12T17:18:16.793 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.792+0000 7f574d1ea780 1 < completed multipart upload key=UTCKL1F42X8A upload=601PFRW12QH2 tag=MVZB3D9DKPE6 type=write size=3356987 2024-09-12T17:18:16.794 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.793+0000 7f574d1ea780 1 > prepared operation key=YXIDO0U18839 tag=J51X2FSKNSP6 type=del size=1052733 2024-09-12T17:18:16.796 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.795+0000 7f574d1ea780 1 < suggested update operation key=RNI86YYLADT0 tag=T7D0G5MMBKUO type=del size=3017781 2024-09-12T17:18:16.797 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.797+0000 7f574d1ea780 1 > prepared operation key=8SG7DJO4HWPI tag=EE3LF3DV9XTA type=del size=1277564 2024-09-12T17:18:16.799 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.798+0000 7f574d1ea780 1 < completed write operation key=ENFNIFHQ3SHW tag=E88QWNO0J6KO type=write size=464848 2024-09-12T17:18:16.800 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.799+0000 7f574d1ea780 1 > prepared operation key=UFKM4I8RMT0W tag=H5P2XIN7RW5O type=write size=294417 2024-09-12T17:18:16.801 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.800+0000 7f574d1ea780 1 < completed delete operation key=ZGE1860DMGHA tag=PDCKURLE5HVN type=del 2024-09-12T17:18:16.803 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.803+0000 7f574d1ea780 1 > prepared part key=_multipart_7BX38Q7723EB.2~C3V9DBSZBFXJ.0 size=1048576 2024-09-12T17:18:16.804 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.804+0000 7f574d1ea780 1 > prepared part key=_multipart_7BX38Q7723EB.2~C3V9DBSZBFXJ.1 size=1048576 2024-09-12T17:18:16.809 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.805+0000 7f574d1ea780 1 > prepared part key=_multipart_7BX38Q7723EB.2~C3V9DBSZBFXJ.2 size=604102 2024-09-12T17:18:16.809 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.805+0000 7f574d1ea780 1 > prepared multipart upload key=7BX38Q7723EB upload=C3V9DBSZBFXJ tag=S8PECUGC1OB7 type=write size=3749830 2024-09-12T17:18:16.809 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.806+0000 7f574d1ea780 1 < completed delete operation key=ZGH8XC39FGTC tag=CO91FWTZ3VW5 type=del 2024-09-12T17:18:16.810 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.807+0000 7f574d1ea780 1 > prepared operation key=RNI86YYLADT0 tag=8R1KYOOJRIGP type=write size=190330 2024-09-12T17:18:16.810 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.809+0000 7f574d1ea780 1 < completed part key=_multipart_TIKBUXFPVTN1.2~S5P82W20DCED.0 size=1048576 2024-09-12T17:18:16.810 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.810+0000 7f574d1ea780 1 < completed part key=_multipart_TIKBUXFPVTN1.2~S5P82W20DCED.1 size=656275 2024-09-12T17:18:16.813 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.812+0000 7f574d1ea780 1 < completed multipart upload key=TIKBUXFPVTN1 upload=S5P82W20DCED tag=QSYECOM1XYAG type=write size=2753427 2024-09-12T17:18:16.815 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.814+0000 7f574d1ea780 1 > prepared part key=_multipart_UTCKL1F42X8A.2~VIFVFQZJEBH1.0 size=1048576 2024-09-12T17:18:16.816 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.815+0000 7f574d1ea780 1 > prepared part key=_multipart_UTCKL1F42X8A.2~VIFVFQZJEBH1.1 size=1048576 2024-09-12T17:18:16.817 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.816+0000 7f574d1ea780 1 > prepared part key=_multipart_UTCKL1F42X8A.2~VIFVFQZJEBH1.2 size=635734 2024-09-12T17:18:16.817 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.816+0000 7f574d1ea780 1 > prepared multipart upload key=UTCKL1F42X8A upload=VIFVFQZJEBH1 tag=LJ3S78U9FFDF type=write size=3781462 2024-09-12T17:18:16.818 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.817+0000 7f574d1ea780 1 < completed part key=_multipart_8SG7DJO4HWPI.2~9LJHCLSZ7N32.0 size=610340 2024-09-12T17:18:16.820 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.819+0000 7f574d1ea780 1 < completed multipart upload key=8SG7DJO4HWPI upload=9LJHCLSZ7N32 tag=3MYY3U4WAJIH type=write size=1658916 2024-09-12T17:18:16.822 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.822+0000 7f574d1ea780 1 > prepared part key=_multipart_SQQMJ61CA0QW.2~91AQFZ8TQ4S6.0 size=1048576 2024-09-12T17:18:16.823 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.822+0000 7f574d1ea780 1 > prepared part key=_multipart_SQQMJ61CA0QW.2~91AQFZ8TQ4S6.1 size=188477 2024-09-12T17:18:16.823 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.822+0000 7f574d1ea780 1 > prepared multipart upload key=SQQMJ61CA0QW upload=91AQFZ8TQ4S6 tag=ZI3Z5YIKJ8ZD type=write size=2285629 2024-09-12T17:18:16.825 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.824+0000 7f574d1ea780 1 < completed delete operation key=8VW3XCUHLF2L tag=7H7ZAGLRP6SZ type=del 2024-09-12T17:18:16.826 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.825+0000 7f574d1ea780 1 > prepared operation key=54LQ91UMBJAN tag=7XHBDX85S0YF type=del size=3414618 2024-09-12T17:18:16.827 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.826+0000 7f574d1ea780 1 < completed delete operation key=C9IYR9CET1I8 tag=9WENCDQZCYU8 type=del 2024-09-12T17:18:16.828 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.827+0000 7f574d1ea780 1 > prepared operation key=YXIDO0U18839 tag=Q6R55QQIU940 type=del size=1688365 2024-09-12T17:18:16.829 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.829+0000 7f574d1ea780 1 < completed part key=_multipart_U6E9A5OH4GUW.2~1PWRD52ETUJD.0 size=1048576 2024-09-12T17:18:16.831 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.830+0000 7f574d1ea780 1 < completed part key=_multipart_U6E9A5OH4GUW.2~1PWRD52ETUJD.1 size=98454 2024-09-12T17:18:16.832 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.832+0000 7f574d1ea780 1 < completed multipart upload key=U6E9A5OH4GUW upload=1PWRD52ETUJD tag=F0N3OJ46WVBV type=write size=2195606 2024-09-12T17:18:16.834 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.833+0000 7f574d1ea780 1 > prepared operation key=54CM8800AT9V tag=TR5M1ZR2LG6G type=write size=727343 2024-09-12T17:18:16.835 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.834+0000 7f574d1ea780 1 < completed delete operation key=55V137SY4E4P tag=07A80PSGRV7J type=del 2024-09-12T17:18:16.836 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.835+0000 7f574d1ea780 1 > prepared operation key=55JI541K1WP2 tag=CF0IGY17T4Q9 type=del size=781082 2024-09-12T17:18:16.837 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.837+0000 7f574d1ea780 1 < completed write operation key=DH02JGZP64MN tag=PAG346G56AB1 type=write size=358632 2024-09-12T17:18:16.839 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.838+0000 7f574d1ea780 1 > prepared operation key=RNI86YYLADT0 tag=RNP1HQSUCKO8 type=del size=2081184 2024-09-12T17:18:16.841 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.840+0000 7f574d1ea780 1 < suggested remove operation key=U6E9A5OH4GUW tag=S54J3G716K5P type=del 2024-09-12T17:18:16.843 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.842+0000 7f574d1ea780 1 > prepared operation key=54LQ91UMBJAN tag=R9QOC37KXF5D type=del size=344138 2024-09-12T17:18:16.844 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.843+0000 7f574d1ea780 1 < completed delete operation key=VWWA5IB0L4N1 tag=2JUY02WL3Y11 type=del 2024-09-12T17:18:16.845 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.844+0000 7f574d1ea780 1 > prepared operation key=QXD8UG2K4STQ tag=6YW3N297C5ZT type=write size=664329 2024-09-12T17:18:16.846 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.846+0000 7f574d1ea780 1 < completed delete operation key=DH02JGZP64MN tag=1DH4FJMZH6NY type=del 2024-09-12T17:18:16.849 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.848+0000 7f574d1ea780 1 > prepared part key=_multipart_TIKBUXFPVTN1.2~FI13P3KLYDSV.0 size=552169 2024-09-12T17:18:16.849 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.848+0000 7f574d1ea780 1 > prepared multipart upload key=TIKBUXFPVTN1 upload=FI13P3KLYDSV tag=E0HO04ZMOXSP type=write size=1600745 2024-09-12T17:18:16.850 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.849+0000 7f574d1ea780 1 < completed delete operation key=ENFNIFHQ3SHW tag=7S3Z8TAFFDTK type=del 2024-09-12T17:18:16.852 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.851+0000 7f574d1ea780 1 > prepared part key=_multipart_ZGE1860DMGHA.2~K9863O1093KN.0 size=701413 2024-09-12T17:18:16.852 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.851+0000 7f574d1ea780 1 > prepared multipart upload key=ZGE1860DMGHA upload=K9863O1093KN tag=38T632BY9WPB type=write size=1749989 2024-09-12T17:18:16.854 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.853+0000 7f574d1ea780 1 < completed delete operation key=YXIDO0U18839 tag=J51X2FSKNSP6 type=del 2024-09-12T17:18:16.855 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.854+0000 7f574d1ea780 1 > prepared operation key=54CM8800AT9V tag=TP2M2V9K416D type=del size=1707706 2024-09-12T17:18:16.856 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.855+0000 7f574d1ea780 1 < completed delete operation key=8SG7DJO4HWPI tag=EE3LF3DV9XTA type=del 2024-09-12T17:18:16.859 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.858+0000 7f574d1ea780 1 > prepared operation key=VWWA5IB0L4N1 tag=K7UQAP96OR6C type=del size=2465412 2024-09-12T17:18:16.860 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.859+0000 7f574d1ea780 1 < completed write operation key=UFKM4I8RMT0W tag=H5P2XIN7RW5O type=write size=294417 2024-09-12T17:18:16.863 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.862+0000 7f574d1ea780 1 > prepared part key=_multipart_TIKBUXFPVTN1.2~6E5CGMOVVWGR.0 size=217227 2024-09-12T17:18:16.863 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.862+0000 7f574d1ea780 1 > prepared multipart upload key=TIKBUXFPVTN1 upload=6E5CGMOVVWGR tag=1CZ67AACTGVR type=write size=1265803 2024-09-12T17:18:16.864 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.863+0000 7f574d1ea780 1 < completed part key=_multipart_7BX38Q7723EB.2~C3V9DBSZBFXJ.0 size=1048576 2024-09-12T17:18:16.865 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.864+0000 7f574d1ea780 1 < completed part key=_multipart_7BX38Q7723EB.2~C3V9DBSZBFXJ.1 size=1048576 2024-09-12T17:18:16.866 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.865+0000 7f574d1ea780 1 < completed part key=_multipart_7BX38Q7723EB.2~C3V9DBSZBFXJ.2 size=604102 2024-09-12T17:18:16.868 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.867+0000 7f574d1ea780 1 < completed multipart upload key=7BX38Q7723EB upload=C3V9DBSZBFXJ tag=S8PECUGC1OB7 type=write size=3749830 2024-09-12T17:18:16.870 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.869+0000 7f574d1ea780 1 > prepared part key=_multipart_U6E9A5OH4GUW.2~KVL88BH340JR.0 size=1048576 2024-09-12T17:18:16.871 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.870+0000 7f574d1ea780 1 > prepared part key=_multipart_U6E9A5OH4GUW.2~KVL88BH340JR.1 size=1048576 2024-09-12T17:18:16.872 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.871+0000 7f574d1ea780 1 > prepared part key=_multipart_U6E9A5OH4GUW.2~KVL88BH340JR.2 size=472610 2024-09-12T17:18:16.872 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.871+0000 7f574d1ea780 1 > prepared multipart upload key=U6E9A5OH4GUW upload=KVL88BH340JR tag=JPZV6FDYUDVA type=write size=3618338 2024-09-12T17:18:16.874 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.873+0000 7f574d1ea780 1 < completed write operation key=RNI86YYLADT0 tag=8R1KYOOJRIGP type=write size=190330 2024-09-12T17:18:16.875 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.874+0000 7f574d1ea780 1 > prepared operation key=55V137SY4E4P tag=4WNYZ0C9O0ZZ type=write size=584949 2024-09-12T17:18:16.876 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.875+0000 7f574d1ea780 1 < completed part key=_multipart_UTCKL1F42X8A.2~VIFVFQZJEBH1.0 size=1048576 2024-09-12T17:18:16.877 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.876+0000 7f574d1ea780 1 < completed part key=_multipart_UTCKL1F42X8A.2~VIFVFQZJEBH1.1 size=1048576 2024-09-12T17:18:16.878 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.877+0000 7f574d1ea780 1 < completed part key=_multipart_UTCKL1F42X8A.2~VIFVFQZJEBH1.2 size=635734 2024-09-12T17:18:16.880 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.879+0000 7f574d1ea780 1 < completed multipart upload key=UTCKL1F42X8A upload=VIFVFQZJEBH1 tag=LJ3S78U9FFDF type=write size=3781462 2024-09-12T17:18:16.881 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.881+0000 7f574d1ea780 1 > prepared operation key=8VW3XCUHLF2L tag=LP3VLX7UO3MX type=write size=578488 2024-09-12T17:18:16.883 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.882+0000 7f574d1ea780 1 < completed part key=_multipart_SQQMJ61CA0QW.2~91AQFZ8TQ4S6.0 size=1048576 2024-09-12T17:18:16.884 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.883+0000 7f574d1ea780 1 < completed part key=_multipart_SQQMJ61CA0QW.2~91AQFZ8TQ4S6.1 size=188477 2024-09-12T17:18:16.886 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.885+0000 7f574d1ea780 1 < completed multipart upload key=SQQMJ61CA0QW upload=91AQFZ8TQ4S6 tag=ZI3Z5YIKJ8ZD type=write size=2285629 2024-09-12T17:18:16.888 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.887+0000 7f574d1ea780 1 > prepared operation key=R00F69ON5P6Z tag=FKU87GSV6O7U type=del size=3849645 2024-09-12T17:18:16.889 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.888+0000 7f574d1ea780 1 < completed delete operation key=54LQ91UMBJAN tag=7XHBDX85S0YF type=del 2024-09-12T17:18:16.890 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.889+0000 7f574d1ea780 1 > prepared operation key=Q2Q3B1J3DAVD tag=CVU2J16A8UVU type=del size=136932 2024-09-12T17:18:16.892 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.891+0000 7f574d1ea780 1 < completed delete operation key=YXIDO0U18839 tag=Q6R55QQIU940 type=del 2024-09-12T17:18:16.893 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.892+0000 7f574d1ea780 1 > prepared operation key=TIKBUXFPVTN1 tag=1K8NVTY1YMCE type=del size=853174 2024-09-12T17:18:16.895 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.894+0000 7f574d1ea780 1 < canceled operation key=54CM8800AT9V tag=TR5M1ZR2LG6G type=write size=727343 2024-09-12T17:18:16.897 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.896+0000 7f574d1ea780 1 > prepared part key=_multipart_ENFNIFHQ3SHW.2~YHWA3SP7QKY8.0 size=1048576 2024-09-12T17:18:16.898 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.897+0000 7f574d1ea780 1 > prepared part key=_multipart_ENFNIFHQ3SHW.2~YHWA3SP7QKY8.1 size=1048576 2024-09-12T17:18:16.899 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.898+0000 7f574d1ea780 1 > prepared part key=_multipart_ENFNIFHQ3SHW.2~YHWA3SP7QKY8.2 size=922261 2024-09-12T17:18:16.899 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.898+0000 7f574d1ea780 1 > prepared multipart upload key=ENFNIFHQ3SHW upload=YHWA3SP7QKY8 tag=D3KEQEFKWG2G type=write size=4067989 2024-09-12T17:18:16.900 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.900+0000 7f574d1ea780 1 < canceled operation key=55JI541K1WP2 tag=CF0IGY17T4Q9 type=del size=781082 2024-09-12T17:18:16.903 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.902+0000 7f574d1ea780 1 > prepared part key=_multipart_R00F69ON5P6Z.2~HDYNE2DVVIW6.0 size=1048576 2024-09-12T17:18:16.904 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.903+0000 7f574d1ea780 1 > prepared part key=_multipart_R00F69ON5P6Z.2~HDYNE2DVVIW6.1 size=466008 2024-09-12T17:18:16.904 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.903+0000 7f574d1ea780 1 > prepared multipart upload key=R00F69ON5P6Z upload=HDYNE2DVVIW6 tag=RHC01LWSPN12 type=write size=2563160 2024-09-12T17:18:16.905 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.904+0000 7f574d1ea780 1 < completed delete operation key=RNI86YYLADT0 tag=RNP1HQSUCKO8 type=del 2024-09-12T17:18:16.908 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.907+0000 7f574d1ea780 1 > prepared part key=_multipart_55JI541K1WP2.2~UGPPNKOD7MSX.0 size=1048576 2024-09-12T17:18:16.909 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.908+0000 7f574d1ea780 1 > prepared part key=_multipart_55JI541K1WP2.2~UGPPNKOD7MSX.1 size=515972 2024-09-12T17:18:16.909 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.908+0000 7f574d1ea780 1 > prepared multipart upload key=55JI541K1WP2 upload=UGPPNKOD7MSX tag=X1VYOPR939LN type=write size=2613124 2024-09-12T17:18:16.910 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.909+0000 7f574d1ea780 1 < completed delete operation key=54LQ91UMBJAN tag=R9QOC37KXF5D type=del 2024-09-12T17:18:16.911 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.911+0000 7f574d1ea780 1 > prepared operation key=43GV2N9VBBKE tag=MDAGOPVV0E4H type=del size=2523434 2024-09-12T17:18:16.913 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.912+0000 7f574d1ea780 1 < completed write operation key=QXD8UG2K4STQ tag=6YW3N297C5ZT type=write size=664329 2024-09-12T17:18:16.914 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.913+0000 7f574d1ea780 1 > prepared operation key=OI51GO639LFK tag=Z9CS6QRGK8WD type=del size=2192524 2024-09-12T17:18:16.915 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.914+0000 7f574d1ea780 1 < completed part key=_multipart_TIKBUXFPVTN1.2~FI13P3KLYDSV.0 size=552169 2024-09-12T17:18:16.917 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.916+0000 7f574d1ea780 1 < completed multipart upload key=TIKBUXFPVTN1 upload=FI13P3KLYDSV tag=E0HO04ZMOXSP type=write size=1600745 2024-09-12T17:18:16.919 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.918+0000 7f574d1ea780 1 > prepared operation key=U6E9A5OH4GUW tag=3DADGP6GIEW7 type=del size=3218750 2024-09-12T17:18:16.920 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.919+0000 7f574d1ea780 1 < completed part key=_multipart_ZGE1860DMGHA.2~K9863O1093KN.0 size=701413 2024-09-12T17:18:16.923 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.922+0000 7f574d1ea780 1 < completed multipart upload key=ZGE1860DMGHA upload=K9863O1093KN tag=38T632BY9WPB type=write size=1749989 2024-09-12T17:18:16.925 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.924+0000 7f574d1ea780 1 > prepared part key=_multipart_U6E9A5OH4GUW.2~04OIZFN9I92U.0 size=1048576 2024-09-12T17:18:16.926 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.925+0000 7f574d1ea780 1 > prepared part key=_multipart_U6E9A5OH4GUW.2~04OIZFN9I92U.1 size=979734 2024-09-12T17:18:16.926 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.925+0000 7f574d1ea780 1 > prepared multipart upload key=U6E9A5OH4GUW upload=04OIZFN9I92U tag=GI5XW73L677G type=write size=3076886 2024-09-12T17:18:16.927 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.927+0000 7f574d1ea780 1 < completed delete operation key=54CM8800AT9V tag=TP2M2V9K416D type=del 2024-09-12T17:18:16.929 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.928+0000 7f574d1ea780 1 > prepared operation key=GEGOEB05R0PK tag=5CAVV35EAF5Z type=del size=2206961 2024-09-12T17:18:16.931 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.930+0000 7f574d1ea780 1 < suggested remove operation key=VWWA5IB0L4N1 tag=K7UQAP96OR6C type=del 2024-09-12T17:18:16.934 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.933+0000 7f574d1ea780 1 > prepared part key=_multipart_D1GEG3MKPOM3.2~N1Q2RQ0ORNE2.0 size=1048576 2024-09-12T17:18:16.935 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.934+0000 7f574d1ea780 1 > prepared part key=_multipart_D1GEG3MKPOM3.2~N1Q2RQ0ORNE2.1 size=402085 2024-09-12T17:18:16.935 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.934+0000 7f574d1ea780 1 > prepared multipart upload key=D1GEG3MKPOM3 upload=N1Q2RQ0ORNE2 tag=I8UHQS1W3BFR type=write size=2499237 2024-09-12T17:18:16.936 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.935+0000 7f574d1ea780 1 < completed part key=_multipart_TIKBUXFPVTN1.2~6E5CGMOVVWGR.0 size=217227 2024-09-12T17:18:16.938 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.937+0000 7f574d1ea780 1 < completed multipart upload key=TIKBUXFPVTN1 upload=6E5CGMOVVWGR tag=1CZ67AACTGVR type=write size=1265803 2024-09-12T17:18:16.939 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.938+0000 7f574d1ea780 1 > prepared operation key=YXIDO0U18839 tag=JEUOZVKZM7BY type=del size=672232 2024-09-12T17:18:16.941 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.940+0000 7f574d1ea780 1 < completed part key=_multipart_U6E9A5OH4GUW.2~KVL88BH340JR.0 size=1048576 2024-09-12T17:18:16.942 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.941+0000 7f574d1ea780 1 < completed part key=_multipart_U6E9A5OH4GUW.2~KVL88BH340JR.1 size=1048576 2024-09-12T17:18:16.943 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.942+0000 7f574d1ea780 1 < completed part key=_multipart_U6E9A5OH4GUW.2~KVL88BH340JR.2 size=472610 2024-09-12T17:18:16.945 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.944+0000 7f574d1ea780 1 < completed multipart upload key=U6E9A5OH4GUW upload=KVL88BH340JR tag=JPZV6FDYUDVA type=write size=3618338 2024-09-12T17:18:16.946 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.945+0000 7f574d1ea780 1 > prepared operation key=43GV2N9VBBKE tag=5KTDE2V3AZH0 type=del size=2181156 2024-09-12T17:18:16.947 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.946+0000 7f574d1ea780 1 < canceled operation key=55V137SY4E4P tag=4WNYZ0C9O0ZZ type=write size=584949 2024-09-12T17:18:16.950 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.949+0000 7f574d1ea780 1 > prepared part key=_multipart_7BX38Q7723EB.2~ZE0VHEVBU4IX.0 size=1048576 2024-09-12T17:18:16.951 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.950+0000 7f574d1ea780 1 > prepared part key=_multipart_7BX38Q7723EB.2~ZE0VHEVBU4IX.1 size=1048576 2024-09-12T17:18:16.952 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.951+0000 7f574d1ea780 1 > prepared part key=_multipart_7BX38Q7723EB.2~ZE0VHEVBU4IX.2 size=227322 2024-09-12T17:18:16.952 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.951+0000 7f574d1ea780 1 > prepared multipart upload key=7BX38Q7723EB upload=ZE0VHEVBU4IX tag=W6XJWTDCGTSO type=write size=3373050 2024-09-12T17:18:16.953 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.952+0000 7f574d1ea780 1 < completed write operation key=8VW3XCUHLF2L tag=LP3VLX7UO3MX type=write size=578488 2024-09-12T17:18:16.955 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.954+0000 7f574d1ea780 1 > prepared operation key=RWVWJHVZE95H tag=MYW69K8OK1GQ type=del size=3611061 2024-09-12T17:18:16.956 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.955+0000 7f574d1ea780 1 < completed delete operation key=R00F69ON5P6Z tag=FKU87GSV6O7U type=del 2024-09-12T17:18:16.958 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.957+0000 7f574d1ea780 1 > prepared operation key=HFWA7DNUMWF2 tag=IKIWBN01UDB6 type=del size=3691488 2024-09-12T17:18:16.961 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.960+0000 7f574d1ea780 1 < suggested remove operation key=Q2Q3B1J3DAVD tag=CVU2J16A8UVU type=del 2024-09-12T17:18:16.962 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.961+0000 7f574d1ea780 1 > prepared operation key=VWWA5IB0L4N1 tag=LDQMTOJAM1L1 type=write size=350311 2024-09-12T17:18:16.963 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.963+0000 7f574d1ea780 1 < completed delete operation key=TIKBUXFPVTN1 tag=1K8NVTY1YMCE type=del 2024-09-12T17:18:16.965 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.964+0000 7f574d1ea780 1 > prepared operation key=U6E9A5OH4GUW tag=EGKIVFIW05OF type=del size=624029 2024-09-12T17:18:16.966 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.965+0000 7f574d1ea780 1 < completed part key=_multipart_ENFNIFHQ3SHW.2~YHWA3SP7QKY8.0 size=1048576 2024-09-12T17:18:16.967 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.966+0000 7f574d1ea780 1 < completed part key=_multipart_ENFNIFHQ3SHW.2~YHWA3SP7QKY8.1 size=1048576 2024-09-12T17:18:16.968 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.967+0000 7f574d1ea780 1 < completed part key=_multipart_ENFNIFHQ3SHW.2~YHWA3SP7QKY8.2 size=922261 2024-09-12T17:18:16.970 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.969+0000 7f574d1ea780 1 < completed multipart upload key=ENFNIFHQ3SHW upload=YHWA3SP7QKY8 tag=D3KEQEFKWG2G type=write size=4067989 2024-09-12T17:18:16.973 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.972+0000 7f574d1ea780 1 > prepared operation key=GEGOEB05R0PK tag=53372C767ACP type=write size=41220 2024-09-12T17:18:16.974 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.973+0000 7f574d1ea780 1 < completed part key=_multipart_R00F69ON5P6Z.2~HDYNE2DVVIW6.0 size=1048576 2024-09-12T17:18:16.975 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.974+0000 7f574d1ea780 1 < completed part key=_multipart_R00F69ON5P6Z.2~HDYNE2DVVIW6.1 size=466008 2024-09-12T17:18:16.977 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.976+0000 7f574d1ea780 1 < completed multipart upload key=R00F69ON5P6Z upload=HDYNE2DVVIW6 tag=RHC01LWSPN12 type=write size=2563160 2024-09-12T17:18:16.979 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.979+0000 7f574d1ea780 1 > prepared part key=_multipart_K12MVG618809.2~PWZAJT3SDXBQ.0 size=1012104 2024-09-12T17:18:16.980 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.979+0000 7f574d1ea780 1 > prepared multipart upload key=K12MVG618809 upload=PWZAJT3SDXBQ tag=ZKDXXT2DNVPB type=write size=2060680 2024-09-12T17:18:16.982 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.981+0000 7f574d1ea780 1 < completed part key=_multipart_55JI541K1WP2.2~UGPPNKOD7MSX.0 size=1048576 2024-09-12T17:18:16.984 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.983+0000 7f574d1ea780 1 < completed part key=_multipart_55JI541K1WP2.2~UGPPNKOD7MSX.1 size=515972 2024-09-12T17:18:16.988 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.987+0000 7f574d1ea780 1 < completed multipart upload key=55JI541K1WP2 upload=UGPPNKOD7MSX tag=X1VYOPR939LN type=write size=2613124 2024-09-12T17:18:16.989 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.988+0000 7f574d1ea780 1 > prepared operation key=C9IYR9CET1I8 tag=3DN10WASM3WP type=del size=710530 2024-09-12T17:18:16.991 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.990+0000 7f574d1ea780 1 < completed delete operation key=43GV2N9VBBKE tag=MDAGOPVV0E4H type=del 2024-09-12T17:18:16.992 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.991+0000 7f574d1ea780 1 > prepared operation key=8VW3XCUHLF2L tag=X46J19PA25HQ type=del size=1449930 2024-09-12T17:18:16.993 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.992+0000 7f574d1ea780 1 < completed delete operation key=OI51GO639LFK tag=Z9CS6QRGK8WD type=del 2024-09-12T17:18:16.994 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.993+0000 7f574d1ea780 1 > prepared operation key=U6E9A5OH4GUW tag=C6K9QNPD6ZX2 type=del size=957970 2024-09-12T17:18:16.997 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.996+0000 7f574d1ea780 1 < suggested update operation key=U6E9A5OH4GUW tag=3DADGP6GIEW7 type=del size=3218750 2024-09-12T17:18:16.999 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.998+0000 7f574d1ea780 1 > prepared part key=_multipart_K12MVG618809.2~6TUAW4RALO7C.0 size=851499 2024-09-12T17:18:16.999 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.998+0000 7f574d1ea780 1 > prepared multipart upload key=K12MVG618809 upload=6TUAW4RALO7C tag=CGH4NZSAFXQF type=write size=1900075 2024-09-12T17:18:17.000 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:16.999+0000 7f574d1ea780 1 < completed part key=_multipart_U6E9A5OH4GUW.2~04OIZFN9I92U.0 size=1048576 2024-09-12T17:18:17.001 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.000+0000 7f574d1ea780 1 < completed part key=_multipart_U6E9A5OH4GUW.2~04OIZFN9I92U.1 size=979734 2024-09-12T17:18:17.003 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.002+0000 7f574d1ea780 1 < completed multipart upload key=U6E9A5OH4GUW upload=04OIZFN9I92U tag=GI5XW73L677G type=write size=3076886 2024-09-12T17:18:17.005 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.004+0000 7f574d1ea780 1 > prepared part key=_multipart_K12MVG618809.2~TG5P50CQUL45.0 size=649040 2024-09-12T17:18:17.005 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.004+0000 7f574d1ea780 1 > prepared multipart upload key=K12MVG618809 upload=TG5P50CQUL45 tag=Y3ILFOLH37CI type=write size=1697616 2024-09-12T17:18:17.008 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.007+0000 7f574d1ea780 1 < suggested remove operation key=GEGOEB05R0PK tag=5CAVV35EAF5Z type=del 2024-09-12T17:18:17.009 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.008+0000 7f574d1ea780 1 > prepared operation key=UTCKL1F42X8A tag=X3DWTYNTN21A type=del size=580398 2024-09-12T17:18:17.010 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.009+0000 7f574d1ea780 1 < completed part key=_multipart_D1GEG3MKPOM3.2~N1Q2RQ0ORNE2.0 size=1048576 2024-09-12T17:18:17.011 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.010+0000 7f574d1ea780 1 < completed part key=_multipart_D1GEG3MKPOM3.2~N1Q2RQ0ORNE2.1 size=402085 2024-09-12T17:18:17.013 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.012+0000 7f574d1ea780 1 < completed multipart upload key=D1GEG3MKPOM3 upload=N1Q2RQ0ORNE2 tag=I8UHQS1W3BFR type=write size=2499237 2024-09-12T17:18:17.015 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.014+0000 7f574d1ea780 1 > prepared part key=_multipart_GEGOEB05R0PK.2~XNKI67FINUTL.0 size=168046 2024-09-12T17:18:17.015 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.014+0000 7f574d1ea780 1 > prepared multipart upload key=GEGOEB05R0PK upload=XNKI67FINUTL tag=ST9OBFGGB5QQ type=write size=1216622 2024-09-12T17:18:17.016 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.015+0000 7f574d1ea780 1 < completed delete operation key=YXIDO0U18839 tag=JEUOZVKZM7BY type=del 2024-09-12T17:18:17.018 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.017+0000 7f574d1ea780 1 > prepared operation key=YXIDO0U18839 tag=VT9BGCJH2OLE type=del size=2626923 2024-09-12T17:18:17.019 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.018+0000 7f574d1ea780 1 < completed delete operation key=43GV2N9VBBKE tag=5KTDE2V3AZH0 type=del 2024-09-12T17:18:17.021 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.020+0000 7f574d1ea780 1 > prepared part key=_multipart_QXD8UG2K4STQ.2~9LHSBVVK7GLB.0 size=140003 2024-09-12T17:18:17.021 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.020+0000 7f574d1ea780 1 > prepared multipart upload key=QXD8UG2K4STQ upload=9LHSBVVK7GLB tag=L05P4RBUA80Q type=write size=1188579 2024-09-12T17:18:17.022 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.021+0000 7f574d1ea780 1 < completed part key=_multipart_7BX38Q7723EB.2~ZE0VHEVBU4IX.0 size=1048576 2024-09-12T17:18:17.023 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.022+0000 7f574d1ea780 1 < completed part key=_multipart_7BX38Q7723EB.2~ZE0VHEVBU4IX.1 size=1048576 2024-09-12T17:18:17.024 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.023+0000 7f574d1ea780 1 < completed part key=_multipart_7BX38Q7723EB.2~ZE0VHEVBU4IX.2 size=227322 2024-09-12T17:18:17.026 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.025+0000 7f574d1ea780 1 < completed multipart upload key=7BX38Q7723EB upload=ZE0VHEVBU4IX tag=W6XJWTDCGTSO type=write size=3373050 2024-09-12T17:18:17.028 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.027+0000 7f574d1ea780 1 > prepared part key=_multipart_OI51GO639LFK.2~HNKSEXW3B1CQ.0 size=1048576 2024-09-12T17:18:17.029 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.028+0000 7f574d1ea780 1 > prepared part key=_multipart_OI51GO639LFK.2~HNKSEXW3B1CQ.1 size=1048576 2024-09-12T17:18:17.030 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.029+0000 7f574d1ea780 1 > prepared part key=_multipart_OI51GO639LFK.2~HNKSEXW3B1CQ.2 size=789514 2024-09-12T17:18:17.030 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.029+0000 7f574d1ea780 1 > prepared multipart upload key=OI51GO639LFK upload=HNKSEXW3B1CQ tag=8X3IYM4744YJ type=write size=3935242 2024-09-12T17:18:17.033 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.032+0000 7f574d1ea780 1 < suggested update operation key=RWVWJHVZE95H tag=MYW69K8OK1GQ type=del size=3611061 2024-09-12T17:18:17.035 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.034+0000 7f574d1ea780 1 > prepared part key=_multipart_54LQ91UMBJAN.2~QYA05SLFG0OW.0 size=364284 2024-09-12T17:18:17.035 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.034+0000 7f574d1ea780 1 > prepared multipart upload key=54LQ91UMBJAN upload=QYA05SLFG0OW tag=9310RB08R7WP type=write size=1412860 2024-09-12T17:18:17.036 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.035+0000 7f574d1ea780 1 < completed delete operation key=HFWA7DNUMWF2 tag=IKIWBN01UDB6 type=del 2024-09-12T17:18:17.037 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.037+0000 7f574d1ea780 1 > prepared operation key=A1TIP3RXHBCZ tag=FY3V4CAFBSG1 type=del size=2766137 2024-09-12T17:18:17.039 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.038+0000 7f574d1ea780 1 < completed write operation key=VWWA5IB0L4N1 tag=LDQMTOJAM1L1 type=write size=350311 2024-09-12T17:18:17.040 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.039+0000 7f574d1ea780 1 > prepared operation key=YXIDO0U18839 tag=CZ0PCJT0SOK9 type=del size=60749 2024-09-12T17:18:17.041 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.040+0000 7f574d1ea780 -1 < failed to complete operation key=U6E9A5OH4GUW tag=EGKIVFIW05OF type=del size=624029: (22) Invalid argument 2024-09-12T17:18:17.044 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.043+0000 7f574d1ea780 1 > prepared part key=_multipart_HGZMN894YYC0.2~OD93V7X9ZT5L.0 size=522159 2024-09-12T17:18:17.044 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.043+0000 7f574d1ea780 1 > prepared multipart upload key=HGZMN894YYC0 upload=OD93V7X9ZT5L tag=8VNL9PK8PGUC type=write size=1570735 2024-09-12T17:18:17.045 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.044+0000 7f574d1ea780 -1 < failed to complete operation key=GEGOEB05R0PK tag=53372C767ACP type=write size=41220: (22) Invalid argument 2024-09-12T17:18:17.047 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.046+0000 7f574d1ea780 1 > prepared part key=_multipart_QXD8UG2K4STQ.2~U0UARK7CYF62.0 size=1048576 2024-09-12T17:18:17.048 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.047+0000 7f574d1ea780 1 > prepared part key=_multipart_QXD8UG2K4STQ.2~U0UARK7CYF62.1 size=129292 2024-09-12T17:18:17.048 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.047+0000 7f574d1ea780 1 > prepared multipart upload key=QXD8UG2K4STQ upload=U0UARK7CYF62 tag=MZ47K6CNOLOF type=write size=2226444 2024-09-12T17:18:17.049 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.049+0000 7f574d1ea780 1 < completed part key=_multipart_K12MVG618809.2~PWZAJT3SDXBQ.0 size=1012104 2024-09-12T17:18:17.052 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.051+0000 7f574d1ea780 1 < completed multipart upload key=K12MVG618809 upload=PWZAJT3SDXBQ tag=ZKDXXT2DNVPB type=write size=2060680 2024-09-12T17:18:17.053 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.053+0000 7f574d1ea780 1 > prepared operation key=ZGE1860DMGHA tag=X2N9NHHFZPAB type=del size=3659914 2024-09-12T17:18:17.055 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.054+0000 7f574d1ea780 1 < completed delete operation key=C9IYR9CET1I8 tag=3DN10WASM3WP type=del 2024-09-12T17:18:17.057 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.056+0000 7f574d1ea780 1 > prepared operation key=TIKBUXFPVTN1 tag=X0YYU1RF8HVQ type=del size=2578130 2024-09-12T17:18:17.058 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.057+0000 7f574d1ea780 1 < completed delete operation key=8VW3XCUHLF2L tag=X46J19PA25HQ type=del 2024-09-12T17:18:17.061 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.060+0000 7f574d1ea780 1 > prepared part key=_multipart_K12MVG618809.2~JXX6KA4R21YA.0 size=1048576 2024-09-12T17:18:17.062 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.061+0000 7f574d1ea780 1 > prepared part key=_multipart_K12MVG618809.2~JXX6KA4R21YA.1 size=401086 2024-09-12T17:18:17.062 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.061+0000 7f574d1ea780 1 > prepared multipart upload key=K12MVG618809 upload=JXX6KA4R21YA tag=YQCZ66X5IMY7 type=write size=2498238 2024-09-12T17:18:17.065 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.064+0000 7f574d1ea780 1 < suggested update operation key=U6E9A5OH4GUW tag=C6K9QNPD6ZX2 type=del size=957970 2024-09-12T17:18:17.066 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.065+0000 7f574d1ea780 1 > prepared operation key=55V137SY4E4P tag=JKQ34VXKOTOE type=del size=3875031 2024-09-12T17:18:17.068 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.067+0000 7f574d1ea780 1 < completed part key=_multipart_K12MVG618809.2~6TUAW4RALO7C.0 size=851499 2024-09-12T17:18:17.070 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.069+0000 7f574d1ea780 1 < completed multipart upload key=K12MVG618809 upload=6TUAW4RALO7C tag=CGH4NZSAFXQF type=write size=1900075 2024-09-12T17:18:17.072 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.071+0000 7f574d1ea780 1 > prepared part key=_multipart_UTCKL1F42X8A.2~3FRA2ZMZUF95.0 size=40639 2024-09-12T17:18:17.072 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.071+0000 7f574d1ea780 1 > prepared multipart upload key=UTCKL1F42X8A upload=3FRA2ZMZUF95 tag=XYUGGOPV8ZTP type=write size=1089215 2024-09-12T17:18:17.072 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.071+0000 7f574d1ea780 1 < canceled part key=_multipart_K12MVG618809.2~TG5P50CQUL45.0 size=649040 2024-09-12T17:18:17.074 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.073+0000 7f574d1ea780 1 < canceled multipart upload key=K12MVG618809 upload=TG5P50CQUL45 tag=Y3ILFOLH37CI type=write size=1697616 2024-09-12T17:18:17.075 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.075+0000 7f574d1ea780 1 > prepared operation key=Q2Q3B1J3DAVD tag=98KKSYSNX8HW type=del size=3306013 2024-09-12T17:18:17.077 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.076+0000 7f574d1ea780 1 < completed delete operation key=UTCKL1F42X8A tag=X3DWTYNTN21A type=del 2024-09-12T17:18:17.078 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.077+0000 7f574d1ea780 1 > prepared operation key=A1TIP3RXHBCZ tag=HIYV136IX8KZ type=del size=756962 2024-09-12T17:18:17.079 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.078+0000 7f574d1ea780 1 < completed part key=_multipart_GEGOEB05R0PK.2~XNKI67FINUTL.0 size=168046 2024-09-12T17:18:17.081 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.080+0000 7f574d1ea780 1 < completed multipart upload key=GEGOEB05R0PK upload=XNKI67FINUTL tag=ST9OBFGGB5QQ type=write size=1216622 2024-09-12T17:18:17.083 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.082+0000 7f574d1ea780 1 > prepared operation key=SQQMJ61CA0QW tag=J6K3MWNU2712 type=del size=2027335 2024-09-12T17:18:17.084 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.083+0000 7f574d1ea780 1 < completed delete operation key=YXIDO0U18839 tag=VT9BGCJH2OLE type=del 2024-09-12T17:18:17.085 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.084+0000 7f574d1ea780 1 > prepared operation key=GEGOEB05R0PK tag=1Q7MEWSI0TRN type=write size=743546 2024-09-12T17:18:17.086 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.086+0000 7f574d1ea780 1 < completed part key=_multipart_QXD8UG2K4STQ.2~9LHSBVVK7GLB.0 size=140003 2024-09-12T17:18:17.088 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.088+0000 7f574d1ea780 1 < completed multipart upload key=QXD8UG2K4STQ upload=9LHSBVVK7GLB tag=L05P4RBUA80Q type=write size=1188579 2024-09-12T17:18:17.090 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.090+0000 7f574d1ea780 1 > prepared part key=_multipart_A1TIP3RXHBCZ.2~ZGVZHNP4AKDW.0 size=1048576 2024-09-12T17:18:17.092 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.091+0000 7f574d1ea780 1 > prepared part key=_multipart_A1TIP3RXHBCZ.2~ZGVZHNP4AKDW.1 size=1048576 2024-09-12T17:18:17.093 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.092+0000 7f574d1ea780 1 > prepared part key=_multipart_A1TIP3RXHBCZ.2~ZGVZHNP4AKDW.2 size=991514 2024-09-12T17:18:17.093 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.092+0000 7f574d1ea780 1 > prepared multipart upload key=A1TIP3RXHBCZ upload=ZGVZHNP4AKDW tag=Z0MOET1VJ059 type=write size=4137242 2024-09-12T17:18:17.094 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.093+0000 7f574d1ea780 1 < completed part key=_multipart_OI51GO639LFK.2~HNKSEXW3B1CQ.0 size=1048576 2024-09-12T17:18:17.095 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.094+0000 7f574d1ea780 1 < completed part key=_multipart_OI51GO639LFK.2~HNKSEXW3B1CQ.1 size=1048576 2024-09-12T17:18:17.096 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.095+0000 7f574d1ea780 1 < completed part key=_multipart_OI51GO639LFK.2~HNKSEXW3B1CQ.2 size=789514 2024-09-12T17:18:17.098 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.097+0000 7f574d1ea780 1 < completed multipart upload key=OI51GO639LFK upload=HNKSEXW3B1CQ tag=8X3IYM4744YJ type=write size=3935242 2024-09-12T17:18:17.099 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.098+0000 7f574d1ea780 1 > prepared operation key=QXD8UG2K4STQ tag=PSBWSI0GX6X0 type=del size=131266 2024-09-12T17:18:17.100 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.099+0000 7f574d1ea780 1 < completed part key=_multipart_54LQ91UMBJAN.2~QYA05SLFG0OW.0 size=364284 2024-09-12T17:18:17.103 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.103+0000 7f574d1ea780 1 < completed multipart upload key=54LQ91UMBJAN upload=QYA05SLFG0OW tag=9310RB08R7WP type=write size=1412860 2024-09-12T17:18:17.105 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.104+0000 7f574d1ea780 1 > prepared operation key=A1TIP3RXHBCZ tag=M1RX8RJFZ0MQ type=del size=4121798 2024-09-12T17:18:17.107 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.106+0000 7f574d1ea780 1 < suggested remove operation key=A1TIP3RXHBCZ tag=FY3V4CAFBSG1 type=del 2024-09-12T17:18:17.109 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.108+0000 7f574d1ea780 1 > prepared part key=_multipart_QXD8UG2K4STQ.2~C50LJVRX3UE4.0 size=1048576 2024-09-12T17:18:17.110 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.109+0000 7f574d1ea780 1 > prepared part key=_multipart_QXD8UG2K4STQ.2~C50LJVRX3UE4.1 size=750606 2024-09-12T17:18:17.110 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.109+0000 7f574d1ea780 1 > prepared multipart upload key=QXD8UG2K4STQ upload=C50LJVRX3UE4 tag=4M6BNBFYXVFY type=write size=2847758 2024-09-12T17:18:17.111 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.111+0000 7f574d1ea780 1 < completed delete operation key=YXIDO0U18839 tag=CZ0PCJT0SOK9 type=del 2024-09-12T17:18:17.114 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.113+0000 7f574d1ea780 1 > prepared part key=_multipart_8VW3XCUHLF2L.2~MHTFOCRCVS98.0 size=1048576 2024-09-12T17:18:17.115 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.114+0000 7f574d1ea780 1 > prepared part key=_multipart_8VW3XCUHLF2L.2~MHTFOCRCVS98.1 size=1048576 2024-09-12T17:18:17.116 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.115+0000 7f574d1ea780 1 > prepared part key=_multipart_8VW3XCUHLF2L.2~MHTFOCRCVS98.2 size=155827 2024-09-12T17:18:17.116 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.115+0000 7f574d1ea780 1 > prepared multipart upload key=8VW3XCUHLF2L upload=MHTFOCRCVS98 tag=O39M9CQRA225 type=write size=3301555 2024-09-12T17:18:17.117 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.116+0000 7f574d1ea780 1 < completed part key=_multipart_HGZMN894YYC0.2~OD93V7X9ZT5L.0 size=522159 2024-09-12T17:18:17.119 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.118+0000 7f574d1ea780 1 < completed multipart upload key=HGZMN894YYC0 upload=OD93V7X9ZT5L tag=8VNL9PK8PGUC type=write size=1570735 2024-09-12T17:18:17.120 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.119+0000 7f574d1ea780 1 > prepared operation key=55JI541K1WP2 tag=6NXJFZ6YX7SM type=del size=3818785 2024-09-12T17:18:17.121 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.121+0000 7f574d1ea780 1 < completed part key=_multipart_QXD8UG2K4STQ.2~U0UARK7CYF62.0 size=1048576 2024-09-12T17:18:17.122 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.122+0000 7f574d1ea780 1 < completed part key=_multipart_QXD8UG2K4STQ.2~U0UARK7CYF62.1 size=129292 2024-09-12T17:18:17.125 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.124+0000 7f574d1ea780 1 < completed multipart upload key=QXD8UG2K4STQ upload=U0UARK7CYF62 tag=MZ47K6CNOLOF type=write size=2226444 2024-09-12T17:18:17.126 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.125+0000 7f574d1ea780 1 > prepared operation key=RWVWJHVZE95H tag=DGTQ99Z0RJ7S type=del size=3456420 2024-09-12T17:18:17.129 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.127+0000 7f574d1ea780 1 < suggested update operation key=ZGE1860DMGHA tag=X2N9NHHFZPAB type=del size=3659914 2024-09-12T17:18:17.131 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.130+0000 7f574d1ea780 1 > prepared part key=_multipart_UTCKL1F42X8A.2~EWGOG118P9VB.0 size=1048576 2024-09-12T17:18:17.132 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.131+0000 7f574d1ea780 1 > prepared part key=_multipart_UTCKL1F42X8A.2~EWGOG118P9VB.1 size=1020763 2024-09-12T17:18:17.132 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.131+0000 7f574d1ea780 1 > prepared multipart upload key=UTCKL1F42X8A upload=EWGOG118P9VB tag=EJF6LK3OYGV0 type=write size=3117915 2024-09-12T17:18:17.133 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.132+0000 7f574d1ea780 1 < completed delete operation key=TIKBUXFPVTN1 tag=X0YYU1RF8HVQ type=del 2024-09-12T17:18:17.134 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.133+0000 7f574d1ea780 1 > prepared operation key=ENFNIFHQ3SHW tag=837DTYC0O17T type=del size=1561930 2024-09-12T17:18:17.135 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.134+0000 7f574d1ea780 1 < completed part key=_multipart_K12MVG618809.2~JXX6KA4R21YA.0 size=1048576 2024-09-12T17:18:17.136 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.136+0000 7f574d1ea780 1 < completed part key=_multipart_K12MVG618809.2~JXX6KA4R21YA.1 size=401086 2024-09-12T17:18:17.139 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.138+0000 7f574d1ea780 1 < completed multipart upload key=K12MVG618809 upload=JXX6KA4R21YA tag=YQCZ66X5IMY7 type=write size=2498238 2024-09-12T17:18:17.141 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.140+0000 7f574d1ea780 1 > prepared part key=_multipart_SQQMJ61CA0QW.2~ICIJRYHX7QO5.0 size=907605 2024-09-12T17:18:17.141 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.140+0000 7f574d1ea780 1 > prepared multipart upload key=SQQMJ61CA0QW upload=ICIJRYHX7QO5 tag=USC6OYRUE6XX type=write size=1956181 2024-09-12T17:18:17.142 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.141+0000 7f574d1ea780 1 < completed delete operation key=55V137SY4E4P tag=JKQ34VXKOTOE type=del 2024-09-12T17:18:17.143 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.143+0000 7f574d1ea780 1 > prepared operation key=HFWA7DNUMWF2 tag=Y11LBDGBP2Z7 type=del size=1883370 2024-09-12T17:18:17.145 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.144+0000 7f574d1ea780 1 < completed part key=_multipart_UTCKL1F42X8A.2~3FRA2ZMZUF95.0 size=40639 2024-09-12T17:18:17.147 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.146+0000 7f574d1ea780 1 < completed multipart upload key=UTCKL1F42X8A upload=3FRA2ZMZUF95 tag=XYUGGOPV8ZTP type=write size=1089215 2024-09-12T17:18:17.148 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.147+0000 7f574d1ea780 1 > prepared operation key=55V137SY4E4P tag=OOLUBTB98X3J type=write size=945179 2024-09-12T17:18:17.149 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.149+0000 7f574d1ea780 1 < canceled operation key=Q2Q3B1J3DAVD tag=98KKSYSNX8HW type=del size=3306013 2024-09-12T17:18:17.151 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.150+0000 7f574d1ea780 1 > prepared operation key=D1GEG3MKPOM3 tag=D1LK96338KJO type=del size=2062301 2024-09-12T17:18:17.152 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.151+0000 7f574d1ea780 -1 < failed to complete operation key=A1TIP3RXHBCZ tag=HIYV136IX8KZ type=del size=756962: (22) Invalid argument 2024-09-12T17:18:17.154 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.153+0000 7f574d1ea780 1 > prepared part key=_multipart_A1TIP3RXHBCZ.2~5VJ12WVJ98DD.0 size=1048576 2024-09-12T17:18:17.155 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.154+0000 7f574d1ea780 1 > prepared part key=_multipart_A1TIP3RXHBCZ.2~5VJ12WVJ98DD.1 size=1048576 2024-09-12T17:18:17.156 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.155+0000 7f574d1ea780 1 > prepared part key=_multipart_A1TIP3RXHBCZ.2~5VJ12WVJ98DD.2 size=630656 2024-09-12T17:18:17.156 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.155+0000 7f574d1ea780 1 > prepared multipart upload key=A1TIP3RXHBCZ upload=5VJ12WVJ98DD tag=5DR5M6K7ZCYH type=write size=3776384 2024-09-12T17:18:17.157 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.156+0000 7f574d1ea780 1 < completed delete operation key=SQQMJ61CA0QW tag=J6K3MWNU2712 type=del 2024-09-12T17:18:17.158 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.158+0000 7f574d1ea780 1 > prepared operation key=43GV2N9VBBKE tag=684B06WFCKF2 type=del size=1899528 2024-09-12T17:18:17.160 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.159+0000 7f574d1ea780 1 < completed write operation key=GEGOEB05R0PK tag=1Q7MEWSI0TRN type=write size=743546 2024-09-12T17:18:17.161 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.160+0000 7f574d1ea780 1 > prepared operation key=RWVWJHVZE95H tag=J9WMWJDSXHPK type=write size=677665 2024-09-12T17:18:17.162 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.161+0000 7f574d1ea780 1 < completed part key=_multipart_A1TIP3RXHBCZ.2~ZGVZHNP4AKDW.0 size=1048576 2024-09-12T17:18:17.163 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.162+0000 7f574d1ea780 1 < completed part key=_multipart_A1TIP3RXHBCZ.2~ZGVZHNP4AKDW.1 size=1048576 2024-09-12T17:18:17.163 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.162+0000 7f574d1ea780 1 < canceled part key=_multipart_A1TIP3RXHBCZ.2~ZGVZHNP4AKDW.2 size=991514 2024-09-12T17:18:17.165 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.164+0000 7f574d1ea780 1 < canceled multipart upload key=A1TIP3RXHBCZ upload=ZGVZHNP4AKDW tag=Z0MOET1VJ059 type=write size=4137242 2024-09-12T17:18:17.168 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.167+0000 7f574d1ea780 1 > prepared operation key=C9IYR9CET1I8 tag=6FL6XK5YAGWZ type=del size=392954 2024-09-12T17:18:17.169 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.168+0000 7f574d1ea780 1 < completed delete operation key=QXD8UG2K4STQ tag=PSBWSI0GX6X0 type=del 2024-09-12T17:18:17.170 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.169+0000 7f574d1ea780 1 > prepared operation key=RNI86YYLADT0 tag=7GZK9C8VC5OE type=del size=308705 2024-09-12T17:18:17.171 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.170+0000 7f574d1ea780 -1 < failed to complete operation key=A1TIP3RXHBCZ tag=M1RX8RJFZ0MQ type=del size=4121798: (22) Invalid argument 2024-09-12T17:18:17.172 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.172+0000 7f574d1ea780 1 > prepared operation key=A1TIP3RXHBCZ tag=HUX2GVEOGP6S type=del size=3835861 2024-09-12T17:18:17.174 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.173+0000 7f574d1ea780 1 < completed part key=_multipart_QXD8UG2K4STQ.2~C50LJVRX3UE4.0 size=1048576 2024-09-12T17:18:17.175 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.174+0000 7f574d1ea780 1 < completed part key=_multipart_QXD8UG2K4STQ.2~C50LJVRX3UE4.1 size=750606 2024-09-12T17:18:17.177 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.176+0000 7f574d1ea780 1 < completed multipart upload key=QXD8UG2K4STQ upload=C50LJVRX3UE4 tag=4M6BNBFYXVFY type=write size=2847758 2024-09-12T17:18:17.178 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.177+0000 7f574d1ea780 1 > prepared operation key=A1TIP3RXHBCZ tag=V6YWPPDQ18ZA type=write size=757626 2024-09-12T17:18:17.179 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.178+0000 7f574d1ea780 1 < completed part key=_multipart_8VW3XCUHLF2L.2~MHTFOCRCVS98.0 size=1048576 2024-09-12T17:18:17.179 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.178+0000 7f574d1ea780 1 < canceled part key=_multipart_8VW3XCUHLF2L.2~MHTFOCRCVS98.1 size=1048576 2024-09-12T17:18:17.180 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.179+0000 7f574d1ea780 1 < completed part key=_multipart_8VW3XCUHLF2L.2~MHTFOCRCVS98.2 size=155827 2024-09-12T17:18:17.182 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.181+0000 7f574d1ea780 1 < canceled multipart upload key=8VW3XCUHLF2L upload=MHTFOCRCVS98 tag=O39M9CQRA225 type=write size=3301555 2024-09-12T17:18:17.183 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.183+0000 7f574d1ea780 1 > prepared operation key=55JI541K1WP2 tag=NIRASJZUYIAE type=del size=2293599 2024-09-12T17:18:17.185 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.184+0000 7f574d1ea780 1 < completed delete operation key=55JI541K1WP2 tag=6NXJFZ6YX7SM type=del 2024-09-12T17:18:17.187 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.186+0000 7f574d1ea780 1 > prepared part key=_multipart_DH02JGZP64MN.2~T0O91N6I9X5L.0 size=792811 2024-09-12T17:18:17.187 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.186+0000 7f574d1ea780 1 > prepared multipart upload key=DH02JGZP64MN upload=T0O91N6I9X5L tag=N1GWDNRO05NS type=write size=1841387 2024-09-12T17:18:17.189 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.189+0000 7f574d1ea780 1 < suggested remove operation key=RWVWJHVZE95H tag=DGTQ99Z0RJ7S type=del 2024-09-12T17:18:17.192 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.191+0000 7f574d1ea780 1 > prepared part key=_multipart_OI51GO639LFK.2~KGDTEH9EE4K8.0 size=483045 2024-09-12T17:18:17.192 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.191+0000 7f574d1ea780 1 > prepared multipart upload key=OI51GO639LFK upload=KGDTEH9EE4K8 tag=ALGYX82GI1P8 type=write size=1531621 2024-09-12T17:18:17.193 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.192+0000 7f574d1ea780 1 < completed part key=_multipart_UTCKL1F42X8A.2~EWGOG118P9VB.0 size=1048576 2024-09-12T17:18:17.194 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.193+0000 7f574d1ea780 1 < completed part key=_multipart_UTCKL1F42X8A.2~EWGOG118P9VB.1 size=1020763 2024-09-12T17:18:17.196 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.195+0000 7f574d1ea780 1 < completed multipart upload key=UTCKL1F42X8A upload=EWGOG118P9VB tag=EJF6LK3OYGV0 type=write size=3117915 2024-09-12T17:18:17.198 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.197+0000 7f574d1ea780 1 > prepared part key=_multipart_43GV2N9VBBKE.2~MM0EHDQU412D.0 size=567070 2024-09-12T17:18:17.198 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.197+0000 7f574d1ea780 1 > prepared multipart upload key=43GV2N9VBBKE upload=MM0EHDQU412D tag=PSR2RX9ANSE2 type=write size=1615646 2024-09-12T17:18:17.199 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.199+0000 7f574d1ea780 1 < completed delete operation key=ENFNIFHQ3SHW tag=837DTYC0O17T type=del 2024-09-12T17:18:17.202 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.201+0000 7f574d1ea780 1 > prepared part key=_multipart_SQQMJ61CA0QW.2~AVDK8AHPWRPC.0 size=225598 2024-09-12T17:18:17.202 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.201+0000 7f574d1ea780 1 > prepared multipart upload key=SQQMJ61CA0QW upload=AVDK8AHPWRPC tag=VVIE8H6OXKO4 type=write size=1274174 2024-09-12T17:18:17.203 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.202+0000 7f574d1ea780 1 < completed part key=_multipart_SQQMJ61CA0QW.2~ICIJRYHX7QO5.0 size=907605 2024-09-12T17:18:17.205 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.204+0000 7f574d1ea780 1 < completed multipart upload key=SQQMJ61CA0QW upload=ICIJRYHX7QO5 tag=USC6OYRUE6XX type=write size=1956181 2024-09-12T17:18:17.207 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.206+0000 7f574d1ea780 1 > prepared part key=_multipart_YXIDO0U18839.2~WF2TU8FIHT0W.0 size=1048576 2024-09-12T17:18:17.208 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.207+0000 7f574d1ea780 1 > prepared part key=_multipart_YXIDO0U18839.2~WF2TU8FIHT0W.1 size=444486 2024-09-12T17:18:17.208 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.207+0000 7f574d1ea780 1 > prepared multipart upload key=YXIDO0U18839 upload=WF2TU8FIHT0W tag=TR4VMPI2ADTT type=write size=2541638 2024-09-12T17:18:17.209 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.208+0000 7f574d1ea780 1 < completed delete operation key=HFWA7DNUMWF2 tag=Y11LBDGBP2Z7 type=del 2024-09-12T17:18:17.211 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.210+0000 7f574d1ea780 1 > prepared operation key=7BX38Q7723EB tag=FB6NUMGK7MVG type=del size=3463069 2024-09-12T17:18:17.212 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.211+0000 7f574d1ea780 1 < completed write operation key=55V137SY4E4P tag=OOLUBTB98X3J type=write size=945179 2024-09-12T17:18:17.213 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.212+0000 7f574d1ea780 1 > prepared operation key=54CM8800AT9V tag=HAL0VXNA52IN type=del size=2532750 2024-09-12T17:18:17.215 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.215+0000 7f574d1ea780 1 < suggested update operation key=D1GEG3MKPOM3 tag=D1LK96338KJO type=del size=2062301 2024-09-12T17:18:17.219 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.218+0000 7f574d1ea780 1 > prepared part key=_multipart_ENFNIFHQ3SHW.2~N165V8NCBHGW.0 size=724819 2024-09-12T17:18:17.219 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.218+0000 7f574d1ea780 1 > prepared multipart upload key=ENFNIFHQ3SHW upload=N165V8NCBHGW tag=R1BWXKMAE5Z7 type=write size=1773395 2024-09-12T17:18:17.220 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.219+0000 7f574d1ea780 1 < completed part key=_multipart_A1TIP3RXHBCZ.2~5VJ12WVJ98DD.0 size=1048576 2024-09-12T17:18:17.221 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.220+0000 7f574d1ea780 1 < completed part key=_multipart_A1TIP3RXHBCZ.2~5VJ12WVJ98DD.1 size=1048576 2024-09-12T17:18:17.222 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.221+0000 7f574d1ea780 1 < completed part key=_multipart_A1TIP3RXHBCZ.2~5VJ12WVJ98DD.2 size=630656 2024-09-12T17:18:17.224 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.223+0000 7f574d1ea780 1 < completed multipart upload key=A1TIP3RXHBCZ upload=5VJ12WVJ98DD tag=5DR5M6K7ZCYH type=write size=3776384 2024-09-12T17:18:17.226 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.225+0000 7f574d1ea780 1 > prepared part key=_multipart_VWWA5IB0L4N1.2~6Q04D9XYZDQ5.0 size=1048576 2024-09-12T17:18:17.227 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.226+0000 7f574d1ea780 1 > prepared part key=_multipart_VWWA5IB0L4N1.2~6Q04D9XYZDQ5.1 size=417912 2024-09-12T17:18:17.227 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.226+0000 7f574d1ea780 1 > prepared multipart upload key=VWWA5IB0L4N1 upload=6Q04D9XYZDQ5 tag=RW04JS8GX095 type=write size=2515064 2024-09-12T17:18:17.228 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.227+0000 7f574d1ea780 1 < completed delete operation key=43GV2N9VBBKE tag=684B06WFCKF2 type=del 2024-09-12T17:18:17.229 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.228+0000 7f574d1ea780 1 > prepared operation key=55JI541K1WP2 tag=4DEYFKJS8Y18 type=del size=2517406 2024-09-12T17:18:17.230 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.230+0000 7f574d1ea780 -1 < failed to complete operation key=RWVWJHVZE95H tag=J9WMWJDSXHPK type=write size=677665: (22) Invalid argument 2024-09-12T17:18:17.233 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.232+0000 7f574d1ea780 1 > prepared part key=_multipart_TIKBUXFPVTN1.2~W4X63T127LQU.0 size=598956 2024-09-12T17:18:17.233 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.232+0000 7f574d1ea780 1 > prepared multipart upload key=TIKBUXFPVTN1 upload=W4X63T127LQU tag=6WFYP3FLY7HE type=write size=1647532 2024-09-12T17:18:17.234 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.233+0000 7f574d1ea780 1 < completed delete operation key=C9IYR9CET1I8 tag=6FL6XK5YAGWZ type=del 2024-09-12T17:18:17.235 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.234+0000 7f574d1ea780 1 > prepared operation key=Q2Q3B1J3DAVD tag=LNL86OP9C4IO type=del size=1595911 2024-09-12T17:18:17.236 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.235+0000 7f574d1ea780 1 < completed delete operation key=RNI86YYLADT0 tag=7GZK9C8VC5OE type=del 2024-09-12T17:18:17.238 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.238+0000 7f574d1ea780 1 > prepared part key=_multipart_ZGE1860DMGHA.2~ST1V83B5FUB1.0 size=1048576 2024-09-12T17:18:17.239 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.239+0000 7f574d1ea780 1 > prepared part key=_multipart_ZGE1860DMGHA.2~ST1V83B5FUB1.1 size=946089 2024-09-12T17:18:17.239 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.239+0000 7f574d1ea780 1 > prepared multipart upload key=ZGE1860DMGHA upload=ST1V83B5FUB1 tag=HG7X1N5VBZ0D type=write size=3043241 2024-09-12T17:18:17.241 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.240+0000 7f574d1ea780 1 < completed delete operation key=A1TIP3RXHBCZ tag=HUX2GVEOGP6S type=del 2024-09-12T17:18:17.243 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.242+0000 7f574d1ea780 1 > prepared part key=_multipart_8VW3XCUHLF2L.2~Q738NY8YB1KU.0 size=1048576 2024-09-12T17:18:17.244 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.243+0000 7f574d1ea780 1 > prepared part key=_multipart_8VW3XCUHLF2L.2~Q738NY8YB1KU.1 size=1048576 2024-09-12T17:18:17.245 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.244+0000 7f574d1ea780 1 > prepared part key=_multipart_8VW3XCUHLF2L.2~Q738NY8YB1KU.2 size=225507 2024-09-12T17:18:17.245 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.244+0000 7f574d1ea780 1 > prepared multipart upload key=8VW3XCUHLF2L upload=Q738NY8YB1KU tag=A64SG6809UC4 type=write size=3371235 2024-09-12T17:18:17.246 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.245+0000 7f574d1ea780 1 < completed write operation key=A1TIP3RXHBCZ tag=V6YWPPDQ18ZA type=write size=757626 2024-09-12T17:18:17.248 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.248+0000 7f574d1ea780 1 > prepared part key=_multipart_SQQMJ61CA0QW.2~LQRIG0218FL8.0 size=1048576 2024-09-12T17:18:17.249 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.249+0000 7f574d1ea780 1 > prepared part key=_multipart_SQQMJ61CA0QW.2~LQRIG0218FL8.1 size=1048576 2024-09-12T17:18:17.250 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.250+0000 7f574d1ea780 1 > prepared part key=_multipart_SQQMJ61CA0QW.2~LQRIG0218FL8.2 size=883954 2024-09-12T17:18:17.250 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.250+0000 7f574d1ea780 1 > prepared multipart upload key=SQQMJ61CA0QW upload=LQRIG0218FL8 tag=CYR30TEOA0DM type=write size=4029682 2024-09-12T17:18:17.252 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.251+0000 7f574d1ea780 1 < completed delete operation key=55JI541K1WP2 tag=NIRASJZUYIAE type=del 2024-09-12T17:18:17.254 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.253+0000 7f574d1ea780 1 > prepared part key=_multipart_UTCKL1F42X8A.2~0U7X1VMU3L9N.0 size=1048576 2024-09-12T17:18:17.255 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.254+0000 7f574d1ea780 1 > prepared part key=_multipart_UTCKL1F42X8A.2~0U7X1VMU3L9N.1 size=17835 2024-09-12T17:18:17.255 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.254+0000 7f574d1ea780 1 > prepared multipart upload key=UTCKL1F42X8A upload=0U7X1VMU3L9N tag=UM74P58CA1AH type=write size=2114987 2024-09-12T17:18:17.256 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.255+0000 7f574d1ea780 1 < completed part key=_multipart_DH02JGZP64MN.2~T0O91N6I9X5L.0 size=792811 2024-09-12T17:18:17.258 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.257+0000 7f574d1ea780 1 < completed multipart upload key=DH02JGZP64MN upload=T0O91N6I9X5L tag=N1GWDNRO05NS type=write size=1841387 2024-09-12T17:18:17.259 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.259+0000 7f574d1ea780 1 > prepared operation key=DH02JGZP64MN tag=VKK2JSV6UB3Q type=del size=532301 2024-09-12T17:18:17.261 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.260+0000 7f574d1ea780 1 < completed part key=_multipart_OI51GO639LFK.2~KGDTEH9EE4K8.0 size=483045 2024-09-12T17:18:17.263 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.262+0000 7f574d1ea780 1 < completed multipart upload key=OI51GO639LFK upload=KGDTEH9EE4K8 tag=ALGYX82GI1P8 type=write size=1531621 2024-09-12T17:18:17.264 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.263+0000 7f574d1ea780 1 > prepared operation key=7BX38Q7723EB tag=KUMVYLMLL2O3 type=del size=2879262 2024-09-12T17:18:17.265 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.265+0000 7f574d1ea780 1 < completed part key=_multipart_43GV2N9VBBKE.2~MM0EHDQU412D.0 size=567070 2024-09-12T17:18:17.267 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.267+0000 7f574d1ea780 1 < completed multipart upload key=43GV2N9VBBKE upload=MM0EHDQU412D tag=PSR2RX9ANSE2 type=write size=1615646 2024-09-12T17:18:17.270 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.269+0000 7f574d1ea780 1 > prepared part key=_multipart_55V137SY4E4P.2~H4YBDK9HLD2X.0 size=509263 2024-09-12T17:18:17.270 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.269+0000 7f574d1ea780 1 > prepared multipart upload key=55V137SY4E4P upload=H4YBDK9HLD2X tag=C6JOTC1USKWB type=write size=1557839 2024-09-12T17:18:17.271 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.270+0000 7f574d1ea780 1 < completed part key=_multipart_SQQMJ61CA0QW.2~AVDK8AHPWRPC.0 size=225598 2024-09-12T17:18:17.273 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.272+0000 7f574d1ea780 1 < completed multipart upload key=SQQMJ61CA0QW upload=AVDK8AHPWRPC tag=VVIE8H6OXKO4 type=write size=1274174 2024-09-12T17:18:17.275 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.275+0000 7f574d1ea780 1 > prepared part key=_multipart_HFWA7DNUMWF2.2~AUF7XDX5T3D6.0 size=1048576 2024-09-12T17:18:17.276 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.276+0000 7f574d1ea780 1 > prepared part key=_multipart_HFWA7DNUMWF2.2~AUF7XDX5T3D6.1 size=604257 2024-09-12T17:18:17.276 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.276+0000 7f574d1ea780 1 > prepared multipart upload key=HFWA7DNUMWF2 upload=AUF7XDX5T3D6 tag=CEZRSLOL1741 type=write size=2701409 2024-09-12T17:18:17.278 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.277+0000 7f574d1ea780 1 < completed part key=_multipart_YXIDO0U18839.2~WF2TU8FIHT0W.0 size=1048576 2024-09-12T17:18:17.279 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.278+0000 7f574d1ea780 1 < completed part key=_multipart_YXIDO0U18839.2~WF2TU8FIHT0W.1 size=444486 2024-09-12T17:18:17.281 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.280+0000 7f574d1ea780 1 < completed multipart upload key=YXIDO0U18839 upload=WF2TU8FIHT0W tag=TR4VMPI2ADTT type=write size=2541638 2024-09-12T17:18:17.282 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.281+0000 7f574d1ea780 1 > prepared operation key=54LQ91UMBJAN tag=MG1X7BF823PM type=del size=4062596 2024-09-12T17:18:17.283 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.282+0000 7f574d1ea780 1 < completed delete operation key=7BX38Q7723EB tag=FB6NUMGK7MVG type=del 2024-09-12T17:18:17.284 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.283+0000 7f574d1ea780 1 > prepared operation key=RWVWJHVZE95H tag=49C4V0C6NKOI type=del size=2995325 2024-09-12T17:18:17.287 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.286+0000 7f574d1ea780 1 < suggested update operation key=54CM8800AT9V tag=HAL0VXNA52IN type=del size=2532750 2024-09-12T17:18:17.288 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.288+0000 7f574d1ea780 1 > prepared operation key=A1TIP3RXHBCZ tag=QCO3F1ZKWFPS type=del size=906083 2024-09-12T17:18:17.290 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.289+0000 7f574d1ea780 1 < completed part key=_multipart_ENFNIFHQ3SHW.2~N165V8NCBHGW.0 size=724819 2024-09-12T17:18:17.292 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.291+0000 7f574d1ea780 1 < completed multipart upload key=ENFNIFHQ3SHW upload=N165V8NCBHGW tag=R1BWXKMAE5Z7 type=write size=1773395 2024-09-12T17:18:17.294 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.293+0000 7f574d1ea780 1 > prepared part key=_multipart_R00F69ON5P6Z.2~SJPB2A5PCU3I.0 size=76894 2024-09-12T17:18:17.294 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.293+0000 7f574d1ea780 1 > prepared multipart upload key=R00F69ON5P6Z upload=SJPB2A5PCU3I tag=OC8BJDQ0CSEE type=write size=1125470 2024-09-12T17:18:17.294 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.293+0000 7f574d1ea780 1 < canceled part key=_multipart_VWWA5IB0L4N1.2~6Q04D9XYZDQ5.0 size=1048576 2024-09-12T17:18:17.295 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.294+0000 7f574d1ea780 1 < completed part key=_multipart_VWWA5IB0L4N1.2~6Q04D9XYZDQ5.1 size=417912 2024-09-12T17:18:17.297 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.296+0000 7f574d1ea780 1 < canceled multipart upload key=VWWA5IB0L4N1 upload=6Q04D9XYZDQ5 tag=RW04JS8GX095 type=write size=2515064 2024-09-12T17:18:17.299 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.298+0000 7f574d1ea780 1 > prepared part key=_multipart_DH02JGZP64MN.2~Y3BQAVHZIM5P.0 size=1048576 2024-09-12T17:18:17.300 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.299+0000 7f574d1ea780 1 > prepared part key=_multipart_DH02JGZP64MN.2~Y3BQAVHZIM5P.1 size=872497 2024-09-12T17:18:17.300 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.299+0000 7f574d1ea780 1 > prepared multipart upload key=DH02JGZP64MN upload=Y3BQAVHZIM5P tag=C9NK698BIAOJ type=write size=2969649 2024-09-12T17:18:17.301 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.300+0000 7f574d1ea780 1 < completed delete operation key=55JI541K1WP2 tag=4DEYFKJS8Y18 type=del 2024-09-12T17:18:17.302 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.301+0000 7f574d1ea780 1 > prepared operation key=ZGE1860DMGHA tag=43WCECRLW5SP type=del size=2696461 2024-09-12T17:18:17.303 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.303+0000 7f574d1ea780 1 < completed part key=_multipart_TIKBUXFPVTN1.2~W4X63T127LQU.0 size=598956 2024-09-12T17:18:17.305 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.304+0000 7f574d1ea780 1 < completed multipart upload key=TIKBUXFPVTN1 upload=W4X63T127LQU tag=6WFYP3FLY7HE type=write size=1647532 2024-09-12T17:18:17.307 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.307+0000 7f574d1ea780 1 > prepared part key=_multipart_VWWA5IB0L4N1.2~050B8WG2G33X.0 size=1048576 2024-09-12T17:18:17.308 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.308+0000 7f574d1ea780 1 > prepared part key=_multipart_VWWA5IB0L4N1.2~050B8WG2G33X.1 size=408679 2024-09-12T17:18:17.309 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.308+0000 7f574d1ea780 1 > prepared multipart upload key=VWWA5IB0L4N1 upload=050B8WG2G33X tag=Z2MR01TQK9GS type=write size=2505831 2024-09-12T17:18:17.310 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.309+0000 7f574d1ea780 1 < completed delete operation key=Q2Q3B1J3DAVD tag=LNL86OP9C4IO type=del 2024-09-12T17:18:17.312 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.312+0000 7f574d1ea780 1 > prepared part key=_multipart_55JI541K1WP2.2~ARMMPOFWK7E5.0 size=1048576 2024-09-12T17:18:17.315 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.314+0000 7f574d1ea780 1 > prepared part key=_multipart_55JI541K1WP2.2~ARMMPOFWK7E5.1 size=421571 2024-09-12T17:18:17.315 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.314+0000 7f574d1ea780 1 > prepared multipart upload key=55JI541K1WP2 upload=ARMMPOFWK7E5 tag=J7BCV5YQ3HN5 type=write size=2518723 2024-09-12T17:18:17.316 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.315+0000 7f574d1ea780 1 < canceled part key=_multipart_ZGE1860DMGHA.2~ST1V83B5FUB1.0 size=1048576 2024-09-12T17:18:17.317 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.316+0000 7f574d1ea780 1 < completed part key=_multipart_ZGE1860DMGHA.2~ST1V83B5FUB1.1 size=946089 2024-09-12T17:18:17.319 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.318+0000 7f574d1ea780 1 < canceled multipart upload key=ZGE1860DMGHA upload=ST1V83B5FUB1 tag=HG7X1N5VBZ0D type=write size=3043241 2024-09-12T17:18:17.320 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.319+0000 7f574d1ea780 1 > prepared operation key=8SG7DJO4HWPI tag=I44FF3ACUQVV type=del size=1700414 2024-09-12T17:18:17.322 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.321+0000 7f574d1ea780 1 < completed part key=_multipart_8VW3XCUHLF2L.2~Q738NY8YB1KU.0 size=1048576 2024-09-12T17:18:17.323 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.322+0000 7f574d1ea780 1 < completed part key=_multipart_8VW3XCUHLF2L.2~Q738NY8YB1KU.1 size=1048576 2024-09-12T17:18:17.324 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.323+0000 7f574d1ea780 1 < completed part key=_multipart_8VW3XCUHLF2L.2~Q738NY8YB1KU.2 size=225507 2024-09-12T17:18:17.326 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.325+0000 7f574d1ea780 1 < completed multipart upload key=8VW3XCUHLF2L upload=Q738NY8YB1KU tag=A64SG6809UC4 type=write size=3371235 2024-09-12T17:18:17.327 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.327+0000 7f574d1ea780 1 > prepared operation key=RWVWJHVZE95H tag=9QZ5O0JJ5IS8 type=del size=2060077 2024-09-12T17:18:17.329 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.328+0000 7f574d1ea780 1 < completed part key=_multipart_SQQMJ61CA0QW.2~LQRIG0218FL8.0 size=1048576 2024-09-12T17:18:17.330 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.329+0000 7f574d1ea780 1 < completed part key=_multipart_SQQMJ61CA0QW.2~LQRIG0218FL8.1 size=1048576 2024-09-12T17:18:17.331 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.330+0000 7f574d1ea780 1 < completed part key=_multipart_SQQMJ61CA0QW.2~LQRIG0218FL8.2 size=883954 2024-09-12T17:18:17.334 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.333+0000 7f574d1ea780 1 < completed multipart upload key=SQQMJ61CA0QW upload=LQRIG0218FL8 tag=CYR30TEOA0DM type=write size=4029682 2024-09-12T17:18:17.336 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.335+0000 7f574d1ea780 1 > prepared part key=_multipart_U6E9A5OH4GUW.2~51KAYV4ZRKAB.0 size=1048576 2024-09-12T17:18:17.337 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.336+0000 7f574d1ea780 1 > prepared part key=_multipart_U6E9A5OH4GUW.2~51KAYV4ZRKAB.1 size=1048576 2024-09-12T17:18:17.338 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.337+0000 7f574d1ea780 1 > prepared part key=_multipart_U6E9A5OH4GUW.2~51KAYV4ZRKAB.2 size=130030 2024-09-12T17:18:17.338 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.337+0000 7f574d1ea780 1 > prepared multipart upload key=U6E9A5OH4GUW upload=51KAYV4ZRKAB tag=B7W0KK5WD71E type=write size=3275758 2024-09-12T17:18:17.339 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.338+0000 7f574d1ea780 1 < completed part key=_multipart_UTCKL1F42X8A.2~0U7X1VMU3L9N.0 size=1048576 2024-09-12T17:18:17.340 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.340+0000 7f574d1ea780 1 < completed part key=_multipart_UTCKL1F42X8A.2~0U7X1VMU3L9N.1 size=17835 2024-09-12T17:18:17.342 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.342+0000 7f574d1ea780 1 < completed multipart upload key=UTCKL1F42X8A upload=0U7X1VMU3L9N tag=UM74P58CA1AH type=write size=2114987 2024-09-12T17:18:17.344 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.343+0000 7f574d1ea780 1 > prepared operation key=HGZMN894YYC0 tag=WH1HKTH9QG81 type=del size=2084847 2024-09-12T17:18:17.345 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.344+0000 7f574d1ea780 1 < completed delete operation key=DH02JGZP64MN tag=VKK2JSV6UB3Q type=del 2024-09-12T17:18:17.346 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.345+0000 7f574d1ea780 1 > prepared operation key=A1TIP3RXHBCZ tag=BXLATI59100P type=del size=1102880 2024-09-12T17:18:17.347 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.346+0000 7f574d1ea780 1 < completed delete operation key=7BX38Q7723EB tag=KUMVYLMLL2O3 type=del 2024-09-12T17:18:17.348 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.348+0000 7f574d1ea780 1 > prepared operation key=UFKM4I8RMT0W tag=FF20PJVG7OTP type=write size=649552 2024-09-12T17:18:17.350 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.349+0000 7f574d1ea780 1 < completed part key=_multipart_55V137SY4E4P.2~H4YBDK9HLD2X.0 size=509263 2024-09-12T17:18:17.351 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.351+0000 7f574d1ea780 1 < completed multipart upload key=55V137SY4E4P upload=H4YBDK9HLD2X tag=C6JOTC1USKWB type=write size=1557839 2024-09-12T17:18:17.353 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.352+0000 7f574d1ea780 1 > prepared operation key=D1GEG3MKPOM3 tag=SZOAG13VK4TX type=del size=2692312 2024-09-12T17:18:17.354 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.353+0000 7f574d1ea780 1 < completed part key=_multipart_HFWA7DNUMWF2.2~AUF7XDX5T3D6.0 size=1048576 2024-09-12T17:18:17.355 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.354+0000 7f574d1ea780 1 < completed part key=_multipart_HFWA7DNUMWF2.2~AUF7XDX5T3D6.1 size=604257 2024-09-12T17:18:17.357 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.356+0000 7f574d1ea780 1 < completed multipart upload key=HFWA7DNUMWF2 upload=AUF7XDX5T3D6 tag=CEZRSLOL1741 type=write size=2701409 2024-09-12T17:18:17.358 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.357+0000 7f574d1ea780 1 > prepared operation key=UFKM4I8RMT0W tag=RS3VZLAVTJ44 type=del size=1795453 2024-09-12T17:18:17.359 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.358+0000 7f574d1ea780 1 < completed delete operation key=54LQ91UMBJAN tag=MG1X7BF823PM type=del 2024-09-12T17:18:17.360 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.360+0000 7f574d1ea780 1 > prepared operation key=7BX38Q7723EB tag=FHO1KNX1TPX8 type=del size=9080 2024-09-12T17:18:17.362 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.361+0000 7f574d1ea780 1 < completed delete operation key=RWVWJHVZE95H tag=49C4V0C6NKOI type=del 2024-09-12T17:18:17.363 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.362+0000 7f574d1ea780 1 > prepared operation key=54CM8800AT9V tag=GVWKNB52OLMC type=write size=167659 2024-09-12T17:18:17.364 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.363+0000 7f574d1ea780 1 < completed delete operation key=A1TIP3RXHBCZ tag=QCO3F1ZKWFPS type=del 2024-09-12T17:18:17.366 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.366+0000 7f574d1ea780 1 > prepared part key=_multipart_RNI86YYLADT0.2~W10FPTUM3FOC.0 size=1048576 2024-09-12T17:18:17.367 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.366+0000 7f574d1ea780 1 > prepared part key=_multipart_RNI86YYLADT0.2~W10FPTUM3FOC.1 size=25594 2024-09-12T17:18:17.367 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.366+0000 7f574d1ea780 1 > prepared multipart upload key=RNI86YYLADT0 upload=W10FPTUM3FOC tag=D32T2O08HQY8 type=write size=2122746 2024-09-12T17:18:17.369 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.368+0000 7f574d1ea780 1 < completed part key=_multipart_R00F69ON5P6Z.2~SJPB2A5PCU3I.0 size=76894 2024-09-12T17:18:17.370 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.370+0000 7f574d1ea780 1 < completed multipart upload key=R00F69ON5P6Z upload=SJPB2A5PCU3I tag=OC8BJDQ0CSEE type=write size=1125470 2024-09-12T17:18:17.373 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.372+0000 7f574d1ea780 1 > prepared part key=_multipart_YXIDO0U18839.2~P1ZB4X2UV0JN.0 size=1048576 2024-09-12T17:18:17.374 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.373+0000 7f574d1ea780 1 > prepared part key=_multipart_YXIDO0U18839.2~P1ZB4X2UV0JN.1 size=169946 2024-09-12T17:18:17.374 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.373+0000 7f574d1ea780 1 > prepared multipart upload key=YXIDO0U18839 upload=P1ZB4X2UV0JN tag=NPRW3K2Y48L7 type=write size=2267098 2024-09-12T17:18:17.375 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.374+0000 7f574d1ea780 1 < completed part key=_multipart_DH02JGZP64MN.2~Y3BQAVHZIM5P.0 size=1048576 2024-09-12T17:18:17.378 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.377+0000 7f574d1ea780 1 < completed part key=_multipart_DH02JGZP64MN.2~Y3BQAVHZIM5P.1 size=872497 2024-09-12T17:18:17.380 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.379+0000 7f574d1ea780 1 < completed multipart upload key=DH02JGZP64MN upload=Y3BQAVHZIM5P tag=C9NK698BIAOJ type=write size=2969649 2024-09-12T17:18:17.381 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.381+0000 7f574d1ea780 1 > prepared operation key=U6E9A5OH4GUW tag=QTSB9FPDR612 type=write size=504549 2024-09-12T17:18:17.382 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.382+0000 7f574d1ea780 1 < completed delete operation key=ZGE1860DMGHA tag=43WCECRLW5SP type=del 2024-09-12T17:18:17.384 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.383+0000 7f574d1ea780 1 > prepared operation key=55JI541K1WP2 tag=1COSF29UMD7H type=del size=3087511 2024-09-12T17:18:17.385 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.384+0000 7f574d1ea780 1 < completed part key=_multipart_VWWA5IB0L4N1.2~050B8WG2G33X.0 size=1048576 2024-09-12T17:18:17.386 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.385+0000 7f574d1ea780 1 < completed part key=_multipart_VWWA5IB0L4N1.2~050B8WG2G33X.1 size=408679 2024-09-12T17:18:17.388 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.387+0000 7f574d1ea780 1 < completed multipart upload key=VWWA5IB0L4N1 upload=050B8WG2G33X tag=Z2MR01TQK9GS type=write size=2505831 2024-09-12T17:18:17.390 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.390+0000 7f574d1ea780 1 > prepared part key=_multipart_55JI541K1WP2.2~VE292XPGGQ7D.0 size=583002 2024-09-12T17:18:17.390 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.390+0000 7f574d1ea780 1 > prepared multipart upload key=55JI541K1WP2 upload=VE292XPGGQ7D tag=JXO90QMVNKF3 type=write size=1631578 2024-09-12T17:18:17.392 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.391+0000 7f574d1ea780 1 < completed part key=_multipart_55JI541K1WP2.2~ARMMPOFWK7E5.0 size=1048576 2024-09-12T17:18:17.393 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.392+0000 7f574d1ea780 1 < completed part key=_multipart_55JI541K1WP2.2~ARMMPOFWK7E5.1 size=421571 2024-09-12T17:18:17.395 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.394+0000 7f574d1ea780 1 < completed multipart upload key=55JI541K1WP2 upload=ARMMPOFWK7E5 tag=J7BCV5YQ3HN5 type=write size=2518723 2024-09-12T17:18:17.396 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.395+0000 7f574d1ea780 1 > prepared operation key=DH02JGZP64MN tag=31MWFEIKDS59 type=write size=421608 2024-09-12T17:18:17.398 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.397+0000 7f574d1ea780 1 < suggested update operation key=8SG7DJO4HWPI tag=I44FF3ACUQVV type=del size=1700414 2024-09-12T17:18:17.399 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.399+0000 7f574d1ea780 1 > prepared operation key=HGZMN894YYC0 tag=P64WADIS0CLY type=del size=495083 2024-09-12T17:18:17.401 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.400+0000 7f574d1ea780 1 < completed delete operation key=RWVWJHVZE95H tag=9QZ5O0JJ5IS8 type=del 2024-09-12T17:18:17.403 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.402+0000 7f574d1ea780 1 > prepared part key=_multipart_RNI86YYLADT0.2~K7FMIW86BV5J.0 size=1048576 2024-09-12T17:18:17.404 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.403+0000 7f574d1ea780 1 > prepared part key=_multipart_RNI86YYLADT0.2~K7FMIW86BV5J.1 size=56023 2024-09-12T17:18:17.404 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.403+0000 7f574d1ea780 1 > prepared multipart upload key=RNI86YYLADT0 upload=K7FMIW86BV5J tag=KOAQJ3RXFPU1 type=write size=2153175 2024-09-12T17:18:17.405 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.404+0000 7f574d1ea780 1 < completed part key=_multipart_U6E9A5OH4GUW.2~51KAYV4ZRKAB.0 size=1048576 2024-09-12T17:18:17.406 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.405+0000 7f574d1ea780 1 < completed part key=_multipart_U6E9A5OH4GUW.2~51KAYV4ZRKAB.1 size=1048576 2024-09-12T17:18:17.407 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.406+0000 7f574d1ea780 1 < completed part key=_multipart_U6E9A5OH4GUW.2~51KAYV4ZRKAB.2 size=130030 2024-09-12T17:18:17.409 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.408+0000 7f574d1ea780 1 < completed multipart upload key=U6E9A5OH4GUW upload=51KAYV4ZRKAB tag=B7W0KK5WD71E type=write size=3275758 2024-09-12T17:18:17.411 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.410+0000 7f574d1ea780 1 > prepared part key=_multipart_VWWA5IB0L4N1.2~SEUWDAT0OE13.0 size=1048576 2024-09-12T17:18:17.412 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.411+0000 7f574d1ea780 1 > prepared part key=_multipart_VWWA5IB0L4N1.2~SEUWDAT0OE13.1 size=595068 2024-09-12T17:18:17.412 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.411+0000 7f574d1ea780 1 > prepared multipart upload key=VWWA5IB0L4N1 upload=SEUWDAT0OE13 tag=ZZYZWD92FFO4 type=write size=2692220 2024-09-12T17:18:17.413 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.412+0000 7f574d1ea780 1 < completed delete operation key=HGZMN894YYC0 tag=WH1HKTH9QG81 type=del 2024-09-12T17:18:17.414 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.413+0000 7f574d1ea780 1 > prepared operation key=ZGH8XC39FGTC tag=FVVP86DFKQ3P type=write size=285407 2024-09-12T17:18:17.415 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.415+0000 7f574d1ea780 1 < completed delete operation key=A1TIP3RXHBCZ tag=BXLATI59100P type=del 2024-09-12T17:18:17.417 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.416+0000 7f574d1ea780 1 > prepared operation key=UFKM4I8RMT0W tag=07S4KRYJT4EE type=write size=671137 2024-09-12T17:18:17.421 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.417+0000 7f574d1ea780 1 < canceled operation key=UFKM4I8RMT0W tag=FF20PJVG7OTP type=write size=649552 2024-09-12T17:18:17.421 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.419+0000 7f574d1ea780 1 > prepared part key=_multipart_43GV2N9VBBKE.2~Q3Q53PKDFBML.0 size=1048576 2024-09-12T17:18:17.421 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.420+0000 7f574d1ea780 1 > prepared part key=_multipart_43GV2N9VBBKE.2~Q3Q53PKDFBML.1 size=975782 2024-09-12T17:18:17.421 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.420+0000 7f574d1ea780 1 > prepared multipart upload key=43GV2N9VBBKE upload=Q3Q53PKDFBML tag=9YJCPYYL0AU8 type=write size=3072934 2024-09-12T17:18:17.422 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.421+0000 7f574d1ea780 1 < completed delete operation key=D1GEG3MKPOM3 tag=SZOAG13VK4TX type=del 2024-09-12T17:18:17.423 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.423+0000 7f574d1ea780 1 > prepared operation key=OI51GO639LFK tag=W1OWGG8LDDR7 type=del size=367867 2024-09-12T17:18:17.426 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.425+0000 7f574d1ea780 1 < suggested remove operation key=UFKM4I8RMT0W tag=RS3VZLAVTJ44 type=del 2024-09-12T17:18:17.428 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.427+0000 7f574d1ea780 1 > prepared part key=_multipart_C9IYR9CET1I8.2~405QMO9HJCKH.0 size=823062 2024-09-12T17:18:17.428 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.427+0000 7f574d1ea780 1 > prepared multipart upload key=C9IYR9CET1I8 upload=405QMO9HJCKH tag=OX77OGN20CFQ type=write size=1871638 2024-09-12T17:18:17.430 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.429+0000 7f574d1ea780 1 < suggested update operation key=7BX38Q7723EB tag=FHO1KNX1TPX8 type=del size=9080 2024-09-12T17:18:17.431 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.431+0000 7f574d1ea780 1 > prepared operation key=54LQ91UMBJAN tag=RYXJ2ZM60YKO type=del size=124247 2024-09-12T17:18:17.433 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.432+0000 7f574d1ea780 1 < completed write operation key=54CM8800AT9V tag=GVWKNB52OLMC type=write size=167659 2024-09-12T17:18:17.434 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.433+0000 7f574d1ea780 1 > prepared operation key=TIKBUXFPVTN1 tag=33EG78VCTYWW type=del size=1591434 2024-09-12T17:18:17.435 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.434+0000 7f574d1ea780 1 < completed part key=_multipart_RNI86YYLADT0.2~W10FPTUM3FOC.0 size=1048576 2024-09-12T17:18:17.436 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.435+0000 7f574d1ea780 1 < completed part key=_multipart_RNI86YYLADT0.2~W10FPTUM3FOC.1 size=25594 2024-09-12T17:18:17.438 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.437+0000 7f574d1ea780 1 < completed multipart upload key=RNI86YYLADT0 upload=W10FPTUM3FOC tag=D32T2O08HQY8 type=write size=2122746 2024-09-12T17:18:17.440 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.439+0000 7f574d1ea780 1 > prepared part key=_multipart_Q2Q3B1J3DAVD.2~EZYV3A8ZNH9U.0 size=66264 2024-09-12T17:18:17.440 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.439+0000 7f574d1ea780 1 > prepared multipart upload key=Q2Q3B1J3DAVD upload=EZYV3A8ZNH9U tag=B31MW2QFMKF1 type=write size=1114840 2024-09-12T17:18:17.441 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.440+0000 7f574d1ea780 1 < completed part key=_multipart_YXIDO0U18839.2~P1ZB4X2UV0JN.0 size=1048576 2024-09-12T17:18:17.442 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.441+0000 7f574d1ea780 1 < completed part key=_multipart_YXIDO0U18839.2~P1ZB4X2UV0JN.1 size=169946 2024-09-12T17:18:17.444 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.443+0000 7f574d1ea780 1 < completed multipart upload key=YXIDO0U18839 upload=P1ZB4X2UV0JN tag=NPRW3K2Y48L7 type=write size=2267098 2024-09-12T17:18:17.445 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.445+0000 7f574d1ea780 1 > prepared operation key=ZGE1860DMGHA tag=1LNNNDYKSRCU type=del size=2168801 2024-09-12T17:18:17.448 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.447+0000 7f574d1ea780 1 < completed write operation key=U6E9A5OH4GUW tag=QTSB9FPDR612 type=write size=504549 2024-09-12T17:18:17.449 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.448+0000 7f574d1ea780 1 > prepared operation key=Q2Q3B1J3DAVD tag=ETADW521U03J type=del size=3728496 2024-09-12T17:18:17.451 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.450+0000 7f574d1ea780 1 < suggested remove operation key=55JI541K1WP2 tag=1COSF29UMD7H type=del 2024-09-12T17:18:17.452 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.452+0000 7f574d1ea780 1 > prepared operation key=QXD8UG2K4STQ tag=W0QV43NAXF6J type=write size=283666 2024-09-12T17:18:17.454 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.453+0000 7f574d1ea780 1 < completed part key=_multipart_55JI541K1WP2.2~VE292XPGGQ7D.0 size=583002 2024-09-12T17:18:17.456 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.455+0000 7f574d1ea780 1 < completed multipart upload key=55JI541K1WP2 upload=VE292XPGGQ7D tag=JXO90QMVNKF3 type=write size=1631578 2024-09-12T17:18:17.457 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.456+0000 7f574d1ea780 1 > prepared operation key=Q2Q3B1J3DAVD tag=7C4UXUTUPP66 type=del size=1046579 2024-09-12T17:18:17.458 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.457+0000 7f574d1ea780 1 < completed write operation key=DH02JGZP64MN tag=31MWFEIKDS59 type=write size=421608 2024-09-12T17:18:17.459 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.458+0000 7f574d1ea780 1 > prepared operation key=54LQ91UMBJAN tag=C1W6KKT94S58 type=del size=3105140 2024-09-12T17:18:17.460 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.460+0000 7f574d1ea780 1 < completed delete operation key=HGZMN894YYC0 tag=P64WADIS0CLY type=del 2024-09-12T17:18:17.462 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.461+0000 7f574d1ea780 1 > prepared operation key=A1TIP3RXHBCZ tag=VINVY8RG1L21 type=del size=3863423 2024-09-12T17:18:17.463 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.462+0000 7f574d1ea780 1 < completed part key=_multipart_RNI86YYLADT0.2~K7FMIW86BV5J.0 size=1048576 2024-09-12T17:18:17.464 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.463+0000 7f574d1ea780 1 < completed part key=_multipart_RNI86YYLADT0.2~K7FMIW86BV5J.1 size=56023 2024-09-12T17:18:17.466 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.465+0000 7f574d1ea780 1 < completed multipart upload key=RNI86YYLADT0 upload=K7FMIW86BV5J tag=KOAQJ3RXFPU1 type=write size=2153175 2024-09-12T17:18:17.467 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.466+0000 7f574d1ea780 1 > prepared operation key=C9IYR9CET1I8 tag=V9I5B7QZ2EKE type=del size=3715276 2024-09-12T17:18:17.468 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.467+0000 7f574d1ea780 1 < completed part key=_multipart_VWWA5IB0L4N1.2~SEUWDAT0OE13.0 size=1048576 2024-09-12T17:18:17.468 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.467+0000 7f574d1ea780 1 < canceled part key=_multipart_VWWA5IB0L4N1.2~SEUWDAT0OE13.1 size=595068 2024-09-12T17:18:17.470 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.469+0000 7f574d1ea780 1 < canceled multipart upload key=VWWA5IB0L4N1 upload=SEUWDAT0OE13 tag=ZZYZWD92FFO4 type=write size=2692220 2024-09-12T17:18:17.472 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.471+0000 7f574d1ea780 1 > prepared part key=_multipart_55V137SY4E4P.2~LIONQT0HPCES.0 size=1048576 2024-09-12T17:18:17.473 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.472+0000 7f574d1ea780 1 > prepared part key=_multipart_55V137SY4E4P.2~LIONQT0HPCES.1 size=469520 2024-09-12T17:18:17.473 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.472+0000 7f574d1ea780 1 > prepared multipart upload key=55V137SY4E4P upload=LIONQT0HPCES tag=4RRSTFSDAQL7 type=write size=2566672 2024-09-12T17:18:17.476 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.475+0000 7f574d1ea780 1 < completed write operation key=ZGH8XC39FGTC tag=FVVP86DFKQ3P type=write size=285407 2024-09-12T17:18:17.477 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.476+0000 7f574d1ea780 1 > prepared operation key=HFWA7DNUMWF2 tag=G82L22UHMWBB type=del size=3688300 2024-09-12T17:18:17.478 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.478+0000 7f574d1ea780 -1 < failed to complete operation key=UFKM4I8RMT0W tag=07S4KRYJT4EE type=write size=671137: (22) Invalid argument 2024-09-12T17:18:17.480 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.479+0000 7f574d1ea780 1 > prepared operation key=OI51GO639LFK tag=YPJL1S0HA46T type=del size=1749418 2024-09-12T17:18:17.481 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.480+0000 7f574d1ea780 1 < completed part key=_multipart_43GV2N9VBBKE.2~Q3Q53PKDFBML.0 size=1048576 2024-09-12T17:18:17.482 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.481+0000 7f574d1ea780 1 < completed part key=_multipart_43GV2N9VBBKE.2~Q3Q53PKDFBML.1 size=975782 2024-09-12T17:18:17.484 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.483+0000 7f574d1ea780 1 < completed multipart upload key=43GV2N9VBBKE upload=Q3Q53PKDFBML tag=9YJCPYYL0AU8 type=write size=3072934 2024-09-12T17:18:17.485 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.484+0000 7f574d1ea780 1 > prepared operation key=OI51GO639LFK tag=YJ0SGCM14FL4 type=del size=302713 2024-09-12T17:18:17.487 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.486+0000 7f574d1ea780 1 < completed delete operation key=OI51GO639LFK tag=W1OWGG8LDDR7 type=del 2024-09-12T17:18:17.488 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.487+0000 7f574d1ea780 1 > prepared operation key=UTCKL1F42X8A tag=5LYMN5XVEFR1 type=del size=212399 2024-09-12T17:18:17.489 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.488+0000 7f574d1ea780 1 < completed part key=_multipart_C9IYR9CET1I8.2~405QMO9HJCKH.0 size=823062 2024-09-12T17:18:17.491 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.490+0000 7f574d1ea780 1 < completed multipart upload key=C9IYR9CET1I8 upload=405QMO9HJCKH tag=OX77OGN20CFQ type=write size=1871638 2024-09-12T17:18:17.492 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.491+0000 7f574d1ea780 1 > prepared operation key=SQQMJ61CA0QW tag=APBNGTTVT350 type=write size=356880 2024-09-12T17:18:17.494 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.494+0000 7f574d1ea780 1 < suggested remove operation key=54LQ91UMBJAN tag=RYXJ2ZM60YKO type=del 2024-09-12T17:18:17.497 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.496+0000 7f574d1ea780 1 > prepared part key=_multipart_DH02JGZP64MN.2~RFKDCBOA8YHI.0 size=1043567 2024-09-12T17:18:17.497 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.496+0000 7f574d1ea780 1 > prepared multipart upload key=DH02JGZP64MN upload=RFKDCBOA8YHI tag=K0WR2PWQ381Z type=write size=2092143 2024-09-12T17:18:17.498 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.497+0000 7f574d1ea780 1 < canceled operation key=TIKBUXFPVTN1 tag=33EG78VCTYWW type=del size=1591434 2024-09-12T17:18:17.499 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.498+0000 7f574d1ea780 1 > prepared operation key=GEGOEB05R0PK tag=1WH5OZ6NYBSM type=write size=510664 2024-09-12T17:18:17.500 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.500+0000 7f574d1ea780 1 < completed part key=_multipart_Q2Q3B1J3DAVD.2~EZYV3A8ZNH9U.0 size=66264 2024-09-12T17:18:17.502 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.501+0000 7f574d1ea780 1 < completed multipart upload key=Q2Q3B1J3DAVD upload=EZYV3A8ZNH9U tag=B31MW2QFMKF1 type=write size=1114840 2024-09-12T17:18:17.504 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.504+0000 7f574d1ea780 1 > prepared part key=_multipart_VWWA5IB0L4N1.2~MMU6L5ZGRL8I.0 size=42473 2024-09-12T17:18:17.505 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.504+0000 7f574d1ea780 1 > prepared multipart upload key=VWWA5IB0L4N1 upload=MMU6L5ZGRL8I tag=HSXKGCNZCCHR type=write size=1091049 2024-09-12T17:18:17.506 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.505+0000 7f574d1ea780 1 < completed delete operation key=ZGE1860DMGHA tag=1LNNNDYKSRCU type=del 2024-09-12T17:18:17.507 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.506+0000 7f574d1ea780 1 > prepared operation key=ZGH8XC39FGTC tag=2WWCQMUO3ZFU type=write size=536061 2024-09-12T17:18:17.508 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.507+0000 7f574d1ea780 1 < completed delete operation key=Q2Q3B1J3DAVD tag=ETADW521U03J type=del 2024-09-12T17:18:17.510 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.509+0000 7f574d1ea780 1 > prepared part key=_multipart_ENFNIFHQ3SHW.2~1XRP1W2NO4BS.0 size=1048576 2024-09-12T17:18:17.511 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.510+0000 7f574d1ea780 1 > prepared part key=_multipart_ENFNIFHQ3SHW.2~1XRP1W2NO4BS.1 size=1048576 2024-09-12T17:18:17.512 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.511+0000 7f574d1ea780 1 > prepared part key=_multipart_ENFNIFHQ3SHW.2~1XRP1W2NO4BS.2 size=470103 2024-09-12T17:18:17.512 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.511+0000 7f574d1ea780 1 > prepared multipart upload key=ENFNIFHQ3SHW upload=1XRP1W2NO4BS tag=24VX3KO5UZ0A type=write size=3615831 2024-09-12T17:18:17.513 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.513+0000 7f574d1ea780 1 < completed write operation key=QXD8UG2K4STQ tag=W0QV43NAXF6J type=write size=283666 2024-09-12T17:18:17.515 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.514+0000 7f574d1ea780 1 > prepared operation key=UTCKL1F42X8A tag=VB1FT53FZ9UD type=del size=3676704 2024-09-12T17:18:17.517 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.516+0000 7f574d1ea780 1 < suggested update operation key=Q2Q3B1J3DAVD tag=7C4UXUTUPP66 type=del size=1046579 2024-09-12T17:18:17.519 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.519+0000 7f574d1ea780 1 > prepared part key=_multipart_K12MVG618809.2~I09YWOHXH73E.0 size=1048576 2024-09-12T17:18:17.520 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.519+0000 7f574d1ea780 1 > prepared part key=_multipart_K12MVG618809.2~I09YWOHXH73E.1 size=1048576 2024-09-12T17:18:17.521 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.520+0000 7f574d1ea780 1 > prepared part key=_multipart_K12MVG618809.2~I09YWOHXH73E.2 size=803735 2024-09-12T17:18:17.521 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.520+0000 7f574d1ea780 1 > prepared multipart upload key=K12MVG618809 upload=I09YWOHXH73E tag=SSIQHZVG5HFK type=write size=3949463 2024-09-12T17:18:17.522 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.522+0000 7f574d1ea780 -1 < failed to complete operation key=54LQ91UMBJAN tag=C1W6KKT94S58 type=del size=3105140: (22) Invalid argument 2024-09-12T17:18:17.525 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.524+0000 7f574d1ea780 1 > prepared part key=_multipart_55JI541K1WP2.2~WDVPP5M0D09Z.0 size=858209 2024-09-12T17:18:17.525 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.524+0000 7f574d1ea780 1 > prepared multipart upload key=55JI541K1WP2 upload=WDVPP5M0D09Z tag=VGPZTQPZ018Y type=write size=1906785 2024-09-12T17:18:17.526 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.525+0000 7f574d1ea780 1 < completed delete operation key=A1TIP3RXHBCZ tag=VINVY8RG1L21 type=del 2024-09-12T17:18:17.527 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.526+0000 7f574d1ea780 1 > prepared operation key=55JI541K1WP2 tag=5U340ZVSD13G type=del size=3923431 2024-09-12T17:18:17.529 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.528+0000 7f574d1ea780 1 < completed delete operation key=C9IYR9CET1I8 tag=V9I5B7QZ2EKE type=del 2024-09-12T17:18:17.530 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.529+0000 7f574d1ea780 1 > prepared operation key=ZGE1860DMGHA tag=C72TRZ2M01DP type=del size=1260914 2024-09-12T17:18:17.531 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.530+0000 7f574d1ea780 1 < completed part key=_multipart_55V137SY4E4P.2~LIONQT0HPCES.0 size=1048576 2024-09-12T17:18:17.532 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.531+0000 7f574d1ea780 1 < completed part key=_multipart_55V137SY4E4P.2~LIONQT0HPCES.1 size=469520 2024-09-12T17:18:17.534 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.534+0000 7f574d1ea780 1 < completed multipart upload key=55V137SY4E4P upload=LIONQT0HPCES tag=4RRSTFSDAQL7 type=write size=2566672 2024-09-12T17:18:17.536 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.535+0000 7f574d1ea780 1 > prepared operation key=VWWA5IB0L4N1 tag=6E2IWS4SNVTJ type=del size=605607 2024-09-12T17:18:17.537 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.536+0000 7f574d1ea780 1 < completed delete operation key=HFWA7DNUMWF2 tag=G82L22UHMWBB type=del 2024-09-12T17:18:17.538 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.537+0000 7f574d1ea780 1 > prepared operation key=ENFNIFHQ3SHW tag=I0YUWWOFL73M type=del size=1868038 2024-09-12T17:18:17.539 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.539+0000 7f574d1ea780 1 < completed delete operation key=OI51GO639LFK tag=YPJL1S0HA46T type=del 2024-09-12T17:18:17.542 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.541+0000 7f574d1ea780 1 > prepared part key=_multipart_55V137SY4E4P.2~K8R9H5JBA916.0 size=1048576 2024-09-12T17:18:17.543 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.542+0000 7f574d1ea780 1 > prepared part key=_multipart_55V137SY4E4P.2~K8R9H5JBA916.1 size=586163 2024-09-12T17:18:17.543 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.542+0000 7f574d1ea780 1 > prepared multipart upload key=55V137SY4E4P upload=K8R9H5JBA916 tag=Z1N3BRMKJYKR type=write size=2683315 2024-09-12T17:18:17.544 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.543+0000 7f574d1ea780 1 < completed delete operation key=OI51GO639LFK tag=YJ0SGCM14FL4 type=del 2024-09-12T17:18:17.548 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.547+0000 7f574d1ea780 1 > prepared part key=_multipart_Q2Q3B1J3DAVD.2~80U3U3K00FOE.0 size=1048576 2024-09-12T17:18:17.549 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.548+0000 7f574d1ea780 1 > prepared part key=_multipart_Q2Q3B1J3DAVD.2~80U3U3K00FOE.1 size=1048576 2024-09-12T17:18:17.550 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.549+0000 7f574d1ea780 1 > prepared part key=_multipart_Q2Q3B1J3DAVD.2~80U3U3K00FOE.2 size=34075 2024-09-12T17:18:17.550 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.549+0000 7f574d1ea780 1 > prepared multipart upload key=Q2Q3B1J3DAVD upload=80U3U3K00FOE tag=UR612I1ZN83L type=write size=3179803 2024-09-12T17:18:17.551 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.551+0000 7f574d1ea780 1 < completed delete operation key=UTCKL1F42X8A tag=5LYMN5XVEFR1 type=del 2024-09-12T17:18:17.553 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.552+0000 7f574d1ea780 1 > prepared operation key=HGZMN894YYC0 tag=IMJ0D0QH4LTB type=del size=2760579 2024-09-12T17:18:17.554 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.553+0000 7f574d1ea780 1 < completed write operation key=SQQMJ61CA0QW tag=APBNGTTVT350 type=write size=356880 2024-09-12T17:18:17.556 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.555+0000 7f574d1ea780 1 > prepared part key=_multipart_HGZMN894YYC0.2~4Y498SGEP0YK.0 size=1048576 2024-09-12T17:18:17.557 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.556+0000 7f574d1ea780 1 > prepared part key=_multipart_HGZMN894YYC0.2~4Y498SGEP0YK.1 size=88206 2024-09-12T17:18:17.557 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.556+0000 7f574d1ea780 1 > prepared multipart upload key=HGZMN894YYC0 upload=4Y498SGEP0YK tag=UE274INLHV3C type=write size=2185358 2024-09-12T17:18:17.558 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.558+0000 7f574d1ea780 1 < completed part key=_multipart_DH02JGZP64MN.2~RFKDCBOA8YHI.0 size=1043567 2024-09-12T17:18:17.560 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.559+0000 7f574d1ea780 1 < completed multipart upload key=DH02JGZP64MN upload=RFKDCBOA8YHI tag=K0WR2PWQ381Z type=write size=2092143 2024-09-12T17:18:17.562 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.561+0000 7f574d1ea780 1 > prepared operation key=54CM8800AT9V tag=5VT7NSS2PI8N type=del size=209424 2024-09-12T17:18:17.563 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.562+0000 7f574d1ea780 1 < completed write operation key=GEGOEB05R0PK tag=1WH5OZ6NYBSM type=write size=510664 2024-09-12T17:18:17.566 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.565+0000 7f574d1ea780 1 > prepared part key=_multipart_DH02JGZP64MN.2~OHGNT3N334E3.0 size=1048576 2024-09-12T17:18:17.567 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.566+0000 7f574d1ea780 1 > prepared part key=_multipart_DH02JGZP64MN.2~OHGNT3N334E3.1 size=1048576 2024-09-12T17:18:17.568 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.567+0000 7f574d1ea780 1 > prepared part key=_multipart_DH02JGZP64MN.2~OHGNT3N334E3.2 size=664853 2024-09-12T17:18:17.568 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.567+0000 7f574d1ea780 1 > prepared multipart upload key=DH02JGZP64MN upload=OHGNT3N334E3 tag=HVZ5C37CVTMH type=write size=3810581 2024-09-12T17:18:17.569 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.568+0000 7f574d1ea780 1 < completed part key=_multipart_VWWA5IB0L4N1.2~MMU6L5ZGRL8I.0 size=42473 2024-09-12T17:18:17.571 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.570+0000 7f574d1ea780 1 < completed multipart upload key=VWWA5IB0L4N1 upload=MMU6L5ZGRL8I tag=HSXKGCNZCCHR type=write size=1091049 2024-09-12T17:18:17.572 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.571+0000 7f574d1ea780 1 > prepared operation key=54LQ91UMBJAN tag=BHEJFWKITKWE type=del size=3015067 2024-09-12T17:18:17.573 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.573+0000 7f574d1ea780 1 < canceled operation key=ZGH8XC39FGTC tag=2WWCQMUO3ZFU type=write size=536061 2024-09-12T17:18:17.574 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.574+0000 7f574d1ea780 1 > prepared operation key=HGZMN894YYC0 tag=NH0WLIK4FDRO type=del size=2317988 2024-09-12T17:18:17.576 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.575+0000 7f574d1ea780 1 < completed part key=_multipart_ENFNIFHQ3SHW.2~1XRP1W2NO4BS.0 size=1048576 2024-09-12T17:18:17.577 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.576+0000 7f574d1ea780 1 < completed part key=_multipart_ENFNIFHQ3SHW.2~1XRP1W2NO4BS.1 size=1048576 2024-09-12T17:18:17.578 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.577+0000 7f574d1ea780 1 < completed part key=_multipart_ENFNIFHQ3SHW.2~1XRP1W2NO4BS.2 size=470103 2024-09-12T17:18:17.580 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.579+0000 7f574d1ea780 1 < completed multipart upload key=ENFNIFHQ3SHW upload=1XRP1W2NO4BS tag=24VX3KO5UZ0A type=write size=3615831 2024-09-12T17:18:17.582 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.581+0000 7f574d1ea780 1 > prepared part key=_multipart_SQQMJ61CA0QW.2~3X4IL107R6VI.0 size=501672 2024-09-12T17:18:17.582 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.581+0000 7f574d1ea780 1 > prepared multipart upload key=SQQMJ61CA0QW upload=3X4IL107R6VI tag=J2QLTEL97TII type=write size=1550248 2024-09-12T17:18:17.583 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.583+0000 7f574d1ea780 1 < completed delete operation key=UTCKL1F42X8A tag=VB1FT53FZ9UD type=del 2024-09-12T17:18:17.585 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.584+0000 7f574d1ea780 1 > prepared operation key=RWVWJHVZE95H tag=Y5FQVUGCOMOA type=del size=3813887 2024-09-12T17:18:17.586 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.585+0000 7f574d1ea780 1 < completed part key=_multipart_K12MVG618809.2~I09YWOHXH73E.0 size=1048576 2024-09-12T17:18:17.587 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.586+0000 7f574d1ea780 1 < completed part key=_multipart_K12MVG618809.2~I09YWOHXH73E.1 size=1048576 2024-09-12T17:18:17.588 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.587+0000 7f574d1ea780 1 < completed part key=_multipart_K12MVG618809.2~I09YWOHXH73E.2 size=803735 2024-09-12T17:18:17.590 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.589+0000 7f574d1ea780 1 < completed multipart upload key=K12MVG618809 upload=I09YWOHXH73E tag=SSIQHZVG5HFK type=write size=3949463 2024-09-12T17:18:17.591 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.590+0000 7f574d1ea780 1 > prepared operation key=ZGE1860DMGHA tag=62ITY8BHASRU type=write size=685562 2024-09-12T17:18:17.593 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.592+0000 7f574d1ea780 1 < completed part key=_multipart_55JI541K1WP2.2~WDVPP5M0D09Z.0 size=858209 2024-09-12T17:18:17.595 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.594+0000 7f574d1ea780 1 < completed multipart upload key=55JI541K1WP2 upload=WDVPP5M0D09Z tag=VGPZTQPZ018Y type=write size=1906785 2024-09-12T17:18:17.597 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.596+0000 7f574d1ea780 1 > prepared part key=_multipart_55V137SY4E4P.2~OB5RVX0BEET8.0 size=739105 2024-09-12T17:18:17.597 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.596+0000 7f574d1ea780 1 > prepared multipart upload key=55V137SY4E4P upload=OB5RVX0BEET8 tag=VKYV45RDWMD8 type=write size=1787681 2024-09-12T17:18:17.598 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.597+0000 7f574d1ea780 1 < completed delete operation key=55JI541K1WP2 tag=5U340ZVSD13G type=del 2024-09-12T17:18:17.600 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.599+0000 7f574d1ea780 1 > prepared part key=_multipart_GEGOEB05R0PK.2~LAB4U8P6YA6Q.0 size=664870 2024-09-12T17:18:17.601 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.599+0000 7f574d1ea780 1 > prepared multipart upload key=GEGOEB05R0PK upload=LAB4U8P6YA6Q tag=47YRFVFDD6T6 type=write size=1713446 2024-09-12T17:18:17.601 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.601+0000 7f574d1ea780 1 < completed delete operation key=ZGE1860DMGHA tag=C72TRZ2M01DP type=del 2024-09-12T17:18:17.604 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.603+0000 7f574d1ea780 1 > prepared part key=_multipart_8SG7DJO4HWPI.2~6JQS4I1YC7U2.0 size=1048576 2024-09-12T17:18:17.605 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.604+0000 7f574d1ea780 1 > prepared part key=_multipart_8SG7DJO4HWPI.2~6JQS4I1YC7U2.1 size=1048576 2024-09-12T17:18:17.605 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.605+0000 7f574d1ea780 1 > prepared part key=_multipart_8SG7DJO4HWPI.2~6JQS4I1YC7U2.2 size=503859 2024-09-12T17:18:17.605 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.605+0000 7f574d1ea780 1 > prepared multipart upload key=8SG7DJO4HWPI upload=6JQS4I1YC7U2 tag=EW4PF8I77YXE type=write size=3649587 2024-09-12T17:18:17.607 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.606+0000 7f574d1ea780 1 < completed delete operation key=VWWA5IB0L4N1 tag=6E2IWS4SNVTJ type=del 2024-09-12T17:18:17.608 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.607+0000 7f574d1ea780 1 > prepared operation key=8SG7DJO4HWPI tag=B3ISBGI3DP5U type=del size=2001054 2024-09-12T17:18:17.609 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.609+0000 7f574d1ea780 1 < completed delete operation key=ENFNIFHQ3SHW tag=I0YUWWOFL73M type=del 2024-09-12T17:18:17.612 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.611+0000 7f574d1ea780 1 > prepared part key=_multipart_54LQ91UMBJAN.2~HONSQNXZBSMC.0 size=1048576 2024-09-12T17:18:17.613 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.612+0000 7f574d1ea780 1 > prepared part key=_multipart_54LQ91UMBJAN.2~HONSQNXZBSMC.1 size=1048576 2024-09-12T17:18:17.614 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.613+0000 7f574d1ea780 1 > prepared part key=_multipart_54LQ91UMBJAN.2~HONSQNXZBSMC.2 size=474519 2024-09-12T17:18:17.614 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.613+0000 7f574d1ea780 1 > prepared multipart upload key=54LQ91UMBJAN upload=HONSQNXZBSMC tag=ZLB0L8SNICTT type=write size=3620247 2024-09-12T17:18:17.615 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.615+0000 7f574d1ea780 1 < completed part key=_multipart_55V137SY4E4P.2~K8R9H5JBA916.0 size=1048576 2024-09-12T17:18:17.616 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.615+0000 7f574d1ea780 1 < canceled part key=_multipart_55V137SY4E4P.2~K8R9H5JBA916.1 size=586163 2024-09-12T17:18:17.618 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.617+0000 7f574d1ea780 1 < canceled multipart upload key=55V137SY4E4P upload=K8R9H5JBA916 tag=Z1N3BRMKJYKR type=write size=2683315 2024-09-12T17:18:17.620 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.619+0000 7f574d1ea780 1 > prepared part key=_multipart_ZGE1860DMGHA.2~S4RDPDXCDOVC.0 size=1048576 2024-09-12T17:18:17.621 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.620+0000 7f574d1ea780 1 > prepared part key=_multipart_ZGE1860DMGHA.2~S4RDPDXCDOVC.1 size=1048576 2024-09-12T17:18:17.622 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.621+0000 7f574d1ea780 1 > prepared part key=_multipart_ZGE1860DMGHA.2~S4RDPDXCDOVC.2 size=220790 2024-09-12T17:18:17.622 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.621+0000 7f574d1ea780 1 > prepared multipart upload key=ZGE1860DMGHA upload=S4RDPDXCDOVC tag=3MX0CLX5YL6D type=write size=3366518 2024-09-12T17:18:17.624 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.623+0000 7f574d1ea780 1 < completed part key=_multipart_Q2Q3B1J3DAVD.2~80U3U3K00FOE.0 size=1048576 2024-09-12T17:18:17.625 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.624+0000 7f574d1ea780 1 < completed part key=_multipart_Q2Q3B1J3DAVD.2~80U3U3K00FOE.1 size=1048576 2024-09-12T17:18:17.629 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.625+0000 7f574d1ea780 1 < completed part key=_multipart_Q2Q3B1J3DAVD.2~80U3U3K00FOE.2 size=34075 2024-09-12T17:18:17.629 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.627+0000 7f574d1ea780 1 < completed multipart upload key=Q2Q3B1J3DAVD upload=80U3U3K00FOE tag=UR612I1ZN83L type=write size=3179803 2024-09-12T17:18:17.630 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.630+0000 7f574d1ea780 1 > prepared part key=_multipart_7BX38Q7723EB.2~CGQ8U0V78HX6.0 size=1048576 2024-09-12T17:18:17.631 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.631+0000 7f574d1ea780 1 > prepared part key=_multipart_7BX38Q7723EB.2~CGQ8U0V78HX6.1 size=1048576 2024-09-12T17:18:17.633 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.632+0000 7f574d1ea780 1 > prepared part key=_multipart_7BX38Q7723EB.2~CGQ8U0V78HX6.2 size=853970 2024-09-12T17:18:17.633 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.632+0000 7f574d1ea780 1 > prepared multipart upload key=7BX38Q7723EB upload=CGQ8U0V78HX6 tag=1VMXMNFAM3XE type=write size=3999698 2024-09-12T17:18:17.634 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.633+0000 7f574d1ea780 1 < completed delete operation key=HGZMN894YYC0 tag=IMJ0D0QH4LTB type=del 2024-09-12T17:18:17.636 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.636+0000 7f574d1ea780 1 > prepared part key=_multipart_RWVWJHVZE95H.2~2HMCXUW84J82.0 size=1048576 2024-09-12T17:18:17.637 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.637+0000 7f574d1ea780 1 > prepared part key=_multipart_RWVWJHVZE95H.2~2HMCXUW84J82.1 size=1048576 2024-09-12T17:18:17.638 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.637+0000 7f574d1ea780 1 > prepared part key=_multipart_RWVWJHVZE95H.2~2HMCXUW84J82.2 size=123452 2024-09-12T17:18:17.638 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.637+0000 7f574d1ea780 1 > prepared multipart upload key=RWVWJHVZE95H upload=2HMCXUW84J82 tag=GZY7044VV3C4 type=write size=3269180 2024-09-12T17:18:17.640 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.639+0000 7f574d1ea780 1 < completed part key=_multipart_HGZMN894YYC0.2~4Y498SGEP0YK.0 size=1048576 2024-09-12T17:18:17.640 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.640+0000 7f574d1ea780 1 < completed part key=_multipart_HGZMN894YYC0.2~4Y498SGEP0YK.1 size=88206 2024-09-12T17:18:17.642 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.642+0000 7f574d1ea780 1 < completed multipart upload key=HGZMN894YYC0 upload=4Y498SGEP0YK tag=UE274INLHV3C type=write size=2185358 2024-09-12T17:18:17.645 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.644+0000 7f574d1ea780 1 > prepared part key=_multipart_K12MVG618809.2~EL7ROJORRKBC.0 size=1048576 2024-09-12T17:18:17.646 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.645+0000 7f574d1ea780 1 > prepared part key=_multipart_K12MVG618809.2~EL7ROJORRKBC.1 size=1048576 2024-09-12T17:18:17.647 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.646+0000 7f574d1ea780 1 > prepared part key=_multipart_K12MVG618809.2~EL7ROJORRKBC.2 size=83870 2024-09-12T17:18:17.647 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.646+0000 7f574d1ea780 1 > prepared multipart upload key=K12MVG618809 upload=EL7ROJORRKBC tag=J3XMRS0P3ANW type=write size=3229598 2024-09-12T17:18:17.648 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.647+0000 7f574d1ea780 1 < canceled operation key=54CM8800AT9V tag=5VT7NSS2PI8N type=del size=209424 2024-09-12T17:18:17.649 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.649+0000 7f574d1ea780 1 > prepared operation key=TIKBUXFPVTN1 tag=FM1TN0P3SNPZ type=write size=1048143 2024-09-12T17:18:17.651 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.650+0000 7f574d1ea780 1 < completed part key=_multipart_DH02JGZP64MN.2~OHGNT3N334E3.0 size=1048576 2024-09-12T17:18:17.652 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.651+0000 7f574d1ea780 1 < completed part key=_multipart_DH02JGZP64MN.2~OHGNT3N334E3.1 size=1048576 2024-09-12T17:18:17.653 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.652+0000 7f574d1ea780 1 < completed part key=_multipart_DH02JGZP64MN.2~OHGNT3N334E3.2 size=664853 2024-09-12T17:18:17.655 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.654+0000 7f574d1ea780 1 < completed multipart upload key=DH02JGZP64MN upload=OHGNT3N334E3 tag=HVZ5C37CVTMH type=write size=3810581 2024-09-12T17:18:17.656 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.655+0000 7f574d1ea780 1 > prepared operation key=HFWA7DNUMWF2 tag=O595BV22LCQW type=del size=3569826 2024-09-12T17:18:17.657 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.656+0000 7f574d1ea780 1 < completed delete operation key=54LQ91UMBJAN tag=BHEJFWKITKWE type=del 2024-09-12T17:18:17.658 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.658+0000 7f574d1ea780 1 > prepared operation key=RWVWJHVZE95H tag=6895OPR721J3 type=del size=255591 2024-09-12T17:18:17.661 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.660+0000 7f574d1ea780 1 < suggested update operation key=HGZMN894YYC0 tag=NH0WLIK4FDRO type=del size=2317988 2024-09-12T17:18:17.662 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.661+0000 7f574d1ea780 1 > prepared operation key=U6E9A5OH4GUW tag=7TMO97YOTZ4G type=del size=3654058 2024-09-12T17:18:17.663 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.662+0000 7f574d1ea780 1 < completed part key=_multipart_SQQMJ61CA0QW.2~3X4IL107R6VI.0 size=501672 2024-09-12T17:18:17.665 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.664+0000 7f574d1ea780 1 < completed multipart upload key=SQQMJ61CA0QW upload=3X4IL107R6VI tag=J2QLTEL97TII type=write size=1550248 2024-09-12T17:18:17.666 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.665+0000 7f574d1ea780 1 > prepared operation key=UFKM4I8RMT0W tag=DAN9AWEBMPCH type=del size=1819813 2024-09-12T17:18:17.668 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.667+0000 7f574d1ea780 1 < completed delete operation key=RWVWJHVZE95H tag=Y5FQVUGCOMOA type=del 2024-09-12T17:18:17.670 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.669+0000 7f574d1ea780 1 > prepared part key=_multipart_C9IYR9CET1I8.2~F775X4TUDWLZ.0 size=502507 2024-09-12T17:18:17.670 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.669+0000 7f574d1ea780 1 > prepared multipart upload key=C9IYR9CET1I8 upload=F775X4TUDWLZ tag=INJR0KNZGPOP type=write size=1551083 2024-09-12T17:18:17.672 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.671+0000 7f574d1ea780 1 < suggested remove operation key=ZGE1860DMGHA tag=62ITY8BHASRU type=write 2024-09-12T17:18:17.673 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.672+0000 7f574d1ea780 1 > prepared operation key=55JI541K1WP2 tag=IZ09JBQS7Y2F type=del size=3799401 2024-09-12T17:18:17.674 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.673+0000 7f574d1ea780 1 < completed part key=_multipart_55V137SY4E4P.2~OB5RVX0BEET8.0 size=739105 2024-09-12T17:18:17.677 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.676+0000 7f574d1ea780 1 < completed multipart upload key=55V137SY4E4P upload=OB5RVX0BEET8 tag=VKYV45RDWMD8 type=write size=1787681 2024-09-12T17:18:17.680 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.679+0000 7f574d1ea780 1 > prepared part key=_multipart_8SG7DJO4HWPI.2~WG4TBFFEP9N6.0 size=1048576 2024-09-12T17:18:17.681 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.680+0000 7f574d1ea780 1 > prepared part key=_multipart_8SG7DJO4HWPI.2~WG4TBFFEP9N6.1 size=1048576 2024-09-12T17:18:17.682 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.681+0000 7f574d1ea780 1 > prepared part key=_multipart_8SG7DJO4HWPI.2~WG4TBFFEP9N6.2 size=241837 2024-09-12T17:18:17.682 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.681+0000 7f574d1ea780 1 > prepared multipart upload key=8SG7DJO4HWPI upload=WG4TBFFEP9N6 tag=P8KTEKMYCZ7M type=write size=3387565 2024-09-12T17:18:17.683 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.683+0000 7f574d1ea780 1 < completed part key=_multipart_GEGOEB05R0PK.2~LAB4U8P6YA6Q.0 size=664870 2024-09-12T17:18:17.685 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.684+0000 7f574d1ea780 1 < completed multipart upload key=GEGOEB05R0PK upload=LAB4U8P6YA6Q tag=47YRFVFDD6T6 type=write size=1713446 2024-09-12T17:18:17.687 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.686+0000 7f574d1ea780 1 > prepared operation key=ZGH8XC39FGTC tag=NP24KEB2N8H0 type=del size=1010335 2024-09-12T17:18:17.688 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.687+0000 7f574d1ea780 1 < completed part key=_multipart_8SG7DJO4HWPI.2~6JQS4I1YC7U2.0 size=1048576 2024-09-12T17:18:17.689 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.688+0000 7f574d1ea780 1 < completed part key=_multipart_8SG7DJO4HWPI.2~6JQS4I1YC7U2.1 size=1048576 2024-09-12T17:18:17.689 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.688+0000 7f574d1ea780 1 < canceled part key=_multipart_8SG7DJO4HWPI.2~6JQS4I1YC7U2.2 size=503859 2024-09-12T17:18:17.691 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.690+0000 7f574d1ea780 1 < canceled multipart upload key=8SG7DJO4HWPI upload=6JQS4I1YC7U2 tag=EW4PF8I77YXE type=write size=3649587 2024-09-12T17:18:17.693 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.692+0000 7f574d1ea780 1 > prepared part key=_multipart_54CM8800AT9V.2~0KLI5313GE4D.0 size=1048576 2024-09-12T17:18:17.694 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.693+0000 7f574d1ea780 1 > prepared part key=_multipart_54CM8800AT9V.2~0KLI5313GE4D.1 size=1048576 2024-09-12T17:18:17.695 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.694+0000 7f574d1ea780 1 > prepared part key=_multipart_54CM8800AT9V.2~0KLI5313GE4D.2 size=544589 2024-09-12T17:18:17.695 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.694+0000 7f574d1ea780 1 > prepared multipart upload key=54CM8800AT9V upload=0KLI5313GE4D tag=JEM4Y1EAP0V9 type=write size=3690317 2024-09-12T17:18:17.696 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.695+0000 7f574d1ea780 1 < completed delete operation key=8SG7DJO4HWPI tag=B3ISBGI3DP5U type=del 2024-09-12T17:18:17.697 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.696+0000 7f574d1ea780 1 > prepared operation key=R00F69ON5P6Z tag=GCGU1EKFXA7Q type=write size=674397 2024-09-12T17:18:17.697 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.696+0000 7f574d1ea780 1 < canceled part key=_multipart_54LQ91UMBJAN.2~HONSQNXZBSMC.0 size=1048576 2024-09-12T17:18:17.698 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.697+0000 7f574d1ea780 1 < completed part key=_multipart_54LQ91UMBJAN.2~HONSQNXZBSMC.1 size=1048576 2024-09-12T17:18:17.698 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.697+0000 7f574d1ea780 1 < canceled part key=_multipart_54LQ91UMBJAN.2~HONSQNXZBSMC.2 size=474519 2024-09-12T17:18:17.700 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.699+0000 7f574d1ea780 1 < canceled multipart upload key=54LQ91UMBJAN upload=HONSQNXZBSMC tag=ZLB0L8SNICTT type=write size=3620247 2024-09-12T17:18:17.701 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.701+0000 7f574d1ea780 1 > prepared operation key=TIKBUXFPVTN1 tag=JKVU1PWHM310 type=del size=2625840 2024-09-12T17:18:17.703 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.702+0000 7f574d1ea780 1 < completed part key=_multipart_ZGE1860DMGHA.2~S4RDPDXCDOVC.0 size=1048576 2024-09-12T17:18:17.704 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.703+0000 7f574d1ea780 1 < completed part key=_multipart_ZGE1860DMGHA.2~S4RDPDXCDOVC.1 size=1048576 2024-09-12T17:18:17.705 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.704+0000 7f574d1ea780 1 < completed part key=_multipart_ZGE1860DMGHA.2~S4RDPDXCDOVC.2 size=220790 2024-09-12T17:18:17.707 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.706+0000 7f574d1ea780 1 < completed multipart upload key=ZGE1860DMGHA upload=S4RDPDXCDOVC tag=3MX0CLX5YL6D type=write size=3366518 2024-09-12T17:18:17.708 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.707+0000 7f574d1ea780 1 > prepared operation key=Q2Q3B1J3DAVD tag=RH6YQJAFWTPB type=del size=1592416 2024-09-12T17:18:17.709 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.709+0000 7f574d1ea780 1 < completed part key=_multipart_7BX38Q7723EB.2~CGQ8U0V78HX6.0 size=1048576 2024-09-12T17:18:17.710 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.709+0000 7f574d1ea780 1 < canceled part key=_multipart_7BX38Q7723EB.2~CGQ8U0V78HX6.1 size=1048576 2024-09-12T17:18:17.710 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.709+0000 7f574d1ea780 1 < canceled part key=_multipart_7BX38Q7723EB.2~CGQ8U0V78HX6.2 size=853970 2024-09-12T17:18:17.712 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.711+0000 7f574d1ea780 1 < canceled multipart upload key=7BX38Q7723EB upload=CGQ8U0V78HX6 tag=1VMXMNFAM3XE type=write size=3999698 2024-09-12T17:18:17.713 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.712+0000 7f574d1ea780 1 > prepared operation key=C9IYR9CET1I8 tag=6HHN79ID3ZIF type=write size=274911 2024-09-12T17:18:17.714 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.713+0000 7f574d1ea780 1 < completed part key=_multipart_RWVWJHVZE95H.2~2HMCXUW84J82.0 size=1048576 2024-09-12T17:18:17.715 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.714+0000 7f574d1ea780 1 < completed part key=_multipart_RWVWJHVZE95H.2~2HMCXUW84J82.1 size=1048576 2024-09-12T17:18:17.716 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.715+0000 7f574d1ea780 1 < completed part key=_multipart_RWVWJHVZE95H.2~2HMCXUW84J82.2 size=123452 2024-09-12T17:18:17.718 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.717+0000 7f574d1ea780 1 < completed multipart upload key=RWVWJHVZE95H upload=2HMCXUW84J82 tag=GZY7044VV3C4 type=write size=3269180 2024-09-12T17:18:17.721 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.720+0000 7f574d1ea780 1 > prepared part key=_multipart_OI51GO639LFK.2~FV8D437MGSA3.0 size=1048576 2024-09-12T17:18:17.721 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.721+0000 7f574d1ea780 1 > prepared part key=_multipart_OI51GO639LFK.2~FV8D437MGSA3.1 size=381219 2024-09-12T17:18:17.722 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.721+0000 7f574d1ea780 1 > prepared multipart upload key=OI51GO639LFK upload=FV8D437MGSA3 tag=UGUIIKN5IFIX type=write size=2478371 2024-09-12T17:18:17.723 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.722+0000 7f574d1ea780 1 < completed part key=_multipart_K12MVG618809.2~EL7ROJORRKBC.0 size=1048576 2024-09-12T17:18:17.724 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.723+0000 7f574d1ea780 1 < completed part key=_multipart_K12MVG618809.2~EL7ROJORRKBC.1 size=1048576 2024-09-12T17:18:17.725 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.724+0000 7f574d1ea780 1 < completed part key=_multipart_K12MVG618809.2~EL7ROJORRKBC.2 size=83870 2024-09-12T17:18:17.728 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.726+0000 7f574d1ea780 1 < completed multipart upload key=K12MVG618809 upload=EL7ROJORRKBC tag=J3XMRS0P3ANW type=write size=3229598 2024-09-12T17:18:17.729 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.727+0000 7f574d1ea780 1 > prepared operation key=K12MVG618809 tag=XG4HZOVHT8D4 type=del size=2111029 2024-09-12T17:18:17.729 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.728+0000 7f574d1ea780 1 < completed write operation key=TIKBUXFPVTN1 tag=FM1TN0P3SNPZ type=write size=1048143 2024-09-12T17:18:17.730 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.729+0000 7f574d1ea780 1 > prepared operation key=54CM8800AT9V tag=AU7SC7PEDA03 type=del size=263833 2024-09-12T17:18:17.733 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.732+0000 7f574d1ea780 1 < suggested update operation key=HFWA7DNUMWF2 tag=O595BV22LCQW type=del size=3569826 2024-09-12T17:18:17.735 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.734+0000 7f574d1ea780 1 > prepared part key=_multipart_VWWA5IB0L4N1.2~CLXTZPYL1L5H.0 size=1048576 2024-09-12T17:18:17.736 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.735+0000 7f574d1ea780 1 > prepared part key=_multipart_VWWA5IB0L4N1.2~CLXTZPYL1L5H.1 size=1048576 2024-09-12T17:18:17.737 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.736+0000 7f574d1ea780 1 > prepared part key=_multipart_VWWA5IB0L4N1.2~CLXTZPYL1L5H.2 size=199400 2024-09-12T17:18:17.737 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.736+0000 7f574d1ea780 1 > prepared multipart upload key=VWWA5IB0L4N1 upload=CLXTZPYL1L5H tag=FXV5Z3KZVZTR type=write size=3345128 2024-09-12T17:18:17.738 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.737+0000 7f574d1ea780 1 < canceled operation key=RWVWJHVZE95H tag=6895OPR721J3 type=del size=255591 2024-09-12T17:18:17.739 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.738+0000 7f574d1ea780 1 > prepared operation key=QXD8UG2K4STQ tag=BB9JING08ZK1 type=del size=2246716 2024-09-12T17:18:17.742 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.741+0000 7f574d1ea780 1 < suggested remove operation key=U6E9A5OH4GUW tag=7TMO97YOTZ4G type=del 2024-09-12T17:18:17.744 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.743+0000 7f574d1ea780 1 > prepared part key=_multipart_SQQMJ61CA0QW.2~IAJT421G1U9N.0 size=245946 2024-09-12T17:18:17.744 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.743+0000 7f574d1ea780 1 > prepared multipart upload key=SQQMJ61CA0QW upload=IAJT421G1U9N tag=XR323QBWWCEZ type=write size=1294522 2024-09-12T17:18:17.747 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.746+0000 7f574d1ea780 1 < suggested update operation key=UFKM4I8RMT0W tag=DAN9AWEBMPCH type=del size=1819813 2024-09-12T17:18:17.748 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.747+0000 7f574d1ea780 1 > prepared operation key=UFKM4I8RMT0W tag=9HOSP5L1AHT7 type=del size=2267983 2024-09-12T17:18:17.749 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.748+0000 7f574d1ea780 1 < completed part key=_multipart_C9IYR9CET1I8.2~F775X4TUDWLZ.0 size=502507 2024-09-12T17:18:17.751 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.750+0000 7f574d1ea780 1 < completed multipart upload key=C9IYR9CET1I8 upload=F775X4TUDWLZ tag=INJR0KNZGPOP type=write size=1551083 2024-09-12T17:18:17.752 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.751+0000 7f574d1ea780 1 > prepared operation key=43GV2N9VBBKE tag=BKVQ4ATPBYP1 type=del size=3700255 2024-09-12T17:18:17.754 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.753+0000 7f574d1ea780 1 < completed delete operation key=55JI541K1WP2 tag=IZ09JBQS7Y2F type=del 2024-09-12T17:18:17.755 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.754+0000 7f574d1ea780 1 > prepared operation key=OI51GO639LFK tag=C8JZO5NDHIMP type=del size=2738210 2024-09-12T17:18:17.756 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.756+0000 7f574d1ea780 1 < completed part key=_multipart_8SG7DJO4HWPI.2~WG4TBFFEP9N6.0 size=1048576 2024-09-12T17:18:17.757 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.757+0000 7f574d1ea780 1 < completed part key=_multipart_8SG7DJO4HWPI.2~WG4TBFFEP9N6.1 size=1048576 2024-09-12T17:18:17.759 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.758+0000 7f574d1ea780 1 < completed part key=_multipart_8SG7DJO4HWPI.2~WG4TBFFEP9N6.2 size=241837 2024-09-12T17:18:17.761 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.760+0000 7f574d1ea780 1 < completed multipart upload key=8SG7DJO4HWPI upload=WG4TBFFEP9N6 tag=P8KTEKMYCZ7M type=write size=3387565 2024-09-12T17:18:17.762 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.761+0000 7f574d1ea780 1 > prepared operation key=55JI541K1WP2 tag=D41RSSKFWONB type=del size=3186894 2024-09-12T17:18:17.765 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.764+0000 7f574d1ea780 1 < suggested remove operation key=ZGH8XC39FGTC tag=NP24KEB2N8H0 type=del 2024-09-12T17:18:17.767 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.766+0000 7f574d1ea780 1 > prepared part key=_multipart_55JI541K1WP2.2~YJGJEMG4AOO8.0 size=1048576 2024-09-12T17:18:17.768 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.767+0000 7f574d1ea780 1 > prepared part key=_multipart_55JI541K1WP2.2~YJGJEMG4AOO8.1 size=322568 2024-09-12T17:18:17.768 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.767+0000 7f574d1ea780 1 > prepared multipart upload key=55JI541K1WP2 upload=YJGJEMG4AOO8 tag=PRZPXKFVITM4 type=write size=2419720 2024-09-12T17:18:17.769 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.768+0000 7f574d1ea780 1 < completed part key=_multipart_54CM8800AT9V.2~0KLI5313GE4D.0 size=1048576 2024-09-12T17:18:17.770 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.769+0000 7f574d1ea780 1 < completed part key=_multipart_54CM8800AT9V.2~0KLI5313GE4D.1 size=1048576 2024-09-12T17:18:17.771 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.770+0000 7f574d1ea780 1 < completed part key=_multipart_54CM8800AT9V.2~0KLI5313GE4D.2 size=544589 2024-09-12T17:18:17.773 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.772+0000 7f574d1ea780 1 < completed multipart upload key=54CM8800AT9V upload=0KLI5313GE4D tag=JEM4Y1EAP0V9 type=write size=3690317 2024-09-12T17:18:17.774 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.774+0000 7f574d1ea780 1 > prepared operation key=R00F69ON5P6Z tag=JR1NFLFTT52Q type=del size=2660232 2024-09-12T17:18:17.776 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.775+0000 7f574d1ea780 1 < completed write operation key=R00F69ON5P6Z tag=GCGU1EKFXA7Q type=write size=674397 2024-09-12T17:18:17.777 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.776+0000 7f574d1ea780 1 > prepared operation key=GEGOEB05R0PK tag=716SZ18XQUAX type=del size=2832601 2024-09-12T17:18:17.778 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.777+0000 7f574d1ea780 1 < completed delete operation key=TIKBUXFPVTN1 tag=JKVU1PWHM310 type=del 2024-09-12T17:18:17.780 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.779+0000 7f574d1ea780 1 > prepared operation key=8VW3XCUHLF2L tag=KXJJQKMZ1LSY type=del size=899122 2024-09-12T17:18:17.781 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.780+0000 7f574d1ea780 1 < completed delete operation key=Q2Q3B1J3DAVD tag=RH6YQJAFWTPB type=del 2024-09-12T17:18:17.783 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.782+0000 7f574d1ea780 1 > prepared part key=_multipart_55JI541K1WP2.2~6DOQLGBSTNZR.0 size=1048576 2024-09-12T17:18:17.784 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.783+0000 7f574d1ea780 1 > prepared part key=_multipart_55JI541K1WP2.2~6DOQLGBSTNZR.1 size=287705 2024-09-12T17:18:17.784 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.783+0000 7f574d1ea780 1 > prepared multipart upload key=55JI541K1WP2 upload=6DOQLGBSTNZR tag=KZDEISE0KHOY type=write size=2384857 2024-09-12T17:18:17.785 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.784+0000 7f574d1ea780 1 < completed write operation key=C9IYR9CET1I8 tag=6HHN79ID3ZIF type=write size=274911 2024-09-12T17:18:17.787 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.786+0000 7f574d1ea780 1 > prepared operation key=55JI541K1WP2 tag=XMDIEP07F9GT type=write size=640155 2024-09-12T17:18:17.788 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.787+0000 7f574d1ea780 1 < completed part key=_multipart_OI51GO639LFK.2~FV8D437MGSA3.0 size=1048576 2024-09-12T17:18:17.789 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.788+0000 7f574d1ea780 1 < completed part key=_multipart_OI51GO639LFK.2~FV8D437MGSA3.1 size=381219 2024-09-12T17:18:17.791 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.790+0000 7f574d1ea780 1 < completed multipart upload key=OI51GO639LFK upload=FV8D437MGSA3 tag=UGUIIKN5IFIX type=write size=2478371 2024-09-12T17:18:17.792 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.791+0000 7f574d1ea780 1 > prepared operation key=Q2Q3B1J3DAVD tag=65PZJAUY6L2N type=del size=3465571 2024-09-12T17:18:17.794 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.793+0000 7f574d1ea780 1 < completed delete operation key=K12MVG618809 tag=XG4HZOVHT8D4 type=del 2024-09-12T17:18:17.795 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.795+0000 7f574d1ea780 1 > prepared operation key=C9IYR9CET1I8 tag=OHO7X1AVWKKD type=del size=1864512 2024-09-12T17:18:17.797 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.796+0000 7f574d1ea780 1 < completed delete operation key=54CM8800AT9V tag=AU7SC7PEDA03 type=del 2024-09-12T17:18:17.798 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.797+0000 7f574d1ea780 1 > prepared operation key=RWVWJHVZE95H tag=X7QNHWDWHRPE type=del size=391563 2024-09-12T17:18:17.799 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.798+0000 7f574d1ea780 1 < completed part key=_multipart_VWWA5IB0L4N1.2~CLXTZPYL1L5H.0 size=1048576 2024-09-12T17:18:17.799 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.798+0000 7f574d1ea780 1 < canceled part key=_multipart_VWWA5IB0L4N1.2~CLXTZPYL1L5H.1 size=1048576 2024-09-12T17:18:17.800 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.799+0000 7f574d1ea780 1 < completed part key=_multipart_VWWA5IB0L4N1.2~CLXTZPYL1L5H.2 size=199400 2024-09-12T17:18:17.802 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.801+0000 7f574d1ea780 1 < canceled multipart upload key=VWWA5IB0L4N1 upload=CLXTZPYL1L5H tag=FXV5Z3KZVZTR type=write size=3345128 2024-09-12T17:18:17.803 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.803+0000 7f574d1ea780 1 > prepared operation key=HFWA7DNUMWF2 tag=58ILP7PSDM0K type=write size=106502 2024-09-12T17:18:17.805 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.804+0000 7f574d1ea780 1 < completed delete operation key=QXD8UG2K4STQ tag=BB9JING08ZK1 type=del 2024-09-12T17:18:17.806 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.805+0000 7f574d1ea780 1 > prepared operation key=8VW3XCUHLF2L tag=0D188O3993T7 type=del size=1198256 2024-09-12T17:18:17.807 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.806+0000 7f574d1ea780 1 < completed part key=_multipart_SQQMJ61CA0QW.2~IAJT421G1U9N.0 size=245946 2024-09-12T17:18:17.809 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.808+0000 7f574d1ea780 1 < completed multipart upload key=SQQMJ61CA0QW upload=IAJT421G1U9N tag=XR323QBWWCEZ type=write size=1294522 2024-09-12T17:18:17.810 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.810+0000 7f574d1ea780 1 > prepared operation key=HGZMN894YYC0 tag=E12KR2MSMA52 type=del size=138161 2024-09-12T17:18:17.812 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.811+0000 7f574d1ea780 1 < completed delete operation key=UFKM4I8RMT0W tag=9HOSP5L1AHT7 type=del 2024-09-12T17:18:17.813 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.812+0000 7f574d1ea780 1 > prepared operation key=Q2Q3B1J3DAVD tag=7ZLBU8NEC49K type=del size=1098993 2024-09-12T17:18:17.815 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.814+0000 7f574d1ea780 1 < suggested update operation key=43GV2N9VBBKE tag=BKVQ4ATPBYP1 type=del size=3700255 2024-09-12T17:18:17.817 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.816+0000 7f574d1ea780 1 > prepared operation key=UFKM4I8RMT0W tag=C64WGVN4OH3T type=del size=2267868 2024-09-12T17:18:17.818 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.817+0000 7f574d1ea780 1 < completed delete operation key=OI51GO639LFK tag=C8JZO5NDHIMP type=del 2024-09-12T17:18:17.820 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.819+0000 7f574d1ea780 1 > prepared part key=_multipart_HGZMN894YYC0.2~KR0EJYPA9XUP.0 size=1048576 2024-09-12T17:18:17.821 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.820+0000 7f574d1ea780 1 > prepared part key=_multipart_HGZMN894YYC0.2~KR0EJYPA9XUP.1 size=1048576 2024-09-12T17:18:17.822 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.821+0000 7f574d1ea780 1 > prepared part key=_multipart_HGZMN894YYC0.2~KR0EJYPA9XUP.2 size=93577 2024-09-12T17:18:17.822 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.821+0000 7f574d1ea780 1 > prepared multipart upload key=HGZMN894YYC0 upload=KR0EJYPA9XUP tag=QV7S93PH8O97 type=write size=3239305 2024-09-12T17:18:17.823 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.822+0000 7f574d1ea780 1 < completed delete operation key=55JI541K1WP2 tag=D41RSSKFWONB type=del 2024-09-12T17:18:17.824 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.824+0000 7f574d1ea780 1 > prepared operation key=R00F69ON5P6Z tag=GMXP4ORM0DM9 type=del size=2353749 2024-09-12T17:18:17.826 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.825+0000 7f574d1ea780 1 < completed part key=_multipart_55JI541K1WP2.2~YJGJEMG4AOO8.0 size=1048576 2024-09-12T17:18:17.827 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.826+0000 7f574d1ea780 1 < completed part key=_multipart_55JI541K1WP2.2~YJGJEMG4AOO8.1 size=322568 2024-09-12T17:18:17.829 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.828+0000 7f574d1ea780 1 < completed multipart upload key=55JI541K1WP2 upload=YJGJEMG4AOO8 tag=PRZPXKFVITM4 type=write size=2419720 2024-09-12T17:18:17.830 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.829+0000 7f574d1ea780 1 > prepared operation key=ZGE1860DMGHA tag=SZDQCEBFATRI type=del size=2985241 2024-09-12T17:18:17.831 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.831+0000 7f574d1ea780 1 < completed delete operation key=R00F69ON5P6Z tag=JR1NFLFTT52Q type=del 2024-09-12T17:18:17.833 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.832+0000 7f574d1ea780 1 > prepared operation key=RNI86YYLADT0 tag=ZTKOQY685E3C type=del size=1656885 2024-09-12T17:18:17.834 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.833+0000 7f574d1ea780 1 < completed delete operation key=GEGOEB05R0PK tag=716SZ18XQUAX type=del 2024-09-12T17:18:17.835 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.834+0000 7f574d1ea780 1 > prepared operation key=OI51GO639LFK tag=BMFZJ87AFYO0 type=del size=1519697 2024-09-12T17:18:17.836 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.835+0000 7f574d1ea780 1 < completed delete operation key=8VW3XCUHLF2L tag=KXJJQKMZ1LSY type=del 2024-09-12T17:18:17.838 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.837+0000 7f574d1ea780 1 > prepared operation key=RWVWJHVZE95H tag=0TH4SOF94U92 type=write size=307136 2024-09-12T17:18:17.839 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.838+0000 7f574d1ea780 1 < completed part key=_multipart_55JI541K1WP2.2~6DOQLGBSTNZR.0 size=1048576 2024-09-12T17:18:17.840 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.839+0000 7f574d1ea780 1 < completed part key=_multipart_55JI541K1WP2.2~6DOQLGBSTNZR.1 size=287705 2024-09-12T17:18:17.842 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.841+0000 7f574d1ea780 1 < completed multipart upload key=55JI541K1WP2 upload=6DOQLGBSTNZR tag=KZDEISE0KHOY type=write size=2384857 2024-09-12T17:18:17.843 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.842+0000 7f574d1ea780 1 > prepared operation key=7BX38Q7723EB tag=35PTQY9PIP0Q type=del size=1833968 2024-09-12T17:18:17.844 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.844+0000 7f574d1ea780 1 < completed write operation key=55JI541K1WP2 tag=XMDIEP07F9GT type=write size=640155 2024-09-12T17:18:17.846 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.845+0000 7f574d1ea780 1 > prepared operation key=A1TIP3RXHBCZ tag=C34LX0Z73J58 type=del size=2087158 2024-09-12T17:18:17.848 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.847+0000 7f574d1ea780 1 < suggested update operation key=Q2Q3B1J3DAVD tag=65PZJAUY6L2N type=del size=3465571 2024-09-12T17:18:17.850 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.850+0000 7f574d1ea780 1 > prepared part key=_multipart_TIKBUXFPVTN1.2~WL8P9FSR9PC1.0 size=882024 2024-09-12T17:18:17.850 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.850+0000 7f574d1ea780 1 > prepared multipart upload key=TIKBUXFPVTN1 upload=WL8P9FSR9PC1 tag=3F3NYT52VEH9 type=write size=1930600 2024-09-12T17:18:17.852 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.851+0000 7f574d1ea780 1 < completed delete operation key=C9IYR9CET1I8 tag=OHO7X1AVWKKD type=del 2024-09-12T17:18:17.853 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.852+0000 7f574d1ea780 1 > prepared operation key=C9IYR9CET1I8 tag=ZD9X5GLSLQB2 type=write size=30615 2024-09-12T17:18:17.854 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.853+0000 7f574d1ea780 1 < completed delete operation key=RWVWJHVZE95H tag=X7QNHWDWHRPE type=del 2024-09-12T17:18:17.856 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.856+0000 7f574d1ea780 1 > prepared part key=_multipart_UTCKL1F42X8A.2~NR12B1CF03CK.0 size=1048576 2024-09-12T17:18:17.857 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.857+0000 7f574d1ea780 1 > prepared part key=_multipart_UTCKL1F42X8A.2~NR12B1CF03CK.1 size=1048576 2024-09-12T17:18:17.858 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.858+0000 7f574d1ea780 1 > prepared part key=_multipart_UTCKL1F42X8A.2~NR12B1CF03CK.2 size=494869 2024-09-12T17:18:17.858 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.858+0000 7f574d1ea780 1 > prepared multipart upload key=UTCKL1F42X8A upload=NR12B1CF03CK tag=1YRHG3SX96LP type=write size=3640597 2024-09-12T17:18:17.860 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.859+0000 7f574d1ea780 1 < completed write operation key=HFWA7DNUMWF2 tag=58ILP7PSDM0K type=write size=106502 2024-09-12T17:18:17.861 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.860+0000 7f574d1ea780 1 > prepared operation key=QXD8UG2K4STQ tag=2AVGCR6VPPX2 type=del size=3366130 2024-09-12T17:18:17.862 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.861+0000 7f574d1ea780 1 < canceled operation key=8VW3XCUHLF2L tag=0D188O3993T7 type=del size=1198256 2024-09-12T17:18:17.864 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.863+0000 7f574d1ea780 1 > prepared operation key=D1GEG3MKPOM3 tag=AYKNGII8Z4OM type=del size=3413177 2024-09-12T17:18:17.866 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.865+0000 7f574d1ea780 1 < suggested remove operation key=HGZMN894YYC0 tag=E12KR2MSMA52 type=del 2024-09-12T17:18:17.867 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.867+0000 7f574d1ea780 1 > prepared operation key=YXIDO0U18839 tag=8JGHW2IPU9LW type=del size=1552855 2024-09-12T17:18:17.870 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.869+0000 7f574d1ea780 1 < suggested remove operation key=Q2Q3B1J3DAVD tag=7ZLBU8NEC49K type=del 2024-09-12T17:18:17.871 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.870+0000 7f574d1ea780 1 > prepared operation key=GEGOEB05R0PK tag=0YUUOGVJHN0K type=del size=3939455 2024-09-12T17:18:17.873 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.872+0000 7f574d1ea780 1 < completed delete operation key=UFKM4I8RMT0W tag=C64WGVN4OH3T type=del 2024-09-12T17:18:17.875 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.874+0000 7f574d1ea780 1 > prepared part key=_multipart_OI51GO639LFK.2~HTOWCTYMX9VV.0 size=1048576 2024-09-12T17:18:17.876 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.875+0000 7f574d1ea780 1 > prepared part key=_multipart_OI51GO639LFK.2~HTOWCTYMX9VV.1 size=1048576 2024-09-12T17:18:17.877 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.876+0000 7f574d1ea780 1 > prepared part key=_multipart_OI51GO639LFK.2~HTOWCTYMX9VV.2 size=880480 2024-09-12T17:18:17.877 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.876+0000 7f574d1ea780 1 > prepared multipart upload key=OI51GO639LFK upload=HTOWCTYMX9VV tag=4MFRA6B32SZ7 type=write size=4026208 2024-09-12T17:18:17.879 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.878+0000 7f574d1ea780 1 < completed part key=_multipart_HGZMN894YYC0.2~KR0EJYPA9XUP.0 size=1048576 2024-09-12T17:18:17.880 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.879+0000 7f574d1ea780 1 < completed part key=_multipart_HGZMN894YYC0.2~KR0EJYPA9XUP.1 size=1048576 2024-09-12T17:18:17.881 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.880+0000 7f574d1ea780 1 < completed part key=_multipart_HGZMN894YYC0.2~KR0EJYPA9XUP.2 size=93577 2024-09-12T17:18:17.883 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.882+0000 7f574d1ea780 1 < completed multipart upload key=HGZMN894YYC0 upload=KR0EJYPA9XUP tag=QV7S93PH8O97 type=write size=3239305 2024-09-12T17:18:17.884 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.883+0000 7f574d1ea780 1 > prepared operation key=DH02JGZP64MN tag=AS54NL8FL0OP type=del size=2020998 2024-09-12T17:18:17.885 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.885+0000 7f574d1ea780 1 < completed delete operation key=R00F69ON5P6Z tag=GMXP4ORM0DM9 type=del 2024-09-12T17:18:17.888 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.887+0000 7f574d1ea780 1 > prepared part key=_multipart_U6E9A5OH4GUW.2~SB8NNYNNGTNT.0 size=1048576 2024-09-12T17:18:17.889 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.888+0000 7f574d1ea780 1 > prepared part key=_multipart_U6E9A5OH4GUW.2~SB8NNYNNGTNT.1 size=982304 2024-09-12T17:18:17.889 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.888+0000 7f574d1ea780 1 > prepared multipart upload key=U6E9A5OH4GUW upload=SB8NNYNNGTNT tag=JZEYJNJJ5ZDM type=write size=3079456 2024-09-12T17:18:17.890 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.889+0000 7f574d1ea780 1 < completed delete operation key=ZGE1860DMGHA tag=SZDQCEBFATRI type=del 2024-09-12T17:18:17.891 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.891+0000 7f574d1ea780 1 > prepared operation key=C9IYR9CET1I8 tag=ED41JVN48YP5 type=del size=759189 2024-09-12T17:18:17.894 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.893+0000 7f574d1ea780 1 < suggested remove operation key=RNI86YYLADT0 tag=ZTKOQY685E3C type=del 2024-09-12T17:18:17.897 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.896+0000 7f574d1ea780 1 > prepared part key=_multipart_54CM8800AT9V.2~NG0SQFP6U52K.0 size=191127 2024-09-12T17:18:17.897 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.896+0000 7f574d1ea780 1 > prepared multipart upload key=54CM8800AT9V upload=NG0SQFP6U52K tag=016RVB0JZIAY type=write size=1239703 2024-09-12T17:18:17.898 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.897+0000 7f574d1ea780 1 < completed delete operation key=OI51GO639LFK tag=BMFZJ87AFYO0 type=del 2024-09-12T17:18:17.899 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.898+0000 7f574d1ea780 1 > prepared operation key=QXD8UG2K4STQ tag=9MOO9OSMPF95 type=del size=209985 2024-09-12T17:18:17.900 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.900+0000 7f574d1ea780 1 < completed write operation key=RWVWJHVZE95H tag=0TH4SOF94U92 type=write size=307136 2024-09-12T17:18:17.902 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.901+0000 7f574d1ea780 1 > prepared operation key=K12MVG618809 tag=G2XEGRGITBGO type=del size=2388266 2024-09-12T17:18:17.903 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.902+0000 7f574d1ea780 1 < completed delete operation key=7BX38Q7723EB tag=35PTQY9PIP0Q type=del 2024-09-12T17:18:17.904 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.904+0000 7f574d1ea780 1 > prepared operation key=ZGH8XC39FGTC tag=3YWTG0ATPMFN type=del size=1570397 2024-09-12T17:18:17.906 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.905+0000 7f574d1ea780 1 < completed delete operation key=A1TIP3RXHBCZ tag=C34LX0Z73J58 type=del 2024-09-12T17:18:17.907 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.906+0000 7f574d1ea780 1 > prepared operation key=QXD8UG2K4STQ tag=7LCJMBJ65W3D type=del size=1254018 2024-09-12T17:18:17.908 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.908+0000 7f574d1ea780 1 < completed part key=_multipart_TIKBUXFPVTN1.2~WL8P9FSR9PC1.0 size=882024 2024-09-12T17:18:17.910 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.910+0000 7f574d1ea780 1 < completed multipart upload key=TIKBUXFPVTN1 upload=WL8P9FSR9PC1 tag=3F3NYT52VEH9 type=write size=1930600 2024-09-12T17:18:17.913 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.912+0000 7f574d1ea780 1 > prepared part key=_multipart_GEGOEB05R0PK.2~COM1M09V9ORJ.0 size=997804 2024-09-12T17:18:17.913 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.912+0000 7f574d1ea780 1 > prepared multipart upload key=GEGOEB05R0PK upload=COM1M09V9ORJ tag=4PELSC6BFCDJ type=write size=2046380 2024-09-12T17:18:17.915 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.914+0000 7f574d1ea780 1 < canceled operation key=C9IYR9CET1I8 tag=ZD9X5GLSLQB2 type=write size=30615 2024-09-12T17:18:17.916 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.916+0000 7f574d1ea780 1 > prepared operation key=VWWA5IB0L4N1 tag=L614A4FKNBL6 type=write size=686562 2024-09-12T17:18:17.918 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.917+0000 7f574d1ea780 1 < completed part key=_multipart_UTCKL1F42X8A.2~NR12B1CF03CK.0 size=1048576 2024-09-12T17:18:17.919 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.918+0000 7f574d1ea780 1 < completed part key=_multipart_UTCKL1F42X8A.2~NR12B1CF03CK.1 size=1048576 2024-09-12T17:18:17.922 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.920+0000 7f574d1ea780 1 < completed part key=_multipart_UTCKL1F42X8A.2~NR12B1CF03CK.2 size=494869 2024-09-12T17:18:17.923 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.922+0000 7f574d1ea780 1 < completed multipart upload key=UTCKL1F42X8A upload=NR12B1CF03CK tag=1YRHG3SX96LP type=write size=3640597 2024-09-12T17:18:17.924 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.923+0000 7f574d1ea780 1 > prepared operation key=VWWA5IB0L4N1 tag=EVHUUI8SRYR3 type=del size=598139 2024-09-12T17:18:17.928 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.927+0000 7f574d1ea780 1 < suggested update operation key=QXD8UG2K4STQ tag=2AVGCR6VPPX2 type=del size=3366130 2024-09-12T17:18:17.929 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.928+0000 7f574d1ea780 1 > prepared operation key=C9IYR9CET1I8 tag=ZU870FU0004U type=del size=3440437 2024-09-12T17:18:17.932 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.931+0000 7f574d1ea780 1 < suggested remove operation key=D1GEG3MKPOM3 tag=AYKNGII8Z4OM type=del 2024-09-12T17:18:17.933 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.932+0000 7f574d1ea780 1 > prepared operation key=ENFNIFHQ3SHW tag=ITYK7DNPR4MX type=del size=1675722 2024-09-12T17:18:17.934 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.933+0000 7f574d1ea780 1 < completed delete operation key=YXIDO0U18839 tag=8JGHW2IPU9LW type=del 2024-09-12T17:18:17.936 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.935+0000 7f574d1ea780 1 > prepared operation key=8SG7DJO4HWPI tag=291XMBXJ8NF3 type=del size=1948077 2024-09-12T17:18:17.937 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.936+0000 7f574d1ea780 1 < completed delete operation key=GEGOEB05R0PK tag=0YUUOGVJHN0K type=del 2024-09-12T17:18:17.938 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.937+0000 7f574d1ea780 1 > prepared operation key=U6E9A5OH4GUW tag=IZR125YQQJO9 type=del size=2067160 2024-09-12T17:18:17.939 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.939+0000 7f574d1ea780 1 < completed part key=_multipart_OI51GO639LFK.2~HTOWCTYMX9VV.0 size=1048576 2024-09-12T17:18:17.940 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.940+0000 7f574d1ea780 1 < completed part key=_multipart_OI51GO639LFK.2~HTOWCTYMX9VV.1 size=1048576 2024-09-12T17:18:17.941 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.941+0000 7f574d1ea780 1 < completed part key=_multipart_OI51GO639LFK.2~HTOWCTYMX9VV.2 size=880480 2024-09-12T17:18:17.944 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.943+0000 7f574d1ea780 1 < completed multipart upload key=OI51GO639LFK upload=HTOWCTYMX9VV tag=4MFRA6B32SZ7 type=write size=4026208 2024-09-12T17:18:17.945 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.944+0000 7f574d1ea780 1 > prepared operation key=TIKBUXFPVTN1 tag=RXMN79P24PWJ type=del size=3390670 2024-09-12T17:18:17.947 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.947+0000 7f574d1ea780 1 < suggested remove operation key=DH02JGZP64MN tag=AS54NL8FL0OP type=del 2024-09-12T17:18:17.949 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.948+0000 7f574d1ea780 1 > prepared operation key=SQQMJ61CA0QW tag=HER5PWNME6EK type=del size=911918 2024-09-12T17:18:17.949 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.948+0000 7f574d1ea780 1 < canceled part key=_multipart_U6E9A5OH4GUW.2~SB8NNYNNGTNT.0 size=1048576 2024-09-12T17:18:17.949 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.948+0000 7f574d1ea780 1 < canceled part key=_multipart_U6E9A5OH4GUW.2~SB8NNYNNGTNT.1 size=982304 2024-09-12T17:18:17.951 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.950+0000 7f574d1ea780 1 < canceled multipart upload key=U6E9A5OH4GUW upload=SB8NNYNNGTNT tag=JZEYJNJJ5ZDM type=write size=3079456 2024-09-12T17:18:17.953 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.952+0000 7f574d1ea780 1 > prepared part key=_multipart_U6E9A5OH4GUW.2~8NT9FS14Y752.0 size=34834 2024-09-12T17:18:17.953 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.952+0000 7f574d1ea780 1 > prepared multipart upload key=U6E9A5OH4GUW upload=8NT9FS14Y752 tag=ZEL0XFEI5NG7 type=write size=1083410 2024-09-12T17:18:17.954 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.953+0000 7f574d1ea780 1 < completed delete operation key=C9IYR9CET1I8 tag=ED41JVN48YP5 type=del 2024-09-12T17:18:17.956 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.956+0000 7f574d1ea780 1 > prepared part key=_multipart_GEGOEB05R0PK.2~SZ69Q4AQPATT.0 size=1048576 2024-09-12T17:18:17.957 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.957+0000 7f574d1ea780 1 > prepared part key=_multipart_GEGOEB05R0PK.2~SZ69Q4AQPATT.1 size=1048576 2024-09-12T17:18:17.958 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.958+0000 7f574d1ea780 1 > prepared part key=_multipart_GEGOEB05R0PK.2~SZ69Q4AQPATT.2 size=352401 2024-09-12T17:18:17.959 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.958+0000 7f574d1ea780 1 > prepared multipart upload key=GEGOEB05R0PK upload=SZ69Q4AQPATT tag=KQHPXCS7837A type=write size=3498129 2024-09-12T17:18:17.960 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.959+0000 7f574d1ea780 1 < completed part key=_multipart_54CM8800AT9V.2~NG0SQFP6U52K.0 size=191127 2024-09-12T17:18:17.961 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.961+0000 7f574d1ea780 1 < completed multipart upload key=54CM8800AT9V upload=NG0SQFP6U52K tag=016RVB0JZIAY type=write size=1239703 2024-09-12T17:18:17.964 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.963+0000 7f574d1ea780 1 > prepared part key=_multipart_8SG7DJO4HWPI.2~4NPVLTOXJN30.0 size=736245 2024-09-12T17:18:17.964 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.963+0000 7f574d1ea780 1 > prepared multipart upload key=8SG7DJO4HWPI upload=4NPVLTOXJN30 tag=K8AXAQ2AUWT6 type=write size=1784821 2024-09-12T17:18:17.965 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.964+0000 7f574d1ea780 -1 < failed to complete operation key=QXD8UG2K4STQ tag=9MOO9OSMPF95 type=del size=209985: (22) Invalid argument 2024-09-12T17:18:17.966 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.965+0000 7f574d1ea780 1 > prepared operation key=7BX38Q7723EB tag=5S4Q15M9SD2K type=del size=2464295 2024-09-12T17:18:17.967 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.966+0000 7f574d1ea780 1 < completed delete operation key=K12MVG618809 tag=G2XEGRGITBGO type=del 2024-09-12T17:18:17.968 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.968+0000 7f574d1ea780 1 > prepared operation key=DH02JGZP64MN tag=YZEQX7U89GGZ type=del size=2220283 2024-09-12T17:18:17.970 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.969+0000 7f574d1ea780 1 < completed delete operation key=ZGH8XC39FGTC tag=3YWTG0ATPMFN type=del 2024-09-12T17:18:17.971 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.970+0000 7f574d1ea780 1 > prepared operation key=DH02JGZP64MN tag=H7ARW0CA1EG2 type=del size=1291902 2024-09-12T17:18:17.972 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.971+0000 7f574d1ea780 -1 < failed to complete operation key=QXD8UG2K4STQ tag=7LCJMBJ65W3D type=del size=1254018: (22) Invalid argument 2024-09-12T17:18:17.974 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.973+0000 7f574d1ea780 1 > prepared part key=_multipart_QXD8UG2K4STQ.2~9XLGB87P80RL.0 size=1048576 2024-09-12T17:18:17.975 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.974+0000 7f574d1ea780 1 > prepared part key=_multipart_QXD8UG2K4STQ.2~9XLGB87P80RL.1 size=706018 2024-09-12T17:18:17.975 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.974+0000 7f574d1ea780 1 > prepared multipart upload key=QXD8UG2K4STQ upload=9XLGB87P80RL tag=XNNZIG6QFRJ7 type=write size=2803170 2024-09-12T17:18:17.976 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.976+0000 7f574d1ea780 1 < completed part key=_multipart_GEGOEB05R0PK.2~COM1M09V9ORJ.0 size=997804 2024-09-12T17:18:17.978 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.977+0000 7f574d1ea780 1 < completed multipart upload key=GEGOEB05R0PK upload=COM1M09V9ORJ tag=4PELSC6BFCDJ type=write size=2046380 2024-09-12T17:18:17.979 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.979+0000 7f574d1ea780 1 > prepared operation key=D1GEG3MKPOM3 tag=BDPP26NS7VP9 type=del size=3656232 2024-09-12T17:18:17.982 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.981+0000 7f574d1ea780 1 < suggested remove operation key=VWWA5IB0L4N1 tag=L614A4FKNBL6 type=write 2024-09-12T17:18:17.983 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.982+0000 7f574d1ea780 1 > prepared operation key=55V137SY4E4P tag=AAYQ76CGQ6WR type=del size=1482273 2024-09-12T17:18:17.984 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.983+0000 7f574d1ea780 -1 < failed to complete operation key=VWWA5IB0L4N1 tag=EVHUUI8SRYR3 type=del size=598139: (22) Invalid argument 2024-09-12T17:18:17.986 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.985+0000 7f574d1ea780 1 > prepared part key=_multipart_TIKBUXFPVTN1.2~QPSKM07I84ET.0 size=863216 2024-09-12T17:18:17.986 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.985+0000 7f574d1ea780 1 > prepared multipart upload key=TIKBUXFPVTN1 upload=QPSKM07I84ET tag=DM60YS9XUJZW type=write size=1911792 2024-09-12T17:18:17.987 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.987+0000 7f574d1ea780 1 < completed delete operation key=C9IYR9CET1I8 tag=ZU870FU0004U type=del 2024-09-12T17:18:17.990 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.989+0000 7f574d1ea780 1 > prepared part key=_multipart_43GV2N9VBBKE.2~HBE7IOQHMMUJ.0 size=1048576 2024-09-12T17:18:17.991 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.990+0000 7f574d1ea780 1 > prepared part key=_multipart_43GV2N9VBBKE.2~HBE7IOQHMMUJ.1 size=1048576 2024-09-12T17:18:17.992 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.991+0000 7f574d1ea780 1 > prepared part key=_multipart_43GV2N9VBBKE.2~HBE7IOQHMMUJ.2 size=92063 2024-09-12T17:18:17.992 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.991+0000 7f574d1ea780 1 > prepared multipart upload key=43GV2N9VBBKE upload=HBE7IOQHMMUJ tag=OA6CFFZL31XF type=write size=3237791 2024-09-12T17:18:17.993 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.992+0000 7f574d1ea780 1 < completed delete operation key=ENFNIFHQ3SHW tag=ITYK7DNPR4MX type=del 2024-09-12T17:18:17.994 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.993+0000 7f574d1ea780 1 > prepared operation key=D1GEG3MKPOM3 tag=RUCVS0UU70VK type=del size=972983 2024-09-12T17:18:17.996 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.996+0000 7f574d1ea780 1 < suggested remove operation key=8SG7DJO4HWPI tag=291XMBXJ8NF3 type=del 2024-09-12T17:18:17.998 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.998+0000 7f574d1ea780 1 > prepared part key=_multipart_QXD8UG2K4STQ.2~HI7TUATB57WA.0 size=1048576 2024-09-12T17:18:17.999 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:17.999+0000 7f574d1ea780 1 > prepared part key=_multipart_QXD8UG2K4STQ.2~HI7TUATB57WA.1 size=1048576 2024-09-12T17:18:18.000 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.000+0000 7f574d1ea780 1 > prepared part key=_multipart_QXD8UG2K4STQ.2~HI7TUATB57WA.2 size=996828 2024-09-12T17:18:18.001 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.000+0000 7f574d1ea780 1 > prepared multipart upload key=QXD8UG2K4STQ upload=HI7TUATB57WA tag=TNCPS159MS3F type=write size=4142556 2024-09-12T17:18:18.003 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.002+0000 7f574d1ea780 1 < suggested remove operation key=U6E9A5OH4GUW tag=IZR125YQQJO9 type=del 2024-09-12T17:18:18.004 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.003+0000 7f574d1ea780 1 > prepared operation key=UFKM4I8RMT0W tag=0MED69YLMZ44 type=del size=46082 2024-09-12T17:18:18.006 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.005+0000 7f574d1ea780 1 < suggested remove operation key=TIKBUXFPVTN1 tag=RXMN79P24PWJ type=del 2024-09-12T17:18:18.007 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.007+0000 7f574d1ea780 1 > prepared operation key=UFKM4I8RMT0W tag=7CKUOND74YII type=del size=1915469 2024-09-12T17:18:18.009 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.008+0000 7f574d1ea780 1 < completed delete operation key=SQQMJ61CA0QW tag=HER5PWNME6EK type=del 2024-09-12T17:18:18.010 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.009+0000 7f574d1ea780 1 > prepared operation key=OI51GO639LFK tag=6P9F077POXKS type=del size=1991299 2024-09-12T17:18:18.011 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.010+0000 7f574d1ea780 1 < completed part key=_multipart_U6E9A5OH4GUW.2~8NT9FS14Y752.0 size=34834 2024-09-12T17:18:18.013 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.012+0000 7f574d1ea780 1 < completed multipart upload key=U6E9A5OH4GUW upload=8NT9FS14Y752 tag=ZEL0XFEI5NG7 type=write size=1083410 2024-09-12T17:18:18.014 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.013+0000 7f574d1ea780 1 > prepared operation key=ZGH8XC39FGTC tag=1Y3F0KXANSK4 type=del size=2332604 2024-09-12T17:18:18.015 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.015+0000 7f574d1ea780 1 < completed part key=_multipart_GEGOEB05R0PK.2~SZ69Q4AQPATT.0 size=1048576 2024-09-12T17:18:18.016 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.015+0000 7f574d1ea780 1 < canceled part key=_multipart_GEGOEB05R0PK.2~SZ69Q4AQPATT.1 size=1048576 2024-09-12T17:18:18.017 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.016+0000 7f574d1ea780 1 < completed part key=_multipart_GEGOEB05R0PK.2~SZ69Q4AQPATT.2 size=352401 2024-09-12T17:18:18.019 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.018+0000 7f574d1ea780 1 < canceled multipart upload key=GEGOEB05R0PK upload=SZ69Q4AQPATT tag=KQHPXCS7837A type=write size=3498129 2024-09-12T17:18:18.021 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.021+0000 7f574d1ea780 1 > prepared part key=_multipart_RNI86YYLADT0.2~3MQ2YQ9OY9NW.0 size=804215 2024-09-12T17:18:18.022 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.021+0000 7f574d1ea780 1 > prepared multipart upload key=RNI86YYLADT0 upload=3MQ2YQ9OY9NW tag=X5BHNHVUCEER type=write size=1852791 2024-09-12T17:18:18.023 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.022+0000 7f574d1ea780 1 < completed part key=_multipart_8SG7DJO4HWPI.2~4NPVLTOXJN30.0 size=736245 2024-09-12T17:18:18.025 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.024+0000 7f574d1ea780 1 < completed multipart upload key=8SG7DJO4HWPI upload=4NPVLTOXJN30 tag=K8AXAQ2AUWT6 type=write size=1784821 2024-09-12T17:18:18.026 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.026+0000 7f574d1ea780 1 > prepared operation key=TIKBUXFPVTN1 tag=FOSV2K4NV8G9 type=del size=1836256 2024-09-12T17:18:18.028 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.027+0000 7f574d1ea780 1 < completed delete operation key=7BX38Q7723EB tag=5S4Q15M9SD2K type=del 2024-09-12T17:18:18.029 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.028+0000 7f574d1ea780 1 > prepared operation key=RNI86YYLADT0 tag=2MHH6Q4WPAP8 type=del size=1223973 2024-09-12T17:18:18.031 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.030+0000 7f574d1ea780 1 < canceled operation key=DH02JGZP64MN tag=YZEQX7U89GGZ type=del size=2220283 2024-09-12T17:18:18.032 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.031+0000 7f574d1ea780 1 > prepared operation key=TIKBUXFPVTN1 tag=407QUR5NACV9 type=del size=585715 2024-09-12T17:18:18.037 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.034+0000 7f574d1ea780 1 < completed delete operation key=DH02JGZP64MN tag=H7ARW0CA1EG2 type=del 2024-09-12T17:18:18.037 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.035+0000 7f574d1ea780 1 > prepared operation key=HGZMN894YYC0 tag=62KLEVLMHLV6 type=del size=1155996 2024-09-12T17:18:18.038 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.037+0000 7f574d1ea780 1 < completed part key=_multipart_QXD8UG2K4STQ.2~9XLGB87P80RL.0 size=1048576 2024-09-12T17:18:18.038 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.038+0000 7f574d1ea780 1 < completed part key=_multipart_QXD8UG2K4STQ.2~9XLGB87P80RL.1 size=706018 2024-09-12T17:18:18.041 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.040+0000 7f574d1ea780 1 < completed multipart upload key=QXD8UG2K4STQ upload=9XLGB87P80RL tag=XNNZIG6QFRJ7 type=write size=2803170 2024-09-12T17:18:18.042 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.041+0000 7f574d1ea780 1 > prepared operation key=54LQ91UMBJAN tag=JODSTUR00LWI type=del size=860117 2024-09-12T17:18:18.043 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.042+0000 7f574d1ea780 1 < completed delete operation key=D1GEG3MKPOM3 tag=BDPP26NS7VP9 type=del 2024-09-12T17:18:18.044 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.043+0000 7f574d1ea780 1 > prepared operation key=55V137SY4E4P tag=TX32ZRUY18ZY type=del size=1308897 2024-09-12T17:18:18.045 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.044+0000 7f574d1ea780 1 < completed delete operation key=55V137SY4E4P tag=AAYQ76CGQ6WR type=del 2024-09-12T17:18:18.047 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.047+0000 7f574d1ea780 1 > prepared part key=_multipart_55JI541K1WP2.2~LXUW9IBH91EF.0 size=977074 2024-09-12T17:18:18.048 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.047+0000 7f574d1ea780 1 > prepared multipart upload key=55JI541K1WP2 upload=LXUW9IBH91EF tag=SLQ6G0XIGOV9 type=write size=2025650 2024-09-12T17:18:18.049 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.048+0000 7f574d1ea780 1 < completed part key=_multipart_TIKBUXFPVTN1.2~QPSKM07I84ET.0 size=863216 2024-09-12T17:18:18.051 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.050+0000 7f574d1ea780 1 < completed multipart upload key=TIKBUXFPVTN1 upload=QPSKM07I84ET tag=DM60YS9XUJZW type=write size=1911792 2024-09-12T17:18:18.053 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.052+0000 7f574d1ea780 1 > prepared part key=_multipart_43GV2N9VBBKE.2~P585IAUFM73G.0 size=145312 2024-09-12T17:18:18.053 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.052+0000 7f574d1ea780 1 > prepared multipart upload key=43GV2N9VBBKE upload=P585IAUFM73G tag=Y60PLUN5M2X4 type=write size=1193888 2024-09-12T17:18:18.054 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.054+0000 7f574d1ea780 1 < completed part key=_multipart_43GV2N9VBBKE.2~HBE7IOQHMMUJ.0 size=1048576 2024-09-12T17:18:18.055 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.055+0000 7f574d1ea780 1 < completed part key=_multipart_43GV2N9VBBKE.2~HBE7IOQHMMUJ.1 size=1048576 2024-09-12T17:18:18.056 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.055+0000 7f574d1ea780 1 < completed part key=_multipart_43GV2N9VBBKE.2~HBE7IOQHMMUJ.2 size=92063 2024-09-12T17:18:18.058 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.058+0000 7f574d1ea780 1 < completed multipart upload key=43GV2N9VBBKE upload=HBE7IOQHMMUJ tag=OA6CFFZL31XF type=write size=3237791 2024-09-12T17:18:18.060 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.059+0000 7f574d1ea780 1 > prepared operation key=VWWA5IB0L4N1 tag=CUNLLCPJ1O42 type=del size=2616670 2024-09-12T17:18:18.061 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.060+0000 7f574d1ea780 1 < completed delete operation key=D1GEG3MKPOM3 tag=RUCVS0UU70VK type=del 2024-09-12T17:18:18.062 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.061+0000 7f574d1ea780 1 > prepared operation key=HFWA7DNUMWF2 tag=L7KSOMYJGONV type=del size=1423180 2024-09-12T17:18:18.063 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.062+0000 7f574d1ea780 1 < completed part key=_multipart_QXD8UG2K4STQ.2~HI7TUATB57WA.0 size=1048576 2024-09-12T17:18:18.064 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.063+0000 7f574d1ea780 1 < completed part key=_multipart_QXD8UG2K4STQ.2~HI7TUATB57WA.1 size=1048576 2024-09-12T17:18:18.065 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.064+0000 7f574d1ea780 1 < completed part key=_multipart_QXD8UG2K4STQ.2~HI7TUATB57WA.2 size=996828 2024-09-12T17:18:18.067 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.066+0000 7f574d1ea780 1 < completed multipart upload key=QXD8UG2K4STQ upload=HI7TUATB57WA tag=TNCPS159MS3F type=write size=4142556 2024-09-12T17:18:18.068 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.068+0000 7f574d1ea780 1 > prepared operation key=RNI86YYLADT0 tag=EH5RVJPQLHZX type=del size=933509 2024-09-12T17:18:18.070 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.069+0000 7f574d1ea780 1 < completed delete operation key=UFKM4I8RMT0W tag=0MED69YLMZ44 type=del 2024-09-12T17:18:18.071 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.070+0000 7f574d1ea780 1 > prepared operation key=DH02JGZP64MN tag=S3VNJ931T5EZ type=del size=1862874 2024-09-12T17:18:18.073 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.073+0000 7f574d1ea780 1 < suggested update operation key=UFKM4I8RMT0W tag=7CKUOND74YII type=del size=1915469 2024-09-12T17:18:18.075 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.074+0000 7f574d1ea780 1 > prepared operation key=55V137SY4E4P tag=NNXSQ1EJ1K6J type=del size=702026 2024-09-12T17:18:18.076 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.075+0000 7f574d1ea780 1 < completed delete operation key=OI51GO639LFK tag=6P9F077POXKS type=del 2024-09-12T17:18:18.077 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.076+0000 7f574d1ea780 1 > prepared operation key=Q2Q3B1J3DAVD tag=1NLQVDATYMQV type=del size=2876208 2024-09-12T17:18:18.079 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.078+0000 7f574d1ea780 1 < completed delete operation key=ZGH8XC39FGTC tag=1Y3F0KXANSK4 type=del 2024-09-12T17:18:18.080 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.079+0000 7f574d1ea780 1 > prepared operation key=7BX38Q7723EB tag=6PYE2JTATC0U type=del size=2452821 2024-09-12T17:18:18.081 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.080+0000 7f574d1ea780 1 < completed part key=_multipart_RNI86YYLADT0.2~3MQ2YQ9OY9NW.0 size=804215 2024-09-12T17:18:18.083 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.082+0000 7f574d1ea780 1 < completed multipart upload key=RNI86YYLADT0 upload=3MQ2YQ9OY9NW tag=X5BHNHVUCEER type=write size=1852791 2024-09-12T17:18:18.085 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.085+0000 7f574d1ea780 1 > prepared part key=_multipart_54CM8800AT9V.2~AI4307AV5CKU.0 size=1048576 2024-09-12T17:18:18.086 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.086+0000 7f574d1ea780 1 > prepared part key=_multipart_54CM8800AT9V.2~AI4307AV5CKU.1 size=1027680 2024-09-12T17:18:18.087 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.086+0000 7f574d1ea780 1 > prepared multipart upload key=54CM8800AT9V upload=AI4307AV5CKU tag=T5V2FUYE3GYC type=write size=3124832 2024-09-12T17:18:18.088 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.087+0000 7f574d1ea780 1 < canceled operation key=TIKBUXFPVTN1 tag=FOSV2K4NV8G9 type=del size=1836256 2024-09-12T17:18:18.089 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.088+0000 7f574d1ea780 1 > prepared operation key=OI51GO639LFK tag=54BU62GSV8DV type=del size=3535909 2024-09-12T17:18:18.090 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.089+0000 7f574d1ea780 1 < canceled operation key=RNI86YYLADT0 tag=2MHH6Q4WPAP8 type=del size=1223973 2024-09-12T17:18:18.091 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.091+0000 7f574d1ea780 1 > prepared operation key=D1GEG3MKPOM3 tag=HPYU5I0V392H type=del size=2804198 2024-09-12T17:18:18.093 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.092+0000 7f574d1ea780 1 < completed delete operation key=TIKBUXFPVTN1 tag=407QUR5NACV9 type=del 2024-09-12T17:18:18.094 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.093+0000 7f574d1ea780 1 > prepared operation key=A1TIP3RXHBCZ tag=DCVO7XUWP83U type=del size=2033697 2024-09-12T17:18:18.095 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.095+0000 7f574d1ea780 1 < completed delete operation key=HGZMN894YYC0 tag=62KLEVLMHLV6 type=del 2024-09-12T17:18:18.098 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.097+0000 7f574d1ea780 1 > prepared part key=_multipart_8SG7DJO4HWPI.2~TTWDTZ7INHGT.0 size=1048576 2024-09-12T17:18:18.099 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.098+0000 7f574d1ea780 1 > prepared part key=_multipart_8SG7DJO4HWPI.2~TTWDTZ7INHGT.1 size=384064 2024-09-12T17:18:18.099 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.098+0000 7f574d1ea780 1 > prepared multipart upload key=8SG7DJO4HWPI upload=TTWDTZ7INHGT tag=L1AX40ZQ3OZF type=write size=2481216 2024-09-12T17:18:18.100 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.099+0000 7f574d1ea780 1 < canceled operation key=54LQ91UMBJAN tag=JODSTUR00LWI type=del size=860117 2024-09-12T17:18:18.101 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.100+0000 7f574d1ea780 1 > prepared operation key=8SG7DJO4HWPI tag=27J4YQLACYJ0 type=del size=3759006 2024-09-12T17:18:18.103 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.102+0000 7f574d1ea780 1 < suggested remove operation key=55V137SY4E4P tag=TX32ZRUY18ZY type=del 2024-09-12T17:18:18.105 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.105+0000 7f574d1ea780 1 > prepared part key=_multipart_8VW3XCUHLF2L.2~12CPKIROP90M.0 size=509804 2024-09-12T17:18:18.106 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.105+0000 7f574d1ea780 1 > prepared multipart upload key=8VW3XCUHLF2L upload=12CPKIROP90M tag=902FYSZNOY6O type=write size=1558380 2024-09-12T17:18:18.107 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.106+0000 7f574d1ea780 1 < completed part key=_multipart_55JI541K1WP2.2~LXUW9IBH91EF.0 size=977074 2024-09-12T17:18:18.109 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.108+0000 7f574d1ea780 1 < completed multipart upload key=55JI541K1WP2 upload=LXUW9IBH91EF tag=SLQ6G0XIGOV9 type=write size=2025650 2024-09-12T17:18:18.110 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.109+0000 7f574d1ea780 1 > prepared operation key=55V137SY4E4P tag=0L3GH2QFUAWS type=del size=1725070 2024-09-12T17:18:18.110 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.109+0000 7f574d1ea780 1 < canceled part key=_multipart_43GV2N9VBBKE.2~P585IAUFM73G.0 size=145312 2024-09-12T17:18:18.112 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.111+0000 7f574d1ea780 1 < canceled multipart upload key=43GV2N9VBBKE upload=P585IAUFM73G tag=Y60PLUN5M2X4 type=write size=1193888 2024-09-12T17:18:18.113 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.112+0000 7f574d1ea780 1 > prepared operation key=54LQ91UMBJAN tag=J0RHJPN4QKBY type=write size=175704 2024-09-12T17:18:18.114 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.114+0000 7f574d1ea780 1 < completed delete operation key=VWWA5IB0L4N1 tag=CUNLLCPJ1O42 type=del 2024-09-12T17:18:18.117 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.116+0000 7f574d1ea780 1 > prepared part key=_multipart_ZGE1860DMGHA.2~KN43YQHL9NOL.0 size=1048576 2024-09-12T17:18:18.118 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.117+0000 7f574d1ea780 1 > prepared part key=_multipart_ZGE1860DMGHA.2~KN43YQHL9NOL.1 size=632098 2024-09-12T17:18:18.118 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.117+0000 7f574d1ea780 1 > prepared multipart upload key=ZGE1860DMGHA upload=KN43YQHL9NOL tag=6SHPWQRFXYNS type=write size=2729250 2024-09-12T17:18:18.119 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.118+0000 7f574d1ea780 1 < canceled operation key=HFWA7DNUMWF2 tag=L7KSOMYJGONV type=del size=1423180 2024-09-12T17:18:18.121 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.120+0000 7f574d1ea780 1 > prepared part key=_multipart_54CM8800AT9V.2~M0F8ZCJ8BV2X.0 size=441780 2024-09-12T17:18:18.121 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.120+0000 7f574d1ea780 1 > prepared multipart upload key=54CM8800AT9V upload=M0F8ZCJ8BV2X tag=HK5IQHEPPRIG type=write size=1490356 2024-09-12T17:18:18.123 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.122+0000 7f574d1ea780 1 < completed delete operation key=RNI86YYLADT0 tag=EH5RVJPQLHZX type=del 2024-09-12T17:18:18.124 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.123+0000 7f574d1ea780 1 > prepared operation key=ENFNIFHQ3SHW tag=18ACL5IXFY7E type=write size=206684 2024-09-12T17:18:18.125 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.124+0000 7f574d1ea780 1 < completed delete operation key=DH02JGZP64MN tag=S3VNJ931T5EZ type=del 2024-09-12T17:18:18.126 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.125+0000 7f574d1ea780 1 > prepared operation key=DH02JGZP64MN tag=0678IF84T9F1 type=del size=4009213 2024-09-12T17:18:18.127 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.127+0000 7f574d1ea780 -1 < failed to complete operation key=55V137SY4E4P tag=NNXSQ1EJ1K6J type=del size=702026: (22) Invalid argument 2024-09-12T17:18:18.130 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.129+0000 7f574d1ea780 1 > prepared part key=_multipart_YXIDO0U18839.2~C6PJZ3PIMS7B.0 size=1048576 2024-09-12T17:18:18.131 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.130+0000 7f574d1ea780 1 > prepared part key=_multipart_YXIDO0U18839.2~C6PJZ3PIMS7B.1 size=1048576 2024-09-12T17:18:18.132 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.131+0000 7f574d1ea780 1 > prepared part key=_multipart_YXIDO0U18839.2~C6PJZ3PIMS7B.2 size=540375 2024-09-12T17:18:18.132 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.131+0000 7f574d1ea780 1 > prepared multipart upload key=YXIDO0U18839 upload=C6PJZ3PIMS7B tag=F1KYCPAZPXGV type=write size=3686103 2024-09-12T17:18:18.133 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.132+0000 7f574d1ea780 1 < completed delete operation key=Q2Q3B1J3DAVD tag=1NLQVDATYMQV type=del 2024-09-12T17:18:18.135 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.134+0000 7f574d1ea780 1 > prepared part key=_multipart_8VW3XCUHLF2L.2~L2MPII2YERWP.0 size=705711 2024-09-12T17:18:18.135 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.134+0000 7f574d1ea780 1 > prepared multipart upload key=8VW3XCUHLF2L upload=L2MPII2YERWP tag=HAI4HEX9D9BU type=write size=1754287 2024-09-12T17:18:18.136 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.136+0000 7f574d1ea780 1 < completed delete operation key=7BX38Q7723EB tag=6PYE2JTATC0U type=del 2024-09-12T17:18:18.139 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.138+0000 7f574d1ea780 1 > prepared part key=_multipart_Q2Q3B1J3DAVD.2~EDR6WYWUN6DT.0 size=1048576 2024-09-12T17:18:18.140 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.139+0000 7f574d1ea780 1 > prepared part key=_multipart_Q2Q3B1J3DAVD.2~EDR6WYWUN6DT.1 size=1048576 2024-09-12T17:18:18.141 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.140+0000 7f574d1ea780 1 > prepared part key=_multipart_Q2Q3B1J3DAVD.2~EDR6WYWUN6DT.2 size=549566 2024-09-12T17:18:18.141 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.140+0000 7f574d1ea780 1 > prepared multipart upload key=Q2Q3B1J3DAVD upload=EDR6WYWUN6DT tag=93KDIAMXRAAK type=write size=3695294 2024-09-12T17:18:18.142 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.141+0000 7f574d1ea780 1 < completed part key=_multipart_54CM8800AT9V.2~AI4307AV5CKU.0 size=1048576 2024-09-12T17:18:18.143 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.142+0000 7f574d1ea780 1 < completed part key=_multipart_54CM8800AT9V.2~AI4307AV5CKU.1 size=1027680 2024-09-12T17:18:18.145 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.144+0000 7f574d1ea780 1 < completed multipart upload key=54CM8800AT9V upload=AI4307AV5CKU tag=T5V2FUYE3GYC type=write size=3124832 2024-09-12T17:18:18.147 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.146+0000 7f574d1ea780 1 > prepared part key=_multipart_GEGOEB05R0PK.2~F4QX2XFMKWQT.0 size=1048576 2024-09-12T17:18:18.148 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.147+0000 7f574d1ea780 1 > prepared part key=_multipart_GEGOEB05R0PK.2~F4QX2XFMKWQT.1 size=1039753 2024-09-12T17:18:18.149 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.147+0000 7f574d1ea780 1 > prepared multipart upload key=GEGOEB05R0PK upload=F4QX2XFMKWQT tag=N0YW4631EG5W type=write size=3136905 2024-09-12T17:18:18.150 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.150+0000 7f574d1ea780 1 < completed delete operation key=OI51GO639LFK tag=54BU62GSV8DV type=del 2024-09-12T17:18:18.153 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.152+0000 7f574d1ea780 1 > prepared operation key=UFKM4I8RMT0W tag=UD4KJSRMK0BT type=del size=4152409 2024-09-12T17:18:18.154 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.153+0000 7f574d1ea780 1 < completed delete operation key=D1GEG3MKPOM3 tag=HPYU5I0V392H type=del 2024-09-12T17:18:18.156 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.155+0000 7f574d1ea780 1 > prepared part key=_multipart_UFKM4I8RMT0W.2~6OEAZYTQM18J.0 size=1048576 2024-09-12T17:18:18.157 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.156+0000 7f574d1ea780 1 > prepared part key=_multipart_UFKM4I8RMT0W.2~6OEAZYTQM18J.1 size=129230 2024-09-12T17:18:18.158 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.156+0000 7f574d1ea780 1 > prepared multipart upload key=UFKM4I8RMT0W upload=6OEAZYTQM18J tag=F1OX4MDVACF5 type=write size=2226382 2024-09-12T17:18:18.159 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.158+0000 7f574d1ea780 1 < completed delete operation key=A1TIP3RXHBCZ tag=DCVO7XUWP83U type=del 2024-09-12T17:18:18.160 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.159+0000 7f574d1ea780 1 > prepared operation key=43GV2N9VBBKE tag=9L5I2THPE9TW type=write size=1041126 2024-09-12T17:18:18.161 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.160+0000 7f574d1ea780 1 < completed part key=_multipart_8SG7DJO4HWPI.2~TTWDTZ7INHGT.0 size=1048576 2024-09-12T17:18:18.162 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.161+0000 7f574d1ea780 1 < completed part key=_multipart_8SG7DJO4HWPI.2~TTWDTZ7INHGT.1 size=384064 2024-09-12T17:18:18.164 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.163+0000 7f574d1ea780 1 < completed multipart upload key=8SG7DJO4HWPI upload=TTWDTZ7INHGT tag=L1AX40ZQ3OZF type=write size=2481216 2024-09-12T17:18:18.166 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.165+0000 7f574d1ea780 1 > prepared part key=_multipart_D1GEG3MKPOM3.2~UDUUX0I3YGPW.0 size=619197 2024-09-12T17:18:18.166 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.165+0000 7f574d1ea780 1 > prepared multipart upload key=D1GEG3MKPOM3 upload=UDUUX0I3YGPW tag=JOZF2DHKUEG6 type=write size=1667773 2024-09-12T17:18:18.167 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.167+0000 7f574d1ea780 1 < completed delete operation key=8SG7DJO4HWPI tag=27J4YQLACYJ0 type=del 2024-09-12T17:18:18.170 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.169+0000 7f574d1ea780 1 > prepared part key=_multipart_54LQ91UMBJAN.2~2UMKRL4XEPN8.0 size=324904 2024-09-12T17:18:18.170 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.169+0000 7f574d1ea780 1 > prepared multipart upload key=54LQ91UMBJAN upload=2UMKRL4XEPN8 tag=VQUY9TZK6TAD type=write size=1373480 2024-09-12T17:18:18.171 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.170+0000 7f574d1ea780 1 < completed part key=_multipart_8VW3XCUHLF2L.2~12CPKIROP90M.0 size=509804 2024-09-12T17:18:18.173 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.172+0000 7f574d1ea780 1 < completed multipart upload key=8VW3XCUHLF2L upload=12CPKIROP90M tag=902FYSZNOY6O type=write size=1558380 2024-09-12T17:18:18.175 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.175+0000 7f574d1ea780 1 > prepared part key=_multipart_HFWA7DNUMWF2.2~00C7QS7R8W5K.0 size=316782 2024-09-12T17:18:18.176 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.175+0000 7f574d1ea780 1 > prepared multipart upload key=HFWA7DNUMWF2 upload=00C7QS7R8W5K tag=DXQM12ERZX70 type=write size=1365358 2024-09-12T17:18:18.177 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.176+0000 7f574d1ea780 1 < completed delete operation key=55V137SY4E4P tag=0L3GH2QFUAWS type=del 2024-09-12T17:18:18.179 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.178+0000 7f574d1ea780 1 > prepared part key=_multipart_TIKBUXFPVTN1.2~D4V8BABQAI2P.0 size=678626 2024-09-12T17:18:18.179 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.178+0000 7f574d1ea780 1 > prepared multipart upload key=TIKBUXFPVTN1 upload=D4V8BABQAI2P tag=EQ8FVRU70YO5 type=write size=1727202 2024-09-12T17:18:18.180 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.179+0000 7f574d1ea780 1 < completed write operation key=54LQ91UMBJAN tag=J0RHJPN4QKBY type=write size=175704 2024-09-12T17:18:18.182 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.181+0000 7f574d1ea780 1 > prepared operation key=8VW3XCUHLF2L tag=9TFZUNMISEZB type=del size=346689 2024-09-12T17:18:18.183 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.182+0000 7f574d1ea780 1 < completed part key=_multipart_ZGE1860DMGHA.2~KN43YQHL9NOL.0 size=1048576 2024-09-12T17:18:18.184 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.183+0000 7f574d1ea780 1 < completed part key=_multipart_ZGE1860DMGHA.2~KN43YQHL9NOL.1 size=632098 2024-09-12T17:18:18.186 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.185+0000 7f574d1ea780 1 < completed multipart upload key=ZGE1860DMGHA upload=KN43YQHL9NOL tag=6SHPWQRFXYNS type=write size=2729250 2024-09-12T17:18:18.187 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.186+0000 7f574d1ea780 1 > prepared operation key=ZGE1860DMGHA tag=8GPOKXO2J63B type=del size=2785618 2024-09-12T17:18:18.189 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.188+0000 7f574d1ea780 1 < completed part key=_multipart_54CM8800AT9V.2~M0F8ZCJ8BV2X.0 size=441780 2024-09-12T17:18:18.191 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.190+0000 7f574d1ea780 1 < completed multipart upload key=54CM8800AT9V upload=M0F8ZCJ8BV2X tag=HK5IQHEPPRIG type=write size=1490356 2024-09-12T17:18:18.192 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.191+0000 7f574d1ea780 1 > prepared operation key=HGZMN894YYC0 tag=CX7WWOKILKMZ type=del size=3426656 2024-09-12T17:18:18.194 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.193+0000 7f574d1ea780 1 < suggested update operation key=ENFNIFHQ3SHW tag=18ACL5IXFY7E type=write size=206684 2024-09-12T17:18:18.196 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.195+0000 7f574d1ea780 1 > prepared part key=_multipart_TIKBUXFPVTN1.2~VT8TUNP4PQQ9.0 size=1048576 2024-09-12T17:18:18.197 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.196+0000 7f574d1ea780 1 > prepared part key=_multipart_TIKBUXFPVTN1.2~VT8TUNP4PQQ9.1 size=827299 2024-09-12T17:18:18.197 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.196+0000 7f574d1ea780 1 > prepared multipart upload key=TIKBUXFPVTN1 upload=VT8TUNP4PQQ9 tag=TY10O5DUJ7VD type=write size=2924451 2024-09-12T17:18:18.198 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.197+0000 7f574d1ea780 1 < completed delete operation key=DH02JGZP64MN tag=0678IF84T9F1 type=del 2024-09-12T17:18:18.201 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.200+0000 7f574d1ea780 1 > prepared part key=_multipart_U6E9A5OH4GUW.2~AD5R9EJYYB2G.0 size=1048576 2024-09-12T17:18:18.201 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.201+0000 7f574d1ea780 1 > prepared part key=_multipart_U6E9A5OH4GUW.2~AD5R9EJYYB2G.1 size=1048576 2024-09-12T17:18:18.202 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.202+0000 7f574d1ea780 1 > prepared part key=_multipart_U6E9A5OH4GUW.2~AD5R9EJYYB2G.2 size=481009 2024-09-12T17:18:18.202 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.202+0000 7f574d1ea780 1 > prepared multipart upload key=U6E9A5OH4GUW upload=AD5R9EJYYB2G tag=7POL7BWPCE89 type=write size=3626737 2024-09-12T17:18:18.204 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.203+0000 7f574d1ea780 1 < completed part key=_multipart_YXIDO0U18839.2~C6PJZ3PIMS7B.0 size=1048576 2024-09-12T17:18:18.205 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.204+0000 7f574d1ea780 1 < completed part key=_multipart_YXIDO0U18839.2~C6PJZ3PIMS7B.1 size=1048576 2024-09-12T17:18:18.205 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.205+0000 7f574d1ea780 1 < completed part key=_multipart_YXIDO0U18839.2~C6PJZ3PIMS7B.2 size=540375 2024-09-12T17:18:18.208 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.207+0000 7f574d1ea780 1 < completed multipart upload key=YXIDO0U18839 upload=C6PJZ3PIMS7B tag=F1KYCPAZPXGV type=write size=3686103 2024-09-12T17:18:18.210 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.209+0000 7f574d1ea780 1 > prepared part key=_multipart_A1TIP3RXHBCZ.2~2ULSU2CDHHQV.0 size=1048576 2024-09-12T17:18:18.210 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.210+0000 7f574d1ea780 1 > prepared part key=_multipart_A1TIP3RXHBCZ.2~2ULSU2CDHHQV.1 size=1048576 2024-09-12T17:18:18.211 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.211+0000 7f574d1ea780 1 > prepared part key=_multipart_A1TIP3RXHBCZ.2~2ULSU2CDHHQV.2 size=755041 2024-09-12T17:18:18.211 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.211+0000 7f574d1ea780 1 > prepared multipart upload key=A1TIP3RXHBCZ upload=2ULSU2CDHHQV tag=TBRLEYEFD7NZ type=write size=3900769 2024-09-12T17:18:18.213 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.212+0000 7f574d1ea780 1 < completed part key=_multipart_8VW3XCUHLF2L.2~L2MPII2YERWP.0 size=705711 2024-09-12T17:18:18.214 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.214+0000 7f574d1ea780 1 < completed multipart upload key=8VW3XCUHLF2L upload=L2MPII2YERWP tag=HAI4HEX9D9BU type=write size=1754287 2024-09-12T17:18:18.216 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.216+0000 7f574d1ea780 1 > prepared part key=_multipart_HGZMN894YYC0.2~SE1625FVCP7Q.0 size=1048576 2024-09-12T17:18:18.217 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.216+0000 7f574d1ea780 1 > prepared part key=_multipart_HGZMN894YYC0.2~SE1625FVCP7Q.1 size=1048576 2024-09-12T17:18:18.218 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.217+0000 7f574d1ea780 1 > prepared part key=_multipart_HGZMN894YYC0.2~SE1625FVCP7Q.2 size=225988 2024-09-12T17:18:18.218 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.217+0000 7f574d1ea780 1 > prepared multipart upload key=HGZMN894YYC0 upload=SE1625FVCP7Q tag=66AVMCD3EJ4E type=write size=3371716 2024-09-12T17:18:18.219 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.218+0000 7f574d1ea780 1 < completed part key=_multipart_Q2Q3B1J3DAVD.2~EDR6WYWUN6DT.0 size=1048576 2024-09-12T17:18:18.220 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.219+0000 7f574d1ea780 1 < completed part key=_multipart_Q2Q3B1J3DAVD.2~EDR6WYWUN6DT.1 size=1048576 2024-09-12T17:18:18.220 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.219+0000 7f574d1ea780 1 < canceled part key=_multipart_Q2Q3B1J3DAVD.2~EDR6WYWUN6DT.2 size=549566 2024-09-12T17:18:18.222 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.221+0000 7f574d1ea780 1 < canceled multipart upload key=Q2Q3B1J3DAVD upload=EDR6WYWUN6DT tag=93KDIAMXRAAK type=write size=3695294 2024-09-12T17:18:18.223 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.223+0000 7f574d1ea780 1 > prepared operation key=55V137SY4E4P tag=28U1OLIGGSAJ type=del size=2814034 2024-09-12T17:18:18.224 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.223+0000 7f574d1ea780 1 < canceled part key=_multipart_GEGOEB05R0PK.2~F4QX2XFMKWQT.0 size=1048576 2024-09-12T17:18:18.225 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.224+0000 7f574d1ea780 1 < completed part key=_multipart_GEGOEB05R0PK.2~F4QX2XFMKWQT.1 size=1039753 2024-09-12T17:18:18.226 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.226+0000 7f574d1ea780 1 < canceled multipart upload key=GEGOEB05R0PK upload=F4QX2XFMKWQT tag=N0YW4631EG5W type=write size=3136905 2024-09-12T17:18:18.229 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.228+0000 7f574d1ea780 1 > prepared part key=_multipart_C9IYR9CET1I8.2~W8P1C89FKF7R.0 size=668383 2024-09-12T17:18:18.229 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.228+0000 7f574d1ea780 1 > prepared multipart upload key=C9IYR9CET1I8 upload=W8P1C89FKF7R tag=FF2ETWBRZUT0 type=write size=1716959 2024-09-12T17:18:18.230 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.229+0000 7f574d1ea780 1 < completed delete operation key=UFKM4I8RMT0W tag=UD4KJSRMK0BT type=del 2024-09-12T17:18:18.232 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.231+0000 7f574d1ea780 1 > prepared part key=_multipart_A1TIP3RXHBCZ.2~35KQV07DOIEA.0 size=236602 2024-09-12T17:18:18.232 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.231+0000 7f574d1ea780 1 > prepared multipart upload key=A1TIP3RXHBCZ upload=35KQV07DOIEA tag=OMG3V59JYLXP type=write size=1285178 2024-09-12T17:18:18.233 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.232+0000 7f574d1ea780 1 < completed part key=_multipart_UFKM4I8RMT0W.2~6OEAZYTQM18J.0 size=1048576 2024-09-12T17:18:18.234 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.233+0000 7f574d1ea780 1 < completed part key=_multipart_UFKM4I8RMT0W.2~6OEAZYTQM18J.1 size=129230 2024-09-12T17:18:18.236 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.235+0000 7f574d1ea780 1 < completed multipart upload key=UFKM4I8RMT0W upload=6OEAZYTQM18J tag=F1OX4MDVACF5 type=write size=2226382 2024-09-12T17:18:18.237 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.236+0000 7f574d1ea780 1 > prepared operation key=VWWA5IB0L4N1 tag=TZ2DB2I709XY type=del size=3537081 2024-09-12T17:18:18.238 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.237+0000 7f574d1ea780 1 < completed write operation key=43GV2N9VBBKE tag=9L5I2THPE9TW type=write size=1041126 2024-09-12T17:18:18.240 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.239+0000 7f574d1ea780 1 > prepared part key=_multipart_43GV2N9VBBKE.2~PPNO47PCEOCZ.0 size=1048576 2024-09-12T17:18:18.241 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.240+0000 7f574d1ea780 1 > prepared part key=_multipart_43GV2N9VBBKE.2~PPNO47PCEOCZ.1 size=109142 2024-09-12T17:18:18.241 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.240+0000 7f574d1ea780 1 > prepared multipart upload key=43GV2N9VBBKE upload=PPNO47PCEOCZ tag=EPN5BKW06SWR type=write size=2206294 2024-09-12T17:18:18.243 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.242+0000 7f574d1ea780 1 < completed part key=_multipart_D1GEG3MKPOM3.2~UDUUX0I3YGPW.0 size=619197 2024-09-12T17:18:18.245 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.244+0000 7f574d1ea780 1 < completed multipart upload key=D1GEG3MKPOM3 upload=UDUUX0I3YGPW tag=JOZF2DHKUEG6 type=write size=1667773 2024-09-12T17:18:18.246 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.245+0000 7f574d1ea780 1 > prepared operation key=54LQ91UMBJAN tag=N96YOXWODI0G type=write size=1034606 2024-09-12T17:18:18.247 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.246+0000 7f574d1ea780 1 < completed part key=_multipart_54LQ91UMBJAN.2~2UMKRL4XEPN8.0 size=324904 2024-09-12T17:18:18.249 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.248+0000 7f574d1ea780 1 < completed multipart upload key=54LQ91UMBJAN upload=2UMKRL4XEPN8 tag=VQUY9TZK6TAD type=write size=1373480 2024-09-12T17:18:18.251 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.250+0000 7f574d1ea780 1 > prepared operation key=RNI86YYLADT0 tag=MO4NKQTSFOYU type=del size=3089281 2024-09-12T17:18:18.252 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.251+0000 7f574d1ea780 1 < completed part key=_multipart_HFWA7DNUMWF2.2~00C7QS7R8W5K.0 size=316782 2024-09-12T17:18:18.254 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.253+0000 7f574d1ea780 1 < completed multipart upload key=HFWA7DNUMWF2 upload=00C7QS7R8W5K tag=DXQM12ERZX70 type=write size=1365358 2024-09-12T17:18:18.257 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.255+0000 7f574d1ea780 1 > prepared part key=_multipart_8SG7DJO4HWPI.2~12SXCF8J6J43.0 size=795829 2024-09-12T17:18:18.257 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.255+0000 7f574d1ea780 1 > prepared multipart upload key=8SG7DJO4HWPI upload=12SXCF8J6J43 tag=101XZE3341UT type=write size=1844405 2024-09-12T17:18:18.257 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.257+0000 7f574d1ea780 1 < completed part key=_multipart_TIKBUXFPVTN1.2~D4V8BABQAI2P.0 size=678626 2024-09-12T17:18:18.260 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.259+0000 7f574d1ea780 1 < completed multipart upload key=TIKBUXFPVTN1 upload=D4V8BABQAI2P tag=EQ8FVRU70YO5 type=write size=1727202 2024-09-12T17:18:18.262 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.262+0000 7f574d1ea780 1 > prepared operation key=UTCKL1F42X8A tag=3C1HVKVEVBWF type=del size=1727651 2024-09-12T17:18:18.264 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.263+0000 7f574d1ea780 1 < completed delete operation key=8VW3XCUHLF2L tag=9TFZUNMISEZB type=del 2024-09-12T17:18:18.265 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.264+0000 7f574d1ea780 1 > prepared operation key=HGZMN894YYC0 tag=MUG82DY88U4C type=write size=955711 2024-09-12T17:18:18.267 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.266+0000 7f574d1ea780 1 < suggested update operation key=ZGE1860DMGHA tag=8GPOKXO2J63B type=del size=2785618 2024-09-12T17:18:18.269 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.268+0000 7f574d1ea780 1 > prepared part key=_multipart_DH02JGZP64MN.2~F89QBXH53F70.0 size=418718 2024-09-12T17:18:18.269 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.268+0000 7f574d1ea780 1 > prepared multipart upload key=DH02JGZP64MN upload=F89QBXH53F70 tag=4ZCP6553KC79 type=write size=1467294 2024-09-12T17:18:18.272 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.271+0000 7f574d1ea780 1 < suggested update operation key=HGZMN894YYC0 tag=CX7WWOKILKMZ type=del size=3426656 2024-09-12T17:18:18.273 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.272+0000 7f574d1ea780 1 > prepared operation key=ENFNIFHQ3SHW tag=ES03H3BFGYE7 type=write size=1003266 2024-09-12T17:18:18.274 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.273+0000 7f574d1ea780 1 < completed part key=_multipart_TIKBUXFPVTN1.2~VT8TUNP4PQQ9.0 size=1048576 2024-09-12T17:18:18.275 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.274+0000 7f574d1ea780 1 < completed part key=_multipart_TIKBUXFPVTN1.2~VT8TUNP4PQQ9.1 size=827299 2024-09-12T17:18:18.277 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.276+0000 7f574d1ea780 1 < completed multipart upload key=TIKBUXFPVTN1 upload=VT8TUNP4PQQ9 tag=TY10O5DUJ7VD type=write size=2924451 2024-09-12T17:18:18.279 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.278+0000 7f574d1ea780 1 > prepared part key=_multipart_ZGH8XC39FGTC.2~2KTQX2MOTRIF.0 size=1048576 2024-09-12T17:18:18.280 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.279+0000 7f574d1ea780 1 > prepared part key=_multipart_ZGH8XC39FGTC.2~2KTQX2MOTRIF.1 size=1048576 2024-09-12T17:18:18.281 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.280+0000 7f574d1ea780 1 > prepared part key=_multipart_ZGH8XC39FGTC.2~2KTQX2MOTRIF.2 size=559685 2024-09-12T17:18:18.281 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.280+0000 7f574d1ea780 1 > prepared multipart upload key=ZGH8XC39FGTC upload=2KTQX2MOTRIF tag=3ZRQ9B5J770L type=write size=3705413 2024-09-12T17:18:18.282 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.281+0000 7f574d1ea780 1 < completed part key=_multipart_U6E9A5OH4GUW.2~AD5R9EJYYB2G.0 size=1048576 2024-09-12T17:18:18.282 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.281+0000 7f574d1ea780 1 < canceled part key=_multipart_U6E9A5OH4GUW.2~AD5R9EJYYB2G.1 size=1048576 2024-09-12T17:18:18.283 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.282+0000 7f574d1ea780 1 < completed part key=_multipart_U6E9A5OH4GUW.2~AD5R9EJYYB2G.2 size=481009 2024-09-12T17:18:18.285 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.284+0000 7f574d1ea780 1 < canceled multipart upload key=U6E9A5OH4GUW upload=AD5R9EJYYB2G tag=7POL7BWPCE89 type=write size=3626737 2024-09-12T17:18:18.287 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.286+0000 7f574d1ea780 1 > prepared operation key=GEGOEB05R0PK tag=DGIZ117Y385L type=write size=61943 2024-09-12T17:18:18.288 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.287+0000 7f574d1ea780 1 < completed part key=_multipart_A1TIP3RXHBCZ.2~2ULSU2CDHHQV.0 size=1048576 2024-09-12T17:18:18.289 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.288+0000 7f574d1ea780 1 < completed part key=_multipart_A1TIP3RXHBCZ.2~2ULSU2CDHHQV.1 size=1048576 2024-09-12T17:18:18.290 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.289+0000 7f574d1ea780 1 < completed part key=_multipart_A1TIP3RXHBCZ.2~2ULSU2CDHHQV.2 size=755041 2024-09-12T17:18:18.292 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.291+0000 7f574d1ea780 1 < completed multipart upload key=A1TIP3RXHBCZ upload=2ULSU2CDHHQV tag=TBRLEYEFD7NZ type=write size=3900769 2024-09-12T17:18:18.294 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.293+0000 7f574d1ea780 1 > prepared part key=_multipart_D1GEG3MKPOM3.2~SMN5RBNBMGRE.0 size=502433 2024-09-12T17:18:18.294 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.293+0000 7f574d1ea780 1 > prepared multipart upload key=D1GEG3MKPOM3 upload=SMN5RBNBMGRE tag=2J1JTL2NMKD5 type=write size=1551009 2024-09-12T17:18:18.295 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.294+0000 7f574d1ea780 1 < completed part key=_multipart_HGZMN894YYC0.2~SE1625FVCP7Q.0 size=1048576 2024-09-12T17:18:18.296 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.295+0000 7f574d1ea780 1 < completed part key=_multipart_HGZMN894YYC0.2~SE1625FVCP7Q.1 size=1048576 2024-09-12T17:18:18.297 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.296+0000 7f574d1ea780 1 < completed part key=_multipart_HGZMN894YYC0.2~SE1625FVCP7Q.2 size=225988 2024-09-12T17:18:18.299 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.298+0000 7f574d1ea780 1 < completed multipart upload key=HGZMN894YYC0 upload=SE1625FVCP7Q tag=66AVMCD3EJ4E type=write size=3371716 2024-09-12T17:18:18.301 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.300+0000 7f574d1ea780 1 > prepared part key=_multipart_U6E9A5OH4GUW.2~9OV1PT1T53S4.0 size=1003802 2024-09-12T17:18:18.301 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.300+0000 7f574d1ea780 1 > prepared multipart upload key=U6E9A5OH4GUW upload=9OV1PT1T53S4 tag=8X6BOHDRIYN6 type=write size=2052378 2024-09-12T17:18:18.302 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.301+0000 7f574d1ea780 1 < canceled operation key=55V137SY4E4P tag=28U1OLIGGSAJ type=del size=2814034 2024-09-12T17:18:18.303 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.303+0000 7f574d1ea780 1 > prepared operation key=8VW3XCUHLF2L tag=JPEJW4XEJNYX type=del size=1944518 2024-09-12T17:18:18.305 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.304+0000 7f574d1ea780 1 < completed part key=_multipart_C9IYR9CET1I8.2~W8P1C89FKF7R.0 size=668383 2024-09-12T17:18:18.307 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.306+0000 7f574d1ea780 1 < completed multipart upload key=C9IYR9CET1I8 upload=W8P1C89FKF7R tag=FF2ETWBRZUT0 type=write size=1716959 2024-09-12T17:18:18.308 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.307+0000 7f574d1ea780 1 > prepared operation key=ENFNIFHQ3SHW tag=AEPFOUXDN6QZ type=del size=2156305 2024-09-12T17:18:18.309 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.308+0000 7f574d1ea780 1 < completed part key=_multipart_A1TIP3RXHBCZ.2~35KQV07DOIEA.0 size=236602 2024-09-12T17:18:18.311 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.310+0000 7f574d1ea780 1 < completed multipart upload key=A1TIP3RXHBCZ upload=35KQV07DOIEA tag=OMG3V59JYLXP type=write size=1285178 2024-09-12T17:18:18.313 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.312+0000 7f574d1ea780 1 > prepared part key=_multipart_55V137SY4E4P.2~V5AUI018L3HT.0 size=1048576 2024-09-12T17:18:18.314 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.313+0000 7f574d1ea780 1 > prepared part key=_multipart_55V137SY4E4P.2~V5AUI018L3HT.1 size=762070 2024-09-12T17:18:18.314 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.313+0000 7f574d1ea780 1 > prepared multipart upload key=55V137SY4E4P upload=V5AUI018L3HT tag=4J2YHP3IS1EO type=write size=2859222 2024-09-12T17:18:18.315 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.314+0000 7f574d1ea780 1 < completed delete operation key=VWWA5IB0L4N1 tag=TZ2DB2I709XY type=del 2024-09-12T17:18:18.317 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.315+0000 7f574d1ea780 1 > prepared operation key=ENFNIFHQ3SHW tag=P0M2L2XWOYLJ type=write size=714383 2024-09-12T17:18:18.317 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.316+0000 7f574d1ea780 1 < canceled part key=_multipart_43GV2N9VBBKE.2~PPNO47PCEOCZ.0 size=1048576 2024-09-12T17:18:18.317 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.317+0000 7f574d1ea780 1 < completed part key=_multipart_43GV2N9VBBKE.2~PPNO47PCEOCZ.1 size=109142 2024-09-12T17:18:18.319 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.319+0000 7f574d1ea780 1 < canceled multipart upload key=43GV2N9VBBKE upload=PPNO47PCEOCZ tag=EPN5BKW06SWR type=write size=2206294 2024-09-12T17:18:18.321 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.320+0000 7f574d1ea780 1 > prepared operation key=55V137SY4E4P tag=GDJEQEATGB7L type=del size=648331 2024-09-12T17:18:18.322 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.321+0000 7f574d1ea780 1 < completed write operation key=54LQ91UMBJAN tag=N96YOXWODI0G type=write size=1034606 2024-09-12T17:18:18.323 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.322+0000 7f574d1ea780 1 > prepared operation key=K12MVG618809 tag=VRXF3MT2L05F type=del size=2573274 2024-09-12T17:18:18.326 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.325+0000 7f574d1ea780 1 < suggested remove operation key=RNI86YYLADT0 tag=MO4NKQTSFOYU type=del 2024-09-12T17:18:18.327 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.326+0000 7f574d1ea780 1 > prepared operation key=A1TIP3RXHBCZ tag=5P1J3WE5SCUD type=write size=504416 2024-09-12T17:18:18.328 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.327+0000 7f574d1ea780 1 < completed part key=_multipart_8SG7DJO4HWPI.2~12SXCF8J6J43.0 size=795829 2024-09-12T17:18:18.330 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.329+0000 7f574d1ea780 1 < completed multipart upload key=8SG7DJO4HWPI upload=12SXCF8J6J43 tag=101XZE3341UT type=write size=1844405 2024-09-12T17:18:18.331 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.330+0000 7f574d1ea780 1 > prepared operation key=TIKBUXFPVTN1 tag=VJ88F0XNPNFE type=del size=537445 2024-09-12T17:18:18.332 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.331+0000 7f574d1ea780 1 < completed delete operation key=UTCKL1F42X8A tag=3C1HVKVEVBWF type=del 2024-09-12T17:18:18.335 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.334+0000 7f574d1ea780 1 > prepared part key=_multipart_YXIDO0U18839.2~L6LUBUF5S1EX.0 size=247154 2024-09-12T17:18:18.335 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.334+0000 7f574d1ea780 1 > prepared multipart upload key=YXIDO0U18839 upload=L6LUBUF5S1EX tag=D3YW33LBAYWT type=write size=1295730 2024-09-12T17:18:18.336 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.335+0000 7f574d1ea780 -1 < failed to complete operation key=HGZMN894YYC0 tag=MUG82DY88U4C type=write size=955711: (22) Invalid argument 2024-09-12T17:18:18.337 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.336+0000 7f574d1ea780 1 > prepared operation key=7BX38Q7723EB tag=LZWLQTKFYM2G type=del size=265438 2024-09-12T17:18:18.338 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.337+0000 7f574d1ea780 1 < completed part key=_multipart_DH02JGZP64MN.2~F89QBXH53F70.0 size=418718 2024-09-12T17:18:18.341 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.340+0000 7f574d1ea780 1 < completed multipart upload key=DH02JGZP64MN upload=F89QBXH53F70 tag=4ZCP6553KC79 type=write size=1467294 2024-09-12T17:18:18.342 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.341+0000 7f574d1ea780 1 > prepared operation key=U6E9A5OH4GUW tag=DE6YZOGO518C type=del size=2567354 2024-09-12T17:18:18.343 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.342+0000 7f574d1ea780 1 < completed write operation key=ENFNIFHQ3SHW tag=ES03H3BFGYE7 type=write size=1003266 2024-09-12T17:18:18.344 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.344+0000 7f574d1ea780 1 > prepared operation key=55V137SY4E4P tag=V87QB21RMPE2 type=del size=874631 2024-09-12T17:18:18.346 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.345+0000 7f574d1ea780 1 < completed part key=_multipart_ZGH8XC39FGTC.2~2KTQX2MOTRIF.0 size=1048576 2024-09-12T17:18:18.347 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.346+0000 7f574d1ea780 1 < completed part key=_multipart_ZGH8XC39FGTC.2~2KTQX2MOTRIF.1 size=1048576 2024-09-12T17:18:18.348 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.347+0000 7f574d1ea780 1 < completed part key=_multipart_ZGH8XC39FGTC.2~2KTQX2MOTRIF.2 size=559685 2024-09-12T17:18:18.350 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.349+0000 7f574d1ea780 1 < completed multipart upload key=ZGH8XC39FGTC upload=2KTQX2MOTRIF tag=3ZRQ9B5J770L type=write size=3705413 2024-09-12T17:18:18.351 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.350+0000 7f574d1ea780 1 > prepared operation key=8SG7DJO4HWPI tag=LDV0AAKMQ6IB type=del size=4116562 2024-09-12T17:18:18.354 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.353+0000 7f574d1ea780 1 < suggested remove operation key=GEGOEB05R0PK tag=DGIZ117Y385L type=write 2024-09-12T17:18:18.355 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.354+0000 7f574d1ea780 1 > prepared operation key=HGZMN894YYC0 tag=HRMQF7KQ8I89 type=write size=194390 2024-09-12T17:18:18.357 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.356+0000 7f574d1ea780 1 < completed part key=_multipart_D1GEG3MKPOM3.2~SMN5RBNBMGRE.0 size=502433 2024-09-12T17:18:18.358 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.357+0000 7f574d1ea780 1 < completed multipart upload key=D1GEG3MKPOM3 upload=SMN5RBNBMGRE tag=2J1JTL2NMKD5 type=write size=1551009 2024-09-12T17:18:18.360 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.359+0000 7f574d1ea780 1 > prepared operation key=DH02JGZP64MN tag=42VG4QNGQTNZ type=del size=2047994 2024-09-12T17:18:18.361 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.360+0000 7f574d1ea780 1 < completed part key=_multipart_U6E9A5OH4GUW.2~9OV1PT1T53S4.0 size=1003802 2024-09-12T17:18:18.364 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.363+0000 7f574d1ea780 1 < completed multipart upload key=U6E9A5OH4GUW upload=9OV1PT1T53S4 tag=8X6BOHDRIYN6 type=write size=2052378 2024-09-12T17:18:18.366 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.365+0000 7f574d1ea780 1 > prepared operation key=YXIDO0U18839 tag=KY1WTQKY90C3 type=write size=642665 2024-09-12T17:18:18.368 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.367+0000 7f574d1ea780 1 < suggested update operation key=8VW3XCUHLF2L tag=JPEJW4XEJNYX type=del size=1944518 2024-09-12T17:18:18.370 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.369+0000 7f574d1ea780 1 > prepared part key=_multipart_VWWA5IB0L4N1.2~6KJOTUY4K33W.0 size=1048576 2024-09-12T17:18:18.371 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.370+0000 7f574d1ea780 1 > prepared part key=_multipart_VWWA5IB0L4N1.2~6KJOTUY4K33W.1 size=171458 2024-09-12T17:18:18.371 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.370+0000 7f574d1ea780 1 > prepared multipart upload key=VWWA5IB0L4N1 upload=6KJOTUY4K33W tag=VVEQQ6XELCTW type=write size=2268610 2024-09-12T17:18:18.372 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.371+0000 7f574d1ea780 1 < completed delete operation key=ENFNIFHQ3SHW tag=AEPFOUXDN6QZ type=del 2024-09-12T17:18:18.373 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.373+0000 7f574d1ea780 1 > prepared operation key=U6E9A5OH4GUW tag=MBZYBINZWSRO type=write size=1007330 2024-09-12T17:18:18.375 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.374+0000 7f574d1ea780 1 < completed part key=_multipart_55V137SY4E4P.2~V5AUI018L3HT.0 size=1048576 2024-09-12T17:18:18.377 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.376+0000 7f574d1ea780 1 < completed part key=_multipart_55V137SY4E4P.2~V5AUI018L3HT.1 size=762070 2024-09-12T17:18:18.380 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.379+0000 7f574d1ea780 1 < completed multipart upload key=55V137SY4E4P upload=V5AUI018L3HT tag=4J2YHP3IS1EO type=write size=2859222 2024-09-12T17:18:18.382 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.382+0000 7f574d1ea780 1 > prepared part key=_multipart_UFKM4I8RMT0W.2~VHBAPKWUZ9H2.0 size=1048576 2024-09-12T17:18:18.383 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.383+0000 7f574d1ea780 1 > prepared part key=_multipart_UFKM4I8RMT0W.2~VHBAPKWUZ9H2.1 size=847762 2024-09-12T17:18:18.383 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.383+0000 7f574d1ea780 1 > prepared multipart upload key=UFKM4I8RMT0W upload=VHBAPKWUZ9H2 tag=JFLAT3GI9150 type=write size=2944914 2024-09-12T17:18:18.385 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.384+0000 7f574d1ea780 1 < completed write operation key=ENFNIFHQ3SHW tag=P0M2L2XWOYLJ type=write size=714383 2024-09-12T17:18:18.386 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.385+0000 7f574d1ea780 1 > prepared operation key=SQQMJ61CA0QW tag=PSR3VVOKIRSQ type=del size=2451868 2024-09-12T17:18:18.387 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.386+0000 7f574d1ea780 1 < completed delete operation key=55V137SY4E4P tag=GDJEQEATGB7L type=del 2024-09-12T17:18:18.388 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.387+0000 7f574d1ea780 1 > prepared operation key=ENFNIFHQ3SHW tag=YL1A88MALDJC type=del size=1016844 2024-09-12T17:18:18.389 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.388+0000 7f574d1ea780 1 < completed delete operation key=K12MVG618809 tag=VRXF3MT2L05F type=del 2024-09-12T17:18:18.390 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.390+0000 7f574d1ea780 1 > prepared operation key=SQQMJ61CA0QW tag=XVBEIMPZBW8Z type=write size=1044496 2024-09-12T17:18:18.393 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.392+0000 7f574d1ea780 1 < suggested remove operation key=A1TIP3RXHBCZ tag=5P1J3WE5SCUD type=write 2024-09-12T17:18:18.395 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.394+0000 7f574d1ea780 1 > prepared part key=_multipart_7BX38Q7723EB.2~HIBX5NHLPDW8.0 size=1048576 2024-09-12T17:18:18.396 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.395+0000 7f574d1ea780 1 > prepared part key=_multipart_7BX38Q7723EB.2~HIBX5NHLPDW8.1 size=579140 2024-09-12T17:18:18.396 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.395+0000 7f574d1ea780 1 > prepared multipart upload key=7BX38Q7723EB upload=HIBX5NHLPDW8 tag=BYLRHLB15KV8 type=write size=2676292 2024-09-12T17:18:18.398 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.397+0000 7f574d1ea780 1 < suggested remove operation key=TIKBUXFPVTN1 tag=VJ88F0XNPNFE type=del 2024-09-12T17:18:18.400 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.399+0000 7f574d1ea780 1 > prepared part key=_multipart_C9IYR9CET1I8.2~6F18NLXDN3D5.0 size=1048576 2024-09-12T17:18:18.401 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.400+0000 7f574d1ea780 1 > prepared part key=_multipart_C9IYR9CET1I8.2~6F18NLXDN3D5.1 size=1048576 2024-09-12T17:18:18.402 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.401+0000 7f574d1ea780 1 > prepared part key=_multipart_C9IYR9CET1I8.2~6F18NLXDN3D5.2 size=348503 2024-09-12T17:18:18.402 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.401+0000 7f574d1ea780 1 > prepared multipart upload key=C9IYR9CET1I8 upload=6F18NLXDN3D5 tag=A10MTMQBD7OJ type=write size=3494231 2024-09-12T17:18:18.403 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.402+0000 7f574d1ea780 1 < completed part key=_multipart_YXIDO0U18839.2~L6LUBUF5S1EX.0 size=247154 2024-09-12T17:18:18.405 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.404+0000 7f574d1ea780 1 < completed multipart upload key=YXIDO0U18839 upload=L6LUBUF5S1EX tag=D3YW33LBAYWT type=write size=1295730 2024-09-12T17:18:18.407 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.406+0000 7f574d1ea780 1 > prepared part key=_multipart_54LQ91UMBJAN.2~1GHUI5AZELN4.0 size=1048576 2024-09-12T17:18:18.408 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.407+0000 7f574d1ea780 1 > prepared part key=_multipart_54LQ91UMBJAN.2~1GHUI5AZELN4.1 size=1048576 2024-09-12T17:18:18.409 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.409+0000 7f574d1ea780 1 > prepared part key=_multipart_54LQ91UMBJAN.2~1GHUI5AZELN4.2 size=274671 2024-09-12T17:18:18.409 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.409+0000 7f574d1ea780 1 > prepared multipart upload key=54LQ91UMBJAN upload=1GHUI5AZELN4 tag=R6UVQFMX18GU type=write size=3420399 2024-09-12T17:18:18.412 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.411+0000 7f574d1ea780 1 < suggested update operation key=7BX38Q7723EB tag=LZWLQTKFYM2G type=del size=265438 2024-09-12T17:18:18.414 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.413+0000 7f574d1ea780 1 > prepared operation key=HGZMN894YYC0 tag=0U85AUNM20K4 type=write size=145032 2024-09-12T17:18:18.415 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.414+0000 7f574d1ea780 1 < canceled operation key=U6E9A5OH4GUW tag=DE6YZOGO518C type=del size=2567354 2024-09-12T17:18:18.417 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.416+0000 7f574d1ea780 1 > prepared operation key=HGZMN894YYC0 tag=42N2K5W5CKF8 type=del size=1400873 2024-09-12T17:18:18.418 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.417+0000 7f574d1ea780 1 < completed delete operation key=55V137SY4E4P tag=V87QB21RMPE2 type=del 2024-09-12T17:18:18.419 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.418+0000 7f574d1ea780 1 > prepared operation key=YXIDO0U18839 tag=WZS01BF33XZN type=write size=1006229 2024-09-12T17:18:18.422 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.421+0000 7f574d1ea780 1 < suggested update operation key=8SG7DJO4HWPI tag=LDV0AAKMQ6IB type=del size=4116562 2024-09-12T17:18:18.423 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.422+0000 7f574d1ea780 1 > prepared operation key=Q2Q3B1J3DAVD tag=G19TTGM8GCVJ type=write size=725140 2024-09-12T17:18:18.424 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.423+0000 7f574d1ea780 1 < canceled operation key=HGZMN894YYC0 tag=HRMQF7KQ8I89 type=write size=194390 2024-09-12T17:18:18.425 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.425+0000 7f574d1ea780 1 > prepared operation key=55V137SY4E4P tag=DCW3CF8P02QG type=del size=1969219 2024-09-12T17:18:18.427 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.426+0000 7f574d1ea780 1 < completed delete operation key=DH02JGZP64MN tag=42VG4QNGQTNZ type=del 2024-09-12T17:18:18.429 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.428+0000 7f574d1ea780 1 > prepared part key=_multipart_HGZMN894YYC0.2~27G9YOJQXE75.0 size=1048576 2024-09-12T17:18:18.430 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.429+0000 7f574d1ea780 1 > prepared part key=_multipart_HGZMN894YYC0.2~27G9YOJQXE75.1 size=769464 2024-09-12T17:18:18.430 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.429+0000 7f574d1ea780 1 > prepared multipart upload key=HGZMN894YYC0 upload=27G9YOJQXE75 tag=NZS3VRWEIIRS type=write size=2866616 2024-09-12T17:18:18.431 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.430+0000 7f574d1ea780 1 < completed write operation key=YXIDO0U18839 tag=KY1WTQKY90C3 type=write size=642665 2024-09-12T17:18:18.433 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.432+0000 7f574d1ea780 1 > prepared operation key=VWWA5IB0L4N1 tag=0ZQ3D8ER45TF type=write size=731181 2024-09-12T17:18:18.434 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.433+0000 7f574d1ea780 1 < completed part key=_multipart_VWWA5IB0L4N1.2~6KJOTUY4K33W.0 size=1048576 2024-09-12T17:18:18.435 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.434+0000 7f574d1ea780 1 < completed part key=_multipart_VWWA5IB0L4N1.2~6KJOTUY4K33W.1 size=171458 2024-09-12T17:18:18.437 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.436+0000 7f574d1ea780 1 < completed multipart upload key=VWWA5IB0L4N1 upload=6KJOTUY4K33W tag=VVEQQ6XELCTW type=write size=2268610 2024-09-12T17:18:18.438 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.437+0000 7f574d1ea780 1 > prepared operation key=55V137SY4E4P tag=8CW4TB78E2GV type=del size=2183287 2024-09-12T17:18:18.440 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.439+0000 7f574d1ea780 1 < completed write operation key=U6E9A5OH4GUW tag=MBZYBINZWSRO type=write size=1007330 2024-09-12T17:18:18.442 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.441+0000 7f574d1ea780 1 > prepared part key=_multipart_55JI541K1WP2.2~4L27QLIZSVSD.0 size=1048576 2024-09-12T17:18:18.443 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.442+0000 7f574d1ea780 1 > prepared part key=_multipart_55JI541K1WP2.2~4L27QLIZSVSD.1 size=1048576 2024-09-12T17:18:18.444 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.443+0000 7f574d1ea780 1 > prepared part key=_multipart_55JI541K1WP2.2~4L27QLIZSVSD.2 size=200698 2024-09-12T17:18:18.444 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.443+0000 7f574d1ea780 1 > prepared multipart upload key=55JI541K1WP2 upload=4L27QLIZSVSD tag=IFPTNK2H8B8H type=write size=3346426 2024-09-12T17:18:18.445 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.444+0000 7f574d1ea780 1 < completed part key=_multipart_UFKM4I8RMT0W.2~VHBAPKWUZ9H2.0 size=1048576 2024-09-12T17:18:18.446 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.446+0000 7f574d1ea780 1 < completed part key=_multipart_UFKM4I8RMT0W.2~VHBAPKWUZ9H2.1 size=847762 2024-09-12T17:18:18.449 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.448+0000 7f574d1ea780 1 < completed multipart upload key=UFKM4I8RMT0W upload=VHBAPKWUZ9H2 tag=JFLAT3GI9150 type=write size=2944914 2024-09-12T17:18:18.450 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.450+0000 7f574d1ea780 1 > prepared operation key=HFWA7DNUMWF2 tag=ZTILDM7LNGYE type=del size=1718760 2024-09-12T17:18:18.452 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.451+0000 7f574d1ea780 1 < completed delete operation key=SQQMJ61CA0QW tag=PSR3VVOKIRSQ type=del 2024-09-12T17:18:18.454 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.453+0000 7f574d1ea780 1 > prepared part key=_multipart_R00F69ON5P6Z.2~9K6VWZF3YH16.0 size=1048576 2024-09-12T17:18:18.455 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.455+0000 7f574d1ea780 1 > prepared part key=_multipart_R00F69ON5P6Z.2~9K6VWZF3YH16.1 size=147382 2024-09-12T17:18:18.456 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.455+0000 7f574d1ea780 1 > prepared multipart upload key=R00F69ON5P6Z upload=9K6VWZF3YH16 tag=2696PFGJI6CX type=write size=2244534 2024-09-12T17:18:18.458 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.456+0000 7f574d1ea780 1 < completed delete operation key=ENFNIFHQ3SHW tag=YL1A88MALDJC type=del 2024-09-12T17:18:18.459 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.458+0000 7f574d1ea780 1 > prepared operation key=RWVWJHVZE95H tag=RQR5PX2UXTMF type=del size=2803540 2024-09-12T17:18:18.461 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.460+0000 7f574d1ea780 1 < suggested update operation key=SQQMJ61CA0QW tag=XVBEIMPZBW8Z type=write size=1044496 2024-09-12T17:18:18.464 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.463+0000 7f574d1ea780 1 > prepared part key=_multipart_43GV2N9VBBKE.2~TYFQ071PNZ3X.0 size=1048576 2024-09-12T17:18:18.465 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.464+0000 7f574d1ea780 1 > prepared part key=_multipart_43GV2N9VBBKE.2~TYFQ071PNZ3X.1 size=1048576 2024-09-12T17:18:18.466 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.465+0000 7f574d1ea780 1 > prepared part key=_multipart_43GV2N9VBBKE.2~TYFQ071PNZ3X.2 size=590041 2024-09-12T17:18:18.466 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.465+0000 7f574d1ea780 1 > prepared multipart upload key=43GV2N9VBBKE upload=TYFQ071PNZ3X tag=EJUAF0T035MM type=write size=3735769 2024-09-12T17:18:18.467 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.466+0000 7f574d1ea780 1 < completed part key=_multipart_7BX38Q7723EB.2~HIBX5NHLPDW8.0 size=1048576 2024-09-12T17:18:18.468 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.467+0000 7f574d1ea780 1 < completed part key=_multipart_7BX38Q7723EB.2~HIBX5NHLPDW8.1 size=579140 2024-09-12T17:18:18.470 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.469+0000 7f574d1ea780 1 < completed multipart upload key=7BX38Q7723EB upload=HIBX5NHLPDW8 tag=BYLRHLB15KV8 type=write size=2676292 2024-09-12T17:18:18.473 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.472+0000 7f574d1ea780 1 > prepared part key=_multipart_K12MVG618809.2~NOYFSUR9WNX5.0 size=836670 2024-09-12T17:18:18.473 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.472+0000 7f574d1ea780 1 > prepared multipart upload key=K12MVG618809 upload=NOYFSUR9WNX5 tag=AOVVJOR6JV20 type=write size=1885246 2024-09-12T17:18:18.474 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.473+0000 7f574d1ea780 1 < completed part key=_multipart_C9IYR9CET1I8.2~6F18NLXDN3D5.0 size=1048576 2024-09-12T17:18:18.475 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.474+0000 7f574d1ea780 1 < completed part key=_multipart_C9IYR9CET1I8.2~6F18NLXDN3D5.1 size=1048576 2024-09-12T17:18:18.476 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.475+0000 7f574d1ea780 1 < completed part key=_multipart_C9IYR9CET1I8.2~6F18NLXDN3D5.2 size=348503 2024-09-12T17:18:18.478 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.477+0000 7f574d1ea780 1 < completed multipart upload key=C9IYR9CET1I8 upload=6F18NLXDN3D5 tag=A10MTMQBD7OJ type=write size=3494231 2024-09-12T17:18:18.479 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.478+0000 7f574d1ea780 1 > prepared operation key=SQQMJ61CA0QW tag=827FUZOXW30V type=del size=3726726 2024-09-12T17:18:18.481 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.480+0000 7f574d1ea780 1 < completed part key=_multipart_54LQ91UMBJAN.2~1GHUI5AZELN4.0 size=1048576 2024-09-12T17:18:18.482 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.481+0000 7f574d1ea780 1 < completed part key=_multipart_54LQ91UMBJAN.2~1GHUI5AZELN4.1 size=1048576 2024-09-12T17:18:18.482 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.482+0000 7f574d1ea780 1 < completed part key=_multipart_54LQ91UMBJAN.2~1GHUI5AZELN4.2 size=274671 2024-09-12T17:18:18.485 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.484+0000 7f574d1ea780 1 < completed multipart upload key=54LQ91UMBJAN upload=1GHUI5AZELN4 tag=R6UVQFMX18GU type=write size=3420399 2024-09-12T17:18:18.487 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.486+0000 7f574d1ea780 1 > prepared part key=_multipart_HFWA7DNUMWF2.2~9SA1V1LZMJO6.0 size=1048576 2024-09-12T17:18:18.488 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.487+0000 7f574d1ea780 1 > prepared part key=_multipart_HFWA7DNUMWF2.2~9SA1V1LZMJO6.1 size=1048576 2024-09-12T17:18:18.489 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.488+0000 7f574d1ea780 1 > prepared part key=_multipart_HFWA7DNUMWF2.2~9SA1V1LZMJO6.2 size=733615 2024-09-12T17:18:18.489 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.488+0000 7f574d1ea780 1 > prepared multipart upload key=HFWA7DNUMWF2 upload=9SA1V1LZMJO6 tag=0NGBTY0B0AGS type=write size=3879343 2024-09-12T17:18:18.490 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.489+0000 7f574d1ea780 1 < completed write operation key=HGZMN894YYC0 tag=0U85AUNM20K4 type=write size=145032 2024-09-12T17:18:18.491 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.491+0000 7f574d1ea780 1 > prepared operation key=DH02JGZP64MN tag=L806ATBZS0ER type=write size=302746 2024-09-12T17:18:18.493 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.492+0000 7f574d1ea780 1 < completed delete operation key=HGZMN894YYC0 tag=42N2K5W5CKF8 type=del 2024-09-12T17:18:18.494 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.494+0000 7f574d1ea780 1 > prepared operation key=Q2Q3B1J3DAVD tag=E640U3T1Z2Z5 type=del size=2265540 2024-09-12T17:18:18.497 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.496+0000 7f574d1ea780 1 < completed write operation key=YXIDO0U18839 tag=WZS01BF33XZN type=write size=1006229 2024-09-12T17:18:18.499 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.499+0000 7f574d1ea780 1 > prepared part key=_multipart_ZGE1860DMGHA.2~E9SCVYYA2KPN.0 size=1048576 2024-09-12T17:18:18.500 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.500+0000 7f574d1ea780 1 > prepared part key=_multipart_ZGE1860DMGHA.2~E9SCVYYA2KPN.1 size=1048576 2024-09-12T17:18:18.501 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.501+0000 7f574d1ea780 1 > prepared part key=_multipart_ZGE1860DMGHA.2~E9SCVYYA2KPN.2 size=530293 2024-09-12T17:18:18.501 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.501+0000 7f574d1ea780 1 > prepared multipart upload key=ZGE1860DMGHA upload=E9SCVYYA2KPN tag=WEKPXVZ6QGPM type=write size=3676021 2024-09-12T17:18:18.502 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.502+0000 7f574d1ea780 1 < completed write operation key=Q2Q3B1J3DAVD tag=G19TTGM8GCVJ type=write size=725140 2024-09-12T17:18:18.504 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.503+0000 7f574d1ea780 1 > prepared operation key=8VW3XCUHLF2L tag=3ALGOAAB1RV5 type=del size=3277841 2024-09-12T17:18:18.505 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.504+0000 7f574d1ea780 1 < completed delete operation key=55V137SY4E4P tag=DCW3CF8P02QG type=del 2024-09-12T17:18:18.506 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.505+0000 7f574d1ea780 1 > prepared operation key=8SG7DJO4HWPI tag=CY20X4SVUUXG type=del size=3640269 2024-09-12T17:18:18.507 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.507+0000 7f574d1ea780 1 < completed part key=_multipart_HGZMN894YYC0.2~27G9YOJQXE75.0 size=1048576 2024-09-12T17:18:18.508 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.508+0000 7f574d1ea780 1 < completed part key=_multipart_HGZMN894YYC0.2~27G9YOJQXE75.1 size=769464 2024-09-12T17:18:18.510 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.510+0000 7f574d1ea780 1 < completed multipart upload key=HGZMN894YYC0 upload=27G9YOJQXE75 tag=NZS3VRWEIIRS type=write size=2866616 2024-09-12T17:18:18.512 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.511+0000 7f574d1ea780 1 > prepared operation key=OI51GO639LFK tag=DDVWEP4EU1QM type=del size=2312619 2024-09-12T17:18:18.513 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.512+0000 7f574d1ea780 1 < completed write operation key=VWWA5IB0L4N1 tag=0ZQ3D8ER45TF type=write size=731181 2024-09-12T17:18:18.514 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.513+0000 7f574d1ea780 1 > prepared operation key=DH02JGZP64MN tag=CPZ44D1IXRO1 type=write size=645063 2024-09-12T17:18:18.515 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.514+0000 7f574d1ea780 1 < completed delete operation key=55V137SY4E4P tag=8CW4TB78E2GV type=del 2024-09-12T17:18:18.518 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.517+0000 7f574d1ea780 1 > prepared part key=_multipart_OI51GO639LFK.2~EFSHL9J7J6TH.0 size=964321 2024-09-12T17:18:18.518 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.517+0000 7f574d1ea780 1 > prepared multipart upload key=OI51GO639LFK upload=EFSHL9J7J6TH tag=9X1POEOM7MIA type=write size=2012897 2024-09-12T17:18:18.519 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.518+0000 7f574d1ea780 1 < completed part key=_multipart_55JI541K1WP2.2~4L27QLIZSVSD.0 size=1048576 2024-09-12T17:18:18.520 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.519+0000 7f574d1ea780 1 < completed part key=_multipart_55JI541K1WP2.2~4L27QLIZSVSD.1 size=1048576 2024-09-12T17:18:18.521 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.520+0000 7f574d1ea780 1 < completed part key=_multipart_55JI541K1WP2.2~4L27QLIZSVSD.2 size=200698 2024-09-12T17:18:18.523 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.522+0000 7f574d1ea780 1 < completed multipart upload key=55JI541K1WP2 upload=4L27QLIZSVSD tag=IFPTNK2H8B8H type=write size=3346426 2024-09-12T17:18:18.525 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.524+0000 7f574d1ea780 1 > prepared part key=_multipart_55V137SY4E4P.2~94AHI02XNQAS.0 size=126956 2024-09-12T17:18:18.525 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.524+0000 7f574d1ea780 1 > prepared multipart upload key=55V137SY4E4P upload=94AHI02XNQAS tag=ALYSX9AV2KOY type=write size=1175532 2024-09-12T17:18:18.527 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.526+0000 7f574d1ea780 1 < suggested remove operation key=HFWA7DNUMWF2 tag=ZTILDM7LNGYE type=del 2024-09-12T17:18:18.529 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.529+0000 7f574d1ea780 1 > prepared part key=_multipart_ZGH8XC39FGTC.2~KPIUGCBXG28I.0 size=850734 2024-09-12T17:18:18.530 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.529+0000 7f574d1ea780 1 > prepared multipart upload key=ZGH8XC39FGTC upload=KPIUGCBXG28I tag=ELE3MLYNWVMG type=write size=1899310 2024-09-12T17:18:18.531 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.530+0000 7f574d1ea780 1 < completed part key=_multipart_R00F69ON5P6Z.2~9K6VWZF3YH16.0 size=1048576 2024-09-12T17:18:18.532 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.531+0000 7f574d1ea780 1 < completed part key=_multipart_R00F69ON5P6Z.2~9K6VWZF3YH16.1 size=147382 2024-09-12T17:18:18.534 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.533+0000 7f574d1ea780 1 < completed multipart upload key=R00F69ON5P6Z upload=9K6VWZF3YH16 tag=2696PFGJI6CX type=write size=2244534 2024-09-12T17:18:18.535 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.534+0000 7f574d1ea780 1 > prepared operation key=VWWA5IB0L4N1 tag=Q2WODMW13XLE type=del size=2903298 2024-09-12T17:18:18.536 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.536+0000 7f574d1ea780 1 < canceled operation key=RWVWJHVZE95H tag=RQR5PX2UXTMF type=del size=2803540 2024-09-12T17:18:18.538 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.537+0000 7f574d1ea780 1 > prepared operation key=QXD8UG2K4STQ tag=C5RFF5P4KTJY type=del size=727312 2024-09-12T17:18:18.539 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.538+0000 7f574d1ea780 1 < completed part key=_multipart_43GV2N9VBBKE.2~TYFQ071PNZ3X.0 size=1048576 2024-09-12T17:18:18.540 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.539+0000 7f574d1ea780 1 < completed part key=_multipart_43GV2N9VBBKE.2~TYFQ071PNZ3X.1 size=1048576 2024-09-12T17:18:18.541 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.540+0000 7f574d1ea780 1 < completed part key=_multipart_43GV2N9VBBKE.2~TYFQ071PNZ3X.2 size=590041 2024-09-12T17:18:18.543 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.542+0000 7f574d1ea780 1 < completed multipart upload key=43GV2N9VBBKE upload=TYFQ071PNZ3X tag=EJUAF0T035MM type=write size=3735769 2024-09-12T17:18:18.546 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.545+0000 7f574d1ea780 1 > prepared part key=_multipart_Q2Q3B1J3DAVD.2~PQ5FS6W7BIDF.0 size=837296 2024-09-12T17:18:18.546 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.545+0000 7f574d1ea780 1 > prepared multipart upload key=Q2Q3B1J3DAVD upload=PQ5FS6W7BIDF tag=7A0L90LZXIBM type=write size=1885872 2024-09-12T17:18:18.547 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.547+0000 7f574d1ea780 1 < completed part key=_multipart_K12MVG618809.2~NOYFSUR9WNX5.0 size=836670 2024-09-12T17:18:18.549 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.549+0000 7f574d1ea780 1 < completed multipart upload key=K12MVG618809 upload=NOYFSUR9WNX5 tag=AOVVJOR6JV20 type=write size=1885246 2024-09-12T17:18:18.552 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.551+0000 7f574d1ea780 1 > prepared part key=_multipart_K12MVG618809.2~29X2NAVE45DK.0 size=1048576 2024-09-12T17:18:18.553 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.552+0000 7f574d1ea780 1 > prepared part key=_multipart_K12MVG618809.2~29X2NAVE45DK.1 size=454819 2024-09-12T17:18:18.553 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.552+0000 7f574d1ea780 1 > prepared multipart upload key=K12MVG618809 upload=29X2NAVE45DK tag=FU636I5RMHK0 type=write size=2551971 2024-09-12T17:18:18.554 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.553+0000 7f574d1ea780 1 < canceled operation key=SQQMJ61CA0QW tag=827FUZOXW30V type=del size=3726726 2024-09-12T17:18:18.555 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.554+0000 7f574d1ea780 1 > prepared operation key=TIKBUXFPVTN1 tag=83WC1WESKYS1 type=del size=2030044 2024-09-12T17:18:18.556 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.556+0000 7f574d1ea780 1 < completed part key=_multipart_HFWA7DNUMWF2.2~9SA1V1LZMJO6.0 size=1048576 2024-09-12T17:18:18.557 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.557+0000 7f574d1ea780 1 < completed part key=_multipart_HFWA7DNUMWF2.2~9SA1V1LZMJO6.1 size=1048576 2024-09-12T17:18:18.559 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.558+0000 7f574d1ea780 1 < completed part key=_multipart_HFWA7DNUMWF2.2~9SA1V1LZMJO6.2 size=733615 2024-09-12T17:18:18.561 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.560+0000 7f574d1ea780 1 < completed multipart upload key=HFWA7DNUMWF2 upload=9SA1V1LZMJO6 tag=0NGBTY0B0AGS type=write size=3879343 2024-09-12T17:18:18.563 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.563+0000 7f574d1ea780 1 > prepared part key=_multipart_8SG7DJO4HWPI.2~3D3MNLMGVHY6.0 size=1048576 2024-09-12T17:18:18.565 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.564+0000 7f574d1ea780 1 > prepared part key=_multipart_8SG7DJO4HWPI.2~3D3MNLMGVHY6.1 size=1048576 2024-09-12T17:18:18.566 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.565+0000 7f574d1ea780 1 > prepared part key=_multipart_8SG7DJO4HWPI.2~3D3MNLMGVHY6.2 size=894608 2024-09-12T17:18:18.566 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.565+0000 7f574d1ea780 1 > prepared multipart upload key=8SG7DJO4HWPI upload=3D3MNLMGVHY6 tag=L2ZBJ7DD6TIA type=write size=4040336 2024-09-12T17:18:18.567 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.566+0000 7f574d1ea780 1 < completed write operation key=DH02JGZP64MN tag=L806ATBZS0ER type=write size=302746 2024-09-12T17:18:18.569 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.568+0000 7f574d1ea780 1 > prepared part key=_multipart_K12MVG618809.2~O2LPF5ZDJKM6.0 size=1048576 2024-09-12T17:18:18.570 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.569+0000 7f574d1ea780 1 > prepared part key=_multipart_K12MVG618809.2~O2LPF5ZDJKM6.1 size=158530 2024-09-12T17:18:18.570 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.570+0000 7f574d1ea780 1 > prepared multipart upload key=K12MVG618809 upload=O2LPF5ZDJKM6 tag=EALYE602SERB type=write size=2255682 2024-09-12T17:18:18.572 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.571+0000 7f574d1ea780 1 < canceled operation key=Q2Q3B1J3DAVD tag=E640U3T1Z2Z5 type=del size=2265540 2024-09-12T17:18:18.573 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.572+0000 7f574d1ea780 1 > prepared operation key=R00F69ON5P6Z tag=ZD2RTTL6H9VL type=del size=511606 2024-09-12T17:18:18.573 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.572+0000 7f574d1ea780 1 < canceled part key=_multipart_ZGE1860DMGHA.2~E9SCVYYA2KPN.0 size=1048576 2024-09-12T17:18:18.573 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.572+0000 7f574d1ea780 1 < canceled part key=_multipart_ZGE1860DMGHA.2~E9SCVYYA2KPN.1 size=1048576 2024-09-12T17:18:18.574 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.573+0000 7f574d1ea780 1 < completed part key=_multipart_ZGE1860DMGHA.2~E9SCVYYA2KPN.2 size=530293 2024-09-12T17:18:18.576 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.575+0000 7f574d1ea780 1 < canceled multipart upload key=ZGE1860DMGHA upload=E9SCVYYA2KPN tag=WEKPXVZ6QGPM type=write size=3676021 2024-09-12T17:18:18.578 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.578+0000 7f574d1ea780 1 > prepared part key=_multipart_D1GEG3MKPOM3.2~187GSF25UIES.0 size=1048576 2024-09-12T17:18:18.580 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.579+0000 7f574d1ea780 1 > prepared part key=_multipart_D1GEG3MKPOM3.2~187GSF25UIES.1 size=188407 2024-09-12T17:18:18.580 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.579+0000 7f574d1ea780 1 > prepared multipart upload key=D1GEG3MKPOM3 upload=187GSF25UIES tag=YG3XZAUAT0YX type=write size=2285559 2024-09-12T17:18:18.581 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.581+0000 7f574d1ea780 1 < completed delete operation key=8VW3XCUHLF2L tag=3ALGOAAB1RV5 type=del 2024-09-12T17:18:18.583 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.582+0000 7f574d1ea780 1 > prepared operation key=55JI541K1WP2 tag=F9LBMP8B06G8 type=del size=1465895 2024-09-12T17:18:18.584 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.583+0000 7f574d1ea780 1 < completed delete operation key=8SG7DJO4HWPI tag=CY20X4SVUUXG type=del 2024-09-12T17:18:18.585 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.584+0000 7f574d1ea780 1 > prepared operation key=54LQ91UMBJAN tag=JNU61C3UIBOF type=write size=361197 2024-09-12T17:18:18.586 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.586+0000 7f574d1ea780 1 < completed delete operation key=OI51GO639LFK tag=DDVWEP4EU1QM type=del 2024-09-12T17:18:18.588 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.587+0000 7f574d1ea780 1 > prepared operation key=C9IYR9CET1I8 tag=E07NQ695ST73 type=del size=3683906 2024-09-12T17:18:18.589 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.588+0000 7f574d1ea780 1 < completed write operation key=DH02JGZP64MN tag=CPZ44D1IXRO1 type=write size=645063 2024-09-12T17:18:18.590 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.589+0000 7f574d1ea780 1 > prepared operation key=UFKM4I8RMT0W tag=VE2DKM9ZFMQN type=del size=2356427 2024-09-12T17:18:18.592 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.591+0000 7f574d1ea780 1 < completed part key=_multipart_OI51GO639LFK.2~EFSHL9J7J6TH.0 size=964321 2024-09-12T17:18:18.594 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.593+0000 7f574d1ea780 1 < completed multipart upload key=OI51GO639LFK upload=EFSHL9J7J6TH tag=9X1POEOM7MIA type=write size=2012897 2024-09-12T17:18:18.595 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.594+0000 7f574d1ea780 1 > prepared operation key=HFWA7DNUMWF2 tag=9LDT0VALJZRK type=write size=60248 2024-09-12T17:18:18.596 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.595+0000 7f574d1ea780 1 < completed part key=_multipart_55V137SY4E4P.2~94AHI02XNQAS.0 size=126956 2024-09-12T17:18:18.598 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.597+0000 7f574d1ea780 1 < completed multipart upload key=55V137SY4E4P upload=94AHI02XNQAS tag=ALYSX9AV2KOY type=write size=1175532 2024-09-12T17:18:18.599 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.598+0000 7f574d1ea780 1 > prepared operation key=YXIDO0U18839 tag=W6K2XOSHDXTV type=del size=1359690 2024-09-12T17:18:18.601 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.600+0000 7f574d1ea780 1 < completed part key=_multipart_ZGH8XC39FGTC.2~KPIUGCBXG28I.0 size=850734 2024-09-12T17:18:18.603 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.602+0000 7f574d1ea780 1 < completed multipart upload key=ZGH8XC39FGTC upload=KPIUGCBXG28I tag=ELE3MLYNWVMG type=write size=1899310 2024-09-12T17:18:18.605 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.604+0000 7f574d1ea780 1 > prepared part key=_multipart_UFKM4I8RMT0W.2~PJ42CA5UL55K.0 size=1017454 2024-09-12T17:18:18.605 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.604+0000 7f574d1ea780 1 > prepared multipart upload key=UFKM4I8RMT0W upload=PJ42CA5UL55K tag=EZM6NTZQQ3D9 type=write size=2066030 2024-09-12T17:18:18.606 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.605+0000 7f574d1ea780 1 < completed delete operation key=VWWA5IB0L4N1 tag=Q2WODMW13XLE type=del 2024-09-12T17:18:18.608 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.607+0000 7f574d1ea780 1 > prepared operation key=R00F69ON5P6Z tag=4LHI599UPZRU type=del size=1277059 2024-09-12T17:18:18.609 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.608+0000 7f574d1ea780 1 < completed delete operation key=QXD8UG2K4STQ tag=C5RFF5P4KTJY type=del 2024-09-12T17:18:18.610 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.609+0000 7f574d1ea780 1 > prepared operation key=HFWA7DNUMWF2 tag=86F1F14ARCIY type=del size=2798389 2024-09-12T17:18:18.612 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.611+0000 7f574d1ea780 1 < completed part key=_multipart_Q2Q3B1J3DAVD.2~PQ5FS6W7BIDF.0 size=837296 2024-09-12T17:18:18.615 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.614+0000 7f574d1ea780 1 < completed multipart upload key=Q2Q3B1J3DAVD upload=PQ5FS6W7BIDF tag=7A0L90LZXIBM type=write size=1885872 2024-09-12T17:18:18.617 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.616+0000 7f574d1ea780 1 > prepared operation key=ZGH8XC39FGTC tag=S15D7R9AB591 type=del size=3304850 2024-09-12T17:18:18.618 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.617+0000 7f574d1ea780 1 < completed part key=_multipart_K12MVG618809.2~29X2NAVE45DK.0 size=1048576 2024-09-12T17:18:18.619 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.618+0000 7f574d1ea780 1 < completed part key=_multipart_K12MVG618809.2~29X2NAVE45DK.1 size=454819 2024-09-12T17:18:18.621 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.620+0000 7f574d1ea780 1 < completed multipart upload key=K12MVG618809 upload=29X2NAVE45DK tag=FU636I5RMHK0 type=write size=2551971 2024-09-12T17:18:18.623 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.623+0000 7f574d1ea780 1 > prepared part key=_multipart_UTCKL1F42X8A.2~BC5IYUE8WGJD.0 size=776475 2024-09-12T17:18:18.624 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.623+0000 7f574d1ea780 1 > prepared multipart upload key=UTCKL1F42X8A upload=BC5IYUE8WGJD tag=B5G8673IKOXW type=write size=1825051 2024-09-12T17:18:18.625 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.624+0000 7f574d1ea780 1 < completed delete operation key=TIKBUXFPVTN1 tag=83WC1WESKYS1 type=del 2024-09-12T17:18:18.626 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.625+0000 7f574d1ea780 1 > prepared operation key=QXD8UG2K4STQ tag=X2O95QG90YTO type=del size=1949069 2024-09-12T17:18:18.627 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.627+0000 7f574d1ea780 1 < completed part key=_multipart_8SG7DJO4HWPI.2~3D3MNLMGVHY6.0 size=1048576 2024-09-12T17:18:18.628 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.627+0000 7f574d1ea780 1 < completed part key=_multipart_8SG7DJO4HWPI.2~3D3MNLMGVHY6.1 size=1048576 2024-09-12T17:18:18.629 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.628+0000 7f574d1ea780 1 < completed part key=_multipart_8SG7DJO4HWPI.2~3D3MNLMGVHY6.2 size=894608 2024-09-12T17:18:18.632 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.631+0000 7f574d1ea780 1 < completed multipart upload key=8SG7DJO4HWPI upload=3D3MNLMGVHY6 tag=L2ZBJ7DD6TIA type=write size=4040336 2024-09-12T17:18:18.634 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.633+0000 7f574d1ea780 1 > prepared part key=_multipart_TIKBUXFPVTN1.2~F7W3DCE4Y3Z1.0 size=934304 2024-09-12T17:18:18.634 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.633+0000 7f574d1ea780 1 > prepared multipart upload key=TIKBUXFPVTN1 upload=F7W3DCE4Y3Z1 tag=4IDXZL42EPND type=write size=1982880 2024-09-12T17:18:18.635 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.634+0000 7f574d1ea780 1 < canceled part key=_multipart_K12MVG618809.2~O2LPF5ZDJKM6.0 size=1048576 2024-09-12T17:18:18.636 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.635+0000 7f574d1ea780 1 < completed part key=_multipart_K12MVG618809.2~O2LPF5ZDJKM6.1 size=158530 2024-09-12T17:18:18.638 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.637+0000 7f574d1ea780 1 < canceled multipart upload key=K12MVG618809 upload=O2LPF5ZDJKM6 tag=EALYE602SERB type=write size=2255682 2024-09-12T17:18:18.639 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.638+0000 7f574d1ea780 1 > prepared operation key=C9IYR9CET1I8 tag=P44TWJCFCMSW type=del size=2718389 2024-09-12T17:18:18.640 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.639+0000 7f574d1ea780 1 < completed delete operation key=R00F69ON5P6Z tag=ZD2RTTL6H9VL type=del 2024-09-12T17:18:18.641 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.641+0000 7f574d1ea780 1 > prepared operation key=YXIDO0U18839 tag=NJW1MTM8Z4N6 type=del size=1780943 2024-09-12T17:18:18.643 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.642+0000 7f574d1ea780 1 < completed part key=_multipart_D1GEG3MKPOM3.2~187GSF25UIES.0 size=1048576 2024-09-12T17:18:18.644 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.643+0000 7f574d1ea780 1 < completed part key=_multipart_D1GEG3MKPOM3.2~187GSF25UIES.1 size=188407 2024-09-12T17:18:18.646 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.645+0000 7f574d1ea780 1 < completed multipart upload key=D1GEG3MKPOM3 upload=187GSF25UIES tag=YG3XZAUAT0YX type=write size=2285559 2024-09-12T17:18:18.647 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.646+0000 7f574d1ea780 1 > prepared operation key=UFKM4I8RMT0W tag=71TJTUZGQQSW type=del size=2421196 2024-09-12T17:18:18.648 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.647+0000 7f574d1ea780 1 < canceled operation key=55JI541K1WP2 tag=F9LBMP8B06G8 type=del size=1465895 2024-09-12T17:18:18.650 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.649+0000 7f574d1ea780 1 > prepared part key=_multipart_43GV2N9VBBKE.2~NZ72GTC3PIDI.0 size=1048576 2024-09-12T17:18:18.651 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.650+0000 7f574d1ea780 1 > prepared part key=_multipart_43GV2N9VBBKE.2~NZ72GTC3PIDI.1 size=1048576 2024-09-12T17:18:18.652 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.651+0000 7f574d1ea780 1 > prepared part key=_multipart_43GV2N9VBBKE.2~NZ72GTC3PIDI.2 size=583524 2024-09-12T17:18:18.652 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.651+0000 7f574d1ea780 1 > prepared multipart upload key=43GV2N9VBBKE upload=NZ72GTC3PIDI tag=TGY9SABKXUAM type=write size=3729252 2024-09-12T17:18:18.654 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.653+0000 7f574d1ea780 1 < completed write operation key=54LQ91UMBJAN tag=JNU61C3UIBOF type=write size=361197 2024-09-12T17:18:18.655 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.654+0000 7f574d1ea780 1 > prepared operation key=54LQ91UMBJAN tag=PCMSYSPO9HXH type=del size=1599343 2024-09-12T17:18:18.657 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.657+0000 7f574d1ea780 1 < suggested remove operation key=C9IYR9CET1I8 tag=E07NQ695ST73 type=del 2024-09-12T17:18:18.659 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.658+0000 7f574d1ea780 1 > prepared operation key=VWWA5IB0L4N1 tag=8AYPKJDFBJX7 type=del size=1461875 2024-09-12T17:18:18.660 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.659+0000 7f574d1ea780 1 < completed delete operation key=UFKM4I8RMT0W tag=VE2DKM9ZFMQN type=del 2024-09-12T17:18:18.662 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.661+0000 7f574d1ea780 1 > prepared part key=_multipart_DH02JGZP64MN.2~SB9KY126UCTQ.0 size=346200 2024-09-12T17:18:18.662 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.661+0000 7f574d1ea780 1 > prepared multipart upload key=DH02JGZP64MN upload=SB9KY126UCTQ tag=6RRZ836EAMX1 type=write size=1394776 2024-09-12T17:18:18.664 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.663+0000 7f574d1ea780 1 < canceled operation key=HFWA7DNUMWF2 tag=9LDT0VALJZRK type=write size=60248 2024-09-12T17:18:18.666 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.665+0000 7f574d1ea780 1 > prepared part key=_multipart_UFKM4I8RMT0W.2~2EVSSHZI06PD.0 size=1048576 2024-09-12T17:18:18.668 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.667+0000 7f574d1ea780 1 > prepared part key=_multipart_UFKM4I8RMT0W.2~2EVSSHZI06PD.1 size=877422 2024-09-12T17:18:18.668 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.667+0000 7f574d1ea780 1 > prepared multipart upload key=UFKM4I8RMT0W upload=2EVSSHZI06PD tag=EVYD4PGOAT9U type=write size=2974574 2024-09-12T17:18:18.670 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.669+0000 7f574d1ea780 1 < suggested update operation key=YXIDO0U18839 tag=W6K2XOSHDXTV type=del size=1359690 2024-09-12T17:18:18.673 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.672+0000 7f574d1ea780 1 > prepared part key=_multipart_RWVWJHVZE95H.2~2B0RX108BA9N.0 size=593037 2024-09-12T17:18:18.673 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.672+0000 7f574d1ea780 1 > prepared multipart upload key=RWVWJHVZE95H upload=2B0RX108BA9N tag=H643Z441BZCW type=write size=1641613 2024-09-12T17:18:18.674 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.673+0000 7f574d1ea780 1 < completed part key=_multipart_UFKM4I8RMT0W.2~PJ42CA5UL55K.0 size=1017454 2024-09-12T17:18:18.676 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.675+0000 7f574d1ea780 1 < completed multipart upload key=UFKM4I8RMT0W upload=PJ42CA5UL55K tag=EZM6NTZQQ3D9 type=write size=2066030 2024-09-12T17:18:18.677 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.676+0000 7f574d1ea780 1 > prepared operation key=U6E9A5OH4GUW tag=4OE34TXOF801 type=del size=4057299 2024-09-12T17:18:18.680 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.679+0000 7f574d1ea780 1 < suggested remove operation key=R00F69ON5P6Z tag=4LHI599UPZRU type=del 2024-09-12T17:18:18.681 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.680+0000 7f574d1ea780 1 > prepared operation key=SQQMJ61CA0QW tag=KLCCQH351JPV type=del size=1903554 2024-09-12T17:18:18.682 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.681+0000 7f574d1ea780 1 < completed delete operation key=HFWA7DNUMWF2 tag=86F1F14ARCIY type=del 2024-09-12T17:18:18.683 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.683+0000 7f574d1ea780 1 > prepared operation key=QXD8UG2K4STQ tag=2LN0RA9TP3ST type=del size=2343806 2024-09-12T17:18:18.685 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.684+0000 7f574d1ea780 1 < completed delete operation key=ZGH8XC39FGTC tag=S15D7R9AB591 type=del 2024-09-12T17:18:18.686 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.685+0000 7f574d1ea780 1 > prepared operation key=ZGE1860DMGHA tag=ZIGPDLSAAVWC type=del size=297235 2024-09-12T17:18:18.687 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.686+0000 7f574d1ea780 1 < completed part key=_multipart_UTCKL1F42X8A.2~BC5IYUE8WGJD.0 size=776475 2024-09-12T17:18:18.689 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.688+0000 7f574d1ea780 1 < completed multipart upload key=UTCKL1F42X8A upload=BC5IYUE8WGJD tag=B5G8673IKOXW type=write size=1825051 2024-09-12T17:18:18.691 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.691+0000 7f574d1ea780 1 > prepared part key=_multipart_ZGH8XC39FGTC.2~ZDPA91NQSLGC.0 size=1048576 2024-09-12T17:18:18.693 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.692+0000 7f574d1ea780 1 > prepared part key=_multipart_ZGH8XC39FGTC.2~ZDPA91NQSLGC.1 size=783095 2024-09-12T17:18:18.693 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.692+0000 7f574d1ea780 1 > prepared multipart upload key=ZGH8XC39FGTC upload=ZDPA91NQSLGC tag=QDOIIM02P859 type=write size=2880247 2024-09-12T17:18:18.694 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.693+0000 7f574d1ea780 1 < completed delete operation key=QXD8UG2K4STQ tag=X2O95QG90YTO type=del 2024-09-12T17:18:18.695 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.694+0000 7f574d1ea780 1 > prepared operation key=UFKM4I8RMT0W tag=FIDG6KDS4KOX type=del size=2011976 2024-09-12T17:18:18.696 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.695+0000 7f574d1ea780 1 < completed part key=_multipart_TIKBUXFPVTN1.2~F7W3DCE4Y3Z1.0 size=934304 2024-09-12T17:18:18.698 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.697+0000 7f574d1ea780 1 < completed multipart upload key=TIKBUXFPVTN1 upload=F7W3DCE4Y3Z1 tag=4IDXZL42EPND type=write size=1982880 2024-09-12T17:18:18.699 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.698+0000 7f574d1ea780 1 > prepared operation key=8VW3XCUHLF2L tag=SOL0W5MHWNKY type=del size=1670241 2024-09-12T17:18:18.701 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.700+0000 7f574d1ea780 -1 < failed to complete operation key=C9IYR9CET1I8 tag=P44TWJCFCMSW type=del size=2718389: (22) Invalid argument 2024-09-12T17:18:18.702 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.701+0000 7f574d1ea780 1 > prepared operation key=Q2Q3B1J3DAVD tag=3UYG0XAWFQ8R type=del size=2653075 2024-09-12T17:18:18.703 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.702+0000 7f574d1ea780 -1 < failed to complete operation key=YXIDO0U18839 tag=NJW1MTM8Z4N6 type=del size=1780943: (22) Invalid argument 2024-09-12T17:18:18.705 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.704+0000 7f574d1ea780 1 > prepared operation key=TIKBUXFPVTN1 tag=XF6IEJDYMV9S type=del size=19856 2024-09-12T17:18:18.706 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.705+0000 7f574d1ea780 1 < completed delete operation key=UFKM4I8RMT0W tag=71TJTUZGQQSW type=del 2024-09-12T17:18:18.708 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.707+0000 7f574d1ea780 1 > prepared part key=_multipart_7BX38Q7723EB.2~NOSAF9GV2Y5Y.0 size=1048576 2024-09-12T17:18:18.709 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.708+0000 7f574d1ea780 1 > prepared part key=_multipart_7BX38Q7723EB.2~NOSAF9GV2Y5Y.1 size=738718 2024-09-12T17:18:18.709 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.708+0000 7f574d1ea780 1 > prepared multipart upload key=7BX38Q7723EB upload=NOSAF9GV2Y5Y tag=96CL007ZRK6D type=write size=2835870 2024-09-12T17:18:18.710 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.709+0000 7f574d1ea780 1 < completed part key=_multipart_43GV2N9VBBKE.2~NZ72GTC3PIDI.0 size=1048576 2024-09-12T17:18:18.711 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.710+0000 7f574d1ea780 1 < completed part key=_multipart_43GV2N9VBBKE.2~NZ72GTC3PIDI.1 size=1048576 2024-09-12T17:18:18.712 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.711+0000 7f574d1ea780 1 < completed part key=_multipart_43GV2N9VBBKE.2~NZ72GTC3PIDI.2 size=583524 2024-09-12T17:18:18.715 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.714+0000 7f574d1ea780 1 < completed multipart upload key=43GV2N9VBBKE upload=NZ72GTC3PIDI tag=TGY9SABKXUAM type=write size=3729252 2024-09-12T17:18:18.716 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.715+0000 7f574d1ea780 1 > prepared operation key=ZGE1860DMGHA tag=F2MAUPU1BVED type=write size=307520 2024-09-12T17:18:18.717 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.716+0000 7f574d1ea780 1 < completed delete operation key=54LQ91UMBJAN tag=PCMSYSPO9HXH type=del 2024-09-12T17:18:18.718 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.718+0000 7f574d1ea780 1 > prepared operation key=RNI86YYLADT0 tag=KO2AAKMVX688 type=del size=3264858 2024-09-12T17:18:18.720 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.719+0000 7f574d1ea780 1 < canceled operation key=VWWA5IB0L4N1 tag=8AYPKJDFBJX7 type=del size=1461875 2024-09-12T17:18:18.722 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.721+0000 7f574d1ea780 1 > prepared part key=_multipart_UFKM4I8RMT0W.2~38FHT4HDG6CL.0 size=105375 2024-09-12T17:18:18.722 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.721+0000 7f574d1ea780 1 > prepared multipart upload key=UFKM4I8RMT0W upload=38FHT4HDG6CL tag=6Z1XCQ0MA1MO type=write size=1153951 2024-09-12T17:18:18.723 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.722+0000 7f574d1ea780 1 < completed part key=_multipart_DH02JGZP64MN.2~SB9KY126UCTQ.0 size=346200 2024-09-12T17:18:18.725 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.724+0000 7f574d1ea780 1 < completed multipart upload key=DH02JGZP64MN upload=SB9KY126UCTQ tag=6RRZ836EAMX1 type=write size=1394776 2024-09-12T17:18:18.727 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.726+0000 7f574d1ea780 1 > prepared operation key=VWWA5IB0L4N1 tag=RI9RJXEJDPNB type=del size=2183280 2024-09-12T17:18:18.728 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.727+0000 7f574d1ea780 1 < completed part key=_multipart_UFKM4I8RMT0W.2~2EVSSHZI06PD.0 size=1048576 2024-09-12T17:18:18.729 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.728+0000 7f574d1ea780 1 < completed part key=_multipart_UFKM4I8RMT0W.2~2EVSSHZI06PD.1 size=877422 2024-09-12T17:18:18.731 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.730+0000 7f574d1ea780 1 < completed multipart upload key=UFKM4I8RMT0W upload=2EVSSHZI06PD tag=EVYD4PGOAT9U type=write size=2974574 2024-09-12T17:18:18.734 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.733+0000 7f574d1ea780 1 > prepared part key=_multipart_Q2Q3B1J3DAVD.2~XA2NFSY6YZCQ.0 size=983127 2024-09-12T17:18:18.734 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.733+0000 7f574d1ea780 1 > prepared multipart upload key=Q2Q3B1J3DAVD upload=XA2NFSY6YZCQ tag=3R1YIDL6LAL0 type=write size=2031703 2024-09-12T17:18:18.735 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.734+0000 7f574d1ea780 1 < completed part key=_multipart_RWVWJHVZE95H.2~2B0RX108BA9N.0 size=593037 2024-09-12T17:18:18.737 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.736+0000 7f574d1ea780 1 < completed multipart upload key=RWVWJHVZE95H upload=2B0RX108BA9N tag=H643Z441BZCW type=write size=1641613 2024-09-12T17:18:18.740 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.739+0000 7f574d1ea780 1 > prepared part key=_multipart_GEGOEB05R0PK.2~VS5RZKEZ396L.0 size=1048576 2024-09-12T17:18:18.741 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.740+0000 7f574d1ea780 1 > prepared part key=_multipart_GEGOEB05R0PK.2~VS5RZKEZ396L.1 size=365687 2024-09-12T17:18:18.741 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.740+0000 7f574d1ea780 1 > prepared multipart upload key=GEGOEB05R0PK upload=VS5RZKEZ396L tag=PF0HSVZC961K type=write size=2462839 2024-09-12T17:18:18.742 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.741+0000 7f574d1ea780 1 < completed delete operation key=U6E9A5OH4GUW tag=4OE34TXOF801 type=del 2024-09-12T17:18:18.743 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.742+0000 7f574d1ea780 1 > prepared operation key=54CM8800AT9V tag=5WG9GZ67BYEV type=del size=1841037 2024-09-12T17:18:18.745 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.744+0000 7f574d1ea780 1 < completed delete operation key=SQQMJ61CA0QW tag=KLCCQH351JPV type=del 2024-09-12T17:18:18.746 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.745+0000 7f574d1ea780 1 > prepared operation key=8SG7DJO4HWPI tag=FF81GR1FYR3V type=del size=3185279 2024-09-12T17:18:18.747 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.746+0000 7f574d1ea780 1 < completed delete operation key=QXD8UG2K4STQ tag=2LN0RA9TP3ST type=del 2024-09-12T17:18:18.748 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.747+0000 7f574d1ea780 1 > prepared operation key=RWVWJHVZE95H tag=8XQS1STORIC1 type=write size=971679 2024-09-12T17:18:18.749 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.749+0000 7f574d1ea780 1 < canceled operation key=ZGE1860DMGHA tag=ZIGPDLSAAVWC type=del size=297235 2024-09-12T17:18:18.751 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.750+0000 7f574d1ea780 1 > prepared operation key=RWVWJHVZE95H tag=9YN66G1VZUAX type=write size=47104 2024-09-12T17:18:18.752 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.751+0000 7f574d1ea780 1 < completed part key=_multipart_ZGH8XC39FGTC.2~ZDPA91NQSLGC.0 size=1048576 2024-09-12T17:18:18.753 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.752+0000 7f574d1ea780 1 < completed part key=_multipart_ZGH8XC39FGTC.2~ZDPA91NQSLGC.1 size=783095 2024-09-12T17:18:18.755 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.754+0000 7f574d1ea780 1 < completed multipart upload key=ZGH8XC39FGTC upload=ZDPA91NQSLGC tag=QDOIIM02P859 type=write size=2880247 2024-09-12T17:18:18.756 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.756+0000 7f574d1ea780 1 > prepared operation key=DH02JGZP64MN tag=IWOW9L1FAW7M type=del size=450119 2024-09-12T17:18:18.759 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.758+0000 7f574d1ea780 1 < suggested update operation key=UFKM4I8RMT0W tag=FIDG6KDS4KOX type=del size=2011976 2024-09-12T17:18:18.760 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.759+0000 7f574d1ea780 1 > prepared operation key=RWVWJHVZE95H tag=678GK3XD1VCW type=del size=1592172 2024-09-12T17:18:18.761 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.760+0000 7f574d1ea780 1 < completed delete operation key=8VW3XCUHLF2L tag=SOL0W5MHWNKY type=del 2024-09-12T17:18:18.762 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.762+0000 7f574d1ea780 1 > prepared operation key=ENFNIFHQ3SHW tag=W88RH3BVVA2H type=del size=1774663 2024-09-12T17:18:18.764 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.763+0000 7f574d1ea780 1 < completed delete operation key=Q2Q3B1J3DAVD tag=3UYG0XAWFQ8R type=del 2024-09-12T17:18:18.765 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.764+0000 7f574d1ea780 1 > prepared operation key=43GV2N9VBBKE tag=76J410AID1LK type=write size=4511 2024-09-12T17:18:18.766 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.765+0000 7f574d1ea780 1 < canceled operation key=TIKBUXFPVTN1 tag=XF6IEJDYMV9S type=del size=19856 2024-09-12T17:18:18.767 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.766+0000 7f574d1ea780 1 > prepared operation key=ZGH8XC39FGTC tag=8DI7HL908ZSO type=del size=2424400 2024-09-12T17:18:18.768 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.768+0000 7f574d1ea780 1 < completed part key=_multipart_7BX38Q7723EB.2~NOSAF9GV2Y5Y.0 size=1048576 2024-09-12T17:18:18.769 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.769+0000 7f574d1ea780 1 < completed part key=_multipart_7BX38Q7723EB.2~NOSAF9GV2Y5Y.1 size=738718 2024-09-12T17:18:18.772 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.771+0000 7f574d1ea780 1 < completed multipart upload key=7BX38Q7723EB upload=NOSAF9GV2Y5Y tag=96CL007ZRK6D type=write size=2835870 2024-09-12T17:18:18.773 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.772+0000 7f574d1ea780 1 > prepared operation key=HFWA7DNUMWF2 tag=K9I12RJSL5DM type=write size=524451 2024-09-12T17:18:18.774 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.773+0000 7f574d1ea780 1 < completed write operation key=ZGE1860DMGHA tag=F2MAUPU1BVED type=write size=307520 2024-09-12T17:18:18.776 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.776+0000 7f574d1ea780 1 > prepared part key=_multipart_8VW3XCUHLF2L.2~6SZS0IPH04AR.0 size=1048576 2024-09-12T17:18:18.777 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.777+0000 7f574d1ea780 1 > prepared part key=_multipart_8VW3XCUHLF2L.2~6SZS0IPH04AR.1 size=1048576 2024-09-12T17:18:18.779 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.778+0000 7f574d1ea780 1 > prepared part key=_multipart_8VW3XCUHLF2L.2~6SZS0IPH04AR.2 size=856299 2024-09-12T17:18:18.779 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.778+0000 7f574d1ea780 1 > prepared multipart upload key=8VW3XCUHLF2L upload=6SZS0IPH04AR tag=2W43SOKTKJKC type=write size=4002027 2024-09-12T17:18:18.781 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.780+0000 7f574d1ea780 1 < suggested remove operation key=RNI86YYLADT0 tag=KO2AAKMVX688 type=del 2024-09-12T17:18:18.783 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.782+0000 7f574d1ea780 1 > prepared part key=_multipart_YXIDO0U18839.2~154M5G7AGOR4.0 size=1048576 2024-09-12T17:18:18.784 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.783+0000 7f574d1ea780 1 > prepared part key=_multipart_YXIDO0U18839.2~154M5G7AGOR4.1 size=647315 2024-09-12T17:18:18.784 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.783+0000 7f574d1ea780 1 > prepared multipart upload key=YXIDO0U18839 upload=154M5G7AGOR4 tag=UP2G2ESAS9A8 type=write size=2744467 2024-09-12T17:18:18.785 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.784+0000 7f574d1ea780 1 < completed part key=_multipart_UFKM4I8RMT0W.2~38FHT4HDG6CL.0 size=105375 2024-09-12T17:18:18.787 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.787+0000 7f574d1ea780 1 < completed multipart upload key=UFKM4I8RMT0W upload=38FHT4HDG6CL tag=6Z1XCQ0MA1MO type=write size=1153951 2024-09-12T17:18:18.789 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.788+0000 7f574d1ea780 1 > prepared operation key=QXD8UG2K4STQ tag=UMYXOIWY1RXV type=write size=967063 2024-09-12T17:18:18.790 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.789+0000 7f574d1ea780 1 < completed delete operation key=VWWA5IB0L4N1 tag=RI9RJXEJDPNB type=del 2024-09-12T17:18:18.792 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.791+0000 7f574d1ea780 1 > prepared part key=_multipart_43GV2N9VBBKE.2~BR6U6LN5E41W.0 size=1048576 2024-09-12T17:18:18.793 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.793+0000 7f574d1ea780 1 > prepared part key=_multipart_43GV2N9VBBKE.2~BR6U6LN5E41W.1 size=452254 2024-09-12T17:18:18.793 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.793+0000 7f574d1ea780 1 > prepared multipart upload key=43GV2N9VBBKE upload=BR6U6LN5E41W tag=2G6UUXEP8C03 type=write size=2549406 2024-09-12T17:18:18.795 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.794+0000 7f574d1ea780 1 < completed part key=_multipart_Q2Q3B1J3DAVD.2~XA2NFSY6YZCQ.0 size=983127 2024-09-12T17:18:18.797 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.796+0000 7f574d1ea780 1 < completed multipart upload key=Q2Q3B1J3DAVD upload=XA2NFSY6YZCQ tag=3R1YIDL6LAL0 type=write size=2031703 2024-09-12T17:18:18.799 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.798+0000 7f574d1ea780 1 > prepared part key=_multipart_RNI86YYLADT0.2~B7ZYO62UVVPZ.0 size=924484 2024-09-12T17:18:18.799 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.798+0000 7f574d1ea780 1 > prepared multipart upload key=RNI86YYLADT0 upload=B7ZYO62UVVPZ tag=M7YD9CNP36D8 type=write size=1973060 2024-09-12T17:18:18.800 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.799+0000 7f574d1ea780 1 < completed part key=_multipart_GEGOEB05R0PK.2~VS5RZKEZ396L.0 size=1048576 2024-09-12T17:18:18.800 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.799+0000 7f574d1ea780 1 < canceled part key=_multipart_GEGOEB05R0PK.2~VS5RZKEZ396L.1 size=365687 2024-09-12T17:18:18.802 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.801+0000 7f574d1ea780 1 < canceled multipart upload key=GEGOEB05R0PK upload=VS5RZKEZ396L tag=PF0HSVZC961K type=write size=2462839 2024-09-12T17:18:18.803 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.803+0000 7f574d1ea780 1 > prepared operation key=54CM8800AT9V tag=I6LZU7WZMXSW type=write size=510779 2024-09-12T17:18:18.805 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.804+0000 7f574d1ea780 1 < completed delete operation key=54CM8800AT9V tag=5WG9GZ67BYEV type=del 2024-09-12T17:18:18.807 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.806+0000 7f574d1ea780 1 > prepared part key=_multipart_ZGE1860DMGHA.2~W4MJS8XQ07EW.0 size=1048576 2024-09-12T17:18:18.808 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.807+0000 7f574d1ea780 1 > prepared part key=_multipart_ZGE1860DMGHA.2~W4MJS8XQ07EW.1 size=557462 2024-09-12T17:18:18.808 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.807+0000 7f574d1ea780 1 > prepared multipart upload key=ZGE1860DMGHA upload=W4MJS8XQ07EW tag=G9P076HYK22W type=write size=2654614 2024-09-12T17:18:18.809 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.808+0000 7f574d1ea780 1 < completed delete operation key=8SG7DJO4HWPI tag=FF81GR1FYR3V type=del 2024-09-12T17:18:18.810 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.809+0000 7f574d1ea780 1 > prepared operation key=A1TIP3RXHBCZ tag=TL6DRK0MKYG9 type=write size=644431 2024-09-12T17:18:18.813 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.812+0000 7f574d1ea780 1 < suggested remove operation key=RWVWJHVZE95H tag=8XQS1STORIC1 type=write 2024-09-12T17:18:18.814 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.813+0000 7f574d1ea780 1 > prepared operation key=D1GEG3MKPOM3 tag=Y27Z3I8NR9VT type=write size=813524 2024-09-12T17:18:18.815 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.814+0000 7f574d1ea780 -1 < failed to complete operation key=RWVWJHVZE95H tag=9YN66G1VZUAX type=write size=47104: (22) Invalid argument 2024-09-12T17:18:18.818 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.817+0000 7f574d1ea780 1 > prepared part key=_multipart_SQQMJ61CA0QW.2~O03FDL3NP824.0 size=1048576 2024-09-12T17:18:18.819 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.818+0000 7f574d1ea780 1 > prepared part key=_multipart_SQQMJ61CA0QW.2~O03FDL3NP824.1 size=893553 2024-09-12T17:18:18.819 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.818+0000 7f574d1ea780 1 > prepared multipart upload key=SQQMJ61CA0QW upload=O03FDL3NP824 tag=WZC9LR9ZLEXI type=write size=2990705 2024-09-12T17:18:18.820 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.819+0000 7f574d1ea780 1 < completed delete operation key=DH02JGZP64MN tag=IWOW9L1FAW7M type=del 2024-09-12T17:18:18.821 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.820+0000 7f574d1ea780 1 > prepared operation key=55V137SY4E4P tag=449NGKME9IWC type=write size=252957 2024-09-12T17:18:18.823 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.822+0000 7f574d1ea780 -1 < failed to complete operation key=RWVWJHVZE95H tag=678GK3XD1VCW type=del size=1592172: (22) Invalid argument 2024-09-12T17:18:18.824 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.823+0000 7f574d1ea780 1 > prepared operation key=ZGH8XC39FGTC tag=HG1RDFG360T5 type=del size=1562318 2024-09-12T17:18:18.827 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.826+0000 7f574d1ea780 1 < suggested update operation key=ENFNIFHQ3SHW tag=W88RH3BVVA2H type=del size=1774663 2024-09-12T17:18:18.829 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.828+0000 7f574d1ea780 1 > prepared operation key=8SG7DJO4HWPI tag=754TO304WVA2 type=del size=2513244 2024-09-12T17:18:18.832 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.831+0000 7f574d1ea780 1 < suggested update operation key=43GV2N9VBBKE tag=76J410AID1LK type=write size=4511 2024-09-12T17:18:18.835 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.834+0000 7f574d1ea780 1 > prepared part key=_multipart_8VW3XCUHLF2L.2~W8JN5II7HHQW.0 size=1048576 2024-09-12T17:18:18.837 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.836+0000 7f574d1ea780 1 > prepared part key=_multipart_8VW3XCUHLF2L.2~W8JN5II7HHQW.1 size=1048576 2024-09-12T17:18:18.838 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.837+0000 7f574d1ea780 1 > prepared part key=_multipart_8VW3XCUHLF2L.2~W8JN5II7HHQW.2 size=322214 2024-09-12T17:18:18.838 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.837+0000 7f574d1ea780 1 > prepared multipart upload key=8VW3XCUHLF2L upload=W8JN5II7HHQW tag=S9OSVTQIJTFA type=write size=3467942 2024-09-12T17:18:18.840 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.839+0000 7f574d1ea780 1 < suggested remove operation key=ZGH8XC39FGTC tag=8DI7HL908ZSO type=del 2024-09-12T17:18:18.841 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.840+0000 7f574d1ea780 1 > prepared operation key=RWVWJHVZE95H tag=J7RVFBON9OLW type=del size=3901184 2024-09-12T17:18:18.842 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.842+0000 7f574d1ea780 1 < completed write operation key=HFWA7DNUMWF2 tag=K9I12RJSL5DM type=write size=524451 2024-09-12T17:18:18.845 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.844+0000 7f574d1ea780 1 > prepared part key=_multipart_OI51GO639LFK.2~2714XRAGJUAQ.0 size=1048576 2024-09-12T17:18:18.846 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.845+0000 7f574d1ea780 1 > prepared part key=_multipart_OI51GO639LFK.2~2714XRAGJUAQ.1 size=1048576 2024-09-12T17:18:18.847 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.846+0000 7f574d1ea780 1 > prepared part key=_multipart_OI51GO639LFK.2~2714XRAGJUAQ.2 size=570463 2024-09-12T17:18:18.847 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.846+0000 7f574d1ea780 1 > prepared multipart upload key=OI51GO639LFK upload=2714XRAGJUAQ tag=OFYBZ01GGP34 type=write size=3716191 2024-09-12T17:18:18.848 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.847+0000 7f574d1ea780 1 < canceled part key=_multipart_8VW3XCUHLF2L.2~6SZS0IPH04AR.0 size=1048576 2024-09-12T17:18:18.848 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.848+0000 7f574d1ea780 1 < completed part key=_multipart_8VW3XCUHLF2L.2~6SZS0IPH04AR.1 size=1048576 2024-09-12T17:18:18.849 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.849+0000 7f574d1ea780 1 < completed part key=_multipart_8VW3XCUHLF2L.2~6SZS0IPH04AR.2 size=856299 2024-09-12T17:18:18.852 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.851+0000 7f574d1ea780 1 < canceled multipart upload key=8VW3XCUHLF2L upload=6SZS0IPH04AR tag=2W43SOKTKJKC type=write size=4002027 2024-09-12T17:18:18.853 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.852+0000 7f574d1ea780 1 > prepared operation key=55JI541K1WP2 tag=6GXOAXMB7UZL type=del size=2016920 2024-09-12T17:18:18.856 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.855+0000 7f574d1ea780 1 < completed part key=_multipart_YXIDO0U18839.2~154M5G7AGOR4.0 size=1048576 2024-09-12T17:18:18.857 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.856+0000 7f574d1ea780 1 < completed part key=_multipart_YXIDO0U18839.2~154M5G7AGOR4.1 size=647315 2024-09-12T17:18:18.861 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.858+0000 7f574d1ea780 1 < completed multipart upload key=YXIDO0U18839 upload=154M5G7AGOR4 tag=UP2G2ESAS9A8 type=write size=2744467 2024-09-12T17:18:18.861 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.861+0000 7f574d1ea780 1 > prepared part key=_multipart_HGZMN894YYC0.2~1I0PAFJDGNBF.0 size=1048576 2024-09-12T17:18:18.863 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.862+0000 7f574d1ea780 1 > prepared part key=_multipart_HGZMN894YYC0.2~1I0PAFJDGNBF.1 size=1048576 2024-09-12T17:18:18.864 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.863+0000 7f574d1ea780 1 > prepared part key=_multipart_HGZMN894YYC0.2~1I0PAFJDGNBF.2 size=659091 2024-09-12T17:18:18.864 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.863+0000 7f574d1ea780 1 > prepared multipart upload key=HGZMN894YYC0 upload=1I0PAFJDGNBF tag=QSR0QYQR3RDE type=write size=3804819 2024-09-12T17:18:18.865 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.864+0000 7f574d1ea780 1 < completed write operation key=QXD8UG2K4STQ tag=UMYXOIWY1RXV type=write size=967063 2024-09-12T17:18:18.868 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.867+0000 7f574d1ea780 1 > prepared part key=_multipart_8VW3XCUHLF2L.2~T55RV8OJHSJD.0 size=1048576 2024-09-12T17:18:18.869 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.868+0000 7f574d1ea780 1 > prepared part key=_multipart_8VW3XCUHLF2L.2~T55RV8OJHSJD.1 size=1048576 2024-09-12T17:18:18.870 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.869+0000 7f574d1ea780 1 > prepared part key=_multipart_8VW3XCUHLF2L.2~T55RV8OJHSJD.2 size=761227 2024-09-12T17:18:18.870 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.869+0000 7f574d1ea780 1 > prepared multipart upload key=8VW3XCUHLF2L upload=T55RV8OJHSJD tag=VARE5262CKEU type=write size=3906955 2024-09-12T17:18:18.871 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.870+0000 7f574d1ea780 1 < completed part key=_multipart_43GV2N9VBBKE.2~BR6U6LN5E41W.0 size=1048576 2024-09-12T17:18:18.872 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.872+0000 7f574d1ea780 1 < completed part key=_multipart_43GV2N9VBBKE.2~BR6U6LN5E41W.1 size=452254 2024-09-12T17:18:18.875 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.874+0000 7f574d1ea780 1 < completed multipart upload key=43GV2N9VBBKE upload=BR6U6LN5E41W tag=2G6UUXEP8C03 type=write size=2549406 2024-09-12T17:18:18.876 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.875+0000 7f574d1ea780 1 > prepared operation key=UTCKL1F42X8A tag=PGQ35KV6UKKT type=del size=1546133 2024-09-12T17:18:18.877 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.877+0000 7f574d1ea780 1 < completed part key=_multipart_RNI86YYLADT0.2~B7ZYO62UVVPZ.0 size=924484 2024-09-12T17:18:18.880 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.879+0000 7f574d1ea780 1 < completed multipart upload key=RNI86YYLADT0 upload=B7ZYO62UVVPZ tag=M7YD9CNP36D8 type=write size=1973060 2024-09-12T17:18:18.881 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.880+0000 7f574d1ea780 1 > prepared operation key=RWVWJHVZE95H tag=EDUKP2P8ERW2 type=del size=2955911 2024-09-12T17:18:18.883 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.882+0000 7f574d1ea780 1 < completed write operation key=54CM8800AT9V tag=I6LZU7WZMXSW type=write size=510779 2024-09-12T17:18:18.884 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.883+0000 7f574d1ea780 1 > prepared operation key=54CM8800AT9V tag=Z3UBXGYDR7O5 type=write size=821949 2024-09-12T17:18:18.885 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.885+0000 7f574d1ea780 1 < completed part key=_multipart_ZGE1860DMGHA.2~W4MJS8XQ07EW.0 size=1048576 2024-09-12T17:18:18.886 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.886+0000 7f574d1ea780 1 < completed part key=_multipart_ZGE1860DMGHA.2~W4MJS8XQ07EW.1 size=557462 2024-09-12T17:18:18.889 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.888+0000 7f574d1ea780 1 < completed multipart upload key=ZGE1860DMGHA upload=W4MJS8XQ07EW tag=G9P076HYK22W type=write size=2654614 2024-09-12T17:18:18.890 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.889+0000 7f574d1ea780 1 > prepared operation key=VWWA5IB0L4N1 tag=JIPWUNH1CBOL type=del size=1192308 2024-09-12T17:18:18.891 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.890+0000 7f574d1ea780 1 < completed write operation key=A1TIP3RXHBCZ tag=TL6DRK0MKYG9 type=write size=644431 2024-09-12T17:18:18.893 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.893+0000 7f574d1ea780 1 > prepared part key=_multipart_43GV2N9VBBKE.2~OCHC0GIYTDJ4.0 size=789683 2024-09-12T17:18:18.894 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.893+0000 7f574d1ea780 1 > prepared multipart upload key=43GV2N9VBBKE upload=OCHC0GIYTDJ4 tag=L16EKNHPBF12 type=write size=1838259 2024-09-12T17:18:18.895 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.894+0000 7f574d1ea780 1 < completed write operation key=D1GEG3MKPOM3 tag=Y27Z3I8NR9VT type=write size=813524 2024-09-12T17:18:18.896 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.895+0000 7f574d1ea780 1 > prepared operation key=UFKM4I8RMT0W tag=MXZ95ERD7M0I type=del size=3923873 2024-09-12T17:18:18.898 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.897+0000 7f574d1ea780 1 < completed part key=_multipart_SQQMJ61CA0QW.2~O03FDL3NP824.0 size=1048576 2024-09-12T17:18:18.898 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.897+0000 7f574d1ea780 1 < completed part key=_multipart_SQQMJ61CA0QW.2~O03FDL3NP824.1 size=893553 2024-09-12T17:18:18.901 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.900+0000 7f574d1ea780 1 < completed multipart upload key=SQQMJ61CA0QW upload=O03FDL3NP824 tag=WZC9LR9ZLEXI type=write size=2990705 2024-09-12T17:18:18.903 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.902+0000 7f574d1ea780 1 > prepared part key=_multipart_YXIDO0U18839.2~8WAHHH2FPRG4.0 size=116749 2024-09-12T17:18:18.903 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.902+0000 7f574d1ea780 1 > prepared multipart upload key=YXIDO0U18839 upload=8WAHHH2FPRG4 tag=V04VY448UMEM type=write size=1165325 2024-09-12T17:18:18.905 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.904+0000 7f574d1ea780 1 < completed write operation key=55V137SY4E4P tag=449NGKME9IWC type=write size=252957 2024-09-12T17:18:18.906 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.905+0000 7f574d1ea780 1 > prepared operation key=OI51GO639LFK tag=YMB24F84X72O type=del size=3300666 2024-09-12T17:18:18.906 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.906+0000 7f574d1ea780 -1 < no bi entry to suggest for operation key=ZGH8XC39FGTC tag=HG1RDFG360T5 type=del size=1562318: (2) No such file or directory 2024-09-12T17:18:18.908 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.907+0000 7f574d1ea780 1 > prepared operation key=U6E9A5OH4GUW tag=CZ848VA0SLZE type=del size=396446 2024-09-12T17:18:18.909 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.908+0000 7f574d1ea780 1 < completed delete operation key=8SG7DJO4HWPI tag=754TO304WVA2 type=del 2024-09-12T17:18:18.911 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.909+0000 7f574d1ea780 1 > prepared operation key=ENFNIFHQ3SHW tag=6VGPLL3CPT7J type=write size=573374 2024-09-12T17:18:18.911 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.910+0000 7f574d1ea780 1 < canceled part key=_multipart_8VW3XCUHLF2L.2~W8JN5II7HHQW.0 size=1048576 2024-09-12T17:18:18.912 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.911+0000 7f574d1ea780 1 < completed part key=_multipart_8VW3XCUHLF2L.2~W8JN5II7HHQW.1 size=1048576 2024-09-12T17:18:18.913 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.912+0000 7f574d1ea780 1 < completed part key=_multipart_8VW3XCUHLF2L.2~W8JN5II7HHQW.2 size=322214 2024-09-12T17:18:18.915 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.914+0000 7f574d1ea780 1 < canceled multipart upload key=8VW3XCUHLF2L upload=W8JN5II7HHQW tag=S9OSVTQIJTFA type=write size=3467942 2024-09-12T17:18:18.917 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.916+0000 7f574d1ea780 1 > prepared part key=_multipart_HGZMN894YYC0.2~B59W0FVA3GNK.0 size=816707 2024-09-12T17:18:18.917 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.916+0000 7f574d1ea780 1 > prepared multipart upload key=HGZMN894YYC0 upload=B59W0FVA3GNK tag=O769725MLFY0 type=write size=1865283 2024-09-12T17:18:18.918 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.917+0000 7f574d1ea780 1 < completed delete operation key=RWVWJHVZE95H tag=J7RVFBON9OLW type=del 2024-09-12T17:18:18.921 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.920+0000 7f574d1ea780 1 > prepared part key=_multipart_54LQ91UMBJAN.2~VA3R0X4KOLRR.0 size=1048576 2024-09-12T17:18:18.922 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.921+0000 7f574d1ea780 1 > prepared part key=_multipart_54LQ91UMBJAN.2~VA3R0X4KOLRR.1 size=1048576 2024-09-12T17:18:18.923 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.922+0000 7f574d1ea780 1 > prepared part key=_multipart_54LQ91UMBJAN.2~VA3R0X4KOLRR.2 size=602957 2024-09-12T17:18:18.923 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.922+0000 7f574d1ea780 1 > prepared multipart upload key=54LQ91UMBJAN upload=VA3R0X4KOLRR tag=VMMYT76MD30D type=write size=3748685 2024-09-12T17:18:18.924 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.923+0000 7f574d1ea780 1 < canceled part key=_multipart_OI51GO639LFK.2~2714XRAGJUAQ.0 size=1048576 2024-09-12T17:18:18.924 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.923+0000 7f574d1ea780 1 < canceled part key=_multipart_OI51GO639LFK.2~2714XRAGJUAQ.1 size=1048576 2024-09-12T17:18:18.925 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.924+0000 7f574d1ea780 1 < completed part key=_multipart_OI51GO639LFK.2~2714XRAGJUAQ.2 size=570463 2024-09-12T17:18:18.927 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.926+0000 7f574d1ea780 1 < canceled multipart upload key=OI51GO639LFK upload=2714XRAGJUAQ tag=OFYBZ01GGP34 type=write size=3716191 2024-09-12T17:18:18.930 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.929+0000 7f574d1ea780 1 > prepared part key=_multipart_U6E9A5OH4GUW.2~QND5WGN92RJ9.0 size=1048576 2024-09-12T17:18:18.931 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.930+0000 7f574d1ea780 1 > prepared part key=_multipart_U6E9A5OH4GUW.2~QND5WGN92RJ9.1 size=88797 2024-09-12T17:18:18.931 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.930+0000 7f574d1ea780 1 > prepared multipart upload key=U6E9A5OH4GUW upload=QND5WGN92RJ9 tag=3AZ2HH4XWF7T type=write size=2185949 2024-09-12T17:18:18.934 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.933+0000 7f574d1ea780 1 < suggested remove operation key=55JI541K1WP2 tag=6GXOAXMB7UZL type=del 2024-09-12T17:18:18.935 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.934+0000 7f574d1ea780 1 > prepared operation key=TIKBUXFPVTN1 tag=THIIEG922CUE type=write size=345245 2024-09-12T17:18:18.936 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.935+0000 7f574d1ea780 1 < completed part key=_multipart_HGZMN894YYC0.2~1I0PAFJDGNBF.0 size=1048576 2024-09-12T17:18:18.937 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.936+0000 7f574d1ea780 1 < completed part key=_multipart_HGZMN894YYC0.2~1I0PAFJDGNBF.1 size=1048576 2024-09-12T17:18:18.938 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.937+0000 7f574d1ea780 1 < completed part key=_multipart_HGZMN894YYC0.2~1I0PAFJDGNBF.2 size=659091 2024-09-12T17:18:18.940 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.939+0000 7f574d1ea780 1 < completed multipart upload key=HGZMN894YYC0 upload=1I0PAFJDGNBF tag=QSR0QYQR3RDE type=write size=3804819 2024-09-12T17:18:18.941 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.940+0000 7f574d1ea780 1 > prepared operation key=SQQMJ61CA0QW tag=I6H54CF0ASEU type=del size=787162 2024-09-12T17:18:18.941 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.940+0000 7f574d1ea780 1 < canceled part key=_multipart_8VW3XCUHLF2L.2~T55RV8OJHSJD.0 size=1048576 2024-09-12T17:18:18.941 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.940+0000 7f574d1ea780 1 < canceled part key=_multipart_8VW3XCUHLF2L.2~T55RV8OJHSJD.1 size=1048576 2024-09-12T17:18:18.942 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.941+0000 7f574d1ea780 1 < completed part key=_multipart_8VW3XCUHLF2L.2~T55RV8OJHSJD.2 size=761227 2024-09-12T17:18:18.944 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.944+0000 7f574d1ea780 1 < canceled multipart upload key=8VW3XCUHLF2L upload=T55RV8OJHSJD tag=VARE5262CKEU type=write size=3906955 2024-09-12T17:18:18.946 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.945+0000 7f574d1ea780 1 > prepared operation key=55JI541K1WP2 tag=J7HCRCU2IPA1 type=del size=3513722 2024-09-12T17:18:18.947 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.946+0000 7f574d1ea780 1 < completed delete operation key=UTCKL1F42X8A tag=PGQ35KV6UKKT type=del 2024-09-12T17:18:18.949 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.948+0000 7f574d1ea780 1 > prepared operation key=HFWA7DNUMWF2 tag=3CUIBJ1SZVO9 type=del size=1038711 2024-09-12T17:18:18.950 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.949+0000 7f574d1ea780 1 < canceled operation key=RWVWJHVZE95H tag=EDUKP2P8ERW2 type=del size=2955911 2024-09-12T17:18:18.952 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.951+0000 7f574d1ea780 1 > prepared part key=_multipart_UFKM4I8RMT0W.2~8BDARUYCIU3N.0 size=1048576 2024-09-12T17:18:18.953 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.952+0000 7f574d1ea780 1 > prepared part key=_multipart_UFKM4I8RMT0W.2~8BDARUYCIU3N.1 size=1048576 2024-09-12T17:18:18.954 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.953+0000 7f574d1ea780 1 > prepared part key=_multipart_UFKM4I8RMT0W.2~8BDARUYCIU3N.2 size=441258 2024-09-12T17:18:18.954 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.953+0000 7f574d1ea780 1 > prepared multipart upload key=UFKM4I8RMT0W upload=8BDARUYCIU3N tag=99DJHH5Y6HQJ type=write size=3586986 2024-09-12T17:18:18.956 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.955+0000 7f574d1ea780 1 < completed write operation key=54CM8800AT9V tag=Z3UBXGYDR7O5 type=write size=821949 2024-09-12T17:18:18.957 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.956+0000 7f574d1ea780 1 > prepared operation key=SQQMJ61CA0QW tag=O6XUJENPX6VJ type=del size=1862294 2024-09-12T17:18:18.958 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.958+0000 7f574d1ea780 1 < completed delete operation key=VWWA5IB0L4N1 tag=JIPWUNH1CBOL type=del 2024-09-12T17:18:18.961 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.960+0000 7f574d1ea780 1 > prepared part key=_multipart_D1GEG3MKPOM3.2~E1329IZ8M1X2.0 size=293282 2024-09-12T17:18:18.961 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.960+0000 7f574d1ea780 1 > prepared multipart upload key=D1GEG3MKPOM3 upload=E1329IZ8M1X2 tag=GZQPUNVO39CX type=write size=1341858 2024-09-12T17:18:18.962 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.961+0000 7f574d1ea780 1 < completed part key=_multipart_43GV2N9VBBKE.2~OCHC0GIYTDJ4.0 size=789683 2024-09-12T17:18:18.964 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.963+0000 7f574d1ea780 1 < completed multipart upload key=43GV2N9VBBKE upload=OCHC0GIYTDJ4 tag=L16EKNHPBF12 type=write size=1838259 2024-09-12T17:18:18.965 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.964+0000 7f574d1ea780 1 > prepared operation key=ZGE1860DMGHA tag=UW02CZR57IES type=del size=317564 2024-09-12T17:18:18.966 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.966+0000 7f574d1ea780 1 < canceled operation key=UFKM4I8RMT0W tag=MXZ95ERD7M0I type=del size=3923873 2024-09-12T17:18:18.969 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.968+0000 7f574d1ea780 1 > prepared part key=_multipart_ENFNIFHQ3SHW.2~SYDM76CRM1VQ.0 size=1048576 2024-09-12T17:18:18.970 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.969+0000 7f574d1ea780 1 > prepared part key=_multipart_ENFNIFHQ3SHW.2~SYDM76CRM1VQ.1 size=18458 2024-09-12T17:18:18.970 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.969+0000 7f574d1ea780 1 > prepared multipart upload key=ENFNIFHQ3SHW upload=SYDM76CRM1VQ tag=GJSHJE9P9VC7 type=write size=2115610 2024-09-12T17:18:18.971 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.970+0000 7f574d1ea780 1 < completed part key=_multipart_YXIDO0U18839.2~8WAHHH2FPRG4.0 size=116749 2024-09-12T17:18:18.973 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.972+0000 7f574d1ea780 1 < completed multipart upload key=YXIDO0U18839 upload=8WAHHH2FPRG4 tag=V04VY448UMEM type=write size=1165325 2024-09-12T17:18:18.974 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.973+0000 7f574d1ea780 1 > prepared operation key=K12MVG618809 tag=9OTYJQJ2NY8N type=del size=3342627 2024-09-12T17:18:18.975 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.975+0000 7f574d1ea780 1 < canceled operation key=OI51GO639LFK tag=YMB24F84X72O type=del size=3300666 2024-09-12T17:18:18.978 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.977+0000 7f574d1ea780 1 > prepared operation key=TIKBUXFPVTN1 tag=2BNG6PIXG22J type=del size=1981925 2024-09-12T17:18:18.982 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.981+0000 7f574d1ea780 1 < suggested remove operation key=U6E9A5OH4GUW tag=CZ848VA0SLZE type=del 2024-09-12T17:18:18.983 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.982+0000 7f574d1ea780 1 > prepared operation key=UFKM4I8RMT0W tag=AK7BMLKH8KNZ type=del size=2569187 2024-09-12T17:18:18.985 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.984+0000 7f574d1ea780 1 < completed write operation key=ENFNIFHQ3SHW tag=6VGPLL3CPT7J type=write size=573374 2024-09-12T17:18:18.987 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.986+0000 7f574d1ea780 1 > prepared part key=_multipart_D1GEG3MKPOM3.2~M1EQBJ6Q5Y84.0 size=1048576 2024-09-12T17:18:18.988 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.987+0000 7f574d1ea780 1 > prepared part key=_multipart_D1GEG3MKPOM3.2~M1EQBJ6Q5Y84.1 size=1048576 2024-09-12T17:18:18.989 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.988+0000 7f574d1ea780 1 > prepared part key=_multipart_D1GEG3MKPOM3.2~M1EQBJ6Q5Y84.2 size=539861 2024-09-12T17:18:18.989 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.988+0000 7f574d1ea780 1 > prepared multipart upload key=D1GEG3MKPOM3 upload=M1EQBJ6Q5Y84 tag=IMJDILVXN0MM type=write size=3685589 2024-09-12T17:18:18.990 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.989+0000 7f574d1ea780 1 < completed part key=_multipart_HGZMN894YYC0.2~B59W0FVA3GNK.0 size=816707 2024-09-12T17:18:18.992 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.991+0000 7f574d1ea780 1 < completed multipart upload key=HGZMN894YYC0 upload=B59W0FVA3GNK tag=O769725MLFY0 type=write size=1865283 2024-09-12T17:18:18.993 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.992+0000 7f574d1ea780 1 > prepared operation key=UFKM4I8RMT0W tag=I17OR96HZHPX type=del size=2737363 2024-09-12T17:18:18.994 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.994+0000 7f574d1ea780 1 < completed part key=_multipart_54LQ91UMBJAN.2~VA3R0X4KOLRR.0 size=1048576 2024-09-12T17:18:18.995 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.994+0000 7f574d1ea780 1 < completed part key=_multipart_54LQ91UMBJAN.2~VA3R0X4KOLRR.1 size=1048576 2024-09-12T17:18:18.995 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.994+0000 7f574d1ea780 1 < canceled part key=_multipart_54LQ91UMBJAN.2~VA3R0X4KOLRR.2 size=602957 2024-09-12T17:18:18.998 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.997+0000 7f574d1ea780 1 < canceled multipart upload key=54LQ91UMBJAN upload=VA3R0X4KOLRR tag=VMMYT76MD30D type=write size=3748685 2024-09-12T17:18:18.999 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.998+0000 7f574d1ea780 1 > prepared operation key=U6E9A5OH4GUW tag=BY3ONCVMV485 type=del size=2112911 2024-09-12T17:18:19.000 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.999+0000 7f574d1ea780 1 < completed part key=_multipart_U6E9A5OH4GUW.2~QND5WGN92RJ9.0 size=1048576 2024-09-12T17:18:19.000 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:18.999+0000 7f574d1ea780 1 < canceled part key=_multipart_U6E9A5OH4GUW.2~QND5WGN92RJ9.1 size=88797 2024-09-12T17:18:19.002 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.001+0000 7f574d1ea780 1 < canceled multipart upload key=U6E9A5OH4GUW upload=QND5WGN92RJ9 tag=3AZ2HH4XWF7T type=write size=2185949 2024-09-12T17:18:19.003 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.002+0000 7f574d1ea780 1 > prepared operation key=8SG7DJO4HWPI tag=GVM35K7CW8SG type=del size=1535909 2024-09-12T17:18:19.005 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.004+0000 7f574d1ea780 1 < completed write operation key=TIKBUXFPVTN1 tag=THIIEG922CUE type=write size=345245 2024-09-12T17:18:19.007 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.006+0000 7f574d1ea780 1 > prepared part key=_multipart_TIKBUXFPVTN1.2~8RLXOR97T49X.0 size=1048576 2024-09-12T17:18:19.008 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.007+0000 7f574d1ea780 1 > prepared part key=_multipart_TIKBUXFPVTN1.2~8RLXOR97T49X.1 size=302738 2024-09-12T17:18:19.008 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.007+0000 7f574d1ea780 1 > prepared multipart upload key=TIKBUXFPVTN1 upload=8RLXOR97T49X tag=VUVBJORDXNLB type=write size=2399890 2024-09-12T17:18:19.009 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.009+0000 7f574d1ea780 1 < completed delete operation key=SQQMJ61CA0QW tag=I6H54CF0ASEU type=del 2024-09-12T17:18:19.012 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.011+0000 7f574d1ea780 1 > prepared part key=_multipart_DH02JGZP64MN.2~0HPDW3JCN164.0 size=331690 2024-09-12T17:18:19.012 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.011+0000 7f574d1ea780 1 > prepared multipart upload key=DH02JGZP64MN upload=0HPDW3JCN164 tag=MB3RYW9B1UJD type=write size=1380266 2024-09-12T17:18:19.013 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.012+0000 7f574d1ea780 1 < canceled operation key=55JI541K1WP2 tag=J7HCRCU2IPA1 type=del size=3513722 2024-09-12T17:18:19.014 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.013+0000 7f574d1ea780 1 > prepared operation key=8SG7DJO4HWPI tag=QIBQ0E0MDPHO type=del size=579359 2024-09-12T17:18:19.015 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.014+0000 7f574d1ea780 1 < canceled operation key=HFWA7DNUMWF2 tag=3CUIBJ1SZVO9 type=del size=1038711 2024-09-12T17:18:19.018 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.017+0000 7f574d1ea780 1 > prepared part key=_multipart_VWWA5IB0L4N1.2~DYGM11TEIGF2.0 size=1048576 2024-09-12T17:18:19.018 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.018+0000 7f574d1ea780 1 > prepared part key=_multipart_VWWA5IB0L4N1.2~DYGM11TEIGF2.1 size=1048576 2024-09-12T17:18:19.019 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.019+0000 7f574d1ea780 1 > prepared part key=_multipart_VWWA5IB0L4N1.2~DYGM11TEIGF2.2 size=198813 2024-09-12T17:18:19.020 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.019+0000 7f574d1ea780 1 > prepared multipart upload key=VWWA5IB0L4N1 upload=DYGM11TEIGF2 tag=U542IHVPI5GK type=write size=3344541 2024-09-12T17:18:19.021 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.020+0000 7f574d1ea780 1 < completed part key=_multipart_UFKM4I8RMT0W.2~8BDARUYCIU3N.0 size=1048576 2024-09-12T17:18:19.022 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.021+0000 7f574d1ea780 1 < completed part key=_multipart_UFKM4I8RMT0W.2~8BDARUYCIU3N.1 size=1048576 2024-09-12T17:18:19.022 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.022+0000 7f574d1ea780 1 < completed part key=_multipart_UFKM4I8RMT0W.2~8BDARUYCIU3N.2 size=441258 2024-09-12T17:18:19.025 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.024+0000 7f574d1ea780 1 < completed multipart upload key=UFKM4I8RMT0W upload=8BDARUYCIU3N tag=99DJHH5Y6HQJ type=write size=3586986 2024-09-12T17:18:19.026 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.025+0000 7f574d1ea780 1 > prepared operation key=55V137SY4E4P tag=PTWPUM8P5U3B type=write size=345418 2024-09-12T17:18:19.027 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.026+0000 7f574d1ea780 1 < completed delete operation key=SQQMJ61CA0QW tag=O6XUJENPX6VJ type=del 2024-09-12T17:18:19.028 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.027+0000 7f574d1ea780 1 > prepared operation key=8SG7DJO4HWPI tag=EY1G1PEWS5XA type=del size=1790781 2024-09-12T17:18:19.029 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.028+0000 7f574d1ea780 1 < completed part key=_multipart_D1GEG3MKPOM3.2~E1329IZ8M1X2.0 size=293282 2024-09-12T17:18:19.031 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.030+0000 7f574d1ea780 1 < completed multipart upload key=D1GEG3MKPOM3 upload=E1329IZ8M1X2 tag=GZQPUNVO39CX type=write size=1341858 2024-09-12T17:18:19.033 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.032+0000 7f574d1ea780 1 > prepared operation key=R00F69ON5P6Z tag=UCTPGIKP9N82 type=del size=4076394 2024-09-12T17:18:19.034 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.033+0000 7f574d1ea780 1 < completed delete operation key=ZGE1860DMGHA tag=UW02CZR57IES type=del 2024-09-12T17:18:19.036 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.035+0000 7f574d1ea780 1 > prepared part key=_multipart_DH02JGZP64MN.2~0BEKTO08EO6C.0 size=1048576 2024-09-12T17:18:19.037 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.036+0000 7f574d1ea780 1 > prepared part key=_multipart_DH02JGZP64MN.2~0BEKTO08EO6C.1 size=88825 2024-09-12T17:18:19.037 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.036+0000 7f574d1ea780 1 > prepared multipart upload key=DH02JGZP64MN upload=0BEKTO08EO6C tag=RJBZ39Z0X2L5 type=write size=2185977 2024-09-12T17:18:19.038 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.037+0000 7f574d1ea780 1 < completed part key=_multipart_ENFNIFHQ3SHW.2~SYDM76CRM1VQ.0 size=1048576 2024-09-12T17:18:19.039 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.038+0000 7f574d1ea780 1 < completed part key=_multipart_ENFNIFHQ3SHW.2~SYDM76CRM1VQ.1 size=18458 2024-09-12T17:18:19.041 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.040+0000 7f574d1ea780 1 < completed multipart upload key=ENFNIFHQ3SHW upload=SYDM76CRM1VQ tag=GJSHJE9P9VC7 type=write size=2115610 2024-09-12T17:18:19.043 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.043+0000 7f574d1ea780 1 > prepared part key=_multipart_54CM8800AT9V.2~V0928T343M24.0 size=685500 2024-09-12T17:18:19.044 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.043+0000 7f574d1ea780 1 > prepared multipart upload key=54CM8800AT9V upload=V0928T343M24 tag=ENYLJSN2XD3H type=write size=1734076 2024-09-12T17:18:19.045 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.044+0000 7f574d1ea780 1 < canceled operation key=K12MVG618809 tag=9OTYJQJ2NY8N type=del size=3342627 2024-09-12T17:18:19.047 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.046+0000 7f574d1ea780 1 > prepared part key=_multipart_HGZMN894YYC0.2~L5WA5O3V8LVK.0 size=1048576 2024-09-12T17:18:19.048 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.047+0000 7f574d1ea780 1 > prepared part key=_multipart_HGZMN894YYC0.2~L5WA5O3V8LVK.1 size=1048576 2024-09-12T17:18:19.049 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.048+0000 7f574d1ea780 1 > prepared part key=_multipart_HGZMN894YYC0.2~L5WA5O3V8LVK.2 size=212900 2024-09-12T17:18:19.049 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.048+0000 7f574d1ea780 1 > prepared multipart upload key=HGZMN894YYC0 upload=L5WA5O3V8LVK tag=JUJ83P966342 type=write size=3358628 2024-09-12T17:18:19.050 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.049+0000 7f574d1ea780 1 < canceled operation key=TIKBUXFPVTN1 tag=2BNG6PIXG22J type=del size=1981925 2024-09-12T17:18:19.052 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.051+0000 7f574d1ea780 1 > prepared part key=_multipart_55JI541K1WP2.2~O2Z57N7PZLRI.0 size=1048576 2024-09-12T17:18:19.054 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.052+0000 7f574d1ea780 1 > prepared part key=_multipart_55JI541K1WP2.2~O2Z57N7PZLRI.1 size=703543 2024-09-12T17:18:19.054 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.052+0000 7f574d1ea780 1 > prepared multipart upload key=55JI541K1WP2 upload=O2Z57N7PZLRI tag=DARWTX8PVKA3 type=write size=2800695 2024-09-12T17:18:19.055 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.054+0000 7f574d1ea780 1 < completed delete operation key=UFKM4I8RMT0W tag=AK7BMLKH8KNZ type=del 2024-09-12T17:18:19.056 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.055+0000 7f574d1ea780 1 > prepared operation key=C9IYR9CET1I8 tag=5WR8KI4T18YM type=del size=2483348 2024-09-12T17:18:19.057 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.056+0000 7f574d1ea780 1 < completed part key=_multipart_D1GEG3MKPOM3.2~M1EQBJ6Q5Y84.0 size=1048576 2024-09-12T17:18:19.058 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.057+0000 7f574d1ea780 1 < completed part key=_multipart_D1GEG3MKPOM3.2~M1EQBJ6Q5Y84.1 size=1048576 2024-09-12T17:18:19.059 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.058+0000 7f574d1ea780 1 < completed part key=_multipart_D1GEG3MKPOM3.2~M1EQBJ6Q5Y84.2 size=539861 2024-09-12T17:18:19.065 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.061+0000 7f574d1ea780 1 < completed multipart upload key=D1GEG3MKPOM3 upload=M1EQBJ6Q5Y84 tag=IMJDILVXN0MM type=write size=3685589 2024-09-12T17:18:19.065 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.063+0000 7f574d1ea780 1 > prepared part key=_multipart_ENFNIFHQ3SHW.2~GDSU7NBJMJ9K.0 size=1048576 2024-09-12T17:18:19.065 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.064+0000 7f574d1ea780 1 > prepared part key=_multipart_ENFNIFHQ3SHW.2~GDSU7NBJMJ9K.1 size=648529 2024-09-12T17:18:19.065 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.064+0000 7f574d1ea780 1 > prepared multipart upload key=ENFNIFHQ3SHW upload=GDSU7NBJMJ9K tag=GEX9OMNG4A51 type=write size=2745681 2024-09-12T17:18:19.066 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.065+0000 7f574d1ea780 1 < completed delete operation key=UFKM4I8RMT0W tag=I17OR96HZHPX type=del 2024-09-12T17:18:19.067 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.066+0000 7f574d1ea780 1 > prepared operation key=OI51GO639LFK tag=JRTHCVMYZV10 type=del size=4162935 2024-09-12T17:18:19.069 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.068+0000 7f574d1ea780 1 < completed delete operation key=U6E9A5OH4GUW tag=BY3ONCVMV485 type=del 2024-09-12T17:18:19.072 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.071+0000 7f574d1ea780 1 > prepared part key=_multipart_TIKBUXFPVTN1.2~CV0ALUNG3SUZ.0 size=1048576 2024-09-12T17:18:19.073 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.072+0000 7f574d1ea780 1 > prepared part key=_multipart_TIKBUXFPVTN1.2~CV0ALUNG3SUZ.1 size=469730 2024-09-12T17:18:19.073 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.072+0000 7f574d1ea780 1 > prepared multipart upload key=TIKBUXFPVTN1 upload=CV0ALUNG3SUZ tag=WWECF55FZQFA type=write size=2566882 2024-09-12T17:18:19.074 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.073+0000 7f574d1ea780 1 < completed delete operation key=8SG7DJO4HWPI tag=GVM35K7CW8SG type=del 2024-09-12T17:18:19.075 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.075+0000 7f574d1ea780 1 > prepared operation key=D1GEG3MKPOM3 tag=KQX9Q111R6YD type=del size=2399682 2024-09-12T17:18:19.077 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.076+0000 7f574d1ea780 1 < completed part key=_multipart_TIKBUXFPVTN1.2~8RLXOR97T49X.0 size=1048576 2024-09-12T17:18:19.078 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.077+0000 7f574d1ea780 1 < completed part key=_multipart_TIKBUXFPVTN1.2~8RLXOR97T49X.1 size=302738 2024-09-12T17:18:19.080 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.079+0000 7f574d1ea780 1 < completed multipart upload key=TIKBUXFPVTN1 upload=8RLXOR97T49X tag=VUVBJORDXNLB type=write size=2399890 2024-09-12T17:18:19.082 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.081+0000 7f574d1ea780 1 > prepared operation key=Q2Q3B1J3DAVD tag=YD43VNPG3VVY type=del size=1125944 2024-09-12T17:18:19.083 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.082+0000 7f574d1ea780 1 < completed part key=_multipart_DH02JGZP64MN.2~0HPDW3JCN164.0 size=331690 2024-09-12T17:18:19.085 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.084+0000 7f574d1ea780 1 < completed multipart upload key=DH02JGZP64MN upload=0HPDW3JCN164 tag=MB3RYW9B1UJD type=write size=1380266 2024-09-12T17:18:19.087 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.086+0000 7f574d1ea780 1 > prepared part key=_multipart_VWWA5IB0L4N1.2~M0MK72XPEZMB.0 size=623715 2024-09-12T17:18:19.087 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.086+0000 7f574d1ea780 1 > prepared multipart upload key=VWWA5IB0L4N1 upload=M0MK72XPEZMB tag=D9ZLDETRSKRG type=write size=1672291 2024-09-12T17:18:19.088 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.088+0000 7f574d1ea780 1 < completed delete operation key=8SG7DJO4HWPI tag=QIBQ0E0MDPHO type=del 2024-09-12T17:18:19.090 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.089+0000 7f574d1ea780 1 > prepared operation key=SQQMJ61CA0QW tag=QE8MWMXO3D5K type=del size=3629230 2024-09-12T17:18:19.091 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.090+0000 7f574d1ea780 1 < completed part key=_multipart_VWWA5IB0L4N1.2~DYGM11TEIGF2.0 size=1048576 2024-09-12T17:18:19.092 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.091+0000 7f574d1ea780 1 < completed part key=_multipart_VWWA5IB0L4N1.2~DYGM11TEIGF2.1 size=1048576 2024-09-12T17:18:19.093 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.092+0000 7f574d1ea780 1 < completed part key=_multipart_VWWA5IB0L4N1.2~DYGM11TEIGF2.2 size=198813 2024-09-12T17:18:19.096 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.096+0000 7f574d1ea780 1 < completed multipart upload key=VWWA5IB0L4N1 upload=DYGM11TEIGF2 tag=U542IHVPI5GK type=write size=3344541 2024-09-12T17:18:19.099 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.098+0000 7f574d1ea780 1 > prepared part key=_multipart_UTCKL1F42X8A.2~FQGFSAO80CT8.0 size=1048576 2024-09-12T17:18:19.100 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.099+0000 7f574d1ea780 1 > prepared part key=_multipart_UTCKL1F42X8A.2~FQGFSAO80CT8.1 size=1048576 2024-09-12T17:18:19.101 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.100+0000 7f574d1ea780 1 > prepared part key=_multipart_UTCKL1F42X8A.2~FQGFSAO80CT8.2 size=914452 2024-09-12T17:18:19.101 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.100+0000 7f574d1ea780 1 > prepared multipart upload key=UTCKL1F42X8A upload=FQGFSAO80CT8 tag=K72HYXEWYU5B type=write size=4060180 2024-09-12T17:18:19.102 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.101+0000 7f574d1ea780 1 < completed write operation key=55V137SY4E4P tag=PTWPUM8P5U3B type=write size=345418 2024-09-12T17:18:19.103 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.103+0000 7f574d1ea780 1 > prepared operation key=43GV2N9VBBKE tag=7C735W07P838 type=write size=141410 2024-09-12T17:18:19.105 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.104+0000 7f574d1ea780 1 < completed delete operation key=8SG7DJO4HWPI tag=EY1G1PEWS5XA type=del 2024-09-12T17:18:19.106 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.105+0000 7f574d1ea780 1 > prepared operation key=TIKBUXFPVTN1 tag=5OZSLZU2LTIT type=del size=880816 2024-09-12T17:18:19.107 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.106+0000 7f574d1ea780 1 < completed delete operation key=R00F69ON5P6Z tag=UCTPGIKP9N82 type=del 2024-09-12T17:18:19.108 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.107+0000 7f574d1ea780 1 > prepared operation key=U6E9A5OH4GUW tag=SY1O1I99BCQ8 type=write size=691632 2024-09-12T17:18:19.109 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.108+0000 7f574d1ea780 1 < canceled part key=_multipart_DH02JGZP64MN.2~0BEKTO08EO6C.0 size=1048576 2024-09-12T17:18:19.109 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.109+0000 7f574d1ea780 1 < completed part key=_multipart_DH02JGZP64MN.2~0BEKTO08EO6C.1 size=88825 2024-09-12T17:18:19.111 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.111+0000 7f574d1ea780 1 < canceled multipart upload key=DH02JGZP64MN upload=0BEKTO08EO6C tag=RJBZ39Z0X2L5 type=write size=2185977 2024-09-12T17:18:19.113 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.112+0000 7f574d1ea780 1 > prepared operation key=R00F69ON5P6Z tag=GK98GGHDZ2JU type=del size=2105336 2024-09-12T17:18:19.114 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.113+0000 7f574d1ea780 1 < completed part key=_multipart_54CM8800AT9V.2~V0928T343M24.0 size=685500 2024-09-12T17:18:19.116 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.115+0000 7f574d1ea780 1 < completed multipart upload key=54CM8800AT9V upload=V0928T343M24 tag=ENYLJSN2XD3H type=write size=1734076 2024-09-12T17:18:19.117 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.116+0000 7f574d1ea780 1 > prepared operation key=D1GEG3MKPOM3 tag=I4WHO4RYENV6 type=del size=4077285 2024-09-12T17:18:19.118 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.117+0000 7f574d1ea780 1 < completed part key=_multipart_HGZMN894YYC0.2~L5WA5O3V8LVK.0 size=1048576 2024-09-12T17:18:19.119 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.118+0000 7f574d1ea780 1 < completed part key=_multipart_HGZMN894YYC0.2~L5WA5O3V8LVK.1 size=1048576 2024-09-12T17:18:19.120 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.119+0000 7f574d1ea780 1 < completed part key=_multipart_HGZMN894YYC0.2~L5WA5O3V8LVK.2 size=212900 2024-09-12T17:18:19.122 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.121+0000 7f574d1ea780 1 < completed multipart upload key=HGZMN894YYC0 upload=L5WA5O3V8LVK tag=JUJ83P966342 type=write size=3358628 2024-09-12T17:18:19.124 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.123+0000 7f574d1ea780 1 > prepared operation key=RWVWJHVZE95H tag=VFMMI4JQ4L45 type=write size=252517 2024-09-12T17:18:19.125 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.124+0000 7f574d1ea780 1 < completed part key=_multipart_55JI541K1WP2.2~O2Z57N7PZLRI.0 size=1048576 2024-09-12T17:18:19.126 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.125+0000 7f574d1ea780 1 < completed part key=_multipart_55JI541K1WP2.2~O2Z57N7PZLRI.1 size=703543 2024-09-12T17:18:19.128 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.127+0000 7f574d1ea780 1 < completed multipart upload key=55JI541K1WP2 upload=O2Z57N7PZLRI tag=DARWTX8PVKA3 type=write size=2800695 2024-09-12T17:18:19.129 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.128+0000 7f574d1ea780 1 > prepared operation key=ENFNIFHQ3SHW tag=0TEBDHXJQADQ type=del size=593068 2024-09-12T17:18:19.130 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.129+0000 7f574d1ea780 1 < completed delete operation key=C9IYR9CET1I8 tag=5WR8KI4T18YM type=del 2024-09-12T17:18:19.133 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.132+0000 7f574d1ea780 1 > prepared part key=_multipart_U6E9A5OH4GUW.2~HIYC31IR6XSO.0 size=1048576 2024-09-12T17:18:19.134 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.133+0000 7f574d1ea780 1 > prepared part key=_multipart_U6E9A5OH4GUW.2~HIYC31IR6XSO.1 size=1004341 2024-09-12T17:18:19.134 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.133+0000 7f574d1ea780 1 > prepared multipart upload key=U6E9A5OH4GUW upload=HIYC31IR6XSO tag=A6D9R6TDFOJZ type=write size=3101493 2024-09-12T17:18:19.135 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.134+0000 7f574d1ea780 1 < completed part key=_multipart_ENFNIFHQ3SHW.2~GDSU7NBJMJ9K.0 size=1048576 2024-09-12T17:18:19.136 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.135+0000 7f574d1ea780 1 < completed part key=_multipart_ENFNIFHQ3SHW.2~GDSU7NBJMJ9K.1 size=648529 2024-09-12T17:18:19.138 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.138+0000 7f574d1ea780 1 < completed multipart upload key=ENFNIFHQ3SHW upload=GDSU7NBJMJ9K tag=GEX9OMNG4A51 type=write size=2745681 2024-09-12T17:18:19.140 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.139+0000 7f574d1ea780 1 > prepared operation key=7BX38Q7723EB tag=EXWVJUE47T2O type=del size=672352 2024-09-12T17:18:19.141 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.140+0000 7f574d1ea780 1 < completed delete operation key=OI51GO639LFK tag=JRTHCVMYZV10 type=del 2024-09-12T17:18:19.143 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.142+0000 7f574d1ea780 1 > prepared part key=_multipart_55JI541K1WP2.2~XG26D3FJ3PUN.0 size=1048576 2024-09-12T17:18:19.144 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.143+0000 7f574d1ea780 1 > prepared part key=_multipart_55JI541K1WP2.2~XG26D3FJ3PUN.1 size=1048576 2024-09-12T17:18:19.145 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.144+0000 7f574d1ea780 1 > prepared part key=_multipart_55JI541K1WP2.2~XG26D3FJ3PUN.2 size=126897 2024-09-12T17:18:19.145 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.144+0000 7f574d1ea780 1 > prepared multipart upload key=55JI541K1WP2 upload=XG26D3FJ3PUN tag=2ZPRF81OKP1C type=write size=3272625 2024-09-12T17:18:19.147 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.146+0000 7f574d1ea780 1 < completed part key=_multipart_TIKBUXFPVTN1.2~CV0ALUNG3SUZ.0 size=1048576 2024-09-12T17:18:19.148 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.147+0000 7f574d1ea780 1 < completed part key=_multipart_TIKBUXFPVTN1.2~CV0ALUNG3SUZ.1 size=469730 2024-09-12T17:18:19.150 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.149+0000 7f574d1ea780 1 < completed multipart upload key=TIKBUXFPVTN1 upload=CV0ALUNG3SUZ tag=WWECF55FZQFA type=write size=2566882 2024-09-12T17:18:19.151 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.150+0000 7f574d1ea780 1 > prepared operation key=Q2Q3B1J3DAVD tag=JNSB1X9TAL9R type=write size=957410 2024-09-12T17:18:19.152 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.151+0000 7f574d1ea780 1 < completed delete operation key=D1GEG3MKPOM3 tag=KQX9Q111R6YD type=del 2024-09-12T17:18:19.153 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.153+0000 7f574d1ea780 1 > prepared operation key=UTCKL1F42X8A tag=U3GV54R7J17M type=del size=577900 2024-09-12T17:18:19.156 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.155+0000 7f574d1ea780 1 < suggested update operation key=Q2Q3B1J3DAVD tag=YD43VNPG3VVY type=del size=1125944 2024-09-12T17:18:19.157 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.156+0000 7f574d1ea780 1 > prepared operation key=SQQMJ61CA0QW tag=PKOFU8WEYNZY type=write size=325035 2024-09-12T17:18:19.158 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.158+0000 7f574d1ea780 1 < completed part key=_multipart_VWWA5IB0L4N1.2~M0MK72XPEZMB.0 size=623715 2024-09-12T17:18:19.161 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.160+0000 7f574d1ea780 1 < completed multipart upload key=VWWA5IB0L4N1 upload=M0MK72XPEZMB tag=D9ZLDETRSKRG type=write size=1672291 2024-09-12T17:18:19.162 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.161+0000 7f574d1ea780 1 > prepared operation key=SQQMJ61CA0QW tag=SHJ03DJ82VMB type=del size=4166136 2024-09-12T17:18:19.163 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.162+0000 7f574d1ea780 1 < completed delete operation key=SQQMJ61CA0QW tag=QE8MWMXO3D5K type=del 2024-09-12T17:18:19.165 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.164+0000 7f574d1ea780 1 > prepared part key=_multipart_HFWA7DNUMWF2.2~VR2NGPYWYYV3.0 size=1048576 2024-09-12T17:18:19.166 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.165+0000 7f574d1ea780 1 > prepared part key=_multipart_HFWA7DNUMWF2.2~VR2NGPYWYYV3.1 size=83697 2024-09-12T17:18:19.167 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.165+0000 7f574d1ea780 1 > prepared multipart upload key=HFWA7DNUMWF2 upload=VR2NGPYWYYV3 tag=BFA4Q0WWV8FG type=write size=2180849 2024-09-12T17:18:19.168 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.167+0000 7f574d1ea780 1 < completed part key=_multipart_UTCKL1F42X8A.2~FQGFSAO80CT8.0 size=1048576 2024-09-12T17:18:19.169 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.168+0000 7f574d1ea780 1 < completed part key=_multipart_UTCKL1F42X8A.2~FQGFSAO80CT8.1 size=1048576 2024-09-12T17:18:19.170 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.169+0000 7f574d1ea780 1 < completed part key=_multipart_UTCKL1F42X8A.2~FQGFSAO80CT8.2 size=914452 2024-09-12T17:18:19.172 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.171+0000 7f574d1ea780 1 < completed multipart upload key=UTCKL1F42X8A upload=FQGFSAO80CT8 tag=K72HYXEWYU5B type=write size=4060180 2024-09-12T17:18:19.173 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.172+0000 7f574d1ea780 1 > prepared operation key=ZGH8XC39FGTC tag=NWOQRAMU59A9 type=del size=3729684 2024-09-12T17:18:19.174 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.173+0000 7f574d1ea780 1 < canceled operation key=43GV2N9VBBKE tag=7C735W07P838 type=write size=141410 2024-09-12T17:18:19.176 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.175+0000 7f574d1ea780 1 > prepared operation key=7BX38Q7723EB tag=1DRPA3D4VE81 type=del size=3818382 2024-09-12T17:18:19.177 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.176+0000 7f574d1ea780 1 < completed delete operation key=TIKBUXFPVTN1 tag=5OZSLZU2LTIT type=del 2024-09-12T17:18:19.178 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.177+0000 7f574d1ea780 1 > prepared operation key=K12MVG618809 tag=4QXO07A19IKL type=del size=728026 2024-09-12T17:18:19.179 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.179+0000 7f574d1ea780 1 < completed write operation key=U6E9A5OH4GUW tag=SY1O1I99BCQ8 type=write size=691632 2024-09-12T17:18:19.181 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.180+0000 7f574d1ea780 1 > prepared operation key=GEGOEB05R0PK tag=ZX3MSEYNWS8C type=del size=819551 2024-09-12T17:18:19.182 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.181+0000 7f574d1ea780 1 < completed delete operation key=R00F69ON5P6Z tag=GK98GGHDZ2JU type=del 2024-09-12T17:18:19.183 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.183+0000 7f574d1ea780 1 > prepared operation key=HGZMN894YYC0 tag=TXF2CNPG8Y2M type=del size=397954 2024-09-12T17:18:19.185 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.184+0000 7f574d1ea780 1 < completed delete operation key=D1GEG3MKPOM3 tag=I4WHO4RYENV6 type=del 2024-09-12T17:18:19.186 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.185+0000 7f574d1ea780 1 > prepared operation key=ZGE1860DMGHA tag=KMXY3QH3LR8U type=del size=928248 2024-09-12T17:18:19.187 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.186+0000 7f574d1ea780 1 < completed write operation key=RWVWJHVZE95H tag=VFMMI4JQ4L45 type=write size=252517 2024-09-12T17:18:19.189 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.189+0000 7f574d1ea780 1 > prepared part key=_multipart_43GV2N9VBBKE.2~6QFQ73JS5A4J.0 size=285180 2024-09-12T17:18:19.190 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.189+0000 7f574d1ea780 1 > prepared multipart upload key=43GV2N9VBBKE upload=6QFQ73JS5A4J tag=YPCCPNSN6U41 type=write size=1333756 2024-09-12T17:18:19.191 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.190+0000 7f574d1ea780 1 < canceled operation key=ENFNIFHQ3SHW tag=0TEBDHXJQADQ type=del size=593068 2024-09-12T17:18:19.193 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.192+0000 7f574d1ea780 1 > prepared part key=_multipart_8SG7DJO4HWPI.2~W0OGVHMPN6O4.0 size=1048576 2024-09-12T17:18:19.195 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.194+0000 7f574d1ea780 1 > prepared part key=_multipart_8SG7DJO4HWPI.2~W0OGVHMPN6O4.1 size=445226 2024-09-12T17:18:19.195 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.194+0000 7f574d1ea780 1 > prepared multipart upload key=8SG7DJO4HWPI upload=W0OGVHMPN6O4 tag=AIQRQI8YG0S9 type=write size=2542378 2024-09-12T17:18:19.196 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.195+0000 7f574d1ea780 1 < completed part key=_multipart_U6E9A5OH4GUW.2~HIYC31IR6XSO.0 size=1048576 2024-09-12T17:18:19.197 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.196+0000 7f574d1ea780 1 < completed part key=_multipart_U6E9A5OH4GUW.2~HIYC31IR6XSO.1 size=1004341 2024-09-12T17:18:19.199 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.198+0000 7f574d1ea780 1 < completed multipart upload key=U6E9A5OH4GUW upload=HIYC31IR6XSO tag=A6D9R6TDFOJZ type=write size=3101493 2024-09-12T17:18:19.201 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.200+0000 7f574d1ea780 1 > prepared part key=_multipart_RNI86YYLADT0.2~CG11IZFUCM1V.0 size=919287 2024-09-12T17:18:19.201 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.200+0000 7f574d1ea780 1 > prepared multipart upload key=RNI86YYLADT0 upload=CG11IZFUCM1V tag=I712NGYB84A2 type=write size=1967863 2024-09-12T17:18:19.202 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.201+0000 7f574d1ea780 1 < canceled operation key=7BX38Q7723EB tag=EXWVJUE47T2O type=del size=672352 2024-09-12T17:18:19.204 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.203+0000 7f574d1ea780 1 > prepared operation key=8SG7DJO4HWPI tag=L2FSOG5LK81N type=del size=1945584 2024-09-12T17:18:19.205 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.204+0000 7f574d1ea780 1 < completed part key=_multipart_55JI541K1WP2.2~XG26D3FJ3PUN.0 size=1048576 2024-09-12T17:18:19.206 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.205+0000 7f574d1ea780 1 < completed part key=_multipart_55JI541K1WP2.2~XG26D3FJ3PUN.1 size=1048576 2024-09-12T17:18:19.207 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.206+0000 7f574d1ea780 1 < completed part key=_multipart_55JI541K1WP2.2~XG26D3FJ3PUN.2 size=126897 2024-09-12T17:18:19.209 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.208+0000 7f574d1ea780 1 < completed multipart upload key=55JI541K1WP2 upload=XG26D3FJ3PUN tag=2ZPRF81OKP1C type=write size=3272625 2024-09-12T17:18:19.210 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.209+0000 7f574d1ea780 1 > prepared operation key=K12MVG618809 tag=FYVGFVECQHDP type=write size=362541 2024-09-12T17:18:19.213 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.212+0000 7f574d1ea780 -1 < failed to complete operation key=Q2Q3B1J3DAVD tag=JNSB1X9TAL9R type=write size=957410: (22) Invalid argument 2024-09-12T17:18:19.214 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.213+0000 7f574d1ea780 1 > prepared operation key=K12MVG618809 tag=70HZLN6CIG7Q type=del size=3310187 2024-09-12T17:18:19.215 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.215+0000 7f574d1ea780 1 < completed delete operation key=UTCKL1F42X8A tag=U3GV54R7J17M type=del 2024-09-12T17:18:19.217 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.216+0000 7f574d1ea780 1 > prepared operation key=OI51GO639LFK tag=7WZOYD0KE2HB type=write size=576884 2024-09-12T17:18:19.219 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.218+0000 7f574d1ea780 1 < suggested update operation key=SQQMJ61CA0QW tag=PKOFU8WEYNZY type=write size=325035 2024-09-12T17:18:19.221 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.221+0000 7f574d1ea780 1 > prepared part key=_multipart_SQQMJ61CA0QW.2~BWDQAZN3CO1Y.0 size=48489 2024-09-12T17:18:19.222 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.221+0000 7f574d1ea780 1 > prepared multipart upload key=SQQMJ61CA0QW upload=BWDQAZN3CO1Y tag=OU51NKON78I4 type=write size=1097065 2024-09-12T17:18:19.223 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.222+0000 7f574d1ea780 -1 < failed to complete operation key=SQQMJ61CA0QW tag=SHJ03DJ82VMB type=del size=4166136: (22) Invalid argument 2024-09-12T17:18:19.225 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.224+0000 7f574d1ea780 1 > prepared part key=_multipart_SQQMJ61CA0QW.2~I22K4VFV2X67.0 size=1048576 2024-09-12T17:18:19.226 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.225+0000 7f574d1ea780 1 > prepared part key=_multipart_SQQMJ61CA0QW.2~I22K4VFV2X67.1 size=1048576 2024-09-12T17:18:19.227 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.226+0000 7f574d1ea780 1 > prepared part key=_multipart_SQQMJ61CA0QW.2~I22K4VFV2X67.2 size=495540 2024-09-12T17:18:19.227 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.226+0000 7f574d1ea780 1 > prepared multipart upload key=SQQMJ61CA0QW upload=I22K4VFV2X67 tag=51BO9IEDR9XA type=write size=3641268 2024-09-12T17:18:19.228 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.227+0000 7f574d1ea780 1 < completed part key=_multipart_HFWA7DNUMWF2.2~VR2NGPYWYYV3.0 size=1048576 2024-09-12T17:18:19.229 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.228+0000 7f574d1ea780 1 < completed part key=_multipart_HFWA7DNUMWF2.2~VR2NGPYWYYV3.1 size=83697 2024-09-12T17:18:19.231 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.230+0000 7f574d1ea780 1 < completed multipart upload key=HFWA7DNUMWF2 upload=VR2NGPYWYYV3 tag=BFA4Q0WWV8FG type=write size=2180849 2024-09-12T17:18:19.233 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.232+0000 7f574d1ea780 1 > prepared operation key=ZGH8XC39FGTC tag=KU72BG3FKDX3 type=del size=2159696 2024-09-12T17:18:19.235 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.234+0000 7f574d1ea780 1 < suggested remove operation key=ZGH8XC39FGTC tag=NWOQRAMU59A9 type=del 2024-09-12T17:18:19.236 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.235+0000 7f574d1ea780 1 > prepared operation key=55JI541K1WP2 tag=2QTT08FJ2RTI type=del size=1125204 2024-09-12T17:18:19.237 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.237+0000 7f574d1ea780 1 < completed delete operation key=7BX38Q7723EB tag=1DRPA3D4VE81 type=del 2024-09-12T17:18:19.239 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.238+0000 7f574d1ea780 1 > prepared operation key=7BX38Q7723EB tag=L9YVN4HZMJ1E type=write size=887923 2024-09-12T17:18:19.240 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.239+0000 7f574d1ea780 1 < canceled operation key=K12MVG618809 tag=4QXO07A19IKL type=del size=728026 2024-09-12T17:18:19.241 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.241+0000 7f574d1ea780 1 > prepared operation key=54CM8800AT9V tag=GZAZXNCM55HM type=del size=2613920 2024-09-12T17:18:19.243 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.242+0000 7f574d1ea780 1 < completed delete operation key=GEGOEB05R0PK tag=ZX3MSEYNWS8C type=del 2024-09-12T17:18:19.245 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.244+0000 7f574d1ea780 1 > prepared part key=_multipart_54CM8800AT9V.2~9C1DFF241RX9.0 size=1048576 2024-09-12T17:18:19.246 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.245+0000 7f574d1ea780 1 > prepared part key=_multipart_54CM8800AT9V.2~9C1DFF241RX9.1 size=1027966 2024-09-12T17:18:19.246 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.245+0000 7f574d1ea780 1 > prepared multipart upload key=54CM8800AT9V upload=9C1DFF241RX9 tag=WJK2ABZ9FT9G type=write size=3125118 2024-09-12T17:18:19.248 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.247+0000 7f574d1ea780 1 < suggested remove operation key=HGZMN894YYC0 tag=TXF2CNPG8Y2M type=del 2024-09-12T17:18:19.249 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.248+0000 7f574d1ea780 1 > prepared operation key=A1TIP3RXHBCZ tag=XV7567IP3TIV type=del size=2633247 2024-09-12T17:18:19.250 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.249+0000 7f574d1ea780 1 < canceled operation key=ZGE1860DMGHA tag=KMXY3QH3LR8U type=del size=928248 2024-09-12T17:18:19.252 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.251+0000 7f574d1ea780 1 > prepared operation key=K12MVG618809 tag=CSZQ06VE4642 type=del size=1598704 2024-09-12T17:18:19.253 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.252+0000 7f574d1ea780 1 < completed part key=_multipart_43GV2N9VBBKE.2~6QFQ73JS5A4J.0 size=285180 2024-09-12T17:18:19.255 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.254+0000 7f574d1ea780 1 < completed multipart upload key=43GV2N9VBBKE upload=6QFQ73JS5A4J tag=YPCCPNSN6U41 type=write size=1333756 2024-09-12T17:18:19.256 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.255+0000 7f574d1ea780 1 > prepared operation key=55JI541K1WP2 tag=L9CZ9SE84MSL type=del size=1599637 2024-09-12T17:18:19.257 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.256+0000 7f574d1ea780 1 < completed part key=_multipart_8SG7DJO4HWPI.2~W0OGVHMPN6O4.0 size=1048576 2024-09-12T17:18:19.258 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.258+0000 7f574d1ea780 1 < completed part key=_multipart_8SG7DJO4HWPI.2~W0OGVHMPN6O4.1 size=445226 2024-09-12T17:18:19.260 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.260+0000 7f574d1ea780 1 < completed multipart upload key=8SG7DJO4HWPI upload=W0OGVHMPN6O4 tag=AIQRQI8YG0S9 type=write size=2542378 2024-09-12T17:18:19.262 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.261+0000 7f574d1ea780 1 > prepared operation key=54CM8800AT9V tag=2PIT2YFUJO1H type=del size=2163115 2024-09-12T17:18:19.263 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.262+0000 7f574d1ea780 1 < completed part key=_multipart_RNI86YYLADT0.2~CG11IZFUCM1V.0 size=919287 2024-09-12T17:18:19.265 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.264+0000 7f574d1ea780 1 < completed multipart upload key=RNI86YYLADT0 upload=CG11IZFUCM1V tag=I712NGYB84A2 type=write size=1967863 2024-09-12T17:18:19.266 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.265+0000 7f574d1ea780 1 > prepared operation key=RNI86YYLADT0 tag=7FYKJ8SKA8BL type=write size=206558 2024-09-12T17:18:19.267 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.266+0000 7f574d1ea780 1 < canceled operation key=8SG7DJO4HWPI tag=L2FSOG5LK81N type=del size=1945584 2024-09-12T17:18:19.269 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.268+0000 7f574d1ea780 1 > prepared operation key=VWWA5IB0L4N1 tag=BZXIJQ4AIEOR type=del size=1889733 2024-09-12T17:18:19.270 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.269+0000 7f574d1ea780 1 < completed write operation key=K12MVG618809 tag=FYVGFVECQHDP type=write size=362541 2024-09-12T17:18:19.271 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.270+0000 7f574d1ea780 1 > prepared operation key=VWWA5IB0L4N1 tag=DVGDEMTZAYSY type=del size=793214 2024-09-12T17:18:19.273 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.272+0000 7f574d1ea780 1 < suggested remove operation key=K12MVG618809 tag=70HZLN6CIG7Q type=del 2024-09-12T17:18:19.274 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.273+0000 7f574d1ea780 1 > prepared operation key=HGZMN894YYC0 tag=2GFKRXGRO8GU type=del size=3705098 2024-09-12T17:18:19.275 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.275+0000 7f574d1ea780 1 < completed write operation key=OI51GO639LFK tag=7WZOYD0KE2HB type=write size=576884 2024-09-12T17:18:19.277 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.276+0000 7f574d1ea780 1 > prepared operation key=Q2Q3B1J3DAVD tag=C463ZSYIOQMQ type=del size=3343388 2024-09-12T17:18:19.278 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.277+0000 7f574d1ea780 1 < completed part key=_multipart_SQQMJ61CA0QW.2~BWDQAZN3CO1Y.0 size=48489 2024-09-12T17:18:19.280 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.279+0000 7f574d1ea780 1 < completed multipart upload key=SQQMJ61CA0QW upload=BWDQAZN3CO1Y tag=OU51NKON78I4 type=write size=1097065 2024-09-12T17:18:19.281 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.280+0000 7f574d1ea780 1 > prepared operation key=HFWA7DNUMWF2 tag=38B1YAH5WQOG type=del size=1818903 2024-09-12T17:18:19.282 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.282+0000 7f574d1ea780 1 < completed part key=_multipart_SQQMJ61CA0QW.2~I22K4VFV2X67.0 size=1048576 2024-09-12T17:18:19.283 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.283+0000 7f574d1ea780 1 < completed part key=_multipart_SQQMJ61CA0QW.2~I22K4VFV2X67.1 size=1048576 2024-09-12T17:18:19.284 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.283+0000 7f574d1ea780 1 < completed part key=_multipart_SQQMJ61CA0QW.2~I22K4VFV2X67.2 size=495540 2024-09-12T17:18:19.286 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.286+0000 7f574d1ea780 1 < completed multipart upload key=SQQMJ61CA0QW upload=I22K4VFV2X67 tag=51BO9IEDR9XA type=write size=3641268 2024-09-12T17:18:19.288 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.287+0000 7f574d1ea780 1 > prepared operation key=TIKBUXFPVTN1 tag=CPUFB7NHWE7B type=del size=3449125 2024-09-12T17:18:19.289 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.288+0000 7f574d1ea780 -1 < failed to complete operation key=ZGH8XC39FGTC tag=KU72BG3FKDX3 type=del size=2159696: (22) Invalid argument 2024-09-12T17:18:19.290 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.289+0000 7f574d1ea780 1 > prepared operation key=UTCKL1F42X8A tag=6UMI6ON81ABD type=del size=88658 2024-09-12T17:18:19.292 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.291+0000 7f574d1ea780 1 < completed delete operation key=55JI541K1WP2 tag=2QTT08FJ2RTI type=del 2024-09-12T17:18:19.293 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.292+0000 7f574d1ea780 1 > prepared operation key=54LQ91UMBJAN tag=I29Z2NUGJYF7 type=del size=1694410 2024-09-12T17:18:19.294 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.293+0000 7f574d1ea780 1 < completed write operation key=7BX38Q7723EB tag=L9YVN4HZMJ1E type=write size=887923 2024-09-12T17:18:19.296 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.295+0000 7f574d1ea780 1 > prepared part key=_multipart_VWWA5IB0L4N1.2~ZC5EL8JI43XB.0 size=72237 2024-09-12T17:18:19.296 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.295+0000 7f574d1ea780 1 > prepared multipart upload key=VWWA5IB0L4N1 upload=ZC5EL8JI43XB tag=0QFT2K31UTJX type=write size=1120813 2024-09-12T17:18:19.299 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.298+0000 7f574d1ea780 1 < completed delete operation key=54CM8800AT9V tag=GZAZXNCM55HM type=del 2024-09-12T17:18:19.301 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.300+0000 7f574d1ea780 1 > prepared part key=_multipart_A1TIP3RXHBCZ.2~ZYVA34T2Q66E.0 size=1048576 2024-09-12T17:18:19.302 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.301+0000 7f574d1ea780 1 > prepared part key=_multipart_A1TIP3RXHBCZ.2~ZYVA34T2Q66E.1 size=1048576 2024-09-12T17:18:19.303 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.302+0000 7f574d1ea780 1 > prepared part key=_multipart_A1TIP3RXHBCZ.2~ZYVA34T2Q66E.2 size=424145 2024-09-12T17:18:19.303 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.302+0000 7f574d1ea780 1 > prepared multipart upload key=A1TIP3RXHBCZ upload=ZYVA34T2Q66E tag=USJE0B9HIDDK type=write size=3569873 2024-09-12T17:18:19.304 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.303+0000 7f574d1ea780 1 < completed part key=_multipart_54CM8800AT9V.2~9C1DFF241RX9.0 size=1048576 2024-09-12T17:18:19.305 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.304+0000 7f574d1ea780 1 < completed part key=_multipart_54CM8800AT9V.2~9C1DFF241RX9.1 size=1027966 2024-09-12T17:18:19.307 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.306+0000 7f574d1ea780 1 < completed multipart upload key=54CM8800AT9V upload=9C1DFF241RX9 tag=WJK2ABZ9FT9G type=write size=3125118 2024-09-12T17:18:19.308 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.308+0000 7f574d1ea780 1 > prepared operation key=Q2Q3B1J3DAVD tag=S75RWV32DLT1 type=del size=43621 2024-09-12T17:18:19.310 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.309+0000 7f574d1ea780 1 < completed delete operation key=A1TIP3RXHBCZ tag=XV7567IP3TIV type=del 2024-09-12T17:18:19.311 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.310+0000 7f574d1ea780 1 > prepared operation key=C9IYR9CET1I8 tag=4YQFCK2DKR0S type=del size=2990014 2024-09-12T17:18:19.312 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.311+0000 7f574d1ea780 -1 < failed to complete operation key=K12MVG618809 tag=CSZQ06VE4642 type=del size=1598704: (22) Invalid argument 2024-09-12T17:18:19.313 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.312+0000 7f574d1ea780 1 > prepared operation key=RNI86YYLADT0 tag=CBF4K0AYLO65 type=del size=1445943 2024-09-12T17:18:19.314 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.313+0000 7f574d1ea780 1 < completed delete operation key=55JI541K1WP2 tag=L9CZ9SE84MSL type=del 2024-09-12T17:18:19.316 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.315+0000 7f574d1ea780 1 > prepared operation key=ENFNIFHQ3SHW tag=2C0ENTQC7GBH type=del size=903016 2024-09-12T17:18:19.317 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.316+0000 7f574d1ea780 1 < completed delete operation key=54CM8800AT9V tag=2PIT2YFUJO1H type=del 2024-09-12T17:18:19.319 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.318+0000 7f574d1ea780 1 > prepared part key=_multipart_SQQMJ61CA0QW.2~Y657US9CWERJ.0 size=84647 2024-09-12T17:18:19.319 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.318+0000 7f574d1ea780 1 > prepared multipart upload key=SQQMJ61CA0QW upload=Y657US9CWERJ tag=TISJRXUPW4AX type=write size=1133223 2024-09-12T17:18:19.320 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.319+0000 7f574d1ea780 1 < canceled operation key=RNI86YYLADT0 tag=7FYKJ8SKA8BL type=write size=206558 2024-09-12T17:18:19.322 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.321+0000 7f574d1ea780 1 > prepared part key=_multipart_ZGH8XC39FGTC.2~HK7BMSV30C0V.0 size=1048576 2024-09-12T17:18:19.323 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.322+0000 7f574d1ea780 1 > prepared part key=_multipart_ZGH8XC39FGTC.2~HK7BMSV30C0V.1 size=1048576 2024-09-12T17:18:19.324 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.323+0000 7f574d1ea780 1 > prepared part key=_multipart_ZGH8XC39FGTC.2~HK7BMSV30C0V.2 size=577179 2024-09-12T17:18:19.324 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.323+0000 7f574d1ea780 1 > prepared multipart upload key=ZGH8XC39FGTC upload=HK7BMSV30C0V tag=9NQL07KS7RXR type=write size=3722907 2024-09-12T17:18:19.325 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.325+0000 7f574d1ea780 1 < completed delete operation key=VWWA5IB0L4N1 tag=BZXIJQ4AIEOR type=del 2024-09-12T17:18:19.328 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.327+0000 7f574d1ea780 1 > prepared part key=_multipart_ZGH8XC39FGTC.2~6FYGD1QIDQI5.0 size=1048576 2024-09-12T17:18:19.330 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.329+0000 7f574d1ea780 1 > prepared part key=_multipart_ZGH8XC39FGTC.2~6FYGD1QIDQI5.1 size=1048576 2024-09-12T17:18:19.331 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.330+0000 7f574d1ea780 1 > prepared part key=_multipart_ZGH8XC39FGTC.2~6FYGD1QIDQI5.2 size=536899 2024-09-12T17:18:19.331 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.330+0000 7f574d1ea780 1 > prepared multipart upload key=ZGH8XC39FGTC upload=6FYGD1QIDQI5 tag=1CZ25W131JQM type=write size=3682627 2024-09-12T17:18:19.332 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.331+0000 7f574d1ea780 1 < completed delete operation key=VWWA5IB0L4N1 tag=DVGDEMTZAYSY type=del 2024-09-12T17:18:19.334 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.333+0000 7f574d1ea780 1 > prepared part key=_multipart_HFWA7DNUMWF2.2~XBN1PGSX0N8I.0 size=1048576 2024-09-12T17:18:19.335 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.334+0000 7f574d1ea780 1 > prepared part key=_multipart_HFWA7DNUMWF2.2~XBN1PGSX0N8I.1 size=1048576 2024-09-12T17:18:19.336 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.335+0000 7f574d1ea780 1 > prepared part key=_multipart_HFWA7DNUMWF2.2~XBN1PGSX0N8I.2 size=335184 2024-09-12T17:18:19.336 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.335+0000 7f574d1ea780 1 > prepared multipart upload key=HFWA7DNUMWF2 upload=XBN1PGSX0N8I tag=073E4QI6SWH7 type=write size=3480912 2024-09-12T17:18:19.338 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.337+0000 7f574d1ea780 1 < suggested update operation key=HGZMN894YYC0 tag=2GFKRXGRO8GU type=del size=3705098 2024-09-12T17:18:19.340 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.339+0000 7f574d1ea780 1 > prepared part key=_multipart_SQQMJ61CA0QW.2~2IVTNIS801L3.0 size=1048576 2024-09-12T17:18:19.341 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.340+0000 7f574d1ea780 1 > prepared part key=_multipart_SQQMJ61CA0QW.2~2IVTNIS801L3.1 size=464951 2024-09-12T17:18:19.341 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.340+0000 7f574d1ea780 1 > prepared multipart upload key=SQQMJ61CA0QW upload=2IVTNIS801L3 tag=33G2K0QN00XI type=write size=2562103 2024-09-12T17:18:19.342 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.341+0000 7f574d1ea780 1 < completed delete operation key=Q2Q3B1J3DAVD tag=C463ZSYIOQMQ type=del 2024-09-12T17:18:19.343 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.343+0000 7f574d1ea780 1 > prepared operation key=8SG7DJO4HWPI tag=ZTMOXN4V27EC type=del size=2369788 2024-09-12T17:18:19.345 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.344+0000 7f574d1ea780 1 < completed delete operation key=HFWA7DNUMWF2 tag=38B1YAH5WQOG type=del 2024-09-12T17:18:19.346 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.345+0000 7f574d1ea780 1 > prepared operation key=SQQMJ61CA0QW tag=3MG2W1CLG344 type=del size=348080 2024-09-12T17:18:19.347 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.346+0000 7f574d1ea780 1 < canceled operation key=TIKBUXFPVTN1 tag=CPUFB7NHWE7B type=del size=3449125 2024-09-12T17:18:19.349 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.348+0000 7f574d1ea780 1 > prepared part key=_multipart_Q2Q3B1J3DAVD.2~CXOC4749UQ0Q.0 size=141898 2024-09-12T17:18:19.349 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.348+0000 7f574d1ea780 1 > prepared multipart upload key=Q2Q3B1J3DAVD upload=CXOC4749UQ0Q tag=4DHP1MBCXXQN type=write size=1190474 2024-09-12T17:18:19.350 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.350+0000 7f574d1ea780 1 < canceled operation key=UTCKL1F42X8A tag=6UMI6ON81ABD type=del size=88658 2024-09-12T17:18:19.352 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.351+0000 7f574d1ea780 1 > prepared operation key=8SG7DJO4HWPI tag=ITEEVREALPMK type=del size=1204508 2024-09-12T17:18:19.354 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.353+0000 7f574d1ea780 1 < suggested update operation key=54LQ91UMBJAN tag=I29Z2NUGJYF7 type=del size=1694410 2024-09-12T17:18:19.356 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.355+0000 7f574d1ea780 1 > prepared part key=_multipart_HGZMN894YYC0.2~72MV2DS9RM62.0 size=1048576 2024-09-12T17:18:19.357 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.356+0000 7f574d1ea780 1 > prepared part key=_multipart_HGZMN894YYC0.2~72MV2DS9RM62.1 size=307740 2024-09-12T17:18:19.357 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.356+0000 7f574d1ea780 1 > prepared multipart upload key=HGZMN894YYC0 upload=72MV2DS9RM62 tag=11KON0AXGZRS type=write size=2404892 2024-09-12T17:18:19.358 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.357+0000 7f574d1ea780 1 < completed part key=_multipart_VWWA5IB0L4N1.2~ZC5EL8JI43XB.0 size=72237 2024-09-12T17:18:19.360 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.359+0000 7f574d1ea780 1 < completed multipart upload key=VWWA5IB0L4N1 upload=ZC5EL8JI43XB tag=0QFT2K31UTJX type=write size=1120813 2024-09-12T17:18:19.362 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.361+0000 7f574d1ea780 1 > prepared part key=_multipart_K12MVG618809.2~PA4QD2TCLCZN.0 size=996940 2024-09-12T17:18:19.362 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.361+0000 7f574d1ea780 1 > prepared multipart upload key=K12MVG618809 upload=PA4QD2TCLCZN tag=3RRTM5RFO6CK type=write size=2045516 2024-09-12T17:18:19.363 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.362+0000 7f574d1ea780 1 < completed part key=_multipart_A1TIP3RXHBCZ.2~ZYVA34T2Q66E.0 size=1048576 2024-09-12T17:18:19.364 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.363+0000 7f574d1ea780 1 < completed part key=_multipart_A1TIP3RXHBCZ.2~ZYVA34T2Q66E.1 size=1048576 2024-09-12T17:18:19.365 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.364+0000 7f574d1ea780 1 < completed part key=_multipart_A1TIP3RXHBCZ.2~ZYVA34T2Q66E.2 size=424145 2024-09-12T17:18:19.367 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.366+0000 7f574d1ea780 1 < completed multipart upload key=A1TIP3RXHBCZ upload=ZYVA34T2Q66E tag=USJE0B9HIDDK type=write size=3569873 2024-09-12T17:18:19.369 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.368+0000 7f574d1ea780 1 > prepared part key=_multipart_RWVWJHVZE95H.2~LJ21GWRWB3HD.0 size=1048576 2024-09-12T17:18:19.370 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.369+0000 7f574d1ea780 1 > prepared part key=_multipart_RWVWJHVZE95H.2~LJ21GWRWB3HD.1 size=518309 2024-09-12T17:18:19.370 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.369+0000 7f574d1ea780 1 > prepared multipart upload key=RWVWJHVZE95H upload=LJ21GWRWB3HD tag=SLJ1Z6OY8FTO type=write size=2615461 2024-09-12T17:18:19.371 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.370+0000 7f574d1ea780 1 < completed delete operation key=Q2Q3B1J3DAVD tag=S75RWV32DLT1 type=del 2024-09-12T17:18:19.373 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.372+0000 7f574d1ea780 1 > prepared operation key=ENFNIFHQ3SHW tag=HTF5424PFQDZ type=del size=3827352 2024-09-12T17:18:19.374 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.373+0000 7f574d1ea780 1 < completed delete operation key=C9IYR9CET1I8 tag=4YQFCK2DKR0S type=del 2024-09-12T17:18:19.375 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.374+0000 7f574d1ea780 1 > prepared operation key=55JI541K1WP2 tag=FMJAKI2XQ9CF type=del size=3168372 2024-09-12T17:18:19.377 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.377+0000 7f574d1ea780 1 < suggested update operation key=RNI86YYLADT0 tag=CBF4K0AYLO65 type=del size=1445943 2024-09-12T17:18:19.379 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.378+0000 7f574d1ea780 1 > prepared operation key=54LQ91UMBJAN tag=BS1RMZ17E0X3 type=del size=393914 2024-09-12T17:18:19.380 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.379+0000 7f574d1ea780 1 < completed delete operation key=ENFNIFHQ3SHW tag=2C0ENTQC7GBH type=del 2024-09-12T17:18:19.382 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.381+0000 7f574d1ea780 1 > prepared part key=_multipart_ZGH8XC39FGTC.2~GAYF8R40FEUY.0 size=222696 2024-09-12T17:18:19.382 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.381+0000 7f574d1ea780 1 > prepared multipart upload key=ZGH8XC39FGTC upload=GAYF8R40FEUY tag=RRNOBQ31ASF5 type=write size=1271272 2024-09-12T17:18:19.383 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.382+0000 7f574d1ea780 1 < completed part key=_multipart_SQQMJ61CA0QW.2~Y657US9CWERJ.0 size=84647 2024-09-12T17:18:19.385 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.384+0000 7f574d1ea780 1 < completed multipart upload key=SQQMJ61CA0QW upload=Y657US9CWERJ tag=TISJRXUPW4AX type=write size=1133223 2024-09-12T17:18:19.387 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.387+0000 7f574d1ea780 1 > prepared part key=_multipart_DH02JGZP64MN.2~WYWUJEU4J2YE.0 size=1036830 2024-09-12T17:18:19.388 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.387+0000 7f574d1ea780 1 > prepared multipart upload key=DH02JGZP64MN upload=WYWUJEU4J2YE tag=IFE87H8F17YL type=write size=2085406 2024-09-12T17:18:19.389 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.388+0000 7f574d1ea780 1 < completed part key=_multipart_ZGH8XC39FGTC.2~HK7BMSV30C0V.0 size=1048576 2024-09-12T17:18:19.390 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.389+0000 7f574d1ea780 1 < completed part key=_multipart_ZGH8XC39FGTC.2~HK7BMSV30C0V.1 size=1048576 2024-09-12T17:18:19.391 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.390+0000 7f574d1ea780 1 < completed part key=_multipart_ZGH8XC39FGTC.2~HK7BMSV30C0V.2 size=577179 2024-09-12T17:18:19.393 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.392+0000 7f574d1ea780 1 < completed multipart upload key=ZGH8XC39FGTC upload=HK7BMSV30C0V tag=9NQL07KS7RXR type=write size=3722907 2024-09-12T17:18:19.395 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.394+0000 7f574d1ea780 1 > prepared part key=_multipart_ENFNIFHQ3SHW.2~SP9MRNNLOAY4.0 size=306942 2024-09-12T17:18:19.395 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.394+0000 7f574d1ea780 1 > prepared multipart upload key=ENFNIFHQ3SHW upload=SP9MRNNLOAY4 tag=8FD92MDUCORI type=write size=1355518 2024-09-12T17:18:19.395 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.394+0000 7f574d1ea780 1 < canceled part key=_multipart_ZGH8XC39FGTC.2~6FYGD1QIDQI5.0 size=1048576 2024-09-12T17:18:19.396 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.395+0000 7f574d1ea780 1 < completed part key=_multipart_ZGH8XC39FGTC.2~6FYGD1QIDQI5.1 size=1048576 2024-09-12T17:18:19.397 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.396+0000 7f574d1ea780 1 < completed part key=_multipart_ZGH8XC39FGTC.2~6FYGD1QIDQI5.2 size=536899 2024-09-12T17:18:19.399 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.398+0000 7f574d1ea780 1 < canceled multipart upload key=ZGH8XC39FGTC upload=6FYGD1QIDQI5 tag=1CZ25W131JQM type=write size=3682627 2024-09-12T17:18:19.401 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.400+0000 7f574d1ea780 1 > prepared part key=_multipart_54LQ91UMBJAN.2~FJ946PV8J3HR.0 size=1048576 2024-09-12T17:18:19.402 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.401+0000 7f574d1ea780 1 > prepared part key=_multipart_54LQ91UMBJAN.2~FJ946PV8J3HR.1 size=840573 2024-09-12T17:18:19.402 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.401+0000 7f574d1ea780 1 > prepared multipart upload key=54LQ91UMBJAN upload=FJ946PV8J3HR tag=GRGFBKG9THKR type=write size=2937725 2024-09-12T17:18:19.404 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.403+0000 7f574d1ea780 1 < completed part key=_multipart_HFWA7DNUMWF2.2~XBN1PGSX0N8I.0 size=1048576 2024-09-12T17:18:19.404 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.404+0000 7f574d1ea780 1 < completed part key=_multipart_HFWA7DNUMWF2.2~XBN1PGSX0N8I.1 size=1048576 2024-09-12T17:18:19.405 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.405+0000 7f574d1ea780 1 < completed part key=_multipart_HFWA7DNUMWF2.2~XBN1PGSX0N8I.2 size=335184 2024-09-12T17:18:19.407 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.407+0000 7f574d1ea780 1 < completed multipart upload key=HFWA7DNUMWF2 upload=XBN1PGSX0N8I tag=073E4QI6SWH7 type=write size=3480912 2024-09-12T17:18:19.409 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.408+0000 7f574d1ea780 1 > prepared operation key=RNI86YYLADT0 tag=7NYXUQHC1PS0 type=del size=1669323 2024-09-12T17:18:19.409 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.408+0000 7f574d1ea780 1 < canceled part key=_multipart_SQQMJ61CA0QW.2~2IVTNIS801L3.0 size=1048576 2024-09-12T17:18:19.409 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.408+0000 7f574d1ea780 1 < canceled part key=_multipart_SQQMJ61CA0QW.2~2IVTNIS801L3.1 size=464951 2024-09-12T17:18:19.411 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.410+0000 7f574d1ea780 1 < canceled multipart upload key=SQQMJ61CA0QW upload=2IVTNIS801L3 tag=33G2K0QN00XI type=write size=2562103 2024-09-12T17:18:19.413 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.412+0000 7f574d1ea780 1 > prepared part key=_multipart_RNI86YYLADT0.2~BZV4MZ7EOFWO.0 size=778121 2024-09-12T17:18:19.413 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.412+0000 7f574d1ea780 1 > prepared multipart upload key=RNI86YYLADT0 upload=BZV4MZ7EOFWO tag=G3PPTFSILXJQ type=write size=1826697 2024-09-12T17:18:19.414 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.413+0000 7f574d1ea780 1 < completed delete operation key=8SG7DJO4HWPI tag=ZTMOXN4V27EC type=del 2024-09-12T17:18:19.415 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.414+0000 7f574d1ea780 1 > prepared operation key=K12MVG618809 tag=3KJZHSHVN5FA type=write size=978366 2024-09-12T17:18:19.416 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.415+0000 7f574d1ea780 1 < completed delete operation key=SQQMJ61CA0QW tag=3MG2W1CLG344 type=del 2024-09-12T17:18:19.417 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.417+0000 7f574d1ea780 1 > prepared operation key=R00F69ON5P6Z tag=E9JXZQUXBD0L type=del size=2437255 2024-09-12T17:18:19.419 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.418+0000 7f574d1ea780 1 < completed part key=_multipart_Q2Q3B1J3DAVD.2~CXOC4749UQ0Q.0 size=141898 2024-09-12T17:18:19.421 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.420+0000 7f574d1ea780 1 < completed multipart upload key=Q2Q3B1J3DAVD upload=CXOC4749UQ0Q tag=4DHP1MBCXXQN type=write size=1190474 2024-09-12T17:18:19.422 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.421+0000 7f574d1ea780 1 > prepared operation key=A1TIP3RXHBCZ tag=1K0DJPUJ466V type=del size=2615302 2024-09-12T17:18:19.423 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.422+0000 7f574d1ea780 1 < completed delete operation key=8SG7DJO4HWPI tag=ITEEVREALPMK type=del 2024-09-12T17:18:19.425 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.424+0000 7f574d1ea780 1 > prepared part key=_multipart_54CM8800AT9V.2~Y5OG4F7IMM11.0 size=1048576 2024-09-12T17:18:19.426 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.425+0000 7f574d1ea780 1 > prepared part key=_multipart_54CM8800AT9V.2~Y5OG4F7IMM11.1 size=463797 2024-09-12T17:18:19.426 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.425+0000 7f574d1ea780 1 > prepared multipart upload key=54CM8800AT9V upload=Y5OG4F7IMM11 tag=SU19QQ1ILFI5 type=write size=2560949 2024-09-12T17:18:19.427 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.427+0000 7f574d1ea780 1 < completed part key=_multipart_HGZMN894YYC0.2~72MV2DS9RM62.0 size=1048576 2024-09-12T17:18:19.428 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.427+0000 7f574d1ea780 1 < completed part key=_multipart_HGZMN894YYC0.2~72MV2DS9RM62.1 size=307740 2024-09-12T17:18:19.430 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.429+0000 7f574d1ea780 1 < completed multipart upload key=HGZMN894YYC0 upload=72MV2DS9RM62 tag=11KON0AXGZRS type=write size=2404892 2024-09-12T17:18:19.433 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.432+0000 7f574d1ea780 1 > prepared part key=_multipart_DH02JGZP64MN.2~IZVAV9ZH6O9T.0 size=1048576 2024-09-12T17:18:19.434 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.433+0000 7f574d1ea780 1 > prepared part key=_multipart_DH02JGZP64MN.2~IZVAV9ZH6O9T.1 size=311211 2024-09-12T17:18:19.434 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.433+0000 7f574d1ea780 1 > prepared multipart upload key=DH02JGZP64MN upload=IZVAV9ZH6O9T tag=12730DLRHK8C type=write size=2408363 2024-09-12T17:18:19.435 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.434+0000 7f574d1ea780 1 < completed part key=_multipart_K12MVG618809.2~PA4QD2TCLCZN.0 size=996940 2024-09-12T17:18:19.437 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.436+0000 7f574d1ea780 1 < completed multipart upload key=K12MVG618809 upload=PA4QD2TCLCZN tag=3RRTM5RFO6CK type=write size=2045516 2024-09-12T17:18:19.439 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.438+0000 7f574d1ea780 1 > prepared operation key=QXD8UG2K4STQ tag=9YWLJBV3JEFB type=del size=954524 2024-09-12T17:18:19.442 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.441+0000 7f574d1ea780 1 < completed part key=_multipart_RWVWJHVZE95H.2~LJ21GWRWB3HD.0 size=1048576 2024-09-12T17:18:19.443 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.442+0000 7f574d1ea780 1 < completed part key=_multipart_RWVWJHVZE95H.2~LJ21GWRWB3HD.1 size=518309 2024-09-12T17:18:19.445 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.444+0000 7f574d1ea780 1 < completed multipart upload key=RWVWJHVZE95H upload=LJ21GWRWB3HD tag=SLJ1Z6OY8FTO type=write size=2615461 2024-09-12T17:18:19.447 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.446+0000 7f574d1ea780 1 > prepared operation key=R00F69ON5P6Z tag=T8BLLG4D0855 type=write size=880749 2024-09-12T17:18:19.448 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.447+0000 7f574d1ea780 1 < completed delete operation key=ENFNIFHQ3SHW tag=HTF5424PFQDZ type=del 2024-09-12T17:18:19.450 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.449+0000 7f574d1ea780 1 > prepared part key=_multipart_K12MVG618809.2~W8OC0Q2ZYGYM.0 size=1048576 2024-09-12T17:18:19.451 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.450+0000 7f574d1ea780 1 > prepared part key=_multipart_K12MVG618809.2~W8OC0Q2ZYGYM.1 size=360609 2024-09-12T17:18:19.451 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.450+0000 7f574d1ea780 1 > prepared multipart upload key=K12MVG618809 upload=W8OC0Q2ZYGYM tag=QLJ2MRX3TSRL type=write size=2457761 2024-09-12T17:18:19.453 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.453+0000 7f574d1ea780 1 < suggested remove operation key=55JI541K1WP2 tag=FMJAKI2XQ9CF type=del 2024-09-12T17:18:19.455 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.454+0000 7f574d1ea780 1 > prepared operation key=RWVWJHVZE95H tag=25HNDJS5BG46 type=del size=568128 2024-09-12T17:18:19.456 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.455+0000 7f574d1ea780 1 < canceled operation key=54LQ91UMBJAN tag=BS1RMZ17E0X3 type=del size=393914 2024-09-12T17:18:19.457 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.456+0000 7f574d1ea780 1 > prepared operation key=ZGE1860DMGHA tag=491E6JPQSX2D type=del size=275769 2024-09-12T17:18:19.459 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.458+0000 7f574d1ea780 1 < completed part key=_multipart_ZGH8XC39FGTC.2~GAYF8R40FEUY.0 size=222696 2024-09-12T17:18:19.461 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.460+0000 7f574d1ea780 1 < completed multipart upload key=ZGH8XC39FGTC upload=GAYF8R40FEUY tag=RRNOBQ31ASF5 type=write size=1271272 2024-09-12T17:18:19.462 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.461+0000 7f574d1ea780 1 > prepared operation key=HFWA7DNUMWF2 tag=JL6OJL5MCRO4 type=del size=461364 2024-09-12T17:18:19.463 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.462+0000 7f574d1ea780 1 < completed part key=_multipart_DH02JGZP64MN.2~WYWUJEU4J2YE.0 size=1036830 2024-09-12T17:18:19.465 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.465+0000 7f574d1ea780 1 < completed multipart upload key=DH02JGZP64MN upload=WYWUJEU4J2YE tag=IFE87H8F17YL type=write size=2085406 2024-09-12T17:18:19.468 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.467+0000 7f574d1ea780 1 > prepared part key=_multipart_C9IYR9CET1I8.2~VUACYWLHY506.0 size=218911 2024-09-12T17:18:19.468 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.467+0000 7f574d1ea780 1 > prepared multipart upload key=C9IYR9CET1I8 upload=VUACYWLHY506 tag=VCIK8B3BJKRI type=write size=1267487 2024-09-12T17:18:19.468 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.467+0000 7f574d1ea780 1 < canceled part key=_multipart_ENFNIFHQ3SHW.2~SP9MRNNLOAY4.0 size=306942 2024-09-12T17:18:19.473 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.469+0000 7f574d1ea780 1 < canceled multipart upload key=ENFNIFHQ3SHW upload=SP9MRNNLOAY4 tag=8FD92MDUCORI type=write size=1355518 2024-09-12T17:18:19.473 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.470+0000 7f574d1ea780 1 > prepared operation key=R00F69ON5P6Z tag=TYSF9L7KZDYR type=del size=1953125 2024-09-12T17:18:19.473 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.471+0000 7f574d1ea780 1 < canceled part key=_multipart_54LQ91UMBJAN.2~FJ946PV8J3HR.0 size=1048576 2024-09-12T17:18:19.473 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.472+0000 7f574d1ea780 1 < completed part key=_multipart_54LQ91UMBJAN.2~FJ946PV8J3HR.1 size=840573 2024-09-12T17:18:19.474 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.474+0000 7f574d1ea780 1 < canceled multipart upload key=54LQ91UMBJAN upload=FJ946PV8J3HR tag=GRGFBKG9THKR type=write size=2937725 2024-09-12T17:18:19.476 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.475+0000 7f574d1ea780 1 > prepared operation key=ENFNIFHQ3SHW tag=B5SN7MRHXU2J type=del size=1575203 2024-09-12T17:18:19.477 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.476+0000 7f574d1ea780 1 < completed delete operation key=RNI86YYLADT0 tag=7NYXUQHC1PS0 type=del 2024-09-12T17:18:19.478 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.477+0000 7f574d1ea780 1 > prepared operation key=U6E9A5OH4GUW tag=3BNU923Z6W2N type=write size=753353 2024-09-12T17:18:19.480 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.479+0000 7f574d1ea780 1 < completed part key=_multipart_RNI86YYLADT0.2~BZV4MZ7EOFWO.0 size=778121 2024-09-12T17:18:19.482 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.481+0000 7f574d1ea780 1 < completed multipart upload key=RNI86YYLADT0 upload=BZV4MZ7EOFWO tag=G3PPTFSILXJQ type=write size=1826697 2024-09-12T17:18:19.484 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.483+0000 7f574d1ea780 1 > prepared part key=_multipart_SQQMJ61CA0QW.2~2RT02HKE9KI5.0 size=1048576 2024-09-12T17:18:19.485 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.484+0000 7f574d1ea780 1 > prepared part key=_multipart_SQQMJ61CA0QW.2~2RT02HKE9KI5.1 size=614914 2024-09-12T17:18:19.485 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.484+0000 7f574d1ea780 1 > prepared multipart upload key=SQQMJ61CA0QW upload=2RT02HKE9KI5 tag=GG98L5E5TCTP type=write size=2712066 2024-09-12T17:18:19.487 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.487+0000 7f574d1ea780 1 < suggested remove operation key=K12MVG618809 tag=3KJZHSHVN5FA type=write 2024-09-12T17:18:19.489 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.488+0000 7f574d1ea780 1 > prepared operation key=UTCKL1F42X8A tag=A0P1SRC4T0CV type=del size=272134 2024-09-12T17:18:19.490 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.489+0000 7f574d1ea780 1 < completed delete operation key=R00F69ON5P6Z tag=E9JXZQUXBD0L type=del 2024-09-12T17:18:19.492 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.491+0000 7f574d1ea780 1 > prepared operation key=Q2Q3B1J3DAVD tag=E0N6VV6EO19V type=del size=1736629 2024-09-12T17:18:19.494 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.493+0000 7f574d1ea780 1 < suggested remove operation key=A1TIP3RXHBCZ tag=1K0DJPUJ466V type=del 2024-09-12T17:18:19.497 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.496+0000 7f574d1ea780 1 > prepared part key=_multipart_K12MVG618809.2~YW7O8YPN2LEU.0 size=1048576 2024-09-12T17:18:19.498 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.497+0000 7f574d1ea780 1 > prepared part key=_multipart_K12MVG618809.2~YW7O8YPN2LEU.1 size=1048576 2024-09-12T17:18:19.499 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.498+0000 7f574d1ea780 1 > prepared part key=_multipart_K12MVG618809.2~YW7O8YPN2LEU.2 size=525082 2024-09-12T17:18:19.499 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.498+0000 7f574d1ea780 1 > prepared multipart upload key=K12MVG618809 upload=YW7O8YPN2LEU tag=4619C2H21HM0 type=write size=3670810 2024-09-12T17:18:19.501 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.500+0000 7f574d1ea780 1 < completed part key=_multipart_54CM8800AT9V.2~Y5OG4F7IMM11.0 size=1048576 2024-09-12T17:18:19.502 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.501+0000 7f574d1ea780 1 < completed part key=_multipart_54CM8800AT9V.2~Y5OG4F7IMM11.1 size=463797 2024-09-12T17:18:19.504 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.503+0000 7f574d1ea780 1 < completed multipart upload key=54CM8800AT9V upload=Y5OG4F7IMM11 tag=SU19QQ1ILFI5 type=write size=2560949 2024-09-12T17:18:19.505 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.505+0000 7f574d1ea780 1 > prepared operation key=Q2Q3B1J3DAVD tag=HQDUYX1ZVT0W type=del size=2141 2024-09-12T17:18:19.507 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.506+0000 7f574d1ea780 1 < completed part key=_multipart_DH02JGZP64MN.2~IZVAV9ZH6O9T.0 size=1048576 2024-09-12T17:18:19.508 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.507+0000 7f574d1ea780 1 < completed part key=_multipart_DH02JGZP64MN.2~IZVAV9ZH6O9T.1 size=311211 2024-09-12T17:18:19.510 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.510+0000 7f574d1ea780 1 < completed multipart upload key=DH02JGZP64MN upload=IZVAV9ZH6O9T tag=12730DLRHK8C type=write size=2408363 2024-09-12T17:18:19.513 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.512+0000 7f574d1ea780 1 > prepared part key=_multipart_RWVWJHVZE95H.2~SB6S0GK18G9P.0 size=689044 2024-09-12T17:18:19.513 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.512+0000 7f574d1ea780 1 > prepared multipart upload key=RWVWJHVZE95H upload=SB6S0GK18G9P tag=AZLIYZT2RH2M type=write size=1737620 2024-09-12T17:18:19.516 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.515+0000 7f574d1ea780 1 < suggested remove operation key=QXD8UG2K4STQ tag=9YWLJBV3JEFB type=del 2024-09-12T17:18:19.519 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.518+0000 7f574d1ea780 1 > prepared part key=_multipart_55V137SY4E4P.2~3CCCHYN5ZTK0.0 size=560927 2024-09-12T17:18:19.519 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.518+0000 7f574d1ea780 1 > prepared multipart upload key=55V137SY4E4P upload=3CCCHYN5ZTK0 tag=LR1FGFLJMPFU type=write size=1609503 2024-09-12T17:18:19.520 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.519+0000 7f574d1ea780 1 < completed write operation key=R00F69ON5P6Z tag=T8BLLG4D0855 type=write size=880749 2024-09-12T17:18:19.528 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.528+0000 7f574d1ea780 1 > prepared part key=_multipart_DH02JGZP64MN.2~7GDSM6ZRBXI2.0 size=1048576 2024-09-12T17:18:19.530 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.529+0000 7f574d1ea780 1 > prepared part key=_multipart_DH02JGZP64MN.2~7GDSM6ZRBXI2.1 size=198350 2024-09-12T17:18:19.530 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.529+0000 7f574d1ea780 1 > prepared multipart upload key=DH02JGZP64MN upload=7GDSM6ZRBXI2 tag=NQ9WMJ2ACVFU type=write size=2295502 2024-09-12T17:18:19.531 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.530+0000 7f574d1ea780 1 < completed part key=_multipart_K12MVG618809.2~W8OC0Q2ZYGYM.0 size=1048576 2024-09-12T17:18:19.532 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.531+0000 7f574d1ea780 1 < completed part key=_multipart_K12MVG618809.2~W8OC0Q2ZYGYM.1 size=360609 2024-09-12T17:18:19.534 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.533+0000 7f574d1ea780 1 < completed multipart upload key=K12MVG618809 upload=W8OC0Q2ZYGYM tag=QLJ2MRX3TSRL type=write size=2457761 2024-09-12T17:18:19.536 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.535+0000 7f574d1ea780 1 > prepared operation key=ZGH8XC39FGTC tag=LF4LT18TNRD2 type=write size=1027602 2024-09-12T17:18:19.537 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.536+0000 7f574d1ea780 1 < completed delete operation key=RWVWJHVZE95H tag=25HNDJS5BG46 type=del 2024-09-12T17:18:19.541 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.540+0000 7f574d1ea780 1 > prepared part key=_multipart_ZGH8XC39FGTC.2~RWML63PHFA17.0 size=1048576 2024-09-12T17:18:19.542 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.541+0000 7f574d1ea780 1 > prepared part key=_multipart_ZGH8XC39FGTC.2~RWML63PHFA17.1 size=1048576 2024-09-12T17:18:19.543 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.542+0000 7f574d1ea780 1 > prepared part key=_multipart_ZGH8XC39FGTC.2~RWML63PHFA17.2 size=910690 2024-09-12T17:18:19.543 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.542+0000 7f574d1ea780 1 > prepared multipart upload key=ZGH8XC39FGTC upload=RWML63PHFA17 tag=UDX2F7WTZFKM type=write size=4056418 2024-09-12T17:18:19.545 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.544+0000 7f574d1ea780 1 < completed delete operation key=ZGE1860DMGHA tag=491E6JPQSX2D type=del 2024-09-12T17:18:19.546 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.545+0000 7f574d1ea780 1 > prepared operation key=TIKBUXFPVTN1 tag=60C5VDCV1AJ2 type=del size=371786 2024-09-12T17:18:19.547 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.546+0000 7f574d1ea780 1 < completed delete operation key=HFWA7DNUMWF2 tag=JL6OJL5MCRO4 type=del 2024-09-12T17:18:19.550 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.549+0000 7f574d1ea780 1 > prepared part key=_multipart_YXIDO0U18839.2~OGIJXOVVQ3XC.0 size=265398 2024-09-12T17:18:19.550 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.549+0000 7f574d1ea780 1 > prepared multipart upload key=YXIDO0U18839 upload=OGIJXOVVQ3XC tag=P5K7P2YAJ81B type=write size=1313974 2024-09-12T17:18:19.551 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.550+0000 7f574d1ea780 1 < completed part key=_multipart_C9IYR9CET1I8.2~VUACYWLHY506.0 size=218911 2024-09-12T17:18:19.553 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.552+0000 7f574d1ea780 1 < completed multipart upload key=C9IYR9CET1I8 upload=VUACYWLHY506 tag=VCIK8B3BJKRI type=write size=1267487 2024-09-12T17:18:19.554 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.553+0000 7f574d1ea780 1 > prepared operation key=ZGH8XC39FGTC tag=SKGHZY2PYKBW type=del size=1365181 2024-09-12T17:18:19.556 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.555+0000 7f574d1ea780 1 < completed delete operation key=R00F69ON5P6Z tag=TYSF9L7KZDYR type=del 2024-09-12T17:18:19.558 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.557+0000 7f574d1ea780 1 > prepared part key=_multipart_K12MVG618809.2~L686HU74ITDF.0 size=760726 2024-09-12T17:18:19.558 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.557+0000 7f574d1ea780 1 > prepared multipart upload key=K12MVG618809 upload=L686HU74ITDF tag=X82NFO4PQ8KM type=write size=1809302 2024-09-12T17:18:19.559 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.558+0000 7f574d1ea780 1 < completed delete operation key=ENFNIFHQ3SHW tag=B5SN7MRHXU2J type=del 2024-09-12T17:18:19.561 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.561+0000 7f574d1ea780 1 > prepared part key=_multipart_VWWA5IB0L4N1.2~IMHSI935WVET.0 size=1048576 2024-09-12T17:18:19.562 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.561+0000 7f574d1ea780 1 > prepared part key=_multipart_VWWA5IB0L4N1.2~IMHSI935WVET.1 size=1048576 2024-09-12T17:18:19.563 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.562+0000 7f574d1ea780 1 > prepared part key=_multipart_VWWA5IB0L4N1.2~IMHSI935WVET.2 size=389941 2024-09-12T17:18:19.563 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.562+0000 7f574d1ea780 1 > prepared multipart upload key=VWWA5IB0L4N1 upload=IMHSI935WVET tag=FYK0FTN8GP0H type=write size=3535669 2024-09-12T17:18:19.566 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.565+0000 7f574d1ea780 1 < suggested update operation key=U6E9A5OH4GUW tag=3BNU923Z6W2N type=write size=753353 2024-09-12T17:18:19.567 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.566+0000 7f574d1ea780 1 > prepared operation key=QXD8UG2K4STQ tag=KAJXE6IVAFN2 type=del size=331414 2024-09-12T17:18:19.568 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.567+0000 7f574d1ea780 1 < completed part key=_multipart_SQQMJ61CA0QW.2~2RT02HKE9KI5.0 size=1048576 2024-09-12T17:18:19.571 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.570+0000 7f574d1ea780 1 < completed part key=_multipart_SQQMJ61CA0QW.2~2RT02HKE9KI5.1 size=614914 2024-09-12T17:18:19.573 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.572+0000 7f574d1ea780 1 < completed multipart upload key=SQQMJ61CA0QW upload=2RT02HKE9KI5 tag=GG98L5E5TCTP type=write size=2712066 2024-09-12T17:18:19.575 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.574+0000 7f574d1ea780 1 > prepared part key=_multipart_K12MVG618809.2~4JFC6JHHMHL6.0 size=118633 2024-09-12T17:18:19.575 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.574+0000 7f574d1ea780 1 > prepared multipart upload key=K12MVG618809 upload=4JFC6JHHMHL6 tag=GJJJBV8FE22X type=write size=1167209 2024-09-12T17:18:19.576 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.576+0000 7f574d1ea780 1 < completed delete operation key=UTCKL1F42X8A tag=A0P1SRC4T0CV type=del 2024-09-12T17:18:19.579 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.578+0000 7f574d1ea780 1 > prepared part key=_multipart_54LQ91UMBJAN.2~RN8CP3QK8WH9.0 size=1048576 2024-09-12T17:18:19.580 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.579+0000 7f574d1ea780 1 > prepared part key=_multipart_54LQ91UMBJAN.2~RN8CP3QK8WH9.1 size=1048576 2024-09-12T17:18:19.581 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.580+0000 7f574d1ea780 1 > prepared part key=_multipart_54LQ91UMBJAN.2~RN8CP3QK8WH9.2 size=606519 2024-09-12T17:18:19.581 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.580+0000 7f574d1ea780 1 > prepared multipart upload key=54LQ91UMBJAN upload=RN8CP3QK8WH9 tag=F36IQXMBD8QJ type=write size=3752247 2024-09-12T17:18:19.583 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.582+0000 7f574d1ea780 1 < suggested remove operation key=Q2Q3B1J3DAVD tag=E0N6VV6EO19V type=del 2024-09-12T17:18:19.585 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.584+0000 7f574d1ea780 1 > prepared part key=_multipart_ZGE1860DMGHA.2~CKCZF8K078Y8.0 size=1048576 2024-09-12T17:18:19.586 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.585+0000 7f574d1ea780 1 > prepared part key=_multipart_ZGE1860DMGHA.2~CKCZF8K078Y8.1 size=1048576 2024-09-12T17:18:19.587 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.586+0000 7f574d1ea780 1 > prepared part key=_multipart_ZGE1860DMGHA.2~CKCZF8K078Y8.2 size=1005062 2024-09-12T17:18:19.587 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.586+0000 7f574d1ea780 1 > prepared multipart upload key=ZGE1860DMGHA upload=CKCZF8K078Y8 tag=OSFT5VX2VCU8 type=write size=4150790 2024-09-12T17:18:19.589 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.588+0000 7f574d1ea780 1 < completed part key=_multipart_K12MVG618809.2~YW7O8YPN2LEU.0 size=1048576 2024-09-12T17:18:19.590 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.589+0000 7f574d1ea780 1 < completed part key=_multipart_K12MVG618809.2~YW7O8YPN2LEU.1 size=1048576 2024-09-12T17:18:19.591 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.590+0000 7f574d1ea780 1 < completed part key=_multipart_K12MVG618809.2~YW7O8YPN2LEU.2 size=525082 2024-09-12T17:18:19.593 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.592+0000 7f574d1ea780 1 < completed multipart upload key=K12MVG618809 upload=YW7O8YPN2LEU tag=4619C2H21HM0 type=write size=3670810 2024-09-12T17:18:19.595 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.594+0000 7f574d1ea780 1 > prepared part key=_multipart_A1TIP3RXHBCZ.2~RMI0DGUTL5NM.0 size=1048576 2024-09-12T17:18:19.596 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.595+0000 7f574d1ea780 1 > prepared part key=_multipart_A1TIP3RXHBCZ.2~RMI0DGUTL5NM.1 size=1048576 2024-09-12T17:18:19.598 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.597+0000 7f574d1ea780 1 > prepared part key=_multipart_A1TIP3RXHBCZ.2~RMI0DGUTL5NM.2 size=771359 2024-09-12T17:18:19.598 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.597+0000 7f574d1ea780 1 > prepared multipart upload key=A1TIP3RXHBCZ upload=RMI0DGUTL5NM tag=H3WSC5Z1B1EX type=write size=3917087 2024-09-12T17:18:19.599 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.598+0000 7f574d1ea780 -1 < failed to complete operation key=Q2Q3B1J3DAVD tag=HQDUYX1ZVT0W type=del size=2141: (22) Invalid argument 2024-09-12T17:18:19.602 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.601+0000 7f574d1ea780 1 > prepared part key=_multipart_55JI541K1WP2.2~L3FPCK8I7QTG.0 size=1048576 2024-09-12T17:18:19.603 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.602+0000 7f574d1ea780 1 > prepared part key=_multipart_55JI541K1WP2.2~L3FPCK8I7QTG.1 size=156221 2024-09-12T17:18:19.603 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.602+0000 7f574d1ea780 1 > prepared multipart upload key=55JI541K1WP2 upload=L3FPCK8I7QTG tag=I2D0HO74YFYC type=write size=2253373 2024-09-12T17:18:19.604 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.603+0000 7f574d1ea780 1 < completed part key=_multipart_RWVWJHVZE95H.2~SB6S0GK18G9P.0 size=689044 2024-09-12T17:18:19.606 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.605+0000 7f574d1ea780 1 < completed multipart upload key=RWVWJHVZE95H upload=SB6S0GK18G9P tag=AZLIYZT2RH2M type=write size=1737620 2024-09-12T17:18:19.609 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.608+0000 7f574d1ea780 1 > prepared part key=_multipart_ENFNIFHQ3SHW.2~POMN5JOTZLDW.0 size=1048576 2024-09-12T17:18:19.610 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.609+0000 7f574d1ea780 1 > prepared part key=_multipart_ENFNIFHQ3SHW.2~POMN5JOTZLDW.1 size=1048576 2024-09-12T17:18:19.611 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.610+0000 7f574d1ea780 1 > prepared part key=_multipart_ENFNIFHQ3SHW.2~POMN5JOTZLDW.2 size=822259 2024-09-12T17:18:19.611 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.610+0000 7f574d1ea780 1 > prepared multipart upload key=ENFNIFHQ3SHW upload=POMN5JOTZLDW tag=UYMC8VC889RF type=write size=3967987 2024-09-12T17:18:19.611 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.610+0000 7f574d1ea780 1 < canceled part key=_multipart_55V137SY4E4P.2~3CCCHYN5ZTK0.0 size=560927 2024-09-12T17:18:19.613 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.612+0000 7f574d1ea780 1 < canceled multipart upload key=55V137SY4E4P upload=3CCCHYN5ZTK0 tag=LR1FGFLJMPFU type=write size=1609503 2024-09-12T17:18:19.614 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.613+0000 7f574d1ea780 1 > prepared operation key=RNI86YYLADT0 tag=CUCQP4GK6F9K type=del size=3287134 2024-09-12T17:18:19.615 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.615+0000 7f574d1ea780 1 < completed part key=_multipart_DH02JGZP64MN.2~7GDSM6ZRBXI2.0 size=1048576 2024-09-12T17:18:19.616 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.616+0000 7f574d1ea780 1 < completed part key=_multipart_DH02JGZP64MN.2~7GDSM6ZRBXI2.1 size=198350 2024-09-12T17:18:19.618 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.618+0000 7f574d1ea780 1 < completed multipart upload key=DH02JGZP64MN upload=7GDSM6ZRBXI2 tag=NQ9WMJ2ACVFU type=write size=2295502 2024-09-12T17:18:19.620 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.619+0000 7f574d1ea780 1 > prepared operation key=ZGE1860DMGHA tag=LBP9JSXAW06A type=del size=3567389 2024-09-12T17:18:19.621 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.620+0000 7f574d1ea780 1 < completed write operation key=ZGH8XC39FGTC tag=LF4LT18TNRD2 type=write size=1027602 2024-09-12T17:18:19.622 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.621+0000 7f574d1ea780 1 > prepared operation key=8SG7DJO4HWPI tag=3QB9H42NQJRC type=write size=973607 2024-09-12T17:18:19.623 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.623+0000 7f574d1ea780 1 < completed part key=_multipart_ZGH8XC39FGTC.2~RWML63PHFA17.0 size=1048576 2024-09-12T17:18:19.624 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.624+0000 7f574d1ea780 1 < completed part key=_multipart_ZGH8XC39FGTC.2~RWML63PHFA17.1 size=1048576 2024-09-12T17:18:19.625 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.625+0000 7f574d1ea780 1 < completed part key=_multipart_ZGH8XC39FGTC.2~RWML63PHFA17.2 size=910690 2024-09-12T17:18:19.628 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.627+0000 7f574d1ea780 1 < completed multipart upload key=ZGH8XC39FGTC upload=RWML63PHFA17 tag=UDX2F7WTZFKM type=write size=4056418 2024-09-12T17:18:19.630 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.629+0000 7f574d1ea780 1 > prepared part key=_multipart_55JI541K1WP2.2~EGHTBQZ7AG8F.0 size=1048576 2024-09-12T17:18:19.631 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.630+0000 7f574d1ea780 1 > prepared part key=_multipart_55JI541K1WP2.2~EGHTBQZ7AG8F.1 size=1048576 2024-09-12T17:18:19.632 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.631+0000 7f574d1ea780 1 > prepared part key=_multipart_55JI541K1WP2.2~EGHTBQZ7AG8F.2 size=97471 2024-09-12T17:18:19.632 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.631+0000 7f574d1ea780 1 > prepared multipart upload key=55JI541K1WP2 upload=EGHTBQZ7AG8F tag=5P31P51UPS9T type=write size=3243199 2024-09-12T17:18:19.634 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.633+0000 7f574d1ea780 1 < completed delete operation key=TIKBUXFPVTN1 tag=60C5VDCV1AJ2 type=del 2024-09-12T17:18:19.635 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.634+0000 7f574d1ea780 1 > prepared operation key=C9IYR9CET1I8 tag=QRA6D8I2V1T2 type=del size=1130137 2024-09-12T17:18:19.636 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.635+0000 7f574d1ea780 1 < completed part key=_multipart_YXIDO0U18839.2~OGIJXOVVQ3XC.0 size=265398 2024-09-12T17:18:19.638 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.637+0000 7f574d1ea780 1 < completed multipart upload key=YXIDO0U18839 upload=OGIJXOVVQ3XC tag=P5K7P2YAJ81B type=write size=1313974 2024-09-12T17:18:19.641 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.640+0000 7f574d1ea780 1 > prepared part key=_multipart_43GV2N9VBBKE.2~66HVRWKVOV3N.0 size=1048576 2024-09-12T17:18:19.642 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.641+0000 7f574d1ea780 1 > prepared part key=_multipart_43GV2N9VBBKE.2~66HVRWKVOV3N.1 size=1048576 2024-09-12T17:18:19.643 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.642+0000 7f574d1ea780 1 > prepared part key=_multipart_43GV2N9VBBKE.2~66HVRWKVOV3N.2 size=920782 2024-09-12T17:18:19.643 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.642+0000 7f574d1ea780 1 > prepared multipart upload key=43GV2N9VBBKE upload=66HVRWKVOV3N tag=QLO2QDZEAP0T type=write size=4066510 2024-09-12T17:18:19.644 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.643+0000 7f574d1ea780 1 < canceled operation key=ZGH8XC39FGTC tag=SKGHZY2PYKBW type=del size=1365181 2024-09-12T17:18:19.646 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.645+0000 7f574d1ea780 1 > prepared part key=_multipart_ENFNIFHQ3SHW.2~OGDYI269T8EY.0 size=1048576 2024-09-12T17:18:19.647 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.646+0000 7f574d1ea780 1 > prepared part key=_multipart_ENFNIFHQ3SHW.2~OGDYI269T8EY.1 size=1048576 2024-09-12T17:18:19.648 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.647+0000 7f574d1ea780 1 > prepared part key=_multipart_ENFNIFHQ3SHW.2~OGDYI269T8EY.2 size=832572 2024-09-12T17:18:19.648 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.647+0000 7f574d1ea780 1 > prepared multipart upload key=ENFNIFHQ3SHW upload=OGDYI269T8EY tag=ZKF1YH4HN40U type=write size=3978300 2024-09-12T17:18:19.649 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.648+0000 7f574d1ea780 1 < completed part key=_multipart_K12MVG618809.2~L686HU74ITDF.0 size=760726 2024-09-12T17:18:19.651 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.651+0000 7f574d1ea780 1 < completed multipart upload key=K12MVG618809 upload=L686HU74ITDF tag=X82NFO4PQ8KM type=write size=1809302 2024-09-12T17:18:19.653 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.652+0000 7f574d1ea780 1 > prepared operation key=UTCKL1F42X8A tag=DINLFMUKPKV2 type=del size=3224740 2024-09-12T17:18:19.654 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.654+0000 7f574d1ea780 1 < completed part key=_multipart_VWWA5IB0L4N1.2~IMHSI935WVET.0 size=1048576 2024-09-12T17:18:19.655 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.654+0000 7f574d1ea780 1 < completed part key=_multipart_VWWA5IB0L4N1.2~IMHSI935WVET.1 size=1048576 2024-09-12T17:18:19.656 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.655+0000 7f574d1ea780 1 < completed part key=_multipart_VWWA5IB0L4N1.2~IMHSI935WVET.2 size=389941 2024-09-12T17:18:19.658 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.657+0000 7f574d1ea780 1 < completed multipart upload key=VWWA5IB0L4N1 upload=IMHSI935WVET tag=FYK0FTN8GP0H type=write size=3535669 2024-09-12T17:18:19.661 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.660+0000 7f574d1ea780 1 > prepared part key=_multipart_HFWA7DNUMWF2.2~NBALL23RZ1AG.0 size=205008 2024-09-12T17:18:19.661 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.660+0000 7f574d1ea780 1 > prepared multipart upload key=HFWA7DNUMWF2 upload=NBALL23RZ1AG tag=9M6TUHLLW5KX type=write size=1253584 2024-09-12T17:18:19.662 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.661+0000 7f574d1ea780 1 < completed delete operation key=QXD8UG2K4STQ tag=KAJXE6IVAFN2 type=del 2024-09-12T17:18:19.663 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.663+0000 7f574d1ea780 1 > prepared operation key=55V137SY4E4P tag=08CDMUDV11G3 type=write size=412823 2024-09-12T17:18:19.665 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.664+0000 7f574d1ea780 1 < completed part key=_multipart_K12MVG618809.2~4JFC6JHHMHL6.0 size=118633 2024-09-12T17:18:19.667 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.666+0000 7f574d1ea780 1 < completed multipart upload key=K12MVG618809 upload=4JFC6JHHMHL6 tag=GJJJBV8FE22X type=write size=1167209 2024-09-12T17:18:19.669 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.668+0000 7f574d1ea780 1 > prepared part key=_multipart_RWVWJHVZE95H.2~GUJP3WGIPPA3.0 size=1048576 2024-09-12T17:18:19.670 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.669+0000 7f574d1ea780 1 > prepared part key=_multipart_RWVWJHVZE95H.2~GUJP3WGIPPA3.1 size=933788 2024-09-12T17:18:19.670 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.669+0000 7f574d1ea780 1 > prepared multipart upload key=RWVWJHVZE95H upload=GUJP3WGIPPA3 tag=GZTTXVBKQ37W type=write size=3030940 2024-09-12T17:18:19.671 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.670+0000 7f574d1ea780 1 < completed part key=_multipart_54LQ91UMBJAN.2~RN8CP3QK8WH9.0 size=1048576 2024-09-12T17:18:19.672 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.671+0000 7f574d1ea780 1 < completed part key=_multipart_54LQ91UMBJAN.2~RN8CP3QK8WH9.1 size=1048576 2024-09-12T17:18:19.673 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.672+0000 7f574d1ea780 1 < completed part key=_multipart_54LQ91UMBJAN.2~RN8CP3QK8WH9.2 size=606519 2024-09-12T17:18:19.675 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.674+0000 7f574d1ea780 1 < completed multipart upload key=54LQ91UMBJAN upload=RN8CP3QK8WH9 tag=F36IQXMBD8QJ type=write size=3752247 2024-09-12T17:18:19.678 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.677+0000 7f574d1ea780 1 > prepared part key=_multipart_7BX38Q7723EB.2~YMUIV2MM3QZ3.0 size=171072 2024-09-12T17:18:19.678 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.677+0000 7f574d1ea780 1 > prepared multipart upload key=7BX38Q7723EB upload=YMUIV2MM3QZ3 tag=OUHO6U1JWB8J type=write size=1219648 2024-09-12T17:18:19.679 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.678+0000 7f574d1ea780 1 < completed part key=_multipart_ZGE1860DMGHA.2~CKCZF8K078Y8.0 size=1048576 2024-09-12T17:18:19.681 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.680+0000 7f574d1ea780 1 < completed part key=_multipart_ZGE1860DMGHA.2~CKCZF8K078Y8.1 size=1048576 2024-09-12T17:18:19.682 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.681+0000 7f574d1ea780 1 < completed part key=_multipart_ZGE1860DMGHA.2~CKCZF8K078Y8.2 size=1005062 2024-09-12T17:18:19.684 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.683+0000 7f574d1ea780 1 < completed multipart upload key=ZGE1860DMGHA upload=CKCZF8K078Y8 tag=OSFT5VX2VCU8 type=write size=4150790 2024-09-12T17:18:19.687 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.686+0000 7f574d1ea780 1 > prepared operation key=UTCKL1F42X8A tag=1RY60XGC1ADT type=write size=791000 2024-09-12T17:18:19.690 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.690+0000 7f574d1ea780 1 < completed part key=_multipart_A1TIP3RXHBCZ.2~RMI0DGUTL5NM.0 size=1048576 2024-09-12T17:18:19.691 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.690+0000 7f574d1ea780 1 < canceled part key=_multipart_A1TIP3RXHBCZ.2~RMI0DGUTL5NM.1 size=1048576 2024-09-12T17:18:19.694 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.694+0000 7f574d1ea780 1 < completed part key=_multipart_A1TIP3RXHBCZ.2~RMI0DGUTL5NM.2 size=771359 2024-09-12T17:18:19.696 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.696+0000 7f574d1ea780 1 < canceled multipart upload key=A1TIP3RXHBCZ upload=RMI0DGUTL5NM tag=H3WSC5Z1B1EX type=write size=3917087 2024-09-12T17:18:19.699 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.698+0000 7f574d1ea780 1 > prepared part key=_multipart_54LQ91UMBJAN.2~TJD3XMZOG8X0.0 size=418871 2024-09-12T17:18:19.699 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.698+0000 7f574d1ea780 1 > prepared multipart upload key=54LQ91UMBJAN upload=TJD3XMZOG8X0 tag=BH5NO7HK8ENR type=write size=1467447 2024-09-12T17:18:19.700 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.699+0000 7f574d1ea780 1 < completed part key=_multipart_55JI541K1WP2.2~L3FPCK8I7QTG.0 size=1048576 2024-09-12T17:18:19.701 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.700+0000 7f574d1ea780 1 < completed part key=_multipart_55JI541K1WP2.2~L3FPCK8I7QTG.1 size=156221 2024-09-12T17:18:19.703 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.702+0000 7f574d1ea780 1 < completed multipart upload key=55JI541K1WP2 upload=L3FPCK8I7QTG tag=I2D0HO74YFYC type=write size=2253373 2024-09-12T17:18:19.706 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.705+0000 7f574d1ea780 1 > prepared part key=_multipart_55V137SY4E4P.2~Y8G6IYPN37Z3.0 size=432002 2024-09-12T17:18:19.706 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.705+0000 7f574d1ea780 1 > prepared multipart upload key=55V137SY4E4P upload=Y8G6IYPN37Z3 tag=3OPL3Q09Q4UX type=write size=1480578 2024-09-12T17:18:19.707 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.706+0000 7f574d1ea780 1 < completed part key=_multipart_ENFNIFHQ3SHW.2~POMN5JOTZLDW.0 size=1048576 2024-09-12T17:18:19.708 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.707+0000 7f574d1ea780 1 < completed part key=_multipart_ENFNIFHQ3SHW.2~POMN5JOTZLDW.1 size=1048576 2024-09-12T17:18:19.709 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.708+0000 7f574d1ea780 1 < completed part key=_multipart_ENFNIFHQ3SHW.2~POMN5JOTZLDW.2 size=822259 2024-09-12T17:18:19.711 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.710+0000 7f574d1ea780 1 < completed multipart upload key=ENFNIFHQ3SHW upload=POMN5JOTZLDW tag=UYMC8VC889RF type=write size=3967987 2024-09-12T17:18:19.712 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.711+0000 7f574d1ea780 1 > prepared operation key=ZGH8XC39FGTC tag=LKP2YJESGSV6 type=del size=1732084 2024-09-12T17:18:19.713 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.713+0000 7f574d1ea780 1 < canceled operation key=RNI86YYLADT0 tag=CUCQP4GK6F9K type=del size=3287134 2024-09-12T17:18:19.715 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.714+0000 7f574d1ea780 1 > prepared operation key=K12MVG618809 tag=UIXBZ24C22MV type=del size=2159462 2024-09-12T17:18:19.718 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.717+0000 7f574d1ea780 1 < suggested remove operation key=ZGE1860DMGHA tag=LBP9JSXAW06A type=del 2024-09-12T17:18:19.720 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.719+0000 7f574d1ea780 1 > prepared part key=_multipart_TIKBUXFPVTN1.2~A6SWA37MM3SM.0 size=1048576 2024-09-12T17:18:19.721 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.720+0000 7f574d1ea780 1 > prepared part key=_multipart_TIKBUXFPVTN1.2~A6SWA37MM3SM.1 size=555106 2024-09-12T17:18:19.721 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.720+0000 7f574d1ea780 1 > prepared multipart upload key=TIKBUXFPVTN1 upload=A6SWA37MM3SM tag=PS9W7Q9QX77S type=write size=2652258 2024-09-12T17:18:19.723 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.722+0000 7f574d1ea780 1 < suggested update operation key=8SG7DJO4HWPI tag=3QB9H42NQJRC type=write size=973607 2024-09-12T17:18:19.724 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.724+0000 7f574d1ea780 1 > prepared operation key=GEGOEB05R0PK tag=S2HP300WXXRU type=del size=4120740 2024-09-12T17:18:19.726 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.725+0000 7f574d1ea780 1 < completed part key=_multipart_55JI541K1WP2.2~EGHTBQZ7AG8F.0 size=1048576 2024-09-12T17:18:19.727 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.726+0000 7f574d1ea780 1 < completed part key=_multipart_55JI541K1WP2.2~EGHTBQZ7AG8F.1 size=1048576 2024-09-12T17:18:19.728 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.727+0000 7f574d1ea780 1 < completed part key=_multipart_55JI541K1WP2.2~EGHTBQZ7AG8F.2 size=97471 2024-09-12T17:18:19.730 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.729+0000 7f574d1ea780 1 < completed multipart upload key=55JI541K1WP2 upload=EGHTBQZ7AG8F tag=5P31P51UPS9T type=write size=3243199 2024-09-12T17:18:19.733 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.732+0000 7f574d1ea780 1 > prepared part key=_multipart_43GV2N9VBBKE.2~H50BVLKJFJ4E.0 size=701101 2024-09-12T17:18:19.733 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.732+0000 7f574d1ea780 1 > prepared multipart upload key=43GV2N9VBBKE upload=H50BVLKJFJ4E tag=OSRK2IQ4U30G type=write size=1749677 2024-09-12T17:18:19.734 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.733+0000 7f574d1ea780 1 < completed delete operation key=C9IYR9CET1I8 tag=QRA6D8I2V1T2 type=del 2024-09-12T17:18:19.735 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.734+0000 7f574d1ea780 1 > prepared operation key=ZGE1860DMGHA tag=KNJE330F9TQN type=write size=174733 2024-09-12T17:18:19.737 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.736+0000 7f574d1ea780 1 < completed part key=_multipart_43GV2N9VBBKE.2~66HVRWKVOV3N.0 size=1048576 2024-09-12T17:18:19.738 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.737+0000 7f574d1ea780 1 < completed part key=_multipart_43GV2N9VBBKE.2~66HVRWKVOV3N.1 size=1048576 2024-09-12T17:18:19.739 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.738+0000 7f574d1ea780 1 < completed part key=_multipart_43GV2N9VBBKE.2~66HVRWKVOV3N.2 size=920782 2024-09-12T17:18:19.745 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.741+0000 7f574d1ea780 1 < completed multipart upload key=43GV2N9VBBKE upload=66HVRWKVOV3N tag=QLO2QDZEAP0T type=write size=4066510 2024-09-12T17:18:19.745 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.742+0000 7f574d1ea780 1 > prepared operation key=ZGE1860DMGHA tag=30MOSGCPPCEH type=del size=404242 2024-09-12T17:18:19.745 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.743+0000 7f574d1ea780 1 < completed part key=_multipart_ENFNIFHQ3SHW.2~OGDYI269T8EY.0 size=1048576 2024-09-12T17:18:19.745 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.745+0000 7f574d1ea780 1 < completed part key=_multipart_ENFNIFHQ3SHW.2~OGDYI269T8EY.1 size=1048576 2024-09-12T17:18:19.747 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.746+0000 7f574d1ea780 1 < completed part key=_multipart_ENFNIFHQ3SHW.2~OGDYI269T8EY.2 size=832572 2024-09-12T17:18:19.749 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.748+0000 7f574d1ea780 1 < completed multipart upload key=ENFNIFHQ3SHW upload=OGDYI269T8EY tag=ZKF1YH4HN40U type=write size=3978300 2024-09-12T17:18:19.753 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.752+0000 7f574d1ea780 1 > prepared part key=_multipart_K12MVG618809.2~7TKQRTPAJ4JV.0 size=1048576 2024-09-12T17:18:19.754 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.753+0000 7f574d1ea780 1 > prepared part key=_multipart_K12MVG618809.2~7TKQRTPAJ4JV.1 size=1048576 2024-09-12T17:18:19.755 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.754+0000 7f574d1ea780 1 > prepared part key=_multipart_K12MVG618809.2~7TKQRTPAJ4JV.2 size=381429 2024-09-12T17:18:19.755 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.754+0000 7f574d1ea780 1 > prepared multipart upload key=K12MVG618809 upload=7TKQRTPAJ4JV tag=V20K1KY79R0C type=write size=3527157 2024-09-12T17:18:19.756 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.755+0000 7f574d1ea780 1 < canceled operation key=UTCKL1F42X8A tag=DINLFMUKPKV2 type=del size=3224740 2024-09-12T17:18:19.757 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.756+0000 7f574d1ea780 1 > prepared operation key=A1TIP3RXHBCZ tag=397K5QQF9QTZ type=del size=560249 2024-09-12T17:18:19.758 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.758+0000 7f574d1ea780 1 < completed part key=_multipart_HFWA7DNUMWF2.2~NBALL23RZ1AG.0 size=205008 2024-09-12T17:18:19.761 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.760+0000 7f574d1ea780 1 < completed multipart upload key=HFWA7DNUMWF2 upload=NBALL23RZ1AG tag=9M6TUHLLW5KX type=write size=1253584 2024-09-12T17:18:19.762 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.761+0000 7f574d1ea780 1 > prepared operation key=Q2Q3B1J3DAVD tag=S3W6NZ8JEN0S type=write size=826994 2024-09-12T17:18:19.763 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.762+0000 7f574d1ea780 1 < completed write operation key=55V137SY4E4P tag=08CDMUDV11G3 type=write size=412823 2024-09-12T17:18:19.765 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.764+0000 7f574d1ea780 1 > prepared part key=_multipart_K12MVG618809.2~93O5DWHY2KVM.0 size=1048576 2024-09-12T17:18:19.766 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.765+0000 7f574d1ea780 1 > prepared part key=_multipart_K12MVG618809.2~93O5DWHY2KVM.1 size=1048576 2024-09-12T17:18:19.767 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.767+0000 7f574d1ea780 1 > prepared part key=_multipart_K12MVG618809.2~93O5DWHY2KVM.2 size=229043 2024-09-12T17:18:19.768 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.767+0000 7f574d1ea780 1 > prepared multipart upload key=K12MVG618809 upload=93O5DWHY2KVM tag=3EV9Z7KBCV15 type=write size=3374771 2024-09-12T17:18:19.769 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.768+0000 7f574d1ea780 1 < completed part key=_multipart_RWVWJHVZE95H.2~GUJP3WGIPPA3.0 size=1048576 2024-09-12T17:18:19.770 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.769+0000 7f574d1ea780 1 < completed part key=_multipart_RWVWJHVZE95H.2~GUJP3WGIPPA3.1 size=933788 2024-09-12T17:18:19.772 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.771+0000 7f574d1ea780 1 < completed multipart upload key=RWVWJHVZE95H upload=GUJP3WGIPPA3 tag=GZTTXVBKQ37W type=write size=3030940 2024-09-12T17:18:19.773 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.773+0000 7f574d1ea780 1 > prepared operation key=C9IYR9CET1I8 tag=MWHQBT8X3B6W type=del size=1975891 2024-09-12T17:18:19.775 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.774+0000 7f574d1ea780 1 < completed part key=_multipart_7BX38Q7723EB.2~YMUIV2MM3QZ3.0 size=171072 2024-09-12T17:18:19.777 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.776+0000 7f574d1ea780 1 < completed multipart upload key=7BX38Q7723EB upload=YMUIV2MM3QZ3 tag=OUHO6U1JWB8J type=write size=1219648 2024-09-12T17:18:19.780 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.779+0000 7f574d1ea780 1 > prepared part key=_multipart_RNI86YYLADT0.2~NUVYCJJ0W0TE.0 size=47549 2024-09-12T17:18:19.780 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.779+0000 7f574d1ea780 1 > prepared multipart upload key=RNI86YYLADT0 upload=NUVYCJJ0W0TE tag=88FWALOO0RAI type=write size=1096125 2024-09-12T17:18:19.781 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.780+0000 7f574d1ea780 1 < completed write operation key=UTCKL1F42X8A tag=1RY60XGC1ADT type=write size=791000 2024-09-12T17:18:19.782 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.781+0000 7f574d1ea780 1 > prepared operation key=DH02JGZP64MN tag=XEQ8Y9ERA70C type=del size=1599571 2024-09-12T17:18:19.784 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.783+0000 7f574d1ea780 1 < completed part key=_multipart_54LQ91UMBJAN.2~TJD3XMZOG8X0.0 size=418871 2024-09-12T17:18:19.786 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.785+0000 7f574d1ea780 1 < completed multipart upload key=54LQ91UMBJAN upload=TJD3XMZOG8X0 tag=BH5NO7HK8ENR type=write size=1467447 2024-09-12T17:18:19.787 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.786+0000 7f574d1ea780 1 > prepared operation key=ENFNIFHQ3SHW tag=V3TRW4YTNDHY type=write size=820072 2024-09-12T17:18:19.788 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.787+0000 7f574d1ea780 1 < completed part key=_multipart_55V137SY4E4P.2~Y8G6IYPN37Z3.0 size=432002 2024-09-12T17:18:19.790 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.790+0000 7f574d1ea780 1 < completed multipart upload key=55V137SY4E4P upload=Y8G6IYPN37Z3 tag=3OPL3Q09Q4UX type=write size=1480578 2024-09-12T17:18:19.792 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.791+0000 7f574d1ea780 1 > prepared operation key=K12MVG618809 tag=XQ9X96D3Z9J9 type=del size=1928778 2024-09-12T17:18:19.793 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.792+0000 7f574d1ea780 1 < completed delete operation key=ZGH8XC39FGTC tag=LKP2YJESGSV6 type=del 2024-09-12T17:18:19.794 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.793+0000 7f574d1ea780 1 > prepared operation key=55V137SY4E4P tag=0JLC8A6MXX64 type=del size=1350826 2024-09-12T17:18:19.796 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.795+0000 7f574d1ea780 1 < completed delete operation key=K12MVG618809 tag=UIXBZ24C22MV type=del 2024-09-12T17:18:19.797 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.796+0000 7f574d1ea780 1 > prepared operation key=Q2Q3B1J3DAVD tag=BCT8FVVLNW0R type=del size=3750914 2024-09-12T17:18:19.798 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.798+0000 7f574d1ea780 1 < completed part key=_multipart_TIKBUXFPVTN1.2~A6SWA37MM3SM.0 size=1048576 2024-09-12T17:18:19.799 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.799+0000 7f574d1ea780 1 < completed part key=_multipart_TIKBUXFPVTN1.2~A6SWA37MM3SM.1 size=555106 2024-09-12T17:18:19.802 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.801+0000 7f574d1ea780 1 < completed multipart upload key=TIKBUXFPVTN1 upload=A6SWA37MM3SM tag=PS9W7Q9QX77S type=write size=2652258 2024-09-12T17:18:19.803 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.802+0000 7f574d1ea780 1 > prepared operation key=ENFNIFHQ3SHW tag=VBR0D3LCAWF1 type=write size=711322 2024-09-12T17:18:19.804 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.803+0000 7f574d1ea780 1 < completed delete operation key=GEGOEB05R0PK tag=S2HP300WXXRU type=del 2024-09-12T17:18:19.806 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.805+0000 7f574d1ea780 1 > prepared operation key=54LQ91UMBJAN tag=IJH9DFUEOAJD type=del size=536098 2024-09-12T17:18:19.806 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.805+0000 7f574d1ea780 1 < canceled part key=_multipart_43GV2N9VBBKE.2~H50BVLKJFJ4E.0 size=701101 2024-09-12T17:18:19.808 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.807+0000 7f574d1ea780 1 < canceled multipart upload key=43GV2N9VBBKE upload=H50BVLKJFJ4E tag=OSRK2IQ4U30G type=write size=1749677 2024-09-12T17:18:19.809 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.808+0000 7f574d1ea780 1 > prepared operation key=QXD8UG2K4STQ tag=2K1OKCYPD0QU type=del size=2312941 2024-09-12T17:18:19.810 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.809+0000 7f574d1ea780 1 < canceled operation key=ZGE1860DMGHA tag=KNJE330F9TQN type=write size=174733 2024-09-12T17:18:19.812 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.811+0000 7f574d1ea780 1 > prepared operation key=8VW3XCUHLF2L tag=5076GLOC1KRN type=del size=2472438 2024-09-12T17:18:19.814 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.813+0000 7f574d1ea780 1 < completed delete operation key=ZGE1860DMGHA tag=30MOSGCPPCEH type=del 2024-09-12T17:18:19.816 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.815+0000 7f574d1ea780 1 > prepared operation key=ZGH8XC39FGTC tag=AEAVJIDVE8HU type=del size=4188906 2024-09-12T17:18:19.817 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.816+0000 7f574d1ea780 1 < completed part key=_multipart_K12MVG618809.2~7TKQRTPAJ4JV.0 size=1048576 2024-09-12T17:18:19.818 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.817+0000 7f574d1ea780 1 < completed part key=_multipart_K12MVG618809.2~7TKQRTPAJ4JV.1 size=1048576 2024-09-12T17:18:19.819 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.818+0000 7f574d1ea780 1 < completed part key=_multipart_K12MVG618809.2~7TKQRTPAJ4JV.2 size=381429 2024-09-12T17:18:19.821 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.820+0000 7f574d1ea780 1 < completed multipart upload key=K12MVG618809 upload=7TKQRTPAJ4JV tag=V20K1KY79R0C type=write size=3527157 2024-09-12T17:18:19.822 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.821+0000 7f574d1ea780 1 > prepared operation key=ENFNIFHQ3SHW tag=UAKTOHLR8AFE type=del size=2308088 2024-09-12T17:18:19.823 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.823+0000 7f574d1ea780 1 < completed delete operation key=A1TIP3RXHBCZ tag=397K5QQF9QTZ type=del 2024-09-12T17:18:19.825 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.824+0000 7f574d1ea780 1 > prepared operation key=HFWA7DNUMWF2 tag=6GVFOUTR03R0 type=del size=2112118 2024-09-12T17:18:19.826 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.825+0000 7f574d1ea780 1 < completed write operation key=Q2Q3B1J3DAVD tag=S3W6NZ8JEN0S type=write size=826994 2024-09-12T17:18:19.828 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.827+0000 7f574d1ea780 1 > prepared part key=_multipart_C9IYR9CET1I8.2~CB5NGPOR5IRD.0 size=1048576 2024-09-12T17:18:19.829 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.828+0000 7f574d1ea780 1 > prepared part key=_multipart_C9IYR9CET1I8.2~CB5NGPOR5IRD.1 size=890843 2024-09-12T17:18:19.829 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.828+0000 7f574d1ea780 1 > prepared multipart upload key=C9IYR9CET1I8 upload=CB5NGPOR5IRD tag=U0U6AVL2YP6R type=write size=2987995 2024-09-12T17:18:19.830 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.829+0000 7f574d1ea780 1 < completed part key=_multipart_K12MVG618809.2~93O5DWHY2KVM.0 size=1048576 2024-09-12T17:18:19.831 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.830+0000 7f574d1ea780 1 < completed part key=_multipart_K12MVG618809.2~93O5DWHY2KVM.1 size=1048576 2024-09-12T17:18:19.832 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.831+0000 7f574d1ea780 1 < completed part key=_multipart_K12MVG618809.2~93O5DWHY2KVM.2 size=229043 2024-09-12T17:18:19.834 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.833+0000 7f574d1ea780 1 < completed multipart upload key=K12MVG618809 upload=93O5DWHY2KVM tag=3EV9Z7KBCV15 type=write size=3374771 2024-09-12T17:18:19.835 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.835+0000 7f574d1ea780 1 > prepared operation key=OI51GO639LFK tag=PV8TDABDFYG7 type=del size=3673526 2024-09-12T17:18:19.837 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.836+0000 7f574d1ea780 1 < completed delete operation key=C9IYR9CET1I8 tag=MWHQBT8X3B6W type=del 2024-09-12T17:18:19.838 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.837+0000 7f574d1ea780 1 > prepared operation key=TIKBUXFPVTN1 tag=KWW7CZ3BP66T type=del size=3435776 2024-09-12T17:18:19.840 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.839+0000 7f574d1ea780 1 < completed part key=_multipart_RNI86YYLADT0.2~NUVYCJJ0W0TE.0 size=47549 2024-09-12T17:18:19.842 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.841+0000 7f574d1ea780 1 < completed multipart upload key=RNI86YYLADT0 upload=NUVYCJJ0W0TE tag=88FWALOO0RAI type=write size=1096125 2024-09-12T17:18:19.843 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.842+0000 7f574d1ea780 1 > prepared operation key=UFKM4I8RMT0W tag=E0JUQOYY8UC7 type=del size=1944537 2024-09-12T17:18:19.845 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.844+0000 7f574d1ea780 1 < completed delete operation key=DH02JGZP64MN tag=XEQ8Y9ERA70C type=del 2024-09-12T17:18:19.846 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.845+0000 7f574d1ea780 1 > prepared operation key=Q2Q3B1J3DAVD tag=FOVVIKH8INKH type=del size=1255136 2024-09-12T17:18:19.847 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.846+0000 7f574d1ea780 1 < completed write operation key=ENFNIFHQ3SHW tag=V3TRW4YTNDHY type=write size=820072 2024-09-12T17:18:19.850 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.849+0000 7f574d1ea780 1 > prepared part key=_multipart_DH02JGZP64MN.2~R0SS130RYP46.0 size=1048576 2024-09-12T17:18:19.851 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.850+0000 7f574d1ea780 1 > prepared part key=_multipart_DH02JGZP64MN.2~R0SS130RYP46.1 size=264985 2024-09-12T17:18:19.851 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.850+0000 7f574d1ea780 1 > prepared multipart upload key=DH02JGZP64MN upload=R0SS130RYP46 tag=Y20VDUR38S4J type=write size=2362137 2024-09-12T17:18:19.852 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.851+0000 7f574d1ea780 1 < completed delete operation key=K12MVG618809 tag=XQ9X96D3Z9J9 type=del 2024-09-12T17:18:19.853 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.852+0000 7f574d1ea780 1 > prepared operation key=7BX38Q7723EB tag=RH2CG9EZ7DJ6 type=write size=914746 2024-09-12T17:18:19.855 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.854+0000 7f574d1ea780 1 < completed delete operation key=55V137SY4E4P tag=0JLC8A6MXX64 type=del 2024-09-12T17:18:19.856 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.855+0000 7f574d1ea780 1 > prepared operation key=HGZMN894YYC0 tag=2I32SK7B04MH type=write size=959701 2024-09-12T17:18:19.858 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.857+0000 7f574d1ea780 1 < suggested update operation key=Q2Q3B1J3DAVD tag=BCT8FVVLNW0R type=del size=3750914 2024-09-12T17:18:19.860 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.860+0000 7f574d1ea780 1 > prepared part key=_multipart_K12MVG618809.2~RKG0YLYYD64O.0 size=399428 2024-09-12T17:18:19.860 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.860+0000 7f574d1ea780 1 > prepared multipart upload key=K12MVG618809 upload=RKG0YLYYD64O tag=EXIUX8AMFVNX type=write size=1448004 2024-09-12T17:18:19.862 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.861+0000 7f574d1ea780 1 < completed write operation key=ENFNIFHQ3SHW tag=VBR0D3LCAWF1 type=write size=711322 2024-09-12T17:18:19.863 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.862+0000 7f574d1ea780 1 > prepared operation key=8VW3XCUHLF2L tag=CZAOXZ9FGA86 type=del size=3034323 2024-09-12T17:18:19.864 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.863+0000 7f574d1ea780 1 < canceled operation key=54LQ91UMBJAN tag=IJH9DFUEOAJD type=del size=536098 2024-09-12T17:18:19.865 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.865+0000 7f574d1ea780 1 > prepared operation key=ENFNIFHQ3SHW tag=2QU11BN5RJ7E type=del size=3161382 2024-09-12T17:18:19.868 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.867+0000 7f574d1ea780 1 < suggested remove operation key=QXD8UG2K4STQ tag=2K1OKCYPD0QU type=del 2024-09-12T17:18:19.869 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.868+0000 7f574d1ea780 1 > prepared operation key=55JI541K1WP2 tag=MBOAQ75ZUS3A type=del size=2224187 2024-09-12T17:18:19.871 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.870+0000 7f574d1ea780 1 < suggested update operation key=8VW3XCUHLF2L tag=5076GLOC1KRN type=del size=2472438 2024-09-12T17:18:19.873 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.872+0000 7f574d1ea780 1 > prepared operation key=U6E9A5OH4GUW tag=O1KR2S15B3P0 type=del size=586358 2024-09-12T17:18:19.874 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.873+0000 7f574d1ea780 1 < canceled operation key=ZGH8XC39FGTC tag=AEAVJIDVE8HU type=del size=4188906 2024-09-12T17:18:19.875 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.874+0000 7f574d1ea780 1 > prepared operation key=VWWA5IB0L4N1 tag=BTA3YB05O8D7 type=del size=2597656 2024-09-12T17:18:19.876 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.875+0000 7f574d1ea780 1 < completed delete operation key=ENFNIFHQ3SHW tag=UAKTOHLR8AFE type=del 2024-09-12T17:18:19.881 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.877+0000 7f574d1ea780 1 > prepared operation key=54CM8800AT9V tag=GQ1D8I6N7SI0 type=del size=2502969 2024-09-12T17:18:19.881 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.878+0000 7f574d1ea780 1 < canceled operation key=HFWA7DNUMWF2 tag=6GVFOUTR03R0 type=del size=2112118 2024-09-12T17:18:19.881 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.880+0000 7f574d1ea780 1 > prepared part key=_multipart_54CM8800AT9V.2~K44ANV4P0KE3.0 size=974852 2024-09-12T17:18:19.881 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.880+0000 7f574d1ea780 1 > prepared multipart upload key=54CM8800AT9V upload=K44ANV4P0KE3 tag=1BEFZQ3N6YWI type=write size=2023428 2024-09-12T17:18:19.882 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.881+0000 7f574d1ea780 1 < completed part key=_multipart_C9IYR9CET1I8.2~CB5NGPOR5IRD.0 size=1048576 2024-09-12T17:18:19.883 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.882+0000 7f574d1ea780 1 < completed part key=_multipart_C9IYR9CET1I8.2~CB5NGPOR5IRD.1 size=890843 2024-09-12T17:18:19.885 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.884+0000 7f574d1ea780 1 < completed multipart upload key=C9IYR9CET1I8 upload=CB5NGPOR5IRD tag=U0U6AVL2YP6R type=write size=2987995 2024-09-12T17:18:19.886 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.885+0000 7f574d1ea780 1 > prepared operation key=7BX38Q7723EB tag=I5JL6T36S0BX type=del size=1699204 2024-09-12T17:18:19.887 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.887+0000 7f574d1ea780 1 < completed delete operation key=OI51GO639LFK tag=PV8TDABDFYG7 type=del 2024-09-12T17:18:19.889 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.888+0000 7f574d1ea780 1 > prepared operation key=ZGE1860DMGHA tag=WCPOF05AYOGB type=del size=4163027 2024-09-12T17:18:19.890 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.889+0000 7f574d1ea780 1 < canceled operation key=TIKBUXFPVTN1 tag=KWW7CZ3BP66T type=del size=3435776 2024-09-12T17:18:19.891 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.890+0000 7f574d1ea780 1 > prepared operation key=ZGE1860DMGHA tag=17L3LBSXBHGD type=del size=1306940 2024-09-12T17:18:19.893 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.892+0000 7f574d1ea780 1 < completed delete operation key=UFKM4I8RMT0W tag=E0JUQOYY8UC7 type=del 2024-09-12T17:18:19.895 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.894+0000 7f574d1ea780 1 > prepared part key=_multipart_GEGOEB05R0PK.2~VY1150EST06I.0 size=993877 2024-09-12T17:18:19.895 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.894+0000 7f574d1ea780 1 > prepared multipart upload key=GEGOEB05R0PK upload=VY1150EST06I tag=XNSB7EW18Z7P type=write size=2042453 2024-09-12T17:18:19.896 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.895+0000 7f574d1ea780 -1 < failed to complete operation key=Q2Q3B1J3DAVD tag=FOVVIKH8INKH type=del size=1255136: (22) Invalid argument 2024-09-12T17:18:19.898 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.898+0000 7f574d1ea780 1 > prepared part key=_multipart_Q2Q3B1J3DAVD.2~UYDL5F9MEAM9.0 size=38882 2024-09-12T17:18:19.899 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.898+0000 7f574d1ea780 1 > prepared multipart upload key=Q2Q3B1J3DAVD upload=UYDL5F9MEAM9 tag=E1DRROWCEQ7H type=write size=1087458 2024-09-12T17:18:19.899 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.898+0000 7f574d1ea780 1 < canceled part key=_multipart_DH02JGZP64MN.2~R0SS130RYP46.0 size=1048576 2024-09-12T17:18:19.899 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.898+0000 7f574d1ea780 1 < canceled part key=_multipart_DH02JGZP64MN.2~R0SS130RYP46.1 size=264985 2024-09-12T17:18:19.901 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.900+0000 7f574d1ea780 1 < canceled multipart upload key=DH02JGZP64MN upload=R0SS130RYP46 tag=Y20VDUR38S4J type=write size=2362137 2024-09-12T17:18:19.902 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.901+0000 7f574d1ea780 1 > prepared operation key=D1GEG3MKPOM3 tag=31ONBAD6W3WM type=write size=841466 2024-09-12T17:18:19.905 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.904+0000 7f574d1ea780 1 < suggested remove operation key=7BX38Q7723EB tag=RH2CG9EZ7DJ6 type=write 2024-09-12T17:18:19.906 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.905+0000 7f574d1ea780 1 > prepared operation key=UFKM4I8RMT0W tag=OJIOD5FDO2O7 type=del size=2321279 2024-09-12T17:18:19.907 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.906+0000 7f574d1ea780 1 < completed write operation key=HGZMN894YYC0 tag=2I32SK7B04MH type=write size=959701 2024-09-12T17:18:19.908 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.908+0000 7f574d1ea780 1 > prepared operation key=QXD8UG2K4STQ tag=MISW7ED65A0D type=del size=2413186 2024-09-12T17:18:19.910 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.909+0000 7f574d1ea780 1 < completed part key=_multipart_K12MVG618809.2~RKG0YLYYD64O.0 size=399428 2024-09-12T17:18:19.912 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.911+0000 7f574d1ea780 1 < completed multipart upload key=K12MVG618809 upload=RKG0YLYYD64O tag=EXIUX8AMFVNX type=write size=1448004 2024-09-12T17:18:19.914 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.914+0000 7f574d1ea780 1 > prepared part key=_multipart_UFKM4I8RMT0W.2~MVQBO3ZNPQ9C.0 size=1048576 2024-09-12T17:18:19.915 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.915+0000 7f574d1ea780 1 > prepared part key=_multipart_UFKM4I8RMT0W.2~MVQBO3ZNPQ9C.1 size=1048576 2024-09-12T17:18:19.916 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.916+0000 7f574d1ea780 1 > prepared part key=_multipart_UFKM4I8RMT0W.2~MVQBO3ZNPQ9C.2 size=757446 2024-09-12T17:18:19.917 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.916+0000 7f574d1ea780 1 > prepared multipart upload key=UFKM4I8RMT0W upload=MVQBO3ZNPQ9C tag=Y598MPE0JISP type=write size=3903174 2024-09-12T17:18:19.918 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.917+0000 7f574d1ea780 -1 < failed to complete operation key=8VW3XCUHLF2L tag=CZAOXZ9FGA86 type=del size=3034323: (22) Invalid argument 2024-09-12T17:18:19.920 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.919+0000 7f574d1ea780 1 > prepared part key=_multipart_8SG7DJO4HWPI.2~EHCTM4VR1ASV.0 size=1048576 2024-09-12T17:18:19.923 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.922+0000 7f574d1ea780 1 > prepared part key=_multipart_8SG7DJO4HWPI.2~EHCTM4VR1ASV.1 size=1048576 2024-09-12T17:18:19.924 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.923+0000 7f574d1ea780 1 > prepared part key=_multipart_8SG7DJO4HWPI.2~EHCTM4VR1ASV.2 size=398896 2024-09-12T17:18:19.924 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.923+0000 7f574d1ea780 1 > prepared multipart upload key=8SG7DJO4HWPI upload=EHCTM4VR1ASV tag=EB8M0CZAIZ6H type=write size=3544624 2024-09-12T17:18:19.925 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.925+0000 7f574d1ea780 1 < completed delete operation key=ENFNIFHQ3SHW tag=2QU11BN5RJ7E type=del 2024-09-12T17:18:19.927 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.926+0000 7f574d1ea780 1 > prepared operation key=54LQ91UMBJAN tag=Q1Y082OMTQ9F type=del size=696398 2024-09-12T17:18:19.928 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.927+0000 7f574d1ea780 1 < canceled operation key=55JI541K1WP2 tag=MBOAQ75ZUS3A type=del size=2224187 2024-09-12T17:18:19.929 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.928+0000 7f574d1ea780 1 > prepared operation key=UFKM4I8RMT0W tag=SSCS85W74IH5 type=del size=807052 2024-09-12T17:18:19.931 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.930+0000 7f574d1ea780 1 < completed delete operation key=U6E9A5OH4GUW tag=O1KR2S15B3P0 type=del 2024-09-12T17:18:19.932 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.931+0000 7f574d1ea780 1 > prepared operation key=8SG7DJO4HWPI tag=I8FARHOBSI5G type=del size=2633021 2024-09-12T17:18:19.934 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.933+0000 7f574d1ea780 1 < suggested update operation key=VWWA5IB0L4N1 tag=BTA3YB05O8D7 type=del size=2597656 2024-09-12T17:18:19.936 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.936+0000 7f574d1ea780 1 > prepared operation key=TIKBUXFPVTN1 tag=R3VNYA7XY0ZC type=del size=2671607 2024-09-12T17:18:19.938 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.937+0000 7f574d1ea780 1 < completed delete operation key=54CM8800AT9V tag=GQ1D8I6N7SI0 type=del 2024-09-12T17:18:19.939 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.938+0000 7f574d1ea780 1 > prepared operation key=HGZMN894YYC0 tag=QM954UKKJ9SK type=del size=1560903 2024-09-12T17:18:19.940 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.939+0000 7f574d1ea780 1 < completed part key=_multipart_54CM8800AT9V.2~K44ANV4P0KE3.0 size=974852 2024-09-12T17:18:19.942 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.941+0000 7f574d1ea780 1 < completed multipart upload key=54CM8800AT9V upload=K44ANV4P0KE3 tag=1BEFZQ3N6YWI type=write size=2023428 2024-09-12T17:18:19.944 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.943+0000 7f574d1ea780 1 > prepared part key=_multipart_R00F69ON5P6Z.2~O3VDMC7ETOK3.0 size=1048576 2024-09-12T17:18:19.945 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.944+0000 7f574d1ea780 1 > prepared part key=_multipart_R00F69ON5P6Z.2~O3VDMC7ETOK3.1 size=1048576 2024-09-12T17:18:19.946 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.945+0000 7f574d1ea780 1 > prepared part key=_multipart_R00F69ON5P6Z.2~O3VDMC7ETOK3.2 size=183561 2024-09-12T17:18:19.946 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.945+0000 7f574d1ea780 1 > prepared multipart upload key=R00F69ON5P6Z upload=O3VDMC7ETOK3 tag=JM15HPHX71CL type=write size=3329289 2024-09-12T17:18:19.947 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.946+0000 7f574d1ea780 -1 < failed to complete operation key=7BX38Q7723EB tag=I5JL6T36S0BX type=del size=1699204: (22) Invalid argument 2024-09-12T17:18:19.949 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.948+0000 7f574d1ea780 1 > prepared operation key=K12MVG618809 tag=B8T807C8S3FF type=del size=2903747 2024-09-12T17:18:19.950 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.949+0000 7f574d1ea780 1 < completed delete operation key=ZGE1860DMGHA tag=WCPOF05AYOGB type=del 2024-09-12T17:18:19.951 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.950+0000 7f574d1ea780 1 > prepared operation key=HFWA7DNUMWF2 tag=LLQ9K3TSFUMJ type=write size=605359 2024-09-12T17:18:19.952 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.951+0000 7f574d1ea780 1 < completed delete operation key=ZGE1860DMGHA tag=17L3LBSXBHGD type=del 2024-09-12T17:18:19.953 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.953+0000 7f574d1ea780 1 > prepared operation key=D1GEG3MKPOM3 tag=QSRMG15VBHRO type=del size=4066293 2024-09-12T17:18:19.955 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.954+0000 7f574d1ea780 1 < completed part key=_multipart_GEGOEB05R0PK.2~VY1150EST06I.0 size=993877 2024-09-12T17:18:19.957 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.956+0000 7f574d1ea780 1 < completed multipart upload key=GEGOEB05R0PK upload=VY1150EST06I tag=XNSB7EW18Z7P type=write size=2042453 2024-09-12T17:18:19.958 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.957+0000 7f574d1ea780 1 > prepared operation key=C9IYR9CET1I8 tag=8K6HPK5NZZ3U type=del size=1956172 2024-09-12T17:18:19.959 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.958+0000 7f574d1ea780 1 < completed part key=_multipart_Q2Q3B1J3DAVD.2~UYDL5F9MEAM9.0 size=38882 2024-09-12T17:18:19.961 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.960+0000 7f574d1ea780 1 < completed multipart upload key=Q2Q3B1J3DAVD upload=UYDL5F9MEAM9 tag=E1DRROWCEQ7H type=write size=1087458 2024-09-12T17:18:19.962 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.961+0000 7f574d1ea780 1 > prepared operation key=C9IYR9CET1I8 tag=KYLCKF8XKTMA type=write size=933686 2024-09-12T17:18:19.963 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.963+0000 7f574d1ea780 1 < canceled operation key=D1GEG3MKPOM3 tag=31ONBAD6W3WM type=write size=841466 2024-09-12T17:18:19.966 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.965+0000 7f574d1ea780 1 > prepared part key=_multipart_7BX38Q7723EB.2~R6OG9RNQR9TS.0 size=1048576 2024-09-12T17:18:19.967 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.966+0000 7f574d1ea780 1 > prepared part key=_multipart_7BX38Q7723EB.2~R6OG9RNQR9TS.1 size=1048576 2024-09-12T17:18:19.967 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.967+0000 7f574d1ea780 1 > prepared part key=_multipart_7BX38Q7723EB.2~R6OG9RNQR9TS.2 size=786196 2024-09-12T17:18:19.968 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.967+0000 7f574d1ea780 1 > prepared multipart upload key=7BX38Q7723EB upload=R6OG9RNQR9TS tag=Z5Q2AQCCVG3P type=write size=3931924 2024-09-12T17:18:19.969 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.968+0000 7f574d1ea780 1 < completed delete operation key=UFKM4I8RMT0W tag=OJIOD5FDO2O7 type=del 2024-09-12T17:18:19.970 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.969+0000 7f574d1ea780 1 > prepared operation key=7BX38Q7723EB tag=B9FXP63Q0S38 type=del size=573050 2024-09-12T17:18:19.971 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.970+0000 7f574d1ea780 1 < completed delete operation key=QXD8UG2K4STQ tag=MISW7ED65A0D type=del 2024-09-12T17:18:19.973 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.973+0000 7f574d1ea780 1 > prepared part key=_multipart_C9IYR9CET1I8.2~7WIMB862JHIL.0 size=365787 2024-09-12T17:18:19.973 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.973+0000 7f574d1ea780 1 > prepared multipart upload key=C9IYR9CET1I8 upload=7WIMB862JHIL tag=YREM3OJA931V type=write size=1414363 2024-09-12T17:18:19.975 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.974+0000 7f574d1ea780 1 < completed part key=_multipart_UFKM4I8RMT0W.2~MVQBO3ZNPQ9C.0 size=1048576 2024-09-12T17:18:19.976 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.975+0000 7f574d1ea780 1 < completed part key=_multipart_UFKM4I8RMT0W.2~MVQBO3ZNPQ9C.1 size=1048576 2024-09-12T17:18:19.977 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.976+0000 7f574d1ea780 1 < completed part key=_multipart_UFKM4I8RMT0W.2~MVQBO3ZNPQ9C.2 size=757446 2024-09-12T17:18:19.979 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.978+0000 7f574d1ea780 1 < completed multipart upload key=UFKM4I8RMT0W upload=MVQBO3ZNPQ9C tag=Y598MPE0JISP type=write size=3903174 2024-09-12T17:18:19.981 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.980+0000 7f574d1ea780 1 > prepared part key=_multipart_K12MVG618809.2~K9G8947I8Y09.0 size=1048576 2024-09-12T17:18:19.982 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.981+0000 7f574d1ea780 1 > prepared part key=_multipart_K12MVG618809.2~K9G8947I8Y09.1 size=1048576 2024-09-12T17:18:19.983 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.982+0000 7f574d1ea780 1 > prepared part key=_multipart_K12MVG618809.2~K9G8947I8Y09.2 size=239379 2024-09-12T17:18:19.983 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.982+0000 7f574d1ea780 1 > prepared multipart upload key=K12MVG618809 upload=K9G8947I8Y09 tag=ISF7AFHQXJTK type=write size=3385107 2024-09-12T17:18:19.984 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.983+0000 7f574d1ea780 1 < completed part key=_multipart_8SG7DJO4HWPI.2~EHCTM4VR1ASV.0 size=1048576 2024-09-12T17:18:19.985 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.985+0000 7f574d1ea780 1 < completed part key=_multipart_8SG7DJO4HWPI.2~EHCTM4VR1ASV.1 size=1048576 2024-09-12T17:18:19.986 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.986+0000 7f574d1ea780 1 < completed part key=_multipart_8SG7DJO4HWPI.2~EHCTM4VR1ASV.2 size=398896 2024-09-12T17:18:19.989 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.988+0000 7f574d1ea780 1 < completed multipart upload key=8SG7DJO4HWPI upload=EHCTM4VR1ASV tag=EB8M0CZAIZ6H type=write size=3544624 2024-09-12T17:18:19.990 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.989+0000 7f574d1ea780 1 > prepared operation key=U6E9A5OH4GUW tag=02317Q39098L type=del size=1558520 2024-09-12T17:18:19.991 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.991+0000 7f574d1ea780 1 < completed delete operation key=54LQ91UMBJAN tag=Q1Y082OMTQ9F type=del 2024-09-12T17:18:19.993 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.992+0000 7f574d1ea780 1 > prepared operation key=QXD8UG2K4STQ tag=6X5LYNAU8FNB type=del size=379330 2024-09-12T17:18:19.994 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.993+0000 7f574d1ea780 1 < canceled operation key=UFKM4I8RMT0W tag=SSCS85W74IH5 type=del size=807052 2024-09-12T17:18:19.995 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.994+0000 7f574d1ea780 1 > prepared operation key=UTCKL1F42X8A tag=0RPVV9D3FQRY type=del size=149660 2024-09-12T17:18:19.996 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.996+0000 7f574d1ea780 1 < completed delete operation key=8SG7DJO4HWPI tag=I8FARHOBSI5G type=del 2024-09-12T17:18:19.999 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.998+0000 7f574d1ea780 1 > prepared part key=_multipart_Q2Q3B1J3DAVD.2~5PX8C3DSF1KL.0 size=1048576 2024-09-12T17:18:20.000 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.999+0000 7f574d1ea780 1 > prepared part key=_multipart_Q2Q3B1J3DAVD.2~5PX8C3DSF1KL.1 size=525067 2024-09-12T17:18:20.000 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:19.999+0000 7f574d1ea780 1 > prepared multipart upload key=Q2Q3B1J3DAVD upload=5PX8C3DSF1KL tag=5AUKBD0NY0UK type=write size=2622219 2024-09-12T17:18:20.001 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.000+0000 7f574d1ea780 1 < completed delete operation key=TIKBUXFPVTN1 tag=R3VNYA7XY0ZC type=del 2024-09-12T17:18:20.002 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.001+0000 7f574d1ea780 1 > prepared operation key=54LQ91UMBJAN tag=GS8W5RC29G8K type=write size=843654 2024-09-12T17:18:20.003 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.003+0000 7f574d1ea780 1 < canceled operation key=HGZMN894YYC0 tag=QM954UKKJ9SK type=del size=1560903 2024-09-12T17:18:20.005 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.004+0000 7f574d1ea780 1 > prepared operation key=D1GEG3MKPOM3 tag=KTF5BKUUZWPD type=del size=2221582 2024-09-12T17:18:20.006 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.005+0000 7f574d1ea780 1 < completed part key=_multipart_R00F69ON5P6Z.2~O3VDMC7ETOK3.0 size=1048576 2024-09-12T17:18:20.007 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.006+0000 7f574d1ea780 1 < completed part key=_multipart_R00F69ON5P6Z.2~O3VDMC7ETOK3.1 size=1048576 2024-09-12T17:18:20.008 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.007+0000 7f574d1ea780 1 < completed part key=_multipart_R00F69ON5P6Z.2~O3VDMC7ETOK3.2 size=183561 2024-09-12T17:18:20.010 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.009+0000 7f574d1ea780 1 < completed multipart upload key=R00F69ON5P6Z upload=O3VDMC7ETOK3 tag=JM15HPHX71CL type=write size=3329289 2024-09-12T17:18:20.012 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.011+0000 7f574d1ea780 1 > prepared part key=_multipart_UFKM4I8RMT0W.2~Q6QMLRP621PM.0 size=1048576 2024-09-12T17:18:20.013 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.012+0000 7f574d1ea780 1 > prepared part key=_multipart_UFKM4I8RMT0W.2~Q6QMLRP621PM.1 size=923888 2024-09-12T17:18:20.013 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.012+0000 7f574d1ea780 1 > prepared multipart upload key=UFKM4I8RMT0W upload=Q6QMLRP621PM tag=8RJCGS5B6QK7 type=write size=3021040 2024-09-12T17:18:20.014 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.014+0000 7f574d1ea780 1 < completed delete operation key=K12MVG618809 tag=B8T807C8S3FF type=del 2024-09-12T17:18:20.016 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.015+0000 7f574d1ea780 1 > prepared operation key=GEGOEB05R0PK tag=4T621XR2H1TM type=del size=1148169 2024-09-12T17:18:20.017 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.016+0000 7f574d1ea780 1 < completed write operation key=HFWA7DNUMWF2 tag=LLQ9K3TSFUMJ type=write size=605359 2024-09-12T17:18:20.018 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.017+0000 7f574d1ea780 1 > prepared operation key=ENFNIFHQ3SHW tag=BSI7OTKDQ40R type=del size=2108830 2024-09-12T17:18:20.019 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.019+0000 7f574d1ea780 1 < completed delete operation key=D1GEG3MKPOM3 tag=QSRMG15VBHRO type=del 2024-09-12T17:18:20.022 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.021+0000 7f574d1ea780 1 > prepared part key=_multipart_DH02JGZP64MN.2~H3AY5B8AZHE3.0 size=1048576 2024-09-12T17:18:20.023 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.022+0000 7f574d1ea780 1 > prepared part key=_multipart_DH02JGZP64MN.2~H3AY5B8AZHE3.1 size=1048576 2024-09-12T17:18:20.024 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.023+0000 7f574d1ea780 1 > prepared part key=_multipart_DH02JGZP64MN.2~H3AY5B8AZHE3.2 size=139318 2024-09-12T17:18:20.024 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.023+0000 7f574d1ea780 1 > prepared multipart upload key=DH02JGZP64MN upload=H3AY5B8AZHE3 tag=MCS19N4F1VXM type=write size=3285046 2024-09-12T17:18:20.025 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.024+0000 7f574d1ea780 1 < completed delete operation key=C9IYR9CET1I8 tag=8K6HPK5NZZ3U type=del 2024-09-12T17:18:20.026 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.025+0000 7f574d1ea780 1 > prepared operation key=ZGH8XC39FGTC tag=Q1VI2DTEBI36 type=del size=1697208 2024-09-12T17:18:20.027 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.027+0000 7f574d1ea780 1 < completed write operation key=C9IYR9CET1I8 tag=KYLCKF8XKTMA type=write size=933686 2024-09-12T17:18:20.029 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.028+0000 7f574d1ea780 1 > prepared operation key=RWVWJHVZE95H tag=RMKFX46O1A3K type=del size=2868519 2024-09-12T17:18:20.030 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.029+0000 7f574d1ea780 1 < completed part key=_multipart_7BX38Q7723EB.2~R6OG9RNQR9TS.0 size=1048576 2024-09-12T17:18:20.031 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.030+0000 7f574d1ea780 1 < completed part key=_multipart_7BX38Q7723EB.2~R6OG9RNQR9TS.1 size=1048576 2024-09-12T17:18:20.032 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.031+0000 7f574d1ea780 1 < completed part key=_multipart_7BX38Q7723EB.2~R6OG9RNQR9TS.2 size=786196 2024-09-12T17:18:20.034 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.033+0000 7f574d1ea780 1 < completed multipart upload key=7BX38Q7723EB upload=R6OG9RNQR9TS tag=Z5Q2AQCCVG3P type=write size=3931924 2024-09-12T17:18:20.035 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.034+0000 7f574d1ea780 1 > prepared operation key=UTCKL1F42X8A tag=1W0D22DPP0UP type=del size=2103975 2024-09-12T17:18:20.036 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.036+0000 7f574d1ea780 1 < completed delete operation key=7BX38Q7723EB tag=B9FXP63Q0S38 type=del 2024-09-12T17:18:20.038 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.037+0000 7f574d1ea780 1 > prepared operation key=ENFNIFHQ3SHW tag=3REMFJPOCQIM type=del size=3757969 2024-09-12T17:18:20.039 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.038+0000 7f574d1ea780 1 < completed part key=_multipart_C9IYR9CET1I8.2~7WIMB862JHIL.0 size=365787 2024-09-12T17:18:20.041 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.040+0000 7f574d1ea780 1 < completed multipart upload key=C9IYR9CET1I8 upload=7WIMB862JHIL tag=YREM3OJA931V type=write size=1414363 2024-09-12T17:18:20.042 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.041+0000 7f574d1ea780 1 > prepared operation key=UFKM4I8RMT0W tag=JYN6MMJFAO38 type=del size=2888477 2024-09-12T17:18:20.043 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.043+0000 7f574d1ea780 1 < completed part key=_multipart_K12MVG618809.2~K9G8947I8Y09.0 size=1048576 2024-09-12T17:18:20.044 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.043+0000 7f574d1ea780 1 < canceled part key=_multipart_K12MVG618809.2~K9G8947I8Y09.1 size=1048576 2024-09-12T17:18:20.045 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.044+0000 7f574d1ea780 1 < completed part key=_multipart_K12MVG618809.2~K9G8947I8Y09.2 size=239379 2024-09-12T17:18:20.047 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.046+0000 7f574d1ea780 1 < canceled multipart upload key=K12MVG618809 upload=K9G8947I8Y09 tag=ISF7AFHQXJTK type=write size=3385107 2024-09-12T17:18:20.048 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.047+0000 7f574d1ea780 1 > prepared operation key=UFKM4I8RMT0W tag=64B33I9CSO5I type=del size=1701274 2024-09-12T17:18:20.049 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.048+0000 7f574d1ea780 1 < completed delete operation key=U6E9A5OH4GUW tag=02317Q39098L type=del 2024-09-12T17:18:20.053 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.052+0000 7f574d1ea780 1 > prepared part key=_multipart_D1GEG3MKPOM3.2~1EW9V0Z71F88.0 size=826410 2024-09-12T17:18:20.053 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.052+0000 7f574d1ea780 1 > prepared multipart upload key=D1GEG3MKPOM3 upload=1EW9V0Z71F88 tag=7QW1WGPY80RD type=write size=1874986 2024-09-12T17:18:20.054 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.053+0000 7f574d1ea780 1 < completed delete operation key=QXD8UG2K4STQ tag=6X5LYNAU8FNB type=del 2024-09-12T17:18:20.056 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.055+0000 7f574d1ea780 1 > prepared part key=_multipart_OI51GO639LFK.2~X3AHUXMRJOJK.0 size=1048576 2024-09-12T17:18:20.057 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.056+0000 7f574d1ea780 1 > prepared part key=_multipart_OI51GO639LFK.2~X3AHUXMRJOJK.1 size=269208 2024-09-12T17:18:20.057 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.056+0000 7f574d1ea780 1 > prepared multipart upload key=OI51GO639LFK upload=X3AHUXMRJOJK tag=SU4WRSTI2PPV type=write size=2366360 2024-09-12T17:18:20.058 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.057+0000 7f574d1ea780 1 < completed delete operation key=UTCKL1F42X8A tag=0RPVV9D3FQRY type=del 2024-09-12T17:18:20.060 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.060+0000 7f574d1ea780 1 > prepared part key=_multipart_U6E9A5OH4GUW.2~A1ZU2WSEY5C0.0 size=1048576 2024-09-12T17:18:20.061 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.061+0000 7f574d1ea780 1 > prepared part key=_multipart_U6E9A5OH4GUW.2~A1ZU2WSEY5C0.1 size=1048576 2024-09-12T17:18:20.062 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.062+0000 7f574d1ea780 1 > prepared part key=_multipart_U6E9A5OH4GUW.2~A1ZU2WSEY5C0.2 size=640887 2024-09-12T17:18:20.062 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.062+0000 7f574d1ea780 1 > prepared multipart upload key=U6E9A5OH4GUW upload=A1ZU2WSEY5C0 tag=71YC8H83I5RZ type=write size=3786615 2024-09-12T17:18:20.064 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.063+0000 7f574d1ea780 1 < completed part key=_multipart_Q2Q3B1J3DAVD.2~5PX8C3DSF1KL.0 size=1048576 2024-09-12T17:18:20.065 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.064+0000 7f574d1ea780 1 < completed part key=_multipart_Q2Q3B1J3DAVD.2~5PX8C3DSF1KL.1 size=525067 2024-09-12T17:18:20.067 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.066+0000 7f574d1ea780 1 < completed multipart upload key=Q2Q3B1J3DAVD upload=5PX8C3DSF1KL tag=5AUKBD0NY0UK type=write size=2622219 2024-09-12T17:18:20.069 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.068+0000 7f574d1ea780 1 > prepared part key=_multipart_HGZMN894YYC0.2~694U56OVWLD3.0 size=1048576 2024-09-12T17:18:20.070 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.069+0000 7f574d1ea780 1 > prepared part key=_multipart_HGZMN894YYC0.2~694U56OVWLD3.1 size=867502 2024-09-12T17:18:20.070 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.069+0000 7f574d1ea780 1 > prepared multipart upload key=HGZMN894YYC0 upload=694U56OVWLD3 tag=DR7JDVBBLUS9 type=write size=2964654 2024-09-12T17:18:20.071 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.070+0000 7f574d1ea780 1 < completed write operation key=54LQ91UMBJAN tag=GS8W5RC29G8K type=write size=843654 2024-09-12T17:18:20.072 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.072+0000 7f574d1ea780 1 > prepared operation key=RWVWJHVZE95H tag=12B4J50S79XA type=del size=2367904 2024-09-12T17:18:20.074 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.073+0000 7f574d1ea780 1 < completed delete operation key=D1GEG3MKPOM3 tag=KTF5BKUUZWPD type=del 2024-09-12T17:18:20.075 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.074+0000 7f574d1ea780 1 > prepared operation key=ZGH8XC39FGTC tag=IPYO3DI7P642 type=del size=3092253 2024-09-12T17:18:20.076 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.075+0000 7f574d1ea780 1 < completed part key=_multipart_UFKM4I8RMT0W.2~Q6QMLRP621PM.0 size=1048576 2024-09-12T17:18:20.077 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.076+0000 7f574d1ea780 1 < completed part key=_multipart_UFKM4I8RMT0W.2~Q6QMLRP621PM.1 size=923888 2024-09-12T17:18:20.079 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.078+0000 7f574d1ea780 1 < completed multipart upload key=UFKM4I8RMT0W upload=Q6QMLRP621PM tag=8RJCGS5B6QK7 type=write size=3021040 2024-09-12T17:18:20.084 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.080+0000 7f574d1ea780 1 > prepared part key=_multipart_VWWA5IB0L4N1.2~UZEE6131EPDL.0 size=850721 2024-09-12T17:18:20.085 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.080+0000 7f574d1ea780 1 > prepared multipart upload key=VWWA5IB0L4N1 upload=UZEE6131EPDL tag=JLW6YS3PDLVM type=write size=1899297 2024-09-12T17:18:20.085 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.082+0000 7f574d1ea780 1 < completed delete operation key=GEGOEB05R0PK tag=4T621XR2H1TM type=del 2024-09-12T17:18:20.085 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.084+0000 7f574d1ea780 1 > prepared part key=_multipart_TIKBUXFPVTN1.2~HLT4ZD76218L.0 size=1048576 2024-09-12T17:18:20.086 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.085+0000 7f574d1ea780 1 > prepared part key=_multipart_TIKBUXFPVTN1.2~HLT4ZD76218L.1 size=940401 2024-09-12T17:18:20.086 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.085+0000 7f574d1ea780 1 > prepared multipart upload key=TIKBUXFPVTN1 upload=HLT4ZD76218L tag=8HQZ7YTU0O3U type=write size=3037553 2024-09-12T17:18:20.087 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.087+0000 7f574d1ea780 1 < canceled operation key=ENFNIFHQ3SHW tag=BSI7OTKDQ40R type=del size=2108830 2024-09-12T17:18:20.089 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.088+0000 7f574d1ea780 1 > prepared operation key=ENFNIFHQ3SHW tag=950JKWOJT792 type=write size=810348 2024-09-12T17:18:20.090 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.089+0000 7f574d1ea780 1 < completed part key=_multipart_DH02JGZP64MN.2~H3AY5B8AZHE3.0 size=1048576 2024-09-12T17:18:20.091 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.090+0000 7f574d1ea780 1 < completed part key=_multipart_DH02JGZP64MN.2~H3AY5B8AZHE3.1 size=1048576 2024-09-12T17:18:20.092 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.091+0000 7f574d1ea780 1 < completed part key=_multipart_DH02JGZP64MN.2~H3AY5B8AZHE3.2 size=139318 2024-09-12T17:18:20.094 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.094+0000 7f574d1ea780 1 < completed multipart upload key=DH02JGZP64MN upload=H3AY5B8AZHE3 tag=MCS19N4F1VXM type=write size=3285046 2024-09-12T17:18:20.097 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.096+0000 7f574d1ea780 1 > prepared part key=_multipart_ZGH8XC39FGTC.2~TVKL3BZMK9W8.0 size=1048576 2024-09-12T17:18:20.098 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.097+0000 7f574d1ea780 1 > prepared part key=_multipart_ZGH8XC39FGTC.2~TVKL3BZMK9W8.1 size=1048576 2024-09-12T17:18:20.099 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.098+0000 7f574d1ea780 1 > prepared part key=_multipart_ZGH8XC39FGTC.2~TVKL3BZMK9W8.2 size=559345 2024-09-12T17:18:20.099 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.098+0000 7f574d1ea780 1 > prepared multipart upload key=ZGH8XC39FGTC upload=TVKL3BZMK9W8 tag=FU0IA04ABCM0 type=write size=3705073 2024-09-12T17:18:20.100 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.100+0000 7f574d1ea780 1 < completed delete operation key=ZGH8XC39FGTC tag=Q1VI2DTEBI36 type=del 2024-09-12T17:18:20.102 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.101+0000 7f574d1ea780 1 > prepared operation key=SQQMJ61CA0QW tag=FFIGS4BUGHDE type=del size=622148 2024-09-12T17:18:20.105 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.104+0000 7f574d1ea780 1 < suggested update operation key=RWVWJHVZE95H tag=RMKFX46O1A3K type=del size=2868519 2024-09-12T17:18:20.106 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.105+0000 7f574d1ea780 1 > prepared operation key=K12MVG618809 tag=SD6I2WYW3SOV type=del size=3092797 2024-09-12T17:18:20.107 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.106+0000 7f574d1ea780 1 < completed delete operation key=UTCKL1F42X8A tag=1W0D22DPP0UP type=del 2024-09-12T17:18:20.109 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.108+0000 7f574d1ea780 1 > prepared operation key=A1TIP3RXHBCZ tag=XKH829XQTSQK type=del size=2315900 2024-09-12T17:18:20.110 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.109+0000 7f574d1ea780 1 < completed delete operation key=ENFNIFHQ3SHW tag=3REMFJPOCQIM type=del 2024-09-12T17:18:20.112 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.111+0000 7f574d1ea780 1 > prepared part key=_multipart_55JI541K1WP2.2~P17MVDPRWHE6.0 size=1048576 2024-09-12T17:18:20.113 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.112+0000 7f574d1ea780 1 > prepared part key=_multipart_55JI541K1WP2.2~P17MVDPRWHE6.1 size=315041 2024-09-12T17:18:20.113 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.112+0000 7f574d1ea780 1 > prepared multipart upload key=55JI541K1WP2 upload=P17MVDPRWHE6 tag=KVFH0HYUBAZN type=write size=2412193 2024-09-12T17:18:20.114 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.114+0000 7f574d1ea780 1 < canceled operation key=UFKM4I8RMT0W tag=JYN6MMJFAO38 type=del size=2888477 2024-09-12T17:18:20.116 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.115+0000 7f574d1ea780 1 > prepared operation key=HFWA7DNUMWF2 tag=3M28XPVL9U3J type=del size=3068603 2024-09-12T17:18:20.118 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.117+0000 7f574d1ea780 1 < suggested update operation key=UFKM4I8RMT0W tag=64B33I9CSO5I type=del size=1701274 2024-09-12T17:18:20.119 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.118+0000 7f574d1ea780 1 > prepared operation key=DH02JGZP64MN tag=S5OD8MGCLV0E type=del size=849174 2024-09-12T17:18:20.119 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.119+0000 7f574d1ea780 1 < canceled part key=_multipart_D1GEG3MKPOM3.2~1EW9V0Z71F88.0 size=826410 2024-09-12T17:18:20.122 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.121+0000 7f574d1ea780 1 < canceled multipart upload key=D1GEG3MKPOM3 upload=1EW9V0Z71F88 tag=7QW1WGPY80RD type=write size=1874986 2024-09-12T17:18:20.124 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.123+0000 7f574d1ea780 1 > prepared part key=_multipart_RNI86YYLADT0.2~1LKHIDCH0CK6.0 size=1048576 2024-09-12T17:18:20.125 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.124+0000 7f574d1ea780 1 > prepared part key=_multipart_RNI86YYLADT0.2~1LKHIDCH0CK6.1 size=1048576 2024-09-12T17:18:20.126 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.125+0000 7f574d1ea780 1 > prepared part key=_multipart_RNI86YYLADT0.2~1LKHIDCH0CK6.2 size=395459 2024-09-12T17:18:20.126 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.125+0000 7f574d1ea780 1 > prepared multipart upload key=RNI86YYLADT0 upload=1LKHIDCH0CK6 tag=H2M66BD0O6LV type=write size=3541187 2024-09-12T17:18:20.128 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.127+0000 7f574d1ea780 1 < completed part key=_multipart_OI51GO639LFK.2~X3AHUXMRJOJK.0 size=1048576 2024-09-12T17:18:20.129 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.128+0000 7f574d1ea780 1 < completed part key=_multipart_OI51GO639LFK.2~X3AHUXMRJOJK.1 size=269208 2024-09-12T17:18:20.131 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.130+0000 7f574d1ea780 1 < completed multipart upload key=OI51GO639LFK upload=X3AHUXMRJOJK tag=SU4WRSTI2PPV type=write size=2366360 2024-09-12T17:18:20.132 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.132+0000 7f574d1ea780 1 > prepared operation key=C9IYR9CET1I8 tag=HK7WNM8RXBG6 type=del size=2941061 2024-09-12T17:18:20.134 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.133+0000 7f574d1ea780 1 < completed part key=_multipart_U6E9A5OH4GUW.2~A1ZU2WSEY5C0.0 size=1048576 2024-09-12T17:18:20.135 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.134+0000 7f574d1ea780 1 < completed part key=_multipart_U6E9A5OH4GUW.2~A1ZU2WSEY5C0.1 size=1048576 2024-09-12T17:18:20.136 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.135+0000 7f574d1ea780 1 < completed part key=_multipart_U6E9A5OH4GUW.2~A1ZU2WSEY5C0.2 size=640887 2024-09-12T17:18:20.138 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.138+0000 7f574d1ea780 1 < completed multipart upload key=U6E9A5OH4GUW upload=A1ZU2WSEY5C0 tag=71YC8H83I5RZ type=write size=3786615 2024-09-12T17:18:20.140 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.139+0000 7f574d1ea780 1 > prepared operation key=VWWA5IB0L4N1 tag=LMM212TGWO6X type=del size=210256 2024-09-12T17:18:20.141 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.141+0000 7f574d1ea780 1 < completed part key=_multipart_HGZMN894YYC0.2~694U56OVWLD3.0 size=1048576 2024-09-12T17:18:20.142 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.142+0000 7f574d1ea780 1 < completed part key=_multipart_HGZMN894YYC0.2~694U56OVWLD3.1 size=867502 2024-09-12T17:18:20.145 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.144+0000 7f574d1ea780 1 < completed multipart upload key=HGZMN894YYC0 upload=694U56OVWLD3 tag=DR7JDVBBLUS9 type=write size=2964654 2024-09-12T17:18:20.147 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.146+0000 7f574d1ea780 1 > prepared part key=_multipart_HGZMN894YYC0.2~B6904PLM5022.0 size=1048576 2024-09-12T17:18:20.148 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.147+0000 7f574d1ea780 1 > prepared part key=_multipart_HGZMN894YYC0.2~B6904PLM5022.1 size=1048576 2024-09-12T17:18:20.149 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.149+0000 7f574d1ea780 1 > prepared part key=_multipart_HGZMN894YYC0.2~B6904PLM5022.2 size=153536 2024-09-12T17:18:20.149 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.149+0000 7f574d1ea780 1 > prepared multipart upload key=HGZMN894YYC0 upload=B6904PLM5022 tag=FRSKKQ8ZHC99 type=write size=3299264 2024-09-12T17:18:20.151 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.150+0000 7f574d1ea780 -1 < failed to complete operation key=RWVWJHVZE95H tag=12B4J50S79XA type=del size=2367904: (22) Invalid argument 2024-09-12T17:18:20.152 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.151+0000 7f574d1ea780 1 > prepared operation key=UFKM4I8RMT0W tag=6MM7DRVK5M76 type=del size=3457954 2024-09-12T17:18:20.154 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.153+0000 7f574d1ea780 1 < completed delete operation key=ZGH8XC39FGTC tag=IPYO3DI7P642 type=del 2024-09-12T17:18:20.156 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.155+0000 7f574d1ea780 1 > prepared part key=_multipart_8VW3XCUHLF2L.2~7GP48KAFR3YP.0 size=1048576 2024-09-12T17:18:20.157 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.156+0000 7f574d1ea780 1 > prepared part key=_multipart_8VW3XCUHLF2L.2~7GP48KAFR3YP.1 size=435592 2024-09-12T17:18:20.157 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.156+0000 7f574d1ea780 1 > prepared multipart upload key=8VW3XCUHLF2L upload=7GP48KAFR3YP tag=LTPDRT7D1W94 type=write size=2532744 2024-09-12T17:18:20.159 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.158+0000 7f574d1ea780 1 < completed part key=_multipart_VWWA5IB0L4N1.2~UZEE6131EPDL.0 size=850721 2024-09-12T17:18:20.161 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.160+0000 7f574d1ea780 1 < completed multipart upload key=VWWA5IB0L4N1 upload=UZEE6131EPDL tag=JLW6YS3PDLVM type=write size=1899297 2024-09-12T17:18:20.162 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.161+0000 7f574d1ea780 1 > prepared operation key=ZGH8XC39FGTC tag=G2I3EVTYO5RV type=write size=52410 2024-09-12T17:18:20.163 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.163+0000 7f574d1ea780 1 < completed part key=_multipart_TIKBUXFPVTN1.2~HLT4ZD76218L.0 size=1048576 2024-09-12T17:18:20.164 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.164+0000 7f574d1ea780 1 < completed part key=_multipart_TIKBUXFPVTN1.2~HLT4ZD76218L.1 size=940401 2024-09-12T17:18:20.166 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.166+0000 7f574d1ea780 1 < completed multipart upload key=TIKBUXFPVTN1 upload=HLT4ZD76218L tag=8HQZ7YTU0O3U type=write size=3037553 2024-09-12T17:18:20.168 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.167+0000 7f574d1ea780 1 > prepared operation key=ZGE1860DMGHA tag=JCNGAE34ODT6 type=del size=2149208 2024-09-12T17:18:20.173 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.172+0000 7f574d1ea780 1 < suggested remove operation key=ENFNIFHQ3SHW tag=950JKWOJT792 type=write 2024-09-12T17:18:20.175 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.174+0000 7f574d1ea780 1 > prepared part key=_multipart_7BX38Q7723EB.2~MWMCQC2NR31C.0 size=1048576 2024-09-12T17:18:20.176 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.175+0000 7f574d1ea780 1 > prepared part key=_multipart_7BX38Q7723EB.2~MWMCQC2NR31C.1 size=47050 2024-09-12T17:18:20.176 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.175+0000 7f574d1ea780 1 > prepared multipart upload key=7BX38Q7723EB upload=MWMCQC2NR31C tag=JU05QYSTL8X5 type=write size=2144202 2024-09-12T17:18:20.177 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.176+0000 7f574d1ea780 1 < completed part key=_multipart_ZGH8XC39FGTC.2~TVKL3BZMK9W8.0 size=1048576 2024-09-12T17:18:20.178 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.177+0000 7f574d1ea780 1 < completed part key=_multipart_ZGH8XC39FGTC.2~TVKL3BZMK9W8.1 size=1048576 2024-09-12T17:18:20.179 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.178+0000 7f574d1ea780 1 < completed part key=_multipart_ZGH8XC39FGTC.2~TVKL3BZMK9W8.2 size=559345 2024-09-12T17:18:20.181 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.180+0000 7f574d1ea780 1 < completed multipart upload key=ZGH8XC39FGTC upload=TVKL3BZMK9W8 tag=FU0IA04ABCM0 type=write size=3705073 2024-09-12T17:18:20.184 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.183+0000 7f574d1ea780 1 > prepared part key=_multipart_UFKM4I8RMT0W.2~NL4WQF46KP0P.0 size=239969 2024-09-12T17:18:20.184 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.183+0000 7f574d1ea780 1 > prepared multipart upload key=UFKM4I8RMT0W upload=NL4WQF46KP0P tag=O3XYRR775MU0 type=write size=1288545 2024-09-12T17:18:20.186 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.185+0000 7f574d1ea780 1 < suggested remove operation key=SQQMJ61CA0QW tag=FFIGS4BUGHDE type=del 2024-09-12T17:18:20.188 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.187+0000 7f574d1ea780 1 > prepared part key=_multipart_55V137SY4E4P.2~KXA20PQ28A0P.0 size=1048576 2024-09-12T17:18:20.189 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.188+0000 7f574d1ea780 1 > prepared part key=_multipart_55V137SY4E4P.2~KXA20PQ28A0P.1 size=550214 2024-09-12T17:18:20.189 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.188+0000 7f574d1ea780 1 > prepared multipart upload key=55V137SY4E4P upload=KXA20PQ28A0P tag=90YQXHUNSXF9 type=write size=2647366 2024-09-12T17:18:20.190 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.190+0000 7f574d1ea780 1 < completed delete operation key=K12MVG618809 tag=SD6I2WYW3SOV type=del 2024-09-12T17:18:20.193 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.192+0000 7f574d1ea780 1 > prepared part key=_multipart_UTCKL1F42X8A.2~SQ0Z8D066A8U.0 size=1048576 2024-09-12T17:18:20.194 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.193+0000 7f574d1ea780 1 > prepared part key=_multipart_UTCKL1F42X8A.2~SQ0Z8D066A8U.1 size=166137 2024-09-12T17:18:20.194 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.193+0000 7f574d1ea780 1 > prepared multipart upload key=UTCKL1F42X8A upload=SQ0Z8D066A8U tag=FYIBNM788280 type=write size=2263289 2024-09-12T17:18:20.195 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.194+0000 7f574d1ea780 1 < completed delete operation key=A1TIP3RXHBCZ tag=XKH829XQTSQK type=del 2024-09-12T17:18:20.197 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.196+0000 7f574d1ea780 1 > prepared part key=_multipart_54CM8800AT9V.2~UOE1OB5PC036.0 size=1048576 2024-09-12T17:18:20.198 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.197+0000 7f574d1ea780 1 > prepared part key=_multipart_54CM8800AT9V.2~UOE1OB5PC036.1 size=200240 2024-09-12T17:18:20.198 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.197+0000 7f574d1ea780 1 > prepared multipart upload key=54CM8800AT9V upload=UOE1OB5PC036 tag=N85MIP9OSHKO type=write size=2297392 2024-09-12T17:18:20.200 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.199+0000 7f574d1ea780 1 < completed part key=_multipart_55JI541K1WP2.2~P17MVDPRWHE6.0 size=1048576 2024-09-12T17:18:20.200 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.200+0000 7f574d1ea780 1 < completed part key=_multipart_55JI541K1WP2.2~P17MVDPRWHE6.1 size=315041 2024-09-12T17:18:20.203 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.202+0000 7f574d1ea780 1 < completed multipart upload key=55JI541K1WP2 upload=P17MVDPRWHE6 tag=KVFH0HYUBAZN type=write size=2412193 2024-09-12T17:18:20.204 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.203+0000 7f574d1ea780 1 > prepared operation key=55JI541K1WP2 tag=0FKQ5XV6KWO0 type=del size=3050732 2024-09-12T17:18:20.205 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.204+0000 7f574d1ea780 1 < completed delete operation key=HFWA7DNUMWF2 tag=3M28XPVL9U3J type=del 2024-09-12T17:18:20.206 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.206+0000 7f574d1ea780 1 > prepared operation key=YXIDO0U18839 tag=J4XO38D7Z17Z type=write size=891257 2024-09-12T17:18:20.208 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.207+0000 7f574d1ea780 1 < completed delete operation key=DH02JGZP64MN tag=S5OD8MGCLV0E type=del 2024-09-12T17:18:20.209 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.208+0000 7f574d1ea780 1 > prepared operation key=54LQ91UMBJAN tag=5RFQ7I1VOQDY type=del size=2289081 2024-09-12T17:18:20.210 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.209+0000 7f574d1ea780 1 < completed part key=_multipart_RNI86YYLADT0.2~1LKHIDCH0CK6.0 size=1048576 2024-09-12T17:18:20.211 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.210+0000 7f574d1ea780 1 < completed part key=_multipart_RNI86YYLADT0.2~1LKHIDCH0CK6.1 size=1048576 2024-09-12T17:18:20.212 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.211+0000 7f574d1ea780 1 < completed part key=_multipart_RNI86YYLADT0.2~1LKHIDCH0CK6.2 size=395459 2024-09-12T17:18:20.214 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.213+0000 7f574d1ea780 1 < completed multipart upload key=RNI86YYLADT0 upload=1LKHIDCH0CK6 tag=H2M66BD0O6LV type=write size=3541187 2024-09-12T17:18:20.216 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.215+0000 7f574d1ea780 1 > prepared operation key=D1GEG3MKPOM3 tag=TZOOZD70G7MI type=del size=2762509 2024-09-12T17:18:20.217 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.216+0000 7f574d1ea780 1 < canceled operation key=C9IYR9CET1I8 tag=HK7WNM8RXBG6 type=del size=2941061 2024-09-12T17:18:20.218 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.217+0000 7f574d1ea780 1 > prepared operation key=UFKM4I8RMT0W tag=XUYC7OJA6R9R type=write size=356249 2024-09-12T17:18:20.219 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.219+0000 7f574d1ea780 1 < completed delete operation key=VWWA5IB0L4N1 tag=LMM212TGWO6X type=del 2024-09-12T17:18:20.221 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.221+0000 7f574d1ea780 1 > prepared part key=_multipart_8VW3XCUHLF2L.2~36WGSYQHS8GY.0 size=73755 2024-09-12T17:18:20.222 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.221+0000 7f574d1ea780 1 > prepared multipart upload key=8VW3XCUHLF2L upload=36WGSYQHS8GY tag=WWPEMEG2OREG type=write size=1122331 2024-09-12T17:18:20.223 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.222+0000 7f574d1ea780 1 < completed part key=_multipart_HGZMN894YYC0.2~B6904PLM5022.0 size=1048576 2024-09-12T17:18:20.224 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.223+0000 7f574d1ea780 1 < completed part key=_multipart_HGZMN894YYC0.2~B6904PLM5022.1 size=1048576 2024-09-12T17:18:20.225 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.224+0000 7f574d1ea780 1 < completed part key=_multipart_HGZMN894YYC0.2~B6904PLM5022.2 size=153536 2024-09-12T17:18:20.227 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.226+0000 7f574d1ea780 1 < completed multipart upload key=HGZMN894YYC0 upload=B6904PLM5022 tag=FRSKKQ8ZHC99 type=write size=3299264 2024-09-12T17:18:20.228 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.227+0000 7f574d1ea780 1 > prepared operation key=SQQMJ61CA0QW tag=ATDRELTUUS96 type=del size=1159916 2024-09-12T17:18:20.229 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.228+0000 7f574d1ea780 1 < completed delete operation key=UFKM4I8RMT0W tag=6MM7DRVK5M76 type=del 2024-09-12T17:18:20.231 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.230+0000 7f574d1ea780 1 > prepared part key=_multipart_TIKBUXFPVTN1.2~7EIVKJ9N2J0Q.0 size=285439 2024-09-12T17:18:20.231 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.230+0000 7f574d1ea780 1 > prepared multipart upload key=TIKBUXFPVTN1 upload=7EIVKJ9N2J0Q tag=H8SPVO08ZOOY type=write size=1334015 2024-09-12T17:18:20.232 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.231+0000 7f574d1ea780 1 < canceled part key=_multipart_8VW3XCUHLF2L.2~7GP48KAFR3YP.0 size=1048576 2024-09-12T17:18:20.232 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.231+0000 7f574d1ea780 1 < completed part key=_multipart_8VW3XCUHLF2L.2~7GP48KAFR3YP.1 size=435592 2024-09-12T17:18:20.234 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.234+0000 7f574d1ea780 1 < canceled multipart upload key=8VW3XCUHLF2L upload=7GP48KAFR3YP tag=LTPDRT7D1W94 type=write size=2532744 2024-09-12T17:18:20.237 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.236+0000 7f574d1ea780 1 > prepared part key=_multipart_HGZMN894YYC0.2~RL7YPK1BSEE0.0 size=732066 2024-09-12T17:18:20.237 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.236+0000 7f574d1ea780 1 > prepared multipart upload key=HGZMN894YYC0 upload=RL7YPK1BSEE0 tag=IJ1VL2MSVCQV type=write size=1780642 2024-09-12T17:18:20.239 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.238+0000 7f574d1ea780 1 < suggested remove operation key=ZGH8XC39FGTC tag=G2I3EVTYO5RV type=write 2024-09-12T17:18:20.241 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.240+0000 7f574d1ea780 1 > prepared part key=_multipart_8VW3XCUHLF2L.2~NTFJMR9JZIPP.0 size=673622 2024-09-12T17:18:20.241 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.240+0000 7f574d1ea780 1 > prepared multipart upload key=8VW3XCUHLF2L upload=NTFJMR9JZIPP tag=O1THGW8M485V type=write size=1722198 2024-09-12T17:18:20.243 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.242+0000 7f574d1ea780 1 < completed delete operation key=ZGE1860DMGHA tag=JCNGAE34ODT6 type=del 2024-09-12T17:18:20.244 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.243+0000 7f574d1ea780 1 > prepared operation key=ENFNIFHQ3SHW tag=N39SA5Q2SE7T type=del size=2128534 2024-09-12T17:18:20.245 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.244+0000 7f574d1ea780 1 < completed part key=_multipart_7BX38Q7723EB.2~MWMCQC2NR31C.0 size=1048576 2024-09-12T17:18:20.246 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.245+0000 7f574d1ea780 1 < completed part key=_multipart_7BX38Q7723EB.2~MWMCQC2NR31C.1 size=47050 2024-09-12T17:18:20.248 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.247+0000 7f574d1ea780 1 < completed multipart upload key=7BX38Q7723EB upload=MWMCQC2NR31C tag=JU05QYSTL8X5 type=write size=2144202 2024-09-12T17:18:20.249 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.248+0000 7f574d1ea780 1 > prepared operation key=C9IYR9CET1I8 tag=6KB5CLOUSLEV type=write size=901625 2024-09-12T17:18:20.250 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.249+0000 7f574d1ea780 1 < completed part key=_multipart_UFKM4I8RMT0W.2~NL4WQF46KP0P.0 size=239969 2024-09-12T17:18:20.252 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.251+0000 7f574d1ea780 1 < completed multipart upload key=UFKM4I8RMT0W upload=NL4WQF46KP0P tag=O3XYRR775MU0 type=write size=1288545 2024-09-12T17:18:20.253 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.252+0000 7f574d1ea780 1 > prepared operation key=DH02JGZP64MN tag=NEDVTROS3ZPX type=del size=1686632 2024-09-12T17:18:20.254 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.254+0000 7f574d1ea780 1 < completed part key=_multipart_55V137SY4E4P.2~KXA20PQ28A0P.0 size=1048576 2024-09-12T17:18:20.255 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.254+0000 7f574d1ea780 1 < completed part key=_multipart_55V137SY4E4P.2~KXA20PQ28A0P.1 size=550214 2024-09-12T17:18:20.258 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.256+0000 7f574d1ea780 1 < completed multipart upload key=55V137SY4E4P upload=KXA20PQ28A0P tag=90YQXHUNSXF9 type=write size=2647366 2024-09-12T17:18:20.258 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.258+0000 7f574d1ea780 1 > prepared operation key=ENFNIFHQ3SHW tag=40ZP5V2R4E52 type=del size=3663146 2024-09-12T17:18:20.260 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.259+0000 7f574d1ea780 1 < completed part key=_multipart_UTCKL1F42X8A.2~SQ0Z8D066A8U.0 size=1048576 2024-09-12T17:18:20.261 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.260+0000 7f574d1ea780 1 < completed part key=_multipart_UTCKL1F42X8A.2~SQ0Z8D066A8U.1 size=166137 2024-09-12T17:18:20.263 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.262+0000 7f574d1ea780 1 < completed multipart upload key=UTCKL1F42X8A upload=SQ0Z8D066A8U tag=FYIBNM788280 type=write size=2263289 2024-09-12T17:18:20.266 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.265+0000 7f574d1ea780 1 > prepared part key=_multipart_OI51GO639LFK.2~IY50866KXAWM.0 size=1048576 2024-09-12T17:18:20.267 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.266+0000 7f574d1ea780 1 > prepared part key=_multipart_OI51GO639LFK.2~IY50866KXAWM.1 size=1048576 2024-09-12T17:18:20.268 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.267+0000 7f574d1ea780 1 > prepared part key=_multipart_OI51GO639LFK.2~IY50866KXAWM.2 size=908586 2024-09-12T17:18:20.268 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.267+0000 7f574d1ea780 1 > prepared multipart upload key=OI51GO639LFK upload=IY50866KXAWM tag=AGDP7VX45FUP type=write size=4054314 2024-09-12T17:18:20.269 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.269+0000 7f574d1ea780 1 < completed part key=_multipart_54CM8800AT9V.2~UOE1OB5PC036.0 size=1048576 2024-09-12T17:18:20.271 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.270+0000 7f574d1ea780 1 < completed part key=_multipart_54CM8800AT9V.2~UOE1OB5PC036.1 size=200240 2024-09-12T17:18:20.273 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.272+0000 7f574d1ea780 1 < completed multipart upload key=54CM8800AT9V upload=UOE1OB5PC036 tag=N85MIP9OSHKO type=write size=2297392 2024-09-12T17:18:20.274 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.273+0000 7f574d1ea780 1 > prepared operation key=QXD8UG2K4STQ tag=3PNSD8UEF9HI type=write size=88539 2024-09-12T17:18:20.275 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.274+0000 7f574d1ea780 1 < canceled operation key=55JI541K1WP2 tag=0FKQ5XV6KWO0 type=del size=3050732 2024-09-12T17:18:20.278 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.277+0000 7f574d1ea780 1 > prepared part key=_multipart_Q2Q3B1J3DAVD.2~I5CCTCAO4SJ2.0 size=1048576 2024-09-12T17:18:20.279 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.278+0000 7f574d1ea780 1 > prepared part key=_multipart_Q2Q3B1J3DAVD.2~I5CCTCAO4SJ2.1 size=1048576 2024-09-12T17:18:20.280 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.279+0000 7f574d1ea780 1 > prepared part key=_multipart_Q2Q3B1J3DAVD.2~I5CCTCAO4SJ2.2 size=337219 2024-09-12T17:18:20.280 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.279+0000 7f574d1ea780 1 > prepared multipart upload key=Q2Q3B1J3DAVD upload=I5CCTCAO4SJ2 tag=NW70LW0E2E3J type=write size=3482947 2024-09-12T17:18:20.282 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.281+0000 7f574d1ea780 1 < suggested remove operation key=YXIDO0U18839 tag=J4XO38D7Z17Z type=write 2024-09-12T17:18:20.283 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.282+0000 7f574d1ea780 1 > prepared operation key=TIKBUXFPVTN1 tag=T739112BBIGU type=del size=3106737 2024-09-12T17:18:20.285 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.284+0000 7f574d1ea780 1 < completed delete operation key=54LQ91UMBJAN tag=5RFQ7I1VOQDY type=del 2024-09-12T17:18:20.290 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.289+0000 7f574d1ea780 1 > prepared part key=_multipart_D1GEG3MKPOM3.2~7W22PPETQVV4.0 size=1048576 2024-09-12T17:18:20.293 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.292+0000 7f574d1ea780 1 > prepared part key=_multipart_D1GEG3MKPOM3.2~7W22PPETQVV4.1 size=326386 2024-09-12T17:18:20.293 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.292+0000 7f574d1ea780 1 > prepared multipart upload key=D1GEG3MKPOM3 upload=7W22PPETQVV4 tag=ZF0IWZTJPKLM type=write size=2423538 2024-09-12T17:18:20.294 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.293+0000 7f574d1ea780 1 < completed delete operation key=D1GEG3MKPOM3 tag=TZOOZD70G7MI type=del 2024-09-12T17:18:20.295 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.295+0000 7f574d1ea780 1 > prepared operation key=54LQ91UMBJAN tag=XTS5SPPDVCVS type=del size=2705511 2024-09-12T17:18:20.297 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.296+0000 7f574d1ea780 1 < canceled operation key=UFKM4I8RMT0W tag=XUYC7OJA6R9R type=write size=356249 2024-09-12T17:18:20.298 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.297+0000 7f574d1ea780 1 > prepared operation key=8VW3XCUHLF2L tag=J8YAY8RZ2VNT type=del size=3242409 2024-09-12T17:18:20.299 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.298+0000 7f574d1ea780 1 < completed part key=_multipart_8VW3XCUHLF2L.2~36WGSYQHS8GY.0 size=73755 2024-09-12T17:18:20.301 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.300+0000 7f574d1ea780 1 < completed multipart upload key=8VW3XCUHLF2L upload=36WGSYQHS8GY tag=WWPEMEG2OREG type=write size=1122331 2024-09-12T17:18:20.302 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.301+0000 7f574d1ea780 1 > prepared operation key=HGZMN894YYC0 tag=81IXZMXCPEFI type=del size=2561103 2024-09-12T17:18:20.303 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.303+0000 7f574d1ea780 1 < completed delete operation key=SQQMJ61CA0QW tag=ATDRELTUUS96 type=del 2024-09-12T17:18:20.305 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.304+0000 7f574d1ea780 1 > prepared operation key=DH02JGZP64MN tag=YMAN9Y9ZB4A4 type=del size=824920 2024-09-12T17:18:20.305 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.304+0000 7f574d1ea780 1 < canceled part key=_multipart_TIKBUXFPVTN1.2~7EIVKJ9N2J0Q.0 size=285439 2024-09-12T17:18:20.307 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.306+0000 7f574d1ea780 1 < canceled multipart upload key=TIKBUXFPVTN1 upload=7EIVKJ9N2J0Q tag=H8SPVO08ZOOY type=write size=1334015 2024-09-12T17:18:20.309 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.308+0000 7f574d1ea780 1 > prepared part key=_multipart_8VW3XCUHLF2L.2~SQUKJZMS0NL5.0 size=1048576 2024-09-12T17:18:20.310 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.309+0000 7f574d1ea780 1 > prepared part key=_multipart_8VW3XCUHLF2L.2~SQUKJZMS0NL5.1 size=60721 2024-09-12T17:18:20.310 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.309+0000 7f574d1ea780 1 > prepared multipart upload key=8VW3XCUHLF2L upload=SQUKJZMS0NL5 tag=3GU80OAB5T11 type=write size=2157873 2024-09-12T17:18:20.311 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.311+0000 7f574d1ea780 1 < completed part key=_multipart_HGZMN894YYC0.2~RL7YPK1BSEE0.0 size=732066 2024-09-12T17:18:20.313 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.313+0000 7f574d1ea780 1 < completed multipart upload key=HGZMN894YYC0 upload=RL7YPK1BSEE0 tag=IJ1VL2MSVCQV type=write size=1780642 2024-09-12T17:18:20.316 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.315+0000 7f574d1ea780 1 > prepared part key=_multipart_GEGOEB05R0PK.2~5KHR0PAAIJRU.0 size=1048576 2024-09-12T17:18:20.317 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.316+0000 7f574d1ea780 1 > prepared part key=_multipart_GEGOEB05R0PK.2~5KHR0PAAIJRU.1 size=116737 2024-09-12T17:18:20.317 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.316+0000 7f574d1ea780 1 > prepared multipart upload key=GEGOEB05R0PK upload=5KHR0PAAIJRU tag=JVMOSB4CBX55 type=write size=2213889 2024-09-12T17:18:20.318 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.317+0000 7f574d1ea780 1 < completed part key=_multipart_8VW3XCUHLF2L.2~NTFJMR9JZIPP.0 size=673622 2024-09-12T17:18:20.320 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.320+0000 7f574d1ea780 1 < completed multipart upload key=8VW3XCUHLF2L upload=NTFJMR9JZIPP tag=O1THGW8M485V type=write size=1722198 2024-09-12T17:18:20.322 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.321+0000 7f574d1ea780 1 > prepared operation key=43GV2N9VBBKE tag=IIWIJPN6U8QT type=write size=135456 2024-09-12T17:18:20.323 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.323+0000 7f574d1ea780 1 < completed delete operation key=ENFNIFHQ3SHW tag=N39SA5Q2SE7T type=del 2024-09-12T17:18:20.325 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.324+0000 7f574d1ea780 1 > prepared operation key=QXD8UG2K4STQ tag=0TAHYU21EVFC type=del size=2793306 2024-09-12T17:18:20.328 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.327+0000 7f574d1ea780 1 < suggested update operation key=C9IYR9CET1I8 tag=6KB5CLOUSLEV type=write size=901625 2024-09-12T17:18:20.329 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.328+0000 7f574d1ea780 1 > prepared operation key=VWWA5IB0L4N1 tag=S86GBRCUFBRK type=del size=3448700 2024-09-12T17:18:20.331 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.330+0000 7f574d1ea780 1 < suggested remove operation key=DH02JGZP64MN tag=NEDVTROS3ZPX type=del 2024-09-12T17:18:20.333 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.333+0000 7f574d1ea780 1 > prepared part key=_multipart_QXD8UG2K4STQ.2~7JCB2L4CSOM9.0 size=95906 2024-09-12T17:18:20.334 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.333+0000 7f574d1ea780 1 > prepared multipart upload key=QXD8UG2K4STQ upload=7JCB2L4CSOM9 tag=3PJ2ZAYQ8AF9 type=write size=1144482 2024-09-12T17:18:20.335 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.334+0000 7f574d1ea780 1 < canceled operation key=ENFNIFHQ3SHW tag=40ZP5V2R4E52 type=del size=3663146 2024-09-12T17:18:20.337 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.336+0000 7f574d1ea780 1 > prepared part key=_multipart_RNI86YYLADT0.2~L78VKU17K5RK.0 size=1048576 2024-09-12T17:18:20.338 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.337+0000 7f574d1ea780 1 > prepared part key=_multipart_RNI86YYLADT0.2~L78VKU17K5RK.1 size=1048576 2024-09-12T17:18:20.339 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.338+0000 7f574d1ea780 1 > prepared part key=_multipart_RNI86YYLADT0.2~L78VKU17K5RK.2 size=9085 2024-09-12T17:18:20.339 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.338+0000 7f574d1ea780 1 > prepared multipart upload key=RNI86YYLADT0 upload=L78VKU17K5RK tag=PFNAXG7B4LY6 type=write size=3154813 2024-09-12T17:18:20.340 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.339+0000 7f574d1ea780 1 < completed part key=_multipart_OI51GO639LFK.2~IY50866KXAWM.0 size=1048576 2024-09-12T17:18:20.340 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.339+0000 7f574d1ea780 1 < canceled part key=_multipart_OI51GO639LFK.2~IY50866KXAWM.1 size=1048576 2024-09-12T17:18:20.340 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.339+0000 7f574d1ea780 1 < canceled part key=_multipart_OI51GO639LFK.2~IY50866KXAWM.2 size=908586 2024-09-12T17:18:20.342 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.341+0000 7f574d1ea780 1 < canceled multipart upload key=OI51GO639LFK upload=IY50866KXAWM tag=AGDP7VX45FUP type=write size=4054314 2024-09-12T17:18:20.344 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.343+0000 7f574d1ea780 1 > prepared part key=_multipart_K12MVG618809.2~51ZC7GHLYEAE.0 size=333830 2024-09-12T17:18:20.344 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.343+0000 7f574d1ea780 1 > prepared multipart upload key=K12MVG618809 upload=51ZC7GHLYEAE tag=F6C4NYJTGADH type=write size=1382406 2024-09-12T17:18:20.345 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.345+0000 7f574d1ea780 1 < completed write operation key=QXD8UG2K4STQ tag=3PNSD8UEF9HI type=write size=88539 2024-09-12T17:18:20.347 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.346+0000 7f574d1ea780 1 > prepared operation key=TIKBUXFPVTN1 tag=H4GGT7XNV1PU type=del size=4160876 2024-09-12T17:18:20.348 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.347+0000 7f574d1ea780 1 < completed part key=_multipart_Q2Q3B1J3DAVD.2~I5CCTCAO4SJ2.0 size=1048576 2024-09-12T17:18:20.349 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.348+0000 7f574d1ea780 1 < completed part key=_multipart_Q2Q3B1J3DAVD.2~I5CCTCAO4SJ2.1 size=1048576 2024-09-12T17:18:20.350 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.349+0000 7f574d1ea780 1 < completed part key=_multipart_Q2Q3B1J3DAVD.2~I5CCTCAO4SJ2.2 size=337219 2024-09-12T17:18:20.352 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.351+0000 7f574d1ea780 1 < completed multipart upload key=Q2Q3B1J3DAVD upload=I5CCTCAO4SJ2 tag=NW70LW0E2E3J type=write size=3482947 2024-09-12T17:18:20.353 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.352+0000 7f574d1ea780 1 > prepared operation key=K12MVG618809 tag=HJPJYESCWMWV type=del size=3541554 2024-09-12T17:18:20.355 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.354+0000 7f574d1ea780 1 < completed delete operation key=TIKBUXFPVTN1 tag=T739112BBIGU type=del 2024-09-12T17:18:20.356 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.355+0000 7f574d1ea780 1 > prepared operation key=A1TIP3RXHBCZ tag=Z80HI2PDWA08 type=write size=49384 2024-09-12T17:18:20.357 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.356+0000 7f574d1ea780 1 < completed part key=_multipart_D1GEG3MKPOM3.2~7W22PPETQVV4.0 size=1048576 2024-09-12T17:18:20.358 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.357+0000 7f574d1ea780 1 < completed part key=_multipart_D1GEG3MKPOM3.2~7W22PPETQVV4.1 size=326386 2024-09-12T17:18:20.360 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.359+0000 7f574d1ea780 1 < completed multipart upload key=D1GEG3MKPOM3 upload=7W22PPETQVV4 tag=ZF0IWZTJPKLM type=write size=2423538 2024-09-12T17:18:20.361 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.361+0000 7f574d1ea780 1 > prepared operation key=OI51GO639LFK tag=2LLOW60FK882 type=del size=13154 2024-09-12T17:18:20.363 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.362+0000 7f574d1ea780 1 < completed delete operation key=54LQ91UMBJAN tag=XTS5SPPDVCVS type=del 2024-09-12T17:18:20.364 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.363+0000 7f574d1ea780 1 > prepared operation key=DH02JGZP64MN tag=8I66K4REL0YG type=del size=1502207 2024-09-12T17:18:20.365 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.364+0000 7f574d1ea780 1 < completed delete operation key=8VW3XCUHLF2L tag=J8YAY8RZ2VNT type=del 2024-09-12T17:18:20.366 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.366+0000 7f574d1ea780 1 > prepared operation key=UTCKL1F42X8A tag=OZBUE884ALQU type=del size=3189902 2024-09-12T17:18:20.369 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.368+0000 7f574d1ea780 1 < suggested remove operation key=HGZMN894YYC0 tag=81IXZMXCPEFI type=del 2024-09-12T17:18:20.370 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.369+0000 7f574d1ea780 1 > prepared operation key=TIKBUXFPVTN1 tag=2TNS9ZHGG228 type=del size=3485904 2024-09-12T17:18:20.371 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.370+0000 7f574d1ea780 -1 < failed to complete operation key=DH02JGZP64MN tag=YMAN9Y9ZB4A4 type=del size=824920: (22) Invalid argument 2024-09-12T17:18:20.372 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.372+0000 7f574d1ea780 1 > prepared operation key=UTCKL1F42X8A tag=G8CZHUEF7F5J type=del size=180600 2024-09-12T17:18:20.374 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.373+0000 7f574d1ea780 1 < completed part key=_multipart_8VW3XCUHLF2L.2~SQUKJZMS0NL5.0 size=1048576 2024-09-12T17:18:20.375 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.374+0000 7f574d1ea780 1 < completed part key=_multipart_8VW3XCUHLF2L.2~SQUKJZMS0NL5.1 size=60721 2024-09-12T17:18:20.377 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.376+0000 7f574d1ea780 1 < completed multipart upload key=8VW3XCUHLF2L upload=SQUKJZMS0NL5 tag=3GU80OAB5T11 type=write size=2157873 2024-09-12T17:18:20.379 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.378+0000 7f574d1ea780 1 > prepared part key=_multipart_RNI86YYLADT0.2~HQ2V34HBTGP5.0 size=808312 2024-09-12T17:18:20.379 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.378+0000 7f574d1ea780 1 > prepared multipart upload key=RNI86YYLADT0 upload=HQ2V34HBTGP5 tag=X7VW230DZ4NP type=write size=1856888 2024-09-12T17:18:20.380 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.380+0000 7f574d1ea780 1 < completed part key=_multipart_GEGOEB05R0PK.2~5KHR0PAAIJRU.0 size=1048576 2024-09-12T17:18:20.381 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.381+0000 7f574d1ea780 1 < completed part key=_multipart_GEGOEB05R0PK.2~5KHR0PAAIJRU.1 size=116737 2024-09-12T17:18:20.384 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.383+0000 7f574d1ea780 1 < completed multipart upload key=GEGOEB05R0PK upload=5KHR0PAAIJRU tag=JVMOSB4CBX55 type=write size=2213889 2024-09-12T17:18:20.386 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.385+0000 7f574d1ea780 1 > prepared part key=_multipart_C9IYR9CET1I8.2~20J2FZLWDKBM.0 size=522629 2024-09-12T17:18:20.386 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.385+0000 7f574d1ea780 1 > prepared multipart upload key=C9IYR9CET1I8 upload=20J2FZLWDKBM tag=CJ6II3LQD9VU type=write size=1571205 2024-09-12T17:18:20.387 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.386+0000 7f574d1ea780 1 < completed write operation key=43GV2N9VBBKE tag=IIWIJPN6U8QT type=write size=135456 2024-09-12T17:18:20.389 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.388+0000 7f574d1ea780 1 > prepared part key=_multipart_VWWA5IB0L4N1.2~RHFVRYQ7Y0J0.0 size=1048576 2024-09-12T17:18:20.390 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.389+0000 7f574d1ea780 1 > prepared part key=_multipart_VWWA5IB0L4N1.2~RHFVRYQ7Y0J0.1 size=1048576 2024-09-12T17:18:20.391 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.390+0000 7f574d1ea780 1 > prepared part key=_multipart_VWWA5IB0L4N1.2~RHFVRYQ7Y0J0.2 size=669831 2024-09-12T17:18:20.391 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.390+0000 7f574d1ea780 1 > prepared multipart upload key=VWWA5IB0L4N1 upload=RHFVRYQ7Y0J0 tag=J7JQXLOYMOWZ type=write size=3815559 2024-09-12T17:18:20.392 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.391+0000 7f574d1ea780 1 < completed delete operation key=QXD8UG2K4STQ tag=0TAHYU21EVFC type=del 2024-09-12T17:18:20.394 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.393+0000 7f574d1ea780 1 > prepared operation key=K12MVG618809 tag=R1KQLBG8870Q type=del size=3557559 2024-09-12T17:18:20.395 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.394+0000 7f574d1ea780 1 < completed delete operation key=VWWA5IB0L4N1 tag=S86GBRCUFBRK type=del 2024-09-12T17:18:20.397 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.396+0000 7f574d1ea780 1 > prepared part key=_multipart_TIKBUXFPVTN1.2~070C1Y66VS2K.0 size=640002 2024-09-12T17:18:20.397 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.396+0000 7f574d1ea780 1 > prepared multipart upload key=TIKBUXFPVTN1 upload=070C1Y66VS2K tag=53IRNNW8OWWP type=write size=1688578 2024-09-12T17:18:20.398 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.396+0000 7f574d1ea780 1 < canceled part key=_multipart_QXD8UG2K4STQ.2~7JCB2L4CSOM9.0 size=95906 2024-09-12T17:18:20.399 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.398+0000 7f574d1ea780 1 < canceled multipart upload key=QXD8UG2K4STQ upload=7JCB2L4CSOM9 tag=3PJ2ZAYQ8AF9 type=write size=1144482 2024-09-12T17:18:20.402 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.401+0000 7f574d1ea780 1 > prepared part key=_multipart_8VW3XCUHLF2L.2~KF9E27NMLJI7.0 size=123912 2024-09-12T17:18:20.402 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.401+0000 7f574d1ea780 1 > prepared multipart upload key=8VW3XCUHLF2L upload=KF9E27NMLJI7 tag=QED3O3ALEOXM type=write size=1172488 2024-09-12T17:18:20.402 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.401+0000 7f574d1ea780 1 < canceled part key=_multipart_RNI86YYLADT0.2~L78VKU17K5RK.0 size=1048576 2024-09-12T17:18:20.402 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.401+0000 7f574d1ea780 1 < canceled part key=_multipart_RNI86YYLADT0.2~L78VKU17K5RK.1 size=1048576 2024-09-12T17:18:20.403 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.402+0000 7f574d1ea780 1 < completed part key=_multipart_RNI86YYLADT0.2~L78VKU17K5RK.2 size=9085 2024-09-12T17:18:20.405 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.404+0000 7f574d1ea780 1 < canceled multipart upload key=RNI86YYLADT0 upload=L78VKU17K5RK tag=PFNAXG7B4LY6 type=write size=3154813 2024-09-12T17:18:20.408 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.407+0000 7f574d1ea780 1 > prepared part key=_multipart_K12MVG618809.2~72310GZC2G6M.0 size=1048576 2024-09-12T17:18:20.409 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.408+0000 7f574d1ea780 1 > prepared part key=_multipart_K12MVG618809.2~72310GZC2G6M.1 size=769743 2024-09-12T17:18:20.409 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.408+0000 7f574d1ea780 1 > prepared multipart upload key=K12MVG618809 upload=72310GZC2G6M tag=RW38BGUVVPZA type=write size=2866895 2024-09-12T17:18:20.410 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.409+0000 7f574d1ea780 1 < completed part key=_multipart_K12MVG618809.2~51ZC7GHLYEAE.0 size=333830 2024-09-12T17:18:20.412 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.411+0000 7f574d1ea780 1 < completed multipart upload key=K12MVG618809 upload=51ZC7GHLYEAE tag=F6C4NYJTGADH type=write size=1382406 2024-09-12T17:18:20.413 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.413+0000 7f574d1ea780 1 > prepared operation key=C9IYR9CET1I8 tag=V1YGA7QXZPXB type=del size=3308945 2024-09-12T17:18:20.415 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.414+0000 7f574d1ea780 1 < completed delete operation key=TIKBUXFPVTN1 tag=H4GGT7XNV1PU type=del 2024-09-12T17:18:20.416 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.415+0000 7f574d1ea780 1 > prepared operation key=D1GEG3MKPOM3 tag=2UUID5NQWGUW type=write size=17015 2024-09-12T17:18:20.417 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.416+0000 7f574d1ea780 1 < canceled operation key=K12MVG618809 tag=HJPJYESCWMWV type=del size=3541554 2024-09-12T17:18:20.419 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.419+0000 7f574d1ea780 1 > prepared part key=_multipart_43GV2N9VBBKE.2~0I31I5SWJTMB.0 size=404584 2024-09-12T17:18:20.419 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.419+0000 7f574d1ea780 1 > prepared multipart upload key=43GV2N9VBBKE upload=0I31I5SWJTMB tag=3QLFMXCXLHBJ type=write size=1453160 2024-09-12T17:18:20.421 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.420+0000 7f574d1ea780 1 < completed write operation key=A1TIP3RXHBCZ tag=Z80HI2PDWA08 type=write size=49384 2024-09-12T17:18:20.422 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.421+0000 7f574d1ea780 1 > prepared operation key=VWWA5IB0L4N1 tag=1XC8TPBWKKST type=del size=2749472 2024-09-12T17:18:20.423 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.423+0000 7f574d1ea780 1 < completed delete operation key=OI51GO639LFK tag=2LLOW60FK882 type=del 2024-09-12T17:18:20.425 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.424+0000 7f574d1ea780 1 > prepared operation key=QXD8UG2K4STQ tag=KV6WQXVQFT7Q type=del size=4188505 2024-09-12T17:18:20.426 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.425+0000 7f574d1ea780 1 < completed delete operation key=DH02JGZP64MN tag=8I66K4REL0YG type=del 2024-09-12T17:18:20.428 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.428+0000 7f574d1ea780 1 > prepared part key=_multipart_RNI86YYLADT0.2~Z5WPE4XQR2XV.0 size=1048576 2024-09-12T17:18:20.429 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.429+0000 7f574d1ea780 1 > prepared part key=_multipart_RNI86YYLADT0.2~Z5WPE4XQR2XV.1 size=1043454 2024-09-12T17:18:20.429 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.429+0000 7f574d1ea780 1 > prepared multipart upload key=RNI86YYLADT0 upload=Z5WPE4XQR2XV tag=RLJK6OWEU4CD type=write size=3140606 2024-09-12T17:18:20.432 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.431+0000 7f574d1ea780 1 < suggested update operation key=UTCKL1F42X8A tag=OZBUE884ALQU type=del size=3189902 2024-09-12T17:18:20.434 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.433+0000 7f574d1ea780 1 > prepared part key=_multipart_UTCKL1F42X8A.2~16PAOJ4MDNQJ.0 size=76708 2024-09-12T17:18:20.434 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.433+0000 7f574d1ea780 1 > prepared multipart upload key=UTCKL1F42X8A upload=16PAOJ4MDNQJ tag=CM82GWCHPZ27 type=write size=1125284 2024-09-12T17:18:20.436 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.435+0000 7f574d1ea780 1 < completed delete operation key=TIKBUXFPVTN1 tag=2TNS9ZHGG228 type=del 2024-09-12T17:18:20.437 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.436+0000 7f574d1ea780 1 > prepared operation key=HFWA7DNUMWF2 tag=Q506K53NG9IE type=del size=762126 2024-09-12T17:18:20.438 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.437+0000 7f574d1ea780 -1 < failed to complete operation key=UTCKL1F42X8A tag=G8CZHUEF7F5J type=del size=180600: (22) Invalid argument 2024-09-12T17:18:20.440 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.440+0000 7f574d1ea780 1 > prepared part key=_multipart_55JI541K1WP2.2~MBI23RC15YQZ.0 size=972591 2024-09-12T17:18:20.441 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.440+0000 7f574d1ea780 1 > prepared multipart upload key=55JI541K1WP2 upload=MBI23RC15YQZ tag=ZY54H8PY1H99 type=write size=2021167 2024-09-12T17:18:20.442 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.441+0000 7f574d1ea780 1 < completed part key=_multipart_RNI86YYLADT0.2~HQ2V34HBTGP5.0 size=808312 2024-09-12T17:18:20.444 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.443+0000 7f574d1ea780 1 < completed multipart upload key=RNI86YYLADT0 upload=HQ2V34HBTGP5 tag=X7VW230DZ4NP type=write size=1856888 2024-09-12T17:18:20.446 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.445+0000 7f574d1ea780 1 > prepared part key=_multipart_U6E9A5OH4GUW.2~FK5Y3NO8G1QJ.0 size=1048576 2024-09-12T17:18:20.447 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.446+0000 7f574d1ea780 1 > prepared part key=_multipart_U6E9A5OH4GUW.2~FK5Y3NO8G1QJ.1 size=268080 2024-09-12T17:18:20.447 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.446+0000 7f574d1ea780 1 > prepared multipart upload key=U6E9A5OH4GUW upload=FK5Y3NO8G1QJ tag=IMAWA0S5I2HP type=write size=2365232 2024-09-12T17:18:20.449 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.448+0000 7f574d1ea780 1 < completed part key=_multipart_C9IYR9CET1I8.2~20J2FZLWDKBM.0 size=522629 2024-09-12T17:18:20.451 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.450+0000 7f574d1ea780 1 < completed multipart upload key=C9IYR9CET1I8 upload=20J2FZLWDKBM tag=CJ6II3LQD9VU type=write size=1571205 2024-09-12T17:18:20.452 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.451+0000 7f574d1ea780 1 > prepared operation key=OI51GO639LFK tag=0W9P3H2ZZ3NJ type=del size=3240361 2024-09-12T17:18:20.452 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.451+0000 7f574d1ea780 1 < canceled part key=_multipart_VWWA5IB0L4N1.2~RHFVRYQ7Y0J0.0 size=1048576 2024-09-12T17:18:20.453 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.452+0000 7f574d1ea780 1 < completed part key=_multipart_VWWA5IB0L4N1.2~RHFVRYQ7Y0J0.1 size=1048576 2024-09-12T17:18:20.454 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.453+0000 7f574d1ea780 1 < completed part key=_multipart_VWWA5IB0L4N1.2~RHFVRYQ7Y0J0.2 size=669831 2024-09-12T17:18:20.456 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.455+0000 7f574d1ea780 1 < canceled multipart upload key=VWWA5IB0L4N1 upload=RHFVRYQ7Y0J0 tag=J7JQXLOYMOWZ type=write size=3815559 2024-09-12T17:18:20.459 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.458+0000 7f574d1ea780 1 > prepared part key=_multipart_R00F69ON5P6Z.2~BGC14LF62DHH.0 size=1048576 2024-09-12T17:18:20.460 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.459+0000 7f574d1ea780 1 > prepared part key=_multipart_R00F69ON5P6Z.2~BGC14LF62DHH.1 size=1029664 2024-09-12T17:18:20.460 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.459+0000 7f574d1ea780 1 > prepared multipart upload key=R00F69ON5P6Z upload=BGC14LF62DHH tag=JG68ANRNYSWP type=write size=3126816 2024-09-12T17:18:20.461 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.460+0000 7f574d1ea780 1 < completed delete operation key=K12MVG618809 tag=R1KQLBG8870Q type=del 2024-09-12T17:18:20.462 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.461+0000 7f574d1ea780 1 > prepared operation key=QXD8UG2K4STQ tag=TCFNH0NK81Z6 type=del size=3128145 2024-09-12T17:18:20.463 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.463+0000 7f574d1ea780 1 < completed part key=_multipart_TIKBUXFPVTN1.2~070C1Y66VS2K.0 size=640002 2024-09-12T17:18:20.465 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.465+0000 7f574d1ea780 1 < completed multipart upload key=TIKBUXFPVTN1 upload=070C1Y66VS2K tag=53IRNNW8OWWP type=write size=1688578 2024-09-12T17:18:20.467 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.466+0000 7f574d1ea780 1 > prepared operation key=U6E9A5OH4GUW tag=WHZCKKQE1RFZ type=del size=3870889 2024-09-12T17:18:20.468 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.467+0000 7f574d1ea780 1 < completed part key=_multipart_8VW3XCUHLF2L.2~KF9E27NMLJI7.0 size=123912 2024-09-12T17:18:20.470 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.469+0000 7f574d1ea780 1 < completed multipart upload key=8VW3XCUHLF2L upload=KF9E27NMLJI7 tag=QED3O3ALEOXM type=write size=1172488 2024-09-12T17:18:20.473 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.472+0000 7f574d1ea780 1 > prepared part key=_multipart_UFKM4I8RMT0W.2~0HDISO2BB8UE.0 size=1048576 2024-09-12T17:18:20.474 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.473+0000 7f574d1ea780 1 > prepared part key=_multipart_UFKM4I8RMT0W.2~0HDISO2BB8UE.1 size=1048576 2024-09-12T17:18:20.475 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.474+0000 7f574d1ea780 1 > prepared part key=_multipart_UFKM4I8RMT0W.2~0HDISO2BB8UE.2 size=386618 2024-09-12T17:18:20.475 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.474+0000 7f574d1ea780 1 > prepared multipart upload key=UFKM4I8RMT0W upload=0HDISO2BB8UE tag=O730Y510SK8C type=write size=3532346 2024-09-12T17:18:20.476 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.475+0000 7f574d1ea780 1 < completed part key=_multipart_K12MVG618809.2~72310GZC2G6M.0 size=1048576 2024-09-12T17:18:20.477 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.476+0000 7f574d1ea780 1 < completed part key=_multipart_K12MVG618809.2~72310GZC2G6M.1 size=769743 2024-09-12T17:18:20.479 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.478+0000 7f574d1ea780 1 < completed multipart upload key=K12MVG618809 upload=72310GZC2G6M tag=RW38BGUVVPZA type=write size=2866895 2024-09-12T17:18:20.480 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.479+0000 7f574d1ea780 1 > prepared operation key=YXIDO0U18839 tag=YAA9734GQIXD type=del size=3818483 2024-09-12T17:18:20.483 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.482+0000 7f574d1ea780 1 < suggested update operation key=C9IYR9CET1I8 tag=V1YGA7QXZPXB type=del size=3308945 2024-09-12T17:18:20.485 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.484+0000 7f574d1ea780 1 > prepared part key=_multipart_HFWA7DNUMWF2.2~IDIBLTKS8YCV.0 size=695473 2024-09-12T17:18:20.485 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.484+0000 7f574d1ea780 1 > prepared multipart upload key=HFWA7DNUMWF2 upload=IDIBLTKS8YCV tag=CDZGJF2EWELU type=write size=1744049 2024-09-12T17:18:20.486 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.485+0000 7f574d1ea780 1 < completed write operation key=D1GEG3MKPOM3 tag=2UUID5NQWGUW type=write size=17015 2024-09-12T17:18:20.489 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.488+0000 7f574d1ea780 1 > prepared part key=_multipart_54CM8800AT9V.2~TH249C5CNNHU.0 size=560490 2024-09-12T17:18:20.489 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.488+0000 7f574d1ea780 1 > prepared multipart upload key=54CM8800AT9V upload=TH249C5CNNHU tag=C0FY7O9VPY6B type=write size=1609066 2024-09-12T17:18:20.489 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.488+0000 7f574d1ea780 1 < canceled part key=_multipart_43GV2N9VBBKE.2~0I31I5SWJTMB.0 size=404584 2024-09-12T17:18:20.491 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.490+0000 7f574d1ea780 1 < canceled multipart upload key=43GV2N9VBBKE upload=0I31I5SWJTMB tag=3QLFMXCXLHBJ type=write size=1453160 2024-09-12T17:18:20.493 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.493+0000 7f574d1ea780 1 > prepared part key=_multipart_ZGH8XC39FGTC.2~Z0DF8PET4UPH.0 size=1048576 2024-09-12T17:18:20.494 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.494+0000 7f574d1ea780 1 > prepared part key=_multipart_ZGH8XC39FGTC.2~Z0DF8PET4UPH.1 size=856056 2024-09-12T17:18:20.495 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.494+0000 7f574d1ea780 1 > prepared multipart upload key=ZGH8XC39FGTC upload=Z0DF8PET4UPH tag=KJW6LEPFCB40 type=write size=2953208 2024-09-12T17:18:20.496 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.495+0000 7f574d1ea780 1 < completed delete operation key=VWWA5IB0L4N1 tag=1XC8TPBWKKST type=del 2024-09-12T17:18:20.497 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.497+0000 7f574d1ea780 1 > prepared operation key=K12MVG618809 tag=9R4U7TB5AUCB type=del size=512571 2024-09-12T17:18:20.499 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.498+0000 7f574d1ea780 1 < completed delete operation key=QXD8UG2K4STQ tag=KV6WQXVQFT7Q type=del 2024-09-12T17:18:20.500 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.500+0000 7f574d1ea780 1 > prepared operation key=OI51GO639LFK tag=371KTIFC0MLY type=del size=2470607 2024-09-12T17:18:20.502 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.501+0000 7f574d1ea780 1 < completed part key=_multipart_RNI86YYLADT0.2~Z5WPE4XQR2XV.0 size=1048576 2024-09-12T17:18:20.503 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.502+0000 7f574d1ea780 1 < completed part key=_multipart_RNI86YYLADT0.2~Z5WPE4XQR2XV.1 size=1043454 2024-09-12T17:18:20.505 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.504+0000 7f574d1ea780 1 < completed multipart upload key=RNI86YYLADT0 upload=Z5WPE4XQR2XV tag=RLJK6OWEU4CD type=write size=3140606 2024-09-12T17:18:20.506 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.505+0000 7f574d1ea780 1 > prepared operation key=RNI86YYLADT0 tag=E6UYFUOQKC5N type=del size=784257 2024-09-12T17:18:20.508 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.507+0000 7f574d1ea780 1 < completed part key=_multipart_UTCKL1F42X8A.2~16PAOJ4MDNQJ.0 size=76708 2024-09-12T17:18:20.510 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.509+0000 7f574d1ea780 1 < completed multipart upload key=UTCKL1F42X8A upload=16PAOJ4MDNQJ tag=CM82GWCHPZ27 type=write size=1125284 2024-09-12T17:18:20.512 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.511+0000 7f574d1ea780 1 > prepared operation key=8VW3XCUHLF2L tag=HB4GV1VWN1K5 type=del size=1021343 2024-09-12T17:18:20.513 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.512+0000 7f574d1ea780 1 < completed delete operation key=HFWA7DNUMWF2 tag=Q506K53NG9IE type=del 2024-09-12T17:18:20.516 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.515+0000 7f574d1ea780 1 > prepared part key=_multipart_HGZMN894YYC0.2~H6M20QDOAEWM.0 size=1048576 2024-09-12T17:18:20.517 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.516+0000 7f574d1ea780 1 > prepared part key=_multipart_HGZMN894YYC0.2~H6M20QDOAEWM.1 size=306555 2024-09-12T17:18:20.517 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.516+0000 7f574d1ea780 1 > prepared multipart upload key=HGZMN894YYC0 upload=H6M20QDOAEWM tag=48R032O4LA9I type=write size=2403707 2024-09-12T17:18:20.517 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.516+0000 7f574d1ea780 1 < canceled part key=_multipart_55JI541K1WP2.2~MBI23RC15YQZ.0 size=972591 2024-09-12T17:18:20.519 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.518+0000 7f574d1ea780 1 < canceled multipart upload key=55JI541K1WP2 upload=MBI23RC15YQZ tag=ZY54H8PY1H99 type=write size=2021167 2024-09-12T17:18:20.521 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.520+0000 7f574d1ea780 1 > prepared operation key=RNI86YYLADT0 tag=R7KW2JAPLZRW type=del size=2646928 2024-09-12T17:18:20.522 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.521+0000 7f574d1ea780 1 < completed part key=_multipart_U6E9A5OH4GUW.2~FK5Y3NO8G1QJ.0 size=1048576 2024-09-12T17:18:20.522 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.521+0000 7f574d1ea780 1 < canceled part key=_multipart_U6E9A5OH4GUW.2~FK5Y3NO8G1QJ.1 size=268080 2024-09-12T17:18:20.526 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.525+0000 7f574d1ea780 1 < canceled multipart upload key=U6E9A5OH4GUW upload=FK5Y3NO8G1QJ tag=IMAWA0S5I2HP type=write size=2365232 2024-09-12T17:18:20.530 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.529+0000 7f574d1ea780 1 > prepared part key=_multipart_R00F69ON5P6Z.2~PEL54L8LKK77.0 size=642629 2024-09-12T17:18:20.530 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.529+0000 7f574d1ea780 1 > prepared multipart upload key=R00F69ON5P6Z upload=PEL54L8LKK77 tag=UOFOETYHFHFC type=write size=1691205 2024-09-12T17:18:20.531 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.530+0000 7f574d1ea780 1 < completed delete operation key=OI51GO639LFK tag=0W9P3H2ZZ3NJ type=del 2024-09-12T17:18:20.532 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.531+0000 7f574d1ea780 1 > prepared operation key=A1TIP3RXHBCZ tag=ELHTTNJHB5UJ type=del size=1854907 2024-09-12T17:18:20.533 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.533+0000 7f574d1ea780 1 < completed part key=_multipart_R00F69ON5P6Z.2~BGC14LF62DHH.0 size=1048576 2024-09-12T17:18:20.534 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.534+0000 7f574d1ea780 1 < completed part key=_multipart_R00F69ON5P6Z.2~BGC14LF62DHH.1 size=1029664 2024-09-12T17:18:20.536 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.536+0000 7f574d1ea780 1 < completed multipart upload key=R00F69ON5P6Z upload=BGC14LF62DHH tag=JG68ANRNYSWP type=write size=3126816 2024-09-12T17:18:20.538 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.537+0000 7f574d1ea780 1 > prepared operation key=SQQMJ61CA0QW tag=7798L2HACHI0 type=del size=2860899 2024-09-12T17:18:20.539 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.538+0000 7f574d1ea780 1 < completed delete operation key=QXD8UG2K4STQ tag=TCFNH0NK81Z6 type=del 2024-09-12T17:18:20.541 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.540+0000 7f574d1ea780 1 > prepared part key=_multipart_TIKBUXFPVTN1.2~ANYP6461YRYO.0 size=1048576 2024-09-12T17:18:20.542 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.541+0000 7f574d1ea780 1 > prepared part key=_multipart_TIKBUXFPVTN1.2~ANYP6461YRYO.1 size=311208 2024-09-12T17:18:20.542 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.541+0000 7f574d1ea780 1 > prepared multipart upload key=TIKBUXFPVTN1 upload=ANYP6461YRYO tag=M0E5G7J99KY3 type=write size=2408360 2024-09-12T17:18:20.543 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.542+0000 7f574d1ea780 1 < completed delete operation key=U6E9A5OH4GUW tag=WHZCKKQE1RFZ type=del 2024-09-12T17:18:20.544 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.543+0000 7f574d1ea780 1 > prepared operation key=55V137SY4E4P tag=HI0BAXYYS10C type=del size=203900 2024-09-12T17:18:20.545 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.545+0000 7f574d1ea780 1 < completed part key=_multipart_UFKM4I8RMT0W.2~0HDISO2BB8UE.0 size=1048576 2024-09-12T17:18:20.546 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.546+0000 7f574d1ea780 1 < completed part key=_multipart_UFKM4I8RMT0W.2~0HDISO2BB8UE.1 size=1048576 2024-09-12T17:18:20.548 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.547+0000 7f574d1ea780 1 < completed part key=_multipart_UFKM4I8RMT0W.2~0HDISO2BB8UE.2 size=386618 2024-09-12T17:18:20.553 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.552+0000 7f574d1ea780 1 < completed multipart upload key=UFKM4I8RMT0W upload=0HDISO2BB8UE tag=O730Y510SK8C type=write size=3532346 2024-09-12T17:18:20.555 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.555+0000 7f574d1ea780 1 > prepared part key=_multipart_UFKM4I8RMT0W.2~NSP1O4NFXRC0.0 size=1048576 2024-09-12T17:18:20.556 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.556+0000 7f574d1ea780 1 > prepared part key=_multipart_UFKM4I8RMT0W.2~NSP1O4NFXRC0.1 size=1048576 2024-09-12T17:18:20.557 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.557+0000 7f574d1ea780 1 > prepared part key=_multipart_UFKM4I8RMT0W.2~NSP1O4NFXRC0.2 size=597166 2024-09-12T17:18:20.557 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.557+0000 7f574d1ea780 1 > prepared multipart upload key=UFKM4I8RMT0W upload=NSP1O4NFXRC0 tag=XY3CN5G6562U type=write size=3742894 2024-09-12T17:18:20.559 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.558+0000 7f574d1ea780 1 < completed delete operation key=YXIDO0U18839 tag=YAA9734GQIXD type=del 2024-09-12T17:18:20.560 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.559+0000 7f574d1ea780 1 > prepared operation key=UFKM4I8RMT0W tag=61R77VU0XK8Y type=del size=1634415 2024-09-12T17:18:20.561 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.560+0000 7f574d1ea780 1 < completed part key=_multipart_HFWA7DNUMWF2.2~IDIBLTKS8YCV.0 size=695473 2024-09-12T17:18:20.563 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.562+0000 7f574d1ea780 1 < completed multipart upload key=HFWA7DNUMWF2 upload=IDIBLTKS8YCV tag=CDZGJF2EWELU type=write size=1744049 2024-09-12T17:18:20.565 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.564+0000 7f574d1ea780 1 > prepared operation key=U6E9A5OH4GUW tag=TF0RN9RRFMCW type=del size=2765730 2024-09-12T17:18:20.566 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.565+0000 7f574d1ea780 1 < completed part key=_multipart_54CM8800AT9V.2~TH249C5CNNHU.0 size=560490 2024-09-12T17:18:20.568 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.567+0000 7f574d1ea780 1 < completed multipart upload key=54CM8800AT9V upload=TH249C5CNNHU tag=C0FY7O9VPY6B type=write size=1609066 2024-09-12T17:18:20.569 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.568+0000 7f574d1ea780 1 > prepared operation key=7BX38Q7723EB tag=ZMJCRN9IRCF8 type=write size=215403 2024-09-12T17:18:20.571 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.570+0000 7f574d1ea780 1 < completed part key=_multipart_ZGH8XC39FGTC.2~Z0DF8PET4UPH.0 size=1048576 2024-09-12T17:18:20.572 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.571+0000 7f574d1ea780 1 < completed part key=_multipart_ZGH8XC39FGTC.2~Z0DF8PET4UPH.1 size=856056 2024-09-12T17:18:20.574 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.573+0000 7f574d1ea780 1 < completed multipart upload key=ZGH8XC39FGTC upload=Z0DF8PET4UPH tag=KJW6LEPFCB40 type=write size=2953208 2024-09-12T17:18:20.575 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.574+0000 7f574d1ea780 1 > prepared operation key=RNI86YYLADT0 tag=WL7VUWNH0EOC type=del size=1552888 2024-09-12T17:18:20.576 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.575+0000 7f574d1ea780 1 < completed delete operation key=K12MVG618809 tag=9R4U7TB5AUCB type=del 2024-09-12T17:18:20.577 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.576+0000 7f574d1ea780 1 > prepared operation key=HGZMN894YYC0 tag=SOV8O1JZO05R type=del size=1282775 2024-09-12T17:18:20.580 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.579+0000 7f574d1ea780 1 < suggested update operation key=OI51GO639LFK tag=371KTIFC0MLY type=del size=2470607 2024-09-12T17:18:20.582 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.581+0000 7f574d1ea780 1 > prepared part key=_multipart_ENFNIFHQ3SHW.2~6Y0HL3E1VG6O.0 size=1048576 2024-09-12T17:18:20.583 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.582+0000 7f574d1ea780 1 > prepared part key=_multipart_ENFNIFHQ3SHW.2~6Y0HL3E1VG6O.1 size=600065 2024-09-12T17:18:20.583 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.582+0000 7f574d1ea780 1 > prepared multipart upload key=ENFNIFHQ3SHW upload=6Y0HL3E1VG6O tag=5T2A7U5YFSER type=write size=2697217 2024-09-12T17:18:20.584 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.584+0000 7f574d1ea780 1 < completed delete operation key=RNI86YYLADT0 tag=E6UYFUOQKC5N type=del 2024-09-12T17:18:20.586 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.585+0000 7f574d1ea780 1 > prepared operation key=55JI541K1WP2 tag=5SE8ZVW87547 type=write size=627718 2024-09-12T17:18:20.587 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.587+0000 7f574d1ea780 1 < completed delete operation key=8VW3XCUHLF2L tag=HB4GV1VWN1K5 type=del 2024-09-12T17:18:20.589 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.588+0000 7f574d1ea780 1 > prepared operation key=GEGOEB05R0PK tag=Q1DVWFQ03ANR type=write size=181588 2024-09-12T17:18:20.590 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.590+0000 7f574d1ea780 1 < completed part key=_multipart_HGZMN894YYC0.2~H6M20QDOAEWM.0 size=1048576 2024-09-12T17:18:20.591 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.591+0000 7f574d1ea780 1 < completed part key=_multipart_HGZMN894YYC0.2~H6M20QDOAEWM.1 size=306555 2024-09-12T17:18:20.594 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.593+0000 7f574d1ea780 1 < completed multipart upload key=HGZMN894YYC0 upload=H6M20QDOAEWM tag=48R032O4LA9I type=write size=2403707 2024-09-12T17:18:20.595 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.595+0000 7f574d1ea780 1 > prepared operation key=DH02JGZP64MN tag=4XWE48S6DZNO type=del size=3120781 2024-09-12T17:18:20.597 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.596+0000 7f574d1ea780 1 < completed delete operation key=RNI86YYLADT0 tag=R7KW2JAPLZRW type=del 2024-09-12T17:18:20.598 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.597+0000 7f574d1ea780 1 > prepared operation key=54LQ91UMBJAN tag=SK66GYI3MBND type=del size=3035445 2024-09-12T17:18:20.599 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.598+0000 7f574d1ea780 1 < completed part key=_multipart_R00F69ON5P6Z.2~PEL54L8LKK77.0 size=642629 2024-09-12T17:18:20.601 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.601+0000 7f574d1ea780 1 < completed multipart upload key=R00F69ON5P6Z upload=PEL54L8LKK77 tag=UOFOETYHFHFC type=write size=1691205 2024-09-12T17:18:20.603 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.602+0000 7f574d1ea780 1 > prepared operation key=DH02JGZP64MN tag=WY1SWWDLIM31 type=del size=2306175 2024-09-12T17:18:20.604 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.604+0000 7f574d1ea780 1 < canceled operation key=A1TIP3RXHBCZ tag=ELHTTNJHB5UJ type=del size=1854907 2024-09-12T17:18:20.607 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.606+0000 7f574d1ea780 1 > prepared part key=_multipart_GEGOEB05R0PK.2~UGKTYJETVRX2.0 size=1048576 2024-09-12T17:18:20.608 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.607+0000 7f574d1ea780 1 > prepared part key=_multipart_GEGOEB05R0PK.2~UGKTYJETVRX2.1 size=1048576 2024-09-12T17:18:20.609 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.608+0000 7f574d1ea780 1 > prepared part key=_multipart_GEGOEB05R0PK.2~UGKTYJETVRX2.2 size=288097 2024-09-12T17:18:20.609 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.608+0000 7f574d1ea780 1 > prepared multipart upload key=GEGOEB05R0PK upload=UGKTYJETVRX2 tag=Q57IRHZXJIJX type=write size=3433825 2024-09-12T17:18:20.610 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.609+0000 7f574d1ea780 1 < completed delete operation key=SQQMJ61CA0QW tag=7798L2HACHI0 type=del 2024-09-12T17:18:20.611 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.610+0000 7f574d1ea780 1 > prepared operation key=ZGE1860DMGHA tag=QOD78OB8DEM7 type=del size=9250 2024-09-12T17:18:20.612 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.612+0000 7f574d1ea780 1 < completed part key=_multipart_TIKBUXFPVTN1.2~ANYP6461YRYO.0 size=1048576 2024-09-12T17:18:20.614 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.613+0000 7f574d1ea780 1 < completed part key=_multipart_TIKBUXFPVTN1.2~ANYP6461YRYO.1 size=311208 2024-09-12T17:18:20.616 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.615+0000 7f574d1ea780 1 < completed multipart upload key=TIKBUXFPVTN1 upload=ANYP6461YRYO tag=M0E5G7J99KY3 type=write size=2408360 2024-09-12T17:18:20.617 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.616+0000 7f574d1ea780 1 > prepared operation key=A1TIP3RXHBCZ tag=E49GLM801M8K type=del size=2649461 2024-09-12T17:18:20.618 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.617+0000 7f574d1ea780 1 < completed delete operation key=55V137SY4E4P tag=HI0BAXYYS10C type=del 2024-09-12T17:18:20.619 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.618+0000 7f574d1ea780 1 > prepared operation key=55V137SY4E4P tag=3PBDO40OBCBU type=del size=321672 2024-09-12T17:18:20.620 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.620+0000 7f574d1ea780 1 < completed part key=_multipart_UFKM4I8RMT0W.2~NSP1O4NFXRC0.0 size=1048576 2024-09-12T17:18:20.621 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.621+0000 7f574d1ea780 1 < completed part key=_multipart_UFKM4I8RMT0W.2~NSP1O4NFXRC0.1 size=1048576 2024-09-12T17:18:20.622 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.621+0000 7f574d1ea780 1 < canceled part key=_multipart_UFKM4I8RMT0W.2~NSP1O4NFXRC0.2 size=597166 2024-09-12T17:18:20.623 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.623+0000 7f574d1ea780 1 < canceled multipart upload key=UFKM4I8RMT0W upload=NSP1O4NFXRC0 tag=XY3CN5G6562U type=write size=3742894 2024-09-12T17:18:20.626 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.625+0000 7f574d1ea780 1 > prepared part key=_multipart_RNI86YYLADT0.2~9XOF65FI6XWR.0 size=987947 2024-09-12T17:18:20.626 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.625+0000 7f574d1ea780 1 > prepared multipart upload key=RNI86YYLADT0 upload=9XOF65FI6XWR tag=QOF8NBDABWXQ type=write size=2036523 2024-09-12T17:18:20.627 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.626+0000 7f574d1ea780 1 < completed delete operation key=UFKM4I8RMT0W tag=61R77VU0XK8Y type=del 2024-09-12T17:18:20.629 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.628+0000 7f574d1ea780 1 > prepared part key=_multipart_VWWA5IB0L4N1.2~P0V51NK2DLGS.0 size=801928 2024-09-12T17:18:20.629 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.628+0000 7f574d1ea780 1 > prepared multipart upload key=VWWA5IB0L4N1 upload=P0V51NK2DLGS tag=O03TMHS4QB3Q type=write size=1850504 2024-09-12T17:18:20.630 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.630+0000 7f574d1ea780 1 < completed delete operation key=U6E9A5OH4GUW tag=TF0RN9RRFMCW type=del 2024-09-12T17:18:20.632 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.631+0000 7f574d1ea780 1 > prepared operation key=8VW3XCUHLF2L tag=CB0M59F23ZRQ type=write size=86689 2024-09-12T17:18:20.633 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.632+0000 7f574d1ea780 1 < completed write operation key=7BX38Q7723EB tag=ZMJCRN9IRCF8 type=write size=215403 2024-09-12T17:18:20.634 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.634+0000 7f574d1ea780 1 > prepared operation key=A1TIP3RXHBCZ tag=8RTMECNCEGXT type=del size=390405 2024-09-12T17:18:20.636 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.635+0000 7f574d1ea780 1 < completed delete operation key=RNI86YYLADT0 tag=WL7VUWNH0EOC type=del 2024-09-12T17:18:20.638 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.637+0000 7f574d1ea780 1 > prepared part key=_multipart_ZGH8XC39FGTC.2~XSZWG0TA82YO.0 size=1048576 2024-09-12T17:18:20.639 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.638+0000 7f574d1ea780 1 > prepared part key=_multipart_ZGH8XC39FGTC.2~XSZWG0TA82YO.1 size=1048576 2024-09-12T17:18:20.640 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.639+0000 7f574d1ea780 1 > prepared part key=_multipart_ZGH8XC39FGTC.2~XSZWG0TA82YO.2 size=391616 2024-09-12T17:18:20.640 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.639+0000 7f574d1ea780 1 > prepared multipart upload key=ZGH8XC39FGTC upload=XSZWG0TA82YO tag=EIGQFYSVNQNF type=write size=3537344 2024-09-12T17:18:20.641 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.640+0000 7f574d1ea780 1 < completed delete operation key=HGZMN894YYC0 tag=SOV8O1JZO05R type=del 2024-09-12T17:18:20.643 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.642+0000 7f574d1ea780 1 > prepared operation key=R00F69ON5P6Z tag=YY2VKFM7ARMP type=del size=1666056 2024-09-12T17:18:20.643 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.642+0000 7f574d1ea780 1 < canceled part key=_multipart_ENFNIFHQ3SHW.2~6Y0HL3E1VG6O.0 size=1048576 2024-09-12T17:18:20.644 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.643+0000 7f574d1ea780 1 < completed part key=_multipart_ENFNIFHQ3SHW.2~6Y0HL3E1VG6O.1 size=600065 2024-09-12T17:18:20.646 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.645+0000 7f574d1ea780 1 < canceled multipart upload key=ENFNIFHQ3SHW upload=6Y0HL3E1VG6O tag=5T2A7U5YFSER type=write size=2697217 2024-09-12T17:18:20.648 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.647+0000 7f574d1ea780 1 > prepared part key=_multipart_Q2Q3B1J3DAVD.2~H800Y8WMM1ZP.0 size=1048576 2024-09-12T17:18:20.649 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.648+0000 7f574d1ea780 1 > prepared part key=_multipart_Q2Q3B1J3DAVD.2~H800Y8WMM1ZP.1 size=1048576 2024-09-12T17:18:20.651 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.650+0000 7f574d1ea780 1 > prepared part key=_multipart_Q2Q3B1J3DAVD.2~H800Y8WMM1ZP.2 size=436029 2024-09-12T17:18:20.651 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.650+0000 7f574d1ea780 1 > prepared multipart upload key=Q2Q3B1J3DAVD upload=H800Y8WMM1ZP tag=PLHB7UBUI849 type=write size=3581757 2024-09-12T17:18:20.652 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.651+0000 7f574d1ea780 1 < completed write operation key=55JI541K1WP2 tag=5SE8ZVW87547 type=write size=627718 2024-09-12T17:18:20.653 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.652+0000 7f574d1ea780 1 > prepared operation key=ENFNIFHQ3SHW tag=4OJSJL9EVQSR type=del size=1255330 2024-09-12T17:18:20.654 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.654+0000 7f574d1ea780 1 < completed write operation key=GEGOEB05R0PK tag=Q1DVWFQ03ANR type=write size=181588 2024-09-12T17:18:20.657 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.656+0000 7f574d1ea780 1 > prepared part key=_multipart_RWVWJHVZE95H.2~L01P78VIY8YS.0 size=538239 2024-09-12T17:18:20.657 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.656+0000 7f574d1ea780 1 > prepared multipart upload key=RWVWJHVZE95H upload=L01P78VIY8YS tag=52XJJK99SW8J type=write size=1586815 2024-09-12T17:18:20.659 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.658+0000 7f574d1ea780 1 < suggested update operation key=DH02JGZP64MN tag=4XWE48S6DZNO type=del size=3120781 2024-09-12T17:18:20.660 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.659+0000 7f574d1ea780 1 > prepared operation key=RWVWJHVZE95H tag=OCQ490DJZFEV type=write size=326830 2024-09-12T17:18:20.661 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.660+0000 7f574d1ea780 1 < canceled operation key=54LQ91UMBJAN tag=SK66GYI3MBND type=del size=3035445 2024-09-12T17:18:20.663 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.662+0000 7f574d1ea780 1 > prepared part key=_multipart_ZGH8XC39FGTC.2~RZLA8RUXBGLC.0 size=1048576 2024-09-12T17:18:20.664 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.663+0000 7f574d1ea780 1 > prepared part key=_multipart_ZGH8XC39FGTC.2~RZLA8RUXBGLC.1 size=1048576 2024-09-12T17:18:20.665 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.664+0000 7f574d1ea780 1 > prepared part key=_multipart_ZGH8XC39FGTC.2~RZLA8RUXBGLC.2 size=5124 2024-09-12T17:18:20.665 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.664+0000 7f574d1ea780 1 > prepared multipart upload key=ZGH8XC39FGTC upload=RZLA8RUXBGLC tag=BDSMY7F36V8Y type=write size=3150852 2024-09-12T17:18:20.667 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.666+0000 7f574d1ea780 1 < suggested update operation key=DH02JGZP64MN tag=WY1SWWDLIM31 type=del size=2306175 2024-09-12T17:18:20.669 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.669+0000 7f574d1ea780 1 > prepared part key=_multipart_GEGOEB05R0PK.2~QUH750D1MEUT.0 size=1048576 2024-09-12T17:18:20.670 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.669+0000 7f574d1ea780 1 > prepared part key=_multipart_GEGOEB05R0PK.2~QUH750D1MEUT.1 size=1048576 2024-09-12T17:18:20.671 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.670+0000 7f574d1ea780 1 > prepared part key=_multipart_GEGOEB05R0PK.2~QUH750D1MEUT.2 size=346432 2024-09-12T17:18:20.671 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.670+0000 7f574d1ea780 1 > prepared multipart upload key=GEGOEB05R0PK upload=QUH750D1MEUT tag=95ZHUC8Z5ZIQ type=write size=3492160 2024-09-12T17:18:20.673 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.672+0000 7f574d1ea780 1 < completed part key=_multipart_GEGOEB05R0PK.2~UGKTYJETVRX2.0 size=1048576 2024-09-12T17:18:20.673 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.673+0000 7f574d1ea780 1 < completed part key=_multipart_GEGOEB05R0PK.2~UGKTYJETVRX2.1 size=1048576 2024-09-12T17:18:20.674 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.674+0000 7f574d1ea780 1 < completed part key=_multipart_GEGOEB05R0PK.2~UGKTYJETVRX2.2 size=288097 2024-09-12T17:18:20.676 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.675+0000 7f574d1ea780 1 < completed multipart upload key=GEGOEB05R0PK upload=UGKTYJETVRX2 tag=Q57IRHZXJIJX type=write size=3433825 2024-09-12T17:18:20.678 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.677+0000 7f574d1ea780 1 > prepared operation key=HFWA7DNUMWF2 tag=9O8NHC9Z111I type=write size=230069 2024-09-12T17:18:20.680 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.680+0000 7f574d1ea780 1 < suggested update operation key=ZGE1860DMGHA tag=QOD78OB8DEM7 type=del size=9250 2024-09-12T17:18:20.682 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.681+0000 7f574d1ea780 1 > prepared operation key=U6E9A5OH4GUW tag=CSAMQZ6L1S5X type=del size=1134889 2024-09-12T17:18:20.683 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.683+0000 7f574d1ea780 1 < completed delete operation key=A1TIP3RXHBCZ tag=E49GLM801M8K type=del 2024-09-12T17:18:20.686 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.685+0000 7f574d1ea780 1 > prepared part key=_multipart_R00F69ON5P6Z.2~NT0O4JQZ1IW5.0 size=211081 2024-09-12T17:18:20.686 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.685+0000 7f574d1ea780 1 > prepared multipart upload key=R00F69ON5P6Z upload=NT0O4JQZ1IW5 tag=45LWDPC37CR6 type=write size=1259657 2024-09-12T17:18:20.687 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.686+0000 7f574d1ea780 1 < completed delete operation key=55V137SY4E4P tag=3PBDO40OBCBU type=del 2024-09-12T17:18:20.688 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.687+0000 7f574d1ea780 1 > prepared operation key=ENFNIFHQ3SHW tag=KAKNIHF20USY type=del size=1329690 2024-09-12T17:18:20.690 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.689+0000 7f574d1ea780 1 < completed part key=_multipart_RNI86YYLADT0.2~9XOF65FI6XWR.0 size=987947 2024-09-12T17:18:20.691 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.691+0000 7f574d1ea780 1 < completed multipart upload key=RNI86YYLADT0 upload=9XOF65FI6XWR tag=QOF8NBDABWXQ type=write size=2036523 2024-09-12T17:18:20.693 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.692+0000 7f574d1ea780 1 > prepared operation key=HFWA7DNUMWF2 tag=TTQC4AGGL7BS type=del size=1674298 2024-09-12T17:18:20.694 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.693+0000 7f574d1ea780 1 < completed part key=_multipart_VWWA5IB0L4N1.2~P0V51NK2DLGS.0 size=801928 2024-09-12T17:18:20.696 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.695+0000 7f574d1ea780 1 < completed multipart upload key=VWWA5IB0L4N1 upload=P0V51NK2DLGS tag=O03TMHS4QB3Q type=write size=1850504 2024-09-12T17:18:20.697 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.697+0000 7f574d1ea780 1 > prepared operation key=VWWA5IB0L4N1 tag=Z0L0MN1W7Y27 type=del size=1177355 2024-09-12T17:18:20.699 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.698+0000 7f574d1ea780 1 < completed write operation key=8VW3XCUHLF2L tag=CB0M59F23ZRQ type=write size=86689 2024-09-12T17:18:20.700 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.699+0000 7f574d1ea780 1 > prepared operation key=C9IYR9CET1I8 tag=16J92QM5EP4P type=del size=2110849 2024-09-12T17:18:20.702 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.701+0000 7f574d1ea780 1 < completed delete operation key=A1TIP3RXHBCZ tag=8RTMECNCEGXT type=del 2024-09-12T17:18:20.704 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.703+0000 7f574d1ea780 1 > prepared part key=_multipart_7BX38Q7723EB.2~PIPCF11BOM18.0 size=637907 2024-09-12T17:18:20.704 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.703+0000 7f574d1ea780 1 > prepared multipart upload key=7BX38Q7723EB upload=PIPCF11BOM18 tag=V50UCBSH1N9R type=write size=1686483 2024-09-12T17:18:20.706 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.705+0000 7f574d1ea780 1 < completed part key=_multipart_ZGH8XC39FGTC.2~XSZWG0TA82YO.0 size=1048576 2024-09-12T17:18:20.707 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.706+0000 7f574d1ea780 1 < completed part key=_multipart_ZGH8XC39FGTC.2~XSZWG0TA82YO.1 size=1048576 2024-09-12T17:18:20.707 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.706+0000 7f574d1ea780 1 < canceled part key=_multipart_ZGH8XC39FGTC.2~XSZWG0TA82YO.2 size=391616 2024-09-12T17:18:20.709 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.708+0000 7f574d1ea780 1 < canceled multipart upload key=ZGH8XC39FGTC upload=XSZWG0TA82YO tag=EIGQFYSVNQNF type=write size=3537344 2024-09-12T17:18:20.710 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.709+0000 7f574d1ea780 1 > prepared operation key=HFWA7DNUMWF2 tag=SMHRZRXWLRZP type=del size=2677852 2024-09-12T17:18:20.711 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.711+0000 7f574d1ea780 1 < completed delete operation key=R00F69ON5P6Z tag=YY2VKFM7ARMP type=del 2024-09-12T17:18:20.713 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.712+0000 7f574d1ea780 1 > prepared operation key=OI51GO639LFK tag=1WBBR0TJMZOW type=del size=3389188 2024-09-12T17:18:20.714 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.713+0000 7f574d1ea780 1 < completed part key=_multipart_Q2Q3B1J3DAVD.2~H800Y8WMM1ZP.0 size=1048576 2024-09-12T17:18:20.715 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.714+0000 7f574d1ea780 1 < completed part key=_multipart_Q2Q3B1J3DAVD.2~H800Y8WMM1ZP.1 size=1048576 2024-09-12T17:18:20.716 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.715+0000 7f574d1ea780 1 < completed part key=_multipart_Q2Q3B1J3DAVD.2~H800Y8WMM1ZP.2 size=436029 2024-09-12T17:18:20.719 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.718+0000 7f574d1ea780 1 < completed multipart upload key=Q2Q3B1J3DAVD upload=H800Y8WMM1ZP tag=PLHB7UBUI849 type=write size=3581757 2024-09-12T17:18:20.720 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.719+0000 7f574d1ea780 1 > prepared operation key=UTCKL1F42X8A tag=1UJZKPO03UAF type=del size=1966955 2024-09-12T17:18:20.722 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.721+0000 7f574d1ea780 1 < completed delete operation key=ENFNIFHQ3SHW tag=4OJSJL9EVQSR type=del 2024-09-12T17:18:20.723 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.722+0000 7f574d1ea780 1 > prepared operation key=55V137SY4E4P tag=5RTP6IP1MKVP type=write size=371198 2024-09-12T17:18:20.724 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.723+0000 7f574d1ea780 1 < completed part key=_multipart_RWVWJHVZE95H.2~L01P78VIY8YS.0 size=538239 2024-09-12T17:18:20.726 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.725+0000 7f574d1ea780 1 < completed multipart upload key=RWVWJHVZE95H upload=L01P78VIY8YS tag=52XJJK99SW8J type=write size=1586815 2024-09-12T17:18:20.728 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.727+0000 7f574d1ea780 1 > prepared operation key=ZGE1860DMGHA tag=2U5CDW4GB7DN type=write size=312959 2024-09-12T17:18:20.729 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.728+0000 7f574d1ea780 1 < completed write operation key=RWVWJHVZE95H tag=OCQ490DJZFEV type=write size=326830 2024-09-12T17:18:20.731 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.730+0000 7f574d1ea780 1 > prepared operation key=D1GEG3MKPOM3 tag=4QQP6SA5F9D3 type=del size=3026608 2024-09-12T17:18:20.732 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.731+0000 7f574d1ea780 1 < completed part key=_multipart_ZGH8XC39FGTC.2~RZLA8RUXBGLC.0 size=1048576 2024-09-12T17:18:20.733 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.732+0000 7f574d1ea780 1 < completed part key=_multipart_ZGH8XC39FGTC.2~RZLA8RUXBGLC.1 size=1048576 2024-09-12T17:18:20.734 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.733+0000 7f574d1ea780 1 < completed part key=_multipart_ZGH8XC39FGTC.2~RZLA8RUXBGLC.2 size=5124 2024-09-12T17:18:20.736 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.735+0000 7f574d1ea780 1 < completed multipart upload key=ZGH8XC39FGTC upload=RZLA8RUXBGLC tag=BDSMY7F36V8Y type=write size=3150852 2024-09-12T17:18:20.737 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.736+0000 7f574d1ea780 1 > prepared operation key=HFWA7DNUMWF2 tag=MHTO29KQYI8J type=del size=337551 2024-09-12T17:18:20.738 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.738+0000 7f574d1ea780 1 < completed part key=_multipart_GEGOEB05R0PK.2~QUH750D1MEUT.0 size=1048576 2024-09-12T17:18:20.740 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.739+0000 7f574d1ea780 1 < completed part key=_multipart_GEGOEB05R0PK.2~QUH750D1MEUT.1 size=1048576 2024-09-12T17:18:20.740 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.740+0000 7f574d1ea780 1 < completed part key=_multipart_GEGOEB05R0PK.2~QUH750D1MEUT.2 size=346432 2024-09-12T17:18:20.743 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.742+0000 7f574d1ea780 1 < completed multipart upload key=GEGOEB05R0PK upload=QUH750D1MEUT tag=95ZHUC8Z5ZIQ type=write size=3492160 2024-09-12T17:18:20.744 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.743+0000 7f574d1ea780 1 > prepared operation key=54CM8800AT9V tag=JILS3ZBGS3E7 type=del size=3857965 2024-09-12T17:18:20.745 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.744+0000 7f574d1ea780 1 < canceled operation key=HFWA7DNUMWF2 tag=9O8NHC9Z111I type=write size=230069 2024-09-12T17:18:20.748 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.747+0000 7f574d1ea780 1 > prepared part key=_multipart_ZGH8XC39FGTC.2~DE58WUMEKT7X.0 size=125918 2024-09-12T17:18:20.748 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.747+0000 7f574d1ea780 1 > prepared multipart upload key=ZGH8XC39FGTC upload=DE58WUMEKT7X tag=UNJ25ATLT0HR type=write size=1174494 2024-09-12T17:18:20.750 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.749+0000 7f574d1ea780 1 < suggested update operation key=U6E9A5OH4GUW tag=CSAMQZ6L1S5X type=del size=1134889 2024-09-12T17:18:20.752 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.751+0000 7f574d1ea780 1 > prepared part key=_multipart_R00F69ON5P6Z.2~YWQH0TNUYZVS.0 size=1048576 2024-09-12T17:18:20.753 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.752+0000 7f574d1ea780 1 > prepared part key=_multipart_R00F69ON5P6Z.2~YWQH0TNUYZVS.1 size=373258 2024-09-12T17:18:20.753 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.752+0000 7f574d1ea780 1 > prepared multipart upload key=R00F69ON5P6Z upload=YWQH0TNUYZVS tag=MRNVS3H5U4EE type=write size=2470410 2024-09-12T17:18:20.754 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.754+0000 7f574d1ea780 1 < completed part key=_multipart_R00F69ON5P6Z.2~NT0O4JQZ1IW5.0 size=211081 2024-09-12T17:18:20.756 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.756+0000 7f574d1ea780 1 < completed multipart upload key=R00F69ON5P6Z upload=NT0O4JQZ1IW5 tag=45LWDPC37CR6 type=write size=1259657 2024-09-12T17:18:20.759 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.758+0000 7f574d1ea780 1 > prepared part key=_multipart_UFKM4I8RMT0W.2~SNSLABFBN50T.0 size=599350 2024-09-12T17:18:20.759 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.758+0000 7f574d1ea780 1 > prepared multipart upload key=UFKM4I8RMT0W upload=SNSLABFBN50T tag=AKJC6XBRO0KR type=write size=1647926 2024-09-12T17:18:20.760 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.759+0000 7f574d1ea780 1 < completed delete operation key=ENFNIFHQ3SHW tag=KAKNIHF20USY type=del 2024-09-12T17:18:20.761 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.760+0000 7f574d1ea780 1 > prepared operation key=7BX38Q7723EB tag=89709K5M9Y02 type=del size=587944 2024-09-12T17:18:20.762 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.761+0000 7f574d1ea780 1 < completed delete operation key=HFWA7DNUMWF2 tag=TTQC4AGGL7BS type=del 2024-09-12T17:18:20.763 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.763+0000 7f574d1ea780 1 > prepared operation key=8SG7DJO4HWPI tag=3RYOLKYUCWCU type=del size=3162491 2024-09-12T17:18:20.765 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.764+0000 7f574d1ea780 1 < completed delete operation key=VWWA5IB0L4N1 tag=Z0L0MN1W7Y27 type=del 2024-09-12T17:18:20.767 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.766+0000 7f574d1ea780 1 > prepared part key=_multipart_YXIDO0U18839.2~ZBFUS1GJACL5.0 size=1048576 2024-09-12T17:18:20.769 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.768+0000 7f574d1ea780 1 > prepared part key=_multipart_YXIDO0U18839.2~ZBFUS1GJACL5.1 size=503796 2024-09-12T17:18:20.769 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.768+0000 7f574d1ea780 1 > prepared multipart upload key=YXIDO0U18839 upload=ZBFUS1GJACL5 tag=J0SGL2HO2MAP type=write size=2600948 2024-09-12T17:18:20.771 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.771+0000 7f574d1ea780 1 < completed delete operation key=C9IYR9CET1I8 tag=16J92QM5EP4P type=del 2024-09-12T17:18:20.774 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.773+0000 7f574d1ea780 1 > prepared part key=_multipart_TIKBUXFPVTN1.2~SG671OL1TNCS.0 size=1048576 2024-09-12T17:18:20.775 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.774+0000 7f574d1ea780 1 > prepared part key=_multipart_TIKBUXFPVTN1.2~SG671OL1TNCS.1 size=166262 2024-09-12T17:18:20.775 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.774+0000 7f574d1ea780 1 > prepared multipart upload key=TIKBUXFPVTN1 upload=SG671OL1TNCS tag=VY57VW8L0U9O type=write size=2263414 2024-09-12T17:18:20.775 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.774+0000 7f574d1ea780 1 < canceled part key=_multipart_7BX38Q7723EB.2~PIPCF11BOM18.0 size=637907 2024-09-12T17:18:20.777 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.776+0000 7f574d1ea780 1 < canceled multipart upload key=7BX38Q7723EB upload=PIPCF11BOM18 tag=V50UCBSH1N9R type=write size=1686483 2024-09-12T17:18:20.779 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.778+0000 7f574d1ea780 1 > prepared part key=_multipart_TIKBUXFPVTN1.2~FI77GBN9B2LK.0 size=797836 2024-09-12T17:18:20.779 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.778+0000 7f574d1ea780 1 > prepared multipart upload key=TIKBUXFPVTN1 upload=FI77GBN9B2LK tag=PLGVZNTPHXQU type=write size=1846412 2024-09-12T17:18:20.780 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.779+0000 7f574d1ea780 1 < completed delete operation key=HFWA7DNUMWF2 tag=SMHRZRXWLRZP type=del 2024-09-12T17:18:20.782 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.781+0000 7f574d1ea780 1 > prepared part key=_multipart_U6E9A5OH4GUW.2~G7DATPQDZP9F.0 size=1041491 2024-09-12T17:18:20.782 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.781+0000 7f574d1ea780 1 > prepared multipart upload key=U6E9A5OH4GUW upload=G7DATPQDZP9F tag=96GETZNDI3I1 type=write size=2090067 2024-09-12T17:18:20.784 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.783+0000 7f574d1ea780 1 < completed delete operation key=OI51GO639LFK tag=1WBBR0TJMZOW type=del 2024-09-12T17:18:20.785 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.784+0000 7f574d1ea780 1 > prepared operation key=54CM8800AT9V tag=FCATDH5AGM96 type=del size=130937 2024-09-12T17:18:20.786 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.785+0000 7f574d1ea780 1 < completed delete operation key=UTCKL1F42X8A tag=1UJZKPO03UAF type=del 2024-09-12T17:18:20.788 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.787+0000 7f574d1ea780 1 > prepared part key=_multipart_7BX38Q7723EB.2~KJQ09ZAKBGJX.0 size=619618 2024-09-12T17:18:20.788 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.787+0000 7f574d1ea780 1 > prepared multipart upload key=7BX38Q7723EB upload=KJQ09ZAKBGJX tag=ILDLTKF1ZYS3 type=write size=1668194 2024-09-12T17:18:20.789 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.789+0000 7f574d1ea780 1 < completed write operation key=55V137SY4E4P tag=5RTP6IP1MKVP type=write size=371198 2024-09-12T17:18:20.792 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.791+0000 7f574d1ea780 1 > prepared part key=_multipart_8SG7DJO4HWPI.2~W0JVUQZK7E8A.0 size=531972 2024-09-12T17:18:20.792 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.791+0000 7f574d1ea780 1 > prepared multipart upload key=8SG7DJO4HWPI upload=W0JVUQZK7E8A tag=LHDFFCGAI0KR type=write size=1580548 2024-09-12T17:18:20.793 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.792+0000 7f574d1ea780 1 < canceled operation key=ZGE1860DMGHA tag=2U5CDW4GB7DN type=write size=312959 2024-09-12T17:18:20.794 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.793+0000 7f574d1ea780 1 > prepared operation key=YXIDO0U18839 tag=MPVXSYV4KFV2 type=del size=185284 2024-09-12T17:18:20.796 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.794+0000 7f574d1ea780 1 < canceled operation key=D1GEG3MKPOM3 tag=4QQP6SA5F9D3 type=del size=3026608 2024-09-12T17:18:20.796 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.796+0000 7f574d1ea780 1 > prepared operation key=D1GEG3MKPOM3 tag=QXTTOLPXNY24 type=write size=892899 2024-09-12T17:18:20.798 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.797+0000 7f574d1ea780 1 < completed delete operation key=HFWA7DNUMWF2 tag=MHTO29KQYI8J type=del 2024-09-12T17:18:20.800 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.799+0000 7f574d1ea780 1 > prepared part key=_multipart_DH02JGZP64MN.2~KNKSMUFZX0OC.0 size=1048576 2024-09-12T17:18:20.801 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.800+0000 7f574d1ea780 1 > prepared part key=_multipart_DH02JGZP64MN.2~KNKSMUFZX0OC.1 size=358272 2024-09-12T17:18:20.801 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.800+0000 7f574d1ea780 1 > prepared multipart upload key=DH02JGZP64MN upload=KNKSMUFZX0OC tag=312RIUEYVQY5 type=write size=2455424 2024-09-12T17:18:20.802 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.801+0000 7f574d1ea780 1 < completed delete operation key=54CM8800AT9V tag=JILS3ZBGS3E7 type=del 2024-09-12T17:18:20.805 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.804+0000 7f574d1ea780 1 > prepared part key=_multipart_43GV2N9VBBKE.2~OZJCAMQZNXFV.0 size=810187 2024-09-12T17:18:20.805 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.804+0000 7f574d1ea780 1 > prepared multipart upload key=43GV2N9VBBKE upload=OZJCAMQZNXFV tag=6FK0XVVPF0R6 type=write size=1858763 2024-09-12T17:18:20.806 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.805+0000 7f574d1ea780 1 < completed part key=_multipart_ZGH8XC39FGTC.2~DE58WUMEKT7X.0 size=125918 2024-09-12T17:18:20.808 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.807+0000 7f574d1ea780 1 < completed multipart upload key=ZGH8XC39FGTC upload=DE58WUMEKT7X tag=UNJ25ATLT0HR type=write size=1174494 2024-09-12T17:18:20.809 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.808+0000 7f574d1ea780 1 > prepared operation key=YXIDO0U18839 tag=12LVQ5L0W983 type=del size=344949 2024-09-12T17:18:20.810 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.809+0000 7f574d1ea780 1 < completed part key=_multipart_R00F69ON5P6Z.2~YWQH0TNUYZVS.0 size=1048576 2024-09-12T17:18:20.811 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.811+0000 7f574d1ea780 1 < completed part key=_multipart_R00F69ON5P6Z.2~YWQH0TNUYZVS.1 size=373258 2024-09-12T17:18:20.814 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.813+0000 7f574d1ea780 1 < completed multipart upload key=R00F69ON5P6Z upload=YWQH0TNUYZVS tag=MRNVS3H5U4EE type=write size=2470410 2024-09-12T17:18:20.815 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.814+0000 7f574d1ea780 1 > prepared operation key=OI51GO639LFK tag=NTRBRC7DVK0B type=del size=56995 2024-09-12T17:18:20.816 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.815+0000 7f574d1ea780 1 < completed part key=_multipart_UFKM4I8RMT0W.2~SNSLABFBN50T.0 size=599350 2024-09-12T17:18:20.818 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.817+0000 7f574d1ea780 1 < completed multipart upload key=UFKM4I8RMT0W upload=SNSLABFBN50T tag=AKJC6XBRO0KR type=write size=1647926 2024-09-12T17:18:20.820 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.819+0000 7f574d1ea780 1 > prepared part key=_multipart_RWVWJHVZE95H.2~TOUO40RMDIAR.0 size=1048576 2024-09-12T17:18:20.821 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.820+0000 7f574d1ea780 1 > prepared part key=_multipart_RWVWJHVZE95H.2~TOUO40RMDIAR.1 size=334119 2024-09-12T17:18:20.821 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.820+0000 7f574d1ea780 1 > prepared multipart upload key=RWVWJHVZE95H upload=TOUO40RMDIAR tag=32QURB2JWUMP type=write size=2431271 2024-09-12T17:18:20.822 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.821+0000 7f574d1ea780 1 < completed delete operation key=7BX38Q7723EB tag=89709K5M9Y02 type=del 2024-09-12T17:18:20.825 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.824+0000 7f574d1ea780 1 > prepared part key=_multipart_U6E9A5OH4GUW.2~QJV6P36GPH4L.0 size=1048576 2024-09-12T17:18:20.826 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.825+0000 7f574d1ea780 1 > prepared part key=_multipart_U6E9A5OH4GUW.2~QJV6P36GPH4L.1 size=1048576 2024-09-12T17:18:20.827 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.826+0000 7f574d1ea780 1 > prepared part key=_multipart_U6E9A5OH4GUW.2~QJV6P36GPH4L.2 size=1034189 2024-09-12T17:18:20.827 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.826+0000 7f574d1ea780 1 > prepared multipart upload key=U6E9A5OH4GUW upload=QJV6P36GPH4L tag=9HIHSY93O6AV type=write size=4179917 2024-09-12T17:18:20.828 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.827+0000 7f574d1ea780 1 < completed delete operation key=8SG7DJO4HWPI tag=3RYOLKYUCWCU type=del 2024-09-12T17:18:20.830 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.829+0000 7f574d1ea780 1 > prepared part key=_multipart_54CM8800AT9V.2~XU1LOZ2UML91.0 size=1048576 2024-09-12T17:18:20.831 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.831+0000 7f574d1ea780 1 > prepared part key=_multipart_54CM8800AT9V.2~XU1LOZ2UML91.1 size=952201 2024-09-12T17:18:20.832 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.831+0000 7f574d1ea780 1 > prepared multipart upload key=54CM8800AT9V upload=XU1LOZ2UML91 tag=7IXZG29E93C6 type=write size=3049353 2024-09-12T17:18:20.833 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.832+0000 7f574d1ea780 1 < completed part key=_multipart_YXIDO0U18839.2~ZBFUS1GJACL5.0 size=1048576 2024-09-12T17:18:20.834 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.833+0000 7f574d1ea780 1 < completed part key=_multipart_YXIDO0U18839.2~ZBFUS1GJACL5.1 size=503796 2024-09-12T17:18:20.836 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.835+0000 7f574d1ea780 1 < completed multipart upload key=YXIDO0U18839 upload=ZBFUS1GJACL5 tag=J0SGL2HO2MAP type=write size=2600948 2024-09-12T17:18:20.837 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.837+0000 7f574d1ea780 1 > prepared operation key=SQQMJ61CA0QW tag=GPP5CRESIEQ8 type=del size=1410075 2024-09-12T17:18:20.839 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.838+0000 7f574d1ea780 1 < completed part key=_multipart_TIKBUXFPVTN1.2~SG671OL1TNCS.0 size=1048576 2024-09-12T17:18:20.839 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.838+0000 7f574d1ea780 1 < canceled part key=_multipart_TIKBUXFPVTN1.2~SG671OL1TNCS.1 size=166262 2024-09-12T17:18:20.841 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.840+0000 7f574d1ea780 1 < canceled multipart upload key=TIKBUXFPVTN1 upload=SG671OL1TNCS tag=VY57VW8L0U9O type=write size=2263414 2024-09-12T17:18:20.843 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.842+0000 7f574d1ea780 1 > prepared part key=_multipart_OI51GO639LFK.2~N0LF8AYR1QSH.0 size=1048576 2024-09-12T17:18:20.844 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.843+0000 7f574d1ea780 1 > prepared part key=_multipart_OI51GO639LFK.2~N0LF8AYR1QSH.1 size=1048576 2024-09-12T17:18:20.845 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.844+0000 7f574d1ea780 1 > prepared part key=_multipart_OI51GO639LFK.2~N0LF8AYR1QSH.2 size=299610 2024-09-12T17:18:20.845 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.844+0000 7f574d1ea780 1 > prepared multipart upload key=OI51GO639LFK upload=N0LF8AYR1QSH tag=0SL8UQG3YLV9 type=write size=3445338 2024-09-12T17:18:20.846 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.845+0000 7f574d1ea780 1 < completed part key=_multipart_TIKBUXFPVTN1.2~FI77GBN9B2LK.0 size=797836 2024-09-12T17:18:20.848 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.847+0000 7f574d1ea780 1 < completed multipart upload key=TIKBUXFPVTN1 upload=FI77GBN9B2LK tag=PLGVZNTPHXQU type=write size=1846412 2024-09-12T17:18:20.849 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.849+0000 7f574d1ea780 1 > prepared operation key=QXD8UG2K4STQ tag=QFLEMOJDE6L7 type=del size=1135200 2024-09-12T17:18:20.851 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.850+0000 7f574d1ea780 1 < completed part key=_multipart_U6E9A5OH4GUW.2~G7DATPQDZP9F.0 size=1041491 2024-09-12T17:18:20.853 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.852+0000 7f574d1ea780 1 < completed multipart upload key=U6E9A5OH4GUW upload=G7DATPQDZP9F tag=96GETZNDI3I1 type=write size=2090067 2024-09-12T17:18:20.854 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.853+0000 7f574d1ea780 1 > prepared operation key=R00F69ON5P6Z tag=XXIUTSIJDPJV type=del size=2221417 2024-09-12T17:18:20.855 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.854+0000 7f574d1ea780 1 < canceled operation key=54CM8800AT9V tag=FCATDH5AGM96 type=del size=130937 2024-09-12T17:18:20.857 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.857+0000 7f574d1ea780 1 > prepared part key=_multipart_K12MVG618809.2~V33LA8G9OE7N.0 size=1048576 2024-09-12T17:18:20.858 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.858+0000 7f574d1ea780 1 > prepared part key=_multipart_K12MVG618809.2~V33LA8G9OE7N.1 size=798847 2024-09-12T17:18:20.859 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.858+0000 7f574d1ea780 1 > prepared multipart upload key=K12MVG618809 upload=V33LA8G9OE7N tag=8HRFGJG0VNCZ type=write size=2895999 2024-09-12T17:18:20.860 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.859+0000 7f574d1ea780 1 < completed part key=_multipart_7BX38Q7723EB.2~KJQ09ZAKBGJX.0 size=619618 2024-09-12T17:18:20.862 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.861+0000 7f574d1ea780 1 < completed multipart upload key=7BX38Q7723EB upload=KJQ09ZAKBGJX tag=ILDLTKF1ZYS3 type=write size=1668194 2024-09-12T17:18:20.863 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.863+0000 7f574d1ea780 1 > prepared operation key=Q2Q3B1J3DAVD tag=Q9OGBZ9M5VZ6 type=del size=670656 2024-09-12T17:18:20.865 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.864+0000 7f574d1ea780 1 < completed part key=_multipart_8SG7DJO4HWPI.2~W0JVUQZK7E8A.0 size=531972 2024-09-12T17:18:20.867 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.866+0000 7f574d1ea780 1 < completed multipart upload key=8SG7DJO4HWPI upload=W0JVUQZK7E8A tag=LHDFFCGAI0KR type=write size=1580548 2024-09-12T17:18:20.869 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.868+0000 7f574d1ea780 1 > prepared part key=_multipart_QXD8UG2K4STQ.2~DPLQIVOHMJHL.0 size=288814 2024-09-12T17:18:20.869 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.868+0000 7f574d1ea780 1 > prepared multipart upload key=QXD8UG2K4STQ upload=DPLQIVOHMJHL tag=ZNAOO9DDXNF6 type=write size=1337390 2024-09-12T17:18:20.870 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.869+0000 7f574d1ea780 1 < completed delete operation key=YXIDO0U18839 tag=MPVXSYV4KFV2 type=del 2024-09-12T17:18:20.871 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.871+0000 7f574d1ea780 1 > prepared operation key=43GV2N9VBBKE tag=KA7SD3EJ68EQ type=del size=1630893 2024-09-12T17:18:20.873 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.872+0000 7f574d1ea780 1 < completed write operation key=D1GEG3MKPOM3 tag=QXTTOLPXNY24 type=write size=892899 2024-09-12T17:18:20.874 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.873+0000 7f574d1ea780 1 > prepared operation key=A1TIP3RXHBCZ tag=7Q435YQTH3PF type=del size=1114476 2024-09-12T17:18:20.874 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.873+0000 7f574d1ea780 1 < canceled part key=_multipart_DH02JGZP64MN.2~KNKSMUFZX0OC.0 size=1048576 2024-09-12T17:18:20.875 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.874+0000 7f574d1ea780 1 < completed part key=_multipart_DH02JGZP64MN.2~KNKSMUFZX0OC.1 size=358272 2024-09-12T17:18:20.877 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.876+0000 7f574d1ea780 1 < canceled multipart upload key=DH02JGZP64MN upload=KNKSMUFZX0OC tag=312RIUEYVQY5 type=write size=2455424 2024-09-12T17:18:20.879 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.878+0000 7f574d1ea780 1 > prepared part key=_multipart_RNI86YYLADT0.2~U8IDXC6ZPW70.0 size=1048576 2024-09-12T17:18:20.880 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.879+0000 7f574d1ea780 1 > prepared part key=_multipart_RNI86YYLADT0.2~U8IDXC6ZPW70.1 size=750237 2024-09-12T17:18:20.880 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:18:20.879+0000 7f574d1ea780 1 > prepared multipart upload key=RNI86YYLADT0 upload=U8IDXC6ZPW70 tag=49EVFNJ0OF43 type=write size=2847389 2024-09-12T17:18:20.881 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] cls_rgw_stats.simulate (9414 ms) 2024-09-12T17:18:20.881 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 1 test from cls_rgw_stats (9414 ms total) 2024-09-12T17:18:20.881 INFO:tasks.workunit.client.0.smithi037.stdout: 2024-09-12T17:18:20.881 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] Global test environment tear-down 2024-09-12T17:18:21.557 INFO:tasks.workunit.client.0.smithi037.stdout:[==========] 1 test from 1 test suite ran. (11989 ms total) 2024-09-12T17:18:21.557 INFO:tasks.workunit.client.0.smithi037.stdout:[ PASSED ] 1 test. 2024-09-12T17:18:21.561 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:18:21.561 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:18:21.645 INFO:tasks.workunit:Running workunits matching cls/test_cls_cmpomap.sh on client.0... 2024-09-12T17:18:21.646 INFO:tasks.workunit:Running workunit cls/test_cls_cmpomap.sh... 2024-09-12T17:18:21.647 DEBUG:teuthology.orchestra.run.smithi037:workunit test cls/test_cls_cmpomap.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_cmpomap.sh 2024-09-12T17:18:21.695 INFO:tasks.workunit.client.0.smithi037.stdout:Running main() from gmock_main.cc 2024-09-12T17:18:21.695 INFO:tasks.workunit.client.0.smithi037.stdout:[==========] Running 31 tests from 1 test suite. 2024-09-12T17:18:21.695 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] Global test environment set-up. 2024-09-12T17:18:23.578 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 31 tests from CmpOmap 2024-09-12T17:18:23.578 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_str 2024-09-12T17:18:23.595 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] CmpOmap.cmp_vals_noexist_str (17 ms) 2024-09-12T17:18:23.595 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_str_default 2024-09-12T17:18:23.599 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] CmpOmap.cmp_vals_noexist_str_default (4 ms) 2024-09-12T17:18:23.599 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_u64 2024-09-12T17:18:23.602 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] CmpOmap.cmp_vals_noexist_u64 (3 ms) 2024-09-12T17:18:23.602 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_u64_default 2024-09-12T17:18:23.605 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] CmpOmap.cmp_vals_noexist_u64_default (4 ms) 2024-09-12T17:18:23.605 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] CmpOmap.cmp_vals_str 2024-09-12T17:18:23.612 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] CmpOmap.cmp_vals_str (6 ms) 2024-09-12T17:18:23.612 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] CmpOmap.cmp_vals_u64 2024-09-12T17:18:23.619 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] CmpOmap.cmp_vals_u64 (8 ms) 2024-09-12T17:18:23.619 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_input 2024-09-12T17:18:23.622 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_input (3 ms) 2024-09-12T17:18:23.622 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_default 2024-09-12T17:18:23.627 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_default (5 ms) 2024-09-12T17:18:23.627 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] CmpOmap.cmp_vals_u64_empty_default 2024-09-12T17:18:23.631 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] CmpOmap.cmp_vals_u64_empty_default (3 ms) 2024-09-12T17:18:23.631 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_value 2024-09-12T17:18:23.635 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_value (5 ms) 2024-09-12T17:18:23.635 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] CmpOmap.cmp_vals_at_max_keys 2024-09-12T17:18:23.636 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] CmpOmap.cmp_vals_at_max_keys (1 ms) 2024-09-12T17:18:23.636 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] CmpOmap.cmp_vals_over_max_keys 2024-09-12T17:18:23.637 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] CmpOmap.cmp_vals_over_max_keys (0 ms) 2024-09-12T17:18:23.637 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_str 2024-09-12T17:18:23.643 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_str (7 ms) 2024-09-12T17:18:23.644 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_str_default 2024-09-12T17:18:23.650 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_str_default (7 ms) 2024-09-12T17:18:23.650 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_u64 2024-09-12T17:18:23.657 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_u64 (7 ms) 2024-09-12T17:18:23.657 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_u64_default 2024-09-12T17:18:23.663 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_u64_default (6 ms) 2024-09-12T17:18:23.663 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] CmpOmap.cmp_set_vals_str 2024-09-12T17:18:23.671 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] CmpOmap.cmp_set_vals_str (8 ms) 2024-09-12T17:18:23.671 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64 2024-09-12T17:18:23.680 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] CmpOmap.cmp_set_vals_u64 (8 ms) 2024-09-12T17:18:23.680 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64_einval 2024-09-12T17:18:23.683 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] CmpOmap.cmp_set_vals_u64_einval (3 ms) 2024-09-12T17:18:23.683 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64_eio 2024-09-12T17:18:23.685 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] CmpOmap.cmp_set_vals_u64_eio (3 ms) 2024-09-12T17:18:23.685 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] CmpOmap.cmp_set_vals_at_max_keys 2024-09-12T17:18:23.686 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] CmpOmap.cmp_set_vals_at_max_keys (1 ms) 2024-09-12T17:18:23.686 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] CmpOmap.cmp_set_vals_over_max_keys 2024-09-12T17:18:23.687 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] CmpOmap.cmp_set_vals_over_max_keys (1 ms) 2024-09-12T17:18:23.687 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] CmpOmap.cmp_rm_keys_noexist_str 2024-09-12T17:18:23.693 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] CmpOmap.cmp_rm_keys_noexist_str (6 ms) 2024-09-12T17:18:23.693 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] CmpOmap.cmp_rm_keys_noexist_u64 2024-09-12T17:18:23.700 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] CmpOmap.cmp_rm_keys_noexist_u64 (7 ms) 2024-09-12T17:18:23.700 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] CmpOmap.cmp_rm_keys_str 2024-09-12T17:18:23.707 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] CmpOmap.cmp_rm_keys_str (7 ms) 2024-09-12T17:18:23.708 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64 2024-09-12T17:18:23.715 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64 (8 ms) 2024-09-12T17:18:23.716 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_einval 2024-09-12T17:18:23.718 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_einval (2 ms) 2024-09-12T17:18:23.718 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_eio 2024-09-12T17:18:23.720 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_eio (3 ms) 2024-09-12T17:18:23.720 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] CmpOmap.cmp_rm_keys_at_max_keys 2024-09-12T17:18:23.721 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] CmpOmap.cmp_rm_keys_at_max_keys (1 ms) 2024-09-12T17:18:23.721 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] CmpOmap.cmp_rm_keys_over_max_keys 2024-09-12T17:18:23.722 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] CmpOmap.cmp_rm_keys_over_max_keys (1 ms) 2024-09-12T17:18:23.722 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_empty 2024-09-12T17:18:23.729 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_empty (7 ms) 2024-09-12T17:18:23.729 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 31 tests from CmpOmap (152 ms total) 2024-09-12T17:18:23.729 INFO:tasks.workunit.client.0.smithi037.stdout: 2024-09-12T17:18:23.730 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] Global test environment tear-down 2024-09-12T17:18:24.578 INFO:tasks.workunit.client.0.smithi037.stdout:[==========] 31 tests from 1 test suite ran. (2883 ms total) 2024-09-12T17:18:24.578 INFO:tasks.workunit.client.0.smithi037.stdout:[ PASSED ] 31 tests. 2024-09-12T17:18:24.581 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:18:24.581 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:18:24.626 INFO:tasks.workunit:Running workunits matching cls/test_cls_2pc_queue.sh on client.0... 2024-09-12T17:18:24.627 INFO:tasks.workunit:Running workunit cls/test_cls_2pc_queue.sh... 2024-09-12T17:18:24.628 DEBUG:teuthology.orchestra.run.smithi037:workunit test cls/test_cls_2pc_queue.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_2pc_queue.sh 2024-09-12T17:18:24.718 INFO:tasks.workunit.client.0.smithi037.stdout:Running main() from gmock_main.cc 2024-09-12T17:18:24.718 INFO:tasks.workunit.client.0.smithi037.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-12T17:18:24.718 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] Global test environment set-up. 2024-09-12T17:18:24.718 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 24 tests from TestCls2PCQueue 2024-09-12T17:18:24.718 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] TestCls2PCQueue.GetCapacity 2024-09-12T17:18:27.603 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] TestCls2PCQueue.GetCapacity (2884 ms) 2024-09-12T17:18:27.603 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] TestCls2PCQueue.AsyncGetCapacity 2024-09-12T17:18:30.624 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] TestCls2PCQueue.AsyncGetCapacity (3020 ms) 2024-09-12T17:18:30.624 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] TestCls2PCQueue.Reserve 2024-09-12T17:18:33.639 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] TestCls2PCQueue.Reserve (3018 ms) 2024-09-12T17:18:33.639 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] TestCls2PCQueue.AsyncReserve 2024-09-12T17:18:36.656 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] TestCls2PCQueue.AsyncReserve (3015 ms) 2024-09-12T17:18:36.656 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] TestCls2PCQueue.Commit 2024-09-12T17:18:40.728 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] TestCls2PCQueue.Commit (4074 ms) 2024-09-12T17:18:40.728 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] TestCls2PCQueue.Stats 2024-09-12T17:18:43.739 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] TestCls2PCQueue.Stats (3011 ms) 2024-09-12T17:18:43.739 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] TestCls2PCQueue.UpgradeFromReef 2024-09-12T17:18:47.773 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] TestCls2PCQueue.UpgradeFromReef (4034 ms) 2024-09-12T17:18:47.774 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] TestCls2PCQueue.Abort 2024-09-12T17:18:50.790 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] TestCls2PCQueue.Abort (3017 ms) 2024-09-12T17:18:50.790 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] TestCls2PCQueue.ReserveError 2024-09-12T17:18:53.815 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] TestCls2PCQueue.ReserveError (3024 ms) 2024-09-12T17:18:53.816 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] TestCls2PCQueue.CommitError 2024-09-12T17:18:56.818 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] TestCls2PCQueue.CommitError (3002 ms) 2024-09-12T17:18:56.818 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] TestCls2PCQueue.AbortError 2024-09-12T17:18:59.872 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] TestCls2PCQueue.AbortError (3055 ms) 2024-09-12T17:18:59.872 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] TestCls2PCQueue.MultiReserve 2024-09-12T17:19:02.883 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] TestCls2PCQueue.MultiReserve (3012 ms) 2024-09-12T17:19:02.884 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] TestCls2PCQueue.MultiCommit 2024-09-12T17:19:05.914 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] TestCls2PCQueue.MultiCommit (3030 ms) 2024-09-12T17:19:05.914 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] TestCls2PCQueue.MultiAbort 2024-09-12T17:19:08.921 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] TestCls2PCQueue.MultiAbort (3008 ms) 2024-09-12T17:19:08.922 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] TestCls2PCQueue.ReserveCommit 2024-09-12T17:19:11.951 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] TestCls2PCQueue.ReserveCommit (3029 ms) 2024-09-12T17:19:11.951 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] TestCls2PCQueue.ReserveAbort 2024-09-12T17:19:14.975 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] TestCls2PCQueue.ReserveAbort (3025 ms) 2024-09-12T17:19:14.976 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] TestCls2PCQueue.ManualCleanup 2024-09-12T17:19:18.009 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] TestCls2PCQueue.ManualCleanup (3034 ms) 2024-09-12T17:19:18.009 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] TestCls2PCQueue.Cleanup 2024-09-12T17:19:21.025 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] TestCls2PCQueue.Cleanup (3014 ms) 2024-09-12T17:19:21.026 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] TestCls2PCQueue.MultiProducer 2024-09-12T17:19:31.416 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] TestCls2PCQueue.MultiProducer (10393 ms) 2024-09-12T17:19:31.416 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] TestCls2PCQueue.AsyncConsumer 2024-09-12T17:19:34.418 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] TestCls2PCQueue.AsyncConsumer (3002 ms) 2024-09-12T17:19:34.419 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] TestCls2PCQueue.MultiProducerConsumer 2024-09-12T17:19:48.467 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] TestCls2PCQueue.MultiProducerConsumer (14048 ms) 2024-09-12T17:19:48.467 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] TestCls2PCQueue.ReserveSpillover 2024-09-12T17:19:52.499 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] TestCls2PCQueue.ReserveSpillover (4033 ms) 2024-09-12T17:19:52.499 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] TestCls2PCQueue.CommitSpillover 2024-09-12T17:19:58.537 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] TestCls2PCQueue.CommitSpillover (6038 ms) 2024-09-12T17:19:58.537 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] TestCls2PCQueue.AbortSpillover 2024-09-12T17:20:04.566 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] TestCls2PCQueue.AbortSpillover (6029 ms) 2024-09-12T17:20:04.567 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 24 tests from TestCls2PCQueue (99849 ms total) 2024-09-12T17:20:04.567 INFO:tasks.workunit.client.0.smithi037.stdout: 2024-09-12T17:20:04.567 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] Global test environment tear-down 2024-09-12T17:20:04.567 INFO:tasks.workunit.client.0.smithi037.stdout:[==========] 24 tests from 1 test suite ran. (99849 ms total) 2024-09-12T17:20:04.567 INFO:tasks.workunit.client.0.smithi037.stdout:[ PASSED ] 24 tests. 2024-09-12T17:20:04.570 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:20:04.570 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:20:04.634 INFO:tasks.workunit:Running workunits matching cls/test_cls_user.sh on client.0... 2024-09-12T17:20:04.635 INFO:tasks.workunit:Running workunit cls/test_cls_user.sh... 2024-09-12T17:20:04.635 DEBUG:teuthology.orchestra.run.smithi037:workunit test cls/test_cls_user.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_user.sh 2024-09-12T17:20:04.695 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:20:04.695 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:20:04.695 INFO:tasks.workunit.client.0.smithi037.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-12T17:20:04.695 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] Global test environment set-up. 2024-09-12T17:20:06.581 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 4 tests from ClsAccount 2024-09-12T17:20:06.581 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] ClsAccount.add 2024-09-12T17:20:06.603 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] ClsAccount.add (23 ms) 2024-09-12T17:20:06.603 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] ClsAccount.get 2024-09-12T17:20:06.609 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] ClsAccount.get (6 ms) 2024-09-12T17:20:06.609 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] ClsAccount.rm 2024-09-12T17:20:06.647 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] ClsAccount.rm (38 ms) 2024-09-12T17:20:06.648 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] ClsAccount.list 2024-09-12T17:20:06.668 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] ClsAccount.list (21 ms) 2024-09-12T17:20:06.668 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 4 tests from ClsAccount (88 ms total) 2024-09-12T17:20:06.668 INFO:tasks.workunit.client.0.smithi037.stdout: 2024-09-12T17:20:06.668 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] Global test environment tear-down 2024-09-12T17:20:07.602 INFO:tasks.workunit.client.0.smithi037.stdout:[==========] 4 tests from 1 test suite ran. (2907 ms total) 2024-09-12T17:20:07.603 INFO:tasks.workunit.client.0.smithi037.stdout:[ PASSED ] 4 tests. 2024-09-12T17:20:07.607 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:20:07.607 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:20:07.652 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_gc_log.sh on client.0... 2024-09-12T17:20:07.654 INFO:tasks.workunit:Running workunit rgw/test_rgw_gc_log.sh... 2024-09-12T17:20:07.654 DEBUG:teuthology.orchestra.run.smithi037:workunit test rgw/test_rgw_gc_log.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_gc_log.sh 2024-09-12T17:20:07.710 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:20:07.710 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:20:07.711 INFO:tasks.workunit.client.0.smithi037.stdout:[==========] Running 6 tests from 1 test suite. 2024-09-12T17:20:07.711 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] Global test environment set-up. 2024-09-12T17:20:09.601 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 6 tests from rgw_gc_log 2024-09-12T17:20:09.601 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] rgw_gc_log.init_existing_queue 2024-09-12T17:20:09.622 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] rgw_gc_log.init_existing_queue (22 ms) 2024-09-12T17:20:09.622 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] rgw_gc_log.init_existing_omap 2024-09-12T17:20:09.626 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] rgw_gc_log.init_existing_omap (4 ms) 2024-09-12T17:20:09.626 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] rgw_gc_log.enqueue1_after_init 2024-09-12T17:20:09.629 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] rgw_gc_log.enqueue1_after_init (3 ms) 2024-09-12T17:20:09.629 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] rgw_gc_log.enqueue2_before_init 2024-09-12T17:20:09.631 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] rgw_gc_log.enqueue2_before_init (2 ms) 2024-09-12T17:20:09.631 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] rgw_gc_log.defer1_after_init 2024-09-12T17:20:09.634 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] rgw_gc_log.defer1_after_init (3 ms) 2024-09-12T17:20:09.634 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] rgw_gc_log.defer2_before_init 2024-09-12T17:20:09.636 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] rgw_gc_log.defer2_before_init (2 ms) 2024-09-12T17:20:09.636 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 6 tests from rgw_gc_log (36 ms total) 2024-09-12T17:20:09.636 INFO:tasks.workunit.client.0.smithi037.stdout: 2024-09-12T17:20:09.636 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] Global test environment tear-down 2024-09-12T17:20:10.606 INFO:tasks.workunit.client.0.smithi037.stdout:[==========] 6 tests from 1 test suite ran. (2896 ms total) 2024-09-12T17:20:10.606 INFO:tasks.workunit.client.0.smithi037.stdout:[ PASSED ] 6 tests. 2024-09-12T17:20:10.610 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:20:10.610 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:20:10.655 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_obj.sh on client.0... 2024-09-12T17:20:10.656 INFO:tasks.workunit:Running workunit rgw/test_rgw_obj.sh... 2024-09-12T17:20:10.656 DEBUG:teuthology.orchestra.run.smithi037:workunit test rgw/test_rgw_obj.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_obj.sh 2024-09-12T17:20:10.754 INFO:tasks.workunit.client.0.smithi037.stdout:Running main() from gmock_main.cc 2024-09-12T17:20:10.754 INFO:tasks.workunit.client.0.smithi037.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-12T17:20:10.754 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] Global test environment set-up. 2024-09-12T17:20:10.754 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 4 tests from TestRGWObj 2024-09-12T17:20:10.754 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] TestRGWObj.underscore 2024-09-12T17:20:10.754 INFO:tasks.workunit.client.0.smithi037.stdout:parsed: _obj 2024-09-12T17:20:10.755 INFO:tasks.workunit.client.0.smithi037.stdout:parsed: _obj 2024-09-12T17:20:10.755 INFO:tasks.workunit.client.0.smithi037.stdout:stripped: _obj ns= i= 2024-09-12T17:20:10.755 INFO:tasks.workunit.client.0.smithi037.stdout:parsed: _obj 2024-09-12T17:20:10.755 INFO:tasks.workunit.client.0.smithi037.stdout:parsed: _obj 2024-09-12T17:20:10.755 INFO:tasks.workunit.client.0.smithi037.stdout:stripped: _obj ns= i= 2024-09-12T17:20:10.755 INFO:tasks.workunit.client.0.smithi037.stdout:parsed: _obj 2024-09-12T17:20:10.755 INFO:tasks.workunit.client.0.smithi037.stdout:parsed: _obj 2024-09-12T17:20:10.755 INFO:tasks.workunit.client.0.smithi037.stdout:stripped: _obj ns= i= 2024-09-12T17:20:10.755 INFO:tasks.workunit.client.0.smithi037.stdout:{ 2024-09-12T17:20:10.755 INFO:tasks.workunit.client.0.smithi037.stdout: "obj1": { 2024-09-12T17:20:10.755 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket": { 2024-09-12T17:20:10.755 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "test", 2024-09-12T17:20:10.755 INFO:tasks.workunit.client.0.smithi037.stdout: "marker": "marker", 2024-09-12T17:20:10.755 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:10.756 INFO:tasks.workunit.client.0.smithi037.stdout: "tenant": "", 2024-09-12T17:20:10.756 INFO:tasks.workunit.client.0.smithi037.stdout: "explicit_placement": { 2024-09-12T17:20:10.756 INFO:tasks.workunit.client.0.smithi037.stdout: "data_pool": "", 2024-09-12T17:20:10.756 INFO:tasks.workunit.client.0.smithi037.stdout: "data_extra_pool": "", 2024-09-12T17:20:10.756 INFO:tasks.workunit.client.0.smithi037.stdout: "index_pool": "" 2024-09-12T17:20:10.756 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.756 INFO:tasks.workunit.client.0.smithi037.stdout: }, 2024-09-12T17:20:10.756 INFO:tasks.workunit.client.0.smithi037.stdout: "key": { 2024-09-12T17:20:10.756 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "_obj", 2024-09-12T17:20:10.756 INFO:tasks.workunit.client.0.smithi037.stdout: "instance": "", 2024-09-12T17:20:10.756 INFO:tasks.workunit.client.0.smithi037.stdout: "ns": "" 2024-09-12T17:20:10.756 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.756 INFO:tasks.workunit.client.0.smithi037.stdout: }, 2024-09-12T17:20:10.757 INFO:tasks.workunit.client.0.smithi037.stdout: "obj2": { 2024-09-12T17:20:10.757 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket": { 2024-09-12T17:20:10.757 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "test", 2024-09-12T17:20:10.757 INFO:tasks.workunit.client.0.smithi037.stdout: "marker": "marker", 2024-09-12T17:20:10.757 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:10.757 INFO:tasks.workunit.client.0.smithi037.stdout: "tenant": "", 2024-09-12T17:20:10.757 INFO:tasks.workunit.client.0.smithi037.stdout: "explicit_placement": { 2024-09-12T17:20:10.757 INFO:tasks.workunit.client.0.smithi037.stdout: "data_pool": "", 2024-09-12T17:20:10.757 INFO:tasks.workunit.client.0.smithi037.stdout: "data_extra_pool": "", 2024-09-12T17:20:10.757 INFO:tasks.workunit.client.0.smithi037.stdout: "index_pool": "" 2024-09-12T17:20:10.757 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.757 INFO:tasks.workunit.client.0.smithi037.stdout: }, 2024-09-12T17:20:10.757 INFO:tasks.workunit.client.0.smithi037.stdout: "key": { 2024-09-12T17:20:10.758 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "_obj", 2024-09-12T17:20:10.758 INFO:tasks.workunit.client.0.smithi037.stdout: "instance": "", 2024-09-12T17:20:10.758 INFO:tasks.workunit.client.0.smithi037.stdout: "ns": "" 2024-09-12T17:20:10.758 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.758 INFO:tasks.workunit.client.0.smithi037.stdout: }, 2024-09-12T17:20:10.758 INFO:tasks.workunit.client.0.smithi037.stdout: "obj3": { 2024-09-12T17:20:10.758 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket": { 2024-09-12T17:20:10.758 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "test", 2024-09-12T17:20:10.758 INFO:tasks.workunit.client.0.smithi037.stdout: "marker": "marker", 2024-09-12T17:20:10.758 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:10.758 INFO:tasks.workunit.client.0.smithi037.stdout: "tenant": "", 2024-09-12T17:20:10.758 INFO:tasks.workunit.client.0.smithi037.stdout: "explicit_placement": { 2024-09-12T17:20:10.758 INFO:tasks.workunit.client.0.smithi037.stdout: "data_pool": "", 2024-09-12T17:20:10.758 INFO:tasks.workunit.client.0.smithi037.stdout: "data_extra_pool": "", 2024-09-12T17:20:10.759 INFO:tasks.workunit.client.0.smithi037.stdout: "index_pool": "" 2024-09-12T17:20:10.759 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.759 INFO:tasks.workunit.client.0.smithi037.stdout: }, 2024-09-12T17:20:10.759 INFO:tasks.workunit.client.0.smithi037.stdout: "key": { 2024-09-12T17:20:10.759 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "_obj", 2024-09-12T17:20:10.759 INFO:tasks.workunit.client.0.smithi037.stdout: "instance": "", 2024-09-12T17:20:10.759 INFO:tasks.workunit.client.0.smithi037.stdout: "ns": "" 2024-09-12T17:20:10.759 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.759 INFO:tasks.workunit.client.0.smithi037.stdout: }, 2024-09-12T17:20:10.759 INFO:tasks.workunit.client.0.smithi037.stdout: "obj3-2": { 2024-09-12T17:20:10.759 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket": { 2024-09-12T17:20:10.759 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "test", 2024-09-12T17:20:10.759 INFO:tasks.workunit.client.0.smithi037.stdout: "marker": "marker", 2024-09-12T17:20:10.759 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:10.759 INFO:tasks.workunit.client.0.smithi037.stdout: "tenant": "", 2024-09-12T17:20:10.760 INFO:tasks.workunit.client.0.smithi037.stdout: "explicit_placement": { 2024-09-12T17:20:10.760 INFO:tasks.workunit.client.0.smithi037.stdout: "data_pool": "", 2024-09-12T17:20:10.760 INFO:tasks.workunit.client.0.smithi037.stdout: "data_extra_pool": "", 2024-09-12T17:20:10.760 INFO:tasks.workunit.client.0.smithi037.stdout: "index_pool": "" 2024-09-12T17:20:10.760 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.760 INFO:tasks.workunit.client.0.smithi037.stdout: }, 2024-09-12T17:20:10.760 INFO:tasks.workunit.client.0.smithi037.stdout: "key": { 2024-09-12T17:20:10.760 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "_obj", 2024-09-12T17:20:10.760 INFO:tasks.workunit.client.0.smithi037.stdout: "instance": "", 2024-09-12T17:20:10.760 INFO:tasks.workunit.client.0.smithi037.stdout: "ns": "" 2024-09-12T17:20:10.760 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.760 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.760 INFO:tasks.workunit.client.0.smithi037.stdout:} 2024-09-12T17:20:10.760 INFO:tasks.workunit.client.0.smithi037.stdout:parsed: _obj 2024-09-12T17:20:10.761 INFO:tasks.workunit.client.0.smithi037.stdout:parsed: _obj 2024-09-12T17:20:10.761 INFO:tasks.workunit.client.0.smithi037.stdout:stripped: _obj ns=ns i= 2024-09-12T17:20:10.761 INFO:tasks.workunit.client.0.smithi037.stdout:parsed: _obj 2024-09-12T17:20:10.761 INFO:tasks.workunit.client.0.smithi037.stdout:parsed: _obj 2024-09-12T17:20:10.761 INFO:tasks.workunit.client.0.smithi037.stdout:stripped: _obj ns=ns i= 2024-09-12T17:20:10.761 INFO:tasks.workunit.client.0.smithi037.stdout:parsed: _obj 2024-09-12T17:20:10.761 INFO:tasks.workunit.client.0.smithi037.stdout:parsed: _obj 2024-09-12T17:20:10.761 INFO:tasks.workunit.client.0.smithi037.stdout:stripped: _obj ns=ns i= 2024-09-12T17:20:10.761 INFO:tasks.workunit.client.0.smithi037.stdout:{ 2024-09-12T17:20:10.761 INFO:tasks.workunit.client.0.smithi037.stdout: "obj1": { 2024-09-12T17:20:10.761 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket": { 2024-09-12T17:20:10.761 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "test", 2024-09-12T17:20:10.761 INFO:tasks.workunit.client.0.smithi037.stdout: "marker": "marker", 2024-09-12T17:20:10.761 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:10.762 INFO:tasks.workunit.client.0.smithi037.stdout: "tenant": "", 2024-09-12T17:20:10.762 INFO:tasks.workunit.client.0.smithi037.stdout: "explicit_placement": { 2024-09-12T17:20:10.762 INFO:tasks.workunit.client.0.smithi037.stdout: "data_pool": "", 2024-09-12T17:20:10.762 INFO:tasks.workunit.client.0.smithi037.stdout: "data_extra_pool": "", 2024-09-12T17:20:10.762 INFO:tasks.workunit.client.0.smithi037.stdout: "index_pool": "" 2024-09-12T17:20:10.762 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.762 INFO:tasks.workunit.client.0.smithi037.stdout: }, 2024-09-12T17:20:10.762 INFO:tasks.workunit.client.0.smithi037.stdout: "key": { 2024-09-12T17:20:10.762 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "_obj", 2024-09-12T17:20:10.762 INFO:tasks.workunit.client.0.smithi037.stdout: "instance": "", 2024-09-12T17:20:10.762 INFO:tasks.workunit.client.0.smithi037.stdout: "ns": "ns" 2024-09-12T17:20:10.762 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.762 INFO:tasks.workunit.client.0.smithi037.stdout: }, 2024-09-12T17:20:10.762 INFO:tasks.workunit.client.0.smithi037.stdout: "obj2": { 2024-09-12T17:20:10.763 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket": { 2024-09-12T17:20:10.763 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "test", 2024-09-12T17:20:10.763 INFO:tasks.workunit.client.0.smithi037.stdout: "marker": "marker", 2024-09-12T17:20:10.763 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:10.763 INFO:tasks.workunit.client.0.smithi037.stdout: "tenant": "", 2024-09-12T17:20:10.763 INFO:tasks.workunit.client.0.smithi037.stdout: "explicit_placement": { 2024-09-12T17:20:10.763 INFO:tasks.workunit.client.0.smithi037.stdout: "data_pool": "", 2024-09-12T17:20:10.763 INFO:tasks.workunit.client.0.smithi037.stdout: "data_extra_pool": "", 2024-09-12T17:20:10.763 INFO:tasks.workunit.client.0.smithi037.stdout: "index_pool": "" 2024-09-12T17:20:10.763 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.763 INFO:tasks.workunit.client.0.smithi037.stdout: }, 2024-09-12T17:20:10.763 INFO:tasks.workunit.client.0.smithi037.stdout: "key": { 2024-09-12T17:20:10.763 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "_obj", 2024-09-12T17:20:10.763 INFO:tasks.workunit.client.0.smithi037.stdout: "instance": "", 2024-09-12T17:20:10.764 INFO:tasks.workunit.client.0.smithi037.stdout: "ns": "ns" 2024-09-12T17:20:10.764 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.764 INFO:tasks.workunit.client.0.smithi037.stdout: }, 2024-09-12T17:20:10.764 INFO:tasks.workunit.client.0.smithi037.stdout: "obj3": { 2024-09-12T17:20:10.764 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket": { 2024-09-12T17:20:10.764 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "test", 2024-09-12T17:20:10.764 INFO:tasks.workunit.client.0.smithi037.stdout: "marker": "marker", 2024-09-12T17:20:10.764 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:10.764 INFO:tasks.workunit.client.0.smithi037.stdout: "tenant": "", 2024-09-12T17:20:10.764 INFO:tasks.workunit.client.0.smithi037.stdout: "explicit_placement": { 2024-09-12T17:20:10.764 INFO:tasks.workunit.client.0.smithi037.stdout: "data_pool": "", 2024-09-12T17:20:10.764 INFO:tasks.workunit.client.0.smithi037.stdout: "data_extra_pool": "", 2024-09-12T17:20:10.764 INFO:tasks.workunit.client.0.smithi037.stdout: "index_pool": "" 2024-09-12T17:20:10.764 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.765 INFO:tasks.workunit.client.0.smithi037.stdout: }, 2024-09-12T17:20:10.765 INFO:tasks.workunit.client.0.smithi037.stdout: "key": { 2024-09-12T17:20:10.765 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "_obj", 2024-09-12T17:20:10.765 INFO:tasks.workunit.client.0.smithi037.stdout: "instance": "", 2024-09-12T17:20:10.765 INFO:tasks.workunit.client.0.smithi037.stdout: "ns": "" 2024-09-12T17:20:10.765 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.765 INFO:tasks.workunit.client.0.smithi037.stdout: }, 2024-09-12T17:20:10.765 INFO:tasks.workunit.client.0.smithi037.stdout: "obj3-2": { 2024-09-12T17:20:10.765 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket": { 2024-09-12T17:20:10.765 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "test", 2024-09-12T17:20:10.765 INFO:tasks.workunit.client.0.smithi037.stdout: "marker": "marker", 2024-09-12T17:20:10.765 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:10.765 INFO:tasks.workunit.client.0.smithi037.stdout: "tenant": "", 2024-09-12T17:20:10.765 INFO:tasks.workunit.client.0.smithi037.stdout: "explicit_placement": { 2024-09-12T17:20:10.766 INFO:tasks.workunit.client.0.smithi037.stdout: "data_pool": "", 2024-09-12T17:20:10.766 INFO:tasks.workunit.client.0.smithi037.stdout: "data_extra_pool": "", 2024-09-12T17:20:10.766 INFO:tasks.workunit.client.0.smithi037.stdout: "index_pool": "" 2024-09-12T17:20:10.766 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.766 INFO:tasks.workunit.client.0.smithi037.stdout: }, 2024-09-12T17:20:10.766 INFO:tasks.workunit.client.0.smithi037.stdout: "key": { 2024-09-12T17:20:10.766 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "_obj", 2024-09-12T17:20:10.766 INFO:tasks.workunit.client.0.smithi037.stdout: "instance": "", 2024-09-12T17:20:10.766 INFO:tasks.workunit.client.0.smithi037.stdout: "ns": "ns" 2024-09-12T17:20:10.766 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.766 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.766 INFO:tasks.workunit.client.0.smithi037.stdout:} 2024-09-12T17:20:10.766 INFO:tasks.workunit.client.0.smithi037.stdout:parsed: _obj[v1] 2024-09-12T17:20:10.766 INFO:tasks.workunit.client.0.smithi037.stdout:parsed: _obj[v1] 2024-09-12T17:20:10.767 INFO:tasks.workunit.client.0.smithi037.stdout:stripped: _obj ns= i=v1 2024-09-12T17:20:10.767 INFO:tasks.workunit.client.0.smithi037.stdout:parsed: _obj[v1] 2024-09-12T17:20:10.767 INFO:tasks.workunit.client.0.smithi037.stdout:parsed: _obj[v1] 2024-09-12T17:20:10.767 INFO:tasks.workunit.client.0.smithi037.stdout:stripped: _obj ns= i=v1 2024-09-12T17:20:10.767 INFO:tasks.workunit.client.0.smithi037.stdout:parsed: _obj[v1] 2024-09-12T17:20:10.767 INFO:tasks.workunit.client.0.smithi037.stdout:parsed: _obj[v1] 2024-09-12T17:20:10.767 INFO:tasks.workunit.client.0.smithi037.stdout:stripped: _obj ns= i=v1 2024-09-12T17:20:10.767 INFO:tasks.workunit.client.0.smithi037.stdout:{ 2024-09-12T17:20:10.767 INFO:tasks.workunit.client.0.smithi037.stdout: "obj1": { 2024-09-12T17:20:10.767 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket": { 2024-09-12T17:20:10.767 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "test", 2024-09-12T17:20:10.767 INFO:tasks.workunit.client.0.smithi037.stdout: "marker": "marker", 2024-09-12T17:20:10.767 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:10.767 INFO:tasks.workunit.client.0.smithi037.stdout: "tenant": "", 2024-09-12T17:20:10.767 INFO:tasks.workunit.client.0.smithi037.stdout: "explicit_placement": { 2024-09-12T17:20:10.768 INFO:tasks.workunit.client.0.smithi037.stdout: "data_pool": "", 2024-09-12T17:20:10.768 INFO:tasks.workunit.client.0.smithi037.stdout: "data_extra_pool": "", 2024-09-12T17:20:10.768 INFO:tasks.workunit.client.0.smithi037.stdout: "index_pool": "" 2024-09-12T17:20:10.768 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.768 INFO:tasks.workunit.client.0.smithi037.stdout: }, 2024-09-12T17:20:10.768 INFO:tasks.workunit.client.0.smithi037.stdout: "key": { 2024-09-12T17:20:10.768 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "_obj", 2024-09-12T17:20:10.768 INFO:tasks.workunit.client.0.smithi037.stdout: "instance": "v1", 2024-09-12T17:20:10.768 INFO:tasks.workunit.client.0.smithi037.stdout: "ns": "" 2024-09-12T17:20:10.768 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.768 INFO:tasks.workunit.client.0.smithi037.stdout: }, 2024-09-12T17:20:10.768 INFO:tasks.workunit.client.0.smithi037.stdout: "obj2": { 2024-09-12T17:20:10.768 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket": { 2024-09-12T17:20:10.769 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "test", 2024-09-12T17:20:10.769 INFO:tasks.workunit.client.0.smithi037.stdout: "marker": "marker", 2024-09-12T17:20:10.769 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:10.769 INFO:tasks.workunit.client.0.smithi037.stdout: "tenant": "", 2024-09-12T17:20:10.769 INFO:tasks.workunit.client.0.smithi037.stdout: "explicit_placement": { 2024-09-12T17:20:10.769 INFO:tasks.workunit.client.0.smithi037.stdout: "data_pool": "", 2024-09-12T17:20:10.769 INFO:tasks.workunit.client.0.smithi037.stdout: "data_extra_pool": "", 2024-09-12T17:20:10.769 INFO:tasks.workunit.client.0.smithi037.stdout: "index_pool": "" 2024-09-12T17:20:10.769 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.769 INFO:tasks.workunit.client.0.smithi037.stdout: }, 2024-09-12T17:20:10.769 INFO:tasks.workunit.client.0.smithi037.stdout: "key": { 2024-09-12T17:20:10.769 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "_obj", 2024-09-12T17:20:10.770 INFO:tasks.workunit.client.0.smithi037.stdout: "instance": "v1", 2024-09-12T17:20:10.770 INFO:tasks.workunit.client.0.smithi037.stdout: "ns": "" 2024-09-12T17:20:10.770 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.770 INFO:tasks.workunit.client.0.smithi037.stdout: }, 2024-09-12T17:20:10.770 INFO:tasks.workunit.client.0.smithi037.stdout: "obj3": { 2024-09-12T17:20:10.770 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket": { 2024-09-12T17:20:10.770 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "test", 2024-09-12T17:20:10.770 INFO:tasks.workunit.client.0.smithi037.stdout: "marker": "marker", 2024-09-12T17:20:10.770 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:10.770 INFO:tasks.workunit.client.0.smithi037.stdout: "tenant": "", 2024-09-12T17:20:10.770 INFO:tasks.workunit.client.0.smithi037.stdout: "explicit_placement": { 2024-09-12T17:20:10.770 INFO:tasks.workunit.client.0.smithi037.stdout: "data_pool": "", 2024-09-12T17:20:10.771 INFO:tasks.workunit.client.0.smithi037.stdout: "data_extra_pool": "", 2024-09-12T17:20:10.771 INFO:tasks.workunit.client.0.smithi037.stdout: "index_pool": "" 2024-09-12T17:20:10.771 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.771 INFO:tasks.workunit.client.0.smithi037.stdout: }, 2024-09-12T17:20:10.771 INFO:tasks.workunit.client.0.smithi037.stdout: "key": { 2024-09-12T17:20:10.771 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "_obj", 2024-09-12T17:20:10.771 INFO:tasks.workunit.client.0.smithi037.stdout: "instance": "", 2024-09-12T17:20:10.771 INFO:tasks.workunit.client.0.smithi037.stdout: "ns": "" 2024-09-12T17:20:10.771 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.771 INFO:tasks.workunit.client.0.smithi037.stdout: }, 2024-09-12T17:20:10.771 INFO:tasks.workunit.client.0.smithi037.stdout: "obj3-2": { 2024-09-12T17:20:10.771 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket": { 2024-09-12T17:20:10.771 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "test", 2024-09-12T17:20:10.771 INFO:tasks.workunit.client.0.smithi037.stdout: "marker": "marker", 2024-09-12T17:20:10.771 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:10.772 INFO:tasks.workunit.client.0.smithi037.stdout: "tenant": "", 2024-09-12T17:20:10.772 INFO:tasks.workunit.client.0.smithi037.stdout: "explicit_placement": { 2024-09-12T17:20:10.772 INFO:tasks.workunit.client.0.smithi037.stdout: "data_pool": "", 2024-09-12T17:20:10.772 INFO:tasks.workunit.client.0.smithi037.stdout: "data_extra_pool": "", 2024-09-12T17:20:10.772 INFO:tasks.workunit.client.0.smithi037.stdout: "index_pool": "" 2024-09-12T17:20:10.772 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.772 INFO:tasks.workunit.client.0.smithi037.stdout: }, 2024-09-12T17:20:10.772 INFO:tasks.workunit.client.0.smithi037.stdout: "key": { 2024-09-12T17:20:10.772 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "_obj", 2024-09-12T17:20:10.772 INFO:tasks.workunit.client.0.smithi037.stdout: "instance": "v1", 2024-09-12T17:20:10.772 INFO:tasks.workunit.client.0.smithi037.stdout: "ns": "" 2024-09-12T17:20:10.772 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.772 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.772 INFO:tasks.workunit.client.0.smithi037.stdout:} 2024-09-12T17:20:10.772 INFO:tasks.workunit.client.0.smithi037.stdout:parsed: _obj[v1] 2024-09-12T17:20:10.773 INFO:tasks.workunit.client.0.smithi037.stdout:parsed: _obj[v1] 2024-09-12T17:20:10.773 INFO:tasks.workunit.client.0.smithi037.stdout:stripped: _obj ns=ns i=v1 2024-09-12T17:20:10.773 INFO:tasks.workunit.client.0.smithi037.stdout:parsed: _obj[v1] 2024-09-12T17:20:10.773 INFO:tasks.workunit.client.0.smithi037.stdout:parsed: _obj[v1] 2024-09-12T17:20:10.773 INFO:tasks.workunit.client.0.smithi037.stdout:stripped: _obj ns=ns i=v1 2024-09-12T17:20:10.773 INFO:tasks.workunit.client.0.smithi037.stdout:parsed: _obj[v1] 2024-09-12T17:20:10.773 INFO:tasks.workunit.client.0.smithi037.stdout:parsed: _obj[v1] 2024-09-12T17:20:10.773 INFO:tasks.workunit.client.0.smithi037.stdout:stripped: _obj ns=ns i=v1 2024-09-12T17:20:10.773 INFO:tasks.workunit.client.0.smithi037.stdout:{ 2024-09-12T17:20:10.773 INFO:tasks.workunit.client.0.smithi037.stdout: "obj1": { 2024-09-12T17:20:10.773 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket": { 2024-09-12T17:20:10.773 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "test", 2024-09-12T17:20:10.774 INFO:tasks.workunit.client.0.smithi037.stdout: "marker": "marker", 2024-09-12T17:20:10.774 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:10.774 INFO:tasks.workunit.client.0.smithi037.stdout: "tenant": "", 2024-09-12T17:20:10.774 INFO:tasks.workunit.client.0.smithi037.stdout: "explicit_placement": { 2024-09-12T17:20:10.774 INFO:tasks.workunit.client.0.smithi037.stdout: "data_pool": "", 2024-09-12T17:20:10.774 INFO:tasks.workunit.client.0.smithi037.stdout: "data_extra_pool": "", 2024-09-12T17:20:10.774 INFO:tasks.workunit.client.0.smithi037.stdout: "index_pool": "" 2024-09-12T17:20:10.774 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.774 INFO:tasks.workunit.client.0.smithi037.stdout: }, 2024-09-12T17:20:10.774 INFO:tasks.workunit.client.0.smithi037.stdout: "key": { 2024-09-12T17:20:10.774 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "_obj", 2024-09-12T17:20:10.774 INFO:tasks.workunit.client.0.smithi037.stdout: "instance": "v1", 2024-09-12T17:20:10.774 INFO:tasks.workunit.client.0.smithi037.stdout: "ns": "ns" 2024-09-12T17:20:10.774 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.775 INFO:tasks.workunit.client.0.smithi037.stdout: }, 2024-09-12T17:20:10.775 INFO:tasks.workunit.client.0.smithi037.stdout: "obj2": { 2024-09-12T17:20:10.775 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket": { 2024-09-12T17:20:10.775 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "test", 2024-09-12T17:20:10.775 INFO:tasks.workunit.client.0.smithi037.stdout: "marker": "marker", 2024-09-12T17:20:10.775 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:10.775 INFO:tasks.workunit.client.0.smithi037.stdout: "tenant": "", 2024-09-12T17:20:10.775 INFO:tasks.workunit.client.0.smithi037.stdout: "explicit_placement": { 2024-09-12T17:20:10.775 INFO:tasks.workunit.client.0.smithi037.stdout: "data_pool": "", 2024-09-12T17:20:10.775 INFO:tasks.workunit.client.0.smithi037.stdout: "data_extra_pool": "", 2024-09-12T17:20:10.775 INFO:tasks.workunit.client.0.smithi037.stdout: "index_pool": "" 2024-09-12T17:20:10.775 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.775 INFO:tasks.workunit.client.0.smithi037.stdout: }, 2024-09-12T17:20:10.775 INFO:tasks.workunit.client.0.smithi037.stdout: "key": { 2024-09-12T17:20:10.775 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "_obj", 2024-09-12T17:20:10.776 INFO:tasks.workunit.client.0.smithi037.stdout: "instance": "v1", 2024-09-12T17:20:10.776 INFO:tasks.workunit.client.0.smithi037.stdout: "ns": "ns" 2024-09-12T17:20:10.776 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.776 INFO:tasks.workunit.client.0.smithi037.stdout: }, 2024-09-12T17:20:10.776 INFO:tasks.workunit.client.0.smithi037.stdout: "obj3": { 2024-09-12T17:20:10.776 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket": { 2024-09-12T17:20:10.776 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "test", 2024-09-12T17:20:10.776 INFO:tasks.workunit.client.0.smithi037.stdout: "marker": "marker", 2024-09-12T17:20:10.776 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:10.776 INFO:tasks.workunit.client.0.smithi037.stdout: "tenant": "", 2024-09-12T17:20:10.776 INFO:tasks.workunit.client.0.smithi037.stdout: "explicit_placement": { 2024-09-12T17:20:10.776 INFO:tasks.workunit.client.0.smithi037.stdout: "data_pool": "", 2024-09-12T17:20:10.776 INFO:tasks.workunit.client.0.smithi037.stdout: "data_extra_pool": "", 2024-09-12T17:20:10.777 INFO:tasks.workunit.client.0.smithi037.stdout: "index_pool": "" 2024-09-12T17:20:10.777 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.777 INFO:tasks.workunit.client.0.smithi037.stdout: }, 2024-09-12T17:20:10.777 INFO:tasks.workunit.client.0.smithi037.stdout: "key": { 2024-09-12T17:20:10.777 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "_obj", 2024-09-12T17:20:10.777 INFO:tasks.workunit.client.0.smithi037.stdout: "instance": "", 2024-09-12T17:20:10.777 INFO:tasks.workunit.client.0.smithi037.stdout: "ns": "" 2024-09-12T17:20:10.777 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.777 INFO:tasks.workunit.client.0.smithi037.stdout: }, 2024-09-12T17:20:10.777 INFO:tasks.workunit.client.0.smithi037.stdout: "obj3-2": { 2024-09-12T17:20:10.777 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket": { 2024-09-12T17:20:10.777 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "test", 2024-09-12T17:20:10.777 INFO:tasks.workunit.client.0.smithi037.stdout: "marker": "marker", 2024-09-12T17:20:10.777 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:10.778 INFO:tasks.workunit.client.0.smithi037.stdout: "tenant": "", 2024-09-12T17:20:10.778 INFO:tasks.workunit.client.0.smithi037.stdout: "explicit_placement": { 2024-09-12T17:20:10.778 INFO:tasks.workunit.client.0.smithi037.stdout: "data_pool": "", 2024-09-12T17:20:10.778 INFO:tasks.workunit.client.0.smithi037.stdout: "data_extra_pool": "", 2024-09-12T17:20:10.778 INFO:tasks.workunit.client.0.smithi037.stdout: "index_pool": "" 2024-09-12T17:20:10.778 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.778 INFO:tasks.workunit.client.0.smithi037.stdout: }, 2024-09-12T17:20:10.778 INFO:tasks.workunit.client.0.smithi037.stdout: "key": { 2024-09-12T17:20:10.778 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "_obj", 2024-09-12T17:20:10.778 INFO:tasks.workunit.client.0.smithi037.stdout: "instance": "v1", 2024-09-12T17:20:10.778 INFO:tasks.workunit.client.0.smithi037.stdout: "ns": "ns" 2024-09-12T17:20:10.778 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.778 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.778 INFO:tasks.workunit.client.0.smithi037.stdout:} 2024-09-12T17:20:10.778 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] TestRGWObj.underscore (0 ms) 2024-09-12T17:20:10.779 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] TestRGWObj.no_underscore 2024-09-12T17:20:10.779 INFO:tasks.workunit.client.0.smithi037.stdout:parsed: obj 2024-09-12T17:20:10.779 INFO:tasks.workunit.client.0.smithi037.stdout:parsed: obj 2024-09-12T17:20:10.779 INFO:tasks.workunit.client.0.smithi037.stdout:stripped: obj ns= i= 2024-09-12T17:20:10.779 INFO:tasks.workunit.client.0.smithi037.stdout:parsed: obj 2024-09-12T17:20:10.779 INFO:tasks.workunit.client.0.smithi037.stdout:parsed: obj 2024-09-12T17:20:10.779 INFO:tasks.workunit.client.0.smithi037.stdout:stripped: obj ns= i= 2024-09-12T17:20:10.779 INFO:tasks.workunit.client.0.smithi037.stdout:parsed: obj 2024-09-12T17:20:10.779 INFO:tasks.workunit.client.0.smithi037.stdout:parsed: obj 2024-09-12T17:20:10.779 INFO:tasks.workunit.client.0.smithi037.stdout:stripped: obj ns= i= 2024-09-12T17:20:10.779 INFO:tasks.workunit.client.0.smithi037.stdout:{ 2024-09-12T17:20:10.779 INFO:tasks.workunit.client.0.smithi037.stdout: "obj1": { 2024-09-12T17:20:10.779 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket": { 2024-09-12T17:20:10.780 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "test", 2024-09-12T17:20:10.780 INFO:tasks.workunit.client.0.smithi037.stdout: "marker": "marker", 2024-09-12T17:20:10.780 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:10.780 INFO:tasks.workunit.client.0.smithi037.stdout: "tenant": "", 2024-09-12T17:20:10.780 INFO:tasks.workunit.client.0.smithi037.stdout: "explicit_placement": { 2024-09-12T17:20:10.780 INFO:tasks.workunit.client.0.smithi037.stdout: "data_pool": "", 2024-09-12T17:20:10.780 INFO:tasks.workunit.client.0.smithi037.stdout: "data_extra_pool": "", 2024-09-12T17:20:10.780 INFO:tasks.workunit.client.0.smithi037.stdout: "index_pool": "" 2024-09-12T17:20:10.780 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.780 INFO:tasks.workunit.client.0.smithi037.stdout: }, 2024-09-12T17:20:10.780 INFO:tasks.workunit.client.0.smithi037.stdout: "key": { 2024-09-12T17:20:10.780 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "obj", 2024-09-12T17:20:10.780 INFO:tasks.workunit.client.0.smithi037.stdout: "instance": "", 2024-09-12T17:20:10.781 INFO:tasks.workunit.client.0.smithi037.stdout: "ns": "" 2024-09-12T17:20:10.781 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.781 INFO:tasks.workunit.client.0.smithi037.stdout: }, 2024-09-12T17:20:10.781 INFO:tasks.workunit.client.0.smithi037.stdout: "obj2": { 2024-09-12T17:20:10.781 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket": { 2024-09-12T17:20:10.781 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "test", 2024-09-12T17:20:10.781 INFO:tasks.workunit.client.0.smithi037.stdout: "marker": "marker", 2024-09-12T17:20:10.781 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:10.781 INFO:tasks.workunit.client.0.smithi037.stdout: "tenant": "", 2024-09-12T17:20:10.781 INFO:tasks.workunit.client.0.smithi037.stdout: "explicit_placement": { 2024-09-12T17:20:10.781 INFO:tasks.workunit.client.0.smithi037.stdout: "data_pool": "", 2024-09-12T17:20:10.781 INFO:tasks.workunit.client.0.smithi037.stdout: "data_extra_pool": "", 2024-09-12T17:20:10.781 INFO:tasks.workunit.client.0.smithi037.stdout: "index_pool": "" 2024-09-12T17:20:10.781 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.782 INFO:tasks.workunit.client.0.smithi037.stdout: }, 2024-09-12T17:20:10.782 INFO:tasks.workunit.client.0.smithi037.stdout: "key": { 2024-09-12T17:20:10.782 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "obj", 2024-09-12T17:20:10.782 INFO:tasks.workunit.client.0.smithi037.stdout: "instance": "", 2024-09-12T17:20:10.782 INFO:tasks.workunit.client.0.smithi037.stdout: "ns": "" 2024-09-12T17:20:10.782 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.782 INFO:tasks.workunit.client.0.smithi037.stdout: }, 2024-09-12T17:20:10.782 INFO:tasks.workunit.client.0.smithi037.stdout: "obj3": { 2024-09-12T17:20:10.782 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket": { 2024-09-12T17:20:10.782 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "test", 2024-09-12T17:20:10.782 INFO:tasks.workunit.client.0.smithi037.stdout: "marker": "marker", 2024-09-12T17:20:10.782 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:10.782 INFO:tasks.workunit.client.0.smithi037.stdout: "tenant": "", 2024-09-12T17:20:10.783 INFO:tasks.workunit.client.0.smithi037.stdout: "explicit_placement": { 2024-09-12T17:20:10.783 INFO:tasks.workunit.client.0.smithi037.stdout: "data_pool": "", 2024-09-12T17:20:10.783 INFO:tasks.workunit.client.0.smithi037.stdout: "data_extra_pool": "", 2024-09-12T17:20:10.783 INFO:tasks.workunit.client.0.smithi037.stdout: "index_pool": "" 2024-09-12T17:20:10.783 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.783 INFO:tasks.workunit.client.0.smithi037.stdout: }, 2024-09-12T17:20:10.783 INFO:tasks.workunit.client.0.smithi037.stdout: "key": { 2024-09-12T17:20:10.783 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "obj", 2024-09-12T17:20:10.783 INFO:tasks.workunit.client.0.smithi037.stdout: "instance": "", 2024-09-12T17:20:10.783 INFO:tasks.workunit.client.0.smithi037.stdout: "ns": "" 2024-09-12T17:20:10.783 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.783 INFO:tasks.workunit.client.0.smithi037.stdout: }, 2024-09-12T17:20:10.783 INFO:tasks.workunit.client.0.smithi037.stdout: "obj3-2": { 2024-09-12T17:20:10.783 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket": { 2024-09-12T17:20:10.784 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "test", 2024-09-12T17:20:10.784 INFO:tasks.workunit.client.0.smithi037.stdout: "marker": "marker", 2024-09-12T17:20:10.784 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:10.784 INFO:tasks.workunit.client.0.smithi037.stdout: "tenant": "", 2024-09-12T17:20:10.784 INFO:tasks.workunit.client.0.smithi037.stdout: "explicit_placement": { 2024-09-12T17:20:10.784 INFO:tasks.workunit.client.0.smithi037.stdout: "data_pool": "", 2024-09-12T17:20:10.784 INFO:tasks.workunit.client.0.smithi037.stdout: "data_extra_pool": "", 2024-09-12T17:20:10.784 INFO:tasks.workunit.client.0.smithi037.stdout: "index_pool": "" 2024-09-12T17:20:10.784 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.784 INFO:tasks.workunit.client.0.smithi037.stdout: }, 2024-09-12T17:20:10.784 INFO:tasks.workunit.client.0.smithi037.stdout: "key": { 2024-09-12T17:20:10.784 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "obj", 2024-09-12T17:20:10.784 INFO:tasks.workunit.client.0.smithi037.stdout: "instance": "", 2024-09-12T17:20:10.785 INFO:tasks.workunit.client.0.smithi037.stdout: "ns": "" 2024-09-12T17:20:10.785 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.785 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.785 INFO:tasks.workunit.client.0.smithi037.stdout:} 2024-09-12T17:20:10.785 INFO:tasks.workunit.client.0.smithi037.stdout:parsed: obj 2024-09-12T17:20:10.785 INFO:tasks.workunit.client.0.smithi037.stdout:parsed: obj 2024-09-12T17:20:10.785 INFO:tasks.workunit.client.0.smithi037.stdout:stripped: obj ns=ns i= 2024-09-12T17:20:10.785 INFO:tasks.workunit.client.0.smithi037.stdout:parsed: obj 2024-09-12T17:20:10.785 INFO:tasks.workunit.client.0.smithi037.stdout:parsed: obj 2024-09-12T17:20:10.785 INFO:tasks.workunit.client.0.smithi037.stdout:stripped: obj ns=ns i= 2024-09-12T17:20:10.785 INFO:tasks.workunit.client.0.smithi037.stdout:parsed: obj 2024-09-12T17:20:10.785 INFO:tasks.workunit.client.0.smithi037.stdout:parsed: obj 2024-09-12T17:20:10.785 INFO:tasks.workunit.client.0.smithi037.stdout:stripped: obj ns=ns i= 2024-09-12T17:20:10.785 INFO:tasks.workunit.client.0.smithi037.stdout:{ 2024-09-12T17:20:10.786 INFO:tasks.workunit.client.0.smithi037.stdout: "obj1": { 2024-09-12T17:20:10.786 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket": { 2024-09-12T17:20:10.786 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "test", 2024-09-12T17:20:10.786 INFO:tasks.workunit.client.0.smithi037.stdout: "marker": "marker", 2024-09-12T17:20:10.786 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:10.786 INFO:tasks.workunit.client.0.smithi037.stdout: "tenant": "", 2024-09-12T17:20:10.786 INFO:tasks.workunit.client.0.smithi037.stdout: "explicit_placement": { 2024-09-12T17:20:10.786 INFO:tasks.workunit.client.0.smithi037.stdout: "data_pool": "", 2024-09-12T17:20:10.786 INFO:tasks.workunit.client.0.smithi037.stdout: "data_extra_pool": "", 2024-09-12T17:20:10.786 INFO:tasks.workunit.client.0.smithi037.stdout: "index_pool": "" 2024-09-12T17:20:10.786 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.786 INFO:tasks.workunit.client.0.smithi037.stdout: }, 2024-09-12T17:20:10.786 INFO:tasks.workunit.client.0.smithi037.stdout: "key": { 2024-09-12T17:20:10.786 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "obj", 2024-09-12T17:20:10.787 INFO:tasks.workunit.client.0.smithi037.stdout: "instance": "", 2024-09-12T17:20:10.787 INFO:tasks.workunit.client.0.smithi037.stdout: "ns": "ns" 2024-09-12T17:20:10.787 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.787 INFO:tasks.workunit.client.0.smithi037.stdout: }, 2024-09-12T17:20:10.787 INFO:tasks.workunit.client.0.smithi037.stdout: "obj2": { 2024-09-12T17:20:10.787 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket": { 2024-09-12T17:20:10.787 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "test", 2024-09-12T17:20:10.787 INFO:tasks.workunit.client.0.smithi037.stdout: "marker": "marker", 2024-09-12T17:20:10.787 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:10.787 INFO:tasks.workunit.client.0.smithi037.stdout: "tenant": "", 2024-09-12T17:20:10.787 INFO:tasks.workunit.client.0.smithi037.stdout: "explicit_placement": { 2024-09-12T17:20:10.787 INFO:tasks.workunit.client.0.smithi037.stdout: "data_pool": "", 2024-09-12T17:20:10.787 INFO:tasks.workunit.client.0.smithi037.stdout: "data_extra_pool": "", 2024-09-12T17:20:10.787 INFO:tasks.workunit.client.0.smithi037.stdout: "index_pool": "" 2024-09-12T17:20:10.787 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.788 INFO:tasks.workunit.client.0.smithi037.stdout: }, 2024-09-12T17:20:10.788 INFO:tasks.workunit.client.0.smithi037.stdout: "key": { 2024-09-12T17:20:10.788 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "obj", 2024-09-12T17:20:10.788 INFO:tasks.workunit.client.0.smithi037.stdout: "instance": "", 2024-09-12T17:20:10.788 INFO:tasks.workunit.client.0.smithi037.stdout: "ns": "ns" 2024-09-12T17:20:10.788 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.788 INFO:tasks.workunit.client.0.smithi037.stdout: }, 2024-09-12T17:20:10.788 INFO:tasks.workunit.client.0.smithi037.stdout: "obj3": { 2024-09-12T17:20:10.788 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket": { 2024-09-12T17:20:10.788 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "test", 2024-09-12T17:20:10.788 INFO:tasks.workunit.client.0.smithi037.stdout: "marker": "marker", 2024-09-12T17:20:10.788 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:10.788 INFO:tasks.workunit.client.0.smithi037.stdout: "tenant": "", 2024-09-12T17:20:10.789 INFO:tasks.workunit.client.0.smithi037.stdout: "explicit_placement": { 2024-09-12T17:20:10.789 INFO:tasks.workunit.client.0.smithi037.stdout: "data_pool": "", 2024-09-12T17:20:10.789 INFO:tasks.workunit.client.0.smithi037.stdout: "data_extra_pool": "", 2024-09-12T17:20:10.789 INFO:tasks.workunit.client.0.smithi037.stdout: "index_pool": "" 2024-09-12T17:20:10.789 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.789 INFO:tasks.workunit.client.0.smithi037.stdout: }, 2024-09-12T17:20:10.789 INFO:tasks.workunit.client.0.smithi037.stdout: "key": { 2024-09-12T17:20:10.789 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "obj", 2024-09-12T17:20:10.789 INFO:tasks.workunit.client.0.smithi037.stdout: "instance": "", 2024-09-12T17:20:10.789 INFO:tasks.workunit.client.0.smithi037.stdout: "ns": "" 2024-09-12T17:20:10.789 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.789 INFO:tasks.workunit.client.0.smithi037.stdout: }, 2024-09-12T17:20:10.789 INFO:tasks.workunit.client.0.smithi037.stdout: "obj3-2": { 2024-09-12T17:20:10.789 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket": { 2024-09-12T17:20:10.790 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "test", 2024-09-12T17:20:10.790 INFO:tasks.workunit.client.0.smithi037.stdout: "marker": "marker", 2024-09-12T17:20:10.790 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:10.790 INFO:tasks.workunit.client.0.smithi037.stdout: "tenant": "", 2024-09-12T17:20:10.790 INFO:tasks.workunit.client.0.smithi037.stdout: "explicit_placement": { 2024-09-12T17:20:10.790 INFO:tasks.workunit.client.0.smithi037.stdout: "data_pool": "", 2024-09-12T17:20:10.790 INFO:tasks.workunit.client.0.smithi037.stdout: "data_extra_pool": "", 2024-09-12T17:20:10.790 INFO:tasks.workunit.client.0.smithi037.stdout: "index_pool": "" 2024-09-12T17:20:10.790 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.790 INFO:tasks.workunit.client.0.smithi037.stdout: }, 2024-09-12T17:20:10.790 INFO:tasks.workunit.client.0.smithi037.stdout: "key": { 2024-09-12T17:20:10.790 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "obj", 2024-09-12T17:20:10.790 INFO:tasks.workunit.client.0.smithi037.stdout: "instance": "", 2024-09-12T17:20:10.790 INFO:tasks.workunit.client.0.smithi037.stdout: "ns": "ns" 2024-09-12T17:20:10.791 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.791 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.791 INFO:tasks.workunit.client.0.smithi037.stdout:} 2024-09-12T17:20:10.791 INFO:tasks.workunit.client.0.smithi037.stdout:parsed: obj[v1] 2024-09-12T17:20:10.791 INFO:tasks.workunit.client.0.smithi037.stdout:parsed: obj[v1] 2024-09-12T17:20:10.791 INFO:tasks.workunit.client.0.smithi037.stdout:stripped: obj ns= i=v1 2024-09-12T17:20:10.791 INFO:tasks.workunit.client.0.smithi037.stdout:parsed: obj[v1] 2024-09-12T17:20:10.791 INFO:tasks.workunit.client.0.smithi037.stdout:parsed: obj[v1] 2024-09-12T17:20:10.791 INFO:tasks.workunit.client.0.smithi037.stdout:stripped: obj ns= i=v1 2024-09-12T17:20:10.791 INFO:tasks.workunit.client.0.smithi037.stdout:parsed: obj[v1] 2024-09-12T17:20:10.791 INFO:tasks.workunit.client.0.smithi037.stdout:parsed: obj[v1] 2024-09-12T17:20:10.791 INFO:tasks.workunit.client.0.smithi037.stdout:stripped: obj ns= i=v1 2024-09-12T17:20:10.791 INFO:tasks.workunit.client.0.smithi037.stdout:{ 2024-09-12T17:20:10.791 INFO:tasks.workunit.client.0.smithi037.stdout: "obj1": { 2024-09-12T17:20:10.792 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket": { 2024-09-12T17:20:10.792 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "test", 2024-09-12T17:20:10.792 INFO:tasks.workunit.client.0.smithi037.stdout: "marker": "marker", 2024-09-12T17:20:10.792 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:10.792 INFO:tasks.workunit.client.0.smithi037.stdout: "tenant": "", 2024-09-12T17:20:10.792 INFO:tasks.workunit.client.0.smithi037.stdout: "explicit_placement": { 2024-09-12T17:20:10.792 INFO:tasks.workunit.client.0.smithi037.stdout: "data_pool": "", 2024-09-12T17:20:10.792 INFO:tasks.workunit.client.0.smithi037.stdout: "data_extra_pool": "", 2024-09-12T17:20:10.792 INFO:tasks.workunit.client.0.smithi037.stdout: "index_pool": "" 2024-09-12T17:20:10.792 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.792 INFO:tasks.workunit.client.0.smithi037.stdout: }, 2024-09-12T17:20:10.792 INFO:tasks.workunit.client.0.smithi037.stdout: "key": { 2024-09-12T17:20:10.792 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "obj", 2024-09-12T17:20:10.793 INFO:tasks.workunit.client.0.smithi037.stdout: "instance": "v1", 2024-09-12T17:20:10.793 INFO:tasks.workunit.client.0.smithi037.stdout: "ns": "" 2024-09-12T17:20:10.793 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.793 INFO:tasks.workunit.client.0.smithi037.stdout: }, 2024-09-12T17:20:10.793 INFO:tasks.workunit.client.0.smithi037.stdout: "obj2": { 2024-09-12T17:20:10.793 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket": { 2024-09-12T17:20:10.793 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "test", 2024-09-12T17:20:10.793 INFO:tasks.workunit.client.0.smithi037.stdout: "marker": "marker", 2024-09-12T17:20:10.793 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:10.793 INFO:tasks.workunit.client.0.smithi037.stdout: "tenant": "", 2024-09-12T17:20:10.793 INFO:tasks.workunit.client.0.smithi037.stdout: "explicit_placement": { 2024-09-12T17:20:10.793 INFO:tasks.workunit.client.0.smithi037.stdout: "data_pool": "", 2024-09-12T17:20:10.793 INFO:tasks.workunit.client.0.smithi037.stdout: "data_extra_pool": "", 2024-09-12T17:20:10.793 INFO:tasks.workunit.client.0.smithi037.stdout: "index_pool": "" 2024-09-12T17:20:10.793 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.794 INFO:tasks.workunit.client.0.smithi037.stdout: }, 2024-09-12T17:20:10.794 INFO:tasks.workunit.client.0.smithi037.stdout: "key": { 2024-09-12T17:20:10.794 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "obj", 2024-09-12T17:20:10.794 INFO:tasks.workunit.client.0.smithi037.stdout: "instance": "v1", 2024-09-12T17:20:10.794 INFO:tasks.workunit.client.0.smithi037.stdout: "ns": "" 2024-09-12T17:20:10.794 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.794 INFO:tasks.workunit.client.0.smithi037.stdout: }, 2024-09-12T17:20:10.794 INFO:tasks.workunit.client.0.smithi037.stdout: "obj3": { 2024-09-12T17:20:10.794 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket": { 2024-09-12T17:20:10.794 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "test", 2024-09-12T17:20:10.794 INFO:tasks.workunit.client.0.smithi037.stdout: "marker": "marker", 2024-09-12T17:20:10.794 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:10.794 INFO:tasks.workunit.client.0.smithi037.stdout: "tenant": "", 2024-09-12T17:20:10.795 INFO:tasks.workunit.client.0.smithi037.stdout: "explicit_placement": { 2024-09-12T17:20:10.795 INFO:tasks.workunit.client.0.smithi037.stdout: "data_pool": "", 2024-09-12T17:20:10.795 INFO:tasks.workunit.client.0.smithi037.stdout: "data_extra_pool": "", 2024-09-12T17:20:10.795 INFO:tasks.workunit.client.0.smithi037.stdout: "index_pool": "" 2024-09-12T17:20:10.795 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.795 INFO:tasks.workunit.client.0.smithi037.stdout: }, 2024-09-12T17:20:10.795 INFO:tasks.workunit.client.0.smithi037.stdout: "key": { 2024-09-12T17:20:10.795 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "obj", 2024-09-12T17:20:10.795 INFO:tasks.workunit.client.0.smithi037.stdout: "instance": "", 2024-09-12T17:20:10.795 INFO:tasks.workunit.client.0.smithi037.stdout: "ns": "" 2024-09-12T17:20:10.795 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.795 INFO:tasks.workunit.client.0.smithi037.stdout: }, 2024-09-12T17:20:10.795 INFO:tasks.workunit.client.0.smithi037.stdout: "obj3-2": { 2024-09-12T17:20:10.795 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket": { 2024-09-12T17:20:10.795 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "test", 2024-09-12T17:20:10.796 INFO:tasks.workunit.client.0.smithi037.stdout: "marker": "marker", 2024-09-12T17:20:10.796 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:10.796 INFO:tasks.workunit.client.0.smithi037.stdout: "tenant": "", 2024-09-12T17:20:10.796 INFO:tasks.workunit.client.0.smithi037.stdout: "explicit_placement": { 2024-09-12T17:20:10.796 INFO:tasks.workunit.client.0.smithi037.stdout: "data_pool": "", 2024-09-12T17:20:10.796 INFO:tasks.workunit.client.0.smithi037.stdout: "data_extra_pool": "", 2024-09-12T17:20:10.796 INFO:tasks.workunit.client.0.smithi037.stdout: "index_pool": "" 2024-09-12T17:20:10.796 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.796 INFO:tasks.workunit.client.0.smithi037.stdout: }, 2024-09-12T17:20:10.796 INFO:tasks.workunit.client.0.smithi037.stdout: "key": { 2024-09-12T17:20:10.796 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "obj", 2024-09-12T17:20:10.796 INFO:tasks.workunit.client.0.smithi037.stdout: "instance": "v1", 2024-09-12T17:20:10.796 INFO:tasks.workunit.client.0.smithi037.stdout: "ns": "" 2024-09-12T17:20:10.796 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.797 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.797 INFO:tasks.workunit.client.0.smithi037.stdout:} 2024-09-12T17:20:10.797 INFO:tasks.workunit.client.0.smithi037.stdout:parsed: obj[v1] 2024-09-12T17:20:10.797 INFO:tasks.workunit.client.0.smithi037.stdout:parsed: obj[v1] 2024-09-12T17:20:10.797 INFO:tasks.workunit.client.0.smithi037.stdout:stripped: obj ns=ns i=v1 2024-09-12T17:20:10.797 INFO:tasks.workunit.client.0.smithi037.stdout:parsed: obj[v1] 2024-09-12T17:20:10.797 INFO:tasks.workunit.client.0.smithi037.stdout:parsed: obj[v1] 2024-09-12T17:20:10.797 INFO:tasks.workunit.client.0.smithi037.stdout:stripped: obj ns=ns i=v1 2024-09-12T17:20:10.797 INFO:tasks.workunit.client.0.smithi037.stdout:parsed: obj[v1] 2024-09-12T17:20:10.797 INFO:tasks.workunit.client.0.smithi037.stdout:parsed: obj[v1] 2024-09-12T17:20:10.797 INFO:tasks.workunit.client.0.smithi037.stdout:stripped: obj ns=ns i=v1 2024-09-12T17:20:10.797 INFO:tasks.workunit.client.0.smithi037.stdout:{ 2024-09-12T17:20:10.797 INFO:tasks.workunit.client.0.smithi037.stdout: "obj1": { 2024-09-12T17:20:10.797 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket": { 2024-09-12T17:20:10.797 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "test", 2024-09-12T17:20:10.798 INFO:tasks.workunit.client.0.smithi037.stdout: "marker": "marker", 2024-09-12T17:20:10.798 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:10.798 INFO:tasks.workunit.client.0.smithi037.stdout: "tenant": "", 2024-09-12T17:20:10.798 INFO:tasks.workunit.client.0.smithi037.stdout: "explicit_placement": { 2024-09-12T17:20:10.798 INFO:tasks.workunit.client.0.smithi037.stdout: "data_pool": "", 2024-09-12T17:20:10.798 INFO:tasks.workunit.client.0.smithi037.stdout: "data_extra_pool": "", 2024-09-12T17:20:10.798 INFO:tasks.workunit.client.0.smithi037.stdout: "index_pool": "" 2024-09-12T17:20:10.798 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.798 INFO:tasks.workunit.client.0.smithi037.stdout: }, 2024-09-12T17:20:10.798 INFO:tasks.workunit.client.0.smithi037.stdout: "key": { 2024-09-12T17:20:10.798 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "obj", 2024-09-12T17:20:10.798 INFO:tasks.workunit.client.0.smithi037.stdout: "instance": "v1", 2024-09-12T17:20:10.798 INFO:tasks.workunit.client.0.smithi037.stdout: "ns": "ns" 2024-09-12T17:20:10.798 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.799 INFO:tasks.workunit.client.0.smithi037.stdout: }, 2024-09-12T17:20:10.799 INFO:tasks.workunit.client.0.smithi037.stdout: "obj2": { 2024-09-12T17:20:10.799 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket": { 2024-09-12T17:20:10.799 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "test", 2024-09-12T17:20:10.799 INFO:tasks.workunit.client.0.smithi037.stdout: "marker": "marker", 2024-09-12T17:20:10.799 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:10.799 INFO:tasks.workunit.client.0.smithi037.stdout: "tenant": "", 2024-09-12T17:20:10.799 INFO:tasks.workunit.client.0.smithi037.stdout: "explicit_placement": { 2024-09-12T17:20:10.799 INFO:tasks.workunit.client.0.smithi037.stdout: "data_pool": "", 2024-09-12T17:20:10.799 INFO:tasks.workunit.client.0.smithi037.stdout: "data_extra_pool": "", 2024-09-12T17:20:10.799 INFO:tasks.workunit.client.0.smithi037.stdout: "index_pool": "" 2024-09-12T17:20:10.799 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.799 INFO:tasks.workunit.client.0.smithi037.stdout: }, 2024-09-12T17:20:10.800 INFO:tasks.workunit.client.0.smithi037.stdout: "key": { 2024-09-12T17:20:10.800 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "obj", 2024-09-12T17:20:10.800 INFO:tasks.workunit.client.0.smithi037.stdout: "instance": "v1", 2024-09-12T17:20:10.800 INFO:tasks.workunit.client.0.smithi037.stdout: "ns": "ns" 2024-09-12T17:20:10.800 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.800 INFO:tasks.workunit.client.0.smithi037.stdout: }, 2024-09-12T17:20:10.800 INFO:tasks.workunit.client.0.smithi037.stdout: "obj3": { 2024-09-12T17:20:10.800 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket": { 2024-09-12T17:20:10.800 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "test", 2024-09-12T17:20:10.800 INFO:tasks.workunit.client.0.smithi037.stdout: "marker": "marker", 2024-09-12T17:20:10.800 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:10.800 INFO:tasks.workunit.client.0.smithi037.stdout: "tenant": "", 2024-09-12T17:20:10.800 INFO:tasks.workunit.client.0.smithi037.stdout: "explicit_placement": { 2024-09-12T17:20:10.800 INFO:tasks.workunit.client.0.smithi037.stdout: "data_pool": "", 2024-09-12T17:20:10.800 INFO:tasks.workunit.client.0.smithi037.stdout: "data_extra_pool": "", 2024-09-12T17:20:10.801 INFO:tasks.workunit.client.0.smithi037.stdout: "index_pool": "" 2024-09-12T17:20:10.801 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.801 INFO:tasks.workunit.client.0.smithi037.stdout: }, 2024-09-12T17:20:10.801 INFO:tasks.workunit.client.0.smithi037.stdout: "key": { 2024-09-12T17:20:10.801 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "obj", 2024-09-12T17:20:10.801 INFO:tasks.workunit.client.0.smithi037.stdout: "instance": "", 2024-09-12T17:20:10.801 INFO:tasks.workunit.client.0.smithi037.stdout: "ns": "" 2024-09-12T17:20:10.801 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.801 INFO:tasks.workunit.client.0.smithi037.stdout: }, 2024-09-12T17:20:10.801 INFO:tasks.workunit.client.0.smithi037.stdout: "obj3-2": { 2024-09-12T17:20:10.801 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket": { 2024-09-12T17:20:10.801 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "test", 2024-09-12T17:20:10.801 INFO:tasks.workunit.client.0.smithi037.stdout: "marker": "marker", 2024-09-12T17:20:10.801 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:10.802 INFO:tasks.workunit.client.0.smithi037.stdout: "tenant": "", 2024-09-12T17:20:10.802 INFO:tasks.workunit.client.0.smithi037.stdout: "explicit_placement": { 2024-09-12T17:20:10.802 INFO:tasks.workunit.client.0.smithi037.stdout: "data_pool": "", 2024-09-12T17:20:10.802 INFO:tasks.workunit.client.0.smithi037.stdout: "data_extra_pool": "", 2024-09-12T17:20:10.802 INFO:tasks.workunit.client.0.smithi037.stdout: "index_pool": "" 2024-09-12T17:20:10.802 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.802 INFO:tasks.workunit.client.0.smithi037.stdout: }, 2024-09-12T17:20:10.802 INFO:tasks.workunit.client.0.smithi037.stdout: "key": { 2024-09-12T17:20:10.802 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "obj", 2024-09-12T17:20:10.802 INFO:tasks.workunit.client.0.smithi037.stdout: "instance": "v1", 2024-09-12T17:20:10.802 INFO:tasks.workunit.client.0.smithi037.stdout: "ns": "ns" 2024-09-12T17:20:10.802 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.802 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.802 INFO:tasks.workunit.client.0.smithi037.stdout:} 2024-09-12T17:20:10.803 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] TestRGWObj.no_underscore (1 ms) 2024-09-12T17:20:10.803 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] TestRGWObj.obj_to_raw 2024-09-12T17:20:10.803 INFO:tasks.workunit.client.0.smithi037.stdout:{ 2024-09-12T17:20:10.803 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket": { 2024-09-12T17:20:10.803 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "test", 2024-09-12T17:20:10.803 INFO:tasks.workunit.client.0.smithi037.stdout: "marker": "marker", 2024-09-12T17:20:10.803 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:10.803 INFO:tasks.workunit.client.0.smithi037.stdout: "tenant": "", 2024-09-12T17:20:10.803 INFO:tasks.workunit.client.0.smithi037.stdout: "explicit_placement": { 2024-09-12T17:20:10.803 INFO:tasks.workunit.client.0.smithi037.stdout: "data_pool": "", 2024-09-12T17:20:10.803 INFO:tasks.workunit.client.0.smithi037.stdout: "data_extra_pool": "", 2024-09-12T17:20:10.803 INFO:tasks.workunit.client.0.smithi037.stdout: "index_pool": "" 2024-09-12T17:20:10.803 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.803 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.804 INFO:tasks.workunit.client.0.smithi037.stdout:} 2024-09-12T17:20:10.804 INFO:tasks.workunit.client.0.smithi037.stdout:{ 2024-09-12T17:20:10.804 INFO:tasks.workunit.client.0.smithi037.stdout: "obj": { 2024-09-12T17:20:10.804 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket": { 2024-09-12T17:20:10.804 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "test", 2024-09-12T17:20:10.804 INFO:tasks.workunit.client.0.smithi037.stdout: "marker": "marker", 2024-09-12T17:20:10.804 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:10.804 INFO:tasks.workunit.client.0.smithi037.stdout: "tenant": "", 2024-09-12T17:20:10.804 INFO:tasks.workunit.client.0.smithi037.stdout: "explicit_placement": { 2024-09-12T17:20:10.804 INFO:tasks.workunit.client.0.smithi037.stdout: "data_pool": "", 2024-09-12T17:20:10.804 INFO:tasks.workunit.client.0.smithi037.stdout: "data_extra_pool": "", 2024-09-12T17:20:10.804 INFO:tasks.workunit.client.0.smithi037.stdout: "index_pool": "" 2024-09-12T17:20:10.804 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.804 INFO:tasks.workunit.client.0.smithi037.stdout: }, 2024-09-12T17:20:10.804 INFO:tasks.workunit.client.0.smithi037.stdout: "key": { 2024-09-12T17:20:10.805 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "myobj", 2024-09-12T17:20:10.805 INFO:tasks.workunit.client.0.smithi037.stdout: "instance": "", 2024-09-12T17:20:10.805 INFO:tasks.workunit.client.0.smithi037.stdout: "ns": "" 2024-09-12T17:20:10.805 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.805 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.805 INFO:tasks.workunit.client.0.smithi037.stdout:} 2024-09-12T17:20:10.805 INFO:tasks.workunit.client.0.smithi037.stdout:{ 2024-09-12T17:20:10.805 INFO:tasks.workunit.client.0.smithi037.stdout: "raw_obj": { 2024-09-12T17:20:10.805 INFO:tasks.workunit.client.0.smithi037.stdout: "pool": "default-placement.data", 2024-09-12T17:20:10.805 INFO:tasks.workunit.client.0.smithi037.stdout: "oid": "marker_myobj", 2024-09-12T17:20:10.805 INFO:tasks.workunit.client.0.smithi037.stdout: "loc": "" 2024-09-12T17:20:10.805 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.806 INFO:tasks.workunit.client.0.smithi037.stdout:} 2024-09-12T17:20:10.806 INFO:tasks.workunit.client.0.smithi037.stdout:{ 2024-09-12T17:20:10.806 INFO:tasks.workunit.client.0.smithi037.stdout: "new_obj": { 2024-09-12T17:20:10.806 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket": { 2024-09-12T17:20:10.806 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "test", 2024-09-12T17:20:10.806 INFO:tasks.workunit.client.0.smithi037.stdout: "marker": "marker", 2024-09-12T17:20:10.806 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:10.806 INFO:tasks.workunit.client.0.smithi037.stdout: "tenant": "", 2024-09-12T17:20:10.806 INFO:tasks.workunit.client.0.smithi037.stdout: "explicit_placement": { 2024-09-12T17:20:10.806 INFO:tasks.workunit.client.0.smithi037.stdout: "data_pool": "", 2024-09-12T17:20:10.806 INFO:tasks.workunit.client.0.smithi037.stdout: "data_extra_pool": "", 2024-09-12T17:20:10.807 INFO:tasks.workunit.client.0.smithi037.stdout: "index_pool": "" 2024-09-12T17:20:10.807 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.807 INFO:tasks.workunit.client.0.smithi037.stdout: }, 2024-09-12T17:20:10.807 INFO:tasks.workunit.client.0.smithi037.stdout: "key": { 2024-09-12T17:20:10.807 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "myobj", 2024-09-12T17:20:10.807 INFO:tasks.workunit.client.0.smithi037.stdout: "instance": "", 2024-09-12T17:20:10.807 INFO:tasks.workunit.client.0.smithi037.stdout: "ns": "" 2024-09-12T17:20:10.807 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.807 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.807 INFO:tasks.workunit.client.0.smithi037.stdout:} 2024-09-12T17:20:10.807 INFO:tasks.workunit.client.0.smithi037.stdout:{ 2024-09-12T17:20:10.807 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket": { 2024-09-12T17:20:10.807 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "ebtest", 2024-09-12T17:20:10.808 INFO:tasks.workunit.client.0.smithi037.stdout: "marker": "marker", 2024-09-12T17:20:10.808 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:10.808 INFO:tasks.workunit.client.0.smithi037.stdout: "tenant": "", 2024-09-12T17:20:10.808 INFO:tasks.workunit.client.0.smithi037.stdout: "explicit_placement": { 2024-09-12T17:20:10.808 INFO:tasks.workunit.client.0.smithi037.stdout: "data_pool": ".data-pool", 2024-09-12T17:20:10.808 INFO:tasks.workunit.client.0.smithi037.stdout: "data_extra_pool": "", 2024-09-12T17:20:10.808 INFO:tasks.workunit.client.0.smithi037.stdout: "index_pool": ".index-pool" 2024-09-12T17:20:10.808 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.808 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.808 INFO:tasks.workunit.client.0.smithi037.stdout:} 2024-09-12T17:20:10.808 INFO:tasks.workunit.client.0.smithi037.stdout:{ 2024-09-12T17:20:10.808 INFO:tasks.workunit.client.0.smithi037.stdout: "obj": { 2024-09-12T17:20:10.808 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket": { 2024-09-12T17:20:10.809 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "ebtest", 2024-09-12T17:20:10.809 INFO:tasks.workunit.client.0.smithi037.stdout: "marker": "marker", 2024-09-12T17:20:10.809 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:10.809 INFO:tasks.workunit.client.0.smithi037.stdout: "tenant": "", 2024-09-12T17:20:10.809 INFO:tasks.workunit.client.0.smithi037.stdout: "explicit_placement": { 2024-09-12T17:20:10.809 INFO:tasks.workunit.client.0.smithi037.stdout: "data_pool": ".data-pool", 2024-09-12T17:20:10.809 INFO:tasks.workunit.client.0.smithi037.stdout: "data_extra_pool": "", 2024-09-12T17:20:10.809 INFO:tasks.workunit.client.0.smithi037.stdout: "index_pool": ".index-pool" 2024-09-12T17:20:10.809 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.809 INFO:tasks.workunit.client.0.smithi037.stdout: }, 2024-09-12T17:20:10.809 INFO:tasks.workunit.client.0.smithi037.stdout: "key": { 2024-09-12T17:20:10.809 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "myobj", 2024-09-12T17:20:10.809 INFO:tasks.workunit.client.0.smithi037.stdout: "instance": "", 2024-09-12T17:20:10.809 INFO:tasks.workunit.client.0.smithi037.stdout: "ns": "" 2024-09-12T17:20:10.810 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.810 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.810 INFO:tasks.workunit.client.0.smithi037.stdout:} 2024-09-12T17:20:10.810 INFO:tasks.workunit.client.0.smithi037.stdout:{ 2024-09-12T17:20:10.810 INFO:tasks.workunit.client.0.smithi037.stdout: "raw_obj": { 2024-09-12T17:20:10.810 INFO:tasks.workunit.client.0.smithi037.stdout: "pool": ".data-pool", 2024-09-12T17:20:10.810 INFO:tasks.workunit.client.0.smithi037.stdout: "oid": "marker_myobj", 2024-09-12T17:20:10.810 INFO:tasks.workunit.client.0.smithi037.stdout: "loc": "" 2024-09-12T17:20:10.810 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.810 INFO:tasks.workunit.client.0.smithi037.stdout:} 2024-09-12T17:20:10.810 INFO:tasks.workunit.client.0.smithi037.stdout:{ 2024-09-12T17:20:10.810 INFO:tasks.workunit.client.0.smithi037.stdout: "new_obj": { 2024-09-12T17:20:10.810 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket": { 2024-09-12T17:20:10.810 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "ebtest", 2024-09-12T17:20:10.810 INFO:tasks.workunit.client.0.smithi037.stdout: "marker": "marker", 2024-09-12T17:20:10.811 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:10.811 INFO:tasks.workunit.client.0.smithi037.stdout: "tenant": "", 2024-09-12T17:20:10.811 INFO:tasks.workunit.client.0.smithi037.stdout: "explicit_placement": { 2024-09-12T17:20:10.811 INFO:tasks.workunit.client.0.smithi037.stdout: "data_pool": ".data-pool", 2024-09-12T17:20:10.811 INFO:tasks.workunit.client.0.smithi037.stdout: "data_extra_pool": "", 2024-09-12T17:20:10.811 INFO:tasks.workunit.client.0.smithi037.stdout: "index_pool": ".index-pool" 2024-09-12T17:20:10.811 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.811 INFO:tasks.workunit.client.0.smithi037.stdout: }, 2024-09-12T17:20:10.811 INFO:tasks.workunit.client.0.smithi037.stdout: "key": { 2024-09-12T17:20:10.811 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "myobj", 2024-09-12T17:20:10.811 INFO:tasks.workunit.client.0.smithi037.stdout: "instance": "", 2024-09-12T17:20:10.811 INFO:tasks.workunit.client.0.smithi037.stdout: "ns": "" 2024-09-12T17:20:10.811 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.811 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.811 INFO:tasks.workunit.client.0.smithi037.stdout:} 2024-09-12T17:20:10.812 INFO:tasks.workunit.client.0.smithi037.stdout:{ 2024-09-12T17:20:10.812 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket": { 2024-09-12T17:20:10.812 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "test", 2024-09-12T17:20:10.812 INFO:tasks.workunit.client.0.smithi037.stdout: "marker": "marker", 2024-09-12T17:20:10.812 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:10.812 INFO:tasks.workunit.client.0.smithi037.stdout: "tenant": "", 2024-09-12T17:20:10.812 INFO:tasks.workunit.client.0.smithi037.stdout: "explicit_placement": { 2024-09-12T17:20:10.812 INFO:tasks.workunit.client.0.smithi037.stdout: "data_pool": "", 2024-09-12T17:20:10.812 INFO:tasks.workunit.client.0.smithi037.stdout: "data_extra_pool": "", 2024-09-12T17:20:10.812 INFO:tasks.workunit.client.0.smithi037.stdout: "index_pool": "" 2024-09-12T17:20:10.812 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.812 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.812 INFO:tasks.workunit.client.0.smithi037.stdout:} 2024-09-12T17:20:10.812 INFO:tasks.workunit.client.0.smithi037.stdout:{ 2024-09-12T17:20:10.812 INFO:tasks.workunit.client.0.smithi037.stdout: "obj": { 2024-09-12T17:20:10.813 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket": { 2024-09-12T17:20:10.813 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "test", 2024-09-12T17:20:10.813 INFO:tasks.workunit.client.0.smithi037.stdout: "marker": "marker", 2024-09-12T17:20:10.813 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:10.813 INFO:tasks.workunit.client.0.smithi037.stdout: "tenant": "", 2024-09-12T17:20:10.813 INFO:tasks.workunit.client.0.smithi037.stdout: "explicit_placement": { 2024-09-12T17:20:10.813 INFO:tasks.workunit.client.0.smithi037.stdout: "data_pool": "", 2024-09-12T17:20:10.813 INFO:tasks.workunit.client.0.smithi037.stdout: "data_extra_pool": "", 2024-09-12T17:20:10.813 INFO:tasks.workunit.client.0.smithi037.stdout: "index_pool": "" 2024-09-12T17:20:10.813 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.813 INFO:tasks.workunit.client.0.smithi037.stdout: }, 2024-09-12T17:20:10.813 INFO:tasks.workunit.client.0.smithi037.stdout: "key": { 2024-09-12T17:20:10.813 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "myobj", 2024-09-12T17:20:10.814 INFO:tasks.workunit.client.0.smithi037.stdout: "instance": "", 2024-09-12T17:20:10.814 INFO:tasks.workunit.client.0.smithi037.stdout: "ns": "ns" 2024-09-12T17:20:10.814 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.814 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.814 INFO:tasks.workunit.client.0.smithi037.stdout:} 2024-09-12T17:20:10.814 INFO:tasks.workunit.client.0.smithi037.stdout:{ 2024-09-12T17:20:10.814 INFO:tasks.workunit.client.0.smithi037.stdout: "raw_obj": { 2024-09-12T17:20:10.814 INFO:tasks.workunit.client.0.smithi037.stdout: "pool": "default-placement.data", 2024-09-12T17:20:10.814 INFO:tasks.workunit.client.0.smithi037.stdout: "oid": "marker__ns_myobj", 2024-09-12T17:20:10.814 INFO:tasks.workunit.client.0.smithi037.stdout: "loc": "" 2024-09-12T17:20:10.814 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.814 INFO:tasks.workunit.client.0.smithi037.stdout:} 2024-09-12T17:20:10.814 INFO:tasks.workunit.client.0.smithi037.stdout:{ 2024-09-12T17:20:10.814 INFO:tasks.workunit.client.0.smithi037.stdout: "new_obj": { 2024-09-12T17:20:10.814 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket": { 2024-09-12T17:20:10.814 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "test", 2024-09-12T17:20:10.815 INFO:tasks.workunit.client.0.smithi037.stdout: "marker": "marker", 2024-09-12T17:20:10.815 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:10.815 INFO:tasks.workunit.client.0.smithi037.stdout: "tenant": "", 2024-09-12T17:20:10.815 INFO:tasks.workunit.client.0.smithi037.stdout: "explicit_placement": { 2024-09-12T17:20:10.815 INFO:tasks.workunit.client.0.smithi037.stdout: "data_pool": "", 2024-09-12T17:20:10.815 INFO:tasks.workunit.client.0.smithi037.stdout: "data_extra_pool": "", 2024-09-12T17:20:10.815 INFO:tasks.workunit.client.0.smithi037.stdout: "index_pool": "" 2024-09-12T17:20:10.815 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.815 INFO:tasks.workunit.client.0.smithi037.stdout: }, 2024-09-12T17:20:10.815 INFO:tasks.workunit.client.0.smithi037.stdout: "key": { 2024-09-12T17:20:10.815 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "myobj", 2024-09-12T17:20:10.815 INFO:tasks.workunit.client.0.smithi037.stdout: "instance": "", 2024-09-12T17:20:10.815 INFO:tasks.workunit.client.0.smithi037.stdout: "ns": "ns" 2024-09-12T17:20:10.816 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.816 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.816 INFO:tasks.workunit.client.0.smithi037.stdout:} 2024-09-12T17:20:10.816 INFO:tasks.workunit.client.0.smithi037.stdout:{ 2024-09-12T17:20:10.816 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket": { 2024-09-12T17:20:10.816 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "ebtest", 2024-09-12T17:20:10.816 INFO:tasks.workunit.client.0.smithi037.stdout: "marker": "marker", 2024-09-12T17:20:10.816 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:10.816 INFO:tasks.workunit.client.0.smithi037.stdout: "tenant": "", 2024-09-12T17:20:10.816 INFO:tasks.workunit.client.0.smithi037.stdout: "explicit_placement": { 2024-09-12T17:20:10.816 INFO:tasks.workunit.client.0.smithi037.stdout: "data_pool": ".data-pool", 2024-09-12T17:20:10.816 INFO:tasks.workunit.client.0.smithi037.stdout: "data_extra_pool": "", 2024-09-12T17:20:10.816 INFO:tasks.workunit.client.0.smithi037.stdout: "index_pool": ".index-pool" 2024-09-12T17:20:10.816 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.816 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.817 INFO:tasks.workunit.client.0.smithi037.stdout:} 2024-09-12T17:20:10.817 INFO:tasks.workunit.client.0.smithi037.stdout:{ 2024-09-12T17:20:10.817 INFO:tasks.workunit.client.0.smithi037.stdout: "obj": { 2024-09-12T17:20:10.817 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket": { 2024-09-12T17:20:10.817 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "ebtest", 2024-09-12T17:20:10.817 INFO:tasks.workunit.client.0.smithi037.stdout: "marker": "marker", 2024-09-12T17:20:10.817 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:10.817 INFO:tasks.workunit.client.0.smithi037.stdout: "tenant": "", 2024-09-12T17:20:10.817 INFO:tasks.workunit.client.0.smithi037.stdout: "explicit_placement": { 2024-09-12T17:20:10.817 INFO:tasks.workunit.client.0.smithi037.stdout: "data_pool": ".data-pool", 2024-09-12T17:20:10.817 INFO:tasks.workunit.client.0.smithi037.stdout: "data_extra_pool": "", 2024-09-12T17:20:10.817 INFO:tasks.workunit.client.0.smithi037.stdout: "index_pool": ".index-pool" 2024-09-12T17:20:10.817 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.817 INFO:tasks.workunit.client.0.smithi037.stdout: }, 2024-09-12T17:20:10.818 INFO:tasks.workunit.client.0.smithi037.stdout: "key": { 2024-09-12T17:20:10.818 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "myobj", 2024-09-12T17:20:10.818 INFO:tasks.workunit.client.0.smithi037.stdout: "instance": "", 2024-09-12T17:20:10.818 INFO:tasks.workunit.client.0.smithi037.stdout: "ns": "ns" 2024-09-12T17:20:10.818 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.818 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.818 INFO:tasks.workunit.client.0.smithi037.stdout:} 2024-09-12T17:20:10.818 INFO:tasks.workunit.client.0.smithi037.stdout:{ 2024-09-12T17:20:10.818 INFO:tasks.workunit.client.0.smithi037.stdout: "raw_obj": { 2024-09-12T17:20:10.818 INFO:tasks.workunit.client.0.smithi037.stdout: "pool": ".data-pool", 2024-09-12T17:20:10.818 INFO:tasks.workunit.client.0.smithi037.stdout: "oid": "marker__ns_myobj", 2024-09-12T17:20:10.818 INFO:tasks.workunit.client.0.smithi037.stdout: "loc": "" 2024-09-12T17:20:10.818 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.818 INFO:tasks.workunit.client.0.smithi037.stdout:} 2024-09-12T17:20:10.818 INFO:tasks.workunit.client.0.smithi037.stdout:{ 2024-09-12T17:20:10.819 INFO:tasks.workunit.client.0.smithi037.stdout: "new_obj": { 2024-09-12T17:20:10.819 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket": { 2024-09-12T17:20:10.819 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "ebtest", 2024-09-12T17:20:10.819 INFO:tasks.workunit.client.0.smithi037.stdout: "marker": "marker", 2024-09-12T17:20:10.819 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:10.819 INFO:tasks.workunit.client.0.smithi037.stdout: "tenant": "", 2024-09-12T17:20:10.819 INFO:tasks.workunit.client.0.smithi037.stdout: "explicit_placement": { 2024-09-12T17:20:10.819 INFO:tasks.workunit.client.0.smithi037.stdout: "data_pool": ".data-pool", 2024-09-12T17:20:10.819 INFO:tasks.workunit.client.0.smithi037.stdout: "data_extra_pool": "", 2024-09-12T17:20:10.819 INFO:tasks.workunit.client.0.smithi037.stdout: "index_pool": ".index-pool" 2024-09-12T17:20:10.819 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.819 INFO:tasks.workunit.client.0.smithi037.stdout: }, 2024-09-12T17:20:10.819 INFO:tasks.workunit.client.0.smithi037.stdout: "key": { 2024-09-12T17:20:10.819 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "myobj", 2024-09-12T17:20:10.819 INFO:tasks.workunit.client.0.smithi037.stdout: "instance": "", 2024-09-12T17:20:10.820 INFO:tasks.workunit.client.0.smithi037.stdout: "ns": "ns" 2024-09-12T17:20:10.820 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.820 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.820 INFO:tasks.workunit.client.0.smithi037.stdout:} 2024-09-12T17:20:10.820 INFO:tasks.workunit.client.0.smithi037.stdout:{ 2024-09-12T17:20:10.820 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket": { 2024-09-12T17:20:10.820 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "test", 2024-09-12T17:20:10.820 INFO:tasks.workunit.client.0.smithi037.stdout: "marker": "marker", 2024-09-12T17:20:10.820 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:10.820 INFO:tasks.workunit.client.0.smithi037.stdout: "tenant": "", 2024-09-12T17:20:10.820 INFO:tasks.workunit.client.0.smithi037.stdout: "explicit_placement": { 2024-09-12T17:20:10.820 INFO:tasks.workunit.client.0.smithi037.stdout: "data_pool": "", 2024-09-12T17:20:10.820 INFO:tasks.workunit.client.0.smithi037.stdout: "data_extra_pool": "", 2024-09-12T17:20:10.820 INFO:tasks.workunit.client.0.smithi037.stdout: "index_pool": "" 2024-09-12T17:20:10.821 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.821 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.821 INFO:tasks.workunit.client.0.smithi037.stdout:} 2024-09-12T17:20:10.821 INFO:tasks.workunit.client.0.smithi037.stdout:{ 2024-09-12T17:20:10.821 INFO:tasks.workunit.client.0.smithi037.stdout: "obj": { 2024-09-12T17:20:10.821 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket": { 2024-09-12T17:20:10.821 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "test", 2024-09-12T17:20:10.821 INFO:tasks.workunit.client.0.smithi037.stdout: "marker": "marker", 2024-09-12T17:20:10.821 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:10.821 INFO:tasks.workunit.client.0.smithi037.stdout: "tenant": "", 2024-09-12T17:20:10.821 INFO:tasks.workunit.client.0.smithi037.stdout: "explicit_placement": { 2024-09-12T17:20:10.821 INFO:tasks.workunit.client.0.smithi037.stdout: "data_pool": "", 2024-09-12T17:20:10.821 INFO:tasks.workunit.client.0.smithi037.stdout: "data_extra_pool": "", 2024-09-12T17:20:10.821 INFO:tasks.workunit.client.0.smithi037.stdout: "index_pool": "" 2024-09-12T17:20:10.821 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.822 INFO:tasks.workunit.client.0.smithi037.stdout: }, 2024-09-12T17:20:10.822 INFO:tasks.workunit.client.0.smithi037.stdout: "key": { 2024-09-12T17:20:10.822 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "myobj", 2024-09-12T17:20:10.822 INFO:tasks.workunit.client.0.smithi037.stdout: "instance": "inst", 2024-09-12T17:20:10.822 INFO:tasks.workunit.client.0.smithi037.stdout: "ns": "" 2024-09-12T17:20:10.822 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.822 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.822 INFO:tasks.workunit.client.0.smithi037.stdout:} 2024-09-12T17:20:10.822 INFO:tasks.workunit.client.0.smithi037.stdout:{ 2024-09-12T17:20:10.822 INFO:tasks.workunit.client.0.smithi037.stdout: "raw_obj": { 2024-09-12T17:20:10.822 INFO:tasks.workunit.client.0.smithi037.stdout: "pool": "default-placement.data", 2024-09-12T17:20:10.822 INFO:tasks.workunit.client.0.smithi037.stdout: "oid": "marker__:inst_myobj", 2024-09-12T17:20:10.822 INFO:tasks.workunit.client.0.smithi037.stdout: "loc": "" 2024-09-12T17:20:10.822 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.823 INFO:tasks.workunit.client.0.smithi037.stdout:} 2024-09-12T17:20:10.823 INFO:tasks.workunit.client.0.smithi037.stdout:{ 2024-09-12T17:20:10.823 INFO:tasks.workunit.client.0.smithi037.stdout: "new_obj": { 2024-09-12T17:20:10.823 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket": { 2024-09-12T17:20:10.823 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "test", 2024-09-12T17:20:10.823 INFO:tasks.workunit.client.0.smithi037.stdout: "marker": "marker", 2024-09-12T17:20:10.823 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:10.823 INFO:tasks.workunit.client.0.smithi037.stdout: "tenant": "", 2024-09-12T17:20:10.823 INFO:tasks.workunit.client.0.smithi037.stdout: "explicit_placement": { 2024-09-12T17:20:10.823 INFO:tasks.workunit.client.0.smithi037.stdout: "data_pool": "", 2024-09-12T17:20:10.823 INFO:tasks.workunit.client.0.smithi037.stdout: "data_extra_pool": "", 2024-09-12T17:20:10.823 INFO:tasks.workunit.client.0.smithi037.stdout: "index_pool": "" 2024-09-12T17:20:10.823 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.823 INFO:tasks.workunit.client.0.smithi037.stdout: }, 2024-09-12T17:20:10.823 INFO:tasks.workunit.client.0.smithi037.stdout: "key": { 2024-09-12T17:20:10.824 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "myobj", 2024-09-12T17:20:10.824 INFO:tasks.workunit.client.0.smithi037.stdout: "instance": "inst", 2024-09-12T17:20:10.824 INFO:tasks.workunit.client.0.smithi037.stdout: "ns": "" 2024-09-12T17:20:10.824 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.824 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.824 INFO:tasks.workunit.client.0.smithi037.stdout:} 2024-09-12T17:20:10.824 INFO:tasks.workunit.client.0.smithi037.stdout:{ 2024-09-12T17:20:10.824 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket": { 2024-09-12T17:20:10.824 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "ebtest", 2024-09-12T17:20:10.824 INFO:tasks.workunit.client.0.smithi037.stdout: "marker": "marker", 2024-09-12T17:20:10.824 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:10.824 INFO:tasks.workunit.client.0.smithi037.stdout: "tenant": "", 2024-09-12T17:20:10.824 INFO:tasks.workunit.client.0.smithi037.stdout: "explicit_placement": { 2024-09-12T17:20:10.824 INFO:tasks.workunit.client.0.smithi037.stdout: "data_pool": ".data-pool", 2024-09-12T17:20:10.825 INFO:tasks.workunit.client.0.smithi037.stdout: "data_extra_pool": "", 2024-09-12T17:20:10.825 INFO:tasks.workunit.client.0.smithi037.stdout: "index_pool": ".index-pool" 2024-09-12T17:20:10.825 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.825 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.825 INFO:tasks.workunit.client.0.smithi037.stdout:} 2024-09-12T17:20:10.825 INFO:tasks.workunit.client.0.smithi037.stdout:{ 2024-09-12T17:20:10.825 INFO:tasks.workunit.client.0.smithi037.stdout: "obj": { 2024-09-12T17:20:10.825 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket": { 2024-09-12T17:20:10.825 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "ebtest", 2024-09-12T17:20:10.825 INFO:tasks.workunit.client.0.smithi037.stdout: "marker": "marker", 2024-09-12T17:20:10.825 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:10.825 INFO:tasks.workunit.client.0.smithi037.stdout: "tenant": "", 2024-09-12T17:20:10.825 INFO:tasks.workunit.client.0.smithi037.stdout: "explicit_placement": { 2024-09-12T17:20:10.825 INFO:tasks.workunit.client.0.smithi037.stdout: "data_pool": ".data-pool", 2024-09-12T17:20:10.826 INFO:tasks.workunit.client.0.smithi037.stdout: "data_extra_pool": "", 2024-09-12T17:20:10.826 INFO:tasks.workunit.client.0.smithi037.stdout: "index_pool": ".index-pool" 2024-09-12T17:20:10.826 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.826 INFO:tasks.workunit.client.0.smithi037.stdout: }, 2024-09-12T17:20:10.826 INFO:tasks.workunit.client.0.smithi037.stdout: "key": { 2024-09-12T17:20:10.826 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "myobj", 2024-09-12T17:20:10.826 INFO:tasks.workunit.client.0.smithi037.stdout: "instance": "inst", 2024-09-12T17:20:10.826 INFO:tasks.workunit.client.0.smithi037.stdout: "ns": "" 2024-09-12T17:20:10.826 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.826 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.826 INFO:tasks.workunit.client.0.smithi037.stdout:} 2024-09-12T17:20:10.826 INFO:tasks.workunit.client.0.smithi037.stdout:{ 2024-09-12T17:20:10.826 INFO:tasks.workunit.client.0.smithi037.stdout: "raw_obj": { 2024-09-12T17:20:10.826 INFO:tasks.workunit.client.0.smithi037.stdout: "pool": ".data-pool", 2024-09-12T17:20:10.826 INFO:tasks.workunit.client.0.smithi037.stdout: "oid": "marker__:inst_myobj", 2024-09-12T17:20:10.826 INFO:tasks.workunit.client.0.smithi037.stdout: "loc": "" 2024-09-12T17:20:10.827 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.827 INFO:tasks.workunit.client.0.smithi037.stdout:} 2024-09-12T17:20:10.827 INFO:tasks.workunit.client.0.smithi037.stdout:{ 2024-09-12T17:20:10.827 INFO:tasks.workunit.client.0.smithi037.stdout: "new_obj": { 2024-09-12T17:20:10.827 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket": { 2024-09-12T17:20:10.827 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "ebtest", 2024-09-12T17:20:10.827 INFO:tasks.workunit.client.0.smithi037.stdout: "marker": "marker", 2024-09-12T17:20:10.827 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:10.827 INFO:tasks.workunit.client.0.smithi037.stdout: "tenant": "", 2024-09-12T17:20:10.827 INFO:tasks.workunit.client.0.smithi037.stdout: "explicit_placement": { 2024-09-12T17:20:10.827 INFO:tasks.workunit.client.0.smithi037.stdout: "data_pool": ".data-pool", 2024-09-12T17:20:10.827 INFO:tasks.workunit.client.0.smithi037.stdout: "data_extra_pool": "", 2024-09-12T17:20:10.827 INFO:tasks.workunit.client.0.smithi037.stdout: "index_pool": ".index-pool" 2024-09-12T17:20:10.828 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.828 INFO:tasks.workunit.client.0.smithi037.stdout: }, 2024-09-12T17:20:10.828 INFO:tasks.workunit.client.0.smithi037.stdout: "key": { 2024-09-12T17:20:10.828 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "myobj", 2024-09-12T17:20:10.828 INFO:tasks.workunit.client.0.smithi037.stdout: "instance": "inst", 2024-09-12T17:20:10.828 INFO:tasks.workunit.client.0.smithi037.stdout: "ns": "" 2024-09-12T17:20:10.828 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.828 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.828 INFO:tasks.workunit.client.0.smithi037.stdout:} 2024-09-12T17:20:10.828 INFO:tasks.workunit.client.0.smithi037.stdout:{ 2024-09-12T17:20:10.828 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket": { 2024-09-12T17:20:10.828 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "test", 2024-09-12T17:20:10.828 INFO:tasks.workunit.client.0.smithi037.stdout: "marker": "marker", 2024-09-12T17:20:10.828 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:10.829 INFO:tasks.workunit.client.0.smithi037.stdout: "tenant": "", 2024-09-12T17:20:10.829 INFO:tasks.workunit.client.0.smithi037.stdout: "explicit_placement": { 2024-09-12T17:20:10.829 INFO:tasks.workunit.client.0.smithi037.stdout: "data_pool": "", 2024-09-12T17:20:10.829 INFO:tasks.workunit.client.0.smithi037.stdout: "data_extra_pool": "", 2024-09-12T17:20:10.829 INFO:tasks.workunit.client.0.smithi037.stdout: "index_pool": "" 2024-09-12T17:20:10.829 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.829 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.829 INFO:tasks.workunit.client.0.smithi037.stdout:} 2024-09-12T17:20:10.829 INFO:tasks.workunit.client.0.smithi037.stdout:{ 2024-09-12T17:20:10.829 INFO:tasks.workunit.client.0.smithi037.stdout: "obj": { 2024-09-12T17:20:10.829 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket": { 2024-09-12T17:20:10.829 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "test", 2024-09-12T17:20:10.829 INFO:tasks.workunit.client.0.smithi037.stdout: "marker": "marker", 2024-09-12T17:20:10.829 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:10.829 INFO:tasks.workunit.client.0.smithi037.stdout: "tenant": "", 2024-09-12T17:20:10.830 INFO:tasks.workunit.client.0.smithi037.stdout: "explicit_placement": { 2024-09-12T17:20:10.830 INFO:tasks.workunit.client.0.smithi037.stdout: "data_pool": "", 2024-09-12T17:20:10.830 INFO:tasks.workunit.client.0.smithi037.stdout: "data_extra_pool": "", 2024-09-12T17:20:10.830 INFO:tasks.workunit.client.0.smithi037.stdout: "index_pool": "" 2024-09-12T17:20:10.830 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.830 INFO:tasks.workunit.client.0.smithi037.stdout: }, 2024-09-12T17:20:10.830 INFO:tasks.workunit.client.0.smithi037.stdout: "key": { 2024-09-12T17:20:10.830 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "myobj", 2024-09-12T17:20:10.830 INFO:tasks.workunit.client.0.smithi037.stdout: "instance": "inst", 2024-09-12T17:20:10.830 INFO:tasks.workunit.client.0.smithi037.stdout: "ns": "ns" 2024-09-12T17:20:10.830 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.830 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.830 INFO:tasks.workunit.client.0.smithi037.stdout:} 2024-09-12T17:20:10.830 INFO:tasks.workunit.client.0.smithi037.stdout:{ 2024-09-12T17:20:10.831 INFO:tasks.workunit.client.0.smithi037.stdout: "raw_obj": { 2024-09-12T17:20:10.831 INFO:tasks.workunit.client.0.smithi037.stdout: "pool": "default-placement.data", 2024-09-12T17:20:10.831 INFO:tasks.workunit.client.0.smithi037.stdout: "oid": "marker__ns:inst_myobj", 2024-09-12T17:20:10.831 INFO:tasks.workunit.client.0.smithi037.stdout: "loc": "" 2024-09-12T17:20:10.831 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.831 INFO:tasks.workunit.client.0.smithi037.stdout:} 2024-09-12T17:20:10.831 INFO:tasks.workunit.client.0.smithi037.stdout:{ 2024-09-12T17:20:10.831 INFO:tasks.workunit.client.0.smithi037.stdout: "new_obj": { 2024-09-12T17:20:10.831 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket": { 2024-09-12T17:20:10.831 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "test", 2024-09-12T17:20:10.831 INFO:tasks.workunit.client.0.smithi037.stdout: "marker": "marker", 2024-09-12T17:20:10.831 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:10.831 INFO:tasks.workunit.client.0.smithi037.stdout: "tenant": "", 2024-09-12T17:20:10.831 INFO:tasks.workunit.client.0.smithi037.stdout: "explicit_placement": { 2024-09-12T17:20:10.832 INFO:tasks.workunit.client.0.smithi037.stdout: "data_pool": "", 2024-09-12T17:20:10.832 INFO:tasks.workunit.client.0.smithi037.stdout: "data_extra_pool": "", 2024-09-12T17:20:10.832 INFO:tasks.workunit.client.0.smithi037.stdout: "index_pool": "" 2024-09-12T17:20:10.832 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.832 INFO:tasks.workunit.client.0.smithi037.stdout: }, 2024-09-12T17:20:10.832 INFO:tasks.workunit.client.0.smithi037.stdout: "key": { 2024-09-12T17:20:10.832 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "myobj", 2024-09-12T17:20:10.832 INFO:tasks.workunit.client.0.smithi037.stdout: "instance": "inst", 2024-09-12T17:20:10.832 INFO:tasks.workunit.client.0.smithi037.stdout: "ns": "ns" 2024-09-12T17:20:10.832 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.832 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.832 INFO:tasks.workunit.client.0.smithi037.stdout:} 2024-09-12T17:20:10.832 INFO:tasks.workunit.client.0.smithi037.stdout:{ 2024-09-12T17:20:10.832 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket": { 2024-09-12T17:20:10.833 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "ebtest", 2024-09-12T17:20:10.833 INFO:tasks.workunit.client.0.smithi037.stdout: "marker": "marker", 2024-09-12T17:20:10.833 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:10.833 INFO:tasks.workunit.client.0.smithi037.stdout: "tenant": "", 2024-09-12T17:20:10.833 INFO:tasks.workunit.client.0.smithi037.stdout: "explicit_placement": { 2024-09-12T17:20:10.833 INFO:tasks.workunit.client.0.smithi037.stdout: "data_pool": ".data-pool", 2024-09-12T17:20:10.833 INFO:tasks.workunit.client.0.smithi037.stdout: "data_extra_pool": "", 2024-09-12T17:20:10.833 INFO:tasks.workunit.client.0.smithi037.stdout: "index_pool": ".index-pool" 2024-09-12T17:20:10.833 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.833 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.833 INFO:tasks.workunit.client.0.smithi037.stdout:} 2024-09-12T17:20:10.833 INFO:tasks.workunit.client.0.smithi037.stdout:{ 2024-09-12T17:20:10.833 INFO:tasks.workunit.client.0.smithi037.stdout: "obj": { 2024-09-12T17:20:10.833 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket": { 2024-09-12T17:20:10.834 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "ebtest", 2024-09-12T17:20:10.834 INFO:tasks.workunit.client.0.smithi037.stdout: "marker": "marker", 2024-09-12T17:20:10.834 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:10.834 INFO:tasks.workunit.client.0.smithi037.stdout: "tenant": "", 2024-09-12T17:20:10.834 INFO:tasks.workunit.client.0.smithi037.stdout: "explicit_placement": { 2024-09-12T17:20:10.834 INFO:tasks.workunit.client.0.smithi037.stdout: "data_pool": ".data-pool", 2024-09-12T17:20:10.834 INFO:tasks.workunit.client.0.smithi037.stdout: "data_extra_pool": "", 2024-09-12T17:20:10.834 INFO:tasks.workunit.client.0.smithi037.stdout: "index_pool": ".index-pool" 2024-09-12T17:20:10.834 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.834 INFO:tasks.workunit.client.0.smithi037.stdout: }, 2024-09-12T17:20:10.834 INFO:tasks.workunit.client.0.smithi037.stdout: "key": { 2024-09-12T17:20:10.834 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "myobj", 2024-09-12T17:20:10.834 INFO:tasks.workunit.client.0.smithi037.stdout: "instance": "inst", 2024-09-12T17:20:10.834 INFO:tasks.workunit.client.0.smithi037.stdout: "ns": "ns" 2024-09-12T17:20:10.834 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.835 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.835 INFO:tasks.workunit.client.0.smithi037.stdout:} 2024-09-12T17:20:10.835 INFO:tasks.workunit.client.0.smithi037.stdout:{ 2024-09-12T17:20:10.835 INFO:tasks.workunit.client.0.smithi037.stdout: "raw_obj": { 2024-09-12T17:20:10.835 INFO:tasks.workunit.client.0.smithi037.stdout: "pool": ".data-pool", 2024-09-12T17:20:10.835 INFO:tasks.workunit.client.0.smithi037.stdout: "oid": "marker__ns:inst_myobj", 2024-09-12T17:20:10.835 INFO:tasks.workunit.client.0.smithi037.stdout: "loc": "" 2024-09-12T17:20:10.835 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.835 INFO:tasks.workunit.client.0.smithi037.stdout:} 2024-09-12T17:20:10.835 INFO:tasks.workunit.client.0.smithi037.stdout:{ 2024-09-12T17:20:10.835 INFO:tasks.workunit.client.0.smithi037.stdout: "new_obj": { 2024-09-12T17:20:10.835 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket": { 2024-09-12T17:20:10.835 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "ebtest", 2024-09-12T17:20:10.835 INFO:tasks.workunit.client.0.smithi037.stdout: "marker": "marker", 2024-09-12T17:20:10.836 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:10.836 INFO:tasks.workunit.client.0.smithi037.stdout: "tenant": "", 2024-09-12T17:20:10.836 INFO:tasks.workunit.client.0.smithi037.stdout: "explicit_placement": { 2024-09-12T17:20:10.836 INFO:tasks.workunit.client.0.smithi037.stdout: "data_pool": ".data-pool", 2024-09-12T17:20:10.836 INFO:tasks.workunit.client.0.smithi037.stdout: "data_extra_pool": "", 2024-09-12T17:20:10.836 INFO:tasks.workunit.client.0.smithi037.stdout: "index_pool": ".index-pool" 2024-09-12T17:20:10.836 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.836 INFO:tasks.workunit.client.0.smithi037.stdout: }, 2024-09-12T17:20:10.836 INFO:tasks.workunit.client.0.smithi037.stdout: "key": { 2024-09-12T17:20:10.836 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "myobj", 2024-09-12T17:20:10.836 INFO:tasks.workunit.client.0.smithi037.stdout: "instance": "inst", 2024-09-12T17:20:10.836 INFO:tasks.workunit.client.0.smithi037.stdout: "ns": "ns" 2024-09-12T17:20:10.836 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.837 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.837 INFO:tasks.workunit.client.0.smithi037.stdout:} 2024-09-12T17:20:10.837 INFO:tasks.workunit.client.0.smithi037.stdout:{ 2024-09-12T17:20:10.837 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket": { 2024-09-12T17:20:10.837 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "test", 2024-09-12T17:20:10.837 INFO:tasks.workunit.client.0.smithi037.stdout: "marker": "marker", 2024-09-12T17:20:10.837 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:10.837 INFO:tasks.workunit.client.0.smithi037.stdout: "tenant": "", 2024-09-12T17:20:10.837 INFO:tasks.workunit.client.0.smithi037.stdout: "explicit_placement": { 2024-09-12T17:20:10.837 INFO:tasks.workunit.client.0.smithi037.stdout: "data_pool": "", 2024-09-12T17:20:10.837 INFO:tasks.workunit.client.0.smithi037.stdout: "data_extra_pool": "", 2024-09-12T17:20:10.837 INFO:tasks.workunit.client.0.smithi037.stdout: "index_pool": "" 2024-09-12T17:20:10.837 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.837 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.837 INFO:tasks.workunit.client.0.smithi037.stdout:} 2024-09-12T17:20:10.838 INFO:tasks.workunit.client.0.smithi037.stdout:{ 2024-09-12T17:20:10.838 INFO:tasks.workunit.client.0.smithi037.stdout: "obj": { 2024-09-12T17:20:10.838 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket": { 2024-09-12T17:20:10.838 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "test", 2024-09-12T17:20:10.838 INFO:tasks.workunit.client.0.smithi037.stdout: "marker": "marker", 2024-09-12T17:20:10.838 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:10.838 INFO:tasks.workunit.client.0.smithi037.stdout: "tenant": "", 2024-09-12T17:20:10.838 INFO:tasks.workunit.client.0.smithi037.stdout: "explicit_placement": { 2024-09-12T17:20:10.838 INFO:tasks.workunit.client.0.smithi037.stdout: "data_pool": "", 2024-09-12T17:20:10.838 INFO:tasks.workunit.client.0.smithi037.stdout: "data_extra_pool": "", 2024-09-12T17:20:10.838 INFO:tasks.workunit.client.0.smithi037.stdout: "index_pool": "" 2024-09-12T17:20:10.838 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.838 INFO:tasks.workunit.client.0.smithi037.stdout: }, 2024-09-12T17:20:10.838 INFO:tasks.workunit.client.0.smithi037.stdout: "key": { 2024-09-12T17:20:10.839 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "_myobj", 2024-09-12T17:20:10.839 INFO:tasks.workunit.client.0.smithi037.stdout: "instance": "", 2024-09-12T17:20:10.839 INFO:tasks.workunit.client.0.smithi037.stdout: "ns": "" 2024-09-12T17:20:10.839 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.839 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.839 INFO:tasks.workunit.client.0.smithi037.stdout:} 2024-09-12T17:20:10.839 INFO:tasks.workunit.client.0.smithi037.stdout:{ 2024-09-12T17:20:10.839 INFO:tasks.workunit.client.0.smithi037.stdout: "raw_obj": { 2024-09-12T17:20:10.839 INFO:tasks.workunit.client.0.smithi037.stdout: "pool": "default-placement.data", 2024-09-12T17:20:10.839 INFO:tasks.workunit.client.0.smithi037.stdout: "oid": "marker___myobj", 2024-09-12T17:20:10.839 INFO:tasks.workunit.client.0.smithi037.stdout: "loc": "marker__myobj" 2024-09-12T17:20:10.839 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.839 INFO:tasks.workunit.client.0.smithi037.stdout:} 2024-09-12T17:20:10.840 INFO:tasks.workunit.client.0.smithi037.stdout:{ 2024-09-12T17:20:10.840 INFO:tasks.workunit.client.0.smithi037.stdout: "new_obj": { 2024-09-12T17:20:10.840 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket": { 2024-09-12T17:20:10.840 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "test", 2024-09-12T17:20:10.840 INFO:tasks.workunit.client.0.smithi037.stdout: "marker": "marker", 2024-09-12T17:20:10.840 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:10.840 INFO:tasks.workunit.client.0.smithi037.stdout: "tenant": "", 2024-09-12T17:20:10.840 INFO:tasks.workunit.client.0.smithi037.stdout: "explicit_placement": { 2024-09-12T17:20:10.840 INFO:tasks.workunit.client.0.smithi037.stdout: "data_pool": "", 2024-09-12T17:20:10.840 INFO:tasks.workunit.client.0.smithi037.stdout: "data_extra_pool": "", 2024-09-12T17:20:10.840 INFO:tasks.workunit.client.0.smithi037.stdout: "index_pool": "" 2024-09-12T17:20:10.840 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.840 INFO:tasks.workunit.client.0.smithi037.stdout: }, 2024-09-12T17:20:10.840 INFO:tasks.workunit.client.0.smithi037.stdout: "key": { 2024-09-12T17:20:10.841 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "_myobj", 2024-09-12T17:20:10.841 INFO:tasks.workunit.client.0.smithi037.stdout: "instance": "", 2024-09-12T17:20:10.841 INFO:tasks.workunit.client.0.smithi037.stdout: "ns": "" 2024-09-12T17:20:10.841 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.841 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.841 INFO:tasks.workunit.client.0.smithi037.stdout:} 2024-09-12T17:20:10.841 INFO:tasks.workunit.client.0.smithi037.stdout:{ 2024-09-12T17:20:10.841 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket": { 2024-09-12T17:20:10.841 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "ebtest", 2024-09-12T17:20:10.841 INFO:tasks.workunit.client.0.smithi037.stdout: "marker": "marker", 2024-09-12T17:20:10.841 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:10.841 INFO:tasks.workunit.client.0.smithi037.stdout: "tenant": "", 2024-09-12T17:20:10.841 INFO:tasks.workunit.client.0.smithi037.stdout: "explicit_placement": { 2024-09-12T17:20:10.842 INFO:tasks.workunit.client.0.smithi037.stdout: "data_pool": ".data-pool", 2024-09-12T17:20:10.842 INFO:tasks.workunit.client.0.smithi037.stdout: "data_extra_pool": "", 2024-09-12T17:20:10.842 INFO:tasks.workunit.client.0.smithi037.stdout: "index_pool": ".index-pool" 2024-09-12T17:20:10.842 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.842 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.842 INFO:tasks.workunit.client.0.smithi037.stdout:} 2024-09-12T17:20:10.842 INFO:tasks.workunit.client.0.smithi037.stdout:{ 2024-09-12T17:20:10.842 INFO:tasks.workunit.client.0.smithi037.stdout: "obj": { 2024-09-12T17:20:10.842 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket": { 2024-09-12T17:20:10.842 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "ebtest", 2024-09-12T17:20:10.842 INFO:tasks.workunit.client.0.smithi037.stdout: "marker": "marker", 2024-09-12T17:20:10.842 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:10.842 INFO:tasks.workunit.client.0.smithi037.stdout: "tenant": "", 2024-09-12T17:20:10.842 INFO:tasks.workunit.client.0.smithi037.stdout: "explicit_placement": { 2024-09-12T17:20:10.843 INFO:tasks.workunit.client.0.smithi037.stdout: "data_pool": ".data-pool", 2024-09-12T17:20:10.843 INFO:tasks.workunit.client.0.smithi037.stdout: "data_extra_pool": "", 2024-09-12T17:20:10.843 INFO:tasks.workunit.client.0.smithi037.stdout: "index_pool": ".index-pool" 2024-09-12T17:20:10.843 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.843 INFO:tasks.workunit.client.0.smithi037.stdout: }, 2024-09-12T17:20:10.843 INFO:tasks.workunit.client.0.smithi037.stdout: "key": { 2024-09-12T17:20:10.843 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "_myobj", 2024-09-12T17:20:10.843 INFO:tasks.workunit.client.0.smithi037.stdout: "instance": "", 2024-09-12T17:20:10.843 INFO:tasks.workunit.client.0.smithi037.stdout: "ns": "" 2024-09-12T17:20:10.843 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.843 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.843 INFO:tasks.workunit.client.0.smithi037.stdout:} 2024-09-12T17:20:10.843 INFO:tasks.workunit.client.0.smithi037.stdout:{ 2024-09-12T17:20:10.843 INFO:tasks.workunit.client.0.smithi037.stdout: "raw_obj": { 2024-09-12T17:20:10.844 INFO:tasks.workunit.client.0.smithi037.stdout: "pool": ".data-pool", 2024-09-12T17:20:10.844 INFO:tasks.workunit.client.0.smithi037.stdout: "oid": "marker___myobj", 2024-09-12T17:20:10.844 INFO:tasks.workunit.client.0.smithi037.stdout: "loc": "marker__myobj" 2024-09-12T17:20:10.844 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.844 INFO:tasks.workunit.client.0.smithi037.stdout:} 2024-09-12T17:20:10.844 INFO:tasks.workunit.client.0.smithi037.stdout:{ 2024-09-12T17:20:10.844 INFO:tasks.workunit.client.0.smithi037.stdout: "new_obj": { 2024-09-12T17:20:10.844 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket": { 2024-09-12T17:20:10.844 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "ebtest", 2024-09-12T17:20:10.844 INFO:tasks.workunit.client.0.smithi037.stdout: "marker": "marker", 2024-09-12T17:20:10.844 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:10.844 INFO:tasks.workunit.client.0.smithi037.stdout: "tenant": "", 2024-09-12T17:20:10.844 INFO:tasks.workunit.client.0.smithi037.stdout: "explicit_placement": { 2024-09-12T17:20:10.844 INFO:tasks.workunit.client.0.smithi037.stdout: "data_pool": ".data-pool", 2024-09-12T17:20:10.845 INFO:tasks.workunit.client.0.smithi037.stdout: "data_extra_pool": "", 2024-09-12T17:20:10.845 INFO:tasks.workunit.client.0.smithi037.stdout: "index_pool": ".index-pool" 2024-09-12T17:20:10.845 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.845 INFO:tasks.workunit.client.0.smithi037.stdout: }, 2024-09-12T17:20:10.845 INFO:tasks.workunit.client.0.smithi037.stdout: "key": { 2024-09-12T17:20:10.845 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "_myobj", 2024-09-12T17:20:10.845 INFO:tasks.workunit.client.0.smithi037.stdout: "instance": "", 2024-09-12T17:20:10.845 INFO:tasks.workunit.client.0.smithi037.stdout: "ns": "" 2024-09-12T17:20:10.845 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.845 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.845 INFO:tasks.workunit.client.0.smithi037.stdout:} 2024-09-12T17:20:10.845 INFO:tasks.workunit.client.0.smithi037.stdout:{ 2024-09-12T17:20:10.845 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket": { 2024-09-12T17:20:10.845 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "test", 2024-09-12T17:20:10.846 INFO:tasks.workunit.client.0.smithi037.stdout: "marker": "marker", 2024-09-12T17:20:10.846 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:10.846 INFO:tasks.workunit.client.0.smithi037.stdout: "tenant": "", 2024-09-12T17:20:10.846 INFO:tasks.workunit.client.0.smithi037.stdout: "explicit_placement": { 2024-09-12T17:20:10.846 INFO:tasks.workunit.client.0.smithi037.stdout: "data_pool": "", 2024-09-12T17:20:10.846 INFO:tasks.workunit.client.0.smithi037.stdout: "data_extra_pool": "", 2024-09-12T17:20:10.846 INFO:tasks.workunit.client.0.smithi037.stdout: "index_pool": "" 2024-09-12T17:20:10.846 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.846 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.846 INFO:tasks.workunit.client.0.smithi037.stdout:} 2024-09-12T17:20:10.846 INFO:tasks.workunit.client.0.smithi037.stdout:{ 2024-09-12T17:20:10.846 INFO:tasks.workunit.client.0.smithi037.stdout: "obj": { 2024-09-12T17:20:10.846 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket": { 2024-09-12T17:20:10.846 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "test", 2024-09-12T17:20:10.847 INFO:tasks.workunit.client.0.smithi037.stdout: "marker": "marker", 2024-09-12T17:20:10.847 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:10.847 INFO:tasks.workunit.client.0.smithi037.stdout: "tenant": "", 2024-09-12T17:20:10.847 INFO:tasks.workunit.client.0.smithi037.stdout: "explicit_placement": { 2024-09-12T17:20:10.847 INFO:tasks.workunit.client.0.smithi037.stdout: "data_pool": "", 2024-09-12T17:20:10.847 INFO:tasks.workunit.client.0.smithi037.stdout: "data_extra_pool": "", 2024-09-12T17:20:10.847 INFO:tasks.workunit.client.0.smithi037.stdout: "index_pool": "" 2024-09-12T17:20:10.847 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.847 INFO:tasks.workunit.client.0.smithi037.stdout: }, 2024-09-12T17:20:10.847 INFO:tasks.workunit.client.0.smithi037.stdout: "key": { 2024-09-12T17:20:10.847 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "_myobj", 2024-09-12T17:20:10.847 INFO:tasks.workunit.client.0.smithi037.stdout: "instance": "", 2024-09-12T17:20:10.847 INFO:tasks.workunit.client.0.smithi037.stdout: "ns": "ns" 2024-09-12T17:20:10.848 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.848 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.848 INFO:tasks.workunit.client.0.smithi037.stdout:} 2024-09-12T17:20:10.848 INFO:tasks.workunit.client.0.smithi037.stdout:{ 2024-09-12T17:20:10.848 INFO:tasks.workunit.client.0.smithi037.stdout: "raw_obj": { 2024-09-12T17:20:10.848 INFO:tasks.workunit.client.0.smithi037.stdout: "pool": "default-placement.data", 2024-09-12T17:20:10.848 INFO:tasks.workunit.client.0.smithi037.stdout: "oid": "marker__ns__myobj", 2024-09-12T17:20:10.848 INFO:tasks.workunit.client.0.smithi037.stdout: "loc": "" 2024-09-12T17:20:10.848 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.848 INFO:tasks.workunit.client.0.smithi037.stdout:} 2024-09-12T17:20:10.848 INFO:tasks.workunit.client.0.smithi037.stdout:{ 2024-09-12T17:20:10.848 INFO:tasks.workunit.client.0.smithi037.stdout: "new_obj": { 2024-09-12T17:20:10.848 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket": { 2024-09-12T17:20:10.848 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "test", 2024-09-12T17:20:10.849 INFO:tasks.workunit.client.0.smithi037.stdout: "marker": "marker", 2024-09-12T17:20:10.849 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:10.849 INFO:tasks.workunit.client.0.smithi037.stdout: "tenant": "", 2024-09-12T17:20:10.849 INFO:tasks.workunit.client.0.smithi037.stdout: "explicit_placement": { 2024-09-12T17:20:10.849 INFO:tasks.workunit.client.0.smithi037.stdout: "data_pool": "", 2024-09-12T17:20:10.849 INFO:tasks.workunit.client.0.smithi037.stdout: "data_extra_pool": "", 2024-09-12T17:20:10.849 INFO:tasks.workunit.client.0.smithi037.stdout: "index_pool": "" 2024-09-12T17:20:10.849 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.849 INFO:tasks.workunit.client.0.smithi037.stdout: }, 2024-09-12T17:20:10.849 INFO:tasks.workunit.client.0.smithi037.stdout: "key": { 2024-09-12T17:20:10.849 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "_myobj", 2024-09-12T17:20:10.849 INFO:tasks.workunit.client.0.smithi037.stdout: "instance": "", 2024-09-12T17:20:10.849 INFO:tasks.workunit.client.0.smithi037.stdout: "ns": "ns" 2024-09-12T17:20:10.850 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.850 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.850 INFO:tasks.workunit.client.0.smithi037.stdout:} 2024-09-12T17:20:10.850 INFO:tasks.workunit.client.0.smithi037.stdout:{ 2024-09-12T17:20:10.850 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket": { 2024-09-12T17:20:10.850 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "ebtest", 2024-09-12T17:20:10.850 INFO:tasks.workunit.client.0.smithi037.stdout: "marker": "marker", 2024-09-12T17:20:10.850 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:10.850 INFO:tasks.workunit.client.0.smithi037.stdout: "tenant": "", 2024-09-12T17:20:10.850 INFO:tasks.workunit.client.0.smithi037.stdout: "explicit_placement": { 2024-09-12T17:20:10.850 INFO:tasks.workunit.client.0.smithi037.stdout: "data_pool": ".data-pool", 2024-09-12T17:20:10.850 INFO:tasks.workunit.client.0.smithi037.stdout: "data_extra_pool": "", 2024-09-12T17:20:10.850 INFO:tasks.workunit.client.0.smithi037.stdout: "index_pool": ".index-pool" 2024-09-12T17:20:10.850 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.851 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.851 INFO:tasks.workunit.client.0.smithi037.stdout:} 2024-09-12T17:20:10.851 INFO:tasks.workunit.client.0.smithi037.stdout:{ 2024-09-12T17:20:10.851 INFO:tasks.workunit.client.0.smithi037.stdout: "obj": { 2024-09-12T17:20:10.851 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket": { 2024-09-12T17:20:10.851 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "ebtest", 2024-09-12T17:20:10.851 INFO:tasks.workunit.client.0.smithi037.stdout: "marker": "marker", 2024-09-12T17:20:10.851 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:10.851 INFO:tasks.workunit.client.0.smithi037.stdout: "tenant": "", 2024-09-12T17:20:10.851 INFO:tasks.workunit.client.0.smithi037.stdout: "explicit_placement": { 2024-09-12T17:20:10.851 INFO:tasks.workunit.client.0.smithi037.stdout: "data_pool": ".data-pool", 2024-09-12T17:20:10.851 INFO:tasks.workunit.client.0.smithi037.stdout: "data_extra_pool": "", 2024-09-12T17:20:10.851 INFO:tasks.workunit.client.0.smithi037.stdout: "index_pool": ".index-pool" 2024-09-12T17:20:10.851 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.852 INFO:tasks.workunit.client.0.smithi037.stdout: }, 2024-09-12T17:20:10.852 INFO:tasks.workunit.client.0.smithi037.stdout: "key": { 2024-09-12T17:20:10.852 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "_myobj", 2024-09-12T17:20:10.852 INFO:tasks.workunit.client.0.smithi037.stdout: "instance": "", 2024-09-12T17:20:10.852 INFO:tasks.workunit.client.0.smithi037.stdout: "ns": "ns" 2024-09-12T17:20:10.852 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.852 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.852 INFO:tasks.workunit.client.0.smithi037.stdout:} 2024-09-12T17:20:10.852 INFO:tasks.workunit.client.0.smithi037.stdout:{ 2024-09-12T17:20:10.852 INFO:tasks.workunit.client.0.smithi037.stdout: "raw_obj": { 2024-09-12T17:20:10.852 INFO:tasks.workunit.client.0.smithi037.stdout: "pool": ".data-pool", 2024-09-12T17:20:10.852 INFO:tasks.workunit.client.0.smithi037.stdout: "oid": "marker__ns__myobj", 2024-09-12T17:20:10.853 INFO:tasks.workunit.client.0.smithi037.stdout: "loc": "" 2024-09-12T17:20:10.853 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.853 INFO:tasks.workunit.client.0.smithi037.stdout:} 2024-09-12T17:20:10.853 INFO:tasks.workunit.client.0.smithi037.stdout:{ 2024-09-12T17:20:10.853 INFO:tasks.workunit.client.0.smithi037.stdout: "new_obj": { 2024-09-12T17:20:10.853 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket": { 2024-09-12T17:20:10.853 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "ebtest", 2024-09-12T17:20:10.853 INFO:tasks.workunit.client.0.smithi037.stdout: "marker": "marker", 2024-09-12T17:20:10.853 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:10.853 INFO:tasks.workunit.client.0.smithi037.stdout: "tenant": "", 2024-09-12T17:20:10.853 INFO:tasks.workunit.client.0.smithi037.stdout: "explicit_placement": { 2024-09-12T17:20:10.853 INFO:tasks.workunit.client.0.smithi037.stdout: "data_pool": ".data-pool", 2024-09-12T17:20:10.853 INFO:tasks.workunit.client.0.smithi037.stdout: "data_extra_pool": "", 2024-09-12T17:20:10.853 INFO:tasks.workunit.client.0.smithi037.stdout: "index_pool": ".index-pool" 2024-09-12T17:20:10.854 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.854 INFO:tasks.workunit.client.0.smithi037.stdout: }, 2024-09-12T17:20:10.854 INFO:tasks.workunit.client.0.smithi037.stdout: "key": { 2024-09-12T17:20:10.854 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "_myobj", 2024-09-12T17:20:10.854 INFO:tasks.workunit.client.0.smithi037.stdout: "instance": "", 2024-09-12T17:20:10.854 INFO:tasks.workunit.client.0.smithi037.stdout: "ns": "ns" 2024-09-12T17:20:10.854 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.854 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.854 INFO:tasks.workunit.client.0.smithi037.stdout:} 2024-09-12T17:20:10.854 INFO:tasks.workunit.client.0.smithi037.stdout:{ 2024-09-12T17:20:10.854 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket": { 2024-09-12T17:20:10.854 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "test", 2024-09-12T17:20:10.854 INFO:tasks.workunit.client.0.smithi037.stdout: "marker": "marker", 2024-09-12T17:20:10.854 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:10.854 INFO:tasks.workunit.client.0.smithi037.stdout: "tenant": "", 2024-09-12T17:20:10.855 INFO:tasks.workunit.client.0.smithi037.stdout: "explicit_placement": { 2024-09-12T17:20:10.855 INFO:tasks.workunit.client.0.smithi037.stdout: "data_pool": "", 2024-09-12T17:20:10.855 INFO:tasks.workunit.client.0.smithi037.stdout: "data_extra_pool": "", 2024-09-12T17:20:10.855 INFO:tasks.workunit.client.0.smithi037.stdout: "index_pool": "" 2024-09-12T17:20:10.855 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.855 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.855 INFO:tasks.workunit.client.0.smithi037.stdout:} 2024-09-12T17:20:10.855 INFO:tasks.workunit.client.0.smithi037.stdout:{ 2024-09-12T17:20:10.855 INFO:tasks.workunit.client.0.smithi037.stdout: "obj": { 2024-09-12T17:20:10.855 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket": { 2024-09-12T17:20:10.855 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "test", 2024-09-12T17:20:10.855 INFO:tasks.workunit.client.0.smithi037.stdout: "marker": "marker", 2024-09-12T17:20:10.855 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:10.855 INFO:tasks.workunit.client.0.smithi037.stdout: "tenant": "", 2024-09-12T17:20:10.855 INFO:tasks.workunit.client.0.smithi037.stdout: "explicit_placement": { 2024-09-12T17:20:10.856 INFO:tasks.workunit.client.0.smithi037.stdout: "data_pool": "", 2024-09-12T17:20:10.856 INFO:tasks.workunit.client.0.smithi037.stdout: "data_extra_pool": "", 2024-09-12T17:20:10.856 INFO:tasks.workunit.client.0.smithi037.stdout: "index_pool": "" 2024-09-12T17:20:10.856 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.856 INFO:tasks.workunit.client.0.smithi037.stdout: }, 2024-09-12T17:20:10.856 INFO:tasks.workunit.client.0.smithi037.stdout: "key": { 2024-09-12T17:20:10.856 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "_myobj", 2024-09-12T17:20:10.856 INFO:tasks.workunit.client.0.smithi037.stdout: "instance": "inst", 2024-09-12T17:20:10.856 INFO:tasks.workunit.client.0.smithi037.stdout: "ns": "" 2024-09-12T17:20:10.856 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.856 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.856 INFO:tasks.workunit.client.0.smithi037.stdout:} 2024-09-12T17:20:10.856 INFO:tasks.workunit.client.0.smithi037.stdout:{ 2024-09-12T17:20:10.856 INFO:tasks.workunit.client.0.smithi037.stdout: "raw_obj": { 2024-09-12T17:20:10.857 INFO:tasks.workunit.client.0.smithi037.stdout: "pool": "default-placement.data", 2024-09-12T17:20:10.857 INFO:tasks.workunit.client.0.smithi037.stdout: "oid": "marker__:inst__myobj", 2024-09-12T17:20:10.857 INFO:tasks.workunit.client.0.smithi037.stdout: "loc": "marker__myobj" 2024-09-12T17:20:10.857 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.857 INFO:tasks.workunit.client.0.smithi037.stdout:} 2024-09-12T17:20:10.857 INFO:tasks.workunit.client.0.smithi037.stdout:{ 2024-09-12T17:20:10.857 INFO:tasks.workunit.client.0.smithi037.stdout: "new_obj": { 2024-09-12T17:20:10.857 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket": { 2024-09-12T17:20:10.857 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "test", 2024-09-12T17:20:10.857 INFO:tasks.workunit.client.0.smithi037.stdout: "marker": "marker", 2024-09-12T17:20:10.857 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:10.857 INFO:tasks.workunit.client.0.smithi037.stdout: "tenant": "", 2024-09-12T17:20:10.857 INFO:tasks.workunit.client.0.smithi037.stdout: "explicit_placement": { 2024-09-12T17:20:10.857 INFO:tasks.workunit.client.0.smithi037.stdout: "data_pool": "", 2024-09-12T17:20:10.858 INFO:tasks.workunit.client.0.smithi037.stdout: "data_extra_pool": "", 2024-09-12T17:20:10.858 INFO:tasks.workunit.client.0.smithi037.stdout: "index_pool": "" 2024-09-12T17:20:10.858 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.858 INFO:tasks.workunit.client.0.smithi037.stdout: }, 2024-09-12T17:20:10.858 INFO:tasks.workunit.client.0.smithi037.stdout: "key": { 2024-09-12T17:20:10.858 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "_myobj", 2024-09-12T17:20:10.858 INFO:tasks.workunit.client.0.smithi037.stdout: "instance": "inst", 2024-09-12T17:20:10.858 INFO:tasks.workunit.client.0.smithi037.stdout: "ns": "" 2024-09-12T17:20:10.858 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.858 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.858 INFO:tasks.workunit.client.0.smithi037.stdout:} 2024-09-12T17:20:10.858 INFO:tasks.workunit.client.0.smithi037.stdout:{ 2024-09-12T17:20:10.858 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket": { 2024-09-12T17:20:10.858 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "ebtest", 2024-09-12T17:20:10.858 INFO:tasks.workunit.client.0.smithi037.stdout: "marker": "marker", 2024-09-12T17:20:10.859 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:10.859 INFO:tasks.workunit.client.0.smithi037.stdout: "tenant": "", 2024-09-12T17:20:10.859 INFO:tasks.workunit.client.0.smithi037.stdout: "explicit_placement": { 2024-09-12T17:20:10.859 INFO:tasks.workunit.client.0.smithi037.stdout: "data_pool": ".data-pool", 2024-09-12T17:20:10.859 INFO:tasks.workunit.client.0.smithi037.stdout: "data_extra_pool": "", 2024-09-12T17:20:10.859 INFO:tasks.workunit.client.0.smithi037.stdout: "index_pool": ".index-pool" 2024-09-12T17:20:10.859 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.859 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.859 INFO:tasks.workunit.client.0.smithi037.stdout:} 2024-09-12T17:20:10.859 INFO:tasks.workunit.client.0.smithi037.stdout:{ 2024-09-12T17:20:10.859 INFO:tasks.workunit.client.0.smithi037.stdout: "obj": { 2024-09-12T17:20:10.859 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket": { 2024-09-12T17:20:10.859 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "ebtest", 2024-09-12T17:20:10.860 INFO:tasks.workunit.client.0.smithi037.stdout: "marker": "marker", 2024-09-12T17:20:10.860 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:10.860 INFO:tasks.workunit.client.0.smithi037.stdout: "tenant": "", 2024-09-12T17:20:10.860 INFO:tasks.workunit.client.0.smithi037.stdout: "explicit_placement": { 2024-09-12T17:20:10.860 INFO:tasks.workunit.client.0.smithi037.stdout: "data_pool": ".data-pool", 2024-09-12T17:20:10.860 INFO:tasks.workunit.client.0.smithi037.stdout: "data_extra_pool": "", 2024-09-12T17:20:10.860 INFO:tasks.workunit.client.0.smithi037.stdout: "index_pool": ".index-pool" 2024-09-12T17:20:10.860 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.860 INFO:tasks.workunit.client.0.smithi037.stdout: }, 2024-09-12T17:20:10.860 INFO:tasks.workunit.client.0.smithi037.stdout: "key": { 2024-09-12T17:20:10.860 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "_myobj", 2024-09-12T17:20:10.860 INFO:tasks.workunit.client.0.smithi037.stdout: "instance": "inst", 2024-09-12T17:20:10.860 INFO:tasks.workunit.client.0.smithi037.stdout: "ns": "" 2024-09-12T17:20:10.860 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.861 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.861 INFO:tasks.workunit.client.0.smithi037.stdout:} 2024-09-12T17:20:10.861 INFO:tasks.workunit.client.0.smithi037.stdout:{ 2024-09-12T17:20:10.861 INFO:tasks.workunit.client.0.smithi037.stdout: "raw_obj": { 2024-09-12T17:20:10.861 INFO:tasks.workunit.client.0.smithi037.stdout: "pool": ".data-pool", 2024-09-12T17:20:10.861 INFO:tasks.workunit.client.0.smithi037.stdout: "oid": "marker__:inst__myobj", 2024-09-12T17:20:10.861 INFO:tasks.workunit.client.0.smithi037.stdout: "loc": "marker__myobj" 2024-09-12T17:20:10.861 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.861 INFO:tasks.workunit.client.0.smithi037.stdout:} 2024-09-12T17:20:10.861 INFO:tasks.workunit.client.0.smithi037.stdout:{ 2024-09-12T17:20:10.861 INFO:tasks.workunit.client.0.smithi037.stdout: "new_obj": { 2024-09-12T17:20:10.861 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket": { 2024-09-12T17:20:10.861 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "ebtest", 2024-09-12T17:20:10.861 INFO:tasks.workunit.client.0.smithi037.stdout: "marker": "marker", 2024-09-12T17:20:10.861 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:10.862 INFO:tasks.workunit.client.0.smithi037.stdout: "tenant": "", 2024-09-12T17:20:10.862 INFO:tasks.workunit.client.0.smithi037.stdout: "explicit_placement": { 2024-09-12T17:20:10.862 INFO:tasks.workunit.client.0.smithi037.stdout: "data_pool": ".data-pool", 2024-09-12T17:20:10.862 INFO:tasks.workunit.client.0.smithi037.stdout: "data_extra_pool": "", 2024-09-12T17:20:10.862 INFO:tasks.workunit.client.0.smithi037.stdout: "index_pool": ".index-pool" 2024-09-12T17:20:10.862 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.862 INFO:tasks.workunit.client.0.smithi037.stdout: }, 2024-09-12T17:20:10.862 INFO:tasks.workunit.client.0.smithi037.stdout: "key": { 2024-09-12T17:20:10.862 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "_myobj", 2024-09-12T17:20:10.862 INFO:tasks.workunit.client.0.smithi037.stdout: "instance": "inst", 2024-09-12T17:20:10.862 INFO:tasks.workunit.client.0.smithi037.stdout: "ns": "" 2024-09-12T17:20:10.862 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.862 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.862 INFO:tasks.workunit.client.0.smithi037.stdout:} 2024-09-12T17:20:10.863 INFO:tasks.workunit.client.0.smithi037.stdout:{ 2024-09-12T17:20:10.863 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket": { 2024-09-12T17:20:10.863 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "test", 2024-09-12T17:20:10.863 INFO:tasks.workunit.client.0.smithi037.stdout: "marker": "marker", 2024-09-12T17:20:10.863 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:10.863 INFO:tasks.workunit.client.0.smithi037.stdout: "tenant": "", 2024-09-12T17:20:10.863 INFO:tasks.workunit.client.0.smithi037.stdout: "explicit_placement": { 2024-09-12T17:20:10.863 INFO:tasks.workunit.client.0.smithi037.stdout: "data_pool": "", 2024-09-12T17:20:10.863 INFO:tasks.workunit.client.0.smithi037.stdout: "data_extra_pool": "", 2024-09-12T17:20:10.863 INFO:tasks.workunit.client.0.smithi037.stdout: "index_pool": "" 2024-09-12T17:20:10.863 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.863 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.863 INFO:tasks.workunit.client.0.smithi037.stdout:} 2024-09-12T17:20:10.863 INFO:tasks.workunit.client.0.smithi037.stdout:{ 2024-09-12T17:20:10.863 INFO:tasks.workunit.client.0.smithi037.stdout: "obj": { 2024-09-12T17:20:10.864 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket": { 2024-09-12T17:20:10.864 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "test", 2024-09-12T17:20:10.864 INFO:tasks.workunit.client.0.smithi037.stdout: "marker": "marker", 2024-09-12T17:20:10.864 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:10.864 INFO:tasks.workunit.client.0.smithi037.stdout: "tenant": "", 2024-09-12T17:20:10.864 INFO:tasks.workunit.client.0.smithi037.stdout: "explicit_placement": { 2024-09-12T17:20:10.864 INFO:tasks.workunit.client.0.smithi037.stdout: "data_pool": "", 2024-09-12T17:20:10.864 INFO:tasks.workunit.client.0.smithi037.stdout: "data_extra_pool": "", 2024-09-12T17:20:10.864 INFO:tasks.workunit.client.0.smithi037.stdout: "index_pool": "" 2024-09-12T17:20:10.864 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.864 INFO:tasks.workunit.client.0.smithi037.stdout: }, 2024-09-12T17:20:10.864 INFO:tasks.workunit.client.0.smithi037.stdout: "key": { 2024-09-12T17:20:10.864 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "_myobj", 2024-09-12T17:20:10.864 INFO:tasks.workunit.client.0.smithi037.stdout: "instance": "inst", 2024-09-12T17:20:10.865 INFO:tasks.workunit.client.0.smithi037.stdout: "ns": "ns" 2024-09-12T17:20:10.865 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.865 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.865 INFO:tasks.workunit.client.0.smithi037.stdout:} 2024-09-12T17:20:10.865 INFO:tasks.workunit.client.0.smithi037.stdout:{ 2024-09-12T17:20:10.865 INFO:tasks.workunit.client.0.smithi037.stdout: "raw_obj": { 2024-09-12T17:20:10.865 INFO:tasks.workunit.client.0.smithi037.stdout: "pool": "default-placement.data", 2024-09-12T17:20:10.865 INFO:tasks.workunit.client.0.smithi037.stdout: "oid": "marker__ns:inst__myobj", 2024-09-12T17:20:10.865 INFO:tasks.workunit.client.0.smithi037.stdout: "loc": "" 2024-09-12T17:20:10.865 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.865 INFO:tasks.workunit.client.0.smithi037.stdout:} 2024-09-12T17:20:10.865 INFO:tasks.workunit.client.0.smithi037.stdout:{ 2024-09-12T17:20:10.865 INFO:tasks.workunit.client.0.smithi037.stdout: "new_obj": { 2024-09-12T17:20:10.865 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket": { 2024-09-12T17:20:10.865 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "test", 2024-09-12T17:20:10.866 INFO:tasks.workunit.client.0.smithi037.stdout: "marker": "marker", 2024-09-12T17:20:10.866 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:10.866 INFO:tasks.workunit.client.0.smithi037.stdout: "tenant": "", 2024-09-12T17:20:10.866 INFO:tasks.workunit.client.0.smithi037.stdout: "explicit_placement": { 2024-09-12T17:20:10.866 INFO:tasks.workunit.client.0.smithi037.stdout: "data_pool": "", 2024-09-12T17:20:10.866 INFO:tasks.workunit.client.0.smithi037.stdout: "data_extra_pool": "", 2024-09-12T17:20:10.866 INFO:tasks.workunit.client.0.smithi037.stdout: "index_pool": "" 2024-09-12T17:20:10.866 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.866 INFO:tasks.workunit.client.0.smithi037.stdout: }, 2024-09-12T17:20:10.866 INFO:tasks.workunit.client.0.smithi037.stdout: "key": { 2024-09-12T17:20:10.866 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "_myobj", 2024-09-12T17:20:10.866 INFO:tasks.workunit.client.0.smithi037.stdout: "instance": "inst", 2024-09-12T17:20:10.866 INFO:tasks.workunit.client.0.smithi037.stdout: "ns": "ns" 2024-09-12T17:20:10.866 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.866 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.867 INFO:tasks.workunit.client.0.smithi037.stdout:} 2024-09-12T17:20:10.867 INFO:tasks.workunit.client.0.smithi037.stdout:{ 2024-09-12T17:20:10.867 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket": { 2024-09-12T17:20:10.867 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "ebtest", 2024-09-12T17:20:10.867 INFO:tasks.workunit.client.0.smithi037.stdout: "marker": "marker", 2024-09-12T17:20:10.867 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:10.867 INFO:tasks.workunit.client.0.smithi037.stdout: "tenant": "", 2024-09-12T17:20:10.867 INFO:tasks.workunit.client.0.smithi037.stdout: "explicit_placement": { 2024-09-12T17:20:10.867 INFO:tasks.workunit.client.0.smithi037.stdout: "data_pool": ".data-pool", 2024-09-12T17:20:10.867 INFO:tasks.workunit.client.0.smithi037.stdout: "data_extra_pool": "", 2024-09-12T17:20:10.867 INFO:tasks.workunit.client.0.smithi037.stdout: "index_pool": ".index-pool" 2024-09-12T17:20:10.867 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.867 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.867 INFO:tasks.workunit.client.0.smithi037.stdout:} 2024-09-12T17:20:10.867 INFO:tasks.workunit.client.0.smithi037.stdout:{ 2024-09-12T17:20:10.868 INFO:tasks.workunit.client.0.smithi037.stdout: "obj": { 2024-09-12T17:20:10.868 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket": { 2024-09-12T17:20:10.868 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "ebtest", 2024-09-12T17:20:10.868 INFO:tasks.workunit.client.0.smithi037.stdout: "marker": "marker", 2024-09-12T17:20:10.868 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:10.868 INFO:tasks.workunit.client.0.smithi037.stdout: "tenant": "", 2024-09-12T17:20:10.868 INFO:tasks.workunit.client.0.smithi037.stdout: "explicit_placement": { 2024-09-12T17:20:10.868 INFO:tasks.workunit.client.0.smithi037.stdout: "data_pool": ".data-pool", 2024-09-12T17:20:10.868 INFO:tasks.workunit.client.0.smithi037.stdout: "data_extra_pool": "", 2024-09-12T17:20:10.868 INFO:tasks.workunit.client.0.smithi037.stdout: "index_pool": ".index-pool" 2024-09-12T17:20:10.868 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.868 INFO:tasks.workunit.client.0.smithi037.stdout: }, 2024-09-12T17:20:10.868 INFO:tasks.workunit.client.0.smithi037.stdout: "key": { 2024-09-12T17:20:10.868 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "_myobj", 2024-09-12T17:20:10.868 INFO:tasks.workunit.client.0.smithi037.stdout: "instance": "inst", 2024-09-12T17:20:10.869 INFO:tasks.workunit.client.0.smithi037.stdout: "ns": "ns" 2024-09-12T17:20:10.869 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.869 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.869 INFO:tasks.workunit.client.0.smithi037.stdout:} 2024-09-12T17:20:10.869 INFO:tasks.workunit.client.0.smithi037.stdout:{ 2024-09-12T17:20:10.869 INFO:tasks.workunit.client.0.smithi037.stdout: "raw_obj": { 2024-09-12T17:20:10.869 INFO:tasks.workunit.client.0.smithi037.stdout: "pool": ".data-pool", 2024-09-12T17:20:10.869 INFO:tasks.workunit.client.0.smithi037.stdout: "oid": "marker__ns:inst__myobj", 2024-09-12T17:20:10.869 INFO:tasks.workunit.client.0.smithi037.stdout: "loc": "" 2024-09-12T17:20:10.869 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.869 INFO:tasks.workunit.client.0.smithi037.stdout:} 2024-09-12T17:20:10.869 INFO:tasks.workunit.client.0.smithi037.stdout:{ 2024-09-12T17:20:10.869 INFO:tasks.workunit.client.0.smithi037.stdout: "new_obj": { 2024-09-12T17:20:10.869 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket": { 2024-09-12T17:20:10.870 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "ebtest", 2024-09-12T17:20:10.870 INFO:tasks.workunit.client.0.smithi037.stdout: "marker": "marker", 2024-09-12T17:20:10.870 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:10.870 INFO:tasks.workunit.client.0.smithi037.stdout: "tenant": "", 2024-09-12T17:20:10.870 INFO:tasks.workunit.client.0.smithi037.stdout: "explicit_placement": { 2024-09-12T17:20:10.870 INFO:tasks.workunit.client.0.smithi037.stdout: "data_pool": ".data-pool", 2024-09-12T17:20:10.870 INFO:tasks.workunit.client.0.smithi037.stdout: "data_extra_pool": "", 2024-09-12T17:20:10.870 INFO:tasks.workunit.client.0.smithi037.stdout: "index_pool": ".index-pool" 2024-09-12T17:20:10.870 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.870 INFO:tasks.workunit.client.0.smithi037.stdout: }, 2024-09-12T17:20:10.870 INFO:tasks.workunit.client.0.smithi037.stdout: "key": { 2024-09-12T17:20:10.870 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "_myobj", 2024-09-12T17:20:10.870 INFO:tasks.workunit.client.0.smithi037.stdout: "instance": "inst", 2024-09-12T17:20:10.870 INFO:tasks.workunit.client.0.smithi037.stdout: "ns": "ns" 2024-09-12T17:20:10.871 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.871 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.871 INFO:tasks.workunit.client.0.smithi037.stdout:} 2024-09-12T17:20:10.871 INFO:tasks.workunit.client.0.smithi037.stdout:{ 2024-09-12T17:20:10.871 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket": { 2024-09-12T17:20:10.871 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "test", 2024-09-12T17:20:10.871 INFO:tasks.workunit.client.0.smithi037.stdout: "marker": "marker", 2024-09-12T17:20:10.871 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:10.871 INFO:tasks.workunit.client.0.smithi037.stdout: "tenant": "", 2024-09-12T17:20:10.871 INFO:tasks.workunit.client.0.smithi037.stdout: "explicit_placement": { 2024-09-12T17:20:10.871 INFO:tasks.workunit.client.0.smithi037.stdout: "data_pool": "", 2024-09-12T17:20:10.871 INFO:tasks.workunit.client.0.smithi037.stdout: "data_extra_pool": "", 2024-09-12T17:20:10.871 INFO:tasks.workunit.client.0.smithi037.stdout: "index_pool": "" 2024-09-12T17:20:10.871 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.871 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.872 INFO:tasks.workunit.client.0.smithi037.stdout:} 2024-09-12T17:20:10.872 INFO:tasks.workunit.client.0.smithi037.stdout:{ 2024-09-12T17:20:10.872 INFO:tasks.workunit.client.0.smithi037.stdout: "obj": { 2024-09-12T17:20:10.872 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket": { 2024-09-12T17:20:10.872 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "test", 2024-09-12T17:20:10.872 INFO:tasks.workunit.client.0.smithi037.stdout: "marker": "marker", 2024-09-12T17:20:10.872 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:10.872 INFO:tasks.workunit.client.0.smithi037.stdout: "tenant": "", 2024-09-12T17:20:10.872 INFO:tasks.workunit.client.0.smithi037.stdout: "explicit_placement": { 2024-09-12T17:20:10.872 INFO:tasks.workunit.client.0.smithi037.stdout: "data_pool": "", 2024-09-12T17:20:10.872 INFO:tasks.workunit.client.0.smithi037.stdout: "data_extra_pool": "", 2024-09-12T17:20:10.872 INFO:tasks.workunit.client.0.smithi037.stdout: "index_pool": "" 2024-09-12T17:20:10.872 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.872 INFO:tasks.workunit.client.0.smithi037.stdout: }, 2024-09-12T17:20:10.873 INFO:tasks.workunit.client.0.smithi037.stdout: "key": { 2024-09-12T17:20:10.873 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "_myobj_", 2024-09-12T17:20:10.873 INFO:tasks.workunit.client.0.smithi037.stdout: "instance": "", 2024-09-12T17:20:10.873 INFO:tasks.workunit.client.0.smithi037.stdout: "ns": "" 2024-09-12T17:20:10.873 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.873 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.873 INFO:tasks.workunit.client.0.smithi037.stdout:} 2024-09-12T17:20:10.873 INFO:tasks.workunit.client.0.smithi037.stdout:{ 2024-09-12T17:20:10.873 INFO:tasks.workunit.client.0.smithi037.stdout: "raw_obj": { 2024-09-12T17:20:10.873 INFO:tasks.workunit.client.0.smithi037.stdout: "pool": "default-placement.data", 2024-09-12T17:20:10.873 INFO:tasks.workunit.client.0.smithi037.stdout: "oid": "marker___myobj_", 2024-09-12T17:20:10.873 INFO:tasks.workunit.client.0.smithi037.stdout: "loc": "marker__myobj_" 2024-09-12T17:20:10.873 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.873 INFO:tasks.workunit.client.0.smithi037.stdout:} 2024-09-12T17:20:10.874 INFO:tasks.workunit.client.0.smithi037.stdout:{ 2024-09-12T17:20:10.874 INFO:tasks.workunit.client.0.smithi037.stdout: "new_obj": { 2024-09-12T17:20:10.874 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket": { 2024-09-12T17:20:10.874 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "test", 2024-09-12T17:20:10.874 INFO:tasks.workunit.client.0.smithi037.stdout: "marker": "marker", 2024-09-12T17:20:10.874 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:10.874 INFO:tasks.workunit.client.0.smithi037.stdout: "tenant": "", 2024-09-12T17:20:10.874 INFO:tasks.workunit.client.0.smithi037.stdout: "explicit_placement": { 2024-09-12T17:20:10.874 INFO:tasks.workunit.client.0.smithi037.stdout: "data_pool": "", 2024-09-12T17:20:10.874 INFO:tasks.workunit.client.0.smithi037.stdout: "data_extra_pool": "", 2024-09-12T17:20:10.874 INFO:tasks.workunit.client.0.smithi037.stdout: "index_pool": "" 2024-09-12T17:20:10.874 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.874 INFO:tasks.workunit.client.0.smithi037.stdout: }, 2024-09-12T17:20:10.874 INFO:tasks.workunit.client.0.smithi037.stdout: "key": { 2024-09-12T17:20:10.874 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "_myobj_", 2024-09-12T17:20:10.875 INFO:tasks.workunit.client.0.smithi037.stdout: "instance": "", 2024-09-12T17:20:10.875 INFO:tasks.workunit.client.0.smithi037.stdout: "ns": "" 2024-09-12T17:20:10.875 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.875 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.875 INFO:tasks.workunit.client.0.smithi037.stdout:} 2024-09-12T17:20:10.875 INFO:tasks.workunit.client.0.smithi037.stdout:{ 2024-09-12T17:20:10.875 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket": { 2024-09-12T17:20:10.875 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "ebtest", 2024-09-12T17:20:10.875 INFO:tasks.workunit.client.0.smithi037.stdout: "marker": "marker", 2024-09-12T17:20:10.875 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:10.875 INFO:tasks.workunit.client.0.smithi037.stdout: "tenant": "", 2024-09-12T17:20:10.875 INFO:tasks.workunit.client.0.smithi037.stdout: "explicit_placement": { 2024-09-12T17:20:10.875 INFO:tasks.workunit.client.0.smithi037.stdout: "data_pool": ".data-pool", 2024-09-12T17:20:10.875 INFO:tasks.workunit.client.0.smithi037.stdout: "data_extra_pool": "", 2024-09-12T17:20:10.876 INFO:tasks.workunit.client.0.smithi037.stdout: "index_pool": ".index-pool" 2024-09-12T17:20:10.876 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.876 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.876 INFO:tasks.workunit.client.0.smithi037.stdout:} 2024-09-12T17:20:10.876 INFO:tasks.workunit.client.0.smithi037.stdout:{ 2024-09-12T17:20:10.876 INFO:tasks.workunit.client.0.smithi037.stdout: "obj": { 2024-09-12T17:20:10.876 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket": { 2024-09-12T17:20:10.876 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "ebtest", 2024-09-12T17:20:10.876 INFO:tasks.workunit.client.0.smithi037.stdout: "marker": "marker", 2024-09-12T17:20:10.876 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:10.876 INFO:tasks.workunit.client.0.smithi037.stdout: "tenant": "", 2024-09-12T17:20:10.876 INFO:tasks.workunit.client.0.smithi037.stdout: "explicit_placement": { 2024-09-12T17:20:10.876 INFO:tasks.workunit.client.0.smithi037.stdout: "data_pool": ".data-pool", 2024-09-12T17:20:10.876 INFO:tasks.workunit.client.0.smithi037.stdout: "data_extra_pool": "", 2024-09-12T17:20:10.877 INFO:tasks.workunit.client.0.smithi037.stdout: "index_pool": ".index-pool" 2024-09-12T17:20:10.877 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.877 INFO:tasks.workunit.client.0.smithi037.stdout: }, 2024-09-12T17:20:10.877 INFO:tasks.workunit.client.0.smithi037.stdout: "key": { 2024-09-12T17:20:10.877 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "_myobj_", 2024-09-12T17:20:10.877 INFO:tasks.workunit.client.0.smithi037.stdout: "instance": "", 2024-09-12T17:20:10.877 INFO:tasks.workunit.client.0.smithi037.stdout: "ns": "" 2024-09-12T17:20:10.877 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.877 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.877 INFO:tasks.workunit.client.0.smithi037.stdout:} 2024-09-12T17:20:10.877 INFO:tasks.workunit.client.0.smithi037.stdout:{ 2024-09-12T17:20:10.877 INFO:tasks.workunit.client.0.smithi037.stdout: "raw_obj": { 2024-09-12T17:20:10.877 INFO:tasks.workunit.client.0.smithi037.stdout: "pool": ".data-pool", 2024-09-12T17:20:10.877 INFO:tasks.workunit.client.0.smithi037.stdout: "oid": "marker___myobj_", 2024-09-12T17:20:10.878 INFO:tasks.workunit.client.0.smithi037.stdout: "loc": "marker__myobj_" 2024-09-12T17:20:10.878 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.878 INFO:tasks.workunit.client.0.smithi037.stdout:} 2024-09-12T17:20:10.878 INFO:tasks.workunit.client.0.smithi037.stdout:{ 2024-09-12T17:20:10.878 INFO:tasks.workunit.client.0.smithi037.stdout: "new_obj": { 2024-09-12T17:20:10.878 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket": { 2024-09-12T17:20:10.878 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "ebtest", 2024-09-12T17:20:10.878 INFO:tasks.workunit.client.0.smithi037.stdout: "marker": "marker", 2024-09-12T17:20:10.878 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:10.878 INFO:tasks.workunit.client.0.smithi037.stdout: "tenant": "", 2024-09-12T17:20:10.878 INFO:tasks.workunit.client.0.smithi037.stdout: "explicit_placement": { 2024-09-12T17:20:10.878 INFO:tasks.workunit.client.0.smithi037.stdout: "data_pool": ".data-pool", 2024-09-12T17:20:10.878 INFO:tasks.workunit.client.0.smithi037.stdout: "data_extra_pool": "", 2024-09-12T17:20:10.878 INFO:tasks.workunit.client.0.smithi037.stdout: "index_pool": ".index-pool" 2024-09-12T17:20:10.878 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.879 INFO:tasks.workunit.client.0.smithi037.stdout: }, 2024-09-12T17:20:10.879 INFO:tasks.workunit.client.0.smithi037.stdout: "key": { 2024-09-12T17:20:10.879 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "_myobj_", 2024-09-12T17:20:10.879 INFO:tasks.workunit.client.0.smithi037.stdout: "instance": "", 2024-09-12T17:20:10.879 INFO:tasks.workunit.client.0.smithi037.stdout: "ns": "" 2024-09-12T17:20:10.879 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.879 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.879 INFO:tasks.workunit.client.0.smithi037.stdout:} 2024-09-12T17:20:10.879 INFO:tasks.workunit.client.0.smithi037.stdout:{ 2024-09-12T17:20:10.879 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket": { 2024-09-12T17:20:10.879 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "test", 2024-09-12T17:20:10.879 INFO:tasks.workunit.client.0.smithi037.stdout: "marker": "marker", 2024-09-12T17:20:10.879 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:10.879 INFO:tasks.workunit.client.0.smithi037.stdout: "tenant": "", 2024-09-12T17:20:10.880 INFO:tasks.workunit.client.0.smithi037.stdout: "explicit_placement": { 2024-09-12T17:20:10.880 INFO:tasks.workunit.client.0.smithi037.stdout: "data_pool": "", 2024-09-12T17:20:10.880 INFO:tasks.workunit.client.0.smithi037.stdout: "data_extra_pool": "", 2024-09-12T17:20:10.880 INFO:tasks.workunit.client.0.smithi037.stdout: "index_pool": "" 2024-09-12T17:20:10.880 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.880 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.880 INFO:tasks.workunit.client.0.smithi037.stdout:} 2024-09-12T17:20:10.880 INFO:tasks.workunit.client.0.smithi037.stdout:{ 2024-09-12T17:20:10.880 INFO:tasks.workunit.client.0.smithi037.stdout: "obj": { 2024-09-12T17:20:10.880 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket": { 2024-09-12T17:20:10.880 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "test", 2024-09-12T17:20:10.880 INFO:tasks.workunit.client.0.smithi037.stdout: "marker": "marker", 2024-09-12T17:20:10.880 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:10.880 INFO:tasks.workunit.client.0.smithi037.stdout: "tenant": "", 2024-09-12T17:20:10.881 INFO:tasks.workunit.client.0.smithi037.stdout: "explicit_placement": { 2024-09-12T17:20:10.881 INFO:tasks.workunit.client.0.smithi037.stdout: "data_pool": "", 2024-09-12T17:20:10.881 INFO:tasks.workunit.client.0.smithi037.stdout: "data_extra_pool": "", 2024-09-12T17:20:10.881 INFO:tasks.workunit.client.0.smithi037.stdout: "index_pool": "" 2024-09-12T17:20:10.881 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.881 INFO:tasks.workunit.client.0.smithi037.stdout: }, 2024-09-12T17:20:10.881 INFO:tasks.workunit.client.0.smithi037.stdout: "key": { 2024-09-12T17:20:10.881 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "_myobj_", 2024-09-12T17:20:10.881 INFO:tasks.workunit.client.0.smithi037.stdout: "instance": "", 2024-09-12T17:20:10.881 INFO:tasks.workunit.client.0.smithi037.stdout: "ns": "ns" 2024-09-12T17:20:10.881 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.881 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.881 INFO:tasks.workunit.client.0.smithi037.stdout:} 2024-09-12T17:20:10.881 INFO:tasks.workunit.client.0.smithi037.stdout:{ 2024-09-12T17:20:10.882 INFO:tasks.workunit.client.0.smithi037.stdout: "raw_obj": { 2024-09-12T17:20:10.882 INFO:tasks.workunit.client.0.smithi037.stdout: "pool": "default-placement.data", 2024-09-12T17:20:10.882 INFO:tasks.workunit.client.0.smithi037.stdout: "oid": "marker__ns__myobj_", 2024-09-12T17:20:10.882 INFO:tasks.workunit.client.0.smithi037.stdout: "loc": "" 2024-09-12T17:20:10.882 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.882 INFO:tasks.workunit.client.0.smithi037.stdout:} 2024-09-12T17:20:10.882 INFO:tasks.workunit.client.0.smithi037.stdout:{ 2024-09-12T17:20:10.882 INFO:tasks.workunit.client.0.smithi037.stdout: "new_obj": { 2024-09-12T17:20:10.882 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket": { 2024-09-12T17:20:10.882 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "test", 2024-09-12T17:20:10.882 INFO:tasks.workunit.client.0.smithi037.stdout: "marker": "marker", 2024-09-12T17:20:10.882 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:10.882 INFO:tasks.workunit.client.0.smithi037.stdout: "tenant": "", 2024-09-12T17:20:10.882 INFO:tasks.workunit.client.0.smithi037.stdout: "explicit_placement": { 2024-09-12T17:20:10.883 INFO:tasks.workunit.client.0.smithi037.stdout: "data_pool": "", 2024-09-12T17:20:10.883 INFO:tasks.workunit.client.0.smithi037.stdout: "data_extra_pool": "", 2024-09-12T17:20:10.883 INFO:tasks.workunit.client.0.smithi037.stdout: "index_pool": "" 2024-09-12T17:20:10.883 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.883 INFO:tasks.workunit.client.0.smithi037.stdout: }, 2024-09-12T17:20:10.883 INFO:tasks.workunit.client.0.smithi037.stdout: "key": { 2024-09-12T17:20:10.883 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "_myobj_", 2024-09-12T17:20:10.883 INFO:tasks.workunit.client.0.smithi037.stdout: "instance": "", 2024-09-12T17:20:10.883 INFO:tasks.workunit.client.0.smithi037.stdout: "ns": "ns" 2024-09-12T17:20:10.883 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.883 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.883 INFO:tasks.workunit.client.0.smithi037.stdout:} 2024-09-12T17:20:10.883 INFO:tasks.workunit.client.0.smithi037.stdout:{ 2024-09-12T17:20:10.883 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket": { 2024-09-12T17:20:10.884 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "ebtest", 2024-09-12T17:20:10.884 INFO:tasks.workunit.client.0.smithi037.stdout: "marker": "marker", 2024-09-12T17:20:10.884 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:10.884 INFO:tasks.workunit.client.0.smithi037.stdout: "tenant": "", 2024-09-12T17:20:10.884 INFO:tasks.workunit.client.0.smithi037.stdout: "explicit_placement": { 2024-09-12T17:20:10.884 INFO:tasks.workunit.client.0.smithi037.stdout: "data_pool": ".data-pool", 2024-09-12T17:20:10.884 INFO:tasks.workunit.client.0.smithi037.stdout: "data_extra_pool": "", 2024-09-12T17:20:10.884 INFO:tasks.workunit.client.0.smithi037.stdout: "index_pool": ".index-pool" 2024-09-12T17:20:10.884 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.884 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.884 INFO:tasks.workunit.client.0.smithi037.stdout:} 2024-09-12T17:20:10.884 INFO:tasks.workunit.client.0.smithi037.stdout:{ 2024-09-12T17:20:10.884 INFO:tasks.workunit.client.0.smithi037.stdout: "obj": { 2024-09-12T17:20:10.884 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket": { 2024-09-12T17:20:10.885 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "ebtest", 2024-09-12T17:20:10.885 INFO:tasks.workunit.client.0.smithi037.stdout: "marker": "marker", 2024-09-12T17:20:10.885 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:10.885 INFO:tasks.workunit.client.0.smithi037.stdout: "tenant": "", 2024-09-12T17:20:10.885 INFO:tasks.workunit.client.0.smithi037.stdout: "explicit_placement": { 2024-09-12T17:20:10.885 INFO:tasks.workunit.client.0.smithi037.stdout: "data_pool": ".data-pool", 2024-09-12T17:20:10.885 INFO:tasks.workunit.client.0.smithi037.stdout: "data_extra_pool": "", 2024-09-12T17:20:10.885 INFO:tasks.workunit.client.0.smithi037.stdout: "index_pool": ".index-pool" 2024-09-12T17:20:10.885 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.885 INFO:tasks.workunit.client.0.smithi037.stdout: }, 2024-09-12T17:20:10.885 INFO:tasks.workunit.client.0.smithi037.stdout: "key": { 2024-09-12T17:20:10.885 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "_myobj_", 2024-09-12T17:20:10.885 INFO:tasks.workunit.client.0.smithi037.stdout: "instance": "", 2024-09-12T17:20:10.885 INFO:tasks.workunit.client.0.smithi037.stdout: "ns": "ns" 2024-09-12T17:20:10.886 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.886 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.886 INFO:tasks.workunit.client.0.smithi037.stdout:} 2024-09-12T17:20:10.886 INFO:tasks.workunit.client.0.smithi037.stdout:{ 2024-09-12T17:20:10.886 INFO:tasks.workunit.client.0.smithi037.stdout: "raw_obj": { 2024-09-12T17:20:10.886 INFO:tasks.workunit.client.0.smithi037.stdout: "pool": ".data-pool", 2024-09-12T17:20:10.886 INFO:tasks.workunit.client.0.smithi037.stdout: "oid": "marker__ns__myobj_", 2024-09-12T17:20:10.886 INFO:tasks.workunit.client.0.smithi037.stdout: "loc": "" 2024-09-12T17:20:10.886 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.886 INFO:tasks.workunit.client.0.smithi037.stdout:} 2024-09-12T17:20:10.886 INFO:tasks.workunit.client.0.smithi037.stdout:{ 2024-09-12T17:20:10.886 INFO:tasks.workunit.client.0.smithi037.stdout: "new_obj": { 2024-09-12T17:20:10.886 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket": { 2024-09-12T17:20:10.886 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "ebtest", 2024-09-12T17:20:10.887 INFO:tasks.workunit.client.0.smithi037.stdout: "marker": "marker", 2024-09-12T17:20:10.887 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:10.887 INFO:tasks.workunit.client.0.smithi037.stdout: "tenant": "", 2024-09-12T17:20:10.887 INFO:tasks.workunit.client.0.smithi037.stdout: "explicit_placement": { 2024-09-12T17:20:10.887 INFO:tasks.workunit.client.0.smithi037.stdout: "data_pool": ".data-pool", 2024-09-12T17:20:10.887 INFO:tasks.workunit.client.0.smithi037.stdout: "data_extra_pool": "", 2024-09-12T17:20:10.887 INFO:tasks.workunit.client.0.smithi037.stdout: "index_pool": ".index-pool" 2024-09-12T17:20:10.887 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.887 INFO:tasks.workunit.client.0.smithi037.stdout: }, 2024-09-12T17:20:10.887 INFO:tasks.workunit.client.0.smithi037.stdout: "key": { 2024-09-12T17:20:10.887 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "_myobj_", 2024-09-12T17:20:10.887 INFO:tasks.workunit.client.0.smithi037.stdout: "instance": "", 2024-09-12T17:20:10.887 INFO:tasks.workunit.client.0.smithi037.stdout: "ns": "ns" 2024-09-12T17:20:10.887 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.887 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.888 INFO:tasks.workunit.client.0.smithi037.stdout:} 2024-09-12T17:20:10.888 INFO:tasks.workunit.client.0.smithi037.stdout:{ 2024-09-12T17:20:10.888 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket": { 2024-09-12T17:20:10.888 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "test", 2024-09-12T17:20:10.888 INFO:tasks.workunit.client.0.smithi037.stdout: "marker": "marker", 2024-09-12T17:20:10.888 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:10.888 INFO:tasks.workunit.client.0.smithi037.stdout: "tenant": "", 2024-09-12T17:20:10.888 INFO:tasks.workunit.client.0.smithi037.stdout: "explicit_placement": { 2024-09-12T17:20:10.888 INFO:tasks.workunit.client.0.smithi037.stdout: "data_pool": "", 2024-09-12T17:20:10.888 INFO:tasks.workunit.client.0.smithi037.stdout: "data_extra_pool": "", 2024-09-12T17:20:10.888 INFO:tasks.workunit.client.0.smithi037.stdout: "index_pool": "" 2024-09-12T17:20:10.888 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.888 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.888 INFO:tasks.workunit.client.0.smithi037.stdout:} 2024-09-12T17:20:10.889 INFO:tasks.workunit.client.0.smithi037.stdout:{ 2024-09-12T17:20:10.889 INFO:tasks.workunit.client.0.smithi037.stdout: "obj": { 2024-09-12T17:20:10.889 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket": { 2024-09-12T17:20:10.889 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "test", 2024-09-12T17:20:10.889 INFO:tasks.workunit.client.0.smithi037.stdout: "marker": "marker", 2024-09-12T17:20:10.889 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:10.889 INFO:tasks.workunit.client.0.smithi037.stdout: "tenant": "", 2024-09-12T17:20:10.889 INFO:tasks.workunit.client.0.smithi037.stdout: "explicit_placement": { 2024-09-12T17:20:10.889 INFO:tasks.workunit.client.0.smithi037.stdout: "data_pool": "", 2024-09-12T17:20:10.889 INFO:tasks.workunit.client.0.smithi037.stdout: "data_extra_pool": "", 2024-09-12T17:20:10.889 INFO:tasks.workunit.client.0.smithi037.stdout: "index_pool": "" 2024-09-12T17:20:10.889 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.889 INFO:tasks.workunit.client.0.smithi037.stdout: }, 2024-09-12T17:20:10.889 INFO:tasks.workunit.client.0.smithi037.stdout: "key": { 2024-09-12T17:20:10.890 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "_myobj_", 2024-09-12T17:20:10.890 INFO:tasks.workunit.client.0.smithi037.stdout: "instance": "inst", 2024-09-12T17:20:10.890 INFO:tasks.workunit.client.0.smithi037.stdout: "ns": "" 2024-09-12T17:20:10.890 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.890 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.890 INFO:tasks.workunit.client.0.smithi037.stdout:} 2024-09-12T17:20:10.890 INFO:tasks.workunit.client.0.smithi037.stdout:{ 2024-09-12T17:20:10.890 INFO:tasks.workunit.client.0.smithi037.stdout: "raw_obj": { 2024-09-12T17:20:10.890 INFO:tasks.workunit.client.0.smithi037.stdout: "pool": "default-placement.data", 2024-09-12T17:20:10.890 INFO:tasks.workunit.client.0.smithi037.stdout: "oid": "marker__:inst__myobj_", 2024-09-12T17:20:10.890 INFO:tasks.workunit.client.0.smithi037.stdout: "loc": "marker__myobj_" 2024-09-12T17:20:10.890 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.890 INFO:tasks.workunit.client.0.smithi037.stdout:} 2024-09-12T17:20:10.890 INFO:tasks.workunit.client.0.smithi037.stdout:{ 2024-09-12T17:20:10.891 INFO:tasks.workunit.client.0.smithi037.stdout: "new_obj": { 2024-09-12T17:20:10.891 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket": { 2024-09-12T17:20:10.891 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "test", 2024-09-12T17:20:10.891 INFO:tasks.workunit.client.0.smithi037.stdout: "marker": "marker", 2024-09-12T17:20:10.891 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:10.891 INFO:tasks.workunit.client.0.smithi037.stdout: "tenant": "", 2024-09-12T17:20:10.891 INFO:tasks.workunit.client.0.smithi037.stdout: "explicit_placement": { 2024-09-12T17:20:10.891 INFO:tasks.workunit.client.0.smithi037.stdout: "data_pool": "", 2024-09-12T17:20:10.891 INFO:tasks.workunit.client.0.smithi037.stdout: "data_extra_pool": "", 2024-09-12T17:20:10.891 INFO:tasks.workunit.client.0.smithi037.stdout: "index_pool": "" 2024-09-12T17:20:10.891 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.891 INFO:tasks.workunit.client.0.smithi037.stdout: }, 2024-09-12T17:20:10.891 INFO:tasks.workunit.client.0.smithi037.stdout: "key": { 2024-09-12T17:20:10.891 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "_myobj_", 2024-09-12T17:20:10.892 INFO:tasks.workunit.client.0.smithi037.stdout: "instance": "inst", 2024-09-12T17:20:10.892 INFO:tasks.workunit.client.0.smithi037.stdout: "ns": "" 2024-09-12T17:20:10.892 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.892 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.892 INFO:tasks.workunit.client.0.smithi037.stdout:} 2024-09-12T17:20:10.892 INFO:tasks.workunit.client.0.smithi037.stdout:{ 2024-09-12T17:20:10.892 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket": { 2024-09-12T17:20:10.892 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "ebtest", 2024-09-12T17:20:10.892 INFO:tasks.workunit.client.0.smithi037.stdout: "marker": "marker", 2024-09-12T17:20:10.892 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:10.892 INFO:tasks.workunit.client.0.smithi037.stdout: "tenant": "", 2024-09-12T17:20:10.892 INFO:tasks.workunit.client.0.smithi037.stdout: "explicit_placement": { 2024-09-12T17:20:10.892 INFO:tasks.workunit.client.0.smithi037.stdout: "data_pool": ".data-pool", 2024-09-12T17:20:10.892 INFO:tasks.workunit.client.0.smithi037.stdout: "data_extra_pool": "", 2024-09-12T17:20:10.893 INFO:tasks.workunit.client.0.smithi037.stdout: "index_pool": ".index-pool" 2024-09-12T17:20:10.893 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.893 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.893 INFO:tasks.workunit.client.0.smithi037.stdout:} 2024-09-12T17:20:10.893 INFO:tasks.workunit.client.0.smithi037.stdout:{ 2024-09-12T17:20:10.893 INFO:tasks.workunit.client.0.smithi037.stdout: "obj": { 2024-09-12T17:20:10.893 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket": { 2024-09-12T17:20:10.893 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "ebtest", 2024-09-12T17:20:10.893 INFO:tasks.workunit.client.0.smithi037.stdout: "marker": "marker", 2024-09-12T17:20:10.893 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:10.893 INFO:tasks.workunit.client.0.smithi037.stdout: "tenant": "", 2024-09-12T17:20:10.893 INFO:tasks.workunit.client.0.smithi037.stdout: "explicit_placement": { 2024-09-12T17:20:10.893 INFO:tasks.workunit.client.0.smithi037.stdout: "data_pool": ".data-pool", 2024-09-12T17:20:10.894 INFO:tasks.workunit.client.0.smithi037.stdout: "data_extra_pool": "", 2024-09-12T17:20:10.894 INFO:tasks.workunit.client.0.smithi037.stdout: "index_pool": ".index-pool" 2024-09-12T17:20:10.894 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.894 INFO:tasks.workunit.client.0.smithi037.stdout: }, 2024-09-12T17:20:10.894 INFO:tasks.workunit.client.0.smithi037.stdout: "key": { 2024-09-12T17:20:10.894 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "_myobj_", 2024-09-12T17:20:10.894 INFO:tasks.workunit.client.0.smithi037.stdout: "instance": "inst", 2024-09-12T17:20:10.894 INFO:tasks.workunit.client.0.smithi037.stdout: "ns": "" 2024-09-12T17:20:10.894 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.894 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.894 INFO:tasks.workunit.client.0.smithi037.stdout:} 2024-09-12T17:20:10.894 INFO:tasks.workunit.client.0.smithi037.stdout:{ 2024-09-12T17:20:10.894 INFO:tasks.workunit.client.0.smithi037.stdout: "raw_obj": { 2024-09-12T17:20:10.894 INFO:tasks.workunit.client.0.smithi037.stdout: "pool": ".data-pool", 2024-09-12T17:20:10.895 INFO:tasks.workunit.client.0.smithi037.stdout: "oid": "marker__:inst__myobj_", 2024-09-12T17:20:10.895 INFO:tasks.workunit.client.0.smithi037.stdout: "loc": "marker__myobj_" 2024-09-12T17:20:10.895 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.895 INFO:tasks.workunit.client.0.smithi037.stdout:} 2024-09-12T17:20:10.895 INFO:tasks.workunit.client.0.smithi037.stdout:{ 2024-09-12T17:20:10.895 INFO:tasks.workunit.client.0.smithi037.stdout: "new_obj": { 2024-09-12T17:20:10.895 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket": { 2024-09-12T17:20:10.895 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "ebtest", 2024-09-12T17:20:10.895 INFO:tasks.workunit.client.0.smithi037.stdout: "marker": "marker", 2024-09-12T17:20:10.895 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:10.895 INFO:tasks.workunit.client.0.smithi037.stdout: "tenant": "", 2024-09-12T17:20:10.895 INFO:tasks.workunit.client.0.smithi037.stdout: "explicit_placement": { 2024-09-12T17:20:10.895 INFO:tasks.workunit.client.0.smithi037.stdout: "data_pool": ".data-pool", 2024-09-12T17:20:10.895 INFO:tasks.workunit.client.0.smithi037.stdout: "data_extra_pool": "", 2024-09-12T17:20:10.895 INFO:tasks.workunit.client.0.smithi037.stdout: "index_pool": ".index-pool" 2024-09-12T17:20:10.896 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.896 INFO:tasks.workunit.client.0.smithi037.stdout: }, 2024-09-12T17:20:10.896 INFO:tasks.workunit.client.0.smithi037.stdout: "key": { 2024-09-12T17:20:10.896 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "_myobj_", 2024-09-12T17:20:10.896 INFO:tasks.workunit.client.0.smithi037.stdout: "instance": "inst", 2024-09-12T17:20:10.896 INFO:tasks.workunit.client.0.smithi037.stdout: "ns": "" 2024-09-12T17:20:10.896 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.896 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.896 INFO:tasks.workunit.client.0.smithi037.stdout:} 2024-09-12T17:20:10.896 INFO:tasks.workunit.client.0.smithi037.stdout:{ 2024-09-12T17:20:10.896 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket": { 2024-09-12T17:20:10.896 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "test", 2024-09-12T17:20:10.896 INFO:tasks.workunit.client.0.smithi037.stdout: "marker": "marker", 2024-09-12T17:20:10.896 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:10.897 INFO:tasks.workunit.client.0.smithi037.stdout: "tenant": "", 2024-09-12T17:20:10.897 INFO:tasks.workunit.client.0.smithi037.stdout: "explicit_placement": { 2024-09-12T17:20:10.897 INFO:tasks.workunit.client.0.smithi037.stdout: "data_pool": "", 2024-09-12T17:20:10.897 INFO:tasks.workunit.client.0.smithi037.stdout: "data_extra_pool": "", 2024-09-12T17:20:10.897 INFO:tasks.workunit.client.0.smithi037.stdout: "index_pool": "" 2024-09-12T17:20:10.897 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.897 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.897 INFO:tasks.workunit.client.0.smithi037.stdout:} 2024-09-12T17:20:10.897 INFO:tasks.workunit.client.0.smithi037.stdout:{ 2024-09-12T17:20:10.897 INFO:tasks.workunit.client.0.smithi037.stdout: "obj": { 2024-09-12T17:20:10.897 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket": { 2024-09-12T17:20:10.897 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "test", 2024-09-12T17:20:10.897 INFO:tasks.workunit.client.0.smithi037.stdout: "marker": "marker", 2024-09-12T17:20:10.897 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:10.898 INFO:tasks.workunit.client.0.smithi037.stdout: "tenant": "", 2024-09-12T17:20:10.898 INFO:tasks.workunit.client.0.smithi037.stdout: "explicit_placement": { 2024-09-12T17:20:10.898 INFO:tasks.workunit.client.0.smithi037.stdout: "data_pool": "", 2024-09-12T17:20:10.898 INFO:tasks.workunit.client.0.smithi037.stdout: "data_extra_pool": "", 2024-09-12T17:20:10.898 INFO:tasks.workunit.client.0.smithi037.stdout: "index_pool": "" 2024-09-12T17:20:10.898 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.898 INFO:tasks.workunit.client.0.smithi037.stdout: }, 2024-09-12T17:20:10.898 INFO:tasks.workunit.client.0.smithi037.stdout: "key": { 2024-09-12T17:20:10.898 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "_myobj_", 2024-09-12T17:20:10.898 INFO:tasks.workunit.client.0.smithi037.stdout: "instance": "inst", 2024-09-12T17:20:10.898 INFO:tasks.workunit.client.0.smithi037.stdout: "ns": "ns" 2024-09-12T17:20:10.898 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.898 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.898 INFO:tasks.workunit.client.0.smithi037.stdout:} 2024-09-12T17:20:10.899 INFO:tasks.workunit.client.0.smithi037.stdout:{ 2024-09-12T17:20:10.899 INFO:tasks.workunit.client.0.smithi037.stdout: "raw_obj": { 2024-09-12T17:20:10.899 INFO:tasks.workunit.client.0.smithi037.stdout: "pool": "default-placement.data", 2024-09-12T17:20:10.899 INFO:tasks.workunit.client.0.smithi037.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-12T17:20:10.899 INFO:tasks.workunit.client.0.smithi037.stdout: "loc": "" 2024-09-12T17:20:10.899 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.899 INFO:tasks.workunit.client.0.smithi037.stdout:} 2024-09-12T17:20:10.899 INFO:tasks.workunit.client.0.smithi037.stdout:{ 2024-09-12T17:20:10.899 INFO:tasks.workunit.client.0.smithi037.stdout: "new_obj": { 2024-09-12T17:20:10.899 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket": { 2024-09-12T17:20:10.899 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "test", 2024-09-12T17:20:10.899 INFO:tasks.workunit.client.0.smithi037.stdout: "marker": "marker", 2024-09-12T17:20:10.899 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:10.899 INFO:tasks.workunit.client.0.smithi037.stdout: "tenant": "", 2024-09-12T17:20:10.899 INFO:tasks.workunit.client.0.smithi037.stdout: "explicit_placement": { 2024-09-12T17:20:10.900 INFO:tasks.workunit.client.0.smithi037.stdout: "data_pool": "", 2024-09-12T17:20:10.900 INFO:tasks.workunit.client.0.smithi037.stdout: "data_extra_pool": "", 2024-09-12T17:20:10.900 INFO:tasks.workunit.client.0.smithi037.stdout: "index_pool": "" 2024-09-12T17:20:10.900 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.900 INFO:tasks.workunit.client.0.smithi037.stdout: }, 2024-09-12T17:20:10.900 INFO:tasks.workunit.client.0.smithi037.stdout: "key": { 2024-09-12T17:20:10.900 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "_myobj_", 2024-09-12T17:20:10.900 INFO:tasks.workunit.client.0.smithi037.stdout: "instance": "inst", 2024-09-12T17:20:10.900 INFO:tasks.workunit.client.0.smithi037.stdout: "ns": "ns" 2024-09-12T17:20:10.900 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.900 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.900 INFO:tasks.workunit.client.0.smithi037.stdout:} 2024-09-12T17:20:10.900 INFO:tasks.workunit.client.0.smithi037.stdout:{ 2024-09-12T17:20:10.901 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket": { 2024-09-12T17:20:10.901 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "ebtest", 2024-09-12T17:20:10.901 INFO:tasks.workunit.client.0.smithi037.stdout: "marker": "marker", 2024-09-12T17:20:10.901 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:10.901 INFO:tasks.workunit.client.0.smithi037.stdout: "tenant": "", 2024-09-12T17:20:10.901 INFO:tasks.workunit.client.0.smithi037.stdout: "explicit_placement": { 2024-09-12T17:20:10.901 INFO:tasks.workunit.client.0.smithi037.stdout: "data_pool": ".data-pool", 2024-09-12T17:20:10.901 INFO:tasks.workunit.client.0.smithi037.stdout: "data_extra_pool": "", 2024-09-12T17:20:10.901 INFO:tasks.workunit.client.0.smithi037.stdout: "index_pool": ".index-pool" 2024-09-12T17:20:10.901 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.901 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.901 INFO:tasks.workunit.client.0.smithi037.stdout:} 2024-09-12T17:20:10.901 INFO:tasks.workunit.client.0.smithi037.stdout:{ 2024-09-12T17:20:10.901 INFO:tasks.workunit.client.0.smithi037.stdout: "obj": { 2024-09-12T17:20:10.902 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket": { 2024-09-12T17:20:10.902 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "ebtest", 2024-09-12T17:20:10.902 INFO:tasks.workunit.client.0.smithi037.stdout: "marker": "marker", 2024-09-12T17:20:10.902 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:10.902 INFO:tasks.workunit.client.0.smithi037.stdout: "tenant": "", 2024-09-12T17:20:10.902 INFO:tasks.workunit.client.0.smithi037.stdout: "explicit_placement": { 2024-09-12T17:20:10.902 INFO:tasks.workunit.client.0.smithi037.stdout: "data_pool": ".data-pool", 2024-09-12T17:20:10.902 INFO:tasks.workunit.client.0.smithi037.stdout: "data_extra_pool": "", 2024-09-12T17:20:10.902 INFO:tasks.workunit.client.0.smithi037.stdout: "index_pool": ".index-pool" 2024-09-12T17:20:10.902 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.902 INFO:tasks.workunit.client.0.smithi037.stdout: }, 2024-09-12T17:20:10.902 INFO:tasks.workunit.client.0.smithi037.stdout: "key": { 2024-09-12T17:20:10.902 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "_myobj_", 2024-09-12T17:20:10.902 INFO:tasks.workunit.client.0.smithi037.stdout: "instance": "inst", 2024-09-12T17:20:10.902 INFO:tasks.workunit.client.0.smithi037.stdout: "ns": "ns" 2024-09-12T17:20:10.903 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.903 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.903 INFO:tasks.workunit.client.0.smithi037.stdout:} 2024-09-12T17:20:10.903 INFO:tasks.workunit.client.0.smithi037.stdout:{ 2024-09-12T17:20:10.903 INFO:tasks.workunit.client.0.smithi037.stdout: "raw_obj": { 2024-09-12T17:20:10.903 INFO:tasks.workunit.client.0.smithi037.stdout: "pool": ".data-pool", 2024-09-12T17:20:10.903 INFO:tasks.workunit.client.0.smithi037.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-12T17:20:10.903 INFO:tasks.workunit.client.0.smithi037.stdout: "loc": "" 2024-09-12T17:20:10.903 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.903 INFO:tasks.workunit.client.0.smithi037.stdout:} 2024-09-12T17:20:10.903 INFO:tasks.workunit.client.0.smithi037.stdout:{ 2024-09-12T17:20:10.903 INFO:tasks.workunit.client.0.smithi037.stdout: "new_obj": { 2024-09-12T17:20:10.903 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket": { 2024-09-12T17:20:10.904 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "ebtest", 2024-09-12T17:20:10.904 INFO:tasks.workunit.client.0.smithi037.stdout: "marker": "marker", 2024-09-12T17:20:10.904 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:10.904 INFO:tasks.workunit.client.0.smithi037.stdout: "tenant": "", 2024-09-12T17:20:10.904 INFO:tasks.workunit.client.0.smithi037.stdout: "explicit_placement": { 2024-09-12T17:20:10.904 INFO:tasks.workunit.client.0.smithi037.stdout: "data_pool": ".data-pool", 2024-09-12T17:20:10.904 INFO:tasks.workunit.client.0.smithi037.stdout: "data_extra_pool": "", 2024-09-12T17:20:10.904 INFO:tasks.workunit.client.0.smithi037.stdout: "index_pool": ".index-pool" 2024-09-12T17:20:10.904 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.904 INFO:tasks.workunit.client.0.smithi037.stdout: }, 2024-09-12T17:20:10.904 INFO:tasks.workunit.client.0.smithi037.stdout: "key": { 2024-09-12T17:20:10.904 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "_myobj_", 2024-09-12T17:20:10.904 INFO:tasks.workunit.client.0.smithi037.stdout: "instance": "inst", 2024-09-12T17:20:10.904 INFO:tasks.workunit.client.0.smithi037.stdout: "ns": "ns" 2024-09-12T17:20:10.905 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.905 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.905 INFO:tasks.workunit.client.0.smithi037.stdout:} 2024-09-12T17:20:10.905 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] TestRGWObj.obj_to_raw (0 ms) 2024-09-12T17:20:10.905 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] TestRGWObj.old_to_raw 2024-09-12T17:20:10.905 INFO:tasks.workunit.client.0.smithi037.stdout:{ 2024-09-12T17:20:10.905 INFO:tasks.workunit.client.0.smithi037.stdout: "raw_obj": { 2024-09-12T17:20:10.905 INFO:tasks.workunit.client.0.smithi037.stdout: "pool": ".data-pool", 2024-09-12T17:20:10.905 INFO:tasks.workunit.client.0.smithi037.stdout: "oid": "marker_myobj", 2024-09-12T17:20:10.905 INFO:tasks.workunit.client.0.smithi037.stdout: "loc": "" 2024-09-12T17:20:10.905 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.905 INFO:tasks.workunit.client.0.smithi037.stdout:} 2024-09-12T17:20:10.905 INFO:tasks.workunit.client.0.smithi037.stdout:{ 2024-09-12T17:20:10.905 INFO:tasks.workunit.client.0.smithi037.stdout: "new_obj": { 2024-09-12T17:20:10.906 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket": { 2024-09-12T17:20:10.906 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "ebtest", 2024-09-12T17:20:10.906 INFO:tasks.workunit.client.0.smithi037.stdout: "marker": "marker", 2024-09-12T17:20:10.906 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:10.906 INFO:tasks.workunit.client.0.smithi037.stdout: "tenant": "", 2024-09-12T17:20:10.906 INFO:tasks.workunit.client.0.smithi037.stdout: "explicit_placement": { 2024-09-12T17:20:10.906 INFO:tasks.workunit.client.0.smithi037.stdout: "data_pool": ".data-pool", 2024-09-12T17:20:10.906 INFO:tasks.workunit.client.0.smithi037.stdout: "data_extra_pool": "", 2024-09-12T17:20:10.906 INFO:tasks.workunit.client.0.smithi037.stdout: "index_pool": ".index-pool" 2024-09-12T17:20:10.906 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.906 INFO:tasks.workunit.client.0.smithi037.stdout: }, 2024-09-12T17:20:10.906 INFO:tasks.workunit.client.0.smithi037.stdout: "key": { 2024-09-12T17:20:10.906 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "myobj", 2024-09-12T17:20:10.906 INFO:tasks.workunit.client.0.smithi037.stdout: "instance": "", 2024-09-12T17:20:10.907 INFO:tasks.workunit.client.0.smithi037.stdout: "ns": "" 2024-09-12T17:20:10.907 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.907 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.907 INFO:tasks.workunit.client.0.smithi037.stdout:} 2024-09-12T17:20:10.907 INFO:tasks.workunit.client.0.smithi037.stdout:raw=.data-pool:marker_myobj 2024-09-12T17:20:10.907 INFO:tasks.workunit.client.0.smithi037.stdout:{ 2024-09-12T17:20:10.907 INFO:tasks.workunit.client.0.smithi037.stdout: "raw_obj2": { 2024-09-12T17:20:10.907 INFO:tasks.workunit.client.0.smithi037.stdout: "pool": ".data-pool", 2024-09-12T17:20:10.907 INFO:tasks.workunit.client.0.smithi037.stdout: "oid": "marker_myobj", 2024-09-12T17:20:10.907 INFO:tasks.workunit.client.0.smithi037.stdout: "loc": "" 2024-09-12T17:20:10.907 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.907 INFO:tasks.workunit.client.0.smithi037.stdout:} 2024-09-12T17:20:10.907 INFO:tasks.workunit.client.0.smithi037.stdout:{ 2024-09-12T17:20:10.907 INFO:tasks.workunit.client.0.smithi037.stdout: "new_obj2": { 2024-09-12T17:20:10.907 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket": { 2024-09-12T17:20:10.908 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "ebtest", 2024-09-12T17:20:10.908 INFO:tasks.workunit.client.0.smithi037.stdout: "marker": "marker", 2024-09-12T17:20:10.908 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:10.908 INFO:tasks.workunit.client.0.smithi037.stdout: "tenant": "", 2024-09-12T17:20:10.908 INFO:tasks.workunit.client.0.smithi037.stdout: "explicit_placement": { 2024-09-12T17:20:10.908 INFO:tasks.workunit.client.0.smithi037.stdout: "data_pool": ".data-pool", 2024-09-12T17:20:10.908 INFO:tasks.workunit.client.0.smithi037.stdout: "data_extra_pool": "", 2024-09-12T17:20:10.908 INFO:tasks.workunit.client.0.smithi037.stdout: "index_pool": ".index-pool" 2024-09-12T17:20:10.908 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.908 INFO:tasks.workunit.client.0.smithi037.stdout: }, 2024-09-12T17:20:10.908 INFO:tasks.workunit.client.0.smithi037.stdout: "key": { 2024-09-12T17:20:10.908 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "myobj", 2024-09-12T17:20:10.908 INFO:tasks.workunit.client.0.smithi037.stdout: "instance": "", 2024-09-12T17:20:10.909 INFO:tasks.workunit.client.0.smithi037.stdout: "ns": "" 2024-09-12T17:20:10.909 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.909 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.909 INFO:tasks.workunit.client.0.smithi037.stdout:} 2024-09-12T17:20:10.909 INFO:tasks.workunit.client.0.smithi037.stdout:raw2=.data-pool:marker_myobj 2024-09-12T17:20:10.909 INFO:tasks.workunit.client.0.smithi037.stdout:{ 2024-09-12T17:20:10.909 INFO:tasks.workunit.client.0.smithi037.stdout: "raw_obj": { 2024-09-12T17:20:10.909 INFO:tasks.workunit.client.0.smithi037.stdout: "pool": ".data-pool", 2024-09-12T17:20:10.909 INFO:tasks.workunit.client.0.smithi037.stdout: "oid": "marker__ns_myobj", 2024-09-12T17:20:10.909 INFO:tasks.workunit.client.0.smithi037.stdout: "loc": "" 2024-09-12T17:20:10.909 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.909 INFO:tasks.workunit.client.0.smithi037.stdout:} 2024-09-12T17:20:10.909 INFO:tasks.workunit.client.0.smithi037.stdout:{ 2024-09-12T17:20:10.909 INFO:tasks.workunit.client.0.smithi037.stdout: "new_obj": { 2024-09-12T17:20:10.910 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket": { 2024-09-12T17:20:10.910 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "ebtest", 2024-09-12T17:20:10.910 INFO:tasks.workunit.client.0.smithi037.stdout: "marker": "marker", 2024-09-12T17:20:10.910 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:10.910 INFO:tasks.workunit.client.0.smithi037.stdout: "tenant": "", 2024-09-12T17:20:10.910 INFO:tasks.workunit.client.0.smithi037.stdout: "explicit_placement": { 2024-09-12T17:20:10.910 INFO:tasks.workunit.client.0.smithi037.stdout: "data_pool": ".data-pool", 2024-09-12T17:20:10.910 INFO:tasks.workunit.client.0.smithi037.stdout: "data_extra_pool": "", 2024-09-12T17:20:10.910 INFO:tasks.workunit.client.0.smithi037.stdout: "index_pool": ".index-pool" 2024-09-12T17:20:10.910 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.910 INFO:tasks.workunit.client.0.smithi037.stdout: }, 2024-09-12T17:20:10.910 INFO:tasks.workunit.client.0.smithi037.stdout: "key": { 2024-09-12T17:20:10.910 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "myobj", 2024-09-12T17:20:10.910 INFO:tasks.workunit.client.0.smithi037.stdout: "instance": "", 2024-09-12T17:20:10.911 INFO:tasks.workunit.client.0.smithi037.stdout: "ns": "ns" 2024-09-12T17:20:10.911 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.911 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.911 INFO:tasks.workunit.client.0.smithi037.stdout:} 2024-09-12T17:20:10.911 INFO:tasks.workunit.client.0.smithi037.stdout:raw=.data-pool:marker__ns_myobj 2024-09-12T17:20:10.911 INFO:tasks.workunit.client.0.smithi037.stdout:{ 2024-09-12T17:20:10.911 INFO:tasks.workunit.client.0.smithi037.stdout: "raw_obj2": { 2024-09-12T17:20:10.911 INFO:tasks.workunit.client.0.smithi037.stdout: "pool": ".data-pool", 2024-09-12T17:20:10.911 INFO:tasks.workunit.client.0.smithi037.stdout: "oid": "marker__ns_myobj", 2024-09-12T17:20:10.911 INFO:tasks.workunit.client.0.smithi037.stdout: "loc": "" 2024-09-12T17:20:10.911 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.911 INFO:tasks.workunit.client.0.smithi037.stdout:} 2024-09-12T17:20:10.911 INFO:tasks.workunit.client.0.smithi037.stdout:{ 2024-09-12T17:20:10.911 INFO:tasks.workunit.client.0.smithi037.stdout: "new_obj2": { 2024-09-12T17:20:10.912 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket": { 2024-09-12T17:20:10.912 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "ebtest", 2024-09-12T17:20:10.912 INFO:tasks.workunit.client.0.smithi037.stdout: "marker": "marker", 2024-09-12T17:20:10.912 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:10.912 INFO:tasks.workunit.client.0.smithi037.stdout: "tenant": "", 2024-09-12T17:20:10.912 INFO:tasks.workunit.client.0.smithi037.stdout: "explicit_placement": { 2024-09-12T17:20:10.912 INFO:tasks.workunit.client.0.smithi037.stdout: "data_pool": ".data-pool", 2024-09-12T17:20:10.912 INFO:tasks.workunit.client.0.smithi037.stdout: "data_extra_pool": "", 2024-09-12T17:20:10.912 INFO:tasks.workunit.client.0.smithi037.stdout: "index_pool": ".index-pool" 2024-09-12T17:20:10.912 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.912 INFO:tasks.workunit.client.0.smithi037.stdout: }, 2024-09-12T17:20:10.912 INFO:tasks.workunit.client.0.smithi037.stdout: "key": { 2024-09-12T17:20:10.912 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "myobj", 2024-09-12T17:20:10.913 INFO:tasks.workunit.client.0.smithi037.stdout: "instance": "", 2024-09-12T17:20:10.913 INFO:tasks.workunit.client.0.smithi037.stdout: "ns": "ns" 2024-09-12T17:20:10.913 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.913 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.913 INFO:tasks.workunit.client.0.smithi037.stdout:} 2024-09-12T17:20:10.913 INFO:tasks.workunit.client.0.smithi037.stdout:raw2=.data-pool:marker__ns_myobj 2024-09-12T17:20:10.913 INFO:tasks.workunit.client.0.smithi037.stdout:{ 2024-09-12T17:20:10.913 INFO:tasks.workunit.client.0.smithi037.stdout: "raw_obj": { 2024-09-12T17:20:10.913 INFO:tasks.workunit.client.0.smithi037.stdout: "pool": ".data-pool", 2024-09-12T17:20:10.913 INFO:tasks.workunit.client.0.smithi037.stdout: "oid": "marker__:inst_myobj", 2024-09-12T17:20:10.913 INFO:tasks.workunit.client.0.smithi037.stdout: "loc": "" 2024-09-12T17:20:10.913 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.913 INFO:tasks.workunit.client.0.smithi037.stdout:} 2024-09-12T17:20:10.913 INFO:tasks.workunit.client.0.smithi037.stdout:{ 2024-09-12T17:20:10.914 INFO:tasks.workunit.client.0.smithi037.stdout: "new_obj": { 2024-09-12T17:20:10.914 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket": { 2024-09-12T17:20:10.914 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "ebtest", 2024-09-12T17:20:10.914 INFO:tasks.workunit.client.0.smithi037.stdout: "marker": "marker", 2024-09-12T17:20:10.914 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:10.914 INFO:tasks.workunit.client.0.smithi037.stdout: "tenant": "", 2024-09-12T17:20:10.914 INFO:tasks.workunit.client.0.smithi037.stdout: "explicit_placement": { 2024-09-12T17:20:10.914 INFO:tasks.workunit.client.0.smithi037.stdout: "data_pool": ".data-pool", 2024-09-12T17:20:10.914 INFO:tasks.workunit.client.0.smithi037.stdout: "data_extra_pool": "", 2024-09-12T17:20:10.914 INFO:tasks.workunit.client.0.smithi037.stdout: "index_pool": ".index-pool" 2024-09-12T17:20:10.914 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.914 INFO:tasks.workunit.client.0.smithi037.stdout: }, 2024-09-12T17:20:10.914 INFO:tasks.workunit.client.0.smithi037.stdout: "key": { 2024-09-12T17:20:10.914 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "myobj", 2024-09-12T17:20:10.914 INFO:tasks.workunit.client.0.smithi037.stdout: "instance": "inst", 2024-09-12T17:20:10.915 INFO:tasks.workunit.client.0.smithi037.stdout: "ns": "" 2024-09-12T17:20:10.915 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.915 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.915 INFO:tasks.workunit.client.0.smithi037.stdout:} 2024-09-12T17:20:10.915 INFO:tasks.workunit.client.0.smithi037.stdout:raw=.data-pool:marker__:inst_myobj 2024-09-12T17:20:10.915 INFO:tasks.workunit.client.0.smithi037.stdout:{ 2024-09-12T17:20:10.915 INFO:tasks.workunit.client.0.smithi037.stdout: "raw_obj2": { 2024-09-12T17:20:10.915 INFO:tasks.workunit.client.0.smithi037.stdout: "pool": ".data-pool", 2024-09-12T17:20:10.915 INFO:tasks.workunit.client.0.smithi037.stdout: "oid": "marker__:inst_myobj", 2024-09-12T17:20:10.915 INFO:tasks.workunit.client.0.smithi037.stdout: "loc": "" 2024-09-12T17:20:10.915 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.915 INFO:tasks.workunit.client.0.smithi037.stdout:} 2024-09-12T17:20:10.915 INFO:tasks.workunit.client.0.smithi037.stdout:{ 2024-09-12T17:20:10.915 INFO:tasks.workunit.client.0.smithi037.stdout: "new_obj2": { 2024-09-12T17:20:10.916 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket": { 2024-09-12T17:20:10.916 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "ebtest", 2024-09-12T17:20:10.916 INFO:tasks.workunit.client.0.smithi037.stdout: "marker": "marker", 2024-09-12T17:20:10.916 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:10.916 INFO:tasks.workunit.client.0.smithi037.stdout: "tenant": "", 2024-09-12T17:20:10.916 INFO:tasks.workunit.client.0.smithi037.stdout: "explicit_placement": { 2024-09-12T17:20:10.916 INFO:tasks.workunit.client.0.smithi037.stdout: "data_pool": ".data-pool", 2024-09-12T17:20:10.916 INFO:tasks.workunit.client.0.smithi037.stdout: "data_extra_pool": "", 2024-09-12T17:20:10.916 INFO:tasks.workunit.client.0.smithi037.stdout: "index_pool": ".index-pool" 2024-09-12T17:20:10.916 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.916 INFO:tasks.workunit.client.0.smithi037.stdout: }, 2024-09-12T17:20:10.916 INFO:tasks.workunit.client.0.smithi037.stdout: "key": { 2024-09-12T17:20:10.916 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "myobj", 2024-09-12T17:20:10.916 INFO:tasks.workunit.client.0.smithi037.stdout: "instance": "inst", 2024-09-12T17:20:10.917 INFO:tasks.workunit.client.0.smithi037.stdout: "ns": "" 2024-09-12T17:20:10.917 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.917 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.917 INFO:tasks.workunit.client.0.smithi037.stdout:} 2024-09-12T17:20:10.917 INFO:tasks.workunit.client.0.smithi037.stdout:raw2=.data-pool:marker__:inst_myobj 2024-09-12T17:20:10.917 INFO:tasks.workunit.client.0.smithi037.stdout:{ 2024-09-12T17:20:10.917 INFO:tasks.workunit.client.0.smithi037.stdout: "raw_obj": { 2024-09-12T17:20:10.917 INFO:tasks.workunit.client.0.smithi037.stdout: "pool": ".data-pool", 2024-09-12T17:20:10.917 INFO:tasks.workunit.client.0.smithi037.stdout: "oid": "marker__ns:inst_myobj", 2024-09-12T17:20:10.917 INFO:tasks.workunit.client.0.smithi037.stdout: "loc": "" 2024-09-12T17:20:10.917 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.917 INFO:tasks.workunit.client.0.smithi037.stdout:} 2024-09-12T17:20:10.917 INFO:tasks.workunit.client.0.smithi037.stdout:{ 2024-09-12T17:20:10.917 INFO:tasks.workunit.client.0.smithi037.stdout: "new_obj": { 2024-09-12T17:20:10.917 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket": { 2024-09-12T17:20:10.918 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "ebtest", 2024-09-12T17:20:10.918 INFO:tasks.workunit.client.0.smithi037.stdout: "marker": "marker", 2024-09-12T17:20:10.918 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:10.918 INFO:tasks.workunit.client.0.smithi037.stdout: "tenant": "", 2024-09-12T17:20:10.918 INFO:tasks.workunit.client.0.smithi037.stdout: "explicit_placement": { 2024-09-12T17:20:10.918 INFO:tasks.workunit.client.0.smithi037.stdout: "data_pool": ".data-pool", 2024-09-12T17:20:10.918 INFO:tasks.workunit.client.0.smithi037.stdout: "data_extra_pool": "", 2024-09-12T17:20:10.918 INFO:tasks.workunit.client.0.smithi037.stdout: "index_pool": ".index-pool" 2024-09-12T17:20:10.918 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.918 INFO:tasks.workunit.client.0.smithi037.stdout: }, 2024-09-12T17:20:10.918 INFO:tasks.workunit.client.0.smithi037.stdout: "key": { 2024-09-12T17:20:10.918 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "myobj", 2024-09-12T17:20:10.918 INFO:tasks.workunit.client.0.smithi037.stdout: "instance": "inst", 2024-09-12T17:20:10.918 INFO:tasks.workunit.client.0.smithi037.stdout: "ns": "ns" 2024-09-12T17:20:10.918 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.919 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.919 INFO:tasks.workunit.client.0.smithi037.stdout:} 2024-09-12T17:20:10.919 INFO:tasks.workunit.client.0.smithi037.stdout:raw=.data-pool:marker__ns:inst_myobj 2024-09-12T17:20:10.919 INFO:tasks.workunit.client.0.smithi037.stdout:{ 2024-09-12T17:20:10.919 INFO:tasks.workunit.client.0.smithi037.stdout: "raw_obj2": { 2024-09-12T17:20:10.919 INFO:tasks.workunit.client.0.smithi037.stdout: "pool": ".data-pool", 2024-09-12T17:20:10.919 INFO:tasks.workunit.client.0.smithi037.stdout: "oid": "marker__ns:inst_myobj", 2024-09-12T17:20:10.919 INFO:tasks.workunit.client.0.smithi037.stdout: "loc": "" 2024-09-12T17:20:10.919 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.919 INFO:tasks.workunit.client.0.smithi037.stdout:} 2024-09-12T17:20:10.919 INFO:tasks.workunit.client.0.smithi037.stdout:{ 2024-09-12T17:20:10.919 INFO:tasks.workunit.client.0.smithi037.stdout: "new_obj2": { 2024-09-12T17:20:10.919 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket": { 2024-09-12T17:20:10.919 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "ebtest", 2024-09-12T17:20:10.920 INFO:tasks.workunit.client.0.smithi037.stdout: "marker": "marker", 2024-09-12T17:20:10.920 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:10.920 INFO:tasks.workunit.client.0.smithi037.stdout: "tenant": "", 2024-09-12T17:20:10.920 INFO:tasks.workunit.client.0.smithi037.stdout: "explicit_placement": { 2024-09-12T17:20:10.920 INFO:tasks.workunit.client.0.smithi037.stdout: "data_pool": ".data-pool", 2024-09-12T17:20:10.920 INFO:tasks.workunit.client.0.smithi037.stdout: "data_extra_pool": "", 2024-09-12T17:20:10.920 INFO:tasks.workunit.client.0.smithi037.stdout: "index_pool": ".index-pool" 2024-09-12T17:20:10.920 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.920 INFO:tasks.workunit.client.0.smithi037.stdout: }, 2024-09-12T17:20:10.920 INFO:tasks.workunit.client.0.smithi037.stdout: "key": { 2024-09-12T17:20:10.920 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "myobj", 2024-09-12T17:20:10.920 INFO:tasks.workunit.client.0.smithi037.stdout: "instance": "inst", 2024-09-12T17:20:10.920 INFO:tasks.workunit.client.0.smithi037.stdout: "ns": "ns" 2024-09-12T17:20:10.920 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.921 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.921 INFO:tasks.workunit.client.0.smithi037.stdout:} 2024-09-12T17:20:10.921 INFO:tasks.workunit.client.0.smithi037.stdout:raw2=.data-pool:marker__ns:inst_myobj 2024-09-12T17:20:10.921 INFO:tasks.workunit.client.0.smithi037.stdout:{ 2024-09-12T17:20:10.921 INFO:tasks.workunit.client.0.smithi037.stdout: "raw_obj": { 2024-09-12T17:20:10.921 INFO:tasks.workunit.client.0.smithi037.stdout: "pool": ".data-pool", 2024-09-12T17:20:10.921 INFO:tasks.workunit.client.0.smithi037.stdout: "oid": "marker___myobj", 2024-09-12T17:20:10.921 INFO:tasks.workunit.client.0.smithi037.stdout: "loc": "marker__myobj" 2024-09-12T17:20:10.921 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.921 INFO:tasks.workunit.client.0.smithi037.stdout:} 2024-09-12T17:20:10.921 INFO:tasks.workunit.client.0.smithi037.stdout:{ 2024-09-12T17:20:10.921 INFO:tasks.workunit.client.0.smithi037.stdout: "new_obj": { 2024-09-12T17:20:10.921 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket": { 2024-09-12T17:20:10.921 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "ebtest", 2024-09-12T17:20:10.922 INFO:tasks.workunit.client.0.smithi037.stdout: "marker": "marker", 2024-09-12T17:20:10.922 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:10.922 INFO:tasks.workunit.client.0.smithi037.stdout: "tenant": "", 2024-09-12T17:20:10.922 INFO:tasks.workunit.client.0.smithi037.stdout: "explicit_placement": { 2024-09-12T17:20:10.922 INFO:tasks.workunit.client.0.smithi037.stdout: "data_pool": ".data-pool", 2024-09-12T17:20:10.922 INFO:tasks.workunit.client.0.smithi037.stdout: "data_extra_pool": "", 2024-09-12T17:20:10.922 INFO:tasks.workunit.client.0.smithi037.stdout: "index_pool": ".index-pool" 2024-09-12T17:20:10.922 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.922 INFO:tasks.workunit.client.0.smithi037.stdout: }, 2024-09-12T17:20:10.922 INFO:tasks.workunit.client.0.smithi037.stdout: "key": { 2024-09-12T17:20:10.922 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "_myobj", 2024-09-12T17:20:10.922 INFO:tasks.workunit.client.0.smithi037.stdout: "instance": "", 2024-09-12T17:20:10.922 INFO:tasks.workunit.client.0.smithi037.stdout: "ns": "" 2024-09-12T17:20:10.922 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.923 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.923 INFO:tasks.workunit.client.0.smithi037.stdout:} 2024-09-12T17:20:10.923 INFO:tasks.workunit.client.0.smithi037.stdout:raw=.data-pool:marker___myobj 2024-09-12T17:20:10.923 INFO:tasks.workunit.client.0.smithi037.stdout:{ 2024-09-12T17:20:10.923 INFO:tasks.workunit.client.0.smithi037.stdout: "raw_obj2": { 2024-09-12T17:20:10.923 INFO:tasks.workunit.client.0.smithi037.stdout: "pool": ".data-pool", 2024-09-12T17:20:10.923 INFO:tasks.workunit.client.0.smithi037.stdout: "oid": "marker___myobj", 2024-09-12T17:20:10.923 INFO:tasks.workunit.client.0.smithi037.stdout: "loc": "marker__myobj" 2024-09-12T17:20:10.923 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.923 INFO:tasks.workunit.client.0.smithi037.stdout:} 2024-09-12T17:20:10.923 INFO:tasks.workunit.client.0.smithi037.stdout:{ 2024-09-12T17:20:10.923 INFO:tasks.workunit.client.0.smithi037.stdout: "new_obj2": { 2024-09-12T17:20:10.923 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket": { 2024-09-12T17:20:10.923 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "ebtest", 2024-09-12T17:20:10.924 INFO:tasks.workunit.client.0.smithi037.stdout: "marker": "marker", 2024-09-12T17:20:10.924 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:10.924 INFO:tasks.workunit.client.0.smithi037.stdout: "tenant": "", 2024-09-12T17:20:10.924 INFO:tasks.workunit.client.0.smithi037.stdout: "explicit_placement": { 2024-09-12T17:20:10.924 INFO:tasks.workunit.client.0.smithi037.stdout: "data_pool": ".data-pool", 2024-09-12T17:20:10.924 INFO:tasks.workunit.client.0.smithi037.stdout: "data_extra_pool": "", 2024-09-12T17:20:10.924 INFO:tasks.workunit.client.0.smithi037.stdout: "index_pool": ".index-pool" 2024-09-12T17:20:10.924 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.924 INFO:tasks.workunit.client.0.smithi037.stdout: }, 2024-09-12T17:20:10.924 INFO:tasks.workunit.client.0.smithi037.stdout: "key": { 2024-09-12T17:20:10.924 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "_myobj", 2024-09-12T17:20:10.924 INFO:tasks.workunit.client.0.smithi037.stdout: "instance": "", 2024-09-12T17:20:10.924 INFO:tasks.workunit.client.0.smithi037.stdout: "ns": "" 2024-09-12T17:20:10.925 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.925 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.925 INFO:tasks.workunit.client.0.smithi037.stdout:} 2024-09-12T17:20:10.925 INFO:tasks.workunit.client.0.smithi037.stdout:raw2=.data-pool:marker___myobj 2024-09-12T17:20:10.925 INFO:tasks.workunit.client.0.smithi037.stdout:{ 2024-09-12T17:20:10.925 INFO:tasks.workunit.client.0.smithi037.stdout: "raw_obj": { 2024-09-12T17:20:10.925 INFO:tasks.workunit.client.0.smithi037.stdout: "pool": ".data-pool", 2024-09-12T17:20:10.925 INFO:tasks.workunit.client.0.smithi037.stdout: "oid": "marker__ns__myobj", 2024-09-12T17:20:10.925 INFO:tasks.workunit.client.0.smithi037.stdout: "loc": "" 2024-09-12T17:20:10.925 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.925 INFO:tasks.workunit.client.0.smithi037.stdout:} 2024-09-12T17:20:10.925 INFO:tasks.workunit.client.0.smithi037.stdout:{ 2024-09-12T17:20:10.925 INFO:tasks.workunit.client.0.smithi037.stdout: "new_obj": { 2024-09-12T17:20:10.926 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket": { 2024-09-12T17:20:10.926 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "ebtest", 2024-09-12T17:20:10.926 INFO:tasks.workunit.client.0.smithi037.stdout: "marker": "marker", 2024-09-12T17:20:10.926 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:10.926 INFO:tasks.workunit.client.0.smithi037.stdout: "tenant": "", 2024-09-12T17:20:10.926 INFO:tasks.workunit.client.0.smithi037.stdout: "explicit_placement": { 2024-09-12T17:20:10.926 INFO:tasks.workunit.client.0.smithi037.stdout: "data_pool": ".data-pool", 2024-09-12T17:20:10.926 INFO:tasks.workunit.client.0.smithi037.stdout: "data_extra_pool": "", 2024-09-12T17:20:10.926 INFO:tasks.workunit.client.0.smithi037.stdout: "index_pool": ".index-pool" 2024-09-12T17:20:10.926 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.926 INFO:tasks.workunit.client.0.smithi037.stdout: }, 2024-09-12T17:20:10.926 INFO:tasks.workunit.client.0.smithi037.stdout: "key": { 2024-09-12T17:20:10.926 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "_myobj", 2024-09-12T17:20:10.926 INFO:tasks.workunit.client.0.smithi037.stdout: "instance": "", 2024-09-12T17:20:10.926 INFO:tasks.workunit.client.0.smithi037.stdout: "ns": "ns" 2024-09-12T17:20:10.927 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.927 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.927 INFO:tasks.workunit.client.0.smithi037.stdout:} 2024-09-12T17:20:10.927 INFO:tasks.workunit.client.0.smithi037.stdout:raw=.data-pool:marker__ns__myobj 2024-09-12T17:20:10.927 INFO:tasks.workunit.client.0.smithi037.stdout:{ 2024-09-12T17:20:10.927 INFO:tasks.workunit.client.0.smithi037.stdout: "raw_obj2": { 2024-09-12T17:20:10.927 INFO:tasks.workunit.client.0.smithi037.stdout: "pool": ".data-pool", 2024-09-12T17:20:10.927 INFO:tasks.workunit.client.0.smithi037.stdout: "oid": "marker__ns__myobj", 2024-09-12T17:20:10.927 INFO:tasks.workunit.client.0.smithi037.stdout: "loc": "" 2024-09-12T17:20:10.927 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.927 INFO:tasks.workunit.client.0.smithi037.stdout:} 2024-09-12T17:20:10.927 INFO:tasks.workunit.client.0.smithi037.stdout:{ 2024-09-12T17:20:10.927 INFO:tasks.workunit.client.0.smithi037.stdout: "new_obj2": { 2024-09-12T17:20:10.927 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket": { 2024-09-12T17:20:10.928 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "ebtest", 2024-09-12T17:20:10.928 INFO:tasks.workunit.client.0.smithi037.stdout: "marker": "marker", 2024-09-12T17:20:10.928 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:10.928 INFO:tasks.workunit.client.0.smithi037.stdout: "tenant": "", 2024-09-12T17:20:10.928 INFO:tasks.workunit.client.0.smithi037.stdout: "explicit_placement": { 2024-09-12T17:20:10.928 INFO:tasks.workunit.client.0.smithi037.stdout: "data_pool": ".data-pool", 2024-09-12T17:20:10.928 INFO:tasks.workunit.client.0.smithi037.stdout: "data_extra_pool": "", 2024-09-12T17:20:10.928 INFO:tasks.workunit.client.0.smithi037.stdout: "index_pool": ".index-pool" 2024-09-12T17:20:10.928 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.928 INFO:tasks.workunit.client.0.smithi037.stdout: }, 2024-09-12T17:20:10.928 INFO:tasks.workunit.client.0.smithi037.stdout: "key": { 2024-09-12T17:20:10.928 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "_myobj", 2024-09-12T17:20:10.928 INFO:tasks.workunit.client.0.smithi037.stdout: "instance": "", 2024-09-12T17:20:10.929 INFO:tasks.workunit.client.0.smithi037.stdout: "ns": "ns" 2024-09-12T17:20:10.929 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.929 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.929 INFO:tasks.workunit.client.0.smithi037.stdout:} 2024-09-12T17:20:10.929 INFO:tasks.workunit.client.0.smithi037.stdout:raw2=.data-pool:marker__ns__myobj 2024-09-12T17:20:10.929 INFO:tasks.workunit.client.0.smithi037.stdout:{ 2024-09-12T17:20:10.929 INFO:tasks.workunit.client.0.smithi037.stdout: "raw_obj": { 2024-09-12T17:20:10.929 INFO:tasks.workunit.client.0.smithi037.stdout: "pool": ".data-pool", 2024-09-12T17:20:10.929 INFO:tasks.workunit.client.0.smithi037.stdout: "oid": "marker__:inst__myobj", 2024-09-12T17:20:10.929 INFO:tasks.workunit.client.0.smithi037.stdout: "loc": "marker__myobj" 2024-09-12T17:20:10.929 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.929 INFO:tasks.workunit.client.0.smithi037.stdout:} 2024-09-12T17:20:10.929 INFO:tasks.workunit.client.0.smithi037.stdout:{ 2024-09-12T17:20:10.929 INFO:tasks.workunit.client.0.smithi037.stdout: "new_obj": { 2024-09-12T17:20:10.929 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket": { 2024-09-12T17:20:10.930 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "ebtest", 2024-09-12T17:20:10.930 INFO:tasks.workunit.client.0.smithi037.stdout: "marker": "marker", 2024-09-12T17:20:10.930 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:10.930 INFO:tasks.workunit.client.0.smithi037.stdout: "tenant": "", 2024-09-12T17:20:10.930 INFO:tasks.workunit.client.0.smithi037.stdout: "explicit_placement": { 2024-09-12T17:20:10.930 INFO:tasks.workunit.client.0.smithi037.stdout: "data_pool": ".data-pool", 2024-09-12T17:20:10.930 INFO:tasks.workunit.client.0.smithi037.stdout: "data_extra_pool": "", 2024-09-12T17:20:10.930 INFO:tasks.workunit.client.0.smithi037.stdout: "index_pool": ".index-pool" 2024-09-12T17:20:10.930 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.930 INFO:tasks.workunit.client.0.smithi037.stdout: }, 2024-09-12T17:20:10.930 INFO:tasks.workunit.client.0.smithi037.stdout: "key": { 2024-09-12T17:20:10.930 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "_myobj", 2024-09-12T17:20:10.930 INFO:tasks.workunit.client.0.smithi037.stdout: "instance": "inst", 2024-09-12T17:20:10.930 INFO:tasks.workunit.client.0.smithi037.stdout: "ns": "" 2024-09-12T17:20:10.931 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.931 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.931 INFO:tasks.workunit.client.0.smithi037.stdout:} 2024-09-12T17:20:10.931 INFO:tasks.workunit.client.0.smithi037.stdout:raw=.data-pool:marker__:inst__myobj 2024-09-12T17:20:10.931 INFO:tasks.workunit.client.0.smithi037.stdout:{ 2024-09-12T17:20:10.931 INFO:tasks.workunit.client.0.smithi037.stdout: "raw_obj2": { 2024-09-12T17:20:10.931 INFO:tasks.workunit.client.0.smithi037.stdout: "pool": ".data-pool", 2024-09-12T17:20:10.931 INFO:tasks.workunit.client.0.smithi037.stdout: "oid": "marker__:inst__myobj", 2024-09-12T17:20:10.931 INFO:tasks.workunit.client.0.smithi037.stdout: "loc": "marker__myobj" 2024-09-12T17:20:10.931 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.931 INFO:tasks.workunit.client.0.smithi037.stdout:} 2024-09-12T17:20:10.931 INFO:tasks.workunit.client.0.smithi037.stdout:{ 2024-09-12T17:20:10.931 INFO:tasks.workunit.client.0.smithi037.stdout: "new_obj2": { 2024-09-12T17:20:10.931 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket": { 2024-09-12T17:20:10.932 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "ebtest", 2024-09-12T17:20:10.932 INFO:tasks.workunit.client.0.smithi037.stdout: "marker": "marker", 2024-09-12T17:20:10.932 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:10.932 INFO:tasks.workunit.client.0.smithi037.stdout: "tenant": "", 2024-09-12T17:20:10.932 INFO:tasks.workunit.client.0.smithi037.stdout: "explicit_placement": { 2024-09-12T17:20:10.932 INFO:tasks.workunit.client.0.smithi037.stdout: "data_pool": ".data-pool", 2024-09-12T17:20:10.932 INFO:tasks.workunit.client.0.smithi037.stdout: "data_extra_pool": "", 2024-09-12T17:20:10.932 INFO:tasks.workunit.client.0.smithi037.stdout: "index_pool": ".index-pool" 2024-09-12T17:20:10.932 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.932 INFO:tasks.workunit.client.0.smithi037.stdout: }, 2024-09-12T17:20:10.932 INFO:tasks.workunit.client.0.smithi037.stdout: "key": { 2024-09-12T17:20:10.932 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "_myobj", 2024-09-12T17:20:10.932 INFO:tasks.workunit.client.0.smithi037.stdout: "instance": "inst", 2024-09-12T17:20:10.932 INFO:tasks.workunit.client.0.smithi037.stdout: "ns": "" 2024-09-12T17:20:10.932 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.933 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.933 INFO:tasks.workunit.client.0.smithi037.stdout:} 2024-09-12T17:20:10.933 INFO:tasks.workunit.client.0.smithi037.stdout:raw2=.data-pool:marker__:inst__myobj 2024-09-12T17:20:10.933 INFO:tasks.workunit.client.0.smithi037.stdout:{ 2024-09-12T17:20:10.933 INFO:tasks.workunit.client.0.smithi037.stdout: "raw_obj": { 2024-09-12T17:20:10.933 INFO:tasks.workunit.client.0.smithi037.stdout: "pool": ".data-pool", 2024-09-12T17:20:10.933 INFO:tasks.workunit.client.0.smithi037.stdout: "oid": "marker__ns:inst__myobj", 2024-09-12T17:20:10.933 INFO:tasks.workunit.client.0.smithi037.stdout: "loc": "" 2024-09-12T17:20:10.933 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.933 INFO:tasks.workunit.client.0.smithi037.stdout:} 2024-09-12T17:20:10.933 INFO:tasks.workunit.client.0.smithi037.stdout:{ 2024-09-12T17:20:10.933 INFO:tasks.workunit.client.0.smithi037.stdout: "new_obj": { 2024-09-12T17:20:10.933 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket": { 2024-09-12T17:20:10.933 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "ebtest", 2024-09-12T17:20:10.934 INFO:tasks.workunit.client.0.smithi037.stdout: "marker": "marker", 2024-09-12T17:20:10.934 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:10.934 INFO:tasks.workunit.client.0.smithi037.stdout: "tenant": "", 2024-09-12T17:20:10.934 INFO:tasks.workunit.client.0.smithi037.stdout: "explicit_placement": { 2024-09-12T17:20:10.934 INFO:tasks.workunit.client.0.smithi037.stdout: "data_pool": ".data-pool", 2024-09-12T17:20:10.934 INFO:tasks.workunit.client.0.smithi037.stdout: "data_extra_pool": "", 2024-09-12T17:20:10.934 INFO:tasks.workunit.client.0.smithi037.stdout: "index_pool": ".index-pool" 2024-09-12T17:20:10.934 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.934 INFO:tasks.workunit.client.0.smithi037.stdout: }, 2024-09-12T17:20:10.934 INFO:tasks.workunit.client.0.smithi037.stdout: "key": { 2024-09-12T17:20:10.934 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "_myobj", 2024-09-12T17:20:10.934 INFO:tasks.workunit.client.0.smithi037.stdout: "instance": "inst", 2024-09-12T17:20:10.934 INFO:tasks.workunit.client.0.smithi037.stdout: "ns": "ns" 2024-09-12T17:20:10.934 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.935 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.935 INFO:tasks.workunit.client.0.smithi037.stdout:} 2024-09-12T17:20:10.935 INFO:tasks.workunit.client.0.smithi037.stdout:raw=.data-pool:marker__ns:inst__myobj 2024-09-12T17:20:10.935 INFO:tasks.workunit.client.0.smithi037.stdout:{ 2024-09-12T17:20:10.935 INFO:tasks.workunit.client.0.smithi037.stdout: "raw_obj2": { 2024-09-12T17:20:10.935 INFO:tasks.workunit.client.0.smithi037.stdout: "pool": ".data-pool", 2024-09-12T17:20:10.935 INFO:tasks.workunit.client.0.smithi037.stdout: "oid": "marker__ns:inst__myobj", 2024-09-12T17:20:10.935 INFO:tasks.workunit.client.0.smithi037.stdout: "loc": "" 2024-09-12T17:20:10.935 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.935 INFO:tasks.workunit.client.0.smithi037.stdout:} 2024-09-12T17:20:10.935 INFO:tasks.workunit.client.0.smithi037.stdout:{ 2024-09-12T17:20:10.935 INFO:tasks.workunit.client.0.smithi037.stdout: "new_obj2": { 2024-09-12T17:20:10.935 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket": { 2024-09-12T17:20:10.935 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "ebtest", 2024-09-12T17:20:10.936 INFO:tasks.workunit.client.0.smithi037.stdout: "marker": "marker", 2024-09-12T17:20:10.936 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:10.936 INFO:tasks.workunit.client.0.smithi037.stdout: "tenant": "", 2024-09-12T17:20:10.936 INFO:tasks.workunit.client.0.smithi037.stdout: "explicit_placement": { 2024-09-12T17:20:10.936 INFO:tasks.workunit.client.0.smithi037.stdout: "data_pool": ".data-pool", 2024-09-12T17:20:10.936 INFO:tasks.workunit.client.0.smithi037.stdout: "data_extra_pool": "", 2024-09-12T17:20:10.936 INFO:tasks.workunit.client.0.smithi037.stdout: "index_pool": ".index-pool" 2024-09-12T17:20:10.936 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.936 INFO:tasks.workunit.client.0.smithi037.stdout: }, 2024-09-12T17:20:10.936 INFO:tasks.workunit.client.0.smithi037.stdout: "key": { 2024-09-12T17:20:10.936 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "_myobj", 2024-09-12T17:20:10.936 INFO:tasks.workunit.client.0.smithi037.stdout: "instance": "inst", 2024-09-12T17:20:10.936 INFO:tasks.workunit.client.0.smithi037.stdout: "ns": "ns" 2024-09-12T17:20:10.936 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.937 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.937 INFO:tasks.workunit.client.0.smithi037.stdout:} 2024-09-12T17:20:10.937 INFO:tasks.workunit.client.0.smithi037.stdout:raw2=.data-pool:marker__ns:inst__myobj 2024-09-12T17:20:10.937 INFO:tasks.workunit.client.0.smithi037.stdout:{ 2024-09-12T17:20:10.937 INFO:tasks.workunit.client.0.smithi037.stdout: "raw_obj": { 2024-09-12T17:20:10.937 INFO:tasks.workunit.client.0.smithi037.stdout: "pool": ".data-pool", 2024-09-12T17:20:10.937 INFO:tasks.workunit.client.0.smithi037.stdout: "oid": "marker___myobj_", 2024-09-12T17:20:10.937 INFO:tasks.workunit.client.0.smithi037.stdout: "loc": "marker__myobj_" 2024-09-12T17:20:10.937 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.937 INFO:tasks.workunit.client.0.smithi037.stdout:} 2024-09-12T17:20:10.937 INFO:tasks.workunit.client.0.smithi037.stdout:{ 2024-09-12T17:20:10.937 INFO:tasks.workunit.client.0.smithi037.stdout: "new_obj": { 2024-09-12T17:20:10.937 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket": { 2024-09-12T17:20:10.937 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "ebtest", 2024-09-12T17:20:10.937 INFO:tasks.workunit.client.0.smithi037.stdout: "marker": "marker", 2024-09-12T17:20:10.938 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:10.938 INFO:tasks.workunit.client.0.smithi037.stdout: "tenant": "", 2024-09-12T17:20:10.938 INFO:tasks.workunit.client.0.smithi037.stdout: "explicit_placement": { 2024-09-12T17:20:10.938 INFO:tasks.workunit.client.0.smithi037.stdout: "data_pool": ".data-pool", 2024-09-12T17:20:10.938 INFO:tasks.workunit.client.0.smithi037.stdout: "data_extra_pool": "", 2024-09-12T17:20:10.938 INFO:tasks.workunit.client.0.smithi037.stdout: "index_pool": ".index-pool" 2024-09-12T17:20:10.938 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.938 INFO:tasks.workunit.client.0.smithi037.stdout: }, 2024-09-12T17:20:10.938 INFO:tasks.workunit.client.0.smithi037.stdout: "key": { 2024-09-12T17:20:10.938 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "_myobj_", 2024-09-12T17:20:10.938 INFO:tasks.workunit.client.0.smithi037.stdout: "instance": "", 2024-09-12T17:20:10.938 INFO:tasks.workunit.client.0.smithi037.stdout: "ns": "" 2024-09-12T17:20:10.938 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.938 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.938 INFO:tasks.workunit.client.0.smithi037.stdout:} 2024-09-12T17:20:10.939 INFO:tasks.workunit.client.0.smithi037.stdout:raw=.data-pool:marker___myobj_ 2024-09-12T17:20:10.939 INFO:tasks.workunit.client.0.smithi037.stdout:{ 2024-09-12T17:20:10.939 INFO:tasks.workunit.client.0.smithi037.stdout: "raw_obj2": { 2024-09-12T17:20:10.939 INFO:tasks.workunit.client.0.smithi037.stdout: "pool": ".data-pool", 2024-09-12T17:20:10.939 INFO:tasks.workunit.client.0.smithi037.stdout: "oid": "marker___myobj_", 2024-09-12T17:20:10.939 INFO:tasks.workunit.client.0.smithi037.stdout: "loc": "marker__myobj_" 2024-09-12T17:20:10.939 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.939 INFO:tasks.workunit.client.0.smithi037.stdout:} 2024-09-12T17:20:10.939 INFO:tasks.workunit.client.0.smithi037.stdout:{ 2024-09-12T17:20:10.939 INFO:tasks.workunit.client.0.smithi037.stdout: "new_obj2": { 2024-09-12T17:20:10.939 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket": { 2024-09-12T17:20:10.939 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "ebtest", 2024-09-12T17:20:10.939 INFO:tasks.workunit.client.0.smithi037.stdout: "marker": "marker", 2024-09-12T17:20:10.939 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:10.939 INFO:tasks.workunit.client.0.smithi037.stdout: "tenant": "", 2024-09-12T17:20:10.940 INFO:tasks.workunit.client.0.smithi037.stdout: "explicit_placement": { 2024-09-12T17:20:10.940 INFO:tasks.workunit.client.0.smithi037.stdout: "data_pool": ".data-pool", 2024-09-12T17:20:10.940 INFO:tasks.workunit.client.0.smithi037.stdout: "data_extra_pool": "", 2024-09-12T17:20:10.940 INFO:tasks.workunit.client.0.smithi037.stdout: "index_pool": ".index-pool" 2024-09-12T17:20:10.940 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.940 INFO:tasks.workunit.client.0.smithi037.stdout: }, 2024-09-12T17:20:10.940 INFO:tasks.workunit.client.0.smithi037.stdout: "key": { 2024-09-12T17:20:10.940 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "_myobj_", 2024-09-12T17:20:10.940 INFO:tasks.workunit.client.0.smithi037.stdout: "instance": "", 2024-09-12T17:20:10.940 INFO:tasks.workunit.client.0.smithi037.stdout: "ns": "" 2024-09-12T17:20:10.940 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.940 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.940 INFO:tasks.workunit.client.0.smithi037.stdout:} 2024-09-12T17:20:10.940 INFO:tasks.workunit.client.0.smithi037.stdout:raw2=.data-pool:marker___myobj_ 2024-09-12T17:20:10.941 INFO:tasks.workunit.client.0.smithi037.stdout:{ 2024-09-12T17:20:10.941 INFO:tasks.workunit.client.0.smithi037.stdout: "raw_obj": { 2024-09-12T17:20:10.941 INFO:tasks.workunit.client.0.smithi037.stdout: "pool": ".data-pool", 2024-09-12T17:20:10.941 INFO:tasks.workunit.client.0.smithi037.stdout: "oid": "marker__ns__myobj_", 2024-09-12T17:20:10.941 INFO:tasks.workunit.client.0.smithi037.stdout: "loc": "" 2024-09-12T17:20:10.941 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.941 INFO:tasks.workunit.client.0.smithi037.stdout:} 2024-09-12T17:20:10.941 INFO:tasks.workunit.client.0.smithi037.stdout:{ 2024-09-12T17:20:10.941 INFO:tasks.workunit.client.0.smithi037.stdout: "new_obj": { 2024-09-12T17:20:10.941 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket": { 2024-09-12T17:20:10.941 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "ebtest", 2024-09-12T17:20:10.941 INFO:tasks.workunit.client.0.smithi037.stdout: "marker": "marker", 2024-09-12T17:20:10.941 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:10.942 INFO:tasks.workunit.client.0.smithi037.stdout: "tenant": "", 2024-09-12T17:20:10.942 INFO:tasks.workunit.client.0.smithi037.stdout: "explicit_placement": { 2024-09-12T17:20:10.942 INFO:tasks.workunit.client.0.smithi037.stdout: "data_pool": ".data-pool", 2024-09-12T17:20:10.942 INFO:tasks.workunit.client.0.smithi037.stdout: "data_extra_pool": "", 2024-09-12T17:20:10.942 INFO:tasks.workunit.client.0.smithi037.stdout: "index_pool": ".index-pool" 2024-09-12T17:20:10.942 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.942 INFO:tasks.workunit.client.0.smithi037.stdout: }, 2024-09-12T17:20:10.942 INFO:tasks.workunit.client.0.smithi037.stdout: "key": { 2024-09-12T17:20:10.942 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "_myobj_", 2024-09-12T17:20:10.942 INFO:tasks.workunit.client.0.smithi037.stdout: "instance": "", 2024-09-12T17:20:10.942 INFO:tasks.workunit.client.0.smithi037.stdout: "ns": "ns" 2024-09-12T17:20:10.942 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.942 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.942 INFO:tasks.workunit.client.0.smithi037.stdout:} 2024-09-12T17:20:10.943 INFO:tasks.workunit.client.0.smithi037.stdout:raw=.data-pool:marker__ns__myobj_ 2024-09-12T17:20:10.943 INFO:tasks.workunit.client.0.smithi037.stdout:{ 2024-09-12T17:20:10.943 INFO:tasks.workunit.client.0.smithi037.stdout: "raw_obj2": { 2024-09-12T17:20:10.943 INFO:tasks.workunit.client.0.smithi037.stdout: "pool": ".data-pool", 2024-09-12T17:20:10.943 INFO:tasks.workunit.client.0.smithi037.stdout: "oid": "marker__ns__myobj_", 2024-09-12T17:20:10.943 INFO:tasks.workunit.client.0.smithi037.stdout: "loc": "" 2024-09-12T17:20:10.943 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.943 INFO:tasks.workunit.client.0.smithi037.stdout:} 2024-09-12T17:20:10.943 INFO:tasks.workunit.client.0.smithi037.stdout:{ 2024-09-12T17:20:10.943 INFO:tasks.workunit.client.0.smithi037.stdout: "new_obj2": { 2024-09-12T17:20:10.943 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket": { 2024-09-12T17:20:10.943 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "ebtest", 2024-09-12T17:20:10.943 INFO:tasks.workunit.client.0.smithi037.stdout: "marker": "marker", 2024-09-12T17:20:10.943 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:10.944 INFO:tasks.workunit.client.0.smithi037.stdout: "tenant": "", 2024-09-12T17:20:10.944 INFO:tasks.workunit.client.0.smithi037.stdout: "explicit_placement": { 2024-09-12T17:20:10.944 INFO:tasks.workunit.client.0.smithi037.stdout: "data_pool": ".data-pool", 2024-09-12T17:20:10.944 INFO:tasks.workunit.client.0.smithi037.stdout: "data_extra_pool": "", 2024-09-12T17:20:10.944 INFO:tasks.workunit.client.0.smithi037.stdout: "index_pool": ".index-pool" 2024-09-12T17:20:10.944 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.944 INFO:tasks.workunit.client.0.smithi037.stdout: }, 2024-09-12T17:20:10.944 INFO:tasks.workunit.client.0.smithi037.stdout: "key": { 2024-09-12T17:20:10.944 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "_myobj_", 2024-09-12T17:20:10.944 INFO:tasks.workunit.client.0.smithi037.stdout: "instance": "", 2024-09-12T17:20:10.944 INFO:tasks.workunit.client.0.smithi037.stdout: "ns": "ns" 2024-09-12T17:20:10.944 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.944 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.945 INFO:tasks.workunit.client.0.smithi037.stdout:} 2024-09-12T17:20:10.945 INFO:tasks.workunit.client.0.smithi037.stdout:raw2=.data-pool:marker__ns__myobj_ 2024-09-12T17:20:10.945 INFO:tasks.workunit.client.0.smithi037.stdout:{ 2024-09-12T17:20:10.945 INFO:tasks.workunit.client.0.smithi037.stdout: "raw_obj": { 2024-09-12T17:20:10.945 INFO:tasks.workunit.client.0.smithi037.stdout: "pool": ".data-pool", 2024-09-12T17:20:10.945 INFO:tasks.workunit.client.0.smithi037.stdout: "oid": "marker__:inst__myobj_", 2024-09-12T17:20:10.945 INFO:tasks.workunit.client.0.smithi037.stdout: "loc": "marker__myobj_" 2024-09-12T17:20:10.945 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.945 INFO:tasks.workunit.client.0.smithi037.stdout:} 2024-09-12T17:20:10.945 INFO:tasks.workunit.client.0.smithi037.stdout:{ 2024-09-12T17:20:10.945 INFO:tasks.workunit.client.0.smithi037.stdout: "new_obj": { 2024-09-12T17:20:10.945 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket": { 2024-09-12T17:20:10.945 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "ebtest", 2024-09-12T17:20:10.945 INFO:tasks.workunit.client.0.smithi037.stdout: "marker": "marker", 2024-09-12T17:20:10.945 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:10.946 INFO:tasks.workunit.client.0.smithi037.stdout: "tenant": "", 2024-09-12T17:20:10.946 INFO:tasks.workunit.client.0.smithi037.stdout: "explicit_placement": { 2024-09-12T17:20:10.946 INFO:tasks.workunit.client.0.smithi037.stdout: "data_pool": ".data-pool", 2024-09-12T17:20:10.946 INFO:tasks.workunit.client.0.smithi037.stdout: "data_extra_pool": "", 2024-09-12T17:20:10.946 INFO:tasks.workunit.client.0.smithi037.stdout: "index_pool": ".index-pool" 2024-09-12T17:20:10.946 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.946 INFO:tasks.workunit.client.0.smithi037.stdout: }, 2024-09-12T17:20:10.946 INFO:tasks.workunit.client.0.smithi037.stdout: "key": { 2024-09-12T17:20:10.946 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "_myobj_", 2024-09-12T17:20:10.946 INFO:tasks.workunit.client.0.smithi037.stdout: "instance": "inst", 2024-09-12T17:20:10.946 INFO:tasks.workunit.client.0.smithi037.stdout: "ns": "" 2024-09-12T17:20:10.946 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.946 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.946 INFO:tasks.workunit.client.0.smithi037.stdout:} 2024-09-12T17:20:10.947 INFO:tasks.workunit.client.0.smithi037.stdout:raw=.data-pool:marker__:inst__myobj_ 2024-09-12T17:20:10.947 INFO:tasks.workunit.client.0.smithi037.stdout:{ 2024-09-12T17:20:10.947 INFO:tasks.workunit.client.0.smithi037.stdout: "raw_obj2": { 2024-09-12T17:20:10.947 INFO:tasks.workunit.client.0.smithi037.stdout: "pool": ".data-pool", 2024-09-12T17:20:10.947 INFO:tasks.workunit.client.0.smithi037.stdout: "oid": "marker__:inst__myobj_", 2024-09-12T17:20:10.947 INFO:tasks.workunit.client.0.smithi037.stdout: "loc": "marker__myobj_" 2024-09-12T17:20:10.947 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.947 INFO:tasks.workunit.client.0.smithi037.stdout:} 2024-09-12T17:20:10.947 INFO:tasks.workunit.client.0.smithi037.stdout:{ 2024-09-12T17:20:10.947 INFO:tasks.workunit.client.0.smithi037.stdout: "new_obj2": { 2024-09-12T17:20:10.947 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket": { 2024-09-12T17:20:10.947 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "ebtest", 2024-09-12T17:20:10.947 INFO:tasks.workunit.client.0.smithi037.stdout: "marker": "marker", 2024-09-12T17:20:10.947 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:10.948 INFO:tasks.workunit.client.0.smithi037.stdout: "tenant": "", 2024-09-12T17:20:10.948 INFO:tasks.workunit.client.0.smithi037.stdout: "explicit_placement": { 2024-09-12T17:20:10.948 INFO:tasks.workunit.client.0.smithi037.stdout: "data_pool": ".data-pool", 2024-09-12T17:20:10.948 INFO:tasks.workunit.client.0.smithi037.stdout: "data_extra_pool": "", 2024-09-12T17:20:10.948 INFO:tasks.workunit.client.0.smithi037.stdout: "index_pool": ".index-pool" 2024-09-12T17:20:10.948 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.948 INFO:tasks.workunit.client.0.smithi037.stdout: }, 2024-09-12T17:20:10.948 INFO:tasks.workunit.client.0.smithi037.stdout: "key": { 2024-09-12T17:20:10.948 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "_myobj_", 2024-09-12T17:20:10.948 INFO:tasks.workunit.client.0.smithi037.stdout: "instance": "inst", 2024-09-12T17:20:10.948 INFO:tasks.workunit.client.0.smithi037.stdout: "ns": "" 2024-09-12T17:20:10.948 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.948 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.948 INFO:tasks.workunit.client.0.smithi037.stdout:} 2024-09-12T17:20:10.948 INFO:tasks.workunit.client.0.smithi037.stdout:raw2=.data-pool:marker__:inst__myobj_ 2024-09-12T17:20:10.949 INFO:tasks.workunit.client.0.smithi037.stdout:{ 2024-09-12T17:20:10.949 INFO:tasks.workunit.client.0.smithi037.stdout: "raw_obj": { 2024-09-12T17:20:10.949 INFO:tasks.workunit.client.0.smithi037.stdout: "pool": ".data-pool", 2024-09-12T17:20:10.949 INFO:tasks.workunit.client.0.smithi037.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-12T17:20:10.949 INFO:tasks.workunit.client.0.smithi037.stdout: "loc": "" 2024-09-12T17:20:10.949 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.949 INFO:tasks.workunit.client.0.smithi037.stdout:} 2024-09-12T17:20:10.949 INFO:tasks.workunit.client.0.smithi037.stdout:{ 2024-09-12T17:20:10.949 INFO:tasks.workunit.client.0.smithi037.stdout: "new_obj": { 2024-09-12T17:20:10.949 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket": { 2024-09-12T17:20:10.949 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "ebtest", 2024-09-12T17:20:10.949 INFO:tasks.workunit.client.0.smithi037.stdout: "marker": "marker", 2024-09-12T17:20:10.949 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:10.949 INFO:tasks.workunit.client.0.smithi037.stdout: "tenant": "", 2024-09-12T17:20:10.949 INFO:tasks.workunit.client.0.smithi037.stdout: "explicit_placement": { 2024-09-12T17:20:10.950 INFO:tasks.workunit.client.0.smithi037.stdout: "data_pool": ".data-pool", 2024-09-12T17:20:10.950 INFO:tasks.workunit.client.0.smithi037.stdout: "data_extra_pool": "", 2024-09-12T17:20:10.950 INFO:tasks.workunit.client.0.smithi037.stdout: "index_pool": ".index-pool" 2024-09-12T17:20:10.950 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.950 INFO:tasks.workunit.client.0.smithi037.stdout: }, 2024-09-12T17:20:10.950 INFO:tasks.workunit.client.0.smithi037.stdout: "key": { 2024-09-12T17:20:10.950 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "_myobj_", 2024-09-12T17:20:10.950 INFO:tasks.workunit.client.0.smithi037.stdout: "instance": "inst", 2024-09-12T17:20:10.950 INFO:tasks.workunit.client.0.smithi037.stdout: "ns": "ns" 2024-09-12T17:20:10.950 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.950 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.950 INFO:tasks.workunit.client.0.smithi037.stdout:} 2024-09-12T17:20:10.950 INFO:tasks.workunit.client.0.smithi037.stdout:raw=.data-pool:marker__ns:inst__myobj_ 2024-09-12T17:20:10.950 INFO:tasks.workunit.client.0.smithi037.stdout:{ 2024-09-12T17:20:10.951 INFO:tasks.workunit.client.0.smithi037.stdout: "raw_obj2": { 2024-09-12T17:20:10.951 INFO:tasks.workunit.client.0.smithi037.stdout: "pool": ".data-pool", 2024-09-12T17:20:10.951 INFO:tasks.workunit.client.0.smithi037.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-12T17:20:10.951 INFO:tasks.workunit.client.0.smithi037.stdout: "loc": "" 2024-09-12T17:20:10.951 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.951 INFO:tasks.workunit.client.0.smithi037.stdout:} 2024-09-12T17:20:10.951 INFO:tasks.workunit.client.0.smithi037.stdout:{ 2024-09-12T17:20:10.951 INFO:tasks.workunit.client.0.smithi037.stdout: "new_obj2": { 2024-09-12T17:20:10.951 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket": { 2024-09-12T17:20:10.951 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "ebtest", 2024-09-12T17:20:10.951 INFO:tasks.workunit.client.0.smithi037.stdout: "marker": "marker", 2024-09-12T17:20:10.951 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket_id": "bucket-id", 2024-09-12T17:20:10.951 INFO:tasks.workunit.client.0.smithi037.stdout: "tenant": "", 2024-09-12T17:20:10.951 INFO:tasks.workunit.client.0.smithi037.stdout: "explicit_placement": { 2024-09-12T17:20:10.951 INFO:tasks.workunit.client.0.smithi037.stdout: "data_pool": ".data-pool", 2024-09-12T17:20:10.951 INFO:tasks.workunit.client.0.smithi037.stdout: "data_extra_pool": "", 2024-09-12T17:20:10.952 INFO:tasks.workunit.client.0.smithi037.stdout: "index_pool": ".index-pool" 2024-09-12T17:20:10.952 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.952 INFO:tasks.workunit.client.0.smithi037.stdout: }, 2024-09-12T17:20:10.952 INFO:tasks.workunit.client.0.smithi037.stdout: "key": { 2024-09-12T17:20:10.952 INFO:tasks.workunit.client.0.smithi037.stdout: "name": "_myobj_", 2024-09-12T17:20:10.952 INFO:tasks.workunit.client.0.smithi037.stdout: "instance": "inst", 2024-09-12T17:20:10.952 INFO:tasks.workunit.client.0.smithi037.stdout: "ns": "ns" 2024-09-12T17:20:10.952 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.952 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:10.952 INFO:tasks.workunit.client.0.smithi037.stdout:} 2024-09-12T17:20:10.952 INFO:tasks.workunit.client.0.smithi037.stdout:raw2=.data-pool:marker__ns:inst__myobj_ 2024-09-12T17:20:10.952 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] TestRGWObj.old_to_raw (0 ms) 2024-09-12T17:20:10.952 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 4 tests from TestRGWObj (1 ms total) 2024-09-12T17:20:10.952 INFO:tasks.workunit.client.0.smithi037.stdout: 2024-09-12T17:20:10.952 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] Global test environment tear-down 2024-09-12T17:20:10.953 INFO:tasks.workunit.client.0.smithi037.stdout:[==========] 4 tests from 1 test suite ran. (1 ms total) 2024-09-12T17:20:10.953 INFO:tasks.workunit.client.0.smithi037.stdout:[ PASSED ] 4 tests. 2024-09-12T17:20:10.953 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:20:10.953 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:20:10.994 INFO:tasks.workunit:Running workunits matching rgw/test_librgw_file.sh on client.0... 2024-09-12T17:20:10.995 INFO:tasks.workunit:Running workunit rgw/test_librgw_file.sh... 2024-09-12T17:20:10.995 DEBUG:teuthology.orchestra.run.smithi037:workunit test rgw/test_librgw_file.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_librgw_file.sh 2024-09-12T17:20:11.128 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:20:11.128 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:20:11.173 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:20:11.172+0000 7f6fe1698800 20 rados->read ofs=0 len=0 2024-09-12T17:20:11.175 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:20:11.174+0000 7f6fe1698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:20:11.175 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:20:11.174+0000 7f6fe1698800 20 realm 2024-09-12T17:20:11.175 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:20:11.174+0000 7f6fe1698800 20 rados->read ofs=0 len=0 2024-09-12T17:20:11.175 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:20:11.174+0000 7f6fe1698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:20:11.175 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:20:11.174+0000 7f6fe1698800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:20:11.175 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:20:11.174+0000 7f6fe1698800 20 rados->read ofs=0 len=0 2024-09-12T17:20:11.175 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:20:11.174+0000 7f6fe1698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:20:11.175 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:20:11.174+0000 7f6fe1698800 20 rados->read ofs=0 len=0 2024-09-12T17:20:11.176 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:20:11.175+0000 7f6fe1698800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:20:11.176 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:20:11.175+0000 7f6fe1698800 20 rados->read ofs=0 len=0 2024-09-12T17:20:11.176 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:20:11.175+0000 7f6fe1698800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:20:11.176 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:20:11.175+0000 7f6fe1698800 20 searching for the correct realm 2024-09-12T17:20:11.186 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:20:11.185+0000 7f6fde981640 0 -- 172.21.15.37:0/2846228241 >> [v2:172.21.15.40:6800/2441293461,v1:172.21.15.40:6801/2441293461] conn(0x7f6fd0023070 msgr2=0x7f6fd0077a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:20:11.195 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:20:11.194+0000 7f6fdf182640 0 -- 172.21.15.37:0/2846228241 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7f6fd409d920 msgr2=0x7f6fd408b400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:20:11.408 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:20:11.406+0000 7f6fe1698800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:20:11.408 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:20:11.406+0000 7f6fe1698800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:20:11.408 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:20:11.406+0000 7f6fe1698800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:20:11.408 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:20:11.406+0000 7f6fe1698800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:20:11.408 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:20:11.406+0000 7f6fe1698800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:20:11.408 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:20:11.406+0000 7f6fe1698800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:20:11.408 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:20:11.406+0000 7f6fe1698800 20 rados->read ofs=0 len=0 2024-09-12T17:20:11.408 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:20:11.407+0000 7f6fe1698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:20:11.408 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:20:11.407+0000 7f6fe1698800 20 rados->read ofs=0 len=0 2024-09-12T17:20:11.409 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:20:11.407+0000 7f6fe1698800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:20:11.409 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:20:11.407+0000 7f6fe1698800 20 rados->read ofs=0 len=0 2024-09-12T17:20:11.409 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:20:11.408+0000 7f6fe1698800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:20:11.410 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:20:11.408+0000 7f6fe1698800 20 zone default found 2024-09-12T17:20:11.410 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:20:11.408+0000 7f6fe1698800 4 Realm: () 2024-09-12T17:20:11.410 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:20:11.408+0000 7f6fe1698800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:20:11.410 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:20:11.408+0000 7f6fe1698800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:20:11.410 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:20:11.408+0000 7f6fe1698800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:20:11.410 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:20:11.408+0000 7f6fe1698800 20 zonegroup default 2024-09-12T17:20:11.410 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:20:11.408+0000 7f6fe1698800 20 rados->read ofs=0 len=0 2024-09-12T17:20:11.410 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:20:11.408+0000 7f6fe1698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:20:11.410 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:20:11.408+0000 7f6fe1698800 20 rados->read ofs=0 len=0 2024-09-12T17:20:11.410 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:20:11.408+0000 7f6fe1698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:20:11.410 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:20:11.408+0000 7f6fe1698800 20 rados->read ofs=0 len=0 2024-09-12T17:20:11.411 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:20:11.409+0000 7f6fe1698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:20:11.411 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:20:11.409+0000 7f6fe1698800 20 started sync module instance, tier type = 2024-09-12T17:20:11.411 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:20:11.409+0000 7f6fe1698800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:20:11.421 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:20:11.420+0000 7f6fe1698800 20 add_watcher() i=0 2024-09-12T17:20:11.421 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:20:11.420+0000 7f6fe1698800 20 add_watcher() i=1 2024-09-12T17:20:11.421 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:20:11.420+0000 7f6fe1698800 20 add_watcher() i=2 2024-09-12T17:20:11.421 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:20:11.420+0000 7f6fe1698800 20 add_watcher() i=3 2024-09-12T17:20:11.421 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:20:11.420+0000 7f6fe1698800 20 add_watcher() i=4 2024-09-12T17:20:11.421 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:20:11.420+0000 7f6fe1698800 20 add_watcher() i=5 2024-09-12T17:20:11.421 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:20:11.420+0000 7f6fe1698800 20 add_watcher() i=6 2024-09-12T17:20:11.421 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:20:11.421+0000 7f6fe1698800 20 add_watcher() i=7 2024-09-12T17:20:11.421 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:20:11.421+0000 7f6fe1698800 2 all 8 watchers are set, enabling cache 2024-09-12T17:20:11.423 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:20:11.422+0000 7f6e95fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:20:11.423 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:20:11.422+0000 7f6fe1698800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:20:11.424 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:20:11.422+0000 7f6fe1698800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:20:11.424 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:20:11.423+0000 7f6fe1698800 5 note: GC not initialized 2024-09-12T17:20:11.424 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:20:11.423+0000 7f6e94fe1640 20 reqs_thread_entry: start 2024-09-12T17:20:11.424 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:20:11.423+0000 7f6fe1698800 20 init_complete bucket index max shards: 11 2024-09-12T17:20:11.425 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:20:11.423+0000 7f6fe1698800 20 Filter name: none 2024-09-12T17:20:11.425 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:20:11.423+0000 7f6e0e7fc640 20 reqs_thread_entry: start 2024-09-12T17:20:11.425 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:20:11.423+0000 7f6fe1698800 10 cache get: name=default.rgw.meta+users.uid+ceph-test-librgw-file : miss 2024-09-12T17:20:11.425 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:20:11.423+0000 7f6fe1698800 20 rados->read ofs=0 len=0 2024-09-12T17:20:11.426 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:20:11.424+0000 7f6fe1698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:20:11.426 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:20:11.424+0000 7f6fe1698800 10 cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x0 2024-09-12T17:20:11.426 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:20:11.424+0000 7f6fe1698800 10 adding default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-09-12T17:20:11.426 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:20:11.424+0000 7f6fe1698800 10 cache get: name=default.rgw.meta+users.email+librgw@example.com : miss 2024-09-12T17:20:11.426 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:20:11.424+0000 7f6fe1698800 20 rados->read ofs=0 len=0 2024-09-12T17:20:11.426 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:20:11.424+0000 7f6fe1698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:20:11.426 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:20:11.424+0000 7f6fe1698800 10 cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x0 2024-09-12T17:20:11.426 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:20:11.424+0000 7f6fe1698800 10 adding default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-09-12T17:20:11.427 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:20:11.424+0000 7f6fe1698800 10 cache get: name=default.rgw.meta+users.keys+wfcNywqrgGrvvoiyyBZIRihFpwQ= : miss 2024-09-12T17:20:11.427 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:20:11.424+0000 7f6fe1698800 20 rados->read ofs=0 len=0 2024-09-12T17:20:11.427 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:20:11.424+0000 7f6fe1698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:20:11.427 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:20:11.424+0000 7f6fe1698800 10 cache put: name=default.rgw.meta+users.keys+wfcNywqrgGrvvoiyyBZIRihFpwQ= info.flags=0x0 2024-09-12T17:20:11.427 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:20:11.424+0000 7f6fe1698800 10 adding default.rgw.meta+users.keys+wfcNywqrgGrvvoiyyBZIRihFpwQ= to cache LRU end 2024-09-12T17:20:11.427 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:20:11.425+0000 7f6fe1698800 10 cache get: name=default.rgw.meta+users.keys+wfcNywqrgGrvvoiyyBZIRihFpwQ= : hit (negative entry) 2024-09-12T17:20:11.427 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:20:11.425+0000 7f6fe1698800 10 cache get: name=default.rgw.meta+users.keys+wfcNywqrgGrvvoiyyBZIRihFpwQ= : hit (negative entry) 2024-09-12T17:20:11.427 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:20:11.426+0000 7f6fe1698800 10 cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x17 2024-09-12T17:20:11.428 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:20:11.426+0000 7f6fe1698800 10 moving default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-09-12T17:20:11.428 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:20:11.426+0000 7f6fe1698800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:ceph-test-librgw-file, ofs0, ns] 2024-09-12T17:20:11.428 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:20:11.426+0000 7f6ec2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1069446856709 cookie 94293813629168 notifier 5318 bl.length()=697 2024-09-12T17:20:11.428 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:20:11.426+0000 7f6ec2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x17 2024-09-12T17:20:11.428 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:20:11.426+0000 7f6ec2ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-09-12T17:20:11.431 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:20:11.430+0000 7f6fe1698800 10 cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x7 2024-09-12T17:20:11.431 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:20:11.430+0000 7f6fe1698800 10 moving default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-09-12T17:20:11.431 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:20:11.430+0000 7f6fe1698800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.email:librgw@example.com, ofs0, ns] 2024-09-12T17:20:11.431 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:20:11.430+0000 7f6ec2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1069446856704 cookie 94293813624032 notifier 5318 bl.length()=194 2024-09-12T17:20:11.431 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:20:11.430+0000 7f6ec2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x7 2024-09-12T17:20:11.431 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:20:11.430+0000 7f6ec2ffd640 10 rgw watcher librados: moving default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-09-12T17:20:11.434 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:20:11.433+0000 7f6fe1698800 10 cache put: name=default.rgw.meta+users.keys+wfcNywqrgGrvvoiyyBZIRihFpwQ= info.flags=0x7 2024-09-12T17:20:11.434 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:20:11.433+0000 7f6fe1698800 10 moving default.rgw.meta+users.keys+wfcNywqrgGrvvoiyyBZIRihFpwQ= to cache LRU end 2024-09-12T17:20:11.434 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:20:11.433+0000 7f6fe1698800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.keys:wfcNywqrgGrvvoiyyBZIRihFpwQ=, ofs0, ns] 2024-09-12T17:20:11.435 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:20:11.433+0000 7f6ec27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1069446856705 cookie 94293813624032 notifier 5318 bl.length()=203 2024-09-12T17:20:11.435 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:20:11.433+0000 7f6ec27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+wfcNywqrgGrvvoiyyBZIRihFpwQ= info.flags=0x7 2024-09-12T17:20:11.435 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:20:11.433+0000 7f6ec27fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+wfcNywqrgGrvvoiyyBZIRihFpwQ= to cache LRU end 2024-09-12T17:20:11.435 INFO:tasks.workunit.client.0.smithi037.stdout:{ 2024-09-12T17:20:11.436 INFO:tasks.workunit.client.0.smithi037.stdout: "user_id": "ceph-test-librgw-file", 2024-09-12T17:20:11.436 INFO:tasks.workunit.client.0.smithi037.stdout: "display_name": "librgw test user", 2024-09-12T17:20:11.436 INFO:tasks.workunit.client.0.smithi037.stdout: "email": "librgw@example.com", 2024-09-12T17:20:11.436 INFO:tasks.workunit.client.0.smithi037.stdout: "suspended": 0, 2024-09-12T17:20:11.436 INFO:tasks.workunit.client.0.smithi037.stdout: "max_buckets": 1000, 2024-09-12T17:20:11.436 INFO:tasks.workunit.client.0.smithi037.stdout: "subusers": [], 2024-09-12T17:20:11.436 INFO:tasks.workunit.client.0.smithi037.stdout: "keys": [ 2024-09-12T17:20:11.436 INFO:tasks.workunit.client.0.smithi037.stdout: { 2024-09-12T17:20:11.436 INFO:tasks.workunit.client.0.smithi037.stdout: "user": "ceph-test-librgw-file", 2024-09-12T17:20:11.436 INFO:tasks.workunit.client.0.smithi037.stdout: "access_key": "wfcNywqrgGrvvoiyyBZIRihFpwQ=", 2024-09-12T17:20:11.436 INFO:tasks.workunit.client.0.smithi037.stdout: "secret_key": "99kL0kTDraLO3y2FNDTb310WRMYsijNCTGOWVE/SXxsygWJ6F9fR4Q==", 2024-09-12T17:20:11.436 INFO:tasks.workunit.client.0.smithi037.stdout: "active": true, 2024-09-12T17:20:11.437 INFO:tasks.workunit.client.0.smithi037.stdout: "create_date": "2024-09-12T17:20:11.425683Z" 2024-09-12T17:20:11.437 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:20:11.437 INFO:tasks.workunit.client.0.smithi037.stdout: ], 2024-09-12T17:20:11.437 INFO:tasks.workunit.client.0.smithi037.stdout: "swift_keys": [], 2024-09-12T17:20:11.437 INFO:tasks.workunit.client.0.smithi037.stdout: "caps": [], 2024-09-12T17:20:11.437 INFO:tasks.workunit.client.0.smithi037.stdout: "op_mask": "read, write, delete", 2024-09-12T17:20:11.437 INFO:tasks.workunit.client.0.smithi037.stdout: "default_placement": "", 2024-09-12T17:20:11.437 INFO:tasks.workunit.client.0.smithi037.stdout: "default_storage_class": "", 2024-09-12T17:20:11.437 INFO:tasks.workunit.client.0.smithi037.stdout: "placement_tags": [], 2024-09-12T17:20:11.437 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket_quota": { 2024-09-12T17:20:11.437 INFO:tasks.workunit.client.0.smithi037.stdout: "enabled": false, 2024-09-12T17:20:11.437 INFO:tasks.workunit.client.0.smithi037.stdout: "check_on_raw": false, 2024-09-12T17:20:11.437 INFO:tasks.workunit.client.0.smithi037.stdout: "max_size": -1, 2024-09-12T17:20:11.437 INFO:tasks.workunit.client.0.smithi037.stdout: "max_size_kb": 0, 2024-09-12T17:20:11.438 INFO:tasks.workunit.client.0.smithi037.stdout: "max_objects": -1 2024-09-12T17:20:11.438 INFO:tasks.workunit.client.0.smithi037.stdout: }, 2024-09-12T17:20:11.438 INFO:tasks.workunit.client.0.smithi037.stdout: "user_quota": { 2024-09-12T17:20:11.438 INFO:tasks.workunit.client.0.smithi037.stdout: "enabled": false, 2024-09-12T17:20:11.438 INFO:tasks.workunit.client.0.smithi037.stdout: "check_on_raw": false, 2024-09-12T17:20:11.438 INFO:tasks.workunit.client.0.smithi037.stdout: "max_size": -1, 2024-09-12T17:20:11.438 INFO:tasks.workunit.client.0.smithi037.stdout: "max_size_kb": 0, 2024-09-12T17:20:11.438 INFO:tasks.workunit.client.0.smithi037.stdout: "max_objects": -1 2024-09-12T17:20:11.438 INFO:tasks.workunit.client.0.smithi037.stdout: }, 2024-09-12T17:20:11.438 INFO:tasks.workunit.client.0.smithi037.stdout: "temp_url_keys": [], 2024-09-12T17:20:11.438 INFO:tasks.workunit.client.0.smithi037.stdout: "type": "rgw", 2024-09-12T17:20:11.438 INFO:tasks.workunit.client.0.smithi037.stdout: "mfa_ids": [], 2024-09-12T17:20:11.438 INFO:tasks.workunit.client.0.smithi037.stdout: "account_id": "", 2024-09-12T17:20:11.438 INFO:tasks.workunit.client.0.smithi037.stdout: "path": "/", 2024-09-12T17:20:11.439 INFO:tasks.workunit.client.0.smithi037.stdout: "create_date": "2024-09-12T17:20:11.425665Z", 2024-09-12T17:20:11.439 INFO:tasks.workunit.client.0.smithi037.stdout: "tags": [], 2024-09-12T17:20:11.439 INFO:tasks.workunit.client.0.smithi037.stdout: "group_ids": [] 2024-09-12T17:20:11.439 INFO:tasks.workunit.client.0.smithi037.stdout:} 2024-09-12T17:20:11.439 INFO:tasks.workunit.client.0.smithi037.stdout: 2024-09-12T17:20:11.439 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:20:11.436+0000 7f6e95fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:20:11.440 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:20:11.439+0000 7f6fe1698800 20 remove_watcher() i=0 2024-09-12T17:20:11.440 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:20:11.439+0000 7f6fe1698800 2 removed watcher, disabling cache 2024-09-12T17:20:11.441 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:20:11.440+0000 7f6fe1698800 20 remove_watcher() i=1 2024-09-12T17:20:11.442 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:20:11.441+0000 7f6fe1698800 20 remove_watcher() i=2 2024-09-12T17:20:11.443 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:20:11.442+0000 7f6fe1698800 20 remove_watcher() i=3 2024-09-12T17:20:11.444 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:20:11.443+0000 7f6fe1698800 20 remove_watcher() i=4 2024-09-12T17:20:11.445 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:20:11.444+0000 7f6fe1698800 20 remove_watcher() i=5 2024-09-12T17:20:11.446 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:20:11.445+0000 7f6fe1698800 20 remove_watcher() i=6 2024-09-12T17:20:11.447 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:20:11.446+0000 7f6fe1698800 20 remove_watcher() i=7 2024-09-12T17:20:11.458 INFO:tasks.workunit.client.0.smithi037.stdout:phase 1.1 2024-09-12T17:20:11.480 INFO:tasks.workunit.client.0.smithi037.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-12T17:20:11.480 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] Global test environment set-up. 2024-09-12T17:20:11.480 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 24 tests from LibRGW 2024-09-12T17:20:11.480 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.INIT 2024-09-12T17:20:11.491 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:20:11.491 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:20:11.876 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.INIT (395 ms) 2024-09-12T17:20:11.876 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-09-12T17:20:11.877 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.MOUNT_NOROOT (2 ms) 2024-09-12T17:20:11.877 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T17:20:11.877 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-09-12T17:20:11.877 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-09-12T17:20:11.890 INFO:tasks.workunit.client.0.smithi037.stdout:creating: nfsroot:foo/bar/baz/quux 2024-09-12T17:20:11.895 INFO:tasks.workunit.client.0.smithi037.stdout:creating: nfsroot:foo/f1 2024-09-12T17:20:11.899 INFO:tasks.workunit.client.0.smithi037.stdout:creating: nfsroot:foo/f2 2024-09-12T17:20:11.902 INFO:tasks.workunit.client.0.smithi037.stdout:creating: nfsroot:foo/bar/f1 2024-09-12T17:20:11.905 INFO:tasks.workunit.client.0.smithi037.stdout:creating: nfsroot:foo/bar/d1/ 2024-09-12T17:20:11.909 INFO:tasks.workunit.client.0.smithi037.stdout:creating: nfsroot:foo/bar/baz/hungry 2024-09-12T17:20:11.912 INFO:tasks.workunit.client.0.smithi037.stdout:creating: nfsroot:foo/bar/baz/hungry/ 2024-09-12T17:20:11.916 INFO:tasks.workunit.client.0.smithi037.stdout:creating: nfsroot:foo/bar/baz/momma 2024-09-12T17:20:11.919 INFO:tasks.workunit.client.0.smithi037.stdout:creating: nfsroot:foo/bar/baz/bear/ 2024-09-12T17:20:11.922 INFO:tasks.workunit.client.0.smithi037.stdout:creating: nfsroot:foo/bar/baz/sasquatch 2024-09-12T17:20:11.925 INFO:tasks.workunit.client.0.smithi037.stdout:creating: nfsroot:foo/bar/baz/sasquatch/ 2024-09-12T17:20:11.928 INFO:tasks.workunit.client.0.smithi037.stdout:creating: nfsroot:foo/bar/baz/frobozz 2024-09-12T17:20:11.931 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.SETUP_HIER1 (54 ms) 2024-09-12T17:20:11.931 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-09-12T17:20:12.040 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.SETUP_DIRS1 (109 ms) 2024-09-12T17:20:12.040 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.SETATTR 2024-09-12T17:20:12.041 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-09-12T17:20:12.041 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-09-12T17:20:12.059 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (19 ms) 2024-09-12T17:20:12.059 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-09-12T17:20:12.110 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (50 ms) 2024-09-12T17:20:12.110 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-09-12T17:20:12.110 INFO:tasks.workunit.client.0.smithi037.stdout:rename file rfile_0 to rfile_r0 (bucket brename0) 2024-09-12T17:20:12.117 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (7 ms) 2024-09-12T17:20:12.117 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-09-12T17:20:12.117 INFO:tasks.workunit.client.0.smithi037.stdout:rename file rfile_1 (bucket brename0) to rfile_rhilldog (bucket brename1) 2024-09-12T17:20:12.124 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (8 ms) 2024-09-12T17:20:12.125 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-09-12T17:20:12.125 INFO:tasks.workunit.client.0.smithi037.stdout:scanning objects in /bdirs1/dir_0 2024-09-12T17:20:12.125 INFO:tasks.workunit.client.0.smithi037.stdout: /bdirs1/dir_0/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-12T17:20:12.125 INFO:tasks.workunit.client.0.smithi037.stdout: /bdirs1/dir_0/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-12T17:20:12.125 INFO:tasks.workunit.client.0.smithi037.stdout: /bdirs1/dir_0/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-12T17:20:12.125 INFO:tasks.workunit.client.0.smithi037.stdout: /bdirs1/dir_0/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-12T17:20:12.125 INFO:tasks.workunit.client.0.smithi037.stdout:scanning objects in /bdirs1/dir_1 2024-09-12T17:20:12.125 INFO:tasks.workunit.client.0.smithi037.stdout: /bdirs1/dir_1/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-12T17:20:12.125 INFO:tasks.workunit.client.0.smithi037.stdout: /bdirs1/dir_1/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-12T17:20:12.125 INFO:tasks.workunit.client.0.smithi037.stdout: /bdirs1/dir_1/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-12T17:20:12.125 INFO:tasks.workunit.client.0.smithi037.stdout: /bdirs1/dir_1/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-12T17:20:12.125 INFO:tasks.workunit.client.0.smithi037.stdout:scanning objects in /bdirs1/dir_2 2024-09-12T17:20:12.125 INFO:tasks.workunit.client.0.smithi037.stdout: /bdirs1/dir_2/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-12T17:20:12.126 INFO:tasks.workunit.client.0.smithi037.stdout: /bdirs1/dir_2/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-12T17:20:12.126 INFO:tasks.workunit.client.0.smithi037.stdout: /bdirs1/dir_2/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-12T17:20:12.126 INFO:tasks.workunit.client.0.smithi037.stdout: /bdirs1/dir_2/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-12T17:20:12.126 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2024-09-12T17:20:12.126 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-09-12T17:20:12.126 INFO:tasks.workunit.client.0.smithi037.stdout:read back objects in /bdirs1/dir_0 2024-09-12T17:20:12.126 INFO:tasks.workunit.client.0.smithi037.stdout:reading 0,256 dir_0/sfile_0 2024-09-12T17:20:12.126 INFO:tasks.workunit.client.0.smithi037.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-12T17:20:12.126 INFO:tasks.workunit.client.0.smithi037.stdout:reading 0,256 dir_0/sfile_1 2024-09-12T17:20:12.127 INFO:tasks.workunit.client.0.smithi037.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-12T17:20:12.127 INFO:tasks.workunit.client.0.smithi037.stdout:read back objects in /bdirs1/dir_1 2024-09-12T17:20:12.127 INFO:tasks.workunit.client.0.smithi037.stdout:reading 0,256 dir_1/sfile_0 2024-09-12T17:20:12.129 INFO:tasks.workunit.client.0.smithi037.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-12T17:20:12.129 INFO:tasks.workunit.client.0.smithi037.stdout:reading 0,256 dir_1/sfile_1 2024-09-12T17:20:12.130 INFO:tasks.workunit.client.0.smithi037.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-12T17:20:12.131 INFO:tasks.workunit.client.0.smithi037.stdout:read back objects in /bdirs1/dir_2 2024-09-12T17:20:12.131 INFO:tasks.workunit.client.0.smithi037.stdout:reading 0,256 dir_2/sfile_0 2024-09-12T17:20:12.132 INFO:tasks.workunit.client.0.smithi037.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-12T17:20:12.132 INFO:tasks.workunit.client.0.smithi037.stdout:reading 0,256 dir_2/sfile_1 2024-09-12T17:20:12.133 INFO:tasks.workunit.client.0.smithi037.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-12T17:20:12.133 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.READ_DIRS1 (9 ms) 2024-09-12T17:20:12.133 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-09-12T17:20:12.314 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.READF_SETUP1 (180 ms) 2024-09-12T17:20:12.314 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-09-12T17:20:12.314 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-09-12T17:20:12.314 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-09-12T17:20:12.314 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-09-12T17:20:12.315 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-09-12T17:20:12.315 INFO:tasks.workunit.client.0.smithi037.stdout:release sdir_0 type: DIR refs: 2 2024-09-12T17:20:12.315 INFO:tasks.workunit.client.0.smithi037.stdout:release sfile_0 type: FILE refs: 2 2024-09-12T17:20:12.315 INFO:tasks.workunit.client.0.smithi037.stdout:release sdir_1 type: DIR refs: 2 2024-09-12T17:20:12.315 INFO:tasks.workunit.client.0.smithi037.stdout:release sfile_1 type: FILE refs: 2 2024-09-12T17:20:12.315 INFO:tasks.workunit.client.0.smithi037.stdout:release sdir_0 type: DIR refs: 2 2024-09-12T17:20:12.315 INFO:tasks.workunit.client.0.smithi037.stdout:release sfile_0 type: FILE refs: 2 2024-09-12T17:20:12.315 INFO:tasks.workunit.client.0.smithi037.stdout:release sdir_1 type: DIR refs: 2 2024-09-12T17:20:12.315 INFO:tasks.workunit.client.0.smithi037.stdout:release sfile_1 type: FILE refs: 2 2024-09-12T17:20:12.315 INFO:tasks.workunit.client.0.smithi037.stdout:release sdir_0 type: DIR refs: 2 2024-09-12T17:20:12.315 INFO:tasks.workunit.client.0.smithi037.stdout:release sfile_0 type: FILE refs: 2 2024-09-12T17:20:12.315 INFO:tasks.workunit.client.0.smithi037.stdout:release sdir_1 type: DIR refs: 2 2024-09-12T17:20:12.315 INFO:tasks.workunit.client.0.smithi037.stdout:release sfile_1 type: FILE refs: 2 2024-09-12T17:20:12.315 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (1 ms) 2024-09-12T17:20:12.315 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.HIER1 2024-09-12T17:20:12.324 INFO:tasks.workunit.client.0.smithi037.stdout:/nfsroot/foo/f2 (f2): FILE 2024-09-12T17:20:12.324 INFO:tasks.workunit.client.0.smithi037.stdout:/nfsroot/foo/f1 (f1): FILE 2024-09-12T17:20:12.329 INFO:tasks.workunit.client.0.smithi037.stdout:/nfsroot/foo/bar/f1 (f1): FILE 2024-09-12T17:20:12.331 INFO:tasks.workunit.client.0.smithi037.stdout:/nfsroot/foo/bar/d1 (d1): DIR 2024-09-12T17:20:12.334 INFO:tasks.workunit.client.0.smithi037.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-12T17:20:12.334 INFO:tasks.workunit.client.0.smithi037.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-12T17:20:12.335 INFO:tasks.workunit.client.0.smithi037.stdout:/nfsroot/foo/bar/baz/quux (quux): FILE 2024-09-12T17:20:12.335 INFO:tasks.workunit.client.0.smithi037.stdout:/nfsroot/foo/bar/baz/momma (momma): FILE 2024-09-12T17:20:12.336 INFO:tasks.workunit.client.0.smithi037.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-12T17:20:12.337 INFO:tasks.workunit.client.0.smithi037.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-12T17:20:12.337 INFO:tasks.workunit.client.0.smithi037.stdout:/nfsroot/foo/bar/baz/frobozz (frobozz): FILE 2024-09-12T17:20:12.339 INFO:tasks.workunit.client.0.smithi037.stdout:/nfsroot/foo/bar/baz/bear (bear): DIR 2024-09-12T17:20:12.339 INFO:tasks.workunit.client.0.smithi037.stdout:/nfsroot/foo/bar/baz (baz): DIR 2024-09-12T17:20:12.340 INFO:tasks.workunit.client.0.smithi037.stdout:/nfsroot/foo/bar (bar): DIR 2024-09-12T17:20:12.340 INFO:tasks.workunit.client.0.smithi037.stdout:/nfsroot/foo (foo): DIR 2024-09-12T17:20:12.340 INFO:tasks.workunit.client.0.smithi037.stdout:/nfsroot (nfsroot): DIR 2024-09-12T17:20:12.340 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.HIER1 (25 ms) 2024-09-12T17:20:12.340 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-12T17:20:12.340 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-09-12T17:20:12.340 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-12T17:20:12.340 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-12T17:20:12.340 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-12T17:20:12.340 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-12T17:20:12.340 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-12T17:20:12.340 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-12T17:20:12.340 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T17:20:12.340 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T17:20:12.341 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T17:20:12.341 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T17:20:12.341 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T17:20:12.341 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:20:12.338+0000 7f95f1f398c0 -1 shutting down 2024-09-12T17:20:12.341 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:20:12.339+0000 7f94c9ed5640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 64463, si_uid : 1000, si_addr0x3e80000fbcf, si_status0 2024-09-12T17:20:41.957 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.SHUTDOWN (29617 ms) 2024-09-12T17:20:41.958 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 24 tests from LibRGW (30476 ms total) 2024-09-12T17:20:41.958 INFO:tasks.workunit.client.0.smithi037.stdout: 2024-09-12T17:20:41.958 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] Global test environment tear-down 2024-09-12T17:20:41.958 INFO:tasks.workunit.client.0.smithi037.stdout:[==========] 24 tests from 1 test suite ran. (30476 ms total) 2024-09-12T17:20:41.958 INFO:tasks.workunit.client.0.smithi037.stdout:[ PASSED ] 24 tests. 2024-09-12T17:20:41.963 INFO:tasks.workunit.client.0.smithi037.stdout:phase 1.2 2024-09-12T17:20:41.990 INFO:tasks.workunit.client.0.smithi037.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-12T17:20:41.990 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] Global test environment set-up. 2024-09-12T17:20:41.990 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 24 tests from LibRGW 2024-09-12T17:20:41.990 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.INIT 2024-09-12T17:20:41.999 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:20:41.999 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:20:42.601 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.INIT (610 ms) 2024-09-12T17:20:42.601 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-09-12T17:20:42.602 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.MOUNT_NOROOT (1 ms) 2024-09-12T17:20:42.602 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T17:20:42.602 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-09-12T17:20:42.602 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-09-12T17:20:42.602 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.SETUP_HIER1 (0 ms) 2024-09-12T17:20:42.603 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-09-12T17:20:42.603 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.SETUP_DIRS1 (0 ms) 2024-09-12T17:20:42.603 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.SETATTR 2024-09-12T17:20:42.603 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-09-12T17:20:42.603 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-09-12T17:20:42.603 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (0 ms) 2024-09-12T17:20:42.603 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-09-12T17:20:42.603 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (0 ms) 2024-09-12T17:20:42.603 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-09-12T17:20:42.603 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (0 ms) 2024-09-12T17:20:42.603 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-09-12T17:20:42.603 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (0 ms) 2024-09-12T17:20:42.603 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-09-12T17:20:42.603 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2024-09-12T17:20:42.604 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-09-12T17:20:42.604 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.READ_DIRS1 (0 ms) 2024-09-12T17:20:42.604 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-09-12T17:20:42.604 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.READF_SETUP1 (0 ms) 2024-09-12T17:20:42.604 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-09-12T17:20:42.604 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-09-12T17:20:42.604 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-09-12T17:20:42.604 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-09-12T17:20:42.604 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-09-12T17:20:42.604 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-09-12T17:20:42.604 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.HIER1 2024-09-12T17:20:42.604 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.HIER1 (0 ms) 2024-09-12T17:20:42.604 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-12T17:20:42.604 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-09-12T17:20:42.605 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-12T17:20:42.605 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-12T17:20:42.605 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-12T17:20:42.605 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-12T17:20:42.605 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-12T17:20:42.605 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-12T17:20:42.605 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T17:20:42.605 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T17:20:42.605 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T17:20:42.605 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T17:20:42.605 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T17:20:42.606 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:20:42.601+0000 7fb2f89428c0 -1 shutting down 2024-09-12T17:20:42.606 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:20:42.602+0000 7fb1d0947640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 65082, si_uid : 1000, si_addr0x3e80000fe3a, si_status0 2024-09-12T17:21:12.847 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.SHUTDOWN (30246 ms) 2024-09-12T17:21:12.848 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 24 tests from LibRGW (30857 ms total) 2024-09-12T17:21:12.848 INFO:tasks.workunit.client.0.smithi037.stdout: 2024-09-12T17:21:12.848 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] Global test environment tear-down 2024-09-12T17:21:12.848 INFO:tasks.workunit.client.0.smithi037.stdout:[==========] 24 tests from 1 test suite ran. (30857 ms total) 2024-09-12T17:21:12.848 INFO:tasks.workunit.client.0.smithi037.stdout:[ PASSED ] 24 tests. 2024-09-12T17:21:12.853 INFO:tasks.workunit.client.0.smithi037.stdout:phase 1.3 2024-09-12T17:21:12.879 INFO:tasks.workunit.client.0.smithi037.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-12T17:21:12.879 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] Global test environment set-up. 2024-09-12T17:21:12.879 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 24 tests from LibRGW 2024-09-12T17:21:12.879 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.INIT 2024-09-12T17:21:12.889 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:21:12.890 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:21:13.492 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.INIT (613 ms) 2024-09-12T17:21:13.492 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-09-12T17:21:13.493 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.MOUNT_NOROOT (2 ms) 2024-09-12T17:21:13.493 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T17:21:13.493 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-09-12T17:21:13.493 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-09-12T17:21:13.499 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.SETUP_HIER1 (6 ms) 2024-09-12T17:21:13.499 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-09-12T17:21:13.565 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.SETUP_DIRS1 (65 ms) 2024-09-12T17:21:13.565 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.SETATTR 2024-09-12T17:21:13.565 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-09-12T17:21:13.565 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-09-12T17:21:13.566 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (0 ms) 2024-09-12T17:21:13.566 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-09-12T17:21:13.566 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (0 ms) 2024-09-12T17:21:13.566 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-09-12T17:21:13.566 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (0 ms) 2024-09-12T17:21:13.566 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-09-12T17:21:13.566 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (0 ms) 2024-09-12T17:21:13.566 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-09-12T17:21:13.566 INFO:tasks.workunit.client.0.smithi037.stdout:scanning objects in /bdirs1/dir_0 2024-09-12T17:21:13.566 INFO:tasks.workunit.client.0.smithi037.stdout: /bdirs1/dir_0/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-12T17:21:13.566 INFO:tasks.workunit.client.0.smithi037.stdout: /bdirs1/dir_0/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-12T17:21:13.566 INFO:tasks.workunit.client.0.smithi037.stdout: /bdirs1/dir_0/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-12T17:21:13.566 INFO:tasks.workunit.client.0.smithi037.stdout: /bdirs1/dir_0/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-12T17:21:13.567 INFO:tasks.workunit.client.0.smithi037.stdout:scanning objects in /bdirs1/dir_1 2024-09-12T17:21:13.567 INFO:tasks.workunit.client.0.smithi037.stdout: /bdirs1/dir_1/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-12T17:21:13.567 INFO:tasks.workunit.client.0.smithi037.stdout: /bdirs1/dir_1/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-12T17:21:13.567 INFO:tasks.workunit.client.0.smithi037.stdout: /bdirs1/dir_1/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-12T17:21:13.567 INFO:tasks.workunit.client.0.smithi037.stdout: /bdirs1/dir_1/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-12T17:21:13.567 INFO:tasks.workunit.client.0.smithi037.stdout:scanning objects in /bdirs1/dir_2 2024-09-12T17:21:13.567 INFO:tasks.workunit.client.0.smithi037.stdout: /bdirs1/dir_2/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-12T17:21:13.567 INFO:tasks.workunit.client.0.smithi037.stdout: /bdirs1/dir_2/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-12T17:21:13.567 INFO:tasks.workunit.client.0.smithi037.stdout: /bdirs1/dir_2/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-12T17:21:13.567 INFO:tasks.workunit.client.0.smithi037.stdout: /bdirs1/dir_2/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-12T17:21:13.567 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2024-09-12T17:21:13.567 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-09-12T17:21:13.567 INFO:tasks.workunit.client.0.smithi037.stdout:read back objects in /bdirs1/dir_0 2024-09-12T17:21:13.567 INFO:tasks.workunit.client.0.smithi037.stdout:reading 0,256 dir_0/sfile_0 2024-09-12T17:21:13.568 INFO:tasks.workunit.client.0.smithi037.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-12T17:21:13.568 INFO:tasks.workunit.client.0.smithi037.stdout:reading 0,256 dir_0/sfile_1 2024-09-12T17:21:13.569 INFO:tasks.workunit.client.0.smithi037.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-12T17:21:13.569 INFO:tasks.workunit.client.0.smithi037.stdout:read back objects in /bdirs1/dir_1 2024-09-12T17:21:13.569 INFO:tasks.workunit.client.0.smithi037.stdout:reading 0,256 dir_1/sfile_0 2024-09-12T17:21:13.570 INFO:tasks.workunit.client.0.smithi037.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-12T17:21:13.571 INFO:tasks.workunit.client.0.smithi037.stdout:reading 0,256 dir_1/sfile_1 2024-09-12T17:21:13.572 INFO:tasks.workunit.client.0.smithi037.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-12T17:21:13.572 INFO:tasks.workunit.client.0.smithi037.stdout:read back objects in /bdirs1/dir_2 2024-09-12T17:21:13.572 INFO:tasks.workunit.client.0.smithi037.stdout:reading 0,256 dir_2/sfile_0 2024-09-12T17:21:13.573 INFO:tasks.workunit.client.0.smithi037.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-12T17:21:13.573 INFO:tasks.workunit.client.0.smithi037.stdout:reading 0,256 dir_2/sfile_1 2024-09-12T17:21:13.575 INFO:tasks.workunit.client.0.smithi037.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-12T17:21:13.575 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.READ_DIRS1 (9 ms) 2024-09-12T17:21:13.575 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-09-12T17:21:13.575 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.READF_SETUP1 (0 ms) 2024-09-12T17:21:13.575 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-09-12T17:21:13.575 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-09-12T17:21:13.575 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-09-12T17:21:13.576 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-09-12T17:21:13.576 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-09-12T17:21:13.576 INFO:tasks.workunit.client.0.smithi037.stdout:release sdir_0 type: DIR refs: 2 2024-09-12T17:21:13.576 INFO:tasks.workunit.client.0.smithi037.stdout:release sfile_0 type: FILE refs: 2 2024-09-12T17:21:13.576 INFO:tasks.workunit.client.0.smithi037.stdout:release sdir_1 type: DIR refs: 2 2024-09-12T17:21:13.576 INFO:tasks.workunit.client.0.smithi037.stdout:release sfile_1 type: FILE refs: 2 2024-09-12T17:21:13.576 INFO:tasks.workunit.client.0.smithi037.stdout:release sdir_0 type: DIR refs: 2 2024-09-12T17:21:13.576 INFO:tasks.workunit.client.0.smithi037.stdout:release sfile_0 type: FILE refs: 2 2024-09-12T17:21:13.576 INFO:tasks.workunit.client.0.smithi037.stdout:release sdir_1 type: DIR refs: 2 2024-09-12T17:21:13.576 INFO:tasks.workunit.client.0.smithi037.stdout:release sfile_1 type: FILE refs: 2 2024-09-12T17:21:13.576 INFO:tasks.workunit.client.0.smithi037.stdout:release sdir_0 type: DIR refs: 2 2024-09-12T17:21:13.576 INFO:tasks.workunit.client.0.smithi037.stdout:release sfile_0 type: FILE refs: 2 2024-09-12T17:21:13.576 INFO:tasks.workunit.client.0.smithi037.stdout:release sdir_1 type: DIR refs: 2 2024-09-12T17:21:13.576 INFO:tasks.workunit.client.0.smithi037.stdout:release sfile_1 type: FILE refs: 2 2024-09-12T17:21:13.576 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-09-12T17:21:13.577 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.HIER1 2024-09-12T17:21:13.583 INFO:tasks.workunit.client.0.smithi037.stdout:/nfsroot/foo/f2 (f2): FILE 2024-09-12T17:21:13.584 INFO:tasks.workunit.client.0.smithi037.stdout:/nfsroot/foo/f1 (f1): FILE 2024-09-12T17:21:13.587 INFO:tasks.workunit.client.0.smithi037.stdout:/nfsroot/foo/bar/f1 (f1): FILE 2024-09-12T17:21:13.589 INFO:tasks.workunit.client.0.smithi037.stdout:/nfsroot/foo/bar/d1 (d1): DIR 2024-09-12T17:21:13.593 INFO:tasks.workunit.client.0.smithi037.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-12T17:21:13.594 INFO:tasks.workunit.client.0.smithi037.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-12T17:21:13.594 INFO:tasks.workunit.client.0.smithi037.stdout:/nfsroot/foo/bar/baz/quux (quux): FILE 2024-09-12T17:21:13.595 INFO:tasks.workunit.client.0.smithi037.stdout:/nfsroot/foo/bar/baz/momma (momma): FILE 2024-09-12T17:21:13.595 INFO:tasks.workunit.client.0.smithi037.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-12T17:21:13.596 INFO:tasks.workunit.client.0.smithi037.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-12T17:21:13.596 INFO:tasks.workunit.client.0.smithi037.stdout:/nfsroot/foo/bar/baz/frobozz (frobozz): FILE 2024-09-12T17:21:13.599 INFO:tasks.workunit.client.0.smithi037.stdout:/nfsroot/foo/bar/baz/bear (bear): DIR 2024-09-12T17:21:13.599 INFO:tasks.workunit.client.0.smithi037.stdout:/nfsroot/foo/bar/baz (baz): DIR 2024-09-12T17:21:13.599 INFO:tasks.workunit.client.0.smithi037.stdout:/nfsroot/foo/bar (bar): DIR 2024-09-12T17:21:13.599 INFO:tasks.workunit.client.0.smithi037.stdout:/nfsroot/foo (foo): DIR 2024-09-12T17:21:13.599 INFO:tasks.workunit.client.0.smithi037.stdout:/nfsroot (nfsroot): DIR 2024-09-12T17:21:13.599 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.HIER1 (24 ms) 2024-09-12T17:21:13.599 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-12T17:21:13.599 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-09-12T17:21:13.600 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-12T17:21:13.600 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-12T17:21:13.600 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-12T17:21:13.600 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-12T17:21:13.600 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-12T17:21:13.600 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-12T17:21:13.600 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T17:21:13.600 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T17:21:13.600 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T17:21:13.600 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T17:21:13.600 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T17:21:13.601 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:21:13.597+0000 7f7ccc2bf8c0 -1 shutting down 2024-09-12T17:21:13.601 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:21:13.598+0000 7f7ba355a640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 65701, si_uid : 1000, si_addr0x3e8000100a5, si_status0 2024-09-12T17:21:43.595 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.SHUTDOWN (29996 ms) 2024-09-12T17:21:43.595 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 24 tests from LibRGW (30716 ms total) 2024-09-12T17:21:43.595 INFO:tasks.workunit.client.0.smithi037.stdout: 2024-09-12T17:21:43.595 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] Global test environment tear-down 2024-09-12T17:21:43.595 INFO:tasks.workunit.client.0.smithi037.stdout:[==========] 24 tests from 1 test suite ran. (30716 ms total) 2024-09-12T17:21:43.596 INFO:tasks.workunit.client.0.smithi037.stdout:[ PASSED ] 24 tests. 2024-09-12T17:21:43.602 INFO:tasks.workunit.client.0.smithi037.stdout:phase 2.1 2024-09-12T17:21:43.631 INFO:tasks.workunit.client.0.smithi037.stdout:[==========] Running 9 tests from 1 test suite. 2024-09-12T17:21:43.631 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] Global test environment set-up. 2024-09-12T17:21:43.631 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 9 tests from LibRGW 2024-09-12T17:21:43.631 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.INIT 2024-09-12T17:21:43.640 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:21:43.640 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:21:44.031 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.INIT (401 ms) 2024-09-12T17:21:44.031 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T17:21:44.032 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-12T17:21:44.032 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-12T17:21:44.044 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.CREATE_BUCKET (12 ms) 2024-09-12T17:21:44.044 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-12T17:21:44.044 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-09-12T17:21:44.044 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.CREATE_BUCKET_MULTI 2024-09-12T17:21:44.055 INFO:tasks.workunit.client.0.smithi037.stdout:created: sorrydave0 2024-09-12T17:21:44.066 INFO:tasks.workunit.client.0.smithi037.stdout:created: sorrydave1 2024-09-12T17:21:44.077 INFO:tasks.workunit.client.0.smithi037.stdout:created: sorrydave2 2024-09-12T17:21:44.089 INFO:tasks.workunit.client.0.smithi037.stdout:created: sorrydave3 2024-09-12T17:21:44.101 INFO:tasks.workunit.client.0.smithi037.stdout:created: sorrydave4 2024-09-12T17:21:44.112 INFO:tasks.workunit.client.0.smithi037.stdout:created: sorrydave5 2024-09-12T17:21:44.125 INFO:tasks.workunit.client.0.smithi037.stdout:created: sorrydave6 2024-09-12T17:21:44.136 INFO:tasks.workunit.client.0.smithi037.stdout:created: sorrydave7 2024-09-12T17:21:44.149 INFO:tasks.workunit.client.0.smithi037.stdout:created: sorrydave8 2024-09-12T17:21:44.164 INFO:tasks.workunit.client.0.smithi037.stdout:created: sorrydave9 2024-09-12T17:21:44.164 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.CREATE_BUCKET_MULTI (119 ms) 2024-09-12T17:21:44.164 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.DELETE_BUCKET_MULTI 2024-09-12T17:21:44.482 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.DELETE_BUCKET_MULTI (318 ms) 2024-09-12T17:21:44.482 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T17:21:44.482 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T17:21:44.482 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T17:21:44.482 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T17:21:44.482 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T17:21:44.483 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:21:44.481+0000 7f483c4ab8c0 -1 shutting down 2024-09-12T17:21:44.483 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:21:44.482+0000 7f47161ea640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 66320, si_uid : 1000, si_addr0x3e800010310, si_status0 2024-09-12T17:22:14.375 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.SHUTDOWN (29893 ms) 2024-09-12T17:22:14.376 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 9 tests from LibRGW (30744 ms total) 2024-09-12T17:22:14.376 INFO:tasks.workunit.client.0.smithi037.stdout: 2024-09-12T17:22:14.376 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] Global test environment tear-down 2024-09-12T17:22:14.376 INFO:tasks.workunit.client.0.smithi037.stdout:[==========] 9 tests from 1 test suite ran. (30744 ms total) 2024-09-12T17:22:14.376 INFO:tasks.workunit.client.0.smithi037.stdout:[ PASSED ] 9 tests. 2024-09-12T17:22:14.382 INFO:tasks.workunit.client.0.smithi037.stdout:phase 2.2 2024-09-12T17:22:14.407 INFO:tasks.workunit.client.0.smithi037.stdout:[==========] Running 9 tests from 1 test suite. 2024-09-12T17:22:14.408 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] Global test environment set-up. 2024-09-12T17:22:14.408 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 9 tests from LibRGW 2024-09-12T17:22:14.408 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.INIT 2024-09-12T17:22:14.417 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:22:14.417 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:22:14.811 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.INIT (403 ms) 2024-09-12T17:22:14.811 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T17:22:14.811 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-12T17:22:14.811 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-12T17:22:14.812 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-09-12T17:22:14.812 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-12T17:22:14.848 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.DELETE_BUCKET (36 ms) 2024-09-12T17:22:14.848 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.CREATE_BUCKET_MULTI 2024-09-12T17:22:14.859 INFO:tasks.workunit.client.0.smithi037.stdout:created: sorrydave0 2024-09-12T17:22:14.870 INFO:tasks.workunit.client.0.smithi037.stdout:created: sorrydave1 2024-09-12T17:22:14.882 INFO:tasks.workunit.client.0.smithi037.stdout:created: sorrydave2 2024-09-12T17:22:14.892 INFO:tasks.workunit.client.0.smithi037.stdout:created: sorrydave3 2024-09-12T17:22:14.903 INFO:tasks.workunit.client.0.smithi037.stdout:created: sorrydave4 2024-09-12T17:22:14.915 INFO:tasks.workunit.client.0.smithi037.stdout:created: sorrydave5 2024-09-12T17:22:14.930 INFO:tasks.workunit.client.0.smithi037.stdout:created: sorrydave6 2024-09-12T17:22:14.942 INFO:tasks.workunit.client.0.smithi037.stdout:created: sorrydave7 2024-09-12T17:22:14.952 INFO:tasks.workunit.client.0.smithi037.stdout:created: sorrydave8 2024-09-12T17:22:14.963 INFO:tasks.workunit.client.0.smithi037.stdout:created: sorrydave9 2024-09-12T17:22:14.963 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.CREATE_BUCKET_MULTI (116 ms) 2024-09-12T17:22:14.963 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.DELETE_BUCKET_MULTI 2024-09-12T17:22:15.278 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.DELETE_BUCKET_MULTI (315 ms) 2024-09-12T17:22:15.278 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T17:22:15.278 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T17:22:15.278 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T17:22:15.278 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T17:22:15.278 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T17:22:15.279 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:22:15.276+0000 7ff850c318c0 -1 shutting down 2024-09-12T17:22:15.279 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:22:15.277+0000 7ff72615a640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 66940, si_uid : 1000, si_addr0x3e80001057c, si_status0 2024-09-12T17:22:45.046 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.SHUTDOWN (29767 ms) 2024-09-12T17:22:45.047 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 9 tests from LibRGW (30639 ms total) 2024-09-12T17:22:45.047 INFO:tasks.workunit.client.0.smithi037.stdout: 2024-09-12T17:22:45.047 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] Global test environment tear-down 2024-09-12T17:22:45.047 INFO:tasks.workunit.client.0.smithi037.stdout:[==========] 9 tests from 1 test suite ran. (30639 ms total) 2024-09-12T17:22:45.047 INFO:tasks.workunit.client.0.smithi037.stdout:[ PASSED ] 9 tests. 2024-09-12T17:22:45.052 INFO:tasks.workunit.client.0.smithi037.stdout:phase 3.1 2024-09-12T17:22:45.383 INFO:tasks.workunit.client.0.smithi037.stdout:[==========] Running 13 tests from 1 test suite. 2024-09-12T17:22:45.383 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] Global test environment set-up. 2024-09-12T17:22:45.383 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 13 tests from LibRGW 2024-09-12T17:22:45.383 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.INIT 2024-09-12T17:22:45.393 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:22:45.393 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:22:45.574 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.INIT (191 ms) 2024-09-12T17:22:45.574 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T17:22:45.575 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-12T17:22:45.575 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-12T17:22:45.587 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.CREATE_BUCKET (12 ms) 2024-09-12T17:22:45.587 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-12T17:22:45.591 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (4 ms) 2024-09-12T17:22:45.591 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-12T17:22:45.594 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (3 ms) 2024-09-12T17:22:45.594 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.LARGE1 2024-09-12T17:22:46.045 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.LARGE1 (451 ms) 2024-09-12T17:22:46.045 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.LARGE2 2024-09-12T17:22:46.092 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.LARGE2 (47 ms) 2024-09-12T17:22:46.092 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-12T17:22:46.092 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-12T17:22:46.092 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-12T17:22:46.092 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.DELETE_OBJECT (0 ms) 2024-09-12T17:22:46.093 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-12T17:22:46.093 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-09-12T17:22:46.093 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T17:22:46.093 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T17:22:46.093 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T17:22:46.093 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T17:22:46.093 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T17:22:46.093 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:22:46.091+0000 7f2b7f6538c0 -1 shutting down 2024-09-12T17:22:46.094 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:22:46.093+0000 7f2a59392640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 67560, si_uid : 1000, si_addr0x3e8000107e8, si_status0 2024-09-12T17:23:15.916 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.SHUTDOWN (29823 ms) 2024-09-12T17:23:15.917 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 13 tests from LibRGW (30532 ms total) 2024-09-12T17:23:15.917 INFO:tasks.workunit.client.0.smithi037.stdout: 2024-09-12T17:23:15.917 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] Global test environment tear-down 2024-09-12T17:23:15.917 INFO:tasks.workunit.client.0.smithi037.stdout:[==========] 13 tests from 1 test suite ran. (30532 ms total) 2024-09-12T17:23:15.917 INFO:tasks.workunit.client.0.smithi037.stdout:[ PASSED ] 13 tests. 2024-09-12T17:23:15.924 INFO:tasks.workunit.client.0.smithi037.stdout:phase 3.2 2024-09-12T17:23:16.255 INFO:tasks.workunit.client.0.smithi037.stdout:[==========] Running 13 tests from 1 test suite. 2024-09-12T17:23:16.255 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] Global test environment set-up. 2024-09-12T17:23:16.256 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 13 tests from LibRGW 2024-09-12T17:23:16.256 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.INIT 2024-09-12T17:23:16.263 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:23:16.264 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:23:16.444 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.INIT (189 ms) 2024-09-12T17:23:16.444 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T17:23:16.445 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-12T17:23:16.445 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-12T17:23:16.445 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-09-12T17:23:16.445 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-12T17:23:16.451 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (6 ms) 2024-09-12T17:23:16.451 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-12T17:23:16.455 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (4 ms) 2024-09-12T17:23:16.455 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.LARGE1 2024-09-12T17:23:16.526 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.LARGE1 (70 ms) 2024-09-12T17:23:16.526 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.LARGE2 2024-09-12T17:23:16.526 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.LARGE2 (0 ms) 2024-09-12T17:23:16.526 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-12T17:23:16.526 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-12T17:23:16.526 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-12T17:23:16.534 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.DELETE_OBJECT (9 ms) 2024-09-12T17:23:16.534 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-12T17:23:16.565 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.DELETE_BUCKET (30 ms) 2024-09-12T17:23:16.565 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T17:23:16.565 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T17:23:16.565 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T17:23:16.565 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T17:23:16.565 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T17:23:16.566 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:23:16.563+0000 7f51ddac18c0 -1 shutting down 2024-09-12T17:23:16.566 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:23:16.564+0000 7f50b4ad5640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 68180, si_uid : 1000, si_addr0x3e800010a54, si_status0 2024-09-12T17:23:46.516 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.SHUTDOWN (29951 ms) 2024-09-12T17:23:46.516 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 13 tests from LibRGW (30260 ms total) 2024-09-12T17:23:46.516 INFO:tasks.workunit.client.0.smithi037.stdout: 2024-09-12T17:23:46.516 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] Global test environment tear-down 2024-09-12T17:23:46.516 INFO:tasks.workunit.client.0.smithi037.stdout:[==========] 13 tests from 1 test suite ran. (30260 ms total) 2024-09-12T17:23:46.516 INFO:tasks.workunit.client.0.smithi037.stdout:[ PASSED ] 13 tests. 2024-09-12T17:23:46.523 INFO:tasks.workunit.client.0.smithi037.stdout:phase 4.1 2024-09-12T17:23:46.553 INFO:tasks.workunit.client.0.smithi037.stdout:[==========] Running 11 tests from 1 test suite. 2024-09-12T17:23:46.553 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] Global test environment set-up. 2024-09-12T17:23:46.553 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 11 tests from LibRGW 2024-09-12T17:23:46.553 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.TVAR 2024-09-12T17:23:46.553 INFO:tasks.workunit.client.0.smithi037.stdout:read i1: 64001 2024-09-12T17:23:46.553 INFO:tasks.workunit.client.0.smithi037.stdout:read s1: blunderbuss 2024-09-12T17:23:46.553 INFO:tasks.workunit.client.0.smithi037.stdout:read s3: [ OK ] LibRGW.TVAR (0 ms) 2024-09-12T17:23:46.553 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.INIT 2024-09-12T17:23:46.564 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:23:46.564 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:23:46.959 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.INIT (406 ms) 2024-09-12T17:23:46.959 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T17:23:46.959 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-12T17:23:46.960 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-12T17:23:46.981 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (22 ms) 2024-09-12T17:23:46.981 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-12T17:23:47.470 INFO:tasks.workunit.client.0.smithi037.stdout:created: dmarker:f_0 2024-09-12T17:23:47.470 INFO:tasks.workunit.client.0.smithi037.stdout:created: dmarker:f_1 2024-09-12T17:23:47.470 INFO:tasks.workunit.client.0.smithi037.stdout:created: dmarker:f_2 2024-09-12T17:23:47.470 INFO:tasks.workunit.client.0.smithi037.stdout:created: dmarker:f_3 2024-09-12T17:23:47.470 INFO:tasks.workunit.client.0.smithi037.stdout:created: dmarker:f_4 2024-09-12T17:23:47.470 INFO:tasks.workunit.client.0.smithi037.stdout:created: dmarker:f_5 2024-09-12T17:23:47.470 INFO:tasks.workunit.client.0.smithi037.stdout:created: dmarker:f_6 2024-09-12T17:23:47.471 INFO:tasks.workunit.client.0.smithi037.stdout:created: dmarker:f_7 2024-09-12T17:23:47.471 INFO:tasks.workunit.client.0.smithi037.stdout:created: dmarker:f_8 2024-09-12T17:23:47.471 INFO:tasks.workunit.client.0.smithi037.stdout:created: dmarker:f_9 2024-09-12T17:23:47.471 INFO:tasks.workunit.client.0.smithi037.stdout:created: dmarker:f_10 2024-09-12T17:23:47.471 INFO:tasks.workunit.client.0.smithi037.stdout:created: dmarker:f_11 2024-09-12T17:23:47.471 INFO:tasks.workunit.client.0.smithi037.stdout:created: dmarker:f_12 2024-09-12T17:23:47.471 INFO:tasks.workunit.client.0.smithi037.stdout:created: dmarker:f_13 2024-09-12T17:23:47.471 INFO:tasks.workunit.client.0.smithi037.stdout:created: dmarker:f_14 2024-09-12T17:23:47.471 INFO:tasks.workunit.client.0.smithi037.stdout:created: dmarker:f_15 2024-09-12T17:23:47.471 INFO:tasks.workunit.client.0.smithi037.stdout:created: dmarker:f_16 2024-09-12T17:23:47.471 INFO:tasks.workunit.client.0.smithi037.stdout:created: dmarker:f_17 2024-09-12T17:23:47.471 INFO:tasks.workunit.client.0.smithi037.stdout:created: dmarker:f_18 2024-09-12T17:23:47.471 INFO:tasks.workunit.client.0.smithi037.stdout:created: dmarker:f_19 2024-09-12T17:23:47.472 INFO:tasks.workunit.client.0.smithi037.stdout:created: dmarker:f_20 2024-09-12T17:23:47.472 INFO:tasks.workunit.client.0.smithi037.stdout:created: dmarker:f_21 2024-09-12T17:23:47.472 INFO:tasks.workunit.client.0.smithi037.stdout:created: dmarker:f_22 2024-09-12T17:23:47.472 INFO:tasks.workunit.client.0.smithi037.stdout:created: dmarker:f_23 2024-09-12T17:23:47.472 INFO:tasks.workunit.client.0.smithi037.stdout:created: dmarker:f_24 2024-09-12T17:23:47.472 INFO:tasks.workunit.client.0.smithi037.stdout:created: dmarker:f_25 2024-09-12T17:23:47.472 INFO:tasks.workunit.client.0.smithi037.stdout:created: dmarker:f_26 2024-09-12T17:23:47.472 INFO:tasks.workunit.client.0.smithi037.stdout:created: dmarker:f_27 2024-09-12T17:23:47.472 INFO:tasks.workunit.client.0.smithi037.stdout:created: dmarker:f_28 2024-09-12T17:23:47.472 INFO:tasks.workunit.client.0.smithi037.stdout:created: dmarker:f_29 2024-09-12T17:23:47.472 INFO:tasks.workunit.client.0.smithi037.stdout:created: dmarker:f_30 2024-09-12T17:23:47.472 INFO:tasks.workunit.client.0.smithi037.stdout:created: dmarker:f_31 2024-09-12T17:23:47.472 INFO:tasks.workunit.client.0.smithi037.stdout:created: dmarker:f_32 2024-09-12T17:23:47.473 INFO:tasks.workunit.client.0.smithi037.stdout:created: dmarker:f_33 2024-09-12T17:23:47.473 INFO:tasks.workunit.client.0.smithi037.stdout:created: dmarker:f_34 2024-09-12T17:23:47.473 INFO:tasks.workunit.client.0.smithi037.stdout:created: dmarker:f_35 2024-09-12T17:23:47.473 INFO:tasks.workunit.client.0.smithi037.stdout:created: dmarker:f_36 2024-09-12T17:23:47.473 INFO:tasks.workunit.client.0.smithi037.stdout:created: dmarker:f_37 2024-09-12T17:23:47.473 INFO:tasks.workunit.client.0.smithi037.stdout:created: dmarker:f_38 2024-09-12T17:23:47.473 INFO:tasks.workunit.client.0.smithi037.stdout:created: dmarker:f_39 2024-09-12T17:23:47.473 INFO:tasks.workunit.client.0.smithi037.stdout:created: dmarker:f_40 2024-09-12T17:23:47.473 INFO:tasks.workunit.client.0.smithi037.stdout:created: dmarker:f_41 2024-09-12T17:23:47.473 INFO:tasks.workunit.client.0.smithi037.stdout:created: dmarker:f_42 2024-09-12T17:23:47.473 INFO:tasks.workunit.client.0.smithi037.stdout:created: dmarker:f_43 2024-09-12T17:23:47.473 INFO:tasks.workunit.client.0.smithi037.stdout:created: dmarker:f_44 2024-09-12T17:23:47.473 INFO:tasks.workunit.client.0.smithi037.stdout:created: dmarker:f_45 2024-09-12T17:23:47.473 INFO:tasks.workunit.client.0.smithi037.stdout:created: dmarker:f_46 2024-09-12T17:23:47.474 INFO:tasks.workunit.client.0.smithi037.stdout:created: dmarker:f_47 2024-09-12T17:23:47.474 INFO:tasks.workunit.client.0.smithi037.stdout:created: dmarker:f_48 2024-09-12T17:23:47.474 INFO:tasks.workunit.client.0.smithi037.stdout:created: dmarker:f_49 2024-09-12T17:23:47.474 INFO:tasks.workunit.client.0.smithi037.stdout:created: dmarker:f_50 2024-09-12T17:23:47.474 INFO:tasks.workunit.client.0.smithi037.stdout:created: dmarker:f_51 2024-09-12T17:23:47.474 INFO:tasks.workunit.client.0.smithi037.stdout:created: dmarker:f_52 2024-09-12T17:23:47.474 INFO:tasks.workunit.client.0.smithi037.stdout:created: dmarker:f_53 2024-09-12T17:23:47.474 INFO:tasks.workunit.client.0.smithi037.stdout:created: dmarker:f_54 2024-09-12T17:23:47.474 INFO:tasks.workunit.client.0.smithi037.stdout:created: dmarker:f_55 2024-09-12T17:23:47.474 INFO:tasks.workunit.client.0.smithi037.stdout:created: dmarker:f_56 2024-09-12T17:23:47.474 INFO:tasks.workunit.client.0.smithi037.stdout:created: dmarker:f_57 2024-09-12T17:23:47.474 INFO:tasks.workunit.client.0.smithi037.stdout:created: dmarker:f_58 2024-09-12T17:23:47.474 INFO:tasks.workunit.client.0.smithi037.stdout:created: dmarker:f_59 2024-09-12T17:23:47.474 INFO:tasks.workunit.client.0.smithi037.stdout:created: dmarker:f_60 2024-09-12T17:23:47.475 INFO:tasks.workunit.client.0.smithi037.stdout:created: dmarker:f_61 2024-09-12T17:23:47.475 INFO:tasks.workunit.client.0.smithi037.stdout:created: dmarker:f_62 2024-09-12T17:23:47.475 INFO:tasks.workunit.client.0.smithi037.stdout:created: dmarker:f_63 2024-09-12T17:23:47.475 INFO:tasks.workunit.client.0.smithi037.stdout:created: dmarker:f_64 2024-09-12T17:23:47.475 INFO:tasks.workunit.client.0.smithi037.stdout:created: dmarker:f_65 2024-09-12T17:23:47.475 INFO:tasks.workunit.client.0.smithi037.stdout:created: dmarker:f_66 2024-09-12T17:23:47.475 INFO:tasks.workunit.client.0.smithi037.stdout:created: dmarker:f_67 2024-09-12T17:23:47.475 INFO:tasks.workunit.client.0.smithi037.stdout:created: dmarker:f_68 2024-09-12T17:23:47.475 INFO:tasks.workunit.client.0.smithi037.stdout:created: dmarker:f_69 2024-09-12T17:23:47.475 INFO:tasks.workunit.client.0.smithi037.stdout:created: dmarker:f_70 2024-09-12T17:23:47.475 INFO:tasks.workunit.client.0.smithi037.stdout:created: dmarker:f_71 2024-09-12T17:23:47.475 INFO:tasks.workunit.client.0.smithi037.stdout:created: dmarker:f_72 2024-09-12T17:23:47.475 INFO:tasks.workunit.client.0.smithi037.stdout:created: dmarker:f_73 2024-09-12T17:23:47.476 INFO:tasks.workunit.client.0.smithi037.stdout:created: dmarker:f_74 2024-09-12T17:23:47.476 INFO:tasks.workunit.client.0.smithi037.stdout:created: dmarker:f_75 2024-09-12T17:23:47.476 INFO:tasks.workunit.client.0.smithi037.stdout:created: dmarker:f_76 2024-09-12T17:23:47.476 INFO:tasks.workunit.client.0.smithi037.stdout:created: dmarker:f_77 2024-09-12T17:23:47.476 INFO:tasks.workunit.client.0.smithi037.stdout:created: dmarker:f_78 2024-09-12T17:23:47.476 INFO:tasks.workunit.client.0.smithi037.stdout:created: dmarker:f_79 2024-09-12T17:23:47.476 INFO:tasks.workunit.client.0.smithi037.stdout:created: dmarker:f_80 2024-09-12T17:23:47.476 INFO:tasks.workunit.client.0.smithi037.stdout:created: dmarker:f_81 2024-09-12T17:23:47.476 INFO:tasks.workunit.client.0.smithi037.stdout:created: dmarker:f_82 2024-09-12T17:23:47.476 INFO:tasks.workunit.client.0.smithi037.stdout:created: dmarker:f_83 2024-09-12T17:23:47.476 INFO:tasks.workunit.client.0.smithi037.stdout:created: dmarker:f_84 2024-09-12T17:23:47.476 INFO:tasks.workunit.client.0.smithi037.stdout:created: dmarker:f_85 2024-09-12T17:23:47.476 INFO:tasks.workunit.client.0.smithi037.stdout:created: dmarker:f_86 2024-09-12T17:23:47.477 INFO:tasks.workunit.client.0.smithi037.stdout:created: dmarker:f_87 2024-09-12T17:23:47.477 INFO:tasks.workunit.client.0.smithi037.stdout:created: dmarker:f_88 2024-09-12T17:23:47.477 INFO:tasks.workunit.client.0.smithi037.stdout:created: dmarker:f_89 2024-09-12T17:23:47.477 INFO:tasks.workunit.client.0.smithi037.stdout:created: dmarker:f_90 2024-09-12T17:23:47.477 INFO:tasks.workunit.client.0.smithi037.stdout:created: dmarker:f_91 2024-09-12T17:23:47.477 INFO:tasks.workunit.client.0.smithi037.stdout:created: dmarker:f_92 2024-09-12T17:23:47.477 INFO:tasks.workunit.client.0.smithi037.stdout:created: dmarker:f_93 2024-09-12T17:23:47.477 INFO:tasks.workunit.client.0.smithi037.stdout:created: dmarker:f_94 2024-09-12T17:23:47.477 INFO:tasks.workunit.client.0.smithi037.stdout:created: dmarker:f_95 2024-09-12T17:23:47.477 INFO:tasks.workunit.client.0.smithi037.stdout:created: dmarker:f_96 2024-09-12T17:23:47.477 INFO:tasks.workunit.client.0.smithi037.stdout:created: dmarker:f_97 2024-09-12T17:23:47.477 INFO:tasks.workunit.client.0.smithi037.stdout:created: dmarker:f_98 2024-09-12T17:23:47.477 INFO:tasks.workunit.client.0.smithi037.stdout:created: dmarker:f_99 2024-09-12T17:23:47.477 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (488 ms) 2024-09-12T17:23:47.477 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-12T17:23:47.479 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=. flags=4 2024-09-12T17:23:47.479 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=.. flags=4 2024-09-12T17:23:47.479 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-09-12T17:23:47.479 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-09-12T17:23:47.479 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-09-12T17:23:47.479 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-09-12T17:23:47.479 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-09-12T17:23:47.479 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-09-12T17:23:47.480 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-09-12T17:23:47.480 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-09-12T17:23:47.480 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-09-12T17:23:47.480 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-09-12T17:23:47.480 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-09-12T17:23:47.480 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-09-12T17:23:47.480 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-09-12T17:23:47.480 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-09-12T17:23:47.480 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-09-12T17:23:47.480 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-09-12T17:23:47.480 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-09-12T17:23:47.480 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-09-12T17:23:47.480 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-09-12T17:23:47.481 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-09-12T17:23:47.481 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-09-12T17:23:47.481 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-09-12T17:23:47.481 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-09-12T17:23:47.481 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-09-12T17:23:47.481 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-09-12T17:23:47.481 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-09-12T17:23:47.481 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-09-12T17:23:47.481 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-09-12T17:23:47.481 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-09-12T17:23:47.481 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-09-12T17:23:47.481 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-09-12T17:23:47.481 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-09-12T17:23:47.482 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-09-12T17:23:47.482 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-09-12T17:23:47.482 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-09-12T17:23:47.482 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-09-12T17:23:47.482 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-09-12T17:23:47.482 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-09-12T17:23:47.482 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-09-12T17:23:47.482 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-09-12T17:23:47.482 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-09-12T17:23:47.482 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-09-12T17:23:47.482 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-09-12T17:23:47.482 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-09-12T17:23:47.482 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-09-12T17:23:47.483 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-09-12T17:23:47.483 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-09-12T17:23:47.483 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-09-12T17:23:47.483 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-09-12T17:23:47.483 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-09-12T17:23:47.483 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-09-12T17:23:47.483 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-09-12T17:23:47.483 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-09-12T17:23:47.483 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-09-12T17:23:47.483 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-09-12T17:23:47.483 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-09-12T17:23:47.483 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-09-12T17:23:47.483 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-09-12T17:23:47.483 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-09-12T17:23:47.484 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-09-12T17:23:47.484 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-09-12T17:23:47.484 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-09-12T17:23:47.484 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-09-12T17:23:47.484 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-09-12T17:23:47.484 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-09-12T17:23:47.484 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-09-12T17:23:47.484 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-09-12T17:23:47.484 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-09-12T17:23:47.484 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-09-12T17:23:47.484 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-09-12T17:23:47.484 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-09-12T17:23:47.484 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-09-12T17:23:47.484 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-09-12T17:23:47.485 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-09-12T17:23:47.485 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-09-12T17:23:47.485 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-09-12T17:23:47.485 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-09-12T17:23:47.485 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-09-12T17:23:47.485 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-09-12T17:23:47.485 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-09-12T17:23:47.485 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-09-12T17:23:47.485 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-09-12T17:23:47.485 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-09-12T17:23:47.485 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-09-12T17:23:47.485 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-09-12T17:23:47.485 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-09-12T17:23:47.486 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-09-12T17:23:47.486 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-09-12T17:23:47.486 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-09-12T17:23:47.486 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-09-12T17:23:47.486 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-09-12T17:23:47.486 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-09-12T17:23:47.486 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-09-12T17:23:47.486 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-09-12T17:23:47.486 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-09-12T17:23:47.486 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-09-12T17:23:47.486 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-09-12T17:23:47.486 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-09-12T17:23:47.486 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-09-12T17:23:47.486 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-09-12T17:23:47.487 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.MARKER1_READDIR (3 ms) 2024-09-12T17:23:47.487 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.MARKER2_READDIR 2024-09-12T17:23:47.487 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-09-12T17:23:47.487 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-09-12T17:23:47.487 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-09-12T17:23:47.487 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-09-12T17:23:47.487 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-09-12T17:23:47.487 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-09-12T17:23:47.487 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-09-12T17:23:47.487 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-09-12T17:23:47.487 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-09-12T17:23:47.487 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-09-12T17:23:47.487 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-09-12T17:23:47.487 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-09-12T17:23:47.487 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-09-12T17:23:47.488 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-09-12T17:23:47.488 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-09-12T17:23:47.488 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-09-12T17:23:47.488 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-09-12T17:23:47.488 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-09-12T17:23:47.488 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-09-12T17:23:47.488 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-09-12T17:23:47.488 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-09-12T17:23:47.488 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-09-12T17:23:47.488 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-09-12T17:23:47.488 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-09-12T17:23:47.488 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-09-12T17:23:47.488 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-09-12T17:23:47.488 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-09-12T17:23:47.488 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-09-12T17:23:47.489 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-09-12T17:23:47.489 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-09-12T17:23:47.489 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-09-12T17:23:47.489 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-09-12T17:23:47.489 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-09-12T17:23:47.489 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-09-12T17:23:47.489 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-09-12T17:23:47.489 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-09-12T17:23:47.489 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-09-12T17:23:47.489 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-09-12T17:23:47.489 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-09-12T17:23:47.489 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-09-12T17:23:47.489 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-09-12T17:23:47.489 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-09-12T17:23:47.489 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-09-12T17:23:47.490 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-09-12T17:23:47.490 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-09-12T17:23:47.490 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-09-12T17:23:47.490 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-09-12T17:23:47.490 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-09-12T17:23:47.490 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-09-12T17:23:47.490 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-09-12T17:23:47.490 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-09-12T17:23:47.490 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-09-12T17:23:47.490 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-09-12T17:23:47.490 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-09-12T17:23:47.490 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-09-12T17:23:47.490 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-09-12T17:23:47.490 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-09-12T17:23:47.490 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-09-12T17:23:47.490 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-09-12T17:23:47.490 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-09-12T17:23:47.491 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-09-12T17:23:47.491 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-09-12T17:23:47.491 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-09-12T17:23:47.491 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-09-12T17:23:47.491 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-09-12T17:23:47.491 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-09-12T17:23:47.491 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-09-12T17:23:47.491 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-09-12T17:23:47.491 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-09-12T17:23:47.491 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-09-12T17:23:47.491 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-09-12T17:23:47.491 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-09-12T17:23:47.491 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-09-12T17:23:47.491 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-09-12T17:23:47.491 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-09-12T17:23:47.492 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-09-12T17:23:47.492 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-09-12T17:23:47.492 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-09-12T17:23:47.492 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-09-12T17:23:47.492 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-09-12T17:23:47.492 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-09-12T17:23:47.492 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-09-12T17:23:47.492 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-09-12T17:23:47.492 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-09-12T17:23:47.492 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-09-12T17:23:47.492 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-09-12T17:23:47.492 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-09-12T17:23:47.492 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-09-12T17:23:47.492 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-09-12T17:23:47.492 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-09-12T17:23:47.493 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-09-12T17:23:47.493 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-09-12T17:23:47.493 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-09-12T17:23:47.493 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-09-12T17:23:47.493 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-09-12T17:23:47.493 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-09-12T17:23:47.493 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-09-12T17:23:47.493 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-09-12T17:23:47.493 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-09-12T17:23:47.493 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-09-12T17:23:47.493 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.MARKER2_READDIR (2 ms) 2024-09-12T17:23:47.493 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-12T17:23:47.493 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-12T17:23:47.493 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T17:23:47.494 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T17:23:47.494 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T17:23:47.494 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T17:23:47.494 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T17:23:47.494 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:23:47.473+0000 7f1bcde878c0 -1 shutting down 2024-09-12T17:23:47.494 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:23:47.475+0000 7f1aa7bc6640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 68799, si_uid : 1000, si_addr0x3e800010cbf, si_status0 2024-09-12T17:24:17.375 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.SHUTDOWN (29901 ms) 2024-09-12T17:24:17.376 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 11 tests from LibRGW (30823 ms total) 2024-09-12T17:24:17.376 INFO:tasks.workunit.client.0.smithi037.stdout: 2024-09-12T17:24:17.376 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] Global test environment tear-down 2024-09-12T17:24:17.376 INFO:tasks.workunit.client.0.smithi037.stdout:[==========] 11 tests from 1 test suite ran. (30823 ms total) 2024-09-12T17:24:17.376 INFO:tasks.workunit.client.0.smithi037.stdout:[ PASSED ] 11 tests. 2024-09-12T17:24:17.382 INFO:tasks.workunit.client.0.smithi037.stdout:phase 4.2 2024-09-12T17:24:17.408 INFO:tasks.workunit.client.0.smithi037.stdout:[==========] Running 11 tests from 1 test suite. 2024-09-12T17:24:17.408 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] Global test environment set-up. 2024-09-12T17:24:17.408 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 11 tests from LibRGW 2024-09-12T17:24:17.408 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.TVAR 2024-09-12T17:24:17.408 INFO:tasks.workunit.client.0.smithi037.stdout:read i1: 64001 2024-09-12T17:24:17.409 INFO:tasks.workunit.client.0.smithi037.stdout:read s1: blunderbuss 2024-09-12T17:24:17.409 INFO:tasks.workunit.client.0.smithi037.stdout:read s3: [ OK ] LibRGW.TVAR (0 ms) 2024-09-12T17:24:17.409 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.INIT 2024-09-12T17:24:17.417 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:24:17.417 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:24:17.813 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.INIT (404 ms) 2024-09-12T17:24:17.813 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T17:24:17.813 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-12T17:24:17.813 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-12T17:24:17.825 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (12 ms) 2024-09-12T17:24:17.825 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-12T17:24:17.825 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-12T17:24:17.825 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-12T17:24:17.825 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-12T17:24:17.825 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.MARKER2_READDIR 2024-09-12T17:24:17.828 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-09-12T17:24:17.828 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-09-12T17:24:17.828 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-09-12T17:24:17.828 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-09-12T17:24:17.828 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-09-12T17:24:17.828 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-09-12T17:24:17.828 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-09-12T17:24:17.828 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-09-12T17:24:17.829 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-09-12T17:24:17.829 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-09-12T17:24:17.829 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-09-12T17:24:17.829 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-09-12T17:24:17.829 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-09-12T17:24:17.829 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-09-12T17:24:17.829 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-09-12T17:24:17.829 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-09-12T17:24:17.829 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-09-12T17:24:17.829 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-09-12T17:24:17.829 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-09-12T17:24:17.829 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-09-12T17:24:17.829 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-09-12T17:24:17.830 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-09-12T17:24:17.830 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-09-12T17:24:17.830 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-09-12T17:24:17.830 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-09-12T17:24:17.830 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-09-12T17:24:17.830 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-09-12T17:24:17.830 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-09-12T17:24:17.830 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-09-12T17:24:17.830 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-09-12T17:24:17.830 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-09-12T17:24:17.830 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-09-12T17:24:17.831 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-09-12T17:24:17.831 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-09-12T17:24:17.831 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-09-12T17:24:17.831 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-09-12T17:24:17.831 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-09-12T17:24:17.831 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-09-12T17:24:17.831 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-09-12T17:24:17.831 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-09-12T17:24:17.831 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-09-12T17:24:17.831 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-09-12T17:24:17.831 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-09-12T17:24:17.831 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-09-12T17:24:17.831 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-09-12T17:24:17.832 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-09-12T17:24:17.832 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-09-12T17:24:17.832 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-09-12T17:24:17.832 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-09-12T17:24:17.832 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-09-12T17:24:17.832 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-09-12T17:24:17.832 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-09-12T17:24:17.832 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-09-12T17:24:17.832 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-09-12T17:24:17.832 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-09-12T17:24:17.832 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-09-12T17:24:17.832 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-09-12T17:24:17.832 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-09-12T17:24:17.833 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-09-12T17:24:17.833 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-09-12T17:24:17.833 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-09-12T17:24:17.833 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-09-12T17:24:17.833 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-09-12T17:24:17.833 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-09-12T17:24:17.833 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-09-12T17:24:17.833 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-09-12T17:24:17.833 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-09-12T17:24:17.833 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-09-12T17:24:17.833 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-09-12T17:24:17.833 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-09-12T17:24:17.833 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-09-12T17:24:17.834 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-09-12T17:24:17.834 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-09-12T17:24:17.834 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-09-12T17:24:17.834 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-09-12T17:24:17.834 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-09-12T17:24:17.834 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-09-12T17:24:17.834 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-09-12T17:24:17.834 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-09-12T17:24:17.834 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-09-12T17:24:17.834 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-09-12T17:24:17.834 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-09-12T17:24:17.834 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-09-12T17:24:17.834 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-09-12T17:24:17.835 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-09-12T17:24:17.835 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-09-12T17:24:17.835 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-09-12T17:24:17.835 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-09-12T17:24:17.835 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-09-12T17:24:17.835 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-09-12T17:24:17.835 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-09-12T17:24:17.835 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-09-12T17:24:17.835 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-09-12T17:24:17.835 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-09-12T17:24:17.835 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-09-12T17:24:17.835 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-09-12T17:24:17.835 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-09-12T17:24:17.835 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-09-12T17:24:17.836 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-09-12T17:24:17.836 INFO:tasks.workunit.client.0.smithi037.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-09-12T17:24:17.836 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.MARKER2_READDIR (2 ms) 2024-09-12T17:24:17.836 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-12T17:24:17.836 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-12T17:24:17.836 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T17:24:17.836 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T17:24:17.836 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T17:24:17.836 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T17:24:17.836 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T17:24:17.837 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:24:17.827+0000 7f6d5a4bc8c0 -1 shutting down 2024-09-12T17:24:17.837 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:24:17.828+0000 7f6c341fb640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 69418, si_uid : 1000, si_addr0x3e800010f2a, si_status0 2024-09-12T17:24:47.997 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.SHUTDOWN (30169 ms) 2024-09-12T17:24:47.997 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 11 tests from LibRGW (30588 ms total) 2024-09-12T17:24:47.997 INFO:tasks.workunit.client.0.smithi037.stdout: 2024-09-12T17:24:47.997 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] Global test environment tear-down 2024-09-12T17:24:47.997 INFO:tasks.workunit.client.0.smithi037.stdout:[==========] 11 tests from 1 test suite ran. (30588 ms total) 2024-09-12T17:24:47.997 INFO:tasks.workunit.client.0.smithi037.stdout:[ PASSED ] 11 tests. 2024-09-12T17:24:48.003 INFO:tasks.workunit.client.0.smithi037.stdout:phase 5.1 2024-09-12T17:24:48.037 INFO:tasks.workunit.client.0.smithi037.stdout:[==========] Running 19 tests from 1 test suite. 2024-09-12T17:24:48.037 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] Global test environment set-up. 2024-09-12T17:24:48.037 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 19 tests from LibRGW 2024-09-12T17:24:48.037 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.INIT 2024-09-12T17:24:48.048 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:24:48.048 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:24:48.444 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.INIT (407 ms) 2024-09-12T17:24:48.444 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T17:24:48.445 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-12T17:24:48.445 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-12T17:24:48.457 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.CREATE_BUCKET (12 ms) 2024-09-12T17:24:48.457 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-12T17:24:48.462 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (5 ms) 2024-09-12T17:24:48.462 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.LIST_OBJECTS 2024-09-12T17:24:48.462 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.LIST_OBJECTS (0 ms) 2024-09-12T17:24:48.462 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-12T17:24:48.464 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (2 ms) 2024-09-12T17:24:48.464 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.OBJ_OPEN 2024-09-12T17:24:48.464 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.OBJ_OPEN (0 ms) 2024-09-12T17:24:48.464 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.PUT_OBJECT 2024-09-12T17:24:48.467 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.PUT_OBJECT (3 ms) 2024-09-12T17:24:48.467 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.GET_OBJECT 2024-09-12T17:24:48.470 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.GET_OBJECT (2 ms) 2024-09-12T17:24:48.470 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-12T17:24:48.470 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-12T17:24:48.470 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.WRITE_READ_VERIFY 2024-09-12T17:24:48.470 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.WRITE_READ_VERIFY (0 ms) 2024-09-12T17:24:48.470 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.WRITEV 2024-09-12T17:24:48.470 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.WRITEV (0 ms) 2024-09-12T17:24:48.470 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.READV 2024-09-12T17:24:48.471 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.READV (0 ms) 2024-09-12T17:24:48.471 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.READV_AFTER_WRITEV 2024-09-12T17:24:48.471 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.READV_AFTER_WRITEV (0 ms) 2024-09-12T17:24:48.471 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-12T17:24:48.471 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.DELETE_OBJECT (0 ms) 2024-09-12T17:24:48.471 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-12T17:24:48.471 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-09-12T17:24:48.471 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T17:24:48.471 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T17:24:48.471 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T17:24:48.471 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T17:24:48.471 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T17:24:48.472 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:24:48.469+0000 7f99d42df8c0 -1 shutting down 2024-09-12T17:24:48.472 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:24:48.470+0000 7f98ae01c640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 70038, si_uid : 1000, si_addr0x3e800011196, si_status0 2024-09-12T17:25:18.633 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.SHUTDOWN (30162 ms) 2024-09-12T17:25:18.633 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 19 tests from LibRGW (30595 ms total) 2024-09-12T17:25:18.633 INFO:tasks.workunit.client.0.smithi037.stdout: 2024-09-12T17:25:18.633 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] Global test environment tear-down 2024-09-12T17:25:18.633 INFO:tasks.workunit.client.0.smithi037.stdout:[==========] 19 tests from 1 test suite ran. (30595 ms total) 2024-09-12T17:25:18.633 INFO:tasks.workunit.client.0.smithi037.stdout:[ PASSED ] 19 tests. 2024-09-12T17:25:18.638 INFO:tasks.workunit.client.0.smithi037.stdout:phase 5.2 2024-09-12T17:25:18.673 INFO:tasks.workunit.client.0.smithi037.stdout:[==========] Running 19 tests from 1 test suite. 2024-09-12T17:25:18.673 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] Global test environment set-up. 2024-09-12T17:25:18.673 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 19 tests from LibRGW 2024-09-12T17:25:18.673 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.INIT 2024-09-12T17:25:18.681 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:25:18.681 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:25:19.075 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.INIT (402 ms) 2024-09-12T17:25:19.075 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T17:25:19.076 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-12T17:25:19.076 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-12T17:25:19.076 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-09-12T17:25:19.076 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-12T17:25:19.083 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (6 ms) 2024-09-12T17:25:19.083 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.LIST_OBJECTS 2024-09-12T17:25:19.083 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.LIST_OBJECTS (0 ms) 2024-09-12T17:25:19.083 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-12T17:25:19.083 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (0 ms) 2024-09-12T17:25:19.083 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.OBJ_OPEN 2024-09-12T17:25:19.083 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.OBJ_OPEN (0 ms) 2024-09-12T17:25:19.083 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.PUT_OBJECT 2024-09-12T17:25:19.083 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.PUT_OBJECT (0 ms) 2024-09-12T17:25:19.083 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.GET_OBJECT 2024-09-12T17:25:19.083 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.GET_OBJECT (0 ms) 2024-09-12T17:25:19.083 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-12T17:25:19.083 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-12T17:25:19.084 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.WRITE_READ_VERIFY 2024-09-12T17:25:19.084 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.WRITE_READ_VERIFY (0 ms) 2024-09-12T17:25:19.084 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.WRITEV 2024-09-12T17:25:19.084 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.WRITEV (0 ms) 2024-09-12T17:25:19.084 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.READV 2024-09-12T17:25:19.084 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.READV (0 ms) 2024-09-12T17:25:19.084 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.READV_AFTER_WRITEV 2024-09-12T17:25:19.084 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.READV_AFTER_WRITEV (0 ms) 2024-09-12T17:25:19.084 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-12T17:25:19.087 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.DELETE_OBJECT (5 ms) 2024-09-12T17:25:19.087 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-12T17:25:19.120 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.DELETE_BUCKET (33 ms) 2024-09-12T17:25:19.120 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T17:25:19.120 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T17:25:19.121 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T17:25:19.121 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T17:25:19.121 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T17:25:19.121 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:25:19.119+0000 7f43f3b268c0 -1 shutting down 2024-09-12T17:25:19.121 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:25:19.120+0000 7f42cb977640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 70657, si_uid : 1000, si_addr0x3e800011401, si_status0 2024-09-12T17:25:49.383 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.SHUTDOWN (30262 ms) 2024-09-12T17:25:49.383 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 19 tests from LibRGW (30709 ms total) 2024-09-12T17:25:49.383 INFO:tasks.workunit.client.0.smithi037.stdout: 2024-09-12T17:25:49.383 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] Global test environment tear-down 2024-09-12T17:25:49.383 INFO:tasks.workunit.client.0.smithi037.stdout:[==========] 19 tests from 1 test suite ran. (30709 ms total) 2024-09-12T17:25:49.383 INFO:tasks.workunit.client.0.smithi037.stdout:[ PASSED ] 19 tests. 2024-09-12T17:25:49.389 INFO:tasks.workunit.client.0.smithi037.stdout:phase 6.1 2024-09-12T17:25:49.415 INFO:tasks.workunit.client.0.smithi037.stdout:[==========] Running 10 tests from 1 test suite. 2024-09-12T17:25:49.415 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] Global test environment set-up. 2024-09-12T17:25:49.415 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 10 tests from LibRGW 2024-09-12T17:25:49.416 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.INIT 2024-09-12T17:25:49.423 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:25:49.423 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:25:49.817 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.INIT (402 ms) 2024-09-12T17:25:49.818 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T17:25:49.818 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-12T17:25:49.818 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.CREATE_BUCKETS 2024-09-12T17:25:49.841 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.CREATE_BUCKETS (23 ms) 2024-09-12T17:25:49.841 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.LOOKUP_BUCKETS 2024-09-12T17:25:49.849 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.LOOKUP_BUCKETS (9 ms) 2024-09-12T17:25:49.850 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.TOPDIR_RENAME 2024-09-12T17:25:49.868 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.TOPDIR_RENAME (18 ms) 2024-09-12T17:25:49.868 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.SUBDIR_RENAME 2024-09-12T17:25:49.892 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.SUBDIR_RENAME (24 ms) 2024-09-12T17:25:49.892 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.CROSS_BUCKET_RENAME 2024-09-12T17:25:49.914 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.CROSS_BUCKET_RENAME (21 ms) 2024-09-12T17:25:49.914 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T17:25:49.914 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T17:25:49.914 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T17:25:49.914 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T17:25:49.914 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T17:25:49.914 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:25:49.912+0000 7fac892538c0 -1 shutting down 2024-09-12T17:25:49.915 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:25:49.913+0000 7fab62f92640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 71276, si_uid : 1000, si_addr0x3e80001166c, si_status0 2024-09-12T17:26:20.235 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRGW.SHUTDOWN (30320 ms) 2024-09-12T17:26:20.235 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 10 tests from LibRGW (30819 ms total) 2024-09-12T17:26:20.236 INFO:tasks.workunit.client.0.smithi037.stdout: 2024-09-12T17:26:20.236 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] Global test environment tear-down 2024-09-12T17:26:20.236 INFO:tasks.workunit.client.0.smithi037.stdout:[==========] 10 tests from 1 test suite ran. (30819 ms total) 2024-09-12T17:26:20.236 INFO:tasks.workunit.client.0.smithi037.stdout:[ PASSED ] 10 tests. 2024-09-12T17:26:20.242 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:26:20.242 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:26:20.288 INFO:tasks.workunit:Running workunits matching rgw/test_awssdkv4_sig.sh on client.0... 2024-09-12T17:26:20.290 INFO:tasks.workunit:Running workunit rgw/test_awssdkv4_sig.sh... 2024-09-12T17:26:20.290 DEBUG:teuthology.orchestra.run.smithi037:workunit test rgw/test_awssdkv4_sig.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_awssdkv4_sig.sh 2024-09-12T17:26:20.326 INFO:tasks.workunit.client.0.smithi037.stderr:+ '[' -z ']' 2024-09-12T17:26:20.326 INFO:tasks.workunit.client.0.smithi037.stderr:+ export AWS_ACCESS_KEY_ID=lNCnR47C2g+ZidCWBAUuwfSAA7Q= 2024-09-12T17:26:20.326 INFO:tasks.workunit.client.0.smithi037.stderr:+ AWS_ACCESS_KEY_ID=lNCnR47C2g+ZidCWBAUuwfSAA7Q= 2024-09-12T17:26:20.326 INFO:tasks.workunit.client.0.smithi037.stderr:+ export AWS_SECRET_ACCESS_KEY=tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== 2024-09-12T17:26:20.327 INFO:tasks.workunit.client.0.smithi037.stderr:+ AWS_SECRET_ACCESS_KEY=tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== 2024-09-12T17:26:20.327 INFO:tasks.workunit.client.0.smithi037.stderr:+ radosgw-admin user create --uid ceph-test-maven --access-key lNCnR47C2g+ZidCWBAUuwfSAA7Q= --secret tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== --display-name 'maven test user' --email sigv4@example.com 2024-09-12T17:26:20.365 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:26:20.365 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:26:20.406 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:26:20.405+0000 7f4fa9011800 20 rados->read ofs=0 len=0 2024-09-12T17:26:20.408 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:26:20.406+0000 7f4fa9011800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:20.408 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:26:20.406+0000 7f4fa9011800 20 realm 2024-09-12T17:26:20.408 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:26:20.406+0000 7f4fa9011800 20 rados->read ofs=0 len=0 2024-09-12T17:26:20.408 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:26:20.407+0000 7f4fa9011800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:20.408 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:26:20.407+0000 7f4fa9011800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:26:20.408 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:26:20.407+0000 7f4fa9011800 20 rados->read ofs=0 len=0 2024-09-12T17:26:20.408 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:26:20.407+0000 7f4fa9011800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:20.409 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:26:20.407+0000 7f4fa9011800 20 rados->read ofs=0 len=0 2024-09-12T17:26:20.409 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:26:20.408+0000 7f4fa9011800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:26:20.409 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:26:20.408+0000 7f4fa9011800 20 rados->read ofs=0 len=0 2024-09-12T17:26:20.409 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:26:20.408+0000 7f4fa9011800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:26:20.409 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:26:20.408+0000 7f4fa9011800 20 searching for the correct realm 2024-09-12T17:26:20.411 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:26:20.410+0000 7f4fa4722640 0 -- 172.21.15.37:0/3470199962 >> [v2:172.21.15.37:6800/1206746176,v1:172.21.15.37:6801/1206746176] conn(0x55a5cc1d5750 msgr2=0x7f4f9c0046c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:26:21.020 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:26:21.019+0000 7f4fa4722640 0 -- 172.21.15.37:0/3470199962 >> [v2:172.21.15.37:6800/1206746176,v1:172.21.15.37:6801/1206746176] conn(0x55a5cc1d5750 msgr2=0x7f4f9c0046c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:26:21.027 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:26:21.026+0000 7f4fa9011800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:26:21.027 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:26:21.026+0000 7f4fa9011800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:26:21.027 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:26:21.026+0000 7f4fa9011800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:26:21.027 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:26:21.026+0000 7f4fa9011800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:26:21.027 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:26:21.026+0000 7f4fa9011800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:26:21.027 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:26:21.026+0000 7f4fa9011800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:26:21.028 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:26:21.026+0000 7f4fa9011800 20 rados->read ofs=0 len=0 2024-09-12T17:26:21.028 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:26:21.026+0000 7f4fa9011800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:21.028 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:26:21.026+0000 7f4fa9011800 20 rados->read ofs=0 len=0 2024-09-12T17:26:21.029 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:26:21.027+0000 7f4fa9011800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:26:21.029 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:26:21.027+0000 7f4fa9011800 20 rados->read ofs=0 len=0 2024-09-12T17:26:21.029 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:26:21.027+0000 7f4fa9011800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:26:21.029 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:26:21.027+0000 7f4fa9011800 20 zone default found 2024-09-12T17:26:21.029 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:26:21.027+0000 7f4fa9011800 4 Realm: () 2024-09-12T17:26:21.029 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:26:21.027+0000 7f4fa9011800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:26:21.029 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:26:21.027+0000 7f4fa9011800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:26:21.029 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:26:21.027+0000 7f4fa9011800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:26:21.029 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:26:21.027+0000 7f4fa9011800 20 zonegroup default 2024-09-12T17:26:21.029 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:26:21.027+0000 7f4fa9011800 20 rados->read ofs=0 len=0 2024-09-12T17:26:21.029 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:26:21.028+0000 7f4fa9011800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:21.029 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:26:21.028+0000 7f4fa9011800 20 rados->read ofs=0 len=0 2024-09-12T17:26:21.030 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:26:21.028+0000 7f4fa9011800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:21.030 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:26:21.028+0000 7f4fa9011800 20 rados->read ofs=0 len=0 2024-09-12T17:26:21.030 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:26:21.029+0000 7f4fa9011800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:21.030 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:26:21.029+0000 7f4fa9011800 20 started sync module instance, tier type = 2024-09-12T17:26:21.030 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:26:21.029+0000 7f4fa9011800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:26:21.040 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:26:21.039+0000 7f4fa9011800 20 add_watcher() i=0 2024-09-12T17:26:21.040 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:26:21.039+0000 7f4fa9011800 20 add_watcher() i=1 2024-09-12T17:26:21.040 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:26:21.039+0000 7f4fa9011800 20 add_watcher() i=2 2024-09-12T17:26:21.040 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:26:21.039+0000 7f4fa9011800 20 add_watcher() i=3 2024-09-12T17:26:21.040 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:26:21.039+0000 7f4fa9011800 20 add_watcher() i=4 2024-09-12T17:26:21.040 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:26:21.039+0000 7f4fa9011800 20 add_watcher() i=5 2024-09-12T17:26:21.041 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:26:21.039+0000 7f4fa9011800 20 add_watcher() i=6 2024-09-12T17:26:21.041 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:26:21.040+0000 7f4fa9011800 20 add_watcher() i=7 2024-09-12T17:26:21.041 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:26:21.040+0000 7f4fa9011800 2 all 8 watchers are set, enabling cache 2024-09-12T17:26:21.043 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:26:21.042+0000 7f4e5afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:26:21.044 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:26:21.043+0000 7f4fa9011800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:26:21.044 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:26:21.043+0000 7f4fa9011800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:26:21.044 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:26:21.043+0000 7f4fa9011800 5 note: GC not initialized 2024-09-12T17:26:21.044 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:26:21.043+0000 7f4e59fdb640 20 reqs_thread_entry: start 2024-09-12T17:26:21.044 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:26:21.043+0000 7f4fa9011800 20 init_complete bucket index max shards: 11 2024-09-12T17:26:21.044 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:26:21.043+0000 7f4fa9011800 20 Filter name: none 2024-09-12T17:26:21.044 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:26:21.043+0000 7f4dcb7fe640 20 reqs_thread_entry: start 2024-09-12T17:26:21.044 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:26:21.043+0000 7f4fa9011800 10 cache get: name=default.rgw.meta+users.uid+ceph-test-maven : miss 2024-09-12T17:26:21.045 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:26:21.043+0000 7f4fa9011800 20 rados->read ofs=0 len=0 2024-09-12T17:26:21.046 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:26:21.044+0000 7f4fa9011800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:21.046 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:26:21.044+0000 7f4fa9011800 10 cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x0 2024-09-12T17:26:21.046 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:26:21.044+0000 7f4fa9011800 10 adding default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-09-12T17:26:21.046 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:26:21.044+0000 7f4fa9011800 10 cache get: name=default.rgw.meta+users.email+sigv4@example.com : miss 2024-09-12T17:26:21.046 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:26:21.044+0000 7f4fa9011800 20 rados->read ofs=0 len=0 2024-09-12T17:26:21.046 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:26:21.044+0000 7f4fa9011800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:21.046 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:26:21.044+0000 7f4fa9011800 10 cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x0 2024-09-12T17:26:21.046 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:26:21.044+0000 7f4fa9011800 10 adding default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-09-12T17:26:21.046 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:26:21.044+0000 7f4fa9011800 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : miss 2024-09-12T17:26:21.046 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:26:21.044+0000 7f4fa9011800 20 rados->read ofs=0 len=0 2024-09-12T17:26:21.046 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:26:21.044+0000 7f4fa9011800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:26:21.046 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:26:21.044+0000 7f4fa9011800 10 cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x0 2024-09-12T17:26:21.046 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:26:21.044+0000 7f4fa9011800 10 adding default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-09-12T17:26:21.047 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:26:21.044+0000 7f4fa9011800 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : hit (negative entry) 2024-09-12T17:26:21.047 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:26:21.044+0000 7f4fa9011800 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : hit (negative entry) 2024-09-12T17:26:21.047 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:26:21.046+0000 7f4fa9011800 10 cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x17 2024-09-12T17:26:21.047 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:26:21.046+0000 7f4fa9011800 10 moving default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-09-12T17:26:21.047 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:26:21.046+0000 7f4fa9011800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:ceph-test-maven, ofs0, ns] 2024-09-12T17:26:21.047 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:26:21.046+0000 7f4e7b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1069446856705 cookie 94170584240176 notifier 5534 bl.length()=677 2024-09-12T17:26:21.048 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:26:21.046+0000 7f4e7b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x17 2024-09-12T17:26:21.048 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:26:21.046+0000 7f4e7b7fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-09-12T17:26:21.050 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:26:21.049+0000 7f4fa9011800 10 cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x7 2024-09-12T17:26:21.050 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:26:21.049+0000 7f4fa9011800 10 moving default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-09-12T17:26:21.050 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:26:21.049+0000 7f4fa9011800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.email:sigv4@example.com, ofs0, ns] 2024-09-12T17:26:21.050 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:26:21.050+0000 7f4e7affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1069446856715 cookie 94170584229376 notifier 5534 bl.length()=187 2024-09-12T17:26:21.051 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:26:21.050+0000 7f4e7affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x7 2024-09-12T17:26:21.051 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:26:21.050+0000 7f4e7affd640 10 rgw watcher librados: moving default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-09-12T17:26:21.053 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:26:21.052+0000 7f4fa9011800 10 cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x7 2024-09-12T17:26:21.053 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:26:21.052+0000 7f4fa9011800 10 moving default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-09-12T17:26:21.053 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:26:21.052+0000 7f4fa9011800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:lNCnR47C2g+ZidCWBAUuwfSAA7Q=, ofs0, ns] 2024-09-12T17:26:21.054 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:26:21.053+0000 7f4e7b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1069446856716 cookie 94170584229376 notifier 5534 bl.length()=197 2024-09-12T17:26:21.054 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:26:21.053+0000 7f4e7b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x7 2024-09-12T17:26:21.054 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:26:21.053+0000 7f4e7b7fe640 10 rgw watcher librados: moving default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-09-12T17:26:21.055 INFO:tasks.workunit.client.0.smithi037.stdout:{ 2024-09-12T17:26:21.055 INFO:tasks.workunit.client.0.smithi037.stdout: "user_id": "ceph-test-maven", 2024-09-12T17:26:21.055 INFO:tasks.workunit.client.0.smithi037.stdout: "display_name": "maven test user", 2024-09-12T17:26:21.055 INFO:tasks.workunit.client.0.smithi037.stdout: "email": "sigv4@example.com", 2024-09-12T17:26:21.055 INFO:tasks.workunit.client.0.smithi037.stdout: "suspended": 0, 2024-09-12T17:26:21.055 INFO:tasks.workunit.client.0.smithi037.stdout: "max_buckets": 1000, 2024-09-12T17:26:21.056 INFO:tasks.workunit.client.0.smithi037.stdout: "subusers": [], 2024-09-12T17:26:21.056 INFO:tasks.workunit.client.0.smithi037.stdout: "keys": [ 2024-09-12T17:26:21.056 INFO:tasks.workunit.client.0.smithi037.stdout: { 2024-09-12T17:26:21.056 INFO:tasks.workunit.client.0.smithi037.stdout: "user": "ceph-test-maven", 2024-09-12T17:26:21.056 INFO:tasks.workunit.client.0.smithi037.stdout: "access_key": "lNCnR47C2g+ZidCWBAUuwfSAA7Q=", 2024-09-12T17:26:21.056 INFO:tasks.workunit.client.0.smithi037.stdout: "secret_key": "tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g==", 2024-09-12T17:26:21.056 INFO:tasks.workunit.client.0.smithi037.stdout: "active": true, 2024-09-12T17:26:21.056 INFO:tasks.workunit.client.0.smithi037.stdout: "create_date": "2024-09-12T17:26:21.045461Z" 2024-09-12T17:26:21.056 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:26:21.056 INFO:tasks.workunit.client.0.smithi037.stdout: ], 2024-09-12T17:26:21.056 INFO:tasks.workunit.client.0.smithi037.stdout: "swift_keys": [], 2024-09-12T17:26:21.056 INFO:tasks.workunit.client.0.smithi037.stdout: "caps": [], 2024-09-12T17:26:21.056 INFO:tasks.workunit.client.0.smithi037.stdout: "op_mask": "read, write, delete", 2024-09-12T17:26:21.056 INFO:tasks.workunit.client.0.smithi037.stdout: "default_placement": "", 2024-09-12T17:26:21.057 INFO:tasks.workunit.client.0.smithi037.stdout: "default_storage_class": "", 2024-09-12T17:26:21.057 INFO:tasks.workunit.client.0.smithi037.stdout: "placement_tags": [], 2024-09-12T17:26:21.057 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket_quota": { 2024-09-12T17:26:21.057 INFO:tasks.workunit.client.0.smithi037.stdout: "enabled": false, 2024-09-12T17:26:21.057 INFO:tasks.workunit.client.0.smithi037.stdout: "check_on_raw": false, 2024-09-12T17:26:21.057 INFO:tasks.workunit.client.0.smithi037.stdout: "max_size": -1, 2024-09-12T17:26:21.057 INFO:tasks.workunit.client.0.smithi037.stdout: "max_size_kb": 0, 2024-09-12T17:26:21.057 INFO:tasks.workunit.client.0.smithi037.stdout: "max_objects": -1 2024-09-12T17:26:21.057 INFO:tasks.workunit.client.0.smithi037.stdout: }, 2024-09-12T17:26:21.057 INFO:tasks.workunit.client.0.smithi037.stdout: "user_quota": { 2024-09-12T17:26:21.057 INFO:tasks.workunit.client.0.smithi037.stdout: "enabled": false, 2024-09-12T17:26:21.057 INFO:tasks.workunit.client.0.smithi037.stdout: "check_on_raw": false, 2024-09-12T17:26:21.057 INFO:tasks.workunit.client.0.smithi037.stdout: "max_size": -1, 2024-09-12T17:26:21.057 INFO:tasks.workunit.client.0.smithi037.stdout: "max_size_kb": 0, 2024-09-12T17:26:21.058 INFO:tasks.workunit.client.0.smithi037.stdout: "max_objects": -1 2024-09-12T17:26:21.058 INFO:tasks.workunit.client.0.smithi037.stdout: }, 2024-09-12T17:26:21.058 INFO:tasks.workunit.client.0.smithi037.stdout: "temp_url_keys": [], 2024-09-12T17:26:21.058 INFO:tasks.workunit.client.0.smithi037.stdout: "type": "rgw", 2024-09-12T17:26:21.058 INFO:tasks.workunit.client.0.smithi037.stdout: "mfa_ids": [], 2024-09-12T17:26:21.058 INFO:tasks.workunit.client.0.smithi037.stdout: "account_id": "", 2024-09-12T17:26:21.058 INFO:tasks.workunit.client.0.smithi037.stdout: "path": "/", 2024-09-12T17:26:21.058 INFO:tasks.workunit.client.0.smithi037.stdout: "create_date": "2024-09-12T17:26:21.045438Z", 2024-09-12T17:26:21.058 INFO:tasks.workunit.client.0.smithi037.stdout: "tags": [], 2024-09-12T17:26:21.058 INFO:tasks.workunit.client.0.smithi037.stdout: "group_ids": [] 2024-09-12T17:26:21.058 INFO:tasks.workunit.client.0.smithi037.stdout:} 2024-09-12T17:26:21.058 INFO:tasks.workunit.client.0.smithi037.stdout: 2024-09-12T17:26:21.059 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:26:21.055+0000 7f4e5afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:26:21.059 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:26:21.058+0000 7f4fa9011800 20 remove_watcher() i=0 2024-09-12T17:26:21.059 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:26:21.058+0000 7f4fa9011800 2 removed watcher, disabling cache 2024-09-12T17:26:21.060 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:26:21.059+0000 7f4fa9011800 20 remove_watcher() i=1 2024-09-12T17:26:21.061 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:26:21.060+0000 7f4fa9011800 20 remove_watcher() i=2 2024-09-12T17:26:21.062 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:26:21.061+0000 7f4fa9011800 20 remove_watcher() i=3 2024-09-12T17:26:21.063 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:26:21.062+0000 7f4fa9011800 20 remove_watcher() i=4 2024-09-12T17:26:21.064 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:26:21.064+0000 7f4fa9011800 20 remove_watcher() i=5 2024-09-12T17:26:21.065 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:26:21.065+0000 7f4fa9011800 20 remove_watcher() i=6 2024-09-12T17:26:21.066 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:26:21.066+0000 7f4fa9011800 20 remove_watcher() i=7 2024-09-12T17:26:21.079 INFO:tasks.workunit.client.0.smithi037.stderr:+ '[' -z ']' 2024-09-12T17:26:21.079 INFO:tasks.workunit.client.0.smithi037.stderr:+ '[' -z /home/ubuntu/cephtest ']' 2024-09-12T17:26:21.079 INFO:tasks.workunit.client.0.smithi037.stderr:++ cat /home/ubuntu/cephtest/url_file 2024-09-12T17:26:21.080 INFO:tasks.workunit.client.0.smithi037.stderr:+ export RGW_HTTP_ENDPOINT_URL=http://smithi037.front.sepia.ceph.com:80 2024-09-12T17:26:21.080 INFO:tasks.workunit.client.0.smithi037.stderr:+ RGW_HTTP_ENDPOINT_URL=http://smithi037.front.sepia.ceph.com:80 2024-09-12T17:26:21.080 INFO:tasks.workunit.client.0.smithi037.stderr:+ '[' -z /home/ubuntu/cephtest/clone.client.0 ']' 2024-09-12T17:26:21.080 INFO:tasks.workunit.client.0.smithi037.stderr:+ cd /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum 2024-09-12T17:26:21.080 INFO:tasks.workunit.client.0.smithi037.stderr:+ ./mvnw clean package 2024-09-12T17:26:21.101 INFO:tasks.workunit.client.0.smithi037.stdout:Warning: JAVA_HOME environment variable is not set. 2024-09-12T17:26:22.736 INFO:tasks.workunit.client.0.smithi037.stdout:[INFO] Scanning for projects... 2024-09-12T17:26:22.851 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.1/junit-bom-5.10.1.pom 2024-09-12T17:26:22.931 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 1.4/5.6 kB Progress (1): 2.8/5.6 kB Progress (1): 4.1/5.6 kB Progress (1): 5.5/5.6 kB Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.1/junit-bom-5.10.1.pom (5.6 kB at 67 kB/s) 2024-09-12T17:26:22.942 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom/2.20.43/bom-2.20.43.pom 2024-09-12T17:26:22.982 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 1.4/83 kB Progress (1): 2.8/83 kB Progress (1): 4.1/83 kB Progress (1): 5.5/83 kB Progress (1): 6.9/83 kB Progress (1): 8.3/83 kB Progress (1): 9.7/83 kB Progress (1): 11/83 kB Progress (1): 12/83 kB Progress (1): 14/83 kB Progress (1): 15/83 kB Progress (1): 16/83 kB Progress (1): 33/83 kB Progress (1): 49/83 kB Progress (1): 65/83 kB Progress (1): 81/83 kB Progress (1): 83 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom/2.20.43/bom-2.20.43.pom (83 kB at 2.1 MB/s) 2024-09-12T17:26:22.990 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-sdk-java-pom/2.20.43/aws-sdk-java-pom-2.20.43.pom 2024-09-12T17:26:23.008 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 16/77 kB Progress (1): 33/77 kB Progress (1): 49/77 kB Progress (1): 66/77 kB Progress (1): 77 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-sdk-java-pom/2.20.43/aws-sdk-java-pom-2.20.43.pom (77 kB at 4.0 MB/s) 2024-09-12T17:26:23.031 INFO:tasks.workunit.client.0.smithi037.stdout:[INFO] 2024-09-12T17:26:23.031 INFO:tasks.workunit.client.0.smithi037.stdout:[INFO] ---------------------------< io.ceph:jcksum >--------------------------- 2024-09-12T17:26:23.032 INFO:tasks.workunit.client.0.smithi037.stdout:[INFO] Building jcksum 1.0 2024-09-12T17:26:23.032 INFO:tasks.workunit.client.0.smithi037.stdout:[INFO] from pom.xml 2024-09-12T17:26:23.032 INFO:tasks.workunit.client.0.smithi037.stdout:[INFO] --------------------------------[ jar ]--------------------------------- 2024-09-12T17:26:23.034 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.pom 2024-09-12T17:26:23.050 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 5.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.pom (5.3 kB at 332 kB/s) 2024-09-12T17:26:23.056 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/35/maven-plugins-35.pom 2024-09-12T17:26:23.072 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 9.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/35/maven-plugins-35.pom (9.9 kB at 619 kB/s) 2024-09-12T17:26:23.075 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/35/maven-parent-35.pom 2024-09-12T17:26:23.092 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 16/45 kB Progress (1): 33/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/35/maven-parent-35.pom (45 kB at 2.7 MB/s) 2024-09-12T17:26:23.097 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/25/apache-25.pom 2024-09-12T17:26:23.114 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/25/apache-25.pom (21 kB at 1.3 MB/s) 2024-09-12T17:26:23.124 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.jar 2024-09-12T17:26:23.140 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 15/36 kB Progress (1): 31/36 kB Progress (1): 36 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.jar (36 kB at 2.2 MB/s) 2024-09-12T17:26:23.147 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.pom 2024-09-12T17:26:23.161 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 8.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.pom (8.2 kB at 544 kB/s) 2024-09-12T17:26:23.164 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/39/maven-plugins-39.pom 2024-09-12T17:26:23.178 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 8.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/39/maven-plugins-39.pom (8.1 kB at 578 kB/s) 2024-09-12T17:26:23.180 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/39/maven-parent-39.pom 2024-09-12T17:26:23.196 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 16/48 kB Progress (1): 32/48 kB Progress (1): 48 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/39/maven-parent-39.pom (48 kB at 3.0 MB/s) 2024-09-12T17:26:23.200 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/29/apache-29.pom 2024-09-12T17:26:23.214 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/29/apache-29.pom (21 kB at 1.4 MB/s) 2024-09-12T17:26:23.220 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.jar 2024-09-12T17:26:23.235 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 16/31 kB Progress (1): 31 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.jar (31 kB at 2.1 MB/s) 2024-09-12T17:26:23.240 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.pom 2024-09-12T17:26:23.256 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 9.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.pom (9.8 kB at 613 kB/s) 2024-09-12T17:26:23.262 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.jar 2024-09-12T17:26:23.278 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 16/66 kB Progress (1): 33/66 kB Progress (1): 49/66 kB Progress (1): 66/66 kB Progress (1): 66 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.jar (66 kB at 3.9 MB/s) 2024-09-12T17:26:23.284 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.pom 2024-09-12T17:26:23.299 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 5.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.pom (5.3 kB at 355 kB/s) 2024-09-12T17:26:23.302 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire/3.2.3/surefire-3.2.3.pom 2024-09-12T17:26:23.318 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 16/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire/3.2.3/surefire-3.2.3.pom (22 kB at 1.6 MB/s) 2024-09-12T17:26:23.320 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/41/maven-parent-41.pom 2024-09-12T17:26:23.336 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 16/50 kB Progress (1): 33/50 kB Progress (1): 49/50 kB Progress (1): 50 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/41/maven-parent-41.pom (50 kB at 3.1 MB/s) 2024-09-12T17:26:23.340 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/31/apache-31.pom 2024-09-12T17:26:23.355 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 16/24 kB Progress (1): 24 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/31/apache-31.pom (24 kB at 1.6 MB/s) 2024-09-12T17:26:23.360 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.3/junit-bom-5.9.3.pom 2024-09-12T17:26:23.375 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.3/junit-bom-5.9.3.pom (5.6 kB at 375 kB/s) 2024-09-12T17:26:23.379 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.jar 2024-09-12T17:26:23.394 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 16/45 kB Progress (1): 33/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.jar (45 kB at 3.0 MB/s) 2024-09-12T17:26:23.401 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.pom 2024-09-12T17:26:23.417 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.pom (6.8 kB at 423 kB/s) 2024-09-12T17:26:23.419 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/37/maven-plugins-37.pom 2024-09-12T17:26:23.434 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 9.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/37/maven-plugins-37.pom (9.9 kB at 660 kB/s) 2024-09-12T17:26:23.436 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/37/maven-parent-37.pom 2024-09-12T17:26:23.452 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 16/46 kB Progress (1): 33/46 kB Progress (1): 46 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/37/maven-parent-37.pom (46 kB at 2.9 MB/s) 2024-09-12T17:26:23.455 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/27/apache-27.pom 2024-09-12T17:26:23.469 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/27/apache-27.pom (20 kB at 1.5 MB/s) 2024-09-12T17:26:23.474 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.jar 2024-09-12T17:26:23.490 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 15/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.jar (27 kB at 1.7 MB/s) 2024-09-12T17:26:23.503 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.pom 2024-09-12T17:26:23.522 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.pom (6.1 kB at 406 kB/s) 2024-09-12T17:26:23.522 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/services/2.20.43/services-2.20.43.pom 2024-09-12T17:26:23.535 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/services/2.20.43/services-2.20.43.pom (21 kB at 1.4 MB/s) 2024-09-12T17:26:23.540 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom-internal/2.20.43/bom-internal-2.20.43.pom 2024-09-12T17:26:23.555 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom-internal/2.20.43/bom-internal-2.20.43.pom (20 kB at 1.3 MB/s) 2024-09-12T17:26:23.562 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.pom 2024-09-12T17:26:23.577 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 4.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.pom (4.0 kB at 267 kB/s) 2024-09-12T17:26:23.580 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocols/2.20.43/protocols-2.20.43.pom 2024-09-12T17:26:23.594 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 1.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocols/2.20.43/protocols-2.20.43.pom (1.6 kB at 111 kB/s) 2024-09-12T17:26:23.596 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/core/2.20.43/core-2.20.43.pom 2024-09-12T17:26:23.611 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/core/2.20.43/core-2.20.43.pom (2.2 kB at 149 kB/s) 2024-09-12T17:26:23.615 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.pom 2024-09-12T17:26:23.630 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 3.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.pom (3.6 kB at 243 kB/s) 2024-09-12T17:26:23.635 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.pom 2024-09-12T17:26:23.650 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.pom (3.2 kB at 215 kB/s) 2024-09-12T17:26:23.654 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.pom 2024-09-12T17:26:23.670 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.pom (11 kB at 685 kB/s) 2024-09-12T17:26:23.675 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.pom 2024-09-12T17:26:23.689 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 1.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.pom (1.7 kB at 120 kB/s) 2024-09-12T17:26:23.694 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.pom 2024-09-12T17:26:23.709 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.pom (3.8 kB at 255 kB/s) 2024-09-12T17:26:23.714 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.pom 2024-09-12T17:26:23.729 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 4.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.pom (4.9 kB at 351 kB/s) 2024-09-12T17:26:23.732 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.pom 2024-09-12T17:26:23.746 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 1.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.pom (1.2 kB at 83 kB/s) 2024-09-12T17:26:23.748 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.30/slf4j-api-1.7.30.pom 2024-09-12T17:26:23.763 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.30/slf4j-api-1.7.30.pom (3.8 kB at 256 kB/s) 2024-09-12T17:26:23.764 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.30/slf4j-parent-1.7.30.pom 2024-09-12T17:26:23.778 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.30/slf4j-parent-1.7.30.pom (14 kB at 986 kB/s) 2024-09-12T17:26:23.781 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.pom 2024-09-12T17:26:23.795 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 3.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.pom (3.7 kB at 262 kB/s) 2024-09-12T17:26:23.799 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.pom 2024-09-12T17:26:23.840 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 2.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.pom (2.5 kB at 60 kB/s) 2024-09-12T17:26:23.844 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.pom 2024-09-12T17:26:23.858 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 2.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.pom (2.9 kB at 208 kB/s) 2024-09-12T17:26:23.862 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.pom 2024-09-12T17:26:23.877 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 7.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.pom (7.4 kB at 494 kB/s) 2024-09-12T17:26:23.881 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.pom 2024-09-12T17:26:23.896 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 5.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.pom (5.5 kB at 364 kB/s) 2024-09-12T17:26:23.900 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.pom 2024-09-12T17:26:23.914 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.pom (3.5 kB at 249 kB/s) 2024-09-12T17:26:23.918 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.pom 2024-09-12T17:26:23.933 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 4.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.pom (4.4 kB at 293 kB/s) 2024-09-12T17:26:23.935 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party/2.20.43/third-party-2.20.43.pom 2024-09-12T17:26:23.949 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party/2.20.43/third-party-2.20.43.pom (2.4 kB at 161 kB/s) 2024-09-12T17:26:23.953 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.pom 2024-09-12T17:26:23.973 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.pom (6.4 kB at 322 kB/s) 2024-09-12T17:26:23.977 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.pom 2024-09-12T17:26:23.991 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.pom (6.1 kB at 433 kB/s) 2024-09-12T17:26:23.995 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.pom 2024-09-12T17:26:24.009 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.pom (3.0 kB at 212 kB/s) 2024-09-12T17:26:24.013 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.pom 2024-09-12T17:26:24.028 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.pom (3.5 kB at 232 kB/s) 2024-09-12T17:26:24.032 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.pom 2024-09-12T17:26:24.046 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.pom (4.1 kB at 292 kB/s) 2024-09-12T17:26:24.048 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-clients/2.20.43/http-clients-2.20.43.pom 2024-09-12T17:26:24.062 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 1.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-clients/2.20.43/http-clients-2.20.43.pom (1.8 kB at 127 kB/s) 2024-09-12T17:26:24.065 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.pom 2024-09-12T17:26:24.079 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 6.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.pom (6.6 kB at 472 kB/s) 2024-09-12T17:26:24.081 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-client/4.5.13/httpcomponents-client-4.5.13.pom 2024-09-12T17:26:24.095 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-client/4.5.13/httpcomponents-client-4.5.13.pom (16 kB at 1.2 MB/s) 2024-09-12T17:26:24.098 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-parent/11/httpcomponents-parent-11.pom 2024-09-12T17:26:24.112 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 16/35 kB Progress (1): 33/35 kB Progress (1): 35 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-parent/11/httpcomponents-parent-11.pom (35 kB at 2.3 MB/s) 2024-09-12T17:26:24.115 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/21/apache-21.pom 2024-09-12T17:26:24.129 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/21/apache-21.pom (17 kB at 1.2 MB/s) 2024-09-12T17:26:24.133 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.pom 2024-09-12T17:26:24.146 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 5.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.pom (5.0 kB at 355 kB/s) 2024-09-12T17:26:24.148 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-core/4.4.13/httpcomponents-core-4.4.13.pom 2024-09-12T17:26:24.162 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-core/4.4.13/httpcomponents-core-4.4.13.pom (13 kB at 940 kB/s) 2024-09-12T17:26:24.165 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.11/commons-codec-1.11.pom 2024-09-12T17:26:24.179 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.11/commons-codec-1.11.pom (14 kB at 998 kB/s) 2024-09-12T17:26:24.181 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/42/commons-parent-42.pom 2024-09-12T17:26:24.197 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 16/68 kB Progress (1): 32/68 kB Progress (1): 49/68 kB Progress (1): 65/68 kB Progress (1): 68 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/42/commons-parent-42.pom (68 kB at 4.2 MB/s) 2024-09-12T17:26:24.202 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/18/apache-18.pom 2024-09-12T17:26:24.216 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/18/apache-18.pom (16 kB at 1.1 MB/s) 2024-09-12T17:26:24.220 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.pom 2024-09-12T17:26:24.234 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.pom (15 kB at 1.1 MB/s) 2024-09-12T17:26:24.236 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/52/commons-parent-52.pom 2024-09-12T17:26:24.251 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 16/79 kB Progress (1): 33/79 kB Progress (1): 49/79 kB Progress (1): 66/79 kB Progress (1): 79 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/52/commons-parent-52.pom (79 kB at 5.3 MB/s) 2024-09-12T17:26:24.255 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/23/apache-23.pom 2024-09-12T17:26:24.270 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 16/18 kB Progress (1): 18 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/23/apache-23.pom (18 kB at 1.2 MB/s) 2024-09-12T17:26:24.273 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.pom 2024-09-12T17:26:24.288 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.pom (20 kB at 1.3 MB/s) 2024-09-12T17:26:24.290 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/65/commons-parent-65.pom 2024-09-12T17:26:24.306 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 16/78 kB Progress (1): 33/78 kB Progress (1): 49/78 kB Progress (1): 66/78 kB Progress (1): 78 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/65/commons-parent-65.pom (78 kB at 4.9 MB/s) 2024-09-12T17:26:24.312 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.pom 2024-09-12T17:26:24.326 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.pom (3.8 kB at 274 kB/s) 2024-09-12T17:26:24.328 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.28/slf4j-parent-1.7.28.pom 2024-09-12T17:26:24.343 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.28/slf4j-parent-1.7.28.pom (14 kB at 920 kB/s) 2024-09-12T17:26:24.345 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.pom 2024-09-12T17:26:24.359 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.pom (3.2 kB at 229 kB/s) 2024-09-12T17:26:24.361 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.pom 2024-09-12T17:26:24.376 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.pom (3.2 kB at 227 kB/s) 2024-09-12T17:26:24.378 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.pom 2024-09-12T17:26:24.392 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 2.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.pom (2.0 kB at 145 kB/s) 2024-09-12T17:26:24.394 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.pom 2024-09-12T17:26:24.409 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.pom (2.8 kB at 189 kB/s) 2024-09-12T17:26:24.411 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.pom 2024-09-12T17:26:24.425 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 1.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.pom (1.5 kB at 109 kB/s) 2024-09-12T17:26:24.427 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.pom 2024-09-12T17:26:24.441 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.pom (3.0 kB at 215 kB/s) 2024-09-12T17:26:24.443 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.pom 2024-09-12T17:26:24.457 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.pom (3.2 kB at 229 kB/s) 2024-09-12T17:26:24.459 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.pom 2024-09-12T17:26:24.473 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.pom (3.2 kB at 214 kB/s) 2024-09-12T17:26:24.476 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.pom 2024-09-12T17:26:24.491 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 1.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.pom (1.0 kB at 68 kB/s) 2024-09-12T17:26:24.494 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.pom 2024-09-12T17:26:24.508 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 964 B Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.pom (964 B at 69 kB/s) 2024-09-12T17:26:24.511 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.pom 2024-09-12T17:26:24.525 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 3.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.pom (3.1 kB at 218 kB/s) 2024-09-12T17:26:24.527 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.pom 2024-09-12T17:26:24.542 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.pom (3.0 kB at 202 kB/s) 2024-09-12T17:26:24.544 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.pom 2024-09-12T17:26:24.558 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 3.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.pom (3.4 kB at 246 kB/s) 2024-09-12T17:26:24.560 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.pom 2024-09-12T17:26:24.575 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 3.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.pom (3.4 kB at 229 kB/s) 2024-09-12T17:26:24.577 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.pom 2024-09-12T17:26:24.592 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.pom (3.0 kB at 202 kB/s) 2024-09-12T17:26:24.611 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.jar 2024-09-12T17:26:24.782 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 0/3.3 MB Progress (1): 0/3.3 MB Progress (1): 0/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.3/3.3 MB Progress (1): 3.3/3.3 MB Progress (1): 3.3 MB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.jar (3.3 MB at 19 MB/s) 2024-09-12T17:26:24.783 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.jar 2024-09-12T17:26:24.783 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.jar 2024-09-12T17:26:24.783 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.jar 2024-09-12T17:26:24.783 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.jar 2024-09-12T17:26:24.784 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.jar 2024-09-12T17:26:24.800 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 15/35 kB Progress (1): 31/35 kB Progress (1): 35 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.jar (35 kB at 2.1 MB/s) 2024-09-12T17:26:24.801 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.jar 2024-09-12T17:26:24.815 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.jar (16 kB at 501 kB/s) 2024-09-12T17:26:24.815 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.jar 2024-09-12T17:26:24.845 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 1.4/16 kB Progress (2): 1.4/16 kB | 1.4/98 kB Progress (3): 1.4/16 kB | 1.4/98 kB | 1.4/71 kB Progress (4): 1.4/16 kB | 1.4/98 kB | 1.4/71 kB | 1.4/49 kB Progress (4): 1.4/16 kB | 1.4/98 kB | 2.8/71 kB | 1.4/49 kB Progress (4): 1.4/16 kB | 2.8/98 kB | 2.8/71 kB | 1.4/49 kB Progress (4): 2.8/16 kB | 2.8/98 kB | 2.8/71 kB | 1.4/49 kB Progress (4): 2.8/16 kB | 4.1/98 kB | 2.8/71 kB | 1.4/49 kB Progress (4): 2.8/16 kB | 4.1/98 kB | 4.1/71 kB | 1.4/49 kB Progress (4): 2.8/16 kB | 4.1/98 kB | 4.1/71 kB | 2.8/49 kB Progress (4): 2.8/16 kB | 4.1/98 kB | 5.5/71 kB | 2.8/49 kB Progress (4): 2.8/16 kB | 5.5/98 kB | 5.5/71 kB | 2.8/49 kB Progress (4): 4.1/16 kB | 5.5/98 kB | 5.5/71 kB | 2.8/49 kB Progress (4): 4.1/16 kB | 6.9/98 kB | 5.5/71 kB | 2.8/49 kB Progress (4): 4.1/16 kB | 6.9/98 kB | 6.9/71 kB | 2.8/49 kB Progress (4): 4.1/16 kB | 8.3/98 kB | 6.9/71 kB | 2.8/49 kB Progress (4): 4.1/16 kB | 8.3/98 kB | 6.9/71 kB | 4.1/49 kB Progress (4): 4.1/16 kB | 9.7/98 kB | 6.9/71 kB | 4.1/49 kB Progress (4): 4.1/16 kB | 9.7/98 kB | 8.3/71 kB | 4.1/49 kB Progress (4): 5.5/16 kB | 9.7/98 kB | 8.3/71 kB | 4.1/49 kB Progress (4): 5.5/16 kB | 9.7/98 kB | 9.7/71 kB | 4.1/49 kB Progress (4): 5.5/16 kB | 11/98 kB | 9.7/71 kB | 4.1/49 kB Progress (4): 5.5/16 kB | 11/98 kB | 9.7/71 kB | 5.5/49 kB Progress (4): 5.5/16 kB | 12/98 kB | 9.7/71 kB | 5.5/49 kB Progress (4): 5.5/16 kB | 12/98 kB | 11/71 kB | 5.5/49 kB Progress (4): 6.9/16 kB | 12/98 kB | 11/71 kB | 5.5/49 kB Progress (4): 6.9/16 kB | 12/98 kB | 12/71 kB | 5.5/49 kB Progress (4): 6.9/16 kB | 14/98 kB | 12/71 kB | 5.5/49 kB Progress (4): 6.9/16 kB | 14/98 kB | 12/71 kB | 6.9/49 kB Progress (4): 6.9/16 kB | 15/98 kB | 12/71 kB | 6.9/49 kB Progress (5): 6.9/16 kB | 15/98 kB | 12/71 kB | 6.9/49 kB | 16/782 kB Progress (5): 6.9/16 kB | 15/98 kB | 14/71 kB | 6.9/49 kB | 16/782 kB Progress (5): 8.3/16 kB | 15/98 kB | 14/71 kB | 6.9/49 kB | 16/782 kB Progress (5): 8.3/16 kB | 15/98 kB | 15/71 kB | 6.9/49 kB | 16/782 kB Progress (5): 8.3/16 kB | 16/98 kB | 15/71 kB | 6.9/49 kB | 16/782 kB Progress (5): 8.3/16 kB | 16/98 kB | 15/71 kB | 8.3/49 kB | 16/782 kB Progress (5): 8.3/16 kB | 18/98 kB | 15/71 kB | 8.3/49 kB | 16/782 kB Progress (5): 8.3/16 kB | 18/98 kB | 15/71 kB | 8.3/49 kB | 33/782 kB Progress (5): 8.3/16 kB | 18/98 kB | 16/71 kB | 8.3/49 kB | 33/782 kB Progress (5): 9.7/16 kB | 18/98 kB | 16/71 kB | 8.3/49 kB | 33/782 kB Progress (5): 9.7/16 kB | 18/98 kB | 18/71 kB | 8.3/49 kB | 33/782 kB Progress (5): 9.7/16 kB | 19/98 kB | 18/71 kB | 8.3/49 kB | 33/782 kB Progress (5): 9.7/16 kB | 19/98 kB | 18/71 kB | 9.7/49 kB | 33/782 kB Progress (5): 9.7/16 kB | 21/98 kB | 18/71 kB | 9.7/49 kB | 33/782 kB Progress (5): 9.7/16 kB | 21/98 kB | 18/71 kB | 11/49 kB | 33/782 kB Progress (5): 9.7/16 kB | 21/98 kB | 18/71 kB | 11/49 kB | 49/782 kB Progress (5): 9.7/16 kB | 21/98 kB | 19/71 kB | 11/49 kB | 49/782 kB Progress (5): 11/16 kB | 21/98 kB | 19/71 kB | 11/49 kB | 49/782 kB Progress (5): 11/16 kB | 21/98 kB | 21/71 kB | 11/49 kB | 49/782 kB Progress (5): 11/16 kB | 21/98 kB | 21/71 kB | 12/49 kB | 49/782 kB Progress (5): 11/16 kB | 22/98 kB | 21/71 kB | 12/49 kB | 49/782 kB Progress (5): 11/16 kB | 22/98 kB | 21/71 kB | 12/49 kB | 65/782 kB Progress (5): 11/16 kB | 22/98 kB | 22/71 kB | 12/49 kB | 65/782 kB Progress (5): 12/16 kB | 22/98 kB | 22/71 kB | 12/49 kB | 65/782 kB Progress (5): 12/16 kB | 22/98 kB | 23/71 kB | 12/49 kB | 65/782 kB Progress (5): 12/16 kB | 23/98 kB | 23/71 kB | 12/49 kB | 65/782 kB Progress (5): 12/16 kB | 23/98 kB | 25/71 kB | 12/49 kB | 65/782 kB Progress (5): 12/16 kB | 23/98 kB | 25/71 kB | 14/49 kB | 65/782 kB Progress (5): 12/16 kB | 23/98 kB | 26/71 kB | 14/49 kB | 65/782 kB Progress (5): 12/16 kB | 23/98 kB | 26/71 kB | 15/49 kB | 65/782 kB Progress (5): 12/16 kB | 23/98 kB | 26/71 kB | 15/49 kB | 82/782 kB Progress (5): 12/16 kB | 25/98 kB | 26/71 kB | 15/49 kB | 82/782 kB Progress (5): 14/16 kB | 25/98 kB | 26/71 kB | 15/49 kB | 82/782 kB Progress (5): 14/16 kB | 26/98 kB | 26/71 kB | 15/49 kB | 82/782 kB Progress (5): 14/16 kB | 26/98 kB | 26/71 kB | 17/49 kB | 82/782 kB Progress (5): 14/16 kB | 26/98 kB | 27/71 kB | 17/49 kB | 82/782 kB Progress (5): 14/16 kB | 26/98 kB | 27/71 kB | 17/49 kB | 98/782 kB Progress (5): 14/16 kB | 27/98 kB | 27/71 kB | 17/49 kB | 98/782 kB Progress (5): 15/16 kB | 27/98 kB | 27/71 kB | 17/49 kB | 98/782 kB Progress (5): 15/16 kB | 29/98 kB | 27/71 kB | 17/49 kB | 98/782 kB Progress (5): 15/16 kB | 29/98 kB | 29/71 kB | 17/49 kB | 98/782 kB Progress (5): 15/16 kB | 29/98 kB | 29/71 kB | 18/49 kB | 98/782 kB Progress (5): 15/16 kB | 29/98 kB | 30/71 kB | 18/49 kB | 98/782 kB Progress (5): 15/16 kB | 29/98 kB | 30/71 kB | 19/49 kB | 98/782 kB Progress (5): 15/16 kB | 30/98 kB | 30/71 kB | 19/49 kB | 98/782 kB Progress (5): 15/16 kB | 30/98 kB | 30/71 kB | 21/49 kB | 98/782 kB Progress (5): 15/16 kB | 30/98 kB | 30/71 kB | 21/49 kB | 115/782 kB Progress (5): 16 kB | 30/98 kB | 30/71 kB | 21/49 kB | 115/782 kB Progress (5): 16 kB | 30/98 kB | 30/71 kB | 22/49 kB | 115/782 kB Progress (5): 16 kB | 30/98 kB | 30/71 kB | 23/49 kB | 115/782 kB Progress (5): 16 kB | 30/98 kB | 30/71 kB | 23/49 kB | 131/782 kB Progress (5): 16 kB | 30/98 kB | 30/71 kB | 25/49 kB | 131/782 kB Progress (5): 16 kB | 30/98 kB | 30/71 kB | 26/49 kB | 131/782 kB Progress (5): 16 kB | 30/98 kB | 30/71 kB | 28/49 kB | 131/782 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.jar (16 kB at 310 kB/s) 2024-09-12T17:26:24.845 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (4): 30/98 kB | 30/71 kB | 29/49 kB | 131/782 kB Downloading from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.jar 2024-09-12T17:26:24.846 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (4): 30/98 kB | 30/71 kB | 30/49 kB | 131/782 kB Progress (4): 30/98 kB | 30/71 kB | 30/49 kB | 147/782 kB Progress (4): 30/98 kB | 30/71 kB | 30/49 kB | 164/782 kB Progress (4): 30/98 kB | 30/71 kB | 30/49 kB | 180/782 kB Progress (4): 30/98 kB | 30/71 kB | 30/49 kB | 197/782 kB Progress (4): 30/98 kB | 30/71 kB | 30/49 kB | 213/782 kB Progress (4): 30/98 kB | 30/71 kB | 30/49 kB | 229/782 kB Progress (4): 30/98 kB | 30/71 kB | 30/49 kB | 246/782 kB Progress (4): 30/98 kB | 32/71 kB | 30/49 kB | 246/782 kB Progress (4): 32/98 kB | 32/71 kB | 30/49 kB | 246/782 kB Progress (4): 32/98 kB | 32/71 kB | 32/49 kB | 246/782 kB Progress (4): 33/98 kB | 32/71 kB | 32/49 kB | 246/782 kB Progress (4): 33/98 kB | 33/71 kB | 32/49 kB | 246/782 kB Progress (4): 34/98 kB | 33/71 kB | 32/49 kB | 246/782 kB Progress (4): 34/98 kB | 33/71 kB | 33/49 kB | 246/782 kB Progress (4): 34/98 kB | 34/71 kB | 33/49 kB | 246/782 kB Progress (4): 36/98 kB | 34/71 kB | 33/49 kB | 246/782 kB Progress (4): 36/98 kB | 36/71 kB | 33/49 kB | 246/782 kB Progress (4): 36/98 kB | 36/71 kB | 34/49 kB | 246/782 kB Progress (4): 36/98 kB | 37/71 kB | 34/49 kB | 246/782 kB Progress (4): 37/98 kB | 37/71 kB | 34/49 kB | 246/782 kB Progress (4): 37/98 kB | 37/71 kB | 36/49 kB | 246/782 kB Progress (4): 37/98 kB | 37/71 kB | 37/49 kB | 246/782 kB Progress (4): 37/98 kB | 38/71 kB | 37/49 kB | 246/782 kB Progress (4): 37/98 kB | 38/71 kB | 39/49 kB | 246/782 kB Progress (4): 37/98 kB | 40/71 kB | 39/49 kB | 246/782 kB Progress (4): 38/98 kB | 40/71 kB | 39/49 kB | 246/782 kB Progress (4): 38/98 kB | 41/71 kB | 39/49 kB | 246/782 kB Progress (4): 38/98 kB | 41/71 kB | 40/49 kB | 246/782 kB Progress (4): 38/98 kB | 43/71 kB | 40/49 kB | 246/782 kB Progress (4): 40/98 kB | 43/71 kB | 40/49 kB | 246/782 kB Progress (4): 40/98 kB | 44/71 kB | 40/49 kB | 246/782 kB Progress (4): 40/98 kB | 44/71 kB | 41/49 kB | 246/782 kB Progress (4): 40/98 kB | 45/71 kB | 41/49 kB | 246/782 kB Progress (4): 41/98 kB | 45/71 kB | 41/49 kB | 246/782 kB Progress (4): 41/98 kB | 45/71 kB | 43/49 kB | 246/782 kB Progress (4): 43/98 kB | 45/71 kB | 43/49 kB | 246/782 kB Progress (4): 43/98 kB | 45/71 kB | 44/49 kB | 246/782 kB Progress (4): 44/98 kB | 45/71 kB | 44/49 kB | 246/782 kB Progress (4): 44/98 kB | 45/71 kB | 46/49 kB | 246/782 kB Progress (4): 45/98 kB | 45/71 kB | 46/49 kB | 246/782 kB Progress (4): 45/98 kB | 45/71 kB | 47/49 kB | 246/782 kB Progress (4): 45/98 kB | 45/71 kB | 48/49 kB | 246/782 kB Progress (4): 45/98 kB | 45/71 kB | 49 kB | 246/782 kB Progress (4): 45/98 kB | 45/71 kB | 49 kB | 262/782 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.jar (49 kB at 849 kB/s) 2024-09-12T17:26:24.846 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (3): 46/98 kB | 45/71 kB | 262/782 kB Progress (3): 46/98 kB | 45/71 kB | 278/782 kB Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.jar 2024-09-12T17:26:24.850 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (3): 46/98 kB | 47/71 kB | 278/782 kB Progress (3): 46/98 kB | 48/71 kB | 278/782 kB Progress (3): 46/98 kB | 49/71 kB | 278/782 kB Progress (3): 46/98 kB | 49/71 kB | 295/782 kB Progress (3): 46/98 kB | 49/71 kB | 311/782 kB Progress (3): 46/98 kB | 49/71 kB | 328/782 kB Progress (3): 46/98 kB | 49/71 kB | 344/782 kB Progress (3): 46/98 kB | 49/71 kB | 360/782 kB Progress (3): 46/98 kB | 49/71 kB | 377/782 kB Progress (3): 46/98 kB | 49/71 kB | 393/782 kB Progress (3): 46/98 kB | 49/71 kB | 410/782 kB Progress (3): 46/98 kB | 49/71 kB | 426/782 kB Progress (4): 46/98 kB | 49/71 kB | 426/782 kB | 1.4/11 kB Progress (4): 46/98 kB | 49/71 kB | 426/782 kB | 2.8/11 kB Progress (4): 46/98 kB | 49/71 kB | 426/782 kB | 4.1/11 kB Progress (4): 46/98 kB | 49/71 kB | 426/782 kB | 5.5/11 kB Progress (4): 46/98 kB | 49/71 kB | 426/782 kB | 6.9/11 kB Progress (4): 46/98 kB | 49/71 kB | 442/782 kB | 6.9/11 kB Progress (4): 46/98 kB | 49/71 kB | 442/782 kB | 8.3/11 kB Progress (4): 46/98 kB | 49/71 kB | 442/782 kB | 9.7/11 kB Progress (4): 46/98 kB | 49/71 kB | 459/782 kB | 9.7/11 kB Progress (4): 46/98 kB | 49/71 kB | 475/782 kB | 9.7/11 kB Progress (4): 46/98 kB | 49/71 kB | 475/782 kB | 11/11 kB Progress (4): 46/98 kB | 49/71 kB | 475/782 kB | 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.jar (11 kB at 172 kB/s) 2024-09-12T17:26:24.850 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.jar 2024-09-12T17:26:24.851 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (3): 46/98 kB | 66/71 kB | 475/782 kB Progress (3): 63/98 kB | 66/71 kB | 475/782 kB Progress (3): 63/98 kB | 71 kB | 475/782 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.jar (71 kB at 1.0 MB/s) 2024-09-12T17:26:24.851 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.jar 2024-09-12T17:26:24.855 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (2): 79/98 kB | 475/782 kB Progress (2): 79/98 kB | 491/782 kB Progress (2): 79/98 kB | 508/782 kB Progress (2): 95/98 kB | 508/782 kB Progress (2): 95/98 kB | 524/782 kB Progress (2): 98 kB | 524/782 kB Progress (2): 98 kB | 541/782 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.jar (98 kB at 1.4 MB/s) 2024-09-12T17:26:24.855 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.jar 2024-09-12T17:26:24.867 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 557/782 kB Progress (1): 573/782 kB Progress (1): 590/782 kB Progress (2): 590/782 kB | 16/205 kB Progress (2): 606/782 kB | 16/205 kB Progress (2): 623/782 kB | 16/205 kB Progress (2): 623/782 kB | 33/205 kB Progress (2): 639/782 kB | 33/205 kB Progress (2): 655/782 kB | 33/205 kB Progress (2): 672/782 kB | 33/205 kB Progress (2): 672/782 kB | 49/205 kB Progress (2): 688/782 kB | 49/205 kB Progress (2): 704/782 kB | 49/205 kB Progress (2): 721/782 kB | 49/205 kB Progress (2): 737/782 kB | 49/205 kB Progress (3): 737/782 kB | 49/205 kB | 1.4/30 kB Progress (3): 737/782 kB | 49/205 kB | 2.8/30 kB Progress (3): 737/782 kB | 49/205 kB | 4.1/30 kB Progress (3): 737/782 kB | 49/205 kB | 5.5/30 kB Progress (3): 737/782 kB | 49/205 kB | 6.9/30 kB Progress (3): 737/782 kB | 49/205 kB | 8.3/30 kB Progress (3): 737/782 kB | 49/205 kB | 9.7/30 kB Progress (3): 754/782 kB | 49/205 kB | 9.7/30 kB Progress (3): 754/782 kB | 49/205 kB | 11/30 kB Progress (3): 770/782 kB | 49/205 kB | 11/30 kB Progress (3): 770/782 kB | 49/205 kB | 12/30 kB Progress (3): 770/782 kB | 49/205 kB | 14/30 kB Progress (3): 770/782 kB | 49/205 kB | 15/30 kB Progress (3): 782 kB | 49/205 kB | 15/30 kB Progress (4): 782 kB | 49/205 kB | 15/30 kB | 16/81 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.jar (782 kB at 9.5 MB/s) 2024-09-12T17:26:24.867 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (3): 49/205 kB | 17/30 kB | 16/81 kB Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.jar 2024-09-12T17:26:24.869 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (3): 49/205 kB | 18/30 kB | 16/81 kB Progress (3): 49/205 kB | 19/30 kB | 16/81 kB Progress (3): 49/205 kB | 21/30 kB | 16/81 kB Progress (3): 63/205 kB | 21/30 kB | 16/81 kB Progress (3): 79/205 kB | 21/30 kB | 16/81 kB Progress (3): 79/205 kB | 22/30 kB | 16/81 kB Progress (3): 79/205 kB | 23/30 kB | 16/81 kB Progress (3): 79/205 kB | 25/30 kB | 16/81 kB Progress (3): 79/205 kB | 25/30 kB | 33/81 kB Progress (3): 79/205 kB | 26/30 kB | 33/81 kB Progress (3): 79/205 kB | 28/30 kB | 33/81 kB Progress (3): 79/205 kB | 29/30 kB | 33/81 kB Progress (4): 79/205 kB | 29/30 kB | 33/81 kB | 15/798 kB Progress (4): 79/205 kB | 30 kB | 33/81 kB | 15/798 kB Progress (4): 79/205 kB | 30 kB | 49/81 kB | 15/798 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.jar (30 kB at 359 kB/s) 2024-09-12T17:26:24.869 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.jar 2024-09-12T17:26:24.878 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (3): 95/205 kB | 49/81 kB | 15/798 kB Progress (3): 112/205 kB | 49/81 kB | 15/798 kB Progress (3): 112/205 kB | 49/81 kB | 31/798 kB Progress (3): 128/205 kB | 49/81 kB | 31/798 kB Progress (3): 128/205 kB | 66/81 kB | 31/798 kB Progress (3): 128/205 kB | 66/81 kB | 48/798 kB Progress (3): 145/205 kB | 66/81 kB | 48/798 kB Progress (3): 145/205 kB | 66/81 kB | 64/798 kB Progress (3): 145/205 kB | 66/81 kB | 78/798 kB Progress (3): 161/205 kB | 66/81 kB | 78/798 kB Progress (3): 177/205 kB | 66/81 kB | 78/798 kB Progress (3): 177/205 kB | 66/81 kB | 95/798 kB Progress (3): 177/205 kB | 81 kB | 95/798 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.jar (81 kB at 883 kB/s) 2024-09-12T17:26:24.878 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.jar 2024-09-12T17:26:24.879 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (2): 194/205 kB | 95/798 kB Progress (2): 205 kB | 95/798 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.jar (205 kB at 2.2 MB/s) 2024-09-12T17:26:24.879 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.jar 2024-09-12T17:26:24.881 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 111/798 kB Progress (2): 111/798 kB | 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.jar (13 kB at 139 kB/s) 2024-09-12T17:26:24.881 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 128/798 kB Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.jar 2024-09-12T17:26:24.908 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 144/798 kB Progress (1): 160/798 kB Progress (1): 177/798 kB Progress (2): 177/798 kB | 16/182 kB Progress (2): 193/798 kB | 16/182 kB Progress (2): 209/798 kB | 16/182 kB Progress (2): 209/798 kB | 32/182 kB Progress (2): 226/798 kB | 32/182 kB Progress (2): 242/798 kB | 32/182 kB Progress (2): 242/798 kB | 49/182 kB Progress (2): 259/798 kB | 49/182 kB Progress (2): 275/798 kB | 49/182 kB Progress (2): 275/798 kB | 64/182 kB Progress (2): 291/798 kB | 64/182 kB Progress (2): 308/798 kB | 64/182 kB Progress (3): 308/798 kB | 64/182 kB | 16/151 kB Progress (3): 308/798 kB | 64/182 kB | 33/151 kB Progress (3): 324/798 kB | 64/182 kB | 33/151 kB Progress (3): 341/798 kB | 64/182 kB | 33/151 kB Progress (3): 357/798 kB | 64/182 kB | 33/151 kB Progress (4): 357/798 kB | 64/182 kB | 33/151 kB | 16/27 kB Progress (4): 357/798 kB | 81/182 kB | 33/151 kB | 16/27 kB Progress (4): 357/798 kB | 81/182 kB | 49/151 kB | 16/27 kB Progress (4): 357/798 kB | 81/182 kB | 49/151 kB | 27 kB Progress (4): 373/798 kB | 81/182 kB | 49/151 kB | 27 kB Progress (4): 373/798 kB | 97/182 kB | 49/151 kB | 27 kB Progress (4): 373/798 kB | 97/182 kB | 62/151 kB | 27 kB Progress (5): 373/798 kB | 97/182 kB | 62/151 kB | 27 kB | 15/30 kB Progress (5): 390/798 kB | 97/182 kB | 62/151 kB | 27 kB | 15/30 kB Progress (5): 390/798 kB | 113/182 kB | 62/151 kB | 27 kB | 15/30 kB Progress (5): 390/798 kB | 113/182 kB | 79/151 kB | 27 kB | 15/30 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.jar (27 kB at 225 kB/s) 2024-09-12T17:26:24.908 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (4): 390/798 kB | 113/182 kB | 79/151 kB | 30 kB Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.jar 2024-09-12T17:26:24.908 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (4): 406/798 kB | 113/182 kB | 79/151 kB | 30 kB Progress (4): 406/798 kB | 113/182 kB | 95/151 kB | 30 kB Progress (4): 406/798 kB | 130/182 kB | 95/151 kB | 30 kB Progress (4): 422/798 kB | 130/182 kB | 95/151 kB | 30 kB Progress (4): 422/798 kB | 130/182 kB | 111/151 kB | 30 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.jar (30 kB at 246 kB/s) 2024-09-12T17:26:24.909 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (3): 422/798 kB | 146/182 kB | 111/151 kB Progress (3): 439/798 kB | 146/182 kB | 111/151 kB Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.jar 2024-09-12T17:26:24.910 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (3): 439/798 kB | 146/182 kB | 128/151 kB Progress (3): 439/798 kB | 146/182 kB | 144/151 kB Progress (3): 455/798 kB | 146/182 kB | 144/151 kB Progress (3): 455/798 kB | 162/182 kB | 144/151 kB Progress (3): 455/798 kB | 162/182 kB | 151 kB Progress (3): 472/798 kB | 162/182 kB | 151 kB Progress (3): 472/798 kB | 179/182 kB | 151 kB Progress (3): 488/798 kB | 179/182 kB | 151 kB Progress (3): 488/798 kB | 182 kB | 151 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.jar (151 kB at 1.2 MB/s) 2024-09-12T17:26:24.910 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.jar 2024-09-12T17:26:24.910 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (2): 504/798 kB | 182 kB Progress (2): 521/798 kB | 182 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.jar (182 kB at 1.5 MB/s) 2024-09-12T17:26:24.910 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.jar 2024-09-12T17:26:24.915 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 537/798 kB Progress (1): 554/798 kB Progress (1): 570/798 kB Progress (1): 586/798 kB Progress (1): 603/798 kB Progress (1): 619/798 kB Progress (1): 635/798 kB Progress (1): 652/798 kB Progress (1): 668/798 kB Progress (1): 685/798 kB Progress (1): 701/798 kB Progress (1): 717/798 kB Progress (1): 734/798 kB Progress (1): 750/798 kB Progress (1): 766/798 kB Progress (1): 783/798 kB Progress (1): 798 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.jar (798 kB at 6.1 MB/s) 2024-09-12T17:26:24.915 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.jar 2024-09-12T17:26:24.922 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 16/385 kB Progress (1): 33/385 kB Progress (2): 33/385 kB | 13 kB Progress (2): 49/385 kB | 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.jar (13 kB at 97 kB/s) 2024-09-12T17:26:24.922 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.jar 2024-09-12T17:26:24.926 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 65/385 kB Progress (1): 82/385 kB Progress (1): 98/385 kB Progress (2): 98/385 kB | 16/780 kB Progress (3): 98/385 kB | 16/780 kB | 15/75 kB Progress (3): 98/385 kB | 33/780 kB | 15/75 kB Progress (3): 98/385 kB | 33/780 kB | 31/75 kB Progress (3): 98/385 kB | 49/780 kB | 31/75 kB Progress (3): 98/385 kB | 49/780 kB | 48/75 kB Progress (3): 114/385 kB | 49/780 kB | 48/75 kB Progress (3): 114/385 kB | 65/780 kB | 48/75 kB Progress (3): 131/385 kB | 65/780 kB | 48/75 kB Progress (3): 131/385 kB | 81/780 kB | 48/75 kB Progress (3): 131/385 kB | 81/780 kB | 64/75 kB Progress (3): 131/385 kB | 97/780 kB | 64/75 kB Progress (3): 131/385 kB | 97/780 kB | 75 kB Progress (3): 131/385 kB | 114/780 kB | 75 kB Progress (3): 147/385 kB | 114/780 kB | 75 kB Progress (3): 147/385 kB | 130/780 kB | 75 kB Progress (3): 147/385 kB | 147/780 kB | 75 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.jar (75 kB at 529 kB/s) 2024-09-12T17:26:24.927 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.jar 2024-09-12T17:26:24.935 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (2): 147/385 kB | 163/780 kB Progress (2): 164/385 kB | 163/780 kB Progress (2): 164/385 kB | 179/780 kB Progress (2): 164/385 kB | 196/780 kB Progress (2): 164/385 kB | 212/780 kB Progress (2): 180/385 kB | 212/780 kB Progress (2): 180/385 kB | 228/780 kB Progress (2): 196/385 kB | 228/780 kB Progress (2): 196/385 kB | 245/780 kB Progress (2): 196/385 kB | 261/780 kB Progress (2): 213/385 kB | 261/780 kB Progress (2): 213/385 kB | 278/780 kB Progress (2): 213/385 kB | 294/780 kB Progress (3): 213/385 kB | 294/780 kB | 16/329 kB Progress (3): 213/385 kB | 294/780 kB | 33/329 kB Progress (3): 229/385 kB | 294/780 kB | 33/329 kB Progress (3): 229/385 kB | 294/780 kB | 49/329 kB Progress (3): 229/385 kB | 294/780 kB | 60/329 kB Progress (3): 229/385 kB | 294/780 kB | 64/329 kB Progress (3): 229/385 kB | 294/780 kB | 81/329 kB Progress (3): 229/385 kB | 294/780 kB | 97/329 kB Progress (3): 229/385 kB | 294/780 kB | 113/329 kB Progress (3): 229/385 kB | 294/780 kB | 130/329 kB Progress (3): 229/385 kB | 294/780 kB | 146/329 kB Progress (3): 229/385 kB | 294/780 kB | 162/329 kB Progress (3): 229/385 kB | 294/780 kB | 179/329 kB Progress (3): 229/385 kB | 294/780 kB | 195/329 kB Progress (3): 245/385 kB | 294/780 kB | 195/329 kB Progress (3): 245/385 kB | 294/780 kB | 212/329 kB Progress (3): 245/385 kB | 294/780 kB | 228/329 kB Progress (3): 262/385 kB | 294/780 kB | 228/329 kB Progress (3): 262/385 kB | 294/780 kB | 244/329 kB Progress (3): 262/385 kB | 294/780 kB | 261/329 kB Progress (3): 262/385 kB | 294/780 kB | 277/329 kB Progress (3): 262/385 kB | 294/780 kB | 294/329 kB Progress (3): 278/385 kB | 294/780 kB | 294/329 kB Progress (3): 278/385 kB | 294/780 kB | 310/329 kB Progress (3): 295/385 kB | 294/780 kB | 310/329 kB Progress (3): 295/385 kB | 294/780 kB | 326/329 kB Progress (3): 295/385 kB | 294/780 kB | 329 kB Progress (3): 311/385 kB | 294/780 kB | 329 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.jar (329 kB at 2.2 MB/s) 2024-09-12T17:26:24.935 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (2): 327/385 kB | 294/780 kB Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.jar 2024-09-12T17:26:24.938 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (2): 344/385 kB | 294/780 kB Progress (3): 344/385 kB | 294/780 kB | 16/501 kB Progress (3): 344/385 kB | 310/780 kB | 16/501 kB Progress (3): 344/385 kB | 310/780 kB | 33/501 kB Progress (3): 344/385 kB | 327/780 kB | 33/501 kB Progress (3): 344/385 kB | 327/780 kB | 49/501 kB Progress (3): 360/385 kB | 327/780 kB | 49/501 kB Progress (3): 360/385 kB | 343/780 kB | 49/501 kB Progress (3): 360/385 kB | 343/780 kB | 66/501 kB Progress (3): 360/385 kB | 343/780 kB | 82/501 kB Progress (3): 360/385 kB | 359/780 kB | 82/501 kB Progress (3): 376/385 kB | 359/780 kB | 82/501 kB Progress (3): 376/385 kB | 376/780 kB | 82/501 kB Progress (3): 385 kB | 376/780 kB | 82/501 kB Progress (3): 385 kB | 376/780 kB | 98/501 kB Progress (3): 385 kB | 392/780 kB | 98/501 kB Progress (3): 385 kB | 392/780 kB | 115/501 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.jar (385 kB at 2.5 MB/s) 2024-09-12T17:26:24.938 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (2): 409/780 kB | 115/501 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.jar 2024-09-12T17:26:24.948 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (2): 425/780 kB | 115/501 kB Progress (2): 425/780 kB | 131/501 kB Progress (2): 425/780 kB | 147/501 kB Progress (2): 441/780 kB | 147/501 kB Progress (2): 441/780 kB | 164/501 kB Progress (2): 458/780 kB | 164/501 kB Progress (2): 458/780 kB | 180/501 kB Progress (2): 474/780 kB | 180/501 kB Progress (2): 474/780 kB | 197/501 kB Progress (2): 491/780 kB | 197/501 kB Progress (3): 491/780 kB | 197/501 kB | 16/354 kB Progress (3): 507/780 kB | 197/501 kB | 16/354 kB Progress (3): 507/780 kB | 197/501 kB | 33/354 kB Progress (3): 507/780 kB | 213/501 kB | 33/354 kB Progress (3): 523/780 kB | 213/501 kB | 33/354 kB Progress (3): 523/780 kB | 213/501 kB | 49/354 kB Progress (3): 523/780 kB | 229/501 kB | 49/354 kB Progress (3): 540/780 kB | 229/501 kB | 49/354 kB Progress (3): 540/780 kB | 229/501 kB | 63/354 kB Progress (3): 540/780 kB | 246/501 kB | 63/354 kB Progress (3): 556/780 kB | 246/501 kB | 63/354 kB Progress (3): 556/780 kB | 246/501 kB | 79/354 kB Progress (3): 556/780 kB | 262/501 kB | 79/354 kB Progress (3): 572/780 kB | 262/501 kB | 79/354 kB Progress (3): 572/780 kB | 262/501 kB | 96/354 kB Progress (3): 572/780 kB | 262/501 kB | 112/354 kB Progress (3): 589/780 kB | 262/501 kB | 112/354 kB Progress (3): 589/780 kB | 262/501 kB | 128/354 kB Progress (3): 605/780 kB | 262/501 kB | 128/354 kB Progress (3): 622/780 kB | 262/501 kB | 128/354 kB Progress (3): 622/780 kB | 262/501 kB | 145/354 kB Progress (3): 622/780 kB | 262/501 kB | 161/354 kB Progress (3): 638/780 kB | 262/501 kB | 161/354 kB Progress (3): 638/780 kB | 262/501 kB | 177/354 kB Progress (3): 654/780 kB | 262/501 kB | 177/354 kB Progress (3): 654/780 kB | 262/501 kB | 194/354 kB Progress (3): 671/780 kB | 262/501 kB | 194/354 kB Progress (3): 671/780 kB | 262/501 kB | 210/354 kB Progress (3): 687/780 kB | 262/501 kB | 210/354 kB Progress (3): 687/780 kB | 262/501 kB | 227/354 kB Progress (3): 704/780 kB | 262/501 kB | 227/354 kB Progress (3): 704/780 kB | 262/501 kB | 243/354 kB Progress (3): 720/780 kB | 262/501 kB | 243/354 kB Progress (3): 736/780 kB | 262/501 kB | 243/354 kB Progress (3): 753/780 kB | 262/501 kB | 243/354 kB Progress (3): 769/780 kB | 262/501 kB | 243/354 kB Progress (3): 780 kB | 262/501 kB | 243/354 kB Progress (3): 780 kB | 279/501 kB | 243/354 kB Progress (3): 780 kB | 295/501 kB | 243/354 kB Progress (3): 780 kB | 311/501 kB | 243/354 kB Progress (3): 780 kB | 328/501 kB | 243/354 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.jar (780 kB at 4.8 MB/s) 2024-09-12T17:26:24.948 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.jar 2024-09-12T17:26:24.955 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (2): 344/501 kB | 243/354 kB Progress (2): 360/501 kB | 243/354 kB Progress (2): 377/501 kB | 243/354 kB Progress (3): 377/501 kB | 243/354 kB | 16/41 kB Progress (3): 393/501 kB | 243/354 kB | 16/41 kB Progress (3): 393/501 kB | 243/354 kB | 33/41 kB Progress (3): 410/501 kB | 243/354 kB | 33/41 kB Progress (3): 410/501 kB | 243/354 kB | 41 kB Progress (3): 426/501 kB | 243/354 kB | 41 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.jar (41 kB at 251 kB/s) 2024-09-12T17:26:24.955 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.jar 2024-09-12T17:26:24.955 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (2): 442/501 kB | 243/354 kB Progress (2): 459/501 kB | 243/354 kB Progress (2): 475/501 kB | 243/354 kB Progress (2): 492/501 kB | 243/354 kB Progress (2): 501 kB | 243/354 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.jar (501 kB at 3.0 MB/s) 2024-09-12T17:26:24.955 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.jar 2024-09-12T17:26:24.956 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (2): 243/354 kB | 6.4 kB Progress (2): 259/354 kB | 6.4 kB Progress (2): 276/354 kB | 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.jar (6.4 kB at 38 kB/s) 2024-09-12T17:26:24.956 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.jar 2024-09-12T17:26:24.956 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 292/354 kB Progress (1): 309/354 kB Progress (1): 325/354 kB Progress (1): 341/354 kB Progress (1): 354 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.jar (354 kB at 2.1 MB/s) 2024-09-12T17:26:24.956 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.jar 2024-09-12T17:26:24.968 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 16/586 kB Progress (1): 32/586 kB Progress (1): 49/586 kB Progress (1): 62/586 kB Progress (1): 78/586 kB Progress (2): 78/586 kB | 16/211 kB Progress (2): 95/586 kB | 16/211 kB Progress (2): 95/586 kB | 33/211 kB Progress (2): 111/586 kB | 33/211 kB Progress (2): 127/586 kB | 33/211 kB Progress (2): 127/586 kB | 49/211 kB Progress (2): 144/586 kB | 49/211 kB Progress (2): 144/586 kB | 66/211 kB Progress (2): 160/586 kB | 66/211 kB Progress (2): 160/586 kB | 82/211 kB Progress (2): 160/586 kB | 98/211 kB Progress (2): 176/586 kB | 98/211 kB Progress (2): 176/586 kB | 114/211 kB Progress (2): 193/586 kB | 114/211 kB Progress (2): 193/586 kB | 131/211 kB Progress (3): 193/586 kB | 131/211 kB | 14 kB Progress (3): 193/586 kB | 147/211 kB | 14 kB Progress (3): 209/586 kB | 147/211 kB | 14 kB Progress (4): 209/586 kB | 147/211 kB | 14 kB | 16/106 kB Progress (4): 209/586 kB | 163/211 kB | 14 kB | 16/106 kB Progress (4): 226/586 kB | 163/211 kB | 14 kB | 16/106 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.jar (14 kB at 79 kB/s) 2024-09-12T17:26:24.968 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (3): 226/586 kB | 180/211 kB | 16/106 kB Progress (3): 226/586 kB | 180/211 kB | 33/106 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.jar 2024-09-12T17:26:24.969 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (3): 242/586 kB | 180/211 kB | 33/106 kB Progress (3): 242/586 kB | 196/211 kB | 33/106 kB Progress (3): 242/586 kB | 196/211 kB | 49/106 kB Progress (3): 258/586 kB | 196/211 kB | 49/106 kB Progress (3): 258/586 kB | 211 kB | 49/106 kB Progress (3): 258/586 kB | 211 kB | 65/106 kB Progress (4): 258/586 kB | 211 kB | 65/106 kB | 6.8 kB Progress (4): 275/586 kB | 211 kB | 65/106 kB | 6.8 kB Progress (4): 275/586 kB | 211 kB | 81/106 kB | 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.jar (211 kB at 1.2 MB/s) 2024-09-12T17:26:24.969 INFO:tasks.workunit.client.0.smithi037.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.jar (6.8 kB at 38 kB/s) 2024-09-12T17:26:24.969 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (2): 275/586 kB | 98/106 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.jar 2024-09-12T17:26:24.969 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.jar 2024-09-12T17:26:24.969 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (2): 291/586 kB | 98/106 kB Progress (2): 291/586 kB | 106 kB Progress (2): 308/586 kB | 106 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.jar (106 kB at 584 kB/s) 2024-09-12T17:26:24.969 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.jar 2024-09-12T17:26:24.975 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 324/586 kB Progress (1): 340/586 kB Progress (1): 357/586 kB Progress (1): 373/586 kB Progress (1): 389/586 kB Progress (1): 406/586 kB Progress (1): 422/586 kB Progress (1): 439/586 kB Progress (1): 455/586 kB Progress (1): 471/586 kB Progress (1): 488/586 kB Progress (1): 504/586 kB Progress (1): 521/586 kB Progress (1): 537/586 kB Progress (1): 553/586 kB Progress (1): 570/586 kB Progress (1): 586 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.jar (586 kB at 3.1 MB/s) 2024-09-12T17:26:24.976 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.jar 2024-09-12T17:26:24.984 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 16/245 kB Progress (1): 33/245 kB Progress (2): 33/245 kB | 15 kB Progress (3): 33/245 kB | 15 kB | 16/205 kB Progress (3): 33/245 kB | 15 kB | 33/205 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.jar (15 kB at 78 kB/s) 2024-09-12T17:26:24.984 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (2): 49/245 kB | 33/205 kB Progress (2): 49/245 kB | 49/205 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.jar 2024-09-12T17:26:24.984 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (2): 63/245 kB | 49/205 kB Progress (2): 63/245 kB | 66/205 kB Progress (3): 63/245 kB | 66/205 kB | 15/16 kB Progress (3): 63/245 kB | 66/205 kB | 16 kB Progress (3): 63/245 kB | 82/205 kB | 16 kB Progress (3): 79/245 kB | 82/205 kB | 16 kB Progress (3): 79/245 kB | 98/205 kB | 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.jar (16 kB at 84 kB/s) 2024-09-12T17:26:24.984 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.jar 2024-09-12T17:26:24.986 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (2): 79/245 kB | 114/205 kB Progress (2): 95/245 kB | 114/205 kB Progress (2): 95/245 kB | 130/205 kB Progress (2): 112/245 kB | 130/205 kB Progress (2): 112/245 kB | 147/205 kB Progress (2): 112/245 kB | 163/205 kB Progress (2): 112/245 kB | 180/205 kB Progress (2): 128/245 kB | 180/205 kB Progress (2): 128/245 kB | 196/205 kB Progress (2): 128/245 kB | 205 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.jar (205 kB at 1.0 MB/s) 2024-09-12T17:26:24.986 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.jar 2024-09-12T17:26:24.990 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 145/245 kB Progress (1): 161/245 kB Progress (1): 177/245 kB Progress (1): 194/245 kB Progress (1): 210/245 kB Progress (1): 226/245 kB Progress (1): 243/245 kB Progress (1): 245 kB Progress (2): 245 kB | 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.jar (245 kB at 1.2 MB/s) 2024-09-12T17:26:24.990 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.jar 2024-09-12T17:26:24.990 INFO:tasks.workunit.client.0.smithi037.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.jar (6.4 kB at 31 kB/s) 2024-09-12T17:26:24.997 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 16/23 kB Progress (1): 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.jar (23 kB at 107 kB/s) 2024-09-12T17:26:24.998 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 16/24 kB Progress (1): 24 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.jar (24 kB at 114 kB/s) 2024-09-12T17:26:24.999 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.jar (17 kB at 81 kB/s) 2024-09-12T17:26:25.009 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 16/184 kB Progress (1): 33/184 kB Progress (1): 49/184 kB Progress (1): 66/184 kB Progress (1): 82/184 kB Progress (1): 98/184 kB Progress (1): 115/184 kB Progress (1): 131/184 kB Progress (1): 147/184 kB Progress (1): 164/184 kB Progress (1): 180/184 kB Progress (1): 184 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.jar (184 kB at 824 kB/s) 2024-09-12T17:26:25.027 INFO:tasks.workunit.client.0.smithi037.stdout:[INFO] 2024-09-12T17:26:25.027 INFO:tasks.workunit.client.0.smithi037.stdout:[INFO] --- clean:3.2.0:clean (default-clean) @ jcksum --- 2024-09-12T17:26:25.033 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.pom 2024-09-12T17:26:25.048 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 5.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.pom (5.8 kB at 389 kB/s) 2024-09-12T17:26:25.050 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/34/maven-shared-components-34.pom 2024-09-12T17:26:25.064 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/34/maven-shared-components-34.pom (5.1 kB at 340 kB/s) 2024-09-12T17:26:25.066 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/34/maven-parent-34.pom 2024-09-12T17:26:25.081 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 16/43 kB Progress (1): 33/43 kB Progress (1): 43 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/34/maven-parent-34.pom (43 kB at 3.1 MB/s) 2024-09-12T17:26:25.085 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.pom 2024-09-12T17:26:25.099 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.pom (14 kB at 950 kB/s) 2024-09-12T17:26:25.103 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.jar 2024-09-12T17:26:25.121 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 16/153 kB Progress (1): 32/153 kB Progress (1): 49/153 kB Progress (1): 65/153 kB Progress (1): 81/153 kB Progress (1): 98/153 kB Progress (1): 114/153 kB Progress (1): 130/153 kB Progress (1): 147/153 kB Progress (1): 153 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.jar (153 kB at 8.5 MB/s) 2024-09-12T17:26:25.122 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.jar 2024-09-12T17:26:25.140 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 16/215 kB Progress (1): 32/215 kB Progress (1): 49/215 kB Progress (1): 65/215 kB Progress (1): 81/215 kB Progress (1): 98/215 kB Progress (1): 114/215 kB Progress (1): 131/215 kB Progress (1): 147/215 kB Progress (1): 163/215 kB Progress (1): 180/215 kB Progress (1): 196/215 kB Progress (1): 212/215 kB Progress (1): 215 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.jar (215 kB at 11 MB/s) 2024-09-12T17:26:25.178 INFO:tasks.workunit.client.0.smithi037.stdout:[INFO] 2024-09-12T17:26:25.178 INFO:tasks.workunit.client.0.smithi037.stdout:[INFO] --- resources:3.3.1:resources (default-resources) @ jcksum --- 2024-09-12T17:26:25.181 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.pom 2024-09-12T17:26:25.195 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.pom (2.7 kB at 190 kB/s) 2024-09-12T17:26:25.197 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/5.1/plexus-5.1.pom 2024-09-12T17:26:25.211 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 16/23 kB Progress (1): 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/5.1/plexus-5.1.pom (23 kB at 1.6 MB/s) 2024-09-12T17:26:25.214 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.pom 2024-09-12T17:26:25.228 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 8.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.pom (8.8 kB at 626 kB/s) 2024-09-12T17:26:25.231 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/10/plexus-10.pom 2024-09-12T17:26:25.245 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 16/25 kB Progress (1): 25 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/10/plexus-10.pom (25 kB at 1.8 MB/s) 2024-09-12T17:26:25.248 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.pom 2024-09-12T17:26:25.263 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.pom (6.0 kB at 402 kB/s) 2024-09-12T17:26:25.264 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/39/maven-shared-components-39.pom 2024-09-12T17:26:25.277 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/39/maven-shared-components-39.pom (3.2 kB at 248 kB/s) 2024-09-12T17:26:25.281 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.pom 2024-09-12T17:26:25.296 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 612 B Downloaded from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.pom (612 B at 41 kB/s) 2024-09-12T17:26:25.298 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.pom 2024-09-12T17:26:25.312 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.pom (2.7 kB at 196 kB/s) 2024-09-12T17:26:25.314 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.36/slf4j-parent-1.7.36.pom 2024-09-12T17:26:25.327 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.36/slf4j-parent-1.7.36.pom (14 kB at 1.0 MB/s) 2024-09-12T17:26:25.330 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.pom 2024-09-12T17:26:25.344 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.pom (3.2 kB at 229 kB/s) 2024-09-12T17:26:25.345 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/15/spice-parent-15.pom 2024-09-12T17:26:25.359 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/15/spice-parent-15.pom (8.4 kB at 557 kB/s) 2024-09-12T17:26:25.361 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/5/forge-parent-5.pom 2024-09-12T17:26:25.375 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/5/forge-parent-5.pom (8.4 kB at 597 kB/s) 2024-09-12T17:26:25.377 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.pom 2024-09-12T17:26:25.393 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 8.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.pom (8.0 kB at 501 kB/s) 2024-09-12T17:26:25.396 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.pom 2024-09-12T17:26:25.410 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.pom (20 kB at 1.4 MB/s) 2024-09-12T17:26:25.415 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.2/junit-bom-5.7.2.pom 2024-09-12T17:26:25.429 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.2/junit-bom-5.7.2.pom (5.1 kB at 364 kB/s) 2024-09-12T17:26:25.432 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.pom 2024-09-12T17:26:25.446 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 16/31 kB Progress (1): 31 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.pom (31 kB at 2.2 MB/s) 2024-09-12T17:26:25.452 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.1/junit-bom-5.7.1.pom 2024-09-12T17:26:25.466 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.1/junit-bom-5.7.1.pom (5.1 kB at 364 kB/s) 2024-09-12T17:26:25.470 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.jar 2024-09-12T17:26:25.485 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 16/85 kB Progress (1): 33/85 kB Progress (1): 49/85 kB Progress (1): 66/85 kB Progress (1): 82/85 kB Progress (1): 85 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.jar (85 kB at 5.7 MB/s) 2024-09-12T17:26:25.485 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.jar 2024-09-12T17:26:25.485 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.jar 2024-09-12T17:26:25.486 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.jar 2024-09-12T17:26:25.486 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.jar 2024-09-12T17:26:25.486 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.jar 2024-09-12T17:26:25.502 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 2.5 kB Progress (2): 2.5 kB | 16/55 kB Progress (3): 2.5 kB | 16/55 kB | 16/269 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.jar (2.5 kB at 178 kB/s) 2024-09-12T17:26:25.502 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (3): 16/55 kB | 16/269 kB | 8.5 kB Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.jar 2024-09-12T17:26:25.502 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (3): 16/55 kB | 33/269 kB | 8.5 kB Progress (3): 33/55 kB | 33/269 kB | 8.5 kB Progress (4): 33/55 kB | 33/269 kB | 8.5 kB | 16/41 kB Progress (4): 33/55 kB | 49/269 kB | 8.5 kB | 16/41 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.jar (8.5 kB at 606 kB/s) 2024-09-12T17:26:25.502 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (3): 49/55 kB | 49/269 kB | 16/41 kB Progress (3): 49/55 kB | 49/269 kB | 33/41 kB Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.jar 2024-09-12T17:26:25.502 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (3): 55 kB | 49/269 kB | 33/41 kB Progress (3): 55 kB | 62/269 kB | 33/41 kB Progress (3): 55 kB | 62/269 kB | 41 kB Progress (3): 55 kB | 79/269 kB | 41 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.jar (55 kB at 3.7 MB/s) 2024-09-12T17:26:25.502 INFO:tasks.workunit.client.0.smithi037.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.jar (41 kB at 2.7 MB/s) 2024-09-12T17:26:25.503 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 95/269 kB Progress (1): 111/269 kB Progress (1): 128/269 kB Progress (1): 144/269 kB Progress (1): 161/269 kB Progress (1): 177/269 kB Progress (1): 193/269 kB Progress (1): 210/269 kB Progress (1): 226/269 kB Progress (1): 243/269 kB Progress (1): 259/269 kB Progress (1): 269 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.jar (269 kB at 15 MB/s) 2024-09-12T17:26:25.521 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 16/587 kB Progress (1): 32/587 kB Progress (2): 32/587 kB | 16/327 kB Progress (2): 49/587 kB | 16/327 kB Progress (2): 65/587 kB | 16/327 kB Progress (2): 65/587 kB | 33/327 kB Progress (2): 78/587 kB | 33/327 kB Progress (2): 78/587 kB | 49/327 kB Progress (2): 94/587 kB | 49/327 kB Progress (2): 111/587 kB | 49/327 kB Progress (2): 127/587 kB | 49/327 kB Progress (2): 127/587 kB | 65/327 kB Progress (2): 143/587 kB | 65/327 kB Progress (2): 160/587 kB | 65/327 kB Progress (2): 160/587 kB | 81/327 kB Progress (2): 176/587 kB | 81/327 kB Progress (2): 193/587 kB | 81/327 kB Progress (2): 209/587 kB | 81/327 kB Progress (2): 225/587 kB | 81/327 kB Progress (2): 225/587 kB | 97/327 kB Progress (2): 242/587 kB | 97/327 kB Progress (2): 242/587 kB | 114/327 kB Progress (2): 258/587 kB | 114/327 kB Progress (2): 275/587 kB | 114/327 kB Progress (2): 291/587 kB | 114/327 kB Progress (2): 291/587 kB | 130/327 kB Progress (2): 307/587 kB | 130/327 kB Progress (2): 324/587 kB | 130/327 kB Progress (2): 340/587 kB | 130/327 kB Progress (2): 340/587 kB | 147/327 kB Progress (2): 356/587 kB | 147/327 kB Progress (2): 356/587 kB | 163/327 kB Progress (2): 373/587 kB | 163/327 kB Progress (2): 389/587 kB | 163/327 kB Progress (2): 406/587 kB | 163/327 kB Progress (2): 406/587 kB | 179/327 kB Progress (2): 422/587 kB | 179/327 kB Progress (2): 438/587 kB | 179/327 kB Progress (2): 455/587 kB | 179/327 kB Progress (2): 455/587 kB | 196/327 kB Progress (2): 471/587 kB | 196/327 kB Progress (2): 488/587 kB | 196/327 kB Progress (2): 504/587 kB | 196/327 kB Progress (2): 520/587 kB | 196/327 kB Progress (2): 520/587 kB | 212/327 kB Progress (2): 537/587 kB | 212/327 kB Progress (2): 537/587 kB | 228/327 kB Progress (2): 553/587 kB | 228/327 kB Progress (2): 569/587 kB | 228/327 kB Progress (2): 586/587 kB | 228/327 kB Progress (2): 587 kB | 228/327 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.jar (587 kB at 17 MB/s) 2024-09-12T17:26:25.527 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 245/327 kB Progress (1): 261/327 kB Progress (1): 278/327 kB Progress (1): 294/327 kB Progress (1): 310/327 kB Progress (1): 327/327 kB Progress (1): 327 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.jar (327 kB at 8.0 MB/s) 2024-09-12T17:26:25.558 INFO:tasks.workunit.client.0.smithi037.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/main/resources 2024-09-12T17:26:25.559 INFO:tasks.workunit.client.0.smithi037.stdout:[INFO] 2024-09-12T17:26:25.559 INFO:tasks.workunit.client.0.smithi037.stdout:[INFO] --- compiler:3.11.0:compile (default-compile) @ jcksum --- 2024-09-12T17:26:25.563 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.pom 2024-09-12T17:26:25.576 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 4.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.pom (4.7 kB at 365 kB/s) 2024-09-12T17:26:25.578 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/19/maven-shared-components-19.pom 2024-09-12T17:26:25.591 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/19/maven-shared-components-19.pom (6.4 kB at 454 kB/s) 2024-09-12T17:26:25.593 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/23/maven-parent-23.pom 2024-09-12T17:26:25.609 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 16/33 kB Progress (1): 33 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/23/maven-parent-23.pom (33 kB at 2.0 MB/s) 2024-09-12T17:26:25.611 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/13/apache-13.pom 2024-09-12T17:26:25.624 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/13/apache-13.pom (14 kB at 1.1 MB/s) 2024-09-12T17:26:25.627 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.pom 2024-09-12T17:26:25.641 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 815 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.pom (815 B at 58 kB/s) 2024-09-12T17:26:25.642 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/1.5.5/plexus-containers-1.5.5.pom 2024-09-12T17:26:25.656 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 4.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/1.5.5/plexus-containers-1.5.5.pom (4.2 kB at 326 kB/s) 2024-09-12T17:26:25.658 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/2.0.7/plexus-2.0.7.pom 2024-09-12T17:26:25.672 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/2.0.7/plexus-2.0.7.pom (17 kB at 1.2 MB/s) 2024-09-12T17:26:25.675 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.pom 2024-09-12T17:26:25.689 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 5.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.pom (5.0 kB at 355 kB/s) 2024-09-12T17:26:25.691 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.1.2/plexus-languages-1.1.2.pom 2024-09-12T17:26:25.705 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.1.2/plexus-languages-1.1.2.pom (4.1 kB at 296 kB/s) 2024-09-12T17:26:25.707 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.pom 2024-09-12T17:26:25.722 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.pom (2.4 kB at 158 kB/s) 2024-09-12T17:26:25.724 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/ow2/1.5.1/ow2-1.5.1.pom 2024-09-12T17:26:25.738 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/ow2/1.5.1/ow2-1.5.1.pom (11 kB at 806 kB/s) 2024-09-12T17:26:25.741 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.pom 2024-09-12T17:26:25.756 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.pom (17 kB at 1.1 MB/s) 2024-09-12T17:26:25.759 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/9/oss-parent-9.pom 2024-09-12T17:26:25.773 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 6.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/9/oss-parent-9.pom (6.6 kB at 438 kB/s) 2024-09-12T17:26:25.777 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.pom 2024-09-12T17:26:25.791 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 1.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.pom (1.1 kB at 70 kB/s) 2024-09-12T17:26:25.793 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler/2.13.0/plexus-compiler-2.13.0.pom 2024-09-12T17:26:25.808 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler/2.13.0/plexus-compiler-2.13.0.pom (8.4 kB at 559 kB/s) 2024-09-12T17:26:25.810 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/10.0/plexus-components-10.0.pom 2024-09-12T17:26:25.825 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/10.0/plexus-components-10.0.pom (2.7 kB at 179 kB/s) 2024-09-12T17:26:25.828 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.1/junit-bom-5.9.1.pom 2024-09-12T17:26:25.841 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.1/junit-bom-5.9.1.pom (5.6 kB at 433 kB/s) 2024-09-12T17:26:25.844 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.pom 2024-09-12T17:26:25.859 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 1.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.pom (1.1 kB at 76 kB/s) 2024-09-12T17:26:25.862 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.1/plexus-component-annotations-2.1.1.pom 2024-09-12T17:26:25.877 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 770 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.1/plexus-component-annotations-2.1.1.pom (770 B at 51 kB/s) 2024-09-12T17:26:25.878 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.1/plexus-containers-2.1.1.pom 2024-09-12T17:26:25.892 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.1/plexus-containers-2.1.1.pom (6.0 kB at 431 kB/s) 2024-09-12T17:26:25.894 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/6.5/plexus-6.5.pom 2024-09-12T17:26:25.908 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 16/26 kB Progress (1): 26 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/6.5/plexus-6.5.pom (26 kB at 1.8 MB/s) 2024-09-12T17:26:25.912 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.pom 2024-09-12T17:26:25.926 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 1.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.pom (1.2 kB at 86 kB/s) 2024-09-12T17:26:25.927 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compilers/2.13.0/plexus-compilers-2.13.0.pom 2024-09-12T17:26:25.941 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 1.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compilers/2.13.0/plexus-compilers-2.13.0.pom (1.3 kB at 94 kB/s) 2024-09-12T17:26:25.947 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.jar 2024-09-12T17:26:25.962 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.jar (14 kB at 967 kB/s) 2024-09-12T17:26:25.962 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.jar 2024-09-12T17:26:25.962 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.jar 2024-09-12T17:26:25.962 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.jar 2024-09-12T17:26:25.962 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.jar 2024-09-12T17:26:25.962 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.jar 2024-09-12T17:26:25.979 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 16/55 kB Progress (2): 16/55 kB | 4.2 kB Progress (3): 16/55 kB | 4.2 kB | 16/27 kB Progress (4): 16/55 kB | 4.2 kB | 16/27 kB | 16/122 kB Progress (4): 16/55 kB | 4.2 kB | 27 kB | 16/122 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.jar (4.2 kB at 301 kB/s) 2024-09-12T17:26:25.979 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.jar 2024-09-12T17:26:25.979 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (3): 16/55 kB | 27 kB | 32/122 kB Progress (3): 33/55 kB | 27 kB | 32/122 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.jar (27 kB at 2.1 MB/s) 2024-09-12T17:26:25.980 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.jar 2024-09-12T17:26:25.980 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (2): 33/55 kB | 49/122 kB Progress (2): 49/55 kB | 49/122 kB Progress (2): 49/55 kB | 65/122 kB Progress (2): 49/55 kB | 81/122 kB Progress (2): 55 kB | 81/122 kB Progress (2): 55 kB | 98/122 kB Progress (2): 55 kB | 114/122 kB Progress (2): 55 kB | 122 kB Progress (3): 55 kB | 122 kB | 16/334 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.jar (55 kB at 3.4 MB/s) 2024-09-12T17:26:25.980 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.jar 2024-09-12T17:26:25.980 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (2): 122 kB | 33/334 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.jar (122 kB at 7.7 MB/s) 2024-09-12T17:26:25.982 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 49/334 kB Progress (1): 66/334 kB Progress (1): 82/334 kB Progress (1): 98/334 kB Progress (1): 115/334 kB Progress (1): 131/334 kB Progress (1): 147/334 kB Progress (1): 164/334 kB Progress (1): 180/334 kB Progress (1): 197/334 kB Progress (1): 213/334 kB Progress (1): 229/334 kB Progress (1): 246/334 kB Progress (1): 262/334 kB Progress (1): 279/334 kB Progress (1): 295/334 kB Progress (1): 311/334 kB Progress (1): 328/334 kB Progress (1): 334 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.jar (334 kB at 17 MB/s) 2024-09-12T17:26:25.989 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 16/267 kB Progress (1): 33/267 kB Progress (2): 33/267 kB | 4.7 kB Progress (2): 49/267 kB | 4.7 kB Progress (2): 63/267 kB | 4.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.jar (4.7 kB at 172 kB/s) 2024-09-12T17:26:25.992 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 80/267 kB Progress (1): 96/267 kB Progress (1): 112/267 kB Progress (1): 129/267 kB Progress (1): 145/267 kB Progress (1): 162/267 kB Progress (1): 178/267 kB Progress (1): 194/267 kB Progress (1): 211/267 kB Progress (1): 227/267 kB Progress (1): 244/267 kB Progress (1): 260/267 kB Progress (1): 267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.jar (267 kB at 8.9 MB/s) 2024-09-12T17:26:25.992 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 2.7/23 kB Progress (1): 12/23 kB Progress (1): 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.jar (23 kB at 735 kB/s) 2024-09-12T17:26:26.055 INFO:tasks.workunit.client.0.smithi037.stdout:[INFO] Changes detected - recompiling the module! :source 2024-09-12T17:26:26.056 INFO:tasks.workunit.client.0.smithi037.stdout:[INFO] Compiling 1 source file with javac [debug target 1.9] to target/classes 2024-09-12T17:26:26.792 INFO:tasks.workunit.client.0.smithi037.stdout:[WARNING] bootstrap class path not set in conjunction with -source 9 2024-09-12T17:26:26.793 INFO:tasks.workunit.client.0.smithi037.stdout:[INFO] 2024-09-12T17:26:26.793 INFO:tasks.workunit.client.0.smithi037.stdout:[INFO] --- resources:3.3.1:testResources (default-testResources) @ jcksum --- 2024-09-12T17:26:26.796 INFO:tasks.workunit.client.0.smithi037.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/test/resources 2024-09-12T17:26:26.797 INFO:tasks.workunit.client.0.smithi037.stdout:[INFO] 2024-09-12T17:26:26.797 INFO:tasks.workunit.client.0.smithi037.stdout:[INFO] --- compiler:3.11.0:testCompile (default-testCompile) @ jcksum --- 2024-09-12T17:26:26.803 INFO:tasks.workunit.client.0.smithi037.stdout:[INFO] Changes detected - recompiling the module! :dependency 2024-09-12T17:26:26.804 INFO:tasks.workunit.client.0.smithi037.stdout:[INFO] Compiling 1 source file with javac [debug target 1.9] to target/test-classes 2024-09-12T17:26:27.038 INFO:tasks.workunit.client.0.smithi037.stdout:[WARNING] bootstrap class path not set in conjunction with -source 9 2024-09-12T17:26:27.038 INFO:tasks.workunit.client.0.smithi037.stdout:[INFO] 2024-09-12T17:26:27.038 INFO:tasks.workunit.client.0.smithi037.stdout:[INFO] --- surefire:3.2.3:test (default-test) @ jcksum --- 2024-09-12T17:26:27.043 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.pom 2024-09-12T17:26:27.058 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 6.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.pom (6.2 kB at 416 kB/s) 2024-09-12T17:26:27.063 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.pom 2024-09-12T17:26:27.078 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.pom (3.5 kB at 235 kB/s) 2024-09-12T17:26:27.082 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.pom 2024-09-12T17:26:27.098 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 3.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.pom (3.3 kB at 204 kB/s) 2024-09-12T17:26:27.102 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.pom 2024-09-12T17:26:27.117 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.pom (4.1 kB at 271 kB/s) 2024-09-12T17:26:27.122 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.pom 2024-09-12T17:26:27.137 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 3.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.pom (3.3 kB at 220 kB/s) 2024-09-12T17:26:27.141 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.pom 2024-09-12T17:26:27.155 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 4.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.pom (4.5 kB at 318 kB/s) 2024-09-12T17:26:27.159 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.pom 2024-09-12T17:26:27.173 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 1.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.pom (1.8 kB at 126 kB/s) 2024-09-12T17:26:27.176 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.pom 2024-09-12T17:26:27.190 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.pom (2.2 kB at 157 kB/s) 2024-09-12T17:26:27.191 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether/1.0.0.v20140518/aether-1.0.0.v20140518.pom 2024-09-12T17:26:27.205 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 16/30 kB Progress (1): 30 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether/1.0.0.v20140518/aether-1.0.0.v20140518.pom (30 kB at 2.2 MB/s) 2024-09-12T17:26:27.208 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.pom 2024-09-12T17:26:27.222 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 1.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.pom (1.9 kB at 135 kB/s) 2024-09-12T17:26:27.225 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.pom 2024-09-12T17:26:27.239 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 5.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.pom (5.8 kB at 414 kB/s) 2024-09-12T17:26:27.243 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-artifact/3.2.5/maven-artifact-3.2.5.pom 2024-09-12T17:26:27.257 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 2.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-artifact/3.2.5/maven-artifact-3.2.5.pom (2.3 kB at 168 kB/s) 2024-09-12T17:26:27.258 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven/3.2.5/maven-3.2.5.pom 2024-09-12T17:26:27.273 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 16/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven/3.2.5/maven-3.2.5.pom (22 kB at 1.4 MB/s) 2024-09-12T17:26:27.275 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/25/maven-parent-25.pom 2024-09-12T17:26:27.290 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 16/37 kB Progress (1): 32/37 kB Progress (1): 37 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/25/maven-parent-25.pom (37 kB at 2.5 MB/s) 2024-09-12T17:26:27.292 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/15/apache-15.pom 2024-09-12T17:26:27.305 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/15/apache-15.pom (15 kB at 1.2 MB/s) 2024-09-12T17:26:27.308 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/4.0.0/plexus-utils-4.0.0.pom 2024-09-12T17:26:27.322 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 8.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/4.0.0/plexus-utils-4.0.0.pom (8.7 kB at 618 kB/s) 2024-09-12T17:26:27.323 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/13/plexus-13.pom 2024-09-12T17:26:27.337 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 16/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/13/plexus-13.pom (27 kB at 2.0 MB/s) 2024-09-12T17:26:27.340 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-core/3.2.5/maven-core-3.2.5.pom 2024-09-12T17:26:27.353 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 8.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-core/3.2.5/maven-core-3.2.5.pom (8.1 kB at 576 kB/s) 2024-09-12T17:26:27.357 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings/3.2.5/maven-settings-3.2.5.pom 2024-09-12T17:26:27.371 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings/3.2.5/maven-settings-3.2.5.pom (2.2 kB at 155 kB/s) 2024-09-12T17:26:27.374 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings-builder/3.2.5/maven-settings-builder-3.2.5.pom 2024-09-12T17:26:27.388 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 2.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings-builder/3.2.5/maven-settings-builder-3.2.5.pom (2.6 kB at 185 kB/s) 2024-09-12T17:26:27.390 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.21/plexus-interpolation-1.21.pom 2024-09-12T17:26:27.405 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 1.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.21/plexus-interpolation-1.21.pom (1.5 kB at 110 kB/s) 2024-09-12T17:26:27.406 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/1.3.1/plexus-components-1.3.1.pom 2024-09-12T17:26:27.420 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 3.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/1.3.1/plexus-components-1.3.1.pom (3.1 kB at 219 kB/s) 2024-09-12T17:26:27.421 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/3.3.1/plexus-3.3.1.pom 2024-09-12T17:26:27.436 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/3.3.1/plexus-3.3.1.pom (20 kB at 1.4 MB/s) 2024-09-12T17:26:27.438 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/17/spice-parent-17.pom 2024-09-12T17:26:27.452 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/17/spice-parent-17.pom (6.8 kB at 483 kB/s) 2024-09-12T17:26:27.454 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/10/forge-parent-10.pom 2024-09-12T17:26:27.468 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/10/forge-parent-10.pom (14 kB at 969 kB/s) 2024-09-12T17:26:27.470 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-sec-dispatcher/1.3/plexus-sec-dispatcher-1.3.pom 2024-09-12T17:26:27.484 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-sec-dispatcher/1.3/plexus-sec-dispatcher-1.3.pom (3.0 kB at 212 kB/s) 2024-09-12T17:26:27.486 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/12/spice-parent-12.pom 2024-09-12T17:26:27.499 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/12/spice-parent-12.pom (6.8 kB at 523 kB/s) 2024-09-12T17:26:27.501 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/4/forge-parent-4.pom 2024-09-12T17:26:27.514 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/4/forge-parent-4.pom (8.4 kB at 646 kB/s) 2024-09-12T17:26:27.516 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-cipher/1.4/plexus-cipher-1.4.pom 2024-09-12T17:26:27.529 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 2.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-cipher/1.4/plexus-cipher-1.4.pom (2.1 kB at 159 kB/s) 2024-09-12T17:26:27.531 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-repository-metadata/3.2.5/maven-repository-metadata-3.2.5.pom 2024-09-12T17:26:27.544 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-repository-metadata/3.2.5/maven-repository-metadata-3.2.5.pom (2.2 kB at 171 kB/s) 2024-09-12T17:26:27.548 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-plugin-api/3.2.5/maven-plugin-api-3.2.5.pom 2024-09-12T17:26:27.562 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-plugin-api/3.2.5/maven-plugin-api-3.2.5.pom (3.0 kB at 216 kB/s) 2024-09-12T17:26:27.565 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.plexus/0.9.0.M2/org.eclipse.sisu.plexus-0.9.0.M2.pom 2024-09-12T17:26:27.578 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.plexus/0.9.0.M2/org.eclipse.sisu.plexus-0.9.0.M2.pom (15 kB at 1.1 MB/s) 2024-09-12T17:26:27.580 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-plexus/0.9.0.M2/sisu-plexus-0.9.0.M2.pom 2024-09-12T17:26:27.595 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-plexus/0.9.0.M2/sisu-plexus-0.9.0.M2.pom (15 kB at 967 kB/s) 2024-09-12T17:26:27.597 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/annotation/javax.annotation-api/1.2/javax.annotation-api-1.2.pom 2024-09-12T17:26:27.612 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/annotation/javax.annotation-api/1.2/javax.annotation-api-1.2.pom (13 kB at 895 kB/s) 2024-09-12T17:26:27.613 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/net/java/jvnet-parent/3/jvnet-parent-3.pom 2024-09-12T17:26:27.628 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/net/java/jvnet-parent/3/jvnet-parent-3.pom (4.8 kB at 342 kB/s) 2024-09-12T17:26:27.630 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/enterprise/cdi-api/1.2/cdi-api-1.2.pom 2024-09-12T17:26:27.644 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 6.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/enterprise/cdi-api/1.2/cdi-api-1.2.pom (6.3 kB at 448 kB/s) 2024-09-12T17:26:27.646 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/jboss/weld/weld-parent/26/weld-parent-26.pom 2024-09-12T17:26:27.660 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 16/32 kB Progress (1): 32 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/jboss/weld/weld-parent/26/weld-parent-26.pom (32 kB at 2.3 MB/s) 2024-09-12T17:26:27.663 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.inject/0.9.0.M2/org.eclipse.sisu.inject-0.9.0.M2.pom 2024-09-12T17:26:27.677 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.inject/0.9.0.M2/org.eclipse.sisu.inject-0.9.0.M2.pom (17 kB at 1.2 MB/s) 2024-09-12T17:26:27.679 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-inject/0.9.0.M2/sisu-inject-0.9.0.M2.pom 2024-09-12T17:26:27.694 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-inject/0.9.0.M2/sisu-inject-0.9.0.M2.pom (15 kB at 925 kB/s) 2024-09-12T17:26:27.696 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.0/plexus-component-annotations-2.1.0.pom 2024-09-12T17:26:27.710 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 750 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.0/plexus-component-annotations-2.1.0.pom (750 B at 54 kB/s) 2024-09-12T17:26:27.711 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.0/plexus-containers-2.1.0.pom 2024-09-12T17:26:27.724 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.0/plexus-containers-2.1.0.pom (4.8 kB at 370 kB/s) 2024-09-12T17:26:27.727 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.6.0/plexus-classworlds-2.6.0.pom 2024-09-12T17:26:27.740 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 7.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.6.0/plexus-classworlds-2.6.0.pom (7.9 kB at 609 kB/s) 2024-09-12T17:26:27.743 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-model-builder/3.2.5/maven-model-builder-3.2.5.pom 2024-09-12T17:26:27.756 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-model-builder/3.2.5/maven-model-builder-3.2.5.pom (3.0 kB at 230 kB/s) 2024-09-12T17:26:27.759 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-aether-provider/3.2.5/maven-aether-provider-3.2.5.pom 2024-09-12T17:26:27.773 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 4.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-aether-provider/3.2.5/maven-aether-provider-3.2.5.pom (4.2 kB at 304 kB/s) 2024-09-12T17:26:27.776 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-spi/1.0.0.v20140518/aether-spi-1.0.0.v20140518.pom 2024-09-12T17:26:27.789 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 2.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-spi/1.0.0.v20140518/aether-spi-1.0.0.v20140518.pom (2.1 kB at 158 kB/s) 2024-09-12T17:26:27.792 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-impl/1.0.0.v20140518/aether-impl-1.0.0.v20140518.pom 2024-09-12T17:26:27.805 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-impl/1.0.0.v20140518/aether-impl-1.0.0.v20140518.pom (3.5 kB at 267 kB/s) 2024-09-12T17:26:27.808 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/sisu-guice/3.2.3/sisu-guice-3.2.3.pom 2024-09-12T17:26:27.822 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/sisu-guice/3.2.3/sisu-guice-3.2.3.pom (11 kB at 781 kB/s) 2024-09-12T17:26:27.824 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/inject/guice-parent/3.2.3/guice-parent-3.2.3.pom 2024-09-12T17:26:27.837 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/inject/guice-parent/3.2.3/guice-parent-3.2.3.pom (13 kB at 1.0 MB/s) 2024-09-12T17:26:27.839 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/38/forge-parent-38.pom 2024-09-12T17:26:27.853 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 16/19 kB Progress (1): 19 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/38/forge-parent-38.pom (19 kB at 1.3 MB/s) 2024-09-12T17:26:27.855 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/aopalliance/aopalliance/1.0/aopalliance-1.0.pom 2024-09-12T17:26:27.869 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 363 B Downloaded from central: https://repo.maven.apache.org/maven2/aopalliance/aopalliance/1.0/aopalliance-1.0.pom (363 B at 26 kB/s) 2024-09-12T17:26:27.870 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/google/guava/guava/16.0.1/guava-16.0.1.pom 2024-09-12T17:26:27.884 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/google/guava/guava/16.0.1/guava-16.0.1.pom (6.1 kB at 436 kB/s) 2024-09-12T17:26:27.886 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/google/guava/guava-parent/16.0.1/guava-parent-16.0.1.pom 2024-09-12T17:26:27.899 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 7.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/google/guava/guava-parent/16.0.1/guava-parent-16.0.1.pom (7.3 kB at 564 kB/s) 2024-09-12T17:26:27.901 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/7/oss-parent-7.pom 2024-09-12T17:26:27.915 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/7/oss-parent-7.pom (4.8 kB at 345 kB/s) 2024-09-12T17:26:27.917 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.5.2/plexus-classworlds-2.5.2.pom 2024-09-12T17:26:27.931 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 7.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.5.2/plexus-classworlds-2.5.2.pom (7.3 kB at 522 kB/s) 2024-09-12T17:26:27.934 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.pom 2024-09-12T17:26:27.948 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 16/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.pom (22 kB at 1.5 MB/s) 2024-09-12T17:26:27.949 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/64/commons-parent-64.pom 2024-09-12T17:26:27.964 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 16/78 kB Progress (1): 33/78 kB Progress (1): 49/78 kB Progress (1): 66/78 kB Progress (1): 78 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/64/commons-parent-64.pom (78 kB at 5.6 MB/s) 2024-09-12T17:26:27.967 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/30/apache-30.pom 2024-09-12T17:26:27.981 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 16/23 kB Progress (1): 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/30/apache-30.pom (23 kB at 1.8 MB/s) 2024-09-12T17:26:27.983 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.0/junit-bom-5.10.0.pom 2024-09-12T17:26:27.997 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.0/junit-bom-5.10.0.pom (5.6 kB at 404 kB/s) 2024-09-12T17:26:27.999 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.pom 2024-09-12T17:26:28.013 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 4.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.pom (4.3 kB at 305 kB/s) 2024-09-12T17:26:28.015 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.2.0/plexus-languages-1.2.0.pom 2024-09-12T17:26:28.028 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.2.0/plexus-languages-1.2.0.pom (3.2 kB at 246 kB/s) 2024-09-12T17:26:28.029 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/15/plexus-15.pom 2024-09-12T17:26:28.042 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 16/28 kB Progress (1): 28 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/15/plexus-15.pom (28 kB at 2.0 MB/s) 2024-09-12T17:26:28.045 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.pom 2024-09-12T17:26:28.058 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.pom (2.4 kB at 182 kB/s) 2024-09-12T17:26:28.063 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.jar 2024-09-12T17:26:28.081 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 15/308 kB Progress (1): 31/308 kB Progress (1): 48/308 kB Progress (1): 64/308 kB Progress (1): 81/308 kB Progress (1): 94/308 kB Progress (1): 110/308 kB Progress (1): 127/308 kB Progress (1): 143/308 kB Progress (1): 159/308 kB Progress (1): 176/308 kB Progress (1): 192/308 kB Progress (1): 208/308 kB Progress (1): 225/308 kB Progress (1): 241/308 kB Progress (1): 258/308 kB Progress (1): 274/308 kB Progress (1): 290/308 kB Progress (1): 307/308 kB Progress (1): 308 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.jar (308 kB at 17 MB/s) 2024-09-12T17:26:28.082 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.jar 2024-09-12T17:26:28.082 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.jar 2024-09-12T17:26:28.082 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.jar 2024-09-12T17:26:28.082 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.jar 2024-09-12T17:26:28.082 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.jar 2024-09-12T17:26:28.096 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.jar (14 kB at 906 kB/s) 2024-09-12T17:26:28.096 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.jar 2024-09-12T17:26:28.099 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 8.2 kB Progress (2): 8.2 kB | 16/26 kB Progress (3): 8.2 kB | 16/26 kB | 16/118 kB Progress (3): 8.2 kB | 26 kB | 16/118 kB Progress (4): 8.2 kB | 26 kB | 16/118 kB | 16/171 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.jar (26 kB at 1.5 MB/s) 2024-09-12T17:26:28.099 INFO:tasks.workunit.client.0.smithi037.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.jar (8.2 kB at 511 kB/s) 2024-09-12T17:26:28.099 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (2): 32/118 kB | 16/171 kB Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.jar 2024-09-12T17:26:28.099 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.jar 2024-09-12T17:26:28.101 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (2): 32/118 kB | 33/171 kB Progress (2): 49/118 kB | 33/171 kB Progress (2): 49/118 kB | 49/171 kB Progress (2): 65/118 kB | 49/171 kB Progress (2): 65/118 kB | 66/171 kB Progress (2): 81/118 kB | 66/171 kB Progress (2): 81/118 kB | 82/171 kB Progress (2): 98/118 kB | 82/171 kB Progress (2): 98/118 kB | 98/171 kB Progress (2): 114/118 kB | 98/171 kB Progress (2): 118 kB | 98/171 kB Progress (2): 118 kB | 113/171 kB Progress (2): 118 kB | 130/171 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.jar (118 kB at 6.2 MB/s) 2024-09-12T17:26:28.101 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.jar 2024-09-12T17:26:28.102 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 146/171 kB Progress (1): 163/171 kB Progress (1): 171 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.jar (171 kB at 8.1 MB/s) 2024-09-12T17:26:28.102 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.jar 2024-09-12T17:26:28.113 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 16/146 kB Progress (1): 32/146 kB Progress (1): 49/146 kB Progress (1): 65/146 kB Progress (1): 81/146 kB Progress (1): 98/146 kB Progress (1): 114/146 kB Progress (1): 130/146 kB Progress (1): 146 kB Progress (2): 146 kB | 16/136 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.jar (146 kB at 4.7 MB/s) 2024-09-12T17:26:28.113 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.jar 2024-09-12T17:26:28.115 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (2): 16/136 kB | 16/61 kB Progress (2): 33/136 kB | 16/61 kB Progress (2): 33/136 kB | 33/61 kB Progress (2): 49/136 kB | 33/61 kB Progress (2): 66/136 kB | 33/61 kB Progress (2): 66/136 kB | 49/61 kB Progress (2): 82/136 kB | 49/61 kB Progress (2): 98/136 kB | 49/61 kB Progress (2): 115/136 kB | 49/61 kB Progress (3): 115/136 kB | 49/61 kB | 16/501 kB Progress (3): 131/136 kB | 49/61 kB | 16/501 kB Progress (3): 136 kB | 49/61 kB | 16/501 kB Progress (3): 136 kB | 61 kB | 16/501 kB Progress (3): 136 kB | 61 kB | 33/501 kB Progress (3): 136 kB | 61 kB | 49/501 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.jar (136 kB at 4.1 MB/s) 2024-09-12T17:26:28.116 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.jar 2024-09-12T17:26:28.116 INFO:tasks.workunit.client.0.smithi037.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.jar (61 kB at 1.8 MB/s) 2024-09-12T17:26:28.120 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 66/501 kB Progress (1): 82/501 kB Progress (1): 97/501 kB Progress (1): 114/501 kB Progress (1): 130/501 kB Progress (1): 147/501 kB Progress (1): 163/501 kB Progress (1): 179/501 kB Progress (1): 196/501 kB Progress (1): 212/501 kB Progress (1): 229/501 kB Progress (1): 245/501 kB Progress (1): 261/501 kB Progress (2): 261/501 kB | 16/58 kB Progress (2): 278/501 kB | 16/58 kB Progress (2): 278/501 kB | 33/58 kB Progress (2): 294/501 kB | 33/58 kB Progress (2): 294/501 kB | 49/58 kB Progress (2): 294/501 kB | 58 kB Progress (2): 310/501 kB | 58 kB Progress (2): 327/501 kB | 58 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.jar (58 kB at 1.5 MB/s) 2024-09-12T17:26:28.123 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 343/501 kB Progress (1): 360/501 kB Progress (1): 376/501 kB Progress (1): 392/501 kB Progress (1): 409/501 kB Progress (1): 425/501 kB Progress (1): 442/501 kB Progress (1): 458/501 kB Progress (1): 474/501 kB Progress (1): 491/501 kB Progress (1): 501 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.jar (501 kB at 12 MB/s) 2024-09-12T17:26:28.128 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 16/124 kB Progress (1): 33/124 kB Progress (1): 49/124 kB Progress (1): 66/124 kB Progress (1): 82/124 kB Progress (1): 98/124 kB Progress (1): 115/124 kB Progress (1): 124 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.jar (124 kB at 2.7 MB/s) 2024-09-12T17:26:28.251 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 0/2.4 MB Progress (1): 0/2.4 MB Progress (1): 0/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.jar (2.4 MB at 14 MB/s) 2024-09-12T17:26:28.322 INFO:tasks.workunit.client.0.smithi037.stdout:[INFO] 2024-09-12T17:26:28.322 INFO:tasks.workunit.client.0.smithi037.stdout:[INFO] --- jar:3.3.0:jar (default-jar) @ jcksum --- 2024-09-12T17:26:28.325 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.pom 2024-09-12T17:26:28.339 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 4.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.pom (4.5 kB at 320 kB/s) 2024-09-12T17:26:28.341 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/36/maven-shared-components-36.pom 2024-09-12T17:26:28.356 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 4.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/36/maven-shared-components-36.pom (4.9 kB at 326 kB/s) 2024-09-12T17:26:28.357 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/36/maven-parent-36.pom 2024-09-12T17:26:28.373 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 16/45 kB Progress (1): 33/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/36/maven-parent-36.pom (45 kB at 2.8 MB/s) 2024-09-12T17:26:28.374 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/26/apache-26.pom 2024-09-12T17:26:28.388 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/26/apache-26.pom (21 kB at 1.5 MB/s) 2024-09-12T17:26:28.391 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.3.0/plexus-utils-3.3.0.pom 2024-09-12T17:26:28.406 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 5.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.3.0/plexus-utils-3.3.0.pom (5.2 kB at 370 kB/s) 2024-09-12T17:26:28.408 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.pom 2024-09-12T17:26:28.422 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 3.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.pom (3.9 kB at 280 kB/s) 2024-09-12T17:26:28.424 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.pom 2024-09-12T17:26:28.439 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.pom (6.0 kB at 401 kB/s) 2024-09-12T17:26:28.441 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.pom 2024-09-12T17:26:28.455 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 6.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.pom (6.3 kB at 447 kB/s) 2024-09-12T17:26:28.457 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.pom 2024-09-12T17:26:28.471 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.pom (20 kB at 1.4 MB/s) 2024-09-12T17:26:28.475 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.pom 2024-09-12T17:26:28.488 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.pom (15 kB at 1.0 MB/s) 2024-09-12T17:26:28.490 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.pom 2024-09-12T17:26:28.504 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 2.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.pom (2.0 kB at 146 kB/s) 2024-09-12T17:26:28.506 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.pom 2024-09-12T17:26:28.520 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 8.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.pom (8.2 kB at 587 kB/s) 2024-09-12T17:26:28.522 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/8/plexus-8.pom 2024-09-12T17:26:28.536 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 16/25 kB Progress (1): 25 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/8/plexus-8.pom (25 kB at 1.8 MB/s) 2024-09-12T17:26:28.543 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.jar 2024-09-12T17:26:28.558 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 16/36 kB Progress (1): 33/36 kB Progress (1): 36 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.jar (36 kB at 2.4 MB/s) 2024-09-12T17:26:28.559 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.jar 2024-09-12T17:26:28.559 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.jar 2024-09-12T17:26:28.559 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.jar 2024-09-12T17:26:28.559 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.jar 2024-09-12T17:26:28.559 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.jar 2024-09-12T17:26:28.575 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 16/79 kB Progress (2): 16/79 kB | 16/211 kB Progress (2): 32/79 kB | 16/211 kB Progress (3): 32/79 kB | 16/211 kB | 16/58 kB Progress (3): 32/79 kB | 33/211 kB | 16/58 kB Progress (3): 49/79 kB | 33/211 kB | 16/58 kB Progress (3): 49/79 kB | 33/211 kB | 33/58 kB Progress (3): 65/79 kB | 33/211 kB | 33/58 kB Progress (3): 65/79 kB | 49/211 kB | 33/58 kB Progress (3): 65/79 kB | 49/211 kB | 49/58 kB Progress (3): 79 kB | 49/211 kB | 49/58 kB Progress (3): 79 kB | 66/211 kB | 49/58 kB Progress (4): 79 kB | 66/211 kB | 49/58 kB | 15/26 kB Progress (4): 79 kB | 66/211 kB | 58 kB | 15/26 kB Progress (4): 79 kB | 79/211 kB | 58 kB | 15/26 kB Progress (4): 79 kB | 79/211 kB | 58 kB | 26 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.jar (79 kB at 5.0 MB/s) 2024-09-12T17:26:28.575 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (3): 95/211 kB | 58 kB | 26 kB Downloading from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.jar 2024-09-12T17:26:28.575 INFO:tasks.workunit.client.0.smithi037.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.jar (58 kB at 3.6 MB/s) 2024-09-12T17:26:28.575 INFO:tasks.workunit.client.0.smithi037.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.jar (26 kB at 1.6 MB/s) 2024-09-12T17:26:28.575 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.jar 2024-09-12T17:26:28.577 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 112/211 kB Progress (1): 128/211 kB Progress (2): 128/211 kB | 0/1.0 MB Progress (2): 145/211 kB | 0/1.0 MB Progress (2): 145/211 kB | 0/1.0 MB Progress (2): 161/211 kB | 0/1.0 MB Progress (2): 161/211 kB | 0/1.0 MB Progress (2): 177/211 kB | 0/1.0 MB Progress (2): 177/211 kB | 0.1/1.0 MB Progress (2): 194/211 kB | 0.1/1.0 MB Progress (2): 194/211 kB | 0.1/1.0 MB Progress (2): 210/211 kB | 0.1/1.0 MB Progress (2): 211 kB | 0.1/1.0 MB Progress (2): 211 kB | 0.1/1.0 MB Progress (2): 211 kB | 0.1/1.0 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.jar (211 kB at 12 MB/s) 2024-09-12T17:26:28.591 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 0.1/1.0 MB Progress (1): 0.1/1.0 MB Progress (1): 0.2/1.0 MB Progress (1): 0.2/1.0 MB Progress (1): 0.2/1.0 MB Progress (1): 0.2/1.0 MB Progress (1): 0.2/1.0 MB Progress (1): 0.2/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.9/1.0 MB Progress (2): 0.9/1.0 MB | 16/116 kB Progress (3): 0.9/1.0 MB | 16/116 kB | 16/267 kB Progress (3): 0.9/1.0 MB | 16/116 kB | 16/267 kB Progress (3): 0.9/1.0 MB | 32/116 kB | 16/267 kB Progress (3): 0.9/1.0 MB | 32/116 kB | 16/267 kB Progress (3): 0.9/1.0 MB | 49/116 kB | 16/267 kB Progress (3): 0.9/1.0 MB | 49/116 kB | 33/267 kB Progress (3): 0.9/1.0 MB | 49/116 kB | 33/267 kB Progress (3): 0.9/1.0 MB | 49/116 kB | 37/267 kB Progress (3): 0.9/1.0 MB | 65/116 kB | 37/267 kB Progress (3): 0.9/1.0 MB | 65/116 kB | 37/267 kB Progress (3): 0.9/1.0 MB | 65/116 kB | 53/267 kB Progress (3): 0.9/1.0 MB | 81/116 kB | 53/267 kB Progress (3): 0.9/1.0 MB | 81/116 kB | 53/267 kB Progress (3): 0.9/1.0 MB | 98/116 kB | 53/267 kB Progress (3): 1.0/1.0 MB | 98/116 kB | 53/267 kB Progress (3): 1.0/1.0 MB | 114/116 kB | 53/267 kB Progress (3): 1.0/1.0 MB | 116 kB | 53/267 kB Progress (3): 1.0/1.0 MB | 116 kB | 69/267 kB Progress (3): 1.0/1.0 MB | 116 kB | 69/267 kB Progress (3): 1.0/1.0 MB | 116 kB | 86/267 kB Progress (3): 1.0/1.0 MB | 116 kB | 86/267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.jar (116 kB at 3.6 MB/s) 2024-09-12T17:26:28.591 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (2): 1.0/1.0 MB | 86/267 kB Progress (2): 1.0 MB | 86/267 kB Progress (2): 1.0 MB | 102/267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.jar (1.0 MB at 30 MB/s) 2024-09-12T17:26:28.601 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 118/267 kB Progress (1): 135/267 kB Progress (1): 151/267 kB Progress (1): 168/267 kB Progress (1): 184/267 kB Progress (1): 200/267 kB Progress (1): 217/267 kB Progress (1): 233/267 kB Progress (1): 250/267 kB Progress (1): 266/267 kB Progress (1): 267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.jar (267 kB at 6.4 MB/s) 2024-09-12T17:26:28.725 INFO:tasks.workunit.client.0.smithi037.stdout:[INFO] Building jar: /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/target/jcksum-1.0.jar 2024-09-12T17:26:28.773 INFO:tasks.workunit.client.0.smithi037.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-12T17:26:28.774 INFO:tasks.workunit.client.0.smithi037.stdout:[INFO] BUILD SUCCESS 2024-09-12T17:26:28.774 INFO:tasks.workunit.client.0.smithi037.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-12T17:26:28.774 INFO:tasks.workunit.client.0.smithi037.stdout:[INFO] Total time: 6.072 s 2024-09-12T17:26:28.774 INFO:tasks.workunit.client.0.smithi037.stdout:[INFO] Finished at: 2024-09-12T17:26:28Z 2024-09-12T17:26:28.774 INFO:tasks.workunit.client.0.smithi037.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-12T17:26:28.808 INFO:tasks.workunit.client.0.smithi037.stderr:+ ./mvnw test -Dtest=PutObjects 2024-09-12T17:26:28.817 INFO:tasks.workunit.client.0.smithi037.stdout:Warning: JAVA_HOME environment variable is not set. 2024-09-12T17:26:29.926 INFO:tasks.workunit.client.0.smithi037.stdout:[INFO] Scanning for projects... 2024-09-12T17:26:30.029 INFO:tasks.workunit.client.0.smithi037.stdout:[INFO] 2024-09-12T17:26:30.029 INFO:tasks.workunit.client.0.smithi037.stdout:[INFO] ---------------------------< io.ceph:jcksum >--------------------------- 2024-09-12T17:26:30.029 INFO:tasks.workunit.client.0.smithi037.stdout:[INFO] Building jcksum 1.0 2024-09-12T17:26:30.029 INFO:tasks.workunit.client.0.smithi037.stdout:[INFO] from pom.xml 2024-09-12T17:26:30.029 INFO:tasks.workunit.client.0.smithi037.stdout:[INFO] --------------------------------[ jar ]--------------------------------- 2024-09-12T17:26:30.282 INFO:tasks.workunit.client.0.smithi037.stdout:[INFO] 2024-09-12T17:26:30.283 INFO:tasks.workunit.client.0.smithi037.stdout:[INFO] --- resources:3.3.1:resources (default-resources) @ jcksum --- 2024-09-12T17:26:30.375 INFO:tasks.workunit.client.0.smithi037.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/main/resources 2024-09-12T17:26:30.376 INFO:tasks.workunit.client.0.smithi037.stdout:[INFO] 2024-09-12T17:26:30.376 INFO:tasks.workunit.client.0.smithi037.stdout:[INFO] --- compiler:3.11.0:compile (default-compile) @ jcksum --- 2024-09-12T17:26:30.467 INFO:tasks.workunit.client.0.smithi037.stdout:[INFO] Nothing to compile - all classes are up to date 2024-09-12T17:26:30.467 INFO:tasks.workunit.client.0.smithi037.stdout:[INFO] 2024-09-12T17:26:30.467 INFO:tasks.workunit.client.0.smithi037.stdout:[INFO] --- resources:3.3.1:testResources (default-testResources) @ jcksum --- 2024-09-12T17:26:30.469 INFO:tasks.workunit.client.0.smithi037.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/test/resources 2024-09-12T17:26:30.469 INFO:tasks.workunit.client.0.smithi037.stdout:[INFO] 2024-09-12T17:26:30.469 INFO:tasks.workunit.client.0.smithi037.stdout:[INFO] --- compiler:3.11.0:testCompile (default-testCompile) @ jcksum --- 2024-09-12T17:26:30.476 INFO:tasks.workunit.client.0.smithi037.stdout:[INFO] Nothing to compile - all classes are up to date 2024-09-12T17:26:30.476 INFO:tasks.workunit.client.0.smithi037.stdout:[INFO] 2024-09-12T17:26:30.476 INFO:tasks.workunit.client.0.smithi037.stdout:[INFO] --- surefire:3.2.3:test (default-test) @ jcksum --- 2024-09-12T17:26:30.660 INFO:tasks.workunit.client.0.smithi037.stdout:[INFO] Using auto detected provider org.apache.maven.surefire.junitplatform.JUnitPlatformProvider 2024-09-12T17:26:30.856 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.pom 2024-09-12T17:26:31.064 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 1.4/4.7 kB Progress (1): 2.8/4.7 kB Progress (1): 4.1/4.7 kB Progress (1): 4.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.pom (4.7 kB at 22 kB/s) 2024-09-12T17:26:31.075 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-providers/3.2.3/surefire-providers-3.2.3.pom 2024-09-12T17:26:31.094 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 1.4/2.6 kB Progress (1): 2.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-providers/3.2.3/surefire-providers-3.2.3.pom (2.6 kB at 131 kB/s) 2024-09-12T17:26:31.101 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.pom 2024-09-12T17:26:31.119 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 1.4/2.8 kB Progress (1): 2.8/2.8 kB Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.pom (2.8 kB at 156 kB/s) 2024-09-12T17:26:31.125 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.pom 2024-09-12T17:26:31.143 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 1.4/3.0 kB Progress (1): 2.8/3.0 kB Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.pom (3.0 kB at 168 kB/s) 2024-09-12T17:26:31.146 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.pom 2024-09-12T17:26:31.164 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 1.4/3.2 kB Progress (1): 2.8/3.2 kB Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.pom (3.2 kB at 178 kB/s) 2024-09-12T17:26:31.167 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.pom 2024-09-12T17:26:31.185 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 1.4/1.7 kB Progress (1): 1.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.pom (1.7 kB at 94 kB/s) 2024-09-12T17:26:31.188 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.pom 2024-09-12T17:26:31.205 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 1.4/2.8 kB Progress (1): 2.8/2.8 kB Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.pom (2.8 kB at 167 kB/s) 2024-09-12T17:26:31.213 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.jar 2024-09-12T17:26:31.237 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 1.4/27 kB Progress (1): 2.8/27 kB Progress (1): 4.1/27 kB Progress (1): 5.5/27 kB Progress (1): 6.9/27 kB Progress (1): 8.3/27 kB Progress (1): 9.7/27 kB Progress (1): 11/27 kB Progress (1): 12/27 kB Progress (1): 14/27 kB Progress (1): 15/27 kB Progress (1): 17/27 kB Progress (1): 18/27 kB Progress (1): 19/27 kB Progress (1): 21/27 kB Progress (1): 22/27 kB Progress (1): 23/27 kB Progress (1): 25/27 kB Progress (1): 26/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.jar (27 kB at 1.2 MB/s) 2024-09-12T17:26:31.238 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.jar 2024-09-12T17:26:31.239 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.jar 2024-09-12T17:26:31.239 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.jar 2024-09-12T17:26:31.240 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.jar 2024-09-12T17:26:31.240 INFO:tasks.workunit.client.0.smithi037.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.jar 2024-09-12T17:26:31.259 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 16/18 kB Progress (1): 18 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.jar (18 kB at 798 kB/s) 2024-09-12T17:26:31.293 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (1): 1.4/7.7 kB Progress (2): 1.4/7.7 kB | 1.4/189 kB Progress (2): 2.8/7.7 kB | 1.4/189 kB Progress (2): 2.8/7.7 kB | 2.8/189 kB Progress (2): 4.1/7.7 kB | 2.8/189 kB Progress (2): 4.1/7.7 kB | 4.1/189 kB Progress (2): 5.5/7.7 kB | 4.1/189 kB Progress (2): 5.5/7.7 kB | 5.5/189 kB Progress (3): 5.5/7.7 kB | 5.5/189 kB | 16/103 kB Progress (3): 5.5/7.7 kB | 6.9/189 kB | 16/103 kB Progress (3): 6.9/7.7 kB | 6.9/189 kB | 16/103 kB Progress (3): 6.9/7.7 kB | 8.3/189 kB | 16/103 kB Progress (3): 7.7 kB | 8.3/189 kB | 16/103 kB Progress (4): 7.7 kB | 8.3/189 kB | 16/103 kB | 16/169 kB Progress (4): 7.7 kB | 9.7/189 kB | 16/103 kB | 16/169 kB Progress (4): 7.7 kB | 11/189 kB | 16/103 kB | 16/169 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.jar (7.7 kB at 142 kB/s) 2024-09-12T17:26:31.319 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (3): 12/189 kB | 16/103 kB | 16/169 kB Progress (3): 14/189 kB | 16/103 kB | 16/169 kB Progress (3): 15/189 kB | 16/103 kB | 16/169 kB Progress (3): 17/189 kB | 16/103 kB | 16/169 kB Progress (3): 18/189 kB | 16/103 kB | 16/169 kB Progress (3): 19/189 kB | 16/103 kB | 16/169 kB Progress (3): 21/189 kB | 16/103 kB | 16/169 kB Progress (3): 22/189 kB | 16/103 kB | 16/169 kB Progress (3): 23/189 kB | 16/103 kB | 16/169 kB Progress (3): 25/189 kB | 16/103 kB | 16/169 kB Progress (3): 26/189 kB | 16/103 kB | 16/169 kB Progress (3): 28/189 kB | 16/103 kB | 16/169 kB Progress (3): 29/189 kB | 16/103 kB | 16/169 kB Progress (3): 30/189 kB | 16/103 kB | 16/169 kB Progress (3): 32/189 kB | 16/103 kB | 16/169 kB Progress (3): 32/189 kB | 33/103 kB | 16/169 kB Progress (3): 33/189 kB | 33/103 kB | 16/169 kB Progress (3): 34/189 kB | 33/103 kB | 16/169 kB Progress (3): 34/189 kB | 33/103 kB | 33/169 kB Progress (3): 36/189 kB | 33/103 kB | 33/169 kB Progress (3): 37/189 kB | 33/103 kB | 33/169 kB Progress (3): 39/189 kB | 33/103 kB | 33/169 kB Progress (3): 40/189 kB | 33/103 kB | 33/169 kB Progress (3): 41/189 kB | 33/103 kB | 33/169 kB Progress (3): 43/189 kB | 33/103 kB | 33/169 kB Progress (3): 43/189 kB | 33/103 kB | 49/169 kB Progress (3): 43/189 kB | 49/103 kB | 49/169 kB Progress (3): 44/189 kB | 49/103 kB | 49/169 kB Progress (3): 46/189 kB | 49/103 kB | 49/169 kB Progress (3): 47/189 kB | 49/103 kB | 49/169 kB Progress (3): 48/189 kB | 49/103 kB | 49/169 kB Progress (3): 50/189 kB | 49/103 kB | 49/169 kB Progress (3): 51/189 kB | 49/103 kB | 49/169 kB Progress (3): 52/189 kB | 49/103 kB | 49/169 kB Progress (3): 54/189 kB | 49/103 kB | 49/169 kB Progress (3): 55/189 kB | 49/103 kB | 49/169 kB Progress (3): 57/189 kB | 49/103 kB | 49/169 kB Progress (3): 58/189 kB | 49/103 kB | 49/169 kB Progress (3): 59/189 kB | 49/103 kB | 49/169 kB Progress (3): 61/189 kB | 49/103 kB | 49/169 kB Progress (3): 62/189 kB | 49/103 kB | 49/169 kB Progress (3): 62/189 kB | 66/103 kB | 49/169 kB Progress (3): 63/189 kB | 66/103 kB | 49/169 kB Progress (3): 63/189 kB | 66/103 kB | 66/169 kB Progress (3): 63/189 kB | 82/103 kB | 66/169 kB Progress (3): 79/189 kB | 82/103 kB | 66/169 kB Progress (3): 79/189 kB | 82/103 kB | 82/169 kB Progress (3): 79/189 kB | 98/103 kB | 82/169 kB Progress (3): 79/189 kB | 103 kB | 82/169 kB Progress (3): 79/189 kB | 103 kB | 98/169 kB Progress (3): 96/189 kB | 103 kB | 98/169 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.jar (103 kB at 1.3 MB/s) 2024-09-12T17:26:31.332 INFO:tasks.workunit.client.0.smithi037.stdout:Progress (2): 96/189 kB | 115/169 kB Progress (2): 112/189 kB | 115/169 kB Progress (2): 112/189 kB | 131/169 kB Progress (2): 128/189 kB | 131/169 kB Progress (2): 128/189 kB | 147/169 kB Progress (2): 145/189 kB | 147/169 kB Progress (2): 161/189 kB | 147/169 kB Progress (2): 178/189 kB | 147/169 kB Progress (2): 178/189 kB | 164/169 kB Progress (2): 178/189 kB | 169 kB Progress (2): 189 kB | 169 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.jar (189 kB at 2.1 MB/s) 2024-09-12T17:26:31.332 INFO:tasks.workunit.client.0.smithi037.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.jar (169 kB at 1.8 MB/s) 2024-09-12T17:26:31.352 INFO:tasks.workunit.client.0.smithi037.stdout:[INFO] 2024-09-12T17:26:31.352 INFO:tasks.workunit.client.0.smithi037.stdout:[INFO] ------------------------------------------------------- 2024-09-12T17:26:31.352 INFO:tasks.workunit.client.0.smithi037.stdout:[INFO] T E S T S 2024-09-12T17:26:31.352 INFO:tasks.workunit.client.0.smithi037.stdout:[INFO] ------------------------------------------------------- 2024-09-12T17:26:31.833 INFO:tasks.workunit.client.0.smithi037.stdout:[INFO] Running io.ceph.jcksum.PutObjects 2024-09-12T17:26:31.951 INFO:tasks.workunit.client.0.smithi037.stdout:PutObjects.java: starting test run: 2024-09-12T17:26:31.952 INFO:tasks.workunit.client.0.smithi037.stdout: AccessKey=lNCnR47C2g+ZidCWBAUuwfSAA7Q= 2024-09-12T17:26:31.952 INFO:tasks.workunit.client.0.smithi037.stdout: SecretKey=tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== 2024-09-12T17:26:31.952 INFO:tasks.workunit.client.0.smithi037.stdout: EndpointUrl=http://smithi037.front.sepia.ceph.com:80 2024-09-12T17:26:31.952 INFO:tasks.workunit.client.0.smithi037.stderr:[main] WARN software.amazon.awssdk.http.apache.ApacheHttpClient - SSL Certificate verification is disabled. This is not a safe setting and should only be used for testing. 2024-09-12T17:26:32.049 INFO:tasks.workunit.client.0.smithi037.stdout:DEBUG: Environment Variables Read 2024-09-12T17:26:32.450 INFO:tasks.workunit.client.0.smithi037.stdout:DEBUG: S3 Client Initialized 2024-09-12T17:26:32.451 INFO:tasks.workunit.client.0.smithi037.stdout:DEBUG: Generating File 2024-09-12T17:26:32.451 INFO:tasks.workunit.client.0.smithi037.stdout:DEBUG: File Generated 2024-09-12T17:26:32.451 INFO:tasks.workunit.client.0.smithi037.stdout:DEBUG: Generating File 2024-09-12T17:26:32.451 INFO:tasks.workunit.client.0.smithi037.stdout:DEBUG: File Generated 2024-09-12T17:26:32.451 INFO:tasks.workunit.client.0.smithi037.stdout:DEBUG: Generating File 2024-09-12T17:26:32.451 INFO:tasks.workunit.client.0.smithi037.stdout:DEBUG: File Generated 2024-09-12T17:26:32.451 INFO:tasks.workunit.client.0.smithi037.stdout:DEBUG: Generating File 2024-09-12T17:26:32.451 INFO:tasks.workunit.client.0.smithi037.stdout:DEBUG: File Generated 2024-09-12T17:26:32.451 INFO:tasks.workunit.client.0.smithi037.stdout:DEBUG: Generating File 2024-09-12T17:26:32.451 INFO:tasks.workunit.client.0.smithi037.stdout:DEBUG: File Generated 2024-09-12T17:26:32.452 INFO:tasks.workunit.client.0.smithi037.stdout:DEBUG: Generating File 2024-09-12T17:26:32.452 INFO:tasks.workunit.client.0.smithi037.stdout:DEBUG: File Generated 2024-09-12T17:26:32.452 INFO:tasks.workunit.client.0.smithi037.stdout:DEBUG: Generated Big Files 2024-09-12T17:26:32.728 INFO:tasks.workunit.client.0.smithi037.stdout:HeadBucketResponse() 2024-09-12T17:26:32.728 INFO:tasks.workunit.client.0.smithi037.stdout:sheik is ready 2024-09-12T17:26:32.728 INFO:tasks.workunit.client.0.smithi037.stdout:DEBUG: Test Bucket Created 2024-09-12T17:26:32.749 INFO:tasks.workunit.client.0.smithi037.stdout:putObjectFromFileNoCksum called with file-0b 2024-09-12T17:26:32.950 INFO:tasks.workunit.client.0.smithi037.stdout:putObjectFromFileNoCksum called with file-8b 2024-09-12T17:26:33.150 INFO:tasks.workunit.client.0.smithi037.stdout:putObjectFromFileNoCksum called with file-200b 2024-09-12T17:26:33.251 INFO:tasks.workunit.client.0.smithi037.stdout:putObjectFromFileNoCksum called with file-21983b 2024-09-12T17:26:33.351 INFO:tasks.workunit.client.0.smithi037.stdout:putObjectFromFileNoCksum called with file-5519b 2024-09-12T17:26:33.451 INFO:tasks.workunit.client.0.smithi037.stdout:putObjectFromFileNoCksum called with file-204329b 2024-09-12T17:26:33.551 INFO:tasks.workunit.client.0.smithi037.stdout:putObjectFromFileNoCksum called with file-256k 2024-09-12T17:26:33.751 INFO:tasks.workunit.client.0.smithi037.stdout:putObjectFromFileNoCksum called with file-1m 2024-09-12T17:26:34.052 INFO:tasks.workunit.client.0.smithi037.stdout:putObjectFromFileNoCksum called with file-1038757b 2024-09-12T17:26:34.553 INFO:tasks.workunit.client.0.smithi037.stdout:mpuObjectFromFileNoCksum called with file-5m 2024-09-12T17:26:38.159 INFO:tasks.workunit.client.0.smithi037.stdout:mpuObjectFromFileNoCksum called with file-10m 2024-09-12T17:26:40.462 INFO:tasks.workunit.client.0.smithi037.stdout:mpuObjectFromFileNoCksum called with file-100m 2024-09-12T17:27:06.457 INFO:tasks.workunit.client.0.smithi037.stdout:arg: file-0b 2024-09-12T17:27:06.458 INFO:tasks.workunit.client.0.smithi037.stdout:arg: file-8b 2024-09-12T17:27:06.458 INFO:tasks.workunit.client.0.smithi037.stdout:arg: file-200b 2024-09-12T17:27:06.459 INFO:tasks.workunit.client.0.smithi037.stdout:arg: file-21983b 2024-09-12T17:27:06.460 INFO:tasks.workunit.client.0.smithi037.stdout:arg: file-5519b 2024-09-12T17:27:06.462 INFO:tasks.workunit.client.0.smithi037.stdout:arg: file-204329b 2024-09-12T17:27:06.462 INFO:tasks.workunit.client.0.smithi037.stdout:arg: file-256k 2024-09-12T17:27:06.463 INFO:tasks.workunit.client.0.smithi037.stdout:arg: file-1m 2024-09-12T17:27:06.465 INFO:tasks.workunit.client.0.smithi037.stdout:arg: file-1038757b 2024-09-12T17:27:06.493 INFO:tasks.workunit.client.0.smithi037.stdout:putObjectFromFileCksum called with file-0b 2024-09-12T17:27:06.593 INFO:tasks.workunit.client.0.smithi037.stdout:PutObjectResponse 2024-09-12T17:27:06.694 INFO:tasks.workunit.client.0.smithi037.stdout:putObjectFromFileCksum called with file-8b 2024-09-12T17:27:06.694 INFO:tasks.workunit.client.0.smithi037.stdout:PutObjectResponse 2024-09-12T17:27:06.794 INFO:tasks.workunit.client.0.smithi037.stdout:putObjectFromFileCksum called with file-200b 2024-09-12T17:27:06.794 INFO:tasks.workunit.client.0.smithi037.stdout:PutObjectResponse 2024-09-12T17:27:06.894 INFO:tasks.workunit.client.0.smithi037.stdout:putObjectFromFileCksum called with file-21983b 2024-09-12T17:27:06.895 INFO:tasks.workunit.client.0.smithi037.stdout:PutObjectResponse 2024-09-12T17:27:06.994 INFO:tasks.workunit.client.0.smithi037.stdout:putObjectFromFileCksum called with file-5519b 2024-09-12T17:27:07.094 INFO:tasks.workunit.client.0.smithi037.stdout:PutObjectResponse 2024-09-12T17:27:07.195 INFO:tasks.workunit.client.0.smithi037.stdout:putObjectFromFileCksum called with file-204329b 2024-09-12T17:27:07.294 INFO:tasks.workunit.client.0.smithi037.stdout:PutObjectResponse 2024-09-12T17:27:07.395 INFO:tasks.workunit.client.0.smithi037.stdout:putObjectFromFileCksum called with file-256k 2024-09-12T17:27:07.446 INFO:tasks.workunit.client.0.smithi037.stdout:PutObjectResponse 2024-09-12T17:27:07.495 INFO:tasks.workunit.client.0.smithi037.stdout:putObjectFromFileCksum called with file-1m 2024-09-12T17:27:07.795 INFO:tasks.workunit.client.0.smithi037.stdout:PutObjectResponse 2024-09-12T17:27:07.895 INFO:tasks.workunit.client.0.smithi037.stdout:putObjectFromFileCksum called with file-1038757b 2024-09-12T17:27:08.096 INFO:tasks.workunit.client.0.smithi037.stdout:PutObjectResponse 2024-09-12T17:27:08.196 INFO:tasks.workunit.client.0.smithi037.stdout:mpuObjectFromFileCksum called with file-5m 2024-09-12T17:27:09.898 INFO:tasks.workunit.client.0.smithi037.stdout:mpuObjectFromFileCksum called with file-10m 2024-09-12T17:27:12.401 INFO:tasks.workunit.client.0.smithi037.stdout:mpuObjectFromFileCksum called with file-100m 2024-09-12T17:27:58.020 INFO:tasks.workunit.client.0.smithi037.stdout:[INFO] Tests run: 33, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 86.18 s -- in io.ceph.jcksum.PutObjects 2024-09-12T17:27:58.032 INFO:tasks.workunit.client.0.smithi037.stdout:[INFO] 2024-09-12T17:27:58.032 INFO:tasks.workunit.client.0.smithi037.stdout:[INFO] Results: 2024-09-12T17:27:58.032 INFO:tasks.workunit.client.0.smithi037.stdout:[INFO] 2024-09-12T17:27:58.032 INFO:tasks.workunit.client.0.smithi037.stdout:[INFO] Tests run: 33, Failures: 0, Errors: 0, Skipped: 0 2024-09-12T17:27:58.032 INFO:tasks.workunit.client.0.smithi037.stdout:[INFO] 2024-09-12T17:27:58.034 INFO:tasks.workunit.client.0.smithi037.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-12T17:27:58.034 INFO:tasks.workunit.client.0.smithi037.stdout:[INFO] BUILD SUCCESS 2024-09-12T17:27:58.034 INFO:tasks.workunit.client.0.smithi037.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-12T17:27:58.035 INFO:tasks.workunit.client.0.smithi037.stdout:[INFO] Total time: 01:28 min 2024-09-12T17:27:58.035 INFO:tasks.workunit.client.0.smithi037.stdout:[INFO] Finished at: 2024-09-12T17:27:58Z 2024-09-12T17:27:58.035 INFO:tasks.workunit.client.0.smithi037.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-12T17:27:58.048 INFO:tasks.workunit.client.0.smithi037.stderr:+ exit 2024-09-12T17:27:58.049 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:27:58.049 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:27:58.128 INFO:tasks.workunit:Stopping ['cls/test_cls_lock.sh', 'cls/test_cls_log.sh', 'cls/test_cls_refcount.sh', 'cls/test_cls_rgw.sh', 'cls/test_cls_rgw_gc.sh', 'cls/test_cls_rgw_stats.sh', 'cls/test_cls_cmpomap.sh', 'cls/test_cls_2pc_queue.sh', 'cls/test_cls_user.sh', 'rgw/test_rgw_gc_log.sh', 'rgw/test_rgw_obj.sh', 'rgw/test_librgw_file.sh', 'rgw/test_awssdkv4_sig.sh'] on client.0... 2024-09-12T17:27:58.129 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T17:27:58.500 DEBUG:teuthology.parallel:result is None 2024-09-12T17:27:58.501 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T17:27:58.540 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T17:27:58.540 DEBUG:teuthology.orchestra.run.smithi037:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T17:27:58.610 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T17:27:58.610 INFO:teuthology.run_tasks:Running task workunit... 2024-09-12T17:27:58.622 INFO:tasks.workunit:Pulling workunits from ref bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T17:27:58.622 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T17:27:58.622 DEBUG:teuthology.orchestra.run.smithi037:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T17:27:58.680 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T17:27:58.680 INFO:teuthology.orchestra.run.smithi037.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T17:27:58.681 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T17:27:58.750 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-12T17:27:58.750 DEBUG:teuthology.orchestra.run.smithi037:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-12T17:27:58.821 INFO:tasks.workunit:timeout=3h 2024-09-12T17:27:58.821 INFO:tasks.workunit:cleanup=True 2024-09-12T17:27:58.822 DEBUG:teuthology.orchestra.run.smithi037:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T17:27:58.891 INFO:tasks.workunit.client.0.smithi037.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T17:28:59.598 INFO:tasks.workunit.client.0.smithi037.stderr:Updating files: 93% (11817/12697) Updating files: 94% (11936/12697) Updating files: 95% (12063/12697) Updating files: 96% (12190/12697) Updating files: 97% (12317/12697) Updating files: 98% (12444/12697) Updating files: 99% (12571/12697) Updating files: 100% (12697/12697) Updating files: 100% (12697/12697), done. 2024-09-12T17:29:00.384 INFO:tasks.workunit.client.0.smithi037.stderr:Note: switching to 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'. 2024-09-12T17:29:00.384 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:29:00.384 INFO:tasks.workunit.client.0.smithi037.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T17:29:00.384 INFO:tasks.workunit.client.0.smithi037.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T17:29:00.385 INFO:tasks.workunit.client.0.smithi037.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T17:29:00.385 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:29:00.385 INFO:tasks.workunit.client.0.smithi037.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T17:29:00.385 INFO:tasks.workunit.client.0.smithi037.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T17:29:00.385 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:29:00.385 INFO:tasks.workunit.client.0.smithi037.stderr: git switch -c 2024-09-12T17:29:00.385 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:29:00.385 INFO:tasks.workunit.client.0.smithi037.stderr:Or undo this operation with: 2024-09-12T17:29:00.385 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:29:00.385 INFO:tasks.workunit.client.0.smithi037.stderr: git switch - 2024-09-12T17:29:00.385 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:29:00.385 INFO:tasks.workunit.client.0.smithi037.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T17:29:00.385 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:29:00.385 INFO:tasks.workunit.client.0.smithi037.stderr:HEAD is now at bad475c18c9 rgw: clear output keys in RGWMetadataLister::get_next() 2024-09-12T17:29:00.390 DEBUG:teuthology.orchestra.run.smithi037:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T17:29:00.459 INFO:tasks.workunit.client.0.smithi037.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T17:29:00.462 INFO:tasks.workunit.client.0.smithi037.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T17:29:00.462 INFO:tasks.workunit.client.0.smithi037.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T17:29:00.513 INFO:tasks.workunit.client.0.smithi037.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T17:29:00.563 INFO:tasks.workunit.client.0.smithi037.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T17:29:00.605 INFO:tasks.workunit.client.0.smithi037.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T17:29:00.607 INFO:tasks.workunit.client.0.smithi037.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T17:29:00.607 INFO:tasks.workunit.client.0.smithi037.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T17:29:00.648 INFO:tasks.workunit.client.0.smithi037.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T17:29:00.651 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-09-12T17:29:00.651 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T17:29:00.722 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_s3_mp_reupload.sh on client.0... 2024-09-12T17:29:00.723 INFO:tasks.workunit:Running workunit rgw/test_rgw_s3_mp_reupload.sh... 2024-09-12T17:29:00.724 DEBUG:teuthology.orchestra.run.smithi037:workunit test rgw/test_rgw_s3_mp_reupload.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_s3_mp_reupload.sh 2024-09-12T17:29:00.798 INFO:tasks.workunit.client.0.smithi037.stdout:INFO: fully qualified domain name: smithi037.front.sepia.ceph.com 2024-09-12T17:29:00.798 INFO:tasks.workunit.client.0.smithi037.stdout:== TESTING *ABORTING* MULTIPART UPLOAD WITH RE-UPLOADS == 2024-09-12T17:29:00.798 INFO:tasks.workunit.client.0.smithi037.stdout:== TESTING NON-VERSIONED BUCKET == 2024-09-12T17:29:03.397 INFO:tasks.workunit.client.0.smithi037.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.9/site-packages (21.3.1) 2024-09-12T17:29:03.592 INFO:tasks.workunit.client.0.smithi037.stdout:Collecting pip 2024-09-12T17:29:03.598 INFO:tasks.workunit.client.0.smithi037.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-12T17:29:03.644 INFO:tasks.workunit.client.0.smithi037.stdout:Installing collected packages: pip 2024-09-12T17:29:03.644 INFO:tasks.workunit.client.0.smithi037.stdout: Attempting uninstall: pip 2024-09-12T17:29:03.644 INFO:tasks.workunit.client.0.smithi037.stdout: Found existing installation: pip 21.3.1 2024-09-12T17:29:03.807 INFO:tasks.workunit.client.0.smithi037.stdout: Uninstalling pip-21.3.1: 2024-09-12T17:29:03.812 INFO:tasks.workunit.client.0.smithi037.stdout: Successfully uninstalled pip-21.3.1 2024-09-12T17:29:04.617 INFO:tasks.workunit.client.0.smithi037.stdout:Successfully installed pip-24.2 2024-09-12T17:29:05.478 INFO:tasks.workunit.client.0.smithi037.stdout:Collecting boto3 2024-09-12T17:29:05.479 INFO:tasks.workunit.client.0.smithi037.stdout: Using cached boto3-1.35.17-py3-none-any.whl.metadata (6.6 kB) 2024-09-12T17:29:06.046 INFO:tasks.workunit.client.0.smithi037.stdout:Collecting botocore<1.36.0,>=1.35.17 (from boto3) 2024-09-12T17:29:06.047 INFO:tasks.workunit.client.0.smithi037.stdout: Using cached botocore-1.35.17-py3-none-any.whl.metadata (5.7 kB) 2024-09-12T17:29:06.098 INFO:tasks.workunit.client.0.smithi037.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-12T17:29:06.099 INFO:tasks.workunit.client.0.smithi037.stdout: Using cached jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-12T17:29:06.152 INFO:tasks.workunit.client.0.smithi037.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-12T17:29:06.154 INFO:tasks.workunit.client.0.smithi037.stdout: Using cached s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-12T17:29:06.213 INFO:tasks.workunit.client.0.smithi037.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T17:29:06.214 INFO:tasks.workunit.client.0.smithi037.stdout: Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-12T17:29:06.283 INFO:tasks.workunit.client.0.smithi037.stdout:Collecting urllib3<1.27,>=1.25.4 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T17:29:06.284 INFO:tasks.workunit.client.0.smithi037.stdout: Using cached urllib3-1.26.20-py2.py3-none-any.whl.metadata (50 kB) 2024-09-12T17:29:06.426 INFO:tasks.workunit.client.0.smithi037.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T17:29:06.428 INFO:tasks.workunit.client.0.smithi037.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-12T17:29:06.432 INFO:tasks.workunit.client.0.smithi037.stdout:Using cached boto3-1.35.17-py3-none-any.whl (139 kB) 2024-09-12T17:29:06.433 INFO:tasks.workunit.client.0.smithi037.stdout:Using cached botocore-1.35.17-py3-none-any.whl (12.5 MB) 2024-09-12T17:29:06.443 INFO:tasks.workunit.client.0.smithi037.stdout:Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-12T17:29:06.444 INFO:tasks.workunit.client.0.smithi037.stdout:Using cached s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-12T17:29:06.445 INFO:tasks.workunit.client.0.smithi037.stdout:Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-12T17:29:06.447 INFO:tasks.workunit.client.0.smithi037.stdout:Using cached urllib3-1.26.20-py2.py3-none-any.whl (144 kB) 2024-09-12T17:29:06.448 INFO:tasks.workunit.client.0.smithi037.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-12T17:29:06.524 INFO:tasks.workunit.client.0.smithi037.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-12T17:29:07.531 INFO:tasks.workunit.client.0.smithi037.stdout:Successfully installed boto3-1.35.17 botocore-1.35.17 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-1.26.20 2024-09-12T17:29:07.776 INFO:tasks.workunit.client.0.smithi037.stdout:INFO: creating user 2024-09-12T17:29:07.895 INFO:tasks.workunit.client.0.smithi037.stdout:{ 2024-09-12T17:29:07.896 INFO:tasks.workunit.client.0.smithi037.stdout: "user_id": "testid", 2024-09-12T17:29:07.896 INFO:tasks.workunit.client.0.smithi037.stdout: "display_name": "M. Tester", 2024-09-12T17:29:07.896 INFO:tasks.workunit.client.0.smithi037.stdout: "email": "tester@ceph.com", 2024-09-12T17:29:07.896 INFO:tasks.workunit.client.0.smithi037.stdout: "suspended": 0, 2024-09-12T17:29:07.896 INFO:tasks.workunit.client.0.smithi037.stdout: "max_buckets": 1000, 2024-09-12T17:29:07.896 INFO:tasks.workunit.client.0.smithi037.stdout: "subusers": [], 2024-09-12T17:29:07.896 INFO:tasks.workunit.client.0.smithi037.stdout: "keys": [ 2024-09-12T17:29:07.896 INFO:tasks.workunit.client.0.smithi037.stdout: { 2024-09-12T17:29:07.896 INFO:tasks.workunit.client.0.smithi037.stdout: "user": "testid", 2024-09-12T17:29:07.896 INFO:tasks.workunit.client.0.smithi037.stdout: "access_key": "0555b35654ad1656d804", 2024-09-12T17:29:07.896 INFO:tasks.workunit.client.0.smithi037.stdout: "secret_key": "h7GhxuBLTrlhVUyxSPUKUV8r/2EI4ngqJxD7iBdBYLhwluN30JaT3Q==", 2024-09-12T17:29:07.896 INFO:tasks.workunit.client.0.smithi037.stdout: "active": true, 2024-09-12T17:29:07.896 INFO:tasks.workunit.client.0.smithi037.stdout: "create_date": "2024-09-12T17:29:07.886240Z" 2024-09-12T17:29:07.897 INFO:tasks.workunit.client.0.smithi037.stdout: } 2024-09-12T17:29:07.897 INFO:tasks.workunit.client.0.smithi037.stdout: ], 2024-09-12T17:29:07.897 INFO:tasks.workunit.client.0.smithi037.stdout: "swift_keys": [], 2024-09-12T17:29:07.897 INFO:tasks.workunit.client.0.smithi037.stdout: "caps": [], 2024-09-12T17:29:07.897 INFO:tasks.workunit.client.0.smithi037.stdout: "op_mask": "read, write, delete", 2024-09-12T17:29:07.897 INFO:tasks.workunit.client.0.smithi037.stdout: "default_placement": "", 2024-09-12T17:29:07.897 INFO:tasks.workunit.client.0.smithi037.stdout: "default_storage_class": "", 2024-09-12T17:29:07.897 INFO:tasks.workunit.client.0.smithi037.stdout: "placement_tags": [], 2024-09-12T17:29:07.897 INFO:tasks.workunit.client.0.smithi037.stdout: "bucket_quota": { 2024-09-12T17:29:07.897 INFO:tasks.workunit.client.0.smithi037.stdout: "enabled": false, 2024-09-12T17:29:07.897 INFO:tasks.workunit.client.0.smithi037.stdout: "check_on_raw": false, 2024-09-12T17:29:07.897 INFO:tasks.workunit.client.0.smithi037.stdout: "max_size": -1, 2024-09-12T17:29:07.897 INFO:tasks.workunit.client.0.smithi037.stdout: "max_size_kb": 0, 2024-09-12T17:29:07.897 INFO:tasks.workunit.client.0.smithi037.stdout: "max_objects": -1 2024-09-12T17:29:07.898 INFO:tasks.workunit.client.0.smithi037.stdout: }, 2024-09-12T17:29:07.898 INFO:tasks.workunit.client.0.smithi037.stdout: "user_quota": { 2024-09-12T17:29:07.898 INFO:tasks.workunit.client.0.smithi037.stdout: "enabled": false, 2024-09-12T17:29:07.898 INFO:tasks.workunit.client.0.smithi037.stdout: "check_on_raw": false, 2024-09-12T17:29:07.898 INFO:tasks.workunit.client.0.smithi037.stdout: "max_size": -1, 2024-09-12T17:29:07.898 INFO:tasks.workunit.client.0.smithi037.stdout: "max_size_kb": 0, 2024-09-12T17:29:07.898 INFO:tasks.workunit.client.0.smithi037.stdout: "max_objects": -1 2024-09-12T17:29:07.898 INFO:tasks.workunit.client.0.smithi037.stdout: }, 2024-09-12T17:29:07.898 INFO:tasks.workunit.client.0.smithi037.stdout: "temp_url_keys": [], 2024-09-12T17:29:07.898 INFO:tasks.workunit.client.0.smithi037.stdout: "type": "rgw", 2024-09-12T17:29:07.898 INFO:tasks.workunit.client.0.smithi037.stdout: "mfa_ids": [], 2024-09-12T17:29:07.898 INFO:tasks.workunit.client.0.smithi037.stdout: "account_id": "", 2024-09-12T17:29:07.898 INFO:tasks.workunit.client.0.smithi037.stdout: "path": "/", 2024-09-12T17:29:07.898 INFO:tasks.workunit.client.0.smithi037.stdout: "create_date": "2024-09-12T17:29:07.886230Z", 2024-09-12T17:29:07.898 INFO:tasks.workunit.client.0.smithi037.stdout: "tags": [], 2024-09-12T17:29:07.899 INFO:tasks.workunit.client.0.smithi037.stdout: "group_ids": [] 2024-09-12T17:29:07.899 INFO:tasks.workunit.client.0.smithi037.stdout:} 2024-09-12T17:29:07.899 INFO:tasks.workunit.client.0.smithi037.stdout: 2024-09-12T17:29:08.192 INFO:tasks.workunit.client.0.smithi037.stderr:5+0 records in 2024-09-12T17:29:08.192 INFO:tasks.workunit.client.0.smithi037.stderr:5+0 records out 2024-09-12T17:29:08.192 INFO:tasks.workunit.client.0.smithi037.stderr:5242880 bytes (5.2 MB, 5.0 MiB) copied, 0.0142196 s, 369 MB/s 2024-09-12T17:29:43.426 INFO:tasks.workunit.client.0.smithi037.stdout:bucket nams is reupload-bkt-108287 2024-09-12T17:29:43.427 INFO:tasks.workunit.client.0.smithi037.stdout:endpoint is http://smithi037.front.sepia.ceph.com:80 2024-09-12T17:29:43.427 INFO:tasks.workunit.client.0.smithi037.stdout:start UploadId=2~Phqr24LSuw01HILtFcu7wO-f6NRF_ce 2024-09-12T17:29:43.427 INFO:tasks.workunit.client.0.smithi037.stdout:phase 1 uploaded part {'ETag': '"00a072722fed079ed13ee5487cf5e796"', 'PartNumber': 1} 2024-09-12T17:29:43.427 INFO:tasks.workunit.client.0.smithi037.stdout:phase 1 uploaded part {'ETag': '"00a072722fed079ed13ee5487cf5e796"', 'PartNumber': 2} 2024-09-12T17:29:43.427 INFO:tasks.workunit.client.0.smithi037.stdout:phase 2 uploaded part {'ETag': '"00a072722fed079ed13ee5487cf5e796"', 'PartNumber': 1} 2024-09-12T17:29:43.427 INFO:tasks.workunit.client.0.smithi037.stdout:phase 2 uploaded part {'ETag': '"00a072722fed079ed13ee5487cf5e796"', 'PartNumber': 1} 2024-09-12T17:29:43.427 INFO:tasks.workunit.client.0.smithi037.stdout:phase 2 uploaded part {'ETag': '"00a072722fed079ed13ee5487cf5e796"', 'PartNumber': 1} 2024-09-12T17:29:43.427 INFO:tasks.workunit.client.0.smithi037.stdout:phase 2 uploaded part {'ETag': '"00a072722fed079ed13ee5487cf5e796"', 'PartNumber': 1} 2024-09-12T17:29:43.427 INFO:tasks.workunit.client.0.smithi037.stdout:phase 2 uploaded part {'ETag': '"00a072722fed079ed13ee5487cf5e796"', 'PartNumber': 1} 2024-09-12T17:29:43.427 INFO:tasks.workunit.client.0.smithi037.stdout:phase 2 uploaded part {'ETag': '"00a072722fed079ed13ee5487cf5e796"', 'PartNumber': 1} 2024-09-12T17:29:43.427 INFO:tasks.workunit.client.0.smithi037.stdout:phase 2 uploaded part {'ETag': '"00a072722fed079ed13ee5487cf5e796"', 'PartNumber': 1} 2024-09-12T17:29:43.427 INFO:tasks.workunit.client.0.smithi037.stdout:phase 2 uploaded part {'ETag': '"00a072722fed079ed13ee5487cf5e796"', 'PartNumber': 1} 2024-09-12T17:29:43.427 INFO:tasks.workunit.client.0.smithi037.stdout:phase 2 uploaded part {'ETag': '"00a072722fed079ed13ee5487cf5e796"', 'PartNumber': 1} 2024-09-12T17:29:43.428 INFO:tasks.workunit.client.0.smithi037.stdout:phase 2 uploaded part {'ETag': '"00a072722fed079ed13ee5487cf5e796"', 'PartNumber': 1} 2024-09-12T17:29:43.428 INFO:tasks.workunit.client.0.smithi037.stdout:phase 2 uploaded part {'ETag': '"00a072722fed079ed13ee5487cf5e796"', 'PartNumber': 1} 2024-09-12T17:29:43.428 INFO:tasks.workunit.client.0.smithi037.stdout:aborting multipart upload, parts=[{'ETag': '"00a072722fed079ed13ee5487cf5e796"', 'PartNumber': 1}, {'ETag': '"00a072722fed079ed13ee5487cf5e796"', 'PartNumber': 2}] 2024-09-12T17:29:44.244 INFO:tasks.workunit.client.0.smithi037.stdout:radosgw-admin bucket radoslist: 2024-09-12T17:29:44.306 INFO:tasks.workunit.client.0.smithi037.stdout:rados ls: 2024-09-12T17:29:44.310 INFO:tasks.workunit.client.0.smithi037.stdout:== PASSED == 2024-09-12T17:29:44.311 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:29:44.311 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:29:44.390 INFO:tasks.workunit:Stopping ['rgw/test_rgw_s3_mp_reupload.sh'] on client.0... 2024-09-12T17:29:44.391 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T17:29:44.810 DEBUG:teuthology.parallel:result is None 2024-09-12T17:29:44.811 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T17:29:44.850 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T17:29:44.850 DEBUG:teuthology.orchestra.run.smithi037:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T17:29:44.922 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T17:29:44.922 INFO:teuthology.run_tasks:Running task ragweed... 2024-09-12T17:29:44.939 DEBUG:tasks.ragweed:ragweed config is {'client.0': {'default-branch': 'ceph-master', 'rgw_server': 'client.0', 'stages': 'prepare,check'}} 2024-09-12T17:29:44.939 INFO:tasks.ragweed:Downloading ragweed... 2024-09-12T17:29:44.939 INFO:tasks.ragweed:Using branch 'wip-rgw-meta-handlers' for ragweed 2024-09-12T17:29:44.940 DEBUG:teuthology.orchestra.run.smithi037:> git clone -b wip-rgw-meta-handlers https://git.ceph.com/ragweed.git /home/ubuntu/cephtest/ragweed.client.0 2024-09-12T17:29:44.991 INFO:teuthology.orchestra.run.smithi037.stderr:Cloning into '/home/ubuntu/cephtest/ragweed.client.0'... 2024-09-12T17:29:45.019 INFO:teuthology.orchestra.run.smithi037.stderr:fatal: Remote branch wip-rgw-meta-handlers not found in upstream origin 2024-09-12T17:29:45.019 DEBUG:teuthology.orchestra.run:got remote process result: 128 2024-09-12T17:29:45.020 INFO:tasks.ragweed:Using branch 'ceph-master' for ragweed 2024-09-12T17:29:45.021 DEBUG:teuthology.orchestra.run.smithi037:> git clone -b ceph-master https://git.ceph.com/ragweed.git /home/ubuntu/cephtest/ragweed.client.0 2024-09-12T17:29:45.090 INFO:teuthology.orchestra.run.smithi037.stderr:Cloning into '/home/ubuntu/cephtest/ragweed.client.0'... 2024-09-12T17:29:45.261 INFO:tasks.ragweed:Creating rgw users... 2024-09-12T17:29:45.261 DEBUG:tasks.ragweed:Creating user ragweed.client.0 on client.0 2024-09-12T17:29:45.261 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid ragweed.client.0 --display-name 'Mr. ragweed.client.0' --access-key PYXMBJWIWQWNEBNJYPAN --secret YC1tKqd6/MJKjjUD2mI5NwOMWq69rJocRvJWL/n/UfSKPZkQBjoAjg== --email ragweed.client.0+test@test.test --system false 2024-09-12T17:29:45.369 INFO:teuthology.orchestra.run.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:29:45.369 INFO:teuthology.orchestra.run.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:29:45.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:45.405+0000 7f4d1232e800 20 rados->read ofs=0 len=0 2024-09-12T17:29:45.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:45.406+0000 7f4d1232e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:45.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:45.406+0000 7f4d1232e800 20 realm 2024-09-12T17:29:45.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:45.406+0000 7f4d1232e800 20 rados->read ofs=0 len=0 2024-09-12T17:29:45.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:45.407+0000 7f4d1232e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:45.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:45.407+0000 7f4d1232e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:29:45.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:45.407+0000 7f4d1232e800 20 rados->read ofs=0 len=0 2024-09-12T17:29:45.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:45.407+0000 7f4d1232e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:45.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:45.407+0000 7f4d1232e800 20 rados->read ofs=0 len=0 2024-09-12T17:29:45.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:45.408+0000 7f4d1232e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:29:45.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:45.408+0000 7f4d1232e800 20 rados->read ofs=0 len=0 2024-09-12T17:29:45.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:45.408+0000 7f4d1232e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:29:45.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:45.408+0000 7f4d1232e800 20 searching for the correct realm 2024-09-12T17:29:45.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:45.411+0000 7f4d0d8dc640 0 -- 172.21.15.37:0/1297337465 >> [v2:172.21.15.40:6800/2441293461,v1:172.21.15.40:6801/2441293461] conn(0x7f4d00018070 msgr2=0x7f4d0007a1e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:29:45.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:45.416+0000 7f4d0e0dd640 0 -- 172.21.15.37:0/1297337465 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7f4d040b1260 msgr2=0x7f4d040c2730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:29:45.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:45.623+0000 7f4d1232e800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:29:45.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:45.623+0000 7f4d1232e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:29:45.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:45.623+0000 7f4d1232e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:29:45.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:45.623+0000 7f4d1232e800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:29:45.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:45.623+0000 7f4d1232e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:29:45.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:45.623+0000 7f4d1232e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:29:45.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:45.623+0000 7f4d1232e800 20 rados->read ofs=0 len=0 2024-09-12T17:29:45.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:45.623+0000 7f4d1232e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:45.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:45.623+0000 7f4d1232e800 20 rados->read ofs=0 len=0 2024-09-12T17:29:45.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:45.624+0000 7f4d1232e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:29:45.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:45.624+0000 7f4d1232e800 20 rados->read ofs=0 len=0 2024-09-12T17:29:45.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:45.625+0000 7f4d1232e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:29:45.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:45.625+0000 7f4d1232e800 20 zone default found 2024-09-12T17:29:45.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:45.625+0000 7f4d1232e800 4 Realm: () 2024-09-12T17:29:45.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:45.625+0000 7f4d1232e800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:29:45.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:45.625+0000 7f4d1232e800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:29:45.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:45.625+0000 7f4d1232e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:29:45.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:45.625+0000 7f4d1232e800 20 zonegroup default 2024-09-12T17:29:45.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:45.625+0000 7f4d1232e800 20 rados->read ofs=0 len=0 2024-09-12T17:29:45.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:45.625+0000 7f4d1232e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:45.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:45.625+0000 7f4d1232e800 20 rados->read ofs=0 len=0 2024-09-12T17:29:45.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:45.625+0000 7f4d1232e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:45.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:45.625+0000 7f4d1232e800 20 rados->read ofs=0 len=0 2024-09-12T17:29:45.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:45.626+0000 7f4d1232e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:45.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:45.626+0000 7f4d1232e800 20 started sync module instance, tier type = 2024-09-12T17:29:45.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:45.626+0000 7f4d1232e800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:29:45.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:45.636+0000 7f4d1232e800 20 add_watcher() i=0 2024-09-12T17:29:45.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:45.636+0000 7f4d1232e800 20 add_watcher() i=1 2024-09-12T17:29:45.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:45.636+0000 7f4d1232e800 20 add_watcher() i=2 2024-09-12T17:29:45.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:45.636+0000 7f4d1232e800 20 add_watcher() i=3 2024-09-12T17:29:45.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:45.636+0000 7f4d1232e800 20 add_watcher() i=4 2024-09-12T17:29:45.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:45.636+0000 7f4d1232e800 20 add_watcher() i=5 2024-09-12T17:29:45.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:45.636+0000 7f4d1232e800 20 add_watcher() i=6 2024-09-12T17:29:45.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:45.637+0000 7f4d1232e800 20 add_watcher() i=7 2024-09-12T17:29:45.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:45.637+0000 7f4d1232e800 2 all 8 watchers are set, enabling cache 2024-09-12T17:29:45.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:45.639+0000 7f4bc4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:29:45.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:45.639+0000 7f4d1232e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:29:45.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:45.639+0000 7f4d1232e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:29:45.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:45.639+0000 7f4d1232e800 5 note: GC not initialized 2024-09-12T17:29:45.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:45.639+0000 7f4b3f7fe640 20 reqs_thread_entry: start 2024-09-12T17:29:45.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:45.639+0000 7f4d1232e800 20 init_complete bucket index max shards: 11 2024-09-12T17:29:45.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:45.639+0000 7f4d1232e800 20 Filter name: none 2024-09-12T17:29:45.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:45.639+0000 7f4b3d7fa640 20 reqs_thread_entry: start 2024-09-12T17:29:45.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:45.639+0000 7f4d1232e800 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : miss 2024-09-12T17:29:45.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:45.639+0000 7f4d1232e800 20 rados->read ofs=0 len=0 2024-09-12T17:29:45.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:45.640+0000 7f4d1232e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:45.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:45.640+0000 7f4d1232e800 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x0 2024-09-12T17:29:45.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:45.640+0000 7f4d1232e800 10 adding default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-12T17:29:45.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:45.640+0000 7f4d1232e800 10 cache get: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test : miss 2024-09-12T17:29:45.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:45.640+0000 7f4d1232e800 20 rados->read ofs=0 len=0 2024-09-12T17:29:45.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:45.640+0000 7f4d1232e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:45.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:45.640+0000 7f4d1232e800 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x0 2024-09-12T17:29:45.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:45.640+0000 7f4d1232e800 10 adding default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-09-12T17:29:45.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:45.640+0000 7f4d1232e800 10 cache get: name=default.rgw.meta+users.keys+PYXMBJWIWQWNEBNJYPAN : miss 2024-09-12T17:29:45.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:45.640+0000 7f4d1232e800 20 rados->read ofs=0 len=0 2024-09-12T17:29:45.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:45.640+0000 7f4d1232e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:45.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:45.640+0000 7f4d1232e800 10 cache put: name=default.rgw.meta+users.keys+PYXMBJWIWQWNEBNJYPAN info.flags=0x0 2024-09-12T17:29:45.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:45.640+0000 7f4d1232e800 10 adding default.rgw.meta+users.keys+PYXMBJWIWQWNEBNJYPAN to cache LRU end 2024-09-12T17:29:45.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:45.640+0000 7f4d1232e800 10 cache get: name=default.rgw.meta+users.keys+PYXMBJWIWQWNEBNJYPAN : hit (negative entry) 2024-09-12T17:29:45.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:45.640+0000 7f4d1232e800 10 cache get: name=default.rgw.meta+users.keys+PYXMBJWIWQWNEBNJYPAN : hit (negative entry) 2024-09-12T17:29:45.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:45.642+0000 7f4d1232e800 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x17 2024-09-12T17:29:45.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:45.642+0000 7f4d1232e800 10 moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-12T17:29:45.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:45.642+0000 7f4d1232e800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ragweed.client.0, ofs0, ns] 2024-09-12T17:29:45.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:45.642+0000 7f4bf1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1082331758657 cookie 94918919868848 notifier 5645 bl.length()=675 2024-09-12T17:29:45.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:45.642+0000 7f4bf1ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x17 2024-09-12T17:29:45.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:45.642+0000 7f4bf1ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-12T17:29:45.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:45.646+0000 7f4d1232e800 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x7 2024-09-12T17:29:45.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:45.646+0000 7f4d1232e800 10 moving default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-09-12T17:29:45.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:45.646+0000 7f4d1232e800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.email:ragweed.client.0+test@test.test, ofs0, ns] 2024-09-12T17:29:45.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:45.646+0000 7f4bf1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1082331758606 cookie 94918919862800 notifier 5645 bl.length()=202 2024-09-12T17:29:45.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:45.646+0000 7f4bf1ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x7 2024-09-12T17:29:45.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:45.646+0000 7f4bf1ffb640 10 rgw watcher librados: moving default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-09-12T17:29:45.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:45.649+0000 7f4d1232e800 10 cache put: name=default.rgw.meta+users.keys+PYXMBJWIWQWNEBNJYPAN info.flags=0x7 2024-09-12T17:29:45.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:45.649+0000 7f4d1232e800 10 moving default.rgw.meta+users.keys+PYXMBJWIWQWNEBNJYPAN to cache LRU end 2024-09-12T17:29:45.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:45.649+0000 7f4d1232e800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.keys:PYXMBJWIWQWNEBNJYPAN, ofs0, ns] 2024-09-12T17:29:45.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:45.649+0000 7f4bf1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1082331758658 cookie 94918919868848 notifier 5645 bl.length()=190 2024-09-12T17:29:45.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:45.649+0000 7f4bf1ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+PYXMBJWIWQWNEBNJYPAN info.flags=0x7 2024-09-12T17:29:45.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:45.649+0000 7f4bf1ffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+PYXMBJWIWQWNEBNJYPAN to cache LRU end 2024-09-12T17:29:45.651 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-09-12T17:29:45.651 INFO:teuthology.orchestra.run.smithi037.stdout: "user_id": "ragweed.client.0", 2024-09-12T17:29:45.651 INFO:teuthology.orchestra.run.smithi037.stdout: "display_name": "Mr. ragweed.client.0", 2024-09-12T17:29:45.651 INFO:teuthology.orchestra.run.smithi037.stdout: "email": "ragweed.client.0+test@test.test", 2024-09-12T17:29:45.652 INFO:teuthology.orchestra.run.smithi037.stdout: "suspended": 0, 2024-09-12T17:29:45.652 INFO:teuthology.orchestra.run.smithi037.stdout: "max_buckets": 1000, 2024-09-12T17:29:45.652 INFO:teuthology.orchestra.run.smithi037.stdout: "subusers": [], 2024-09-12T17:29:45.652 INFO:teuthology.orchestra.run.smithi037.stdout: "keys": [ 2024-09-12T17:29:45.652 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-12T17:29:45.652 INFO:teuthology.orchestra.run.smithi037.stdout: "user": "ragweed.client.0", 2024-09-12T17:29:45.652 INFO:teuthology.orchestra.run.smithi037.stdout: "access_key": "PYXMBJWIWQWNEBNJYPAN", 2024-09-12T17:29:45.652 INFO:teuthology.orchestra.run.smithi037.stdout: "secret_key": "YC1tKqd6/MJKjjUD2mI5NwOMWq69rJocRvJWL/n/UfSKPZkQBjoAjg==", 2024-09-12T17:29:45.652 INFO:teuthology.orchestra.run.smithi037.stdout: "active": true, 2024-09-12T17:29:45.652 INFO:teuthology.orchestra.run.smithi037.stdout: "create_date": "2024-09-12T17:29:45.641581Z" 2024-09-12T17:29:45.653 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-12T17:29:45.653 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-12T17:29:45.653 INFO:teuthology.orchestra.run.smithi037.stdout: "swift_keys": [], 2024-09-12T17:29:45.653 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": [], 2024-09-12T17:29:45.653 INFO:teuthology.orchestra.run.smithi037.stdout: "op_mask": "read, write, delete", 2024-09-12T17:29:45.653 INFO:teuthology.orchestra.run.smithi037.stdout: "default_placement": "", 2024-09-12T17:29:45.653 INFO:teuthology.orchestra.run.smithi037.stdout: "default_storage_class": "", 2024-09-12T17:29:45.653 INFO:teuthology.orchestra.run.smithi037.stdout: "placement_tags": [], 2024-09-12T17:29:45.653 INFO:teuthology.orchestra.run.smithi037.stdout: "bucket_quota": { 2024-09-12T17:29:45.653 INFO:teuthology.orchestra.run.smithi037.stdout: "enabled": false, 2024-09-12T17:29:45.653 INFO:teuthology.orchestra.run.smithi037.stdout: "check_on_raw": false, 2024-09-12T17:29:45.653 INFO:teuthology.orchestra.run.smithi037.stdout: "max_size": -1, 2024-09-12T17:29:45.653 INFO:teuthology.orchestra.run.smithi037.stdout: "max_size_kb": 0, 2024-09-12T17:29:45.654 INFO:teuthology.orchestra.run.smithi037.stdout: "max_objects": -1 2024-09-12T17:29:45.654 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-12T17:29:45.654 INFO:teuthology.orchestra.run.smithi037.stdout: "user_quota": { 2024-09-12T17:29:45.654 INFO:teuthology.orchestra.run.smithi037.stdout: "enabled": false, 2024-09-12T17:29:45.654 INFO:teuthology.orchestra.run.smithi037.stdout: "check_on_raw": false, 2024-09-12T17:29:45.654 INFO:teuthology.orchestra.run.smithi037.stdout: "max_size": -1, 2024-09-12T17:29:45.654 INFO:teuthology.orchestra.run.smithi037.stdout: "max_size_kb": 0, 2024-09-12T17:29:45.654 INFO:teuthology.orchestra.run.smithi037.stdout: "max_objects": -1 2024-09-12T17:29:45.654 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-12T17:29:45.654 INFO:teuthology.orchestra.run.smithi037.stdout: "temp_url_keys": [], 2024-09-12T17:29:45.654 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "rgw", 2024-09-12T17:29:45.654 INFO:teuthology.orchestra.run.smithi037.stdout: "mfa_ids": [], 2024-09-12T17:29:45.654 INFO:teuthology.orchestra.run.smithi037.stdout: "account_id": "", 2024-09-12T17:29:45.655 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-09-12T17:29:45.655 INFO:teuthology.orchestra.run.smithi037.stdout: "create_date": "2024-09-12T17:29:45.641564Z", 2024-09-12T17:29:45.655 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-12T17:29:45.655 INFO:teuthology.orchestra.run.smithi037.stdout: "group_ids": [] 2024-09-12T17:29:45.655 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-09-12T17:29:45.655 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:29:45.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:45.651+0000 7f4bc4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:29:45.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:45.654+0000 7f4d1232e800 20 remove_watcher() i=0 2024-09-12T17:29:45.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:45.654+0000 7f4d1232e800 2 removed watcher, disabling cache 2024-09-12T17:29:45.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:45.656+0000 7f4d1232e800 20 remove_watcher() i=1 2024-09-12T17:29:45.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:45.657+0000 7f4d1232e800 20 remove_watcher() i=2 2024-09-12T17:29:45.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:45.658+0000 7f4d1232e800 20 remove_watcher() i=3 2024-09-12T17:29:45.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:45.659+0000 7f4d1232e800 20 remove_watcher() i=4 2024-09-12T17:29:45.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:45.660+0000 7f4d1232e800 20 remove_watcher() i=5 2024-09-12T17:29:45.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:45.661+0000 7f4d1232e800 20 remove_watcher() i=6 2024-09-12T17:29:45.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:45.662+0000 7f4d1232e800 20 remove_watcher() i=7 2024-09-12T17:29:45.675 DEBUG:tasks.ragweed:Creating user sysuser.client.0 on client.0 2024-09-12T17:29:45.675 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid sysuser.client.0 --display-name 'Mr. sysuser.client.0' --access-key IPSJNLKKQCTGCKQMISRE --secret gI9e7iIbke5EDoy0JehWV5OwOq4TF0Zbk/HVnResDJ8fouT+RtWmbg== --email sysuser.client.0+test@test.test --system true 2024-09-12T17:29:45.743 INFO:teuthology.orchestra.run.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:29:45.744 INFO:teuthology.orchestra.run.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:29:45.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:45.778+0000 7f7c902b9800 20 rados->read ofs=0 len=0 2024-09-12T17:29:45.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:45.780+0000 7f7c902b9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:45.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:45.780+0000 7f7c902b9800 20 realm 2024-09-12T17:29:45.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:45.780+0000 7f7c902b9800 20 rados->read ofs=0 len=0 2024-09-12T17:29:45.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:45.780+0000 7f7c902b9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:45.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:45.780+0000 7f7c902b9800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:29:45.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:45.780+0000 7f7c902b9800 20 rados->read ofs=0 len=0 2024-09-12T17:29:45.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:45.780+0000 7f7c902b9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:45.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:45.780+0000 7f7c902b9800 20 rados->read ofs=0 len=0 2024-09-12T17:29:45.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:45.781+0000 7f7c902b9800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:29:45.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:45.781+0000 7f7c902b9800 20 rados->read ofs=0 len=0 2024-09-12T17:29:45.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:45.781+0000 7f7c902b9800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:29:45.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:45.781+0000 7f7c902b9800 20 searching for the correct realm 2024-09-12T17:29:45.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:45.784+0000 7f7c8d5a2640 0 -- 172.21.15.37:0/664589708 >> [v2:172.21.15.40:6800/2441293461,v1:172.21.15.40:6801/2441293461] conn(0x7f7c8007f030 msgr2=0x7f7c80092080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:29:45.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:45.788+0000 7f7c8dda3640 0 -- 172.21.15.37:0/664589708 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7f7c8405d040 msgr2=0x7f7c8405d420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:29:45.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:45.994+0000 7f7c902b9800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:29:45.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:45.994+0000 7f7c902b9800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:29:45.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:45.994+0000 7f7c902b9800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:29:45.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:45.994+0000 7f7c902b9800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:29:45.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:45.994+0000 7f7c902b9800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:29:45.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:45.994+0000 7f7c902b9800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:29:45.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:45.995+0000 7f7c902b9800 20 rados->read ofs=0 len=0 2024-09-12T17:29:45.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:45.995+0000 7f7c902b9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:45.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:45.995+0000 7f7c902b9800 20 rados->read ofs=0 len=0 2024-09-12T17:29:45.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:45.995+0000 7f7c902b9800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:29:45.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:45.995+0000 7f7c902b9800 20 rados->read ofs=0 len=0 2024-09-12T17:29:45.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:45.996+0000 7f7c902b9800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:29:45.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:45.996+0000 7f7c902b9800 20 zone default found 2024-09-12T17:29:45.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:45.996+0000 7f7c902b9800 4 Realm: () 2024-09-12T17:29:45.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:45.996+0000 7f7c902b9800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:29:45.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:45.996+0000 7f7c902b9800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:29:45.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:45.996+0000 7f7c902b9800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:29:45.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:45.996+0000 7f7c902b9800 20 zonegroup default 2024-09-12T17:29:45.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:45.996+0000 7f7c902b9800 20 rados->read ofs=0 len=0 2024-09-12T17:29:45.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:45.996+0000 7f7c902b9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:45.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:45.996+0000 7f7c902b9800 20 rados->read ofs=0 len=0 2024-09-12T17:29:45.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:45.996+0000 7f7c902b9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:45.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:45.996+0000 7f7c902b9800 20 rados->read ofs=0 len=0 2024-09-12T17:29:45.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:45.997+0000 7f7c902b9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:45.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:45.997+0000 7f7c902b9800 20 started sync module instance, tier type = 2024-09-12T17:29:45.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:45.997+0000 7f7c902b9800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:29:46.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:46.007+0000 7f7c902b9800 20 add_watcher() i=0 2024-09-12T17:29:46.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:46.007+0000 7f7c902b9800 20 add_watcher() i=1 2024-09-12T17:29:46.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:46.007+0000 7f7c902b9800 20 add_watcher() i=2 2024-09-12T17:29:46.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:46.007+0000 7f7c902b9800 20 add_watcher() i=3 2024-09-12T17:29:46.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:46.007+0000 7f7c902b9800 20 add_watcher() i=4 2024-09-12T17:29:46.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:46.007+0000 7f7c902b9800 20 add_watcher() i=5 2024-09-12T17:29:46.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:46.007+0000 7f7c902b9800 20 add_watcher() i=6 2024-09-12T17:29:46.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:46.008+0000 7f7c902b9800 20 add_watcher() i=7 2024-09-12T17:29:46.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:46.008+0000 7f7c902b9800 2 all 8 watchers are set, enabling cache 2024-09-12T17:29:46.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:46.009+0000 7f7b43fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:29:46.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:46.010+0000 7f7c902b9800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:29:46.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:46.010+0000 7f7c902b9800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:29:46.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:46.010+0000 7f7c902b9800 5 note: GC not initialized 2024-09-12T17:29:46.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:46.010+0000 7f7b42fe5640 20 reqs_thread_entry: start 2024-09-12T17:29:46.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:46.010+0000 7f7c902b9800 20 init_complete bucket index max shards: 11 2024-09-12T17:29:46.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:46.010+0000 7f7c902b9800 20 Filter name: none 2024-09-12T17:29:46.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:46.010+0000 7f7b40fe1640 20 reqs_thread_entry: start 2024-09-12T17:29:46.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:46.010+0000 7f7c902b9800 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : miss 2024-09-12T17:29:46.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:46.010+0000 7f7c902b9800 20 rados->read ofs=0 len=0 2024-09-12T17:29:46.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:46.011+0000 7f7c902b9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:46.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:46.011+0000 7f7c902b9800 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x0 2024-09-12T17:29:46.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:46.011+0000 7f7c902b9800 10 adding default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-12T17:29:46.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:46.011+0000 7f7c902b9800 10 cache get: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test : miss 2024-09-12T17:29:46.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:46.011+0000 7f7c902b9800 20 rados->read ofs=0 len=0 2024-09-12T17:29:46.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:46.011+0000 7f7c902b9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:46.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:46.011+0000 7f7c902b9800 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x0 2024-09-12T17:29:46.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:46.011+0000 7f7c902b9800 10 adding default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-09-12T17:29:46.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:46.011+0000 7f7c902b9800 10 cache get: name=default.rgw.meta+users.keys+IPSJNLKKQCTGCKQMISRE : miss 2024-09-12T17:29:46.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:46.011+0000 7f7c902b9800 20 rados->read ofs=0 len=0 2024-09-12T17:29:46.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:46.011+0000 7f7c902b9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:46.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:46.011+0000 7f7c902b9800 10 cache put: name=default.rgw.meta+users.keys+IPSJNLKKQCTGCKQMISRE info.flags=0x0 2024-09-12T17:29:46.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:46.011+0000 7f7c902b9800 10 adding default.rgw.meta+users.keys+IPSJNLKKQCTGCKQMISRE to cache LRU end 2024-09-12T17:29:46.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:46.011+0000 7f7c902b9800 10 cache get: name=default.rgw.meta+users.keys+IPSJNLKKQCTGCKQMISRE : hit (negative entry) 2024-09-12T17:29:46.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:46.011+0000 7f7c902b9800 10 cache get: name=default.rgw.meta+users.keys+IPSJNLKKQCTGCKQMISRE : hit (negative entry) 2024-09-12T17:29:46.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:46.013+0000 7f7c902b9800 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x17 2024-09-12T17:29:46.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:46.013+0000 7f7c902b9800 10 moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-12T17:29:46.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:46.013+0000 7f7c902b9800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:sysuser.client.0, ofs0, ns] 2024-09-12T17:29:46.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:46.013+0000 7f7b717fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1082331758607 cookie 94042564683424 notifier 5660 bl.length()=675 2024-09-12T17:29:46.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:46.013+0000 7f7b717fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x17 2024-09-12T17:29:46.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:46.013+0000 7f7b717fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-12T17:29:46.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:46.016+0000 7f7c902b9800 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x7 2024-09-12T17:29:46.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:46.016+0000 7f7c902b9800 10 moving default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-09-12T17:29:46.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:46.016+0000 7f7c902b9800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.email:sysuser.client.0+test@test.test, ofs0, ns] 2024-09-12T17:29:46.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:46.017+0000 7f7b717fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1082331758659 cookie 94042564691008 notifier 5660 bl.length()=202 2024-09-12T17:29:46.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:46.017+0000 7f7b717fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x7 2024-09-12T17:29:46.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:46.017+0000 7f7b717fa640 10 rgw watcher librados: moving default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-09-12T17:29:46.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:46.020+0000 7f7c902b9800 10 cache put: name=default.rgw.meta+users.keys+IPSJNLKKQCTGCKQMISRE info.flags=0x7 2024-09-12T17:29:46.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:46.020+0000 7f7c902b9800 10 moving default.rgw.meta+users.keys+IPSJNLKKQCTGCKQMISRE to cache LRU end 2024-09-12T17:29:46.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:46.020+0000 7f7c902b9800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.keys:IPSJNLKKQCTGCKQMISRE, ofs0, ns] 2024-09-12T17:29:46.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:46.020+0000 7f7b70ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1082331758660 cookie 94042564673440 notifier 5660 bl.length()=190 2024-09-12T17:29:46.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:46.020+0000 7f7b70ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+IPSJNLKKQCTGCKQMISRE info.flags=0x7 2024-09-12T17:29:46.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:46.020+0000 7f7b70ff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+IPSJNLKKQCTGCKQMISRE to cache LRU end 2024-09-12T17:29:46.022 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-09-12T17:29:46.022 INFO:teuthology.orchestra.run.smithi037.stdout: "user_id": "sysuser.client.0", 2024-09-12T17:29:46.023 INFO:teuthology.orchestra.run.smithi037.stdout: "display_name": "Mr. sysuser.client.0", 2024-09-12T17:29:46.023 INFO:teuthology.orchestra.run.smithi037.stdout: "email": "sysuser.client.0+test@test.test", 2024-09-12T17:29:46.023 INFO:teuthology.orchestra.run.smithi037.stdout: "suspended": 0, 2024-09-12T17:29:46.023 INFO:teuthology.orchestra.run.smithi037.stdout: "max_buckets": 1000, 2024-09-12T17:29:46.023 INFO:teuthology.orchestra.run.smithi037.stdout: "subusers": [], 2024-09-12T17:29:46.023 INFO:teuthology.orchestra.run.smithi037.stdout: "keys": [ 2024-09-12T17:29:46.023 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-12T17:29:46.023 INFO:teuthology.orchestra.run.smithi037.stdout: "user": "sysuser.client.0", 2024-09-12T17:29:46.023 INFO:teuthology.orchestra.run.smithi037.stdout: "access_key": "IPSJNLKKQCTGCKQMISRE", 2024-09-12T17:29:46.023 INFO:teuthology.orchestra.run.smithi037.stdout: "secret_key": "gI9e7iIbke5EDoy0JehWV5OwOq4TF0Zbk/HVnResDJ8fouT+RtWmbg==", 2024-09-12T17:29:46.023 INFO:teuthology.orchestra.run.smithi037.stdout: "active": true, 2024-09-12T17:29:46.023 INFO:teuthology.orchestra.run.smithi037.stdout: "create_date": "2024-09-12T17:29:46.012635Z" 2024-09-12T17:29:46.023 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-12T17:29:46.024 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-12T17:29:46.024 INFO:teuthology.orchestra.run.smithi037.stdout: "swift_keys": [], 2024-09-12T17:29:46.024 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": [], 2024-09-12T17:29:46.024 INFO:teuthology.orchestra.run.smithi037.stdout: "op_mask": "read, write, delete", 2024-09-12T17:29:46.024 INFO:teuthology.orchestra.run.smithi037.stdout: "system": true, 2024-09-12T17:29:46.024 INFO:teuthology.orchestra.run.smithi037.stdout: "default_placement": "", 2024-09-12T17:29:46.024 INFO:teuthology.orchestra.run.smithi037.stdout: "default_storage_class": "", 2024-09-12T17:29:46.024 INFO:teuthology.orchestra.run.smithi037.stdout: "placement_tags": [], 2024-09-12T17:29:46.024 INFO:teuthology.orchestra.run.smithi037.stdout: "bucket_quota": { 2024-09-12T17:29:46.024 INFO:teuthology.orchestra.run.smithi037.stdout: "enabled": false, 2024-09-12T17:29:46.024 INFO:teuthology.orchestra.run.smithi037.stdout: "check_on_raw": false, 2024-09-12T17:29:46.024 INFO:teuthology.orchestra.run.smithi037.stdout: "max_size": -1, 2024-09-12T17:29:46.024 INFO:teuthology.orchestra.run.smithi037.stdout: "max_size_kb": 0, 2024-09-12T17:29:46.025 INFO:teuthology.orchestra.run.smithi037.stdout: "max_objects": -1 2024-09-12T17:29:46.025 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-12T17:29:46.025 INFO:teuthology.orchestra.run.smithi037.stdout: "user_quota": { 2024-09-12T17:29:46.025 INFO:teuthology.orchestra.run.smithi037.stdout: "enabled": false, 2024-09-12T17:29:46.025 INFO:teuthology.orchestra.run.smithi037.stdout: "check_on_raw": false, 2024-09-12T17:29:46.025 INFO:teuthology.orchestra.run.smithi037.stdout: "max_size": -1, 2024-09-12T17:29:46.025 INFO:teuthology.orchestra.run.smithi037.stdout: "max_size_kb": 0, 2024-09-12T17:29:46.025 INFO:teuthology.orchestra.run.smithi037.stdout: "max_objects": -1 2024-09-12T17:29:46.025 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-12T17:29:46.025 INFO:teuthology.orchestra.run.smithi037.stdout: "temp_url_keys": [], 2024-09-12T17:29:46.025 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "rgw", 2024-09-12T17:29:46.025 INFO:teuthology.orchestra.run.smithi037.stdout: "mfa_ids": [], 2024-09-12T17:29:46.025 INFO:teuthology.orchestra.run.smithi037.stdout: "account_id": "", 2024-09-12T17:29:46.025 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-09-12T17:29:46.026 INFO:teuthology.orchestra.run.smithi037.stdout: "create_date": "2024-09-12T17:29:46.012625Z", 2024-09-12T17:29:46.026 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-12T17:29:46.026 INFO:teuthology.orchestra.run.smithi037.stdout: "group_ids": [] 2024-09-12T17:29:46.026 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-09-12T17:29:46.026 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:29:46.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:46.023+0000 7f7b43fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:29:46.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:46.025+0000 7f7c902b9800 20 remove_watcher() i=0 2024-09-12T17:29:46.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:46.025+0000 7f7c902b9800 2 removed watcher, disabling cache 2024-09-12T17:29:46.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:46.026+0000 7f7c902b9800 20 remove_watcher() i=1 2024-09-12T17:29:46.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:46.027+0000 7f7c902b9800 20 remove_watcher() i=2 2024-09-12T17:29:46.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:46.029+0000 7f7c902b9800 20 remove_watcher() i=3 2024-09-12T17:29:46.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:46.030+0000 7f7c902b9800 20 remove_watcher() i=4 2024-09-12T17:29:46.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:46.031+0000 7f7c902b9800 20 remove_watcher() i=5 2024-09-12T17:29:46.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:46.032+0000 7f7c902b9800 20 remove_watcher() i=6 2024-09-12T17:29:46.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:29:46.033+0000 7f7c902b9800 20 remove_watcher() i=7 2024-09-12T17:29:46.045 INFO:tasks.ragweed:Configuring ragweed... 2024-09-12T17:29:46.046 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-09-12T17:29:46.046 DEBUG:teuthology.orchestra.run.smithi037:> dd of=/home/ubuntu/cephtest/archive/ragweed.client.0.conf 2024-09-12T17:29:46.076 INFO:tasks.ragweed:Configuring boto... 2024-09-12T17:29:46.076 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-09-12T17:29:46.076 DEBUG:teuthology.orchestra.run.smithi037:> dd of=/home/ubuntu/cephtest/boto.cfg 2024-09-12T17:29:46.145 DEBUG:teuthology.orchestra.run.smithi037:ragweed tests against rgw> source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/ragweed.client.0 && RAGWEED_CONF=/home/ubuntu/cephtest/archive/ragweed.client.0.conf RAGWEED_STAGES=prepare,check BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg tox --sitepackages -- -v -m 'not fails_on_rgw' 2024-09-12T17:29:46.338 INFO:teuthology.orchestra.run.smithi037.stdout:GLOB sdist-make: /home/ubuntu/cephtest/ragweed.client.0/setup.py 2024-09-12T17:29:46.513 INFO:teuthology.orchestra.run.smithi037.stdout:py create: /home/ubuntu/cephtest/ragweed.client.0/.tox/py 2024-09-12T17:29:47.056 INFO:teuthology.orchestra.run.smithi037.stdout:py installdeps: -rrequirements.txt 2024-09-12T17:29:53.500 INFO:teuthology.orchestra.run.smithi037.stdout:py inst: /home/ubuntu/cephtest/ragweed.client.0/.tox/.tmp/package/1/ragweed-0.0.1.zip 2024-09-12T17:29:57.159 INFO:teuthology.orchestra.run.smithi037.stdout:py installed: asyncssh==2.13.2,Babel==2.9.1,bcrypt==3.2.2,boto==2.49.0,cachetools==4.2.4,ceph==1.0.0,ceph-volume==1.0.0,cephfs==2.0.0,certifi==2023.5.7,cffi==1.14.5,chardet==4.0.0,cheroot==8.6.0,CherryPy==18.6.1,cockpit @ file:///builddir/build/BUILD/cockpit-323/tmp/wheel/cockpit-323-py3-none-any.whl,cryptography==36.0.1,dasbus==1.4,dbus-python==1.2.18,distro==1.5.0,docopt==0.6.2,exceptiongroup==1.2.2,execnet==2.1.1,file-magic==0.4.0,gevent==24.2.1,google-auth==2.34.0,gpg==1.15.1,greenlet==3.1.0,grpcio==1.46.7,grpcio-tools==1.46.7,httplib2==0.22.0,idna==2.10,iniconfig==2.0.0,isodate==0.6.1,jaraco.classes==3.2.1,jaraco.collections==3.0.0,jaraco.functools==3.5.0,jaraco.text==3.2.0,Jinja2==2.11.3,jsonpatch==1.21,jsonpointer==2.0,kubernetes==26.1.0,libcomps==0.1.18,logutils==0.3.5,lxml==4.6.5,Mako==1.1.4.dev0,MarkupSafe==1.1.1,more-itertools==8.12.0,munch==4.0.0,natsort==7.1.1,nftables==0.1,numpy==1.20.1,oauthlib==3.1.1,packaging==20.9,pecan==1.4.2,perf==0.1,pexpect==4.8.0,pluggy==1.5.0,ply==3.11,portend==3.1.0,prettytable==0.7.2,protobuf==3.14.0,psutil==5.8.0,ptyprocess==0.6.0,pyasn1==0.4.8,pyasn1-modules==0.2.8,pycparser==2.20,PyGObject==3.40.1,pyOpenSSL==21.0.0,pyparsing==2.4.7,PySocks==1.7.1,pytest==8.3.3,python-dateutil==2.8.1,python-linux-procfs==0.7.3,pytz==2021.1,pyudev==0.22.0,PyYAML==5.4.1,rados==2.0.0,ragweed @ file:///home/ubuntu/cephtest/ragweed.client.0/.tox/.tmp/package/1/ragweed-0.0.1.zip#sha256=f943a082e387988fc584d0348213499b8818121bfbb8656d4febe32cf4e6860e,rbd==2.0.0,registries-conf-ctl==1.0,remoto==1.2.1,repoze.lru==0.7,requests==2.25.1,requests-oauthlib==1.3.0,rgw==2.0.0,Routes==2.5.1,rpm==4.16.1.3,rsa==4.9,s3cmd==2.4.0,scipy==1.6.2,selinux==3.6,sepolicy==3.6,setools==4.4.4,setroubleshoot @ file:///builddir/build/BUILD/setroubleshoot-3.3.32/src,six==1.15.0,systemd-python==234,tempora==5.0.0,toml==0.10.2,tomli==2.0.1,typing_extensions==4.12.2,urllib3==1.26.5,WebOb==1.8.8,websocket-client==1.2.3,Werkzeug==2.0.3,zc.lockfile==2.0,zope.event==5.0,zope.interface==7.0.3 2024-09-12T17:29:57.159 INFO:teuthology.orchestra.run.smithi037.stdout:py run-test-pre: PYTHONHASHSEED='604490908' 2024-09-12T17:29:57.160 INFO:teuthology.orchestra.run.smithi037.stdout:py run-test: commands[0] | python -m pytest -v -m 'not fails_on_rgw' 2024-09-12T17:29:57.365 INFO:teuthology.orchestra.run.smithi037.stdout:============================= test session starts ============================== 2024-09-12T17:29:57.365 INFO:teuthology.orchestra.run.smithi037.stdout:platform linux -- Python 3.9.19, pytest-8.3.3, pluggy-1.5.0 -- /home/ubuntu/cephtest/ragweed.client.0/.tox/py/bin/python 2024-09-12T17:29:57.365 INFO:teuthology.orchestra.run.smithi037.stdout:cachedir: .tox/py/.pytest_cache 2024-09-12T17:29:57.365 INFO:teuthology.orchestra.run.smithi037.stdout:rootdir: /home/ubuntu/cephtest/ragweed.client.0 2024-09-12T17:29:57.365 INFO:teuthology.orchestra.run.smithi037.stdout:configfile: pytest.ini 2024-09-12T17:29:57.466 INFO:teuthology.orchestra.run.smithi037.stdout:collecting ... collected 9 items 2024-09-12T17:29:57.467 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:29:59.792 INFO:teuthology.orchestra.run.smithi037.stdout:ragweed/tests/tests.py::r_test_small_obj_data::test PASSED [ 11%] 2024-09-12T17:30:01.945 INFO:teuthology.orchestra.run.smithi037.stdout:ragweed/tests/tests.py::r_test_multipart_simple::test PASSED [ 22%] 2024-09-12T17:30:05.278 INFO:teuthology.orchestra.run.smithi037.stdout:ragweed/tests/tests.py::r_test_multipart_index_versioning::test PASSED [ 33%] 2024-09-12T17:30:07.494 INFO:teuthology.orchestra.run.smithi037.stdout:ragweed/tests/tests.py::r_test_multipart_defer_complete::test PASSED [ 44%] 2024-09-12T17:30:11.298 INFO:teuthology.orchestra.run.smithi037.stdout:ragweed/tests/tests.py::r_test_multipart_defer_update_complete::test PASSED [ 55%] 2024-09-12T17:30:20.093 INFO:teuthology.orchestra.run.smithi037.stdout:ragweed/tests/tests.py::r_test_obj_storage_class::test PASSED [ 66%] 2024-09-12T17:30:24.979 INFO:teuthology.orchestra.run.smithi037.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_multipart::test PASSED [ 77%] 2024-09-12T17:30:29.652 INFO:teuthology.orchestra.run.smithi037.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_copy::test PASSED [ 88%] 2024-09-12T17:30:39.725 INFO:teuthology.orchestra.run.smithi037.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_multipart_copy::test PASSED [100%] 2024-09-12T17:30:39.725 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:30:39.725 INFO:teuthology.orchestra.run.smithi037.stdout:=============================== warnings summary =============================== 2024-09-12T17:30:39.725 INFO:teuthology.orchestra.run.smithi037.stdout:.tox/py/lib/python3.9/site-packages/boto/plugin.py:40 2024-09-12T17:30:39.725 INFO:teuthology.orchestra.run.smithi037.stdout: /home/ubuntu/cephtest/ragweed.client.0/.tox/py/lib/python3.9/site-packages/boto/plugin.py:40: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses 2024-09-12T17:30:39.725 INFO:teuthology.orchestra.run.smithi037.stdout: import imp 2024-09-12T17:30:39.725 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:30:39.725 INFO:teuthology.orchestra.run.smithi037.stdout:-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html 2024-09-12T17:30:39.726 INFO:teuthology.orchestra.run.smithi037.stdout:======================== 9 passed, 1 warning in 42.36s ========================= 2024-09-12T17:30:39.756 INFO:teuthology.orchestra.run.smithi037.stdout:___________________________________ summary ____________________________________ 2024-09-12T17:30:39.756 INFO:teuthology.orchestra.run.smithi037.stdout: py: commands succeeded 2024-09-12T17:30:39.756 INFO:teuthology.orchestra.run.smithi037.stdout: congratulations :) 2024-09-12T17:30:39.775 INFO:tasks.ragweed:Cleaning up boto... 2024-09-12T17:30:39.775 DEBUG:teuthology.orchestra.run.smithi037:> rm -f /home/ubuntu/cephtest/boto.cfg 2024-09-12T17:30:39.805 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid ragweed.client.0 --purge-data 2024-09-12T17:30:39.904 INFO:teuthology.orchestra.run.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:30:39.904 INFO:teuthology.orchestra.run.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:30:39.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:39.939+0000 7f893de30800 20 rados->read ofs=0 len=0 2024-09-12T17:30:39.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:39.940+0000 7f893de30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:39.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:39.940+0000 7f893de30800 20 realm 2024-09-12T17:30:39.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:39.940+0000 7f893de30800 20 rados->read ofs=0 len=0 2024-09-12T17:30:39.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:39.940+0000 7f893de30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:39.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:39.940+0000 7f893de30800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:30:39.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:39.940+0000 7f893de30800 20 rados->read ofs=0 len=0 2024-09-12T17:30:39.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:39.940+0000 7f893de30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:39.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:39.940+0000 7f893de30800 20 rados->read ofs=0 len=0 2024-09-12T17:30:39.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:39.941+0000 7f893de30800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:30:39.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:39.941+0000 7f893de30800 20 rados->read ofs=0 len=0 2024-09-12T17:30:39.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:39.942+0000 7f893de30800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:30:39.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:39.942+0000 7f893de30800 20 searching for the correct realm 2024-09-12T17:30:39.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:39.945+0000 7f8938952640 0 -- 172.21.15.37:0/3068637501 >> [v2:172.21.15.37:6816/2964054205,v1:172.21.15.37:6817/2964054205] conn(0x55891d698f30 msgr2=0x55891d69b3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:30:39.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:39.949+0000 7f8939153640 0 -- 172.21.15.37:0/3068637501 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7f8930012610 msgr2=0x7f8930094110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:30:39.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:39.954+0000 7f893de30800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:30:39.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:39.954+0000 7f893de30800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:30:39.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:39.954+0000 7f893de30800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:30:39.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:39.954+0000 7f893de30800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:30:39.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:39.954+0000 7f893de30800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:30:39.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:39.954+0000 7f893de30800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:30:39.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:39.954+0000 7f893de30800 20 rados->read ofs=0 len=0 2024-09-12T17:30:39.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:39.954+0000 7f893de30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:39.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:39.954+0000 7f893de30800 20 rados->read ofs=0 len=0 2024-09-12T17:30:39.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:39.955+0000 7f893de30800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:30:39.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:39.955+0000 7f893de30800 20 rados->read ofs=0 len=0 2024-09-12T17:30:39.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:39.955+0000 7f893de30800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:30:39.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:39.955+0000 7f893de30800 20 zone default found 2024-09-12T17:30:39.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:39.955+0000 7f893de30800 4 Realm: () 2024-09-12T17:30:39.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:39.955+0000 7f893de30800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:30:39.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:39.955+0000 7f893de30800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:30:39.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:39.955+0000 7f893de30800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:30:39.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:39.955+0000 7f893de30800 20 zonegroup default 2024-09-12T17:30:39.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:39.955+0000 7f893de30800 20 rados->read ofs=0 len=0 2024-09-12T17:30:39.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:39.955+0000 7f893de30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:39.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:39.955+0000 7f893de30800 20 rados->read ofs=0 len=0 2024-09-12T17:30:39.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:39.956+0000 7f893de30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:39.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:39.956+0000 7f893de30800 20 rados->read ofs=0 len=0 2024-09-12T17:30:39.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:39.956+0000 7f893de30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:39.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:39.956+0000 7f893de30800 20 started sync module instance, tier type = 2024-09-12T17:30:39.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:39.956+0000 7f893de30800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:30:39.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:39.966+0000 7f893de30800 20 add_watcher() i=0 2024-09-12T17:30:39.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:39.966+0000 7f893de30800 20 add_watcher() i=1 2024-09-12T17:30:39.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:39.966+0000 7f893de30800 20 add_watcher() i=2 2024-09-12T17:30:39.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:39.966+0000 7f893de30800 20 add_watcher() i=3 2024-09-12T17:30:39.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:39.966+0000 7f893de30800 20 add_watcher() i=4 2024-09-12T17:30:39.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:39.966+0000 7f893de30800 20 add_watcher() i=5 2024-09-12T17:30:39.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:39.966+0000 7f893de30800 20 add_watcher() i=6 2024-09-12T17:30:39.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:39.967+0000 7f893de30800 20 add_watcher() i=7 2024-09-12T17:30:39.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:39.967+0000 7f893de30800 2 all 8 watchers are set, enabling cache 2024-09-12T17:30:39.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:39.968+0000 7f87ef7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:30:39.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:39.968+0000 7f893de30800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:30:39.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:39.968+0000 7f893de30800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:30:40.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.007+0000 7f87ee7e4640 20 reqs_thread_entry: start 2024-09-12T17:30:40.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.007+0000 7f893de30800 20 init_complete bucket index max shards: 11 2024-09-12T17:30:40.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.007+0000 7f893de30800 20 Filter name: none 2024-09-12T17:30:40.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.007+0000 7f875ffff640 20 reqs_thread_entry: start 2024-09-12T17:30:40.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.008+0000 7f893de30800 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : miss 2024-09-12T17:30:40.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.008+0000 7f893de30800 20 rados->read ofs=0 len=0 2024-09-12T17:30:40.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.008+0000 7f893de30800 20 rados_obj.operate() r=0 bl.length=486 2024-09-12T17:30:40.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.008+0000 7f893de30800 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x13 2024-09-12T17:30:40.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.008+0000 7f893de30800 10 adding default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-12T17:30:40.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.008+0000 7f893de30800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:30:40.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.009+0000 7f893de30800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.5 : miss 2024-09-12T17:30:40.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.009+0000 7f893de30800 20 rados->read ofs=0 len=0 2024-09-12T17:30:40.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.009+0000 7f893de30800 20 rados_obj.operate() r=0 bl.length=426 2024-09-12T17:30:40.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.009+0000 7f893de30800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.5 info.flags=0x17 2024-09-12T17:30:40.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.009+0000 7f893de30800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-conf:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.5 to cache LRU end 2024-09-12T17:30:40.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.009+0000 7f893de30800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:30:40.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.009+0000 7f893de30800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T17:30:40.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.009+0000 7f893de30800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-conf:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.5 2024-09-12T17:30:40.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.010+0000 7f893de30800 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_multipart_copy 2024-09-12T17:30:40.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.011+0000 7f893de30800 10 cls_bucket_list_unordered: got tests/r_test_multipart_index_versioning 2024-09-12T17:30:40.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.011+0000 7f893de30800 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_copy 2024-09-12T17:30:40.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.011+0000 7f893de30800 10 cls_bucket_list_unordered: got tests/r_test_multipart_defer_update_complete 2024-09-12T17:30:40.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.012+0000 7f893de30800 10 cls_bucket_list_unordered: got tests/r_test_multipart_defer_complete 2024-09-12T17:30:40.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.012+0000 7f893de30800 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class 2024-09-12T17:30:40.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.012+0000 7f893de30800 10 cls_bucket_list_unordered: got tests/r_test_multipart_simple 2024-09-12T17:30:40.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.013+0000 7f893de30800 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_multipart 2024-09-12T17:30:40.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.014+0000 7f893de30800 10 cls_bucket_list_unordered: got tests/r_test_small_obj_data 2024-09-12T17:30:40.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.015+0000 7f893de30800 20 get_obj_state: octx=0x55891d4bbc30 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart_copy state=0x55891d759718 s->prefetch_data=0 2024-09-12T17:30:40.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.015+0000 7f893de30800 10 manifest: total_size = 7735 2024-09-12T17:30:40.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.015+0000 7f893de30800 20 get_obj_state: setting s->obj_tag to 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18365888766079008665 2024-09-12T17:30:40.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.015+0000 7f893de30800 20 get_obj_state: octx=0x55891d4bbc30 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart_copy state=0x55891d759718 s->prefetch_data=0 2024-09-12T17:30:40.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.015+0000 7f893de30800 20 prepare_atomic_modification: state is not atomic. state=0x55891d759718 2024-09-12T17:30:40.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.015+0000 7f893de30800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.5.1 2024-09-12T17:30:40.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.018+0000 7f893de30800 20 get_obj_state: octx=0x55891d4bbc30 obj=test-client.0-conf:tests/r_test_multipart_index_versioning state=0x55891d7596d8 s->prefetch_data=0 2024-09-12T17:30:40.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.019+0000 7f893de30800 10 manifest: total_size = 5100 2024-09-12T17:30:40.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.019+0000 7f893de30800 20 get_obj_state: setting s->obj_tag to 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.12322836849154885272 2024-09-12T17:30:40.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.019+0000 7f893de30800 20 get_obj_state: octx=0x55891d4bbc30 obj=test-client.0-conf:tests/r_test_multipart_index_versioning state=0x55891d7596d8 s->prefetch_data=0 2024-09-12T17:30:40.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.019+0000 7f893de30800 20 prepare_atomic_modification: state is not atomic. state=0x55891d7596d8 2024-09-12T17:30:40.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.019+0000 7f893de30800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.5.2 2024-09-12T17:30:40.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.019+0000 7f881cff9640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_multipart_copy 2024-09-12T17:30:40.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.022+0000 7f893de30800 20 get_obj_state: octx=0x55891d4bbc30 obj=test-client.0-conf:tests/r_test_obj_storage_class_copy state=0x55891d7596d8 s->prefetch_data=0 2024-09-12T17:30:40.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.022+0000 7f893de30800 10 manifest: total_size = 7727 2024-09-12T17:30:40.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.022+0000 7f893de30800 20 get_obj_state: setting s->obj_tag to 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.4419058384607206419 2024-09-12T17:30:40.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.022+0000 7f893de30800 20 get_obj_state: octx=0x55891d4bbc30 obj=test-client.0-conf:tests/r_test_obj_storage_class_copy state=0x55891d7596d8 s->prefetch_data=0 2024-09-12T17:30:40.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.022+0000 7f893de30800 20 prepare_atomic_modification: state is not atomic. state=0x55891d7596d8 2024-09-12T17:30:40.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.022+0000 7f893de30800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.5.2 2024-09-12T17:30:40.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.023+0000 7f880bfff640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_index_versioning 2024-09-12T17:30:40.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.025+0000 7f893de30800 20 get_obj_state: octx=0x7f893000ae00 obj=test-client.0-conf:tests/r_test_multipart_defer_update_complete state=0x55891d7596d8 s->prefetch_data=0 2024-09-12T17:30:40.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.026+0000 7f893de30800 10 manifest: total_size = 7557 2024-09-12T17:30:40.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.026+0000 7f893de30800 20 get_obj_state: setting s->obj_tag to 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.3403991595096396148 2024-09-12T17:30:40.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.026+0000 7f893de30800 20 get_obj_state: octx=0x7f893000ae00 obj=test-client.0-conf:tests/r_test_multipart_defer_update_complete state=0x55891d7596d8 s->prefetch_data=0 2024-09-12T17:30:40.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.026+0000 7f893de30800 20 prepare_atomic_modification: state is not atomic. state=0x55891d7596d8 2024-09-12T17:30:40.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.026+0000 7f893de30800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.5.3 2024-09-12T17:30:40.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.026+0000 7f881cff9640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_copy 2024-09-12T17:30:40.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.028+0000 7f893de30800 20 get_obj_state: octx=0x7f892c06fc10 obj=test-client.0-conf:tests/r_test_multipart_defer_complete state=0x55891d7596d8 s->prefetch_data=0 2024-09-12T17:30:40.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.029+0000 7f893de30800 10 manifest: total_size = 13073 2024-09-12T17:30:40.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.029+0000 7f893de30800 20 get_obj_state: setting s->obj_tag to 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.15581001371558670012 2024-09-12T17:30:40.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.029+0000 7f893de30800 20 get_obj_state: octx=0x7f892c06fc10 obj=test-client.0-conf:tests/r_test_multipart_defer_complete state=0x55891d7596d8 s->prefetch_data=0 2024-09-12T17:30:40.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.029+0000 7f893de30800 20 prepare_atomic_modification: state is not atomic. state=0x55891d7596d8 2024-09-12T17:30:40.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.029+0000 7f893de30800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.5.4 2024-09-12T17:30:40.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.030+0000 7f880bfff640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_defer_update_complete 2024-09-12T17:30:40.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.032+0000 7f893de30800 20 get_obj_state: octx=0x7f8930011f00 obj=test-client.0-conf:tests/r_test_obj_storage_class state=0x55891d7596d8 s->prefetch_data=0 2024-09-12T17:30:40.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.032+0000 7f893de30800 10 manifest: total_size = 5203 2024-09-12T17:30:40.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.032+0000 7f893de30800 20 get_obj_state: setting s->obj_tag to 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.13948275855436798764 2024-09-12T17:30:40.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.032+0000 7f893de30800 20 get_obj_state: octx=0x7f8930011f00 obj=test-client.0-conf:tests/r_test_obj_storage_class state=0x55891d7596d8 s->prefetch_data=0 2024-09-12T17:30:40.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.032+0000 7f893de30800 20 prepare_atomic_modification: state is not atomic. state=0x55891d7596d8 2024-09-12T17:30:40.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.032+0000 7f893de30800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.5.4 2024-09-12T17:30:40.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.033+0000 7f881cff9640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_defer_complete 2024-09-12T17:30:40.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.035+0000 7f893de30800 20 get_obj_state: octx=0x7f8934006620 obj=test-client.0-conf:tests/r_test_multipart_simple state=0x55891d7596d8 s->prefetch_data=0 2024-09-12T17:30:40.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.035+0000 7f893de30800 10 manifest: total_size = 4871 2024-09-12T17:30:40.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.035+0000 7f893de30800 20 get_obj_state: setting s->obj_tag to 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.14136613221441760182 2024-09-12T17:30:40.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.035+0000 7f893de30800 20 get_obj_state: octx=0x7f8934006620 obj=test-client.0-conf:tests/r_test_multipart_simple state=0x55891d7596d8 s->prefetch_data=0 2024-09-12T17:30:40.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.035+0000 7f893de30800 20 prepare_atomic_modification: state is not atomic. state=0x55891d7596d8 2024-09-12T17:30:40.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.035+0000 7f893de30800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.5.5 2024-09-12T17:30:40.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.036+0000 7f880bfff640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class 2024-09-12T17:30:40.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.039+0000 7f893de30800 20 get_obj_state: octx=0x7f892c06fc10 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart state=0x55891d7596d8 s->prefetch_data=0 2024-09-12T17:30:40.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.039+0000 7f893de30800 10 manifest: total_size = 7888 2024-09-12T17:30:40.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.039+0000 7f893de30800 20 get_obj_state: setting s->obj_tag to 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.9306740663051040094 2024-09-12T17:30:40.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.039+0000 7f893de30800 20 get_obj_state: octx=0x7f892c06fc10 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart state=0x55891d7596d8 s->prefetch_data=0 2024-09-12T17:30:40.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.039+0000 7f893de30800 20 prepare_atomic_modification: state is not atomic. state=0x55891d7596d8 2024-09-12T17:30:40.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.039+0000 7f893de30800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.5.7 2024-09-12T17:30:40.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.041+0000 7f881cff9640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_simple 2024-09-12T17:30:40.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.041+0000 7f893de30800 20 get_obj_state: octx=0x7f892c06fc10 obj=test-client.0-conf:tests/r_test_small_obj_data state=0x55891d7591c8 s->prefetch_data=0 2024-09-12T17:30:40.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.042+0000 7f893de30800 10 manifest: total_size = 7739 2024-09-12T17:30:40.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.042+0000 7f893de30800 20 get_obj_state: setting s->obj_tag to 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.8208328489741485997 2024-09-12T17:30:40.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.042+0000 7f893de30800 20 get_obj_state: octx=0x7f892c06fc10 obj=test-client.0-conf:tests/r_test_small_obj_data state=0x55891d7591c8 s->prefetch_data=0 2024-09-12T17:30:40.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.042+0000 7f893de30800 20 prepare_atomic_modification: state is not atomic. state=0x55891d7591c8 2024-09-12T17:30:40.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.042+0000 7f893de30800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.5.8 2024-09-12T17:30:40.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.043+0000 7f880bfff640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_multipart 2024-09-12T17:30:40.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.045+0000 7f893de30800 20 list_objects_ordered: starting attempt 1 2024-09-12T17:30:40.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.045+0000 7f893de30800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T17:30:40.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.046+0000 7f880bfff640 20 handle_completion(): completion ok for obj=tests/r_test_small_obj_data 2024-09-12T17:30:40.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.046+0000 7f893de30800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T17:30:40.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.046+0000 7f893de30800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T17:30:40.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.046+0000 7f893de30800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T17:30:40.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.046+0000 7f893de30800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T17:30:40.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.046+0000 7f893de30800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-conf[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.5])"; uploads.size()=0; is_truncated=0 2024-09-12T17:30:40.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.048+0000 7f893de30800 10 cache get: name=default.rgw.meta+root+test-client.0-conf : miss 2024-09-12T17:30:40.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.048+0000 7f893de30800 20 rados->read ofs=0 len=0 2024-09-12T17:30:40.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.048+0000 7f893de30800 20 rados_obj.operate() r=0 bl.length=204 2024-09-12T17:30:40.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.048+0000 7f893de30800 10 cache put: name=default.rgw.meta+root+test-client.0-conf info.flags=0x11 2024-09-12T17:30:40.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.048+0000 7f893de30800 10 adding default.rgw.meta+root+test-client.0-conf to cache LRU end 2024-09-12T17:30:40.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.049+0000 7f893de30800 10 removing default.rgw.meta+root+test-client.0-conf from cache 2024-09-12T17:30:40.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.049+0000 7f893de30800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-conf, ofs0, ns] 2024-09-12T17:30:40.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.050+0000 7f880bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562442 cookie 94047392345040 notifier 5684 bl.length()=162 2024-09-12T17:30:40.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.053+0000 7f893de30800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-conf:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.5 from cache 2024-09-12T17:30:40.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.053+0000 7f893de30800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-conf:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.5, ofs0, ns] 2024-09-12T17:30:40.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.053+0000 7f880bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562375 cookie 94047392369744 notifier 5684 bl.length()=219 2024-09-12T17:30:40.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.056+0000 7f893de30800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-conf/722b129a-cf7a-4aca-b594-5b9492d130e2.4623.5 : miss 2024-09-12T17:30:40.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.056+0000 7f893de30800 20 rados->read ofs=0 len=0 2024-09-12T17:30:40.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.057+0000 7f893de30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:40.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.057+0000 7f893de30800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-conf/722b129a-cf7a-4aca-b594-5b9492d130e2.4623.5 info.flags=0x0 2024-09-12T17:30:40.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.057+0000 7f893de30800 10 adding default.rgw.log++pubsub..bucket.test-client.0-conf/722b129a-cf7a-4aca-b594-5b9492d130e2.4623.5 to cache LRU end 2024-09-12T17:30:40.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.059+0000 7f893de30800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.12 : miss 2024-09-12T17:30:40.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.059+0000 7f893de30800 20 rados->read ofs=0 len=0 2024-09-12T17:30:40.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.059+0000 7f893de30800 20 rados_obj.operate() r=0 bl.length=457 2024-09-12T17:30:40.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.059+0000 7f893de30800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.12 info.flags=0x17 2024-09-12T17:30:40.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.059+0000 7f893de30800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.12 to cache LRU end 2024-09-12T17:30:40.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.059+0000 7f893de30800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:30:40.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.059+0000 7f893de30800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T17:30:40.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.059+0000 7f893de30800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.12 2024-09-12T17:30:40.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.064+0000 7f893de30800 10 cls_bucket_list_unordered: got foo 2024-09-12T17:30:40.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.064+0000 7f893de30800 20 get_obj_state: octx=0x7f893001e510 obj=test-client.0-r-test-multipart-defer-complete.1:foo state=0x55891d6e5258 s->prefetch_data=0 2024-09-12T17:30:40.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.064+0000 7f893de30800 10 manifest: total_size = 74198 2024-09-12T17:30:40.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.064+0000 7f893de30800 20 get_obj_state: setting s->obj_tag to 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.1027369559759265534 2024-09-12T17:30:40.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.064+0000 7f893de30800 20 get_obj_state: octx=0x7f893001e510 obj=test-client.0-r-test-multipart-defer-complete.1:foo state=0x55891d6e5258 s->prefetch_data=0 2024-09-12T17:30:40.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.064+0000 7f893de30800 20 prepare_atomic_modification: state is not atomic. state=0x55891d6e5258 2024-09-12T17:30:40.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.064+0000 7f893de30800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.12.10 2024-09-12T17:30:40.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.067+0000 7f893de30800 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-12T17:30:40.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.067+0000 7f893de30800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=20613 2024-09-12T17:30:40.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.067+0000 7f893de30800 20 RGWObjManifest::operator++(): result: ofs=20613 stripe_ofs=20613 part_ofs=20613 rule->part_size=20613 2024-09-12T17:30:40.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.067+0000 7f893de30800 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-12T17:30:40.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.067+0000 7f893de30800 20 RGWObjManifest::operator++(): stripe_ofs=6312069 part_ofs=20613 rule->part_size=20613 2024-09-12T17:30:40.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.067+0000 7f893de30800 20 RGWObjManifest::operator++(): result: ofs=41226 stripe_ofs=41226 part_ofs=41226 rule->part_size=20613 2024-09-12T17:30:40.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.067+0000 7f893de30800 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-12T17:30:40.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.067+0000 7f893de30800 20 RGWObjManifest::operator++(): stripe_ofs=6332682 part_ofs=41226 rule->part_size=20613 2024-09-12T17:30:40.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.067+0000 7f893de30800 20 RGWObjManifest::operator++(): result: ofs=61839 stripe_ofs=61839 part_ofs=61839 rule->part_size=12359 2024-09-12T17:30:40.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.067+0000 7f893de30800 20 RGWObjManifest::operator++(): rule->part_size=12359 rules.size()=2 2024-09-12T17:30:40.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.067+0000 7f893de30800 20 RGWObjManifest::operator++(): stripe_ofs=6353295 part_ofs=61839 rule->part_size=12359 2024-09-12T17:30:40.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.067+0000 7f893de30800 20 RGWObjManifest::operator++(): result: ofs=74198 stripe_ofs=74198 part_ofs=74198 rule->part_size=12359 2024-09-12T17:30:40.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.067+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - tag is: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.1027369559759265534 2024-09-12T17:30:40.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.067+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:30:40.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.067+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.12__multipart_foo.2~2CZEffOJi5ADSvHbL8PRThRAigkQOWA.1 2024-09-12T17:30:40.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.067+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 346 2024-09-12T17:30:40.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.067+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.12__multipart_foo.2~2CZEffOJi5ADSvHbL8PRThRAigkQOWA.2 2024-09-12T17:30:40.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.067+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 592 2024-09-12T17:30:40.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.067+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.12__multipart_foo.2~2CZEffOJi5ADSvHbL8PRThRAigkQOWA.3 2024-09-12T17:30:40.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.067+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 838 2024-09-12T17:30:40.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.067+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.12__multipart_foo.2~2CZEffOJi5ADSvHbL8PRThRAigkQOWA.4 2024-09-12T17:30:40.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.067+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1084 2024-09-12T17:30:40.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.067+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:30:40.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.067+0000 7f893de30800 20 garbage collection: RGWGC::send_chain - on object name: gc.17tag is: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.1027369559759265534 2024-09-12T17:30:40.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.068+0000 7f881cff9640 20 handle_completion(): completion ok for obj=foo 2024-09-12T17:30:40.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.070+0000 7f893de30800 20 list_objects_ordered: starting attempt 1 2024-09-12T17:30:40.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.070+0000 7f893de30800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T17:30:40.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.070+0000 7f893de30800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T17:30:40.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.070+0000 7f893de30800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T17:30:40.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.070+0000 7f893de30800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T17:30:40.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.070+0000 7f893de30800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T17:30:40.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.070+0000 7f893de30800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-defer-complete.1[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.12])"; uploads.size()=0; is_truncated=0 2024-09-12T17:30:40.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.072+0000 7f893de30800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 : miss 2024-09-12T17:30:40.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.072+0000 7f893de30800 20 rados->read ofs=0 len=0 2024-09-12T17:30:40.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.073+0000 7f893de30800 20 rados_obj.operate() r=0 bl.length=235 2024-09-12T17:30:40.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.073+0000 7f893de30800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 info.flags=0x11 2024-09-12T17:30:40.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.073+0000 7f893de30800 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 to cache LRU end 2024-09-12T17:30:40.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.074+0000 7f893de30800 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 from cache 2024-09-12T17:30:40.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.074+0000 7f893de30800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-defer-complete.1, ofs0, ns] 2024-09-12T17:30:40.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.075+0000 7f881cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562434 cookie 94047392342960 notifier 5684 bl.length()=191 2024-09-12T17:30:40.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.077+0000 7f893de30800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.12 from cache 2024-09-12T17:30:40.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.077+0000 7f893de30800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.12, ofs0, ns] 2024-09-12T17:30:40.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.077+0000 7f881cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562376 cookie 94047392369744 notifier 5684 bl.length()=249 2024-09-12T17:30:40.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.082+0000 7f893de30800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/722b129a-cf7a-4aca-b594-5b9492d130e2.4623.12 : miss 2024-09-12T17:30:40.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.082+0000 7f893de30800 20 rados->read ofs=0 len=0 2024-09-12T17:30:40.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.083+0000 7f893de30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:40.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.083+0000 7f893de30800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/722b129a-cf7a-4aca-b594-5b9492d130e2.4623.12 info.flags=0x0 2024-09-12T17:30:40.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.083+0000 7f893de30800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/722b129a-cf7a-4aca-b594-5b9492d130e2.4623.12 to cache LRU end 2024-09-12T17:30:40.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.085+0000 7f893de30800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.13 : miss 2024-09-12T17:30:40.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.085+0000 7f893de30800 20 rados->read ofs=0 len=0 2024-09-12T17:30:40.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.085+0000 7f893de30800 20 rados_obj.operate() r=0 bl.length=464 2024-09-12T17:30:40.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.085+0000 7f893de30800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.13 info.flags=0x17 2024-09-12T17:30:40.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.085+0000 7f893de30800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.13 to cache LRU end 2024-09-12T17:30:40.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.085+0000 7f893de30800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:30:40.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.085+0000 7f893de30800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T17:30:40.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.085+0000 7f893de30800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.13 2024-09-12T17:30:40.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.090+0000 7f893de30800 10 cls_bucket_list_unordered: got foo 2024-09-12T17:30:40.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.090+0000 7f893de30800 20 get_obj_state: octx=0x7f892c06f710 obj=test-client.0-r-test-multipart-defer-update-complete.1:foo state=0x55891d6e51d8 s->prefetch_data=0 2024-09-12T17:30:40.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.090+0000 7f893de30800 10 manifest: total_size = 26079 2024-09-12T17:30:40.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.090+0000 7f893de30800 20 get_obj_state: setting s->obj_tag to 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.17530935367180366311 2024-09-12T17:30:40.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.090+0000 7f893de30800 20 get_obj_state: octx=0x7f892c06f710 obj=test-client.0-r-test-multipart-defer-update-complete.1:foo state=0x55891d6e51d8 s->prefetch_data=0 2024-09-12T17:30:40.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.090+0000 7f893de30800 20 prepare_atomic_modification: state is not atomic. state=0x55891d6e51d8 2024-09-12T17:30:40.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.090+0000 7f893de30800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.13.10 2024-09-12T17:30:40.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.093+0000 7f893de30800 20 RGWObjManifest::operator++(): rule->part_size=7670 rules.size()=3 2024-09-12T17:30:40.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.093+0000 7f893de30800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=7670 2024-09-12T17:30:40.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.093+0000 7f893de30800 20 RGWObjManifest::operator++(): result: ofs=7670 stripe_ofs=7670 part_ofs=7670 rule->part_size=7671 2024-09-12T17:30:40.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.093+0000 7f893de30800 20 RGWObjManifest::operator++(): rule->part_size=7671 rules.size()=3 2024-09-12T17:30:40.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.093+0000 7f893de30800 20 RGWObjManifest::operator++(): stripe_ofs=6299126 part_ofs=7670 rule->part_size=7671 2024-09-12T17:30:40.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.093+0000 7f893de30800 20 RGWObjManifest::operator++(): result: ofs=15341 stripe_ofs=15341 part_ofs=15341 rule->part_size=7671 2024-09-12T17:30:40.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.093+0000 7f893de30800 20 RGWObjManifest::operator++(): rule->part_size=7671 rules.size()=3 2024-09-12T17:30:40.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.093+0000 7f893de30800 20 RGWObjManifest::operator++(): stripe_ofs=6306797 part_ofs=15341 rule->part_size=7671 2024-09-12T17:30:40.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.093+0000 7f893de30800 20 RGWObjManifest::operator++(): result: ofs=23012 stripe_ofs=23012 part_ofs=23012 rule->part_size=3067 2024-09-12T17:30:40.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.093+0000 7f893de30800 20 RGWObjManifest::operator++(): rule->part_size=3067 rules.size()=3 2024-09-12T17:30:40.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.093+0000 7f893de30800 20 RGWObjManifest::operator++(): stripe_ofs=6314468 part_ofs=23012 rule->part_size=3067 2024-09-12T17:30:40.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.093+0000 7f893de30800 20 RGWObjManifest::operator++(): result: ofs=26079 stripe_ofs=26079 part_ofs=26079 rule->part_size=3067 2024-09-12T17:30:40.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.093+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - tag is: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.17530935367180366311 2024-09-12T17:30:40.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.093+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:30:40.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.093+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.13__multipart_foo.2~pmrxXnnLDFlRri_unqBgipVd2BoalkQ.1 2024-09-12T17:30:40.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.093+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 347 2024-09-12T17:30:40.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.093+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.13__multipart_foo.2~pmrxXnnLDFlRri_unqBgipVd2BoalkQ.2 2024-09-12T17:30:40.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.093+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 593 2024-09-12T17:30:40.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.093+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.13__multipart_foo.2~pmrxXnnLDFlRri_unqBgipVd2BoalkQ.3 2024-09-12T17:30:40.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.093+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 839 2024-09-12T17:30:40.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.093+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.13__multipart_foo.2~pmrxXnnLDFlRri_unqBgipVd2BoalkQ.4 2024-09-12T17:30:40.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.093+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1085 2024-09-12T17:30:40.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.093+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:30:40.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.093+0000 7f893de30800 20 garbage collection: RGWGC::send_chain - on object name: gc.29tag is: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.17530935367180366311 2024-09-12T17:30:40.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.094+0000 7f880bfff640 20 handle_completion(): completion ok for obj=foo 2024-09-12T17:30:40.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.094+0000 7f893de30800 20 list_objects_ordered: starting attempt 1 2024-09-12T17:30:40.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.094+0000 7f893de30800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T17:30:40.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.095+0000 7f893de30800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T17:30:40.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.095+0000 7f893de30800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T17:30:40.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.095+0000 7f893de30800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T17:30:40.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.095+0000 7f893de30800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T17:30:40.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.095+0000 7f893de30800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-defer-update-complete.1[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.13])"; uploads.size()=0; is_truncated=0 2024-09-12T17:30:40.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.097+0000 7f893de30800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 : miss 2024-09-12T17:30:40.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.097+0000 7f893de30800 20 rados->read ofs=0 len=0 2024-09-12T17:30:40.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.098+0000 7f893de30800 20 rados_obj.operate() r=0 bl.length=242 2024-09-12T17:30:40.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.098+0000 7f893de30800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 info.flags=0x11 2024-09-12T17:30:40.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.098+0000 7f893de30800 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 to cache LRU end 2024-09-12T17:30:40.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.099+0000 7f893de30800 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 from cache 2024-09-12T17:30:40.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.099+0000 7f893de30800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-defer-update-complete.1, ofs0, ns] 2024-09-12T17:30:40.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.099+0000 7f880bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562394 cookie 94047392353664 notifier 5684 bl.length()=198 2024-09-12T17:30:40.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.102+0000 7f893de30800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.13 from cache 2024-09-12T17:30:40.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.102+0000 7f893de30800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.13, ofs0, ns] 2024-09-12T17:30:40.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.102+0000 7f880bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562443 cookie 94047392358944 notifier 5684 bl.length()=256 2024-09-12T17:30:40.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.106+0000 7f893de30800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/722b129a-cf7a-4aca-b594-5b9492d130e2.4623.13 : miss 2024-09-12T17:30:40.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.106+0000 7f893de30800 20 rados->read ofs=0 len=0 2024-09-12T17:30:40.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.106+0000 7f893de30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:40.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.106+0000 7f893de30800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/722b129a-cf7a-4aca-b594-5b9492d130e2.4623.13 info.flags=0x0 2024-09-12T17:30:40.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.106+0000 7f893de30800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/722b129a-cf7a-4aca-b594-5b9492d130e2.4623.13 to cache LRU end 2024-09-12T17:30:40.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.109+0000 7f893de30800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.11 : miss 2024-09-12T17:30:40.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.109+0000 7f893de30800 20 rados->read ofs=0 len=0 2024-09-12T17:30:40.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.110+0000 7f893de30800 20 rados_obj.operate() r=0 bl.length=459 2024-09-12T17:30:40.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.110+0000 7f893de30800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.11 info.flags=0x17 2024-09-12T17:30:40.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.110+0000 7f893de30800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.11 to cache LRU end 2024-09-12T17:30:40.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.110+0000 7f893de30800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:30:40.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.110+0000 7f893de30800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T17:30:40.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.110+0000 7f893de30800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.11 2024-09-12T17:30:40.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.113+0000 7f893de30800 10 cls_bucket_list_unordered: got foo[Onzmqnyz.QjhJN8nXrAe6mbFqLS43DS] 2024-09-12T17:30:40.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.113+0000 7f893de30800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.11.10 2024-09-12T17:30:40.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.113+0000 7f893de30800 20 get_obj_state: octx=0x55891d6e79f0 obj=test-client.0-r-test-multipart-index-versioning.1:foo state=0x55891d6e51d8 s->prefetch_data=0 2024-09-12T17:30:40.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.114+0000 7f893de30800 20 get_obj_state: setting s->obj_tag to bgca33z6jeq5va176uc5eqtg071iuto0 2024-09-12T17:30:40.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.114+0000 7f893de30800 20 get_obj_state_impl: setting s->olh_tag to zv0azxkeot5z83jzas04y4grm3qz23s6 2024-09-12T17:30:40.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.114+0000 7f893de30800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=zv0azxkeot5z83jzas04y4grm3qz23s6 2024-09-12T17:30:40.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.115+0000 7f893de30800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.11.10 2024-09-12T17:30:40.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.117+0000 7f893de30800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.11.10 2024-09-12T17:30:40.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.117+0000 7f893de30800 20 olh_log_entry: epoch=3 op=2 key=foo[] 2024-09-12T17:30:40.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.117+0000 7f893de30800 20 olh_log_entry: epoch=3 op=3 key=foo[Onzmqnyz.QjhJN8nXrAe6mbFqLS43DS] 2024-09-12T17:30:40.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.117+0000 7f893de30800 20 get_obj_state: octx=0x55891d6e79f0 obj=test-client.0-r-test-multipart-index-versioning.1:_:Onzmqnyz.QjhJN8nXrAe6mbFqLS43DS_foo state=0x55891d6fcac8 s->prefetch_data=0 2024-09-12T17:30:40.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.117+0000 7f893de30800 10 manifest: total_size = 26082 2024-09-12T17:30:40.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.117+0000 7f893de30800 20 get_obj_state: setting s->obj_tag to 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.15791433450595715832 2024-09-12T17:30:40.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.117+0000 7f893de30800 20 get_obj_state: octx=0x55891d6e79f0 obj=test-client.0-r-test-multipart-index-versioning.1:_:Onzmqnyz.QjhJN8nXrAe6mbFqLS43DS_foo state=0x55891d6fcac8 s->prefetch_data=0 2024-09-12T17:30:40.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.117+0000 7f893de30800 20 prepare_atomic_modification: state is not atomic. state=0x55891d6fcac8 2024-09-12T17:30:40.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.117+0000 7f893de30800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.11.10 2024-09-12T17:30:40.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.120+0000 7f893de30800 20 RGWObjManifest::operator++(): rule->part_size=7672 rules.size()=4 2024-09-12T17:30:40.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.120+0000 7f893de30800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=7672 2024-09-12T17:30:40.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.120+0000 7f893de30800 20 RGWObjManifest::operator++(): result: ofs=7672 stripe_ofs=7672 part_ofs=7672 rule->part_size=7670 2024-09-12T17:30:40.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.120+0000 7f893de30800 20 RGWObjManifest::operator++(): rule->part_size=7670 rules.size()=4 2024-09-12T17:30:40.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.120+0000 7f893de30800 20 RGWObjManifest::operator++(): stripe_ofs=6299128 part_ofs=7672 rule->part_size=7670 2024-09-12T17:30:40.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.120+0000 7f893de30800 20 RGWObjManifest::operator++(): result: ofs=15342 stripe_ofs=15342 part_ofs=15342 rule->part_size=7673 2024-09-12T17:30:40.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.120+0000 7f893de30800 20 RGWObjManifest::operator++(): rule->part_size=7673 rules.size()=4 2024-09-12T17:30:40.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.120+0000 7f893de30800 20 RGWObjManifest::operator++(): stripe_ofs=6306798 part_ofs=15342 rule->part_size=7673 2024-09-12T17:30:40.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.120+0000 7f893de30800 20 RGWObjManifest::operator++(): result: ofs=23015 stripe_ofs=23015 part_ofs=23015 rule->part_size=3067 2024-09-12T17:30:40.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.120+0000 7f893de30800 20 RGWObjManifest::operator++(): rule->part_size=3067 rules.size()=4 2024-09-12T17:30:40.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.120+0000 7f893de30800 20 RGWObjManifest::operator++(): stripe_ofs=6314471 part_ofs=23015 rule->part_size=3067 2024-09-12T17:30:40.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.120+0000 7f893de30800 20 RGWObjManifest::operator++(): result: ofs=26082 stripe_ofs=26082 part_ofs=26082 rule->part_size=3067 2024-09-12T17:30:40.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.120+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - tag is: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.15791433450595715832 2024-09-12T17:30:40.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.120+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:30:40.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.120+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.11__multipart_foo.2~YO5ZQ1zBWEypEpranUXKfRwoI--l1LK.1 2024-09-12T17:30:40.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.120+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 347 2024-09-12T17:30:40.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.120+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.11__multipart_foo.2~YO5ZQ1zBWEypEpranUXKfRwoI--l1LK.2 2024-09-12T17:30:40.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.120+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 593 2024-09-12T17:30:40.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.120+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.11__multipart_foo.2~YO5ZQ1zBWEypEpranUXKfRwoI--l1LK.3 2024-09-12T17:30:40.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.120+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 839 2024-09-12T17:30:40.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.120+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.11__multipart_foo.2~YO5ZQ1zBWEypEpranUXKfRwoI--l1LK.4 2024-09-12T17:30:40.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.120+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1085 2024-09-12T17:30:40.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.120+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:30:40.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.120+0000 7f893de30800 20 garbage collection: RGWGC::send_chain - on object name: gc.9tag is: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.15791433450595715832 2024-09-12T17:30:40.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.121+0000 7f881cff9640 20 handle_completion(): completion ok for obj=foo[Onzmqnyz.QjhJN8nXrAe6mbFqLS43DS] 2024-09-12T17:30:40.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.122+0000 7f893de30800 20 get_obj_state: octx=0x55891d6e79f0 obj=test-client.0-r-test-multipart-index-versioning.1:foo state=0x55891d6e51d8 s->prefetch_data=0 2024-09-12T17:30:40.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.124+0000 7f893de30800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.11.10 2024-09-12T17:30:40.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.125+0000 7f893de30800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.11.10 2024-09-12T17:30:40.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.125+0000 7f893de30800 20 list_objects_ordered: starting attempt 1 2024-09-12T17:30:40.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.125+0000 7f893de30800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T17:30:40.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.126+0000 7f893de30800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T17:30:40.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.126+0000 7f893de30800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T17:30:40.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.126+0000 7f893de30800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T17:30:40.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.126+0000 7f893de30800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T17:30:40.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.126+0000 7f893de30800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-index-versioning.1[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.11])"; uploads.size()=0; is_truncated=0 2024-09-12T17:30:40.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.127+0000 7f893de30800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 : miss 2024-09-12T17:30:40.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.127+0000 7f893de30800 20 rados->read ofs=0 len=0 2024-09-12T17:30:40.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.128+0000 7f893de30800 20 rados_obj.operate() r=0 bl.length=237 2024-09-12T17:30:40.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.128+0000 7f893de30800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 info.flags=0x11 2024-09-12T17:30:40.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.128+0000 7f893de30800 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 to cache LRU end 2024-09-12T17:30:40.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.129+0000 7f893de30800 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 from cache 2024-09-12T17:30:40.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.129+0000 7f893de30800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-index-versioning.1, ofs0, ns] 2024-09-12T17:30:40.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.129+0000 7f880bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562395 cookie 94047392353664 notifier 5684 bl.length()=193 2024-09-12T17:30:40.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.132+0000 7f893de30800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.11 from cache 2024-09-12T17:30:40.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.132+0000 7f893de30800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.11, ofs0, ns] 2024-09-12T17:30:40.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.132+0000 7f880bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562396 cookie 94047392353664 notifier 5684 bl.length()=251 2024-09-12T17:30:40.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.136+0000 7f893de30800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/722b129a-cf7a-4aca-b594-5b9492d130e2.4623.11 : miss 2024-09-12T17:30:40.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.136+0000 7f893de30800 20 rados->read ofs=0 len=0 2024-09-12T17:30:40.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.136+0000 7f893de30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:40.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.136+0000 7f893de30800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/722b129a-cf7a-4aca-b594-5b9492d130e2.4623.11 info.flags=0x0 2024-09-12T17:30:40.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.136+0000 7f893de30800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/722b129a-cf7a-4aca-b594-5b9492d130e2.4623.11 to cache LRU end 2024-09-12T17:30:40.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.138+0000 7f893de30800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.10 : miss 2024-09-12T17:30:40.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.138+0000 7f893de30800 20 rados->read ofs=0 len=0 2024-09-12T17:30:40.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.139+0000 7f893de30800 20 rados_obj.operate() r=0 bl.length=449 2024-09-12T17:30:40.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.139+0000 7f893de30800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.10 info.flags=0x17 2024-09-12T17:30:40.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.139+0000 7f893de30800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.10 to cache LRU end 2024-09-12T17:30:40.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.139+0000 7f893de30800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:30:40.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.139+0000 7f893de30800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T17:30:40.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.139+0000 7f893de30800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.10 2024-09-12T17:30:40.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.142+0000 7f893de30800 10 cls_bucket_list_unordered: got foo 2024-09-12T17:30:40.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.143+0000 7f893de30800 20 get_obj_state: octx=0x55891d6dbc20 obj=test-client.0-r-test-multipart-simple.1:foo state=0x55891d6fcac8 s->prefetch_data=0 2024-09-12T17:30:40.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.143+0000 7f893de30800 10 manifest: total_size = 1667 2024-09-12T17:30:40.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.143+0000 7f893de30800 20 get_obj_state: setting s->obj_tag to 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.9690149301494369721 2024-09-12T17:30:40.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.143+0000 7f893de30800 20 get_obj_state: octx=0x55891d6dbc20 obj=test-client.0-r-test-multipart-simple.1:foo state=0x55891d6fcac8 s->prefetch_data=0 2024-09-12T17:30:40.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.143+0000 7f893de30800 20 prepare_atomic_modification: state is not atomic. state=0x55891d6fcac8 2024-09-12T17:30:40.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.143+0000 7f893de30800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.10.10 2024-09-12T17:30:40.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.146+0000 7f893de30800 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-12T17:30:40.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.146+0000 7f893de30800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=516 2024-09-12T17:30:40.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.146+0000 7f893de30800 20 RGWObjManifest::operator++(): result: ofs=516 stripe_ofs=516 part_ofs=516 rule->part_size=516 2024-09-12T17:30:40.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.146+0000 7f893de30800 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-12T17:30:40.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.146+0000 7f893de30800 20 RGWObjManifest::operator++(): stripe_ofs=6291972 part_ofs=516 rule->part_size=516 2024-09-12T17:30:40.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.146+0000 7f893de30800 20 RGWObjManifest::operator++(): result: ofs=1032 stripe_ofs=1032 part_ofs=1032 rule->part_size=516 2024-09-12T17:30:40.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.146+0000 7f893de30800 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-12T17:30:40.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.146+0000 7f893de30800 20 RGWObjManifest::operator++(): stripe_ofs=6292488 part_ofs=1032 rule->part_size=516 2024-09-12T17:30:40.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.146+0000 7f893de30800 20 RGWObjManifest::operator++(): result: ofs=1548 stripe_ofs=1548 part_ofs=1548 rule->part_size=119 2024-09-12T17:30:40.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.146+0000 7f893de30800 20 RGWObjManifest::operator++(): rule->part_size=119 rules.size()=2 2024-09-12T17:30:40.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.146+0000 7f893de30800 20 RGWObjManifest::operator++(): stripe_ofs=6293004 part_ofs=1548 rule->part_size=119 2024-09-12T17:30:40.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.146+0000 7f893de30800 20 RGWObjManifest::operator++(): result: ofs=1667 stripe_ofs=1667 part_ofs=1667 rule->part_size=119 2024-09-12T17:30:40.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.146+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - tag is: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.9690149301494369721 2024-09-12T17:30:40.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.146+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:30:40.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.146+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.10__multipart_foo.2~A7rYpum_mslTPuh7xZikOFDMMfCEe3W.1 2024-09-12T17:30:40.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.146+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 346 2024-09-12T17:30:40.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.146+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.10__multipart_foo.2~A7rYpum_mslTPuh7xZikOFDMMfCEe3W.2 2024-09-12T17:30:40.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.146+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 592 2024-09-12T17:30:40.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.146+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.10__multipart_foo.2~A7rYpum_mslTPuh7xZikOFDMMfCEe3W.3 2024-09-12T17:30:40.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.146+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 838 2024-09-12T17:30:40.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.146+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.10__multipart_foo.2~A7rYpum_mslTPuh7xZikOFDMMfCEe3W.4 2024-09-12T17:30:40.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.146+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1084 2024-09-12T17:30:40.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.146+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:30:40.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.146+0000 7f893de30800 20 garbage collection: RGWGC::send_chain - on object name: gc.6tag is: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.9690149301494369721 2024-09-12T17:30:40.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.147+0000 7f880bfff640 20 handle_completion(): completion ok for obj=foo 2024-09-12T17:30:40.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.147+0000 7f893de30800 20 list_objects_ordered: starting attempt 1 2024-09-12T17:30:40.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.147+0000 7f893de30800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T17:30:40.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.148+0000 7f893de30800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T17:30:40.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.148+0000 7f893de30800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T17:30:40.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.148+0000 7f893de30800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T17:30:40.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.148+0000 7f893de30800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T17:30:40.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.148+0000 7f893de30800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-simple.1[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.10])"; uploads.size()=0; is_truncated=0 2024-09-12T17:30:40.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.150+0000 7f893de30800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 : miss 2024-09-12T17:30:40.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.150+0000 7f893de30800 20 rados->read ofs=0 len=0 2024-09-12T17:30:40.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.151+0000 7f893de30800 20 rados_obj.operate() r=0 bl.length=227 2024-09-12T17:30:40.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.151+0000 7f893de30800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 info.flags=0x11 2024-09-12T17:30:40.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.151+0000 7f893de30800 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 to cache LRU end 2024-09-12T17:30:40.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.152+0000 7f893de30800 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 from cache 2024-09-12T17:30:40.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.152+0000 7f893de30800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-simple.1, ofs0, ns] 2024-09-12T17:30:40.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.152+0000 7f881cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562444 cookie 94047392358944 notifier 5684 bl.length()=183 2024-09-12T17:30:40.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.155+0000 7f893de30800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.10 from cache 2024-09-12T17:30:40.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.155+0000 7f893de30800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-simple.1:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.10, ofs0, ns] 2024-09-12T17:30:40.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.155+0000 7f881cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562445 cookie 94047392345040 notifier 5684 bl.length()=241 2024-09-12T17:30:40.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.159+0000 7f893de30800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/722b129a-cf7a-4aca-b594-5b9492d130e2.4623.10 : miss 2024-09-12T17:30:40.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.159+0000 7f893de30800 20 rados->read ofs=0 len=0 2024-09-12T17:30:40.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.159+0000 7f893de30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:40.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.159+0000 7f893de30800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/722b129a-cf7a-4aca-b594-5b9492d130e2.4623.10 info.flags=0x0 2024-09-12T17:30:40.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.159+0000 7f893de30800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/722b129a-cf7a-4aca-b594-5b9492d130e2.4623.10 to cache LRU end 2024-09-12T17:30:40.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.161+0000 7f893de30800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.16 : miss 2024-09-12T17:30:40.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.161+0000 7f893de30800 20 rados->read ofs=0 len=0 2024-09-12T17:30:40.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.162+0000 7f893de30800 20 rados_obj.operate() r=0 bl.length=455 2024-09-12T17:30:40.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.162+0000 7f893de30800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.16 info.flags=0x17 2024-09-12T17:30:40.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.162+0000 7f893de30800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.16 to cache LRU end 2024-09-12T17:30:40.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.162+0000 7f893de30800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:30:40.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.162+0000 7f893de30800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T17:30:40.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.162+0000 7f893de30800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.16 2024-09-12T17:30:40.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.163+0000 7f893de30800 10 cls_bucket_list_unordered: got foo-STANDARD-LUKEWARM 2024-09-12T17:30:40.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.163+0000 7f893de30800 10 cls_bucket_list_unordered: got foo-LUKEWARM-STANDARD 2024-09-12T17:30:40.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.164+0000 7f893de30800 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-12T17:30:40.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.165+0000 7f893de30800 10 cls_bucket_list_unordered: got foo-FROZEN-LUKEWARM 2024-09-12T17:30:40.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.165+0000 7f893de30800 10 cls_bucket_list_unordered: got foo-LUKEWARM-FROZEN 2024-09-12T17:30:40.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.165+0000 7f893de30800 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-12T17:30:40.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.165+0000 7f893de30800 10 cls_bucket_list_unordered: got foo-FROZEN-STANDARD 2024-09-12T17:30:40.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.165+0000 7f893de30800 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-12T17:30:40.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.165+0000 7f893de30800 10 cls_bucket_list_unordered: got foo-STANDARD-STANDARD 2024-09-12T17:30:40.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.166+0000 7f893de30800 10 cls_bucket_list_unordered: got foo-LUKEWARM-LUKEWARM 2024-09-12T17:30:40.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.166+0000 7f893de30800 10 cls_bucket_list_unordered: got foo-STANDARD-FROZEN 2024-09-12T17:30:40.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.166+0000 7f893de30800 10 cls_bucket_list_unordered: got foo-FROZEN-FROZEN 2024-09-12T17:30:40.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.167+0000 7f893de30800 20 get_obj_state: octx=0x55891d6dae40 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-LUKEWARM state=0x55891d6fd998 s->prefetch_data=0 2024-09-12T17:30:40.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.167+0000 7f893de30800 10 manifest: total_size = 22651 2024-09-12T17:30:40.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.167+0000 7f893de30800 20 get_obj_state: setting s->obj_tag to _uDbHyEiuEEaXDJp152EeZN4HBRS4dXk 2024-09-12T17:30:40.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.167+0000 7f893de30800 20 get_obj_state: octx=0x55891d6dae40 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-LUKEWARM state=0x55891d6fd998 s->prefetch_data=0 2024-09-12T17:30:40.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.167+0000 7f893de30800 20 prepare_atomic_modification: state is not atomic. state=0x55891d6fd998 2024-09-12T17:30:40.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.167+0000 7f893de30800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.16.0 2024-09-12T17:30:40.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.170+0000 7f893de30800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:30:40.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.170+0000 7f893de30800 20 RGWObjManifest::operator++(): result: ofs=22651 stripe_ofs=22651 part_ofs=0 rule->part_size=0 2024-09-12T17:30:40.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.170+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - tag is: _uDbHyEiuEEaXDJp152EeZN4HBRS4dXk 2024-09-12T17:30:40.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.170+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:30:40.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.170+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.16__shadow_.bYecQG2QRP7cRbdfc67A-DkHjMyQ0SM_0 2024-09-12T17:30:40.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.170+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-12T17:30:40.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.170+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:30:40.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.170+0000 7f893de30800 20 garbage collection: RGWGC::send_chain - on object name: gc.7tag is: _uDbHyEiuEEaXDJp152EeZN4HBRS4dXk 2024-09-12T17:30:40.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.171+0000 7f881cff9640 20 handle_completion(): completion ok for obj=foo-STANDARD-LUKEWARM 2024-09-12T17:30:40.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.171+0000 7f893de30800 20 get_obj_state: octx=0x55891d6dae40 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-STANDARD state=0x55891d6e5fb8 s->prefetch_data=0 2024-09-12T17:30:40.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.171+0000 7f893de30800 10 manifest: total_size = 5242880 2024-09-12T17:30:40.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.171+0000 7f893de30800 20 get_obj_state: setting s->obj_tag to _JZ6oq8ur3IiN8H-lcvQ5eGr1ONykVzM 2024-09-12T17:30:40.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.171+0000 7f893de30800 20 get_obj_state: octx=0x55891d6dae40 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-STANDARD state=0x55891d6e5fb8 s->prefetch_data=0 2024-09-12T17:30:40.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.171+0000 7f893de30800 20 prepare_atomic_modification: state is not atomic. state=0x55891d6e5fb8 2024-09-12T17:30:40.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.171+0000 7f893de30800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.16.2 2024-09-12T17:30:40.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.174+0000 7f893de30800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:30:40.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.174+0000 7f893de30800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T17:30:40.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.174+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - tag is: _JZ6oq8ur3IiN8H-lcvQ5eGr1ONykVzM 2024-09-12T17:30:40.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.174+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:30:40.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.174+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.16__shadow_.7mdexwkuF4BzBnaX0k1wjkwxGHOY4gh_1 2024-09-12T17:30:40.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.174+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-12T17:30:40.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.174+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:30:40.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.174+0000 7f893de30800 20 garbage collection: RGWGC::send_chain - on object name: gc.10tag is: _JZ6oq8ur3IiN8H-lcvQ5eGr1ONykVzM 2024-09-12T17:30:40.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.175+0000 7f880bfff640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-STANDARD 2024-09-12T17:30:40.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.176+0000 7f893de30800 20 get_obj_state: octx=0x7f892c0beec0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN state=0x55891d6e5fb8 s->prefetch_data=0 2024-09-12T17:30:40.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.176+0000 7f893de30800 10 manifest: total_size = 5242880 2024-09-12T17:30:40.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.176+0000 7f893de30800 20 get_obj_state: setting s->obj_tag to 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.5697041962364583487 2024-09-12T17:30:40.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.176+0000 7f893de30800 20 get_obj_state: octx=0x7f892c0beec0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN state=0x55891d6e5fb8 s->prefetch_data=0 2024-09-12T17:30:40.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.176+0000 7f893de30800 20 prepare_atomic_modification: state is not atomic. state=0x55891d6e5fb8 2024-09-12T17:30:40.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.176+0000 7f893de30800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.16.3 2024-09-12T17:30:40.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.178+0000 7f893de30800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:30:40.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.178+0000 7f893de30800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T17:30:40.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.178+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - tag is: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.5697041962364583487 2024-09-12T17:30:40.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.178+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:30:40.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.178+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.16__shadow_.-XG0GEu7c64dGShgFRMwSYQy95RIGXr_0 2024-09-12T17:30:40.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.178+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 337 2024-09-12T17:30:40.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.178+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:30:40.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.178+0000 7f893de30800 20 garbage collection: RGWGC::send_chain - on object name: gc.12tag is: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.5697041962364583487 2024-09-12T17:30:40.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.180+0000 7f881cff9640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-12T17:30:40.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.180+0000 7f893de30800 20 get_obj_state: octx=0x55891d6fa9b0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-LUKEWARM state=0x55891d6e5fb8 s->prefetch_data=0 2024-09-12T17:30:40.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.180+0000 7f893de30800 10 manifest: total_size = 5242880 2024-09-12T17:30:40.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.180+0000 7f893de30800 20 get_obj_state: setting s->obj_tag to _2Q3dKwA2QeIIJHMUgbU221W1Zo4Ddkd 2024-09-12T17:30:40.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.180+0000 7f893de30800 20 get_obj_state: octx=0x55891d6fa9b0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-LUKEWARM state=0x55891d6e5fb8 s->prefetch_data=0 2024-09-12T17:30:40.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.180+0000 7f893de30800 20 prepare_atomic_modification: state is not atomic. state=0x55891d6e5fb8 2024-09-12T17:30:40.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.180+0000 7f893de30800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.16.5 2024-09-12T17:30:40.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.183+0000 7f893de30800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:30:40.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.183+0000 7f893de30800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T17:30:40.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.183+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - tag is: _2Q3dKwA2QeIIJHMUgbU221W1Zo4Ddkd 2024-09-12T17:30:40.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.183+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:30:40.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.183+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.16__shadow_.zBBS-xfih2tMXgyVI-QIODmpu06rokP_0 2024-09-12T17:30:40.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.183+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-12T17:30:40.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.183+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:30:40.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.183+0000 7f893de30800 20 garbage collection: RGWGC::send_chain - on object name: gc.3tag is: _2Q3dKwA2QeIIJHMUgbU221W1Zo4Ddkd 2024-09-12T17:30:40.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.184+0000 7f880bfff640 20 handle_completion(): completion ok for obj=foo-FROZEN-LUKEWARM 2024-09-12T17:30:40.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.184+0000 7f893de30800 20 get_obj_state: octx=0x7f8930011f00 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-FROZEN state=0x55891d6e5fb8 s->prefetch_data=0 2024-09-12T17:30:40.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.185+0000 7f893de30800 10 manifest: total_size = 5242880 2024-09-12T17:30:40.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.185+0000 7f893de30800 20 get_obj_state: setting s->obj_tag to _ETj8FGt9nOeQCWaWopCGQIgKExdykfz 2024-09-12T17:30:40.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.185+0000 7f893de30800 20 get_obj_state: octx=0x7f8930011f00 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-FROZEN state=0x55891d6e5fb8 s->prefetch_data=0 2024-09-12T17:30:40.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.185+0000 7f893de30800 20 prepare_atomic_modification: state is not atomic. state=0x55891d6e5fb8 2024-09-12T17:30:40.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.185+0000 7f893de30800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.16.5 2024-09-12T17:30:40.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.187+0000 7f893de30800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:30:40.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.187+0000 7f893de30800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T17:30:40.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.187+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - tag is: _ETj8FGt9nOeQCWaWopCGQIgKExdykfz 2024-09-12T17:30:40.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.187+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:30:40.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.187+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.16__shadow_.IRV9NcU_ja0TVgFC6a3zOY2XM20pJ2i_0 2024-09-12T17:30:40.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.187+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-12T17:30:40.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.187+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:30:40.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.187+0000 7f893de30800 20 garbage collection: RGWGC::send_chain - on object name: gc.16tag is: _ETj8FGt9nOeQCWaWopCGQIgKExdykfz 2024-09-12T17:30:40.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.189+0000 7f881cff9640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-FROZEN 2024-09-12T17:30:40.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.189+0000 7f893de30800 20 get_obj_state: octx=0x7f892c0beec0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD state=0x55891d6e5fb8 s->prefetch_data=0 2024-09-12T17:30:40.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.189+0000 7f893de30800 10 manifest: total_size = 22651 2024-09-12T17:30:40.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.189+0000 7f893de30800 20 get_obj_state: setting s->obj_tag to 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.11878359607180835627 2024-09-12T17:30:40.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.189+0000 7f893de30800 20 get_obj_state: octx=0x7f892c0beec0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD state=0x55891d6e5fb8 s->prefetch_data=0 2024-09-12T17:30:40.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.189+0000 7f893de30800 20 prepare_atomic_modification: state is not atomic. state=0x55891d6e5fb8 2024-09-12T17:30:40.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.189+0000 7f893de30800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.16.5 2024-09-12T17:30:40.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.192+0000 7f893de30800 20 get_obj_state: octx=0x7f8930011f00 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-STANDARD state=0x55891d6e5fb8 s->prefetch_data=0 2024-09-12T17:30:40.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.192+0000 7f893de30800 10 manifest: total_size = 5242880 2024-09-12T17:30:40.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.192+0000 7f893de30800 20 get_obj_state: setting s->obj_tag to _gUkPIx67kYJYNh6vNp6pS4aC9-JwAL8 2024-09-12T17:30:40.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.192+0000 7f893de30800 20 get_obj_state: octx=0x7f8930011f00 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-STANDARD state=0x55891d6e5fb8 s->prefetch_data=0 2024-09-12T17:30:40.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.192+0000 7f893de30800 20 prepare_atomic_modification: state is not atomic. state=0x55891d6e5fb8 2024-09-12T17:30:40.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.192+0000 7f893de30800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.16.7 2024-09-12T17:30:40.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.193+0000 7f880bfff640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-12T17:30:40.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.195+0000 7f893de30800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:30:40.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.195+0000 7f893de30800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T17:30:40.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.195+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - tag is: _gUkPIx67kYJYNh6vNp6pS4aC9-JwAL8 2024-09-12T17:30:40.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.195+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:30:40.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.195+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.16__shadow_.446SI8MwxMkPsBOh9AAZXqyZSynH-ce_1 2024-09-12T17:30:40.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.195+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-12T17:30:40.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.195+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:30:40.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.195+0000 7f893de30800 20 garbage collection: RGWGC::send_chain - on object name: gc.24tag is: _gUkPIx67kYJYNh6vNp6pS4aC9-JwAL8 2024-09-12T17:30:40.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.197+0000 7f881cff9640 20 handle_completion(): completion ok for obj=foo-FROZEN-STANDARD 2024-09-12T17:30:40.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.197+0000 7f893de30800 20 get_obj_state: octx=0x55891d6fa9b0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM state=0x55891d6fcac8 s->prefetch_data=0 2024-09-12T17:30:40.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.197+0000 7f893de30800 10 manifest: total_size = 5242880 2024-09-12T17:30:40.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.197+0000 7f893de30800 20 get_obj_state: setting s->obj_tag to 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.12961051686328372529 2024-09-12T17:30:40.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.197+0000 7f893de30800 20 get_obj_state: octx=0x55891d6fa9b0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM state=0x55891d6fcac8 s->prefetch_data=0 2024-09-12T17:30:40.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.197+0000 7f893de30800 20 prepare_atomic_modification: state is not atomic. state=0x55891d6fcac8 2024-09-12T17:30:40.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.197+0000 7f893de30800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.16.7 2024-09-12T17:30:40.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.199+0000 7f893de30800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:30:40.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.199+0000 7f893de30800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T17:30:40.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.199+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - tag is: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.12961051686328372529 2024-09-12T17:30:40.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.199+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:30:40.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.199+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.16__shadow_.BG55K2HV9ncIKMEVBGeBEZlnA5pSp45_0 2024-09-12T17:30:40.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.199+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 340 2024-09-12T17:30:40.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.199+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:30:40.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.199+0000 7f893de30800 20 garbage collection: RGWGC::send_chain - on object name: gc.28tag is: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.12961051686328372529 2024-09-12T17:30:40.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.201+0000 7f880bfff640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-12T17:30:40.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.201+0000 7f893de30800 20 get_obj_state: octx=0x55891d6dae40 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-STANDARD state=0x55891d6fcac8 s->prefetch_data=0 2024-09-12T17:30:40.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.201+0000 7f893de30800 10 manifest: total_size = 22651 2024-09-12T17:30:40.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.201+0000 7f893de30800 20 get_obj_state: setting s->obj_tag to _3IY2t3-Bl-fdrpDhYZDFczwfB8LiG0I 2024-09-12T17:30:40.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.201+0000 7f893de30800 20 get_obj_state: octx=0x55891d6dae40 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-STANDARD state=0x55891d6fcac8 s->prefetch_data=0 2024-09-12T17:30:40.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.201+0000 7f893de30800 20 prepare_atomic_modification: state is not atomic. state=0x55891d6fcac8 2024-09-12T17:30:40.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.201+0000 7f893de30800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.16.7 2024-09-12T17:30:40.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.203+0000 7f893de30800 20 get_obj_state: octx=0x7f892c0beec0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-LUKEWARM state=0x55891d6fcac8 s->prefetch_data=0 2024-09-12T17:30:40.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.204+0000 7f893de30800 10 manifest: total_size = 5242880 2024-09-12T17:30:40.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.204+0000 7f893de30800 20 get_obj_state: setting s->obj_tag to 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.1074000423253572708 2024-09-12T17:30:40.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.204+0000 7f893de30800 20 get_obj_state: octx=0x7f892c0beec0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-LUKEWARM state=0x55891d6fcac8 s->prefetch_data=0 2024-09-12T17:30:40.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.204+0000 7f893de30800 20 prepare_atomic_modification: state is not atomic. state=0x55891d6fcac8 2024-09-12T17:30:40.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.204+0000 7f893de30800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.16.8 2024-09-12T17:30:40.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.205+0000 7f881cff9640 20 handle_completion(): completion ok for obj=foo-STANDARD-STANDARD 2024-09-12T17:30:40.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.207+0000 7f893de30800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:30:40.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.207+0000 7f893de30800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T17:30:40.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.207+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - tag is: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.1074000423253572708 2024-09-12T17:30:40.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.207+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:30:40.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.207+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.16__shadow_.BG55K2HV9ncIKMEVBGeBEZlnA5pSp45_0 2024-09-12T17:30:40.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.207+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 339 2024-09-12T17:30:40.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.207+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:30:40.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.207+0000 7f893de30800 20 garbage collection: RGWGC::send_chain - on object name: gc.30tag is: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.1074000423253572708 2024-09-12T17:30:40.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.208+0000 7f893de30800 20 get_obj_state: octx=0x55891d6dae40 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-FROZEN state=0x55891d6fcac8 s->prefetch_data=0 2024-09-12T17:30:40.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.208+0000 7f880bfff640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-LUKEWARM 2024-09-12T17:30:40.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.208+0000 7f893de30800 10 manifest: total_size = 22651 2024-09-12T17:30:40.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.208+0000 7f893de30800 20 get_obj_state: setting s->obj_tag to _4_qaRJhhQgymnz3_zS2NvDE9cgRuclR 2024-09-12T17:30:40.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.208+0000 7f893de30800 20 get_obj_state: octx=0x55891d6dae40 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-FROZEN state=0x55891d6fcac8 s->prefetch_data=0 2024-09-12T17:30:40.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.208+0000 7f893de30800 20 prepare_atomic_modification: state is not atomic. state=0x55891d6fcac8 2024-09-12T17:30:40.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.208+0000 7f893de30800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.16.8 2024-09-12T17:30:40.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.211+0000 7f893de30800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:30:40.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.211+0000 7f893de30800 20 RGWObjManifest::operator++(): result: ofs=22651 stripe_ofs=22651 part_ofs=0 rule->part_size=0 2024-09-12T17:30:40.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.211+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - tag is: _4_qaRJhhQgymnz3_zS2NvDE9cgRuclR 2024-09-12T17:30:40.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.211+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:30:40.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.211+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.16__shadow_.6Ge4Di8F3Y6unEOTy88bNScQO0eOv6G_0 2024-09-12T17:30:40.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.211+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-12T17:30:40.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.211+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:30:40.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.211+0000 7f893de30800 20 garbage collection: RGWGC::send_chain - on object name: gc.30tag is: _4_qaRJhhQgymnz3_zS2NvDE9cgRuclR 2024-09-12T17:30:40.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.212+0000 7f881cff9640 20 handle_completion(): completion ok for obj=foo-STANDARD-FROZEN 2024-09-12T17:30:40.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.212+0000 7f893de30800 20 get_obj_state: octx=0x7f893403f710 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-FROZEN state=0x55891d6fcac8 s->prefetch_data=0 2024-09-12T17:30:40.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.212+0000 7f893de30800 10 manifest: total_size = 5242880 2024-09-12T17:30:40.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.212+0000 7f893de30800 20 get_obj_state: setting s->obj_tag to 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.5239078408954868536 2024-09-12T17:30:40.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.212+0000 7f893de30800 20 get_obj_state: octx=0x7f893403f710 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-FROZEN state=0x55891d6fcac8 s->prefetch_data=0 2024-09-12T17:30:40.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.212+0000 7f893de30800 20 prepare_atomic_modification: state is not atomic. state=0x55891d6fcac8 2024-09-12T17:30:40.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.212+0000 7f893de30800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.16.9 2024-09-12T17:30:40.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.215+0000 7f893de30800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:30:40.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.215+0000 7f893de30800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T17:30:40.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.215+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - tag is: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.5239078408954868536 2024-09-12T17:30:40.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.215+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:30:40.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.215+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.16__shadow_.-XG0GEu7c64dGShgFRMwSYQy95RIGXr_0 2024-09-12T17:30:40.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.215+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 337 2024-09-12T17:30:40.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.215+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:30:40.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.215+0000 7f893de30800 20 garbage collection: RGWGC::send_chain - on object name: gc.23tag is: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.5239078408954868536 2024-09-12T17:30:40.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.216+0000 7f880bfff640 20 handle_completion(): completion ok for obj=foo-FROZEN-FROZEN 2024-09-12T17:30:40.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.216+0000 7f893de30800 20 list_objects_ordered: starting attempt 1 2024-09-12T17:30:40.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.216+0000 7f893de30800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T17:30:40.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.217+0000 7f893de30800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T17:30:40.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.217+0000 7f893de30800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T17:30:40.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.217+0000 7f893de30800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T17:30:40.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.217+0000 7f893de30800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T17:30:40.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.217+0000 7f893de30800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-copy.1[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.16])"; uploads.size()=0; is_truncated=0 2024-09-12T17:30:40.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.219+0000 7f893de30800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 : miss 2024-09-12T17:30:40.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.219+0000 7f893de30800 20 rados->read ofs=0 len=0 2024-09-12T17:30:40.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.219+0000 7f893de30800 20 rados_obj.operate() r=0 bl.length=233 2024-09-12T17:30:40.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.219+0000 7f893de30800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x11 2024-09-12T17:30:40.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.219+0000 7f893de30800 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2024-09-12T17:30:40.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.220+0000 7f893de30800 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 from cache 2024-09-12T17:30:40.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.221+0000 7f893de30800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-copy.1, ofs0, ns] 2024-09-12T17:30:40.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.221+0000 7f880bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562397 cookie 94047392353664 notifier 5684 bl.length()=189 2024-09-12T17:30:40.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.224+0000 7f893de30800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.16 from cache 2024-09-12T17:30:40.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.224+0000 7f893de30800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.16, ofs0, ns] 2024-09-12T17:30:40.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.224+0000 7f880bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562398 cookie 94047392353664 notifier 5684 bl.length()=247 2024-09-12T17:30:40.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.228+0000 7f893de30800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/722b129a-cf7a-4aca-b594-5b9492d130e2.4623.16 : miss 2024-09-12T17:30:40.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.228+0000 7f893de30800 20 rados->read ofs=0 len=0 2024-09-12T17:30:40.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.228+0000 7f893de30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:40.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.228+0000 7f893de30800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/722b129a-cf7a-4aca-b594-5b9492d130e2.4623.16 info.flags=0x0 2024-09-12T17:30:40.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.228+0000 7f893de30800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/722b129a-cf7a-4aca-b594-5b9492d130e2.4623.16 to cache LRU end 2024-09-12T17:30:40.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.230+0000 7f893de30800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.17 : miss 2024-09-12T17:30:40.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.230+0000 7f893de30800 20 rados->read ofs=0 len=0 2024-09-12T17:30:40.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.231+0000 7f893de30800 20 rados_obj.operate() r=0 bl.length=465 2024-09-12T17:30:40.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.231+0000 7f893de30800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.17 info.flags=0x17 2024-09-12T17:30:40.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.231+0000 7f893de30800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.17 to cache LRU end 2024-09-12T17:30:40.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.231+0000 7f893de30800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:30:40.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.231+0000 7f893de30800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T17:30:40.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.231+0000 7f893de30800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.17 2024-09-12T17:30:40.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.232+0000 7f893de30800 10 cls_bucket_list_unordered: got foo-STANDARD-LUKEWARM 2024-09-12T17:30:40.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.232+0000 7f893de30800 10 cls_bucket_list_unordered: got foo-LUKEWARM-STANDARD 2024-09-12T17:30:40.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.233+0000 7f893de30800 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-12T17:30:40.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.233+0000 7f893de30800 10 cls_bucket_list_unordered: got foo-FROZEN-LUKEWARM 2024-09-12T17:30:40.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.233+0000 7f893de30800 10 cls_bucket_list_unordered: got foo-LUKEWARM-FROZEN 2024-09-12T17:30:40.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.233+0000 7f893de30800 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-12T17:30:40.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.234+0000 7f893de30800 10 cls_bucket_list_unordered: got foo-FROZEN-STANDARD 2024-09-12T17:30:40.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.234+0000 7f893de30800 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-12T17:30:40.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.234+0000 7f893de30800 10 cls_bucket_list_unordered: got foo-STANDARD-STANDARD 2024-09-12T17:30:40.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.235+0000 7f893de30800 10 cls_bucket_list_unordered: got foo-LUKEWARM-LUKEWARM 2024-09-12T17:30:40.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.235+0000 7f893de30800 10 cls_bucket_list_unordered: got foo-STANDARD-FROZEN 2024-09-12T17:30:40.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.235+0000 7f893de30800 10 cls_bucket_list_unordered: got foo-FROZEN-FROZEN 2024-09-12T17:30:40.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.236+0000 7f893de30800 20 get_obj_state: octx=0x55891d6dc280 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-LUKEWARM state=0x55891d6fef18 s->prefetch_data=0 2024-09-12T17:30:40.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.236+0000 7f893de30800 10 manifest: total_size = 16376 2024-09-12T17:30:40.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.236+0000 7f893de30800 20 get_obj_state: setting s->obj_tag to _LIS12q7EBHKBGE5Tg_SnpXNA7Ci5jsU 2024-09-12T17:30:40.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.236+0000 7f893de30800 20 get_obj_state: octx=0x55891d6dc280 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-LUKEWARM state=0x55891d6fef18 s->prefetch_data=0 2024-09-12T17:30:40.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.236+0000 7f893de30800 20 prepare_atomic_modification: state is not atomic. state=0x55891d6fef18 2024-09-12T17:30:40.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.236+0000 7f893de30800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.17.0 2024-09-12T17:30:40.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.239+0000 7f893de30800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:30:40.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.239+0000 7f893de30800 20 RGWObjManifest::operator++(): result: ofs=16376 stripe_ofs=16376 part_ofs=0 rule->part_size=0 2024-09-12T17:30:40.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.239+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - tag is: _LIS12q7EBHKBGE5Tg_SnpXNA7Ci5jsU 2024-09-12T17:30:40.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.239+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:30:40.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.239+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.17__shadow_.tnnuHZVJFUYLrVMf9xOLPRYMNAlXYG4_0 2024-09-12T17:30:40.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.239+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-12T17:30:40.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.239+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:30:40.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.239+0000 7f893de30800 20 garbage collection: RGWGC::send_chain - on object name: gc.26tag is: _LIS12q7EBHKBGE5Tg_SnpXNA7Ci5jsU 2024-09-12T17:30:40.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.240+0000 7f880bfff640 20 handle_completion(): completion ok for obj=foo-STANDARD-LUKEWARM 2024-09-12T17:30:40.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.240+0000 7f893de30800 20 get_obj_state: octx=0x7f8934014db0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-STANDARD state=0x55891d6fef18 s->prefetch_data=0 2024-09-12T17:30:40.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.241+0000 7f893de30800 10 manifest: total_size = 11534336 2024-09-12T17:30:40.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.241+0000 7f893de30800 20 get_obj_state: setting s->obj_tag to _GVhrY9baGZLb7ew-hnDJW0Er0lTLC3- 2024-09-12T17:30:40.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.241+0000 7f893de30800 20 get_obj_state: octx=0x7f8934014db0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-STANDARD state=0x55891d6fef18 s->prefetch_data=0 2024-09-12T17:30:40.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.241+0000 7f893de30800 20 prepare_atomic_modification: state is not atomic. state=0x55891d6fef18 2024-09-12T17:30:40.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.241+0000 7f893de30800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.17.2 2024-09-12T17:30:40.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.243+0000 7f893de30800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:30:40.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.243+0000 7f893de30800 20 RGWObjManifest::operator++(): result: ofs=10481664 stripe_ofs=10481664 part_ofs=0 rule->part_size=0 2024-09-12T17:30:40.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.243+0000 7f893de30800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:30:40.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.243+0000 7f893de30800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-12T17:30:40.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.243+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - tag is: _GVhrY9baGZLb7ew-hnDJW0Er0lTLC3- 2024-09-12T17:30:40.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.243+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:30:40.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.243+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.17__shadow_.3GBAFufTEHBJZPvC2hNkyDk4bBWQwES_1 2024-09-12T17:30:40.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.243+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-12T17:30:40.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.243+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.17__shadow_.3GBAFufTEHBJZPvC2hNkyDk4bBWQwES_2 2024-09-12T17:30:40.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.243+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 531 2024-09-12T17:30:40.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.243+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:30:40.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.243+0000 7f893de30800 20 garbage collection: RGWGC::send_chain - on object name: gc.30tag is: _GVhrY9baGZLb7ew-hnDJW0Er0lTLC3- 2024-09-12T17:30:40.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.245+0000 7f881cff9640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-STANDARD 2024-09-12T17:30:40.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.245+0000 7f893de30800 20 get_obj_state: octx=0x7f892c0beec0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN state=0x55891d6fef18 s->prefetch_data=0 2024-09-12T17:30:40.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.245+0000 7f893de30800 10 manifest: total_size = 11534336 2024-09-12T17:30:40.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.245+0000 7f893de30800 20 get_obj_state: setting s->obj_tag to 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.9286930177530948550 2024-09-12T17:30:40.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.245+0000 7f893de30800 20 get_obj_state: octx=0x7f892c0beec0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN state=0x55891d6fef18 s->prefetch_data=0 2024-09-12T17:30:40.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.245+0000 7f893de30800 20 prepare_atomic_modification: state is not atomic. state=0x55891d6fef18 2024-09-12T17:30:40.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.245+0000 7f893de30800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.17.3 2024-09-12T17:30:40.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.247+0000 7f893de30800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:30:40.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.247+0000 7f893de30800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-09-12T17:30:40.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.247+0000 7f893de30800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:30:40.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.247+0000 7f893de30800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:30:40.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.247+0000 7f893de30800 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:30:40.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.247+0000 7f893de30800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-12T17:30:40.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.247+0000 7f893de30800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-12T17:30:40.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.247+0000 7f893de30800 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-09-12T17:30:40.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.247+0000 7f893de30800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-12T17:30:40.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.247+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - tag is: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.9286930177530948550 2024-09-12T17:30:40.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.247+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:30:40.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.247+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.17__multipart_foo-FROZEN.2~mK5UcGwPkCsgvLpZEsTArO48JetS8zO.1 2024-09-12T17:30:40.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.247+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 367 2024-09-12T17:30:40.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.247+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.17__multipart_foo-FROZEN.2~mK5UcGwPkCsgvLpZEsTArO48JetS8zO.2 2024-09-12T17:30:40.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.247+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 634 2024-09-12T17:30:40.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.247+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.17__multipart_foo-FROZEN.2~mK5UcGwPkCsgvLpZEsTArO48JetS8zO.3 2024-09-12T17:30:40.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.247+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 901 2024-09-12T17:30:40.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.247+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:30:40.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.247+0000 7f893de30800 20 garbage collection: RGWGC::send_chain - on object name: gc.0tag is: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.9286930177530948550 2024-09-12T17:30:40.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.249+0000 7f880bfff640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-12T17:30:40.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.249+0000 7f893de30800 20 get_obj_state: octx=0x7f892c06f710 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-LUKEWARM state=0x55891d6fef18 s->prefetch_data=0 2024-09-12T17:30:40.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.249+0000 7f893de30800 10 manifest: total_size = 11534336 2024-09-12T17:30:40.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.249+0000 7f893de30800 20 get_obj_state: setting s->obj_tag to _fVphe69twCKjI-_MArOoEIT8KRNY_rK 2024-09-12T17:30:40.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.249+0000 7f893de30800 20 get_obj_state: octx=0x7f892c06f710 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-LUKEWARM state=0x55891d6fef18 s->prefetch_data=0 2024-09-12T17:30:40.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.249+0000 7f893de30800 20 prepare_atomic_modification: state is not atomic. state=0x55891d6fef18 2024-09-12T17:30:40.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.249+0000 7f893de30800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.17.5 2024-09-12T17:30:40.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.252+0000 7f893de30800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:30:40.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.252+0000 7f893de30800 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2024-09-12T17:30:40.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.252+0000 7f893de30800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:30:40.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.252+0000 7f893de30800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-12T17:30:40.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.252+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - tag is: _fVphe69twCKjI-_MArOoEIT8KRNY_rK 2024-09-12T17:30:40.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.252+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:30:40.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.252+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.17__shadow_.PPPKxYCANCMyIscBEKmV-UhJ5buBkFg_0 2024-09-12T17:30:40.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.252+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-12T17:30:40.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.252+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.17__shadow_.PPPKxYCANCMyIscBEKmV-UhJ5buBkFg_1 2024-09-12T17:30:40.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.252+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 549 2024-09-12T17:30:40.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.252+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:30:40.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.252+0000 7f893de30800 20 garbage collection: RGWGC::send_chain - on object name: gc.29tag is: _fVphe69twCKjI-_MArOoEIT8KRNY_rK 2024-09-12T17:30:40.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.253+0000 7f881cff9640 20 handle_completion(): completion ok for obj=foo-FROZEN-LUKEWARM 2024-09-12T17:30:40.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.253+0000 7f893de30800 20 get_obj_state: octx=0x7f8934014db0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-FROZEN state=0x55891d6fef18 s->prefetch_data=0 2024-09-12T17:30:40.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.253+0000 7f893de30800 10 manifest: total_size = 11534336 2024-09-12T17:30:40.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.253+0000 7f893de30800 20 get_obj_state: setting s->obj_tag to _3EtxPyADpbY54J4lqr_EwXFPBkEs4Om 2024-09-12T17:30:40.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.253+0000 7f893de30800 20 get_obj_state: octx=0x7f8934014db0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-FROZEN state=0x55891d6fef18 s->prefetch_data=0 2024-09-12T17:30:40.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.253+0000 7f893de30800 20 prepare_atomic_modification: state is not atomic. state=0x55891d6fef18 2024-09-12T17:30:40.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.253+0000 7f893de30800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.17.5 2024-09-12T17:30:40.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.256+0000 7f893de30800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:30:40.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.256+0000 7f893de30800 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2024-09-12T17:30:40.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.256+0000 7f893de30800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:30:40.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.256+0000 7f893de30800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-12T17:30:40.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.256+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - tag is: _3EtxPyADpbY54J4lqr_EwXFPBkEs4Om 2024-09-12T17:30:40.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.256+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:30:40.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.256+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.17__shadow_.und_oBZwCWd9JFqH9VMBJmHhgwGHykb_0 2024-09-12T17:30:40.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.256+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-12T17:30:40.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.256+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.17__shadow_.und_oBZwCWd9JFqH9VMBJmHhgwGHykb_1 2024-09-12T17:30:40.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.256+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 545 2024-09-12T17:30:40.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.256+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:30:40.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.256+0000 7f893de30800 20 garbage collection: RGWGC::send_chain - on object name: gc.23tag is: _3EtxPyADpbY54J4lqr_EwXFPBkEs4Om 2024-09-12T17:30:40.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.257+0000 7f893de30800 20 get_obj_state: octx=0x55891d6fd690 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD state=0x55891d6fef18 s->prefetch_data=0 2024-09-12T17:30:40.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.257+0000 7f880bfff640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-FROZEN 2024-09-12T17:30:40.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.258+0000 7f893de30800 10 manifest: total_size = 16376 2024-09-12T17:30:40.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.258+0000 7f893de30800 20 get_obj_state: setting s->obj_tag to 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.17727107852081077902 2024-09-12T17:30:40.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.258+0000 7f893de30800 20 get_obj_state: octx=0x55891d6fd690 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD state=0x55891d6fef18 s->prefetch_data=0 2024-09-12T17:30:40.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.258+0000 7f893de30800 20 prepare_atomic_modification: state is not atomic. state=0x55891d6fef18 2024-09-12T17:30:40.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.258+0000 7f893de30800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.17.5 2024-09-12T17:30:40.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.260+0000 7f893de30800 20 RGWObjManifest::operator++(): rule->part_size=7669 rules.size()=3 2024-09-12T17:30:40.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.260+0000 7f893de30800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=7669 2024-09-12T17:30:40.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.260+0000 7f893de30800 20 RGWObjManifest::operator++(): result: ofs=7669 stripe_ofs=7669 part_ofs=7669 rule->part_size=7672 2024-09-12T17:30:40.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.260+0000 7f893de30800 20 RGWObjManifest::operator++(): rule->part_size=7672 rules.size()=3 2024-09-12T17:30:40.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.260+0000 7f893de30800 20 RGWObjManifest::operator++(): stripe_ofs=6299125 part_ofs=7669 rule->part_size=7672 2024-09-12T17:30:40.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.260+0000 7f893de30800 20 RGWObjManifest::operator++(): result: ofs=15341 stripe_ofs=15341 part_ofs=15341 rule->part_size=1035 2024-09-12T17:30:40.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.260+0000 7f893de30800 20 RGWObjManifest::operator++(): rule->part_size=1035 rules.size()=3 2024-09-12T17:30:40.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.260+0000 7f893de30800 20 RGWObjManifest::operator++(): stripe_ofs=6306797 part_ofs=15341 rule->part_size=1035 2024-09-12T17:30:40.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.260+0000 7f893de30800 20 RGWObjManifest::operator++(): result: ofs=16376 stripe_ofs=16376 part_ofs=16376 rule->part_size=1035 2024-09-12T17:30:40.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.260+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - tag is: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.17727107852081077902 2024-09-12T17:30:40.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.260+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:30:40.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.260+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.17__multipart_foo-STANDARD.2~3Fr5vjon4RjiQMVCfPwWSIjK6F0Py6Z.1 2024-09-12T17:30:40.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.260+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 365 2024-09-12T17:30:40.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.260+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.17__multipart_foo-STANDARD.2~3Fr5vjon4RjiQMVCfPwWSIjK6F0Py6Z.2 2024-09-12T17:30:40.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.260+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 629 2024-09-12T17:30:40.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.260+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.17__multipart_foo-STANDARD.2~3Fr5vjon4RjiQMVCfPwWSIjK6F0Py6Z.3 2024-09-12T17:30:40.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.260+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 893 2024-09-12T17:30:40.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.260+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:30:40.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.260+0000 7f893de30800 20 garbage collection: RGWGC::send_chain - on object name: gc.2tag is: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.17727107852081077902 2024-09-12T17:30:40.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.261+0000 7f881cff9640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-12T17:30:40.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.262+0000 7f893de30800 20 get_obj_state: octx=0x7f892c06f710 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-STANDARD state=0x55891d6fef18 s->prefetch_data=0 2024-09-12T17:30:40.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.262+0000 7f893de30800 10 manifest: total_size = 11534336 2024-09-12T17:30:40.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.262+0000 7f893de30800 20 get_obj_state: setting s->obj_tag to _RkTD1chARR_IdO6EMK1USvgqhRtSH0L 2024-09-12T17:30:40.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.262+0000 7f893de30800 20 get_obj_state: octx=0x7f892c06f710 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-STANDARD state=0x55891d6fef18 s->prefetch_data=0 2024-09-12T17:30:40.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.262+0000 7f893de30800 20 prepare_atomic_modification: state is not atomic. state=0x55891d6fef18 2024-09-12T17:30:40.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.262+0000 7f893de30800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.17.7 2024-09-12T17:30:40.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.264+0000 7f893de30800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:30:40.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.264+0000 7f893de30800 20 RGWObjManifest::operator++(): result: ofs=10481664 stripe_ofs=10481664 part_ofs=0 rule->part_size=0 2024-09-12T17:30:40.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.264+0000 7f893de30800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:30:40.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.264+0000 7f893de30800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-12T17:30:40.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.264+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - tag is: _RkTD1chARR_IdO6EMK1USvgqhRtSH0L 2024-09-12T17:30:40.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.264+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:30:40.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.264+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.17__shadow_.fiU_0aF7Nxt_bkgOFtUI3jRfScXY77X_1 2024-09-12T17:30:40.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.264+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-12T17:30:40.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.264+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.17__shadow_.fiU_0aF7Nxt_bkgOFtUI3jRfScXY77X_2 2024-09-12T17:30:40.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.264+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 531 2024-09-12T17:30:40.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.264+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:30:40.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.264+0000 7f893de30800 20 garbage collection: RGWGC::send_chain - on object name: gc.18tag is: _RkTD1chARR_IdO6EMK1USvgqhRtSH0L 2024-09-12T17:30:40.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.266+0000 7f880bfff640 20 handle_completion(): completion ok for obj=foo-FROZEN-STANDARD 2024-09-12T17:30:40.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.266+0000 7f893de30800 20 get_obj_state: octx=0x7f892c0649f0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM state=0x55891d6fef18 s->prefetch_data=0 2024-09-12T17:30:40.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.266+0000 7f893de30800 10 manifest: total_size = 11534336 2024-09-12T17:30:40.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.266+0000 7f893de30800 20 get_obj_state: setting s->obj_tag to 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.667413290576992298 2024-09-12T17:30:40.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.266+0000 7f893de30800 20 get_obj_state: octx=0x7f892c0649f0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM state=0x55891d6fef18 s->prefetch_data=0 2024-09-12T17:30:40.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.266+0000 7f893de30800 20 prepare_atomic_modification: state is not atomic. state=0x55891d6fef18 2024-09-12T17:30:40.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.266+0000 7f893de30800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.17.7 2024-09-12T17:30:40.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.269+0000 7f893de30800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:30:40.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.269+0000 7f893de30800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-09-12T17:30:40.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.269+0000 7f893de30800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:30:40.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.269+0000 7f893de30800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:30:40.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.269+0000 7f893de30800 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:30:40.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.269+0000 7f893de30800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-12T17:30:40.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.269+0000 7f893de30800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-12T17:30:40.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.269+0000 7f893de30800 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-09-12T17:30:40.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.269+0000 7f893de30800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-12T17:30:40.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.269+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - tag is: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.667413290576992298 2024-09-12T17:30:40.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.269+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:30:40.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.269+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.17__multipart_foo-LUKEWARM.2~3p8F8Dm0U5mVPAce6ztNjQpm3R2wt2_.1 2024-09-12T17:30:40.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.269+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 372 2024-09-12T17:30:40.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.269+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.17__multipart_foo-LUKEWARM.2~3p8F8Dm0U5mVPAce6ztNjQpm3R2wt2_.2 2024-09-12T17:30:40.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.269+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 645 2024-09-12T17:30:40.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.269+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.17__multipart_foo-LUKEWARM.2~3p8F8Dm0U5mVPAce6ztNjQpm3R2wt2_.3 2024-09-12T17:30:40.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.269+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 918 2024-09-12T17:30:40.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.269+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:30:40.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.269+0000 7f893de30800 20 garbage collection: RGWGC::send_chain - on object name: gc.6tag is: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.667413290576992298 2024-09-12T17:30:40.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.270+0000 7f881cff9640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-12T17:30:40.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.270+0000 7f893de30800 20 get_obj_state: octx=0x55891d6db1a0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-STANDARD state=0x55891d6fef18 s->prefetch_data=0 2024-09-12T17:30:40.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.271+0000 7f893de30800 10 manifest: total_size = 16376 2024-09-12T17:30:40.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.271+0000 7f893de30800 20 get_obj_state: setting s->obj_tag to 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.11281699694055619586 2024-09-12T17:30:40.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.271+0000 7f893de30800 20 get_obj_state: octx=0x55891d6db1a0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-STANDARD state=0x55891d6fef18 s->prefetch_data=0 2024-09-12T17:30:40.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.271+0000 7f893de30800 20 prepare_atomic_modification: state is not atomic. state=0x55891d6fef18 2024-09-12T17:30:40.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.271+0000 7f893de30800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.17.7 2024-09-12T17:30:40.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.273+0000 7f893de30800 20 RGWObjManifest::operator++(): rule->part_size=7669 rules.size()=3 2024-09-12T17:30:40.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.273+0000 7f893de30800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=7669 2024-09-12T17:30:40.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.273+0000 7f893de30800 20 RGWObjManifest::operator++(): result: ofs=7669 stripe_ofs=7669 part_ofs=7669 rule->part_size=7672 2024-09-12T17:30:40.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.273+0000 7f893de30800 20 RGWObjManifest::operator++(): rule->part_size=7672 rules.size()=3 2024-09-12T17:30:40.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.273+0000 7f893de30800 20 RGWObjManifest::operator++(): stripe_ofs=6299125 part_ofs=7669 rule->part_size=7672 2024-09-12T17:30:40.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.273+0000 7f893de30800 20 RGWObjManifest::operator++(): result: ofs=15341 stripe_ofs=15341 part_ofs=15341 rule->part_size=1035 2024-09-12T17:30:40.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.273+0000 7f893de30800 20 RGWObjManifest::operator++(): rule->part_size=1035 rules.size()=3 2024-09-12T17:30:40.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.273+0000 7f893de30800 20 RGWObjManifest::operator++(): stripe_ofs=6306797 part_ofs=15341 rule->part_size=1035 2024-09-12T17:30:40.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.273+0000 7f893de30800 20 RGWObjManifest::operator++(): result: ofs=16376 stripe_ofs=16376 part_ofs=16376 rule->part_size=1035 2024-09-12T17:30:40.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.273+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - tag is: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.11281699694055619586 2024-09-12T17:30:40.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.273+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:30:40.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.273+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.17__multipart_foo-STANDARD.2~3Fr5vjon4RjiQMVCfPwWSIjK6F0Py6Z.1 2024-09-12T17:30:40.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.273+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 365 2024-09-12T17:30:40.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.273+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.17__multipart_foo-STANDARD.2~3Fr5vjon4RjiQMVCfPwWSIjK6F0Py6Z.2 2024-09-12T17:30:40.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.273+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 629 2024-09-12T17:30:40.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.273+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.17__multipart_foo-STANDARD.2~3Fr5vjon4RjiQMVCfPwWSIjK6F0Py6Z.3 2024-09-12T17:30:40.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.273+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 893 2024-09-12T17:30:40.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.273+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:30:40.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.273+0000 7f893de30800 20 garbage collection: RGWGC::send_chain - on object name: gc.1tag is: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.11281699694055619586 2024-09-12T17:30:40.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.275+0000 7f880bfff640 20 handle_completion(): completion ok for obj=foo-STANDARD-STANDARD 2024-09-12T17:30:40.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.275+0000 7f893de30800 20 get_obj_state: octx=0x55891d703560 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-LUKEWARM state=0x55891d6fef18 s->prefetch_data=0 2024-09-12T17:30:40.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.275+0000 7f893de30800 10 manifest: total_size = 11534336 2024-09-12T17:30:40.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.275+0000 7f893de30800 20 get_obj_state: setting s->obj_tag to 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.15388750536020454649 2024-09-12T17:30:40.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.275+0000 7f893de30800 20 get_obj_state: octx=0x55891d703560 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-LUKEWARM state=0x55891d6fef18 s->prefetch_data=0 2024-09-12T17:30:40.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.275+0000 7f893de30800 20 prepare_atomic_modification: state is not atomic. state=0x55891d6fef18 2024-09-12T17:30:40.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.275+0000 7f893de30800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.17.8 2024-09-12T17:30:40.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.278+0000 7f893de30800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:30:40.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.278+0000 7f893de30800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-09-12T17:30:40.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.278+0000 7f893de30800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:30:40.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.278+0000 7f893de30800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:30:40.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.278+0000 7f893de30800 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:30:40.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.278+0000 7f893de30800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-12T17:30:40.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.278+0000 7f893de30800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-12T17:30:40.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.278+0000 7f893de30800 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-09-12T17:30:40.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.278+0000 7f893de30800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-12T17:30:40.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.278+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - tag is: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.15388750536020454649 2024-09-12T17:30:40.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.278+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:30:40.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.278+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.17__multipart_foo-LUKEWARM.2~3p8F8Dm0U5mVPAce6ztNjQpm3R2wt2_.1 2024-09-12T17:30:40.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.278+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 374 2024-09-12T17:30:40.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.278+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.17__multipart_foo-LUKEWARM.2~3p8F8Dm0U5mVPAce6ztNjQpm3R2wt2_.2 2024-09-12T17:30:40.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.278+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 647 2024-09-12T17:30:40.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.278+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.17__multipart_foo-LUKEWARM.2~3p8F8Dm0U5mVPAce6ztNjQpm3R2wt2_.3 2024-09-12T17:30:40.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.278+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 920 2024-09-12T17:30:40.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.278+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:30:40.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.278+0000 7f893de30800 20 garbage collection: RGWGC::send_chain - on object name: gc.28tag is: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.15388750536020454649 2024-09-12T17:30:40.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.279+0000 7f881cff9640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-LUKEWARM 2024-09-12T17:30:40.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.279+0000 7f893de30800 20 get_obj_state: octx=0x7f893000ae00 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-FROZEN state=0x55891d6fef18 s->prefetch_data=0 2024-09-12T17:30:40.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.279+0000 7f893de30800 10 manifest: total_size = 16376 2024-09-12T17:30:40.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.279+0000 7f893de30800 20 get_obj_state: setting s->obj_tag to _SGAwRGQuQrIv6zti6O9y2d73GBZtGoq 2024-09-12T17:30:40.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.279+0000 7f893de30800 20 get_obj_state: octx=0x7f893000ae00 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-FROZEN state=0x55891d6fef18 s->prefetch_data=0 2024-09-12T17:30:40.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.279+0000 7f893de30800 20 prepare_atomic_modification: state is not atomic. state=0x55891d6fef18 2024-09-12T17:30:40.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.279+0000 7f893de30800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.17.8 2024-09-12T17:30:40.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.282+0000 7f893de30800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:30:40.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.282+0000 7f893de30800 20 RGWObjManifest::operator++(): result: ofs=16376 stripe_ofs=16376 part_ofs=0 rule->part_size=0 2024-09-12T17:30:40.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.282+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - tag is: _SGAwRGQuQrIv6zti6O9y2d73GBZtGoq 2024-09-12T17:30:40.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.282+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:30:40.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.282+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.17__shadow_.3HNtbN3Mb0Qh7yE-EnLEEZobut1Y5H6_0 2024-09-12T17:30:40.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.282+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-12T17:30:40.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.282+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:30:40.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.282+0000 7f893de30800 20 garbage collection: RGWGC::send_chain - on object name: gc.29tag is: _SGAwRGQuQrIv6zti6O9y2d73GBZtGoq 2024-09-12T17:30:40.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.283+0000 7f880bfff640 20 handle_completion(): completion ok for obj=foo-STANDARD-FROZEN 2024-09-12T17:30:40.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.283+0000 7f893de30800 20 get_obj_state: octx=0x55891d6e80b0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-FROZEN state=0x55891d6fef18 s->prefetch_data=0 2024-09-12T17:30:40.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.284+0000 7f893de30800 10 manifest: total_size = 11534336 2024-09-12T17:30:40.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.284+0000 7f893de30800 20 get_obj_state: setting s->obj_tag to 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.12767497614370164650 2024-09-12T17:30:40.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.284+0000 7f893de30800 20 get_obj_state: octx=0x55891d6e80b0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-FROZEN state=0x55891d6fef18 s->prefetch_data=0 2024-09-12T17:30:40.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.284+0000 7f893de30800 20 prepare_atomic_modification: state is not atomic. state=0x55891d6fef18 2024-09-12T17:30:40.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.284+0000 7f893de30800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.17.9 2024-09-12T17:30:40.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.286+0000 7f893de30800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:30:40.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.286+0000 7f893de30800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-09-12T17:30:40.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.286+0000 7f893de30800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:30:40.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.286+0000 7f893de30800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:30:40.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.286+0000 7f893de30800 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:30:40.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.286+0000 7f893de30800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-12T17:30:40.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.286+0000 7f893de30800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-12T17:30:40.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.286+0000 7f893de30800 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-09-12T17:30:40.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.286+0000 7f893de30800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-12T17:30:40.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.286+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - tag is: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.12767497614370164650 2024-09-12T17:30:40.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.286+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:30:40.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.286+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.17__multipart_foo-FROZEN.2~mK5UcGwPkCsgvLpZEsTArO48JetS8zO.1 2024-09-12T17:30:40.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.286+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 368 2024-09-12T17:30:40.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.286+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.17__multipart_foo-FROZEN.2~mK5UcGwPkCsgvLpZEsTArO48JetS8zO.2 2024-09-12T17:30:40.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.286+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 635 2024-09-12T17:30:40.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.286+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.17__multipart_foo-FROZEN.2~mK5UcGwPkCsgvLpZEsTArO48JetS8zO.3 2024-09-12T17:30:40.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.286+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 902 2024-09-12T17:30:40.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.286+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:30:40.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.286+0000 7f893de30800 20 garbage collection: RGWGC::send_chain - on object name: gc.14tag is: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.12767497614370164650 2024-09-12T17:30:40.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.287+0000 7f881cff9640 20 handle_completion(): completion ok for obj=foo-FROZEN-FROZEN 2024-09-12T17:30:40.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.287+0000 7f893de30800 20 list_objects_ordered: starting attempt 1 2024-09-12T17:30:40.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.288+0000 7f893de30800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T17:30:40.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.288+0000 7f893de30800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T17:30:40.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.288+0000 7f893de30800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T17:30:40.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.288+0000 7f893de30800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T17:30:40.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.288+0000 7f893de30800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T17:30:40.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.288+0000 7f893de30800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-multipart-copy.1[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.17])"; uploads.size()=0; is_truncated=0 2024-09-12T17:30:40.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.290+0000 7f893de30800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 : miss 2024-09-12T17:30:40.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.290+0000 7f893de30800 20 rados->read ofs=0 len=0 2024-09-12T17:30:40.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.291+0000 7f893de30800 20 rados_obj.operate() r=0 bl.length=243 2024-09-12T17:30:40.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.291+0000 7f893de30800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x11 2024-09-12T17:30:40.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.291+0000 7f893de30800 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2024-09-12T17:30:40.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.292+0000 7f893de30800 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 from cache 2024-09-12T17:30:40.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.292+0000 7f893de30800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart-copy.1, ofs0, ns] 2024-09-12T17:30:40.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.292+0000 7f880bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562378 cookie 94047392356304 notifier 5684 bl.length()=199 2024-09-12T17:30:40.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.295+0000 7f893de30800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.17 from cache 2024-09-12T17:30:40.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.295+0000 7f893de30800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.17, ofs0, ns] 2024-09-12T17:30:40.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.295+0000 7f881cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562382 cookie 94047392351168 notifier 5684 bl.length()=257 2024-09-12T17:30:40.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.299+0000 7f893de30800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/722b129a-cf7a-4aca-b594-5b9492d130e2.4623.17 : miss 2024-09-12T17:30:40.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.299+0000 7f893de30800 20 rados->read ofs=0 len=0 2024-09-12T17:30:40.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.299+0000 7f893de30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:40.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.299+0000 7f893de30800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/722b129a-cf7a-4aca-b594-5b9492d130e2.4623.17 info.flags=0x0 2024-09-12T17:30:40.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.299+0000 7f893de30800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/722b129a-cf7a-4aca-b594-5b9492d130e2.4623.17 to cache LRU end 2024-09-12T17:30:40.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.301+0000 7f893de30800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.15 : miss 2024-09-12T17:30:40.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.301+0000 7f893de30800 20 rados->read ofs=0 len=0 2024-09-12T17:30:40.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.302+0000 7f893de30800 20 rados_obj.operate() r=0 bl.length=460 2024-09-12T17:30:40.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.302+0000 7f893de30800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.15 info.flags=0x17 2024-09-12T17:30:40.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.302+0000 7f893de30800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.15 to cache LRU end 2024-09-12T17:30:40.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.302+0000 7f893de30800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:30:40.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.302+0000 7f893de30800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T17:30:40.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.302+0000 7f893de30800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.15 2024-09-12T17:30:40.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.303+0000 7f893de30800 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-12T17:30:40.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.304+0000 7f893de30800 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-12T17:30:40.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.305+0000 7f893de30800 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-12T17:30:40.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.306+0000 7f893de30800 20 get_obj_state: octx=0x55891d758da0 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-FROZEN state=0x55891d6dfbf8 s->prefetch_data=0 2024-09-12T17:30:40.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.306+0000 7f893de30800 10 manifest: total_size = 11534336 2024-09-12T17:30:40.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.306+0000 7f893de30800 20 get_obj_state: setting s->obj_tag to 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18382905173119541097 2024-09-12T17:30:40.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.306+0000 7f893de30800 20 get_obj_state: octx=0x55891d758da0 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-FROZEN state=0x55891d6dfbf8 s->prefetch_data=0 2024-09-12T17:30:40.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.306+0000 7f893de30800 20 prepare_atomic_modification: state is not atomic. state=0x55891d6dfbf8 2024-09-12T17:30:40.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.306+0000 7f893de30800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.15.3 2024-09-12T17:30:40.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.309+0000 7f893de30800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:30:40.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.309+0000 7f893de30800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-09-12T17:30:40.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.309+0000 7f893de30800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:30:40.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.309+0000 7f893de30800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:30:40.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.309+0000 7f893de30800 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:30:40.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.309+0000 7f893de30800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-12T17:30:40.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.309+0000 7f893de30800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-12T17:30:40.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.309+0000 7f893de30800 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-09-12T17:30:40.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.309+0000 7f893de30800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-12T17:30:40.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.309+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - tag is: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18382905173119541097 2024-09-12T17:30:40.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.309+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:30:40.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.309+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.15__multipart_foo-FROZEN.2~rmgNxRFuLGqWfUx3oAVF7QnjCBP1g7r.1 2024-09-12T17:30:40.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.309+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 368 2024-09-12T17:30:40.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.309+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.15__multipart_foo-FROZEN.2~rmgNxRFuLGqWfUx3oAVF7QnjCBP1g7r.2 2024-09-12T17:30:40.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.309+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 635 2024-09-12T17:30:40.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.309+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.15__multipart_foo-FROZEN.2~rmgNxRFuLGqWfUx3oAVF7QnjCBP1g7r.3 2024-09-12T17:30:40.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.309+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 902 2024-09-12T17:30:40.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.309+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:30:40.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.309+0000 7f893de30800 20 garbage collection: RGWGC::send_chain - on object name: gc.1tag is: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18382905173119541097 2024-09-12T17:30:40.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.310+0000 7f881cff9640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-12T17:30:40.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.310+0000 7f893de30800 20 get_obj_state: octx=0x7f893001eed0 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-STANDARD state=0x55891d6fef18 s->prefetch_data=0 2024-09-12T17:30:40.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.311+0000 7f893de30800 10 manifest: total_size = 541681 2024-09-12T17:30:40.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.311+0000 7f893de30800 20 get_obj_state: setting s->obj_tag to 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.17124026983468503466 2024-09-12T17:30:40.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.311+0000 7f893de30800 20 get_obj_state: octx=0x7f893001eed0 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-STANDARD state=0x55891d6fef18 s->prefetch_data=0 2024-09-12T17:30:40.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.311+0000 7f893de30800 20 prepare_atomic_modification: state is not atomic. state=0x55891d6fef18 2024-09-12T17:30:40.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.311+0000 7f893de30800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.15.5 2024-09-12T17:30:40.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.313+0000 7f893de30800 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-12T17:30:40.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.314+0000 7f893de30800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=246247 2024-09-12T17:30:40.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.314+0000 7f893de30800 20 RGWObjManifest::operator++(): result: ofs=246247 stripe_ofs=246247 part_ofs=246247 rule->part_size=246247 2024-09-12T17:30:40.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.314+0000 7f893de30800 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-12T17:30:40.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.314+0000 7f893de30800 20 RGWObjManifest::operator++(): stripe_ofs=6537703 part_ofs=246247 rule->part_size=246247 2024-09-12T17:30:40.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.314+0000 7f893de30800 20 RGWObjManifest::operator++(): result: ofs=492494 stripe_ofs=492494 part_ofs=492494 rule->part_size=49187 2024-09-12T17:30:40.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.314+0000 7f893de30800 20 RGWObjManifest::operator++(): rule->part_size=49187 rules.size()=2 2024-09-12T17:30:40.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.314+0000 7f893de30800 20 RGWObjManifest::operator++(): stripe_ofs=6783950 part_ofs=492494 rule->part_size=49187 2024-09-12T17:30:40.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.314+0000 7f893de30800 20 RGWObjManifest::operator++(): result: ofs=541681 stripe_ofs=541681 part_ofs=541681 rule->part_size=49187 2024-09-12T17:30:40.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.314+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - tag is: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.17124026983468503466 2024-09-12T17:30:40.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.314+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:30:40.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.314+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.15__multipart_foo-STANDARD.2~CWUr_0hd_E967talIygMTLP0uGj-zPn.1 2024-09-12T17:30:40.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.314+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 365 2024-09-12T17:30:40.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.314+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.15__multipart_foo-STANDARD.2~CWUr_0hd_E967talIygMTLP0uGj-zPn.2 2024-09-12T17:30:40.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.314+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 629 2024-09-12T17:30:40.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.314+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.15__multipart_foo-STANDARD.2~CWUr_0hd_E967talIygMTLP0uGj-zPn.3 2024-09-12T17:30:40.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.314+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 893 2024-09-12T17:30:40.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.314+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:30:40.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.314+0000 7f893de30800 20 garbage collection: RGWGC::send_chain - on object name: gc.28tag is: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.17124026983468503466 2024-09-12T17:30:40.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.315+0000 7f880bfff640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-12T17:30:40.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.315+0000 7f893de30800 20 get_obj_state: octx=0x7f8934006620 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-LUKEWARM state=0x55891d6fef18 s->prefetch_data=0 2024-09-12T17:30:40.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.315+0000 7f893de30800 10 manifest: total_size = 11534336 2024-09-12T17:30:40.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.315+0000 7f893de30800 20 get_obj_state: setting s->obj_tag to 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.11052335611803842256 2024-09-12T17:30:40.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.315+0000 7f893de30800 20 get_obj_state: octx=0x7f8934006620 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-LUKEWARM state=0x55891d6fef18 s->prefetch_data=0 2024-09-12T17:30:40.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.315+0000 7f893de30800 20 prepare_atomic_modification: state is not atomic. state=0x55891d6fef18 2024-09-12T17:30:40.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.315+0000 7f893de30800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.15.7 2024-09-12T17:30:40.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.318+0000 7f893de30800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:30:40.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.318+0000 7f893de30800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-09-12T17:30:40.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.318+0000 7f893de30800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:30:40.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.318+0000 7f893de30800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:30:40.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.318+0000 7f893de30800 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:30:40.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.318+0000 7f893de30800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-12T17:30:40.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.318+0000 7f893de30800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-12T17:30:40.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.318+0000 7f893de30800 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-09-12T17:30:40.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.318+0000 7f893de30800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-12T17:30:40.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.318+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - tag is: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.11052335611803842256 2024-09-12T17:30:40.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.318+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:30:40.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.318+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.15__multipart_foo-LUKEWARM.2~cfK8En_Z4Mxjy1_iPlLAuZWgfLvwKUK.1 2024-09-12T17:30:40.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.318+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 374 2024-09-12T17:30:40.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.318+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.15__multipart_foo-LUKEWARM.2~cfK8En_Z4Mxjy1_iPlLAuZWgfLvwKUK.2 2024-09-12T17:30:40.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.318+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 647 2024-09-12T17:30:40.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.318+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.15__multipart_foo-LUKEWARM.2~cfK8En_Z4Mxjy1_iPlLAuZWgfLvwKUK.3 2024-09-12T17:30:40.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.318+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 920 2024-09-12T17:30:40.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.318+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:30:40.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.318+0000 7f893de30800 20 garbage collection: RGWGC::send_chain - on object name: gc.17tag is: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.11052335611803842256 2024-09-12T17:30:40.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.319+0000 7f881cff9640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-12T17:30:40.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.319+0000 7f893de30800 20 list_objects_ordered: starting attempt 1 2024-09-12T17:30:40.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.319+0000 7f893de30800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T17:30:40.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.320+0000 7f893de30800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T17:30:40.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.320+0000 7f893de30800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T17:30:40.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.320+0000 7f893de30800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T17:30:40.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.320+0000 7f893de30800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T17:30:40.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.320+0000 7f893de30800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-multipart.1[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.15])"; uploads.size()=0; is_truncated=0 2024-09-12T17:30:40.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.322+0000 7f893de30800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 : miss 2024-09-12T17:30:40.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.322+0000 7f893de30800 20 rados->read ofs=0 len=0 2024-09-12T17:30:40.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.322+0000 7f893de30800 20 rados_obj.operate() r=0 bl.length=238 2024-09-12T17:30:40.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.322+0000 7f893de30800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 info.flags=0x11 2024-09-12T17:30:40.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.322+0000 7f893de30800 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 to cache LRU end 2024-09-12T17:30:40.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.323+0000 7f893de30800 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 from cache 2024-09-12T17:30:40.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.323+0000 7f893de30800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart.1, ofs0, ns] 2024-09-12T17:30:40.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.324+0000 7f881cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562383 cookie 94047392351168 notifier 5684 bl.length()=194 2024-09-12T17:30:40.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.326+0000 7f893de30800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.15 from cache 2024-09-12T17:30:40.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.326+0000 7f893de30800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.15, ofs0, ns] 2024-09-12T17:30:40.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.327+0000 7f880bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562384 cookie 94047392351168 notifier 5684 bl.length()=252 2024-09-12T17:30:40.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.330+0000 7f893de30800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/722b129a-cf7a-4aca-b594-5b9492d130e2.4623.15 : miss 2024-09-12T17:30:40.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.330+0000 7f893de30800 20 rados->read ofs=0 len=0 2024-09-12T17:30:40.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.330+0000 7f893de30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:40.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.330+0000 7f893de30800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/722b129a-cf7a-4aca-b594-5b9492d130e2.4623.15 info.flags=0x0 2024-09-12T17:30:40.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.330+0000 7f893de30800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/722b129a-cf7a-4aca-b594-5b9492d130e2.4623.15 to cache LRU end 2024-09-12T17:30:40.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.332+0000 7f893de30800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.14 : miss 2024-09-12T17:30:40.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.332+0000 7f893de30800 20 rados->read ofs=0 len=0 2024-09-12T17:30:40.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.333+0000 7f893de30800 20 rados_obj.operate() r=0 bl.length=450 2024-09-12T17:30:40.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.333+0000 7f893de30800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.14 info.flags=0x17 2024-09-12T17:30:40.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.333+0000 7f893de30800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.14 to cache LRU end 2024-09-12T17:30:40.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.333+0000 7f893de30800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:30:40.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.333+0000 7f893de30800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T17:30:40.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.333+0000 7f893de30800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.14 2024-09-12T17:30:40.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.334+0000 7f893de30800 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-12T17:30:40.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.335+0000 7f893de30800 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-12T17:30:40.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.336+0000 7f893de30800 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-12T17:30:40.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.337+0000 7f893de30800 20 get_obj_state: octx=0x55891d6dabd0 obj=test-client.0-r-test-obj-storage-class.1:foo-FROZEN state=0x55891d6fd998 s->prefetch_data=0 2024-09-12T17:30:40.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.338+0000 7f893de30800 10 manifest: total_size = 10485760 2024-09-12T17:30:40.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.338+0000 7f893de30800 20 get_obj_state: setting s->obj_tag to 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.10999708332186763869 2024-09-12T17:30:40.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.338+0000 7f893de30800 20 get_obj_state: octx=0x55891d6dabd0 obj=test-client.0-r-test-obj-storage-class.1:foo-FROZEN state=0x55891d6fd998 s->prefetch_data=0 2024-09-12T17:30:40.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.338+0000 7f893de30800 20 prepare_atomic_modification: state is not atomic. state=0x55891d6fd998 2024-09-12T17:30:40.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.338+0000 7f893de30800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.14.3 2024-09-12T17:30:40.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.340+0000 7f893de30800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:30:40.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.340+0000 7f893de30800 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2024-09-12T17:30:40.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.340+0000 7f893de30800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:30:40.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.340+0000 7f893de30800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2024-09-12T17:30:40.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.340+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - tag is: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.10999708332186763869 2024-09-12T17:30:40.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.340+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:30:40.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.340+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.14__shadow_.co5pdLIRRD6dAyOISnS4RCiP1XNW7T7_0 2024-09-12T17:30:40.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.340+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 338 2024-09-12T17:30:40.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.340+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.14__shadow_.co5pdLIRRD6dAyOISnS4RCiP1XNW7T7_1 2024-09-12T17:30:40.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.340+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 575 2024-09-12T17:30:40.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.340+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:30:40.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.340+0000 7f893de30800 20 garbage collection: RGWGC::send_chain - on object name: gc.23tag is: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.10999708332186763869 2024-09-12T17:30:40.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.341+0000 7f880bfff640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-12T17:30:40.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.342+0000 7f893de30800 20 get_obj_state: octx=0x55891d6fd580 obj=test-client.0-r-test-obj-storage-class.1:foo-STANDARD state=0x55891d6fd998 s->prefetch_data=0 2024-09-12T17:30:40.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.342+0000 7f893de30800 10 manifest: total_size = 3312 2024-09-12T17:30:40.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.342+0000 7f893de30800 20 get_obj_state: setting s->obj_tag to 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.15909531202862343031 2024-09-12T17:30:40.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.342+0000 7f893de30800 20 get_obj_state: octx=0x55891d6fd580 obj=test-client.0-r-test-obj-storage-class.1:foo-STANDARD state=0x55891d6fd998 s->prefetch_data=0 2024-09-12T17:30:40.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.342+0000 7f893de30800 20 prepare_atomic_modification: state is not atomic. state=0x55891d6fd998 2024-09-12T17:30:40.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.342+0000 7f893de30800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.14.5 2024-09-12T17:30:40.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.345+0000 7f893de30800 20 get_obj_state: octx=0x7f8934006620 obj=test-client.0-r-test-obj-storage-class.1:foo-LUKEWARM state=0x55891d6fd998 s->prefetch_data=0 2024-09-12T17:30:40.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.345+0000 7f893de30800 10 manifest: total_size = 10485760 2024-09-12T17:30:40.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.345+0000 7f893de30800 20 get_obj_state: setting s->obj_tag to 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.1109770148586127526 2024-09-12T17:30:40.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.345+0000 7f893de30800 20 get_obj_state: octx=0x7f8934006620 obj=test-client.0-r-test-obj-storage-class.1:foo-LUKEWARM state=0x55891d6fd998 s->prefetch_data=0 2024-09-12T17:30:40.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.345+0000 7f893de30800 20 prepare_atomic_modification: state is not atomic. state=0x55891d6fd998 2024-09-12T17:30:40.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.345+0000 7f893de30800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.14.7 2024-09-12T17:30:40.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.346+0000 7f881cff9640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-12T17:30:40.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.347+0000 7f893de30800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:30:40.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.347+0000 7f893de30800 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2024-09-12T17:30:40.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.347+0000 7f893de30800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:30:40.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.347+0000 7f893de30800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2024-09-12T17:30:40.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.347+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - tag is: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.1109770148586127526 2024-09-12T17:30:40.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.347+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:30:40.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.347+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.14__shadow_._xhTewaxGpJ2vS6U0lbhH1m3vEiOj9H_0 2024-09-12T17:30:40.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.347+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 339 2024-09-12T17:30:40.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.347+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.14__shadow_._xhTewaxGpJ2vS6U0lbhH1m3vEiOj9H_1 2024-09-12T17:30:40.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.347+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 578 2024-09-12T17:30:40.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.347+0000 7f893de30800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:30:40.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.347+0000 7f893de30800 20 garbage collection: RGWGC::send_chain - on object name: gc.16tag is: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.1109770148586127526 2024-09-12T17:30:40.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.349+0000 7f880bfff640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-12T17:30:40.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.349+0000 7f893de30800 20 list_objects_ordered: starting attempt 1 2024-09-12T17:30:40.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.349+0000 7f893de30800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T17:30:40.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.350+0000 7f893de30800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T17:30:40.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.350+0000 7f893de30800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T17:30:40.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.350+0000 7f893de30800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T17:30:40.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.350+0000 7f893de30800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T17:30:40.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.350+0000 7f893de30800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class.1[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.14])"; uploads.size()=0; is_truncated=0 2024-09-12T17:30:40.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.352+0000 7f893de30800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 : miss 2024-09-12T17:30:40.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.352+0000 7f893de30800 20 rados->read ofs=0 len=0 2024-09-12T17:30:40.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.352+0000 7f893de30800 20 rados_obj.operate() r=0 bl.length=228 2024-09-12T17:30:40.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.352+0000 7f893de30800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 info.flags=0x11 2024-09-12T17:30:40.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.352+0000 7f893de30800 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 to cache LRU end 2024-09-12T17:30:40.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.353+0000 7f893de30800 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 from cache 2024-09-12T17:30:40.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.353+0000 7f893de30800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class.1, ofs0, ns] 2024-09-12T17:30:40.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.353+0000 7f880bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562399 cookie 94047392353664 notifier 5684 bl.length()=184 2024-09-12T17:30:40.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.356+0000 7f893de30800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.14 from cache 2024-09-12T17:30:40.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.356+0000 7f893de30800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class.1:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.14, ofs0, ns] 2024-09-12T17:30:40.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.357+0000 7f880bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562446 cookie 94047392358944 notifier 5684 bl.length()=242 2024-09-12T17:30:40.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.361+0000 7f893de30800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/722b129a-cf7a-4aca-b594-5b9492d130e2.4623.14 : miss 2024-09-12T17:30:40.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.361+0000 7f893de30800 20 rados->read ofs=0 len=0 2024-09-12T17:30:40.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.361+0000 7f893de30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:40.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.361+0000 7f893de30800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/722b129a-cf7a-4aca-b594-5b9492d130e2.4623.14 info.flags=0x0 2024-09-12T17:30:40.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.361+0000 7f893de30800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/722b129a-cf7a-4aca-b594-5b9492d130e2.4623.14 to cache LRU end 2024-09-12T17:30:40.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.363+0000 7f893de30800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.7 : miss 2024-09-12T17:30:40.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.363+0000 7f893de30800 20 rados->read ofs=0 len=0 2024-09-12T17:30:40.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.364+0000 7f893de30800 20 rados_obj.operate() r=0 bl.length=445 2024-09-12T17:30:40.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.364+0000 7f893de30800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.7 info.flags=0x17 2024-09-12T17:30:40.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.364+0000 7f893de30800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.7 to cache LRU end 2024-09-12T17:30:40.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.364+0000 7f893de30800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:30:40.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.364+0000 7f893de30800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T17:30:40.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.364+0000 7f893de30800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.7 2024-09-12T17:30:40.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.365+0000 7f893de30800 10 cls_bucket_list_unordered: got ___ 2024-09-12T17:30:40.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.365+0000 7f893de30800 10 cls_bucket_list_unordered: got __ _ 2024-09-12T17:30:40.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.366+0000 7f893de30800 10 cls_bucket_list_unordered: got __ 2024-09-12T17:30:40.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.367+0000 7f893de30800 10 cls_bucket_list_unordered: got obj 2024-09-12T17:30:40.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.368+0000 7f893de30800 20 get_obj_state: octx=0x55891d75bad0 obj=test-client.0-r-test-small-obj-data.1:___ state=0x55891d6fd998 s->prefetch_data=0 2024-09-12T17:30:40.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.368+0000 7f893de30800 10 manifest: total_size = 0 2024-09-12T17:30:40.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.368+0000 7f893de30800 20 get_obj_state: setting s->obj_tag to 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.1785271634544754688 2024-09-12T17:30:40.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.368+0000 7f893de30800 20 get_obj_state: octx=0x55891d75bad0 obj=test-client.0-r-test-small-obj-data.1:___ state=0x55891d6fd998 s->prefetch_data=0 2024-09-12T17:30:40.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.368+0000 7f893de30800 20 prepare_atomic_modification: state is not atomic. state=0x55891d6fd998 2024-09-12T17:30:40.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.368+0000 7f893de30800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.7.2 2024-09-12T17:30:40.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.371+0000 7f893de30800 20 get_obj_state: octx=0x55891d75bad0 obj=test-client.0-r-test-small-obj-data.1:__ _ state=0x55891d6fd998 s->prefetch_data=0 2024-09-12T17:30:40.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.371+0000 7f893de30800 10 manifest: total_size = 0 2024-09-12T17:30:40.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.371+0000 7f893de30800 20 get_obj_state: setting s->obj_tag to 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.17263820249907956479 2024-09-12T17:30:40.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.371+0000 7f893de30800 20 get_obj_state: octx=0x55891d75bad0 obj=test-client.0-r-test-small-obj-data.1:__ _ state=0x55891d6fd998 s->prefetch_data=0 2024-09-12T17:30:40.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.371+0000 7f893de30800 20 prepare_atomic_modification: state is not atomic. state=0x55891d6fd998 2024-09-12T17:30:40.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.371+0000 7f893de30800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.7.3 2024-09-12T17:30:40.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.372+0000 7f881cff9640 20 handle_completion(): completion ok for obj=___ 2024-09-12T17:30:40.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.374+0000 7f893de30800 20 get_obj_state: octx=0x55891d6e5770 obj=test-client.0-r-test-small-obj-data.1:__ state=0x55891d6fd998 s->prefetch_data=0 2024-09-12T17:30:40.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.374+0000 7f893de30800 10 manifest: total_size = 0 2024-09-12T17:30:40.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.374+0000 7f893de30800 20 get_obj_state: setting s->obj_tag to 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.14238756235056873595 2024-09-12T17:30:40.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.374+0000 7f893de30800 20 get_obj_state: octx=0x55891d6e5770 obj=test-client.0-r-test-small-obj-data.1:__ state=0x55891d6fd998 s->prefetch_data=0 2024-09-12T17:30:40.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.374+0000 7f893de30800 20 prepare_atomic_modification: state is not atomic. state=0x55891d6fd998 2024-09-12T17:30:40.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.374+0000 7f893de30800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.7.6 2024-09-12T17:30:40.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.375+0000 7f880bfff640 20 handle_completion(): completion ok for obj=__ _ 2024-09-12T17:30:40.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.377+0000 7f893de30800 20 get_obj_state: octx=0x7f89300a36c0 obj=test-client.0-r-test-small-obj-data.1:obj state=0x55891d6fd998 s->prefetch_data=0 2024-09-12T17:30:40.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.377+0000 7f893de30800 10 manifest: total_size = 0 2024-09-12T17:30:40.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.377+0000 7f893de30800 20 get_obj_state: setting s->obj_tag to 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.14742634320972240357 2024-09-12T17:30:40.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.377+0000 7f893de30800 20 get_obj_state: octx=0x7f89300a36c0 obj=test-client.0-r-test-small-obj-data.1:obj state=0x55891d6fd998 s->prefetch_data=0 2024-09-12T17:30:40.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.377+0000 7f893de30800 20 prepare_atomic_modification: state is not atomic. state=0x55891d6fd998 2024-09-12T17:30:40.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.377+0000 7f893de30800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.7.8 2024-09-12T17:30:40.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.378+0000 7f881cff9640 20 handle_completion(): completion ok for obj=__ 2024-09-12T17:30:40.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.380+0000 7f893de30800 20 list_objects_ordered: starting attempt 1 2024-09-12T17:30:40.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.380+0000 7f893de30800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T17:30:40.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.381+0000 7f880bfff640 20 handle_completion(): completion ok for obj=obj 2024-09-12T17:30:40.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.381+0000 7f893de30800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T17:30:40.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.381+0000 7f893de30800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T17:30:40.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.381+0000 7f893de30800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T17:30:40.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.381+0000 7f893de30800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T17:30:40.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.381+0000 7f893de30800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.1[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.7])"; uploads.size()=0; is_truncated=0 2024-09-12T17:30:40.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.383+0000 7f893de30800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 : miss 2024-09-12T17:30:40.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.383+0000 7f893de30800 20 rados->read ofs=0 len=0 2024-09-12T17:30:40.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.383+0000 7f893de30800 20 rados_obj.operate() r=0 bl.length=223 2024-09-12T17:30:40.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.383+0000 7f893de30800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 info.flags=0x11 2024-09-12T17:30:40.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.383+0000 7f893de30800 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 to cache LRU end 2024-09-12T17:30:40.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.385+0000 7f893de30800 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 from cache 2024-09-12T17:30:40.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.385+0000 7f893de30800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.1, ofs0, ns] 2024-09-12T17:30:40.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.385+0000 7f881cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562435 cookie 94047392342960 notifier 5684 bl.length()=181 2024-09-12T17:30:40.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.387+0000 7f893de30800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.7 from cache 2024-09-12T17:30:40.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.387+0000 7f893de30800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.1:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.7, ofs0, ns] 2024-09-12T17:30:40.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.388+0000 7f880bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562400 cookie 94047392353664 notifier 5684 bl.length()=238 2024-09-12T17:30:40.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.392+0000 7f893de30800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/722b129a-cf7a-4aca-b594-5b9492d130e2.4623.7 : miss 2024-09-12T17:30:40.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.392+0000 7f893de30800 20 rados->read ofs=0 len=0 2024-09-12T17:30:40.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.392+0000 7f893de30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:40.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.392+0000 7f893de30800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/722b129a-cf7a-4aca-b594-5b9492d130e2.4623.7 info.flags=0x0 2024-09-12T17:30:40.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.392+0000 7f893de30800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/722b129a-cf7a-4aca-b594-5b9492d130e2.4623.7 to cache LRU end 2024-09-12T17:30:40.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.395+0000 7f893de30800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.8 : miss 2024-09-12T17:30:40.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.395+0000 7f893de30800 20 rados->read ofs=0 len=0 2024-09-12T17:30:40.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.395+0000 7f893de30800 20 rados_obj.operate() r=0 bl.length=445 2024-09-12T17:30:40.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.395+0000 7f893de30800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.8 info.flags=0x17 2024-09-12T17:30:40.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.395+0000 7f893de30800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.8 to cache LRU end 2024-09-12T17:30:40.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.395+0000 7f893de30800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:30:40.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.395+0000 7f893de30800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T17:30:40.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.395+0000 7f893de30800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.8 2024-09-12T17:30:40.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.396+0000 7f893de30800 10 cls_bucket_list_unordered: got ___ 2024-09-12T17:30:40.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.397+0000 7f893de30800 10 cls_bucket_list_unordered: got __ _ 2024-09-12T17:30:40.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.398+0000 7f893de30800 10 cls_bucket_list_unordered: got __ 2024-09-12T17:30:40.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.399+0000 7f893de30800 10 cls_bucket_list_unordered: got obj 2024-09-12T17:30:40.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.399+0000 7f893de30800 20 get_obj_state: octx=0x7f8934014db0 obj=test-client.0-r-test-small-obj-data.2:___ state=0x55891d70abf8 s->prefetch_data=0 2024-09-12T17:30:40.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.400+0000 7f893de30800 10 manifest: total_size = 527 2024-09-12T17:30:40.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.400+0000 7f893de30800 20 get_obj_state: setting s->obj_tag to 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.13824060464941812601 2024-09-12T17:30:40.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.400+0000 7f893de30800 20 get_obj_state: octx=0x7f8934014db0 obj=test-client.0-r-test-small-obj-data.2:___ state=0x55891d70abf8 s->prefetch_data=0 2024-09-12T17:30:40.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.400+0000 7f893de30800 20 prepare_atomic_modification: state is not atomic. state=0x55891d70abf8 2024-09-12T17:30:40.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.400+0000 7f893de30800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.8.2 2024-09-12T17:30:40.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.403+0000 7f893de30800 20 get_obj_state: octx=0x7f8934014db0 obj=test-client.0-r-test-small-obj-data.2:__ _ state=0x55891d635388 s->prefetch_data=0 2024-09-12T17:30:40.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.403+0000 7f893de30800 10 manifest: total_size = 527 2024-09-12T17:30:40.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.403+0000 7f893de30800 20 get_obj_state: setting s->obj_tag to 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.15944000167842927642 2024-09-12T17:30:40.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.403+0000 7f893de30800 20 get_obj_state: octx=0x7f8934014db0 obj=test-client.0-r-test-small-obj-data.2:__ _ state=0x55891d635388 s->prefetch_data=0 2024-09-12T17:30:40.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.403+0000 7f893de30800 20 prepare_atomic_modification: state is not atomic. state=0x55891d635388 2024-09-12T17:30:40.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.403+0000 7f893de30800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.8.3 2024-09-12T17:30:40.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.404+0000 7f881cff9640 20 handle_completion(): completion ok for obj=___ 2024-09-12T17:30:40.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.405+0000 7f893de30800 20 get_obj_state: octx=0x7f8934014db0 obj=test-client.0-r-test-small-obj-data.2:__ state=0x55891d635388 s->prefetch_data=0 2024-09-12T17:30:40.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.406+0000 7f893de30800 10 manifest: total_size = 38 2024-09-12T17:30:40.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.406+0000 7f893de30800 20 get_obj_state: setting s->obj_tag to 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.17718238183432046373 2024-09-12T17:30:40.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.406+0000 7f893de30800 20 get_obj_state: octx=0x7f8934014db0 obj=test-client.0-r-test-small-obj-data.2:__ state=0x55891d635388 s->prefetch_data=0 2024-09-12T17:30:40.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.406+0000 7f893de30800 20 prepare_atomic_modification: state is not atomic. state=0x55891d635388 2024-09-12T17:30:40.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.406+0000 7f893de30800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.8.6 2024-09-12T17:30:40.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.407+0000 7f880bfff640 20 handle_completion(): completion ok for obj=__ _ 2024-09-12T17:30:40.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.409+0000 7f893de30800 20 get_obj_state: octx=0x55891d6dad10 obj=test-client.0-r-test-small-obj-data.2:obj state=0x55891d635388 s->prefetch_data=0 2024-09-12T17:30:40.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.409+0000 7f893de30800 10 manifest: total_size = 524288 2024-09-12T17:30:40.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.409+0000 7f893de30800 20 get_obj_state: setting s->obj_tag to 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2813147585648356693 2024-09-12T17:30:40.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.409+0000 7f893de30800 20 get_obj_state: octx=0x55891d6dad10 obj=test-client.0-r-test-small-obj-data.2:obj state=0x55891d635388 s->prefetch_data=0 2024-09-12T17:30:40.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.409+0000 7f893de30800 20 prepare_atomic_modification: state is not atomic. state=0x55891d635388 2024-09-12T17:30:40.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.409+0000 7f893de30800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.8.8 2024-09-12T17:30:40.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.410+0000 7f881cff9640 20 handle_completion(): completion ok for obj=__ 2024-09-12T17:30:40.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.412+0000 7f893de30800 20 list_objects_ordered: starting attempt 1 2024-09-12T17:30:40.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.412+0000 7f893de30800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T17:30:40.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.413+0000 7f880bfff640 20 handle_completion(): completion ok for obj=obj 2024-09-12T17:30:40.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.413+0000 7f893de30800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T17:30:40.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.413+0000 7f893de30800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T17:30:40.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.413+0000 7f893de30800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T17:30:40.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.413+0000 7f893de30800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T17:30:40.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.414+0000 7f893de30800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.2[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.8])"; uploads.size()=0; is_truncated=0 2024-09-12T17:30:40.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.415+0000 7f893de30800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 : miss 2024-09-12T17:30:40.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.415+0000 7f893de30800 20 rados->read ofs=0 len=0 2024-09-12T17:30:40.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.416+0000 7f893de30800 20 rados_obj.operate() r=0 bl.length=223 2024-09-12T17:30:40.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.416+0000 7f893de30800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 info.flags=0x11 2024-09-12T17:30:40.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.416+0000 7f893de30800 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 to cache LRU end 2024-09-12T17:30:40.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.417+0000 7f893de30800 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 from cache 2024-09-12T17:30:40.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.417+0000 7f893de30800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.2, ofs0, ns] 2024-09-12T17:30:40.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.417+0000 7f881cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562436 cookie 94047392342960 notifier 5684 bl.length()=181 2024-09-12T17:30:40.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.420+0000 7f893de30800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.8 from cache 2024-09-12T17:30:40.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.420+0000 7f893de30800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.2:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.8, ofs0, ns] 2024-09-12T17:30:40.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.421+0000 7f881cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562401 cookie 94047392353664 notifier 5684 bl.length()=238 2024-09-12T17:30:40.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.424+0000 7f893de30800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/722b129a-cf7a-4aca-b594-5b9492d130e2.4623.8 : miss 2024-09-12T17:30:40.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.424+0000 7f893de30800 20 rados->read ofs=0 len=0 2024-09-12T17:30:40.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.425+0000 7f893de30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:40.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.425+0000 7f893de30800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/722b129a-cf7a-4aca-b594-5b9492d130e2.4623.8 info.flags=0x0 2024-09-12T17:30:40.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.425+0000 7f893de30800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/722b129a-cf7a-4aca-b594-5b9492d130e2.4623.8 to cache LRU end 2024-09-12T17:30:40.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.426+0000 7f893de30800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.9 : miss 2024-09-12T17:30:40.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.426+0000 7f893de30800 20 rados->read ofs=0 len=0 2024-09-12T17:30:40.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.427+0000 7f893de30800 20 rados_obj.operate() r=0 bl.length=445 2024-09-12T17:30:40.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.427+0000 7f893de30800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.9 info.flags=0x17 2024-09-12T17:30:40.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.427+0000 7f893de30800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.9 to cache LRU end 2024-09-12T17:30:40.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.427+0000 7f893de30800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:30:40.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.427+0000 7f893de30800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T17:30:40.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.427+0000 7f893de30800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.9 2024-09-12T17:30:40.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.428+0000 7f893de30800 10 cls_bucket_list_unordered: got ___ 2024-09-12T17:30:40.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.429+0000 7f893de30800 10 cls_bucket_list_unordered: got __ _ 2024-09-12T17:30:40.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.430+0000 7f893de30800 10 cls_bucket_list_unordered: got __ 2024-09-12T17:30:40.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.431+0000 7f893de30800 10 cls_bucket_list_unordered: got obj 2024-09-12T17:30:40.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.431+0000 7f893de30800 20 get_obj_state: octx=0x7f892c0649f0 obj=test-client.0-r-test-small-obj-data.3:___ state=0x55891d6fd998 s->prefetch_data=0 2024-09-12T17:30:40.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.432+0000 7f893de30800 10 manifest: total_size = 1035 2024-09-12T17:30:40.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.432+0000 7f893de30800 20 get_obj_state: setting s->obj_tag to 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.13804425498928762459 2024-09-12T17:30:40.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.432+0000 7f893de30800 20 get_obj_state: octx=0x7f892c0649f0 obj=test-client.0-r-test-small-obj-data.3:___ state=0x55891d6fd998 s->prefetch_data=0 2024-09-12T17:30:40.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.432+0000 7f893de30800 20 prepare_atomic_modification: state is not atomic. state=0x55891d6fd998 2024-09-12T17:30:40.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.432+0000 7f893de30800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.9.2 2024-09-12T17:30:40.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.434+0000 7f893de30800 20 get_obj_state: octx=0x7f892c0649f0 obj=test-client.0-r-test-small-obj-data.3:__ _ state=0x55891d6fd998 s->prefetch_data=0 2024-09-12T17:30:40.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.435+0000 7f893de30800 10 manifest: total_size = 1035 2024-09-12T17:30:40.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.435+0000 7f893de30800 20 get_obj_state: setting s->obj_tag to 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.28859193429423748 2024-09-12T17:30:40.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.435+0000 7f893de30800 20 get_obj_state: octx=0x7f892c0649f0 obj=test-client.0-r-test-small-obj-data.3:__ _ state=0x55891d6fd998 s->prefetch_data=0 2024-09-12T17:30:40.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.435+0000 7f893de30800 20 prepare_atomic_modification: state is not atomic. state=0x55891d6fd998 2024-09-12T17:30:40.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.435+0000 7f893de30800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.9.3 2024-09-12T17:30:40.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.436+0000 7f880bfff640 20 handle_completion(): completion ok for obj=___ 2024-09-12T17:30:40.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.438+0000 7f893de30800 20 get_obj_state: octx=0x7f892c0beec0 obj=test-client.0-r-test-small-obj-data.3:__ state=0x55891d6fd998 s->prefetch_data=0 2024-09-12T17:30:40.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.438+0000 7f893de30800 10 manifest: total_size = 4134 2024-09-12T17:30:40.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.438+0000 7f893de30800 20 get_obj_state: setting s->obj_tag to 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.15696064639112509302 2024-09-12T17:30:40.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.438+0000 7f893de30800 20 get_obj_state: octx=0x7f892c0beec0 obj=test-client.0-r-test-small-obj-data.3:__ state=0x55891d6fd998 s->prefetch_data=0 2024-09-12T17:30:40.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.438+0000 7f893de30800 20 prepare_atomic_modification: state is not atomic. state=0x55891d6fd998 2024-09-12T17:30:40.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.438+0000 7f893de30800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.9.6 2024-09-12T17:30:40.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.439+0000 7f881cff9640 20 handle_completion(): completion ok for obj=__ _ 2024-09-12T17:30:40.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.440+0000 7f893de30800 20 get_obj_state: octx=0x7f892c0649f0 obj=test-client.0-r-test-small-obj-data.3:obj state=0x55891d6fd998 s->prefetch_data=0 2024-09-12T17:30:40.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.441+0000 7f893de30800 10 manifest: total_size = 55 2024-09-12T17:30:40.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.441+0000 7f893de30800 20 get_obj_state: setting s->obj_tag to 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2455022539494984618 2024-09-12T17:30:40.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.441+0000 7f893de30800 20 get_obj_state: octx=0x7f892c0649f0 obj=test-client.0-r-test-small-obj-data.3:obj state=0x55891d6fd998 s->prefetch_data=0 2024-09-12T17:30:40.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.441+0000 7f893de30800 20 prepare_atomic_modification: state is not atomic. state=0x55891d6fd998 2024-09-12T17:30:40.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.441+0000 7f893de30800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.9.8 2024-09-12T17:30:40.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.442+0000 7f880bfff640 20 handle_completion(): completion ok for obj=__ 2024-09-12T17:30:40.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.443+0000 7f893de30800 20 list_objects_ordered: starting attempt 1 2024-09-12T17:30:40.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.443+0000 7f893de30800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T17:30:40.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.445+0000 7f881cff9640 20 handle_completion(): completion ok for obj=obj 2024-09-12T17:30:40.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.445+0000 7f893de30800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T17:30:40.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.445+0000 7f893de30800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T17:30:40.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.445+0000 7f893de30800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T17:30:40.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.445+0000 7f893de30800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T17:30:40.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.445+0000 7f893de30800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.3[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.9])"; uploads.size()=0; is_truncated=0 2024-09-12T17:30:40.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.447+0000 7f893de30800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 : miss 2024-09-12T17:30:40.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.447+0000 7f893de30800 20 rados->read ofs=0 len=0 2024-09-12T17:30:40.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.447+0000 7f893de30800 20 rados_obj.operate() r=0 bl.length=223 2024-09-12T17:30:40.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.447+0000 7f893de30800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 info.flags=0x11 2024-09-12T17:30:40.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.447+0000 7f893de30800 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 to cache LRU end 2024-09-12T17:30:40.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.448+0000 7f893de30800 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 from cache 2024-09-12T17:30:40.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.448+0000 7f893de30800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.3, ofs0, ns] 2024-09-12T17:30:40.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.449+0000 7f880bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562437 cookie 94047392342960 notifier 5684 bl.length()=181 2024-09-12T17:30:40.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.451+0000 7f893de30800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.9 from cache 2024-09-12T17:30:40.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.451+0000 7f893de30800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.3:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.9, ofs0, ns] 2024-09-12T17:30:40.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.451+0000 7f881cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562402 cookie 94047392353664 notifier 5684 bl.length()=238 2024-09-12T17:30:40.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.455+0000 7f893de30800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/722b129a-cf7a-4aca-b594-5b9492d130e2.4623.9 : miss 2024-09-12T17:30:40.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.455+0000 7f893de30800 20 rados->read ofs=0 len=0 2024-09-12T17:30:40.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.455+0000 7f893de30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:40.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.455+0000 7f893de30800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/722b129a-cf7a-4aca-b594-5b9492d130e2.4623.9 info.flags=0x0 2024-09-12T17:30:40.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.455+0000 7f893de30800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/722b129a-cf7a-4aca-b594-5b9492d130e2.4623.9 to cache LRU end 2024-09-12T17:30:40.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.457+0000 7f893de30800 10 removing key index: PYXMBJWIWQWNEBNJYPAN 2024-09-12T17:30:40.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.458+0000 7f893de30800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.keys:PYXMBJWIWQWNEBNJYPAN, ofs0, ns] 2024-09-12T17:30:40.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.459+0000 7f881cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562447 cookie 94047392358944 notifier 5684 bl.length()=170 2024-09-12T17:30:40.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.460+0000 7f893de30800 10 removing email index: ragweed.client.0+test@test.test 2024-09-12T17:30:40.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.461+0000 7f893de30800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.email:ragweed.client.0+test@test.test, ofs0, ns] 2024-09-12T17:30:40.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.461+0000 7f880bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562403 cookie 94047392353664 notifier 5684 bl.length()=182 2024-09-12T17:30:40.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.462+0000 7f893de30800 10 removing user buckets index 2024-09-12T17:30:40.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.463+0000 7f893de30800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:ragweed.client.0.buckets, ofs0, ns] 2024-09-12T17:30:40.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.464+0000 7f880bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562385 cookie 94047392351168 notifier 5684 bl.length()=173 2024-09-12T17:30:40.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.465+0000 7f893de30800 10 removing user index: ragweed.client.0 2024-09-12T17:30:40.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.466+0000 7f893de30800 10 removing default.rgw.meta+users.uid+ragweed.client.0 from cache 2024-09-12T17:30:40.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.466+0000 7f893de30800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:ragweed.client.0, ofs0, ns] 2024-09-12T17:30:40.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.466+0000 7f881cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562448 cookie 94047392358944 notifier 5684 bl.length()=165 2024-09-12T17:30:40.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.470+0000 7f87ef7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:30:40.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.473+0000 7f893de30800 20 remove_watcher() i=0 2024-09-12T17:30:40.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.473+0000 7f893de30800 2 removed watcher, disabling cache 2024-09-12T17:30:40.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.474+0000 7f893de30800 20 remove_watcher() i=1 2024-09-12T17:30:40.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.475+0000 7f893de30800 20 remove_watcher() i=2 2024-09-12T17:30:40.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.476+0000 7f893de30800 20 remove_watcher() i=3 2024-09-12T17:30:40.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.477+0000 7f893de30800 20 remove_watcher() i=4 2024-09-12T17:30:40.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.478+0000 7f893de30800 20 remove_watcher() i=5 2024-09-12T17:30:40.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.479+0000 7f893de30800 20 remove_watcher() i=6 2024-09-12T17:30:40.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.481+0000 7f893de30800 20 remove_watcher() i=7 2024-09-12T17:30:40.493 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid sysuser.client.0 --purge-data 2024-09-12T17:30:40.552 INFO:teuthology.orchestra.run.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:30:40.553 INFO:teuthology.orchestra.run.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:30:40.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.586+0000 7f204531f800 20 rados->read ofs=0 len=0 2024-09-12T17:30:40.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.587+0000 7f204531f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:40.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.587+0000 7f204531f800 20 realm 2024-09-12T17:30:40.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.587+0000 7f204531f800 20 rados->read ofs=0 len=0 2024-09-12T17:30:40.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.587+0000 7f204531f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:40.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.587+0000 7f204531f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:30:40.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.587+0000 7f204531f800 20 rados->read ofs=0 len=0 2024-09-12T17:30:40.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.588+0000 7f204531f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:40.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.588+0000 7f204531f800 20 rados->read ofs=0 len=0 2024-09-12T17:30:40.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.588+0000 7f204531f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:30:40.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.588+0000 7f204531f800 20 rados->read ofs=0 len=0 2024-09-12T17:30:40.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.589+0000 7f204531f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:30:40.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.589+0000 7f204531f800 20 searching for the correct realm 2024-09-12T17:30:40.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.592+0000 7f204180d640 0 -- 172.21.15.37:0/3500063818 >> [v2:172.21.15.40:6818/1210108009,v1:172.21.15.40:6819/1210108009] conn(0x7f2038044040 msgr2=0x7f2038037940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:30:40.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.595+0000 7f204100c640 0 -- 172.21.15.37:0/3500063818 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7f2038046b60 msgr2=0x7f2038058920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:30:40.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.801+0000 7f204531f800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:30:40.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.801+0000 7f204531f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:30:40.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.801+0000 7f204531f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:30:40.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.801+0000 7f204531f800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:30:40.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.801+0000 7f204531f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:30:40.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.801+0000 7f204531f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:30:40.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.801+0000 7f204531f800 20 rados->read ofs=0 len=0 2024-09-12T17:30:40.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.801+0000 7f204531f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:40.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.801+0000 7f204531f800 20 rados->read ofs=0 len=0 2024-09-12T17:30:40.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.801+0000 7f204531f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:30:40.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.801+0000 7f204531f800 20 rados->read ofs=0 len=0 2024-09-12T17:30:40.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.802+0000 7f204531f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:30:40.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.802+0000 7f204531f800 20 zone default found 2024-09-12T17:30:40.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.802+0000 7f204531f800 4 Realm: () 2024-09-12T17:30:40.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.802+0000 7f204531f800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:30:40.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.802+0000 7f204531f800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:30:40.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.802+0000 7f204531f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:30:40.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.802+0000 7f204531f800 20 zonegroup default 2024-09-12T17:30:40.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.802+0000 7f204531f800 20 rados->read ofs=0 len=0 2024-09-12T17:30:40.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.802+0000 7f204531f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:40.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.802+0000 7f204531f800 20 rados->read ofs=0 len=0 2024-09-12T17:30:40.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.802+0000 7f204531f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:40.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.802+0000 7f204531f800 20 rados->read ofs=0 len=0 2024-09-12T17:30:40.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.803+0000 7f204531f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:40.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.803+0000 7f204531f800 20 started sync module instance, tier type = 2024-09-12T17:30:40.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.803+0000 7f204531f800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:30:40.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.812+0000 7f204531f800 20 add_watcher() i=0 2024-09-12T17:30:40.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.812+0000 7f204531f800 20 add_watcher() i=1 2024-09-12T17:30:40.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.812+0000 7f204531f800 20 add_watcher() i=2 2024-09-12T17:30:40.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.812+0000 7f204531f800 20 add_watcher() i=3 2024-09-12T17:30:40.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.812+0000 7f204531f800 20 add_watcher() i=4 2024-09-12T17:30:40.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.812+0000 7f204531f800 20 add_watcher() i=5 2024-09-12T17:30:40.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.812+0000 7f204531f800 20 add_watcher() i=6 2024-09-12T17:30:40.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.813+0000 7f204531f800 20 add_watcher() i=7 2024-09-12T17:30:40.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.813+0000 7f204531f800 2 all 8 watchers are set, enabling cache 2024-09-12T17:30:40.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.815+0000 7f1ef77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:30:40.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.815+0000 7f204531f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:30:40.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.815+0000 7f204531f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:30:40.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.851+0000 7f1ef67e4640 20 reqs_thread_entry: start 2024-09-12T17:30:40.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.851+0000 7f204531f800 20 init_complete bucket index max shards: 11 2024-09-12T17:30:40.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.851+0000 7f204531f800 20 Filter name: none 2024-09-12T17:30:40.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.851+0000 7f1e67fff640 20 reqs_thread_entry: start 2024-09-12T17:30:40.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.851+0000 7f204531f800 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : miss 2024-09-12T17:30:40.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.851+0000 7f204531f800 20 rados->read ofs=0 len=0 2024-09-12T17:30:40.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.852+0000 7f204531f800 20 rados_obj.operate() r=0 bl.length=486 2024-09-12T17:30:40.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.852+0000 7f204531f800 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x13 2024-09-12T17:30:40.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.852+0000 7f204531f800 10 adding default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-12T17:30:40.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.852+0000 7f204531f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:30:40.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.852+0000 7f204531f800 10 removing key index: IPSJNLKKQCTGCKQMISRE 2024-09-12T17:30:40.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.853+0000 7f204531f800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.keys:IPSJNLKKQCTGCKQMISRE, ofs0, ns] 2024-09-12T17:30:40.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.854+0000 7f1f24ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562449 cookie 94346516033104 notifier 5702 bl.length()=170 2024-09-12T17:30:40.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.855+0000 7f204531f800 10 removing email index: sysuser.client.0+test@test.test 2024-09-12T17:30:40.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.856+0000 7f204531f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.email:sysuser.client.0+test@test.test, ofs0, ns] 2024-09-12T17:30:40.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.857+0000 7f1f13fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562450 cookie 94346516047248 notifier 5702 bl.length()=182 2024-09-12T17:30:40.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.858+0000 7f204531f800 10 removing user buckets index 2024-09-12T17:30:40.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.859+0000 7f204531f800 10 removing user index: sysuser.client.0 2024-09-12T17:30:40.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.860+0000 7f204531f800 10 removing default.rgw.meta+users.uid+sysuser.client.0 from cache 2024-09-12T17:30:40.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.860+0000 7f204531f800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.uid:sysuser.client.0, ofs0, ns] 2024-09-12T17:30:40.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.860+0000 7f1f13fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562404 cookie 94346516043200 notifier 5702 bl.length()=165 2024-09-12T17:30:40.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.863+0000 7f1ef77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:30:40.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.865+0000 7f204531f800 20 remove_watcher() i=0 2024-09-12T17:30:40.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.865+0000 7f204531f800 2 removed watcher, disabling cache 2024-09-12T17:30:40.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.866+0000 7f204531f800 20 remove_watcher() i=1 2024-09-12T17:30:40.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.867+0000 7f204531f800 20 remove_watcher() i=2 2024-09-12T17:30:40.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.868+0000 7f204531f800 20 remove_watcher() i=3 2024-09-12T17:30:40.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.870+0000 7f204531f800 20 remove_watcher() i=4 2024-09-12T17:30:40.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.871+0000 7f204531f800 20 remove_watcher() i=5 2024-09-12T17:30:40.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.872+0000 7f204531f800 20 remove_watcher() i=6 2024-09-12T17:30:40.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:30:40.873+0000 7f204531f800 20 remove_watcher() i=7 2024-09-12T17:30:40.885 INFO:tasks.ragweed:Removing ragweed... 2024-09-12T17:30:40.885 DEBUG:teuthology.orchestra.run.smithi037:> rm -rf /home/ubuntu/cephtest/ragweed.client.0 2024-09-12T17:30:40.970 INFO:teuthology.run_tasks:Running task workunit... 2024-09-12T17:30:40.983 INFO:tasks.workunit:Pulling workunits from ref bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T17:30:40.983 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T17:30:40.983 DEBUG:teuthology.orchestra.run.smithi037:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T17:30:41.014 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T17:30:41.014 INFO:teuthology.orchestra.run.smithi037.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T17:30:41.014 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T17:30:41.085 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-12T17:30:41.085 DEBUG:teuthology.orchestra.run.smithi037:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-12T17:30:41.155 INFO:tasks.workunit:timeout=3h 2024-09-12T17:30:41.155 INFO:tasks.workunit:cleanup=True 2024-09-12T17:30:41.156 DEBUG:teuthology.orchestra.run.smithi037:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T17:30:41.225 INFO:tasks.workunit.client.0.smithi037.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T17:31:42.394 INFO:tasks.workunit.client.0.smithi037.stderr:Updating files: 92% (11689/12697) Updating files: 93% (11809/12697) Updating files: 94% (11936/12697) Updating files: 95% (12063/12697) Updating files: 96% (12190/12697) Updating files: 97% (12317/12697) Updating files: 98% (12444/12697) Updating files: 99% (12571/12697) Updating files: 100% (12697/12697) Updating files: 100% (12697/12697), done. 2024-09-12T17:31:43.076 INFO:tasks.workunit.client.0.smithi037.stderr:Note: switching to 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'. 2024-09-12T17:31:43.076 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:31:43.076 INFO:tasks.workunit.client.0.smithi037.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T17:31:43.076 INFO:tasks.workunit.client.0.smithi037.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T17:31:43.076 INFO:tasks.workunit.client.0.smithi037.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T17:31:43.076 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:31:43.076 INFO:tasks.workunit.client.0.smithi037.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T17:31:43.076 INFO:tasks.workunit.client.0.smithi037.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T17:31:43.076 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:31:43.076 INFO:tasks.workunit.client.0.smithi037.stderr: git switch -c 2024-09-12T17:31:43.077 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:31:43.077 INFO:tasks.workunit.client.0.smithi037.stderr:Or undo this operation with: 2024-09-12T17:31:43.077 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:31:43.077 INFO:tasks.workunit.client.0.smithi037.stderr: git switch - 2024-09-12T17:31:43.077 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:31:43.077 INFO:tasks.workunit.client.0.smithi037.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T17:31:43.077 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:31:43.077 INFO:tasks.workunit.client.0.smithi037.stderr:HEAD is now at bad475c18c9 rgw: clear output keys in RGWMetadataLister::get_next() 2024-09-12T17:31:43.082 DEBUG:teuthology.orchestra.run.smithi037:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T17:31:43.151 INFO:tasks.workunit.client.0.smithi037.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T17:31:43.154 INFO:tasks.workunit.client.0.smithi037.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T17:31:43.154 INFO:tasks.workunit.client.0.smithi037.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T17:31:43.203 INFO:tasks.workunit.client.0.smithi037.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T17:31:43.255 INFO:tasks.workunit.client.0.smithi037.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T17:31:43.295 INFO:tasks.workunit.client.0.smithi037.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T17:31:43.297 INFO:tasks.workunit.client.0.smithi037.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T17:31:43.297 INFO:tasks.workunit.client.0.smithi037.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T17:31:43.337 INFO:tasks.workunit.client.0.smithi037.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T17:31:43.341 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-09-12T17:31:43.341 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T17:31:43.412 INFO:tasks.workunit:Running workunits matching rgw/run-reshard.sh on client.0... 2024-09-12T17:31:43.413 INFO:tasks.workunit:Running workunit rgw/run-reshard.sh... 2024-09-12T17:31:43.414 DEBUG:teuthology.orchestra.run.smithi037:workunit test rgw/run-reshard.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh 2024-09-12T17:31:43.486 INFO:tasks.workunit.client.0.smithi037.stderr:+ ulimit -c 0 2024-09-12T17:31:43.486 INFO:tasks.workunit.client.0.smithi037.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh 2024-09-12T17:31:43.487 INFO:tasks.workunit.client.0.smithi037.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T17:31:43.487 INFO:tasks.workunit.client.0.smithi037.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T17:31:45.866 INFO:tasks.workunit.client.0.smithi037.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-09-12T17:31:45.866 INFO:tasks.workunit.client.0.smithi037.stderr:++ deactivate nondestructive 2024-09-12T17:31:45.866 INFO:tasks.workunit.client.0.smithi037.stderr:++ '[' -n '' ']' 2024-09-12T17:31:45.866 INFO:tasks.workunit.client.0.smithi037.stderr:++ '[' -n '' ']' 2024-09-12T17:31:45.866 INFO:tasks.workunit.client.0.smithi037.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T17:31:45.866 INFO:tasks.workunit.client.0.smithi037.stderr:++ hash -r 2024-09-12T17:31:45.866 INFO:tasks.workunit.client.0.smithi037.stderr:++ '[' -n '' ']' 2024-09-12T17:31:45.866 INFO:tasks.workunit.client.0.smithi037.stderr:++ unset VIRTUAL_ENV 2024-09-12T17:31:45.866 INFO:tasks.workunit.client.0.smithi037.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-09-12T17:31:45.866 INFO:tasks.workunit.client.0.smithi037.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T17:31:45.866 INFO:tasks.workunit.client.0.smithi037.stderr:++ export VIRTUAL_ENV 2024-09-12T17:31:45.867 INFO:tasks.workunit.client.0.smithi037.stderr:++ _OLD_VIRTUAL_PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-12T17:31:45.867 INFO:tasks.workunit.client.0.smithi037.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-12T17:31:45.867 INFO:tasks.workunit.client.0.smithi037.stderr:++ export PATH 2024-09-12T17:31:45.867 INFO:tasks.workunit.client.0.smithi037.stderr:++ '[' -n '' ']' 2024-09-12T17:31:45.867 INFO:tasks.workunit.client.0.smithi037.stderr:++ '[' -z '' ']' 2024-09-12T17:31:45.867 INFO:tasks.workunit.client.0.smithi037.stderr:++ _OLD_VIRTUAL_PS1= 2024-09-12T17:31:45.867 INFO:tasks.workunit.client.0.smithi037.stderr:++ PS1='(rgw) ' 2024-09-12T17:31:45.867 INFO:tasks.workunit.client.0.smithi037.stderr:++ export PS1 2024-09-12T17:31:45.867 INFO:tasks.workunit.client.0.smithi037.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T17:31:45.867 INFO:tasks.workunit.client.0.smithi037.stderr:++ hash -r 2024-09-12T17:31:45.867 INFO:tasks.workunit.client.0.smithi037.stderr:+ pip install pip --upgrade 2024-09-12T17:31:46.106 INFO:tasks.workunit.client.0.smithi037.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.9/site-packages (21.3.1) 2024-09-12T17:31:46.295 INFO:tasks.workunit.client.0.smithi037.stdout:Collecting pip 2024-09-12T17:31:46.301 INFO:tasks.workunit.client.0.smithi037.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-12T17:31:46.347 INFO:tasks.workunit.client.0.smithi037.stdout:Installing collected packages: pip 2024-09-12T17:31:46.347 INFO:tasks.workunit.client.0.smithi037.stdout: Attempting uninstall: pip 2024-09-12T17:31:46.347 INFO:tasks.workunit.client.0.smithi037.stdout: Found existing installation: pip 21.3.1 2024-09-12T17:31:46.527 INFO:tasks.workunit.client.0.smithi037.stdout: Uninstalling pip-21.3.1: 2024-09-12T17:31:46.534 INFO:tasks.workunit.client.0.smithi037.stdout: Successfully uninstalled pip-21.3.1 2024-09-12T17:31:47.334 INFO:tasks.workunit.client.0.smithi037.stdout:Successfully installed pip-24.2 2024-09-12T17:31:47.383 INFO:tasks.workunit.client.0.smithi037.stderr:+ pip install boto3 2024-09-12T17:31:48.188 INFO:tasks.workunit.client.0.smithi037.stdout:Collecting boto3 2024-09-12T17:31:48.190 INFO:tasks.workunit.client.0.smithi037.stdout: Using cached boto3-1.35.17-py3-none-any.whl.metadata (6.6 kB) 2024-09-12T17:31:48.760 INFO:tasks.workunit.client.0.smithi037.stdout:Collecting botocore<1.36.0,>=1.35.17 (from boto3) 2024-09-12T17:31:48.761 INFO:tasks.workunit.client.0.smithi037.stdout: Using cached botocore-1.35.17-py3-none-any.whl.metadata (5.7 kB) 2024-09-12T17:31:48.810 INFO:tasks.workunit.client.0.smithi037.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-12T17:31:48.811 INFO:tasks.workunit.client.0.smithi037.stdout: Using cached jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-12T17:31:48.866 INFO:tasks.workunit.client.0.smithi037.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-12T17:31:48.867 INFO:tasks.workunit.client.0.smithi037.stdout: Using cached s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-12T17:31:48.916 INFO:tasks.workunit.client.0.smithi037.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T17:31:48.917 INFO:tasks.workunit.client.0.smithi037.stdout: Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-12T17:31:48.994 INFO:tasks.workunit.client.0.smithi037.stdout:Collecting urllib3<1.27,>=1.25.4 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T17:31:48.995 INFO:tasks.workunit.client.0.smithi037.stdout: Using cached urllib3-1.26.20-py2.py3-none-any.whl.metadata (50 kB) 2024-09-12T17:31:49.196 INFO:tasks.workunit.client.0.smithi037.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T17:31:49.197 INFO:tasks.workunit.client.0.smithi037.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-12T17:31:49.202 INFO:tasks.workunit.client.0.smithi037.stdout:Using cached boto3-1.35.17-py3-none-any.whl (139 kB) 2024-09-12T17:31:49.203 INFO:tasks.workunit.client.0.smithi037.stdout:Using cached botocore-1.35.17-py3-none-any.whl (12.5 MB) 2024-09-12T17:31:49.212 INFO:tasks.workunit.client.0.smithi037.stdout:Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-12T17:31:49.213 INFO:tasks.workunit.client.0.smithi037.stdout:Using cached s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-12T17:31:49.215 INFO:tasks.workunit.client.0.smithi037.stdout:Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-12T17:31:49.216 INFO:tasks.workunit.client.0.smithi037.stdout:Using cached urllib3-1.26.20-py2.py3-none-any.whl (144 kB) 2024-09-12T17:31:49.219 INFO:tasks.workunit.client.0.smithi037.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-12T17:31:49.293 INFO:tasks.workunit.client.0.smithi037.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-12T17:31:50.317 INFO:tasks.workunit.client.0.smithi037.stdout:Successfully installed boto3-1.35.17 botocore-1.35.17 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-1.26.20 2024-09-12T17:31:50.433 INFO:tasks.workunit.client.0.smithi037.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_reshard.py 2024-09-12T17:31:50.563 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin user create --uid tester --display-name "Testing" --access-key NX5QOQKC6BH2IDN8HC7A --secret LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn 2024-09-12T17:31:50.598 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:31:50.598 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:31:50.638 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:50.637+0000 7f5ad5b39800 20 rados->read ofs=0 len=0 2024-09-12T17:31:50.640 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:50.639+0000 7f5ad5b39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:31:50.640 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:50.639+0000 7f5ad5b39800 20 realm 2024-09-12T17:31:50.640 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:50.639+0000 7f5ad5b39800 20 rados->read ofs=0 len=0 2024-09-12T17:31:50.640 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:50.639+0000 7f5ad5b39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:31:50.640 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:50.639+0000 7f5ad5b39800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:31:50.640 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:50.639+0000 7f5ad5b39800 20 rados->read ofs=0 len=0 2024-09-12T17:31:50.640 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:50.639+0000 7f5ad5b39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:31:50.640 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:50.639+0000 7f5ad5b39800 20 rados->read ofs=0 len=0 2024-09-12T17:31:50.641 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:50.640+0000 7f5ad5b39800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:31:50.641 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:50.640+0000 7f5ad5b39800 20 rados->read ofs=0 len=0 2024-09-12T17:31:50.641 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:50.640+0000 7f5ad5b39800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:31:50.641 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:50.640+0000 7f5ad5b39800 20 searching for the correct realm 2024-09-12T17:31:50.644 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:50.644+0000 7f5ad1fc8640 0 -- 172.21.15.37:0/4159005897 >> [v2:172.21.15.40:6818/1210108009,v1:172.21.15.40:6819/1210108009] conn(0x7f5ac802d3d0 msgr2=0x7f5ac802d810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:31:50.648 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:50.647+0000 7f5ad17c7640 0 -- 172.21.15.37:0/4159005897 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7f5ac801e410 msgr2=0x7f5ac801e890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:31:50.855 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:50.853+0000 7f5ad5b39800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:31:50.855 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:50.853+0000 7f5ad5b39800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:31:50.855 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:50.853+0000 7f5ad5b39800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:31:50.855 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:50.853+0000 7f5ad5b39800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:31:50.855 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:50.853+0000 7f5ad5b39800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:31:50.855 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:50.853+0000 7f5ad5b39800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:31:50.855 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:50.853+0000 7f5ad5b39800 20 rados->read ofs=0 len=0 2024-09-12T17:31:50.855 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:50.854+0000 7f5ad5b39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:31:50.855 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:50.854+0000 7f5ad5b39800 20 rados->read ofs=0 len=0 2024-09-12T17:31:50.855 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:50.854+0000 7f5ad5b39800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:31:50.856 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:50.854+0000 7f5ad5b39800 20 rados->read ofs=0 len=0 2024-09-12T17:31:50.856 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:50.854+0000 7f5ad5b39800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:31:50.857 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:50.854+0000 7f5ad5b39800 20 zone default found 2024-09-12T17:31:50.857 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:50.854+0000 7f5ad5b39800 4 Realm: () 2024-09-12T17:31:50.857 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:50.854+0000 7f5ad5b39800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:31:50.857 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:50.854+0000 7f5ad5b39800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:31:50.857 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:50.854+0000 7f5ad5b39800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:31:50.857 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:50.854+0000 7f5ad5b39800 20 zonegroup default 2024-09-12T17:31:50.857 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:50.854+0000 7f5ad5b39800 20 rados->read ofs=0 len=0 2024-09-12T17:31:50.857 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:50.855+0000 7f5ad5b39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:31:50.857 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:50.855+0000 7f5ad5b39800 20 rados->read ofs=0 len=0 2024-09-12T17:31:50.857 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:50.855+0000 7f5ad5b39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:31:50.857 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:50.855+0000 7f5ad5b39800 20 rados->read ofs=0 len=0 2024-09-12T17:31:50.858 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:50.855+0000 7f5ad5b39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:31:50.858 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:50.855+0000 7f5ad5b39800 20 started sync module instance, tier type = 2024-09-12T17:31:50.858 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:50.855+0000 7f5ad5b39800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:31:50.866 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:50.866+0000 7f5ad5b39800 20 add_watcher() i=0 2024-09-12T17:31:50.867 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:50.866+0000 7f5ad5b39800 20 add_watcher() i=1 2024-09-12T17:31:50.867 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:50.866+0000 7f5ad5b39800 20 add_watcher() i=2 2024-09-12T17:31:50.867 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:50.866+0000 7f5ad5b39800 20 add_watcher() i=3 2024-09-12T17:31:50.867 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:50.866+0000 7f5ad5b39800 20 add_watcher() i=4 2024-09-12T17:31:50.867 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:50.866+0000 7f5ad5b39800 20 add_watcher() i=5 2024-09-12T17:31:50.867 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:50.866+0000 7f5ad5b39800 20 add_watcher() i=6 2024-09-12T17:31:50.867 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:50.866+0000 7f5ad5b39800 20 add_watcher() i=7 2024-09-12T17:31:50.867 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:50.866+0000 7f5ad5b39800 2 all 8 watchers are set, enabling cache 2024-09-12T17:31:50.869 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:50.868+0000 7f5987fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:31:50.870 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:50.869+0000 7f5ad5b39800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:31:50.870 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:50.869+0000 7f5ad5b39800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:31:50.870 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:50.869+0000 7f5ad5b39800 5 note: GC not initialized 2024-09-12T17:31:50.870 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:50.869+0000 7f5986fe5640 20 reqs_thread_entry: start 2024-09-12T17:31:50.870 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:50.869+0000 7f5ad5b39800 20 init_complete bucket index max shards: 11 2024-09-12T17:31:50.870 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:50.869+0000 7f5ad5b39800 20 Filter name: none 2024-09-12T17:31:50.870 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:50.869+0000 7f5984fe1640 20 reqs_thread_entry: start 2024-09-12T17:31:50.871 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:50.869+0000 7f5ad5b39800 10 cache get: name=default.rgw.meta+users.uid+tester : miss 2024-09-12T17:31:50.871 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:50.869+0000 7f5ad5b39800 20 rados->read ofs=0 len=0 2024-09-12T17:31:50.872 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:50.870+0000 7f5ad5b39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:31:50.872 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:50.870+0000 7f5ad5b39800 10 cache put: name=default.rgw.meta+users.uid+tester info.flags=0x0 2024-09-12T17:31:50.872 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:50.870+0000 7f5ad5b39800 10 adding default.rgw.meta+users.uid+tester to cache LRU end 2024-09-12T17:31:50.873 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:50.870+0000 7f5ad5b39800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : miss 2024-09-12T17:31:50.873 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:50.870+0000 7f5ad5b39800 20 rados->read ofs=0 len=0 2024-09-12T17:31:50.873 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:50.870+0000 7f5ad5b39800 20 rados_obj.operate() r=0 bl.length=22 2024-09-12T17:31:50.873 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:50.870+0000 7f5ad5b39800 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x5 2024-09-12T17:31:50.873 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:50.870+0000 7f5ad5b39800 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-12T17:31:50.873 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:50.870+0000 7f5ad5b39800 10 cache get: name=default.rgw.meta+users.uid+rgw_datacache_user : miss 2024-09-12T17:31:50.873 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:50.870+0000 7f5ad5b39800 20 rados->read ofs=0 len=0 2024-09-12T17:31:50.873 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:50.871+0000 7f5ad5b39800 20 rados_obj.operate() r=0 bl.length=420 2024-09-12T17:31:50.873 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:50.871+0000 7f5ad5b39800 10 cache put: name=default.rgw.meta+users.uid+rgw_datacache_user info.flags=0x13 2024-09-12T17:31:50.873 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:50.871+0000 7f5ad5b39800 10 adding default.rgw.meta+users.uid+rgw_datacache_user to cache LRU end 2024-09-12T17:31:50.873 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:50.871+0000 7f5ad5b39800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:31:50.873 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:50.871+0000 7f5ad5b39800 10 chain_cache_entry: cache_locator=default.rgw.meta+users.uid+rgw_datacache_user 2024-09-12T17:31:50.873 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:50.871+0000 7f5ad5b39800 20 get_user_info_from_index found 0 xattrs 2024-09-12T17:31:50.873 INFO:tasks.workunit.client.0.smithi037.stderr:could not create user: unable to parse parameters, duplicate key provided 2024-09-12T17:31:50.874 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:50.872+0000 7f5987fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:31:50.875 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:50.874+0000 7f5ad5b39800 20 remove_watcher() i=0 2024-09-12T17:31:50.875 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:50.874+0000 7f5ad5b39800 2 removed watcher, disabling cache 2024-09-12T17:31:50.876 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:50.875+0000 7f5ad5b39800 20 remove_watcher() i=1 2024-09-12T17:31:50.877 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:50.877+0000 7f5ad5b39800 20 remove_watcher() i=2 2024-09-12T17:31:50.878 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:50.878+0000 7f5ad5b39800 20 remove_watcher() i=3 2024-09-12T17:31:50.880 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:50.879+0000 7f5ad5b39800 20 remove_watcher() i=4 2024-09-12T17:31:50.881 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:50.880+0000 7f5ad5b39800 20 remove_watcher() i=5 2024-09-12T17:31:50.882 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:50.881+0000 7f5ad5b39800 20 remove_watcher() i=6 2024-09-12T17:31:50.882 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:50.882+0000 7f5ad5b39800 20 remove_watcher() i=7 2024-09-12T17:31:51.267 INFO:tasks.workunit.client.0.smithi037.stderr:TEST: reshard add 2024-09-12T17:31:51.267 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:31:51.269 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T17:31:51.298 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:31:51.298 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:31:51.337 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.336+0000 7f3896d17800 20 rados->read ofs=0 len=0 2024-09-12T17:31:51.339 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.338+0000 7f3896d17800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:31:51.339 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.338+0000 7f3896d17800 20 realm 2024-09-12T17:31:51.339 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.338+0000 7f3896d17800 20 rados->read ofs=0 len=0 2024-09-12T17:31:51.339 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.338+0000 7f3896d17800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:31:51.340 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.338+0000 7f3896d17800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:31:51.340 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.338+0000 7f3896d17800 20 rados->read ofs=0 len=0 2024-09-12T17:31:51.340 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.339+0000 7f3896d17800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:31:51.340 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.339+0000 7f3896d17800 20 rados->read ofs=0 len=0 2024-09-12T17:31:51.340 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.339+0000 7f3896d17800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:31:51.340 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.339+0000 7f3896d17800 20 rados->read ofs=0 len=0 2024-09-12T17:31:51.341 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.340+0000 7f3896d17800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:31:51.341 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.340+0000 7f3896d17800 20 searching for the correct realm 2024-09-12T17:31:51.345 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.344+0000 7f3895002640 0 -- 172.21.15.37:0/4108752897 >> [v2:172.21.15.37:6824/3990661154,v1:172.21.15.37:6825/3990661154] conn(0x55a84e0b52d0 msgr2=0x55a84e0b7770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:31:51.348 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.347+0000 7f3894000640 0 -- 172.21.15.37:0/4108752897 >> [v2:172.21.15.40:6800/2441293461,v1:172.21.15.40:6801/2441293461] conn(0x7f38840db9e0 msgr2=0x7f388404de50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:31:51.356 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.352+0000 7f3896d17800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:31:51.356 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.352+0000 7f3896d17800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:31:51.356 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.352+0000 7f3896d17800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:31:51.356 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.352+0000 7f3896d17800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:31:51.357 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.352+0000 7f3896d17800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:31:51.357 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.352+0000 7f3896d17800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:31:51.357 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.352+0000 7f3896d17800 20 rados->read ofs=0 len=0 2024-09-12T17:31:51.357 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.352+0000 7f3896d17800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:31:51.357 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.352+0000 7f3896d17800 20 rados->read ofs=0 len=0 2024-09-12T17:31:51.357 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.353+0000 7f3896d17800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:31:51.357 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.353+0000 7f3896d17800 20 rados->read ofs=0 len=0 2024-09-12T17:31:51.357 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.353+0000 7f3896d17800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:31:51.357 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.353+0000 7f3896d17800 20 zone default found 2024-09-12T17:31:51.358 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.353+0000 7f3896d17800 4 Realm: () 2024-09-12T17:31:51.358 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.353+0000 7f3896d17800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:31:51.358 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.353+0000 7f3896d17800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:31:51.358 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.353+0000 7f3896d17800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:31:51.358 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.353+0000 7f3896d17800 20 zonegroup default 2024-09-12T17:31:51.358 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.353+0000 7f3896d17800 20 rados->read ofs=0 len=0 2024-09-12T17:31:51.358 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.353+0000 7f3896d17800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:31:51.358 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.353+0000 7f3896d17800 20 rados->read ofs=0 len=0 2024-09-12T17:31:51.358 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.354+0000 7f3896d17800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:31:51.358 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.354+0000 7f3896d17800 20 rados->read ofs=0 len=0 2024-09-12T17:31:51.358 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.354+0000 7f3896d17800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:31:51.358 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.354+0000 7f3896d17800 20 started sync module instance, tier type = 2024-09-12T17:31:51.359 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.354+0000 7f3896d17800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:31:51.365 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.364+0000 7f3896d17800 20 add_watcher() i=0 2024-09-12T17:31:51.365 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.364+0000 7f3896d17800 20 add_watcher() i=1 2024-09-12T17:31:51.365 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.364+0000 7f3896d17800 20 add_watcher() i=2 2024-09-12T17:31:51.365 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.364+0000 7f3896d17800 20 add_watcher() i=3 2024-09-12T17:31:51.365 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.364+0000 7f3896d17800 20 add_watcher() i=4 2024-09-12T17:31:51.365 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.364+0000 7f3896d17800 20 add_watcher() i=5 2024-09-12T17:31:51.365 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.364+0000 7f3896d17800 20 add_watcher() i=6 2024-09-12T17:31:51.365 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.365+0000 7f3896d17800 20 add_watcher() i=7 2024-09-12T17:31:51.365 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.365+0000 7f3896d17800 2 all 8 watchers are set, enabling cache 2024-09-12T17:31:51.367 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.366+0000 7f374afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:31:51.369 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.367+0000 7f3896d17800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:31:51.369 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.367+0000 7f3896d17800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:31:51.369 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.367+0000 7f3896d17800 5 note: GC not initialized 2024-09-12T17:31:51.369 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.367+0000 7f3749fe3640 20 reqs_thread_entry: start 2024-09-12T17:31:51.370 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.367+0000 7f3896d17800 20 init_complete bucket index max shards: 11 2024-09-12T17:31:51.370 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.367+0000 7f3896d17800 20 Filter name: none 2024-09-12T17:31:51.370 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.367+0000 7f3742ffd640 20 reqs_thread_entry: start 2024-09-12T17:31:51.370 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.367+0000 7f3896d17800 20 rados->read ofs=0 len=0 2024-09-12T17:31:51.371 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.368+0000 7f3896d17800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:31:51.371 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.368+0000 7f3896d17800 20 rados->read ofs=0 len=0 2024-09-12T17:31:51.372 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.368+0000 7f3896d17800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:31:51.372 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.368+0000 7f3896d17800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:31:51.372 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.368+0000 7f3896d17800 20 rados->read ofs=0 len=0 2024-09-12T17:31:51.372 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.369+0000 7f3896d17800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:31:51.372 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.369+0000 7f3896d17800 20 rados->read ofs=0 len=0 2024-09-12T17:31:51.372 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.369+0000 7f3896d17800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:31:51.372 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.369+0000 7f3896d17800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:31:51.372 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.371+0000 7f374afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:31:51.374 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.373+0000 7f3896d17800 20 remove_watcher() i=0 2024-09-12T17:31:51.374 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.373+0000 7f3896d17800 2 removed watcher, disabling cache 2024-09-12T17:31:51.375 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.374+0000 7f3896d17800 20 remove_watcher() i=1 2024-09-12T17:31:51.376 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.375+0000 7f3896d17800 20 remove_watcher() i=2 2024-09-12T17:31:51.377 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.377+0000 7f3896d17800 20 remove_watcher() i=3 2024-09-12T17:31:51.378 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.378+0000 7f3896d17800 20 remove_watcher() i=4 2024-09-12T17:31:51.380 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.379+0000 7f3896d17800 20 remove_watcher() i=5 2024-09-12T17:31:51.380 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.380+0000 7f3896d17800 20 remove_watcher() i=6 2024-09-12T17:31:51.381 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.381+0000 7f3896d17800 20 remove_watcher() i=7 2024-09-12T17:31:51.393 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:31:51.393 INFO:tasks.workunit.client.0.smithi037.stderr:BUCKET_STATS: 2024-09-12T17:31:51.393 INFO:tasks.workunit.client.0.smithi037.stderr:bucket: a-bucket id: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 num_objects: 0 size_kb: 0 num_shards: 11 2024-09-12T17:31:51.393 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:31:51.395 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin reshard add --bucket a-bucket --num-shards 12 2024-09-12T17:31:51.426 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:31:51.426 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:31:51.466 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.465+0000 7fc7ece0e800 20 rados->read ofs=0 len=0 2024-09-12T17:31:51.468 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.466+0000 7fc7ece0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:31:51.468 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.466+0000 7fc7ece0e800 20 realm 2024-09-12T17:31:51.468 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.466+0000 7fc7ece0e800 20 rados->read ofs=0 len=0 2024-09-12T17:31:51.468 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.466+0000 7fc7ece0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:31:51.468 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.466+0000 7fc7ece0e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:31:51.469 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.466+0000 7fc7ece0e800 20 rados->read ofs=0 len=0 2024-09-12T17:31:51.469 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.467+0000 7fc7ece0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:31:51.469 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.467+0000 7fc7ece0e800 20 rados->read ofs=0 len=0 2024-09-12T17:31:51.469 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.467+0000 7fc7ece0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:31:51.469 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.467+0000 7fc7ece0e800 20 rados->read ofs=0 len=0 2024-09-12T17:31:51.470 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.468+0000 7fc7ece0e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:31:51.470 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.468+0000 7fc7ece0e800 20 searching for the correct realm 2024-09-12T17:31:51.471 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.471+0000 7fc7e7d6a640 0 -- 172.21.15.37:0/4086295459 >> [v2:172.21.15.37:6816/2964054205,v1:172.21.15.37:6817/2964054205] conn(0x559b04f515d0 msgr2=0x559b04f53a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:31:51.475 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.475+0000 7fc7e856b640 0 -- 172.21.15.37:0/4086295459 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7fc7dc0a2960 msgr2=0x7fc7dc0da730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:31:51.481 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.480+0000 7fc7ece0e800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:31:51.481 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.480+0000 7fc7ece0e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:31:51.481 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.480+0000 7fc7ece0e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:31:51.482 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.480+0000 7fc7ece0e800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:31:51.482 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.480+0000 7fc7ece0e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:31:51.482 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.480+0000 7fc7ece0e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:31:51.482 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.480+0000 7fc7ece0e800 20 rados->read ofs=0 len=0 2024-09-12T17:31:51.482 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.480+0000 7fc7ece0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:31:51.482 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.480+0000 7fc7ece0e800 20 rados->read ofs=0 len=0 2024-09-12T17:31:51.482 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.480+0000 7fc7ece0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:31:51.482 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.480+0000 7fc7ece0e800 20 rados->read ofs=0 len=0 2024-09-12T17:31:51.484 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.481+0000 7fc7ece0e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:31:51.484 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.481+0000 7fc7ece0e800 20 zone default found 2024-09-12T17:31:51.484 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.481+0000 7fc7ece0e800 4 Realm: () 2024-09-12T17:31:51.484 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.481+0000 7fc7ece0e800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:31:51.485 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.481+0000 7fc7ece0e800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:31:51.485 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.481+0000 7fc7ece0e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:31:51.485 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.481+0000 7fc7ece0e800 20 zonegroup default 2024-09-12T17:31:51.485 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.481+0000 7fc7ece0e800 20 rados->read ofs=0 len=0 2024-09-12T17:31:51.485 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.481+0000 7fc7ece0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:31:51.485 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.481+0000 7fc7ece0e800 20 rados->read ofs=0 len=0 2024-09-12T17:31:51.485 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.482+0000 7fc7ece0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:31:51.485 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.482+0000 7fc7ece0e800 20 rados->read ofs=0 len=0 2024-09-12T17:31:51.486 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.482+0000 7fc7ece0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:31:51.486 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.482+0000 7fc7ece0e800 20 started sync module instance, tier type = 2024-09-12T17:31:51.486 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.482+0000 7fc7ece0e800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:31:51.492 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.491+0000 7fc7ece0e800 20 add_watcher() i=0 2024-09-12T17:31:51.492 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.491+0000 7fc7ece0e800 20 add_watcher() i=1 2024-09-12T17:31:51.492 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.491+0000 7fc7ece0e800 20 add_watcher() i=2 2024-09-12T17:31:51.492 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.491+0000 7fc7ece0e800 20 add_watcher() i=3 2024-09-12T17:31:51.492 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.491+0000 7fc7ece0e800 20 add_watcher() i=4 2024-09-12T17:31:51.492 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.491+0000 7fc7ece0e800 20 add_watcher() i=5 2024-09-12T17:31:51.493 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.491+0000 7fc7ece0e800 20 add_watcher() i=6 2024-09-12T17:31:51.493 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.492+0000 7fc7ece0e800 20 add_watcher() i=7 2024-09-12T17:31:51.493 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.492+0000 7fc7ece0e800 2 all 8 watchers are set, enabling cache 2024-09-12T17:31:51.494 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.494+0000 7fc69efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:31:51.496 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.494+0000 7fc7ece0e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:31:51.496 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.494+0000 7fc7ece0e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:31:51.496 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.494+0000 7fc7ece0e800 5 note: GC not initialized 2024-09-12T17:31:51.496 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.494+0000 7fc69dfdb640 20 reqs_thread_entry: start 2024-09-12T17:31:51.496 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.494+0000 7fc7ece0e800 20 init_complete bucket index max shards: 11 2024-09-12T17:31:51.496 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.495+0000 7fc7ece0e800 20 Filter name: none 2024-09-12T17:31:51.496 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.495+0000 7fc60f7fe640 20 reqs_thread_entry: start 2024-09-12T17:31:51.496 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.495+0000 7fc7ece0e800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:31:51.496 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.495+0000 7fc7ece0e800 20 rados->read ofs=0 len=0 2024-09-12T17:31:51.496 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.495+0000 7fc7ece0e800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:31:51.497 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.495+0000 7fc7ece0e800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:31:51.497 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.495+0000 7fc7ece0e800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:31:51.497 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.495+0000 7fc7ece0e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 : miss 2024-09-12T17:31:51.497 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.495+0000 7fc7ece0e800 20 rados->read ofs=0 len=0 2024-09-12T17:31:51.497 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.495+0000 7fc7ece0e800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:31:51.497 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.495+0000 7fc7ece0e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 info.flags=0x17 2024-09-12T17:31:51.497 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.495+0000 7fc7ece0e800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 to cache LRU end 2024-09-12T17:31:51.498 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.495+0000 7fc7ece0e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:31:51.498 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.495+0000 7fc7ece0e800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:31:51.498 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.496+0000 7fc7ece0e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 2024-09-12T17:31:51.499 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.497+0000 7fc69efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:31:51.500 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.500+0000 7fc7ece0e800 20 remove_watcher() i=0 2024-09-12T17:31:51.500 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.500+0000 7fc7ece0e800 2 removed watcher, disabling cache 2024-09-12T17:31:51.501 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.501+0000 7fc7ece0e800 20 remove_watcher() i=1 2024-09-12T17:31:51.503 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.502+0000 7fc7ece0e800 20 remove_watcher() i=2 2024-09-12T17:31:51.504 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.503+0000 7fc7ece0e800 20 remove_watcher() i=3 2024-09-12T17:31:51.505 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.504+0000 7fc7ece0e800 20 remove_watcher() i=4 2024-09-12T17:31:51.506 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.505+0000 7fc7ece0e800 20 remove_watcher() i=5 2024-09-12T17:31:51.507 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.506+0000 7fc7ece0e800 20 remove_watcher() i=6 2024-09-12T17:31:51.508 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.507+0000 7fc7ece0e800 20 remove_watcher() i=7 2024-09-12T17:31:51.521 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin reshard list 2024-09-12T17:31:51.548 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:31:51.548 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:31:51.587 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.586+0000 7f8dc313b800 20 rados->read ofs=0 len=0 2024-09-12T17:31:51.590 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.589+0000 7f8dc313b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:31:51.590 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.589+0000 7f8dc313b800 20 realm 2024-09-12T17:31:51.590 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.589+0000 7f8dc313b800 20 rados->read ofs=0 len=0 2024-09-12T17:31:51.590 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.589+0000 7f8dc313b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:31:51.590 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.589+0000 7f8dc313b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:31:51.590 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.589+0000 7f8dc313b800 20 rados->read ofs=0 len=0 2024-09-12T17:31:51.590 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.589+0000 7f8dc313b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:31:51.590 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.589+0000 7f8dc313b800 20 rados->read ofs=0 len=0 2024-09-12T17:31:51.591 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.590+0000 7f8dc313b800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:31:51.591 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.590+0000 7f8dc313b800 20 rados->read ofs=0 len=0 2024-09-12T17:31:51.591 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.590+0000 7f8dc313b800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:31:51.591 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.590+0000 7f8dc313b800 20 searching for the correct realm 2024-09-12T17:31:51.592 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.591+0000 7f8dbf6bc640 0 -- 172.21.15.37:0/2038406226 >> [v2:172.21.15.40:6818/1210108009,v1:172.21.15.40:6819/1210108009] conn(0x7f8da8069020 msgr2=0x7f8da80a3050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:31:51.797 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:51.796+0000 7f8dbf6bc640 0 -- 172.21.15.37:0/2038406226 >> [v2:172.21.15.40:6808/2253405131,v1:172.21.15.40:6809/2253405131] conn(0x7f8da80ad860 msgr2=0x7f8da80dc210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:31:52.008 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.007+0000 7f8dc313b800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:31:52.008 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.007+0000 7f8dc313b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:31:52.008 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.007+0000 7f8dc313b800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:31:52.008 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.007+0000 7f8dc313b800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:31:52.009 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.007+0000 7f8dc313b800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:31:52.009 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.007+0000 7f8dc313b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:31:52.009 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.007+0000 7f8dc313b800 20 rados->read ofs=0 len=0 2024-09-12T17:31:52.009 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.007+0000 7f8dc313b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:31:52.009 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.007+0000 7f8dc313b800 20 rados->read ofs=0 len=0 2024-09-12T17:31:52.011 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.008+0000 7f8dc313b800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:31:52.011 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.008+0000 7f8dc313b800 20 rados->read ofs=0 len=0 2024-09-12T17:31:52.011 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.008+0000 7f8dc313b800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:31:52.011 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.008+0000 7f8dc313b800 20 zone default found 2024-09-12T17:31:52.011 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.008+0000 7f8dc313b800 4 Realm: () 2024-09-12T17:31:52.011 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.008+0000 7f8dc313b800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:31:52.011 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.008+0000 7f8dc313b800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:31:52.011 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.008+0000 7f8dc313b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:31:52.011 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.008+0000 7f8dc313b800 20 zonegroup default 2024-09-12T17:31:52.011 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.008+0000 7f8dc313b800 20 rados->read ofs=0 len=0 2024-09-12T17:31:52.012 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.008+0000 7f8dc313b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:31:52.012 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.009+0000 7f8dc313b800 20 rados->read ofs=0 len=0 2024-09-12T17:31:52.012 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.009+0000 7f8dc313b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:31:52.012 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.009+0000 7f8dc313b800 20 rados->read ofs=0 len=0 2024-09-12T17:31:52.012 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.009+0000 7f8dc313b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:31:52.012 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.009+0000 7f8dc313b800 20 started sync module instance, tier type = 2024-09-12T17:31:52.012 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.009+0000 7f8dc313b800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:31:52.021 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.020+0000 7f8dc313b800 20 add_watcher() i=0 2024-09-12T17:31:52.022 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.020+0000 7f8dc313b800 20 add_watcher() i=1 2024-09-12T17:31:52.022 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.020+0000 7f8dc313b800 20 add_watcher() i=2 2024-09-12T17:31:52.022 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.020+0000 7f8dc313b800 20 add_watcher() i=3 2024-09-12T17:31:52.022 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.020+0000 7f8dc313b800 20 add_watcher() i=4 2024-09-12T17:31:52.022 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.020+0000 7f8dc313b800 20 add_watcher() i=5 2024-09-12T17:31:52.022 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.020+0000 7f8dc313b800 20 add_watcher() i=6 2024-09-12T17:31:52.023 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.021+0000 7f8dc313b800 20 add_watcher() i=7 2024-09-12T17:31:52.023 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.021+0000 7f8dc313b800 2 all 8 watchers are set, enabling cache 2024-09-12T17:31:52.024 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.023+0000 7f8c757e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:31:52.025 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.024+0000 7f8dc313b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:31:52.026 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.024+0000 7f8dc313b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:31:52.026 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.024+0000 7f8dc313b800 5 note: GC not initialized 2024-09-12T17:31:52.026 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.024+0000 7f8beffff640 20 reqs_thread_entry: start 2024-09-12T17:31:52.026 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.024+0000 7f8dc313b800 20 init_complete bucket index max shards: 11 2024-09-12T17:31:52.026 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.024+0000 7f8dc313b800 20 Filter name: none 2024-09-12T17:31:52.026 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.024+0000 7f8bedffb640 20 reqs_thread_entry: start 2024-09-12T17:31:52.033 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.032+0000 7f8c757e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:31:52.036 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.035+0000 7f8dc313b800 20 remove_watcher() i=0 2024-09-12T17:31:52.036 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.035+0000 7f8dc313b800 2 removed watcher, disabling cache 2024-09-12T17:31:52.037 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.036+0000 7f8dc313b800 20 remove_watcher() i=1 2024-09-12T17:31:52.038 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.037+0000 7f8dc313b800 20 remove_watcher() i=2 2024-09-12T17:31:52.039 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.039+0000 7f8dc313b800 20 remove_watcher() i=3 2024-09-12T17:31:52.040 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.040+0000 7f8dc313b800 20 remove_watcher() i=4 2024-09-12T17:31:52.042 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.041+0000 7f8dc313b800 20 remove_watcher() i=5 2024-09-12T17:31:52.043 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.042+0000 7f8dc313b800 20 remove_watcher() i=6 2024-09-12T17:31:52.044 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.043+0000 7f8dc313b800 20 remove_watcher() i=7 2024-09-12T17:31:52.056 INFO:tasks.workunit.client.0.smithi037.stderr:bucket name a-bucket 2024-09-12T17:31:52.056 INFO:tasks.workunit.client.0.smithi037.stderr:TEST: reshard process 2024-09-12T17:31:52.056 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:31:52.058 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin reshard process 2024-09-12T17:31:52.086 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:31:52.086 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:31:52.127 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.126+0000 7f9cfbb34800 20 rados->read ofs=0 len=0 2024-09-12T17:31:52.129 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.128+0000 7f9cfbb34800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:31:52.129 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.128+0000 7f9cfbb34800 20 realm 2024-09-12T17:31:52.129 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.128+0000 7f9cfbb34800 20 rados->read ofs=0 len=0 2024-09-12T17:31:52.129 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.128+0000 7f9cfbb34800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:31:52.129 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.128+0000 7f9cfbb34800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:31:52.129 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.128+0000 7f9cfbb34800 20 rados->read ofs=0 len=0 2024-09-12T17:31:52.129 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.128+0000 7f9cfbb34800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:31:52.129 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.128+0000 7f9cfbb34800 20 rados->read ofs=0 len=0 2024-09-12T17:31:52.130 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.129+0000 7f9cfbb34800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:31:52.130 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.129+0000 7f9cfbb34800 20 rados->read ofs=0 len=0 2024-09-12T17:31:52.130 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.129+0000 7f9cfbb34800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:31:52.130 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.130+0000 7f9cfbb34800 20 searching for the correct realm 2024-09-12T17:31:52.134 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.133+0000 7f9cef0b6640 0 -- 172.21.15.37:0/2455851026 >> [v2:172.21.15.40:6800/2441293461,v1:172.21.15.40:6801/2441293461] conn(0x7f9ce8052060 msgr2=0x7f9ce8049040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:31:52.138 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.137+0000 7f9cf78b7640 0 -- 172.21.15.37:0/2455851026 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7f9ce008b7e0 msgr2=0x7f9ce00d2ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:31:52.346 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.344+0000 7f9cfbb34800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:31:52.346 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.344+0000 7f9cfbb34800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:31:52.346 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.344+0000 7f9cfbb34800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:31:52.346 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.344+0000 7f9cfbb34800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:31:52.346 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.344+0000 7f9cfbb34800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:31:52.346 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.344+0000 7f9cfbb34800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:31:52.347 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.344+0000 7f9cfbb34800 20 rados->read ofs=0 len=0 2024-09-12T17:31:52.347 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.344+0000 7f9cfbb34800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:31:52.347 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.344+0000 7f9cfbb34800 20 rados->read ofs=0 len=0 2024-09-12T17:31:52.347 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.345+0000 7f9cfbb34800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:31:52.347 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.345+0000 7f9cfbb34800 20 rados->read ofs=0 len=0 2024-09-12T17:31:52.348 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.345+0000 7f9cfbb34800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:31:52.349 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.345+0000 7f9cfbb34800 20 zone default found 2024-09-12T17:31:52.349 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.345+0000 7f9cfbb34800 4 Realm: () 2024-09-12T17:31:52.349 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.345+0000 7f9cfbb34800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:31:52.349 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.345+0000 7f9cfbb34800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:31:52.349 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.345+0000 7f9cfbb34800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:31:52.349 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.345+0000 7f9cfbb34800 20 zonegroup default 2024-09-12T17:31:52.349 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.345+0000 7f9cfbb34800 20 rados->read ofs=0 len=0 2024-09-12T17:31:52.349 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.345+0000 7f9cfbb34800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:31:52.349 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.345+0000 7f9cfbb34800 20 rados->read ofs=0 len=0 2024-09-12T17:31:52.349 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.346+0000 7f9cfbb34800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:31:52.349 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.346+0000 7f9cfbb34800 20 rados->read ofs=0 len=0 2024-09-12T17:31:52.349 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.346+0000 7f9cfbb34800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:31:52.349 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.346+0000 7f9cfbb34800 20 started sync module instance, tier type = 2024-09-12T17:31:52.350 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.346+0000 7f9cfbb34800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:31:52.357 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.356+0000 7f9cfbb34800 20 add_watcher() i=0 2024-09-12T17:31:52.358 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.356+0000 7f9cfbb34800 20 add_watcher() i=1 2024-09-12T17:31:52.358 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.356+0000 7f9cfbb34800 20 add_watcher() i=2 2024-09-12T17:31:52.358 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.356+0000 7f9cfbb34800 20 add_watcher() i=3 2024-09-12T17:31:52.358 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.356+0000 7f9cfbb34800 20 add_watcher() i=4 2024-09-12T17:31:52.358 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.356+0000 7f9cfbb34800 20 add_watcher() i=5 2024-09-12T17:31:52.358 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.356+0000 7f9cfbb34800 20 add_watcher() i=6 2024-09-12T17:31:52.358 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.357+0000 7f9cfbb34800 20 add_watcher() i=7 2024-09-12T17:31:52.358 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.357+0000 7f9cfbb34800 2 all 8 watchers are set, enabling cache 2024-09-12T17:31:52.359 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.359+0000 7f9badfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:31:52.360 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.359+0000 7f9cfbb34800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:31:52.361 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.359+0000 7f9cfbb34800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:31:52.361 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.359+0000 7f9cfbb34800 5 note: GC not initialized 2024-09-12T17:31:52.361 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.359+0000 7f9bacfe1640 20 reqs_thread_entry: start 2024-09-12T17:31:52.361 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.360+0000 7f9cfbb34800 20 init_complete bucket index max shards: 11 2024-09-12T17:31:52.361 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.360+0000 7f9cfbb34800 20 Filter name: none 2024-09-12T17:31:52.361 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.360+0000 7f9b267fc640 20 reqs_thread_entry: start 2024-09-12T17:31:52.361 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.360+0000 7f9cfbb34800 20 processing logshard = reshard.0000000000 2024-09-12T17:31:52.363 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.362+0000 7f9cfbb34800 20 finish processing logshard = reshard.0000000000 , ret = 0 2024-09-12T17:31:52.363 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.362+0000 7f9cfbb34800 20 processing logshard = reshard.0000000001 2024-09-12T17:31:52.366 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.365+0000 7f9cfbb34800 20 finish processing logshard = reshard.0000000001 , ret = 0 2024-09-12T17:31:52.366 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.365+0000 7f9cfbb34800 20 processing logshard = reshard.0000000002 2024-09-12T17:31:52.368 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.368+0000 7f9cfbb34800 20 finish processing logshard = reshard.0000000002 , ret = 0 2024-09-12T17:31:52.368 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.368+0000 7f9cfbb34800 20 processing logshard = reshard.0000000003 2024-09-12T17:31:52.371 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.370+0000 7f9cfbb34800 20 finish processing logshard = reshard.0000000003 , ret = 0 2024-09-12T17:31:52.371 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.370+0000 7f9cfbb34800 20 processing logshard = reshard.0000000004 2024-09-12T17:31:52.373 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.373+0000 7f9cfbb34800 20 finish processing logshard = reshard.0000000004 , ret = 0 2024-09-12T17:31:52.374 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.373+0000 7f9cfbb34800 20 processing logshard = reshard.0000000005 2024-09-12T17:31:52.376 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.375+0000 7f9cfbb34800 20 finish processing logshard = reshard.0000000005 , ret = 0 2024-09-12T17:31:52.376 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.375+0000 7f9cfbb34800 20 processing logshard = reshard.0000000006 2024-09-12T17:31:52.378 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.377+0000 7f9cfbb34800 20 process_entry resharding a-bucket 2024-09-12T17:31:52.378 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.377+0000 7f9cfbb34800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:31:52.378 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.377+0000 7f9cfbb34800 20 rados->read ofs=0 len=0 2024-09-12T17:31:52.378 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.377+0000 7f9cfbb34800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:31:52.378 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.377+0000 7f9cfbb34800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x1 2024-09-12T17:31:52.378 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.377+0000 7f9cfbb34800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:31:52.378 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.377+0000 7f9cfbb34800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 : miss 2024-09-12T17:31:52.378 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.377+0000 7f9cfbb34800 20 rados->read ofs=0 len=0 2024-09-12T17:31:52.379 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.377+0000 7f9cfbb34800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:31:52.379 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.377+0000 7f9cfbb34800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 info.flags=0x17 2024-09-12T17:31:52.379 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.378+0000 7f9cfbb34800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 to cache LRU end 2024-09-12T17:31:52.379 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.378+0000 7f9cfbb34800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:31:52.379 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.378+0000 7f9cfbb34800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:31:52.379 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.378+0000 7f9cfbb34800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 2024-09-12T17:31:52.386 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.385+0000 7f9cfbb34800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 info.flags=0x17 2024-09-12T17:31:52.386 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.385+0000 7f9cfbb34800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 to cache LRU end 2024-09-12T17:31:52.386 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.385+0000 7f9cfbb34800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:31:52.386 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.385+0000 7f9cfbb34800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18, ofs0, ns] 2024-09-12T17:31:52.386 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.385+0000 7f9bd67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496970 cookie 94245322883152 notifier 6090 bl.length()=911 2024-09-12T17:31:52.386 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.385+0000 7f9bd67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 info.flags=0x17 2024-09-12T17:31:52.386 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.385+0000 7f9bd67fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 to cache LRU end 2024-09-12T17:31:52.386 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.385+0000 7f9bd67fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:31:52.387 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.387+0000 7f9cfbb34800 20 handle_bi_update(): bucket=:a-bucket[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18]): orig_sources= new_sources= 2024-09-12T17:31:52.388 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.387+0000 7f9cfbb34800 20 handle_bi_update(): bucket=:a-bucket[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18]): potential sources added=[] removed=[] 2024-09-12T17:31:52.388 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.387+0000 7f9cfbb34800 20 handle_bi_update(): bucket=:a-bucket[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18]): orig_dests= new_dests= 2024-09-12T17:31:52.388 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.387+0000 7f9cfbb34800 20 handle_bi_update(): bucket=:a-bucket[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18]): potential dests added=[] removed=[] 2024-09-12T17:31:52.393 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.392+0000 7f9cfbb34800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.1.0 2024-09-12T17:31:52.394 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.392+0000 7f9cfbb34800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.1.0 2024-09-12T17:31:52.394 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.392+0000 7f9cfbb34800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.1.1 2024-09-12T17:31:52.394 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.392+0000 7f9cfbb34800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.1.1 2024-09-12T17:31:52.394 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.392+0000 7f9cfbb34800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.1.2 2024-09-12T17:31:52.394 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.392+0000 7f9cfbb34800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.1.2 2024-09-12T17:31:52.394 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.392+0000 7f9cfbb34800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.1.3 2024-09-12T17:31:52.394 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.392+0000 7f9cfbb34800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.1.3 2024-09-12T17:31:52.394 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.392+0000 7f9cfbb34800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.1.4 2024-09-12T17:31:52.394 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.392+0000 7f9cfbb34800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.1.4 2024-09-12T17:31:52.395 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.392+0000 7f9cfbb34800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.1.5 2024-09-12T17:31:52.395 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.392+0000 7f9cfbb34800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.1.5 2024-09-12T17:31:52.395 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.392+0000 7f9cfbb34800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.1.6 2024-09-12T17:31:52.395 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.392+0000 7f9cfbb34800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.1.6 2024-09-12T17:31:52.395 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.392+0000 7f9cfbb34800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.1.7 2024-09-12T17:31:52.395 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.392+0000 7f9cfbb34800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.1.7 2024-09-12T17:31:52.395 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.392+0000 7f9cfbb34800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.1.8 2024-09-12T17:31:52.395 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.392+0000 7f9cfbb34800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.1.8 2024-09-12T17:31:52.395 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.392+0000 7f9cfbb34800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.1.9 2024-09-12T17:31:52.395 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.392+0000 7f9cfbb34800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.1.9 2024-09-12T17:31:52.395 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.392+0000 7f9cfbb34800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.1.10 2024-09-12T17:31:52.396 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.392+0000 7f9cfbb34800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.1.10 2024-09-12T17:31:52.396 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.392+0000 7f9cfbb34800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.1.11 2024-09-12T17:31:52.396 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.392+0000 7f9cfbb34800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.1.11 2024-09-12T17:31:52.396 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.392+0000 7f9cfbb34800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.0 2024-09-12T17:31:52.396 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.393+0000 7f9cfbb34800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.1 2024-09-12T17:31:52.397 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.393+0000 7f9cfbb34800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2 2024-09-12T17:31:52.397 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.394+0000 7f9cfbb34800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.3 2024-09-12T17:31:52.397 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.395+0000 7f9cfbb34800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.4 2024-09-12T17:31:52.397 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.395+0000 7f9cfbb34800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.5 2024-09-12T17:31:52.397 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.395+0000 7f9cfbb34800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.6 2024-09-12T17:31:52.397 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.396+0000 7f9cfbb34800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.7 2024-09-12T17:31:52.398 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.396+0000 7f9cfbb34800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.8 2024-09-12T17:31:52.399 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.397+0000 7f9cfbb34800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.9 2024-09-12T17:31:52.399 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.398+0000 7f9cfbb34800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.10 2024-09-12T17:31:52.399 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.398+0000 7f9cfbb34800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 : hit (requested=0x17, cached=0x17) 2024-09-12T17:31:52.399 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.398+0000 7f9cfbb34800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 2024-09-12T17:31:52.401 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.400+0000 7f9cfbb34800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 info.flags=0x17 2024-09-12T17:31:52.401 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.400+0000 7f9cfbb34800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 to cache LRU end 2024-09-12T17:31:52.401 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.400+0000 7f9cfbb34800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:31:52.401 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.400+0000 7f9cfbb34800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18, ofs0, ns] 2024-09-12T17:31:52.401 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.400+0000 7f9bd6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496971 cookie 94245322883152 notifier 6090 bl.length()=911 2024-09-12T17:31:52.401 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.400+0000 7f9bd6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 info.flags=0x17 2024-09-12T17:31:52.401 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.400+0000 7f9bd6ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 to cache LRU end 2024-09-12T17:31:52.401 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.400+0000 7f9bd6ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:31:52.402 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.402+0000 7f9cfbb34800 20 handle_bi_update(): bucket=:a-bucket[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18]): orig_sources= new_sources= 2024-09-12T17:31:52.402 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.402+0000 7f9cfbb34800 20 handle_bi_update(): bucket=:a-bucket[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18]): potential sources added=[] removed=[] 2024-09-12T17:31:52.403 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.402+0000 7f9cfbb34800 20 handle_bi_update(): bucket=:a-bucket[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18]): orig_dests= new_dests= 2024-09-12T17:31:52.403 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.402+0000 7f9cfbb34800 20 handle_bi_update(): bucket=:a-bucket[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18]): potential dests added=[] removed=[] 2024-09-12T17:31:52.405 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.404+0000 7f9cfbb34800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.0 2024-09-12T17:31:52.406 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.405+0000 7f9cfbb34800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.1 2024-09-12T17:31:52.406 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.405+0000 7f9cfbb34800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2 2024-09-12T17:31:52.406 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.406+0000 7f9cfbb34800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.3 2024-09-12T17:31:52.407 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.406+0000 7f9cfbb34800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.4 2024-09-12T17:31:52.407 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.406+0000 7f9cfbb34800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.5 2024-09-12T17:31:52.407 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.407+0000 7f9cfbb34800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.6 2024-09-12T17:31:52.408 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.407+0000 7f9cfbb34800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.7 2024-09-12T17:31:52.408 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.407+0000 7f9cfbb34800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.8 2024-09-12T17:31:52.408 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.408+0000 7f9cfbb34800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.9 2024-09-12T17:31:52.409 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.408+0000 7f9cfbb34800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.10 2024-09-12T17:31:52.409 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.408+0000 7f9cfbb34800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 : hit (requested=0x17, cached=0x17) 2024-09-12T17:31:52.409 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.408+0000 7f9cfbb34800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 2024-09-12T17:31:52.411 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.410+0000 7f9cfbb34800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 info.flags=0x17 2024-09-12T17:31:52.411 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.410+0000 7f9cfbb34800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 to cache LRU end 2024-09-12T17:31:52.411 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.410+0000 7f9cfbb34800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:31:52.411 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.410+0000 7f9cfbb34800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18, ofs0, ns] 2024-09-12T17:31:52.411 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.410+0000 7f9bd67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496972 cookie 94245322883152 notifier 6090 bl.length()=879 2024-09-12T17:31:52.411 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.410+0000 7f9bd67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 info.flags=0x17 2024-09-12T17:31:52.411 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.410+0000 7f9bd67fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 to cache LRU end 2024-09-12T17:31:52.411 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.410+0000 7f9bd67fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:31:52.412 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.412+0000 7f9cfbb34800 20 handle_bi_update(): bucket=:a-bucket[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18]): orig_sources= new_sources= 2024-09-12T17:31:52.413 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.412+0000 7f9cfbb34800 20 handle_bi_update(): bucket=:a-bucket[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18]): potential sources added=[] removed=[] 2024-09-12T17:31:52.413 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.412+0000 7f9cfbb34800 20 handle_bi_update(): bucket=:a-bucket[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18]): orig_dests= new_dests= 2024-09-12T17:31:52.413 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.412+0000 7f9cfbb34800 20 handle_bi_update(): bucket=:a-bucket[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18]): potential dests added=[] removed=[] 2024-09-12T17:31:52.415 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.414+0000 7f9cfbb34800 1 execute INFO: reshard of bucket "a-bucket" from 11 shards to 12 shards completed successfully 2024-09-12T17:31:52.416 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.415+0000 7f9cfbb34800 20 process_entry removing reshard queue entry for bucket a-bucket 2024-09-12T17:31:52.418 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.417+0000 7f9cfbb34800 20 finish processing logshard = reshard.0000000006 , ret = 0 2024-09-12T17:31:52.418 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.417+0000 7f9cfbb34800 20 processing logshard = reshard.0000000007 2024-09-12T17:31:52.420 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.420+0000 7f9cfbb34800 20 finish processing logshard = reshard.0000000007 , ret = 0 2024-09-12T17:31:52.420 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.420+0000 7f9cfbb34800 20 processing logshard = reshard.0000000008 2024-09-12T17:31:52.423 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.422+0000 7f9cfbb34800 20 finish processing logshard = reshard.0000000008 , ret = 0 2024-09-12T17:31:52.424 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.422+0000 7f9cfbb34800 20 processing logshard = reshard.0000000009 2024-09-12T17:31:52.426 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.425+0000 7f9cfbb34800 20 finish processing logshard = reshard.0000000009 , ret = 0 2024-09-12T17:31:52.426 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.425+0000 7f9cfbb34800 20 processing logshard = reshard.0000000010 2024-09-12T17:31:52.428 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.427+0000 7f9cfbb34800 20 finish processing logshard = reshard.0000000010 , ret = 0 2024-09-12T17:31:52.428 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.427+0000 7f9cfbb34800 20 processing logshard = reshard.0000000011 2024-09-12T17:31:52.430 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.429+0000 7f9cfbb34800 20 finish processing logshard = reshard.0000000011 , ret = 0 2024-09-12T17:31:52.430 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.429+0000 7f9cfbb34800 20 processing logshard = reshard.0000000012 2024-09-12T17:31:52.433 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.432+0000 7f9cfbb34800 20 finish processing logshard = reshard.0000000012 , ret = 0 2024-09-12T17:31:52.433 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.432+0000 7f9cfbb34800 20 processing logshard = reshard.0000000013 2024-09-12T17:31:52.435 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.435+0000 7f9cfbb34800 20 finish processing logshard = reshard.0000000013 , ret = 0 2024-09-12T17:31:52.436 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.435+0000 7f9cfbb34800 20 processing logshard = reshard.0000000014 2024-09-12T17:31:52.438 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.437+0000 7f9cfbb34800 20 finish processing logshard = reshard.0000000014 , ret = 0 2024-09-12T17:31:52.438 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.437+0000 7f9cfbb34800 20 processing logshard = reshard.0000000015 2024-09-12T17:31:52.440 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.440+0000 7f9cfbb34800 20 finish processing logshard = reshard.0000000015 , ret = 0 2024-09-12T17:31:52.441 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.441+0000 7f9badfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:31:52.443 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.443+0000 7f9cfbb34800 20 remove_watcher() i=0 2024-09-12T17:31:52.444 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.443+0000 7f9cfbb34800 2 removed watcher, disabling cache 2024-09-12T17:31:52.445 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.444+0000 7f9cfbb34800 20 remove_watcher() i=1 2024-09-12T17:31:52.446 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.445+0000 7f9cfbb34800 20 remove_watcher() i=2 2024-09-12T17:31:52.447 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.446+0000 7f9cfbb34800 20 remove_watcher() i=3 2024-09-12T17:31:52.448 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.447+0000 7f9cfbb34800 20 remove_watcher() i=4 2024-09-12T17:31:52.449 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.448+0000 7f9cfbb34800 20 remove_watcher() i=5 2024-09-12T17:31:52.450 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.449+0000 7f9cfbb34800 20 remove_watcher() i=6 2024-09-12T17:31:52.451 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:52.450+0000 7f9cfbb34800 20 remove_watcher() i=7 2024-09-12T17:31:57.469 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T17:31:57.505 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:31:57.505 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:31:57.551 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:57.550+0000 7fe435926800 20 rados->read ofs=0 len=0 2024-09-12T17:31:57.553 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:57.552+0000 7fe435926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:31:57.553 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:57.552+0000 7fe435926800 20 realm 2024-09-12T17:31:57.553 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:57.552+0000 7fe435926800 20 rados->read ofs=0 len=0 2024-09-12T17:31:57.553 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:57.552+0000 7fe435926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:31:57.553 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:57.552+0000 7fe435926800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:31:57.553 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:57.552+0000 7fe435926800 20 rados->read ofs=0 len=0 2024-09-12T17:31:57.554 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:57.553+0000 7fe435926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:31:57.554 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:57.553+0000 7fe435926800 20 rados->read ofs=0 len=0 2024-09-12T17:31:57.554 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:57.554+0000 7fe435926800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:31:57.554 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:57.554+0000 7fe435926800 20 rados->read ofs=0 len=0 2024-09-12T17:31:57.555 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:57.554+0000 7fe435926800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:31:57.555 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:57.554+0000 7fe435926800 20 searching for the correct realm 2024-09-12T17:31:57.558 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:57.557+0000 7fe430dd8640 0 -- 172.21.15.37:0/717034172 >> [v2:172.21.15.40:6800/2441293461,v1:172.21.15.40:6801/2441293461] conn(0x7fe424060ee0 msgr2=0x7fe424060950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:31:57.563 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:57.562+0000 7fe4315d9640 0 -- 172.21.15.37:0/717034172 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7fe428073040 msgr2=0x7fe42808e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:31:57.772 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:57.771+0000 7fe435926800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:31:57.772 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:57.771+0000 7fe435926800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:31:57.772 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:57.771+0000 7fe435926800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:31:57.772 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:57.771+0000 7fe435926800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:31:57.772 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:57.771+0000 7fe435926800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:31:57.772 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:57.771+0000 7fe435926800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:31:57.772 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:57.771+0000 7fe435926800 20 rados->read ofs=0 len=0 2024-09-12T17:31:57.772 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:57.771+0000 7fe435926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:31:57.772 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:57.771+0000 7fe435926800 20 rados->read ofs=0 len=0 2024-09-12T17:31:57.773 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:57.771+0000 7fe435926800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:31:57.773 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:57.771+0000 7fe435926800 20 rados->read ofs=0 len=0 2024-09-12T17:31:57.773 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:57.772+0000 7fe435926800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:31:57.774 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:57.772+0000 7fe435926800 20 zone default found 2024-09-12T17:31:57.774 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:57.772+0000 7fe435926800 4 Realm: () 2024-09-12T17:31:57.774 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:57.772+0000 7fe435926800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:31:57.774 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:57.772+0000 7fe435926800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:31:57.774 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:57.772+0000 7fe435926800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:31:57.774 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:57.772+0000 7fe435926800 20 zonegroup default 2024-09-12T17:31:57.774 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:57.772+0000 7fe435926800 20 rados->read ofs=0 len=0 2024-09-12T17:31:57.774 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:57.772+0000 7fe435926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:31:57.774 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:57.772+0000 7fe435926800 20 rados->read ofs=0 len=0 2024-09-12T17:31:57.774 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:57.773+0000 7fe435926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:31:57.774 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:57.773+0000 7fe435926800 20 rados->read ofs=0 len=0 2024-09-12T17:31:57.775 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:57.773+0000 7fe435926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:31:57.775 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:57.773+0000 7fe435926800 20 started sync module instance, tier type = 2024-09-12T17:31:57.775 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:57.773+0000 7fe435926800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:31:57.785 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:57.784+0000 7fe435926800 20 add_watcher() i=0 2024-09-12T17:31:57.785 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:57.784+0000 7fe435926800 20 add_watcher() i=1 2024-09-12T17:31:57.785 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:57.784+0000 7fe435926800 20 add_watcher() i=2 2024-09-12T17:31:57.785 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:57.784+0000 7fe435926800 20 add_watcher() i=3 2024-09-12T17:31:57.785 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:57.784+0000 7fe435926800 20 add_watcher() i=4 2024-09-12T17:31:57.785 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:57.784+0000 7fe435926800 20 add_watcher() i=5 2024-09-12T17:31:57.785 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:57.784+0000 7fe435926800 20 add_watcher() i=6 2024-09-12T17:31:57.786 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:57.785+0000 7fe435926800 20 add_watcher() i=7 2024-09-12T17:31:57.786 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:57.785+0000 7fe435926800 2 all 8 watchers are set, enabling cache 2024-09-12T17:31:57.788 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:57.787+0000 7fe2e77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:31:57.789 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:57.787+0000 7fe435926800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:31:57.789 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:57.787+0000 7fe435926800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:31:57.789 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:57.787+0000 7fe435926800 5 note: GC not initialized 2024-09-12T17:31:57.789 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:57.788+0000 7fe2e67e4640 20 reqs_thread_entry: start 2024-09-12T17:31:57.789 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:57.788+0000 7fe435926800 20 init_complete bucket index max shards: 11 2024-09-12T17:31:57.789 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:57.788+0000 7fe435926800 20 Filter name: none 2024-09-12T17:31:57.789 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:57.788+0000 7fe257fff640 20 reqs_thread_entry: start 2024-09-12T17:31:57.789 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:57.788+0000 7fe435926800 20 rados->read ofs=0 len=0 2024-09-12T17:31:57.790 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:57.789+0000 7fe435926800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:31:57.790 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:57.789+0000 7fe435926800 20 rados->read ofs=0 len=0 2024-09-12T17:31:57.790 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:57.789+0000 7fe435926800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:31:57.790 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:57.789+0000 7fe435926800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:31:57.790 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:57.789+0000 7fe435926800 20 rados->read ofs=0 len=0 2024-09-12T17:31:57.791 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:57.790+0000 7fe435926800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:31:57.791 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:57.790+0000 7fe435926800 20 rados->read ofs=0 len=0 2024-09-12T17:31:57.791 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:57.790+0000 7fe435926800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:31:57.791 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:57.790+0000 7fe435926800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:31:57.793 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:57.792+0000 7fe2e77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:31:57.795 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:57.795+0000 7fe435926800 20 remove_watcher() i=0 2024-09-12T17:31:57.796 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:57.795+0000 7fe435926800 2 removed watcher, disabling cache 2024-09-12T17:31:57.797 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:57.796+0000 7fe435926800 20 remove_watcher() i=1 2024-09-12T17:31:57.798 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:57.797+0000 7fe435926800 20 remove_watcher() i=2 2024-09-12T17:31:57.799 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:57.799+0000 7fe435926800 20 remove_watcher() i=3 2024-09-12T17:31:57.800 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:57.800+0000 7fe435926800 20 remove_watcher() i=4 2024-09-12T17:31:57.802 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:57.801+0000 7fe435926800 20 remove_watcher() i=5 2024-09-12T17:31:57.803 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:57.802+0000 7fe435926800 20 remove_watcher() i=6 2024-09-12T17:31:57.804 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:57.803+0000 7fe435926800 20 remove_watcher() i=7 2024-09-12T17:31:57.817 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:31:57.817 INFO:tasks.workunit.client.0.smithi037.stderr:BUCKET_STATS: 2024-09-12T17:31:57.817 INFO:tasks.workunit.client.0.smithi037.stderr:bucket: a-bucket id: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 num_objects: 0 size_kb: 0 num_shards: 12 2024-09-12T17:31:57.817 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:31:57.817 INFO:tasks.workunit.client.0.smithi037.stderr:TEST: reshard add non empty bucket 2024-09-12T17:31:57.817 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:31:58.113 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T17:31:58.142 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:31:58.142 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:31:58.182 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.181+0000 7f486510c800 20 rados->read ofs=0 len=0 2024-09-12T17:31:58.184 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.183+0000 7f486510c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:31:58.184 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.183+0000 7f486510c800 20 realm 2024-09-12T17:31:58.184 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.183+0000 7f486510c800 20 rados->read ofs=0 len=0 2024-09-12T17:31:58.184 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.183+0000 7f486510c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:31:58.184 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.183+0000 7f486510c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:31:58.184 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.183+0000 7f486510c800 20 rados->read ofs=0 len=0 2024-09-12T17:31:58.184 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.183+0000 7f486510c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:31:58.184 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.183+0000 7f486510c800 20 rados->read ofs=0 len=0 2024-09-12T17:31:58.185 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.184+0000 7f486510c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:31:58.185 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.184+0000 7f486510c800 20 rados->read ofs=0 len=0 2024-09-12T17:31:58.185 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.184+0000 7f486510c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:31:58.185 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.184+0000 7f486510c800 20 searching for the correct realm 2024-09-12T17:31:58.188 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.187+0000 7f48623f5640 0 -- 172.21.15.37:0/325521970 >> [v2:172.21.15.40:6800/2441293461,v1:172.21.15.40:6801/2441293461] conn(0x7f485404e070 msgr2=0x7f485400c000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:31:58.192 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.191+0000 7f4862bf6640 0 -- 172.21.15.37:0/325521970 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7f48580616f0 msgr2=0x7f48580966b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:31:58.399 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.398+0000 7f486510c800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:31:58.399 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.398+0000 7f486510c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:31:58.400 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.398+0000 7f486510c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:31:58.400 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.398+0000 7f486510c800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:31:58.400 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.398+0000 7f486510c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:31:58.400 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.398+0000 7f486510c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:31:58.400 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.398+0000 7f486510c800 20 rados->read ofs=0 len=0 2024-09-12T17:31:58.400 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.399+0000 7f486510c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:31:58.400 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.399+0000 7f486510c800 20 rados->read ofs=0 len=0 2024-09-12T17:31:58.401 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.399+0000 7f486510c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:31:58.401 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.399+0000 7f486510c800 20 rados->read ofs=0 len=0 2024-09-12T17:31:58.401 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.399+0000 7f486510c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:31:58.401 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.399+0000 7f486510c800 20 zone default found 2024-09-12T17:31:58.402 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.399+0000 7f486510c800 4 Realm: () 2024-09-12T17:31:58.402 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.399+0000 7f486510c800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:31:58.402 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.399+0000 7f486510c800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:31:58.402 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.399+0000 7f486510c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:31:58.402 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.399+0000 7f486510c800 20 zonegroup default 2024-09-12T17:31:58.402 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.399+0000 7f486510c800 20 rados->read ofs=0 len=0 2024-09-12T17:31:58.402 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.400+0000 7f486510c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:31:58.402 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.400+0000 7f486510c800 20 rados->read ofs=0 len=0 2024-09-12T17:31:58.402 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.400+0000 7f486510c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:31:58.402 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.400+0000 7f486510c800 20 rados->read ofs=0 len=0 2024-09-12T17:31:58.402 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.400+0000 7f486510c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:31:58.402 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.400+0000 7f486510c800 20 started sync module instance, tier type = 2024-09-12T17:31:58.402 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.400+0000 7f486510c800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:31:58.411 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.410+0000 7f486510c800 20 add_watcher() i=0 2024-09-12T17:31:58.411 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.410+0000 7f486510c800 20 add_watcher() i=1 2024-09-12T17:31:58.411 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.410+0000 7f486510c800 20 add_watcher() i=2 2024-09-12T17:31:58.412 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.410+0000 7f486510c800 20 add_watcher() i=3 2024-09-12T17:31:58.412 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.410+0000 7f486510c800 20 add_watcher() i=4 2024-09-12T17:31:58.412 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.410+0000 7f486510c800 20 add_watcher() i=5 2024-09-12T17:31:58.412 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.410+0000 7f486510c800 20 add_watcher() i=6 2024-09-12T17:31:58.412 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.411+0000 7f486510c800 20 add_watcher() i=7 2024-09-12T17:31:58.412 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.411+0000 7f486510c800 2 all 8 watchers are set, enabling cache 2024-09-12T17:31:58.414 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.413+0000 7f47197e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:31:58.415 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.414+0000 7f486510c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:31:58.415 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.414+0000 7f486510c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:31:58.415 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.414+0000 7f486510c800 5 note: GC not initialized 2024-09-12T17:31:58.415 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.414+0000 7f4693fff640 20 reqs_thread_entry: start 2024-09-12T17:31:58.415 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.414+0000 7f486510c800 20 init_complete bucket index max shards: 11 2024-09-12T17:31:58.415 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.414+0000 7f486510c800 20 Filter name: none 2024-09-12T17:31:58.416 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.414+0000 7f4691ffb640 20 reqs_thread_entry: start 2024-09-12T17:31:58.416 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.414+0000 7f486510c800 20 rados->read ofs=0 len=0 2024-09-12T17:31:58.416 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.415+0000 7f486510c800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:31:58.417 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.415+0000 7f486510c800 20 rados->read ofs=0 len=0 2024-09-12T17:31:58.417 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.415+0000 7f486510c800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:31:58.417 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.415+0000 7f486510c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:31:58.417 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.415+0000 7f486510c800 20 rados->read ofs=0 len=0 2024-09-12T17:31:58.417 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.415+0000 7f486510c800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:31:58.417 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.415+0000 7f486510c800 20 rados->read ofs=0 len=0 2024-09-12T17:31:58.417 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.416+0000 7f486510c800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:31:58.417 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.416+0000 7f486510c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:31:58.418 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.418+0000 7f47197e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:31:58.421 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.420+0000 7f486510c800 20 remove_watcher() i=0 2024-09-12T17:31:58.421 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.420+0000 7f486510c800 2 removed watcher, disabling cache 2024-09-12T17:31:58.422 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.422+0000 7f486510c800 20 remove_watcher() i=1 2024-09-12T17:31:58.423 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.423+0000 7f486510c800 20 remove_watcher() i=2 2024-09-12T17:31:58.425 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.424+0000 7f486510c800 20 remove_watcher() i=3 2024-09-12T17:31:58.426 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.425+0000 7f486510c800 20 remove_watcher() i=4 2024-09-12T17:31:58.427 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.426+0000 7f486510c800 20 remove_watcher() i=5 2024-09-12T17:31:58.428 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.427+0000 7f486510c800 20 remove_watcher() i=6 2024-09-12T17:31:58.429 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.428+0000 7f486510c800 20 remove_watcher() i=7 2024-09-12T17:31:58.440 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:31:58.440 INFO:tasks.workunit.client.0.smithi037.stderr:BUCKET_STATS: 2024-09-12T17:31:58.440 INFO:tasks.workunit.client.0.smithi037.stderr:bucket: a-bucket id: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 num_objects: 8 size_kb: 1 num_shards: 12 2024-09-12T17:31:58.440 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:31:58.441 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin reshard add --bucket a-bucket --num-shards 13 2024-09-12T17:31:58.473 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:31:58.473 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:31:58.512 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.511+0000 7fa70e00f800 20 rados->read ofs=0 len=0 2024-09-12T17:31:58.514 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.513+0000 7fa70e00f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:31:58.514 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.513+0000 7fa70e00f800 20 realm 2024-09-12T17:31:58.514 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.513+0000 7fa70e00f800 20 rados->read ofs=0 len=0 2024-09-12T17:31:58.514 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.513+0000 7fa70e00f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:31:58.514 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.513+0000 7fa70e00f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:31:58.514 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.513+0000 7fa70e00f800 20 rados->read ofs=0 len=0 2024-09-12T17:31:58.514 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.513+0000 7fa70e00f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:31:58.514 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.513+0000 7fa70e00f800 20 rados->read ofs=0 len=0 2024-09-12T17:31:58.515 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.514+0000 7fa70e00f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:31:58.515 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.514+0000 7fa70e00f800 20 rados->read ofs=0 len=0 2024-09-12T17:31:58.516 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.515+0000 7fa70e00f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:31:58.516 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.515+0000 7fa70e00f800 20 searching for the correct realm 2024-09-12T17:31:58.519 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.518+0000 7fa7032f8640 0 -- 172.21.15.37:0/2192181891 >> [v2:172.21.15.37:6824/3990661154,v1:172.21.15.37:6825/3990661154] conn(0x560d18ab40c0 msgr2=0x560d18ab6550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:31:58.523 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.522+0000 7fa70baf9640 0 -- 172.21.15.37:0/2192181891 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7fa6f4067f60 msgr2=0x7fa6f4089280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:31:58.528 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.527+0000 7fa70e00f800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:31:58.528 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.527+0000 7fa70e00f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:31:58.528 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.527+0000 7fa70e00f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:31:58.528 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.527+0000 7fa70e00f800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:31:58.528 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.527+0000 7fa70e00f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:31:58.528 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.527+0000 7fa70e00f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:31:58.528 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.527+0000 7fa70e00f800 20 rados->read ofs=0 len=0 2024-09-12T17:31:58.528 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.527+0000 7fa70e00f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:31:58.528 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.527+0000 7fa70e00f800 20 rados->read ofs=0 len=0 2024-09-12T17:31:58.530 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.527+0000 7fa70e00f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:31:58.530 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.527+0000 7fa70e00f800 20 rados->read ofs=0 len=0 2024-09-12T17:31:58.530 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.528+0000 7fa70e00f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:31:58.530 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.528+0000 7fa70e00f800 20 zone default found 2024-09-12T17:31:58.530 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.528+0000 7fa70e00f800 4 Realm: () 2024-09-12T17:31:58.530 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.528+0000 7fa70e00f800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:31:58.530 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.528+0000 7fa70e00f800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:31:58.530 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.528+0000 7fa70e00f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:31:58.530 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.528+0000 7fa70e00f800 20 zonegroup default 2024-09-12T17:31:58.530 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.528+0000 7fa70e00f800 20 rados->read ofs=0 len=0 2024-09-12T17:31:58.530 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.528+0000 7fa70e00f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:31:58.531 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.528+0000 7fa70e00f800 20 rados->read ofs=0 len=0 2024-09-12T17:31:58.531 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.529+0000 7fa70e00f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:31:58.531 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.529+0000 7fa70e00f800 20 rados->read ofs=0 len=0 2024-09-12T17:31:58.531 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.529+0000 7fa70e00f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:31:58.531 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.529+0000 7fa70e00f800 20 started sync module instance, tier type = 2024-09-12T17:31:58.531 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.529+0000 7fa70e00f800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:31:58.539 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.538+0000 7fa70e00f800 20 add_watcher() i=0 2024-09-12T17:31:58.539 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.538+0000 7fa70e00f800 20 add_watcher() i=1 2024-09-12T17:31:58.539 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.538+0000 7fa70e00f800 20 add_watcher() i=2 2024-09-12T17:31:58.539 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.538+0000 7fa70e00f800 20 add_watcher() i=3 2024-09-12T17:31:58.539 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.538+0000 7fa70e00f800 20 add_watcher() i=4 2024-09-12T17:31:58.540 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.538+0000 7fa70e00f800 20 add_watcher() i=5 2024-09-12T17:31:58.540 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.538+0000 7fa70e00f800 20 add_watcher() i=6 2024-09-12T17:31:58.540 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.539+0000 7fa70e00f800 20 add_watcher() i=7 2024-09-12T17:31:58.540 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.539+0000 7fa70e00f800 2 all 8 watchers are set, enabling cache 2024-09-12T17:31:58.541 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.541+0000 7fa5c1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:31:58.542 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.541+0000 7fa70e00f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:31:58.543 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.541+0000 7fa70e00f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:31:58.543 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.541+0000 7fa70e00f800 5 note: GC not initialized 2024-09-12T17:31:58.543 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.541+0000 7fa5c0fe1640 20 reqs_thread_entry: start 2024-09-12T17:31:58.543 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.541+0000 7fa70e00f800 20 init_complete bucket index max shards: 11 2024-09-12T17:31:58.543 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.541+0000 7fa70e00f800 20 Filter name: none 2024-09-12T17:31:58.543 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.542+0000 7fa53a7fc640 20 reqs_thread_entry: start 2024-09-12T17:31:58.543 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.542+0000 7fa70e00f800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:31:58.543 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.542+0000 7fa70e00f800 20 rados->read ofs=0 len=0 2024-09-12T17:31:58.544 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.542+0000 7fa70e00f800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:31:58.544 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.542+0000 7fa70e00f800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:31:58.544 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.542+0000 7fa70e00f800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:31:58.544 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.542+0000 7fa70e00f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 : miss 2024-09-12T17:31:58.544 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.542+0000 7fa70e00f800 20 rados->read ofs=0 len=0 2024-09-12T17:31:58.544 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.543+0000 7fa70e00f800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:31:58.544 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.543+0000 7fa70e00f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 info.flags=0x17 2024-09-12T17:31:58.545 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.543+0000 7fa70e00f800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 to cache LRU end 2024-09-12T17:31:58.545 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.543+0000 7fa70e00f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:31:58.545 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.543+0000 7fa70e00f800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:31:58.545 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.543+0000 7fa70e00f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 2024-09-12T17:31:58.545 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.545+0000 7fa5c1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:31:58.548 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.547+0000 7fa70e00f800 20 remove_watcher() i=0 2024-09-12T17:31:58.548 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.547+0000 7fa70e00f800 2 removed watcher, disabling cache 2024-09-12T17:31:58.549 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.548+0000 7fa70e00f800 20 remove_watcher() i=1 2024-09-12T17:31:58.550 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.549+0000 7fa70e00f800 20 remove_watcher() i=2 2024-09-12T17:31:58.551 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.551+0000 7fa70e00f800 20 remove_watcher() i=3 2024-09-12T17:31:58.553 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.552+0000 7fa70e00f800 20 remove_watcher() i=4 2024-09-12T17:31:58.553 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.553+0000 7fa70e00f800 20 remove_watcher() i=5 2024-09-12T17:31:58.554 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.554+0000 7fa70e00f800 20 remove_watcher() i=6 2024-09-12T17:31:58.555 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.555+0000 7fa70e00f800 20 remove_watcher() i=7 2024-09-12T17:31:58.568 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin reshard list 2024-09-12T17:31:58.595 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:31:58.596 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:31:58.635 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.634+0000 7f31b1898800 20 rados->read ofs=0 len=0 2024-09-12T17:31:58.637 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.636+0000 7f31b1898800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:31:58.638 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.636+0000 7f31b1898800 20 realm 2024-09-12T17:31:58.638 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.636+0000 7f31b1898800 20 rados->read ofs=0 len=0 2024-09-12T17:31:58.638 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.636+0000 7f31b1898800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:31:58.638 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.636+0000 7f31b1898800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:31:58.638 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.636+0000 7f31b1898800 20 rados->read ofs=0 len=0 2024-09-12T17:31:58.638 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.636+0000 7f31b1898800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:31:58.638 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.636+0000 7f31b1898800 20 rados->read ofs=0 len=0 2024-09-12T17:31:58.639 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.637+0000 7f31b1898800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:31:58.639 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.637+0000 7f31b1898800 20 rados->read ofs=0 len=0 2024-09-12T17:31:58.639 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.638+0000 7f31b1898800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:31:58.639 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.638+0000 7f31b1898800 20 searching for the correct realm 2024-09-12T17:31:58.641 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.641+0000 7f31aeb88640 0 -- 172.21.15.37:0/3263193466 >> [v2:172.21.15.40:6800/2441293461,v1:172.21.15.40:6801/2441293461] conn(0x7f31a0032040 msgr2=0x7f31a0050040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:31:58.645 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.644+0000 7f31af389640 0 -- 172.21.15.37:0/3263193466 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7f31980ac7d0 msgr2=0x7f31980be7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:31:58.852 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.851+0000 7f31b1898800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:31:58.852 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.851+0000 7f31b1898800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:31:58.852 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.851+0000 7f31b1898800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:31:58.852 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.851+0000 7f31b1898800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:31:58.852 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.851+0000 7f31b1898800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:31:58.852 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.851+0000 7f31b1898800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:31:58.852 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.851+0000 7f31b1898800 20 rados->read ofs=0 len=0 2024-09-12T17:31:58.852 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.851+0000 7f31b1898800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:31:58.852 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.851+0000 7f31b1898800 20 rados->read ofs=0 len=0 2024-09-12T17:31:58.853 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.851+0000 7f31b1898800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:31:58.853 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.851+0000 7f31b1898800 20 rados->read ofs=0 len=0 2024-09-12T17:31:58.854 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.852+0000 7f31b1898800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:31:58.854 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.852+0000 7f31b1898800 20 zone default found 2024-09-12T17:31:58.854 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.852+0000 7f31b1898800 4 Realm: () 2024-09-12T17:31:58.854 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.852+0000 7f31b1898800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:31:58.854 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.852+0000 7f31b1898800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:31:58.854 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.852+0000 7f31b1898800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:31:58.854 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.852+0000 7f31b1898800 20 zonegroup default 2024-09-12T17:31:58.854 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.852+0000 7f31b1898800 20 rados->read ofs=0 len=0 2024-09-12T17:31:58.854 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.852+0000 7f31b1898800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:31:58.854 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.852+0000 7f31b1898800 20 rados->read ofs=0 len=0 2024-09-12T17:31:58.854 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.853+0000 7f31b1898800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:31:58.854 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.853+0000 7f31b1898800 20 rados->read ofs=0 len=0 2024-09-12T17:31:58.855 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.853+0000 7f31b1898800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:31:58.855 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.853+0000 7f31b1898800 20 started sync module instance, tier type = 2024-09-12T17:31:58.855 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.853+0000 7f31b1898800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:31:58.864 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.863+0000 7f31b1898800 20 add_watcher() i=0 2024-09-12T17:31:58.864 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.863+0000 7f31b1898800 20 add_watcher() i=1 2024-09-12T17:31:58.864 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.863+0000 7f31b1898800 20 add_watcher() i=2 2024-09-12T17:31:58.864 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.863+0000 7f31b1898800 20 add_watcher() i=3 2024-09-12T17:31:58.864 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.863+0000 7f31b1898800 20 add_watcher() i=4 2024-09-12T17:31:58.864 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.863+0000 7f31b1898800 20 add_watcher() i=5 2024-09-12T17:31:58.864 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.863+0000 7f31b1898800 20 add_watcher() i=6 2024-09-12T17:31:58.865 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.864+0000 7f31b1898800 20 add_watcher() i=7 2024-09-12T17:31:58.865 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.864+0000 7f31b1898800 2 all 8 watchers are set, enabling cache 2024-09-12T17:31:58.866 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.866+0000 7f3065fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:31:58.867 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.866+0000 7f31b1898800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:31:58.867 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.866+0000 7f31b1898800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:31:58.868 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.866+0000 7f31b1898800 5 note: GC not initialized 2024-09-12T17:31:58.868 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.866+0000 7f3064fe1640 20 reqs_thread_entry: start 2024-09-12T17:31:58.868 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.867+0000 7f31b1898800 20 init_complete bucket index max shards: 11 2024-09-12T17:31:58.868 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.867+0000 7f31b1898800 20 Filter name: none 2024-09-12T17:31:58.868 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.867+0000 7f2fde7fc640 20 reqs_thread_entry: start 2024-09-12T17:31:58.874 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.873+0000 7f3065fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:31:58.877 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.876+0000 7f31b1898800 20 remove_watcher() i=0 2024-09-12T17:31:58.877 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.876+0000 7f31b1898800 2 removed watcher, disabling cache 2024-09-12T17:31:58.878 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.877+0000 7f31b1898800 20 remove_watcher() i=1 2024-09-12T17:31:58.879 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.879+0000 7f31b1898800 20 remove_watcher() i=2 2024-09-12T17:31:58.881 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.880+0000 7f31b1898800 20 remove_watcher() i=3 2024-09-12T17:31:58.882 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.881+0000 7f31b1898800 20 remove_watcher() i=4 2024-09-12T17:31:58.883 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.882+0000 7f31b1898800 20 remove_watcher() i=5 2024-09-12T17:31:58.884 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.883+0000 7f31b1898800 20 remove_watcher() i=6 2024-09-12T17:31:58.884 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.884+0000 7f31b1898800 20 remove_watcher() i=7 2024-09-12T17:31:58.896 INFO:tasks.workunit.client.0.smithi037.stderr:bucket name a-bucket 2024-09-12T17:31:58.897 INFO:tasks.workunit.client.0.smithi037.stderr:TEST: reshard process non empty bucket 2024-09-12T17:31:58.897 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:31:58.898 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin reshard process 2024-09-12T17:31:58.925 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:31:58.925 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:31:58.965 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.964+0000 7f745e412800 20 rados->read ofs=0 len=0 2024-09-12T17:31:58.967 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.966+0000 7f745e412800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:31:58.967 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.966+0000 7f745e412800 20 realm 2024-09-12T17:31:58.967 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.966+0000 7f745e412800 20 rados->read ofs=0 len=0 2024-09-12T17:31:58.967 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.966+0000 7f745e412800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:31:58.967 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.966+0000 7f745e412800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:31:58.967 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.966+0000 7f745e412800 20 rados->read ofs=0 len=0 2024-09-12T17:31:58.967 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.966+0000 7f745e412800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:31:58.967 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.966+0000 7f745e412800 20 rados->read ofs=0 len=0 2024-09-12T17:31:58.968 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.967+0000 7f745e412800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:31:58.968 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.967+0000 7f745e412800 20 rados->read ofs=0 len=0 2024-09-12T17:31:58.969 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.967+0000 7f745e412800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:31:58.969 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.967+0000 7f745e412800 20 searching for the correct realm 2024-09-12T17:31:58.971 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.971+0000 7f745a3e1640 0 -- 172.21.15.37:0/591572886 >> [v2:172.21.15.40:6818/1210108009,v1:172.21.15.40:6819/1210108009] conn(0x7f74500e8280 msgr2=0x7f7450091f30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:31:58.975 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:58.974+0000 7f7459be0640 0 -- 172.21.15.37:0/591572886 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7f74500b8e20 msgr2=0x7f74500c58a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:31:59.181 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.180+0000 7f745e412800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:31:59.182 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.180+0000 7f745e412800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:31:59.182 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.180+0000 7f745e412800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:31:59.182 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.180+0000 7f745e412800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:31:59.182 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.180+0000 7f745e412800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:31:59.182 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.180+0000 7f745e412800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:31:59.182 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.180+0000 7f745e412800 20 rados->read ofs=0 len=0 2024-09-12T17:31:59.182 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.180+0000 7f745e412800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:31:59.182 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.180+0000 7f745e412800 20 rados->read ofs=0 len=0 2024-09-12T17:31:59.183 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.181+0000 7f745e412800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:31:59.183 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.181+0000 7f745e412800 20 rados->read ofs=0 len=0 2024-09-12T17:31:59.184 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.181+0000 7f745e412800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:31:59.184 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.181+0000 7f745e412800 20 zone default found 2024-09-12T17:31:59.184 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.181+0000 7f745e412800 4 Realm: () 2024-09-12T17:31:59.184 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.181+0000 7f745e412800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:31:59.184 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.181+0000 7f745e412800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:31:59.184 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.181+0000 7f745e412800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:31:59.184 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.181+0000 7f745e412800 20 zonegroup default 2024-09-12T17:31:59.184 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.181+0000 7f745e412800 20 rados->read ofs=0 len=0 2024-09-12T17:31:59.184 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.182+0000 7f745e412800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:31:59.184 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.182+0000 7f745e412800 20 rados->read ofs=0 len=0 2024-09-12T17:31:59.184 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.182+0000 7f745e412800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:31:59.184 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.182+0000 7f745e412800 20 rados->read ofs=0 len=0 2024-09-12T17:31:59.184 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.182+0000 7f745e412800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:31:59.184 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.182+0000 7f745e412800 20 started sync module instance, tier type = 2024-09-12T17:31:59.185 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.182+0000 7f745e412800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:31:59.194 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.193+0000 7f745e412800 20 add_watcher() i=0 2024-09-12T17:31:59.194 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.193+0000 7f745e412800 20 add_watcher() i=1 2024-09-12T17:31:59.194 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.193+0000 7f745e412800 20 add_watcher() i=2 2024-09-12T17:31:59.194 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.193+0000 7f745e412800 20 add_watcher() i=3 2024-09-12T17:31:59.194 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.193+0000 7f745e412800 20 add_watcher() i=4 2024-09-12T17:31:59.194 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.193+0000 7f745e412800 20 add_watcher() i=5 2024-09-12T17:31:59.194 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.193+0000 7f745e412800 20 add_watcher() i=6 2024-09-12T17:31:59.195 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.194+0000 7f745e412800 20 add_watcher() i=7 2024-09-12T17:31:59.195 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.194+0000 7f745e412800 2 all 8 watchers are set, enabling cache 2024-09-12T17:31:59.197 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.196+0000 7f730b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:31:59.197 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.196+0000 7f745e412800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:31:59.198 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.196+0000 7f745e412800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:31:59.198 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.196+0000 7f745e412800 5 note: GC not initialized 2024-09-12T17:31:59.198 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.196+0000 7f730a7fc640 20 reqs_thread_entry: start 2024-09-12T17:31:59.198 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.197+0000 7f745e412800 20 init_complete bucket index max shards: 11 2024-09-12T17:31:59.198 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.197+0000 7f745e412800 20 Filter name: none 2024-09-12T17:31:59.198 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.197+0000 7f727bfff640 20 reqs_thread_entry: start 2024-09-12T17:31:59.198 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.197+0000 7f745e412800 20 processing logshard = reshard.0000000000 2024-09-12T17:31:59.200 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.199+0000 7f745e412800 20 finish processing logshard = reshard.0000000000 , ret = 0 2024-09-12T17:31:59.200 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.199+0000 7f745e412800 20 processing logshard = reshard.0000000001 2024-09-12T17:31:59.203 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.202+0000 7f745e412800 20 finish processing logshard = reshard.0000000001 , ret = 0 2024-09-12T17:31:59.203 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.202+0000 7f745e412800 20 processing logshard = reshard.0000000002 2024-09-12T17:31:59.205 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.205+0000 7f745e412800 20 finish processing logshard = reshard.0000000002 , ret = 0 2024-09-12T17:31:59.205 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.205+0000 7f745e412800 20 processing logshard = reshard.0000000003 2024-09-12T17:31:59.208 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.207+0000 7f745e412800 20 finish processing logshard = reshard.0000000003 , ret = 0 2024-09-12T17:31:59.208 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.207+0000 7f745e412800 20 processing logshard = reshard.0000000004 2024-09-12T17:31:59.211 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.210+0000 7f745e412800 20 finish processing logshard = reshard.0000000004 , ret = 0 2024-09-12T17:31:59.211 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.210+0000 7f745e412800 20 processing logshard = reshard.0000000005 2024-09-12T17:31:59.214 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.213+0000 7f745e412800 20 finish processing logshard = reshard.0000000005 , ret = 0 2024-09-12T17:31:59.214 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.213+0000 7f745e412800 20 processing logshard = reshard.0000000006 2024-09-12T17:31:59.216 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.215+0000 7f745e412800 20 process_entry resharding a-bucket 2024-09-12T17:31:59.216 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.215+0000 7f745e412800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:31:59.216 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.215+0000 7f745e412800 20 rados->read ofs=0 len=0 2024-09-12T17:31:59.216 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.215+0000 7f745e412800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:31:59.216 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.215+0000 7f745e412800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x1 2024-09-12T17:31:59.216 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.215+0000 7f745e412800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:31:59.216 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.215+0000 7f745e412800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 : miss 2024-09-12T17:31:59.217 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.215+0000 7f745e412800 20 rados->read ofs=0 len=0 2024-09-12T17:31:59.217 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.216+0000 7f745e412800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:31:59.217 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.216+0000 7f745e412800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 info.flags=0x17 2024-09-12T17:31:59.217 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.216+0000 7f745e412800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 to cache LRU end 2024-09-12T17:31:59.217 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.216+0000 7f745e412800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:31:59.218 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.216+0000 7f745e412800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:31:59.218 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.216+0000 7f745e412800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 2024-09-12T17:31:59.225 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.224+0000 7f745e412800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 info.flags=0x17 2024-09-12T17:31:59.225 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.224+0000 7f745e412800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 to cache LRU end 2024-09-12T17:31:59.225 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.224+0000 7f745e412800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:31:59.225 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.224+0000 7f745e412800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18, ofs0, ns] 2024-09-12T17:31:59.226 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.225+0000 7f733d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496973 cookie 94819541085008 notifier 6183 bl.length()=911 2024-09-12T17:31:59.226 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.225+0000 7f733d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 info.flags=0x17 2024-09-12T17:31:59.226 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.225+0000 7f733d7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 to cache LRU end 2024-09-12T17:31:59.226 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.225+0000 7f733d7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:31:59.227 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.226+0000 7f745e412800 20 handle_bi_update(): bucket=:a-bucket[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18]): orig_sources= new_sources= 2024-09-12T17:31:59.227 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.226+0000 7f745e412800 20 handle_bi_update(): bucket=:a-bucket[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18]): potential sources added=[] removed=[] 2024-09-12T17:31:59.227 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.226+0000 7f745e412800 20 handle_bi_update(): bucket=:a-bucket[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18]): orig_dests= new_dests= 2024-09-12T17:31:59.227 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.226+0000 7f745e412800 20 handle_bi_update(): bucket=:a-bucket[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18]): potential dests added=[] removed=[] 2024-09-12T17:31:59.232 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.231+0000 7f745e412800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.0 2024-09-12T17:31:59.233 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.231+0000 7f745e412800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.0 2024-09-12T17:31:59.233 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.231+0000 7f745e412800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.1 2024-09-12T17:31:59.233 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.231+0000 7f745e412800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.1 2024-09-12T17:31:59.233 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.231+0000 7f745e412800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.2 2024-09-12T17:31:59.233 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.231+0000 7f745e412800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.2 2024-09-12T17:31:59.233 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.231+0000 7f745e412800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.3 2024-09-12T17:31:59.233 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.231+0000 7f745e412800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.3 2024-09-12T17:31:59.233 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.231+0000 7f745e412800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.4 2024-09-12T17:31:59.233 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.231+0000 7f745e412800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.4 2024-09-12T17:31:59.233 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.231+0000 7f745e412800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.5 2024-09-12T17:31:59.233 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.231+0000 7f745e412800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.5 2024-09-12T17:31:59.233 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.231+0000 7f745e412800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.6 2024-09-12T17:31:59.234 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.231+0000 7f745e412800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.6 2024-09-12T17:31:59.234 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.231+0000 7f745e412800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.7 2024-09-12T17:31:59.234 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.231+0000 7f745e412800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.7 2024-09-12T17:31:59.234 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.231+0000 7f745e412800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.8 2024-09-12T17:31:59.234 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.231+0000 7f745e412800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.8 2024-09-12T17:31:59.234 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.231+0000 7f745e412800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.9 2024-09-12T17:31:59.234 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.231+0000 7f745e412800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.9 2024-09-12T17:31:59.234 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.231+0000 7f745e412800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.10 2024-09-12T17:31:59.234 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.231+0000 7f745e412800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.10 2024-09-12T17:31:59.234 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.231+0000 7f745e412800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.11 2024-09-12T17:31:59.234 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.231+0000 7f745e412800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.11 2024-09-12T17:31:59.234 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.231+0000 7f745e412800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.12 2024-09-12T17:31:59.234 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.231+0000 7f745e412800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.12 2024-09-12T17:31:59.234 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.231+0000 7f745e412800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.1.0 2024-09-12T17:31:59.235 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.231+0000 7f745e412800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.1.0 2024-09-12T17:31:59.235 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.232+0000 7f745e412800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.1.1 2024-09-12T17:31:59.235 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.232+0000 7f745e412800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.1.1 2024-09-12T17:31:59.236 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.232+0000 7f745e412800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.1.2 2024-09-12T17:31:59.236 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.232+0000 7f745e412800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.1.2 2024-09-12T17:31:59.236 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.233+0000 7f745e412800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.1.3 2024-09-12T17:31:59.236 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.233+0000 7f745e412800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.1.3 2024-09-12T17:31:59.236 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.233+0000 7f745e412800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.1.4 2024-09-12T17:31:59.236 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.233+0000 7f745e412800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.1.4 2024-09-12T17:31:59.236 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.234+0000 7f745e412800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.1.5 2024-09-12T17:31:59.236 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.234+0000 7f745e412800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.1.5 2024-09-12T17:31:59.236 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.234+0000 7f745e412800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.1.6 2024-09-12T17:31:59.236 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.234+0000 7f745e412800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.1.6 2024-09-12T17:31:59.236 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.235+0000 7f745e412800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.1.7 2024-09-12T17:31:59.236 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.235+0000 7f745e412800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.1.7 2024-09-12T17:31:59.237 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.236+0000 7f745e412800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.1.8 2024-09-12T17:31:59.237 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.236+0000 7f745e412800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.1.8 2024-09-12T17:31:59.237 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.236+0000 7f745e412800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.1.9 2024-09-12T17:31:59.237 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.236+0000 7f745e412800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.1.9 2024-09-12T17:31:59.237 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.237+0000 7f745e412800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.1.10 2024-09-12T17:31:59.237 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.237+0000 7f745e412800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.1.10 2024-09-12T17:31:59.238 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.237+0000 7f745e412800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.1.11 2024-09-12T17:31:59.238 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.237+0000 7f745e412800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.1.11 2024-09-12T17:31:59.240 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.240+0000 7f745e412800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 : hit (requested=0x17, cached=0x17) 2024-09-12T17:31:59.240 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.240+0000 7f745e412800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 2024-09-12T17:31:59.242 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.241+0000 7f745e412800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 info.flags=0x17 2024-09-12T17:31:59.242 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.241+0000 7f745e412800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 to cache LRU end 2024-09-12T17:31:59.242 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.241+0000 7f745e412800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:31:59.242 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.241+0000 7f745e412800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18, ofs0, ns] 2024-09-12T17:31:59.242 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.241+0000 7f733d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496974 cookie 94819541085008 notifier 6183 bl.length()=911 2024-09-12T17:31:59.242 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.241+0000 7f733d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 info.flags=0x17 2024-09-12T17:31:59.242 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.241+0000 7f733d7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 to cache LRU end 2024-09-12T17:31:59.242 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.241+0000 7f733d7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:31:59.244 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.243+0000 7f745e412800 20 handle_bi_update(): bucket=:a-bucket[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18]): orig_sources= new_sources= 2024-09-12T17:31:59.244 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.243+0000 7f745e412800 20 handle_bi_update(): bucket=:a-bucket[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18]): potential sources added=[] removed=[] 2024-09-12T17:31:59.244 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.243+0000 7f745e412800 20 handle_bi_update(): bucket=:a-bucket[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18]): orig_dests= new_dests= 2024-09-12T17:31:59.244 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.243+0000 7f745e412800 20 handle_bi_update(): bucket=:a-bucket[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18]): potential dests added=[] removed=[] 2024-09-12T17:31:59.246 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.245+0000 7f745e412800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.1.0 2024-09-12T17:31:59.246 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.245+0000 7f745e412800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.1.0 2024-09-12T17:31:59.247 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.246+0000 7f745e412800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.1.1 2024-09-12T17:31:59.247 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.246+0000 7f745e412800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.1.1 2024-09-12T17:31:59.247 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.246+0000 7f745e412800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.1.2 2024-09-12T17:31:59.247 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.246+0000 7f745e412800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.1.2 2024-09-12T17:31:59.247 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.246+0000 7f745e412800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.1.3 2024-09-12T17:31:59.247 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.246+0000 7f745e412800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.1.3 2024-09-12T17:31:59.247 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.247+0000 7f745e412800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.1.4 2024-09-12T17:31:59.248 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.247+0000 7f745e412800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.1.4 2024-09-12T17:31:59.248 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.247+0000 7f745e412800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.1.5 2024-09-12T17:31:59.248 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.247+0000 7f745e412800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.1.5 2024-09-12T17:31:59.248 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.247+0000 7f745e412800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.1.6 2024-09-12T17:31:59.248 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.247+0000 7f745e412800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.1.6 2024-09-12T17:31:59.248 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.247+0000 7f745e412800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.1.7 2024-09-12T17:31:59.248 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.247+0000 7f745e412800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.1.7 2024-09-12T17:31:59.249 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.248+0000 7f745e412800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.1.8 2024-09-12T17:31:59.249 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.248+0000 7f745e412800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.1.8 2024-09-12T17:31:59.249 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.248+0000 7f745e412800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.1.9 2024-09-12T17:31:59.249 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.248+0000 7f745e412800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.1.9 2024-09-12T17:31:59.249 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.249+0000 7f745e412800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.1.10 2024-09-12T17:31:59.249 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.249+0000 7f745e412800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.1.10 2024-09-12T17:31:59.250 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.249+0000 7f745e412800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.1.11 2024-09-12T17:31:59.250 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.249+0000 7f745e412800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.1.11 2024-09-12T17:31:59.250 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.249+0000 7f745e412800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 : hit (requested=0x17, cached=0x17) 2024-09-12T17:31:59.250 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.249+0000 7f745e412800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 2024-09-12T17:31:59.251 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.251+0000 7f745e412800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 info.flags=0x17 2024-09-12T17:31:59.252 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.251+0000 7f745e412800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 to cache LRU end 2024-09-12T17:31:59.252 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.251+0000 7f745e412800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:31:59.252 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.251+0000 7f745e412800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18, ofs0, ns] 2024-09-12T17:31:59.252 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.251+0000 7f733d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496975 cookie 94819541085008 notifier 6183 bl.length()=879 2024-09-12T17:31:59.252 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.251+0000 7f733d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 info.flags=0x17 2024-09-12T17:31:59.252 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.251+0000 7f733d7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 to cache LRU end 2024-09-12T17:31:59.252 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.251+0000 7f733d7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:31:59.253 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.252+0000 7f745e412800 20 handle_bi_update(): bucket=:a-bucket[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18]): orig_sources= new_sources= 2024-09-12T17:31:59.253 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.252+0000 7f745e412800 20 handle_bi_update(): bucket=:a-bucket[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18]): potential sources added=[] removed=[] 2024-09-12T17:31:59.253 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.252+0000 7f745e412800 20 handle_bi_update(): bucket=:a-bucket[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18]): orig_dests= new_dests= 2024-09-12T17:31:59.253 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.252+0000 7f745e412800 20 handle_bi_update(): bucket=:a-bucket[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18]): potential dests added=[] removed=[] 2024-09-12T17:31:59.256 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.255+0000 7f745e412800 1 execute INFO: reshard of bucket "a-bucket" from 12 shards to 13 shards completed successfully 2024-09-12T17:31:59.257 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.256+0000 7f745e412800 20 process_entry removing reshard queue entry for bucket a-bucket 2024-09-12T17:31:59.259 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.258+0000 7f745e412800 20 finish processing logshard = reshard.0000000006 , ret = 0 2024-09-12T17:31:59.259 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.258+0000 7f745e412800 20 processing logshard = reshard.0000000007 2024-09-12T17:31:59.261 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.261+0000 7f745e412800 20 finish processing logshard = reshard.0000000007 , ret = 0 2024-09-12T17:31:59.261 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.261+0000 7f745e412800 20 processing logshard = reshard.0000000008 2024-09-12T17:31:59.264 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.263+0000 7f745e412800 20 finish processing logshard = reshard.0000000008 , ret = 0 2024-09-12T17:31:59.264 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.263+0000 7f745e412800 20 processing logshard = reshard.0000000009 2024-09-12T17:31:59.266 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.266+0000 7f745e412800 20 finish processing logshard = reshard.0000000009 , ret = 0 2024-09-12T17:31:59.266 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.266+0000 7f745e412800 20 processing logshard = reshard.0000000010 2024-09-12T17:31:59.269 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.268+0000 7f745e412800 20 finish processing logshard = reshard.0000000010 , ret = 0 2024-09-12T17:31:59.269 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.268+0000 7f745e412800 20 processing logshard = reshard.0000000011 2024-09-12T17:31:59.271 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.271+0000 7f745e412800 20 finish processing logshard = reshard.0000000011 , ret = 0 2024-09-12T17:31:59.271 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.271+0000 7f745e412800 20 processing logshard = reshard.0000000012 2024-09-12T17:31:59.274 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.273+0000 7f745e412800 20 finish processing logshard = reshard.0000000012 , ret = 0 2024-09-12T17:31:59.274 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.273+0000 7f745e412800 20 processing logshard = reshard.0000000013 2024-09-12T17:31:59.277 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.276+0000 7f745e412800 20 finish processing logshard = reshard.0000000013 , ret = 0 2024-09-12T17:31:59.277 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.276+0000 7f745e412800 20 processing logshard = reshard.0000000014 2024-09-12T17:31:59.279 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.278+0000 7f745e412800 20 finish processing logshard = reshard.0000000014 , ret = 0 2024-09-12T17:31:59.279 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.278+0000 7f745e412800 20 processing logshard = reshard.0000000015 2024-09-12T17:31:59.282 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.281+0000 7f745e412800 20 finish processing logshard = reshard.0000000015 , ret = 0 2024-09-12T17:31:59.283 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.282+0000 7f730b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:31:59.285 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.284+0000 7f745e412800 20 remove_watcher() i=0 2024-09-12T17:31:59.285 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.284+0000 7f745e412800 2 removed watcher, disabling cache 2024-09-12T17:31:59.286 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.285+0000 7f745e412800 20 remove_watcher() i=1 2024-09-12T17:31:59.287 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.286+0000 7f745e412800 20 remove_watcher() i=2 2024-09-12T17:31:59.288 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.288+0000 7f745e412800 20 remove_watcher() i=3 2024-09-12T17:31:59.289 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.289+0000 7f745e412800 20 remove_watcher() i=4 2024-09-12T17:31:59.290 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.290+0000 7f745e412800 20 remove_watcher() i=5 2024-09-12T17:31:59.291 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.291+0000 7f745e412800 20 remove_watcher() i=6 2024-09-12T17:31:59.292 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.292+0000 7f745e412800 20 remove_watcher() i=7 2024-09-12T17:31:59.305 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T17:31:59.334 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:31:59.334 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:31:59.575 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.574+0000 7f59fb346800 20 rados->read ofs=0 len=0 2024-09-12T17:31:59.577 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.576+0000 7f59fb346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:31:59.577 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.576+0000 7f59fb346800 20 realm 2024-09-12T17:31:59.578 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.576+0000 7f59fb346800 20 rados->read ofs=0 len=0 2024-09-12T17:31:59.578 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.577+0000 7f59fb346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:31:59.578 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.577+0000 7f59fb346800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:31:59.578 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.577+0000 7f59fb346800 20 rados->read ofs=0 len=0 2024-09-12T17:31:59.578 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.577+0000 7f59fb346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:31:59.578 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.577+0000 7f59fb346800 20 rados->read ofs=0 len=0 2024-09-12T17:31:59.578 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.578+0000 7f59fb346800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:31:59.578 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.578+0000 7f59fb346800 20 rados->read ofs=0 len=0 2024-09-12T17:31:59.579 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.578+0000 7f59fb346800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:31:59.579 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.578+0000 7f59fb346800 20 searching for the correct realm 2024-09-12T17:31:59.581 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.581+0000 7f59f8636640 0 -- 172.21.15.37:0/246078712 >> [v2:172.21.15.40:6800/2441293461,v1:172.21.15.40:6801/2441293461] conn(0x7f59e80a4040 msgr2=0x7f59e80678e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:31:59.789 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.788+0000 7f59f8e37640 0 -- 172.21.15.37:0/246078712 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7f59ec05f280 msgr2=0x7f59ec07a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:31:59.998 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.996+0000 7f59fb346800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:31:59.998 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.996+0000 7f59fb346800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:31:59.998 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.996+0000 7f59fb346800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:31:59.998 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.996+0000 7f59fb346800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:31:59.998 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.996+0000 7f59fb346800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:31:59.998 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.996+0000 7f59fb346800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:31:59.998 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.996+0000 7f59fb346800 20 rados->read ofs=0 len=0 2024-09-12T17:31:59.998 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.997+0000 7f59fb346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:31:59.998 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.997+0000 7f59fb346800 20 rados->read ofs=0 len=0 2024-09-12T17:32:00.000 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.997+0000 7f59fb346800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:00.000 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.997+0000 7f59fb346800 20 rados->read ofs=0 len=0 2024-09-12T17:32:00.000 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.998+0000 7f59fb346800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:32:00.000 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.998+0000 7f59fb346800 20 zone default found 2024-09-12T17:32:00.000 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.998+0000 7f59fb346800 4 Realm: () 2024-09-12T17:32:00.000 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.998+0000 7f59fb346800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:32:00.000 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.998+0000 7f59fb346800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:32:00.000 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.998+0000 7f59fb346800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:32:00.000 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.998+0000 7f59fb346800 20 zonegroup default 2024-09-12T17:32:00.000 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.998+0000 7f59fb346800 20 rados->read ofs=0 len=0 2024-09-12T17:32:00.000 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.998+0000 7f59fb346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:00.000 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.998+0000 7f59fb346800 20 rados->read ofs=0 len=0 2024-09-12T17:32:00.000 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.998+0000 7f59fb346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:00.001 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.998+0000 7f59fb346800 20 rados->read ofs=0 len=0 2024-09-12T17:32:00.001 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.999+0000 7f59fb346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:00.001 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.999+0000 7f59fb346800 20 started sync module instance, tier type = 2024-09-12T17:32:00.001 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:31:59.999+0000 7f59fb346800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:32:00.010 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:00.009+0000 7f59fb346800 20 add_watcher() i=0 2024-09-12T17:32:00.010 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:00.009+0000 7f59fb346800 20 add_watcher() i=1 2024-09-12T17:32:00.010 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:00.009+0000 7f59fb346800 20 add_watcher() i=2 2024-09-12T17:32:00.010 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:00.009+0000 7f59fb346800 20 add_watcher() i=3 2024-09-12T17:32:00.010 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:00.009+0000 7f59fb346800 20 add_watcher() i=4 2024-09-12T17:32:00.011 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:00.009+0000 7f59fb346800 20 add_watcher() i=5 2024-09-12T17:32:00.011 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:00.010+0000 7f59fb346800 20 add_watcher() i=6 2024-09-12T17:32:00.011 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:00.011+0000 7f59fb346800 20 add_watcher() i=7 2024-09-12T17:32:00.011 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:00.011+0000 7f59fb346800 2 all 8 watchers are set, enabling cache 2024-09-12T17:32:00.013 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:00.012+0000 7f58aefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:32:00.014 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:00.013+0000 7f59fb346800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:32:00.014 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:00.013+0000 7f59fb346800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:32:00.014 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:00.013+0000 7f59fb346800 5 note: GC not initialized 2024-09-12T17:32:00.014 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:00.013+0000 7f58adfe3640 20 reqs_thread_entry: start 2024-09-12T17:32:00.014 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:00.013+0000 7f59fb346800 20 init_complete bucket index max shards: 11 2024-09-12T17:32:00.015 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:00.013+0000 7f59fb346800 20 Filter name: none 2024-09-12T17:32:00.015 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:00.013+0000 7f581f7fe640 20 reqs_thread_entry: start 2024-09-12T17:32:00.015 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:00.013+0000 7f59fb346800 20 rados->read ofs=0 len=0 2024-09-12T17:32:00.016 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:00.014+0000 7f59fb346800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:32:00.016 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:00.014+0000 7f59fb346800 20 rados->read ofs=0 len=0 2024-09-12T17:32:00.016 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:00.014+0000 7f59fb346800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:32:00.016 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:00.014+0000 7f59fb346800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:32:00.016 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:00.014+0000 7f59fb346800 20 rados->read ofs=0 len=0 2024-09-12T17:32:00.016 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:00.015+0000 7f59fb346800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:32:00.016 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:00.015+0000 7f59fb346800 20 rados->read ofs=0 len=0 2024-09-12T17:32:00.016 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:00.015+0000 7f59fb346800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:32:00.017 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:00.015+0000 7f59fb346800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:32:00.018 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:00.017+0000 7f58aefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:32:00.021 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:00.020+0000 7f59fb346800 20 remove_watcher() i=0 2024-09-12T17:32:00.021 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:00.020+0000 7f59fb346800 2 removed watcher, disabling cache 2024-09-12T17:32:00.022 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:00.021+0000 7f59fb346800 20 remove_watcher() i=1 2024-09-12T17:32:00.023 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:00.022+0000 7f59fb346800 20 remove_watcher() i=2 2024-09-12T17:32:00.024 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:00.023+0000 7f59fb346800 20 remove_watcher() i=3 2024-09-12T17:32:00.025 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:00.025+0000 7f59fb346800 20 remove_watcher() i=4 2024-09-12T17:32:00.026 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:00.026+0000 7f59fb346800 20 remove_watcher() i=5 2024-09-12T17:32:00.028 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:00.027+0000 7f59fb346800 20 remove_watcher() i=6 2024-09-12T17:32:00.029 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:00.028+0000 7f59fb346800 20 remove_watcher() i=7 2024-09-12T17:32:00.041 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:32:00.041 INFO:tasks.workunit.client.0.smithi037.stderr:BUCKET_STATS: 2024-09-12T17:32:00.041 INFO:tasks.workunit.client.0.smithi037.stderr:bucket: a-bucket id: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 num_objects: 8 size_kb: 1 num_shards: 13 2024-09-12T17:32:00.041 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:32:00.041 INFO:tasks.workunit.client.0.smithi037.stderr:TEST: reshard bucket with EIO injected at init_index 2024-09-12T17:32:00.041 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:32:00.850 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-12T17:32:00.879 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:32:00.880 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:32:00.919 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:00.918+0000 7faba292a800 20 rados->read ofs=0 len=0 2024-09-12T17:32:00.922 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:00.920+0000 7faba292a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:00.922 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:00.920+0000 7faba292a800 20 realm 2024-09-12T17:32:00.922 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:00.920+0000 7faba292a800 20 rados->read ofs=0 len=0 2024-09-12T17:32:00.922 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:00.921+0000 7faba292a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:00.922 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:00.921+0000 7faba292a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:32:00.922 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:00.921+0000 7faba292a800 20 rados->read ofs=0 len=0 2024-09-12T17:32:00.922 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:00.921+0000 7faba292a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:00.922 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:00.921+0000 7faba292a800 20 rados->read ofs=0 len=0 2024-09-12T17:32:00.923 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:00.922+0000 7faba292a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:00.923 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:00.922+0000 7faba292a800 20 rados->read ofs=0 len=0 2024-09-12T17:32:00.923 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:00.922+0000 7faba292a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:32:00.923 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:00.922+0000 7faba292a800 20 searching for the correct realm 2024-09-12T17:32:00.926 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:00.925+0000 7fab9ded9640 0 -- 172.21.15.37:0/1093829632 >> [v2:172.21.15.40:6800/2441293461,v1:172.21.15.40:6801/2441293461] conn(0x7fab9002f070 msgr2=0x7fab9003e430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:32:00.930 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:00.929+0000 7fab9e6da640 0 -- 172.21.15.37:0/1093829632 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7fab9406a450 msgr2=0x7fab940278a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:32:01.136 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.135+0000 7faba292a800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:32:01.137 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.135+0000 7faba292a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:32:01.137 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.135+0000 7faba292a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:32:01.137 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.135+0000 7faba292a800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:32:01.137 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.135+0000 7faba292a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:32:01.137 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.135+0000 7faba292a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:32:01.137 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.135+0000 7faba292a800 20 rados->read ofs=0 len=0 2024-09-12T17:32:01.137 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.136+0000 7faba292a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:01.137 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.136+0000 7faba292a800 20 rados->read ofs=0 len=0 2024-09-12T17:32:01.138 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.136+0000 7faba292a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:01.138 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.136+0000 7faba292a800 20 rados->read ofs=0 len=0 2024-09-12T17:32:01.138 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.136+0000 7faba292a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:32:01.139 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.136+0000 7faba292a800 20 zone default found 2024-09-12T17:32:01.139 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.136+0000 7faba292a800 4 Realm: () 2024-09-12T17:32:01.139 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.136+0000 7faba292a800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:32:01.139 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.136+0000 7faba292a800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:32:01.139 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.136+0000 7faba292a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:32:01.139 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.136+0000 7faba292a800 20 zonegroup default 2024-09-12T17:32:01.139 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.136+0000 7faba292a800 20 rados->read ofs=0 len=0 2024-09-12T17:32:01.139 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.137+0000 7faba292a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:01.139 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.137+0000 7faba292a800 20 rados->read ofs=0 len=0 2024-09-12T17:32:01.139 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.137+0000 7faba292a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:01.139 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.137+0000 7faba292a800 20 rados->read ofs=0 len=0 2024-09-12T17:32:01.139 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.137+0000 7faba292a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:01.139 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.137+0000 7faba292a800 20 started sync module instance, tier type = 2024-09-12T17:32:01.139 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.137+0000 7faba292a800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:32:01.149 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.148+0000 7faba292a800 20 add_watcher() i=0 2024-09-12T17:32:01.149 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.148+0000 7faba292a800 20 add_watcher() i=1 2024-09-12T17:32:01.149 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.148+0000 7faba292a800 20 add_watcher() i=2 2024-09-12T17:32:01.149 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.148+0000 7faba292a800 20 add_watcher() i=3 2024-09-12T17:32:01.149 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.148+0000 7faba292a800 20 add_watcher() i=4 2024-09-12T17:32:01.149 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.148+0000 7faba292a800 20 add_watcher() i=5 2024-09-12T17:32:01.149 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.148+0000 7faba292a800 20 add_watcher() i=6 2024-09-12T17:32:01.150 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.149+0000 7faba292a800 20 add_watcher() i=7 2024-09-12T17:32:01.150 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.149+0000 7faba292a800 2 all 8 watchers are set, enabling cache 2024-09-12T17:32:01.151 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.150+0000 7faa54fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:32:01.152 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.151+0000 7faba292a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:32:01.152 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.151+0000 7faba292a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:32:01.152 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.151+0000 7faba292a800 5 note: GC not initialized 2024-09-12T17:32:01.152 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.151+0000 7fa9cf7fe640 20 reqs_thread_entry: start 2024-09-12T17:32:01.152 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.151+0000 7faba292a800 20 init_complete bucket index max shards: 11 2024-09-12T17:32:01.153 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.151+0000 7faba292a800 20 Filter name: none 2024-09-12T17:32:01.153 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.151+0000 7fa9cd7fa640 20 reqs_thread_entry: start 2024-09-12T17:32:01.153 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.151+0000 7faba292a800 20 rados->read ofs=0 len=0 2024-09-12T17:32:01.153 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.152+0000 7faba292a800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:32:01.153 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.152+0000 7faba292a800 20 rados->read ofs=0 len=0 2024-09-12T17:32:01.153 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.153+0000 7faba292a800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:32:01.154 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.153+0000 7faba292a800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:32:01.154 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.153+0000 7faba292a800 20 rados->read ofs=0 len=0 2024-09-12T17:32:01.154 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.153+0000 7faba292a800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:32:01.154 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.153+0000 7faba292a800 20 rados->read ofs=0 len=0 2024-09-12T17:32:01.155 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.153+0000 7faba292a800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:32:01.155 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.153+0000 7faba292a800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:32:01.156 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.155+0000 7faa54fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:32:01.158 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.158+0000 7faba292a800 20 remove_watcher() i=0 2024-09-12T17:32:01.158 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.158+0000 7faba292a800 2 removed watcher, disabling cache 2024-09-12T17:32:01.159 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.159+0000 7faba292a800 20 remove_watcher() i=1 2024-09-12T17:32:01.161 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.160+0000 7faba292a800 20 remove_watcher() i=2 2024-09-12T17:32:01.162 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.161+0000 7faba292a800 20 remove_watcher() i=3 2024-09-12T17:32:01.163 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.162+0000 7faba292a800 20 remove_watcher() i=4 2024-09-12T17:32:01.164 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.163+0000 7faba292a800 20 remove_watcher() i=5 2024-09-12T17:32:01.165 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.164+0000 7faba292a800 20 remove_watcher() i=6 2024-09-12T17:32:01.166 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.165+0000 7faba292a800 20 remove_watcher() i=7 2024-09-12T17:32:01.177 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:32:01.178 INFO:tasks.workunit.client.0.smithi037.stderr:BUCKET_STATS: 2024-09-12T17:32:01.178 INFO:tasks.workunit.client.0.smithi037.stderr:bucket: error-at-init-index id: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.20 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:32:01.178 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:32:01.179 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bucket reshard --bucket error-at-init-index --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at init_index 2024-09-12T17:32:01.214 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:32:01.215 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:32:01.254 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.253+0000 7f3ede020800 20 rados->read ofs=0 len=0 2024-09-12T17:32:01.256 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.255+0000 7f3ede020800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:01.256 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.255+0000 7f3ede020800 20 realm 2024-09-12T17:32:01.256 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.255+0000 7f3ede020800 20 rados->read ofs=0 len=0 2024-09-12T17:32:01.256 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.255+0000 7f3ede020800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:01.256 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.255+0000 7f3ede020800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:32:01.256 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.255+0000 7f3ede020800 20 rados->read ofs=0 len=0 2024-09-12T17:32:01.256 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.255+0000 7f3ede020800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:01.256 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.255+0000 7f3ede020800 20 rados->read ofs=0 len=0 2024-09-12T17:32:01.257 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.256+0000 7f3ede020800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:01.257 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.256+0000 7f3ede020800 20 rados->read ofs=0 len=0 2024-09-12T17:32:01.257 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.256+0000 7f3ede020800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:32:01.257 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.256+0000 7f3ede020800 20 searching for the correct realm 2024-09-12T17:32:01.261 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.260+0000 7f3ed3fff640 0 -- 172.21.15.37:0/1319570507 >> [v2:172.21.15.37:6816/2964054205,v1:172.21.15.37:6817/2964054205] conn(0x564c67225cd0 msgr2=0x564c67228190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:32:01.265 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.264+0000 7f3edbb0a640 0 -- 172.21.15.37:0/1319570507 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7f3ec4068040 msgr2=0x7f3ec40893d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:32:01.269 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.268+0000 7f3ede020800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:32:01.269 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.268+0000 7f3ede020800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:32:01.269 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.268+0000 7f3ede020800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:32:01.269 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.268+0000 7f3ede020800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:32:01.269 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.268+0000 7f3ede020800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:32:01.270 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.268+0000 7f3ede020800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:32:01.270 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.268+0000 7f3ede020800 20 rados->read ofs=0 len=0 2024-09-12T17:32:01.270 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.268+0000 7f3ede020800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:01.270 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.269+0000 7f3ede020800 20 rados->read ofs=0 len=0 2024-09-12T17:32:01.271 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.269+0000 7f3ede020800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:01.271 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.269+0000 7f3ede020800 20 rados->read ofs=0 len=0 2024-09-12T17:32:01.271 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.269+0000 7f3ede020800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:32:01.271 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.269+0000 7f3ede020800 20 zone default found 2024-09-12T17:32:01.271 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.269+0000 7f3ede020800 4 Realm: () 2024-09-12T17:32:01.272 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.269+0000 7f3ede020800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:32:01.272 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.269+0000 7f3ede020800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:32:01.272 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.269+0000 7f3ede020800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:32:01.272 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.269+0000 7f3ede020800 20 zonegroup default 2024-09-12T17:32:01.272 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.269+0000 7f3ede020800 20 rados->read ofs=0 len=0 2024-09-12T17:32:01.272 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.270+0000 7f3ede020800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:01.272 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.270+0000 7f3ede020800 20 rados->read ofs=0 len=0 2024-09-12T17:32:01.272 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.270+0000 7f3ede020800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:01.272 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.270+0000 7f3ede020800 20 rados->read ofs=0 len=0 2024-09-12T17:32:01.272 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.270+0000 7f3ede020800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:01.272 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.270+0000 7f3ede020800 20 started sync module instance, tier type = 2024-09-12T17:32:01.272 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.270+0000 7f3ede020800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:32:01.281 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.280+0000 7f3ede020800 20 add_watcher() i=0 2024-09-12T17:32:01.282 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.280+0000 7f3ede020800 20 add_watcher() i=1 2024-09-12T17:32:01.282 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.280+0000 7f3ede020800 20 add_watcher() i=2 2024-09-12T17:32:01.282 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.280+0000 7f3ede020800 20 add_watcher() i=3 2024-09-12T17:32:01.282 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.280+0000 7f3ede020800 20 add_watcher() i=4 2024-09-12T17:32:01.282 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.280+0000 7f3ede020800 20 add_watcher() i=5 2024-09-12T17:32:01.282 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.280+0000 7f3ede020800 20 add_watcher() i=6 2024-09-12T17:32:01.282 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.281+0000 7f3ede020800 20 add_watcher() i=7 2024-09-12T17:32:01.283 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.281+0000 7f3ede020800 2 all 8 watchers are set, enabling cache 2024-09-12T17:32:01.284 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.283+0000 7f3d91fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:32:01.286 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.283+0000 7f3ede020800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:32:01.286 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.283+0000 7f3ede020800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:32:01.286 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.284+0000 7f3ede020800 5 note: GC not initialized 2024-09-12T17:32:01.286 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.284+0000 7f3d90fe1640 20 reqs_thread_entry: start 2024-09-12T17:32:01.286 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.284+0000 7f3ede020800 20 init_complete bucket index max shards: 11 2024-09-12T17:32:01.286 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.284+0000 7f3ede020800 20 Filter name: none 2024-09-12T17:32:01.286 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.284+0000 7f3d0a7fc640 20 reqs_thread_entry: start 2024-09-12T17:32:01.286 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.284+0000 7f3ede020800 10 cache get: name=default.rgw.meta+root+error-at-init-index : miss 2024-09-12T17:32:01.286 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.284+0000 7f3ede020800 20 rados->read ofs=0 len=0 2024-09-12T17:32:01.286 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.285+0000 7f3ede020800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:32:01.286 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.285+0000 7f3ede020800 10 cache put: name=default.rgw.meta+root+error-at-init-index info.flags=0x11 2024-09-12T17:32:01.287 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.285+0000 7f3ede020800 10 adding default.rgw.meta+root+error-at-init-index to cache LRU end 2024-09-12T17:32:01.287 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.285+0000 7f3ede020800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.20 : miss 2024-09-12T17:32:01.287 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.285+0000 7f3ede020800 20 rados->read ofs=0 len=0 2024-09-12T17:32:01.287 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.285+0000 7f3ede020800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:32:01.288 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.285+0000 7f3ede020800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.20 info.flags=0x17 2024-09-12T17:32:01.288 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.285+0000 7f3ede020800 10 adding default.rgw.meta+root+.bucket.meta.error-at-init-index:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.20 to cache LRU end 2024-09-12T17:32:01.288 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.285+0000 7f3ede020800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:32:01.288 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.285+0000 7f3ede020800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:32:01.288 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.285+0000 7f3ede020800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.20 2024-09-12T17:32:01.288 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.286+0000 7f3ede020800 -1 Injecting error=-5 at location=init_index 2024-09-12T17:32:01.288 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.286+0000 7f3ede020800 0 ERROR: init_target_index failed to initialize target index shard objects: (5) Input/output error 2024-09-12T17:32:01.289 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.288+0000 7f3d91fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:32:01.292 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.291+0000 7f3ede020800 20 remove_watcher() i=0 2024-09-12T17:32:01.292 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.291+0000 7f3ede020800 2 removed watcher, disabling cache 2024-09-12T17:32:01.293 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.292+0000 7f3ede020800 20 remove_watcher() i=1 2024-09-12T17:32:01.294 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.293+0000 7f3ede020800 20 remove_watcher() i=2 2024-09-12T17:32:01.295 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.294+0000 7f3ede020800 20 remove_watcher() i=3 2024-09-12T17:32:01.296 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.295+0000 7f3ede020800 20 remove_watcher() i=4 2024-09-12T17:32:01.297 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.296+0000 7f3ede020800 20 remove_watcher() i=5 2024-09-12T17:32:01.298 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.297+0000 7f3ede020800 20 remove_watcher() i=6 2024-09-12T17:32:01.299 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.298+0000 7f3ede020800 20 remove_watcher() i=7 2024-09-12T17:32:01.312 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-12T17:32:01.341 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:32:01.341 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:32:01.380 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.379+0000 7fb90e898800 20 rados->read ofs=0 len=0 2024-09-12T17:32:01.382 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.381+0000 7fb90e898800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:01.382 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.381+0000 7fb90e898800 20 realm 2024-09-12T17:32:01.382 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.381+0000 7fb90e898800 20 rados->read ofs=0 len=0 2024-09-12T17:32:01.382 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.381+0000 7fb90e898800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:01.383 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.381+0000 7fb90e898800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:32:01.383 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.381+0000 7fb90e898800 20 rados->read ofs=0 len=0 2024-09-12T17:32:01.383 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.381+0000 7fb90e898800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:01.383 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.381+0000 7fb90e898800 20 rados->read ofs=0 len=0 2024-09-12T17:32:01.383 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.382+0000 7fb90e898800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:01.383 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.382+0000 7fb90e898800 20 rados->read ofs=0 len=0 2024-09-12T17:32:01.383 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.383+0000 7fb90e898800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:32:01.384 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.383+0000 7fb90e898800 20 searching for the correct realm 2024-09-12T17:32:01.587 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.586+0000 7fb90bb81640 0 -- 172.21.15.37:0/56268460 >> [v2:172.21.15.40:6800/2441293461,v1:172.21.15.40:6801/2441293461] conn(0x7fb8fc017040 msgr2=0x7fb8fc060610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:32:01.994 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:01.993+0000 7fb90c382640 0 -- 172.21.15.37:0/56268460 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7fb900068f40 msgr2=0x7fb9000820d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:32:02.201 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.200+0000 7fb90e898800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:32:02.201 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.200+0000 7fb90e898800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:32:02.201 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.200+0000 7fb90e898800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:32:02.201 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.200+0000 7fb90e898800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:32:02.202 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.200+0000 7fb90e898800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:32:02.202 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.200+0000 7fb90e898800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:32:02.202 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.200+0000 7fb90e898800 20 rados->read ofs=0 len=0 2024-09-12T17:32:02.202 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.200+0000 7fb90e898800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:02.202 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.200+0000 7fb90e898800 20 rados->read ofs=0 len=0 2024-09-12T17:32:02.203 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.201+0000 7fb90e898800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:02.203 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.201+0000 7fb90e898800 20 rados->read ofs=0 len=0 2024-09-12T17:32:02.203 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.201+0000 7fb90e898800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:32:02.203 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.201+0000 7fb90e898800 20 zone default found 2024-09-12T17:32:02.203 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.201+0000 7fb90e898800 4 Realm: () 2024-09-12T17:32:02.203 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.201+0000 7fb90e898800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:32:02.203 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.201+0000 7fb90e898800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:32:02.203 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.201+0000 7fb90e898800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:32:02.203 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.201+0000 7fb90e898800 20 zonegroup default 2024-09-12T17:32:02.203 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.201+0000 7fb90e898800 20 rados->read ofs=0 len=0 2024-09-12T17:32:02.204 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.201+0000 7fb90e898800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:02.204 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.201+0000 7fb90e898800 20 rados->read ofs=0 len=0 2024-09-12T17:32:02.204 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.202+0000 7fb90e898800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:02.204 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.202+0000 7fb90e898800 20 rados->read ofs=0 len=0 2024-09-12T17:32:02.204 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.202+0000 7fb90e898800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:02.204 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.202+0000 7fb90e898800 20 started sync module instance, tier type = 2024-09-12T17:32:02.204 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.202+0000 7fb90e898800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:32:02.214 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.213+0000 7fb90e898800 20 add_watcher() i=0 2024-09-12T17:32:02.215 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.214+0000 7fb90e898800 20 add_watcher() i=1 2024-09-12T17:32:02.215 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.214+0000 7fb90e898800 20 add_watcher() i=2 2024-09-12T17:32:02.215 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.214+0000 7fb90e898800 20 add_watcher() i=3 2024-09-12T17:32:02.215 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.214+0000 7fb90e898800 20 add_watcher() i=4 2024-09-12T17:32:02.215 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.214+0000 7fb90e898800 20 add_watcher() i=5 2024-09-12T17:32:02.215 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.214+0000 7fb90e898800 20 add_watcher() i=6 2024-09-12T17:32:02.215 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.215+0000 7fb90e898800 20 add_watcher() i=7 2024-09-12T17:32:02.215 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.215+0000 7fb90e898800 2 all 8 watchers are set, enabling cache 2024-09-12T17:32:02.222 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.216+0000 7fb7c2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:32:02.222 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.217+0000 7fb90e898800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:32:02.222 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.217+0000 7fb90e898800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:32:02.222 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.217+0000 7fb90e898800 5 note: GC not initialized 2024-09-12T17:32:02.222 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.217+0000 7fb7c1fdb640 20 reqs_thread_entry: start 2024-09-12T17:32:02.222 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.217+0000 7fb90e898800 20 init_complete bucket index max shards: 11 2024-09-12T17:32:02.222 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.217+0000 7fb90e898800 20 Filter name: none 2024-09-12T17:32:02.222 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.217+0000 7fb7337fe640 20 reqs_thread_entry: start 2024-09-12T17:32:02.222 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.218+0000 7fb90e898800 20 rados->read ofs=0 len=0 2024-09-12T17:32:02.222 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.218+0000 7fb90e898800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:32:02.222 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.218+0000 7fb90e898800 20 rados->read ofs=0 len=0 2024-09-12T17:32:02.222 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.219+0000 7fb90e898800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:32:02.223 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.219+0000 7fb90e898800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:32:02.223 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.219+0000 7fb90e898800 20 rados->read ofs=0 len=0 2024-09-12T17:32:02.223 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.219+0000 7fb90e898800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:32:02.224 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.219+0000 7fb90e898800 20 rados->read ofs=0 len=0 2024-09-12T17:32:02.224 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.220+0000 7fb90e898800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:32:02.224 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.220+0000 7fb90e898800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:32:02.224 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.222+0000 7fb7c2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:32:02.225 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.224+0000 7fb90e898800 20 remove_watcher() i=0 2024-09-12T17:32:02.225 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.224+0000 7fb90e898800 2 removed watcher, disabling cache 2024-09-12T17:32:02.226 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.226+0000 7fb90e898800 20 remove_watcher() i=1 2024-09-12T17:32:02.228 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.227+0000 7fb90e898800 20 remove_watcher() i=2 2024-09-12T17:32:02.229 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.228+0000 7fb90e898800 20 remove_watcher() i=3 2024-09-12T17:32:02.230 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.230+0000 7fb90e898800 20 remove_watcher() i=4 2024-09-12T17:32:02.232 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.231+0000 7fb90e898800 20 remove_watcher() i=5 2024-09-12T17:32:02.233 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.232+0000 7fb90e898800 20 remove_watcher() i=6 2024-09-12T17:32:02.234 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.234+0000 7fb90e898800 20 remove_watcher() i=7 2024-09-12T17:32:02.248 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:32:02.248 INFO:tasks.workunit.client.0.smithi037.stderr:BUCKET_STATS: 2024-09-12T17:32:02.248 INFO:tasks.workunit.client.0.smithi037.stderr:bucket: error-at-init-index id: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.20 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:32:02.248 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:32:02.340 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bucket reshard --bucket error-at-init-index --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:32:02.373 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:32:02.373 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:32:02.415 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.414+0000 7fe9ed742800 20 rados->read ofs=0 len=0 2024-09-12T17:32:02.417 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.416+0000 7fe9ed742800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:02.417 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.416+0000 7fe9ed742800 20 realm 2024-09-12T17:32:02.417 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.416+0000 7fe9ed742800 20 rados->read ofs=0 len=0 2024-09-12T17:32:02.417 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.416+0000 7fe9ed742800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:02.417 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.416+0000 7fe9ed742800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:32:02.417 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.416+0000 7fe9ed742800 20 rados->read ofs=0 len=0 2024-09-12T17:32:02.417 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.416+0000 7fe9ed742800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:02.417 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.416+0000 7fe9ed742800 20 rados->read ofs=0 len=0 2024-09-12T17:32:02.418 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.417+0000 7fe9ed742800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:02.418 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.417+0000 7fe9ed742800 20 rados->read ofs=0 len=0 2024-09-12T17:32:02.418 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.417+0000 7fe9ed742800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:32:02.418 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.417+0000 7fe9ed742800 20 searching for the correct realm 2024-09-12T17:32:02.422 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.421+0000 7fe9e9c87640 0 -- 172.21.15.37:0/2333446290 >> [v2:172.21.15.37:6824/3990661154,v1:172.21.15.37:6825/3990661154] conn(0x55e6e22a4a90 msgr2=0x55e6e22a6ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:32:02.426 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.425+0000 7fe9e9486640 0 -- 172.21.15.37:0/2333446290 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7fe9e00b18b0 msgr2=0x7fe9e00e1280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:32:02.430 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.429+0000 7fe9ed742800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:32:02.430 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.429+0000 7fe9ed742800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:32:02.431 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.429+0000 7fe9ed742800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:32:02.431 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.429+0000 7fe9ed742800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:32:02.431 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.429+0000 7fe9ed742800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:32:02.431 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.429+0000 7fe9ed742800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:32:02.431 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.429+0000 7fe9ed742800 20 rados->read ofs=0 len=0 2024-09-12T17:32:02.431 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.430+0000 7fe9ed742800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:02.431 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.430+0000 7fe9ed742800 20 rados->read ofs=0 len=0 2024-09-12T17:32:02.432 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.430+0000 7fe9ed742800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:02.432 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.430+0000 7fe9ed742800 20 rados->read ofs=0 len=0 2024-09-12T17:32:02.432 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.431+0000 7fe9ed742800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:32:02.432 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.431+0000 7fe9ed742800 20 zone default found 2024-09-12T17:32:02.432 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.431+0000 7fe9ed742800 4 Realm: () 2024-09-12T17:32:02.433 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.431+0000 7fe9ed742800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:32:02.433 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.431+0000 7fe9ed742800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:32:02.433 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.431+0000 7fe9ed742800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:32:02.433 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.431+0000 7fe9ed742800 20 zonegroup default 2024-09-12T17:32:02.433 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.431+0000 7fe9ed742800 20 rados->read ofs=0 len=0 2024-09-12T17:32:02.433 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.431+0000 7fe9ed742800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:02.433 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.431+0000 7fe9ed742800 20 rados->read ofs=0 len=0 2024-09-12T17:32:02.433 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.431+0000 7fe9ed742800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:02.433 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.431+0000 7fe9ed742800 20 rados->read ofs=0 len=0 2024-09-12T17:32:02.433 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.431+0000 7fe9ed742800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:02.433 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.431+0000 7fe9ed742800 20 started sync module instance, tier type = 2024-09-12T17:32:02.433 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.431+0000 7fe9ed742800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:32:02.442 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.441+0000 7fe9ed742800 20 add_watcher() i=0 2024-09-12T17:32:02.442 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.441+0000 7fe9ed742800 20 add_watcher() i=1 2024-09-12T17:32:02.442 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.441+0000 7fe9ed742800 20 add_watcher() i=2 2024-09-12T17:32:02.442 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.441+0000 7fe9ed742800 20 add_watcher() i=3 2024-09-12T17:32:02.442 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.441+0000 7fe9ed742800 20 add_watcher() i=4 2024-09-12T17:32:02.442 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.441+0000 7fe9ed742800 20 add_watcher() i=5 2024-09-12T17:32:02.442 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.441+0000 7fe9ed742800 20 add_watcher() i=6 2024-09-12T17:32:02.443 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.442+0000 7fe9ed742800 20 add_watcher() i=7 2024-09-12T17:32:02.443 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.442+0000 7fe9ed742800 2 all 8 watchers are set, enabling cache 2024-09-12T17:32:02.445 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.444+0000 7fe89ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:32:02.446 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.444+0000 7fe9ed742800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:32:02.446 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.444+0000 7fe9ed742800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:32:02.446 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.444+0000 7fe9ed742800 5 note: GC not initialized 2024-09-12T17:32:02.446 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.445+0000 7fe89efe5640 20 reqs_thread_entry: start 2024-09-12T17:32:02.446 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.445+0000 7fe9ed742800 20 init_complete bucket index max shards: 11 2024-09-12T17:32:02.446 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.445+0000 7fe9ed742800 20 Filter name: none 2024-09-12T17:32:02.447 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.445+0000 7fe89cfe1640 20 reqs_thread_entry: start 2024-09-12T17:32:02.447 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.445+0000 7fe9ed742800 10 cache get: name=default.rgw.meta+root+error-at-init-index : miss 2024-09-12T17:32:02.447 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.445+0000 7fe9ed742800 20 rados->read ofs=0 len=0 2024-09-12T17:32:02.447 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.445+0000 7fe9ed742800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:32:02.447 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.445+0000 7fe9ed742800 10 cache put: name=default.rgw.meta+root+error-at-init-index info.flags=0x11 2024-09-12T17:32:02.447 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.445+0000 7fe9ed742800 10 adding default.rgw.meta+root+error-at-init-index to cache LRU end 2024-09-12T17:32:02.447 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.445+0000 7fe9ed742800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.20 : miss 2024-09-12T17:32:02.447 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.445+0000 7fe9ed742800 20 rados->read ofs=0 len=0 2024-09-12T17:32:02.448 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.446+0000 7fe9ed742800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:32:02.448 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.446+0000 7fe9ed742800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.20 info.flags=0x17 2024-09-12T17:32:02.448 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.446+0000 7fe9ed742800 10 adding default.rgw.meta+root+.bucket.meta.error-at-init-index:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.20 to cache LRU end 2024-09-12T17:32:02.448 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.446+0000 7fe9ed742800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:32:02.448 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.446+0000 7fe9ed742800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:32:02.448 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.446+0000 7fe9ed742800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.20 2024-09-12T17:32:02.453 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.453+0000 7fe9ed742800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.20 info.flags=0x17 2024-09-12T17:32:02.454 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.453+0000 7fe9ed742800 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.20 to cache LRU end 2024-09-12T17:32:02.454 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.453+0000 7fe9ed742800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:32:02.454 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.453+0000 7fe9ed742800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.20, ofs0, ns] 2024-09-12T17:32:02.455 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.453+0000 7fe8bffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497031 cookie 94450125312464 notifier 5951 bl.length()=995 2024-09-12T17:32:02.455 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.453+0000 7fe8bffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.20 info.flags=0x17 2024-09-12T17:32:02.455 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.453+0000 7fe8bffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.20 to cache LRU end 2024-09-12T17:32:02.455 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.453+0000 7fe8bffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:32:02.455 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.455+0000 7fe9ed742800 20 handle_bi_update(): bucket=:error-at-init-index[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.20]): orig_sources= new_sources= 2024-09-12T17:32:02.456 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.455+0000 7fe9ed742800 20 handle_bi_update(): bucket=:error-at-init-index[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.20]): potential sources added=[] removed=[] 2024-09-12T17:32:02.456 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.455+0000 7fe9ed742800 20 handle_bi_update(): bucket=:error-at-init-index[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.20]): orig_dests= new_dests= 2024-09-12T17:32:02.456 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.455+0000 7fe9ed742800 20 handle_bi_update(): bucket=:error-at-init-index[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.20]): potential dests added=[] removed=[] 2024-09-12T17:32:02.463 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.462+0000 7fe9ed742800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.20.1.0 2024-09-12T17:32:02.463 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.462+0000 7fe9ed742800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.20.1.0 2024-09-12T17:32:02.463 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.462+0000 7fe9ed742800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.20.1.1 2024-09-12T17:32:02.463 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.462+0000 7fe9ed742800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.20.1.1 2024-09-12T17:32:02.463 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.462+0000 7fe9ed742800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.20.1.2 2024-09-12T17:32:02.463 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.462+0000 7fe9ed742800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.20.1.2 2024-09-12T17:32:02.463 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.462+0000 7fe9ed742800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.20.1.3 2024-09-12T17:32:02.463 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.462+0000 7fe9ed742800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.20.1.3 2024-09-12T17:32:02.463 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.462+0000 7fe9ed742800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.20.1.4 2024-09-12T17:32:02.463 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.462+0000 7fe9ed742800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.20.1.4 2024-09-12T17:32:02.463 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.462+0000 7fe9ed742800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.20.1.5 2024-09-12T17:32:02.464 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.462+0000 7fe9ed742800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.20.1.5 2024-09-12T17:32:02.464 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.462+0000 7fe9ed742800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.20.1.6 2024-09-12T17:32:02.464 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.462+0000 7fe9ed742800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.20.1.6 2024-09-12T17:32:02.464 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.462+0000 7fe9ed742800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.20.1.7 2024-09-12T17:32:02.464 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.462+0000 7fe9ed742800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.20.1.7 2024-09-12T17:32:02.464 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.462+0000 7fe9ed742800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.20.1.8 2024-09-12T17:32:02.464 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.462+0000 7fe9ed742800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.20.1.8 2024-09-12T17:32:02.464 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.462+0000 7fe9ed742800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.20.1.9 2024-09-12T17:32:02.464 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.462+0000 7fe9ed742800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.20.1.9 2024-09-12T17:32:02.464 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.462+0000 7fe9ed742800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.20.1.10 2024-09-12T17:32:02.464 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.462+0000 7fe9ed742800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.20.1.10 2024-09-12T17:32:02.464 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.462+0000 7fe9ed742800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.20.1.11 2024-09-12T17:32:02.464 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.462+0000 7fe9ed742800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.20.1.11 2024-09-12T17:32:02.465 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.462+0000 7fe9ed742800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.20.0 2024-09-12T17:32:02.465 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.462+0000 7fe9ed742800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.20.1 2024-09-12T17:32:02.465 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.463+0000 7fe9ed742800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.20.2 2024-09-12T17:32:02.466 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.463+0000 7fe9ed742800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.20.3 2024-09-12T17:32:02.466 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.464+0000 7fe9ed742800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.20.4 2024-09-12T17:32:02.466 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.465+0000 7fe9ed742800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.20.5 2024-09-12T17:32:02.466 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.465+0000 7fe9ed742800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.20.6 2024-09-12T17:32:02.466 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.466+0000 7fe9ed742800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.20.7 2024-09-12T17:32:02.467 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.466+0000 7fe9ed742800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.20.8 2024-09-12T17:32:02.468 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.467+0000 7fe9ed742800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.20.9 2024-09-12T17:32:02.468 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.467+0000 7fe9ed742800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.20.10 2024-09-12T17:32:02.472 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.471+0000 7fe9ed742800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.20 : hit (requested=0x17, cached=0x17) 2024-09-12T17:32:02.472 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.471+0000 7fe9ed742800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.20 2024-09-12T17:32:02.473 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.472+0000 7fe9ed742800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.20 info.flags=0x17 2024-09-12T17:32:02.473 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.472+0000 7fe9ed742800 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.20 to cache LRU end 2024-09-12T17:32:02.473 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.472+0000 7fe9ed742800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:32:02.473 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.472+0000 7fe9ed742800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.20, ofs0, ns] 2024-09-12T17:32:02.473 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.472+0000 7fe8bffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497032 cookie 94450125312464 notifier 5951 bl.length()=995 2024-09-12T17:32:02.473 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.472+0000 7fe8bffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.20 info.flags=0x17 2024-09-12T17:32:02.474 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.472+0000 7fe8bffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.20 to cache LRU end 2024-09-12T17:32:02.474 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.472+0000 7fe8bffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:32:02.475 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.474+0000 7fe9ed742800 20 handle_bi_update(): bucket=:error-at-init-index[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.20]): orig_sources= new_sources= 2024-09-12T17:32:02.475 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.474+0000 7fe9ed742800 20 handle_bi_update(): bucket=:error-at-init-index[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.20]): potential sources added=[] removed=[] 2024-09-12T17:32:02.475 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.474+0000 7fe9ed742800 20 handle_bi_update(): bucket=:error-at-init-index[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.20]): orig_dests= new_dests= 2024-09-12T17:32:02.475 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.474+0000 7fe9ed742800 20 handle_bi_update(): bucket=:error-at-init-index[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.20]): potential dests added=[] removed=[] 2024-09-12T17:32:02.477 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.477+0000 7fe9ed742800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.20.0 2024-09-12T17:32:02.478 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.477+0000 7fe9ed742800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.20.1 2024-09-12T17:32:02.478 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.477+0000 7fe9ed742800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.20.2 2024-09-12T17:32:02.478 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.478+0000 7fe9ed742800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.20.3 2024-09-12T17:32:02.479 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.478+0000 7fe9ed742800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.20.4 2024-09-12T17:32:02.479 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.478+0000 7fe9ed742800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.20.5 2024-09-12T17:32:02.480 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.479+0000 7fe9ed742800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.20.6 2024-09-12T17:32:02.480 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.479+0000 7fe9ed742800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.20.7 2024-09-12T17:32:02.480 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.479+0000 7fe9ed742800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.20.8 2024-09-12T17:32:02.481 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.480+0000 7fe9ed742800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.20.9 2024-09-12T17:32:02.481 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.480+0000 7fe9ed742800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.20.10 2024-09-12T17:32:02.482 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.481+0000 7fe9ed742800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.20 : hit (requested=0x17, cached=0x17) 2024-09-12T17:32:02.482 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.481+0000 7fe9ed742800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.20 2024-09-12T17:32:02.483 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.482+0000 7fe9ed742800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.20 info.flags=0x17 2024-09-12T17:32:02.483 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.482+0000 7fe9ed742800 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.20 to cache LRU end 2024-09-12T17:32:02.483 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.482+0000 7fe9ed742800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:32:02.483 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.482+0000 7fe9ed742800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.20, ofs0, ns] 2024-09-12T17:32:02.483 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.482+0000 7fe8ccff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497033 cookie 94450125312464 notifier 5951 bl.length()=963 2024-09-12T17:32:02.483 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.482+0000 7fe8ccff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.20 info.flags=0x17 2024-09-12T17:32:02.483 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.482+0000 7fe8ccff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.20 to cache LRU end 2024-09-12T17:32:02.484 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.482+0000 7fe8ccff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:32:02.484 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.484+0000 7fe9ed742800 20 handle_bi_update(): bucket=:error-at-init-index[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.20]): orig_sources= new_sources= 2024-09-12T17:32:02.485 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.484+0000 7fe9ed742800 20 handle_bi_update(): bucket=:error-at-init-index[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.20]): potential sources added=[] removed=[] 2024-09-12T17:32:02.485 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.484+0000 7fe9ed742800 20 handle_bi_update(): bucket=:error-at-init-index[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.20]): orig_dests= new_dests= 2024-09-12T17:32:02.485 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.484+0000 7fe9ed742800 20 handle_bi_update(): bucket=:error-at-init-index[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.20]): potential dests added=[] removed=[] 2024-09-12T17:32:02.487 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.486+0000 7fe9ed742800 1 execute INFO: reshard of bucket "error-at-init-index" from 11 shards to 12 shards completed successfully 2024-09-12T17:32:02.489 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.488+0000 7fe89ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:32:02.491 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.491+0000 7fe9ed742800 20 remove_watcher() i=0 2024-09-12T17:32:02.491 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.491+0000 7fe9ed742800 2 removed watcher, disabling cache 2024-09-12T17:32:02.492 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.492+0000 7fe9ed742800 20 remove_watcher() i=1 2024-09-12T17:32:02.493 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.493+0000 7fe9ed742800 20 remove_watcher() i=2 2024-09-12T17:32:02.494 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.494+0000 7fe9ed742800 20 remove_watcher() i=3 2024-09-12T17:32:02.495 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.495+0000 7fe9ed742800 20 remove_watcher() i=4 2024-09-12T17:32:02.496 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.496+0000 7fe9ed742800 20 remove_watcher() i=5 2024-09-12T17:32:02.497 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.497+0000 7fe9ed742800 20 remove_watcher() i=6 2024-09-12T17:32:02.498 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.498+0000 7fe9ed742800 20 remove_watcher() i=7 2024-09-12T17:32:02.511 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-12T17:32:02.544 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:32:02.544 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:32:02.584 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.583+0000 7f9a1540e800 20 rados->read ofs=0 len=0 2024-09-12T17:32:02.586 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.585+0000 7f9a1540e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:02.586 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.585+0000 7f9a1540e800 20 realm 2024-09-12T17:32:02.586 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.585+0000 7f9a1540e800 20 rados->read ofs=0 len=0 2024-09-12T17:32:02.586 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.585+0000 7f9a1540e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:02.586 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.585+0000 7f9a1540e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:32:02.586 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.585+0000 7f9a1540e800 20 rados->read ofs=0 len=0 2024-09-12T17:32:02.586 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.585+0000 7f9a1540e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:02.586 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.585+0000 7f9a1540e800 20 rados->read ofs=0 len=0 2024-09-12T17:32:02.587 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.586+0000 7f9a1540e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:02.587 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.586+0000 7f9a1540e800 20 rados->read ofs=0 len=0 2024-09-12T17:32:02.587 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.586+0000 7f9a1540e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:32:02.587 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.586+0000 7f9a1540e800 20 searching for the correct realm 2024-09-12T17:32:02.590 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.589+0000 7f9a0bfff640 0 -- 172.21.15.37:0/340110846 >> [v2:172.21.15.40:6800/2441293461,v1:172.21.15.40:6801/2441293461] conn(0x7f9a040a1040 msgr2=0x7f9a04011a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:32:02.593 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.593+0000 7f9a10a59640 0 -- 172.21.15.37:0/340110846 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7f99fc02d3e0 msgr2=0x7f99fc02d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:32:02.803 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.799+0000 7f9a1540e800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:32:02.803 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.799+0000 7f9a1540e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:32:02.803 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.799+0000 7f9a1540e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:32:02.803 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.799+0000 7f9a1540e800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:32:02.803 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.799+0000 7f9a1540e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:32:02.803 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.799+0000 7f9a1540e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:32:02.803 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.799+0000 7f9a1540e800 20 rados->read ofs=0 len=0 2024-09-12T17:32:02.804 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.800+0000 7f9a1540e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:02.804 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.800+0000 7f9a1540e800 20 rados->read ofs=0 len=0 2024-09-12T17:32:02.804 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.800+0000 7f9a1540e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:02.804 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.800+0000 7f9a1540e800 20 rados->read ofs=0 len=0 2024-09-12T17:32:02.804 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.800+0000 7f9a1540e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:32:02.804 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.800+0000 7f9a1540e800 20 zone default found 2024-09-12T17:32:02.804 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.800+0000 7f9a1540e800 4 Realm: () 2024-09-12T17:32:02.804 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.800+0000 7f9a1540e800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:32:02.804 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.800+0000 7f9a1540e800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:32:02.804 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.800+0000 7f9a1540e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:32:02.805 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.800+0000 7f9a1540e800 20 zonegroup default 2024-09-12T17:32:02.805 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.800+0000 7f9a1540e800 20 rados->read ofs=0 len=0 2024-09-12T17:32:02.805 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.801+0000 7f9a1540e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:02.805 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.801+0000 7f9a1540e800 20 rados->read ofs=0 len=0 2024-09-12T17:32:02.805 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.801+0000 7f9a1540e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:02.805 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.801+0000 7f9a1540e800 20 rados->read ofs=0 len=0 2024-09-12T17:32:02.805 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.801+0000 7f9a1540e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:02.805 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.801+0000 7f9a1540e800 20 started sync module instance, tier type = 2024-09-12T17:32:02.805 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.801+0000 7f9a1540e800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:32:02.813 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.812+0000 7f9a1540e800 20 add_watcher() i=0 2024-09-12T17:32:02.813 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.812+0000 7f9a1540e800 20 add_watcher() i=1 2024-09-12T17:32:02.813 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.812+0000 7f9a1540e800 20 add_watcher() i=2 2024-09-12T17:32:02.813 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.812+0000 7f9a1540e800 20 add_watcher() i=3 2024-09-12T17:32:02.813 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.812+0000 7f9a1540e800 20 add_watcher() i=4 2024-09-12T17:32:02.813 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.812+0000 7f9a1540e800 20 add_watcher() i=5 2024-09-12T17:32:02.813 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.812+0000 7f9a1540e800 20 add_watcher() i=6 2024-09-12T17:32:02.814 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.813+0000 7f9a1540e800 20 add_watcher() i=7 2024-09-12T17:32:02.814 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.813+0000 7f9a1540e800 2 all 8 watchers are set, enabling cache 2024-09-12T17:32:02.815 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.814+0000 7f98c6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:32:02.816 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.814+0000 7f9a1540e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:32:02.817 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.814+0000 7f9a1540e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:32:02.817 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.814+0000 7f9a1540e800 5 note: GC not initialized 2024-09-12T17:32:02.817 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.815+0000 7f98c5fe3640 20 reqs_thread_entry: start 2024-09-12T17:32:02.817 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.815+0000 7f9a1540e800 20 init_complete bucket index max shards: 11 2024-09-12T17:32:02.817 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.815+0000 7f9a1540e800 20 Filter name: none 2024-09-12T17:32:02.817 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.815+0000 7f98377fe640 20 reqs_thread_entry: start 2024-09-12T17:32:02.817 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.815+0000 7f9a1540e800 20 rados->read ofs=0 len=0 2024-09-12T17:32:02.818 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.816+0000 7f9a1540e800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:32:02.818 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.816+0000 7f9a1540e800 20 rados->read ofs=0 len=0 2024-09-12T17:32:02.818 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.816+0000 7f9a1540e800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:32:02.818 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.816+0000 7f9a1540e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:32:02.818 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.816+0000 7f9a1540e800 20 rados->read ofs=0 len=0 2024-09-12T17:32:02.819 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.817+0000 7f9a1540e800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:32:02.819 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.817+0000 7f9a1540e800 20 rados->read ofs=0 len=0 2024-09-12T17:32:02.819 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.817+0000 7f9a1540e800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:32:02.819 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.817+0000 7f9a1540e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:32:02.820 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.819+0000 7f98c6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:32:02.823 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.821+0000 7f9a1540e800 20 remove_watcher() i=0 2024-09-12T17:32:02.823 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.821+0000 7f9a1540e800 2 removed watcher, disabling cache 2024-09-12T17:32:02.824 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.823+0000 7f9a1540e800 20 remove_watcher() i=1 2024-09-12T17:32:02.825 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.824+0000 7f9a1540e800 20 remove_watcher() i=2 2024-09-12T17:32:02.826 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.825+0000 7f9a1540e800 20 remove_watcher() i=3 2024-09-12T17:32:02.827 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.826+0000 7f9a1540e800 20 remove_watcher() i=4 2024-09-12T17:32:02.828 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.827+0000 7f9a1540e800 20 remove_watcher() i=5 2024-09-12T17:32:02.829 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.828+0000 7f9a1540e800 20 remove_watcher() i=6 2024-09-12T17:32:02.832 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:02.830+0000 7f9a1540e800 20 remove_watcher() i=7 2024-09-12T17:32:02.845 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:32:02.845 INFO:tasks.workunit.client.0.smithi037.stderr:BUCKET_STATS: 2024-09-12T17:32:02.845 INFO:tasks.workunit.client.0.smithi037.stderr:bucket: error-at-init-index id: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.20 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T17:32:02.845 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:32:03.192 INFO:tasks.workunit.client.0.smithi037.stderr:TEST: reshard bucket with EOPNOTSUPP injected at init_index 2024-09-12T17:32:03.192 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:32:03.977 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-12T17:32:04.006 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:32:04.006 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:32:04.239 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:04.238+0000 7f9149c94640 0 --2- 172.21.15.37:0/1745101739 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x55e1c7a25fe0 0x55e1c7a243d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-12T17:32:04.248 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:04.247+0000 7f914c9ab800 20 rados->read ofs=0 len=0 2024-09-12T17:32:04.250 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:04.249+0000 7f914c9ab800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:04.250 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:04.249+0000 7f914c9ab800 20 realm 2024-09-12T17:32:04.250 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:04.249+0000 7f914c9ab800 20 rados->read ofs=0 len=0 2024-09-12T17:32:04.250 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:04.249+0000 7f914c9ab800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:04.250 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:04.249+0000 7f914c9ab800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:32:04.250 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:04.249+0000 7f914c9ab800 20 rados->read ofs=0 len=0 2024-09-12T17:32:04.250 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:04.249+0000 7f914c9ab800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:04.250 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:04.249+0000 7f914c9ab800 20 rados->read ofs=0 len=0 2024-09-12T17:32:04.251 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:04.250+0000 7f914c9ab800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:04.251 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:04.250+0000 7f914c9ab800 20 rados->read ofs=0 len=0 2024-09-12T17:32:04.251 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:04.250+0000 7f914c9ab800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:32:04.251 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:04.250+0000 7f914c9ab800 20 searching for the correct realm 2024-09-12T17:32:04.253 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:04.253+0000 7f9149c94640 0 -- 172.21.15.37:0/430770232 >> [v2:172.21.15.40:6800/2441293461,v1:172.21.15.40:6801/2441293461] conn(0x7f913c03e040 msgr2=0x7f913c09d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:32:04.461 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:04.460+0000 7f914a495640 0 -- 172.21.15.37:0/430770232 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7f9140066390 msgr2=0x7f914009d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:32:04.668 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:04.667+0000 7f914c9ab800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:32:04.668 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:04.667+0000 7f914c9ab800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:32:04.668 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:04.667+0000 7f914c9ab800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:32:04.668 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:04.667+0000 7f914c9ab800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:32:04.668 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:04.667+0000 7f914c9ab800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:32:04.668 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:04.667+0000 7f914c9ab800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:32:04.668 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:04.667+0000 7f914c9ab800 20 rados->read ofs=0 len=0 2024-09-12T17:32:04.668 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:04.667+0000 7f914c9ab800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:04.668 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:04.667+0000 7f914c9ab800 20 rados->read ofs=0 len=0 2024-09-12T17:32:04.670 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:04.667+0000 7f914c9ab800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:04.670 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:04.667+0000 7f914c9ab800 20 rados->read ofs=0 len=0 2024-09-12T17:32:04.670 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:04.668+0000 7f914c9ab800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:32:04.670 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:04.668+0000 7f914c9ab800 20 zone default found 2024-09-12T17:32:04.670 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:04.668+0000 7f914c9ab800 4 Realm: () 2024-09-12T17:32:04.670 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:04.668+0000 7f914c9ab800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:32:04.670 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:04.668+0000 7f914c9ab800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:32:04.670 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:04.668+0000 7f914c9ab800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:32:04.670 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:04.668+0000 7f914c9ab800 20 zonegroup default 2024-09-12T17:32:04.670 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:04.668+0000 7f914c9ab800 20 rados->read ofs=0 len=0 2024-09-12T17:32:04.670 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:04.668+0000 7f914c9ab800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:04.671 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:04.668+0000 7f914c9ab800 20 rados->read ofs=0 len=0 2024-09-12T17:32:04.671 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:04.668+0000 7f914c9ab800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:04.671 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:04.668+0000 7f914c9ab800 20 rados->read ofs=0 len=0 2024-09-12T17:32:04.671 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:04.668+0000 7f914c9ab800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:04.671 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:04.668+0000 7f914c9ab800 20 started sync module instance, tier type = 2024-09-12T17:32:04.671 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:04.668+0000 7f914c9ab800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:32:04.685 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:04.680+0000 7f914c9ab800 20 add_watcher() i=0 2024-09-12T17:32:04.685 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:04.680+0000 7f914c9ab800 20 add_watcher() i=1 2024-09-12T17:32:04.686 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:04.680+0000 7f914c9ab800 20 add_watcher() i=2 2024-09-12T17:32:04.686 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:04.680+0000 7f914c9ab800 20 add_watcher() i=3 2024-09-12T17:32:04.686 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:04.680+0000 7f914c9ab800 20 add_watcher() i=4 2024-09-12T17:32:04.686 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:04.680+0000 7f914c9ab800 20 add_watcher() i=5 2024-09-12T17:32:04.686 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:04.680+0000 7f914c9ab800 20 add_watcher() i=6 2024-09-12T17:32:04.686 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:04.681+0000 7f914c9ab800 20 add_watcher() i=7 2024-09-12T17:32:04.686 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:04.681+0000 7f914c9ab800 2 all 8 watchers are set, enabling cache 2024-09-12T17:32:04.686 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:04.683+0000 7f9000fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:32:04.686 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:04.683+0000 7f914c9ab800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:32:04.686 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:04.683+0000 7f914c9ab800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:32:04.686 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:04.683+0000 7f914c9ab800 5 note: GC not initialized 2024-09-12T17:32:04.686 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:04.683+0000 7f8f7b7fe640 20 reqs_thread_entry: start 2024-09-12T17:32:04.687 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:04.684+0000 7f914c9ab800 20 init_complete bucket index max shards: 11 2024-09-12T17:32:04.687 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:04.684+0000 7f914c9ab800 20 Filter name: none 2024-09-12T17:32:04.687 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:04.684+0000 7f8f797fa640 20 reqs_thread_entry: start 2024-09-12T17:32:04.687 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:04.684+0000 7f914c9ab800 20 rados->read ofs=0 len=0 2024-09-12T17:32:04.687 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:04.684+0000 7f914c9ab800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:32:04.687 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:04.684+0000 7f914c9ab800 20 rados->read ofs=0 len=0 2024-09-12T17:32:04.687 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:04.685+0000 7f914c9ab800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:32:04.687 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:04.685+0000 7f914c9ab800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:32:04.688 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:04.685+0000 7f914c9ab800 20 rados->read ofs=0 len=0 2024-09-12T17:32:04.688 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:04.685+0000 7f914c9ab800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:32:04.688 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:04.685+0000 7f914c9ab800 20 rados->read ofs=0 len=0 2024-09-12T17:32:04.688 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:04.686+0000 7f914c9ab800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:32:04.688 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:04.686+0000 7f914c9ab800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:32:04.689 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:04.688+0000 7f9000fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:32:04.691 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:04.690+0000 7f914c9ab800 20 remove_watcher() i=0 2024-09-12T17:32:04.691 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:04.690+0000 7f914c9ab800 2 removed watcher, disabling cache 2024-09-12T17:32:04.693 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:04.692+0000 7f914c9ab800 20 remove_watcher() i=1 2024-09-12T17:32:04.694 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:04.693+0000 7f914c9ab800 20 remove_watcher() i=2 2024-09-12T17:32:04.695 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:04.694+0000 7f914c9ab800 20 remove_watcher() i=3 2024-09-12T17:32:04.696 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:04.695+0000 7f914c9ab800 20 remove_watcher() i=4 2024-09-12T17:32:04.698 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:04.697+0000 7f914c9ab800 20 remove_watcher() i=5 2024-09-12T17:32:04.699 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:04.698+0000 7f914c9ab800 20 remove_watcher() i=6 2024-09-12T17:32:04.700 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:04.699+0000 7f914c9ab800 20 remove_watcher() i=7 2024-09-12T17:32:04.712 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:32:04.712 INFO:tasks.workunit.client.0.smithi037.stderr:BUCKET_STATS: 2024-09-12T17:32:04.713 INFO:tasks.workunit.client.0.smithi037.stderr:bucket: error-at-init-index id: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.21 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:32:04.713 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:32:04.714 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bucket reshard --bucket error-at-init-index --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at init_index --inject-error-code 95 2024-09-12T17:32:04.751 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:32:04.751 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:32:04.791 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:04.790+0000 7f446c708800 20 rados->read ofs=0 len=0 2024-09-12T17:32:04.792 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:04.791+0000 7f446c708800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:04.792 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:04.791+0000 7f446c708800 20 realm 2024-09-12T17:32:04.792 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:04.791+0000 7f446c708800 20 rados->read ofs=0 len=0 2024-09-12T17:32:04.793 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:04.791+0000 7f446c708800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:04.793 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:04.791+0000 7f446c708800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:32:04.793 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:04.791+0000 7f446c708800 20 rados->read ofs=0 len=0 2024-09-12T17:32:04.793 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:04.792+0000 7f446c708800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:04.793 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:04.792+0000 7f446c708800 20 rados->read ofs=0 len=0 2024-09-12T17:32:04.793 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:04.793+0000 7f446c708800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:04.793 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:04.793+0000 7f446c708800 20 rados->read ofs=0 len=0 2024-09-12T17:32:04.794 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:04.793+0000 7f446c708800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:32:04.794 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:04.793+0000 7f446c708800 20 searching for the correct realm 2024-09-12T17:32:04.796 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:04.796+0000 7f44699f1640 0 -- 172.21.15.37:0/3756112185 >> [v2:172.21.15.40:6800/2441293461,v1:172.21.15.40:6801/2441293461] conn(0x7f445c06b020 msgr2=0x7f445c0be930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:32:04.800 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:04.799+0000 7f446a1f2640 0 -- 172.21.15.37:0/3756112185 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7f446000e4c0 msgr2=0x7f446000d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:32:05.008 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.007+0000 7f446c708800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:32:05.009 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.007+0000 7f446c708800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:32:05.009 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.007+0000 7f446c708800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:32:05.009 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.007+0000 7f446c708800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:32:05.009 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.007+0000 7f446c708800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:32:05.009 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.007+0000 7f446c708800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:32:05.009 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.007+0000 7f446c708800 20 rados->read ofs=0 len=0 2024-09-12T17:32:05.009 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.008+0000 7f446c708800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:05.009 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.008+0000 7f446c708800 20 rados->read ofs=0 len=0 2024-09-12T17:32:05.011 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.008+0000 7f446c708800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:05.011 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.008+0000 7f446c708800 20 rados->read ofs=0 len=0 2024-09-12T17:32:05.011 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.008+0000 7f446c708800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:32:05.011 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.008+0000 7f446c708800 20 zone default found 2024-09-12T17:32:05.011 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.008+0000 7f446c708800 4 Realm: () 2024-09-12T17:32:05.011 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.008+0000 7f446c708800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:32:05.012 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.008+0000 7f446c708800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:32:05.012 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.008+0000 7f446c708800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:32:05.012 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.008+0000 7f446c708800 20 zonegroup default 2024-09-12T17:32:05.012 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.008+0000 7f446c708800 20 rados->read ofs=0 len=0 2024-09-12T17:32:05.012 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.009+0000 7f446c708800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:05.012 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.009+0000 7f446c708800 20 rados->read ofs=0 len=0 2024-09-12T17:32:05.012 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.009+0000 7f446c708800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:05.012 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.009+0000 7f446c708800 20 rados->read ofs=0 len=0 2024-09-12T17:32:05.012 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.009+0000 7f446c708800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:05.012 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.009+0000 7f446c708800 20 started sync module instance, tier type = 2024-09-12T17:32:05.012 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.009+0000 7f446c708800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:32:05.021 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.019+0000 7f446c708800 20 add_watcher() i=0 2024-09-12T17:32:05.021 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.019+0000 7f446c708800 20 add_watcher() i=1 2024-09-12T17:32:05.021 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.019+0000 7f446c708800 20 add_watcher() i=2 2024-09-12T17:32:05.021 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.019+0000 7f446c708800 20 add_watcher() i=3 2024-09-12T17:32:05.021 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.019+0000 7f446c708800 20 add_watcher() i=4 2024-09-12T17:32:05.021 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.019+0000 7f446c708800 20 add_watcher() i=5 2024-09-12T17:32:05.021 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.019+0000 7f446c708800 20 add_watcher() i=6 2024-09-12T17:32:05.021 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.020+0000 7f446c708800 20 add_watcher() i=7 2024-09-12T17:32:05.022 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.020+0000 7f446c708800 2 all 8 watchers are set, enabling cache 2024-09-12T17:32:05.023 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.023+0000 7f4320fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:32:05.024 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.023+0000 7f446c708800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:32:05.024 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.023+0000 7f446c708800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:32:05.024 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.023+0000 7f446c708800 5 note: GC not initialized 2024-09-12T17:32:05.025 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.023+0000 7f429b7fe640 20 reqs_thread_entry: start 2024-09-12T17:32:05.025 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.023+0000 7f446c708800 20 init_complete bucket index max shards: 11 2024-09-12T17:32:05.025 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.023+0000 7f446c708800 20 Filter name: none 2024-09-12T17:32:05.025 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.023+0000 7f42997fa640 20 reqs_thread_entry: start 2024-09-12T17:32:05.025 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.023+0000 7f446c708800 10 cache get: name=default.rgw.meta+root+error-at-init-index : miss 2024-09-12T17:32:05.025 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.023+0000 7f446c708800 20 rados->read ofs=0 len=0 2024-09-12T17:32:05.026 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.024+0000 7f446c708800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:32:05.026 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.024+0000 7f446c708800 10 cache put: name=default.rgw.meta+root+error-at-init-index info.flags=0x11 2024-09-12T17:32:05.026 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.024+0000 7f446c708800 10 adding default.rgw.meta+root+error-at-init-index to cache LRU end 2024-09-12T17:32:05.026 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.024+0000 7f446c708800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.21 : miss 2024-09-12T17:32:05.026 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.024+0000 7f446c708800 20 rados->read ofs=0 len=0 2024-09-12T17:32:05.026 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.024+0000 7f446c708800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:32:05.026 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.024+0000 7f446c708800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.21 info.flags=0x17 2024-09-12T17:32:05.026 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.024+0000 7f446c708800 10 adding default.rgw.meta+root+.bucket.meta.error-at-init-index:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.21 to cache LRU end 2024-09-12T17:32:05.026 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.024+0000 7f446c708800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:32:05.026 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.024+0000 7f446c708800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:32:05.027 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.024+0000 7f446c708800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.21 2024-09-12T17:32:05.027 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.026+0000 7f446c708800 -1 Injecting error=-95 at location=init_index 2024-09-12T17:32:05.027 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.026+0000 7f446c708800 0 WARNING: init_index() does not supported logrecord, falling back to block reshard mode. 2024-09-12T17:32:05.031 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.030+0000 7f446c708800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.21 info.flags=0x17 2024-09-12T17:32:05.031 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.030+0000 7f446c708800 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.21 to cache LRU end 2024-09-12T17:32:05.032 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.030+0000 7f446c708800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:32:05.032 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.030+0000 7f446c708800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.21, ofs0, ns] 2024-09-12T17:32:05.032 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.030+0000 7f434d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497036 cookie 94202675987200 notifier 5999 bl.length()=995 2024-09-12T17:32:05.032 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.030+0000 7f434d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.21 info.flags=0x17 2024-09-12T17:32:05.032 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.030+0000 7f434d7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.21 to cache LRU end 2024-09-12T17:32:05.032 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.030+0000 7f434d7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:32:05.033 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.032+0000 7f446c708800 20 handle_bi_update(): bucket=:error-at-init-index[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.21]): orig_sources= new_sources= 2024-09-12T17:32:05.033 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.032+0000 7f446c708800 20 handle_bi_update(): bucket=:error-at-init-index[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.21]): potential sources added=[] removed=[] 2024-09-12T17:32:05.033 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.032+0000 7f446c708800 20 handle_bi_update(): bucket=:error-at-init-index[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.21]): orig_dests= new_dests= 2024-09-12T17:32:05.033 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.032+0000 7f446c708800 20 handle_bi_update(): bucket=:error-at-init-index[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.21]): potential dests added=[] removed=[] 2024-09-12T17:32:05.038 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.037+0000 7f446c708800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.21.1.0 2024-09-12T17:32:05.038 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.037+0000 7f446c708800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.21.1.0 2024-09-12T17:32:05.038 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.037+0000 7f446c708800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.21.1.1 2024-09-12T17:32:05.038 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.037+0000 7f446c708800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.21.1.1 2024-09-12T17:32:05.039 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.037+0000 7f446c708800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.21.1.2 2024-09-12T17:32:05.039 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.037+0000 7f446c708800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.21.1.2 2024-09-12T17:32:05.039 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.037+0000 7f446c708800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.21.1.3 2024-09-12T17:32:05.039 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.037+0000 7f446c708800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.21.1.3 2024-09-12T17:32:05.039 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.037+0000 7f446c708800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.21.1.4 2024-09-12T17:32:05.039 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.037+0000 7f446c708800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.21.1.4 2024-09-12T17:32:05.039 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.037+0000 7f446c708800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.21.1.5 2024-09-12T17:32:05.039 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.037+0000 7f446c708800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.21.1.5 2024-09-12T17:32:05.039 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.037+0000 7f446c708800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.21.1.6 2024-09-12T17:32:05.039 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.037+0000 7f446c708800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.21.1.6 2024-09-12T17:32:05.039 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.037+0000 7f446c708800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.21.1.7 2024-09-12T17:32:05.039 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.037+0000 7f446c708800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.21.1.7 2024-09-12T17:32:05.039 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.037+0000 7f446c708800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.21.1.8 2024-09-12T17:32:05.039 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.037+0000 7f446c708800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.21.1.8 2024-09-12T17:32:05.040 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.037+0000 7f446c708800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.21.1.9 2024-09-12T17:32:05.040 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.037+0000 7f446c708800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.21.1.9 2024-09-12T17:32:05.040 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.037+0000 7f446c708800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.21.1.10 2024-09-12T17:32:05.040 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.037+0000 7f446c708800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.21.1.10 2024-09-12T17:32:05.040 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.037+0000 7f446c708800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.21.1.11 2024-09-12T17:32:05.040 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.037+0000 7f446c708800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.21.1.11 2024-09-12T17:32:05.040 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.037+0000 7f446c708800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.21.0 2024-09-12T17:32:05.040 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.037+0000 7f446c708800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.21.1 2024-09-12T17:32:05.041 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.038+0000 7f446c708800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.21.2 2024-09-12T17:32:05.041 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.038+0000 7f446c708800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.21.3 2024-09-12T17:32:05.041 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.039+0000 7f446c708800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.21.4 2024-09-12T17:32:05.041 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.039+0000 7f446c708800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.21.5 2024-09-12T17:32:05.042 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.040+0000 7f446c708800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.21.6 2024-09-12T17:32:05.042 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.040+0000 7f446c708800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.21.7 2024-09-12T17:32:05.042 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.041+0000 7f446c708800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.21.8 2024-09-12T17:32:05.042 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.041+0000 7f446c708800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.21.9 2024-09-12T17:32:05.042 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.042+0000 7f446c708800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.21.10 2024-09-12T17:32:05.045 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.045+0000 7f446c708800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.21 : hit (requested=0x17, cached=0x17) 2024-09-12T17:32:05.045 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.045+0000 7f446c708800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.21 2024-09-12T17:32:05.047 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.046+0000 7f446c708800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.21 info.flags=0x17 2024-09-12T17:32:05.047 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.046+0000 7f446c708800 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.21 to cache LRU end 2024-09-12T17:32:05.047 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.046+0000 7f446c708800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:32:05.047 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.046+0000 7f446c708800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.21, ofs0, ns] 2024-09-12T17:32:05.047 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.046+0000 7f434d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497037 cookie 94202675987200 notifier 5999 bl.length()=963 2024-09-12T17:32:05.047 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.046+0000 7f434d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.21 info.flags=0x17 2024-09-12T17:32:05.048 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.046+0000 7f434d7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.21 to cache LRU end 2024-09-12T17:32:05.048 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.046+0000 7f434d7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:32:05.049 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.048+0000 7f446c708800 20 handle_bi_update(): bucket=:error-at-init-index[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.21]): orig_sources= new_sources= 2024-09-12T17:32:05.049 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.048+0000 7f446c708800 20 handle_bi_update(): bucket=:error-at-init-index[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.21]): potential sources added=[] removed=[] 2024-09-12T17:32:05.049 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.048+0000 7f446c708800 20 handle_bi_update(): bucket=:error-at-init-index[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.21]): orig_dests= new_dests= 2024-09-12T17:32:05.049 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.048+0000 7f446c708800 20 handle_bi_update(): bucket=:error-at-init-index[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.21]): potential dests added=[] removed=[] 2024-09-12T17:32:05.051 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.051+0000 7f446c708800 1 execute INFO: reshard of bucket "error-at-init-index" from 11 shards to 12 shards completed successfully 2024-09-12T17:32:05.054 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.053+0000 7f4320fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:32:05.056 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.055+0000 7f446c708800 20 remove_watcher() i=0 2024-09-12T17:32:05.056 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.055+0000 7f446c708800 2 removed watcher, disabling cache 2024-09-12T17:32:05.057 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.056+0000 7f446c708800 20 remove_watcher() i=1 2024-09-12T17:32:05.058 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.057+0000 7f446c708800 20 remove_watcher() i=2 2024-09-12T17:32:05.059 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.058+0000 7f446c708800 20 remove_watcher() i=3 2024-09-12T17:32:05.060 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.059+0000 7f446c708800 20 remove_watcher() i=4 2024-09-12T17:32:05.061 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.060+0000 7f446c708800 20 remove_watcher() i=5 2024-09-12T17:32:05.062 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.061+0000 7f446c708800 20 remove_watcher() i=6 2024-09-12T17:32:05.063 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.062+0000 7f446c708800 20 remove_watcher() i=7 2024-09-12T17:32:05.076 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-12T17:32:05.105 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:32:05.105 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:32:05.144 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.143+0000 7fa055537800 20 rados->read ofs=0 len=0 2024-09-12T17:32:05.147 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.145+0000 7fa055537800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:05.147 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.145+0000 7fa055537800 20 realm 2024-09-12T17:32:05.147 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.145+0000 7fa055537800 20 rados->read ofs=0 len=0 2024-09-12T17:32:05.147 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.145+0000 7fa055537800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:05.147 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.145+0000 7fa055537800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:32:05.147 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.145+0000 7fa055537800 20 rados->read ofs=0 len=0 2024-09-12T17:32:05.147 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.146+0000 7fa055537800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:05.147 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.146+0000 7fa055537800 20 rados->read ofs=0 len=0 2024-09-12T17:32:05.148 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.146+0000 7fa055537800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:05.148 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.146+0000 7fa055537800 20 rados->read ofs=0 len=0 2024-09-12T17:32:05.148 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.147+0000 7fa055537800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:32:05.148 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.147+0000 7fa055537800 20 searching for the correct realm 2024-09-12T17:32:05.150 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.149+0000 7fa050a20640 0 -- 172.21.15.37:0/3038226301 >> [v2:172.21.15.40:6800/2441293461,v1:172.21.15.40:6801/2441293461] conn(0x7fa04407c420 msgr2=0x7fa04407c840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:32:05.155 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.154+0000 7fa051221640 0 -- 172.21.15.37:0/3038226301 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7fa04804f0b0 msgr2=0x7fa0480637d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:32:05.362 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.361+0000 7fa055537800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:32:05.362 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.361+0000 7fa055537800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:32:05.362 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.361+0000 7fa055537800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:32:05.362 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.361+0000 7fa055537800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:32:05.362 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.361+0000 7fa055537800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:32:05.362 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.361+0000 7fa055537800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:32:05.363 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.361+0000 7fa055537800 20 rados->read ofs=0 len=0 2024-09-12T17:32:05.363 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.361+0000 7fa055537800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:05.363 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.361+0000 7fa055537800 20 rados->read ofs=0 len=0 2024-09-12T17:32:05.363 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.361+0000 7fa055537800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:05.363 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.361+0000 7fa055537800 20 rados->read ofs=0 len=0 2024-09-12T17:32:05.364 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.362+0000 7fa055537800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:32:05.364 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.362+0000 7fa055537800 20 zone default found 2024-09-12T17:32:05.364 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.362+0000 7fa055537800 4 Realm: () 2024-09-12T17:32:05.364 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.362+0000 7fa055537800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:32:05.364 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.362+0000 7fa055537800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:32:05.364 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.362+0000 7fa055537800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:32:05.364 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.362+0000 7fa055537800 20 zonegroup default 2024-09-12T17:32:05.365 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.362+0000 7fa055537800 20 rados->read ofs=0 len=0 2024-09-12T17:32:05.365 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.362+0000 7fa055537800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:05.365 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.362+0000 7fa055537800 20 rados->read ofs=0 len=0 2024-09-12T17:32:05.365 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.362+0000 7fa055537800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:05.365 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.362+0000 7fa055537800 20 rados->read ofs=0 len=0 2024-09-12T17:32:05.365 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.363+0000 7fa055537800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:05.365 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.363+0000 7fa055537800 20 started sync module instance, tier type = 2024-09-12T17:32:05.365 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.363+0000 7fa055537800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:32:05.373 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.373+0000 7fa055537800 20 add_watcher() i=0 2024-09-12T17:32:05.373 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.373+0000 7fa055537800 20 add_watcher() i=1 2024-09-12T17:32:05.373 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.373+0000 7fa055537800 20 add_watcher() i=2 2024-09-12T17:32:05.374 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.373+0000 7fa055537800 20 add_watcher() i=3 2024-09-12T17:32:05.374 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.373+0000 7fa055537800 20 add_watcher() i=4 2024-09-12T17:32:05.374 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.373+0000 7fa055537800 20 add_watcher() i=5 2024-09-12T17:32:05.374 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.373+0000 7fa055537800 20 add_watcher() i=6 2024-09-12T17:32:05.374 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.374+0000 7fa055537800 20 add_watcher() i=7 2024-09-12T17:32:05.374 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.374+0000 7fa055537800 2 all 8 watchers are set, enabling cache 2024-09-12T17:32:05.376 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.375+0000 7f9f077e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:32:05.377 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.376+0000 7fa055537800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:32:05.378 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.376+0000 7fa055537800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:32:05.378 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.376+0000 7fa055537800 5 note: GC not initialized 2024-09-12T17:32:05.378 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.376+0000 7f9f067e4640 20 reqs_thread_entry: start 2024-09-12T17:32:05.378 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.376+0000 7fa055537800 20 init_complete bucket index max shards: 11 2024-09-12T17:32:05.378 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.376+0000 7fa055537800 20 Filter name: none 2024-09-12T17:32:05.378 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.376+0000 7f9e77fff640 20 reqs_thread_entry: start 2024-09-12T17:32:05.378 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.376+0000 7fa055537800 20 rados->read ofs=0 len=0 2024-09-12T17:32:05.378 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.377+0000 7fa055537800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:32:05.379 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.377+0000 7fa055537800 20 rados->read ofs=0 len=0 2024-09-12T17:32:05.379 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.378+0000 7fa055537800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:32:05.379 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.378+0000 7fa055537800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:32:05.379 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.378+0000 7fa055537800 20 rados->read ofs=0 len=0 2024-09-12T17:32:05.380 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.379+0000 7fa055537800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:32:05.380 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.379+0000 7fa055537800 20 rados->read ofs=0 len=0 2024-09-12T17:32:05.380 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.379+0000 7fa055537800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:32:05.380 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.379+0000 7fa055537800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:32:05.382 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.381+0000 7f9f077e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:32:05.384 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.383+0000 7fa055537800 20 remove_watcher() i=0 2024-09-12T17:32:05.384 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.383+0000 7fa055537800 2 removed watcher, disabling cache 2024-09-12T17:32:05.385 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.384+0000 7fa055537800 20 remove_watcher() i=1 2024-09-12T17:32:05.386 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.385+0000 7fa055537800 20 remove_watcher() i=2 2024-09-12T17:32:05.387 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.387+0000 7fa055537800 20 remove_watcher() i=3 2024-09-12T17:32:05.389 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.388+0000 7fa055537800 20 remove_watcher() i=4 2024-09-12T17:32:05.390 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.389+0000 7fa055537800 20 remove_watcher() i=5 2024-09-12T17:32:05.390 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.390+0000 7fa055537800 20 remove_watcher() i=6 2024-09-12T17:32:05.391 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:05.391+0000 7fa055537800 20 remove_watcher() i=7 2024-09-12T17:32:05.403 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:32:05.403 INFO:tasks.workunit.client.0.smithi037.stderr:BUCKET_STATS: 2024-09-12T17:32:05.403 INFO:tasks.workunit.client.0.smithi037.stderr:bucket: error-at-init-index id: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.21 num_objects: 20 size_kb: 1 num_shards: 12 2024-09-12T17:32:05.403 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:32:05.764 INFO:tasks.workunit.client.0.smithi037.stderr:TEST: reshard bucket with abort at init_index 2024-09-12T17:32:05.764 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:32:06.556 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bucket stats --bucket abort-at-init-indext 2024-09-12T17:32:06.585 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:32:06.585 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:32:06.625 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:06.623+0000 7f5c8ad46800 20 rados->read ofs=0 len=0 2024-09-12T17:32:06.627 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:06.625+0000 7f5c8ad46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:06.627 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:06.625+0000 7f5c8ad46800 20 realm 2024-09-12T17:32:06.627 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:06.625+0000 7f5c8ad46800 20 rados->read ofs=0 len=0 2024-09-12T17:32:06.627 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:06.625+0000 7f5c8ad46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:06.627 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:06.625+0000 7f5c8ad46800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:32:06.627 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:06.625+0000 7f5c8ad46800 20 rados->read ofs=0 len=0 2024-09-12T17:32:06.627 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:06.626+0000 7f5c8ad46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:06.627 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:06.626+0000 7f5c8ad46800 20 rados->read ofs=0 len=0 2024-09-12T17:32:06.628 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:06.626+0000 7f5c8ad46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:06.628 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:06.626+0000 7f5c8ad46800 20 rados->read ofs=0 len=0 2024-09-12T17:32:06.630 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:06.627+0000 7f5c8ad46800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:32:06.630 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:06.627+0000 7f5c8ad46800 20 searching for the correct realm 2024-09-12T17:32:06.631 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:06.630+0000 7f5c89031640 0 -- 172.21.15.37:0/3489410557 >> [v2:172.21.15.40:6818/1210108009,v1:172.21.15.40:6819/1210108009] conn(0x7f5c740890d0 msgr2=0x7f5c740698d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:32:06.635 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:06.634+0000 7f5c88830640 0 -- 172.21.15.37:0/3489410557 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7f5c7407cb90 msgr2=0x7f5c74087430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:32:06.842 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:06.841+0000 7f5c8ad46800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:32:06.843 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:06.841+0000 7f5c8ad46800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:32:06.843 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:06.841+0000 7f5c8ad46800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:32:06.843 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:06.841+0000 7f5c8ad46800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:32:06.843 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:06.841+0000 7f5c8ad46800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:32:06.843 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:06.841+0000 7f5c8ad46800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:32:06.843 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:06.841+0000 7f5c8ad46800 20 rados->read ofs=0 len=0 2024-09-12T17:32:06.843 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:06.841+0000 7f5c8ad46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:06.843 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:06.841+0000 7f5c8ad46800 20 rados->read ofs=0 len=0 2024-09-12T17:32:06.844 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:06.841+0000 7f5c8ad46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:06.844 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:06.841+0000 7f5c8ad46800 20 rados->read ofs=0 len=0 2024-09-12T17:32:06.845 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:06.842+0000 7f5c8ad46800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:32:06.845 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:06.842+0000 7f5c8ad46800 20 zone default found 2024-09-12T17:32:06.845 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:06.842+0000 7f5c8ad46800 4 Realm: () 2024-09-12T17:32:06.845 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:06.842+0000 7f5c8ad46800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:32:06.845 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:06.842+0000 7f5c8ad46800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:32:06.845 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:06.842+0000 7f5c8ad46800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:32:06.845 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:06.842+0000 7f5c8ad46800 20 zonegroup default 2024-09-12T17:32:06.845 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:06.842+0000 7f5c8ad46800 20 rados->read ofs=0 len=0 2024-09-12T17:32:06.845 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:06.842+0000 7f5c8ad46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:06.845 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:06.842+0000 7f5c8ad46800 20 rados->read ofs=0 len=0 2024-09-12T17:32:06.845 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:06.843+0000 7f5c8ad46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:06.846 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:06.843+0000 7f5c8ad46800 20 rados->read ofs=0 len=0 2024-09-12T17:32:06.846 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:06.843+0000 7f5c8ad46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:06.846 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:06.843+0000 7f5c8ad46800 20 started sync module instance, tier type = 2024-09-12T17:32:06.846 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:06.843+0000 7f5c8ad46800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:32:06.854 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:06.853+0000 7f5c8ad46800 20 add_watcher() i=0 2024-09-12T17:32:06.854 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:06.853+0000 7f5c8ad46800 20 add_watcher() i=1 2024-09-12T17:32:06.855 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:06.853+0000 7f5c8ad46800 20 add_watcher() i=2 2024-09-12T17:32:06.855 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:06.853+0000 7f5c8ad46800 20 add_watcher() i=3 2024-09-12T17:32:06.855 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:06.853+0000 7f5c8ad46800 20 add_watcher() i=4 2024-09-12T17:32:06.855 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:06.853+0000 7f5c8ad46800 20 add_watcher() i=5 2024-09-12T17:32:06.855 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:06.853+0000 7f5c8ad46800 20 add_watcher() i=6 2024-09-12T17:32:06.855 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:06.853+0000 7f5c8ad46800 20 add_watcher() i=7 2024-09-12T17:32:06.855 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:06.853+0000 7f5c8ad46800 2 all 8 watchers are set, enabling cache 2024-09-12T17:32:06.856 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:06.856+0000 7f5b3efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:32:06.858 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:06.856+0000 7f5c8ad46800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:32:06.858 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:06.856+0000 7f5c8ad46800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:32:06.858 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:06.856+0000 7f5c8ad46800 5 note: GC not initialized 2024-09-12T17:32:06.858 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:06.856+0000 7f5b3dfe3640 20 reqs_thread_entry: start 2024-09-12T17:32:06.858 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:06.856+0000 7f5c8ad46800 20 init_complete bucket index max shards: 11 2024-09-12T17:32:06.858 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:06.856+0000 7f5c8ad46800 20 Filter name: none 2024-09-12T17:32:06.858 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:06.856+0000 7f5aaf7fe640 20 reqs_thread_entry: start 2024-09-12T17:32:06.859 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:06.857+0000 7f5c8ad46800 20 rados->read ofs=0 len=0 2024-09-12T17:32:06.859 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:06.857+0000 7f5c8ad46800 20 rados_obj.operate() r=0 bl.length=212 2024-09-12T17:32:06.859 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:06.857+0000 7f5c8ad46800 20 rados->read ofs=0 len=0 2024-09-12T17:32:06.859 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:06.858+0000 7f5c8ad46800 20 rados_obj.operate() r=0 bl.length=434 2024-09-12T17:32:06.859 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:06.858+0000 7f5c8ad46800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:32:06.860 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:06.858+0000 7f5c8ad46800 20 rados->read ofs=0 len=0 2024-09-12T17:32:06.860 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:06.858+0000 7f5c8ad46800 20 rados_obj.operate() r=0 bl.length=212 2024-09-12T17:32:06.860 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:06.858+0000 7f5c8ad46800 20 rados->read ofs=0 len=0 2024-09-12T17:32:06.860 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:06.859+0000 7f5c8ad46800 20 rados_obj.operate() r=0 bl.length=434 2024-09-12T17:32:06.860 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:06.859+0000 7f5c8ad46800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:32:06.862 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:06.861+0000 7f5b3efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:32:06.864 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:06.863+0000 7f5c8ad46800 20 remove_watcher() i=0 2024-09-12T17:32:06.864 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:06.863+0000 7f5c8ad46800 2 removed watcher, disabling cache 2024-09-12T17:32:06.865 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:06.865+0000 7f5c8ad46800 20 remove_watcher() i=1 2024-09-12T17:32:06.866 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:06.866+0000 7f5c8ad46800 20 remove_watcher() i=2 2024-09-12T17:32:06.867 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:06.867+0000 7f5c8ad46800 20 remove_watcher() i=3 2024-09-12T17:32:06.869 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:06.868+0000 7f5c8ad46800 20 remove_watcher() i=4 2024-09-12T17:32:06.870 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:06.869+0000 7f5c8ad46800 20 remove_watcher() i=5 2024-09-12T17:32:06.871 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:06.870+0000 7f5c8ad46800 20 remove_watcher() i=6 2024-09-12T17:32:06.871 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:06.871+0000 7f5c8ad46800 20 remove_watcher() i=7 2024-09-12T17:32:06.883 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:32:06.883 INFO:tasks.workunit.client.0.smithi037.stderr:BUCKET_STATS: 2024-09-12T17:32:06.883 INFO:tasks.workunit.client.0.smithi037.stderr:bucket: abort-at-init-indext id: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.22 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:32:06.883 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:32:06.884 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bucket reshard --bucket abort-at-init-indext --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at init_index 2024-09-12T17:32:06.920 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:32:06.920 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:32:06.959 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:06.958+0000 7fc64febb800 20 rados->read ofs=0 len=0 2024-09-12T17:32:06.961 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:06.960+0000 7fc64febb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:06.961 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:06.960+0000 7fc64febb800 20 realm 2024-09-12T17:32:06.961 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:06.960+0000 7fc64febb800 20 rados->read ofs=0 len=0 2024-09-12T17:32:06.961 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:06.960+0000 7fc64febb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:06.961 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:06.960+0000 7fc64febb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:32:06.961 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:06.960+0000 7fc64febb800 20 rados->read ofs=0 len=0 2024-09-12T17:32:06.961 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:06.960+0000 7fc64febb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:06.962 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:06.960+0000 7fc64febb800 20 rados->read ofs=0 len=0 2024-09-12T17:32:06.963 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:06.961+0000 7fc64febb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:06.963 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:06.961+0000 7fc64febb800 20 rados->read ofs=0 len=0 2024-09-12T17:32:06.963 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:06.961+0000 7fc64febb800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:32:06.963 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:06.961+0000 7fc64febb800 20 searching for the correct realm 2024-09-12T17:32:06.965 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:06.964+0000 7fc64d1a4640 0 -- 172.21.15.37:0/2031873925 >> [v2:172.21.15.40:6800/2441293461,v1:172.21.15.40:6801/2441293461] conn(0x7fc64008f070 msgr2=0x7fc640067e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:32:06.969 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:06.968+0000 7fc64d9a5640 0 -- 172.21.15.37:0/2031873925 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7fc644072040 msgr2=0x7fc6440358a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:32:07.176 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.174+0000 7fc64febb800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:32:07.176 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.174+0000 7fc64febb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:32:07.176 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.174+0000 7fc64febb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:32:07.176 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.174+0000 7fc64febb800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:32:07.176 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.174+0000 7fc64febb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:32:07.176 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.174+0000 7fc64febb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:32:07.176 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.174+0000 7fc64febb800 20 rados->read ofs=0 len=0 2024-09-12T17:32:07.176 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.174+0000 7fc64febb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:07.177 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.174+0000 7fc64febb800 20 rados->read ofs=0 len=0 2024-09-12T17:32:07.178 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.175+0000 7fc64febb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:07.178 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.175+0000 7fc64febb800 20 rados->read ofs=0 len=0 2024-09-12T17:32:07.178 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.176+0000 7fc64febb800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:32:07.178 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.176+0000 7fc64febb800 20 zone default found 2024-09-12T17:32:07.178 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.176+0000 7fc64febb800 4 Realm: () 2024-09-12T17:32:07.179 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.176+0000 7fc64febb800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:32:07.179 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.176+0000 7fc64febb800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:32:07.179 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.176+0000 7fc64febb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:32:07.179 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.176+0000 7fc64febb800 20 zonegroup default 2024-09-12T17:32:07.179 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.176+0000 7fc64febb800 20 rados->read ofs=0 len=0 2024-09-12T17:32:07.179 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.176+0000 7fc64febb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:07.179 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.176+0000 7fc64febb800 20 rados->read ofs=0 len=0 2024-09-12T17:32:07.179 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.176+0000 7fc64febb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:07.179 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.176+0000 7fc64febb800 20 rados->read ofs=0 len=0 2024-09-12T17:32:07.179 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.176+0000 7fc64febb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:07.180 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.176+0000 7fc64febb800 20 started sync module instance, tier type = 2024-09-12T17:32:07.180 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.176+0000 7fc64febb800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:32:07.188 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.187+0000 7fc64febb800 20 add_watcher() i=0 2024-09-12T17:32:07.189 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.187+0000 7fc64febb800 20 add_watcher() i=1 2024-09-12T17:32:07.189 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.187+0000 7fc64febb800 20 add_watcher() i=2 2024-09-12T17:32:07.189 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.187+0000 7fc64febb800 20 add_watcher() i=3 2024-09-12T17:32:07.189 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.187+0000 7fc64febb800 20 add_watcher() i=4 2024-09-12T17:32:07.189 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.187+0000 7fc64febb800 20 add_watcher() i=5 2024-09-12T17:32:07.189 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.187+0000 7fc64febb800 20 add_watcher() i=6 2024-09-12T17:32:07.189 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.188+0000 7fc64febb800 20 add_watcher() i=7 2024-09-12T17:32:07.190 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.188+0000 7fc64febb800 2 all 8 watchers are set, enabling cache 2024-09-12T17:32:07.191 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.190+0000 7fc4ff7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:32:07.192 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.190+0000 7fc64febb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:32:07.192 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.190+0000 7fc64febb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:32:07.192 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.190+0000 7fc64febb800 5 note: GC not initialized 2024-09-12T17:32:07.192 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.191+0000 7fc4fe7fc640 20 reqs_thread_entry: start 2024-09-12T17:32:07.192 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.191+0000 7fc64febb800 20 init_complete bucket index max shards: 11 2024-09-12T17:32:07.193 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.191+0000 7fc64febb800 20 Filter name: none 2024-09-12T17:32:07.193 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.191+0000 7fc46ffff640 20 reqs_thread_entry: start 2024-09-12T17:32:07.193 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.191+0000 7fc64febb800 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-12T17:32:07.193 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.191+0000 7fc64febb800 20 rados->read ofs=0 len=0 2024-09-12T17:32:07.193 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.191+0000 7fc64febb800 20 rados_obj.operate() r=0 bl.length=212 2024-09-12T17:32:07.193 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.191+0000 7fc64febb800 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-12T17:32:07.193 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.191+0000 7fc64febb800 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-12T17:32:07.193 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.191+0000 7fc64febb800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.22 : miss 2024-09-12T17:32:07.193 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.191+0000 7fc64febb800 20 rados->read ofs=0 len=0 2024-09-12T17:32:07.194 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.192+0000 7fc64febb800 20 rados_obj.operate() r=0 bl.length=434 2024-09-12T17:32:07.194 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.192+0000 7fc64febb800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.22 info.flags=0x17 2024-09-12T17:32:07.194 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.192+0000 7fc64febb800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.22 to cache LRU end 2024-09-12T17:32:07.194 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.192+0000 7fc64febb800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:32:07.194 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.192+0000 7fc64febb800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:32:07.194 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.192+0000 7fc64febb800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.22 2024-09-12T17:32:07.195 INFO:tasks.workunit.client.0.smithi037.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fc64febb800 time 2024-09-12T17:32:07.194540+0000 2024-09-12T17:32:07.195 INFO:tasks.workunit.client.0.smithi037.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:32:07.195 INFO:tasks.workunit.client.0.smithi037.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:32:07.195 INFO:tasks.workunit.client.0.smithi037.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fc65338c71a] 2024-09-12T17:32:07.196 INFO:tasks.workunit.client.0.smithi037.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fc65338c8d8] 2024-09-12T17:32:07.196 INFO:tasks.workunit.client.0.smithi037.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561d8bf66841] 2024-09-12T17:32:07.196 INFO:tasks.workunit.client.0.smithi037.stderr: 4: radosgw-admin(+0xd73b64) [0x561d8c473b64] 2024-09-12T17:32:07.196 INFO:tasks.workunit.client.0.smithi037.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x561d8bf7650d] 2024-09-12T17:32:07.196 INFO:tasks.workunit.client.0.smithi037.stderr: 6: main() 2024-09-12T17:32:07.196 INFO:tasks.workunit.client.0.smithi037.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fc652029590] 2024-09-12T17:32:07.196 INFO:tasks.workunit.client.0.smithi037.stderr: 8: __libc_start_main() 2024-09-12T17:32:07.196 INFO:tasks.workunit.client.0.smithi037.stderr: 9: _start() 2024-09-12T17:32:07.196 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.194+0000 7fc64febb800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fc64febb800 time 2024-09-12T17:32:07.194540+0000 2024-09-12T17:32:07.196 INFO:tasks.workunit.client.0.smithi037.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:32:07.196 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:32:07.197 INFO:tasks.workunit.client.0.smithi037.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:32:07.197 INFO:tasks.workunit.client.0.smithi037.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fc65338c71a] 2024-09-12T17:32:07.197 INFO:tasks.workunit.client.0.smithi037.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fc65338c8d8] 2024-09-12T17:32:07.197 INFO:tasks.workunit.client.0.smithi037.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561d8bf66841] 2024-09-12T17:32:07.197 INFO:tasks.workunit.client.0.smithi037.stderr: 4: radosgw-admin(+0xd73b64) [0x561d8c473b64] 2024-09-12T17:32:07.197 INFO:tasks.workunit.client.0.smithi037.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x561d8bf7650d] 2024-09-12T17:32:07.197 INFO:tasks.workunit.client.0.smithi037.stderr: 6: main() 2024-09-12T17:32:07.197 INFO:tasks.workunit.client.0.smithi037.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fc652029590] 2024-09-12T17:32:07.197 INFO:tasks.workunit.client.0.smithi037.stderr: 8: __libc_start_main() 2024-09-12T17:32:07.197 INFO:tasks.workunit.client.0.smithi037.stderr: 9: _start() 2024-09-12T17:32:07.197 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:32:07.197 INFO:tasks.workunit.client.0.smithi037.stderr:*** Caught signal (Aborted) ** 2024-09-12T17:32:07.197 INFO:tasks.workunit.client.0.smithi037.stderr: in thread 7fc64febb800 thread_name:radosgw-admin 2024-09-12T17:32:07.220 INFO:tasks.workunit.client.0.smithi037.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:32:07.221 INFO:tasks.workunit.client.0.smithi037.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fc65203e6f0] 2024-09-12T17:32:07.221 INFO:tasks.workunit.client.0.smithi037.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fc65208b99c] 2024-09-12T17:32:07.221 INFO:tasks.workunit.client.0.smithi037.stderr: 3: raise() 2024-09-12T17:32:07.221 INFO:tasks.workunit.client.0.smithi037.stderr: 4: abort() 2024-09-12T17:32:07.221 INFO:tasks.workunit.client.0.smithi037.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fc65338c774] 2024-09-12T17:32:07.221 INFO:tasks.workunit.client.0.smithi037.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fc65338c8d8] 2024-09-12T17:32:07.221 INFO:tasks.workunit.client.0.smithi037.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561d8bf66841] 2024-09-12T17:32:07.221 INFO:tasks.workunit.client.0.smithi037.stderr: 8: radosgw-admin(+0xd73b64) [0x561d8c473b64] 2024-09-12T17:32:07.221 INFO:tasks.workunit.client.0.smithi037.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x561d8bf7650d] 2024-09-12T17:32:07.221 INFO:tasks.workunit.client.0.smithi037.stderr: 10: main() 2024-09-12T17:32:07.222 INFO:tasks.workunit.client.0.smithi037.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fc652029590] 2024-09-12T17:32:07.222 INFO:tasks.workunit.client.0.smithi037.stderr: 12: __libc_start_main() 2024-09-12T17:32:07.222 INFO:tasks.workunit.client.0.smithi037.stderr: 13: _start() 2024-09-12T17:32:07.222 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.195+0000 7fc64febb800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:32:07.222 INFO:tasks.workunit.client.0.smithi037.stderr: in thread 7fc64febb800 thread_name:radosgw-admin 2024-09-12T17:32:07.222 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:32:07.222 INFO:tasks.workunit.client.0.smithi037.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:32:07.222 INFO:tasks.workunit.client.0.smithi037.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fc65203e6f0] 2024-09-12T17:32:07.222 INFO:tasks.workunit.client.0.smithi037.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fc65208b99c] 2024-09-12T17:32:07.222 INFO:tasks.workunit.client.0.smithi037.stderr: 3: raise() 2024-09-12T17:32:07.222 INFO:tasks.workunit.client.0.smithi037.stderr: 4: abort() 2024-09-12T17:32:07.223 INFO:tasks.workunit.client.0.smithi037.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fc65338c774] 2024-09-12T17:32:07.223 INFO:tasks.workunit.client.0.smithi037.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fc65338c8d8] 2024-09-12T17:32:07.223 INFO:tasks.workunit.client.0.smithi037.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561d8bf66841] 2024-09-12T17:32:07.223 INFO:tasks.workunit.client.0.smithi037.stderr: 8: radosgw-admin(+0xd73b64) [0x561d8c473b64] 2024-09-12T17:32:07.223 INFO:tasks.workunit.client.0.smithi037.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x561d8bf7650d] 2024-09-12T17:32:07.223 INFO:tasks.workunit.client.0.smithi037.stderr: 10: main() 2024-09-12T17:32:07.223 INFO:tasks.workunit.client.0.smithi037.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fc652029590] 2024-09-12T17:32:07.223 INFO:tasks.workunit.client.0.smithi037.stderr: 12: __libc_start_main() 2024-09-12T17:32:07.223 INFO:tasks.workunit.client.0.smithi037.stderr: 13: _start() 2024-09-12T17:32:07.223 INFO:tasks.workunit.client.0.smithi037.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:32:07.223 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:32:07.224 INFO:tasks.workunit.client.0.smithi037.stderr:--- begin dump of recent events --- 2024-09-12T17:32:07.224 INFO:tasks.workunit.client.0.smithi037.stderr: -499> 2024-09-12T17:32:06.940+0000 7fc64e1a6640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:32:07.224 INFO:tasks.workunit.client.0.smithi037.stderr: -498> 2024-09-12T17:32:06.940+0000 7fc64e1a6640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:32:07.224 INFO:tasks.workunit.client.0.smithi037.stderr: -497> 2024-09-12T17:32:06.940+0000 7fc64d1a4640 10 monclient(hunting): handle_auth_done global_id 6375 payload 274 2024-09-12T17:32:07.224 INFO:tasks.workunit.client.0.smithi037.stderr: -496> 2024-09-12T17:32:06.940+0000 7fc64d1a4640 10 monclient: _finish_hunting 0 2024-09-12T17:32:07.224 INFO:tasks.workunit.client.0.smithi037.stderr: -495> 2024-09-12T17:32:06.940+0000 7fc64d1a4640 1 monclient: found mon.noname-a 2024-09-12T17:32:07.224 INFO:tasks.workunit.client.0.smithi037.stderr: -494> 2024-09-12T17:32:06.940+0000 7fc64d1a4640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.37:3300/0 2024-09-12T17:32:07.224 INFO:tasks.workunit.client.0.smithi037.stderr: -493> 2024-09-12T17:32:06.940+0000 7fc53be07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:32:07.224 INFO:tasks.workunit.client.0.smithi037.stderr: -492> 2024-09-12T17:32:06.940+0000 7fc53be07640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:32:07.224 INFO:tasks.workunit.client.0.smithi037.stderr: -491> 2024-09-12T17:32:06.940+0000 7fc53be07640 10 monclient: dump: 2024-09-12T17:32:07.225 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:32:07.225 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:32:07.225 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:32:07.225 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:32:07.225 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:32:07.225 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:32:07.225 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:32:07.225 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:32:07.225 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:32:07.225 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:32:07.225 INFO:tasks.workunit.client.0.smithi037.stderr: -490> 2024-09-12T17:32:06.940+0000 7fc53be07640 10 monclient: _finish_auth 0 2024-09-12T17:32:07.226 INFO:tasks.workunit.client.0.smithi037.stderr: -489> 2024-09-12T17:32:06.940+0000 7fc53be07640 10 monclient: _check_auth_tickets 2024-09-12T17:32:07.226 INFO:tasks.workunit.client.0.smithi037.stderr: -488> 2024-09-12T17:32:06.940+0000 7fc53be07640 10 monclient: handle_config config(0 keys) 2024-09-12T17:32:07.226 INFO:tasks.workunit.client.0.smithi037.stderr: -487> 2024-09-12T17:32:06.940+0000 7fc64febb800 5 monclient: authenticate success, global_id 6375 2024-09-12T17:32:07.226 INFO:tasks.workunit.client.0.smithi037.stderr: -486> 2024-09-12T17:32:06.940+0000 7fc64febb800 10 monclient: get_monmap_and_config success 2024-09-12T17:32:07.226 INFO:tasks.workunit.client.0.smithi037.stderr: -485> 2024-09-12T17:32:06.940+0000 7fc64febb800 4 set_mon_vals no callback set 2024-09-12T17:32:07.226 INFO:tasks.workunit.client.0.smithi037.stderr: -484> 2024-09-12T17:32:06.940+0000 7fc53be07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:32:07.226 INFO:tasks.workunit.client.0.smithi037.stderr: -483> 2024-09-12T17:32:06.940+0000 7fc53be07640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:32:07.226 INFO:tasks.workunit.client.0.smithi037.stderr: -482> 2024-09-12T17:32:06.940+0000 7fc53be07640 10 monclient: dump: 2024-09-12T17:32:07.226 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:32:07.226 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:32:07.226 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:32:07.227 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:32:07.227 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:32:07.227 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:32:07.227 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:32:07.227 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:32:07.227 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:32:07.227 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:32:07.227 INFO:tasks.workunit.client.0.smithi037.stderr: -481> 2024-09-12T17:32:06.941+0000 7fc64febb800 10 monclient: shutdown 2024-09-12T17:32:07.227 INFO:tasks.workunit.client.0.smithi037.stderr: -480> 2024-09-12T17:32:06.941+0000 7fc64febb800 5 asok(0x561d8e107730) unregister_commands rotate-key 2024-09-12T17:32:07.227 INFO:tasks.workunit.client.0.smithi037.stderr: -479> 2024-09-12T17:32:06.941+0000 7fc64febb800 10 monclient: build_initial_monmap 2024-09-12T17:32:07.227 INFO:tasks.workunit.client.0.smithi037.stderr: -478> 2024-09-12T17:32:06.941+0000 7fc64febb800 1 build_initial for_mkfs: 0 2024-09-12T17:32:07.227 INFO:tasks.workunit.client.0.smithi037.stderr: -477> 2024-09-12T17:32:06.941+0000 7fc64febb800 10 monclient: monmap: 2024-09-12T17:32:07.228 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 0 2024-09-12T17:32:07.228 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:32:07.228 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 0.000000 2024-09-12T17:32:07.228 INFO:tasks.workunit.client.0.smithi037.stderr:created 0.000000 2024-09-12T17:32:07.228 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 0 (unknown) 2024-09-12T17:32:07.228 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:32:07.228 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.noname-a 2024-09-12T17:32:07.228 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.noname-b 2024-09-12T17:32:07.228 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.noname-c 2024-09-12T17:32:07.228 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:32:07.228 INFO:tasks.workunit.client.0.smithi037.stderr: -476> 2024-09-12T17:32:06.941+0000 7fc64febb800 5 AuthRegistry(0x561d8e32e220) adding auth protocol: cephx 2024-09-12T17:32:07.229 INFO:tasks.workunit.client.0.smithi037.stderr: -475> 2024-09-12T17:32:06.941+0000 7fc64febb800 5 AuthRegistry(0x561d8e32e220) adding auth protocol: cephx 2024-09-12T17:32:07.229 INFO:tasks.workunit.client.0.smithi037.stderr: -474> 2024-09-12T17:32:06.941+0000 7fc64febb800 5 AuthRegistry(0x561d8e32e220) adding auth protocol: cephx 2024-09-12T17:32:07.229 INFO:tasks.workunit.client.0.smithi037.stderr: -473> 2024-09-12T17:32:06.941+0000 7fc64febb800 5 AuthRegistry(0x561d8e32e220) adding con mode: secure 2024-09-12T17:32:07.229 INFO:tasks.workunit.client.0.smithi037.stderr: -472> 2024-09-12T17:32:06.941+0000 7fc64febb800 5 AuthRegistry(0x561d8e32e220) adding con mode: crc 2024-09-12T17:32:07.229 INFO:tasks.workunit.client.0.smithi037.stderr: -471> 2024-09-12T17:32:06.941+0000 7fc64febb800 5 AuthRegistry(0x561d8e32e220) adding con mode: secure 2024-09-12T17:32:07.229 INFO:tasks.workunit.client.0.smithi037.stderr: -470> 2024-09-12T17:32:06.941+0000 7fc64febb800 5 AuthRegistry(0x561d8e32e220) adding con mode: crc 2024-09-12T17:32:07.229 INFO:tasks.workunit.client.0.smithi037.stderr: -469> 2024-09-12T17:32:06.941+0000 7fc64febb800 5 AuthRegistry(0x561d8e32e220) adding con mode: secure 2024-09-12T17:32:07.229 INFO:tasks.workunit.client.0.smithi037.stderr: -468> 2024-09-12T17:32:06.941+0000 7fc64febb800 5 AuthRegistry(0x561d8e32e220) adding con mode: crc 2024-09-12T17:32:07.229 INFO:tasks.workunit.client.0.smithi037.stderr: -467> 2024-09-12T17:32:06.941+0000 7fc64febb800 5 AuthRegistry(0x561d8e32e220) adding con mode: crc 2024-09-12T17:32:07.229 INFO:tasks.workunit.client.0.smithi037.stderr: -466> 2024-09-12T17:32:06.941+0000 7fc64febb800 5 AuthRegistry(0x561d8e32e220) adding con mode: secure 2024-09-12T17:32:07.229 INFO:tasks.workunit.client.0.smithi037.stderr: -465> 2024-09-12T17:32:06.941+0000 7fc64febb800 5 AuthRegistry(0x561d8e32e220) adding con mode: crc 2024-09-12T17:32:07.230 INFO:tasks.workunit.client.0.smithi037.stderr: -464> 2024-09-12T17:32:06.941+0000 7fc64febb800 5 AuthRegistry(0x561d8e32e220) adding con mode: secure 2024-09-12T17:32:07.230 INFO:tasks.workunit.client.0.smithi037.stderr: -463> 2024-09-12T17:32:06.941+0000 7fc64febb800 5 AuthRegistry(0x561d8e32e220) adding con mode: crc 2024-09-12T17:32:07.230 INFO:tasks.workunit.client.0.smithi037.stderr: -462> 2024-09-12T17:32:06.941+0000 7fc64febb800 5 AuthRegistry(0x561d8e32e220) adding con mode: secure 2024-09-12T17:32:07.230 INFO:tasks.workunit.client.0.smithi037.stderr: -461> 2024-09-12T17:32:06.941+0000 7fc64febb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:32:07.230 INFO:tasks.workunit.client.0.smithi037.stderr: -460> 2024-09-12T17:32:06.941+0000 7fc64febb800 1 librados: starting msgr at 2024-09-12T17:32:07.230 INFO:tasks.workunit.client.0.smithi037.stderr: -459> 2024-09-12T17:32:06.941+0000 7fc64febb800 1 librados: starting objecter 2024-09-12T17:32:07.230 INFO:tasks.workunit.client.0.smithi037.stderr: -458> 2024-09-12T17:32:06.941+0000 7fc64febb800 5 asok(0x561d8e107730) register_command objecter_requests hook 0x561d8e32a140 2024-09-12T17:32:07.230 INFO:tasks.workunit.client.0.smithi037.stderr: -457> 2024-09-12T17:32:06.941+0000 7fc64febb800 1 librados: setting wanted keys 2024-09-12T17:32:07.230 INFO:tasks.workunit.client.0.smithi037.stderr: -456> 2024-09-12T17:32:06.941+0000 7fc64febb800 1 librados: calling monclient init 2024-09-12T17:32:07.230 INFO:tasks.workunit.client.0.smithi037.stderr: -455> 2024-09-12T17:32:06.941+0000 7fc64febb800 10 monclient: init 2024-09-12T17:32:07.231 INFO:tasks.workunit.client.0.smithi037.stderr: -454> 2024-09-12T17:32:06.941+0000 7fc64febb800 5 AuthRegistry(0x561d8e328c80) adding auth protocol: cephx 2024-09-12T17:32:07.231 INFO:tasks.workunit.client.0.smithi037.stderr: -453> 2024-09-12T17:32:06.941+0000 7fc64febb800 5 AuthRegistry(0x561d8e328c80) adding auth protocol: cephx 2024-09-12T17:32:07.231 INFO:tasks.workunit.client.0.smithi037.stderr: -452> 2024-09-12T17:32:06.941+0000 7fc64febb800 5 AuthRegistry(0x561d8e328c80) adding auth protocol: cephx 2024-09-12T17:32:07.231 INFO:tasks.workunit.client.0.smithi037.stderr: -451> 2024-09-12T17:32:06.941+0000 7fc64febb800 5 AuthRegistry(0x561d8e328c80) adding con mode: secure 2024-09-12T17:32:07.231 INFO:tasks.workunit.client.0.smithi037.stderr: -450> 2024-09-12T17:32:06.941+0000 7fc64febb800 5 AuthRegistry(0x561d8e328c80) adding con mode: crc 2024-09-12T17:32:07.231 INFO:tasks.workunit.client.0.smithi037.stderr: -449> 2024-09-12T17:32:06.941+0000 7fc64febb800 5 AuthRegistry(0x561d8e328c80) adding con mode: secure 2024-09-12T17:32:07.231 INFO:tasks.workunit.client.0.smithi037.stderr: -448> 2024-09-12T17:32:06.941+0000 7fc64febb800 5 AuthRegistry(0x561d8e328c80) adding con mode: crc 2024-09-12T17:32:07.231 INFO:tasks.workunit.client.0.smithi037.stderr: -447> 2024-09-12T17:32:06.941+0000 7fc64febb800 5 AuthRegistry(0x561d8e328c80) adding con mode: secure 2024-09-12T17:32:07.231 INFO:tasks.workunit.client.0.smithi037.stderr: -446> 2024-09-12T17:32:06.941+0000 7fc64febb800 5 AuthRegistry(0x561d8e328c80) adding con mode: crc 2024-09-12T17:32:07.231 INFO:tasks.workunit.client.0.smithi037.stderr: -445> 2024-09-12T17:32:06.941+0000 7fc64febb800 5 AuthRegistry(0x561d8e328c80) adding con mode: crc 2024-09-12T17:32:07.231 INFO:tasks.workunit.client.0.smithi037.stderr: -444> 2024-09-12T17:32:06.941+0000 7fc64febb800 5 AuthRegistry(0x561d8e328c80) adding con mode: secure 2024-09-12T17:32:07.231 INFO:tasks.workunit.client.0.smithi037.stderr: -443> 2024-09-12T17:32:06.941+0000 7fc64febb800 5 AuthRegistry(0x561d8e328c80) adding con mode: crc 2024-09-12T17:32:07.232 INFO:tasks.workunit.client.0.smithi037.stderr: -442> 2024-09-12T17:32:06.941+0000 7fc64febb800 5 AuthRegistry(0x561d8e328c80) adding con mode: secure 2024-09-12T17:32:07.232 INFO:tasks.workunit.client.0.smithi037.stderr: -441> 2024-09-12T17:32:06.941+0000 7fc64febb800 5 AuthRegistry(0x561d8e328c80) adding con mode: crc 2024-09-12T17:32:07.232 INFO:tasks.workunit.client.0.smithi037.stderr: -440> 2024-09-12T17:32:06.941+0000 7fc64febb800 5 AuthRegistry(0x561d8e328c80) adding con mode: secure 2024-09-12T17:32:07.232 INFO:tasks.workunit.client.0.smithi037.stderr: -439> 2024-09-12T17:32:06.942+0000 7fc64febb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:32:07.232 INFO:tasks.workunit.client.0.smithi037.stderr: -438> 2024-09-12T17:32:06.942+0000 7fc64febb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:32:07.232 INFO:tasks.workunit.client.0.smithi037.stderr: -437> 2024-09-12T17:32:06.942+0000 7fc64febb800 5 asok(0x561d8e107730) register_command rotate-key hook 0x561d8e328dc8 2024-09-12T17:32:07.232 INFO:tasks.workunit.client.0.smithi037.stderr: -436> 2024-09-12T17:32:06.942+0000 7fc64febb800 10 monclient: _reopen_session rank -1 2024-09-12T17:32:07.232 INFO:tasks.workunit.client.0.smithi037.stderr: -435> 2024-09-12T17:32:06.942+0000 7fc64febb800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T17:32:07.232 INFO:tasks.workunit.client.0.smithi037.stderr: -434> 2024-09-12T17:32:06.942+0000 7fc64febb800 10 monclient(hunting): picked mon.noname-c con 0x561d8e26ea40 addr [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] 2024-09-12T17:32:07.232 INFO:tasks.workunit.client.0.smithi037.stderr: -433> 2024-09-12T17:32:06.942+0000 7fc64febb800 10 monclient(hunting): picked mon.noname-a con 0x561d8e26ee20 addr [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] 2024-09-12T17:32:07.233 INFO:tasks.workunit.client.0.smithi037.stderr: -432> 2024-09-12T17:32:06.942+0000 7fc64febb800 10 monclient(hunting): picked mon.noname-b con 0x561d8e272380 addr [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] 2024-09-12T17:32:07.233 INFO:tasks.workunit.client.0.smithi037.stderr: -431> 2024-09-12T17:32:06.942+0000 7fc64febb800 10 monclient(hunting): start opening mon connection 2024-09-12T17:32:07.233 INFO:tasks.workunit.client.0.smithi037.stderr: -430> 2024-09-12T17:32:06.942+0000 7fc64febb800 10 monclient(hunting): start opening mon connection 2024-09-12T17:32:07.233 INFO:tasks.workunit.client.0.smithi037.stderr: -429> 2024-09-12T17:32:06.942+0000 7fc64febb800 10 monclient(hunting): start opening mon connection 2024-09-12T17:32:07.233 INFO:tasks.workunit.client.0.smithi037.stderr: -428> 2024-09-12T17:32:06.942+0000 7fc64febb800 10 monclient(hunting): _renew_subs 2024-09-12T17:32:07.233 INFO:tasks.workunit.client.0.smithi037.stderr: -427> 2024-09-12T17:32:06.942+0000 7fc64febb800 10 monclient(hunting): authenticate will time out at 2114.539481s 2024-09-12T17:32:07.233 INFO:tasks.workunit.client.0.smithi037.stderr: -426> 2024-09-12T17:32:06.942+0000 7fc64d9a5640 10 monclient(hunting): get_auth_request con 0x561d8e26ea40 auth_method 0 2024-09-12T17:32:07.233 INFO:tasks.workunit.client.0.smithi037.stderr: -425> 2024-09-12T17:32:06.942+0000 7fc64d9a5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:32:07.233 INFO:tasks.workunit.client.0.smithi037.stderr: -424> 2024-09-12T17:32:06.942+0000 7fc64d9a5640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:32:07.233 INFO:tasks.workunit.client.0.smithi037.stderr: -423> 2024-09-12T17:32:06.942+0000 7fc64d9a5640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:32:07.233 INFO:tasks.workunit.client.0.smithi037.stderr: -422> 2024-09-12T17:32:06.942+0000 7fc64d1a4640 10 monclient(hunting): get_auth_request con 0x561d8e26ee20 auth_method 0 2024-09-12T17:32:07.234 INFO:tasks.workunit.client.0.smithi037.stderr: -421> 2024-09-12T17:32:06.942+0000 7fc64d1a4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:32:07.234 INFO:tasks.workunit.client.0.smithi037.stderr: -420> 2024-09-12T17:32:06.942+0000 7fc64d1a4640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:32:07.234 INFO:tasks.workunit.client.0.smithi037.stderr: -419> 2024-09-12T17:32:06.942+0000 7fc64d1a4640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:32:07.234 INFO:tasks.workunit.client.0.smithi037.stderr: -418> 2024-09-12T17:32:06.942+0000 7fc64d9a5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:32:07.234 INFO:tasks.workunit.client.0.smithi037.stderr: -417> 2024-09-12T17:32:06.942+0000 7fc64d9a5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:32:07.234 INFO:tasks.workunit.client.0.smithi037.stderr: -416> 2024-09-12T17:32:06.942+0000 7fc64d9a5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:32:07.234 INFO:tasks.workunit.client.0.smithi037.stderr: -415> 2024-09-12T17:32:06.942+0000 7fc64d1a4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:32:07.234 INFO:tasks.workunit.client.0.smithi037.stderr: -414> 2024-09-12T17:32:06.942+0000 7fc64d1a4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:32:07.234 INFO:tasks.workunit.client.0.smithi037.stderr: -413> 2024-09-12T17:32:06.942+0000 7fc64d1a4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:32:07.234 INFO:tasks.workunit.client.0.smithi037.stderr: -412> 2024-09-12T17:32:06.942+0000 7fc64e1a6640 10 monclient(hunting): get_auth_request con 0x561d8e272380 auth_method 0 2024-09-12T17:32:07.234 INFO:tasks.workunit.client.0.smithi037.stderr: -411> 2024-09-12T17:32:06.942+0000 7fc64e1a6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:32:07.234 INFO:tasks.workunit.client.0.smithi037.stderr: -410> 2024-09-12T17:32:06.942+0000 7fc64e1a6640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:32:07.235 INFO:tasks.workunit.client.0.smithi037.stderr: -409> 2024-09-12T17:32:06.942+0000 7fc64e1a6640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:32:07.235 INFO:tasks.workunit.client.0.smithi037.stderr: -408> 2024-09-12T17:32:06.942+0000 7fc64d9a5640 10 monclient(hunting): handle_auth_done global_id 6044 payload 824 2024-09-12T17:32:07.235 INFO:tasks.workunit.client.0.smithi037.stderr: -407> 2024-09-12T17:32:06.942+0000 7fc64d9a5640 10 monclient: _finish_hunting 0 2024-09-12T17:32:07.235 INFO:tasks.workunit.client.0.smithi037.stderr: -406> 2024-09-12T17:32:06.942+0000 7fc64d9a5640 1 monclient: found mon.noname-c 2024-09-12T17:32:07.235 INFO:tasks.workunit.client.0.smithi037.stderr: -405> 2024-09-12T17:32:06.942+0000 7fc64d9a5640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.37:3301/0 2024-09-12T17:32:07.235 INFO:tasks.workunit.client.0.smithi037.stderr: -404> 2024-09-12T17:32:06.943+0000 7fc53a604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:32:07.235 INFO:tasks.workunit.client.0.smithi037.stderr: -403> 2024-09-12T17:32:06.943+0000 7fc53a604640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:32:07.235 INFO:tasks.workunit.client.0.smithi037.stderr: -402> 2024-09-12T17:32:06.943+0000 7fc53a604640 10 monclient: dump: 2024-09-12T17:32:07.235 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:32:07.235 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:32:07.235 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:32:07.235 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:32:07.235 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:32:07.236 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:32:07.236 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:32:07.236 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:32:07.236 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:32:07.236 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:32:07.236 INFO:tasks.workunit.client.0.smithi037.stderr: -401> 2024-09-12T17:32:06.943+0000 7fc53a604640 10 monclient: _finish_auth 0 2024-09-12T17:32:07.236 INFO:tasks.workunit.client.0.smithi037.stderr: -400> 2024-09-12T17:32:06.943+0000 7fc53a604640 10 monclient: _check_auth_tickets 2024-09-12T17:32:07.236 INFO:tasks.workunit.client.0.smithi037.stderr: -399> 2024-09-12T17:32:06.943+0000 7fc53a604640 10 monclient: handle_config config(0 keys) 2024-09-12T17:32:07.236 INFO:tasks.workunit.client.0.smithi037.stderr: -398> 2024-09-12T17:32:06.943+0000 7fc53a604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:32:07.236 INFO:tasks.workunit.client.0.smithi037.stderr: -397> 2024-09-12T17:32:06.943+0000 7fc53a604640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:32:07.236 INFO:tasks.workunit.client.0.smithi037.stderr: -396> 2024-09-12T17:32:06.943+0000 7fc53a604640 10 monclient: dump: 2024-09-12T17:32:07.237 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:32:07.237 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:32:07.237 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:32:07.237 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:32:07.237 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:32:07.237 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:32:07.237 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:32:07.237 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:32:07.237 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:32:07.237 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:32:07.237 INFO:tasks.workunit.client.0.smithi037.stderr: -395> 2024-09-12T17:32:06.943+0000 7fc64febb800 5 monclient: authenticate success, global_id 6044 2024-09-12T17:32:07.237 INFO:tasks.workunit.client.0.smithi037.stderr: -394> 2024-09-12T17:32:06.943+0000 7fc64febb800 10 monclient: _renew_subs 2024-09-12T17:32:07.237 INFO:tasks.workunit.client.0.smithi037.stderr: -393> 2024-09-12T17:32:06.943+0000 7fc64febb800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.37:3301/0 2024-09-12T17:32:07.238 INFO:tasks.workunit.client.0.smithi037.stderr: -392> 2024-09-12T17:32:06.943+0000 7fc53be07640 4 set_mon_vals no callback set 2024-09-12T17:32:07.238 INFO:tasks.workunit.client.0.smithi037.stderr: -391> 2024-09-12T17:32:06.943+0000 7fc64febb800 10 monclient: _renew_subs 2024-09-12T17:32:07.238 INFO:tasks.workunit.client.0.smithi037.stderr: -390> 2024-09-12T17:32:06.943+0000 7fc64febb800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.37:3301/0 2024-09-12T17:32:07.238 INFO:tasks.workunit.client.0.smithi037.stderr: -389> 2024-09-12T17:32:06.943+0000 7fc64febb800 1 librados: init done 2024-09-12T17:32:07.238 INFO:tasks.workunit.client.0.smithi037.stderr: -388> 2024-09-12T17:32:06.945+0000 7fc53a604640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:32:07.238 INFO:tasks.workunit.client.0.smithi037.stderr: -387> 2024-09-12T17:32:06.945+0000 7fc53a604640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.40:6816/3916250676,v1:172.21.15.40:6817/3916250676] 2024-09-12T17:32:07.238 INFO:tasks.workunit.client.0.smithi037.stderr: -386> 2024-09-12T17:32:06.945+0000 7fc53a604640 4 mgrc reconnect Starting new session with [v2:172.21.15.40:6816/3916250676,v1:172.21.15.40:6817/3916250676] 2024-09-12T17:32:07.238 INFO:tasks.workunit.client.0.smithi037.stderr: -385> 2024-09-12T17:32:06.945+0000 7fc64d1a4640 10 monclient: get_auth_request con 0x7fc5340764a0 auth_method 0 2024-09-12T17:32:07.238 INFO:tasks.workunit.client.0.smithi037.stderr: -384> 2024-09-12T17:32:06.945+0000 7fc64e1a6640 10 monclient: get_auth_request con 0x561d8e352670 auth_method 0 2024-09-12T17:32:07.238 INFO:tasks.workunit.client.0.smithi037.stderr: -383> 2024-09-12T17:32:06.946+0000 7fc64d9a5640 10 monclient: get_auth_request con 0x561d8e3751d0 auth_method 0 2024-09-12T17:32:07.238 INFO:tasks.workunit.client.0.smithi037.stderr: -382> 2024-09-12T17:32:06.947+0000 7fc64d1a4640 10 monclient: get_auth_request con 0x561d8e37a260 auth_method 0 2024-09-12T17:32:07.239 INFO:tasks.workunit.client.0.smithi037.stderr: -381> 2024-09-12T17:32:06.948+0000 7fc64febb800 10 monclient: build_initial_monmap 2024-09-12T17:32:07.239 INFO:tasks.workunit.client.0.smithi037.stderr: -380> 2024-09-12T17:32:06.948+0000 7fc64febb800 1 build_initial for_mkfs: 0 2024-09-12T17:32:07.239 INFO:tasks.workunit.client.0.smithi037.stderr: -379> 2024-09-12T17:32:06.948+0000 7fc64febb800 10 monclient: monmap: 2024-09-12T17:32:07.239 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 0 2024-09-12T17:32:07.239 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:32:07.239 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 0.000000 2024-09-12T17:32:07.239 INFO:tasks.workunit.client.0.smithi037.stderr:created 0.000000 2024-09-12T17:32:07.239 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 0 (unknown) 2024-09-12T17:32:07.239 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:32:07.239 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.noname-a 2024-09-12T17:32:07.239 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.noname-b 2024-09-12T17:32:07.240 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.noname-c 2024-09-12T17:32:07.240 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:32:07.240 INFO:tasks.workunit.client.0.smithi037.stderr: -378> 2024-09-12T17:32:06.948+0000 7fc64febb800 5 AuthRegistry(0x561d8e37e0e0) adding auth protocol: cephx 2024-09-12T17:32:07.240 INFO:tasks.workunit.client.0.smithi037.stderr: -377> 2024-09-12T17:32:06.948+0000 7fc64febb800 5 AuthRegistry(0x561d8e37e0e0) adding auth protocol: cephx 2024-09-12T17:32:07.240 INFO:tasks.workunit.client.0.smithi037.stderr: -376> 2024-09-12T17:32:06.948+0000 7fc64febb800 5 AuthRegistry(0x561d8e37e0e0) adding auth protocol: cephx 2024-09-12T17:32:07.240 INFO:tasks.workunit.client.0.smithi037.stderr: -375> 2024-09-12T17:32:06.948+0000 7fc64febb800 5 AuthRegistry(0x561d8e37e0e0) adding con mode: secure 2024-09-12T17:32:07.240 INFO:tasks.workunit.client.0.smithi037.stderr: -374> 2024-09-12T17:32:06.948+0000 7fc64febb800 5 AuthRegistry(0x561d8e37e0e0) adding con mode: crc 2024-09-12T17:32:07.240 INFO:tasks.workunit.client.0.smithi037.stderr: -373> 2024-09-12T17:32:06.948+0000 7fc64febb800 5 AuthRegistry(0x561d8e37e0e0) adding con mode: secure 2024-09-12T17:32:07.240 INFO:tasks.workunit.client.0.smithi037.stderr: -372> 2024-09-12T17:32:06.948+0000 7fc64febb800 5 AuthRegistry(0x561d8e37e0e0) adding con mode: crc 2024-09-12T17:32:07.240 INFO:tasks.workunit.client.0.smithi037.stderr: -371> 2024-09-12T17:32:06.948+0000 7fc64febb800 5 AuthRegistry(0x561d8e37e0e0) adding con mode: secure 2024-09-12T17:32:07.240 INFO:tasks.workunit.client.0.smithi037.stderr: -370> 2024-09-12T17:32:06.948+0000 7fc64febb800 5 AuthRegistry(0x561d8e37e0e0) adding con mode: crc 2024-09-12T17:32:07.241 INFO:tasks.workunit.client.0.smithi037.stderr: -369> 2024-09-12T17:32:06.948+0000 7fc64febb800 5 AuthRegistry(0x561d8e37e0e0) adding con mode: crc 2024-09-12T17:32:07.241 INFO:tasks.workunit.client.0.smithi037.stderr: -368> 2024-09-12T17:32:06.948+0000 7fc64febb800 5 AuthRegistry(0x561d8e37e0e0) adding con mode: secure 2024-09-12T17:32:07.241 INFO:tasks.workunit.client.0.smithi037.stderr: -367> 2024-09-12T17:32:06.948+0000 7fc64febb800 5 AuthRegistry(0x561d8e37e0e0) adding con mode: crc 2024-09-12T17:32:07.241 INFO:tasks.workunit.client.0.smithi037.stderr: -366> 2024-09-12T17:32:06.948+0000 7fc64febb800 5 AuthRegistry(0x561d8e37e0e0) adding con mode: secure 2024-09-12T17:32:07.241 INFO:tasks.workunit.client.0.smithi037.stderr: -365> 2024-09-12T17:32:06.948+0000 7fc64febb800 5 AuthRegistry(0x561d8e37e0e0) adding con mode: crc 2024-09-12T17:32:07.241 INFO:tasks.workunit.client.0.smithi037.stderr: -364> 2024-09-12T17:32:06.948+0000 7fc64febb800 5 AuthRegistry(0x561d8e37e0e0) adding con mode: secure 2024-09-12T17:32:07.241 INFO:tasks.workunit.client.0.smithi037.stderr: -363> 2024-09-12T17:32:06.949+0000 7fc64febb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:32:07.241 INFO:tasks.workunit.client.0.smithi037.stderr: -362> 2024-09-12T17:32:06.949+0000 7fc64febb800 5 asok(0x561d8e107730) register_command objecter_requests cmddesc objecter_requests hook 0x561d8e381590 EEXIST 2024-09-12T17:32:07.241 INFO:tasks.workunit.client.0.smithi037.stderr: -361> 2024-09-12T17:32:06.949+0000 7fc64febb800 10 monclient: init 2024-09-12T17:32:07.241 INFO:tasks.workunit.client.0.smithi037.stderr: -360> 2024-09-12T17:32:06.949+0000 7fc64febb800 5 AuthRegistry(0x561d8e37d098) adding auth protocol: cephx 2024-09-12T17:32:07.242 INFO:tasks.workunit.client.0.smithi037.stderr: -359> 2024-09-12T17:32:06.949+0000 7fc64febb800 5 AuthRegistry(0x561d8e37d098) adding auth protocol: cephx 2024-09-12T17:32:07.242 INFO:tasks.workunit.client.0.smithi037.stderr: -358> 2024-09-12T17:32:06.949+0000 7fc64febb800 5 AuthRegistry(0x561d8e37d098) adding auth protocol: cephx 2024-09-12T17:32:07.242 INFO:tasks.workunit.client.0.smithi037.stderr: -357> 2024-09-12T17:32:06.949+0000 7fc64febb800 5 AuthRegistry(0x561d8e37d098) adding con mode: secure 2024-09-12T17:32:07.242 INFO:tasks.workunit.client.0.smithi037.stderr: -356> 2024-09-12T17:32:06.949+0000 7fc64febb800 5 AuthRegistry(0x561d8e37d098) adding con mode: crc 2024-09-12T17:32:07.242 INFO:tasks.workunit.client.0.smithi037.stderr: -355> 2024-09-12T17:32:06.949+0000 7fc64febb800 5 AuthRegistry(0x561d8e37d098) adding con mode: secure 2024-09-12T17:32:07.242 INFO:tasks.workunit.client.0.smithi037.stderr: -354> 2024-09-12T17:32:06.949+0000 7fc64febb800 5 AuthRegistry(0x561d8e37d098) adding con mode: crc 2024-09-12T17:32:07.242 INFO:tasks.workunit.client.0.smithi037.stderr: -353> 2024-09-12T17:32:06.949+0000 7fc64febb800 5 AuthRegistry(0x561d8e37d098) adding con mode: secure 2024-09-12T17:32:07.242 INFO:tasks.workunit.client.0.smithi037.stderr: -352> 2024-09-12T17:32:06.949+0000 7fc64febb800 5 AuthRegistry(0x561d8e37d098) adding con mode: crc 2024-09-12T17:32:07.242 INFO:tasks.workunit.client.0.smithi037.stderr: -351> 2024-09-12T17:32:06.949+0000 7fc64febb800 5 AuthRegistry(0x561d8e37d098) adding con mode: crc 2024-09-12T17:32:07.242 INFO:tasks.workunit.client.0.smithi037.stderr: -350> 2024-09-12T17:32:06.949+0000 7fc64febb800 5 AuthRegistry(0x561d8e37d098) adding con mode: secure 2024-09-12T17:32:07.242 INFO:tasks.workunit.client.0.smithi037.stderr: -349> 2024-09-12T17:32:06.949+0000 7fc64febb800 5 AuthRegistry(0x561d8e37d098) adding con mode: crc 2024-09-12T17:32:07.242 INFO:tasks.workunit.client.0.smithi037.stderr: -348> 2024-09-12T17:32:06.949+0000 7fc64febb800 5 AuthRegistry(0x561d8e37d098) adding con mode: secure 2024-09-12T17:32:07.243 INFO:tasks.workunit.client.0.smithi037.stderr: -347> 2024-09-12T17:32:06.949+0000 7fc64febb800 5 AuthRegistry(0x561d8e37d098) adding con mode: crc 2024-09-12T17:32:07.243 INFO:tasks.workunit.client.0.smithi037.stderr: -346> 2024-09-12T17:32:06.949+0000 7fc64febb800 5 AuthRegistry(0x561d8e37d098) adding con mode: secure 2024-09-12T17:32:07.243 INFO:tasks.workunit.client.0.smithi037.stderr: -345> 2024-09-12T17:32:06.949+0000 7fc64febb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:32:07.243 INFO:tasks.workunit.client.0.smithi037.stderr: -344> 2024-09-12T17:32:06.949+0000 7fc64febb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:32:07.243 INFO:tasks.workunit.client.0.smithi037.stderr: -343> 2024-09-12T17:32:06.949+0000 7fc64febb800 5 asok(0x561d8e107730) register_command rotate-key cmddesc rotate-key hook 0x561d8e37d1e0 EEXIST 2024-09-12T17:32:07.243 INFO:tasks.workunit.client.0.smithi037.stderr: -342> 2024-09-12T17:32:06.949+0000 7fc64febb800 10 monclient: _reopen_session rank -1 2024-09-12T17:32:07.243 INFO:tasks.workunit.client.0.smithi037.stderr: -341> 2024-09-12T17:32:06.949+0000 7fc64febb800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T17:32:07.243 INFO:tasks.workunit.client.0.smithi037.stderr: -340> 2024-09-12T17:32:06.950+0000 7fc64febb800 10 monclient(hunting): picked mon.noname-b con 0x561d8e3a58b0 addr [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] 2024-09-12T17:32:07.243 INFO:tasks.workunit.client.0.smithi037.stderr: -339> 2024-09-12T17:32:06.950+0000 7fc64febb800 10 monclient(hunting): picked mon.noname-c con 0x561d8e3a5c90 addr [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] 2024-09-12T17:32:07.243 INFO:tasks.workunit.client.0.smithi037.stderr: -338> 2024-09-12T17:32:06.950+0000 7fc64febb800 10 monclient(hunting): picked mon.noname-a con 0x561d8e3a45c0 addr [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] 2024-09-12T17:32:07.244 INFO:tasks.workunit.client.0.smithi037.stderr: -337> 2024-09-12T17:32:06.950+0000 7fc64febb800 10 monclient(hunting): start opening mon connection 2024-09-12T17:32:07.244 INFO:tasks.workunit.client.0.smithi037.stderr: -336> 2024-09-12T17:32:06.950+0000 7fc64febb800 10 monclient(hunting): start opening mon connection 2024-09-12T17:32:07.244 INFO:tasks.workunit.client.0.smithi037.stderr: -335> 2024-09-12T17:32:06.950+0000 7fc64febb800 10 monclient(hunting): start opening mon connection 2024-09-12T17:32:07.244 INFO:tasks.workunit.client.0.smithi037.stderr: -334> 2024-09-12T17:32:06.950+0000 7fc64febb800 10 monclient(hunting): _renew_subs 2024-09-12T17:32:07.244 INFO:tasks.workunit.client.0.smithi037.stderr: -333> 2024-09-12T17:32:06.950+0000 7fc64febb800 10 monclient(hunting): authenticate will time out at 2114.547044s 2024-09-12T17:32:07.244 INFO:tasks.workunit.client.0.smithi037.stderr: -332> 2024-09-12T17:32:06.950+0000 7fc64d1a4640 10 monclient(hunting): get_auth_request con 0x561d8e3a5c90 auth_method 0 2024-09-12T17:32:07.244 INFO:tasks.workunit.client.0.smithi037.stderr: -331> 2024-09-12T17:32:06.950+0000 7fc64d1a4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:32:07.244 INFO:tasks.workunit.client.0.smithi037.stderr: -330> 2024-09-12T17:32:06.950+0000 7fc64d1a4640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:32:07.244 INFO:tasks.workunit.client.0.smithi037.stderr: -329> 2024-09-12T17:32:06.950+0000 7fc64d1a4640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:32:07.244 INFO:tasks.workunit.client.0.smithi037.stderr: -328> 2024-09-12T17:32:06.950+0000 7fc64e1a6640 10 monclient(hunting): get_auth_request con 0x561d8e3a45c0 auth_method 0 2024-09-12T17:32:07.244 INFO:tasks.workunit.client.0.smithi037.stderr: -327> 2024-09-12T17:32:06.950+0000 7fc64e1a6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:32:07.244 INFO:tasks.workunit.client.0.smithi037.stderr: -326> 2024-09-12T17:32:06.950+0000 7fc64e1a6640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:32:07.245 INFO:tasks.workunit.client.0.smithi037.stderr: -325> 2024-09-12T17:32:06.950+0000 7fc64e1a6640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:32:07.245 INFO:tasks.workunit.client.0.smithi037.stderr: -324> 2024-09-12T17:32:06.950+0000 7fc64d9a5640 10 monclient(hunting): get_auth_request con 0x561d8e3a58b0 auth_method 0 2024-09-12T17:32:07.245 INFO:tasks.workunit.client.0.smithi037.stderr: -323> 2024-09-12T17:32:06.950+0000 7fc64d9a5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:32:07.245 INFO:tasks.workunit.client.0.smithi037.stderr: -322> 2024-09-12T17:32:06.950+0000 7fc64d9a5640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:32:07.245 INFO:tasks.workunit.client.0.smithi037.stderr: -321> 2024-09-12T17:32:06.950+0000 7fc64d9a5640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:32:07.245 INFO:tasks.workunit.client.0.smithi037.stderr: -320> 2024-09-12T17:32:06.950+0000 7fc64d1a4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:32:07.245 INFO:tasks.workunit.client.0.smithi037.stderr: -319> 2024-09-12T17:32:06.950+0000 7fc64d1a4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:32:07.245 INFO:tasks.workunit.client.0.smithi037.stderr: -318> 2024-09-12T17:32:06.950+0000 7fc64d1a4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:32:07.245 INFO:tasks.workunit.client.0.smithi037.stderr: -317> 2024-09-12T17:32:06.950+0000 7fc64e1a6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:32:07.245 INFO:tasks.workunit.client.0.smithi037.stderr: -316> 2024-09-12T17:32:06.950+0000 7fc64e1a6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:32:07.246 INFO:tasks.workunit.client.0.smithi037.stderr: -315> 2024-09-12T17:32:06.950+0000 7fc64e1a6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:32:07.246 INFO:tasks.workunit.client.0.smithi037.stderr: -314> 2024-09-12T17:32:06.950+0000 7fc64d9a5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:32:07.246 INFO:tasks.workunit.client.0.smithi037.stderr: -313> 2024-09-12T17:32:06.950+0000 7fc64d9a5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:32:07.246 INFO:tasks.workunit.client.0.smithi037.stderr: -312> 2024-09-12T17:32:06.950+0000 7fc64d9a5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:32:07.246 INFO:tasks.workunit.client.0.smithi037.stderr: -311> 2024-09-12T17:32:06.950+0000 7fc64d1a4640 10 monclient(hunting): handle_auth_done global_id 6047 payload 824 2024-09-12T17:32:07.246 INFO:tasks.workunit.client.0.smithi037.stderr: -310> 2024-09-12T17:32:06.950+0000 7fc64d1a4640 10 monclient: _finish_hunting 0 2024-09-12T17:32:07.246 INFO:tasks.workunit.client.0.smithi037.stderr: -309> 2024-09-12T17:32:06.950+0000 7fc64d1a4640 1 monclient: found mon.noname-c 2024-09-12T17:32:07.246 INFO:tasks.workunit.client.0.smithi037.stderr: -308> 2024-09-12T17:32:06.950+0000 7fc64d1a4640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.37:3301/0 2024-09-12T17:32:07.246 INFO:tasks.workunit.client.0.smithi037.stderr: -307> 2024-09-12T17:32:06.950+0000 7fc5337fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:32:07.246 INFO:tasks.workunit.client.0.smithi037.stderr: -306> 2024-09-12T17:32:06.950+0000 7fc5337fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:32:07.246 INFO:tasks.workunit.client.0.smithi037.stderr: -305> 2024-09-12T17:32:06.950+0000 7fc5337fe640 10 monclient: dump: 2024-09-12T17:32:07.246 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:32:07.247 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:32:07.247 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:32:07.247 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:32:07.247 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:32:07.247 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:32:07.247 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:32:07.247 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:32:07.247 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:32:07.247 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:32:07.247 INFO:tasks.workunit.client.0.smithi037.stderr: -304> 2024-09-12T17:32:06.950+0000 7fc5337fe640 10 monclient: _finish_auth 0 2024-09-12T17:32:07.247 INFO:tasks.workunit.client.0.smithi037.stderr: -303> 2024-09-12T17:32:06.950+0000 7fc5337fe640 10 monclient: _check_auth_tickets 2024-09-12T17:32:07.248 INFO:tasks.workunit.client.0.smithi037.stderr: -302> 2024-09-12T17:32:06.950+0000 7fc64febb800 5 monclient: authenticate success, global_id 6047 2024-09-12T17:32:07.248 INFO:tasks.workunit.client.0.smithi037.stderr: -301> 2024-09-12T17:32:06.950+0000 7fc64febb800 10 monclient: _renew_subs 2024-09-12T17:32:07.248 INFO:tasks.workunit.client.0.smithi037.stderr: -300> 2024-09-12T17:32:06.950+0000 7fc64febb800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.37:3301/0 2024-09-12T17:32:07.248 INFO:tasks.workunit.client.0.smithi037.stderr: -299> 2024-09-12T17:32:06.950+0000 7fc5337fe640 10 monclient: handle_config config(0 keys) 2024-09-12T17:32:07.248 INFO:tasks.workunit.client.0.smithi037.stderr: -298> 2024-09-12T17:32:06.950+0000 7fc5337fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:32:07.248 INFO:tasks.workunit.client.0.smithi037.stderr: -297> 2024-09-12T17:32:06.950+0000 7fc5337fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:32:07.248 INFO:tasks.workunit.client.0.smithi037.stderr: -296> 2024-09-12T17:32:06.950+0000 7fc5337fe640 10 monclient: dump: 2024-09-12T17:32:07.248 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:32:07.248 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:32:07.248 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:32:07.248 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:32:07.249 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:32:07.249 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:32:07.249 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:32:07.249 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:32:07.249 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:32:07.249 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:32:07.249 INFO:tasks.workunit.client.0.smithi037.stderr: -295> 2024-09-12T17:32:06.950+0000 7fc64e9a7640 4 set_mon_vals no callback set 2024-09-12T17:32:07.249 INFO:tasks.workunit.client.0.smithi037.stderr: -294> 2024-09-12T17:32:06.950+0000 7fc64febb800 10 monclient: _renew_subs 2024-09-12T17:32:07.249 INFO:tasks.workunit.client.0.smithi037.stderr: -293> 2024-09-12T17:32:06.950+0000 7fc64febb800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.37:3301/0 2024-09-12T17:32:07.249 INFO:tasks.workunit.client.0.smithi037.stderr: -292> 2024-09-12T17:32:06.952+0000 7fc5337fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:32:07.249 INFO:tasks.workunit.client.0.smithi037.stderr: -291> 2024-09-12T17:32:06.952+0000 7fc5337fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.40:6816/3916250676,v1:172.21.15.40:6817/3916250676] 2024-09-12T17:32:07.250 INFO:tasks.workunit.client.0.smithi037.stderr: -290> 2024-09-12T17:32:06.952+0000 7fc5337fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.40:6816/3916250676,v1:172.21.15.40:6817/3916250676] 2024-09-12T17:32:07.250 INFO:tasks.workunit.client.0.smithi037.stderr: -289> 2024-09-12T17:32:06.953+0000 7fc64d9a5640 10 monclient: get_auth_request con 0x7fc528076380 auth_method 0 2024-09-12T17:32:07.250 INFO:tasks.workunit.client.0.smithi037.stderr: -288> 2024-09-12T17:32:06.953+0000 7fc64febb800 10 monclient: get_monmap_and_config 2024-09-12T17:32:07.250 INFO:tasks.workunit.client.0.smithi037.stderr: -287> 2024-09-12T17:32:06.953+0000 7fc64febb800 10 monclient: build_initial_monmap 2024-09-12T17:32:07.250 INFO:tasks.workunit.client.0.smithi037.stderr: -286> 2024-09-12T17:32:06.953+0000 7fc64febb800 1 build_initial for_mkfs: 0 2024-09-12T17:32:07.250 INFO:tasks.workunit.client.0.smithi037.stderr: -285> 2024-09-12T17:32:06.953+0000 7fc64febb800 10 monclient: monmap: 2024-09-12T17:32:07.250 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 0 2024-09-12T17:32:07.250 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:32:07.250 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 0.000000 2024-09-12T17:32:07.250 INFO:tasks.workunit.client.0.smithi037.stderr:created 0.000000 2024-09-12T17:32:07.250 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 0 (unknown) 2024-09-12T17:32:07.250 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:32:07.251 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.noname-a 2024-09-12T17:32:07.251 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.noname-b 2024-09-12T17:32:07.251 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.noname-c 2024-09-12T17:32:07.251 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:32:07.251 INFO:tasks.workunit.client.0.smithi037.stderr: -284> 2024-09-12T17:32:06.953+0000 7fc64febb800 5 AuthRegistry(0x561d8e3c5630) adding auth protocol: cephx 2024-09-12T17:32:07.251 INFO:tasks.workunit.client.0.smithi037.stderr: -283> 2024-09-12T17:32:06.953+0000 7fc64febb800 5 AuthRegistry(0x561d8e3c5630) adding auth protocol: cephx 2024-09-12T17:32:07.251 INFO:tasks.workunit.client.0.smithi037.stderr: -282> 2024-09-12T17:32:06.953+0000 7fc64febb800 5 AuthRegistry(0x561d8e3c5630) adding auth protocol: cephx 2024-09-12T17:32:07.251 INFO:tasks.workunit.client.0.smithi037.stderr: -281> 2024-09-12T17:32:06.953+0000 7fc64febb800 5 AuthRegistry(0x561d8e3c5630) adding con mode: secure 2024-09-12T17:32:07.251 INFO:tasks.workunit.client.0.smithi037.stderr: -280> 2024-09-12T17:32:06.953+0000 7fc64febb800 5 AuthRegistry(0x561d8e3c5630) adding con mode: crc 2024-09-12T17:32:07.251 INFO:tasks.workunit.client.0.smithi037.stderr: -279> 2024-09-12T17:32:06.953+0000 7fc64febb800 5 AuthRegistry(0x561d8e3c5630) adding con mode: secure 2024-09-12T17:32:07.251 INFO:tasks.workunit.client.0.smithi037.stderr: -278> 2024-09-12T17:32:06.953+0000 7fc64febb800 5 AuthRegistry(0x561d8e3c5630) adding con mode: crc 2024-09-12T17:32:07.251 INFO:tasks.workunit.client.0.smithi037.stderr: -277> 2024-09-12T17:32:06.953+0000 7fc64febb800 5 AuthRegistry(0x561d8e3c5630) adding con mode: secure 2024-09-12T17:32:07.252 INFO:tasks.workunit.client.0.smithi037.stderr: -276> 2024-09-12T17:32:06.953+0000 7fc64febb800 5 AuthRegistry(0x561d8e3c5630) adding con mode: crc 2024-09-12T17:32:07.252 INFO:tasks.workunit.client.0.smithi037.stderr: -275> 2024-09-12T17:32:06.953+0000 7fc64febb800 5 AuthRegistry(0x561d8e3c5630) adding con mode: crc 2024-09-12T17:32:07.252 INFO:tasks.workunit.client.0.smithi037.stderr: -274> 2024-09-12T17:32:06.953+0000 7fc64febb800 5 AuthRegistry(0x561d8e3c5630) adding con mode: secure 2024-09-12T17:32:07.252 INFO:tasks.workunit.client.0.smithi037.stderr: -273> 2024-09-12T17:32:06.953+0000 7fc64febb800 5 AuthRegistry(0x561d8e3c5630) adding con mode: crc 2024-09-12T17:32:07.252 INFO:tasks.workunit.client.0.smithi037.stderr: -272> 2024-09-12T17:32:06.953+0000 7fc64febb800 5 AuthRegistry(0x561d8e3c5630) adding con mode: secure 2024-09-12T17:32:07.252 INFO:tasks.workunit.client.0.smithi037.stderr: -271> 2024-09-12T17:32:06.953+0000 7fc64febb800 5 AuthRegistry(0x561d8e3c5630) adding con mode: crc 2024-09-12T17:32:07.252 INFO:tasks.workunit.client.0.smithi037.stderr: -270> 2024-09-12T17:32:06.953+0000 7fc64febb800 5 AuthRegistry(0x561d8e3c5630) adding con mode: secure 2024-09-12T17:32:07.252 INFO:tasks.workunit.client.0.smithi037.stderr: -269> 2024-09-12T17:32:06.953+0000 7fc64febb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:32:07.252 INFO:tasks.workunit.client.0.smithi037.stderr: -268> 2024-09-12T17:32:06.953+0000 7fc64febb800 10 monclient: init 2024-09-12T17:32:07.252 INFO:tasks.workunit.client.0.smithi037.stderr: -267> 2024-09-12T17:32:06.953+0000 7fc64febb800 5 AuthRegistry(0x7fff10c4d030) adding auth protocol: cephx 2024-09-12T17:32:07.252 INFO:tasks.workunit.client.0.smithi037.stderr: -266> 2024-09-12T17:32:06.953+0000 7fc64febb800 5 AuthRegistry(0x7fff10c4d030) adding auth protocol: cephx 2024-09-12T17:32:07.253 INFO:tasks.workunit.client.0.smithi037.stderr: -265> 2024-09-12T17:32:06.953+0000 7fc64febb800 5 AuthRegistry(0x7fff10c4d030) adding auth protocol: cephx 2024-09-12T17:32:07.253 INFO:tasks.workunit.client.0.smithi037.stderr: -264> 2024-09-12T17:32:06.953+0000 7fc64febb800 5 AuthRegistry(0x7fff10c4d030) adding con mode: secure 2024-09-12T17:32:07.253 INFO:tasks.workunit.client.0.smithi037.stderr: -263> 2024-09-12T17:32:06.953+0000 7fc64febb800 5 AuthRegistry(0x7fff10c4d030) adding con mode: crc 2024-09-12T17:32:07.253 INFO:tasks.workunit.client.0.smithi037.stderr: -262> 2024-09-12T17:32:06.953+0000 7fc64febb800 5 AuthRegistry(0x7fff10c4d030) adding con mode: secure 2024-09-12T17:32:07.253 INFO:tasks.workunit.client.0.smithi037.stderr: -261> 2024-09-12T17:32:06.953+0000 7fc64febb800 5 AuthRegistry(0x7fff10c4d030) adding con mode: crc 2024-09-12T17:32:07.253 INFO:tasks.workunit.client.0.smithi037.stderr: -260> 2024-09-12T17:32:06.953+0000 7fc64febb800 5 AuthRegistry(0x7fff10c4d030) adding con mode: secure 2024-09-12T17:32:07.253 INFO:tasks.workunit.client.0.smithi037.stderr: -259> 2024-09-12T17:32:06.953+0000 7fc64febb800 5 AuthRegistry(0x7fff10c4d030) adding con mode: crc 2024-09-12T17:32:07.253 INFO:tasks.workunit.client.0.smithi037.stderr: -258> 2024-09-12T17:32:06.953+0000 7fc64febb800 5 AuthRegistry(0x7fff10c4d030) adding con mode: crc 2024-09-12T17:32:07.253 INFO:tasks.workunit.client.0.smithi037.stderr: -257> 2024-09-12T17:32:06.953+0000 7fc64febb800 5 AuthRegistry(0x7fff10c4d030) adding con mode: secure 2024-09-12T17:32:07.253 INFO:tasks.workunit.client.0.smithi037.stderr: -256> 2024-09-12T17:32:06.953+0000 7fc64febb800 5 AuthRegistry(0x7fff10c4d030) adding con mode: crc 2024-09-12T17:32:07.253 INFO:tasks.workunit.client.0.smithi037.stderr: -255> 2024-09-12T17:32:06.953+0000 7fc64febb800 5 AuthRegistry(0x7fff10c4d030) adding con mode: secure 2024-09-12T17:32:07.253 INFO:tasks.workunit.client.0.smithi037.stderr: -254> 2024-09-12T17:32:06.953+0000 7fc64febb800 5 AuthRegistry(0x7fff10c4d030) adding con mode: crc 2024-09-12T17:32:07.254 INFO:tasks.workunit.client.0.smithi037.stderr: -253> 2024-09-12T17:32:06.953+0000 7fc64febb800 5 AuthRegistry(0x7fff10c4d030) adding con mode: secure 2024-09-12T17:32:07.254 INFO:tasks.workunit.client.0.smithi037.stderr: -252> 2024-09-12T17:32:06.953+0000 7fc64febb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:32:07.254 INFO:tasks.workunit.client.0.smithi037.stderr: -251> 2024-09-12T17:32:06.954+0000 7fc64febb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:32:07.254 INFO:tasks.workunit.client.0.smithi037.stderr: -250> 2024-09-12T17:32:06.954+0000 7fc64febb800 5 asok(0x561d8e107730) register_command rotate-key cmddesc rotate-key hook 0x7fff10c4d178 EEXIST 2024-09-12T17:32:07.254 INFO:tasks.workunit.client.0.smithi037.stderr: -249> 2024-09-12T17:32:06.954+0000 7fc64febb800 10 monclient: _reopen_session rank -1 2024-09-12T17:32:07.254 INFO:tasks.workunit.client.0.smithi037.stderr: -248> 2024-09-12T17:32:06.954+0000 7fc64febb800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T17:32:07.254 INFO:tasks.workunit.client.0.smithi037.stderr: -247> 2024-09-12T17:32:06.954+0000 7fc64febb800 10 monclient(hunting): picked mon.noname-c con 0x561d8e3f9bf0 addr [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] 2024-09-12T17:32:07.254 INFO:tasks.workunit.client.0.smithi037.stderr: -246> 2024-09-12T17:32:06.954+0000 7fc64febb800 10 monclient(hunting): picked mon.noname-a con 0x561d8e3ea880 addr [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] 2024-09-12T17:32:07.254 INFO:tasks.workunit.client.0.smithi037.stderr: -245> 2024-09-12T17:32:06.954+0000 7fc64febb800 10 monclient(hunting): picked mon.noname-b con 0x561d8e3f5020 addr [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] 2024-09-12T17:32:07.254 INFO:tasks.workunit.client.0.smithi037.stderr: -244> 2024-09-12T17:32:06.954+0000 7fc64febb800 10 monclient(hunting): start opening mon connection 2024-09-12T17:32:07.254 INFO:tasks.workunit.client.0.smithi037.stderr: -243> 2024-09-12T17:32:06.954+0000 7fc64febb800 10 monclient(hunting): start opening mon connection 2024-09-12T17:32:07.255 INFO:tasks.workunit.client.0.smithi037.stderr: -242> 2024-09-12T17:32:06.954+0000 7fc64febb800 10 monclient(hunting): start opening mon connection 2024-09-12T17:32:07.255 INFO:tasks.workunit.client.0.smithi037.stderr: -241> 2024-09-12T17:32:06.954+0000 7fc64febb800 10 monclient(hunting): _renew_subs 2024-09-12T17:32:07.255 INFO:tasks.workunit.client.0.smithi037.stderr: -240> 2024-09-12T17:32:06.954+0000 7fc64febb800 10 monclient(hunting): authenticate will time out at 2114.551262s 2024-09-12T17:32:07.255 INFO:tasks.workunit.client.0.smithi037.stderr: -239> 2024-09-12T17:32:06.954+0000 7fc64d1a4640 10 monclient(hunting): get_auth_request con 0x561d8e3ea880 auth_method 0 2024-09-12T17:32:07.255 INFO:tasks.workunit.client.0.smithi037.stderr: -238> 2024-09-12T17:32:06.954+0000 7fc64d1a4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:32:07.255 INFO:tasks.workunit.client.0.smithi037.stderr: -237> 2024-09-12T17:32:06.954+0000 7fc64d1a4640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:32:07.255 INFO:tasks.workunit.client.0.smithi037.stderr: -236> 2024-09-12T17:32:06.954+0000 7fc64d1a4640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:32:07.255 INFO:tasks.workunit.client.0.smithi037.stderr: -235> 2024-09-12T17:32:06.954+0000 7fc64d9a5640 10 monclient(hunting): get_auth_request con 0x561d8e3f9bf0 auth_method 0 2024-09-12T17:32:07.255 INFO:tasks.workunit.client.0.smithi037.stderr: -234> 2024-09-12T17:32:06.954+0000 7fc64d9a5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:32:07.255 INFO:tasks.workunit.client.0.smithi037.stderr: -233> 2024-09-12T17:32:06.954+0000 7fc64d9a5640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:32:07.255 INFO:tasks.workunit.client.0.smithi037.stderr: -232> 2024-09-12T17:32:06.954+0000 7fc64d9a5640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:32:07.256 INFO:tasks.workunit.client.0.smithi037.stderr: -231> 2024-09-12T17:32:06.954+0000 7fc64e1a6640 10 monclient(hunting): get_auth_request con 0x561d8e3f5020 auth_method 0 2024-09-12T17:32:07.256 INFO:tasks.workunit.client.0.smithi037.stderr: -230> 2024-09-12T17:32:06.954+0000 7fc64e1a6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:32:07.256 INFO:tasks.workunit.client.0.smithi037.stderr: -229> 2024-09-12T17:32:06.954+0000 7fc64e1a6640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:32:07.256 INFO:tasks.workunit.client.0.smithi037.stderr: -228> 2024-09-12T17:32:06.954+0000 7fc64e1a6640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:32:07.256 INFO:tasks.workunit.client.0.smithi037.stderr: -227> 2024-09-12T17:32:06.954+0000 7fc64d1a4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:32:07.256 INFO:tasks.workunit.client.0.smithi037.stderr: -226> 2024-09-12T17:32:06.954+0000 7fc64d1a4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:32:07.256 INFO:tasks.workunit.client.0.smithi037.stderr: -225> 2024-09-12T17:32:06.954+0000 7fc64d1a4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:32:07.256 INFO:tasks.workunit.client.0.smithi037.stderr: -224> 2024-09-12T17:32:06.954+0000 7fc64d9a5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:32:07.256 INFO:tasks.workunit.client.0.smithi037.stderr: -223> 2024-09-12T17:32:06.954+0000 7fc64d9a5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:32:07.256 INFO:tasks.workunit.client.0.smithi037.stderr: -222> 2024-09-12T17:32:06.954+0000 7fc64d9a5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:32:07.256 INFO:tasks.workunit.client.0.smithi037.stderr: -221> 2024-09-12T17:32:06.954+0000 7fc64e1a6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:32:07.256 INFO:tasks.workunit.client.0.smithi037.stderr: -220> 2024-09-12T17:32:06.954+0000 7fc64e1a6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:32:07.257 INFO:tasks.workunit.client.0.smithi037.stderr: -219> 2024-09-12T17:32:06.954+0000 7fc64e1a6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:32:07.257 INFO:tasks.workunit.client.0.smithi037.stderr: -218> 2024-09-12T17:32:06.954+0000 7fc64d1a4640 10 monclient(hunting): handle_auth_done global_id 6384 payload 274 2024-09-12T17:32:07.257 INFO:tasks.workunit.client.0.smithi037.stderr: -217> 2024-09-12T17:32:06.954+0000 7fc64d1a4640 10 monclient: _finish_hunting 0 2024-09-12T17:32:07.257 INFO:tasks.workunit.client.0.smithi037.stderr: -216> 2024-09-12T17:32:06.954+0000 7fc64d1a4640 1 monclient: found mon.noname-a 2024-09-12T17:32:07.257 INFO:tasks.workunit.client.0.smithi037.stderr: -215> 2024-09-12T17:32:06.954+0000 7fc64d1a4640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.37:3300/0 2024-09-12T17:32:07.257 INFO:tasks.workunit.client.0.smithi037.stderr: -214> 2024-09-12T17:32:06.954+0000 7fc5317fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:32:07.257 INFO:tasks.workunit.client.0.smithi037.stderr: -213> 2024-09-12T17:32:06.954+0000 7fc5317fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:32:07.257 INFO:tasks.workunit.client.0.smithi037.stderr: -212> 2024-09-12T17:32:06.954+0000 7fc5317fa640 10 monclient: dump: 2024-09-12T17:32:07.257 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:32:07.257 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:32:07.257 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:32:07.258 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:32:07.258 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:32:07.258 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:32:07.258 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:32:07.258 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:32:07.258 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:32:07.258 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:32:07.258 INFO:tasks.workunit.client.0.smithi037.stderr: -211> 2024-09-12T17:32:06.954+0000 7fc5317fa640 10 monclient: _finish_auth 0 2024-09-12T17:32:07.258 INFO:tasks.workunit.client.0.smithi037.stderr: -210> 2024-09-12T17:32:06.954+0000 7fc5317fa640 10 monclient: _check_auth_tickets 2024-09-12T17:32:07.258 INFO:tasks.workunit.client.0.smithi037.stderr: -209> 2024-09-12T17:32:06.954+0000 7fc5317fa640 10 monclient: handle_config config(0 keys) 2024-09-12T17:32:07.258 INFO:tasks.workunit.client.0.smithi037.stderr: -208> 2024-09-12T17:32:06.954+0000 7fc5317fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:32:07.258 INFO:tasks.workunit.client.0.smithi037.stderr: -207> 2024-09-12T17:32:06.954+0000 7fc5317fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:32:07.259 INFO:tasks.workunit.client.0.smithi037.stderr: -206> 2024-09-12T17:32:06.954+0000 7fc5317fa640 10 monclient: dump: 2024-09-12T17:32:07.259 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:32:07.259 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:32:07.259 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:32:07.259 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:32:07.259 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:32:07.259 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:32:07.259 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:32:07.259 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:32:07.259 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:32:07.259 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:32:07.260 INFO:tasks.workunit.client.0.smithi037.stderr: -205> 2024-09-12T17:32:06.954+0000 7fc64febb800 5 monclient: authenticate success, global_id 6384 2024-09-12T17:32:07.260 INFO:tasks.workunit.client.0.smithi037.stderr: -204> 2024-09-12T17:32:06.954+0000 7fc64febb800 10 monclient: get_monmap_and_config success 2024-09-12T17:32:07.260 INFO:tasks.workunit.client.0.smithi037.stderr: -203> 2024-09-12T17:32:06.954+0000 7fc64febb800 4 set_mon_vals no callback set 2024-09-12T17:32:07.260 INFO:tasks.workunit.client.0.smithi037.stderr: -202> 2024-09-12T17:32:06.955+0000 7fc64febb800 10 monclient: shutdown 2024-09-12T17:32:07.260 INFO:tasks.workunit.client.0.smithi037.stderr: -201> 2024-09-12T17:32:06.955+0000 7fc64febb800 10 monclient: build_initial_monmap 2024-09-12T17:32:07.260 INFO:tasks.workunit.client.0.smithi037.stderr: -200> 2024-09-12T17:32:06.955+0000 7fc64febb800 1 build_initial for_mkfs: 0 2024-09-12T17:32:07.260 INFO:tasks.workunit.client.0.smithi037.stderr: -199> 2024-09-12T17:32:06.955+0000 7fc64febb800 10 monclient: monmap: 2024-09-12T17:32:07.260 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 0 2024-09-12T17:32:07.260 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:32:07.260 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 0.000000 2024-09-12T17:32:07.260 INFO:tasks.workunit.client.0.smithi037.stderr:created 0.000000 2024-09-12T17:32:07.261 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 0 (unknown) 2024-09-12T17:32:07.261 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:32:07.261 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.noname-a 2024-09-12T17:32:07.261 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.noname-b 2024-09-12T17:32:07.261 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.noname-c 2024-09-12T17:32:07.261 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:32:07.261 INFO:tasks.workunit.client.0.smithi037.stderr: -198> 2024-09-12T17:32:06.955+0000 7fc64febb800 5 AuthRegistry(0x561d8e3f3d20) adding auth protocol: cephx 2024-09-12T17:32:07.261 INFO:tasks.workunit.client.0.smithi037.stderr: -197> 2024-09-12T17:32:06.955+0000 7fc64febb800 5 AuthRegistry(0x561d8e3f3d20) adding auth protocol: cephx 2024-09-12T17:32:07.261 INFO:tasks.workunit.client.0.smithi037.stderr: -196> 2024-09-12T17:32:06.955+0000 7fc64febb800 5 AuthRegistry(0x561d8e3f3d20) adding auth protocol: cephx 2024-09-12T17:32:07.261 INFO:tasks.workunit.client.0.smithi037.stderr: -195> 2024-09-12T17:32:06.955+0000 7fc64febb800 5 AuthRegistry(0x561d8e3f3d20) adding con mode: secure 2024-09-12T17:32:07.261 INFO:tasks.workunit.client.0.smithi037.stderr: -194> 2024-09-12T17:32:06.955+0000 7fc64febb800 5 AuthRegistry(0x561d8e3f3d20) adding con mode: crc 2024-09-12T17:32:07.261 INFO:tasks.workunit.client.0.smithi037.stderr: -193> 2024-09-12T17:32:06.955+0000 7fc64febb800 5 AuthRegistry(0x561d8e3f3d20) adding con mode: secure 2024-09-12T17:32:07.262 INFO:tasks.workunit.client.0.smithi037.stderr: -192> 2024-09-12T17:32:06.955+0000 7fc64febb800 5 AuthRegistry(0x561d8e3f3d20) adding con mode: crc 2024-09-12T17:32:07.262 INFO:tasks.workunit.client.0.smithi037.stderr: -191> 2024-09-12T17:32:06.955+0000 7fc64febb800 5 AuthRegistry(0x561d8e3f3d20) adding con mode: secure 2024-09-12T17:32:07.262 INFO:tasks.workunit.client.0.smithi037.stderr: -190> 2024-09-12T17:32:06.955+0000 7fc64febb800 5 AuthRegistry(0x561d8e3f3d20) adding con mode: crc 2024-09-12T17:32:07.262 INFO:tasks.workunit.client.0.smithi037.stderr: -189> 2024-09-12T17:32:06.955+0000 7fc64febb800 5 AuthRegistry(0x561d8e3f3d20) adding con mode: crc 2024-09-12T17:32:07.262 INFO:tasks.workunit.client.0.smithi037.stderr: -188> 2024-09-12T17:32:06.955+0000 7fc64febb800 5 AuthRegistry(0x561d8e3f3d20) adding con mode: secure 2024-09-12T17:32:07.262 INFO:tasks.workunit.client.0.smithi037.stderr: -187> 2024-09-12T17:32:06.955+0000 7fc64febb800 5 AuthRegistry(0x561d8e3f3d20) adding con mode: crc 2024-09-12T17:32:07.262 INFO:tasks.workunit.client.0.smithi037.stderr: -186> 2024-09-12T17:32:06.955+0000 7fc64febb800 5 AuthRegistry(0x561d8e3f3d20) adding con mode: secure 2024-09-12T17:32:07.262 INFO:tasks.workunit.client.0.smithi037.stderr: -185> 2024-09-12T17:32:06.955+0000 7fc64febb800 5 AuthRegistry(0x561d8e3f3d20) adding con mode: crc 2024-09-12T17:32:07.262 INFO:tasks.workunit.client.0.smithi037.stderr: -184> 2024-09-12T17:32:06.955+0000 7fc64febb800 5 AuthRegistry(0x561d8e3f3d20) adding con mode: secure 2024-09-12T17:32:07.262 INFO:tasks.workunit.client.0.smithi037.stderr: -183> 2024-09-12T17:32:06.955+0000 7fc64febb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:32:07.262 INFO:tasks.workunit.client.0.smithi037.stderr: -182> 2024-09-12T17:32:06.955+0000 7fc64febb800 1 librados: starting msgr at 2024-09-12T17:32:07.263 INFO:tasks.workunit.client.0.smithi037.stderr: -181> 2024-09-12T17:32:06.955+0000 7fc64febb800 1 librados: starting objecter 2024-09-12T17:32:07.263 INFO:tasks.workunit.client.0.smithi037.stderr: -180> 2024-09-12T17:32:06.955+0000 7fc64febb800 5 asok(0x561d8e107730) register_command objecter_requests cmddesc objecter_requests hook 0x561d8e3f6df0 EEXIST 2024-09-12T17:32:07.263 INFO:tasks.workunit.client.0.smithi037.stderr: -179> 2024-09-12T17:32:06.955+0000 7fc64febb800 1 librados: setting wanted keys 2024-09-12T17:32:07.263 INFO:tasks.workunit.client.0.smithi037.stderr: -178> 2024-09-12T17:32:06.955+0000 7fc64febb800 1 librados: calling monclient init 2024-09-12T17:32:07.263 INFO:tasks.workunit.client.0.smithi037.stderr: -177> 2024-09-12T17:32:06.955+0000 7fc64febb800 10 monclient: init 2024-09-12T17:32:07.263 INFO:tasks.workunit.client.0.smithi037.stderr: -176> 2024-09-12T17:32:06.955+0000 7fc64febb800 5 AuthRegistry(0x561d8e3ba170) adding auth protocol: cephx 2024-09-12T17:32:07.263 INFO:tasks.workunit.client.0.smithi037.stderr: -175> 2024-09-12T17:32:06.955+0000 7fc64febb800 5 AuthRegistry(0x561d8e3ba170) adding auth protocol: cephx 2024-09-12T17:32:07.264 INFO:tasks.workunit.client.0.smithi037.stderr: -174> 2024-09-12T17:32:06.956+0000 7fc64febb800 5 AuthRegistry(0x561d8e3ba170) adding auth protocol: cephx 2024-09-12T17:32:07.264 INFO:tasks.workunit.client.0.smithi037.stderr: -173> 2024-09-12T17:32:06.956+0000 7fc64febb800 5 AuthRegistry(0x561d8e3ba170) adding con mode: secure 2024-09-12T17:32:07.264 INFO:tasks.workunit.client.0.smithi037.stderr: -172> 2024-09-12T17:32:06.956+0000 7fc64febb800 5 AuthRegistry(0x561d8e3ba170) adding con mode: crc 2024-09-12T17:32:07.264 INFO:tasks.workunit.client.0.smithi037.stderr: -171> 2024-09-12T17:32:06.956+0000 7fc64febb800 5 AuthRegistry(0x561d8e3ba170) adding con mode: secure 2024-09-12T17:32:07.264 INFO:tasks.workunit.client.0.smithi037.stderr: -170> 2024-09-12T17:32:06.956+0000 7fc64febb800 5 AuthRegistry(0x561d8e3ba170) adding con mode: crc 2024-09-12T17:32:07.264 INFO:tasks.workunit.client.0.smithi037.stderr: -169> 2024-09-12T17:32:06.956+0000 7fc64febb800 5 AuthRegistry(0x561d8e3ba170) adding con mode: secure 2024-09-12T17:32:07.264 INFO:tasks.workunit.client.0.smithi037.stderr: -168> 2024-09-12T17:32:06.956+0000 7fc64febb800 5 AuthRegistry(0x561d8e3ba170) adding con mode: crc 2024-09-12T17:32:07.264 INFO:tasks.workunit.client.0.smithi037.stderr: -167> 2024-09-12T17:32:06.956+0000 7fc64febb800 5 AuthRegistry(0x561d8e3ba170) adding con mode: crc 2024-09-12T17:32:07.264 INFO:tasks.workunit.client.0.smithi037.stderr: -166> 2024-09-12T17:32:06.956+0000 7fc64febb800 5 AuthRegistry(0x561d8e3ba170) adding con mode: secure 2024-09-12T17:32:07.264 INFO:tasks.workunit.client.0.smithi037.stderr: -165> 2024-09-12T17:32:06.956+0000 7fc64febb800 5 AuthRegistry(0x561d8e3ba170) adding con mode: crc 2024-09-12T17:32:07.264 INFO:tasks.workunit.client.0.smithi037.stderr: -164> 2024-09-12T17:32:06.956+0000 7fc64febb800 5 AuthRegistry(0x561d8e3ba170) adding con mode: secure 2024-09-12T17:32:07.265 INFO:tasks.workunit.client.0.smithi037.stderr: -163> 2024-09-12T17:32:06.956+0000 7fc64febb800 5 AuthRegistry(0x561d8e3ba170) adding con mode: crc 2024-09-12T17:32:07.265 INFO:tasks.workunit.client.0.smithi037.stderr: -162> 2024-09-12T17:32:06.956+0000 7fc64febb800 5 AuthRegistry(0x561d8e3ba170) adding con mode: secure 2024-09-12T17:32:07.265 INFO:tasks.workunit.client.0.smithi037.stderr: -161> 2024-09-12T17:32:06.956+0000 7fc64febb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:32:07.265 INFO:tasks.workunit.client.0.smithi037.stderr: -160> 2024-09-12T17:32:06.956+0000 7fc64febb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:32:07.265 INFO:tasks.workunit.client.0.smithi037.stderr: -159> 2024-09-12T17:32:06.956+0000 7fc64febb800 5 asok(0x561d8e107730) register_command rotate-key cmddesc rotate-key hook 0x561d8e3ba2b8 EEXIST 2024-09-12T17:32:07.265 INFO:tasks.workunit.client.0.smithi037.stderr: -158> 2024-09-12T17:32:06.956+0000 7fc64febb800 10 monclient: _reopen_session rank -1 2024-09-12T17:32:07.265 INFO:tasks.workunit.client.0.smithi037.stderr: -157> 2024-09-12T17:32:06.956+0000 7fc64febb800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T17:32:07.265 INFO:tasks.workunit.client.0.smithi037.stderr: -156> 2024-09-12T17:32:06.956+0000 7fc64febb800 10 monclient(hunting): picked mon.noname-c con 0x561d8e3ea880 addr [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] 2024-09-12T17:32:07.265 INFO:tasks.workunit.client.0.smithi037.stderr: -155> 2024-09-12T17:32:06.956+0000 7fc64febb800 10 monclient(hunting): picked mon.noname-b con 0x561d8e3f5020 addr [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] 2024-09-12T17:32:07.265 INFO:tasks.workunit.client.0.smithi037.stderr: -154> 2024-09-12T17:32:06.956+0000 7fc64febb800 10 monclient(hunting): picked mon.noname-a con 0x561d8e3f9bf0 addr [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] 2024-09-12T17:32:07.265 INFO:tasks.workunit.client.0.smithi037.stderr: -153> 2024-09-12T17:32:06.956+0000 7fc64febb800 10 monclient(hunting): start opening mon connection 2024-09-12T17:32:07.265 INFO:tasks.workunit.client.0.smithi037.stderr: -152> 2024-09-12T17:32:06.956+0000 7fc64febb800 10 monclient(hunting): start opening mon connection 2024-09-12T17:32:07.266 INFO:tasks.workunit.client.0.smithi037.stderr: -151> 2024-09-12T17:32:06.956+0000 7fc64febb800 10 monclient(hunting): start opening mon connection 2024-09-12T17:32:07.266 INFO:tasks.workunit.client.0.smithi037.stderr: -150> 2024-09-12T17:32:06.956+0000 7fc64febb800 10 monclient(hunting): _renew_subs 2024-09-12T17:32:07.266 INFO:tasks.workunit.client.0.smithi037.stderr: -149> 2024-09-12T17:32:06.956+0000 7fc64febb800 10 monclient(hunting): authenticate will time out at 2114.553529s 2024-09-12T17:32:07.266 INFO:tasks.workunit.client.0.smithi037.stderr: -148> 2024-09-12T17:32:06.956+0000 7fc64d9a5640 10 monclient(hunting): get_auth_request con 0x561d8e3ea880 auth_method 0 2024-09-12T17:32:07.266 INFO:tasks.workunit.client.0.smithi037.stderr: -147> 2024-09-12T17:32:06.956+0000 7fc64d9a5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:32:07.266 INFO:tasks.workunit.client.0.smithi037.stderr: -146> 2024-09-12T17:32:06.956+0000 7fc64d9a5640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:32:07.266 INFO:tasks.workunit.client.0.smithi037.stderr: -145> 2024-09-12T17:32:06.956+0000 7fc64d9a5640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:32:07.266 INFO:tasks.workunit.client.0.smithi037.stderr: -144> 2024-09-12T17:32:06.956+0000 7fc64e1a6640 10 monclient(hunting): get_auth_request con 0x561d8e3f9bf0 auth_method 0 2024-09-12T17:32:07.266 INFO:tasks.workunit.client.0.smithi037.stderr: -143> 2024-09-12T17:32:06.956+0000 7fc64e1a6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:32:07.266 INFO:tasks.workunit.client.0.smithi037.stderr: -142> 2024-09-12T17:32:06.956+0000 7fc64e1a6640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:32:07.266 INFO:tasks.workunit.client.0.smithi037.stderr: -141> 2024-09-12T17:32:06.956+0000 7fc64e1a6640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:32:07.266 INFO:tasks.workunit.client.0.smithi037.stderr: -140> 2024-09-12T17:32:06.956+0000 7fc64d9a5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:32:07.267 INFO:tasks.workunit.client.0.smithi037.stderr: -139> 2024-09-12T17:32:06.956+0000 7fc64d9a5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:32:07.267 INFO:tasks.workunit.client.0.smithi037.stderr: -138> 2024-09-12T17:32:06.956+0000 7fc64d9a5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:32:07.267 INFO:tasks.workunit.client.0.smithi037.stderr: -137> 2024-09-12T17:32:06.956+0000 7fc64e1a6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:32:07.267 INFO:tasks.workunit.client.0.smithi037.stderr: -136> 2024-09-12T17:32:06.956+0000 7fc64e1a6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:32:07.267 INFO:tasks.workunit.client.0.smithi037.stderr: -135> 2024-09-12T17:32:06.956+0000 7fc64e1a6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:32:07.267 INFO:tasks.workunit.client.0.smithi037.stderr: -134> 2024-09-12T17:32:06.956+0000 7fc64d9a5640 10 monclient(hunting): handle_auth_done global_id 6053 payload 824 2024-09-12T17:32:07.267 INFO:tasks.workunit.client.0.smithi037.stderr: -133> 2024-09-12T17:32:06.956+0000 7fc64d9a5640 10 monclient: _finish_hunting 0 2024-09-12T17:32:07.267 INFO:tasks.workunit.client.0.smithi037.stderr: -132> 2024-09-12T17:32:06.956+0000 7fc64d9a5640 1 monclient: found mon.noname-c 2024-09-12T17:32:07.267 INFO:tasks.workunit.client.0.smithi037.stderr: -131> 2024-09-12T17:32:06.956+0000 7fc64d9a5640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.37:3301/0 2024-09-12T17:32:07.267 INFO:tasks.workunit.client.0.smithi037.stderr: -130> 2024-09-12T17:32:06.957+0000 7fc51f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:32:07.267 INFO:tasks.workunit.client.0.smithi037.stderr: -129> 2024-09-12T17:32:06.957+0000 7fc51f7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:32:07.267 INFO:tasks.workunit.client.0.smithi037.stderr: -128> 2024-09-12T17:32:06.957+0000 7fc51f7fe640 10 monclient: dump: 2024-09-12T17:32:07.268 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:32:07.268 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:32:07.268 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:32:07.268 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:32:07.268 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:32:07.268 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:32:07.268 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:32:07.268 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:32:07.268 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:32:07.268 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:32:07.268 INFO:tasks.workunit.client.0.smithi037.stderr: -127> 2024-09-12T17:32:06.957+0000 7fc51f7fe640 10 monclient: _finish_auth 0 2024-09-12T17:32:07.269 INFO:tasks.workunit.client.0.smithi037.stderr: -126> 2024-09-12T17:32:06.957+0000 7fc51f7fe640 10 monclient: _check_auth_tickets 2024-09-12T17:32:07.269 INFO:tasks.workunit.client.0.smithi037.stderr: -125> 2024-09-12T17:32:06.957+0000 7fc51f7fe640 10 monclient: handle_config config(0 keys) 2024-09-12T17:32:07.269 INFO:tasks.workunit.client.0.smithi037.stderr: -124> 2024-09-12T17:32:06.957+0000 7fc51f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:32:07.269 INFO:tasks.workunit.client.0.smithi037.stderr: -123> 2024-09-12T17:32:06.957+0000 7fc51f7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:32:07.269 INFO:tasks.workunit.client.0.smithi037.stderr: -122> 2024-09-12T17:32:06.957+0000 7fc51f7fe640 10 monclient: dump: 2024-09-12T17:32:07.269 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:32:07.269 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:32:07.269 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:32:07.269 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:32:07.269 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:32:07.269 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:32:07.269 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:32:07.270 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:32:07.270 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:32:07.270 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:32:07.270 INFO:tasks.workunit.client.0.smithi037.stderr: -121> 2024-09-12T17:32:06.957+0000 7fc64febb800 5 monclient: authenticate success, global_id 6053 2024-09-12T17:32:07.270 INFO:tasks.workunit.client.0.smithi037.stderr: -120> 2024-09-12T17:32:06.957+0000 7fc64febb800 10 monclient: _renew_subs 2024-09-12T17:32:07.270 INFO:tasks.workunit.client.0.smithi037.stderr: -119> 2024-09-12T17:32:06.957+0000 7fc5317fa640 4 set_mon_vals no callback set 2024-09-12T17:32:07.270 INFO:tasks.workunit.client.0.smithi037.stderr: -118> 2024-09-12T17:32:06.957+0000 7fc64febb800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.37:3301/0 2024-09-12T17:32:07.270 INFO:tasks.workunit.client.0.smithi037.stderr: -117> 2024-09-12T17:32:06.957+0000 7fc64febb800 10 monclient: _renew_subs 2024-09-12T17:32:07.270 INFO:tasks.workunit.client.0.smithi037.stderr: -116> 2024-09-12T17:32:06.957+0000 7fc64febb800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.37:3301/0 2024-09-12T17:32:07.270 INFO:tasks.workunit.client.0.smithi037.stderr: -115> 2024-09-12T17:32:06.957+0000 7fc64febb800 1 librados: init done 2024-09-12T17:32:07.270 INFO:tasks.workunit.client.0.smithi037.stderr: -114> 2024-09-12T17:32:06.957+0000 7fc64febb800 5 asok(0x561d8e107730) register_command cr dump hook 0x561d8e3e8a08 2024-09-12T17:32:07.270 INFO:tasks.workunit.client.0.smithi037.stderr: -113> 2024-09-12T17:32:06.958+0000 7fc64febb800 20 rados->read ofs=0 len=0 2024-09-12T17:32:07.270 INFO:tasks.workunit.client.0.smithi037.stderr: -112> 2024-09-12T17:32:06.959+0000 7fc51f7fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:32:07.271 INFO:tasks.workunit.client.0.smithi037.stderr: -111> 2024-09-12T17:32:06.959+0000 7fc51f7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.40:6816/3916250676,v1:172.21.15.40:6817/3916250676] 2024-09-12T17:32:07.271 INFO:tasks.workunit.client.0.smithi037.stderr: -110> 2024-09-12T17:32:06.959+0000 7fc51f7fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.40:6816/3916250676,v1:172.21.15.40:6817/3916250676] 2024-09-12T17:32:07.271 INFO:tasks.workunit.client.0.smithi037.stderr: -109> 2024-09-12T17:32:06.959+0000 7fc64d1a4640 10 monclient: get_auth_request con 0x7fc518076470 auth_method 0 2024-09-12T17:32:07.271 INFO:tasks.workunit.client.0.smithi037.stderr: -108> 2024-09-12T17:32:06.959+0000 7fc64e1a6640 10 monclient: get_auth_request con 0x561d8e414160 auth_method 0 2024-09-12T17:32:07.271 INFO:tasks.workunit.client.0.smithi037.stderr: -107> 2024-09-12T17:32:06.960+0000 7fc64febb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:07.271 INFO:tasks.workunit.client.0.smithi037.stderr: -106> 2024-09-12T17:32:06.960+0000 7fc64febb800 20 realm 2024-09-12T17:32:07.271 INFO:tasks.workunit.client.0.smithi037.stderr: -105> 2024-09-12T17:32:06.960+0000 7fc64febb800 20 rados->read ofs=0 len=0 2024-09-12T17:32:07.271 INFO:tasks.workunit.client.0.smithi037.stderr: -104> 2024-09-12T17:32:06.960+0000 7fc64febb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:07.271 INFO:tasks.workunit.client.0.smithi037.stderr: -103> 2024-09-12T17:32:06.960+0000 7fc64febb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:32:07.271 INFO:tasks.workunit.client.0.smithi037.stderr: -102> 2024-09-12T17:32:06.960+0000 7fc64febb800 20 rados->read ofs=0 len=0 2024-09-12T17:32:07.272 INFO:tasks.workunit.client.0.smithi037.stderr: -101> 2024-09-12T17:32:06.960+0000 7fc64febb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:07.272 INFO:tasks.workunit.client.0.smithi037.stderr: -100> 2024-09-12T17:32:06.960+0000 7fc64febb800 20 rados->read ofs=0 len=0 2024-09-12T17:32:07.272 INFO:tasks.workunit.client.0.smithi037.stderr: -99> 2024-09-12T17:32:06.960+0000 7fc64d9a5640 10 monclient: get_auth_request con 0x561d8e418470 auth_method 0 2024-09-12T17:32:07.272 INFO:tasks.workunit.client.0.smithi037.stderr: -98> 2024-09-12T17:32:06.961+0000 7fc64febb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:07.272 INFO:tasks.workunit.client.0.smithi037.stderr: -97> 2024-09-12T17:32:06.961+0000 7fc64febb800 20 rados->read ofs=0 len=0 2024-09-12T17:32:07.272 INFO:tasks.workunit.client.0.smithi037.stderr: -96> 2024-09-12T17:32:06.961+0000 7fc64febb800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:32:07.272 INFO:tasks.workunit.client.0.smithi037.stderr: -95> 2024-09-12T17:32:06.961+0000 7fc64febb800 20 searching for the correct realm 2024-09-12T17:32:07.272 INFO:tasks.workunit.client.0.smithi037.stderr: -94> 2024-09-12T17:32:06.961+0000 7fc64d1a4640 10 monclient: get_auth_request con 0x561d8e41d5a0 auth_method 0 2024-09-12T17:32:07.272 INFO:tasks.workunit.client.0.smithi037.stderr: -93> 2024-09-12T17:32:06.962+0000 7fc64e1a6640 10 monclient: get_auth_request con 0x7fc64408f1d0 auth_method 0 2024-09-12T17:32:07.272 INFO:tasks.workunit.client.0.smithi037.stderr: -92> 2024-09-12T17:32:06.963+0000 7fc64d9a5640 10 monclient: get_auth_request con 0x7fc648071040 auth_method 0 2024-09-12T17:32:07.272 INFO:tasks.workunit.client.0.smithi037.stderr: -91> 2024-09-12T17:32:06.964+0000 7fc64d1a4640 10 monclient: get_auth_request con 0x7fc64008f070 auth_method 0 2024-09-12T17:32:07.272 INFO:tasks.workunit.client.0.smithi037.stderr: -90> 2024-09-12T17:32:06.964+0000 7fc64d1a4640 0 -- 172.21.15.37:0/2031873925 >> [v2:172.21.15.40:6800/2441293461,v1:172.21.15.40:6801/2441293461] conn(0x7fc64008f070 msgr2=0x7fc640067e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:32:07.273 INFO:tasks.workunit.client.0.smithi037.stderr: -89> 2024-09-12T17:32:06.964+0000 7fc51f7fe640 1 client.6053.objecter ms_handle_reset 0x7fc64008f070 session 0x7fc640081040 osd.4 2024-09-12T17:32:07.273 INFO:tasks.workunit.client.0.smithi037.stderr: -88> 2024-09-12T17:32:06.964+0000 7fc51f7fe640 10 monclient: _renew_subs 2024-09-12T17:32:07.273 INFO:tasks.workunit.client.0.smithi037.stderr: -87> 2024-09-12T17:32:06.964+0000 7fc51f7fe640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.37:3301/0 2024-09-12T17:32:07.273 INFO:tasks.workunit.client.0.smithi037.stderr: -86> 2024-09-12T17:32:06.965+0000 7fc64d1a4640 10 monclient: get_auth_request con 0x7fc518086b10 auth_method 0 2024-09-12T17:32:07.273 INFO:tasks.workunit.client.0.smithi037.stderr: -85> 2024-09-12T17:32:06.966+0000 7fc64e1a6640 10 monclient: get_auth_request con 0x7fc644098a60 auth_method 0 2024-09-12T17:32:07.273 INFO:tasks.workunit.client.0.smithi037.stderr: -84> 2024-09-12T17:32:06.968+0000 7fc64d9a5640 10 monclient: get_auth_request con 0x7fc644072040 auth_method 0 2024-09-12T17:32:07.273 INFO:tasks.workunit.client.0.smithi037.stderr: -83> 2024-09-12T17:32:06.968+0000 7fc64d9a5640 0 -- 172.21.15.37:0/2031873925 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7fc644072040 msgr2=0x7fc6440358a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:32:07.273 INFO:tasks.workunit.client.0.smithi037.stderr: -82> 2024-09-12T17:32:07.169+0000 7fc64d9a5640 10 monclient: get_auth_request con 0x7fc644072040 auth_method 0 2024-09-12T17:32:07.273 INFO:tasks.workunit.client.0.smithi037.stderr: -81> 2024-09-12T17:32:07.174+0000 7fc64febb800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:32:07.273 INFO:tasks.workunit.client.0.smithi037.stderr: -80> 2024-09-12T17:32:07.174+0000 7fc64febb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:32:07.273 INFO:tasks.workunit.client.0.smithi037.stderr: -79> 2024-09-12T17:32:07.174+0000 7fc64febb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:32:07.274 INFO:tasks.workunit.client.0.smithi037.stderr: -78> 2024-09-12T17:32:07.174+0000 7fc64febb800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:32:07.274 INFO:tasks.workunit.client.0.smithi037.stderr: -77> 2024-09-12T17:32:07.174+0000 7fc64febb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:32:07.274 INFO:tasks.workunit.client.0.smithi037.stderr: -76> 2024-09-12T17:32:07.174+0000 7fc64febb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:32:07.274 INFO:tasks.workunit.client.0.smithi037.stderr: -75> 2024-09-12T17:32:07.174+0000 7fc64febb800 20 rados->read ofs=0 len=0 2024-09-12T17:32:07.274 INFO:tasks.workunit.client.0.smithi037.stderr: -74> 2024-09-12T17:32:07.174+0000 7fc64febb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:07.274 INFO:tasks.workunit.client.0.smithi037.stderr: -73> 2024-09-12T17:32:07.174+0000 7fc64febb800 20 rados->read ofs=0 len=0 2024-09-12T17:32:07.274 INFO:tasks.workunit.client.0.smithi037.stderr: -72> 2024-09-12T17:32:07.175+0000 7fc64febb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:07.274 INFO:tasks.workunit.client.0.smithi037.stderr: -71> 2024-09-12T17:32:07.175+0000 7fc64febb800 20 rados->read ofs=0 len=0 2024-09-12T17:32:07.274 INFO:tasks.workunit.client.0.smithi037.stderr: -70> 2024-09-12T17:32:07.176+0000 7fc64febb800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:32:07.274 INFO:tasks.workunit.client.0.smithi037.stderr: -69> 2024-09-12T17:32:07.176+0000 7fc64febb800 20 zone default found 2024-09-12T17:32:07.274 INFO:tasks.workunit.client.0.smithi037.stderr: -68> 2024-09-12T17:32:07.176+0000 7fc64febb800 4 Realm: () 2024-09-12T17:32:07.274 INFO:tasks.workunit.client.0.smithi037.stderr: -67> 2024-09-12T17:32:07.176+0000 7fc64febb800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:32:07.275 INFO:tasks.workunit.client.0.smithi037.stderr: -66> 2024-09-12T17:32:07.176+0000 7fc64febb800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:32:07.275 INFO:tasks.workunit.client.0.smithi037.stderr: -65> 2024-09-12T17:32:07.176+0000 7fc64febb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:32:07.275 INFO:tasks.workunit.client.0.smithi037.stderr: -64> 2024-09-12T17:32:07.176+0000 7fc64febb800 20 zonegroup default 2024-09-12T17:32:07.275 INFO:tasks.workunit.client.0.smithi037.stderr: -63> 2024-09-12T17:32:07.176+0000 7fc64febb800 20 rados->read ofs=0 len=0 2024-09-12T17:32:07.275 INFO:tasks.workunit.client.0.smithi037.stderr: -62> 2024-09-12T17:32:07.176+0000 7fc64febb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:07.275 INFO:tasks.workunit.client.0.smithi037.stderr: -61> 2024-09-12T17:32:07.176+0000 7fc64febb800 20 rados->read ofs=0 len=0 2024-09-12T17:32:07.275 INFO:tasks.workunit.client.0.smithi037.stderr: -60> 2024-09-12T17:32:07.176+0000 7fc64febb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:07.275 INFO:tasks.workunit.client.0.smithi037.stderr: -59> 2024-09-12T17:32:07.176+0000 7fc64febb800 20 rados->read ofs=0 len=0 2024-09-12T17:32:07.275 INFO:tasks.workunit.client.0.smithi037.stderr: -58> 2024-09-12T17:32:07.176+0000 7fc64febb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:07.275 INFO:tasks.workunit.client.0.smithi037.stderr: -57> 2024-09-12T17:32:07.176+0000 7fc64febb800 20 started sync module instance, tier type = 2024-09-12T17:32:07.275 INFO:tasks.workunit.client.0.smithi037.stderr: -56> 2024-09-12T17:32:07.176+0000 7fc64febb800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:32:07.275 INFO:tasks.workunit.client.0.smithi037.stderr: -55> 2024-09-12T17:32:07.187+0000 7fc64febb800 20 add_watcher() i=0 2024-09-12T17:32:07.276 INFO:tasks.workunit.client.0.smithi037.stderr: -54> 2024-09-12T17:32:07.187+0000 7fc64febb800 20 add_watcher() i=1 2024-09-12T17:32:07.276 INFO:tasks.workunit.client.0.smithi037.stderr: -53> 2024-09-12T17:32:07.187+0000 7fc64febb800 20 add_watcher() i=2 2024-09-12T17:32:07.276 INFO:tasks.workunit.client.0.smithi037.stderr: -52> 2024-09-12T17:32:07.187+0000 7fc64febb800 20 add_watcher() i=3 2024-09-12T17:32:07.276 INFO:tasks.workunit.client.0.smithi037.stderr: -51> 2024-09-12T17:32:07.187+0000 7fc64febb800 20 add_watcher() i=4 2024-09-12T17:32:07.276 INFO:tasks.workunit.client.0.smithi037.stderr: -50> 2024-09-12T17:32:07.187+0000 7fc64febb800 20 add_watcher() i=5 2024-09-12T17:32:07.276 INFO:tasks.workunit.client.0.smithi037.stderr: -49> 2024-09-12T17:32:07.187+0000 7fc64febb800 20 add_watcher() i=6 2024-09-12T17:32:07.276 INFO:tasks.workunit.client.0.smithi037.stderr: -48> 2024-09-12T17:32:07.188+0000 7fc64febb800 20 add_watcher() i=7 2024-09-12T17:32:07.276 INFO:tasks.workunit.client.0.smithi037.stderr: -47> 2024-09-12T17:32:07.188+0000 7fc64febb800 2 all 8 watchers are set, enabling cache 2024-09-12T17:32:07.276 INFO:tasks.workunit.client.0.smithi037.stderr: -46> 2024-09-12T17:32:07.190+0000 7fc64febb800 5 AuthRegistry(0x7fff10c4d500) adding auth protocol: cephx 2024-09-12T17:32:07.276 INFO:tasks.workunit.client.0.smithi037.stderr: -45> 2024-09-12T17:32:07.190+0000 7fc64febb800 5 AuthRegistry(0x7fff10c4d500) adding auth protocol: cephx 2024-09-12T17:32:07.276 INFO:tasks.workunit.client.0.smithi037.stderr: -44> 2024-09-12T17:32:07.190+0000 7fc64febb800 5 AuthRegistry(0x7fff10c4d500) adding auth protocol: cephx 2024-09-12T17:32:07.276 INFO:tasks.workunit.client.0.smithi037.stderr: -43> 2024-09-12T17:32:07.190+0000 7fc64febb800 5 AuthRegistry(0x7fff10c4d500) adding con mode: secure 2024-09-12T17:32:07.277 INFO:tasks.workunit.client.0.smithi037.stderr: -42> 2024-09-12T17:32:07.190+0000 7fc64febb800 5 AuthRegistry(0x7fff10c4d500) adding con mode: crc 2024-09-12T17:32:07.277 INFO:tasks.workunit.client.0.smithi037.stderr: -41> 2024-09-12T17:32:07.190+0000 7fc64febb800 5 AuthRegistry(0x7fff10c4d500) adding con mode: secure 2024-09-12T17:32:07.277 INFO:tasks.workunit.client.0.smithi037.stderr: -40> 2024-09-12T17:32:07.190+0000 7fc64febb800 5 AuthRegistry(0x7fff10c4d500) adding con mode: crc 2024-09-12T17:32:07.277 INFO:tasks.workunit.client.0.smithi037.stderr: -39> 2024-09-12T17:32:07.190+0000 7fc4ff7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:32:07.277 INFO:tasks.workunit.client.0.smithi037.stderr: -38> 2024-09-12T17:32:07.190+0000 7fc64febb800 5 AuthRegistry(0x7fff10c4d500) adding con mode: secure 2024-09-12T17:32:07.277 INFO:tasks.workunit.client.0.smithi037.stderr: -37> 2024-09-12T17:32:07.190+0000 7fc64febb800 5 AuthRegistry(0x7fff10c4d500) adding con mode: crc 2024-09-12T17:32:07.277 INFO:tasks.workunit.client.0.smithi037.stderr: -36> 2024-09-12T17:32:07.190+0000 7fc64febb800 5 AuthRegistry(0x7fff10c4d500) adding con mode: crc 2024-09-12T17:32:07.277 INFO:tasks.workunit.client.0.smithi037.stderr: -35> 2024-09-12T17:32:07.190+0000 7fc64febb800 5 AuthRegistry(0x7fff10c4d500) adding con mode: secure 2024-09-12T17:32:07.277 INFO:tasks.workunit.client.0.smithi037.stderr: -34> 2024-09-12T17:32:07.190+0000 7fc64febb800 5 AuthRegistry(0x7fff10c4d500) adding con mode: crc 2024-09-12T17:32:07.277 INFO:tasks.workunit.client.0.smithi037.stderr: -33> 2024-09-12T17:32:07.190+0000 7fc64febb800 5 AuthRegistry(0x7fff10c4d500) adding con mode: secure 2024-09-12T17:32:07.277 INFO:tasks.workunit.client.0.smithi037.stderr: -32> 2024-09-12T17:32:07.190+0000 7fc64febb800 5 AuthRegistry(0x7fff10c4d500) adding con mode: crc 2024-09-12T17:32:07.277 INFO:tasks.workunit.client.0.smithi037.stderr: -31> 2024-09-12T17:32:07.190+0000 7fc64febb800 5 AuthRegistry(0x7fff10c4d500) adding con mode: secure 2024-09-12T17:32:07.278 INFO:tasks.workunit.client.0.smithi037.stderr: -30> 2024-09-12T17:32:07.190+0000 7fc64febb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:32:07.278 INFO:tasks.workunit.client.0.smithi037.stderr: -29> 2024-09-12T17:32:07.190+0000 7fc64febb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:32:07.278 INFO:tasks.workunit.client.0.smithi037.stderr: -28> 2024-09-12T17:32:07.190+0000 7fc64febb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:32:07.278 INFO:tasks.workunit.client.0.smithi037.stderr: -27> 2024-09-12T17:32:07.190+0000 7fc64febb800 5 asok(0x561d8e107730) register_command cache list hook 0x561d8e3e88b0 2024-09-12T17:32:07.278 INFO:tasks.workunit.client.0.smithi037.stderr: -26> 2024-09-12T17:32:07.190+0000 7fc64febb800 5 asok(0x561d8e107730) register_command cache inspect hook 0x561d8e3e88b0 2024-09-12T17:32:07.278 INFO:tasks.workunit.client.0.smithi037.stderr: -25> 2024-09-12T17:32:07.190+0000 7fc64febb800 5 asok(0x561d8e107730) register_command cache erase hook 0x561d8e3e88b0 2024-09-12T17:32:07.278 INFO:tasks.workunit.client.0.smithi037.stderr: -24> 2024-09-12T17:32:07.190+0000 7fc64febb800 5 asok(0x561d8e107730) register_command cache zap hook 0x561d8e3e88b0 2024-09-12T17:32:07.278 INFO:tasks.workunit.client.0.smithi037.stderr: -23> 2024-09-12T17:32:07.190+0000 7fc64febb800 5 note: GC not initialized 2024-09-12T17:32:07.278 INFO:tasks.workunit.client.0.smithi037.stderr: -22> 2024-09-12T17:32:07.191+0000 7fc4fe7fc640 20 reqs_thread_entry: start 2024-09-12T17:32:07.278 INFO:tasks.workunit.client.0.smithi037.stderr: -21> 2024-09-12T17:32:07.191+0000 7fc64febb800 5 asok(0x561d8e107730) register_command sync trace show hook 0x7fc64402a070 2024-09-12T17:32:07.278 INFO:tasks.workunit.client.0.smithi037.stderr: -20> 2024-09-12T17:32:07.191+0000 7fc64febb800 5 asok(0x561d8e107730) register_command sync trace history hook 0x7fc64402a070 2024-09-12T17:32:07.279 INFO:tasks.workunit.client.0.smithi037.stderr: -19> 2024-09-12T17:32:07.191+0000 7fc64febb800 5 asok(0x561d8e107730) register_command sync trace active hook 0x7fc64402a070 2024-09-12T17:32:07.279 INFO:tasks.workunit.client.0.smithi037.stderr: -18> 2024-09-12T17:32:07.191+0000 7fc64febb800 5 asok(0x561d8e107730) register_command sync trace active_short hook 0x7fc64402a070 2024-09-12T17:32:07.279 INFO:tasks.workunit.client.0.smithi037.stderr: -17> 2024-09-12T17:32:07.191+0000 7fc64febb800 20 init_complete bucket index max shards: 11 2024-09-12T17:32:07.279 INFO:tasks.workunit.client.0.smithi037.stderr: -16> 2024-09-12T17:32:07.191+0000 7fc64febb800 20 Filter name: none 2024-09-12T17:32:07.279 INFO:tasks.workunit.client.0.smithi037.stderr: -15> 2024-09-12T17:32:07.191+0000 7fc46ffff640 20 reqs_thread_entry: start 2024-09-12T17:32:07.279 INFO:tasks.workunit.client.0.smithi037.stderr: -14> 2024-09-12T17:32:07.191+0000 7fc64febb800 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-12T17:32:07.279 INFO:tasks.workunit.client.0.smithi037.stderr: -13> 2024-09-12T17:32:07.191+0000 7fc64febb800 20 rados->read ofs=0 len=0 2024-09-12T17:32:07.279 INFO:tasks.workunit.client.0.smithi037.stderr: -12> 2024-09-12T17:32:07.191+0000 7fc64febb800 20 rados_obj.operate() r=0 bl.length=212 2024-09-12T17:32:07.279 INFO:tasks.workunit.client.0.smithi037.stderr: -11> 2024-09-12T17:32:07.191+0000 7fc64febb800 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-12T17:32:07.279 INFO:tasks.workunit.client.0.smithi037.stderr: -10> 2024-09-12T17:32:07.191+0000 7fc64febb800 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-12T17:32:07.279 INFO:tasks.workunit.client.0.smithi037.stderr: -9> 2024-09-12T17:32:07.191+0000 7fc64febb800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.22 : miss 2024-09-12T17:32:07.280 INFO:tasks.workunit.client.0.smithi037.stderr: -8> 2024-09-12T17:32:07.191+0000 7fc64febb800 20 rados->read ofs=0 len=0 2024-09-12T17:32:07.280 INFO:tasks.workunit.client.0.smithi037.stderr: -7> 2024-09-12T17:32:07.192+0000 7fc64febb800 20 rados_obj.operate() r=0 bl.length=434 2024-09-12T17:32:07.280 INFO:tasks.workunit.client.0.smithi037.stderr: -6> 2024-09-12T17:32:07.192+0000 7fc64febb800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.22 info.flags=0x17 2024-09-12T17:32:07.280 INFO:tasks.workunit.client.0.smithi037.stderr: -5> 2024-09-12T17:32:07.192+0000 7fc64febb800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.22 to cache LRU end 2024-09-12T17:32:07.280 INFO:tasks.workunit.client.0.smithi037.stderr: -4> 2024-09-12T17:32:07.192+0000 7fc64febb800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:32:07.280 INFO:tasks.workunit.client.0.smithi037.stderr: -3> 2024-09-12T17:32:07.192+0000 7fc64febb800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:32:07.280 INFO:tasks.workunit.client.0.smithi037.stderr: -2> 2024-09-12T17:32:07.192+0000 7fc64febb800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.22 2024-09-12T17:32:07.280 INFO:tasks.workunit.client.0.smithi037.stderr: -1> 2024-09-12T17:32:07.194+0000 7fc64febb800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fc64febb800 time 2024-09-12T17:32:07.194540+0000 2024-09-12T17:32:07.280 INFO:tasks.workunit.client.0.smithi037.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:32:07.281 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:32:07.281 INFO:tasks.workunit.client.0.smithi037.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:32:07.281 INFO:tasks.workunit.client.0.smithi037.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fc65338c71a] 2024-09-12T17:32:07.281 INFO:tasks.workunit.client.0.smithi037.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fc65338c8d8] 2024-09-12T17:32:07.281 INFO:tasks.workunit.client.0.smithi037.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561d8bf66841] 2024-09-12T17:32:07.281 INFO:tasks.workunit.client.0.smithi037.stderr: 4: radosgw-admin(+0xd73b64) [0x561d8c473b64] 2024-09-12T17:32:07.281 INFO:tasks.workunit.client.0.smithi037.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x561d8bf7650d] 2024-09-12T17:32:07.281 INFO:tasks.workunit.client.0.smithi037.stderr: 6: main() 2024-09-12T17:32:07.281 INFO:tasks.workunit.client.0.smithi037.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fc652029590] 2024-09-12T17:32:07.281 INFO:tasks.workunit.client.0.smithi037.stderr: 8: __libc_start_main() 2024-09-12T17:32:07.281 INFO:tasks.workunit.client.0.smithi037.stderr: 9: _start() 2024-09-12T17:32:07.282 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:32:07.282 INFO:tasks.workunit.client.0.smithi037.stderr: 0> 2024-09-12T17:32:07.195+0000 7fc64febb800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:32:07.282 INFO:tasks.workunit.client.0.smithi037.stderr: in thread 7fc64febb800 thread_name:radosgw-admin 2024-09-12T17:32:07.282 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:32:07.282 INFO:tasks.workunit.client.0.smithi037.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:32:07.282 INFO:tasks.workunit.client.0.smithi037.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fc65203e6f0] 2024-09-12T17:32:07.282 INFO:tasks.workunit.client.0.smithi037.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fc65208b99c] 2024-09-12T17:32:07.282 INFO:tasks.workunit.client.0.smithi037.stderr: 3: raise() 2024-09-12T17:32:07.282 INFO:tasks.workunit.client.0.smithi037.stderr: 4: abort() 2024-09-12T17:32:07.282 INFO:tasks.workunit.client.0.smithi037.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fc65338c774] 2024-09-12T17:32:07.282 INFO:tasks.workunit.client.0.smithi037.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fc65338c8d8] 2024-09-12T17:32:07.282 INFO:tasks.workunit.client.0.smithi037.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561d8bf66841] 2024-09-12T17:32:07.283 INFO:tasks.workunit.client.0.smithi037.stderr: 8: radosgw-admin(+0xd73b64) [0x561d8c473b64] 2024-09-12T17:32:07.283 INFO:tasks.workunit.client.0.smithi037.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x561d8bf7650d] 2024-09-12T17:32:07.283 INFO:tasks.workunit.client.0.smithi037.stderr: 10: main() 2024-09-12T17:32:07.283 INFO:tasks.workunit.client.0.smithi037.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fc652029590] 2024-09-12T17:32:07.283 INFO:tasks.workunit.client.0.smithi037.stderr: 12: __libc_start_main() 2024-09-12T17:32:07.283 INFO:tasks.workunit.client.0.smithi037.stderr: 13: _start() 2024-09-12T17:32:07.283 INFO:tasks.workunit.client.0.smithi037.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:32:07.283 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:32:07.283 INFO:tasks.workunit.client.0.smithi037.stderr:--- logging levels --- 2024-09-12T17:32:07.283 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 none 2024-09-12T17:32:07.283 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 lockdep 2024-09-12T17:32:07.283 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 context 2024-09-12T17:32:07.284 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 1 crush 2024-09-12T17:32:07.284 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mds 2024-09-12T17:32:07.284 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mds_balancer 2024-09-12T17:32:07.284 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mds_locker 2024-09-12T17:32:07.284 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mds_log 2024-09-12T17:32:07.284 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mds_log_expire 2024-09-12T17:32:07.284 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mds_migrator 2024-09-12T17:32:07.284 INFO:tasks.workunit.client.0.smithi037.stderr: 3/ 5 mds_quiesce 2024-09-12T17:32:07.284 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 buffer 2024-09-12T17:32:07.284 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 timer 2024-09-12T17:32:07.284 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 filer 2024-09-12T17:32:07.284 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 striper 2024-09-12T17:32:07.285 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 objecter 2024-09-12T17:32:07.285 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 rados 2024-09-12T17:32:07.285 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 rbd 2024-09-12T17:32:07.285 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 rbd_mirror 2024-09-12T17:32:07.285 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 rbd_replay 2024-09-12T17:32:07.285 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 rbd_pwl 2024-09-12T17:32:07.285 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 journaler 2024-09-12T17:32:07.285 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 objectcacher 2024-09-12T17:32:07.285 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:32:07.285 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 client 2024-09-12T17:32:07.285 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 osd 2024-09-12T17:32:07.285 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 optracker 2024-09-12T17:32:07.286 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 objclass 2024-09-12T17:32:07.286 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 3 filestore 2024-09-12T17:32:07.286 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 3 journal 2024-09-12T17:32:07.286 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 0 ms 2024-09-12T17:32:07.286 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mon 2024-09-12T17:32:07.286 INFO:tasks.workunit.client.0.smithi037.stderr: 0/10 monc 2024-09-12T17:32:07.286 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 paxos 2024-09-12T17:32:07.286 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 tp 2024-09-12T17:32:07.286 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 auth 2024-09-12T17:32:07.286 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 crypto 2024-09-12T17:32:07.286 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 1 finisher 2024-09-12T17:32:07.286 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 1 reserver 2024-09-12T17:32:07.287 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 heartbeatmap 2024-09-12T17:32:07.287 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 perfcounter 2024-09-12T17:32:07.287 INFO:tasks.workunit.client.0.smithi037.stderr: 20/20 rgw 2024-09-12T17:32:07.287 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 rgw_sync 2024-09-12T17:32:07.287 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 rgw_datacache 2024-09-12T17:32:07.287 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 rgw_access 2024-09-12T17:32:07.287 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:32:07.287 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 rgw_flight 2024-09-12T17:32:07.287 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:32:07.287 INFO:tasks.workunit.client.0.smithi037.stderr: 20/20 rgw_notification 2024-09-12T17:32:07.287 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 javaclient 2024-09-12T17:32:07.287 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 asok 2024-09-12T17:32:07.287 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 1 throttle 2024-09-12T17:32:07.288 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 0 refs 2024-09-12T17:32:07.288 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 compressor 2024-09-12T17:32:07.288 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 bluestore 2024-09-12T17:32:07.288 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 bluefs 2024-09-12T17:32:07.288 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 3 bdev 2024-09-12T17:32:07.288 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 kstore 2024-09-12T17:32:07.288 INFO:tasks.workunit.client.0.smithi037.stderr: 4/ 5 rocksdb 2024-09-12T17:32:07.288 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 fuse 2024-09-12T17:32:07.288 INFO:tasks.workunit.client.0.smithi037.stderr: 2/ 5 mgr 2024-09-12T17:32:07.288 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mgrc 2024-09-12T17:32:07.288 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 dpdk 2024-09-12T17:32:07.288 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 eventtrace 2024-09-12T17:32:07.289 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 prioritycache 2024-09-12T17:32:07.289 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 test 2024-09-12T17:32:07.289 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:32:07.289 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 cephsqlite 2024-09-12T17:32:07.289 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:32:07.289 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore 2024-09-12T17:32:07.289 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_onode 2024-09-12T17:32:07.289 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_odata 2024-09-12T17:32:07.289 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_omap 2024-09-12T17:32:07.289 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_tm 2024-09-12T17:32:07.289 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_t 2024-09-12T17:32:07.290 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:32:07.290 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_epm 2024-09-12T17:32:07.290 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_lba 2024-09-12T17:32:07.290 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:32:07.290 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_cache 2024-09-12T17:32:07.290 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_journal 2024-09-12T17:32:07.290 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_device 2024-09-12T17:32:07.290 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_backref 2024-09-12T17:32:07.290 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 alienstore 2024-09-12T17:32:07.290 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mclock 2024-09-12T17:32:07.290 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 cyanstore 2024-09-12T17:32:07.290 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 ceph_exporter 2024-09-12T17:32:07.291 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 memstore 2024-09-12T17:32:07.291 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 trace 2024-09-12T17:32:07.291 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 ceph_dedup 2024-09-12T17:32:07.291 INFO:tasks.workunit.client.0.smithi037.stderr: -2/-2 (syslog threshold) 2024-09-12T17:32:07.291 INFO:tasks.workunit.client.0.smithi037.stderr: 99/99 (stderr threshold) 2024-09-12T17:32:07.291 INFO:tasks.workunit.client.0.smithi037.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:32:07.291 INFO:tasks.workunit.client.0.smithi037.stderr: 7fc46ffff640 / http_manager 2024-09-12T17:32:07.291 INFO:tasks.workunit.client.0.smithi037.stderr: 7fc4fe7fc640 / http_manager 2024-09-12T17:32:07.291 INFO:tasks.workunit.client.0.smithi037.stderr: 7fc4ff7fe640 / rgw_dt_lg_renew 2024-09-12T17:32:07.291 INFO:tasks.workunit.client.0.smithi037.stderr: 7fc51f7fe640 / ms_dispatch 2024-09-12T17:32:07.291 INFO:tasks.workunit.client.0.smithi037.stderr: 7fc5317fa640 / io_context_pool 2024-09-12T17:32:07.291 INFO:tasks.workunit.client.0.smithi037.stderr: 7fc5337fe640 / ms_dispatch 2024-09-12T17:32:07.292 INFO:tasks.workunit.client.0.smithi037.stderr: 7fc53a604640 / ms_dispatch 2024-09-12T17:32:07.292 INFO:tasks.workunit.client.0.smithi037.stderr: 7fc53be07640 / io_context_pool 2024-09-12T17:32:07.292 INFO:tasks.workunit.client.0.smithi037.stderr: 7fc64d1a4640 / msgr-worker-2 2024-09-12T17:32:07.292 INFO:tasks.workunit.client.0.smithi037.stderr: 7fc64d9a5640 / msgr-worker-1 2024-09-12T17:32:07.292 INFO:tasks.workunit.client.0.smithi037.stderr: 7fc64e1a6640 / msgr-worker-0 2024-09-12T17:32:07.292 INFO:tasks.workunit.client.0.smithi037.stderr: 7fc64e9a7640 / io_context_pool 2024-09-12T17:32:07.292 INFO:tasks.workunit.client.0.smithi037.stderr: 7fc64febb800 / radosgw-admin 2024-09-12T17:32:07.292 INFO:tasks.workunit.client.0.smithi037.stderr: max_recent 500 2024-09-12T17:32:07.292 INFO:tasks.workunit.client.0.smithi037.stderr: max_new 1000 2024-09-12T17:32:07.292 INFO:tasks.workunit.client.0.smithi037.stderr: log_file /var/log/ceph/ceph-client.admin.90778.log 2024-09-12T17:32:07.292 INFO:tasks.workunit.client.0.smithi037.stderr:--- end dump of recent events --- 2024-09-12T17:32:07.292 INFO:tasks.workunit.client.0.smithi037.stderr:--- begin dump of recent events --- 2024-09-12T17:32:07.293 INFO:tasks.workunit.client.0.smithi037.stderr: -499> 2024-09-12T17:32:06.940+0000 7fc64e1a6640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:32:07.293 INFO:tasks.workunit.client.0.smithi037.stderr: -498> 2024-09-12T17:32:06.940+0000 7fc64e1a6640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:32:07.293 INFO:tasks.workunit.client.0.smithi037.stderr: -497> 2024-09-12T17:32:06.940+0000 7fc64d1a4640 10 monclient(hunting): handle_auth_done global_id 6375 payload 274 2024-09-12T17:32:07.293 INFO:tasks.workunit.client.0.smithi037.stderr: -496> 2024-09-12T17:32:06.940+0000 7fc64d1a4640 10 monclient: _finish_hunting 0 2024-09-12T17:32:07.293 INFO:tasks.workunit.client.0.smithi037.stderr: -495> 2024-09-12T17:32:06.940+0000 7fc64d1a4640 1 monclient: found mon.noname-a 2024-09-12T17:32:07.293 INFO:tasks.workunit.client.0.smithi037.stderr: -494> 2024-09-12T17:32:06.940+0000 7fc64d1a4640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.37:3300/0 2024-09-12T17:32:07.293 INFO:tasks.workunit.client.0.smithi037.stderr: -493> 2024-09-12T17:32:06.940+0000 7fc53be07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:32:07.293 INFO:tasks.workunit.client.0.smithi037.stderr: -492> 2024-09-12T17:32:06.940+0000 7fc53be07640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:32:07.293 INFO:tasks.workunit.client.0.smithi037.stderr: -491> 2024-09-12T17:32:06.940+0000 7fc53be07640 10 monclient: dump: 2024-09-12T17:32:07.293 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:32:07.293 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:32:07.293 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:32:07.294 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:32:07.294 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:32:07.294 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:32:07.294 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:32:07.294 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:32:07.294 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:32:07.294 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:32:07.294 INFO:tasks.workunit.client.0.smithi037.stderr: -490> 2024-09-12T17:32:06.940+0000 7fc53be07640 10 monclient: _finish_auth 0 2024-09-12T17:32:07.294 INFO:tasks.workunit.client.0.smithi037.stderr: -489> 2024-09-12T17:32:06.940+0000 7fc53be07640 10 monclient: _check_auth_tickets 2024-09-12T17:32:07.294 INFO:tasks.workunit.client.0.smithi037.stderr: -488> 2024-09-12T17:32:06.940+0000 7fc53be07640 10 monclient: handle_config config(0 keys) 2024-09-12T17:32:07.294 INFO:tasks.workunit.client.0.smithi037.stderr: -487> 2024-09-12T17:32:06.940+0000 7fc64febb800 5 monclient: authenticate success, global_id 6375 2024-09-12T17:32:07.294 INFO:tasks.workunit.client.0.smithi037.stderr: -486> 2024-09-12T17:32:06.940+0000 7fc64febb800 10 monclient: get_monmap_and_config success 2024-09-12T17:32:07.295 INFO:tasks.workunit.client.0.smithi037.stderr: -485> 2024-09-12T17:32:06.940+0000 7fc64febb800 4 set_mon_vals no callback set 2024-09-12T17:32:07.295 INFO:tasks.workunit.client.0.smithi037.stderr: -484> 2024-09-12T17:32:06.940+0000 7fc53be07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:32:07.295 INFO:tasks.workunit.client.0.smithi037.stderr: -483> 2024-09-12T17:32:06.940+0000 7fc53be07640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:32:07.295 INFO:tasks.workunit.client.0.smithi037.stderr: -482> 2024-09-12T17:32:06.940+0000 7fc53be07640 10 monclient: dump: 2024-09-12T17:32:07.295 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:32:07.295 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:32:07.295 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:32:07.295 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:32:07.295 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:32:07.295 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:32:07.295 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:32:07.295 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:32:07.296 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:32:07.296 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:32:07.296 INFO:tasks.workunit.client.0.smithi037.stderr: -481> 2024-09-12T17:32:06.941+0000 7fc64febb800 10 monclient: shutdown 2024-09-12T17:32:07.296 INFO:tasks.workunit.client.0.smithi037.stderr: -480> 2024-09-12T17:32:06.941+0000 7fc64febb800 5 asok(0x561d8e107730) unregister_commands rotate-key 2024-09-12T17:32:07.296 INFO:tasks.workunit.client.0.smithi037.stderr: -479> 2024-09-12T17:32:06.941+0000 7fc64febb800 10 monclient: build_initial_monmap 2024-09-12T17:32:07.296 INFO:tasks.workunit.client.0.smithi037.stderr: -478> 2024-09-12T17:32:06.941+0000 7fc64febb800 1 build_initial for_mkfs: 0 2024-09-12T17:32:07.296 INFO:tasks.workunit.client.0.smithi037.stderr: -477> 2024-09-12T17:32:06.941+0000 7fc64febb800 10 monclient: monmap: 2024-09-12T17:32:07.296 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 0 2024-09-12T17:32:07.296 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:32:07.296 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 0.000000 2024-09-12T17:32:07.296 INFO:tasks.workunit.client.0.smithi037.stderr:created 0.000000 2024-09-12T17:32:07.296 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 0 (unknown) 2024-09-12T17:32:07.297 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:32:07.297 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.noname-a 2024-09-12T17:32:07.297 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.noname-b 2024-09-12T17:32:07.297 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.noname-c 2024-09-12T17:32:07.297 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:32:07.297 INFO:tasks.workunit.client.0.smithi037.stderr: -476> 2024-09-12T17:32:06.941+0000 7fc64febb800 5 AuthRegistry(0x561d8e32e220) adding auth protocol: cephx 2024-09-12T17:32:07.297 INFO:tasks.workunit.client.0.smithi037.stderr: -475> 2024-09-12T17:32:06.941+0000 7fc64febb800 5 AuthRegistry(0x561d8e32e220) adding auth protocol: cephx 2024-09-12T17:32:07.297 INFO:tasks.workunit.client.0.smithi037.stderr: -474> 2024-09-12T17:32:06.941+0000 7fc64febb800 5 AuthRegistry(0x561d8e32e220) adding auth protocol: cephx 2024-09-12T17:32:07.297 INFO:tasks.workunit.client.0.smithi037.stderr: -473> 2024-09-12T17:32:06.941+0000 7fc64febb800 5 AuthRegistry(0x561d8e32e220) adding con mode: secure 2024-09-12T17:32:07.297 INFO:tasks.workunit.client.0.smithi037.stderr: -472> 2024-09-12T17:32:06.941+0000 7fc64febb800 5 AuthRegistry(0x561d8e32e220) adding con mode: crc 2024-09-12T17:32:07.297 INFO:tasks.workunit.client.0.smithi037.stderr: -471> 2024-09-12T17:32:06.941+0000 7fc64febb800 5 AuthRegistry(0x561d8e32e220) adding con mode: secure 2024-09-12T17:32:07.297 INFO:tasks.workunit.client.0.smithi037.stderr: -470> 2024-09-12T17:32:06.941+0000 7fc64febb800 5 AuthRegistry(0x561d8e32e220) adding con mode: crc 2024-09-12T17:32:07.298 INFO:tasks.workunit.client.0.smithi037.stderr: -469> 2024-09-12T17:32:06.941+0000 7fc64febb800 5 AuthRegistry(0x561d8e32e220) adding con mode: secure 2024-09-12T17:32:07.298 INFO:tasks.workunit.client.0.smithi037.stderr: -468> 2024-09-12T17:32:06.941+0000 7fc64febb800 5 AuthRegistry(0x561d8e32e220) adding con mode: crc 2024-09-12T17:32:07.298 INFO:tasks.workunit.client.0.smithi037.stderr: -467> 2024-09-12T17:32:06.941+0000 7fc64febb800 5 AuthRegistry(0x561d8e32e220) adding con mode: crc 2024-09-12T17:32:07.298 INFO:tasks.workunit.client.0.smithi037.stderr: -466> 2024-09-12T17:32:06.941+0000 7fc64febb800 5 AuthRegistry(0x561d8e32e220) adding con mode: secure 2024-09-12T17:32:07.298 INFO:tasks.workunit.client.0.smithi037.stderr: -465> 2024-09-12T17:32:06.941+0000 7fc64febb800 5 AuthRegistry(0x561d8e32e220) adding con mode: crc 2024-09-12T17:32:07.298 INFO:tasks.workunit.client.0.smithi037.stderr: -464> 2024-09-12T17:32:06.941+0000 7fc64febb800 5 AuthRegistry(0x561d8e32e220) adding con mode: secure 2024-09-12T17:32:07.298 INFO:tasks.workunit.client.0.smithi037.stderr: -463> 2024-09-12T17:32:06.941+0000 7fc64febb800 5 AuthRegistry(0x561d8e32e220) adding con mode: crc 2024-09-12T17:32:07.298 INFO:tasks.workunit.client.0.smithi037.stderr: -462> 2024-09-12T17:32:06.941+0000 7fc64febb800 5 AuthRegistry(0x561d8e32e220) adding con mode: secure 2024-09-12T17:32:07.298 INFO:tasks.workunit.client.0.smithi037.stderr: -461> 2024-09-12T17:32:06.941+0000 7fc64febb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:32:07.298 INFO:tasks.workunit.client.0.smithi037.stderr: -460> 2024-09-12T17:32:06.941+0000 7fc64febb800 1 librados: starting msgr at 2024-09-12T17:32:07.298 INFO:tasks.workunit.client.0.smithi037.stderr: -459> 2024-09-12T17:32:06.941+0000 7fc64febb800 1 librados: starting objecter 2024-09-12T17:32:07.298 INFO:tasks.workunit.client.0.smithi037.stderr: -458> 2024-09-12T17:32:06.941+0000 7fc64febb800 5 asok(0x561d8e107730) register_command objecter_requests hook 0x561d8e32a140 2024-09-12T17:32:07.299 INFO:tasks.workunit.client.0.smithi037.stderr: -457> 2024-09-12T17:32:06.941+0000 7fc64febb800 1 librados: setting wanted keys 2024-09-12T17:32:07.299 INFO:tasks.workunit.client.0.smithi037.stderr: -456> 2024-09-12T17:32:06.941+0000 7fc64febb800 1 librados: calling monclient init 2024-09-12T17:32:07.299 INFO:tasks.workunit.client.0.smithi037.stderr: -455> 2024-09-12T17:32:06.941+0000 7fc64febb800 10 monclient: init 2024-09-12T17:32:07.299 INFO:tasks.workunit.client.0.smithi037.stderr: -454> 2024-09-12T17:32:06.941+0000 7fc64febb800 5 AuthRegistry(0x561d8e328c80) adding auth protocol: cephx 2024-09-12T17:32:07.299 INFO:tasks.workunit.client.0.smithi037.stderr: -453> 2024-09-12T17:32:06.941+0000 7fc64febb800 5 AuthRegistry(0x561d8e328c80) adding auth protocol: cephx 2024-09-12T17:32:07.299 INFO:tasks.workunit.client.0.smithi037.stderr: -452> 2024-09-12T17:32:06.941+0000 7fc64febb800 5 AuthRegistry(0x561d8e328c80) adding auth protocol: cephx 2024-09-12T17:32:07.299 INFO:tasks.workunit.client.0.smithi037.stderr: -451> 2024-09-12T17:32:06.941+0000 7fc64febb800 5 AuthRegistry(0x561d8e328c80) adding con mode: secure 2024-09-12T17:32:07.299 INFO:tasks.workunit.client.0.smithi037.stderr: -450> 2024-09-12T17:32:06.941+0000 7fc64febb800 5 AuthRegistry(0x561d8e328c80) adding con mode: crc 2024-09-12T17:32:07.299 INFO:tasks.workunit.client.0.smithi037.stderr: -449> 2024-09-12T17:32:06.941+0000 7fc64febb800 5 AuthRegistry(0x561d8e328c80) adding con mode: secure 2024-09-12T17:32:07.299 INFO:tasks.workunit.client.0.smithi037.stderr: -448> 2024-09-12T17:32:06.941+0000 7fc64febb800 5 AuthRegistry(0x561d8e328c80) adding con mode: crc 2024-09-12T17:32:07.299 INFO:tasks.workunit.client.0.smithi037.stderr: -447> 2024-09-12T17:32:06.941+0000 7fc64febb800 5 AuthRegistry(0x561d8e328c80) adding con mode: secure 2024-09-12T17:32:07.299 INFO:tasks.workunit.client.0.smithi037.stderr: -446> 2024-09-12T17:32:06.941+0000 7fc64febb800 5 AuthRegistry(0x561d8e328c80) adding con mode: crc 2024-09-12T17:32:07.300 INFO:tasks.workunit.client.0.smithi037.stderr: -445> 2024-09-12T17:32:06.941+0000 7fc64febb800 5 AuthRegistry(0x561d8e328c80) adding con mode: crc 2024-09-12T17:32:07.300 INFO:tasks.workunit.client.0.smithi037.stderr: -444> 2024-09-12T17:32:06.941+0000 7fc64febb800 5 AuthRegistry(0x561d8e328c80) adding con mode: secure 2024-09-12T17:32:07.300 INFO:tasks.workunit.client.0.smithi037.stderr: -443> 2024-09-12T17:32:06.941+0000 7fc64febb800 5 AuthRegistry(0x561d8e328c80) adding con mode: crc 2024-09-12T17:32:07.300 INFO:tasks.workunit.client.0.smithi037.stderr: -442> 2024-09-12T17:32:06.941+0000 7fc64febb800 5 AuthRegistry(0x561d8e328c80) adding con mode: secure 2024-09-12T17:32:07.300 INFO:tasks.workunit.client.0.smithi037.stderr: -441> 2024-09-12T17:32:06.941+0000 7fc64febb800 5 AuthRegistry(0x561d8e328c80) adding con mode: crc 2024-09-12T17:32:07.300 INFO:tasks.workunit.client.0.smithi037.stderr: -440> 2024-09-12T17:32:06.941+0000 7fc64febb800 5 AuthRegistry(0x561d8e328c80) adding con mode: secure 2024-09-12T17:32:07.300 INFO:tasks.workunit.client.0.smithi037.stderr: -439> 2024-09-12T17:32:06.942+0000 7fc64febb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:32:07.300 INFO:tasks.workunit.client.0.smithi037.stderr: -438> 2024-09-12T17:32:06.942+0000 7fc64febb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:32:07.300 INFO:tasks.workunit.client.0.smithi037.stderr: -437> 2024-09-12T17:32:06.942+0000 7fc64febb800 5 asok(0x561d8e107730) register_command rotate-key hook 0x561d8e328dc8 2024-09-12T17:32:07.300 INFO:tasks.workunit.client.0.smithi037.stderr: -436> 2024-09-12T17:32:06.942+0000 7fc64febb800 10 monclient: _reopen_session rank -1 2024-09-12T17:32:07.301 INFO:tasks.workunit.client.0.smithi037.stderr: -435> 2024-09-12T17:32:06.942+0000 7fc64febb800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T17:32:07.301 INFO:tasks.workunit.client.0.smithi037.stderr: -434> 2024-09-12T17:32:06.942+0000 7fc64febb800 10 monclient(hunting): picked mon.noname-c con 0x561d8e26ea40 addr [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] 2024-09-12T17:32:07.301 INFO:tasks.workunit.client.0.smithi037.stderr: -433> 2024-09-12T17:32:06.942+0000 7fc64febb800 10 monclient(hunting): picked mon.noname-a con 0x561d8e26ee20 addr [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] 2024-09-12T17:32:07.301 INFO:tasks.workunit.client.0.smithi037.stderr: -432> 2024-09-12T17:32:06.942+0000 7fc64febb800 10 monclient(hunting): picked mon.noname-b con 0x561d8e272380 addr [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] 2024-09-12T17:32:07.301 INFO:tasks.workunit.client.0.smithi037.stderr: -431> 2024-09-12T17:32:06.942+0000 7fc64febb800 10 monclient(hunting): start opening mon connection 2024-09-12T17:32:07.301 INFO:tasks.workunit.client.0.smithi037.stderr: -430> 2024-09-12T17:32:06.942+0000 7fc64febb800 10 monclient(hunting): start opening mon connection 2024-09-12T17:32:07.301 INFO:tasks.workunit.client.0.smithi037.stderr: -429> 2024-09-12T17:32:06.942+0000 7fc64febb800 10 monclient(hunting): start opening mon connection 2024-09-12T17:32:07.301 INFO:tasks.workunit.client.0.smithi037.stderr: -428> 2024-09-12T17:32:06.942+0000 7fc64febb800 10 monclient(hunting): _renew_subs 2024-09-12T17:32:07.301 INFO:tasks.workunit.client.0.smithi037.stderr: -427> 2024-09-12T17:32:06.942+0000 7fc64febb800 10 monclient(hunting): authenticate will time out at 2114.539481s 2024-09-12T17:32:07.301 INFO:tasks.workunit.client.0.smithi037.stderr: -426> 2024-09-12T17:32:06.942+0000 7fc64d9a5640 10 monclient(hunting): get_auth_request con 0x561d8e26ea40 auth_method 0 2024-09-12T17:32:07.301 INFO:tasks.workunit.client.0.smithi037.stderr: -425> 2024-09-12T17:32:06.942+0000 7fc64d9a5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:32:07.301 INFO:tasks.workunit.client.0.smithi037.stderr: -424> 2024-09-12T17:32:06.942+0000 7fc64d9a5640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:32:07.302 INFO:tasks.workunit.client.0.smithi037.stderr: -423> 2024-09-12T17:32:06.942+0000 7fc64d9a5640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:32:07.302 INFO:tasks.workunit.client.0.smithi037.stderr: -422> 2024-09-12T17:32:06.942+0000 7fc64d1a4640 10 monclient(hunting): get_auth_request con 0x561d8e26ee20 auth_method 0 2024-09-12T17:32:07.302 INFO:tasks.workunit.client.0.smithi037.stderr: -421> 2024-09-12T17:32:06.942+0000 7fc64d1a4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:32:07.302 INFO:tasks.workunit.client.0.smithi037.stderr: -420> 2024-09-12T17:32:06.942+0000 7fc64d1a4640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:32:07.302 INFO:tasks.workunit.client.0.smithi037.stderr: -419> 2024-09-12T17:32:06.942+0000 7fc64d1a4640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:32:07.302 INFO:tasks.workunit.client.0.smithi037.stderr: -418> 2024-09-12T17:32:06.942+0000 7fc64d9a5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:32:07.302 INFO:tasks.workunit.client.0.smithi037.stderr: -417> 2024-09-12T17:32:06.942+0000 7fc64d9a5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:32:07.302 INFO:tasks.workunit.client.0.smithi037.stderr: -416> 2024-09-12T17:32:06.942+0000 7fc64d9a5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:32:07.302 INFO:tasks.workunit.client.0.smithi037.stderr: -415> 2024-09-12T17:32:06.942+0000 7fc64d1a4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:32:07.302 INFO:tasks.workunit.client.0.smithi037.stderr: -414> 2024-09-12T17:32:06.942+0000 7fc64d1a4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:32:07.302 INFO:tasks.workunit.client.0.smithi037.stderr: -413> 2024-09-12T17:32:06.942+0000 7fc64d1a4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:32:07.302 INFO:tasks.workunit.client.0.smithi037.stderr: -412> 2024-09-12T17:32:06.942+0000 7fc64e1a6640 10 monclient(hunting): get_auth_request con 0x561d8e272380 auth_method 0 2024-09-12T17:32:07.303 INFO:tasks.workunit.client.0.smithi037.stderr: -411> 2024-09-12T17:32:06.942+0000 7fc64e1a6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:32:07.303 INFO:tasks.workunit.client.0.smithi037.stderr: -410> 2024-09-12T17:32:06.942+0000 7fc64e1a6640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:32:07.303 INFO:tasks.workunit.client.0.smithi037.stderr: -409> 2024-09-12T17:32:06.942+0000 7fc64e1a6640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:32:07.303 INFO:tasks.workunit.client.0.smithi037.stderr: -408> 2024-09-12T17:32:06.942+0000 7fc64d9a5640 10 monclient(hunting): handle_auth_done global_id 6044 payload 824 2024-09-12T17:32:07.303 INFO:tasks.workunit.client.0.smithi037.stderr: -407> 2024-09-12T17:32:06.942+0000 7fc64d9a5640 10 monclient: _finish_hunting 0 2024-09-12T17:32:07.303 INFO:tasks.workunit.client.0.smithi037.stderr: -406> 2024-09-12T17:32:06.942+0000 7fc64d9a5640 1 monclient: found mon.noname-c 2024-09-12T17:32:07.303 INFO:tasks.workunit.client.0.smithi037.stderr: -405> 2024-09-12T17:32:06.942+0000 7fc64d9a5640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.37:3301/0 2024-09-12T17:32:07.303 INFO:tasks.workunit.client.0.smithi037.stderr: -404> 2024-09-12T17:32:06.943+0000 7fc53a604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:32:07.303 INFO:tasks.workunit.client.0.smithi037.stderr: -403> 2024-09-12T17:32:06.943+0000 7fc53a604640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:32:07.303 INFO:tasks.workunit.client.0.smithi037.stderr: -402> 2024-09-12T17:32:06.943+0000 7fc53a604640 10 monclient: dump: 2024-09-12T17:32:07.303 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:32:07.303 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:32:07.304 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:32:07.304 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:32:07.304 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:32:07.304 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:32:07.304 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:32:07.304 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:32:07.304 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:32:07.304 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:32:07.304 INFO:tasks.workunit.client.0.smithi037.stderr: -401> 2024-09-12T17:32:06.943+0000 7fc53a604640 10 monclient: _finish_auth 0 2024-09-12T17:32:07.304 INFO:tasks.workunit.client.0.smithi037.stderr: -400> 2024-09-12T17:32:06.943+0000 7fc53a604640 10 monclient: _check_auth_tickets 2024-09-12T17:32:07.304 INFO:tasks.workunit.client.0.smithi037.stderr: -399> 2024-09-12T17:32:06.943+0000 7fc53a604640 10 monclient: handle_config config(0 keys) 2024-09-12T17:32:07.305 INFO:tasks.workunit.client.0.smithi037.stderr: -398> 2024-09-12T17:32:06.943+0000 7fc53a604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:32:07.305 INFO:tasks.workunit.client.0.smithi037.stderr: -397> 2024-09-12T17:32:06.943+0000 7fc53a604640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:32:07.305 INFO:tasks.workunit.client.0.smithi037.stderr: -396> 2024-09-12T17:32:06.943+0000 7fc53a604640 10 monclient: dump: 2024-09-12T17:32:07.305 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:32:07.305 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:32:07.305 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:32:07.305 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:32:07.305 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:32:07.305 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:32:07.305 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:32:07.305 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:32:07.305 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:32:07.306 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:32:07.306 INFO:tasks.workunit.client.0.smithi037.stderr: -395> 2024-09-12T17:32:06.943+0000 7fc64febb800 5 monclient: authenticate success, global_id 6044 2024-09-12T17:32:07.306 INFO:tasks.workunit.client.0.smithi037.stderr: -394> 2024-09-12T17:32:06.943+0000 7fc64febb800 10 monclient: _renew_subs 2024-09-12T17:32:07.306 INFO:tasks.workunit.client.0.smithi037.stderr: -393> 2024-09-12T17:32:06.943+0000 7fc64febb800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.37:3301/0 2024-09-12T17:32:07.306 INFO:tasks.workunit.client.0.smithi037.stderr: -392> 2024-09-12T17:32:06.943+0000 7fc53be07640 4 set_mon_vals no callback set 2024-09-12T17:32:07.306 INFO:tasks.workunit.client.0.smithi037.stderr: -391> 2024-09-12T17:32:06.943+0000 7fc64febb800 10 monclient: _renew_subs 2024-09-12T17:32:07.306 INFO:tasks.workunit.client.0.smithi037.stderr: -390> 2024-09-12T17:32:06.943+0000 7fc64febb800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.37:3301/0 2024-09-12T17:32:07.306 INFO:tasks.workunit.client.0.smithi037.stderr: -389> 2024-09-12T17:32:06.943+0000 7fc64febb800 1 librados: init done 2024-09-12T17:32:07.306 INFO:tasks.workunit.client.0.smithi037.stderr: -388> 2024-09-12T17:32:06.945+0000 7fc53a604640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:32:07.306 INFO:tasks.workunit.client.0.smithi037.stderr: -387> 2024-09-12T17:32:06.945+0000 7fc53a604640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.40:6816/3916250676,v1:172.21.15.40:6817/3916250676] 2024-09-12T17:32:07.306 INFO:tasks.workunit.client.0.smithi037.stderr: -386> 2024-09-12T17:32:06.945+0000 7fc53a604640 4 mgrc reconnect Starting new session with [v2:172.21.15.40:6816/3916250676,v1:172.21.15.40:6817/3916250676] 2024-09-12T17:32:07.306 INFO:tasks.workunit.client.0.smithi037.stderr: -385> 2024-09-12T17:32:06.945+0000 7fc64d1a4640 10 monclient: get_auth_request con 0x7fc5340764a0 auth_method 0 2024-09-12T17:32:07.307 INFO:tasks.workunit.client.0.smithi037.stderr: -384> 2024-09-12T17:32:06.945+0000 7fc64e1a6640 10 monclient: get_auth_request con 0x561d8e352670 auth_method 0 2024-09-12T17:32:07.307 INFO:tasks.workunit.client.0.smithi037.stderr: -383> 2024-09-12T17:32:06.946+0000 7fc64d9a5640 10 monclient: get_auth_request con 0x561d8e3751d0 auth_method 0 2024-09-12T17:32:07.307 INFO:tasks.workunit.client.0.smithi037.stderr: -382> 2024-09-12T17:32:06.947+0000 7fc64d1a4640 10 monclient: get_auth_request con 0x561d8e37a260 auth_method 0 2024-09-12T17:32:07.307 INFO:tasks.workunit.client.0.smithi037.stderr: -381> 2024-09-12T17:32:06.948+0000 7fc64febb800 10 monclient: build_initial_monmap 2024-09-12T17:32:07.307 INFO:tasks.workunit.client.0.smithi037.stderr: -380> 2024-09-12T17:32:06.948+0000 7fc64febb800 1 build_initial for_mkfs: 0 2024-09-12T17:32:07.307 INFO:tasks.workunit.client.0.smithi037.stderr: -379> 2024-09-12T17:32:06.948+0000 7fc64febb800 10 monclient: monmap: 2024-09-12T17:32:07.307 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 0 2024-09-12T17:32:07.307 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:32:07.307 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 0.000000 2024-09-12T17:32:07.307 INFO:tasks.workunit.client.0.smithi037.stderr:created 0.000000 2024-09-12T17:32:07.307 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 0 (unknown) 2024-09-12T17:32:07.307 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:32:07.308 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.noname-a 2024-09-12T17:32:07.308 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.noname-b 2024-09-12T17:32:07.308 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.noname-c 2024-09-12T17:32:07.308 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:32:07.308 INFO:tasks.workunit.client.0.smithi037.stderr: -378> 2024-09-12T17:32:06.948+0000 7fc64febb800 5 AuthRegistry(0x561d8e37e0e0) adding auth protocol: cephx 2024-09-12T17:32:07.308 INFO:tasks.workunit.client.0.smithi037.stderr: -377> 2024-09-12T17:32:06.948+0000 7fc64febb800 5 AuthRegistry(0x561d8e37e0e0) adding auth protocol: cephx 2024-09-12T17:32:07.308 INFO:tasks.workunit.client.0.smithi037.stderr: -376> 2024-09-12T17:32:06.948+0000 7fc64febb800 5 AuthRegistry(0x561d8e37e0e0) adding auth protocol: cephx 2024-09-12T17:32:07.308 INFO:tasks.workunit.client.0.smithi037.stderr: -375> 2024-09-12T17:32:06.948+0000 7fc64febb800 5 AuthRegistry(0x561d8e37e0e0) adding con mode: secure 2024-09-12T17:32:07.308 INFO:tasks.workunit.client.0.smithi037.stderr: -374> 2024-09-12T17:32:06.948+0000 7fc64febb800 5 AuthRegistry(0x561d8e37e0e0) adding con mode: crc 2024-09-12T17:32:07.308 INFO:tasks.workunit.client.0.smithi037.stderr: -373> 2024-09-12T17:32:06.948+0000 7fc64febb800 5 AuthRegistry(0x561d8e37e0e0) adding con mode: secure 2024-09-12T17:32:07.308 INFO:tasks.workunit.client.0.smithi037.stderr: -372> 2024-09-12T17:32:06.948+0000 7fc64febb800 5 AuthRegistry(0x561d8e37e0e0) adding con mode: crc 2024-09-12T17:32:07.309 INFO:tasks.workunit.client.0.smithi037.stderr: -371> 2024-09-12T17:32:06.948+0000 7fc64febb800 5 AuthRegistry(0x561d8e37e0e0) adding con mode: secure 2024-09-12T17:32:07.309 INFO:tasks.workunit.client.0.smithi037.stderr: -370> 2024-09-12T17:32:06.948+0000 7fc64febb800 5 AuthRegistry(0x561d8e37e0e0) adding con mode: crc 2024-09-12T17:32:07.309 INFO:tasks.workunit.client.0.smithi037.stderr: -369> 2024-09-12T17:32:06.948+0000 7fc64febb800 5 AuthRegistry(0x561d8e37e0e0) adding con mode: crc 2024-09-12T17:32:07.309 INFO:tasks.workunit.client.0.smithi037.stderr: -368> 2024-09-12T17:32:06.948+0000 7fc64febb800 5 AuthRegistry(0x561d8e37e0e0) adding con mode: secure 2024-09-12T17:32:07.309 INFO:tasks.workunit.client.0.smithi037.stderr: -367> 2024-09-12T17:32:06.948+0000 7fc64febb800 5 AuthRegistry(0x561d8e37e0e0) adding con mode: crc 2024-09-12T17:32:07.309 INFO:tasks.workunit.client.0.smithi037.stderr: -366> 2024-09-12T17:32:06.948+0000 7fc64febb800 5 AuthRegistry(0x561d8e37e0e0) adding con mode: secure 2024-09-12T17:32:07.309 INFO:tasks.workunit.client.0.smithi037.stderr: -365> 2024-09-12T17:32:06.948+0000 7fc64febb800 5 AuthRegistry(0x561d8e37e0e0) adding con mode: crc 2024-09-12T17:32:07.309 INFO:tasks.workunit.client.0.smithi037.stderr: -364> 2024-09-12T17:32:06.948+0000 7fc64febb800 5 AuthRegistry(0x561d8e37e0e0) adding con mode: secure 2024-09-12T17:32:07.309 INFO:tasks.workunit.client.0.smithi037.stderr: -363> 2024-09-12T17:32:06.949+0000 7fc64febb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:32:07.309 INFO:tasks.workunit.client.0.smithi037.stderr: -362> 2024-09-12T17:32:06.949+0000 7fc64febb800 5 asok(0x561d8e107730) register_command objecter_requests cmddesc objecter_requests hook 0x561d8e381590 EEXIST 2024-09-12T17:32:07.310 INFO:tasks.workunit.client.0.smithi037.stderr: -361> 2024-09-12T17:32:06.949+0000 7fc64febb800 10 monclient: init 2024-09-12T17:32:07.310 INFO:tasks.workunit.client.0.smithi037.stderr: -360> 2024-09-12T17:32:06.949+0000 7fc64febb800 5 AuthRegistry(0x561d8e37d098) adding auth protocol: cephx 2024-09-12T17:32:07.310 INFO:tasks.workunit.client.0.smithi037.stderr: -359> 2024-09-12T17:32:06.949+0000 7fc64febb800 5 AuthRegistry(0x561d8e37d098) adding auth protocol: cephx 2024-09-12T17:32:07.310 INFO:tasks.workunit.client.0.smithi037.stderr: -358> 2024-09-12T17:32:06.949+0000 7fc64febb800 5 AuthRegistry(0x561d8e37d098) adding auth protocol: cephx 2024-09-12T17:32:07.310 INFO:tasks.workunit.client.0.smithi037.stderr: -357> 2024-09-12T17:32:06.949+0000 7fc64febb800 5 AuthRegistry(0x561d8e37d098) adding con mode: secure 2024-09-12T17:32:07.310 INFO:tasks.workunit.client.0.smithi037.stderr: -356> 2024-09-12T17:32:06.949+0000 7fc64febb800 5 AuthRegistry(0x561d8e37d098) adding con mode: crc 2024-09-12T17:32:07.310 INFO:tasks.workunit.client.0.smithi037.stderr: -355> 2024-09-12T17:32:06.949+0000 7fc64febb800 5 AuthRegistry(0x561d8e37d098) adding con mode: secure 2024-09-12T17:32:07.310 INFO:tasks.workunit.client.0.smithi037.stderr: -354> 2024-09-12T17:32:06.949+0000 7fc64febb800 5 AuthRegistry(0x561d8e37d098) adding con mode: crc 2024-09-12T17:32:07.310 INFO:tasks.workunit.client.0.smithi037.stderr: -353> 2024-09-12T17:32:06.949+0000 7fc64febb800 5 AuthRegistry(0x561d8e37d098) adding con mode: secure 2024-09-12T17:32:07.310 INFO:tasks.workunit.client.0.smithi037.stderr: -352> 2024-09-12T17:32:06.949+0000 7fc64febb800 5 AuthRegistry(0x561d8e37d098) adding con mode: crc 2024-09-12T17:32:07.310 INFO:tasks.workunit.client.0.smithi037.stderr: -351> 2024-09-12T17:32:06.949+0000 7fc64febb800 5 AuthRegistry(0x561d8e37d098) adding con mode: crc 2024-09-12T17:32:07.310 INFO:tasks.workunit.client.0.smithi037.stderr: -350> 2024-09-12T17:32:06.949+0000 7fc64febb800 5 AuthRegistry(0x561d8e37d098) adding con mode: secure 2024-09-12T17:32:07.311 INFO:tasks.workunit.client.0.smithi037.stderr: -349> 2024-09-12T17:32:06.949+0000 7fc64febb800 5 AuthRegistry(0x561d8e37d098) adding con mode: crc 2024-09-12T17:32:07.311 INFO:tasks.workunit.client.0.smithi037.stderr: -348> 2024-09-12T17:32:06.949+0000 7fc64febb800 5 AuthRegistry(0x561d8e37d098) adding con mode: secure 2024-09-12T17:32:07.311 INFO:tasks.workunit.client.0.smithi037.stderr: -347> 2024-09-12T17:32:06.949+0000 7fc64febb800 5 AuthRegistry(0x561d8e37d098) adding con mode: crc 2024-09-12T17:32:07.311 INFO:tasks.workunit.client.0.smithi037.stderr: -346> 2024-09-12T17:32:06.949+0000 7fc64febb800 5 AuthRegistry(0x561d8e37d098) adding con mode: secure 2024-09-12T17:32:07.311 INFO:tasks.workunit.client.0.smithi037.stderr: -345> 2024-09-12T17:32:06.949+0000 7fc64febb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:32:07.311 INFO:tasks.workunit.client.0.smithi037.stderr: -344> 2024-09-12T17:32:06.949+0000 7fc64febb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:32:07.311 INFO:tasks.workunit.client.0.smithi037.stderr: -343> 2024-09-12T17:32:06.949+0000 7fc64febb800 5 asok(0x561d8e107730) register_command rotate-key cmddesc rotate-key hook 0x561d8e37d1e0 EEXIST 2024-09-12T17:32:07.311 INFO:tasks.workunit.client.0.smithi037.stderr: -342> 2024-09-12T17:32:06.949+0000 7fc64febb800 10 monclient: _reopen_session rank -1 2024-09-12T17:32:07.311 INFO:tasks.workunit.client.0.smithi037.stderr: -341> 2024-09-12T17:32:06.949+0000 7fc64febb800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T17:32:07.311 INFO:tasks.workunit.client.0.smithi037.stderr: -340> 2024-09-12T17:32:06.950+0000 7fc64febb800 10 monclient(hunting): picked mon.noname-b con 0x561d8e3a58b0 addr [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] 2024-09-12T17:32:07.311 INFO:tasks.workunit.client.0.smithi037.stderr: -339> 2024-09-12T17:32:06.950+0000 7fc64febb800 10 monclient(hunting): picked mon.noname-c con 0x561d8e3a5c90 addr [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] 2024-09-12T17:32:07.311 INFO:tasks.workunit.client.0.smithi037.stderr: -338> 2024-09-12T17:32:06.950+0000 7fc64febb800 10 monclient(hunting): picked mon.noname-a con 0x561d8e3a45c0 addr [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] 2024-09-12T17:32:07.312 INFO:tasks.workunit.client.0.smithi037.stderr: -337> 2024-09-12T17:32:06.950+0000 7fc64febb800 10 monclient(hunting): start opening mon connection 2024-09-12T17:32:07.312 INFO:tasks.workunit.client.0.smithi037.stderr: -336> 2024-09-12T17:32:06.950+0000 7fc64febb800 10 monclient(hunting): start opening mon connection 2024-09-12T17:32:07.312 INFO:tasks.workunit.client.0.smithi037.stderr: -335> 2024-09-12T17:32:06.950+0000 7fc64febb800 10 monclient(hunting): start opening mon connection 2024-09-12T17:32:07.312 INFO:tasks.workunit.client.0.smithi037.stderr: -334> 2024-09-12T17:32:06.950+0000 7fc64febb800 10 monclient(hunting): _renew_subs 2024-09-12T17:32:07.312 INFO:tasks.workunit.client.0.smithi037.stderr: -333> 2024-09-12T17:32:06.950+0000 7fc64febb800 10 monclient(hunting): authenticate will time out at 2114.547044s 2024-09-12T17:32:07.312 INFO:tasks.workunit.client.0.smithi037.stderr: -332> 2024-09-12T17:32:06.950+0000 7fc64d1a4640 10 monclient(hunting): get_auth_request con 0x561d8e3a5c90 auth_method 0 2024-09-12T17:32:07.312 INFO:tasks.workunit.client.0.smithi037.stderr: -331> 2024-09-12T17:32:06.950+0000 7fc64d1a4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:32:07.312 INFO:tasks.workunit.client.0.smithi037.stderr: -330> 2024-09-12T17:32:06.950+0000 7fc64d1a4640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:32:07.312 INFO:tasks.workunit.client.0.smithi037.stderr: -329> 2024-09-12T17:32:06.950+0000 7fc64d1a4640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:32:07.312 INFO:tasks.workunit.client.0.smithi037.stderr: -328> 2024-09-12T17:32:06.950+0000 7fc64e1a6640 10 monclient(hunting): get_auth_request con 0x561d8e3a45c0 auth_method 0 2024-09-12T17:32:07.312 INFO:tasks.workunit.client.0.smithi037.stderr: -327> 2024-09-12T17:32:06.950+0000 7fc64e1a6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:32:07.312 INFO:tasks.workunit.client.0.smithi037.stderr: -326> 2024-09-12T17:32:06.950+0000 7fc64e1a6640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:32:07.313 INFO:tasks.workunit.client.0.smithi037.stderr: -325> 2024-09-12T17:32:06.950+0000 7fc64e1a6640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:32:07.313 INFO:tasks.workunit.client.0.smithi037.stderr: -324> 2024-09-12T17:32:06.950+0000 7fc64d9a5640 10 monclient(hunting): get_auth_request con 0x561d8e3a58b0 auth_method 0 2024-09-12T17:32:07.313 INFO:tasks.workunit.client.0.smithi037.stderr: -323> 2024-09-12T17:32:06.950+0000 7fc64d9a5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:32:07.313 INFO:tasks.workunit.client.0.smithi037.stderr: -322> 2024-09-12T17:32:06.950+0000 7fc64d9a5640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:32:07.313 INFO:tasks.workunit.client.0.smithi037.stderr: -321> 2024-09-12T17:32:06.950+0000 7fc64d9a5640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:32:07.313 INFO:tasks.workunit.client.0.smithi037.stderr: -320> 2024-09-12T17:32:06.950+0000 7fc64d1a4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:32:07.313 INFO:tasks.workunit.client.0.smithi037.stderr: -319> 2024-09-12T17:32:06.950+0000 7fc64d1a4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:32:07.313 INFO:tasks.workunit.client.0.smithi037.stderr: -318> 2024-09-12T17:32:06.950+0000 7fc64d1a4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:32:07.313 INFO:tasks.workunit.client.0.smithi037.stderr: -317> 2024-09-12T17:32:06.950+0000 7fc64e1a6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:32:07.313 INFO:tasks.workunit.client.0.smithi037.stderr: -316> 2024-09-12T17:32:06.950+0000 7fc64e1a6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:32:07.313 INFO:tasks.workunit.client.0.smithi037.stderr: -315> 2024-09-12T17:32:06.950+0000 7fc64e1a6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:32:07.314 INFO:tasks.workunit.client.0.smithi037.stderr: -314> 2024-09-12T17:32:06.950+0000 7fc64d9a5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:32:07.314 INFO:tasks.workunit.client.0.smithi037.stderr: -313> 2024-09-12T17:32:06.950+0000 7fc64d9a5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:32:07.314 INFO:tasks.workunit.client.0.smithi037.stderr: -312> 2024-09-12T17:32:06.950+0000 7fc64d9a5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:32:07.314 INFO:tasks.workunit.client.0.smithi037.stderr: -311> 2024-09-12T17:32:06.950+0000 7fc64d1a4640 10 monclient(hunting): handle_auth_done global_id 6047 payload 824 2024-09-12T17:32:07.314 INFO:tasks.workunit.client.0.smithi037.stderr: -310> 2024-09-12T17:32:06.950+0000 7fc64d1a4640 10 monclient: _finish_hunting 0 2024-09-12T17:32:07.314 INFO:tasks.workunit.client.0.smithi037.stderr: -309> 2024-09-12T17:32:06.950+0000 7fc64d1a4640 1 monclient: found mon.noname-c 2024-09-12T17:32:07.314 INFO:tasks.workunit.client.0.smithi037.stderr: -308> 2024-09-12T17:32:06.950+0000 7fc64d1a4640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.37:3301/0 2024-09-12T17:32:07.314 INFO:tasks.workunit.client.0.smithi037.stderr: -307> 2024-09-12T17:32:06.950+0000 7fc5337fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:32:07.314 INFO:tasks.workunit.client.0.smithi037.stderr: -306> 2024-09-12T17:32:06.950+0000 7fc5337fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:32:07.314 INFO:tasks.workunit.client.0.smithi037.stderr: -305> 2024-09-12T17:32:06.950+0000 7fc5337fe640 10 monclient: dump: 2024-09-12T17:32:07.314 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:32:07.314 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:32:07.315 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:32:07.315 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:32:07.315 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:32:07.315 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:32:07.315 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:32:07.315 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:32:07.315 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:32:07.315 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:32:07.315 INFO:tasks.workunit.client.0.smithi037.stderr: -304> 2024-09-12T17:32:06.950+0000 7fc5337fe640 10 monclient: _finish_auth 0 2024-09-12T17:32:07.315 INFO:tasks.workunit.client.0.smithi037.stderr: -303> 2024-09-12T17:32:06.950+0000 7fc5337fe640 10 monclient: _check_auth_tickets 2024-09-12T17:32:07.315 INFO:tasks.workunit.client.0.smithi037.stderr: -302> 2024-09-12T17:32:06.950+0000 7fc64febb800 5 monclient: authenticate success, global_id 6047 2024-09-12T17:32:07.316 INFO:tasks.workunit.client.0.smithi037.stderr: -301> 2024-09-12T17:32:06.950+0000 7fc64febb800 10 monclient: _renew_subs 2024-09-12T17:32:07.316 INFO:tasks.workunit.client.0.smithi037.stderr: -300> 2024-09-12T17:32:06.950+0000 7fc64febb800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.37:3301/0 2024-09-12T17:32:07.316 INFO:tasks.workunit.client.0.smithi037.stderr: -299> 2024-09-12T17:32:06.950+0000 7fc5337fe640 10 monclient: handle_config config(0 keys) 2024-09-12T17:32:07.316 INFO:tasks.workunit.client.0.smithi037.stderr: -298> 2024-09-12T17:32:06.950+0000 7fc5337fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:32:07.316 INFO:tasks.workunit.client.0.smithi037.stderr: -297> 2024-09-12T17:32:06.950+0000 7fc5337fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:32:07.316 INFO:tasks.workunit.client.0.smithi037.stderr: -296> 2024-09-12T17:32:06.950+0000 7fc5337fe640 10 monclient: dump: 2024-09-12T17:32:07.316 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:32:07.316 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:32:07.316 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:32:07.317 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:32:07.317 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:32:07.317 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:32:07.317 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:32:07.317 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:32:07.317 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:32:07.317 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:32:07.317 INFO:tasks.workunit.client.0.smithi037.stderr: -295> 2024-09-12T17:32:06.950+0000 7fc64e9a7640 4 set_mon_vals no callback set 2024-09-12T17:32:07.317 INFO:tasks.workunit.client.0.smithi037.stderr: -294> 2024-09-12T17:32:06.950+0000 7fc64febb800 10 monclient: _renew_subs 2024-09-12T17:32:07.317 INFO:tasks.workunit.client.0.smithi037.stderr: -293> 2024-09-12T17:32:06.950+0000 7fc64febb800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.37:3301/0 2024-09-12T17:32:07.317 INFO:tasks.workunit.client.0.smithi037.stderr: -292> 2024-09-12T17:32:06.952+0000 7fc5337fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:32:07.317 INFO:tasks.workunit.client.0.smithi037.stderr: -291> 2024-09-12T17:32:06.952+0000 7fc5337fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.40:6816/3916250676,v1:172.21.15.40:6817/3916250676] 2024-09-12T17:32:07.318 INFO:tasks.workunit.client.0.smithi037.stderr: -290> 2024-09-12T17:32:06.952+0000 7fc5337fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.40:6816/3916250676,v1:172.21.15.40:6817/3916250676] 2024-09-12T17:32:07.318 INFO:tasks.workunit.client.0.smithi037.stderr: -289> 2024-09-12T17:32:06.953+0000 7fc64d9a5640 10 monclient: get_auth_request con 0x7fc528076380 auth_method 0 2024-09-12T17:32:07.318 INFO:tasks.workunit.client.0.smithi037.stderr: -288> 2024-09-12T17:32:06.953+0000 7fc64febb800 10 monclient: get_monmap_and_config 2024-09-12T17:32:07.318 INFO:tasks.workunit.client.0.smithi037.stderr: -287> 2024-09-12T17:32:06.953+0000 7fc64febb800 10 monclient: build_initial_monmap 2024-09-12T17:32:07.318 INFO:tasks.workunit.client.0.smithi037.stderr: -286> 2024-09-12T17:32:06.953+0000 7fc64febb800 1 build_initial for_mkfs: 0 2024-09-12T17:32:07.318 INFO:tasks.workunit.client.0.smithi037.stderr: -285> 2024-09-12T17:32:06.953+0000 7fc64febb800 10 monclient: monmap: 2024-09-12T17:32:07.318 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 0 2024-09-12T17:32:07.318 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:32:07.318 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 0.000000 2024-09-12T17:32:07.318 INFO:tasks.workunit.client.0.smithi037.stderr:created 0.000000 2024-09-12T17:32:07.318 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 0 (unknown) 2024-09-12T17:32:07.319 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:32:07.319 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.noname-a 2024-09-12T17:32:07.319 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.noname-b 2024-09-12T17:32:07.319 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.noname-c 2024-09-12T17:32:07.319 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:32:07.319 INFO:tasks.workunit.client.0.smithi037.stderr: -284> 2024-09-12T17:32:06.953+0000 7fc64febb800 5 AuthRegistry(0x561d8e3c5630) adding auth protocol: cephx 2024-09-12T17:32:07.319 INFO:tasks.workunit.client.0.smithi037.stderr: -283> 2024-09-12T17:32:06.953+0000 7fc64febb800 5 AuthRegistry(0x561d8e3c5630) adding auth protocol: cephx 2024-09-12T17:32:07.319 INFO:tasks.workunit.client.0.smithi037.stderr: -282> 2024-09-12T17:32:06.953+0000 7fc64febb800 5 AuthRegistry(0x561d8e3c5630) adding auth protocol: cephx 2024-09-12T17:32:07.319 INFO:tasks.workunit.client.0.smithi037.stderr: -281> 2024-09-12T17:32:06.953+0000 7fc64febb800 5 AuthRegistry(0x561d8e3c5630) adding con mode: secure 2024-09-12T17:32:07.319 INFO:tasks.workunit.client.0.smithi037.stderr: -280> 2024-09-12T17:32:06.953+0000 7fc64febb800 5 AuthRegistry(0x561d8e3c5630) adding con mode: crc 2024-09-12T17:32:07.319 INFO:tasks.workunit.client.0.smithi037.stderr: -279> 2024-09-12T17:32:06.953+0000 7fc64febb800 5 AuthRegistry(0x561d8e3c5630) adding con mode: secure 2024-09-12T17:32:07.320 INFO:tasks.workunit.client.0.smithi037.stderr: -278> 2024-09-12T17:32:06.953+0000 7fc64febb800 5 AuthRegistry(0x561d8e3c5630) adding con mode: crc 2024-09-12T17:32:07.320 INFO:tasks.workunit.client.0.smithi037.stderr: -277> 2024-09-12T17:32:06.953+0000 7fc64febb800 5 AuthRegistry(0x561d8e3c5630) adding con mode: secure 2024-09-12T17:32:07.320 INFO:tasks.workunit.client.0.smithi037.stderr: -276> 2024-09-12T17:32:06.953+0000 7fc64febb800 5 AuthRegistry(0x561d8e3c5630) adding con mode: crc 2024-09-12T17:32:07.320 INFO:tasks.workunit.client.0.smithi037.stderr: -275> 2024-09-12T17:32:06.953+0000 7fc64febb800 5 AuthRegistry(0x561d8e3c5630) adding con mode: crc 2024-09-12T17:32:07.320 INFO:tasks.workunit.client.0.smithi037.stderr: -274> 2024-09-12T17:32:06.953+0000 7fc64febb800 5 AuthRegistry(0x561d8e3c5630) adding con mode: secure 2024-09-12T17:32:07.320 INFO:tasks.workunit.client.0.smithi037.stderr: -273> 2024-09-12T17:32:06.953+0000 7fc64febb800 5 AuthRegistry(0x561d8e3c5630) adding con mode: crc 2024-09-12T17:32:07.320 INFO:tasks.workunit.client.0.smithi037.stderr: -272> 2024-09-12T17:32:06.953+0000 7fc64febb800 5 AuthRegistry(0x561d8e3c5630) adding con mode: secure 2024-09-12T17:32:07.320 INFO:tasks.workunit.client.0.smithi037.stderr: -271> 2024-09-12T17:32:06.953+0000 7fc64febb800 5 AuthRegistry(0x561d8e3c5630) adding con mode: crc 2024-09-12T17:32:07.321 INFO:tasks.workunit.client.0.smithi037.stderr: -270> 2024-09-12T17:32:06.953+0000 7fc64febb800 5 AuthRegistry(0x561d8e3c5630) adding con mode: secure 2024-09-12T17:32:07.321 INFO:tasks.workunit.client.0.smithi037.stderr: -269> 2024-09-12T17:32:06.953+0000 7fc64febb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:32:07.321 INFO:tasks.workunit.client.0.smithi037.stderr: -268> 2024-09-12T17:32:06.953+0000 7fc64febb800 10 monclient: init 2024-09-12T17:32:07.321 INFO:tasks.workunit.client.0.smithi037.stderr: -267> 2024-09-12T17:32:06.953+0000 7fc64febb800 5 AuthRegistry(0x7fff10c4d030) adding auth protocol: cephx 2024-09-12T17:32:07.321 INFO:tasks.workunit.client.0.smithi037.stderr: -266> 2024-09-12T17:32:06.953+0000 7fc64febb800 5 AuthRegistry(0x7fff10c4d030) adding auth protocol: cephx 2024-09-12T17:32:07.321 INFO:tasks.workunit.client.0.smithi037.stderr: -265> 2024-09-12T17:32:06.953+0000 7fc64febb800 5 AuthRegistry(0x7fff10c4d030) adding auth protocol: cephx 2024-09-12T17:32:07.321 INFO:tasks.workunit.client.0.smithi037.stderr: -264> 2024-09-12T17:32:06.953+0000 7fc64febb800 5 AuthRegistry(0x7fff10c4d030) adding con mode: secure 2024-09-12T17:32:07.321 INFO:tasks.workunit.client.0.smithi037.stderr: -263> 2024-09-12T17:32:06.953+0000 7fc64febb800 5 AuthRegistry(0x7fff10c4d030) adding con mode: crc 2024-09-12T17:32:07.321 INFO:tasks.workunit.client.0.smithi037.stderr: -262> 2024-09-12T17:32:06.953+0000 7fc64febb800 5 AuthRegistry(0x7fff10c4d030) adding con mode: secure 2024-09-12T17:32:07.322 INFO:tasks.workunit.client.0.smithi037.stderr: -261> 2024-09-12T17:32:06.953+0000 7fc64febb800 5 AuthRegistry(0x7fff10c4d030) adding con mode: crc 2024-09-12T17:32:07.322 INFO:tasks.workunit.client.0.smithi037.stderr: -260> 2024-09-12T17:32:06.953+0000 7fc64febb800 5 AuthRegistry(0x7fff10c4d030) adding con mode: secure 2024-09-12T17:32:07.322 INFO:tasks.workunit.client.0.smithi037.stderr: -259> 2024-09-12T17:32:06.953+0000 7fc64febb800 5 AuthRegistry(0x7fff10c4d030) adding con mode: crc 2024-09-12T17:32:07.322 INFO:tasks.workunit.client.0.smithi037.stderr: -258> 2024-09-12T17:32:06.953+0000 7fc64febb800 5 AuthRegistry(0x7fff10c4d030) adding con mode: crc 2024-09-12T17:32:07.322 INFO:tasks.workunit.client.0.smithi037.stderr: -257> 2024-09-12T17:32:06.953+0000 7fc64febb800 5 AuthRegistry(0x7fff10c4d030) adding con mode: secure 2024-09-12T17:32:07.322 INFO:tasks.workunit.client.0.smithi037.stderr: -256> 2024-09-12T17:32:06.953+0000 7fc64febb800 5 AuthRegistry(0x7fff10c4d030) adding con mode: crc 2024-09-12T17:32:07.322 INFO:tasks.workunit.client.0.smithi037.stderr: -255> 2024-09-12T17:32:06.953+0000 7fc64febb800 5 AuthRegistry(0x7fff10c4d030) adding con mode: secure 2024-09-12T17:32:07.322 INFO:tasks.workunit.client.0.smithi037.stderr: -254> 2024-09-12T17:32:06.953+0000 7fc64febb800 5 AuthRegistry(0x7fff10c4d030) adding con mode: crc 2024-09-12T17:32:07.322 INFO:tasks.workunit.client.0.smithi037.stderr: -253> 2024-09-12T17:32:06.953+0000 7fc64febb800 5 AuthRegistry(0x7fff10c4d030) adding con mode: secure 2024-09-12T17:32:07.322 INFO:tasks.workunit.client.0.smithi037.stderr: -252> 2024-09-12T17:32:06.953+0000 7fc64febb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:32:07.322 INFO:tasks.workunit.client.0.smithi037.stderr: -251> 2024-09-12T17:32:06.954+0000 7fc64febb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:32:07.322 INFO:tasks.workunit.client.0.smithi037.stderr: -250> 2024-09-12T17:32:06.954+0000 7fc64febb800 5 asok(0x561d8e107730) register_command rotate-key cmddesc rotate-key hook 0x7fff10c4d178 EEXIST 2024-09-12T17:32:07.323 INFO:tasks.workunit.client.0.smithi037.stderr: -249> 2024-09-12T17:32:06.954+0000 7fc64febb800 10 monclient: _reopen_session rank -1 2024-09-12T17:32:07.323 INFO:tasks.workunit.client.0.smithi037.stderr: -248> 2024-09-12T17:32:06.954+0000 7fc64febb800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T17:32:07.323 INFO:tasks.workunit.client.0.smithi037.stderr: -247> 2024-09-12T17:32:06.954+0000 7fc64febb800 10 monclient(hunting): picked mon.noname-c con 0x561d8e3f9bf0 addr [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] 2024-09-12T17:32:07.323 INFO:tasks.workunit.client.0.smithi037.stderr: -246> 2024-09-12T17:32:06.954+0000 7fc64febb800 10 monclient(hunting): picked mon.noname-a con 0x561d8e3ea880 addr [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] 2024-09-12T17:32:07.323 INFO:tasks.workunit.client.0.smithi037.stderr: -245> 2024-09-12T17:32:06.954+0000 7fc64febb800 10 monclient(hunting): picked mon.noname-b con 0x561d8e3f5020 addr [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] 2024-09-12T17:32:07.323 INFO:tasks.workunit.client.0.smithi037.stderr: -244> 2024-09-12T17:32:06.954+0000 7fc64febb800 10 monclient(hunting): start opening mon connection 2024-09-12T17:32:07.323 INFO:tasks.workunit.client.0.smithi037.stderr: -243> 2024-09-12T17:32:06.954+0000 7fc64febb800 10 monclient(hunting): start opening mon connection 2024-09-12T17:32:07.323 INFO:tasks.workunit.client.0.smithi037.stderr: -242> 2024-09-12T17:32:06.954+0000 7fc64febb800 10 monclient(hunting): start opening mon connection 2024-09-12T17:32:07.323 INFO:tasks.workunit.client.0.smithi037.stderr: -241> 2024-09-12T17:32:06.954+0000 7fc64febb800 10 monclient(hunting): _renew_subs 2024-09-12T17:32:07.323 INFO:tasks.workunit.client.0.smithi037.stderr: -240> 2024-09-12T17:32:06.954+0000 7fc64febb800 10 monclient(hunting): authenticate will time out at 2114.551262s 2024-09-12T17:32:07.323 INFO:tasks.workunit.client.0.smithi037.stderr: -239> 2024-09-12T17:32:06.954+0000 7fc64d1a4640 10 monclient(hunting): get_auth_request con 0x561d8e3ea880 auth_method 0 2024-09-12T17:32:07.323 INFO:tasks.workunit.client.0.smithi037.stderr: -238> 2024-09-12T17:32:06.954+0000 7fc64d1a4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:32:07.324 INFO:tasks.workunit.client.0.smithi037.stderr: -237> 2024-09-12T17:32:06.954+0000 7fc64d1a4640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:32:07.324 INFO:tasks.workunit.client.0.smithi037.stderr: -236> 2024-09-12T17:32:06.954+0000 7fc64d1a4640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:32:07.324 INFO:tasks.workunit.client.0.smithi037.stderr: -235> 2024-09-12T17:32:06.954+0000 7fc64d9a5640 10 monclient(hunting): get_auth_request con 0x561d8e3f9bf0 auth_method 0 2024-09-12T17:32:07.324 INFO:tasks.workunit.client.0.smithi037.stderr: -234> 2024-09-12T17:32:06.954+0000 7fc64d9a5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:32:07.324 INFO:tasks.workunit.client.0.smithi037.stderr: -233> 2024-09-12T17:32:06.954+0000 7fc64d9a5640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:32:07.324 INFO:tasks.workunit.client.0.smithi037.stderr: -232> 2024-09-12T17:32:06.954+0000 7fc64d9a5640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:32:07.324 INFO:tasks.workunit.client.0.smithi037.stderr: -231> 2024-09-12T17:32:06.954+0000 7fc64e1a6640 10 monclient(hunting): get_auth_request con 0x561d8e3f5020 auth_method 0 2024-09-12T17:32:07.324 INFO:tasks.workunit.client.0.smithi037.stderr: -230> 2024-09-12T17:32:06.954+0000 7fc64e1a6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:32:07.324 INFO:tasks.workunit.client.0.smithi037.stderr: -229> 2024-09-12T17:32:06.954+0000 7fc64e1a6640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:32:07.324 INFO:tasks.workunit.client.0.smithi037.stderr: -228> 2024-09-12T17:32:06.954+0000 7fc64e1a6640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:32:07.324 INFO:tasks.workunit.client.0.smithi037.stderr: -227> 2024-09-12T17:32:06.954+0000 7fc64d1a4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:32:07.325 INFO:tasks.workunit.client.0.smithi037.stderr: -226> 2024-09-12T17:32:06.954+0000 7fc64d1a4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:32:07.325 INFO:tasks.workunit.client.0.smithi037.stderr: -225> 2024-09-12T17:32:06.954+0000 7fc64d1a4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:32:07.325 INFO:tasks.workunit.client.0.smithi037.stderr: -224> 2024-09-12T17:32:06.954+0000 7fc64d9a5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:32:07.325 INFO:tasks.workunit.client.0.smithi037.stderr: -223> 2024-09-12T17:32:06.954+0000 7fc64d9a5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:32:07.325 INFO:tasks.workunit.client.0.smithi037.stderr: -222> 2024-09-12T17:32:06.954+0000 7fc64d9a5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:32:07.325 INFO:tasks.workunit.client.0.smithi037.stderr: -221> 2024-09-12T17:32:06.954+0000 7fc64e1a6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:32:07.325 INFO:tasks.workunit.client.0.smithi037.stderr: -220> 2024-09-12T17:32:06.954+0000 7fc64e1a6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:32:07.325 INFO:tasks.workunit.client.0.smithi037.stderr: -219> 2024-09-12T17:32:06.954+0000 7fc64e1a6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:32:07.325 INFO:tasks.workunit.client.0.smithi037.stderr: -218> 2024-09-12T17:32:06.954+0000 7fc64d1a4640 10 monclient(hunting): handle_auth_done global_id 6384 payload 274 2024-09-12T17:32:07.325 INFO:tasks.workunit.client.0.smithi037.stderr: -217> 2024-09-12T17:32:06.954+0000 7fc64d1a4640 10 monclient: _finish_hunting 0 2024-09-12T17:32:07.325 INFO:tasks.workunit.client.0.smithi037.stderr: -216> 2024-09-12T17:32:06.954+0000 7fc64d1a4640 1 monclient: found mon.noname-a 2024-09-12T17:32:07.325 INFO:tasks.workunit.client.0.smithi037.stderr: -215> 2024-09-12T17:32:06.954+0000 7fc64d1a4640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.37:3300/0 2024-09-12T17:32:07.326 INFO:tasks.workunit.client.0.smithi037.stderr: -214> 2024-09-12T17:32:06.954+0000 7fc5317fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:32:07.326 INFO:tasks.workunit.client.0.smithi037.stderr: -213> 2024-09-12T17:32:06.954+0000 7fc5317fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:32:07.326 INFO:tasks.workunit.client.0.smithi037.stderr: -212> 2024-09-12T17:32:06.954+0000 7fc5317fa640 10 monclient: dump: 2024-09-12T17:32:07.326 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:32:07.326 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:32:07.326 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:32:07.326 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:32:07.326 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:32:07.326 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:32:07.326 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:32:07.326 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:32:07.326 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:32:07.327 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:32:07.327 INFO:tasks.workunit.client.0.smithi037.stderr: -211> 2024-09-12T17:32:06.954+0000 7fc5317fa640 10 monclient: _finish_auth 0 2024-09-12T17:32:07.327 INFO:tasks.workunit.client.0.smithi037.stderr: -210> 2024-09-12T17:32:06.954+0000 7fc5317fa640 10 monclient: _check_auth_tickets 2024-09-12T17:32:07.327 INFO:tasks.workunit.client.0.smithi037.stderr: -209> 2024-09-12T17:32:06.954+0000 7fc5317fa640 10 monclient: handle_config config(0 keys) 2024-09-12T17:32:07.327 INFO:tasks.workunit.client.0.smithi037.stderr: -208> 2024-09-12T17:32:06.954+0000 7fc5317fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:32:07.327 INFO:tasks.workunit.client.0.smithi037.stderr: -207> 2024-09-12T17:32:06.954+0000 7fc5317fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:32:07.327 INFO:tasks.workunit.client.0.smithi037.stderr: -206> 2024-09-12T17:32:06.954+0000 7fc5317fa640 10 monclient: dump: 2024-09-12T17:32:07.327 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:32:07.327 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:32:07.327 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:32:07.327 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:32:07.327 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:32:07.328 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:32:07.328 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:32:07.328 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:32:07.328 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:32:07.328 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:32:07.328 INFO:tasks.workunit.client.0.smithi037.stderr: -205> 2024-09-12T17:32:06.954+0000 7fc64febb800 5 monclient: authenticate success, global_id 6384 2024-09-12T17:32:07.328 INFO:tasks.workunit.client.0.smithi037.stderr: -204> 2024-09-12T17:32:06.954+0000 7fc64febb800 10 monclient: get_monmap_and_config success 2024-09-12T17:32:07.328 INFO:tasks.workunit.client.0.smithi037.stderr: -203> 2024-09-12T17:32:06.954+0000 7fc64febb800 4 set_mon_vals no callback set 2024-09-12T17:32:07.328 INFO:tasks.workunit.client.0.smithi037.stderr: -202> 2024-09-12T17:32:06.955+0000 7fc64febb800 10 monclient: shutdown 2024-09-12T17:32:07.328 INFO:tasks.workunit.client.0.smithi037.stderr: -201> 2024-09-12T17:32:06.955+0000 7fc64febb800 10 monclient: build_initial_monmap 2024-09-12T17:32:07.328 INFO:tasks.workunit.client.0.smithi037.stderr: -200> 2024-09-12T17:32:06.955+0000 7fc64febb800 1 build_initial for_mkfs: 0 2024-09-12T17:32:07.329 INFO:tasks.workunit.client.0.smithi037.stderr: -199> 2024-09-12T17:32:06.955+0000 7fc64febb800 10 monclient: monmap: 2024-09-12T17:32:07.329 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 0 2024-09-12T17:32:07.329 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:32:07.329 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 0.000000 2024-09-12T17:32:07.329 INFO:tasks.workunit.client.0.smithi037.stderr:created 0.000000 2024-09-12T17:32:07.329 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 0 (unknown) 2024-09-12T17:32:07.329 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:32:07.329 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.noname-a 2024-09-12T17:32:07.329 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.noname-b 2024-09-12T17:32:07.329 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.noname-c 2024-09-12T17:32:07.329 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:32:07.329 INFO:tasks.workunit.client.0.smithi037.stderr: -198> 2024-09-12T17:32:06.955+0000 7fc64febb800 5 AuthRegistry(0x561d8e3f3d20) adding auth protocol: cephx 2024-09-12T17:32:07.330 INFO:tasks.workunit.client.0.smithi037.stderr: -197> 2024-09-12T17:32:06.955+0000 7fc64febb800 5 AuthRegistry(0x561d8e3f3d20) adding auth protocol: cephx 2024-09-12T17:32:07.330 INFO:tasks.workunit.client.0.smithi037.stderr: -196> 2024-09-12T17:32:06.955+0000 7fc64febb800 5 AuthRegistry(0x561d8e3f3d20) adding auth protocol: cephx 2024-09-12T17:32:07.330 INFO:tasks.workunit.client.0.smithi037.stderr: -195> 2024-09-12T17:32:06.955+0000 7fc64febb800 5 AuthRegistry(0x561d8e3f3d20) adding con mode: secure 2024-09-12T17:32:07.330 INFO:tasks.workunit.client.0.smithi037.stderr: -194> 2024-09-12T17:32:06.955+0000 7fc64febb800 5 AuthRegistry(0x561d8e3f3d20) adding con mode: crc 2024-09-12T17:32:07.330 INFO:tasks.workunit.client.0.smithi037.stderr: -193> 2024-09-12T17:32:06.955+0000 7fc64febb800 5 AuthRegistry(0x561d8e3f3d20) adding con mode: secure 2024-09-12T17:32:07.330 INFO:tasks.workunit.client.0.smithi037.stderr: -192> 2024-09-12T17:32:06.955+0000 7fc64febb800 5 AuthRegistry(0x561d8e3f3d20) adding con mode: crc 2024-09-12T17:32:07.330 INFO:tasks.workunit.client.0.smithi037.stderr: -191> 2024-09-12T17:32:06.955+0000 7fc64febb800 5 AuthRegistry(0x561d8e3f3d20) adding con mode: secure 2024-09-12T17:32:07.330 INFO:tasks.workunit.client.0.smithi037.stderr: -190> 2024-09-12T17:32:06.955+0000 7fc64febb800 5 AuthRegistry(0x561d8e3f3d20) adding con mode: crc 2024-09-12T17:32:07.330 INFO:tasks.workunit.client.0.smithi037.stderr: -189> 2024-09-12T17:32:06.955+0000 7fc64febb800 5 AuthRegistry(0x561d8e3f3d20) adding con mode: crc 2024-09-12T17:32:07.330 INFO:tasks.workunit.client.0.smithi037.stderr: -188> 2024-09-12T17:32:06.955+0000 7fc64febb800 5 AuthRegistry(0x561d8e3f3d20) adding con mode: secure 2024-09-12T17:32:07.330 INFO:tasks.workunit.client.0.smithi037.stderr: -187> 2024-09-12T17:32:06.955+0000 7fc64febb800 5 AuthRegistry(0x561d8e3f3d20) adding con mode: crc 2024-09-12T17:32:07.330 INFO:tasks.workunit.client.0.smithi037.stderr: -186> 2024-09-12T17:32:06.955+0000 7fc64febb800 5 AuthRegistry(0x561d8e3f3d20) adding con mode: secure 2024-09-12T17:32:07.331 INFO:tasks.workunit.client.0.smithi037.stderr: -185> 2024-09-12T17:32:06.955+0000 7fc64febb800 5 AuthRegistry(0x561d8e3f3d20) adding con mode: crc 2024-09-12T17:32:07.331 INFO:tasks.workunit.client.0.smithi037.stderr: -184> 2024-09-12T17:32:06.955+0000 7fc64febb800 5 AuthRegistry(0x561d8e3f3d20) adding con mode: secure 2024-09-12T17:32:07.331 INFO:tasks.workunit.client.0.smithi037.stderr: -183> 2024-09-12T17:32:06.955+0000 7fc64febb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:32:07.331 INFO:tasks.workunit.client.0.smithi037.stderr: -182> 2024-09-12T17:32:06.955+0000 7fc64febb800 1 librados: starting msgr at 2024-09-12T17:32:07.331 INFO:tasks.workunit.client.0.smithi037.stderr: -181> 2024-09-12T17:32:06.955+0000 7fc64febb800 1 librados: starting objecter 2024-09-12T17:32:07.331 INFO:tasks.workunit.client.0.smithi037.stderr: -180> 2024-09-12T17:32:06.955+0000 7fc64febb800 5 asok(0x561d8e107730) register_command objecter_requests cmddesc objecter_requests hook 0x561d8e3f6df0 EEXIST 2024-09-12T17:32:07.331 INFO:tasks.workunit.client.0.smithi037.stderr: -179> 2024-09-12T17:32:06.955+0000 7fc64febb800 1 librados: setting wanted keys 2024-09-12T17:32:07.331 INFO:tasks.workunit.client.0.smithi037.stderr: -178> 2024-09-12T17:32:06.955+0000 7fc64febb800 1 librados: calling monclient init 2024-09-12T17:32:07.331 INFO:tasks.workunit.client.0.smithi037.stderr: -177> 2024-09-12T17:32:06.955+0000 7fc64febb800 10 monclient: init 2024-09-12T17:32:07.331 INFO:tasks.workunit.client.0.smithi037.stderr: -176> 2024-09-12T17:32:06.955+0000 7fc64febb800 5 AuthRegistry(0x561d8e3ba170) adding auth protocol: cephx 2024-09-12T17:32:07.331 INFO:tasks.workunit.client.0.smithi037.stderr: -175> 2024-09-12T17:32:06.955+0000 7fc64febb800 5 AuthRegistry(0x561d8e3ba170) adding auth protocol: cephx 2024-09-12T17:32:07.331 INFO:tasks.workunit.client.0.smithi037.stderr: -174> 2024-09-12T17:32:06.956+0000 7fc64febb800 5 AuthRegistry(0x561d8e3ba170) adding auth protocol: cephx 2024-09-12T17:32:07.332 INFO:tasks.workunit.client.0.smithi037.stderr: -173> 2024-09-12T17:32:06.956+0000 7fc64febb800 5 AuthRegistry(0x561d8e3ba170) adding con mode: secure 2024-09-12T17:32:07.332 INFO:tasks.workunit.client.0.smithi037.stderr: -172> 2024-09-12T17:32:06.956+0000 7fc64febb800 5 AuthRegistry(0x561d8e3ba170) adding con mode: crc 2024-09-12T17:32:07.332 INFO:tasks.workunit.client.0.smithi037.stderr: -171> 2024-09-12T17:32:06.956+0000 7fc64febb800 5 AuthRegistry(0x561d8e3ba170) adding con mode: secure 2024-09-12T17:32:07.332 INFO:tasks.workunit.client.0.smithi037.stderr: -170> 2024-09-12T17:32:06.956+0000 7fc64febb800 5 AuthRegistry(0x561d8e3ba170) adding con mode: crc 2024-09-12T17:32:07.332 INFO:tasks.workunit.client.0.smithi037.stderr: -169> 2024-09-12T17:32:06.956+0000 7fc64febb800 5 AuthRegistry(0x561d8e3ba170) adding con mode: secure 2024-09-12T17:32:07.332 INFO:tasks.workunit.client.0.smithi037.stderr: -168> 2024-09-12T17:32:06.956+0000 7fc64febb800 5 AuthRegistry(0x561d8e3ba170) adding con mode: crc 2024-09-12T17:32:07.332 INFO:tasks.workunit.client.0.smithi037.stderr: -167> 2024-09-12T17:32:06.956+0000 7fc64febb800 5 AuthRegistry(0x561d8e3ba170) adding con mode: crc 2024-09-12T17:32:07.332 INFO:tasks.workunit.client.0.smithi037.stderr: -166> 2024-09-12T17:32:06.956+0000 7fc64febb800 5 AuthRegistry(0x561d8e3ba170) adding con mode: secure 2024-09-12T17:32:07.332 INFO:tasks.workunit.client.0.smithi037.stderr: -165> 2024-09-12T17:32:06.956+0000 7fc64febb800 5 AuthRegistry(0x561d8e3ba170) adding con mode: crc 2024-09-12T17:32:07.332 INFO:tasks.workunit.client.0.smithi037.stderr: -164> 2024-09-12T17:32:06.956+0000 7fc64febb800 5 AuthRegistry(0x561d8e3ba170) adding con mode: secure 2024-09-12T17:32:07.332 INFO:tasks.workunit.client.0.smithi037.stderr: -163> 2024-09-12T17:32:06.956+0000 7fc64febb800 5 AuthRegistry(0x561d8e3ba170) adding con mode: crc 2024-09-12T17:32:07.332 INFO:tasks.workunit.client.0.smithi037.stderr: -162> 2024-09-12T17:32:06.956+0000 7fc64febb800 5 AuthRegistry(0x561d8e3ba170) adding con mode: secure 2024-09-12T17:32:07.333 INFO:tasks.workunit.client.0.smithi037.stderr: -161> 2024-09-12T17:32:06.956+0000 7fc64febb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:32:07.333 INFO:tasks.workunit.client.0.smithi037.stderr: -160> 2024-09-12T17:32:06.956+0000 7fc64febb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:32:07.333 INFO:tasks.workunit.client.0.smithi037.stderr: -159> 2024-09-12T17:32:06.956+0000 7fc64febb800 5 asok(0x561d8e107730) register_command rotate-key cmddesc rotate-key hook 0x561d8e3ba2b8 EEXIST 2024-09-12T17:32:07.333 INFO:tasks.workunit.client.0.smithi037.stderr: -158> 2024-09-12T17:32:06.956+0000 7fc64febb800 10 monclient: _reopen_session rank -1 2024-09-12T17:32:07.333 INFO:tasks.workunit.client.0.smithi037.stderr: -157> 2024-09-12T17:32:06.956+0000 7fc64febb800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T17:32:07.333 INFO:tasks.workunit.client.0.smithi037.stderr: -156> 2024-09-12T17:32:06.956+0000 7fc64febb800 10 monclient(hunting): picked mon.noname-c con 0x561d8e3ea880 addr [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] 2024-09-12T17:32:07.333 INFO:tasks.workunit.client.0.smithi037.stderr: -155> 2024-09-12T17:32:06.956+0000 7fc64febb800 10 monclient(hunting): picked mon.noname-b con 0x561d8e3f5020 addr [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] 2024-09-12T17:32:07.333 INFO:tasks.workunit.client.0.smithi037.stderr: -154> 2024-09-12T17:32:06.956+0000 7fc64febb800 10 monclient(hunting): picked mon.noname-a con 0x561d8e3f9bf0 addr [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] 2024-09-12T17:32:07.333 INFO:tasks.workunit.client.0.smithi037.stderr: -153> 2024-09-12T17:32:06.956+0000 7fc64febb800 10 monclient(hunting): start opening mon connection 2024-09-12T17:32:07.333 INFO:tasks.workunit.client.0.smithi037.stderr: -152> 2024-09-12T17:32:06.956+0000 7fc64febb800 10 monclient(hunting): start opening mon connection 2024-09-12T17:32:07.333 INFO:tasks.workunit.client.0.smithi037.stderr: -151> 2024-09-12T17:32:06.956+0000 7fc64febb800 10 monclient(hunting): start opening mon connection 2024-09-12T17:32:07.333 INFO:tasks.workunit.client.0.smithi037.stderr: -150> 2024-09-12T17:32:06.956+0000 7fc64febb800 10 monclient(hunting): _renew_subs 2024-09-12T17:32:07.334 INFO:tasks.workunit.client.0.smithi037.stderr: -149> 2024-09-12T17:32:06.956+0000 7fc64febb800 10 monclient(hunting): authenticate will time out at 2114.553529s 2024-09-12T17:32:07.334 INFO:tasks.workunit.client.0.smithi037.stderr: -148> 2024-09-12T17:32:06.956+0000 7fc64d9a5640 10 monclient(hunting): get_auth_request con 0x561d8e3ea880 auth_method 0 2024-09-12T17:32:07.334 INFO:tasks.workunit.client.0.smithi037.stderr: -147> 2024-09-12T17:32:06.956+0000 7fc64d9a5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:32:07.334 INFO:tasks.workunit.client.0.smithi037.stderr: -146> 2024-09-12T17:32:06.956+0000 7fc64d9a5640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:32:07.334 INFO:tasks.workunit.client.0.smithi037.stderr: -145> 2024-09-12T17:32:06.956+0000 7fc64d9a5640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:32:07.334 INFO:tasks.workunit.client.0.smithi037.stderr: -144> 2024-09-12T17:32:06.956+0000 7fc64e1a6640 10 monclient(hunting): get_auth_request con 0x561d8e3f9bf0 auth_method 0 2024-09-12T17:32:07.334 INFO:tasks.workunit.client.0.smithi037.stderr: -143> 2024-09-12T17:32:06.956+0000 7fc64e1a6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:32:07.334 INFO:tasks.workunit.client.0.smithi037.stderr: -142> 2024-09-12T17:32:06.956+0000 7fc64e1a6640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:32:07.334 INFO:tasks.workunit.client.0.smithi037.stderr: -141> 2024-09-12T17:32:06.956+0000 7fc64e1a6640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:32:07.334 INFO:tasks.workunit.client.0.smithi037.stderr: -140> 2024-09-12T17:32:06.956+0000 7fc64d9a5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:32:07.334 INFO:tasks.workunit.client.0.smithi037.stderr: -139> 2024-09-12T17:32:06.956+0000 7fc64d9a5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:32:07.334 INFO:tasks.workunit.client.0.smithi037.stderr: -138> 2024-09-12T17:32:06.956+0000 7fc64d9a5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:32:07.334 INFO:tasks.workunit.client.0.smithi037.stderr: -137> 2024-09-12T17:32:06.956+0000 7fc64e1a6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:32:07.335 INFO:tasks.workunit.client.0.smithi037.stderr: -136> 2024-09-12T17:32:06.956+0000 7fc64e1a6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:32:07.335 INFO:tasks.workunit.client.0.smithi037.stderr: -135> 2024-09-12T17:32:06.956+0000 7fc64e1a6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:32:07.335 INFO:tasks.workunit.client.0.smithi037.stderr: -134> 2024-09-12T17:32:06.956+0000 7fc64d9a5640 10 monclient(hunting): handle_auth_done global_id 6053 payload 824 2024-09-12T17:32:07.335 INFO:tasks.workunit.client.0.smithi037.stderr: -133> 2024-09-12T17:32:06.956+0000 7fc64d9a5640 10 monclient: _finish_hunting 0 2024-09-12T17:32:07.335 INFO:tasks.workunit.client.0.smithi037.stderr: -132> 2024-09-12T17:32:06.956+0000 7fc64d9a5640 1 monclient: found mon.noname-c 2024-09-12T17:32:07.335 INFO:tasks.workunit.client.0.smithi037.stderr: -131> 2024-09-12T17:32:06.956+0000 7fc64d9a5640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.37:3301/0 2024-09-12T17:32:07.335 INFO:tasks.workunit.client.0.smithi037.stderr: -130> 2024-09-12T17:32:06.957+0000 7fc51f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:32:07.335 INFO:tasks.workunit.client.0.smithi037.stderr: -129> 2024-09-12T17:32:06.957+0000 7fc51f7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:32:07.335 INFO:tasks.workunit.client.0.smithi037.stderr: -128> 2024-09-12T17:32:06.957+0000 7fc51f7fe640 10 monclient: dump: 2024-09-12T17:32:07.335 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:32:07.335 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:32:07.335 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:32:07.335 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:32:07.336 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:32:07.336 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:32:07.336 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:32:07.336 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:32:07.336 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:32:07.336 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:32:07.336 INFO:tasks.workunit.client.0.smithi037.stderr: -127> 2024-09-12T17:32:06.957+0000 7fc51f7fe640 10 monclient: _finish_auth 0 2024-09-12T17:32:07.336 INFO:tasks.workunit.client.0.smithi037.stderr: -126> 2024-09-12T17:32:06.957+0000 7fc51f7fe640 10 monclient: _check_auth_tickets 2024-09-12T17:32:07.336 INFO:tasks.workunit.client.0.smithi037.stderr: -125> 2024-09-12T17:32:06.957+0000 7fc51f7fe640 10 monclient: handle_config config(0 keys) 2024-09-12T17:32:07.336 INFO:tasks.workunit.client.0.smithi037.stderr: -124> 2024-09-12T17:32:06.957+0000 7fc51f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:32:07.336 INFO:tasks.workunit.client.0.smithi037.stderr: -123> 2024-09-12T17:32:06.957+0000 7fc51f7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:32:07.336 INFO:tasks.workunit.client.0.smithi037.stderr: -122> 2024-09-12T17:32:06.957+0000 7fc51f7fe640 10 monclient: dump: 2024-09-12T17:32:07.337 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:32:07.337 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:32:07.337 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:32:07.337 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:32:07.337 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:32:07.337 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:32:07.337 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:32:07.337 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:32:07.337 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:32:07.337 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:32:07.337 INFO:tasks.workunit.client.0.smithi037.stderr: -121> 2024-09-12T17:32:06.957+0000 7fc64febb800 5 monclient: authenticate success, global_id 6053 2024-09-12T17:32:07.337 INFO:tasks.workunit.client.0.smithi037.stderr: -120> 2024-09-12T17:32:06.957+0000 7fc64febb800 10 monclient: _renew_subs 2024-09-12T17:32:07.337 INFO:tasks.workunit.client.0.smithi037.stderr: -119> 2024-09-12T17:32:06.957+0000 7fc5317fa640 4 set_mon_vals no callback set 2024-09-12T17:32:07.338 INFO:tasks.workunit.client.0.smithi037.stderr: -118> 2024-09-12T17:32:06.957+0000 7fc64febb800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.37:3301/0 2024-09-12T17:32:07.338 INFO:tasks.workunit.client.0.smithi037.stderr: -117> 2024-09-12T17:32:06.957+0000 7fc64febb800 10 monclient: _renew_subs 2024-09-12T17:32:07.338 INFO:tasks.workunit.client.0.smithi037.stderr: -116> 2024-09-12T17:32:06.957+0000 7fc64febb800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.37:3301/0 2024-09-12T17:32:07.338 INFO:tasks.workunit.client.0.smithi037.stderr: -115> 2024-09-12T17:32:06.957+0000 7fc64febb800 1 librados: init done 2024-09-12T17:32:07.338 INFO:tasks.workunit.client.0.smithi037.stderr: -114> 2024-09-12T17:32:06.957+0000 7fc64febb800 5 asok(0x561d8e107730) register_command cr dump hook 0x561d8e3e8a08 2024-09-12T17:32:07.338 INFO:tasks.workunit.client.0.smithi037.stderr: -113> 2024-09-12T17:32:06.958+0000 7fc64febb800 20 rados->read ofs=0 len=0 2024-09-12T17:32:07.338 INFO:tasks.workunit.client.0.smithi037.stderr: -112> 2024-09-12T17:32:06.959+0000 7fc51f7fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:32:07.340 INFO:tasks.workunit.client.0.smithi037.stderr: -111> 2024-09-12T17:32:06.959+0000 7fc51f7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.40:6816/3916250676,v1:172.21.15.40:6817/3916250676] 2024-09-12T17:32:07.340 INFO:tasks.workunit.client.0.smithi037.stderr: -110> 2024-09-12T17:32:06.959+0000 7fc51f7fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.40:6816/3916250676,v1:172.21.15.40:6817/3916250676] 2024-09-12T17:32:07.340 INFO:tasks.workunit.client.0.smithi037.stderr: -109> 2024-09-12T17:32:06.959+0000 7fc64d1a4640 10 monclient: get_auth_request con 0x7fc518076470 auth_method 0 2024-09-12T17:32:07.340 INFO:tasks.workunit.client.0.smithi037.stderr: -108> 2024-09-12T17:32:06.959+0000 7fc64e1a6640 10 monclient: get_auth_request con 0x561d8e414160 auth_method 0 2024-09-12T17:32:07.340 INFO:tasks.workunit.client.0.smithi037.stderr: -107> 2024-09-12T17:32:06.960+0000 7fc64febb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:07.341 INFO:tasks.workunit.client.0.smithi037.stderr: -106> 2024-09-12T17:32:06.960+0000 7fc64febb800 20 realm 2024-09-12T17:32:07.341 INFO:tasks.workunit.client.0.smithi037.stderr: -105> 2024-09-12T17:32:06.960+0000 7fc64febb800 20 rados->read ofs=0 len=0 2024-09-12T17:32:07.341 INFO:tasks.workunit.client.0.smithi037.stderr: -104> 2024-09-12T17:32:06.960+0000 7fc64febb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:07.341 INFO:tasks.workunit.client.0.smithi037.stderr: -103> 2024-09-12T17:32:06.960+0000 7fc64febb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:32:07.341 INFO:tasks.workunit.client.0.smithi037.stderr: -102> 2024-09-12T17:32:06.960+0000 7fc64febb800 20 rados->read ofs=0 len=0 2024-09-12T17:32:07.341 INFO:tasks.workunit.client.0.smithi037.stderr: -101> 2024-09-12T17:32:06.960+0000 7fc64febb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:07.341 INFO:tasks.workunit.client.0.smithi037.stderr: -100> 2024-09-12T17:32:06.960+0000 7fc64febb800 20 rados->read ofs=0 len=0 2024-09-12T17:32:07.341 INFO:tasks.workunit.client.0.smithi037.stderr: -99> 2024-09-12T17:32:06.960+0000 7fc64d9a5640 10 monclient: get_auth_request con 0x561d8e418470 auth_method 0 2024-09-12T17:32:07.341 INFO:tasks.workunit.client.0.smithi037.stderr: -98> 2024-09-12T17:32:06.961+0000 7fc64febb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:07.341 INFO:tasks.workunit.client.0.smithi037.stderr: -97> 2024-09-12T17:32:06.961+0000 7fc64febb800 20 rados->read ofs=0 len=0 2024-09-12T17:32:07.341 INFO:tasks.workunit.client.0.smithi037.stderr: -96> 2024-09-12T17:32:06.961+0000 7fc64febb800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:32:07.341 INFO:tasks.workunit.client.0.smithi037.stderr: -95> 2024-09-12T17:32:06.961+0000 7fc64febb800 20 searching for the correct realm 2024-09-12T17:32:07.342 INFO:tasks.workunit.client.0.smithi037.stderr: -94> 2024-09-12T17:32:06.961+0000 7fc64d1a4640 10 monclient: get_auth_request con 0x561d8e41d5a0 auth_method 0 2024-09-12T17:32:07.342 INFO:tasks.workunit.client.0.smithi037.stderr: -93> 2024-09-12T17:32:06.962+0000 7fc64e1a6640 10 monclient: get_auth_request con 0x7fc64408f1d0 auth_method 0 2024-09-12T17:32:07.342 INFO:tasks.workunit.client.0.smithi037.stderr: -92> 2024-09-12T17:32:06.963+0000 7fc64d9a5640 10 monclient: get_auth_request con 0x7fc648071040 auth_method 0 2024-09-12T17:32:07.342 INFO:tasks.workunit.client.0.smithi037.stderr: -91> 2024-09-12T17:32:06.964+0000 7fc64d1a4640 10 monclient: get_auth_request con 0x7fc64008f070 auth_method 0 2024-09-12T17:32:07.342 INFO:tasks.workunit.client.0.smithi037.stderr: -90> 2024-09-12T17:32:06.964+0000 7fc64d1a4640 0 -- 172.21.15.37:0/2031873925 >> [v2:172.21.15.40:6800/2441293461,v1:172.21.15.40:6801/2441293461] conn(0x7fc64008f070 msgr2=0x7fc640067e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:32:07.342 INFO:tasks.workunit.client.0.smithi037.stderr: -89> 2024-09-12T17:32:06.964+0000 7fc51f7fe640 1 client.6053.objecter ms_handle_reset 0x7fc64008f070 session 0x7fc640081040 osd.4 2024-09-12T17:32:07.342 INFO:tasks.workunit.client.0.smithi037.stderr: -88> 2024-09-12T17:32:06.964+0000 7fc51f7fe640 10 monclient: _renew_subs 2024-09-12T17:32:07.342 INFO:tasks.workunit.client.0.smithi037.stderr: -87> 2024-09-12T17:32:06.964+0000 7fc51f7fe640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.37:3301/0 2024-09-12T17:32:07.342 INFO:tasks.workunit.client.0.smithi037.stderr: -86> 2024-09-12T17:32:06.965+0000 7fc64d1a4640 10 monclient: get_auth_request con 0x7fc518086b10 auth_method 0 2024-09-12T17:32:07.342 INFO:tasks.workunit.client.0.smithi037.stderr: -85> 2024-09-12T17:32:06.966+0000 7fc64e1a6640 10 monclient: get_auth_request con 0x7fc644098a60 auth_method 0 2024-09-12T17:32:07.342 INFO:tasks.workunit.client.0.smithi037.stderr: -84> 2024-09-12T17:32:06.968+0000 7fc64d9a5640 10 monclient: get_auth_request con 0x7fc644072040 auth_method 0 2024-09-12T17:32:07.343 INFO:tasks.workunit.client.0.smithi037.stderr: -83> 2024-09-12T17:32:06.968+0000 7fc64d9a5640 0 -- 172.21.15.37:0/2031873925 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7fc644072040 msgr2=0x7fc6440358a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:32:07.343 INFO:tasks.workunit.client.0.smithi037.stderr: -82> 2024-09-12T17:32:07.169+0000 7fc64d9a5640 10 monclient: get_auth_request con 0x7fc644072040 auth_method 0 2024-09-12T17:32:07.343 INFO:tasks.workunit.client.0.smithi037.stderr: -81> 2024-09-12T17:32:07.174+0000 7fc64febb800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:32:07.343 INFO:tasks.workunit.client.0.smithi037.stderr: -80> 2024-09-12T17:32:07.174+0000 7fc64febb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:32:07.343 INFO:tasks.workunit.client.0.smithi037.stderr: -79> 2024-09-12T17:32:07.174+0000 7fc64febb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:32:07.343 INFO:tasks.workunit.client.0.smithi037.stderr: -78> 2024-09-12T17:32:07.174+0000 7fc64febb800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:32:07.343 INFO:tasks.workunit.client.0.smithi037.stderr: -77> 2024-09-12T17:32:07.174+0000 7fc64febb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:32:07.343 INFO:tasks.workunit.client.0.smithi037.stderr: -76> 2024-09-12T17:32:07.174+0000 7fc64febb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:32:07.343 INFO:tasks.workunit.client.0.smithi037.stderr: -75> 2024-09-12T17:32:07.174+0000 7fc64febb800 20 rados->read ofs=0 len=0 2024-09-12T17:32:07.343 INFO:tasks.workunit.client.0.smithi037.stderr: -74> 2024-09-12T17:32:07.174+0000 7fc64febb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:07.343 INFO:tasks.workunit.client.0.smithi037.stderr: -73> 2024-09-12T17:32:07.174+0000 7fc64febb800 20 rados->read ofs=0 len=0 2024-09-12T17:32:07.343 INFO:tasks.workunit.client.0.smithi037.stderr: -72> 2024-09-12T17:32:07.175+0000 7fc64febb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:07.344 INFO:tasks.workunit.client.0.smithi037.stderr: -71> 2024-09-12T17:32:07.175+0000 7fc64febb800 20 rados->read ofs=0 len=0 2024-09-12T17:32:07.344 INFO:tasks.workunit.client.0.smithi037.stderr: -70> 2024-09-12T17:32:07.176+0000 7fc64febb800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:32:07.344 INFO:tasks.workunit.client.0.smithi037.stderr: -69> 2024-09-12T17:32:07.176+0000 7fc64febb800 20 zone default found 2024-09-12T17:32:07.344 INFO:tasks.workunit.client.0.smithi037.stderr: -68> 2024-09-12T17:32:07.176+0000 7fc64febb800 4 Realm: () 2024-09-12T17:32:07.344 INFO:tasks.workunit.client.0.smithi037.stderr: -67> 2024-09-12T17:32:07.176+0000 7fc64febb800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:32:07.344 INFO:tasks.workunit.client.0.smithi037.stderr: -66> 2024-09-12T17:32:07.176+0000 7fc64febb800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:32:07.344 INFO:tasks.workunit.client.0.smithi037.stderr: -65> 2024-09-12T17:32:07.176+0000 7fc64febb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:32:07.344 INFO:tasks.workunit.client.0.smithi037.stderr: -64> 2024-09-12T17:32:07.176+0000 7fc64febb800 20 zonegroup default 2024-09-12T17:32:07.344 INFO:tasks.workunit.client.0.smithi037.stderr: -63> 2024-09-12T17:32:07.176+0000 7fc64febb800 20 rados->read ofs=0 len=0 2024-09-12T17:32:07.344 INFO:tasks.workunit.client.0.smithi037.stderr: -62> 2024-09-12T17:32:07.176+0000 7fc64febb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:07.344 INFO:tasks.workunit.client.0.smithi037.stderr: -61> 2024-09-12T17:32:07.176+0000 7fc64febb800 20 rados->read ofs=0 len=0 2024-09-12T17:32:07.345 INFO:tasks.workunit.client.0.smithi037.stderr: -60> 2024-09-12T17:32:07.176+0000 7fc64febb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:07.345 INFO:tasks.workunit.client.0.smithi037.stderr: -59> 2024-09-12T17:32:07.176+0000 7fc64febb800 20 rados->read ofs=0 len=0 2024-09-12T17:32:07.345 INFO:tasks.workunit.client.0.smithi037.stderr: -58> 2024-09-12T17:32:07.176+0000 7fc64febb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:07.345 INFO:tasks.workunit.client.0.smithi037.stderr: -57> 2024-09-12T17:32:07.176+0000 7fc64febb800 20 started sync module instance, tier type = 2024-09-12T17:32:07.345 INFO:tasks.workunit.client.0.smithi037.stderr: -56> 2024-09-12T17:32:07.176+0000 7fc64febb800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:32:07.345 INFO:tasks.workunit.client.0.smithi037.stderr: -55> 2024-09-12T17:32:07.187+0000 7fc64febb800 20 add_watcher() i=0 2024-09-12T17:32:07.345 INFO:tasks.workunit.client.0.smithi037.stderr: -54> 2024-09-12T17:32:07.187+0000 7fc64febb800 20 add_watcher() i=1 2024-09-12T17:32:07.345 INFO:tasks.workunit.client.0.smithi037.stderr: -53> 2024-09-12T17:32:07.187+0000 7fc64febb800 20 add_watcher() i=2 2024-09-12T17:32:07.345 INFO:tasks.workunit.client.0.smithi037.stderr: -52> 2024-09-12T17:32:07.187+0000 7fc64febb800 20 add_watcher() i=3 2024-09-12T17:32:07.345 INFO:tasks.workunit.client.0.smithi037.stderr: -51> 2024-09-12T17:32:07.187+0000 7fc64febb800 20 add_watcher() i=4 2024-09-12T17:32:07.345 INFO:tasks.workunit.client.0.smithi037.stderr: -50> 2024-09-12T17:32:07.187+0000 7fc64febb800 20 add_watcher() i=5 2024-09-12T17:32:07.345 INFO:tasks.workunit.client.0.smithi037.stderr: -49> 2024-09-12T17:32:07.187+0000 7fc64febb800 20 add_watcher() i=6 2024-09-12T17:32:07.346 INFO:tasks.workunit.client.0.smithi037.stderr: -48> 2024-09-12T17:32:07.188+0000 7fc64febb800 20 add_watcher() i=7 2024-09-12T17:32:07.346 INFO:tasks.workunit.client.0.smithi037.stderr: -47> 2024-09-12T17:32:07.188+0000 7fc64febb800 2 all 8 watchers are set, enabling cache 2024-09-12T17:32:07.346 INFO:tasks.workunit.client.0.smithi037.stderr: -46> 2024-09-12T17:32:07.190+0000 7fc64febb800 5 AuthRegistry(0x7fff10c4d500) adding auth protocol: cephx 2024-09-12T17:32:07.346 INFO:tasks.workunit.client.0.smithi037.stderr: -45> 2024-09-12T17:32:07.190+0000 7fc64febb800 5 AuthRegistry(0x7fff10c4d500) adding auth protocol: cephx 2024-09-12T17:32:07.346 INFO:tasks.workunit.client.0.smithi037.stderr: -44> 2024-09-12T17:32:07.190+0000 7fc64febb800 5 AuthRegistry(0x7fff10c4d500) adding auth protocol: cephx 2024-09-12T17:32:07.346 INFO:tasks.workunit.client.0.smithi037.stderr: -43> 2024-09-12T17:32:07.190+0000 7fc64febb800 5 AuthRegistry(0x7fff10c4d500) adding con mode: secure 2024-09-12T17:32:07.346 INFO:tasks.workunit.client.0.smithi037.stderr: -42> 2024-09-12T17:32:07.190+0000 7fc64febb800 5 AuthRegistry(0x7fff10c4d500) adding con mode: crc 2024-09-12T17:32:07.346 INFO:tasks.workunit.client.0.smithi037.stderr: -41> 2024-09-12T17:32:07.190+0000 7fc64febb800 5 AuthRegistry(0x7fff10c4d500) adding con mode: secure 2024-09-12T17:32:07.346 INFO:tasks.workunit.client.0.smithi037.stderr: -40> 2024-09-12T17:32:07.190+0000 7fc64febb800 5 AuthRegistry(0x7fff10c4d500) adding con mode: crc 2024-09-12T17:32:07.346 INFO:tasks.workunit.client.0.smithi037.stderr: -39> 2024-09-12T17:32:07.190+0000 7fc4ff7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:32:07.346 INFO:tasks.workunit.client.0.smithi037.stderr: -38> 2024-09-12T17:32:07.190+0000 7fc64febb800 5 AuthRegistry(0x7fff10c4d500) adding con mode: secure 2024-09-12T17:32:07.347 INFO:tasks.workunit.client.0.smithi037.stderr: -37> 2024-09-12T17:32:07.190+0000 7fc64febb800 5 AuthRegistry(0x7fff10c4d500) adding con mode: crc 2024-09-12T17:32:07.347 INFO:tasks.workunit.client.0.smithi037.stderr: -36> 2024-09-12T17:32:07.190+0000 7fc64febb800 5 AuthRegistry(0x7fff10c4d500) adding con mode: crc 2024-09-12T17:32:07.347 INFO:tasks.workunit.client.0.smithi037.stderr: -35> 2024-09-12T17:32:07.190+0000 7fc64febb800 5 AuthRegistry(0x7fff10c4d500) adding con mode: secure 2024-09-12T17:32:07.347 INFO:tasks.workunit.client.0.smithi037.stderr: -34> 2024-09-12T17:32:07.190+0000 7fc64febb800 5 AuthRegistry(0x7fff10c4d500) adding con mode: crc 2024-09-12T17:32:07.347 INFO:tasks.workunit.client.0.smithi037.stderr: -33> 2024-09-12T17:32:07.190+0000 7fc64febb800 5 AuthRegistry(0x7fff10c4d500) adding con mode: secure 2024-09-12T17:32:07.347 INFO:tasks.workunit.client.0.smithi037.stderr: -32> 2024-09-12T17:32:07.190+0000 7fc64febb800 5 AuthRegistry(0x7fff10c4d500) adding con mode: crc 2024-09-12T17:32:07.347 INFO:tasks.workunit.client.0.smithi037.stderr: -31> 2024-09-12T17:32:07.190+0000 7fc64febb800 5 AuthRegistry(0x7fff10c4d500) adding con mode: secure 2024-09-12T17:32:07.347 INFO:tasks.workunit.client.0.smithi037.stderr: -30> 2024-09-12T17:32:07.190+0000 7fc64febb800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:32:07.347 INFO:tasks.workunit.client.0.smithi037.stderr: -29> 2024-09-12T17:32:07.190+0000 7fc64febb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:32:07.347 INFO:tasks.workunit.client.0.smithi037.stderr: -28> 2024-09-12T17:32:07.190+0000 7fc64febb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:32:07.347 INFO:tasks.workunit.client.0.smithi037.stderr: -27> 2024-09-12T17:32:07.190+0000 7fc64febb800 5 asok(0x561d8e107730) register_command cache list hook 0x561d8e3e88b0 2024-09-12T17:32:07.347 INFO:tasks.workunit.client.0.smithi037.stderr: -26> 2024-09-12T17:32:07.190+0000 7fc64febb800 5 asok(0x561d8e107730) register_command cache inspect hook 0x561d8e3e88b0 2024-09-12T17:32:07.348 INFO:tasks.workunit.client.0.smithi037.stderr: -25> 2024-09-12T17:32:07.190+0000 7fc64febb800 5 asok(0x561d8e107730) register_command cache erase hook 0x561d8e3e88b0 2024-09-12T17:32:07.348 INFO:tasks.workunit.client.0.smithi037.stderr: -24> 2024-09-12T17:32:07.190+0000 7fc64febb800 5 asok(0x561d8e107730) register_command cache zap hook 0x561d8e3e88b0 2024-09-12T17:32:07.348 INFO:tasks.workunit.client.0.smithi037.stderr: -23> 2024-09-12T17:32:07.190+0000 7fc64febb800 5 note: GC not initialized 2024-09-12T17:32:07.348 INFO:tasks.workunit.client.0.smithi037.stderr: -22> 2024-09-12T17:32:07.191+0000 7fc4fe7fc640 20 reqs_thread_entry: start 2024-09-12T17:32:07.348 INFO:tasks.workunit.client.0.smithi037.stderr: -21> 2024-09-12T17:32:07.191+0000 7fc64febb800 5 asok(0x561d8e107730) register_command sync trace show hook 0x7fc64402a070 2024-09-12T17:32:07.348 INFO:tasks.workunit.client.0.smithi037.stderr: -20> 2024-09-12T17:32:07.191+0000 7fc64febb800 5 asok(0x561d8e107730) register_command sync trace history hook 0x7fc64402a070 2024-09-12T17:32:07.348 INFO:tasks.workunit.client.0.smithi037.stderr: -19> 2024-09-12T17:32:07.191+0000 7fc64febb800 5 asok(0x561d8e107730) register_command sync trace active hook 0x7fc64402a070 2024-09-12T17:32:07.348 INFO:tasks.workunit.client.0.smithi037.stderr: -18> 2024-09-12T17:32:07.191+0000 7fc64febb800 5 asok(0x561d8e107730) register_command sync trace active_short hook 0x7fc64402a070 2024-09-12T17:32:07.348 INFO:tasks.workunit.client.0.smithi037.stderr: -17> 2024-09-12T17:32:07.191+0000 7fc64febb800 20 init_complete bucket index max shards: 11 2024-09-12T17:32:07.348 INFO:tasks.workunit.client.0.smithi037.stderr: -16> 2024-09-12T17:32:07.191+0000 7fc64febb800 20 Filter name: none 2024-09-12T17:32:07.348 INFO:tasks.workunit.client.0.smithi037.stderr: -15> 2024-09-12T17:32:07.191+0000 7fc46ffff640 20 reqs_thread_entry: start 2024-09-12T17:32:07.348 INFO:tasks.workunit.client.0.smithi037.stderr: -14> 2024-09-12T17:32:07.191+0000 7fc64febb800 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-12T17:32:07.349 INFO:tasks.workunit.client.0.smithi037.stderr: -13> 2024-09-12T17:32:07.191+0000 7fc64febb800 20 rados->read ofs=0 len=0 2024-09-12T17:32:07.349 INFO:tasks.workunit.client.0.smithi037.stderr: -12> 2024-09-12T17:32:07.191+0000 7fc64febb800 20 rados_obj.operate() r=0 bl.length=212 2024-09-12T17:32:07.349 INFO:tasks.workunit.client.0.smithi037.stderr: -11> 2024-09-12T17:32:07.191+0000 7fc64febb800 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-12T17:32:07.349 INFO:tasks.workunit.client.0.smithi037.stderr: -10> 2024-09-12T17:32:07.191+0000 7fc64febb800 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-12T17:32:07.349 INFO:tasks.workunit.client.0.smithi037.stderr: -9> 2024-09-12T17:32:07.191+0000 7fc64febb800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.22 : miss 2024-09-12T17:32:07.349 INFO:tasks.workunit.client.0.smithi037.stderr: -8> 2024-09-12T17:32:07.191+0000 7fc64febb800 20 rados->read ofs=0 len=0 2024-09-12T17:32:07.349 INFO:tasks.workunit.client.0.smithi037.stderr: -7> 2024-09-12T17:32:07.192+0000 7fc64febb800 20 rados_obj.operate() r=0 bl.length=434 2024-09-12T17:32:07.349 INFO:tasks.workunit.client.0.smithi037.stderr: -6> 2024-09-12T17:32:07.192+0000 7fc64febb800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.22 info.flags=0x17 2024-09-12T17:32:07.349 INFO:tasks.workunit.client.0.smithi037.stderr: -5> 2024-09-12T17:32:07.192+0000 7fc64febb800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.22 to cache LRU end 2024-09-12T17:32:07.349 INFO:tasks.workunit.client.0.smithi037.stderr: -4> 2024-09-12T17:32:07.192+0000 7fc64febb800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:32:07.349 INFO:tasks.workunit.client.0.smithi037.stderr: -3> 2024-09-12T17:32:07.192+0000 7fc64febb800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:32:07.350 INFO:tasks.workunit.client.0.smithi037.stderr: -2> 2024-09-12T17:32:07.192+0000 7fc64febb800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.22 2024-09-12T17:32:07.350 INFO:tasks.workunit.client.0.smithi037.stderr: -1> 2024-09-12T17:32:07.194+0000 7fc64febb800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fc64febb800 time 2024-09-12T17:32:07.194540+0000 2024-09-12T17:32:07.350 INFO:tasks.workunit.client.0.smithi037.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:32:07.350 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:32:07.350 INFO:tasks.workunit.client.0.smithi037.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:32:07.350 INFO:tasks.workunit.client.0.smithi037.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fc65338c71a] 2024-09-12T17:32:07.350 INFO:tasks.workunit.client.0.smithi037.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fc65338c8d8] 2024-09-12T17:32:07.350 INFO:tasks.workunit.client.0.smithi037.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561d8bf66841] 2024-09-12T17:32:07.350 INFO:tasks.workunit.client.0.smithi037.stderr: 4: radosgw-admin(+0xd73b64) [0x561d8c473b64] 2024-09-12T17:32:07.350 INFO:tasks.workunit.client.0.smithi037.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x561d8bf7650d] 2024-09-12T17:32:07.350 INFO:tasks.workunit.client.0.smithi037.stderr: 6: main() 2024-09-12T17:32:07.350 INFO:tasks.workunit.client.0.smithi037.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fc652029590] 2024-09-12T17:32:07.351 INFO:tasks.workunit.client.0.smithi037.stderr: 8: __libc_start_main() 2024-09-12T17:32:07.351 INFO:tasks.workunit.client.0.smithi037.stderr: 9: _start() 2024-09-12T17:32:07.351 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:32:07.351 INFO:tasks.workunit.client.0.smithi037.stderr: 0> 2024-09-12T17:32:07.195+0000 7fc64febb800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:32:07.351 INFO:tasks.workunit.client.0.smithi037.stderr: in thread 7fc64febb800 thread_name:radosgw-admin 2024-09-12T17:32:07.351 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:32:07.351 INFO:tasks.workunit.client.0.smithi037.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:32:07.351 INFO:tasks.workunit.client.0.smithi037.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fc65203e6f0] 2024-09-12T17:32:07.351 INFO:tasks.workunit.client.0.smithi037.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fc65208b99c] 2024-09-12T17:32:07.351 INFO:tasks.workunit.client.0.smithi037.stderr: 3: raise() 2024-09-12T17:32:07.351 INFO:tasks.workunit.client.0.smithi037.stderr: 4: abort() 2024-09-12T17:32:07.351 INFO:tasks.workunit.client.0.smithi037.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fc65338c774] 2024-09-12T17:32:07.352 INFO:tasks.workunit.client.0.smithi037.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fc65338c8d8] 2024-09-12T17:32:07.352 INFO:tasks.workunit.client.0.smithi037.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561d8bf66841] 2024-09-12T17:32:07.352 INFO:tasks.workunit.client.0.smithi037.stderr: 8: radosgw-admin(+0xd73b64) [0x561d8c473b64] 2024-09-12T17:32:07.352 INFO:tasks.workunit.client.0.smithi037.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x561d8bf7650d] 2024-09-12T17:32:07.352 INFO:tasks.workunit.client.0.smithi037.stderr: 10: main() 2024-09-12T17:32:07.352 INFO:tasks.workunit.client.0.smithi037.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fc652029590] 2024-09-12T17:32:07.352 INFO:tasks.workunit.client.0.smithi037.stderr: 12: __libc_start_main() 2024-09-12T17:32:07.352 INFO:tasks.workunit.client.0.smithi037.stderr: 13: _start() 2024-09-12T17:32:07.352 INFO:tasks.workunit.client.0.smithi037.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:32:07.352 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:32:07.352 INFO:tasks.workunit.client.0.smithi037.stderr:--- logging levels --- 2024-09-12T17:32:07.353 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 none 2024-09-12T17:32:07.353 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 lockdep 2024-09-12T17:32:07.353 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 context 2024-09-12T17:32:07.353 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 1 crush 2024-09-12T17:32:07.353 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mds 2024-09-12T17:32:07.353 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mds_balancer 2024-09-12T17:32:07.353 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mds_locker 2024-09-12T17:32:07.353 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mds_log 2024-09-12T17:32:07.353 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mds_log_expire 2024-09-12T17:32:07.353 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mds_migrator 2024-09-12T17:32:07.353 INFO:tasks.workunit.client.0.smithi037.stderr: 3/ 5 mds_quiesce 2024-09-12T17:32:07.353 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 buffer 2024-09-12T17:32:07.354 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 timer 2024-09-12T17:32:07.354 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 filer 2024-09-12T17:32:07.354 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 striper 2024-09-12T17:32:07.354 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 objecter 2024-09-12T17:32:07.354 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 rados 2024-09-12T17:32:07.354 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 rbd 2024-09-12T17:32:07.354 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 rbd_mirror 2024-09-12T17:32:07.354 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 rbd_replay 2024-09-12T17:32:07.354 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 rbd_pwl 2024-09-12T17:32:07.354 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 journaler 2024-09-12T17:32:07.354 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 objectcacher 2024-09-12T17:32:07.354 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:32:07.354 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 client 2024-09-12T17:32:07.355 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 osd 2024-09-12T17:32:07.355 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 optracker 2024-09-12T17:32:07.355 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 objclass 2024-09-12T17:32:07.355 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 3 filestore 2024-09-12T17:32:07.355 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 3 journal 2024-09-12T17:32:07.355 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 0 ms 2024-09-12T17:32:07.355 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mon 2024-09-12T17:32:07.355 INFO:tasks.workunit.client.0.smithi037.stderr: 0/10 monc 2024-09-12T17:32:07.355 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 paxos 2024-09-12T17:32:07.355 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 tp 2024-09-12T17:32:07.355 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 auth 2024-09-12T17:32:07.355 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 crypto 2024-09-12T17:32:07.355 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 1 finisher 2024-09-12T17:32:07.355 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 1 reserver 2024-09-12T17:32:07.356 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 heartbeatmap 2024-09-12T17:32:07.356 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 perfcounter 2024-09-12T17:32:07.356 INFO:tasks.workunit.client.0.smithi037.stderr: 20/20 rgw 2024-09-12T17:32:07.356 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 rgw_sync 2024-09-12T17:32:07.356 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 rgw_datacache 2024-09-12T17:32:07.356 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 rgw_access 2024-09-12T17:32:07.356 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:32:07.356 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 rgw_flight 2024-09-12T17:32:07.356 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:32:07.356 INFO:tasks.workunit.client.0.smithi037.stderr: 20/20 rgw_notification 2024-09-12T17:32:07.356 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 javaclient 2024-09-12T17:32:07.357 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 asok 2024-09-12T17:32:07.357 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 1 throttle 2024-09-12T17:32:07.357 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 0 refs 2024-09-12T17:32:07.357 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 compressor 2024-09-12T17:32:07.357 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 bluestore 2024-09-12T17:32:07.357 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 bluefs 2024-09-12T17:32:07.357 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 3 bdev 2024-09-12T17:32:07.357 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 kstore 2024-09-12T17:32:07.357 INFO:tasks.workunit.client.0.smithi037.stderr: 4/ 5 rocksdb 2024-09-12T17:32:07.357 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 fuse 2024-09-12T17:32:07.357 INFO:tasks.workunit.client.0.smithi037.stderr: 2/ 5 mgr 2024-09-12T17:32:07.357 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mgrc 2024-09-12T17:32:07.358 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 dpdk 2024-09-12T17:32:07.358 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 eventtrace 2024-09-12T17:32:07.358 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 prioritycache 2024-09-12T17:32:07.358 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 test 2024-09-12T17:32:07.358 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:32:07.358 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 cephsqlite 2024-09-12T17:32:07.358 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:32:07.358 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore 2024-09-12T17:32:07.358 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_onode 2024-09-12T17:32:07.358 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_odata 2024-09-12T17:32:07.358 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_omap 2024-09-12T17:32:07.358 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_tm 2024-09-12T17:32:07.359 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_t 2024-09-12T17:32:07.359 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:32:07.359 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_epm 2024-09-12T17:32:07.359 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_lba 2024-09-12T17:32:07.359 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:32:07.359 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_cache 2024-09-12T17:32:07.359 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_journal 2024-09-12T17:32:07.359 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_device 2024-09-12T17:32:07.359 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_backref 2024-09-12T17:32:07.359 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 alienstore 2024-09-12T17:32:07.359 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mclock 2024-09-12T17:32:07.359 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 cyanstore 2024-09-12T17:32:07.359 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 ceph_exporter 2024-09-12T17:32:07.360 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 memstore 2024-09-12T17:32:07.360 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 trace 2024-09-12T17:32:07.360 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 ceph_dedup 2024-09-12T17:32:07.360 INFO:tasks.workunit.client.0.smithi037.stderr: -2/-2 (syslog threshold) 2024-09-12T17:32:07.360 INFO:tasks.workunit.client.0.smithi037.stderr: 99/99 (stderr threshold) 2024-09-12T17:32:07.360 INFO:tasks.workunit.client.0.smithi037.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:32:07.360 INFO:tasks.workunit.client.0.smithi037.stderr: 7fc46ffff640 / http_manager 2024-09-12T17:32:07.360 INFO:tasks.workunit.client.0.smithi037.stderr: 7fc4fe7fc640 / http_manager 2024-09-12T17:32:07.360 INFO:tasks.workunit.client.0.smithi037.stderr: 7fc4ff7fe640 / rgw_dt_lg_renew 2024-09-12T17:32:07.360 INFO:tasks.workunit.client.0.smithi037.stderr: 7fc51f7fe640 / ms_dispatch 2024-09-12T17:32:07.360 INFO:tasks.workunit.client.0.smithi037.stderr: 7fc5317fa640 / io_context_pool 2024-09-12T17:32:07.361 INFO:tasks.workunit.client.0.smithi037.stderr: 7fc5337fe640 / ms_dispatch 2024-09-12T17:32:07.361 INFO:tasks.workunit.client.0.smithi037.stderr: 7fc53a604640 / ms_dispatch 2024-09-12T17:32:07.361 INFO:tasks.workunit.client.0.smithi037.stderr: 7fc53be07640 / io_context_pool 2024-09-12T17:32:07.361 INFO:tasks.workunit.client.0.smithi037.stderr: 7fc64d1a4640 / msgr-worker-2 2024-09-12T17:32:07.361 INFO:tasks.workunit.client.0.smithi037.stderr: 7fc64d9a5640 / msgr-worker-1 2024-09-12T17:32:07.361 INFO:tasks.workunit.client.0.smithi037.stderr: 7fc64e1a6640 / msgr-worker-0 2024-09-12T17:32:07.361 INFO:tasks.workunit.client.0.smithi037.stderr: 7fc64e9a7640 / io_context_pool 2024-09-12T17:32:07.361 INFO:tasks.workunit.client.0.smithi037.stderr: 7fc64febb800 / radosgw-admin 2024-09-12T17:32:07.361 INFO:tasks.workunit.client.0.smithi037.stderr: max_recent 500 2024-09-12T17:32:07.361 INFO:tasks.workunit.client.0.smithi037.stderr: max_new 1000 2024-09-12T17:32:07.361 INFO:tasks.workunit.client.0.smithi037.stderr: log_file /var/lib/ceph/crash/2024-09-12T17:32:07.196227Z_67797aca-0da7-44dd-be28-1fef1efb35a5/log 2024-09-12T17:32:07.361 INFO:tasks.workunit.client.0.smithi037.stderr:--- end dump of recent events --- 2024-09-12T17:32:07.362 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bucket stats --bucket abort-at-init-indext 2024-09-12T17:32:07.364 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:32:07.364 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:32:07.364 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.274+0000 7f619fb2c800 20 rados->read ofs=0 len=0 2024-09-12T17:32:07.364 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.276+0000 7f619fb2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:07.364 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.276+0000 7f619fb2c800 20 realm 2024-09-12T17:32:07.364 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.276+0000 7f619fb2c800 20 rados->read ofs=0 len=0 2024-09-12T17:32:07.364 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.276+0000 7f619fb2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:07.364 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.276+0000 7f619fb2c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:32:07.364 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.276+0000 7f619fb2c800 20 rados->read ofs=0 len=0 2024-09-12T17:32:07.364 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.276+0000 7f619fb2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:07.364 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.276+0000 7f619fb2c800 20 rados->read ofs=0 len=0 2024-09-12T17:32:07.365 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.277+0000 7f619fb2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:07.365 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.277+0000 7f619fb2c800 20 rados->read ofs=0 len=0 2024-09-12T17:32:07.365 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.277+0000 7f619fb2c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:32:07.365 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.277+0000 7f619fb2c800 20 searching for the correct realm 2024-09-12T17:32:07.365 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.281+0000 7f619b04e640 0 -- 172.21.15.37:0/1164424450 >> [v2:172.21.15.40:6800/2441293461,v1:172.21.15.40:6801/2441293461] conn(0x7f618c0ab240 msgr2=0x7f618c0a3550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:32:07.365 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.285+0000 7f619b84f640 0 -- 172.21.15.37:0/1164424450 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7f6190038c00 msgr2=0x7f6190022960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:32:07.492 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.491+0000 7f619fb2c800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:32:07.493 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.491+0000 7f619fb2c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:32:07.493 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.491+0000 7f619fb2c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:32:07.493 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.491+0000 7f619fb2c800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:32:07.493 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.491+0000 7f619fb2c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:32:07.493 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.491+0000 7f619fb2c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:32:07.493 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.491+0000 7f619fb2c800 20 rados->read ofs=0 len=0 2024-09-12T17:32:07.493 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.491+0000 7f619fb2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:07.493 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.491+0000 7f619fb2c800 20 rados->read ofs=0 len=0 2024-09-12T17:32:07.493 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.492+0000 7f619fb2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:07.494 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.492+0000 7f619fb2c800 20 rados->read ofs=0 len=0 2024-09-12T17:32:07.495 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.492+0000 7f619fb2c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:32:07.495 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.492+0000 7f619fb2c800 20 zone default found 2024-09-12T17:32:07.495 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.492+0000 7f619fb2c800 4 Realm: () 2024-09-12T17:32:07.495 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.492+0000 7f619fb2c800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:32:07.495 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.492+0000 7f619fb2c800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:32:07.495 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.492+0000 7f619fb2c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:32:07.496 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.492+0000 7f619fb2c800 20 zonegroup default 2024-09-12T17:32:07.496 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.492+0000 7f619fb2c800 20 rados->read ofs=0 len=0 2024-09-12T17:32:07.496 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.493+0000 7f619fb2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:07.496 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.493+0000 7f619fb2c800 20 rados->read ofs=0 len=0 2024-09-12T17:32:07.496 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.493+0000 7f619fb2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:07.496 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.493+0000 7f619fb2c800 20 rados->read ofs=0 len=0 2024-09-12T17:32:07.496 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.493+0000 7f619fb2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:07.496 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.493+0000 7f619fb2c800 20 started sync module instance, tier type = 2024-09-12T17:32:07.496 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.493+0000 7f619fb2c800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:32:07.504 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.503+0000 7f619fb2c800 20 add_watcher() i=0 2024-09-12T17:32:07.505 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.503+0000 7f619fb2c800 20 add_watcher() i=1 2024-09-12T17:32:07.505 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.503+0000 7f619fb2c800 20 add_watcher() i=2 2024-09-12T17:32:07.505 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.503+0000 7f619fb2c800 20 add_watcher() i=3 2024-09-12T17:32:07.505 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.503+0000 7f619fb2c800 20 add_watcher() i=4 2024-09-12T17:32:07.505 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.503+0000 7f619fb2c800 20 add_watcher() i=5 2024-09-12T17:32:07.505 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.503+0000 7f619fb2c800 20 add_watcher() i=6 2024-09-12T17:32:07.505 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.504+0000 7f619fb2c800 20 add_watcher() i=7 2024-09-12T17:32:07.505 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.504+0000 7f619fb2c800 2 all 8 watchers are set, enabling cache 2024-09-12T17:32:07.507 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.506+0000 7f6051fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:32:07.508 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.506+0000 7f619fb2c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:32:07.508 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.506+0000 7f619fb2c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:32:07.508 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.506+0000 7f619fb2c800 5 note: GC not initialized 2024-09-12T17:32:07.508 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.507+0000 7f6050fe1640 20 reqs_thread_entry: start 2024-09-12T17:32:07.508 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.507+0000 7f619fb2c800 20 init_complete bucket index max shards: 11 2024-09-12T17:32:07.508 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.507+0000 7f619fb2c800 20 Filter name: none 2024-09-12T17:32:07.509 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.507+0000 7f5fca7fc640 20 reqs_thread_entry: start 2024-09-12T17:32:07.509 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.507+0000 7f619fb2c800 20 rados->read ofs=0 len=0 2024-09-12T17:32:07.509 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.507+0000 7f619fb2c800 20 rados_obj.operate() r=0 bl.length=212 2024-09-12T17:32:07.509 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.507+0000 7f619fb2c800 20 rados->read ofs=0 len=0 2024-09-12T17:32:07.509 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.508+0000 7f619fb2c800 20 rados_obj.operate() r=0 bl.length=434 2024-09-12T17:32:07.509 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.508+0000 7f619fb2c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:32:07.509 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.508+0000 7f619fb2c800 20 rados->read ofs=0 len=0 2024-09-12T17:32:07.510 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.509+0000 7f619fb2c800 20 rados_obj.operate() r=0 bl.length=212 2024-09-12T17:32:07.510 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.509+0000 7f619fb2c800 20 rados->read ofs=0 len=0 2024-09-12T17:32:07.510 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.510+0000 7f619fb2c800 20 rados_obj.operate() r=0 bl.length=434 2024-09-12T17:32:07.511 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.510+0000 7f619fb2c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:32:07.512 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.511+0000 7f6051fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:32:07.515 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.514+0000 7f619fb2c800 20 remove_watcher() i=0 2024-09-12T17:32:07.515 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.514+0000 7f619fb2c800 2 removed watcher, disabling cache 2024-09-12T17:32:07.516 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.515+0000 7f619fb2c800 20 remove_watcher() i=1 2024-09-12T17:32:07.517 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.516+0000 7f619fb2c800 20 remove_watcher() i=2 2024-09-12T17:32:07.518 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.517+0000 7f619fb2c800 20 remove_watcher() i=3 2024-09-12T17:32:07.519 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.519+0000 7f619fb2c800 20 remove_watcher() i=4 2024-09-12T17:32:07.520 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.520+0000 7f619fb2c800 20 remove_watcher() i=5 2024-09-12T17:32:07.521 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.520+0000 7f619fb2c800 20 remove_watcher() i=6 2024-09-12T17:32:07.522 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.521+0000 7f619fb2c800 20 remove_watcher() i=7 2024-09-12T17:32:07.534 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:32:07.534 INFO:tasks.workunit.client.0.smithi037.stderr:BUCKET_STATS: 2024-09-12T17:32:07.534 INFO:tasks.workunit.client.0.smithi037.stderr:bucket: abort-at-init-indext id: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.22 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:32:07.534 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:32:07.623 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bucket reshard --bucket abort-at-init-indext --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:32:07.655 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:32:07.655 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:32:07.695 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.694+0000 7f648a9af800 20 rados->read ofs=0 len=0 2024-09-12T17:32:07.697 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.696+0000 7f648a9af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:07.697 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.696+0000 7f648a9af800 20 realm 2024-09-12T17:32:07.697 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.696+0000 7f648a9af800 20 rados->read ofs=0 len=0 2024-09-12T17:32:07.697 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.696+0000 7f648a9af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:07.697 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.696+0000 7f648a9af800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:32:07.697 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.696+0000 7f648a9af800 20 rados->read ofs=0 len=0 2024-09-12T17:32:07.697 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.696+0000 7f648a9af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:07.698 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.696+0000 7f648a9af800 20 rados->read ofs=0 len=0 2024-09-12T17:32:07.698 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.697+0000 7f648a9af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:07.698 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.697+0000 7f648a9af800 20 rados->read ofs=0 len=0 2024-09-12T17:32:07.698 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.697+0000 7f648a9af800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:32:07.699 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.698+0000 7f648a9af800 20 searching for the correct realm 2024-09-12T17:32:07.702 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.701+0000 7f6487c98640 0 -- 172.21.15.37:0/776321423 >> [v2:172.21.15.40:6800/2441293461,v1:172.21.15.40:6801/2441293461] conn(0x7f647804fab0 msgr2=0x7f6478037400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:32:07.705 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.705+0000 7f6488499640 0 -- 172.21.15.37:0/776321423 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7f647c06ebd0 msgr2=0x7f647c0c0740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:32:07.914 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.913+0000 7f648a9af800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:32:07.914 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.913+0000 7f648a9af800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:32:07.914 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.913+0000 7f648a9af800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:32:07.914 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.913+0000 7f648a9af800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:32:07.914 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.913+0000 7f648a9af800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:32:07.914 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.913+0000 7f648a9af800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:32:07.914 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.913+0000 7f648a9af800 20 rados->read ofs=0 len=0 2024-09-12T17:32:07.914 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.913+0000 7f648a9af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:07.914 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.913+0000 7f648a9af800 20 rados->read ofs=0 len=0 2024-09-12T17:32:07.916 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.913+0000 7f648a9af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:07.916 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.913+0000 7f648a9af800 20 rados->read ofs=0 len=0 2024-09-12T17:32:07.916 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.914+0000 7f648a9af800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:32:07.916 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.914+0000 7f648a9af800 20 zone default found 2024-09-12T17:32:07.916 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.914+0000 7f648a9af800 4 Realm: () 2024-09-12T17:32:07.916 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.914+0000 7f648a9af800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:32:07.916 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.914+0000 7f648a9af800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:32:07.916 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.914+0000 7f648a9af800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:32:07.916 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.914+0000 7f648a9af800 20 zonegroup default 2024-09-12T17:32:07.916 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.914+0000 7f648a9af800 20 rados->read ofs=0 len=0 2024-09-12T17:32:07.916 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.914+0000 7f648a9af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:07.916 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.914+0000 7f648a9af800 20 rados->read ofs=0 len=0 2024-09-12T17:32:07.916 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.914+0000 7f648a9af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:07.917 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.914+0000 7f648a9af800 20 rados->read ofs=0 len=0 2024-09-12T17:32:07.917 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.915+0000 7f648a9af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:07.917 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.915+0000 7f648a9af800 20 started sync module instance, tier type = 2024-09-12T17:32:07.917 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.915+0000 7f648a9af800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:32:07.926 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.925+0000 7f648a9af800 20 add_watcher() i=0 2024-09-12T17:32:07.926 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.925+0000 7f648a9af800 20 add_watcher() i=1 2024-09-12T17:32:07.926 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.925+0000 7f648a9af800 20 add_watcher() i=2 2024-09-12T17:32:07.926 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.925+0000 7f648a9af800 20 add_watcher() i=3 2024-09-12T17:32:07.926 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.925+0000 7f648a9af800 20 add_watcher() i=4 2024-09-12T17:32:07.926 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.925+0000 7f648a9af800 20 add_watcher() i=5 2024-09-12T17:32:07.926 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.925+0000 7f648a9af800 20 add_watcher() i=6 2024-09-12T17:32:07.926 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.926+0000 7f648a9af800 20 add_watcher() i=7 2024-09-12T17:32:07.927 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.926+0000 7f648a9af800 2 all 8 watchers are set, enabling cache 2024-09-12T17:32:07.929 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.928+0000 7f633efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:32:07.929 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.928+0000 7f648a9af800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:32:07.930 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.928+0000 7f648a9af800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:32:07.930 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.928+0000 7f648a9af800 5 note: GC not initialized 2024-09-12T17:32:07.930 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.928+0000 7f633dfdb640 20 reqs_thread_entry: start 2024-09-12T17:32:07.930 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.928+0000 7f648a9af800 20 init_complete bucket index max shards: 11 2024-09-12T17:32:07.930 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.928+0000 7f648a9af800 20 Filter name: none 2024-09-12T17:32:07.930 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.929+0000 7f62af7fe640 20 reqs_thread_entry: start 2024-09-12T17:32:07.930 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.929+0000 7f648a9af800 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-12T17:32:07.930 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.929+0000 7f648a9af800 20 rados->read ofs=0 len=0 2024-09-12T17:32:07.931 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.929+0000 7f648a9af800 20 rados_obj.operate() r=0 bl.length=212 2024-09-12T17:32:07.931 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.929+0000 7f648a9af800 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-12T17:32:07.931 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.929+0000 7f648a9af800 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-12T17:32:07.931 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.929+0000 7f648a9af800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.22 : miss 2024-09-12T17:32:07.931 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.929+0000 7f648a9af800 20 rados->read ofs=0 len=0 2024-09-12T17:32:07.931 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.930+0000 7f648a9af800 20 rados_obj.operate() r=0 bl.length=434 2024-09-12T17:32:07.931 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.930+0000 7f648a9af800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.22 info.flags=0x17 2024-09-12T17:32:07.931 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.930+0000 7f648a9af800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.22 to cache LRU end 2024-09-12T17:32:07.932 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.930+0000 7f648a9af800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:32:07.932 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.930+0000 7f648a9af800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:32:07.932 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.930+0000 7f648a9af800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.22 2024-09-12T17:32:07.932 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.931+0000 7f648a9af800 0 INFO: RGWReshardLock::lock found lock on abort-at-init-indext:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.22 to be held by another RGW process; skipping for now 2024-09-12T17:32:07.932 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.932+0000 7f633efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:32:07.935 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.935+0000 7f648a9af800 20 remove_watcher() i=0 2024-09-12T17:32:07.935 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.935+0000 7f648a9af800 2 removed watcher, disabling cache 2024-09-12T17:32:07.936 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.936+0000 7f648a9af800 20 remove_watcher() i=1 2024-09-12T17:32:07.938 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.937+0000 7f648a9af800 20 remove_watcher() i=2 2024-09-12T17:32:07.939 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.939+0000 7f648a9af800 20 remove_watcher() i=3 2024-09-12T17:32:07.941 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.940+0000 7f648a9af800 20 remove_watcher() i=4 2024-09-12T17:32:07.942 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.941+0000 7f648a9af800 20 remove_watcher() i=5 2024-09-12T17:32:07.943 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.942+0000 7f648a9af800 20 remove_watcher() i=6 2024-09-12T17:32:07.944 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:07.943+0000 7f648a9af800 20 remove_watcher() i=7 2024-09-12T17:32:07.956 INFO:tasks.workunit.client.0.smithi037.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T17:32:37.989 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bucket reshard --bucket abort-at-init-indext --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:32:38.025 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:32:38.026 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:32:38.072 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.070+0000 7f22fddaf800 20 rados->read ofs=0 len=0 2024-09-12T17:32:38.073 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.071+0000 7f22fddaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:38.074 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.071+0000 7f22fddaf800 20 realm 2024-09-12T17:32:38.074 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.071+0000 7f22fddaf800 20 rados->read ofs=0 len=0 2024-09-12T17:32:38.074 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.071+0000 7f22fddaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:38.074 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.071+0000 7f22fddaf800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:32:38.074 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.071+0000 7f22fddaf800 20 rados->read ofs=0 len=0 2024-09-12T17:32:38.074 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.071+0000 7f22fddaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:38.074 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.071+0000 7f22fddaf800 20 rados->read ofs=0 len=0 2024-09-12T17:32:38.075 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.073+0000 7f22fddaf800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:38.075 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.073+0000 7f22fddaf800 20 rados->read ofs=0 len=0 2024-09-12T17:32:38.075 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.073+0000 7f22fddaf800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:32:38.075 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.073+0000 7f22fddaf800 20 searching for the correct realm 2024-09-12T17:32:38.078 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.076+0000 7f22fb098640 0 -- 172.21.15.37:0/2705619443 >> [v2:172.21.15.40:6800/2441293461,v1:172.21.15.40:6801/2441293461] conn(0x7f22ec046040 msgr2=0x7f22ec046930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:32:38.083 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.082+0000 7f22fb899640 0 -- 172.21.15.37:0/2705619443 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7f22f003b930 msgr2=0x7f22f0022400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:32:38.291 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.289+0000 7f22fddaf800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:32:38.292 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.289+0000 7f22fddaf800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:32:38.292 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.289+0000 7f22fddaf800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:32:38.292 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.289+0000 7f22fddaf800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:32:38.292 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.289+0000 7f22fddaf800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:32:38.292 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.289+0000 7f22fddaf800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:32:38.292 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.289+0000 7f22fddaf800 20 rados->read ofs=0 len=0 2024-09-12T17:32:38.292 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.289+0000 7f22fddaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:38.292 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.289+0000 7f22fddaf800 20 rados->read ofs=0 len=0 2024-09-12T17:32:38.293 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.289+0000 7f22fddaf800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:38.293 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.289+0000 7f22fddaf800 20 rados->read ofs=0 len=0 2024-09-12T17:32:38.294 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.290+0000 7f22fddaf800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:32:38.294 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.290+0000 7f22fddaf800 20 zone default found 2024-09-12T17:32:38.294 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.290+0000 7f22fddaf800 4 Realm: () 2024-09-12T17:32:38.294 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.290+0000 7f22fddaf800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:32:38.294 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.290+0000 7f22fddaf800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:32:38.294 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.290+0000 7f22fddaf800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:32:38.294 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.290+0000 7f22fddaf800 20 zonegroup default 2024-09-12T17:32:38.294 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.290+0000 7f22fddaf800 20 rados->read ofs=0 len=0 2024-09-12T17:32:38.294 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.290+0000 7f22fddaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:38.294 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.290+0000 7f22fddaf800 20 rados->read ofs=0 len=0 2024-09-12T17:32:38.294 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.291+0000 7f22fddaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:38.295 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.291+0000 7f22fddaf800 20 rados->read ofs=0 len=0 2024-09-12T17:32:38.295 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.291+0000 7f22fddaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:38.295 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.291+0000 7f22fddaf800 20 started sync module instance, tier type = 2024-09-12T17:32:38.295 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.291+0000 7f22fddaf800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:32:38.305 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.302+0000 7f22fddaf800 20 add_watcher() i=0 2024-09-12T17:32:38.305 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.302+0000 7f22fddaf800 20 add_watcher() i=1 2024-09-12T17:32:38.305 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.302+0000 7f22fddaf800 20 add_watcher() i=2 2024-09-12T17:32:38.305 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.302+0000 7f22fddaf800 20 add_watcher() i=3 2024-09-12T17:32:38.305 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.302+0000 7f22fddaf800 20 add_watcher() i=4 2024-09-12T17:32:38.305 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.302+0000 7f22fddaf800 20 add_watcher() i=5 2024-09-12T17:32:38.305 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.302+0000 7f22fddaf800 20 add_watcher() i=6 2024-09-12T17:32:38.306 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.303+0000 7f22fddaf800 20 add_watcher() i=7 2024-09-12T17:32:38.306 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.303+0000 7f22fddaf800 2 all 8 watchers are set, enabling cache 2024-09-12T17:32:38.307 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.305+0000 7f21b1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:32:38.308 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.306+0000 7f22fddaf800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:32:38.308 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.306+0000 7f22fddaf800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:32:38.308 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.306+0000 7f22fddaf800 5 note: GC not initialized 2024-09-12T17:32:38.310 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.306+0000 7f21b0fe1640 20 reqs_thread_entry: start 2024-09-12T17:32:38.310 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.306+0000 7f22fddaf800 20 init_complete bucket index max shards: 11 2024-09-12T17:32:38.310 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.306+0000 7f22fddaf800 20 Filter name: none 2024-09-12T17:32:38.310 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.306+0000 7f212a7fc640 20 reqs_thread_entry: start 2024-09-12T17:32:38.310 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.306+0000 7f22fddaf800 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-12T17:32:38.310 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.306+0000 7f22fddaf800 20 rados->read ofs=0 len=0 2024-09-12T17:32:38.312 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.307+0000 7f22fddaf800 20 rados_obj.operate() r=0 bl.length=212 2024-09-12T17:32:38.312 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.307+0000 7f22fddaf800 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-12T17:32:38.312 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.307+0000 7f22fddaf800 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-12T17:32:38.312 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.307+0000 7f22fddaf800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.22 : miss 2024-09-12T17:32:38.313 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.307+0000 7f22fddaf800 20 rados->read ofs=0 len=0 2024-09-12T17:32:38.313 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.309+0000 7f22fddaf800 20 rados_obj.operate() r=0 bl.length=434 2024-09-12T17:32:38.313 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.309+0000 7f22fddaf800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.22 info.flags=0x17 2024-09-12T17:32:38.313 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.309+0000 7f22fddaf800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.22 to cache LRU end 2024-09-12T17:32:38.313 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.309+0000 7f22fddaf800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:32:38.313 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.309+0000 7f22fddaf800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:32:38.313 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.309+0000 7f22fddaf800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.22 2024-09-12T17:32:38.316 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.315+0000 7f22fddaf800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.22 info.flags=0x17 2024-09-12T17:32:38.316 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.315+0000 7f22fddaf800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.22 to cache LRU end 2024-09-12T17:32:38.316 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.315+0000 7f22fddaf800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:32:38.316 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.315+0000 7f22fddaf800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-init-indext:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.22, ofs0, ns] 2024-09-12T17:32:38.317 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.315+0000 7f21da7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497041 cookie 94126949888848 notifier 6447 bl.length()=997 2024-09-12T17:32:38.317 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.315+0000 7f21da7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.22 info.flags=0x17 2024-09-12T17:32:38.317 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.315+0000 7f21da7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.22 to cache LRU end 2024-09-12T17:32:38.317 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.315+0000 7f21da7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:32:38.318 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.317+0000 7f22fddaf800 20 handle_bi_update(): bucket=:abort-at-init-indext[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.22]): orig_sources= new_sources= 2024-09-12T17:32:38.318 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.317+0000 7f22fddaf800 20 handle_bi_update(): bucket=:abort-at-init-indext[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.22]): potential sources added=[] removed=[] 2024-09-12T17:32:38.318 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.317+0000 7f22fddaf800 20 handle_bi_update(): bucket=:abort-at-init-indext[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.22]): orig_dests= new_dests= 2024-09-12T17:32:38.319 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.317+0000 7f22fddaf800 20 handle_bi_update(): bucket=:abort-at-init-indext[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.22]): potential dests added=[] removed=[] 2024-09-12T17:32:38.325 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.322+0000 7f22fddaf800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.22.1.0 2024-09-12T17:32:38.325 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.322+0000 7f22fddaf800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.22.1.0 2024-09-12T17:32:38.325 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.322+0000 7f22fddaf800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.22.1.1 2024-09-12T17:32:38.325 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.322+0000 7f22fddaf800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.22.1.1 2024-09-12T17:32:38.325 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.322+0000 7f22fddaf800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.22.1.2 2024-09-12T17:32:38.325 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.322+0000 7f22fddaf800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.22.1.2 2024-09-12T17:32:38.325 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.322+0000 7f22fddaf800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.22.1.3 2024-09-12T17:32:38.325 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.322+0000 7f22fddaf800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.22.1.3 2024-09-12T17:32:38.326 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.322+0000 7f22fddaf800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.22.1.4 2024-09-12T17:32:38.326 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.322+0000 7f22fddaf800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.22.1.4 2024-09-12T17:32:38.326 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.322+0000 7f22fddaf800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.22.1.5 2024-09-12T17:32:38.326 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.322+0000 7f22fddaf800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.22.1.5 2024-09-12T17:32:38.326 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.322+0000 7f22fddaf800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.22.1.6 2024-09-12T17:32:38.326 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.322+0000 7f22fddaf800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.22.1.6 2024-09-12T17:32:38.326 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.322+0000 7f22fddaf800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.22.1.7 2024-09-12T17:32:38.326 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.322+0000 7f22fddaf800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.22.1.7 2024-09-12T17:32:38.326 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.322+0000 7f22fddaf800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.22.1.8 2024-09-12T17:32:38.326 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.322+0000 7f22fddaf800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.22.1.8 2024-09-12T17:32:38.326 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.322+0000 7f22fddaf800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.22.1.9 2024-09-12T17:32:38.327 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.322+0000 7f22fddaf800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.22.1.9 2024-09-12T17:32:38.327 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.322+0000 7f22fddaf800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.22.1.10 2024-09-12T17:32:38.327 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.322+0000 7f22fddaf800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.22.1.10 2024-09-12T17:32:38.327 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.322+0000 7f22fddaf800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.22.1.11 2024-09-12T17:32:38.327 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.322+0000 7f22fddaf800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.22.1.11 2024-09-12T17:32:38.327 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.322+0000 7f22fddaf800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.22.0 2024-09-12T17:32:38.327 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.323+0000 7f22fddaf800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.22.1 2024-09-12T17:32:38.328 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.323+0000 7f22fddaf800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.22.2 2024-09-12T17:32:38.328 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.324+0000 7f22fddaf800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.22.3 2024-09-12T17:32:38.328 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.326+0000 7f22fddaf800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.22.4 2024-09-12T17:32:38.328 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.326+0000 7f22fddaf800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.22.5 2024-09-12T17:32:38.328 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.326+0000 7f22fddaf800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.22.6 2024-09-12T17:32:38.329 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.328+0000 7f22fddaf800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.22.7 2024-09-12T17:32:38.329 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.328+0000 7f22fddaf800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.22.8 2024-09-12T17:32:38.330 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.328+0000 7f22fddaf800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.22.9 2024-09-12T17:32:38.330 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.328+0000 7f22fddaf800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.22.10 2024-09-12T17:32:38.335 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.332+0000 7f22fddaf800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.22 : hit (requested=0x17, cached=0x17) 2024-09-12T17:32:38.335 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.333+0000 7f22fddaf800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.22 2024-09-12T17:32:38.336 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.334+0000 7f22fddaf800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.22 info.flags=0x17 2024-09-12T17:32:38.336 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.334+0000 7f22fddaf800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.22 to cache LRU end 2024-09-12T17:32:38.336 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.334+0000 7f22fddaf800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:32:38.336 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.334+0000 7f22fddaf800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-init-indext:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.22, ofs0, ns] 2024-09-12T17:32:38.337 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.334+0000 7f21daffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497042 cookie 94126949888848 notifier 6447 bl.length()=997 2024-09-12T17:32:38.337 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.334+0000 7f21daffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.22 info.flags=0x17 2024-09-12T17:32:38.338 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.334+0000 7f21daffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.22 to cache LRU end 2024-09-12T17:32:38.338 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.334+0000 7f21daffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:32:38.339 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.336+0000 7f22fddaf800 20 handle_bi_update(): bucket=:abort-at-init-indext[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.22]): orig_sources= new_sources= 2024-09-12T17:32:38.339 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.336+0000 7f22fddaf800 20 handle_bi_update(): bucket=:abort-at-init-indext[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.22]): potential sources added=[] removed=[] 2024-09-12T17:32:38.339 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.336+0000 7f22fddaf800 20 handle_bi_update(): bucket=:abort-at-init-indext[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.22]): orig_dests= new_dests= 2024-09-12T17:32:38.339 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.336+0000 7f22fddaf800 20 handle_bi_update(): bucket=:abort-at-init-indext[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.22]): potential dests added=[] removed=[] 2024-09-12T17:32:38.341 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.339+0000 7f22fddaf800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.22.0 2024-09-12T17:32:38.341 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.339+0000 7f22fddaf800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.22.1 2024-09-12T17:32:38.342 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.340+0000 7f22fddaf800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.22.2 2024-09-12T17:32:38.344 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.340+0000 7f22fddaf800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.22.3 2024-09-12T17:32:38.344 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.341+0000 7f22fddaf800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.22.4 2024-09-12T17:32:38.344 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.341+0000 7f22fddaf800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.22.5 2024-09-12T17:32:38.344 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.343+0000 7f22fddaf800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.22.6 2024-09-12T17:32:38.344 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.343+0000 7f22fddaf800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.22.7 2024-09-12T17:32:38.345 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.343+0000 7f22fddaf800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.22.8 2024-09-12T17:32:38.345 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.343+0000 7f22fddaf800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.22.9 2024-09-12T17:32:38.346 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.344+0000 7f22fddaf800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.22.10 2024-09-12T17:32:38.346 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.344+0000 7f22fddaf800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.22 : hit (requested=0x17, cached=0x17) 2024-09-12T17:32:38.346 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.344+0000 7f22fddaf800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.22 2024-09-12T17:32:38.347 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.346+0000 7f22fddaf800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.22 info.flags=0x17 2024-09-12T17:32:38.347 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.346+0000 7f22fddaf800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.22 to cache LRU end 2024-09-12T17:32:38.347 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.346+0000 7f22fddaf800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:32:38.348 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.346+0000 7f22fddaf800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-init-indext:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.22, ofs0, ns] 2024-09-12T17:32:38.348 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.346+0000 7f21da7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497043 cookie 94126949888848 notifier 6447 bl.length()=965 2024-09-12T17:32:38.348 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.346+0000 7f21da7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.22 info.flags=0x17 2024-09-12T17:32:38.348 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.346+0000 7f21da7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.22 to cache LRU end 2024-09-12T17:32:38.348 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.346+0000 7f21da7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:32:38.349 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.348+0000 7f22fddaf800 20 handle_bi_update(): bucket=:abort-at-init-indext[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.22]): orig_sources= new_sources= 2024-09-12T17:32:38.349 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.348+0000 7f22fddaf800 20 handle_bi_update(): bucket=:abort-at-init-indext[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.22]): potential sources added=[] removed=[] 2024-09-12T17:32:38.350 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.348+0000 7f22fddaf800 20 handle_bi_update(): bucket=:abort-at-init-indext[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.22]): orig_dests= new_dests= 2024-09-12T17:32:38.350 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.348+0000 7f22fddaf800 20 handle_bi_update(): bucket=:abort-at-init-indext[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.22]): potential dests added=[] removed=[] 2024-09-12T17:32:38.352 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.350+0000 7f22fddaf800 1 execute INFO: reshard of bucket "abort-at-init-indext" from 11 shards to 12 shards completed successfully 2024-09-12T17:32:38.354 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.352+0000 7f21b1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:32:38.356 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.355+0000 7f22fddaf800 20 remove_watcher() i=0 2024-09-12T17:32:38.356 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.355+0000 7f22fddaf800 2 removed watcher, disabling cache 2024-09-12T17:32:38.358 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.357+0000 7f22fddaf800 20 remove_watcher() i=1 2024-09-12T17:32:38.360 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.358+0000 7f22fddaf800 20 remove_watcher() i=2 2024-09-12T17:32:38.361 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.359+0000 7f22fddaf800 20 remove_watcher() i=3 2024-09-12T17:32:38.362 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.360+0000 7f22fddaf800 20 remove_watcher() i=4 2024-09-12T17:32:38.363 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.361+0000 7f22fddaf800 20 remove_watcher() i=5 2024-09-12T17:32:38.364 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.362+0000 7f22fddaf800 20 remove_watcher() i=6 2024-09-12T17:32:38.365 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.363+0000 7f22fddaf800 20 remove_watcher() i=7 2024-09-12T17:32:38.379 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bucket stats --bucket abort-at-init-indext 2024-09-12T17:32:38.409 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:32:38.409 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:32:38.451 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.449+0000 7ff50e687800 20 rados->read ofs=0 len=0 2024-09-12T17:32:38.453 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.451+0000 7ff50e687800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:38.453 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.451+0000 7ff50e687800 20 realm 2024-09-12T17:32:38.453 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.451+0000 7ff50e687800 20 rados->read ofs=0 len=0 2024-09-12T17:32:38.453 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.451+0000 7ff50e687800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:38.453 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.451+0000 7ff50e687800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:32:38.453 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.451+0000 7ff50e687800 20 rados->read ofs=0 len=0 2024-09-12T17:32:38.453 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.451+0000 7ff50e687800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:38.454 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.451+0000 7ff50e687800 20 rados->read ofs=0 len=0 2024-09-12T17:32:38.454 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.452+0000 7ff50e687800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:38.454 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.452+0000 7ff50e687800 20 rados->read ofs=0 len=0 2024-09-12T17:32:38.455 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.453+0000 7ff50e687800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:32:38.455 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.453+0000 7ff50e687800 20 searching for the correct realm 2024-09-12T17:32:38.458 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.456+0000 7ff50c972640 0 -- 172.21.15.37:0/2128536887 >> [v2:172.21.15.40:6818/1210108009,v1:172.21.15.40:6819/1210108009] conn(0x7ff4f4045430 msgr2=0x7ff4f4045850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:32:38.462 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.460+0000 7ff50c171640 0 -- 172.21.15.37:0/2128536887 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7ff4f4055410 msgr2=0x7ff4f4055870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:32:38.668 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.666+0000 7ff50e687800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:32:38.669 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.666+0000 7ff50e687800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:32:38.669 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.666+0000 7ff50e687800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:32:38.669 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.666+0000 7ff50e687800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:32:38.669 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.666+0000 7ff50e687800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:32:38.669 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.666+0000 7ff50e687800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:32:38.669 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.666+0000 7ff50e687800 20 rados->read ofs=0 len=0 2024-09-12T17:32:38.669 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.667+0000 7ff50e687800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:38.669 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.667+0000 7ff50e687800 20 rados->read ofs=0 len=0 2024-09-12T17:32:38.670 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.667+0000 7ff50e687800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:38.670 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.667+0000 7ff50e687800 20 rados->read ofs=0 len=0 2024-09-12T17:32:38.670 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.667+0000 7ff50e687800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:32:38.670 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.668+0000 7ff50e687800 20 zone default found 2024-09-12T17:32:38.670 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.668+0000 7ff50e687800 4 Realm: () 2024-09-12T17:32:38.670 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.668+0000 7ff50e687800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:32:38.671 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.668+0000 7ff50e687800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:32:38.671 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.668+0000 7ff50e687800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:32:38.671 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.668+0000 7ff50e687800 20 zonegroup default 2024-09-12T17:32:38.671 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.668+0000 7ff50e687800 20 rados->read ofs=0 len=0 2024-09-12T17:32:38.671 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.668+0000 7ff50e687800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:38.671 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.668+0000 7ff50e687800 20 rados->read ofs=0 len=0 2024-09-12T17:32:38.671 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.668+0000 7ff50e687800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:38.671 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.668+0000 7ff50e687800 20 rados->read ofs=0 len=0 2024-09-12T17:32:38.671 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.669+0000 7ff50e687800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:38.672 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.669+0000 7ff50e687800 20 started sync module instance, tier type = 2024-09-12T17:32:38.672 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.669+0000 7ff50e687800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:32:38.680 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.678+0000 7ff50e687800 20 add_watcher() i=0 2024-09-12T17:32:38.680 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.678+0000 7ff50e687800 20 add_watcher() i=1 2024-09-12T17:32:38.680 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.678+0000 7ff50e687800 20 add_watcher() i=2 2024-09-12T17:32:38.680 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.678+0000 7ff50e687800 20 add_watcher() i=3 2024-09-12T17:32:38.680 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.678+0000 7ff50e687800 20 add_watcher() i=4 2024-09-12T17:32:38.681 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.678+0000 7ff50e687800 20 add_watcher() i=5 2024-09-12T17:32:38.681 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.678+0000 7ff50e687800 20 add_watcher() i=6 2024-09-12T17:32:38.681 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.679+0000 7ff50e687800 20 add_watcher() i=7 2024-09-12T17:32:38.681 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.679+0000 7ff50e687800 2 all 8 watchers are set, enabling cache 2024-09-12T17:32:38.683 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.682+0000 7ff3c2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:32:38.683 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.682+0000 7ff50e687800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:32:38.684 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.682+0000 7ff50e687800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:32:38.684 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.682+0000 7ff50e687800 5 note: GC not initialized 2024-09-12T17:32:38.684 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.682+0000 7ff3c1fdb640 20 reqs_thread_entry: start 2024-09-12T17:32:38.684 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.682+0000 7ff50e687800 20 init_complete bucket index max shards: 11 2024-09-12T17:32:38.684 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.682+0000 7ff50e687800 20 Filter name: none 2024-09-12T17:32:38.684 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.682+0000 7ff3337fe640 20 reqs_thread_entry: start 2024-09-12T17:32:38.684 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.682+0000 7ff50e687800 20 rados->read ofs=0 len=0 2024-09-12T17:32:38.685 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.682+0000 7ff50e687800 20 rados_obj.operate() r=0 bl.length=212 2024-09-12T17:32:38.685 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.682+0000 7ff50e687800 20 rados->read ofs=0 len=0 2024-09-12T17:32:38.685 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.684+0000 7ff50e687800 20 rados_obj.operate() r=0 bl.length=434 2024-09-12T17:32:38.685 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.684+0000 7ff50e687800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:32:38.685 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.684+0000 7ff50e687800 20 rados->read ofs=0 len=0 2024-09-12T17:32:38.685 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.684+0000 7ff50e687800 20 rados_obj.operate() r=0 bl.length=212 2024-09-12T17:32:38.685 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.684+0000 7ff50e687800 20 rados->read ofs=0 len=0 2024-09-12T17:32:38.686 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.685+0000 7ff50e687800 20 rados_obj.operate() r=0 bl.length=434 2024-09-12T17:32:38.686 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.685+0000 7ff50e687800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:32:38.687 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.686+0000 7ff3c2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:32:38.689 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.689+0000 7ff50e687800 20 remove_watcher() i=0 2024-09-12T17:32:38.689 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.689+0000 7ff50e687800 2 removed watcher, disabling cache 2024-09-12T17:32:38.691 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.689+0000 7ff50e687800 20 remove_watcher() i=1 2024-09-12T17:32:38.692 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.691+0000 7ff50e687800 20 remove_watcher() i=2 2024-09-12T17:32:38.693 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.691+0000 7ff50e687800 20 remove_watcher() i=3 2024-09-12T17:32:38.694 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.692+0000 7ff50e687800 20 remove_watcher() i=4 2024-09-12T17:32:38.695 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.693+0000 7ff50e687800 20 remove_watcher() i=5 2024-09-12T17:32:38.696 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.694+0000 7ff50e687800 20 remove_watcher() i=6 2024-09-12T17:32:38.697 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:38.695+0000 7ff50e687800 20 remove_watcher() i=7 2024-09-12T17:32:38.708 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:32:38.708 INFO:tasks.workunit.client.0.smithi037.stderr:BUCKET_STATS: 2024-09-12T17:32:38.708 INFO:tasks.workunit.client.0.smithi037.stderr:bucket: abort-at-init-indext id: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.22 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T17:32:38.708 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:32:39.052 INFO:tasks.workunit.client.0.smithi037.stderr:TEST: reshard bucket with EIO injected at set_target_layout 2024-09-12T17:32:39.052 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:32:39.844 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-12T17:32:39.873 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:32:39.873 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:32:39.913 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:39.912+0000 7fbdc152d800 20 rados->read ofs=0 len=0 2024-09-12T17:32:39.915 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:39.914+0000 7fbdc152d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:39.915 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:39.914+0000 7fbdc152d800 20 realm 2024-09-12T17:32:39.915 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:39.914+0000 7fbdc152d800 20 rados->read ofs=0 len=0 2024-09-12T17:32:39.915 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:39.914+0000 7fbdc152d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:39.915 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:39.914+0000 7fbdc152d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:32:39.915 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:39.914+0000 7fbdc152d800 20 rados->read ofs=0 len=0 2024-09-12T17:32:39.915 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:39.914+0000 7fbdc152d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:39.915 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:39.914+0000 7fbdc152d800 20 rados->read ofs=0 len=0 2024-09-12T17:32:39.916 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:39.915+0000 7fbdc152d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:39.916 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:39.915+0000 7fbdc152d800 20 rados->read ofs=0 len=0 2024-09-12T17:32:39.916 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:39.915+0000 7fbdc152d800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:32:39.916 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:39.915+0000 7fbdc152d800 20 searching for the correct realm 2024-09-12T17:32:39.919 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:39.918+0000 7fbdbca75640 0 -- 172.21.15.37:0/651830022 >> [v2:172.21.15.40:6800/2441293461,v1:172.21.15.40:6801/2441293461] conn(0x7fbdb004e060 msgr2=0x7fbdb00a3710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:32:39.923 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:39.922+0000 7fbdbd276640 0 -- 172.21.15.37:0/651830022 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7fbdb408a420 msgr2=0x7fbdb408a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:32:40.130 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.129+0000 7fbdc152d800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:32:40.130 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.129+0000 7fbdc152d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:32:40.130 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.129+0000 7fbdc152d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:32:40.130 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.129+0000 7fbdc152d800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:32:40.130 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.129+0000 7fbdc152d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:32:40.130 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.129+0000 7fbdc152d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:32:40.131 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.129+0000 7fbdc152d800 20 rados->read ofs=0 len=0 2024-09-12T17:32:40.131 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.129+0000 7fbdc152d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:40.131 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.129+0000 7fbdc152d800 20 rados->read ofs=0 len=0 2024-09-12T17:32:40.132 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.130+0000 7fbdc152d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:40.132 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.130+0000 7fbdc152d800 20 rados->read ofs=0 len=0 2024-09-12T17:32:40.132 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.130+0000 7fbdc152d800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:32:40.132 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.130+0000 7fbdc152d800 20 zone default found 2024-09-12T17:32:40.132 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.130+0000 7fbdc152d800 4 Realm: () 2024-09-12T17:32:40.132 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.130+0000 7fbdc152d800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:32:40.132 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.130+0000 7fbdc152d800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:32:40.132 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.130+0000 7fbdc152d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:32:40.132 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.130+0000 7fbdc152d800 20 zonegroup default 2024-09-12T17:32:40.133 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.130+0000 7fbdc152d800 20 rados->read ofs=0 len=0 2024-09-12T17:32:40.133 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.130+0000 7fbdc152d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:40.133 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.130+0000 7fbdc152d800 20 rados->read ofs=0 len=0 2024-09-12T17:32:40.133 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.131+0000 7fbdc152d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:40.133 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.131+0000 7fbdc152d800 20 rados->read ofs=0 len=0 2024-09-12T17:32:40.133 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.131+0000 7fbdc152d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:40.133 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.131+0000 7fbdc152d800 20 started sync module instance, tier type = 2024-09-12T17:32:40.133 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.131+0000 7fbdc152d800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:32:40.142 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.141+0000 7fbdc152d800 20 add_watcher() i=0 2024-09-12T17:32:40.142 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.141+0000 7fbdc152d800 20 add_watcher() i=1 2024-09-12T17:32:40.142 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.141+0000 7fbdc152d800 20 add_watcher() i=2 2024-09-12T17:32:40.142 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.141+0000 7fbdc152d800 20 add_watcher() i=3 2024-09-12T17:32:40.142 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.141+0000 7fbdc152d800 20 add_watcher() i=4 2024-09-12T17:32:40.142 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.141+0000 7fbdc152d800 20 add_watcher() i=5 2024-09-12T17:32:40.142 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.141+0000 7fbdc152d800 20 add_watcher() i=6 2024-09-12T17:32:40.143 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.142+0000 7fbdc152d800 20 add_watcher() i=7 2024-09-12T17:32:40.143 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.142+0000 7fbdc152d800 2 all 8 watchers are set, enabling cache 2024-09-12T17:32:40.144 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.144+0000 7fbc737e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:32:40.145 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.144+0000 7fbdc152d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:32:40.145 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.144+0000 7fbdc152d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:32:40.145 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.144+0000 7fbdc152d800 5 note: GC not initialized 2024-09-12T17:32:40.146 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.144+0000 7fbc727e4640 20 reqs_thread_entry: start 2024-09-12T17:32:40.146 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.144+0000 7fbdc152d800 20 init_complete bucket index max shards: 11 2024-09-12T17:32:40.146 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.144+0000 7fbdc152d800 20 Filter name: none 2024-09-12T17:32:40.146 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.144+0000 7fbbe3fff640 20 reqs_thread_entry: start 2024-09-12T17:32:40.146 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.145+0000 7fbdc152d800 20 rados->read ofs=0 len=0 2024-09-12T17:32:40.147 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.145+0000 7fbdc152d800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T17:32:40.147 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.145+0000 7fbdc152d800 20 rados->read ofs=0 len=0 2024-09-12T17:32:40.147 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.146+0000 7fbdc152d800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T17:32:40.147 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.146+0000 7fbdc152d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:32:40.147 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.146+0000 7fbdc152d800 20 rados->read ofs=0 len=0 2024-09-12T17:32:40.147 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.146+0000 7fbdc152d800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T17:32:40.147 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.146+0000 7fbdc152d800 20 rados->read ofs=0 len=0 2024-09-12T17:32:40.148 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.146+0000 7fbdc152d800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T17:32:40.148 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.146+0000 7fbdc152d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:32:40.149 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.148+0000 7fbc737e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:32:40.151 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.151+0000 7fbdc152d800 20 remove_watcher() i=0 2024-09-12T17:32:40.152 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.151+0000 7fbdc152d800 2 removed watcher, disabling cache 2024-09-12T17:32:40.152 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.152+0000 7fbdc152d800 20 remove_watcher() i=1 2024-09-12T17:32:40.154 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.153+0000 7fbdc152d800 20 remove_watcher() i=2 2024-09-12T17:32:40.154 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.154+0000 7fbdc152d800 20 remove_watcher() i=3 2024-09-12T17:32:40.156 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.155+0000 7fbdc152d800 20 remove_watcher() i=4 2024-09-12T17:32:40.157 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.156+0000 7fbdc152d800 20 remove_watcher() i=5 2024-09-12T17:32:40.158 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.157+0000 7fbdc152d800 20 remove_watcher() i=6 2024-09-12T17:32:40.159 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.158+0000 7fbdc152d800 20 remove_watcher() i=7 2024-09-12T17:32:40.170 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:32:40.170 INFO:tasks.workunit.client.0.smithi037.stderr:BUCKET_STATS: 2024-09-12T17:32:40.170 INFO:tasks.workunit.client.0.smithi037.stderr:bucket: error-at-set-target-layout id: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.23 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:32:40.170 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:32:40.172 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at set_target_layout 2024-09-12T17:32:40.207 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:32:40.207 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:32:40.246 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.245+0000 7f2024a98800 20 rados->read ofs=0 len=0 2024-09-12T17:32:40.248 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.247+0000 7f2024a98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:40.248 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.247+0000 7f2024a98800 20 realm 2024-09-12T17:32:40.248 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.247+0000 7f2024a98800 20 rados->read ofs=0 len=0 2024-09-12T17:32:40.248 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.247+0000 7f2024a98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:40.248 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.247+0000 7f2024a98800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:32:40.248 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.247+0000 7f2024a98800 20 rados->read ofs=0 len=0 2024-09-12T17:32:40.249 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.247+0000 7f2024a98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:40.249 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.247+0000 7f2024a98800 20 rados->read ofs=0 len=0 2024-09-12T17:32:40.249 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.248+0000 7f2024a98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:40.249 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.248+0000 7f2024a98800 20 rados->read ofs=0 len=0 2024-09-12T17:32:40.249 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.248+0000 7f2024a98800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:32:40.250 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.248+0000 7f2024a98800 20 searching for the correct realm 2024-09-12T17:32:40.252 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.251+0000 7f2022d83640 0 -- 172.21.15.37:0/2115691079 >> [v2:172.21.15.40:6818/1210108009,v1:172.21.15.40:6819/1210108009] conn(0x7f2018043040 msgr2=0x7f2018043930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:32:40.255 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.255+0000 7f2022582640 0 -- 172.21.15.37:0/2115691079 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7f20180403f0 msgr2=0x7f2018040850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:32:40.464 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.462+0000 7f2024a98800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:32:40.464 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.462+0000 7f2024a98800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:32:40.464 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.462+0000 7f2024a98800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:32:40.464 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.462+0000 7f2024a98800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:32:40.464 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.462+0000 7f2024a98800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:32:40.464 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.462+0000 7f2024a98800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:32:40.465 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.462+0000 7f2024a98800 20 rados->read ofs=0 len=0 2024-09-12T17:32:40.465 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.463+0000 7f2024a98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:40.465 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.463+0000 7f2024a98800 20 rados->read ofs=0 len=0 2024-09-12T17:32:40.465 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.463+0000 7f2024a98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:40.465 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.463+0000 7f2024a98800 20 rados->read ofs=0 len=0 2024-09-12T17:32:40.466 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.464+0000 7f2024a98800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:32:40.466 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.464+0000 7f2024a98800 20 zone default found 2024-09-12T17:32:40.466 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.464+0000 7f2024a98800 4 Realm: () 2024-09-12T17:32:40.467 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.464+0000 7f2024a98800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:32:40.467 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.464+0000 7f2024a98800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:32:40.467 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.464+0000 7f2024a98800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:32:40.467 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.464+0000 7f2024a98800 20 zonegroup default 2024-09-12T17:32:40.467 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.464+0000 7f2024a98800 20 rados->read ofs=0 len=0 2024-09-12T17:32:40.467 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.464+0000 7f2024a98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:40.467 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.464+0000 7f2024a98800 20 rados->read ofs=0 len=0 2024-09-12T17:32:40.467 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.464+0000 7f2024a98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:40.467 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.464+0000 7f2024a98800 20 rados->read ofs=0 len=0 2024-09-12T17:32:40.467 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.465+0000 7f2024a98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:40.467 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.465+0000 7f2024a98800 20 started sync module instance, tier type = 2024-09-12T17:32:40.467 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.465+0000 7f2024a98800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:32:40.475 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.474+0000 7f2024a98800 20 add_watcher() i=0 2024-09-12T17:32:40.476 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.474+0000 7f2024a98800 20 add_watcher() i=1 2024-09-12T17:32:40.476 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.474+0000 7f2024a98800 20 add_watcher() i=2 2024-09-12T17:32:40.476 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.474+0000 7f2024a98800 20 add_watcher() i=3 2024-09-12T17:32:40.476 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.474+0000 7f2024a98800 20 add_watcher() i=4 2024-09-12T17:32:40.476 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.474+0000 7f2024a98800 20 add_watcher() i=5 2024-09-12T17:32:40.476 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.474+0000 7f2024a98800 20 add_watcher() i=6 2024-09-12T17:32:40.476 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.475+0000 7f2024a98800 20 add_watcher() i=7 2024-09-12T17:32:40.476 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.475+0000 7f2024a98800 2 all 8 watchers are set, enabling cache 2024-09-12T17:32:40.481 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.478+0000 7f1ed97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:32:40.481 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.478+0000 7f2024a98800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:32:40.481 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.478+0000 7f2024a98800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:32:40.482 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.478+0000 7f2024a98800 5 note: GC not initialized 2024-09-12T17:32:40.482 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.478+0000 7f1ed37fe640 20 reqs_thread_entry: start 2024-09-12T17:32:40.482 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.478+0000 7f2024a98800 20 init_complete bucket index max shards: 11 2024-09-12T17:32:40.482 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.478+0000 7f2024a98800 20 Filter name: none 2024-09-12T17:32:40.482 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.479+0000 7f1ed17fa640 20 reqs_thread_entry: start 2024-09-12T17:32:40.483 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.479+0000 7f2024a98800 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-09-12T17:32:40.483 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.479+0000 7f2024a98800 20 rados->read ofs=0 len=0 2024-09-12T17:32:40.483 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.479+0000 7f2024a98800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T17:32:40.483 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.479+0000 7f2024a98800 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-09-12T17:32:40.483 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.479+0000 7f2024a98800 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-09-12T17:32:40.483 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.479+0000 7f2024a98800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.23 : miss 2024-09-12T17:32:40.483 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.479+0000 7f2024a98800 20 rados->read ofs=0 len=0 2024-09-12T17:32:40.484 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.479+0000 7f2024a98800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T17:32:40.484 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.479+0000 7f2024a98800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.23 info.flags=0x17 2024-09-12T17:32:40.484 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.479+0000 7f2024a98800 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.23 to cache LRU end 2024-09-12T17:32:40.484 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.479+0000 7f2024a98800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:32:40.484 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.479+0000 7f2024a98800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:32:40.484 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.480+0000 7f2024a98800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.23 2024-09-12T17:32:40.489 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.484+0000 7f2024a98800 -1 Injecting error=-5 at location=set_target_layout 2024-09-12T17:32:40.489 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.484+0000 7f2024a98800 0 ERROR: init_target_layout failed to write target index layout to bucket info: (5) Input/output error 2024-09-12T17:32:40.494 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.493+0000 7f1ed97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:32:40.497 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.495+0000 7f2024a98800 20 remove_watcher() i=0 2024-09-12T17:32:40.497 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.495+0000 7f2024a98800 2 removed watcher, disabling cache 2024-09-12T17:32:40.497 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.496+0000 7f2024a98800 20 remove_watcher() i=1 2024-09-12T17:32:40.498 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.497+0000 7f2024a98800 20 remove_watcher() i=2 2024-09-12T17:32:40.499 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.498+0000 7f2024a98800 20 remove_watcher() i=3 2024-09-12T17:32:40.500 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.499+0000 7f2024a98800 20 remove_watcher() i=4 2024-09-12T17:32:40.501 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.501+0000 7f2024a98800 20 remove_watcher() i=5 2024-09-12T17:32:40.502 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.502+0000 7f2024a98800 20 remove_watcher() i=6 2024-09-12T17:32:40.503 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.503+0000 7f2024a98800 20 remove_watcher() i=7 2024-09-12T17:32:40.516 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-12T17:32:40.545 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:32:40.545 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:32:40.586 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.585+0000 7fbb01528800 20 rados->read ofs=0 len=0 2024-09-12T17:32:40.588 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.587+0000 7fbb01528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:40.588 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.587+0000 7fbb01528800 20 realm 2024-09-12T17:32:40.589 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.587+0000 7fbb01528800 20 rados->read ofs=0 len=0 2024-09-12T17:32:40.589 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.587+0000 7fbb01528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:40.589 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.587+0000 7fbb01528800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:32:40.589 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.587+0000 7fbb01528800 20 rados->read ofs=0 len=0 2024-09-12T17:32:40.589 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.587+0000 7fbb01528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:40.589 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.587+0000 7fbb01528800 20 rados->read ofs=0 len=0 2024-09-12T17:32:40.590 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.588+0000 7fbb01528800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:40.590 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.588+0000 7fbb01528800 20 rados->read ofs=0 len=0 2024-09-12T17:32:40.590 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.589+0000 7fbb01528800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:32:40.590 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.589+0000 7fbb01528800 20 searching for the correct realm 2024-09-12T17:32:40.593 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.592+0000 7fbafda70640 0 -- 172.21.15.37:0/385914417 >> [v2:172.21.15.40:6818/1210108009,v1:172.21.15.40:6819/1210108009] conn(0x7fbaf40038f0 msgr2=0x7fbaf4008ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:32:40.596 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.595+0000 7fbafd26f640 0 -- 172.21.15.37:0/385914417 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7fbaf4063280 msgr2=0x7fbaf4096170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:32:40.804 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.803+0000 7fbb01528800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:32:40.805 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.803+0000 7fbb01528800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:32:40.805 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.803+0000 7fbb01528800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:32:40.805 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.803+0000 7fbb01528800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:32:40.805 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.803+0000 7fbb01528800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:32:40.805 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.803+0000 7fbb01528800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:32:40.805 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.803+0000 7fbb01528800 20 rados->read ofs=0 len=0 2024-09-12T17:32:40.805 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.804+0000 7fbb01528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:40.805 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.804+0000 7fbb01528800 20 rados->read ofs=0 len=0 2024-09-12T17:32:40.806 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.804+0000 7fbb01528800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:40.806 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.804+0000 7fbb01528800 20 rados->read ofs=0 len=0 2024-09-12T17:32:40.806 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.804+0000 7fbb01528800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:32:40.807 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.804+0000 7fbb01528800 20 zone default found 2024-09-12T17:32:40.807 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.804+0000 7fbb01528800 4 Realm: () 2024-09-12T17:32:40.807 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.804+0000 7fbb01528800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:32:40.807 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.804+0000 7fbb01528800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:32:40.807 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.804+0000 7fbb01528800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:32:40.807 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.804+0000 7fbb01528800 20 zonegroup default 2024-09-12T17:32:40.808 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.804+0000 7fbb01528800 20 rados->read ofs=0 len=0 2024-09-12T17:32:40.808 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.805+0000 7fbb01528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:40.808 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.805+0000 7fbb01528800 20 rados->read ofs=0 len=0 2024-09-12T17:32:40.808 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.805+0000 7fbb01528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:40.808 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.805+0000 7fbb01528800 20 rados->read ofs=0 len=0 2024-09-12T17:32:40.808 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.805+0000 7fbb01528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:40.808 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.805+0000 7fbb01528800 20 started sync module instance, tier type = 2024-09-12T17:32:40.808 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.805+0000 7fbb01528800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:32:40.816 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.815+0000 7fbb01528800 20 add_watcher() i=0 2024-09-12T17:32:40.816 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.815+0000 7fbb01528800 20 add_watcher() i=1 2024-09-12T17:32:40.816 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.815+0000 7fbb01528800 20 add_watcher() i=2 2024-09-12T17:32:40.817 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.815+0000 7fbb01528800 20 add_watcher() i=3 2024-09-12T17:32:40.817 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.815+0000 7fbb01528800 20 add_watcher() i=4 2024-09-12T17:32:40.817 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.815+0000 7fbb01528800 20 add_watcher() i=5 2024-09-12T17:32:40.817 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.815+0000 7fbb01528800 20 add_watcher() i=6 2024-09-12T17:32:40.817 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.816+0000 7fbb01528800 20 add_watcher() i=7 2024-09-12T17:32:40.817 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.816+0000 7fbb01528800 2 all 8 watchers are set, enabling cache 2024-09-12T17:32:40.819 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.818+0000 7fb9b37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:32:40.820 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.818+0000 7fbb01528800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:32:40.820 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.818+0000 7fbb01528800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:32:40.820 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.818+0000 7fbb01528800 5 note: GC not initialized 2024-09-12T17:32:40.820 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.819+0000 7fb9b27e4640 20 reqs_thread_entry: start 2024-09-12T17:32:40.820 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.819+0000 7fbb01528800 20 init_complete bucket index max shards: 11 2024-09-12T17:32:40.820 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.819+0000 7fbb01528800 20 Filter name: none 2024-09-12T17:32:40.820 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.819+0000 7fb923fff640 20 reqs_thread_entry: start 2024-09-12T17:32:40.820 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.819+0000 7fbb01528800 20 rados->read ofs=0 len=0 2024-09-12T17:32:40.821 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.819+0000 7fbb01528800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T17:32:40.821 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.819+0000 7fbb01528800 20 rados->read ofs=0 len=0 2024-09-12T17:32:40.822 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.820+0000 7fbb01528800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T17:32:40.822 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.820+0000 7fbb01528800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:32:40.822 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.820+0000 7fbb01528800 20 rados->read ofs=0 len=0 2024-09-12T17:32:40.822 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.820+0000 7fbb01528800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T17:32:40.822 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.820+0000 7fbb01528800 20 rados->read ofs=0 len=0 2024-09-12T17:32:40.822 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.820+0000 7fbb01528800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T17:32:40.822 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.820+0000 7fbb01528800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:32:40.823 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.822+0000 7fb9b37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:32:40.826 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.825+0000 7fbb01528800 20 remove_watcher() i=0 2024-09-12T17:32:40.826 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.825+0000 7fbb01528800 2 removed watcher, disabling cache 2024-09-12T17:32:40.827 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.826+0000 7fbb01528800 20 remove_watcher() i=1 2024-09-12T17:32:40.828 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.827+0000 7fbb01528800 20 remove_watcher() i=2 2024-09-12T17:32:40.829 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.829+0000 7fbb01528800 20 remove_watcher() i=3 2024-09-12T17:32:40.830 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.830+0000 7fbb01528800 20 remove_watcher() i=4 2024-09-12T17:32:40.831 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.831+0000 7fbb01528800 20 remove_watcher() i=5 2024-09-12T17:32:40.832 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.832+0000 7fbb01528800 20 remove_watcher() i=6 2024-09-12T17:32:40.834 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:40.833+0000 7fbb01528800 20 remove_watcher() i=7 2024-09-12T17:32:40.845 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:32:40.845 INFO:tasks.workunit.client.0.smithi037.stderr:BUCKET_STATS: 2024-09-12T17:32:40.845 INFO:tasks.workunit.client.0.smithi037.stderr:bucket: error-at-set-target-layout id: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.23 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:32:40.845 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:32:40.935 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:32:40.968 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:32:40.969 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:32:41.009 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.008+0000 7f80ba014800 20 rados->read ofs=0 len=0 2024-09-12T17:32:41.010 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.009+0000 7f80ba014800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:41.011 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.009+0000 7f80ba014800 20 realm 2024-09-12T17:32:41.011 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.009+0000 7f80ba014800 20 rados->read ofs=0 len=0 2024-09-12T17:32:41.011 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.009+0000 7f80ba014800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:41.011 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.009+0000 7f80ba014800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:32:41.011 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.009+0000 7f80ba014800 20 rados->read ofs=0 len=0 2024-09-12T17:32:41.011 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.010+0000 7f80ba014800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:41.011 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.010+0000 7f80ba014800 20 rados->read ofs=0 len=0 2024-09-12T17:32:41.012 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.010+0000 7f80ba014800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:41.012 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.010+0000 7f80ba014800 20 rados->read ofs=0 len=0 2024-09-12T17:32:41.012 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.011+0000 7f80ba014800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:32:41.012 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.011+0000 7f80ba014800 20 searching for the correct realm 2024-09-12T17:32:41.015 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.014+0000 7f80acfdf640 0 -- 172.21.15.37:0/664248293 >> [v2:172.21.15.40:6800/2441293461,v1:172.21.15.40:6801/2441293461] conn(0x7f80a8056410 msgr2=0x7f80a8056830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:32:41.019 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.018+0000 7f80b57e0640 0 -- 172.21.15.37:0/664248293 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7f80a0091de0 msgr2=0x7f80a00a4400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:32:41.226 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.225+0000 7f80ba014800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:32:41.227 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.225+0000 7f80ba014800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:32:41.227 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.225+0000 7f80ba014800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:32:41.227 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.225+0000 7f80ba014800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:32:41.227 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.225+0000 7f80ba014800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:32:41.227 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.225+0000 7f80ba014800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:32:41.227 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.225+0000 7f80ba014800 20 rados->read ofs=0 len=0 2024-09-12T17:32:41.227 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.226+0000 7f80ba014800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:41.227 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.226+0000 7f80ba014800 20 rados->read ofs=0 len=0 2024-09-12T17:32:41.229 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.226+0000 7f80ba014800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:41.229 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.226+0000 7f80ba014800 20 rados->read ofs=0 len=0 2024-09-12T17:32:41.229 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.226+0000 7f80ba014800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:32:41.229 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.226+0000 7f80ba014800 20 zone default found 2024-09-12T17:32:41.229 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.226+0000 7f80ba014800 4 Realm: () 2024-09-12T17:32:41.230 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.226+0000 7f80ba014800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:32:41.230 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.226+0000 7f80ba014800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:32:41.230 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.226+0000 7f80ba014800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:32:41.230 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.226+0000 7f80ba014800 20 zonegroup default 2024-09-12T17:32:41.230 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.226+0000 7f80ba014800 20 rados->read ofs=0 len=0 2024-09-12T17:32:41.230 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.227+0000 7f80ba014800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:41.230 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.227+0000 7f80ba014800 20 rados->read ofs=0 len=0 2024-09-12T17:32:41.230 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.227+0000 7f80ba014800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:41.231 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.227+0000 7f80ba014800 20 rados->read ofs=0 len=0 2024-09-12T17:32:41.231 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.227+0000 7f80ba014800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:41.231 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.228+0000 7f80ba014800 20 started sync module instance, tier type = 2024-09-12T17:32:41.231 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.228+0000 7f80ba014800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:32:41.239 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.238+0000 7f80ba014800 20 add_watcher() i=0 2024-09-12T17:32:41.239 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.238+0000 7f80ba014800 20 add_watcher() i=1 2024-09-12T17:32:41.239 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.238+0000 7f80ba014800 20 add_watcher() i=2 2024-09-12T17:32:41.239 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.238+0000 7f80ba014800 20 add_watcher() i=3 2024-09-12T17:32:41.239 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.238+0000 7f80ba014800 20 add_watcher() i=4 2024-09-12T17:32:41.239 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.238+0000 7f80ba014800 20 add_watcher() i=5 2024-09-12T17:32:41.239 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.238+0000 7f80ba014800 20 add_watcher() i=6 2024-09-12T17:32:41.240 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.239+0000 7f80ba014800 20 add_watcher() i=7 2024-09-12T17:32:41.240 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.239+0000 7f80ba014800 2 all 8 watchers are set, enabling cache 2024-09-12T17:32:41.243 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.241+0000 7f7f6bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:32:41.244 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.241+0000 7f80ba014800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:32:41.244 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.241+0000 7f80ba014800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:32:41.244 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.241+0000 7f80ba014800 5 note: GC not initialized 2024-09-12T17:32:41.244 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.241+0000 7f7f6afe5640 20 reqs_thread_entry: start 2024-09-12T17:32:41.244 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.241+0000 7f80ba014800 20 init_complete bucket index max shards: 11 2024-09-12T17:32:41.244 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.242+0000 7f80ba014800 20 Filter name: none 2024-09-12T17:32:41.244 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.242+0000 7f7f68fe1640 20 reqs_thread_entry: start 2024-09-12T17:32:41.244 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.242+0000 7f80ba014800 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-09-12T17:32:41.244 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.242+0000 7f80ba014800 20 rados->read ofs=0 len=0 2024-09-12T17:32:41.244 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.242+0000 7f80ba014800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T17:32:41.245 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.242+0000 7f80ba014800 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-09-12T17:32:41.245 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.242+0000 7f80ba014800 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-09-12T17:32:41.245 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.242+0000 7f80ba014800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.23 : miss 2024-09-12T17:32:41.245 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.242+0000 7f80ba014800 20 rados->read ofs=0 len=0 2024-09-12T17:32:41.245 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.243+0000 7f80ba014800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T17:32:41.245 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.243+0000 7f80ba014800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.23 info.flags=0x17 2024-09-12T17:32:41.245 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.243+0000 7f80ba014800 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.23 to cache LRU end 2024-09-12T17:32:41.245 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.243+0000 7f80ba014800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:32:41.246 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.243+0000 7f80ba014800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:32:41.246 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.243+0000 7f80ba014800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.23 2024-09-12T17:32:41.250 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.249+0000 7f80ba014800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.23 info.flags=0x17 2024-09-12T17:32:41.250 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.249+0000 7f80ba014800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.23 to cache LRU end 2024-09-12T17:32:41.250 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.249+0000 7f80ba014800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:32:41.250 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.249+0000 7f80ba014800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.23, ofs0, ns] 2024-09-12T17:32:41.251 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.249+0000 7f7f98ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496981 cookie 93950198267136 notifier 6540 bl.length()=1009 2024-09-12T17:32:41.251 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.249+0000 7f7f98ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.23 info.flags=0x17 2024-09-12T17:32:41.251 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.249+0000 7f7f98ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.23 to cache LRU end 2024-09-12T17:32:41.251 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.249+0000 7f7f98ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:32:41.252 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.251+0000 7f80ba014800 20 handle_bi_update(): bucket=:error-at-set-target-layout[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.23]): orig_sources= new_sources= 2024-09-12T17:32:41.252 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.251+0000 7f80ba014800 20 handle_bi_update(): bucket=:error-at-set-target-layout[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.23]): potential sources added=[] removed=[] 2024-09-12T17:32:41.252 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.251+0000 7f80ba014800 20 handle_bi_update(): bucket=:error-at-set-target-layout[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.23]): orig_dests= new_dests= 2024-09-12T17:32:41.252 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.251+0000 7f80ba014800 20 handle_bi_update(): bucket=:error-at-set-target-layout[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.23]): potential dests added=[] removed=[] 2024-09-12T17:32:41.257 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.257+0000 7f80ba014800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.23.1.0 2024-09-12T17:32:41.258 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.257+0000 7f80ba014800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.23.1.0 2024-09-12T17:32:41.258 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.257+0000 7f80ba014800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.23.1.1 2024-09-12T17:32:41.258 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.257+0000 7f80ba014800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.23.1.1 2024-09-12T17:32:41.258 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.257+0000 7f80ba014800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.23.1.2 2024-09-12T17:32:41.258 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.257+0000 7f80ba014800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.23.1.2 2024-09-12T17:32:41.258 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.257+0000 7f80ba014800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.23.1.3 2024-09-12T17:32:41.258 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.257+0000 7f80ba014800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.23.1.3 2024-09-12T17:32:41.258 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.257+0000 7f80ba014800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.23.1.4 2024-09-12T17:32:41.258 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.257+0000 7f80ba014800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.23.1.4 2024-09-12T17:32:41.258 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.257+0000 7f80ba014800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.23.1.5 2024-09-12T17:32:41.259 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.257+0000 7f80ba014800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.23.1.5 2024-09-12T17:32:41.259 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.257+0000 7f80ba014800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.23.1.6 2024-09-12T17:32:41.259 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.257+0000 7f80ba014800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.23.1.6 2024-09-12T17:32:41.259 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.257+0000 7f80ba014800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.23.1.7 2024-09-12T17:32:41.259 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.257+0000 7f80ba014800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.23.1.7 2024-09-12T17:32:41.259 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.257+0000 7f80ba014800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.23.1.8 2024-09-12T17:32:41.259 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.257+0000 7f80ba014800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.23.1.8 2024-09-12T17:32:41.259 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.257+0000 7f80ba014800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.23.1.9 2024-09-12T17:32:41.259 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.257+0000 7f80ba014800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.23.1.9 2024-09-12T17:32:41.259 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.257+0000 7f80ba014800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.23.1.10 2024-09-12T17:32:41.260 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.257+0000 7f80ba014800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.23.1.10 2024-09-12T17:32:41.260 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.257+0000 7f80ba014800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.23.1.11 2024-09-12T17:32:41.260 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.257+0000 7f80ba014800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.23.1.11 2024-09-12T17:32:41.260 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.257+0000 7f80ba014800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.23.0 2024-09-12T17:32:41.262 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.257+0000 7f80ba014800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.23.1 2024-09-12T17:32:41.262 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.258+0000 7f80ba014800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.23.2 2024-09-12T17:32:41.262 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.259+0000 7f80ba014800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.23.3 2024-09-12T17:32:41.262 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.259+0000 7f80ba014800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.23.4 2024-09-12T17:32:41.262 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.260+0000 7f80ba014800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.23.5 2024-09-12T17:32:41.262 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.260+0000 7f80ba014800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.23.6 2024-09-12T17:32:41.262 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.261+0000 7f80ba014800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.23.7 2024-09-12T17:32:41.263 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.262+0000 7f80ba014800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.23.8 2024-09-12T17:32:41.263 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.262+0000 7f80ba014800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.23.9 2024-09-12T17:32:41.264 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.263+0000 7f80ba014800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.23.10 2024-09-12T17:32:41.267 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.266+0000 7f80ba014800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.23 : hit (requested=0x17, cached=0x17) 2024-09-12T17:32:41.267 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.266+0000 7f80ba014800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.23 2024-09-12T17:32:41.269 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.267+0000 7f80ba014800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.23 info.flags=0x17 2024-09-12T17:32:41.269 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.267+0000 7f80ba014800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.23 to cache LRU end 2024-09-12T17:32:41.269 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.267+0000 7f80ba014800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:32:41.269 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.267+0000 7f80ba014800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.23, ofs0, ns] 2024-09-12T17:32:41.269 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.268+0000 7f7f98ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496982 cookie 93950198267136 notifier 6540 bl.length()=1009 2024-09-12T17:32:41.269 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.268+0000 7f7f98ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.23 info.flags=0x17 2024-09-12T17:32:41.269 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.268+0000 7f7f98ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.23 to cache LRU end 2024-09-12T17:32:41.269 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.268+0000 7f7f98ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:32:41.270 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.270+0000 7f80ba014800 20 handle_bi_update(): bucket=:error-at-set-target-layout[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.23]): orig_sources= new_sources= 2024-09-12T17:32:41.270 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.270+0000 7f80ba014800 20 handle_bi_update(): bucket=:error-at-set-target-layout[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.23]): potential sources added=[] removed=[] 2024-09-12T17:32:41.270 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.270+0000 7f80ba014800 20 handle_bi_update(): bucket=:error-at-set-target-layout[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.23]): orig_dests= new_dests= 2024-09-12T17:32:41.270 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.270+0000 7f80ba014800 20 handle_bi_update(): bucket=:error-at-set-target-layout[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.23]): potential dests added=[] removed=[] 2024-09-12T17:32:41.273 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.273+0000 7f80ba014800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.23.0 2024-09-12T17:32:41.274 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.273+0000 7f80ba014800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.23.1 2024-09-12T17:32:41.274 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.273+0000 7f80ba014800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.23.2 2024-09-12T17:32:41.274 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.274+0000 7f80ba014800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.23.3 2024-09-12T17:32:41.275 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.274+0000 7f80ba014800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.23.4 2024-09-12T17:32:41.275 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.274+0000 7f80ba014800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.23.5 2024-09-12T17:32:41.276 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.275+0000 7f80ba014800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.23.6 2024-09-12T17:32:41.276 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.275+0000 7f80ba014800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.23.7 2024-09-12T17:32:41.276 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.276+0000 7f80ba014800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.23.8 2024-09-12T17:32:41.277 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.276+0000 7f80ba014800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.23.9 2024-09-12T17:32:41.277 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.276+0000 7f80ba014800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.23.10 2024-09-12T17:32:41.277 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.277+0000 7f80ba014800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.23 : hit (requested=0x17, cached=0x17) 2024-09-12T17:32:41.277 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.277+0000 7f80ba014800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.23 2024-09-12T17:32:41.279 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.278+0000 7f80ba014800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.23 info.flags=0x17 2024-09-12T17:32:41.279 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.278+0000 7f80ba014800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.23 to cache LRU end 2024-09-12T17:32:41.279 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.278+0000 7f80ba014800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:32:41.279 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.278+0000 7f80ba014800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.23, ofs0, ns] 2024-09-12T17:32:41.279 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.278+0000 7f7f87fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496983 cookie 93950198267136 notifier 6540 bl.length()=977 2024-09-12T17:32:41.280 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.278+0000 7f7f87fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.23 info.flags=0x17 2024-09-12T17:32:41.280 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.278+0000 7f7f87fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.23 to cache LRU end 2024-09-12T17:32:41.280 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.278+0000 7f7f87fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:32:41.280 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.280+0000 7f80ba014800 20 handle_bi_update(): bucket=:error-at-set-target-layout[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.23]): orig_sources= new_sources= 2024-09-12T17:32:41.281 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.280+0000 7f80ba014800 20 handle_bi_update(): bucket=:error-at-set-target-layout[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.23]): potential sources added=[] removed=[] 2024-09-12T17:32:41.281 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.280+0000 7f80ba014800 20 handle_bi_update(): bucket=:error-at-set-target-layout[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.23]): orig_dests= new_dests= 2024-09-12T17:32:41.281 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.280+0000 7f80ba014800 20 handle_bi_update(): bucket=:error-at-set-target-layout[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.23]): potential dests added=[] removed=[] 2024-09-12T17:32:41.283 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.283+0000 7f80ba014800 1 execute INFO: reshard of bucket "error-at-set-target-layout" from 11 shards to 12 shards completed successfully 2024-09-12T17:32:41.285 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.285+0000 7f7f6bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:32:41.288 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.287+0000 7f80ba014800 20 remove_watcher() i=0 2024-09-12T17:32:41.288 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.287+0000 7f80ba014800 2 removed watcher, disabling cache 2024-09-12T17:32:41.289 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.288+0000 7f80ba014800 20 remove_watcher() i=1 2024-09-12T17:32:41.290 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.289+0000 7f80ba014800 20 remove_watcher() i=2 2024-09-12T17:32:41.291 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.290+0000 7f80ba014800 20 remove_watcher() i=3 2024-09-12T17:32:41.292 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.291+0000 7f80ba014800 20 remove_watcher() i=4 2024-09-12T17:32:41.293 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.292+0000 7f80ba014800 20 remove_watcher() i=5 2024-09-12T17:32:41.294 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.294+0000 7f80ba014800 20 remove_watcher() i=6 2024-09-12T17:32:41.295 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.295+0000 7f80ba014800 20 remove_watcher() i=7 2024-09-12T17:32:41.308 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-12T17:32:41.338 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:32:41.338 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:32:41.378 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.377+0000 7f0111519800 20 rados->read ofs=0 len=0 2024-09-12T17:32:41.380 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.378+0000 7f0111519800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:41.380 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.378+0000 7f0111519800 20 realm 2024-09-12T17:32:41.380 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.379+0000 7f0111519800 20 rados->read ofs=0 len=0 2024-09-12T17:32:41.380 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.379+0000 7f0111519800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:41.380 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.379+0000 7f0111519800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:32:41.380 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.379+0000 7f0111519800 20 rados->read ofs=0 len=0 2024-09-12T17:32:41.380 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.379+0000 7f0111519800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:41.380 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.379+0000 7f0111519800 20 rados->read ofs=0 len=0 2024-09-12T17:32:41.381 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.380+0000 7f0111519800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:41.381 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.380+0000 7f0111519800 20 rados->read ofs=0 len=0 2024-09-12T17:32:41.381 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.380+0000 7f0111519800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:32:41.381 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.380+0000 7f0111519800 20 searching for the correct realm 2024-09-12T17:32:41.383 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.383+0000 7f010e802640 0 -- 172.21.15.37:0/4225004802 >> [v2:172.21.15.40:6800/2441293461,v1:172.21.15.40:6801/2441293461] conn(0x7f010004db90 msgr2=0x7f01000606b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:32:41.591 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.590+0000 7f010f003640 0 -- 172.21.15.37:0/4225004802 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7f010407e040 msgr2=0x7f0104064040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:32:41.799 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.798+0000 7f0111519800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:32:41.799 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.798+0000 7f0111519800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:32:41.799 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.798+0000 7f0111519800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:32:41.799 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.798+0000 7f0111519800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:32:41.799 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.798+0000 7f0111519800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:32:41.799 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.798+0000 7f0111519800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:32:41.799 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.798+0000 7f0111519800 20 rados->read ofs=0 len=0 2024-09-12T17:32:41.799 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.798+0000 7f0111519800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:41.799 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.798+0000 7f0111519800 20 rados->read ofs=0 len=0 2024-09-12T17:32:41.800 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.798+0000 7f0111519800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:41.800 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.798+0000 7f0111519800 20 rados->read ofs=0 len=0 2024-09-12T17:32:41.800 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.799+0000 7f0111519800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:32:41.800 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.799+0000 7f0111519800 20 zone default found 2024-09-12T17:32:41.800 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.799+0000 7f0111519800 4 Realm: () 2024-09-12T17:32:41.801 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.799+0000 7f0111519800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:32:41.801 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.799+0000 7f0111519800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:32:41.801 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.799+0000 7f0111519800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:32:41.801 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.799+0000 7f0111519800 20 zonegroup default 2024-09-12T17:32:41.801 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.799+0000 7f0111519800 20 rados->read ofs=0 len=0 2024-09-12T17:32:41.801 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.799+0000 7f0111519800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:41.801 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.799+0000 7f0111519800 20 rados->read ofs=0 len=0 2024-09-12T17:32:41.801 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.799+0000 7f0111519800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:41.801 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.799+0000 7f0111519800 20 rados->read ofs=0 len=0 2024-09-12T17:32:41.802 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.800+0000 7f0111519800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:41.802 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.800+0000 7f0111519800 20 started sync module instance, tier type = 2024-09-12T17:32:41.802 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.800+0000 7f0111519800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:32:41.812 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.811+0000 7f0111519800 20 add_watcher() i=0 2024-09-12T17:32:41.812 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.811+0000 7f0111519800 20 add_watcher() i=1 2024-09-12T17:32:41.812 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.811+0000 7f0111519800 20 add_watcher() i=2 2024-09-12T17:32:41.812 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.811+0000 7f0111519800 20 add_watcher() i=3 2024-09-12T17:32:41.812 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.811+0000 7f0111519800 20 add_watcher() i=4 2024-09-12T17:32:41.812 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.811+0000 7f0111519800 20 add_watcher() i=5 2024-09-12T17:32:41.812 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.811+0000 7f0111519800 20 add_watcher() i=6 2024-09-12T17:32:41.812 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.812+0000 7f0111519800 20 add_watcher() i=7 2024-09-12T17:32:41.813 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.812+0000 7f0111519800 2 all 8 watchers are set, enabling cache 2024-09-12T17:32:41.814 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.814+0000 7effc57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:32:41.815 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.814+0000 7f0111519800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:32:41.815 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.814+0000 7f0111519800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:32:41.816 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.814+0000 7f0111519800 5 note: GC not initialized 2024-09-12T17:32:41.816 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.814+0000 7eff3ffff640 20 reqs_thread_entry: start 2024-09-12T17:32:41.816 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.814+0000 7f0111519800 20 init_complete bucket index max shards: 11 2024-09-12T17:32:41.816 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.814+0000 7f0111519800 20 Filter name: none 2024-09-12T17:32:41.816 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.815+0000 7eff3dffb640 20 reqs_thread_entry: start 2024-09-12T17:32:41.816 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.815+0000 7f0111519800 20 rados->read ofs=0 len=0 2024-09-12T17:32:41.817 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.815+0000 7f0111519800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T17:32:41.817 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.815+0000 7f0111519800 20 rados->read ofs=0 len=0 2024-09-12T17:32:41.817 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.816+0000 7f0111519800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T17:32:41.817 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.816+0000 7f0111519800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:32:41.817 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.816+0000 7f0111519800 20 rados->read ofs=0 len=0 2024-09-12T17:32:41.817 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.816+0000 7f0111519800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T17:32:41.817 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.816+0000 7f0111519800 20 rados->read ofs=0 len=0 2024-09-12T17:32:41.818 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.817+0000 7f0111519800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T17:32:41.818 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.817+0000 7f0111519800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:32:41.819 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.819+0000 7effc57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:32:41.822 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.821+0000 7f0111519800 20 remove_watcher() i=0 2024-09-12T17:32:41.822 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.821+0000 7f0111519800 2 removed watcher, disabling cache 2024-09-12T17:32:41.823 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.822+0000 7f0111519800 20 remove_watcher() i=1 2024-09-12T17:32:41.824 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.824+0000 7f0111519800 20 remove_watcher() i=2 2024-09-12T17:32:41.826 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.825+0000 7f0111519800 20 remove_watcher() i=3 2024-09-12T17:32:41.827 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.826+0000 7f0111519800 20 remove_watcher() i=4 2024-09-12T17:32:41.828 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.827+0000 7f0111519800 20 remove_watcher() i=5 2024-09-12T17:32:41.829 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.828+0000 7f0111519800 20 remove_watcher() i=6 2024-09-12T17:32:41.830 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:41.829+0000 7f0111519800 20 remove_watcher() i=7 2024-09-12T17:32:41.842 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:32:41.842 INFO:tasks.workunit.client.0.smithi037.stderr:BUCKET_STATS: 2024-09-12T17:32:41.842 INFO:tasks.workunit.client.0.smithi037.stderr:bucket: error-at-set-target-layout id: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.23 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T17:32:41.842 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:32:42.198 INFO:tasks.workunit.client.0.smithi037.stderr:TEST: reshard bucket with ECANCELED injected at set_target_layout 2024-09-12T17:32:42.199 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:32:42.980 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-12T17:32:43.009 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:32:43.009 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:32:43.049 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.048+0000 7f8716240800 20 rados->read ofs=0 len=0 2024-09-12T17:32:43.050 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.049+0000 7f8716240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:43.051 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.049+0000 7f8716240800 20 realm 2024-09-12T17:32:43.051 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.049+0000 7f8716240800 20 rados->read ofs=0 len=0 2024-09-12T17:32:43.051 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.050+0000 7f8716240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:43.051 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.050+0000 7f8716240800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:32:43.051 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.050+0000 7f8716240800 20 rados->read ofs=0 len=0 2024-09-12T17:32:43.051 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.050+0000 7f8716240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:43.051 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.050+0000 7f8716240800 20 rados->read ofs=0 len=0 2024-09-12T17:32:43.052 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.051+0000 7f8716240800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:43.052 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.051+0000 7f8716240800 20 rados->read ofs=0 len=0 2024-09-12T17:32:43.052 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.051+0000 7f8716240800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:32:43.052 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.051+0000 7f8716240800 20 searching for the correct realm 2024-09-12T17:32:43.053 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.053+0000 7f8713d2a640 0 -- 172.21.15.37:0/3173917962 >> [v2:172.21.15.37:6800/1206746176,v1:172.21.15.37:6801/1206746176] conn(0x7f870c061070 msgr2=0x7f870c0bfac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:32:43.058 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.057+0000 7f871452b640 0 -- 172.21.15.37:0/3173917962 >> [v2:172.21.15.40:6818/1210108009,v1:172.21.15.40:6819/1210108009] conn(0x7f870804d070 msgr2=0x7f870804e3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:32:43.064 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.062+0000 7f8716240800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:32:43.064 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.062+0000 7f8716240800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:32:43.065 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.062+0000 7f8716240800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:32:43.065 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.062+0000 7f8716240800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:32:43.065 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.062+0000 7f8716240800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:32:43.065 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.062+0000 7f8716240800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:32:43.065 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.062+0000 7f8716240800 20 rados->read ofs=0 len=0 2024-09-12T17:32:43.065 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.063+0000 7f8716240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:43.065 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.063+0000 7f8716240800 20 rados->read ofs=0 len=0 2024-09-12T17:32:43.065 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.063+0000 7f8716240800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:43.065 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.063+0000 7f8716240800 20 rados->read ofs=0 len=0 2024-09-12T17:32:43.065 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.063+0000 7f8716240800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:32:43.065 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.063+0000 7f8716240800 20 zone default found 2024-09-12T17:32:43.065 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.063+0000 7f8716240800 4 Realm: () 2024-09-12T17:32:43.066 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.063+0000 7f8716240800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:32:43.066 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.063+0000 7f8716240800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:32:43.066 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.063+0000 7f8716240800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:32:43.066 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.063+0000 7f8716240800 20 zonegroup default 2024-09-12T17:32:43.066 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.063+0000 7f8716240800 20 rados->read ofs=0 len=0 2024-09-12T17:32:43.066 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.063+0000 7f8716240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:43.066 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.064+0000 7f8716240800 20 rados->read ofs=0 len=0 2024-09-12T17:32:43.067 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.064+0000 7f8716240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:43.067 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.064+0000 7f8716240800 20 rados->read ofs=0 len=0 2024-09-12T17:32:43.067 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.064+0000 7f8716240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:43.067 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.064+0000 7f8716240800 20 started sync module instance, tier type = 2024-09-12T17:32:43.067 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.064+0000 7f8716240800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:32:43.075 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.074+0000 7f8716240800 20 add_watcher() i=0 2024-09-12T17:32:43.075 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.074+0000 7f8716240800 20 add_watcher() i=1 2024-09-12T17:32:43.075 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.074+0000 7f8716240800 20 add_watcher() i=2 2024-09-12T17:32:43.076 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.074+0000 7f8716240800 20 add_watcher() i=3 2024-09-12T17:32:43.076 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.074+0000 7f8716240800 20 add_watcher() i=4 2024-09-12T17:32:43.076 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.074+0000 7f8716240800 20 add_watcher() i=5 2024-09-12T17:32:43.076 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.075+0000 7f8716240800 20 add_watcher() i=6 2024-09-12T17:32:43.076 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.075+0000 7f8716240800 20 add_watcher() i=7 2024-09-12T17:32:43.076 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.075+0000 7f8716240800 2 all 8 watchers are set, enabling cache 2024-09-12T17:32:43.078 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.077+0000 7f85c9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:32:43.079 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.077+0000 7f8716240800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:32:43.079 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.077+0000 7f8716240800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:32:43.079 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.077+0000 7f8716240800 5 note: GC not initialized 2024-09-12T17:32:43.079 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.078+0000 7f85c8fe1640 20 reqs_thread_entry: start 2024-09-12T17:32:43.079 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.078+0000 7f8716240800 20 init_complete bucket index max shards: 11 2024-09-12T17:32:43.079 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.078+0000 7f8716240800 20 Filter name: none 2024-09-12T17:32:43.079 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.078+0000 7f85427fc640 20 reqs_thread_entry: start 2024-09-12T17:32:43.079 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.078+0000 7f8716240800 20 rados->read ofs=0 len=0 2024-09-12T17:32:43.081 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.079+0000 7f8716240800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T17:32:43.081 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.079+0000 7f8716240800 20 rados->read ofs=0 len=0 2024-09-12T17:32:43.081 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.079+0000 7f8716240800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T17:32:43.081 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.079+0000 7f8716240800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:32:43.081 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.079+0000 7f8716240800 20 rados->read ofs=0 len=0 2024-09-12T17:32:43.081 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.079+0000 7f8716240800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T17:32:43.081 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.079+0000 7f8716240800 20 rados->read ofs=0 len=0 2024-09-12T17:32:43.081 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.080+0000 7f8716240800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T17:32:43.081 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.080+0000 7f8716240800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:32:43.082 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.081+0000 7f85c9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:32:43.084 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.084+0000 7f8716240800 20 remove_watcher() i=0 2024-09-12T17:32:43.085 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.084+0000 7f8716240800 2 removed watcher, disabling cache 2024-09-12T17:32:43.085 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.085+0000 7f8716240800 20 remove_watcher() i=1 2024-09-12T17:32:43.086 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.086+0000 7f8716240800 20 remove_watcher() i=2 2024-09-12T17:32:43.087 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.087+0000 7f8716240800 20 remove_watcher() i=3 2024-09-12T17:32:43.089 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.088+0000 7f8716240800 20 remove_watcher() i=4 2024-09-12T17:32:43.090 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.089+0000 7f8716240800 20 remove_watcher() i=5 2024-09-12T17:32:43.091 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.090+0000 7f8716240800 20 remove_watcher() i=6 2024-09-12T17:32:43.092 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.091+0000 7f8716240800 20 remove_watcher() i=7 2024-09-12T17:32:43.103 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:32:43.103 INFO:tasks.workunit.client.0.smithi037.stderr:BUCKET_STATS: 2024-09-12T17:32:43.103 INFO:tasks.workunit.client.0.smithi037.stderr:bucket: error-at-set-target-layout id: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.24 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:32:43.103 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:32:43.105 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at set_target_layout --inject-error-code 125 2024-09-12T17:32:43.142 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:32:43.142 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:32:43.182 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.181+0000 7f3334887800 20 rados->read ofs=0 len=0 2024-09-12T17:32:43.183 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.182+0000 7f3334887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:43.183 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.182+0000 7f3334887800 20 realm 2024-09-12T17:32:43.184 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.182+0000 7f3334887800 20 rados->read ofs=0 len=0 2024-09-12T17:32:43.184 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.183+0000 7f3334887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:43.184 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.183+0000 7f3334887800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:32:43.184 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.183+0000 7f3334887800 20 rados->read ofs=0 len=0 2024-09-12T17:32:43.184 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.183+0000 7f3334887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:43.184 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.183+0000 7f3334887800 20 rados->read ofs=0 len=0 2024-09-12T17:32:43.185 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.184+0000 7f3334887800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:43.185 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.184+0000 7f3334887800 20 rados->read ofs=0 len=0 2024-09-12T17:32:43.185 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.184+0000 7f3334887800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:32:43.185 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.184+0000 7f3334887800 20 searching for the correct realm 2024-09-12T17:32:43.187 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.187+0000 7f3331b70640 0 -- 172.21.15.37:0/3982613252 >> [v2:172.21.15.40:6800/2441293461,v1:172.21.15.40:6801/2441293461] conn(0x7f3324063b60 msgr2=0x7f33240615b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:32:43.191 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.190+0000 7f3332371640 0 -- 172.21.15.37:0/3982613252 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7f33280b5e50 msgr2=0x7f33280e2250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:32:43.397 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.396+0000 7f3334887800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:32:43.397 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.396+0000 7f3334887800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:32:43.397 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.396+0000 7f3334887800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:32:43.397 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.396+0000 7f3334887800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:32:43.397 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.396+0000 7f3334887800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:32:43.397 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.396+0000 7f3334887800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:32:43.397 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.396+0000 7f3334887800 20 rados->read ofs=0 len=0 2024-09-12T17:32:43.398 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.396+0000 7f3334887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:43.398 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.396+0000 7f3334887800 20 rados->read ofs=0 len=0 2024-09-12T17:32:43.399 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.396+0000 7f3334887800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:43.399 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.396+0000 7f3334887800 20 rados->read ofs=0 len=0 2024-09-12T17:32:43.399 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.397+0000 7f3334887800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:32:43.399 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.397+0000 7f3334887800 20 zone default found 2024-09-12T17:32:43.399 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.397+0000 7f3334887800 4 Realm: () 2024-09-12T17:32:43.399 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.397+0000 7f3334887800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:32:43.399 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.397+0000 7f3334887800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:32:43.399 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.397+0000 7f3334887800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:32:43.399 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.397+0000 7f3334887800 20 zonegroup default 2024-09-12T17:32:43.399 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.397+0000 7f3334887800 20 rados->read ofs=0 len=0 2024-09-12T17:32:43.399 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.397+0000 7f3334887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:43.400 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.397+0000 7f3334887800 20 rados->read ofs=0 len=0 2024-09-12T17:32:43.400 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.398+0000 7f3334887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:43.400 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.398+0000 7f3334887800 20 rados->read ofs=0 len=0 2024-09-12T17:32:43.400 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.398+0000 7f3334887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:43.400 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.398+0000 7f3334887800 20 started sync module instance, tier type = 2024-09-12T17:32:43.400 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.398+0000 7f3334887800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:32:43.409 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.408+0000 7f3334887800 20 add_watcher() i=0 2024-09-12T17:32:43.409 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.408+0000 7f3334887800 20 add_watcher() i=1 2024-09-12T17:32:43.409 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.408+0000 7f3334887800 20 add_watcher() i=2 2024-09-12T17:32:43.409 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.408+0000 7f3334887800 20 add_watcher() i=3 2024-09-12T17:32:43.409 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.408+0000 7f3334887800 20 add_watcher() i=4 2024-09-12T17:32:43.409 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.408+0000 7f3334887800 20 add_watcher() i=5 2024-09-12T17:32:43.409 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.408+0000 7f3334887800 20 add_watcher() i=6 2024-09-12T17:32:43.410 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.409+0000 7f3334887800 20 add_watcher() i=7 2024-09-12T17:32:43.410 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.409+0000 7f3334887800 2 all 8 watchers are set, enabling cache 2024-09-12T17:32:43.411 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.411+0000 7f31e8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:32:43.412 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.411+0000 7f3334887800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:32:43.412 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.411+0000 7f3334887800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:32:43.412 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.411+0000 7f3334887800 5 note: GC not initialized 2024-09-12T17:32:43.412 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.411+0000 7f31637fe640 20 reqs_thread_entry: start 2024-09-12T17:32:43.413 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.411+0000 7f3334887800 20 init_complete bucket index max shards: 11 2024-09-12T17:32:43.413 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.412+0000 7f3334887800 20 Filter name: none 2024-09-12T17:32:43.413 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.412+0000 7f31617fa640 20 reqs_thread_entry: start 2024-09-12T17:32:43.414 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.412+0000 7f3334887800 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-09-12T17:32:43.414 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.412+0000 7f3334887800 20 rados->read ofs=0 len=0 2024-09-12T17:32:43.414 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.412+0000 7f3334887800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T17:32:43.414 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.412+0000 7f3334887800 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-09-12T17:32:43.414 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.412+0000 7f3334887800 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-09-12T17:32:43.414 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.412+0000 7f3334887800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.24 : miss 2024-09-12T17:32:43.414 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.412+0000 7f3334887800 20 rados->read ofs=0 len=0 2024-09-12T17:32:43.414 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.413+0000 7f3334887800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T17:32:43.414 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.413+0000 7f3334887800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.24 info.flags=0x17 2024-09-12T17:32:43.414 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.413+0000 7f3334887800 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.24 to cache LRU end 2024-09-12T17:32:43.414 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.413+0000 7f3334887800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:32:43.414 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.413+0000 7f3334887800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:32:43.414 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.413+0000 7f3334887800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.24 2024-09-12T17:32:43.417 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.417+0000 7f3334887800 -1 Injecting error=-125 at location=set_target_layout 2024-09-12T17:32:43.419 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.418+0000 7f3334887800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.24 info.flags=0x17 2024-09-12T17:32:43.419 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.418+0000 7f3334887800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.24 to cache LRU end 2024-09-12T17:32:43.419 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.418+0000 7f3334887800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:32:43.420 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.418+0000 7f3334887800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.24, ofs0, ns] 2024-09-12T17:32:43.420 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.418+0000 7f3215ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496986 cookie 93942160701344 notifier 6600 bl.length()=1009 2024-09-12T17:32:43.420 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.418+0000 7f3215ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.24 info.flags=0x17 2024-09-12T17:32:43.420 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.418+0000 7f3215ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.24 to cache LRU end 2024-09-12T17:32:43.420 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.418+0000 7f3215ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:32:43.421 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.420+0000 7f3334887800 20 handle_bi_update(): bucket=:error-at-set-target-layout[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.24]): orig_sources= new_sources= 2024-09-12T17:32:43.421 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.420+0000 7f3334887800 20 handle_bi_update(): bucket=:error-at-set-target-layout[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.24]): potential sources added=[] removed=[] 2024-09-12T17:32:43.421 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.420+0000 7f3334887800 20 handle_bi_update(): bucket=:error-at-set-target-layout[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.24]): orig_dests= new_dests= 2024-09-12T17:32:43.421 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.420+0000 7f3334887800 20 handle_bi_update(): bucket=:error-at-set-target-layout[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.24]): potential dests added=[] removed=[] 2024-09-12T17:32:43.426 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.425+0000 7f3334887800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.24.1.0 2024-09-12T17:32:43.427 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.425+0000 7f3334887800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.24.1.0 2024-09-12T17:32:43.427 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.425+0000 7f3334887800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.24.1.1 2024-09-12T17:32:43.427 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.425+0000 7f3334887800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.24.1.1 2024-09-12T17:32:43.427 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.425+0000 7f3334887800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.24.1.2 2024-09-12T17:32:43.427 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.425+0000 7f3334887800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.24.1.2 2024-09-12T17:32:43.427 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.425+0000 7f3334887800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.24.1.3 2024-09-12T17:32:43.428 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.425+0000 7f3334887800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.24.1.3 2024-09-12T17:32:43.428 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.425+0000 7f3334887800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.24.1.4 2024-09-12T17:32:43.428 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.425+0000 7f3334887800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.24.1.4 2024-09-12T17:32:43.428 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.425+0000 7f3334887800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.24.1.5 2024-09-12T17:32:43.428 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.425+0000 7f3334887800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.24.1.5 2024-09-12T17:32:43.428 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.425+0000 7f3334887800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.24.1.6 2024-09-12T17:32:43.428 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.425+0000 7f3334887800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.24.1.6 2024-09-12T17:32:43.428 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.425+0000 7f3334887800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.24.1.7 2024-09-12T17:32:43.428 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.425+0000 7f3334887800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.24.1.7 2024-09-12T17:32:43.429 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.425+0000 7f3334887800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.24.1.8 2024-09-12T17:32:43.429 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.425+0000 7f3334887800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.24.1.8 2024-09-12T17:32:43.429 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.425+0000 7f3334887800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.24.1.9 2024-09-12T17:32:43.429 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.425+0000 7f3334887800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.24.1.9 2024-09-12T17:32:43.429 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.425+0000 7f3334887800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.24.1.10 2024-09-12T17:32:43.429 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.425+0000 7f3334887800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.24.1.10 2024-09-12T17:32:43.429 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.425+0000 7f3334887800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.24.1.11 2024-09-12T17:32:43.429 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.425+0000 7f3334887800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.24.1.11 2024-09-12T17:32:43.429 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.425+0000 7f3334887800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.24.0 2024-09-12T17:32:43.430 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.426+0000 7f3334887800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.24.1 2024-09-12T17:32:43.430 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.427+0000 7f3334887800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.24.2 2024-09-12T17:32:43.431 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.428+0000 7f3334887800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.24.3 2024-09-12T17:32:43.431 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.428+0000 7f3334887800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.24.4 2024-09-12T17:32:43.431 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.429+0000 7f3334887800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.24.5 2024-09-12T17:32:43.431 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.429+0000 7f3334887800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.24.6 2024-09-12T17:32:43.431 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.430+0000 7f3334887800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.24.7 2024-09-12T17:32:43.432 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.431+0000 7f3334887800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.24.8 2024-09-12T17:32:43.432 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.432+0000 7f3334887800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.24.9 2024-09-12T17:32:43.433 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.432+0000 7f3334887800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.24.10 2024-09-12T17:32:43.438 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.437+0000 7f3334887800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.24 : hit (requested=0x17, cached=0x17) 2024-09-12T17:32:43.438 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.437+0000 7f3334887800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.24 2024-09-12T17:32:43.439 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.438+0000 7f3334887800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.24 info.flags=0x17 2024-09-12T17:32:43.439 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.438+0000 7f3334887800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.24 to cache LRU end 2024-09-12T17:32:43.440 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.438+0000 7f3334887800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:32:43.440 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.438+0000 7f3334887800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.24, ofs0, ns] 2024-09-12T17:32:43.440 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.439+0000 7f3215ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496987 cookie 93942160701344 notifier 6600 bl.length()=1009 2024-09-12T17:32:43.440 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.439+0000 7f3215ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.24 info.flags=0x17 2024-09-12T17:32:43.440 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.439+0000 7f3215ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.24 to cache LRU end 2024-09-12T17:32:43.440 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.439+0000 7f3215ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:32:43.441 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.440+0000 7f3334887800 20 handle_bi_update(): bucket=:error-at-set-target-layout[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.24]): orig_sources= new_sources= 2024-09-12T17:32:43.441 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.440+0000 7f3334887800 20 handle_bi_update(): bucket=:error-at-set-target-layout[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.24]): potential sources added=[] removed=[] 2024-09-12T17:32:43.441 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.440+0000 7f3334887800 20 handle_bi_update(): bucket=:error-at-set-target-layout[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.24]): orig_dests= new_dests= 2024-09-12T17:32:43.441 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.440+0000 7f3334887800 20 handle_bi_update(): bucket=:error-at-set-target-layout[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.24]): potential dests added=[] removed=[] 2024-09-12T17:32:43.445 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.444+0000 7f3334887800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.24.0 2024-09-12T17:32:43.445 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.445+0000 7f3334887800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.24.1 2024-09-12T17:32:43.446 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.445+0000 7f3334887800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.24.2 2024-09-12T17:32:43.446 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.445+0000 7f3334887800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.24.3 2024-09-12T17:32:43.446 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.446+0000 7f3334887800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.24.4 2024-09-12T17:32:43.447 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.446+0000 7f3334887800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.24.5 2024-09-12T17:32:43.447 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.446+0000 7f3334887800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.24.6 2024-09-12T17:32:43.447 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.447+0000 7f3334887800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.24.7 2024-09-12T17:32:43.448 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.447+0000 7f3334887800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.24.8 2024-09-12T17:32:43.448 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.448+0000 7f3334887800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.24.9 2024-09-12T17:32:43.449 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.448+0000 7f3334887800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.24.10 2024-09-12T17:32:43.449 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.449+0000 7f3334887800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.24 : hit (requested=0x17, cached=0x17) 2024-09-12T17:32:43.449 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.449+0000 7f3334887800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.24 2024-09-12T17:32:43.451 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.450+0000 7f3334887800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.24 info.flags=0x17 2024-09-12T17:32:43.451 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.450+0000 7f3334887800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.24 to cache LRU end 2024-09-12T17:32:43.451 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.450+0000 7f3334887800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:32:43.451 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.450+0000 7f3334887800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.24, ofs0, ns] 2024-09-12T17:32:43.451 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.450+0000 7f32157fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496988 cookie 93942160701344 notifier 6600 bl.length()=977 2024-09-12T17:32:43.451 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.450+0000 7f32157fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.24 info.flags=0x17 2024-09-12T17:32:43.451 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.450+0000 7f32157fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.24 to cache LRU end 2024-09-12T17:32:43.452 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.450+0000 7f32157fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:32:43.452 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.452+0000 7f3334887800 20 handle_bi_update(): bucket=:error-at-set-target-layout[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.24]): orig_sources= new_sources= 2024-09-12T17:32:43.453 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.452+0000 7f3334887800 20 handle_bi_update(): bucket=:error-at-set-target-layout[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.24]): potential sources added=[] removed=[] 2024-09-12T17:32:43.453 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.452+0000 7f3334887800 20 handle_bi_update(): bucket=:error-at-set-target-layout[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.24]): orig_dests= new_dests= 2024-09-12T17:32:43.453 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.452+0000 7f3334887800 20 handle_bi_update(): bucket=:error-at-set-target-layout[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.24]): potential dests added=[] removed=[] 2024-09-12T17:32:43.455 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.454+0000 7f3334887800 1 execute INFO: reshard of bucket "error-at-set-target-layout" from 11 shards to 12 shards completed successfully 2024-09-12T17:32:43.457 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.456+0000 7f31e8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:32:43.459 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.458+0000 7f3334887800 20 remove_watcher() i=0 2024-09-12T17:32:43.459 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.458+0000 7f3334887800 2 removed watcher, disabling cache 2024-09-12T17:32:43.460 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.460+0000 7f3334887800 20 remove_watcher() i=1 2024-09-12T17:32:43.461 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.461+0000 7f3334887800 20 remove_watcher() i=2 2024-09-12T17:32:43.463 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.462+0000 7f3334887800 20 remove_watcher() i=3 2024-09-12T17:32:43.463 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.463+0000 7f3334887800 20 remove_watcher() i=4 2024-09-12T17:32:43.464 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.464+0000 7f3334887800 20 remove_watcher() i=5 2024-09-12T17:32:43.466 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.465+0000 7f3334887800 20 remove_watcher() i=6 2024-09-12T17:32:43.467 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.466+0000 7f3334887800 20 remove_watcher() i=7 2024-09-12T17:32:43.480 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-12T17:32:43.509 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:32:43.509 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:32:43.548 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.547+0000 7f5630231800 20 rados->read ofs=0 len=0 2024-09-12T17:32:43.550 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.549+0000 7f5630231800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:43.550 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.549+0000 7f5630231800 20 realm 2024-09-12T17:32:43.550 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.549+0000 7f5630231800 20 rados->read ofs=0 len=0 2024-09-12T17:32:43.550 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.549+0000 7f5630231800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:43.550 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.549+0000 7f5630231800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:32:43.550 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.549+0000 7f5630231800 20 rados->read ofs=0 len=0 2024-09-12T17:32:43.550 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.549+0000 7f5630231800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:43.550 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.549+0000 7f5630231800 20 rados->read ofs=0 len=0 2024-09-12T17:32:43.551 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.550+0000 7f5630231800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:43.551 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.550+0000 7f5630231800 20 rados->read ofs=0 len=0 2024-09-12T17:32:43.551 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.551+0000 7f5630231800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:32:43.551 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.551+0000 7f5630231800 20 searching for the correct realm 2024-09-12T17:32:43.555 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.555+0000 7f562ad8a640 0 -- 172.21.15.37:0/3249746770 >> [v2:172.21.15.40:6800/2441293461,v1:172.21.15.40:6801/2441293461] conn(0x7f561c075c20 msgr2=0x7f561c0450c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:32:43.561 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.558+0000 7f562bd8c640 0 -- 172.21.15.37:0/3249746770 >> [v2:172.21.15.40:6808/2253405131,v1:172.21.15.40:6809/2253405131] conn(0x7f5620013030 msgr2=0x7f5620059410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:32:43.563 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.562+0000 7f5630231800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:32:43.563 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.562+0000 7f5630231800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:32:43.563 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.562+0000 7f5630231800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:32:43.563 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.562+0000 7f5630231800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:32:43.563 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.562+0000 7f5630231800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:32:43.563 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.562+0000 7f5630231800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:32:43.563 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.562+0000 7f5630231800 20 rados->read ofs=0 len=0 2024-09-12T17:32:43.563 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.562+0000 7f5630231800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:43.563 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.562+0000 7f5630231800 20 rados->read ofs=0 len=0 2024-09-12T17:32:43.564 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.562+0000 7f5630231800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:43.564 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.562+0000 7f5630231800 20 rados->read ofs=0 len=0 2024-09-12T17:32:43.564 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.563+0000 7f5630231800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:32:43.565 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.563+0000 7f5630231800 20 zone default found 2024-09-12T17:32:43.565 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.563+0000 7f5630231800 4 Realm: () 2024-09-12T17:32:43.565 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.563+0000 7f5630231800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:32:43.565 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.563+0000 7f5630231800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:32:43.565 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.563+0000 7f5630231800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:32:43.565 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.563+0000 7f5630231800 20 zonegroup default 2024-09-12T17:32:43.565 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.563+0000 7f5630231800 20 rados->read ofs=0 len=0 2024-09-12T17:32:43.565 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.563+0000 7f5630231800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:43.565 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.563+0000 7f5630231800 20 rados->read ofs=0 len=0 2024-09-12T17:32:43.565 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.564+0000 7f5630231800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:43.565 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.564+0000 7f5630231800 20 rados->read ofs=0 len=0 2024-09-12T17:32:43.566 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.564+0000 7f5630231800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:43.566 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.564+0000 7f5630231800 20 started sync module instance, tier type = 2024-09-12T17:32:43.566 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.564+0000 7f5630231800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:32:43.573 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.573+0000 7f5630231800 20 add_watcher() i=0 2024-09-12T17:32:43.573 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.573+0000 7f5630231800 20 add_watcher() i=1 2024-09-12T17:32:43.573 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.573+0000 7f5630231800 20 add_watcher() i=2 2024-09-12T17:32:43.573 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.573+0000 7f5630231800 20 add_watcher() i=3 2024-09-12T17:32:43.574 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.573+0000 7f5630231800 20 add_watcher() i=4 2024-09-12T17:32:43.574 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.573+0000 7f5630231800 20 add_watcher() i=5 2024-09-12T17:32:43.574 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.573+0000 7f5630231800 20 add_watcher() i=6 2024-09-12T17:32:43.574 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.573+0000 7f5630231800 20 add_watcher() i=7 2024-09-12T17:32:43.574 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.573+0000 7f5630231800 2 all 8 watchers are set, enabling cache 2024-09-12T17:32:43.576 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.575+0000 7f54e1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:32:43.577 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.576+0000 7f5630231800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:32:43.577 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.576+0000 7f5630231800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:32:43.577 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.576+0000 7f5630231800 5 note: GC not initialized 2024-09-12T17:32:43.578 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.576+0000 7f54e0fe1640 20 reqs_thread_entry: start 2024-09-12T17:32:43.578 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.576+0000 7f5630231800 20 init_complete bucket index max shards: 11 2024-09-12T17:32:43.578 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.576+0000 7f5630231800 20 Filter name: none 2024-09-12T17:32:43.578 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.576+0000 7f545a7fc640 20 reqs_thread_entry: start 2024-09-12T17:32:43.578 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.576+0000 7f5630231800 20 rados->read ofs=0 len=0 2024-09-12T17:32:43.578 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.576+0000 7f5630231800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T17:32:43.578 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.576+0000 7f5630231800 20 rados->read ofs=0 len=0 2024-09-12T17:32:43.579 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.577+0000 7f5630231800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T17:32:43.579 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.577+0000 7f5630231800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:32:43.579 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.577+0000 7f5630231800 20 rados->read ofs=0 len=0 2024-09-12T17:32:43.579 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.577+0000 7f5630231800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T17:32:43.579 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.577+0000 7f5630231800 20 rados->read ofs=0 len=0 2024-09-12T17:32:43.579 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.578+0000 7f5630231800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T17:32:43.579 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.578+0000 7f5630231800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:32:43.581 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.580+0000 7f54e1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:32:43.583 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.582+0000 7f5630231800 20 remove_watcher() i=0 2024-09-12T17:32:43.583 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.582+0000 7f5630231800 2 removed watcher, disabling cache 2024-09-12T17:32:43.584 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.583+0000 7f5630231800 20 remove_watcher() i=1 2024-09-12T17:32:43.585 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.584+0000 7f5630231800 20 remove_watcher() i=2 2024-09-12T17:32:43.585 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.585+0000 7f5630231800 20 remove_watcher() i=3 2024-09-12T17:32:43.586 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.586+0000 7f5630231800 20 remove_watcher() i=4 2024-09-12T17:32:43.587 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.587+0000 7f5630231800 20 remove_watcher() i=5 2024-09-12T17:32:43.588 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.588+0000 7f5630231800 20 remove_watcher() i=6 2024-09-12T17:32:43.589 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:43.589+0000 7f5630231800 20 remove_watcher() i=7 2024-09-12T17:32:43.601 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:32:43.601 INFO:tasks.workunit.client.0.smithi037.stderr:BUCKET_STATS: 2024-09-12T17:32:43.601 INFO:tasks.workunit.client.0.smithi037.stderr:bucket: error-at-set-target-layout id: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.24 num_objects: 20 size_kb: 1 num_shards: 12 2024-09-12T17:32:43.601 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:32:43.969 INFO:tasks.workunit.client.0.smithi037.stderr:TEST: reshard bucket with abort at set_target_layout 2024-09-12T17:32:43.969 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:32:44.760 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-09-12T17:32:44.790 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:32:44.790 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:32:44.829 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:44.828+0000 7f737d2bb800 20 rados->read ofs=0 len=0 2024-09-12T17:32:44.831 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:44.829+0000 7f737d2bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:44.831 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:44.829+0000 7f737d2bb800 20 realm 2024-09-12T17:32:44.831 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:44.829+0000 7f737d2bb800 20 rados->read ofs=0 len=0 2024-09-12T17:32:44.831 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:44.830+0000 7f737d2bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:44.831 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:44.830+0000 7f737d2bb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:32:44.831 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:44.830+0000 7f737d2bb800 20 rados->read ofs=0 len=0 2024-09-12T17:32:44.831 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:44.830+0000 7f737d2bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:44.831 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:44.830+0000 7f737d2bb800 20 rados->read ofs=0 len=0 2024-09-12T17:32:44.832 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:44.831+0000 7f737d2bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:44.832 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:44.831+0000 7f737d2bb800 20 rados->read ofs=0 len=0 2024-09-12T17:32:44.833 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:44.831+0000 7f737d2bb800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:32:44.833 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:44.831+0000 7f737d2bb800 20 searching for the correct realm 2024-09-12T17:32:44.835 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:44.834+0000 7f737b5a6640 0 -- 172.21.15.37:0/4058796522 >> [v2:172.21.15.40:6818/1210108009,v1:172.21.15.40:6819/1210108009] conn(0x7f73700dcbd0 msgr2=0x7f73700b3a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:32:44.839 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:44.838+0000 7f737ada5640 0 -- 172.21.15.37:0/4058796522 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7f7370009b90 msgr2=0x7f73700839a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:32:45.047 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.045+0000 7f737d2bb800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:32:45.047 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.045+0000 7f737d2bb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:32:45.047 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.045+0000 7f737d2bb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:32:45.047 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.045+0000 7f737d2bb800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:32:45.047 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.045+0000 7f737d2bb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:32:45.047 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.045+0000 7f737d2bb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:32:45.047 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.045+0000 7f737d2bb800 20 rados->read ofs=0 len=0 2024-09-12T17:32:45.048 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.045+0000 7f737d2bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:45.048 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.045+0000 7f737d2bb800 20 rados->read ofs=0 len=0 2024-09-12T17:32:45.048 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.046+0000 7f737d2bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:45.048 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.046+0000 7f737d2bb800 20 rados->read ofs=0 len=0 2024-09-12T17:32:45.049 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.046+0000 7f737d2bb800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:32:45.050 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.046+0000 7f737d2bb800 20 zone default found 2024-09-12T17:32:45.050 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.046+0000 7f737d2bb800 4 Realm: () 2024-09-12T17:32:45.050 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.046+0000 7f737d2bb800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:32:45.050 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.046+0000 7f737d2bb800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:32:45.050 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.046+0000 7f737d2bb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:32:45.050 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.046+0000 7f737d2bb800 20 zonegroup default 2024-09-12T17:32:45.050 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.046+0000 7f737d2bb800 20 rados->read ofs=0 len=0 2024-09-12T17:32:45.050 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.046+0000 7f737d2bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:45.050 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.046+0000 7f737d2bb800 20 rados->read ofs=0 len=0 2024-09-12T17:32:45.050 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.047+0000 7f737d2bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:45.050 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.047+0000 7f737d2bb800 20 rados->read ofs=0 len=0 2024-09-12T17:32:45.051 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.047+0000 7f737d2bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:45.051 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.047+0000 7f737d2bb800 20 started sync module instance, tier type = 2024-09-12T17:32:45.051 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.047+0000 7f737d2bb800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:32:45.058 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.057+0000 7f737d2bb800 20 add_watcher() i=0 2024-09-12T17:32:45.058 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.057+0000 7f737d2bb800 20 add_watcher() i=1 2024-09-12T17:32:45.058 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.057+0000 7f737d2bb800 20 add_watcher() i=2 2024-09-12T17:32:45.058 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.057+0000 7f737d2bb800 20 add_watcher() i=3 2024-09-12T17:32:45.058 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.057+0000 7f737d2bb800 20 add_watcher() i=4 2024-09-12T17:32:45.058 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.057+0000 7f737d2bb800 20 add_watcher() i=5 2024-09-12T17:32:45.058 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.057+0000 7f737d2bb800 20 add_watcher() i=6 2024-09-12T17:32:45.059 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.058+0000 7f737d2bb800 20 add_watcher() i=7 2024-09-12T17:32:45.059 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.058+0000 7f737d2bb800 2 all 8 watchers are set, enabling cache 2024-09-12T17:32:45.061 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.059+0000 7f72317e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:32:45.062 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.060+0000 7f737d2bb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:32:45.062 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.060+0000 7f737d2bb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:32:45.062 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.060+0000 7f737d2bb800 5 note: GC not initialized 2024-09-12T17:32:45.062 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.060+0000 7f71abfff640 20 reqs_thread_entry: start 2024-09-12T17:32:45.062 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.060+0000 7f737d2bb800 20 init_complete bucket index max shards: 11 2024-09-12T17:32:45.062 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.060+0000 7f737d2bb800 20 Filter name: none 2024-09-12T17:32:45.062 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.060+0000 7f71a9ffb640 20 reqs_thread_entry: start 2024-09-12T17:32:45.062 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.060+0000 7f737d2bb800 20 rados->read ofs=0 len=0 2024-09-12T17:32:45.063 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.061+0000 7f737d2bb800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T17:32:45.064 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.061+0000 7f737d2bb800 20 rados->read ofs=0 len=0 2024-09-12T17:32:45.064 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.062+0000 7f737d2bb800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T17:32:45.064 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.062+0000 7f737d2bb800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:32:45.064 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.062+0000 7f737d2bb800 20 rados->read ofs=0 len=0 2024-09-12T17:32:45.064 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.062+0000 7f737d2bb800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T17:32:45.064 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.062+0000 7f737d2bb800 20 rados->read ofs=0 len=0 2024-09-12T17:32:45.064 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.063+0000 7f737d2bb800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T17:32:45.064 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.063+0000 7f737d2bb800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:32:45.065 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.065+0000 7f72317e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:32:45.067 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.067+0000 7f737d2bb800 20 remove_watcher() i=0 2024-09-12T17:32:45.067 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.067+0000 7f737d2bb800 2 removed watcher, disabling cache 2024-09-12T17:32:45.068 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.068+0000 7f737d2bb800 20 remove_watcher() i=1 2024-09-12T17:32:45.069 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.069+0000 7f737d2bb800 20 remove_watcher() i=2 2024-09-12T17:32:45.070 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.070+0000 7f737d2bb800 20 remove_watcher() i=3 2024-09-12T17:32:45.071 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.071+0000 7f737d2bb800 20 remove_watcher() i=4 2024-09-12T17:32:45.072 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.072+0000 7f737d2bb800 20 remove_watcher() i=5 2024-09-12T17:32:45.073 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.073+0000 7f737d2bb800 20 remove_watcher() i=6 2024-09-12T17:32:45.074 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.074+0000 7f737d2bb800 20 remove_watcher() i=7 2024-09-12T17:32:45.085 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:32:45.086 INFO:tasks.workunit.client.0.smithi037.stderr:BUCKET_STATS: 2024-09-12T17:32:45.086 INFO:tasks.workunit.client.0.smithi037.stderr:bucket: abort-at-set-target-layout id: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.25 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:32:45.086 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:32:45.087 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at set_target_layout 2024-09-12T17:32:45.123 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:32:45.123 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:32:45.161 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.160+0000 7f62ea542800 20 rados->read ofs=0 len=0 2024-09-12T17:32:45.163 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.162+0000 7f62ea542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:45.163 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.162+0000 7f62ea542800 20 realm 2024-09-12T17:32:45.163 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.162+0000 7f62ea542800 20 rados->read ofs=0 len=0 2024-09-12T17:32:45.163 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.162+0000 7f62ea542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:45.164 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.162+0000 7f62ea542800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:32:45.164 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.162+0000 7f62ea542800 20 rados->read ofs=0 len=0 2024-09-12T17:32:45.164 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.162+0000 7f62ea542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:45.164 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.162+0000 7f62ea542800 20 rados->read ofs=0 len=0 2024-09-12T17:32:45.164 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.163+0000 7f62ea542800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:45.164 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.163+0000 7f62ea542800 20 rados->read ofs=0 len=0 2024-09-12T17:32:45.165 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.163+0000 7f62ea542800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:32:45.165 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.163+0000 7f62ea542800 20 searching for the correct realm 2024-09-12T17:32:45.167 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.166+0000 7f62e6a87640 0 -- 172.21.15.37:0/1799390293 >> [v2:172.21.15.40:6818/1210108009,v1:172.21.15.40:6819/1210108009] conn(0x7f62d0035030 msgr2=0x7f62d00a5a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:32:45.171 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.170+0000 7f62e6286640 0 -- 172.21.15.37:0/1799390293 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7f62d00018c0 msgr2=0x7f62d002a9e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:32:45.378 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.377+0000 7f62ea542800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:32:45.378 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.377+0000 7f62ea542800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:32:45.378 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.377+0000 7f62ea542800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:32:45.378 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.377+0000 7f62ea542800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:32:45.378 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.377+0000 7f62ea542800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:32:45.378 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.377+0000 7f62ea542800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:32:45.378 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.377+0000 7f62ea542800 20 rados->read ofs=0 len=0 2024-09-12T17:32:45.378 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.377+0000 7f62ea542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:45.379 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.377+0000 7f62ea542800 20 rados->read ofs=0 len=0 2024-09-12T17:32:45.379 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.377+0000 7f62ea542800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:45.379 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.377+0000 7f62ea542800 20 rados->read ofs=0 len=0 2024-09-12T17:32:45.380 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.377+0000 7f62ea542800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:32:45.380 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.377+0000 7f62ea542800 20 zone default found 2024-09-12T17:32:45.380 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.378+0000 7f62ea542800 4 Realm: () 2024-09-12T17:32:45.380 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.378+0000 7f62ea542800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:32:45.380 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.378+0000 7f62ea542800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:32:45.380 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.378+0000 7f62ea542800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:32:45.380 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.378+0000 7f62ea542800 20 zonegroup default 2024-09-12T17:32:45.380 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.378+0000 7f62ea542800 20 rados->read ofs=0 len=0 2024-09-12T17:32:45.380 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.378+0000 7f62ea542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:45.380 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.378+0000 7f62ea542800 20 rados->read ofs=0 len=0 2024-09-12T17:32:45.381 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.378+0000 7f62ea542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:45.381 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.378+0000 7f62ea542800 20 rados->read ofs=0 len=0 2024-09-12T17:32:45.381 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.379+0000 7f62ea542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:45.381 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.379+0000 7f62ea542800 20 started sync module instance, tier type = 2024-09-12T17:32:45.381 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.379+0000 7f62ea542800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:32:45.389 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.388+0000 7f62ea542800 20 add_watcher() i=0 2024-09-12T17:32:45.389 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.388+0000 7f62ea542800 20 add_watcher() i=1 2024-09-12T17:32:45.390 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.388+0000 7f62ea542800 20 add_watcher() i=2 2024-09-12T17:32:45.390 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.388+0000 7f62ea542800 20 add_watcher() i=3 2024-09-12T17:32:45.390 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.388+0000 7f62ea542800 20 add_watcher() i=4 2024-09-12T17:32:45.390 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.388+0000 7f62ea542800 20 add_watcher() i=5 2024-09-12T17:32:45.390 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.388+0000 7f62ea542800 20 add_watcher() i=6 2024-09-12T17:32:45.390 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.389+0000 7f62ea542800 20 add_watcher() i=7 2024-09-12T17:32:45.391 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.389+0000 7f62ea542800 2 all 8 watchers are set, enabling cache 2024-09-12T17:32:45.393 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.391+0000 7f619cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:32:45.393 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.391+0000 7f62ea542800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:32:45.393 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.391+0000 7f62ea542800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:32:45.393 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.391+0000 7f62ea542800 5 note: GC not initialized 2024-09-12T17:32:45.393 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.392+0000 7f61177fe640 20 reqs_thread_entry: start 2024-09-12T17:32:45.393 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.392+0000 7f62ea542800 20 init_complete bucket index max shards: 11 2024-09-12T17:32:45.393 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.392+0000 7f62ea542800 20 Filter name: none 2024-09-12T17:32:45.394 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.392+0000 7f61157fa640 20 reqs_thread_entry: start 2024-09-12T17:32:45.394 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.392+0000 7f62ea542800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-12T17:32:45.394 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.392+0000 7f62ea542800 20 rados->read ofs=0 len=0 2024-09-12T17:32:45.394 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.393+0000 7f62ea542800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T17:32:45.394 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.393+0000 7f62ea542800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-12T17:32:45.394 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.393+0000 7f62ea542800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-12T17:32:45.395 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.393+0000 7f62ea542800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.25 : miss 2024-09-12T17:32:45.395 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.393+0000 7f62ea542800 20 rados->read ofs=0 len=0 2024-09-12T17:32:45.395 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.394+0000 7f62ea542800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T17:32:45.395 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.394+0000 7f62ea542800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.25 info.flags=0x17 2024-09-12T17:32:45.395 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.394+0000 7f62ea542800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.25 to cache LRU end 2024-09-12T17:32:45.395 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.394+0000 7f62ea542800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:32:45.396 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.394+0000 7f62ea542800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:32:45.396 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.394+0000 7f62ea542800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.25 2024-09-12T17:32:45.398 INFO:tasks.workunit.client.0.smithi037.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f62ea542800 time 2024-09-12T17:32:45.398941+0000 2024-09-12T17:32:45.399 INFO:tasks.workunit.client.0.smithi037.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:32:45.399 INFO:tasks.workunit.client.0.smithi037.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:32:45.400 INFO:tasks.workunit.client.0.smithi037.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f62ebd8c71a] 2024-09-12T17:32:45.400 INFO:tasks.workunit.client.0.smithi037.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f62ebd8c8d8] 2024-09-12T17:32:45.400 INFO:tasks.workunit.client.0.smithi037.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559a91227841] 2024-09-12T17:32:45.400 INFO:tasks.workunit.client.0.smithi037.stderr: 4: radosgw-admin(+0xd73ca8) [0x559a91734ca8] 2024-09-12T17:32:45.400 INFO:tasks.workunit.client.0.smithi037.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x559a9123750d] 2024-09-12T17:32:45.400 INFO:tasks.workunit.client.0.smithi037.stderr: 6: main() 2024-09-12T17:32:45.400 INFO:tasks.workunit.client.0.smithi037.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f62eaa29590] 2024-09-12T17:32:45.400 INFO:tasks.workunit.client.0.smithi037.stderr: 8: __libc_start_main() 2024-09-12T17:32:45.400 INFO:tasks.workunit.client.0.smithi037.stderr: 9: _start() 2024-09-12T17:32:45.400 INFO:tasks.workunit.client.0.smithi037.stderr:*** Caught signal (Aborted) ** 2024-09-12T17:32:45.400 INFO:tasks.workunit.client.0.smithi037.stderr: in thread 7f62ea542800 thread_name:radosgw-admin 2024-09-12T17:32:45.401 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.399+0000 7f62ea542800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f62ea542800 time 2024-09-12T17:32:45.398941+0000 2024-09-12T17:32:45.401 INFO:tasks.workunit.client.0.smithi037.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:32:45.401 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:32:45.401 INFO:tasks.workunit.client.0.smithi037.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:32:45.401 INFO:tasks.workunit.client.0.smithi037.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f62ebd8c71a] 2024-09-12T17:32:45.401 INFO:tasks.workunit.client.0.smithi037.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f62ebd8c8d8] 2024-09-12T17:32:45.401 INFO:tasks.workunit.client.0.smithi037.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559a91227841] 2024-09-12T17:32:45.401 INFO:tasks.workunit.client.0.smithi037.stderr: 4: radosgw-admin(+0xd73ca8) [0x559a91734ca8] 2024-09-12T17:32:45.401 INFO:tasks.workunit.client.0.smithi037.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x559a9123750d] 2024-09-12T17:32:45.401 INFO:tasks.workunit.client.0.smithi037.stderr: 6: main() 2024-09-12T17:32:45.401 INFO:tasks.workunit.client.0.smithi037.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f62eaa29590] 2024-09-12T17:32:45.402 INFO:tasks.workunit.client.0.smithi037.stderr: 8: __libc_start_main() 2024-09-12T17:32:45.402 INFO:tasks.workunit.client.0.smithi037.stderr: 9: _start() 2024-09-12T17:32:45.402 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:32:45.427 INFO:tasks.workunit.client.0.smithi037.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:32:45.427 INFO:tasks.workunit.client.0.smithi037.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f62eaa3e6f0] 2024-09-12T17:32:45.427 INFO:tasks.workunit.client.0.smithi037.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f62eaa8b99c] 2024-09-12T17:32:45.427 INFO:tasks.workunit.client.0.smithi037.stderr: 3: raise() 2024-09-12T17:32:45.427 INFO:tasks.workunit.client.0.smithi037.stderr: 4: abort() 2024-09-12T17:32:45.427 INFO:tasks.workunit.client.0.smithi037.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f62ebd8c774] 2024-09-12T17:32:45.427 INFO:tasks.workunit.client.0.smithi037.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f62ebd8c8d8] 2024-09-12T17:32:45.427 INFO:tasks.workunit.client.0.smithi037.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559a91227841] 2024-09-12T17:32:45.427 INFO:tasks.workunit.client.0.smithi037.stderr: 8: radosgw-admin(+0xd73ca8) [0x559a91734ca8] 2024-09-12T17:32:45.427 INFO:tasks.workunit.client.0.smithi037.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x559a9123750d] 2024-09-12T17:32:45.428 INFO:tasks.workunit.client.0.smithi037.stderr: 10: main() 2024-09-12T17:32:45.428 INFO:tasks.workunit.client.0.smithi037.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f62eaa29590] 2024-09-12T17:32:45.428 INFO:tasks.workunit.client.0.smithi037.stderr: 12: __libc_start_main() 2024-09-12T17:32:45.428 INFO:tasks.workunit.client.0.smithi037.stderr: 13: _start() 2024-09-12T17:32:45.428 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.399+0000 7f62ea542800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:32:45.428 INFO:tasks.workunit.client.0.smithi037.stderr: in thread 7f62ea542800 thread_name:radosgw-admin 2024-09-12T17:32:45.428 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:32:45.428 INFO:tasks.workunit.client.0.smithi037.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:32:45.428 INFO:tasks.workunit.client.0.smithi037.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f62eaa3e6f0] 2024-09-12T17:32:45.428 INFO:tasks.workunit.client.0.smithi037.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f62eaa8b99c] 2024-09-12T17:32:45.428 INFO:tasks.workunit.client.0.smithi037.stderr: 3: raise() 2024-09-12T17:32:45.428 INFO:tasks.workunit.client.0.smithi037.stderr: 4: abort() 2024-09-12T17:32:45.428 INFO:tasks.workunit.client.0.smithi037.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f62ebd8c774] 2024-09-12T17:32:45.429 INFO:tasks.workunit.client.0.smithi037.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f62ebd8c8d8] 2024-09-12T17:32:45.429 INFO:tasks.workunit.client.0.smithi037.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559a91227841] 2024-09-12T17:32:45.429 INFO:tasks.workunit.client.0.smithi037.stderr: 8: radosgw-admin(+0xd73ca8) [0x559a91734ca8] 2024-09-12T17:32:45.429 INFO:tasks.workunit.client.0.smithi037.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x559a9123750d] 2024-09-12T17:32:45.429 INFO:tasks.workunit.client.0.smithi037.stderr: 10: main() 2024-09-12T17:32:45.429 INFO:tasks.workunit.client.0.smithi037.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f62eaa29590] 2024-09-12T17:32:45.429 INFO:tasks.workunit.client.0.smithi037.stderr: 12: __libc_start_main() 2024-09-12T17:32:45.429 INFO:tasks.workunit.client.0.smithi037.stderr: 13: _start() 2024-09-12T17:32:45.429 INFO:tasks.workunit.client.0.smithi037.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:32:45.429 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:32:45.429 INFO:tasks.workunit.client.0.smithi037.stderr:--- begin dump of recent events --- 2024-09-12T17:32:45.429 INFO:tasks.workunit.client.0.smithi037.stderr: -499> 2024-09-12T17:32:45.143+0000 7f61d4608640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:32:45.429 INFO:tasks.workunit.client.0.smithi037.stderr: -498> 2024-09-12T17:32:45.143+0000 7f61d4608640 10 monclient: dump: 2024-09-12T17:32:45.429 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:32:45.430 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:32:45.430 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:32:45.430 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:32:45.430 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:32:45.430 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:32:45.430 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:32:45.430 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:32:45.430 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:32:45.430 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:32:45.430 INFO:tasks.workunit.client.0.smithi037.stderr: -497> 2024-09-12T17:32:45.143+0000 7f61d4608640 10 monclient: _finish_auth 0 2024-09-12T17:32:45.430 INFO:tasks.workunit.client.0.smithi037.stderr: -496> 2024-09-12T17:32:45.143+0000 7f61d4608640 10 monclient: _check_auth_tickets 2024-09-12T17:32:45.430 INFO:tasks.workunit.client.0.smithi037.stderr: -495> 2024-09-12T17:32:45.143+0000 7f61d4608640 10 monclient: handle_config config(0 keys) 2024-09-12T17:32:45.430 INFO:tasks.workunit.client.0.smithi037.stderr: -494> 2024-09-12T17:32:45.143+0000 7f62ea542800 5 monclient: authenticate success, global_id 6269 2024-09-12T17:32:45.430 INFO:tasks.workunit.client.0.smithi037.stderr: -493> 2024-09-12T17:32:45.143+0000 7f62ea542800 10 monclient: get_monmap_and_config success 2024-09-12T17:32:45.431 INFO:tasks.workunit.client.0.smithi037.stderr: -492> 2024-09-12T17:32:45.143+0000 7f62ea542800 4 set_mon_vals no callback set 2024-09-12T17:32:45.431 INFO:tasks.workunit.client.0.smithi037.stderr: -491> 2024-09-12T17:32:45.143+0000 7f61d4608640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:32:45.431 INFO:tasks.workunit.client.0.smithi037.stderr: -490> 2024-09-12T17:32:45.143+0000 7f61d4608640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:32:45.431 INFO:tasks.workunit.client.0.smithi037.stderr: -489> 2024-09-12T17:32:45.143+0000 7f61d4608640 10 monclient: dump: 2024-09-12T17:32:45.431 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:32:45.431 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:32:45.431 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:32:45.431 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:32:45.431 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:32:45.431 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:32:45.431 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:32:45.431 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:32:45.431 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:32:45.431 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:32:45.432 INFO:tasks.workunit.client.0.smithi037.stderr: -488> 2024-09-12T17:32:45.143+0000 7f62ea542800 10 monclient: shutdown 2024-09-12T17:32:45.432 INFO:tasks.workunit.client.0.smithi037.stderr: -487> 2024-09-12T17:32:45.143+0000 7f62ea542800 5 asok(0x559a91ed1730) unregister_commands rotate-key 2024-09-12T17:32:45.432 INFO:tasks.workunit.client.0.smithi037.stderr: -486> 2024-09-12T17:32:45.143+0000 7f62ea542800 10 monclient: build_initial_monmap 2024-09-12T17:32:45.432 INFO:tasks.workunit.client.0.smithi037.stderr: -485> 2024-09-12T17:32:45.143+0000 7f62ea542800 1 build_initial for_mkfs: 0 2024-09-12T17:32:45.432 INFO:tasks.workunit.client.0.smithi037.stderr: -484> 2024-09-12T17:32:45.143+0000 7f62ea542800 10 monclient: monmap: 2024-09-12T17:32:45.432 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 0 2024-09-12T17:32:45.432 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:32:45.432 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 0.000000 2024-09-12T17:32:45.432 INFO:tasks.workunit.client.0.smithi037.stderr:created 0.000000 2024-09-12T17:32:45.432 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 0 (unknown) 2024-09-12T17:32:45.432 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:32:45.432 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.noname-a 2024-09-12T17:32:45.432 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.noname-b 2024-09-12T17:32:45.433 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.noname-c 2024-09-12T17:32:45.433 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:32:45.433 INFO:tasks.workunit.client.0.smithi037.stderr: -483> 2024-09-12T17:32:45.143+0000 7f62ea542800 5 AuthRegistry(0x559a920f98a0) adding auth protocol: cephx 2024-09-12T17:32:45.433 INFO:tasks.workunit.client.0.smithi037.stderr: -482> 2024-09-12T17:32:45.143+0000 7f62ea542800 5 AuthRegistry(0x559a920f98a0) adding auth protocol: cephx 2024-09-12T17:32:45.433 INFO:tasks.workunit.client.0.smithi037.stderr: -481> 2024-09-12T17:32:45.143+0000 7f62ea542800 5 AuthRegistry(0x559a920f98a0) adding auth protocol: cephx 2024-09-12T17:32:45.433 INFO:tasks.workunit.client.0.smithi037.stderr: -480> 2024-09-12T17:32:45.143+0000 7f62ea542800 5 AuthRegistry(0x559a920f98a0) adding con mode: secure 2024-09-12T17:32:45.433 INFO:tasks.workunit.client.0.smithi037.stderr: -479> 2024-09-12T17:32:45.143+0000 7f62ea542800 5 AuthRegistry(0x559a920f98a0) adding con mode: crc 2024-09-12T17:32:45.433 INFO:tasks.workunit.client.0.smithi037.stderr: -478> 2024-09-12T17:32:45.143+0000 7f62ea542800 5 AuthRegistry(0x559a920f98a0) adding con mode: secure 2024-09-12T17:32:45.433 INFO:tasks.workunit.client.0.smithi037.stderr: -477> 2024-09-12T17:32:45.143+0000 7f62ea542800 5 AuthRegistry(0x559a920f98a0) adding con mode: crc 2024-09-12T17:32:45.433 INFO:tasks.workunit.client.0.smithi037.stderr: -476> 2024-09-12T17:32:45.143+0000 7f62ea542800 5 AuthRegistry(0x559a920f98a0) adding con mode: secure 2024-09-12T17:32:45.433 INFO:tasks.workunit.client.0.smithi037.stderr: -475> 2024-09-12T17:32:45.143+0000 7f62ea542800 5 AuthRegistry(0x559a920f98a0) adding con mode: crc 2024-09-12T17:32:45.433 INFO:tasks.workunit.client.0.smithi037.stderr: -474> 2024-09-12T17:32:45.143+0000 7f62ea542800 5 AuthRegistry(0x559a920f98a0) adding con mode: crc 2024-09-12T17:32:45.434 INFO:tasks.workunit.client.0.smithi037.stderr: -473> 2024-09-12T17:32:45.143+0000 7f62ea542800 5 AuthRegistry(0x559a920f98a0) adding con mode: secure 2024-09-12T17:32:45.434 INFO:tasks.workunit.client.0.smithi037.stderr: -472> 2024-09-12T17:32:45.143+0000 7f62ea542800 5 AuthRegistry(0x559a920f98a0) adding con mode: crc 2024-09-12T17:32:45.434 INFO:tasks.workunit.client.0.smithi037.stderr: -471> 2024-09-12T17:32:45.143+0000 7f62ea542800 5 AuthRegistry(0x559a920f98a0) adding con mode: secure 2024-09-12T17:32:45.434 INFO:tasks.workunit.client.0.smithi037.stderr: -470> 2024-09-12T17:32:45.143+0000 7f62ea542800 5 AuthRegistry(0x559a920f98a0) adding con mode: crc 2024-09-12T17:32:45.434 INFO:tasks.workunit.client.0.smithi037.stderr: -469> 2024-09-12T17:32:45.143+0000 7f62ea542800 5 AuthRegistry(0x559a920f98a0) adding con mode: secure 2024-09-12T17:32:45.434 INFO:tasks.workunit.client.0.smithi037.stderr: -468> 2024-09-12T17:32:45.144+0000 7f62ea542800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:32:45.434 INFO:tasks.workunit.client.0.smithi037.stderr: -467> 2024-09-12T17:32:45.144+0000 7f62ea542800 1 librados: starting msgr at 2024-09-12T17:32:45.434 INFO:tasks.workunit.client.0.smithi037.stderr: -466> 2024-09-12T17:32:45.144+0000 7f62ea542800 1 librados: starting objecter 2024-09-12T17:32:45.434 INFO:tasks.workunit.client.0.smithi037.stderr: -465> 2024-09-12T17:32:45.144+0000 7f62ea542800 5 asok(0x559a91ed1730) register_command objecter_requests hook 0x559a920fafe0 2024-09-12T17:32:45.434 INFO:tasks.workunit.client.0.smithi037.stderr: -464> 2024-09-12T17:32:45.144+0000 7f62ea542800 1 librados: setting wanted keys 2024-09-12T17:32:45.434 INFO:tasks.workunit.client.0.smithi037.stderr: -463> 2024-09-12T17:32:45.144+0000 7f62ea542800 1 librados: calling monclient init 2024-09-12T17:32:45.434 INFO:tasks.workunit.client.0.smithi037.stderr: -462> 2024-09-12T17:32:45.144+0000 7f62ea542800 10 monclient: init 2024-09-12T17:32:45.434 INFO:tasks.workunit.client.0.smithi037.stderr: -461> 2024-09-12T17:32:45.144+0000 7f62ea542800 5 AuthRegistry(0x559a920f42e0) adding auth protocol: cephx 2024-09-12T17:32:45.434 INFO:tasks.workunit.client.0.smithi037.stderr: -460> 2024-09-12T17:32:45.144+0000 7f62ea542800 5 AuthRegistry(0x559a920f42e0) adding auth protocol: cephx 2024-09-12T17:32:45.435 INFO:tasks.workunit.client.0.smithi037.stderr: -459> 2024-09-12T17:32:45.144+0000 7f62ea542800 5 AuthRegistry(0x559a920f42e0) adding auth protocol: cephx 2024-09-12T17:32:45.435 INFO:tasks.workunit.client.0.smithi037.stderr: -458> 2024-09-12T17:32:45.144+0000 7f62ea542800 5 AuthRegistry(0x559a920f42e0) adding con mode: secure 2024-09-12T17:32:45.435 INFO:tasks.workunit.client.0.smithi037.stderr: -457> 2024-09-12T17:32:45.144+0000 7f62ea542800 5 AuthRegistry(0x559a920f42e0) adding con mode: crc 2024-09-12T17:32:45.435 INFO:tasks.workunit.client.0.smithi037.stderr: -456> 2024-09-12T17:32:45.144+0000 7f62ea542800 5 AuthRegistry(0x559a920f42e0) adding con mode: secure 2024-09-12T17:32:45.435 INFO:tasks.workunit.client.0.smithi037.stderr: -455> 2024-09-12T17:32:45.144+0000 7f62ea542800 5 AuthRegistry(0x559a920f42e0) adding con mode: crc 2024-09-12T17:32:45.435 INFO:tasks.workunit.client.0.smithi037.stderr: -454> 2024-09-12T17:32:45.144+0000 7f62ea542800 5 AuthRegistry(0x559a920f42e0) adding con mode: secure 2024-09-12T17:32:45.435 INFO:tasks.workunit.client.0.smithi037.stderr: -453> 2024-09-12T17:32:45.144+0000 7f62ea542800 5 AuthRegistry(0x559a920f42e0) adding con mode: crc 2024-09-12T17:32:45.435 INFO:tasks.workunit.client.0.smithi037.stderr: -452> 2024-09-12T17:32:45.144+0000 7f62ea542800 5 AuthRegistry(0x559a920f42e0) adding con mode: crc 2024-09-12T17:32:45.435 INFO:tasks.workunit.client.0.smithi037.stderr: -451> 2024-09-12T17:32:45.144+0000 7f62ea542800 5 AuthRegistry(0x559a920f42e0) adding con mode: secure 2024-09-12T17:32:45.435 INFO:tasks.workunit.client.0.smithi037.stderr: -450> 2024-09-12T17:32:45.144+0000 7f62ea542800 5 AuthRegistry(0x559a920f42e0) adding con mode: crc 2024-09-12T17:32:45.435 INFO:tasks.workunit.client.0.smithi037.stderr: -449> 2024-09-12T17:32:45.144+0000 7f62ea542800 5 AuthRegistry(0x559a920f42e0) adding con mode: secure 2024-09-12T17:32:45.435 INFO:tasks.workunit.client.0.smithi037.stderr: -448> 2024-09-12T17:32:45.144+0000 7f62ea542800 5 AuthRegistry(0x559a920f42e0) adding con mode: crc 2024-09-12T17:32:45.435 INFO:tasks.workunit.client.0.smithi037.stderr: -447> 2024-09-12T17:32:45.144+0000 7f62ea542800 5 AuthRegistry(0x559a920f42e0) adding con mode: secure 2024-09-12T17:32:45.436 INFO:tasks.workunit.client.0.smithi037.stderr: -446> 2024-09-12T17:32:45.144+0000 7f62ea542800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:32:45.436 INFO:tasks.workunit.client.0.smithi037.stderr: -445> 2024-09-12T17:32:45.144+0000 7f62ea542800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:32:45.436 INFO:tasks.workunit.client.0.smithi037.stderr: -444> 2024-09-12T17:32:45.144+0000 7f62ea542800 5 asok(0x559a91ed1730) register_command rotate-key hook 0x559a920f4428 2024-09-12T17:32:45.436 INFO:tasks.workunit.client.0.smithi037.stderr: -443> 2024-09-12T17:32:45.144+0000 7f62ea542800 10 monclient: _reopen_session rank -1 2024-09-12T17:32:45.436 INFO:tasks.workunit.client.0.smithi037.stderr: -442> 2024-09-12T17:32:45.144+0000 7f62ea542800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T17:32:45.436 INFO:tasks.workunit.client.0.smithi037.stderr: -441> 2024-09-12T17:32:45.144+0000 7f62ea542800 10 monclient(hunting): picked mon.noname-c con 0x559a91fa1650 addr [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] 2024-09-12T17:32:45.436 INFO:tasks.workunit.client.0.smithi037.stderr: -440> 2024-09-12T17:32:45.144+0000 7f62ea542800 10 monclient(hunting): picked mon.noname-a con 0x559a9203cd50 addr [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] 2024-09-12T17:32:45.436 INFO:tasks.workunit.client.0.smithi037.stderr: -439> 2024-09-12T17:32:45.144+0000 7f62ea542800 10 monclient(hunting): picked mon.noname-b con 0x559a9203d6b0 addr [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] 2024-09-12T17:32:45.436 INFO:tasks.workunit.client.0.smithi037.stderr: -438> 2024-09-12T17:32:45.144+0000 7f62ea542800 10 monclient(hunting): start opening mon connection 2024-09-12T17:32:45.436 INFO:tasks.workunit.client.0.smithi037.stderr: -437> 2024-09-12T17:32:45.144+0000 7f62ea542800 10 monclient(hunting): start opening mon connection 2024-09-12T17:32:45.436 INFO:tasks.workunit.client.0.smithi037.stderr: -436> 2024-09-12T17:32:45.144+0000 7f62ea542800 10 monclient(hunting): start opening mon connection 2024-09-12T17:32:45.436 INFO:tasks.workunit.client.0.smithi037.stderr: -435> 2024-09-12T17:32:45.144+0000 7f62ea542800 10 monclient(hunting): _renew_subs 2024-09-12T17:32:45.436 INFO:tasks.workunit.client.0.smithi037.stderr: -434> 2024-09-12T17:32:45.144+0000 7f62ea542800 10 monclient(hunting): authenticate will time out at 2152.741942s 2024-09-12T17:32:45.437 INFO:tasks.workunit.client.0.smithi037.stderr: -433> 2024-09-12T17:32:45.145+0000 7f62e6286640 10 monclient(hunting): get_auth_request con 0x559a91fa1650 auth_method 0 2024-09-12T17:32:45.437 INFO:tasks.workunit.client.0.smithi037.stderr: -432> 2024-09-12T17:32:45.145+0000 7f62e6286640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:32:45.437 INFO:tasks.workunit.client.0.smithi037.stderr: -431> 2024-09-12T17:32:45.145+0000 7f62e6286640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:32:45.437 INFO:tasks.workunit.client.0.smithi037.stderr: -430> 2024-09-12T17:32:45.145+0000 7f62e6286640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:32:45.437 INFO:tasks.workunit.client.0.smithi037.stderr: -429> 2024-09-12T17:32:45.145+0000 7f62e5a85640 10 monclient(hunting): get_auth_request con 0x559a9203cd50 auth_method 0 2024-09-12T17:32:45.437 INFO:tasks.workunit.client.0.smithi037.stderr: -428> 2024-09-12T17:32:45.145+0000 7f62e5a85640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:32:45.437 INFO:tasks.workunit.client.0.smithi037.stderr: -427> 2024-09-12T17:32:45.145+0000 7f62e5a85640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:32:45.437 INFO:tasks.workunit.client.0.smithi037.stderr: -426> 2024-09-12T17:32:45.145+0000 7f62e5a85640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:32:45.437 INFO:tasks.workunit.client.0.smithi037.stderr: -425> 2024-09-12T17:32:45.145+0000 7f62e6286640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:32:45.437 INFO:tasks.workunit.client.0.smithi037.stderr: -424> 2024-09-12T17:32:45.145+0000 7f62e6286640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:32:45.437 INFO:tasks.workunit.client.0.smithi037.stderr: -423> 2024-09-12T17:32:45.145+0000 7f62e6286640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:32:45.437 INFO:tasks.workunit.client.0.smithi037.stderr: -422> 2024-09-12T17:32:45.145+0000 7f62e5a85640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:32:45.437 INFO:tasks.workunit.client.0.smithi037.stderr: -421> 2024-09-12T17:32:45.145+0000 7f62e5a85640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:32:45.438 INFO:tasks.workunit.client.0.smithi037.stderr: -420> 2024-09-12T17:32:45.145+0000 7f62e5a85640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:32:45.438 INFO:tasks.workunit.client.0.smithi037.stderr: -419> 2024-09-12T17:32:45.145+0000 7f62e6a87640 10 monclient(hunting): get_auth_request con 0x559a9203d6b0 auth_method 0 2024-09-12T17:32:45.438 INFO:tasks.workunit.client.0.smithi037.stderr: -418> 2024-09-12T17:32:45.145+0000 7f62e6a87640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:32:45.438 INFO:tasks.workunit.client.0.smithi037.stderr: -417> 2024-09-12T17:32:45.145+0000 7f62e6a87640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:32:45.438 INFO:tasks.workunit.client.0.smithi037.stderr: -416> 2024-09-12T17:32:45.145+0000 7f62e6a87640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:32:45.438 INFO:tasks.workunit.client.0.smithi037.stderr: -415> 2024-09-12T17:32:45.145+0000 7f62e6286640 10 monclient(hunting): handle_auth_done global_id 6272 payload 824 2024-09-12T17:32:45.438 INFO:tasks.workunit.client.0.smithi037.stderr: -414> 2024-09-12T17:32:45.145+0000 7f62e6286640 10 monclient: _finish_hunting 0 2024-09-12T17:32:45.438 INFO:tasks.workunit.client.0.smithi037.stderr: -413> 2024-09-12T17:32:45.145+0000 7f62e6286640 1 monclient: found mon.noname-c 2024-09-12T17:32:45.438 INFO:tasks.workunit.client.0.smithi037.stderr: -412> 2024-09-12T17:32:45.145+0000 7f62e6286640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.37:3301/0 2024-09-12T17:32:45.438 INFO:tasks.workunit.client.0.smithi037.stderr: -411> 2024-09-12T17:32:45.145+0000 7f61d2e05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:32:45.438 INFO:tasks.workunit.client.0.smithi037.stderr: -410> 2024-09-12T17:32:45.145+0000 7f61d2e05640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:32:45.438 INFO:tasks.workunit.client.0.smithi037.stderr: -409> 2024-09-12T17:32:45.145+0000 7f61d2e05640 10 monclient: dump: 2024-09-12T17:32:45.438 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:32:45.438 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:32:45.438 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:32:45.439 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:32:45.439 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:32:45.439 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:32:45.439 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:32:45.439 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:32:45.439 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:32:45.439 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:32:45.439 INFO:tasks.workunit.client.0.smithi037.stderr: -408> 2024-09-12T17:32:45.145+0000 7f61d2e05640 10 monclient: _finish_auth 0 2024-09-12T17:32:45.439 INFO:tasks.workunit.client.0.smithi037.stderr: -407> 2024-09-12T17:32:45.145+0000 7f61d2e05640 10 monclient: _check_auth_tickets 2024-09-12T17:32:45.439 INFO:tasks.workunit.client.0.smithi037.stderr: -406> 2024-09-12T17:32:45.145+0000 7f61d2e05640 10 monclient: handle_config config(0 keys) 2024-09-12T17:32:45.439 INFO:tasks.workunit.client.0.smithi037.stderr: -405> 2024-09-12T17:32:45.145+0000 7f61d2e05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:32:45.439 INFO:tasks.workunit.client.0.smithi037.stderr: -404> 2024-09-12T17:32:45.145+0000 7f61d2e05640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:32:45.439 INFO:tasks.workunit.client.0.smithi037.stderr: -403> 2024-09-12T17:32:45.145+0000 7f61d2e05640 10 monclient: dump: 2024-09-12T17:32:45.439 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:32:45.440 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:32:45.440 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:32:45.440 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:32:45.440 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:32:45.440 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:32:45.440 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:32:45.440 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:32:45.440 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:32:45.440 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:32:45.440 INFO:tasks.workunit.client.0.smithi037.stderr: -402> 2024-09-12T17:32:45.145+0000 7f62ea542800 5 monclient: authenticate success, global_id 6272 2024-09-12T17:32:45.440 INFO:tasks.workunit.client.0.smithi037.stderr: -401> 2024-09-12T17:32:45.145+0000 7f62ea542800 10 monclient: _renew_subs 2024-09-12T17:32:45.440 INFO:tasks.workunit.client.0.smithi037.stderr: -400> 2024-09-12T17:32:45.145+0000 7f61d4608640 4 set_mon_vals no callback set 2024-09-12T17:32:45.440 INFO:tasks.workunit.client.0.smithi037.stderr: -399> 2024-09-12T17:32:45.145+0000 7f62ea542800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.37:3301/0 2024-09-12T17:32:45.440 INFO:tasks.workunit.client.0.smithi037.stderr: -398> 2024-09-12T17:32:45.145+0000 7f62ea542800 10 monclient: _renew_subs 2024-09-12T17:32:45.441 INFO:tasks.workunit.client.0.smithi037.stderr: -397> 2024-09-12T17:32:45.145+0000 7f62ea542800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.37:3301/0 2024-09-12T17:32:45.441 INFO:tasks.workunit.client.0.smithi037.stderr: -396> 2024-09-12T17:32:45.145+0000 7f62ea542800 1 librados: init done 2024-09-12T17:32:45.441 INFO:tasks.workunit.client.0.smithi037.stderr: -395> 2024-09-12T17:32:45.147+0000 7f61d2e05640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:32:45.441 INFO:tasks.workunit.client.0.smithi037.stderr: -394> 2024-09-12T17:32:45.147+0000 7f61d2e05640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.40:6816/3916250676,v1:172.21.15.40:6817/3916250676] 2024-09-12T17:32:45.441 INFO:tasks.workunit.client.0.smithi037.stderr: -393> 2024-09-12T17:32:45.147+0000 7f61d2e05640 4 mgrc reconnect Starting new session with [v2:172.21.15.40:6816/3916250676,v1:172.21.15.40:6817/3916250676] 2024-09-12T17:32:45.441 INFO:tasks.workunit.client.0.smithi037.stderr: -392> 2024-09-12T17:32:45.147+0000 7f62e5a85640 10 monclient: get_auth_request con 0x7f61cc076470 auth_method 0 2024-09-12T17:32:45.441 INFO:tasks.workunit.client.0.smithi037.stderr: -391> 2024-09-12T17:32:45.148+0000 7f62e6a87640 10 monclient: get_auth_request con 0x559a9211cca0 auth_method 0 2024-09-12T17:32:45.441 INFO:tasks.workunit.client.0.smithi037.stderr: -390> 2024-09-12T17:32:45.148+0000 7f62e6286640 10 monclient: get_auth_request con 0x559a9213f560 auth_method 0 2024-09-12T17:32:45.441 INFO:tasks.workunit.client.0.smithi037.stderr: -389> 2024-09-12T17:32:45.150+0000 7f62e5a85640 10 monclient: get_auth_request con 0x559a92142e10 auth_method 0 2024-09-12T17:32:45.441 INFO:tasks.workunit.client.0.smithi037.stderr: -388> 2024-09-12T17:32:45.150+0000 7f62ea542800 10 monclient: build_initial_monmap 2024-09-12T17:32:45.441 INFO:tasks.workunit.client.0.smithi037.stderr: -387> 2024-09-12T17:32:45.150+0000 7f62ea542800 1 build_initial for_mkfs: 0 2024-09-12T17:32:45.441 INFO:tasks.workunit.client.0.smithi037.stderr: -386> 2024-09-12T17:32:45.150+0000 7f62ea542800 10 monclient: monmap: 2024-09-12T17:32:45.441 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 0 2024-09-12T17:32:45.442 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:32:45.442 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 0.000000 2024-09-12T17:32:45.442 INFO:tasks.workunit.client.0.smithi037.stderr:created 0.000000 2024-09-12T17:32:45.442 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 0 (unknown) 2024-09-12T17:32:45.442 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:32:45.442 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.noname-a 2024-09-12T17:32:45.442 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.noname-b 2024-09-12T17:32:45.442 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.noname-c 2024-09-12T17:32:45.442 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:32:45.442 INFO:tasks.workunit.client.0.smithi037.stderr: -385> 2024-09-12T17:32:45.150+0000 7f62ea542800 5 AuthRegistry(0x559a92148830) adding auth protocol: cephx 2024-09-12T17:32:45.442 INFO:tasks.workunit.client.0.smithi037.stderr: -384> 2024-09-12T17:32:45.150+0000 7f62ea542800 5 AuthRegistry(0x559a92148830) adding auth protocol: cephx 2024-09-12T17:32:45.442 INFO:tasks.workunit.client.0.smithi037.stderr: -383> 2024-09-12T17:32:45.150+0000 7f62ea542800 5 AuthRegistry(0x559a92148830) adding auth protocol: cephx 2024-09-12T17:32:45.442 INFO:tasks.workunit.client.0.smithi037.stderr: -382> 2024-09-12T17:32:45.150+0000 7f62ea542800 5 AuthRegistry(0x559a92148830) adding con mode: secure 2024-09-12T17:32:45.442 INFO:tasks.workunit.client.0.smithi037.stderr: -381> 2024-09-12T17:32:45.150+0000 7f62ea542800 5 AuthRegistry(0x559a92148830) adding con mode: crc 2024-09-12T17:32:45.443 INFO:tasks.workunit.client.0.smithi037.stderr: -380> 2024-09-12T17:32:45.150+0000 7f62ea542800 5 AuthRegistry(0x559a92148830) adding con mode: secure 2024-09-12T17:32:45.443 INFO:tasks.workunit.client.0.smithi037.stderr: -379> 2024-09-12T17:32:45.150+0000 7f62ea542800 5 AuthRegistry(0x559a92148830) adding con mode: crc 2024-09-12T17:32:45.443 INFO:tasks.workunit.client.0.smithi037.stderr: -378> 2024-09-12T17:32:45.150+0000 7f62ea542800 5 AuthRegistry(0x559a92148830) adding con mode: secure 2024-09-12T17:32:45.443 INFO:tasks.workunit.client.0.smithi037.stderr: -377> 2024-09-12T17:32:45.150+0000 7f62ea542800 5 AuthRegistry(0x559a92148830) adding con mode: crc 2024-09-12T17:32:45.443 INFO:tasks.workunit.client.0.smithi037.stderr: -376> 2024-09-12T17:32:45.150+0000 7f62ea542800 5 AuthRegistry(0x559a92148830) adding con mode: crc 2024-09-12T17:32:45.443 INFO:tasks.workunit.client.0.smithi037.stderr: -375> 2024-09-12T17:32:45.150+0000 7f62ea542800 5 AuthRegistry(0x559a92148830) adding con mode: secure 2024-09-12T17:32:45.443 INFO:tasks.workunit.client.0.smithi037.stderr: -374> 2024-09-12T17:32:45.150+0000 7f62ea542800 5 AuthRegistry(0x559a92148830) adding con mode: crc 2024-09-12T17:32:45.443 INFO:tasks.workunit.client.0.smithi037.stderr: -373> 2024-09-12T17:32:45.150+0000 7f62ea542800 5 AuthRegistry(0x559a92148830) adding con mode: secure 2024-09-12T17:32:45.443 INFO:tasks.workunit.client.0.smithi037.stderr: -372> 2024-09-12T17:32:45.150+0000 7f62ea542800 5 AuthRegistry(0x559a92148830) adding con mode: crc 2024-09-12T17:32:45.443 INFO:tasks.workunit.client.0.smithi037.stderr: -371> 2024-09-12T17:32:45.150+0000 7f62ea542800 5 AuthRegistry(0x559a92148830) adding con mode: secure 2024-09-12T17:32:45.443 INFO:tasks.workunit.client.0.smithi037.stderr: -370> 2024-09-12T17:32:45.151+0000 7f62ea542800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:32:45.443 INFO:tasks.workunit.client.0.smithi037.stderr: -369> 2024-09-12T17:32:45.151+0000 7f62ea542800 5 asok(0x559a91ed1730) register_command objecter_requests cmddesc objecter_requests hook 0x559a9214c200 EEXIST 2024-09-12T17:32:45.443 INFO:tasks.workunit.client.0.smithi037.stderr: -368> 2024-09-12T17:32:45.151+0000 7f62ea542800 10 monclient: init 2024-09-12T17:32:45.444 INFO:tasks.workunit.client.0.smithi037.stderr: -367> 2024-09-12T17:32:45.151+0000 7f62ea542800 5 AuthRegistry(0x559a921477e8) adding auth protocol: cephx 2024-09-12T17:32:45.444 INFO:tasks.workunit.client.0.smithi037.stderr: -366> 2024-09-12T17:32:45.151+0000 7f62ea542800 5 AuthRegistry(0x559a921477e8) adding auth protocol: cephx 2024-09-12T17:32:45.444 INFO:tasks.workunit.client.0.smithi037.stderr: -365> 2024-09-12T17:32:45.151+0000 7f62ea542800 5 AuthRegistry(0x559a921477e8) adding auth protocol: cephx 2024-09-12T17:32:45.444 INFO:tasks.workunit.client.0.smithi037.stderr: -364> 2024-09-12T17:32:45.151+0000 7f62ea542800 5 AuthRegistry(0x559a921477e8) adding con mode: secure 2024-09-12T17:32:45.444 INFO:tasks.workunit.client.0.smithi037.stderr: -363> 2024-09-12T17:32:45.151+0000 7f62ea542800 5 AuthRegistry(0x559a921477e8) adding con mode: crc 2024-09-12T17:32:45.444 INFO:tasks.workunit.client.0.smithi037.stderr: -362> 2024-09-12T17:32:45.151+0000 7f62ea542800 5 AuthRegistry(0x559a921477e8) adding con mode: secure 2024-09-12T17:32:45.444 INFO:tasks.workunit.client.0.smithi037.stderr: -361> 2024-09-12T17:32:45.151+0000 7f62ea542800 5 AuthRegistry(0x559a921477e8) adding con mode: crc 2024-09-12T17:32:45.444 INFO:tasks.workunit.client.0.smithi037.stderr: -360> 2024-09-12T17:32:45.151+0000 7f62ea542800 5 AuthRegistry(0x559a921477e8) adding con mode: secure 2024-09-12T17:32:45.444 INFO:tasks.workunit.client.0.smithi037.stderr: -359> 2024-09-12T17:32:45.151+0000 7f62ea542800 5 AuthRegistry(0x559a921477e8) adding con mode: crc 2024-09-12T17:32:45.444 INFO:tasks.workunit.client.0.smithi037.stderr: -358> 2024-09-12T17:32:45.151+0000 7f62ea542800 5 AuthRegistry(0x559a921477e8) adding con mode: crc 2024-09-12T17:32:45.444 INFO:tasks.workunit.client.0.smithi037.stderr: -357> 2024-09-12T17:32:45.151+0000 7f62ea542800 5 AuthRegistry(0x559a921477e8) adding con mode: secure 2024-09-12T17:32:45.444 INFO:tasks.workunit.client.0.smithi037.stderr: -356> 2024-09-12T17:32:45.151+0000 7f62ea542800 5 AuthRegistry(0x559a921477e8) adding con mode: crc 2024-09-12T17:32:45.444 INFO:tasks.workunit.client.0.smithi037.stderr: -355> 2024-09-12T17:32:45.151+0000 7f62ea542800 5 AuthRegistry(0x559a921477e8) adding con mode: secure 2024-09-12T17:32:45.444 INFO:tasks.workunit.client.0.smithi037.stderr: -354> 2024-09-12T17:32:45.151+0000 7f62ea542800 5 AuthRegistry(0x559a921477e8) adding con mode: crc 2024-09-12T17:32:45.445 INFO:tasks.workunit.client.0.smithi037.stderr: -353> 2024-09-12T17:32:45.151+0000 7f62ea542800 5 AuthRegistry(0x559a921477e8) adding con mode: secure 2024-09-12T17:32:45.445 INFO:tasks.workunit.client.0.smithi037.stderr: -352> 2024-09-12T17:32:45.151+0000 7f62ea542800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:32:45.445 INFO:tasks.workunit.client.0.smithi037.stderr: -351> 2024-09-12T17:32:45.151+0000 7f62ea542800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:32:45.445 INFO:tasks.workunit.client.0.smithi037.stderr: -350> 2024-09-12T17:32:45.151+0000 7f62ea542800 5 asok(0x559a91ed1730) register_command rotate-key cmddesc rotate-key hook 0x559a92147930 EEXIST 2024-09-12T17:32:45.445 INFO:tasks.workunit.client.0.smithi037.stderr: -349> 2024-09-12T17:32:45.151+0000 7f62ea542800 10 monclient: _reopen_session rank -1 2024-09-12T17:32:45.445 INFO:tasks.workunit.client.0.smithi037.stderr: -348> 2024-09-12T17:32:45.151+0000 7f62ea542800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T17:32:45.445 INFO:tasks.workunit.client.0.smithi037.stderr: -347> 2024-09-12T17:32:45.151+0000 7f62ea542800 10 monclient(hunting): picked mon.noname-a con 0x559a9216fef0 addr [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] 2024-09-12T17:32:45.445 INFO:tasks.workunit.client.0.smithi037.stderr: -346> 2024-09-12T17:32:45.151+0000 7f62ea542800 10 monclient(hunting): picked mon.noname-c con 0x559a921721c0 addr [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] 2024-09-12T17:32:45.445 INFO:tasks.workunit.client.0.smithi037.stderr: -345> 2024-09-12T17:32:45.151+0000 7f62ea542800 10 monclient(hunting): picked mon.noname-b con 0x559a9216e6c0 addr [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] 2024-09-12T17:32:45.446 INFO:tasks.workunit.client.0.smithi037.stderr: -344> 2024-09-12T17:32:45.151+0000 7f62ea542800 10 monclient(hunting): start opening mon connection 2024-09-12T17:32:45.446 INFO:tasks.workunit.client.0.smithi037.stderr: -343> 2024-09-12T17:32:45.151+0000 7f62ea542800 10 monclient(hunting): start opening mon connection 2024-09-12T17:32:45.446 INFO:tasks.workunit.client.0.smithi037.stderr: -342> 2024-09-12T17:32:45.151+0000 7f62ea542800 10 monclient(hunting): start opening mon connection 2024-09-12T17:32:45.446 INFO:tasks.workunit.client.0.smithi037.stderr: -341> 2024-09-12T17:32:45.152+0000 7f62ea542800 10 monclient(hunting): _renew_subs 2024-09-12T17:32:45.446 INFO:tasks.workunit.client.0.smithi037.stderr: -340> 2024-09-12T17:32:45.152+0000 7f62ea542800 10 monclient(hunting): authenticate will time out at 2152.749013s 2024-09-12T17:32:45.446 INFO:tasks.workunit.client.0.smithi037.stderr: -339> 2024-09-12T17:32:45.152+0000 7f62e5a85640 10 monclient(hunting): get_auth_request con 0x559a921721c0 auth_method 0 2024-09-12T17:32:45.446 INFO:tasks.workunit.client.0.smithi037.stderr: -338> 2024-09-12T17:32:45.152+0000 7f62e5a85640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:32:45.446 INFO:tasks.workunit.client.0.smithi037.stderr: -337> 2024-09-12T17:32:45.152+0000 7f62e5a85640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:32:45.446 INFO:tasks.workunit.client.0.smithi037.stderr: -336> 2024-09-12T17:32:45.152+0000 7f62e5a85640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:32:45.446 INFO:tasks.workunit.client.0.smithi037.stderr: -335> 2024-09-12T17:32:45.152+0000 7f62e6286640 10 monclient(hunting): get_auth_request con 0x559a9216fef0 auth_method 0 2024-09-12T17:32:45.446 INFO:tasks.workunit.client.0.smithi037.stderr: -334> 2024-09-12T17:32:45.152+0000 7f62e6286640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:32:45.446 INFO:tasks.workunit.client.0.smithi037.stderr: -333> 2024-09-12T17:32:45.152+0000 7f62e6286640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:32:45.446 INFO:tasks.workunit.client.0.smithi037.stderr: -332> 2024-09-12T17:32:45.152+0000 7f62e6286640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:32:45.446 INFO:tasks.workunit.client.0.smithi037.stderr: -331> 2024-09-12T17:32:45.152+0000 7f62e6a87640 10 monclient(hunting): get_auth_request con 0x559a9216e6c0 auth_method 0 2024-09-12T17:32:45.447 INFO:tasks.workunit.client.0.smithi037.stderr: -330> 2024-09-12T17:32:45.152+0000 7f62e6a87640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:32:45.447 INFO:tasks.workunit.client.0.smithi037.stderr: -329> 2024-09-12T17:32:45.152+0000 7f62e6a87640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:32:45.447 INFO:tasks.workunit.client.0.smithi037.stderr: -328> 2024-09-12T17:32:45.152+0000 7f62e6a87640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:32:45.447 INFO:tasks.workunit.client.0.smithi037.stderr: -327> 2024-09-12T17:32:45.152+0000 7f62e5a85640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:32:45.447 INFO:tasks.workunit.client.0.smithi037.stderr: -326> 2024-09-12T17:32:45.152+0000 7f62e5a85640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:32:45.447 INFO:tasks.workunit.client.0.smithi037.stderr: -325> 2024-09-12T17:32:45.152+0000 7f62e5a85640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:32:45.447 INFO:tasks.workunit.client.0.smithi037.stderr: -324> 2024-09-12T17:32:45.152+0000 7f62e6286640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:32:45.447 INFO:tasks.workunit.client.0.smithi037.stderr: -323> 2024-09-12T17:32:45.152+0000 7f62e6286640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:32:45.447 INFO:tasks.workunit.client.0.smithi037.stderr: -322> 2024-09-12T17:32:45.152+0000 7f62e6286640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:32:45.447 INFO:tasks.workunit.client.0.smithi037.stderr: -321> 2024-09-12T17:32:45.152+0000 7f62e6a87640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:32:45.447 INFO:tasks.workunit.client.0.smithi037.stderr: -320> 2024-09-12T17:32:45.152+0000 7f62e6a87640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:32:45.447 INFO:tasks.workunit.client.0.smithi037.stderr: -319> 2024-09-12T17:32:45.152+0000 7f62e6a87640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:32:45.447 INFO:tasks.workunit.client.0.smithi037.stderr: -318> 2024-09-12T17:32:45.152+0000 7f62e5a85640 10 monclient(hunting): handle_auth_done global_id 6275 payload 824 2024-09-12T17:32:45.448 INFO:tasks.workunit.client.0.smithi037.stderr: -317> 2024-09-12T17:32:45.152+0000 7f62e5a85640 10 monclient: _finish_hunting 0 2024-09-12T17:32:45.448 INFO:tasks.workunit.client.0.smithi037.stderr: -316> 2024-09-12T17:32:45.152+0000 7f62e5a85640 1 monclient: found mon.noname-c 2024-09-12T17:32:45.448 INFO:tasks.workunit.client.0.smithi037.stderr: -315> 2024-09-12T17:32:45.152+0000 7f62e5a85640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.37:3301/0 2024-09-12T17:32:45.448 INFO:tasks.workunit.client.0.smithi037.stderr: -314> 2024-09-12T17:32:45.152+0000 7f61cbfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:32:45.448 INFO:tasks.workunit.client.0.smithi037.stderr: -313> 2024-09-12T17:32:45.152+0000 7f61cbfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:32:45.448 INFO:tasks.workunit.client.0.smithi037.stderr: -312> 2024-09-12T17:32:45.152+0000 7f61cbfff640 10 monclient: dump: 2024-09-12T17:32:45.448 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:32:45.448 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:32:45.448 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:32:45.448 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:32:45.448 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:32:45.448 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:32:45.448 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:32:45.449 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:32:45.449 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:32:45.449 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:32:45.449 INFO:tasks.workunit.client.0.smithi037.stderr: -311> 2024-09-12T17:32:45.152+0000 7f61cbfff640 10 monclient: _finish_auth 0 2024-09-12T17:32:45.449 INFO:tasks.workunit.client.0.smithi037.stderr: -310> 2024-09-12T17:32:45.152+0000 7f61cbfff640 10 monclient: _check_auth_tickets 2024-09-12T17:32:45.449 INFO:tasks.workunit.client.0.smithi037.stderr: -309> 2024-09-12T17:32:45.152+0000 7f61cbfff640 10 monclient: handle_config config(0 keys) 2024-09-12T17:32:45.449 INFO:tasks.workunit.client.0.smithi037.stderr: -308> 2024-09-12T17:32:45.152+0000 7f61cbfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:32:45.449 INFO:tasks.workunit.client.0.smithi037.stderr: -307> 2024-09-12T17:32:45.152+0000 7f61cbfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:32:45.449 INFO:tasks.workunit.client.0.smithi037.stderr: -306> 2024-09-12T17:32:45.152+0000 7f61cbfff640 10 monclient: dump: 2024-09-12T17:32:45.449 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:32:45.449 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:32:45.449 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:32:45.449 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:32:45.450 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:32:45.450 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:32:45.450 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:32:45.450 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:32:45.450 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:32:45.450 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:32:45.450 INFO:tasks.workunit.client.0.smithi037.stderr: -305> 2024-09-12T17:32:45.152+0000 7f62ea542800 5 monclient: authenticate success, global_id 6275 2024-09-12T17:32:45.450 INFO:tasks.workunit.client.0.smithi037.stderr: -304> 2024-09-12T17:32:45.152+0000 7f62ea542800 10 monclient: _renew_subs 2024-09-12T17:32:45.450 INFO:tasks.workunit.client.0.smithi037.stderr: -303> 2024-09-12T17:32:45.152+0000 7f62ea542800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.37:3301/0 2024-09-12T17:32:45.450 INFO:tasks.workunit.client.0.smithi037.stderr: -302> 2024-09-12T17:32:45.152+0000 7f62e7288640 4 set_mon_vals no callback set 2024-09-12T17:32:45.450 INFO:tasks.workunit.client.0.smithi037.stderr: -301> 2024-09-12T17:32:45.152+0000 7f62ea542800 10 monclient: _renew_subs 2024-09-12T17:32:45.450 INFO:tasks.workunit.client.0.smithi037.stderr: -300> 2024-09-12T17:32:45.152+0000 7f62ea542800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.37:3301/0 2024-09-12T17:32:45.450 INFO:tasks.workunit.client.0.smithi037.stderr: -299> 2024-09-12T17:32:45.154+0000 7f61cbfff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:32:45.451 INFO:tasks.workunit.client.0.smithi037.stderr: -298> 2024-09-12T17:32:45.154+0000 7f61cbfff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.40:6816/3916250676,v1:172.21.15.40:6817/3916250676] 2024-09-12T17:32:45.451 INFO:tasks.workunit.client.0.smithi037.stderr: -297> 2024-09-12T17:32:45.154+0000 7f61cbfff640 4 mgrc reconnect Starting new session with [v2:172.21.15.40:6816/3916250676,v1:172.21.15.40:6817/3916250676] 2024-09-12T17:32:45.451 INFO:tasks.workunit.client.0.smithi037.stderr: -296> 2024-09-12T17:32:45.155+0000 7f62ea542800 10 monclient: get_monmap_and_config 2024-09-12T17:32:45.451 INFO:tasks.workunit.client.0.smithi037.stderr: -295> 2024-09-12T17:32:45.155+0000 7f62ea542800 10 monclient: build_initial_monmap 2024-09-12T17:32:45.451 INFO:tasks.workunit.client.0.smithi037.stderr: -294> 2024-09-12T17:32:45.155+0000 7f62ea542800 1 build_initial for_mkfs: 0 2024-09-12T17:32:45.451 INFO:tasks.workunit.client.0.smithi037.stderr: -293> 2024-09-12T17:32:45.155+0000 7f62ea542800 10 monclient: monmap: 2024-09-12T17:32:45.451 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 0 2024-09-12T17:32:45.451 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:32:45.451 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 0.000000 2024-09-12T17:32:45.451 INFO:tasks.workunit.client.0.smithi037.stderr:created 0.000000 2024-09-12T17:32:45.451 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 0 (unknown) 2024-09-12T17:32:45.451 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:32:45.451 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.noname-a 2024-09-12T17:32:45.451 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.noname-b 2024-09-12T17:32:45.452 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.noname-c 2024-09-12T17:32:45.452 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:32:45.452 INFO:tasks.workunit.client.0.smithi037.stderr: -292> 2024-09-12T17:32:45.155+0000 7f62ea542800 5 AuthRegistry(0x559a9218fb90) adding auth protocol: cephx 2024-09-12T17:32:45.452 INFO:tasks.workunit.client.0.smithi037.stderr: -291> 2024-09-12T17:32:45.155+0000 7f62ea542800 5 AuthRegistry(0x559a9218fb90) adding auth protocol: cephx 2024-09-12T17:32:45.452 INFO:tasks.workunit.client.0.smithi037.stderr: -290> 2024-09-12T17:32:45.155+0000 7f62ea542800 5 AuthRegistry(0x559a9218fb90) adding auth protocol: cephx 2024-09-12T17:32:45.452 INFO:tasks.workunit.client.0.smithi037.stderr: -289> 2024-09-12T17:32:45.155+0000 7f62ea542800 5 AuthRegistry(0x559a9218fb90) adding con mode: secure 2024-09-12T17:32:45.452 INFO:tasks.workunit.client.0.smithi037.stderr: -288> 2024-09-12T17:32:45.155+0000 7f62ea542800 5 AuthRegistry(0x559a9218fb90) adding con mode: crc 2024-09-12T17:32:45.452 INFO:tasks.workunit.client.0.smithi037.stderr: -287> 2024-09-12T17:32:45.155+0000 7f62ea542800 5 AuthRegistry(0x559a9218fb90) adding con mode: secure 2024-09-12T17:32:45.452 INFO:tasks.workunit.client.0.smithi037.stderr: -286> 2024-09-12T17:32:45.155+0000 7f62ea542800 5 AuthRegistry(0x559a9218fb90) adding con mode: crc 2024-09-12T17:32:45.452 INFO:tasks.workunit.client.0.smithi037.stderr: -285> 2024-09-12T17:32:45.155+0000 7f62ea542800 5 AuthRegistry(0x559a9218fb90) adding con mode: secure 2024-09-12T17:32:45.452 INFO:tasks.workunit.client.0.smithi037.stderr: -284> 2024-09-12T17:32:45.155+0000 7f62ea542800 5 AuthRegistry(0x559a9218fb90) adding con mode: crc 2024-09-12T17:32:45.452 INFO:tasks.workunit.client.0.smithi037.stderr: -283> 2024-09-12T17:32:45.155+0000 7f62ea542800 5 AuthRegistry(0x559a9218fb90) adding con mode: crc 2024-09-12T17:32:45.452 INFO:tasks.workunit.client.0.smithi037.stderr: -282> 2024-09-12T17:32:45.155+0000 7f62ea542800 5 AuthRegistry(0x559a9218fb90) adding con mode: secure 2024-09-12T17:32:45.453 INFO:tasks.workunit.client.0.smithi037.stderr: -281> 2024-09-12T17:32:45.155+0000 7f62ea542800 5 AuthRegistry(0x559a9218fb90) adding con mode: crc 2024-09-12T17:32:45.453 INFO:tasks.workunit.client.0.smithi037.stderr: -280> 2024-09-12T17:32:45.155+0000 7f62ea542800 5 AuthRegistry(0x559a9218fb90) adding con mode: secure 2024-09-12T17:32:45.453 INFO:tasks.workunit.client.0.smithi037.stderr: -279> 2024-09-12T17:32:45.155+0000 7f62ea542800 5 AuthRegistry(0x559a9218fb90) adding con mode: crc 2024-09-12T17:32:45.453 INFO:tasks.workunit.client.0.smithi037.stderr: -278> 2024-09-12T17:32:45.155+0000 7f62ea542800 5 AuthRegistry(0x559a9218fb90) adding con mode: secure 2024-09-12T17:32:45.453 INFO:tasks.workunit.client.0.smithi037.stderr: -277> 2024-09-12T17:32:45.155+0000 7f62e6286640 10 monclient: get_auth_request con 0x7f61c0076380 auth_method 0 2024-09-12T17:32:45.453 INFO:tasks.workunit.client.0.smithi037.stderr: -276> 2024-09-12T17:32:45.155+0000 7f62ea542800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:32:45.453 INFO:tasks.workunit.client.0.smithi037.stderr: -275> 2024-09-12T17:32:45.155+0000 7f62ea542800 10 monclient: init 2024-09-12T17:32:45.453 INFO:tasks.workunit.client.0.smithi037.stderr: -274> 2024-09-12T17:32:45.155+0000 7f62ea542800 5 AuthRegistry(0x7fff16f1bed0) adding auth protocol: cephx 2024-09-12T17:32:45.453 INFO:tasks.workunit.client.0.smithi037.stderr: -273> 2024-09-12T17:32:45.155+0000 7f62ea542800 5 AuthRegistry(0x7fff16f1bed0) adding auth protocol: cephx 2024-09-12T17:32:45.453 INFO:tasks.workunit.client.0.smithi037.stderr: -272> 2024-09-12T17:32:45.155+0000 7f62ea542800 5 AuthRegistry(0x7fff16f1bed0) adding auth protocol: cephx 2024-09-12T17:32:45.453 INFO:tasks.workunit.client.0.smithi037.stderr: -271> 2024-09-12T17:32:45.155+0000 7f62ea542800 5 AuthRegistry(0x7fff16f1bed0) adding con mode: secure 2024-09-12T17:32:45.453 INFO:tasks.workunit.client.0.smithi037.stderr: -270> 2024-09-12T17:32:45.155+0000 7f62ea542800 5 AuthRegistry(0x7fff16f1bed0) adding con mode: crc 2024-09-12T17:32:45.453 INFO:tasks.workunit.client.0.smithi037.stderr: -269> 2024-09-12T17:32:45.155+0000 7f62ea542800 5 AuthRegistry(0x7fff16f1bed0) adding con mode: secure 2024-09-12T17:32:45.453 INFO:tasks.workunit.client.0.smithi037.stderr: -268> 2024-09-12T17:32:45.155+0000 7f62ea542800 5 AuthRegistry(0x7fff16f1bed0) adding con mode: crc 2024-09-12T17:32:45.454 INFO:tasks.workunit.client.0.smithi037.stderr: -267> 2024-09-12T17:32:45.155+0000 7f62ea542800 5 AuthRegistry(0x7fff16f1bed0) adding con mode: secure 2024-09-12T17:32:45.454 INFO:tasks.workunit.client.0.smithi037.stderr: -266> 2024-09-12T17:32:45.155+0000 7f62ea542800 5 AuthRegistry(0x7fff16f1bed0) adding con mode: crc 2024-09-12T17:32:45.454 INFO:tasks.workunit.client.0.smithi037.stderr: -265> 2024-09-12T17:32:45.155+0000 7f62ea542800 5 AuthRegistry(0x7fff16f1bed0) adding con mode: crc 2024-09-12T17:32:45.454 INFO:tasks.workunit.client.0.smithi037.stderr: -264> 2024-09-12T17:32:45.155+0000 7f62ea542800 5 AuthRegistry(0x7fff16f1bed0) adding con mode: secure 2024-09-12T17:32:45.454 INFO:tasks.workunit.client.0.smithi037.stderr: -263> 2024-09-12T17:32:45.155+0000 7f62ea542800 5 AuthRegistry(0x7fff16f1bed0) adding con mode: crc 2024-09-12T17:32:45.454 INFO:tasks.workunit.client.0.smithi037.stderr: -262> 2024-09-12T17:32:45.155+0000 7f62ea542800 5 AuthRegistry(0x7fff16f1bed0) adding con mode: secure 2024-09-12T17:32:45.454 INFO:tasks.workunit.client.0.smithi037.stderr: -261> 2024-09-12T17:32:45.155+0000 7f62ea542800 5 AuthRegistry(0x7fff16f1bed0) adding con mode: crc 2024-09-12T17:32:45.454 INFO:tasks.workunit.client.0.smithi037.stderr: -260> 2024-09-12T17:32:45.155+0000 7f62ea542800 5 AuthRegistry(0x7fff16f1bed0) adding con mode: secure 2024-09-12T17:32:45.454 INFO:tasks.workunit.client.0.smithi037.stderr: -259> 2024-09-12T17:32:45.155+0000 7f62ea542800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:32:45.454 INFO:tasks.workunit.client.0.smithi037.stderr: -258> 2024-09-12T17:32:45.155+0000 7f62ea542800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:32:45.454 INFO:tasks.workunit.client.0.smithi037.stderr: -257> 2024-09-12T17:32:45.155+0000 7f62ea542800 5 asok(0x559a91ed1730) register_command rotate-key cmddesc rotate-key hook 0x7fff16f1c018 EEXIST 2024-09-12T17:32:45.454 INFO:tasks.workunit.client.0.smithi037.stderr: -256> 2024-09-12T17:32:45.155+0000 7f62ea542800 10 monclient: _reopen_session rank -1 2024-09-12T17:32:45.454 INFO:tasks.workunit.client.0.smithi037.stderr: -255> 2024-09-12T17:32:45.155+0000 7f62ea542800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T17:32:45.455 INFO:tasks.workunit.client.0.smithi037.stderr: -254> 2024-09-12T17:32:45.155+0000 7f62ea542800 10 monclient(hunting): picked mon.noname-c con 0x559a92193c70 addr [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] 2024-09-12T17:32:45.455 INFO:tasks.workunit.client.0.smithi037.stderr: -253> 2024-09-12T17:32:45.155+0000 7f62ea542800 10 monclient(hunting): picked mon.noname-a con 0x559a921c42c0 addr [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] 2024-09-12T17:32:45.455 INFO:tasks.workunit.client.0.smithi037.stderr: -252> 2024-09-12T17:32:45.156+0000 7f62ea542800 10 monclient(hunting): picked mon.noname-b con 0x559a921bf4b0 addr [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] 2024-09-12T17:32:45.455 INFO:tasks.workunit.client.0.smithi037.stderr: -251> 2024-09-12T17:32:45.156+0000 7f62ea542800 10 monclient(hunting): start opening mon connection 2024-09-12T17:32:45.455 INFO:tasks.workunit.client.0.smithi037.stderr: -250> 2024-09-12T17:32:45.156+0000 7f62ea542800 10 monclient(hunting): start opening mon connection 2024-09-12T17:32:45.455 INFO:tasks.workunit.client.0.smithi037.stderr: -249> 2024-09-12T17:32:45.156+0000 7f62ea542800 10 monclient(hunting): start opening mon connection 2024-09-12T17:32:45.455 INFO:tasks.workunit.client.0.smithi037.stderr: -248> 2024-09-12T17:32:45.156+0000 7f62ea542800 10 monclient(hunting): _renew_subs 2024-09-12T17:32:45.455 INFO:tasks.workunit.client.0.smithi037.stderr: -247> 2024-09-12T17:32:45.156+0000 7f62ea542800 10 monclient(hunting): authenticate will time out at 2152.753021s 2024-09-12T17:32:45.455 INFO:tasks.workunit.client.0.smithi037.stderr: -246> 2024-09-12T17:32:45.156+0000 7f62e6286640 10 monclient(hunting): get_auth_request con 0x559a92193c70 auth_method 0 2024-09-12T17:32:45.455 INFO:tasks.workunit.client.0.smithi037.stderr: -245> 2024-09-12T17:32:45.156+0000 7f62e6286640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:32:45.455 INFO:tasks.workunit.client.0.smithi037.stderr: -244> 2024-09-12T17:32:45.156+0000 7f62e6286640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:32:45.455 INFO:tasks.workunit.client.0.smithi037.stderr: -243> 2024-09-12T17:32:45.156+0000 7f62e6286640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:32:45.455 INFO:tasks.workunit.client.0.smithi037.stderr: -242> 2024-09-12T17:32:45.156+0000 7f62e5a85640 10 monclient(hunting): get_auth_request con 0x559a921c42c0 auth_method 0 2024-09-12T17:32:45.455 INFO:tasks.workunit.client.0.smithi037.stderr: -241> 2024-09-12T17:32:45.156+0000 7f62e5a85640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:32:45.456 INFO:tasks.workunit.client.0.smithi037.stderr: -240> 2024-09-12T17:32:45.156+0000 7f62e5a85640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:32:45.456 INFO:tasks.workunit.client.0.smithi037.stderr: -239> 2024-09-12T17:32:45.156+0000 7f62e5a85640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:32:45.456 INFO:tasks.workunit.client.0.smithi037.stderr: -238> 2024-09-12T17:32:45.156+0000 7f62e6a87640 10 monclient(hunting): get_auth_request con 0x559a921bf4b0 auth_method 0 2024-09-12T17:32:45.456 INFO:tasks.workunit.client.0.smithi037.stderr: -237> 2024-09-12T17:32:45.156+0000 7f62e6a87640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:32:45.456 INFO:tasks.workunit.client.0.smithi037.stderr: -236> 2024-09-12T17:32:45.156+0000 7f62e6a87640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:32:45.456 INFO:tasks.workunit.client.0.smithi037.stderr: -235> 2024-09-12T17:32:45.156+0000 7f62e6a87640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:32:45.456 INFO:tasks.workunit.client.0.smithi037.stderr: -234> 2024-09-12T17:32:45.156+0000 7f62e6286640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:32:45.456 INFO:tasks.workunit.client.0.smithi037.stderr: -233> 2024-09-12T17:32:45.156+0000 7f62e6286640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:32:45.456 INFO:tasks.workunit.client.0.smithi037.stderr: -232> 2024-09-12T17:32:45.156+0000 7f62e6286640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:32:45.456 INFO:tasks.workunit.client.0.smithi037.stderr: -231> 2024-09-12T17:32:45.156+0000 7f62e5a85640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:32:45.456 INFO:tasks.workunit.client.0.smithi037.stderr: -230> 2024-09-12T17:32:45.156+0000 7f62e5a85640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:32:45.456 INFO:tasks.workunit.client.0.smithi037.stderr: -229> 2024-09-12T17:32:45.156+0000 7f62e5a85640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:32:45.456 INFO:tasks.workunit.client.0.smithi037.stderr: -228> 2024-09-12T17:32:45.156+0000 7f62e6a87640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:32:45.457 INFO:tasks.workunit.client.0.smithi037.stderr: -227> 2024-09-12T17:32:45.156+0000 7f62e6a87640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:32:45.457 INFO:tasks.workunit.client.0.smithi037.stderr: -226> 2024-09-12T17:32:45.156+0000 7f62e6a87640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:32:45.457 INFO:tasks.workunit.client.0.smithi037.stderr: -225> 2024-09-12T17:32:45.156+0000 7f62e6286640 10 monclient(hunting): handle_auth_done global_id 6278 payload 274 2024-09-12T17:32:45.457 INFO:tasks.workunit.client.0.smithi037.stderr: -224> 2024-09-12T17:32:45.156+0000 7f62e6286640 10 monclient: _finish_hunting 0 2024-09-12T17:32:45.457 INFO:tasks.workunit.client.0.smithi037.stderr: -223> 2024-09-12T17:32:45.156+0000 7f62e6286640 1 monclient: found mon.noname-c 2024-09-12T17:32:45.457 INFO:tasks.workunit.client.0.smithi037.stderr: -222> 2024-09-12T17:32:45.156+0000 7f62e6286640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.37:3301/0 2024-09-12T17:32:45.457 INFO:tasks.workunit.client.0.smithi037.stderr: -221> 2024-09-12T17:32:45.156+0000 7f61c9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:32:45.457 INFO:tasks.workunit.client.0.smithi037.stderr: -220> 2024-09-12T17:32:45.156+0000 7f61c9ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:32:45.457 INFO:tasks.workunit.client.0.smithi037.stderr: -219> 2024-09-12T17:32:45.156+0000 7f61c9ffb640 10 monclient: dump: 2024-09-12T17:32:45.457 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:32:45.457 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:32:45.457 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:32:45.457 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:32:45.457 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:32:45.458 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:32:45.458 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:32:45.458 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:32:45.458 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:32:45.458 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:32:45.458 INFO:tasks.workunit.client.0.smithi037.stderr: -218> 2024-09-12T17:32:45.156+0000 7f61c9ffb640 10 monclient: _finish_auth 0 2024-09-12T17:32:45.458 INFO:tasks.workunit.client.0.smithi037.stderr: -217> 2024-09-12T17:32:45.156+0000 7f61c9ffb640 10 monclient: _check_auth_tickets 2024-09-12T17:32:45.458 INFO:tasks.workunit.client.0.smithi037.stderr: -216> 2024-09-12T17:32:45.156+0000 7f61c9ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T17:32:45.458 INFO:tasks.workunit.client.0.smithi037.stderr: -215> 2024-09-12T17:32:45.156+0000 7f62ea542800 5 monclient: authenticate success, global_id 6278 2024-09-12T17:32:45.458 INFO:tasks.workunit.client.0.smithi037.stderr: -214> 2024-09-12T17:32:45.156+0000 7f62ea542800 10 monclient: get_monmap_and_config success 2024-09-12T17:32:45.458 INFO:tasks.workunit.client.0.smithi037.stderr: -213> 2024-09-12T17:32:45.156+0000 7f62ea542800 4 set_mon_vals no callback set 2024-09-12T17:32:45.458 INFO:tasks.workunit.client.0.smithi037.stderr: -212> 2024-09-12T17:32:45.156+0000 7f61c9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:32:45.458 INFO:tasks.workunit.client.0.smithi037.stderr: -211> 2024-09-12T17:32:45.156+0000 7f61c9ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:32:45.458 INFO:tasks.workunit.client.0.smithi037.stderr: -210> 2024-09-12T17:32:45.156+0000 7f61c9ffb640 10 monclient: dump: 2024-09-12T17:32:45.459 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:32:45.459 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:32:45.459 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:32:45.459 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:32:45.459 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:32:45.459 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:32:45.459 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:32:45.459 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:32:45.459 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:32:45.459 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:32:45.459 INFO:tasks.workunit.client.0.smithi037.stderr: -209> 2024-09-12T17:32:45.157+0000 7f62ea542800 10 monclient: shutdown 2024-09-12T17:32:45.459 INFO:tasks.workunit.client.0.smithi037.stderr: -208> 2024-09-12T17:32:45.157+0000 7f62ea542800 10 monclient: build_initial_monmap 2024-09-12T17:32:45.459 INFO:tasks.workunit.client.0.smithi037.stderr: -207> 2024-09-12T17:32:45.157+0000 7f62ea542800 1 build_initial for_mkfs: 0 2024-09-12T17:32:45.460 INFO:tasks.workunit.client.0.smithi037.stderr: -206> 2024-09-12T17:32:45.157+0000 7f62ea542800 10 monclient: monmap: 2024-09-12T17:32:45.460 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 0 2024-09-12T17:32:45.460 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:32:45.460 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 0.000000 2024-09-12T17:32:45.460 INFO:tasks.workunit.client.0.smithi037.stderr:created 0.000000 2024-09-12T17:32:45.460 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 0 (unknown) 2024-09-12T17:32:45.460 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:32:45.460 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.noname-a 2024-09-12T17:32:45.460 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.noname-b 2024-09-12T17:32:45.460 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.noname-c 2024-09-12T17:32:45.460 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:32:45.460 INFO:tasks.workunit.client.0.smithi037.stderr: -205> 2024-09-12T17:32:45.157+0000 7f62ea542800 5 AuthRegistry(0x559a921be170) adding auth protocol: cephx 2024-09-12T17:32:45.460 INFO:tasks.workunit.client.0.smithi037.stderr: -204> 2024-09-12T17:32:45.157+0000 7f62ea542800 5 AuthRegistry(0x559a921be170) adding auth protocol: cephx 2024-09-12T17:32:45.460 INFO:tasks.workunit.client.0.smithi037.stderr: -203> 2024-09-12T17:32:45.157+0000 7f62ea542800 5 AuthRegistry(0x559a921be170) adding auth protocol: cephx 2024-09-12T17:32:45.461 INFO:tasks.workunit.client.0.smithi037.stderr: -202> 2024-09-12T17:32:45.157+0000 7f62ea542800 5 AuthRegistry(0x559a921be170) adding con mode: secure 2024-09-12T17:32:45.461 INFO:tasks.workunit.client.0.smithi037.stderr: -201> 2024-09-12T17:32:45.157+0000 7f62ea542800 5 AuthRegistry(0x559a921be170) adding con mode: crc 2024-09-12T17:32:45.461 INFO:tasks.workunit.client.0.smithi037.stderr: -200> 2024-09-12T17:32:45.157+0000 7f62ea542800 5 AuthRegistry(0x559a921be170) adding con mode: secure 2024-09-12T17:32:45.461 INFO:tasks.workunit.client.0.smithi037.stderr: -199> 2024-09-12T17:32:45.157+0000 7f62ea542800 5 AuthRegistry(0x559a921be170) adding con mode: crc 2024-09-12T17:32:45.461 INFO:tasks.workunit.client.0.smithi037.stderr: -198> 2024-09-12T17:32:45.157+0000 7f62ea542800 5 AuthRegistry(0x559a921be170) adding con mode: secure 2024-09-12T17:32:45.461 INFO:tasks.workunit.client.0.smithi037.stderr: -197> 2024-09-12T17:32:45.157+0000 7f62ea542800 5 AuthRegistry(0x559a921be170) adding con mode: crc 2024-09-12T17:32:45.461 INFO:tasks.workunit.client.0.smithi037.stderr: -196> 2024-09-12T17:32:45.157+0000 7f62ea542800 5 AuthRegistry(0x559a921be170) adding con mode: crc 2024-09-12T17:32:45.461 INFO:tasks.workunit.client.0.smithi037.stderr: -195> 2024-09-12T17:32:45.157+0000 7f62ea542800 5 AuthRegistry(0x559a921be170) adding con mode: secure 2024-09-12T17:32:45.461 INFO:tasks.workunit.client.0.smithi037.stderr: -194> 2024-09-12T17:32:45.157+0000 7f62ea542800 5 AuthRegistry(0x559a921be170) adding con mode: crc 2024-09-12T17:32:45.461 INFO:tasks.workunit.client.0.smithi037.stderr: -193> 2024-09-12T17:32:45.157+0000 7f62ea542800 5 AuthRegistry(0x559a921be170) adding con mode: secure 2024-09-12T17:32:45.461 INFO:tasks.workunit.client.0.smithi037.stderr: -192> 2024-09-12T17:32:45.157+0000 7f62ea542800 5 AuthRegistry(0x559a921be170) adding con mode: crc 2024-09-12T17:32:45.461 INFO:tasks.workunit.client.0.smithi037.stderr: -191> 2024-09-12T17:32:45.157+0000 7f62ea542800 5 AuthRegistry(0x559a921be170) adding con mode: secure 2024-09-12T17:32:45.461 INFO:tasks.workunit.client.0.smithi037.stderr: -190> 2024-09-12T17:32:45.157+0000 7f62ea542800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:32:45.462 INFO:tasks.workunit.client.0.smithi037.stderr: -189> 2024-09-12T17:32:45.157+0000 7f62ea542800 1 librados: starting msgr at 2024-09-12T17:32:45.462 INFO:tasks.workunit.client.0.smithi037.stderr: -188> 2024-09-12T17:32:45.157+0000 7f62ea542800 1 librados: starting objecter 2024-09-12T17:32:45.462 INFO:tasks.workunit.client.0.smithi037.stderr: -187> 2024-09-12T17:32:45.157+0000 7f62ea542800 5 asok(0x559a91ed1730) register_command objecter_requests cmddesc objecter_requests hook 0x559a92171d50 EEXIST 2024-09-12T17:32:45.462 INFO:tasks.workunit.client.0.smithi037.stderr: -186> 2024-09-12T17:32:45.157+0000 7f62ea542800 1 librados: setting wanted keys 2024-09-12T17:32:45.462 INFO:tasks.workunit.client.0.smithi037.stderr: -185> 2024-09-12T17:32:45.157+0000 7f62ea542800 1 librados: calling monclient init 2024-09-12T17:32:45.462 INFO:tasks.workunit.client.0.smithi037.stderr: -184> 2024-09-12T17:32:45.157+0000 7f62ea542800 10 monclient: init 2024-09-12T17:32:45.462 INFO:tasks.workunit.client.0.smithi037.stderr: -183> 2024-09-12T17:32:45.157+0000 7f62ea542800 5 AuthRegistry(0x559a92187ca0) adding auth protocol: cephx 2024-09-12T17:32:45.462 INFO:tasks.workunit.client.0.smithi037.stderr: -182> 2024-09-12T17:32:45.157+0000 7f62ea542800 5 AuthRegistry(0x559a92187ca0) adding auth protocol: cephx 2024-09-12T17:32:45.462 INFO:tasks.workunit.client.0.smithi037.stderr: -181> 2024-09-12T17:32:45.157+0000 7f62ea542800 5 AuthRegistry(0x559a92187ca0) adding auth protocol: cephx 2024-09-12T17:32:45.462 INFO:tasks.workunit.client.0.smithi037.stderr: -180> 2024-09-12T17:32:45.157+0000 7f62ea542800 5 AuthRegistry(0x559a92187ca0) adding con mode: secure 2024-09-12T17:32:45.462 INFO:tasks.workunit.client.0.smithi037.stderr: -179> 2024-09-12T17:32:45.157+0000 7f62ea542800 5 AuthRegistry(0x559a92187ca0) adding con mode: crc 2024-09-12T17:32:45.462 INFO:tasks.workunit.client.0.smithi037.stderr: -178> 2024-09-12T17:32:45.157+0000 7f62ea542800 5 AuthRegistry(0x559a92187ca0) adding con mode: secure 2024-09-12T17:32:45.462 INFO:tasks.workunit.client.0.smithi037.stderr: -177> 2024-09-12T17:32:45.157+0000 7f62ea542800 5 AuthRegistry(0x559a92187ca0) adding con mode: crc 2024-09-12T17:32:45.462 INFO:tasks.workunit.client.0.smithi037.stderr: -176> 2024-09-12T17:32:45.157+0000 7f62ea542800 5 AuthRegistry(0x559a92187ca0) adding con mode: secure 2024-09-12T17:32:45.463 INFO:tasks.workunit.client.0.smithi037.stderr: -175> 2024-09-12T17:32:45.157+0000 7f62ea542800 5 AuthRegistry(0x559a92187ca0) adding con mode: crc 2024-09-12T17:32:45.463 INFO:tasks.workunit.client.0.smithi037.stderr: -174> 2024-09-12T17:32:45.157+0000 7f62ea542800 5 AuthRegistry(0x559a92187ca0) adding con mode: crc 2024-09-12T17:32:45.463 INFO:tasks.workunit.client.0.smithi037.stderr: -173> 2024-09-12T17:32:45.157+0000 7f62ea542800 5 AuthRegistry(0x559a92187ca0) adding con mode: secure 2024-09-12T17:32:45.463 INFO:tasks.workunit.client.0.smithi037.stderr: -172> 2024-09-12T17:32:45.157+0000 7f62ea542800 5 AuthRegistry(0x559a92187ca0) adding con mode: crc 2024-09-12T17:32:45.463 INFO:tasks.workunit.client.0.smithi037.stderr: -171> 2024-09-12T17:32:45.157+0000 7f62ea542800 5 AuthRegistry(0x559a92187ca0) adding con mode: secure 2024-09-12T17:32:45.463 INFO:tasks.workunit.client.0.smithi037.stderr: -170> 2024-09-12T17:32:45.157+0000 7f62ea542800 5 AuthRegistry(0x559a92187ca0) adding con mode: crc 2024-09-12T17:32:45.463 INFO:tasks.workunit.client.0.smithi037.stderr: -169> 2024-09-12T17:32:45.157+0000 7f62ea542800 5 AuthRegistry(0x559a92187ca0) adding con mode: secure 2024-09-12T17:32:45.463 INFO:tasks.workunit.client.0.smithi037.stderr: -168> 2024-09-12T17:32:45.157+0000 7f62ea542800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:32:45.463 INFO:tasks.workunit.client.0.smithi037.stderr: -167> 2024-09-12T17:32:45.158+0000 7f62ea542800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:32:45.463 INFO:tasks.workunit.client.0.smithi037.stderr: -166> 2024-09-12T17:32:45.158+0000 7f62ea542800 5 asok(0x559a91ed1730) register_command rotate-key cmddesc rotate-key hook 0x559a92187de8 EEXIST 2024-09-12T17:32:45.463 INFO:tasks.workunit.client.0.smithi037.stderr: -165> 2024-09-12T17:32:45.158+0000 7f62ea542800 10 monclient: _reopen_session rank -1 2024-09-12T17:32:45.463 INFO:tasks.workunit.client.0.smithi037.stderr: -164> 2024-09-12T17:32:45.158+0000 7f62ea542800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T17:32:45.463 INFO:tasks.workunit.client.0.smithi037.stderr: -163> 2024-09-12T17:32:45.158+0000 7f62ea542800 10 monclient(hunting): picked mon.noname-b con 0x559a92193c70 addr [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] 2024-09-12T17:32:45.464 INFO:tasks.workunit.client.0.smithi037.stderr: -162> 2024-09-12T17:32:45.158+0000 7f62ea542800 10 monclient(hunting): picked mon.noname-a con 0x559a921bf4b0 addr [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] 2024-09-12T17:32:45.464 INFO:tasks.workunit.client.0.smithi037.stderr: -161> 2024-09-12T17:32:45.158+0000 7f62ea542800 10 monclient(hunting): picked mon.noname-c con 0x559a921c42c0 addr [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] 2024-09-12T17:32:45.464 INFO:tasks.workunit.client.0.smithi037.stderr: -160> 2024-09-12T17:32:45.158+0000 7f62ea542800 10 monclient(hunting): start opening mon connection 2024-09-12T17:32:45.464 INFO:tasks.workunit.client.0.smithi037.stderr: -159> 2024-09-12T17:32:45.158+0000 7f62ea542800 10 monclient(hunting): start opening mon connection 2024-09-12T17:32:45.464 INFO:tasks.workunit.client.0.smithi037.stderr: -158> 2024-09-12T17:32:45.158+0000 7f62ea542800 10 monclient(hunting): start opening mon connection 2024-09-12T17:32:45.464 INFO:tasks.workunit.client.0.smithi037.stderr: -157> 2024-09-12T17:32:45.158+0000 7f62ea542800 10 monclient(hunting): _renew_subs 2024-09-12T17:32:45.464 INFO:tasks.workunit.client.0.smithi037.stderr: -156> 2024-09-12T17:32:45.158+0000 7f62ea542800 10 monclient(hunting): authenticate will time out at 2152.755317s 2024-09-12T17:32:45.464 INFO:tasks.workunit.client.0.smithi037.stderr: -155> 2024-09-12T17:32:45.158+0000 7f62e5a85640 10 monclient(hunting): get_auth_request con 0x559a921bf4b0 auth_method 0 2024-09-12T17:32:45.464 INFO:tasks.workunit.client.0.smithi037.stderr: -154> 2024-09-12T17:32:45.158+0000 7f62e5a85640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:32:45.464 INFO:tasks.workunit.client.0.smithi037.stderr: -153> 2024-09-12T17:32:45.158+0000 7f62e5a85640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:32:45.464 INFO:tasks.workunit.client.0.smithi037.stderr: -152> 2024-09-12T17:32:45.158+0000 7f62e5a85640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:32:45.464 INFO:tasks.workunit.client.0.smithi037.stderr: -151> 2024-09-12T17:32:45.158+0000 7f62e6a87640 10 monclient(hunting): get_auth_request con 0x559a921c42c0 auth_method 0 2024-09-12T17:32:45.464 INFO:tasks.workunit.client.0.smithi037.stderr: -150> 2024-09-12T17:32:45.158+0000 7f62e6a87640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:32:45.464 INFO:tasks.workunit.client.0.smithi037.stderr: -149> 2024-09-12T17:32:45.158+0000 7f62e6a87640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:32:45.465 INFO:tasks.workunit.client.0.smithi037.stderr: -148> 2024-09-12T17:32:45.158+0000 7f62e6a87640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:32:45.465 INFO:tasks.workunit.client.0.smithi037.stderr: -147> 2024-09-12T17:32:45.158+0000 7f62e6286640 10 monclient(hunting): get_auth_request con 0x559a92193c70 auth_method 0 2024-09-12T17:32:45.465 INFO:tasks.workunit.client.0.smithi037.stderr: -146> 2024-09-12T17:32:45.158+0000 7f62e6286640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:32:45.465 INFO:tasks.workunit.client.0.smithi037.stderr: -145> 2024-09-12T17:32:45.158+0000 7f62e6286640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:32:45.465 INFO:tasks.workunit.client.0.smithi037.stderr: -144> 2024-09-12T17:32:45.158+0000 7f62e6286640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:32:45.465 INFO:tasks.workunit.client.0.smithi037.stderr: -143> 2024-09-12T17:32:45.158+0000 7f62e5a85640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:32:45.465 INFO:tasks.workunit.client.0.smithi037.stderr: -142> 2024-09-12T17:32:45.158+0000 7f62e5a85640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:32:45.465 INFO:tasks.workunit.client.0.smithi037.stderr: -141> 2024-09-12T17:32:45.158+0000 7f62e5a85640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:32:45.465 INFO:tasks.workunit.client.0.smithi037.stderr: -140> 2024-09-12T17:32:45.158+0000 7f62e6a87640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:32:45.465 INFO:tasks.workunit.client.0.smithi037.stderr: -139> 2024-09-12T17:32:45.158+0000 7f62e6a87640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:32:45.465 INFO:tasks.workunit.client.0.smithi037.stderr: -138> 2024-09-12T17:32:45.158+0000 7f62e6a87640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:32:45.465 INFO:tasks.workunit.client.0.smithi037.stderr: -137> 2024-09-12T17:32:45.158+0000 7f62e6286640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:32:45.465 INFO:tasks.workunit.client.0.smithi037.stderr: -136> 2024-09-12T17:32:45.158+0000 7f62e6286640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:32:45.466 INFO:tasks.workunit.client.0.smithi037.stderr: -135> 2024-09-12T17:32:45.158+0000 7f62e6286640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:32:45.466 INFO:tasks.workunit.client.0.smithi037.stderr: -134> 2024-09-12T17:32:45.158+0000 7f62e5a85640 10 monclient(hunting): handle_auth_done global_id 6654 payload 824 2024-09-12T17:32:45.466 INFO:tasks.workunit.client.0.smithi037.stderr: -133> 2024-09-12T17:32:45.158+0000 7f62e5a85640 10 monclient: _finish_hunting 0 2024-09-12T17:32:45.466 INFO:tasks.workunit.client.0.smithi037.stderr: -132> 2024-09-12T17:32:45.158+0000 7f62e5a85640 1 monclient: found mon.noname-a 2024-09-12T17:32:45.466 INFO:tasks.workunit.client.0.smithi037.stderr: -131> 2024-09-12T17:32:45.158+0000 7f62e5a85640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.37:3300/0 2024-09-12T17:32:45.466 INFO:tasks.workunit.client.0.smithi037.stderr: -130> 2024-09-12T17:32:45.158+0000 7f61b7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:32:45.466 INFO:tasks.workunit.client.0.smithi037.stderr: -129> 2024-09-12T17:32:45.158+0000 7f61b7fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:32:45.466 INFO:tasks.workunit.client.0.smithi037.stderr: -128> 2024-09-12T17:32:45.158+0000 7f61b7fff640 10 monclient: dump: 2024-09-12T17:32:45.466 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:32:45.466 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:32:45.466 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:32:45.466 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:32:45.466 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:32:45.467 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:32:45.467 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:32:45.467 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:32:45.467 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:32:45.467 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:32:45.467 INFO:tasks.workunit.client.0.smithi037.stderr: -127> 2024-09-12T17:32:45.158+0000 7f61b7fff640 10 monclient: _finish_auth 0 2024-09-12T17:32:45.467 INFO:tasks.workunit.client.0.smithi037.stderr: -126> 2024-09-12T17:32:45.158+0000 7f61b7fff640 10 monclient: _check_auth_tickets 2024-09-12T17:32:45.467 INFO:tasks.workunit.client.0.smithi037.stderr: -125> 2024-09-12T17:32:45.158+0000 7f61b7fff640 10 monclient: handle_config config(0 keys) 2024-09-12T17:32:45.467 INFO:tasks.workunit.client.0.smithi037.stderr: -124> 2024-09-12T17:32:45.158+0000 7f61b7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:32:45.467 INFO:tasks.workunit.client.0.smithi037.stderr: -123> 2024-09-12T17:32:45.158+0000 7f61b7fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:32:45.467 INFO:tasks.workunit.client.0.smithi037.stderr: -122> 2024-09-12T17:32:45.158+0000 7f61b7fff640 10 monclient: dump: 2024-09-12T17:32:45.467 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:32:45.467 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:32:45.467 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:32:45.468 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:32:45.468 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:32:45.468 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:32:45.468 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:32:45.468 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:32:45.468 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:32:45.468 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:32:45.468 INFO:tasks.workunit.client.0.smithi037.stderr: -121> 2024-09-12T17:32:45.158+0000 7f62ea542800 5 monclient: authenticate success, global_id 6654 2024-09-12T17:32:45.468 INFO:tasks.workunit.client.0.smithi037.stderr: -120> 2024-09-12T17:32:45.158+0000 7f61c9ffb640 4 set_mon_vals no callback set 2024-09-12T17:32:45.468 INFO:tasks.workunit.client.0.smithi037.stderr: -119> 2024-09-12T17:32:45.158+0000 7f62ea542800 10 monclient: _renew_subs 2024-09-12T17:32:45.468 INFO:tasks.workunit.client.0.smithi037.stderr: -118> 2024-09-12T17:32:45.158+0000 7f62ea542800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.37:3300/0 2024-09-12T17:32:45.468 INFO:tasks.workunit.client.0.smithi037.stderr: -117> 2024-09-12T17:32:45.159+0000 7f62ea542800 10 monclient: _renew_subs 2024-09-12T17:32:45.468 INFO:tasks.workunit.client.0.smithi037.stderr: -116> 2024-09-12T17:32:45.159+0000 7f62ea542800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.37:3300/0 2024-09-12T17:32:45.469 INFO:tasks.workunit.client.0.smithi037.stderr: -115> 2024-09-12T17:32:45.159+0000 7f62ea542800 1 librados: init done 2024-09-12T17:32:45.469 INFO:tasks.workunit.client.0.smithi037.stderr: -114> 2024-09-12T17:32:45.159+0000 7f62ea542800 5 asok(0x559a91ed1730) register_command cr dump hook 0x559a921bcb08 2024-09-12T17:32:45.469 INFO:tasks.workunit.client.0.smithi037.stderr: -113> 2024-09-12T17:32:45.160+0000 7f62ea542800 20 rados->read ofs=0 len=0 2024-09-12T17:32:45.469 INFO:tasks.workunit.client.0.smithi037.stderr: -112> 2024-09-12T17:32:45.161+0000 7f61b7fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:32:45.469 INFO:tasks.workunit.client.0.smithi037.stderr: -111> 2024-09-12T17:32:45.161+0000 7f61b7fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.40:6816/3916250676,v1:172.21.15.40:6817/3916250676] 2024-09-12T17:32:45.469 INFO:tasks.workunit.client.0.smithi037.stderr: -110> 2024-09-12T17:32:45.161+0000 7f61b7fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.40:6816/3916250676,v1:172.21.15.40:6817/3916250676] 2024-09-12T17:32:45.469 INFO:tasks.workunit.client.0.smithi037.stderr: -109> 2024-09-12T17:32:45.161+0000 7f62e6286640 10 monclient: get_auth_request con 0x7f61b00764a0 auth_method 0 2024-09-12T17:32:45.469 INFO:tasks.workunit.client.0.smithi037.stderr: -108> 2024-09-12T17:32:45.161+0000 7f62e6a87640 10 monclient: get_auth_request con 0x559a921ddde0 auth_method 0 2024-09-12T17:32:45.469 INFO:tasks.workunit.client.0.smithi037.stderr: -107> 2024-09-12T17:32:45.162+0000 7f62ea542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:45.469 INFO:tasks.workunit.client.0.smithi037.stderr: -106> 2024-09-12T17:32:45.162+0000 7f62ea542800 20 realm 2024-09-12T17:32:45.469 INFO:tasks.workunit.client.0.smithi037.stderr: -105> 2024-09-12T17:32:45.162+0000 7f62ea542800 20 rados->read ofs=0 len=0 2024-09-12T17:32:45.469 INFO:tasks.workunit.client.0.smithi037.stderr: -104> 2024-09-12T17:32:45.162+0000 7f62ea542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:45.470 INFO:tasks.workunit.client.0.smithi037.stderr: -103> 2024-09-12T17:32:45.162+0000 7f62ea542800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:32:45.470 INFO:tasks.workunit.client.0.smithi037.stderr: -102> 2024-09-12T17:32:45.162+0000 7f62ea542800 20 rados->read ofs=0 len=0 2024-09-12T17:32:45.470 INFO:tasks.workunit.client.0.smithi037.stderr: -101> 2024-09-12T17:32:45.162+0000 7f62ea542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:45.470 INFO:tasks.workunit.client.0.smithi037.stderr: -100> 2024-09-12T17:32:45.162+0000 7f62ea542800 20 rados->read ofs=0 len=0 2024-09-12T17:32:45.470 INFO:tasks.workunit.client.0.smithi037.stderr: -99> 2024-09-12T17:32:45.162+0000 7f62e6286640 10 monclient: get_auth_request con 0x559a921e2180 auth_method 0 2024-09-12T17:32:45.470 INFO:tasks.workunit.client.0.smithi037.stderr: -98> 2024-09-12T17:32:45.163+0000 7f62ea542800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:45.470 INFO:tasks.workunit.client.0.smithi037.stderr: -97> 2024-09-12T17:32:45.163+0000 7f62ea542800 20 rados->read ofs=0 len=0 2024-09-12T17:32:45.470 INFO:tasks.workunit.client.0.smithi037.stderr: -96> 2024-09-12T17:32:45.163+0000 7f62ea542800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:32:45.470 INFO:tasks.workunit.client.0.smithi037.stderr: -95> 2024-09-12T17:32:45.163+0000 7f62ea542800 20 searching for the correct realm 2024-09-12T17:32:45.470 INFO:tasks.workunit.client.0.smithi037.stderr: -94> 2024-09-12T17:32:45.164+0000 7f62e5a85640 10 monclient: get_auth_request con 0x559a921e7290 auth_method 0 2024-09-12T17:32:45.470 INFO:tasks.workunit.client.0.smithi037.stderr: -93> 2024-09-12T17:32:45.164+0000 7f62e6a87640 10 monclient: get_auth_request con 0x7f62d0035030 auth_method 0 2024-09-12T17:32:45.470 INFO:tasks.workunit.client.0.smithi037.stderr: -92> 2024-09-12T17:32:45.165+0000 7f62e6286640 10 monclient: get_auth_request con 0x7f62e0056420 auth_method 0 2024-09-12T17:32:45.470 INFO:tasks.workunit.client.0.smithi037.stderr: -91> 2024-09-12T17:32:45.166+0000 7f62e5a85640 10 monclient: get_auth_request con 0x7f62d8086a90 auth_method 0 2024-09-12T17:32:45.471 INFO:tasks.workunit.client.0.smithi037.stderr: -90> 2024-09-12T17:32:45.166+0000 7f62e6a87640 0 -- 172.21.15.37:0/1799390293 >> [v2:172.21.15.40:6818/1210108009,v1:172.21.15.40:6819/1210108009] conn(0x7f62d0035030 msgr2=0x7f62d00a5a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:32:45.471 INFO:tasks.workunit.client.0.smithi037.stderr: -89> 2024-09-12T17:32:45.166+0000 7f61b7fff640 1 client.6654.objecter ms_handle_reset 0x7f62d0035030 session 0x7f62d006d070 osd.7 2024-09-12T17:32:45.471 INFO:tasks.workunit.client.0.smithi037.stderr: -88> 2024-09-12T17:32:45.166+0000 7f61b7fff640 10 monclient: _renew_subs 2024-09-12T17:32:45.471 INFO:tasks.workunit.client.0.smithi037.stderr: -87> 2024-09-12T17:32:45.166+0000 7f61b7fff640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.37:3300/0 2024-09-12T17:32:45.471 INFO:tasks.workunit.client.0.smithi037.stderr: -86> 2024-09-12T17:32:45.166+0000 7f62e6a87640 10 monclient: get_auth_request con 0x7f61b0086b40 auth_method 0 2024-09-12T17:32:45.471 INFO:tasks.workunit.client.0.smithi037.stderr: -85> 2024-09-12T17:32:45.168+0000 7f62e6a87640 10 monclient: get_auth_request con 0x7f62d001f070 auth_method 0 2024-09-12T17:32:45.471 INFO:tasks.workunit.client.0.smithi037.stderr: -84> 2024-09-12T17:32:45.170+0000 7f62e6286640 10 monclient: get_auth_request con 0x7f62d00018c0 auth_method 0 2024-09-12T17:32:45.471 INFO:tasks.workunit.client.0.smithi037.stderr: -83> 2024-09-12T17:32:45.170+0000 7f62e6286640 0 -- 172.21.15.37:0/1799390293 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7f62d00018c0 msgr2=0x7f62d002a9e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:32:45.471 INFO:tasks.workunit.client.0.smithi037.stderr: -82> 2024-09-12T17:32:45.372+0000 7f62e6286640 10 monclient: get_auth_request con 0x7f62d00018c0 auth_method 0 2024-09-12T17:32:45.471 INFO:tasks.workunit.client.0.smithi037.stderr: -81> 2024-09-12T17:32:45.377+0000 7f62ea542800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:32:45.471 INFO:tasks.workunit.client.0.smithi037.stderr: -80> 2024-09-12T17:32:45.377+0000 7f62ea542800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:32:45.471 INFO:tasks.workunit.client.0.smithi037.stderr: -79> 2024-09-12T17:32:45.377+0000 7f62ea542800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:32:45.471 INFO:tasks.workunit.client.0.smithi037.stderr: -78> 2024-09-12T17:32:45.377+0000 7f62ea542800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:32:45.471 INFO:tasks.workunit.client.0.smithi037.stderr: -77> 2024-09-12T17:32:45.377+0000 7f62ea542800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:32:45.472 INFO:tasks.workunit.client.0.smithi037.stderr: -76> 2024-09-12T17:32:45.377+0000 7f62ea542800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:32:45.472 INFO:tasks.workunit.client.0.smithi037.stderr: -75> 2024-09-12T17:32:45.377+0000 7f62ea542800 20 rados->read ofs=0 len=0 2024-09-12T17:32:45.472 INFO:tasks.workunit.client.0.smithi037.stderr: -74> 2024-09-12T17:32:45.377+0000 7f62ea542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:45.472 INFO:tasks.workunit.client.0.smithi037.stderr: -73> 2024-09-12T17:32:45.377+0000 7f62ea542800 20 rados->read ofs=0 len=0 2024-09-12T17:32:45.472 INFO:tasks.workunit.client.0.smithi037.stderr: -72> 2024-09-12T17:32:45.377+0000 7f62ea542800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:45.472 INFO:tasks.workunit.client.0.smithi037.stderr: -71> 2024-09-12T17:32:45.377+0000 7f62ea542800 20 rados->read ofs=0 len=0 2024-09-12T17:32:45.472 INFO:tasks.workunit.client.0.smithi037.stderr: -70> 2024-09-12T17:32:45.377+0000 7f62ea542800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:32:45.472 INFO:tasks.workunit.client.0.smithi037.stderr: -69> 2024-09-12T17:32:45.377+0000 7f62ea542800 20 zone default found 2024-09-12T17:32:45.472 INFO:tasks.workunit.client.0.smithi037.stderr: -68> 2024-09-12T17:32:45.378+0000 7f62ea542800 4 Realm: () 2024-09-12T17:32:45.472 INFO:tasks.workunit.client.0.smithi037.stderr: -67> 2024-09-12T17:32:45.378+0000 7f62ea542800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:32:45.472 INFO:tasks.workunit.client.0.smithi037.stderr: -66> 2024-09-12T17:32:45.378+0000 7f62ea542800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:32:45.472 INFO:tasks.workunit.client.0.smithi037.stderr: -65> 2024-09-12T17:32:45.378+0000 7f62ea542800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:32:45.472 INFO:tasks.workunit.client.0.smithi037.stderr: -64> 2024-09-12T17:32:45.378+0000 7f62ea542800 20 zonegroup default 2024-09-12T17:32:45.473 INFO:tasks.workunit.client.0.smithi037.stderr: -63> 2024-09-12T17:32:45.378+0000 7f62ea542800 20 rados->read ofs=0 len=0 2024-09-12T17:32:45.473 INFO:tasks.workunit.client.0.smithi037.stderr: -62> 2024-09-12T17:32:45.378+0000 7f62ea542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:45.473 INFO:tasks.workunit.client.0.smithi037.stderr: -61> 2024-09-12T17:32:45.378+0000 7f62ea542800 20 rados->read ofs=0 len=0 2024-09-12T17:32:45.473 INFO:tasks.workunit.client.0.smithi037.stderr: -60> 2024-09-12T17:32:45.378+0000 7f62ea542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:45.473 INFO:tasks.workunit.client.0.smithi037.stderr: -59> 2024-09-12T17:32:45.378+0000 7f62ea542800 20 rados->read ofs=0 len=0 2024-09-12T17:32:45.473 INFO:tasks.workunit.client.0.smithi037.stderr: -58> 2024-09-12T17:32:45.379+0000 7f62ea542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:45.473 INFO:tasks.workunit.client.0.smithi037.stderr: -57> 2024-09-12T17:32:45.379+0000 7f62ea542800 20 started sync module instance, tier type = 2024-09-12T17:32:45.473 INFO:tasks.workunit.client.0.smithi037.stderr: -56> 2024-09-12T17:32:45.379+0000 7f62ea542800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:32:45.473 INFO:tasks.workunit.client.0.smithi037.stderr: -55> 2024-09-12T17:32:45.388+0000 7f62ea542800 20 add_watcher() i=0 2024-09-12T17:32:45.473 INFO:tasks.workunit.client.0.smithi037.stderr: -54> 2024-09-12T17:32:45.388+0000 7f62ea542800 20 add_watcher() i=1 2024-09-12T17:32:45.473 INFO:tasks.workunit.client.0.smithi037.stderr: -53> 2024-09-12T17:32:45.388+0000 7f62ea542800 20 add_watcher() i=2 2024-09-12T17:32:45.473 INFO:tasks.workunit.client.0.smithi037.stderr: -52> 2024-09-12T17:32:45.388+0000 7f62ea542800 20 add_watcher() i=3 2024-09-12T17:32:45.473 INFO:tasks.workunit.client.0.smithi037.stderr: -51> 2024-09-12T17:32:45.388+0000 7f62ea542800 20 add_watcher() i=4 2024-09-12T17:32:45.474 INFO:tasks.workunit.client.0.smithi037.stderr: -50> 2024-09-12T17:32:45.388+0000 7f62ea542800 20 add_watcher() i=5 2024-09-12T17:32:45.474 INFO:tasks.workunit.client.0.smithi037.stderr: -49> 2024-09-12T17:32:45.388+0000 7f62ea542800 20 add_watcher() i=6 2024-09-12T17:32:45.474 INFO:tasks.workunit.client.0.smithi037.stderr: -48> 2024-09-12T17:32:45.389+0000 7f62ea542800 20 add_watcher() i=7 2024-09-12T17:32:45.474 INFO:tasks.workunit.client.0.smithi037.stderr: -47> 2024-09-12T17:32:45.389+0000 7f62ea542800 2 all 8 watchers are set, enabling cache 2024-09-12T17:32:45.474 INFO:tasks.workunit.client.0.smithi037.stderr: -46> 2024-09-12T17:32:45.391+0000 7f62ea542800 5 AuthRegistry(0x7fff16f1c3a0) adding auth protocol: cephx 2024-09-12T17:32:45.474 INFO:tasks.workunit.client.0.smithi037.stderr: -45> 2024-09-12T17:32:45.391+0000 7f62ea542800 5 AuthRegistry(0x7fff16f1c3a0) adding auth protocol: cephx 2024-09-12T17:32:45.474 INFO:tasks.workunit.client.0.smithi037.stderr: -44> 2024-09-12T17:32:45.391+0000 7f62ea542800 5 AuthRegistry(0x7fff16f1c3a0) adding auth protocol: cephx 2024-09-12T17:32:45.474 INFO:tasks.workunit.client.0.smithi037.stderr: -43> 2024-09-12T17:32:45.391+0000 7f62ea542800 5 AuthRegistry(0x7fff16f1c3a0) adding con mode: secure 2024-09-12T17:32:45.474 INFO:tasks.workunit.client.0.smithi037.stderr: -42> 2024-09-12T17:32:45.391+0000 7f62ea542800 5 AuthRegistry(0x7fff16f1c3a0) adding con mode: crc 2024-09-12T17:32:45.474 INFO:tasks.workunit.client.0.smithi037.stderr: -41> 2024-09-12T17:32:45.391+0000 7f62ea542800 5 AuthRegistry(0x7fff16f1c3a0) adding con mode: secure 2024-09-12T17:32:45.474 INFO:tasks.workunit.client.0.smithi037.stderr: -40> 2024-09-12T17:32:45.391+0000 7f62ea542800 5 AuthRegistry(0x7fff16f1c3a0) adding con mode: crc 2024-09-12T17:32:45.474 INFO:tasks.workunit.client.0.smithi037.stderr: -39> 2024-09-12T17:32:45.391+0000 7f62ea542800 5 AuthRegistry(0x7fff16f1c3a0) adding con mode: secure 2024-09-12T17:32:45.474 INFO:tasks.workunit.client.0.smithi037.stderr: -38> 2024-09-12T17:32:45.391+0000 7f62ea542800 5 AuthRegistry(0x7fff16f1c3a0) adding con mode: crc 2024-09-12T17:32:45.475 INFO:tasks.workunit.client.0.smithi037.stderr: -37> 2024-09-12T17:32:45.391+0000 7f62ea542800 5 AuthRegistry(0x7fff16f1c3a0) adding con mode: crc 2024-09-12T17:32:45.475 INFO:tasks.workunit.client.0.smithi037.stderr: -36> 2024-09-12T17:32:45.391+0000 7f62ea542800 5 AuthRegistry(0x7fff16f1c3a0) adding con mode: secure 2024-09-12T17:32:45.475 INFO:tasks.workunit.client.0.smithi037.stderr: -35> 2024-09-12T17:32:45.391+0000 7f62ea542800 5 AuthRegistry(0x7fff16f1c3a0) adding con mode: crc 2024-09-12T17:32:45.475 INFO:tasks.workunit.client.0.smithi037.stderr: -34> 2024-09-12T17:32:45.391+0000 7f62ea542800 5 AuthRegistry(0x7fff16f1c3a0) adding con mode: secure 2024-09-12T17:32:45.475 INFO:tasks.workunit.client.0.smithi037.stderr: -33> 2024-09-12T17:32:45.391+0000 7f62ea542800 5 AuthRegistry(0x7fff16f1c3a0) adding con mode: crc 2024-09-12T17:32:45.475 INFO:tasks.workunit.client.0.smithi037.stderr: -32> 2024-09-12T17:32:45.391+0000 7f62ea542800 5 AuthRegistry(0x7fff16f1c3a0) adding con mode: secure 2024-09-12T17:32:45.475 INFO:tasks.workunit.client.0.smithi037.stderr: -31> 2024-09-12T17:32:45.391+0000 7f619cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:32:45.475 INFO:tasks.workunit.client.0.smithi037.stderr: -30> 2024-09-12T17:32:45.391+0000 7f62ea542800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:32:45.475 INFO:tasks.workunit.client.0.smithi037.stderr: -29> 2024-09-12T17:32:45.391+0000 7f62ea542800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:32:45.475 INFO:tasks.workunit.client.0.smithi037.stderr: -28> 2024-09-12T17:32:45.391+0000 7f62ea542800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:32:45.475 INFO:tasks.workunit.client.0.smithi037.stderr: -27> 2024-09-12T17:32:45.391+0000 7f62ea542800 5 asok(0x559a91ed1730) register_command cache list hook 0x559a921b93f0 2024-09-12T17:32:45.475 INFO:tasks.workunit.client.0.smithi037.stderr: -26> 2024-09-12T17:32:45.391+0000 7f62ea542800 5 asok(0x559a91ed1730) register_command cache inspect hook 0x559a921b93f0 2024-09-12T17:32:45.475 INFO:tasks.workunit.client.0.smithi037.stderr: -25> 2024-09-12T17:32:45.391+0000 7f62ea542800 5 asok(0x559a91ed1730) register_command cache erase hook 0x559a921b93f0 2024-09-12T17:32:45.476 INFO:tasks.workunit.client.0.smithi037.stderr: -24> 2024-09-12T17:32:45.391+0000 7f62ea542800 5 asok(0x559a91ed1730) register_command cache zap hook 0x559a921b93f0 2024-09-12T17:32:45.476 INFO:tasks.workunit.client.0.smithi037.stderr: -23> 2024-09-12T17:32:45.391+0000 7f62ea542800 5 note: GC not initialized 2024-09-12T17:32:45.476 INFO:tasks.workunit.client.0.smithi037.stderr: -22> 2024-09-12T17:32:45.392+0000 7f61177fe640 20 reqs_thread_entry: start 2024-09-12T17:32:45.476 INFO:tasks.workunit.client.0.smithi037.stderr: -21> 2024-09-12T17:32:45.392+0000 7f62ea542800 5 asok(0x559a91ed1730) register_command sync trace show hook 0x7f62e0004ee0 2024-09-12T17:32:45.476 INFO:tasks.workunit.client.0.smithi037.stderr: -20> 2024-09-12T17:32:45.392+0000 7f62ea542800 5 asok(0x559a91ed1730) register_command sync trace history hook 0x7f62e0004ee0 2024-09-12T17:32:45.476 INFO:tasks.workunit.client.0.smithi037.stderr: -19> 2024-09-12T17:32:45.392+0000 7f62ea542800 5 asok(0x559a91ed1730) register_command sync trace active hook 0x7f62e0004ee0 2024-09-12T17:32:45.476 INFO:tasks.workunit.client.0.smithi037.stderr: -18> 2024-09-12T17:32:45.392+0000 7f62ea542800 5 asok(0x559a91ed1730) register_command sync trace active_short hook 0x7f62e0004ee0 2024-09-12T17:32:45.476 INFO:tasks.workunit.client.0.smithi037.stderr: -17> 2024-09-12T17:32:45.392+0000 7f62ea542800 20 init_complete bucket index max shards: 11 2024-09-12T17:32:45.476 INFO:tasks.workunit.client.0.smithi037.stderr: -16> 2024-09-12T17:32:45.392+0000 7f62ea542800 20 Filter name: none 2024-09-12T17:32:45.476 INFO:tasks.workunit.client.0.smithi037.stderr: -15> 2024-09-12T17:32:45.392+0000 7f61157fa640 20 reqs_thread_entry: start 2024-09-12T17:32:45.476 INFO:tasks.workunit.client.0.smithi037.stderr: -14> 2024-09-12T17:32:45.392+0000 7f62ea542800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-12T17:32:45.476 INFO:tasks.workunit.client.0.smithi037.stderr: -13> 2024-09-12T17:32:45.392+0000 7f62ea542800 20 rados->read ofs=0 len=0 2024-09-12T17:32:45.476 INFO:tasks.workunit.client.0.smithi037.stderr: -12> 2024-09-12T17:32:45.393+0000 7f62ea542800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T17:32:45.477 INFO:tasks.workunit.client.0.smithi037.stderr: -11> 2024-09-12T17:32:45.393+0000 7f62ea542800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-12T17:32:45.477 INFO:tasks.workunit.client.0.smithi037.stderr: -10> 2024-09-12T17:32:45.393+0000 7f62ea542800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-12T17:32:45.477 INFO:tasks.workunit.client.0.smithi037.stderr: -9> 2024-09-12T17:32:45.393+0000 7f62ea542800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.25 : miss 2024-09-12T17:32:45.477 INFO:tasks.workunit.client.0.smithi037.stderr: -8> 2024-09-12T17:32:45.393+0000 7f62ea542800 20 rados->read ofs=0 len=0 2024-09-12T17:32:45.477 INFO:tasks.workunit.client.0.smithi037.stderr: -7> 2024-09-12T17:32:45.394+0000 7f62ea542800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T17:32:45.477 INFO:tasks.workunit.client.0.smithi037.stderr: -6> 2024-09-12T17:32:45.394+0000 7f62ea542800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.25 info.flags=0x17 2024-09-12T17:32:45.477 INFO:tasks.workunit.client.0.smithi037.stderr: -5> 2024-09-12T17:32:45.394+0000 7f62ea542800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.25 to cache LRU end 2024-09-12T17:32:45.477 INFO:tasks.workunit.client.0.smithi037.stderr: -4> 2024-09-12T17:32:45.394+0000 7f62ea542800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:32:45.477 INFO:tasks.workunit.client.0.smithi037.stderr: -3> 2024-09-12T17:32:45.394+0000 7f62ea542800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:32:45.477 INFO:tasks.workunit.client.0.smithi037.stderr: -2> 2024-09-12T17:32:45.394+0000 7f62ea542800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.25 2024-09-12T17:32:45.477 INFO:tasks.workunit.client.0.smithi037.stderr: -1> 2024-09-12T17:32:45.399+0000 7f62ea542800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f62ea542800 time 2024-09-12T17:32:45.398941+0000 2024-09-12T17:32:45.477 INFO:tasks.workunit.client.0.smithi037.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:32:45.477 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:32:45.478 INFO:tasks.workunit.client.0.smithi037.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:32:45.478 INFO:tasks.workunit.client.0.smithi037.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f62ebd8c71a] 2024-09-12T17:32:45.478 INFO:tasks.workunit.client.0.smithi037.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f62ebd8c8d8] 2024-09-12T17:32:45.478 INFO:tasks.workunit.client.0.smithi037.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559a91227841] 2024-09-12T17:32:45.478 INFO:tasks.workunit.client.0.smithi037.stderr: 4: radosgw-admin(+0xd73ca8) [0x559a91734ca8] 2024-09-12T17:32:45.478 INFO:tasks.workunit.client.0.smithi037.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x559a9123750d] 2024-09-12T17:32:45.478 INFO:tasks.workunit.client.0.smithi037.stderr: 6: main() 2024-09-12T17:32:45.478 INFO:tasks.workunit.client.0.smithi037.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f62eaa29590] 2024-09-12T17:32:45.478 INFO:tasks.workunit.client.0.smithi037.stderr: 8: __libc_start_main() 2024-09-12T17:32:45.478 INFO:tasks.workunit.client.0.smithi037.stderr: 9: _start() 2024-09-12T17:32:45.478 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:32:45.478 INFO:tasks.workunit.client.0.smithi037.stderr: 0> 2024-09-12T17:32:45.399+0000 7f62ea542800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:32:45.478 INFO:tasks.workunit.client.0.smithi037.stderr: in thread 7f62ea542800 thread_name:radosgw-admin 2024-09-12T17:32:45.478 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:32:45.479 INFO:tasks.workunit.client.0.smithi037.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:32:45.479 INFO:tasks.workunit.client.0.smithi037.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f62eaa3e6f0] 2024-09-12T17:32:45.479 INFO:tasks.workunit.client.0.smithi037.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f62eaa8b99c] 2024-09-12T17:32:45.479 INFO:tasks.workunit.client.0.smithi037.stderr: 3: raise() 2024-09-12T17:32:45.479 INFO:tasks.workunit.client.0.smithi037.stderr: 4: abort() 2024-09-12T17:32:45.479 INFO:tasks.workunit.client.0.smithi037.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f62ebd8c774] 2024-09-12T17:32:45.479 INFO:tasks.workunit.client.0.smithi037.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f62ebd8c8d8] 2024-09-12T17:32:45.479 INFO:tasks.workunit.client.0.smithi037.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559a91227841] 2024-09-12T17:32:45.479 INFO:tasks.workunit.client.0.smithi037.stderr: 8: radosgw-admin(+0xd73ca8) [0x559a91734ca8] 2024-09-12T17:32:45.479 INFO:tasks.workunit.client.0.smithi037.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x559a9123750d] 2024-09-12T17:32:45.479 INFO:tasks.workunit.client.0.smithi037.stderr: 10: main() 2024-09-12T17:32:45.479 INFO:tasks.workunit.client.0.smithi037.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f62eaa29590] 2024-09-12T17:32:45.479 INFO:tasks.workunit.client.0.smithi037.stderr: 12: __libc_start_main() 2024-09-12T17:32:45.479 INFO:tasks.workunit.client.0.smithi037.stderr: 13: _start() 2024-09-12T17:32:45.480 INFO:tasks.workunit.client.0.smithi037.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:32:45.480 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:32:45.480 INFO:tasks.workunit.client.0.smithi037.stderr:--- logging levels --- 2024-09-12T17:32:45.480 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 none 2024-09-12T17:32:45.480 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 lockdep 2024-09-12T17:32:45.480 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 context 2024-09-12T17:32:45.480 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 1 crush 2024-09-12T17:32:45.480 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mds 2024-09-12T17:32:45.480 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mds_balancer 2024-09-12T17:32:45.480 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mds_locker 2024-09-12T17:32:45.480 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mds_log 2024-09-12T17:32:45.480 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mds_log_expire 2024-09-12T17:32:45.480 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mds_migrator 2024-09-12T17:32:45.481 INFO:tasks.workunit.client.0.smithi037.stderr: 3/ 5 mds_quiesce 2024-09-12T17:32:45.481 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 buffer 2024-09-12T17:32:45.481 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 timer 2024-09-12T17:32:45.481 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 filer 2024-09-12T17:32:45.481 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 striper 2024-09-12T17:32:45.481 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 objecter 2024-09-12T17:32:45.481 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 rados 2024-09-12T17:32:45.481 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 rbd 2024-09-12T17:32:45.481 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 rbd_mirror 2024-09-12T17:32:45.481 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 rbd_replay 2024-09-12T17:32:45.481 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 rbd_pwl 2024-09-12T17:32:45.481 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 journaler 2024-09-12T17:32:45.481 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 objectcacher 2024-09-12T17:32:45.481 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:32:45.482 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 client 2024-09-12T17:32:45.482 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 osd 2024-09-12T17:32:45.482 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 optracker 2024-09-12T17:32:45.482 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 objclass 2024-09-12T17:32:45.482 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 3 filestore 2024-09-12T17:32:45.482 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 3 journal 2024-09-12T17:32:45.482 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 0 ms 2024-09-12T17:32:45.482 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mon 2024-09-12T17:32:45.482 INFO:tasks.workunit.client.0.smithi037.stderr: 0/10 monc 2024-09-12T17:32:45.482 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 paxos 2024-09-12T17:32:45.482 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 tp 2024-09-12T17:32:45.482 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 auth 2024-09-12T17:32:45.482 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 crypto 2024-09-12T17:32:45.482 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 1 finisher 2024-09-12T17:32:45.483 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 1 reserver 2024-09-12T17:32:45.483 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 heartbeatmap 2024-09-12T17:32:45.483 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 perfcounter 2024-09-12T17:32:45.483 INFO:tasks.workunit.client.0.smithi037.stderr: 20/20 rgw 2024-09-12T17:32:45.483 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 rgw_sync 2024-09-12T17:32:45.483 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 rgw_datacache 2024-09-12T17:32:45.483 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 rgw_access 2024-09-12T17:32:45.483 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:32:45.483 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 rgw_flight 2024-09-12T17:32:45.483 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:32:45.483 INFO:tasks.workunit.client.0.smithi037.stderr: 20/20 rgw_notification 2024-09-12T17:32:45.483 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 javaclient 2024-09-12T17:32:45.483 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 asok 2024-09-12T17:32:45.484 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 1 throttle 2024-09-12T17:32:45.484 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 0 refs 2024-09-12T17:32:45.484 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 compressor 2024-09-12T17:32:45.484 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 bluestore 2024-09-12T17:32:45.484 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 bluefs 2024-09-12T17:32:45.484 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 3 bdev 2024-09-12T17:32:45.484 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 kstore 2024-09-12T17:32:45.484 INFO:tasks.workunit.client.0.smithi037.stderr: 4/ 5 rocksdb 2024-09-12T17:32:45.484 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 fuse 2024-09-12T17:32:45.484 INFO:tasks.workunit.client.0.smithi037.stderr: 2/ 5 mgr 2024-09-12T17:32:45.484 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mgrc 2024-09-12T17:32:45.484 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 dpdk 2024-09-12T17:32:45.484 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 eventtrace 2024-09-12T17:32:45.484 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 prioritycache 2024-09-12T17:32:45.485 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 test 2024-09-12T17:32:45.485 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:32:45.485 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 cephsqlite 2024-09-12T17:32:45.485 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:32:45.485 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore 2024-09-12T17:32:45.485 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_onode 2024-09-12T17:32:45.485 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_odata 2024-09-12T17:32:45.485 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_omap 2024-09-12T17:32:45.485 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_tm 2024-09-12T17:32:45.485 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_t 2024-09-12T17:32:45.485 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:32:45.485 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_epm 2024-09-12T17:32:45.485 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_lba 2024-09-12T17:32:45.486 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:32:45.486 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_cache 2024-09-12T17:32:45.486 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_journal 2024-09-12T17:32:45.486 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_device 2024-09-12T17:32:45.486 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_backref 2024-09-12T17:32:45.486 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 alienstore 2024-09-12T17:32:45.486 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mclock 2024-09-12T17:32:45.486 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 cyanstore 2024-09-12T17:32:45.486 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 ceph_exporter 2024-09-12T17:32:45.486 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 memstore 2024-09-12T17:32:45.486 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 trace 2024-09-12T17:32:45.486 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 ceph_dedup 2024-09-12T17:32:45.486 INFO:tasks.workunit.client.0.smithi037.stderr: -2/-2 (syslog threshold) 2024-09-12T17:32:45.486 INFO:tasks.workunit.client.0.smithi037.stderr: 99/99 (stderr threshold) 2024-09-12T17:32:45.487 INFO:tasks.workunit.client.0.smithi037.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:32:45.487 INFO:tasks.workunit.client.0.smithi037.stderr: 7f61157fa640 / http_manager 2024-09-12T17:32:45.487 INFO:tasks.workunit.client.0.smithi037.stderr: 7f61177fe640 / http_manager 2024-09-12T17:32:45.487 INFO:tasks.workunit.client.0.smithi037.stderr: 7f619cfe1640 / rgw_dt_lg_renew 2024-09-12T17:32:45.487 INFO:tasks.workunit.client.0.smithi037.stderr: 7f61b7fff640 / ms_dispatch 2024-09-12T17:32:45.487 INFO:tasks.workunit.client.0.smithi037.stderr: 7f61c9ffb640 / io_context_pool 2024-09-12T17:32:45.487 INFO:tasks.workunit.client.0.smithi037.stderr: 7f61cbfff640 / ms_dispatch 2024-09-12T17:32:45.487 INFO:tasks.workunit.client.0.smithi037.stderr: 7f61d2e05640 / ms_dispatch 2024-09-12T17:32:45.487 INFO:tasks.workunit.client.0.smithi037.stderr: 7f61d4608640 / io_context_pool 2024-09-12T17:32:45.487 INFO:tasks.workunit.client.0.smithi037.stderr: 7f62e5a85640 / msgr-worker-2 2024-09-12T17:32:45.487 INFO:tasks.workunit.client.0.smithi037.stderr: 7f62e6286640 / msgr-worker-1 2024-09-12T17:32:45.487 INFO:tasks.workunit.client.0.smithi037.stderr: 7f62e6a87640 / msgr-worker-0 2024-09-12T17:32:45.487 INFO:tasks.workunit.client.0.smithi037.stderr: 7f62e7288640 / io_context_pool 2024-09-12T17:32:45.487 INFO:tasks.workunit.client.0.smithi037.stderr: 7f62ea542800 / radosgw-admin 2024-09-12T17:32:45.488 INFO:tasks.workunit.client.0.smithi037.stderr: max_recent 500 2024-09-12T17:32:45.488 INFO:tasks.workunit.client.0.smithi037.stderr: max_new 1000 2024-09-12T17:32:45.488 INFO:tasks.workunit.client.0.smithi037.stderr: log_file /var/log/ceph/ceph-client.admin.99024.log 2024-09-12T17:32:45.488 INFO:tasks.workunit.client.0.smithi037.stderr:--- end dump of recent events --- 2024-09-12T17:32:45.488 INFO:tasks.workunit.client.0.smithi037.stderr:--- begin dump of recent events --- 2024-09-12T17:32:45.488 INFO:tasks.workunit.client.0.smithi037.stderr: -499> 2024-09-12T17:32:45.143+0000 7f61d4608640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:32:45.488 INFO:tasks.workunit.client.0.smithi037.stderr: -498> 2024-09-12T17:32:45.143+0000 7f61d4608640 10 monclient: dump: 2024-09-12T17:32:45.488 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:32:45.488 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:32:45.488 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:32:45.488 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:32:45.488 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:32:45.488 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:32:45.489 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:32:45.489 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:32:45.489 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:32:45.489 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:32:45.489 INFO:tasks.workunit.client.0.smithi037.stderr: -497> 2024-09-12T17:32:45.143+0000 7f61d4608640 10 monclient: _finish_auth 0 2024-09-12T17:32:45.489 INFO:tasks.workunit.client.0.smithi037.stderr: -496> 2024-09-12T17:32:45.143+0000 7f61d4608640 10 monclient: _check_auth_tickets 2024-09-12T17:32:45.489 INFO:tasks.workunit.client.0.smithi037.stderr: -495> 2024-09-12T17:32:45.143+0000 7f61d4608640 10 monclient: handle_config config(0 keys) 2024-09-12T17:32:45.489 INFO:tasks.workunit.client.0.smithi037.stderr: -494> 2024-09-12T17:32:45.143+0000 7f62ea542800 5 monclient: authenticate success, global_id 6269 2024-09-12T17:32:45.489 INFO:tasks.workunit.client.0.smithi037.stderr: -493> 2024-09-12T17:32:45.143+0000 7f62ea542800 10 monclient: get_monmap_and_config success 2024-09-12T17:32:45.489 INFO:tasks.workunit.client.0.smithi037.stderr: -492> 2024-09-12T17:32:45.143+0000 7f62ea542800 4 set_mon_vals no callback set 2024-09-12T17:32:45.489 INFO:tasks.workunit.client.0.smithi037.stderr: -491> 2024-09-12T17:32:45.143+0000 7f61d4608640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:32:45.489 INFO:tasks.workunit.client.0.smithi037.stderr: -490> 2024-09-12T17:32:45.143+0000 7f61d4608640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:32:45.489 INFO:tasks.workunit.client.0.smithi037.stderr: -489> 2024-09-12T17:32:45.143+0000 7f61d4608640 10 monclient: dump: 2024-09-12T17:32:45.489 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:32:45.490 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:32:45.490 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:32:45.490 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:32:45.490 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:32:45.490 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:32:45.490 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:32:45.490 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:32:45.490 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:32:45.490 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:32:45.490 INFO:tasks.workunit.client.0.smithi037.stderr: -488> 2024-09-12T17:32:45.143+0000 7f62ea542800 10 monclient: shutdown 2024-09-12T17:32:45.490 INFO:tasks.workunit.client.0.smithi037.stderr: -487> 2024-09-12T17:32:45.143+0000 7f62ea542800 5 asok(0x559a91ed1730) unregister_commands rotate-key 2024-09-12T17:32:45.490 INFO:tasks.workunit.client.0.smithi037.stderr: -486> 2024-09-12T17:32:45.143+0000 7f62ea542800 10 monclient: build_initial_monmap 2024-09-12T17:32:45.490 INFO:tasks.workunit.client.0.smithi037.stderr: -485> 2024-09-12T17:32:45.143+0000 7f62ea542800 1 build_initial for_mkfs: 0 2024-09-12T17:32:45.490 INFO:tasks.workunit.client.0.smithi037.stderr: -484> 2024-09-12T17:32:45.143+0000 7f62ea542800 10 monclient: monmap: 2024-09-12T17:32:45.491 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 0 2024-09-12T17:32:45.491 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:32:45.491 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 0.000000 2024-09-12T17:32:45.491 INFO:tasks.workunit.client.0.smithi037.stderr:created 0.000000 2024-09-12T17:32:45.491 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 0 (unknown) 2024-09-12T17:32:45.491 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:32:45.491 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.noname-a 2024-09-12T17:32:45.491 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.noname-b 2024-09-12T17:32:45.491 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.noname-c 2024-09-12T17:32:45.491 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:32:45.491 INFO:tasks.workunit.client.0.smithi037.stderr: -483> 2024-09-12T17:32:45.143+0000 7f62ea542800 5 AuthRegistry(0x559a920f98a0) adding auth protocol: cephx 2024-09-12T17:32:45.491 INFO:tasks.workunit.client.0.smithi037.stderr: -482> 2024-09-12T17:32:45.143+0000 7f62ea542800 5 AuthRegistry(0x559a920f98a0) adding auth protocol: cephx 2024-09-12T17:32:45.491 INFO:tasks.workunit.client.0.smithi037.stderr: -481> 2024-09-12T17:32:45.143+0000 7f62ea542800 5 AuthRegistry(0x559a920f98a0) adding auth protocol: cephx 2024-09-12T17:32:45.491 INFO:tasks.workunit.client.0.smithi037.stderr: -480> 2024-09-12T17:32:45.143+0000 7f62ea542800 5 AuthRegistry(0x559a920f98a0) adding con mode: secure 2024-09-12T17:32:45.492 INFO:tasks.workunit.client.0.smithi037.stderr: -479> 2024-09-12T17:32:45.143+0000 7f62ea542800 5 AuthRegistry(0x559a920f98a0) adding con mode: crc 2024-09-12T17:32:45.492 INFO:tasks.workunit.client.0.smithi037.stderr: -478> 2024-09-12T17:32:45.143+0000 7f62ea542800 5 AuthRegistry(0x559a920f98a0) adding con mode: secure 2024-09-12T17:32:45.492 INFO:tasks.workunit.client.0.smithi037.stderr: -477> 2024-09-12T17:32:45.143+0000 7f62ea542800 5 AuthRegistry(0x559a920f98a0) adding con mode: crc 2024-09-12T17:32:45.492 INFO:tasks.workunit.client.0.smithi037.stderr: -476> 2024-09-12T17:32:45.143+0000 7f62ea542800 5 AuthRegistry(0x559a920f98a0) adding con mode: secure 2024-09-12T17:32:45.492 INFO:tasks.workunit.client.0.smithi037.stderr: -475> 2024-09-12T17:32:45.143+0000 7f62ea542800 5 AuthRegistry(0x559a920f98a0) adding con mode: crc 2024-09-12T17:32:45.492 INFO:tasks.workunit.client.0.smithi037.stderr: -474> 2024-09-12T17:32:45.143+0000 7f62ea542800 5 AuthRegistry(0x559a920f98a0) adding con mode: crc 2024-09-12T17:32:45.492 INFO:tasks.workunit.client.0.smithi037.stderr: -473> 2024-09-12T17:32:45.143+0000 7f62ea542800 5 AuthRegistry(0x559a920f98a0) adding con mode: secure 2024-09-12T17:32:45.492 INFO:tasks.workunit.client.0.smithi037.stderr: -472> 2024-09-12T17:32:45.143+0000 7f62ea542800 5 AuthRegistry(0x559a920f98a0) adding con mode: crc 2024-09-12T17:32:45.492 INFO:tasks.workunit.client.0.smithi037.stderr: -471> 2024-09-12T17:32:45.143+0000 7f62ea542800 5 AuthRegistry(0x559a920f98a0) adding con mode: secure 2024-09-12T17:32:45.492 INFO:tasks.workunit.client.0.smithi037.stderr: -470> 2024-09-12T17:32:45.143+0000 7f62ea542800 5 AuthRegistry(0x559a920f98a0) adding con mode: crc 2024-09-12T17:32:45.492 INFO:tasks.workunit.client.0.smithi037.stderr: -469> 2024-09-12T17:32:45.143+0000 7f62ea542800 5 AuthRegistry(0x559a920f98a0) adding con mode: secure 2024-09-12T17:32:45.492 INFO:tasks.workunit.client.0.smithi037.stderr: -468> 2024-09-12T17:32:45.144+0000 7f62ea542800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:32:45.492 INFO:tasks.workunit.client.0.smithi037.stderr: -467> 2024-09-12T17:32:45.144+0000 7f62ea542800 1 librados: starting msgr at 2024-09-12T17:32:45.492 INFO:tasks.workunit.client.0.smithi037.stderr: -466> 2024-09-12T17:32:45.144+0000 7f62ea542800 1 librados: starting objecter 2024-09-12T17:32:45.493 INFO:tasks.workunit.client.0.smithi037.stderr: -465> 2024-09-12T17:32:45.144+0000 7f62ea542800 5 asok(0x559a91ed1730) register_command objecter_requests hook 0x559a920fafe0 2024-09-12T17:32:45.493 INFO:tasks.workunit.client.0.smithi037.stderr: -464> 2024-09-12T17:32:45.144+0000 7f62ea542800 1 librados: setting wanted keys 2024-09-12T17:32:45.493 INFO:tasks.workunit.client.0.smithi037.stderr: -463> 2024-09-12T17:32:45.144+0000 7f62ea542800 1 librados: calling monclient init 2024-09-12T17:32:45.493 INFO:tasks.workunit.client.0.smithi037.stderr: -462> 2024-09-12T17:32:45.144+0000 7f62ea542800 10 monclient: init 2024-09-12T17:32:45.493 INFO:tasks.workunit.client.0.smithi037.stderr: -461> 2024-09-12T17:32:45.144+0000 7f62ea542800 5 AuthRegistry(0x559a920f42e0) adding auth protocol: cephx 2024-09-12T17:32:45.493 INFO:tasks.workunit.client.0.smithi037.stderr: -460> 2024-09-12T17:32:45.144+0000 7f62ea542800 5 AuthRegistry(0x559a920f42e0) adding auth protocol: cephx 2024-09-12T17:32:45.493 INFO:tasks.workunit.client.0.smithi037.stderr: -459> 2024-09-12T17:32:45.144+0000 7f62ea542800 5 AuthRegistry(0x559a920f42e0) adding auth protocol: cephx 2024-09-12T17:32:45.493 INFO:tasks.workunit.client.0.smithi037.stderr: -458> 2024-09-12T17:32:45.144+0000 7f62ea542800 5 AuthRegistry(0x559a920f42e0) adding con mode: secure 2024-09-12T17:32:45.493 INFO:tasks.workunit.client.0.smithi037.stderr: -457> 2024-09-12T17:32:45.144+0000 7f62ea542800 5 AuthRegistry(0x559a920f42e0) adding con mode: crc 2024-09-12T17:32:45.493 INFO:tasks.workunit.client.0.smithi037.stderr: -456> 2024-09-12T17:32:45.144+0000 7f62ea542800 5 AuthRegistry(0x559a920f42e0) adding con mode: secure 2024-09-12T17:32:45.493 INFO:tasks.workunit.client.0.smithi037.stderr: -455> 2024-09-12T17:32:45.144+0000 7f62ea542800 5 AuthRegistry(0x559a920f42e0) adding con mode: crc 2024-09-12T17:32:45.493 INFO:tasks.workunit.client.0.smithi037.stderr: -454> 2024-09-12T17:32:45.144+0000 7f62ea542800 5 AuthRegistry(0x559a920f42e0) adding con mode: secure 2024-09-12T17:32:45.493 INFO:tasks.workunit.client.0.smithi037.stderr: -453> 2024-09-12T17:32:45.144+0000 7f62ea542800 5 AuthRegistry(0x559a920f42e0) adding con mode: crc 2024-09-12T17:32:45.493 INFO:tasks.workunit.client.0.smithi037.stderr: -452> 2024-09-12T17:32:45.144+0000 7f62ea542800 5 AuthRegistry(0x559a920f42e0) adding con mode: crc 2024-09-12T17:32:45.494 INFO:tasks.workunit.client.0.smithi037.stderr: -451> 2024-09-12T17:32:45.144+0000 7f62ea542800 5 AuthRegistry(0x559a920f42e0) adding con mode: secure 2024-09-12T17:32:45.494 INFO:tasks.workunit.client.0.smithi037.stderr: -450> 2024-09-12T17:32:45.144+0000 7f62ea542800 5 AuthRegistry(0x559a920f42e0) adding con mode: crc 2024-09-12T17:32:45.494 INFO:tasks.workunit.client.0.smithi037.stderr: -449> 2024-09-12T17:32:45.144+0000 7f62ea542800 5 AuthRegistry(0x559a920f42e0) adding con mode: secure 2024-09-12T17:32:45.494 INFO:tasks.workunit.client.0.smithi037.stderr: -448> 2024-09-12T17:32:45.144+0000 7f62ea542800 5 AuthRegistry(0x559a920f42e0) adding con mode: crc 2024-09-12T17:32:45.494 INFO:tasks.workunit.client.0.smithi037.stderr: -447> 2024-09-12T17:32:45.144+0000 7f62ea542800 5 AuthRegistry(0x559a920f42e0) adding con mode: secure 2024-09-12T17:32:45.494 INFO:tasks.workunit.client.0.smithi037.stderr: -446> 2024-09-12T17:32:45.144+0000 7f62ea542800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:32:45.494 INFO:tasks.workunit.client.0.smithi037.stderr: -445> 2024-09-12T17:32:45.144+0000 7f62ea542800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:32:45.494 INFO:tasks.workunit.client.0.smithi037.stderr: -444> 2024-09-12T17:32:45.144+0000 7f62ea542800 5 asok(0x559a91ed1730) register_command rotate-key hook 0x559a920f4428 2024-09-12T17:32:45.494 INFO:tasks.workunit.client.0.smithi037.stderr: -443> 2024-09-12T17:32:45.144+0000 7f62ea542800 10 monclient: _reopen_session rank -1 2024-09-12T17:32:45.494 INFO:tasks.workunit.client.0.smithi037.stderr: -442> 2024-09-12T17:32:45.144+0000 7f62ea542800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T17:32:45.494 INFO:tasks.workunit.client.0.smithi037.stderr: -441> 2024-09-12T17:32:45.144+0000 7f62ea542800 10 monclient(hunting): picked mon.noname-c con 0x559a91fa1650 addr [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] 2024-09-12T17:32:45.494 INFO:tasks.workunit.client.0.smithi037.stderr: -440> 2024-09-12T17:32:45.144+0000 7f62ea542800 10 monclient(hunting): picked mon.noname-a con 0x559a9203cd50 addr [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] 2024-09-12T17:32:45.494 INFO:tasks.workunit.client.0.smithi037.stderr: -439> 2024-09-12T17:32:45.144+0000 7f62ea542800 10 monclient(hunting): picked mon.noname-b con 0x559a9203d6b0 addr [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] 2024-09-12T17:32:45.494 INFO:tasks.workunit.client.0.smithi037.stderr: -438> 2024-09-12T17:32:45.144+0000 7f62ea542800 10 monclient(hunting): start opening mon connection 2024-09-12T17:32:45.495 INFO:tasks.workunit.client.0.smithi037.stderr: -437> 2024-09-12T17:32:45.144+0000 7f62ea542800 10 monclient(hunting): start opening mon connection 2024-09-12T17:32:45.495 INFO:tasks.workunit.client.0.smithi037.stderr: -436> 2024-09-12T17:32:45.144+0000 7f62ea542800 10 monclient(hunting): start opening mon connection 2024-09-12T17:32:45.495 INFO:tasks.workunit.client.0.smithi037.stderr: -435> 2024-09-12T17:32:45.144+0000 7f62ea542800 10 monclient(hunting): _renew_subs 2024-09-12T17:32:45.495 INFO:tasks.workunit.client.0.smithi037.stderr: -434> 2024-09-12T17:32:45.144+0000 7f62ea542800 10 monclient(hunting): authenticate will time out at 2152.741942s 2024-09-12T17:32:45.495 INFO:tasks.workunit.client.0.smithi037.stderr: -433> 2024-09-12T17:32:45.145+0000 7f62e6286640 10 monclient(hunting): get_auth_request con 0x559a91fa1650 auth_method 0 2024-09-12T17:32:45.495 INFO:tasks.workunit.client.0.smithi037.stderr: -432> 2024-09-12T17:32:45.145+0000 7f62e6286640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:32:45.495 INFO:tasks.workunit.client.0.smithi037.stderr: -431> 2024-09-12T17:32:45.145+0000 7f62e6286640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:32:45.495 INFO:tasks.workunit.client.0.smithi037.stderr: -430> 2024-09-12T17:32:45.145+0000 7f62e6286640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:32:45.495 INFO:tasks.workunit.client.0.smithi037.stderr: -429> 2024-09-12T17:32:45.145+0000 7f62e5a85640 10 monclient(hunting): get_auth_request con 0x559a9203cd50 auth_method 0 2024-09-12T17:32:45.495 INFO:tasks.workunit.client.0.smithi037.stderr: -428> 2024-09-12T17:32:45.145+0000 7f62e5a85640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:32:45.495 INFO:tasks.workunit.client.0.smithi037.stderr: -427> 2024-09-12T17:32:45.145+0000 7f62e5a85640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:32:45.495 INFO:tasks.workunit.client.0.smithi037.stderr: -426> 2024-09-12T17:32:45.145+0000 7f62e5a85640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:32:45.495 INFO:tasks.workunit.client.0.smithi037.stderr: -425> 2024-09-12T17:32:45.145+0000 7f62e6286640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:32:45.496 INFO:tasks.workunit.client.0.smithi037.stderr: -424> 2024-09-12T17:32:45.145+0000 7f62e6286640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:32:45.496 INFO:tasks.workunit.client.0.smithi037.stderr: -423> 2024-09-12T17:32:45.145+0000 7f62e6286640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:32:45.496 INFO:tasks.workunit.client.0.smithi037.stderr: -422> 2024-09-12T17:32:45.145+0000 7f62e5a85640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:32:45.496 INFO:tasks.workunit.client.0.smithi037.stderr: -421> 2024-09-12T17:32:45.145+0000 7f62e5a85640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:32:45.496 INFO:tasks.workunit.client.0.smithi037.stderr: -420> 2024-09-12T17:32:45.145+0000 7f62e5a85640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:32:45.496 INFO:tasks.workunit.client.0.smithi037.stderr: -419> 2024-09-12T17:32:45.145+0000 7f62e6a87640 10 monclient(hunting): get_auth_request con 0x559a9203d6b0 auth_method 0 2024-09-12T17:32:45.496 INFO:tasks.workunit.client.0.smithi037.stderr: -418> 2024-09-12T17:32:45.145+0000 7f62e6a87640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:32:45.496 INFO:tasks.workunit.client.0.smithi037.stderr: -417> 2024-09-12T17:32:45.145+0000 7f62e6a87640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:32:45.496 INFO:tasks.workunit.client.0.smithi037.stderr: -416> 2024-09-12T17:32:45.145+0000 7f62e6a87640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:32:45.496 INFO:tasks.workunit.client.0.smithi037.stderr: -415> 2024-09-12T17:32:45.145+0000 7f62e6286640 10 monclient(hunting): handle_auth_done global_id 6272 payload 824 2024-09-12T17:32:45.496 INFO:tasks.workunit.client.0.smithi037.stderr: -414> 2024-09-12T17:32:45.145+0000 7f62e6286640 10 monclient: _finish_hunting 0 2024-09-12T17:32:45.496 INFO:tasks.workunit.client.0.smithi037.stderr: -413> 2024-09-12T17:32:45.145+0000 7f62e6286640 1 monclient: found mon.noname-c 2024-09-12T17:32:45.496 INFO:tasks.workunit.client.0.smithi037.stderr: -412> 2024-09-12T17:32:45.145+0000 7f62e6286640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.37:3301/0 2024-09-12T17:32:45.497 INFO:tasks.workunit.client.0.smithi037.stderr: -411> 2024-09-12T17:32:45.145+0000 7f61d2e05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:32:45.497 INFO:tasks.workunit.client.0.smithi037.stderr: -410> 2024-09-12T17:32:45.145+0000 7f61d2e05640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:32:45.497 INFO:tasks.workunit.client.0.smithi037.stderr: -409> 2024-09-12T17:32:45.145+0000 7f61d2e05640 10 monclient: dump: 2024-09-12T17:32:45.497 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:32:45.497 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:32:45.497 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:32:45.497 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:32:45.497 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:32:45.497 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:32:45.497 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:32:45.497 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:32:45.497 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:32:45.497 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:32:45.497 INFO:tasks.workunit.client.0.smithi037.stderr: -408> 2024-09-12T17:32:45.145+0000 7f61d2e05640 10 monclient: _finish_auth 0 2024-09-12T17:32:45.498 INFO:tasks.workunit.client.0.smithi037.stderr: -407> 2024-09-12T17:32:45.145+0000 7f61d2e05640 10 monclient: _check_auth_tickets 2024-09-12T17:32:45.498 INFO:tasks.workunit.client.0.smithi037.stderr: -406> 2024-09-12T17:32:45.145+0000 7f61d2e05640 10 monclient: handle_config config(0 keys) 2024-09-12T17:32:45.498 INFO:tasks.workunit.client.0.smithi037.stderr: -405> 2024-09-12T17:32:45.145+0000 7f61d2e05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:32:45.498 INFO:tasks.workunit.client.0.smithi037.stderr: -404> 2024-09-12T17:32:45.145+0000 7f61d2e05640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:32:45.498 INFO:tasks.workunit.client.0.smithi037.stderr: -403> 2024-09-12T17:32:45.145+0000 7f61d2e05640 10 monclient: dump: 2024-09-12T17:32:45.498 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:32:45.498 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:32:45.498 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:32:45.498 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:32:45.498 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:32:45.498 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:32:45.498 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:32:45.498 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:32:45.498 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:32:45.499 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:32:45.499 INFO:tasks.workunit.client.0.smithi037.stderr: -402> 2024-09-12T17:32:45.145+0000 7f62ea542800 5 monclient: authenticate success, global_id 6272 2024-09-12T17:32:45.499 INFO:tasks.workunit.client.0.smithi037.stderr: -401> 2024-09-12T17:32:45.145+0000 7f62ea542800 10 monclient: _renew_subs 2024-09-12T17:32:45.499 INFO:tasks.workunit.client.0.smithi037.stderr: -400> 2024-09-12T17:32:45.145+0000 7f61d4608640 4 set_mon_vals no callback set 2024-09-12T17:32:45.499 INFO:tasks.workunit.client.0.smithi037.stderr: -399> 2024-09-12T17:32:45.145+0000 7f62ea542800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.37:3301/0 2024-09-12T17:32:45.499 INFO:tasks.workunit.client.0.smithi037.stderr: -398> 2024-09-12T17:32:45.145+0000 7f62ea542800 10 monclient: _renew_subs 2024-09-12T17:32:45.499 INFO:tasks.workunit.client.0.smithi037.stderr: -397> 2024-09-12T17:32:45.145+0000 7f62ea542800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.37:3301/0 2024-09-12T17:32:45.499 INFO:tasks.workunit.client.0.smithi037.stderr: -396> 2024-09-12T17:32:45.145+0000 7f62ea542800 1 librados: init done 2024-09-12T17:32:45.499 INFO:tasks.workunit.client.0.smithi037.stderr: -395> 2024-09-12T17:32:45.147+0000 7f61d2e05640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:32:45.499 INFO:tasks.workunit.client.0.smithi037.stderr: -394> 2024-09-12T17:32:45.147+0000 7f61d2e05640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.40:6816/3916250676,v1:172.21.15.40:6817/3916250676] 2024-09-12T17:32:45.499 INFO:tasks.workunit.client.0.smithi037.stderr: -393> 2024-09-12T17:32:45.147+0000 7f61d2e05640 4 mgrc reconnect Starting new session with [v2:172.21.15.40:6816/3916250676,v1:172.21.15.40:6817/3916250676] 2024-09-12T17:32:45.499 INFO:tasks.workunit.client.0.smithi037.stderr: -392> 2024-09-12T17:32:45.147+0000 7f62e5a85640 10 monclient: get_auth_request con 0x7f61cc076470 auth_method 0 2024-09-12T17:32:45.499 INFO:tasks.workunit.client.0.smithi037.stderr: -391> 2024-09-12T17:32:45.148+0000 7f62e6a87640 10 monclient: get_auth_request con 0x559a9211cca0 auth_method 0 2024-09-12T17:32:45.499 INFO:tasks.workunit.client.0.smithi037.stderr: -390> 2024-09-12T17:32:45.148+0000 7f62e6286640 10 monclient: get_auth_request con 0x559a9213f560 auth_method 0 2024-09-12T17:32:45.500 INFO:tasks.workunit.client.0.smithi037.stderr: -389> 2024-09-12T17:32:45.150+0000 7f62e5a85640 10 monclient: get_auth_request con 0x559a92142e10 auth_method 0 2024-09-12T17:32:45.500 INFO:tasks.workunit.client.0.smithi037.stderr: -388> 2024-09-12T17:32:45.150+0000 7f62ea542800 10 monclient: build_initial_monmap 2024-09-12T17:32:45.500 INFO:tasks.workunit.client.0.smithi037.stderr: -387> 2024-09-12T17:32:45.150+0000 7f62ea542800 1 build_initial for_mkfs: 0 2024-09-12T17:32:45.500 INFO:tasks.workunit.client.0.smithi037.stderr: -386> 2024-09-12T17:32:45.150+0000 7f62ea542800 10 monclient: monmap: 2024-09-12T17:32:45.500 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 0 2024-09-12T17:32:45.500 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:32:45.500 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 0.000000 2024-09-12T17:32:45.500 INFO:tasks.workunit.client.0.smithi037.stderr:created 0.000000 2024-09-12T17:32:45.500 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 0 (unknown) 2024-09-12T17:32:45.500 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:32:45.500 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.noname-a 2024-09-12T17:32:45.500 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.noname-b 2024-09-12T17:32:45.500 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.noname-c 2024-09-12T17:32:45.500 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:32:45.501 INFO:tasks.workunit.client.0.smithi037.stderr: -385> 2024-09-12T17:32:45.150+0000 7f62ea542800 5 AuthRegistry(0x559a92148830) adding auth protocol: cephx 2024-09-12T17:32:45.501 INFO:tasks.workunit.client.0.smithi037.stderr: -384> 2024-09-12T17:32:45.150+0000 7f62ea542800 5 AuthRegistry(0x559a92148830) adding auth protocol: cephx 2024-09-12T17:32:45.501 INFO:tasks.workunit.client.0.smithi037.stderr: -383> 2024-09-12T17:32:45.150+0000 7f62ea542800 5 AuthRegistry(0x559a92148830) adding auth protocol: cephx 2024-09-12T17:32:45.501 INFO:tasks.workunit.client.0.smithi037.stderr: -382> 2024-09-12T17:32:45.150+0000 7f62ea542800 5 AuthRegistry(0x559a92148830) adding con mode: secure 2024-09-12T17:32:45.501 INFO:tasks.workunit.client.0.smithi037.stderr: -381> 2024-09-12T17:32:45.150+0000 7f62ea542800 5 AuthRegistry(0x559a92148830) adding con mode: crc 2024-09-12T17:32:45.501 INFO:tasks.workunit.client.0.smithi037.stderr: -380> 2024-09-12T17:32:45.150+0000 7f62ea542800 5 AuthRegistry(0x559a92148830) adding con mode: secure 2024-09-12T17:32:45.501 INFO:tasks.workunit.client.0.smithi037.stderr: -379> 2024-09-12T17:32:45.150+0000 7f62ea542800 5 AuthRegistry(0x559a92148830) adding con mode: crc 2024-09-12T17:32:45.501 INFO:tasks.workunit.client.0.smithi037.stderr: -378> 2024-09-12T17:32:45.150+0000 7f62ea542800 5 AuthRegistry(0x559a92148830) adding con mode: secure 2024-09-12T17:32:45.501 INFO:tasks.workunit.client.0.smithi037.stderr: -377> 2024-09-12T17:32:45.150+0000 7f62ea542800 5 AuthRegistry(0x559a92148830) adding con mode: crc 2024-09-12T17:32:45.501 INFO:tasks.workunit.client.0.smithi037.stderr: -376> 2024-09-12T17:32:45.150+0000 7f62ea542800 5 AuthRegistry(0x559a92148830) adding con mode: crc 2024-09-12T17:32:45.501 INFO:tasks.workunit.client.0.smithi037.stderr: -375> 2024-09-12T17:32:45.150+0000 7f62ea542800 5 AuthRegistry(0x559a92148830) adding con mode: secure 2024-09-12T17:32:45.501 INFO:tasks.workunit.client.0.smithi037.stderr: -374> 2024-09-12T17:32:45.150+0000 7f62ea542800 5 AuthRegistry(0x559a92148830) adding con mode: crc 2024-09-12T17:32:45.501 INFO:tasks.workunit.client.0.smithi037.stderr: -373> 2024-09-12T17:32:45.150+0000 7f62ea542800 5 AuthRegistry(0x559a92148830) adding con mode: secure 2024-09-12T17:32:45.502 INFO:tasks.workunit.client.0.smithi037.stderr: -372> 2024-09-12T17:32:45.150+0000 7f62ea542800 5 AuthRegistry(0x559a92148830) adding con mode: crc 2024-09-12T17:32:45.502 INFO:tasks.workunit.client.0.smithi037.stderr: -371> 2024-09-12T17:32:45.150+0000 7f62ea542800 5 AuthRegistry(0x559a92148830) adding con mode: secure 2024-09-12T17:32:45.502 INFO:tasks.workunit.client.0.smithi037.stderr: -370> 2024-09-12T17:32:45.151+0000 7f62ea542800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:32:45.502 INFO:tasks.workunit.client.0.smithi037.stderr: -369> 2024-09-12T17:32:45.151+0000 7f62ea542800 5 asok(0x559a91ed1730) register_command objecter_requests cmddesc objecter_requests hook 0x559a9214c200 EEXIST 2024-09-12T17:32:45.502 INFO:tasks.workunit.client.0.smithi037.stderr: -368> 2024-09-12T17:32:45.151+0000 7f62ea542800 10 monclient: init 2024-09-12T17:32:45.502 INFO:tasks.workunit.client.0.smithi037.stderr: -367> 2024-09-12T17:32:45.151+0000 7f62ea542800 5 AuthRegistry(0x559a921477e8) adding auth protocol: cephx 2024-09-12T17:32:45.502 INFO:tasks.workunit.client.0.smithi037.stderr: -366> 2024-09-12T17:32:45.151+0000 7f62ea542800 5 AuthRegistry(0x559a921477e8) adding auth protocol: cephx 2024-09-12T17:32:45.502 INFO:tasks.workunit.client.0.smithi037.stderr: -365> 2024-09-12T17:32:45.151+0000 7f62ea542800 5 AuthRegistry(0x559a921477e8) adding auth protocol: cephx 2024-09-12T17:32:45.502 INFO:tasks.workunit.client.0.smithi037.stderr: -364> 2024-09-12T17:32:45.151+0000 7f62ea542800 5 AuthRegistry(0x559a921477e8) adding con mode: secure 2024-09-12T17:32:45.502 INFO:tasks.workunit.client.0.smithi037.stderr: -363> 2024-09-12T17:32:45.151+0000 7f62ea542800 5 AuthRegistry(0x559a921477e8) adding con mode: crc 2024-09-12T17:32:45.502 INFO:tasks.workunit.client.0.smithi037.stderr: -362> 2024-09-12T17:32:45.151+0000 7f62ea542800 5 AuthRegistry(0x559a921477e8) adding con mode: secure 2024-09-12T17:32:45.502 INFO:tasks.workunit.client.0.smithi037.stderr: -361> 2024-09-12T17:32:45.151+0000 7f62ea542800 5 AuthRegistry(0x559a921477e8) adding con mode: crc 2024-09-12T17:32:45.503 INFO:tasks.workunit.client.0.smithi037.stderr: -360> 2024-09-12T17:32:45.151+0000 7f62ea542800 5 AuthRegistry(0x559a921477e8) adding con mode: secure 2024-09-12T17:32:45.503 INFO:tasks.workunit.client.0.smithi037.stderr: -359> 2024-09-12T17:32:45.151+0000 7f62ea542800 5 AuthRegistry(0x559a921477e8) adding con mode: crc 2024-09-12T17:32:45.503 INFO:tasks.workunit.client.0.smithi037.stderr: -358> 2024-09-12T17:32:45.151+0000 7f62ea542800 5 AuthRegistry(0x559a921477e8) adding con mode: crc 2024-09-12T17:32:45.503 INFO:tasks.workunit.client.0.smithi037.stderr: -357> 2024-09-12T17:32:45.151+0000 7f62ea542800 5 AuthRegistry(0x559a921477e8) adding con mode: secure 2024-09-12T17:32:45.503 INFO:tasks.workunit.client.0.smithi037.stderr: -356> 2024-09-12T17:32:45.151+0000 7f62ea542800 5 AuthRegistry(0x559a921477e8) adding con mode: crc 2024-09-12T17:32:45.503 INFO:tasks.workunit.client.0.smithi037.stderr: -355> 2024-09-12T17:32:45.151+0000 7f62ea542800 5 AuthRegistry(0x559a921477e8) adding con mode: secure 2024-09-12T17:32:45.503 INFO:tasks.workunit.client.0.smithi037.stderr: -354> 2024-09-12T17:32:45.151+0000 7f62ea542800 5 AuthRegistry(0x559a921477e8) adding con mode: crc 2024-09-12T17:32:45.503 INFO:tasks.workunit.client.0.smithi037.stderr: -353> 2024-09-12T17:32:45.151+0000 7f62ea542800 5 AuthRegistry(0x559a921477e8) adding con mode: secure 2024-09-12T17:32:45.503 INFO:tasks.workunit.client.0.smithi037.stderr: -352> 2024-09-12T17:32:45.151+0000 7f62ea542800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:32:45.503 INFO:tasks.workunit.client.0.smithi037.stderr: -351> 2024-09-12T17:32:45.151+0000 7f62ea542800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:32:45.503 INFO:tasks.workunit.client.0.smithi037.stderr: -350> 2024-09-12T17:32:45.151+0000 7f62ea542800 5 asok(0x559a91ed1730) register_command rotate-key cmddesc rotate-key hook 0x559a92147930 EEXIST 2024-09-12T17:32:45.503 INFO:tasks.workunit.client.0.smithi037.stderr: -349> 2024-09-12T17:32:45.151+0000 7f62ea542800 10 monclient: _reopen_session rank -1 2024-09-12T17:32:45.503 INFO:tasks.workunit.client.0.smithi037.stderr: -348> 2024-09-12T17:32:45.151+0000 7f62ea542800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T17:32:45.503 INFO:tasks.workunit.client.0.smithi037.stderr: -347> 2024-09-12T17:32:45.151+0000 7f62ea542800 10 monclient(hunting): picked mon.noname-a con 0x559a9216fef0 addr [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] 2024-09-12T17:32:45.504 INFO:tasks.workunit.client.0.smithi037.stderr: -346> 2024-09-12T17:32:45.151+0000 7f62ea542800 10 monclient(hunting): picked mon.noname-c con 0x559a921721c0 addr [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] 2024-09-12T17:32:45.504 INFO:tasks.workunit.client.0.smithi037.stderr: -345> 2024-09-12T17:32:45.151+0000 7f62ea542800 10 monclient(hunting): picked mon.noname-b con 0x559a9216e6c0 addr [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] 2024-09-12T17:32:45.504 INFO:tasks.workunit.client.0.smithi037.stderr: -344> 2024-09-12T17:32:45.151+0000 7f62ea542800 10 monclient(hunting): start opening mon connection 2024-09-12T17:32:45.504 INFO:tasks.workunit.client.0.smithi037.stderr: -343> 2024-09-12T17:32:45.151+0000 7f62ea542800 10 monclient(hunting): start opening mon connection 2024-09-12T17:32:45.504 INFO:tasks.workunit.client.0.smithi037.stderr: -342> 2024-09-12T17:32:45.151+0000 7f62ea542800 10 monclient(hunting): start opening mon connection 2024-09-12T17:32:45.504 INFO:tasks.workunit.client.0.smithi037.stderr: -341> 2024-09-12T17:32:45.152+0000 7f62ea542800 10 monclient(hunting): _renew_subs 2024-09-12T17:32:45.504 INFO:tasks.workunit.client.0.smithi037.stderr: -340> 2024-09-12T17:32:45.152+0000 7f62ea542800 10 monclient(hunting): authenticate will time out at 2152.749013s 2024-09-12T17:32:45.504 INFO:tasks.workunit.client.0.smithi037.stderr: -339> 2024-09-12T17:32:45.152+0000 7f62e5a85640 10 monclient(hunting): get_auth_request con 0x559a921721c0 auth_method 0 2024-09-12T17:32:45.504 INFO:tasks.workunit.client.0.smithi037.stderr: -338> 2024-09-12T17:32:45.152+0000 7f62e5a85640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:32:45.504 INFO:tasks.workunit.client.0.smithi037.stderr: -337> 2024-09-12T17:32:45.152+0000 7f62e5a85640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:32:45.504 INFO:tasks.workunit.client.0.smithi037.stderr: -336> 2024-09-12T17:32:45.152+0000 7f62e5a85640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:32:45.504 INFO:tasks.workunit.client.0.smithi037.stderr: -335> 2024-09-12T17:32:45.152+0000 7f62e6286640 10 monclient(hunting): get_auth_request con 0x559a9216fef0 auth_method 0 2024-09-12T17:32:45.504 INFO:tasks.workunit.client.0.smithi037.stderr: -334> 2024-09-12T17:32:45.152+0000 7f62e6286640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:32:45.505 INFO:tasks.workunit.client.0.smithi037.stderr: -333> 2024-09-12T17:32:45.152+0000 7f62e6286640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:32:45.505 INFO:tasks.workunit.client.0.smithi037.stderr: -332> 2024-09-12T17:32:45.152+0000 7f62e6286640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:32:45.505 INFO:tasks.workunit.client.0.smithi037.stderr: -331> 2024-09-12T17:32:45.152+0000 7f62e6a87640 10 monclient(hunting): get_auth_request con 0x559a9216e6c0 auth_method 0 2024-09-12T17:32:45.505 INFO:tasks.workunit.client.0.smithi037.stderr: -330> 2024-09-12T17:32:45.152+0000 7f62e6a87640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:32:45.505 INFO:tasks.workunit.client.0.smithi037.stderr: -329> 2024-09-12T17:32:45.152+0000 7f62e6a87640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:32:45.505 INFO:tasks.workunit.client.0.smithi037.stderr: -328> 2024-09-12T17:32:45.152+0000 7f62e6a87640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:32:45.505 INFO:tasks.workunit.client.0.smithi037.stderr: -327> 2024-09-12T17:32:45.152+0000 7f62e5a85640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:32:45.505 INFO:tasks.workunit.client.0.smithi037.stderr: -326> 2024-09-12T17:32:45.152+0000 7f62e5a85640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:32:45.505 INFO:tasks.workunit.client.0.smithi037.stderr: -325> 2024-09-12T17:32:45.152+0000 7f62e5a85640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:32:45.505 INFO:tasks.workunit.client.0.smithi037.stderr: -324> 2024-09-12T17:32:45.152+0000 7f62e6286640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:32:45.505 INFO:tasks.workunit.client.0.smithi037.stderr: -323> 2024-09-12T17:32:45.152+0000 7f62e6286640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:32:45.505 INFO:tasks.workunit.client.0.smithi037.stderr: -322> 2024-09-12T17:32:45.152+0000 7f62e6286640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:32:45.505 INFO:tasks.workunit.client.0.smithi037.stderr: -321> 2024-09-12T17:32:45.152+0000 7f62e6a87640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:32:45.505 INFO:tasks.workunit.client.0.smithi037.stderr: -320> 2024-09-12T17:32:45.152+0000 7f62e6a87640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:32:45.506 INFO:tasks.workunit.client.0.smithi037.stderr: -319> 2024-09-12T17:32:45.152+0000 7f62e6a87640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:32:45.506 INFO:tasks.workunit.client.0.smithi037.stderr: -318> 2024-09-12T17:32:45.152+0000 7f62e5a85640 10 monclient(hunting): handle_auth_done global_id 6275 payload 824 2024-09-12T17:32:45.506 INFO:tasks.workunit.client.0.smithi037.stderr: -317> 2024-09-12T17:32:45.152+0000 7f62e5a85640 10 monclient: _finish_hunting 0 2024-09-12T17:32:45.506 INFO:tasks.workunit.client.0.smithi037.stderr: -316> 2024-09-12T17:32:45.152+0000 7f62e5a85640 1 monclient: found mon.noname-c 2024-09-12T17:32:45.506 INFO:tasks.workunit.client.0.smithi037.stderr: -315> 2024-09-12T17:32:45.152+0000 7f62e5a85640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.37:3301/0 2024-09-12T17:32:45.506 INFO:tasks.workunit.client.0.smithi037.stderr: -314> 2024-09-12T17:32:45.152+0000 7f61cbfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:32:45.506 INFO:tasks.workunit.client.0.smithi037.stderr: -313> 2024-09-12T17:32:45.152+0000 7f61cbfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:32:45.506 INFO:tasks.workunit.client.0.smithi037.stderr: -312> 2024-09-12T17:32:45.152+0000 7f61cbfff640 10 monclient: dump: 2024-09-12T17:32:45.506 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:32:45.506 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:32:45.506 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:32:45.506 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:32:45.506 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:32:45.506 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:32:45.506 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:32:45.507 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:32:45.507 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:32:45.507 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:32:45.507 INFO:tasks.workunit.client.0.smithi037.stderr: -311> 2024-09-12T17:32:45.152+0000 7f61cbfff640 10 monclient: _finish_auth 0 2024-09-12T17:32:45.507 INFO:tasks.workunit.client.0.smithi037.stderr: -310> 2024-09-12T17:32:45.152+0000 7f61cbfff640 10 monclient: _check_auth_tickets 2024-09-12T17:32:45.507 INFO:tasks.workunit.client.0.smithi037.stderr: -309> 2024-09-12T17:32:45.152+0000 7f61cbfff640 10 monclient: handle_config config(0 keys) 2024-09-12T17:32:45.507 INFO:tasks.workunit.client.0.smithi037.stderr: -308> 2024-09-12T17:32:45.152+0000 7f61cbfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:32:45.507 INFO:tasks.workunit.client.0.smithi037.stderr: -307> 2024-09-12T17:32:45.152+0000 7f61cbfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:32:45.507 INFO:tasks.workunit.client.0.smithi037.stderr: -306> 2024-09-12T17:32:45.152+0000 7f61cbfff640 10 monclient: dump: 2024-09-12T17:32:45.507 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:32:45.507 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:32:45.507 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:32:45.507 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:32:45.507 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:32:45.508 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:32:45.508 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:32:45.508 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:32:45.508 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:32:45.508 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:32:45.508 INFO:tasks.workunit.client.0.smithi037.stderr: -305> 2024-09-12T17:32:45.152+0000 7f62ea542800 5 monclient: authenticate success, global_id 6275 2024-09-12T17:32:45.508 INFO:tasks.workunit.client.0.smithi037.stderr: -304> 2024-09-12T17:32:45.152+0000 7f62ea542800 10 monclient: _renew_subs 2024-09-12T17:32:45.508 INFO:tasks.workunit.client.0.smithi037.stderr: -303> 2024-09-12T17:32:45.152+0000 7f62ea542800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.37:3301/0 2024-09-12T17:32:45.508 INFO:tasks.workunit.client.0.smithi037.stderr: -302> 2024-09-12T17:32:45.152+0000 7f62e7288640 4 set_mon_vals no callback set 2024-09-12T17:32:45.508 INFO:tasks.workunit.client.0.smithi037.stderr: -301> 2024-09-12T17:32:45.152+0000 7f62ea542800 10 monclient: _renew_subs 2024-09-12T17:32:45.508 INFO:tasks.workunit.client.0.smithi037.stderr: -300> 2024-09-12T17:32:45.152+0000 7f62ea542800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.37:3301/0 2024-09-12T17:32:45.508 INFO:tasks.workunit.client.0.smithi037.stderr: -299> 2024-09-12T17:32:45.154+0000 7f61cbfff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:32:45.508 INFO:tasks.workunit.client.0.smithi037.stderr: -298> 2024-09-12T17:32:45.154+0000 7f61cbfff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.40:6816/3916250676,v1:172.21.15.40:6817/3916250676] 2024-09-12T17:32:45.508 INFO:tasks.workunit.client.0.smithi037.stderr: -297> 2024-09-12T17:32:45.154+0000 7f61cbfff640 4 mgrc reconnect Starting new session with [v2:172.21.15.40:6816/3916250676,v1:172.21.15.40:6817/3916250676] 2024-09-12T17:32:45.509 INFO:tasks.workunit.client.0.smithi037.stderr: -296> 2024-09-12T17:32:45.155+0000 7f62ea542800 10 monclient: get_monmap_and_config 2024-09-12T17:32:45.509 INFO:tasks.workunit.client.0.smithi037.stderr: -295> 2024-09-12T17:32:45.155+0000 7f62ea542800 10 monclient: build_initial_monmap 2024-09-12T17:32:45.509 INFO:tasks.workunit.client.0.smithi037.stderr: -294> 2024-09-12T17:32:45.155+0000 7f62ea542800 1 build_initial for_mkfs: 0 2024-09-12T17:32:45.509 INFO:tasks.workunit.client.0.smithi037.stderr: -293> 2024-09-12T17:32:45.155+0000 7f62ea542800 10 monclient: monmap: 2024-09-12T17:32:45.509 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 0 2024-09-12T17:32:45.509 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:32:45.509 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 0.000000 2024-09-12T17:32:45.509 INFO:tasks.workunit.client.0.smithi037.stderr:created 0.000000 2024-09-12T17:32:45.509 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 0 (unknown) 2024-09-12T17:32:45.509 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:32:45.509 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.noname-a 2024-09-12T17:32:45.509 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.noname-b 2024-09-12T17:32:45.509 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.noname-c 2024-09-12T17:32:45.510 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:32:45.510 INFO:tasks.workunit.client.0.smithi037.stderr: -292> 2024-09-12T17:32:45.155+0000 7f62ea542800 5 AuthRegistry(0x559a9218fb90) adding auth protocol: cephx 2024-09-12T17:32:45.510 INFO:tasks.workunit.client.0.smithi037.stderr: -291> 2024-09-12T17:32:45.155+0000 7f62ea542800 5 AuthRegistry(0x559a9218fb90) adding auth protocol: cephx 2024-09-12T17:32:45.510 INFO:tasks.workunit.client.0.smithi037.stderr: -290> 2024-09-12T17:32:45.155+0000 7f62ea542800 5 AuthRegistry(0x559a9218fb90) adding auth protocol: cephx 2024-09-12T17:32:45.510 INFO:tasks.workunit.client.0.smithi037.stderr: -289> 2024-09-12T17:32:45.155+0000 7f62ea542800 5 AuthRegistry(0x559a9218fb90) adding con mode: secure 2024-09-12T17:32:45.510 INFO:tasks.workunit.client.0.smithi037.stderr: -288> 2024-09-12T17:32:45.155+0000 7f62ea542800 5 AuthRegistry(0x559a9218fb90) adding con mode: crc 2024-09-12T17:32:45.510 INFO:tasks.workunit.client.0.smithi037.stderr: -287> 2024-09-12T17:32:45.155+0000 7f62ea542800 5 AuthRegistry(0x559a9218fb90) adding con mode: secure 2024-09-12T17:32:45.510 INFO:tasks.workunit.client.0.smithi037.stderr: -286> 2024-09-12T17:32:45.155+0000 7f62ea542800 5 AuthRegistry(0x559a9218fb90) adding con mode: crc 2024-09-12T17:32:45.510 INFO:tasks.workunit.client.0.smithi037.stderr: -285> 2024-09-12T17:32:45.155+0000 7f62ea542800 5 AuthRegistry(0x559a9218fb90) adding con mode: secure 2024-09-12T17:32:45.510 INFO:tasks.workunit.client.0.smithi037.stderr: -284> 2024-09-12T17:32:45.155+0000 7f62ea542800 5 AuthRegistry(0x559a9218fb90) adding con mode: crc 2024-09-12T17:32:45.510 INFO:tasks.workunit.client.0.smithi037.stderr: -283> 2024-09-12T17:32:45.155+0000 7f62ea542800 5 AuthRegistry(0x559a9218fb90) adding con mode: crc 2024-09-12T17:32:45.510 INFO:tasks.workunit.client.0.smithi037.stderr: -282> 2024-09-12T17:32:45.155+0000 7f62ea542800 5 AuthRegistry(0x559a9218fb90) adding con mode: secure 2024-09-12T17:32:45.510 INFO:tasks.workunit.client.0.smithi037.stderr: -281> 2024-09-12T17:32:45.155+0000 7f62ea542800 5 AuthRegistry(0x559a9218fb90) adding con mode: crc 2024-09-12T17:32:45.510 INFO:tasks.workunit.client.0.smithi037.stderr: -280> 2024-09-12T17:32:45.155+0000 7f62ea542800 5 AuthRegistry(0x559a9218fb90) adding con mode: secure 2024-09-12T17:32:45.511 INFO:tasks.workunit.client.0.smithi037.stderr: -279> 2024-09-12T17:32:45.155+0000 7f62ea542800 5 AuthRegistry(0x559a9218fb90) adding con mode: crc 2024-09-12T17:32:45.511 INFO:tasks.workunit.client.0.smithi037.stderr: -278> 2024-09-12T17:32:45.155+0000 7f62ea542800 5 AuthRegistry(0x559a9218fb90) adding con mode: secure 2024-09-12T17:32:45.511 INFO:tasks.workunit.client.0.smithi037.stderr: -277> 2024-09-12T17:32:45.155+0000 7f62e6286640 10 monclient: get_auth_request con 0x7f61c0076380 auth_method 0 2024-09-12T17:32:45.511 INFO:tasks.workunit.client.0.smithi037.stderr: -276> 2024-09-12T17:32:45.155+0000 7f62ea542800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:32:45.511 INFO:tasks.workunit.client.0.smithi037.stderr: -275> 2024-09-12T17:32:45.155+0000 7f62ea542800 10 monclient: init 2024-09-12T17:32:45.511 INFO:tasks.workunit.client.0.smithi037.stderr: -274> 2024-09-12T17:32:45.155+0000 7f62ea542800 5 AuthRegistry(0x7fff16f1bed0) adding auth protocol: cephx 2024-09-12T17:32:45.511 INFO:tasks.workunit.client.0.smithi037.stderr: -273> 2024-09-12T17:32:45.155+0000 7f62ea542800 5 AuthRegistry(0x7fff16f1bed0) adding auth protocol: cephx 2024-09-12T17:32:45.511 INFO:tasks.workunit.client.0.smithi037.stderr: -272> 2024-09-12T17:32:45.155+0000 7f62ea542800 5 AuthRegistry(0x7fff16f1bed0) adding auth protocol: cephx 2024-09-12T17:32:45.511 INFO:tasks.workunit.client.0.smithi037.stderr: -271> 2024-09-12T17:32:45.155+0000 7f62ea542800 5 AuthRegistry(0x7fff16f1bed0) adding con mode: secure 2024-09-12T17:32:45.511 INFO:tasks.workunit.client.0.smithi037.stderr: -270> 2024-09-12T17:32:45.155+0000 7f62ea542800 5 AuthRegistry(0x7fff16f1bed0) adding con mode: crc 2024-09-12T17:32:45.511 INFO:tasks.workunit.client.0.smithi037.stderr: -269> 2024-09-12T17:32:45.155+0000 7f62ea542800 5 AuthRegistry(0x7fff16f1bed0) adding con mode: secure 2024-09-12T17:32:45.511 INFO:tasks.workunit.client.0.smithi037.stderr: -268> 2024-09-12T17:32:45.155+0000 7f62ea542800 5 AuthRegistry(0x7fff16f1bed0) adding con mode: crc 2024-09-12T17:32:45.511 INFO:tasks.workunit.client.0.smithi037.stderr: -267> 2024-09-12T17:32:45.155+0000 7f62ea542800 5 AuthRegistry(0x7fff16f1bed0) adding con mode: secure 2024-09-12T17:32:45.512 INFO:tasks.workunit.client.0.smithi037.stderr: -266> 2024-09-12T17:32:45.155+0000 7f62ea542800 5 AuthRegistry(0x7fff16f1bed0) adding con mode: crc 2024-09-12T17:32:45.512 INFO:tasks.workunit.client.0.smithi037.stderr: -265> 2024-09-12T17:32:45.155+0000 7f62ea542800 5 AuthRegistry(0x7fff16f1bed0) adding con mode: crc 2024-09-12T17:32:45.512 INFO:tasks.workunit.client.0.smithi037.stderr: -264> 2024-09-12T17:32:45.155+0000 7f62ea542800 5 AuthRegistry(0x7fff16f1bed0) adding con mode: secure 2024-09-12T17:32:45.512 INFO:tasks.workunit.client.0.smithi037.stderr: -263> 2024-09-12T17:32:45.155+0000 7f62ea542800 5 AuthRegistry(0x7fff16f1bed0) adding con mode: crc 2024-09-12T17:32:45.512 INFO:tasks.workunit.client.0.smithi037.stderr: -262> 2024-09-12T17:32:45.155+0000 7f62ea542800 5 AuthRegistry(0x7fff16f1bed0) adding con mode: secure 2024-09-12T17:32:45.512 INFO:tasks.workunit.client.0.smithi037.stderr: -261> 2024-09-12T17:32:45.155+0000 7f62ea542800 5 AuthRegistry(0x7fff16f1bed0) adding con mode: crc 2024-09-12T17:32:45.512 INFO:tasks.workunit.client.0.smithi037.stderr: -260> 2024-09-12T17:32:45.155+0000 7f62ea542800 5 AuthRegistry(0x7fff16f1bed0) adding con mode: secure 2024-09-12T17:32:45.512 INFO:tasks.workunit.client.0.smithi037.stderr: -259> 2024-09-12T17:32:45.155+0000 7f62ea542800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:32:45.512 INFO:tasks.workunit.client.0.smithi037.stderr: -258> 2024-09-12T17:32:45.155+0000 7f62ea542800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:32:45.512 INFO:tasks.workunit.client.0.smithi037.stderr: -257> 2024-09-12T17:32:45.155+0000 7f62ea542800 5 asok(0x559a91ed1730) register_command rotate-key cmddesc rotate-key hook 0x7fff16f1c018 EEXIST 2024-09-12T17:32:45.512 INFO:tasks.workunit.client.0.smithi037.stderr: -256> 2024-09-12T17:32:45.155+0000 7f62ea542800 10 monclient: _reopen_session rank -1 2024-09-12T17:32:45.512 INFO:tasks.workunit.client.0.smithi037.stderr: -255> 2024-09-12T17:32:45.155+0000 7f62ea542800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T17:32:45.512 INFO:tasks.workunit.client.0.smithi037.stderr: -254> 2024-09-12T17:32:45.155+0000 7f62ea542800 10 monclient(hunting): picked mon.noname-c con 0x559a92193c70 addr [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] 2024-09-12T17:32:45.512 INFO:tasks.workunit.client.0.smithi037.stderr: -253> 2024-09-12T17:32:45.155+0000 7f62ea542800 10 monclient(hunting): picked mon.noname-a con 0x559a921c42c0 addr [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] 2024-09-12T17:32:45.513 INFO:tasks.workunit.client.0.smithi037.stderr: -252> 2024-09-12T17:32:45.156+0000 7f62ea542800 10 monclient(hunting): picked mon.noname-b con 0x559a921bf4b0 addr [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] 2024-09-12T17:32:45.513 INFO:tasks.workunit.client.0.smithi037.stderr: -251> 2024-09-12T17:32:45.156+0000 7f62ea542800 10 monclient(hunting): start opening mon connection 2024-09-12T17:32:45.513 INFO:tasks.workunit.client.0.smithi037.stderr: -250> 2024-09-12T17:32:45.156+0000 7f62ea542800 10 monclient(hunting): start opening mon connection 2024-09-12T17:32:45.513 INFO:tasks.workunit.client.0.smithi037.stderr: -249> 2024-09-12T17:32:45.156+0000 7f62ea542800 10 monclient(hunting): start opening mon connection 2024-09-12T17:32:45.513 INFO:tasks.workunit.client.0.smithi037.stderr: -248> 2024-09-12T17:32:45.156+0000 7f62ea542800 10 monclient(hunting): _renew_subs 2024-09-12T17:32:45.513 INFO:tasks.workunit.client.0.smithi037.stderr: -247> 2024-09-12T17:32:45.156+0000 7f62ea542800 10 monclient(hunting): authenticate will time out at 2152.753021s 2024-09-12T17:32:45.513 INFO:tasks.workunit.client.0.smithi037.stderr: -246> 2024-09-12T17:32:45.156+0000 7f62e6286640 10 monclient(hunting): get_auth_request con 0x559a92193c70 auth_method 0 2024-09-12T17:32:45.513 INFO:tasks.workunit.client.0.smithi037.stderr: -245> 2024-09-12T17:32:45.156+0000 7f62e6286640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:32:45.513 INFO:tasks.workunit.client.0.smithi037.stderr: -244> 2024-09-12T17:32:45.156+0000 7f62e6286640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:32:45.513 INFO:tasks.workunit.client.0.smithi037.stderr: -243> 2024-09-12T17:32:45.156+0000 7f62e6286640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:32:45.513 INFO:tasks.workunit.client.0.smithi037.stderr: -242> 2024-09-12T17:32:45.156+0000 7f62e5a85640 10 monclient(hunting): get_auth_request con 0x559a921c42c0 auth_method 0 2024-09-12T17:32:45.513 INFO:tasks.workunit.client.0.smithi037.stderr: -241> 2024-09-12T17:32:45.156+0000 7f62e5a85640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:32:45.513 INFO:tasks.workunit.client.0.smithi037.stderr: -240> 2024-09-12T17:32:45.156+0000 7f62e5a85640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:32:45.513 INFO:tasks.workunit.client.0.smithi037.stderr: -239> 2024-09-12T17:32:45.156+0000 7f62e5a85640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:32:45.514 INFO:tasks.workunit.client.0.smithi037.stderr: -238> 2024-09-12T17:32:45.156+0000 7f62e6a87640 10 monclient(hunting): get_auth_request con 0x559a921bf4b0 auth_method 0 2024-09-12T17:32:45.514 INFO:tasks.workunit.client.0.smithi037.stderr: -237> 2024-09-12T17:32:45.156+0000 7f62e6a87640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:32:45.514 INFO:tasks.workunit.client.0.smithi037.stderr: -236> 2024-09-12T17:32:45.156+0000 7f62e6a87640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:32:45.514 INFO:tasks.workunit.client.0.smithi037.stderr: -235> 2024-09-12T17:32:45.156+0000 7f62e6a87640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:32:45.514 INFO:tasks.workunit.client.0.smithi037.stderr: -234> 2024-09-12T17:32:45.156+0000 7f62e6286640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:32:45.514 INFO:tasks.workunit.client.0.smithi037.stderr: -233> 2024-09-12T17:32:45.156+0000 7f62e6286640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:32:45.514 INFO:tasks.workunit.client.0.smithi037.stderr: -232> 2024-09-12T17:32:45.156+0000 7f62e6286640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:32:45.514 INFO:tasks.workunit.client.0.smithi037.stderr: -231> 2024-09-12T17:32:45.156+0000 7f62e5a85640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:32:45.514 INFO:tasks.workunit.client.0.smithi037.stderr: -230> 2024-09-12T17:32:45.156+0000 7f62e5a85640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:32:45.514 INFO:tasks.workunit.client.0.smithi037.stderr: -229> 2024-09-12T17:32:45.156+0000 7f62e5a85640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:32:45.514 INFO:tasks.workunit.client.0.smithi037.stderr: -228> 2024-09-12T17:32:45.156+0000 7f62e6a87640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:32:45.514 INFO:tasks.workunit.client.0.smithi037.stderr: -227> 2024-09-12T17:32:45.156+0000 7f62e6a87640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:32:45.514 INFO:tasks.workunit.client.0.smithi037.stderr: -226> 2024-09-12T17:32:45.156+0000 7f62e6a87640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:32:45.515 INFO:tasks.workunit.client.0.smithi037.stderr: -225> 2024-09-12T17:32:45.156+0000 7f62e6286640 10 monclient(hunting): handle_auth_done global_id 6278 payload 274 2024-09-12T17:32:45.515 INFO:tasks.workunit.client.0.smithi037.stderr: -224> 2024-09-12T17:32:45.156+0000 7f62e6286640 10 monclient: _finish_hunting 0 2024-09-12T17:32:45.515 INFO:tasks.workunit.client.0.smithi037.stderr: -223> 2024-09-12T17:32:45.156+0000 7f62e6286640 1 monclient: found mon.noname-c 2024-09-12T17:32:45.515 INFO:tasks.workunit.client.0.smithi037.stderr: -222> 2024-09-12T17:32:45.156+0000 7f62e6286640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.37:3301/0 2024-09-12T17:32:45.515 INFO:tasks.workunit.client.0.smithi037.stderr: -221> 2024-09-12T17:32:45.156+0000 7f61c9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:32:45.515 INFO:tasks.workunit.client.0.smithi037.stderr: -220> 2024-09-12T17:32:45.156+0000 7f61c9ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:32:45.515 INFO:tasks.workunit.client.0.smithi037.stderr: -219> 2024-09-12T17:32:45.156+0000 7f61c9ffb640 10 monclient: dump: 2024-09-12T17:32:45.515 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:32:45.515 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:32:45.515 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:32:45.515 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:32:45.515 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:32:45.515 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:32:45.515 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:32:45.516 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:32:45.516 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:32:45.516 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:32:45.516 INFO:tasks.workunit.client.0.smithi037.stderr: -218> 2024-09-12T17:32:45.156+0000 7f61c9ffb640 10 monclient: _finish_auth 0 2024-09-12T17:32:45.516 INFO:tasks.workunit.client.0.smithi037.stderr: -217> 2024-09-12T17:32:45.156+0000 7f61c9ffb640 10 monclient: _check_auth_tickets 2024-09-12T17:32:45.516 INFO:tasks.workunit.client.0.smithi037.stderr: -216> 2024-09-12T17:32:45.156+0000 7f61c9ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T17:32:45.516 INFO:tasks.workunit.client.0.smithi037.stderr: -215> 2024-09-12T17:32:45.156+0000 7f62ea542800 5 monclient: authenticate success, global_id 6278 2024-09-12T17:32:45.516 INFO:tasks.workunit.client.0.smithi037.stderr: -214> 2024-09-12T17:32:45.156+0000 7f62ea542800 10 monclient: get_monmap_and_config success 2024-09-12T17:32:45.516 INFO:tasks.workunit.client.0.smithi037.stderr: -213> 2024-09-12T17:32:45.156+0000 7f62ea542800 4 set_mon_vals no callback set 2024-09-12T17:32:45.516 INFO:tasks.workunit.client.0.smithi037.stderr: -212> 2024-09-12T17:32:45.156+0000 7f61c9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:32:45.516 INFO:tasks.workunit.client.0.smithi037.stderr: -211> 2024-09-12T17:32:45.156+0000 7f61c9ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:32:45.516 INFO:tasks.workunit.client.0.smithi037.stderr: -210> 2024-09-12T17:32:45.156+0000 7f61c9ffb640 10 monclient: dump: 2024-09-12T17:32:45.516 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:32:45.517 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:32:45.517 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:32:45.517 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:32:45.517 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:32:45.517 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:32:45.517 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:32:45.517 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:32:45.517 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:32:45.517 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:32:45.517 INFO:tasks.workunit.client.0.smithi037.stderr: -209> 2024-09-12T17:32:45.157+0000 7f62ea542800 10 monclient: shutdown 2024-09-12T17:32:45.517 INFO:tasks.workunit.client.0.smithi037.stderr: -208> 2024-09-12T17:32:45.157+0000 7f62ea542800 10 monclient: build_initial_monmap 2024-09-12T17:32:45.517 INFO:tasks.workunit.client.0.smithi037.stderr: -207> 2024-09-12T17:32:45.157+0000 7f62ea542800 1 build_initial for_mkfs: 0 2024-09-12T17:32:45.517 INFO:tasks.workunit.client.0.smithi037.stderr: -206> 2024-09-12T17:32:45.157+0000 7f62ea542800 10 monclient: monmap: 2024-09-12T17:32:45.518 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 0 2024-09-12T17:32:45.518 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:32:45.518 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 0.000000 2024-09-12T17:32:45.518 INFO:tasks.workunit.client.0.smithi037.stderr:created 0.000000 2024-09-12T17:32:45.518 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 0 (unknown) 2024-09-12T17:32:45.518 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:32:45.518 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.noname-a 2024-09-12T17:32:45.518 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.noname-b 2024-09-12T17:32:45.518 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.noname-c 2024-09-12T17:32:45.518 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:32:45.518 INFO:tasks.workunit.client.0.smithi037.stderr: -205> 2024-09-12T17:32:45.157+0000 7f62ea542800 5 AuthRegistry(0x559a921be170) adding auth protocol: cephx 2024-09-12T17:32:45.518 INFO:tasks.workunit.client.0.smithi037.stderr: -204> 2024-09-12T17:32:45.157+0000 7f62ea542800 5 AuthRegistry(0x559a921be170) adding auth protocol: cephx 2024-09-12T17:32:45.518 INFO:tasks.workunit.client.0.smithi037.stderr: -203> 2024-09-12T17:32:45.157+0000 7f62ea542800 5 AuthRegistry(0x559a921be170) adding auth protocol: cephx 2024-09-12T17:32:45.519 INFO:tasks.workunit.client.0.smithi037.stderr: -202> 2024-09-12T17:32:45.157+0000 7f62ea542800 5 AuthRegistry(0x559a921be170) adding con mode: secure 2024-09-12T17:32:45.519 INFO:tasks.workunit.client.0.smithi037.stderr: -201> 2024-09-12T17:32:45.157+0000 7f62ea542800 5 AuthRegistry(0x559a921be170) adding con mode: crc 2024-09-12T17:32:45.519 INFO:tasks.workunit.client.0.smithi037.stderr: -200> 2024-09-12T17:32:45.157+0000 7f62ea542800 5 AuthRegistry(0x559a921be170) adding con mode: secure 2024-09-12T17:32:45.519 INFO:tasks.workunit.client.0.smithi037.stderr: -199> 2024-09-12T17:32:45.157+0000 7f62ea542800 5 AuthRegistry(0x559a921be170) adding con mode: crc 2024-09-12T17:32:45.519 INFO:tasks.workunit.client.0.smithi037.stderr: -198> 2024-09-12T17:32:45.157+0000 7f62ea542800 5 AuthRegistry(0x559a921be170) adding con mode: secure 2024-09-12T17:32:45.519 INFO:tasks.workunit.client.0.smithi037.stderr: -197> 2024-09-12T17:32:45.157+0000 7f62ea542800 5 AuthRegistry(0x559a921be170) adding con mode: crc 2024-09-12T17:32:45.519 INFO:tasks.workunit.client.0.smithi037.stderr: -196> 2024-09-12T17:32:45.157+0000 7f62ea542800 5 AuthRegistry(0x559a921be170) adding con mode: crc 2024-09-12T17:32:45.519 INFO:tasks.workunit.client.0.smithi037.stderr: -195> 2024-09-12T17:32:45.157+0000 7f62ea542800 5 AuthRegistry(0x559a921be170) adding con mode: secure 2024-09-12T17:32:45.519 INFO:tasks.workunit.client.0.smithi037.stderr: -194> 2024-09-12T17:32:45.157+0000 7f62ea542800 5 AuthRegistry(0x559a921be170) adding con mode: crc 2024-09-12T17:32:45.519 INFO:tasks.workunit.client.0.smithi037.stderr: -193> 2024-09-12T17:32:45.157+0000 7f62ea542800 5 AuthRegistry(0x559a921be170) adding con mode: secure 2024-09-12T17:32:45.519 INFO:tasks.workunit.client.0.smithi037.stderr: -192> 2024-09-12T17:32:45.157+0000 7f62ea542800 5 AuthRegistry(0x559a921be170) adding con mode: crc 2024-09-12T17:32:45.519 INFO:tasks.workunit.client.0.smithi037.stderr: -191> 2024-09-12T17:32:45.157+0000 7f62ea542800 5 AuthRegistry(0x559a921be170) adding con mode: secure 2024-09-12T17:32:45.519 INFO:tasks.workunit.client.0.smithi037.stderr: -190> 2024-09-12T17:32:45.157+0000 7f62ea542800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:32:45.519 INFO:tasks.workunit.client.0.smithi037.stderr: -189> 2024-09-12T17:32:45.157+0000 7f62ea542800 1 librados: starting msgr at 2024-09-12T17:32:45.520 INFO:tasks.workunit.client.0.smithi037.stderr: -188> 2024-09-12T17:32:45.157+0000 7f62ea542800 1 librados: starting objecter 2024-09-12T17:32:45.520 INFO:tasks.workunit.client.0.smithi037.stderr: -187> 2024-09-12T17:32:45.157+0000 7f62ea542800 5 asok(0x559a91ed1730) register_command objecter_requests cmddesc objecter_requests hook 0x559a92171d50 EEXIST 2024-09-12T17:32:45.520 INFO:tasks.workunit.client.0.smithi037.stderr: -186> 2024-09-12T17:32:45.157+0000 7f62ea542800 1 librados: setting wanted keys 2024-09-12T17:32:45.520 INFO:tasks.workunit.client.0.smithi037.stderr: -185> 2024-09-12T17:32:45.157+0000 7f62ea542800 1 librados: calling monclient init 2024-09-12T17:32:45.520 INFO:tasks.workunit.client.0.smithi037.stderr: -184> 2024-09-12T17:32:45.157+0000 7f62ea542800 10 monclient: init 2024-09-12T17:32:45.520 INFO:tasks.workunit.client.0.smithi037.stderr: -183> 2024-09-12T17:32:45.157+0000 7f62ea542800 5 AuthRegistry(0x559a92187ca0) adding auth protocol: cephx 2024-09-12T17:32:45.520 INFO:tasks.workunit.client.0.smithi037.stderr: -182> 2024-09-12T17:32:45.157+0000 7f62ea542800 5 AuthRegistry(0x559a92187ca0) adding auth protocol: cephx 2024-09-12T17:32:45.520 INFO:tasks.workunit.client.0.smithi037.stderr: -181> 2024-09-12T17:32:45.157+0000 7f62ea542800 5 AuthRegistry(0x559a92187ca0) adding auth protocol: cephx 2024-09-12T17:32:45.520 INFO:tasks.workunit.client.0.smithi037.stderr: -180> 2024-09-12T17:32:45.157+0000 7f62ea542800 5 AuthRegistry(0x559a92187ca0) adding con mode: secure 2024-09-12T17:32:45.520 INFO:tasks.workunit.client.0.smithi037.stderr: -179> 2024-09-12T17:32:45.157+0000 7f62ea542800 5 AuthRegistry(0x559a92187ca0) adding con mode: crc 2024-09-12T17:32:45.520 INFO:tasks.workunit.client.0.smithi037.stderr: -178> 2024-09-12T17:32:45.157+0000 7f62ea542800 5 AuthRegistry(0x559a92187ca0) adding con mode: secure 2024-09-12T17:32:45.520 INFO:tasks.workunit.client.0.smithi037.stderr: -177> 2024-09-12T17:32:45.157+0000 7f62ea542800 5 AuthRegistry(0x559a92187ca0) adding con mode: crc 2024-09-12T17:32:45.520 INFO:tasks.workunit.client.0.smithi037.stderr: -176> 2024-09-12T17:32:45.157+0000 7f62ea542800 5 AuthRegistry(0x559a92187ca0) adding con mode: secure 2024-09-12T17:32:45.521 INFO:tasks.workunit.client.0.smithi037.stderr: -175> 2024-09-12T17:32:45.157+0000 7f62ea542800 5 AuthRegistry(0x559a92187ca0) adding con mode: crc 2024-09-12T17:32:45.521 INFO:tasks.workunit.client.0.smithi037.stderr: -174> 2024-09-12T17:32:45.157+0000 7f62ea542800 5 AuthRegistry(0x559a92187ca0) adding con mode: crc 2024-09-12T17:32:45.521 INFO:tasks.workunit.client.0.smithi037.stderr: -173> 2024-09-12T17:32:45.157+0000 7f62ea542800 5 AuthRegistry(0x559a92187ca0) adding con mode: secure 2024-09-12T17:32:45.521 INFO:tasks.workunit.client.0.smithi037.stderr: -172> 2024-09-12T17:32:45.157+0000 7f62ea542800 5 AuthRegistry(0x559a92187ca0) adding con mode: crc 2024-09-12T17:32:45.521 INFO:tasks.workunit.client.0.smithi037.stderr: -171> 2024-09-12T17:32:45.157+0000 7f62ea542800 5 AuthRegistry(0x559a92187ca0) adding con mode: secure 2024-09-12T17:32:45.521 INFO:tasks.workunit.client.0.smithi037.stderr: -170> 2024-09-12T17:32:45.157+0000 7f62ea542800 5 AuthRegistry(0x559a92187ca0) adding con mode: crc 2024-09-12T17:32:45.521 INFO:tasks.workunit.client.0.smithi037.stderr: -169> 2024-09-12T17:32:45.157+0000 7f62ea542800 5 AuthRegistry(0x559a92187ca0) adding con mode: secure 2024-09-12T17:32:45.521 INFO:tasks.workunit.client.0.smithi037.stderr: -168> 2024-09-12T17:32:45.157+0000 7f62ea542800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:32:45.521 INFO:tasks.workunit.client.0.smithi037.stderr: -167> 2024-09-12T17:32:45.158+0000 7f62ea542800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:32:45.521 INFO:tasks.workunit.client.0.smithi037.stderr: -166> 2024-09-12T17:32:45.158+0000 7f62ea542800 5 asok(0x559a91ed1730) register_command rotate-key cmddesc rotate-key hook 0x559a92187de8 EEXIST 2024-09-12T17:32:45.521 INFO:tasks.workunit.client.0.smithi037.stderr: -165> 2024-09-12T17:32:45.158+0000 7f62ea542800 10 monclient: _reopen_session rank -1 2024-09-12T17:32:45.521 INFO:tasks.workunit.client.0.smithi037.stderr: -164> 2024-09-12T17:32:45.158+0000 7f62ea542800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T17:32:45.521 INFO:tasks.workunit.client.0.smithi037.stderr: -163> 2024-09-12T17:32:45.158+0000 7f62ea542800 10 monclient(hunting): picked mon.noname-b con 0x559a92193c70 addr [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] 2024-09-12T17:32:45.521 INFO:tasks.workunit.client.0.smithi037.stderr: -162> 2024-09-12T17:32:45.158+0000 7f62ea542800 10 monclient(hunting): picked mon.noname-a con 0x559a921bf4b0 addr [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] 2024-09-12T17:32:45.522 INFO:tasks.workunit.client.0.smithi037.stderr: -161> 2024-09-12T17:32:45.158+0000 7f62ea542800 10 monclient(hunting): picked mon.noname-c con 0x559a921c42c0 addr [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] 2024-09-12T17:32:45.522 INFO:tasks.workunit.client.0.smithi037.stderr: -160> 2024-09-12T17:32:45.158+0000 7f62ea542800 10 monclient(hunting): start opening mon connection 2024-09-12T17:32:45.522 INFO:tasks.workunit.client.0.smithi037.stderr: -159> 2024-09-12T17:32:45.158+0000 7f62ea542800 10 monclient(hunting): start opening mon connection 2024-09-12T17:32:45.522 INFO:tasks.workunit.client.0.smithi037.stderr: -158> 2024-09-12T17:32:45.158+0000 7f62ea542800 10 monclient(hunting): start opening mon connection 2024-09-12T17:32:45.522 INFO:tasks.workunit.client.0.smithi037.stderr: -157> 2024-09-12T17:32:45.158+0000 7f62ea542800 10 monclient(hunting): _renew_subs 2024-09-12T17:32:45.522 INFO:tasks.workunit.client.0.smithi037.stderr: -156> 2024-09-12T17:32:45.158+0000 7f62ea542800 10 monclient(hunting): authenticate will time out at 2152.755317s 2024-09-12T17:32:45.522 INFO:tasks.workunit.client.0.smithi037.stderr: -155> 2024-09-12T17:32:45.158+0000 7f62e5a85640 10 monclient(hunting): get_auth_request con 0x559a921bf4b0 auth_method 0 2024-09-12T17:32:45.522 INFO:tasks.workunit.client.0.smithi037.stderr: -154> 2024-09-12T17:32:45.158+0000 7f62e5a85640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:32:45.522 INFO:tasks.workunit.client.0.smithi037.stderr: -153> 2024-09-12T17:32:45.158+0000 7f62e5a85640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:32:45.522 INFO:tasks.workunit.client.0.smithi037.stderr: -152> 2024-09-12T17:32:45.158+0000 7f62e5a85640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:32:45.522 INFO:tasks.workunit.client.0.smithi037.stderr: -151> 2024-09-12T17:32:45.158+0000 7f62e6a87640 10 monclient(hunting): get_auth_request con 0x559a921c42c0 auth_method 0 2024-09-12T17:32:45.522 INFO:tasks.workunit.client.0.smithi037.stderr: -150> 2024-09-12T17:32:45.158+0000 7f62e6a87640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:32:45.522 INFO:tasks.workunit.client.0.smithi037.stderr: -149> 2024-09-12T17:32:45.158+0000 7f62e6a87640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:32:45.523 INFO:tasks.workunit.client.0.smithi037.stderr: -148> 2024-09-12T17:32:45.158+0000 7f62e6a87640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:32:45.523 INFO:tasks.workunit.client.0.smithi037.stderr: -147> 2024-09-12T17:32:45.158+0000 7f62e6286640 10 monclient(hunting): get_auth_request con 0x559a92193c70 auth_method 0 2024-09-12T17:32:45.523 INFO:tasks.workunit.client.0.smithi037.stderr: -146> 2024-09-12T17:32:45.158+0000 7f62e6286640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:32:45.523 INFO:tasks.workunit.client.0.smithi037.stderr: -145> 2024-09-12T17:32:45.158+0000 7f62e6286640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:32:45.523 INFO:tasks.workunit.client.0.smithi037.stderr: -144> 2024-09-12T17:32:45.158+0000 7f62e6286640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:32:45.523 INFO:tasks.workunit.client.0.smithi037.stderr: -143> 2024-09-12T17:32:45.158+0000 7f62e5a85640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:32:45.523 INFO:tasks.workunit.client.0.smithi037.stderr: -142> 2024-09-12T17:32:45.158+0000 7f62e5a85640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:32:45.523 INFO:tasks.workunit.client.0.smithi037.stderr: -141> 2024-09-12T17:32:45.158+0000 7f62e5a85640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:32:45.523 INFO:tasks.workunit.client.0.smithi037.stderr: -140> 2024-09-12T17:32:45.158+0000 7f62e6a87640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:32:45.523 INFO:tasks.workunit.client.0.smithi037.stderr: -139> 2024-09-12T17:32:45.158+0000 7f62e6a87640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:32:45.523 INFO:tasks.workunit.client.0.smithi037.stderr: -138> 2024-09-12T17:32:45.158+0000 7f62e6a87640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:32:45.523 INFO:tasks.workunit.client.0.smithi037.stderr: -137> 2024-09-12T17:32:45.158+0000 7f62e6286640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:32:45.523 INFO:tasks.workunit.client.0.smithi037.stderr: -136> 2024-09-12T17:32:45.158+0000 7f62e6286640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:32:45.523 INFO:tasks.workunit.client.0.smithi037.stderr: -135> 2024-09-12T17:32:45.158+0000 7f62e6286640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:32:45.524 INFO:tasks.workunit.client.0.smithi037.stderr: -134> 2024-09-12T17:32:45.158+0000 7f62e5a85640 10 monclient(hunting): handle_auth_done global_id 6654 payload 824 2024-09-12T17:32:45.524 INFO:tasks.workunit.client.0.smithi037.stderr: -133> 2024-09-12T17:32:45.158+0000 7f62e5a85640 10 monclient: _finish_hunting 0 2024-09-12T17:32:45.524 INFO:tasks.workunit.client.0.smithi037.stderr: -132> 2024-09-12T17:32:45.158+0000 7f62e5a85640 1 monclient: found mon.noname-a 2024-09-12T17:32:45.524 INFO:tasks.workunit.client.0.smithi037.stderr: -131> 2024-09-12T17:32:45.158+0000 7f62e5a85640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.37:3300/0 2024-09-12T17:32:45.524 INFO:tasks.workunit.client.0.smithi037.stderr: -130> 2024-09-12T17:32:45.158+0000 7f61b7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:32:45.524 INFO:tasks.workunit.client.0.smithi037.stderr: -129> 2024-09-12T17:32:45.158+0000 7f61b7fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:32:45.524 INFO:tasks.workunit.client.0.smithi037.stderr: -128> 2024-09-12T17:32:45.158+0000 7f61b7fff640 10 monclient: dump: 2024-09-12T17:32:45.524 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:32:45.524 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:32:45.524 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:32:45.524 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:32:45.524 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:32:45.524 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:32:45.525 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:32:45.525 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:32:45.525 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:32:45.525 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:32:45.525 INFO:tasks.workunit.client.0.smithi037.stderr: -127> 2024-09-12T17:32:45.158+0000 7f61b7fff640 10 monclient: _finish_auth 0 2024-09-12T17:32:45.525 INFO:tasks.workunit.client.0.smithi037.stderr: -126> 2024-09-12T17:32:45.158+0000 7f61b7fff640 10 monclient: _check_auth_tickets 2024-09-12T17:32:45.525 INFO:tasks.workunit.client.0.smithi037.stderr: -125> 2024-09-12T17:32:45.158+0000 7f61b7fff640 10 monclient: handle_config config(0 keys) 2024-09-12T17:32:45.525 INFO:tasks.workunit.client.0.smithi037.stderr: -124> 2024-09-12T17:32:45.158+0000 7f61b7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:32:45.525 INFO:tasks.workunit.client.0.smithi037.stderr: -123> 2024-09-12T17:32:45.158+0000 7f61b7fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:32:45.525 INFO:tasks.workunit.client.0.smithi037.stderr: -122> 2024-09-12T17:32:45.158+0000 7f61b7fff640 10 monclient: dump: 2024-09-12T17:32:45.525 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:32:45.525 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:32:45.525 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:32:45.525 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:32:45.526 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:32:45.526 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:32:45.526 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:32:45.526 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:32:45.526 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:32:45.526 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:32:45.526 INFO:tasks.workunit.client.0.smithi037.stderr: -121> 2024-09-12T17:32:45.158+0000 7f62ea542800 5 monclient: authenticate success, global_id 6654 2024-09-12T17:32:45.526 INFO:tasks.workunit.client.0.smithi037.stderr: -120> 2024-09-12T17:32:45.158+0000 7f61c9ffb640 4 set_mon_vals no callback set 2024-09-12T17:32:45.526 INFO:tasks.workunit.client.0.smithi037.stderr: -119> 2024-09-12T17:32:45.158+0000 7f62ea542800 10 monclient: _renew_subs 2024-09-12T17:32:45.526 INFO:tasks.workunit.client.0.smithi037.stderr: -118> 2024-09-12T17:32:45.158+0000 7f62ea542800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.37:3300/0 2024-09-12T17:32:45.526 INFO:tasks.workunit.client.0.smithi037.stderr: -117> 2024-09-12T17:32:45.159+0000 7f62ea542800 10 monclient: _renew_subs 2024-09-12T17:32:45.526 INFO:tasks.workunit.client.0.smithi037.stderr: -116> 2024-09-12T17:32:45.159+0000 7f62ea542800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.37:3300/0 2024-09-12T17:32:45.526 INFO:tasks.workunit.client.0.smithi037.stderr: -115> 2024-09-12T17:32:45.159+0000 7f62ea542800 1 librados: init done 2024-09-12T17:32:45.526 INFO:tasks.workunit.client.0.smithi037.stderr: -114> 2024-09-12T17:32:45.159+0000 7f62ea542800 5 asok(0x559a91ed1730) register_command cr dump hook 0x559a921bcb08 2024-09-12T17:32:45.527 INFO:tasks.workunit.client.0.smithi037.stderr: -113> 2024-09-12T17:32:45.160+0000 7f62ea542800 20 rados->read ofs=0 len=0 2024-09-12T17:32:45.527 INFO:tasks.workunit.client.0.smithi037.stderr: -112> 2024-09-12T17:32:45.161+0000 7f61b7fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:32:45.527 INFO:tasks.workunit.client.0.smithi037.stderr: -111> 2024-09-12T17:32:45.161+0000 7f61b7fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.40:6816/3916250676,v1:172.21.15.40:6817/3916250676] 2024-09-12T17:32:45.527 INFO:tasks.workunit.client.0.smithi037.stderr: -110> 2024-09-12T17:32:45.161+0000 7f61b7fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.40:6816/3916250676,v1:172.21.15.40:6817/3916250676] 2024-09-12T17:32:45.527 INFO:tasks.workunit.client.0.smithi037.stderr: -109> 2024-09-12T17:32:45.161+0000 7f62e6286640 10 monclient: get_auth_request con 0x7f61b00764a0 auth_method 0 2024-09-12T17:32:45.527 INFO:tasks.workunit.client.0.smithi037.stderr: -108> 2024-09-12T17:32:45.161+0000 7f62e6a87640 10 monclient: get_auth_request con 0x559a921ddde0 auth_method 0 2024-09-12T17:32:45.527 INFO:tasks.workunit.client.0.smithi037.stderr: -107> 2024-09-12T17:32:45.162+0000 7f62ea542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:45.527 INFO:tasks.workunit.client.0.smithi037.stderr: -106> 2024-09-12T17:32:45.162+0000 7f62ea542800 20 realm 2024-09-12T17:32:45.527 INFO:tasks.workunit.client.0.smithi037.stderr: -105> 2024-09-12T17:32:45.162+0000 7f62ea542800 20 rados->read ofs=0 len=0 2024-09-12T17:32:45.527 INFO:tasks.workunit.client.0.smithi037.stderr: -104> 2024-09-12T17:32:45.162+0000 7f62ea542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:45.527 INFO:tasks.workunit.client.0.smithi037.stderr: -103> 2024-09-12T17:32:45.162+0000 7f62ea542800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:32:45.527 INFO:tasks.workunit.client.0.smithi037.stderr: -102> 2024-09-12T17:32:45.162+0000 7f62ea542800 20 rados->read ofs=0 len=0 2024-09-12T17:32:45.527 INFO:tasks.workunit.client.0.smithi037.stderr: -101> 2024-09-12T17:32:45.162+0000 7f62ea542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:45.527 INFO:tasks.workunit.client.0.smithi037.stderr: -100> 2024-09-12T17:32:45.162+0000 7f62ea542800 20 rados->read ofs=0 len=0 2024-09-12T17:32:45.528 INFO:tasks.workunit.client.0.smithi037.stderr: -99> 2024-09-12T17:32:45.162+0000 7f62e6286640 10 monclient: get_auth_request con 0x559a921e2180 auth_method 0 2024-09-12T17:32:45.528 INFO:tasks.workunit.client.0.smithi037.stderr: -98> 2024-09-12T17:32:45.163+0000 7f62ea542800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:45.528 INFO:tasks.workunit.client.0.smithi037.stderr: -97> 2024-09-12T17:32:45.163+0000 7f62ea542800 20 rados->read ofs=0 len=0 2024-09-12T17:32:45.528 INFO:tasks.workunit.client.0.smithi037.stderr: -96> 2024-09-12T17:32:45.163+0000 7f62ea542800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:32:45.528 INFO:tasks.workunit.client.0.smithi037.stderr: -95> 2024-09-12T17:32:45.163+0000 7f62ea542800 20 searching for the correct realm 2024-09-12T17:32:45.528 INFO:tasks.workunit.client.0.smithi037.stderr: -94> 2024-09-12T17:32:45.164+0000 7f62e5a85640 10 monclient: get_auth_request con 0x559a921e7290 auth_method 0 2024-09-12T17:32:45.528 INFO:tasks.workunit.client.0.smithi037.stderr: -93> 2024-09-12T17:32:45.164+0000 7f62e6a87640 10 monclient: get_auth_request con 0x7f62d0035030 auth_method 0 2024-09-12T17:32:45.528 INFO:tasks.workunit.client.0.smithi037.stderr: -92> 2024-09-12T17:32:45.165+0000 7f62e6286640 10 monclient: get_auth_request con 0x7f62e0056420 auth_method 0 2024-09-12T17:32:45.528 INFO:tasks.workunit.client.0.smithi037.stderr: -91> 2024-09-12T17:32:45.166+0000 7f62e5a85640 10 monclient: get_auth_request con 0x7f62d8086a90 auth_method 0 2024-09-12T17:32:45.528 INFO:tasks.workunit.client.0.smithi037.stderr: -90> 2024-09-12T17:32:45.166+0000 7f62e6a87640 0 -- 172.21.15.37:0/1799390293 >> [v2:172.21.15.40:6818/1210108009,v1:172.21.15.40:6819/1210108009] conn(0x7f62d0035030 msgr2=0x7f62d00a5a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:32:45.528 INFO:tasks.workunit.client.0.smithi037.stderr: -89> 2024-09-12T17:32:45.166+0000 7f61b7fff640 1 client.6654.objecter ms_handle_reset 0x7f62d0035030 session 0x7f62d006d070 osd.7 2024-09-12T17:32:45.528 INFO:tasks.workunit.client.0.smithi037.stderr: -88> 2024-09-12T17:32:45.166+0000 7f61b7fff640 10 monclient: _renew_subs 2024-09-12T17:32:45.528 INFO:tasks.workunit.client.0.smithi037.stderr: -87> 2024-09-12T17:32:45.166+0000 7f61b7fff640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.37:3300/0 2024-09-12T17:32:45.529 INFO:tasks.workunit.client.0.smithi037.stderr: -86> 2024-09-12T17:32:45.166+0000 7f62e6a87640 10 monclient: get_auth_request con 0x7f61b0086b40 auth_method 0 2024-09-12T17:32:45.529 INFO:tasks.workunit.client.0.smithi037.stderr: -85> 2024-09-12T17:32:45.168+0000 7f62e6a87640 10 monclient: get_auth_request con 0x7f62d001f070 auth_method 0 2024-09-12T17:32:45.529 INFO:tasks.workunit.client.0.smithi037.stderr: -84> 2024-09-12T17:32:45.170+0000 7f62e6286640 10 monclient: get_auth_request con 0x7f62d00018c0 auth_method 0 2024-09-12T17:32:45.529 INFO:tasks.workunit.client.0.smithi037.stderr: -83> 2024-09-12T17:32:45.170+0000 7f62e6286640 0 -- 172.21.15.37:0/1799390293 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7f62d00018c0 msgr2=0x7f62d002a9e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:32:45.529 INFO:tasks.workunit.client.0.smithi037.stderr: -82> 2024-09-12T17:32:45.372+0000 7f62e6286640 10 monclient: get_auth_request con 0x7f62d00018c0 auth_method 0 2024-09-12T17:32:45.529 INFO:tasks.workunit.client.0.smithi037.stderr: -81> 2024-09-12T17:32:45.377+0000 7f62ea542800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:32:45.529 INFO:tasks.workunit.client.0.smithi037.stderr: -80> 2024-09-12T17:32:45.377+0000 7f62ea542800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:32:45.529 INFO:tasks.workunit.client.0.smithi037.stderr: -79> 2024-09-12T17:32:45.377+0000 7f62ea542800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:32:45.529 INFO:tasks.workunit.client.0.smithi037.stderr: -78> 2024-09-12T17:32:45.377+0000 7f62ea542800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:32:45.529 INFO:tasks.workunit.client.0.smithi037.stderr: -77> 2024-09-12T17:32:45.377+0000 7f62ea542800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:32:45.529 INFO:tasks.workunit.client.0.smithi037.stderr: -76> 2024-09-12T17:32:45.377+0000 7f62ea542800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:32:45.529 INFO:tasks.workunit.client.0.smithi037.stderr: -75> 2024-09-12T17:32:45.377+0000 7f62ea542800 20 rados->read ofs=0 len=0 2024-09-12T17:32:45.529 INFO:tasks.workunit.client.0.smithi037.stderr: -74> 2024-09-12T17:32:45.377+0000 7f62ea542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:45.529 INFO:tasks.workunit.client.0.smithi037.stderr: -73> 2024-09-12T17:32:45.377+0000 7f62ea542800 20 rados->read ofs=0 len=0 2024-09-12T17:32:45.530 INFO:tasks.workunit.client.0.smithi037.stderr: -72> 2024-09-12T17:32:45.377+0000 7f62ea542800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:45.530 INFO:tasks.workunit.client.0.smithi037.stderr: -71> 2024-09-12T17:32:45.377+0000 7f62ea542800 20 rados->read ofs=0 len=0 2024-09-12T17:32:45.530 INFO:tasks.workunit.client.0.smithi037.stderr: -70> 2024-09-12T17:32:45.377+0000 7f62ea542800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:32:45.530 INFO:tasks.workunit.client.0.smithi037.stderr: -69> 2024-09-12T17:32:45.377+0000 7f62ea542800 20 zone default found 2024-09-12T17:32:45.530 INFO:tasks.workunit.client.0.smithi037.stderr: -68> 2024-09-12T17:32:45.378+0000 7f62ea542800 4 Realm: () 2024-09-12T17:32:45.530 INFO:tasks.workunit.client.0.smithi037.stderr: -67> 2024-09-12T17:32:45.378+0000 7f62ea542800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:32:45.530 INFO:tasks.workunit.client.0.smithi037.stderr: -66> 2024-09-12T17:32:45.378+0000 7f62ea542800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:32:45.530 INFO:tasks.workunit.client.0.smithi037.stderr: -65> 2024-09-12T17:32:45.378+0000 7f62ea542800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:32:45.530 INFO:tasks.workunit.client.0.smithi037.stderr: -64> 2024-09-12T17:32:45.378+0000 7f62ea542800 20 zonegroup default 2024-09-12T17:32:45.530 INFO:tasks.workunit.client.0.smithi037.stderr: -63> 2024-09-12T17:32:45.378+0000 7f62ea542800 20 rados->read ofs=0 len=0 2024-09-12T17:32:45.530 INFO:tasks.workunit.client.0.smithi037.stderr: -62> 2024-09-12T17:32:45.378+0000 7f62ea542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:45.530 INFO:tasks.workunit.client.0.smithi037.stderr: -61> 2024-09-12T17:32:45.378+0000 7f62ea542800 20 rados->read ofs=0 len=0 2024-09-12T17:32:45.530 INFO:tasks.workunit.client.0.smithi037.stderr: -60> 2024-09-12T17:32:45.378+0000 7f62ea542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:45.530 INFO:tasks.workunit.client.0.smithi037.stderr: -59> 2024-09-12T17:32:45.378+0000 7f62ea542800 20 rados->read ofs=0 len=0 2024-09-12T17:32:45.531 INFO:tasks.workunit.client.0.smithi037.stderr: -58> 2024-09-12T17:32:45.379+0000 7f62ea542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:45.531 INFO:tasks.workunit.client.0.smithi037.stderr: -57> 2024-09-12T17:32:45.379+0000 7f62ea542800 20 started sync module instance, tier type = 2024-09-12T17:32:45.531 INFO:tasks.workunit.client.0.smithi037.stderr: -56> 2024-09-12T17:32:45.379+0000 7f62ea542800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:32:45.531 INFO:tasks.workunit.client.0.smithi037.stderr: -55> 2024-09-12T17:32:45.388+0000 7f62ea542800 20 add_watcher() i=0 2024-09-12T17:32:45.531 INFO:tasks.workunit.client.0.smithi037.stderr: -54> 2024-09-12T17:32:45.388+0000 7f62ea542800 20 add_watcher() i=1 2024-09-12T17:32:45.531 INFO:tasks.workunit.client.0.smithi037.stderr: -53> 2024-09-12T17:32:45.388+0000 7f62ea542800 20 add_watcher() i=2 2024-09-12T17:32:45.531 INFO:tasks.workunit.client.0.smithi037.stderr: -52> 2024-09-12T17:32:45.388+0000 7f62ea542800 20 add_watcher() i=3 2024-09-12T17:32:45.531 INFO:tasks.workunit.client.0.smithi037.stderr: -51> 2024-09-12T17:32:45.388+0000 7f62ea542800 20 add_watcher() i=4 2024-09-12T17:32:45.531 INFO:tasks.workunit.client.0.smithi037.stderr: -50> 2024-09-12T17:32:45.388+0000 7f62ea542800 20 add_watcher() i=5 2024-09-12T17:32:45.531 INFO:tasks.workunit.client.0.smithi037.stderr: -49> 2024-09-12T17:32:45.388+0000 7f62ea542800 20 add_watcher() i=6 2024-09-12T17:32:45.531 INFO:tasks.workunit.client.0.smithi037.stderr: -48> 2024-09-12T17:32:45.389+0000 7f62ea542800 20 add_watcher() i=7 2024-09-12T17:32:45.531 INFO:tasks.workunit.client.0.smithi037.stderr: -47> 2024-09-12T17:32:45.389+0000 7f62ea542800 2 all 8 watchers are set, enabling cache 2024-09-12T17:32:45.531 INFO:tasks.workunit.client.0.smithi037.stderr: -46> 2024-09-12T17:32:45.391+0000 7f62ea542800 5 AuthRegistry(0x7fff16f1c3a0) adding auth protocol: cephx 2024-09-12T17:32:45.531 INFO:tasks.workunit.client.0.smithi037.stderr: -45> 2024-09-12T17:32:45.391+0000 7f62ea542800 5 AuthRegistry(0x7fff16f1c3a0) adding auth protocol: cephx 2024-09-12T17:32:45.532 INFO:tasks.workunit.client.0.smithi037.stderr: -44> 2024-09-12T17:32:45.391+0000 7f62ea542800 5 AuthRegistry(0x7fff16f1c3a0) adding auth protocol: cephx 2024-09-12T17:32:45.532 INFO:tasks.workunit.client.0.smithi037.stderr: -43> 2024-09-12T17:32:45.391+0000 7f62ea542800 5 AuthRegistry(0x7fff16f1c3a0) adding con mode: secure 2024-09-12T17:32:45.532 INFO:tasks.workunit.client.0.smithi037.stderr: -42> 2024-09-12T17:32:45.391+0000 7f62ea542800 5 AuthRegistry(0x7fff16f1c3a0) adding con mode: crc 2024-09-12T17:32:45.532 INFO:tasks.workunit.client.0.smithi037.stderr: -41> 2024-09-12T17:32:45.391+0000 7f62ea542800 5 AuthRegistry(0x7fff16f1c3a0) adding con mode: secure 2024-09-12T17:32:45.532 INFO:tasks.workunit.client.0.smithi037.stderr: -40> 2024-09-12T17:32:45.391+0000 7f62ea542800 5 AuthRegistry(0x7fff16f1c3a0) adding con mode: crc 2024-09-12T17:32:45.532 INFO:tasks.workunit.client.0.smithi037.stderr: -39> 2024-09-12T17:32:45.391+0000 7f62ea542800 5 AuthRegistry(0x7fff16f1c3a0) adding con mode: secure 2024-09-12T17:32:45.532 INFO:tasks.workunit.client.0.smithi037.stderr: -38> 2024-09-12T17:32:45.391+0000 7f62ea542800 5 AuthRegistry(0x7fff16f1c3a0) adding con mode: crc 2024-09-12T17:32:45.532 INFO:tasks.workunit.client.0.smithi037.stderr: -37> 2024-09-12T17:32:45.391+0000 7f62ea542800 5 AuthRegistry(0x7fff16f1c3a0) adding con mode: crc 2024-09-12T17:32:45.532 INFO:tasks.workunit.client.0.smithi037.stderr: -36> 2024-09-12T17:32:45.391+0000 7f62ea542800 5 AuthRegistry(0x7fff16f1c3a0) adding con mode: secure 2024-09-12T17:32:45.532 INFO:tasks.workunit.client.0.smithi037.stderr: -35> 2024-09-12T17:32:45.391+0000 7f62ea542800 5 AuthRegistry(0x7fff16f1c3a0) adding con mode: crc 2024-09-12T17:32:45.532 INFO:tasks.workunit.client.0.smithi037.stderr: -34> 2024-09-12T17:32:45.391+0000 7f62ea542800 5 AuthRegistry(0x7fff16f1c3a0) adding con mode: secure 2024-09-12T17:32:45.532 INFO:tasks.workunit.client.0.smithi037.stderr: -33> 2024-09-12T17:32:45.391+0000 7f62ea542800 5 AuthRegistry(0x7fff16f1c3a0) adding con mode: crc 2024-09-12T17:32:45.533 INFO:tasks.workunit.client.0.smithi037.stderr: -32> 2024-09-12T17:32:45.391+0000 7f62ea542800 5 AuthRegistry(0x7fff16f1c3a0) adding con mode: secure 2024-09-12T17:32:45.533 INFO:tasks.workunit.client.0.smithi037.stderr: -31> 2024-09-12T17:32:45.391+0000 7f619cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:32:45.533 INFO:tasks.workunit.client.0.smithi037.stderr: -30> 2024-09-12T17:32:45.391+0000 7f62ea542800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:32:45.533 INFO:tasks.workunit.client.0.smithi037.stderr: -29> 2024-09-12T17:32:45.391+0000 7f62ea542800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:32:45.533 INFO:tasks.workunit.client.0.smithi037.stderr: -28> 2024-09-12T17:32:45.391+0000 7f62ea542800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:32:45.533 INFO:tasks.workunit.client.0.smithi037.stderr: -27> 2024-09-12T17:32:45.391+0000 7f62ea542800 5 asok(0x559a91ed1730) register_command cache list hook 0x559a921b93f0 2024-09-12T17:32:45.533 INFO:tasks.workunit.client.0.smithi037.stderr: -26> 2024-09-12T17:32:45.391+0000 7f62ea542800 5 asok(0x559a91ed1730) register_command cache inspect hook 0x559a921b93f0 2024-09-12T17:32:45.533 INFO:tasks.workunit.client.0.smithi037.stderr: -25> 2024-09-12T17:32:45.391+0000 7f62ea542800 5 asok(0x559a91ed1730) register_command cache erase hook 0x559a921b93f0 2024-09-12T17:32:45.533 INFO:tasks.workunit.client.0.smithi037.stderr: -24> 2024-09-12T17:32:45.391+0000 7f62ea542800 5 asok(0x559a91ed1730) register_command cache zap hook 0x559a921b93f0 2024-09-12T17:32:45.533 INFO:tasks.workunit.client.0.smithi037.stderr: -23> 2024-09-12T17:32:45.391+0000 7f62ea542800 5 note: GC not initialized 2024-09-12T17:32:45.533 INFO:tasks.workunit.client.0.smithi037.stderr: -22> 2024-09-12T17:32:45.392+0000 7f61177fe640 20 reqs_thread_entry: start 2024-09-12T17:32:45.533 INFO:tasks.workunit.client.0.smithi037.stderr: -21> 2024-09-12T17:32:45.392+0000 7f62ea542800 5 asok(0x559a91ed1730) register_command sync trace show hook 0x7f62e0004ee0 2024-09-12T17:32:45.533 INFO:tasks.workunit.client.0.smithi037.stderr: -20> 2024-09-12T17:32:45.392+0000 7f62ea542800 5 asok(0x559a91ed1730) register_command sync trace history hook 0x7f62e0004ee0 2024-09-12T17:32:45.533 INFO:tasks.workunit.client.0.smithi037.stderr: -19> 2024-09-12T17:32:45.392+0000 7f62ea542800 5 asok(0x559a91ed1730) register_command sync trace active hook 0x7f62e0004ee0 2024-09-12T17:32:45.534 INFO:tasks.workunit.client.0.smithi037.stderr: -18> 2024-09-12T17:32:45.392+0000 7f62ea542800 5 asok(0x559a91ed1730) register_command sync trace active_short hook 0x7f62e0004ee0 2024-09-12T17:32:45.534 INFO:tasks.workunit.client.0.smithi037.stderr: -17> 2024-09-12T17:32:45.392+0000 7f62ea542800 20 init_complete bucket index max shards: 11 2024-09-12T17:32:45.534 INFO:tasks.workunit.client.0.smithi037.stderr: -16> 2024-09-12T17:32:45.392+0000 7f62ea542800 20 Filter name: none 2024-09-12T17:32:45.534 INFO:tasks.workunit.client.0.smithi037.stderr: -15> 2024-09-12T17:32:45.392+0000 7f61157fa640 20 reqs_thread_entry: start 2024-09-12T17:32:45.534 INFO:tasks.workunit.client.0.smithi037.stderr: -14> 2024-09-12T17:32:45.392+0000 7f62ea542800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-12T17:32:45.534 INFO:tasks.workunit.client.0.smithi037.stderr: -13> 2024-09-12T17:32:45.392+0000 7f62ea542800 20 rados->read ofs=0 len=0 2024-09-12T17:32:45.534 INFO:tasks.workunit.client.0.smithi037.stderr: -12> 2024-09-12T17:32:45.393+0000 7f62ea542800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T17:32:45.534 INFO:tasks.workunit.client.0.smithi037.stderr: -11> 2024-09-12T17:32:45.393+0000 7f62ea542800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-12T17:32:45.534 INFO:tasks.workunit.client.0.smithi037.stderr: -10> 2024-09-12T17:32:45.393+0000 7f62ea542800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-12T17:32:45.534 INFO:tasks.workunit.client.0.smithi037.stderr: -9> 2024-09-12T17:32:45.393+0000 7f62ea542800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.25 : miss 2024-09-12T17:32:45.534 INFO:tasks.workunit.client.0.smithi037.stderr: -8> 2024-09-12T17:32:45.393+0000 7f62ea542800 20 rados->read ofs=0 len=0 2024-09-12T17:32:45.534 INFO:tasks.workunit.client.0.smithi037.stderr: -7> 2024-09-12T17:32:45.394+0000 7f62ea542800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T17:32:45.534 INFO:tasks.workunit.client.0.smithi037.stderr: -6> 2024-09-12T17:32:45.394+0000 7f62ea542800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.25 info.flags=0x17 2024-09-12T17:32:45.534 INFO:tasks.workunit.client.0.smithi037.stderr: -5> 2024-09-12T17:32:45.394+0000 7f62ea542800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.25 to cache LRU end 2024-09-12T17:32:45.535 INFO:tasks.workunit.client.0.smithi037.stderr: -4> 2024-09-12T17:32:45.394+0000 7f62ea542800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:32:45.535 INFO:tasks.workunit.client.0.smithi037.stderr: -3> 2024-09-12T17:32:45.394+0000 7f62ea542800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:32:45.535 INFO:tasks.workunit.client.0.smithi037.stderr: -2> 2024-09-12T17:32:45.394+0000 7f62ea542800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.25 2024-09-12T17:32:45.535 INFO:tasks.workunit.client.0.smithi037.stderr: -1> 2024-09-12T17:32:45.399+0000 7f62ea542800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f62ea542800 time 2024-09-12T17:32:45.398941+0000 2024-09-12T17:32:45.535 INFO:tasks.workunit.client.0.smithi037.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:32:45.535 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:32:45.535 INFO:tasks.workunit.client.0.smithi037.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:32:45.535 INFO:tasks.workunit.client.0.smithi037.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f62ebd8c71a] 2024-09-12T17:32:45.535 INFO:tasks.workunit.client.0.smithi037.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f62ebd8c8d8] 2024-09-12T17:32:45.535 INFO:tasks.workunit.client.0.smithi037.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559a91227841] 2024-09-12T17:32:45.535 INFO:tasks.workunit.client.0.smithi037.stderr: 4: radosgw-admin(+0xd73ca8) [0x559a91734ca8] 2024-09-12T17:32:45.535 INFO:tasks.workunit.client.0.smithi037.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x559a9123750d] 2024-09-12T17:32:45.535 INFO:tasks.workunit.client.0.smithi037.stderr: 6: main() 2024-09-12T17:32:45.536 INFO:tasks.workunit.client.0.smithi037.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f62eaa29590] 2024-09-12T17:32:45.536 INFO:tasks.workunit.client.0.smithi037.stderr: 8: __libc_start_main() 2024-09-12T17:32:45.536 INFO:tasks.workunit.client.0.smithi037.stderr: 9: _start() 2024-09-12T17:32:45.536 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:32:45.536 INFO:tasks.workunit.client.0.smithi037.stderr: 0> 2024-09-12T17:32:45.399+0000 7f62ea542800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:32:45.536 INFO:tasks.workunit.client.0.smithi037.stderr: in thread 7f62ea542800 thread_name:radosgw-admin 2024-09-12T17:32:45.536 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:32:45.536 INFO:tasks.workunit.client.0.smithi037.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:32:45.536 INFO:tasks.workunit.client.0.smithi037.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f62eaa3e6f0] 2024-09-12T17:32:45.536 INFO:tasks.workunit.client.0.smithi037.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f62eaa8b99c] 2024-09-12T17:32:45.536 INFO:tasks.workunit.client.0.smithi037.stderr: 3: raise() 2024-09-12T17:32:45.536 INFO:tasks.workunit.client.0.smithi037.stderr: 4: abort() 2024-09-12T17:32:45.536 INFO:tasks.workunit.client.0.smithi037.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f62ebd8c774] 2024-09-12T17:32:45.537 INFO:tasks.workunit.client.0.smithi037.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f62ebd8c8d8] 2024-09-12T17:32:45.537 INFO:tasks.workunit.client.0.smithi037.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559a91227841] 2024-09-12T17:32:45.537 INFO:tasks.workunit.client.0.smithi037.stderr: 8: radosgw-admin(+0xd73ca8) [0x559a91734ca8] 2024-09-12T17:32:45.537 INFO:tasks.workunit.client.0.smithi037.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x559a9123750d] 2024-09-12T17:32:45.537 INFO:tasks.workunit.client.0.smithi037.stderr: 10: main() 2024-09-12T17:32:45.537 INFO:tasks.workunit.client.0.smithi037.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f62eaa29590] 2024-09-12T17:32:45.537 INFO:tasks.workunit.client.0.smithi037.stderr: 12: __libc_start_main() 2024-09-12T17:32:45.537 INFO:tasks.workunit.client.0.smithi037.stderr: 13: _start() 2024-09-12T17:32:45.537 INFO:tasks.workunit.client.0.smithi037.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:32:45.537 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:32:45.537 INFO:tasks.workunit.client.0.smithi037.stderr:--- logging levels --- 2024-09-12T17:32:45.537 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 none 2024-09-12T17:32:45.537 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 lockdep 2024-09-12T17:32:45.538 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 context 2024-09-12T17:32:45.538 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 1 crush 2024-09-12T17:32:45.538 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mds 2024-09-12T17:32:45.538 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mds_balancer 2024-09-12T17:32:45.538 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mds_locker 2024-09-12T17:32:45.538 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mds_log 2024-09-12T17:32:45.538 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mds_log_expire 2024-09-12T17:32:45.538 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mds_migrator 2024-09-12T17:32:45.538 INFO:tasks.workunit.client.0.smithi037.stderr: 3/ 5 mds_quiesce 2024-09-12T17:32:45.538 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 buffer 2024-09-12T17:32:45.538 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 timer 2024-09-12T17:32:45.538 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 filer 2024-09-12T17:32:45.538 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 striper 2024-09-12T17:32:45.538 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 objecter 2024-09-12T17:32:45.539 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 rados 2024-09-12T17:32:45.539 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 rbd 2024-09-12T17:32:45.539 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 rbd_mirror 2024-09-12T17:32:45.539 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 rbd_replay 2024-09-12T17:32:45.539 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 rbd_pwl 2024-09-12T17:32:45.539 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 journaler 2024-09-12T17:32:45.539 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 objectcacher 2024-09-12T17:32:45.539 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:32:45.539 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 client 2024-09-12T17:32:45.539 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 osd 2024-09-12T17:32:45.539 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 optracker 2024-09-12T17:32:45.539 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 objclass 2024-09-12T17:32:45.539 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 3 filestore 2024-09-12T17:32:45.539 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 3 journal 2024-09-12T17:32:45.540 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 0 ms 2024-09-12T17:32:45.540 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mon 2024-09-12T17:32:45.540 INFO:tasks.workunit.client.0.smithi037.stderr: 0/10 monc 2024-09-12T17:32:45.540 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 paxos 2024-09-12T17:32:45.540 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 tp 2024-09-12T17:32:45.540 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 auth 2024-09-12T17:32:45.540 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 crypto 2024-09-12T17:32:45.540 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 1 finisher 2024-09-12T17:32:45.540 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 1 reserver 2024-09-12T17:32:45.540 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 heartbeatmap 2024-09-12T17:32:45.540 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 perfcounter 2024-09-12T17:32:45.540 INFO:tasks.workunit.client.0.smithi037.stderr: 20/20 rgw 2024-09-12T17:32:45.540 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 rgw_sync 2024-09-12T17:32:45.540 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 rgw_datacache 2024-09-12T17:32:45.541 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 rgw_access 2024-09-12T17:32:45.541 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:32:45.541 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 rgw_flight 2024-09-12T17:32:45.541 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:32:45.541 INFO:tasks.workunit.client.0.smithi037.stderr: 20/20 rgw_notification 2024-09-12T17:32:45.541 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 javaclient 2024-09-12T17:32:45.541 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 asok 2024-09-12T17:32:45.541 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 1 throttle 2024-09-12T17:32:45.541 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 0 refs 2024-09-12T17:32:45.541 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 compressor 2024-09-12T17:32:45.541 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 bluestore 2024-09-12T17:32:45.541 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 bluefs 2024-09-12T17:32:45.541 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 3 bdev 2024-09-12T17:32:45.541 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 kstore 2024-09-12T17:32:45.542 INFO:tasks.workunit.client.0.smithi037.stderr: 4/ 5 rocksdb 2024-09-12T17:32:45.542 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 fuse 2024-09-12T17:32:45.542 INFO:tasks.workunit.client.0.smithi037.stderr: 2/ 5 mgr 2024-09-12T17:32:45.542 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mgrc 2024-09-12T17:32:45.542 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 dpdk 2024-09-12T17:32:45.542 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 eventtrace 2024-09-12T17:32:45.542 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 prioritycache 2024-09-12T17:32:45.542 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 test 2024-09-12T17:32:45.542 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:32:45.542 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 cephsqlite 2024-09-12T17:32:45.542 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:32:45.542 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore 2024-09-12T17:32:45.542 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_onode 2024-09-12T17:32:45.542 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_odata 2024-09-12T17:32:45.543 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_omap 2024-09-12T17:32:45.543 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_tm 2024-09-12T17:32:45.543 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_t 2024-09-12T17:32:45.543 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:32:45.543 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_epm 2024-09-12T17:32:45.543 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_lba 2024-09-12T17:32:45.543 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:32:45.543 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_cache 2024-09-12T17:32:45.543 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_journal 2024-09-12T17:32:45.543 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_device 2024-09-12T17:32:45.543 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_backref 2024-09-12T17:32:45.543 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 alienstore 2024-09-12T17:32:45.543 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mclock 2024-09-12T17:32:45.543 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 cyanstore 2024-09-12T17:32:45.543 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 ceph_exporter 2024-09-12T17:32:45.544 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 memstore 2024-09-12T17:32:45.544 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 trace 2024-09-12T17:32:45.544 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 ceph_dedup 2024-09-12T17:32:45.544 INFO:tasks.workunit.client.0.smithi037.stderr: -2/-2 (syslog threshold) 2024-09-12T17:32:45.544 INFO:tasks.workunit.client.0.smithi037.stderr: 99/99 (stderr threshold) 2024-09-12T17:32:45.544 INFO:tasks.workunit.client.0.smithi037.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:32:45.544 INFO:tasks.workunit.client.0.smithi037.stderr: 7f61157fa640 / http_manager 2024-09-12T17:32:45.544 INFO:tasks.workunit.client.0.smithi037.stderr: 7f61177fe640 / http_manager 2024-09-12T17:32:45.544 INFO:tasks.workunit.client.0.smithi037.stderr: 7f619cfe1640 / rgw_dt_lg_renew 2024-09-12T17:32:45.544 INFO:tasks.workunit.client.0.smithi037.stderr: 7f61b7fff640 / ms_dispatch 2024-09-12T17:32:45.544 INFO:tasks.workunit.client.0.smithi037.stderr: 7f61c9ffb640 / io_context_pool 2024-09-12T17:32:45.544 INFO:tasks.workunit.client.0.smithi037.stderr: 7f61cbfff640 / ms_dispatch 2024-09-12T17:32:45.544 INFO:tasks.workunit.client.0.smithi037.stderr: 7f61d2e05640 / ms_dispatch 2024-09-12T17:32:45.544 INFO:tasks.workunit.client.0.smithi037.stderr: 7f61d4608640 / io_context_pool 2024-09-12T17:32:45.545 INFO:tasks.workunit.client.0.smithi037.stderr: 7f62e5a85640 / msgr-worker-2 2024-09-12T17:32:45.545 INFO:tasks.workunit.client.0.smithi037.stderr: 7f62e6286640 / msgr-worker-1 2024-09-12T17:32:45.545 INFO:tasks.workunit.client.0.smithi037.stderr: 7f62e6a87640 / msgr-worker-0 2024-09-12T17:32:45.545 INFO:tasks.workunit.client.0.smithi037.stderr: 7f62e7288640 / io_context_pool 2024-09-12T17:32:45.545 INFO:tasks.workunit.client.0.smithi037.stderr: 7f62ea542800 / radosgw-admin 2024-09-12T17:32:45.545 INFO:tasks.workunit.client.0.smithi037.stderr: max_recent 500 2024-09-12T17:32:45.545 INFO:tasks.workunit.client.0.smithi037.stderr: max_new 1000 2024-09-12T17:32:45.545 INFO:tasks.workunit.client.0.smithi037.stderr: log_file /var/lib/ceph/crash/2024-09-12T17:32:45.400613Z_09fb2683-2add-4a62-8c9f-1b87fb526a6e/log 2024-09-12T17:32:45.545 INFO:tasks.workunit.client.0.smithi037.stderr:--- end dump of recent events --- 2024-09-12T17:32:45.545 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-09-12T17:32:45.547 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:32:45.547 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:32:45.547 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.478+0000 7fe9d4523800 20 rados->read ofs=0 len=0 2024-09-12T17:32:45.547 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.480+0000 7fe9d4523800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:45.547 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.480+0000 7fe9d4523800 20 realm 2024-09-12T17:32:45.547 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.480+0000 7fe9d4523800 20 rados->read ofs=0 len=0 2024-09-12T17:32:45.547 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.480+0000 7fe9d4523800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:45.548 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.480+0000 7fe9d4523800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:32:45.548 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.480+0000 7fe9d4523800 20 rados->read ofs=0 len=0 2024-09-12T17:32:45.548 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.480+0000 7fe9d4523800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:45.548 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.480+0000 7fe9d4523800 20 rados->read ofs=0 len=0 2024-09-12T17:32:45.548 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.481+0000 7fe9d4523800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:45.548 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.481+0000 7fe9d4523800 20 rados->read ofs=0 len=0 2024-09-12T17:32:45.548 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.481+0000 7fe9d4523800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:32:45.548 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.481+0000 7fe9d4523800 20 searching for the correct realm 2024-09-12T17:32:45.548 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.484+0000 7fe9cfa12640 0 -- 172.21.15.37:0/2142397473 >> [v2:172.21.15.40:6800/2441293461,v1:172.21.15.40:6801/2441293461] conn(0x7fe9c001a040 msgr2=0x7fe9c0067a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:32:45.548 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.488+0000 7fe9d0213640 0 -- 172.21.15.37:0/2142397473 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7fe9c40bf130 msgr2=0x7fe9c40bf8c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:32:45.697 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.695+0000 7fe9d4523800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:32:45.697 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.695+0000 7fe9d4523800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:32:45.697 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.695+0000 7fe9d4523800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:32:45.697 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.695+0000 7fe9d4523800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:32:45.697 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.695+0000 7fe9d4523800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:32:45.698 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.695+0000 7fe9d4523800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:32:45.698 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.695+0000 7fe9d4523800 20 rados->read ofs=0 len=0 2024-09-12T17:32:45.698 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.695+0000 7fe9d4523800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:45.698 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.695+0000 7fe9d4523800 20 rados->read ofs=0 len=0 2024-09-12T17:32:45.698 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.695+0000 7fe9d4523800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:45.698 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.695+0000 7fe9d4523800 20 rados->read ofs=0 len=0 2024-09-12T17:32:45.698 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.696+0000 7fe9d4523800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:32:45.698 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.696+0000 7fe9d4523800 20 zone default found 2024-09-12T17:32:45.698 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.696+0000 7fe9d4523800 4 Realm: () 2024-09-12T17:32:45.698 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.696+0000 7fe9d4523800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:32:45.699 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.696+0000 7fe9d4523800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:32:45.699 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.696+0000 7fe9d4523800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:32:45.699 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.696+0000 7fe9d4523800 20 zonegroup default 2024-09-12T17:32:45.699 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.696+0000 7fe9d4523800 20 rados->read ofs=0 len=0 2024-09-12T17:32:45.699 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.696+0000 7fe9d4523800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:45.699 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.696+0000 7fe9d4523800 20 rados->read ofs=0 len=0 2024-09-12T17:32:45.699 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.696+0000 7fe9d4523800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:45.699 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.696+0000 7fe9d4523800 20 rados->read ofs=0 len=0 2024-09-12T17:32:45.700 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.697+0000 7fe9d4523800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:45.700 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.697+0000 7fe9d4523800 20 started sync module instance, tier type = 2024-09-12T17:32:45.700 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.697+0000 7fe9d4523800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:32:45.707 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.706+0000 7fe9d4523800 20 add_watcher() i=0 2024-09-12T17:32:45.707 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.706+0000 7fe9d4523800 20 add_watcher() i=1 2024-09-12T17:32:45.707 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.706+0000 7fe9d4523800 20 add_watcher() i=2 2024-09-12T17:32:45.707 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.706+0000 7fe9d4523800 20 add_watcher() i=3 2024-09-12T17:32:45.707 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.706+0000 7fe9d4523800 20 add_watcher() i=4 2024-09-12T17:32:45.708 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.706+0000 7fe9d4523800 20 add_watcher() i=5 2024-09-12T17:32:45.708 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.706+0000 7fe9d4523800 20 add_watcher() i=6 2024-09-12T17:32:45.708 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.707+0000 7fe9d4523800 20 add_watcher() i=7 2024-09-12T17:32:45.708 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.707+0000 7fe9d4523800 2 all 8 watchers are set, enabling cache 2024-09-12T17:32:45.710 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.709+0000 7fe886fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:32:45.711 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.709+0000 7fe9d4523800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:32:45.711 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.709+0000 7fe9d4523800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:32:45.711 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.709+0000 7fe9d4523800 5 note: GC not initialized 2024-09-12T17:32:45.711 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.710+0000 7fe885fdb640 20 reqs_thread_entry: start 2024-09-12T17:32:45.711 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.710+0000 7fe9d4523800 20 init_complete bucket index max shards: 11 2024-09-12T17:32:45.711 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.710+0000 7fe9d4523800 20 Filter name: none 2024-09-12T17:32:45.711 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.710+0000 7fe7f77fe640 20 reqs_thread_entry: start 2024-09-12T17:32:45.711 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.710+0000 7fe9d4523800 20 rados->read ofs=0 len=0 2024-09-12T17:32:45.712 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.710+0000 7fe9d4523800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T17:32:45.712 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.710+0000 7fe9d4523800 20 rados->read ofs=0 len=0 2024-09-12T17:32:45.712 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.711+0000 7fe9d4523800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T17:32:45.712 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.711+0000 7fe9d4523800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:32:45.712 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.711+0000 7fe9d4523800 20 rados->read ofs=0 len=0 2024-09-12T17:32:45.713 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.711+0000 7fe9d4523800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T17:32:45.713 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.712+0000 7fe9d4523800 20 rados->read ofs=0 len=0 2024-09-12T17:32:45.713 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.712+0000 7fe9d4523800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T17:32:45.713 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.712+0000 7fe9d4523800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:32:45.715 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.714+0000 7fe886fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:32:45.717 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.716+0000 7fe9d4523800 20 remove_watcher() i=0 2024-09-12T17:32:45.717 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.716+0000 7fe9d4523800 2 removed watcher, disabling cache 2024-09-12T17:32:45.718 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.717+0000 7fe9d4523800 20 remove_watcher() i=1 2024-09-12T17:32:45.719 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.718+0000 7fe9d4523800 20 remove_watcher() i=2 2024-09-12T17:32:45.720 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.719+0000 7fe9d4523800 20 remove_watcher() i=3 2024-09-12T17:32:45.721 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.720+0000 7fe9d4523800 20 remove_watcher() i=4 2024-09-12T17:32:45.722 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.721+0000 7fe9d4523800 20 remove_watcher() i=5 2024-09-12T17:32:45.723 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.722+0000 7fe9d4523800 20 remove_watcher() i=6 2024-09-12T17:32:45.724 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.723+0000 7fe9d4523800 20 remove_watcher() i=7 2024-09-12T17:32:45.735 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:32:45.735 INFO:tasks.workunit.client.0.smithi037.stderr:BUCKET_STATS: 2024-09-12T17:32:45.735 INFO:tasks.workunit.client.0.smithi037.stderr:bucket: abort-at-set-target-layout id: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.25 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:32:45.736 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:32:45.825 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:32:45.857 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:32:45.857 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:32:45.898 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.897+0000 7f318d010800 20 rados->read ofs=0 len=0 2024-09-12T17:32:45.899 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.898+0000 7f318d010800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:45.899 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.898+0000 7f318d010800 20 realm 2024-09-12T17:32:45.899 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.898+0000 7f318d010800 20 rados->read ofs=0 len=0 2024-09-12T17:32:45.900 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.898+0000 7f318d010800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:45.900 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.898+0000 7f318d010800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:32:45.900 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.898+0000 7f318d010800 20 rados->read ofs=0 len=0 2024-09-12T17:32:45.900 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.899+0000 7f318d010800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:45.900 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.899+0000 7f318d010800 20 rados->read ofs=0 len=0 2024-09-12T17:32:45.900 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.899+0000 7f318d010800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:45.901 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.899+0000 7f318d010800 20 rados->read ofs=0 len=0 2024-09-12T17:32:45.901 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.900+0000 7f318d010800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:32:45.901 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.900+0000 7f318d010800 20 searching for the correct realm 2024-09-12T17:32:45.903 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.903+0000 7f3188fbd640 0 -- 172.21.15.37:0/874636018 >> [v2:172.21.15.40:6818/1210108009,v1:172.21.15.40:6819/1210108009] conn(0x7f3170038060 msgr2=0x7f3170067a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:32:45.907 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:45.906+0000 7f31887bc640 0 -- 172.21.15.37:0/874636018 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7f3170068fd0 msgr2=0x7f3170082120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:32:46.114 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:46.112+0000 7f318d010800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:32:46.114 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:46.112+0000 7f318d010800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:32:46.115 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:46.112+0000 7f318d010800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:32:46.115 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:46.112+0000 7f318d010800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:32:46.115 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:46.112+0000 7f318d010800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:32:46.115 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:46.112+0000 7f318d010800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:32:46.115 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:46.112+0000 7f318d010800 20 rados->read ofs=0 len=0 2024-09-12T17:32:46.115 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:46.112+0000 7f318d010800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:46.115 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:46.112+0000 7f318d010800 20 rados->read ofs=0 len=0 2024-09-12T17:32:46.115 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:46.113+0000 7f318d010800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:46.115 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:46.113+0000 7f318d010800 20 rados->read ofs=0 len=0 2024-09-12T17:32:46.115 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:46.113+0000 7f318d010800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:32:46.115 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:46.113+0000 7f318d010800 20 zone default found 2024-09-12T17:32:46.115 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:46.113+0000 7f318d010800 4 Realm: () 2024-09-12T17:32:46.115 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:46.113+0000 7f318d010800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:32:46.115 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:46.113+0000 7f318d010800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:32:46.116 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:46.113+0000 7f318d010800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:32:46.116 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:46.113+0000 7f318d010800 20 zonegroup default 2024-09-12T17:32:46.116 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:46.113+0000 7f318d010800 20 rados->read ofs=0 len=0 2024-09-12T17:32:46.116 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:46.113+0000 7f318d010800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:46.116 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:46.113+0000 7f318d010800 20 rados->read ofs=0 len=0 2024-09-12T17:32:46.116 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:46.114+0000 7f318d010800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:46.116 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:46.114+0000 7f318d010800 20 rados->read ofs=0 len=0 2024-09-12T17:32:46.117 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:46.114+0000 7f318d010800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:46.117 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:46.114+0000 7f318d010800 20 started sync module instance, tier type = 2024-09-12T17:32:46.117 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:46.114+0000 7f318d010800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:32:46.124 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:46.123+0000 7f318d010800 20 add_watcher() i=0 2024-09-12T17:32:46.124 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:46.123+0000 7f318d010800 20 add_watcher() i=1 2024-09-12T17:32:46.124 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:46.123+0000 7f318d010800 20 add_watcher() i=2 2024-09-12T17:32:46.125 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:46.123+0000 7f318d010800 20 add_watcher() i=3 2024-09-12T17:32:46.125 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:46.123+0000 7f318d010800 20 add_watcher() i=4 2024-09-12T17:32:46.125 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:46.123+0000 7f318d010800 20 add_watcher() i=5 2024-09-12T17:32:46.125 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:46.123+0000 7f318d010800 20 add_watcher() i=6 2024-09-12T17:32:46.125 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:46.124+0000 7f318d010800 20 add_watcher() i=7 2024-09-12T17:32:46.125 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:46.124+0000 7f318d010800 2 all 8 watchers are set, enabling cache 2024-09-12T17:32:46.127 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:46.126+0000 7f303efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:32:46.130 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:46.127+0000 7f318d010800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:32:46.130 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:46.127+0000 7f318d010800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:32:46.130 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:46.127+0000 7f318d010800 5 note: GC not initialized 2024-09-12T17:32:46.130 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:46.127+0000 7f303dfe3640 20 reqs_thread_entry: start 2024-09-12T17:32:46.131 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:46.127+0000 7f318d010800 20 init_complete bucket index max shards: 11 2024-09-12T17:32:46.131 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:46.127+0000 7f318d010800 20 Filter name: none 2024-09-12T17:32:46.131 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:46.127+0000 7f3036ffd640 20 reqs_thread_entry: start 2024-09-12T17:32:46.131 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:46.127+0000 7f318d010800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-12T17:32:46.132 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:46.127+0000 7f318d010800 20 rados->read ofs=0 len=0 2024-09-12T17:32:46.132 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:46.128+0000 7f318d010800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T17:32:46.132 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:46.128+0000 7f318d010800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-12T17:32:46.132 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:46.128+0000 7f318d010800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-12T17:32:46.132 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:46.128+0000 7f318d010800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.25 : miss 2024-09-12T17:32:46.132 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:46.128+0000 7f318d010800 20 rados->read ofs=0 len=0 2024-09-12T17:32:46.133 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:46.128+0000 7f318d010800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T17:32:46.133 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:46.128+0000 7f318d010800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.25 info.flags=0x17 2024-09-12T17:32:46.133 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:46.128+0000 7f318d010800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.25 to cache LRU end 2024-09-12T17:32:46.133 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:46.128+0000 7f318d010800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:32:46.133 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:46.128+0000 7f318d010800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:32:46.134 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:46.128+0000 7f318d010800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.25 2024-09-12T17:32:46.135 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:46.130+0000 7f318d010800 0 INFO: RGWReshardLock::lock found lock on abort-at-set-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.25 to be held by another RGW process; skipping for now 2024-09-12T17:32:46.135 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:46.130+0000 7f303efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:32:46.135 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:46.133+0000 7f318d010800 20 remove_watcher() i=0 2024-09-12T17:32:46.135 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:46.133+0000 7f318d010800 2 removed watcher, disabling cache 2024-09-12T17:32:46.135 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:46.134+0000 7f318d010800 20 remove_watcher() i=1 2024-09-12T17:32:46.136 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:46.135+0000 7f318d010800 20 remove_watcher() i=2 2024-09-12T17:32:46.137 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:46.136+0000 7f318d010800 20 remove_watcher() i=3 2024-09-12T17:32:46.138 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:46.137+0000 7f318d010800 20 remove_watcher() i=4 2024-09-12T17:32:46.139 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:46.138+0000 7f318d010800 20 remove_watcher() i=5 2024-09-12T17:32:46.140 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:46.139+0000 7f318d010800 20 remove_watcher() i=6 2024-09-12T17:32:46.141 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:32:46.140+0000 7f318d010800 20 remove_watcher() i=7 2024-09-12T17:32:46.152 INFO:tasks.workunit.client.0.smithi037.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T17:33:16.184 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:33:16.223 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:33:16.223 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:33:16.268 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.267+0000 7fce0ed3c800 20 rados->read ofs=0 len=0 2024-09-12T17:33:16.270 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.269+0000 7fce0ed3c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:16.270 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.269+0000 7fce0ed3c800 20 realm 2024-09-12T17:33:16.270 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.269+0000 7fce0ed3c800 20 rados->read ofs=0 len=0 2024-09-12T17:33:16.270 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.269+0000 7fce0ed3c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:16.270 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.269+0000 7fce0ed3c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:33:16.270 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.269+0000 7fce0ed3c800 20 rados->read ofs=0 len=0 2024-09-12T17:33:16.270 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.269+0000 7fce0ed3c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:16.270 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.269+0000 7fce0ed3c800 20 rados->read ofs=0 len=0 2024-09-12T17:33:16.271 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.270+0000 7fce0ed3c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:33:16.271 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.270+0000 7fce0ed3c800 20 rados->read ofs=0 len=0 2024-09-12T17:33:16.271 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.270+0000 7fce0ed3c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:33:16.272 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.271+0000 7fce0ed3c800 20 searching for the correct realm 2024-09-12T17:33:16.274 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.274+0000 7fce0a280640 0 -- 172.21.15.37:0/2561407998 >> [v2:172.21.15.40:6800/2441293461,v1:172.21.15.40:6801/2441293461] conn(0x7fcdfc095070 msgr2=0x7fcdfc04d7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:33:16.482 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.481+0000 7fce0aa81640 0 -- 172.21.15.37:0/2561407998 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7fce00095b00 msgr2=0x7fce0009c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:33:16.689 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.688+0000 7fce0ed3c800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:33:16.690 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.688+0000 7fce0ed3c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:33:16.690 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.688+0000 7fce0ed3c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:33:16.690 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.688+0000 7fce0ed3c800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:33:16.690 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.688+0000 7fce0ed3c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:33:16.690 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.688+0000 7fce0ed3c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:33:16.690 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.688+0000 7fce0ed3c800 20 rados->read ofs=0 len=0 2024-09-12T17:33:16.690 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.689+0000 7fce0ed3c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:16.690 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.689+0000 7fce0ed3c800 20 rados->read ofs=0 len=0 2024-09-12T17:33:16.691 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.689+0000 7fce0ed3c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:33:16.692 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.689+0000 7fce0ed3c800 20 rados->read ofs=0 len=0 2024-09-12T17:33:16.692 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.690+0000 7fce0ed3c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:33:16.692 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.690+0000 7fce0ed3c800 20 zone default found 2024-09-12T17:33:16.692 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.690+0000 7fce0ed3c800 4 Realm: () 2024-09-12T17:33:16.692 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.690+0000 7fce0ed3c800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:33:16.692 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.690+0000 7fce0ed3c800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:33:16.692 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.690+0000 7fce0ed3c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:33:16.692 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.690+0000 7fce0ed3c800 20 zonegroup default 2024-09-12T17:33:16.692 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.690+0000 7fce0ed3c800 20 rados->read ofs=0 len=0 2024-09-12T17:33:16.692 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.690+0000 7fce0ed3c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:16.692 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.690+0000 7fce0ed3c800 20 rados->read ofs=0 len=0 2024-09-12T17:33:16.692 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.691+0000 7fce0ed3c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:16.693 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.691+0000 7fce0ed3c800 20 rados->read ofs=0 len=0 2024-09-12T17:33:16.693 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.691+0000 7fce0ed3c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:16.693 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.691+0000 7fce0ed3c800 20 started sync module instance, tier type = 2024-09-12T17:33:16.693 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.691+0000 7fce0ed3c800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:33:16.704 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.703+0000 7fce0ed3c800 20 add_watcher() i=0 2024-09-12T17:33:16.704 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.703+0000 7fce0ed3c800 20 add_watcher() i=1 2024-09-12T17:33:16.704 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.703+0000 7fce0ed3c800 20 add_watcher() i=2 2024-09-12T17:33:16.704 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.703+0000 7fce0ed3c800 20 add_watcher() i=3 2024-09-12T17:33:16.704 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.703+0000 7fce0ed3c800 20 add_watcher() i=4 2024-09-12T17:33:16.704 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.703+0000 7fce0ed3c800 20 add_watcher() i=5 2024-09-12T17:33:16.704 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.703+0000 7fce0ed3c800 20 add_watcher() i=6 2024-09-12T17:33:16.705 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.704+0000 7fce0ed3c800 20 add_watcher() i=7 2024-09-12T17:33:16.705 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.704+0000 7fce0ed3c800 2 all 8 watchers are set, enabling cache 2024-09-12T17:33:16.707 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.707+0000 7fccc17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:33:16.708 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.707+0000 7fce0ed3c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:33:16.708 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.707+0000 7fce0ed3c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:33:16.708 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.707+0000 7fce0ed3c800 5 note: GC not initialized 2024-09-12T17:33:16.709 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.707+0000 7fcc3bfff640 20 reqs_thread_entry: start 2024-09-12T17:33:16.709 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.708+0000 7fce0ed3c800 20 init_complete bucket index max shards: 11 2024-09-12T17:33:16.709 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.708+0000 7fce0ed3c800 20 Filter name: none 2024-09-12T17:33:16.709 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.708+0000 7fcc39ffb640 20 reqs_thread_entry: start 2024-09-12T17:33:16.709 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.708+0000 7fce0ed3c800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-12T17:33:16.709 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.708+0000 7fce0ed3c800 20 rados->read ofs=0 len=0 2024-09-12T17:33:16.710 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.708+0000 7fce0ed3c800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T17:33:16.710 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.708+0000 7fce0ed3c800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-12T17:33:16.710 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.708+0000 7fce0ed3c800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-12T17:33:16.710 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.708+0000 7fce0ed3c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.25 : miss 2024-09-12T17:33:16.710 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.708+0000 7fce0ed3c800 20 rados->read ofs=0 len=0 2024-09-12T17:33:16.711 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.709+0000 7fce0ed3c800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T17:33:16.711 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.709+0000 7fce0ed3c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.25 info.flags=0x17 2024-09-12T17:33:16.711 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.709+0000 7fce0ed3c800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.25 to cache LRU end 2024-09-12T17:33:16.711 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.709+0000 7fce0ed3c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:33:16.711 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.709+0000 7fce0ed3c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:33:16.711 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.709+0000 7fce0ed3c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.25 2024-09-12T17:33:16.716 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.715+0000 7fce0ed3c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.25 info.flags=0x17 2024-09-12T17:33:16.716 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.715+0000 7fce0ed3c800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.25 to cache LRU end 2024-09-12T17:33:16.716 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.715+0000 7fce0ed3c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:33:16.716 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.715+0000 7fce0ed3c800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.25, ofs0, ns] 2024-09-12T17:33:16.716 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.715+0000 7fccee7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497047 cookie 94411735503952 notifier 6329 bl.length()=1009 2024-09-12T17:33:16.717 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.715+0000 7fccee7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.25 info.flags=0x17 2024-09-12T17:33:16.717 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.715+0000 7fccee7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.25 to cache LRU end 2024-09-12T17:33:16.717 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.715+0000 7fccee7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:33:16.718 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.717+0000 7fce0ed3c800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.25]): orig_sources= new_sources= 2024-09-12T17:33:16.718 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.717+0000 7fce0ed3c800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.25]): potential sources added=[] removed=[] 2024-09-12T17:33:16.718 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.717+0000 7fce0ed3c800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.25]): orig_dests= new_dests= 2024-09-12T17:33:16.718 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.717+0000 7fce0ed3c800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.25]): potential dests added=[] removed=[] 2024-09-12T17:33:16.724 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.723+0000 7fce0ed3c800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.25.1.0 2024-09-12T17:33:16.724 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.723+0000 7fce0ed3c800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.25.1.0 2024-09-12T17:33:16.724 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.723+0000 7fce0ed3c800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.25.1.1 2024-09-12T17:33:16.725 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.723+0000 7fce0ed3c800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.25.1.1 2024-09-12T17:33:16.725 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.723+0000 7fce0ed3c800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.25.1.2 2024-09-12T17:33:16.725 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.723+0000 7fce0ed3c800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.25.1.2 2024-09-12T17:33:16.725 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.723+0000 7fce0ed3c800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.25.1.3 2024-09-12T17:33:16.725 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.723+0000 7fce0ed3c800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.25.1.3 2024-09-12T17:33:16.725 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.723+0000 7fce0ed3c800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.25.1.4 2024-09-12T17:33:16.725 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.723+0000 7fce0ed3c800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.25.1.4 2024-09-12T17:33:16.725 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.723+0000 7fce0ed3c800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.25.1.5 2024-09-12T17:33:16.725 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.723+0000 7fce0ed3c800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.25.1.5 2024-09-12T17:33:16.725 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.723+0000 7fce0ed3c800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.25.1.6 2024-09-12T17:33:16.725 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.723+0000 7fce0ed3c800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.25.1.6 2024-09-12T17:33:16.725 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.723+0000 7fce0ed3c800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.25.1.7 2024-09-12T17:33:16.725 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.723+0000 7fce0ed3c800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.25.1.7 2024-09-12T17:33:16.726 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.723+0000 7fce0ed3c800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.25.1.8 2024-09-12T17:33:16.726 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.723+0000 7fce0ed3c800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.25.1.8 2024-09-12T17:33:16.726 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.723+0000 7fce0ed3c800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.25.1.9 2024-09-12T17:33:16.726 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.723+0000 7fce0ed3c800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.25.1.9 2024-09-12T17:33:16.726 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.723+0000 7fce0ed3c800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.25.1.10 2024-09-12T17:33:16.726 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.723+0000 7fce0ed3c800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.25.1.10 2024-09-12T17:33:16.726 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.723+0000 7fce0ed3c800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.25.1.11 2024-09-12T17:33:16.726 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.723+0000 7fce0ed3c800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.25.1.11 2024-09-12T17:33:16.726 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.723+0000 7fce0ed3c800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.25.0 2024-09-12T17:33:16.726 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.724+0000 7fce0ed3c800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.25.1 2024-09-12T17:33:16.727 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.724+0000 7fce0ed3c800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.25.2 2024-09-12T17:33:16.727 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.725+0000 7fce0ed3c800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.25.3 2024-09-12T17:33:16.727 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.725+0000 7fce0ed3c800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.25.4 2024-09-12T17:33:16.727 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.726+0000 7fce0ed3c800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.25.5 2024-09-12T17:33:16.727 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.726+0000 7fce0ed3c800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.25.6 2024-09-12T17:33:16.728 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.727+0000 7fce0ed3c800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.25.7 2024-09-12T17:33:16.729 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.728+0000 7fce0ed3c800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.25.8 2024-09-12T17:33:16.729 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.729+0000 7fce0ed3c800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.25.9 2024-09-12T17:33:16.730 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.729+0000 7fce0ed3c800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.25.10 2024-09-12T17:33:16.733 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.733+0000 7fce0ed3c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.25 : hit (requested=0x17, cached=0x17) 2024-09-12T17:33:16.733 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.733+0000 7fce0ed3c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.25 2024-09-12T17:33:16.735 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.735+0000 7fce0ed3c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.25 info.flags=0x17 2024-09-12T17:33:16.735 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.735+0000 7fce0ed3c800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.25 to cache LRU end 2024-09-12T17:33:16.735 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.735+0000 7fce0ed3c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:33:16.735 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.735+0000 7fce0ed3c800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.25, ofs0, ns] 2024-09-12T17:33:16.736 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.735+0000 7fccee7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497048 cookie 94411735503952 notifier 6329 bl.length()=1009 2024-09-12T17:33:16.736 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.735+0000 7fccee7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.25 info.flags=0x17 2024-09-12T17:33:16.736 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.735+0000 7fccee7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.25 to cache LRU end 2024-09-12T17:33:16.736 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.735+0000 7fccee7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:33:16.738 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.737+0000 7fce0ed3c800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.25]): orig_sources= new_sources= 2024-09-12T17:33:16.738 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.737+0000 7fce0ed3c800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.25]): potential sources added=[] removed=[] 2024-09-12T17:33:16.738 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.737+0000 7fce0ed3c800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.25]): orig_dests= new_dests= 2024-09-12T17:33:16.738 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.737+0000 7fce0ed3c800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.25]): potential dests added=[] removed=[] 2024-09-12T17:33:16.741 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.740+0000 7fce0ed3c800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.25.0 2024-09-12T17:33:16.741 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.741+0000 7fce0ed3c800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.25.1 2024-09-12T17:33:16.742 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.741+0000 7fce0ed3c800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.25.2 2024-09-12T17:33:16.742 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.741+0000 7fce0ed3c800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.25.3 2024-09-12T17:33:16.742 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.742+0000 7fce0ed3c800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.25.4 2024-09-12T17:33:16.743 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.742+0000 7fce0ed3c800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.25.5 2024-09-12T17:33:16.743 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.742+0000 7fce0ed3c800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.25.6 2024-09-12T17:33:16.743 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.743+0000 7fce0ed3c800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.25.7 2024-09-12T17:33:16.744 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.743+0000 7fce0ed3c800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.25.8 2024-09-12T17:33:16.744 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.744+0000 7fce0ed3c800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.25.9 2024-09-12T17:33:16.745 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.744+0000 7fce0ed3c800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.25.10 2024-09-12T17:33:16.745 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.744+0000 7fce0ed3c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.25 : hit (requested=0x17, cached=0x17) 2024-09-12T17:33:16.745 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.744+0000 7fce0ed3c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.25 2024-09-12T17:33:16.747 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.746+0000 7fce0ed3c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.25 info.flags=0x17 2024-09-12T17:33:16.747 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.746+0000 7fce0ed3c800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.25 to cache LRU end 2024-09-12T17:33:16.747 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.746+0000 7fce0ed3c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:33:16.747 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.746+0000 7fce0ed3c800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.25, ofs0, ns] 2024-09-12T17:33:16.747 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.746+0000 7fccedffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497049 cookie 94411735503952 notifier 6329 bl.length()=977 2024-09-12T17:33:16.747 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.746+0000 7fccedffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.25 info.flags=0x17 2024-09-12T17:33:16.747 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.746+0000 7fccedffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.25 to cache LRU end 2024-09-12T17:33:16.747 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.746+0000 7fccedffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:33:16.749 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.748+0000 7fce0ed3c800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.25]): orig_sources= new_sources= 2024-09-12T17:33:16.749 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.748+0000 7fce0ed3c800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.25]): potential sources added=[] removed=[] 2024-09-12T17:33:16.749 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.748+0000 7fce0ed3c800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.25]): orig_dests= new_dests= 2024-09-12T17:33:16.749 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.748+0000 7fce0ed3c800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.25]): potential dests added=[] removed=[] 2024-09-12T17:33:16.751 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.751+0000 7fce0ed3c800 1 execute INFO: reshard of bucket "abort-at-set-target-layout" from 11 shards to 12 shards completed successfully 2024-09-12T17:33:16.754 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.753+0000 7fccc17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:33:16.756 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.756+0000 7fce0ed3c800 20 remove_watcher() i=0 2024-09-12T17:33:16.756 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.756+0000 7fce0ed3c800 2 removed watcher, disabling cache 2024-09-12T17:33:16.758 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.757+0000 7fce0ed3c800 20 remove_watcher() i=1 2024-09-12T17:33:16.759 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.758+0000 7fce0ed3c800 20 remove_watcher() i=2 2024-09-12T17:33:16.760 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.759+0000 7fce0ed3c800 20 remove_watcher() i=3 2024-09-12T17:33:16.761 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.760+0000 7fce0ed3c800 20 remove_watcher() i=4 2024-09-12T17:33:16.762 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.761+0000 7fce0ed3c800 20 remove_watcher() i=5 2024-09-12T17:33:16.763 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.762+0000 7fce0ed3c800 20 remove_watcher() i=6 2024-09-12T17:33:16.764 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.764+0000 7fce0ed3c800 20 remove_watcher() i=7 2024-09-12T17:33:16.778 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-09-12T17:33:16.809 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:33:16.809 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:33:16.849 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.848+0000 7f1252d2c800 20 rados->read ofs=0 len=0 2024-09-12T17:33:16.851 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.850+0000 7f1252d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:16.851 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.850+0000 7f1252d2c800 20 realm 2024-09-12T17:33:16.851 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.850+0000 7f1252d2c800 20 rados->read ofs=0 len=0 2024-09-12T17:33:16.851 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.850+0000 7f1252d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:16.851 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.850+0000 7f1252d2c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:33:16.851 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.850+0000 7f1252d2c800 20 rados->read ofs=0 len=0 2024-09-12T17:33:16.851 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.850+0000 7f1252d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:16.851 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.850+0000 7f1252d2c800 20 rados->read ofs=0 len=0 2024-09-12T17:33:16.852 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.851+0000 7f1252d2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:33:16.852 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.851+0000 7f1252d2c800 20 rados->read ofs=0 len=0 2024-09-12T17:33:16.852 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.851+0000 7f1252d2c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:33:16.852 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.851+0000 7f1252d2c800 20 searching for the correct realm 2024-09-12T17:33:16.855 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.855+0000 7f124f2db640 0 -- 172.21.15.37:0/3708480641 >> [v2:172.21.15.40:6818/1210108009,v1:172.21.15.40:6819/1210108009] conn(0x7f124403b070 msgr2=0x7f124403c910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:33:16.859 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:16.858+0000 7f124eada640 0 -- 172.21.15.37:0/3708480641 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7f124403b450 msgr2=0x7f124403b8b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:33:17.065 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:17.064+0000 7f1252d2c800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:33:17.066 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:17.064+0000 7f1252d2c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:33:17.066 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:17.064+0000 7f1252d2c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:33:17.066 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:17.064+0000 7f1252d2c800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:33:17.066 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:17.064+0000 7f1252d2c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:33:17.066 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:17.064+0000 7f1252d2c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:33:17.066 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:17.064+0000 7f1252d2c800 20 rados->read ofs=0 len=0 2024-09-12T17:33:17.066 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:17.065+0000 7f1252d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:17.066 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:17.065+0000 7f1252d2c800 20 rados->read ofs=0 len=0 2024-09-12T17:33:17.067 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:17.065+0000 7f1252d2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:33:17.068 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:17.065+0000 7f1252d2c800 20 rados->read ofs=0 len=0 2024-09-12T17:33:17.068 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:17.066+0000 7f1252d2c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:33:17.068 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:17.066+0000 7f1252d2c800 20 zone default found 2024-09-12T17:33:17.068 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:17.066+0000 7f1252d2c800 4 Realm: () 2024-09-12T17:33:17.068 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:17.066+0000 7f1252d2c800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:33:17.068 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:17.066+0000 7f1252d2c800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:33:17.068 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:17.066+0000 7f1252d2c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:33:17.068 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:17.066+0000 7f1252d2c800 20 zonegroup default 2024-09-12T17:33:17.068 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:17.066+0000 7f1252d2c800 20 rados->read ofs=0 len=0 2024-09-12T17:33:17.068 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:17.066+0000 7f1252d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:17.068 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:17.066+0000 7f1252d2c800 20 rados->read ofs=0 len=0 2024-09-12T17:33:17.068 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:17.066+0000 7f1252d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:17.068 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:17.066+0000 7f1252d2c800 20 rados->read ofs=0 len=0 2024-09-12T17:33:17.069 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:17.066+0000 7f1252d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:17.069 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:17.067+0000 7f1252d2c800 20 started sync module instance, tier type = 2024-09-12T17:33:17.069 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:17.067+0000 7f1252d2c800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:33:17.078 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:17.077+0000 7f1252d2c800 20 add_watcher() i=0 2024-09-12T17:33:17.078 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:17.077+0000 7f1252d2c800 20 add_watcher() i=1 2024-09-12T17:33:17.078 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:17.077+0000 7f1252d2c800 20 add_watcher() i=2 2024-09-12T17:33:17.078 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:17.077+0000 7f1252d2c800 20 add_watcher() i=3 2024-09-12T17:33:17.078 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:17.077+0000 7f1252d2c800 20 add_watcher() i=4 2024-09-12T17:33:17.078 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:17.077+0000 7f1252d2c800 20 add_watcher() i=5 2024-09-12T17:33:17.078 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:17.077+0000 7f1252d2c800 20 add_watcher() i=6 2024-09-12T17:33:17.078 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:17.078+0000 7f1252d2c800 20 add_watcher() i=7 2024-09-12T17:33:17.079 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:17.078+0000 7f1252d2c800 2 all 8 watchers are set, enabling cache 2024-09-12T17:33:17.080 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:17.079+0000 7f1105fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:33:17.084 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:17.080+0000 7f1252d2c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:33:17.084 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:17.080+0000 7f1252d2c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:33:17.084 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:17.080+0000 7f1252d2c800 5 note: GC not initialized 2024-09-12T17:33:17.085 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:17.080+0000 7f1104fe1640 20 reqs_thread_entry: start 2024-09-12T17:33:17.085 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:17.080+0000 7f1252d2c800 20 init_complete bucket index max shards: 11 2024-09-12T17:33:17.085 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:17.080+0000 7f1252d2c800 20 Filter name: none 2024-09-12T17:33:17.085 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:17.080+0000 7f10fdffb640 20 reqs_thread_entry: start 2024-09-12T17:33:17.085 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:17.080+0000 7f1252d2c800 20 rados->read ofs=0 len=0 2024-09-12T17:33:17.085 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:17.081+0000 7f1252d2c800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T17:33:17.085 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:17.081+0000 7f1252d2c800 20 rados->read ofs=0 len=0 2024-09-12T17:33:17.085 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:17.082+0000 7f1252d2c800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T17:33:17.085 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:17.082+0000 7f1252d2c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:33:17.085 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:17.082+0000 7f1252d2c800 20 rados->read ofs=0 len=0 2024-09-12T17:33:17.085 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:17.082+0000 7f1252d2c800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T17:33:17.085 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:17.082+0000 7f1252d2c800 20 rados->read ofs=0 len=0 2024-09-12T17:33:17.085 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:17.083+0000 7f1252d2c800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T17:33:17.085 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:17.083+0000 7f1252d2c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:33:17.086 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:17.085+0000 7f1105fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:33:17.088 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:17.087+0000 7f1252d2c800 20 remove_watcher() i=0 2024-09-12T17:33:17.088 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:17.087+0000 7f1252d2c800 2 removed watcher, disabling cache 2024-09-12T17:33:17.089 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:17.088+0000 7f1252d2c800 20 remove_watcher() i=1 2024-09-12T17:33:17.090 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:17.089+0000 7f1252d2c800 20 remove_watcher() i=2 2024-09-12T17:33:17.091 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:17.091+0000 7f1252d2c800 20 remove_watcher() i=3 2024-09-12T17:33:17.092 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:17.092+0000 7f1252d2c800 20 remove_watcher() i=4 2024-09-12T17:33:17.093 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:17.093+0000 7f1252d2c800 20 remove_watcher() i=5 2024-09-12T17:33:17.095 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:17.094+0000 7f1252d2c800 20 remove_watcher() i=6 2024-09-12T17:33:17.095 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:17.095+0000 7f1252d2c800 20 remove_watcher() i=7 2024-09-12T17:33:17.107 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:33:17.107 INFO:tasks.workunit.client.0.smithi037.stderr:BUCKET_STATS: 2024-09-12T17:33:17.107 INFO:tasks.workunit.client.0.smithi037.stderr:bucket: abort-at-set-target-layout id: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.25 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T17:33:17.108 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:33:17.450 INFO:tasks.workunit.client.0.smithi037.stderr:TEST: reshard bucket with EIO injected at trim_reshard_log_entries 2024-09-12T17:33:17.450 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:33:18.244 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-12T17:33:18.273 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:33:18.273 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:33:18.312 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:18.312+0000 7fe534b0a800 20 rados->read ofs=0 len=0 2024-09-12T17:33:18.314 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:18.313+0000 7fe534b0a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:18.315 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:18.313+0000 7fe534b0a800 20 realm 2024-09-12T17:33:18.315 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:18.313+0000 7fe534b0a800 20 rados->read ofs=0 len=0 2024-09-12T17:33:18.315 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:18.314+0000 7fe534b0a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:18.315 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:18.314+0000 7fe534b0a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:33:18.315 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:18.314+0000 7fe534b0a800 20 rados->read ofs=0 len=0 2024-09-12T17:33:18.315 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:18.314+0000 7fe534b0a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:18.315 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:18.314+0000 7fe534b0a800 20 rados->read ofs=0 len=0 2024-09-12T17:33:18.316 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:18.315+0000 7fe534b0a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:33:18.316 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:18.315+0000 7fe534b0a800 20 rados->read ofs=0 len=0 2024-09-12T17:33:18.316 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:18.315+0000 7fe534b0a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:33:18.316 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:18.315+0000 7fe534b0a800 20 searching for the correct realm 2024-09-12T17:33:18.318 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:18.318+0000 7fe531df3640 0 -- 172.21.15.37:0/1669640237 >> [v2:172.21.15.40:6800/2441293461,v1:172.21.15.40:6801/2441293461] conn(0x7fe52407ca30 msgr2=0x7fe524007c90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:33:18.526 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:18.525+0000 7fe5325f4640 0 -- 172.21.15.37:0/1669640237 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7fe52805a460 msgr2=0x7fe52805a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:33:18.734 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:18.733+0000 7fe534b0a800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:33:18.734 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:18.733+0000 7fe534b0a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:33:18.734 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:18.733+0000 7fe534b0a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:33:18.734 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:18.733+0000 7fe534b0a800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:33:18.734 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:18.733+0000 7fe534b0a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:33:18.734 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:18.733+0000 7fe534b0a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:33:18.735 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:18.733+0000 7fe534b0a800 20 rados->read ofs=0 len=0 2024-09-12T17:33:18.735 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:18.733+0000 7fe534b0a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:18.735 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:18.733+0000 7fe534b0a800 20 rados->read ofs=0 len=0 2024-09-12T17:33:18.736 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:18.733+0000 7fe534b0a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:33:18.736 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:18.733+0000 7fe534b0a800 20 rados->read ofs=0 len=0 2024-09-12T17:33:18.736 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:18.734+0000 7fe534b0a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:33:18.736 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:18.734+0000 7fe534b0a800 20 zone default found 2024-09-12T17:33:18.736 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:18.734+0000 7fe534b0a800 4 Realm: () 2024-09-12T17:33:18.736 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:18.734+0000 7fe534b0a800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:33:18.737 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:18.734+0000 7fe534b0a800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:33:18.737 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:18.734+0000 7fe534b0a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:33:18.737 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:18.734+0000 7fe534b0a800 20 zonegroup default 2024-09-12T17:33:18.737 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:18.734+0000 7fe534b0a800 20 rados->read ofs=0 len=0 2024-09-12T17:33:18.737 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:18.734+0000 7fe534b0a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:18.737 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:18.734+0000 7fe534b0a800 20 rados->read ofs=0 len=0 2024-09-12T17:33:18.737 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:18.735+0000 7fe534b0a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:18.737 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:18.735+0000 7fe534b0a800 20 rados->read ofs=0 len=0 2024-09-12T17:33:18.737 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:18.735+0000 7fe534b0a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:18.737 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:18.735+0000 7fe534b0a800 20 started sync module instance, tier type = 2024-09-12T17:33:18.738 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:18.735+0000 7fe534b0a800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:33:18.747 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:18.746+0000 7fe534b0a800 20 add_watcher() i=0 2024-09-12T17:33:18.747 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:18.746+0000 7fe534b0a800 20 add_watcher() i=1 2024-09-12T17:33:18.747 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:18.746+0000 7fe534b0a800 20 add_watcher() i=2 2024-09-12T17:33:18.747 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:18.746+0000 7fe534b0a800 20 add_watcher() i=3 2024-09-12T17:33:18.747 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:18.746+0000 7fe534b0a800 20 add_watcher() i=4 2024-09-12T17:33:18.747 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:18.746+0000 7fe534b0a800 20 add_watcher() i=5 2024-09-12T17:33:18.748 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:18.746+0000 7fe534b0a800 20 add_watcher() i=6 2024-09-12T17:33:18.748 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:18.747+0000 7fe534b0a800 20 add_watcher() i=7 2024-09-12T17:33:18.748 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:18.747+0000 7fe534b0a800 2 all 8 watchers are set, enabling cache 2024-09-12T17:33:18.750 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:18.749+0000 7fe3e8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:33:18.752 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:18.750+0000 7fe534b0a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:33:18.752 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:18.750+0000 7fe534b0a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:33:18.752 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:18.750+0000 7fe534b0a800 5 note: GC not initialized 2024-09-12T17:33:18.752 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:18.750+0000 7fe3637fe640 20 reqs_thread_entry: start 2024-09-12T17:33:18.752 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:18.750+0000 7fe534b0a800 20 init_complete bucket index max shards: 11 2024-09-12T17:33:18.752 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:18.750+0000 7fe534b0a800 20 Filter name: none 2024-09-12T17:33:18.753 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:18.750+0000 7fe3617fa640 20 reqs_thread_entry: start 2024-09-12T17:33:18.753 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:18.750+0000 7fe534b0a800 20 rados->read ofs=0 len=0 2024-09-12T17:33:18.753 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:18.751+0000 7fe534b0a800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T17:33:18.753 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:18.751+0000 7fe534b0a800 20 rados->read ofs=0 len=0 2024-09-12T17:33:18.754 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:18.751+0000 7fe534b0a800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T17:33:18.754 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:18.752+0000 7fe534b0a800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:33:18.754 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:18.752+0000 7fe534b0a800 20 rados->read ofs=0 len=0 2024-09-12T17:33:18.754 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:18.752+0000 7fe534b0a800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T17:33:18.755 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:18.752+0000 7fe534b0a800 20 rados->read ofs=0 len=0 2024-09-12T17:33:18.755 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:18.753+0000 7fe534b0a800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T17:33:18.755 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:18.753+0000 7fe534b0a800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:33:18.756 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:18.754+0000 7fe3e8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:33:18.758 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:18.757+0000 7fe534b0a800 20 remove_watcher() i=0 2024-09-12T17:33:18.758 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:18.757+0000 7fe534b0a800 2 removed watcher, disabling cache 2024-09-12T17:33:18.759 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:18.758+0000 7fe534b0a800 20 remove_watcher() i=1 2024-09-12T17:33:18.760 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:18.759+0000 7fe534b0a800 20 remove_watcher() i=2 2024-09-12T17:33:18.761 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:18.760+0000 7fe534b0a800 20 remove_watcher() i=3 2024-09-12T17:33:18.762 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:18.762+0000 7fe534b0a800 20 remove_watcher() i=4 2024-09-12T17:33:18.763 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:18.763+0000 7fe534b0a800 20 remove_watcher() i=5 2024-09-12T17:33:18.764 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:18.764+0000 7fe534b0a800 20 remove_watcher() i=6 2024-09-12T17:33:18.765 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:18.765+0000 7fe534b0a800 20 remove_watcher() i=7 2024-09-12T17:33:18.777 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:33:18.778 INFO:tasks.workunit.client.0.smithi037.stderr:BUCKET_STATS: 2024-09-12T17:33:18.778 INFO:tasks.workunit.client.0.smithi037.stderr:bucket: error-at-trim-reshard-log-entries id: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.26 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:33:18.778 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:33:18.779 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bucket reshard --bucket error-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at trim_reshard_log_entries 2024-09-12T17:33:18.816 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:33:18.816 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:33:18.857 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:18.856+0000 7fe02d917800 20 rados->read ofs=0 len=0 2024-09-12T17:33:18.859 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:18.857+0000 7fe02d917800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:18.859 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:18.857+0000 7fe02d917800 20 realm 2024-09-12T17:33:18.859 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:18.857+0000 7fe02d917800 20 rados->read ofs=0 len=0 2024-09-12T17:33:18.859 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:18.858+0000 7fe02d917800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:18.860 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:18.858+0000 7fe02d917800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:33:18.860 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:18.858+0000 7fe02d917800 20 rados->read ofs=0 len=0 2024-09-12T17:33:18.860 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:18.858+0000 7fe02d917800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:18.860 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:18.858+0000 7fe02d917800 20 rados->read ofs=0 len=0 2024-09-12T17:33:18.861 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:18.859+0000 7fe02d917800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:33:18.861 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:18.859+0000 7fe02d917800 20 rados->read ofs=0 len=0 2024-09-12T17:33:18.861 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:18.859+0000 7fe02d917800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:33:18.861 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:18.859+0000 7fe02d917800 20 searching for the correct realm 2024-09-12T17:33:18.862 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:18.861+0000 7fe02b401640 0 -- 172.21.15.37:0/586878012 >> [v2:172.21.15.37:6800/1206746176,v1:172.21.15.37:6801/1206746176] conn(0x7fe024025410 msgr2=0x7fe024025870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:33:19.067 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.066+0000 7fe02bc02640 0 -- 172.21.15.37:0/586878012 >> [v2:172.21.15.40:6818/1210108009,v1:172.21.15.40:6819/1210108009] conn(0x7fe01403f070 msgr2=0x7fe01406bbf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:33:19.075 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.073+0000 7fe02d917800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:33:19.075 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.073+0000 7fe02d917800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:33:19.075 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.073+0000 7fe02d917800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:33:19.075 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.073+0000 7fe02d917800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:33:19.075 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.073+0000 7fe02d917800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:33:19.075 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.073+0000 7fe02d917800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:33:19.075 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.073+0000 7fe02d917800 20 rados->read ofs=0 len=0 2024-09-12T17:33:19.075 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.074+0000 7fe02d917800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:19.075 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.074+0000 7fe02d917800 20 rados->read ofs=0 len=0 2024-09-12T17:33:19.076 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.074+0000 7fe02d917800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:33:19.076 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.074+0000 7fe02d917800 20 rados->read ofs=0 len=0 2024-09-12T17:33:19.077 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.075+0000 7fe02d917800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:33:19.077 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.075+0000 7fe02d917800 20 zone default found 2024-09-12T17:33:19.077 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.075+0000 7fe02d917800 4 Realm: () 2024-09-12T17:33:19.077 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.075+0000 7fe02d917800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:33:19.077 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.075+0000 7fe02d917800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:33:19.077 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.075+0000 7fe02d917800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:33:19.077 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.075+0000 7fe02d917800 20 zonegroup default 2024-09-12T17:33:19.077 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.075+0000 7fe02d917800 20 rados->read ofs=0 len=0 2024-09-12T17:33:19.077 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.075+0000 7fe02d917800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:19.077 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.075+0000 7fe02d917800 20 rados->read ofs=0 len=0 2024-09-12T17:33:19.077 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.075+0000 7fe02d917800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:19.077 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.075+0000 7fe02d917800 20 rados->read ofs=0 len=0 2024-09-12T17:33:19.077 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.075+0000 7fe02d917800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:19.077 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.076+0000 7fe02d917800 20 started sync module instance, tier type = 2024-09-12T17:33:19.078 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.076+0000 7fe02d917800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:33:19.086 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.085+0000 7fe02d917800 20 add_watcher() i=0 2024-09-12T17:33:19.086 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.085+0000 7fe02d917800 20 add_watcher() i=1 2024-09-12T17:33:19.086 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.085+0000 7fe02d917800 20 add_watcher() i=2 2024-09-12T17:33:19.086 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.085+0000 7fe02d917800 20 add_watcher() i=3 2024-09-12T17:33:19.087 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.085+0000 7fe02d917800 20 add_watcher() i=4 2024-09-12T17:33:19.087 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.085+0000 7fe02d917800 20 add_watcher() i=5 2024-09-12T17:33:19.087 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.085+0000 7fe02d917800 20 add_watcher() i=6 2024-09-12T17:33:19.087 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.086+0000 7fe02d917800 20 add_watcher() i=7 2024-09-12T17:33:19.087 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.086+0000 7fe02d917800 2 all 8 watchers are set, enabling cache 2024-09-12T17:33:19.089 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.088+0000 7fdee1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:33:19.090 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.088+0000 7fe02d917800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:33:19.090 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.088+0000 7fe02d917800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:33:19.090 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.088+0000 7fe02d917800 5 note: GC not initialized 2024-09-12T17:33:19.090 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.089+0000 7fdee0fe1640 20 reqs_thread_entry: start 2024-09-12T17:33:19.090 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.089+0000 7fe02d917800 20 init_complete bucket index max shards: 11 2024-09-12T17:33:19.090 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.089+0000 7fe02d917800 20 Filter name: none 2024-09-12T17:33:19.090 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.089+0000 7fde5a7fc640 20 reqs_thread_entry: start 2024-09-12T17:33:19.090 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.089+0000 7fe02d917800 10 cache get: name=default.rgw.meta+root+error-at-trim-reshard-log-entries : miss 2024-09-12T17:33:19.090 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.089+0000 7fe02d917800 20 rados->read ofs=0 len=0 2024-09-12T17:33:19.091 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.090+0000 7fe02d917800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T17:33:19.091 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.090+0000 7fe02d917800 10 cache put: name=default.rgw.meta+root+error-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T17:33:19.091 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.090+0000 7fe02d917800 10 adding default.rgw.meta+root+error-at-trim-reshard-log-entries to cache LRU end 2024-09-12T17:33:19.091 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.090+0000 7fe02d917800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.26 : miss 2024-09-12T17:33:19.091 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.090+0000 7fe02d917800 20 rados->read ofs=0 len=0 2024-09-12T17:33:19.091 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.090+0000 7fe02d917800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T17:33:19.092 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.090+0000 7fe02d917800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.26 info.flags=0x17 2024-09-12T17:33:19.092 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.090+0000 7fe02d917800 10 adding default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.26 to cache LRU end 2024-09-12T17:33:19.092 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.090+0000 7fe02d917800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:33:19.092 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.090+0000 7fe02d917800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:33:19.092 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.090+0000 7fe02d917800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.26 2024-09-12T17:33:19.097 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.096+0000 7fe02d917800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.26 info.flags=0x17 2024-09-12T17:33:19.097 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.096+0000 7fe02d917800 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.26 to cache LRU end 2024-09-12T17:33:19.097 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.096+0000 7fe02d917800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:33:19.098 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.096+0000 7fe02d917800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.26, ofs0, ns] 2024-09-12T17:33:19.098 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.096+0000 7fdf0effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496979 cookie 93837978883616 notifier 6771 bl.length()=1023 2024-09-12T17:33:19.098 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.096+0000 7fdf0effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.26 info.flags=0x17 2024-09-12T17:33:19.098 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.096+0000 7fdf0effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.26 to cache LRU end 2024-09-12T17:33:19.098 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.096+0000 7fdf0effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:33:19.099 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.098+0000 7fe02d917800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.26]): orig_sources= new_sources= 2024-09-12T17:33:19.099 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.098+0000 7fe02d917800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.26]): potential sources added=[] removed=[] 2024-09-12T17:33:19.099 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.098+0000 7fe02d917800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.26]): orig_dests= new_dests= 2024-09-12T17:33:19.099 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.098+0000 7fe02d917800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.26]): potential dests added=[] removed=[] 2024-09-12T17:33:19.099 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.098+0000 7fe02d917800 -1 Injecting error=-5 at location=trim_reshard_log_entries 2024-09-12T17:33:19.099 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.098+0000 7fe02d917800 0 ERROR: init_reshard failed to trim reshard log entries: (5) Input/output error 2024-09-12T17:33:19.101 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.101+0000 7fdee1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:33:19.104 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.103+0000 7fe02d917800 20 remove_watcher() i=0 2024-09-12T17:33:19.104 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.103+0000 7fe02d917800 2 removed watcher, disabling cache 2024-09-12T17:33:19.105 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.104+0000 7fe02d917800 20 remove_watcher() i=1 2024-09-12T17:33:19.106 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.106+0000 7fe02d917800 20 remove_watcher() i=2 2024-09-12T17:33:19.107 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.107+0000 7fe02d917800 20 remove_watcher() i=3 2024-09-12T17:33:19.109 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.108+0000 7fe02d917800 20 remove_watcher() i=4 2024-09-12T17:33:19.110 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.109+0000 7fe02d917800 20 remove_watcher() i=5 2024-09-12T17:33:19.111 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.111+0000 7fe02d917800 20 remove_watcher() i=6 2024-09-12T17:33:19.112 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.112+0000 7fe02d917800 20 remove_watcher() i=7 2024-09-12T17:33:19.125 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-12T17:33:19.154 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:33:19.155 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:33:19.195 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.193+0000 7f7c33e10800 20 rados->read ofs=0 len=0 2024-09-12T17:33:19.196 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.195+0000 7f7c33e10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:19.196 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.195+0000 7f7c33e10800 20 realm 2024-09-12T17:33:19.196 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.195+0000 7f7c33e10800 20 rados->read ofs=0 len=0 2024-09-12T17:33:19.196 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.195+0000 7f7c33e10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:19.196 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.195+0000 7f7c33e10800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:33:19.197 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.195+0000 7f7c33e10800 20 rados->read ofs=0 len=0 2024-09-12T17:33:19.197 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.195+0000 7f7c33e10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:19.197 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.195+0000 7f7c33e10800 20 rados->read ofs=0 len=0 2024-09-12T17:33:19.197 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.196+0000 7f7c33e10800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:33:19.197 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.196+0000 7f7c33e10800 20 rados->read ofs=0 len=0 2024-09-12T17:33:19.198 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.197+0000 7f7c33e10800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:33:19.198 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.197+0000 7f7c33e10800 20 searching for the correct realm 2024-09-12T17:33:19.201 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.201+0000 7f7c2ed79640 0 -- 172.21.15.37:0/1961183926 >> [v2:172.21.15.37:6816/2964054205,v1:172.21.15.37:6817/2964054205] conn(0x55bda5f34990 msgr2=0x55bda5f36de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:33:19.205 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.204+0000 7f7c2f57a640 0 -- 172.21.15.37:0/1961183926 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7f7c240167d0 msgr2=0x7f7c2404c0c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:33:19.213 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.209+0000 7f7c33e10800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:33:19.213 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.209+0000 7f7c33e10800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:33:19.213 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.209+0000 7f7c33e10800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:33:19.213 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.209+0000 7f7c33e10800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:33:19.213 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.209+0000 7f7c33e10800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:33:19.213 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.209+0000 7f7c33e10800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:33:19.214 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.209+0000 7f7c33e10800 20 rados->read ofs=0 len=0 2024-09-12T17:33:19.214 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.209+0000 7f7c33e10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:19.214 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.209+0000 7f7c33e10800 20 rados->read ofs=0 len=0 2024-09-12T17:33:19.214 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.209+0000 7f7c33e10800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:33:19.214 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.209+0000 7f7c33e10800 20 rados->read ofs=0 len=0 2024-09-12T17:33:19.214 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.210+0000 7f7c33e10800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:33:19.214 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.210+0000 7f7c33e10800 20 zone default found 2024-09-12T17:33:19.214 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.210+0000 7f7c33e10800 4 Realm: () 2024-09-12T17:33:19.214 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.210+0000 7f7c33e10800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:33:19.214 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.210+0000 7f7c33e10800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:33:19.215 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.210+0000 7f7c33e10800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:33:19.215 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.210+0000 7f7c33e10800 20 zonegroup default 2024-09-12T17:33:19.216 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.210+0000 7f7c33e10800 20 rados->read ofs=0 len=0 2024-09-12T17:33:19.216 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.210+0000 7f7c33e10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:19.216 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.210+0000 7f7c33e10800 20 rados->read ofs=0 len=0 2024-09-12T17:33:19.216 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.211+0000 7f7c33e10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:19.216 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.211+0000 7f7c33e10800 20 rados->read ofs=0 len=0 2024-09-12T17:33:19.216 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.211+0000 7f7c33e10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:19.217 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.211+0000 7f7c33e10800 20 started sync module instance, tier type = 2024-09-12T17:33:19.217 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.211+0000 7f7c33e10800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:33:19.222 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.221+0000 7f7c33e10800 20 add_watcher() i=0 2024-09-12T17:33:19.222 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.221+0000 7f7c33e10800 20 add_watcher() i=1 2024-09-12T17:33:19.222 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.221+0000 7f7c33e10800 20 add_watcher() i=2 2024-09-12T17:33:19.222 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.221+0000 7f7c33e10800 20 add_watcher() i=3 2024-09-12T17:33:19.222 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.221+0000 7f7c33e10800 20 add_watcher() i=4 2024-09-12T17:33:19.222 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.221+0000 7f7c33e10800 20 add_watcher() i=5 2024-09-12T17:33:19.223 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.221+0000 7f7c33e10800 20 add_watcher() i=6 2024-09-12T17:33:19.223 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.222+0000 7f7c33e10800 20 add_watcher() i=7 2024-09-12T17:33:19.223 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.222+0000 7f7c33e10800 2 all 8 watchers are set, enabling cache 2024-09-12T17:33:19.225 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.224+0000 7f7ae67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:33:19.226 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.224+0000 7f7c33e10800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:33:19.226 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.224+0000 7f7c33e10800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:33:19.226 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.224+0000 7f7c33e10800 5 note: GC not initialized 2024-09-12T17:33:19.226 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.224+0000 7f7ae57e2640 20 reqs_thread_entry: start 2024-09-12T17:33:19.226 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.224+0000 7f7c33e10800 20 init_complete bucket index max shards: 11 2024-09-12T17:33:19.226 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.224+0000 7f7c33e10800 20 Filter name: none 2024-09-12T17:33:19.226 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.225+0000 7f7ade7fc640 20 reqs_thread_entry: start 2024-09-12T17:33:19.226 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.225+0000 7f7c33e10800 20 rados->read ofs=0 len=0 2024-09-12T17:33:19.229 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.225+0000 7f7c33e10800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T17:33:19.230 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.225+0000 7f7c33e10800 20 rados->read ofs=0 len=0 2024-09-12T17:33:19.230 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.226+0000 7f7c33e10800 20 rados_obj.operate() r=0 bl.length=479 2024-09-12T17:33:19.230 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.226+0000 7f7c33e10800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:33:19.230 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.226+0000 7f7c33e10800 20 rados->read ofs=0 len=0 2024-09-12T17:33:19.230 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.226+0000 7f7c33e10800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T17:33:19.230 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.226+0000 7f7c33e10800 20 rados->read ofs=0 len=0 2024-09-12T17:33:19.230 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.227+0000 7f7c33e10800 20 rados_obj.operate() r=0 bl.length=479 2024-09-12T17:33:19.230 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.227+0000 7f7c33e10800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:33:19.230 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.228+0000 7f7ae67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:33:19.232 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.231+0000 7f7c33e10800 20 remove_watcher() i=0 2024-09-12T17:33:19.232 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.231+0000 7f7c33e10800 2 removed watcher, disabling cache 2024-09-12T17:33:19.233 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.232+0000 7f7c33e10800 20 remove_watcher() i=1 2024-09-12T17:33:19.234 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.233+0000 7f7c33e10800 20 remove_watcher() i=2 2024-09-12T17:33:19.235 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.234+0000 7f7c33e10800 20 remove_watcher() i=3 2024-09-12T17:33:19.236 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.235+0000 7f7c33e10800 20 remove_watcher() i=4 2024-09-12T17:33:19.237 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.236+0000 7f7c33e10800 20 remove_watcher() i=5 2024-09-12T17:33:19.239 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.237+0000 7f7c33e10800 20 remove_watcher() i=6 2024-09-12T17:33:19.239 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.238+0000 7f7c33e10800 20 remove_watcher() i=7 2024-09-12T17:33:19.251 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:33:19.251 INFO:tasks.workunit.client.0.smithi037.stderr:BUCKET_STATS: 2024-09-12T17:33:19.251 INFO:tasks.workunit.client.0.smithi037.stderr:bucket: error-at-trim-reshard-log-entries id: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.26 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:33:19.251 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:33:19.342 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bucket reshard --bucket error-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:33:19.375 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:33:19.375 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:33:19.413 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.412+0000 7f1529a13800 20 rados->read ofs=0 len=0 2024-09-12T17:33:19.415 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.414+0000 7f1529a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:19.415 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.414+0000 7f1529a13800 20 realm 2024-09-12T17:33:19.415 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.414+0000 7f1529a13800 20 rados->read ofs=0 len=0 2024-09-12T17:33:19.416 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.414+0000 7f1529a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:19.416 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.414+0000 7f1529a13800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:33:19.416 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.414+0000 7f1529a13800 20 rados->read ofs=0 len=0 2024-09-12T17:33:19.416 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.415+0000 7f1529a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:19.416 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.415+0000 7f1529a13800 20 rados->read ofs=0 len=0 2024-09-12T17:33:19.417 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.416+0000 7f1529a13800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:33:19.417 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.416+0000 7f1529a13800 20 rados->read ofs=0 len=0 2024-09-12T17:33:19.417 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.416+0000 7f1529a13800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:33:19.417 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.416+0000 7f1529a13800 20 searching for the correct realm 2024-09-12T17:33:19.421 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.420+0000 7f1524947640 0 -- 172.21.15.37:0/4218786161 >> [v2:172.21.15.40:6800/2441293461,v1:172.21.15.40:6801/2441293461] conn(0x7f151804b070 msgr2=0x7f151804ea90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:33:19.424 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.423+0000 7f1525949640 0 -- 172.21.15.37:0/4218786161 >> [v2:172.21.15.40:6808/2253405131,v1:172.21.15.40:6809/2253405131] conn(0x7f151c07c070 msgr2=0x7f151c095eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:33:19.429 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.428+0000 7f1529a13800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:33:19.429 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.428+0000 7f1529a13800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:33:19.429 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.428+0000 7f1529a13800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:33:19.429 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.428+0000 7f1529a13800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:33:19.429 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.428+0000 7f1529a13800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:33:19.429 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.428+0000 7f1529a13800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:33:19.429 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.428+0000 7f1529a13800 20 rados->read ofs=0 len=0 2024-09-12T17:33:19.429 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.428+0000 7f1529a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:19.429 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.428+0000 7f1529a13800 20 rados->read ofs=0 len=0 2024-09-12T17:33:19.431 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.428+0000 7f1529a13800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:33:19.431 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.428+0000 7f1529a13800 20 rados->read ofs=0 len=0 2024-09-12T17:33:19.431 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.429+0000 7f1529a13800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:33:19.432 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.429+0000 7f1529a13800 20 zone default found 2024-09-12T17:33:19.432 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.429+0000 7f1529a13800 4 Realm: () 2024-09-12T17:33:19.432 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.429+0000 7f1529a13800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:33:19.432 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.429+0000 7f1529a13800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:33:19.432 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.429+0000 7f1529a13800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:33:19.432 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.429+0000 7f1529a13800 20 zonegroup default 2024-09-12T17:33:19.432 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.429+0000 7f1529a13800 20 rados->read ofs=0 len=0 2024-09-12T17:33:19.432 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.429+0000 7f1529a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:19.432 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.429+0000 7f1529a13800 20 rados->read ofs=0 len=0 2024-09-12T17:33:19.432 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.429+0000 7f1529a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:19.432 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.429+0000 7f1529a13800 20 rados->read ofs=0 len=0 2024-09-12T17:33:19.432 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.430+0000 7f1529a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:19.432 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.430+0000 7f1529a13800 20 started sync module instance, tier type = 2024-09-12T17:33:19.433 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.430+0000 7f1529a13800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:33:19.441 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.439+0000 7f1529a13800 20 add_watcher() i=0 2024-09-12T17:33:19.441 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.439+0000 7f1529a13800 20 add_watcher() i=1 2024-09-12T17:33:19.441 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.439+0000 7f1529a13800 20 add_watcher() i=2 2024-09-12T17:33:19.441 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.439+0000 7f1529a13800 20 add_watcher() i=3 2024-09-12T17:33:19.441 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.439+0000 7f1529a13800 20 add_watcher() i=4 2024-09-12T17:33:19.441 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.439+0000 7f1529a13800 20 add_watcher() i=5 2024-09-12T17:33:19.441 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.440+0000 7f1529a13800 20 add_watcher() i=6 2024-09-12T17:33:19.442 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.440+0000 7f1529a13800 20 add_watcher() i=7 2024-09-12T17:33:19.442 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.440+0000 7f1529a13800 2 all 8 watchers are set, enabling cache 2024-09-12T17:33:19.443 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.442+0000 7f13db7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:33:19.445 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.443+0000 7f1529a13800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:33:19.445 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.443+0000 7f1529a13800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:33:19.445 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.443+0000 7f1529a13800 5 note: GC not initialized 2024-09-12T17:33:19.445 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.443+0000 7f13da7e4640 20 reqs_thread_entry: start 2024-09-12T17:33:19.445 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.443+0000 7f1529a13800 20 init_complete bucket index max shards: 11 2024-09-12T17:33:19.445 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.443+0000 7f1529a13800 20 Filter name: none 2024-09-12T17:33:19.445 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.443+0000 7f134bfff640 20 reqs_thread_entry: start 2024-09-12T17:33:19.445 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.443+0000 7f1529a13800 10 cache get: name=default.rgw.meta+root+error-at-trim-reshard-log-entries : miss 2024-09-12T17:33:19.445 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.443+0000 7f1529a13800 20 rados->read ofs=0 len=0 2024-09-12T17:33:19.445 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.444+0000 7f1529a13800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T17:33:19.446 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.444+0000 7f1529a13800 10 cache put: name=default.rgw.meta+root+error-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T17:33:19.446 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.444+0000 7f1529a13800 10 adding default.rgw.meta+root+error-at-trim-reshard-log-entries to cache LRU end 2024-09-12T17:33:19.446 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.444+0000 7f1529a13800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.26 : miss 2024-09-12T17:33:19.446 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.444+0000 7f1529a13800 20 rados->read ofs=0 len=0 2024-09-12T17:33:19.446 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.444+0000 7f1529a13800 20 rados_obj.operate() r=0 bl.length=479 2024-09-12T17:33:19.446 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.444+0000 7f1529a13800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.26 info.flags=0x17 2024-09-12T17:33:19.447 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.444+0000 7f1529a13800 10 adding default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.26 to cache LRU end 2024-09-12T17:33:19.447 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.444+0000 7f1529a13800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:33:19.447 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.444+0000 7f1529a13800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:33:19.447 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.444+0000 7f1529a13800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.26 2024-09-12T17:33:19.447 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.446+0000 7f1529a13800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T17:33:19.454 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.454+0000 7f1529a13800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.26 info.flags=0x17 2024-09-12T17:33:19.455 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.454+0000 7f1529a13800 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.26 to cache LRU end 2024-09-12T17:33:19.455 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.454+0000 7f1529a13800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:33:19.455 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.454+0000 7f1529a13800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.26, ofs0, ns] 2024-09-12T17:33:19.455 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.454+0000 7f1408ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496980 cookie 94630838439360 notifier 6413 bl.length()=1023 2024-09-12T17:33:19.455 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.454+0000 7f1408ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.26 info.flags=0x17 2024-09-12T17:33:19.455 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.454+0000 7f1408ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.26 to cache LRU end 2024-09-12T17:33:19.455 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.454+0000 7f1408ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:33:19.456 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.456+0000 7f1529a13800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.26]): orig_sources= new_sources= 2024-09-12T17:33:19.456 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.456+0000 7f1529a13800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.26]): potential sources added=[] removed=[] 2024-09-12T17:33:19.456 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.456+0000 7f1529a13800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.26]): orig_dests= new_dests= 2024-09-12T17:33:19.456 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.456+0000 7f1529a13800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.26]): potential dests added=[] removed=[] 2024-09-12T17:33:19.464 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.462+0000 7f1529a13800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.26.2.0 2024-09-12T17:33:19.464 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.462+0000 7f1529a13800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.26.2.0 2024-09-12T17:33:19.464 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.462+0000 7f1529a13800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.26.2.1 2024-09-12T17:33:19.465 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.462+0000 7f1529a13800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.26.2.1 2024-09-12T17:33:19.465 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.462+0000 7f1529a13800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.26.2.2 2024-09-12T17:33:19.465 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.462+0000 7f1529a13800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.26.2.2 2024-09-12T17:33:19.465 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.462+0000 7f1529a13800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.26.2.3 2024-09-12T17:33:19.465 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.462+0000 7f1529a13800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.26.2.3 2024-09-12T17:33:19.465 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.462+0000 7f1529a13800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.26.2.4 2024-09-12T17:33:19.465 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.462+0000 7f1529a13800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.26.2.4 2024-09-12T17:33:19.465 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.462+0000 7f1529a13800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.26.2.5 2024-09-12T17:33:19.465 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.462+0000 7f1529a13800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.26.2.5 2024-09-12T17:33:19.465 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.462+0000 7f1529a13800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.26.2.6 2024-09-12T17:33:19.465 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.462+0000 7f1529a13800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.26.2.6 2024-09-12T17:33:19.465 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.462+0000 7f1529a13800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.26.2.7 2024-09-12T17:33:19.465 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.462+0000 7f1529a13800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.26.2.7 2024-09-12T17:33:19.465 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.462+0000 7f1529a13800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.26.2.8 2024-09-12T17:33:19.466 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.462+0000 7f1529a13800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.26.2.8 2024-09-12T17:33:19.466 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.462+0000 7f1529a13800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.26.2.9 2024-09-12T17:33:19.466 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.462+0000 7f1529a13800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.26.2.9 2024-09-12T17:33:19.466 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.462+0000 7f1529a13800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.26.2.10 2024-09-12T17:33:19.466 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.462+0000 7f1529a13800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.26.2.10 2024-09-12T17:33:19.466 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.462+0000 7f1529a13800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.26.2.11 2024-09-12T17:33:19.466 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.462+0000 7f1529a13800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.26.2.11 2024-09-12T17:33:19.466 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.462+0000 7f1529a13800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.26.0 2024-09-12T17:33:19.466 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.463+0000 7f1529a13800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.26.1 2024-09-12T17:33:19.466 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.463+0000 7f1529a13800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.26.2 2024-09-12T17:33:19.467 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.464+0000 7f1529a13800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.26.3 2024-09-12T17:33:19.467 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.464+0000 7f1529a13800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.26.4 2024-09-12T17:33:19.467 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.465+0000 7f1529a13800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.26.5 2024-09-12T17:33:19.467 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.465+0000 7f1529a13800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.26.6 2024-09-12T17:33:19.467 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.466+0000 7f1529a13800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.26.7 2024-09-12T17:33:19.467 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.466+0000 7f1529a13800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.26.8 2024-09-12T17:33:19.468 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.467+0000 7f1529a13800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.26.9 2024-09-12T17:33:19.468 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.467+0000 7f1529a13800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.26.10 2024-09-12T17:33:19.473 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.472+0000 7f1529a13800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.26 : hit (requested=0x17, cached=0x17) 2024-09-12T17:33:19.473 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.472+0000 7f1529a13800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.26 2024-09-12T17:33:19.474 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.473+0000 7f1529a13800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.26 info.flags=0x17 2024-09-12T17:33:19.474 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.473+0000 7f1529a13800 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.26 to cache LRU end 2024-09-12T17:33:19.474 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.473+0000 7f1529a13800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:33:19.474 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.473+0000 7f1529a13800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.26, ofs0, ns] 2024-09-12T17:33:19.475 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.474+0000 7f13f7fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496981 cookie 94630838439360 notifier 6413 bl.length()=1023 2024-09-12T17:33:19.475 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.474+0000 7f13f7fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.26 info.flags=0x17 2024-09-12T17:33:19.475 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.474+0000 7f13f7fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.26 to cache LRU end 2024-09-12T17:33:19.475 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.474+0000 7f13f7fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:33:19.476 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.475+0000 7f1529a13800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.26]): orig_sources= new_sources= 2024-09-12T17:33:19.477 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.475+0000 7f1529a13800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.26]): potential sources added=[] removed=[] 2024-09-12T17:33:19.477 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.475+0000 7f1529a13800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.26]): orig_dests= new_dests= 2024-09-12T17:33:19.477 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.475+0000 7f1529a13800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.26]): potential dests added=[] removed=[] 2024-09-12T17:33:19.479 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.478+0000 7f1529a13800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.26.0 2024-09-12T17:33:19.479 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.478+0000 7f1529a13800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.26.1 2024-09-12T17:33:19.479 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.478+0000 7f1529a13800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.26.2 2024-09-12T17:33:19.480 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.479+0000 7f1529a13800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.26.3 2024-09-12T17:33:19.480 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.479+0000 7f1529a13800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.26.4 2024-09-12T17:33:19.481 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.479+0000 7f1529a13800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.26.5 2024-09-12T17:33:19.481 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.480+0000 7f1529a13800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.26.6 2024-09-12T17:33:19.481 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.480+0000 7f1529a13800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.26.7 2024-09-12T17:33:19.481 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.480+0000 7f1529a13800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.26.8 2024-09-12T17:33:19.481 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.481+0000 7f1529a13800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.26.9 2024-09-12T17:33:19.482 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.481+0000 7f1529a13800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.26.10 2024-09-12T17:33:19.482 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.481+0000 7f1529a13800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.26 : hit (requested=0x17, cached=0x17) 2024-09-12T17:33:19.482 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.481+0000 7f1529a13800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.26 2024-09-12T17:33:19.484 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.482+0000 7f1529a13800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.26 info.flags=0x17 2024-09-12T17:33:19.484 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.482+0000 7f1529a13800 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.26 to cache LRU end 2024-09-12T17:33:19.484 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.482+0000 7f1529a13800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:33:19.485 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.482+0000 7f1529a13800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.26, ofs0, ns] 2024-09-12T17:33:19.485 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.483+0000 7f13f7fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496982 cookie 94630838439360 notifier 6413 bl.length()=991 2024-09-12T17:33:19.485 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.483+0000 7f13f7fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.26 info.flags=0x17 2024-09-12T17:33:19.486 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.483+0000 7f13f7fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.26 to cache LRU end 2024-09-12T17:33:19.486 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.483+0000 7f13f7fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:33:19.486 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.484+0000 7f1529a13800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.26]): orig_sources= new_sources= 2024-09-12T17:33:19.486 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.484+0000 7f1529a13800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.26]): potential sources added=[] removed=[] 2024-09-12T17:33:19.486 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.484+0000 7f1529a13800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.26]): orig_dests= new_dests= 2024-09-12T17:33:19.487 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.484+0000 7f1529a13800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.26]): potential dests added=[] removed=[] 2024-09-12T17:33:19.487 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.487+0000 7f1529a13800 1 execute INFO: reshard of bucket "error-at-trim-reshard-log-entries" from 11 shards to 12 shards completed successfully 2024-09-12T17:33:19.489 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.488+0000 7f13db7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:33:19.491 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.491+0000 7f1529a13800 20 remove_watcher() i=0 2024-09-12T17:33:19.491 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.491+0000 7f1529a13800 2 removed watcher, disabling cache 2024-09-12T17:33:19.493 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.492+0000 7f1529a13800 20 remove_watcher() i=1 2024-09-12T17:33:19.494 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.493+0000 7f1529a13800 20 remove_watcher() i=2 2024-09-12T17:33:19.495 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.494+0000 7f1529a13800 20 remove_watcher() i=3 2024-09-12T17:33:19.496 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.495+0000 7f1529a13800 20 remove_watcher() i=4 2024-09-12T17:33:19.497 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.496+0000 7f1529a13800 20 remove_watcher() i=5 2024-09-12T17:33:19.498 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.497+0000 7f1529a13800 20 remove_watcher() i=6 2024-09-12T17:33:19.499 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.498+0000 7f1529a13800 20 remove_watcher() i=7 2024-09-12T17:33:19.512 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-12T17:33:19.541 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:33:19.541 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:33:19.581 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.580+0000 7f70fbd19800 20 rados->read ofs=0 len=0 2024-09-12T17:33:19.583 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.581+0000 7f70fbd19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:19.583 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.582+0000 7f70fbd19800 20 realm 2024-09-12T17:33:19.583 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.582+0000 7f70fbd19800 20 rados->read ofs=0 len=0 2024-09-12T17:33:19.583 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.582+0000 7f70fbd19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:19.583 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.582+0000 7f70fbd19800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:33:19.583 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.582+0000 7f70fbd19800 20 rados->read ofs=0 len=0 2024-09-12T17:33:19.583 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.582+0000 7f70fbd19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:19.583 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.582+0000 7f70fbd19800 20 rados->read ofs=0 len=0 2024-09-12T17:33:19.584 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.583+0000 7f70fbd19800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:33:19.585 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.583+0000 7f70fbd19800 20 rados->read ofs=0 len=0 2024-09-12T17:33:19.585 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.583+0000 7f70fbd19800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:33:19.585 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.583+0000 7f70fbd19800 20 searching for the correct realm 2024-09-12T17:33:19.586 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.586+0000 7f70f9002640 0 -- 172.21.15.37:0/3769801285 >> [v2:172.21.15.40:6800/2441293461,v1:172.21.15.40:6801/2441293461] conn(0x7f70ec0b8030 msgr2=0x7f70ec0a38f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:33:19.591 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.590+0000 7f70f9803640 0 -- 172.21.15.37:0/3769801285 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7f70f002e4c0 msgr2=0x7f70f007a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:33:19.799 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.797+0000 7f70fbd19800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:33:19.799 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.797+0000 7f70fbd19800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:33:19.799 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.797+0000 7f70fbd19800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:33:19.799 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.797+0000 7f70fbd19800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:33:19.799 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.797+0000 7f70fbd19800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:33:19.799 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.797+0000 7f70fbd19800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:33:19.799 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.797+0000 7f70fbd19800 20 rados->read ofs=0 len=0 2024-09-12T17:33:19.799 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.797+0000 7f70fbd19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:19.799 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.797+0000 7f70fbd19800 20 rados->read ofs=0 len=0 2024-09-12T17:33:19.799 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.797+0000 7f70fbd19800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:33:19.799 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.797+0000 7f70fbd19800 20 rados->read ofs=0 len=0 2024-09-12T17:33:19.800 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.798+0000 7f70fbd19800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:33:19.800 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.798+0000 7f70fbd19800 20 zone default found 2024-09-12T17:33:19.800 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.798+0000 7f70fbd19800 4 Realm: () 2024-09-12T17:33:19.800 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.798+0000 7f70fbd19800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:33:19.800 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.798+0000 7f70fbd19800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:33:19.800 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.798+0000 7f70fbd19800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:33:19.800 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.798+0000 7f70fbd19800 20 zonegroup default 2024-09-12T17:33:19.800 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.798+0000 7f70fbd19800 20 rados->read ofs=0 len=0 2024-09-12T17:33:19.800 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.798+0000 7f70fbd19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:19.800 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.798+0000 7f70fbd19800 20 rados->read ofs=0 len=0 2024-09-12T17:33:19.801 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.798+0000 7f70fbd19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:19.801 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.798+0000 7f70fbd19800 20 rados->read ofs=0 len=0 2024-09-12T17:33:19.801 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.799+0000 7f70fbd19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:19.801 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.799+0000 7f70fbd19800 20 started sync module instance, tier type = 2024-09-12T17:33:19.801 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.799+0000 7f70fbd19800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:33:19.809 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.809+0000 7f70fbd19800 20 add_watcher() i=0 2024-09-12T17:33:19.810 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.809+0000 7f70fbd19800 20 add_watcher() i=1 2024-09-12T17:33:19.810 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.809+0000 7f70fbd19800 20 add_watcher() i=2 2024-09-12T17:33:19.810 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.809+0000 7f70fbd19800 20 add_watcher() i=3 2024-09-12T17:33:19.810 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.809+0000 7f70fbd19800 20 add_watcher() i=4 2024-09-12T17:33:19.810 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.809+0000 7f70fbd19800 20 add_watcher() i=5 2024-09-12T17:33:19.810 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.809+0000 7f70fbd19800 20 add_watcher() i=6 2024-09-12T17:33:19.810 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.810+0000 7f70fbd19800 20 add_watcher() i=7 2024-09-12T17:33:19.810 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.810+0000 7f70fbd19800 2 all 8 watchers are set, enabling cache 2024-09-12T17:33:19.812 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.811+0000 7f6fab7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:33:19.813 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.812+0000 7f70fbd19800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:33:19.813 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.812+0000 7f70fbd19800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:33:19.814 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.812+0000 7f70fbd19800 5 note: GC not initialized 2024-09-12T17:33:19.814 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.812+0000 7f6faa7fc640 20 reqs_thread_entry: start 2024-09-12T17:33:19.814 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.812+0000 7f70fbd19800 20 init_complete bucket index max shards: 11 2024-09-12T17:33:19.814 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.812+0000 7f70fbd19800 20 Filter name: none 2024-09-12T17:33:19.814 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.812+0000 7f6f1bfff640 20 reqs_thread_entry: start 2024-09-12T17:33:19.814 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.812+0000 7f70fbd19800 20 rados->read ofs=0 len=0 2024-09-12T17:33:19.814 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.813+0000 7f70fbd19800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T17:33:19.814 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.813+0000 7f70fbd19800 20 rados->read ofs=0 len=0 2024-09-12T17:33:19.815 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.814+0000 7f70fbd19800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T17:33:19.815 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.814+0000 7f70fbd19800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:33:19.815 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.814+0000 7f70fbd19800 20 rados->read ofs=0 len=0 2024-09-12T17:33:19.815 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.814+0000 7f70fbd19800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T17:33:19.816 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.814+0000 7f70fbd19800 20 rados->read ofs=0 len=0 2024-09-12T17:33:19.816 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.815+0000 7f70fbd19800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T17:33:19.816 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.815+0000 7f70fbd19800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:33:19.817 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.817+0000 7f6fab7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:33:19.820 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.819+0000 7f70fbd19800 20 remove_watcher() i=0 2024-09-12T17:33:19.820 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.819+0000 7f70fbd19800 2 removed watcher, disabling cache 2024-09-12T17:33:19.821 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.820+0000 7f70fbd19800 20 remove_watcher() i=1 2024-09-12T17:33:19.822 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.821+0000 7f70fbd19800 20 remove_watcher() i=2 2024-09-12T17:33:19.823 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.822+0000 7f70fbd19800 20 remove_watcher() i=3 2024-09-12T17:33:19.825 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.823+0000 7f70fbd19800 20 remove_watcher() i=4 2024-09-12T17:33:19.825 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.824+0000 7f70fbd19800 20 remove_watcher() i=5 2024-09-12T17:33:19.826 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.825+0000 7f70fbd19800 20 remove_watcher() i=6 2024-09-12T17:33:19.827 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:19.826+0000 7f70fbd19800 20 remove_watcher() i=7 2024-09-12T17:33:19.838 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:33:19.838 INFO:tasks.workunit.client.0.smithi037.stderr:BUCKET_STATS: 2024-09-12T17:33:19.838 INFO:tasks.workunit.client.0.smithi037.stderr:bucket: error-at-trim-reshard-log-entries id: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.26 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T17:33:19.839 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:33:20.185 INFO:tasks.workunit.client.0.smithi037.stderr:TEST: reshard bucket with EOPNOTSUPP injected at trim_reshard_log_entries 2024-09-12T17:33:20.185 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:33:21.001 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-12T17:33:21.031 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:33:21.031 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:33:21.070 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.069+0000 7f77e4734800 20 rados->read ofs=0 len=0 2024-09-12T17:33:21.072 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.071+0000 7f77e4734800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:21.072 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.071+0000 7f77e4734800 20 realm 2024-09-12T17:33:21.072 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.071+0000 7f77e4734800 20 rados->read ofs=0 len=0 2024-09-12T17:33:21.072 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.071+0000 7f77e4734800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:21.072 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.071+0000 7f77e4734800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:33:21.073 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.071+0000 7f77e4734800 20 rados->read ofs=0 len=0 2024-09-12T17:33:21.073 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.071+0000 7f77e4734800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:21.073 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.071+0000 7f77e4734800 20 rados->read ofs=0 len=0 2024-09-12T17:33:21.073 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.072+0000 7f77e4734800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:33:21.073 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.072+0000 7f77e4734800 20 rados->read ofs=0 len=0 2024-09-12T17:33:21.073 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.072+0000 7f77e4734800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:33:21.074 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.072+0000 7f77e4734800 20 searching for the correct realm 2024-09-12T17:33:21.076 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.075+0000 7f77e0cb8640 0 -- 172.21.15.37:0/2551042242 >> [v2:172.21.15.40:6818/1210108009,v1:172.21.15.40:6819/1210108009] conn(0x7f77d403b040 msgr2=0x7f77d4022930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:33:21.079 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.079+0000 7f77e04b7640 0 -- 172.21.15.37:0/2551042242 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7f77d4008980 msgr2=0x7f77d403b420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:33:21.286 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.285+0000 7f77e4734800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:33:21.286 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.285+0000 7f77e4734800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:33:21.286 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.285+0000 7f77e4734800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:33:21.286 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.285+0000 7f77e4734800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:33:21.286 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.285+0000 7f77e4734800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:33:21.286 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.285+0000 7f77e4734800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:33:21.286 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.285+0000 7f77e4734800 20 rados->read ofs=0 len=0 2024-09-12T17:33:21.287 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.285+0000 7f77e4734800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:21.287 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.285+0000 7f77e4734800 20 rados->read ofs=0 len=0 2024-09-12T17:33:21.288 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.285+0000 7f77e4734800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:33:21.288 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.285+0000 7f77e4734800 20 rados->read ofs=0 len=0 2024-09-12T17:33:21.288 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.286+0000 7f77e4734800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:33:21.288 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.286+0000 7f77e4734800 20 zone default found 2024-09-12T17:33:21.288 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.286+0000 7f77e4734800 4 Realm: () 2024-09-12T17:33:21.288 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.286+0000 7f77e4734800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:33:21.288 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.286+0000 7f77e4734800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:33:21.288 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.286+0000 7f77e4734800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:33:21.288 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.286+0000 7f77e4734800 20 zonegroup default 2024-09-12T17:33:21.288 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.286+0000 7f77e4734800 20 rados->read ofs=0 len=0 2024-09-12T17:33:21.288 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.286+0000 7f77e4734800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:21.288 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.286+0000 7f77e4734800 20 rados->read ofs=0 len=0 2024-09-12T17:33:21.288 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.287+0000 7f77e4734800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:21.289 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.287+0000 7f77e4734800 20 rados->read ofs=0 len=0 2024-09-12T17:33:21.289 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.287+0000 7f77e4734800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:21.289 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.287+0000 7f77e4734800 20 started sync module instance, tier type = 2024-09-12T17:33:21.289 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.287+0000 7f77e4734800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:33:21.298 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.297+0000 7f77e4734800 20 add_watcher() i=0 2024-09-12T17:33:21.298 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.297+0000 7f77e4734800 20 add_watcher() i=1 2024-09-12T17:33:21.298 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.297+0000 7f77e4734800 20 add_watcher() i=2 2024-09-12T17:33:21.298 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.297+0000 7f77e4734800 20 add_watcher() i=3 2024-09-12T17:33:21.299 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.297+0000 7f77e4734800 20 add_watcher() i=4 2024-09-12T17:33:21.299 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.297+0000 7f77e4734800 20 add_watcher() i=5 2024-09-12T17:33:21.299 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.297+0000 7f77e4734800 20 add_watcher() i=6 2024-09-12T17:33:21.299 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.298+0000 7f77e4734800 20 add_watcher() i=7 2024-09-12T17:33:21.299 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.298+0000 7f77e4734800 2 all 8 watchers are set, enabling cache 2024-09-12T17:33:21.300 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.300+0000 7f7696fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:33:21.301 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.300+0000 7f77e4734800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:33:21.301 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.300+0000 7f77e4734800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:33:21.302 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.300+0000 7f77e4734800 5 note: GC not initialized 2024-09-12T17:33:21.302 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.300+0000 7f7695fdb640 20 reqs_thread_entry: start 2024-09-12T17:33:21.302 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.300+0000 7f77e4734800 20 init_complete bucket index max shards: 11 2024-09-12T17:33:21.302 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.300+0000 7f77e4734800 20 Filter name: none 2024-09-12T17:33:21.302 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.300+0000 7f76077fe640 20 reqs_thread_entry: start 2024-09-12T17:33:21.302 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.300+0000 7f77e4734800 20 rados->read ofs=0 len=0 2024-09-12T17:33:21.303 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.301+0000 7f77e4734800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T17:33:21.303 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.301+0000 7f77e4734800 20 rados->read ofs=0 len=0 2024-09-12T17:33:21.303 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.302+0000 7f77e4734800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T17:33:21.303 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.302+0000 7f77e4734800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:33:21.303 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.302+0000 7f77e4734800 20 rados->read ofs=0 len=0 2024-09-12T17:33:21.303 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.302+0000 7f77e4734800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T17:33:21.303 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.302+0000 7f77e4734800 20 rados->read ofs=0 len=0 2024-09-12T17:33:21.304 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.302+0000 7f77e4734800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T17:33:21.304 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.302+0000 7f77e4734800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:33:21.305 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.304+0000 7f7696fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:33:21.307 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.306+0000 7f77e4734800 20 remove_watcher() i=0 2024-09-12T17:33:21.307 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.306+0000 7f77e4734800 2 removed watcher, disabling cache 2024-09-12T17:33:21.308 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.308+0000 7f77e4734800 20 remove_watcher() i=1 2024-09-12T17:33:21.309 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.309+0000 7f77e4734800 20 remove_watcher() i=2 2024-09-12T17:33:21.310 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.310+0000 7f77e4734800 20 remove_watcher() i=3 2024-09-12T17:33:21.311 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.311+0000 7f77e4734800 20 remove_watcher() i=4 2024-09-12T17:33:21.312 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.312+0000 7f77e4734800 20 remove_watcher() i=5 2024-09-12T17:33:21.313 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.313+0000 7f77e4734800 20 remove_watcher() i=6 2024-09-12T17:33:21.314 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.314+0000 7f77e4734800 20 remove_watcher() i=7 2024-09-12T17:33:21.326 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:33:21.326 INFO:tasks.workunit.client.0.smithi037.stderr:BUCKET_STATS: 2024-09-12T17:33:21.326 INFO:tasks.workunit.client.0.smithi037.stderr:bucket: error-at-trim-reshard-log-entries id: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.27 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:33:21.326 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:33:21.327 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bucket reshard --bucket error-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at trim_reshard_log_entries --inject-error-code 95 2024-09-12T17:33:21.364 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:33:21.364 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:33:21.403 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.402+0000 7fce8810c800 20 rados->read ofs=0 len=0 2024-09-12T17:33:21.405 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.404+0000 7fce8810c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:21.405 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.404+0000 7fce8810c800 20 realm 2024-09-12T17:33:21.405 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.404+0000 7fce8810c800 20 rados->read ofs=0 len=0 2024-09-12T17:33:21.405 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.404+0000 7fce8810c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:21.405 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.404+0000 7fce8810c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:33:21.406 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.404+0000 7fce8810c800 20 rados->read ofs=0 len=0 2024-09-12T17:33:21.406 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.404+0000 7fce8810c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:21.406 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.404+0000 7fce8810c800 20 rados->read ofs=0 len=0 2024-09-12T17:33:21.406 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.405+0000 7fce8810c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:33:21.406 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.405+0000 7fce8810c800 20 rados->read ofs=0 len=0 2024-09-12T17:33:21.407 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.406+0000 7fce8810c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:33:21.407 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.406+0000 7fce8810c800 20 searching for the correct realm 2024-09-12T17:33:21.410 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.409+0000 7fce863f7640 0 -- 172.21.15.37:0/25083068 >> [v2:172.21.15.40:6818/1210108009,v1:172.21.15.40:6819/1210108009] conn(0x7fce7c095020 msgr2=0x7fce7c07f040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:33:21.413 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.413+0000 7fce85bf6640 0 -- 172.21.15.37:0/25083068 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7fce7c046850 msgr2=0x7fce7c060e80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:33:21.418 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.417+0000 7fce8810c800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:33:21.418 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.417+0000 7fce8810c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:33:21.418 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.417+0000 7fce8810c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:33:21.418 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.417+0000 7fce8810c800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:33:21.418 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.417+0000 7fce8810c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:33:21.418 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.417+0000 7fce8810c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:33:21.419 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.417+0000 7fce8810c800 20 rados->read ofs=0 len=0 2024-09-12T17:33:21.419 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.417+0000 7fce8810c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:21.419 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.417+0000 7fce8810c800 20 rados->read ofs=0 len=0 2024-09-12T17:33:21.420 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.418+0000 7fce8810c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:33:21.420 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.418+0000 7fce8810c800 20 rados->read ofs=0 len=0 2024-09-12T17:33:21.420 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.418+0000 7fce8810c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:33:21.420 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.418+0000 7fce8810c800 20 zone default found 2024-09-12T17:33:21.420 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.418+0000 7fce8810c800 4 Realm: () 2024-09-12T17:33:21.420 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.418+0000 7fce8810c800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:33:21.421 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.418+0000 7fce8810c800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:33:21.421 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.418+0000 7fce8810c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:33:21.421 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.418+0000 7fce8810c800 20 zonegroup default 2024-09-12T17:33:21.421 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.418+0000 7fce8810c800 20 rados->read ofs=0 len=0 2024-09-12T17:33:21.421 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.418+0000 7fce8810c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:21.421 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.418+0000 7fce8810c800 20 rados->read ofs=0 len=0 2024-09-12T17:33:21.421 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.419+0000 7fce8810c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:21.421 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.419+0000 7fce8810c800 20 rados->read ofs=0 len=0 2024-09-12T17:33:21.421 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.419+0000 7fce8810c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:21.421 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.419+0000 7fce8810c800 20 started sync module instance, tier type = 2024-09-12T17:33:21.421 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.419+0000 7fce8810c800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:33:21.429 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.428+0000 7fce8810c800 20 add_watcher() i=0 2024-09-12T17:33:21.429 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.428+0000 7fce8810c800 20 add_watcher() i=1 2024-09-12T17:33:21.429 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.428+0000 7fce8810c800 20 add_watcher() i=2 2024-09-12T17:33:21.429 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.428+0000 7fce8810c800 20 add_watcher() i=3 2024-09-12T17:33:21.429 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.428+0000 7fce8810c800 20 add_watcher() i=4 2024-09-12T17:33:21.429 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.428+0000 7fce8810c800 20 add_watcher() i=5 2024-09-12T17:33:21.429 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.428+0000 7fce8810c800 20 add_watcher() i=6 2024-09-12T17:33:21.430 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.429+0000 7fce8810c800 20 add_watcher() i=7 2024-09-12T17:33:21.430 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.429+0000 7fce8810c800 2 all 8 watchers are set, enabling cache 2024-09-12T17:33:21.432 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.431+0000 7fcd377fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:33:21.433 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.431+0000 7fce8810c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:33:21.433 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.431+0000 7fce8810c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:33:21.433 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.431+0000 7fce8810c800 5 note: GC not initialized 2024-09-12T17:33:21.433 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.432+0000 7fcd367fc640 20 reqs_thread_entry: start 2024-09-12T17:33:21.433 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.432+0000 7fce8810c800 20 init_complete bucket index max shards: 11 2024-09-12T17:33:21.433 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.432+0000 7fce8810c800 20 Filter name: none 2024-09-12T17:33:21.433 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.432+0000 7fcca7fff640 20 reqs_thread_entry: start 2024-09-12T17:33:21.433 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.432+0000 7fce8810c800 10 cache get: name=default.rgw.meta+root+error-at-trim-reshard-log-entries : miss 2024-09-12T17:33:21.433 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.432+0000 7fce8810c800 20 rados->read ofs=0 len=0 2024-09-12T17:33:21.434 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.432+0000 7fce8810c800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T17:33:21.434 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.432+0000 7fce8810c800 10 cache put: name=default.rgw.meta+root+error-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T17:33:21.434 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.432+0000 7fce8810c800 10 adding default.rgw.meta+root+error-at-trim-reshard-log-entries to cache LRU end 2024-09-12T17:33:21.434 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.432+0000 7fce8810c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.27 : miss 2024-09-12T17:33:21.434 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.432+0000 7fce8810c800 20 rados->read ofs=0 len=0 2024-09-12T17:33:21.435 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.433+0000 7fce8810c800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T17:33:21.435 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.433+0000 7fce8810c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.27 info.flags=0x17 2024-09-12T17:33:21.435 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.433+0000 7fce8810c800 10 adding default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.27 to cache LRU end 2024-09-12T17:33:21.435 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.433+0000 7fce8810c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:33:21.435 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.433+0000 7fce8810c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:33:21.435 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.433+0000 7fce8810c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.27 2024-09-12T17:33:21.439 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.438+0000 7fce8810c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.27 info.flags=0x17 2024-09-12T17:33:21.439 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.438+0000 7fce8810c800 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.27 to cache LRU end 2024-09-12T17:33:21.439 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.438+0000 7fce8810c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:33:21.439 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.438+0000 7fce8810c800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.27, ofs0, ns] 2024-09-12T17:33:21.439 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.438+0000 7fcd697fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496985 cookie 94077325845648 notifier 6461 bl.length()=1023 2024-09-12T17:33:21.439 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.438+0000 7fcd697fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.27 info.flags=0x17 2024-09-12T17:33:21.440 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.438+0000 7fcd697fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.27 to cache LRU end 2024-09-12T17:33:21.440 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.438+0000 7fcd697fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:33:21.441 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.440+0000 7fce8810c800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.27]): orig_sources= new_sources= 2024-09-12T17:33:21.441 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.440+0000 7fce8810c800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.27]): potential sources added=[] removed=[] 2024-09-12T17:33:21.441 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.440+0000 7fce8810c800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.27]): orig_dests= new_dests= 2024-09-12T17:33:21.441 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.440+0000 7fce8810c800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.27]): potential dests added=[] removed=[] 2024-09-12T17:33:21.441 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.440+0000 7fce8810c800 -1 Injecting error=-95 at location=trim_reshard_log_entries 2024-09-12T17:33:21.441 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.440+0000 7fce8810c800 0 WARNING: trim_reshard_log_entries() does not supported logrecord, falling back to block reshard mode. 2024-09-12T17:33:21.444 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.442+0000 7fce8810c800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.27.1.0 2024-09-12T17:33:21.444 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.442+0000 7fce8810c800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.27.1.0 2024-09-12T17:33:21.444 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.442+0000 7fce8810c800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.27.1.1 2024-09-12T17:33:21.444 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.442+0000 7fce8810c800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.27.1.1 2024-09-12T17:33:21.444 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.442+0000 7fce8810c800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.27.1.2 2024-09-12T17:33:21.444 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.442+0000 7fce8810c800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.27.1.2 2024-09-12T17:33:21.444 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.442+0000 7fce8810c800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.27.1.3 2024-09-12T17:33:21.444 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.442+0000 7fce8810c800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.27.1.3 2024-09-12T17:33:21.444 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.442+0000 7fce8810c800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.27.1.4 2024-09-12T17:33:21.444 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.442+0000 7fce8810c800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.27.1.4 2024-09-12T17:33:21.444 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.442+0000 7fce8810c800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.27.1.5 2024-09-12T17:33:21.444 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.442+0000 7fce8810c800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.27.1.5 2024-09-12T17:33:21.444 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.442+0000 7fce8810c800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.27.1.6 2024-09-12T17:33:21.445 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.442+0000 7fce8810c800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.27.1.6 2024-09-12T17:33:21.445 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.442+0000 7fce8810c800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.27.1.7 2024-09-12T17:33:21.445 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.442+0000 7fce8810c800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.27.1.7 2024-09-12T17:33:21.445 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.442+0000 7fce8810c800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.27.1.8 2024-09-12T17:33:21.445 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.442+0000 7fce8810c800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.27.1.8 2024-09-12T17:33:21.445 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.442+0000 7fce8810c800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.27.1.9 2024-09-12T17:33:21.445 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.442+0000 7fce8810c800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.27.1.9 2024-09-12T17:33:21.445 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.442+0000 7fce8810c800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.27.1.10 2024-09-12T17:33:21.445 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.442+0000 7fce8810c800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.27.1.10 2024-09-12T17:33:21.445 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.442+0000 7fce8810c800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.27.1.11 2024-09-12T17:33:21.445 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.442+0000 7fce8810c800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.27.1.11 2024-09-12T17:33:21.445 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.442+0000 7fce8810c800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.27.0 2024-09-12T17:33:21.445 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.443+0000 7fce8810c800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.27.1 2024-09-12T17:33:21.446 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.443+0000 7fce8810c800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.27.2 2024-09-12T17:33:21.446 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.444+0000 7fce8810c800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.27.3 2024-09-12T17:33:21.446 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.444+0000 7fce8810c800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.27.4 2024-09-12T17:33:21.447 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.445+0000 7fce8810c800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.27.5 2024-09-12T17:33:21.447 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.446+0000 7fce8810c800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.27.6 2024-09-12T17:33:21.447 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.446+0000 7fce8810c800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.27.7 2024-09-12T17:33:21.448 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.447+0000 7fce8810c800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.27.8 2024-09-12T17:33:21.448 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.447+0000 7fce8810c800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.27.9 2024-09-12T17:33:21.449 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.448+0000 7fce8810c800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.27.10 2024-09-12T17:33:21.452 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.451+0000 7fce8810c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.27 : hit (requested=0x17, cached=0x17) 2024-09-12T17:33:21.452 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.451+0000 7fce8810c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.27 2024-09-12T17:33:21.454 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.452+0000 7fce8810c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.27 info.flags=0x17 2024-09-12T17:33:21.454 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.452+0000 7fce8810c800 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.27 to cache LRU end 2024-09-12T17:33:21.454 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.452+0000 7fce8810c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:33:21.454 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.452+0000 7fce8810c800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.27, ofs0, ns] 2024-09-12T17:33:21.454 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.453+0000 7fcd68ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496986 cookie 94077325845648 notifier 6461 bl.length()=991 2024-09-12T17:33:21.454 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.453+0000 7fcd68ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.27 info.flags=0x17 2024-09-12T17:33:21.454 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.453+0000 7fcd68ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.27 to cache LRU end 2024-09-12T17:33:21.455 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.453+0000 7fcd68ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:33:21.455 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.454+0000 7fce8810c800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.27]): orig_sources= new_sources= 2024-09-12T17:33:21.455 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.454+0000 7fce8810c800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.27]): potential sources added=[] removed=[] 2024-09-12T17:33:21.455 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.454+0000 7fce8810c800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.27]): orig_dests= new_dests= 2024-09-12T17:33:21.456 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.454+0000 7fce8810c800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.27]): potential dests added=[] removed=[] 2024-09-12T17:33:21.457 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.457+0000 7fce8810c800 1 execute INFO: reshard of bucket "error-at-trim-reshard-log-entries" from 11 shards to 12 shards completed successfully 2024-09-12T17:33:21.459 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.459+0000 7fcd377fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:33:21.462 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.461+0000 7fce8810c800 20 remove_watcher() i=0 2024-09-12T17:33:21.462 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.461+0000 7fce8810c800 2 removed watcher, disabling cache 2024-09-12T17:33:21.462 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.462+0000 7fce8810c800 20 remove_watcher() i=1 2024-09-12T17:33:21.463 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.463+0000 7fce8810c800 20 remove_watcher() i=2 2024-09-12T17:33:21.465 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.464+0000 7fce8810c800 20 remove_watcher() i=3 2024-09-12T17:33:21.466 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.465+0000 7fce8810c800 20 remove_watcher() i=4 2024-09-12T17:33:21.467 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.466+0000 7fce8810c800 20 remove_watcher() i=5 2024-09-12T17:33:21.468 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.467+0000 7fce8810c800 20 remove_watcher() i=6 2024-09-12T17:33:21.469 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.468+0000 7fce8810c800 20 remove_watcher() i=7 2024-09-12T17:33:21.482 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-12T17:33:21.511 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:33:21.511 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:33:21.552 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.550+0000 7f6c45f28800 20 rados->read ofs=0 len=0 2024-09-12T17:33:21.553 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.552+0000 7f6c45f28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:21.553 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.552+0000 7f6c45f28800 20 realm 2024-09-12T17:33:21.553 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.552+0000 7f6c45f28800 20 rados->read ofs=0 len=0 2024-09-12T17:33:21.553 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.552+0000 7f6c45f28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:21.553 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.552+0000 7f6c45f28800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:33:21.554 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.552+0000 7f6c45f28800 20 rados->read ofs=0 len=0 2024-09-12T17:33:21.554 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.552+0000 7f6c45f28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:21.554 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.552+0000 7f6c45f28800 20 rados->read ofs=0 len=0 2024-09-12T17:33:21.554 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.553+0000 7f6c45f28800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:33:21.554 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.553+0000 7f6c45f28800 20 rados->read ofs=0 len=0 2024-09-12T17:33:21.554 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.553+0000 7f6c45f28800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:33:21.555 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.553+0000 7f6c45f28800 20 searching for the correct realm 2024-09-12T17:33:21.556 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.556+0000 7f6c4146e640 0 -- 172.21.15.37:0/4073421132 >> [v2:172.21.15.40:6800/2441293461,v1:172.21.15.40:6801/2441293461] conn(0x7f6c34052570 msgr2=0x7f6c3400ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:33:21.763 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.762+0000 7f6c41c6f640 0 -- 172.21.15.37:0/4073421132 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7f6c380778f0 msgr2=0x7f6c380993b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:33:21.971 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.970+0000 7f6c45f28800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:33:21.971 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.970+0000 7f6c45f28800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:33:21.971 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.970+0000 7f6c45f28800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:33:21.971 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.970+0000 7f6c45f28800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:33:21.971 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.970+0000 7f6c45f28800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:33:21.971 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.970+0000 7f6c45f28800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:33:21.971 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.970+0000 7f6c45f28800 20 rados->read ofs=0 len=0 2024-09-12T17:33:21.971 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.970+0000 7f6c45f28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:21.972 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.970+0000 7f6c45f28800 20 rados->read ofs=0 len=0 2024-09-12T17:33:21.973 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.970+0000 7f6c45f28800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:33:21.973 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.970+0000 7f6c45f28800 20 rados->read ofs=0 len=0 2024-09-12T17:33:21.973 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.971+0000 7f6c45f28800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:33:21.973 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.971+0000 7f6c45f28800 20 zone default found 2024-09-12T17:33:21.973 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.971+0000 7f6c45f28800 4 Realm: () 2024-09-12T17:33:21.973 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.971+0000 7f6c45f28800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:33:21.973 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.971+0000 7f6c45f28800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:33:21.973 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.971+0000 7f6c45f28800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:33:21.973 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.971+0000 7f6c45f28800 20 zonegroup default 2024-09-12T17:33:21.974 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.971+0000 7f6c45f28800 20 rados->read ofs=0 len=0 2024-09-12T17:33:21.974 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.971+0000 7f6c45f28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:21.974 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.971+0000 7f6c45f28800 20 rados->read ofs=0 len=0 2024-09-12T17:33:21.974 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.972+0000 7f6c45f28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:21.974 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.972+0000 7f6c45f28800 20 rados->read ofs=0 len=0 2024-09-12T17:33:21.974 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.972+0000 7f6c45f28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:21.974 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.972+0000 7f6c45f28800 20 started sync module instance, tier type = 2024-09-12T17:33:21.974 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.972+0000 7f6c45f28800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:33:21.983 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.982+0000 7f6c45f28800 20 add_watcher() i=0 2024-09-12T17:33:21.983 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.982+0000 7f6c45f28800 20 add_watcher() i=1 2024-09-12T17:33:21.983 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.982+0000 7f6c45f28800 20 add_watcher() i=2 2024-09-12T17:33:21.983 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.982+0000 7f6c45f28800 20 add_watcher() i=3 2024-09-12T17:33:21.984 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.982+0000 7f6c45f28800 20 add_watcher() i=4 2024-09-12T17:33:21.984 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.982+0000 7f6c45f28800 20 add_watcher() i=5 2024-09-12T17:33:21.984 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.982+0000 7f6c45f28800 20 add_watcher() i=6 2024-09-12T17:33:21.984 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.983+0000 7f6c45f28800 20 add_watcher() i=7 2024-09-12T17:33:21.984 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.983+0000 7f6c45f28800 2 all 8 watchers are set, enabling cache 2024-09-12T17:33:21.985 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.985+0000 7f6af37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:33:21.986 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.985+0000 7f6c45f28800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:33:21.987 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.985+0000 7f6c45f28800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:33:21.987 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.985+0000 7f6c45f28800 5 note: GC not initialized 2024-09-12T17:33:21.987 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.985+0000 7f6af27fc640 20 reqs_thread_entry: start 2024-09-12T17:33:21.987 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.986+0000 7f6c45f28800 20 init_complete bucket index max shards: 11 2024-09-12T17:33:21.987 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.986+0000 7f6c45f28800 20 Filter name: none 2024-09-12T17:33:21.987 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.986+0000 7f6a63fff640 20 reqs_thread_entry: start 2024-09-12T17:33:21.987 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.986+0000 7f6c45f28800 20 rados->read ofs=0 len=0 2024-09-12T17:33:21.988 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.986+0000 7f6c45f28800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T17:33:21.988 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.986+0000 7f6c45f28800 20 rados->read ofs=0 len=0 2024-09-12T17:33:21.988 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.987+0000 7f6c45f28800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T17:33:21.988 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.987+0000 7f6c45f28800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:33:21.989 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.987+0000 7f6c45f28800 20 rados->read ofs=0 len=0 2024-09-12T17:33:21.989 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.988+0000 7f6c45f28800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T17:33:21.989 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.988+0000 7f6c45f28800 20 rados->read ofs=0 len=0 2024-09-12T17:33:21.989 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.988+0000 7f6c45f28800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T17:33:21.989 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.988+0000 7f6c45f28800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:33:21.991 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.990+0000 7f6af37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:33:21.993 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.992+0000 7f6c45f28800 20 remove_watcher() i=0 2024-09-12T17:33:21.993 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.992+0000 7f6c45f28800 2 removed watcher, disabling cache 2024-09-12T17:33:21.996 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.993+0000 7f6c45f28800 20 remove_watcher() i=1 2024-09-12T17:33:21.996 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.995+0000 7f6c45f28800 20 remove_watcher() i=2 2024-09-12T17:33:21.997 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.996+0000 7f6c45f28800 20 remove_watcher() i=3 2024-09-12T17:33:21.997 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.997+0000 7f6c45f28800 20 remove_watcher() i=4 2024-09-12T17:33:21.998 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.998+0000 7f6c45f28800 20 remove_watcher() i=5 2024-09-12T17:33:21.999 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:21.999+0000 7f6c45f28800 20 remove_watcher() i=6 2024-09-12T17:33:22.000 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:22.000+0000 7f6c45f28800 20 remove_watcher() i=7 2024-09-12T17:33:22.012 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:33:22.012 INFO:tasks.workunit.client.0.smithi037.stderr:BUCKET_STATS: 2024-09-12T17:33:22.012 INFO:tasks.workunit.client.0.smithi037.stderr:bucket: error-at-trim-reshard-log-entries id: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.27 num_objects: 20 size_kb: 1 num_shards: 12 2024-09-12T17:33:22.012 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:33:22.370 INFO:tasks.workunit.client.0.smithi037.stderr:TEST: reshard bucket with abort at trim_reshard_log_entries 2024-09-12T17:33:22.370 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:33:23.155 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bucket stats --bucket abort-at-trim-reshard-log-entries 2024-09-12T17:33:23.184 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:33:23.185 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:33:23.224 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:23.223+0000 7f0185335800 20 rados->read ofs=0 len=0 2024-09-12T17:33:23.226 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:23.225+0000 7f0185335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:23.226 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:23.225+0000 7f0185335800 20 realm 2024-09-12T17:33:23.226 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:23.225+0000 7f0185335800 20 rados->read ofs=0 len=0 2024-09-12T17:33:23.226 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:23.225+0000 7f0185335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:23.226 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:23.225+0000 7f0185335800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:33:23.226 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:23.225+0000 7f0185335800 20 rados->read ofs=0 len=0 2024-09-12T17:33:23.226 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:23.225+0000 7f0185335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:23.226 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:23.225+0000 7f0185335800 20 rados->read ofs=0 len=0 2024-09-12T17:33:23.227 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:23.226+0000 7f0185335800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:33:23.227 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:23.226+0000 7f0185335800 20 rados->read ofs=0 len=0 2024-09-12T17:33:23.227 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:23.226+0000 7f0185335800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:33:23.227 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:23.226+0000 7f0185335800 20 searching for the correct realm 2024-09-12T17:33:23.229 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:23.229+0000 7f0180820640 0 -- 172.21.15.37:0/904450772 >> [v2:172.21.15.40:6800/2441293461,v1:172.21.15.40:6801/2441293461] conn(0x7f0174038030 msgr2=0x7f0174051940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:33:23.435 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:23.434+0000 7f0181021640 0 -- 172.21.15.37:0/904450772 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7f01780cd280 msgr2=0x7f01780a9d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:33:23.642 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:23.641+0000 7f0185335800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:33:23.642 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:23.641+0000 7f0185335800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:33:23.643 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:23.641+0000 7f0185335800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:33:23.643 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:23.641+0000 7f0185335800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:33:23.643 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:23.641+0000 7f0185335800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:33:23.643 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:23.641+0000 7f0185335800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:33:23.643 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:23.641+0000 7f0185335800 20 rados->read ofs=0 len=0 2024-09-12T17:33:23.643 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:23.641+0000 7f0185335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:23.643 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:23.641+0000 7f0185335800 20 rados->read ofs=0 len=0 2024-09-12T17:33:23.644 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:23.642+0000 7f0185335800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:33:23.644 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:23.642+0000 7f0185335800 20 rados->read ofs=0 len=0 2024-09-12T17:33:23.645 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:23.642+0000 7f0185335800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:33:23.645 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:23.642+0000 7f0185335800 20 zone default found 2024-09-12T17:33:23.645 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:23.642+0000 7f0185335800 4 Realm: () 2024-09-12T17:33:23.645 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:23.642+0000 7f0185335800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:33:23.645 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:23.642+0000 7f0185335800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:33:23.645 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:23.642+0000 7f0185335800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:33:23.645 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:23.642+0000 7f0185335800 20 zonegroup default 2024-09-12T17:33:23.645 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:23.642+0000 7f0185335800 20 rados->read ofs=0 len=0 2024-09-12T17:33:23.645 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:23.643+0000 7f0185335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:23.645 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:23.643+0000 7f0185335800 20 rados->read ofs=0 len=0 2024-09-12T17:33:23.645 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:23.643+0000 7f0185335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:23.645 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:23.643+0000 7f0185335800 20 rados->read ofs=0 len=0 2024-09-12T17:33:23.645 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:23.643+0000 7f0185335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:23.645 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:23.643+0000 7f0185335800 20 started sync module instance, tier type = 2024-09-12T17:33:23.646 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:23.643+0000 7f0185335800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:33:23.655 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:23.654+0000 7f0185335800 20 add_watcher() i=0 2024-09-12T17:33:23.655 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:23.654+0000 7f0185335800 20 add_watcher() i=1 2024-09-12T17:33:23.655 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:23.654+0000 7f0185335800 20 add_watcher() i=2 2024-09-12T17:33:23.655 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:23.654+0000 7f0185335800 20 add_watcher() i=3 2024-09-12T17:33:23.655 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:23.654+0000 7f0185335800 20 add_watcher() i=4 2024-09-12T17:33:23.655 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:23.654+0000 7f0185335800 20 add_watcher() i=5 2024-09-12T17:33:23.655 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:23.654+0000 7f0185335800 20 add_watcher() i=6 2024-09-12T17:33:23.656 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:23.655+0000 7f0185335800 20 add_watcher() i=7 2024-09-12T17:33:23.656 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:23.655+0000 7f0185335800 2 all 8 watchers are set, enabling cache 2024-09-12T17:33:23.657 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:23.657+0000 7f0037fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:33:23.658 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:23.657+0000 7f0185335800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:33:23.658 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:23.657+0000 7f0185335800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:33:23.659 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:23.657+0000 7f0185335800 5 note: GC not initialized 2024-09-12T17:33:23.659 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:23.657+0000 7f0036fe5640 20 reqs_thread_entry: start 2024-09-12T17:33:23.659 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:23.657+0000 7f0185335800 20 init_complete bucket index max shards: 11 2024-09-12T17:33:23.659 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:23.657+0000 7f0185335800 20 Filter name: none 2024-09-12T17:33:23.659 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:23.658+0000 7f0034fe1640 20 reqs_thread_entry: start 2024-09-12T17:33:23.659 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:23.658+0000 7f0185335800 20 rados->read ofs=0 len=0 2024-09-12T17:33:23.659 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:23.658+0000 7f0185335800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T17:33:23.659 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:23.658+0000 7f0185335800 20 rados->read ofs=0 len=0 2024-09-12T17:33:23.660 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:23.659+0000 7f0185335800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T17:33:23.660 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:23.659+0000 7f0185335800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:33:23.660 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:23.659+0000 7f0185335800 20 rados->read ofs=0 len=0 2024-09-12T17:33:23.660 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:23.659+0000 7f0185335800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T17:33:23.660 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:23.659+0000 7f0185335800 20 rados->read ofs=0 len=0 2024-09-12T17:33:23.661 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:23.660+0000 7f0185335800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T17:33:23.661 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:23.660+0000 7f0185335800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:33:23.662 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:23.661+0000 7f0037fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:33:23.664 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:23.664+0000 7f0185335800 20 remove_watcher() i=0 2024-09-12T17:33:23.664 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:23.664+0000 7f0185335800 2 removed watcher, disabling cache 2024-09-12T17:33:23.665 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:23.665+0000 7f0185335800 20 remove_watcher() i=1 2024-09-12T17:33:23.667 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:23.666+0000 7f0185335800 20 remove_watcher() i=2 2024-09-12T17:33:23.668 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:23.667+0000 7f0185335800 20 remove_watcher() i=3 2024-09-12T17:33:23.669 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:23.668+0000 7f0185335800 20 remove_watcher() i=4 2024-09-12T17:33:23.670 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:23.669+0000 7f0185335800 20 remove_watcher() i=5 2024-09-12T17:33:23.671 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:23.670+0000 7f0185335800 20 remove_watcher() i=6 2024-09-12T17:33:23.672 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:23.671+0000 7f0185335800 20 remove_watcher() i=7 2024-09-12T17:33:23.684 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:33:23.684 INFO:tasks.workunit.client.0.smithi037.stderr:BUCKET_STATS: 2024-09-12T17:33:23.684 INFO:tasks.workunit.client.0.smithi037.stderr:bucket: abort-at-trim-reshard-log-entries id: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.28 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:33:23.684 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:33:23.686 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bucket reshard --bucket abort-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at trim_reshard_log_entries 2024-09-12T17:33:23.721 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:33:23.721 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:33:23.761 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:23.760+0000 7f638320e800 20 rados->read ofs=0 len=0 2024-09-12T17:33:23.763 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:23.761+0000 7f638320e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:23.763 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:23.761+0000 7f638320e800 20 realm 2024-09-12T17:33:23.763 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:23.761+0000 7f638320e800 20 rados->read ofs=0 len=0 2024-09-12T17:33:23.763 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:23.761+0000 7f638320e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:23.763 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:23.761+0000 7f638320e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:33:23.763 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:23.761+0000 7f638320e800 20 rados->read ofs=0 len=0 2024-09-12T17:33:23.763 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:23.761+0000 7f638320e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:23.763 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:23.761+0000 7f638320e800 20 rados->read ofs=0 len=0 2024-09-12T17:33:23.764 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:23.762+0000 7f638320e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:33:23.764 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:23.762+0000 7f638320e800 20 rados->read ofs=0 len=0 2024-09-12T17:33:23.764 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:23.762+0000 7f638320e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:33:23.764 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:23.762+0000 7f638320e800 20 searching for the correct realm 2024-09-12T17:33:23.766 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:23.766+0000 7f637e16a640 0 -- 172.21.15.37:0/450165220 >> [v2:172.21.15.40:6800/2441293461,v1:172.21.15.40:6801/2441293461] conn(0x7f637001f060 msgr2=0x7f63700961d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:33:23.770 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:23.770+0000 7f637e96b640 0 -- 172.21.15.37:0/450165220 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7f637402d040 msgr2=0x7f63740980b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:33:23.978 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:23.977+0000 7f638320e800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:33:23.978 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:23.977+0000 7f638320e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:33:23.978 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:23.977+0000 7f638320e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:33:23.978 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:23.977+0000 7f638320e800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:33:23.978 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:23.977+0000 7f638320e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:33:23.979 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:23.977+0000 7f638320e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:33:23.979 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:23.977+0000 7f638320e800 20 rados->read ofs=0 len=0 2024-09-12T17:33:23.979 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:23.977+0000 7f638320e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:23.979 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:23.977+0000 7f638320e800 20 rados->read ofs=0 len=0 2024-09-12T17:33:23.980 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:23.977+0000 7f638320e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:33:23.980 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:23.977+0000 7f638320e800 20 rados->read ofs=0 len=0 2024-09-12T17:33:23.980 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:23.978+0000 7f638320e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:33:23.980 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:23.978+0000 7f638320e800 20 zone default found 2024-09-12T17:33:23.981 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:23.978+0000 7f638320e800 4 Realm: () 2024-09-12T17:33:23.981 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:23.978+0000 7f638320e800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:33:23.981 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:23.978+0000 7f638320e800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:33:23.981 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:23.978+0000 7f638320e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:33:23.981 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:23.978+0000 7f638320e800 20 zonegroup default 2024-09-12T17:33:23.981 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:23.978+0000 7f638320e800 20 rados->read ofs=0 len=0 2024-09-12T17:33:23.981 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:23.978+0000 7f638320e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:23.981 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:23.978+0000 7f638320e800 20 rados->read ofs=0 len=0 2024-09-12T17:33:23.981 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:23.978+0000 7f638320e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:23.981 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:23.978+0000 7f638320e800 20 rados->read ofs=0 len=0 2024-09-12T17:33:23.981 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:23.979+0000 7f638320e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:23.981 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:23.979+0000 7f638320e800 20 started sync module instance, tier type = 2024-09-12T17:33:23.981 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:23.979+0000 7f638320e800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:33:23.989 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:23.988+0000 7f638320e800 20 add_watcher() i=0 2024-09-12T17:33:23.990 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:23.988+0000 7f638320e800 20 add_watcher() i=1 2024-09-12T17:33:23.990 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:23.988+0000 7f638320e800 20 add_watcher() i=2 2024-09-12T17:33:23.990 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:23.988+0000 7f638320e800 20 add_watcher() i=3 2024-09-12T17:33:23.990 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:23.988+0000 7f638320e800 20 add_watcher() i=4 2024-09-12T17:33:23.990 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:23.988+0000 7f638320e800 20 add_watcher() i=5 2024-09-12T17:33:23.990 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:23.988+0000 7f638320e800 20 add_watcher() i=6 2024-09-12T17:33:23.991 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:23.990+0000 7f638320e800 20 add_watcher() i=7 2024-09-12T17:33:23.991 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:23.990+0000 7f638320e800 2 all 8 watchers are set, enabling cache 2024-09-12T17:33:23.993 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:23.992+0000 7f62357e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:33:23.995 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:23.992+0000 7f638320e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:33:23.995 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:23.992+0000 7f638320e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:33:23.995 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:23.992+0000 7f638320e800 5 note: GC not initialized 2024-09-12T17:33:23.995 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:23.993+0000 7f61affff640 20 reqs_thread_entry: start 2024-09-12T17:33:23.995 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:23.993+0000 7f638320e800 20 init_complete bucket index max shards: 11 2024-09-12T17:33:23.995 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:23.993+0000 7f638320e800 20 Filter name: none 2024-09-12T17:33:23.995 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:23.993+0000 7f61adffb640 20 reqs_thread_entry: start 2024-09-12T17:33:23.995 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:23.993+0000 7f638320e800 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-12T17:33:23.995 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:23.993+0000 7f638320e800 20 rados->read ofs=0 len=0 2024-09-12T17:33:23.996 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:23.993+0000 7f638320e800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T17:33:23.996 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:23.993+0000 7f638320e800 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T17:33:23.996 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:23.993+0000 7f638320e800 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-12T17:33:23.996 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:23.993+0000 7f638320e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.28 : miss 2024-09-12T17:33:23.996 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:23.993+0000 7f638320e800 20 rados->read ofs=0 len=0 2024-09-12T17:33:23.996 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:23.994+0000 7f638320e800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T17:33:23.996 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:23.994+0000 7f638320e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.28 info.flags=0x17 2024-09-12T17:33:23.996 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:23.994+0000 7f638320e800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.28 to cache LRU end 2024-09-12T17:33:23.996 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:23.994+0000 7f638320e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:33:23.996 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:23.994+0000 7f638320e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:33:23.996 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:23.994+0000 7f638320e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.28 2024-09-12T17:33:24.000 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:23.999+0000 7f638320e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.28 info.flags=0x17 2024-09-12T17:33:24.000 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:23.999+0000 7f638320e800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.28 to cache LRU end 2024-09-12T17:33:24.000 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:23.999+0000 7f638320e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:33:24.001 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:23.999+0000 7f638320e800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.28, ofs0, ns] 2024-09-12T17:33:24.001 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.000+0000 7f62627fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497053 cookie 94500503182064 notifier 6924 bl.length()=1023 2024-09-12T17:33:24.001 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.000+0000 7f62627fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.28 info.flags=0x17 2024-09-12T17:33:24.001 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.000+0000 7f62627fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.28 to cache LRU end 2024-09-12T17:33:24.001 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.000+0000 7f62627fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:33:24.003 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.002+0000 7f638320e800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.28]): orig_sources= new_sources= 2024-09-12T17:33:24.003 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.002+0000 7f638320e800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.28]): potential sources added=[] removed=[] 2024-09-12T17:33:24.003 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.002+0000 7f638320e800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.28]): orig_dests= new_dests= 2024-09-12T17:33:24.003 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.002+0000 7f638320e800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.28]): potential dests added=[] removed=[] 2024-09-12T17:33:24.003 INFO:tasks.workunit.client.0.smithi037.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f638320e800 time 2024-09-12T17:33:24.002828+0000 2024-09-12T17:33:24.003 INFO:tasks.workunit.client.0.smithi037.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:33:24.004 INFO:tasks.workunit.client.0.smithi037.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:33:24.004 INFO:tasks.workunit.client.0.smithi037.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f638438c71a] 2024-09-12T17:33:24.004 INFO:tasks.workunit.client.0.smithi037.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f638438c8d8] 2024-09-12T17:33:24.004 INFO:tasks.workunit.client.0.smithi037.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f29bd70841] 2024-09-12T17:33:24.004 INFO:tasks.workunit.client.0.smithi037.stderr: 4: radosgw-admin(+0xd7489e) [0x55f29c27e89e] 2024-09-12T17:33:24.004 INFO:tasks.workunit.client.0.smithi037.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55f29bd8050d] 2024-09-12T17:33:24.004 INFO:tasks.workunit.client.0.smithi037.stderr: 6: main() 2024-09-12T17:33:24.004 INFO:tasks.workunit.client.0.smithi037.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f6383029590] 2024-09-12T17:33:24.004 INFO:tasks.workunit.client.0.smithi037.stderr: 8: __libc_start_main() 2024-09-12T17:33:24.004 INFO:tasks.workunit.client.0.smithi037.stderr: 9: _start() 2024-09-12T17:33:24.005 INFO:tasks.workunit.client.0.smithi037.stderr:*** Caught signal (Aborted) ** 2024-09-12T17:33:24.005 INFO:tasks.workunit.client.0.smithi037.stderr: in thread 7f638320e800 thread_name:radosgw-admin 2024-09-12T17:33:24.005 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.002+0000 7f638320e800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f638320e800 time 2024-09-12T17:33:24.002828+0000 2024-09-12T17:33:24.005 INFO:tasks.workunit.client.0.smithi037.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:33:24.005 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:33:24.005 INFO:tasks.workunit.client.0.smithi037.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:33:24.005 INFO:tasks.workunit.client.0.smithi037.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f638438c71a] 2024-09-12T17:33:24.005 INFO:tasks.workunit.client.0.smithi037.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f638438c8d8] 2024-09-12T17:33:24.005 INFO:tasks.workunit.client.0.smithi037.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f29bd70841] 2024-09-12T17:33:24.005 INFO:tasks.workunit.client.0.smithi037.stderr: 4: radosgw-admin(+0xd7489e) [0x55f29c27e89e] 2024-09-12T17:33:24.005 INFO:tasks.workunit.client.0.smithi037.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55f29bd8050d] 2024-09-12T17:33:24.005 INFO:tasks.workunit.client.0.smithi037.stderr: 6: main() 2024-09-12T17:33:24.005 INFO:tasks.workunit.client.0.smithi037.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f6383029590] 2024-09-12T17:33:24.005 INFO:tasks.workunit.client.0.smithi037.stderr: 8: __libc_start_main() 2024-09-12T17:33:24.006 INFO:tasks.workunit.client.0.smithi037.stderr: 9: _start() 2024-09-12T17:33:24.006 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:33:24.026 INFO:tasks.workunit.client.0.smithi037.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:33:24.026 INFO:tasks.workunit.client.0.smithi037.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f638303e6f0] 2024-09-12T17:33:24.026 INFO:tasks.workunit.client.0.smithi037.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f638308b99c] 2024-09-12T17:33:24.026 INFO:tasks.workunit.client.0.smithi037.stderr: 3: raise() 2024-09-12T17:33:24.026 INFO:tasks.workunit.client.0.smithi037.stderr: 4: abort() 2024-09-12T17:33:24.026 INFO:tasks.workunit.client.0.smithi037.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f638438c774] 2024-09-12T17:33:24.026 INFO:tasks.workunit.client.0.smithi037.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f638438c8d8] 2024-09-12T17:33:24.027 INFO:tasks.workunit.client.0.smithi037.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f29bd70841] 2024-09-12T17:33:24.027 INFO:tasks.workunit.client.0.smithi037.stderr: 8: radosgw-admin(+0xd7489e) [0x55f29c27e89e] 2024-09-12T17:33:24.027 INFO:tasks.workunit.client.0.smithi037.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55f29bd8050d] 2024-09-12T17:33:24.027 INFO:tasks.workunit.client.0.smithi037.stderr: 10: main() 2024-09-12T17:33:24.027 INFO:tasks.workunit.client.0.smithi037.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f6383029590] 2024-09-12T17:33:24.027 INFO:tasks.workunit.client.0.smithi037.stderr: 12: __libc_start_main() 2024-09-12T17:33:24.027 INFO:tasks.workunit.client.0.smithi037.stderr: 13: _start() 2024-09-12T17:33:24.027 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.003+0000 7f638320e800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:33:24.027 INFO:tasks.workunit.client.0.smithi037.stderr: in thread 7f638320e800 thread_name:radosgw-admin 2024-09-12T17:33:24.028 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:33:24.028 INFO:tasks.workunit.client.0.smithi037.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:33:24.028 INFO:tasks.workunit.client.0.smithi037.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f638303e6f0] 2024-09-12T17:33:24.028 INFO:tasks.workunit.client.0.smithi037.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f638308b99c] 2024-09-12T17:33:24.028 INFO:tasks.workunit.client.0.smithi037.stderr: 3: raise() 2024-09-12T17:33:24.028 INFO:tasks.workunit.client.0.smithi037.stderr: 4: abort() 2024-09-12T17:33:24.028 INFO:tasks.workunit.client.0.smithi037.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f638438c774] 2024-09-12T17:33:24.028 INFO:tasks.workunit.client.0.smithi037.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f638438c8d8] 2024-09-12T17:33:24.028 INFO:tasks.workunit.client.0.smithi037.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f29bd70841] 2024-09-12T17:33:24.028 INFO:tasks.workunit.client.0.smithi037.stderr: 8: radosgw-admin(+0xd7489e) [0x55f29c27e89e] 2024-09-12T17:33:24.028 INFO:tasks.workunit.client.0.smithi037.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55f29bd8050d] 2024-09-12T17:33:24.028 INFO:tasks.workunit.client.0.smithi037.stderr: 10: main() 2024-09-12T17:33:24.028 INFO:tasks.workunit.client.0.smithi037.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f6383029590] 2024-09-12T17:33:24.029 INFO:tasks.workunit.client.0.smithi037.stderr: 12: __libc_start_main() 2024-09-12T17:33:24.029 INFO:tasks.workunit.client.0.smithi037.stderr: 13: _start() 2024-09-12T17:33:24.029 INFO:tasks.workunit.client.0.smithi037.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:33:24.029 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:33:24.029 INFO:tasks.workunit.client.0.smithi037.stderr:--- begin dump of recent events --- 2024-09-12T17:33:24.029 INFO:tasks.workunit.client.0.smithi037.stderr: -499> 2024-09-12T17:33:23.742+0000 7f626ce09640 10 monclient: handle_config config(0 keys) 2024-09-12T17:33:24.029 INFO:tasks.workunit.client.0.smithi037.stderr: -498> 2024-09-12T17:33:23.742+0000 7f638320e800 10 monclient: get_monmap_and_config success 2024-09-12T17:33:24.029 INFO:tasks.workunit.client.0.smithi037.stderr: -497> 2024-09-12T17:33:23.742+0000 7f638320e800 4 set_mon_vals no callback set 2024-09-12T17:33:24.029 INFO:tasks.workunit.client.0.smithi037.stderr: -496> 2024-09-12T17:33:23.742+0000 7f626ce09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:33:24.029 INFO:tasks.workunit.client.0.smithi037.stderr: -495> 2024-09-12T17:33:23.742+0000 7f626ce09640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:33:24.030 INFO:tasks.workunit.client.0.smithi037.stderr: -494> 2024-09-12T17:33:23.742+0000 7f626ce09640 10 monclient: dump: 2024-09-12T17:33:24.030 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:33:24.030 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:33:24.030 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:33:24.030 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:33:24.030 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:33:24.030 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:33:24.030 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:33:24.030 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:33:24.030 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:33:24.030 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:33:24.030 INFO:tasks.workunit.client.0.smithi037.stderr: -493> 2024-09-12T17:33:23.743+0000 7f638320e800 10 monclient: shutdown 2024-09-12T17:33:24.030 INFO:tasks.workunit.client.0.smithi037.stderr: -492> 2024-09-12T17:33:23.743+0000 7f638320e800 5 asok(0x55f29cba7730) unregister_commands rotate-key 2024-09-12T17:33:24.030 INFO:tasks.workunit.client.0.smithi037.stderr: -491> 2024-09-12T17:33:23.743+0000 7f638320e800 10 monclient: build_initial_monmap 2024-09-12T17:33:24.031 INFO:tasks.workunit.client.0.smithi037.stderr: -490> 2024-09-12T17:33:23.743+0000 7f638320e800 1 build_initial for_mkfs: 0 2024-09-12T17:33:24.031 INFO:tasks.workunit.client.0.smithi037.stderr: -489> 2024-09-12T17:33:23.743+0000 7f638320e800 10 monclient: monmap: 2024-09-12T17:33:24.031 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 0 2024-09-12T17:33:24.031 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:33:24.031 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 0.000000 2024-09-12T17:33:24.031 INFO:tasks.workunit.client.0.smithi037.stderr:created 0.000000 2024-09-12T17:33:24.031 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 0 (unknown) 2024-09-12T17:33:24.031 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:33:24.031 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.noname-a 2024-09-12T17:33:24.031 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.noname-b 2024-09-12T17:33:24.031 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.noname-c 2024-09-12T17:33:24.032 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:33:24.032 INFO:tasks.workunit.client.0.smithi037.stderr: -488> 2024-09-12T17:33:23.743+0000 7f638320e800 5 AuthRegistry(0x55f29cdcf680) adding auth protocol: cephx 2024-09-12T17:33:24.032 INFO:tasks.workunit.client.0.smithi037.stderr: -487> 2024-09-12T17:33:23.743+0000 7f638320e800 5 AuthRegistry(0x55f29cdcf680) adding auth protocol: cephx 2024-09-12T17:33:24.032 INFO:tasks.workunit.client.0.smithi037.stderr: -486> 2024-09-12T17:33:23.743+0000 7f638320e800 5 AuthRegistry(0x55f29cdcf680) adding auth protocol: cephx 2024-09-12T17:33:24.032 INFO:tasks.workunit.client.0.smithi037.stderr: -485> 2024-09-12T17:33:23.743+0000 7f638320e800 5 AuthRegistry(0x55f29cdcf680) adding con mode: secure 2024-09-12T17:33:24.032 INFO:tasks.workunit.client.0.smithi037.stderr: -484> 2024-09-12T17:33:23.743+0000 7f638320e800 5 AuthRegistry(0x55f29cdcf680) adding con mode: crc 2024-09-12T17:33:24.032 INFO:tasks.workunit.client.0.smithi037.stderr: -483> 2024-09-12T17:33:23.743+0000 7f638320e800 5 AuthRegistry(0x55f29cdcf680) adding con mode: secure 2024-09-12T17:33:24.032 INFO:tasks.workunit.client.0.smithi037.stderr: -482> 2024-09-12T17:33:23.743+0000 7f638320e800 5 AuthRegistry(0x55f29cdcf680) adding con mode: crc 2024-09-12T17:33:24.032 INFO:tasks.workunit.client.0.smithi037.stderr: -481> 2024-09-12T17:33:23.743+0000 7f638320e800 5 AuthRegistry(0x55f29cdcf680) adding con mode: secure 2024-09-12T17:33:24.032 INFO:tasks.workunit.client.0.smithi037.stderr: -480> 2024-09-12T17:33:23.743+0000 7f638320e800 5 AuthRegistry(0x55f29cdcf680) adding con mode: crc 2024-09-12T17:33:24.032 INFO:tasks.workunit.client.0.smithi037.stderr: -479> 2024-09-12T17:33:23.743+0000 7f638320e800 5 AuthRegistry(0x55f29cdcf680) adding con mode: crc 2024-09-12T17:33:24.032 INFO:tasks.workunit.client.0.smithi037.stderr: -478> 2024-09-12T17:33:23.743+0000 7f638320e800 5 AuthRegistry(0x55f29cdcf680) adding con mode: secure 2024-09-12T17:33:24.032 INFO:tasks.workunit.client.0.smithi037.stderr: -477> 2024-09-12T17:33:23.743+0000 7f638320e800 5 AuthRegistry(0x55f29cdcf680) adding con mode: crc 2024-09-12T17:33:24.033 INFO:tasks.workunit.client.0.smithi037.stderr: -476> 2024-09-12T17:33:23.743+0000 7f638320e800 5 AuthRegistry(0x55f29cdcf680) adding con mode: secure 2024-09-12T17:33:24.033 INFO:tasks.workunit.client.0.smithi037.stderr: -475> 2024-09-12T17:33:23.743+0000 7f638320e800 5 AuthRegistry(0x55f29cdcf680) adding con mode: crc 2024-09-12T17:33:24.033 INFO:tasks.workunit.client.0.smithi037.stderr: -474> 2024-09-12T17:33:23.743+0000 7f638320e800 5 AuthRegistry(0x55f29cdcf680) adding con mode: secure 2024-09-12T17:33:24.033 INFO:tasks.workunit.client.0.smithi037.stderr: -473> 2024-09-12T17:33:23.743+0000 7f638320e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:33:24.033 INFO:tasks.workunit.client.0.smithi037.stderr: -472> 2024-09-12T17:33:23.743+0000 7f638320e800 1 librados: starting msgr at 2024-09-12T17:33:24.033 INFO:tasks.workunit.client.0.smithi037.stderr: -471> 2024-09-12T17:33:23.743+0000 7f638320e800 1 librados: starting objecter 2024-09-12T17:33:24.033 INFO:tasks.workunit.client.0.smithi037.stderr: -470> 2024-09-12T17:33:23.743+0000 7f638320e800 5 asok(0x55f29cba7730) register_command objecter_requests hook 0x55f29cdf3ae0 2024-09-12T17:33:24.034 INFO:tasks.workunit.client.0.smithi037.stderr: -469> 2024-09-12T17:33:23.743+0000 7f638320e800 1 librados: setting wanted keys 2024-09-12T17:33:24.034 INFO:tasks.workunit.client.0.smithi037.stderr: -468> 2024-09-12T17:33:23.743+0000 7f638320e800 1 librados: calling monclient init 2024-09-12T17:33:24.034 INFO:tasks.workunit.client.0.smithi037.stderr: -467> 2024-09-12T17:33:23.743+0000 7f638320e800 10 monclient: init 2024-09-12T17:33:24.034 INFO:tasks.workunit.client.0.smithi037.stderr: -466> 2024-09-12T17:33:23.743+0000 7f638320e800 5 AuthRegistry(0x55f29cdc9fc0) adding auth protocol: cephx 2024-09-12T17:33:24.034 INFO:tasks.workunit.client.0.smithi037.stderr: -465> 2024-09-12T17:33:23.743+0000 7f638320e800 5 AuthRegistry(0x55f29cdc9fc0) adding auth protocol: cephx 2024-09-12T17:33:24.037 INFO:tasks.workunit.client.0.smithi037.stderr: -464> 2024-09-12T17:33:23.743+0000 7f638320e800 5 AuthRegistry(0x55f29cdc9fc0) adding auth protocol: cephx 2024-09-12T17:33:24.037 INFO:tasks.workunit.client.0.smithi037.stderr: -463> 2024-09-12T17:33:23.743+0000 7f638320e800 5 AuthRegistry(0x55f29cdc9fc0) adding con mode: secure 2024-09-12T17:33:24.037 INFO:tasks.workunit.client.0.smithi037.stderr: -462> 2024-09-12T17:33:23.743+0000 7f638320e800 5 AuthRegistry(0x55f29cdc9fc0) adding con mode: crc 2024-09-12T17:33:24.037 INFO:tasks.workunit.client.0.smithi037.stderr: -461> 2024-09-12T17:33:23.743+0000 7f638320e800 5 AuthRegistry(0x55f29cdc9fc0) adding con mode: secure 2024-09-12T17:33:24.037 INFO:tasks.workunit.client.0.smithi037.stderr: -460> 2024-09-12T17:33:23.743+0000 7f638320e800 5 AuthRegistry(0x55f29cdc9fc0) adding con mode: crc 2024-09-12T17:33:24.037 INFO:tasks.workunit.client.0.smithi037.stderr: -459> 2024-09-12T17:33:23.743+0000 7f638320e800 5 AuthRegistry(0x55f29cdc9fc0) adding con mode: secure 2024-09-12T17:33:24.037 INFO:tasks.workunit.client.0.smithi037.stderr: -458> 2024-09-12T17:33:23.743+0000 7f638320e800 5 AuthRegistry(0x55f29cdc9fc0) adding con mode: crc 2024-09-12T17:33:24.038 INFO:tasks.workunit.client.0.smithi037.stderr: -457> 2024-09-12T17:33:23.743+0000 7f638320e800 5 AuthRegistry(0x55f29cdc9fc0) adding con mode: crc 2024-09-12T17:33:24.038 INFO:tasks.workunit.client.0.smithi037.stderr: -456> 2024-09-12T17:33:23.743+0000 7f638320e800 5 AuthRegistry(0x55f29cdc9fc0) adding con mode: secure 2024-09-12T17:33:24.038 INFO:tasks.workunit.client.0.smithi037.stderr: -455> 2024-09-12T17:33:23.743+0000 7f638320e800 5 AuthRegistry(0x55f29cdc9fc0) adding con mode: crc 2024-09-12T17:33:24.038 INFO:tasks.workunit.client.0.smithi037.stderr: -454> 2024-09-12T17:33:23.743+0000 7f638320e800 5 AuthRegistry(0x55f29cdc9fc0) adding con mode: secure 2024-09-12T17:33:24.038 INFO:tasks.workunit.client.0.smithi037.stderr: -453> 2024-09-12T17:33:23.743+0000 7f638320e800 5 AuthRegistry(0x55f29cdc9fc0) adding con mode: crc 2024-09-12T17:33:24.038 INFO:tasks.workunit.client.0.smithi037.stderr: -452> 2024-09-12T17:33:23.743+0000 7f638320e800 5 AuthRegistry(0x55f29cdc9fc0) adding con mode: secure 2024-09-12T17:33:24.038 INFO:tasks.workunit.client.0.smithi037.stderr: -451> 2024-09-12T17:33:23.743+0000 7f638320e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:33:24.038 INFO:tasks.workunit.client.0.smithi037.stderr: -450> 2024-09-12T17:33:23.744+0000 7f638320e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:33:24.038 INFO:tasks.workunit.client.0.smithi037.stderr: -449> 2024-09-12T17:33:23.744+0000 7f638320e800 5 asok(0x55f29cba7730) register_command rotate-key hook 0x55f29cdca108 2024-09-12T17:33:24.039 INFO:tasks.workunit.client.0.smithi037.stderr: -448> 2024-09-12T17:33:23.744+0000 7f638320e800 10 monclient: _reopen_session rank -1 2024-09-12T17:33:24.039 INFO:tasks.workunit.client.0.smithi037.stderr: -447> 2024-09-12T17:33:23.744+0000 7f638320e800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T17:33:24.039 INFO:tasks.workunit.client.0.smithi037.stderr: -446> 2024-09-12T17:33:23.744+0000 7f638320e800 10 monclient(hunting): picked mon.noname-a con 0x55f29cd0b2f0 addr [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] 2024-09-12T17:33:24.039 INFO:tasks.workunit.client.0.smithi037.stderr: -445> 2024-09-12T17:33:23.744+0000 7f638320e800 10 monclient(hunting): picked mon.noname-b con 0x55f29cd0e470 addr [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] 2024-09-12T17:33:24.039 INFO:tasks.workunit.client.0.smithi037.stderr: -444> 2024-09-12T17:33:23.744+0000 7f638320e800 10 monclient(hunting): picked mon.noname-c con 0x55f29cd16d70 addr [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] 2024-09-12T17:33:24.039 INFO:tasks.workunit.client.0.smithi037.stderr: -443> 2024-09-12T17:33:23.744+0000 7f638320e800 10 monclient(hunting): start opening mon connection 2024-09-12T17:33:24.039 INFO:tasks.workunit.client.0.smithi037.stderr: -442> 2024-09-12T17:33:23.744+0000 7f638320e800 10 monclient(hunting): start opening mon connection 2024-09-12T17:33:24.039 INFO:tasks.workunit.client.0.smithi037.stderr: -441> 2024-09-12T17:33:23.744+0000 7f638320e800 10 monclient(hunting): start opening mon connection 2024-09-12T17:33:24.039 INFO:tasks.workunit.client.0.smithi037.stderr: -440> 2024-09-12T17:33:23.744+0000 7f638320e800 10 monclient(hunting): _renew_subs 2024-09-12T17:33:24.040 INFO:tasks.workunit.client.0.smithi037.stderr: -439> 2024-09-12T17:33:23.744+0000 7f638320e800 10 monclient(hunting): authenticate will time out at 2191.341277s 2024-09-12T17:33:24.040 INFO:tasks.workunit.client.0.smithi037.stderr: -438> 2024-09-12T17:33:23.744+0000 7f637e96b640 10 monclient(hunting): get_auth_request con 0x55f29cd0b2f0 auth_method 0 2024-09-12T17:33:24.040 INFO:tasks.workunit.client.0.smithi037.stderr: -437> 2024-09-12T17:33:23.744+0000 7f637e96b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:33:24.040 INFO:tasks.workunit.client.0.smithi037.stderr: -436> 2024-09-12T17:33:23.744+0000 7f637e96b640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:33:24.040 INFO:tasks.workunit.client.0.smithi037.stderr: -435> 2024-09-12T17:33:23.744+0000 7f637e96b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:33:24.040 INFO:tasks.workunit.client.0.smithi037.stderr: -434> 2024-09-12T17:33:23.744+0000 7f637e96b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:33:24.040 INFO:tasks.workunit.client.0.smithi037.stderr: -433> 2024-09-12T17:33:23.744+0000 7f637e96b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:33:24.040 INFO:tasks.workunit.client.0.smithi037.stderr: -432> 2024-09-12T17:33:23.744+0000 7f637e96b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:33:24.040 INFO:tasks.workunit.client.0.smithi037.stderr: -431> 2024-09-12T17:33:23.744+0000 7f637e16a640 10 monclient(hunting): get_auth_request con 0x55f29cd0e470 auth_method 0 2024-09-12T17:33:24.040 INFO:tasks.workunit.client.0.smithi037.stderr: -430> 2024-09-12T17:33:23.744+0000 7f637e16a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:33:24.041 INFO:tasks.workunit.client.0.smithi037.stderr: -429> 2024-09-12T17:33:23.744+0000 7f637e16a640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:33:24.041 INFO:tasks.workunit.client.0.smithi037.stderr: -428> 2024-09-12T17:33:23.744+0000 7f637e16a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:33:24.041 INFO:tasks.workunit.client.0.smithi037.stderr: -427> 2024-09-12T17:33:23.744+0000 7f637e96b640 10 monclient(hunting): handle_auth_done global_id 6915 payload 824 2024-09-12T17:33:24.041 INFO:tasks.workunit.client.0.smithi037.stderr: -426> 2024-09-12T17:33:23.744+0000 7f637e96b640 10 monclient: _finish_hunting 0 2024-09-12T17:33:24.041 INFO:tasks.workunit.client.0.smithi037.stderr: -425> 2024-09-12T17:33:23.744+0000 7f637e96b640 1 monclient: found mon.noname-a 2024-09-12T17:33:24.041 INFO:tasks.workunit.client.0.smithi037.stderr: -424> 2024-09-12T17:33:23.744+0000 7f637e96b640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.37:3300/0 2024-09-12T17:33:24.041 INFO:tasks.workunit.client.0.smithi037.stderr: -423> 2024-09-12T17:33:23.744+0000 7f626b606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:33:24.041 INFO:tasks.workunit.client.0.smithi037.stderr: -422> 2024-09-12T17:33:23.744+0000 7f626b606640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:33:24.041 INFO:tasks.workunit.client.0.smithi037.stderr: -421> 2024-09-12T17:33:23.744+0000 7f626b606640 10 monclient: dump: 2024-09-12T17:33:24.041 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:33:24.041 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:33:24.041 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:33:24.041 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:33:24.041 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:33:24.042 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:33:24.042 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:33:24.042 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:33:24.042 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:33:24.042 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:33:24.042 INFO:tasks.workunit.client.0.smithi037.stderr: -420> 2024-09-12T17:33:23.744+0000 7f626b606640 10 monclient: _finish_auth 0 2024-09-12T17:33:24.042 INFO:tasks.workunit.client.0.smithi037.stderr: -419> 2024-09-12T17:33:23.744+0000 7f626b606640 10 monclient: _check_auth_tickets 2024-09-12T17:33:24.042 INFO:tasks.workunit.client.0.smithi037.stderr: -418> 2024-09-12T17:33:23.744+0000 7f626b606640 10 monclient: handle_config config(0 keys) 2024-09-12T17:33:24.042 INFO:tasks.workunit.client.0.smithi037.stderr: -417> 2024-09-12T17:33:23.744+0000 7f626b606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:33:24.042 INFO:tasks.workunit.client.0.smithi037.stderr: -416> 2024-09-12T17:33:23.744+0000 7f626b606640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:33:24.042 INFO:tasks.workunit.client.0.smithi037.stderr: -415> 2024-09-12T17:33:23.744+0000 7f626b606640 10 monclient: dump: 2024-09-12T17:33:24.042 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:33:24.042 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:33:24.042 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:33:24.043 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:33:24.043 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:33:24.043 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:33:24.043 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:33:24.043 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:33:24.043 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:33:24.043 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:33:24.043 INFO:tasks.workunit.client.0.smithi037.stderr: -414> 2024-09-12T17:33:23.744+0000 7f638320e800 5 monclient: authenticate success, global_id 6915 2024-09-12T17:33:24.043 INFO:tasks.workunit.client.0.smithi037.stderr: -413> 2024-09-12T17:33:23.744+0000 7f638320e800 10 monclient: _renew_subs 2024-09-12T17:33:24.043 INFO:tasks.workunit.client.0.smithi037.stderr: -412> 2024-09-12T17:33:23.744+0000 7f638320e800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.37:3300/0 2024-09-12T17:33:24.043 INFO:tasks.workunit.client.0.smithi037.stderr: -411> 2024-09-12T17:33:23.744+0000 7f626ce09640 4 set_mon_vals no callback set 2024-09-12T17:33:24.043 INFO:tasks.workunit.client.0.smithi037.stderr: -410> 2024-09-12T17:33:23.744+0000 7f638320e800 10 monclient: _renew_subs 2024-09-12T17:33:24.043 INFO:tasks.workunit.client.0.smithi037.stderr: -409> 2024-09-12T17:33:23.744+0000 7f638320e800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.37:3300/0 2024-09-12T17:33:24.043 INFO:tasks.workunit.client.0.smithi037.stderr: -408> 2024-09-12T17:33:23.744+0000 7f638320e800 1 librados: init done 2024-09-12T17:33:24.043 INFO:tasks.workunit.client.0.smithi037.stderr: -407> 2024-09-12T17:33:23.746+0000 7f626b606640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:33:24.044 INFO:tasks.workunit.client.0.smithi037.stderr: -406> 2024-09-12T17:33:23.746+0000 7f626b606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.40:6816/3916250676,v1:172.21.15.40:6817/3916250676] 2024-09-12T17:33:24.044 INFO:tasks.workunit.client.0.smithi037.stderr: -405> 2024-09-12T17:33:23.746+0000 7f626b606640 4 mgrc reconnect Starting new session with [v2:172.21.15.40:6816/3916250676,v1:172.21.15.40:6817/3916250676] 2024-09-12T17:33:24.044 INFO:tasks.workunit.client.0.smithi037.stderr: -404> 2024-09-12T17:33:23.747+0000 7f637e16a640 10 monclient: get_auth_request con 0x7f6264076470 auth_method 0 2024-09-12T17:33:24.044 INFO:tasks.workunit.client.0.smithi037.stderr: -403> 2024-09-12T17:33:23.747+0000 7f637f16c640 10 monclient: get_auth_request con 0x55f29cdf2610 auth_method 0 2024-09-12T17:33:24.044 INFO:tasks.workunit.client.0.smithi037.stderr: -402> 2024-09-12T17:33:23.748+0000 7f637e96b640 10 monclient: get_auth_request con 0x55f29ce152d0 auth_method 0 2024-09-12T17:33:24.044 INFO:tasks.workunit.client.0.smithi037.stderr: -401> 2024-09-12T17:33:23.749+0000 7f637e16a640 10 monclient: get_auth_request con 0x55f29ce1a470 auth_method 0 2024-09-12T17:33:24.044 INFO:tasks.workunit.client.0.smithi037.stderr: -400> 2024-09-12T17:33:23.750+0000 7f638320e800 10 monclient: build_initial_monmap 2024-09-12T17:33:24.044 INFO:tasks.workunit.client.0.smithi037.stderr: -399> 2024-09-12T17:33:23.750+0000 7f638320e800 1 build_initial for_mkfs: 0 2024-09-12T17:33:24.044 INFO:tasks.workunit.client.0.smithi037.stderr: -398> 2024-09-12T17:33:23.750+0000 7f638320e800 10 monclient: monmap: 2024-09-12T17:33:24.044 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 0 2024-09-12T17:33:24.044 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:33:24.044 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 0.000000 2024-09-12T17:33:24.044 INFO:tasks.workunit.client.0.smithi037.stderr:created 0.000000 2024-09-12T17:33:24.045 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 0 (unknown) 2024-09-12T17:33:24.045 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:33:24.045 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.noname-a 2024-09-12T17:33:24.045 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.noname-b 2024-09-12T17:33:24.045 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.noname-c 2024-09-12T17:33:24.045 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:33:24.045 INFO:tasks.workunit.client.0.smithi037.stderr: -397> 2024-09-12T17:33:23.750+0000 7f638320e800 5 AuthRegistry(0x55f29ce1e360) adding auth protocol: cephx 2024-09-12T17:33:24.045 INFO:tasks.workunit.client.0.smithi037.stderr: -396> 2024-09-12T17:33:23.750+0000 7f638320e800 5 AuthRegistry(0x55f29ce1e360) adding auth protocol: cephx 2024-09-12T17:33:24.045 INFO:tasks.workunit.client.0.smithi037.stderr: -395> 2024-09-12T17:33:23.750+0000 7f638320e800 5 AuthRegistry(0x55f29ce1e360) adding auth protocol: cephx 2024-09-12T17:33:24.045 INFO:tasks.workunit.client.0.smithi037.stderr: -394> 2024-09-12T17:33:23.750+0000 7f638320e800 5 AuthRegistry(0x55f29ce1e360) adding con mode: secure 2024-09-12T17:33:24.045 INFO:tasks.workunit.client.0.smithi037.stderr: -393> 2024-09-12T17:33:23.750+0000 7f638320e800 5 AuthRegistry(0x55f29ce1e360) adding con mode: crc 2024-09-12T17:33:24.045 INFO:tasks.workunit.client.0.smithi037.stderr: -392> 2024-09-12T17:33:23.750+0000 7f638320e800 5 AuthRegistry(0x55f29ce1e360) adding con mode: secure 2024-09-12T17:33:24.045 INFO:tasks.workunit.client.0.smithi037.stderr: -391> 2024-09-12T17:33:23.750+0000 7f638320e800 5 AuthRegistry(0x55f29ce1e360) adding con mode: crc 2024-09-12T17:33:24.045 INFO:tasks.workunit.client.0.smithi037.stderr: -390> 2024-09-12T17:33:23.750+0000 7f638320e800 5 AuthRegistry(0x55f29ce1e360) adding con mode: secure 2024-09-12T17:33:24.045 INFO:tasks.workunit.client.0.smithi037.stderr: -389> 2024-09-12T17:33:23.750+0000 7f638320e800 5 AuthRegistry(0x55f29ce1e360) adding con mode: crc 2024-09-12T17:33:24.046 INFO:tasks.workunit.client.0.smithi037.stderr: -388> 2024-09-12T17:33:23.750+0000 7f638320e800 5 AuthRegistry(0x55f29ce1e360) adding con mode: crc 2024-09-12T17:33:24.046 INFO:tasks.workunit.client.0.smithi037.stderr: -387> 2024-09-12T17:33:23.750+0000 7f638320e800 5 AuthRegistry(0x55f29ce1e360) adding con mode: secure 2024-09-12T17:33:24.046 INFO:tasks.workunit.client.0.smithi037.stderr: -386> 2024-09-12T17:33:23.750+0000 7f638320e800 5 AuthRegistry(0x55f29ce1e360) adding con mode: crc 2024-09-12T17:33:24.046 INFO:tasks.workunit.client.0.smithi037.stderr: -385> 2024-09-12T17:33:23.750+0000 7f638320e800 5 AuthRegistry(0x55f29ce1e360) adding con mode: secure 2024-09-12T17:33:24.046 INFO:tasks.workunit.client.0.smithi037.stderr: -384> 2024-09-12T17:33:23.750+0000 7f638320e800 5 AuthRegistry(0x55f29ce1e360) adding con mode: crc 2024-09-12T17:33:24.046 INFO:tasks.workunit.client.0.smithi037.stderr: -383> 2024-09-12T17:33:23.750+0000 7f638320e800 5 AuthRegistry(0x55f29ce1e360) adding con mode: secure 2024-09-12T17:33:24.046 INFO:tasks.workunit.client.0.smithi037.stderr: -382> 2024-09-12T17:33:23.750+0000 7f638320e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:33:24.046 INFO:tasks.workunit.client.0.smithi037.stderr: -381> 2024-09-12T17:33:23.750+0000 7f638320e800 5 asok(0x55f29cba7730) register_command objecter_requests cmddesc objecter_requests hook 0x55f29ce21db0 EEXIST 2024-09-12T17:33:24.046 INFO:tasks.workunit.client.0.smithi037.stderr: -380> 2024-09-12T17:33:23.751+0000 7f638320e800 10 monclient: init 2024-09-12T17:33:24.046 INFO:tasks.workunit.client.0.smithi037.stderr: -379> 2024-09-12T17:33:23.751+0000 7f638320e800 5 AuthRegistry(0x55f29ce1d448) adding auth protocol: cephx 2024-09-12T17:33:24.046 INFO:tasks.workunit.client.0.smithi037.stderr: -378> 2024-09-12T17:33:23.751+0000 7f638320e800 5 AuthRegistry(0x55f29ce1d448) adding auth protocol: cephx 2024-09-12T17:33:24.046 INFO:tasks.workunit.client.0.smithi037.stderr: -377> 2024-09-12T17:33:23.751+0000 7f638320e800 5 AuthRegistry(0x55f29ce1d448) adding auth protocol: cephx 2024-09-12T17:33:24.046 INFO:tasks.workunit.client.0.smithi037.stderr: -376> 2024-09-12T17:33:23.751+0000 7f638320e800 5 AuthRegistry(0x55f29ce1d448) adding con mode: secure 2024-09-12T17:33:24.047 INFO:tasks.workunit.client.0.smithi037.stderr: -375> 2024-09-12T17:33:23.751+0000 7f638320e800 5 AuthRegistry(0x55f29ce1d448) adding con mode: crc 2024-09-12T17:33:24.047 INFO:tasks.workunit.client.0.smithi037.stderr: -374> 2024-09-12T17:33:23.751+0000 7f638320e800 5 AuthRegistry(0x55f29ce1d448) adding con mode: secure 2024-09-12T17:33:24.047 INFO:tasks.workunit.client.0.smithi037.stderr: -373> 2024-09-12T17:33:23.751+0000 7f638320e800 5 AuthRegistry(0x55f29ce1d448) adding con mode: crc 2024-09-12T17:33:24.047 INFO:tasks.workunit.client.0.smithi037.stderr: -372> 2024-09-12T17:33:23.751+0000 7f638320e800 5 AuthRegistry(0x55f29ce1d448) adding con mode: secure 2024-09-12T17:33:24.047 INFO:tasks.workunit.client.0.smithi037.stderr: -371> 2024-09-12T17:33:23.751+0000 7f638320e800 5 AuthRegistry(0x55f29ce1d448) adding con mode: crc 2024-09-12T17:33:24.047 INFO:tasks.workunit.client.0.smithi037.stderr: -370> 2024-09-12T17:33:23.751+0000 7f638320e800 5 AuthRegistry(0x55f29ce1d448) adding con mode: crc 2024-09-12T17:33:24.047 INFO:tasks.workunit.client.0.smithi037.stderr: -369> 2024-09-12T17:33:23.751+0000 7f638320e800 5 AuthRegistry(0x55f29ce1d448) adding con mode: secure 2024-09-12T17:33:24.047 INFO:tasks.workunit.client.0.smithi037.stderr: -368> 2024-09-12T17:33:23.751+0000 7f638320e800 5 AuthRegistry(0x55f29ce1d448) adding con mode: crc 2024-09-12T17:33:24.047 INFO:tasks.workunit.client.0.smithi037.stderr: -367> 2024-09-12T17:33:23.751+0000 7f638320e800 5 AuthRegistry(0x55f29ce1d448) adding con mode: secure 2024-09-12T17:33:24.047 INFO:tasks.workunit.client.0.smithi037.stderr: -366> 2024-09-12T17:33:23.751+0000 7f638320e800 5 AuthRegistry(0x55f29ce1d448) adding con mode: crc 2024-09-12T17:33:24.047 INFO:tasks.workunit.client.0.smithi037.stderr: -365> 2024-09-12T17:33:23.751+0000 7f638320e800 5 AuthRegistry(0x55f29ce1d448) adding con mode: secure 2024-09-12T17:33:24.047 INFO:tasks.workunit.client.0.smithi037.stderr: -364> 2024-09-12T17:33:23.751+0000 7f638320e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:33:24.047 INFO:tasks.workunit.client.0.smithi037.stderr: -363> 2024-09-12T17:33:23.751+0000 7f638320e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:33:24.048 INFO:tasks.workunit.client.0.smithi037.stderr: -362> 2024-09-12T17:33:23.751+0000 7f638320e800 5 asok(0x55f29cba7730) register_command rotate-key cmddesc rotate-key hook 0x55f29ce1d590 EEXIST 2024-09-12T17:33:24.048 INFO:tasks.workunit.client.0.smithi037.stderr: -361> 2024-09-12T17:33:23.751+0000 7f638320e800 10 monclient: _reopen_session rank -1 2024-09-12T17:33:24.048 INFO:tasks.workunit.client.0.smithi037.stderr: -360> 2024-09-12T17:33:23.751+0000 7f638320e800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T17:33:24.048 INFO:tasks.workunit.client.0.smithi037.stderr: -359> 2024-09-12T17:33:23.751+0000 7f638320e800 10 monclient(hunting): picked mon.noname-a con 0x55f29ce45aa0 addr [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] 2024-09-12T17:33:24.048 INFO:tasks.workunit.client.0.smithi037.stderr: -358> 2024-09-12T17:33:23.751+0000 7f638320e800 10 monclient(hunting): picked mon.noname-c con 0x55f29ce47d70 addr [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] 2024-09-12T17:33:24.048 INFO:tasks.workunit.client.0.smithi037.stderr: -357> 2024-09-12T17:33:23.751+0000 7f638320e800 10 monclient(hunting): picked mon.noname-b con 0x55f29ce44270 addr [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] 2024-09-12T17:33:24.048 INFO:tasks.workunit.client.0.smithi037.stderr: -356> 2024-09-12T17:33:23.751+0000 7f638320e800 10 monclient(hunting): start opening mon connection 2024-09-12T17:33:24.048 INFO:tasks.workunit.client.0.smithi037.stderr: -355> 2024-09-12T17:33:23.751+0000 7f638320e800 10 monclient(hunting): start opening mon connection 2024-09-12T17:33:24.048 INFO:tasks.workunit.client.0.smithi037.stderr: -354> 2024-09-12T17:33:23.751+0000 7f638320e800 10 monclient(hunting): start opening mon connection 2024-09-12T17:33:24.048 INFO:tasks.workunit.client.0.smithi037.stderr: -353> 2024-09-12T17:33:23.751+0000 7f638320e800 10 monclient(hunting): _renew_subs 2024-09-12T17:33:24.048 INFO:tasks.workunit.client.0.smithi037.stderr: -352> 2024-09-12T17:33:23.751+0000 7f638320e800 10 monclient(hunting): authenticate will time out at 2191.348653s 2024-09-12T17:33:24.048 INFO:tasks.workunit.client.0.smithi037.stderr: -351> 2024-09-12T17:33:23.751+0000 7f637e96b640 10 monclient(hunting): get_auth_request con 0x55f29ce45aa0 auth_method 0 2024-09-12T17:33:24.049 INFO:tasks.workunit.client.0.smithi037.stderr: -350> 2024-09-12T17:33:23.751+0000 7f637e96b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:33:24.049 INFO:tasks.workunit.client.0.smithi037.stderr: -349> 2024-09-12T17:33:23.751+0000 7f637e96b640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:33:24.049 INFO:tasks.workunit.client.0.smithi037.stderr: -348> 2024-09-12T17:33:23.751+0000 7f637e96b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:33:24.049 INFO:tasks.workunit.client.0.smithi037.stderr: -347> 2024-09-12T17:33:23.751+0000 7f637e16a640 10 monclient(hunting): get_auth_request con 0x55f29ce47d70 auth_method 0 2024-09-12T17:33:24.049 INFO:tasks.workunit.client.0.smithi037.stderr: -346> 2024-09-12T17:33:23.751+0000 7f637e16a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:33:24.049 INFO:tasks.workunit.client.0.smithi037.stderr: -345> 2024-09-12T17:33:23.751+0000 7f637e16a640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:33:24.049 INFO:tasks.workunit.client.0.smithi037.stderr: -344> 2024-09-12T17:33:23.751+0000 7f637e16a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:33:24.049 INFO:tasks.workunit.client.0.smithi037.stderr: -343> 2024-09-12T17:33:23.751+0000 7f637f16c640 10 monclient(hunting): get_auth_request con 0x55f29ce44270 auth_method 0 2024-09-12T17:33:24.049 INFO:tasks.workunit.client.0.smithi037.stderr: -342> 2024-09-12T17:33:23.751+0000 7f637f16c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:33:24.049 INFO:tasks.workunit.client.0.smithi037.stderr: -341> 2024-09-12T17:33:23.751+0000 7f637f16c640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:33:24.049 INFO:tasks.workunit.client.0.smithi037.stderr: -340> 2024-09-12T17:33:23.751+0000 7f637f16c640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:33:24.049 INFO:tasks.workunit.client.0.smithi037.stderr: -339> 2024-09-12T17:33:23.751+0000 7f637e96b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:33:24.049 INFO:tasks.workunit.client.0.smithi037.stderr: -338> 2024-09-12T17:33:23.751+0000 7f637e96b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:33:24.050 INFO:tasks.workunit.client.0.smithi037.stderr: -337> 2024-09-12T17:33:23.751+0000 7f637e96b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:33:24.050 INFO:tasks.workunit.client.0.smithi037.stderr: -336> 2024-09-12T17:33:23.751+0000 7f637e16a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:33:24.050 INFO:tasks.workunit.client.0.smithi037.stderr: -335> 2024-09-12T17:33:23.751+0000 7f637e16a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:33:24.050 INFO:tasks.workunit.client.0.smithi037.stderr: -334> 2024-09-12T17:33:23.751+0000 7f637e16a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:33:24.050 INFO:tasks.workunit.client.0.smithi037.stderr: -333> 2024-09-12T17:33:23.751+0000 7f637f16c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:33:24.050 INFO:tasks.workunit.client.0.smithi037.stderr: -332> 2024-09-12T17:33:23.751+0000 7f637f16c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:33:24.050 INFO:tasks.workunit.client.0.smithi037.stderr: -331> 2024-09-12T17:33:23.751+0000 7f637f16c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:33:24.050 INFO:tasks.workunit.client.0.smithi037.stderr: -330> 2024-09-12T17:33:23.752+0000 7f637e16a640 10 monclient(hunting): handle_auth_done global_id 6503 payload 824 2024-09-12T17:33:24.050 INFO:tasks.workunit.client.0.smithi037.stderr: -329> 2024-09-12T17:33:23.752+0000 7f637e16a640 10 monclient: _finish_hunting 0 2024-09-12T17:33:24.050 INFO:tasks.workunit.client.0.smithi037.stderr: -328> 2024-09-12T17:33:23.752+0000 7f637e16a640 1 monclient: found mon.noname-c 2024-09-12T17:33:24.050 INFO:tasks.workunit.client.0.smithi037.stderr: -327> 2024-09-12T17:33:23.752+0000 7f637e16a640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.37:3301/0 2024-09-12T17:33:24.050 INFO:tasks.workunit.client.0.smithi037.stderr: -326> 2024-09-12T17:33:23.752+0000 7f6268e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:33:24.050 INFO:tasks.workunit.client.0.smithi037.stderr: -325> 2024-09-12T17:33:23.752+0000 7f6268e01640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:33:24.051 INFO:tasks.workunit.client.0.smithi037.stderr: -324> 2024-09-12T17:33:23.752+0000 7f6268e01640 10 monclient: dump: 2024-09-12T17:33:24.051 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:33:24.051 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:33:24.051 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:33:24.051 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:33:24.051 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:33:24.051 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:33:24.051 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:33:24.051 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:33:24.051 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:33:24.051 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:33:24.051 INFO:tasks.workunit.client.0.smithi037.stderr: -323> 2024-09-12T17:33:23.752+0000 7f6268e01640 10 monclient: _finish_auth 0 2024-09-12T17:33:24.051 INFO:tasks.workunit.client.0.smithi037.stderr: -322> 2024-09-12T17:33:23.752+0000 7f6268e01640 10 monclient: _check_auth_tickets 2024-09-12T17:33:24.051 INFO:tasks.workunit.client.0.smithi037.stderr: -321> 2024-09-12T17:33:23.752+0000 7f6268e01640 10 monclient: handle_config config(0 keys) 2024-09-12T17:33:24.052 INFO:tasks.workunit.client.0.smithi037.stderr: -320> 2024-09-12T17:33:23.752+0000 7f6268e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:33:24.052 INFO:tasks.workunit.client.0.smithi037.stderr: -319> 2024-09-12T17:33:23.752+0000 7f6268e01640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:33:24.052 INFO:tasks.workunit.client.0.smithi037.stderr: -318> 2024-09-12T17:33:23.752+0000 7f6268e01640 10 monclient: dump: 2024-09-12T17:33:24.052 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:33:24.052 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:33:24.052 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:33:24.052 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:33:24.052 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:33:24.052 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:33:24.052 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:33:24.052 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:33:24.053 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:33:24.053 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:33:24.053 INFO:tasks.workunit.client.0.smithi037.stderr: -317> 2024-09-12T17:33:23.752+0000 7f638320e800 5 monclient: authenticate success, global_id 6503 2024-09-12T17:33:24.053 INFO:tasks.workunit.client.0.smithi037.stderr: -316> 2024-09-12T17:33:23.752+0000 7f638320e800 10 monclient: _renew_subs 2024-09-12T17:33:24.053 INFO:tasks.workunit.client.0.smithi037.stderr: -315> 2024-09-12T17:33:23.752+0000 7f638320e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.37:3301/0 2024-09-12T17:33:24.053 INFO:tasks.workunit.client.0.smithi037.stderr: -314> 2024-09-12T17:33:23.752+0000 7f637f96d640 4 set_mon_vals no callback set 2024-09-12T17:33:24.053 INFO:tasks.workunit.client.0.smithi037.stderr: -313> 2024-09-12T17:33:23.752+0000 7f638320e800 10 monclient: _renew_subs 2024-09-12T17:33:24.053 INFO:tasks.workunit.client.0.smithi037.stderr: -312> 2024-09-12T17:33:23.752+0000 7f638320e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.37:3301/0 2024-09-12T17:33:24.053 INFO:tasks.workunit.client.0.smithi037.stderr: -311> 2024-09-12T17:33:23.754+0000 7f6268e01640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:33:24.053 INFO:tasks.workunit.client.0.smithi037.stderr: -310> 2024-09-12T17:33:23.754+0000 7f6268e01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.40:6816/3916250676,v1:172.21.15.40:6817/3916250676] 2024-09-12T17:33:24.053 INFO:tasks.workunit.client.0.smithi037.stderr: -309> 2024-09-12T17:33:23.754+0000 7f6268e01640 4 mgrc reconnect Starting new session with [v2:172.21.15.40:6816/3916250676,v1:172.21.15.40:6817/3916250676] 2024-09-12T17:33:24.053 INFO:tasks.workunit.client.0.smithi037.stderr: -308> 2024-09-12T17:33:23.754+0000 7f637e96b640 10 monclient: get_auth_request con 0x7f6258076380 auth_method 0 2024-09-12T17:33:24.053 INFO:tasks.workunit.client.0.smithi037.stderr: -307> 2024-09-12T17:33:23.754+0000 7f638320e800 10 monclient: get_monmap_and_config 2024-09-12T17:33:24.053 INFO:tasks.workunit.client.0.smithi037.stderr: -306> 2024-09-12T17:33:23.754+0000 7f638320e800 10 monclient: build_initial_monmap 2024-09-12T17:33:24.054 INFO:tasks.workunit.client.0.smithi037.stderr: -305> 2024-09-12T17:33:23.754+0000 7f638320e800 1 build_initial for_mkfs: 0 2024-09-12T17:33:24.054 INFO:tasks.workunit.client.0.smithi037.stderr: -304> 2024-09-12T17:33:23.754+0000 7f638320e800 10 monclient: monmap: 2024-09-12T17:33:24.054 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 0 2024-09-12T17:33:24.054 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:33:24.054 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 0.000000 2024-09-12T17:33:24.054 INFO:tasks.workunit.client.0.smithi037.stderr:created 0.000000 2024-09-12T17:33:24.054 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 0 (unknown) 2024-09-12T17:33:24.054 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:33:24.054 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.noname-a 2024-09-12T17:33:24.054 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.noname-b 2024-09-12T17:33:24.054 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.noname-c 2024-09-12T17:33:24.054 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:33:24.054 INFO:tasks.workunit.client.0.smithi037.stderr: -303> 2024-09-12T17:33:23.754+0000 7f638320e800 5 AuthRegistry(0x55f29ce657e0) adding auth protocol: cephx 2024-09-12T17:33:24.055 INFO:tasks.workunit.client.0.smithi037.stderr: -302> 2024-09-12T17:33:23.754+0000 7f638320e800 5 AuthRegistry(0x55f29ce657e0) adding auth protocol: cephx 2024-09-12T17:33:24.055 INFO:tasks.workunit.client.0.smithi037.stderr: -301> 2024-09-12T17:33:23.754+0000 7f638320e800 5 AuthRegistry(0x55f29ce657e0) adding auth protocol: cephx 2024-09-12T17:33:24.055 INFO:tasks.workunit.client.0.smithi037.stderr: -300> 2024-09-12T17:33:23.754+0000 7f638320e800 5 AuthRegistry(0x55f29ce657e0) adding con mode: secure 2024-09-12T17:33:24.055 INFO:tasks.workunit.client.0.smithi037.stderr: -299> 2024-09-12T17:33:23.754+0000 7f638320e800 5 AuthRegistry(0x55f29ce657e0) adding con mode: crc 2024-09-12T17:33:24.055 INFO:tasks.workunit.client.0.smithi037.stderr: -298> 2024-09-12T17:33:23.754+0000 7f638320e800 5 AuthRegistry(0x55f29ce657e0) adding con mode: secure 2024-09-12T17:33:24.055 INFO:tasks.workunit.client.0.smithi037.stderr: -297> 2024-09-12T17:33:23.754+0000 7f638320e800 5 AuthRegistry(0x55f29ce657e0) adding con mode: crc 2024-09-12T17:33:24.055 INFO:tasks.workunit.client.0.smithi037.stderr: -296> 2024-09-12T17:33:23.754+0000 7f638320e800 5 AuthRegistry(0x55f29ce657e0) adding con mode: secure 2024-09-12T17:33:24.055 INFO:tasks.workunit.client.0.smithi037.stderr: -295> 2024-09-12T17:33:23.754+0000 7f638320e800 5 AuthRegistry(0x55f29ce657e0) adding con mode: crc 2024-09-12T17:33:24.055 INFO:tasks.workunit.client.0.smithi037.stderr: -294> 2024-09-12T17:33:23.754+0000 7f638320e800 5 AuthRegistry(0x55f29ce657e0) adding con mode: crc 2024-09-12T17:33:24.055 INFO:tasks.workunit.client.0.smithi037.stderr: -293> 2024-09-12T17:33:23.754+0000 7f638320e800 5 AuthRegistry(0x55f29ce657e0) adding con mode: secure 2024-09-12T17:33:24.055 INFO:tasks.workunit.client.0.smithi037.stderr: -292> 2024-09-12T17:33:23.754+0000 7f638320e800 5 AuthRegistry(0x55f29ce657e0) adding con mode: crc 2024-09-12T17:33:24.055 INFO:tasks.workunit.client.0.smithi037.stderr: -291> 2024-09-12T17:33:23.754+0000 7f638320e800 5 AuthRegistry(0x55f29ce657e0) adding con mode: secure 2024-09-12T17:33:24.055 INFO:tasks.workunit.client.0.smithi037.stderr: -290> 2024-09-12T17:33:23.754+0000 7f638320e800 5 AuthRegistry(0x55f29ce657e0) adding con mode: crc 2024-09-12T17:33:24.055 INFO:tasks.workunit.client.0.smithi037.stderr: -289> 2024-09-12T17:33:23.754+0000 7f638320e800 5 AuthRegistry(0x55f29ce657e0) adding con mode: secure 2024-09-12T17:33:24.055 INFO:tasks.workunit.client.0.smithi037.stderr: -288> 2024-09-12T17:33:23.755+0000 7f638320e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:33:24.056 INFO:tasks.workunit.client.0.smithi037.stderr: -287> 2024-09-12T17:33:23.755+0000 7f638320e800 10 monclient: init 2024-09-12T17:33:24.056 INFO:tasks.workunit.client.0.smithi037.stderr: -286> 2024-09-12T17:33:23.755+0000 7f638320e800 5 AuthRegistry(0x7ffcdf08f640) adding auth protocol: cephx 2024-09-12T17:33:24.056 INFO:tasks.workunit.client.0.smithi037.stderr: -285> 2024-09-12T17:33:23.755+0000 7f638320e800 5 AuthRegistry(0x7ffcdf08f640) adding auth protocol: cephx 2024-09-12T17:33:24.056 INFO:tasks.workunit.client.0.smithi037.stderr: -284> 2024-09-12T17:33:23.755+0000 7f638320e800 5 AuthRegistry(0x7ffcdf08f640) adding auth protocol: cephx 2024-09-12T17:33:24.056 INFO:tasks.workunit.client.0.smithi037.stderr: -283> 2024-09-12T17:33:23.755+0000 7f638320e800 5 AuthRegistry(0x7ffcdf08f640) adding con mode: secure 2024-09-12T17:33:24.056 INFO:tasks.workunit.client.0.smithi037.stderr: -282> 2024-09-12T17:33:23.755+0000 7f638320e800 5 AuthRegistry(0x7ffcdf08f640) adding con mode: crc 2024-09-12T17:33:24.056 INFO:tasks.workunit.client.0.smithi037.stderr: -281> 2024-09-12T17:33:23.755+0000 7f638320e800 5 AuthRegistry(0x7ffcdf08f640) adding con mode: secure 2024-09-12T17:33:24.056 INFO:tasks.workunit.client.0.smithi037.stderr: -280> 2024-09-12T17:33:23.755+0000 7f638320e800 5 AuthRegistry(0x7ffcdf08f640) adding con mode: crc 2024-09-12T17:33:24.056 INFO:tasks.workunit.client.0.smithi037.stderr: -279> 2024-09-12T17:33:23.755+0000 7f638320e800 5 AuthRegistry(0x7ffcdf08f640) adding con mode: secure 2024-09-12T17:33:24.056 INFO:tasks.workunit.client.0.smithi037.stderr: -278> 2024-09-12T17:33:23.755+0000 7f638320e800 5 AuthRegistry(0x7ffcdf08f640) adding con mode: crc 2024-09-12T17:33:24.056 INFO:tasks.workunit.client.0.smithi037.stderr: -277> 2024-09-12T17:33:23.755+0000 7f638320e800 5 AuthRegistry(0x7ffcdf08f640) adding con mode: crc 2024-09-12T17:33:24.056 INFO:tasks.workunit.client.0.smithi037.stderr: -276> 2024-09-12T17:33:23.755+0000 7f638320e800 5 AuthRegistry(0x7ffcdf08f640) adding con mode: secure 2024-09-12T17:33:24.056 INFO:tasks.workunit.client.0.smithi037.stderr: -275> 2024-09-12T17:33:23.755+0000 7f638320e800 5 AuthRegistry(0x7ffcdf08f640) adding con mode: crc 2024-09-12T17:33:24.057 INFO:tasks.workunit.client.0.smithi037.stderr: -274> 2024-09-12T17:33:23.755+0000 7f638320e800 5 AuthRegistry(0x7ffcdf08f640) adding con mode: secure 2024-09-12T17:33:24.057 INFO:tasks.workunit.client.0.smithi037.stderr: -273> 2024-09-12T17:33:23.755+0000 7f638320e800 5 AuthRegistry(0x7ffcdf08f640) adding con mode: crc 2024-09-12T17:33:24.057 INFO:tasks.workunit.client.0.smithi037.stderr: -272> 2024-09-12T17:33:23.755+0000 7f638320e800 5 AuthRegistry(0x7ffcdf08f640) adding con mode: secure 2024-09-12T17:33:24.057 INFO:tasks.workunit.client.0.smithi037.stderr: -271> 2024-09-12T17:33:23.755+0000 7f638320e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:33:24.057 INFO:tasks.workunit.client.0.smithi037.stderr: -270> 2024-09-12T17:33:23.755+0000 7f638320e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:33:24.057 INFO:tasks.workunit.client.0.smithi037.stderr: -269> 2024-09-12T17:33:23.755+0000 7f638320e800 5 asok(0x55f29cba7730) register_command rotate-key cmddesc rotate-key hook 0x7ffcdf08f788 EEXIST 2024-09-12T17:33:24.057 INFO:tasks.workunit.client.0.smithi037.stderr: -268> 2024-09-12T17:33:23.755+0000 7f638320e800 10 monclient: _reopen_session rank -1 2024-09-12T17:33:24.057 INFO:tasks.workunit.client.0.smithi037.stderr: -267> 2024-09-12T17:33:23.755+0000 7f638320e800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T17:33:24.057 INFO:tasks.workunit.client.0.smithi037.stderr: -266> 2024-09-12T17:33:23.755+0000 7f638320e800 10 monclient(hunting): picked mon.noname-c con 0x55f29ce99d30 addr [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] 2024-09-12T17:33:24.057 INFO:tasks.workunit.client.0.smithi037.stderr: -265> 2024-09-12T17:33:23.755+0000 7f638320e800 10 monclient(hunting): picked mon.noname-b con 0x55f29ce69890 addr [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] 2024-09-12T17:33:24.057 INFO:tasks.workunit.client.0.smithi037.stderr: -264> 2024-09-12T17:33:23.755+0000 7f638320e800 10 monclient(hunting): picked mon.noname-a con 0x55f29ce667c0 addr [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] 2024-09-12T17:33:24.057 INFO:tasks.workunit.client.0.smithi037.stderr: -263> 2024-09-12T17:33:23.755+0000 7f638320e800 10 monclient(hunting): start opening mon connection 2024-09-12T17:33:24.057 INFO:tasks.workunit.client.0.smithi037.stderr: -262> 2024-09-12T17:33:23.755+0000 7f638320e800 10 monclient(hunting): start opening mon connection 2024-09-12T17:33:24.058 INFO:tasks.workunit.client.0.smithi037.stderr: -261> 2024-09-12T17:33:23.755+0000 7f638320e800 10 monclient(hunting): start opening mon connection 2024-09-12T17:33:24.058 INFO:tasks.workunit.client.0.smithi037.stderr: -260> 2024-09-12T17:33:23.755+0000 7f638320e800 10 monclient(hunting): _renew_subs 2024-09-12T17:33:24.058 INFO:tasks.workunit.client.0.smithi037.stderr: -259> 2024-09-12T17:33:23.755+0000 7f638320e800 10 monclient(hunting): authenticate will time out at 2191.352724s 2024-09-12T17:33:24.058 INFO:tasks.workunit.client.0.smithi037.stderr: -258> 2024-09-12T17:33:23.755+0000 7f637e96b640 10 monclient(hunting): get_auth_request con 0x55f29ce99d30 auth_method 0 2024-09-12T17:33:24.058 INFO:tasks.workunit.client.0.smithi037.stderr: -257> 2024-09-12T17:33:23.755+0000 7f637e96b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:33:24.058 INFO:tasks.workunit.client.0.smithi037.stderr: -256> 2024-09-12T17:33:23.755+0000 7f637e96b640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:33:24.058 INFO:tasks.workunit.client.0.smithi037.stderr: -255> 2024-09-12T17:33:23.755+0000 7f637e96b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:33:24.058 INFO:tasks.workunit.client.0.smithi037.stderr: -254> 2024-09-12T17:33:23.755+0000 7f637f16c640 10 monclient(hunting): get_auth_request con 0x55f29ce667c0 auth_method 0 2024-09-12T17:33:24.058 INFO:tasks.workunit.client.0.smithi037.stderr: -253> 2024-09-12T17:33:23.755+0000 7f637f16c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:33:24.058 INFO:tasks.workunit.client.0.smithi037.stderr: -252> 2024-09-12T17:33:23.755+0000 7f637f16c640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:33:24.058 INFO:tasks.workunit.client.0.smithi037.stderr: -251> 2024-09-12T17:33:23.755+0000 7f637f16c640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:33:24.058 INFO:tasks.workunit.client.0.smithi037.stderr: -250> 2024-09-12T17:33:23.755+0000 7f637e16a640 10 monclient(hunting): get_auth_request con 0x55f29ce69890 auth_method 0 2024-09-12T17:33:24.058 INFO:tasks.workunit.client.0.smithi037.stderr: -249> 2024-09-12T17:33:23.755+0000 7f637e16a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:33:24.059 INFO:tasks.workunit.client.0.smithi037.stderr: -248> 2024-09-12T17:33:23.755+0000 7f637e16a640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:33:24.059 INFO:tasks.workunit.client.0.smithi037.stderr: -247> 2024-09-12T17:33:23.755+0000 7f637e16a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:33:24.059 INFO:tasks.workunit.client.0.smithi037.stderr: -246> 2024-09-12T17:33:23.755+0000 7f637e96b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:33:24.059 INFO:tasks.workunit.client.0.smithi037.stderr: -245> 2024-09-12T17:33:23.755+0000 7f637e96b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:33:24.059 INFO:tasks.workunit.client.0.smithi037.stderr: -244> 2024-09-12T17:33:23.755+0000 7f637e96b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:33:24.059 INFO:tasks.workunit.client.0.smithi037.stderr: -243> 2024-09-12T17:33:23.755+0000 7f637f16c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:33:24.059 INFO:tasks.workunit.client.0.smithi037.stderr: -242> 2024-09-12T17:33:23.755+0000 7f637f16c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:33:24.059 INFO:tasks.workunit.client.0.smithi037.stderr: -241> 2024-09-12T17:33:23.755+0000 7f637f16c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:33:24.059 INFO:tasks.workunit.client.0.smithi037.stderr: -240> 2024-09-12T17:33:23.755+0000 7f637e16a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:33:24.059 INFO:tasks.workunit.client.0.smithi037.stderr: -239> 2024-09-12T17:33:23.755+0000 7f637e16a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:33:24.059 INFO:tasks.workunit.client.0.smithi037.stderr: -238> 2024-09-12T17:33:23.755+0000 7f637e16a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:33:24.059 INFO:tasks.workunit.client.0.smithi037.stderr: -237> 2024-09-12T17:33:23.756+0000 7f637e96b640 10 monclient(hunting): handle_auth_done global_id 6506 payload 274 2024-09-12T17:33:24.059 INFO:tasks.workunit.client.0.smithi037.stderr: -236> 2024-09-12T17:33:23.756+0000 7f637e96b640 10 monclient: _finish_hunting 0 2024-09-12T17:33:24.060 INFO:tasks.workunit.client.0.smithi037.stderr: -235> 2024-09-12T17:33:23.756+0000 7f637e96b640 1 monclient: found mon.noname-c 2024-09-12T17:33:24.060 INFO:tasks.workunit.client.0.smithi037.stderr: -234> 2024-09-12T17:33:23.756+0000 7f637e96b640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.37:3301/0 2024-09-12T17:33:24.060 INFO:tasks.workunit.client.0.smithi037.stderr: -233> 2024-09-12T17:33:23.756+0000 7f62627fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:33:24.060 INFO:tasks.workunit.client.0.smithi037.stderr: -232> 2024-09-12T17:33:23.756+0000 7f62627fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:33:24.060 INFO:tasks.workunit.client.0.smithi037.stderr: -231> 2024-09-12T17:33:23.756+0000 7f62627fc640 10 monclient: dump: 2024-09-12T17:33:24.060 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:33:24.060 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:33:24.060 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:33:24.060 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:33:24.060 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:33:24.060 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:33:24.060 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:33:24.060 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:33:24.060 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:33:24.061 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:33:24.061 INFO:tasks.workunit.client.0.smithi037.stderr: -230> 2024-09-12T17:33:23.756+0000 7f62627fc640 10 monclient: _finish_auth 0 2024-09-12T17:33:24.061 INFO:tasks.workunit.client.0.smithi037.stderr: -229> 2024-09-12T17:33:23.756+0000 7f62627fc640 10 monclient: _check_auth_tickets 2024-09-12T17:33:24.061 INFO:tasks.workunit.client.0.smithi037.stderr: -228> 2024-09-12T17:33:23.756+0000 7f62627fc640 10 monclient: handle_config config(0 keys) 2024-09-12T17:33:24.061 INFO:tasks.workunit.client.0.smithi037.stderr: -227> 2024-09-12T17:33:23.756+0000 7f638320e800 5 monclient: authenticate success, global_id 6506 2024-09-12T17:33:24.061 INFO:tasks.workunit.client.0.smithi037.stderr: -226> 2024-09-12T17:33:23.756+0000 7f638320e800 10 monclient: get_monmap_and_config success 2024-09-12T17:33:24.061 INFO:tasks.workunit.client.0.smithi037.stderr: -225> 2024-09-12T17:33:23.756+0000 7f638320e800 4 set_mon_vals no callback set 2024-09-12T17:33:24.061 INFO:tasks.workunit.client.0.smithi037.stderr: -224> 2024-09-12T17:33:23.756+0000 7f62627fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:33:24.061 INFO:tasks.workunit.client.0.smithi037.stderr: -223> 2024-09-12T17:33:23.756+0000 7f62627fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:33:24.061 INFO:tasks.workunit.client.0.smithi037.stderr: -222> 2024-09-12T17:33:23.756+0000 7f62627fc640 10 monclient: dump: 2024-09-12T17:33:24.061 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:33:24.062 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:33:24.062 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:33:24.062 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:33:24.062 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:33:24.062 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:33:24.062 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:33:24.062 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:33:24.062 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:33:24.062 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:33:24.062 INFO:tasks.workunit.client.0.smithi037.stderr: -221> 2024-09-12T17:33:23.756+0000 7f638320e800 10 monclient: shutdown 2024-09-12T17:33:24.062 INFO:tasks.workunit.client.0.smithi037.stderr: -220> 2024-09-12T17:33:23.756+0000 7f638320e800 10 monclient: build_initial_monmap 2024-09-12T17:33:24.063 INFO:tasks.workunit.client.0.smithi037.stderr: -219> 2024-09-12T17:33:23.756+0000 7f638320e800 1 build_initial for_mkfs: 0 2024-09-12T17:33:24.063 INFO:tasks.workunit.client.0.smithi037.stderr: -218> 2024-09-12T17:33:23.756+0000 7f638320e800 10 monclient: monmap: 2024-09-12T17:33:24.063 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 0 2024-09-12T17:33:24.063 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:33:24.063 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 0.000000 2024-09-12T17:33:24.063 INFO:tasks.workunit.client.0.smithi037.stderr:created 0.000000 2024-09-12T17:33:24.063 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 0 (unknown) 2024-09-12T17:33:24.063 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:33:24.063 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.noname-a 2024-09-12T17:33:24.063 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.noname-b 2024-09-12T17:33:24.063 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.noname-c 2024-09-12T17:33:24.063 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:33:24.063 INFO:tasks.workunit.client.0.smithi037.stderr: -217> 2024-09-12T17:33:23.756+0000 7f638320e800 5 AuthRegistry(0x55f29ce6a8b0) adding auth protocol: cephx 2024-09-12T17:33:24.064 INFO:tasks.workunit.client.0.smithi037.stderr: -216> 2024-09-12T17:33:23.756+0000 7f638320e800 5 AuthRegistry(0x55f29ce6a8b0) adding auth protocol: cephx 2024-09-12T17:33:24.064 INFO:tasks.workunit.client.0.smithi037.stderr: -215> 2024-09-12T17:33:23.756+0000 7f638320e800 5 AuthRegistry(0x55f29ce6a8b0) adding auth protocol: cephx 2024-09-12T17:33:24.064 INFO:tasks.workunit.client.0.smithi037.stderr: -214> 2024-09-12T17:33:23.756+0000 7f638320e800 5 AuthRegistry(0x55f29ce6a8b0) adding con mode: secure 2024-09-12T17:33:24.064 INFO:tasks.workunit.client.0.smithi037.stderr: -213> 2024-09-12T17:33:23.756+0000 7f638320e800 5 AuthRegistry(0x55f29ce6a8b0) adding con mode: crc 2024-09-12T17:33:24.064 INFO:tasks.workunit.client.0.smithi037.stderr: -212> 2024-09-12T17:33:23.756+0000 7f638320e800 5 AuthRegistry(0x55f29ce6a8b0) adding con mode: secure 2024-09-12T17:33:24.064 INFO:tasks.workunit.client.0.smithi037.stderr: -211> 2024-09-12T17:33:23.756+0000 7f638320e800 5 AuthRegistry(0x55f29ce6a8b0) adding con mode: crc 2024-09-12T17:33:24.065 INFO:tasks.workunit.client.0.smithi037.stderr: -210> 2024-09-12T17:33:23.756+0000 7f638320e800 5 AuthRegistry(0x55f29ce6a8b0) adding con mode: secure 2024-09-12T17:33:24.065 INFO:tasks.workunit.client.0.smithi037.stderr: -209> 2024-09-12T17:33:23.756+0000 7f638320e800 5 AuthRegistry(0x55f29ce6a8b0) adding con mode: crc 2024-09-12T17:33:24.065 INFO:tasks.workunit.client.0.smithi037.stderr: -208> 2024-09-12T17:33:23.757+0000 7f638320e800 5 AuthRegistry(0x55f29ce6a8b0) adding con mode: crc 2024-09-12T17:33:24.065 INFO:tasks.workunit.client.0.smithi037.stderr: -207> 2024-09-12T17:33:23.757+0000 7f638320e800 5 AuthRegistry(0x55f29ce6a8b0) adding con mode: secure 2024-09-12T17:33:24.065 INFO:tasks.workunit.client.0.smithi037.stderr: -206> 2024-09-12T17:33:23.757+0000 7f638320e800 5 AuthRegistry(0x55f29ce6a8b0) adding con mode: crc 2024-09-12T17:33:24.065 INFO:tasks.workunit.client.0.smithi037.stderr: -205> 2024-09-12T17:33:23.757+0000 7f638320e800 5 AuthRegistry(0x55f29ce6a8b0) adding con mode: secure 2024-09-12T17:33:24.065 INFO:tasks.workunit.client.0.smithi037.stderr: -204> 2024-09-12T17:33:23.757+0000 7f638320e800 5 AuthRegistry(0x55f29ce6a8b0) adding con mode: crc 2024-09-12T17:33:24.065 INFO:tasks.workunit.client.0.smithi037.stderr: -203> 2024-09-12T17:33:23.757+0000 7f638320e800 5 AuthRegistry(0x55f29ce6a8b0) adding con mode: secure 2024-09-12T17:33:24.065 INFO:tasks.workunit.client.0.smithi037.stderr: -202> 2024-09-12T17:33:23.757+0000 7f638320e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:33:24.065 INFO:tasks.workunit.client.0.smithi037.stderr: -201> 2024-09-12T17:33:23.757+0000 7f638320e800 1 librados: starting msgr at 2024-09-12T17:33:24.065 INFO:tasks.workunit.client.0.smithi037.stderr: -200> 2024-09-12T17:33:23.757+0000 7f638320e800 1 librados: starting objecter 2024-09-12T17:33:24.065 INFO:tasks.workunit.client.0.smithi037.stderr: -199> 2024-09-12T17:33:23.757+0000 7f638320e800 5 asok(0x55f29cba7730) register_command objecter_requests cmddesc objecter_requests hook 0x55f29ce8c970 EEXIST 2024-09-12T17:33:24.065 INFO:tasks.workunit.client.0.smithi037.stderr: -198> 2024-09-12T17:33:23.757+0000 7f638320e800 1 librados: setting wanted keys 2024-09-12T17:33:24.065 INFO:tasks.workunit.client.0.smithi037.stderr: -197> 2024-09-12T17:33:23.757+0000 7f638320e800 1 librados: calling monclient init 2024-09-12T17:33:24.066 INFO:tasks.workunit.client.0.smithi037.stderr: -196> 2024-09-12T17:33:23.757+0000 7f638320e800 10 monclient: init 2024-09-12T17:33:24.066 INFO:tasks.workunit.client.0.smithi037.stderr: -195> 2024-09-12T17:33:23.757+0000 7f638320e800 5 AuthRegistry(0x55f29ce5d850) adding auth protocol: cephx 2024-09-12T17:33:24.066 INFO:tasks.workunit.client.0.smithi037.stderr: -194> 2024-09-12T17:33:23.757+0000 7f638320e800 5 AuthRegistry(0x55f29ce5d850) adding auth protocol: cephx 2024-09-12T17:33:24.066 INFO:tasks.workunit.client.0.smithi037.stderr: -193> 2024-09-12T17:33:23.757+0000 7f638320e800 5 AuthRegistry(0x55f29ce5d850) adding auth protocol: cephx 2024-09-12T17:33:24.066 INFO:tasks.workunit.client.0.smithi037.stderr: -192> 2024-09-12T17:33:23.757+0000 7f638320e800 5 AuthRegistry(0x55f29ce5d850) adding con mode: secure 2024-09-12T17:33:24.066 INFO:tasks.workunit.client.0.smithi037.stderr: -191> 2024-09-12T17:33:23.757+0000 7f638320e800 5 AuthRegistry(0x55f29ce5d850) adding con mode: crc 2024-09-12T17:33:24.066 INFO:tasks.workunit.client.0.smithi037.stderr: -190> 2024-09-12T17:33:23.757+0000 7f638320e800 5 AuthRegistry(0x55f29ce5d850) adding con mode: secure 2024-09-12T17:33:24.066 INFO:tasks.workunit.client.0.smithi037.stderr: -189> 2024-09-12T17:33:23.757+0000 7f638320e800 5 AuthRegistry(0x55f29ce5d850) adding con mode: crc 2024-09-12T17:33:24.066 INFO:tasks.workunit.client.0.smithi037.stderr: -188> 2024-09-12T17:33:23.757+0000 7f638320e800 5 AuthRegistry(0x55f29ce5d850) adding con mode: secure 2024-09-12T17:33:24.066 INFO:tasks.workunit.client.0.smithi037.stderr: -187> 2024-09-12T17:33:23.757+0000 7f638320e800 5 AuthRegistry(0x55f29ce5d850) adding con mode: crc 2024-09-12T17:33:24.066 INFO:tasks.workunit.client.0.smithi037.stderr: -186> 2024-09-12T17:33:23.757+0000 7f638320e800 5 AuthRegistry(0x55f29ce5d850) adding con mode: crc 2024-09-12T17:33:24.067 INFO:tasks.workunit.client.0.smithi037.stderr: -185> 2024-09-12T17:33:23.757+0000 7f638320e800 5 AuthRegistry(0x55f29ce5d850) adding con mode: secure 2024-09-12T17:33:24.067 INFO:tasks.workunit.client.0.smithi037.stderr: -184> 2024-09-12T17:33:23.757+0000 7f638320e800 5 AuthRegistry(0x55f29ce5d850) adding con mode: crc 2024-09-12T17:33:24.067 INFO:tasks.workunit.client.0.smithi037.stderr: -183> 2024-09-12T17:33:23.757+0000 7f638320e800 5 AuthRegistry(0x55f29ce5d850) adding con mode: secure 2024-09-12T17:33:24.067 INFO:tasks.workunit.client.0.smithi037.stderr: -182> 2024-09-12T17:33:23.757+0000 7f638320e800 5 AuthRegistry(0x55f29ce5d850) adding con mode: crc 2024-09-12T17:33:24.067 INFO:tasks.workunit.client.0.smithi037.stderr: -181> 2024-09-12T17:33:23.757+0000 7f638320e800 5 AuthRegistry(0x55f29ce5d850) adding con mode: secure 2024-09-12T17:33:24.067 INFO:tasks.workunit.client.0.smithi037.stderr: -180> 2024-09-12T17:33:23.757+0000 7f638320e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:33:24.067 INFO:tasks.workunit.client.0.smithi037.stderr: -179> 2024-09-12T17:33:23.757+0000 7f638320e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:33:24.067 INFO:tasks.workunit.client.0.smithi037.stderr: -178> 2024-09-12T17:33:23.757+0000 7f638320e800 5 asok(0x55f29cba7730) register_command rotate-key cmddesc rotate-key hook 0x55f29ce5d998 EEXIST 2024-09-12T17:33:24.067 INFO:tasks.workunit.client.0.smithi037.stderr: -177> 2024-09-12T17:33:23.757+0000 7f638320e800 10 monclient: _reopen_session rank -1 2024-09-12T17:33:24.067 INFO:tasks.workunit.client.0.smithi037.stderr: -176> 2024-09-12T17:33:23.757+0000 7f638320e800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T17:33:24.067 INFO:tasks.workunit.client.0.smithi037.stderr: -175> 2024-09-12T17:33:23.757+0000 7f638320e800 10 monclient(hunting): picked mon.noname-b con 0x55f29ce667c0 addr [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] 2024-09-12T17:33:24.067 INFO:tasks.workunit.client.0.smithi037.stderr: -174> 2024-09-12T17:33:23.757+0000 7f638320e800 10 monclient(hunting): picked mon.noname-a con 0x55f29ce69890 addr [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] 2024-09-12T17:33:24.067 INFO:tasks.workunit.client.0.smithi037.stderr: -173> 2024-09-12T17:33:23.757+0000 7f638320e800 10 monclient(hunting): picked mon.noname-c con 0x55f29ce99d30 addr [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] 2024-09-12T17:33:24.068 INFO:tasks.workunit.client.0.smithi037.stderr: -172> 2024-09-12T17:33:23.757+0000 7f638320e800 10 monclient(hunting): start opening mon connection 2024-09-12T17:33:24.068 INFO:tasks.workunit.client.0.smithi037.stderr: -171> 2024-09-12T17:33:23.757+0000 7f638320e800 10 monclient(hunting): start opening mon connection 2024-09-12T17:33:24.068 INFO:tasks.workunit.client.0.smithi037.stderr: -170> 2024-09-12T17:33:23.757+0000 7f638320e800 10 monclient(hunting): start opening mon connection 2024-09-12T17:33:24.068 INFO:tasks.workunit.client.0.smithi037.stderr: -169> 2024-09-12T17:33:23.757+0000 7f638320e800 10 monclient(hunting): _renew_subs 2024-09-12T17:33:24.068 INFO:tasks.workunit.client.0.smithi037.stderr: -168> 2024-09-12T17:33:23.757+0000 7f638320e800 10 monclient(hunting): authenticate will time out at 2191.354958s 2024-09-12T17:33:24.068 INFO:tasks.workunit.client.0.smithi037.stderr: -167> 2024-09-12T17:33:23.758+0000 7f637e16a640 10 monclient(hunting): get_auth_request con 0x55f29ce69890 auth_method 0 2024-09-12T17:33:24.068 INFO:tasks.workunit.client.0.smithi037.stderr: -166> 2024-09-12T17:33:23.758+0000 7f637e16a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:33:24.068 INFO:tasks.workunit.client.0.smithi037.stderr: -165> 2024-09-12T17:33:23.758+0000 7f637e16a640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:33:24.068 INFO:tasks.workunit.client.0.smithi037.stderr: -164> 2024-09-12T17:33:23.758+0000 7f637e16a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:33:24.068 INFO:tasks.workunit.client.0.smithi037.stderr: -163> 2024-09-12T17:33:23.758+0000 7f637f16c640 10 monclient(hunting): get_auth_request con 0x55f29ce99d30 auth_method 0 2024-09-12T17:33:24.069 INFO:tasks.workunit.client.0.smithi037.stderr: -162> 2024-09-12T17:33:23.758+0000 7f637f16c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:33:24.069 INFO:tasks.workunit.client.0.smithi037.stderr: -161> 2024-09-12T17:33:23.758+0000 7f637f16c640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:33:24.069 INFO:tasks.workunit.client.0.smithi037.stderr: -160> 2024-09-12T17:33:23.758+0000 7f637f16c640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:33:24.069 INFO:tasks.workunit.client.0.smithi037.stderr: -159> 2024-09-12T17:33:23.758+0000 7f637e96b640 10 monclient(hunting): get_auth_request con 0x55f29ce667c0 auth_method 0 2024-09-12T17:33:24.069 INFO:tasks.workunit.client.0.smithi037.stderr: -158> 2024-09-12T17:33:23.758+0000 7f637e96b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:33:24.069 INFO:tasks.workunit.client.0.smithi037.stderr: -157> 2024-09-12T17:33:23.758+0000 7f637e96b640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:33:24.069 INFO:tasks.workunit.client.0.smithi037.stderr: -156> 2024-09-12T17:33:23.758+0000 7f637e96b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:33:24.069 INFO:tasks.workunit.client.0.smithi037.stderr: -155> 2024-09-12T17:33:23.758+0000 7f637e16a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:33:24.069 INFO:tasks.workunit.client.0.smithi037.stderr: -154> 2024-09-12T17:33:23.758+0000 7f637e16a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:33:24.069 INFO:tasks.workunit.client.0.smithi037.stderr: -153> 2024-09-12T17:33:23.758+0000 7f637e16a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:33:24.069 INFO:tasks.workunit.client.0.smithi037.stderr: -152> 2024-09-12T17:33:23.758+0000 7f637f16c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:33:24.070 INFO:tasks.workunit.client.0.smithi037.stderr: -151> 2024-09-12T17:33:23.758+0000 7f637f16c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:33:24.070 INFO:tasks.workunit.client.0.smithi037.stderr: -150> 2024-09-12T17:33:23.758+0000 7f637f16c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:33:24.070 INFO:tasks.workunit.client.0.smithi037.stderr: -149> 2024-09-12T17:33:23.758+0000 7f637e96b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:33:24.070 INFO:tasks.workunit.client.0.smithi037.stderr: -148> 2024-09-12T17:33:23.758+0000 7f637e96b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:33:24.070 INFO:tasks.workunit.client.0.smithi037.stderr: -147> 2024-09-12T17:33:23.758+0000 7f637e96b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:33:24.070 INFO:tasks.workunit.client.0.smithi037.stderr: -146> 2024-09-12T17:33:23.758+0000 7f637e16a640 10 monclient(hunting): handle_auth_done global_id 6924 payload 824 2024-09-12T17:33:24.070 INFO:tasks.workunit.client.0.smithi037.stderr: -145> 2024-09-12T17:33:23.758+0000 7f637e16a640 10 monclient: _finish_hunting 0 2024-09-12T17:33:24.070 INFO:tasks.workunit.client.0.smithi037.stderr: -144> 2024-09-12T17:33:23.758+0000 7f637e16a640 1 monclient: found mon.noname-a 2024-09-12T17:33:24.070 INFO:tasks.workunit.client.0.smithi037.stderr: -143> 2024-09-12T17:33:23.758+0000 7f637e16a640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.37:3300/0 2024-09-12T17:33:24.070 INFO:tasks.workunit.client.0.smithi037.stderr: -142> 2024-09-12T17:33:23.758+0000 7f6260ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:33:24.071 INFO:tasks.workunit.client.0.smithi037.stderr: -141> 2024-09-12T17:33:23.758+0000 7f6260ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:33:24.071 INFO:tasks.workunit.client.0.smithi037.stderr: -140> 2024-09-12T17:33:23.758+0000 7f6260ff9640 10 monclient: dump: 2024-09-12T17:33:24.071 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:33:24.071 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:33:24.071 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:33:24.071 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:33:24.071 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:33:24.071 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:33:24.071 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:33:24.071 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:33:24.071 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:33:24.072 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:33:24.072 INFO:tasks.workunit.client.0.smithi037.stderr: -139> 2024-09-12T17:33:23.758+0000 7f6260ff9640 10 monclient: _finish_auth 0 2024-09-12T17:33:24.072 INFO:tasks.workunit.client.0.smithi037.stderr: -138> 2024-09-12T17:33:23.758+0000 7f6260ff9640 10 monclient: _check_auth_tickets 2024-09-12T17:33:24.072 INFO:tasks.workunit.client.0.smithi037.stderr: -137> 2024-09-12T17:33:23.758+0000 7f6260ff9640 10 monclient: handle_config config(0 keys) 2024-09-12T17:33:24.072 INFO:tasks.workunit.client.0.smithi037.stderr: -136> 2024-09-12T17:33:23.758+0000 7f6260ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:33:24.072 INFO:tasks.workunit.client.0.smithi037.stderr: -135> 2024-09-12T17:33:23.758+0000 7f6260ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:33:24.072 INFO:tasks.workunit.client.0.smithi037.stderr: -134> 2024-09-12T17:33:23.758+0000 7f6260ff9640 10 monclient: dump: 2024-09-12T17:33:24.072 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:33:24.072 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:33:24.072 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:33:24.072 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:33:24.072 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:33:24.072 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:33:24.073 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:33:24.073 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:33:24.073 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:33:24.073 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:33:24.073 INFO:tasks.workunit.client.0.smithi037.stderr: -133> 2024-09-12T17:33:23.758+0000 7f638320e800 5 monclient: authenticate success, global_id 6924 2024-09-12T17:33:24.073 INFO:tasks.workunit.client.0.smithi037.stderr: -132> 2024-09-12T17:33:23.758+0000 7f62627fc640 4 set_mon_vals no callback set 2024-09-12T17:33:24.073 INFO:tasks.workunit.client.0.smithi037.stderr: -131> 2024-09-12T17:33:23.758+0000 7f638320e800 10 monclient: _renew_subs 2024-09-12T17:33:24.073 INFO:tasks.workunit.client.0.smithi037.stderr: -130> 2024-09-12T17:33:23.758+0000 7f638320e800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.37:3300/0 2024-09-12T17:33:24.073 INFO:tasks.workunit.client.0.smithi037.stderr: -129> 2024-09-12T17:33:23.758+0000 7f638320e800 10 monclient: _renew_subs 2024-09-12T17:33:24.073 INFO:tasks.workunit.client.0.smithi037.stderr: -128> 2024-09-12T17:33:23.758+0000 7f638320e800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.37:3300/0 2024-09-12T17:33:24.073 INFO:tasks.workunit.client.0.smithi037.stderr: -127> 2024-09-12T17:33:23.758+0000 7f638320e800 1 librados: init done 2024-09-12T17:33:24.073 INFO:tasks.workunit.client.0.smithi037.stderr: -126> 2024-09-12T17:33:23.758+0000 7f638320e800 5 asok(0x55f29cba7730) register_command cr dump hook 0x55f29ce89f78 2024-09-12T17:33:24.073 INFO:tasks.workunit.client.0.smithi037.stderr: -125> 2024-09-12T17:33:23.760+0000 7f638320e800 20 rados->read ofs=0 len=0 2024-09-12T17:33:24.073 INFO:tasks.workunit.client.0.smithi037.stderr: -124> 2024-09-12T17:33:23.760+0000 7f6260ff9640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:33:24.074 INFO:tasks.workunit.client.0.smithi037.stderr: -123> 2024-09-12T17:33:23.760+0000 7f6260ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.40:6816/3916250676,v1:172.21.15.40:6817/3916250676] 2024-09-12T17:33:24.074 INFO:tasks.workunit.client.0.smithi037.stderr: -122> 2024-09-12T17:33:23.760+0000 7f6260ff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.40:6816/3916250676,v1:172.21.15.40:6817/3916250676] 2024-09-12T17:33:24.074 INFO:tasks.workunit.client.0.smithi037.stderr: -121> 2024-09-12T17:33:23.760+0000 7f637e96b640 10 monclient: get_auth_request con 0x7f6248076470 auth_method 0 2024-09-12T17:33:24.074 INFO:tasks.workunit.client.0.smithi037.stderr: -120> 2024-09-12T17:33:23.761+0000 7f637f16c640 10 monclient: get_auth_request con 0x55f29ceb41e0 auth_method 0 2024-09-12T17:33:24.074 INFO:tasks.workunit.client.0.smithi037.stderr: -119> 2024-09-12T17:33:23.761+0000 7f638320e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:24.074 INFO:tasks.workunit.client.0.smithi037.stderr: -118> 2024-09-12T17:33:23.761+0000 7f638320e800 20 realm 2024-09-12T17:33:24.074 INFO:tasks.workunit.client.0.smithi037.stderr: -117> 2024-09-12T17:33:23.761+0000 7f638320e800 20 rados->read ofs=0 len=0 2024-09-12T17:33:24.074 INFO:tasks.workunit.client.0.smithi037.stderr: -116> 2024-09-12T17:33:23.761+0000 7f638320e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:24.074 INFO:tasks.workunit.client.0.smithi037.stderr: -115> 2024-09-12T17:33:23.761+0000 7f638320e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:33:24.074 INFO:tasks.workunit.client.0.smithi037.stderr: -114> 2024-09-12T17:33:23.761+0000 7f638320e800 20 rados->read ofs=0 len=0 2024-09-12T17:33:24.074 INFO:tasks.workunit.client.0.smithi037.stderr: -113> 2024-09-12T17:33:23.761+0000 7f638320e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:24.074 INFO:tasks.workunit.client.0.smithi037.stderr: -112> 2024-09-12T17:33:23.761+0000 7f638320e800 20 rados->read ofs=0 len=0 2024-09-12T17:33:24.074 INFO:tasks.workunit.client.0.smithi037.stderr: -111> 2024-09-12T17:33:23.762+0000 7f637e96b640 10 monclient: get_auth_request con 0x55f29ceb85a0 auth_method 0 2024-09-12T17:33:24.075 INFO:tasks.workunit.client.0.smithi037.stderr: -110> 2024-09-12T17:33:23.762+0000 7f638320e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:33:24.075 INFO:tasks.workunit.client.0.smithi037.stderr: -109> 2024-09-12T17:33:23.762+0000 7f638320e800 20 rados->read ofs=0 len=0 2024-09-12T17:33:24.075 INFO:tasks.workunit.client.0.smithi037.stderr: -108> 2024-09-12T17:33:23.762+0000 7f638320e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:33:24.075 INFO:tasks.workunit.client.0.smithi037.stderr: -107> 2024-09-12T17:33:23.762+0000 7f638320e800 20 searching for the correct realm 2024-09-12T17:33:24.075 INFO:tasks.workunit.client.0.smithi037.stderr: -106> 2024-09-12T17:33:23.763+0000 7f637e16a640 10 monclient: get_auth_request con 0x55f29cebd6b0 auth_method 0 2024-09-12T17:33:24.075 INFO:tasks.workunit.client.0.smithi037.stderr: -105> 2024-09-12T17:33:23.763+0000 7f637f16c640 10 monclient: get_auth_request con 0x7f6374003500 auth_method 0 2024-09-12T17:33:24.075 INFO:tasks.workunit.client.0.smithi037.stderr: -104> 2024-09-12T17:33:23.764+0000 7f637e96b640 10 monclient: get_auth_request con 0x7f6378071040 auth_method 0 2024-09-12T17:33:24.075 INFO:tasks.workunit.client.0.smithi037.stderr: -103> 2024-09-12T17:33:23.765+0000 7f637e16a640 10 monclient: get_auth_request con 0x7f637001f060 auth_method 0 2024-09-12T17:33:24.075 INFO:tasks.workunit.client.0.smithi037.stderr: -102> 2024-09-12T17:33:23.766+0000 7f637e16a640 0 -- 172.21.15.37:0/450165220 >> [v2:172.21.15.40:6800/2441293461,v1:172.21.15.40:6801/2441293461] conn(0x7f637001f060 msgr2=0x7f63700961d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:33:24.075 INFO:tasks.workunit.client.0.smithi037.stderr: -101> 2024-09-12T17:33:23.766+0000 7f6260ff9640 1 client.6924.objecter ms_handle_reset 0x7f637001f060 session 0x7f6370011040 osd.4 2024-09-12T17:33:24.075 INFO:tasks.workunit.client.0.smithi037.stderr: -100> 2024-09-12T17:33:23.766+0000 7f6260ff9640 10 monclient: _renew_subs 2024-09-12T17:33:24.076 INFO:tasks.workunit.client.0.smithi037.stderr: -99> 2024-09-12T17:33:23.766+0000 7f6260ff9640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.37:3300/0 2024-09-12T17:33:24.076 INFO:tasks.workunit.client.0.smithi037.stderr: -98> 2024-09-12T17:33:23.766+0000 7f637e16a640 10 monclient: get_auth_request con 0x7f6248086b10 auth_method 0 2024-09-12T17:33:24.076 INFO:tasks.workunit.client.0.smithi037.stderr: -97> 2024-09-12T17:33:23.767+0000 7f637f16c640 10 monclient: get_auth_request con 0x7f6374085190 auth_method 0 2024-09-12T17:33:24.076 INFO:tasks.workunit.client.0.smithi037.stderr: -96> 2024-09-12T17:33:23.770+0000 7f637e96b640 10 monclient: get_auth_request con 0x7f637402d040 auth_method 0 2024-09-12T17:33:24.076 INFO:tasks.workunit.client.0.smithi037.stderr: -95> 2024-09-12T17:33:23.770+0000 7f637e96b640 0 -- 172.21.15.37:0/450165220 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7f637402d040 msgr2=0x7f63740980b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:33:24.076 INFO:tasks.workunit.client.0.smithi037.stderr: -94> 2024-09-12T17:33:23.971+0000 7f637e96b640 10 monclient: get_auth_request con 0x7f637402d040 auth_method 0 2024-09-12T17:33:24.076 INFO:tasks.workunit.client.0.smithi037.stderr: -93> 2024-09-12T17:33:23.977+0000 7f638320e800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:33:24.076 INFO:tasks.workunit.client.0.smithi037.stderr: -92> 2024-09-12T17:33:23.977+0000 7f638320e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:33:24.076 INFO:tasks.workunit.client.0.smithi037.stderr: -91> 2024-09-12T17:33:23.977+0000 7f638320e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:33:24.077 INFO:tasks.workunit.client.0.smithi037.stderr: -90> 2024-09-12T17:33:23.977+0000 7f638320e800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:33:24.077 INFO:tasks.workunit.client.0.smithi037.stderr: -89> 2024-09-12T17:33:23.977+0000 7f638320e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:33:24.077 INFO:tasks.workunit.client.0.smithi037.stderr: -88> 2024-09-12T17:33:23.977+0000 7f638320e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:33:24.077 INFO:tasks.workunit.client.0.smithi037.stderr: -87> 2024-09-12T17:33:23.977+0000 7f638320e800 20 rados->read ofs=0 len=0 2024-09-12T17:33:24.077 INFO:tasks.workunit.client.0.smithi037.stderr: -86> 2024-09-12T17:33:23.977+0000 7f638320e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:24.077 INFO:tasks.workunit.client.0.smithi037.stderr: -85> 2024-09-12T17:33:23.977+0000 7f638320e800 20 rados->read ofs=0 len=0 2024-09-12T17:33:24.077 INFO:tasks.workunit.client.0.smithi037.stderr: -84> 2024-09-12T17:33:23.977+0000 7f638320e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:33:24.077 INFO:tasks.workunit.client.0.smithi037.stderr: -83> 2024-09-12T17:33:23.977+0000 7f638320e800 20 rados->read ofs=0 len=0 2024-09-12T17:33:24.077 INFO:tasks.workunit.client.0.smithi037.stderr: -82> 2024-09-12T17:33:23.978+0000 7f638320e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:33:24.077 INFO:tasks.workunit.client.0.smithi037.stderr: -81> 2024-09-12T17:33:23.978+0000 7f638320e800 20 zone default found 2024-09-12T17:33:24.078 INFO:tasks.workunit.client.0.smithi037.stderr: -80> 2024-09-12T17:33:23.978+0000 7f638320e800 4 Realm: () 2024-09-12T17:33:24.078 INFO:tasks.workunit.client.0.smithi037.stderr: -79> 2024-09-12T17:33:23.978+0000 7f638320e800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:33:24.078 INFO:tasks.workunit.client.0.smithi037.stderr: -78> 2024-09-12T17:33:23.978+0000 7f638320e800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:33:24.078 INFO:tasks.workunit.client.0.smithi037.stderr: -77> 2024-09-12T17:33:23.978+0000 7f638320e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:33:24.078 INFO:tasks.workunit.client.0.smithi037.stderr: -76> 2024-09-12T17:33:23.978+0000 7f638320e800 20 zonegroup default 2024-09-12T17:33:24.078 INFO:tasks.workunit.client.0.smithi037.stderr: -75> 2024-09-12T17:33:23.978+0000 7f638320e800 20 rados->read ofs=0 len=0 2024-09-12T17:33:24.078 INFO:tasks.workunit.client.0.smithi037.stderr: -74> 2024-09-12T17:33:23.978+0000 7f638320e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:24.078 INFO:tasks.workunit.client.0.smithi037.stderr: -73> 2024-09-12T17:33:23.978+0000 7f638320e800 20 rados->read ofs=0 len=0 2024-09-12T17:33:24.078 INFO:tasks.workunit.client.0.smithi037.stderr: -72> 2024-09-12T17:33:23.978+0000 7f638320e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:24.078 INFO:tasks.workunit.client.0.smithi037.stderr: -71> 2024-09-12T17:33:23.978+0000 7f638320e800 20 rados->read ofs=0 len=0 2024-09-12T17:33:24.078 INFO:tasks.workunit.client.0.smithi037.stderr: -70> 2024-09-12T17:33:23.979+0000 7f638320e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:24.078 INFO:tasks.workunit.client.0.smithi037.stderr: -69> 2024-09-12T17:33:23.979+0000 7f638320e800 20 started sync module instance, tier type = 2024-09-12T17:33:24.078 INFO:tasks.workunit.client.0.smithi037.stderr: -68> 2024-09-12T17:33:23.979+0000 7f638320e800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:33:24.078 INFO:tasks.workunit.client.0.smithi037.stderr: -67> 2024-09-12T17:33:23.988+0000 7f638320e800 20 add_watcher() i=0 2024-09-12T17:33:24.079 INFO:tasks.workunit.client.0.smithi037.stderr: -66> 2024-09-12T17:33:23.988+0000 7f638320e800 20 add_watcher() i=1 2024-09-12T17:33:24.079 INFO:tasks.workunit.client.0.smithi037.stderr: -65> 2024-09-12T17:33:23.988+0000 7f638320e800 20 add_watcher() i=2 2024-09-12T17:33:24.079 INFO:tasks.workunit.client.0.smithi037.stderr: -64> 2024-09-12T17:33:23.988+0000 7f638320e800 20 add_watcher() i=3 2024-09-12T17:33:24.079 INFO:tasks.workunit.client.0.smithi037.stderr: -63> 2024-09-12T17:33:23.988+0000 7f638320e800 20 add_watcher() i=4 2024-09-12T17:33:24.079 INFO:tasks.workunit.client.0.smithi037.stderr: -62> 2024-09-12T17:33:23.988+0000 7f638320e800 20 add_watcher() i=5 2024-09-12T17:33:24.079 INFO:tasks.workunit.client.0.smithi037.stderr: -61> 2024-09-12T17:33:23.988+0000 7f638320e800 20 add_watcher() i=6 2024-09-12T17:33:24.079 INFO:tasks.workunit.client.0.smithi037.stderr: -60> 2024-09-12T17:33:23.990+0000 7f638320e800 20 add_watcher() i=7 2024-09-12T17:33:24.079 INFO:tasks.workunit.client.0.smithi037.stderr: -59> 2024-09-12T17:33:23.990+0000 7f638320e800 2 all 8 watchers are set, enabling cache 2024-09-12T17:33:24.079 INFO:tasks.workunit.client.0.smithi037.stderr: -58> 2024-09-12T17:33:23.992+0000 7f638320e800 5 AuthRegistry(0x7ffcdf08fb10) adding auth protocol: cephx 2024-09-12T17:33:24.079 INFO:tasks.workunit.client.0.smithi037.stderr: -57> 2024-09-12T17:33:23.992+0000 7f638320e800 5 AuthRegistry(0x7ffcdf08fb10) adding auth protocol: cephx 2024-09-12T17:33:24.079 INFO:tasks.workunit.client.0.smithi037.stderr: -56> 2024-09-12T17:33:23.992+0000 7f638320e800 5 AuthRegistry(0x7ffcdf08fb10) adding auth protocol: cephx 2024-09-12T17:33:24.079 INFO:tasks.workunit.client.0.smithi037.stderr: -55> 2024-09-12T17:33:23.992+0000 7f638320e800 5 AuthRegistry(0x7ffcdf08fb10) adding con mode: secure 2024-09-12T17:33:24.079 INFO:tasks.workunit.client.0.smithi037.stderr: -54> 2024-09-12T17:33:23.992+0000 7f638320e800 5 AuthRegistry(0x7ffcdf08fb10) adding con mode: crc 2024-09-12T17:33:24.079 INFO:tasks.workunit.client.0.smithi037.stderr: -53> 2024-09-12T17:33:23.992+0000 7f638320e800 5 AuthRegistry(0x7ffcdf08fb10) adding con mode: secure 2024-09-12T17:33:24.080 INFO:tasks.workunit.client.0.smithi037.stderr: -52> 2024-09-12T17:33:23.992+0000 7f638320e800 5 AuthRegistry(0x7ffcdf08fb10) adding con mode: crc 2024-09-12T17:33:24.080 INFO:tasks.workunit.client.0.smithi037.stderr: -51> 2024-09-12T17:33:23.992+0000 7f638320e800 5 AuthRegistry(0x7ffcdf08fb10) adding con mode: secure 2024-09-12T17:33:24.080 INFO:tasks.workunit.client.0.smithi037.stderr: -50> 2024-09-12T17:33:23.992+0000 7f638320e800 5 AuthRegistry(0x7ffcdf08fb10) adding con mode: crc 2024-09-12T17:33:24.080 INFO:tasks.workunit.client.0.smithi037.stderr: -49> 2024-09-12T17:33:23.992+0000 7f638320e800 5 AuthRegistry(0x7ffcdf08fb10) adding con mode: crc 2024-09-12T17:33:24.080 INFO:tasks.workunit.client.0.smithi037.stderr: -48> 2024-09-12T17:33:23.992+0000 7f638320e800 5 AuthRegistry(0x7ffcdf08fb10) adding con mode: secure 2024-09-12T17:33:24.080 INFO:tasks.workunit.client.0.smithi037.stderr: -47> 2024-09-12T17:33:23.992+0000 7f62357e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:33:24.080 INFO:tasks.workunit.client.0.smithi037.stderr: -46> 2024-09-12T17:33:23.992+0000 7f638320e800 5 AuthRegistry(0x7ffcdf08fb10) adding con mode: crc 2024-09-12T17:33:24.080 INFO:tasks.workunit.client.0.smithi037.stderr: -45> 2024-09-12T17:33:23.992+0000 7f638320e800 5 AuthRegistry(0x7ffcdf08fb10) adding con mode: secure 2024-09-12T17:33:24.080 INFO:tasks.workunit.client.0.smithi037.stderr: -44> 2024-09-12T17:33:23.992+0000 7f638320e800 5 AuthRegistry(0x7ffcdf08fb10) adding con mode: crc 2024-09-12T17:33:24.080 INFO:tasks.workunit.client.0.smithi037.stderr: -43> 2024-09-12T17:33:23.992+0000 7f638320e800 5 AuthRegistry(0x7ffcdf08fb10) adding con mode: secure 2024-09-12T17:33:24.080 INFO:tasks.workunit.client.0.smithi037.stderr: -42> 2024-09-12T17:33:23.992+0000 7f638320e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:33:24.080 INFO:tasks.workunit.client.0.smithi037.stderr: -41> 2024-09-12T17:33:23.992+0000 7f638320e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:33:24.080 INFO:tasks.workunit.client.0.smithi037.stderr: -40> 2024-09-12T17:33:23.992+0000 7f638320e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:33:24.080 INFO:tasks.workunit.client.0.smithi037.stderr: -39> 2024-09-12T17:33:23.992+0000 7f638320e800 5 asok(0x55f29cba7730) register_command cache list hook 0x55f29ce8ef40 2024-09-12T17:33:24.081 INFO:tasks.workunit.client.0.smithi037.stderr: -38> 2024-09-12T17:33:23.992+0000 7f638320e800 5 asok(0x55f29cba7730) register_command cache inspect hook 0x55f29ce8ef40 2024-09-12T17:33:24.081 INFO:tasks.workunit.client.0.smithi037.stderr: -37> 2024-09-12T17:33:23.992+0000 7f638320e800 5 asok(0x55f29cba7730) register_command cache erase hook 0x55f29ce8ef40 2024-09-12T17:33:24.081 INFO:tasks.workunit.client.0.smithi037.stderr: -36> 2024-09-12T17:33:23.992+0000 7f638320e800 5 asok(0x55f29cba7730) register_command cache zap hook 0x55f29ce8ef40 2024-09-12T17:33:24.081 INFO:tasks.workunit.client.0.smithi037.stderr: -35> 2024-09-12T17:33:23.992+0000 7f638320e800 5 note: GC not initialized 2024-09-12T17:33:24.081 INFO:tasks.workunit.client.0.smithi037.stderr: -34> 2024-09-12T17:33:23.993+0000 7f61affff640 20 reqs_thread_entry: start 2024-09-12T17:33:24.081 INFO:tasks.workunit.client.0.smithi037.stderr: -33> 2024-09-12T17:33:23.993+0000 7f638320e800 5 asok(0x55f29cba7730) register_command sync trace show hook 0x7f6370004540 2024-09-12T17:33:24.081 INFO:tasks.workunit.client.0.smithi037.stderr: -32> 2024-09-12T17:33:23.993+0000 7f638320e800 5 asok(0x55f29cba7730) register_command sync trace history hook 0x7f6370004540 2024-09-12T17:33:24.081 INFO:tasks.workunit.client.0.smithi037.stderr: -31> 2024-09-12T17:33:23.993+0000 7f638320e800 5 asok(0x55f29cba7730) register_command sync trace active hook 0x7f6370004540 2024-09-12T17:33:24.081 INFO:tasks.workunit.client.0.smithi037.stderr: -30> 2024-09-12T17:33:23.993+0000 7f638320e800 5 asok(0x55f29cba7730) register_command sync trace active_short hook 0x7f6370004540 2024-09-12T17:33:24.081 INFO:tasks.workunit.client.0.smithi037.stderr: -29> 2024-09-12T17:33:23.993+0000 7f638320e800 20 init_complete bucket index max shards: 11 2024-09-12T17:33:24.081 INFO:tasks.workunit.client.0.smithi037.stderr: -28> 2024-09-12T17:33:23.993+0000 7f638320e800 20 Filter name: none 2024-09-12T17:33:24.081 INFO:tasks.workunit.client.0.smithi037.stderr: -27> 2024-09-12T17:33:23.993+0000 7f61adffb640 20 reqs_thread_entry: start 2024-09-12T17:33:24.081 INFO:tasks.workunit.client.0.smithi037.stderr: -26> 2024-09-12T17:33:23.993+0000 7f638320e800 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-12T17:33:24.081 INFO:tasks.workunit.client.0.smithi037.stderr: -25> 2024-09-12T17:33:23.993+0000 7f638320e800 20 rados->read ofs=0 len=0 2024-09-12T17:33:24.082 INFO:tasks.workunit.client.0.smithi037.stderr: -24> 2024-09-12T17:33:23.993+0000 7f638320e800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T17:33:24.082 INFO:tasks.workunit.client.0.smithi037.stderr: -23> 2024-09-12T17:33:23.993+0000 7f638320e800 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T17:33:24.082 INFO:tasks.workunit.client.0.smithi037.stderr: -22> 2024-09-12T17:33:23.993+0000 7f638320e800 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-12T17:33:24.082 INFO:tasks.workunit.client.0.smithi037.stderr: -21> 2024-09-12T17:33:23.993+0000 7f638320e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.28 : miss 2024-09-12T17:33:24.082 INFO:tasks.workunit.client.0.smithi037.stderr: -20> 2024-09-12T17:33:23.993+0000 7f638320e800 20 rados->read ofs=0 len=0 2024-09-12T17:33:24.082 INFO:tasks.workunit.client.0.smithi037.stderr: -19> 2024-09-12T17:33:23.994+0000 7f638320e800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T17:33:24.082 INFO:tasks.workunit.client.0.smithi037.stderr: -18> 2024-09-12T17:33:23.994+0000 7f638320e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.28 info.flags=0x17 2024-09-12T17:33:24.082 INFO:tasks.workunit.client.0.smithi037.stderr: -17> 2024-09-12T17:33:23.994+0000 7f638320e800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.28 to cache LRU end 2024-09-12T17:33:24.082 INFO:tasks.workunit.client.0.smithi037.stderr: -16> 2024-09-12T17:33:23.994+0000 7f638320e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:33:24.082 INFO:tasks.workunit.client.0.smithi037.stderr: -15> 2024-09-12T17:33:23.994+0000 7f638320e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:33:24.082 INFO:tasks.workunit.client.0.smithi037.stderr: -14> 2024-09-12T17:33:23.994+0000 7f638320e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.28 2024-09-12T17:33:24.082 INFO:tasks.workunit.client.0.smithi037.stderr: -13> 2024-09-12T17:33:23.999+0000 7f638320e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.28 info.flags=0x17 2024-09-12T17:33:24.082 INFO:tasks.workunit.client.0.smithi037.stderr: -12> 2024-09-12T17:33:23.999+0000 7f638320e800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.28 to cache LRU end 2024-09-12T17:33:24.083 INFO:tasks.workunit.client.0.smithi037.stderr: -11> 2024-09-12T17:33:23.999+0000 7f638320e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:33:24.083 INFO:tasks.workunit.client.0.smithi037.stderr: -10> 2024-09-12T17:33:23.999+0000 7f638320e800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.28, ofs0, ns] 2024-09-12T17:33:24.083 INFO:tasks.workunit.client.0.smithi037.stderr: -9> 2024-09-12T17:33:24.000+0000 7f62627fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497053 cookie 94500503182064 notifier 6924 bl.length()=1023 2024-09-12T17:33:24.083 INFO:tasks.workunit.client.0.smithi037.stderr: -8> 2024-09-12T17:33:24.000+0000 7f62627fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.28 info.flags=0x17 2024-09-12T17:33:24.083 INFO:tasks.workunit.client.0.smithi037.stderr: -7> 2024-09-12T17:33:24.000+0000 7f62627fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.28 to cache LRU end 2024-09-12T17:33:24.083 INFO:tasks.workunit.client.0.smithi037.stderr: -6> 2024-09-12T17:33:24.000+0000 7f62627fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:33:24.083 INFO:tasks.workunit.client.0.smithi037.stderr: -5> 2024-09-12T17:33:24.002+0000 7f638320e800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.28]): orig_sources= new_sources= 2024-09-12T17:33:24.083 INFO:tasks.workunit.client.0.smithi037.stderr: -4> 2024-09-12T17:33:24.002+0000 7f638320e800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.28]): potential sources added=[] removed=[] 2024-09-12T17:33:24.083 INFO:tasks.workunit.client.0.smithi037.stderr: -3> 2024-09-12T17:33:24.002+0000 7f638320e800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.28]): orig_dests= new_dests= 2024-09-12T17:33:24.083 INFO:tasks.workunit.client.0.smithi037.stderr: -2> 2024-09-12T17:33:24.002+0000 7f638320e800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.28]): potential dests added=[] removed=[] 2024-09-12T17:33:24.083 INFO:tasks.workunit.client.0.smithi037.stderr: -1> 2024-09-12T17:33:24.002+0000 7f638320e800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f638320e800 time 2024-09-12T17:33:24.002828+0000 2024-09-12T17:33:24.083 INFO:tasks.workunit.client.0.smithi037.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:33:24.083 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:33:24.083 INFO:tasks.workunit.client.0.smithi037.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:33:24.084 INFO:tasks.workunit.client.0.smithi037.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f638438c71a] 2024-09-12T17:33:24.084 INFO:tasks.workunit.client.0.smithi037.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f638438c8d8] 2024-09-12T17:33:24.084 INFO:tasks.workunit.client.0.smithi037.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f29bd70841] 2024-09-12T17:33:24.084 INFO:tasks.workunit.client.0.smithi037.stderr: 4: radosgw-admin(+0xd7489e) [0x55f29c27e89e] 2024-09-12T17:33:24.084 INFO:tasks.workunit.client.0.smithi037.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55f29bd8050d] 2024-09-12T17:33:24.084 INFO:tasks.workunit.client.0.smithi037.stderr: 6: main() 2024-09-12T17:33:24.084 INFO:tasks.workunit.client.0.smithi037.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f6383029590] 2024-09-12T17:33:24.084 INFO:tasks.workunit.client.0.smithi037.stderr: 8: __libc_start_main() 2024-09-12T17:33:24.084 INFO:tasks.workunit.client.0.smithi037.stderr: 9: _start() 2024-09-12T17:33:24.084 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:33:24.084 INFO:tasks.workunit.client.0.smithi037.stderr: 0> 2024-09-12T17:33:24.003+0000 7f638320e800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:33:24.084 INFO:tasks.workunit.client.0.smithi037.stderr: in thread 7f638320e800 thread_name:radosgw-admin 2024-09-12T17:33:24.084 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:33:24.085 INFO:tasks.workunit.client.0.smithi037.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:33:24.085 INFO:tasks.workunit.client.0.smithi037.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f638303e6f0] 2024-09-12T17:33:24.085 INFO:tasks.workunit.client.0.smithi037.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f638308b99c] 2024-09-12T17:33:24.085 INFO:tasks.workunit.client.0.smithi037.stderr: 3: raise() 2024-09-12T17:33:24.085 INFO:tasks.workunit.client.0.smithi037.stderr: 4: abort() 2024-09-12T17:33:24.085 INFO:tasks.workunit.client.0.smithi037.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f638438c774] 2024-09-12T17:33:24.085 INFO:tasks.workunit.client.0.smithi037.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f638438c8d8] 2024-09-12T17:33:24.085 INFO:tasks.workunit.client.0.smithi037.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f29bd70841] 2024-09-12T17:33:24.085 INFO:tasks.workunit.client.0.smithi037.stderr: 8: radosgw-admin(+0xd7489e) [0x55f29c27e89e] 2024-09-12T17:33:24.085 INFO:tasks.workunit.client.0.smithi037.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55f29bd8050d] 2024-09-12T17:33:24.085 INFO:tasks.workunit.client.0.smithi037.stderr: 10: main() 2024-09-12T17:33:24.085 INFO:tasks.workunit.client.0.smithi037.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f6383029590] 2024-09-12T17:33:24.085 INFO:tasks.workunit.client.0.smithi037.stderr: 12: __libc_start_main() 2024-09-12T17:33:24.085 INFO:tasks.workunit.client.0.smithi037.stderr: 13: _start() 2024-09-12T17:33:24.085 INFO:tasks.workunit.client.0.smithi037.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:33:24.086 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:33:24.086 INFO:tasks.workunit.client.0.smithi037.stderr:--- logging levels --- 2024-09-12T17:33:24.086 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 none 2024-09-12T17:33:24.086 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 lockdep 2024-09-12T17:33:24.086 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 context 2024-09-12T17:33:24.086 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 1 crush 2024-09-12T17:33:24.086 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mds 2024-09-12T17:33:24.086 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mds_balancer 2024-09-12T17:33:24.086 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mds_locker 2024-09-12T17:33:24.086 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mds_log 2024-09-12T17:33:24.086 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mds_log_expire 2024-09-12T17:33:24.086 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mds_migrator 2024-09-12T17:33:24.086 INFO:tasks.workunit.client.0.smithi037.stderr: 3/ 5 mds_quiesce 2024-09-12T17:33:24.086 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 buffer 2024-09-12T17:33:24.087 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 timer 2024-09-12T17:33:24.087 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 filer 2024-09-12T17:33:24.087 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 striper 2024-09-12T17:33:24.087 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 objecter 2024-09-12T17:33:24.087 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 rados 2024-09-12T17:33:24.087 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 rbd 2024-09-12T17:33:24.087 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 rbd_mirror 2024-09-12T17:33:24.087 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 rbd_replay 2024-09-12T17:33:24.087 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 rbd_pwl 2024-09-12T17:33:24.087 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 journaler 2024-09-12T17:33:24.087 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 objectcacher 2024-09-12T17:33:24.087 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:33:24.087 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 client 2024-09-12T17:33:24.087 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 osd 2024-09-12T17:33:24.088 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 optracker 2024-09-12T17:33:24.088 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 objclass 2024-09-12T17:33:24.088 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 3 filestore 2024-09-12T17:33:24.088 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 3 journal 2024-09-12T17:33:24.088 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 0 ms 2024-09-12T17:33:24.088 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mon 2024-09-12T17:33:24.088 INFO:tasks.workunit.client.0.smithi037.stderr: 0/10 monc 2024-09-12T17:33:24.088 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 paxos 2024-09-12T17:33:24.088 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 tp 2024-09-12T17:33:24.088 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 auth 2024-09-12T17:33:24.088 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 crypto 2024-09-12T17:33:24.088 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 1 finisher 2024-09-12T17:33:24.088 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 1 reserver 2024-09-12T17:33:24.089 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 heartbeatmap 2024-09-12T17:33:24.089 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 perfcounter 2024-09-12T17:33:24.089 INFO:tasks.workunit.client.0.smithi037.stderr: 20/20 rgw 2024-09-12T17:33:24.089 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 rgw_sync 2024-09-12T17:33:24.089 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 rgw_datacache 2024-09-12T17:33:24.089 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 rgw_access 2024-09-12T17:33:24.089 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:33:24.089 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 rgw_flight 2024-09-12T17:33:24.089 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:33:24.089 INFO:tasks.workunit.client.0.smithi037.stderr: 20/20 rgw_notification 2024-09-12T17:33:24.089 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 javaclient 2024-09-12T17:33:24.089 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 asok 2024-09-12T17:33:24.089 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 1 throttle 2024-09-12T17:33:24.089 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 0 refs 2024-09-12T17:33:24.090 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 compressor 2024-09-12T17:33:24.090 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 bluestore 2024-09-12T17:33:24.090 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 bluefs 2024-09-12T17:33:24.090 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 3 bdev 2024-09-12T17:33:24.090 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 kstore 2024-09-12T17:33:24.090 INFO:tasks.workunit.client.0.smithi037.stderr: 4/ 5 rocksdb 2024-09-12T17:33:24.090 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 fuse 2024-09-12T17:33:24.090 INFO:tasks.workunit.client.0.smithi037.stderr: 2/ 5 mgr 2024-09-12T17:33:24.090 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mgrc 2024-09-12T17:33:24.090 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 dpdk 2024-09-12T17:33:24.090 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 eventtrace 2024-09-12T17:33:24.090 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 prioritycache 2024-09-12T17:33:24.090 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 test 2024-09-12T17:33:24.090 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:33:24.091 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 cephsqlite 2024-09-12T17:33:24.091 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:33:24.091 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore 2024-09-12T17:33:24.091 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_onode 2024-09-12T17:33:24.091 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_odata 2024-09-12T17:33:24.091 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_omap 2024-09-12T17:33:24.091 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_tm 2024-09-12T17:33:24.091 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_t 2024-09-12T17:33:24.091 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:33:24.091 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_epm 2024-09-12T17:33:24.091 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_lba 2024-09-12T17:33:24.091 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:33:24.091 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_cache 2024-09-12T17:33:24.091 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_journal 2024-09-12T17:33:24.091 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_device 2024-09-12T17:33:24.092 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_backref 2024-09-12T17:33:24.092 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 alienstore 2024-09-12T17:33:24.092 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mclock 2024-09-12T17:33:24.092 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 cyanstore 2024-09-12T17:33:24.092 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 ceph_exporter 2024-09-12T17:33:24.092 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 memstore 2024-09-12T17:33:24.092 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 trace 2024-09-12T17:33:24.092 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 ceph_dedup 2024-09-12T17:33:24.092 INFO:tasks.workunit.client.0.smithi037.stderr: -2/-2 (syslog threshold) 2024-09-12T17:33:24.092 INFO:tasks.workunit.client.0.smithi037.stderr: 99/99 (stderr threshold) 2024-09-12T17:33:24.092 INFO:tasks.workunit.client.0.smithi037.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:33:24.092 INFO:tasks.workunit.client.0.smithi037.stderr: 7f61adffb640 / http_manager 2024-09-12T17:33:24.092 INFO:tasks.workunit.client.0.smithi037.stderr: 7f61affff640 / http_manager 2024-09-12T17:33:24.092 INFO:tasks.workunit.client.0.smithi037.stderr: 7f62357e2640 / rgw_dt_lg_renew 2024-09-12T17:33:24.093 INFO:tasks.workunit.client.0.smithi037.stderr: 7f6260ff9640 / ms_dispatch 2024-09-12T17:33:24.093 INFO:tasks.workunit.client.0.smithi037.stderr: 7f62627fc640 / io_context_pool 2024-09-12T17:33:24.093 INFO:tasks.workunit.client.0.smithi037.stderr: 7f6268e01640 / ms_dispatch 2024-09-12T17:33:24.093 INFO:tasks.workunit.client.0.smithi037.stderr: 7f626b606640 / ms_dispatch 2024-09-12T17:33:24.093 INFO:tasks.workunit.client.0.smithi037.stderr: 7f626ce09640 / io_context_pool 2024-09-12T17:33:24.093 INFO:tasks.workunit.client.0.smithi037.stderr: 7f637e16a640 / msgr-worker-2 2024-09-12T17:33:24.093 INFO:tasks.workunit.client.0.smithi037.stderr: 7f637e96b640 / msgr-worker-1 2024-09-12T17:33:24.093 INFO:tasks.workunit.client.0.smithi037.stderr: 7f637f16c640 / msgr-worker-0 2024-09-12T17:33:24.093 INFO:tasks.workunit.client.0.smithi037.stderr: 7f637f96d640 / io_context_pool 2024-09-12T17:33:24.093 INFO:tasks.workunit.client.0.smithi037.stderr: 7f638320e800 / radosgw-admin 2024-09-12T17:33:24.093 INFO:tasks.workunit.client.0.smithi037.stderr: max_recent 500 2024-09-12T17:33:24.093 INFO:tasks.workunit.client.0.smithi037.stderr: max_new 1000 2024-09-12T17:33:24.093 INFO:tasks.workunit.client.0.smithi037.stderr: log_file /var/log/ceph/ceph-client.admin.107271.log 2024-09-12T17:33:24.094 INFO:tasks.workunit.client.0.smithi037.stderr:--- end dump of recent events --- 2024-09-12T17:33:24.094 INFO:tasks.workunit.client.0.smithi037.stderr:--- begin dump of recent events --- 2024-09-12T17:33:24.094 INFO:tasks.workunit.client.0.smithi037.stderr: -499> 2024-09-12T17:33:23.742+0000 7f626ce09640 10 monclient: handle_config config(0 keys) 2024-09-12T17:33:24.094 INFO:tasks.workunit.client.0.smithi037.stderr: -498> 2024-09-12T17:33:23.742+0000 7f638320e800 10 monclient: get_monmap_and_config success 2024-09-12T17:33:24.094 INFO:tasks.workunit.client.0.smithi037.stderr: -497> 2024-09-12T17:33:23.742+0000 7f638320e800 4 set_mon_vals no callback set 2024-09-12T17:33:24.094 INFO:tasks.workunit.client.0.smithi037.stderr: -496> 2024-09-12T17:33:23.742+0000 7f626ce09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:33:24.094 INFO:tasks.workunit.client.0.smithi037.stderr: -495> 2024-09-12T17:33:23.742+0000 7f626ce09640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:33:24.094 INFO:tasks.workunit.client.0.smithi037.stderr: -494> 2024-09-12T17:33:23.742+0000 7f626ce09640 10 monclient: dump: 2024-09-12T17:33:24.094 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:33:24.094 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:33:24.094 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:33:24.094 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:33:24.094 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:33:24.094 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:33:24.095 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:33:24.095 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:33:24.095 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:33:24.095 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:33:24.095 INFO:tasks.workunit.client.0.smithi037.stderr: -493> 2024-09-12T17:33:23.743+0000 7f638320e800 10 monclient: shutdown 2024-09-12T17:33:24.095 INFO:tasks.workunit.client.0.smithi037.stderr: -492> 2024-09-12T17:33:23.743+0000 7f638320e800 5 asok(0x55f29cba7730) unregister_commands rotate-key 2024-09-12T17:33:24.095 INFO:tasks.workunit.client.0.smithi037.stderr: -491> 2024-09-12T17:33:23.743+0000 7f638320e800 10 monclient: build_initial_monmap 2024-09-12T17:33:24.095 INFO:tasks.workunit.client.0.smithi037.stderr: -490> 2024-09-12T17:33:23.743+0000 7f638320e800 1 build_initial for_mkfs: 0 2024-09-12T17:33:24.095 INFO:tasks.workunit.client.0.smithi037.stderr: -489> 2024-09-12T17:33:23.743+0000 7f638320e800 10 monclient: monmap: 2024-09-12T17:33:24.095 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 0 2024-09-12T17:33:24.095 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:33:24.095 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 0.000000 2024-09-12T17:33:24.095 INFO:tasks.workunit.client.0.smithi037.stderr:created 0.000000 2024-09-12T17:33:24.095 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 0 (unknown) 2024-09-12T17:33:24.096 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:33:24.096 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.noname-a 2024-09-12T17:33:24.096 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.noname-b 2024-09-12T17:33:24.096 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.noname-c 2024-09-12T17:33:24.096 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:33:24.096 INFO:tasks.workunit.client.0.smithi037.stderr: -488> 2024-09-12T17:33:23.743+0000 7f638320e800 5 AuthRegistry(0x55f29cdcf680) adding auth protocol: cephx 2024-09-12T17:33:24.096 INFO:tasks.workunit.client.0.smithi037.stderr: -487> 2024-09-12T17:33:23.743+0000 7f638320e800 5 AuthRegistry(0x55f29cdcf680) adding auth protocol: cephx 2024-09-12T17:33:24.096 INFO:tasks.workunit.client.0.smithi037.stderr: -486> 2024-09-12T17:33:23.743+0000 7f638320e800 5 AuthRegistry(0x55f29cdcf680) adding auth protocol: cephx 2024-09-12T17:33:24.096 INFO:tasks.workunit.client.0.smithi037.stderr: -485> 2024-09-12T17:33:23.743+0000 7f638320e800 5 AuthRegistry(0x55f29cdcf680) adding con mode: secure 2024-09-12T17:33:24.096 INFO:tasks.workunit.client.0.smithi037.stderr: -484> 2024-09-12T17:33:23.743+0000 7f638320e800 5 AuthRegistry(0x55f29cdcf680) adding con mode: crc 2024-09-12T17:33:24.096 INFO:tasks.workunit.client.0.smithi037.stderr: -483> 2024-09-12T17:33:23.743+0000 7f638320e800 5 AuthRegistry(0x55f29cdcf680) adding con mode: secure 2024-09-12T17:33:24.096 INFO:tasks.workunit.client.0.smithi037.stderr: -482> 2024-09-12T17:33:23.743+0000 7f638320e800 5 AuthRegistry(0x55f29cdcf680) adding con mode: crc 2024-09-12T17:33:24.096 INFO:tasks.workunit.client.0.smithi037.stderr: -481> 2024-09-12T17:33:23.743+0000 7f638320e800 5 AuthRegistry(0x55f29cdcf680) adding con mode: secure 2024-09-12T17:33:24.096 INFO:tasks.workunit.client.0.smithi037.stderr: -480> 2024-09-12T17:33:23.743+0000 7f638320e800 5 AuthRegistry(0x55f29cdcf680) adding con mode: crc 2024-09-12T17:33:24.097 INFO:tasks.workunit.client.0.smithi037.stderr: -479> 2024-09-12T17:33:23.743+0000 7f638320e800 5 AuthRegistry(0x55f29cdcf680) adding con mode: crc 2024-09-12T17:33:24.097 INFO:tasks.workunit.client.0.smithi037.stderr: -478> 2024-09-12T17:33:23.743+0000 7f638320e800 5 AuthRegistry(0x55f29cdcf680) adding con mode: secure 2024-09-12T17:33:24.097 INFO:tasks.workunit.client.0.smithi037.stderr: -477> 2024-09-12T17:33:23.743+0000 7f638320e800 5 AuthRegistry(0x55f29cdcf680) adding con mode: crc 2024-09-12T17:33:24.097 INFO:tasks.workunit.client.0.smithi037.stderr: -476> 2024-09-12T17:33:23.743+0000 7f638320e800 5 AuthRegistry(0x55f29cdcf680) adding con mode: secure 2024-09-12T17:33:24.097 INFO:tasks.workunit.client.0.smithi037.stderr: -475> 2024-09-12T17:33:23.743+0000 7f638320e800 5 AuthRegistry(0x55f29cdcf680) adding con mode: crc 2024-09-12T17:33:24.097 INFO:tasks.workunit.client.0.smithi037.stderr: -474> 2024-09-12T17:33:23.743+0000 7f638320e800 5 AuthRegistry(0x55f29cdcf680) adding con mode: secure 2024-09-12T17:33:24.097 INFO:tasks.workunit.client.0.smithi037.stderr: -473> 2024-09-12T17:33:23.743+0000 7f638320e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:33:24.097 INFO:tasks.workunit.client.0.smithi037.stderr: -472> 2024-09-12T17:33:23.743+0000 7f638320e800 1 librados: starting msgr at 2024-09-12T17:33:24.097 INFO:tasks.workunit.client.0.smithi037.stderr: -471> 2024-09-12T17:33:23.743+0000 7f638320e800 1 librados: starting objecter 2024-09-12T17:33:24.097 INFO:tasks.workunit.client.0.smithi037.stderr: -470> 2024-09-12T17:33:23.743+0000 7f638320e800 5 asok(0x55f29cba7730) register_command objecter_requests hook 0x55f29cdf3ae0 2024-09-12T17:33:24.097 INFO:tasks.workunit.client.0.smithi037.stderr: -469> 2024-09-12T17:33:23.743+0000 7f638320e800 1 librados: setting wanted keys 2024-09-12T17:33:24.097 INFO:tasks.workunit.client.0.smithi037.stderr: -468> 2024-09-12T17:33:23.743+0000 7f638320e800 1 librados: calling monclient init 2024-09-12T17:33:24.097 INFO:tasks.workunit.client.0.smithi037.stderr: -467> 2024-09-12T17:33:23.743+0000 7f638320e800 10 monclient: init 2024-09-12T17:33:24.097 INFO:tasks.workunit.client.0.smithi037.stderr: -466> 2024-09-12T17:33:23.743+0000 7f638320e800 5 AuthRegistry(0x55f29cdc9fc0) adding auth protocol: cephx 2024-09-12T17:33:24.098 INFO:tasks.workunit.client.0.smithi037.stderr: -465> 2024-09-12T17:33:23.743+0000 7f638320e800 5 AuthRegistry(0x55f29cdc9fc0) adding auth protocol: cephx 2024-09-12T17:33:24.098 INFO:tasks.workunit.client.0.smithi037.stderr: -464> 2024-09-12T17:33:23.743+0000 7f638320e800 5 AuthRegistry(0x55f29cdc9fc0) adding auth protocol: cephx 2024-09-12T17:33:24.098 INFO:tasks.workunit.client.0.smithi037.stderr: -463> 2024-09-12T17:33:23.743+0000 7f638320e800 5 AuthRegistry(0x55f29cdc9fc0) adding con mode: secure 2024-09-12T17:33:24.098 INFO:tasks.workunit.client.0.smithi037.stderr: -462> 2024-09-12T17:33:23.743+0000 7f638320e800 5 AuthRegistry(0x55f29cdc9fc0) adding con mode: crc 2024-09-12T17:33:24.098 INFO:tasks.workunit.client.0.smithi037.stderr: -461> 2024-09-12T17:33:23.743+0000 7f638320e800 5 AuthRegistry(0x55f29cdc9fc0) adding con mode: secure 2024-09-12T17:33:24.098 INFO:tasks.workunit.client.0.smithi037.stderr: -460> 2024-09-12T17:33:23.743+0000 7f638320e800 5 AuthRegistry(0x55f29cdc9fc0) adding con mode: crc 2024-09-12T17:33:24.098 INFO:tasks.workunit.client.0.smithi037.stderr: -459> 2024-09-12T17:33:23.743+0000 7f638320e800 5 AuthRegistry(0x55f29cdc9fc0) adding con mode: secure 2024-09-12T17:33:24.098 INFO:tasks.workunit.client.0.smithi037.stderr: -458> 2024-09-12T17:33:23.743+0000 7f638320e800 5 AuthRegistry(0x55f29cdc9fc0) adding con mode: crc 2024-09-12T17:33:24.098 INFO:tasks.workunit.client.0.smithi037.stderr: -457> 2024-09-12T17:33:23.743+0000 7f638320e800 5 AuthRegistry(0x55f29cdc9fc0) adding con mode: crc 2024-09-12T17:33:24.098 INFO:tasks.workunit.client.0.smithi037.stderr: -456> 2024-09-12T17:33:23.743+0000 7f638320e800 5 AuthRegistry(0x55f29cdc9fc0) adding con mode: secure 2024-09-12T17:33:24.098 INFO:tasks.workunit.client.0.smithi037.stderr: -455> 2024-09-12T17:33:23.743+0000 7f638320e800 5 AuthRegistry(0x55f29cdc9fc0) adding con mode: crc 2024-09-12T17:33:24.098 INFO:tasks.workunit.client.0.smithi037.stderr: -454> 2024-09-12T17:33:23.743+0000 7f638320e800 5 AuthRegistry(0x55f29cdc9fc0) adding con mode: secure 2024-09-12T17:33:24.099 INFO:tasks.workunit.client.0.smithi037.stderr: -453> 2024-09-12T17:33:23.743+0000 7f638320e800 5 AuthRegistry(0x55f29cdc9fc0) adding con mode: crc 2024-09-12T17:33:24.099 INFO:tasks.workunit.client.0.smithi037.stderr: -452> 2024-09-12T17:33:23.743+0000 7f638320e800 5 AuthRegistry(0x55f29cdc9fc0) adding con mode: secure 2024-09-12T17:33:24.099 INFO:tasks.workunit.client.0.smithi037.stderr: -451> 2024-09-12T17:33:23.743+0000 7f638320e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:33:24.099 INFO:tasks.workunit.client.0.smithi037.stderr: -450> 2024-09-12T17:33:23.744+0000 7f638320e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:33:24.099 INFO:tasks.workunit.client.0.smithi037.stderr: -449> 2024-09-12T17:33:23.744+0000 7f638320e800 5 asok(0x55f29cba7730) register_command rotate-key hook 0x55f29cdca108 2024-09-12T17:33:24.099 INFO:tasks.workunit.client.0.smithi037.stderr: -448> 2024-09-12T17:33:23.744+0000 7f638320e800 10 monclient: _reopen_session rank -1 2024-09-12T17:33:24.099 INFO:tasks.workunit.client.0.smithi037.stderr: -447> 2024-09-12T17:33:23.744+0000 7f638320e800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T17:33:24.099 INFO:tasks.workunit.client.0.smithi037.stderr: -446> 2024-09-12T17:33:23.744+0000 7f638320e800 10 monclient(hunting): picked mon.noname-a con 0x55f29cd0b2f0 addr [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] 2024-09-12T17:33:24.099 INFO:tasks.workunit.client.0.smithi037.stderr: -445> 2024-09-12T17:33:23.744+0000 7f638320e800 10 monclient(hunting): picked mon.noname-b con 0x55f29cd0e470 addr [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] 2024-09-12T17:33:24.100 INFO:tasks.workunit.client.0.smithi037.stderr: -444> 2024-09-12T17:33:23.744+0000 7f638320e800 10 monclient(hunting): picked mon.noname-c con 0x55f29cd16d70 addr [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] 2024-09-12T17:33:24.100 INFO:tasks.workunit.client.0.smithi037.stderr: -443> 2024-09-12T17:33:23.744+0000 7f638320e800 10 monclient(hunting): start opening mon connection 2024-09-12T17:33:24.100 INFO:tasks.workunit.client.0.smithi037.stderr: -442> 2024-09-12T17:33:23.744+0000 7f638320e800 10 monclient(hunting): start opening mon connection 2024-09-12T17:33:24.100 INFO:tasks.workunit.client.0.smithi037.stderr: -441> 2024-09-12T17:33:23.744+0000 7f638320e800 10 monclient(hunting): start opening mon connection 2024-09-12T17:33:24.100 INFO:tasks.workunit.client.0.smithi037.stderr: -440> 2024-09-12T17:33:23.744+0000 7f638320e800 10 monclient(hunting): _renew_subs 2024-09-12T17:33:24.100 INFO:tasks.workunit.client.0.smithi037.stderr: -439> 2024-09-12T17:33:23.744+0000 7f638320e800 10 monclient(hunting): authenticate will time out at 2191.341277s 2024-09-12T17:33:24.100 INFO:tasks.workunit.client.0.smithi037.stderr: -438> 2024-09-12T17:33:23.744+0000 7f637e96b640 10 monclient(hunting): get_auth_request con 0x55f29cd0b2f0 auth_method 0 2024-09-12T17:33:24.100 INFO:tasks.workunit.client.0.smithi037.stderr: -437> 2024-09-12T17:33:23.744+0000 7f637e96b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:33:24.100 INFO:tasks.workunit.client.0.smithi037.stderr: -436> 2024-09-12T17:33:23.744+0000 7f637e96b640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:33:24.100 INFO:tasks.workunit.client.0.smithi037.stderr: -435> 2024-09-12T17:33:23.744+0000 7f637e96b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:33:24.101 INFO:tasks.workunit.client.0.smithi037.stderr: -434> 2024-09-12T17:33:23.744+0000 7f637e96b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:33:24.101 INFO:tasks.workunit.client.0.smithi037.stderr: -433> 2024-09-12T17:33:23.744+0000 7f637e96b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:33:24.101 INFO:tasks.workunit.client.0.smithi037.stderr: -432> 2024-09-12T17:33:23.744+0000 7f637e96b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:33:24.101 INFO:tasks.workunit.client.0.smithi037.stderr: -431> 2024-09-12T17:33:23.744+0000 7f637e16a640 10 monclient(hunting): get_auth_request con 0x55f29cd0e470 auth_method 0 2024-09-12T17:33:24.101 INFO:tasks.workunit.client.0.smithi037.stderr: -430> 2024-09-12T17:33:23.744+0000 7f637e16a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:33:24.101 INFO:tasks.workunit.client.0.smithi037.stderr: -429> 2024-09-12T17:33:23.744+0000 7f637e16a640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:33:24.101 INFO:tasks.workunit.client.0.smithi037.stderr: -428> 2024-09-12T17:33:23.744+0000 7f637e16a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:33:24.101 INFO:tasks.workunit.client.0.smithi037.stderr: -427> 2024-09-12T17:33:23.744+0000 7f637e96b640 10 monclient(hunting): handle_auth_done global_id 6915 payload 824 2024-09-12T17:33:24.101 INFO:tasks.workunit.client.0.smithi037.stderr: -426> 2024-09-12T17:33:23.744+0000 7f637e96b640 10 monclient: _finish_hunting 0 2024-09-12T17:33:24.101 INFO:tasks.workunit.client.0.smithi037.stderr: -425> 2024-09-12T17:33:23.744+0000 7f637e96b640 1 monclient: found mon.noname-a 2024-09-12T17:33:24.101 INFO:tasks.workunit.client.0.smithi037.stderr: -424> 2024-09-12T17:33:23.744+0000 7f637e96b640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.37:3300/0 2024-09-12T17:33:24.102 INFO:tasks.workunit.client.0.smithi037.stderr: -423> 2024-09-12T17:33:23.744+0000 7f626b606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:33:24.102 INFO:tasks.workunit.client.0.smithi037.stderr: -422> 2024-09-12T17:33:23.744+0000 7f626b606640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:33:24.102 INFO:tasks.workunit.client.0.smithi037.stderr: -421> 2024-09-12T17:33:23.744+0000 7f626b606640 10 monclient: dump: 2024-09-12T17:33:24.102 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:33:24.102 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:33:24.102 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:33:24.102 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:33:24.102 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:33:24.102 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:33:24.102 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:33:24.102 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:33:24.102 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:33:24.102 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:33:24.103 INFO:tasks.workunit.client.0.smithi037.stderr: -420> 2024-09-12T17:33:23.744+0000 7f626b606640 10 monclient: _finish_auth 0 2024-09-12T17:33:24.103 INFO:tasks.workunit.client.0.smithi037.stderr: -419> 2024-09-12T17:33:23.744+0000 7f626b606640 10 monclient: _check_auth_tickets 2024-09-12T17:33:24.103 INFO:tasks.workunit.client.0.smithi037.stderr: -418> 2024-09-12T17:33:23.744+0000 7f626b606640 10 monclient: handle_config config(0 keys) 2024-09-12T17:33:24.103 INFO:tasks.workunit.client.0.smithi037.stderr: -417> 2024-09-12T17:33:23.744+0000 7f626b606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:33:24.103 INFO:tasks.workunit.client.0.smithi037.stderr: -416> 2024-09-12T17:33:23.744+0000 7f626b606640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:33:24.103 INFO:tasks.workunit.client.0.smithi037.stderr: -415> 2024-09-12T17:33:23.744+0000 7f626b606640 10 monclient: dump: 2024-09-12T17:33:24.103 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:33:24.103 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:33:24.103 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:33:24.103 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:33:24.103 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:33:24.104 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:33:24.104 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:33:24.104 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:33:24.104 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:33:24.104 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:33:24.104 INFO:tasks.workunit.client.0.smithi037.stderr: -414> 2024-09-12T17:33:23.744+0000 7f638320e800 5 monclient: authenticate success, global_id 6915 2024-09-12T17:33:24.104 INFO:tasks.workunit.client.0.smithi037.stderr: -413> 2024-09-12T17:33:23.744+0000 7f638320e800 10 monclient: _renew_subs 2024-09-12T17:33:24.104 INFO:tasks.workunit.client.0.smithi037.stderr: -412> 2024-09-12T17:33:23.744+0000 7f638320e800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.37:3300/0 2024-09-12T17:33:24.104 INFO:tasks.workunit.client.0.smithi037.stderr: -411> 2024-09-12T17:33:23.744+0000 7f626ce09640 4 set_mon_vals no callback set 2024-09-12T17:33:24.104 INFO:tasks.workunit.client.0.smithi037.stderr: -410> 2024-09-12T17:33:23.744+0000 7f638320e800 10 monclient: _renew_subs 2024-09-12T17:33:24.104 INFO:tasks.workunit.client.0.smithi037.stderr: -409> 2024-09-12T17:33:23.744+0000 7f638320e800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.37:3300/0 2024-09-12T17:33:24.104 INFO:tasks.workunit.client.0.smithi037.stderr: -408> 2024-09-12T17:33:23.744+0000 7f638320e800 1 librados: init done 2024-09-12T17:33:24.105 INFO:tasks.workunit.client.0.smithi037.stderr: -407> 2024-09-12T17:33:23.746+0000 7f626b606640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:33:24.105 INFO:tasks.workunit.client.0.smithi037.stderr: -406> 2024-09-12T17:33:23.746+0000 7f626b606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.40:6816/3916250676,v1:172.21.15.40:6817/3916250676] 2024-09-12T17:33:24.105 INFO:tasks.workunit.client.0.smithi037.stderr: -405> 2024-09-12T17:33:23.746+0000 7f626b606640 4 mgrc reconnect Starting new session with [v2:172.21.15.40:6816/3916250676,v1:172.21.15.40:6817/3916250676] 2024-09-12T17:33:24.105 INFO:tasks.workunit.client.0.smithi037.stderr: -404> 2024-09-12T17:33:23.747+0000 7f637e16a640 10 monclient: get_auth_request con 0x7f6264076470 auth_method 0 2024-09-12T17:33:24.105 INFO:tasks.workunit.client.0.smithi037.stderr: -403> 2024-09-12T17:33:23.747+0000 7f637f16c640 10 monclient: get_auth_request con 0x55f29cdf2610 auth_method 0 2024-09-12T17:33:24.105 INFO:tasks.workunit.client.0.smithi037.stderr: -402> 2024-09-12T17:33:23.748+0000 7f637e96b640 10 monclient: get_auth_request con 0x55f29ce152d0 auth_method 0 2024-09-12T17:33:24.105 INFO:tasks.workunit.client.0.smithi037.stderr: -401> 2024-09-12T17:33:23.749+0000 7f637e16a640 10 monclient: get_auth_request con 0x55f29ce1a470 auth_method 0 2024-09-12T17:33:24.105 INFO:tasks.workunit.client.0.smithi037.stderr: -400> 2024-09-12T17:33:23.750+0000 7f638320e800 10 monclient: build_initial_monmap 2024-09-12T17:33:24.105 INFO:tasks.workunit.client.0.smithi037.stderr: -399> 2024-09-12T17:33:23.750+0000 7f638320e800 1 build_initial for_mkfs: 0 2024-09-12T17:33:24.105 INFO:tasks.workunit.client.0.smithi037.stderr: -398> 2024-09-12T17:33:23.750+0000 7f638320e800 10 monclient: monmap: 2024-09-12T17:33:24.105 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 0 2024-09-12T17:33:24.106 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:33:24.106 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 0.000000 2024-09-12T17:33:24.106 INFO:tasks.workunit.client.0.smithi037.stderr:created 0.000000 2024-09-12T17:33:24.106 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 0 (unknown) 2024-09-12T17:33:24.106 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:33:24.106 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.noname-a 2024-09-12T17:33:24.106 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.noname-b 2024-09-12T17:33:24.106 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.noname-c 2024-09-12T17:33:24.106 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:33:24.106 INFO:tasks.workunit.client.0.smithi037.stderr: -397> 2024-09-12T17:33:23.750+0000 7f638320e800 5 AuthRegistry(0x55f29ce1e360) adding auth protocol: cephx 2024-09-12T17:33:24.106 INFO:tasks.workunit.client.0.smithi037.stderr: -396> 2024-09-12T17:33:23.750+0000 7f638320e800 5 AuthRegistry(0x55f29ce1e360) adding auth protocol: cephx 2024-09-12T17:33:24.106 INFO:tasks.workunit.client.0.smithi037.stderr: -395> 2024-09-12T17:33:23.750+0000 7f638320e800 5 AuthRegistry(0x55f29ce1e360) adding auth protocol: cephx 2024-09-12T17:33:24.106 INFO:tasks.workunit.client.0.smithi037.stderr: -394> 2024-09-12T17:33:23.750+0000 7f638320e800 5 AuthRegistry(0x55f29ce1e360) adding con mode: secure 2024-09-12T17:33:24.107 INFO:tasks.workunit.client.0.smithi037.stderr: -393> 2024-09-12T17:33:23.750+0000 7f638320e800 5 AuthRegistry(0x55f29ce1e360) adding con mode: crc 2024-09-12T17:33:24.107 INFO:tasks.workunit.client.0.smithi037.stderr: -392> 2024-09-12T17:33:23.750+0000 7f638320e800 5 AuthRegistry(0x55f29ce1e360) adding con mode: secure 2024-09-12T17:33:24.107 INFO:tasks.workunit.client.0.smithi037.stderr: -391> 2024-09-12T17:33:23.750+0000 7f638320e800 5 AuthRegistry(0x55f29ce1e360) adding con mode: crc 2024-09-12T17:33:24.107 INFO:tasks.workunit.client.0.smithi037.stderr: -390> 2024-09-12T17:33:23.750+0000 7f638320e800 5 AuthRegistry(0x55f29ce1e360) adding con mode: secure 2024-09-12T17:33:24.107 INFO:tasks.workunit.client.0.smithi037.stderr: -389> 2024-09-12T17:33:23.750+0000 7f638320e800 5 AuthRegistry(0x55f29ce1e360) adding con mode: crc 2024-09-12T17:33:24.107 INFO:tasks.workunit.client.0.smithi037.stderr: -388> 2024-09-12T17:33:23.750+0000 7f638320e800 5 AuthRegistry(0x55f29ce1e360) adding con mode: crc 2024-09-12T17:33:24.107 INFO:tasks.workunit.client.0.smithi037.stderr: -387> 2024-09-12T17:33:23.750+0000 7f638320e800 5 AuthRegistry(0x55f29ce1e360) adding con mode: secure 2024-09-12T17:33:24.107 INFO:tasks.workunit.client.0.smithi037.stderr: -386> 2024-09-12T17:33:23.750+0000 7f638320e800 5 AuthRegistry(0x55f29ce1e360) adding con mode: crc 2024-09-12T17:33:24.107 INFO:tasks.workunit.client.0.smithi037.stderr: -385> 2024-09-12T17:33:23.750+0000 7f638320e800 5 AuthRegistry(0x55f29ce1e360) adding con mode: secure 2024-09-12T17:33:24.107 INFO:tasks.workunit.client.0.smithi037.stderr: -384> 2024-09-12T17:33:23.750+0000 7f638320e800 5 AuthRegistry(0x55f29ce1e360) adding con mode: crc 2024-09-12T17:33:24.107 INFO:tasks.workunit.client.0.smithi037.stderr: -383> 2024-09-12T17:33:23.750+0000 7f638320e800 5 AuthRegistry(0x55f29ce1e360) adding con mode: secure 2024-09-12T17:33:24.107 INFO:tasks.workunit.client.0.smithi037.stderr: -382> 2024-09-12T17:33:23.750+0000 7f638320e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:33:24.108 INFO:tasks.workunit.client.0.smithi037.stderr: -381> 2024-09-12T17:33:23.750+0000 7f638320e800 5 asok(0x55f29cba7730) register_command objecter_requests cmddesc objecter_requests hook 0x55f29ce21db0 EEXIST 2024-09-12T17:33:24.108 INFO:tasks.workunit.client.0.smithi037.stderr: -380> 2024-09-12T17:33:23.751+0000 7f638320e800 10 monclient: init 2024-09-12T17:33:24.108 INFO:tasks.workunit.client.0.smithi037.stderr: -379> 2024-09-12T17:33:23.751+0000 7f638320e800 5 AuthRegistry(0x55f29ce1d448) adding auth protocol: cephx 2024-09-12T17:33:24.108 INFO:tasks.workunit.client.0.smithi037.stderr: -378> 2024-09-12T17:33:23.751+0000 7f638320e800 5 AuthRegistry(0x55f29ce1d448) adding auth protocol: cephx 2024-09-12T17:33:24.108 INFO:tasks.workunit.client.0.smithi037.stderr: -377> 2024-09-12T17:33:23.751+0000 7f638320e800 5 AuthRegistry(0x55f29ce1d448) adding auth protocol: cephx 2024-09-12T17:33:24.108 INFO:tasks.workunit.client.0.smithi037.stderr: -376> 2024-09-12T17:33:23.751+0000 7f638320e800 5 AuthRegistry(0x55f29ce1d448) adding con mode: secure 2024-09-12T17:33:24.108 INFO:tasks.workunit.client.0.smithi037.stderr: -375> 2024-09-12T17:33:23.751+0000 7f638320e800 5 AuthRegistry(0x55f29ce1d448) adding con mode: crc 2024-09-12T17:33:24.108 INFO:tasks.workunit.client.0.smithi037.stderr: -374> 2024-09-12T17:33:23.751+0000 7f638320e800 5 AuthRegistry(0x55f29ce1d448) adding con mode: secure 2024-09-12T17:33:24.108 INFO:tasks.workunit.client.0.smithi037.stderr: -373> 2024-09-12T17:33:23.751+0000 7f638320e800 5 AuthRegistry(0x55f29ce1d448) adding con mode: crc 2024-09-12T17:33:24.108 INFO:tasks.workunit.client.0.smithi037.stderr: -372> 2024-09-12T17:33:23.751+0000 7f638320e800 5 AuthRegistry(0x55f29ce1d448) adding con mode: secure 2024-09-12T17:33:24.109 INFO:tasks.workunit.client.0.smithi037.stderr: -371> 2024-09-12T17:33:23.751+0000 7f638320e800 5 AuthRegistry(0x55f29ce1d448) adding con mode: crc 2024-09-12T17:33:24.109 INFO:tasks.workunit.client.0.smithi037.stderr: -370> 2024-09-12T17:33:23.751+0000 7f638320e800 5 AuthRegistry(0x55f29ce1d448) adding con mode: crc 2024-09-12T17:33:24.109 INFO:tasks.workunit.client.0.smithi037.stderr: -369> 2024-09-12T17:33:23.751+0000 7f638320e800 5 AuthRegistry(0x55f29ce1d448) adding con mode: secure 2024-09-12T17:33:24.109 INFO:tasks.workunit.client.0.smithi037.stderr: -368> 2024-09-12T17:33:23.751+0000 7f638320e800 5 AuthRegistry(0x55f29ce1d448) adding con mode: crc 2024-09-12T17:33:24.109 INFO:tasks.workunit.client.0.smithi037.stderr: -367> 2024-09-12T17:33:23.751+0000 7f638320e800 5 AuthRegistry(0x55f29ce1d448) adding con mode: secure 2024-09-12T17:33:24.109 INFO:tasks.workunit.client.0.smithi037.stderr: -366> 2024-09-12T17:33:23.751+0000 7f638320e800 5 AuthRegistry(0x55f29ce1d448) adding con mode: crc 2024-09-12T17:33:24.109 INFO:tasks.workunit.client.0.smithi037.stderr: -365> 2024-09-12T17:33:23.751+0000 7f638320e800 5 AuthRegistry(0x55f29ce1d448) adding con mode: secure 2024-09-12T17:33:24.109 INFO:tasks.workunit.client.0.smithi037.stderr: -364> 2024-09-12T17:33:23.751+0000 7f638320e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:33:24.109 INFO:tasks.workunit.client.0.smithi037.stderr: -363> 2024-09-12T17:33:23.751+0000 7f638320e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:33:24.109 INFO:tasks.workunit.client.0.smithi037.stderr: -362> 2024-09-12T17:33:23.751+0000 7f638320e800 5 asok(0x55f29cba7730) register_command rotate-key cmddesc rotate-key hook 0x55f29ce1d590 EEXIST 2024-09-12T17:33:24.110 INFO:tasks.workunit.client.0.smithi037.stderr: -361> 2024-09-12T17:33:23.751+0000 7f638320e800 10 monclient: _reopen_session rank -1 2024-09-12T17:33:24.110 INFO:tasks.workunit.client.0.smithi037.stderr: -360> 2024-09-12T17:33:23.751+0000 7f638320e800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T17:33:24.110 INFO:tasks.workunit.client.0.smithi037.stderr: -359> 2024-09-12T17:33:23.751+0000 7f638320e800 10 monclient(hunting): picked mon.noname-a con 0x55f29ce45aa0 addr [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] 2024-09-12T17:33:24.110 INFO:tasks.workunit.client.0.smithi037.stderr: -358> 2024-09-12T17:33:23.751+0000 7f638320e800 10 monclient(hunting): picked mon.noname-c con 0x55f29ce47d70 addr [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] 2024-09-12T17:33:24.110 INFO:tasks.workunit.client.0.smithi037.stderr: -357> 2024-09-12T17:33:23.751+0000 7f638320e800 10 monclient(hunting): picked mon.noname-b con 0x55f29ce44270 addr [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] 2024-09-12T17:33:24.110 INFO:tasks.workunit.client.0.smithi037.stderr: -356> 2024-09-12T17:33:23.751+0000 7f638320e800 10 monclient(hunting): start opening mon connection 2024-09-12T17:33:24.110 INFO:tasks.workunit.client.0.smithi037.stderr: -355> 2024-09-12T17:33:23.751+0000 7f638320e800 10 monclient(hunting): start opening mon connection 2024-09-12T17:33:24.111 INFO:tasks.workunit.client.0.smithi037.stderr: -354> 2024-09-12T17:33:23.751+0000 7f638320e800 10 monclient(hunting): start opening mon connection 2024-09-12T17:33:24.111 INFO:tasks.workunit.client.0.smithi037.stderr: -353> 2024-09-12T17:33:23.751+0000 7f638320e800 10 monclient(hunting): _renew_subs 2024-09-12T17:33:24.111 INFO:tasks.workunit.client.0.smithi037.stderr: -352> 2024-09-12T17:33:23.751+0000 7f638320e800 10 monclient(hunting): authenticate will time out at 2191.348653s 2024-09-12T17:33:24.111 INFO:tasks.workunit.client.0.smithi037.stderr: -351> 2024-09-12T17:33:23.751+0000 7f637e96b640 10 monclient(hunting): get_auth_request con 0x55f29ce45aa0 auth_method 0 2024-09-12T17:33:24.111 INFO:tasks.workunit.client.0.smithi037.stderr: -350> 2024-09-12T17:33:23.751+0000 7f637e96b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:33:24.111 INFO:tasks.workunit.client.0.smithi037.stderr: -349> 2024-09-12T17:33:23.751+0000 7f637e96b640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:33:24.111 INFO:tasks.workunit.client.0.smithi037.stderr: -348> 2024-09-12T17:33:23.751+0000 7f637e96b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:33:24.111 INFO:tasks.workunit.client.0.smithi037.stderr: -347> 2024-09-12T17:33:23.751+0000 7f637e16a640 10 monclient(hunting): get_auth_request con 0x55f29ce47d70 auth_method 0 2024-09-12T17:33:24.111 INFO:tasks.workunit.client.0.smithi037.stderr: -346> 2024-09-12T17:33:23.751+0000 7f637e16a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:33:24.111 INFO:tasks.workunit.client.0.smithi037.stderr: -345> 2024-09-12T17:33:23.751+0000 7f637e16a640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:33:24.111 INFO:tasks.workunit.client.0.smithi037.stderr: -344> 2024-09-12T17:33:23.751+0000 7f637e16a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:33:24.112 INFO:tasks.workunit.client.0.smithi037.stderr: -343> 2024-09-12T17:33:23.751+0000 7f637f16c640 10 monclient(hunting): get_auth_request con 0x55f29ce44270 auth_method 0 2024-09-12T17:33:24.112 INFO:tasks.workunit.client.0.smithi037.stderr: -342> 2024-09-12T17:33:23.751+0000 7f637f16c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:33:24.112 INFO:tasks.workunit.client.0.smithi037.stderr: -341> 2024-09-12T17:33:23.751+0000 7f637f16c640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:33:24.112 INFO:tasks.workunit.client.0.smithi037.stderr: -340> 2024-09-12T17:33:23.751+0000 7f637f16c640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:33:24.112 INFO:tasks.workunit.client.0.smithi037.stderr: -339> 2024-09-12T17:33:23.751+0000 7f637e96b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:33:24.112 INFO:tasks.workunit.client.0.smithi037.stderr: -338> 2024-09-12T17:33:23.751+0000 7f637e96b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:33:24.112 INFO:tasks.workunit.client.0.smithi037.stderr: -337> 2024-09-12T17:33:23.751+0000 7f637e96b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:33:24.112 INFO:tasks.workunit.client.0.smithi037.stderr: -336> 2024-09-12T17:33:23.751+0000 7f637e16a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:33:24.112 INFO:tasks.workunit.client.0.smithi037.stderr: -335> 2024-09-12T17:33:23.751+0000 7f637e16a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:33:24.112 INFO:tasks.workunit.client.0.smithi037.stderr: -334> 2024-09-12T17:33:23.751+0000 7f637e16a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:33:24.112 INFO:tasks.workunit.client.0.smithi037.stderr: -333> 2024-09-12T17:33:23.751+0000 7f637f16c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:33:24.112 INFO:tasks.workunit.client.0.smithi037.stderr: -332> 2024-09-12T17:33:23.751+0000 7f637f16c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:33:24.112 INFO:tasks.workunit.client.0.smithi037.stderr: -331> 2024-09-12T17:33:23.751+0000 7f637f16c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:33:24.112 INFO:tasks.workunit.client.0.smithi037.stderr: -330> 2024-09-12T17:33:23.752+0000 7f637e16a640 10 monclient(hunting): handle_auth_done global_id 6503 payload 824 2024-09-12T17:33:24.113 INFO:tasks.workunit.client.0.smithi037.stderr: -329> 2024-09-12T17:33:23.752+0000 7f637e16a640 10 monclient: _finish_hunting 0 2024-09-12T17:33:24.113 INFO:tasks.workunit.client.0.smithi037.stderr: -328> 2024-09-12T17:33:23.752+0000 7f637e16a640 1 monclient: found mon.noname-c 2024-09-12T17:33:24.113 INFO:tasks.workunit.client.0.smithi037.stderr: -327> 2024-09-12T17:33:23.752+0000 7f637e16a640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.37:3301/0 2024-09-12T17:33:24.113 INFO:tasks.workunit.client.0.smithi037.stderr: -326> 2024-09-12T17:33:23.752+0000 7f6268e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:33:24.113 INFO:tasks.workunit.client.0.smithi037.stderr: -325> 2024-09-12T17:33:23.752+0000 7f6268e01640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:33:24.113 INFO:tasks.workunit.client.0.smithi037.stderr: -324> 2024-09-12T17:33:23.752+0000 7f6268e01640 10 monclient: dump: 2024-09-12T17:33:24.113 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:33:24.113 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:33:24.113 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:33:24.113 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:33:24.113 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:33:24.113 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:33:24.113 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:33:24.113 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:33:24.114 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:33:24.114 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:33:24.114 INFO:tasks.workunit.client.0.smithi037.stderr: -323> 2024-09-12T17:33:23.752+0000 7f6268e01640 10 monclient: _finish_auth 0 2024-09-12T17:33:24.114 INFO:tasks.workunit.client.0.smithi037.stderr: -322> 2024-09-12T17:33:23.752+0000 7f6268e01640 10 monclient: _check_auth_tickets 2024-09-12T17:33:24.114 INFO:tasks.workunit.client.0.smithi037.stderr: -321> 2024-09-12T17:33:23.752+0000 7f6268e01640 10 monclient: handle_config config(0 keys) 2024-09-12T17:33:24.114 INFO:tasks.workunit.client.0.smithi037.stderr: -320> 2024-09-12T17:33:23.752+0000 7f6268e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:33:24.114 INFO:tasks.workunit.client.0.smithi037.stderr: -319> 2024-09-12T17:33:23.752+0000 7f6268e01640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:33:24.114 INFO:tasks.workunit.client.0.smithi037.stderr: -318> 2024-09-12T17:33:23.752+0000 7f6268e01640 10 monclient: dump: 2024-09-12T17:33:24.114 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:33:24.114 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:33:24.114 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:33:24.114 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:33:24.114 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:33:24.114 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:33:24.115 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:33:24.115 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:33:24.115 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:33:24.115 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:33:24.115 INFO:tasks.workunit.client.0.smithi037.stderr: -317> 2024-09-12T17:33:23.752+0000 7f638320e800 5 monclient: authenticate success, global_id 6503 2024-09-12T17:33:24.115 INFO:tasks.workunit.client.0.smithi037.stderr: -316> 2024-09-12T17:33:23.752+0000 7f638320e800 10 monclient: _renew_subs 2024-09-12T17:33:24.115 INFO:tasks.workunit.client.0.smithi037.stderr: -315> 2024-09-12T17:33:23.752+0000 7f638320e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.37:3301/0 2024-09-12T17:33:24.115 INFO:tasks.workunit.client.0.smithi037.stderr: -314> 2024-09-12T17:33:23.752+0000 7f637f96d640 4 set_mon_vals no callback set 2024-09-12T17:33:24.115 INFO:tasks.workunit.client.0.smithi037.stderr: -313> 2024-09-12T17:33:23.752+0000 7f638320e800 10 monclient: _renew_subs 2024-09-12T17:33:24.115 INFO:tasks.workunit.client.0.smithi037.stderr: -312> 2024-09-12T17:33:23.752+0000 7f638320e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.37:3301/0 2024-09-12T17:33:24.115 INFO:tasks.workunit.client.0.smithi037.stderr: -311> 2024-09-12T17:33:23.754+0000 7f6268e01640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:33:24.115 INFO:tasks.workunit.client.0.smithi037.stderr: -310> 2024-09-12T17:33:23.754+0000 7f6268e01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.40:6816/3916250676,v1:172.21.15.40:6817/3916250676] 2024-09-12T17:33:24.115 INFO:tasks.workunit.client.0.smithi037.stderr: -309> 2024-09-12T17:33:23.754+0000 7f6268e01640 4 mgrc reconnect Starting new session with [v2:172.21.15.40:6816/3916250676,v1:172.21.15.40:6817/3916250676] 2024-09-12T17:33:24.115 INFO:tasks.workunit.client.0.smithi037.stderr: -308> 2024-09-12T17:33:23.754+0000 7f637e96b640 10 monclient: get_auth_request con 0x7f6258076380 auth_method 0 2024-09-12T17:33:24.116 INFO:tasks.workunit.client.0.smithi037.stderr: -307> 2024-09-12T17:33:23.754+0000 7f638320e800 10 monclient: get_monmap_and_config 2024-09-12T17:33:24.116 INFO:tasks.workunit.client.0.smithi037.stderr: -306> 2024-09-12T17:33:23.754+0000 7f638320e800 10 monclient: build_initial_monmap 2024-09-12T17:33:24.116 INFO:tasks.workunit.client.0.smithi037.stderr: -305> 2024-09-12T17:33:23.754+0000 7f638320e800 1 build_initial for_mkfs: 0 2024-09-12T17:33:24.116 INFO:tasks.workunit.client.0.smithi037.stderr: -304> 2024-09-12T17:33:23.754+0000 7f638320e800 10 monclient: monmap: 2024-09-12T17:33:24.116 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 0 2024-09-12T17:33:24.116 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:33:24.116 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 0.000000 2024-09-12T17:33:24.116 INFO:tasks.workunit.client.0.smithi037.stderr:created 0.000000 2024-09-12T17:33:24.116 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 0 (unknown) 2024-09-12T17:33:24.116 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:33:24.116 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.noname-a 2024-09-12T17:33:24.116 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.noname-b 2024-09-12T17:33:24.116 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.noname-c 2024-09-12T17:33:24.117 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:33:24.117 INFO:tasks.workunit.client.0.smithi037.stderr: -303> 2024-09-12T17:33:23.754+0000 7f638320e800 5 AuthRegistry(0x55f29ce657e0) adding auth protocol: cephx 2024-09-12T17:33:24.117 INFO:tasks.workunit.client.0.smithi037.stderr: -302> 2024-09-12T17:33:23.754+0000 7f638320e800 5 AuthRegistry(0x55f29ce657e0) adding auth protocol: cephx 2024-09-12T17:33:24.117 INFO:tasks.workunit.client.0.smithi037.stderr: -301> 2024-09-12T17:33:23.754+0000 7f638320e800 5 AuthRegistry(0x55f29ce657e0) adding auth protocol: cephx 2024-09-12T17:33:24.117 INFO:tasks.workunit.client.0.smithi037.stderr: -300> 2024-09-12T17:33:23.754+0000 7f638320e800 5 AuthRegistry(0x55f29ce657e0) adding con mode: secure 2024-09-12T17:33:24.117 INFO:tasks.workunit.client.0.smithi037.stderr: -299> 2024-09-12T17:33:23.754+0000 7f638320e800 5 AuthRegistry(0x55f29ce657e0) adding con mode: crc 2024-09-12T17:33:24.117 INFO:tasks.workunit.client.0.smithi037.stderr: -298> 2024-09-12T17:33:23.754+0000 7f638320e800 5 AuthRegistry(0x55f29ce657e0) adding con mode: secure 2024-09-12T17:33:24.117 INFO:tasks.workunit.client.0.smithi037.stderr: -297> 2024-09-12T17:33:23.754+0000 7f638320e800 5 AuthRegistry(0x55f29ce657e0) adding con mode: crc 2024-09-12T17:33:24.117 INFO:tasks.workunit.client.0.smithi037.stderr: -296> 2024-09-12T17:33:23.754+0000 7f638320e800 5 AuthRegistry(0x55f29ce657e0) adding con mode: secure 2024-09-12T17:33:24.117 INFO:tasks.workunit.client.0.smithi037.stderr: -295> 2024-09-12T17:33:23.754+0000 7f638320e800 5 AuthRegistry(0x55f29ce657e0) adding con mode: crc 2024-09-12T17:33:24.117 INFO:tasks.workunit.client.0.smithi037.stderr: -294> 2024-09-12T17:33:23.754+0000 7f638320e800 5 AuthRegistry(0x55f29ce657e0) adding con mode: crc 2024-09-12T17:33:24.117 INFO:tasks.workunit.client.0.smithi037.stderr: -293> 2024-09-12T17:33:23.754+0000 7f638320e800 5 AuthRegistry(0x55f29ce657e0) adding con mode: secure 2024-09-12T17:33:24.118 INFO:tasks.workunit.client.0.smithi037.stderr: -292> 2024-09-12T17:33:23.754+0000 7f638320e800 5 AuthRegistry(0x55f29ce657e0) adding con mode: crc 2024-09-12T17:33:24.118 INFO:tasks.workunit.client.0.smithi037.stderr: -291> 2024-09-12T17:33:23.754+0000 7f638320e800 5 AuthRegistry(0x55f29ce657e0) adding con mode: secure 2024-09-12T17:33:24.118 INFO:tasks.workunit.client.0.smithi037.stderr: -290> 2024-09-12T17:33:23.754+0000 7f638320e800 5 AuthRegistry(0x55f29ce657e0) adding con mode: crc 2024-09-12T17:33:24.118 INFO:tasks.workunit.client.0.smithi037.stderr: -289> 2024-09-12T17:33:23.754+0000 7f638320e800 5 AuthRegistry(0x55f29ce657e0) adding con mode: secure 2024-09-12T17:33:24.118 INFO:tasks.workunit.client.0.smithi037.stderr: -288> 2024-09-12T17:33:23.755+0000 7f638320e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:33:24.118 INFO:tasks.workunit.client.0.smithi037.stderr: -287> 2024-09-12T17:33:23.755+0000 7f638320e800 10 monclient: init 2024-09-12T17:33:24.118 INFO:tasks.workunit.client.0.smithi037.stderr: -286> 2024-09-12T17:33:23.755+0000 7f638320e800 5 AuthRegistry(0x7ffcdf08f640) adding auth protocol: cephx 2024-09-12T17:33:24.118 INFO:tasks.workunit.client.0.smithi037.stderr: -285> 2024-09-12T17:33:23.755+0000 7f638320e800 5 AuthRegistry(0x7ffcdf08f640) adding auth protocol: cephx 2024-09-12T17:33:24.118 INFO:tasks.workunit.client.0.smithi037.stderr: -284> 2024-09-12T17:33:23.755+0000 7f638320e800 5 AuthRegistry(0x7ffcdf08f640) adding auth protocol: cephx 2024-09-12T17:33:24.118 INFO:tasks.workunit.client.0.smithi037.stderr: -283> 2024-09-12T17:33:23.755+0000 7f638320e800 5 AuthRegistry(0x7ffcdf08f640) adding con mode: secure 2024-09-12T17:33:24.118 INFO:tasks.workunit.client.0.smithi037.stderr: -282> 2024-09-12T17:33:23.755+0000 7f638320e800 5 AuthRegistry(0x7ffcdf08f640) adding con mode: crc 2024-09-12T17:33:24.118 INFO:tasks.workunit.client.0.smithi037.stderr: -281> 2024-09-12T17:33:23.755+0000 7f638320e800 5 AuthRegistry(0x7ffcdf08f640) adding con mode: secure 2024-09-12T17:33:24.118 INFO:tasks.workunit.client.0.smithi037.stderr: -280> 2024-09-12T17:33:23.755+0000 7f638320e800 5 AuthRegistry(0x7ffcdf08f640) adding con mode: crc 2024-09-12T17:33:24.118 INFO:tasks.workunit.client.0.smithi037.stderr: -279> 2024-09-12T17:33:23.755+0000 7f638320e800 5 AuthRegistry(0x7ffcdf08f640) adding con mode: secure 2024-09-12T17:33:24.119 INFO:tasks.workunit.client.0.smithi037.stderr: -278> 2024-09-12T17:33:23.755+0000 7f638320e800 5 AuthRegistry(0x7ffcdf08f640) adding con mode: crc 2024-09-12T17:33:24.119 INFO:tasks.workunit.client.0.smithi037.stderr: -277> 2024-09-12T17:33:23.755+0000 7f638320e800 5 AuthRegistry(0x7ffcdf08f640) adding con mode: crc 2024-09-12T17:33:24.119 INFO:tasks.workunit.client.0.smithi037.stderr: -276> 2024-09-12T17:33:23.755+0000 7f638320e800 5 AuthRegistry(0x7ffcdf08f640) adding con mode: secure 2024-09-12T17:33:24.119 INFO:tasks.workunit.client.0.smithi037.stderr: -275> 2024-09-12T17:33:23.755+0000 7f638320e800 5 AuthRegistry(0x7ffcdf08f640) adding con mode: crc 2024-09-12T17:33:24.119 INFO:tasks.workunit.client.0.smithi037.stderr: -274> 2024-09-12T17:33:23.755+0000 7f638320e800 5 AuthRegistry(0x7ffcdf08f640) adding con mode: secure 2024-09-12T17:33:24.119 INFO:tasks.workunit.client.0.smithi037.stderr: -273> 2024-09-12T17:33:23.755+0000 7f638320e800 5 AuthRegistry(0x7ffcdf08f640) adding con mode: crc 2024-09-12T17:33:24.119 INFO:tasks.workunit.client.0.smithi037.stderr: -272> 2024-09-12T17:33:23.755+0000 7f638320e800 5 AuthRegistry(0x7ffcdf08f640) adding con mode: secure 2024-09-12T17:33:24.119 INFO:tasks.workunit.client.0.smithi037.stderr: -271> 2024-09-12T17:33:23.755+0000 7f638320e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:33:24.119 INFO:tasks.workunit.client.0.smithi037.stderr: -270> 2024-09-12T17:33:23.755+0000 7f638320e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:33:24.119 INFO:tasks.workunit.client.0.smithi037.stderr: -269> 2024-09-12T17:33:23.755+0000 7f638320e800 5 asok(0x55f29cba7730) register_command rotate-key cmddesc rotate-key hook 0x7ffcdf08f788 EEXIST 2024-09-12T17:33:24.119 INFO:tasks.workunit.client.0.smithi037.stderr: -268> 2024-09-12T17:33:23.755+0000 7f638320e800 10 monclient: _reopen_session rank -1 2024-09-12T17:33:24.119 INFO:tasks.workunit.client.0.smithi037.stderr: -267> 2024-09-12T17:33:23.755+0000 7f638320e800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T17:33:24.119 INFO:tasks.workunit.client.0.smithi037.stderr: -266> 2024-09-12T17:33:23.755+0000 7f638320e800 10 monclient(hunting): picked mon.noname-c con 0x55f29ce99d30 addr [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] 2024-09-12T17:33:24.120 INFO:tasks.workunit.client.0.smithi037.stderr: -265> 2024-09-12T17:33:23.755+0000 7f638320e800 10 monclient(hunting): picked mon.noname-b con 0x55f29ce69890 addr [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] 2024-09-12T17:33:24.120 INFO:tasks.workunit.client.0.smithi037.stderr: -264> 2024-09-12T17:33:23.755+0000 7f638320e800 10 monclient(hunting): picked mon.noname-a con 0x55f29ce667c0 addr [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] 2024-09-12T17:33:24.120 INFO:tasks.workunit.client.0.smithi037.stderr: -263> 2024-09-12T17:33:23.755+0000 7f638320e800 10 monclient(hunting): start opening mon connection 2024-09-12T17:33:24.120 INFO:tasks.workunit.client.0.smithi037.stderr: -262> 2024-09-12T17:33:23.755+0000 7f638320e800 10 monclient(hunting): start opening mon connection 2024-09-12T17:33:24.120 INFO:tasks.workunit.client.0.smithi037.stderr: -261> 2024-09-12T17:33:23.755+0000 7f638320e800 10 monclient(hunting): start opening mon connection 2024-09-12T17:33:24.120 INFO:tasks.workunit.client.0.smithi037.stderr: -260> 2024-09-12T17:33:23.755+0000 7f638320e800 10 monclient(hunting): _renew_subs 2024-09-12T17:33:24.120 INFO:tasks.workunit.client.0.smithi037.stderr: -259> 2024-09-12T17:33:23.755+0000 7f638320e800 10 monclient(hunting): authenticate will time out at 2191.352724s 2024-09-12T17:33:24.120 INFO:tasks.workunit.client.0.smithi037.stderr: -258> 2024-09-12T17:33:23.755+0000 7f637e96b640 10 monclient(hunting): get_auth_request con 0x55f29ce99d30 auth_method 0 2024-09-12T17:33:24.120 INFO:tasks.workunit.client.0.smithi037.stderr: -257> 2024-09-12T17:33:23.755+0000 7f637e96b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:33:24.120 INFO:tasks.workunit.client.0.smithi037.stderr: -256> 2024-09-12T17:33:23.755+0000 7f637e96b640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:33:24.120 INFO:tasks.workunit.client.0.smithi037.stderr: -255> 2024-09-12T17:33:23.755+0000 7f637e96b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:33:24.120 INFO:tasks.workunit.client.0.smithi037.stderr: -254> 2024-09-12T17:33:23.755+0000 7f637f16c640 10 monclient(hunting): get_auth_request con 0x55f29ce667c0 auth_method 0 2024-09-12T17:33:24.121 INFO:tasks.workunit.client.0.smithi037.stderr: -253> 2024-09-12T17:33:23.755+0000 7f637f16c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:33:24.121 INFO:tasks.workunit.client.0.smithi037.stderr: -252> 2024-09-12T17:33:23.755+0000 7f637f16c640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:33:24.121 INFO:tasks.workunit.client.0.smithi037.stderr: -251> 2024-09-12T17:33:23.755+0000 7f637f16c640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:33:24.121 INFO:tasks.workunit.client.0.smithi037.stderr: -250> 2024-09-12T17:33:23.755+0000 7f637e16a640 10 monclient(hunting): get_auth_request con 0x55f29ce69890 auth_method 0 2024-09-12T17:33:24.121 INFO:tasks.workunit.client.0.smithi037.stderr: -249> 2024-09-12T17:33:23.755+0000 7f637e16a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:33:24.121 INFO:tasks.workunit.client.0.smithi037.stderr: -248> 2024-09-12T17:33:23.755+0000 7f637e16a640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:33:24.121 INFO:tasks.workunit.client.0.smithi037.stderr: -247> 2024-09-12T17:33:23.755+0000 7f637e16a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:33:24.121 INFO:tasks.workunit.client.0.smithi037.stderr: -246> 2024-09-12T17:33:23.755+0000 7f637e96b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:33:24.121 INFO:tasks.workunit.client.0.smithi037.stderr: -245> 2024-09-12T17:33:23.755+0000 7f637e96b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:33:24.121 INFO:tasks.workunit.client.0.smithi037.stderr: -244> 2024-09-12T17:33:23.755+0000 7f637e96b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:33:24.121 INFO:tasks.workunit.client.0.smithi037.stderr: -243> 2024-09-12T17:33:23.755+0000 7f637f16c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:33:24.121 INFO:tasks.workunit.client.0.smithi037.stderr: -242> 2024-09-12T17:33:23.755+0000 7f637f16c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:33:24.121 INFO:tasks.workunit.client.0.smithi037.stderr: -241> 2024-09-12T17:33:23.755+0000 7f637f16c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:33:24.121 INFO:tasks.workunit.client.0.smithi037.stderr: -240> 2024-09-12T17:33:23.755+0000 7f637e16a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:33:24.122 INFO:tasks.workunit.client.0.smithi037.stderr: -239> 2024-09-12T17:33:23.755+0000 7f637e16a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:33:24.122 INFO:tasks.workunit.client.0.smithi037.stderr: -238> 2024-09-12T17:33:23.755+0000 7f637e16a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:33:24.122 INFO:tasks.workunit.client.0.smithi037.stderr: -237> 2024-09-12T17:33:23.756+0000 7f637e96b640 10 monclient(hunting): handle_auth_done global_id 6506 payload 274 2024-09-12T17:33:24.122 INFO:tasks.workunit.client.0.smithi037.stderr: -236> 2024-09-12T17:33:23.756+0000 7f637e96b640 10 monclient: _finish_hunting 0 2024-09-12T17:33:24.122 INFO:tasks.workunit.client.0.smithi037.stderr: -235> 2024-09-12T17:33:23.756+0000 7f637e96b640 1 monclient: found mon.noname-c 2024-09-12T17:33:24.122 INFO:tasks.workunit.client.0.smithi037.stderr: -234> 2024-09-12T17:33:23.756+0000 7f637e96b640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.37:3301/0 2024-09-12T17:33:24.122 INFO:tasks.workunit.client.0.smithi037.stderr: -233> 2024-09-12T17:33:23.756+0000 7f62627fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:33:24.122 INFO:tasks.workunit.client.0.smithi037.stderr: -232> 2024-09-12T17:33:23.756+0000 7f62627fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:33:24.122 INFO:tasks.workunit.client.0.smithi037.stderr: -231> 2024-09-12T17:33:23.756+0000 7f62627fc640 10 monclient: dump: 2024-09-12T17:33:24.122 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:33:24.122 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:33:24.122 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:33:24.123 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:33:24.123 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:33:24.123 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:33:24.123 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:33:24.123 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:33:24.123 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:33:24.123 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:33:24.123 INFO:tasks.workunit.client.0.smithi037.stderr: -230> 2024-09-12T17:33:23.756+0000 7f62627fc640 10 monclient: _finish_auth 0 2024-09-12T17:33:24.123 INFO:tasks.workunit.client.0.smithi037.stderr: -229> 2024-09-12T17:33:23.756+0000 7f62627fc640 10 monclient: _check_auth_tickets 2024-09-12T17:33:24.123 INFO:tasks.workunit.client.0.smithi037.stderr: -228> 2024-09-12T17:33:23.756+0000 7f62627fc640 10 monclient: handle_config config(0 keys) 2024-09-12T17:33:24.123 INFO:tasks.workunit.client.0.smithi037.stderr: -227> 2024-09-12T17:33:23.756+0000 7f638320e800 5 monclient: authenticate success, global_id 6506 2024-09-12T17:33:24.123 INFO:tasks.workunit.client.0.smithi037.stderr: -226> 2024-09-12T17:33:23.756+0000 7f638320e800 10 monclient: get_monmap_and_config success 2024-09-12T17:33:24.123 INFO:tasks.workunit.client.0.smithi037.stderr: -225> 2024-09-12T17:33:23.756+0000 7f638320e800 4 set_mon_vals no callback set 2024-09-12T17:33:24.123 INFO:tasks.workunit.client.0.smithi037.stderr: -224> 2024-09-12T17:33:23.756+0000 7f62627fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:33:24.124 INFO:tasks.workunit.client.0.smithi037.stderr: -223> 2024-09-12T17:33:23.756+0000 7f62627fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:33:24.124 INFO:tasks.workunit.client.0.smithi037.stderr: -222> 2024-09-12T17:33:23.756+0000 7f62627fc640 10 monclient: dump: 2024-09-12T17:33:24.124 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:33:24.124 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:33:24.124 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:33:24.124 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:33:24.124 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:33:24.124 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:33:24.124 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:33:24.124 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:33:24.124 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:33:24.124 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:33:24.124 INFO:tasks.workunit.client.0.smithi037.stderr: -221> 2024-09-12T17:33:23.756+0000 7f638320e800 10 monclient: shutdown 2024-09-12T17:33:24.125 INFO:tasks.workunit.client.0.smithi037.stderr: -220> 2024-09-12T17:33:23.756+0000 7f638320e800 10 monclient: build_initial_monmap 2024-09-12T17:33:24.125 INFO:tasks.workunit.client.0.smithi037.stderr: -219> 2024-09-12T17:33:23.756+0000 7f638320e800 1 build_initial for_mkfs: 0 2024-09-12T17:33:24.125 INFO:tasks.workunit.client.0.smithi037.stderr: -218> 2024-09-12T17:33:23.756+0000 7f638320e800 10 monclient: monmap: 2024-09-12T17:33:24.125 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 0 2024-09-12T17:33:24.125 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:33:24.125 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 0.000000 2024-09-12T17:33:24.125 INFO:tasks.workunit.client.0.smithi037.stderr:created 0.000000 2024-09-12T17:33:24.125 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 0 (unknown) 2024-09-12T17:33:24.125 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:33:24.125 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.noname-a 2024-09-12T17:33:24.125 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.noname-b 2024-09-12T17:33:24.125 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.noname-c 2024-09-12T17:33:24.125 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:33:24.126 INFO:tasks.workunit.client.0.smithi037.stderr: -217> 2024-09-12T17:33:23.756+0000 7f638320e800 5 AuthRegistry(0x55f29ce6a8b0) adding auth protocol: cephx 2024-09-12T17:33:24.126 INFO:tasks.workunit.client.0.smithi037.stderr: -216> 2024-09-12T17:33:23.756+0000 7f638320e800 5 AuthRegistry(0x55f29ce6a8b0) adding auth protocol: cephx 2024-09-12T17:33:24.126 INFO:tasks.workunit.client.0.smithi037.stderr: -215> 2024-09-12T17:33:23.756+0000 7f638320e800 5 AuthRegistry(0x55f29ce6a8b0) adding auth protocol: cephx 2024-09-12T17:33:24.126 INFO:tasks.workunit.client.0.smithi037.stderr: -214> 2024-09-12T17:33:23.756+0000 7f638320e800 5 AuthRegistry(0x55f29ce6a8b0) adding con mode: secure 2024-09-12T17:33:24.126 INFO:tasks.workunit.client.0.smithi037.stderr: -213> 2024-09-12T17:33:23.756+0000 7f638320e800 5 AuthRegistry(0x55f29ce6a8b0) adding con mode: crc 2024-09-12T17:33:24.126 INFO:tasks.workunit.client.0.smithi037.stderr: -212> 2024-09-12T17:33:23.756+0000 7f638320e800 5 AuthRegistry(0x55f29ce6a8b0) adding con mode: secure 2024-09-12T17:33:24.126 INFO:tasks.workunit.client.0.smithi037.stderr: -211> 2024-09-12T17:33:23.756+0000 7f638320e800 5 AuthRegistry(0x55f29ce6a8b0) adding con mode: crc 2024-09-12T17:33:24.126 INFO:tasks.workunit.client.0.smithi037.stderr: -210> 2024-09-12T17:33:23.756+0000 7f638320e800 5 AuthRegistry(0x55f29ce6a8b0) adding con mode: secure 2024-09-12T17:33:24.126 INFO:tasks.workunit.client.0.smithi037.stderr: -209> 2024-09-12T17:33:23.756+0000 7f638320e800 5 AuthRegistry(0x55f29ce6a8b0) adding con mode: crc 2024-09-12T17:33:24.126 INFO:tasks.workunit.client.0.smithi037.stderr: -208> 2024-09-12T17:33:23.757+0000 7f638320e800 5 AuthRegistry(0x55f29ce6a8b0) adding con mode: crc 2024-09-12T17:33:24.126 INFO:tasks.workunit.client.0.smithi037.stderr: -207> 2024-09-12T17:33:23.757+0000 7f638320e800 5 AuthRegistry(0x55f29ce6a8b0) adding con mode: secure 2024-09-12T17:33:24.126 INFO:tasks.workunit.client.0.smithi037.stderr: -206> 2024-09-12T17:33:23.757+0000 7f638320e800 5 AuthRegistry(0x55f29ce6a8b0) adding con mode: crc 2024-09-12T17:33:24.126 INFO:tasks.workunit.client.0.smithi037.stderr: -205> 2024-09-12T17:33:23.757+0000 7f638320e800 5 AuthRegistry(0x55f29ce6a8b0) adding con mode: secure 2024-09-12T17:33:24.126 INFO:tasks.workunit.client.0.smithi037.stderr: -204> 2024-09-12T17:33:23.757+0000 7f638320e800 5 AuthRegistry(0x55f29ce6a8b0) adding con mode: crc 2024-09-12T17:33:24.127 INFO:tasks.workunit.client.0.smithi037.stderr: -203> 2024-09-12T17:33:23.757+0000 7f638320e800 5 AuthRegistry(0x55f29ce6a8b0) adding con mode: secure 2024-09-12T17:33:24.127 INFO:tasks.workunit.client.0.smithi037.stderr: -202> 2024-09-12T17:33:23.757+0000 7f638320e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:33:24.127 INFO:tasks.workunit.client.0.smithi037.stderr: -201> 2024-09-12T17:33:23.757+0000 7f638320e800 1 librados: starting msgr at 2024-09-12T17:33:24.127 INFO:tasks.workunit.client.0.smithi037.stderr: -200> 2024-09-12T17:33:23.757+0000 7f638320e800 1 librados: starting objecter 2024-09-12T17:33:24.127 INFO:tasks.workunit.client.0.smithi037.stderr: -199> 2024-09-12T17:33:23.757+0000 7f638320e800 5 asok(0x55f29cba7730) register_command objecter_requests cmddesc objecter_requests hook 0x55f29ce8c970 EEXIST 2024-09-12T17:33:24.127 INFO:tasks.workunit.client.0.smithi037.stderr: -198> 2024-09-12T17:33:23.757+0000 7f638320e800 1 librados: setting wanted keys 2024-09-12T17:33:24.127 INFO:tasks.workunit.client.0.smithi037.stderr: -197> 2024-09-12T17:33:23.757+0000 7f638320e800 1 librados: calling monclient init 2024-09-12T17:33:24.127 INFO:tasks.workunit.client.0.smithi037.stderr: -196> 2024-09-12T17:33:23.757+0000 7f638320e800 10 monclient: init 2024-09-12T17:33:24.127 INFO:tasks.workunit.client.0.smithi037.stderr: -195> 2024-09-12T17:33:23.757+0000 7f638320e800 5 AuthRegistry(0x55f29ce5d850) adding auth protocol: cephx 2024-09-12T17:33:24.127 INFO:tasks.workunit.client.0.smithi037.stderr: -194> 2024-09-12T17:33:23.757+0000 7f638320e800 5 AuthRegistry(0x55f29ce5d850) adding auth protocol: cephx 2024-09-12T17:33:24.127 INFO:tasks.workunit.client.0.smithi037.stderr: -193> 2024-09-12T17:33:23.757+0000 7f638320e800 5 AuthRegistry(0x55f29ce5d850) adding auth protocol: cephx 2024-09-12T17:33:24.127 INFO:tasks.workunit.client.0.smithi037.stderr: -192> 2024-09-12T17:33:23.757+0000 7f638320e800 5 AuthRegistry(0x55f29ce5d850) adding con mode: secure 2024-09-12T17:33:24.127 INFO:tasks.workunit.client.0.smithi037.stderr: -191> 2024-09-12T17:33:23.757+0000 7f638320e800 5 AuthRegistry(0x55f29ce5d850) adding con mode: crc 2024-09-12T17:33:24.127 INFO:tasks.workunit.client.0.smithi037.stderr: -190> 2024-09-12T17:33:23.757+0000 7f638320e800 5 AuthRegistry(0x55f29ce5d850) adding con mode: secure 2024-09-12T17:33:24.127 INFO:tasks.workunit.client.0.smithi037.stderr: -189> 2024-09-12T17:33:23.757+0000 7f638320e800 5 AuthRegistry(0x55f29ce5d850) adding con mode: crc 2024-09-12T17:33:24.128 INFO:tasks.workunit.client.0.smithi037.stderr: -188> 2024-09-12T17:33:23.757+0000 7f638320e800 5 AuthRegistry(0x55f29ce5d850) adding con mode: secure 2024-09-12T17:33:24.128 INFO:tasks.workunit.client.0.smithi037.stderr: -187> 2024-09-12T17:33:23.757+0000 7f638320e800 5 AuthRegistry(0x55f29ce5d850) adding con mode: crc 2024-09-12T17:33:24.128 INFO:tasks.workunit.client.0.smithi037.stderr: -186> 2024-09-12T17:33:23.757+0000 7f638320e800 5 AuthRegistry(0x55f29ce5d850) adding con mode: crc 2024-09-12T17:33:24.128 INFO:tasks.workunit.client.0.smithi037.stderr: -185> 2024-09-12T17:33:23.757+0000 7f638320e800 5 AuthRegistry(0x55f29ce5d850) adding con mode: secure 2024-09-12T17:33:24.128 INFO:tasks.workunit.client.0.smithi037.stderr: -184> 2024-09-12T17:33:23.757+0000 7f638320e800 5 AuthRegistry(0x55f29ce5d850) adding con mode: crc 2024-09-12T17:33:24.128 INFO:tasks.workunit.client.0.smithi037.stderr: -183> 2024-09-12T17:33:23.757+0000 7f638320e800 5 AuthRegistry(0x55f29ce5d850) adding con mode: secure 2024-09-12T17:33:24.128 INFO:tasks.workunit.client.0.smithi037.stderr: -182> 2024-09-12T17:33:23.757+0000 7f638320e800 5 AuthRegistry(0x55f29ce5d850) adding con mode: crc 2024-09-12T17:33:24.128 INFO:tasks.workunit.client.0.smithi037.stderr: -181> 2024-09-12T17:33:23.757+0000 7f638320e800 5 AuthRegistry(0x55f29ce5d850) adding con mode: secure 2024-09-12T17:33:24.128 INFO:tasks.workunit.client.0.smithi037.stderr: -180> 2024-09-12T17:33:23.757+0000 7f638320e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:33:24.128 INFO:tasks.workunit.client.0.smithi037.stderr: -179> 2024-09-12T17:33:23.757+0000 7f638320e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:33:24.128 INFO:tasks.workunit.client.0.smithi037.stderr: -178> 2024-09-12T17:33:23.757+0000 7f638320e800 5 asok(0x55f29cba7730) register_command rotate-key cmddesc rotate-key hook 0x55f29ce5d998 EEXIST 2024-09-12T17:33:24.128 INFO:tasks.workunit.client.0.smithi037.stderr: -177> 2024-09-12T17:33:23.757+0000 7f638320e800 10 monclient: _reopen_session rank -1 2024-09-12T17:33:24.128 INFO:tasks.workunit.client.0.smithi037.stderr: -176> 2024-09-12T17:33:23.757+0000 7f638320e800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T17:33:24.129 INFO:tasks.workunit.client.0.smithi037.stderr: -175> 2024-09-12T17:33:23.757+0000 7f638320e800 10 monclient(hunting): picked mon.noname-b con 0x55f29ce667c0 addr [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] 2024-09-12T17:33:24.129 INFO:tasks.workunit.client.0.smithi037.stderr: -174> 2024-09-12T17:33:23.757+0000 7f638320e800 10 monclient(hunting): picked mon.noname-a con 0x55f29ce69890 addr [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] 2024-09-12T17:33:24.129 INFO:tasks.workunit.client.0.smithi037.stderr: -173> 2024-09-12T17:33:23.757+0000 7f638320e800 10 monclient(hunting): picked mon.noname-c con 0x55f29ce99d30 addr [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] 2024-09-12T17:33:24.129 INFO:tasks.workunit.client.0.smithi037.stderr: -172> 2024-09-12T17:33:23.757+0000 7f638320e800 10 monclient(hunting): start opening mon connection 2024-09-12T17:33:24.129 INFO:tasks.workunit.client.0.smithi037.stderr: -171> 2024-09-12T17:33:23.757+0000 7f638320e800 10 monclient(hunting): start opening mon connection 2024-09-12T17:33:24.129 INFO:tasks.workunit.client.0.smithi037.stderr: -170> 2024-09-12T17:33:23.757+0000 7f638320e800 10 monclient(hunting): start opening mon connection 2024-09-12T17:33:24.129 INFO:tasks.workunit.client.0.smithi037.stderr: -169> 2024-09-12T17:33:23.757+0000 7f638320e800 10 monclient(hunting): _renew_subs 2024-09-12T17:33:24.129 INFO:tasks.workunit.client.0.smithi037.stderr: -168> 2024-09-12T17:33:23.757+0000 7f638320e800 10 monclient(hunting): authenticate will time out at 2191.354958s 2024-09-12T17:33:24.129 INFO:tasks.workunit.client.0.smithi037.stderr: -167> 2024-09-12T17:33:23.758+0000 7f637e16a640 10 monclient(hunting): get_auth_request con 0x55f29ce69890 auth_method 0 2024-09-12T17:33:24.129 INFO:tasks.workunit.client.0.smithi037.stderr: -166> 2024-09-12T17:33:23.758+0000 7f637e16a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:33:24.129 INFO:tasks.workunit.client.0.smithi037.stderr: -165> 2024-09-12T17:33:23.758+0000 7f637e16a640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:33:24.129 INFO:tasks.workunit.client.0.smithi037.stderr: -164> 2024-09-12T17:33:23.758+0000 7f637e16a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:33:24.129 INFO:tasks.workunit.client.0.smithi037.stderr: -163> 2024-09-12T17:33:23.758+0000 7f637f16c640 10 monclient(hunting): get_auth_request con 0x55f29ce99d30 auth_method 0 2024-09-12T17:33:24.129 INFO:tasks.workunit.client.0.smithi037.stderr: -162> 2024-09-12T17:33:23.758+0000 7f637f16c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:33:24.130 INFO:tasks.workunit.client.0.smithi037.stderr: -161> 2024-09-12T17:33:23.758+0000 7f637f16c640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:33:24.130 INFO:tasks.workunit.client.0.smithi037.stderr: -160> 2024-09-12T17:33:23.758+0000 7f637f16c640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:33:24.130 INFO:tasks.workunit.client.0.smithi037.stderr: -159> 2024-09-12T17:33:23.758+0000 7f637e96b640 10 monclient(hunting): get_auth_request con 0x55f29ce667c0 auth_method 0 2024-09-12T17:33:24.130 INFO:tasks.workunit.client.0.smithi037.stderr: -158> 2024-09-12T17:33:23.758+0000 7f637e96b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:33:24.130 INFO:tasks.workunit.client.0.smithi037.stderr: -157> 2024-09-12T17:33:23.758+0000 7f637e96b640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:33:24.130 INFO:tasks.workunit.client.0.smithi037.stderr: -156> 2024-09-12T17:33:23.758+0000 7f637e96b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:33:24.130 INFO:tasks.workunit.client.0.smithi037.stderr: -155> 2024-09-12T17:33:23.758+0000 7f637e16a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:33:24.130 INFO:tasks.workunit.client.0.smithi037.stderr: -154> 2024-09-12T17:33:23.758+0000 7f637e16a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:33:24.130 INFO:tasks.workunit.client.0.smithi037.stderr: -153> 2024-09-12T17:33:23.758+0000 7f637e16a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:33:24.130 INFO:tasks.workunit.client.0.smithi037.stderr: -152> 2024-09-12T17:33:23.758+0000 7f637f16c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:33:24.130 INFO:tasks.workunit.client.0.smithi037.stderr: -151> 2024-09-12T17:33:23.758+0000 7f637f16c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:33:24.130 INFO:tasks.workunit.client.0.smithi037.stderr: -150> 2024-09-12T17:33:23.758+0000 7f637f16c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:33:24.130 INFO:tasks.workunit.client.0.smithi037.stderr: -149> 2024-09-12T17:33:23.758+0000 7f637e96b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:33:24.130 INFO:tasks.workunit.client.0.smithi037.stderr: -148> 2024-09-12T17:33:23.758+0000 7f637e96b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:33:24.131 INFO:tasks.workunit.client.0.smithi037.stderr: -147> 2024-09-12T17:33:23.758+0000 7f637e96b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:33:24.131 INFO:tasks.workunit.client.0.smithi037.stderr: -146> 2024-09-12T17:33:23.758+0000 7f637e16a640 10 monclient(hunting): handle_auth_done global_id 6924 payload 824 2024-09-12T17:33:24.131 INFO:tasks.workunit.client.0.smithi037.stderr: -145> 2024-09-12T17:33:23.758+0000 7f637e16a640 10 monclient: _finish_hunting 0 2024-09-12T17:33:24.131 INFO:tasks.workunit.client.0.smithi037.stderr: -144> 2024-09-12T17:33:23.758+0000 7f637e16a640 1 monclient: found mon.noname-a 2024-09-12T17:33:24.131 INFO:tasks.workunit.client.0.smithi037.stderr: -143> 2024-09-12T17:33:23.758+0000 7f637e16a640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.37:3300/0 2024-09-12T17:33:24.131 INFO:tasks.workunit.client.0.smithi037.stderr: -142> 2024-09-12T17:33:23.758+0000 7f6260ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:33:24.131 INFO:tasks.workunit.client.0.smithi037.stderr: -141> 2024-09-12T17:33:23.758+0000 7f6260ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:33:24.131 INFO:tasks.workunit.client.0.smithi037.stderr: -140> 2024-09-12T17:33:23.758+0000 7f6260ff9640 10 monclient: dump: 2024-09-12T17:33:24.131 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:33:24.131 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:33:24.131 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:33:24.131 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:33:24.131 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:33:24.131 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:33:24.132 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:33:24.132 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:33:24.132 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:33:24.132 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:33:24.132 INFO:tasks.workunit.client.0.smithi037.stderr: -139> 2024-09-12T17:33:23.758+0000 7f6260ff9640 10 monclient: _finish_auth 0 2024-09-12T17:33:24.132 INFO:tasks.workunit.client.0.smithi037.stderr: -138> 2024-09-12T17:33:23.758+0000 7f6260ff9640 10 monclient: _check_auth_tickets 2024-09-12T17:33:24.132 INFO:tasks.workunit.client.0.smithi037.stderr: -137> 2024-09-12T17:33:23.758+0000 7f6260ff9640 10 monclient: handle_config config(0 keys) 2024-09-12T17:33:24.132 INFO:tasks.workunit.client.0.smithi037.stderr: -136> 2024-09-12T17:33:23.758+0000 7f6260ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:33:24.132 INFO:tasks.workunit.client.0.smithi037.stderr: -135> 2024-09-12T17:33:23.758+0000 7f6260ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:33:24.132 INFO:tasks.workunit.client.0.smithi037.stderr: -134> 2024-09-12T17:33:23.758+0000 7f6260ff9640 10 monclient: dump: 2024-09-12T17:33:24.132 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:33:24.132 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:33:24.133 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:33:24.133 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:33:24.133 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:33:24.133 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:33:24.133 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:33:24.133 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:33:24.133 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:33:24.133 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:33:24.133 INFO:tasks.workunit.client.0.smithi037.stderr: -133> 2024-09-12T17:33:23.758+0000 7f638320e800 5 monclient: authenticate success, global_id 6924 2024-09-12T17:33:24.133 INFO:tasks.workunit.client.0.smithi037.stderr: -132> 2024-09-12T17:33:23.758+0000 7f62627fc640 4 set_mon_vals no callback set 2024-09-12T17:33:24.134 INFO:tasks.workunit.client.0.smithi037.stderr: -131> 2024-09-12T17:33:23.758+0000 7f638320e800 10 monclient: _renew_subs 2024-09-12T17:33:24.134 INFO:tasks.workunit.client.0.smithi037.stderr: -130> 2024-09-12T17:33:23.758+0000 7f638320e800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.37:3300/0 2024-09-12T17:33:24.134 INFO:tasks.workunit.client.0.smithi037.stderr: -129> 2024-09-12T17:33:23.758+0000 7f638320e800 10 monclient: _renew_subs 2024-09-12T17:33:24.134 INFO:tasks.workunit.client.0.smithi037.stderr: -128> 2024-09-12T17:33:23.758+0000 7f638320e800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.37:3300/0 2024-09-12T17:33:24.134 INFO:tasks.workunit.client.0.smithi037.stderr: -127> 2024-09-12T17:33:23.758+0000 7f638320e800 1 librados: init done 2024-09-12T17:33:24.134 INFO:tasks.workunit.client.0.smithi037.stderr: -126> 2024-09-12T17:33:23.758+0000 7f638320e800 5 asok(0x55f29cba7730) register_command cr dump hook 0x55f29ce89f78 2024-09-12T17:33:24.134 INFO:tasks.workunit.client.0.smithi037.stderr: -125> 2024-09-12T17:33:23.760+0000 7f638320e800 20 rados->read ofs=0 len=0 2024-09-12T17:33:24.134 INFO:tasks.workunit.client.0.smithi037.stderr: -124> 2024-09-12T17:33:23.760+0000 7f6260ff9640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:33:24.134 INFO:tasks.workunit.client.0.smithi037.stderr: -123> 2024-09-12T17:33:23.760+0000 7f6260ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.40:6816/3916250676,v1:172.21.15.40:6817/3916250676] 2024-09-12T17:33:24.134 INFO:tasks.workunit.client.0.smithi037.stderr: -122> 2024-09-12T17:33:23.760+0000 7f6260ff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.40:6816/3916250676,v1:172.21.15.40:6817/3916250676] 2024-09-12T17:33:24.134 INFO:tasks.workunit.client.0.smithi037.stderr: -121> 2024-09-12T17:33:23.760+0000 7f637e96b640 10 monclient: get_auth_request con 0x7f6248076470 auth_method 0 2024-09-12T17:33:24.134 INFO:tasks.workunit.client.0.smithi037.stderr: -120> 2024-09-12T17:33:23.761+0000 7f637f16c640 10 monclient: get_auth_request con 0x55f29ceb41e0 auth_method 0 2024-09-12T17:33:24.134 INFO:tasks.workunit.client.0.smithi037.stderr: -119> 2024-09-12T17:33:23.761+0000 7f638320e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:24.134 INFO:tasks.workunit.client.0.smithi037.stderr: -118> 2024-09-12T17:33:23.761+0000 7f638320e800 20 realm 2024-09-12T17:33:24.135 INFO:tasks.workunit.client.0.smithi037.stderr: -117> 2024-09-12T17:33:23.761+0000 7f638320e800 20 rados->read ofs=0 len=0 2024-09-12T17:33:24.135 INFO:tasks.workunit.client.0.smithi037.stderr: -116> 2024-09-12T17:33:23.761+0000 7f638320e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:24.135 INFO:tasks.workunit.client.0.smithi037.stderr: -115> 2024-09-12T17:33:23.761+0000 7f638320e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:33:24.135 INFO:tasks.workunit.client.0.smithi037.stderr: -114> 2024-09-12T17:33:23.761+0000 7f638320e800 20 rados->read ofs=0 len=0 2024-09-12T17:33:24.135 INFO:tasks.workunit.client.0.smithi037.stderr: -113> 2024-09-12T17:33:23.761+0000 7f638320e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:24.135 INFO:tasks.workunit.client.0.smithi037.stderr: -112> 2024-09-12T17:33:23.761+0000 7f638320e800 20 rados->read ofs=0 len=0 2024-09-12T17:33:24.135 INFO:tasks.workunit.client.0.smithi037.stderr: -111> 2024-09-12T17:33:23.762+0000 7f637e96b640 10 monclient: get_auth_request con 0x55f29ceb85a0 auth_method 0 2024-09-12T17:33:24.135 INFO:tasks.workunit.client.0.smithi037.stderr: -110> 2024-09-12T17:33:23.762+0000 7f638320e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:33:24.135 INFO:tasks.workunit.client.0.smithi037.stderr: -109> 2024-09-12T17:33:23.762+0000 7f638320e800 20 rados->read ofs=0 len=0 2024-09-12T17:33:24.135 INFO:tasks.workunit.client.0.smithi037.stderr: -108> 2024-09-12T17:33:23.762+0000 7f638320e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:33:24.136 INFO:tasks.workunit.client.0.smithi037.stderr: -107> 2024-09-12T17:33:23.762+0000 7f638320e800 20 searching for the correct realm 2024-09-12T17:33:24.136 INFO:tasks.workunit.client.0.smithi037.stderr: -106> 2024-09-12T17:33:23.763+0000 7f637e16a640 10 monclient: get_auth_request con 0x55f29cebd6b0 auth_method 0 2024-09-12T17:33:24.136 INFO:tasks.workunit.client.0.smithi037.stderr: -105> 2024-09-12T17:33:23.763+0000 7f637f16c640 10 monclient: get_auth_request con 0x7f6374003500 auth_method 0 2024-09-12T17:33:24.136 INFO:tasks.workunit.client.0.smithi037.stderr: -104> 2024-09-12T17:33:23.764+0000 7f637e96b640 10 monclient: get_auth_request con 0x7f6378071040 auth_method 0 2024-09-12T17:33:24.136 INFO:tasks.workunit.client.0.smithi037.stderr: -103> 2024-09-12T17:33:23.765+0000 7f637e16a640 10 monclient: get_auth_request con 0x7f637001f060 auth_method 0 2024-09-12T17:33:24.136 INFO:tasks.workunit.client.0.smithi037.stderr: -102> 2024-09-12T17:33:23.766+0000 7f637e16a640 0 -- 172.21.15.37:0/450165220 >> [v2:172.21.15.40:6800/2441293461,v1:172.21.15.40:6801/2441293461] conn(0x7f637001f060 msgr2=0x7f63700961d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:33:24.136 INFO:tasks.workunit.client.0.smithi037.stderr: -101> 2024-09-12T17:33:23.766+0000 7f6260ff9640 1 client.6924.objecter ms_handle_reset 0x7f637001f060 session 0x7f6370011040 osd.4 2024-09-12T17:33:24.136 INFO:tasks.workunit.client.0.smithi037.stderr: -100> 2024-09-12T17:33:23.766+0000 7f6260ff9640 10 monclient: _renew_subs 2024-09-12T17:33:24.136 INFO:tasks.workunit.client.0.smithi037.stderr: -99> 2024-09-12T17:33:23.766+0000 7f6260ff9640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.37:3300/0 2024-09-12T17:33:24.136 INFO:tasks.workunit.client.0.smithi037.stderr: -98> 2024-09-12T17:33:23.766+0000 7f637e16a640 10 monclient: get_auth_request con 0x7f6248086b10 auth_method 0 2024-09-12T17:33:24.136 INFO:tasks.workunit.client.0.smithi037.stderr: -97> 2024-09-12T17:33:23.767+0000 7f637f16c640 10 monclient: get_auth_request con 0x7f6374085190 auth_method 0 2024-09-12T17:33:24.136 INFO:tasks.workunit.client.0.smithi037.stderr: -96> 2024-09-12T17:33:23.770+0000 7f637e96b640 10 monclient: get_auth_request con 0x7f637402d040 auth_method 0 2024-09-12T17:33:24.136 INFO:tasks.workunit.client.0.smithi037.stderr: -95> 2024-09-12T17:33:23.770+0000 7f637e96b640 0 -- 172.21.15.37:0/450165220 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7f637402d040 msgr2=0x7f63740980b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:33:24.136 INFO:tasks.workunit.client.0.smithi037.stderr: -94> 2024-09-12T17:33:23.971+0000 7f637e96b640 10 monclient: get_auth_request con 0x7f637402d040 auth_method 0 2024-09-12T17:33:24.137 INFO:tasks.workunit.client.0.smithi037.stderr: -93> 2024-09-12T17:33:23.977+0000 7f638320e800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:33:24.137 INFO:tasks.workunit.client.0.smithi037.stderr: -92> 2024-09-12T17:33:23.977+0000 7f638320e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:33:24.137 INFO:tasks.workunit.client.0.smithi037.stderr: -91> 2024-09-12T17:33:23.977+0000 7f638320e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:33:24.137 INFO:tasks.workunit.client.0.smithi037.stderr: -90> 2024-09-12T17:33:23.977+0000 7f638320e800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:33:24.137 INFO:tasks.workunit.client.0.smithi037.stderr: -89> 2024-09-12T17:33:23.977+0000 7f638320e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:33:24.137 INFO:tasks.workunit.client.0.smithi037.stderr: -88> 2024-09-12T17:33:23.977+0000 7f638320e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:33:24.137 INFO:tasks.workunit.client.0.smithi037.stderr: -87> 2024-09-12T17:33:23.977+0000 7f638320e800 20 rados->read ofs=0 len=0 2024-09-12T17:33:24.137 INFO:tasks.workunit.client.0.smithi037.stderr: -86> 2024-09-12T17:33:23.977+0000 7f638320e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:24.137 INFO:tasks.workunit.client.0.smithi037.stderr: -85> 2024-09-12T17:33:23.977+0000 7f638320e800 20 rados->read ofs=0 len=0 2024-09-12T17:33:24.138 INFO:tasks.workunit.client.0.smithi037.stderr: -84> 2024-09-12T17:33:23.977+0000 7f638320e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:33:24.138 INFO:tasks.workunit.client.0.smithi037.stderr: -83> 2024-09-12T17:33:23.977+0000 7f638320e800 20 rados->read ofs=0 len=0 2024-09-12T17:33:24.138 INFO:tasks.workunit.client.0.smithi037.stderr: -82> 2024-09-12T17:33:23.978+0000 7f638320e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:33:24.138 INFO:tasks.workunit.client.0.smithi037.stderr: -81> 2024-09-12T17:33:23.978+0000 7f638320e800 20 zone default found 2024-09-12T17:33:24.138 INFO:tasks.workunit.client.0.smithi037.stderr: -80> 2024-09-12T17:33:23.978+0000 7f638320e800 4 Realm: () 2024-09-12T17:33:24.138 INFO:tasks.workunit.client.0.smithi037.stderr: -79> 2024-09-12T17:33:23.978+0000 7f638320e800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:33:24.138 INFO:tasks.workunit.client.0.smithi037.stderr: -78> 2024-09-12T17:33:23.978+0000 7f638320e800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:33:24.138 INFO:tasks.workunit.client.0.smithi037.stderr: -77> 2024-09-12T17:33:23.978+0000 7f638320e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:33:24.138 INFO:tasks.workunit.client.0.smithi037.stderr: -76> 2024-09-12T17:33:23.978+0000 7f638320e800 20 zonegroup default 2024-09-12T17:33:24.138 INFO:tasks.workunit.client.0.smithi037.stderr: -75> 2024-09-12T17:33:23.978+0000 7f638320e800 20 rados->read ofs=0 len=0 2024-09-12T17:33:24.138 INFO:tasks.workunit.client.0.smithi037.stderr: -74> 2024-09-12T17:33:23.978+0000 7f638320e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:24.138 INFO:tasks.workunit.client.0.smithi037.stderr: -73> 2024-09-12T17:33:23.978+0000 7f638320e800 20 rados->read ofs=0 len=0 2024-09-12T17:33:24.138 INFO:tasks.workunit.client.0.smithi037.stderr: -72> 2024-09-12T17:33:23.978+0000 7f638320e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:24.138 INFO:tasks.workunit.client.0.smithi037.stderr: -71> 2024-09-12T17:33:23.978+0000 7f638320e800 20 rados->read ofs=0 len=0 2024-09-12T17:33:24.139 INFO:tasks.workunit.client.0.smithi037.stderr: -70> 2024-09-12T17:33:23.979+0000 7f638320e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:24.139 INFO:tasks.workunit.client.0.smithi037.stderr: -69> 2024-09-12T17:33:23.979+0000 7f638320e800 20 started sync module instance, tier type = 2024-09-12T17:33:24.139 INFO:tasks.workunit.client.0.smithi037.stderr: -68> 2024-09-12T17:33:23.979+0000 7f638320e800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:33:24.139 INFO:tasks.workunit.client.0.smithi037.stderr: -67> 2024-09-12T17:33:23.988+0000 7f638320e800 20 add_watcher() i=0 2024-09-12T17:33:24.139 INFO:tasks.workunit.client.0.smithi037.stderr: -66> 2024-09-12T17:33:23.988+0000 7f638320e800 20 add_watcher() i=1 2024-09-12T17:33:24.139 INFO:tasks.workunit.client.0.smithi037.stderr: -65> 2024-09-12T17:33:23.988+0000 7f638320e800 20 add_watcher() i=2 2024-09-12T17:33:24.139 INFO:tasks.workunit.client.0.smithi037.stderr: -64> 2024-09-12T17:33:23.988+0000 7f638320e800 20 add_watcher() i=3 2024-09-12T17:33:24.139 INFO:tasks.workunit.client.0.smithi037.stderr: -63> 2024-09-12T17:33:23.988+0000 7f638320e800 20 add_watcher() i=4 2024-09-12T17:33:24.139 INFO:tasks.workunit.client.0.smithi037.stderr: -62> 2024-09-12T17:33:23.988+0000 7f638320e800 20 add_watcher() i=5 2024-09-12T17:33:24.139 INFO:tasks.workunit.client.0.smithi037.stderr: -61> 2024-09-12T17:33:23.988+0000 7f638320e800 20 add_watcher() i=6 2024-09-12T17:33:24.139 INFO:tasks.workunit.client.0.smithi037.stderr: -60> 2024-09-12T17:33:23.990+0000 7f638320e800 20 add_watcher() i=7 2024-09-12T17:33:24.140 INFO:tasks.workunit.client.0.smithi037.stderr: -59> 2024-09-12T17:33:23.990+0000 7f638320e800 2 all 8 watchers are set, enabling cache 2024-09-12T17:33:24.140 INFO:tasks.workunit.client.0.smithi037.stderr: -58> 2024-09-12T17:33:23.992+0000 7f638320e800 5 AuthRegistry(0x7ffcdf08fb10) adding auth protocol: cephx 2024-09-12T17:33:24.140 INFO:tasks.workunit.client.0.smithi037.stderr: -57> 2024-09-12T17:33:23.992+0000 7f638320e800 5 AuthRegistry(0x7ffcdf08fb10) adding auth protocol: cephx 2024-09-12T17:33:24.140 INFO:tasks.workunit.client.0.smithi037.stderr: -56> 2024-09-12T17:33:23.992+0000 7f638320e800 5 AuthRegistry(0x7ffcdf08fb10) adding auth protocol: cephx 2024-09-12T17:33:24.140 INFO:tasks.workunit.client.0.smithi037.stderr: -55> 2024-09-12T17:33:23.992+0000 7f638320e800 5 AuthRegistry(0x7ffcdf08fb10) adding con mode: secure 2024-09-12T17:33:24.140 INFO:tasks.workunit.client.0.smithi037.stderr: -54> 2024-09-12T17:33:23.992+0000 7f638320e800 5 AuthRegistry(0x7ffcdf08fb10) adding con mode: crc 2024-09-12T17:33:24.140 INFO:tasks.workunit.client.0.smithi037.stderr: -53> 2024-09-12T17:33:23.992+0000 7f638320e800 5 AuthRegistry(0x7ffcdf08fb10) adding con mode: secure 2024-09-12T17:33:24.140 INFO:tasks.workunit.client.0.smithi037.stderr: -52> 2024-09-12T17:33:23.992+0000 7f638320e800 5 AuthRegistry(0x7ffcdf08fb10) adding con mode: crc 2024-09-12T17:33:24.140 INFO:tasks.workunit.client.0.smithi037.stderr: -51> 2024-09-12T17:33:23.992+0000 7f638320e800 5 AuthRegistry(0x7ffcdf08fb10) adding con mode: secure 2024-09-12T17:33:24.140 INFO:tasks.workunit.client.0.smithi037.stderr: -50> 2024-09-12T17:33:23.992+0000 7f638320e800 5 AuthRegistry(0x7ffcdf08fb10) adding con mode: crc 2024-09-12T17:33:24.140 INFO:tasks.workunit.client.0.smithi037.stderr: -49> 2024-09-12T17:33:23.992+0000 7f638320e800 5 AuthRegistry(0x7ffcdf08fb10) adding con mode: crc 2024-09-12T17:33:24.141 INFO:tasks.workunit.client.0.smithi037.stderr: -48> 2024-09-12T17:33:23.992+0000 7f638320e800 5 AuthRegistry(0x7ffcdf08fb10) adding con mode: secure 2024-09-12T17:33:24.141 INFO:tasks.workunit.client.0.smithi037.stderr: -47> 2024-09-12T17:33:23.992+0000 7f62357e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:33:24.141 INFO:tasks.workunit.client.0.smithi037.stderr: -46> 2024-09-12T17:33:23.992+0000 7f638320e800 5 AuthRegistry(0x7ffcdf08fb10) adding con mode: crc 2024-09-12T17:33:24.141 INFO:tasks.workunit.client.0.smithi037.stderr: -45> 2024-09-12T17:33:23.992+0000 7f638320e800 5 AuthRegistry(0x7ffcdf08fb10) adding con mode: secure 2024-09-12T17:33:24.141 INFO:tasks.workunit.client.0.smithi037.stderr: -44> 2024-09-12T17:33:23.992+0000 7f638320e800 5 AuthRegistry(0x7ffcdf08fb10) adding con mode: crc 2024-09-12T17:33:24.141 INFO:tasks.workunit.client.0.smithi037.stderr: -43> 2024-09-12T17:33:23.992+0000 7f638320e800 5 AuthRegistry(0x7ffcdf08fb10) adding con mode: secure 2024-09-12T17:33:24.141 INFO:tasks.workunit.client.0.smithi037.stderr: -42> 2024-09-12T17:33:23.992+0000 7f638320e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:33:24.141 INFO:tasks.workunit.client.0.smithi037.stderr: -41> 2024-09-12T17:33:23.992+0000 7f638320e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:33:24.141 INFO:tasks.workunit.client.0.smithi037.stderr: -40> 2024-09-12T17:33:23.992+0000 7f638320e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:33:24.141 INFO:tasks.workunit.client.0.smithi037.stderr: -39> 2024-09-12T17:33:23.992+0000 7f638320e800 5 asok(0x55f29cba7730) register_command cache list hook 0x55f29ce8ef40 2024-09-12T17:33:24.141 INFO:tasks.workunit.client.0.smithi037.stderr: -38> 2024-09-12T17:33:23.992+0000 7f638320e800 5 asok(0x55f29cba7730) register_command cache inspect hook 0x55f29ce8ef40 2024-09-12T17:33:24.141 INFO:tasks.workunit.client.0.smithi037.stderr: -37> 2024-09-12T17:33:23.992+0000 7f638320e800 5 asok(0x55f29cba7730) register_command cache erase hook 0x55f29ce8ef40 2024-09-12T17:33:24.142 INFO:tasks.workunit.client.0.smithi037.stderr: -36> 2024-09-12T17:33:23.992+0000 7f638320e800 5 asok(0x55f29cba7730) register_command cache zap hook 0x55f29ce8ef40 2024-09-12T17:33:24.142 INFO:tasks.workunit.client.0.smithi037.stderr: -35> 2024-09-12T17:33:23.992+0000 7f638320e800 5 note: GC not initialized 2024-09-12T17:33:24.142 INFO:tasks.workunit.client.0.smithi037.stderr: -34> 2024-09-12T17:33:23.993+0000 7f61affff640 20 reqs_thread_entry: start 2024-09-12T17:33:24.142 INFO:tasks.workunit.client.0.smithi037.stderr: -33> 2024-09-12T17:33:23.993+0000 7f638320e800 5 asok(0x55f29cba7730) register_command sync trace show hook 0x7f6370004540 2024-09-12T17:33:24.142 INFO:tasks.workunit.client.0.smithi037.stderr: -32> 2024-09-12T17:33:23.993+0000 7f638320e800 5 asok(0x55f29cba7730) register_command sync trace history hook 0x7f6370004540 2024-09-12T17:33:24.142 INFO:tasks.workunit.client.0.smithi037.stderr: -31> 2024-09-12T17:33:23.993+0000 7f638320e800 5 asok(0x55f29cba7730) register_command sync trace active hook 0x7f6370004540 2024-09-12T17:33:24.142 INFO:tasks.workunit.client.0.smithi037.stderr: -30> 2024-09-12T17:33:23.993+0000 7f638320e800 5 asok(0x55f29cba7730) register_command sync trace active_short hook 0x7f6370004540 2024-09-12T17:33:24.142 INFO:tasks.workunit.client.0.smithi037.stderr: -29> 2024-09-12T17:33:23.993+0000 7f638320e800 20 init_complete bucket index max shards: 11 2024-09-12T17:33:24.142 INFO:tasks.workunit.client.0.smithi037.stderr: -28> 2024-09-12T17:33:23.993+0000 7f638320e800 20 Filter name: none 2024-09-12T17:33:24.142 INFO:tasks.workunit.client.0.smithi037.stderr: -27> 2024-09-12T17:33:23.993+0000 7f61adffb640 20 reqs_thread_entry: start 2024-09-12T17:33:24.142 INFO:tasks.workunit.client.0.smithi037.stderr: -26> 2024-09-12T17:33:23.993+0000 7f638320e800 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-12T17:33:24.143 INFO:tasks.workunit.client.0.smithi037.stderr: -25> 2024-09-12T17:33:23.993+0000 7f638320e800 20 rados->read ofs=0 len=0 2024-09-12T17:33:24.143 INFO:tasks.workunit.client.0.smithi037.stderr: -24> 2024-09-12T17:33:23.993+0000 7f638320e800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T17:33:24.143 INFO:tasks.workunit.client.0.smithi037.stderr: -23> 2024-09-12T17:33:23.993+0000 7f638320e800 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T17:33:24.143 INFO:tasks.workunit.client.0.smithi037.stderr: -22> 2024-09-12T17:33:23.993+0000 7f638320e800 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-12T17:33:24.143 INFO:tasks.workunit.client.0.smithi037.stderr: -21> 2024-09-12T17:33:23.993+0000 7f638320e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.28 : miss 2024-09-12T17:33:24.143 INFO:tasks.workunit.client.0.smithi037.stderr: -20> 2024-09-12T17:33:23.993+0000 7f638320e800 20 rados->read ofs=0 len=0 2024-09-12T17:33:24.143 INFO:tasks.workunit.client.0.smithi037.stderr: -19> 2024-09-12T17:33:23.994+0000 7f638320e800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T17:33:24.143 INFO:tasks.workunit.client.0.smithi037.stderr: -18> 2024-09-12T17:33:23.994+0000 7f638320e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.28 info.flags=0x17 2024-09-12T17:33:24.143 INFO:tasks.workunit.client.0.smithi037.stderr: -17> 2024-09-12T17:33:23.994+0000 7f638320e800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.28 to cache LRU end 2024-09-12T17:33:24.143 INFO:tasks.workunit.client.0.smithi037.stderr: -16> 2024-09-12T17:33:23.994+0000 7f638320e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:33:24.144 INFO:tasks.workunit.client.0.smithi037.stderr: -15> 2024-09-12T17:33:23.994+0000 7f638320e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:33:24.144 INFO:tasks.workunit.client.0.smithi037.stderr: -14> 2024-09-12T17:33:23.994+0000 7f638320e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.28 2024-09-12T17:33:24.144 INFO:tasks.workunit.client.0.smithi037.stderr: -13> 2024-09-12T17:33:23.999+0000 7f638320e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.28 info.flags=0x17 2024-09-12T17:33:24.144 INFO:tasks.workunit.client.0.smithi037.stderr: -12> 2024-09-12T17:33:23.999+0000 7f638320e800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.28 to cache LRU end 2024-09-12T17:33:24.144 INFO:tasks.workunit.client.0.smithi037.stderr: -11> 2024-09-12T17:33:23.999+0000 7f638320e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:33:24.144 INFO:tasks.workunit.client.0.smithi037.stderr: -10> 2024-09-12T17:33:23.999+0000 7f638320e800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.28, ofs0, ns] 2024-09-12T17:33:24.144 INFO:tasks.workunit.client.0.smithi037.stderr: -9> 2024-09-12T17:33:24.000+0000 7f62627fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497053 cookie 94500503182064 notifier 6924 bl.length()=1023 2024-09-12T17:33:24.144 INFO:tasks.workunit.client.0.smithi037.stderr: -8> 2024-09-12T17:33:24.000+0000 7f62627fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.28 info.flags=0x17 2024-09-12T17:33:24.144 INFO:tasks.workunit.client.0.smithi037.stderr: -7> 2024-09-12T17:33:24.000+0000 7f62627fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.28 to cache LRU end 2024-09-12T17:33:24.145 INFO:tasks.workunit.client.0.smithi037.stderr: -6> 2024-09-12T17:33:24.000+0000 7f62627fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:33:24.145 INFO:tasks.workunit.client.0.smithi037.stderr: -5> 2024-09-12T17:33:24.002+0000 7f638320e800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.28]): orig_sources= new_sources= 2024-09-12T17:33:24.145 INFO:tasks.workunit.client.0.smithi037.stderr: -4> 2024-09-12T17:33:24.002+0000 7f638320e800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.28]): potential sources added=[] removed=[] 2024-09-12T17:33:24.145 INFO:tasks.workunit.client.0.smithi037.stderr: -3> 2024-09-12T17:33:24.002+0000 7f638320e800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.28]): orig_dests= new_dests= 2024-09-12T17:33:24.145 INFO:tasks.workunit.client.0.smithi037.stderr: -2> 2024-09-12T17:33:24.002+0000 7f638320e800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.28]): potential dests added=[] removed=[] 2024-09-12T17:33:24.145 INFO:tasks.workunit.client.0.smithi037.stderr: -1> 2024-09-12T17:33:24.002+0000 7f638320e800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f638320e800 time 2024-09-12T17:33:24.002828+0000 2024-09-12T17:33:24.145 INFO:tasks.workunit.client.0.smithi037.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:33:24.145 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:33:24.145 INFO:tasks.workunit.client.0.smithi037.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:33:24.145 INFO:tasks.workunit.client.0.smithi037.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f638438c71a] 2024-09-12T17:33:24.145 INFO:tasks.workunit.client.0.smithi037.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f638438c8d8] 2024-09-12T17:33:24.145 INFO:tasks.workunit.client.0.smithi037.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f29bd70841] 2024-09-12T17:33:24.145 INFO:tasks.workunit.client.0.smithi037.stderr: 4: radosgw-admin(+0xd7489e) [0x55f29c27e89e] 2024-09-12T17:33:24.146 INFO:tasks.workunit.client.0.smithi037.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55f29bd8050d] 2024-09-12T17:33:24.146 INFO:tasks.workunit.client.0.smithi037.stderr: 6: main() 2024-09-12T17:33:24.146 INFO:tasks.workunit.client.0.smithi037.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f6383029590] 2024-09-12T17:33:24.146 INFO:tasks.workunit.client.0.smithi037.stderr: 8: __libc_start_main() 2024-09-12T17:33:24.146 INFO:tasks.workunit.client.0.smithi037.stderr: 9: _start() 2024-09-12T17:33:24.146 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:33:24.146 INFO:tasks.workunit.client.0.smithi037.stderr: 0> 2024-09-12T17:33:24.003+0000 7f638320e800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:33:24.146 INFO:tasks.workunit.client.0.smithi037.stderr: in thread 7f638320e800 thread_name:radosgw-admin 2024-09-12T17:33:24.146 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:33:24.146 INFO:tasks.workunit.client.0.smithi037.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:33:24.146 INFO:tasks.workunit.client.0.smithi037.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f638303e6f0] 2024-09-12T17:33:24.146 INFO:tasks.workunit.client.0.smithi037.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f638308b99c] 2024-09-12T17:33:24.146 INFO:tasks.workunit.client.0.smithi037.stderr: 3: raise() 2024-09-12T17:33:24.146 INFO:tasks.workunit.client.0.smithi037.stderr: 4: abort() 2024-09-12T17:33:24.146 INFO:tasks.workunit.client.0.smithi037.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f638438c774] 2024-09-12T17:33:24.147 INFO:tasks.workunit.client.0.smithi037.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f638438c8d8] 2024-09-12T17:33:24.147 INFO:tasks.workunit.client.0.smithi037.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f29bd70841] 2024-09-12T17:33:24.147 INFO:tasks.workunit.client.0.smithi037.stderr: 8: radosgw-admin(+0xd7489e) [0x55f29c27e89e] 2024-09-12T17:33:24.147 INFO:tasks.workunit.client.0.smithi037.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55f29bd8050d] 2024-09-12T17:33:24.147 INFO:tasks.workunit.client.0.smithi037.stderr: 10: main() 2024-09-12T17:33:24.147 INFO:tasks.workunit.client.0.smithi037.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f6383029590] 2024-09-12T17:33:24.147 INFO:tasks.workunit.client.0.smithi037.stderr: 12: __libc_start_main() 2024-09-12T17:33:24.147 INFO:tasks.workunit.client.0.smithi037.stderr: 13: _start() 2024-09-12T17:33:24.147 INFO:tasks.workunit.client.0.smithi037.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:33:24.147 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:33:24.147 INFO:tasks.workunit.client.0.smithi037.stderr:--- logging levels --- 2024-09-12T17:33:24.147 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 none 2024-09-12T17:33:24.148 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 lockdep 2024-09-12T17:33:24.148 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 context 2024-09-12T17:33:24.148 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 1 crush 2024-09-12T17:33:24.148 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mds 2024-09-12T17:33:24.148 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mds_balancer 2024-09-12T17:33:24.148 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mds_locker 2024-09-12T17:33:24.148 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mds_log 2024-09-12T17:33:24.148 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mds_log_expire 2024-09-12T17:33:24.148 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mds_migrator 2024-09-12T17:33:24.148 INFO:tasks.workunit.client.0.smithi037.stderr: 3/ 5 mds_quiesce 2024-09-12T17:33:24.149 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 buffer 2024-09-12T17:33:24.149 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 timer 2024-09-12T17:33:24.149 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 filer 2024-09-12T17:33:24.149 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 striper 2024-09-12T17:33:24.149 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 objecter 2024-09-12T17:33:24.149 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 rados 2024-09-12T17:33:24.149 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 rbd 2024-09-12T17:33:24.149 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 rbd_mirror 2024-09-12T17:33:24.149 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 rbd_replay 2024-09-12T17:33:24.149 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 rbd_pwl 2024-09-12T17:33:24.149 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 journaler 2024-09-12T17:33:24.149 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 objectcacher 2024-09-12T17:33:24.149 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:33:24.149 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 client 2024-09-12T17:33:24.149 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 osd 2024-09-12T17:33:24.150 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 optracker 2024-09-12T17:33:24.150 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 objclass 2024-09-12T17:33:24.150 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 3 filestore 2024-09-12T17:33:24.150 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 3 journal 2024-09-12T17:33:24.150 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 0 ms 2024-09-12T17:33:24.150 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mon 2024-09-12T17:33:24.150 INFO:tasks.workunit.client.0.smithi037.stderr: 0/10 monc 2024-09-12T17:33:24.150 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 paxos 2024-09-12T17:33:24.150 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 tp 2024-09-12T17:33:24.150 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 auth 2024-09-12T17:33:24.150 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 crypto 2024-09-12T17:33:24.150 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 1 finisher 2024-09-12T17:33:24.150 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 1 reserver 2024-09-12T17:33:24.150 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 heartbeatmap 2024-09-12T17:33:24.150 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 perfcounter 2024-09-12T17:33:24.151 INFO:tasks.workunit.client.0.smithi037.stderr: 20/20 rgw 2024-09-12T17:33:24.151 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 rgw_sync 2024-09-12T17:33:24.151 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 rgw_datacache 2024-09-12T17:33:24.151 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 rgw_access 2024-09-12T17:33:24.151 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:33:24.151 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 rgw_flight 2024-09-12T17:33:24.151 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:33:24.151 INFO:tasks.workunit.client.0.smithi037.stderr: 20/20 rgw_notification 2024-09-12T17:33:24.151 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 javaclient 2024-09-12T17:33:24.151 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 asok 2024-09-12T17:33:24.151 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 1 throttle 2024-09-12T17:33:24.151 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 0 refs 2024-09-12T17:33:24.151 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 compressor 2024-09-12T17:33:24.151 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 bluestore 2024-09-12T17:33:24.151 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 bluefs 2024-09-12T17:33:24.152 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 3 bdev 2024-09-12T17:33:24.152 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 kstore 2024-09-12T17:33:24.152 INFO:tasks.workunit.client.0.smithi037.stderr: 4/ 5 rocksdb 2024-09-12T17:33:24.152 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 fuse 2024-09-12T17:33:24.152 INFO:tasks.workunit.client.0.smithi037.stderr: 2/ 5 mgr 2024-09-12T17:33:24.152 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mgrc 2024-09-12T17:33:24.152 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 dpdk 2024-09-12T17:33:24.152 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 eventtrace 2024-09-12T17:33:24.152 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 prioritycache 2024-09-12T17:33:24.152 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 test 2024-09-12T17:33:24.152 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:33:24.152 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 cephsqlite 2024-09-12T17:33:24.152 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:33:24.152 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore 2024-09-12T17:33:24.153 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_onode 2024-09-12T17:33:24.153 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_odata 2024-09-12T17:33:24.153 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_omap 2024-09-12T17:33:24.153 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_tm 2024-09-12T17:33:24.153 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_t 2024-09-12T17:33:24.153 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:33:24.153 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_epm 2024-09-12T17:33:24.153 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_lba 2024-09-12T17:33:24.153 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:33:24.153 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_cache 2024-09-12T17:33:24.153 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_journal 2024-09-12T17:33:24.153 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_device 2024-09-12T17:33:24.153 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_backref 2024-09-12T17:33:24.153 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 alienstore 2024-09-12T17:33:24.153 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mclock 2024-09-12T17:33:24.154 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 cyanstore 2024-09-12T17:33:24.154 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 ceph_exporter 2024-09-12T17:33:24.154 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 memstore 2024-09-12T17:33:24.154 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 trace 2024-09-12T17:33:24.154 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 ceph_dedup 2024-09-12T17:33:24.154 INFO:tasks.workunit.client.0.smithi037.stderr: -2/-2 (syslog threshold) 2024-09-12T17:33:24.154 INFO:tasks.workunit.client.0.smithi037.stderr: 99/99 (stderr threshold) 2024-09-12T17:33:24.154 INFO:tasks.workunit.client.0.smithi037.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:33:24.154 INFO:tasks.workunit.client.0.smithi037.stderr: 7f61adffb640 / http_manager 2024-09-12T17:33:24.154 INFO:tasks.workunit.client.0.smithi037.stderr: 7f61affff640 / http_manager 2024-09-12T17:33:24.154 INFO:tasks.workunit.client.0.smithi037.stderr: 7f62357e2640 / rgw_dt_lg_renew 2024-09-12T17:33:24.154 INFO:tasks.workunit.client.0.smithi037.stderr: 7f6260ff9640 / ms_dispatch 2024-09-12T17:33:24.154 INFO:tasks.workunit.client.0.smithi037.stderr: 7f62627fc640 / io_context_pool 2024-09-12T17:33:24.154 INFO:tasks.workunit.client.0.smithi037.stderr: 7f6268e01640 / ms_dispatch 2024-09-12T17:33:24.155 INFO:tasks.workunit.client.0.smithi037.stderr: 7f626b606640 / ms_dispatch 2024-09-12T17:33:24.155 INFO:tasks.workunit.client.0.smithi037.stderr: 7f626ce09640 / io_context_pool 2024-09-12T17:33:24.155 INFO:tasks.workunit.client.0.smithi037.stderr: 7f637e16a640 / msgr-worker-2 2024-09-12T17:33:24.155 INFO:tasks.workunit.client.0.smithi037.stderr: 7f637e96b640 / msgr-worker-1 2024-09-12T17:33:24.155 INFO:tasks.workunit.client.0.smithi037.stderr: 7f637f16c640 / msgr-worker-0 2024-09-12T17:33:24.155 INFO:tasks.workunit.client.0.smithi037.stderr: 7f637f96d640 / io_context_pool 2024-09-12T17:33:24.155 INFO:tasks.workunit.client.0.smithi037.stderr: 7f638320e800 / radosgw-admin 2024-09-12T17:33:24.155 INFO:tasks.workunit.client.0.smithi037.stderr: max_recent 500 2024-09-12T17:33:24.155 INFO:tasks.workunit.client.0.smithi037.stderr: max_new 1000 2024-09-12T17:33:24.155 INFO:tasks.workunit.client.0.smithi037.stderr: log_file /var/lib/ceph/crash/2024-09-12T17:33:24.004495Z_bb94427c-a519-43ad-bf78-99f4296d6a04/log 2024-09-12T17:33:24.155 INFO:tasks.workunit.client.0.smithi037.stderr:--- end dump of recent events --- 2024-09-12T17:33:24.155 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bucket stats --bucket abort-at-trim-reshard-log-entries 2024-09-12T17:33:24.157 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:33:24.157 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:33:24.157 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.082+0000 7f2d7253c800 20 rados->read ofs=0 len=0 2024-09-12T17:33:24.157 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.083+0000 7f2d7253c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:24.157 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.083+0000 7f2d7253c800 20 realm 2024-09-12T17:33:24.157 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.083+0000 7f2d7253c800 20 rados->read ofs=0 len=0 2024-09-12T17:33:24.157 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.084+0000 7f2d7253c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:24.158 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.084+0000 7f2d7253c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:33:24.158 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.084+0000 7f2d7253c800 20 rados->read ofs=0 len=0 2024-09-12T17:33:24.158 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.084+0000 7f2d7253c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:24.158 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.084+0000 7f2d7253c800 20 rados->read ofs=0 len=0 2024-09-12T17:33:24.158 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.085+0000 7f2d7253c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:33:24.158 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.085+0000 7f2d7253c800 20 rados->read ofs=0 len=0 2024-09-12T17:33:24.158 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.085+0000 7f2d7253c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:33:24.158 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.085+0000 7f2d7253c800 20 searching for the correct realm 2024-09-12T17:33:24.158 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.088+0000 7f2d6da80640 0 -- 172.21.15.37:0/1768254465 >> [v2:172.21.15.40:6800/2441293461,v1:172.21.15.40:6801/2441293461] conn(0x7f2d600aab20 msgr2=0x7f2d600c59c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:33:24.158 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.092+0000 7f2d6e281640 0 -- 172.21.15.37:0/1768254465 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7f2d640776f0 msgr2=0x7f2d64060750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:33:24.300 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.298+0000 7f2d7253c800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:33:24.300 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.298+0000 7f2d7253c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:33:24.300 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.298+0000 7f2d7253c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:33:24.300 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.298+0000 7f2d7253c800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:33:24.300 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.298+0000 7f2d7253c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:33:24.300 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.298+0000 7f2d7253c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:33:24.300 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.298+0000 7f2d7253c800 20 rados->read ofs=0 len=0 2024-09-12T17:33:24.300 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.299+0000 7f2d7253c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:24.300 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.299+0000 7f2d7253c800 20 rados->read ofs=0 len=0 2024-09-12T17:33:24.301 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.299+0000 7f2d7253c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:33:24.301 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.299+0000 7f2d7253c800 20 rados->read ofs=0 len=0 2024-09-12T17:33:24.302 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.299+0000 7f2d7253c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:33:24.302 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.299+0000 7f2d7253c800 20 zone default found 2024-09-12T17:33:24.302 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.299+0000 7f2d7253c800 4 Realm: () 2024-09-12T17:33:24.302 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.299+0000 7f2d7253c800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:33:24.302 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.299+0000 7f2d7253c800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:33:24.302 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.299+0000 7f2d7253c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:33:24.302 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.299+0000 7f2d7253c800 20 zonegroup default 2024-09-12T17:33:24.302 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.299+0000 7f2d7253c800 20 rados->read ofs=0 len=0 2024-09-12T17:33:24.302 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.300+0000 7f2d7253c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:24.302 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.300+0000 7f2d7253c800 20 rados->read ofs=0 len=0 2024-09-12T17:33:24.302 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.300+0000 7f2d7253c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:24.302 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.300+0000 7f2d7253c800 20 rados->read ofs=0 len=0 2024-09-12T17:33:24.303 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.300+0000 7f2d7253c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:24.303 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.300+0000 7f2d7253c800 20 started sync module instance, tier type = 2024-09-12T17:33:24.303 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.300+0000 7f2d7253c800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:33:24.312 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.311+0000 7f2d7253c800 20 add_watcher() i=0 2024-09-12T17:33:24.312 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.311+0000 7f2d7253c800 20 add_watcher() i=1 2024-09-12T17:33:24.312 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.311+0000 7f2d7253c800 20 add_watcher() i=2 2024-09-12T17:33:24.312 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.311+0000 7f2d7253c800 20 add_watcher() i=3 2024-09-12T17:33:24.312 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.311+0000 7f2d7253c800 20 add_watcher() i=4 2024-09-12T17:33:24.312 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.311+0000 7f2d7253c800 20 add_watcher() i=5 2024-09-12T17:33:24.312 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.311+0000 7f2d7253c800 20 add_watcher() i=6 2024-09-12T17:33:24.313 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.312+0000 7f2d7253c800 20 add_watcher() i=7 2024-09-12T17:33:24.313 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.312+0000 7f2d7253c800 2 all 8 watchers are set, enabling cache 2024-09-12T17:33:24.316 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.314+0000 7f2c24fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:33:24.316 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.315+0000 7f2d7253c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:33:24.316 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.315+0000 7f2d7253c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:33:24.316 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.315+0000 7f2d7253c800 5 note: GC not initialized 2024-09-12T17:33:24.317 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.315+0000 7f2b9f7fe640 20 reqs_thread_entry: start 2024-09-12T17:33:24.317 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.315+0000 7f2d7253c800 20 init_complete bucket index max shards: 11 2024-09-12T17:33:24.317 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.315+0000 7f2d7253c800 20 Filter name: none 2024-09-12T17:33:24.317 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.315+0000 7f2b9d7fa640 20 reqs_thread_entry: start 2024-09-12T17:33:24.317 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.315+0000 7f2d7253c800 20 rados->read ofs=0 len=0 2024-09-12T17:33:24.318 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.316+0000 7f2d7253c800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T17:33:24.318 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.316+0000 7f2d7253c800 20 rados->read ofs=0 len=0 2024-09-12T17:33:24.318 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.317+0000 7f2d7253c800 20 rados_obj.operate() r=0 bl.length=479 2024-09-12T17:33:24.319 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.317+0000 7f2d7253c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:33:24.319 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.317+0000 7f2d7253c800 20 rados->read ofs=0 len=0 2024-09-12T17:33:24.319 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.317+0000 7f2d7253c800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T17:33:24.319 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.317+0000 7f2d7253c800 20 rados->read ofs=0 len=0 2024-09-12T17:33:24.320 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.318+0000 7f2d7253c800 20 rados_obj.operate() r=0 bl.length=479 2024-09-12T17:33:24.320 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.318+0000 7f2d7253c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:33:24.320 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.319+0000 7f2c24fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:33:24.323 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.323+0000 7f2d7253c800 20 remove_watcher() i=0 2024-09-12T17:33:24.323 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.323+0000 7f2d7253c800 2 removed watcher, disabling cache 2024-09-12T17:33:24.324 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.324+0000 7f2d7253c800 20 remove_watcher() i=1 2024-09-12T17:33:24.325 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.325+0000 7f2d7253c800 20 remove_watcher() i=2 2024-09-12T17:33:24.326 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.326+0000 7f2d7253c800 20 remove_watcher() i=3 2024-09-12T17:33:24.328 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.328+0000 7f2d7253c800 20 remove_watcher() i=4 2024-09-12T17:33:24.329 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.329+0000 7f2d7253c800 20 remove_watcher() i=5 2024-09-12T17:33:24.330 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.330+0000 7f2d7253c800 20 remove_watcher() i=6 2024-09-12T17:33:24.331 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.331+0000 7f2d7253c800 20 remove_watcher() i=7 2024-09-12T17:33:24.346 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:33:24.346 INFO:tasks.workunit.client.0.smithi037.stderr:BUCKET_STATS: 2024-09-12T17:33:24.347 INFO:tasks.workunit.client.0.smithi037.stderr:bucket: abort-at-trim-reshard-log-entries id: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.28 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:33:24.347 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:33:24.432 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bucket reshard --bucket abort-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:33:24.464 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:33:24.465 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:33:24.504 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.503+0000 7fe0c6125800 20 rados->read ofs=0 len=0 2024-09-12T17:33:24.506 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.504+0000 7fe0c6125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:24.506 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.504+0000 7fe0c6125800 20 realm 2024-09-12T17:33:24.506 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.504+0000 7fe0c6125800 20 rados->read ofs=0 len=0 2024-09-12T17:33:24.506 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.504+0000 7fe0c6125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:24.507 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.504+0000 7fe0c6125800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:33:24.507 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.504+0000 7fe0c6125800 20 rados->read ofs=0 len=0 2024-09-12T17:33:24.507 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.505+0000 7fe0c6125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:24.507 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.505+0000 7fe0c6125800 20 rados->read ofs=0 len=0 2024-09-12T17:33:24.507 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.506+0000 7fe0c6125800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:33:24.507 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.506+0000 7fe0c6125800 20 rados->read ofs=0 len=0 2024-09-12T17:33:24.507 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.506+0000 7fe0c6125800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:33:24.507 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.506+0000 7fe0c6125800 20 searching for the correct realm 2024-09-12T17:33:24.510 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.510+0000 7fe0c15ad640 0 -- 172.21.15.37:0/4082858630 >> [v2:172.21.15.37:6816/2964054205,v1:172.21.15.37:6817/2964054205] conn(0x5611725901c0 msgr2=0x561172592660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:33:24.514 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.513+0000 7fe0c1dae640 0 -- 172.21.15.37:0/4082858630 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7fe0b805f300 msgr2=0x7fe0b80823c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:33:24.520 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.518+0000 7fe0c6125800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:33:24.521 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.518+0000 7fe0c6125800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:33:24.521 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.518+0000 7fe0c6125800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:33:24.521 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.518+0000 7fe0c6125800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:33:24.521 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.518+0000 7fe0c6125800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:33:24.521 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.518+0000 7fe0c6125800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:33:24.521 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.518+0000 7fe0c6125800 20 rados->read ofs=0 len=0 2024-09-12T17:33:24.521 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.518+0000 7fe0c6125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:24.521 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.518+0000 7fe0c6125800 20 rados->read ofs=0 len=0 2024-09-12T17:33:24.521 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.518+0000 7fe0c6125800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:33:24.521 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.518+0000 7fe0c6125800 20 rados->read ofs=0 len=0 2024-09-12T17:33:24.521 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.519+0000 7fe0c6125800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:33:24.521 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.519+0000 7fe0c6125800 20 zone default found 2024-09-12T17:33:24.522 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.519+0000 7fe0c6125800 4 Realm: () 2024-09-12T17:33:24.522 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.519+0000 7fe0c6125800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:33:24.522 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.519+0000 7fe0c6125800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:33:24.522 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.519+0000 7fe0c6125800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:33:24.522 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.519+0000 7fe0c6125800 20 zonegroup default 2024-09-12T17:33:24.523 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.519+0000 7fe0c6125800 20 rados->read ofs=0 len=0 2024-09-12T17:33:24.523 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.519+0000 7fe0c6125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:24.523 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.519+0000 7fe0c6125800 20 rados->read ofs=0 len=0 2024-09-12T17:33:24.524 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.520+0000 7fe0c6125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:24.524 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.520+0000 7fe0c6125800 20 rados->read ofs=0 len=0 2024-09-12T17:33:24.524 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.520+0000 7fe0c6125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:24.524 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.520+0000 7fe0c6125800 20 started sync module instance, tier type = 2024-09-12T17:33:24.524 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.520+0000 7fe0c6125800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:33:24.534 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.533+0000 7fe0c6125800 20 add_watcher() i=0 2024-09-12T17:33:24.534 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.533+0000 7fe0c6125800 20 add_watcher() i=1 2024-09-12T17:33:24.535 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.533+0000 7fe0c6125800 20 add_watcher() i=2 2024-09-12T17:33:24.535 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.533+0000 7fe0c6125800 20 add_watcher() i=3 2024-09-12T17:33:24.535 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.533+0000 7fe0c6125800 20 add_watcher() i=4 2024-09-12T17:33:24.535 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.533+0000 7fe0c6125800 20 add_watcher() i=5 2024-09-12T17:33:24.535 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.533+0000 7fe0c6125800 20 add_watcher() i=6 2024-09-12T17:33:24.535 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.534+0000 7fe0c6125800 20 add_watcher() i=7 2024-09-12T17:33:24.535 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.534+0000 7fe0c6125800 2 all 8 watchers are set, enabling cache 2024-09-12T17:33:24.536 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.536+0000 7fdf737fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:33:24.537 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.536+0000 7fe0c6125800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:33:24.538 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.536+0000 7fe0c6125800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:33:24.538 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.536+0000 7fe0c6125800 5 note: GC not initialized 2024-09-12T17:33:24.538 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.536+0000 7fdf727fc640 20 reqs_thread_entry: start 2024-09-12T17:33:24.538 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.537+0000 7fe0c6125800 20 init_complete bucket index max shards: 11 2024-09-12T17:33:24.539 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.537+0000 7fe0c6125800 20 Filter name: none 2024-09-12T17:33:24.539 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.537+0000 7fdee3fff640 20 reqs_thread_entry: start 2024-09-12T17:33:24.539 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.537+0000 7fe0c6125800 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-12T17:33:24.539 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.537+0000 7fe0c6125800 20 rados->read ofs=0 len=0 2024-09-12T17:33:24.540 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.537+0000 7fe0c6125800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T17:33:24.540 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.537+0000 7fe0c6125800 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T17:33:24.540 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.537+0000 7fe0c6125800 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-12T17:33:24.540 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.537+0000 7fe0c6125800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.28 : miss 2024-09-12T17:33:24.540 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.537+0000 7fe0c6125800 20 rados->read ofs=0 len=0 2024-09-12T17:33:24.540 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.538+0000 7fe0c6125800 20 rados_obj.operate() r=0 bl.length=479 2024-09-12T17:33:24.541 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.538+0000 7fe0c6125800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.28 info.flags=0x17 2024-09-12T17:33:24.541 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.538+0000 7fe0c6125800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.28 to cache LRU end 2024-09-12T17:33:24.541 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.538+0000 7fe0c6125800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:33:24.541 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.538+0000 7fe0c6125800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:33:24.541 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.538+0000 7fe0c6125800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.28 2024-09-12T17:33:24.541 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.539+0000 7fe0c6125800 0 INFO: RGWReshardLock::lock found lock on abort-at-trim-reshard-log-entries:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.28 to be held by another RGW process; skipping for now 2024-09-12T17:33:24.541 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.540+0000 7fdf737fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:33:24.543 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.542+0000 7fe0c6125800 20 remove_watcher() i=0 2024-09-12T17:33:24.543 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.542+0000 7fe0c6125800 2 removed watcher, disabling cache 2024-09-12T17:33:24.544 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.543+0000 7fe0c6125800 20 remove_watcher() i=1 2024-09-12T17:33:24.545 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.544+0000 7fe0c6125800 20 remove_watcher() i=2 2024-09-12T17:33:24.546 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.546+0000 7fe0c6125800 20 remove_watcher() i=3 2024-09-12T17:33:24.547 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.547+0000 7fe0c6125800 20 remove_watcher() i=4 2024-09-12T17:33:24.548 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.548+0000 7fe0c6125800 20 remove_watcher() i=5 2024-09-12T17:33:24.550 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.549+0000 7fe0c6125800 20 remove_watcher() i=6 2024-09-12T17:33:24.551 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:24.550+0000 7fe0c6125800 20 remove_watcher() i=7 2024-09-12T17:33:24.562 INFO:tasks.workunit.client.0.smithi037.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T17:33:54.594 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bucket reshard --bucket abort-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:33:54.630 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:33:54.630 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:33:54.675 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.674+0000 7f0aa9f26800 20 rados->read ofs=0 len=0 2024-09-12T17:33:54.676 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.675+0000 7f0aa9f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:54.677 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.675+0000 7f0aa9f26800 20 realm 2024-09-12T17:33:54.677 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.675+0000 7f0aa9f26800 20 rados->read ofs=0 len=0 2024-09-12T17:33:54.677 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.676+0000 7f0aa9f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:54.677 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.676+0000 7f0aa9f26800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:33:54.677 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.676+0000 7f0aa9f26800 20 rados->read ofs=0 len=0 2024-09-12T17:33:54.677 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.676+0000 7f0aa9f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:54.677 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.676+0000 7f0aa9f26800 20 rados->read ofs=0 len=0 2024-09-12T17:33:54.677 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.677+0000 7f0aa9f26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:33:54.678 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.677+0000 7f0aa9f26800 20 rados->read ofs=0 len=0 2024-09-12T17:33:54.678 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.677+0000 7f0aa9f26800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:33:54.678 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.677+0000 7f0aa9f26800 20 searching for the correct realm 2024-09-12T17:33:54.681 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.680+0000 7f0aa546e640 0 -- 172.21.15.37:0/3957676942 >> [v2:172.21.15.40:6800/2441293461,v1:172.21.15.40:6801/2441293461] conn(0x7f0a980468f0 msgr2=0x7f0a980453b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:33:54.686 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.686+0000 7f0aa5c6f640 0 -- 172.21.15.37:0/3957676942 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7f0a9c05a400 msgr2=0x7f0a9c05a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:33:54.895 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.894+0000 7f0aa9f26800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:33:54.895 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.894+0000 7f0aa9f26800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:33:54.895 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.894+0000 7f0aa9f26800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:33:54.895 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.894+0000 7f0aa9f26800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:33:54.895 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.894+0000 7f0aa9f26800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:33:54.895 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.894+0000 7f0aa9f26800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:33:54.895 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.894+0000 7f0aa9f26800 20 rados->read ofs=0 len=0 2024-09-12T17:33:54.895 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.894+0000 7f0aa9f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:54.896 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.894+0000 7f0aa9f26800 20 rados->read ofs=0 len=0 2024-09-12T17:33:54.897 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.895+0000 7f0aa9f26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:33:54.897 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.895+0000 7f0aa9f26800 20 rados->read ofs=0 len=0 2024-09-12T17:33:54.897 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.895+0000 7f0aa9f26800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:33:54.897 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.895+0000 7f0aa9f26800 20 zone default found 2024-09-12T17:33:54.897 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.895+0000 7f0aa9f26800 4 Realm: () 2024-09-12T17:33:54.897 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.895+0000 7f0aa9f26800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:33:54.897 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.895+0000 7f0aa9f26800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:33:54.897 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.895+0000 7f0aa9f26800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:33:54.898 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.895+0000 7f0aa9f26800 20 zonegroup default 2024-09-12T17:33:54.898 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.895+0000 7f0aa9f26800 20 rados->read ofs=0 len=0 2024-09-12T17:33:54.898 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.895+0000 7f0aa9f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:54.898 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.895+0000 7f0aa9f26800 20 rados->read ofs=0 len=0 2024-09-12T17:33:54.898 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.896+0000 7f0aa9f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:54.898 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.896+0000 7f0aa9f26800 20 rados->read ofs=0 len=0 2024-09-12T17:33:54.898 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.896+0000 7f0aa9f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:54.898 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.896+0000 7f0aa9f26800 20 started sync module instance, tier type = 2024-09-12T17:33:54.898 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.896+0000 7f0aa9f26800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:33:54.908 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.907+0000 7f0aa9f26800 20 add_watcher() i=0 2024-09-12T17:33:54.908 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.907+0000 7f0aa9f26800 20 add_watcher() i=1 2024-09-12T17:33:54.908 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.907+0000 7f0aa9f26800 20 add_watcher() i=2 2024-09-12T17:33:54.908 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.907+0000 7f0aa9f26800 20 add_watcher() i=3 2024-09-12T17:33:54.908 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.907+0000 7f0aa9f26800 20 add_watcher() i=4 2024-09-12T17:33:54.908 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.907+0000 7f0aa9f26800 20 add_watcher() i=5 2024-09-12T17:33:54.908 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.907+0000 7f0aa9f26800 20 add_watcher() i=6 2024-09-12T17:33:54.909 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.908+0000 7f0aa9f26800 20 add_watcher() i=7 2024-09-12T17:33:54.909 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.908+0000 7f0aa9f26800 2 all 8 watchers are set, enabling cache 2024-09-12T17:33:54.911 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.910+0000 7f09577fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:33:54.912 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.911+0000 7f0aa9f26800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:33:54.912 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.911+0000 7f0aa9f26800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:33:54.912 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.911+0000 7f0aa9f26800 5 note: GC not initialized 2024-09-12T17:33:54.912 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.911+0000 7f09567fc640 20 reqs_thread_entry: start 2024-09-12T17:33:54.912 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.911+0000 7f0aa9f26800 20 init_complete bucket index max shards: 11 2024-09-12T17:33:54.912 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.911+0000 7f0aa9f26800 20 Filter name: none 2024-09-12T17:33:54.912 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.911+0000 7f08c7fff640 20 reqs_thread_entry: start 2024-09-12T17:33:54.913 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.911+0000 7f0aa9f26800 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-12T17:33:54.913 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.911+0000 7f0aa9f26800 20 rados->read ofs=0 len=0 2024-09-12T17:33:54.913 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.912+0000 7f0aa9f26800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T17:33:54.913 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.912+0000 7f0aa9f26800 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T17:33:54.914 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.912+0000 7f0aa9f26800 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-12T17:33:54.914 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.912+0000 7f0aa9f26800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.28 : miss 2024-09-12T17:33:54.914 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.912+0000 7f0aa9f26800 20 rados->read ofs=0 len=0 2024-09-12T17:33:54.914 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.912+0000 7f0aa9f26800 20 rados_obj.operate() r=0 bl.length=479 2024-09-12T17:33:54.914 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.912+0000 7f0aa9f26800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.28 info.flags=0x17 2024-09-12T17:33:54.914 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.912+0000 7f0aa9f26800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.28 to cache LRU end 2024-09-12T17:33:54.914 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.912+0000 7f0aa9f26800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:33:54.914 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.912+0000 7f0aa9f26800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:33:54.914 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.912+0000 7f0aa9f26800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.28 2024-09-12T17:33:54.915 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.914+0000 7f0aa9f26800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T17:33:54.922 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.921+0000 7f0aa9f26800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.28 info.flags=0x17 2024-09-12T17:33:54.922 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.921+0000 7f0aa9f26800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.28 to cache LRU end 2024-09-12T17:33:54.922 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.921+0000 7f0aa9f26800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:33:54.922 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.921+0000 7f0aa9f26800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.28, ofs0, ns] 2024-09-12T17:33:54.923 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.922+0000 7f0988ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497054 cookie 93944469756064 notifier 6557 bl.length()=1023 2024-09-12T17:33:54.923 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.922+0000 7f0988ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.28 info.flags=0x17 2024-09-12T17:33:54.923 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.922+0000 7f0988ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.28 to cache LRU end 2024-09-12T17:33:54.923 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.922+0000 7f0988ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:33:54.924 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.923+0000 7f0aa9f26800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.28]): orig_sources= new_sources= 2024-09-12T17:33:54.924 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.923+0000 7f0aa9f26800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.28]): potential sources added=[] removed=[] 2024-09-12T17:33:54.924 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.923+0000 7f0aa9f26800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.28]): orig_dests= new_dests= 2024-09-12T17:33:54.924 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.923+0000 7f0aa9f26800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.28]): potential dests added=[] removed=[] 2024-09-12T17:33:54.934 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.929+0000 7f0aa9f26800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.28.2.0 2024-09-12T17:33:54.934 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.929+0000 7f0aa9f26800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.28.2.0 2024-09-12T17:33:54.935 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.929+0000 7f0aa9f26800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.28.2.1 2024-09-12T17:33:54.935 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.929+0000 7f0aa9f26800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.28.2.1 2024-09-12T17:33:54.935 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.929+0000 7f0aa9f26800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.28.2.2 2024-09-12T17:33:54.935 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.929+0000 7f0aa9f26800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.28.2.2 2024-09-12T17:33:54.935 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.929+0000 7f0aa9f26800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.28.2.3 2024-09-12T17:33:54.935 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.929+0000 7f0aa9f26800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.28.2.3 2024-09-12T17:33:54.935 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.929+0000 7f0aa9f26800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.28.2.4 2024-09-12T17:33:54.935 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.929+0000 7f0aa9f26800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.28.2.4 2024-09-12T17:33:54.935 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.929+0000 7f0aa9f26800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.28.2.5 2024-09-12T17:33:54.935 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.929+0000 7f0aa9f26800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.28.2.5 2024-09-12T17:33:54.935 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.929+0000 7f0aa9f26800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.28.2.6 2024-09-12T17:33:54.935 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.929+0000 7f0aa9f26800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.28.2.6 2024-09-12T17:33:54.935 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.929+0000 7f0aa9f26800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.28.2.7 2024-09-12T17:33:54.935 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.929+0000 7f0aa9f26800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.28.2.7 2024-09-12T17:33:54.936 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.929+0000 7f0aa9f26800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.28.2.8 2024-09-12T17:33:54.936 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.929+0000 7f0aa9f26800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.28.2.8 2024-09-12T17:33:54.936 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.929+0000 7f0aa9f26800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.28.2.9 2024-09-12T17:33:54.936 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.929+0000 7f0aa9f26800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.28.2.9 2024-09-12T17:33:54.936 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.929+0000 7f0aa9f26800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.28.2.10 2024-09-12T17:33:54.936 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.929+0000 7f0aa9f26800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.28.2.10 2024-09-12T17:33:54.936 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.929+0000 7f0aa9f26800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.28.2.11 2024-09-12T17:33:54.936 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.929+0000 7f0aa9f26800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.28.2.11 2024-09-12T17:33:54.936 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.929+0000 7f0aa9f26800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.28.0 2024-09-12T17:33:54.936 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.929+0000 7f0aa9f26800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.28.1 2024-09-12T17:33:54.937 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.930+0000 7f0aa9f26800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.28.2 2024-09-12T17:33:54.937 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.930+0000 7f0aa9f26800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.28.3 2024-09-12T17:33:54.937 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.931+0000 7f0aa9f26800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.28.4 2024-09-12T17:33:54.937 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.932+0000 7f0aa9f26800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.28.5 2024-09-12T17:33:54.937 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.932+0000 7f0aa9f26800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.28.6 2024-09-12T17:33:54.937 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.933+0000 7f0aa9f26800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.28.7 2024-09-12T17:33:54.938 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.933+0000 7f0aa9f26800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.28.8 2024-09-12T17:33:54.938 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.934+0000 7f0aa9f26800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.28.9 2024-09-12T17:33:54.938 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.934+0000 7f0aa9f26800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.28.10 2024-09-12T17:33:54.939 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.938+0000 7f0aa9f26800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.28 : hit (requested=0x17, cached=0x17) 2024-09-12T17:33:54.939 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.938+0000 7f0aa9f26800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.28 2024-09-12T17:33:54.940 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.940+0000 7f0aa9f26800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.28 info.flags=0x17 2024-09-12T17:33:54.940 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.940+0000 7f0aa9f26800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.28 to cache LRU end 2024-09-12T17:33:54.941 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.940+0000 7f0aa9f26800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:33:54.941 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.940+0000 7f0aa9f26800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.28, ofs0, ns] 2024-09-12T17:33:54.941 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.940+0000 7f09897fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497055 cookie 93944469756064 notifier 6557 bl.length()=1023 2024-09-12T17:33:54.941 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.940+0000 7f09897fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.28 info.flags=0x17 2024-09-12T17:33:54.941 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.940+0000 7f09897fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.28 to cache LRU end 2024-09-12T17:33:54.941 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.940+0000 7f09897fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:33:54.942 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.942+0000 7f0aa9f26800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.28]): orig_sources= new_sources= 2024-09-12T17:33:54.942 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.942+0000 7f0aa9f26800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.28]): potential sources added=[] removed=[] 2024-09-12T17:33:54.942 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.942+0000 7f0aa9f26800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.28]): orig_dests= new_dests= 2024-09-12T17:33:54.942 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.942+0000 7f0aa9f26800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.28]): potential dests added=[] removed=[] 2024-09-12T17:33:54.947 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.946+0000 7f0aa9f26800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.28.0 2024-09-12T17:33:54.947 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.946+0000 7f0aa9f26800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.28.1 2024-09-12T17:33:54.948 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.947+0000 7f0aa9f26800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.28.2 2024-09-12T17:33:54.948 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.947+0000 7f0aa9f26800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.28.3 2024-09-12T17:33:54.948 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.948+0000 7f0aa9f26800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.28.4 2024-09-12T17:33:54.949 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.948+0000 7f0aa9f26800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.28.5 2024-09-12T17:33:54.949 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.949+0000 7f0aa9f26800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.28.6 2024-09-12T17:33:54.950 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.949+0000 7f0aa9f26800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.28.7 2024-09-12T17:33:54.950 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.949+0000 7f0aa9f26800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.28.8 2024-09-12T17:33:54.951 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.950+0000 7f0aa9f26800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.28.9 2024-09-12T17:33:54.951 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.950+0000 7f0aa9f26800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.28.10 2024-09-12T17:33:54.951 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.951+0000 7f0aa9f26800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.28 : hit (requested=0x17, cached=0x17) 2024-09-12T17:33:54.951 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.951+0000 7f0aa9f26800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.28 2024-09-12T17:33:54.953 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.952+0000 7f0aa9f26800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.28 info.flags=0x17 2024-09-12T17:33:54.953 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.952+0000 7f0aa9f26800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.28 to cache LRU end 2024-09-12T17:33:54.953 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.952+0000 7f0aa9f26800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:33:54.953 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.952+0000 7f0aa9f26800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.28, ofs0, ns] 2024-09-12T17:33:54.953 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.952+0000 7f0988ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497056 cookie 93944469756064 notifier 6557 bl.length()=991 2024-09-12T17:33:54.954 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.952+0000 7f0988ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.28 info.flags=0x17 2024-09-12T17:33:54.954 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.952+0000 7f0988ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.28 to cache LRU end 2024-09-12T17:33:54.954 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.952+0000 7f0988ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:33:54.955 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.954+0000 7f0aa9f26800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.28]): orig_sources= new_sources= 2024-09-12T17:33:54.955 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.954+0000 7f0aa9f26800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.28]): potential sources added=[] removed=[] 2024-09-12T17:33:54.955 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.954+0000 7f0aa9f26800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.28]): orig_dests= new_dests= 2024-09-12T17:33:54.955 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.954+0000 7f0aa9f26800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.28]): potential dests added=[] removed=[] 2024-09-12T17:33:54.959 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.958+0000 7f0aa9f26800 1 execute INFO: reshard of bucket "abort-at-trim-reshard-log-entries" from 11 shards to 12 shards completed successfully 2024-09-12T17:33:54.961 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.961+0000 7f09577fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:33:54.964 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.963+0000 7f0aa9f26800 20 remove_watcher() i=0 2024-09-12T17:33:54.964 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.963+0000 7f0aa9f26800 2 removed watcher, disabling cache 2024-09-12T17:33:54.965 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.964+0000 7f0aa9f26800 20 remove_watcher() i=1 2024-09-12T17:33:54.966 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.965+0000 7f0aa9f26800 20 remove_watcher() i=2 2024-09-12T17:33:54.967 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.967+0000 7f0aa9f26800 20 remove_watcher() i=3 2024-09-12T17:33:54.968 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.968+0000 7f0aa9f26800 20 remove_watcher() i=4 2024-09-12T17:33:54.969 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.969+0000 7f0aa9f26800 20 remove_watcher() i=5 2024-09-12T17:33:54.970 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.970+0000 7f0aa9f26800 20 remove_watcher() i=6 2024-09-12T17:33:54.972 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:54.971+0000 7f0aa9f26800 20 remove_watcher() i=7 2024-09-12T17:33:54.986 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bucket stats --bucket abort-at-trim-reshard-log-entries 2024-09-12T17:33:55.015 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:33:55.015 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:33:55.055 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:55.054+0000 7fafb1726800 20 rados->read ofs=0 len=0 2024-09-12T17:33:55.057 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:55.056+0000 7fafb1726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:55.057 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:55.056+0000 7fafb1726800 20 realm 2024-09-12T17:33:55.058 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:55.056+0000 7fafb1726800 20 rados->read ofs=0 len=0 2024-09-12T17:33:55.058 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:55.056+0000 7fafb1726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:55.058 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:55.056+0000 7fafb1726800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:33:55.058 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:55.056+0000 7fafb1726800 20 rados->read ofs=0 len=0 2024-09-12T17:33:55.058 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:55.056+0000 7fafb1726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:55.058 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:55.056+0000 7fafb1726800 20 rados->read ofs=0 len=0 2024-09-12T17:33:55.058 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:55.057+0000 7fafb1726800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:33:55.059 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:55.057+0000 7fafb1726800 20 rados->read ofs=0 len=0 2024-09-12T17:33:55.059 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:55.058+0000 7fafb1726800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:33:55.059 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:55.058+0000 7fafb1726800 20 searching for the correct realm 2024-09-12T17:33:55.062 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:55.062+0000 7fafadb0a640 0 -- 172.21.15.37:0/3898629556 >> [v2:172.21.15.40:6808/2253405131,v1:172.21.15.40:6809/2253405131] conn(0x7fafa40dcb60 msgr2=0x7fafa40b9a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:33:55.270 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:55.269+0000 7fafad309640 0 -- 172.21.15.37:0/3898629556 >> [v2:172.21.15.40:6826/4130399962,v1:172.21.15.40:6827/4130399962] conn(0x55cbb04ecb40 msgr2=0x55cbb04eefd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:33:55.273 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:55.272+0000 7fafb1726800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:33:55.274 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:55.272+0000 7fafb1726800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:33:55.274 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:55.272+0000 7fafb1726800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:33:55.274 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:55.272+0000 7fafb1726800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:33:55.274 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:55.272+0000 7fafb1726800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:33:55.274 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:55.272+0000 7fafb1726800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:33:55.274 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:55.272+0000 7fafb1726800 20 rados->read ofs=0 len=0 2024-09-12T17:33:55.274 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:55.273+0000 7fafb1726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:55.274 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:55.273+0000 7fafb1726800 20 rados->read ofs=0 len=0 2024-09-12T17:33:55.275 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:55.273+0000 7fafb1726800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:33:55.275 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:55.273+0000 7fafb1726800 20 rados->read ofs=0 len=0 2024-09-12T17:33:55.275 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:55.274+0000 7fafb1726800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:33:55.275 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:55.274+0000 7fafb1726800 20 zone default found 2024-09-12T17:33:55.275 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:55.274+0000 7fafb1726800 4 Realm: () 2024-09-12T17:33:55.275 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:55.274+0000 7fafb1726800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:33:55.276 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:55.274+0000 7fafb1726800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:33:55.276 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:55.274+0000 7fafb1726800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:33:55.276 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:55.274+0000 7fafb1726800 20 zonegroup default 2024-09-12T17:33:55.276 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:55.274+0000 7fafb1726800 20 rados->read ofs=0 len=0 2024-09-12T17:33:55.276 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:55.274+0000 7fafb1726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:55.276 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:55.274+0000 7fafb1726800 20 rados->read ofs=0 len=0 2024-09-12T17:33:55.276 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:55.274+0000 7fafb1726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:55.276 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:55.274+0000 7fafb1726800 20 rados->read ofs=0 len=0 2024-09-12T17:33:55.276 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:55.275+0000 7fafb1726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:55.276 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:55.275+0000 7fafb1726800 20 started sync module instance, tier type = 2024-09-12T17:33:55.276 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:55.275+0000 7fafb1726800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:33:55.286 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:55.285+0000 7fafb1726800 20 add_watcher() i=0 2024-09-12T17:33:55.286 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:55.285+0000 7fafb1726800 20 add_watcher() i=1 2024-09-12T17:33:55.286 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:55.285+0000 7fafb1726800 20 add_watcher() i=2 2024-09-12T17:33:55.286 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:55.285+0000 7fafb1726800 20 add_watcher() i=3 2024-09-12T17:33:55.286 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:55.285+0000 7fafb1726800 20 add_watcher() i=4 2024-09-12T17:33:55.286 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:55.285+0000 7fafb1726800 20 add_watcher() i=5 2024-09-12T17:33:55.287 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:55.285+0000 7fafb1726800 20 add_watcher() i=6 2024-09-12T17:33:55.287 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:55.286+0000 7fafb1726800 20 add_watcher() i=7 2024-09-12T17:33:55.287 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:55.286+0000 7fafb1726800 2 all 8 watchers are set, enabling cache 2024-09-12T17:33:55.289 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:55.288+0000 7fae63fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:33:55.289 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:55.288+0000 7fafb1726800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:33:55.290 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:55.288+0000 7fafb1726800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:33:55.290 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:55.288+0000 7fafb1726800 5 note: GC not initialized 2024-09-12T17:33:55.290 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:55.288+0000 7fae62fe5640 20 reqs_thread_entry: start 2024-09-12T17:33:55.290 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:55.288+0000 7fafb1726800 20 init_complete bucket index max shards: 11 2024-09-12T17:33:55.290 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:55.289+0000 7fafb1726800 20 Filter name: none 2024-09-12T17:33:55.290 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:55.289+0000 7fae60fe1640 20 reqs_thread_entry: start 2024-09-12T17:33:55.290 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:55.289+0000 7fafb1726800 20 rados->read ofs=0 len=0 2024-09-12T17:33:55.291 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:55.289+0000 7fafb1726800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T17:33:55.291 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:55.289+0000 7fafb1726800 20 rados->read ofs=0 len=0 2024-09-12T17:33:55.291 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:55.290+0000 7fafb1726800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T17:33:55.291 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:55.290+0000 7fafb1726800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:33:55.291 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:55.290+0000 7fafb1726800 20 rados->read ofs=0 len=0 2024-09-12T17:33:55.291 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:55.290+0000 7fafb1726800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T17:33:55.291 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:55.290+0000 7fafb1726800 20 rados->read ofs=0 len=0 2024-09-12T17:33:55.292 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:55.291+0000 7fafb1726800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T17:33:55.292 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:55.291+0000 7fafb1726800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:33:55.293 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:55.293+0000 7fae63fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:33:55.296 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:55.295+0000 7fafb1726800 20 remove_watcher() i=0 2024-09-12T17:33:55.296 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:55.295+0000 7fafb1726800 2 removed watcher, disabling cache 2024-09-12T17:33:55.297 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:55.296+0000 7fafb1726800 20 remove_watcher() i=1 2024-09-12T17:33:55.298 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:55.297+0000 7fafb1726800 20 remove_watcher() i=2 2024-09-12T17:33:55.299 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:55.299+0000 7fafb1726800 20 remove_watcher() i=3 2024-09-12T17:33:55.300 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:55.300+0000 7fafb1726800 20 remove_watcher() i=4 2024-09-12T17:33:55.301 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:55.301+0000 7fafb1726800 20 remove_watcher() i=5 2024-09-12T17:33:55.302 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:55.302+0000 7fafb1726800 20 remove_watcher() i=6 2024-09-12T17:33:55.303 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:55.303+0000 7fafb1726800 20 remove_watcher() i=7 2024-09-12T17:33:55.315 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:33:55.315 INFO:tasks.workunit.client.0.smithi037.stderr:BUCKET_STATS: 2024-09-12T17:33:55.315 INFO:tasks.workunit.client.0.smithi037.stderr:bucket: abort-at-trim-reshard-log-entries id: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.28 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T17:33:55.315 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:33:55.668 INFO:tasks.workunit.client.0.smithi037.stderr:TEST: reshard bucket with EIO injected at block_writes 2024-09-12T17:33:55.668 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:33:56.462 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-09-12T17:33:56.492 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:33:56.493 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:33:56.534 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:56.533+0000 7f838a142800 20 rados->read ofs=0 len=0 2024-09-12T17:33:56.536 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:56.535+0000 7f838a142800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:56.536 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:56.535+0000 7f838a142800 20 realm 2024-09-12T17:33:56.536 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:56.535+0000 7f838a142800 20 rados->read ofs=0 len=0 2024-09-12T17:33:56.537 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:56.535+0000 7f838a142800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:56.537 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:56.535+0000 7f838a142800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:33:56.537 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:56.535+0000 7f838a142800 20 rados->read ofs=0 len=0 2024-09-12T17:33:56.537 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:56.536+0000 7f838a142800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:56.537 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:56.536+0000 7f838a142800 20 rados->read ofs=0 len=0 2024-09-12T17:33:56.537 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:56.536+0000 7f838a142800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:33:56.537 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:56.536+0000 7f838a142800 20 rados->read ofs=0 len=0 2024-09-12T17:33:56.538 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:56.537+0000 7f838a142800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:33:56.538 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:56.537+0000 7f838a142800 20 searching for the correct realm 2024-09-12T17:33:56.539 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:56.538+0000 7f8385e86640 0 -- 172.21.15.37:0/3957542199 >> [v2:172.21.15.37:6800/1206746176,v1:172.21.15.37:6801/1206746176] conn(0x7f8380028020 msgr2=0x7f838008aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:33:56.744 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:56.744+0000 7f8386687640 0 -- 172.21.15.37:0/3957542199 >> [v2:172.21.15.40:6818/1210108009,v1:172.21.15.40:6819/1210108009] conn(0x7f837c038030 msgr2=0x7f837c017450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:33:56.750 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:56.749+0000 7f838a142800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:33:56.751 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:56.749+0000 7f838a142800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:33:56.751 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:56.749+0000 7f838a142800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:33:56.751 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:56.749+0000 7f838a142800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:33:56.751 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:56.749+0000 7f838a142800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:33:56.751 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:56.749+0000 7f838a142800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:33:56.751 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:56.749+0000 7f838a142800 20 rados->read ofs=0 len=0 2024-09-12T17:33:56.751 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:56.750+0000 7f838a142800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:56.751 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:56.750+0000 7f838a142800 20 rados->read ofs=0 len=0 2024-09-12T17:33:56.752 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:56.750+0000 7f838a142800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:33:56.752 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:56.750+0000 7f838a142800 20 rados->read ofs=0 len=0 2024-09-12T17:33:56.752 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:56.750+0000 7f838a142800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:33:56.753 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:56.750+0000 7f838a142800 20 zone default found 2024-09-12T17:33:56.753 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:56.750+0000 7f838a142800 4 Realm: () 2024-09-12T17:33:56.753 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:56.750+0000 7f838a142800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:33:56.753 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:56.750+0000 7f838a142800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:33:56.753 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:56.750+0000 7f838a142800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:33:56.753 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:56.750+0000 7f838a142800 20 zonegroup default 2024-09-12T17:33:56.753 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:56.750+0000 7f838a142800 20 rados->read ofs=0 len=0 2024-09-12T17:33:56.753 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:56.751+0000 7f838a142800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:56.753 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:56.751+0000 7f838a142800 20 rados->read ofs=0 len=0 2024-09-12T17:33:56.753 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:56.751+0000 7f838a142800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:56.753 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:56.751+0000 7f838a142800 20 rados->read ofs=0 len=0 2024-09-12T17:33:56.753 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:56.751+0000 7f838a142800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:56.753 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:56.751+0000 7f838a142800 20 started sync module instance, tier type = 2024-09-12T17:33:56.754 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:56.751+0000 7f838a142800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:33:56.762 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:56.761+0000 7f838a142800 20 add_watcher() i=0 2024-09-12T17:33:56.762 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:56.761+0000 7f838a142800 20 add_watcher() i=1 2024-09-12T17:33:56.762 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:56.761+0000 7f838a142800 20 add_watcher() i=2 2024-09-12T17:33:56.763 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:56.761+0000 7f838a142800 20 add_watcher() i=3 2024-09-12T17:33:56.763 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:56.761+0000 7f838a142800 20 add_watcher() i=4 2024-09-12T17:33:56.763 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:56.761+0000 7f838a142800 20 add_watcher() i=5 2024-09-12T17:33:56.763 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:56.761+0000 7f838a142800 20 add_watcher() i=6 2024-09-12T17:33:56.763 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:56.762+0000 7f838a142800 20 add_watcher() i=7 2024-09-12T17:33:56.763 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:56.762+0000 7f838a142800 2 all 8 watchers are set, enabling cache 2024-09-12T17:33:56.764 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:56.763+0000 7f8237fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:33:56.765 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:56.764+0000 7f838a142800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:33:56.766 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:56.764+0000 7f838a142800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:33:56.766 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:56.764+0000 7f838a142800 5 note: GC not initialized 2024-09-12T17:33:56.766 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:56.764+0000 7f8236ffd640 20 reqs_thread_entry: start 2024-09-12T17:33:56.766 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:56.764+0000 7f838a142800 20 init_complete bucket index max shards: 11 2024-09-12T17:33:56.766 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:56.764+0000 7f838a142800 20 Filter name: none 2024-09-12T17:33:56.766 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:56.765+0000 7f8234ff9640 20 reqs_thread_entry: start 2024-09-12T17:33:56.766 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:56.765+0000 7f838a142800 20 rados->read ofs=0 len=0 2024-09-12T17:33:56.768 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:56.765+0000 7f838a142800 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T17:33:56.768 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:56.765+0000 7f838a142800 20 rados->read ofs=0 len=0 2024-09-12T17:33:56.768 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:56.766+0000 7f838a142800 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T17:33:56.768 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:56.766+0000 7f838a142800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:33:56.768 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:56.766+0000 7f838a142800 20 rados->read ofs=0 len=0 2024-09-12T17:33:56.769 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:56.766+0000 7f838a142800 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T17:33:56.769 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:56.766+0000 7f838a142800 20 rados->read ofs=0 len=0 2024-09-12T17:33:56.769 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:56.767+0000 7f838a142800 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T17:33:56.769 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:56.767+0000 7f838a142800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:33:56.769 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:56.768+0000 7f8237fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:33:56.775 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:56.771+0000 7f838a142800 20 remove_watcher() i=0 2024-09-12T17:33:56.775 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:56.771+0000 7f838a142800 2 removed watcher, disabling cache 2024-09-12T17:33:56.775 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:56.772+0000 7f838a142800 20 remove_watcher() i=1 2024-09-12T17:33:56.775 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:56.773+0000 7f838a142800 20 remove_watcher() i=2 2024-09-12T17:33:56.776 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:56.774+0000 7f838a142800 20 remove_watcher() i=3 2024-09-12T17:33:56.776 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:56.775+0000 7f838a142800 20 remove_watcher() i=4 2024-09-12T17:33:56.777 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:56.776+0000 7f838a142800 20 remove_watcher() i=5 2024-09-12T17:33:56.779 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:56.778+0000 7f838a142800 20 remove_watcher() i=6 2024-09-12T17:33:56.780 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:56.779+0000 7f838a142800 20 remove_watcher() i=7 2024-09-12T17:33:56.791 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:33:56.792 INFO:tasks.workunit.client.0.smithi037.stderr:BUCKET_STATS: 2024-09-12T17:33:56.792 INFO:tasks.workunit.client.0.smithi037.stderr:bucket: error-at-block-writes id: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.29 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:33:56.792 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:33:56.792 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bucket reshard --bucket error-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at block_writes 2024-09-12T17:33:56.827 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:33:56.827 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:33:56.866 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:56.865+0000 7f5973531800 20 rados->read ofs=0 len=0 2024-09-12T17:33:56.867 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:56.867+0000 7f5973531800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:56.868 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:56.867+0000 7f5973531800 20 realm 2024-09-12T17:33:56.868 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:56.867+0000 7f5973531800 20 rados->read ofs=0 len=0 2024-09-12T17:33:56.868 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:56.867+0000 7f5973531800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:56.868 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:56.867+0000 7f5973531800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:33:56.868 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:56.867+0000 7f5973531800 20 rados->read ofs=0 len=0 2024-09-12T17:33:56.868 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:56.867+0000 7f5973531800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:56.869 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:56.867+0000 7f5973531800 20 rados->read ofs=0 len=0 2024-09-12T17:33:56.869 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:56.868+0000 7f5973531800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:33:56.869 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:56.868+0000 7f5973531800 20 rados->read ofs=0 len=0 2024-09-12T17:33:56.870 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:56.869+0000 7f5973531800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:33:56.870 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:56.869+0000 7f5973531800 20 searching for the correct realm 2024-09-12T17:33:56.872 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:56.872+0000 7f596ea19640 0 -- 172.21.15.37:0/2555534998 >> [v2:172.21.15.40:6800/2441293461,v1:172.21.15.40:6801/2441293461] conn(0x7f5960047030 msgr2=0x7f5960047410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:33:56.876 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:56.875+0000 7f596f21a640 0 -- 172.21.15.37:0/2555534998 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7f5958040b40 msgr2=0x7f595809f370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:33:57.083 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.081+0000 7f5973531800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:33:57.083 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.081+0000 7f5973531800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:33:57.083 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.081+0000 7f5973531800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:33:57.083 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.081+0000 7f5973531800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:33:57.083 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.081+0000 7f5973531800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:33:57.083 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.081+0000 7f5973531800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:33:57.083 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.081+0000 7f5973531800 20 rados->read ofs=0 len=0 2024-09-12T17:33:57.083 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.082+0000 7f5973531800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:57.083 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.082+0000 7f5973531800 20 rados->read ofs=0 len=0 2024-09-12T17:33:57.084 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.082+0000 7f5973531800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:33:57.085 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.082+0000 7f5973531800 20 rados->read ofs=0 len=0 2024-09-12T17:33:57.085 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.083+0000 7f5973531800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:33:57.085 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.083+0000 7f5973531800 20 zone default found 2024-09-12T17:33:57.085 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.083+0000 7f5973531800 4 Realm: () 2024-09-12T17:33:57.085 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.083+0000 7f5973531800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:33:57.085 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.083+0000 7f5973531800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:33:57.085 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.083+0000 7f5973531800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:33:57.085 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.083+0000 7f5973531800 20 zonegroup default 2024-09-12T17:33:57.085 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.083+0000 7f5973531800 20 rados->read ofs=0 len=0 2024-09-12T17:33:57.086 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.083+0000 7f5973531800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:57.086 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.083+0000 7f5973531800 20 rados->read ofs=0 len=0 2024-09-12T17:33:57.086 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.083+0000 7f5973531800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:57.086 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.083+0000 7f5973531800 20 rados->read ofs=0 len=0 2024-09-12T17:33:57.086 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.084+0000 7f5973531800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:57.086 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.084+0000 7f5973531800 20 started sync module instance, tier type = 2024-09-12T17:33:57.086 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.084+0000 7f5973531800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:33:57.094 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.093+0000 7f5973531800 20 add_watcher() i=0 2024-09-12T17:33:57.094 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.093+0000 7f5973531800 20 add_watcher() i=1 2024-09-12T17:33:57.095 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.093+0000 7f5973531800 20 add_watcher() i=2 2024-09-12T17:33:57.095 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.093+0000 7f5973531800 20 add_watcher() i=3 2024-09-12T17:33:57.095 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.093+0000 7f5973531800 20 add_watcher() i=4 2024-09-12T17:33:57.095 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.093+0000 7f5973531800 20 add_watcher() i=5 2024-09-12T17:33:57.095 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.093+0000 7f5973531800 20 add_watcher() i=6 2024-09-12T17:33:57.095 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.094+0000 7f5973531800 20 add_watcher() i=7 2024-09-12T17:33:57.096 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.094+0000 7f5973531800 2 all 8 watchers are set, enabling cache 2024-09-12T17:33:57.097 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.096+0000 7f5825fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:33:57.098 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.097+0000 7f5973531800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:33:57.098 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.097+0000 7f5973531800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:33:57.099 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.097+0000 7f5973531800 5 note: GC not initialized 2024-09-12T17:33:57.099 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.097+0000 7f5824fe1640 20 reqs_thread_entry: start 2024-09-12T17:33:57.099 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.097+0000 7f5973531800 20 init_complete bucket index max shards: 11 2024-09-12T17:33:57.099 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.097+0000 7f5973531800 20 Filter name: none 2024-09-12T17:33:57.099 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.097+0000 7f579e7fc640 20 reqs_thread_entry: start 2024-09-12T17:33:57.099 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.097+0000 7f5973531800 10 cache get: name=default.rgw.meta+root+error-at-block-writes : miss 2024-09-12T17:33:57.099 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.097+0000 7f5973531800 20 rados->read ofs=0 len=0 2024-09-12T17:33:57.100 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.098+0000 7f5973531800 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T17:33:57.100 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.098+0000 7f5973531800 10 cache put: name=default.rgw.meta+root+error-at-block-writes info.flags=0x11 2024-09-12T17:33:57.100 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.098+0000 7f5973531800 10 adding default.rgw.meta+root+error-at-block-writes to cache LRU end 2024-09-12T17:33:57.100 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.098+0000 7f5973531800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.29 : miss 2024-09-12T17:33:57.100 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.098+0000 7f5973531800 20 rados->read ofs=0 len=0 2024-09-12T17:33:57.100 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.098+0000 7f5973531800 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T17:33:57.100 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.098+0000 7f5973531800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.29 info.flags=0x17 2024-09-12T17:33:57.100 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.098+0000 7f5973531800 10 adding default.rgw.meta+root+.bucket.meta.error-at-block-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.29 to cache LRU end 2024-09-12T17:33:57.101 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.098+0000 7f5973531800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:33:57.101 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.098+0000 7f5973531800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:33:57.101 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.098+0000 7f5973531800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.29 2024-09-12T17:33:57.104 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.104+0000 7f5973531800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.29 info.flags=0x17 2024-09-12T17:33:57.104 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.104+0000 7f5973531800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.29 to cache LRU end 2024-09-12T17:33:57.104 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.104+0000 7f5973531800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:33:57.105 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.104+0000 7f5973531800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.29, ofs0, ns] 2024-09-12T17:33:57.105 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.104+0000 7f58527fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496989 cookie 94468212051680 notifier 6605 bl.length()=999 2024-09-12T17:33:57.105 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.104+0000 7f58527fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.29 info.flags=0x17 2024-09-12T17:33:57.105 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.104+0000 7f58527fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.29 to cache LRU end 2024-09-12T17:33:57.105 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.104+0000 7f58527fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:33:57.106 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.106+0000 7f5973531800 20 handle_bi_update(): bucket=:error-at-block-writes[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.29]): orig_sources= new_sources= 2024-09-12T17:33:57.106 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.106+0000 7f5973531800 20 handle_bi_update(): bucket=:error-at-block-writes[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.29]): potential sources added=[] removed=[] 2024-09-12T17:33:57.106 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.106+0000 7f5973531800 20 handle_bi_update(): bucket=:error-at-block-writes[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.29]): orig_dests= new_dests= 2024-09-12T17:33:57.107 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.106+0000 7f5973531800 20 handle_bi_update(): bucket=:error-at-block-writes[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.29]): potential dests added=[] removed=[] 2024-09-12T17:33:57.114 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.112+0000 7f5973531800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.29.1.0 2024-09-12T17:33:57.114 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.112+0000 7f5973531800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.29.1.0 2024-09-12T17:33:57.114 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.112+0000 7f5973531800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.29.1.1 2024-09-12T17:33:57.114 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.112+0000 7f5973531800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.29.1.1 2024-09-12T17:33:57.114 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.112+0000 7f5973531800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.29.1.2 2024-09-12T17:33:57.114 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.112+0000 7f5973531800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.29.1.2 2024-09-12T17:33:57.114 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.112+0000 7f5973531800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.29.1.3 2024-09-12T17:33:57.114 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.112+0000 7f5973531800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.29.1.3 2024-09-12T17:33:57.114 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.112+0000 7f5973531800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.29.1.4 2024-09-12T17:33:57.114 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.112+0000 7f5973531800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.29.1.4 2024-09-12T17:33:57.114 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.112+0000 7f5973531800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.29.1.5 2024-09-12T17:33:57.115 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.112+0000 7f5973531800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.29.1.5 2024-09-12T17:33:57.115 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.112+0000 7f5973531800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.29.1.6 2024-09-12T17:33:57.115 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.112+0000 7f5973531800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.29.1.6 2024-09-12T17:33:57.115 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.112+0000 7f5973531800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.29.1.7 2024-09-12T17:33:57.115 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.112+0000 7f5973531800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.29.1.7 2024-09-12T17:33:57.115 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.112+0000 7f5973531800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.29.1.8 2024-09-12T17:33:57.115 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.112+0000 7f5973531800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.29.1.8 2024-09-12T17:33:57.115 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.112+0000 7f5973531800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.29.1.9 2024-09-12T17:33:57.115 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.112+0000 7f5973531800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.29.1.9 2024-09-12T17:33:57.115 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.112+0000 7f5973531800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.29.1.10 2024-09-12T17:33:57.115 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.112+0000 7f5973531800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.29.1.10 2024-09-12T17:33:57.115 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.112+0000 7f5973531800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.29.1.11 2024-09-12T17:33:57.115 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.112+0000 7f5973531800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.29.1.11 2024-09-12T17:33:57.115 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.112+0000 7f5973531800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.29.0 2024-09-12T17:33:57.116 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.113+0000 7f5973531800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.29.1 2024-09-12T17:33:57.116 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.113+0000 7f5973531800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.29.2 2024-09-12T17:33:57.116 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.114+0000 7f5973531800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.29.3 2024-09-12T17:33:57.117 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.114+0000 7f5973531800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.29.4 2024-09-12T17:33:57.117 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.115+0000 7f5973531800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.29.5 2024-09-12T17:33:57.117 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.116+0000 7f5973531800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.29.6 2024-09-12T17:33:57.117 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.116+0000 7f5973531800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.29.7 2024-09-12T17:33:57.117 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.117+0000 7f5973531800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.29.8 2024-09-12T17:33:57.118 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.117+0000 7f5973531800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.29.9 2024-09-12T17:33:57.118 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.118+0000 7f5973531800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.29.10 2024-09-12T17:33:57.123 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.122+0000 7f5973531800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.29 : hit (requested=0x17, cached=0x17) 2024-09-12T17:33:57.123 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.122+0000 7f5973531800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.29 2024-09-12T17:33:57.125 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.123+0000 7f5973531800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.29 info.flags=0x17 2024-09-12T17:33:57.125 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.123+0000 7f5973531800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.29 to cache LRU end 2024-09-12T17:33:57.125 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.123+0000 7f5973531800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:33:57.125 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.123+0000 7f5973531800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.29, ofs0, ns] 2024-09-12T17:33:57.125 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.124+0000 7f5852ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496990 cookie 94468212051680 notifier 6605 bl.length()=999 2024-09-12T17:33:57.125 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.124+0000 7f5852ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.29 info.flags=0x17 2024-09-12T17:33:57.125 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.124+0000 7f5852ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.29 to cache LRU end 2024-09-12T17:33:57.125 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.124+0000 7f5852ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:33:57.126 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.125+0000 7f5973531800 20 handle_bi_update(): bucket=:error-at-block-writes[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.29]): orig_sources= new_sources= 2024-09-12T17:33:57.126 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.125+0000 7f5973531800 20 handle_bi_update(): bucket=:error-at-block-writes[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.29]): potential sources added=[] removed=[] 2024-09-12T17:33:57.126 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.125+0000 7f5973531800 20 handle_bi_update(): bucket=:error-at-block-writes[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.29]): orig_dests= new_dests= 2024-09-12T17:33:57.126 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.125+0000 7f5973531800 20 handle_bi_update(): bucket=:error-at-block-writes[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.29]): potential dests added=[] removed=[] 2024-09-12T17:33:57.127 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.125+0000 7f5973531800 -1 Injecting error=-5 at location=block_writes 2024-09-12T17:33:57.127 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.125+0000 7f5973531800 0 ERROR: change_reshard_state failed to pause writes to the current index: (5) Input/output error 2024-09-12T17:33:57.133 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.132+0000 7f5973531800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.29 : hit (requested=0x17, cached=0x17) 2024-09-12T17:33:57.133 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.132+0000 7f5973531800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.29 2024-09-12T17:33:57.134 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.133+0000 7f5973531800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.29 info.flags=0x17 2024-09-12T17:33:57.135 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.133+0000 7f5973531800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.29 to cache LRU end 2024-09-12T17:33:57.135 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.133+0000 7f5973531800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:33:57.135 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.133+0000 7f5973531800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.29, ofs0, ns] 2024-09-12T17:33:57.135 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.133+0000 7f58527fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496991 cookie 94468212051680 notifier 6605 bl.length()=967 2024-09-12T17:33:57.135 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.133+0000 7f58527fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.29 info.flags=0x17 2024-09-12T17:33:57.135 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.133+0000 7f58527fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.29 to cache LRU end 2024-09-12T17:33:57.135 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.133+0000 7f58527fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:33:57.136 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.135+0000 7f5973531800 20 handle_bi_update(): bucket=:error-at-block-writes[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.29]): orig_sources= new_sources= 2024-09-12T17:33:57.136 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.135+0000 7f5973531800 20 handle_bi_update(): bucket=:error-at-block-writes[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.29]): potential sources added=[] removed=[] 2024-09-12T17:33:57.136 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.135+0000 7f5973531800 20 handle_bi_update(): bucket=:error-at-block-writes[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.29]): orig_dests= new_dests= 2024-09-12T17:33:57.136 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.135+0000 7f5973531800 20 handle_bi_update(): bucket=:error-at-block-writes[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.29]): potential dests added=[] removed=[] 2024-09-12T17:33:57.138 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.137+0000 7f5973531800 1 execute INFO: reshard of bucket "error-at-block-writes" canceled due to errors 2024-09-12T17:33:57.140 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.139+0000 7f5825fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:33:57.142 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.141+0000 7f5973531800 20 remove_watcher() i=0 2024-09-12T17:33:57.142 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.142+0000 7f5973531800 2 removed watcher, disabling cache 2024-09-12T17:33:57.143 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.143+0000 7f5973531800 20 remove_watcher() i=1 2024-09-12T17:33:57.145 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.144+0000 7f5973531800 20 remove_watcher() i=2 2024-09-12T17:33:57.146 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.145+0000 7f5973531800 20 remove_watcher() i=3 2024-09-12T17:33:57.147 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.146+0000 7f5973531800 20 remove_watcher() i=4 2024-09-12T17:33:57.148 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.147+0000 7f5973531800 20 remove_watcher() i=5 2024-09-12T17:33:57.149 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.148+0000 7f5973531800 20 remove_watcher() i=6 2024-09-12T17:33:57.150 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.149+0000 7f5973531800 20 remove_watcher() i=7 2024-09-12T17:33:57.163 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-09-12T17:33:57.192 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:33:57.192 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:33:57.231 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.230+0000 7f714c330800 20 rados->read ofs=0 len=0 2024-09-12T17:33:57.234 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.232+0000 7f714c330800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:57.234 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.232+0000 7f714c330800 20 realm 2024-09-12T17:33:57.234 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.232+0000 7f714c330800 20 rados->read ofs=0 len=0 2024-09-12T17:33:57.234 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.232+0000 7f714c330800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:57.234 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.232+0000 7f714c330800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:33:57.234 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.232+0000 7f714c330800 20 rados->read ofs=0 len=0 2024-09-12T17:33:57.234 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.233+0000 7f714c330800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:57.234 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.233+0000 7f714c330800 20 rados->read ofs=0 len=0 2024-09-12T17:33:57.235 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.233+0000 7f714c330800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:33:57.235 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.233+0000 7f714c330800 20 rados->read ofs=0 len=0 2024-09-12T17:33:57.236 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.234+0000 7f714c330800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:33:57.236 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.234+0000 7f714c330800 20 searching for the correct realm 2024-09-12T17:33:57.237 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.236+0000 7f71478af640 0 -- 172.21.15.37:0/1891572262 >> [v2:172.21.15.40:6800/2441293461,v1:172.21.15.40:6801/2441293461] conn(0x7f713807e070 msgr2=0x7f7138064a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:33:57.444 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.443+0000 7f71480b0640 0 -- 172.21.15.37:0/1891572262 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7f713c09e8f0 msgr2=0x7f713c07d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:33:57.652 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.651+0000 7f714c330800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:33:57.652 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.651+0000 7f714c330800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:33:57.653 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.651+0000 7f714c330800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:33:57.653 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.651+0000 7f714c330800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:33:57.653 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.651+0000 7f714c330800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:33:57.653 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.651+0000 7f714c330800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:33:57.653 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.651+0000 7f714c330800 20 rados->read ofs=0 len=0 2024-09-12T17:33:57.653 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.651+0000 7f714c330800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:57.653 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.651+0000 7f714c330800 20 rados->read ofs=0 len=0 2024-09-12T17:33:57.654 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.652+0000 7f714c330800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:33:57.654 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.652+0000 7f714c330800 20 rados->read ofs=0 len=0 2024-09-12T17:33:57.654 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.652+0000 7f714c330800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:33:57.654 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.652+0000 7f714c330800 20 zone default found 2024-09-12T17:33:57.654 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.652+0000 7f714c330800 4 Realm: () 2024-09-12T17:33:57.654 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.652+0000 7f714c330800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:33:57.654 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.652+0000 7f714c330800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:33:57.654 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.652+0000 7f714c330800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:33:57.654 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.652+0000 7f714c330800 20 zonegroup default 2024-09-12T17:33:57.655 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.653+0000 7f714c330800 20 rados->read ofs=0 len=0 2024-09-12T17:33:57.655 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.653+0000 7f714c330800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:57.655 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.653+0000 7f714c330800 20 rados->read ofs=0 len=0 2024-09-12T17:33:57.655 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.653+0000 7f714c330800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:57.655 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.653+0000 7f714c330800 20 rados->read ofs=0 len=0 2024-09-12T17:33:57.655 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.654+0000 7f714c330800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:57.655 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.654+0000 7f714c330800 20 started sync module instance, tier type = 2024-09-12T17:33:57.656 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.654+0000 7f714c330800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:33:57.665 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.664+0000 7f714c330800 20 add_watcher() i=0 2024-09-12T17:33:57.665 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.664+0000 7f714c330800 20 add_watcher() i=1 2024-09-12T17:33:57.665 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.664+0000 7f714c330800 20 add_watcher() i=2 2024-09-12T17:33:57.666 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.664+0000 7f714c330800 20 add_watcher() i=3 2024-09-12T17:33:57.666 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.664+0000 7f714c330800 20 add_watcher() i=4 2024-09-12T17:33:57.666 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.664+0000 7f714c330800 20 add_watcher() i=5 2024-09-12T17:33:57.666 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.664+0000 7f714c330800 20 add_watcher() i=6 2024-09-12T17:33:57.666 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.666+0000 7f714c330800 20 add_watcher() i=7 2024-09-12T17:33:57.666 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.666+0000 7f714c330800 2 all 8 watchers are set, enabling cache 2024-09-12T17:33:57.669 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.668+0000 7f6ffefdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:33:57.669 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.668+0000 7f714c330800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:33:57.669 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.668+0000 7f714c330800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:33:57.670 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.668+0000 7f714c330800 5 note: GC not initialized 2024-09-12T17:33:57.670 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.668+0000 7f6ffdfdb640 20 reqs_thread_entry: start 2024-09-12T17:33:57.670 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.669+0000 7f714c330800 20 init_complete bucket index max shards: 11 2024-09-12T17:33:57.670 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.669+0000 7f714c330800 20 Filter name: none 2024-09-12T17:33:57.670 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.669+0000 7f6f6f7fe640 20 reqs_thread_entry: start 2024-09-12T17:33:57.670 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.669+0000 7f714c330800 20 rados->read ofs=0 len=0 2024-09-12T17:33:57.670 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.669+0000 7f714c330800 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T17:33:57.671 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.670+0000 7f714c330800 20 rados->read ofs=0 len=0 2024-09-12T17:33:57.671 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.670+0000 7f714c330800 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T17:33:57.671 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.670+0000 7f714c330800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:33:57.671 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.670+0000 7f714c330800 20 rados->read ofs=0 len=0 2024-09-12T17:33:57.672 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.671+0000 7f714c330800 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T17:33:57.672 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.671+0000 7f714c330800 20 rados->read ofs=0 len=0 2024-09-12T17:33:57.672 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.671+0000 7f714c330800 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T17:33:57.672 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.671+0000 7f714c330800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:33:57.674 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.673+0000 7f6ffefdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:33:57.676 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.676+0000 7f714c330800 20 remove_watcher() i=0 2024-09-12T17:33:57.677 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.676+0000 7f714c330800 2 removed watcher, disabling cache 2024-09-12T17:33:57.678 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.677+0000 7f714c330800 20 remove_watcher() i=1 2024-09-12T17:33:57.679 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.679+0000 7f714c330800 20 remove_watcher() i=2 2024-09-12T17:33:57.680 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.680+0000 7f714c330800 20 remove_watcher() i=3 2024-09-12T17:33:57.682 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.681+0000 7f714c330800 20 remove_watcher() i=4 2024-09-12T17:33:57.683 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.682+0000 7f714c330800 20 remove_watcher() i=5 2024-09-12T17:33:57.684 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.683+0000 7f714c330800 20 remove_watcher() i=6 2024-09-12T17:33:57.685 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.684+0000 7f714c330800 20 remove_watcher() i=7 2024-09-12T17:33:57.697 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:33:57.697 INFO:tasks.workunit.client.0.smithi037.stderr:BUCKET_STATS: 2024-09-12T17:33:57.698 INFO:tasks.workunit.client.0.smithi037.stderr:bucket: error-at-block-writes id: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.29 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:33:57.698 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:33:57.793 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bucket reshard --bucket error-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:33:57.823 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:33:57.823 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:33:57.863 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.862+0000 7fc22651f800 20 rados->read ofs=0 len=0 2024-09-12T17:33:57.864 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.863+0000 7fc22651f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:57.865 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.863+0000 7fc22651f800 20 realm 2024-09-12T17:33:57.865 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.863+0000 7fc22651f800 20 rados->read ofs=0 len=0 2024-09-12T17:33:57.865 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.863+0000 7fc22651f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:57.865 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.864+0000 7fc22651f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:33:57.865 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.864+0000 7fc22651f800 20 rados->read ofs=0 len=0 2024-09-12T17:33:57.865 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.864+0000 7fc22651f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:57.865 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.864+0000 7fc22651f800 20 rados->read ofs=0 len=0 2024-09-12T17:33:57.866 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.865+0000 7fc22651f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:33:57.866 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.865+0000 7fc22651f800 20 rados->read ofs=0 len=0 2024-09-12T17:33:57.866 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.865+0000 7fc22651f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:33:57.866 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.865+0000 7fc22651f800 20 searching for the correct realm 2024-09-12T17:33:57.870 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.869+0000 7fc221aa1640 0 -- 172.21.15.37:0/3138534728 >> [v2:172.21.15.40:6800/2441293461,v1:172.21.15.40:6801/2441293461] conn(0x7fc21401e060 msgr2=0x7fc21405ea50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:33:57.874 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.873+0000 7fc222aa3640 0 -- 172.21.15.37:0/3138534728 >> [v2:172.21.15.40:6808/2253405131,v1:172.21.15.40:6809/2253405131] conn(0x7fc218087920 msgr2=0x7fc2180933f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:33:57.878 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.877+0000 7fc22651f800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:33:57.878 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.877+0000 7fc22651f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:33:57.878 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.877+0000 7fc22651f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:33:57.879 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.877+0000 7fc22651f800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:33:57.879 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.877+0000 7fc22651f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:33:57.879 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.877+0000 7fc22651f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:33:57.879 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.877+0000 7fc22651f800 20 rados->read ofs=0 len=0 2024-09-12T17:33:57.879 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.878+0000 7fc22651f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:57.879 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.878+0000 7fc22651f800 20 rados->read ofs=0 len=0 2024-09-12T17:33:57.880 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.878+0000 7fc22651f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:33:57.880 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.878+0000 7fc22651f800 20 rados->read ofs=0 len=0 2024-09-12T17:33:57.881 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.878+0000 7fc22651f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:33:57.881 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.878+0000 7fc22651f800 20 zone default found 2024-09-12T17:33:57.881 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.878+0000 7fc22651f800 4 Realm: () 2024-09-12T17:33:57.881 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.878+0000 7fc22651f800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:33:57.881 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.878+0000 7fc22651f800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:33:57.881 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.878+0000 7fc22651f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:33:57.881 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.878+0000 7fc22651f800 20 zonegroup default 2024-09-12T17:33:57.881 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.878+0000 7fc22651f800 20 rados->read ofs=0 len=0 2024-09-12T17:33:57.881 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.879+0000 7fc22651f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:57.881 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.879+0000 7fc22651f800 20 rados->read ofs=0 len=0 2024-09-12T17:33:57.881 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.879+0000 7fc22651f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:57.881 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.879+0000 7fc22651f800 20 rados->read ofs=0 len=0 2024-09-12T17:33:57.881 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.879+0000 7fc22651f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:57.882 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.879+0000 7fc22651f800 20 started sync module instance, tier type = 2024-09-12T17:33:57.882 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.879+0000 7fc22651f800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:33:57.891 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.889+0000 7fc22651f800 20 add_watcher() i=0 2024-09-12T17:33:57.891 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.889+0000 7fc22651f800 20 add_watcher() i=1 2024-09-12T17:33:57.891 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.889+0000 7fc22651f800 20 add_watcher() i=2 2024-09-12T17:33:57.891 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.889+0000 7fc22651f800 20 add_watcher() i=3 2024-09-12T17:33:57.891 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.889+0000 7fc22651f800 20 add_watcher() i=4 2024-09-12T17:33:57.891 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.889+0000 7fc22651f800 20 add_watcher() i=5 2024-09-12T17:33:57.892 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.889+0000 7fc22651f800 20 add_watcher() i=6 2024-09-12T17:33:57.892 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.890+0000 7fc22651f800 20 add_watcher() i=7 2024-09-12T17:33:57.892 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.890+0000 7fc22651f800 2 all 8 watchers are set, enabling cache 2024-09-12T17:33:57.892 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.892+0000 7fc0d8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:33:57.893 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.892+0000 7fc22651f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:33:57.894 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.892+0000 7fc22651f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:33:57.894 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.892+0000 7fc22651f800 5 note: GC not initialized 2024-09-12T17:33:57.894 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.892+0000 7fc0537fe640 20 reqs_thread_entry: start 2024-09-12T17:33:57.894 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.892+0000 7fc22651f800 20 init_complete bucket index max shards: 11 2024-09-12T17:33:57.894 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.892+0000 7fc22651f800 20 Filter name: none 2024-09-12T17:33:57.895 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.892+0000 7fc0517fa640 20 reqs_thread_entry: start 2024-09-12T17:33:57.895 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.893+0000 7fc22651f800 10 cache get: name=default.rgw.meta+root+error-at-block-writes : miss 2024-09-12T17:33:57.895 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.893+0000 7fc22651f800 20 rados->read ofs=0 len=0 2024-09-12T17:33:57.896 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.893+0000 7fc22651f800 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T17:33:57.896 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.893+0000 7fc22651f800 10 cache put: name=default.rgw.meta+root+error-at-block-writes info.flags=0x11 2024-09-12T17:33:57.896 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.893+0000 7fc22651f800 10 adding default.rgw.meta+root+error-at-block-writes to cache LRU end 2024-09-12T17:33:57.896 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.893+0000 7fc22651f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.29 : miss 2024-09-12T17:33:57.896 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.893+0000 7fc22651f800 20 rados->read ofs=0 len=0 2024-09-12T17:33:57.896 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.893+0000 7fc22651f800 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T17:33:57.897 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.893+0000 7fc22651f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.29 info.flags=0x17 2024-09-12T17:33:57.897 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.893+0000 7fc22651f800 10 adding default.rgw.meta+root+.bucket.meta.error-at-block-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.29 to cache LRU end 2024-09-12T17:33:57.897 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.893+0000 7fc22651f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:33:57.897 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.893+0000 7fc22651f800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:33:57.897 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.893+0000 7fc22651f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.29 2024-09-12T17:33:57.899 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.898+0000 7fc22651f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.29 info.flags=0x17 2024-09-12T17:33:57.899 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.898+0000 7fc22651f800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.29 to cache LRU end 2024-09-12T17:33:57.899 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.898+0000 7fc22651f800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:33:57.899 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.898+0000 7fc22651f800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.29, ofs0, ns] 2024-09-12T17:33:57.899 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.898+0000 7fc1057fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496992 cookie 94480117108160 notifier 7074 bl.length()=999 2024-09-12T17:33:57.900 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.898+0000 7fc1057fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.29 info.flags=0x17 2024-09-12T17:33:57.900 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.898+0000 7fc1057fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.29 to cache LRU end 2024-09-12T17:33:57.900 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.898+0000 7fc1057fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:33:57.901 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.900+0000 7fc22651f800 20 handle_bi_update(): bucket=:error-at-block-writes[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.29]): orig_sources= new_sources= 2024-09-12T17:33:57.901 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.900+0000 7fc22651f800 20 handle_bi_update(): bucket=:error-at-block-writes[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.29]): potential sources added=[] removed=[] 2024-09-12T17:33:57.901 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.900+0000 7fc22651f800 20 handle_bi_update(): bucket=:error-at-block-writes[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.29]): orig_dests= new_dests= 2024-09-12T17:33:57.901 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.900+0000 7fc22651f800 20 handle_bi_update(): bucket=:error-at-block-writes[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.29]): potential dests added=[] removed=[] 2024-09-12T17:33:57.906 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.905+0000 7fc22651f800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.29.1.0 2024-09-12T17:33:57.906 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.905+0000 7fc22651f800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.29.1.0 2024-09-12T17:33:57.907 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.905+0000 7fc22651f800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.29.1.1 2024-09-12T17:33:57.907 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.905+0000 7fc22651f800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.29.1.1 2024-09-12T17:33:57.907 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.905+0000 7fc22651f800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.29.1.2 2024-09-12T17:33:57.907 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.905+0000 7fc22651f800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.29.1.2 2024-09-12T17:33:57.907 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.905+0000 7fc22651f800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.29.1.3 2024-09-12T17:33:57.907 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.905+0000 7fc22651f800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.29.1.3 2024-09-12T17:33:57.907 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.905+0000 7fc22651f800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.29.1.4 2024-09-12T17:33:57.907 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.905+0000 7fc22651f800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.29.1.4 2024-09-12T17:33:57.908 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.905+0000 7fc22651f800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.29.1.5 2024-09-12T17:33:57.908 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.905+0000 7fc22651f800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.29.1.5 2024-09-12T17:33:57.908 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.905+0000 7fc22651f800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.29.1.6 2024-09-12T17:33:57.908 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.905+0000 7fc22651f800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.29.1.6 2024-09-12T17:33:57.908 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.905+0000 7fc22651f800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.29.1.7 2024-09-12T17:33:57.908 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.905+0000 7fc22651f800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.29.1.7 2024-09-12T17:33:57.908 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.905+0000 7fc22651f800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.29.1.8 2024-09-12T17:33:57.908 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.905+0000 7fc22651f800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.29.1.8 2024-09-12T17:33:57.908 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.905+0000 7fc22651f800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.29.1.9 2024-09-12T17:33:57.908 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.905+0000 7fc22651f800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.29.1.9 2024-09-12T17:33:57.909 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.905+0000 7fc22651f800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.29.1.10 2024-09-12T17:33:57.909 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.905+0000 7fc22651f800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.29.1.10 2024-09-12T17:33:57.909 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.905+0000 7fc22651f800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.29.1.11 2024-09-12T17:33:57.909 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.905+0000 7fc22651f800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.29.1.11 2024-09-12T17:33:57.909 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.905+0000 7fc22651f800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.29.0 2024-09-12T17:33:57.909 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.905+0000 7fc22651f800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.29.1 2024-09-12T17:33:57.910 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.906+0000 7fc22651f800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.29.2 2024-09-12T17:33:57.910 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.906+0000 7fc22651f800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.29.3 2024-09-12T17:33:57.910 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.907+0000 7fc22651f800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.29.4 2024-09-12T17:33:57.910 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.907+0000 7fc22651f800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.29.5 2024-09-12T17:33:57.910 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.908+0000 7fc22651f800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.29.6 2024-09-12T17:33:57.910 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.909+0000 7fc22651f800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.29.7 2024-09-12T17:33:57.910 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.909+0000 7fc22651f800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.29.8 2024-09-12T17:33:57.911 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.910+0000 7fc22651f800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.29.9 2024-09-12T17:33:57.911 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.911+0000 7fc22651f800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.29.10 2024-09-12T17:33:57.915 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.914+0000 7fc22651f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.29 : hit (requested=0x17, cached=0x17) 2024-09-12T17:33:57.915 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.914+0000 7fc22651f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.29 2024-09-12T17:33:57.916 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.915+0000 7fc22651f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.29 info.flags=0x17 2024-09-12T17:33:57.916 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.915+0000 7fc22651f800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.29 to cache LRU end 2024-09-12T17:33:57.917 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.915+0000 7fc22651f800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:33:57.917 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.915+0000 7fc22651f800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.29, ofs0, ns] 2024-09-12T17:33:57.917 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.916+0000 7fc1057fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496993 cookie 94480117108160 notifier 7074 bl.length()=999 2024-09-12T17:33:57.917 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.916+0000 7fc1057fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.29 info.flags=0x17 2024-09-12T17:33:57.917 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.916+0000 7fc1057fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.29 to cache LRU end 2024-09-12T17:33:57.917 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.916+0000 7fc1057fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:33:57.918 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.917+0000 7fc22651f800 20 handle_bi_update(): bucket=:error-at-block-writes[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.29]): orig_sources= new_sources= 2024-09-12T17:33:57.918 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.917+0000 7fc22651f800 20 handle_bi_update(): bucket=:error-at-block-writes[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.29]): potential sources added=[] removed=[] 2024-09-12T17:33:57.918 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.917+0000 7fc22651f800 20 handle_bi_update(): bucket=:error-at-block-writes[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.29]): orig_dests= new_dests= 2024-09-12T17:33:57.919 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.917+0000 7fc22651f800 20 handle_bi_update(): bucket=:error-at-block-writes[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.29]): potential dests added=[] removed=[] 2024-09-12T17:33:57.921 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.920+0000 7fc22651f800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.29.0 2024-09-12T17:33:57.921 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.920+0000 7fc22651f800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.29.1 2024-09-12T17:33:57.921 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.920+0000 7fc22651f800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.29.2 2024-09-12T17:33:57.922 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.921+0000 7fc22651f800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.29.3 2024-09-12T17:33:57.922 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.921+0000 7fc22651f800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.29.4 2024-09-12T17:33:57.923 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.922+0000 7fc22651f800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.29.5 2024-09-12T17:33:57.923 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.922+0000 7fc22651f800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.29.6 2024-09-12T17:33:57.923 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.922+0000 7fc22651f800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.29.7 2024-09-12T17:33:57.923 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.923+0000 7fc22651f800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.29.8 2024-09-12T17:33:57.924 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.923+0000 7fc22651f800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.29.9 2024-09-12T17:33:57.924 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.923+0000 7fc22651f800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.29.10 2024-09-12T17:33:57.924 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.924+0000 7fc22651f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.29 : hit (requested=0x17, cached=0x17) 2024-09-12T17:33:57.925 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.924+0000 7fc22651f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.29 2024-09-12T17:33:57.926 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.925+0000 7fc22651f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.29 info.flags=0x17 2024-09-12T17:33:57.926 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.925+0000 7fc22651f800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.29 to cache LRU end 2024-09-12T17:33:57.926 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.925+0000 7fc22651f800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:33:57.927 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.925+0000 7fc22651f800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.29, ofs0, ns] 2024-09-12T17:33:57.927 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.925+0000 7fc105ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496994 cookie 94480117108160 notifier 7074 bl.length()=967 2024-09-12T17:33:57.927 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.925+0000 7fc105ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.29 info.flags=0x17 2024-09-12T17:33:57.927 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.925+0000 7fc105ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.29 to cache LRU end 2024-09-12T17:33:57.927 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.925+0000 7fc105ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:33:57.927 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.927+0000 7fc22651f800 20 handle_bi_update(): bucket=:error-at-block-writes[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.29]): orig_sources= new_sources= 2024-09-12T17:33:57.928 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.927+0000 7fc22651f800 20 handle_bi_update(): bucket=:error-at-block-writes[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.29]): potential sources added=[] removed=[] 2024-09-12T17:33:57.928 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.927+0000 7fc22651f800 20 handle_bi_update(): bucket=:error-at-block-writes[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.29]): orig_dests= new_dests= 2024-09-12T17:33:57.928 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.927+0000 7fc22651f800 20 handle_bi_update(): bucket=:error-at-block-writes[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.29]): potential dests added=[] removed=[] 2024-09-12T17:33:57.930 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.929+0000 7fc22651f800 1 execute INFO: reshard of bucket "error-at-block-writes" from 11 shards to 12 shards completed successfully 2024-09-12T17:33:57.932 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.931+0000 7fc0d8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:33:57.934 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.934+0000 7fc22651f800 20 remove_watcher() i=0 2024-09-12T17:33:57.934 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.934+0000 7fc22651f800 2 removed watcher, disabling cache 2024-09-12T17:33:57.935 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.935+0000 7fc22651f800 20 remove_watcher() i=1 2024-09-12T17:33:57.936 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.936+0000 7fc22651f800 20 remove_watcher() i=2 2024-09-12T17:33:57.938 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.937+0000 7fc22651f800 20 remove_watcher() i=3 2024-09-12T17:33:57.939 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.938+0000 7fc22651f800 20 remove_watcher() i=4 2024-09-12T17:33:57.940 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.939+0000 7fc22651f800 20 remove_watcher() i=5 2024-09-12T17:33:57.941 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.940+0000 7fc22651f800 20 remove_watcher() i=6 2024-09-12T17:33:57.941 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:57.941+0000 7fc22651f800 20 remove_watcher() i=7 2024-09-12T17:33:57.954 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-09-12T17:33:57.984 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:33:57.984 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:33:58.024 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:58.023+0000 7ffa7ab46800 20 rados->read ofs=0 len=0 2024-09-12T17:33:58.026 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:58.024+0000 7ffa7ab46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:58.026 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:58.024+0000 7ffa7ab46800 20 realm 2024-09-12T17:33:58.027 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:58.024+0000 7ffa7ab46800 20 rados->read ofs=0 len=0 2024-09-12T17:33:58.027 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:58.025+0000 7ffa7ab46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:58.027 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:58.025+0000 7ffa7ab46800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:33:58.027 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:58.025+0000 7ffa7ab46800 20 rados->read ofs=0 len=0 2024-09-12T17:33:58.028 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:58.025+0000 7ffa7ab46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:58.028 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:58.025+0000 7ffa7ab46800 20 rados->read ofs=0 len=0 2024-09-12T17:33:58.029 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:58.026+0000 7ffa7ab46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:33:58.030 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:58.026+0000 7ffa7ab46800 20 rados->read ofs=0 len=0 2024-09-12T17:33:58.030 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:58.026+0000 7ffa7ab46800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:33:58.030 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:58.026+0000 7ffa7ab46800 20 searching for the correct realm 2024-09-12T17:33:58.030 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:58.028+0000 7ffa78e31640 0 -- 172.21.15.37:0/837169311 >> [v2:172.21.15.40:6818/1210108009,v1:172.21.15.40:6819/1210108009] conn(0x7ffa6c02e040 msgr2=0x7ffa6c02e930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:33:58.032 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:58.031+0000 7ffa78e31640 0 -- 172.21.15.37:0/837169311 >> [v2:172.21.15.40:6808/2253405131,v1:172.21.15.40:6809/2253405131] conn(0x7ffa6c01d040 msgr2=0x7ffa6c03e940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:33:58.243 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:58.241+0000 7ffa7ab46800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:33:58.243 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:58.242+0000 7ffa7ab46800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:33:58.243 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:58.242+0000 7ffa7ab46800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:33:58.243 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:58.242+0000 7ffa7ab46800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:33:58.243 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:58.242+0000 7ffa7ab46800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:33:58.243 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:58.242+0000 7ffa7ab46800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:33:58.243 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:58.242+0000 7ffa7ab46800 20 rados->read ofs=0 len=0 2024-09-12T17:33:58.243 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:58.242+0000 7ffa7ab46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:58.243 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:58.242+0000 7ffa7ab46800 20 rados->read ofs=0 len=0 2024-09-12T17:33:58.244 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:58.242+0000 7ffa7ab46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:33:58.245 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:58.242+0000 7ffa7ab46800 20 rados->read ofs=0 len=0 2024-09-12T17:33:58.245 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:58.243+0000 7ffa7ab46800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:33:58.245 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:58.243+0000 7ffa7ab46800 20 zone default found 2024-09-12T17:33:58.245 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:58.243+0000 7ffa7ab46800 4 Realm: () 2024-09-12T17:33:58.245 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:58.243+0000 7ffa7ab46800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:33:58.245 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:58.243+0000 7ffa7ab46800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:33:58.245 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:58.243+0000 7ffa7ab46800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:33:58.245 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:58.243+0000 7ffa7ab46800 20 zonegroup default 2024-09-12T17:33:58.245 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:58.243+0000 7ffa7ab46800 20 rados->read ofs=0 len=0 2024-09-12T17:33:58.245 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:58.243+0000 7ffa7ab46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:58.245 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:58.243+0000 7ffa7ab46800 20 rados->read ofs=0 len=0 2024-09-12T17:33:58.245 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:58.243+0000 7ffa7ab46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:58.245 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:58.243+0000 7ffa7ab46800 20 rados->read ofs=0 len=0 2024-09-12T17:33:58.246 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:58.244+0000 7ffa7ab46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:58.246 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:58.244+0000 7ffa7ab46800 20 started sync module instance, tier type = 2024-09-12T17:33:58.246 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:58.244+0000 7ffa7ab46800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:33:58.255 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:58.254+0000 7ffa7ab46800 20 add_watcher() i=0 2024-09-12T17:33:58.255 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:58.254+0000 7ffa7ab46800 20 add_watcher() i=1 2024-09-12T17:33:58.255 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:58.254+0000 7ffa7ab46800 20 add_watcher() i=2 2024-09-12T17:33:58.255 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:58.254+0000 7ffa7ab46800 20 add_watcher() i=3 2024-09-12T17:33:58.255 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:58.254+0000 7ffa7ab46800 20 add_watcher() i=4 2024-09-12T17:33:58.256 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:58.254+0000 7ffa7ab46800 20 add_watcher() i=5 2024-09-12T17:33:58.256 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:58.254+0000 7ffa7ab46800 20 add_watcher() i=6 2024-09-12T17:33:58.256 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:58.255+0000 7ffa7ab46800 20 add_watcher() i=7 2024-09-12T17:33:58.256 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:58.255+0000 7ffa7ab46800 2 all 8 watchers are set, enabling cache 2024-09-12T17:33:58.257 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:58.257+0000 7ff92efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:33:58.258 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:58.257+0000 7ffa7ab46800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:33:58.258 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:58.257+0000 7ffa7ab46800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:33:58.258 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:58.257+0000 7ffa7ab46800 5 note: GC not initialized 2024-09-12T17:33:58.258 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:58.257+0000 7ff92dfdb640 20 reqs_thread_entry: start 2024-09-12T17:33:58.259 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:58.257+0000 7ffa7ab46800 20 init_complete bucket index max shards: 11 2024-09-12T17:33:58.259 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:58.257+0000 7ffa7ab46800 20 Filter name: none 2024-09-12T17:33:58.259 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:58.257+0000 7ff89f7fe640 20 reqs_thread_entry: start 2024-09-12T17:33:58.259 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:58.258+0000 7ffa7ab46800 20 rados->read ofs=0 len=0 2024-09-12T17:33:58.259 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:58.258+0000 7ffa7ab46800 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T17:33:58.259 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:58.258+0000 7ffa7ab46800 20 rados->read ofs=0 len=0 2024-09-12T17:33:58.260 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:58.259+0000 7ffa7ab46800 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T17:33:58.260 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:58.259+0000 7ffa7ab46800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:33:58.260 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:58.259+0000 7ffa7ab46800 20 rados->read ofs=0 len=0 2024-09-12T17:33:58.260 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:58.259+0000 7ffa7ab46800 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T17:33:58.260 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:58.259+0000 7ffa7ab46800 20 rados->read ofs=0 len=0 2024-09-12T17:33:58.260 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:58.259+0000 7ffa7ab46800 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T17:33:58.260 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:58.259+0000 7ffa7ab46800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:33:58.262 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:58.261+0000 7ff92efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:33:58.264 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:58.264+0000 7ffa7ab46800 20 remove_watcher() i=0 2024-09-12T17:33:58.264 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:58.264+0000 7ffa7ab46800 2 removed watcher, disabling cache 2024-09-12T17:33:58.265 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:58.265+0000 7ffa7ab46800 20 remove_watcher() i=1 2024-09-12T17:33:58.266 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:58.266+0000 7ffa7ab46800 20 remove_watcher() i=2 2024-09-12T17:33:58.268 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:58.267+0000 7ffa7ab46800 20 remove_watcher() i=3 2024-09-12T17:33:58.269 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:58.268+0000 7ffa7ab46800 20 remove_watcher() i=4 2024-09-12T17:33:58.270 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:58.269+0000 7ffa7ab46800 20 remove_watcher() i=5 2024-09-12T17:33:58.271 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:58.270+0000 7ffa7ab46800 20 remove_watcher() i=6 2024-09-12T17:33:58.272 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:58.271+0000 7ffa7ab46800 20 remove_watcher() i=7 2024-09-12T17:33:58.283 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:33:58.283 INFO:tasks.workunit.client.0.smithi037.stderr:BUCKET_STATS: 2024-09-12T17:33:58.283 INFO:tasks.workunit.client.0.smithi037.stderr:bucket: error-at-block-writes id: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.29 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T17:33:58.283 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:33:58.638 INFO:tasks.workunit.client.0.smithi037.stderr:TEST: reshard bucket with abort at block_writes 2024-09-12T17:33:58.638 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:33:59.438 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-09-12T17:33:59.468 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:33:59.468 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:33:59.507 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:59.506+0000 7fce4432c800 20 rados->read ofs=0 len=0 2024-09-12T17:33:59.509 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:59.508+0000 7fce4432c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:59.509 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:59.508+0000 7fce4432c800 20 realm 2024-09-12T17:33:59.509 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:59.508+0000 7fce4432c800 20 rados->read ofs=0 len=0 2024-09-12T17:33:59.509 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:59.508+0000 7fce4432c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:59.509 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:59.508+0000 7fce4432c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:33:59.509 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:59.508+0000 7fce4432c800 20 rados->read ofs=0 len=0 2024-09-12T17:33:59.509 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:59.508+0000 7fce4432c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:59.509 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:59.508+0000 7fce4432c800 20 rados->read ofs=0 len=0 2024-09-12T17:33:59.510 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:59.509+0000 7fce4432c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:33:59.510 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:59.509+0000 7fce4432c800 20 rados->read ofs=0 len=0 2024-09-12T17:33:59.510 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:59.509+0000 7fce4432c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:33:59.510 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:59.510+0000 7fce4432c800 20 searching for the correct realm 2024-09-12T17:33:59.514 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:59.513+0000 7fce40746640 0 -- 172.21.15.37:0/968430418 >> [v2:172.21.15.40:6818/1210108009,v1:172.21.15.40:6819/1210108009] conn(0x7fce34075510 msgr2=0x7fce34060b70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:33:59.518 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:59.517+0000 7fce3ff45640 0 -- 172.21.15.37:0/968430418 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7fce340a3040 msgr2=0x7fce3407c1d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:33:59.726 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:59.724+0000 7fce4432c800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:33:59.726 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:59.724+0000 7fce4432c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:33:59.726 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:59.724+0000 7fce4432c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:33:59.726 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:59.724+0000 7fce4432c800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:33:59.726 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:59.724+0000 7fce4432c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:33:59.726 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:59.724+0000 7fce4432c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:33:59.726 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:59.724+0000 7fce4432c800 20 rados->read ofs=0 len=0 2024-09-12T17:33:59.726 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:59.725+0000 7fce4432c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:59.726 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:59.725+0000 7fce4432c800 20 rados->read ofs=0 len=0 2024-09-12T17:33:59.727 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:59.725+0000 7fce4432c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:33:59.728 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:59.725+0000 7fce4432c800 20 rados->read ofs=0 len=0 2024-09-12T17:33:59.728 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:59.726+0000 7fce4432c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:33:59.728 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:59.726+0000 7fce4432c800 20 zone default found 2024-09-12T17:33:59.728 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:59.726+0000 7fce4432c800 4 Realm: () 2024-09-12T17:33:59.728 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:59.726+0000 7fce4432c800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:33:59.728 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:59.726+0000 7fce4432c800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:33:59.728 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:59.726+0000 7fce4432c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:33:59.728 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:59.726+0000 7fce4432c800 20 zonegroup default 2024-09-12T17:33:59.728 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:59.726+0000 7fce4432c800 20 rados->read ofs=0 len=0 2024-09-12T17:33:59.728 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:59.726+0000 7fce4432c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:59.728 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:59.726+0000 7fce4432c800 20 rados->read ofs=0 len=0 2024-09-12T17:33:59.728 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:59.726+0000 7fce4432c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:59.729 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:59.726+0000 7fce4432c800 20 rados->read ofs=0 len=0 2024-09-12T17:33:59.729 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:59.727+0000 7fce4432c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:33:59.729 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:59.727+0000 7fce4432c800 20 started sync module instance, tier type = 2024-09-12T17:33:59.729 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:59.727+0000 7fce4432c800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:33:59.738 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:59.737+0000 7fce4432c800 20 add_watcher() i=0 2024-09-12T17:33:59.738 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:59.737+0000 7fce4432c800 20 add_watcher() i=1 2024-09-12T17:33:59.738 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:59.737+0000 7fce4432c800 20 add_watcher() i=2 2024-09-12T17:33:59.739 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:59.737+0000 7fce4432c800 20 add_watcher() i=3 2024-09-12T17:33:59.739 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:59.737+0000 7fce4432c800 20 add_watcher() i=4 2024-09-12T17:33:59.739 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:59.737+0000 7fce4432c800 20 add_watcher() i=5 2024-09-12T17:33:59.739 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:59.737+0000 7fce4432c800 20 add_watcher() i=6 2024-09-12T17:33:59.739 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:59.738+0000 7fce4432c800 20 add_watcher() i=7 2024-09-12T17:33:59.739 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:59.738+0000 7fce4432c800 2 all 8 watchers are set, enabling cache 2024-09-12T17:33:59.741 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:59.740+0000 7fccf5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:33:59.742 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:59.741+0000 7fce4432c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:33:59.742 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:59.741+0000 7fce4432c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:33:59.742 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:59.741+0000 7fce4432c800 5 note: GC not initialized 2024-09-12T17:33:59.742 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:59.741+0000 7fccf4fe1640 20 reqs_thread_entry: start 2024-09-12T17:33:59.742 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:59.741+0000 7fce4432c800 20 init_complete bucket index max shards: 11 2024-09-12T17:33:59.742 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:59.741+0000 7fce4432c800 20 Filter name: none 2024-09-12T17:33:59.742 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:59.741+0000 7fcc6e7fc640 20 reqs_thread_entry: start 2024-09-12T17:33:59.743 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:59.741+0000 7fce4432c800 20 rados->read ofs=0 len=0 2024-09-12T17:33:59.743 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:59.742+0000 7fce4432c800 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T17:33:59.743 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:59.742+0000 7fce4432c800 20 rados->read ofs=0 len=0 2024-09-12T17:33:59.743 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:59.742+0000 7fce4432c800 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T17:33:59.743 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:59.742+0000 7fce4432c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:33:59.744 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:59.742+0000 7fce4432c800 20 rados->read ofs=0 len=0 2024-09-12T17:33:59.744 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:59.743+0000 7fce4432c800 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T17:33:59.744 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:59.743+0000 7fce4432c800 20 rados->read ofs=0 len=0 2024-09-12T17:33:59.744 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:59.743+0000 7fce4432c800 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T17:33:59.744 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:59.743+0000 7fce4432c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:33:59.746 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:59.745+0000 7fccf5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:33:59.748 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:59.747+0000 7fce4432c800 20 remove_watcher() i=0 2024-09-12T17:33:59.748 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:59.747+0000 7fce4432c800 2 removed watcher, disabling cache 2024-09-12T17:33:59.750 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:59.749+0000 7fce4432c800 20 remove_watcher() i=1 2024-09-12T17:33:59.751 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:59.750+0000 7fce4432c800 20 remove_watcher() i=2 2024-09-12T17:33:59.752 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:59.751+0000 7fce4432c800 20 remove_watcher() i=3 2024-09-12T17:33:59.753 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:59.752+0000 7fce4432c800 20 remove_watcher() i=4 2024-09-12T17:33:59.754 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:59.753+0000 7fce4432c800 20 remove_watcher() i=5 2024-09-12T17:33:59.755 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:59.754+0000 7fce4432c800 20 remove_watcher() i=6 2024-09-12T17:33:59.756 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:33:59.755+0000 7fce4432c800 20 remove_watcher() i=7 2024-09-12T17:33:59.767 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:33:59.767 INFO:tasks.workunit.client.0.smithi037.stderr:BUCKET_STATS: 2024-09-12T17:33:59.767 INFO:tasks.workunit.client.0.smithi037.stderr:bucket: abort-at-block-writes id: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:33:59.768 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:33:59.769 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at block_writes 2024-09-12T17:33:59.804 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:33:59.805 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:34:00.047 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:00.046+0000 7fd9a9098800 20 rados->read ofs=0 len=0 2024-09-12T17:34:00.048 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:00.047+0000 7fd9a9098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:00.049 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:00.047+0000 7fd9a9098800 20 realm 2024-09-12T17:34:00.049 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:00.047+0000 7fd9a9098800 20 rados->read ofs=0 len=0 2024-09-12T17:34:00.049 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:00.047+0000 7fd9a9098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:00.049 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:00.047+0000 7fd9a9098800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:34:00.049 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:00.048+0000 7fd9a9098800 20 rados->read ofs=0 len=0 2024-09-12T17:34:00.049 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:00.048+0000 7fd9a9098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:00.049 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:00.048+0000 7fd9a9098800 20 rados->read ofs=0 len=0 2024-09-12T17:34:00.049 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:00.049+0000 7fd9a9098800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:34:00.050 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:00.049+0000 7fd9a9098800 20 rados->read ofs=0 len=0 2024-09-12T17:34:00.050 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:00.049+0000 7fd9a9098800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:34:00.050 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:00.049+0000 7fd9a9098800 20 searching for the correct realm 2024-09-12T17:34:00.052 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:00.052+0000 7fd9a6381640 0 -- 172.21.15.37:0/3960364345 >> [v2:172.21.15.40:6800/2441293461,v1:172.21.15.40:6801/2441293461] conn(0x7fd99806b040 msgr2=0x7fd998003990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:34:00.263 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:00.259+0000 7fd9a6b82640 0 -- 172.21.15.37:0/3960364345 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7fd99c0108f0 msgr2=0x7fd99c02e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:34:00.468 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:00.466+0000 7fd9a9098800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:34:00.468 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:00.466+0000 7fd9a9098800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:34:00.468 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:00.466+0000 7fd9a9098800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:34:00.468 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:00.466+0000 7fd9a9098800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:34:00.468 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:00.466+0000 7fd9a9098800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:34:00.468 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:00.466+0000 7fd9a9098800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:34:00.468 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:00.466+0000 7fd9a9098800 20 rados->read ofs=0 len=0 2024-09-12T17:34:00.468 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:00.467+0000 7fd9a9098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:00.468 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:00.467+0000 7fd9a9098800 20 rados->read ofs=0 len=0 2024-09-12T17:34:00.469 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:00.467+0000 7fd9a9098800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:34:00.469 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:00.467+0000 7fd9a9098800 20 rados->read ofs=0 len=0 2024-09-12T17:34:00.470 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:00.467+0000 7fd9a9098800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:34:00.470 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:00.467+0000 7fd9a9098800 20 zone default found 2024-09-12T17:34:00.470 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:00.467+0000 7fd9a9098800 4 Realm: () 2024-09-12T17:34:00.470 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:00.467+0000 7fd9a9098800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:34:00.470 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:00.467+0000 7fd9a9098800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:34:00.470 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:00.467+0000 7fd9a9098800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:34:00.470 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:00.467+0000 7fd9a9098800 20 zonegroup default 2024-09-12T17:34:00.470 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:00.467+0000 7fd9a9098800 20 rados->read ofs=0 len=0 2024-09-12T17:34:00.471 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:00.468+0000 7fd9a9098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:00.471 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:00.468+0000 7fd9a9098800 20 rados->read ofs=0 len=0 2024-09-12T17:34:00.471 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:00.468+0000 7fd9a9098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:00.471 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:00.468+0000 7fd9a9098800 20 rados->read ofs=0 len=0 2024-09-12T17:34:00.471 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:00.469+0000 7fd9a9098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:00.471 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:00.469+0000 7fd9a9098800 20 started sync module instance, tier type = 2024-09-12T17:34:00.471 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:00.469+0000 7fd9a9098800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:34:00.480 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:00.479+0000 7fd9a9098800 20 add_watcher() i=0 2024-09-12T17:34:00.480 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:00.479+0000 7fd9a9098800 20 add_watcher() i=1 2024-09-12T17:34:00.480 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:00.479+0000 7fd9a9098800 20 add_watcher() i=2 2024-09-12T17:34:00.481 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:00.479+0000 7fd9a9098800 20 add_watcher() i=3 2024-09-12T17:34:00.481 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:00.479+0000 7fd9a9098800 20 add_watcher() i=4 2024-09-12T17:34:00.481 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:00.479+0000 7fd9a9098800 20 add_watcher() i=5 2024-09-12T17:34:00.481 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:00.479+0000 7fd9a9098800 20 add_watcher() i=6 2024-09-12T17:34:00.481 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:00.480+0000 7fd9a9098800 20 add_watcher() i=7 2024-09-12T17:34:00.481 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:00.480+0000 7fd9a9098800 2 all 8 watchers are set, enabling cache 2024-09-12T17:34:00.483 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:00.482+0000 7fd85dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:34:00.484 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:00.483+0000 7fd9a9098800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:34:00.484 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:00.483+0000 7fd9a9098800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:34:00.484 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:00.483+0000 7fd9a9098800 5 note: GC not initialized 2024-09-12T17:34:00.487 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:00.483+0000 7fd85cfe1640 20 reqs_thread_entry: start 2024-09-12T17:34:00.487 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:00.483+0000 7fd9a9098800 20 init_complete bucket index max shards: 11 2024-09-12T17:34:00.487 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:00.483+0000 7fd9a9098800 20 Filter name: none 2024-09-12T17:34:00.487 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:00.483+0000 7fd855ffb640 20 reqs_thread_entry: start 2024-09-12T17:34:00.487 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:00.483+0000 7fd9a9098800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-12T17:34:00.488 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:00.483+0000 7fd9a9098800 20 rados->read ofs=0 len=0 2024-09-12T17:34:00.488 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:00.484+0000 7fd9a9098800 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T17:34:00.488 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:00.484+0000 7fd9a9098800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-12T17:34:00.488 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:00.484+0000 7fd9a9098800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-12T17:34:00.488 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:00.484+0000 7fd9a9098800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30 : miss 2024-09-12T17:34:00.489 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:00.484+0000 7fd9a9098800 20 rados->read ofs=0 len=0 2024-09-12T17:34:00.489 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:00.484+0000 7fd9a9098800 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T17:34:00.489 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:00.484+0000 7fd9a9098800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30 info.flags=0x17 2024-09-12T17:34:00.489 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:00.484+0000 7fd9a9098800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30 to cache LRU end 2024-09-12T17:34:00.489 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:00.484+0000 7fd9a9098800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:34:00.489 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:00.484+0000 7fd9a9098800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:34:00.490 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:00.484+0000 7fd9a9098800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30 2024-09-12T17:34:00.491 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:00.491+0000 7fd9a9098800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30 info.flags=0x17 2024-09-12T17:34:00.492 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:00.491+0000 7fd9a9098800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30 to cache LRU end 2024-09-12T17:34:00.492 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:00.491+0000 7fd9a9098800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:34:00.492 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:00.491+0000 7fd9a9098800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30, ofs0, ns] 2024-09-12T17:34:00.493 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:00.491+0000 7fd88a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497061 cookie 94581003899664 notifier 6683 bl.length()=999 2024-09-12T17:34:00.493 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:00.491+0000 7fd88a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30 info.flags=0x17 2024-09-12T17:34:00.493 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:00.491+0000 7fd88a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30 to cache LRU end 2024-09-12T17:34:00.493 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:00.491+0000 7fd88a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:34:00.494 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:00.493+0000 7fd9a9098800 20 handle_bi_update(): bucket=:abort-at-block-writes[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30]): orig_sources= new_sources= 2024-09-12T17:34:00.494 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:00.493+0000 7fd9a9098800 20 handle_bi_update(): bucket=:abort-at-block-writes[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30]): potential sources added=[] removed=[] 2024-09-12T17:34:00.494 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:00.493+0000 7fd9a9098800 20 handle_bi_update(): bucket=:abort-at-block-writes[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30]): orig_dests= new_dests= 2024-09-12T17:34:00.495 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:00.493+0000 7fd9a9098800 20 handle_bi_update(): bucket=:abort-at-block-writes[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30]): potential dests added=[] removed=[] 2024-09-12T17:34:00.500 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:00.499+0000 7fd9a9098800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30.1.0 2024-09-12T17:34:00.500 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:00.499+0000 7fd9a9098800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30.1.0 2024-09-12T17:34:00.500 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:00.499+0000 7fd9a9098800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30.1.1 2024-09-12T17:34:00.500 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:00.499+0000 7fd9a9098800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30.1.1 2024-09-12T17:34:00.500 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:00.499+0000 7fd9a9098800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30.1.2 2024-09-12T17:34:00.500 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:00.499+0000 7fd9a9098800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30.1.2 2024-09-12T17:34:00.501 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:00.499+0000 7fd9a9098800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30.1.3 2024-09-12T17:34:00.501 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:00.499+0000 7fd9a9098800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30.1.3 2024-09-12T17:34:00.501 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:00.499+0000 7fd9a9098800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30.1.4 2024-09-12T17:34:00.501 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:00.499+0000 7fd9a9098800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30.1.4 2024-09-12T17:34:00.501 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:00.499+0000 7fd9a9098800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30.1.5 2024-09-12T17:34:00.501 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:00.499+0000 7fd9a9098800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30.1.5 2024-09-12T17:34:00.501 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:00.499+0000 7fd9a9098800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30.1.6 2024-09-12T17:34:00.501 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:00.499+0000 7fd9a9098800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30.1.6 2024-09-12T17:34:00.501 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:00.499+0000 7fd9a9098800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30.1.7 2024-09-12T17:34:00.501 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:00.499+0000 7fd9a9098800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30.1.7 2024-09-12T17:34:00.501 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:00.499+0000 7fd9a9098800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30.1.8 2024-09-12T17:34:00.501 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:00.499+0000 7fd9a9098800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30.1.8 2024-09-12T17:34:00.501 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:00.499+0000 7fd9a9098800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30.1.9 2024-09-12T17:34:00.501 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:00.499+0000 7fd9a9098800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30.1.9 2024-09-12T17:34:00.502 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:00.499+0000 7fd9a9098800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30.1.10 2024-09-12T17:34:00.502 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:00.499+0000 7fd9a9098800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30.1.10 2024-09-12T17:34:00.502 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:00.499+0000 7fd9a9098800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30.1.11 2024-09-12T17:34:00.502 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:00.499+0000 7fd9a9098800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30.1.11 2024-09-12T17:34:00.502 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:00.499+0000 7fd9a9098800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30.0 2024-09-12T17:34:00.503 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:00.500+0000 7fd9a9098800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30.1 2024-09-12T17:34:00.503 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:00.500+0000 7fd9a9098800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30.2 2024-09-12T17:34:00.503 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:00.501+0000 7fd9a9098800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30.3 2024-09-12T17:34:00.503 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:00.501+0000 7fd9a9098800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30.4 2024-09-12T17:34:00.503 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:00.502+0000 7fd9a9098800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30.5 2024-09-12T17:34:00.503 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:00.502+0000 7fd9a9098800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30.6 2024-09-12T17:34:00.504 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:00.503+0000 7fd9a9098800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30.7 2024-09-12T17:34:00.504 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:00.503+0000 7fd9a9098800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30.8 2024-09-12T17:34:00.505 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:00.504+0000 7fd9a9098800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30.9 2024-09-12T17:34:00.505 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:00.504+0000 7fd9a9098800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30.10 2024-09-12T17:34:00.509 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:00.508+0000 7fd9a9098800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30 : hit (requested=0x17, cached=0x17) 2024-09-12T17:34:00.509 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:00.508+0000 7fd9a9098800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30 2024-09-12T17:34:00.510 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:00.509+0000 7fd9a9098800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30 info.flags=0x17 2024-09-12T17:34:00.510 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:00.509+0000 7fd9a9098800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30 to cache LRU end 2024-09-12T17:34:00.510 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:00.509+0000 7fd9a9098800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:34:00.511 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:00.509+0000 7fd9a9098800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30, ofs0, ns] 2024-09-12T17:34:00.511 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:00.510+0000 7fd88a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497062 cookie 94581003899664 notifier 6683 bl.length()=999 2024-09-12T17:34:00.511 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:00.510+0000 7fd88a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30 info.flags=0x17 2024-09-12T17:34:00.511 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:00.510+0000 7fd88a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30 to cache LRU end 2024-09-12T17:34:00.511 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:00.510+0000 7fd88a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:34:00.512 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:00.511+0000 7fd9a9098800 20 handle_bi_update(): bucket=:abort-at-block-writes[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30]): orig_sources= new_sources= 2024-09-12T17:34:00.512 INFO:tasks.workunit.client.0.smithi037.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fd9a9098800 time 2024-09-12T17:34:00.512591+0000 2024-09-12T17:34:00.513 INFO:tasks.workunit.client.0.smithi037.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:34:00.513 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:00.511+0000 7fd9a9098800 20 handle_bi_update(): bucket=:abort-at-block-writes[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30]): potential sources added=[] removed=[] 2024-09-12T17:34:00.513 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:00.511+0000 7fd9a9098800 20 handle_bi_update(): bucket=:abort-at-block-writes[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30]): orig_dests= new_dests= 2024-09-12T17:34:00.513 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:00.511+0000 7fd9a9098800 20 handle_bi_update(): bucket=:abort-at-block-writes[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30]): potential dests added=[] removed=[] 2024-09-12T17:34:00.514 INFO:tasks.workunit.client.0.smithi037.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:34:00.514 INFO:tasks.workunit.client.0.smithi037.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fd9ac58c71a] 2024-09-12T17:34:00.514 INFO:tasks.workunit.client.0.smithi037.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fd9ac58c8d8] 2024-09-12T17:34:00.514 INFO:tasks.workunit.client.0.smithi037.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x560559129841] 2024-09-12T17:34:00.514 INFO:tasks.workunit.client.0.smithi037.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x189e) [0x56055913879e] 2024-09-12T17:34:00.514 INFO:tasks.workunit.client.0.smithi037.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x5605591395d4] 2024-09-12T17:34:00.514 INFO:tasks.workunit.client.0.smithi037.stderr: 6: main() 2024-09-12T17:34:00.515 INFO:tasks.workunit.client.0.smithi037.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fd9ab229590] 2024-09-12T17:34:00.515 INFO:tasks.workunit.client.0.smithi037.stderr: 8: __libc_start_main() 2024-09-12T17:34:00.515 INFO:tasks.workunit.client.0.smithi037.stderr: 9: _start() 2024-09-12T17:34:00.515 INFO:tasks.workunit.client.0.smithi037.stderr:*** Caught signal (Aborted) ** 2024-09-12T17:34:00.515 INFO:tasks.workunit.client.0.smithi037.stderr: in thread 7fd9a9098800 thread_name:radosgw-admin 2024-09-12T17:34:00.515 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:00.512+0000 7fd9a9098800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fd9a9098800 time 2024-09-12T17:34:00.512591+0000 2024-09-12T17:34:00.515 INFO:tasks.workunit.client.0.smithi037.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:34:00.515 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:34:00.515 INFO:tasks.workunit.client.0.smithi037.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:34:00.515 INFO:tasks.workunit.client.0.smithi037.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fd9ac58c71a] 2024-09-12T17:34:00.515 INFO:tasks.workunit.client.0.smithi037.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fd9ac58c8d8] 2024-09-12T17:34:00.515 INFO:tasks.workunit.client.0.smithi037.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x560559129841] 2024-09-12T17:34:00.516 INFO:tasks.workunit.client.0.smithi037.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x189e) [0x56055913879e] 2024-09-12T17:34:00.516 INFO:tasks.workunit.client.0.smithi037.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x5605591395d4] 2024-09-12T17:34:00.516 INFO:tasks.workunit.client.0.smithi037.stderr: 6: main() 2024-09-12T17:34:00.516 INFO:tasks.workunit.client.0.smithi037.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fd9ab229590] 2024-09-12T17:34:00.516 INFO:tasks.workunit.client.0.smithi037.stderr: 8: __libc_start_main() 2024-09-12T17:34:00.516 INFO:tasks.workunit.client.0.smithi037.stderr: 9: _start() 2024-09-12T17:34:00.516 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:34:00.538 INFO:tasks.workunit.client.0.smithi037.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:34:00.538 INFO:tasks.workunit.client.0.smithi037.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fd9ab23e6f0] 2024-09-12T17:34:00.538 INFO:tasks.workunit.client.0.smithi037.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fd9ab28b99c] 2024-09-12T17:34:00.538 INFO:tasks.workunit.client.0.smithi037.stderr: 3: raise() 2024-09-12T17:34:00.538 INFO:tasks.workunit.client.0.smithi037.stderr: 4: abort() 2024-09-12T17:34:00.539 INFO:tasks.workunit.client.0.smithi037.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fd9ac58c774] 2024-09-12T17:34:00.539 INFO:tasks.workunit.client.0.smithi037.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fd9ac58c8d8] 2024-09-12T17:34:00.539 INFO:tasks.workunit.client.0.smithi037.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x560559129841] 2024-09-12T17:34:00.539 INFO:tasks.workunit.client.0.smithi037.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x189e) [0x56055913879e] 2024-09-12T17:34:00.539 INFO:tasks.workunit.client.0.smithi037.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x5605591395d4] 2024-09-12T17:34:00.539 INFO:tasks.workunit.client.0.smithi037.stderr: 10: main() 2024-09-12T17:34:00.539 INFO:tasks.workunit.client.0.smithi037.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fd9ab229590] 2024-09-12T17:34:00.539 INFO:tasks.workunit.client.0.smithi037.stderr: 12: __libc_start_main() 2024-09-12T17:34:00.539 INFO:tasks.workunit.client.0.smithi037.stderr: 13: _start() 2024-09-12T17:34:00.539 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:00.513+0000 7fd9a9098800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:34:00.539 INFO:tasks.workunit.client.0.smithi037.stderr: in thread 7fd9a9098800 thread_name:radosgw-admin 2024-09-12T17:34:00.539 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:34:00.540 INFO:tasks.workunit.client.0.smithi037.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:34:00.540 INFO:tasks.workunit.client.0.smithi037.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fd9ab23e6f0] 2024-09-12T17:34:00.540 INFO:tasks.workunit.client.0.smithi037.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fd9ab28b99c] 2024-09-12T17:34:00.540 INFO:tasks.workunit.client.0.smithi037.stderr: 3: raise() 2024-09-12T17:34:00.540 INFO:tasks.workunit.client.0.smithi037.stderr: 4: abort() 2024-09-12T17:34:00.540 INFO:tasks.workunit.client.0.smithi037.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fd9ac58c774] 2024-09-12T17:34:00.540 INFO:tasks.workunit.client.0.smithi037.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fd9ac58c8d8] 2024-09-12T17:34:00.540 INFO:tasks.workunit.client.0.smithi037.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x560559129841] 2024-09-12T17:34:00.540 INFO:tasks.workunit.client.0.smithi037.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x189e) [0x56055913879e] 2024-09-12T17:34:00.540 INFO:tasks.workunit.client.0.smithi037.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x5605591395d4] 2024-09-12T17:34:00.540 INFO:tasks.workunit.client.0.smithi037.stderr: 10: main() 2024-09-12T17:34:00.540 INFO:tasks.workunit.client.0.smithi037.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fd9ab229590] 2024-09-12T17:34:00.540 INFO:tasks.workunit.client.0.smithi037.stderr: 12: __libc_start_main() 2024-09-12T17:34:00.541 INFO:tasks.workunit.client.0.smithi037.stderr: 13: _start() 2024-09-12T17:34:00.541 INFO:tasks.workunit.client.0.smithi037.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:34:00.541 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:34:00.541 INFO:tasks.workunit.client.0.smithi037.stderr:--- begin dump of recent events --- 2024-09-12T17:34:00.541 INFO:tasks.workunit.client.0.smithi037.stderr: -499> 2024-09-12T17:33:59.826+0000 7fd9a9098800 5 AuthRegistry(0x56055b140ac0) adding con mode: crc 2024-09-12T17:34:00.541 INFO:tasks.workunit.client.0.smithi037.stderr: -498> 2024-09-12T17:33:59.826+0000 7fd9a9098800 5 AuthRegistry(0x56055b140ac0) adding con mode: secure 2024-09-12T17:34:00.541 INFO:tasks.workunit.client.0.smithi037.stderr: -497> 2024-09-12T17:33:59.826+0000 7fd9a9098800 5 AuthRegistry(0x56055b140ac0) adding con mode: crc 2024-09-12T17:34:00.541 INFO:tasks.workunit.client.0.smithi037.stderr: -496> 2024-09-12T17:33:59.826+0000 7fd9a9098800 5 AuthRegistry(0x56055b140ac0) adding con mode: secure 2024-09-12T17:34:00.541 INFO:tasks.workunit.client.0.smithi037.stderr: -495> 2024-09-12T17:33:59.827+0000 7fd9a9098800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:34:00.542 INFO:tasks.workunit.client.0.smithi037.stderr: -494> 2024-09-12T17:33:59.827+0000 7fd9a9098800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:34:00.542 INFO:tasks.workunit.client.0.smithi037.stderr: -493> 2024-09-12T17:33:59.827+0000 7fd9a9098800 5 asok(0x56055af1f730) register_command rotate-key hook 0x56055b140c08 2024-09-12T17:34:00.542 INFO:tasks.workunit.client.0.smithi037.stderr: -492> 2024-09-12T17:33:59.827+0000 7fd9a9098800 10 monclient: _reopen_session rank -1 2024-09-12T17:34:00.542 INFO:tasks.workunit.client.0.smithi037.stderr: -491> 2024-09-12T17:33:59.827+0000 7fd9a9098800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T17:34:00.542 INFO:tasks.workunit.client.0.smithi037.stderr: -490> 2024-09-12T17:33:59.827+0000 7fd9a9098800 10 monclient(hunting): picked mon.noname-c con 0x56055afed000 addr [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] 2024-09-12T17:34:00.542 INFO:tasks.workunit.client.0.smithi037.stderr: -489> 2024-09-12T17:33:59.827+0000 7fd9a9098800 10 monclient(hunting): picked mon.noname-b con 0x56055b0834f0 addr [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] 2024-09-12T17:34:00.542 INFO:tasks.workunit.client.0.smithi037.stderr: -488> 2024-09-12T17:33:59.827+0000 7fd9a9098800 10 monclient(hunting): picked mon.noname-a con 0x56055b089bd0 addr [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] 2024-09-12T17:34:00.543 INFO:tasks.workunit.client.0.smithi037.stderr: -487> 2024-09-12T17:33:59.827+0000 7fd9a9098800 10 monclient(hunting): start opening mon connection 2024-09-12T17:34:00.543 INFO:tasks.workunit.client.0.smithi037.stderr: -486> 2024-09-12T17:33:59.827+0000 7fd9a9098800 10 monclient(hunting): start opening mon connection 2024-09-12T17:34:00.543 INFO:tasks.workunit.client.0.smithi037.stderr: -485> 2024-09-12T17:33:59.827+0000 7fd9a9098800 10 monclient(hunting): start opening mon connection 2024-09-12T17:34:00.543 INFO:tasks.workunit.client.0.smithi037.stderr: -484> 2024-09-12T17:33:59.827+0000 7fd9a9098800 10 monclient(hunting): _renew_subs 2024-09-12T17:34:00.543 INFO:tasks.workunit.client.0.smithi037.stderr: -483> 2024-09-12T17:33:59.827+0000 7fd9a9098800 10 monclient(hunting): authenticate will time out at 2227.424390s 2024-09-12T17:34:00.543 INFO:tasks.workunit.client.0.smithi037.stderr: -482> 2024-09-12T17:33:59.827+0000 7fd9a6b82640 10 monclient(hunting): get_auth_request con 0x56055afed000 auth_method 0 2024-09-12T17:34:00.543 INFO:tasks.workunit.client.0.smithi037.stderr: -481> 2024-09-12T17:33:59.827+0000 7fd9a6b82640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:34:00.543 INFO:tasks.workunit.client.0.smithi037.stderr: -480> 2024-09-12T17:33:59.827+0000 7fd9a6b82640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:34:00.543 INFO:tasks.workunit.client.0.smithi037.stderr: -479> 2024-09-12T17:33:59.827+0000 7fd9a6b82640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:34:00.543 INFO:tasks.workunit.client.0.smithi037.stderr: -478> 2024-09-12T17:33:59.827+0000 7fd9a7383640 10 monclient(hunting): get_auth_request con 0x56055b089bd0 auth_method 0 2024-09-12T17:34:00.543 INFO:tasks.workunit.client.0.smithi037.stderr: -477> 2024-09-12T17:33:59.827+0000 7fd9a7383640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:34:00.543 INFO:tasks.workunit.client.0.smithi037.stderr: -476> 2024-09-12T17:33:59.827+0000 7fd9a7383640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:34:00.543 INFO:tasks.workunit.client.0.smithi037.stderr: -475> 2024-09-12T17:33:59.827+0000 7fd9a7383640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:34:00.543 INFO:tasks.workunit.client.0.smithi037.stderr: -474> 2024-09-12T17:33:59.827+0000 7fd9a6b82640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:34:00.544 INFO:tasks.workunit.client.0.smithi037.stderr: -473> 2024-09-12T17:33:59.827+0000 7fd9a6b82640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:34:00.544 INFO:tasks.workunit.client.0.smithi037.stderr: -472> 2024-09-12T17:33:59.827+0000 7fd9a6b82640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:34:00.544 INFO:tasks.workunit.client.0.smithi037.stderr: -471> 2024-09-12T17:33:59.827+0000 7fd9a7383640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:34:00.544 INFO:tasks.workunit.client.0.smithi037.stderr: -470> 2024-09-12T17:33:59.827+0000 7fd9a7383640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:34:00.544 INFO:tasks.workunit.client.0.smithi037.stderr: -469> 2024-09-12T17:33:59.827+0000 7fd9a7383640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:34:00.544 INFO:tasks.workunit.client.0.smithi037.stderr: -468> 2024-09-12T17:33:59.827+0000 7fd9a6381640 10 monclient(hunting): get_auth_request con 0x56055b0834f0 auth_method 0 2024-09-12T17:34:00.544 INFO:tasks.workunit.client.0.smithi037.stderr: -467> 2024-09-12T17:33:59.827+0000 7fd9a6381640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:34:00.544 INFO:tasks.workunit.client.0.smithi037.stderr: -466> 2024-09-12T17:33:59.827+0000 7fd9a6381640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:34:00.544 INFO:tasks.workunit.client.0.smithi037.stderr: -465> 2024-09-12T17:33:59.827+0000 7fd9a6381640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:34:00.544 INFO:tasks.workunit.client.0.smithi037.stderr: -464> 2024-09-12T17:33:59.827+0000 7fd9a6b82640 10 monclient(hunting): handle_auth_done global_id 6674 payload 824 2024-09-12T17:34:00.545 INFO:tasks.workunit.client.0.smithi037.stderr: -463> 2024-09-12T17:33:59.827+0000 7fd9a6b82640 10 monclient: _finish_hunting 0 2024-09-12T17:34:00.545 INFO:tasks.workunit.client.0.smithi037.stderr: -462> 2024-09-12T17:33:59.827+0000 7fd9a6b82640 1 monclient: found mon.noname-c 2024-09-12T17:34:00.545 INFO:tasks.workunit.client.0.smithi037.stderr: -461> 2024-09-12T17:33:59.827+0000 7fd9a6b82640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.37:3301/0 2024-09-12T17:34:00.545 INFO:tasks.workunit.client.0.smithi037.stderr: -460> 2024-09-12T17:33:59.828+0000 7fd893606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:34:00.545 INFO:tasks.workunit.client.0.smithi037.stderr: -459> 2024-09-12T17:33:59.828+0000 7fd893606640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:34:00.545 INFO:tasks.workunit.client.0.smithi037.stderr: -458> 2024-09-12T17:33:59.828+0000 7fd893606640 10 monclient: dump: 2024-09-12T17:34:00.545 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:34:00.545 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:34:00.545 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:34:00.545 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:34:00.545 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:34:00.545 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:34:00.546 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:34:00.546 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:34:00.546 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:34:00.546 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:34:00.546 INFO:tasks.workunit.client.0.smithi037.stderr: -457> 2024-09-12T17:33:59.828+0000 7fd893606640 10 monclient: _finish_auth 0 2024-09-12T17:34:00.546 INFO:tasks.workunit.client.0.smithi037.stderr: -456> 2024-09-12T17:33:59.828+0000 7fd893606640 10 monclient: _check_auth_tickets 2024-09-12T17:34:00.546 INFO:tasks.workunit.client.0.smithi037.stderr: -455> 2024-09-12T17:33:59.828+0000 7fd893606640 10 monclient: handle_config config(0 keys) 2024-09-12T17:34:00.546 INFO:tasks.workunit.client.0.smithi037.stderr: -454> 2024-09-12T17:33:59.828+0000 7fd893606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:34:00.546 INFO:tasks.workunit.client.0.smithi037.stderr: -453> 2024-09-12T17:33:59.828+0000 7fd893606640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:34:00.546 INFO:tasks.workunit.client.0.smithi037.stderr: -452> 2024-09-12T17:33:59.828+0000 7fd893606640 10 monclient: dump: 2024-09-12T17:34:00.546 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:34:00.547 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:34:00.547 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:34:00.547 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:34:00.547 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:34:00.547 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:34:00.547 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:34:00.547 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:34:00.547 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:34:00.547 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:34:00.547 INFO:tasks.workunit.client.0.smithi037.stderr: -451> 2024-09-12T17:33:59.828+0000 7fd9a9098800 5 monclient: authenticate success, global_id 6674 2024-09-12T17:34:00.547 INFO:tasks.workunit.client.0.smithi037.stderr: -450> 2024-09-12T17:33:59.828+0000 7fd894e09640 4 set_mon_vals no callback set 2024-09-12T17:34:00.547 INFO:tasks.workunit.client.0.smithi037.stderr: -449> 2024-09-12T17:33:59.828+0000 7fd9a9098800 10 monclient: _renew_subs 2024-09-12T17:34:00.547 INFO:tasks.workunit.client.0.smithi037.stderr: -448> 2024-09-12T17:33:59.828+0000 7fd9a9098800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.37:3301/0 2024-09-12T17:34:00.548 INFO:tasks.workunit.client.0.smithi037.stderr: -447> 2024-09-12T17:33:59.828+0000 7fd9a9098800 10 monclient: _renew_subs 2024-09-12T17:34:00.548 INFO:tasks.workunit.client.0.smithi037.stderr: -446> 2024-09-12T17:33:59.828+0000 7fd9a9098800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.37:3301/0 2024-09-12T17:34:00.548 INFO:tasks.workunit.client.0.smithi037.stderr: -445> 2024-09-12T17:33:59.828+0000 7fd9a9098800 1 librados: init done 2024-09-12T17:34:00.548 INFO:tasks.workunit.client.0.smithi037.stderr: -444> 2024-09-12T17:33:59.830+0000 7fd893606640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:34:00.548 INFO:tasks.workunit.client.0.smithi037.stderr: -443> 2024-09-12T17:33:59.830+0000 7fd893606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.40:6816/3916250676,v1:172.21.15.40:6817/3916250676] 2024-09-12T17:34:00.548 INFO:tasks.workunit.client.0.smithi037.stderr: -442> 2024-09-12T17:33:59.830+0000 7fd893606640 4 mgrc reconnect Starting new session with [v2:172.21.15.40:6816/3916250676,v1:172.21.15.40:6817/3916250676] 2024-09-12T17:34:00.548 INFO:tasks.workunit.client.0.smithi037.stderr: -441> 2024-09-12T17:33:59.830+0000 7fd9a6381640 10 monclient: get_auth_request con 0x7fd88c076470 auth_method 0 2024-09-12T17:34:00.548 INFO:tasks.workunit.client.0.smithi037.stderr: -440> 2024-09-12T17:33:59.830+0000 7fd9a7383640 10 monclient: get_auth_request con 0x56055b168ce0 auth_method 0 2024-09-12T17:34:00.548 INFO:tasks.workunit.client.0.smithi037.stderr: -439> 2024-09-12T17:33:59.831+0000 7fd9a6b82640 10 monclient: get_auth_request con 0x56055b18bad0 auth_method 0 2024-09-12T17:34:00.548 INFO:tasks.workunit.client.0.smithi037.stderr: -438> 2024-09-12T17:33:59.833+0000 7fd9a6381640 10 monclient: get_auth_request con 0x56055b190d20 auth_method 0 2024-09-12T17:34:00.549 INFO:tasks.workunit.client.0.smithi037.stderr: -437> 2024-09-12T17:34:00.035+0000 7fd9a6381640 10 monclient: get_auth_request con 0x56055b190d20 auth_method 0 2024-09-12T17:34:00.549 INFO:tasks.workunit.client.0.smithi037.stderr: -436> 2024-09-12T17:34:00.036+0000 7fd9a9098800 10 monclient: build_initial_monmap 2024-09-12T17:34:00.549 INFO:tasks.workunit.client.0.smithi037.stderr: -435> 2024-09-12T17:34:00.036+0000 7fd9a9098800 1 build_initial for_mkfs: 0 2024-09-12T17:34:00.549 INFO:tasks.workunit.client.0.smithi037.stderr: -434> 2024-09-12T17:34:00.036+0000 7fd9a9098800 10 monclient: monmap: 2024-09-12T17:34:00.549 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 0 2024-09-12T17:34:00.549 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:34:00.549 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 0.000000 2024-09-12T17:34:00.550 INFO:tasks.workunit.client.0.smithi037.stderr:created 0.000000 2024-09-12T17:34:00.550 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 0 (unknown) 2024-09-12T17:34:00.550 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:34:00.550 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.noname-a 2024-09-12T17:34:00.550 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.noname-b 2024-09-12T17:34:00.550 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.noname-c 2024-09-12T17:34:00.550 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:34:00.550 INFO:tasks.workunit.client.0.smithi037.stderr: -433> 2024-09-12T17:34:00.036+0000 7fd9a9098800 5 AuthRegistry(0x56055b194d90) adding auth protocol: cephx 2024-09-12T17:34:00.550 INFO:tasks.workunit.client.0.smithi037.stderr: -432> 2024-09-12T17:34:00.036+0000 7fd9a9098800 5 AuthRegistry(0x56055b194d90) adding auth protocol: cephx 2024-09-12T17:34:00.551 INFO:tasks.workunit.client.0.smithi037.stderr: -431> 2024-09-12T17:34:00.036+0000 7fd9a9098800 5 AuthRegistry(0x56055b194d90) adding auth protocol: cephx 2024-09-12T17:34:00.551 INFO:tasks.workunit.client.0.smithi037.stderr: -430> 2024-09-12T17:34:00.036+0000 7fd9a9098800 5 AuthRegistry(0x56055b194d90) adding con mode: secure 2024-09-12T17:34:00.551 INFO:tasks.workunit.client.0.smithi037.stderr: -429> 2024-09-12T17:34:00.036+0000 7fd9a9098800 5 AuthRegistry(0x56055b194d90) adding con mode: crc 2024-09-12T17:34:00.551 INFO:tasks.workunit.client.0.smithi037.stderr: -428> 2024-09-12T17:34:00.036+0000 7fd9a9098800 5 AuthRegistry(0x56055b194d90) adding con mode: secure 2024-09-12T17:34:00.551 INFO:tasks.workunit.client.0.smithi037.stderr: -427> 2024-09-12T17:34:00.036+0000 7fd9a9098800 5 AuthRegistry(0x56055b194d90) adding con mode: crc 2024-09-12T17:34:00.551 INFO:tasks.workunit.client.0.smithi037.stderr: -426> 2024-09-12T17:34:00.036+0000 7fd9a9098800 5 AuthRegistry(0x56055b194d90) adding con mode: secure 2024-09-12T17:34:00.551 INFO:tasks.workunit.client.0.smithi037.stderr: -425> 2024-09-12T17:34:00.036+0000 7fd9a9098800 5 AuthRegistry(0x56055b194d90) adding con mode: crc 2024-09-12T17:34:00.551 INFO:tasks.workunit.client.0.smithi037.stderr: -424> 2024-09-12T17:34:00.036+0000 7fd9a9098800 5 AuthRegistry(0x56055b194d90) adding con mode: crc 2024-09-12T17:34:00.551 INFO:tasks.workunit.client.0.smithi037.stderr: -423> 2024-09-12T17:34:00.036+0000 7fd9a9098800 5 AuthRegistry(0x56055b194d90) adding con mode: secure 2024-09-12T17:34:00.551 INFO:tasks.workunit.client.0.smithi037.stderr: -422> 2024-09-12T17:34:00.036+0000 7fd9a9098800 5 AuthRegistry(0x56055b194d90) adding con mode: crc 2024-09-12T17:34:00.552 INFO:tasks.workunit.client.0.smithi037.stderr: -421> 2024-09-12T17:34:00.036+0000 7fd9a9098800 5 AuthRegistry(0x56055b194d90) adding con mode: secure 2024-09-12T17:34:00.552 INFO:tasks.workunit.client.0.smithi037.stderr: -420> 2024-09-12T17:34:00.036+0000 7fd9a9098800 5 AuthRegistry(0x56055b194d90) adding con mode: crc 2024-09-12T17:34:00.552 INFO:tasks.workunit.client.0.smithi037.stderr: -419> 2024-09-12T17:34:00.036+0000 7fd9a9098800 5 AuthRegistry(0x56055b194d90) adding con mode: secure 2024-09-12T17:34:00.552 INFO:tasks.workunit.client.0.smithi037.stderr: -418> 2024-09-12T17:34:00.036+0000 7fd9a9098800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:34:00.552 INFO:tasks.workunit.client.0.smithi037.stderr: -417> 2024-09-12T17:34:00.036+0000 7fd9a9098800 5 asok(0x56055af1f730) register_command objecter_requests cmddesc objecter_requests hook 0x56055b199350 EEXIST 2024-09-12T17:34:00.552 INFO:tasks.workunit.client.0.smithi037.stderr: -416> 2024-09-12T17:34:00.036+0000 7fd9a9098800 10 monclient: init 2024-09-12T17:34:00.552 INFO:tasks.workunit.client.0.smithi037.stderr: -415> 2024-09-12T17:34:00.036+0000 7fd9a9098800 5 AuthRegistry(0x56055b193d48) adding auth protocol: cephx 2024-09-12T17:34:00.552 INFO:tasks.workunit.client.0.smithi037.stderr: -414> 2024-09-12T17:34:00.036+0000 7fd9a9098800 5 AuthRegistry(0x56055b193d48) adding auth protocol: cephx 2024-09-12T17:34:00.553 INFO:tasks.workunit.client.0.smithi037.stderr: -413> 2024-09-12T17:34:00.036+0000 7fd9a9098800 5 AuthRegistry(0x56055b193d48) adding auth protocol: cephx 2024-09-12T17:34:00.553 INFO:tasks.workunit.client.0.smithi037.stderr: -412> 2024-09-12T17:34:00.036+0000 7fd9a9098800 5 AuthRegistry(0x56055b193d48) adding con mode: secure 2024-09-12T17:34:00.553 INFO:tasks.workunit.client.0.smithi037.stderr: -411> 2024-09-12T17:34:00.036+0000 7fd9a9098800 5 AuthRegistry(0x56055b193d48) adding con mode: crc 2024-09-12T17:34:00.553 INFO:tasks.workunit.client.0.smithi037.stderr: -410> 2024-09-12T17:34:00.036+0000 7fd9a9098800 5 AuthRegistry(0x56055b193d48) adding con mode: secure 2024-09-12T17:34:00.553 INFO:tasks.workunit.client.0.smithi037.stderr: -409> 2024-09-12T17:34:00.036+0000 7fd9a9098800 5 AuthRegistry(0x56055b193d48) adding con mode: crc 2024-09-12T17:34:00.553 INFO:tasks.workunit.client.0.smithi037.stderr: -408> 2024-09-12T17:34:00.036+0000 7fd9a9098800 5 AuthRegistry(0x56055b193d48) adding con mode: secure 2024-09-12T17:34:00.553 INFO:tasks.workunit.client.0.smithi037.stderr: -407> 2024-09-12T17:34:00.036+0000 7fd9a9098800 5 AuthRegistry(0x56055b193d48) adding con mode: crc 2024-09-12T17:34:00.553 INFO:tasks.workunit.client.0.smithi037.stderr: -406> 2024-09-12T17:34:00.036+0000 7fd9a9098800 5 AuthRegistry(0x56055b193d48) adding con mode: crc 2024-09-12T17:34:00.553 INFO:tasks.workunit.client.0.smithi037.stderr: -405> 2024-09-12T17:34:00.036+0000 7fd9a9098800 5 AuthRegistry(0x56055b193d48) adding con mode: secure 2024-09-12T17:34:00.553 INFO:tasks.workunit.client.0.smithi037.stderr: -404> 2024-09-12T17:34:00.036+0000 7fd9a9098800 5 AuthRegistry(0x56055b193d48) adding con mode: crc 2024-09-12T17:34:00.553 INFO:tasks.workunit.client.0.smithi037.stderr: -403> 2024-09-12T17:34:00.036+0000 7fd9a9098800 5 AuthRegistry(0x56055b193d48) adding con mode: secure 2024-09-12T17:34:00.553 INFO:tasks.workunit.client.0.smithi037.stderr: -402> 2024-09-12T17:34:00.036+0000 7fd9a9098800 5 AuthRegistry(0x56055b193d48) adding con mode: crc 2024-09-12T17:34:00.553 INFO:tasks.workunit.client.0.smithi037.stderr: -401> 2024-09-12T17:34:00.036+0000 7fd9a9098800 5 AuthRegistry(0x56055b193d48) adding con mode: secure 2024-09-12T17:34:00.554 INFO:tasks.workunit.client.0.smithi037.stderr: -400> 2024-09-12T17:34:00.037+0000 7fd9a9098800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:34:00.554 INFO:tasks.workunit.client.0.smithi037.stderr: -399> 2024-09-12T17:34:00.037+0000 7fd9a9098800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:34:00.554 INFO:tasks.workunit.client.0.smithi037.stderr: -398> 2024-09-12T17:34:00.037+0000 7fd9a9098800 5 asok(0x56055af1f730) register_command rotate-key cmddesc rotate-key hook 0x56055b193e90 EEXIST 2024-09-12T17:34:00.554 INFO:tasks.workunit.client.0.smithi037.stderr: -397> 2024-09-12T17:34:00.037+0000 7fd9a9098800 10 monclient: _reopen_session rank -1 2024-09-12T17:34:00.554 INFO:tasks.workunit.client.0.smithi037.stderr: -396> 2024-09-12T17:34:00.037+0000 7fd9a9098800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T17:34:00.554 INFO:tasks.workunit.client.0.smithi037.stderr: -395> 2024-09-12T17:34:00.037+0000 7fd9a9098800 10 monclient(hunting): picked mon.noname-c con 0x56055b1bd650 addr [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] 2024-09-12T17:34:00.554 INFO:tasks.workunit.client.0.smithi037.stderr: -394> 2024-09-12T17:34:00.037+0000 7fd9a9098800 10 monclient(hunting): picked mon.noname-b con 0x56055b1bc7b0 addr [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] 2024-09-12T17:34:00.554 INFO:tasks.workunit.client.0.smithi037.stderr: -393> 2024-09-12T17:34:00.037+0000 7fd9a9098800 10 monclient(hunting): picked mon.noname-a con 0x56055b1d5aa0 addr [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] 2024-09-12T17:34:00.554 INFO:tasks.workunit.client.0.smithi037.stderr: -392> 2024-09-12T17:34:00.037+0000 7fd9a9098800 10 monclient(hunting): start opening mon connection 2024-09-12T17:34:00.554 INFO:tasks.workunit.client.0.smithi037.stderr: -391> 2024-09-12T17:34:00.037+0000 7fd9a9098800 10 monclient(hunting): start opening mon connection 2024-09-12T17:34:00.554 INFO:tasks.workunit.client.0.smithi037.stderr: -390> 2024-09-12T17:34:00.037+0000 7fd9a9098800 10 monclient(hunting): start opening mon connection 2024-09-12T17:34:00.554 INFO:tasks.workunit.client.0.smithi037.stderr: -389> 2024-09-12T17:34:00.037+0000 7fd9a9098800 10 monclient(hunting): _renew_subs 2024-09-12T17:34:00.554 INFO:tasks.workunit.client.0.smithi037.stderr: -388> 2024-09-12T17:34:00.037+0000 7fd9a9098800 10 monclient(hunting): authenticate will time out at 2227.634473s 2024-09-12T17:34:00.555 INFO:tasks.workunit.client.0.smithi037.stderr: -387> 2024-09-12T17:34:00.037+0000 7fd9a7383640 10 monclient(hunting): get_auth_request con 0x56055b1d5aa0 auth_method 0 2024-09-12T17:34:00.555 INFO:tasks.workunit.client.0.smithi037.stderr: -386> 2024-09-12T17:34:00.037+0000 7fd9a7383640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:34:00.555 INFO:tasks.workunit.client.0.smithi037.stderr: -385> 2024-09-12T17:34:00.037+0000 7fd9a7383640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:34:00.555 INFO:tasks.workunit.client.0.smithi037.stderr: -384> 2024-09-12T17:34:00.037+0000 7fd9a7383640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:34:00.555 INFO:tasks.workunit.client.0.smithi037.stderr: -383> 2024-09-12T17:34:00.037+0000 7fd9a6b82640 10 monclient(hunting): get_auth_request con 0x56055b1bd650 auth_method 0 2024-09-12T17:34:00.555 INFO:tasks.workunit.client.0.smithi037.stderr: -382> 2024-09-12T17:34:00.037+0000 7fd9a6b82640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:34:00.555 INFO:tasks.workunit.client.0.smithi037.stderr: -381> 2024-09-12T17:34:00.037+0000 7fd9a6b82640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:34:00.555 INFO:tasks.workunit.client.0.smithi037.stderr: -380> 2024-09-12T17:34:00.037+0000 7fd9a6b82640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:34:00.555 INFO:tasks.workunit.client.0.smithi037.stderr: -379> 2024-09-12T17:34:00.037+0000 7fd9a6381640 10 monclient(hunting): get_auth_request con 0x56055b1bc7b0 auth_method 0 2024-09-12T17:34:00.555 INFO:tasks.workunit.client.0.smithi037.stderr: -378> 2024-09-12T17:34:00.037+0000 7fd9a6381640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:34:00.555 INFO:tasks.workunit.client.0.smithi037.stderr: -377> 2024-09-12T17:34:00.037+0000 7fd9a6381640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:34:00.555 INFO:tasks.workunit.client.0.smithi037.stderr: -376> 2024-09-12T17:34:00.037+0000 7fd9a6381640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:34:00.555 INFO:tasks.workunit.client.0.smithi037.stderr: -375> 2024-09-12T17:34:00.037+0000 7fd9a7383640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:34:00.556 INFO:tasks.workunit.client.0.smithi037.stderr: -374> 2024-09-12T17:34:00.037+0000 7fd9a7383640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:34:00.556 INFO:tasks.workunit.client.0.smithi037.stderr: -373> 2024-09-12T17:34:00.037+0000 7fd9a7383640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:34:00.556 INFO:tasks.workunit.client.0.smithi037.stderr: -372> 2024-09-12T17:34:00.037+0000 7fd9a6b82640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:34:00.556 INFO:tasks.workunit.client.0.smithi037.stderr: -371> 2024-09-12T17:34:00.037+0000 7fd9a6b82640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:34:00.556 INFO:tasks.workunit.client.0.smithi037.stderr: -370> 2024-09-12T17:34:00.037+0000 7fd9a6b82640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:34:00.556 INFO:tasks.workunit.client.0.smithi037.stderr: -369> 2024-09-12T17:34:00.037+0000 7fd9a6381640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:34:00.556 INFO:tasks.workunit.client.0.smithi037.stderr: -368> 2024-09-12T17:34:00.037+0000 7fd9a6381640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:34:00.556 INFO:tasks.workunit.client.0.smithi037.stderr: -367> 2024-09-12T17:34:00.037+0000 7fd9a6381640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:34:00.556 INFO:tasks.workunit.client.0.smithi037.stderr: -366> 2024-09-12T17:34:00.037+0000 7fd9a7383640 10 monclient(hunting): handle_auth_done global_id 7125 payload 824 2024-09-12T17:34:00.556 INFO:tasks.workunit.client.0.smithi037.stderr: -365> 2024-09-12T17:34:00.037+0000 7fd9a7383640 10 monclient: _finish_hunting 0 2024-09-12T17:34:00.556 INFO:tasks.workunit.client.0.smithi037.stderr: -364> 2024-09-12T17:34:00.037+0000 7fd9a7383640 1 monclient: found mon.noname-a 2024-09-12T17:34:00.557 INFO:tasks.workunit.client.0.smithi037.stderr: -363> 2024-09-12T17:34:00.037+0000 7fd9a7383640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.37:3300/0 2024-09-12T17:34:00.557 INFO:tasks.workunit.client.0.smithi037.stderr: -362> 2024-09-12T17:34:00.038+0000 7fd890e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:34:00.557 INFO:tasks.workunit.client.0.smithi037.stderr: -361> 2024-09-12T17:34:00.038+0000 7fd890e01640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:34:00.557 INFO:tasks.workunit.client.0.smithi037.stderr: -360> 2024-09-12T17:34:00.038+0000 7fd890e01640 10 monclient: dump: 2024-09-12T17:34:00.557 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:34:00.557 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:34:00.557 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:34:00.557 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:34:00.557 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:34:00.557 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:34:00.558 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:34:00.558 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:34:00.558 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:34:00.558 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:34:00.558 INFO:tasks.workunit.client.0.smithi037.stderr: -359> 2024-09-12T17:34:00.038+0000 7fd890e01640 10 monclient: _finish_auth 0 2024-09-12T17:34:00.558 INFO:tasks.workunit.client.0.smithi037.stderr: -358> 2024-09-12T17:34:00.038+0000 7fd890e01640 10 monclient: _check_auth_tickets 2024-09-12T17:34:00.558 INFO:tasks.workunit.client.0.smithi037.stderr: -357> 2024-09-12T17:34:00.038+0000 7fd890e01640 10 monclient: handle_config config(0 keys) 2024-09-12T17:34:00.558 INFO:tasks.workunit.client.0.smithi037.stderr: -356> 2024-09-12T17:34:00.038+0000 7fd890e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:34:00.558 INFO:tasks.workunit.client.0.smithi037.stderr: -355> 2024-09-12T17:34:00.038+0000 7fd890e01640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:34:00.558 INFO:tasks.workunit.client.0.smithi037.stderr: -354> 2024-09-12T17:34:00.038+0000 7fd890e01640 10 monclient: dump: 2024-09-12T17:34:00.558 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:34:00.559 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:34:00.559 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:34:00.559 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:34:00.559 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:34:00.559 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:34:00.559 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:34:00.559 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:34:00.559 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:34:00.559 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:34:00.559 INFO:tasks.workunit.client.0.smithi037.stderr: -353> 2024-09-12T17:34:00.038+0000 7fd9a9098800 5 monclient: authenticate success, global_id 7125 2024-09-12T17:34:00.559 INFO:tasks.workunit.client.0.smithi037.stderr: -352> 2024-09-12T17:34:00.038+0000 7fd9a9098800 10 monclient: _renew_subs 2024-09-12T17:34:00.559 INFO:tasks.workunit.client.0.smithi037.stderr: -351> 2024-09-12T17:34:00.038+0000 7fd9a7b84640 4 set_mon_vals no callback set 2024-09-12T17:34:00.559 INFO:tasks.workunit.client.0.smithi037.stderr: -350> 2024-09-12T17:34:00.038+0000 7fd9a9098800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.37:3300/0 2024-09-12T17:34:00.559 INFO:tasks.workunit.client.0.smithi037.stderr: -349> 2024-09-12T17:34:00.038+0000 7fd9a9098800 10 monclient: _renew_subs 2024-09-12T17:34:00.560 INFO:tasks.workunit.client.0.smithi037.stderr: -348> 2024-09-12T17:34:00.038+0000 7fd9a9098800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.37:3300/0 2024-09-12T17:34:00.560 INFO:tasks.workunit.client.0.smithi037.stderr: -347> 2024-09-12T17:34:00.040+0000 7fd890e01640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:34:00.560 INFO:tasks.workunit.client.0.smithi037.stderr: -346> 2024-09-12T17:34:00.040+0000 7fd890e01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.40:6816/3916250676,v1:172.21.15.40:6817/3916250676] 2024-09-12T17:34:00.560 INFO:tasks.workunit.client.0.smithi037.stderr: -345> 2024-09-12T17:34:00.040+0000 7fd890e01640 4 mgrc reconnect Starting new session with [v2:172.21.15.40:6816/3916250676,v1:172.21.15.40:6817/3916250676] 2024-09-12T17:34:00.560 INFO:tasks.workunit.client.0.smithi037.stderr: -344> 2024-09-12T17:34:00.040+0000 7fd9a6b82640 10 monclient: get_auth_request con 0x7fd880076380 auth_method 0 2024-09-12T17:34:00.560 INFO:tasks.workunit.client.0.smithi037.stderr: -343> 2024-09-12T17:34:00.040+0000 7fd9a9098800 10 monclient: get_monmap_and_config 2024-09-12T17:34:00.560 INFO:tasks.workunit.client.0.smithi037.stderr: -342> 2024-09-12T17:34:00.040+0000 7fd9a9098800 10 monclient: build_initial_monmap 2024-09-12T17:34:00.560 INFO:tasks.workunit.client.0.smithi037.stderr: -341> 2024-09-12T17:34:00.040+0000 7fd9a9098800 1 build_initial for_mkfs: 0 2024-09-12T17:34:00.560 INFO:tasks.workunit.client.0.smithi037.stderr: -340> 2024-09-12T17:34:00.040+0000 7fd9a9098800 10 monclient: monmap: 2024-09-12T17:34:00.560 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 0 2024-09-12T17:34:00.560 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:34:00.560 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 0.000000 2024-09-12T17:34:00.560 INFO:tasks.workunit.client.0.smithi037.stderr:created 0.000000 2024-09-12T17:34:00.560 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 0 (unknown) 2024-09-12T17:34:00.560 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:34:00.561 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.noname-a 2024-09-12T17:34:00.561 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.noname-b 2024-09-12T17:34:00.561 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.noname-c 2024-09-12T17:34:00.561 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:34:00.561 INFO:tasks.workunit.client.0.smithi037.stderr: -339> 2024-09-12T17:34:00.040+0000 7fd9a9098800 5 AuthRegistry(0x56055b1dd5a0) adding auth protocol: cephx 2024-09-12T17:34:00.561 INFO:tasks.workunit.client.0.smithi037.stderr: -338> 2024-09-12T17:34:00.040+0000 7fd9a9098800 5 AuthRegistry(0x56055b1dd5a0) adding auth protocol: cephx 2024-09-12T17:34:00.561 INFO:tasks.workunit.client.0.smithi037.stderr: -337> 2024-09-12T17:34:00.040+0000 7fd9a9098800 5 AuthRegistry(0x56055b1dd5a0) adding auth protocol: cephx 2024-09-12T17:34:00.561 INFO:tasks.workunit.client.0.smithi037.stderr: -336> 2024-09-12T17:34:00.040+0000 7fd9a9098800 5 AuthRegistry(0x56055b1dd5a0) adding con mode: secure 2024-09-12T17:34:00.561 INFO:tasks.workunit.client.0.smithi037.stderr: -335> 2024-09-12T17:34:00.040+0000 7fd9a9098800 5 AuthRegistry(0x56055b1dd5a0) adding con mode: crc 2024-09-12T17:34:00.561 INFO:tasks.workunit.client.0.smithi037.stderr: -334> 2024-09-12T17:34:00.040+0000 7fd9a9098800 5 AuthRegistry(0x56055b1dd5a0) adding con mode: secure 2024-09-12T17:34:00.561 INFO:tasks.workunit.client.0.smithi037.stderr: -333> 2024-09-12T17:34:00.040+0000 7fd9a9098800 5 AuthRegistry(0x56055b1dd5a0) adding con mode: crc 2024-09-12T17:34:00.561 INFO:tasks.workunit.client.0.smithi037.stderr: -332> 2024-09-12T17:34:00.040+0000 7fd9a9098800 5 AuthRegistry(0x56055b1dd5a0) adding con mode: secure 2024-09-12T17:34:00.562 INFO:tasks.workunit.client.0.smithi037.stderr: -331> 2024-09-12T17:34:00.040+0000 7fd9a9098800 5 AuthRegistry(0x56055b1dd5a0) adding con mode: crc 2024-09-12T17:34:00.562 INFO:tasks.workunit.client.0.smithi037.stderr: -330> 2024-09-12T17:34:00.040+0000 7fd9a9098800 5 AuthRegistry(0x56055b1dd5a0) adding con mode: crc 2024-09-12T17:34:00.562 INFO:tasks.workunit.client.0.smithi037.stderr: -329> 2024-09-12T17:34:00.040+0000 7fd9a9098800 5 AuthRegistry(0x56055b1dd5a0) adding con mode: secure 2024-09-12T17:34:00.562 INFO:tasks.workunit.client.0.smithi037.stderr: -328> 2024-09-12T17:34:00.040+0000 7fd9a9098800 5 AuthRegistry(0x56055b1dd5a0) adding con mode: crc 2024-09-12T17:34:00.562 INFO:tasks.workunit.client.0.smithi037.stderr: -327> 2024-09-12T17:34:00.040+0000 7fd9a9098800 5 AuthRegistry(0x56055b1dd5a0) adding con mode: secure 2024-09-12T17:34:00.562 INFO:tasks.workunit.client.0.smithi037.stderr: -326> 2024-09-12T17:34:00.040+0000 7fd9a9098800 5 AuthRegistry(0x56055b1dd5a0) adding con mode: crc 2024-09-12T17:34:00.562 INFO:tasks.workunit.client.0.smithi037.stderr: -325> 2024-09-12T17:34:00.040+0000 7fd9a9098800 5 AuthRegistry(0x56055b1dd5a0) adding con mode: secure 2024-09-12T17:34:00.562 INFO:tasks.workunit.client.0.smithi037.stderr: -324> 2024-09-12T17:34:00.040+0000 7fd9a9098800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:34:00.562 INFO:tasks.workunit.client.0.smithi037.stderr: -323> 2024-09-12T17:34:00.041+0000 7fd9a9098800 10 monclient: init 2024-09-12T17:34:00.562 INFO:tasks.workunit.client.0.smithi037.stderr: -322> 2024-09-12T17:34:00.041+0000 7fd9a9098800 5 AuthRegistry(0x7fff09a1ea10) adding auth protocol: cephx 2024-09-12T17:34:00.562 INFO:tasks.workunit.client.0.smithi037.stderr: -321> 2024-09-12T17:34:00.041+0000 7fd9a9098800 5 AuthRegistry(0x7fff09a1ea10) adding auth protocol: cephx 2024-09-12T17:34:00.563 INFO:tasks.workunit.client.0.smithi037.stderr: -320> 2024-09-12T17:34:00.041+0000 7fd9a9098800 5 AuthRegistry(0x7fff09a1ea10) adding auth protocol: cephx 2024-09-12T17:34:00.563 INFO:tasks.workunit.client.0.smithi037.stderr: -319> 2024-09-12T17:34:00.041+0000 7fd9a9098800 5 AuthRegistry(0x7fff09a1ea10) adding con mode: secure 2024-09-12T17:34:00.563 INFO:tasks.workunit.client.0.smithi037.stderr: -318> 2024-09-12T17:34:00.041+0000 7fd9a9098800 5 AuthRegistry(0x7fff09a1ea10) adding con mode: crc 2024-09-12T17:34:00.563 INFO:tasks.workunit.client.0.smithi037.stderr: -317> 2024-09-12T17:34:00.041+0000 7fd9a9098800 5 AuthRegistry(0x7fff09a1ea10) adding con mode: secure 2024-09-12T17:34:00.563 INFO:tasks.workunit.client.0.smithi037.stderr: -316> 2024-09-12T17:34:00.041+0000 7fd9a9098800 5 AuthRegistry(0x7fff09a1ea10) adding con mode: crc 2024-09-12T17:34:00.563 INFO:tasks.workunit.client.0.smithi037.stderr: -315> 2024-09-12T17:34:00.041+0000 7fd9a9098800 5 AuthRegistry(0x7fff09a1ea10) adding con mode: secure 2024-09-12T17:34:00.563 INFO:tasks.workunit.client.0.smithi037.stderr: -314> 2024-09-12T17:34:00.041+0000 7fd9a9098800 5 AuthRegistry(0x7fff09a1ea10) adding con mode: crc 2024-09-12T17:34:00.563 INFO:tasks.workunit.client.0.smithi037.stderr: -313> 2024-09-12T17:34:00.041+0000 7fd9a9098800 5 AuthRegistry(0x7fff09a1ea10) adding con mode: crc 2024-09-12T17:34:00.563 INFO:tasks.workunit.client.0.smithi037.stderr: -312> 2024-09-12T17:34:00.041+0000 7fd9a9098800 5 AuthRegistry(0x7fff09a1ea10) adding con mode: secure 2024-09-12T17:34:00.563 INFO:tasks.workunit.client.0.smithi037.stderr: -311> 2024-09-12T17:34:00.041+0000 7fd9a9098800 5 AuthRegistry(0x7fff09a1ea10) adding con mode: crc 2024-09-12T17:34:00.563 INFO:tasks.workunit.client.0.smithi037.stderr: -310> 2024-09-12T17:34:00.041+0000 7fd9a9098800 5 AuthRegistry(0x7fff09a1ea10) adding con mode: secure 2024-09-12T17:34:00.563 INFO:tasks.workunit.client.0.smithi037.stderr: -309> 2024-09-12T17:34:00.041+0000 7fd9a9098800 5 AuthRegistry(0x7fff09a1ea10) adding con mode: crc 2024-09-12T17:34:00.563 INFO:tasks.workunit.client.0.smithi037.stderr: -308> 2024-09-12T17:34:00.041+0000 7fd9a9098800 5 AuthRegistry(0x7fff09a1ea10) adding con mode: secure 2024-09-12T17:34:00.564 INFO:tasks.workunit.client.0.smithi037.stderr: -307> 2024-09-12T17:34:00.041+0000 7fd9a9098800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:34:00.564 INFO:tasks.workunit.client.0.smithi037.stderr: -306> 2024-09-12T17:34:00.041+0000 7fd9a9098800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:34:00.564 INFO:tasks.workunit.client.0.smithi037.stderr: -305> 2024-09-12T17:34:00.041+0000 7fd9a9098800 5 asok(0x56055af1f730) register_command rotate-key cmddesc rotate-key hook 0x7fff09a1eb58 EEXIST 2024-09-12T17:34:00.564 INFO:tasks.workunit.client.0.smithi037.stderr: -304> 2024-09-12T17:34:00.041+0000 7fd9a9098800 10 monclient: _reopen_session rank -1 2024-09-12T17:34:00.564 INFO:tasks.workunit.client.0.smithi037.stderr: -303> 2024-09-12T17:34:00.041+0000 7fd9a9098800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T17:34:00.564 INFO:tasks.workunit.client.0.smithi037.stderr: -302> 2024-09-12T17:34:00.041+0000 7fd9a9098800 10 monclient(hunting): picked mon.noname-a con 0x56055b211a80 addr [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] 2024-09-12T17:34:00.564 INFO:tasks.workunit.client.0.smithi037.stderr: -301> 2024-09-12T17:34:00.041+0000 7fd9a9098800 10 monclient(hunting): picked mon.noname-c con 0x56055b20c0a0 addr [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] 2024-09-12T17:34:00.564 INFO:tasks.workunit.client.0.smithi037.stderr: -300> 2024-09-12T17:34:00.041+0000 7fd9a9098800 10 monclient(hunting): picked mon.noname-b con 0x56055b20d450 addr [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] 2024-09-12T17:34:00.564 INFO:tasks.workunit.client.0.smithi037.stderr: -299> 2024-09-12T17:34:00.041+0000 7fd9a9098800 10 monclient(hunting): start opening mon connection 2024-09-12T17:34:00.564 INFO:tasks.workunit.client.0.smithi037.stderr: -298> 2024-09-12T17:34:00.041+0000 7fd9a9098800 10 monclient(hunting): start opening mon connection 2024-09-12T17:34:00.564 INFO:tasks.workunit.client.0.smithi037.stderr: -297> 2024-09-12T17:34:00.041+0000 7fd9a9098800 10 monclient(hunting): start opening mon connection 2024-09-12T17:34:00.564 INFO:tasks.workunit.client.0.smithi037.stderr: -296> 2024-09-12T17:34:00.041+0000 7fd9a9098800 10 monclient(hunting): _renew_subs 2024-09-12T17:34:00.564 INFO:tasks.workunit.client.0.smithi037.stderr: -295> 2024-09-12T17:34:00.041+0000 7fd9a9098800 10 monclient(hunting): authenticate will time out at 2227.638614s 2024-09-12T17:34:00.564 INFO:tasks.workunit.client.0.smithi037.stderr: -294> 2024-09-12T17:34:00.041+0000 7fd9a6381640 10 monclient(hunting): get_auth_request con 0x56055b20c0a0 auth_method 0 2024-09-12T17:34:00.565 INFO:tasks.workunit.client.0.smithi037.stderr: -293> 2024-09-12T17:34:00.041+0000 7fd9a6381640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:34:00.565 INFO:tasks.workunit.client.0.smithi037.stderr: -292> 2024-09-12T17:34:00.041+0000 7fd9a6381640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:34:00.565 INFO:tasks.workunit.client.0.smithi037.stderr: -291> 2024-09-12T17:34:00.041+0000 7fd9a6381640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:34:00.565 INFO:tasks.workunit.client.0.smithi037.stderr: -290> 2024-09-12T17:34:00.041+0000 7fd9a6b82640 10 monclient(hunting): get_auth_request con 0x56055b211a80 auth_method 0 2024-09-12T17:34:00.565 INFO:tasks.workunit.client.0.smithi037.stderr: -289> 2024-09-12T17:34:00.041+0000 7fd9a6b82640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:34:00.565 INFO:tasks.workunit.client.0.smithi037.stderr: -288> 2024-09-12T17:34:00.041+0000 7fd9a6b82640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:34:00.565 INFO:tasks.workunit.client.0.smithi037.stderr: -287> 2024-09-12T17:34:00.041+0000 7fd9a6b82640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:34:00.565 INFO:tasks.workunit.client.0.smithi037.stderr: -286> 2024-09-12T17:34:00.041+0000 7fd9a6381640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:34:00.565 INFO:tasks.workunit.client.0.smithi037.stderr: -285> 2024-09-12T17:34:00.041+0000 7fd9a6381640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:34:00.565 INFO:tasks.workunit.client.0.smithi037.stderr: -284> 2024-09-12T17:34:00.041+0000 7fd9a6381640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:34:00.565 INFO:tasks.workunit.client.0.smithi037.stderr: -283> 2024-09-12T17:34:00.041+0000 7fd9a6b82640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:34:00.565 INFO:tasks.workunit.client.0.smithi037.stderr: -282> 2024-09-12T17:34:00.041+0000 7fd9a6b82640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:34:00.565 INFO:tasks.workunit.client.0.smithi037.stderr: -281> 2024-09-12T17:34:00.041+0000 7fd9a6b82640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:34:00.565 INFO:tasks.workunit.client.0.smithi037.stderr: -280> 2024-09-12T17:34:00.041+0000 7fd9a7383640 10 monclient(hunting): get_auth_request con 0x56055b20d450 auth_method 0 2024-09-12T17:34:00.566 INFO:tasks.workunit.client.0.smithi037.stderr: -279> 2024-09-12T17:34:00.041+0000 7fd9a7383640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:34:00.566 INFO:tasks.workunit.client.0.smithi037.stderr: -278> 2024-09-12T17:34:00.041+0000 7fd9a7383640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:34:00.566 INFO:tasks.workunit.client.0.smithi037.stderr: -277> 2024-09-12T17:34:00.041+0000 7fd9a7383640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:34:00.566 INFO:tasks.workunit.client.0.smithi037.stderr: -276> 2024-09-12T17:34:00.041+0000 7fd9a6381640 10 monclient(hunting): handle_auth_done global_id 6680 payload 274 2024-09-12T17:34:00.566 INFO:tasks.workunit.client.0.smithi037.stderr: -275> 2024-09-12T17:34:00.041+0000 7fd9a6381640 10 monclient: _finish_hunting 0 2024-09-12T17:34:00.566 INFO:tasks.workunit.client.0.smithi037.stderr: -274> 2024-09-12T17:34:00.041+0000 7fd9a6381640 1 monclient: found mon.noname-c 2024-09-12T17:34:00.566 INFO:tasks.workunit.client.0.smithi037.stderr: -273> 2024-09-12T17:34:00.041+0000 7fd9a6381640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.37:3301/0 2024-09-12T17:34:00.566 INFO:tasks.workunit.client.0.smithi037.stderr: -272> 2024-09-12T17:34:00.042+0000 7fd88a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:34:00.566 INFO:tasks.workunit.client.0.smithi037.stderr: -271> 2024-09-12T17:34:00.042+0000 7fd88a7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:34:00.566 INFO:tasks.workunit.client.0.smithi037.stderr: -270> 2024-09-12T17:34:00.042+0000 7fd88a7fc640 10 monclient: dump: 2024-09-12T17:34:00.566 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:34:00.566 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:34:00.566 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:34:00.566 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:34:00.567 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:34:00.567 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:34:00.567 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:34:00.567 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:34:00.567 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:34:00.567 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:34:00.567 INFO:tasks.workunit.client.0.smithi037.stderr: -269> 2024-09-12T17:34:00.042+0000 7fd88a7fc640 10 monclient: _finish_auth 0 2024-09-12T17:34:00.567 INFO:tasks.workunit.client.0.smithi037.stderr: -268> 2024-09-12T17:34:00.042+0000 7fd88a7fc640 10 monclient: _check_auth_tickets 2024-09-12T17:34:00.567 INFO:tasks.workunit.client.0.smithi037.stderr: -267> 2024-09-12T17:34:00.042+0000 7fd88a7fc640 10 monclient: handle_config config(0 keys) 2024-09-12T17:34:00.567 INFO:tasks.workunit.client.0.smithi037.stderr: -266> 2024-09-12T17:34:00.042+0000 7fd88a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:34:00.567 INFO:tasks.workunit.client.0.smithi037.stderr: -265> 2024-09-12T17:34:00.042+0000 7fd88a7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:34:00.567 INFO:tasks.workunit.client.0.smithi037.stderr: -264> 2024-09-12T17:34:00.042+0000 7fd88a7fc640 10 monclient: dump: 2024-09-12T17:34:00.567 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:34:00.567 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:34:00.567 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:34:00.568 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:34:00.568 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:34:00.568 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:34:00.568 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:34:00.568 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:34:00.568 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:34:00.568 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:34:00.568 INFO:tasks.workunit.client.0.smithi037.stderr: -263> 2024-09-12T17:34:00.042+0000 7fd9a9098800 5 monclient: authenticate success, global_id 6680 2024-09-12T17:34:00.568 INFO:tasks.workunit.client.0.smithi037.stderr: -262> 2024-09-12T17:34:00.042+0000 7fd9a9098800 10 monclient: get_monmap_and_config success 2024-09-12T17:34:00.568 INFO:tasks.workunit.client.0.smithi037.stderr: -261> 2024-09-12T17:34:00.042+0000 7fd9a9098800 4 set_mon_vals no callback set 2024-09-12T17:34:00.568 INFO:tasks.workunit.client.0.smithi037.stderr: -260> 2024-09-12T17:34:00.042+0000 7fd9a9098800 10 monclient: shutdown 2024-09-12T17:34:00.568 INFO:tasks.workunit.client.0.smithi037.stderr: -259> 2024-09-12T17:34:00.043+0000 7fd9a9098800 10 monclient: build_initial_monmap 2024-09-12T17:34:00.568 INFO:tasks.workunit.client.0.smithi037.stderr: -258> 2024-09-12T17:34:00.043+0000 7fd9a9098800 1 build_initial for_mkfs: 0 2024-09-12T17:34:00.569 INFO:tasks.workunit.client.0.smithi037.stderr: -257> 2024-09-12T17:34:00.043+0000 7fd9a9098800 10 monclient: monmap: 2024-09-12T17:34:00.569 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 0 2024-09-12T17:34:00.569 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:34:00.569 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 0.000000 2024-09-12T17:34:00.569 INFO:tasks.workunit.client.0.smithi037.stderr:created 0.000000 2024-09-12T17:34:00.569 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 0 (unknown) 2024-09-12T17:34:00.569 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:34:00.569 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.noname-a 2024-09-12T17:34:00.569 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.noname-b 2024-09-12T17:34:00.569 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.noname-c 2024-09-12T17:34:00.569 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:34:00.569 INFO:tasks.workunit.client.0.smithi037.stderr: -256> 2024-09-12T17:34:00.043+0000 7fd9a9098800 5 AuthRegistry(0x56055b202250) adding auth protocol: cephx 2024-09-12T17:34:00.569 INFO:tasks.workunit.client.0.smithi037.stderr: -255> 2024-09-12T17:34:00.043+0000 7fd9a9098800 5 AuthRegistry(0x56055b202250) adding auth protocol: cephx 2024-09-12T17:34:00.569 INFO:tasks.workunit.client.0.smithi037.stderr: -254> 2024-09-12T17:34:00.043+0000 7fd9a9098800 5 AuthRegistry(0x56055b202250) adding auth protocol: cephx 2024-09-12T17:34:00.570 INFO:tasks.workunit.client.0.smithi037.stderr: -253> 2024-09-12T17:34:00.043+0000 7fd9a9098800 5 AuthRegistry(0x56055b202250) adding con mode: secure 2024-09-12T17:34:00.570 INFO:tasks.workunit.client.0.smithi037.stderr: -252> 2024-09-12T17:34:00.043+0000 7fd9a9098800 5 AuthRegistry(0x56055b202250) adding con mode: crc 2024-09-12T17:34:00.570 INFO:tasks.workunit.client.0.smithi037.stderr: -251> 2024-09-12T17:34:00.043+0000 7fd9a9098800 5 AuthRegistry(0x56055b202250) adding con mode: secure 2024-09-12T17:34:00.570 INFO:tasks.workunit.client.0.smithi037.stderr: -250> 2024-09-12T17:34:00.043+0000 7fd9a9098800 5 AuthRegistry(0x56055b202250) adding con mode: crc 2024-09-12T17:34:00.570 INFO:tasks.workunit.client.0.smithi037.stderr: -249> 2024-09-12T17:34:00.043+0000 7fd9a9098800 5 AuthRegistry(0x56055b202250) adding con mode: secure 2024-09-12T17:34:00.570 INFO:tasks.workunit.client.0.smithi037.stderr: -248> 2024-09-12T17:34:00.043+0000 7fd9a9098800 5 AuthRegistry(0x56055b202250) adding con mode: crc 2024-09-12T17:34:00.570 INFO:tasks.workunit.client.0.smithi037.stderr: -247> 2024-09-12T17:34:00.043+0000 7fd9a9098800 5 AuthRegistry(0x56055b202250) adding con mode: crc 2024-09-12T17:34:00.570 INFO:tasks.workunit.client.0.smithi037.stderr: -246> 2024-09-12T17:34:00.043+0000 7fd9a9098800 5 AuthRegistry(0x56055b202250) adding con mode: secure 2024-09-12T17:34:00.570 INFO:tasks.workunit.client.0.smithi037.stderr: -245> 2024-09-12T17:34:00.043+0000 7fd9a9098800 5 AuthRegistry(0x56055b202250) adding con mode: crc 2024-09-12T17:34:00.570 INFO:tasks.workunit.client.0.smithi037.stderr: -244> 2024-09-12T17:34:00.043+0000 7fd9a9098800 5 AuthRegistry(0x56055b202250) adding con mode: secure 2024-09-12T17:34:00.570 INFO:tasks.workunit.client.0.smithi037.stderr: -243> 2024-09-12T17:34:00.043+0000 7fd9a9098800 5 AuthRegistry(0x56055b202250) adding con mode: crc 2024-09-12T17:34:00.570 INFO:tasks.workunit.client.0.smithi037.stderr: -242> 2024-09-12T17:34:00.043+0000 7fd9a9098800 5 AuthRegistry(0x56055b202250) adding con mode: secure 2024-09-12T17:34:00.570 INFO:tasks.workunit.client.0.smithi037.stderr: -241> 2024-09-12T17:34:00.043+0000 7fd9a9098800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:34:00.570 INFO:tasks.workunit.client.0.smithi037.stderr: -240> 2024-09-12T17:34:00.043+0000 7fd9a9098800 1 librados: starting msgr at 2024-09-12T17:34:00.571 INFO:tasks.workunit.client.0.smithi037.stderr: -239> 2024-09-12T17:34:00.043+0000 7fd9a9098800 1 librados: starting objecter 2024-09-12T17:34:00.571 INFO:tasks.workunit.client.0.smithi037.stderr: -238> 2024-09-12T17:34:00.043+0000 7fd9a9098800 5 asok(0x56055af1f730) register_command objecter_requests cmddesc objecter_requests hook 0x56055b1bf3d0 EEXIST 2024-09-12T17:34:00.571 INFO:tasks.workunit.client.0.smithi037.stderr: -237> 2024-09-12T17:34:00.043+0000 7fd9a9098800 1 librados: setting wanted keys 2024-09-12T17:34:00.571 INFO:tasks.workunit.client.0.smithi037.stderr: -236> 2024-09-12T17:34:00.043+0000 7fd9a9098800 1 librados: calling monclient init 2024-09-12T17:34:00.571 INFO:tasks.workunit.client.0.smithi037.stderr: -235> 2024-09-12T17:34:00.043+0000 7fd9a9098800 10 monclient: init 2024-09-12T17:34:00.571 INFO:tasks.workunit.client.0.smithi037.stderr: -234> 2024-09-12T17:34:00.043+0000 7fd9a9098800 5 AuthRegistry(0x56055b1dc790) adding auth protocol: cephx 2024-09-12T17:34:00.571 INFO:tasks.workunit.client.0.smithi037.stderr: -233> 2024-09-12T17:34:00.043+0000 7fd9a9098800 5 AuthRegistry(0x56055b1dc790) adding auth protocol: cephx 2024-09-12T17:34:00.571 INFO:tasks.workunit.client.0.smithi037.stderr: -232> 2024-09-12T17:34:00.043+0000 7fd9a9098800 5 AuthRegistry(0x56055b1dc790) adding auth protocol: cephx 2024-09-12T17:34:00.571 INFO:tasks.workunit.client.0.smithi037.stderr: -231> 2024-09-12T17:34:00.043+0000 7fd9a9098800 5 AuthRegistry(0x56055b1dc790) adding con mode: secure 2024-09-12T17:34:00.571 INFO:tasks.workunit.client.0.smithi037.stderr: -230> 2024-09-12T17:34:00.043+0000 7fd9a9098800 5 AuthRegistry(0x56055b1dc790) adding con mode: crc 2024-09-12T17:34:00.571 INFO:tasks.workunit.client.0.smithi037.stderr: -229> 2024-09-12T17:34:00.043+0000 7fd9a9098800 5 AuthRegistry(0x56055b1dc790) adding con mode: secure 2024-09-12T17:34:00.572 INFO:tasks.workunit.client.0.smithi037.stderr: -228> 2024-09-12T17:34:00.043+0000 7fd9a9098800 5 AuthRegistry(0x56055b1dc790) adding con mode: crc 2024-09-12T17:34:00.572 INFO:tasks.workunit.client.0.smithi037.stderr: -227> 2024-09-12T17:34:00.043+0000 7fd9a9098800 5 AuthRegistry(0x56055b1dc790) adding con mode: secure 2024-09-12T17:34:00.572 INFO:tasks.workunit.client.0.smithi037.stderr: -226> 2024-09-12T17:34:00.043+0000 7fd9a9098800 5 AuthRegistry(0x56055b1dc790) adding con mode: crc 2024-09-12T17:34:00.572 INFO:tasks.workunit.client.0.smithi037.stderr: -225> 2024-09-12T17:34:00.043+0000 7fd9a9098800 5 AuthRegistry(0x56055b1dc790) adding con mode: crc 2024-09-12T17:34:00.572 INFO:tasks.workunit.client.0.smithi037.stderr: -224> 2024-09-12T17:34:00.043+0000 7fd9a9098800 5 AuthRegistry(0x56055b1dc790) adding con mode: secure 2024-09-12T17:34:00.572 INFO:tasks.workunit.client.0.smithi037.stderr: -223> 2024-09-12T17:34:00.043+0000 7fd9a9098800 5 AuthRegistry(0x56055b1dc790) adding con mode: crc 2024-09-12T17:34:00.572 INFO:tasks.workunit.client.0.smithi037.stderr: -222> 2024-09-12T17:34:00.043+0000 7fd9a9098800 5 AuthRegistry(0x56055b1dc790) adding con mode: secure 2024-09-12T17:34:00.572 INFO:tasks.workunit.client.0.smithi037.stderr: -221> 2024-09-12T17:34:00.043+0000 7fd9a9098800 5 AuthRegistry(0x56055b1dc790) adding con mode: crc 2024-09-12T17:34:00.572 INFO:tasks.workunit.client.0.smithi037.stderr: -220> 2024-09-12T17:34:00.043+0000 7fd9a9098800 5 AuthRegistry(0x56055b1dc790) adding con mode: secure 2024-09-12T17:34:00.572 INFO:tasks.workunit.client.0.smithi037.stderr: -219> 2024-09-12T17:34:00.043+0000 7fd9a9098800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:34:00.572 INFO:tasks.workunit.client.0.smithi037.stderr: -218> 2024-09-12T17:34:00.043+0000 7fd9a9098800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:34:00.572 INFO:tasks.workunit.client.0.smithi037.stderr: -217> 2024-09-12T17:34:00.043+0000 7fd9a9098800 5 asok(0x56055af1f730) register_command rotate-key cmddesc rotate-key hook 0x56055b1dc8d8 EEXIST 2024-09-12T17:34:00.573 INFO:tasks.workunit.client.0.smithi037.stderr: -216> 2024-09-12T17:34:00.044+0000 7fd9a9098800 10 monclient: _reopen_session rank -1 2024-09-12T17:34:00.573 INFO:tasks.workunit.client.0.smithi037.stderr: -215> 2024-09-12T17:34:00.044+0000 7fd9a9098800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T17:34:00.573 INFO:tasks.workunit.client.0.smithi037.stderr: -214> 2024-09-12T17:34:00.044+0000 7fd9a9098800 10 monclient(hunting): picked mon.noname-c con 0x56055b20d450 addr [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] 2024-09-12T17:34:00.573 INFO:tasks.workunit.client.0.smithi037.stderr: -213> 2024-09-12T17:34:00.044+0000 7fd9a9098800 10 monclient(hunting): picked mon.noname-b con 0x56055b211a80 addr [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] 2024-09-12T17:34:00.573 INFO:tasks.workunit.client.0.smithi037.stderr: -212> 2024-09-12T17:34:00.044+0000 7fd9a9098800 10 monclient(hunting): picked mon.noname-a con 0x56055b21c160 addr [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] 2024-09-12T17:34:00.573 INFO:tasks.workunit.client.0.smithi037.stderr: -211> 2024-09-12T17:34:00.044+0000 7fd9a9098800 10 monclient(hunting): start opening mon connection 2024-09-12T17:34:00.573 INFO:tasks.workunit.client.0.smithi037.stderr: -210> 2024-09-12T17:34:00.044+0000 7fd9a9098800 10 monclient(hunting): start opening mon connection 2024-09-12T17:34:00.573 INFO:tasks.workunit.client.0.smithi037.stderr: -209> 2024-09-12T17:34:00.044+0000 7fd9a9098800 10 monclient(hunting): start opening mon connection 2024-09-12T17:34:00.573 INFO:tasks.workunit.client.0.smithi037.stderr: -208> 2024-09-12T17:34:00.044+0000 7fd9a9098800 10 monclient(hunting): _renew_subs 2024-09-12T17:34:00.573 INFO:tasks.workunit.client.0.smithi037.stderr: -207> 2024-09-12T17:34:00.044+0000 7fd9a9098800 10 monclient(hunting): authenticate will time out at 2227.641077s 2024-09-12T17:34:00.573 INFO:tasks.workunit.client.0.smithi037.stderr: -206> 2024-09-12T17:34:00.044+0000 7fd9a6b82640 10 monclient(hunting): get_auth_request con 0x56055b20d450 auth_method 0 2024-09-12T17:34:00.573 INFO:tasks.workunit.client.0.smithi037.stderr: -205> 2024-09-12T17:34:00.044+0000 7fd9a6b82640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:34:00.573 INFO:tasks.workunit.client.0.smithi037.stderr: -204> 2024-09-12T17:34:00.044+0000 7fd9a6b82640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:34:00.573 INFO:tasks.workunit.client.0.smithi037.stderr: -203> 2024-09-12T17:34:00.044+0000 7fd9a6b82640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:34:00.574 INFO:tasks.workunit.client.0.smithi037.stderr: -202> 2024-09-12T17:34:00.044+0000 7fd9a7383640 10 monclient(hunting): get_auth_request con 0x56055b21c160 auth_method 0 2024-09-12T17:34:00.574 INFO:tasks.workunit.client.0.smithi037.stderr: -201> 2024-09-12T17:34:00.044+0000 7fd9a7383640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:34:00.574 INFO:tasks.workunit.client.0.smithi037.stderr: -200> 2024-09-12T17:34:00.044+0000 7fd9a7383640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:34:00.574 INFO:tasks.workunit.client.0.smithi037.stderr: -199> 2024-09-12T17:34:00.044+0000 7fd9a7383640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:34:00.574 INFO:tasks.workunit.client.0.smithi037.stderr: -198> 2024-09-12T17:34:00.044+0000 7fd9a6b82640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:34:00.574 INFO:tasks.workunit.client.0.smithi037.stderr: -197> 2024-09-12T17:34:00.044+0000 7fd9a6b82640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:34:00.574 INFO:tasks.workunit.client.0.smithi037.stderr: -196> 2024-09-12T17:34:00.044+0000 7fd9a6b82640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:34:00.574 INFO:tasks.workunit.client.0.smithi037.stderr: -195> 2024-09-12T17:34:00.044+0000 7fd9a7383640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:34:00.574 INFO:tasks.workunit.client.0.smithi037.stderr: -194> 2024-09-12T17:34:00.044+0000 7fd9a7383640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:34:00.574 INFO:tasks.workunit.client.0.smithi037.stderr: -193> 2024-09-12T17:34:00.044+0000 7fd9a7383640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:34:00.575 INFO:tasks.workunit.client.0.smithi037.stderr: -192> 2024-09-12T17:34:00.044+0000 7fd9a6b82640 10 monclient(hunting): handle_auth_done global_id 6683 payload 824 2024-09-12T17:34:00.575 INFO:tasks.workunit.client.0.smithi037.stderr: -191> 2024-09-12T17:34:00.044+0000 7fd9a6b82640 10 monclient: _finish_hunting 0 2024-09-12T17:34:00.575 INFO:tasks.workunit.client.0.smithi037.stderr: -190> 2024-09-12T17:34:00.044+0000 7fd9a6b82640 1 monclient: found mon.noname-c 2024-09-12T17:34:00.575 INFO:tasks.workunit.client.0.smithi037.stderr: -189> 2024-09-12T17:34:00.044+0000 7fd9a6b82640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.37:3301/0 2024-09-12T17:34:00.575 INFO:tasks.workunit.client.0.smithi037.stderr: -188> 2024-09-12T17:34:00.044+0000 7fd888ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:34:00.575 INFO:tasks.workunit.client.0.smithi037.stderr: -187> 2024-09-12T17:34:00.044+0000 7fd888ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:34:00.575 INFO:tasks.workunit.client.0.smithi037.stderr: -186> 2024-09-12T17:34:00.044+0000 7fd888ff9640 10 monclient: dump: 2024-09-12T17:34:00.575 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:34:00.575 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:34:00.575 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:34:00.576 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:34:00.576 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:34:00.576 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:34:00.576 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:34:00.576 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:34:00.576 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:34:00.576 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:34:00.576 INFO:tasks.workunit.client.0.smithi037.stderr: -185> 2024-09-12T17:34:00.044+0000 7fd888ff9640 10 monclient: _finish_auth 0 2024-09-12T17:34:00.576 INFO:tasks.workunit.client.0.smithi037.stderr: -184> 2024-09-12T17:34:00.044+0000 7fd888ff9640 10 monclient: _check_auth_tickets 2024-09-12T17:34:00.576 INFO:tasks.workunit.client.0.smithi037.stderr: -183> 2024-09-12T17:34:00.044+0000 7fd888ff9640 10 monclient: handle_config config(0 keys) 2024-09-12T17:34:00.576 INFO:tasks.workunit.client.0.smithi037.stderr: -182> 2024-09-12T17:34:00.044+0000 7fd888ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:34:00.577 INFO:tasks.workunit.client.0.smithi037.stderr: -181> 2024-09-12T17:34:00.044+0000 7fd888ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:34:00.577 INFO:tasks.workunit.client.0.smithi037.stderr: -180> 2024-09-12T17:34:00.044+0000 7fd888ff9640 10 monclient: dump: 2024-09-12T17:34:00.577 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:34:00.577 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:34:00.577 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:34:00.577 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:34:00.577 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:34:00.577 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:34:00.577 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:34:00.577 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:34:00.577 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:34:00.577 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:34:00.577 INFO:tasks.workunit.client.0.smithi037.stderr: -179> 2024-09-12T17:34:00.044+0000 7fd9a9098800 5 monclient: authenticate success, global_id 6683 2024-09-12T17:34:00.578 INFO:tasks.workunit.client.0.smithi037.stderr: -178> 2024-09-12T17:34:00.044+0000 7fd88a7fc640 4 set_mon_vals no callback set 2024-09-12T17:34:00.578 INFO:tasks.workunit.client.0.smithi037.stderr: -177> 2024-09-12T17:34:00.044+0000 7fd9a9098800 10 monclient: _renew_subs 2024-09-12T17:34:00.578 INFO:tasks.workunit.client.0.smithi037.stderr: -176> 2024-09-12T17:34:00.044+0000 7fd9a9098800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.37:3301/0 2024-09-12T17:34:00.578 INFO:tasks.workunit.client.0.smithi037.stderr: -175> 2024-09-12T17:34:00.044+0000 7fd9a9098800 10 monclient: _renew_subs 2024-09-12T17:34:00.578 INFO:tasks.workunit.client.0.smithi037.stderr: -174> 2024-09-12T17:34:00.044+0000 7fd9a9098800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.37:3301/0 2024-09-12T17:34:00.578 INFO:tasks.workunit.client.0.smithi037.stderr: -173> 2024-09-12T17:34:00.044+0000 7fd9a9098800 1 librados: init done 2024-09-12T17:34:00.578 INFO:tasks.workunit.client.0.smithi037.stderr: -172> 2024-09-12T17:34:00.044+0000 7fd9a9098800 5 asok(0x56055af1f730) register_command cr dump hook 0x56055b214c08 2024-09-12T17:34:00.578 INFO:tasks.workunit.client.0.smithi037.stderr: -171> 2024-09-12T17:34:00.046+0000 7fd9a9098800 20 rados->read ofs=0 len=0 2024-09-12T17:34:00.578 INFO:tasks.workunit.client.0.smithi037.stderr: -170> 2024-09-12T17:34:00.046+0000 7fd888ff9640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:34:00.578 INFO:tasks.workunit.client.0.smithi037.stderr: -169> 2024-09-12T17:34:00.046+0000 7fd888ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.40:6816/3916250676,v1:172.21.15.40:6817/3916250676] 2024-09-12T17:34:00.578 INFO:tasks.workunit.client.0.smithi037.stderr: -168> 2024-09-12T17:34:00.046+0000 7fd888ff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.40:6816/3916250676,v1:172.21.15.40:6817/3916250676] 2024-09-12T17:34:00.578 INFO:tasks.workunit.client.0.smithi037.stderr: -167> 2024-09-12T17:34:00.047+0000 7fd9a6381640 10 monclient: get_auth_request con 0x7fd870076470 auth_method 0 2024-09-12T17:34:00.578 INFO:tasks.workunit.client.0.smithi037.stderr: -166> 2024-09-12T17:34:00.047+0000 7fd9a7383640 10 monclient: get_auth_request con 0x56055b22c1b0 auth_method 0 2024-09-12T17:34:00.578 INFO:tasks.workunit.client.0.smithi037.stderr: -165> 2024-09-12T17:34:00.047+0000 7fd9a9098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:00.579 INFO:tasks.workunit.client.0.smithi037.stderr: -164> 2024-09-12T17:34:00.047+0000 7fd9a9098800 20 realm 2024-09-12T17:34:00.579 INFO:tasks.workunit.client.0.smithi037.stderr: -163> 2024-09-12T17:34:00.047+0000 7fd9a9098800 20 rados->read ofs=0 len=0 2024-09-12T17:34:00.579 INFO:tasks.workunit.client.0.smithi037.stderr: -162> 2024-09-12T17:34:00.047+0000 7fd9a9098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:00.579 INFO:tasks.workunit.client.0.smithi037.stderr: -161> 2024-09-12T17:34:00.047+0000 7fd9a9098800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:34:00.579 INFO:tasks.workunit.client.0.smithi037.stderr: -160> 2024-09-12T17:34:00.048+0000 7fd9a9098800 20 rados->read ofs=0 len=0 2024-09-12T17:34:00.579 INFO:tasks.workunit.client.0.smithi037.stderr: -159> 2024-09-12T17:34:00.048+0000 7fd9a9098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:00.579 INFO:tasks.workunit.client.0.smithi037.stderr: -158> 2024-09-12T17:34:00.048+0000 7fd9a9098800 20 rados->read ofs=0 len=0 2024-09-12T17:34:00.579 INFO:tasks.workunit.client.0.smithi037.stderr: -157> 2024-09-12T17:34:00.048+0000 7fd9a6b82640 10 monclient: get_auth_request con 0x56055b2304e0 auth_method 0 2024-09-12T17:34:00.579 INFO:tasks.workunit.client.0.smithi037.stderr: -156> 2024-09-12T17:34:00.049+0000 7fd9a9098800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:34:00.579 INFO:tasks.workunit.client.0.smithi037.stderr: -155> 2024-09-12T17:34:00.049+0000 7fd9a9098800 20 rados->read ofs=0 len=0 2024-09-12T17:34:00.579 INFO:tasks.workunit.client.0.smithi037.stderr: -154> 2024-09-12T17:34:00.049+0000 7fd9a9098800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:34:00.579 INFO:tasks.workunit.client.0.smithi037.stderr: -153> 2024-09-12T17:34:00.049+0000 7fd9a9098800 20 searching for the correct realm 2024-09-12T17:34:00.579 INFO:tasks.workunit.client.0.smithi037.stderr: -152> 2024-09-12T17:34:00.049+0000 7fd9a6381640 10 monclient: get_auth_request con 0x56055b235620 auth_method 0 2024-09-12T17:34:00.580 INFO:tasks.workunit.client.0.smithi037.stderr: -151> 2024-09-12T17:34:00.050+0000 7fd9a7383640 10 monclient: get_auth_request con 0x7fd99c02f940 auth_method 0 2024-09-12T17:34:00.580 INFO:tasks.workunit.client.0.smithi037.stderr: -150> 2024-09-12T17:34:00.051+0000 7fd9a6b82640 10 monclient: get_auth_request con 0x7fd9a0061040 auth_method 0 2024-09-12T17:34:00.580 INFO:tasks.workunit.client.0.smithi037.stderr: -149> 2024-09-12T17:34:00.052+0000 7fd9a6381640 10 monclient: get_auth_request con 0x7fd99806b040 auth_method 0 2024-09-12T17:34:00.580 INFO:tasks.workunit.client.0.smithi037.stderr: -148> 2024-09-12T17:34:00.052+0000 7fd9a6381640 0 -- 172.21.15.37:0/3960364345 >> [v2:172.21.15.40:6800/2441293461,v1:172.21.15.40:6801/2441293461] conn(0x7fd99806b040 msgr2=0x7fd998003990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:34:00.580 INFO:tasks.workunit.client.0.smithi037.stderr: -147> 2024-09-12T17:34:00.254+0000 7fd9a6381640 10 monclient: get_auth_request con 0x7fd99806b040 auth_method 0 2024-09-12T17:34:00.580 INFO:tasks.workunit.client.0.smithi037.stderr: -146> 2024-09-12T17:34:00.256+0000 7fd9a7383640 10 monclient: get_auth_request con 0x7fd99c04b040 auth_method 0 2024-09-12T17:34:00.580 INFO:tasks.workunit.client.0.smithi037.stderr: -145> 2024-09-12T17:34:00.259+0000 7fd9a6b82640 10 monclient: get_auth_request con 0x7fd99c0108f0 auth_method 0 2024-09-12T17:34:00.580 INFO:tasks.workunit.client.0.smithi037.stderr: -144> 2024-09-12T17:34:00.259+0000 7fd9a6b82640 0 -- 172.21.15.37:0/3960364345 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7fd99c0108f0 msgr2=0x7fd99c02e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:34:00.580 INFO:tasks.workunit.client.0.smithi037.stderr: -143> 2024-09-12T17:34:00.460+0000 7fd9a6b82640 10 monclient: get_auth_request con 0x7fd99c0108f0 auth_method 0 2024-09-12T17:34:00.580 INFO:tasks.workunit.client.0.smithi037.stderr: -142> 2024-09-12T17:34:00.466+0000 7fd9a9098800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:34:00.580 INFO:tasks.workunit.client.0.smithi037.stderr: -141> 2024-09-12T17:34:00.466+0000 7fd9a9098800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:34:00.580 INFO:tasks.workunit.client.0.smithi037.stderr: -140> 2024-09-12T17:34:00.466+0000 7fd9a9098800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:34:00.580 INFO:tasks.workunit.client.0.smithi037.stderr: -139> 2024-09-12T17:34:00.466+0000 7fd9a9098800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:34:00.581 INFO:tasks.workunit.client.0.smithi037.stderr: -138> 2024-09-12T17:34:00.466+0000 7fd9a9098800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:34:00.581 INFO:tasks.workunit.client.0.smithi037.stderr: -137> 2024-09-12T17:34:00.466+0000 7fd9a9098800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:34:00.581 INFO:tasks.workunit.client.0.smithi037.stderr: -136> 2024-09-12T17:34:00.466+0000 7fd9a9098800 20 rados->read ofs=0 len=0 2024-09-12T17:34:00.581 INFO:tasks.workunit.client.0.smithi037.stderr: -135> 2024-09-12T17:34:00.467+0000 7fd9a9098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:00.581 INFO:tasks.workunit.client.0.smithi037.stderr: -134> 2024-09-12T17:34:00.467+0000 7fd9a9098800 20 rados->read ofs=0 len=0 2024-09-12T17:34:00.581 INFO:tasks.workunit.client.0.smithi037.stderr: -133> 2024-09-12T17:34:00.467+0000 7fd9a9098800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:34:00.581 INFO:tasks.workunit.client.0.smithi037.stderr: -132> 2024-09-12T17:34:00.467+0000 7fd9a9098800 20 rados->read ofs=0 len=0 2024-09-12T17:34:00.581 INFO:tasks.workunit.client.0.smithi037.stderr: -131> 2024-09-12T17:34:00.467+0000 7fd9a9098800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:34:00.581 INFO:tasks.workunit.client.0.smithi037.stderr: -130> 2024-09-12T17:34:00.467+0000 7fd9a9098800 20 zone default found 2024-09-12T17:34:00.581 INFO:tasks.workunit.client.0.smithi037.stderr: -129> 2024-09-12T17:34:00.467+0000 7fd9a9098800 4 Realm: () 2024-09-12T17:34:00.581 INFO:tasks.workunit.client.0.smithi037.stderr: -128> 2024-09-12T17:34:00.467+0000 7fd9a9098800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:34:00.581 INFO:tasks.workunit.client.0.smithi037.stderr: -127> 2024-09-12T17:34:00.467+0000 7fd9a9098800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:34:00.581 INFO:tasks.workunit.client.0.smithi037.stderr: -126> 2024-09-12T17:34:00.467+0000 7fd9a9098800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:34:00.581 INFO:tasks.workunit.client.0.smithi037.stderr: -125> 2024-09-12T17:34:00.467+0000 7fd9a9098800 20 zonegroup default 2024-09-12T17:34:00.582 INFO:tasks.workunit.client.0.smithi037.stderr: -124> 2024-09-12T17:34:00.467+0000 7fd9a9098800 20 rados->read ofs=0 len=0 2024-09-12T17:34:00.582 INFO:tasks.workunit.client.0.smithi037.stderr: -123> 2024-09-12T17:34:00.468+0000 7fd9a9098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:00.582 INFO:tasks.workunit.client.0.smithi037.stderr: -122> 2024-09-12T17:34:00.468+0000 7fd9a9098800 20 rados->read ofs=0 len=0 2024-09-12T17:34:00.582 INFO:tasks.workunit.client.0.smithi037.stderr: -121> 2024-09-12T17:34:00.468+0000 7fd9a9098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:00.582 INFO:tasks.workunit.client.0.smithi037.stderr: -120> 2024-09-12T17:34:00.468+0000 7fd9a9098800 20 rados->read ofs=0 len=0 2024-09-12T17:34:00.582 INFO:tasks.workunit.client.0.smithi037.stderr: -119> 2024-09-12T17:34:00.469+0000 7fd9a9098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:00.582 INFO:tasks.workunit.client.0.smithi037.stderr: -118> 2024-09-12T17:34:00.469+0000 7fd9a9098800 20 started sync module instance, tier type = 2024-09-12T17:34:00.582 INFO:tasks.workunit.client.0.smithi037.stderr: -117> 2024-09-12T17:34:00.469+0000 7fd9a9098800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:34:00.582 INFO:tasks.workunit.client.0.smithi037.stderr: -116> 2024-09-12T17:34:00.479+0000 7fd9a9098800 20 add_watcher() i=0 2024-09-12T17:34:00.582 INFO:tasks.workunit.client.0.smithi037.stderr: -115> 2024-09-12T17:34:00.479+0000 7fd9a9098800 20 add_watcher() i=1 2024-09-12T17:34:00.582 INFO:tasks.workunit.client.0.smithi037.stderr: -114> 2024-09-12T17:34:00.479+0000 7fd9a9098800 20 add_watcher() i=2 2024-09-12T17:34:00.583 INFO:tasks.workunit.client.0.smithi037.stderr: -113> 2024-09-12T17:34:00.479+0000 7fd9a9098800 20 add_watcher() i=3 2024-09-12T17:34:00.583 INFO:tasks.workunit.client.0.smithi037.stderr: -112> 2024-09-12T17:34:00.479+0000 7fd9a9098800 20 add_watcher() i=4 2024-09-12T17:34:00.583 INFO:tasks.workunit.client.0.smithi037.stderr: -111> 2024-09-12T17:34:00.479+0000 7fd9a9098800 20 add_watcher() i=5 2024-09-12T17:34:00.583 INFO:tasks.workunit.client.0.smithi037.stderr: -110> 2024-09-12T17:34:00.479+0000 7fd9a9098800 20 add_watcher() i=6 2024-09-12T17:34:00.583 INFO:tasks.workunit.client.0.smithi037.stderr: -109> 2024-09-12T17:34:00.480+0000 7fd9a9098800 20 add_watcher() i=7 2024-09-12T17:34:00.583 INFO:tasks.workunit.client.0.smithi037.stderr: -108> 2024-09-12T17:34:00.480+0000 7fd9a9098800 2 all 8 watchers are set, enabling cache 2024-09-12T17:34:00.583 INFO:tasks.workunit.client.0.smithi037.stderr: -107> 2024-09-12T17:34:00.482+0000 7fd9a9098800 5 AuthRegistry(0x7fff09a1eee0) adding auth protocol: cephx 2024-09-12T17:34:00.583 INFO:tasks.workunit.client.0.smithi037.stderr: -106> 2024-09-12T17:34:00.482+0000 7fd9a9098800 5 AuthRegistry(0x7fff09a1eee0) adding auth protocol: cephx 2024-09-12T17:34:00.583 INFO:tasks.workunit.client.0.smithi037.stderr: -105> 2024-09-12T17:34:00.482+0000 7fd9a9098800 5 AuthRegistry(0x7fff09a1eee0) adding auth protocol: cephx 2024-09-12T17:34:00.583 INFO:tasks.workunit.client.0.smithi037.stderr: -104> 2024-09-12T17:34:00.482+0000 7fd9a9098800 5 AuthRegistry(0x7fff09a1eee0) adding con mode: secure 2024-09-12T17:34:00.583 INFO:tasks.workunit.client.0.smithi037.stderr: -103> 2024-09-12T17:34:00.482+0000 7fd9a9098800 5 AuthRegistry(0x7fff09a1eee0) adding con mode: crc 2024-09-12T17:34:00.583 INFO:tasks.workunit.client.0.smithi037.stderr: -102> 2024-09-12T17:34:00.482+0000 7fd9a9098800 5 AuthRegistry(0x7fff09a1eee0) adding con mode: secure 2024-09-12T17:34:00.583 INFO:tasks.workunit.client.0.smithi037.stderr: -101> 2024-09-12T17:34:00.482+0000 7fd9a9098800 5 AuthRegistry(0x7fff09a1eee0) adding con mode: crc 2024-09-12T17:34:00.584 INFO:tasks.workunit.client.0.smithi037.stderr: -100> 2024-09-12T17:34:00.482+0000 7fd9a9098800 5 AuthRegistry(0x7fff09a1eee0) adding con mode: secure 2024-09-12T17:34:00.584 INFO:tasks.workunit.client.0.smithi037.stderr: -99> 2024-09-12T17:34:00.482+0000 7fd9a9098800 5 AuthRegistry(0x7fff09a1eee0) adding con mode: crc 2024-09-12T17:34:00.584 INFO:tasks.workunit.client.0.smithi037.stderr: -98> 2024-09-12T17:34:00.482+0000 7fd9a9098800 5 AuthRegistry(0x7fff09a1eee0) adding con mode: crc 2024-09-12T17:34:00.584 INFO:tasks.workunit.client.0.smithi037.stderr: -97> 2024-09-12T17:34:00.482+0000 7fd9a9098800 5 AuthRegistry(0x7fff09a1eee0) adding con mode: secure 2024-09-12T17:34:00.584 INFO:tasks.workunit.client.0.smithi037.stderr: -96> 2024-09-12T17:34:00.482+0000 7fd85dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:34:00.584 INFO:tasks.workunit.client.0.smithi037.stderr: -95> 2024-09-12T17:34:00.482+0000 7fd9a9098800 5 AuthRegistry(0x7fff09a1eee0) adding con mode: crc 2024-09-12T17:34:00.584 INFO:tasks.workunit.client.0.smithi037.stderr: -94> 2024-09-12T17:34:00.482+0000 7fd9a9098800 5 AuthRegistry(0x7fff09a1eee0) adding con mode: secure 2024-09-12T17:34:00.584 INFO:tasks.workunit.client.0.smithi037.stderr: -93> 2024-09-12T17:34:00.482+0000 7fd9a9098800 5 AuthRegistry(0x7fff09a1eee0) adding con mode: crc 2024-09-12T17:34:00.584 INFO:tasks.workunit.client.0.smithi037.stderr: -92> 2024-09-12T17:34:00.482+0000 7fd9a9098800 5 AuthRegistry(0x7fff09a1eee0) adding con mode: secure 2024-09-12T17:34:00.584 INFO:tasks.workunit.client.0.smithi037.stderr: -91> 2024-09-12T17:34:00.483+0000 7fd9a9098800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:34:00.584 INFO:tasks.workunit.client.0.smithi037.stderr: -90> 2024-09-12T17:34:00.483+0000 7fd9a9098800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:34:00.585 INFO:tasks.workunit.client.0.smithi037.stderr: -89> 2024-09-12T17:34:00.483+0000 7fd9a9098800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:34:00.585 INFO:tasks.workunit.client.0.smithi037.stderr: -88> 2024-09-12T17:34:00.483+0000 7fd9a9098800 5 asok(0x56055af1f730) register_command cache list hook 0x56055b1e02a0 2024-09-12T17:34:00.585 INFO:tasks.workunit.client.0.smithi037.stderr: -87> 2024-09-12T17:34:00.483+0000 7fd9a9098800 5 asok(0x56055af1f730) register_command cache inspect hook 0x56055b1e02a0 2024-09-12T17:34:00.585 INFO:tasks.workunit.client.0.smithi037.stderr: -86> 2024-09-12T17:34:00.483+0000 7fd9a9098800 5 asok(0x56055af1f730) register_command cache erase hook 0x56055b1e02a0 2024-09-12T17:34:00.585 INFO:tasks.workunit.client.0.smithi037.stderr: -85> 2024-09-12T17:34:00.483+0000 7fd9a9098800 5 asok(0x56055af1f730) register_command cache zap hook 0x56055b1e02a0 2024-09-12T17:34:00.585 INFO:tasks.workunit.client.0.smithi037.stderr: -84> 2024-09-12T17:34:00.483+0000 7fd9a9098800 5 note: GC not initialized 2024-09-12T17:34:00.585 INFO:tasks.workunit.client.0.smithi037.stderr: -83> 2024-09-12T17:34:00.483+0000 7fd85cfe1640 20 reqs_thread_entry: start 2024-09-12T17:34:00.585 INFO:tasks.workunit.client.0.smithi037.stderr: -82> 2024-09-12T17:34:00.483+0000 7fd9a9098800 5 asok(0x56055af1f730) register_command sync trace show hook 0x7fd99c011a40 2024-09-12T17:34:00.585 INFO:tasks.workunit.client.0.smithi037.stderr: -81> 2024-09-12T17:34:00.483+0000 7fd9a9098800 5 asok(0x56055af1f730) register_command sync trace history hook 0x7fd99c011a40 2024-09-12T17:34:00.585 INFO:tasks.workunit.client.0.smithi037.stderr: -80> 2024-09-12T17:34:00.483+0000 7fd9a9098800 5 asok(0x56055af1f730) register_command sync trace active hook 0x7fd99c011a40 2024-09-12T17:34:00.585 INFO:tasks.workunit.client.0.smithi037.stderr: -79> 2024-09-12T17:34:00.483+0000 7fd9a9098800 5 asok(0x56055af1f730) register_command sync trace active_short hook 0x7fd99c011a40 2024-09-12T17:34:00.585 INFO:tasks.workunit.client.0.smithi037.stderr: -78> 2024-09-12T17:34:00.483+0000 7fd9a9098800 20 init_complete bucket index max shards: 11 2024-09-12T17:34:00.585 INFO:tasks.workunit.client.0.smithi037.stderr: -77> 2024-09-12T17:34:00.483+0000 7fd9a9098800 20 Filter name: none 2024-09-12T17:34:00.585 INFO:tasks.workunit.client.0.smithi037.stderr: -76> 2024-09-12T17:34:00.483+0000 7fd855ffb640 20 reqs_thread_entry: start 2024-09-12T17:34:00.586 INFO:tasks.workunit.client.0.smithi037.stderr: -75> 2024-09-12T17:34:00.483+0000 7fd9a9098800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-12T17:34:00.586 INFO:tasks.workunit.client.0.smithi037.stderr: -74> 2024-09-12T17:34:00.483+0000 7fd9a9098800 20 rados->read ofs=0 len=0 2024-09-12T17:34:00.586 INFO:tasks.workunit.client.0.smithi037.stderr: -73> 2024-09-12T17:34:00.484+0000 7fd9a9098800 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T17:34:00.586 INFO:tasks.workunit.client.0.smithi037.stderr: -72> 2024-09-12T17:34:00.484+0000 7fd9a9098800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-12T17:34:00.586 INFO:tasks.workunit.client.0.smithi037.stderr: -71> 2024-09-12T17:34:00.484+0000 7fd9a9098800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-12T17:34:00.586 INFO:tasks.workunit.client.0.smithi037.stderr: -70> 2024-09-12T17:34:00.484+0000 7fd9a9098800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30 : miss 2024-09-12T17:34:00.586 INFO:tasks.workunit.client.0.smithi037.stderr: -69> 2024-09-12T17:34:00.484+0000 7fd9a9098800 20 rados->read ofs=0 len=0 2024-09-12T17:34:00.586 INFO:tasks.workunit.client.0.smithi037.stderr: -68> 2024-09-12T17:34:00.484+0000 7fd9a9098800 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T17:34:00.586 INFO:tasks.workunit.client.0.smithi037.stderr: -67> 2024-09-12T17:34:00.484+0000 7fd9a9098800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30 info.flags=0x17 2024-09-12T17:34:00.586 INFO:tasks.workunit.client.0.smithi037.stderr: -66> 2024-09-12T17:34:00.484+0000 7fd9a9098800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30 to cache LRU end 2024-09-12T17:34:00.586 INFO:tasks.workunit.client.0.smithi037.stderr: -65> 2024-09-12T17:34:00.484+0000 7fd9a9098800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:34:00.587 INFO:tasks.workunit.client.0.smithi037.stderr: -64> 2024-09-12T17:34:00.484+0000 7fd9a9098800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:34:00.587 INFO:tasks.workunit.client.0.smithi037.stderr: -63> 2024-09-12T17:34:00.484+0000 7fd9a9098800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30 2024-09-12T17:34:00.587 INFO:tasks.workunit.client.0.smithi037.stderr: -62> 2024-09-12T17:34:00.491+0000 7fd9a9098800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30 info.flags=0x17 2024-09-12T17:34:00.587 INFO:tasks.workunit.client.0.smithi037.stderr: -61> 2024-09-12T17:34:00.491+0000 7fd9a9098800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30 to cache LRU end 2024-09-12T17:34:00.587 INFO:tasks.workunit.client.0.smithi037.stderr: -60> 2024-09-12T17:34:00.491+0000 7fd9a9098800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:34:00.587 INFO:tasks.workunit.client.0.smithi037.stderr: -59> 2024-09-12T17:34:00.491+0000 7fd9a9098800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30, ofs0, ns] 2024-09-12T17:34:00.587 INFO:tasks.workunit.client.0.smithi037.stderr: -58> 2024-09-12T17:34:00.491+0000 7fd88a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497061 cookie 94581003899664 notifier 6683 bl.length()=999 2024-09-12T17:34:00.587 INFO:tasks.workunit.client.0.smithi037.stderr: -57> 2024-09-12T17:34:00.491+0000 7fd88a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30 info.flags=0x17 2024-09-12T17:34:00.587 INFO:tasks.workunit.client.0.smithi037.stderr: -56> 2024-09-12T17:34:00.491+0000 7fd88a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30 to cache LRU end 2024-09-12T17:34:00.587 INFO:tasks.workunit.client.0.smithi037.stderr: -55> 2024-09-12T17:34:00.491+0000 7fd88a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:34:00.588 INFO:tasks.workunit.client.0.smithi037.stderr: -54> 2024-09-12T17:34:00.493+0000 7fd9a9098800 20 handle_bi_update(): bucket=:abort-at-block-writes[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30]): orig_sources= new_sources= 2024-09-12T17:34:00.588 INFO:tasks.workunit.client.0.smithi037.stderr: -53> 2024-09-12T17:34:00.493+0000 7fd9a9098800 20 handle_bi_update(): bucket=:abort-at-block-writes[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30]): potential sources added=[] removed=[] 2024-09-12T17:34:00.588 INFO:tasks.workunit.client.0.smithi037.stderr: -52> 2024-09-12T17:34:00.493+0000 7fd9a9098800 20 handle_bi_update(): bucket=:abort-at-block-writes[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30]): orig_dests= new_dests= 2024-09-12T17:34:00.588 INFO:tasks.workunit.client.0.smithi037.stderr: -51> 2024-09-12T17:34:00.493+0000 7fd9a9098800 20 handle_bi_update(): bucket=:abort-at-block-writes[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30]): potential dests added=[] removed=[] 2024-09-12T17:34:00.588 INFO:tasks.workunit.client.0.smithi037.stderr: -50> 2024-09-12T17:34:00.499+0000 7fd9a9098800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30.1.0 2024-09-12T17:34:00.588 INFO:tasks.workunit.client.0.smithi037.stderr: -49> 2024-09-12T17:34:00.499+0000 7fd9a9098800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30.1.0 2024-09-12T17:34:00.588 INFO:tasks.workunit.client.0.smithi037.stderr: -48> 2024-09-12T17:34:00.499+0000 7fd9a9098800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30.1.1 2024-09-12T17:34:00.588 INFO:tasks.workunit.client.0.smithi037.stderr: -47> 2024-09-12T17:34:00.499+0000 7fd9a9098800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30.1.1 2024-09-12T17:34:00.588 INFO:tasks.workunit.client.0.smithi037.stderr: -46> 2024-09-12T17:34:00.499+0000 7fd9a9098800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30.1.2 2024-09-12T17:34:00.588 INFO:tasks.workunit.client.0.smithi037.stderr: -45> 2024-09-12T17:34:00.499+0000 7fd9a9098800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30.1.2 2024-09-12T17:34:00.588 INFO:tasks.workunit.client.0.smithi037.stderr: -44> 2024-09-12T17:34:00.499+0000 7fd9a9098800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30.1.3 2024-09-12T17:34:00.588 INFO:tasks.workunit.client.0.smithi037.stderr: -43> 2024-09-12T17:34:00.499+0000 7fd9a9098800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30.1.3 2024-09-12T17:34:00.589 INFO:tasks.workunit.client.0.smithi037.stderr: -42> 2024-09-12T17:34:00.499+0000 7fd9a9098800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30.1.4 2024-09-12T17:34:00.589 INFO:tasks.workunit.client.0.smithi037.stderr: -41> 2024-09-12T17:34:00.499+0000 7fd9a9098800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30.1.4 2024-09-12T17:34:00.589 INFO:tasks.workunit.client.0.smithi037.stderr: -40> 2024-09-12T17:34:00.499+0000 7fd9a9098800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30.1.5 2024-09-12T17:34:00.589 INFO:tasks.workunit.client.0.smithi037.stderr: -39> 2024-09-12T17:34:00.499+0000 7fd9a9098800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30.1.5 2024-09-12T17:34:00.589 INFO:tasks.workunit.client.0.smithi037.stderr: -38> 2024-09-12T17:34:00.499+0000 7fd9a9098800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30.1.6 2024-09-12T17:34:00.589 INFO:tasks.workunit.client.0.smithi037.stderr: -37> 2024-09-12T17:34:00.499+0000 7fd9a9098800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30.1.6 2024-09-12T17:34:00.589 INFO:tasks.workunit.client.0.smithi037.stderr: -36> 2024-09-12T17:34:00.499+0000 7fd9a9098800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30.1.7 2024-09-12T17:34:00.590 INFO:tasks.workunit.client.0.smithi037.stderr: -35> 2024-09-12T17:34:00.499+0000 7fd9a9098800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30.1.7 2024-09-12T17:34:00.590 INFO:tasks.workunit.client.0.smithi037.stderr: -34> 2024-09-12T17:34:00.499+0000 7fd9a9098800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30.1.8 2024-09-12T17:34:00.590 INFO:tasks.workunit.client.0.smithi037.stderr: -33> 2024-09-12T17:34:00.499+0000 7fd9a9098800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30.1.8 2024-09-12T17:34:00.590 INFO:tasks.workunit.client.0.smithi037.stderr: -32> 2024-09-12T17:34:00.499+0000 7fd9a9098800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30.1.9 2024-09-12T17:34:00.590 INFO:tasks.workunit.client.0.smithi037.stderr: -31> 2024-09-12T17:34:00.499+0000 7fd9a9098800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30.1.9 2024-09-12T17:34:00.590 INFO:tasks.workunit.client.0.smithi037.stderr: -30> 2024-09-12T17:34:00.499+0000 7fd9a9098800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30.1.10 2024-09-12T17:34:00.590 INFO:tasks.workunit.client.0.smithi037.stderr: -29> 2024-09-12T17:34:00.499+0000 7fd9a9098800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30.1.10 2024-09-12T17:34:00.590 INFO:tasks.workunit.client.0.smithi037.stderr: -28> 2024-09-12T17:34:00.499+0000 7fd9a9098800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30.1.11 2024-09-12T17:34:00.590 INFO:tasks.workunit.client.0.smithi037.stderr: -27> 2024-09-12T17:34:00.499+0000 7fd9a9098800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30.1.11 2024-09-12T17:34:00.591 INFO:tasks.workunit.client.0.smithi037.stderr: -26> 2024-09-12T17:34:00.499+0000 7fd9a9098800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30.0 2024-09-12T17:34:00.591 INFO:tasks.workunit.client.0.smithi037.stderr: -25> 2024-09-12T17:34:00.500+0000 7fd9a9098800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30.1 2024-09-12T17:34:00.591 INFO:tasks.workunit.client.0.smithi037.stderr: -24> 2024-09-12T17:34:00.500+0000 7fd9a9098800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30.2 2024-09-12T17:34:00.591 INFO:tasks.workunit.client.0.smithi037.stderr: -23> 2024-09-12T17:34:00.501+0000 7fd9a9098800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30.3 2024-09-12T17:34:00.591 INFO:tasks.workunit.client.0.smithi037.stderr: -22> 2024-09-12T17:34:00.501+0000 7fd9a9098800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30.4 2024-09-12T17:34:00.591 INFO:tasks.workunit.client.0.smithi037.stderr: -21> 2024-09-12T17:34:00.502+0000 7fd9a9098800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30.5 2024-09-12T17:34:00.591 INFO:tasks.workunit.client.0.smithi037.stderr: -20> 2024-09-12T17:34:00.502+0000 7fd9a9098800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30.6 2024-09-12T17:34:00.591 INFO:tasks.workunit.client.0.smithi037.stderr: -19> 2024-09-12T17:34:00.503+0000 7fd9a9098800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30.7 2024-09-12T17:34:00.591 INFO:tasks.workunit.client.0.smithi037.stderr: -18> 2024-09-12T17:34:00.503+0000 7fd9a9098800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30.8 2024-09-12T17:34:00.591 INFO:tasks.workunit.client.0.smithi037.stderr: -17> 2024-09-12T17:34:00.504+0000 7fd9a9098800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30.9 2024-09-12T17:34:00.591 INFO:tasks.workunit.client.0.smithi037.stderr: -16> 2024-09-12T17:34:00.504+0000 7fd9a9098800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30.10 2024-09-12T17:34:00.592 INFO:tasks.workunit.client.0.smithi037.stderr: -15> 2024-09-12T17:34:00.508+0000 7fd9a9098800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30 : hit (requested=0x17, cached=0x17) 2024-09-12T17:34:00.592 INFO:tasks.workunit.client.0.smithi037.stderr: -14> 2024-09-12T17:34:00.508+0000 7fd9a9098800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30 2024-09-12T17:34:00.592 INFO:tasks.workunit.client.0.smithi037.stderr: -13> 2024-09-12T17:34:00.509+0000 7fd9a9098800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30 info.flags=0x17 2024-09-12T17:34:00.592 INFO:tasks.workunit.client.0.smithi037.stderr: -12> 2024-09-12T17:34:00.509+0000 7fd9a9098800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30 to cache LRU end 2024-09-12T17:34:00.592 INFO:tasks.workunit.client.0.smithi037.stderr: -11> 2024-09-12T17:34:00.509+0000 7fd9a9098800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:34:00.592 INFO:tasks.workunit.client.0.smithi037.stderr: -10> 2024-09-12T17:34:00.509+0000 7fd9a9098800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30, ofs0, ns] 2024-09-12T17:34:00.592 INFO:tasks.workunit.client.0.smithi037.stderr: -9> 2024-09-12T17:34:00.510+0000 7fd88a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497062 cookie 94581003899664 notifier 6683 bl.length()=999 2024-09-12T17:34:00.592 INFO:tasks.workunit.client.0.smithi037.stderr: -8> 2024-09-12T17:34:00.510+0000 7fd88a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30 info.flags=0x17 2024-09-12T17:34:00.592 INFO:tasks.workunit.client.0.smithi037.stderr: -7> 2024-09-12T17:34:00.510+0000 7fd88a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30 to cache LRU end 2024-09-12T17:34:00.592 INFO:tasks.workunit.client.0.smithi037.stderr: -6> 2024-09-12T17:34:00.510+0000 7fd88a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:34:00.593 INFO:tasks.workunit.client.0.smithi037.stderr: -5> 2024-09-12T17:34:00.511+0000 7fd9a9098800 20 handle_bi_update(): bucket=:abort-at-block-writes[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30]): orig_sources= new_sources= 2024-09-12T17:34:00.593 INFO:tasks.workunit.client.0.smithi037.stderr: -4> 2024-09-12T17:34:00.511+0000 7fd9a9098800 20 handle_bi_update(): bucket=:abort-at-block-writes[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30]): potential sources added=[] removed=[] 2024-09-12T17:34:00.593 INFO:tasks.workunit.client.0.smithi037.stderr: -3> 2024-09-12T17:34:00.511+0000 7fd9a9098800 20 handle_bi_update(): bucket=:abort-at-block-writes[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30]): orig_dests= new_dests= 2024-09-12T17:34:00.593 INFO:tasks.workunit.client.0.smithi037.stderr: -2> 2024-09-12T17:34:00.511+0000 7fd9a9098800 20 handle_bi_update(): bucket=:abort-at-block-writes[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30]): potential dests added=[] removed=[] 2024-09-12T17:34:00.593 INFO:tasks.workunit.client.0.smithi037.stderr: -1> 2024-09-12T17:34:00.512+0000 7fd9a9098800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fd9a9098800 time 2024-09-12T17:34:00.512591+0000 2024-09-12T17:34:00.593 INFO:tasks.workunit.client.0.smithi037.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:34:00.593 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:34:00.593 INFO:tasks.workunit.client.0.smithi037.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:34:00.593 INFO:tasks.workunit.client.0.smithi037.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fd9ac58c71a] 2024-09-12T17:34:00.593 INFO:tasks.workunit.client.0.smithi037.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fd9ac58c8d8] 2024-09-12T17:34:00.593 INFO:tasks.workunit.client.0.smithi037.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x560559129841] 2024-09-12T17:34:00.593 INFO:tasks.workunit.client.0.smithi037.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x189e) [0x56055913879e] 2024-09-12T17:34:00.594 INFO:tasks.workunit.client.0.smithi037.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x5605591395d4] 2024-09-12T17:34:00.594 INFO:tasks.workunit.client.0.smithi037.stderr: 6: main() 2024-09-12T17:34:00.594 INFO:tasks.workunit.client.0.smithi037.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fd9ab229590] 2024-09-12T17:34:00.594 INFO:tasks.workunit.client.0.smithi037.stderr: 8: __libc_start_main() 2024-09-12T17:34:00.594 INFO:tasks.workunit.client.0.smithi037.stderr: 9: _start() 2024-09-12T17:34:00.594 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:34:00.594 INFO:tasks.workunit.client.0.smithi037.stderr: 0> 2024-09-12T17:34:00.513+0000 7fd9a9098800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:34:00.594 INFO:tasks.workunit.client.0.smithi037.stderr: in thread 7fd9a9098800 thread_name:radosgw-admin 2024-09-12T17:34:00.595 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:34:00.595 INFO:tasks.workunit.client.0.smithi037.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:34:00.595 INFO:tasks.workunit.client.0.smithi037.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fd9ab23e6f0] 2024-09-12T17:34:00.595 INFO:tasks.workunit.client.0.smithi037.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fd9ab28b99c] 2024-09-12T17:34:00.595 INFO:tasks.workunit.client.0.smithi037.stderr: 3: raise() 2024-09-12T17:34:00.595 INFO:tasks.workunit.client.0.smithi037.stderr: 4: abort() 2024-09-12T17:34:00.595 INFO:tasks.workunit.client.0.smithi037.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fd9ac58c774] 2024-09-12T17:34:00.595 INFO:tasks.workunit.client.0.smithi037.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fd9ac58c8d8] 2024-09-12T17:34:00.595 INFO:tasks.workunit.client.0.smithi037.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x560559129841] 2024-09-12T17:34:00.595 INFO:tasks.workunit.client.0.smithi037.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x189e) [0x56055913879e] 2024-09-12T17:34:00.595 INFO:tasks.workunit.client.0.smithi037.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x5605591395d4] 2024-09-12T17:34:00.595 INFO:tasks.workunit.client.0.smithi037.stderr: 10: main() 2024-09-12T17:34:00.596 INFO:tasks.workunit.client.0.smithi037.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fd9ab229590] 2024-09-12T17:34:00.596 INFO:tasks.workunit.client.0.smithi037.stderr: 12: __libc_start_main() 2024-09-12T17:34:00.596 INFO:tasks.workunit.client.0.smithi037.stderr: 13: _start() 2024-09-12T17:34:00.596 INFO:tasks.workunit.client.0.smithi037.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:34:00.596 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:34:00.596 INFO:tasks.workunit.client.0.smithi037.stderr:--- logging levels --- 2024-09-12T17:34:00.596 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 none 2024-09-12T17:34:00.596 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 lockdep 2024-09-12T17:34:00.596 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 context 2024-09-12T17:34:00.596 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 1 crush 2024-09-12T17:34:00.596 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mds 2024-09-12T17:34:00.596 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mds_balancer 2024-09-12T17:34:00.596 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mds_locker 2024-09-12T17:34:00.597 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mds_log 2024-09-12T17:34:00.597 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mds_log_expire 2024-09-12T17:34:00.597 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mds_migrator 2024-09-12T17:34:00.597 INFO:tasks.workunit.client.0.smithi037.stderr: 3/ 5 mds_quiesce 2024-09-12T17:34:00.597 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 buffer 2024-09-12T17:34:00.597 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 timer 2024-09-12T17:34:00.597 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 filer 2024-09-12T17:34:00.597 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 striper 2024-09-12T17:34:00.597 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 objecter 2024-09-12T17:34:00.597 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 rados 2024-09-12T17:34:00.597 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 rbd 2024-09-12T17:34:00.597 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 rbd_mirror 2024-09-12T17:34:00.597 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 rbd_replay 2024-09-12T17:34:00.597 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 rbd_pwl 2024-09-12T17:34:00.598 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 journaler 2024-09-12T17:34:00.598 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 objectcacher 2024-09-12T17:34:00.598 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:34:00.598 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 client 2024-09-12T17:34:00.598 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 osd 2024-09-12T17:34:00.598 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 optracker 2024-09-12T17:34:00.598 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 objclass 2024-09-12T17:34:00.598 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 3 filestore 2024-09-12T17:34:00.598 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 3 journal 2024-09-12T17:34:00.598 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 0 ms 2024-09-12T17:34:00.598 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mon 2024-09-12T17:34:00.598 INFO:tasks.workunit.client.0.smithi037.stderr: 0/10 monc 2024-09-12T17:34:00.598 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 paxos 2024-09-12T17:34:00.598 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 tp 2024-09-12T17:34:00.599 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 auth 2024-09-12T17:34:00.599 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 crypto 2024-09-12T17:34:00.599 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 1 finisher 2024-09-12T17:34:00.599 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 1 reserver 2024-09-12T17:34:00.599 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 heartbeatmap 2024-09-12T17:34:00.599 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 perfcounter 2024-09-12T17:34:00.599 INFO:tasks.workunit.client.0.smithi037.stderr: 20/20 rgw 2024-09-12T17:34:00.599 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 rgw_sync 2024-09-12T17:34:00.599 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 rgw_datacache 2024-09-12T17:34:00.599 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 rgw_access 2024-09-12T17:34:00.599 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:34:00.599 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 rgw_flight 2024-09-12T17:34:00.599 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:34:00.599 INFO:tasks.workunit.client.0.smithi037.stderr: 20/20 rgw_notification 2024-09-12T17:34:00.600 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 javaclient 2024-09-12T17:34:00.600 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 asok 2024-09-12T17:34:00.600 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 1 throttle 2024-09-12T17:34:00.600 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 0 refs 2024-09-12T17:34:00.600 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 compressor 2024-09-12T17:34:00.600 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 bluestore 2024-09-12T17:34:00.600 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 bluefs 2024-09-12T17:34:00.600 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 3 bdev 2024-09-12T17:34:00.600 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 kstore 2024-09-12T17:34:00.600 INFO:tasks.workunit.client.0.smithi037.stderr: 4/ 5 rocksdb 2024-09-12T17:34:00.600 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 fuse 2024-09-12T17:34:00.600 INFO:tasks.workunit.client.0.smithi037.stderr: 2/ 5 mgr 2024-09-12T17:34:00.601 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mgrc 2024-09-12T17:34:00.601 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 dpdk 2024-09-12T17:34:00.601 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 eventtrace 2024-09-12T17:34:00.601 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 prioritycache 2024-09-12T17:34:00.601 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 test 2024-09-12T17:34:00.601 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:34:00.601 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 cephsqlite 2024-09-12T17:34:00.601 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:34:00.601 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore 2024-09-12T17:34:00.601 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_onode 2024-09-12T17:34:00.601 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_odata 2024-09-12T17:34:00.601 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_omap 2024-09-12T17:34:00.601 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_tm 2024-09-12T17:34:00.602 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_t 2024-09-12T17:34:00.602 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:34:00.602 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_epm 2024-09-12T17:34:00.602 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_lba 2024-09-12T17:34:00.602 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:34:00.602 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_cache 2024-09-12T17:34:00.602 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_journal 2024-09-12T17:34:00.602 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_device 2024-09-12T17:34:00.602 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_backref 2024-09-12T17:34:00.602 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 alienstore 2024-09-12T17:34:00.602 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mclock 2024-09-12T17:34:00.602 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 cyanstore 2024-09-12T17:34:00.602 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 ceph_exporter 2024-09-12T17:34:00.602 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 memstore 2024-09-12T17:34:00.603 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 trace 2024-09-12T17:34:00.603 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 ceph_dedup 2024-09-12T17:34:00.603 INFO:tasks.workunit.client.0.smithi037.stderr: -2/-2 (syslog threshold) 2024-09-12T17:34:00.603 INFO:tasks.workunit.client.0.smithi037.stderr: 99/99 (stderr threshold) 2024-09-12T17:34:00.603 INFO:tasks.workunit.client.0.smithi037.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:34:00.603 INFO:tasks.workunit.client.0.smithi037.stderr: 7fd855ffb640 / http_manager 2024-09-12T17:34:00.603 INFO:tasks.workunit.client.0.smithi037.stderr: 7fd85cfe1640 / http_manager 2024-09-12T17:34:00.603 INFO:tasks.workunit.client.0.smithi037.stderr: 7fd85dfe3640 / rgw_dt_lg_renew 2024-09-12T17:34:00.603 INFO:tasks.workunit.client.0.smithi037.stderr: 7fd888ff9640 / ms_dispatch 2024-09-12T17:34:00.603 INFO:tasks.workunit.client.0.smithi037.stderr: 7fd88a7fc640 / io_context_pool 2024-09-12T17:34:00.603 INFO:tasks.workunit.client.0.smithi037.stderr: 7fd890e01640 / ms_dispatch 2024-09-12T17:34:00.603 INFO:tasks.workunit.client.0.smithi037.stderr: 7fd893606640 / ms_dispatch 2024-09-12T17:34:00.603 INFO:tasks.workunit.client.0.smithi037.stderr: 7fd894e09640 / io_context_pool 2024-09-12T17:34:00.604 INFO:tasks.workunit.client.0.smithi037.stderr: 7fd9a6381640 / msgr-worker-2 2024-09-12T17:34:00.604 INFO:tasks.workunit.client.0.smithi037.stderr: 7fd9a6b82640 / msgr-worker-1 2024-09-12T17:34:00.604 INFO:tasks.workunit.client.0.smithi037.stderr: 7fd9a7383640 / msgr-worker-0 2024-09-12T17:34:00.604 INFO:tasks.workunit.client.0.smithi037.stderr: 7fd9a7b84640 / io_context_pool 2024-09-12T17:34:00.604 INFO:tasks.workunit.client.0.smithi037.stderr: 7fd9a9098800 / radosgw-admin 2024-09-12T17:34:00.604 INFO:tasks.workunit.client.0.smithi037.stderr: max_recent 500 2024-09-12T17:34:00.604 INFO:tasks.workunit.client.0.smithi037.stderr: max_new 1000 2024-09-12T17:34:00.604 INFO:tasks.workunit.client.0.smithi037.stderr: log_file /var/log/ceph/ceph-client.admin.113751.log 2024-09-12T17:34:00.604 INFO:tasks.workunit.client.0.smithi037.stderr:--- end dump of recent events --- 2024-09-12T17:34:00.604 INFO:tasks.workunit.client.0.smithi037.stderr:--- begin dump of recent events --- 2024-09-12T17:34:00.604 INFO:tasks.workunit.client.0.smithi037.stderr: -499> 2024-09-12T17:33:59.826+0000 7fd9a9098800 5 AuthRegistry(0x56055b140ac0) adding con mode: crc 2024-09-12T17:34:00.604 INFO:tasks.workunit.client.0.smithi037.stderr: -498> 2024-09-12T17:33:59.826+0000 7fd9a9098800 5 AuthRegistry(0x56055b140ac0) adding con mode: secure 2024-09-12T17:34:00.604 INFO:tasks.workunit.client.0.smithi037.stderr: -497> 2024-09-12T17:33:59.826+0000 7fd9a9098800 5 AuthRegistry(0x56055b140ac0) adding con mode: crc 2024-09-12T17:34:00.604 INFO:tasks.workunit.client.0.smithi037.stderr: -496> 2024-09-12T17:33:59.826+0000 7fd9a9098800 5 AuthRegistry(0x56055b140ac0) adding con mode: secure 2024-09-12T17:34:00.605 INFO:tasks.workunit.client.0.smithi037.stderr: -495> 2024-09-12T17:33:59.827+0000 7fd9a9098800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:34:00.605 INFO:tasks.workunit.client.0.smithi037.stderr: -494> 2024-09-12T17:33:59.827+0000 7fd9a9098800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:34:00.605 INFO:tasks.workunit.client.0.smithi037.stderr: -493> 2024-09-12T17:33:59.827+0000 7fd9a9098800 5 asok(0x56055af1f730) register_command rotate-key hook 0x56055b140c08 2024-09-12T17:34:00.605 INFO:tasks.workunit.client.0.smithi037.stderr: -492> 2024-09-12T17:33:59.827+0000 7fd9a9098800 10 monclient: _reopen_session rank -1 2024-09-12T17:34:00.605 INFO:tasks.workunit.client.0.smithi037.stderr: -491> 2024-09-12T17:33:59.827+0000 7fd9a9098800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T17:34:00.605 INFO:tasks.workunit.client.0.smithi037.stderr: -490> 2024-09-12T17:33:59.827+0000 7fd9a9098800 10 monclient(hunting): picked mon.noname-c con 0x56055afed000 addr [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] 2024-09-12T17:34:00.605 INFO:tasks.workunit.client.0.smithi037.stderr: -489> 2024-09-12T17:33:59.827+0000 7fd9a9098800 10 monclient(hunting): picked mon.noname-b con 0x56055b0834f0 addr [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] 2024-09-12T17:34:00.605 INFO:tasks.workunit.client.0.smithi037.stderr: -488> 2024-09-12T17:33:59.827+0000 7fd9a9098800 10 monclient(hunting): picked mon.noname-a con 0x56055b089bd0 addr [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] 2024-09-12T17:34:00.605 INFO:tasks.workunit.client.0.smithi037.stderr: -487> 2024-09-12T17:33:59.827+0000 7fd9a9098800 10 monclient(hunting): start opening mon connection 2024-09-12T17:34:00.605 INFO:tasks.workunit.client.0.smithi037.stderr: -486> 2024-09-12T17:33:59.827+0000 7fd9a9098800 10 monclient(hunting): start opening mon connection 2024-09-12T17:34:00.605 INFO:tasks.workunit.client.0.smithi037.stderr: -485> 2024-09-12T17:33:59.827+0000 7fd9a9098800 10 monclient(hunting): start opening mon connection 2024-09-12T17:34:00.605 INFO:tasks.workunit.client.0.smithi037.stderr: -484> 2024-09-12T17:33:59.827+0000 7fd9a9098800 10 monclient(hunting): _renew_subs 2024-09-12T17:34:00.605 INFO:tasks.workunit.client.0.smithi037.stderr: -483> 2024-09-12T17:33:59.827+0000 7fd9a9098800 10 monclient(hunting): authenticate will time out at 2227.424390s 2024-09-12T17:34:00.606 INFO:tasks.workunit.client.0.smithi037.stderr: -482> 2024-09-12T17:33:59.827+0000 7fd9a6b82640 10 monclient(hunting): get_auth_request con 0x56055afed000 auth_method 0 2024-09-12T17:34:00.606 INFO:tasks.workunit.client.0.smithi037.stderr: -481> 2024-09-12T17:33:59.827+0000 7fd9a6b82640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:34:00.606 INFO:tasks.workunit.client.0.smithi037.stderr: -480> 2024-09-12T17:33:59.827+0000 7fd9a6b82640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:34:00.606 INFO:tasks.workunit.client.0.smithi037.stderr: -479> 2024-09-12T17:33:59.827+0000 7fd9a6b82640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:34:00.606 INFO:tasks.workunit.client.0.smithi037.stderr: -478> 2024-09-12T17:33:59.827+0000 7fd9a7383640 10 monclient(hunting): get_auth_request con 0x56055b089bd0 auth_method 0 2024-09-12T17:34:00.606 INFO:tasks.workunit.client.0.smithi037.stderr: -477> 2024-09-12T17:33:59.827+0000 7fd9a7383640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:34:00.606 INFO:tasks.workunit.client.0.smithi037.stderr: -476> 2024-09-12T17:33:59.827+0000 7fd9a7383640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:34:00.606 INFO:tasks.workunit.client.0.smithi037.stderr: -475> 2024-09-12T17:33:59.827+0000 7fd9a7383640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:34:00.606 INFO:tasks.workunit.client.0.smithi037.stderr: -474> 2024-09-12T17:33:59.827+0000 7fd9a6b82640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:34:00.606 INFO:tasks.workunit.client.0.smithi037.stderr: -473> 2024-09-12T17:33:59.827+0000 7fd9a6b82640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:34:00.606 INFO:tasks.workunit.client.0.smithi037.stderr: -472> 2024-09-12T17:33:59.827+0000 7fd9a6b82640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:34:00.606 INFO:tasks.workunit.client.0.smithi037.stderr: -471> 2024-09-12T17:33:59.827+0000 7fd9a7383640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:34:00.607 INFO:tasks.workunit.client.0.smithi037.stderr: -470> 2024-09-12T17:33:59.827+0000 7fd9a7383640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:34:00.607 INFO:tasks.workunit.client.0.smithi037.stderr: -469> 2024-09-12T17:33:59.827+0000 7fd9a7383640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:34:00.607 INFO:tasks.workunit.client.0.smithi037.stderr: -468> 2024-09-12T17:33:59.827+0000 7fd9a6381640 10 monclient(hunting): get_auth_request con 0x56055b0834f0 auth_method 0 2024-09-12T17:34:00.607 INFO:tasks.workunit.client.0.smithi037.stderr: -467> 2024-09-12T17:33:59.827+0000 7fd9a6381640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:34:00.607 INFO:tasks.workunit.client.0.smithi037.stderr: -466> 2024-09-12T17:33:59.827+0000 7fd9a6381640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:34:00.607 INFO:tasks.workunit.client.0.smithi037.stderr: -465> 2024-09-12T17:33:59.827+0000 7fd9a6381640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:34:00.607 INFO:tasks.workunit.client.0.smithi037.stderr: -464> 2024-09-12T17:33:59.827+0000 7fd9a6b82640 10 monclient(hunting): handle_auth_done global_id 6674 payload 824 2024-09-12T17:34:00.607 INFO:tasks.workunit.client.0.smithi037.stderr: -463> 2024-09-12T17:33:59.827+0000 7fd9a6b82640 10 monclient: _finish_hunting 0 2024-09-12T17:34:00.607 INFO:tasks.workunit.client.0.smithi037.stderr: -462> 2024-09-12T17:33:59.827+0000 7fd9a6b82640 1 monclient: found mon.noname-c 2024-09-12T17:34:00.607 INFO:tasks.workunit.client.0.smithi037.stderr: -461> 2024-09-12T17:33:59.827+0000 7fd9a6b82640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.37:3301/0 2024-09-12T17:34:00.608 INFO:tasks.workunit.client.0.smithi037.stderr: -460> 2024-09-12T17:33:59.828+0000 7fd893606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:34:00.608 INFO:tasks.workunit.client.0.smithi037.stderr: -459> 2024-09-12T17:33:59.828+0000 7fd893606640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:34:00.608 INFO:tasks.workunit.client.0.smithi037.stderr: -458> 2024-09-12T17:33:59.828+0000 7fd893606640 10 monclient: dump: 2024-09-12T17:34:00.608 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:34:00.608 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:34:00.608 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:34:00.608 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:34:00.608 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:34:00.608 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:34:00.608 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:34:00.608 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:34:00.609 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:34:00.609 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:34:00.609 INFO:tasks.workunit.client.0.smithi037.stderr: -457> 2024-09-12T17:33:59.828+0000 7fd893606640 10 monclient: _finish_auth 0 2024-09-12T17:34:00.609 INFO:tasks.workunit.client.0.smithi037.stderr: -456> 2024-09-12T17:33:59.828+0000 7fd893606640 10 monclient: _check_auth_tickets 2024-09-12T17:34:00.609 INFO:tasks.workunit.client.0.smithi037.stderr: -455> 2024-09-12T17:33:59.828+0000 7fd893606640 10 monclient: handle_config config(0 keys) 2024-09-12T17:34:00.609 INFO:tasks.workunit.client.0.smithi037.stderr: -454> 2024-09-12T17:33:59.828+0000 7fd893606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:34:00.609 INFO:tasks.workunit.client.0.smithi037.stderr: -453> 2024-09-12T17:33:59.828+0000 7fd893606640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:34:00.609 INFO:tasks.workunit.client.0.smithi037.stderr: -452> 2024-09-12T17:33:59.828+0000 7fd893606640 10 monclient: dump: 2024-09-12T17:34:00.609 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:34:00.609 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:34:00.609 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:34:00.610 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:34:00.610 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:34:00.610 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:34:00.610 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:34:00.610 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:34:00.610 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:34:00.610 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:34:00.610 INFO:tasks.workunit.client.0.smithi037.stderr: -451> 2024-09-12T17:33:59.828+0000 7fd9a9098800 5 monclient: authenticate success, global_id 6674 2024-09-12T17:34:00.610 INFO:tasks.workunit.client.0.smithi037.stderr: -450> 2024-09-12T17:33:59.828+0000 7fd894e09640 4 set_mon_vals no callback set 2024-09-12T17:34:00.610 INFO:tasks.workunit.client.0.smithi037.stderr: -449> 2024-09-12T17:33:59.828+0000 7fd9a9098800 10 monclient: _renew_subs 2024-09-12T17:34:00.610 INFO:tasks.workunit.client.0.smithi037.stderr: -448> 2024-09-12T17:33:59.828+0000 7fd9a9098800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.37:3301/0 2024-09-12T17:34:00.610 INFO:tasks.workunit.client.0.smithi037.stderr: -447> 2024-09-12T17:33:59.828+0000 7fd9a9098800 10 monclient: _renew_subs 2024-09-12T17:34:00.610 INFO:tasks.workunit.client.0.smithi037.stderr: -446> 2024-09-12T17:33:59.828+0000 7fd9a9098800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.37:3301/0 2024-09-12T17:34:00.610 INFO:tasks.workunit.client.0.smithi037.stderr: -445> 2024-09-12T17:33:59.828+0000 7fd9a9098800 1 librados: init done 2024-09-12T17:34:00.611 INFO:tasks.workunit.client.0.smithi037.stderr: -444> 2024-09-12T17:33:59.830+0000 7fd893606640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:34:00.611 INFO:tasks.workunit.client.0.smithi037.stderr: -443> 2024-09-12T17:33:59.830+0000 7fd893606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.40:6816/3916250676,v1:172.21.15.40:6817/3916250676] 2024-09-12T17:34:00.611 INFO:tasks.workunit.client.0.smithi037.stderr: -442> 2024-09-12T17:33:59.830+0000 7fd893606640 4 mgrc reconnect Starting new session with [v2:172.21.15.40:6816/3916250676,v1:172.21.15.40:6817/3916250676] 2024-09-12T17:34:00.611 INFO:tasks.workunit.client.0.smithi037.stderr: -441> 2024-09-12T17:33:59.830+0000 7fd9a6381640 10 monclient: get_auth_request con 0x7fd88c076470 auth_method 0 2024-09-12T17:34:00.611 INFO:tasks.workunit.client.0.smithi037.stderr: -440> 2024-09-12T17:33:59.830+0000 7fd9a7383640 10 monclient: get_auth_request con 0x56055b168ce0 auth_method 0 2024-09-12T17:34:00.611 INFO:tasks.workunit.client.0.smithi037.stderr: -439> 2024-09-12T17:33:59.831+0000 7fd9a6b82640 10 monclient: get_auth_request con 0x56055b18bad0 auth_method 0 2024-09-12T17:34:00.611 INFO:tasks.workunit.client.0.smithi037.stderr: -438> 2024-09-12T17:33:59.833+0000 7fd9a6381640 10 monclient: get_auth_request con 0x56055b190d20 auth_method 0 2024-09-12T17:34:00.611 INFO:tasks.workunit.client.0.smithi037.stderr: -437> 2024-09-12T17:34:00.035+0000 7fd9a6381640 10 monclient: get_auth_request con 0x56055b190d20 auth_method 0 2024-09-12T17:34:00.611 INFO:tasks.workunit.client.0.smithi037.stderr: -436> 2024-09-12T17:34:00.036+0000 7fd9a9098800 10 monclient: build_initial_monmap 2024-09-12T17:34:00.611 INFO:tasks.workunit.client.0.smithi037.stderr: -435> 2024-09-12T17:34:00.036+0000 7fd9a9098800 1 build_initial for_mkfs: 0 2024-09-12T17:34:00.611 INFO:tasks.workunit.client.0.smithi037.stderr: -434> 2024-09-12T17:34:00.036+0000 7fd9a9098800 10 monclient: monmap: 2024-09-12T17:34:00.611 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 0 2024-09-12T17:34:00.611 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:34:00.611 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 0.000000 2024-09-12T17:34:00.611 INFO:tasks.workunit.client.0.smithi037.stderr:created 0.000000 2024-09-12T17:34:00.612 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 0 (unknown) 2024-09-12T17:34:00.612 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:34:00.612 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.noname-a 2024-09-12T17:34:00.612 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.noname-b 2024-09-12T17:34:00.612 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.noname-c 2024-09-12T17:34:00.612 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:34:00.612 INFO:tasks.workunit.client.0.smithi037.stderr: -433> 2024-09-12T17:34:00.036+0000 7fd9a9098800 5 AuthRegistry(0x56055b194d90) adding auth protocol: cephx 2024-09-12T17:34:00.612 INFO:tasks.workunit.client.0.smithi037.stderr: -432> 2024-09-12T17:34:00.036+0000 7fd9a9098800 5 AuthRegistry(0x56055b194d90) adding auth protocol: cephx 2024-09-12T17:34:00.612 INFO:tasks.workunit.client.0.smithi037.stderr: -431> 2024-09-12T17:34:00.036+0000 7fd9a9098800 5 AuthRegistry(0x56055b194d90) adding auth protocol: cephx 2024-09-12T17:34:00.612 INFO:tasks.workunit.client.0.smithi037.stderr: -430> 2024-09-12T17:34:00.036+0000 7fd9a9098800 5 AuthRegistry(0x56055b194d90) adding con mode: secure 2024-09-12T17:34:00.612 INFO:tasks.workunit.client.0.smithi037.stderr: -429> 2024-09-12T17:34:00.036+0000 7fd9a9098800 5 AuthRegistry(0x56055b194d90) adding con mode: crc 2024-09-12T17:34:00.612 INFO:tasks.workunit.client.0.smithi037.stderr: -428> 2024-09-12T17:34:00.036+0000 7fd9a9098800 5 AuthRegistry(0x56055b194d90) adding con mode: secure 2024-09-12T17:34:00.612 INFO:tasks.workunit.client.0.smithi037.stderr: -427> 2024-09-12T17:34:00.036+0000 7fd9a9098800 5 AuthRegistry(0x56055b194d90) adding con mode: crc 2024-09-12T17:34:00.612 INFO:tasks.workunit.client.0.smithi037.stderr: -426> 2024-09-12T17:34:00.036+0000 7fd9a9098800 5 AuthRegistry(0x56055b194d90) adding con mode: secure 2024-09-12T17:34:00.613 INFO:tasks.workunit.client.0.smithi037.stderr: -425> 2024-09-12T17:34:00.036+0000 7fd9a9098800 5 AuthRegistry(0x56055b194d90) adding con mode: crc 2024-09-12T17:34:00.613 INFO:tasks.workunit.client.0.smithi037.stderr: -424> 2024-09-12T17:34:00.036+0000 7fd9a9098800 5 AuthRegistry(0x56055b194d90) adding con mode: crc 2024-09-12T17:34:00.613 INFO:tasks.workunit.client.0.smithi037.stderr: -423> 2024-09-12T17:34:00.036+0000 7fd9a9098800 5 AuthRegistry(0x56055b194d90) adding con mode: secure 2024-09-12T17:34:00.613 INFO:tasks.workunit.client.0.smithi037.stderr: -422> 2024-09-12T17:34:00.036+0000 7fd9a9098800 5 AuthRegistry(0x56055b194d90) adding con mode: crc 2024-09-12T17:34:00.613 INFO:tasks.workunit.client.0.smithi037.stderr: -421> 2024-09-12T17:34:00.036+0000 7fd9a9098800 5 AuthRegistry(0x56055b194d90) adding con mode: secure 2024-09-12T17:34:00.613 INFO:tasks.workunit.client.0.smithi037.stderr: -420> 2024-09-12T17:34:00.036+0000 7fd9a9098800 5 AuthRegistry(0x56055b194d90) adding con mode: crc 2024-09-12T17:34:00.613 INFO:tasks.workunit.client.0.smithi037.stderr: -419> 2024-09-12T17:34:00.036+0000 7fd9a9098800 5 AuthRegistry(0x56055b194d90) adding con mode: secure 2024-09-12T17:34:00.613 INFO:tasks.workunit.client.0.smithi037.stderr: -418> 2024-09-12T17:34:00.036+0000 7fd9a9098800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:34:00.613 INFO:tasks.workunit.client.0.smithi037.stderr: -417> 2024-09-12T17:34:00.036+0000 7fd9a9098800 5 asok(0x56055af1f730) register_command objecter_requests cmddesc objecter_requests hook 0x56055b199350 EEXIST 2024-09-12T17:34:00.613 INFO:tasks.workunit.client.0.smithi037.stderr: -416> 2024-09-12T17:34:00.036+0000 7fd9a9098800 10 monclient: init 2024-09-12T17:34:00.614 INFO:tasks.workunit.client.0.smithi037.stderr: -415> 2024-09-12T17:34:00.036+0000 7fd9a9098800 5 AuthRegistry(0x56055b193d48) adding auth protocol: cephx 2024-09-12T17:34:00.614 INFO:tasks.workunit.client.0.smithi037.stderr: -414> 2024-09-12T17:34:00.036+0000 7fd9a9098800 5 AuthRegistry(0x56055b193d48) adding auth protocol: cephx 2024-09-12T17:34:00.614 INFO:tasks.workunit.client.0.smithi037.stderr: -413> 2024-09-12T17:34:00.036+0000 7fd9a9098800 5 AuthRegistry(0x56055b193d48) adding auth protocol: cephx 2024-09-12T17:34:00.614 INFO:tasks.workunit.client.0.smithi037.stderr: -412> 2024-09-12T17:34:00.036+0000 7fd9a9098800 5 AuthRegistry(0x56055b193d48) adding con mode: secure 2024-09-12T17:34:00.614 INFO:tasks.workunit.client.0.smithi037.stderr: -411> 2024-09-12T17:34:00.036+0000 7fd9a9098800 5 AuthRegistry(0x56055b193d48) adding con mode: crc 2024-09-12T17:34:00.614 INFO:tasks.workunit.client.0.smithi037.stderr: -410> 2024-09-12T17:34:00.036+0000 7fd9a9098800 5 AuthRegistry(0x56055b193d48) adding con mode: secure 2024-09-12T17:34:00.615 INFO:tasks.workunit.client.0.smithi037.stderr: -409> 2024-09-12T17:34:00.036+0000 7fd9a9098800 5 AuthRegistry(0x56055b193d48) adding con mode: crc 2024-09-12T17:34:00.615 INFO:tasks.workunit.client.0.smithi037.stderr: -408> 2024-09-12T17:34:00.036+0000 7fd9a9098800 5 AuthRegistry(0x56055b193d48) adding con mode: secure 2024-09-12T17:34:00.615 INFO:tasks.workunit.client.0.smithi037.stderr: -407> 2024-09-12T17:34:00.036+0000 7fd9a9098800 5 AuthRegistry(0x56055b193d48) adding con mode: crc 2024-09-12T17:34:00.615 INFO:tasks.workunit.client.0.smithi037.stderr: -406> 2024-09-12T17:34:00.036+0000 7fd9a9098800 5 AuthRegistry(0x56055b193d48) adding con mode: crc 2024-09-12T17:34:00.615 INFO:tasks.workunit.client.0.smithi037.stderr: -405> 2024-09-12T17:34:00.036+0000 7fd9a9098800 5 AuthRegistry(0x56055b193d48) adding con mode: secure 2024-09-12T17:34:00.615 INFO:tasks.workunit.client.0.smithi037.stderr: -404> 2024-09-12T17:34:00.036+0000 7fd9a9098800 5 AuthRegistry(0x56055b193d48) adding con mode: crc 2024-09-12T17:34:00.615 INFO:tasks.workunit.client.0.smithi037.stderr: -403> 2024-09-12T17:34:00.036+0000 7fd9a9098800 5 AuthRegistry(0x56055b193d48) adding con mode: secure 2024-09-12T17:34:00.615 INFO:tasks.workunit.client.0.smithi037.stderr: -402> 2024-09-12T17:34:00.036+0000 7fd9a9098800 5 AuthRegistry(0x56055b193d48) adding con mode: crc 2024-09-12T17:34:00.616 INFO:tasks.workunit.client.0.smithi037.stderr: -401> 2024-09-12T17:34:00.036+0000 7fd9a9098800 5 AuthRegistry(0x56055b193d48) adding con mode: secure 2024-09-12T17:34:00.616 INFO:tasks.workunit.client.0.smithi037.stderr: -400> 2024-09-12T17:34:00.037+0000 7fd9a9098800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:34:00.616 INFO:tasks.workunit.client.0.smithi037.stderr: -399> 2024-09-12T17:34:00.037+0000 7fd9a9098800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:34:00.616 INFO:tasks.workunit.client.0.smithi037.stderr: -398> 2024-09-12T17:34:00.037+0000 7fd9a9098800 5 asok(0x56055af1f730) register_command rotate-key cmddesc rotate-key hook 0x56055b193e90 EEXIST 2024-09-12T17:34:00.617 INFO:tasks.workunit.client.0.smithi037.stderr: -397> 2024-09-12T17:34:00.037+0000 7fd9a9098800 10 monclient: _reopen_session rank -1 2024-09-12T17:34:00.617 INFO:tasks.workunit.client.0.smithi037.stderr: -396> 2024-09-12T17:34:00.037+0000 7fd9a9098800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T17:34:00.617 INFO:tasks.workunit.client.0.smithi037.stderr: -395> 2024-09-12T17:34:00.037+0000 7fd9a9098800 10 monclient(hunting): picked mon.noname-c con 0x56055b1bd650 addr [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] 2024-09-12T17:34:00.617 INFO:tasks.workunit.client.0.smithi037.stderr: -394> 2024-09-12T17:34:00.037+0000 7fd9a9098800 10 monclient(hunting): picked mon.noname-b con 0x56055b1bc7b0 addr [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] 2024-09-12T17:34:00.617 INFO:tasks.workunit.client.0.smithi037.stderr: -393> 2024-09-12T17:34:00.037+0000 7fd9a9098800 10 monclient(hunting): picked mon.noname-a con 0x56055b1d5aa0 addr [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] 2024-09-12T17:34:00.617 INFO:tasks.workunit.client.0.smithi037.stderr: -392> 2024-09-12T17:34:00.037+0000 7fd9a9098800 10 monclient(hunting): start opening mon connection 2024-09-12T17:34:00.617 INFO:tasks.workunit.client.0.smithi037.stderr: -391> 2024-09-12T17:34:00.037+0000 7fd9a9098800 10 monclient(hunting): start opening mon connection 2024-09-12T17:34:00.617 INFO:tasks.workunit.client.0.smithi037.stderr: -390> 2024-09-12T17:34:00.037+0000 7fd9a9098800 10 monclient(hunting): start opening mon connection 2024-09-12T17:34:00.617 INFO:tasks.workunit.client.0.smithi037.stderr: -389> 2024-09-12T17:34:00.037+0000 7fd9a9098800 10 monclient(hunting): _renew_subs 2024-09-12T17:34:00.618 INFO:tasks.workunit.client.0.smithi037.stderr: -388> 2024-09-12T17:34:00.037+0000 7fd9a9098800 10 monclient(hunting): authenticate will time out at 2227.634473s 2024-09-12T17:34:00.618 INFO:tasks.workunit.client.0.smithi037.stderr: -387> 2024-09-12T17:34:00.037+0000 7fd9a7383640 10 monclient(hunting): get_auth_request con 0x56055b1d5aa0 auth_method 0 2024-09-12T17:34:00.618 INFO:tasks.workunit.client.0.smithi037.stderr: -386> 2024-09-12T17:34:00.037+0000 7fd9a7383640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:34:00.618 INFO:tasks.workunit.client.0.smithi037.stderr: -385> 2024-09-12T17:34:00.037+0000 7fd9a7383640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:34:00.618 INFO:tasks.workunit.client.0.smithi037.stderr: -384> 2024-09-12T17:34:00.037+0000 7fd9a7383640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:34:00.618 INFO:tasks.workunit.client.0.smithi037.stderr: -383> 2024-09-12T17:34:00.037+0000 7fd9a6b82640 10 monclient(hunting): get_auth_request con 0x56055b1bd650 auth_method 0 2024-09-12T17:34:00.618 INFO:tasks.workunit.client.0.smithi037.stderr: -382> 2024-09-12T17:34:00.037+0000 7fd9a6b82640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:34:00.618 INFO:tasks.workunit.client.0.smithi037.stderr: -381> 2024-09-12T17:34:00.037+0000 7fd9a6b82640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:34:00.618 INFO:tasks.workunit.client.0.smithi037.stderr: -380> 2024-09-12T17:34:00.037+0000 7fd9a6b82640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:34:00.618 INFO:tasks.workunit.client.0.smithi037.stderr: -379> 2024-09-12T17:34:00.037+0000 7fd9a6381640 10 monclient(hunting): get_auth_request con 0x56055b1bc7b0 auth_method 0 2024-09-12T17:34:00.618 INFO:tasks.workunit.client.0.smithi037.stderr: -378> 2024-09-12T17:34:00.037+0000 7fd9a6381640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:34:00.619 INFO:tasks.workunit.client.0.smithi037.stderr: -377> 2024-09-12T17:34:00.037+0000 7fd9a6381640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:34:00.619 INFO:tasks.workunit.client.0.smithi037.stderr: -376> 2024-09-12T17:34:00.037+0000 7fd9a6381640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:34:00.619 INFO:tasks.workunit.client.0.smithi037.stderr: -375> 2024-09-12T17:34:00.037+0000 7fd9a7383640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:34:00.619 INFO:tasks.workunit.client.0.smithi037.stderr: -374> 2024-09-12T17:34:00.037+0000 7fd9a7383640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:34:00.619 INFO:tasks.workunit.client.0.smithi037.stderr: -373> 2024-09-12T17:34:00.037+0000 7fd9a7383640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:34:00.619 INFO:tasks.workunit.client.0.smithi037.stderr: -372> 2024-09-12T17:34:00.037+0000 7fd9a6b82640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:34:00.619 INFO:tasks.workunit.client.0.smithi037.stderr: -371> 2024-09-12T17:34:00.037+0000 7fd9a6b82640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:34:00.619 INFO:tasks.workunit.client.0.smithi037.stderr: -370> 2024-09-12T17:34:00.037+0000 7fd9a6b82640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:34:00.619 INFO:tasks.workunit.client.0.smithi037.stderr: -369> 2024-09-12T17:34:00.037+0000 7fd9a6381640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:34:00.619 INFO:tasks.workunit.client.0.smithi037.stderr: -368> 2024-09-12T17:34:00.037+0000 7fd9a6381640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:34:00.619 INFO:tasks.workunit.client.0.smithi037.stderr: -367> 2024-09-12T17:34:00.037+0000 7fd9a6381640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:34:00.620 INFO:tasks.workunit.client.0.smithi037.stderr: -366> 2024-09-12T17:34:00.037+0000 7fd9a7383640 10 monclient(hunting): handle_auth_done global_id 7125 payload 824 2024-09-12T17:34:00.620 INFO:tasks.workunit.client.0.smithi037.stderr: -365> 2024-09-12T17:34:00.037+0000 7fd9a7383640 10 monclient: _finish_hunting 0 2024-09-12T17:34:00.620 INFO:tasks.workunit.client.0.smithi037.stderr: -364> 2024-09-12T17:34:00.037+0000 7fd9a7383640 1 monclient: found mon.noname-a 2024-09-12T17:34:00.620 INFO:tasks.workunit.client.0.smithi037.stderr: -363> 2024-09-12T17:34:00.037+0000 7fd9a7383640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.37:3300/0 2024-09-12T17:34:00.620 INFO:tasks.workunit.client.0.smithi037.stderr: -362> 2024-09-12T17:34:00.038+0000 7fd890e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:34:00.620 INFO:tasks.workunit.client.0.smithi037.stderr: -361> 2024-09-12T17:34:00.038+0000 7fd890e01640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:34:00.620 INFO:tasks.workunit.client.0.smithi037.stderr: -360> 2024-09-12T17:34:00.038+0000 7fd890e01640 10 monclient: dump: 2024-09-12T17:34:00.620 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:34:00.620 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:34:00.620 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:34:00.621 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:34:00.621 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:34:00.621 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:34:00.621 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:34:00.621 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:34:00.621 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:34:00.621 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:34:00.621 INFO:tasks.workunit.client.0.smithi037.stderr: -359> 2024-09-12T17:34:00.038+0000 7fd890e01640 10 monclient: _finish_auth 0 2024-09-12T17:34:00.621 INFO:tasks.workunit.client.0.smithi037.stderr: -358> 2024-09-12T17:34:00.038+0000 7fd890e01640 10 monclient: _check_auth_tickets 2024-09-12T17:34:00.621 INFO:tasks.workunit.client.0.smithi037.stderr: -357> 2024-09-12T17:34:00.038+0000 7fd890e01640 10 monclient: handle_config config(0 keys) 2024-09-12T17:34:00.621 INFO:tasks.workunit.client.0.smithi037.stderr: -356> 2024-09-12T17:34:00.038+0000 7fd890e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:34:00.622 INFO:tasks.workunit.client.0.smithi037.stderr: -355> 2024-09-12T17:34:00.038+0000 7fd890e01640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:34:00.622 INFO:tasks.workunit.client.0.smithi037.stderr: -354> 2024-09-12T17:34:00.038+0000 7fd890e01640 10 monclient: dump: 2024-09-12T17:34:00.622 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:34:00.622 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:34:00.622 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:34:00.622 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:34:00.622 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:34:00.622 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:34:00.622 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:34:00.622 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:34:00.622 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:34:00.622 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:34:00.622 INFO:tasks.workunit.client.0.smithi037.stderr: -353> 2024-09-12T17:34:00.038+0000 7fd9a9098800 5 monclient: authenticate success, global_id 7125 2024-09-12T17:34:00.623 INFO:tasks.workunit.client.0.smithi037.stderr: -352> 2024-09-12T17:34:00.038+0000 7fd9a9098800 10 monclient: _renew_subs 2024-09-12T17:34:00.623 INFO:tasks.workunit.client.0.smithi037.stderr: -351> 2024-09-12T17:34:00.038+0000 7fd9a7b84640 4 set_mon_vals no callback set 2024-09-12T17:34:00.623 INFO:tasks.workunit.client.0.smithi037.stderr: -350> 2024-09-12T17:34:00.038+0000 7fd9a9098800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.37:3300/0 2024-09-12T17:34:00.623 INFO:tasks.workunit.client.0.smithi037.stderr: -349> 2024-09-12T17:34:00.038+0000 7fd9a9098800 10 monclient: _renew_subs 2024-09-12T17:34:00.623 INFO:tasks.workunit.client.0.smithi037.stderr: -348> 2024-09-12T17:34:00.038+0000 7fd9a9098800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.37:3300/0 2024-09-12T17:34:00.623 INFO:tasks.workunit.client.0.smithi037.stderr: -347> 2024-09-12T17:34:00.040+0000 7fd890e01640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:34:00.623 INFO:tasks.workunit.client.0.smithi037.stderr: -346> 2024-09-12T17:34:00.040+0000 7fd890e01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.40:6816/3916250676,v1:172.21.15.40:6817/3916250676] 2024-09-12T17:34:00.623 INFO:tasks.workunit.client.0.smithi037.stderr: -345> 2024-09-12T17:34:00.040+0000 7fd890e01640 4 mgrc reconnect Starting new session with [v2:172.21.15.40:6816/3916250676,v1:172.21.15.40:6817/3916250676] 2024-09-12T17:34:00.623 INFO:tasks.workunit.client.0.smithi037.stderr: -344> 2024-09-12T17:34:00.040+0000 7fd9a6b82640 10 monclient: get_auth_request con 0x7fd880076380 auth_method 0 2024-09-12T17:34:00.623 INFO:tasks.workunit.client.0.smithi037.stderr: -343> 2024-09-12T17:34:00.040+0000 7fd9a9098800 10 monclient: get_monmap_and_config 2024-09-12T17:34:00.624 INFO:tasks.workunit.client.0.smithi037.stderr: -342> 2024-09-12T17:34:00.040+0000 7fd9a9098800 10 monclient: build_initial_monmap 2024-09-12T17:34:00.624 INFO:tasks.workunit.client.0.smithi037.stderr: -341> 2024-09-12T17:34:00.040+0000 7fd9a9098800 1 build_initial for_mkfs: 0 2024-09-12T17:34:00.624 INFO:tasks.workunit.client.0.smithi037.stderr: -340> 2024-09-12T17:34:00.040+0000 7fd9a9098800 10 monclient: monmap: 2024-09-12T17:34:00.624 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 0 2024-09-12T17:34:00.624 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:34:00.624 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 0.000000 2024-09-12T17:34:00.624 INFO:tasks.workunit.client.0.smithi037.stderr:created 0.000000 2024-09-12T17:34:00.624 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 0 (unknown) 2024-09-12T17:34:00.624 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:34:00.624 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.noname-a 2024-09-12T17:34:00.625 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.noname-b 2024-09-12T17:34:00.625 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.noname-c 2024-09-12T17:34:00.625 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:34:00.625 INFO:tasks.workunit.client.0.smithi037.stderr: -339> 2024-09-12T17:34:00.040+0000 7fd9a9098800 5 AuthRegistry(0x56055b1dd5a0) adding auth protocol: cephx 2024-09-12T17:34:00.625 INFO:tasks.workunit.client.0.smithi037.stderr: -338> 2024-09-12T17:34:00.040+0000 7fd9a9098800 5 AuthRegistry(0x56055b1dd5a0) adding auth protocol: cephx 2024-09-12T17:34:00.625 INFO:tasks.workunit.client.0.smithi037.stderr: -337> 2024-09-12T17:34:00.040+0000 7fd9a9098800 5 AuthRegistry(0x56055b1dd5a0) adding auth protocol: cephx 2024-09-12T17:34:00.625 INFO:tasks.workunit.client.0.smithi037.stderr: -336> 2024-09-12T17:34:00.040+0000 7fd9a9098800 5 AuthRegistry(0x56055b1dd5a0) adding con mode: secure 2024-09-12T17:34:00.625 INFO:tasks.workunit.client.0.smithi037.stderr: -335> 2024-09-12T17:34:00.040+0000 7fd9a9098800 5 AuthRegistry(0x56055b1dd5a0) adding con mode: crc 2024-09-12T17:34:00.626 INFO:tasks.workunit.client.0.smithi037.stderr: -334> 2024-09-12T17:34:00.040+0000 7fd9a9098800 5 AuthRegistry(0x56055b1dd5a0) adding con mode: secure 2024-09-12T17:34:00.626 INFO:tasks.workunit.client.0.smithi037.stderr: -333> 2024-09-12T17:34:00.040+0000 7fd9a9098800 5 AuthRegistry(0x56055b1dd5a0) adding con mode: crc 2024-09-12T17:34:00.626 INFO:tasks.workunit.client.0.smithi037.stderr: -332> 2024-09-12T17:34:00.040+0000 7fd9a9098800 5 AuthRegistry(0x56055b1dd5a0) adding con mode: secure 2024-09-12T17:34:00.626 INFO:tasks.workunit.client.0.smithi037.stderr: -331> 2024-09-12T17:34:00.040+0000 7fd9a9098800 5 AuthRegistry(0x56055b1dd5a0) adding con mode: crc 2024-09-12T17:34:00.626 INFO:tasks.workunit.client.0.smithi037.stderr: -330> 2024-09-12T17:34:00.040+0000 7fd9a9098800 5 AuthRegistry(0x56055b1dd5a0) adding con mode: crc 2024-09-12T17:34:00.626 INFO:tasks.workunit.client.0.smithi037.stderr: -329> 2024-09-12T17:34:00.040+0000 7fd9a9098800 5 AuthRegistry(0x56055b1dd5a0) adding con mode: secure 2024-09-12T17:34:00.626 INFO:tasks.workunit.client.0.smithi037.stderr: -328> 2024-09-12T17:34:00.040+0000 7fd9a9098800 5 AuthRegistry(0x56055b1dd5a0) adding con mode: crc 2024-09-12T17:34:00.626 INFO:tasks.workunit.client.0.smithi037.stderr: -327> 2024-09-12T17:34:00.040+0000 7fd9a9098800 5 AuthRegistry(0x56055b1dd5a0) adding con mode: secure 2024-09-12T17:34:00.626 INFO:tasks.workunit.client.0.smithi037.stderr: -326> 2024-09-12T17:34:00.040+0000 7fd9a9098800 5 AuthRegistry(0x56055b1dd5a0) adding con mode: crc 2024-09-12T17:34:00.626 INFO:tasks.workunit.client.0.smithi037.stderr: -325> 2024-09-12T17:34:00.040+0000 7fd9a9098800 5 AuthRegistry(0x56055b1dd5a0) adding con mode: secure 2024-09-12T17:34:00.626 INFO:tasks.workunit.client.0.smithi037.stderr: -324> 2024-09-12T17:34:00.040+0000 7fd9a9098800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:34:00.626 INFO:tasks.workunit.client.0.smithi037.stderr: -323> 2024-09-12T17:34:00.041+0000 7fd9a9098800 10 monclient: init 2024-09-12T17:34:00.626 INFO:tasks.workunit.client.0.smithi037.stderr: -322> 2024-09-12T17:34:00.041+0000 7fd9a9098800 5 AuthRegistry(0x7fff09a1ea10) adding auth protocol: cephx 2024-09-12T17:34:00.626 INFO:tasks.workunit.client.0.smithi037.stderr: -321> 2024-09-12T17:34:00.041+0000 7fd9a9098800 5 AuthRegistry(0x7fff09a1ea10) adding auth protocol: cephx 2024-09-12T17:34:00.627 INFO:tasks.workunit.client.0.smithi037.stderr: -320> 2024-09-12T17:34:00.041+0000 7fd9a9098800 5 AuthRegistry(0x7fff09a1ea10) adding auth protocol: cephx 2024-09-12T17:34:00.627 INFO:tasks.workunit.client.0.smithi037.stderr: -319> 2024-09-12T17:34:00.041+0000 7fd9a9098800 5 AuthRegistry(0x7fff09a1ea10) adding con mode: secure 2024-09-12T17:34:00.627 INFO:tasks.workunit.client.0.smithi037.stderr: -318> 2024-09-12T17:34:00.041+0000 7fd9a9098800 5 AuthRegistry(0x7fff09a1ea10) adding con mode: crc 2024-09-12T17:34:00.627 INFO:tasks.workunit.client.0.smithi037.stderr: -317> 2024-09-12T17:34:00.041+0000 7fd9a9098800 5 AuthRegistry(0x7fff09a1ea10) adding con mode: secure 2024-09-12T17:34:00.627 INFO:tasks.workunit.client.0.smithi037.stderr: -316> 2024-09-12T17:34:00.041+0000 7fd9a9098800 5 AuthRegistry(0x7fff09a1ea10) adding con mode: crc 2024-09-12T17:34:00.628 INFO:tasks.workunit.client.0.smithi037.stderr: -315> 2024-09-12T17:34:00.041+0000 7fd9a9098800 5 AuthRegistry(0x7fff09a1ea10) adding con mode: secure 2024-09-12T17:34:00.628 INFO:tasks.workunit.client.0.smithi037.stderr: -314> 2024-09-12T17:34:00.041+0000 7fd9a9098800 5 AuthRegistry(0x7fff09a1ea10) adding con mode: crc 2024-09-12T17:34:00.628 INFO:tasks.workunit.client.0.smithi037.stderr: -313> 2024-09-12T17:34:00.041+0000 7fd9a9098800 5 AuthRegistry(0x7fff09a1ea10) adding con mode: crc 2024-09-12T17:34:00.628 INFO:tasks.workunit.client.0.smithi037.stderr: -312> 2024-09-12T17:34:00.041+0000 7fd9a9098800 5 AuthRegistry(0x7fff09a1ea10) adding con mode: secure 2024-09-12T17:34:00.628 INFO:tasks.workunit.client.0.smithi037.stderr: -311> 2024-09-12T17:34:00.041+0000 7fd9a9098800 5 AuthRegistry(0x7fff09a1ea10) adding con mode: crc 2024-09-12T17:34:00.628 INFO:tasks.workunit.client.0.smithi037.stderr: -310> 2024-09-12T17:34:00.041+0000 7fd9a9098800 5 AuthRegistry(0x7fff09a1ea10) adding con mode: secure 2024-09-12T17:34:00.628 INFO:tasks.workunit.client.0.smithi037.stderr: -309> 2024-09-12T17:34:00.041+0000 7fd9a9098800 5 AuthRegistry(0x7fff09a1ea10) adding con mode: crc 2024-09-12T17:34:00.628 INFO:tasks.workunit.client.0.smithi037.stderr: -308> 2024-09-12T17:34:00.041+0000 7fd9a9098800 5 AuthRegistry(0x7fff09a1ea10) adding con mode: secure 2024-09-12T17:34:00.628 INFO:tasks.workunit.client.0.smithi037.stderr: -307> 2024-09-12T17:34:00.041+0000 7fd9a9098800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:34:00.628 INFO:tasks.workunit.client.0.smithi037.stderr: -306> 2024-09-12T17:34:00.041+0000 7fd9a9098800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:34:00.628 INFO:tasks.workunit.client.0.smithi037.stderr: -305> 2024-09-12T17:34:00.041+0000 7fd9a9098800 5 asok(0x56055af1f730) register_command rotate-key cmddesc rotate-key hook 0x7fff09a1eb58 EEXIST 2024-09-12T17:34:00.628 INFO:tasks.workunit.client.0.smithi037.stderr: -304> 2024-09-12T17:34:00.041+0000 7fd9a9098800 10 monclient: _reopen_session rank -1 2024-09-12T17:34:00.629 INFO:tasks.workunit.client.0.smithi037.stderr: -303> 2024-09-12T17:34:00.041+0000 7fd9a9098800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T17:34:00.629 INFO:tasks.workunit.client.0.smithi037.stderr: -302> 2024-09-12T17:34:00.041+0000 7fd9a9098800 10 monclient(hunting): picked mon.noname-a con 0x56055b211a80 addr [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] 2024-09-12T17:34:00.629 INFO:tasks.workunit.client.0.smithi037.stderr: -301> 2024-09-12T17:34:00.041+0000 7fd9a9098800 10 monclient(hunting): picked mon.noname-c con 0x56055b20c0a0 addr [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] 2024-09-12T17:34:00.629 INFO:tasks.workunit.client.0.smithi037.stderr: -300> 2024-09-12T17:34:00.041+0000 7fd9a9098800 10 monclient(hunting): picked mon.noname-b con 0x56055b20d450 addr [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] 2024-09-12T17:34:00.629 INFO:tasks.workunit.client.0.smithi037.stderr: -299> 2024-09-12T17:34:00.041+0000 7fd9a9098800 10 monclient(hunting): start opening mon connection 2024-09-12T17:34:00.629 INFO:tasks.workunit.client.0.smithi037.stderr: -298> 2024-09-12T17:34:00.041+0000 7fd9a9098800 10 monclient(hunting): start opening mon connection 2024-09-12T17:34:00.629 INFO:tasks.workunit.client.0.smithi037.stderr: -297> 2024-09-12T17:34:00.041+0000 7fd9a9098800 10 monclient(hunting): start opening mon connection 2024-09-12T17:34:00.629 INFO:tasks.workunit.client.0.smithi037.stderr: -296> 2024-09-12T17:34:00.041+0000 7fd9a9098800 10 monclient(hunting): _renew_subs 2024-09-12T17:34:00.629 INFO:tasks.workunit.client.0.smithi037.stderr: -295> 2024-09-12T17:34:00.041+0000 7fd9a9098800 10 monclient(hunting): authenticate will time out at 2227.638614s 2024-09-12T17:34:00.629 INFO:tasks.workunit.client.0.smithi037.stderr: -294> 2024-09-12T17:34:00.041+0000 7fd9a6381640 10 monclient(hunting): get_auth_request con 0x56055b20c0a0 auth_method 0 2024-09-12T17:34:00.629 INFO:tasks.workunit.client.0.smithi037.stderr: -293> 2024-09-12T17:34:00.041+0000 7fd9a6381640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:34:00.629 INFO:tasks.workunit.client.0.smithi037.stderr: -292> 2024-09-12T17:34:00.041+0000 7fd9a6381640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:34:00.630 INFO:tasks.workunit.client.0.smithi037.stderr: -291> 2024-09-12T17:34:00.041+0000 7fd9a6381640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:34:00.630 INFO:tasks.workunit.client.0.smithi037.stderr: -290> 2024-09-12T17:34:00.041+0000 7fd9a6b82640 10 monclient(hunting): get_auth_request con 0x56055b211a80 auth_method 0 2024-09-12T17:34:00.630 INFO:tasks.workunit.client.0.smithi037.stderr: -289> 2024-09-12T17:34:00.041+0000 7fd9a6b82640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:34:00.630 INFO:tasks.workunit.client.0.smithi037.stderr: -288> 2024-09-12T17:34:00.041+0000 7fd9a6b82640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:34:00.630 INFO:tasks.workunit.client.0.smithi037.stderr: -287> 2024-09-12T17:34:00.041+0000 7fd9a6b82640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:34:00.630 INFO:tasks.workunit.client.0.smithi037.stderr: -286> 2024-09-12T17:34:00.041+0000 7fd9a6381640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:34:00.630 INFO:tasks.workunit.client.0.smithi037.stderr: -285> 2024-09-12T17:34:00.041+0000 7fd9a6381640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:34:00.630 INFO:tasks.workunit.client.0.smithi037.stderr: -284> 2024-09-12T17:34:00.041+0000 7fd9a6381640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:34:00.630 INFO:tasks.workunit.client.0.smithi037.stderr: -283> 2024-09-12T17:34:00.041+0000 7fd9a6b82640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:34:00.630 INFO:tasks.workunit.client.0.smithi037.stderr: -282> 2024-09-12T17:34:00.041+0000 7fd9a6b82640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:34:00.630 INFO:tasks.workunit.client.0.smithi037.stderr: -281> 2024-09-12T17:34:00.041+0000 7fd9a6b82640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:34:00.630 INFO:tasks.workunit.client.0.smithi037.stderr: -280> 2024-09-12T17:34:00.041+0000 7fd9a7383640 10 monclient(hunting): get_auth_request con 0x56055b20d450 auth_method 0 2024-09-12T17:34:00.630 INFO:tasks.workunit.client.0.smithi037.stderr: -279> 2024-09-12T17:34:00.041+0000 7fd9a7383640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:34:00.630 INFO:tasks.workunit.client.0.smithi037.stderr: -278> 2024-09-12T17:34:00.041+0000 7fd9a7383640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:34:00.631 INFO:tasks.workunit.client.0.smithi037.stderr: -277> 2024-09-12T17:34:00.041+0000 7fd9a7383640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:34:00.631 INFO:tasks.workunit.client.0.smithi037.stderr: -276> 2024-09-12T17:34:00.041+0000 7fd9a6381640 10 monclient(hunting): handle_auth_done global_id 6680 payload 274 2024-09-12T17:34:00.631 INFO:tasks.workunit.client.0.smithi037.stderr: -275> 2024-09-12T17:34:00.041+0000 7fd9a6381640 10 monclient: _finish_hunting 0 2024-09-12T17:34:00.631 INFO:tasks.workunit.client.0.smithi037.stderr: -274> 2024-09-12T17:34:00.041+0000 7fd9a6381640 1 monclient: found mon.noname-c 2024-09-12T17:34:00.631 INFO:tasks.workunit.client.0.smithi037.stderr: -273> 2024-09-12T17:34:00.041+0000 7fd9a6381640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.37:3301/0 2024-09-12T17:34:00.631 INFO:tasks.workunit.client.0.smithi037.stderr: -272> 2024-09-12T17:34:00.042+0000 7fd88a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:34:00.631 INFO:tasks.workunit.client.0.smithi037.stderr: -271> 2024-09-12T17:34:00.042+0000 7fd88a7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:34:00.631 INFO:tasks.workunit.client.0.smithi037.stderr: -270> 2024-09-12T17:34:00.042+0000 7fd88a7fc640 10 monclient: dump: 2024-09-12T17:34:00.631 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:34:00.631 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:34:00.631 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:34:00.632 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:34:00.632 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:34:00.632 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:34:00.632 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:34:00.632 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:34:00.632 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:34:00.632 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:34:00.632 INFO:tasks.workunit.client.0.smithi037.stderr: -269> 2024-09-12T17:34:00.042+0000 7fd88a7fc640 10 monclient: _finish_auth 0 2024-09-12T17:34:00.632 INFO:tasks.workunit.client.0.smithi037.stderr: -268> 2024-09-12T17:34:00.042+0000 7fd88a7fc640 10 monclient: _check_auth_tickets 2024-09-12T17:34:00.632 INFO:tasks.workunit.client.0.smithi037.stderr: -267> 2024-09-12T17:34:00.042+0000 7fd88a7fc640 10 monclient: handle_config config(0 keys) 2024-09-12T17:34:00.632 INFO:tasks.workunit.client.0.smithi037.stderr: -266> 2024-09-12T17:34:00.042+0000 7fd88a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:34:00.633 INFO:tasks.workunit.client.0.smithi037.stderr: -265> 2024-09-12T17:34:00.042+0000 7fd88a7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:34:00.633 INFO:tasks.workunit.client.0.smithi037.stderr: -264> 2024-09-12T17:34:00.042+0000 7fd88a7fc640 10 monclient: dump: 2024-09-12T17:34:00.633 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:34:00.633 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:34:00.633 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:34:00.633 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:34:00.633 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:34:00.633 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:34:00.633 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:34:00.633 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:34:00.633 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:34:00.633 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:34:00.634 INFO:tasks.workunit.client.0.smithi037.stderr: -263> 2024-09-12T17:34:00.042+0000 7fd9a9098800 5 monclient: authenticate success, global_id 6680 2024-09-12T17:34:00.634 INFO:tasks.workunit.client.0.smithi037.stderr: -262> 2024-09-12T17:34:00.042+0000 7fd9a9098800 10 monclient: get_monmap_and_config success 2024-09-12T17:34:00.634 INFO:tasks.workunit.client.0.smithi037.stderr: -261> 2024-09-12T17:34:00.042+0000 7fd9a9098800 4 set_mon_vals no callback set 2024-09-12T17:34:00.634 INFO:tasks.workunit.client.0.smithi037.stderr: -260> 2024-09-12T17:34:00.042+0000 7fd9a9098800 10 monclient: shutdown 2024-09-12T17:34:00.634 INFO:tasks.workunit.client.0.smithi037.stderr: -259> 2024-09-12T17:34:00.043+0000 7fd9a9098800 10 monclient: build_initial_monmap 2024-09-12T17:34:00.634 INFO:tasks.workunit.client.0.smithi037.stderr: -258> 2024-09-12T17:34:00.043+0000 7fd9a9098800 1 build_initial for_mkfs: 0 2024-09-12T17:34:00.634 INFO:tasks.workunit.client.0.smithi037.stderr: -257> 2024-09-12T17:34:00.043+0000 7fd9a9098800 10 monclient: monmap: 2024-09-12T17:34:00.634 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 0 2024-09-12T17:34:00.634 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:34:00.634 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 0.000000 2024-09-12T17:34:00.634 INFO:tasks.workunit.client.0.smithi037.stderr:created 0.000000 2024-09-12T17:34:00.634 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 0 (unknown) 2024-09-12T17:34:00.634 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:34:00.635 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.noname-a 2024-09-12T17:34:00.635 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.noname-b 2024-09-12T17:34:00.635 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.noname-c 2024-09-12T17:34:00.635 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:34:00.635 INFO:tasks.workunit.client.0.smithi037.stderr: -256> 2024-09-12T17:34:00.043+0000 7fd9a9098800 5 AuthRegistry(0x56055b202250) adding auth protocol: cephx 2024-09-12T17:34:00.635 INFO:tasks.workunit.client.0.smithi037.stderr: -255> 2024-09-12T17:34:00.043+0000 7fd9a9098800 5 AuthRegistry(0x56055b202250) adding auth protocol: cephx 2024-09-12T17:34:00.635 INFO:tasks.workunit.client.0.smithi037.stderr: -254> 2024-09-12T17:34:00.043+0000 7fd9a9098800 5 AuthRegistry(0x56055b202250) adding auth protocol: cephx 2024-09-12T17:34:00.635 INFO:tasks.workunit.client.0.smithi037.stderr: -253> 2024-09-12T17:34:00.043+0000 7fd9a9098800 5 AuthRegistry(0x56055b202250) adding con mode: secure 2024-09-12T17:34:00.635 INFO:tasks.workunit.client.0.smithi037.stderr: -252> 2024-09-12T17:34:00.043+0000 7fd9a9098800 5 AuthRegistry(0x56055b202250) adding con mode: crc 2024-09-12T17:34:00.635 INFO:tasks.workunit.client.0.smithi037.stderr: -251> 2024-09-12T17:34:00.043+0000 7fd9a9098800 5 AuthRegistry(0x56055b202250) adding con mode: secure 2024-09-12T17:34:00.635 INFO:tasks.workunit.client.0.smithi037.stderr: -250> 2024-09-12T17:34:00.043+0000 7fd9a9098800 5 AuthRegistry(0x56055b202250) adding con mode: crc 2024-09-12T17:34:00.635 INFO:tasks.workunit.client.0.smithi037.stderr: -249> 2024-09-12T17:34:00.043+0000 7fd9a9098800 5 AuthRegistry(0x56055b202250) adding con mode: secure 2024-09-12T17:34:00.635 INFO:tasks.workunit.client.0.smithi037.stderr: -248> 2024-09-12T17:34:00.043+0000 7fd9a9098800 5 AuthRegistry(0x56055b202250) adding con mode: crc 2024-09-12T17:34:00.635 INFO:tasks.workunit.client.0.smithi037.stderr: -247> 2024-09-12T17:34:00.043+0000 7fd9a9098800 5 AuthRegistry(0x56055b202250) adding con mode: crc 2024-09-12T17:34:00.636 INFO:tasks.workunit.client.0.smithi037.stderr: -246> 2024-09-12T17:34:00.043+0000 7fd9a9098800 5 AuthRegistry(0x56055b202250) adding con mode: secure 2024-09-12T17:34:00.636 INFO:tasks.workunit.client.0.smithi037.stderr: -245> 2024-09-12T17:34:00.043+0000 7fd9a9098800 5 AuthRegistry(0x56055b202250) adding con mode: crc 2024-09-12T17:34:00.636 INFO:tasks.workunit.client.0.smithi037.stderr: -244> 2024-09-12T17:34:00.043+0000 7fd9a9098800 5 AuthRegistry(0x56055b202250) adding con mode: secure 2024-09-12T17:34:00.636 INFO:tasks.workunit.client.0.smithi037.stderr: -243> 2024-09-12T17:34:00.043+0000 7fd9a9098800 5 AuthRegistry(0x56055b202250) adding con mode: crc 2024-09-12T17:34:00.636 INFO:tasks.workunit.client.0.smithi037.stderr: -242> 2024-09-12T17:34:00.043+0000 7fd9a9098800 5 AuthRegistry(0x56055b202250) adding con mode: secure 2024-09-12T17:34:00.636 INFO:tasks.workunit.client.0.smithi037.stderr: -241> 2024-09-12T17:34:00.043+0000 7fd9a9098800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:34:00.636 INFO:tasks.workunit.client.0.smithi037.stderr: -240> 2024-09-12T17:34:00.043+0000 7fd9a9098800 1 librados: starting msgr at 2024-09-12T17:34:00.636 INFO:tasks.workunit.client.0.smithi037.stderr: -239> 2024-09-12T17:34:00.043+0000 7fd9a9098800 1 librados: starting objecter 2024-09-12T17:34:00.636 INFO:tasks.workunit.client.0.smithi037.stderr: -238> 2024-09-12T17:34:00.043+0000 7fd9a9098800 5 asok(0x56055af1f730) register_command objecter_requests cmddesc objecter_requests hook 0x56055b1bf3d0 EEXIST 2024-09-12T17:34:00.636 INFO:tasks.workunit.client.0.smithi037.stderr: -237> 2024-09-12T17:34:00.043+0000 7fd9a9098800 1 librados: setting wanted keys 2024-09-12T17:34:00.637 INFO:tasks.workunit.client.0.smithi037.stderr: -236> 2024-09-12T17:34:00.043+0000 7fd9a9098800 1 librados: calling monclient init 2024-09-12T17:34:00.637 INFO:tasks.workunit.client.0.smithi037.stderr: -235> 2024-09-12T17:34:00.043+0000 7fd9a9098800 10 monclient: init 2024-09-12T17:34:00.637 INFO:tasks.workunit.client.0.smithi037.stderr: -234> 2024-09-12T17:34:00.043+0000 7fd9a9098800 5 AuthRegistry(0x56055b1dc790) adding auth protocol: cephx 2024-09-12T17:34:00.638 INFO:tasks.workunit.client.0.smithi037.stderr: -233> 2024-09-12T17:34:00.043+0000 7fd9a9098800 5 AuthRegistry(0x56055b1dc790) adding auth protocol: cephx 2024-09-12T17:34:00.638 INFO:tasks.workunit.client.0.smithi037.stderr: -232> 2024-09-12T17:34:00.043+0000 7fd9a9098800 5 AuthRegistry(0x56055b1dc790) adding auth protocol: cephx 2024-09-12T17:34:00.638 INFO:tasks.workunit.client.0.smithi037.stderr: -231> 2024-09-12T17:34:00.043+0000 7fd9a9098800 5 AuthRegistry(0x56055b1dc790) adding con mode: secure 2024-09-12T17:34:00.638 INFO:tasks.workunit.client.0.smithi037.stderr: -230> 2024-09-12T17:34:00.043+0000 7fd9a9098800 5 AuthRegistry(0x56055b1dc790) adding con mode: crc 2024-09-12T17:34:00.638 INFO:tasks.workunit.client.0.smithi037.stderr: -229> 2024-09-12T17:34:00.043+0000 7fd9a9098800 5 AuthRegistry(0x56055b1dc790) adding con mode: secure 2024-09-12T17:34:00.638 INFO:tasks.workunit.client.0.smithi037.stderr: -228> 2024-09-12T17:34:00.043+0000 7fd9a9098800 5 AuthRegistry(0x56055b1dc790) adding con mode: crc 2024-09-12T17:34:00.638 INFO:tasks.workunit.client.0.smithi037.stderr: -227> 2024-09-12T17:34:00.043+0000 7fd9a9098800 5 AuthRegistry(0x56055b1dc790) adding con mode: secure 2024-09-12T17:34:00.639 INFO:tasks.workunit.client.0.smithi037.stderr: -226> 2024-09-12T17:34:00.043+0000 7fd9a9098800 5 AuthRegistry(0x56055b1dc790) adding con mode: crc 2024-09-12T17:34:00.639 INFO:tasks.workunit.client.0.smithi037.stderr: -225> 2024-09-12T17:34:00.043+0000 7fd9a9098800 5 AuthRegistry(0x56055b1dc790) adding con mode: crc 2024-09-12T17:34:00.639 INFO:tasks.workunit.client.0.smithi037.stderr: -224> 2024-09-12T17:34:00.043+0000 7fd9a9098800 5 AuthRegistry(0x56055b1dc790) adding con mode: secure 2024-09-12T17:34:00.639 INFO:tasks.workunit.client.0.smithi037.stderr: -223> 2024-09-12T17:34:00.043+0000 7fd9a9098800 5 AuthRegistry(0x56055b1dc790) adding con mode: crc 2024-09-12T17:34:00.639 INFO:tasks.workunit.client.0.smithi037.stderr: -222> 2024-09-12T17:34:00.043+0000 7fd9a9098800 5 AuthRegistry(0x56055b1dc790) adding con mode: secure 2024-09-12T17:34:00.639 INFO:tasks.workunit.client.0.smithi037.stderr: -221> 2024-09-12T17:34:00.043+0000 7fd9a9098800 5 AuthRegistry(0x56055b1dc790) adding con mode: crc 2024-09-12T17:34:00.640 INFO:tasks.workunit.client.0.smithi037.stderr: -220> 2024-09-12T17:34:00.043+0000 7fd9a9098800 5 AuthRegistry(0x56055b1dc790) adding con mode: secure 2024-09-12T17:34:00.640 INFO:tasks.workunit.client.0.smithi037.stderr: -219> 2024-09-12T17:34:00.043+0000 7fd9a9098800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:34:00.640 INFO:tasks.workunit.client.0.smithi037.stderr: -218> 2024-09-12T17:34:00.043+0000 7fd9a9098800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:34:00.640 INFO:tasks.workunit.client.0.smithi037.stderr: -217> 2024-09-12T17:34:00.043+0000 7fd9a9098800 5 asok(0x56055af1f730) register_command rotate-key cmddesc rotate-key hook 0x56055b1dc8d8 EEXIST 2024-09-12T17:34:00.640 INFO:tasks.workunit.client.0.smithi037.stderr: -216> 2024-09-12T17:34:00.044+0000 7fd9a9098800 10 monclient: _reopen_session rank -1 2024-09-12T17:34:00.640 INFO:tasks.workunit.client.0.smithi037.stderr: -215> 2024-09-12T17:34:00.044+0000 7fd9a9098800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T17:34:00.641 INFO:tasks.workunit.client.0.smithi037.stderr: -214> 2024-09-12T17:34:00.044+0000 7fd9a9098800 10 monclient(hunting): picked mon.noname-c con 0x56055b20d450 addr [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] 2024-09-12T17:34:00.641 INFO:tasks.workunit.client.0.smithi037.stderr: -213> 2024-09-12T17:34:00.044+0000 7fd9a9098800 10 monclient(hunting): picked mon.noname-b con 0x56055b211a80 addr [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] 2024-09-12T17:34:00.641 INFO:tasks.workunit.client.0.smithi037.stderr: -212> 2024-09-12T17:34:00.044+0000 7fd9a9098800 10 monclient(hunting): picked mon.noname-a con 0x56055b21c160 addr [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] 2024-09-12T17:34:00.641 INFO:tasks.workunit.client.0.smithi037.stderr: -211> 2024-09-12T17:34:00.044+0000 7fd9a9098800 10 monclient(hunting): start opening mon connection 2024-09-12T17:34:00.641 INFO:tasks.workunit.client.0.smithi037.stderr: -210> 2024-09-12T17:34:00.044+0000 7fd9a9098800 10 monclient(hunting): start opening mon connection 2024-09-12T17:34:00.641 INFO:tasks.workunit.client.0.smithi037.stderr: -209> 2024-09-12T17:34:00.044+0000 7fd9a9098800 10 monclient(hunting): start opening mon connection 2024-09-12T17:34:00.642 INFO:tasks.workunit.client.0.smithi037.stderr: -208> 2024-09-12T17:34:00.044+0000 7fd9a9098800 10 monclient(hunting): _renew_subs 2024-09-12T17:34:00.642 INFO:tasks.workunit.client.0.smithi037.stderr: -207> 2024-09-12T17:34:00.044+0000 7fd9a9098800 10 monclient(hunting): authenticate will time out at 2227.641077s 2024-09-12T17:34:00.642 INFO:tasks.workunit.client.0.smithi037.stderr: -206> 2024-09-12T17:34:00.044+0000 7fd9a6b82640 10 monclient(hunting): get_auth_request con 0x56055b20d450 auth_method 0 2024-09-12T17:34:00.642 INFO:tasks.workunit.client.0.smithi037.stderr: -205> 2024-09-12T17:34:00.044+0000 7fd9a6b82640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:34:00.642 INFO:tasks.workunit.client.0.smithi037.stderr: -204> 2024-09-12T17:34:00.044+0000 7fd9a6b82640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:34:00.642 INFO:tasks.workunit.client.0.smithi037.stderr: -203> 2024-09-12T17:34:00.044+0000 7fd9a6b82640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:34:00.643 INFO:tasks.workunit.client.0.smithi037.stderr: -202> 2024-09-12T17:34:00.044+0000 7fd9a7383640 10 monclient(hunting): get_auth_request con 0x56055b21c160 auth_method 0 2024-09-12T17:34:00.643 INFO:tasks.workunit.client.0.smithi037.stderr: -201> 2024-09-12T17:34:00.044+0000 7fd9a7383640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:34:00.643 INFO:tasks.workunit.client.0.smithi037.stderr: -200> 2024-09-12T17:34:00.044+0000 7fd9a7383640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:34:00.643 INFO:tasks.workunit.client.0.smithi037.stderr: -199> 2024-09-12T17:34:00.044+0000 7fd9a7383640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:34:00.643 INFO:tasks.workunit.client.0.smithi037.stderr: -198> 2024-09-12T17:34:00.044+0000 7fd9a6b82640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:34:00.643 INFO:tasks.workunit.client.0.smithi037.stderr: -197> 2024-09-12T17:34:00.044+0000 7fd9a6b82640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:34:00.643 INFO:tasks.workunit.client.0.smithi037.stderr: -196> 2024-09-12T17:34:00.044+0000 7fd9a6b82640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:34:00.644 INFO:tasks.workunit.client.0.smithi037.stderr: -195> 2024-09-12T17:34:00.044+0000 7fd9a7383640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:34:00.644 INFO:tasks.workunit.client.0.smithi037.stderr: -194> 2024-09-12T17:34:00.044+0000 7fd9a7383640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:34:00.644 INFO:tasks.workunit.client.0.smithi037.stderr: -193> 2024-09-12T17:34:00.044+0000 7fd9a7383640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:34:00.644 INFO:tasks.workunit.client.0.smithi037.stderr: -192> 2024-09-12T17:34:00.044+0000 7fd9a6b82640 10 monclient(hunting): handle_auth_done global_id 6683 payload 824 2024-09-12T17:34:00.644 INFO:tasks.workunit.client.0.smithi037.stderr: -191> 2024-09-12T17:34:00.044+0000 7fd9a6b82640 10 monclient: _finish_hunting 0 2024-09-12T17:34:00.644 INFO:tasks.workunit.client.0.smithi037.stderr: -190> 2024-09-12T17:34:00.044+0000 7fd9a6b82640 1 monclient: found mon.noname-c 2024-09-12T17:34:00.645 INFO:tasks.workunit.client.0.smithi037.stderr: -189> 2024-09-12T17:34:00.044+0000 7fd9a6b82640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.37:3301/0 2024-09-12T17:34:00.645 INFO:tasks.workunit.client.0.smithi037.stderr: -188> 2024-09-12T17:34:00.044+0000 7fd888ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:34:00.645 INFO:tasks.workunit.client.0.smithi037.stderr: -187> 2024-09-12T17:34:00.044+0000 7fd888ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:34:00.645 INFO:tasks.workunit.client.0.smithi037.stderr: -186> 2024-09-12T17:34:00.044+0000 7fd888ff9640 10 monclient: dump: 2024-09-12T17:34:00.645 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:34:00.645 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:34:00.646 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:34:00.646 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:34:00.646 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:34:00.646 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:34:00.646 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:34:00.646 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:34:00.647 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:34:00.647 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:34:00.647 INFO:tasks.workunit.client.0.smithi037.stderr: -185> 2024-09-12T17:34:00.044+0000 7fd888ff9640 10 monclient: _finish_auth 0 2024-09-12T17:34:00.648 INFO:tasks.workunit.client.0.smithi037.stderr: -184> 2024-09-12T17:34:00.044+0000 7fd888ff9640 10 monclient: _check_auth_tickets 2024-09-12T17:34:00.648 INFO:tasks.workunit.client.0.smithi037.stderr: -183> 2024-09-12T17:34:00.044+0000 7fd888ff9640 10 monclient: handle_config config(0 keys) 2024-09-12T17:34:00.648 INFO:tasks.workunit.client.0.smithi037.stderr: -182> 2024-09-12T17:34:00.044+0000 7fd888ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:34:00.648 INFO:tasks.workunit.client.0.smithi037.stderr: -181> 2024-09-12T17:34:00.044+0000 7fd888ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:34:00.648 INFO:tasks.workunit.client.0.smithi037.stderr: -180> 2024-09-12T17:34:00.044+0000 7fd888ff9640 10 monclient: dump: 2024-09-12T17:34:00.649 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:34:00.649 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:34:00.649 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:34:00.649 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:34:00.649 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:34:00.649 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:34:00.649 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:34:00.653 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:34:00.653 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:34:00.654 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:34:00.654 INFO:tasks.workunit.client.0.smithi037.stderr: -179> 2024-09-12T17:34:00.044+0000 7fd9a9098800 5 monclient: authenticate success, global_id 6683 2024-09-12T17:34:00.654 INFO:tasks.workunit.client.0.smithi037.stderr: -178> 2024-09-12T17:34:00.044+0000 7fd88a7fc640 4 set_mon_vals no callback set 2024-09-12T17:34:00.654 INFO:tasks.workunit.client.0.smithi037.stderr: -177> 2024-09-12T17:34:00.044+0000 7fd9a9098800 10 monclient: _renew_subs 2024-09-12T17:34:00.654 INFO:tasks.workunit.client.0.smithi037.stderr: -176> 2024-09-12T17:34:00.044+0000 7fd9a9098800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.37:3301/0 2024-09-12T17:34:00.655 INFO:tasks.workunit.client.0.smithi037.stderr: -175> 2024-09-12T17:34:00.044+0000 7fd9a9098800 10 monclient: _renew_subs 2024-09-12T17:34:00.655 INFO:tasks.workunit.client.0.smithi037.stderr: -174> 2024-09-12T17:34:00.044+0000 7fd9a9098800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.37:3301/0 2024-09-12T17:34:00.655 INFO:tasks.workunit.client.0.smithi037.stderr: -173> 2024-09-12T17:34:00.044+0000 7fd9a9098800 1 librados: init done 2024-09-12T17:34:00.655 INFO:tasks.workunit.client.0.smithi037.stderr: -172> 2024-09-12T17:34:00.044+0000 7fd9a9098800 5 asok(0x56055af1f730) register_command cr dump hook 0x56055b214c08 2024-09-12T17:34:00.655 INFO:tasks.workunit.client.0.smithi037.stderr: -171> 2024-09-12T17:34:00.046+0000 7fd9a9098800 20 rados->read ofs=0 len=0 2024-09-12T17:34:00.655 INFO:tasks.workunit.client.0.smithi037.stderr: -170> 2024-09-12T17:34:00.046+0000 7fd888ff9640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:34:00.655 INFO:tasks.workunit.client.0.smithi037.stderr: -169> 2024-09-12T17:34:00.046+0000 7fd888ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.40:6816/3916250676,v1:172.21.15.40:6817/3916250676] 2024-09-12T17:34:00.656 INFO:tasks.workunit.client.0.smithi037.stderr: -168> 2024-09-12T17:34:00.046+0000 7fd888ff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.40:6816/3916250676,v1:172.21.15.40:6817/3916250676] 2024-09-12T17:34:00.656 INFO:tasks.workunit.client.0.smithi037.stderr: -167> 2024-09-12T17:34:00.047+0000 7fd9a6381640 10 monclient: get_auth_request con 0x7fd870076470 auth_method 0 2024-09-12T17:34:00.656 INFO:tasks.workunit.client.0.smithi037.stderr: -166> 2024-09-12T17:34:00.047+0000 7fd9a7383640 10 monclient: get_auth_request con 0x56055b22c1b0 auth_method 0 2024-09-12T17:34:00.656 INFO:tasks.workunit.client.0.smithi037.stderr: -165> 2024-09-12T17:34:00.047+0000 7fd9a9098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:00.656 INFO:tasks.workunit.client.0.smithi037.stderr: -164> 2024-09-12T17:34:00.047+0000 7fd9a9098800 20 realm 2024-09-12T17:34:00.657 INFO:tasks.workunit.client.0.smithi037.stderr: -163> 2024-09-12T17:34:00.047+0000 7fd9a9098800 20 rados->read ofs=0 len=0 2024-09-12T17:34:00.657 INFO:tasks.workunit.client.0.smithi037.stderr: -162> 2024-09-12T17:34:00.047+0000 7fd9a9098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:00.657 INFO:tasks.workunit.client.0.smithi037.stderr: -161> 2024-09-12T17:34:00.047+0000 7fd9a9098800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:34:00.657 INFO:tasks.workunit.client.0.smithi037.stderr: -160> 2024-09-12T17:34:00.048+0000 7fd9a9098800 20 rados->read ofs=0 len=0 2024-09-12T17:34:00.657 INFO:tasks.workunit.client.0.smithi037.stderr: -159> 2024-09-12T17:34:00.048+0000 7fd9a9098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:00.657 INFO:tasks.workunit.client.0.smithi037.stderr: -158> 2024-09-12T17:34:00.048+0000 7fd9a9098800 20 rados->read ofs=0 len=0 2024-09-12T17:34:00.658 INFO:tasks.workunit.client.0.smithi037.stderr: -157> 2024-09-12T17:34:00.048+0000 7fd9a6b82640 10 monclient: get_auth_request con 0x56055b2304e0 auth_method 0 2024-09-12T17:34:00.658 INFO:tasks.workunit.client.0.smithi037.stderr: -156> 2024-09-12T17:34:00.049+0000 7fd9a9098800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:34:00.658 INFO:tasks.workunit.client.0.smithi037.stderr: -155> 2024-09-12T17:34:00.049+0000 7fd9a9098800 20 rados->read ofs=0 len=0 2024-09-12T17:34:00.658 INFO:tasks.workunit.client.0.smithi037.stderr: -154> 2024-09-12T17:34:00.049+0000 7fd9a9098800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:34:00.659 INFO:tasks.workunit.client.0.smithi037.stderr: -153> 2024-09-12T17:34:00.049+0000 7fd9a9098800 20 searching for the correct realm 2024-09-12T17:34:00.659 INFO:tasks.workunit.client.0.smithi037.stderr: -152> 2024-09-12T17:34:00.049+0000 7fd9a6381640 10 monclient: get_auth_request con 0x56055b235620 auth_method 0 2024-09-12T17:34:00.659 INFO:tasks.workunit.client.0.smithi037.stderr: -151> 2024-09-12T17:34:00.050+0000 7fd9a7383640 10 monclient: get_auth_request con 0x7fd99c02f940 auth_method 0 2024-09-12T17:34:00.659 INFO:tasks.workunit.client.0.smithi037.stderr: -150> 2024-09-12T17:34:00.051+0000 7fd9a6b82640 10 monclient: get_auth_request con 0x7fd9a0061040 auth_method 0 2024-09-12T17:34:00.659 INFO:tasks.workunit.client.0.smithi037.stderr: -149> 2024-09-12T17:34:00.052+0000 7fd9a6381640 10 monclient: get_auth_request con 0x7fd99806b040 auth_method 0 2024-09-12T17:34:00.660 INFO:tasks.workunit.client.0.smithi037.stderr: -148> 2024-09-12T17:34:00.052+0000 7fd9a6381640 0 -- 172.21.15.37:0/3960364345 >> [v2:172.21.15.40:6800/2441293461,v1:172.21.15.40:6801/2441293461] conn(0x7fd99806b040 msgr2=0x7fd998003990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:34:00.660 INFO:tasks.workunit.client.0.smithi037.stderr: -147> 2024-09-12T17:34:00.254+0000 7fd9a6381640 10 monclient: get_auth_request con 0x7fd99806b040 auth_method 0 2024-09-12T17:34:00.660 INFO:tasks.workunit.client.0.smithi037.stderr: -146> 2024-09-12T17:34:00.256+0000 7fd9a7383640 10 monclient: get_auth_request con 0x7fd99c04b040 auth_method 0 2024-09-12T17:34:00.660 INFO:tasks.workunit.client.0.smithi037.stderr: -145> 2024-09-12T17:34:00.259+0000 7fd9a6b82640 10 monclient: get_auth_request con 0x7fd99c0108f0 auth_method 0 2024-09-12T17:34:00.661 INFO:tasks.workunit.client.0.smithi037.stderr: -144> 2024-09-12T17:34:00.259+0000 7fd9a6b82640 0 -- 172.21.15.37:0/3960364345 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7fd99c0108f0 msgr2=0x7fd99c02e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:34:00.661 INFO:tasks.workunit.client.0.smithi037.stderr: -143> 2024-09-12T17:34:00.460+0000 7fd9a6b82640 10 monclient: get_auth_request con 0x7fd99c0108f0 auth_method 0 2024-09-12T17:34:00.661 INFO:tasks.workunit.client.0.smithi037.stderr: -142> 2024-09-12T17:34:00.466+0000 7fd9a9098800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:34:00.661 INFO:tasks.workunit.client.0.smithi037.stderr: -141> 2024-09-12T17:34:00.466+0000 7fd9a9098800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:34:00.662 INFO:tasks.workunit.client.0.smithi037.stderr: -140> 2024-09-12T17:34:00.466+0000 7fd9a9098800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:34:00.662 INFO:tasks.workunit.client.0.smithi037.stderr: -139> 2024-09-12T17:34:00.466+0000 7fd9a9098800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:34:00.662 INFO:tasks.workunit.client.0.smithi037.stderr: -138> 2024-09-12T17:34:00.466+0000 7fd9a9098800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:34:00.662 INFO:tasks.workunit.client.0.smithi037.stderr: -137> 2024-09-12T17:34:00.466+0000 7fd9a9098800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:34:00.662 INFO:tasks.workunit.client.0.smithi037.stderr: -136> 2024-09-12T17:34:00.466+0000 7fd9a9098800 20 rados->read ofs=0 len=0 2024-09-12T17:34:00.663 INFO:tasks.workunit.client.0.smithi037.stderr: -135> 2024-09-12T17:34:00.467+0000 7fd9a9098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:00.663 INFO:tasks.workunit.client.0.smithi037.stderr: -134> 2024-09-12T17:34:00.467+0000 7fd9a9098800 20 rados->read ofs=0 len=0 2024-09-12T17:34:00.663 INFO:tasks.workunit.client.0.smithi037.stderr: -133> 2024-09-12T17:34:00.467+0000 7fd9a9098800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:34:00.664 INFO:tasks.workunit.client.0.smithi037.stderr: -132> 2024-09-12T17:34:00.467+0000 7fd9a9098800 20 rados->read ofs=0 len=0 2024-09-12T17:34:00.664 INFO:tasks.workunit.client.0.smithi037.stderr: -131> 2024-09-12T17:34:00.467+0000 7fd9a9098800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:34:00.664 INFO:tasks.workunit.client.0.smithi037.stderr: -130> 2024-09-12T17:34:00.467+0000 7fd9a9098800 20 zone default found 2024-09-12T17:34:00.664 INFO:tasks.workunit.client.0.smithi037.stderr: -129> 2024-09-12T17:34:00.467+0000 7fd9a9098800 4 Realm: () 2024-09-12T17:34:00.665 INFO:tasks.workunit.client.0.smithi037.stderr: -128> 2024-09-12T17:34:00.467+0000 7fd9a9098800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:34:00.665 INFO:tasks.workunit.client.0.smithi037.stderr: -127> 2024-09-12T17:34:00.467+0000 7fd9a9098800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:34:00.665 INFO:tasks.workunit.client.0.smithi037.stderr: -126> 2024-09-12T17:34:00.467+0000 7fd9a9098800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:34:00.665 INFO:tasks.workunit.client.0.smithi037.stderr: -125> 2024-09-12T17:34:00.467+0000 7fd9a9098800 20 zonegroup default 2024-09-12T17:34:00.666 INFO:tasks.workunit.client.0.smithi037.stderr: -124> 2024-09-12T17:34:00.467+0000 7fd9a9098800 20 rados->read ofs=0 len=0 2024-09-12T17:34:00.666 INFO:tasks.workunit.client.0.smithi037.stderr: -123> 2024-09-12T17:34:00.468+0000 7fd9a9098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:00.666 INFO:tasks.workunit.client.0.smithi037.stderr: -122> 2024-09-12T17:34:00.468+0000 7fd9a9098800 20 rados->read ofs=0 len=0 2024-09-12T17:34:00.666 INFO:tasks.workunit.client.0.smithi037.stderr: -121> 2024-09-12T17:34:00.468+0000 7fd9a9098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:00.667 INFO:tasks.workunit.client.0.smithi037.stderr: -120> 2024-09-12T17:34:00.468+0000 7fd9a9098800 20 rados->read ofs=0 len=0 2024-09-12T17:34:00.667 INFO:tasks.workunit.client.0.smithi037.stderr: -119> 2024-09-12T17:34:00.469+0000 7fd9a9098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:00.667 INFO:tasks.workunit.client.0.smithi037.stderr: -118> 2024-09-12T17:34:00.469+0000 7fd9a9098800 20 started sync module instance, tier type = 2024-09-12T17:34:00.667 INFO:tasks.workunit.client.0.smithi037.stderr: -117> 2024-09-12T17:34:00.469+0000 7fd9a9098800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:34:00.667 INFO:tasks.workunit.client.0.smithi037.stderr: -116> 2024-09-12T17:34:00.479+0000 7fd9a9098800 20 add_watcher() i=0 2024-09-12T17:34:00.668 INFO:tasks.workunit.client.0.smithi037.stderr: -115> 2024-09-12T17:34:00.479+0000 7fd9a9098800 20 add_watcher() i=1 2024-09-12T17:34:00.668 INFO:tasks.workunit.client.0.smithi037.stderr: -114> 2024-09-12T17:34:00.479+0000 7fd9a9098800 20 add_watcher() i=2 2024-09-12T17:34:00.668 INFO:tasks.workunit.client.0.smithi037.stderr: -113> 2024-09-12T17:34:00.479+0000 7fd9a9098800 20 add_watcher() i=3 2024-09-12T17:34:00.668 INFO:tasks.workunit.client.0.smithi037.stderr: -112> 2024-09-12T17:34:00.479+0000 7fd9a9098800 20 add_watcher() i=4 2024-09-12T17:34:00.668 INFO:tasks.workunit.client.0.smithi037.stderr: -111> 2024-09-12T17:34:00.479+0000 7fd9a9098800 20 add_watcher() i=5 2024-09-12T17:34:00.668 INFO:tasks.workunit.client.0.smithi037.stderr: -110> 2024-09-12T17:34:00.479+0000 7fd9a9098800 20 add_watcher() i=6 2024-09-12T17:34:00.669 INFO:tasks.workunit.client.0.smithi037.stderr: -109> 2024-09-12T17:34:00.480+0000 7fd9a9098800 20 add_watcher() i=7 2024-09-12T17:34:00.669 INFO:tasks.workunit.client.0.smithi037.stderr: -108> 2024-09-12T17:34:00.480+0000 7fd9a9098800 2 all 8 watchers are set, enabling cache 2024-09-12T17:34:00.669 INFO:tasks.workunit.client.0.smithi037.stderr: -107> 2024-09-12T17:34:00.482+0000 7fd9a9098800 5 AuthRegistry(0x7fff09a1eee0) adding auth protocol: cephx 2024-09-12T17:34:00.669 INFO:tasks.workunit.client.0.smithi037.stderr: -106> 2024-09-12T17:34:00.482+0000 7fd9a9098800 5 AuthRegistry(0x7fff09a1eee0) adding auth protocol: cephx 2024-09-12T17:34:00.669 INFO:tasks.workunit.client.0.smithi037.stderr: -105> 2024-09-12T17:34:00.482+0000 7fd9a9098800 5 AuthRegistry(0x7fff09a1eee0) adding auth protocol: cephx 2024-09-12T17:34:00.670 INFO:tasks.workunit.client.0.smithi037.stderr: -104> 2024-09-12T17:34:00.482+0000 7fd9a9098800 5 AuthRegistry(0x7fff09a1eee0) adding con mode: secure 2024-09-12T17:34:00.670 INFO:tasks.workunit.client.0.smithi037.stderr: -103> 2024-09-12T17:34:00.482+0000 7fd9a9098800 5 AuthRegistry(0x7fff09a1eee0) adding con mode: crc 2024-09-12T17:34:00.670 INFO:tasks.workunit.client.0.smithi037.stderr: -102> 2024-09-12T17:34:00.482+0000 7fd9a9098800 5 AuthRegistry(0x7fff09a1eee0) adding con mode: secure 2024-09-12T17:34:00.670 INFO:tasks.workunit.client.0.smithi037.stderr: -101> 2024-09-12T17:34:00.482+0000 7fd9a9098800 5 AuthRegistry(0x7fff09a1eee0) adding con mode: crc 2024-09-12T17:34:00.670 INFO:tasks.workunit.client.0.smithi037.stderr: -100> 2024-09-12T17:34:00.482+0000 7fd9a9098800 5 AuthRegistry(0x7fff09a1eee0) adding con mode: secure 2024-09-12T17:34:00.671 INFO:tasks.workunit.client.0.smithi037.stderr: -99> 2024-09-12T17:34:00.482+0000 7fd9a9098800 5 AuthRegistry(0x7fff09a1eee0) adding con mode: crc 2024-09-12T17:34:00.671 INFO:tasks.workunit.client.0.smithi037.stderr: -98> 2024-09-12T17:34:00.482+0000 7fd9a9098800 5 AuthRegistry(0x7fff09a1eee0) adding con mode: crc 2024-09-12T17:34:00.671 INFO:tasks.workunit.client.0.smithi037.stderr: -97> 2024-09-12T17:34:00.482+0000 7fd9a9098800 5 AuthRegistry(0x7fff09a1eee0) adding con mode: secure 2024-09-12T17:34:00.671 INFO:tasks.workunit.client.0.smithi037.stderr: -96> 2024-09-12T17:34:00.482+0000 7fd85dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:34:00.671 INFO:tasks.workunit.client.0.smithi037.stderr: -95> 2024-09-12T17:34:00.482+0000 7fd9a9098800 5 AuthRegistry(0x7fff09a1eee0) adding con mode: crc 2024-09-12T17:34:00.671 INFO:tasks.workunit.client.0.smithi037.stderr: -94> 2024-09-12T17:34:00.482+0000 7fd9a9098800 5 AuthRegistry(0x7fff09a1eee0) adding con mode: secure 2024-09-12T17:34:00.672 INFO:tasks.workunit.client.0.smithi037.stderr: -93> 2024-09-12T17:34:00.482+0000 7fd9a9098800 5 AuthRegistry(0x7fff09a1eee0) adding con mode: crc 2024-09-12T17:34:00.672 INFO:tasks.workunit.client.0.smithi037.stderr: -92> 2024-09-12T17:34:00.482+0000 7fd9a9098800 5 AuthRegistry(0x7fff09a1eee0) adding con mode: secure 2024-09-12T17:34:00.672 INFO:tasks.workunit.client.0.smithi037.stderr: -91> 2024-09-12T17:34:00.483+0000 7fd9a9098800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:34:00.672 INFO:tasks.workunit.client.0.smithi037.stderr: -90> 2024-09-12T17:34:00.483+0000 7fd9a9098800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:34:00.672 INFO:tasks.workunit.client.0.smithi037.stderr: -89> 2024-09-12T17:34:00.483+0000 7fd9a9098800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:34:00.673 INFO:tasks.workunit.client.0.smithi037.stderr: -88> 2024-09-12T17:34:00.483+0000 7fd9a9098800 5 asok(0x56055af1f730) register_command cache list hook 0x56055b1e02a0 2024-09-12T17:34:00.673 INFO:tasks.workunit.client.0.smithi037.stderr: -87> 2024-09-12T17:34:00.483+0000 7fd9a9098800 5 asok(0x56055af1f730) register_command cache inspect hook 0x56055b1e02a0 2024-09-12T17:34:00.673 INFO:tasks.workunit.client.0.smithi037.stderr: -86> 2024-09-12T17:34:00.483+0000 7fd9a9098800 5 asok(0x56055af1f730) register_command cache erase hook 0x56055b1e02a0 2024-09-12T17:34:00.673 INFO:tasks.workunit.client.0.smithi037.stderr: -85> 2024-09-12T17:34:00.483+0000 7fd9a9098800 5 asok(0x56055af1f730) register_command cache zap hook 0x56055b1e02a0 2024-09-12T17:34:00.673 INFO:tasks.workunit.client.0.smithi037.stderr: -84> 2024-09-12T17:34:00.483+0000 7fd9a9098800 5 note: GC not initialized 2024-09-12T17:34:00.673 INFO:tasks.workunit.client.0.smithi037.stderr: -83> 2024-09-12T17:34:00.483+0000 7fd85cfe1640 20 reqs_thread_entry: start 2024-09-12T17:34:00.674 INFO:tasks.workunit.client.0.smithi037.stderr: -82> 2024-09-12T17:34:00.483+0000 7fd9a9098800 5 asok(0x56055af1f730) register_command sync trace show hook 0x7fd99c011a40 2024-09-12T17:34:00.674 INFO:tasks.workunit.client.0.smithi037.stderr: -81> 2024-09-12T17:34:00.483+0000 7fd9a9098800 5 asok(0x56055af1f730) register_command sync trace history hook 0x7fd99c011a40 2024-09-12T17:34:00.674 INFO:tasks.workunit.client.0.smithi037.stderr: -80> 2024-09-12T17:34:00.483+0000 7fd9a9098800 5 asok(0x56055af1f730) register_command sync trace active hook 0x7fd99c011a40 2024-09-12T17:34:00.675 INFO:tasks.workunit.client.0.smithi037.stderr: -79> 2024-09-12T17:34:00.483+0000 7fd9a9098800 5 asok(0x56055af1f730) register_command sync trace active_short hook 0x7fd99c011a40 2024-09-12T17:34:00.675 INFO:tasks.workunit.client.0.smithi037.stderr: -78> 2024-09-12T17:34:00.483+0000 7fd9a9098800 20 init_complete bucket index max shards: 11 2024-09-12T17:34:00.675 INFO:tasks.workunit.client.0.smithi037.stderr: -77> 2024-09-12T17:34:00.483+0000 7fd9a9098800 20 Filter name: none 2024-09-12T17:34:00.675 INFO:tasks.workunit.client.0.smithi037.stderr: -76> 2024-09-12T17:34:00.483+0000 7fd855ffb640 20 reqs_thread_entry: start 2024-09-12T17:34:00.675 INFO:tasks.workunit.client.0.smithi037.stderr: -75> 2024-09-12T17:34:00.483+0000 7fd9a9098800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-12T17:34:00.676 INFO:tasks.workunit.client.0.smithi037.stderr: -74> 2024-09-12T17:34:00.483+0000 7fd9a9098800 20 rados->read ofs=0 len=0 2024-09-12T17:34:00.676 INFO:tasks.workunit.client.0.smithi037.stderr: -73> 2024-09-12T17:34:00.484+0000 7fd9a9098800 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T17:34:00.676 INFO:tasks.workunit.client.0.smithi037.stderr: -72> 2024-09-12T17:34:00.484+0000 7fd9a9098800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-12T17:34:00.676 INFO:tasks.workunit.client.0.smithi037.stderr: -71> 2024-09-12T17:34:00.484+0000 7fd9a9098800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-12T17:34:00.676 INFO:tasks.workunit.client.0.smithi037.stderr: -70> 2024-09-12T17:34:00.484+0000 7fd9a9098800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30 : miss 2024-09-12T17:34:00.676 INFO:tasks.workunit.client.0.smithi037.stderr: -69> 2024-09-12T17:34:00.484+0000 7fd9a9098800 20 rados->read ofs=0 len=0 2024-09-12T17:34:00.677 INFO:tasks.workunit.client.0.smithi037.stderr: -68> 2024-09-12T17:34:00.484+0000 7fd9a9098800 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T17:34:00.677 INFO:tasks.workunit.client.0.smithi037.stderr: -67> 2024-09-12T17:34:00.484+0000 7fd9a9098800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30 info.flags=0x17 2024-09-12T17:34:00.677 INFO:tasks.workunit.client.0.smithi037.stderr: -66> 2024-09-12T17:34:00.484+0000 7fd9a9098800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30 to cache LRU end 2024-09-12T17:34:00.677 INFO:tasks.workunit.client.0.smithi037.stderr: -65> 2024-09-12T17:34:00.484+0000 7fd9a9098800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:34:00.677 INFO:tasks.workunit.client.0.smithi037.stderr: -64> 2024-09-12T17:34:00.484+0000 7fd9a9098800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:34:00.678 INFO:tasks.workunit.client.0.smithi037.stderr: -63> 2024-09-12T17:34:00.484+0000 7fd9a9098800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30 2024-09-12T17:34:00.678 INFO:tasks.workunit.client.0.smithi037.stderr: -62> 2024-09-12T17:34:00.491+0000 7fd9a9098800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30 info.flags=0x17 2024-09-12T17:34:00.678 INFO:tasks.workunit.client.0.smithi037.stderr: -61> 2024-09-12T17:34:00.491+0000 7fd9a9098800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30 to cache LRU end 2024-09-12T17:34:00.678 INFO:tasks.workunit.client.0.smithi037.stderr: -60> 2024-09-12T17:34:00.491+0000 7fd9a9098800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:34:00.678 INFO:tasks.workunit.client.0.smithi037.stderr: -59> 2024-09-12T17:34:00.491+0000 7fd9a9098800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30, ofs0, ns] 2024-09-12T17:34:00.678 INFO:tasks.workunit.client.0.smithi037.stderr: -58> 2024-09-12T17:34:00.491+0000 7fd88a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497061 cookie 94581003899664 notifier 6683 bl.length()=999 2024-09-12T17:34:00.679 INFO:tasks.workunit.client.0.smithi037.stderr: -57> 2024-09-12T17:34:00.491+0000 7fd88a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30 info.flags=0x17 2024-09-12T17:34:00.679 INFO:tasks.workunit.client.0.smithi037.stderr: -56> 2024-09-12T17:34:00.491+0000 7fd88a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30 to cache LRU end 2024-09-12T17:34:00.679 INFO:tasks.workunit.client.0.smithi037.stderr: -55> 2024-09-12T17:34:00.491+0000 7fd88a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:34:00.679 INFO:tasks.workunit.client.0.smithi037.stderr: -54> 2024-09-12T17:34:00.493+0000 7fd9a9098800 20 handle_bi_update(): bucket=:abort-at-block-writes[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30]): orig_sources= new_sources= 2024-09-12T17:34:00.679 INFO:tasks.workunit.client.0.smithi037.stderr: -53> 2024-09-12T17:34:00.493+0000 7fd9a9098800 20 handle_bi_update(): bucket=:abort-at-block-writes[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30]): potential sources added=[] removed=[] 2024-09-12T17:34:00.679 INFO:tasks.workunit.client.0.smithi037.stderr: -52> 2024-09-12T17:34:00.493+0000 7fd9a9098800 20 handle_bi_update(): bucket=:abort-at-block-writes[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30]): orig_dests= new_dests= 2024-09-12T17:34:00.680 INFO:tasks.workunit.client.0.smithi037.stderr: -51> 2024-09-12T17:34:00.493+0000 7fd9a9098800 20 handle_bi_update(): bucket=:abort-at-block-writes[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30]): potential dests added=[] removed=[] 2024-09-12T17:34:00.680 INFO:tasks.workunit.client.0.smithi037.stderr: -50> 2024-09-12T17:34:00.499+0000 7fd9a9098800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30.1.0 2024-09-12T17:34:00.680 INFO:tasks.workunit.client.0.smithi037.stderr: -49> 2024-09-12T17:34:00.499+0000 7fd9a9098800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30.1.0 2024-09-12T17:34:00.680 INFO:tasks.workunit.client.0.smithi037.stderr: -48> 2024-09-12T17:34:00.499+0000 7fd9a9098800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30.1.1 2024-09-12T17:34:00.680 INFO:tasks.workunit.client.0.smithi037.stderr: -47> 2024-09-12T17:34:00.499+0000 7fd9a9098800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30.1.1 2024-09-12T17:34:00.681 INFO:tasks.workunit.client.0.smithi037.stderr: -46> 2024-09-12T17:34:00.499+0000 7fd9a9098800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30.1.2 2024-09-12T17:34:00.681 INFO:tasks.workunit.client.0.smithi037.stderr: -45> 2024-09-12T17:34:00.499+0000 7fd9a9098800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30.1.2 2024-09-12T17:34:00.681 INFO:tasks.workunit.client.0.smithi037.stderr: -44> 2024-09-12T17:34:00.499+0000 7fd9a9098800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30.1.3 2024-09-12T17:34:00.681 INFO:tasks.workunit.client.0.smithi037.stderr: -43> 2024-09-12T17:34:00.499+0000 7fd9a9098800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30.1.3 2024-09-12T17:34:00.681 INFO:tasks.workunit.client.0.smithi037.stderr: -42> 2024-09-12T17:34:00.499+0000 7fd9a9098800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30.1.4 2024-09-12T17:34:00.681 INFO:tasks.workunit.client.0.smithi037.stderr: -41> 2024-09-12T17:34:00.499+0000 7fd9a9098800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30.1.4 2024-09-12T17:34:00.682 INFO:tasks.workunit.client.0.smithi037.stderr: -40> 2024-09-12T17:34:00.499+0000 7fd9a9098800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30.1.5 2024-09-12T17:34:00.682 INFO:tasks.workunit.client.0.smithi037.stderr: -39> 2024-09-12T17:34:00.499+0000 7fd9a9098800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30.1.5 2024-09-12T17:34:00.682 INFO:tasks.workunit.client.0.smithi037.stderr: -38> 2024-09-12T17:34:00.499+0000 7fd9a9098800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30.1.6 2024-09-12T17:34:00.682 INFO:tasks.workunit.client.0.smithi037.stderr: -37> 2024-09-12T17:34:00.499+0000 7fd9a9098800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30.1.6 2024-09-12T17:34:00.682 INFO:tasks.workunit.client.0.smithi037.stderr: -36> 2024-09-12T17:34:00.499+0000 7fd9a9098800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30.1.7 2024-09-12T17:34:00.682 INFO:tasks.workunit.client.0.smithi037.stderr: -35> 2024-09-12T17:34:00.499+0000 7fd9a9098800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30.1.7 2024-09-12T17:34:00.682 INFO:tasks.workunit.client.0.smithi037.stderr: -34> 2024-09-12T17:34:00.499+0000 7fd9a9098800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30.1.8 2024-09-12T17:34:00.683 INFO:tasks.workunit.client.0.smithi037.stderr: -33> 2024-09-12T17:34:00.499+0000 7fd9a9098800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30.1.8 2024-09-12T17:34:00.683 INFO:tasks.workunit.client.0.smithi037.stderr: -32> 2024-09-12T17:34:00.499+0000 7fd9a9098800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30.1.9 2024-09-12T17:34:00.683 INFO:tasks.workunit.client.0.smithi037.stderr: -31> 2024-09-12T17:34:00.499+0000 7fd9a9098800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30.1.9 2024-09-12T17:34:00.683 INFO:tasks.workunit.client.0.smithi037.stderr: -30> 2024-09-12T17:34:00.499+0000 7fd9a9098800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30.1.10 2024-09-12T17:34:00.683 INFO:tasks.workunit.client.0.smithi037.stderr: -29> 2024-09-12T17:34:00.499+0000 7fd9a9098800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30.1.10 2024-09-12T17:34:00.683 INFO:tasks.workunit.client.0.smithi037.stderr: -28> 2024-09-12T17:34:00.499+0000 7fd9a9098800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30.1.11 2024-09-12T17:34:00.683 INFO:tasks.workunit.client.0.smithi037.stderr: -27> 2024-09-12T17:34:00.499+0000 7fd9a9098800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30.1.11 2024-09-12T17:34:00.683 INFO:tasks.workunit.client.0.smithi037.stderr: -26> 2024-09-12T17:34:00.499+0000 7fd9a9098800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30.0 2024-09-12T17:34:00.684 INFO:tasks.workunit.client.0.smithi037.stderr: -25> 2024-09-12T17:34:00.500+0000 7fd9a9098800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30.1 2024-09-12T17:34:00.684 INFO:tasks.workunit.client.0.smithi037.stderr: -24> 2024-09-12T17:34:00.500+0000 7fd9a9098800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30.2 2024-09-12T17:34:00.684 INFO:tasks.workunit.client.0.smithi037.stderr: -23> 2024-09-12T17:34:00.501+0000 7fd9a9098800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30.3 2024-09-12T17:34:00.684 INFO:tasks.workunit.client.0.smithi037.stderr: -22> 2024-09-12T17:34:00.501+0000 7fd9a9098800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30.4 2024-09-12T17:34:00.684 INFO:tasks.workunit.client.0.smithi037.stderr: -21> 2024-09-12T17:34:00.502+0000 7fd9a9098800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30.5 2024-09-12T17:34:00.684 INFO:tasks.workunit.client.0.smithi037.stderr: -20> 2024-09-12T17:34:00.502+0000 7fd9a9098800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30.6 2024-09-12T17:34:00.684 INFO:tasks.workunit.client.0.smithi037.stderr: -19> 2024-09-12T17:34:00.503+0000 7fd9a9098800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30.7 2024-09-12T17:34:00.684 INFO:tasks.workunit.client.0.smithi037.stderr: -18> 2024-09-12T17:34:00.503+0000 7fd9a9098800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30.8 2024-09-12T17:34:00.685 INFO:tasks.workunit.client.0.smithi037.stderr: -17> 2024-09-12T17:34:00.504+0000 7fd9a9098800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30.9 2024-09-12T17:34:00.685 INFO:tasks.workunit.client.0.smithi037.stderr: -16> 2024-09-12T17:34:00.504+0000 7fd9a9098800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30.10 2024-09-12T17:34:00.685 INFO:tasks.workunit.client.0.smithi037.stderr: -15> 2024-09-12T17:34:00.508+0000 7fd9a9098800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30 : hit (requested=0x17, cached=0x17) 2024-09-12T17:34:00.685 INFO:tasks.workunit.client.0.smithi037.stderr: -14> 2024-09-12T17:34:00.508+0000 7fd9a9098800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30 2024-09-12T17:34:00.685 INFO:tasks.workunit.client.0.smithi037.stderr: -13> 2024-09-12T17:34:00.509+0000 7fd9a9098800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30 info.flags=0x17 2024-09-12T17:34:00.685 INFO:tasks.workunit.client.0.smithi037.stderr: -12> 2024-09-12T17:34:00.509+0000 7fd9a9098800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30 to cache LRU end 2024-09-12T17:34:00.685 INFO:tasks.workunit.client.0.smithi037.stderr: -11> 2024-09-12T17:34:00.509+0000 7fd9a9098800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:34:00.685 INFO:tasks.workunit.client.0.smithi037.stderr: -10> 2024-09-12T17:34:00.509+0000 7fd9a9098800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30, ofs0, ns] 2024-09-12T17:34:00.686 INFO:tasks.workunit.client.0.smithi037.stderr: -9> 2024-09-12T17:34:00.510+0000 7fd88a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497062 cookie 94581003899664 notifier 6683 bl.length()=999 2024-09-12T17:34:00.686 INFO:tasks.workunit.client.0.smithi037.stderr: -8> 2024-09-12T17:34:00.510+0000 7fd88a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30 info.flags=0x17 2024-09-12T17:34:00.686 INFO:tasks.workunit.client.0.smithi037.stderr: -7> 2024-09-12T17:34:00.510+0000 7fd88a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30 to cache LRU end 2024-09-12T17:34:00.686 INFO:tasks.workunit.client.0.smithi037.stderr: -6> 2024-09-12T17:34:00.510+0000 7fd88a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:34:00.686 INFO:tasks.workunit.client.0.smithi037.stderr: -5> 2024-09-12T17:34:00.511+0000 7fd9a9098800 20 handle_bi_update(): bucket=:abort-at-block-writes[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30]): orig_sources= new_sources= 2024-09-12T17:34:00.686 INFO:tasks.workunit.client.0.smithi037.stderr: -4> 2024-09-12T17:34:00.511+0000 7fd9a9098800 20 handle_bi_update(): bucket=:abort-at-block-writes[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30]): potential sources added=[] removed=[] 2024-09-12T17:34:00.686 INFO:tasks.workunit.client.0.smithi037.stderr: -3> 2024-09-12T17:34:00.511+0000 7fd9a9098800 20 handle_bi_update(): bucket=:abort-at-block-writes[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30]): orig_dests= new_dests= 2024-09-12T17:34:00.687 INFO:tasks.workunit.client.0.smithi037.stderr: -2> 2024-09-12T17:34:00.511+0000 7fd9a9098800 20 handle_bi_update(): bucket=:abort-at-block-writes[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30]): potential dests added=[] removed=[] 2024-09-12T17:34:00.687 INFO:tasks.workunit.client.0.smithi037.stderr: -1> 2024-09-12T17:34:00.512+0000 7fd9a9098800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fd9a9098800 time 2024-09-12T17:34:00.512591+0000 2024-09-12T17:34:00.687 INFO:tasks.workunit.client.0.smithi037.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:34:00.687 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:34:00.687 INFO:tasks.workunit.client.0.smithi037.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:34:00.687 INFO:tasks.workunit.client.0.smithi037.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fd9ac58c71a] 2024-09-12T17:34:00.687 INFO:tasks.workunit.client.0.smithi037.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fd9ac58c8d8] 2024-09-12T17:34:00.688 INFO:tasks.workunit.client.0.smithi037.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x560559129841] 2024-09-12T17:34:00.688 INFO:tasks.workunit.client.0.smithi037.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x189e) [0x56055913879e] 2024-09-12T17:34:00.688 INFO:tasks.workunit.client.0.smithi037.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x5605591395d4] 2024-09-12T17:34:00.688 INFO:tasks.workunit.client.0.smithi037.stderr: 6: main() 2024-09-12T17:34:00.688 INFO:tasks.workunit.client.0.smithi037.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fd9ab229590] 2024-09-12T17:34:00.688 INFO:tasks.workunit.client.0.smithi037.stderr: 8: __libc_start_main() 2024-09-12T17:34:00.689 INFO:tasks.workunit.client.0.smithi037.stderr: 9: _start() 2024-09-12T17:34:00.689 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:34:00.689 INFO:tasks.workunit.client.0.smithi037.stderr: 0> 2024-09-12T17:34:00.513+0000 7fd9a9098800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:34:00.689 INFO:tasks.workunit.client.0.smithi037.stderr: in thread 7fd9a9098800 thread_name:radosgw-admin 2024-09-12T17:34:00.689 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:34:00.689 INFO:tasks.workunit.client.0.smithi037.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:34:00.689 INFO:tasks.workunit.client.0.smithi037.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fd9ab23e6f0] 2024-09-12T17:34:00.689 INFO:tasks.workunit.client.0.smithi037.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fd9ab28b99c] 2024-09-12T17:34:00.689 INFO:tasks.workunit.client.0.smithi037.stderr: 3: raise() 2024-09-12T17:34:00.689 INFO:tasks.workunit.client.0.smithi037.stderr: 4: abort() 2024-09-12T17:34:00.689 INFO:tasks.workunit.client.0.smithi037.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fd9ac58c774] 2024-09-12T17:34:00.689 INFO:tasks.workunit.client.0.smithi037.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fd9ac58c8d8] 2024-09-12T17:34:00.689 INFO:tasks.workunit.client.0.smithi037.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x560559129841] 2024-09-12T17:34:00.689 INFO:tasks.workunit.client.0.smithi037.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x189e) [0x56055913879e] 2024-09-12T17:34:00.690 INFO:tasks.workunit.client.0.smithi037.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x5605591395d4] 2024-09-12T17:34:00.690 INFO:tasks.workunit.client.0.smithi037.stderr: 10: main() 2024-09-12T17:34:00.690 INFO:tasks.workunit.client.0.smithi037.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fd9ab229590] 2024-09-12T17:34:00.690 INFO:tasks.workunit.client.0.smithi037.stderr: 12: __libc_start_main() 2024-09-12T17:34:00.690 INFO:tasks.workunit.client.0.smithi037.stderr: 13: _start() 2024-09-12T17:34:00.690 INFO:tasks.workunit.client.0.smithi037.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:34:00.691 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:34:00.691 INFO:tasks.workunit.client.0.smithi037.stderr:--- logging levels --- 2024-09-12T17:34:00.691 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 none 2024-09-12T17:34:00.691 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 lockdep 2024-09-12T17:34:00.691 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 context 2024-09-12T17:34:00.691 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 1 crush 2024-09-12T17:34:00.691 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mds 2024-09-12T17:34:00.691 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mds_balancer 2024-09-12T17:34:00.691 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mds_locker 2024-09-12T17:34:00.691 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mds_log 2024-09-12T17:34:00.691 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mds_log_expire 2024-09-12T17:34:00.691 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mds_migrator 2024-09-12T17:34:00.691 INFO:tasks.workunit.client.0.smithi037.stderr: 3/ 5 mds_quiesce 2024-09-12T17:34:00.692 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 buffer 2024-09-12T17:34:00.692 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 timer 2024-09-12T17:34:00.692 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 filer 2024-09-12T17:34:00.692 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 striper 2024-09-12T17:34:00.692 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 objecter 2024-09-12T17:34:00.692 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 rados 2024-09-12T17:34:00.692 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 rbd 2024-09-12T17:34:00.692 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 rbd_mirror 2024-09-12T17:34:00.692 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 rbd_replay 2024-09-12T17:34:00.692 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 rbd_pwl 2024-09-12T17:34:00.692 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 journaler 2024-09-12T17:34:00.693 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 objectcacher 2024-09-12T17:34:00.693 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:34:00.693 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 client 2024-09-12T17:34:00.693 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 osd 2024-09-12T17:34:00.693 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 optracker 2024-09-12T17:34:00.693 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 objclass 2024-09-12T17:34:00.693 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 3 filestore 2024-09-12T17:34:00.693 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 3 journal 2024-09-12T17:34:00.693 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 0 ms 2024-09-12T17:34:00.693 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mon 2024-09-12T17:34:00.693 INFO:tasks.workunit.client.0.smithi037.stderr: 0/10 monc 2024-09-12T17:34:00.693 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 paxos 2024-09-12T17:34:00.694 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 tp 2024-09-12T17:34:00.694 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 auth 2024-09-12T17:34:00.694 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 crypto 2024-09-12T17:34:00.694 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 1 finisher 2024-09-12T17:34:00.694 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 1 reserver 2024-09-12T17:34:00.694 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 heartbeatmap 2024-09-12T17:34:00.694 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 perfcounter 2024-09-12T17:34:00.694 INFO:tasks.workunit.client.0.smithi037.stderr: 20/20 rgw 2024-09-12T17:34:00.694 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 rgw_sync 2024-09-12T17:34:00.695 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 rgw_datacache 2024-09-12T17:34:00.695 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 rgw_access 2024-09-12T17:34:00.695 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:34:00.695 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 rgw_flight 2024-09-12T17:34:00.695 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:34:00.695 INFO:tasks.workunit.client.0.smithi037.stderr: 20/20 rgw_notification 2024-09-12T17:34:00.695 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 javaclient 2024-09-12T17:34:00.695 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 asok 2024-09-12T17:34:00.695 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 1 throttle 2024-09-12T17:34:00.695 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 0 refs 2024-09-12T17:34:00.696 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 compressor 2024-09-12T17:34:00.696 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 bluestore 2024-09-12T17:34:00.696 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 bluefs 2024-09-12T17:34:00.696 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 3 bdev 2024-09-12T17:34:00.696 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 kstore 2024-09-12T17:34:00.697 INFO:tasks.workunit.client.0.smithi037.stderr: 4/ 5 rocksdb 2024-09-12T17:34:00.697 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 fuse 2024-09-12T17:34:00.697 INFO:tasks.workunit.client.0.smithi037.stderr: 2/ 5 mgr 2024-09-12T17:34:00.697 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mgrc 2024-09-12T17:34:00.697 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 dpdk 2024-09-12T17:34:00.698 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 eventtrace 2024-09-12T17:34:00.698 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 prioritycache 2024-09-12T17:34:00.698 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 test 2024-09-12T17:34:00.698 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:34:00.698 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 cephsqlite 2024-09-12T17:34:00.698 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:34:00.698 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore 2024-09-12T17:34:00.698 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_onode 2024-09-12T17:34:00.698 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_odata 2024-09-12T17:34:00.698 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_omap 2024-09-12T17:34:00.698 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_tm 2024-09-12T17:34:00.699 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_t 2024-09-12T17:34:00.699 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:34:00.699 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_epm 2024-09-12T17:34:00.699 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_lba 2024-09-12T17:34:00.699 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:34:00.699 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_cache 2024-09-12T17:34:00.699 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_journal 2024-09-12T17:34:00.699 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_device 2024-09-12T17:34:00.699 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_backref 2024-09-12T17:34:00.700 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 alienstore 2024-09-12T17:34:00.700 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mclock 2024-09-12T17:34:00.700 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 cyanstore 2024-09-12T17:34:00.700 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 ceph_exporter 2024-09-12T17:34:00.700 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 memstore 2024-09-12T17:34:00.700 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 trace 2024-09-12T17:34:00.701 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 ceph_dedup 2024-09-12T17:34:00.701 INFO:tasks.workunit.client.0.smithi037.stderr: -2/-2 (syslog threshold) 2024-09-12T17:34:00.701 INFO:tasks.workunit.client.0.smithi037.stderr: 99/99 (stderr threshold) 2024-09-12T17:34:00.701 INFO:tasks.workunit.client.0.smithi037.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:34:00.701 INFO:tasks.workunit.client.0.smithi037.stderr: 7fd855ffb640 / http_manager 2024-09-12T17:34:00.701 INFO:tasks.workunit.client.0.smithi037.stderr: 7fd85cfe1640 / http_manager 2024-09-12T17:34:00.701 INFO:tasks.workunit.client.0.smithi037.stderr: 7fd85dfe3640 / rgw_dt_lg_renew 2024-09-12T17:34:00.701 INFO:tasks.workunit.client.0.smithi037.stderr: 7fd888ff9640 / ms_dispatch 2024-09-12T17:34:00.701 INFO:tasks.workunit.client.0.smithi037.stderr: 7fd88a7fc640 / io_context_pool 2024-09-12T17:34:00.701 INFO:tasks.workunit.client.0.smithi037.stderr: 7fd890e01640 / ms_dispatch 2024-09-12T17:34:00.701 INFO:tasks.workunit.client.0.smithi037.stderr: 7fd893606640 / ms_dispatch 2024-09-12T17:34:00.701 INFO:tasks.workunit.client.0.smithi037.stderr: 7fd894e09640 / io_context_pool 2024-09-12T17:34:00.701 INFO:tasks.workunit.client.0.smithi037.stderr: 7fd9a6381640 / msgr-worker-2 2024-09-12T17:34:00.702 INFO:tasks.workunit.client.0.smithi037.stderr: 7fd9a6b82640 / msgr-worker-1 2024-09-12T17:34:00.702 INFO:tasks.workunit.client.0.smithi037.stderr: 7fd9a7383640 / msgr-worker-0 2024-09-12T17:34:00.702 INFO:tasks.workunit.client.0.smithi037.stderr: 7fd9a7b84640 / io_context_pool 2024-09-12T17:34:00.702 INFO:tasks.workunit.client.0.smithi037.stderr: 7fd9a9098800 / radosgw-admin 2024-09-12T17:34:00.702 INFO:tasks.workunit.client.0.smithi037.stderr: max_recent 500 2024-09-12T17:34:00.702 INFO:tasks.workunit.client.0.smithi037.stderr: max_new 1000 2024-09-12T17:34:00.702 INFO:tasks.workunit.client.0.smithi037.stderr: log_file /var/lib/ceph/crash/2024-09-12T17:34:00.514266Z_be9b8bcd-750f-483c-aae0-2f02153e8645/log 2024-09-12T17:34:00.702 INFO:tasks.workunit.client.0.smithi037.stderr:--- end dump of recent events --- 2024-09-12T17:34:00.702 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-09-12T17:34:00.704 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:34:00.704 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:34:00.704 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:00.597+0000 7f9d0780e800 20 rados->read ofs=0 len=0 2024-09-12T17:34:00.704 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:00.599+0000 7f9d0780e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:00.704 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:00.599+0000 7f9d0780e800 20 realm 2024-09-12T17:34:00.704 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:00.599+0000 7f9d0780e800 20 rados->read ofs=0 len=0 2024-09-12T17:34:00.704 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:00.599+0000 7f9d0780e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:00.704 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:00.599+0000 7f9d0780e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:34:00.704 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:00.599+0000 7f9d0780e800 20 rados->read ofs=0 len=0 2024-09-12T17:34:00.704 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:00.599+0000 7f9d0780e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:00.704 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:00.599+0000 7f9d0780e800 20 rados->read ofs=0 len=0 2024-09-12T17:34:00.704 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:00.600+0000 7f9d0780e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:34:00.705 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:00.600+0000 7f9d0780e800 20 rados->read ofs=0 len=0 2024-09-12T17:34:00.705 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:00.601+0000 7f9d0780e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:34:00.705 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:00.601+0000 7f9d0780e800 20 searching for the correct realm 2024-09-12T17:34:00.705 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:00.603+0000 7f9d02658640 0 -- 172.21.15.37:0/1430778043 >> [v2:172.21.15.40:6800/2441293461,v1:172.21.15.40:6801/2441293461] conn(0x7f9cf40a6050 msgr2=0x7f9cf4075d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:34:00.811 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:00.810+0000 7f9d02e59640 0 -- 172.21.15.37:0/1430778043 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7f9cf8061b80 msgr2=0x7f9cf80c1620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:34:01.020 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:01.017+0000 7f9d0780e800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:34:01.020 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:01.017+0000 7f9d0780e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:34:01.020 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:01.017+0000 7f9d0780e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:34:01.020 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:01.017+0000 7f9d0780e800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:34:01.020 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:01.017+0000 7f9d0780e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:34:01.020 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:01.017+0000 7f9d0780e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:34:01.020 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:01.017+0000 7f9d0780e800 20 rados->read ofs=0 len=0 2024-09-12T17:34:01.020 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:01.018+0000 7f9d0780e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:01.021 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:01.018+0000 7f9d0780e800 20 rados->read ofs=0 len=0 2024-09-12T17:34:01.021 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:01.018+0000 7f9d0780e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:34:01.021 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:01.018+0000 7f9d0780e800 20 rados->read ofs=0 len=0 2024-09-12T17:34:01.021 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:01.019+0000 7f9d0780e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:34:01.021 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:01.019+0000 7f9d0780e800 20 zone default found 2024-09-12T17:34:01.021 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:01.019+0000 7f9d0780e800 4 Realm: () 2024-09-12T17:34:01.021 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:01.019+0000 7f9d0780e800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:34:01.021 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:01.019+0000 7f9d0780e800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:34:01.021 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:01.019+0000 7f9d0780e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:34:01.021 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:01.019+0000 7f9d0780e800 20 zonegroup default 2024-09-12T17:34:01.021 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:01.019+0000 7f9d0780e800 20 rados->read ofs=0 len=0 2024-09-12T17:34:01.021 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:01.019+0000 7f9d0780e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:01.021 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:01.019+0000 7f9d0780e800 20 rados->read ofs=0 len=0 2024-09-12T17:34:01.022 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:01.019+0000 7f9d0780e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:01.022 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:01.019+0000 7f9d0780e800 20 rados->read ofs=0 len=0 2024-09-12T17:34:01.022 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:01.020+0000 7f9d0780e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:01.022 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:01.020+0000 7f9d0780e800 20 started sync module instance, tier type = 2024-09-12T17:34:01.022 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:01.020+0000 7f9d0780e800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:34:01.032 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:01.031+0000 7f9d0780e800 20 add_watcher() i=0 2024-09-12T17:34:01.032 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:01.031+0000 7f9d0780e800 20 add_watcher() i=1 2024-09-12T17:34:01.032 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:01.031+0000 7f9d0780e800 20 add_watcher() i=2 2024-09-12T17:34:01.032 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:01.031+0000 7f9d0780e800 20 add_watcher() i=3 2024-09-12T17:34:01.032 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:01.031+0000 7f9d0780e800 20 add_watcher() i=4 2024-09-12T17:34:01.033 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:01.031+0000 7f9d0780e800 20 add_watcher() i=5 2024-09-12T17:34:01.033 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:01.031+0000 7f9d0780e800 20 add_watcher() i=6 2024-09-12T17:34:01.033 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:01.032+0000 7f9d0780e800 20 add_watcher() i=7 2024-09-12T17:34:01.033 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:01.032+0000 7f9d0780e800 2 all 8 watchers are set, enabling cache 2024-09-12T17:34:01.034 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:01.033+0000 7f9bb97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:34:01.035 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:01.034+0000 7f9d0780e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:34:01.035 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:01.034+0000 7f9d0780e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:34:01.035 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:01.034+0000 7f9d0780e800 5 note: GC not initialized 2024-09-12T17:34:01.035 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:01.034+0000 7f9b33fff640 20 reqs_thread_entry: start 2024-09-12T17:34:01.036 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:01.034+0000 7f9d0780e800 20 init_complete bucket index max shards: 11 2024-09-12T17:34:01.036 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:01.034+0000 7f9d0780e800 20 Filter name: none 2024-09-12T17:34:01.036 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:01.034+0000 7f9b31ffb640 20 reqs_thread_entry: start 2024-09-12T17:34:01.036 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:01.034+0000 7f9d0780e800 20 rados->read ofs=0 len=0 2024-09-12T17:34:01.037 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:01.035+0000 7f9d0780e800 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T17:34:01.037 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:01.035+0000 7f9d0780e800 20 rados->read ofs=0 len=0 2024-09-12T17:34:01.037 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:01.035+0000 7f9d0780e800 20 rados_obj.operate() r=0 bl.length=467 2024-09-12T17:34:01.037 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:01.035+0000 7f9d0780e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:34:01.038 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:01.035+0000 7f9d0780e800 20 rados->read ofs=0 len=0 2024-09-12T17:34:01.038 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:01.036+0000 7f9d0780e800 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T17:34:01.038 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:01.036+0000 7f9d0780e800 20 rados->read ofs=0 len=0 2024-09-12T17:34:01.038 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:01.036+0000 7f9d0780e800 20 rados_obj.operate() r=0 bl.length=467 2024-09-12T17:34:01.038 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:01.036+0000 7f9d0780e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:34:01.039 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:01.038+0000 7f9bb97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:34:01.042 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:01.041+0000 7f9d0780e800 20 remove_watcher() i=0 2024-09-12T17:34:01.042 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:01.041+0000 7f9d0780e800 2 removed watcher, disabling cache 2024-09-12T17:34:01.043 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:01.042+0000 7f9d0780e800 20 remove_watcher() i=1 2024-09-12T17:34:01.044 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:01.043+0000 7f9d0780e800 20 remove_watcher() i=2 2024-09-12T17:34:01.045 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:01.045+0000 7f9d0780e800 20 remove_watcher() i=3 2024-09-12T17:34:01.046 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:01.046+0000 7f9d0780e800 20 remove_watcher() i=4 2024-09-12T17:34:01.047 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:01.047+0000 7f9d0780e800 20 remove_watcher() i=5 2024-09-12T17:34:01.048 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:01.048+0000 7f9d0780e800 20 remove_watcher() i=6 2024-09-12T17:34:01.050 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:01.049+0000 7f9d0780e800 20 remove_watcher() i=7 2024-09-12T17:34:01.062 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:34:01.062 INFO:tasks.workunit.client.0.smithi037.stderr:BUCKET_STATS: 2024-09-12T17:34:01.062 INFO:tasks.workunit.client.0.smithi037.stderr:bucket: abort-at-block-writes id: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:34:01.062 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:34:01.151 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:34:01.183 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:34:01.183 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:34:01.223 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:01.222+0000 7fd9e8b26800 20 rados->read ofs=0 len=0 2024-09-12T17:34:01.226 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:01.224+0000 7fd9e8b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:01.226 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:01.224+0000 7fd9e8b26800 20 realm 2024-09-12T17:34:01.226 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:01.224+0000 7fd9e8b26800 20 rados->read ofs=0 len=0 2024-09-12T17:34:01.226 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:01.224+0000 7fd9e8b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:01.226 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:01.224+0000 7fd9e8b26800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:34:01.226 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:01.224+0000 7fd9e8b26800 20 rados->read ofs=0 len=0 2024-09-12T17:34:01.226 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:01.224+0000 7fd9e8b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:01.226 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:01.224+0000 7fd9e8b26800 20 rados->read ofs=0 len=0 2024-09-12T17:34:01.227 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:01.225+0000 7fd9e8b26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:34:01.227 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:01.225+0000 7fd9e8b26800 20 rados->read ofs=0 len=0 2024-09-12T17:34:01.227 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:01.226+0000 7fd9e8b26800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:34:01.228 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:01.226+0000 7fd9e8b26800 20 searching for the correct realm 2024-09-12T17:34:01.230 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:01.229+0000 7fd9e3f08640 0 -- 172.21.15.37:0/1753645999 >> [v2:172.21.15.37:6816/2964054205,v1:172.21.15.37:6817/2964054205] conn(0x563273ad6ca0 msgr2=0x563273ad9140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:34:01.233 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:01.233+0000 7fd9e4709640 0 -- 172.21.15.37:0/1753645999 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7fd9d80e1bb0 msgr2=0x7fd9d80a9e50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:34:01.239 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:01.238+0000 7fd9e8b26800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:34:01.239 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:01.238+0000 7fd9e8b26800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:34:01.239 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:01.238+0000 7fd9e8b26800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:34:01.239 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:01.238+0000 7fd9e8b26800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:34:01.239 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:01.238+0000 7fd9e8b26800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:34:01.239 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:01.238+0000 7fd9e8b26800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:34:01.239 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:01.238+0000 7fd9e8b26800 20 rados->read ofs=0 len=0 2024-09-12T17:34:01.239 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:01.238+0000 7fd9e8b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:01.239 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:01.238+0000 7fd9e8b26800 20 rados->read ofs=0 len=0 2024-09-12T17:34:01.240 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:01.238+0000 7fd9e8b26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:34:01.241 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:01.238+0000 7fd9e8b26800 20 rados->read ofs=0 len=0 2024-09-12T17:34:01.241 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:01.239+0000 7fd9e8b26800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:34:01.241 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:01.239+0000 7fd9e8b26800 20 zone default found 2024-09-12T17:34:01.241 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:01.239+0000 7fd9e8b26800 4 Realm: () 2024-09-12T17:34:01.241 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:01.239+0000 7fd9e8b26800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:34:01.241 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:01.239+0000 7fd9e8b26800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:34:01.241 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:01.239+0000 7fd9e8b26800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:34:01.241 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:01.239+0000 7fd9e8b26800 20 zonegroup default 2024-09-12T17:34:01.241 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:01.239+0000 7fd9e8b26800 20 rados->read ofs=0 len=0 2024-09-12T17:34:01.241 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:01.239+0000 7fd9e8b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:01.241 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:01.239+0000 7fd9e8b26800 20 rados->read ofs=0 len=0 2024-09-12T17:34:01.241 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:01.240+0000 7fd9e8b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:01.241 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:01.240+0000 7fd9e8b26800 20 rados->read ofs=0 len=0 2024-09-12T17:34:01.242 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:01.240+0000 7fd9e8b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:01.242 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:01.240+0000 7fd9e8b26800 20 started sync module instance, tier type = 2024-09-12T17:34:01.242 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:01.240+0000 7fd9e8b26800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:34:01.250 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:01.249+0000 7fd9e8b26800 20 add_watcher() i=0 2024-09-12T17:34:01.250 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:01.249+0000 7fd9e8b26800 20 add_watcher() i=1 2024-09-12T17:34:01.251 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:01.249+0000 7fd9e8b26800 20 add_watcher() i=2 2024-09-12T17:34:01.251 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:01.249+0000 7fd9e8b26800 20 add_watcher() i=3 2024-09-12T17:34:01.251 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:01.249+0000 7fd9e8b26800 20 add_watcher() i=4 2024-09-12T17:34:01.251 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:01.249+0000 7fd9e8b26800 20 add_watcher() i=5 2024-09-12T17:34:01.251 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:01.249+0000 7fd9e8b26800 20 add_watcher() i=6 2024-09-12T17:34:01.251 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:01.250+0000 7fd9e8b26800 20 add_watcher() i=7 2024-09-12T17:34:01.251 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:01.250+0000 7fd9e8b26800 2 all 8 watchers are set, enabling cache 2024-09-12T17:34:01.252 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:01.252+0000 7fd89a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:34:01.254 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:01.252+0000 7fd9e8b26800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:34:01.254 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:01.252+0000 7fd9e8b26800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:34:01.254 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:01.252+0000 7fd9e8b26800 5 note: GC not initialized 2024-09-12T17:34:01.254 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:01.252+0000 7fd8997e2640 20 reqs_thread_entry: start 2024-09-12T17:34:01.254 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:01.252+0000 7fd9e8b26800 20 init_complete bucket index max shards: 11 2024-09-12T17:34:01.254 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:01.252+0000 7fd9e8b26800 20 Filter name: none 2024-09-12T17:34:01.254 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:01.253+0000 7fd80affd640 20 reqs_thread_entry: start 2024-09-12T17:34:01.254 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:01.253+0000 7fd9e8b26800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-12T17:34:01.254 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:01.253+0000 7fd9e8b26800 20 rados->read ofs=0 len=0 2024-09-12T17:34:01.254 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:01.253+0000 7fd9e8b26800 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T17:34:01.254 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:01.253+0000 7fd9e8b26800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-12T17:34:01.255 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:01.253+0000 7fd9e8b26800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-12T17:34:01.255 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:01.253+0000 7fd9e8b26800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30 : miss 2024-09-12T17:34:01.255 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:01.253+0000 7fd9e8b26800 20 rados->read ofs=0 len=0 2024-09-12T17:34:01.256 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:01.253+0000 7fd9e8b26800 20 rados_obj.operate() r=0 bl.length=467 2024-09-12T17:34:01.256 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:01.253+0000 7fd9e8b26800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30 info.flags=0x17 2024-09-12T17:34:01.256 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:01.253+0000 7fd9e8b26800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30 to cache LRU end 2024-09-12T17:34:01.256 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:01.253+0000 7fd9e8b26800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:34:01.256 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:01.253+0000 7fd9e8b26800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:34:01.256 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:01.253+0000 7fd9e8b26800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30 2024-09-12T17:34:01.256 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:01.255+0000 7fd9e8b26800 0 INFO: RGWReshardLock::lock found lock on abort-at-block-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30 to be held by another RGW process; skipping for now 2024-09-12T17:34:01.257 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:01.256+0000 7fd89a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:34:01.259 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:01.258+0000 7fd9e8b26800 20 remove_watcher() i=0 2024-09-12T17:34:01.259 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:01.258+0000 7fd9e8b26800 2 removed watcher, disabling cache 2024-09-12T17:34:01.260 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:01.260+0000 7fd9e8b26800 20 remove_watcher() i=1 2024-09-12T17:34:01.261 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:01.261+0000 7fd9e8b26800 20 remove_watcher() i=2 2024-09-12T17:34:01.263 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:01.262+0000 7fd9e8b26800 20 remove_watcher() i=3 2024-09-12T17:34:01.264 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:01.263+0000 7fd9e8b26800 20 remove_watcher() i=4 2024-09-12T17:34:01.265 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:01.264+0000 7fd9e8b26800 20 remove_watcher() i=5 2024-09-12T17:34:01.266 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:01.265+0000 7fd9e8b26800 20 remove_watcher() i=6 2024-09-12T17:34:01.267 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:01.266+0000 7fd9e8b26800 20 remove_watcher() i=7 2024-09-12T17:34:01.278 INFO:tasks.workunit.client.0.smithi037.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T17:34:31.310 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:34:31.350 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:34:31.350 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:34:31.395 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.394+0000 7fbcf8946800 20 rados->read ofs=0 len=0 2024-09-12T17:34:31.397 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.396+0000 7fbcf8946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:31.397 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.396+0000 7fbcf8946800 20 realm 2024-09-12T17:34:31.397 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.396+0000 7fbcf8946800 20 rados->read ofs=0 len=0 2024-09-12T17:34:31.397 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.396+0000 7fbcf8946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:31.397 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.396+0000 7fbcf8946800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:34:31.397 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.396+0000 7fbcf8946800 20 rados->read ofs=0 len=0 2024-09-12T17:34:31.397 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.396+0000 7fbcf8946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:31.397 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.396+0000 7fbcf8946800 20 rados->read ofs=0 len=0 2024-09-12T17:34:31.398 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.397+0000 7fbcf8946800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:34:31.398 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.397+0000 7fbcf8946800 20 rados->read ofs=0 len=0 2024-09-12T17:34:31.398 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.398+0000 7fbcf8946800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:34:31.398 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.398+0000 7fbcf8946800 20 searching for the correct realm 2024-09-12T17:34:31.402 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.401+0000 7fbcf5c2f640 0 -- 172.21.15.37:0/3388414568 >> [v2:172.21.15.40:6800/2441293461,v1:172.21.15.40:6801/2441293461] conn(0x7fbce80a55c0 msgr2=0x7fbce80766f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:34:31.406 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.405+0000 7fbcf6430640 0 -- 172.21.15.37:0/3388414568 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7fbcec071390 msgr2=0x7fbcec02b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:34:31.613 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.611+0000 7fbcf8946800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:34:31.613 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.612+0000 7fbcf8946800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:34:31.613 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.612+0000 7fbcf8946800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:34:31.613 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.612+0000 7fbcf8946800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:34:31.613 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.612+0000 7fbcf8946800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:34:31.613 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.612+0000 7fbcf8946800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:34:31.613 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.612+0000 7fbcf8946800 20 rados->read ofs=0 len=0 2024-09-12T17:34:31.613 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.612+0000 7fbcf8946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:31.613 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.612+0000 7fbcf8946800 20 rados->read ofs=0 len=0 2024-09-12T17:34:31.615 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.612+0000 7fbcf8946800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:34:31.615 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.612+0000 7fbcf8946800 20 rados->read ofs=0 len=0 2024-09-12T17:34:31.615 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.613+0000 7fbcf8946800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:34:31.615 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.613+0000 7fbcf8946800 20 zone default found 2024-09-12T17:34:31.615 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.613+0000 7fbcf8946800 4 Realm: () 2024-09-12T17:34:31.615 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.613+0000 7fbcf8946800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:34:31.615 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.613+0000 7fbcf8946800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:34:31.615 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.613+0000 7fbcf8946800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:34:31.616 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.613+0000 7fbcf8946800 20 zonegroup default 2024-09-12T17:34:31.616 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.613+0000 7fbcf8946800 20 rados->read ofs=0 len=0 2024-09-12T17:34:31.616 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.613+0000 7fbcf8946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:31.616 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.613+0000 7fbcf8946800 20 rados->read ofs=0 len=0 2024-09-12T17:34:31.616 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.614+0000 7fbcf8946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:31.616 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.614+0000 7fbcf8946800 20 rados->read ofs=0 len=0 2024-09-12T17:34:31.616 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.614+0000 7fbcf8946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:31.616 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.614+0000 7fbcf8946800 20 started sync module instance, tier type = 2024-09-12T17:34:31.616 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.614+0000 7fbcf8946800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:34:31.626 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.625+0000 7fbcf8946800 20 add_watcher() i=0 2024-09-12T17:34:31.626 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.625+0000 7fbcf8946800 20 add_watcher() i=1 2024-09-12T17:34:31.626 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.625+0000 7fbcf8946800 20 add_watcher() i=2 2024-09-12T17:34:31.626 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.625+0000 7fbcf8946800 20 add_watcher() i=3 2024-09-12T17:34:31.626 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.625+0000 7fbcf8946800 20 add_watcher() i=4 2024-09-12T17:34:31.626 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.625+0000 7fbcf8946800 20 add_watcher() i=5 2024-09-12T17:34:31.626 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.625+0000 7fbcf8946800 20 add_watcher() i=6 2024-09-12T17:34:31.627 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.626+0000 7fbcf8946800 20 add_watcher() i=7 2024-09-12T17:34:31.627 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.626+0000 7fbcf8946800 2 all 8 watchers are set, enabling cache 2024-09-12T17:34:31.629 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.628+0000 7fbbad7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:34:31.630 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.629+0000 7fbcf8946800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:34:31.630 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.629+0000 7fbcf8946800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:34:31.630 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.629+0000 7fbcf8946800 5 note: GC not initialized 2024-09-12T17:34:31.630 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.629+0000 7fbba77fe640 20 reqs_thread_entry: start 2024-09-12T17:34:31.630 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.629+0000 7fbcf8946800 20 init_complete bucket index max shards: 11 2024-09-12T17:34:31.630 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.629+0000 7fbcf8946800 20 Filter name: none 2024-09-12T17:34:31.630 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.629+0000 7fbcf8946800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-12T17:34:31.630 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.629+0000 7fbba57fa640 20 reqs_thread_entry: start 2024-09-12T17:34:31.631 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.629+0000 7fbcf8946800 20 rados->read ofs=0 len=0 2024-09-12T17:34:31.631 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.630+0000 7fbcf8946800 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T17:34:31.631 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.630+0000 7fbcf8946800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-12T17:34:31.631 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.630+0000 7fbcf8946800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-12T17:34:31.631 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.630+0000 7fbcf8946800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30 : miss 2024-09-12T17:34:31.632 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.630+0000 7fbcf8946800 20 rados->read ofs=0 len=0 2024-09-12T17:34:31.632 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.630+0000 7fbcf8946800 20 rados_obj.operate() r=0 bl.length=467 2024-09-12T17:34:31.632 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.630+0000 7fbcf8946800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30 info.flags=0x17 2024-09-12T17:34:31.632 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.630+0000 7fbcf8946800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30 to cache LRU end 2024-09-12T17:34:31.632 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.630+0000 7fbcf8946800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:34:31.632 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.630+0000 7fbcf8946800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:34:31.632 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.630+0000 7fbcf8946800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30 2024-09-12T17:34:31.632 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.632+0000 7fbcf8946800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T17:34:31.640 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.639+0000 7fbcf8946800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30 info.flags=0x17 2024-09-12T17:34:31.640 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.639+0000 7fbcf8946800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30 to cache LRU end 2024-09-12T17:34:31.640 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.639+0000 7fbcf8946800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:34:31.640 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.639+0000 7fbcf8946800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30, ofs0, ns] 2024-09-12T17:34:31.641 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.639+0000 7fbbd97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497063 cookie 94239523910288 notifier 6731 bl.length()=999 2024-09-12T17:34:31.641 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.639+0000 7fbbd97fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30 info.flags=0x17 2024-09-12T17:34:31.641 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.639+0000 7fbbd97fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30 to cache LRU end 2024-09-12T17:34:31.641 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.639+0000 7fbbd97fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:34:31.642 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.641+0000 7fbcf8946800 20 handle_bi_update(): bucket=:abort-at-block-writes[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30]): orig_sources= new_sources= 2024-09-12T17:34:31.642 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.641+0000 7fbcf8946800 20 handle_bi_update(): bucket=:abort-at-block-writes[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30]): potential sources added=[] removed=[] 2024-09-12T17:34:31.642 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.641+0000 7fbcf8946800 20 handle_bi_update(): bucket=:abort-at-block-writes[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30]): orig_dests= new_dests= 2024-09-12T17:34:31.642 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.641+0000 7fbcf8946800 20 handle_bi_update(): bucket=:abort-at-block-writes[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30]): potential dests added=[] removed=[] 2024-09-12T17:34:31.649 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.648+0000 7fbcf8946800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30.2.0 2024-09-12T17:34:31.649 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.648+0000 7fbcf8946800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30.2.0 2024-09-12T17:34:31.649 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.648+0000 7fbcf8946800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30.2.1 2024-09-12T17:34:31.649 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.648+0000 7fbcf8946800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30.2.1 2024-09-12T17:34:31.649 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.648+0000 7fbcf8946800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30.2.2 2024-09-12T17:34:31.649 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.648+0000 7fbcf8946800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30.2.2 2024-09-12T17:34:31.649 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.648+0000 7fbcf8946800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30.2.3 2024-09-12T17:34:31.649 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.648+0000 7fbcf8946800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30.2.3 2024-09-12T17:34:31.650 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.648+0000 7fbcf8946800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30.2.4 2024-09-12T17:34:31.650 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.648+0000 7fbcf8946800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30.2.4 2024-09-12T17:34:31.650 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.648+0000 7fbcf8946800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30.2.5 2024-09-12T17:34:31.650 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.648+0000 7fbcf8946800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30.2.5 2024-09-12T17:34:31.650 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.648+0000 7fbcf8946800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30.2.6 2024-09-12T17:34:31.650 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.648+0000 7fbcf8946800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30.2.6 2024-09-12T17:34:31.650 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.648+0000 7fbcf8946800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30.2.7 2024-09-12T17:34:31.650 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.648+0000 7fbcf8946800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30.2.7 2024-09-12T17:34:31.650 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.648+0000 7fbcf8946800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30.2.8 2024-09-12T17:34:31.650 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.648+0000 7fbcf8946800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30.2.8 2024-09-12T17:34:31.650 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.648+0000 7fbcf8946800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30.2.9 2024-09-12T17:34:31.650 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.648+0000 7fbcf8946800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30.2.9 2024-09-12T17:34:31.650 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.648+0000 7fbcf8946800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30.2.10 2024-09-12T17:34:31.651 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.648+0000 7fbcf8946800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30.2.10 2024-09-12T17:34:31.651 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.648+0000 7fbcf8946800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30.2.11 2024-09-12T17:34:31.651 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.648+0000 7fbcf8946800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30.2.11 2024-09-12T17:34:31.651 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.648+0000 7fbcf8946800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30.0 2024-09-12T17:34:31.651 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.648+0000 7fbcf8946800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30.1 2024-09-12T17:34:31.652 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.649+0000 7fbcf8946800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30.2 2024-09-12T17:34:31.652 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.649+0000 7fbcf8946800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30.3 2024-09-12T17:34:31.652 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.650+0000 7fbcf8946800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30.4 2024-09-12T17:34:31.652 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.650+0000 7fbcf8946800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30.5 2024-09-12T17:34:31.652 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.651+0000 7fbcf8946800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30.6 2024-09-12T17:34:31.652 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.651+0000 7fbcf8946800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30.7 2024-09-12T17:34:31.653 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.652+0000 7fbcf8946800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30.8 2024-09-12T17:34:31.653 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.652+0000 7fbcf8946800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30.9 2024-09-12T17:34:31.653 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.652+0000 7fbcf8946800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30.10 2024-09-12T17:34:31.657 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.656+0000 7fbcf8946800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30 : hit (requested=0x17, cached=0x17) 2024-09-12T17:34:31.657 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.656+0000 7fbcf8946800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30 2024-09-12T17:34:31.658 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.657+0000 7fbcf8946800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30 info.flags=0x17 2024-09-12T17:34:31.658 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.657+0000 7fbcf8946800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30 to cache LRU end 2024-09-12T17:34:31.658 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.657+0000 7fbcf8946800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:34:31.658 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.657+0000 7fbcf8946800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30, ofs0, ns] 2024-09-12T17:34:31.659 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.657+0000 7fbbd9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497064 cookie 94239523910288 notifier 6731 bl.length()=999 2024-09-12T17:34:31.659 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.657+0000 7fbbd9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30 info.flags=0x17 2024-09-12T17:34:31.659 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.657+0000 7fbbd9ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30 to cache LRU end 2024-09-12T17:34:31.659 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.657+0000 7fbbd9ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:34:31.660 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.659+0000 7fbcf8946800 20 handle_bi_update(): bucket=:abort-at-block-writes[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30]): orig_sources= new_sources= 2024-09-12T17:34:31.660 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.659+0000 7fbcf8946800 20 handle_bi_update(): bucket=:abort-at-block-writes[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30]): potential sources added=[] removed=[] 2024-09-12T17:34:31.660 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.659+0000 7fbcf8946800 20 handle_bi_update(): bucket=:abort-at-block-writes[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30]): orig_dests= new_dests= 2024-09-12T17:34:31.660 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.659+0000 7fbcf8946800 20 handle_bi_update(): bucket=:abort-at-block-writes[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30]): potential dests added=[] removed=[] 2024-09-12T17:34:31.663 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.662+0000 7fbcf8946800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30.0 2024-09-12T17:34:31.663 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.662+0000 7fbcf8946800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30.1 2024-09-12T17:34:31.664 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.663+0000 7fbcf8946800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30.2 2024-09-12T17:34:31.664 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.663+0000 7fbcf8946800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30.3 2024-09-12T17:34:31.664 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.663+0000 7fbcf8946800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30.4 2024-09-12T17:34:31.665 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.664+0000 7fbcf8946800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30.5 2024-09-12T17:34:31.665 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.664+0000 7fbcf8946800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30.6 2024-09-12T17:34:31.665 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.665+0000 7fbcf8946800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30.7 2024-09-12T17:34:31.666 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.665+0000 7fbcf8946800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30.8 2024-09-12T17:34:31.666 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.665+0000 7fbcf8946800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30.9 2024-09-12T17:34:31.666 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.666+0000 7fbcf8946800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30.10 2024-09-12T17:34:31.667 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.666+0000 7fbcf8946800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30 : hit (requested=0x17, cached=0x17) 2024-09-12T17:34:31.667 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.666+0000 7fbcf8946800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30 2024-09-12T17:34:31.668 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.667+0000 7fbcf8946800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30 info.flags=0x17 2024-09-12T17:34:31.668 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.667+0000 7fbcf8946800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30 to cache LRU end 2024-09-12T17:34:31.668 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.667+0000 7fbcf8946800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:34:31.668 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.667+0000 7fbcf8946800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30, ofs0, ns] 2024-09-12T17:34:31.669 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.668+0000 7fbbd97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497065 cookie 94239523910288 notifier 6731 bl.length()=967 2024-09-12T17:34:31.669 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.668+0000 7fbbd97fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30 info.flags=0x17 2024-09-12T17:34:31.669 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.668+0000 7fbbd97fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30 to cache LRU end 2024-09-12T17:34:31.669 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.668+0000 7fbbd97fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:34:31.670 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.670+0000 7fbcf8946800 20 handle_bi_update(): bucket=:abort-at-block-writes[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30]): orig_sources= new_sources= 2024-09-12T17:34:31.671 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.670+0000 7fbcf8946800 20 handle_bi_update(): bucket=:abort-at-block-writes[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30]): potential sources added=[] removed=[] 2024-09-12T17:34:31.671 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.670+0000 7fbcf8946800 20 handle_bi_update(): bucket=:abort-at-block-writes[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30]): orig_dests= new_dests= 2024-09-12T17:34:31.671 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.670+0000 7fbcf8946800 20 handle_bi_update(): bucket=:abort-at-block-writes[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30]): potential dests added=[] removed=[] 2024-09-12T17:34:31.673 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.673+0000 7fbcf8946800 1 execute INFO: reshard of bucket "abort-at-block-writes" from 11 shards to 12 shards completed successfully 2024-09-12T17:34:31.675 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.675+0000 7fbbad7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:34:31.678 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.677+0000 7fbcf8946800 20 remove_watcher() i=0 2024-09-12T17:34:31.678 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.677+0000 7fbcf8946800 2 removed watcher, disabling cache 2024-09-12T17:34:31.679 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.678+0000 7fbcf8946800 20 remove_watcher() i=1 2024-09-12T17:34:31.680 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.679+0000 7fbcf8946800 20 remove_watcher() i=2 2024-09-12T17:34:31.681 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.681+0000 7fbcf8946800 20 remove_watcher() i=3 2024-09-12T17:34:31.682 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.682+0000 7fbcf8946800 20 remove_watcher() i=4 2024-09-12T17:34:31.683 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.683+0000 7fbcf8946800 20 remove_watcher() i=5 2024-09-12T17:34:31.684 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.684+0000 7fbcf8946800 20 remove_watcher() i=6 2024-09-12T17:34:31.685 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.685+0000 7fbcf8946800 20 remove_watcher() i=7 2024-09-12T17:34:31.699 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-09-12T17:34:31.729 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:34:31.729 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:34:31.768 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.767+0000 7fcb6a736800 20 rados->read ofs=0 len=0 2024-09-12T17:34:31.770 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.769+0000 7fcb6a736800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:31.770 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.769+0000 7fcb6a736800 20 realm 2024-09-12T17:34:31.770 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.769+0000 7fcb6a736800 20 rados->read ofs=0 len=0 2024-09-12T17:34:31.770 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.769+0000 7fcb6a736800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:31.770 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.769+0000 7fcb6a736800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:34:31.770 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.769+0000 7fcb6a736800 20 rados->read ofs=0 len=0 2024-09-12T17:34:31.770 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.769+0000 7fcb6a736800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:31.770 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.769+0000 7fcb6a736800 20 rados->read ofs=0 len=0 2024-09-12T17:34:31.772 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.770+0000 7fcb6a736800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:34:31.772 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.770+0000 7fcb6a736800 20 rados->read ofs=0 len=0 2024-09-12T17:34:31.772 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.771+0000 7fcb6a736800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:34:31.772 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.771+0000 7fcb6a736800 20 searching for the correct realm 2024-09-12T17:34:31.774 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.774+0000 7fcb5ffff640 0 -- 172.21.15.37:0/371533885 >> [v2:172.21.15.40:6800/2441293461,v1:172.21.15.40:6801/2441293461] conn(0x7fcb5807f040 msgr2=0x7fcb5809b930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:34:31.778 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.778+0000 7fcb664b7640 0 -- 172.21.15.37:0/371533885 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7fcb50062b80 msgr2=0x7fcb5008f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:34:31.986 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.985+0000 7fcb6a736800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:34:31.986 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.985+0000 7fcb6a736800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:34:31.986 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.985+0000 7fcb6a736800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:34:31.986 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.985+0000 7fcb6a736800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:34:31.986 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.985+0000 7fcb6a736800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:34:31.987 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.985+0000 7fcb6a736800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:34:31.987 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.985+0000 7fcb6a736800 20 rados->read ofs=0 len=0 2024-09-12T17:34:31.987 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.985+0000 7fcb6a736800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:31.987 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.985+0000 7fcb6a736800 20 rados->read ofs=0 len=0 2024-09-12T17:34:31.989 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.985+0000 7fcb6a736800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:34:31.989 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.985+0000 7fcb6a736800 20 rados->read ofs=0 len=0 2024-09-12T17:34:31.989 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.986+0000 7fcb6a736800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:34:31.989 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.986+0000 7fcb6a736800 20 zone default found 2024-09-12T17:34:31.989 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.986+0000 7fcb6a736800 4 Realm: () 2024-09-12T17:34:31.989 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.986+0000 7fcb6a736800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:34:31.989 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.986+0000 7fcb6a736800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:34:31.990 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.986+0000 7fcb6a736800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:34:31.990 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.986+0000 7fcb6a736800 20 zonegroup default 2024-09-12T17:34:31.990 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.986+0000 7fcb6a736800 20 rados->read ofs=0 len=0 2024-09-12T17:34:31.990 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.986+0000 7fcb6a736800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:31.990 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.986+0000 7fcb6a736800 20 rados->read ofs=0 len=0 2024-09-12T17:34:31.990 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.987+0000 7fcb6a736800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:31.990 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.987+0000 7fcb6a736800 20 rados->read ofs=0 len=0 2024-09-12T17:34:31.990 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.987+0000 7fcb6a736800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:31.990 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.987+0000 7fcb6a736800 20 started sync module instance, tier type = 2024-09-12T17:34:31.991 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.987+0000 7fcb6a736800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:34:31.997 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.997+0000 7fcb6a736800 20 add_watcher() i=0 2024-09-12T17:34:31.998 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.997+0000 7fcb6a736800 20 add_watcher() i=1 2024-09-12T17:34:31.998 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.997+0000 7fcb6a736800 20 add_watcher() i=2 2024-09-12T17:34:31.998 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.997+0000 7fcb6a736800 20 add_watcher() i=3 2024-09-12T17:34:31.998 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.997+0000 7fcb6a736800 20 add_watcher() i=4 2024-09-12T17:34:31.998 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.997+0000 7fcb6a736800 20 add_watcher() i=5 2024-09-12T17:34:31.998 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.997+0000 7fcb6a736800 20 add_watcher() i=6 2024-09-12T17:34:31.999 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.998+0000 7fcb6a736800 20 add_watcher() i=7 2024-09-12T17:34:31.999 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.998+0000 7fcb6a736800 2 all 8 watchers are set, enabling cache 2024-09-12T17:34:32.001 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:31.999+0000 7fca1cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:34:32.001 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:32.000+0000 7fcb6a736800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:34:32.001 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:32.000+0000 7fcb6a736800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:34:32.001 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:32.000+0000 7fcb6a736800 5 note: GC not initialized 2024-09-12T17:34:32.001 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:32.000+0000 7fc9977fe640 20 reqs_thread_entry: start 2024-09-12T17:34:32.001 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:32.000+0000 7fcb6a736800 20 init_complete bucket index max shards: 11 2024-09-12T17:34:32.002 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:32.000+0000 7fcb6a736800 20 Filter name: none 2024-09-12T17:34:32.002 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:32.000+0000 7fc9957fa640 20 reqs_thread_entry: start 2024-09-12T17:34:32.002 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:32.000+0000 7fcb6a736800 20 rados->read ofs=0 len=0 2024-09-12T17:34:32.003 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:32.001+0000 7fcb6a736800 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T17:34:32.003 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:32.001+0000 7fcb6a736800 20 rados->read ofs=0 len=0 2024-09-12T17:34:32.003 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:32.001+0000 7fcb6a736800 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T17:34:32.003 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:32.001+0000 7fcb6a736800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:34:32.003 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:32.001+0000 7fcb6a736800 20 rados->read ofs=0 len=0 2024-09-12T17:34:32.003 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:32.001+0000 7fcb6a736800 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T17:34:32.003 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:32.001+0000 7fcb6a736800 20 rados->read ofs=0 len=0 2024-09-12T17:34:32.003 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:32.002+0000 7fcb6a736800 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T17:34:32.004 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:32.002+0000 7fcb6a736800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:34:32.005 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:32.004+0000 7fca1cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:34:32.007 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:32.006+0000 7fcb6a736800 20 remove_watcher() i=0 2024-09-12T17:34:32.007 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:32.006+0000 7fcb6a736800 2 removed watcher, disabling cache 2024-09-12T17:34:32.009 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:32.008+0000 7fcb6a736800 20 remove_watcher() i=1 2024-09-12T17:34:32.010 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:32.009+0000 7fcb6a736800 20 remove_watcher() i=2 2024-09-12T17:34:32.011 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:32.010+0000 7fcb6a736800 20 remove_watcher() i=3 2024-09-12T17:34:32.013 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:32.012+0000 7fcb6a736800 20 remove_watcher() i=4 2024-09-12T17:34:32.014 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:32.013+0000 7fcb6a736800 20 remove_watcher() i=5 2024-09-12T17:34:32.015 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:32.014+0000 7fcb6a736800 20 remove_watcher() i=6 2024-09-12T17:34:32.016 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:32.015+0000 7fcb6a736800 20 remove_watcher() i=7 2024-09-12T17:34:32.027 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:34:32.027 INFO:tasks.workunit.client.0.smithi037.stderr:BUCKET_STATS: 2024-09-12T17:34:32.027 INFO:tasks.workunit.client.0.smithi037.stderr:bucket: abort-at-block-writes id: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.30 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T17:34:32.027 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:34:32.373 INFO:tasks.workunit.client.0.smithi037.stderr:TEST: reshard bucket with EIO injected at commit_target_layout 2024-09-12T17:34:32.373 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:34:33.168 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-12T17:34:33.197 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:34:33.197 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:34:33.235 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.235+0000 7f9a4e620800 20 rados->read ofs=0 len=0 2024-09-12T17:34:33.237 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.236+0000 7f9a4e620800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:33.237 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.236+0000 7f9a4e620800 20 realm 2024-09-12T17:34:33.237 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.236+0000 7f9a4e620800 20 rados->read ofs=0 len=0 2024-09-12T17:34:33.237 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.236+0000 7f9a4e620800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:33.237 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.236+0000 7f9a4e620800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:34:33.237 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.236+0000 7f9a4e620800 20 rados->read ofs=0 len=0 2024-09-12T17:34:33.237 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.236+0000 7f9a4e620800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:33.237 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.236+0000 7f9a4e620800 20 rados->read ofs=0 len=0 2024-09-12T17:34:33.238 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.237+0000 7f9a4e620800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:34:33.238 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.237+0000 7f9a4e620800 20 rados->read ofs=0 len=0 2024-09-12T17:34:33.238 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.237+0000 7f9a4e620800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:34:33.238 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.237+0000 7f9a4e620800 20 searching for the correct realm 2024-09-12T17:34:33.241 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.240+0000 7f9a4c912640 0 -- 172.21.15.37:0/3355994541 >> [v2:172.21.15.40:6818/1210108009,v1:172.21.15.40:6819/1210108009] conn(0x7f9a40086070 msgr2=0x7f9a4009a960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:34:33.245 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.244+0000 7f9a4c111640 0 -- 172.21.15.37:0/3355994541 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7f9a400a9910 msgr2=0x7f9a400783d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:34:33.451 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.450+0000 7f9a4e620800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:34:33.451 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.450+0000 7f9a4e620800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:34:33.451 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.450+0000 7f9a4e620800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:34:33.452 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.450+0000 7f9a4e620800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:34:33.452 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.450+0000 7f9a4e620800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:34:33.452 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.450+0000 7f9a4e620800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:34:33.452 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.450+0000 7f9a4e620800 20 rados->read ofs=0 len=0 2024-09-12T17:34:33.452 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.450+0000 7f9a4e620800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:33.452 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.450+0000 7f9a4e620800 20 rados->read ofs=0 len=0 2024-09-12T17:34:33.453 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.451+0000 7f9a4e620800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:34:33.453 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.451+0000 7f9a4e620800 20 rados->read ofs=0 len=0 2024-09-12T17:34:33.453 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.451+0000 7f9a4e620800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:34:33.454 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.451+0000 7f9a4e620800 20 zone default found 2024-09-12T17:34:33.454 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.451+0000 7f9a4e620800 4 Realm: () 2024-09-12T17:34:33.454 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.451+0000 7f9a4e620800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:34:33.454 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.451+0000 7f9a4e620800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:34:33.454 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.451+0000 7f9a4e620800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:34:33.454 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.451+0000 7f9a4e620800 20 zonegroup default 2024-09-12T17:34:33.454 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.451+0000 7f9a4e620800 20 rados->read ofs=0 len=0 2024-09-12T17:34:33.454 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.451+0000 7f9a4e620800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:33.454 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.451+0000 7f9a4e620800 20 rados->read ofs=0 len=0 2024-09-12T17:34:33.454 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.452+0000 7f9a4e620800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:33.454 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.452+0000 7f9a4e620800 20 rados->read ofs=0 len=0 2024-09-12T17:34:33.455 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.452+0000 7f9a4e620800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:33.455 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.452+0000 7f9a4e620800 20 started sync module instance, tier type = 2024-09-12T17:34:33.455 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.452+0000 7f9a4e620800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:34:33.462 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.462+0000 7f9a4e620800 20 add_watcher() i=0 2024-09-12T17:34:33.462 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.462+0000 7f9a4e620800 20 add_watcher() i=1 2024-09-12T17:34:33.463 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.462+0000 7f9a4e620800 20 add_watcher() i=2 2024-09-12T17:34:33.463 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.462+0000 7f9a4e620800 20 add_watcher() i=3 2024-09-12T17:34:33.463 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.462+0000 7f9a4e620800 20 add_watcher() i=4 2024-09-12T17:34:33.463 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.462+0000 7f9a4e620800 20 add_watcher() i=5 2024-09-12T17:34:33.463 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.462+0000 7f9a4e620800 20 add_watcher() i=6 2024-09-12T17:34:33.463 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.462+0000 7f9a4e620800 20 add_watcher() i=7 2024-09-12T17:34:33.463 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.462+0000 7f9a4e620800 2 all 8 watchers are set, enabling cache 2024-09-12T17:34:33.465 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.464+0000 7f9902fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:34:33.466 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.465+0000 7f9a4e620800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:34:33.466 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.465+0000 7f9a4e620800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:34:33.466 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.465+0000 7f9a4e620800 5 note: GC not initialized 2024-09-12T17:34:33.466 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.465+0000 7f9901fdb640 20 reqs_thread_entry: start 2024-09-12T17:34:33.467 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.465+0000 7f9a4e620800 20 init_complete bucket index max shards: 11 2024-09-12T17:34:33.467 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.465+0000 7f9a4e620800 20 Filter name: none 2024-09-12T17:34:33.467 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.465+0000 7f98737fe640 20 reqs_thread_entry: start 2024-09-12T17:34:33.467 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.465+0000 7f9a4e620800 20 rados->read ofs=0 len=0 2024-09-12T17:34:33.467 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.466+0000 7f9a4e620800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:34:33.467 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.466+0000 7f9a4e620800 20 rados->read ofs=0 len=0 2024-09-12T17:34:33.468 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.467+0000 7f9a4e620800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:34:33.468 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.467+0000 7f9a4e620800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:34:33.468 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.467+0000 7f9a4e620800 20 rados->read ofs=0 len=0 2024-09-12T17:34:33.468 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.467+0000 7f9a4e620800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:34:33.468 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.467+0000 7f9a4e620800 20 rados->read ofs=0 len=0 2024-09-12T17:34:33.469 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.468+0000 7f9a4e620800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:34:33.469 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.468+0000 7f9a4e620800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:34:33.473 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.470+0000 7f9902fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:34:33.473 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.472+0000 7f9a4e620800 20 remove_watcher() i=0 2024-09-12T17:34:33.473 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.472+0000 7f9a4e620800 2 removed watcher, disabling cache 2024-09-12T17:34:33.474 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.473+0000 7f9a4e620800 20 remove_watcher() i=1 2024-09-12T17:34:33.475 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.475+0000 7f9a4e620800 20 remove_watcher() i=2 2024-09-12T17:34:33.476 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.476+0000 7f9a4e620800 20 remove_watcher() i=3 2024-09-12T17:34:33.477 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.477+0000 7f9a4e620800 20 remove_watcher() i=4 2024-09-12T17:34:33.478 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.478+0000 7f9a4e620800 20 remove_watcher() i=5 2024-09-12T17:34:33.480 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.479+0000 7f9a4e620800 20 remove_watcher() i=6 2024-09-12T17:34:33.480 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.480+0000 7f9a4e620800 20 remove_watcher() i=7 2024-09-12T17:34:33.492 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:34:33.492 INFO:tasks.workunit.client.0.smithi037.stderr:BUCKET_STATS: 2024-09-12T17:34:33.492 INFO:tasks.workunit.client.0.smithi037.stderr:bucket: error-at-commit-target-layout id: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.31 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:34:33.492 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:34:33.494 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at commit_target_layout 2024-09-12T17:34:33.529 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:34:33.529 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:34:33.568 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.567+0000 7f318bb0c800 20 rados->read ofs=0 len=0 2024-09-12T17:34:33.569 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.568+0000 7f318bb0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:33.570 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.568+0000 7f318bb0c800 20 realm 2024-09-12T17:34:33.570 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.568+0000 7f318bb0c800 20 rados->read ofs=0 len=0 2024-09-12T17:34:33.570 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.569+0000 7f318bb0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:33.570 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.569+0000 7f318bb0c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:34:33.570 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.569+0000 7f318bb0c800 20 rados->read ofs=0 len=0 2024-09-12T17:34:33.570 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.569+0000 7f318bb0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:33.570 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.569+0000 7f318bb0c800 20 rados->read ofs=0 len=0 2024-09-12T17:34:33.571 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.570+0000 7f318bb0c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:34:33.571 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.570+0000 7f318bb0c800 20 rados->read ofs=0 len=0 2024-09-12T17:34:33.571 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.570+0000 7f318bb0c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:34:33.571 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.570+0000 7f318bb0c800 20 searching for the correct realm 2024-09-12T17:34:33.574 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.573+0000 7f3188df5640 0 -- 172.21.15.37:0/236825038 >> [v2:172.21.15.37:6816/2964054205,v1:172.21.15.37:6817/2964054205] conn(0x556d5ae72b80 msgr2=0x556d5ae74f70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:34:33.578 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.577+0000 7f31895f6640 0 -- 172.21.15.37:0/236825038 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7f3180013070 msgr2=0x7f318008ea70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:34:33.582 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.581+0000 7f318bb0c800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:34:33.583 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.581+0000 7f318bb0c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:34:33.583 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.581+0000 7f318bb0c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:34:33.583 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.581+0000 7f318bb0c800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:34:33.583 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.581+0000 7f318bb0c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:34:33.583 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.581+0000 7f318bb0c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:34:33.583 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.581+0000 7f318bb0c800 20 rados->read ofs=0 len=0 2024-09-12T17:34:33.583 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.581+0000 7f318bb0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:33.583 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.581+0000 7f318bb0c800 20 rados->read ofs=0 len=0 2024-09-12T17:34:33.583 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.582+0000 7f318bb0c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:34:33.583 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.582+0000 7f318bb0c800 20 rados->read ofs=0 len=0 2024-09-12T17:34:33.584 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.582+0000 7f318bb0c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:34:33.584 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.582+0000 7f318bb0c800 20 zone default found 2024-09-12T17:34:33.584 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.582+0000 7f318bb0c800 4 Realm: () 2024-09-12T17:34:33.584 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.582+0000 7f318bb0c800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:34:33.584 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.582+0000 7f318bb0c800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:34:33.584 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.582+0000 7f318bb0c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:34:33.584 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.582+0000 7f318bb0c800 20 zonegroup default 2024-09-12T17:34:33.585 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.582+0000 7f318bb0c800 20 rados->read ofs=0 len=0 2024-09-12T17:34:33.585 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.582+0000 7f318bb0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:33.585 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.582+0000 7f318bb0c800 20 rados->read ofs=0 len=0 2024-09-12T17:34:33.585 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.583+0000 7f318bb0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:33.585 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.583+0000 7f318bb0c800 20 rados->read ofs=0 len=0 2024-09-12T17:34:33.585 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.583+0000 7f318bb0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:33.585 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.583+0000 7f318bb0c800 20 started sync module instance, tier type = 2024-09-12T17:34:33.585 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.583+0000 7f318bb0c800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:34:33.593 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.592+0000 7f318bb0c800 20 add_watcher() i=0 2024-09-12T17:34:33.593 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.592+0000 7f318bb0c800 20 add_watcher() i=1 2024-09-12T17:34:33.593 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.592+0000 7f318bb0c800 20 add_watcher() i=2 2024-09-12T17:34:33.593 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.592+0000 7f318bb0c800 20 add_watcher() i=3 2024-09-12T17:34:33.593 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.592+0000 7f318bb0c800 20 add_watcher() i=4 2024-09-12T17:34:33.593 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.592+0000 7f318bb0c800 20 add_watcher() i=5 2024-09-12T17:34:33.593 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.592+0000 7f318bb0c800 20 add_watcher() i=6 2024-09-12T17:34:33.594 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.593+0000 7f318bb0c800 20 add_watcher() i=7 2024-09-12T17:34:33.594 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.593+0000 7f318bb0c800 2 all 8 watchers are set, enabling cache 2024-09-12T17:34:33.595 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.595+0000 7f303f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:34:33.597 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.595+0000 7f318bb0c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:34:33.597 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.595+0000 7f318bb0c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:34:33.597 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.595+0000 7f318bb0c800 5 note: GC not initialized 2024-09-12T17:34:33.597 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.595+0000 7f303e7e4640 20 reqs_thread_entry: start 2024-09-12T17:34:33.597 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.595+0000 7f318bb0c800 20 init_complete bucket index max shards: 11 2024-09-12T17:34:33.597 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.595+0000 7f318bb0c800 20 Filter name: none 2024-09-12T17:34:33.597 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.596+0000 7f2faffff640 20 reqs_thread_entry: start 2024-09-12T17:34:33.597 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.596+0000 7f318bb0c800 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-09-12T17:34:33.597 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.596+0000 7f318bb0c800 20 rados->read ofs=0 len=0 2024-09-12T17:34:33.598 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.596+0000 7f318bb0c800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:34:33.598 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.596+0000 7f318bb0c800 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-09-12T17:34:33.598 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.596+0000 7f318bb0c800 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-09-12T17:34:33.598 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.596+0000 7f318bb0c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.31 : miss 2024-09-12T17:34:33.598 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.596+0000 7f318bb0c800 20 rados->read ofs=0 len=0 2024-09-12T17:34:33.598 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.596+0000 7f318bb0c800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:34:33.599 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.596+0000 7f318bb0c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.31 info.flags=0x17 2024-09-12T17:34:33.599 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.596+0000 7f318bb0c800 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.31 to cache LRU end 2024-09-12T17:34:33.599 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.596+0000 7f318bb0c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:34:33.599 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.596+0000 7f318bb0c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:34:33.599 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.596+0000 7f318bb0c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.31 2024-09-12T17:34:33.602 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.601+0000 7f318bb0c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.31 info.flags=0x17 2024-09-12T17:34:33.602 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.601+0000 7f318bb0c800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.31 to cache LRU end 2024-09-12T17:34:33.602 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.601+0000 7f318bb0c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:34:33.602 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.601+0000 7f318bb0c800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.31, ofs0, ns] 2024-09-12T17:34:33.603 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.602+0000 7f306cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497070 cookie 93928164902384 notifier 6785 bl.length()=1015 2024-09-12T17:34:33.603 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.602+0000 7f306cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.31 info.flags=0x17 2024-09-12T17:34:33.603 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.602+0000 7f306cff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.31 to cache LRU end 2024-09-12T17:34:33.603 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.602+0000 7f306cff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:34:33.605 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.604+0000 7f318bb0c800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.31]): orig_sources= new_sources= 2024-09-12T17:34:33.605 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.604+0000 7f318bb0c800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.31]): potential sources added=[] removed=[] 2024-09-12T17:34:33.605 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.604+0000 7f318bb0c800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.31]): orig_dests= new_dests= 2024-09-12T17:34:33.605 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.604+0000 7f318bb0c800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.31]): potential dests added=[] removed=[] 2024-09-12T17:34:33.611 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.609+0000 7f318bb0c800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.31.1.0 2024-09-12T17:34:33.611 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.609+0000 7f318bb0c800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.31.1.0 2024-09-12T17:34:33.611 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.609+0000 7f318bb0c800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.31.1.1 2024-09-12T17:34:33.611 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.609+0000 7f318bb0c800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.31.1.1 2024-09-12T17:34:33.611 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.609+0000 7f318bb0c800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.31.1.2 2024-09-12T17:34:33.611 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.609+0000 7f318bb0c800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.31.1.2 2024-09-12T17:34:33.611 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.609+0000 7f318bb0c800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.31.1.3 2024-09-12T17:34:33.611 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.609+0000 7f318bb0c800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.31.1.3 2024-09-12T17:34:33.612 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.609+0000 7f318bb0c800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.31.1.4 2024-09-12T17:34:33.612 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.609+0000 7f318bb0c800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.31.1.4 2024-09-12T17:34:33.612 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.609+0000 7f318bb0c800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.31.1.5 2024-09-12T17:34:33.612 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.609+0000 7f318bb0c800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.31.1.5 2024-09-12T17:34:33.612 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.609+0000 7f318bb0c800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.31.1.6 2024-09-12T17:34:33.612 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.609+0000 7f318bb0c800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.31.1.6 2024-09-12T17:34:33.612 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.609+0000 7f318bb0c800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.31.1.7 2024-09-12T17:34:33.613 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.609+0000 7f318bb0c800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.31.1.7 2024-09-12T17:34:33.613 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.609+0000 7f318bb0c800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.31.1.8 2024-09-12T17:34:33.613 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.609+0000 7f318bb0c800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.31.1.8 2024-09-12T17:34:33.613 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.609+0000 7f318bb0c800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.31.1.9 2024-09-12T17:34:33.613 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.609+0000 7f318bb0c800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.31.1.9 2024-09-12T17:34:33.613 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.609+0000 7f318bb0c800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.31.1.10 2024-09-12T17:34:33.613 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.609+0000 7f318bb0c800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.31.1.10 2024-09-12T17:34:33.613 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.609+0000 7f318bb0c800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.31.1.11 2024-09-12T17:34:33.613 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.609+0000 7f318bb0c800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.31.1.11 2024-09-12T17:34:33.613 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.609+0000 7f318bb0c800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.31.0 2024-09-12T17:34:33.613 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.610+0000 7f318bb0c800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.31.1 2024-09-12T17:34:33.615 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.610+0000 7f318bb0c800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.31.2 2024-09-12T17:34:33.615 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.611+0000 7f318bb0c800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.31.3 2024-09-12T17:34:33.615 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.611+0000 7f318bb0c800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.31.4 2024-09-12T17:34:33.615 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.612+0000 7f318bb0c800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.31.5 2024-09-12T17:34:33.615 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.612+0000 7f318bb0c800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.31.6 2024-09-12T17:34:33.615 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.613+0000 7f318bb0c800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.31.7 2024-09-12T17:34:33.616 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.614+0000 7f318bb0c800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.31.8 2024-09-12T17:34:33.616 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.614+0000 7f318bb0c800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.31.9 2024-09-12T17:34:33.616 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.615+0000 7f318bb0c800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.31.10 2024-09-12T17:34:33.618 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.618+0000 7f318bb0c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.31 : hit (requested=0x17, cached=0x17) 2024-09-12T17:34:33.619 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.618+0000 7f318bb0c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.31 2024-09-12T17:34:33.620 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.619+0000 7f318bb0c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.31 info.flags=0x17 2024-09-12T17:34:33.620 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.619+0000 7f318bb0c800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.31 to cache LRU end 2024-09-12T17:34:33.621 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.619+0000 7f318bb0c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:34:33.621 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.619+0000 7f318bb0c800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.31, ofs0, ns] 2024-09-12T17:34:33.621 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.619+0000 7f305bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497071 cookie 93928164902384 notifier 6785 bl.length()=1015 2024-09-12T17:34:33.621 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.619+0000 7f305bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.31 info.flags=0x17 2024-09-12T17:34:33.621 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.619+0000 7f305bfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.31 to cache LRU end 2024-09-12T17:34:33.621 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.619+0000 7f305bfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:34:33.622 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.621+0000 7f318bb0c800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.31]): orig_sources= new_sources= 2024-09-12T17:34:33.622 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.621+0000 7f318bb0c800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.31]): potential sources added=[] removed=[] 2024-09-12T17:34:33.622 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.621+0000 7f318bb0c800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.31]): orig_dests= new_dests= 2024-09-12T17:34:33.622 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.621+0000 7f318bb0c800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.31]): potential dests added=[] removed=[] 2024-09-12T17:34:33.624 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.623+0000 7f318bb0c800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.31.0 2024-09-12T17:34:33.624 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.624+0000 7f318bb0c800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.31.1 2024-09-12T17:34:33.625 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.624+0000 7f318bb0c800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.31.2 2024-09-12T17:34:33.625 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.624+0000 7f318bb0c800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.31.3 2024-09-12T17:34:33.626 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.625+0000 7f318bb0c800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.31.4 2024-09-12T17:34:33.626 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.625+0000 7f318bb0c800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.31.5 2024-09-12T17:34:33.626 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.625+0000 7f318bb0c800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.31.6 2024-09-12T17:34:33.630 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.625+0000 7f318bb0c800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.31.7 2024-09-12T17:34:33.630 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.626+0000 7f318bb0c800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.31.8 2024-09-12T17:34:33.630 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.626+0000 7f318bb0c800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.31.9 2024-09-12T17:34:33.630 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.626+0000 7f318bb0c800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.31.10 2024-09-12T17:34:33.630 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.627+0000 7f318bb0c800 -1 Injecting error=-5 at location=commit_target_layout 2024-09-12T17:34:33.631 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.627+0000 7f318bb0c800 0 ERROR: commit_reshard failed to commit target index layout: (5) Input/output error 2024-09-12T17:34:33.632 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.631+0000 7f303f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:34:33.634 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.633+0000 7f318bb0c800 20 remove_watcher() i=0 2024-09-12T17:34:33.634 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.633+0000 7f318bb0c800 2 removed watcher, disabling cache 2024-09-12T17:34:33.635 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.634+0000 7f318bb0c800 20 remove_watcher() i=1 2024-09-12T17:34:33.636 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.635+0000 7f318bb0c800 20 remove_watcher() i=2 2024-09-12T17:34:33.637 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.636+0000 7f318bb0c800 20 remove_watcher() i=3 2024-09-12T17:34:33.638 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.637+0000 7f318bb0c800 20 remove_watcher() i=4 2024-09-12T17:34:33.639 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.638+0000 7f318bb0c800 20 remove_watcher() i=5 2024-09-12T17:34:33.640 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.639+0000 7f318bb0c800 20 remove_watcher() i=6 2024-09-12T17:34:33.641 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.640+0000 7f318bb0c800 20 remove_watcher() i=7 2024-09-12T17:34:33.653 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-12T17:34:33.683 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:34:33.684 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:34:33.722 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.721+0000 7fab916bb800 20 rados->read ofs=0 len=0 2024-09-12T17:34:33.724 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.723+0000 7fab916bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:33.724 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.723+0000 7fab916bb800 20 realm 2024-09-12T17:34:33.724 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.723+0000 7fab916bb800 20 rados->read ofs=0 len=0 2024-09-12T17:34:33.725 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.723+0000 7fab916bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:33.725 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.723+0000 7fab916bb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:34:33.725 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.723+0000 7fab916bb800 20 rados->read ofs=0 len=0 2024-09-12T17:34:33.725 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.723+0000 7fab916bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:33.725 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.723+0000 7fab916bb800 20 rados->read ofs=0 len=0 2024-09-12T17:34:33.725 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.724+0000 7fab916bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:34:33.726 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.724+0000 7fab916bb800 20 rados->read ofs=0 len=0 2024-09-12T17:34:33.726 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.724+0000 7fab916bb800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:34:33.726 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.724+0000 7fab916bb800 20 searching for the correct realm 2024-09-12T17:34:33.728 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.728+0000 7fab8f9a6640 0 -- 172.21.15.37:0/41796326 >> [v2:172.21.15.40:6818/1210108009,v1:172.21.15.40:6819/1210108009] conn(0x7fab8401e400 msgr2=0x7fab8401e820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:34:33.732 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.731+0000 7fab8f1a5640 0 -- 172.21.15.37:0/41796326 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7fab84051910 msgr2=0x7fab84008420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:34:33.938 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.937+0000 7fab916bb800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:34:33.938 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.937+0000 7fab916bb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:34:33.939 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.937+0000 7fab916bb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:34:33.939 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.937+0000 7fab916bb800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:34:33.939 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.937+0000 7fab916bb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:34:33.939 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.937+0000 7fab916bb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:34:33.939 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.937+0000 7fab916bb800 20 rados->read ofs=0 len=0 2024-09-12T17:34:33.939 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.937+0000 7fab916bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:33.939 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.937+0000 7fab916bb800 20 rados->read ofs=0 len=0 2024-09-12T17:34:33.939 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.938+0000 7fab916bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:34:33.939 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.938+0000 7fab916bb800 20 rados->read ofs=0 len=0 2024-09-12T17:34:33.940 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.938+0000 7fab916bb800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:34:33.940 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.938+0000 7fab916bb800 20 zone default found 2024-09-12T17:34:33.941 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.938+0000 7fab916bb800 4 Realm: () 2024-09-12T17:34:33.941 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.938+0000 7fab916bb800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:34:33.941 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.938+0000 7fab916bb800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:34:33.941 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.938+0000 7fab916bb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:34:33.941 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.938+0000 7fab916bb800 20 zonegroup default 2024-09-12T17:34:33.941 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.938+0000 7fab916bb800 20 rados->read ofs=0 len=0 2024-09-12T17:34:33.941 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.938+0000 7fab916bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:33.941 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.938+0000 7fab916bb800 20 rados->read ofs=0 len=0 2024-09-12T17:34:33.941 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.939+0000 7fab916bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:33.941 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.939+0000 7fab916bb800 20 rados->read ofs=0 len=0 2024-09-12T17:34:33.941 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.939+0000 7fab916bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:33.941 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.939+0000 7fab916bb800 20 started sync module instance, tier type = 2024-09-12T17:34:33.941 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.939+0000 7fab916bb800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:34:33.949 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.948+0000 7fab916bb800 20 add_watcher() i=0 2024-09-12T17:34:33.949 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.948+0000 7fab916bb800 20 add_watcher() i=1 2024-09-12T17:34:33.949 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.948+0000 7fab916bb800 20 add_watcher() i=2 2024-09-12T17:34:33.949 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.948+0000 7fab916bb800 20 add_watcher() i=3 2024-09-12T17:34:33.949 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.948+0000 7fab916bb800 20 add_watcher() i=4 2024-09-12T17:34:33.949 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.948+0000 7fab916bb800 20 add_watcher() i=5 2024-09-12T17:34:33.949 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.948+0000 7fab916bb800 20 add_watcher() i=6 2024-09-12T17:34:33.949 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.949+0000 7fab916bb800 20 add_watcher() i=7 2024-09-12T17:34:33.950 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.949+0000 7fab916bb800 2 all 8 watchers are set, enabling cache 2024-09-12T17:34:33.951 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.951+0000 7faa45fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:34:33.952 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.951+0000 7fab916bb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:34:33.952 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.951+0000 7fab916bb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:34:33.952 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.951+0000 7fab916bb800 5 note: GC not initialized 2024-09-12T17:34:33.953 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.951+0000 7faa44fe1640 20 reqs_thread_entry: start 2024-09-12T17:34:33.953 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.951+0000 7fab916bb800 20 init_complete bucket index max shards: 11 2024-09-12T17:34:33.953 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.951+0000 7fab916bb800 20 Filter name: none 2024-09-12T17:34:33.953 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.952+0000 7fa9be7fc640 20 reqs_thread_entry: start 2024-09-12T17:34:33.953 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.952+0000 7fab916bb800 20 rados->read ofs=0 len=0 2024-09-12T17:34:33.954 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.952+0000 7fab916bb800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:34:33.954 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.952+0000 7fab916bb800 20 rados->read ofs=0 len=0 2024-09-12T17:34:33.954 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.952+0000 7fab916bb800 20 rados_obj.operate() r=0 bl.length=475 2024-09-12T17:34:33.954 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.953+0000 7fab916bb800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:34:33.954 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.953+0000 7fab916bb800 20 rados->read ofs=0 len=0 2024-09-12T17:34:33.954 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.953+0000 7fab916bb800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:34:33.954 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.953+0000 7fab916bb800 20 rados->read ofs=0 len=0 2024-09-12T17:34:33.955 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.953+0000 7fab916bb800 20 rados_obj.operate() r=0 bl.length=475 2024-09-12T17:34:33.955 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.953+0000 7fab916bb800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:34:33.956 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.955+0000 7faa45fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:34:33.958 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.957+0000 7fab916bb800 20 remove_watcher() i=0 2024-09-12T17:34:33.958 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.957+0000 7fab916bb800 2 removed watcher, disabling cache 2024-09-12T17:34:33.959 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.958+0000 7fab916bb800 20 remove_watcher() i=1 2024-09-12T17:34:33.960 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.959+0000 7fab916bb800 20 remove_watcher() i=2 2024-09-12T17:34:33.961 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.960+0000 7fab916bb800 20 remove_watcher() i=3 2024-09-12T17:34:33.962 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.961+0000 7fab916bb800 20 remove_watcher() i=4 2024-09-12T17:34:33.963 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.962+0000 7fab916bb800 20 remove_watcher() i=5 2024-09-12T17:34:33.964 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.963+0000 7fab916bb800 20 remove_watcher() i=6 2024-09-12T17:34:33.965 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:33.964+0000 7fab916bb800 20 remove_watcher() i=7 2024-09-12T17:34:33.976 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:34:33.976 INFO:tasks.workunit.client.0.smithi037.stderr:BUCKET_STATS: 2024-09-12T17:34:33.976 INFO:tasks.workunit.client.0.smithi037.stderr:bucket: error-at-commit-target-layout id: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.31 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:34:33.976 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:34:34.064 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:34:34.097 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:34:34.097 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:34:34.320 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.319+0000 7f985c82b640 0 --2- 172.21.15.37:0/4229481479 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x7f9744006de0 0x7f9744009270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-12T17:34:34.339 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.339+0000 7f986033d800 20 rados->read ofs=0 len=0 2024-09-12T17:34:34.341 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.340+0000 7f986033d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:34.341 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.340+0000 7f986033d800 20 realm 2024-09-12T17:34:34.341 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.340+0000 7f986033d800 20 rados->read ofs=0 len=0 2024-09-12T17:34:34.341 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.340+0000 7f986033d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:34.341 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.340+0000 7f986033d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:34:34.342 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.340+0000 7f986033d800 20 rados->read ofs=0 len=0 2024-09-12T17:34:34.342 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.341+0000 7f986033d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:34.342 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.341+0000 7f986033d800 20 rados->read ofs=0 len=0 2024-09-12T17:34:34.342 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.341+0000 7f986033d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:34:34.342 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.341+0000 7f986033d800 20 rados->read ofs=0 len=0 2024-09-12T17:34:34.343 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.342+0000 7f986033d800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:34:34.343 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.342+0000 7f986033d800 20 searching for the correct realm 2024-09-12T17:34:34.343 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.343+0000 7f985c82b640 0 -- 172.21.15.37:0/3945371286 >> [v2:172.21.15.40:6818/1210108009,v1:172.21.15.40:6819/1210108009] conn(0x7f9850090c20 msgr2=0x7f985009a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:34:34.549 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.548+0000 7f985c82b640 0 -- 172.21.15.37:0/3945371286 >> [v2:172.21.15.40:6808/2253405131,v1:172.21.15.40:6809/2253405131] conn(0x7f985002a040 msgr2=0x7f98500829c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:34:34.760 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.759+0000 7f986033d800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:34:34.760 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.759+0000 7f986033d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:34:34.761 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.759+0000 7f986033d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:34:34.761 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.759+0000 7f986033d800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:34:34.761 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.759+0000 7f986033d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:34:34.761 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.759+0000 7f986033d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:34:34.761 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.759+0000 7f986033d800 20 rados->read ofs=0 len=0 2024-09-12T17:34:34.761 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.759+0000 7f986033d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:34.761 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.759+0000 7f986033d800 20 rados->read ofs=0 len=0 2024-09-12T17:34:34.762 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.760+0000 7f986033d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:34:34.762 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.760+0000 7f986033d800 20 rados->read ofs=0 len=0 2024-09-12T17:34:34.762 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.760+0000 7f986033d800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:34:34.762 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.760+0000 7f986033d800 20 zone default found 2024-09-12T17:34:34.762 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.760+0000 7f986033d800 4 Realm: () 2024-09-12T17:34:34.762 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.760+0000 7f986033d800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:34:34.762 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.760+0000 7f986033d800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:34:34.762 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.760+0000 7f986033d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:34:34.762 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.760+0000 7f986033d800 20 zonegroup default 2024-09-12T17:34:34.762 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.760+0000 7f986033d800 20 rados->read ofs=0 len=0 2024-09-12T17:34:34.762 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.761+0000 7f986033d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:34.762 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.761+0000 7f986033d800 20 rados->read ofs=0 len=0 2024-09-12T17:34:34.763 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.761+0000 7f986033d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:34.763 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.761+0000 7f986033d800 20 rados->read ofs=0 len=0 2024-09-12T17:34:34.763 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.762+0000 7f986033d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:34.763 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.762+0000 7f986033d800 20 started sync module instance, tier type = 2024-09-12T17:34:34.763 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.762+0000 7f986033d800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:34:34.774 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.773+0000 7f986033d800 20 add_watcher() i=0 2024-09-12T17:34:34.774 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.773+0000 7f986033d800 20 add_watcher() i=1 2024-09-12T17:34:34.774 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.773+0000 7f986033d800 20 add_watcher() i=2 2024-09-12T17:34:34.774 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.773+0000 7f986033d800 20 add_watcher() i=3 2024-09-12T17:34:34.774 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.773+0000 7f986033d800 20 add_watcher() i=4 2024-09-12T17:34:34.775 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.773+0000 7f986033d800 20 add_watcher() i=5 2024-09-12T17:34:34.775 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.773+0000 7f986033d800 20 add_watcher() i=6 2024-09-12T17:34:34.777 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.776+0000 7f986033d800 20 add_watcher() i=7 2024-09-12T17:34:34.777 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.776+0000 7f986033d800 2 all 8 watchers are set, enabling cache 2024-09-12T17:34:34.778 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.778+0000 7f9712fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:34:34.780 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.778+0000 7f986033d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:34:34.780 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.778+0000 7f986033d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:34:34.780 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.778+0000 7f986033d800 5 note: GC not initialized 2024-09-12T17:34:34.780 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.778+0000 7f9711fdb640 20 reqs_thread_entry: start 2024-09-12T17:34:34.780 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.779+0000 7f986033d800 20 init_complete bucket index max shards: 11 2024-09-12T17:34:34.780 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.779+0000 7f986033d800 20 Filter name: none 2024-09-12T17:34:34.780 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.779+0000 7f96837fe640 20 reqs_thread_entry: start 2024-09-12T17:34:34.780 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.779+0000 7f986033d800 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-09-12T17:34:34.780 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.779+0000 7f986033d800 20 rados->read ofs=0 len=0 2024-09-12T17:34:34.781 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.780+0000 7f986033d800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:34:34.781 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.780+0000 7f986033d800 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-09-12T17:34:34.781 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.780+0000 7f986033d800 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-09-12T17:34:34.781 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.780+0000 7f986033d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.31 : miss 2024-09-12T17:34:34.781 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.780+0000 7f986033d800 20 rados->read ofs=0 len=0 2024-09-12T17:34:34.782 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.780+0000 7f986033d800 20 rados_obj.operate() r=0 bl.length=475 2024-09-12T17:34:34.782 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.780+0000 7f986033d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.31 info.flags=0x17 2024-09-12T17:34:34.782 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.780+0000 7f986033d800 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.31 to cache LRU end 2024-09-12T17:34:34.782 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.780+0000 7f986033d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:34:34.782 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.780+0000 7f986033d800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:34:34.782 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.780+0000 7f986033d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.31 2024-09-12T17:34:34.783 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.782+0000 7f986033d800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T17:34:34.792 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.791+0000 7f986033d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.31 info.flags=0x17 2024-09-12T17:34:34.792 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.791+0000 7f986033d800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.31 to cache LRU end 2024-09-12T17:34:34.792 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.791+0000 7f986033d800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:34:34.792 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.791+0000 7f986033d800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.31, ofs0, ns] 2024-09-12T17:34:34.793 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.792+0000 7f97337fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497072 cookie 94712223126112 notifier 6818 bl.length()=1015 2024-09-12T17:34:34.793 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.792+0000 7f97337fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.31 info.flags=0x17 2024-09-12T17:34:34.793 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.792+0000 7f97337fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.31 to cache LRU end 2024-09-12T17:34:34.793 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.792+0000 7f97337fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:34:34.795 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.794+0000 7f986033d800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.31]): orig_sources= new_sources= 2024-09-12T17:34:34.795 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.794+0000 7f986033d800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.31]): potential sources added=[] removed=[] 2024-09-12T17:34:34.795 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.794+0000 7f986033d800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.31]): orig_dests= new_dests= 2024-09-12T17:34:34.795 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.794+0000 7f986033d800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.31]): potential dests added=[] removed=[] 2024-09-12T17:34:34.800 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.799+0000 7f986033d800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.31.2.0 2024-09-12T17:34:34.801 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.799+0000 7f986033d800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.31.2.0 2024-09-12T17:34:34.801 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.799+0000 7f986033d800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.31.2.1 2024-09-12T17:34:34.801 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.799+0000 7f986033d800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.31.2.1 2024-09-12T17:34:34.801 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.799+0000 7f986033d800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.31.2.2 2024-09-12T17:34:34.801 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.799+0000 7f986033d800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.31.2.2 2024-09-12T17:34:34.801 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.799+0000 7f986033d800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.31.2.3 2024-09-12T17:34:34.801 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.799+0000 7f986033d800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.31.2.3 2024-09-12T17:34:34.801 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.799+0000 7f986033d800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.31.2.4 2024-09-12T17:34:34.801 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.799+0000 7f986033d800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.31.2.4 2024-09-12T17:34:34.801 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.799+0000 7f986033d800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.31.2.5 2024-09-12T17:34:34.801 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.799+0000 7f986033d800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.31.2.5 2024-09-12T17:34:34.801 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.799+0000 7f986033d800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.31.2.6 2024-09-12T17:34:34.802 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.799+0000 7f986033d800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.31.2.6 2024-09-12T17:34:34.802 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.799+0000 7f986033d800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.31.2.7 2024-09-12T17:34:34.802 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.799+0000 7f986033d800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.31.2.7 2024-09-12T17:34:34.802 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.799+0000 7f986033d800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.31.2.8 2024-09-12T17:34:34.802 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.799+0000 7f986033d800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.31.2.8 2024-09-12T17:34:34.802 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.799+0000 7f986033d800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.31.2.9 2024-09-12T17:34:34.802 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.799+0000 7f986033d800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.31.2.9 2024-09-12T17:34:34.802 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.799+0000 7f986033d800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.31.2.10 2024-09-12T17:34:34.802 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.799+0000 7f986033d800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.31.2.10 2024-09-12T17:34:34.802 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.799+0000 7f986033d800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.31.2.11 2024-09-12T17:34:34.802 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.799+0000 7f986033d800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.31.2.11 2024-09-12T17:34:34.803 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.799+0000 7f986033d800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.31.0 2024-09-12T17:34:34.803 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.800+0000 7f986033d800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.31.1 2024-09-12T17:34:34.803 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.800+0000 7f986033d800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.31.2 2024-09-12T17:34:34.803 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.801+0000 7f986033d800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.31.3 2024-09-12T17:34:34.803 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.802+0000 7f986033d800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.31.4 2024-09-12T17:34:34.803 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.802+0000 7f986033d800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.31.5 2024-09-12T17:34:34.804 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.803+0000 7f986033d800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.31.6 2024-09-12T17:34:34.804 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.804+0000 7f986033d800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.31.7 2024-09-12T17:34:34.805 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.804+0000 7f986033d800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.31.8 2024-09-12T17:34:34.807 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.805+0000 7f986033d800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.31.9 2024-09-12T17:34:34.807 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.806+0000 7f986033d800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.31.10 2024-09-12T17:34:34.811 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.810+0000 7f986033d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.31 : hit (requested=0x17, cached=0x17) 2024-09-12T17:34:34.811 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.810+0000 7f986033d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.31 2024-09-12T17:34:34.812 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.812+0000 7f986033d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.31 info.flags=0x17 2024-09-12T17:34:34.813 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.812+0000 7f986033d800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.31 to cache LRU end 2024-09-12T17:34:34.813 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.812+0000 7f986033d800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:34:34.813 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.812+0000 7f986033d800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.31, ofs0, ns] 2024-09-12T17:34:34.813 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.812+0000 7f9732ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497073 cookie 94712223126112 notifier 6818 bl.length()=1015 2024-09-12T17:34:34.813 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.812+0000 7f9732ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.31 info.flags=0x17 2024-09-12T17:34:34.813 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.812+0000 7f9732ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.31 to cache LRU end 2024-09-12T17:34:34.814 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.812+0000 7f9732ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:34:34.815 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.814+0000 7f986033d800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.31]): orig_sources= new_sources= 2024-09-12T17:34:34.815 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.814+0000 7f986033d800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.31]): potential sources added=[] removed=[] 2024-09-12T17:34:34.815 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.814+0000 7f986033d800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.31]): orig_dests= new_dests= 2024-09-12T17:34:34.815 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.814+0000 7f986033d800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.31]): potential dests added=[] removed=[] 2024-09-12T17:34:34.818 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.817+0000 7f986033d800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.31.0 2024-09-12T17:34:34.818 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.817+0000 7f986033d800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.31.1 2024-09-12T17:34:34.818 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.818+0000 7f986033d800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.31.2 2024-09-12T17:34:34.819 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.818+0000 7f986033d800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.31.3 2024-09-12T17:34:34.819 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.818+0000 7f986033d800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.31.4 2024-09-12T17:34:34.820 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.819+0000 7f986033d800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.31.5 2024-09-12T17:34:34.820 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.819+0000 7f986033d800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.31.6 2024-09-12T17:34:34.820 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.820+0000 7f986033d800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.31.7 2024-09-12T17:34:34.821 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.820+0000 7f986033d800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.31.8 2024-09-12T17:34:34.821 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.820+0000 7f986033d800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.31.9 2024-09-12T17:34:34.821 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.821+0000 7f986033d800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.31.10 2024-09-12T17:34:34.822 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.821+0000 7f986033d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.31 : hit (requested=0x17, cached=0x17) 2024-09-12T17:34:34.822 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.821+0000 7f986033d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.31 2024-09-12T17:34:34.823 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.823+0000 7f986033d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.31 info.flags=0x17 2024-09-12T17:34:34.823 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.823+0000 7f986033d800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.31 to cache LRU end 2024-09-12T17:34:34.824 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.823+0000 7f986033d800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:34:34.824 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.823+0000 7f986033d800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.31, ofs0, ns] 2024-09-12T17:34:34.824 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.823+0000 7f9732ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497074 cookie 94712223126112 notifier 6818 bl.length()=983 2024-09-12T17:34:34.824 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.823+0000 7f9732ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.31 info.flags=0x17 2024-09-12T17:34:34.824 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.823+0000 7f9732ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.31 to cache LRU end 2024-09-12T17:34:34.824 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.823+0000 7f9732ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:34:34.825 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.825+0000 7f986033d800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.31]): orig_sources= new_sources= 2024-09-12T17:34:34.826 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.825+0000 7f986033d800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.31]): potential sources added=[] removed=[] 2024-09-12T17:34:34.826 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.825+0000 7f986033d800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.31]): orig_dests= new_dests= 2024-09-12T17:34:34.826 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.825+0000 7f986033d800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.31]): potential dests added=[] removed=[] 2024-09-12T17:34:34.828 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.827+0000 7f986033d800 1 execute INFO: reshard of bucket "error-at-commit-target-layout" from 11 shards to 12 shards completed successfully 2024-09-12T17:34:34.830 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.829+0000 7f9712fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:34:34.832 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.832+0000 7f986033d800 20 remove_watcher() i=0 2024-09-12T17:34:34.833 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.832+0000 7f986033d800 2 removed watcher, disabling cache 2024-09-12T17:34:34.834 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.833+0000 7f986033d800 20 remove_watcher() i=1 2024-09-12T17:34:34.835 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.834+0000 7f986033d800 20 remove_watcher() i=2 2024-09-12T17:34:34.836 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.836+0000 7f986033d800 20 remove_watcher() i=3 2024-09-12T17:34:34.837 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.837+0000 7f986033d800 20 remove_watcher() i=4 2024-09-12T17:34:34.839 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.838+0000 7f986033d800 20 remove_watcher() i=5 2024-09-12T17:34:34.840 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.839+0000 7f986033d800 20 remove_watcher() i=6 2024-09-12T17:34:34.841 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.840+0000 7f986033d800 20 remove_watcher() i=7 2024-09-12T17:34:34.856 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-12T17:34:34.884 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:34:34.884 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:34:34.924 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.923+0000 7fc24f344800 20 rados->read ofs=0 len=0 2024-09-12T17:34:34.926 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.925+0000 7fc24f344800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:34.926 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.925+0000 7fc24f344800 20 realm 2024-09-12T17:34:34.927 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.925+0000 7fc24f344800 20 rados->read ofs=0 len=0 2024-09-12T17:34:34.927 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.925+0000 7fc24f344800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:34.927 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.925+0000 7fc24f344800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:34:34.927 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.925+0000 7fc24f344800 20 rados->read ofs=0 len=0 2024-09-12T17:34:34.927 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.925+0000 7fc24f344800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:34.927 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.925+0000 7fc24f344800 20 rados->read ofs=0 len=0 2024-09-12T17:34:34.928 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.926+0000 7fc24f344800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:34:34.928 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.926+0000 7fc24f344800 20 rados->read ofs=0 len=0 2024-09-12T17:34:34.928 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.927+0000 7fc24f344800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:34:34.928 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.927+0000 7fc24f344800 20 searching for the correct realm 2024-09-12T17:34:34.930 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.930+0000 7fc24a8f3640 0 -- 172.21.15.37:0/2595063015 >> [v2:172.21.15.40:6800/2441293461,v1:172.21.15.40:6801/2441293461] conn(0x7fc23c057bf0 msgr2=0x7fc23c060d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:34:34.934 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:34.934+0000 7fc24b0f4640 0 -- 172.21.15.37:0/2595063015 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7fc240064430 msgr2=0x7fc2400648b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:34:35.142 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:35.141+0000 7fc24f344800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:34:35.142 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:35.141+0000 7fc24f344800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:34:35.142 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:35.141+0000 7fc24f344800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:34:35.142 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:35.141+0000 7fc24f344800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:34:35.142 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:35.141+0000 7fc24f344800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:34:35.142 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:35.141+0000 7fc24f344800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:34:35.142 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:35.141+0000 7fc24f344800 20 rados->read ofs=0 len=0 2024-09-12T17:34:35.142 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:35.141+0000 7fc24f344800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:35.142 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:35.141+0000 7fc24f344800 20 rados->read ofs=0 len=0 2024-09-12T17:34:35.144 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:35.141+0000 7fc24f344800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:34:35.144 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:35.141+0000 7fc24f344800 20 rados->read ofs=0 len=0 2024-09-12T17:34:35.144 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:35.142+0000 7fc24f344800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:34:35.144 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:35.142+0000 7fc24f344800 20 zone default found 2024-09-12T17:34:35.144 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:35.142+0000 7fc24f344800 4 Realm: () 2024-09-12T17:34:35.144 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:35.142+0000 7fc24f344800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:34:35.144 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:35.142+0000 7fc24f344800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:34:35.144 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:35.142+0000 7fc24f344800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:34:35.144 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:35.142+0000 7fc24f344800 20 zonegroup default 2024-09-12T17:34:35.144 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:35.142+0000 7fc24f344800 20 rados->read ofs=0 len=0 2024-09-12T17:34:35.144 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:35.142+0000 7fc24f344800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:35.144 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:35.142+0000 7fc24f344800 20 rados->read ofs=0 len=0 2024-09-12T17:34:35.145 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:35.142+0000 7fc24f344800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:35.145 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:35.142+0000 7fc24f344800 20 rados->read ofs=0 len=0 2024-09-12T17:34:35.145 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:35.143+0000 7fc24f344800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:35.145 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:35.143+0000 7fc24f344800 20 started sync module instance, tier type = 2024-09-12T17:34:35.145 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:35.143+0000 7fc24f344800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:34:35.154 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:35.153+0000 7fc24f344800 20 add_watcher() i=0 2024-09-12T17:34:35.154 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:35.153+0000 7fc24f344800 20 add_watcher() i=1 2024-09-12T17:34:35.154 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:35.153+0000 7fc24f344800 20 add_watcher() i=2 2024-09-12T17:34:35.154 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:35.153+0000 7fc24f344800 20 add_watcher() i=3 2024-09-12T17:34:35.154 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:35.153+0000 7fc24f344800 20 add_watcher() i=4 2024-09-12T17:34:35.154 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:35.153+0000 7fc24f344800 20 add_watcher() i=5 2024-09-12T17:34:35.154 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:35.153+0000 7fc24f344800 20 add_watcher() i=6 2024-09-12T17:34:35.154 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:35.154+0000 7fc24f344800 20 add_watcher() i=7 2024-09-12T17:34:35.154 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:35.154+0000 7fc24f344800 2 all 8 watchers are set, enabling cache 2024-09-12T17:34:35.156 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:35.156+0000 7fc101fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:34:35.158 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:35.156+0000 7fc24f344800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:34:35.158 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:35.156+0000 7fc24f344800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:34:35.158 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:35.156+0000 7fc24f344800 5 note: GC not initialized 2024-09-12T17:34:35.158 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:35.156+0000 7fc100fe1640 20 reqs_thread_entry: start 2024-09-12T17:34:35.158 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:35.156+0000 7fc24f344800 20 init_complete bucket index max shards: 11 2024-09-12T17:34:35.158 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:35.156+0000 7fc24f344800 20 Filter name: none 2024-09-12T17:34:35.158 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:35.156+0000 7fc07a7fc640 20 reqs_thread_entry: start 2024-09-12T17:34:35.158 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:35.157+0000 7fc24f344800 20 rados->read ofs=0 len=0 2024-09-12T17:34:35.158 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:35.157+0000 7fc24f344800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:34:35.158 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:35.157+0000 7fc24f344800 20 rados->read ofs=0 len=0 2024-09-12T17:34:35.160 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:35.158+0000 7fc24f344800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:34:35.160 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:35.158+0000 7fc24f344800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:34:35.160 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:35.158+0000 7fc24f344800 20 rados->read ofs=0 len=0 2024-09-12T17:34:35.160 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:35.158+0000 7fc24f344800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:34:35.160 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:35.158+0000 7fc24f344800 20 rados->read ofs=0 len=0 2024-09-12T17:34:35.160 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:35.158+0000 7fc24f344800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:34:35.160 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:35.158+0000 7fc24f344800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:34:35.161 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:35.160+0000 7fc101fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:34:35.163 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:35.163+0000 7fc24f344800 20 remove_watcher() i=0 2024-09-12T17:34:35.163 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:35.163+0000 7fc24f344800 2 removed watcher, disabling cache 2024-09-12T17:34:35.164 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:35.164+0000 7fc24f344800 20 remove_watcher() i=1 2024-09-12T17:34:35.165 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:35.165+0000 7fc24f344800 20 remove_watcher() i=2 2024-09-12T17:34:35.167 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:35.166+0000 7fc24f344800 20 remove_watcher() i=3 2024-09-12T17:34:35.168 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:35.167+0000 7fc24f344800 20 remove_watcher() i=4 2024-09-12T17:34:35.169 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:35.168+0000 7fc24f344800 20 remove_watcher() i=5 2024-09-12T17:34:35.170 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:35.169+0000 7fc24f344800 20 remove_watcher() i=6 2024-09-12T17:34:35.171 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:35.170+0000 7fc24f344800 20 remove_watcher() i=7 2024-09-12T17:34:35.182 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:34:35.182 INFO:tasks.workunit.client.0.smithi037.stderr:BUCKET_STATS: 2024-09-12T17:34:35.182 INFO:tasks.workunit.client.0.smithi037.stderr:bucket: error-at-commit-target-layout id: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.31 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T17:34:35.182 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:34:35.530 INFO:tasks.workunit.client.0.smithi037.stderr:TEST: reshard bucket with ECANCELED injected at commit_target_layout 2024-09-12T17:34:35.530 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:34:36.322 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-12T17:34:36.344 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:34:36.345 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:34:36.586 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:36.584+0000 7f7241e0e800 20 rados->read ofs=0 len=0 2024-09-12T17:34:36.588 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:36.586+0000 7f7241e0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:36.588 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:36.586+0000 7f7241e0e800 20 realm 2024-09-12T17:34:36.589 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:36.586+0000 7f7241e0e800 20 rados->read ofs=0 len=0 2024-09-12T17:34:36.589 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:36.586+0000 7f7241e0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:36.589 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:36.586+0000 7f7241e0e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:34:36.589 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:36.586+0000 7f7241e0e800 20 rados->read ofs=0 len=0 2024-09-12T17:34:36.589 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:36.586+0000 7f7241e0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:36.589 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:36.586+0000 7f7241e0e800 20 rados->read ofs=0 len=0 2024-09-12T17:34:36.589 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:36.588+0000 7f7241e0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:34:36.590 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:36.588+0000 7f7241e0e800 20 rados->read ofs=0 len=0 2024-09-12T17:34:36.590 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:36.588+0000 7f7241e0e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:34:36.590 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:36.588+0000 7f7241e0e800 20 searching for the correct realm 2024-09-12T17:34:36.593 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:36.591+0000 7f7234d6a640 0 -- 172.21.15.37:0/2506931811 >> [v2:172.21.15.40:6800/2441293461,v1:172.21.15.40:6801/2441293461] conn(0x7f7230038070 msgr2=0x7f7230039400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:34:36.598 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:36.596+0000 7f723d56b640 0 -- 172.21.15.37:0/2506931811 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7f72280e45f0 msgr2=0x7f72280ad680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:34:36.805 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:36.802+0000 7f7241e0e800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:34:36.805 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:36.802+0000 7f7241e0e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:34:36.805 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:36.802+0000 7f7241e0e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:34:36.805 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:36.802+0000 7f7241e0e800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:34:36.805 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:36.802+0000 7f7241e0e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:34:36.805 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:36.802+0000 7f7241e0e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:34:36.805 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:36.802+0000 7f7241e0e800 20 rados->read ofs=0 len=0 2024-09-12T17:34:36.805 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:36.803+0000 7f7241e0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:36.805 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:36.803+0000 7f7241e0e800 20 rados->read ofs=0 len=0 2024-09-12T17:34:36.806 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:36.803+0000 7f7241e0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:34:36.806 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:36.803+0000 7f7241e0e800 20 rados->read ofs=0 len=0 2024-09-12T17:34:36.806 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:36.804+0000 7f7241e0e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:34:36.806 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:36.804+0000 7f7241e0e800 20 zone default found 2024-09-12T17:34:36.806 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:36.804+0000 7f7241e0e800 4 Realm: () 2024-09-12T17:34:36.807 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:36.804+0000 7f7241e0e800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:34:36.807 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:36.804+0000 7f7241e0e800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:34:36.807 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:36.804+0000 7f7241e0e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:34:36.807 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:36.804+0000 7f7241e0e800 20 zonegroup default 2024-09-12T17:34:36.807 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:36.804+0000 7f7241e0e800 20 rados->read ofs=0 len=0 2024-09-12T17:34:36.807 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:36.804+0000 7f7241e0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:36.807 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:36.804+0000 7f7241e0e800 20 rados->read ofs=0 len=0 2024-09-12T17:34:36.808 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:36.805+0000 7f7241e0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:36.808 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:36.805+0000 7f7241e0e800 20 rados->read ofs=0 len=0 2024-09-12T17:34:36.808 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:36.805+0000 7f7241e0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:36.808 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:36.805+0000 7f7241e0e800 20 started sync module instance, tier type = 2024-09-12T17:34:36.808 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:36.805+0000 7f7241e0e800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:34:36.817 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:36.815+0000 7f7241e0e800 20 add_watcher() i=0 2024-09-12T17:34:36.817 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:36.815+0000 7f7241e0e800 20 add_watcher() i=1 2024-09-12T17:34:36.817 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:36.815+0000 7f7241e0e800 20 add_watcher() i=2 2024-09-12T17:34:36.817 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:36.815+0000 7f7241e0e800 20 add_watcher() i=3 2024-09-12T17:34:36.817 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:36.815+0000 7f7241e0e800 20 add_watcher() i=4 2024-09-12T17:34:36.818 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:36.815+0000 7f7241e0e800 20 add_watcher() i=5 2024-09-12T17:34:36.818 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:36.815+0000 7f7241e0e800 20 add_watcher() i=6 2024-09-12T17:34:36.818 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:36.816+0000 7f7241e0e800 20 add_watcher() i=7 2024-09-12T17:34:36.818 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:36.816+0000 7f7241e0e800 2 all 8 watchers are set, enabling cache 2024-09-12T17:34:36.820 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:36.818+0000 7f70f3fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:34:36.821 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:36.819+0000 7f7241e0e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:34:36.821 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:36.819+0000 7f7241e0e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:34:36.821 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:36.819+0000 7f7241e0e800 5 note: GC not initialized 2024-09-12T17:34:36.821 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:36.819+0000 7f70f2fe5640 20 reqs_thread_entry: start 2024-09-12T17:34:36.821 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:36.819+0000 7f7241e0e800 20 init_complete bucket index max shards: 11 2024-09-12T17:34:36.822 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:36.819+0000 7f7241e0e800 20 Filter name: none 2024-09-12T17:34:36.822 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:36.819+0000 7f70f0fe1640 20 reqs_thread_entry: start 2024-09-12T17:34:36.822 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:36.819+0000 7f7241e0e800 20 rados->read ofs=0 len=0 2024-09-12T17:34:36.822 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:36.820+0000 7f7241e0e800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:34:36.823 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:36.820+0000 7f7241e0e800 20 rados->read ofs=0 len=0 2024-09-12T17:34:36.823 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:36.821+0000 7f7241e0e800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:34:36.823 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:36.821+0000 7f7241e0e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:34:36.823 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:36.821+0000 7f7241e0e800 20 rados->read ofs=0 len=0 2024-09-12T17:34:36.823 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:36.821+0000 7f7241e0e800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:34:36.823 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:36.821+0000 7f7241e0e800 20 rados->read ofs=0 len=0 2024-09-12T17:34:36.823 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:36.822+0000 7f7241e0e800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:34:36.823 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:36.822+0000 7f7241e0e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:34:36.825 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:36.824+0000 7f70f3fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:34:36.828 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:36.826+0000 7f7241e0e800 20 remove_watcher() i=0 2024-09-12T17:34:36.828 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:36.826+0000 7f7241e0e800 2 removed watcher, disabling cache 2024-09-12T17:34:36.829 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:36.827+0000 7f7241e0e800 20 remove_watcher() i=1 2024-09-12T17:34:36.830 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:36.829+0000 7f7241e0e800 20 remove_watcher() i=2 2024-09-12T17:34:36.832 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:36.830+0000 7f7241e0e800 20 remove_watcher() i=3 2024-09-12T17:34:36.833 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:36.831+0000 7f7241e0e800 20 remove_watcher() i=4 2024-09-12T17:34:36.834 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:36.832+0000 7f7241e0e800 20 remove_watcher() i=5 2024-09-12T17:34:36.835 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:36.833+0000 7f7241e0e800 20 remove_watcher() i=6 2024-09-12T17:34:36.836 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:36.834+0000 7f7241e0e800 20 remove_watcher() i=7 2024-09-12T17:34:36.847 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:34:36.848 INFO:tasks.workunit.client.0.smithi037.stderr:BUCKET_STATS: 2024-09-12T17:34:36.848 INFO:tasks.workunit.client.0.smithi037.stderr:bucket: error-at-commit-target-layout id: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.32 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:34:36.848 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:34:36.849 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at commit_target_layout --inject-error-code 125 2024-09-12T17:34:36.887 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:34:36.887 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:34:36.926 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:36.924+0000 7f53a5d36800 20 rados->read ofs=0 len=0 2024-09-12T17:34:36.928 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:36.925+0000 7f53a5d36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:36.928 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:36.925+0000 7f53a5d36800 20 realm 2024-09-12T17:34:36.928 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:36.925+0000 7f53a5d36800 20 rados->read ofs=0 len=0 2024-09-12T17:34:36.928 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:36.926+0000 7f53a5d36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:36.928 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:36.926+0000 7f53a5d36800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:34:36.928 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:36.926+0000 7f53a5d36800 20 rados->read ofs=0 len=0 2024-09-12T17:34:36.928 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:36.926+0000 7f53a5d36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:36.929 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:36.926+0000 7f53a5d36800 20 rados->read ofs=0 len=0 2024-09-12T17:34:36.929 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:36.927+0000 7f53a5d36800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:34:36.930 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:36.927+0000 7f53a5d36800 20 rados->read ofs=0 len=0 2024-09-12T17:34:36.930 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:36.927+0000 7f53a5d36800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:34:36.930 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:36.927+0000 7f53a5d36800 20 searching for the correct realm 2024-09-12T17:34:36.932 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:36.930+0000 7f53992b6640 0 -- 172.21.15.37:0/265181074 >> [v2:172.21.15.40:6800/2441293461,v1:172.21.15.40:6801/2441293461] conn(0x7f53940b8070 msgr2=0x7f53940ab030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:34:37.138 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.137+0000 7f53a1ab7640 0 -- 172.21.15.37:0/265181074 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7f538c09e2f0 msgr2=0x7f538c08e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:34:37.346 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.344+0000 7f53a5d36800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:34:37.347 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.344+0000 7f53a5d36800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:34:37.347 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.344+0000 7f53a5d36800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:34:37.347 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.344+0000 7f53a5d36800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:34:37.347 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.344+0000 7f53a5d36800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:34:37.347 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.344+0000 7f53a5d36800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:34:37.347 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.344+0000 7f53a5d36800 20 rados->read ofs=0 len=0 2024-09-12T17:34:37.347 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.344+0000 7f53a5d36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:37.348 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.344+0000 7f53a5d36800 20 rados->read ofs=0 len=0 2024-09-12T17:34:37.348 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.345+0000 7f53a5d36800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:34:37.348 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.345+0000 7f53a5d36800 20 rados->read ofs=0 len=0 2024-09-12T17:34:37.350 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.345+0000 7f53a5d36800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:34:37.350 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.345+0000 7f53a5d36800 20 zone default found 2024-09-12T17:34:37.350 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.345+0000 7f53a5d36800 4 Realm: () 2024-09-12T17:34:37.350 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.345+0000 7f53a5d36800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:34:37.350 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.345+0000 7f53a5d36800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:34:37.350 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.345+0000 7f53a5d36800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:34:37.350 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.345+0000 7f53a5d36800 20 zonegroup default 2024-09-12T17:34:37.350 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.345+0000 7f53a5d36800 20 rados->read ofs=0 len=0 2024-09-12T17:34:37.351 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.345+0000 7f53a5d36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:37.351 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.345+0000 7f53a5d36800 20 rados->read ofs=0 len=0 2024-09-12T17:34:37.351 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.346+0000 7f53a5d36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:37.351 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.346+0000 7f53a5d36800 20 rados->read ofs=0 len=0 2024-09-12T17:34:37.351 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.346+0000 7f53a5d36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:37.351 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.346+0000 7f53a5d36800 20 started sync module instance, tier type = 2024-09-12T17:34:37.351 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.346+0000 7f53a5d36800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:34:37.359 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.357+0000 7f53a5d36800 20 add_watcher() i=0 2024-09-12T17:34:37.359 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.357+0000 7f53a5d36800 20 add_watcher() i=1 2024-09-12T17:34:37.360 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.357+0000 7f53a5d36800 20 add_watcher() i=2 2024-09-12T17:34:37.360 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.357+0000 7f53a5d36800 20 add_watcher() i=3 2024-09-12T17:34:37.360 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.357+0000 7f53a5d36800 20 add_watcher() i=4 2024-09-12T17:34:37.360 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.357+0000 7f53a5d36800 20 add_watcher() i=5 2024-09-12T17:34:37.360 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.357+0000 7f53a5d36800 20 add_watcher() i=6 2024-09-12T17:34:37.360 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.358+0000 7f53a5d36800 20 add_watcher() i=7 2024-09-12T17:34:37.361 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.358+0000 7f53a5d36800 2 all 8 watchers are set, enabling cache 2024-09-12T17:34:37.363 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.360+0000 7f5253fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:34:37.363 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.361+0000 7f53a5d36800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:34:37.364 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.361+0000 7f53a5d36800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:34:37.364 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.361+0000 7f53a5d36800 5 note: GC not initialized 2024-09-12T17:34:37.364 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.361+0000 7f5252ffd640 20 reqs_thread_entry: start 2024-09-12T17:34:37.364 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.361+0000 7f53a5d36800 20 init_complete bucket index max shards: 11 2024-09-12T17:34:37.364 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.361+0000 7f53a5d36800 20 Filter name: none 2024-09-12T17:34:37.364 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.361+0000 7f5250ff9640 20 reqs_thread_entry: start 2024-09-12T17:34:37.364 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.361+0000 7f53a5d36800 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-09-12T17:34:37.364 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.361+0000 7f53a5d36800 20 rados->read ofs=0 len=0 2024-09-12T17:34:37.365 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.362+0000 7f53a5d36800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:34:37.366 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.362+0000 7f53a5d36800 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-09-12T17:34:37.366 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.362+0000 7f53a5d36800 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-09-12T17:34:37.366 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.362+0000 7f53a5d36800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.32 : miss 2024-09-12T17:34:37.366 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.362+0000 7f53a5d36800 20 rados->read ofs=0 len=0 2024-09-12T17:34:37.366 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.362+0000 7f53a5d36800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:34:37.366 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.362+0000 7f53a5d36800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.32 info.flags=0x17 2024-09-12T17:34:37.366 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.362+0000 7f53a5d36800 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.32 to cache LRU end 2024-09-12T17:34:37.366 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.362+0000 7f53a5d36800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:34:37.366 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.362+0000 7f53a5d36800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:34:37.366 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.362+0000 7f53a5d36800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.32 2024-09-12T17:34:37.372 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.370+0000 7f53a5d36800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.32 info.flags=0x17 2024-09-12T17:34:37.372 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.370+0000 7f53a5d36800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.32 to cache LRU end 2024-09-12T17:34:37.372 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.370+0000 7f53a5d36800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:34:37.372 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.370+0000 7f53a5d36800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.32, ofs0, ns] 2024-09-12T17:34:37.373 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.371+0000 7f5284ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497079 cookie 94455896987888 notifier 7338 bl.length()=1015 2024-09-12T17:34:37.373 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.371+0000 7f5284ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.32 info.flags=0x17 2024-09-12T17:34:37.373 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.371+0000 7f5284ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.32 to cache LRU end 2024-09-12T17:34:37.373 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.371+0000 7f5284ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:34:37.374 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.373+0000 7f53a5d36800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.32]): orig_sources= new_sources= 2024-09-12T17:34:37.374 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.373+0000 7f53a5d36800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.32]): potential sources added=[] removed=[] 2024-09-12T17:34:37.374 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.373+0000 7f53a5d36800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.32]): orig_dests= new_dests= 2024-09-12T17:34:37.374 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.373+0000 7f53a5d36800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.32]): potential dests added=[] removed=[] 2024-09-12T17:34:37.380 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.378+0000 7f53a5d36800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.32.1.0 2024-09-12T17:34:37.380 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.378+0000 7f53a5d36800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.32.1.0 2024-09-12T17:34:37.380 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.378+0000 7f53a5d36800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.32.1.1 2024-09-12T17:34:37.380 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.378+0000 7f53a5d36800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.32.1.1 2024-09-12T17:34:37.380 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.378+0000 7f53a5d36800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.32.1.2 2024-09-12T17:34:37.380 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.378+0000 7f53a5d36800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.32.1.2 2024-09-12T17:34:37.380 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.378+0000 7f53a5d36800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.32.1.3 2024-09-12T17:34:37.380 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.378+0000 7f53a5d36800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.32.1.3 2024-09-12T17:34:37.381 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.378+0000 7f53a5d36800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.32.1.4 2024-09-12T17:34:37.381 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.378+0000 7f53a5d36800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.32.1.4 2024-09-12T17:34:37.381 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.378+0000 7f53a5d36800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.32.1.5 2024-09-12T17:34:37.381 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.378+0000 7f53a5d36800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.32.1.5 2024-09-12T17:34:37.381 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.378+0000 7f53a5d36800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.32.1.6 2024-09-12T17:34:37.381 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.378+0000 7f53a5d36800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.32.1.6 2024-09-12T17:34:37.381 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.378+0000 7f53a5d36800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.32.1.7 2024-09-12T17:34:37.381 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.378+0000 7f53a5d36800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.32.1.7 2024-09-12T17:34:37.381 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.378+0000 7f53a5d36800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.32.1.8 2024-09-12T17:34:37.381 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.378+0000 7f53a5d36800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.32.1.8 2024-09-12T17:34:37.381 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.378+0000 7f53a5d36800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.32.1.9 2024-09-12T17:34:37.381 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.378+0000 7f53a5d36800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.32.1.9 2024-09-12T17:34:37.381 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.378+0000 7f53a5d36800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.32.1.10 2024-09-12T17:34:37.382 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.378+0000 7f53a5d36800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.32.1.10 2024-09-12T17:34:37.382 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.378+0000 7f53a5d36800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.32.1.11 2024-09-12T17:34:37.382 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.378+0000 7f53a5d36800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.32.1.11 2024-09-12T17:34:37.382 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.378+0000 7f53a5d36800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.32.0 2024-09-12T17:34:37.383 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.379+0000 7f53a5d36800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.32.1 2024-09-12T17:34:37.383 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.379+0000 7f53a5d36800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.32.2 2024-09-12T17:34:37.383 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.380+0000 7f53a5d36800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.32.3 2024-09-12T17:34:37.383 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.380+0000 7f53a5d36800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.32.4 2024-09-12T17:34:37.383 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.381+0000 7f53a5d36800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.32.5 2024-09-12T17:34:37.384 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.381+0000 7f53a5d36800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.32.6 2024-09-12T17:34:37.384 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.382+0000 7f53a5d36800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.32.7 2024-09-12T17:34:37.385 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.383+0000 7f53a5d36800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.32.8 2024-09-12T17:34:37.385 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.384+0000 7f53a5d36800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.32.9 2024-09-12T17:34:37.386 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.384+0000 7f53a5d36800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.32.10 2024-09-12T17:34:37.389 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.387+0000 7f53a5d36800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.32 : hit (requested=0x17, cached=0x17) 2024-09-12T17:34:37.389 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.387+0000 7f53a5d36800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.32 2024-09-12T17:34:37.391 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.388+0000 7f53a5d36800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.32 info.flags=0x17 2024-09-12T17:34:37.391 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.388+0000 7f53a5d36800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.32 to cache LRU end 2024-09-12T17:34:37.391 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.388+0000 7f53a5d36800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:34:37.391 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.388+0000 7f53a5d36800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.32, ofs0, ns] 2024-09-12T17:34:37.391 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.389+0000 7f52857fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497080 cookie 94455896987888 notifier 7338 bl.length()=1015 2024-09-12T17:34:37.391 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.389+0000 7f52857fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.32 info.flags=0x17 2024-09-12T17:34:37.391 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.389+0000 7f52857fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.32 to cache LRU end 2024-09-12T17:34:37.391 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.389+0000 7f52857fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:34:37.393 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.391+0000 7f53a5d36800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.32]): orig_sources= new_sources= 2024-09-12T17:34:37.393 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.391+0000 7f53a5d36800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.32]): potential sources added=[] removed=[] 2024-09-12T17:34:37.393 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.391+0000 7f53a5d36800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.32]): orig_dests= new_dests= 2024-09-12T17:34:37.393 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.391+0000 7f53a5d36800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.32]): potential dests added=[] removed=[] 2024-09-12T17:34:37.397 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.395+0000 7f53a5d36800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.32.0 2024-09-12T17:34:37.397 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.395+0000 7f53a5d36800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.32.1 2024-09-12T17:34:37.397 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.396+0000 7f53a5d36800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.32.2 2024-09-12T17:34:37.398 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.396+0000 7f53a5d36800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.32.3 2024-09-12T17:34:37.398 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.396+0000 7f53a5d36800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.32.4 2024-09-12T17:34:37.398 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.397+0000 7f53a5d36800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.32.5 2024-09-12T17:34:37.399 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.397+0000 7f53a5d36800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.32.6 2024-09-12T17:34:37.399 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.398+0000 7f53a5d36800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.32.7 2024-09-12T17:34:37.400 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.398+0000 7f53a5d36800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.32.8 2024-09-12T17:34:37.400 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.398+0000 7f53a5d36800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.32.9 2024-09-12T17:34:37.400 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.399+0000 7f53a5d36800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.32.10 2024-09-12T17:34:37.401 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.399+0000 7f53a5d36800 -1 Injecting error=-125 at location=commit_target_layout 2024-09-12T17:34:37.401 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.399+0000 7f53a5d36800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.32 : hit (requested=0x17, cached=0x17) 2024-09-12T17:34:37.401 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.399+0000 7f53a5d36800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.32 2024-09-12T17:34:37.402 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.401+0000 7f53a5d36800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.32 info.flags=0x17 2024-09-12T17:34:37.402 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.401+0000 7f53a5d36800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.32 to cache LRU end 2024-09-12T17:34:37.403 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.401+0000 7f53a5d36800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:34:37.403 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.401+0000 7f53a5d36800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.32, ofs0, ns] 2024-09-12T17:34:37.403 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.401+0000 7f52857fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497081 cookie 94455896987888 notifier 7338 bl.length()=983 2024-09-12T17:34:37.403 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.401+0000 7f52857fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.32 info.flags=0x17 2024-09-12T17:34:37.403 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.401+0000 7f52857fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.32 to cache LRU end 2024-09-12T17:34:37.403 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.401+0000 7f52857fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:34:37.404 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.403+0000 7f53a5d36800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.32]): orig_sources= new_sources= 2024-09-12T17:34:37.404 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.403+0000 7f53a5d36800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.32]): potential sources added=[] removed=[] 2024-09-12T17:34:37.404 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.403+0000 7f53a5d36800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.32]): orig_dests= new_dests= 2024-09-12T17:34:37.404 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.403+0000 7f53a5d36800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.32]): potential dests added=[] removed=[] 2024-09-12T17:34:37.409 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.407+0000 7f53a5d36800 1 execute INFO: reshard of bucket "error-at-commit-target-layout" from 11 shards to 12 shards completed successfully 2024-09-12T17:34:37.411 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.409+0000 7f5253fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:34:37.414 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.412+0000 7f53a5d36800 20 remove_watcher() i=0 2024-09-12T17:34:37.414 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.412+0000 7f53a5d36800 2 removed watcher, disabling cache 2024-09-12T17:34:37.415 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.413+0000 7f53a5d36800 20 remove_watcher() i=1 2024-09-12T17:34:37.416 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.415+0000 7f53a5d36800 20 remove_watcher() i=2 2024-09-12T17:34:37.417 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.416+0000 7f53a5d36800 20 remove_watcher() i=3 2024-09-12T17:34:37.419 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.417+0000 7f53a5d36800 20 remove_watcher() i=4 2024-09-12T17:34:37.420 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.418+0000 7f53a5d36800 20 remove_watcher() i=5 2024-09-12T17:34:37.421 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.419+0000 7f53a5d36800 20 remove_watcher() i=6 2024-09-12T17:34:37.422 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.420+0000 7f53a5d36800 20 remove_watcher() i=7 2024-09-12T17:34:37.435 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-12T17:34:37.464 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:34:37.465 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:34:37.504 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.503+0000 7f084480e800 20 rados->read ofs=0 len=0 2024-09-12T17:34:37.509 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.504+0000 7f084480e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:37.509 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.504+0000 7f084480e800 20 realm 2024-09-12T17:34:37.509 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.504+0000 7f084480e800 20 rados->read ofs=0 len=0 2024-09-12T17:34:37.509 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.505+0000 7f084480e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:37.509 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.505+0000 7f084480e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:34:37.509 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.505+0000 7f084480e800 20 rados->read ofs=0 len=0 2024-09-12T17:34:37.510 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.505+0000 7f084480e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:37.510 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.505+0000 7f084480e800 20 rados->read ofs=0 len=0 2024-09-12T17:34:37.510 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.506+0000 7f084480e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:34:37.510 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.506+0000 7f084480e800 20 rados->read ofs=0 len=0 2024-09-12T17:34:37.510 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.506+0000 7f084480e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:34:37.510 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.506+0000 7f084480e800 20 searching for the correct realm 2024-09-12T17:34:37.511 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.509+0000 7f083f658640 0 -- 172.21.15.37:0/2330742536 >> [v2:172.21.15.37:6816/2964054205,v1:172.21.15.37:6817/2964054205] conn(0x55942f447bc0 msgr2=0x55942f449fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:34:37.515 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.513+0000 7f083fe59640 0 -- 172.21.15.37:0/2330742536 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7f083404b910 msgr2=0x7f083400a430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:34:37.519 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.517+0000 7f084480e800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:34:37.519 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.517+0000 7f084480e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:34:37.519 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.517+0000 7f084480e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:34:37.519 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.517+0000 7f084480e800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:34:37.519 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.517+0000 7f084480e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:34:37.520 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.517+0000 7f084480e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:34:37.520 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.517+0000 7f084480e800 20 rados->read ofs=0 len=0 2024-09-12T17:34:37.520 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.517+0000 7f084480e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:37.520 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.517+0000 7f084480e800 20 rados->read ofs=0 len=0 2024-09-12T17:34:37.521 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.518+0000 7f084480e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:34:37.521 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.518+0000 7f084480e800 20 rados->read ofs=0 len=0 2024-09-12T17:34:37.521 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.518+0000 7f084480e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:34:37.521 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.518+0000 7f084480e800 20 zone default found 2024-09-12T17:34:37.521 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.518+0000 7f084480e800 4 Realm: () 2024-09-12T17:34:37.521 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.518+0000 7f084480e800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:34:37.521 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.518+0000 7f084480e800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:34:37.521 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.518+0000 7f084480e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:34:37.521 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.518+0000 7f084480e800 20 zonegroup default 2024-09-12T17:34:37.522 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.518+0000 7f084480e800 20 rados->read ofs=0 len=0 2024-09-12T17:34:37.522 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.518+0000 7f084480e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:37.522 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.518+0000 7f084480e800 20 rados->read ofs=0 len=0 2024-09-12T17:34:37.522 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.519+0000 7f084480e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:37.522 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.519+0000 7f084480e800 20 rados->read ofs=0 len=0 2024-09-12T17:34:37.522 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.519+0000 7f084480e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:37.522 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.519+0000 7f084480e800 20 started sync module instance, tier type = 2024-09-12T17:34:37.522 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.519+0000 7f084480e800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:34:37.531 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.529+0000 7f084480e800 20 add_watcher() i=0 2024-09-12T17:34:37.531 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.529+0000 7f084480e800 20 add_watcher() i=1 2024-09-12T17:34:37.531 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.529+0000 7f084480e800 20 add_watcher() i=2 2024-09-12T17:34:37.531 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.529+0000 7f084480e800 20 add_watcher() i=3 2024-09-12T17:34:37.531 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.529+0000 7f084480e800 20 add_watcher() i=4 2024-09-12T17:34:37.531 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.529+0000 7f084480e800 20 add_watcher() i=5 2024-09-12T17:34:37.531 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.529+0000 7f084480e800 20 add_watcher() i=6 2024-09-12T17:34:37.531 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.530+0000 7f084480e800 20 add_watcher() i=7 2024-09-12T17:34:37.532 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.530+0000 7f084480e800 2 all 8 watchers are set, enabling cache 2024-09-12T17:34:37.533 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.532+0000 7f06f5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:34:37.534 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.532+0000 7f084480e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:34:37.534 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.532+0000 7f084480e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:34:37.535 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.532+0000 7f084480e800 5 note: GC not initialized 2024-09-12T17:34:37.535 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.532+0000 7f06f4fe1640 20 reqs_thread_entry: start 2024-09-12T17:34:37.535 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.532+0000 7f084480e800 20 init_complete bucket index max shards: 11 2024-09-12T17:34:37.535 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.532+0000 7f084480e800 20 Filter name: none 2024-09-12T17:34:37.535 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.533+0000 7f066e7fc640 20 reqs_thread_entry: start 2024-09-12T17:34:37.535 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.533+0000 7f084480e800 20 rados->read ofs=0 len=0 2024-09-12T17:34:37.536 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.533+0000 7f084480e800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:34:37.536 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.533+0000 7f084480e800 20 rados->read ofs=0 len=0 2024-09-12T17:34:37.536 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.534+0000 7f084480e800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:34:37.536 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.534+0000 7f084480e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:34:37.536 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.534+0000 7f084480e800 20 rados->read ofs=0 len=0 2024-09-12T17:34:37.536 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.534+0000 7f084480e800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:34:37.536 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.534+0000 7f084480e800 20 rados->read ofs=0 len=0 2024-09-12T17:34:37.537 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.534+0000 7f084480e800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:34:37.537 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.534+0000 7f084480e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:34:37.538 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.536+0000 7f06f5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:34:37.540 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.539+0000 7f084480e800 20 remove_watcher() i=0 2024-09-12T17:34:37.540 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.539+0000 7f084480e800 2 removed watcher, disabling cache 2024-09-12T17:34:37.541 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.540+0000 7f084480e800 20 remove_watcher() i=1 2024-09-12T17:34:37.542 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.541+0000 7f084480e800 20 remove_watcher() i=2 2024-09-12T17:34:37.544 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.542+0000 7f084480e800 20 remove_watcher() i=3 2024-09-12T17:34:37.545 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.543+0000 7f084480e800 20 remove_watcher() i=4 2024-09-12T17:34:37.546 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.544+0000 7f084480e800 20 remove_watcher() i=5 2024-09-12T17:34:37.547 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.545+0000 7f084480e800 20 remove_watcher() i=6 2024-09-12T17:34:37.548 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:37.546+0000 7f084480e800 20 remove_watcher() i=7 2024-09-12T17:34:37.558 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:34:37.559 INFO:tasks.workunit.client.0.smithi037.stderr:BUCKET_STATS: 2024-09-12T17:34:37.559 INFO:tasks.workunit.client.0.smithi037.stderr:bucket: error-at-commit-target-layout id: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.32 num_objects: 20 size_kb: 1 num_shards: 12 2024-09-12T17:34:37.559 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:34:37.916 INFO:tasks.workunit.client.0.smithi037.stderr:TEST: reshard bucket with abort at commit_target_layout 2024-09-12T17:34:37.917 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:34:38.711 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-09-12T17:34:38.740 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:34:38.740 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:34:38.782 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:38.780+0000 7f7bdad25800 20 rados->read ofs=0 len=0 2024-09-12T17:34:38.784 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:38.782+0000 7f7bdad25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:38.784 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:38.782+0000 7f7bdad25800 20 realm 2024-09-12T17:34:38.785 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:38.782+0000 7f7bdad25800 20 rados->read ofs=0 len=0 2024-09-12T17:34:38.785 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:38.782+0000 7f7bdad25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:38.785 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:38.782+0000 7f7bdad25800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:34:38.785 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:38.782+0000 7f7bdad25800 20 rados->read ofs=0 len=0 2024-09-12T17:34:38.785 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:38.782+0000 7f7bdad25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:38.785 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:38.782+0000 7f7bdad25800 20 rados->read ofs=0 len=0 2024-09-12T17:34:38.785 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:38.783+0000 7f7bdad25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:34:38.786 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:38.783+0000 7f7bdad25800 20 rados->read ofs=0 len=0 2024-09-12T17:34:38.786 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:38.784+0000 7f7bdad25800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:34:38.786 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:38.784+0000 7f7bdad25800 20 searching for the correct realm 2024-09-12T17:34:38.787 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:38.785+0000 7f7bd6933640 0 -- 172.21.15.37:0/1588105710 >> [v2:172.21.15.37:6800/1206746176,v1:172.21.15.37:6801/1206746176] conn(0x7f7bd0061020 msgr2=0x7f7bd0007580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:34:38.992 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:38.990+0000 7f7bd7134640 0 -- 172.21.15.37:0/1588105710 >> [v2:172.21.15.40:6818/1210108009,v1:172.21.15.40:6819/1210108009] conn(0x7f7bcc049c20 msgr2=0x7f7bcc0763e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:34:38.999 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:38.997+0000 7f7bdad25800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:34:38.999 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:38.997+0000 7f7bdad25800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:34:38.999 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:38.997+0000 7f7bdad25800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:34:38.999 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:38.997+0000 7f7bdad25800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:34:38.999 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:38.997+0000 7f7bdad25800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:34:38.999 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:38.997+0000 7f7bdad25800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:34:38.999 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:38.997+0000 7f7bdad25800 20 rados->read ofs=0 len=0 2024-09-12T17:34:38.999 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:38.997+0000 7f7bdad25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:38.999 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:38.997+0000 7f7bdad25800 20 rados->read ofs=0 len=0 2024-09-12T17:34:39.000 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:38.997+0000 7f7bdad25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:34:39.000 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:38.997+0000 7f7bdad25800 20 rados->read ofs=0 len=0 2024-09-12T17:34:39.001 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:38.998+0000 7f7bdad25800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:34:39.001 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:38.998+0000 7f7bdad25800 20 zone default found 2024-09-12T17:34:39.001 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:38.998+0000 7f7bdad25800 4 Realm: () 2024-09-12T17:34:39.001 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:38.998+0000 7f7bdad25800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:34:39.001 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:38.998+0000 7f7bdad25800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:34:39.001 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:38.998+0000 7f7bdad25800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:34:39.001 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:38.998+0000 7f7bdad25800 20 zonegroup default 2024-09-12T17:34:39.001 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:38.998+0000 7f7bdad25800 20 rados->read ofs=0 len=0 2024-09-12T17:34:39.001 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:38.998+0000 7f7bdad25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:39.001 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:38.998+0000 7f7bdad25800 20 rados->read ofs=0 len=0 2024-09-12T17:34:39.001 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:38.999+0000 7f7bdad25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:39.001 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:38.999+0000 7f7bdad25800 20 rados->read ofs=0 len=0 2024-09-12T17:34:39.002 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:38.999+0000 7f7bdad25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:39.002 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:38.999+0000 7f7bdad25800 20 started sync module instance, tier type = 2024-09-12T17:34:39.002 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:38.999+0000 7f7bdad25800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:34:39.011 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.009+0000 7f7bdad25800 20 add_watcher() i=0 2024-09-12T17:34:39.011 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.009+0000 7f7bdad25800 20 add_watcher() i=1 2024-09-12T17:34:39.011 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.009+0000 7f7bdad25800 20 add_watcher() i=2 2024-09-12T17:34:39.011 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.009+0000 7f7bdad25800 20 add_watcher() i=3 2024-09-12T17:34:39.011 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.009+0000 7f7bdad25800 20 add_watcher() i=4 2024-09-12T17:34:39.011 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.009+0000 7f7bdad25800 20 add_watcher() i=5 2024-09-12T17:34:39.011 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.009+0000 7f7bdad25800 20 add_watcher() i=6 2024-09-12T17:34:39.012 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.010+0000 7f7bdad25800 20 add_watcher() i=7 2024-09-12T17:34:39.012 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.010+0000 7f7bdad25800 2 all 8 watchers are set, enabling cache 2024-09-12T17:34:39.013 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.012+0000 7f7a8dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:34:39.014 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.012+0000 7f7bdad25800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:34:39.015 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.012+0000 7f7bdad25800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:34:39.015 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.012+0000 7f7bdad25800 5 note: GC not initialized 2024-09-12T17:34:39.015 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.012+0000 7f7a8cfe1640 20 reqs_thread_entry: start 2024-09-12T17:34:39.015 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.013+0000 7f7bdad25800 20 init_complete bucket index max shards: 11 2024-09-12T17:34:39.015 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.013+0000 7f7bdad25800 20 Filter name: none 2024-09-12T17:34:39.015 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.013+0000 7f7a85ffb640 20 reqs_thread_entry: start 2024-09-12T17:34:39.015 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.013+0000 7f7bdad25800 20 rados->read ofs=0 len=0 2024-09-12T17:34:39.016 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.013+0000 7f7bdad25800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:34:39.016 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.013+0000 7f7bdad25800 20 rados->read ofs=0 len=0 2024-09-12T17:34:39.016 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.014+0000 7f7bdad25800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:34:39.017 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.014+0000 7f7bdad25800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:34:39.017 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.014+0000 7f7bdad25800 20 rados->read ofs=0 len=0 2024-09-12T17:34:39.017 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.014+0000 7f7bdad25800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:34:39.017 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.014+0000 7f7bdad25800 20 rados->read ofs=0 len=0 2024-09-12T17:34:39.017 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.014+0000 7f7bdad25800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:34:39.017 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.015+0000 7f7bdad25800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:34:39.018 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.016+0000 7f7a8dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:34:39.020 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.019+0000 7f7bdad25800 20 remove_watcher() i=0 2024-09-12T17:34:39.021 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.019+0000 7f7bdad25800 2 removed watcher, disabling cache 2024-09-12T17:34:39.022 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.020+0000 7f7bdad25800 20 remove_watcher() i=1 2024-09-12T17:34:39.023 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.021+0000 7f7bdad25800 20 remove_watcher() i=2 2024-09-12T17:34:39.024 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.022+0000 7f7bdad25800 20 remove_watcher() i=3 2024-09-12T17:34:39.025 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.023+0000 7f7bdad25800 20 remove_watcher() i=4 2024-09-12T17:34:39.026 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.025+0000 7f7bdad25800 20 remove_watcher() i=5 2024-09-12T17:34:39.027 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.025+0000 7f7bdad25800 20 remove_watcher() i=6 2024-09-12T17:34:39.028 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.026+0000 7f7bdad25800 20 remove_watcher() i=7 2024-09-12T17:34:39.039 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:34:39.039 INFO:tasks.workunit.client.0.smithi037.stderr:BUCKET_STATS: 2024-09-12T17:34:39.039 INFO:tasks.workunit.client.0.smithi037.stderr:bucket: abort-at-commit-target-layout id: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:34:39.039 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:34:39.041 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bucket reshard --bucket abort-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at commit_target_layout 2024-09-12T17:34:39.076 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:34:39.076 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:34:39.299 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.297+0000 7f1e24ca0640 0 --2- 172.21.15.37:0/2585735461 >> [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] conn(0x558a82a0bde0 0x558a82af7ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-12T17:34:39.318 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.316+0000 7f1e271af800 20 rados->read ofs=0 len=0 2024-09-12T17:34:39.320 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.318+0000 7f1e271af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:39.320 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.318+0000 7f1e271af800 20 realm 2024-09-12T17:34:39.320 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.318+0000 7f1e271af800 20 rados->read ofs=0 len=0 2024-09-12T17:34:39.321 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.318+0000 7f1e271af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:39.321 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.318+0000 7f1e271af800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:34:39.321 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.318+0000 7f1e271af800 20 rados->read ofs=0 len=0 2024-09-12T17:34:39.321 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.318+0000 7f1e271af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:39.321 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.318+0000 7f1e271af800 20 rados->read ofs=0 len=0 2024-09-12T17:34:39.321 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.319+0000 7f1e271af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:34:39.322 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.319+0000 7f1e271af800 20 rados->read ofs=0 len=0 2024-09-12T17:34:39.322 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.320+0000 7f1e271af800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:34:39.322 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.320+0000 7f1e271af800 20 searching for the correct realm 2024-09-12T17:34:39.324 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.322+0000 7f1e24ca0640 0 -- 172.21.15.37:0/3805717393 >> [v2:172.21.15.37:6800/1206746176,v1:172.21.15.37:6801/1206746176] conn(0x7f1e1c06d300 msgr2=0x7f1e1c063280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:34:39.328 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.326+0000 7f1e24ca0640 0 -- 172.21.15.37:0/3805717393 >> [v2:172.21.15.37:6800/1206746176,v1:172.21.15.37:6801/1206746176] conn(0x7f1cf0086a90 msgr2=0x7f1cf0088ec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:34:39.334 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.332+0000 7f1e271af800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:34:39.334 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.332+0000 7f1e271af800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:34:39.334 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.332+0000 7f1e271af800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:34:39.334 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.332+0000 7f1e271af800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:34:39.334 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.332+0000 7f1e271af800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:34:39.334 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.332+0000 7f1e271af800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:34:39.334 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.332+0000 7f1e271af800 20 rados->read ofs=0 len=0 2024-09-12T17:34:39.334 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.332+0000 7f1e271af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:39.334 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.332+0000 7f1e271af800 20 rados->read ofs=0 len=0 2024-09-12T17:34:39.335 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.332+0000 7f1e271af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:34:39.336 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.332+0000 7f1e271af800 20 rados->read ofs=0 len=0 2024-09-12T17:34:39.336 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.333+0000 7f1e271af800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:34:39.336 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.333+0000 7f1e271af800 20 zone default found 2024-09-12T17:34:39.336 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.333+0000 7f1e271af800 4 Realm: () 2024-09-12T17:34:39.336 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.333+0000 7f1e271af800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:34:39.336 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.333+0000 7f1e271af800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:34:39.336 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.333+0000 7f1e271af800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:34:39.336 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.333+0000 7f1e271af800 20 zonegroup default 2024-09-12T17:34:39.336 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.333+0000 7f1e271af800 20 rados->read ofs=0 len=0 2024-09-12T17:34:39.336 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.333+0000 7f1e271af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:39.336 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.333+0000 7f1e271af800 20 rados->read ofs=0 len=0 2024-09-12T17:34:39.336 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.333+0000 7f1e271af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:39.336 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.333+0000 7f1e271af800 20 rados->read ofs=0 len=0 2024-09-12T17:34:39.336 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.334+0000 7f1e271af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:39.337 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.334+0000 7f1e271af800 20 started sync module instance, tier type = 2024-09-12T17:34:39.337 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.334+0000 7f1e271af800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:34:39.350 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.344+0000 7f1e271af800 20 add_watcher() i=0 2024-09-12T17:34:39.350 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.344+0000 7f1e271af800 20 add_watcher() i=1 2024-09-12T17:34:39.350 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.344+0000 7f1e271af800 20 add_watcher() i=2 2024-09-12T17:34:39.351 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.344+0000 7f1e271af800 20 add_watcher() i=3 2024-09-12T17:34:39.351 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.344+0000 7f1e271af800 20 add_watcher() i=4 2024-09-12T17:34:39.351 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.344+0000 7f1e271af800 20 add_watcher() i=5 2024-09-12T17:34:39.351 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.344+0000 7f1e271af800 20 add_watcher() i=6 2024-09-12T17:34:39.351 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.345+0000 7f1e271af800 20 add_watcher() i=7 2024-09-12T17:34:39.351 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.345+0000 7f1e271af800 2 all 8 watchers are set, enabling cache 2024-09-12T17:34:39.351 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.346+0000 7f1cdafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:34:39.351 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.347+0000 7f1e271af800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:34:39.351 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.347+0000 7f1e271af800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:34:39.351 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.347+0000 7f1e271af800 5 note: GC not initialized 2024-09-12T17:34:39.351 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.347+0000 7f1cd9fe3640 20 reqs_thread_entry: start 2024-09-12T17:34:39.351 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.347+0000 7f1e271af800 20 init_complete bucket index max shards: 11 2024-09-12T17:34:39.351 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.347+0000 7f1e271af800 20 Filter name: none 2024-09-12T17:34:39.351 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.347+0000 7f1c4b7fe640 20 reqs_thread_entry: start 2024-09-12T17:34:39.352 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.347+0000 7f1e271af800 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-12T17:34:39.352 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.347+0000 7f1e271af800 20 rados->read ofs=0 len=0 2024-09-12T17:34:39.352 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.348+0000 7f1e271af800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:34:39.352 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.348+0000 7f1e271af800 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-12T17:34:39.352 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.348+0000 7f1e271af800 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-12T17:34:39.352 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.348+0000 7f1e271af800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33 : miss 2024-09-12T17:34:39.352 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.348+0000 7f1e271af800 20 rados->read ofs=0 len=0 2024-09-12T17:34:39.352 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.348+0000 7f1e271af800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:34:39.352 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.348+0000 7f1e271af800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33 info.flags=0x17 2024-09-12T17:34:39.352 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.348+0000 7f1e271af800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33 to cache LRU end 2024-09-12T17:34:39.352 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.348+0000 7f1e271af800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:34:39.352 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.348+0000 7f1e271af800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:34:39.352 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.348+0000 7f1e271af800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33 2024-09-12T17:34:39.355 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.354+0000 7f1e271af800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33 info.flags=0x17 2024-09-12T17:34:39.355 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.354+0000 7f1e271af800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33 to cache LRU end 2024-09-12T17:34:39.356 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.354+0000 7f1e271af800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:34:39.356 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.354+0000 7f1e271af800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33, ofs0, ns] 2024-09-12T17:34:39.356 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.354+0000 7f1cfb7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496991 cookie 94053387230944 notifier 6920 bl.length()=1015 2024-09-12T17:34:39.356 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.354+0000 7f1cfb7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33 info.flags=0x17 2024-09-12T17:34:39.357 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.354+0000 7f1cfb7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33 to cache LRU end 2024-09-12T17:34:39.357 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.354+0000 7f1cfb7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:34:39.357 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.356+0000 7f1e271af800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33]): orig_sources= new_sources= 2024-09-12T17:34:39.357 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.356+0000 7f1e271af800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33]): potential sources added=[] removed=[] 2024-09-12T17:34:39.358 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.356+0000 7f1e271af800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33]): orig_dests= new_dests= 2024-09-12T17:34:39.358 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.356+0000 7f1e271af800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33]): potential dests added=[] removed=[] 2024-09-12T17:34:39.363 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.361+0000 7f1e271af800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.1.0 2024-09-12T17:34:39.363 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.361+0000 7f1e271af800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.1.0 2024-09-12T17:34:39.363 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.361+0000 7f1e271af800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.1.1 2024-09-12T17:34:39.363 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.361+0000 7f1e271af800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.1.1 2024-09-12T17:34:39.363 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.361+0000 7f1e271af800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.1.2 2024-09-12T17:34:39.363 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.361+0000 7f1e271af800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.1.2 2024-09-12T17:34:39.363 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.361+0000 7f1e271af800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.1.3 2024-09-12T17:34:39.363 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.361+0000 7f1e271af800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.1.3 2024-09-12T17:34:39.363 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.361+0000 7f1e271af800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.1.4 2024-09-12T17:34:39.363 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.361+0000 7f1e271af800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.1.4 2024-09-12T17:34:39.363 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.361+0000 7f1e271af800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.1.5 2024-09-12T17:34:39.363 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.361+0000 7f1e271af800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.1.5 2024-09-12T17:34:39.363 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.361+0000 7f1e271af800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.1.6 2024-09-12T17:34:39.363 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.361+0000 7f1e271af800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.1.6 2024-09-12T17:34:39.364 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.361+0000 7f1e271af800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.1.7 2024-09-12T17:34:39.364 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.361+0000 7f1e271af800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.1.7 2024-09-12T17:34:39.364 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.361+0000 7f1e271af800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.1.8 2024-09-12T17:34:39.364 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.361+0000 7f1e271af800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.1.8 2024-09-12T17:34:39.364 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.361+0000 7f1e271af800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.1.9 2024-09-12T17:34:39.364 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.361+0000 7f1e271af800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.1.9 2024-09-12T17:34:39.364 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.361+0000 7f1e271af800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.1.10 2024-09-12T17:34:39.364 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.361+0000 7f1e271af800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.1.10 2024-09-12T17:34:39.364 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.361+0000 7f1e271af800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.1.11 2024-09-12T17:34:39.364 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.361+0000 7f1e271af800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.1.11 2024-09-12T17:34:39.364 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.361+0000 7f1e271af800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.0 2024-09-12T17:34:39.365 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.361+0000 7f1e271af800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.1 2024-09-12T17:34:39.365 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.362+0000 7f1e271af800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.2 2024-09-12T17:34:39.365 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.362+0000 7f1e271af800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.3 2024-09-12T17:34:39.365 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.363+0000 7f1e271af800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.4 2024-09-12T17:34:39.366 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.364+0000 7f1e271af800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.5 2024-09-12T17:34:39.366 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.365+0000 7f1e271af800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.6 2024-09-12T17:34:39.367 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.365+0000 7f1e271af800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.7 2024-09-12T17:34:39.368 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.366+0000 7f1e271af800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.8 2024-09-12T17:34:39.368 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.367+0000 7f1e271af800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.9 2024-09-12T17:34:39.369 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.367+0000 7f1e271af800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.10 2024-09-12T17:34:39.373 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.371+0000 7f1e271af800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33 : hit (requested=0x17, cached=0x17) 2024-09-12T17:34:39.373 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.371+0000 7f1e271af800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33 2024-09-12T17:34:39.374 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.372+0000 7f1e271af800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33 info.flags=0x17 2024-09-12T17:34:39.374 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.372+0000 7f1e271af800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33 to cache LRU end 2024-09-12T17:34:39.374 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.372+0000 7f1e271af800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:34:39.374 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.372+0000 7f1e271af800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33, ofs0, ns] 2024-09-12T17:34:39.374 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.372+0000 7f1cfbfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496992 cookie 94053387230944 notifier 6920 bl.length()=1015 2024-09-12T17:34:39.374 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.372+0000 7f1cfbfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33 info.flags=0x17 2024-09-12T17:34:39.375 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.372+0000 7f1cfbfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33 to cache LRU end 2024-09-12T17:34:39.375 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.372+0000 7f1cfbfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:34:39.375 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.374+0000 7f1e271af800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33]): orig_sources= new_sources= 2024-09-12T17:34:39.376 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.374+0000 7f1e271af800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33]): potential sources added=[] removed=[] 2024-09-12T17:34:39.376 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.374+0000 7f1e271af800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33]): orig_dests= new_dests= 2024-09-12T17:34:39.376 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.374+0000 7f1e271af800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33]): potential dests added=[] removed=[] 2024-09-12T17:34:39.378 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.377+0000 7f1e271af800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.0 2024-09-12T17:34:39.379 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.377+0000 7f1e271af800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.1 2024-09-12T17:34:39.379 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.377+0000 7f1e271af800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.2 2024-09-12T17:34:39.379 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.377+0000 7f1e271af800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.3 2024-09-12T17:34:39.380 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.378+0000 7f1e271af800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.4 2024-09-12T17:34:39.380 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.378+0000 7f1e271af800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.5 2024-09-12T17:34:39.380 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.378+0000 7f1e271af800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.6 2024-09-12T17:34:39.380 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.379+0000 7f1e271af800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.7 2024-09-12T17:34:39.381 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.379+0000 7f1e271af800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.8 2024-09-12T17:34:39.381 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.379+0000 7f1e271af800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.9 2024-09-12T17:34:39.381 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.380+0000 7f1e271af800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.10 2024-09-12T17:34:39.382 INFO:tasks.workunit.client.0.smithi037.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f1e271af800 time 2024-09-12T17:34:39.382198+0000 2024-09-12T17:34:39.382 INFO:tasks.workunit.client.0.smithi037.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:34:39.382 INFO:tasks.workunit.client.0.smithi037.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:34:39.382 INFO:tasks.workunit.client.0.smithi037.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f1e2a78c71a] 2024-09-12T17:34:39.383 INFO:tasks.workunit.client.0.smithi037.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f1e2a78c8d8] 2024-09-12T17:34:39.383 INFO:tasks.workunit.client.0.smithi037.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x558a81d58841] 2024-09-12T17:34:39.383 INFO:tasks.workunit.client.0.smithi037.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x558a81d68827] 2024-09-12T17:34:39.383 INFO:tasks.workunit.client.0.smithi037.stderr: 5: main() 2024-09-12T17:34:39.383 INFO:tasks.workunit.client.0.smithi037.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f1e29429590] 2024-09-12T17:34:39.383 INFO:tasks.workunit.client.0.smithi037.stderr: 7: __libc_start_main() 2024-09-12T17:34:39.383 INFO:tasks.workunit.client.0.smithi037.stderr: 8: _start() 2024-09-12T17:34:39.383 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.381+0000 7f1e271af800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f1e271af800 time 2024-09-12T17:34:39.382198+0000 2024-09-12T17:34:39.383 INFO:tasks.workunit.client.0.smithi037.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:34:39.383 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:34:39.383 INFO:tasks.workunit.client.0.smithi037.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:34:39.383 INFO:tasks.workunit.client.0.smithi037.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f1e2a78c71a] 2024-09-12T17:34:39.383 INFO:tasks.workunit.client.0.smithi037.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f1e2a78c8d8] 2024-09-12T17:34:39.384 INFO:tasks.workunit.client.0.smithi037.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x558a81d58841] 2024-09-12T17:34:39.384 INFO:tasks.workunit.client.0.smithi037.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x558a81d68827] 2024-09-12T17:34:39.384 INFO:tasks.workunit.client.0.smithi037.stderr: 5: main() 2024-09-12T17:34:39.384 INFO:tasks.workunit.client.0.smithi037.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f1e29429590] 2024-09-12T17:34:39.384 INFO:tasks.workunit.client.0.smithi037.stderr: 7: __libc_start_main() 2024-09-12T17:34:39.384 INFO:tasks.workunit.client.0.smithi037.stderr: 8: _start() 2024-09-12T17:34:39.384 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:34:39.384 INFO:tasks.workunit.client.0.smithi037.stderr:*** Caught signal (Aborted) ** 2024-09-12T17:34:39.384 INFO:tasks.workunit.client.0.smithi037.stderr: in thread 7f1e271af800 thread_name:radosgw-admin 2024-09-12T17:34:39.399 INFO:tasks.workunit.client.0.smithi037.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:34:39.400 INFO:tasks.workunit.client.0.smithi037.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f1e2943e6f0] 2024-09-12T17:34:39.400 INFO:tasks.workunit.client.0.smithi037.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f1e2948b99c] 2024-09-12T17:34:39.400 INFO:tasks.workunit.client.0.smithi037.stderr: 3: raise() 2024-09-12T17:34:39.400 INFO:tasks.workunit.client.0.smithi037.stderr: 4: abort() 2024-09-12T17:34:39.400 INFO:tasks.workunit.client.0.smithi037.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f1e2a78c774] 2024-09-12T17:34:39.400 INFO:tasks.workunit.client.0.smithi037.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f1e2a78c8d8] 2024-09-12T17:34:39.400 INFO:tasks.workunit.client.0.smithi037.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x558a81d58841] 2024-09-12T17:34:39.400 INFO:tasks.workunit.client.0.smithi037.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x558a81d68827] 2024-09-12T17:34:39.400 INFO:tasks.workunit.client.0.smithi037.stderr: 9: main() 2024-09-12T17:34:39.400 INFO:tasks.workunit.client.0.smithi037.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f1e29429590] 2024-09-12T17:34:39.400 INFO:tasks.workunit.client.0.smithi037.stderr: 11: __libc_start_main() 2024-09-12T17:34:39.401 INFO:tasks.workunit.client.0.smithi037.stderr: 12: _start() 2024-09-12T17:34:39.401 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.381+0000 7f1e271af800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:34:39.401 INFO:tasks.workunit.client.0.smithi037.stderr: in thread 7f1e271af800 thread_name:radosgw-admin 2024-09-12T17:34:39.401 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:34:39.401 INFO:tasks.workunit.client.0.smithi037.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:34:39.401 INFO:tasks.workunit.client.0.smithi037.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f1e2943e6f0] 2024-09-12T17:34:39.401 INFO:tasks.workunit.client.0.smithi037.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f1e2948b99c] 2024-09-12T17:34:39.401 INFO:tasks.workunit.client.0.smithi037.stderr: 3: raise() 2024-09-12T17:34:39.401 INFO:tasks.workunit.client.0.smithi037.stderr: 4: abort() 2024-09-12T17:34:39.401 INFO:tasks.workunit.client.0.smithi037.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f1e2a78c774] 2024-09-12T17:34:39.401 INFO:tasks.workunit.client.0.smithi037.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f1e2a78c8d8] 2024-09-12T17:34:39.401 INFO:tasks.workunit.client.0.smithi037.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x558a81d58841] 2024-09-12T17:34:39.401 INFO:tasks.workunit.client.0.smithi037.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x558a81d68827] 2024-09-12T17:34:39.402 INFO:tasks.workunit.client.0.smithi037.stderr: 9: main() 2024-09-12T17:34:39.402 INFO:tasks.workunit.client.0.smithi037.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f1e29429590] 2024-09-12T17:34:39.402 INFO:tasks.workunit.client.0.smithi037.stderr: 11: __libc_start_main() 2024-09-12T17:34:39.402 INFO:tasks.workunit.client.0.smithi037.stderr: 12: _start() 2024-09-12T17:34:39.402 INFO:tasks.workunit.client.0.smithi037.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:34:39.402 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:34:39.402 INFO:tasks.workunit.client.0.smithi037.stderr:--- begin dump of recent events --- 2024-09-12T17:34:39.402 INFO:tasks.workunit.client.0.smithi037.stderr: -499> 2024-09-12T17:34:39.300+0000 7f1e2449f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:34:39.402 INFO:tasks.workunit.client.0.smithi037.stderr: -498> 2024-09-12T17:34:39.300+0000 7f1e2449f640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:34:39.402 INFO:tasks.workunit.client.0.smithi037.stderr: -497> 2024-09-12T17:34:39.300+0000 7f1e2449f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:34:39.402 INFO:tasks.workunit.client.0.smithi037.stderr: -496> 2024-09-12T17:34:39.300+0000 7f1e254a1640 10 monclient(hunting): get_auth_request con 0x7f1d0c006e40 auth_method 0 2024-09-12T17:34:39.402 INFO:tasks.workunit.client.0.smithi037.stderr: -495> 2024-09-12T17:34:39.300+0000 7f1e254a1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:34:39.402 INFO:tasks.workunit.client.0.smithi037.stderr: -494> 2024-09-12T17:34:39.300+0000 7f1e254a1640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:34:39.403 INFO:tasks.workunit.client.0.smithi037.stderr: -493> 2024-09-12T17:34:39.300+0000 7f1e254a1640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:34:39.403 INFO:tasks.workunit.client.0.smithi037.stderr: -492> 2024-09-12T17:34:39.300+0000 7f1e2449f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:34:39.403 INFO:tasks.workunit.client.0.smithi037.stderr: -491> 2024-09-12T17:34:39.300+0000 7f1e2449f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:34:39.403 INFO:tasks.workunit.client.0.smithi037.stderr: -490> 2024-09-12T17:34:39.300+0000 7f1e2449f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:34:39.403 INFO:tasks.workunit.client.0.smithi037.stderr: -489> 2024-09-12T17:34:39.300+0000 7f1e254a1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:34:39.403 INFO:tasks.workunit.client.0.smithi037.stderr: -488> 2024-09-12T17:34:39.300+0000 7f1e254a1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:34:39.403 INFO:tasks.workunit.client.0.smithi037.stderr: -487> 2024-09-12T17:34:39.300+0000 7f1e254a1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:34:39.403 INFO:tasks.workunit.client.0.smithi037.stderr: -486> 2024-09-12T17:34:39.300+0000 7f1e2449f640 10 monclient(hunting): handle_auth_done global_id 7383 payload 824 2024-09-12T17:34:39.403 INFO:tasks.workunit.client.0.smithi037.stderr: -485> 2024-09-12T17:34:39.300+0000 7f1e2449f640 10 monclient: _finish_hunting 0 2024-09-12T17:34:39.403 INFO:tasks.workunit.client.0.smithi037.stderr: -484> 2024-09-12T17:34:39.300+0000 7f1e2449f640 1 monclient: found mon.noname-a 2024-09-12T17:34:39.403 INFO:tasks.workunit.client.0.smithi037.stderr: -483> 2024-09-12T17:34:39.300+0000 7f1e2449f640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.37:3300/0 2024-09-12T17:34:39.403 INFO:tasks.workunit.client.0.smithi037.stderr: -482> 2024-09-12T17:34:39.300+0000 7f1e24ca0640 10 monclient: get_auth_request con 0x558a82a0c1c0 auth_method 0 2024-09-12T17:34:39.403 INFO:tasks.workunit.client.0.smithi037.stderr: -481> 2024-09-12T17:34:39.300+0000 7f1d1160a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:34:39.403 INFO:tasks.workunit.client.0.smithi037.stderr: -480> 2024-09-12T17:34:39.300+0000 7f1d1160a640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:34:39.403 INFO:tasks.workunit.client.0.smithi037.stderr: -479> 2024-09-12T17:34:39.300+0000 7f1d1160a640 10 monclient: dump: 2024-09-12T17:34:39.404 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:34:39.404 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:34:39.404 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:34:39.404 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:34:39.404 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:34:39.404 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:34:39.404 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:34:39.404 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:34:39.404 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:34:39.404 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:34:39.404 INFO:tasks.workunit.client.0.smithi037.stderr: -478> 2024-09-12T17:34:39.300+0000 7f1d1160a640 10 monclient: _finish_auth 0 2024-09-12T17:34:39.404 INFO:tasks.workunit.client.0.smithi037.stderr: -477> 2024-09-12T17:34:39.300+0000 7f1d1160a640 10 monclient: _check_auth_tickets 2024-09-12T17:34:39.404 INFO:tasks.workunit.client.0.smithi037.stderr: -476> 2024-09-12T17:34:39.300+0000 7f1d1160a640 10 monclient: handle_config config(0 keys) 2024-09-12T17:34:39.405 INFO:tasks.workunit.client.0.smithi037.stderr: -475> 2024-09-12T17:34:39.300+0000 7f1d1160a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:34:39.405 INFO:tasks.workunit.client.0.smithi037.stderr: -474> 2024-09-12T17:34:39.300+0000 7f1d1160a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:34:39.405 INFO:tasks.workunit.client.0.smithi037.stderr: -473> 2024-09-12T17:34:39.300+0000 7f1d1160a640 10 monclient: dump: 2024-09-12T17:34:39.405 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:34:39.405 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:34:39.405 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:34:39.405 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:34:39.405 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:34:39.405 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:34:39.405 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:34:39.405 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:34:39.405 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:34:39.405 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:34:39.406 INFO:tasks.workunit.client.0.smithi037.stderr: -472> 2024-09-12T17:34:39.300+0000 7f1e271af800 5 monclient: authenticate success, global_id 7383 2024-09-12T17:34:39.406 INFO:tasks.workunit.client.0.smithi037.stderr: -471> 2024-09-12T17:34:39.300+0000 7f1e271af800 10 monclient: _renew_subs 2024-09-12T17:34:39.406 INFO:tasks.workunit.client.0.smithi037.stderr: -470> 2024-09-12T17:34:39.300+0000 7f1e271af800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.37:3300/0 2024-09-12T17:34:39.406 INFO:tasks.workunit.client.0.smithi037.stderr: -469> 2024-09-12T17:34:39.300+0000 7f1d12e0d640 4 set_mon_vals no callback set 2024-09-12T17:34:39.406 INFO:tasks.workunit.client.0.smithi037.stderr: -468> 2024-09-12T17:34:39.300+0000 7f1e271af800 10 monclient: _renew_subs 2024-09-12T17:34:39.406 INFO:tasks.workunit.client.0.smithi037.stderr: -467> 2024-09-12T17:34:39.300+0000 7f1e271af800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.37:3300/0 2024-09-12T17:34:39.406 INFO:tasks.workunit.client.0.smithi037.stderr: -466> 2024-09-12T17:34:39.300+0000 7f1e271af800 1 librados: init done 2024-09-12T17:34:39.406 INFO:tasks.workunit.client.0.smithi037.stderr: -465> 2024-09-12T17:34:39.302+0000 7f1d1160a640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:34:39.406 INFO:tasks.workunit.client.0.smithi037.stderr: -464> 2024-09-12T17:34:39.302+0000 7f1d1160a640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.40:6816/3916250676,v1:172.21.15.40:6817/3916250676] 2024-09-12T17:34:39.406 INFO:tasks.workunit.client.0.smithi037.stderr: -463> 2024-09-12T17:34:39.302+0000 7f1d1160a640 4 mgrc reconnect Starting new session with [v2:172.21.15.40:6816/3916250676,v1:172.21.15.40:6817/3916250676] 2024-09-12T17:34:39.406 INFO:tasks.workunit.client.0.smithi037.stderr: -462> 2024-09-12T17:34:39.303+0000 7f1e24ca0640 10 monclient: get_auth_request con 0x7f1d0c077550 auth_method 0 2024-09-12T17:34:39.406 INFO:tasks.workunit.client.0.smithi037.stderr: -461> 2024-09-12T17:34:39.303+0000 7f1e254a1640 10 monclient: get_auth_request con 0x558a82afc1f0 auth_method 0 2024-09-12T17:34:39.406 INFO:tasks.workunit.client.0.smithi037.stderr: -460> 2024-09-12T17:34:39.304+0000 7f1e24ca0640 10 monclient: get_auth_request con 0x558a82b13d50 auth_method 0 2024-09-12T17:34:39.406 INFO:tasks.workunit.client.0.smithi037.stderr: -459> 2024-09-12T17:34:39.306+0000 7f1e2449f640 10 monclient: get_auth_request con 0x558a82b18de0 auth_method 0 2024-09-12T17:34:39.406 INFO:tasks.workunit.client.0.smithi037.stderr: -458> 2024-09-12T17:34:39.306+0000 7f1e271af800 10 monclient: build_initial_monmap 2024-09-12T17:34:39.407 INFO:tasks.workunit.client.0.smithi037.stderr: -457> 2024-09-12T17:34:39.306+0000 7f1e271af800 1 build_initial for_mkfs: 0 2024-09-12T17:34:39.407 INFO:tasks.workunit.client.0.smithi037.stderr: -456> 2024-09-12T17:34:39.306+0000 7f1e271af800 10 monclient: monmap: 2024-09-12T17:34:39.407 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 0 2024-09-12T17:34:39.407 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:34:39.407 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 0.000000 2024-09-12T17:34:39.407 INFO:tasks.workunit.client.0.smithi037.stderr:created 0.000000 2024-09-12T17:34:39.407 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 0 (unknown) 2024-09-12T17:34:39.407 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:34:39.407 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.noname-a 2024-09-12T17:34:39.407 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.noname-b 2024-09-12T17:34:39.407 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.noname-c 2024-09-12T17:34:39.407 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:34:39.407 INFO:tasks.workunit.client.0.smithi037.stderr: -455> 2024-09-12T17:34:39.306+0000 7f1e271af800 5 AuthRegistry(0x558a82b1ce60) adding auth protocol: cephx 2024-09-12T17:34:39.408 INFO:tasks.workunit.client.0.smithi037.stderr: -454> 2024-09-12T17:34:39.306+0000 7f1e271af800 5 AuthRegistry(0x558a82b1ce60) adding auth protocol: cephx 2024-09-12T17:34:39.408 INFO:tasks.workunit.client.0.smithi037.stderr: -453> 2024-09-12T17:34:39.306+0000 7f1e271af800 5 AuthRegistry(0x558a82b1ce60) adding auth protocol: cephx 2024-09-12T17:34:39.408 INFO:tasks.workunit.client.0.smithi037.stderr: -452> 2024-09-12T17:34:39.306+0000 7f1e271af800 5 AuthRegistry(0x558a82b1ce60) adding con mode: secure 2024-09-12T17:34:39.408 INFO:tasks.workunit.client.0.smithi037.stderr: -451> 2024-09-12T17:34:39.306+0000 7f1e271af800 5 AuthRegistry(0x558a82b1ce60) adding con mode: crc 2024-09-12T17:34:39.408 INFO:tasks.workunit.client.0.smithi037.stderr: -450> 2024-09-12T17:34:39.306+0000 7f1e271af800 5 AuthRegistry(0x558a82b1ce60) adding con mode: secure 2024-09-12T17:34:39.408 INFO:tasks.workunit.client.0.smithi037.stderr: -449> 2024-09-12T17:34:39.306+0000 7f1e271af800 5 AuthRegistry(0x558a82b1ce60) adding con mode: crc 2024-09-12T17:34:39.408 INFO:tasks.workunit.client.0.smithi037.stderr: -448> 2024-09-12T17:34:39.306+0000 7f1e271af800 5 AuthRegistry(0x558a82b1ce60) adding con mode: secure 2024-09-12T17:34:39.408 INFO:tasks.workunit.client.0.smithi037.stderr: -447> 2024-09-12T17:34:39.306+0000 7f1e271af800 5 AuthRegistry(0x558a82b1ce60) adding con mode: crc 2024-09-12T17:34:39.408 INFO:tasks.workunit.client.0.smithi037.stderr: -446> 2024-09-12T17:34:39.306+0000 7f1e271af800 5 AuthRegistry(0x558a82b1ce60) adding con mode: crc 2024-09-12T17:34:39.408 INFO:tasks.workunit.client.0.smithi037.stderr: -445> 2024-09-12T17:34:39.306+0000 7f1e271af800 5 AuthRegistry(0x558a82b1ce60) adding con mode: secure 2024-09-12T17:34:39.408 INFO:tasks.workunit.client.0.smithi037.stderr: -444> 2024-09-12T17:34:39.306+0000 7f1e271af800 5 AuthRegistry(0x558a82b1ce60) adding con mode: crc 2024-09-12T17:34:39.408 INFO:tasks.workunit.client.0.smithi037.stderr: -443> 2024-09-12T17:34:39.306+0000 7f1e271af800 5 AuthRegistry(0x558a82b1ce60) adding con mode: secure 2024-09-12T17:34:39.408 INFO:tasks.workunit.client.0.smithi037.stderr: -442> 2024-09-12T17:34:39.306+0000 7f1e271af800 5 AuthRegistry(0x558a82b1ce60) adding con mode: crc 2024-09-12T17:34:39.408 INFO:tasks.workunit.client.0.smithi037.stderr: -441> 2024-09-12T17:34:39.306+0000 7f1e271af800 5 AuthRegistry(0x558a82b1ce60) adding con mode: secure 2024-09-12T17:34:39.409 INFO:tasks.workunit.client.0.smithi037.stderr: -440> 2024-09-12T17:34:39.307+0000 7f1e271af800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:34:39.409 INFO:tasks.workunit.client.0.smithi037.stderr: -439> 2024-09-12T17:34:39.307+0000 7f1e271af800 5 asok(0x558a828a4730) register_command objecter_requests cmddesc objecter_requests hook 0x558a82b20330 EEXIST 2024-09-12T17:34:39.409 INFO:tasks.workunit.client.0.smithi037.stderr: -438> 2024-09-12T17:34:39.307+0000 7f1e271af800 10 monclient: init 2024-09-12T17:34:39.409 INFO:tasks.workunit.client.0.smithi037.stderr: -437> 2024-09-12T17:34:39.307+0000 7f1e271af800 5 AuthRegistry(0x558a82b1be18) adding auth protocol: cephx 2024-09-12T17:34:39.409 INFO:tasks.workunit.client.0.smithi037.stderr: -436> 2024-09-12T17:34:39.307+0000 7f1e271af800 5 AuthRegistry(0x558a82b1be18) adding auth protocol: cephx 2024-09-12T17:34:39.409 INFO:tasks.workunit.client.0.smithi037.stderr: -435> 2024-09-12T17:34:39.307+0000 7f1e271af800 5 AuthRegistry(0x558a82b1be18) adding auth protocol: cephx 2024-09-12T17:34:39.409 INFO:tasks.workunit.client.0.smithi037.stderr: -434> 2024-09-12T17:34:39.307+0000 7f1e271af800 5 AuthRegistry(0x558a82b1be18) adding con mode: secure 2024-09-12T17:34:39.409 INFO:tasks.workunit.client.0.smithi037.stderr: -433> 2024-09-12T17:34:39.307+0000 7f1e271af800 5 AuthRegistry(0x558a82b1be18) adding con mode: crc 2024-09-12T17:34:39.409 INFO:tasks.workunit.client.0.smithi037.stderr: -432> 2024-09-12T17:34:39.307+0000 7f1e271af800 5 AuthRegistry(0x558a82b1be18) adding con mode: secure 2024-09-12T17:34:39.409 INFO:tasks.workunit.client.0.smithi037.stderr: -431> 2024-09-12T17:34:39.307+0000 7f1e271af800 5 AuthRegistry(0x558a82b1be18) adding con mode: crc 2024-09-12T17:34:39.409 INFO:tasks.workunit.client.0.smithi037.stderr: -430> 2024-09-12T17:34:39.307+0000 7f1e271af800 5 AuthRegistry(0x558a82b1be18) adding con mode: secure 2024-09-12T17:34:39.409 INFO:tasks.workunit.client.0.smithi037.stderr: -429> 2024-09-12T17:34:39.307+0000 7f1e271af800 5 AuthRegistry(0x558a82b1be18) adding con mode: crc 2024-09-12T17:34:39.409 INFO:tasks.workunit.client.0.smithi037.stderr: -428> 2024-09-12T17:34:39.307+0000 7f1e271af800 5 AuthRegistry(0x558a82b1be18) adding con mode: crc 2024-09-12T17:34:39.410 INFO:tasks.workunit.client.0.smithi037.stderr: -427> 2024-09-12T17:34:39.307+0000 7f1e271af800 5 AuthRegistry(0x558a82b1be18) adding con mode: secure 2024-09-12T17:34:39.410 INFO:tasks.workunit.client.0.smithi037.stderr: -426> 2024-09-12T17:34:39.307+0000 7f1e271af800 5 AuthRegistry(0x558a82b1be18) adding con mode: crc 2024-09-12T17:34:39.410 INFO:tasks.workunit.client.0.smithi037.stderr: -425> 2024-09-12T17:34:39.307+0000 7f1e271af800 5 AuthRegistry(0x558a82b1be18) adding con mode: secure 2024-09-12T17:34:39.410 INFO:tasks.workunit.client.0.smithi037.stderr: -424> 2024-09-12T17:34:39.307+0000 7f1e271af800 5 AuthRegistry(0x558a82b1be18) adding con mode: crc 2024-09-12T17:34:39.410 INFO:tasks.workunit.client.0.smithi037.stderr: -423> 2024-09-12T17:34:39.307+0000 7f1e271af800 5 AuthRegistry(0x558a82b1be18) adding con mode: secure 2024-09-12T17:34:39.410 INFO:tasks.workunit.client.0.smithi037.stderr: -422> 2024-09-12T17:34:39.307+0000 7f1e271af800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:34:39.410 INFO:tasks.workunit.client.0.smithi037.stderr: -421> 2024-09-12T17:34:39.307+0000 7f1e271af800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:34:39.410 INFO:tasks.workunit.client.0.smithi037.stderr: -420> 2024-09-12T17:34:39.307+0000 7f1e271af800 5 asok(0x558a828a4730) register_command rotate-key cmddesc rotate-key hook 0x558a82b1bf60 EEXIST 2024-09-12T17:34:39.410 INFO:tasks.workunit.client.0.smithi037.stderr: -419> 2024-09-12T17:34:39.307+0000 7f1e271af800 10 monclient: _reopen_session rank -1 2024-09-12T17:34:39.410 INFO:tasks.workunit.client.0.smithi037.stderr: -418> 2024-09-12T17:34:39.307+0000 7f1e271af800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T17:34:39.410 INFO:tasks.workunit.client.0.smithi037.stderr: -417> 2024-09-12T17:34:39.307+0000 7f1e271af800 10 monclient(hunting): picked mon.noname-b con 0x558a82b44650 addr [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] 2024-09-12T17:34:39.410 INFO:tasks.workunit.client.0.smithi037.stderr: -416> 2024-09-12T17:34:39.307+0000 7f1e271af800 10 monclient(hunting): picked mon.noname-c con 0x558a82b44a30 addr [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] 2024-09-12T17:34:39.410 INFO:tasks.workunit.client.0.smithi037.stderr: -415> 2024-09-12T17:34:39.307+0000 7f1e271af800 10 monclient(hunting): picked mon.noname-a con 0x558a82b43360 addr [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] 2024-09-12T17:34:39.411 INFO:tasks.workunit.client.0.smithi037.stderr: -414> 2024-09-12T17:34:39.307+0000 7f1e271af800 10 monclient(hunting): start opening mon connection 2024-09-12T17:34:39.411 INFO:tasks.workunit.client.0.smithi037.stderr: -413> 2024-09-12T17:34:39.307+0000 7f1e271af800 10 monclient(hunting): start opening mon connection 2024-09-12T17:34:39.411 INFO:tasks.workunit.client.0.smithi037.stderr: -412> 2024-09-12T17:34:39.307+0000 7f1e271af800 10 monclient(hunting): start opening mon connection 2024-09-12T17:34:39.411 INFO:tasks.workunit.client.0.smithi037.stderr: -411> 2024-09-12T17:34:39.307+0000 7f1e271af800 10 monclient(hunting): _renew_subs 2024-09-12T17:34:39.411 INFO:tasks.workunit.client.0.smithi037.stderr: -410> 2024-09-12T17:34:39.307+0000 7f1e271af800 10 monclient(hunting): authenticate will time out at 2266.905998s 2024-09-12T17:34:39.411 INFO:tasks.workunit.client.0.smithi037.stderr: -409> 2024-09-12T17:34:39.308+0000 7f1e2449f640 10 monclient(hunting): get_auth_request con 0x558a82b44a30 auth_method 0 2024-09-12T17:34:39.411 INFO:tasks.workunit.client.0.smithi037.stderr: -408> 2024-09-12T17:34:39.308+0000 7f1e2449f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:34:39.411 INFO:tasks.workunit.client.0.smithi037.stderr: -407> 2024-09-12T17:34:39.308+0000 7f1e2449f640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:34:39.411 INFO:tasks.workunit.client.0.smithi037.stderr: -406> 2024-09-12T17:34:39.308+0000 7f1e2449f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:34:39.411 INFO:tasks.workunit.client.0.smithi037.stderr: -405> 2024-09-12T17:34:39.308+0000 7f1e254a1640 10 monclient(hunting): get_auth_request con 0x558a82b43360 auth_method 0 2024-09-12T17:34:39.411 INFO:tasks.workunit.client.0.smithi037.stderr: -404> 2024-09-12T17:34:39.308+0000 7f1e254a1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:34:39.411 INFO:tasks.workunit.client.0.smithi037.stderr: -403> 2024-09-12T17:34:39.308+0000 7f1e254a1640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:34:39.411 INFO:tasks.workunit.client.0.smithi037.stderr: -402> 2024-09-12T17:34:39.308+0000 7f1e254a1640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:34:39.411 INFO:tasks.workunit.client.0.smithi037.stderr: -401> 2024-09-12T17:34:39.308+0000 7f1e24ca0640 10 monclient(hunting): get_auth_request con 0x558a82b44650 auth_method 0 2024-09-12T17:34:39.412 INFO:tasks.workunit.client.0.smithi037.stderr: -400> 2024-09-12T17:34:39.308+0000 7f1e24ca0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:34:39.412 INFO:tasks.workunit.client.0.smithi037.stderr: -399> 2024-09-12T17:34:39.308+0000 7f1e24ca0640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:34:39.412 INFO:tasks.workunit.client.0.smithi037.stderr: -398> 2024-09-12T17:34:39.308+0000 7f1e24ca0640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:34:39.412 INFO:tasks.workunit.client.0.smithi037.stderr: -397> 2024-09-12T17:34:39.308+0000 7f1e2449f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:34:39.412 INFO:tasks.workunit.client.0.smithi037.stderr: -396> 2024-09-12T17:34:39.308+0000 7f1e2449f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:34:39.412 INFO:tasks.workunit.client.0.smithi037.stderr: -395> 2024-09-12T17:34:39.308+0000 7f1e2449f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:34:39.412 INFO:tasks.workunit.client.0.smithi037.stderr: -394> 2024-09-12T17:34:39.308+0000 7f1e254a1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:34:39.412 INFO:tasks.workunit.client.0.smithi037.stderr: -393> 2024-09-12T17:34:39.308+0000 7f1e254a1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:34:39.412 INFO:tasks.workunit.client.0.smithi037.stderr: -392> 2024-09-12T17:34:39.308+0000 7f1e254a1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:34:39.412 INFO:tasks.workunit.client.0.smithi037.stderr: -391> 2024-09-12T17:34:39.308+0000 7f1e24ca0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:34:39.412 INFO:tasks.workunit.client.0.smithi037.stderr: -390> 2024-09-12T17:34:39.308+0000 7f1e24ca0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:34:39.412 INFO:tasks.workunit.client.0.smithi037.stderr: -389> 2024-09-12T17:34:39.308+0000 7f1e24ca0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:34:39.412 INFO:tasks.workunit.client.0.smithi037.stderr: -388> 2024-09-12T17:34:39.308+0000 7f1e254a1640 10 monclient(hunting): handle_auth_done global_id 7386 payload 824 2024-09-12T17:34:39.412 INFO:tasks.workunit.client.0.smithi037.stderr: -387> 2024-09-12T17:34:39.308+0000 7f1e254a1640 10 monclient: _finish_hunting 0 2024-09-12T17:34:39.413 INFO:tasks.workunit.client.0.smithi037.stderr: -386> 2024-09-12T17:34:39.308+0000 7f1e254a1640 1 monclient: found mon.noname-a 2024-09-12T17:34:39.413 INFO:tasks.workunit.client.0.smithi037.stderr: -385> 2024-09-12T17:34:39.308+0000 7f1e254a1640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.37:3300/0 2024-09-12T17:34:39.413 INFO:tasks.workunit.client.0.smithi037.stderr: -384> 2024-09-12T17:34:39.308+0000 7f1d0a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:34:39.413 INFO:tasks.workunit.client.0.smithi037.stderr: -383> 2024-09-12T17:34:39.308+0000 7f1d0a7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:34:39.413 INFO:tasks.workunit.client.0.smithi037.stderr: -382> 2024-09-12T17:34:39.308+0000 7f1d0a7fc640 10 monclient: dump: 2024-09-12T17:34:39.413 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:34:39.413 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:34:39.413 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:34:39.413 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:34:39.413 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:34:39.413 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:34:39.413 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:34:39.413 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:34:39.414 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:34:39.414 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:34:39.414 INFO:tasks.workunit.client.0.smithi037.stderr: -381> 2024-09-12T17:34:39.308+0000 7f1d0a7fc640 10 monclient: _finish_auth 0 2024-09-12T17:34:39.414 INFO:tasks.workunit.client.0.smithi037.stderr: -380> 2024-09-12T17:34:39.308+0000 7f1d0a7fc640 10 monclient: _check_auth_tickets 2024-09-12T17:34:39.414 INFO:tasks.workunit.client.0.smithi037.stderr: -379> 2024-09-12T17:34:39.308+0000 7f1d0a7fc640 10 monclient: handle_config config(0 keys) 2024-09-12T17:34:39.414 INFO:tasks.workunit.client.0.smithi037.stderr: -378> 2024-09-12T17:34:39.308+0000 7f1d0a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:34:39.414 INFO:tasks.workunit.client.0.smithi037.stderr: -377> 2024-09-12T17:34:39.308+0000 7f1d0a7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:34:39.414 INFO:tasks.workunit.client.0.smithi037.stderr: -376> 2024-09-12T17:34:39.308+0000 7f1d0a7fc640 10 monclient: dump: 2024-09-12T17:34:39.414 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:34:39.414 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:34:39.414 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:34:39.414 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:34:39.414 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:34:39.415 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:34:39.415 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:34:39.415 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:34:39.415 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:34:39.415 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:34:39.415 INFO:tasks.workunit.client.0.smithi037.stderr: -375> 2024-09-12T17:34:39.308+0000 7f1e271af800 5 monclient: authenticate success, global_id 7386 2024-09-12T17:34:39.415 INFO:tasks.workunit.client.0.smithi037.stderr: -374> 2024-09-12T17:34:39.308+0000 7f1e271af800 10 monclient: _renew_subs 2024-09-12T17:34:39.415 INFO:tasks.workunit.client.0.smithi037.stderr: -373> 2024-09-12T17:34:39.308+0000 7f1e25ca2640 4 set_mon_vals no callback set 2024-09-12T17:34:39.415 INFO:tasks.workunit.client.0.smithi037.stderr: -372> 2024-09-12T17:34:39.308+0000 7f1e271af800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.37:3300/0 2024-09-12T17:34:39.415 INFO:tasks.workunit.client.0.smithi037.stderr: -371> 2024-09-12T17:34:39.308+0000 7f1e271af800 10 monclient: _renew_subs 2024-09-12T17:34:39.415 INFO:tasks.workunit.client.0.smithi037.stderr: -370> 2024-09-12T17:34:39.308+0000 7f1e271af800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.37:3300/0 2024-09-12T17:34:39.415 INFO:tasks.workunit.client.0.smithi037.stderr: -369> 2024-09-12T17:34:39.310+0000 7f1d0a7fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:34:39.415 INFO:tasks.workunit.client.0.smithi037.stderr: -368> 2024-09-12T17:34:39.310+0000 7f1d0a7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.40:6816/3916250676,v1:172.21.15.40:6817/3916250676] 2024-09-12T17:34:39.415 INFO:tasks.workunit.client.0.smithi037.stderr: -367> 2024-09-12T17:34:39.310+0000 7f1d0a7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.40:6816/3916250676,v1:172.21.15.40:6817/3916250676] 2024-09-12T17:34:39.416 INFO:tasks.workunit.client.0.smithi037.stderr: -366> 2024-09-12T17:34:39.311+0000 7f1e271af800 10 monclient: get_monmap_and_config 2024-09-12T17:34:39.416 INFO:tasks.workunit.client.0.smithi037.stderr: -365> 2024-09-12T17:34:39.311+0000 7f1e271af800 10 monclient: build_initial_monmap 2024-09-12T17:34:39.416 INFO:tasks.workunit.client.0.smithi037.stderr: -364> 2024-09-12T17:34:39.311+0000 7f1e271af800 1 build_initial for_mkfs: 0 2024-09-12T17:34:39.416 INFO:tasks.workunit.client.0.smithi037.stderr: -363> 2024-09-12T17:34:39.311+0000 7f1e271af800 10 monclient: monmap: 2024-09-12T17:34:39.416 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 0 2024-09-12T17:34:39.416 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:34:39.416 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 0.000000 2024-09-12T17:34:39.416 INFO:tasks.workunit.client.0.smithi037.stderr:created 0.000000 2024-09-12T17:34:39.416 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 0 (unknown) 2024-09-12T17:34:39.416 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:34:39.416 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.noname-a 2024-09-12T17:34:39.416 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.noname-b 2024-09-12T17:34:39.416 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.noname-c 2024-09-12T17:34:39.416 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:34:39.417 INFO:tasks.workunit.client.0.smithi037.stderr: -362> 2024-09-12T17:34:39.311+0000 7f1e271af800 5 AuthRegistry(0x558a82b643e0) adding auth protocol: cephx 2024-09-12T17:34:39.417 INFO:tasks.workunit.client.0.smithi037.stderr: -361> 2024-09-12T17:34:39.311+0000 7f1e271af800 5 AuthRegistry(0x558a82b643e0) adding auth protocol: cephx 2024-09-12T17:34:39.417 INFO:tasks.workunit.client.0.smithi037.stderr: -360> 2024-09-12T17:34:39.311+0000 7f1e271af800 5 AuthRegistry(0x558a82b643e0) adding auth protocol: cephx 2024-09-12T17:34:39.417 INFO:tasks.workunit.client.0.smithi037.stderr: -359> 2024-09-12T17:34:39.311+0000 7f1e271af800 5 AuthRegistry(0x558a82b643e0) adding con mode: secure 2024-09-12T17:34:39.417 INFO:tasks.workunit.client.0.smithi037.stderr: -358> 2024-09-12T17:34:39.311+0000 7f1e271af800 5 AuthRegistry(0x558a82b643e0) adding con mode: crc 2024-09-12T17:34:39.417 INFO:tasks.workunit.client.0.smithi037.stderr: -357> 2024-09-12T17:34:39.311+0000 7f1e271af800 5 AuthRegistry(0x558a82b643e0) adding con mode: secure 2024-09-12T17:34:39.417 INFO:tasks.workunit.client.0.smithi037.stderr: -356> 2024-09-12T17:34:39.311+0000 7f1e271af800 5 AuthRegistry(0x558a82b643e0) adding con mode: crc 2024-09-12T17:34:39.417 INFO:tasks.workunit.client.0.smithi037.stderr: -355> 2024-09-12T17:34:39.311+0000 7f1e271af800 5 AuthRegistry(0x558a82b643e0) adding con mode: secure 2024-09-12T17:34:39.417 INFO:tasks.workunit.client.0.smithi037.stderr: -354> 2024-09-12T17:34:39.311+0000 7f1e271af800 5 AuthRegistry(0x558a82b643e0) adding con mode: crc 2024-09-12T17:34:39.417 INFO:tasks.workunit.client.0.smithi037.stderr: -353> 2024-09-12T17:34:39.311+0000 7f1e271af800 5 AuthRegistry(0x558a82b643e0) adding con mode: crc 2024-09-12T17:34:39.417 INFO:tasks.workunit.client.0.smithi037.stderr: -352> 2024-09-12T17:34:39.311+0000 7f1e271af800 5 AuthRegistry(0x558a82b643e0) adding con mode: secure 2024-09-12T17:34:39.417 INFO:tasks.workunit.client.0.smithi037.stderr: -351> 2024-09-12T17:34:39.311+0000 7f1e271af800 5 AuthRegistry(0x558a82b643e0) adding con mode: crc 2024-09-12T17:34:39.417 INFO:tasks.workunit.client.0.smithi037.stderr: -350> 2024-09-12T17:34:39.311+0000 7f1e271af800 5 AuthRegistry(0x558a82b643e0) adding con mode: secure 2024-09-12T17:34:39.418 INFO:tasks.workunit.client.0.smithi037.stderr: -349> 2024-09-12T17:34:39.311+0000 7f1e271af800 5 AuthRegistry(0x558a82b643e0) adding con mode: crc 2024-09-12T17:34:39.418 INFO:tasks.workunit.client.0.smithi037.stderr: -348> 2024-09-12T17:34:39.311+0000 7f1e271af800 5 AuthRegistry(0x558a82b643e0) adding con mode: secure 2024-09-12T17:34:39.418 INFO:tasks.workunit.client.0.smithi037.stderr: -347> 2024-09-12T17:34:39.311+0000 7f1e24ca0640 10 monclient: get_auth_request con 0x7f1cfc076380 auth_method 0 2024-09-12T17:34:39.418 INFO:tasks.workunit.client.0.smithi037.stderr: -346> 2024-09-12T17:34:39.311+0000 7f1e271af800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:34:39.418 INFO:tasks.workunit.client.0.smithi037.stderr: -345> 2024-09-12T17:34:39.311+0000 7f1e271af800 10 monclient: init 2024-09-12T17:34:39.418 INFO:tasks.workunit.client.0.smithi037.stderr: -344> 2024-09-12T17:34:39.311+0000 7f1e271af800 5 AuthRegistry(0x7ffe5e026cf0) adding auth protocol: cephx 2024-09-12T17:34:39.418 INFO:tasks.workunit.client.0.smithi037.stderr: -343> 2024-09-12T17:34:39.311+0000 7f1e271af800 5 AuthRegistry(0x7ffe5e026cf0) adding auth protocol: cephx 2024-09-12T17:34:39.418 INFO:tasks.workunit.client.0.smithi037.stderr: -342> 2024-09-12T17:34:39.311+0000 7f1e271af800 5 AuthRegistry(0x7ffe5e026cf0) adding auth protocol: cephx 2024-09-12T17:34:39.418 INFO:tasks.workunit.client.0.smithi037.stderr: -341> 2024-09-12T17:34:39.311+0000 7f1e271af800 5 AuthRegistry(0x7ffe5e026cf0) adding con mode: secure 2024-09-12T17:34:39.418 INFO:tasks.workunit.client.0.smithi037.stderr: -340> 2024-09-12T17:34:39.311+0000 7f1e271af800 5 AuthRegistry(0x7ffe5e026cf0) adding con mode: crc 2024-09-12T17:34:39.418 INFO:tasks.workunit.client.0.smithi037.stderr: -339> 2024-09-12T17:34:39.311+0000 7f1e271af800 5 AuthRegistry(0x7ffe5e026cf0) adding con mode: secure 2024-09-12T17:34:39.418 INFO:tasks.workunit.client.0.smithi037.stderr: -338> 2024-09-12T17:34:39.311+0000 7f1e271af800 5 AuthRegistry(0x7ffe5e026cf0) adding con mode: crc 2024-09-12T17:34:39.418 INFO:tasks.workunit.client.0.smithi037.stderr: -337> 2024-09-12T17:34:39.311+0000 7f1e271af800 5 AuthRegistry(0x7ffe5e026cf0) adding con mode: secure 2024-09-12T17:34:39.418 INFO:tasks.workunit.client.0.smithi037.stderr: -336> 2024-09-12T17:34:39.311+0000 7f1e271af800 5 AuthRegistry(0x7ffe5e026cf0) adding con mode: crc 2024-09-12T17:34:39.418 INFO:tasks.workunit.client.0.smithi037.stderr: -335> 2024-09-12T17:34:39.311+0000 7f1e271af800 5 AuthRegistry(0x7ffe5e026cf0) adding con mode: crc 2024-09-12T17:34:39.419 INFO:tasks.workunit.client.0.smithi037.stderr: -334> 2024-09-12T17:34:39.311+0000 7f1e271af800 5 AuthRegistry(0x7ffe5e026cf0) adding con mode: secure 2024-09-12T17:34:39.419 INFO:tasks.workunit.client.0.smithi037.stderr: -333> 2024-09-12T17:34:39.311+0000 7f1e271af800 5 AuthRegistry(0x7ffe5e026cf0) adding con mode: crc 2024-09-12T17:34:39.419 INFO:tasks.workunit.client.0.smithi037.stderr: -332> 2024-09-12T17:34:39.311+0000 7f1e271af800 5 AuthRegistry(0x7ffe5e026cf0) adding con mode: secure 2024-09-12T17:34:39.419 INFO:tasks.workunit.client.0.smithi037.stderr: -331> 2024-09-12T17:34:39.311+0000 7f1e271af800 5 AuthRegistry(0x7ffe5e026cf0) adding con mode: crc 2024-09-12T17:34:39.419 INFO:tasks.workunit.client.0.smithi037.stderr: -330> 2024-09-12T17:34:39.311+0000 7f1e271af800 5 AuthRegistry(0x7ffe5e026cf0) adding con mode: secure 2024-09-12T17:34:39.419 INFO:tasks.workunit.client.0.smithi037.stderr: -329> 2024-09-12T17:34:39.311+0000 7f1e271af800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:34:39.419 INFO:tasks.workunit.client.0.smithi037.stderr: -328> 2024-09-12T17:34:39.312+0000 7f1e271af800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:34:39.419 INFO:tasks.workunit.client.0.smithi037.stderr: -327> 2024-09-12T17:34:39.312+0000 7f1e271af800 5 asok(0x558a828a4730) register_command rotate-key cmddesc rotate-key hook 0x7ffe5e026e38 EEXIST 2024-09-12T17:34:39.419 INFO:tasks.workunit.client.0.smithi037.stderr: -326> 2024-09-12T17:34:39.312+0000 7f1e271af800 10 monclient: _reopen_session rank -1 2024-09-12T17:34:39.419 INFO:tasks.workunit.client.0.smithi037.stderr: -325> 2024-09-12T17:34:39.312+0000 7f1e271af800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T17:34:39.419 INFO:tasks.workunit.client.0.smithi037.stderr: -324> 2024-09-12T17:34:39.312+0000 7f1e271af800 10 monclient(hunting): picked mon.noname-b con 0x558a82b989e0 addr [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] 2024-09-12T17:34:39.419 INFO:tasks.workunit.client.0.smithi037.stderr: -323> 2024-09-12T17:34:39.312+0000 7f1e271af800 10 monclient(hunting): picked mon.noname-c con 0x558a82b89330 addr [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] 2024-09-12T17:34:39.419 INFO:tasks.workunit.client.0.smithi037.stderr: -322> 2024-09-12T17:34:39.312+0000 7f1e271af800 10 monclient(hunting): picked mon.noname-a con 0x558a82b93e10 addr [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] 2024-09-12T17:34:39.420 INFO:tasks.workunit.client.0.smithi037.stderr: -321> 2024-09-12T17:34:39.312+0000 7f1e271af800 10 monclient(hunting): start opening mon connection 2024-09-12T17:34:39.420 INFO:tasks.workunit.client.0.smithi037.stderr: -320> 2024-09-12T17:34:39.312+0000 7f1e271af800 10 monclient(hunting): start opening mon connection 2024-09-12T17:34:39.420 INFO:tasks.workunit.client.0.smithi037.stderr: -319> 2024-09-12T17:34:39.312+0000 7f1e271af800 10 monclient(hunting): start opening mon connection 2024-09-12T17:34:39.420 INFO:tasks.workunit.client.0.smithi037.stderr: -318> 2024-09-12T17:34:39.312+0000 7f1e271af800 10 monclient(hunting): _renew_subs 2024-09-12T17:34:39.420 INFO:tasks.workunit.client.0.smithi037.stderr: -317> 2024-09-12T17:34:39.312+0000 7f1e271af800 10 monclient(hunting): authenticate will time out at 2266.910202s 2024-09-12T17:34:39.420 INFO:tasks.workunit.client.0.smithi037.stderr: -316> 2024-09-12T17:34:39.312+0000 7f1e254a1640 10 monclient(hunting): get_auth_request con 0x558a82b93e10 auth_method 0 2024-09-12T17:34:39.420 INFO:tasks.workunit.client.0.smithi037.stderr: -315> 2024-09-12T17:34:39.312+0000 7f1e254a1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:34:39.420 INFO:tasks.workunit.client.0.smithi037.stderr: -314> 2024-09-12T17:34:39.312+0000 7f1e254a1640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:34:39.420 INFO:tasks.workunit.client.0.smithi037.stderr: -313> 2024-09-12T17:34:39.312+0000 7f1e254a1640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:34:39.420 INFO:tasks.workunit.client.0.smithi037.stderr: -312> 2024-09-12T17:34:39.312+0000 7f1e2449f640 10 monclient(hunting): get_auth_request con 0x558a82b89330 auth_method 0 2024-09-12T17:34:39.420 INFO:tasks.workunit.client.0.smithi037.stderr: -311> 2024-09-12T17:34:39.312+0000 7f1e2449f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:34:39.420 INFO:tasks.workunit.client.0.smithi037.stderr: -310> 2024-09-12T17:34:39.312+0000 7f1e2449f640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:34:39.420 INFO:tasks.workunit.client.0.smithi037.stderr: -309> 2024-09-12T17:34:39.312+0000 7f1e2449f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:34:39.420 INFO:tasks.workunit.client.0.smithi037.stderr: -308> 2024-09-12T17:34:39.312+0000 7f1e24ca0640 10 monclient(hunting): get_auth_request con 0x558a82b989e0 auth_method 0 2024-09-12T17:34:39.421 INFO:tasks.workunit.client.0.smithi037.stderr: -307> 2024-09-12T17:34:39.312+0000 7f1e24ca0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:34:39.421 INFO:tasks.workunit.client.0.smithi037.stderr: -306> 2024-09-12T17:34:39.312+0000 7f1e24ca0640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:34:39.421 INFO:tasks.workunit.client.0.smithi037.stderr: -305> 2024-09-12T17:34:39.312+0000 7f1e24ca0640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:34:39.421 INFO:tasks.workunit.client.0.smithi037.stderr: -304> 2024-09-12T17:34:39.312+0000 7f1e2449f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:34:39.421 INFO:tasks.workunit.client.0.smithi037.stderr: -303> 2024-09-12T17:34:39.312+0000 7f1e2449f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:34:39.421 INFO:tasks.workunit.client.0.smithi037.stderr: -302> 2024-09-12T17:34:39.312+0000 7f1e2449f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:34:39.421 INFO:tasks.workunit.client.0.smithi037.stderr: -301> 2024-09-12T17:34:39.312+0000 7f1e254a1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:34:39.421 INFO:tasks.workunit.client.0.smithi037.stderr: -300> 2024-09-12T17:34:39.312+0000 7f1e254a1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:34:39.421 INFO:tasks.workunit.client.0.smithi037.stderr: -299> 2024-09-12T17:34:39.312+0000 7f1e254a1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:34:39.421 INFO:tasks.workunit.client.0.smithi037.stderr: -298> 2024-09-12T17:34:39.312+0000 7f1e24ca0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:34:39.421 INFO:tasks.workunit.client.0.smithi037.stderr: -297> 2024-09-12T17:34:39.312+0000 7f1e24ca0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:34:39.421 INFO:tasks.workunit.client.0.smithi037.stderr: -296> 2024-09-12T17:34:39.312+0000 7f1e24ca0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:34:39.421 INFO:tasks.workunit.client.0.smithi037.stderr: -295> 2024-09-12T17:34:39.312+0000 7f1e254a1640 10 monclient(hunting): handle_auth_done global_id 7389 payload 274 2024-09-12T17:34:39.422 INFO:tasks.workunit.client.0.smithi037.stderr: -294> 2024-09-12T17:34:39.312+0000 7f1e254a1640 10 monclient: _finish_hunting 0 2024-09-12T17:34:39.422 INFO:tasks.workunit.client.0.smithi037.stderr: -293> 2024-09-12T17:34:39.312+0000 7f1e254a1640 1 monclient: found mon.noname-a 2024-09-12T17:34:39.422 INFO:tasks.workunit.client.0.smithi037.stderr: -292> 2024-09-12T17:34:39.312+0000 7f1e254a1640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.37:3300/0 2024-09-12T17:34:39.422 INFO:tasks.workunit.client.0.smithi037.stderr: -291> 2024-09-12T17:34:39.312+0000 7f1cfbfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:34:39.422 INFO:tasks.workunit.client.0.smithi037.stderr: -290> 2024-09-12T17:34:39.312+0000 7f1cfbfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:34:39.422 INFO:tasks.workunit.client.0.smithi037.stderr: -289> 2024-09-12T17:34:39.312+0000 7f1cfbfff640 10 monclient: dump: 2024-09-12T17:34:39.422 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:34:39.422 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:34:39.422 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:34:39.422 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:34:39.422 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:34:39.422 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:34:39.422 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:34:39.422 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:34:39.422 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:34:39.423 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:34:39.423 INFO:tasks.workunit.client.0.smithi037.stderr: -288> 2024-09-12T17:34:39.312+0000 7f1cfbfff640 10 monclient: _finish_auth 0 2024-09-12T17:34:39.423 INFO:tasks.workunit.client.0.smithi037.stderr: -287> 2024-09-12T17:34:39.312+0000 7f1cfbfff640 10 monclient: _check_auth_tickets 2024-09-12T17:34:39.423 INFO:tasks.workunit.client.0.smithi037.stderr: -286> 2024-09-12T17:34:39.312+0000 7f1cfbfff640 10 monclient: handle_config config(0 keys) 2024-09-12T17:34:39.423 INFO:tasks.workunit.client.0.smithi037.stderr: -285> 2024-09-12T17:34:39.312+0000 7f1cfbfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:34:39.423 INFO:tasks.workunit.client.0.smithi037.stderr: -284> 2024-09-12T17:34:39.312+0000 7f1cfbfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:34:39.423 INFO:tasks.workunit.client.0.smithi037.stderr: -283> 2024-09-12T17:34:39.312+0000 7f1cfbfff640 10 monclient: dump: 2024-09-12T17:34:39.423 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:34:39.423 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:34:39.423 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:34:39.423 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:34:39.423 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:34:39.423 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:34:39.424 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:34:39.424 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:34:39.424 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:34:39.424 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:34:39.424 INFO:tasks.workunit.client.0.smithi037.stderr: -282> 2024-09-12T17:34:39.312+0000 7f1e271af800 5 monclient: authenticate success, global_id 7389 2024-09-12T17:34:39.424 INFO:tasks.workunit.client.0.smithi037.stderr: -281> 2024-09-12T17:34:39.312+0000 7f1e271af800 10 monclient: get_monmap_and_config success 2024-09-12T17:34:39.424 INFO:tasks.workunit.client.0.smithi037.stderr: -280> 2024-09-12T17:34:39.312+0000 7f1e271af800 4 set_mon_vals no callback set 2024-09-12T17:34:39.424 INFO:tasks.workunit.client.0.smithi037.stderr: -279> 2024-09-12T17:34:39.313+0000 7f1e271af800 10 monclient: shutdown 2024-09-12T17:34:39.424 INFO:tasks.workunit.client.0.smithi037.stderr: -278> 2024-09-12T17:34:39.313+0000 7f1e271af800 10 monclient: build_initial_monmap 2024-09-12T17:34:39.424 INFO:tasks.workunit.client.0.smithi037.stderr: -277> 2024-09-12T17:34:39.313+0000 7f1e271af800 1 build_initial for_mkfs: 0 2024-09-12T17:34:39.424 INFO:tasks.workunit.client.0.smithi037.stderr: -276> 2024-09-12T17:34:39.313+0000 7f1e271af800 10 monclient: monmap: 2024-09-12T17:34:39.424 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 0 2024-09-12T17:34:39.424 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:34:39.424 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 0.000000 2024-09-12T17:34:39.424 INFO:tasks.workunit.client.0.smithi037.stderr:created 0.000000 2024-09-12T17:34:39.425 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 0 (unknown) 2024-09-12T17:34:39.425 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:34:39.425 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.noname-a 2024-09-12T17:34:39.425 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.noname-b 2024-09-12T17:34:39.425 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.noname-c 2024-09-12T17:34:39.425 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:34:39.425 INFO:tasks.workunit.client.0.smithi037.stderr: -275> 2024-09-12T17:34:39.313+0000 7f1e271af800 5 AuthRegistry(0x558a82b89820) adding auth protocol: cephx 2024-09-12T17:34:39.425 INFO:tasks.workunit.client.0.smithi037.stderr: -274> 2024-09-12T17:34:39.313+0000 7f1e271af800 5 AuthRegistry(0x558a82b89820) adding auth protocol: cephx 2024-09-12T17:34:39.425 INFO:tasks.workunit.client.0.smithi037.stderr: -273> 2024-09-12T17:34:39.313+0000 7f1e271af800 5 AuthRegistry(0x558a82b89820) adding auth protocol: cephx 2024-09-12T17:34:39.425 INFO:tasks.workunit.client.0.smithi037.stderr: -272> 2024-09-12T17:34:39.313+0000 7f1e271af800 5 AuthRegistry(0x558a82b89820) adding con mode: secure 2024-09-12T17:34:39.425 INFO:tasks.workunit.client.0.smithi037.stderr: -271> 2024-09-12T17:34:39.313+0000 7f1e271af800 5 AuthRegistry(0x558a82b89820) adding con mode: crc 2024-09-12T17:34:39.425 INFO:tasks.workunit.client.0.smithi037.stderr: -270> 2024-09-12T17:34:39.313+0000 7f1e271af800 5 AuthRegistry(0x558a82b89820) adding con mode: secure 2024-09-12T17:34:39.425 INFO:tasks.workunit.client.0.smithi037.stderr: -269> 2024-09-12T17:34:39.313+0000 7f1e271af800 5 AuthRegistry(0x558a82b89820) adding con mode: crc 2024-09-12T17:34:39.425 INFO:tasks.workunit.client.0.smithi037.stderr: -268> 2024-09-12T17:34:39.313+0000 7f1e271af800 5 AuthRegistry(0x558a82b89820) adding con mode: secure 2024-09-12T17:34:39.426 INFO:tasks.workunit.client.0.smithi037.stderr: -267> 2024-09-12T17:34:39.313+0000 7f1e271af800 5 AuthRegistry(0x558a82b89820) adding con mode: crc 2024-09-12T17:34:39.426 INFO:tasks.workunit.client.0.smithi037.stderr: -266> 2024-09-12T17:34:39.313+0000 7f1e271af800 5 AuthRegistry(0x558a82b89820) adding con mode: crc 2024-09-12T17:34:39.426 INFO:tasks.workunit.client.0.smithi037.stderr: -265> 2024-09-12T17:34:39.313+0000 7f1e271af800 5 AuthRegistry(0x558a82b89820) adding con mode: secure 2024-09-12T17:34:39.426 INFO:tasks.workunit.client.0.smithi037.stderr: -264> 2024-09-12T17:34:39.313+0000 7f1e271af800 5 AuthRegistry(0x558a82b89820) adding con mode: crc 2024-09-12T17:34:39.426 INFO:tasks.workunit.client.0.smithi037.stderr: -263> 2024-09-12T17:34:39.313+0000 7f1e271af800 5 AuthRegistry(0x558a82b89820) adding con mode: secure 2024-09-12T17:34:39.426 INFO:tasks.workunit.client.0.smithi037.stderr: -262> 2024-09-12T17:34:39.313+0000 7f1e271af800 5 AuthRegistry(0x558a82b89820) adding con mode: crc 2024-09-12T17:34:39.426 INFO:tasks.workunit.client.0.smithi037.stderr: -261> 2024-09-12T17:34:39.313+0000 7f1e271af800 5 AuthRegistry(0x558a82b89820) adding con mode: secure 2024-09-12T17:34:39.426 INFO:tasks.workunit.client.0.smithi037.stderr: -260> 2024-09-12T17:34:39.313+0000 7f1e271af800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:34:39.426 INFO:tasks.workunit.client.0.smithi037.stderr: -259> 2024-09-12T17:34:39.313+0000 7f1e271af800 1 librados: starting msgr at 2024-09-12T17:34:39.426 INFO:tasks.workunit.client.0.smithi037.stderr: -258> 2024-09-12T17:34:39.313+0000 7f1e271af800 1 librados: starting objecter 2024-09-12T17:34:39.426 INFO:tasks.workunit.client.0.smithi037.stderr: -257> 2024-09-12T17:34:39.313+0000 7f1e271af800 5 asok(0x558a828a4730) register_command objecter_requests cmddesc objecter_requests hook 0x558a82b46750 EEXIST 2024-09-12T17:34:39.426 INFO:tasks.workunit.client.0.smithi037.stderr: -256> 2024-09-12T17:34:39.313+0000 7f1e271af800 1 librados: setting wanted keys 2024-09-12T17:34:39.426 INFO:tasks.workunit.client.0.smithi037.stderr: -255> 2024-09-12T17:34:39.313+0000 7f1e271af800 1 librados: calling monclient init 2024-09-12T17:34:39.426 INFO:tasks.workunit.client.0.smithi037.stderr: -254> 2024-09-12T17:34:39.313+0000 7f1e271af800 10 monclient: init 2024-09-12T17:34:39.427 INFO:tasks.workunit.client.0.smithi037.stderr: -253> 2024-09-12T17:34:39.313+0000 7f1e271af800 5 AuthRegistry(0x558a82b58f10) adding auth protocol: cephx 2024-09-12T17:34:39.427 INFO:tasks.workunit.client.0.smithi037.stderr: -252> 2024-09-12T17:34:39.313+0000 7f1e271af800 5 AuthRegistry(0x558a82b58f10) adding auth protocol: cephx 2024-09-12T17:34:39.427 INFO:tasks.workunit.client.0.smithi037.stderr: -251> 2024-09-12T17:34:39.313+0000 7f1e271af800 5 AuthRegistry(0x558a82b58f10) adding auth protocol: cephx 2024-09-12T17:34:39.427 INFO:tasks.workunit.client.0.smithi037.stderr: -250> 2024-09-12T17:34:39.313+0000 7f1e271af800 5 AuthRegistry(0x558a82b58f10) adding con mode: secure 2024-09-12T17:34:39.427 INFO:tasks.workunit.client.0.smithi037.stderr: -249> 2024-09-12T17:34:39.313+0000 7f1e271af800 5 AuthRegistry(0x558a82b58f10) adding con mode: crc 2024-09-12T17:34:39.427 INFO:tasks.workunit.client.0.smithi037.stderr: -248> 2024-09-12T17:34:39.313+0000 7f1e271af800 5 AuthRegistry(0x558a82b58f10) adding con mode: secure 2024-09-12T17:34:39.427 INFO:tasks.workunit.client.0.smithi037.stderr: -247> 2024-09-12T17:34:39.313+0000 7f1e271af800 5 AuthRegistry(0x558a82b58f10) adding con mode: crc 2024-09-12T17:34:39.427 INFO:tasks.workunit.client.0.smithi037.stderr: -246> 2024-09-12T17:34:39.313+0000 7f1e271af800 5 AuthRegistry(0x558a82b58f10) adding con mode: secure 2024-09-12T17:34:39.427 INFO:tasks.workunit.client.0.smithi037.stderr: -245> 2024-09-12T17:34:39.313+0000 7f1e271af800 5 AuthRegistry(0x558a82b58f10) adding con mode: crc 2024-09-12T17:34:39.427 INFO:tasks.workunit.client.0.smithi037.stderr: -244> 2024-09-12T17:34:39.313+0000 7f1e271af800 5 AuthRegistry(0x558a82b58f10) adding con mode: crc 2024-09-12T17:34:39.427 INFO:tasks.workunit.client.0.smithi037.stderr: -243> 2024-09-12T17:34:39.313+0000 7f1e271af800 5 AuthRegistry(0x558a82b58f10) adding con mode: secure 2024-09-12T17:34:39.428 INFO:tasks.workunit.client.0.smithi037.stderr: -242> 2024-09-12T17:34:39.314+0000 7f1e271af800 5 AuthRegistry(0x558a82b58f10) adding con mode: crc 2024-09-12T17:34:39.428 INFO:tasks.workunit.client.0.smithi037.stderr: -241> 2024-09-12T17:34:39.314+0000 7f1e271af800 5 AuthRegistry(0x558a82b58f10) adding con mode: secure 2024-09-12T17:34:39.428 INFO:tasks.workunit.client.0.smithi037.stderr: -240> 2024-09-12T17:34:39.314+0000 7f1e271af800 5 AuthRegistry(0x558a82b58f10) adding con mode: crc 2024-09-12T17:34:39.428 INFO:tasks.workunit.client.0.smithi037.stderr: -239> 2024-09-12T17:34:39.314+0000 7f1e271af800 5 AuthRegistry(0x558a82b58f10) adding con mode: secure 2024-09-12T17:34:39.428 INFO:tasks.workunit.client.0.smithi037.stderr: -238> 2024-09-12T17:34:39.314+0000 7f1e271af800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:34:39.428 INFO:tasks.workunit.client.0.smithi037.stderr: -237> 2024-09-12T17:34:39.314+0000 7f1e271af800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:34:39.428 INFO:tasks.workunit.client.0.smithi037.stderr: -236> 2024-09-12T17:34:39.314+0000 7f1e271af800 5 asok(0x558a828a4730) register_command rotate-key cmddesc rotate-key hook 0x558a82b59058 EEXIST 2024-09-12T17:34:39.428 INFO:tasks.workunit.client.0.smithi037.stderr: -235> 2024-09-12T17:34:39.314+0000 7f1e271af800 10 monclient: _reopen_session rank -1 2024-09-12T17:34:39.428 INFO:tasks.workunit.client.0.smithi037.stderr: -234> 2024-09-12T17:34:39.314+0000 7f1e271af800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T17:34:39.428 INFO:tasks.workunit.client.0.smithi037.stderr: -233> 2024-09-12T17:34:39.314+0000 7f1e271af800 10 monclient(hunting): picked mon.noname-b con 0x558a82b89330 addr [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] 2024-09-12T17:34:39.428 INFO:tasks.workunit.client.0.smithi037.stderr: -232> 2024-09-12T17:34:39.314+0000 7f1e271af800 10 monclient(hunting): picked mon.noname-c con 0x558a82b93e10 addr [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] 2024-09-12T17:34:39.428 INFO:tasks.workunit.client.0.smithi037.stderr: -231> 2024-09-12T17:34:39.314+0000 7f1e271af800 10 monclient(hunting): picked mon.noname-a con 0x558a82b989e0 addr [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] 2024-09-12T17:34:39.428 INFO:tasks.workunit.client.0.smithi037.stderr: -230> 2024-09-12T17:34:39.314+0000 7f1e271af800 10 monclient(hunting): start opening mon connection 2024-09-12T17:34:39.429 INFO:tasks.workunit.client.0.smithi037.stderr: -229> 2024-09-12T17:34:39.314+0000 7f1e271af800 10 monclient(hunting): start opening mon connection 2024-09-12T17:34:39.429 INFO:tasks.workunit.client.0.smithi037.stderr: -228> 2024-09-12T17:34:39.314+0000 7f1e271af800 10 monclient(hunting): start opening mon connection 2024-09-12T17:34:39.429 INFO:tasks.workunit.client.0.smithi037.stderr: -227> 2024-09-12T17:34:39.314+0000 7f1e271af800 10 monclient(hunting): _renew_subs 2024-09-12T17:34:39.429 INFO:tasks.workunit.client.0.smithi037.stderr: -226> 2024-09-12T17:34:39.314+0000 7f1e271af800 10 monclient(hunting): authenticate will time out at 2266.912527s 2024-09-12T17:34:39.429 INFO:tasks.workunit.client.0.smithi037.stderr: -225> 2024-09-12T17:34:39.314+0000 7f1e2449f640 10 monclient(hunting): get_auth_request con 0x558a82b93e10 auth_method 0 2024-09-12T17:34:39.429 INFO:tasks.workunit.client.0.smithi037.stderr: -224> 2024-09-12T17:34:39.314+0000 7f1e2449f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:34:39.429 INFO:tasks.workunit.client.0.smithi037.stderr: -223> 2024-09-12T17:34:39.314+0000 7f1e2449f640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:34:39.429 INFO:tasks.workunit.client.0.smithi037.stderr: -222> 2024-09-12T17:34:39.314+0000 7f1e2449f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:34:39.429 INFO:tasks.workunit.client.0.smithi037.stderr: -221> 2024-09-12T17:34:39.314+0000 7f1e254a1640 10 monclient(hunting): get_auth_request con 0x558a82b989e0 auth_method 0 2024-09-12T17:34:39.429 INFO:tasks.workunit.client.0.smithi037.stderr: -220> 2024-09-12T17:34:39.314+0000 7f1e254a1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:34:39.429 INFO:tasks.workunit.client.0.smithi037.stderr: -219> 2024-09-12T17:34:39.314+0000 7f1e254a1640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:34:39.429 INFO:tasks.workunit.client.0.smithi037.stderr: -218> 2024-09-12T17:34:39.314+0000 7f1e254a1640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:34:39.429 INFO:tasks.workunit.client.0.smithi037.stderr: -217> 2024-09-12T17:34:39.314+0000 7f1e2449f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:34:39.430 INFO:tasks.workunit.client.0.smithi037.stderr: -216> 2024-09-12T17:34:39.314+0000 7f1e2449f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:34:39.430 INFO:tasks.workunit.client.0.smithi037.stderr: -215> 2024-09-12T17:34:39.314+0000 7f1e2449f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:34:39.430 INFO:tasks.workunit.client.0.smithi037.stderr: -214> 2024-09-12T17:34:39.314+0000 7f1e254a1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:34:39.430 INFO:tasks.workunit.client.0.smithi037.stderr: -213> 2024-09-12T17:34:39.314+0000 7f1e254a1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:34:39.430 INFO:tasks.workunit.client.0.smithi037.stderr: -212> 2024-09-12T17:34:39.314+0000 7f1e254a1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:34:39.430 INFO:tasks.workunit.client.0.smithi037.stderr: -211> 2024-09-12T17:34:39.314+0000 7f1e24ca0640 10 monclient(hunting): get_auth_request con 0x558a82b89330 auth_method 0 2024-09-12T17:34:39.430 INFO:tasks.workunit.client.0.smithi037.stderr: -210> 2024-09-12T17:34:39.314+0000 7f1e24ca0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:34:39.430 INFO:tasks.workunit.client.0.smithi037.stderr: -209> 2024-09-12T17:34:39.314+0000 7f1e24ca0640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:34:39.430 INFO:tasks.workunit.client.0.smithi037.stderr: -208> 2024-09-12T17:34:39.314+0000 7f1e24ca0640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:34:39.430 INFO:tasks.workunit.client.0.smithi037.stderr: -207> 2024-09-12T17:34:39.314+0000 7f1e2449f640 10 monclient(hunting): handle_auth_done global_id 6920 payload 824 2024-09-12T17:34:39.430 INFO:tasks.workunit.client.0.smithi037.stderr: -206> 2024-09-12T17:34:39.314+0000 7f1e2449f640 10 monclient: _finish_hunting 0 2024-09-12T17:34:39.430 INFO:tasks.workunit.client.0.smithi037.stderr: -205> 2024-09-12T17:34:39.314+0000 7f1e2449f640 1 monclient: found mon.noname-c 2024-09-12T17:34:39.430 INFO:tasks.workunit.client.0.smithi037.stderr: -204> 2024-09-12T17:34:39.314+0000 7f1e2449f640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.37:3301/0 2024-09-12T17:34:39.430 INFO:tasks.workunit.client.0.smithi037.stderr: -203> 2024-09-12T17:34:39.315+0000 7f1cfa7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:34:39.431 INFO:tasks.workunit.client.0.smithi037.stderr: -202> 2024-09-12T17:34:39.315+0000 7f1cfa7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:34:39.431 INFO:tasks.workunit.client.0.smithi037.stderr: -201> 2024-09-12T17:34:39.315+0000 7f1cfa7fc640 10 monclient: dump: 2024-09-12T17:34:39.431 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:34:39.431 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:34:39.431 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:34:39.431 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:34:39.431 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:34:39.431 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:34:39.431 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:34:39.431 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:34:39.431 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:34:39.431 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:34:39.431 INFO:tasks.workunit.client.0.smithi037.stderr: -200> 2024-09-12T17:34:39.315+0000 7f1cfa7fc640 10 monclient: _finish_auth 0 2024-09-12T17:34:39.431 INFO:tasks.workunit.client.0.smithi037.stderr: -199> 2024-09-12T17:34:39.315+0000 7f1cfa7fc640 10 monclient: _check_auth_tickets 2024-09-12T17:34:39.432 INFO:tasks.workunit.client.0.smithi037.stderr: -198> 2024-09-12T17:34:39.315+0000 7f1e271af800 5 monclient: authenticate success, global_id 6920 2024-09-12T17:34:39.432 INFO:tasks.workunit.client.0.smithi037.stderr: -197> 2024-09-12T17:34:39.315+0000 7f1e271af800 10 monclient: _renew_subs 2024-09-12T17:34:39.432 INFO:tasks.workunit.client.0.smithi037.stderr: -196> 2024-09-12T17:34:39.315+0000 7f1e271af800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.37:3301/0 2024-09-12T17:34:39.432 INFO:tasks.workunit.client.0.smithi037.stderr: -195> 2024-09-12T17:34:39.315+0000 7f1cfa7fc640 10 monclient: handle_config config(0 keys) 2024-09-12T17:34:39.432 INFO:tasks.workunit.client.0.smithi037.stderr: -194> 2024-09-12T17:34:39.315+0000 7f1cfa7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:34:39.432 INFO:tasks.workunit.client.0.smithi037.stderr: -193> 2024-09-12T17:34:39.315+0000 7f1cfa7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:34:39.432 INFO:tasks.workunit.client.0.smithi037.stderr: -192> 2024-09-12T17:34:39.315+0000 7f1cfa7fc640 10 monclient: dump: 2024-09-12T17:34:39.432 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:34:39.432 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:34:39.432 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:34:39.432 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:34:39.432 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:34:39.432 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:34:39.432 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:34:39.433 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:34:39.433 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:34:39.433 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:34:39.433 INFO:tasks.workunit.client.0.smithi037.stderr: -191> 2024-09-12T17:34:39.315+0000 7f1cfbfff640 4 set_mon_vals no callback set 2024-09-12T17:34:39.433 INFO:tasks.workunit.client.0.smithi037.stderr: -190> 2024-09-12T17:34:39.315+0000 7f1e271af800 10 monclient: _renew_subs 2024-09-12T17:34:39.433 INFO:tasks.workunit.client.0.smithi037.stderr: -189> 2024-09-12T17:34:39.315+0000 7f1e271af800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.37:3301/0 2024-09-12T17:34:39.433 INFO:tasks.workunit.client.0.smithi037.stderr: -188> 2024-09-12T17:34:39.315+0000 7f1e271af800 1 librados: init done 2024-09-12T17:34:39.433 INFO:tasks.workunit.client.0.smithi037.stderr: -187> 2024-09-12T17:34:39.315+0000 7f1e271af800 5 asok(0x558a828a4730) register_command cr dump hook 0x558a82b92ab8 2024-09-12T17:34:39.433 INFO:tasks.workunit.client.0.smithi037.stderr: -186> 2024-09-12T17:34:39.316+0000 7f1e271af800 20 rados->read ofs=0 len=0 2024-09-12T17:34:39.433 INFO:tasks.workunit.client.0.smithi037.stderr: -185> 2024-09-12T17:34:39.317+0000 7f1cfa7fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:34:39.433 INFO:tasks.workunit.client.0.smithi037.stderr: -184> 2024-09-12T17:34:39.317+0000 7f1cfa7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.40:6816/3916250676,v1:172.21.15.40:6817/3916250676] 2024-09-12T17:34:39.433 INFO:tasks.workunit.client.0.smithi037.stderr: -183> 2024-09-12T17:34:39.317+0000 7f1cfa7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.40:6816/3916250676,v1:172.21.15.40:6817/3916250676] 2024-09-12T17:34:39.433 INFO:tasks.workunit.client.0.smithi037.stderr: -182> 2024-09-12T17:34:39.317+0000 7f1e24ca0640 10 monclient: get_auth_request con 0x7f1cf0076470 auth_method 0 2024-09-12T17:34:39.433 INFO:tasks.workunit.client.0.smithi037.stderr: -181> 2024-09-12T17:34:39.317+0000 7f1e254a1640 10 monclient: get_auth_request con 0x558a82bb28d0 auth_method 0 2024-09-12T17:34:39.434 INFO:tasks.workunit.client.0.smithi037.stderr: -180> 2024-09-12T17:34:39.318+0000 7f1e271af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:39.434 INFO:tasks.workunit.client.0.smithi037.stderr: -179> 2024-09-12T17:34:39.318+0000 7f1e271af800 20 realm 2024-09-12T17:34:39.434 INFO:tasks.workunit.client.0.smithi037.stderr: -178> 2024-09-12T17:34:39.318+0000 7f1e271af800 20 rados->read ofs=0 len=0 2024-09-12T17:34:39.434 INFO:tasks.workunit.client.0.smithi037.stderr: -177> 2024-09-12T17:34:39.318+0000 7f1e271af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:39.434 INFO:tasks.workunit.client.0.smithi037.stderr: -176> 2024-09-12T17:34:39.318+0000 7f1e271af800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:34:39.434 INFO:tasks.workunit.client.0.smithi037.stderr: -175> 2024-09-12T17:34:39.318+0000 7f1e271af800 20 rados->read ofs=0 len=0 2024-09-12T17:34:39.434 INFO:tasks.workunit.client.0.smithi037.stderr: -174> 2024-09-12T17:34:39.318+0000 7f1e271af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:39.434 INFO:tasks.workunit.client.0.smithi037.stderr: -173> 2024-09-12T17:34:39.318+0000 7f1e271af800 20 rados->read ofs=0 len=0 2024-09-12T17:34:39.434 INFO:tasks.workunit.client.0.smithi037.stderr: -172> 2024-09-12T17:34:39.319+0000 7f1e24ca0640 10 monclient: get_auth_request con 0x558a82bb6c20 auth_method 0 2024-09-12T17:34:39.434 INFO:tasks.workunit.client.0.smithi037.stderr: -171> 2024-09-12T17:34:39.319+0000 7f1e271af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:34:39.434 INFO:tasks.workunit.client.0.smithi037.stderr: -170> 2024-09-12T17:34:39.319+0000 7f1e271af800 20 rados->read ofs=0 len=0 2024-09-12T17:34:39.434 INFO:tasks.workunit.client.0.smithi037.stderr: -169> 2024-09-12T17:34:39.320+0000 7f1e271af800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:34:39.434 INFO:tasks.workunit.client.0.smithi037.stderr: -168> 2024-09-12T17:34:39.320+0000 7f1e271af800 20 searching for the correct realm 2024-09-12T17:34:39.434 INFO:tasks.workunit.client.0.smithi037.stderr: -167> 2024-09-12T17:34:39.320+0000 7f1e2449f640 10 monclient: get_auth_request con 0x558a82bbbe90 auth_method 0 2024-09-12T17:34:39.435 INFO:tasks.workunit.client.0.smithi037.stderr: -166> 2024-09-12T17:34:39.321+0000 7f1e254a1640 10 monclient: get_auth_request con 0x7f1e18074070 auth_method 0 2024-09-12T17:34:39.435 INFO:tasks.workunit.client.0.smithi037.stderr: -165> 2024-09-12T17:34:39.322+0000 7f1e24ca0640 10 monclient: get_auth_request con 0x7f1e1c06d300 auth_method 0 2024-09-12T17:34:39.435 INFO:tasks.workunit.client.0.smithi037.stderr: -164> 2024-09-12T17:34:39.322+0000 7f1e24ca0640 0 -- 172.21.15.37:0/3805717393 >> [v2:172.21.15.37:6800/1206746176,v1:172.21.15.37:6801/1206746176] conn(0x7f1e1c06d300 msgr2=0x7f1e1c063280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:34:39.435 INFO:tasks.workunit.client.0.smithi037.stderr: -163> 2024-09-12T17:34:39.322+0000 7f1cfa7fc640 1 client.6920.objecter ms_handle_reset 0x7f1e1c06d300 session 0x7f1e1c0645b0 osd.2 2024-09-12T17:34:39.435 INFO:tasks.workunit.client.0.smithi037.stderr: -162> 2024-09-12T17:34:39.322+0000 7f1cfa7fc640 10 monclient: _renew_subs 2024-09-12T17:34:39.435 INFO:tasks.workunit.client.0.smithi037.stderr: -161> 2024-09-12T17:34:39.322+0000 7f1cfa7fc640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.37:3301/0 2024-09-12T17:34:39.435 INFO:tasks.workunit.client.0.smithi037.stderr: -160> 2024-09-12T17:34:39.322+0000 7f1e24ca0640 10 monclient: get_auth_request con 0x7f1cf0086a90 auth_method 0 2024-09-12T17:34:39.435 INFO:tasks.workunit.client.0.smithi037.stderr: -159> 2024-09-12T17:34:39.322+0000 7f1e2449f640 10 monclient: get_auth_request con 0x7f1e14030070 auth_method 0 2024-09-12T17:34:39.435 INFO:tasks.workunit.client.0.smithi037.stderr: -158> 2024-09-12T17:34:39.324+0000 7f1e254a1640 10 monclient: get_auth_request con 0x7f1e180bdb90 auth_method 0 2024-09-12T17:34:39.435 INFO:tasks.workunit.client.0.smithi037.stderr: -157> 2024-09-12T17:34:39.326+0000 7f1e24ca0640 0 -- 172.21.15.37:0/3805717393 >> [v2:172.21.15.37:6800/1206746176,v1:172.21.15.37:6801/1206746176] conn(0x7f1cf0086a90 msgr2=0x7f1cf0088ec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:34:39.435 INFO:tasks.workunit.client.0.smithi037.stderr: -156> 2024-09-12T17:34:39.326+0000 7f1cfa7fc640 1 client.6920.objecter ms_handle_reset 0x7f1cf0086a90 session 0x7f1e1c0645b0 osd.2 2024-09-12T17:34:39.435 INFO:tasks.workunit.client.0.smithi037.stderr: -155> 2024-09-12T17:34:39.326+0000 7f1e24ca0640 10 monclient: get_auth_request con 0x7f1e1c06d300 auth_method 0 2024-09-12T17:34:39.435 INFO:tasks.workunit.client.0.smithi037.stderr: -154> 2024-09-12T17:34:39.327+0000 7f1e24ca0640 10 monclient: get_auth_request con 0x7f1e18075c30 auth_method 0 2024-09-12T17:34:39.435 INFO:tasks.workunit.client.0.smithi037.stderr: -153> 2024-09-12T17:34:39.332+0000 7f1e271af800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:34:39.436 INFO:tasks.workunit.client.0.smithi037.stderr: -152> 2024-09-12T17:34:39.332+0000 7f1e271af800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:34:39.436 INFO:tasks.workunit.client.0.smithi037.stderr: -151> 2024-09-12T17:34:39.332+0000 7f1e271af800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:34:39.436 INFO:tasks.workunit.client.0.smithi037.stderr: -150> 2024-09-12T17:34:39.332+0000 7f1e271af800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:34:39.436 INFO:tasks.workunit.client.0.smithi037.stderr: -149> 2024-09-12T17:34:39.332+0000 7f1e271af800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:34:39.436 INFO:tasks.workunit.client.0.smithi037.stderr: -148> 2024-09-12T17:34:39.332+0000 7f1e271af800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:34:39.436 INFO:tasks.workunit.client.0.smithi037.stderr: -147> 2024-09-12T17:34:39.332+0000 7f1e271af800 20 rados->read ofs=0 len=0 2024-09-12T17:34:39.436 INFO:tasks.workunit.client.0.smithi037.stderr: -146> 2024-09-12T17:34:39.332+0000 7f1e271af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:39.436 INFO:tasks.workunit.client.0.smithi037.stderr: -145> 2024-09-12T17:34:39.332+0000 7f1e271af800 20 rados->read ofs=0 len=0 2024-09-12T17:34:39.436 INFO:tasks.workunit.client.0.smithi037.stderr: -144> 2024-09-12T17:34:39.332+0000 7f1e271af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:34:39.436 INFO:tasks.workunit.client.0.smithi037.stderr: -143> 2024-09-12T17:34:39.332+0000 7f1e271af800 20 rados->read ofs=0 len=0 2024-09-12T17:34:39.436 INFO:tasks.workunit.client.0.smithi037.stderr: -142> 2024-09-12T17:34:39.333+0000 7f1e271af800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:34:39.436 INFO:tasks.workunit.client.0.smithi037.stderr: -141> 2024-09-12T17:34:39.333+0000 7f1e271af800 20 zone default found 2024-09-12T17:34:39.436 INFO:tasks.workunit.client.0.smithi037.stderr: -140> 2024-09-12T17:34:39.333+0000 7f1e271af800 4 Realm: () 2024-09-12T17:34:39.437 INFO:tasks.workunit.client.0.smithi037.stderr: -139> 2024-09-12T17:34:39.333+0000 7f1e271af800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:34:39.437 INFO:tasks.workunit.client.0.smithi037.stderr: -138> 2024-09-12T17:34:39.333+0000 7f1e271af800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:34:39.437 INFO:tasks.workunit.client.0.smithi037.stderr: -137> 2024-09-12T17:34:39.333+0000 7f1e271af800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:34:39.437 INFO:tasks.workunit.client.0.smithi037.stderr: -136> 2024-09-12T17:34:39.333+0000 7f1e271af800 20 zonegroup default 2024-09-12T17:34:39.437 INFO:tasks.workunit.client.0.smithi037.stderr: -135> 2024-09-12T17:34:39.333+0000 7f1e271af800 20 rados->read ofs=0 len=0 2024-09-12T17:34:39.437 INFO:tasks.workunit.client.0.smithi037.stderr: -134> 2024-09-12T17:34:39.333+0000 7f1e271af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:39.437 INFO:tasks.workunit.client.0.smithi037.stderr: -133> 2024-09-12T17:34:39.333+0000 7f1e271af800 20 rados->read ofs=0 len=0 2024-09-12T17:34:39.437 INFO:tasks.workunit.client.0.smithi037.stderr: -132> 2024-09-12T17:34:39.333+0000 7f1e271af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:39.437 INFO:tasks.workunit.client.0.smithi037.stderr: -131> 2024-09-12T17:34:39.333+0000 7f1e271af800 20 rados->read ofs=0 len=0 2024-09-12T17:34:39.437 INFO:tasks.workunit.client.0.smithi037.stderr: -130> 2024-09-12T17:34:39.334+0000 7f1e271af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:39.437 INFO:tasks.workunit.client.0.smithi037.stderr: -129> 2024-09-12T17:34:39.334+0000 7f1e271af800 20 started sync module instance, tier type = 2024-09-12T17:34:39.437 INFO:tasks.workunit.client.0.smithi037.stderr: -128> 2024-09-12T17:34:39.334+0000 7f1e271af800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:34:39.437 INFO:tasks.workunit.client.0.smithi037.stderr: -127> 2024-09-12T17:34:39.344+0000 7f1e271af800 20 add_watcher() i=0 2024-09-12T17:34:39.437 INFO:tasks.workunit.client.0.smithi037.stderr: -126> 2024-09-12T17:34:39.344+0000 7f1e271af800 20 add_watcher() i=1 2024-09-12T17:34:39.438 INFO:tasks.workunit.client.0.smithi037.stderr: -125> 2024-09-12T17:34:39.344+0000 7f1e271af800 20 add_watcher() i=2 2024-09-12T17:34:39.438 INFO:tasks.workunit.client.0.smithi037.stderr: -124> 2024-09-12T17:34:39.344+0000 7f1e271af800 20 add_watcher() i=3 2024-09-12T17:34:39.438 INFO:tasks.workunit.client.0.smithi037.stderr: -123> 2024-09-12T17:34:39.344+0000 7f1e271af800 20 add_watcher() i=4 2024-09-12T17:34:39.438 INFO:tasks.workunit.client.0.smithi037.stderr: -122> 2024-09-12T17:34:39.344+0000 7f1e271af800 20 add_watcher() i=5 2024-09-12T17:34:39.438 INFO:tasks.workunit.client.0.smithi037.stderr: -121> 2024-09-12T17:34:39.344+0000 7f1e271af800 20 add_watcher() i=6 2024-09-12T17:34:39.438 INFO:tasks.workunit.client.0.smithi037.stderr: -120> 2024-09-12T17:34:39.345+0000 7f1e271af800 20 add_watcher() i=7 2024-09-12T17:34:39.438 INFO:tasks.workunit.client.0.smithi037.stderr: -119> 2024-09-12T17:34:39.345+0000 7f1e271af800 2 all 8 watchers are set, enabling cache 2024-09-12T17:34:39.438 INFO:tasks.workunit.client.0.smithi037.stderr: -118> 2024-09-12T17:34:39.346+0000 7f1e271af800 5 AuthRegistry(0x7ffe5e0271c0) adding auth protocol: cephx 2024-09-12T17:34:39.438 INFO:tasks.workunit.client.0.smithi037.stderr: -117> 2024-09-12T17:34:39.346+0000 7f1e271af800 5 AuthRegistry(0x7ffe5e0271c0) adding auth protocol: cephx 2024-09-12T17:34:39.438 INFO:tasks.workunit.client.0.smithi037.stderr: -116> 2024-09-12T17:34:39.346+0000 7f1e271af800 5 AuthRegistry(0x7ffe5e0271c0) adding auth protocol: cephx 2024-09-12T17:34:39.438 INFO:tasks.workunit.client.0.smithi037.stderr: -115> 2024-09-12T17:34:39.346+0000 7f1e271af800 5 AuthRegistry(0x7ffe5e0271c0) adding con mode: secure 2024-09-12T17:34:39.438 INFO:tasks.workunit.client.0.smithi037.stderr: -114> 2024-09-12T17:34:39.346+0000 7f1e271af800 5 AuthRegistry(0x7ffe5e0271c0) adding con mode: crc 2024-09-12T17:34:39.438 INFO:tasks.workunit.client.0.smithi037.stderr: -113> 2024-09-12T17:34:39.346+0000 7f1e271af800 5 AuthRegistry(0x7ffe5e0271c0) adding con mode: secure 2024-09-12T17:34:39.438 INFO:tasks.workunit.client.0.smithi037.stderr: -112> 2024-09-12T17:34:39.346+0000 7f1e271af800 5 AuthRegistry(0x7ffe5e0271c0) adding con mode: crc 2024-09-12T17:34:39.438 INFO:tasks.workunit.client.0.smithi037.stderr: -111> 2024-09-12T17:34:39.346+0000 7f1e271af800 5 AuthRegistry(0x7ffe5e0271c0) adding con mode: secure 2024-09-12T17:34:39.439 INFO:tasks.workunit.client.0.smithi037.stderr: -110> 2024-09-12T17:34:39.347+0000 7f1e271af800 5 AuthRegistry(0x7ffe5e0271c0) adding con mode: crc 2024-09-12T17:34:39.439 INFO:tasks.workunit.client.0.smithi037.stderr: -109> 2024-09-12T17:34:39.347+0000 7f1e271af800 5 AuthRegistry(0x7ffe5e0271c0) adding con mode: crc 2024-09-12T17:34:39.439 INFO:tasks.workunit.client.0.smithi037.stderr: -108> 2024-09-12T17:34:39.347+0000 7f1e271af800 5 AuthRegistry(0x7ffe5e0271c0) adding con mode: secure 2024-09-12T17:34:39.439 INFO:tasks.workunit.client.0.smithi037.stderr: -107> 2024-09-12T17:34:39.347+0000 7f1e271af800 5 AuthRegistry(0x7ffe5e0271c0) adding con mode: crc 2024-09-12T17:34:39.439 INFO:tasks.workunit.client.0.smithi037.stderr: -106> 2024-09-12T17:34:39.347+0000 7f1e271af800 5 AuthRegistry(0x7ffe5e0271c0) adding con mode: secure 2024-09-12T17:34:39.439 INFO:tasks.workunit.client.0.smithi037.stderr: -105> 2024-09-12T17:34:39.346+0000 7f1cdafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:34:39.439 INFO:tasks.workunit.client.0.smithi037.stderr: -104> 2024-09-12T17:34:39.347+0000 7f1e271af800 5 AuthRegistry(0x7ffe5e0271c0) adding con mode: crc 2024-09-12T17:34:39.439 INFO:tasks.workunit.client.0.smithi037.stderr: -103> 2024-09-12T17:34:39.347+0000 7f1e271af800 5 AuthRegistry(0x7ffe5e0271c0) adding con mode: secure 2024-09-12T17:34:39.439 INFO:tasks.workunit.client.0.smithi037.stderr: -102> 2024-09-12T17:34:39.347+0000 7f1e271af800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:34:39.439 INFO:tasks.workunit.client.0.smithi037.stderr: -101> 2024-09-12T17:34:39.347+0000 7f1e271af800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:34:39.439 INFO:tasks.workunit.client.0.smithi037.stderr: -100> 2024-09-12T17:34:39.347+0000 7f1e271af800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:34:39.439 INFO:tasks.workunit.client.0.smithi037.stderr: -99> 2024-09-12T17:34:39.347+0000 7f1e271af800 5 asok(0x558a828a4730) register_command cache list hook 0x558a82b8cb30 2024-09-12T17:34:39.439 INFO:tasks.workunit.client.0.smithi037.stderr: -98> 2024-09-12T17:34:39.347+0000 7f1e271af800 5 asok(0x558a828a4730) register_command cache inspect hook 0x558a82b8cb30 2024-09-12T17:34:39.439 INFO:tasks.workunit.client.0.smithi037.stderr: -97> 2024-09-12T17:34:39.347+0000 7f1e271af800 5 asok(0x558a828a4730) register_command cache erase hook 0x558a82b8cb30 2024-09-12T17:34:39.440 INFO:tasks.workunit.client.0.smithi037.stderr: -96> 2024-09-12T17:34:39.347+0000 7f1e271af800 5 asok(0x558a828a4730) register_command cache zap hook 0x558a82b8cb30 2024-09-12T17:34:39.440 INFO:tasks.workunit.client.0.smithi037.stderr: -95> 2024-09-12T17:34:39.347+0000 7f1e271af800 5 note: GC not initialized 2024-09-12T17:34:39.440 INFO:tasks.workunit.client.0.smithi037.stderr: -94> 2024-09-12T17:34:39.347+0000 7f1cd9fe3640 20 reqs_thread_entry: start 2024-09-12T17:34:39.440 INFO:tasks.workunit.client.0.smithi037.stderr: -93> 2024-09-12T17:34:39.347+0000 7f1e271af800 5 asok(0x558a828a4730) register_command sync trace show hook 0x7f1e1801c400 2024-09-12T17:34:39.440 INFO:tasks.workunit.client.0.smithi037.stderr: -92> 2024-09-12T17:34:39.347+0000 7f1e271af800 5 asok(0x558a828a4730) register_command sync trace history hook 0x7f1e1801c400 2024-09-12T17:34:39.440 INFO:tasks.workunit.client.0.smithi037.stderr: -91> 2024-09-12T17:34:39.347+0000 7f1e271af800 5 asok(0x558a828a4730) register_command sync trace active hook 0x7f1e1801c400 2024-09-12T17:34:39.440 INFO:tasks.workunit.client.0.smithi037.stderr: -90> 2024-09-12T17:34:39.347+0000 7f1e271af800 5 asok(0x558a828a4730) register_command sync trace active_short hook 0x7f1e1801c400 2024-09-12T17:34:39.440 INFO:tasks.workunit.client.0.smithi037.stderr: -89> 2024-09-12T17:34:39.347+0000 7f1e271af800 20 init_complete bucket index max shards: 11 2024-09-12T17:34:39.440 INFO:tasks.workunit.client.0.smithi037.stderr: -88> 2024-09-12T17:34:39.347+0000 7f1e271af800 20 Filter name: none 2024-09-12T17:34:39.440 INFO:tasks.workunit.client.0.smithi037.stderr: -87> 2024-09-12T17:34:39.347+0000 7f1c4b7fe640 20 reqs_thread_entry: start 2024-09-12T17:34:39.440 INFO:tasks.workunit.client.0.smithi037.stderr: -86> 2024-09-12T17:34:39.347+0000 7f1e271af800 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-12T17:34:39.440 INFO:tasks.workunit.client.0.smithi037.stderr: -85> 2024-09-12T17:34:39.347+0000 7f1e271af800 20 rados->read ofs=0 len=0 2024-09-12T17:34:39.440 INFO:tasks.workunit.client.0.smithi037.stderr: -84> 2024-09-12T17:34:39.348+0000 7f1e271af800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:34:39.441 INFO:tasks.workunit.client.0.smithi037.stderr: -83> 2024-09-12T17:34:39.348+0000 7f1e271af800 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-12T17:34:39.441 INFO:tasks.workunit.client.0.smithi037.stderr: -82> 2024-09-12T17:34:39.348+0000 7f1e271af800 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-12T17:34:39.441 INFO:tasks.workunit.client.0.smithi037.stderr: -81> 2024-09-12T17:34:39.348+0000 7f1e271af800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33 : miss 2024-09-12T17:34:39.441 INFO:tasks.workunit.client.0.smithi037.stderr: -80> 2024-09-12T17:34:39.348+0000 7f1e271af800 20 rados->read ofs=0 len=0 2024-09-12T17:34:39.441 INFO:tasks.workunit.client.0.smithi037.stderr: -79> 2024-09-12T17:34:39.348+0000 7f1e271af800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:34:39.441 INFO:tasks.workunit.client.0.smithi037.stderr: -78> 2024-09-12T17:34:39.348+0000 7f1e271af800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33 info.flags=0x17 2024-09-12T17:34:39.441 INFO:tasks.workunit.client.0.smithi037.stderr: -77> 2024-09-12T17:34:39.348+0000 7f1e271af800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33 to cache LRU end 2024-09-12T17:34:39.441 INFO:tasks.workunit.client.0.smithi037.stderr: -76> 2024-09-12T17:34:39.348+0000 7f1e271af800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:34:39.441 INFO:tasks.workunit.client.0.smithi037.stderr: -75> 2024-09-12T17:34:39.348+0000 7f1e271af800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:34:39.441 INFO:tasks.workunit.client.0.smithi037.stderr: -74> 2024-09-12T17:34:39.348+0000 7f1e271af800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33 2024-09-12T17:34:39.441 INFO:tasks.workunit.client.0.smithi037.stderr: -73> 2024-09-12T17:34:39.354+0000 7f1e271af800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33 info.flags=0x17 2024-09-12T17:34:39.441 INFO:tasks.workunit.client.0.smithi037.stderr: -72> 2024-09-12T17:34:39.354+0000 7f1e271af800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33 to cache LRU end 2024-09-12T17:34:39.441 INFO:tasks.workunit.client.0.smithi037.stderr: -71> 2024-09-12T17:34:39.354+0000 7f1e271af800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:34:39.441 INFO:tasks.workunit.client.0.smithi037.stderr: -70> 2024-09-12T17:34:39.354+0000 7f1e271af800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33, ofs0, ns] 2024-09-12T17:34:39.442 INFO:tasks.workunit.client.0.smithi037.stderr: -69> 2024-09-12T17:34:39.354+0000 7f1cfb7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496991 cookie 94053387230944 notifier 6920 bl.length()=1015 2024-09-12T17:34:39.442 INFO:tasks.workunit.client.0.smithi037.stderr: -68> 2024-09-12T17:34:39.354+0000 7f1cfb7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33 info.flags=0x17 2024-09-12T17:34:39.442 INFO:tasks.workunit.client.0.smithi037.stderr: -67> 2024-09-12T17:34:39.354+0000 7f1cfb7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33 to cache LRU end 2024-09-12T17:34:39.442 INFO:tasks.workunit.client.0.smithi037.stderr: -66> 2024-09-12T17:34:39.354+0000 7f1cfb7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:34:39.442 INFO:tasks.workunit.client.0.smithi037.stderr: -65> 2024-09-12T17:34:39.356+0000 7f1e271af800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33]): orig_sources= new_sources= 2024-09-12T17:34:39.442 INFO:tasks.workunit.client.0.smithi037.stderr: -64> 2024-09-12T17:34:39.356+0000 7f1e271af800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33]): potential sources added=[] removed=[] 2024-09-12T17:34:39.442 INFO:tasks.workunit.client.0.smithi037.stderr: -63> 2024-09-12T17:34:39.356+0000 7f1e271af800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33]): orig_dests= new_dests= 2024-09-12T17:34:39.442 INFO:tasks.workunit.client.0.smithi037.stderr: -62> 2024-09-12T17:34:39.356+0000 7f1e271af800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33]): potential dests added=[] removed=[] 2024-09-12T17:34:39.442 INFO:tasks.workunit.client.0.smithi037.stderr: -61> 2024-09-12T17:34:39.361+0000 7f1e271af800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.1.0 2024-09-12T17:34:39.442 INFO:tasks.workunit.client.0.smithi037.stderr: -60> 2024-09-12T17:34:39.361+0000 7f1e271af800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.1.0 2024-09-12T17:34:39.442 INFO:tasks.workunit.client.0.smithi037.stderr: -59> 2024-09-12T17:34:39.361+0000 7f1e271af800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.1.1 2024-09-12T17:34:39.442 INFO:tasks.workunit.client.0.smithi037.stderr: -58> 2024-09-12T17:34:39.361+0000 7f1e271af800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.1.1 2024-09-12T17:34:39.442 INFO:tasks.workunit.client.0.smithi037.stderr: -57> 2024-09-12T17:34:39.361+0000 7f1e271af800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.1.2 2024-09-12T17:34:39.442 INFO:tasks.workunit.client.0.smithi037.stderr: -56> 2024-09-12T17:34:39.361+0000 7f1e271af800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.1.2 2024-09-12T17:34:39.443 INFO:tasks.workunit.client.0.smithi037.stderr: -55> 2024-09-12T17:34:39.361+0000 7f1e271af800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.1.3 2024-09-12T17:34:39.443 INFO:tasks.workunit.client.0.smithi037.stderr: -54> 2024-09-12T17:34:39.361+0000 7f1e271af800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.1.3 2024-09-12T17:34:39.443 INFO:tasks.workunit.client.0.smithi037.stderr: -53> 2024-09-12T17:34:39.361+0000 7f1e271af800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.1.4 2024-09-12T17:34:39.443 INFO:tasks.workunit.client.0.smithi037.stderr: -52> 2024-09-12T17:34:39.361+0000 7f1e271af800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.1.4 2024-09-12T17:34:39.443 INFO:tasks.workunit.client.0.smithi037.stderr: -51> 2024-09-12T17:34:39.361+0000 7f1e271af800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.1.5 2024-09-12T17:34:39.443 INFO:tasks.workunit.client.0.smithi037.stderr: -50> 2024-09-12T17:34:39.361+0000 7f1e271af800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.1.5 2024-09-12T17:34:39.443 INFO:tasks.workunit.client.0.smithi037.stderr: -49> 2024-09-12T17:34:39.361+0000 7f1e271af800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.1.6 2024-09-12T17:34:39.443 INFO:tasks.workunit.client.0.smithi037.stderr: -48> 2024-09-12T17:34:39.361+0000 7f1e271af800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.1.6 2024-09-12T17:34:39.443 INFO:tasks.workunit.client.0.smithi037.stderr: -47> 2024-09-12T17:34:39.361+0000 7f1e271af800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.1.7 2024-09-12T17:34:39.443 INFO:tasks.workunit.client.0.smithi037.stderr: -46> 2024-09-12T17:34:39.361+0000 7f1e271af800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.1.7 2024-09-12T17:34:39.443 INFO:tasks.workunit.client.0.smithi037.stderr: -45> 2024-09-12T17:34:39.361+0000 7f1e271af800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.1.8 2024-09-12T17:34:39.443 INFO:tasks.workunit.client.0.smithi037.stderr: -44> 2024-09-12T17:34:39.361+0000 7f1e271af800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.1.8 2024-09-12T17:34:39.443 INFO:tasks.workunit.client.0.smithi037.stderr: -43> 2024-09-12T17:34:39.361+0000 7f1e271af800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.1.9 2024-09-12T17:34:39.443 INFO:tasks.workunit.client.0.smithi037.stderr: -42> 2024-09-12T17:34:39.361+0000 7f1e271af800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.1.9 2024-09-12T17:34:39.444 INFO:tasks.workunit.client.0.smithi037.stderr: -41> 2024-09-12T17:34:39.361+0000 7f1e271af800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.1.10 2024-09-12T17:34:39.444 INFO:tasks.workunit.client.0.smithi037.stderr: -40> 2024-09-12T17:34:39.361+0000 7f1e271af800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.1.10 2024-09-12T17:34:39.444 INFO:tasks.workunit.client.0.smithi037.stderr: -39> 2024-09-12T17:34:39.361+0000 7f1e271af800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.1.11 2024-09-12T17:34:39.444 INFO:tasks.workunit.client.0.smithi037.stderr: -38> 2024-09-12T17:34:39.361+0000 7f1e271af800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.1.11 2024-09-12T17:34:39.444 INFO:tasks.workunit.client.0.smithi037.stderr: -37> 2024-09-12T17:34:39.361+0000 7f1e271af800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.0 2024-09-12T17:34:39.444 INFO:tasks.workunit.client.0.smithi037.stderr: -36> 2024-09-12T17:34:39.361+0000 7f1e271af800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.1 2024-09-12T17:34:39.444 INFO:tasks.workunit.client.0.smithi037.stderr: -35> 2024-09-12T17:34:39.362+0000 7f1e271af800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.2 2024-09-12T17:34:39.444 INFO:tasks.workunit.client.0.smithi037.stderr: -34> 2024-09-12T17:34:39.362+0000 7f1e271af800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.3 2024-09-12T17:34:39.444 INFO:tasks.workunit.client.0.smithi037.stderr: -33> 2024-09-12T17:34:39.363+0000 7f1e271af800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.4 2024-09-12T17:34:39.444 INFO:tasks.workunit.client.0.smithi037.stderr: -32> 2024-09-12T17:34:39.364+0000 7f1e271af800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.5 2024-09-12T17:34:39.444 INFO:tasks.workunit.client.0.smithi037.stderr: -31> 2024-09-12T17:34:39.365+0000 7f1e271af800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.6 2024-09-12T17:34:39.444 INFO:tasks.workunit.client.0.smithi037.stderr: -30> 2024-09-12T17:34:39.365+0000 7f1e271af800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.7 2024-09-12T17:34:39.444 INFO:tasks.workunit.client.0.smithi037.stderr: -29> 2024-09-12T17:34:39.366+0000 7f1e271af800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.8 2024-09-12T17:34:39.445 INFO:tasks.workunit.client.0.smithi037.stderr: -28> 2024-09-12T17:34:39.367+0000 7f1e271af800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.9 2024-09-12T17:34:39.445 INFO:tasks.workunit.client.0.smithi037.stderr: -27> 2024-09-12T17:34:39.367+0000 7f1e271af800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.10 2024-09-12T17:34:39.445 INFO:tasks.workunit.client.0.smithi037.stderr: -26> 2024-09-12T17:34:39.371+0000 7f1e271af800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33 : hit (requested=0x17, cached=0x17) 2024-09-12T17:34:39.445 INFO:tasks.workunit.client.0.smithi037.stderr: -25> 2024-09-12T17:34:39.371+0000 7f1e271af800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33 2024-09-12T17:34:39.445 INFO:tasks.workunit.client.0.smithi037.stderr: -24> 2024-09-12T17:34:39.372+0000 7f1e271af800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33 info.flags=0x17 2024-09-12T17:34:39.445 INFO:tasks.workunit.client.0.smithi037.stderr: -23> 2024-09-12T17:34:39.372+0000 7f1e271af800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33 to cache LRU end 2024-09-12T17:34:39.445 INFO:tasks.workunit.client.0.smithi037.stderr: -22> 2024-09-12T17:34:39.372+0000 7f1e271af800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:34:39.445 INFO:tasks.workunit.client.0.smithi037.stderr: -21> 2024-09-12T17:34:39.372+0000 7f1e271af800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33, ofs0, ns] 2024-09-12T17:34:39.445 INFO:tasks.workunit.client.0.smithi037.stderr: -20> 2024-09-12T17:34:39.372+0000 7f1cfbfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496992 cookie 94053387230944 notifier 6920 bl.length()=1015 2024-09-12T17:34:39.445 INFO:tasks.workunit.client.0.smithi037.stderr: -19> 2024-09-12T17:34:39.372+0000 7f1cfbfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33 info.flags=0x17 2024-09-12T17:34:39.445 INFO:tasks.workunit.client.0.smithi037.stderr: -18> 2024-09-12T17:34:39.372+0000 7f1cfbfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33 to cache LRU end 2024-09-12T17:34:39.445 INFO:tasks.workunit.client.0.smithi037.stderr: -17> 2024-09-12T17:34:39.372+0000 7f1cfbfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:34:39.445 INFO:tasks.workunit.client.0.smithi037.stderr: -16> 2024-09-12T17:34:39.374+0000 7f1e271af800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33]): orig_sources= new_sources= 2024-09-12T17:34:39.445 INFO:tasks.workunit.client.0.smithi037.stderr: -15> 2024-09-12T17:34:39.374+0000 7f1e271af800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33]): potential sources added=[] removed=[] 2024-09-12T17:34:39.446 INFO:tasks.workunit.client.0.smithi037.stderr: -14> 2024-09-12T17:34:39.374+0000 7f1e271af800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33]): orig_dests= new_dests= 2024-09-12T17:34:39.446 INFO:tasks.workunit.client.0.smithi037.stderr: -13> 2024-09-12T17:34:39.374+0000 7f1e271af800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33]): potential dests added=[] removed=[] 2024-09-12T17:34:39.446 INFO:tasks.workunit.client.0.smithi037.stderr: -12> 2024-09-12T17:34:39.377+0000 7f1e271af800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.0 2024-09-12T17:34:39.446 INFO:tasks.workunit.client.0.smithi037.stderr: -11> 2024-09-12T17:34:39.377+0000 7f1e271af800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.1 2024-09-12T17:34:39.446 INFO:tasks.workunit.client.0.smithi037.stderr: -10> 2024-09-12T17:34:39.377+0000 7f1e271af800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.2 2024-09-12T17:34:39.446 INFO:tasks.workunit.client.0.smithi037.stderr: -9> 2024-09-12T17:34:39.377+0000 7f1e271af800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.3 2024-09-12T17:34:39.446 INFO:tasks.workunit.client.0.smithi037.stderr: -8> 2024-09-12T17:34:39.378+0000 7f1e271af800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.4 2024-09-12T17:34:39.446 INFO:tasks.workunit.client.0.smithi037.stderr: -7> 2024-09-12T17:34:39.378+0000 7f1e271af800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.5 2024-09-12T17:34:39.446 INFO:tasks.workunit.client.0.smithi037.stderr: -6> 2024-09-12T17:34:39.378+0000 7f1e271af800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.6 2024-09-12T17:34:39.446 INFO:tasks.workunit.client.0.smithi037.stderr: -5> 2024-09-12T17:34:39.379+0000 7f1e271af800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.7 2024-09-12T17:34:39.446 INFO:tasks.workunit.client.0.smithi037.stderr: -4> 2024-09-12T17:34:39.379+0000 7f1e271af800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.8 2024-09-12T17:34:39.446 INFO:tasks.workunit.client.0.smithi037.stderr: -3> 2024-09-12T17:34:39.379+0000 7f1e271af800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.9 2024-09-12T17:34:39.446 INFO:tasks.workunit.client.0.smithi037.stderr: -2> 2024-09-12T17:34:39.380+0000 7f1e271af800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.10 2024-09-12T17:34:39.446 INFO:tasks.workunit.client.0.smithi037.stderr: -1> 2024-09-12T17:34:39.381+0000 7f1e271af800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f1e271af800 time 2024-09-12T17:34:39.382198+0000 2024-09-12T17:34:39.447 INFO:tasks.workunit.client.0.smithi037.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:34:39.447 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:34:39.447 INFO:tasks.workunit.client.0.smithi037.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:34:39.447 INFO:tasks.workunit.client.0.smithi037.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f1e2a78c71a] 2024-09-12T17:34:39.447 INFO:tasks.workunit.client.0.smithi037.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f1e2a78c8d8] 2024-09-12T17:34:39.447 INFO:tasks.workunit.client.0.smithi037.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x558a81d58841] 2024-09-12T17:34:39.447 INFO:tasks.workunit.client.0.smithi037.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x558a81d68827] 2024-09-12T17:34:39.447 INFO:tasks.workunit.client.0.smithi037.stderr: 5: main() 2024-09-12T17:34:39.447 INFO:tasks.workunit.client.0.smithi037.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f1e29429590] 2024-09-12T17:34:39.447 INFO:tasks.workunit.client.0.smithi037.stderr: 7: __libc_start_main() 2024-09-12T17:34:39.447 INFO:tasks.workunit.client.0.smithi037.stderr: 8: _start() 2024-09-12T17:34:39.447 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:34:39.447 INFO:tasks.workunit.client.0.smithi037.stderr: 0> 2024-09-12T17:34:39.381+0000 7f1e271af800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:34:39.447 INFO:tasks.workunit.client.0.smithi037.stderr: in thread 7f1e271af800 thread_name:radosgw-admin 2024-09-12T17:34:39.448 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:34:39.448 INFO:tasks.workunit.client.0.smithi037.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:34:39.448 INFO:tasks.workunit.client.0.smithi037.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f1e2943e6f0] 2024-09-12T17:34:39.448 INFO:tasks.workunit.client.0.smithi037.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f1e2948b99c] 2024-09-12T17:34:39.448 INFO:tasks.workunit.client.0.smithi037.stderr: 3: raise() 2024-09-12T17:34:39.448 INFO:tasks.workunit.client.0.smithi037.stderr: 4: abort() 2024-09-12T17:34:39.448 INFO:tasks.workunit.client.0.smithi037.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f1e2a78c774] 2024-09-12T17:34:39.448 INFO:tasks.workunit.client.0.smithi037.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f1e2a78c8d8] 2024-09-12T17:34:39.448 INFO:tasks.workunit.client.0.smithi037.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x558a81d58841] 2024-09-12T17:34:39.448 INFO:tasks.workunit.client.0.smithi037.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x558a81d68827] 2024-09-12T17:34:39.448 INFO:tasks.workunit.client.0.smithi037.stderr: 9: main() 2024-09-12T17:34:39.448 INFO:tasks.workunit.client.0.smithi037.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f1e29429590] 2024-09-12T17:34:39.448 INFO:tasks.workunit.client.0.smithi037.stderr: 11: __libc_start_main() 2024-09-12T17:34:39.449 INFO:tasks.workunit.client.0.smithi037.stderr: 12: _start() 2024-09-12T17:34:39.449 INFO:tasks.workunit.client.0.smithi037.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:34:39.449 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:34:39.449 INFO:tasks.workunit.client.0.smithi037.stderr:--- logging levels --- 2024-09-12T17:34:39.449 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 none 2024-09-12T17:34:39.449 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 lockdep 2024-09-12T17:34:39.449 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 context 2024-09-12T17:34:39.449 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 1 crush 2024-09-12T17:34:39.449 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mds 2024-09-12T17:34:39.449 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mds_balancer 2024-09-12T17:34:39.449 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mds_locker 2024-09-12T17:34:39.449 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mds_log 2024-09-12T17:34:39.449 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mds_log_expire 2024-09-12T17:34:39.449 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mds_migrator 2024-09-12T17:34:39.450 INFO:tasks.workunit.client.0.smithi037.stderr: 3/ 5 mds_quiesce 2024-09-12T17:34:39.450 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 buffer 2024-09-12T17:34:39.450 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 timer 2024-09-12T17:34:39.450 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 filer 2024-09-12T17:34:39.450 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 striper 2024-09-12T17:34:39.450 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 objecter 2024-09-12T17:34:39.450 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 rados 2024-09-12T17:34:39.450 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 rbd 2024-09-12T17:34:39.450 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 rbd_mirror 2024-09-12T17:34:39.450 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 rbd_replay 2024-09-12T17:34:39.450 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 rbd_pwl 2024-09-12T17:34:39.450 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 journaler 2024-09-12T17:34:39.450 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 objectcacher 2024-09-12T17:34:39.450 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:34:39.450 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 client 2024-09-12T17:34:39.451 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 osd 2024-09-12T17:34:39.451 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 optracker 2024-09-12T17:34:39.451 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 objclass 2024-09-12T17:34:39.451 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 3 filestore 2024-09-12T17:34:39.451 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 3 journal 2024-09-12T17:34:39.451 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 0 ms 2024-09-12T17:34:39.451 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mon 2024-09-12T17:34:39.451 INFO:tasks.workunit.client.0.smithi037.stderr: 0/10 monc 2024-09-12T17:34:39.451 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 paxos 2024-09-12T17:34:39.451 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 tp 2024-09-12T17:34:39.451 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 auth 2024-09-12T17:34:39.451 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 crypto 2024-09-12T17:34:39.451 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 1 finisher 2024-09-12T17:34:39.451 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 1 reserver 2024-09-12T17:34:39.452 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 heartbeatmap 2024-09-12T17:34:39.452 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 perfcounter 2024-09-12T17:34:39.452 INFO:tasks.workunit.client.0.smithi037.stderr: 20/20 rgw 2024-09-12T17:34:39.452 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 rgw_sync 2024-09-12T17:34:39.452 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 rgw_datacache 2024-09-12T17:34:39.452 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 rgw_access 2024-09-12T17:34:39.452 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:34:39.452 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 rgw_flight 2024-09-12T17:34:39.452 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:34:39.452 INFO:tasks.workunit.client.0.smithi037.stderr: 20/20 rgw_notification 2024-09-12T17:34:39.452 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 javaclient 2024-09-12T17:34:39.452 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 asok 2024-09-12T17:34:39.452 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 1 throttle 2024-09-12T17:34:39.452 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 0 refs 2024-09-12T17:34:39.453 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 compressor 2024-09-12T17:34:39.453 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 bluestore 2024-09-12T17:34:39.453 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 bluefs 2024-09-12T17:34:39.453 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 3 bdev 2024-09-12T17:34:39.453 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 kstore 2024-09-12T17:34:39.453 INFO:tasks.workunit.client.0.smithi037.stderr: 4/ 5 rocksdb 2024-09-12T17:34:39.453 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 fuse 2024-09-12T17:34:39.453 INFO:tasks.workunit.client.0.smithi037.stderr: 2/ 5 mgr 2024-09-12T17:34:39.453 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mgrc 2024-09-12T17:34:39.453 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 dpdk 2024-09-12T17:34:39.453 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 eventtrace 2024-09-12T17:34:39.453 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 prioritycache 2024-09-12T17:34:39.453 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 test 2024-09-12T17:34:39.453 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:34:39.454 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 cephsqlite 2024-09-12T17:34:39.454 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:34:39.454 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore 2024-09-12T17:34:39.454 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_onode 2024-09-12T17:34:39.454 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_odata 2024-09-12T17:34:39.454 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_omap 2024-09-12T17:34:39.454 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_tm 2024-09-12T17:34:39.454 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_t 2024-09-12T17:34:39.454 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:34:39.454 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_epm 2024-09-12T17:34:39.454 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_lba 2024-09-12T17:34:39.454 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:34:39.454 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_cache 2024-09-12T17:34:39.454 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_journal 2024-09-12T17:34:39.454 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_device 2024-09-12T17:34:39.455 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_backref 2024-09-12T17:34:39.455 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 alienstore 2024-09-12T17:34:39.455 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mclock 2024-09-12T17:34:39.455 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 cyanstore 2024-09-12T17:34:39.455 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 ceph_exporter 2024-09-12T17:34:39.455 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 memstore 2024-09-12T17:34:39.455 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 trace 2024-09-12T17:34:39.455 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 ceph_dedup 2024-09-12T17:34:39.455 INFO:tasks.workunit.client.0.smithi037.stderr: -2/-2 (syslog threshold) 2024-09-12T17:34:39.455 INFO:tasks.workunit.client.0.smithi037.stderr: 99/99 (stderr threshold) 2024-09-12T17:34:39.455 INFO:tasks.workunit.client.0.smithi037.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:34:39.455 INFO:tasks.workunit.client.0.smithi037.stderr: 7f1c4b7fe640 / http_manager 2024-09-12T17:34:39.455 INFO:tasks.workunit.client.0.smithi037.stderr: 7f1cd9fe3640 / http_manager 2024-09-12T17:34:39.455 INFO:tasks.workunit.client.0.smithi037.stderr: 7f1cdafe5640 / rgw_dt_lg_renew 2024-09-12T17:34:39.456 INFO:tasks.workunit.client.0.smithi037.stderr: 7f1cfa7fc640 / ms_dispatch 2024-09-12T17:34:39.456 INFO:tasks.workunit.client.0.smithi037.stderr: 7f1cfb7fe640 / io_context_pool 2024-09-12T17:34:39.456 INFO:tasks.workunit.client.0.smithi037.stderr: 7f1cfbfff640 / io_context_pool 2024-09-12T17:34:39.456 INFO:tasks.workunit.client.0.smithi037.stderr: 7f1d0a7fc640 / ms_dispatch 2024-09-12T17:34:39.456 INFO:tasks.workunit.client.0.smithi037.stderr: 7f1d1160a640 / ms_dispatch 2024-09-12T17:34:39.456 INFO:tasks.workunit.client.0.smithi037.stderr: 7f1d12e0d640 / io_context_pool 2024-09-12T17:34:39.456 INFO:tasks.workunit.client.0.smithi037.stderr: 7f1e2449f640 / msgr-worker-2 2024-09-12T17:34:39.456 INFO:tasks.workunit.client.0.smithi037.stderr: 7f1e24ca0640 / msgr-worker-1 2024-09-12T17:34:39.456 INFO:tasks.workunit.client.0.smithi037.stderr: 7f1e254a1640 / msgr-worker-0 2024-09-12T17:34:39.456 INFO:tasks.workunit.client.0.smithi037.stderr: 7f1e25ca2640 / io_context_pool 2024-09-12T17:34:39.456 INFO:tasks.workunit.client.0.smithi037.stderr: 7f1e271af800 / radosgw-admin 2024-09-12T17:34:39.457 INFO:tasks.workunit.client.0.smithi037.stderr: max_recent 500 2024-09-12T17:34:39.457 INFO:tasks.workunit.client.0.smithi037.stderr: max_new 1000 2024-09-12T17:34:39.457 INFO:tasks.workunit.client.0.smithi037.stderr: log_file /var/log/ceph/ceph-client.admin.121998.log 2024-09-12T17:34:39.457 INFO:tasks.workunit.client.0.smithi037.stderr:--- end dump of recent events --- 2024-09-12T17:34:39.457 INFO:tasks.workunit.client.0.smithi037.stderr:--- begin dump of recent events --- 2024-09-12T17:34:39.457 INFO:tasks.workunit.client.0.smithi037.stderr: -499> 2024-09-12T17:34:39.300+0000 7f1e2449f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:34:39.457 INFO:tasks.workunit.client.0.smithi037.stderr: -498> 2024-09-12T17:34:39.300+0000 7f1e2449f640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:34:39.457 INFO:tasks.workunit.client.0.smithi037.stderr: -497> 2024-09-12T17:34:39.300+0000 7f1e2449f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:34:39.457 INFO:tasks.workunit.client.0.smithi037.stderr: -496> 2024-09-12T17:34:39.300+0000 7f1e254a1640 10 monclient(hunting): get_auth_request con 0x7f1d0c006e40 auth_method 0 2024-09-12T17:34:39.457 INFO:tasks.workunit.client.0.smithi037.stderr: -495> 2024-09-12T17:34:39.300+0000 7f1e254a1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:34:39.457 INFO:tasks.workunit.client.0.smithi037.stderr: -494> 2024-09-12T17:34:39.300+0000 7f1e254a1640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:34:39.457 INFO:tasks.workunit.client.0.smithi037.stderr: -493> 2024-09-12T17:34:39.300+0000 7f1e254a1640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:34:39.457 INFO:tasks.workunit.client.0.smithi037.stderr: -492> 2024-09-12T17:34:39.300+0000 7f1e2449f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:34:39.458 INFO:tasks.workunit.client.0.smithi037.stderr: -491> 2024-09-12T17:34:39.300+0000 7f1e2449f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:34:39.458 INFO:tasks.workunit.client.0.smithi037.stderr: -490> 2024-09-12T17:34:39.300+0000 7f1e2449f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:34:39.458 INFO:tasks.workunit.client.0.smithi037.stderr: -489> 2024-09-12T17:34:39.300+0000 7f1e254a1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:34:39.458 INFO:tasks.workunit.client.0.smithi037.stderr: -488> 2024-09-12T17:34:39.300+0000 7f1e254a1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:34:39.458 INFO:tasks.workunit.client.0.smithi037.stderr: -487> 2024-09-12T17:34:39.300+0000 7f1e254a1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:34:39.458 INFO:tasks.workunit.client.0.smithi037.stderr: -486> 2024-09-12T17:34:39.300+0000 7f1e2449f640 10 monclient(hunting): handle_auth_done global_id 7383 payload 824 2024-09-12T17:34:39.458 INFO:tasks.workunit.client.0.smithi037.stderr: -485> 2024-09-12T17:34:39.300+0000 7f1e2449f640 10 monclient: _finish_hunting 0 2024-09-12T17:34:39.458 INFO:tasks.workunit.client.0.smithi037.stderr: -484> 2024-09-12T17:34:39.300+0000 7f1e2449f640 1 monclient: found mon.noname-a 2024-09-12T17:34:39.458 INFO:tasks.workunit.client.0.smithi037.stderr: -483> 2024-09-12T17:34:39.300+0000 7f1e2449f640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.37:3300/0 2024-09-12T17:34:39.458 INFO:tasks.workunit.client.0.smithi037.stderr: -482> 2024-09-12T17:34:39.300+0000 7f1e24ca0640 10 monclient: get_auth_request con 0x558a82a0c1c0 auth_method 0 2024-09-12T17:34:39.458 INFO:tasks.workunit.client.0.smithi037.stderr: -481> 2024-09-12T17:34:39.300+0000 7f1d1160a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:34:39.458 INFO:tasks.workunit.client.0.smithi037.stderr: -480> 2024-09-12T17:34:39.300+0000 7f1d1160a640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:34:39.458 INFO:tasks.workunit.client.0.smithi037.stderr: -479> 2024-09-12T17:34:39.300+0000 7f1d1160a640 10 monclient: dump: 2024-09-12T17:34:39.458 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:34:39.459 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:34:39.459 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:34:39.459 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:34:39.459 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:34:39.459 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:34:39.459 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:34:39.459 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:34:39.459 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:34:39.459 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:34:39.459 INFO:tasks.workunit.client.0.smithi037.stderr: -478> 2024-09-12T17:34:39.300+0000 7f1d1160a640 10 monclient: _finish_auth 0 2024-09-12T17:34:39.459 INFO:tasks.workunit.client.0.smithi037.stderr: -477> 2024-09-12T17:34:39.300+0000 7f1d1160a640 10 monclient: _check_auth_tickets 2024-09-12T17:34:39.459 INFO:tasks.workunit.client.0.smithi037.stderr: -476> 2024-09-12T17:34:39.300+0000 7f1d1160a640 10 monclient: handle_config config(0 keys) 2024-09-12T17:34:39.459 INFO:tasks.workunit.client.0.smithi037.stderr: -475> 2024-09-12T17:34:39.300+0000 7f1d1160a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:34:39.459 INFO:tasks.workunit.client.0.smithi037.stderr: -474> 2024-09-12T17:34:39.300+0000 7f1d1160a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:34:39.460 INFO:tasks.workunit.client.0.smithi037.stderr: -473> 2024-09-12T17:34:39.300+0000 7f1d1160a640 10 monclient: dump: 2024-09-12T17:34:39.460 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:34:39.460 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:34:39.460 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:34:39.460 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:34:39.460 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:34:39.460 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:34:39.460 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:34:39.460 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:34:39.460 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:34:39.460 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:34:39.460 INFO:tasks.workunit.client.0.smithi037.stderr: -472> 2024-09-12T17:34:39.300+0000 7f1e271af800 5 monclient: authenticate success, global_id 7383 2024-09-12T17:34:39.460 INFO:tasks.workunit.client.0.smithi037.stderr: -471> 2024-09-12T17:34:39.300+0000 7f1e271af800 10 monclient: _renew_subs 2024-09-12T17:34:39.461 INFO:tasks.workunit.client.0.smithi037.stderr: -470> 2024-09-12T17:34:39.300+0000 7f1e271af800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.37:3300/0 2024-09-12T17:34:39.461 INFO:tasks.workunit.client.0.smithi037.stderr: -469> 2024-09-12T17:34:39.300+0000 7f1d12e0d640 4 set_mon_vals no callback set 2024-09-12T17:34:39.461 INFO:tasks.workunit.client.0.smithi037.stderr: -468> 2024-09-12T17:34:39.300+0000 7f1e271af800 10 monclient: _renew_subs 2024-09-12T17:34:39.461 INFO:tasks.workunit.client.0.smithi037.stderr: -467> 2024-09-12T17:34:39.300+0000 7f1e271af800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.37:3300/0 2024-09-12T17:34:39.461 INFO:tasks.workunit.client.0.smithi037.stderr: -466> 2024-09-12T17:34:39.300+0000 7f1e271af800 1 librados: init done 2024-09-12T17:34:39.461 INFO:tasks.workunit.client.0.smithi037.stderr: -465> 2024-09-12T17:34:39.302+0000 7f1d1160a640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:34:39.461 INFO:tasks.workunit.client.0.smithi037.stderr: -464> 2024-09-12T17:34:39.302+0000 7f1d1160a640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.40:6816/3916250676,v1:172.21.15.40:6817/3916250676] 2024-09-12T17:34:39.461 INFO:tasks.workunit.client.0.smithi037.stderr: -463> 2024-09-12T17:34:39.302+0000 7f1d1160a640 4 mgrc reconnect Starting new session with [v2:172.21.15.40:6816/3916250676,v1:172.21.15.40:6817/3916250676] 2024-09-12T17:34:39.461 INFO:tasks.workunit.client.0.smithi037.stderr: -462> 2024-09-12T17:34:39.303+0000 7f1e24ca0640 10 monclient: get_auth_request con 0x7f1d0c077550 auth_method 0 2024-09-12T17:34:39.461 INFO:tasks.workunit.client.0.smithi037.stderr: -461> 2024-09-12T17:34:39.303+0000 7f1e254a1640 10 monclient: get_auth_request con 0x558a82afc1f0 auth_method 0 2024-09-12T17:34:39.461 INFO:tasks.workunit.client.0.smithi037.stderr: -460> 2024-09-12T17:34:39.304+0000 7f1e24ca0640 10 monclient: get_auth_request con 0x558a82b13d50 auth_method 0 2024-09-12T17:34:39.461 INFO:tasks.workunit.client.0.smithi037.stderr: -459> 2024-09-12T17:34:39.306+0000 7f1e2449f640 10 monclient: get_auth_request con 0x558a82b18de0 auth_method 0 2024-09-12T17:34:39.461 INFO:tasks.workunit.client.0.smithi037.stderr: -458> 2024-09-12T17:34:39.306+0000 7f1e271af800 10 monclient: build_initial_monmap 2024-09-12T17:34:39.462 INFO:tasks.workunit.client.0.smithi037.stderr: -457> 2024-09-12T17:34:39.306+0000 7f1e271af800 1 build_initial for_mkfs: 0 2024-09-12T17:34:39.462 INFO:tasks.workunit.client.0.smithi037.stderr: -456> 2024-09-12T17:34:39.306+0000 7f1e271af800 10 monclient: monmap: 2024-09-12T17:34:39.462 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 0 2024-09-12T17:34:39.462 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:34:39.462 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 0.000000 2024-09-12T17:34:39.462 INFO:tasks.workunit.client.0.smithi037.stderr:created 0.000000 2024-09-12T17:34:39.462 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 0 (unknown) 2024-09-12T17:34:39.462 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:34:39.462 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.noname-a 2024-09-12T17:34:39.462 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.noname-b 2024-09-12T17:34:39.462 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.noname-c 2024-09-12T17:34:39.462 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:34:39.462 INFO:tasks.workunit.client.0.smithi037.stderr: -455> 2024-09-12T17:34:39.306+0000 7f1e271af800 5 AuthRegistry(0x558a82b1ce60) adding auth protocol: cephx 2024-09-12T17:34:39.462 INFO:tasks.workunit.client.0.smithi037.stderr: -454> 2024-09-12T17:34:39.306+0000 7f1e271af800 5 AuthRegistry(0x558a82b1ce60) adding auth protocol: cephx 2024-09-12T17:34:39.463 INFO:tasks.workunit.client.0.smithi037.stderr: -453> 2024-09-12T17:34:39.306+0000 7f1e271af800 5 AuthRegistry(0x558a82b1ce60) adding auth protocol: cephx 2024-09-12T17:34:39.463 INFO:tasks.workunit.client.0.smithi037.stderr: -452> 2024-09-12T17:34:39.306+0000 7f1e271af800 5 AuthRegistry(0x558a82b1ce60) adding con mode: secure 2024-09-12T17:34:39.463 INFO:tasks.workunit.client.0.smithi037.stderr: -451> 2024-09-12T17:34:39.306+0000 7f1e271af800 5 AuthRegistry(0x558a82b1ce60) adding con mode: crc 2024-09-12T17:34:39.463 INFO:tasks.workunit.client.0.smithi037.stderr: -450> 2024-09-12T17:34:39.306+0000 7f1e271af800 5 AuthRegistry(0x558a82b1ce60) adding con mode: secure 2024-09-12T17:34:39.463 INFO:tasks.workunit.client.0.smithi037.stderr: -449> 2024-09-12T17:34:39.306+0000 7f1e271af800 5 AuthRegistry(0x558a82b1ce60) adding con mode: crc 2024-09-12T17:34:39.463 INFO:tasks.workunit.client.0.smithi037.stderr: -448> 2024-09-12T17:34:39.306+0000 7f1e271af800 5 AuthRegistry(0x558a82b1ce60) adding con mode: secure 2024-09-12T17:34:39.463 INFO:tasks.workunit.client.0.smithi037.stderr: -447> 2024-09-12T17:34:39.306+0000 7f1e271af800 5 AuthRegistry(0x558a82b1ce60) adding con mode: crc 2024-09-12T17:34:39.463 INFO:tasks.workunit.client.0.smithi037.stderr: -446> 2024-09-12T17:34:39.306+0000 7f1e271af800 5 AuthRegistry(0x558a82b1ce60) adding con mode: crc 2024-09-12T17:34:39.463 INFO:tasks.workunit.client.0.smithi037.stderr: -445> 2024-09-12T17:34:39.306+0000 7f1e271af800 5 AuthRegistry(0x558a82b1ce60) adding con mode: secure 2024-09-12T17:34:39.463 INFO:tasks.workunit.client.0.smithi037.stderr: -444> 2024-09-12T17:34:39.306+0000 7f1e271af800 5 AuthRegistry(0x558a82b1ce60) adding con mode: crc 2024-09-12T17:34:39.463 INFO:tasks.workunit.client.0.smithi037.stderr: -443> 2024-09-12T17:34:39.306+0000 7f1e271af800 5 AuthRegistry(0x558a82b1ce60) adding con mode: secure 2024-09-12T17:34:39.463 INFO:tasks.workunit.client.0.smithi037.stderr: -442> 2024-09-12T17:34:39.306+0000 7f1e271af800 5 AuthRegistry(0x558a82b1ce60) adding con mode: crc 2024-09-12T17:34:39.463 INFO:tasks.workunit.client.0.smithi037.stderr: -441> 2024-09-12T17:34:39.306+0000 7f1e271af800 5 AuthRegistry(0x558a82b1ce60) adding con mode: secure 2024-09-12T17:34:39.463 INFO:tasks.workunit.client.0.smithi037.stderr: -440> 2024-09-12T17:34:39.307+0000 7f1e271af800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:34:39.464 INFO:tasks.workunit.client.0.smithi037.stderr: -439> 2024-09-12T17:34:39.307+0000 7f1e271af800 5 asok(0x558a828a4730) register_command objecter_requests cmddesc objecter_requests hook 0x558a82b20330 EEXIST 2024-09-12T17:34:39.464 INFO:tasks.workunit.client.0.smithi037.stderr: -438> 2024-09-12T17:34:39.307+0000 7f1e271af800 10 monclient: init 2024-09-12T17:34:39.464 INFO:tasks.workunit.client.0.smithi037.stderr: -437> 2024-09-12T17:34:39.307+0000 7f1e271af800 5 AuthRegistry(0x558a82b1be18) adding auth protocol: cephx 2024-09-12T17:34:39.464 INFO:tasks.workunit.client.0.smithi037.stderr: -436> 2024-09-12T17:34:39.307+0000 7f1e271af800 5 AuthRegistry(0x558a82b1be18) adding auth protocol: cephx 2024-09-12T17:34:39.464 INFO:tasks.workunit.client.0.smithi037.stderr: -435> 2024-09-12T17:34:39.307+0000 7f1e271af800 5 AuthRegistry(0x558a82b1be18) adding auth protocol: cephx 2024-09-12T17:34:39.464 INFO:tasks.workunit.client.0.smithi037.stderr: -434> 2024-09-12T17:34:39.307+0000 7f1e271af800 5 AuthRegistry(0x558a82b1be18) adding con mode: secure 2024-09-12T17:34:39.464 INFO:tasks.workunit.client.0.smithi037.stderr: -433> 2024-09-12T17:34:39.307+0000 7f1e271af800 5 AuthRegistry(0x558a82b1be18) adding con mode: crc 2024-09-12T17:34:39.464 INFO:tasks.workunit.client.0.smithi037.stderr: -432> 2024-09-12T17:34:39.307+0000 7f1e271af800 5 AuthRegistry(0x558a82b1be18) adding con mode: secure 2024-09-12T17:34:39.464 INFO:tasks.workunit.client.0.smithi037.stderr: -431> 2024-09-12T17:34:39.307+0000 7f1e271af800 5 AuthRegistry(0x558a82b1be18) adding con mode: crc 2024-09-12T17:34:39.464 INFO:tasks.workunit.client.0.smithi037.stderr: -430> 2024-09-12T17:34:39.307+0000 7f1e271af800 5 AuthRegistry(0x558a82b1be18) adding con mode: secure 2024-09-12T17:34:39.464 INFO:tasks.workunit.client.0.smithi037.stderr: -429> 2024-09-12T17:34:39.307+0000 7f1e271af800 5 AuthRegistry(0x558a82b1be18) adding con mode: crc 2024-09-12T17:34:39.464 INFO:tasks.workunit.client.0.smithi037.stderr: -428> 2024-09-12T17:34:39.307+0000 7f1e271af800 5 AuthRegistry(0x558a82b1be18) adding con mode: crc 2024-09-12T17:34:39.464 INFO:tasks.workunit.client.0.smithi037.stderr: -427> 2024-09-12T17:34:39.307+0000 7f1e271af800 5 AuthRegistry(0x558a82b1be18) adding con mode: secure 2024-09-12T17:34:39.464 INFO:tasks.workunit.client.0.smithi037.stderr: -426> 2024-09-12T17:34:39.307+0000 7f1e271af800 5 AuthRegistry(0x558a82b1be18) adding con mode: crc 2024-09-12T17:34:39.465 INFO:tasks.workunit.client.0.smithi037.stderr: -425> 2024-09-12T17:34:39.307+0000 7f1e271af800 5 AuthRegistry(0x558a82b1be18) adding con mode: secure 2024-09-12T17:34:39.465 INFO:tasks.workunit.client.0.smithi037.stderr: -424> 2024-09-12T17:34:39.307+0000 7f1e271af800 5 AuthRegistry(0x558a82b1be18) adding con mode: crc 2024-09-12T17:34:39.465 INFO:tasks.workunit.client.0.smithi037.stderr: -423> 2024-09-12T17:34:39.307+0000 7f1e271af800 5 AuthRegistry(0x558a82b1be18) adding con mode: secure 2024-09-12T17:34:39.465 INFO:tasks.workunit.client.0.smithi037.stderr: -422> 2024-09-12T17:34:39.307+0000 7f1e271af800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:34:39.465 INFO:tasks.workunit.client.0.smithi037.stderr: -421> 2024-09-12T17:34:39.307+0000 7f1e271af800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:34:39.465 INFO:tasks.workunit.client.0.smithi037.stderr: -420> 2024-09-12T17:34:39.307+0000 7f1e271af800 5 asok(0x558a828a4730) register_command rotate-key cmddesc rotate-key hook 0x558a82b1bf60 EEXIST 2024-09-12T17:34:39.465 INFO:tasks.workunit.client.0.smithi037.stderr: -419> 2024-09-12T17:34:39.307+0000 7f1e271af800 10 monclient: _reopen_session rank -1 2024-09-12T17:34:39.465 INFO:tasks.workunit.client.0.smithi037.stderr: -418> 2024-09-12T17:34:39.307+0000 7f1e271af800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T17:34:39.465 INFO:tasks.workunit.client.0.smithi037.stderr: -417> 2024-09-12T17:34:39.307+0000 7f1e271af800 10 monclient(hunting): picked mon.noname-b con 0x558a82b44650 addr [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] 2024-09-12T17:34:39.465 INFO:tasks.workunit.client.0.smithi037.stderr: -416> 2024-09-12T17:34:39.307+0000 7f1e271af800 10 monclient(hunting): picked mon.noname-c con 0x558a82b44a30 addr [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] 2024-09-12T17:34:39.465 INFO:tasks.workunit.client.0.smithi037.stderr: -415> 2024-09-12T17:34:39.307+0000 7f1e271af800 10 monclient(hunting): picked mon.noname-a con 0x558a82b43360 addr [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] 2024-09-12T17:34:39.465 INFO:tasks.workunit.client.0.smithi037.stderr: -414> 2024-09-12T17:34:39.307+0000 7f1e271af800 10 monclient(hunting): start opening mon connection 2024-09-12T17:34:39.465 INFO:tasks.workunit.client.0.smithi037.stderr: -413> 2024-09-12T17:34:39.307+0000 7f1e271af800 10 monclient(hunting): start opening mon connection 2024-09-12T17:34:39.465 INFO:tasks.workunit.client.0.smithi037.stderr: -412> 2024-09-12T17:34:39.307+0000 7f1e271af800 10 monclient(hunting): start opening mon connection 2024-09-12T17:34:39.466 INFO:tasks.workunit.client.0.smithi037.stderr: -411> 2024-09-12T17:34:39.307+0000 7f1e271af800 10 monclient(hunting): _renew_subs 2024-09-12T17:34:39.466 INFO:tasks.workunit.client.0.smithi037.stderr: -410> 2024-09-12T17:34:39.307+0000 7f1e271af800 10 monclient(hunting): authenticate will time out at 2266.905998s 2024-09-12T17:34:39.466 INFO:tasks.workunit.client.0.smithi037.stderr: -409> 2024-09-12T17:34:39.308+0000 7f1e2449f640 10 monclient(hunting): get_auth_request con 0x558a82b44a30 auth_method 0 2024-09-12T17:34:39.466 INFO:tasks.workunit.client.0.smithi037.stderr: -408> 2024-09-12T17:34:39.308+0000 7f1e2449f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:34:39.466 INFO:tasks.workunit.client.0.smithi037.stderr: -407> 2024-09-12T17:34:39.308+0000 7f1e2449f640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:34:39.466 INFO:tasks.workunit.client.0.smithi037.stderr: -406> 2024-09-12T17:34:39.308+0000 7f1e2449f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:34:39.466 INFO:tasks.workunit.client.0.smithi037.stderr: -405> 2024-09-12T17:34:39.308+0000 7f1e254a1640 10 monclient(hunting): get_auth_request con 0x558a82b43360 auth_method 0 2024-09-12T17:34:39.466 INFO:tasks.workunit.client.0.smithi037.stderr: -404> 2024-09-12T17:34:39.308+0000 7f1e254a1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:34:39.466 INFO:tasks.workunit.client.0.smithi037.stderr: -403> 2024-09-12T17:34:39.308+0000 7f1e254a1640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:34:39.466 INFO:tasks.workunit.client.0.smithi037.stderr: -402> 2024-09-12T17:34:39.308+0000 7f1e254a1640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:34:39.466 INFO:tasks.workunit.client.0.smithi037.stderr: -401> 2024-09-12T17:34:39.308+0000 7f1e24ca0640 10 monclient(hunting): get_auth_request con 0x558a82b44650 auth_method 0 2024-09-12T17:34:39.466 INFO:tasks.workunit.client.0.smithi037.stderr: -400> 2024-09-12T17:34:39.308+0000 7f1e24ca0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:34:39.466 INFO:tasks.workunit.client.0.smithi037.stderr: -399> 2024-09-12T17:34:39.308+0000 7f1e24ca0640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:34:39.466 INFO:tasks.workunit.client.0.smithi037.stderr: -398> 2024-09-12T17:34:39.308+0000 7f1e24ca0640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:34:39.467 INFO:tasks.workunit.client.0.smithi037.stderr: -397> 2024-09-12T17:34:39.308+0000 7f1e2449f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:34:39.467 INFO:tasks.workunit.client.0.smithi037.stderr: -396> 2024-09-12T17:34:39.308+0000 7f1e2449f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:34:39.467 INFO:tasks.workunit.client.0.smithi037.stderr: -395> 2024-09-12T17:34:39.308+0000 7f1e2449f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:34:39.467 INFO:tasks.workunit.client.0.smithi037.stderr: -394> 2024-09-12T17:34:39.308+0000 7f1e254a1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:34:39.467 INFO:tasks.workunit.client.0.smithi037.stderr: -393> 2024-09-12T17:34:39.308+0000 7f1e254a1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:34:39.467 INFO:tasks.workunit.client.0.smithi037.stderr: -392> 2024-09-12T17:34:39.308+0000 7f1e254a1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:34:39.467 INFO:tasks.workunit.client.0.smithi037.stderr: -391> 2024-09-12T17:34:39.308+0000 7f1e24ca0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:34:39.467 INFO:tasks.workunit.client.0.smithi037.stderr: -390> 2024-09-12T17:34:39.308+0000 7f1e24ca0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:34:39.467 INFO:tasks.workunit.client.0.smithi037.stderr: -389> 2024-09-12T17:34:39.308+0000 7f1e24ca0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:34:39.467 INFO:tasks.workunit.client.0.smithi037.stderr: -388> 2024-09-12T17:34:39.308+0000 7f1e254a1640 10 monclient(hunting): handle_auth_done global_id 7386 payload 824 2024-09-12T17:34:39.467 INFO:tasks.workunit.client.0.smithi037.stderr: -387> 2024-09-12T17:34:39.308+0000 7f1e254a1640 10 monclient: _finish_hunting 0 2024-09-12T17:34:39.467 INFO:tasks.workunit.client.0.smithi037.stderr: -386> 2024-09-12T17:34:39.308+0000 7f1e254a1640 1 monclient: found mon.noname-a 2024-09-12T17:34:39.467 INFO:tasks.workunit.client.0.smithi037.stderr: -385> 2024-09-12T17:34:39.308+0000 7f1e254a1640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.37:3300/0 2024-09-12T17:34:39.467 INFO:tasks.workunit.client.0.smithi037.stderr: -384> 2024-09-12T17:34:39.308+0000 7f1d0a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:34:39.468 INFO:tasks.workunit.client.0.smithi037.stderr: -383> 2024-09-12T17:34:39.308+0000 7f1d0a7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:34:39.468 INFO:tasks.workunit.client.0.smithi037.stderr: -382> 2024-09-12T17:34:39.308+0000 7f1d0a7fc640 10 monclient: dump: 2024-09-12T17:34:39.468 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:34:39.468 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:34:39.468 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:34:39.468 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:34:39.468 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:34:39.468 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:34:39.468 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:34:39.468 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:34:39.468 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:34:39.468 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:34:39.468 INFO:tasks.workunit.client.0.smithi037.stderr: -381> 2024-09-12T17:34:39.308+0000 7f1d0a7fc640 10 monclient: _finish_auth 0 2024-09-12T17:34:39.469 INFO:tasks.workunit.client.0.smithi037.stderr: -380> 2024-09-12T17:34:39.308+0000 7f1d0a7fc640 10 monclient: _check_auth_tickets 2024-09-12T17:34:39.469 INFO:tasks.workunit.client.0.smithi037.stderr: -379> 2024-09-12T17:34:39.308+0000 7f1d0a7fc640 10 monclient: handle_config config(0 keys) 2024-09-12T17:34:39.469 INFO:tasks.workunit.client.0.smithi037.stderr: -378> 2024-09-12T17:34:39.308+0000 7f1d0a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:34:39.469 INFO:tasks.workunit.client.0.smithi037.stderr: -377> 2024-09-12T17:34:39.308+0000 7f1d0a7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:34:39.469 INFO:tasks.workunit.client.0.smithi037.stderr: -376> 2024-09-12T17:34:39.308+0000 7f1d0a7fc640 10 monclient: dump: 2024-09-12T17:34:39.469 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:34:39.469 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:34:39.469 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:34:39.469 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:34:39.469 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:34:39.469 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:34:39.469 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:34:39.469 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:34:39.469 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:34:39.470 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:34:39.470 INFO:tasks.workunit.client.0.smithi037.stderr: -375> 2024-09-12T17:34:39.308+0000 7f1e271af800 5 monclient: authenticate success, global_id 7386 2024-09-12T17:34:39.470 INFO:tasks.workunit.client.0.smithi037.stderr: -374> 2024-09-12T17:34:39.308+0000 7f1e271af800 10 monclient: _renew_subs 2024-09-12T17:34:39.470 INFO:tasks.workunit.client.0.smithi037.stderr: -373> 2024-09-12T17:34:39.308+0000 7f1e25ca2640 4 set_mon_vals no callback set 2024-09-12T17:34:39.470 INFO:tasks.workunit.client.0.smithi037.stderr: -372> 2024-09-12T17:34:39.308+0000 7f1e271af800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.37:3300/0 2024-09-12T17:34:39.470 INFO:tasks.workunit.client.0.smithi037.stderr: -371> 2024-09-12T17:34:39.308+0000 7f1e271af800 10 monclient: _renew_subs 2024-09-12T17:34:39.470 INFO:tasks.workunit.client.0.smithi037.stderr: -370> 2024-09-12T17:34:39.308+0000 7f1e271af800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.37:3300/0 2024-09-12T17:34:39.470 INFO:tasks.workunit.client.0.smithi037.stderr: -369> 2024-09-12T17:34:39.310+0000 7f1d0a7fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:34:39.470 INFO:tasks.workunit.client.0.smithi037.stderr: -368> 2024-09-12T17:34:39.310+0000 7f1d0a7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.40:6816/3916250676,v1:172.21.15.40:6817/3916250676] 2024-09-12T17:34:39.470 INFO:tasks.workunit.client.0.smithi037.stderr: -367> 2024-09-12T17:34:39.310+0000 7f1d0a7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.40:6816/3916250676,v1:172.21.15.40:6817/3916250676] 2024-09-12T17:34:39.470 INFO:tasks.workunit.client.0.smithi037.stderr: -366> 2024-09-12T17:34:39.311+0000 7f1e271af800 10 monclient: get_monmap_and_config 2024-09-12T17:34:39.470 INFO:tasks.workunit.client.0.smithi037.stderr: -365> 2024-09-12T17:34:39.311+0000 7f1e271af800 10 monclient: build_initial_monmap 2024-09-12T17:34:39.470 INFO:tasks.workunit.client.0.smithi037.stderr: -364> 2024-09-12T17:34:39.311+0000 7f1e271af800 1 build_initial for_mkfs: 0 2024-09-12T17:34:39.470 INFO:tasks.workunit.client.0.smithi037.stderr: -363> 2024-09-12T17:34:39.311+0000 7f1e271af800 10 monclient: monmap: 2024-09-12T17:34:39.471 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 0 2024-09-12T17:34:39.471 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:34:39.471 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 0.000000 2024-09-12T17:34:39.471 INFO:tasks.workunit.client.0.smithi037.stderr:created 0.000000 2024-09-12T17:34:39.471 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 0 (unknown) 2024-09-12T17:34:39.471 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:34:39.471 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.noname-a 2024-09-12T17:34:39.471 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.noname-b 2024-09-12T17:34:39.471 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.noname-c 2024-09-12T17:34:39.471 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:34:39.471 INFO:tasks.workunit.client.0.smithi037.stderr: -362> 2024-09-12T17:34:39.311+0000 7f1e271af800 5 AuthRegistry(0x558a82b643e0) adding auth protocol: cephx 2024-09-12T17:34:39.471 INFO:tasks.workunit.client.0.smithi037.stderr: -361> 2024-09-12T17:34:39.311+0000 7f1e271af800 5 AuthRegistry(0x558a82b643e0) adding auth protocol: cephx 2024-09-12T17:34:39.471 INFO:tasks.workunit.client.0.smithi037.stderr: -360> 2024-09-12T17:34:39.311+0000 7f1e271af800 5 AuthRegistry(0x558a82b643e0) adding auth protocol: cephx 2024-09-12T17:34:39.471 INFO:tasks.workunit.client.0.smithi037.stderr: -359> 2024-09-12T17:34:39.311+0000 7f1e271af800 5 AuthRegistry(0x558a82b643e0) adding con mode: secure 2024-09-12T17:34:39.472 INFO:tasks.workunit.client.0.smithi037.stderr: -358> 2024-09-12T17:34:39.311+0000 7f1e271af800 5 AuthRegistry(0x558a82b643e0) adding con mode: crc 2024-09-12T17:34:39.472 INFO:tasks.workunit.client.0.smithi037.stderr: -357> 2024-09-12T17:34:39.311+0000 7f1e271af800 5 AuthRegistry(0x558a82b643e0) adding con mode: secure 2024-09-12T17:34:39.472 INFO:tasks.workunit.client.0.smithi037.stderr: -356> 2024-09-12T17:34:39.311+0000 7f1e271af800 5 AuthRegistry(0x558a82b643e0) adding con mode: crc 2024-09-12T17:34:39.472 INFO:tasks.workunit.client.0.smithi037.stderr: -355> 2024-09-12T17:34:39.311+0000 7f1e271af800 5 AuthRegistry(0x558a82b643e0) adding con mode: secure 2024-09-12T17:34:39.472 INFO:tasks.workunit.client.0.smithi037.stderr: -354> 2024-09-12T17:34:39.311+0000 7f1e271af800 5 AuthRegistry(0x558a82b643e0) adding con mode: crc 2024-09-12T17:34:39.472 INFO:tasks.workunit.client.0.smithi037.stderr: -353> 2024-09-12T17:34:39.311+0000 7f1e271af800 5 AuthRegistry(0x558a82b643e0) adding con mode: crc 2024-09-12T17:34:39.472 INFO:tasks.workunit.client.0.smithi037.stderr: -352> 2024-09-12T17:34:39.311+0000 7f1e271af800 5 AuthRegistry(0x558a82b643e0) adding con mode: secure 2024-09-12T17:34:39.472 INFO:tasks.workunit.client.0.smithi037.stderr: -351> 2024-09-12T17:34:39.311+0000 7f1e271af800 5 AuthRegistry(0x558a82b643e0) adding con mode: crc 2024-09-12T17:34:39.472 INFO:tasks.workunit.client.0.smithi037.stderr: -350> 2024-09-12T17:34:39.311+0000 7f1e271af800 5 AuthRegistry(0x558a82b643e0) adding con mode: secure 2024-09-12T17:34:39.472 INFO:tasks.workunit.client.0.smithi037.stderr: -349> 2024-09-12T17:34:39.311+0000 7f1e271af800 5 AuthRegistry(0x558a82b643e0) adding con mode: crc 2024-09-12T17:34:39.472 INFO:tasks.workunit.client.0.smithi037.stderr: -348> 2024-09-12T17:34:39.311+0000 7f1e271af800 5 AuthRegistry(0x558a82b643e0) adding con mode: secure 2024-09-12T17:34:39.472 INFO:tasks.workunit.client.0.smithi037.stderr: -347> 2024-09-12T17:34:39.311+0000 7f1e24ca0640 10 monclient: get_auth_request con 0x7f1cfc076380 auth_method 0 2024-09-12T17:34:39.472 INFO:tasks.workunit.client.0.smithi037.stderr: -346> 2024-09-12T17:34:39.311+0000 7f1e271af800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:34:39.473 INFO:tasks.workunit.client.0.smithi037.stderr: -345> 2024-09-12T17:34:39.311+0000 7f1e271af800 10 monclient: init 2024-09-12T17:34:39.473 INFO:tasks.workunit.client.0.smithi037.stderr: -344> 2024-09-12T17:34:39.311+0000 7f1e271af800 5 AuthRegistry(0x7ffe5e026cf0) adding auth protocol: cephx 2024-09-12T17:34:39.473 INFO:tasks.workunit.client.0.smithi037.stderr: -343> 2024-09-12T17:34:39.311+0000 7f1e271af800 5 AuthRegistry(0x7ffe5e026cf0) adding auth protocol: cephx 2024-09-12T17:34:39.473 INFO:tasks.workunit.client.0.smithi037.stderr: -342> 2024-09-12T17:34:39.311+0000 7f1e271af800 5 AuthRegistry(0x7ffe5e026cf0) adding auth protocol: cephx 2024-09-12T17:34:39.473 INFO:tasks.workunit.client.0.smithi037.stderr: -341> 2024-09-12T17:34:39.311+0000 7f1e271af800 5 AuthRegistry(0x7ffe5e026cf0) adding con mode: secure 2024-09-12T17:34:39.473 INFO:tasks.workunit.client.0.smithi037.stderr: -340> 2024-09-12T17:34:39.311+0000 7f1e271af800 5 AuthRegistry(0x7ffe5e026cf0) adding con mode: crc 2024-09-12T17:34:39.473 INFO:tasks.workunit.client.0.smithi037.stderr: -339> 2024-09-12T17:34:39.311+0000 7f1e271af800 5 AuthRegistry(0x7ffe5e026cf0) adding con mode: secure 2024-09-12T17:34:39.473 INFO:tasks.workunit.client.0.smithi037.stderr: -338> 2024-09-12T17:34:39.311+0000 7f1e271af800 5 AuthRegistry(0x7ffe5e026cf0) adding con mode: crc 2024-09-12T17:34:39.473 INFO:tasks.workunit.client.0.smithi037.stderr: -337> 2024-09-12T17:34:39.311+0000 7f1e271af800 5 AuthRegistry(0x7ffe5e026cf0) adding con mode: secure 2024-09-12T17:34:39.473 INFO:tasks.workunit.client.0.smithi037.stderr: -336> 2024-09-12T17:34:39.311+0000 7f1e271af800 5 AuthRegistry(0x7ffe5e026cf0) adding con mode: crc 2024-09-12T17:34:39.473 INFO:tasks.workunit.client.0.smithi037.stderr: -335> 2024-09-12T17:34:39.311+0000 7f1e271af800 5 AuthRegistry(0x7ffe5e026cf0) adding con mode: crc 2024-09-12T17:34:39.473 INFO:tasks.workunit.client.0.smithi037.stderr: -334> 2024-09-12T17:34:39.311+0000 7f1e271af800 5 AuthRegistry(0x7ffe5e026cf0) adding con mode: secure 2024-09-12T17:34:39.473 INFO:tasks.workunit.client.0.smithi037.stderr: -333> 2024-09-12T17:34:39.311+0000 7f1e271af800 5 AuthRegistry(0x7ffe5e026cf0) adding con mode: crc 2024-09-12T17:34:39.473 INFO:tasks.workunit.client.0.smithi037.stderr: -332> 2024-09-12T17:34:39.311+0000 7f1e271af800 5 AuthRegistry(0x7ffe5e026cf0) adding con mode: secure 2024-09-12T17:34:39.474 INFO:tasks.workunit.client.0.smithi037.stderr: -331> 2024-09-12T17:34:39.311+0000 7f1e271af800 5 AuthRegistry(0x7ffe5e026cf0) adding con mode: crc 2024-09-12T17:34:39.474 INFO:tasks.workunit.client.0.smithi037.stderr: -330> 2024-09-12T17:34:39.311+0000 7f1e271af800 5 AuthRegistry(0x7ffe5e026cf0) adding con mode: secure 2024-09-12T17:34:39.474 INFO:tasks.workunit.client.0.smithi037.stderr: -329> 2024-09-12T17:34:39.311+0000 7f1e271af800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:34:39.474 INFO:tasks.workunit.client.0.smithi037.stderr: -328> 2024-09-12T17:34:39.312+0000 7f1e271af800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:34:39.474 INFO:tasks.workunit.client.0.smithi037.stderr: -327> 2024-09-12T17:34:39.312+0000 7f1e271af800 5 asok(0x558a828a4730) register_command rotate-key cmddesc rotate-key hook 0x7ffe5e026e38 EEXIST 2024-09-12T17:34:39.474 INFO:tasks.workunit.client.0.smithi037.stderr: -326> 2024-09-12T17:34:39.312+0000 7f1e271af800 10 monclient: _reopen_session rank -1 2024-09-12T17:34:39.474 INFO:tasks.workunit.client.0.smithi037.stderr: -325> 2024-09-12T17:34:39.312+0000 7f1e271af800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T17:34:39.474 INFO:tasks.workunit.client.0.smithi037.stderr: -324> 2024-09-12T17:34:39.312+0000 7f1e271af800 10 monclient(hunting): picked mon.noname-b con 0x558a82b989e0 addr [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] 2024-09-12T17:34:39.474 INFO:tasks.workunit.client.0.smithi037.stderr: -323> 2024-09-12T17:34:39.312+0000 7f1e271af800 10 monclient(hunting): picked mon.noname-c con 0x558a82b89330 addr [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] 2024-09-12T17:34:39.474 INFO:tasks.workunit.client.0.smithi037.stderr: -322> 2024-09-12T17:34:39.312+0000 7f1e271af800 10 monclient(hunting): picked mon.noname-a con 0x558a82b93e10 addr [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] 2024-09-12T17:34:39.474 INFO:tasks.workunit.client.0.smithi037.stderr: -321> 2024-09-12T17:34:39.312+0000 7f1e271af800 10 monclient(hunting): start opening mon connection 2024-09-12T17:34:39.474 INFO:tasks.workunit.client.0.smithi037.stderr: -320> 2024-09-12T17:34:39.312+0000 7f1e271af800 10 monclient(hunting): start opening mon connection 2024-09-12T17:34:39.474 INFO:tasks.workunit.client.0.smithi037.stderr: -319> 2024-09-12T17:34:39.312+0000 7f1e271af800 10 monclient(hunting): start opening mon connection 2024-09-12T17:34:39.474 INFO:tasks.workunit.client.0.smithi037.stderr: -318> 2024-09-12T17:34:39.312+0000 7f1e271af800 10 monclient(hunting): _renew_subs 2024-09-12T17:34:39.475 INFO:tasks.workunit.client.0.smithi037.stderr: -317> 2024-09-12T17:34:39.312+0000 7f1e271af800 10 monclient(hunting): authenticate will time out at 2266.910202s 2024-09-12T17:34:39.475 INFO:tasks.workunit.client.0.smithi037.stderr: -316> 2024-09-12T17:34:39.312+0000 7f1e254a1640 10 monclient(hunting): get_auth_request con 0x558a82b93e10 auth_method 0 2024-09-12T17:34:39.475 INFO:tasks.workunit.client.0.smithi037.stderr: -315> 2024-09-12T17:34:39.312+0000 7f1e254a1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:34:39.475 INFO:tasks.workunit.client.0.smithi037.stderr: -314> 2024-09-12T17:34:39.312+0000 7f1e254a1640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:34:39.475 INFO:tasks.workunit.client.0.smithi037.stderr: -313> 2024-09-12T17:34:39.312+0000 7f1e254a1640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:34:39.475 INFO:tasks.workunit.client.0.smithi037.stderr: -312> 2024-09-12T17:34:39.312+0000 7f1e2449f640 10 monclient(hunting): get_auth_request con 0x558a82b89330 auth_method 0 2024-09-12T17:34:39.475 INFO:tasks.workunit.client.0.smithi037.stderr: -311> 2024-09-12T17:34:39.312+0000 7f1e2449f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:34:39.475 INFO:tasks.workunit.client.0.smithi037.stderr: -310> 2024-09-12T17:34:39.312+0000 7f1e2449f640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:34:39.475 INFO:tasks.workunit.client.0.smithi037.stderr: -309> 2024-09-12T17:34:39.312+0000 7f1e2449f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:34:39.475 INFO:tasks.workunit.client.0.smithi037.stderr: -308> 2024-09-12T17:34:39.312+0000 7f1e24ca0640 10 monclient(hunting): get_auth_request con 0x558a82b989e0 auth_method 0 2024-09-12T17:34:39.476 INFO:tasks.workunit.client.0.smithi037.stderr: -307> 2024-09-12T17:34:39.312+0000 7f1e24ca0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:34:39.476 INFO:tasks.workunit.client.0.smithi037.stderr: -306> 2024-09-12T17:34:39.312+0000 7f1e24ca0640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:34:39.476 INFO:tasks.workunit.client.0.smithi037.stderr: -305> 2024-09-12T17:34:39.312+0000 7f1e24ca0640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:34:39.476 INFO:tasks.workunit.client.0.smithi037.stderr: -304> 2024-09-12T17:34:39.312+0000 7f1e2449f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:34:39.476 INFO:tasks.workunit.client.0.smithi037.stderr: -303> 2024-09-12T17:34:39.312+0000 7f1e2449f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:34:39.476 INFO:tasks.workunit.client.0.smithi037.stderr: -302> 2024-09-12T17:34:39.312+0000 7f1e2449f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:34:39.476 INFO:tasks.workunit.client.0.smithi037.stderr: -301> 2024-09-12T17:34:39.312+0000 7f1e254a1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:34:39.476 INFO:tasks.workunit.client.0.smithi037.stderr: -300> 2024-09-12T17:34:39.312+0000 7f1e254a1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:34:39.476 INFO:tasks.workunit.client.0.smithi037.stderr: -299> 2024-09-12T17:34:39.312+0000 7f1e254a1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:34:39.476 INFO:tasks.workunit.client.0.smithi037.stderr: -298> 2024-09-12T17:34:39.312+0000 7f1e24ca0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:34:39.476 INFO:tasks.workunit.client.0.smithi037.stderr: -297> 2024-09-12T17:34:39.312+0000 7f1e24ca0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:34:39.476 INFO:tasks.workunit.client.0.smithi037.stderr: -296> 2024-09-12T17:34:39.312+0000 7f1e24ca0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:34:39.476 INFO:tasks.workunit.client.0.smithi037.stderr: -295> 2024-09-12T17:34:39.312+0000 7f1e254a1640 10 monclient(hunting): handle_auth_done global_id 7389 payload 274 2024-09-12T17:34:39.476 INFO:tasks.workunit.client.0.smithi037.stderr: -294> 2024-09-12T17:34:39.312+0000 7f1e254a1640 10 monclient: _finish_hunting 0 2024-09-12T17:34:39.477 INFO:tasks.workunit.client.0.smithi037.stderr: -293> 2024-09-12T17:34:39.312+0000 7f1e254a1640 1 monclient: found mon.noname-a 2024-09-12T17:34:39.477 INFO:tasks.workunit.client.0.smithi037.stderr: -292> 2024-09-12T17:34:39.312+0000 7f1e254a1640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.37:3300/0 2024-09-12T17:34:39.477 INFO:tasks.workunit.client.0.smithi037.stderr: -291> 2024-09-12T17:34:39.312+0000 7f1cfbfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:34:39.477 INFO:tasks.workunit.client.0.smithi037.stderr: -290> 2024-09-12T17:34:39.312+0000 7f1cfbfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:34:39.477 INFO:tasks.workunit.client.0.smithi037.stderr: -289> 2024-09-12T17:34:39.312+0000 7f1cfbfff640 10 monclient: dump: 2024-09-12T17:34:39.477 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:34:39.477 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:34:39.477 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:34:39.477 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:34:39.477 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:34:39.477 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:34:39.477 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:34:39.477 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:34:39.477 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:34:39.478 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:34:39.478 INFO:tasks.workunit.client.0.smithi037.stderr: -288> 2024-09-12T17:34:39.312+0000 7f1cfbfff640 10 monclient: _finish_auth 0 2024-09-12T17:34:39.478 INFO:tasks.workunit.client.0.smithi037.stderr: -287> 2024-09-12T17:34:39.312+0000 7f1cfbfff640 10 monclient: _check_auth_tickets 2024-09-12T17:34:39.478 INFO:tasks.workunit.client.0.smithi037.stderr: -286> 2024-09-12T17:34:39.312+0000 7f1cfbfff640 10 monclient: handle_config config(0 keys) 2024-09-12T17:34:39.478 INFO:tasks.workunit.client.0.smithi037.stderr: -285> 2024-09-12T17:34:39.312+0000 7f1cfbfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:34:39.478 INFO:tasks.workunit.client.0.smithi037.stderr: -284> 2024-09-12T17:34:39.312+0000 7f1cfbfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:34:39.478 INFO:tasks.workunit.client.0.smithi037.stderr: -283> 2024-09-12T17:34:39.312+0000 7f1cfbfff640 10 monclient: dump: 2024-09-12T17:34:39.478 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:34:39.478 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:34:39.478 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:34:39.478 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:34:39.478 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:34:39.478 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:34:39.478 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:34:39.479 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:34:39.479 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:34:39.479 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:34:39.479 INFO:tasks.workunit.client.0.smithi037.stderr: -282> 2024-09-12T17:34:39.312+0000 7f1e271af800 5 monclient: authenticate success, global_id 7389 2024-09-12T17:34:39.479 INFO:tasks.workunit.client.0.smithi037.stderr: -281> 2024-09-12T17:34:39.312+0000 7f1e271af800 10 monclient: get_monmap_and_config success 2024-09-12T17:34:39.479 INFO:tasks.workunit.client.0.smithi037.stderr: -280> 2024-09-12T17:34:39.312+0000 7f1e271af800 4 set_mon_vals no callback set 2024-09-12T17:34:39.479 INFO:tasks.workunit.client.0.smithi037.stderr: -279> 2024-09-12T17:34:39.313+0000 7f1e271af800 10 monclient: shutdown 2024-09-12T17:34:39.479 INFO:tasks.workunit.client.0.smithi037.stderr: -278> 2024-09-12T17:34:39.313+0000 7f1e271af800 10 monclient: build_initial_monmap 2024-09-12T17:34:39.479 INFO:tasks.workunit.client.0.smithi037.stderr: -277> 2024-09-12T17:34:39.313+0000 7f1e271af800 1 build_initial for_mkfs: 0 2024-09-12T17:34:39.479 INFO:tasks.workunit.client.0.smithi037.stderr: -276> 2024-09-12T17:34:39.313+0000 7f1e271af800 10 monclient: monmap: 2024-09-12T17:34:39.479 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 0 2024-09-12T17:34:39.479 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:34:39.479 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 0.000000 2024-09-12T17:34:39.479 INFO:tasks.workunit.client.0.smithi037.stderr:created 0.000000 2024-09-12T17:34:39.480 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 0 (unknown) 2024-09-12T17:34:39.480 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:34:39.480 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.noname-a 2024-09-12T17:34:39.480 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.noname-b 2024-09-12T17:34:39.480 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.noname-c 2024-09-12T17:34:39.480 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:34:39.480 INFO:tasks.workunit.client.0.smithi037.stderr: -275> 2024-09-12T17:34:39.313+0000 7f1e271af800 5 AuthRegistry(0x558a82b89820) adding auth protocol: cephx 2024-09-12T17:34:39.480 INFO:tasks.workunit.client.0.smithi037.stderr: -274> 2024-09-12T17:34:39.313+0000 7f1e271af800 5 AuthRegistry(0x558a82b89820) adding auth protocol: cephx 2024-09-12T17:34:39.480 INFO:tasks.workunit.client.0.smithi037.stderr: -273> 2024-09-12T17:34:39.313+0000 7f1e271af800 5 AuthRegistry(0x558a82b89820) adding auth protocol: cephx 2024-09-12T17:34:39.480 INFO:tasks.workunit.client.0.smithi037.stderr: -272> 2024-09-12T17:34:39.313+0000 7f1e271af800 5 AuthRegistry(0x558a82b89820) adding con mode: secure 2024-09-12T17:34:39.480 INFO:tasks.workunit.client.0.smithi037.stderr: -271> 2024-09-12T17:34:39.313+0000 7f1e271af800 5 AuthRegistry(0x558a82b89820) adding con mode: crc 2024-09-12T17:34:39.480 INFO:tasks.workunit.client.0.smithi037.stderr: -270> 2024-09-12T17:34:39.313+0000 7f1e271af800 5 AuthRegistry(0x558a82b89820) adding con mode: secure 2024-09-12T17:34:39.480 INFO:tasks.workunit.client.0.smithi037.stderr: -269> 2024-09-12T17:34:39.313+0000 7f1e271af800 5 AuthRegistry(0x558a82b89820) adding con mode: crc 2024-09-12T17:34:39.480 INFO:tasks.workunit.client.0.smithi037.stderr: -268> 2024-09-12T17:34:39.313+0000 7f1e271af800 5 AuthRegistry(0x558a82b89820) adding con mode: secure 2024-09-12T17:34:39.481 INFO:tasks.workunit.client.0.smithi037.stderr: -267> 2024-09-12T17:34:39.313+0000 7f1e271af800 5 AuthRegistry(0x558a82b89820) adding con mode: crc 2024-09-12T17:34:39.481 INFO:tasks.workunit.client.0.smithi037.stderr: -266> 2024-09-12T17:34:39.313+0000 7f1e271af800 5 AuthRegistry(0x558a82b89820) adding con mode: crc 2024-09-12T17:34:39.481 INFO:tasks.workunit.client.0.smithi037.stderr: -265> 2024-09-12T17:34:39.313+0000 7f1e271af800 5 AuthRegistry(0x558a82b89820) adding con mode: secure 2024-09-12T17:34:39.481 INFO:tasks.workunit.client.0.smithi037.stderr: -264> 2024-09-12T17:34:39.313+0000 7f1e271af800 5 AuthRegistry(0x558a82b89820) adding con mode: crc 2024-09-12T17:34:39.481 INFO:tasks.workunit.client.0.smithi037.stderr: -263> 2024-09-12T17:34:39.313+0000 7f1e271af800 5 AuthRegistry(0x558a82b89820) adding con mode: secure 2024-09-12T17:34:39.481 INFO:tasks.workunit.client.0.smithi037.stderr: -262> 2024-09-12T17:34:39.313+0000 7f1e271af800 5 AuthRegistry(0x558a82b89820) adding con mode: crc 2024-09-12T17:34:39.481 INFO:tasks.workunit.client.0.smithi037.stderr: -261> 2024-09-12T17:34:39.313+0000 7f1e271af800 5 AuthRegistry(0x558a82b89820) adding con mode: secure 2024-09-12T17:34:39.481 INFO:tasks.workunit.client.0.smithi037.stderr: -260> 2024-09-12T17:34:39.313+0000 7f1e271af800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:34:39.481 INFO:tasks.workunit.client.0.smithi037.stderr: -259> 2024-09-12T17:34:39.313+0000 7f1e271af800 1 librados: starting msgr at 2024-09-12T17:34:39.481 INFO:tasks.workunit.client.0.smithi037.stderr: -258> 2024-09-12T17:34:39.313+0000 7f1e271af800 1 librados: starting objecter 2024-09-12T17:34:39.481 INFO:tasks.workunit.client.0.smithi037.stderr: -257> 2024-09-12T17:34:39.313+0000 7f1e271af800 5 asok(0x558a828a4730) register_command objecter_requests cmddesc objecter_requests hook 0x558a82b46750 EEXIST 2024-09-12T17:34:39.481 INFO:tasks.workunit.client.0.smithi037.stderr: -256> 2024-09-12T17:34:39.313+0000 7f1e271af800 1 librados: setting wanted keys 2024-09-12T17:34:39.481 INFO:tasks.workunit.client.0.smithi037.stderr: -255> 2024-09-12T17:34:39.313+0000 7f1e271af800 1 librados: calling monclient init 2024-09-12T17:34:39.481 INFO:tasks.workunit.client.0.smithi037.stderr: -254> 2024-09-12T17:34:39.313+0000 7f1e271af800 10 monclient: init 2024-09-12T17:34:39.482 INFO:tasks.workunit.client.0.smithi037.stderr: -253> 2024-09-12T17:34:39.313+0000 7f1e271af800 5 AuthRegistry(0x558a82b58f10) adding auth protocol: cephx 2024-09-12T17:34:39.482 INFO:tasks.workunit.client.0.smithi037.stderr: -252> 2024-09-12T17:34:39.313+0000 7f1e271af800 5 AuthRegistry(0x558a82b58f10) adding auth protocol: cephx 2024-09-12T17:34:39.482 INFO:tasks.workunit.client.0.smithi037.stderr: -251> 2024-09-12T17:34:39.313+0000 7f1e271af800 5 AuthRegistry(0x558a82b58f10) adding auth protocol: cephx 2024-09-12T17:34:39.482 INFO:tasks.workunit.client.0.smithi037.stderr: -250> 2024-09-12T17:34:39.313+0000 7f1e271af800 5 AuthRegistry(0x558a82b58f10) adding con mode: secure 2024-09-12T17:34:39.482 INFO:tasks.workunit.client.0.smithi037.stderr: -249> 2024-09-12T17:34:39.313+0000 7f1e271af800 5 AuthRegistry(0x558a82b58f10) adding con mode: crc 2024-09-12T17:34:39.482 INFO:tasks.workunit.client.0.smithi037.stderr: -248> 2024-09-12T17:34:39.313+0000 7f1e271af800 5 AuthRegistry(0x558a82b58f10) adding con mode: secure 2024-09-12T17:34:39.482 INFO:tasks.workunit.client.0.smithi037.stderr: -247> 2024-09-12T17:34:39.313+0000 7f1e271af800 5 AuthRegistry(0x558a82b58f10) adding con mode: crc 2024-09-12T17:34:39.482 INFO:tasks.workunit.client.0.smithi037.stderr: -246> 2024-09-12T17:34:39.313+0000 7f1e271af800 5 AuthRegistry(0x558a82b58f10) adding con mode: secure 2024-09-12T17:34:39.482 INFO:tasks.workunit.client.0.smithi037.stderr: -245> 2024-09-12T17:34:39.313+0000 7f1e271af800 5 AuthRegistry(0x558a82b58f10) adding con mode: crc 2024-09-12T17:34:39.482 INFO:tasks.workunit.client.0.smithi037.stderr: -244> 2024-09-12T17:34:39.313+0000 7f1e271af800 5 AuthRegistry(0x558a82b58f10) adding con mode: crc 2024-09-12T17:34:39.482 INFO:tasks.workunit.client.0.smithi037.stderr: -243> 2024-09-12T17:34:39.313+0000 7f1e271af800 5 AuthRegistry(0x558a82b58f10) adding con mode: secure 2024-09-12T17:34:39.482 INFO:tasks.workunit.client.0.smithi037.stderr: -242> 2024-09-12T17:34:39.314+0000 7f1e271af800 5 AuthRegistry(0x558a82b58f10) adding con mode: crc 2024-09-12T17:34:39.482 INFO:tasks.workunit.client.0.smithi037.stderr: -241> 2024-09-12T17:34:39.314+0000 7f1e271af800 5 AuthRegistry(0x558a82b58f10) adding con mode: secure 2024-09-12T17:34:39.483 INFO:tasks.workunit.client.0.smithi037.stderr: -240> 2024-09-12T17:34:39.314+0000 7f1e271af800 5 AuthRegistry(0x558a82b58f10) adding con mode: crc 2024-09-12T17:34:39.483 INFO:tasks.workunit.client.0.smithi037.stderr: -239> 2024-09-12T17:34:39.314+0000 7f1e271af800 5 AuthRegistry(0x558a82b58f10) adding con mode: secure 2024-09-12T17:34:39.483 INFO:tasks.workunit.client.0.smithi037.stderr: -238> 2024-09-12T17:34:39.314+0000 7f1e271af800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:34:39.483 INFO:tasks.workunit.client.0.smithi037.stderr: -237> 2024-09-12T17:34:39.314+0000 7f1e271af800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:34:39.483 INFO:tasks.workunit.client.0.smithi037.stderr: -236> 2024-09-12T17:34:39.314+0000 7f1e271af800 5 asok(0x558a828a4730) register_command rotate-key cmddesc rotate-key hook 0x558a82b59058 EEXIST 2024-09-12T17:34:39.483 INFO:tasks.workunit.client.0.smithi037.stderr: -235> 2024-09-12T17:34:39.314+0000 7f1e271af800 10 monclient: _reopen_session rank -1 2024-09-12T17:34:39.483 INFO:tasks.workunit.client.0.smithi037.stderr: -234> 2024-09-12T17:34:39.314+0000 7f1e271af800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T17:34:39.483 INFO:tasks.workunit.client.0.smithi037.stderr: -233> 2024-09-12T17:34:39.314+0000 7f1e271af800 10 monclient(hunting): picked mon.noname-b con 0x558a82b89330 addr [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] 2024-09-12T17:34:39.483 INFO:tasks.workunit.client.0.smithi037.stderr: -232> 2024-09-12T17:34:39.314+0000 7f1e271af800 10 monclient(hunting): picked mon.noname-c con 0x558a82b93e10 addr [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] 2024-09-12T17:34:39.483 INFO:tasks.workunit.client.0.smithi037.stderr: -231> 2024-09-12T17:34:39.314+0000 7f1e271af800 10 monclient(hunting): picked mon.noname-a con 0x558a82b989e0 addr [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] 2024-09-12T17:34:39.483 INFO:tasks.workunit.client.0.smithi037.stderr: -230> 2024-09-12T17:34:39.314+0000 7f1e271af800 10 monclient(hunting): start opening mon connection 2024-09-12T17:34:39.483 INFO:tasks.workunit.client.0.smithi037.stderr: -229> 2024-09-12T17:34:39.314+0000 7f1e271af800 10 monclient(hunting): start opening mon connection 2024-09-12T17:34:39.483 INFO:tasks.workunit.client.0.smithi037.stderr: -228> 2024-09-12T17:34:39.314+0000 7f1e271af800 10 monclient(hunting): start opening mon connection 2024-09-12T17:34:39.483 INFO:tasks.workunit.client.0.smithi037.stderr: -227> 2024-09-12T17:34:39.314+0000 7f1e271af800 10 monclient(hunting): _renew_subs 2024-09-12T17:34:39.484 INFO:tasks.workunit.client.0.smithi037.stderr: -226> 2024-09-12T17:34:39.314+0000 7f1e271af800 10 monclient(hunting): authenticate will time out at 2266.912527s 2024-09-12T17:34:39.484 INFO:tasks.workunit.client.0.smithi037.stderr: -225> 2024-09-12T17:34:39.314+0000 7f1e2449f640 10 monclient(hunting): get_auth_request con 0x558a82b93e10 auth_method 0 2024-09-12T17:34:39.484 INFO:tasks.workunit.client.0.smithi037.stderr: -224> 2024-09-12T17:34:39.314+0000 7f1e2449f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:34:39.484 INFO:tasks.workunit.client.0.smithi037.stderr: -223> 2024-09-12T17:34:39.314+0000 7f1e2449f640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:34:39.484 INFO:tasks.workunit.client.0.smithi037.stderr: -222> 2024-09-12T17:34:39.314+0000 7f1e2449f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:34:39.484 INFO:tasks.workunit.client.0.smithi037.stderr: -221> 2024-09-12T17:34:39.314+0000 7f1e254a1640 10 monclient(hunting): get_auth_request con 0x558a82b989e0 auth_method 0 2024-09-12T17:34:39.484 INFO:tasks.workunit.client.0.smithi037.stderr: -220> 2024-09-12T17:34:39.314+0000 7f1e254a1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:34:39.484 INFO:tasks.workunit.client.0.smithi037.stderr: -219> 2024-09-12T17:34:39.314+0000 7f1e254a1640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:34:39.484 INFO:tasks.workunit.client.0.smithi037.stderr: -218> 2024-09-12T17:34:39.314+0000 7f1e254a1640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:34:39.484 INFO:tasks.workunit.client.0.smithi037.stderr: -217> 2024-09-12T17:34:39.314+0000 7f1e2449f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:34:39.484 INFO:tasks.workunit.client.0.smithi037.stderr: -216> 2024-09-12T17:34:39.314+0000 7f1e2449f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:34:39.484 INFO:tasks.workunit.client.0.smithi037.stderr: -215> 2024-09-12T17:34:39.314+0000 7f1e2449f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:34:39.484 INFO:tasks.workunit.client.0.smithi037.stderr: -214> 2024-09-12T17:34:39.314+0000 7f1e254a1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:34:39.484 INFO:tasks.workunit.client.0.smithi037.stderr: -213> 2024-09-12T17:34:39.314+0000 7f1e254a1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:34:39.485 INFO:tasks.workunit.client.0.smithi037.stderr: -212> 2024-09-12T17:34:39.314+0000 7f1e254a1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:34:39.485 INFO:tasks.workunit.client.0.smithi037.stderr: -211> 2024-09-12T17:34:39.314+0000 7f1e24ca0640 10 monclient(hunting): get_auth_request con 0x558a82b89330 auth_method 0 2024-09-12T17:34:39.485 INFO:tasks.workunit.client.0.smithi037.stderr: -210> 2024-09-12T17:34:39.314+0000 7f1e24ca0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:34:39.485 INFO:tasks.workunit.client.0.smithi037.stderr: -209> 2024-09-12T17:34:39.314+0000 7f1e24ca0640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:34:39.485 INFO:tasks.workunit.client.0.smithi037.stderr: -208> 2024-09-12T17:34:39.314+0000 7f1e24ca0640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:34:39.485 INFO:tasks.workunit.client.0.smithi037.stderr: -207> 2024-09-12T17:34:39.314+0000 7f1e2449f640 10 monclient(hunting): handle_auth_done global_id 6920 payload 824 2024-09-12T17:34:39.485 INFO:tasks.workunit.client.0.smithi037.stderr: -206> 2024-09-12T17:34:39.314+0000 7f1e2449f640 10 monclient: _finish_hunting 0 2024-09-12T17:34:39.485 INFO:tasks.workunit.client.0.smithi037.stderr: -205> 2024-09-12T17:34:39.314+0000 7f1e2449f640 1 monclient: found mon.noname-c 2024-09-12T17:34:39.485 INFO:tasks.workunit.client.0.smithi037.stderr: -204> 2024-09-12T17:34:39.314+0000 7f1e2449f640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.37:3301/0 2024-09-12T17:34:39.485 INFO:tasks.workunit.client.0.smithi037.stderr: -203> 2024-09-12T17:34:39.315+0000 7f1cfa7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:34:39.485 INFO:tasks.workunit.client.0.smithi037.stderr: -202> 2024-09-12T17:34:39.315+0000 7f1cfa7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:34:39.485 INFO:tasks.workunit.client.0.smithi037.stderr: -201> 2024-09-12T17:34:39.315+0000 7f1cfa7fc640 10 monclient: dump: 2024-09-12T17:34:39.485 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:34:39.485 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:34:39.486 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:34:39.486 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:34:39.486 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:34:39.486 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:34:39.486 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:34:39.486 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:34:39.486 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:34:39.486 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:34:39.486 INFO:tasks.workunit.client.0.smithi037.stderr: -200> 2024-09-12T17:34:39.315+0000 7f1cfa7fc640 10 monclient: _finish_auth 0 2024-09-12T17:34:39.486 INFO:tasks.workunit.client.0.smithi037.stderr: -199> 2024-09-12T17:34:39.315+0000 7f1cfa7fc640 10 monclient: _check_auth_tickets 2024-09-12T17:34:39.486 INFO:tasks.workunit.client.0.smithi037.stderr: -198> 2024-09-12T17:34:39.315+0000 7f1e271af800 5 monclient: authenticate success, global_id 6920 2024-09-12T17:34:39.486 INFO:tasks.workunit.client.0.smithi037.stderr: -197> 2024-09-12T17:34:39.315+0000 7f1e271af800 10 monclient: _renew_subs 2024-09-12T17:34:39.486 INFO:tasks.workunit.client.0.smithi037.stderr: -196> 2024-09-12T17:34:39.315+0000 7f1e271af800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.37:3301/0 2024-09-12T17:34:39.486 INFO:tasks.workunit.client.0.smithi037.stderr: -195> 2024-09-12T17:34:39.315+0000 7f1cfa7fc640 10 monclient: handle_config config(0 keys) 2024-09-12T17:34:39.487 INFO:tasks.workunit.client.0.smithi037.stderr: -194> 2024-09-12T17:34:39.315+0000 7f1cfa7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:34:39.487 INFO:tasks.workunit.client.0.smithi037.stderr: -193> 2024-09-12T17:34:39.315+0000 7f1cfa7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:34:39.487 INFO:tasks.workunit.client.0.smithi037.stderr: -192> 2024-09-12T17:34:39.315+0000 7f1cfa7fc640 10 monclient: dump: 2024-09-12T17:34:39.487 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:34:39.487 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:34:39.487 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:34:39.487 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:34:39.487 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:34:39.487 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:34:39.487 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:34:39.487 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:34:39.487 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:34:39.487 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:34:39.488 INFO:tasks.workunit.client.0.smithi037.stderr: -191> 2024-09-12T17:34:39.315+0000 7f1cfbfff640 4 set_mon_vals no callback set 2024-09-12T17:34:39.488 INFO:tasks.workunit.client.0.smithi037.stderr: -190> 2024-09-12T17:34:39.315+0000 7f1e271af800 10 monclient: _renew_subs 2024-09-12T17:34:39.488 INFO:tasks.workunit.client.0.smithi037.stderr: -189> 2024-09-12T17:34:39.315+0000 7f1e271af800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.37:3301/0 2024-09-12T17:34:39.488 INFO:tasks.workunit.client.0.smithi037.stderr: -188> 2024-09-12T17:34:39.315+0000 7f1e271af800 1 librados: init done 2024-09-12T17:34:39.488 INFO:tasks.workunit.client.0.smithi037.stderr: -187> 2024-09-12T17:34:39.315+0000 7f1e271af800 5 asok(0x558a828a4730) register_command cr dump hook 0x558a82b92ab8 2024-09-12T17:34:39.488 INFO:tasks.workunit.client.0.smithi037.stderr: -186> 2024-09-12T17:34:39.316+0000 7f1e271af800 20 rados->read ofs=0 len=0 2024-09-12T17:34:39.488 INFO:tasks.workunit.client.0.smithi037.stderr: -185> 2024-09-12T17:34:39.317+0000 7f1cfa7fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:34:39.488 INFO:tasks.workunit.client.0.smithi037.stderr: -184> 2024-09-12T17:34:39.317+0000 7f1cfa7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.40:6816/3916250676,v1:172.21.15.40:6817/3916250676] 2024-09-12T17:34:39.488 INFO:tasks.workunit.client.0.smithi037.stderr: -183> 2024-09-12T17:34:39.317+0000 7f1cfa7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.40:6816/3916250676,v1:172.21.15.40:6817/3916250676] 2024-09-12T17:34:39.488 INFO:tasks.workunit.client.0.smithi037.stderr: -182> 2024-09-12T17:34:39.317+0000 7f1e24ca0640 10 monclient: get_auth_request con 0x7f1cf0076470 auth_method 0 2024-09-12T17:34:39.488 INFO:tasks.workunit.client.0.smithi037.stderr: -181> 2024-09-12T17:34:39.317+0000 7f1e254a1640 10 monclient: get_auth_request con 0x558a82bb28d0 auth_method 0 2024-09-12T17:34:39.488 INFO:tasks.workunit.client.0.smithi037.stderr: -180> 2024-09-12T17:34:39.318+0000 7f1e271af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:39.488 INFO:tasks.workunit.client.0.smithi037.stderr: -179> 2024-09-12T17:34:39.318+0000 7f1e271af800 20 realm 2024-09-12T17:34:39.488 INFO:tasks.workunit.client.0.smithi037.stderr: -178> 2024-09-12T17:34:39.318+0000 7f1e271af800 20 rados->read ofs=0 len=0 2024-09-12T17:34:39.489 INFO:tasks.workunit.client.0.smithi037.stderr: -177> 2024-09-12T17:34:39.318+0000 7f1e271af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:39.489 INFO:tasks.workunit.client.0.smithi037.stderr: -176> 2024-09-12T17:34:39.318+0000 7f1e271af800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:34:39.489 INFO:tasks.workunit.client.0.smithi037.stderr: -175> 2024-09-12T17:34:39.318+0000 7f1e271af800 20 rados->read ofs=0 len=0 2024-09-12T17:34:39.489 INFO:tasks.workunit.client.0.smithi037.stderr: -174> 2024-09-12T17:34:39.318+0000 7f1e271af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:39.489 INFO:tasks.workunit.client.0.smithi037.stderr: -173> 2024-09-12T17:34:39.318+0000 7f1e271af800 20 rados->read ofs=0 len=0 2024-09-12T17:34:39.489 INFO:tasks.workunit.client.0.smithi037.stderr: -172> 2024-09-12T17:34:39.319+0000 7f1e24ca0640 10 monclient: get_auth_request con 0x558a82bb6c20 auth_method 0 2024-09-12T17:34:39.489 INFO:tasks.workunit.client.0.smithi037.stderr: -171> 2024-09-12T17:34:39.319+0000 7f1e271af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:34:39.489 INFO:tasks.workunit.client.0.smithi037.stderr: -170> 2024-09-12T17:34:39.319+0000 7f1e271af800 20 rados->read ofs=0 len=0 2024-09-12T17:34:39.489 INFO:tasks.workunit.client.0.smithi037.stderr: -169> 2024-09-12T17:34:39.320+0000 7f1e271af800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:34:39.489 INFO:tasks.workunit.client.0.smithi037.stderr: -168> 2024-09-12T17:34:39.320+0000 7f1e271af800 20 searching for the correct realm 2024-09-12T17:34:39.489 INFO:tasks.workunit.client.0.smithi037.stderr: -167> 2024-09-12T17:34:39.320+0000 7f1e2449f640 10 monclient: get_auth_request con 0x558a82bbbe90 auth_method 0 2024-09-12T17:34:39.489 INFO:tasks.workunit.client.0.smithi037.stderr: -166> 2024-09-12T17:34:39.321+0000 7f1e254a1640 10 monclient: get_auth_request con 0x7f1e18074070 auth_method 0 2024-09-12T17:34:39.489 INFO:tasks.workunit.client.0.smithi037.stderr: -165> 2024-09-12T17:34:39.322+0000 7f1e24ca0640 10 monclient: get_auth_request con 0x7f1e1c06d300 auth_method 0 2024-09-12T17:34:39.490 INFO:tasks.workunit.client.0.smithi037.stderr: -164> 2024-09-12T17:34:39.322+0000 7f1e24ca0640 0 -- 172.21.15.37:0/3805717393 >> [v2:172.21.15.37:6800/1206746176,v1:172.21.15.37:6801/1206746176] conn(0x7f1e1c06d300 msgr2=0x7f1e1c063280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:34:39.490 INFO:tasks.workunit.client.0.smithi037.stderr: -163> 2024-09-12T17:34:39.322+0000 7f1cfa7fc640 1 client.6920.objecter ms_handle_reset 0x7f1e1c06d300 session 0x7f1e1c0645b0 osd.2 2024-09-12T17:34:39.490 INFO:tasks.workunit.client.0.smithi037.stderr: -162> 2024-09-12T17:34:39.322+0000 7f1cfa7fc640 10 monclient: _renew_subs 2024-09-12T17:34:39.490 INFO:tasks.workunit.client.0.smithi037.stderr: -161> 2024-09-12T17:34:39.322+0000 7f1cfa7fc640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.37:3301/0 2024-09-12T17:34:39.490 INFO:tasks.workunit.client.0.smithi037.stderr: -160> 2024-09-12T17:34:39.322+0000 7f1e24ca0640 10 monclient: get_auth_request con 0x7f1cf0086a90 auth_method 0 2024-09-12T17:34:39.490 INFO:tasks.workunit.client.0.smithi037.stderr: -159> 2024-09-12T17:34:39.322+0000 7f1e2449f640 10 monclient: get_auth_request con 0x7f1e14030070 auth_method 0 2024-09-12T17:34:39.490 INFO:tasks.workunit.client.0.smithi037.stderr: -158> 2024-09-12T17:34:39.324+0000 7f1e254a1640 10 monclient: get_auth_request con 0x7f1e180bdb90 auth_method 0 2024-09-12T17:34:39.490 INFO:tasks.workunit.client.0.smithi037.stderr: -157> 2024-09-12T17:34:39.326+0000 7f1e24ca0640 0 -- 172.21.15.37:0/3805717393 >> [v2:172.21.15.37:6800/1206746176,v1:172.21.15.37:6801/1206746176] conn(0x7f1cf0086a90 msgr2=0x7f1cf0088ec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:34:39.490 INFO:tasks.workunit.client.0.smithi037.stderr: -156> 2024-09-12T17:34:39.326+0000 7f1cfa7fc640 1 client.6920.objecter ms_handle_reset 0x7f1cf0086a90 session 0x7f1e1c0645b0 osd.2 2024-09-12T17:34:39.490 INFO:tasks.workunit.client.0.smithi037.stderr: -155> 2024-09-12T17:34:39.326+0000 7f1e24ca0640 10 monclient: get_auth_request con 0x7f1e1c06d300 auth_method 0 2024-09-12T17:34:39.490 INFO:tasks.workunit.client.0.smithi037.stderr: -154> 2024-09-12T17:34:39.327+0000 7f1e24ca0640 10 monclient: get_auth_request con 0x7f1e18075c30 auth_method 0 2024-09-12T17:34:39.490 INFO:tasks.workunit.client.0.smithi037.stderr: -153> 2024-09-12T17:34:39.332+0000 7f1e271af800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:34:39.490 INFO:tasks.workunit.client.0.smithi037.stderr: -152> 2024-09-12T17:34:39.332+0000 7f1e271af800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:34:39.490 INFO:tasks.workunit.client.0.smithi037.stderr: -151> 2024-09-12T17:34:39.332+0000 7f1e271af800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:34:39.491 INFO:tasks.workunit.client.0.smithi037.stderr: -150> 2024-09-12T17:34:39.332+0000 7f1e271af800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:34:39.491 INFO:tasks.workunit.client.0.smithi037.stderr: -149> 2024-09-12T17:34:39.332+0000 7f1e271af800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:34:39.491 INFO:tasks.workunit.client.0.smithi037.stderr: -148> 2024-09-12T17:34:39.332+0000 7f1e271af800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:34:39.491 INFO:tasks.workunit.client.0.smithi037.stderr: -147> 2024-09-12T17:34:39.332+0000 7f1e271af800 20 rados->read ofs=0 len=0 2024-09-12T17:34:39.491 INFO:tasks.workunit.client.0.smithi037.stderr: -146> 2024-09-12T17:34:39.332+0000 7f1e271af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:39.491 INFO:tasks.workunit.client.0.smithi037.stderr: -145> 2024-09-12T17:34:39.332+0000 7f1e271af800 20 rados->read ofs=0 len=0 2024-09-12T17:34:39.491 INFO:tasks.workunit.client.0.smithi037.stderr: -144> 2024-09-12T17:34:39.332+0000 7f1e271af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:34:39.491 INFO:tasks.workunit.client.0.smithi037.stderr: -143> 2024-09-12T17:34:39.332+0000 7f1e271af800 20 rados->read ofs=0 len=0 2024-09-12T17:34:39.491 INFO:tasks.workunit.client.0.smithi037.stderr: -142> 2024-09-12T17:34:39.333+0000 7f1e271af800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:34:39.491 INFO:tasks.workunit.client.0.smithi037.stderr: -141> 2024-09-12T17:34:39.333+0000 7f1e271af800 20 zone default found 2024-09-12T17:34:39.491 INFO:tasks.workunit.client.0.smithi037.stderr: -140> 2024-09-12T17:34:39.333+0000 7f1e271af800 4 Realm: () 2024-09-12T17:34:39.491 INFO:tasks.workunit.client.0.smithi037.stderr: -139> 2024-09-12T17:34:39.333+0000 7f1e271af800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:34:39.491 INFO:tasks.workunit.client.0.smithi037.stderr: -138> 2024-09-12T17:34:39.333+0000 7f1e271af800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:34:39.491 INFO:tasks.workunit.client.0.smithi037.stderr: -137> 2024-09-12T17:34:39.333+0000 7f1e271af800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:34:39.492 INFO:tasks.workunit.client.0.smithi037.stderr: -136> 2024-09-12T17:34:39.333+0000 7f1e271af800 20 zonegroup default 2024-09-12T17:34:39.492 INFO:tasks.workunit.client.0.smithi037.stderr: -135> 2024-09-12T17:34:39.333+0000 7f1e271af800 20 rados->read ofs=0 len=0 2024-09-12T17:34:39.492 INFO:tasks.workunit.client.0.smithi037.stderr: -134> 2024-09-12T17:34:39.333+0000 7f1e271af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:39.492 INFO:tasks.workunit.client.0.smithi037.stderr: -133> 2024-09-12T17:34:39.333+0000 7f1e271af800 20 rados->read ofs=0 len=0 2024-09-12T17:34:39.492 INFO:tasks.workunit.client.0.smithi037.stderr: -132> 2024-09-12T17:34:39.333+0000 7f1e271af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:39.492 INFO:tasks.workunit.client.0.smithi037.stderr: -131> 2024-09-12T17:34:39.333+0000 7f1e271af800 20 rados->read ofs=0 len=0 2024-09-12T17:34:39.492 INFO:tasks.workunit.client.0.smithi037.stderr: -130> 2024-09-12T17:34:39.334+0000 7f1e271af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:39.492 INFO:tasks.workunit.client.0.smithi037.stderr: -129> 2024-09-12T17:34:39.334+0000 7f1e271af800 20 started sync module instance, tier type = 2024-09-12T17:34:39.492 INFO:tasks.workunit.client.0.smithi037.stderr: -128> 2024-09-12T17:34:39.334+0000 7f1e271af800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:34:39.492 INFO:tasks.workunit.client.0.smithi037.stderr: -127> 2024-09-12T17:34:39.344+0000 7f1e271af800 20 add_watcher() i=0 2024-09-12T17:34:39.492 INFO:tasks.workunit.client.0.smithi037.stderr: -126> 2024-09-12T17:34:39.344+0000 7f1e271af800 20 add_watcher() i=1 2024-09-12T17:34:39.492 INFO:tasks.workunit.client.0.smithi037.stderr: -125> 2024-09-12T17:34:39.344+0000 7f1e271af800 20 add_watcher() i=2 2024-09-12T17:34:39.492 INFO:tasks.workunit.client.0.smithi037.stderr: -124> 2024-09-12T17:34:39.344+0000 7f1e271af800 20 add_watcher() i=3 2024-09-12T17:34:39.492 INFO:tasks.workunit.client.0.smithi037.stderr: -123> 2024-09-12T17:34:39.344+0000 7f1e271af800 20 add_watcher() i=4 2024-09-12T17:34:39.493 INFO:tasks.workunit.client.0.smithi037.stderr: -122> 2024-09-12T17:34:39.344+0000 7f1e271af800 20 add_watcher() i=5 2024-09-12T17:34:39.493 INFO:tasks.workunit.client.0.smithi037.stderr: -121> 2024-09-12T17:34:39.344+0000 7f1e271af800 20 add_watcher() i=6 2024-09-12T17:34:39.493 INFO:tasks.workunit.client.0.smithi037.stderr: -120> 2024-09-12T17:34:39.345+0000 7f1e271af800 20 add_watcher() i=7 2024-09-12T17:34:39.493 INFO:tasks.workunit.client.0.smithi037.stderr: -119> 2024-09-12T17:34:39.345+0000 7f1e271af800 2 all 8 watchers are set, enabling cache 2024-09-12T17:34:39.493 INFO:tasks.workunit.client.0.smithi037.stderr: -118> 2024-09-12T17:34:39.346+0000 7f1e271af800 5 AuthRegistry(0x7ffe5e0271c0) adding auth protocol: cephx 2024-09-12T17:34:39.493 INFO:tasks.workunit.client.0.smithi037.stderr: -117> 2024-09-12T17:34:39.346+0000 7f1e271af800 5 AuthRegistry(0x7ffe5e0271c0) adding auth protocol: cephx 2024-09-12T17:34:39.493 INFO:tasks.workunit.client.0.smithi037.stderr: -116> 2024-09-12T17:34:39.346+0000 7f1e271af800 5 AuthRegistry(0x7ffe5e0271c0) adding auth protocol: cephx 2024-09-12T17:34:39.493 INFO:tasks.workunit.client.0.smithi037.stderr: -115> 2024-09-12T17:34:39.346+0000 7f1e271af800 5 AuthRegistry(0x7ffe5e0271c0) adding con mode: secure 2024-09-12T17:34:39.493 INFO:tasks.workunit.client.0.smithi037.stderr: -114> 2024-09-12T17:34:39.346+0000 7f1e271af800 5 AuthRegistry(0x7ffe5e0271c0) adding con mode: crc 2024-09-12T17:34:39.493 INFO:tasks.workunit.client.0.smithi037.stderr: -113> 2024-09-12T17:34:39.346+0000 7f1e271af800 5 AuthRegistry(0x7ffe5e0271c0) adding con mode: secure 2024-09-12T17:34:39.493 INFO:tasks.workunit.client.0.smithi037.stderr: -112> 2024-09-12T17:34:39.346+0000 7f1e271af800 5 AuthRegistry(0x7ffe5e0271c0) adding con mode: crc 2024-09-12T17:34:39.493 INFO:tasks.workunit.client.0.smithi037.stderr: -111> 2024-09-12T17:34:39.346+0000 7f1e271af800 5 AuthRegistry(0x7ffe5e0271c0) adding con mode: secure 2024-09-12T17:34:39.493 INFO:tasks.workunit.client.0.smithi037.stderr: -110> 2024-09-12T17:34:39.347+0000 7f1e271af800 5 AuthRegistry(0x7ffe5e0271c0) adding con mode: crc 2024-09-12T17:34:39.493 INFO:tasks.workunit.client.0.smithi037.stderr: -109> 2024-09-12T17:34:39.347+0000 7f1e271af800 5 AuthRegistry(0x7ffe5e0271c0) adding con mode: crc 2024-09-12T17:34:39.494 INFO:tasks.workunit.client.0.smithi037.stderr: -108> 2024-09-12T17:34:39.347+0000 7f1e271af800 5 AuthRegistry(0x7ffe5e0271c0) adding con mode: secure 2024-09-12T17:34:39.494 INFO:tasks.workunit.client.0.smithi037.stderr: -107> 2024-09-12T17:34:39.347+0000 7f1e271af800 5 AuthRegistry(0x7ffe5e0271c0) adding con mode: crc 2024-09-12T17:34:39.494 INFO:tasks.workunit.client.0.smithi037.stderr: -106> 2024-09-12T17:34:39.347+0000 7f1e271af800 5 AuthRegistry(0x7ffe5e0271c0) adding con mode: secure 2024-09-12T17:34:39.494 INFO:tasks.workunit.client.0.smithi037.stderr: -105> 2024-09-12T17:34:39.346+0000 7f1cdafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:34:39.494 INFO:tasks.workunit.client.0.smithi037.stderr: -104> 2024-09-12T17:34:39.347+0000 7f1e271af800 5 AuthRegistry(0x7ffe5e0271c0) adding con mode: crc 2024-09-12T17:34:39.494 INFO:tasks.workunit.client.0.smithi037.stderr: -103> 2024-09-12T17:34:39.347+0000 7f1e271af800 5 AuthRegistry(0x7ffe5e0271c0) adding con mode: secure 2024-09-12T17:34:39.494 INFO:tasks.workunit.client.0.smithi037.stderr: -102> 2024-09-12T17:34:39.347+0000 7f1e271af800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:34:39.494 INFO:tasks.workunit.client.0.smithi037.stderr: -101> 2024-09-12T17:34:39.347+0000 7f1e271af800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:34:39.494 INFO:tasks.workunit.client.0.smithi037.stderr: -100> 2024-09-12T17:34:39.347+0000 7f1e271af800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:34:39.494 INFO:tasks.workunit.client.0.smithi037.stderr: -99> 2024-09-12T17:34:39.347+0000 7f1e271af800 5 asok(0x558a828a4730) register_command cache list hook 0x558a82b8cb30 2024-09-12T17:34:39.494 INFO:tasks.workunit.client.0.smithi037.stderr: -98> 2024-09-12T17:34:39.347+0000 7f1e271af800 5 asok(0x558a828a4730) register_command cache inspect hook 0x558a82b8cb30 2024-09-12T17:34:39.494 INFO:tasks.workunit.client.0.smithi037.stderr: -97> 2024-09-12T17:34:39.347+0000 7f1e271af800 5 asok(0x558a828a4730) register_command cache erase hook 0x558a82b8cb30 2024-09-12T17:34:39.494 INFO:tasks.workunit.client.0.smithi037.stderr: -96> 2024-09-12T17:34:39.347+0000 7f1e271af800 5 asok(0x558a828a4730) register_command cache zap hook 0x558a82b8cb30 2024-09-12T17:34:39.495 INFO:tasks.workunit.client.0.smithi037.stderr: -95> 2024-09-12T17:34:39.347+0000 7f1e271af800 5 note: GC not initialized 2024-09-12T17:34:39.495 INFO:tasks.workunit.client.0.smithi037.stderr: -94> 2024-09-12T17:34:39.347+0000 7f1cd9fe3640 20 reqs_thread_entry: start 2024-09-12T17:34:39.495 INFO:tasks.workunit.client.0.smithi037.stderr: -93> 2024-09-12T17:34:39.347+0000 7f1e271af800 5 asok(0x558a828a4730) register_command sync trace show hook 0x7f1e1801c400 2024-09-12T17:34:39.495 INFO:tasks.workunit.client.0.smithi037.stderr: -92> 2024-09-12T17:34:39.347+0000 7f1e271af800 5 asok(0x558a828a4730) register_command sync trace history hook 0x7f1e1801c400 2024-09-12T17:34:39.495 INFO:tasks.workunit.client.0.smithi037.stderr: -91> 2024-09-12T17:34:39.347+0000 7f1e271af800 5 asok(0x558a828a4730) register_command sync trace active hook 0x7f1e1801c400 2024-09-12T17:34:39.495 INFO:tasks.workunit.client.0.smithi037.stderr: -90> 2024-09-12T17:34:39.347+0000 7f1e271af800 5 asok(0x558a828a4730) register_command sync trace active_short hook 0x7f1e1801c400 2024-09-12T17:34:39.495 INFO:tasks.workunit.client.0.smithi037.stderr: -89> 2024-09-12T17:34:39.347+0000 7f1e271af800 20 init_complete bucket index max shards: 11 2024-09-12T17:34:39.495 INFO:tasks.workunit.client.0.smithi037.stderr: -88> 2024-09-12T17:34:39.347+0000 7f1e271af800 20 Filter name: none 2024-09-12T17:34:39.495 INFO:tasks.workunit.client.0.smithi037.stderr: -87> 2024-09-12T17:34:39.347+0000 7f1c4b7fe640 20 reqs_thread_entry: start 2024-09-12T17:34:39.495 INFO:tasks.workunit.client.0.smithi037.stderr: -86> 2024-09-12T17:34:39.347+0000 7f1e271af800 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-12T17:34:39.495 INFO:tasks.workunit.client.0.smithi037.stderr: -85> 2024-09-12T17:34:39.347+0000 7f1e271af800 20 rados->read ofs=0 len=0 2024-09-12T17:34:39.495 INFO:tasks.workunit.client.0.smithi037.stderr: -84> 2024-09-12T17:34:39.348+0000 7f1e271af800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:34:39.495 INFO:tasks.workunit.client.0.smithi037.stderr: -83> 2024-09-12T17:34:39.348+0000 7f1e271af800 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-12T17:34:39.495 INFO:tasks.workunit.client.0.smithi037.stderr: -82> 2024-09-12T17:34:39.348+0000 7f1e271af800 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-12T17:34:39.496 INFO:tasks.workunit.client.0.smithi037.stderr: -81> 2024-09-12T17:34:39.348+0000 7f1e271af800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33 : miss 2024-09-12T17:34:39.496 INFO:tasks.workunit.client.0.smithi037.stderr: -80> 2024-09-12T17:34:39.348+0000 7f1e271af800 20 rados->read ofs=0 len=0 2024-09-12T17:34:39.496 INFO:tasks.workunit.client.0.smithi037.stderr: -79> 2024-09-12T17:34:39.348+0000 7f1e271af800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:34:39.496 INFO:tasks.workunit.client.0.smithi037.stderr: -78> 2024-09-12T17:34:39.348+0000 7f1e271af800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33 info.flags=0x17 2024-09-12T17:34:39.496 INFO:tasks.workunit.client.0.smithi037.stderr: -77> 2024-09-12T17:34:39.348+0000 7f1e271af800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33 to cache LRU end 2024-09-12T17:34:39.496 INFO:tasks.workunit.client.0.smithi037.stderr: -76> 2024-09-12T17:34:39.348+0000 7f1e271af800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:34:39.496 INFO:tasks.workunit.client.0.smithi037.stderr: -75> 2024-09-12T17:34:39.348+0000 7f1e271af800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:34:39.496 INFO:tasks.workunit.client.0.smithi037.stderr: -74> 2024-09-12T17:34:39.348+0000 7f1e271af800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33 2024-09-12T17:34:39.496 INFO:tasks.workunit.client.0.smithi037.stderr: -73> 2024-09-12T17:34:39.354+0000 7f1e271af800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33 info.flags=0x17 2024-09-12T17:34:39.496 INFO:tasks.workunit.client.0.smithi037.stderr: -72> 2024-09-12T17:34:39.354+0000 7f1e271af800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33 to cache LRU end 2024-09-12T17:34:39.496 INFO:tasks.workunit.client.0.smithi037.stderr: -71> 2024-09-12T17:34:39.354+0000 7f1e271af800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:34:39.496 INFO:tasks.workunit.client.0.smithi037.stderr: -70> 2024-09-12T17:34:39.354+0000 7f1e271af800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33, ofs0, ns] 2024-09-12T17:34:39.496 INFO:tasks.workunit.client.0.smithi037.stderr: -69> 2024-09-12T17:34:39.354+0000 7f1cfb7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496991 cookie 94053387230944 notifier 6920 bl.length()=1015 2024-09-12T17:34:39.497 INFO:tasks.workunit.client.0.smithi037.stderr: -68> 2024-09-12T17:34:39.354+0000 7f1cfb7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33 info.flags=0x17 2024-09-12T17:34:39.497 INFO:tasks.workunit.client.0.smithi037.stderr: -67> 2024-09-12T17:34:39.354+0000 7f1cfb7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33 to cache LRU end 2024-09-12T17:34:39.497 INFO:tasks.workunit.client.0.smithi037.stderr: -66> 2024-09-12T17:34:39.354+0000 7f1cfb7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:34:39.497 INFO:tasks.workunit.client.0.smithi037.stderr: -65> 2024-09-12T17:34:39.356+0000 7f1e271af800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33]): orig_sources= new_sources= 2024-09-12T17:34:39.497 INFO:tasks.workunit.client.0.smithi037.stderr: -64> 2024-09-12T17:34:39.356+0000 7f1e271af800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33]): potential sources added=[] removed=[] 2024-09-12T17:34:39.497 INFO:tasks.workunit.client.0.smithi037.stderr: -63> 2024-09-12T17:34:39.356+0000 7f1e271af800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33]): orig_dests= new_dests= 2024-09-12T17:34:39.497 INFO:tasks.workunit.client.0.smithi037.stderr: -62> 2024-09-12T17:34:39.356+0000 7f1e271af800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33]): potential dests added=[] removed=[] 2024-09-12T17:34:39.497 INFO:tasks.workunit.client.0.smithi037.stderr: -61> 2024-09-12T17:34:39.361+0000 7f1e271af800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.1.0 2024-09-12T17:34:39.497 INFO:tasks.workunit.client.0.smithi037.stderr: -60> 2024-09-12T17:34:39.361+0000 7f1e271af800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.1.0 2024-09-12T17:34:39.497 INFO:tasks.workunit.client.0.smithi037.stderr: -59> 2024-09-12T17:34:39.361+0000 7f1e271af800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.1.1 2024-09-12T17:34:39.497 INFO:tasks.workunit.client.0.smithi037.stderr: -58> 2024-09-12T17:34:39.361+0000 7f1e271af800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.1.1 2024-09-12T17:34:39.497 INFO:tasks.workunit.client.0.smithi037.stderr: -57> 2024-09-12T17:34:39.361+0000 7f1e271af800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.1.2 2024-09-12T17:34:39.497 INFO:tasks.workunit.client.0.smithi037.stderr: -56> 2024-09-12T17:34:39.361+0000 7f1e271af800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.1.2 2024-09-12T17:34:39.497 INFO:tasks.workunit.client.0.smithi037.stderr: -55> 2024-09-12T17:34:39.361+0000 7f1e271af800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.1.3 2024-09-12T17:34:39.498 INFO:tasks.workunit.client.0.smithi037.stderr: -54> 2024-09-12T17:34:39.361+0000 7f1e271af800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.1.3 2024-09-12T17:34:39.498 INFO:tasks.workunit.client.0.smithi037.stderr: -53> 2024-09-12T17:34:39.361+0000 7f1e271af800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.1.4 2024-09-12T17:34:39.498 INFO:tasks.workunit.client.0.smithi037.stderr: -52> 2024-09-12T17:34:39.361+0000 7f1e271af800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.1.4 2024-09-12T17:34:39.498 INFO:tasks.workunit.client.0.smithi037.stderr: -51> 2024-09-12T17:34:39.361+0000 7f1e271af800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.1.5 2024-09-12T17:34:39.498 INFO:tasks.workunit.client.0.smithi037.stderr: -50> 2024-09-12T17:34:39.361+0000 7f1e271af800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.1.5 2024-09-12T17:34:39.498 INFO:tasks.workunit.client.0.smithi037.stderr: -49> 2024-09-12T17:34:39.361+0000 7f1e271af800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.1.6 2024-09-12T17:34:39.498 INFO:tasks.workunit.client.0.smithi037.stderr: -48> 2024-09-12T17:34:39.361+0000 7f1e271af800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.1.6 2024-09-12T17:34:39.498 INFO:tasks.workunit.client.0.smithi037.stderr: -47> 2024-09-12T17:34:39.361+0000 7f1e271af800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.1.7 2024-09-12T17:34:39.498 INFO:tasks.workunit.client.0.smithi037.stderr: -46> 2024-09-12T17:34:39.361+0000 7f1e271af800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.1.7 2024-09-12T17:34:39.498 INFO:tasks.workunit.client.0.smithi037.stderr: -45> 2024-09-12T17:34:39.361+0000 7f1e271af800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.1.8 2024-09-12T17:34:39.498 INFO:tasks.workunit.client.0.smithi037.stderr: -44> 2024-09-12T17:34:39.361+0000 7f1e271af800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.1.8 2024-09-12T17:34:39.498 INFO:tasks.workunit.client.0.smithi037.stderr: -43> 2024-09-12T17:34:39.361+0000 7f1e271af800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.1.9 2024-09-12T17:34:39.498 INFO:tasks.workunit.client.0.smithi037.stderr: -42> 2024-09-12T17:34:39.361+0000 7f1e271af800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.1.9 2024-09-12T17:34:39.498 INFO:tasks.workunit.client.0.smithi037.stderr: -41> 2024-09-12T17:34:39.361+0000 7f1e271af800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.1.10 2024-09-12T17:34:39.499 INFO:tasks.workunit.client.0.smithi037.stderr: -40> 2024-09-12T17:34:39.361+0000 7f1e271af800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.1.10 2024-09-12T17:34:39.499 INFO:tasks.workunit.client.0.smithi037.stderr: -39> 2024-09-12T17:34:39.361+0000 7f1e271af800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.1.11 2024-09-12T17:34:39.499 INFO:tasks.workunit.client.0.smithi037.stderr: -38> 2024-09-12T17:34:39.361+0000 7f1e271af800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.1.11 2024-09-12T17:34:39.499 INFO:tasks.workunit.client.0.smithi037.stderr: -37> 2024-09-12T17:34:39.361+0000 7f1e271af800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.0 2024-09-12T17:34:39.499 INFO:tasks.workunit.client.0.smithi037.stderr: -36> 2024-09-12T17:34:39.361+0000 7f1e271af800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.1 2024-09-12T17:34:39.499 INFO:tasks.workunit.client.0.smithi037.stderr: -35> 2024-09-12T17:34:39.362+0000 7f1e271af800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.2 2024-09-12T17:34:39.499 INFO:tasks.workunit.client.0.smithi037.stderr: -34> 2024-09-12T17:34:39.362+0000 7f1e271af800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.3 2024-09-12T17:34:39.499 INFO:tasks.workunit.client.0.smithi037.stderr: -33> 2024-09-12T17:34:39.363+0000 7f1e271af800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.4 2024-09-12T17:34:39.499 INFO:tasks.workunit.client.0.smithi037.stderr: -32> 2024-09-12T17:34:39.364+0000 7f1e271af800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.5 2024-09-12T17:34:39.499 INFO:tasks.workunit.client.0.smithi037.stderr: -31> 2024-09-12T17:34:39.365+0000 7f1e271af800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.6 2024-09-12T17:34:39.499 INFO:tasks.workunit.client.0.smithi037.stderr: -30> 2024-09-12T17:34:39.365+0000 7f1e271af800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.7 2024-09-12T17:34:39.499 INFO:tasks.workunit.client.0.smithi037.stderr: -29> 2024-09-12T17:34:39.366+0000 7f1e271af800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.8 2024-09-12T17:34:39.499 INFO:tasks.workunit.client.0.smithi037.stderr: -28> 2024-09-12T17:34:39.367+0000 7f1e271af800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.9 2024-09-12T17:34:39.499 INFO:tasks.workunit.client.0.smithi037.stderr: -27> 2024-09-12T17:34:39.367+0000 7f1e271af800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.10 2024-09-12T17:34:39.500 INFO:tasks.workunit.client.0.smithi037.stderr: -26> 2024-09-12T17:34:39.371+0000 7f1e271af800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33 : hit (requested=0x17, cached=0x17) 2024-09-12T17:34:39.500 INFO:tasks.workunit.client.0.smithi037.stderr: -25> 2024-09-12T17:34:39.371+0000 7f1e271af800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33 2024-09-12T17:34:39.500 INFO:tasks.workunit.client.0.smithi037.stderr: -24> 2024-09-12T17:34:39.372+0000 7f1e271af800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33 info.flags=0x17 2024-09-12T17:34:39.500 INFO:tasks.workunit.client.0.smithi037.stderr: -23> 2024-09-12T17:34:39.372+0000 7f1e271af800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33 to cache LRU end 2024-09-12T17:34:39.500 INFO:tasks.workunit.client.0.smithi037.stderr: -22> 2024-09-12T17:34:39.372+0000 7f1e271af800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:34:39.500 INFO:tasks.workunit.client.0.smithi037.stderr: -21> 2024-09-12T17:34:39.372+0000 7f1e271af800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33, ofs0, ns] 2024-09-12T17:34:39.500 INFO:tasks.workunit.client.0.smithi037.stderr: -20> 2024-09-12T17:34:39.372+0000 7f1cfbfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496992 cookie 94053387230944 notifier 6920 bl.length()=1015 2024-09-12T17:34:39.500 INFO:tasks.workunit.client.0.smithi037.stderr: -19> 2024-09-12T17:34:39.372+0000 7f1cfbfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33 info.flags=0x17 2024-09-12T17:34:39.500 INFO:tasks.workunit.client.0.smithi037.stderr: -18> 2024-09-12T17:34:39.372+0000 7f1cfbfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33 to cache LRU end 2024-09-12T17:34:39.500 INFO:tasks.workunit.client.0.smithi037.stderr: -17> 2024-09-12T17:34:39.372+0000 7f1cfbfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:34:39.500 INFO:tasks.workunit.client.0.smithi037.stderr: -16> 2024-09-12T17:34:39.374+0000 7f1e271af800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33]): orig_sources= new_sources= 2024-09-12T17:34:39.500 INFO:tasks.workunit.client.0.smithi037.stderr: -15> 2024-09-12T17:34:39.374+0000 7f1e271af800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33]): potential sources added=[] removed=[] 2024-09-12T17:34:39.500 INFO:tasks.workunit.client.0.smithi037.stderr: -14> 2024-09-12T17:34:39.374+0000 7f1e271af800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33]): orig_dests= new_dests= 2024-09-12T17:34:39.501 INFO:tasks.workunit.client.0.smithi037.stderr: -13> 2024-09-12T17:34:39.374+0000 7f1e271af800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33]): potential dests added=[] removed=[] 2024-09-12T17:34:39.501 INFO:tasks.workunit.client.0.smithi037.stderr: -12> 2024-09-12T17:34:39.377+0000 7f1e271af800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.0 2024-09-12T17:34:39.501 INFO:tasks.workunit.client.0.smithi037.stderr: -11> 2024-09-12T17:34:39.377+0000 7f1e271af800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.1 2024-09-12T17:34:39.501 INFO:tasks.workunit.client.0.smithi037.stderr: -10> 2024-09-12T17:34:39.377+0000 7f1e271af800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.2 2024-09-12T17:34:39.501 INFO:tasks.workunit.client.0.smithi037.stderr: -9> 2024-09-12T17:34:39.377+0000 7f1e271af800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.3 2024-09-12T17:34:39.501 INFO:tasks.workunit.client.0.smithi037.stderr: -8> 2024-09-12T17:34:39.378+0000 7f1e271af800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.4 2024-09-12T17:34:39.501 INFO:tasks.workunit.client.0.smithi037.stderr: -7> 2024-09-12T17:34:39.378+0000 7f1e271af800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.5 2024-09-12T17:34:39.501 INFO:tasks.workunit.client.0.smithi037.stderr: -6> 2024-09-12T17:34:39.378+0000 7f1e271af800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.6 2024-09-12T17:34:39.501 INFO:tasks.workunit.client.0.smithi037.stderr: -5> 2024-09-12T17:34:39.379+0000 7f1e271af800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.7 2024-09-12T17:34:39.501 INFO:tasks.workunit.client.0.smithi037.stderr: -4> 2024-09-12T17:34:39.379+0000 7f1e271af800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.8 2024-09-12T17:34:39.501 INFO:tasks.workunit.client.0.smithi037.stderr: -3> 2024-09-12T17:34:39.379+0000 7f1e271af800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.9 2024-09-12T17:34:39.501 INFO:tasks.workunit.client.0.smithi037.stderr: -2> 2024-09-12T17:34:39.380+0000 7f1e271af800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.10 2024-09-12T17:34:39.501 INFO:tasks.workunit.client.0.smithi037.stderr: -1> 2024-09-12T17:34:39.381+0000 7f1e271af800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f1e271af800 time 2024-09-12T17:34:39.382198+0000 2024-09-12T17:34:39.502 INFO:tasks.workunit.client.0.smithi037.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:34:39.502 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:34:39.502 INFO:tasks.workunit.client.0.smithi037.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:34:39.502 INFO:tasks.workunit.client.0.smithi037.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f1e2a78c71a] 2024-09-12T17:34:39.502 INFO:tasks.workunit.client.0.smithi037.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f1e2a78c8d8] 2024-09-12T17:34:39.502 INFO:tasks.workunit.client.0.smithi037.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x558a81d58841] 2024-09-12T17:34:39.502 INFO:tasks.workunit.client.0.smithi037.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x558a81d68827] 2024-09-12T17:34:39.502 INFO:tasks.workunit.client.0.smithi037.stderr: 5: main() 2024-09-12T17:34:39.502 INFO:tasks.workunit.client.0.smithi037.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f1e29429590] 2024-09-12T17:34:39.502 INFO:tasks.workunit.client.0.smithi037.stderr: 7: __libc_start_main() 2024-09-12T17:34:39.502 INFO:tasks.workunit.client.0.smithi037.stderr: 8: _start() 2024-09-12T17:34:39.502 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:34:39.502 INFO:tasks.workunit.client.0.smithi037.stderr: 0> 2024-09-12T17:34:39.381+0000 7f1e271af800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:34:39.503 INFO:tasks.workunit.client.0.smithi037.stderr: in thread 7f1e271af800 thread_name:radosgw-admin 2024-09-12T17:34:39.503 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:34:39.503 INFO:tasks.workunit.client.0.smithi037.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:34:39.503 INFO:tasks.workunit.client.0.smithi037.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f1e2943e6f0] 2024-09-12T17:34:39.503 INFO:tasks.workunit.client.0.smithi037.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f1e2948b99c] 2024-09-12T17:34:39.503 INFO:tasks.workunit.client.0.smithi037.stderr: 3: raise() 2024-09-12T17:34:39.503 INFO:tasks.workunit.client.0.smithi037.stderr: 4: abort() 2024-09-12T17:34:39.503 INFO:tasks.workunit.client.0.smithi037.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f1e2a78c774] 2024-09-12T17:34:39.503 INFO:tasks.workunit.client.0.smithi037.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f1e2a78c8d8] 2024-09-12T17:34:39.503 INFO:tasks.workunit.client.0.smithi037.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x558a81d58841] 2024-09-12T17:34:39.503 INFO:tasks.workunit.client.0.smithi037.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x558a81d68827] 2024-09-12T17:34:39.503 INFO:tasks.workunit.client.0.smithi037.stderr: 9: main() 2024-09-12T17:34:39.503 INFO:tasks.workunit.client.0.smithi037.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f1e29429590] 2024-09-12T17:34:39.503 INFO:tasks.workunit.client.0.smithi037.stderr: 11: __libc_start_main() 2024-09-12T17:34:39.503 INFO:tasks.workunit.client.0.smithi037.stderr: 12: _start() 2024-09-12T17:34:39.504 INFO:tasks.workunit.client.0.smithi037.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:34:39.504 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:34:39.504 INFO:tasks.workunit.client.0.smithi037.stderr:--- logging levels --- 2024-09-12T17:34:39.504 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 none 2024-09-12T17:34:39.504 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 lockdep 2024-09-12T17:34:39.504 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 context 2024-09-12T17:34:39.504 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 1 crush 2024-09-12T17:34:39.504 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mds 2024-09-12T17:34:39.504 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mds_balancer 2024-09-12T17:34:39.504 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mds_locker 2024-09-12T17:34:39.504 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mds_log 2024-09-12T17:34:39.504 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mds_log_expire 2024-09-12T17:34:39.504 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mds_migrator 2024-09-12T17:34:39.504 INFO:tasks.workunit.client.0.smithi037.stderr: 3/ 5 mds_quiesce 2024-09-12T17:34:39.505 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 buffer 2024-09-12T17:34:39.505 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 timer 2024-09-12T17:34:39.505 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 filer 2024-09-12T17:34:39.505 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 striper 2024-09-12T17:34:39.505 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 objecter 2024-09-12T17:34:39.505 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 rados 2024-09-12T17:34:39.505 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 rbd 2024-09-12T17:34:39.505 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 rbd_mirror 2024-09-12T17:34:39.505 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 rbd_replay 2024-09-12T17:34:39.505 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 rbd_pwl 2024-09-12T17:34:39.505 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 journaler 2024-09-12T17:34:39.505 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 objectcacher 2024-09-12T17:34:39.505 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:34:39.505 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 client 2024-09-12T17:34:39.506 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 osd 2024-09-12T17:34:39.506 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 optracker 2024-09-12T17:34:39.506 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 objclass 2024-09-12T17:34:39.506 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 3 filestore 2024-09-12T17:34:39.506 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 3 journal 2024-09-12T17:34:39.506 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 0 ms 2024-09-12T17:34:39.506 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mon 2024-09-12T17:34:39.506 INFO:tasks.workunit.client.0.smithi037.stderr: 0/10 monc 2024-09-12T17:34:39.506 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 paxos 2024-09-12T17:34:39.506 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 tp 2024-09-12T17:34:39.506 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 auth 2024-09-12T17:34:39.506 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 crypto 2024-09-12T17:34:39.506 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 1 finisher 2024-09-12T17:34:39.506 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 1 reserver 2024-09-12T17:34:39.507 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 heartbeatmap 2024-09-12T17:34:39.507 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 perfcounter 2024-09-12T17:34:39.507 INFO:tasks.workunit.client.0.smithi037.stderr: 20/20 rgw 2024-09-12T17:34:39.507 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 rgw_sync 2024-09-12T17:34:39.507 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 rgw_datacache 2024-09-12T17:34:39.507 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 rgw_access 2024-09-12T17:34:39.507 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:34:39.507 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 rgw_flight 2024-09-12T17:34:39.507 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:34:39.507 INFO:tasks.workunit.client.0.smithi037.stderr: 20/20 rgw_notification 2024-09-12T17:34:39.507 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 javaclient 2024-09-12T17:34:39.507 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 asok 2024-09-12T17:34:39.507 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 1 throttle 2024-09-12T17:34:39.507 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 0 refs 2024-09-12T17:34:39.507 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 compressor 2024-09-12T17:34:39.508 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 bluestore 2024-09-12T17:34:39.508 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 bluefs 2024-09-12T17:34:39.508 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 3 bdev 2024-09-12T17:34:39.508 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 kstore 2024-09-12T17:34:39.508 INFO:tasks.workunit.client.0.smithi037.stderr: 4/ 5 rocksdb 2024-09-12T17:34:39.508 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 fuse 2024-09-12T17:34:39.508 INFO:tasks.workunit.client.0.smithi037.stderr: 2/ 5 mgr 2024-09-12T17:34:39.508 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mgrc 2024-09-12T17:34:39.508 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 dpdk 2024-09-12T17:34:39.508 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 eventtrace 2024-09-12T17:34:39.508 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 prioritycache 2024-09-12T17:34:39.508 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 test 2024-09-12T17:34:39.508 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:34:39.508 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 cephsqlite 2024-09-12T17:34:39.509 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:34:39.509 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore 2024-09-12T17:34:39.509 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_onode 2024-09-12T17:34:39.509 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_odata 2024-09-12T17:34:39.509 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_omap 2024-09-12T17:34:39.509 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_tm 2024-09-12T17:34:39.509 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_t 2024-09-12T17:34:39.509 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:34:39.509 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_epm 2024-09-12T17:34:39.509 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_lba 2024-09-12T17:34:39.509 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:34:39.509 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_cache 2024-09-12T17:34:39.509 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_journal 2024-09-12T17:34:39.509 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_device 2024-09-12T17:34:39.510 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_backref 2024-09-12T17:34:39.510 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 alienstore 2024-09-12T17:34:39.510 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mclock 2024-09-12T17:34:39.510 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 cyanstore 2024-09-12T17:34:39.510 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 ceph_exporter 2024-09-12T17:34:39.510 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 memstore 2024-09-12T17:34:39.510 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 trace 2024-09-12T17:34:39.510 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 ceph_dedup 2024-09-12T17:34:39.510 INFO:tasks.workunit.client.0.smithi037.stderr: -2/-2 (syslog threshold) 2024-09-12T17:34:39.510 INFO:tasks.workunit.client.0.smithi037.stderr: 99/99 (stderr threshold) 2024-09-12T17:34:39.510 INFO:tasks.workunit.client.0.smithi037.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:34:39.510 INFO:tasks.workunit.client.0.smithi037.stderr: 7f1c4b7fe640 / http_manager 2024-09-12T17:34:39.510 INFO:tasks.workunit.client.0.smithi037.stderr: 7f1cd9fe3640 / http_manager 2024-09-12T17:34:39.510 INFO:tasks.workunit.client.0.smithi037.stderr: 7f1cdafe5640 / rgw_dt_lg_renew 2024-09-12T17:34:39.511 INFO:tasks.workunit.client.0.smithi037.stderr: 7f1cfa7fc640 / ms_dispatch 2024-09-12T17:34:39.511 INFO:tasks.workunit.client.0.smithi037.stderr: 7f1cfb7fe640 / io_context_pool 2024-09-12T17:34:39.511 INFO:tasks.workunit.client.0.smithi037.stderr: 7f1cfbfff640 / io_context_pool 2024-09-12T17:34:39.511 INFO:tasks.workunit.client.0.smithi037.stderr: 7f1d0a7fc640 / ms_dispatch 2024-09-12T17:34:39.511 INFO:tasks.workunit.client.0.smithi037.stderr: 7f1d1160a640 / ms_dispatch 2024-09-12T17:34:39.511 INFO:tasks.workunit.client.0.smithi037.stderr: 7f1d12e0d640 / io_context_pool 2024-09-12T17:34:39.511 INFO:tasks.workunit.client.0.smithi037.stderr: 7f1e2449f640 / msgr-worker-2 2024-09-12T17:34:39.511 INFO:tasks.workunit.client.0.smithi037.stderr: 7f1e24ca0640 / msgr-worker-1 2024-09-12T17:34:39.511 INFO:tasks.workunit.client.0.smithi037.stderr: 7f1e254a1640 / msgr-worker-0 2024-09-12T17:34:39.511 INFO:tasks.workunit.client.0.smithi037.stderr: 7f1e25ca2640 / io_context_pool 2024-09-12T17:34:39.511 INFO:tasks.workunit.client.0.smithi037.stderr: 7f1e271af800 / radosgw-admin 2024-09-12T17:34:39.511 INFO:tasks.workunit.client.0.smithi037.stderr: max_recent 500 2024-09-12T17:34:39.511 INFO:tasks.workunit.client.0.smithi037.stderr: max_new 1000 2024-09-12T17:34:39.511 INFO:tasks.workunit.client.0.smithi037.stderr: log_file /var/lib/ceph/crash/2024-09-12T17:34:39.383580Z_819ac3e1-0589-44c3-8680-a23b920c3fc0/log 2024-09-12T17:34:39.512 INFO:tasks.workunit.client.0.smithi037.stderr:--- end dump of recent events --- 2024-09-12T17:34:39.512 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-09-12T17:34:39.513 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:34:39.514 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:34:39.514 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.460+0000 7fda5eb0c800 20 rados->read ofs=0 len=0 2024-09-12T17:34:39.514 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.462+0000 7fda5eb0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:39.514 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.462+0000 7fda5eb0c800 20 realm 2024-09-12T17:34:39.514 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.462+0000 7fda5eb0c800 20 rados->read ofs=0 len=0 2024-09-12T17:34:39.514 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.462+0000 7fda5eb0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:39.514 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.462+0000 7fda5eb0c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:34:39.514 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.462+0000 7fda5eb0c800 20 rados->read ofs=0 len=0 2024-09-12T17:34:39.514 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.463+0000 7fda5eb0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:39.514 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.463+0000 7fda5eb0c800 20 rados->read ofs=0 len=0 2024-09-12T17:34:39.514 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.463+0000 7fda5eb0c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:34:39.514 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.463+0000 7fda5eb0c800 20 rados->read ofs=0 len=0 2024-09-12T17:34:39.514 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.464+0000 7fda5eb0c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:34:39.514 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.464+0000 7fda5eb0c800 20 searching for the correct realm 2024-09-12T17:34:39.515 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.467+0000 7fda5cdf7640 0 -- 172.21.15.37:0/851800503 >> [v2:172.21.15.40:6818/1210108009,v1:172.21.15.40:6819/1210108009] conn(0x7fda44040040 msgr2=0x7fda44026410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:34:39.515 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.471+0000 7fda5c5f6640 0 -- 172.21.15.37:0/851800503 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7fda44054040 msgr2=0x7fda44033410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:34:39.679 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.677+0000 7fda5eb0c800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:34:39.679 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.677+0000 7fda5eb0c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:34:39.679 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.677+0000 7fda5eb0c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:34:39.679 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.677+0000 7fda5eb0c800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:34:39.679 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.677+0000 7fda5eb0c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:34:39.679 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.677+0000 7fda5eb0c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:34:39.679 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.677+0000 7fda5eb0c800 20 rados->read ofs=0 len=0 2024-09-12T17:34:39.679 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.677+0000 7fda5eb0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:39.680 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.677+0000 7fda5eb0c800 20 rados->read ofs=0 len=0 2024-09-12T17:34:39.681 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.677+0000 7fda5eb0c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:34:39.681 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.677+0000 7fda5eb0c800 20 rados->read ofs=0 len=0 2024-09-12T17:34:39.681 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.678+0000 7fda5eb0c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:34:39.681 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.678+0000 7fda5eb0c800 20 zone default found 2024-09-12T17:34:39.681 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.678+0000 7fda5eb0c800 4 Realm: () 2024-09-12T17:34:39.681 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.678+0000 7fda5eb0c800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:34:39.681 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.678+0000 7fda5eb0c800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:34:39.681 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.678+0000 7fda5eb0c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:34:39.681 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.678+0000 7fda5eb0c800 20 zonegroup default 2024-09-12T17:34:39.681 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.678+0000 7fda5eb0c800 20 rados->read ofs=0 len=0 2024-09-12T17:34:39.681 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.678+0000 7fda5eb0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:39.681 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.678+0000 7fda5eb0c800 20 rados->read ofs=0 len=0 2024-09-12T17:34:39.682 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.679+0000 7fda5eb0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:39.682 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.679+0000 7fda5eb0c800 20 rados->read ofs=0 len=0 2024-09-12T17:34:39.682 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.679+0000 7fda5eb0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:34:39.682 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.679+0000 7fda5eb0c800 20 started sync module instance, tier type = 2024-09-12T17:34:39.682 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.679+0000 7fda5eb0c800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:34:39.691 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.689+0000 7fda5eb0c800 20 add_watcher() i=0 2024-09-12T17:34:39.691 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.689+0000 7fda5eb0c800 20 add_watcher() i=1 2024-09-12T17:34:39.691 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.689+0000 7fda5eb0c800 20 add_watcher() i=2 2024-09-12T17:34:39.691 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.689+0000 7fda5eb0c800 20 add_watcher() i=3 2024-09-12T17:34:39.692 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.689+0000 7fda5eb0c800 20 add_watcher() i=4 2024-09-12T17:34:39.692 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.689+0000 7fda5eb0c800 20 add_watcher() i=5 2024-09-12T17:34:39.692 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.689+0000 7fda5eb0c800 20 add_watcher() i=6 2024-09-12T17:34:39.692 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.690+0000 7fda5eb0c800 20 add_watcher() i=7 2024-09-12T17:34:39.692 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.690+0000 7fda5eb0c800 2 all 8 watchers are set, enabling cache 2024-09-12T17:34:39.694 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.692+0000 7fd9137de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:34:39.695 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.693+0000 7fda5eb0c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:34:39.695 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.693+0000 7fda5eb0c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:34:39.695 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.693+0000 7fda5eb0c800 5 note: GC not initialized 2024-09-12T17:34:39.695 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.693+0000 7fd9127dc640 20 reqs_thread_entry: start 2024-09-12T17:34:39.695 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.693+0000 7fda5eb0c800 20 init_complete bucket index max shards: 11 2024-09-12T17:34:39.695 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.693+0000 7fda5eb0c800 20 Filter name: none 2024-09-12T17:34:39.695 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.693+0000 7fd90b7fe640 20 reqs_thread_entry: start 2024-09-12T17:34:39.695 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.693+0000 7fda5eb0c800 20 rados->read ofs=0 len=0 2024-09-12T17:34:39.696 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.694+0000 7fda5eb0c800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:34:39.696 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.694+0000 7fda5eb0c800 20 rados->read ofs=0 len=0 2024-09-12T17:34:39.696 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.694+0000 7fda5eb0c800 20 rados_obj.operate() r=0 bl.length=475 2024-09-12T17:34:39.696 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.694+0000 7fda5eb0c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:34:39.697 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.694+0000 7fda5eb0c800 20 rados->read ofs=0 len=0 2024-09-12T17:34:39.697 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.694+0000 7fda5eb0c800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:34:39.697 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.695+0000 7fda5eb0c800 20 rados->read ofs=0 len=0 2024-09-12T17:34:39.697 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.695+0000 7fda5eb0c800 20 rados_obj.operate() r=0 bl.length=475 2024-09-12T17:34:39.697 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.695+0000 7fda5eb0c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:34:39.698 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.697+0000 7fd9137de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:34:39.701 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.700+0000 7fda5eb0c800 20 remove_watcher() i=0 2024-09-12T17:34:39.701 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.700+0000 7fda5eb0c800 2 removed watcher, disabling cache 2024-09-12T17:34:39.702 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.701+0000 7fda5eb0c800 20 remove_watcher() i=1 2024-09-12T17:34:39.703 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.702+0000 7fda5eb0c800 20 remove_watcher() i=2 2024-09-12T17:34:39.705 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.703+0000 7fda5eb0c800 20 remove_watcher() i=3 2024-09-12T17:34:39.706 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.704+0000 7fda5eb0c800 20 remove_watcher() i=4 2024-09-12T17:34:39.707 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.705+0000 7fda5eb0c800 20 remove_watcher() i=5 2024-09-12T17:34:39.708 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.706+0000 7fda5eb0c800 20 remove_watcher() i=6 2024-09-12T17:34:39.709 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:34:39.707+0000 7fda5eb0c800 20 remove_watcher() i=7 2024-09-12T17:34:39.720 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:34:39.720 INFO:tasks.workunit.client.0.smithi037.stderr:BUCKET_STATS: 2024-09-12T17:34:39.720 INFO:tasks.workunit.client.0.smithi037.stderr:bucket: abort-at-commit-target-layout id: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:34:39.720 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:35:09.931 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bucket reshard --bucket abort-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:35:09.964 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:35:09.964 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:35:10.005 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.004+0000 7fdff3d21800 20 rados->read ofs=0 len=0 2024-09-12T17:35:10.006 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.005+0000 7fdff3d21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:10.006 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.005+0000 7fdff3d21800 20 realm 2024-09-12T17:35:10.006 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.005+0000 7fdff3d21800 20 rados->read ofs=0 len=0 2024-09-12T17:35:10.006 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.005+0000 7fdff3d21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:10.006 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.005+0000 7fdff3d21800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:35:10.006 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.005+0000 7fdff3d21800 20 rados->read ofs=0 len=0 2024-09-12T17:35:10.007 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.005+0000 7fdff3d21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:10.007 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.005+0000 7fdff3d21800 20 rados->read ofs=0 len=0 2024-09-12T17:35:10.007 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.006+0000 7fdff3d21800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:35:10.007 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.007+0000 7fdff3d21800 20 rados->read ofs=0 len=0 2024-09-12T17:35:10.008 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.007+0000 7fdff3d21800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:35:10.008 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.007+0000 7fdff3d21800 20 searching for the correct realm 2024-09-12T17:35:10.011 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.010+0000 7fdff0157640 0 -- 172.21.15.37:0/2799452159 >> [v2:172.21.15.40:6818/1210108009,v1:172.21.15.40:6819/1210108009] conn(0x7fdfe40982a0 msgr2=0x7fdfe409c020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:35:10.015 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.015+0000 7fdfef956640 0 -- 172.21.15.37:0/2799452159 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7fdfe4048ba0 msgr2=0x7fdfe407b1d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:35:10.224 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.223+0000 7fdff3d21800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:35:10.225 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.223+0000 7fdff3d21800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:35:10.225 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.223+0000 7fdff3d21800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:35:10.225 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.223+0000 7fdff3d21800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:35:10.225 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.223+0000 7fdff3d21800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:35:10.225 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.223+0000 7fdff3d21800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:35:10.225 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.223+0000 7fdff3d21800 20 rados->read ofs=0 len=0 2024-09-12T17:35:10.225 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.223+0000 7fdff3d21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:10.225 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.223+0000 7fdff3d21800 20 rados->read ofs=0 len=0 2024-09-12T17:35:10.225 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.224+0000 7fdff3d21800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:35:10.225 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.224+0000 7fdff3d21800 20 rados->read ofs=0 len=0 2024-09-12T17:35:10.226 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.224+0000 7fdff3d21800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:35:10.227 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.224+0000 7fdff3d21800 20 zone default found 2024-09-12T17:35:10.227 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.224+0000 7fdff3d21800 4 Realm: () 2024-09-12T17:35:10.227 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.224+0000 7fdff3d21800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:35:10.227 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.224+0000 7fdff3d21800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:35:10.227 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.224+0000 7fdff3d21800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:35:10.227 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.224+0000 7fdff3d21800 20 zonegroup default 2024-09-12T17:35:10.227 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.224+0000 7fdff3d21800 20 rados->read ofs=0 len=0 2024-09-12T17:35:10.227 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.224+0000 7fdff3d21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:10.227 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.224+0000 7fdff3d21800 20 rados->read ofs=0 len=0 2024-09-12T17:35:10.227 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.225+0000 7fdff3d21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:10.227 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.225+0000 7fdff3d21800 20 rados->read ofs=0 len=0 2024-09-12T17:35:10.227 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.225+0000 7fdff3d21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:10.227 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.225+0000 7fdff3d21800 20 started sync module instance, tier type = 2024-09-12T17:35:10.228 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.225+0000 7fdff3d21800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:35:10.237 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.236+0000 7fdff3d21800 20 add_watcher() i=0 2024-09-12T17:35:10.237 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.236+0000 7fdff3d21800 20 add_watcher() i=1 2024-09-12T17:35:10.237 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.236+0000 7fdff3d21800 20 add_watcher() i=2 2024-09-12T17:35:10.237 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.236+0000 7fdff3d21800 20 add_watcher() i=3 2024-09-12T17:35:10.237 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.236+0000 7fdff3d21800 20 add_watcher() i=4 2024-09-12T17:35:10.237 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.236+0000 7fdff3d21800 20 add_watcher() i=5 2024-09-12T17:35:10.237 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.236+0000 7fdff3d21800 20 add_watcher() i=6 2024-09-12T17:35:10.238 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.237+0000 7fdff3d21800 20 add_watcher() i=7 2024-09-12T17:35:10.238 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.237+0000 7fdff3d21800 2 all 8 watchers are set, enabling cache 2024-09-12T17:35:10.239 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.239+0000 7fdea5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:35:10.241 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.239+0000 7fdff3d21800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:35:10.241 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.239+0000 7fdff3d21800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:35:10.241 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.239+0000 7fdff3d21800 5 note: GC not initialized 2024-09-12T17:35:10.241 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.239+0000 7fdea4fe1640 20 reqs_thread_entry: start 2024-09-12T17:35:10.241 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.239+0000 7fdff3d21800 20 init_complete bucket index max shards: 11 2024-09-12T17:35:10.241 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.239+0000 7fdff3d21800 20 Filter name: none 2024-09-12T17:35:10.241 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.240+0000 7fde1e7fc640 20 reqs_thread_entry: start 2024-09-12T17:35:10.241 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.240+0000 7fdff3d21800 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-12T17:35:10.241 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.240+0000 7fdff3d21800 20 rados->read ofs=0 len=0 2024-09-12T17:35:10.241 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.240+0000 7fdff3d21800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:35:10.241 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.240+0000 7fdff3d21800 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-12T17:35:10.242 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.240+0000 7fdff3d21800 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-12T17:35:10.242 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.240+0000 7fdff3d21800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33 : miss 2024-09-12T17:35:10.242 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.240+0000 7fdff3d21800 20 rados->read ofs=0 len=0 2024-09-12T17:35:10.242 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.240+0000 7fdff3d21800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:35:10.242 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.240+0000 7fdff3d21800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33 info.flags=0x17 2024-09-12T17:35:10.242 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.240+0000 7fdff3d21800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33 to cache LRU end 2024-09-12T17:35:10.242 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.240+0000 7fdff3d21800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:35:10.242 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.240+0000 7fdff3d21800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:35:10.243 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.240+0000 7fdff3d21800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33 2024-09-12T17:35:10.246 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.245+0000 7fdff3d21800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33 info.flags=0x17 2024-09-12T17:35:10.246 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.245+0000 7fdff3d21800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33 to cache LRU end 2024-09-12T17:35:10.246 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.245+0000 7fdff3d21800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:35:10.246 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.245+0000 7fdff3d21800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33, ofs0, ns] 2024-09-12T17:35:10.247 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.246+0000 7fdeceffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496994 cookie 94532206991648 notifier 6956 bl.length()=1015 2024-09-12T17:35:10.247 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.246+0000 7fdeceffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33 info.flags=0x17 2024-09-12T17:35:10.247 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.246+0000 7fdeceffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33 to cache LRU end 2024-09-12T17:35:10.247 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.246+0000 7fdeceffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:35:10.248 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.247+0000 7fdff3d21800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33]): orig_sources= new_sources= 2024-09-12T17:35:10.248 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.247+0000 7fdff3d21800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33]): potential sources added=[] removed=[] 2024-09-12T17:35:10.248 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.247+0000 7fdff3d21800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33]): orig_dests= new_dests= 2024-09-12T17:35:10.248 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.247+0000 7fdff3d21800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33]): potential dests added=[] removed=[] 2024-09-12T17:35:10.254 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.253+0000 7fdff3d21800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.1.0 2024-09-12T17:35:10.254 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.253+0000 7fdff3d21800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.1.0 2024-09-12T17:35:10.254 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.253+0000 7fdff3d21800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.1.1 2024-09-12T17:35:10.254 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.253+0000 7fdff3d21800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.1.1 2024-09-12T17:35:10.254 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.253+0000 7fdff3d21800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.1.2 2024-09-12T17:35:10.254 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.253+0000 7fdff3d21800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.1.2 2024-09-12T17:35:10.254 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.253+0000 7fdff3d21800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.1.3 2024-09-12T17:35:10.254 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.253+0000 7fdff3d21800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.1.3 2024-09-12T17:35:10.254 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.253+0000 7fdff3d21800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.1.4 2024-09-12T17:35:10.255 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.253+0000 7fdff3d21800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.1.4 2024-09-12T17:35:10.255 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.253+0000 7fdff3d21800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.1.5 2024-09-12T17:35:10.255 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.253+0000 7fdff3d21800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.1.5 2024-09-12T17:35:10.255 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.253+0000 7fdff3d21800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.1.6 2024-09-12T17:35:10.255 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.253+0000 7fdff3d21800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.1.6 2024-09-12T17:35:10.255 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.253+0000 7fdff3d21800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.1.7 2024-09-12T17:35:10.255 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.253+0000 7fdff3d21800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.1.7 2024-09-12T17:35:10.255 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.253+0000 7fdff3d21800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.1.8 2024-09-12T17:35:10.255 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.253+0000 7fdff3d21800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.1.8 2024-09-12T17:35:10.255 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.253+0000 7fdff3d21800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.1.9 2024-09-12T17:35:10.255 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.253+0000 7fdff3d21800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.1.9 2024-09-12T17:35:10.255 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.253+0000 7fdff3d21800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.1.10 2024-09-12T17:35:10.255 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.253+0000 7fdff3d21800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.1.10 2024-09-12T17:35:10.255 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.253+0000 7fdff3d21800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.1.11 2024-09-12T17:35:10.256 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.253+0000 7fdff3d21800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.1.11 2024-09-12T17:35:10.256 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.253+0000 7fdff3d21800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.0 2024-09-12T17:35:10.256 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.253+0000 7fdff3d21800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.1 2024-09-12T17:35:10.256 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.254+0000 7fdff3d21800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.2 2024-09-12T17:35:10.257 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.254+0000 7fdff3d21800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.3 2024-09-12T17:35:10.257 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.255+0000 7fdff3d21800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.4 2024-09-12T17:35:10.257 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.255+0000 7fdff3d21800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.5 2024-09-12T17:35:10.257 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.256+0000 7fdff3d21800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.6 2024-09-12T17:35:10.257 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.257+0000 7fdff3d21800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.7 2024-09-12T17:35:10.258 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.258+0000 7fdff3d21800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.8 2024-09-12T17:35:10.259 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.258+0000 7fdff3d21800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.9 2024-09-12T17:35:10.259 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.258+0000 7fdff3d21800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.10 2024-09-12T17:35:10.263 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.262+0000 7fdff3d21800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33 : hit (requested=0x17, cached=0x17) 2024-09-12T17:35:10.263 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.262+0000 7fdff3d21800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33 2024-09-12T17:35:10.264 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.263+0000 7fdff3d21800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33 info.flags=0x17 2024-09-12T17:35:10.264 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.263+0000 7fdff3d21800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33 to cache LRU end 2024-09-12T17:35:10.264 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.263+0000 7fdff3d21800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:35:10.265 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.263+0000 7fdff3d21800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33, ofs0, ns] 2024-09-12T17:35:10.265 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.264+0000 7fdeceffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496995 cookie 94532206991648 notifier 6956 bl.length()=1015 2024-09-12T17:35:10.265 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.264+0000 7fdeceffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33 info.flags=0x17 2024-09-12T17:35:10.265 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.264+0000 7fdeceffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33 to cache LRU end 2024-09-12T17:35:10.265 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.264+0000 7fdeceffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:35:10.266 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.265+0000 7fdff3d21800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33]): orig_sources= new_sources= 2024-09-12T17:35:10.266 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.265+0000 7fdff3d21800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33]): potential sources added=[] removed=[] 2024-09-12T17:35:10.266 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.265+0000 7fdff3d21800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33]): orig_dests= new_dests= 2024-09-12T17:35:10.266 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.265+0000 7fdff3d21800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33]): potential dests added=[] removed=[] 2024-09-12T17:35:10.269 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.268+0000 7fdff3d21800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.0 2024-09-12T17:35:10.269 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.268+0000 7fdff3d21800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.1 2024-09-12T17:35:10.269 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.268+0000 7fdff3d21800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.2 2024-09-12T17:35:10.270 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.269+0000 7fdff3d21800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.3 2024-09-12T17:35:10.270 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.269+0000 7fdff3d21800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.4 2024-09-12T17:35:10.270 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.270+0000 7fdff3d21800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.5 2024-09-12T17:35:10.271 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.270+0000 7fdff3d21800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.6 2024-09-12T17:35:10.271 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.270+0000 7fdff3d21800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.7 2024-09-12T17:35:10.271 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.271+0000 7fdff3d21800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.8 2024-09-12T17:35:10.272 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.271+0000 7fdff3d21800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.9 2024-09-12T17:35:10.272 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.271+0000 7fdff3d21800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33.10 2024-09-12T17:35:10.273 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.272+0000 7fdff3d21800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33 : hit (requested=0x17, cached=0x17) 2024-09-12T17:35:10.273 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.272+0000 7fdff3d21800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33 2024-09-12T17:35:10.274 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.273+0000 7fdff3d21800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33 info.flags=0x17 2024-09-12T17:35:10.274 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.273+0000 7fdff3d21800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33 to cache LRU end 2024-09-12T17:35:10.274 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.273+0000 7fdff3d21800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:35:10.274 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.273+0000 7fdff3d21800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33, ofs0, ns] 2024-09-12T17:35:10.274 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.273+0000 7fdeceffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496996 cookie 94532206991648 notifier 6956 bl.length()=983 2024-09-12T17:35:10.274 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.273+0000 7fdeceffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33 info.flags=0x17 2024-09-12T17:35:10.275 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.273+0000 7fdeceffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33 to cache LRU end 2024-09-12T17:35:10.275 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.273+0000 7fdeceffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:35:10.276 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.275+0000 7fdff3d21800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33]): orig_sources= new_sources= 2024-09-12T17:35:10.276 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.275+0000 7fdff3d21800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33]): potential sources added=[] removed=[] 2024-09-12T17:35:10.276 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.275+0000 7fdff3d21800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33]): orig_dests= new_dests= 2024-09-12T17:35:10.276 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.275+0000 7fdff3d21800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33]): potential dests added=[] removed=[] 2024-09-12T17:35:10.278 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.277+0000 7fdff3d21800 1 execute INFO: reshard of bucket "abort-at-commit-target-layout" from 11 shards to 12 shards completed successfully 2024-09-12T17:35:10.280 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.279+0000 7fdea5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:35:10.282 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.282+0000 7fdff3d21800 20 remove_watcher() i=0 2024-09-12T17:35:10.283 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.282+0000 7fdff3d21800 2 removed watcher, disabling cache 2024-09-12T17:35:10.284 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.283+0000 7fdff3d21800 20 remove_watcher() i=1 2024-09-12T17:35:10.285 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.284+0000 7fdff3d21800 20 remove_watcher() i=2 2024-09-12T17:35:10.286 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.286+0000 7fdff3d21800 20 remove_watcher() i=3 2024-09-12T17:35:10.287 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.287+0000 7fdff3d21800 20 remove_watcher() i=4 2024-09-12T17:35:10.288 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.288+0000 7fdff3d21800 20 remove_watcher() i=5 2024-09-12T17:35:10.289 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.289+0000 7fdff3d21800 20 remove_watcher() i=6 2024-09-12T17:35:10.290 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.290+0000 7fdff3d21800 20 remove_watcher() i=7 2024-09-12T17:35:10.303 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-09-12T17:35:10.332 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:35:10.332 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:35:10.371 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.370+0000 7f6fbc015800 20 rados->read ofs=0 len=0 2024-09-12T17:35:10.373 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.372+0000 7f6fbc015800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:10.373 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.372+0000 7f6fbc015800 20 realm 2024-09-12T17:35:10.373 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.372+0000 7f6fbc015800 20 rados->read ofs=0 len=0 2024-09-12T17:35:10.373 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.372+0000 7f6fbc015800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:10.373 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.372+0000 7f6fbc015800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:35:10.373 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.372+0000 7f6fbc015800 20 rados->read ofs=0 len=0 2024-09-12T17:35:10.373 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.372+0000 7f6fbc015800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:10.373 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.372+0000 7f6fbc015800 20 rados->read ofs=0 len=0 2024-09-12T17:35:10.374 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.373+0000 7f6fbc015800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:35:10.374 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.373+0000 7f6fbc015800 20 rados->read ofs=0 len=0 2024-09-12T17:35:10.374 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.373+0000 7f6fbc015800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:35:10.374 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.373+0000 7f6fbc015800 20 searching for the correct realm 2024-09-12T17:35:10.377 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.377+0000 7f6fb7f93640 0 -- 172.21.15.37:0/3592416899 >> [v2:172.21.15.40:6818/1210108009,v1:172.21.15.40:6819/1210108009] conn(0x7f6fac0b7c20 msgr2=0x7f6fac0a3890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:35:10.381 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.380+0000 7f6fb7792640 0 -- 172.21.15.37:0/3592416899 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7f6fac091b70 msgr2=0x7f6fac0c6a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:35:10.386 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.385+0000 7f6fbc015800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:35:10.386 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.385+0000 7f6fbc015800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:35:10.386 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.385+0000 7f6fbc015800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:35:10.386 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.385+0000 7f6fbc015800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:35:10.386 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.385+0000 7f6fbc015800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:35:10.386 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.385+0000 7f6fbc015800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:35:10.386 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.385+0000 7f6fbc015800 20 rados->read ofs=0 len=0 2024-09-12T17:35:10.387 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.385+0000 7f6fbc015800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:10.387 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.385+0000 7f6fbc015800 20 rados->read ofs=0 len=0 2024-09-12T17:35:10.388 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.386+0000 7f6fbc015800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:35:10.388 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.386+0000 7f6fbc015800 20 rados->read ofs=0 len=0 2024-09-12T17:35:10.388 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.386+0000 7f6fbc015800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:35:10.388 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.386+0000 7f6fbc015800 20 zone default found 2024-09-12T17:35:10.388 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.386+0000 7f6fbc015800 4 Realm: () 2024-09-12T17:35:10.388 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.386+0000 7f6fbc015800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:35:10.388 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.386+0000 7f6fbc015800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:35:10.388 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.386+0000 7f6fbc015800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:35:10.389 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.386+0000 7f6fbc015800 20 zonegroup default 2024-09-12T17:35:10.389 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.386+0000 7f6fbc015800 20 rados->read ofs=0 len=0 2024-09-12T17:35:10.389 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.386+0000 7f6fbc015800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:10.389 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.386+0000 7f6fbc015800 20 rados->read ofs=0 len=0 2024-09-12T17:35:10.389 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.387+0000 7f6fbc015800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:10.389 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.387+0000 7f6fbc015800 20 rados->read ofs=0 len=0 2024-09-12T17:35:10.389 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.387+0000 7f6fbc015800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:10.389 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.387+0000 7f6fbc015800 20 started sync module instance, tier type = 2024-09-12T17:35:10.389 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.387+0000 7f6fbc015800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:35:10.397 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.396+0000 7f6fbc015800 20 add_watcher() i=0 2024-09-12T17:35:10.398 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.397+0000 7f6fbc015800 20 add_watcher() i=1 2024-09-12T17:35:10.398 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.397+0000 7f6fbc015800 20 add_watcher() i=2 2024-09-12T17:35:10.398 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.397+0000 7f6fbc015800 20 add_watcher() i=3 2024-09-12T17:35:10.398 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.397+0000 7f6fbc015800 20 add_watcher() i=4 2024-09-12T17:35:10.398 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.397+0000 7f6fbc015800 20 add_watcher() i=5 2024-09-12T17:35:10.398 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.397+0000 7f6fbc015800 20 add_watcher() i=6 2024-09-12T17:35:10.398 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.398+0000 7f6fbc015800 20 add_watcher() i=7 2024-09-12T17:35:10.398 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.398+0000 7f6fbc015800 2 all 8 watchers are set, enabling cache 2024-09-12T17:35:10.400 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.399+0000 7f6e6dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:35:10.401 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.400+0000 7f6fbc015800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:35:10.401 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.400+0000 7f6fbc015800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:35:10.401 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.400+0000 7f6fbc015800 5 note: GC not initialized 2024-09-12T17:35:10.401 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.400+0000 7f6e6cfe1640 20 reqs_thread_entry: start 2024-09-12T17:35:10.401 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.400+0000 7f6fbc015800 20 init_complete bucket index max shards: 11 2024-09-12T17:35:10.401 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.400+0000 7f6fbc015800 20 Filter name: none 2024-09-12T17:35:10.402 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.400+0000 7f6de67fc640 20 reqs_thread_entry: start 2024-09-12T17:35:10.402 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.400+0000 7f6fbc015800 20 rados->read ofs=0 len=0 2024-09-12T17:35:10.402 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.401+0000 7f6fbc015800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:35:10.402 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.401+0000 7f6fbc015800 20 rados->read ofs=0 len=0 2024-09-12T17:35:10.403 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.401+0000 7f6fbc015800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:35:10.403 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.401+0000 7f6fbc015800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:35:10.403 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.401+0000 7f6fbc015800 20 rados->read ofs=0 len=0 2024-09-12T17:35:10.403 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.401+0000 7f6fbc015800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:35:10.403 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.401+0000 7f6fbc015800 20 rados->read ofs=0 len=0 2024-09-12T17:35:10.403 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.402+0000 7f6fbc015800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:35:10.403 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.402+0000 7f6fbc015800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:35:10.404 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.404+0000 7f6e6dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:35:10.407 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.406+0000 7f6fbc015800 20 remove_watcher() i=0 2024-09-12T17:35:10.407 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.406+0000 7f6fbc015800 2 removed watcher, disabling cache 2024-09-12T17:35:10.408 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.407+0000 7f6fbc015800 20 remove_watcher() i=1 2024-09-12T17:35:10.409 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.408+0000 7f6fbc015800 20 remove_watcher() i=2 2024-09-12T17:35:10.410 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.409+0000 7f6fbc015800 20 remove_watcher() i=3 2024-09-12T17:35:10.411 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.410+0000 7f6fbc015800 20 remove_watcher() i=4 2024-09-12T17:35:10.412 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.411+0000 7f6fbc015800 20 remove_watcher() i=5 2024-09-12T17:35:10.413 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.412+0000 7f6fbc015800 20 remove_watcher() i=6 2024-09-12T17:35:10.414 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:10.413+0000 7f6fbc015800 20 remove_watcher() i=7 2024-09-12T17:35:10.426 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:35:10.426 INFO:tasks.workunit.client.0.smithi037.stderr:BUCKET_STATS: 2024-09-12T17:35:10.426 INFO:tasks.workunit.client.0.smithi037.stderr:bucket: abort-at-commit-target-layout id: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.33 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T17:35:10.426 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:35:10.767 INFO:tasks.workunit.client.0.smithi037.stderr:TEST: reshard bucket with EIO injected at do_reshard 2024-09-12T17:35:10.768 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:35:11.586 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-09-12T17:35:11.615 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:35:11.615 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:35:11.654 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:11.653+0000 7fe83dcbb800 20 rados->read ofs=0 len=0 2024-09-12T17:35:11.656 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:11.655+0000 7fe83dcbb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:11.656 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:11.655+0000 7fe83dcbb800 20 realm 2024-09-12T17:35:11.656 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:11.655+0000 7fe83dcbb800 20 rados->read ofs=0 len=0 2024-09-12T17:35:11.656 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:11.655+0000 7fe83dcbb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:11.656 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:11.655+0000 7fe83dcbb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:35:11.656 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:11.655+0000 7fe83dcbb800 20 rados->read ofs=0 len=0 2024-09-12T17:35:11.656 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:11.655+0000 7fe83dcbb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:11.656 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:11.655+0000 7fe83dcbb800 20 rados->read ofs=0 len=0 2024-09-12T17:35:11.657 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:11.656+0000 7fe83dcbb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:35:11.657 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:11.656+0000 7fe83dcbb800 20 rados->read ofs=0 len=0 2024-09-12T17:35:11.657 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:11.656+0000 7fe83dcbb800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:35:11.657 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:11.656+0000 7fe83dcbb800 20 searching for the correct realm 2024-09-12T17:35:11.660 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:11.659+0000 7fe83afa4640 0 -- 172.21.15.37:0/2501111552 >> [v2:172.21.15.37:6816/2964054205,v1:172.21.15.37:6817/2964054205] conn(0x5619aa5e6d30 msgr2=0x5619aa5e9120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:35:11.664 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:11.663+0000 7fe83b7a5640 0 -- 172.21.15.37:0/2501111552 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7fe830045470 msgr2=0x7fe830065160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:35:11.668 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:11.667+0000 7fe83dcbb800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:35:11.668 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:11.667+0000 7fe83dcbb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:35:11.668 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:11.667+0000 7fe83dcbb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:35:11.668 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:11.667+0000 7fe83dcbb800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:35:11.668 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:11.667+0000 7fe83dcbb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:35:11.669 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:11.667+0000 7fe83dcbb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:35:11.669 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:11.667+0000 7fe83dcbb800 20 rados->read ofs=0 len=0 2024-09-12T17:35:11.669 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:11.667+0000 7fe83dcbb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:11.669 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:11.667+0000 7fe83dcbb800 20 rados->read ofs=0 len=0 2024-09-12T17:35:11.670 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:11.668+0000 7fe83dcbb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:35:11.670 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:11.668+0000 7fe83dcbb800 20 rados->read ofs=0 len=0 2024-09-12T17:35:11.670 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:11.668+0000 7fe83dcbb800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:35:11.670 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:11.668+0000 7fe83dcbb800 20 zone default found 2024-09-12T17:35:11.670 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:11.668+0000 7fe83dcbb800 4 Realm: () 2024-09-12T17:35:11.671 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:11.668+0000 7fe83dcbb800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:35:11.671 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:11.668+0000 7fe83dcbb800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:35:11.671 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:11.668+0000 7fe83dcbb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:35:11.671 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:11.668+0000 7fe83dcbb800 20 zonegroup default 2024-09-12T17:35:11.671 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:11.668+0000 7fe83dcbb800 20 rados->read ofs=0 len=0 2024-09-12T17:35:11.671 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:11.669+0000 7fe83dcbb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:11.671 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:11.669+0000 7fe83dcbb800 20 rados->read ofs=0 len=0 2024-09-12T17:35:11.671 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:11.669+0000 7fe83dcbb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:11.671 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:11.669+0000 7fe83dcbb800 20 rados->read ofs=0 len=0 2024-09-12T17:35:11.671 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:11.669+0000 7fe83dcbb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:11.671 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:11.669+0000 7fe83dcbb800 20 started sync module instance, tier type = 2024-09-12T17:35:11.671 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:11.669+0000 7fe83dcbb800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:35:11.680 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:11.679+0000 7fe83dcbb800 20 add_watcher() i=0 2024-09-12T17:35:11.680 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:11.679+0000 7fe83dcbb800 20 add_watcher() i=1 2024-09-12T17:35:11.680 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:11.679+0000 7fe83dcbb800 20 add_watcher() i=2 2024-09-12T17:35:11.680 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:11.679+0000 7fe83dcbb800 20 add_watcher() i=3 2024-09-12T17:35:11.680 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:11.679+0000 7fe83dcbb800 20 add_watcher() i=4 2024-09-12T17:35:11.680 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:11.679+0000 7fe83dcbb800 20 add_watcher() i=5 2024-09-12T17:35:11.681 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:11.679+0000 7fe83dcbb800 20 add_watcher() i=6 2024-09-12T17:35:11.681 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:11.680+0000 7fe83dcbb800 20 add_watcher() i=7 2024-09-12T17:35:11.681 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:11.680+0000 7fe83dcbb800 2 all 8 watchers are set, enabling cache 2024-09-12T17:35:11.682 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:11.681+0000 7fe6f27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:35:11.683 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:11.682+0000 7fe83dcbb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:35:11.683 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:11.682+0000 7fe83dcbb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:35:11.683 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:11.682+0000 7fe83dcbb800 5 note: GC not initialized 2024-09-12T17:35:11.683 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:11.682+0000 7fe6f17e2640 20 reqs_thread_entry: start 2024-09-12T17:35:11.684 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:11.682+0000 7fe83dcbb800 20 init_complete bucket index max shards: 11 2024-09-12T17:35:11.684 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:11.682+0000 7fe83dcbb800 20 Filter name: none 2024-09-12T17:35:11.684 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:11.682+0000 7fe6ea7fc640 20 reqs_thread_entry: start 2024-09-12T17:35:11.684 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:11.682+0000 7fe83dcbb800 20 rados->read ofs=0 len=0 2024-09-12T17:35:11.685 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:11.683+0000 7fe83dcbb800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:35:11.685 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:11.683+0000 7fe83dcbb800 20 rados->read ofs=0 len=0 2024-09-12T17:35:11.685 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:11.684+0000 7fe83dcbb800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:35:11.685 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:11.684+0000 7fe83dcbb800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:35:11.685 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:11.684+0000 7fe83dcbb800 20 rados->read ofs=0 len=0 2024-09-12T17:35:11.685 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:11.684+0000 7fe83dcbb800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:35:11.685 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:11.684+0000 7fe83dcbb800 20 rados->read ofs=0 len=0 2024-09-12T17:35:11.686 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:11.684+0000 7fe83dcbb800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:35:11.686 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:11.684+0000 7fe83dcbb800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:35:11.687 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:11.686+0000 7fe6f27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:35:11.689 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:11.688+0000 7fe83dcbb800 20 remove_watcher() i=0 2024-09-12T17:35:11.689 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:11.688+0000 7fe83dcbb800 2 removed watcher, disabling cache 2024-09-12T17:35:11.690 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:11.690+0000 7fe83dcbb800 20 remove_watcher() i=1 2024-09-12T17:35:11.691 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:11.691+0000 7fe83dcbb800 20 remove_watcher() i=2 2024-09-12T17:35:11.692 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:11.692+0000 7fe83dcbb800 20 remove_watcher() i=3 2024-09-12T17:35:11.693 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:11.693+0000 7fe83dcbb800 20 remove_watcher() i=4 2024-09-12T17:35:11.694 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:11.694+0000 7fe83dcbb800 20 remove_watcher() i=5 2024-09-12T17:35:11.695 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:11.695+0000 7fe83dcbb800 20 remove_watcher() i=6 2024-09-12T17:35:11.696 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:11.696+0000 7fe83dcbb800 20 remove_watcher() i=7 2024-09-12T17:35:11.708 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:35:11.708 INFO:tasks.workunit.client.0.smithi037.stderr:BUCKET_STATS: 2024-09-12T17:35:11.708 INFO:tasks.workunit.client.0.smithi037.stderr:bucket: error-at-do-reshard id: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.34 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:35:11.708 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:35:11.709 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bucket reshard --bucket error-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at do_reshard 2024-09-12T17:35:11.744 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:35:11.744 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:35:11.784 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:11.783+0000 7feba972b800 20 rados->read ofs=0 len=0 2024-09-12T17:35:11.786 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:11.784+0000 7feba972b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:11.786 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:11.784+0000 7feba972b800 20 realm 2024-09-12T17:35:11.786 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:11.784+0000 7feba972b800 20 rados->read ofs=0 len=0 2024-09-12T17:35:11.786 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:11.785+0000 7feba972b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:11.786 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:11.785+0000 7feba972b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:35:11.786 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:11.785+0000 7feba972b800 20 rados->read ofs=0 len=0 2024-09-12T17:35:11.786 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:11.785+0000 7feba972b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:11.786 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:11.785+0000 7feba972b800 20 rados->read ofs=0 len=0 2024-09-12T17:35:11.787 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:11.786+0000 7feba972b800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:35:11.787 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:11.786+0000 7feba972b800 20 rados->read ofs=0 len=0 2024-09-12T17:35:11.787 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:11.786+0000 7feba972b800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:35:11.787 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:11.786+0000 7feba972b800 20 searching for the correct realm 2024-09-12T17:35:11.788 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:11.788+0000 7feba5473640 0 -- 172.21.15.37:0/3454032165 >> [v2:172.21.15.37:6800/1206746176,v1:172.21.15.37:6801/1206746176] conn(0x7feba006b040 msgr2=0x7feba00a78f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:35:11.994 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:11.993+0000 7feba5c74640 0 -- 172.21.15.37:0/3454032165 >> [v2:172.21.15.40:6818/1210108009,v1:172.21.15.40:6819/1210108009] conn(0x7feb90072050 msgr2=0x7feb90008720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:35:12.000 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:11.999+0000 7feba972b800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:35:12.000 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:11.999+0000 7feba972b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:35:12.000 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:11.999+0000 7feba972b800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:35:12.001 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:11.999+0000 7feba972b800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:35:12.001 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:11.999+0000 7feba972b800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:35:12.001 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:11.999+0000 7feba972b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:35:12.001 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:11.999+0000 7feba972b800 20 rados->read ofs=0 len=0 2024-09-12T17:35:12.001 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.000+0000 7feba972b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:12.001 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.000+0000 7feba972b800 20 rados->read ofs=0 len=0 2024-09-12T17:35:12.002 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.000+0000 7feba972b800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:35:12.002 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.000+0000 7feba972b800 20 rados->read ofs=0 len=0 2024-09-12T17:35:12.002 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.000+0000 7feba972b800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:35:12.003 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.000+0000 7feba972b800 20 zone default found 2024-09-12T17:35:12.003 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.000+0000 7feba972b800 4 Realm: () 2024-09-12T17:35:12.003 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.000+0000 7feba972b800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:35:12.003 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.000+0000 7feba972b800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:35:12.003 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.000+0000 7feba972b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:35:12.003 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.000+0000 7feba972b800 20 zonegroup default 2024-09-12T17:35:12.003 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.000+0000 7feba972b800 20 rados->read ofs=0 len=0 2024-09-12T17:35:12.003 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.001+0000 7feba972b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:12.003 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.001+0000 7feba972b800 20 rados->read ofs=0 len=0 2024-09-12T17:35:12.003 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.001+0000 7feba972b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:12.003 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.001+0000 7feba972b800 20 rados->read ofs=0 len=0 2024-09-12T17:35:12.003 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.001+0000 7feba972b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:12.003 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.001+0000 7feba972b800 20 started sync module instance, tier type = 2024-09-12T17:35:12.004 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.001+0000 7feba972b800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:35:12.011 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.011+0000 7feba972b800 20 add_watcher() i=0 2024-09-12T17:35:12.011 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.011+0000 7feba972b800 20 add_watcher() i=1 2024-09-12T17:35:12.011 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.011+0000 7feba972b800 20 add_watcher() i=2 2024-09-12T17:35:12.011 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.011+0000 7feba972b800 20 add_watcher() i=3 2024-09-12T17:35:12.012 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.011+0000 7feba972b800 20 add_watcher() i=4 2024-09-12T17:35:12.012 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.011+0000 7feba972b800 20 add_watcher() i=5 2024-09-12T17:35:12.012 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.011+0000 7feba972b800 20 add_watcher() i=6 2024-09-12T17:35:12.012 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.011+0000 7feba972b800 20 add_watcher() i=7 2024-09-12T17:35:12.012 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.011+0000 7feba972b800 2 all 8 watchers are set, enabling cache 2024-09-12T17:35:12.014 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.013+0000 7fea5b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:35:12.015 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.014+0000 7feba972b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:35:12.015 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.014+0000 7feba972b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:35:12.015 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.014+0000 7feba972b800 5 note: GC not initialized 2024-09-12T17:35:12.015 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.014+0000 7fea5a7e4640 20 reqs_thread_entry: start 2024-09-12T17:35:12.015 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.014+0000 7feba972b800 20 init_complete bucket index max shards: 11 2024-09-12T17:35:12.015 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.014+0000 7feba972b800 20 Filter name: none 2024-09-12T17:35:12.016 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.014+0000 7fe9cbfff640 20 reqs_thread_entry: start 2024-09-12T17:35:12.016 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.014+0000 7feba972b800 10 cache get: name=default.rgw.meta+root+error-at-do-reshard : miss 2024-09-12T17:35:12.016 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.014+0000 7feba972b800 20 rados->read ofs=0 len=0 2024-09-12T17:35:12.016 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.015+0000 7feba972b800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:35:12.016 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.015+0000 7feba972b800 10 cache put: name=default.rgw.meta+root+error-at-do-reshard info.flags=0x11 2024-09-12T17:35:12.017 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.015+0000 7feba972b800 10 adding default.rgw.meta+root+error-at-do-reshard to cache LRU end 2024-09-12T17:35:12.017 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.015+0000 7feba972b800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.34 : miss 2024-09-12T17:35:12.017 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.015+0000 7feba972b800 20 rados->read ofs=0 len=0 2024-09-12T17:35:12.017 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.015+0000 7feba972b800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:35:12.017 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.015+0000 7feba972b800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.34 info.flags=0x17 2024-09-12T17:35:12.017 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.015+0000 7feba972b800 10 adding default.rgw.meta+root+.bucket.meta.error-at-do-reshard:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.34 to cache LRU end 2024-09-12T17:35:12.017 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.015+0000 7feba972b800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:35:12.017 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.015+0000 7feba972b800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:35:12.017 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.015+0000 7feba972b800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.34 2024-09-12T17:35:12.021 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.020+0000 7feba972b800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.34 info.flags=0x17 2024-09-12T17:35:12.021 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.020+0000 7feba972b800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.34 to cache LRU end 2024-09-12T17:35:12.021 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.020+0000 7feba972b800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:35:12.021 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.020+0000 7feba972b800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.34, ofs0, ns] 2024-09-12T17:35:12.022 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.020+0000 7fea77fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497086 cookie 93831378996928 notifier 7007 bl.length()=995 2024-09-12T17:35:12.022 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.020+0000 7fea77fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.34 info.flags=0x17 2024-09-12T17:35:12.022 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.020+0000 7fea77fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.34 to cache LRU end 2024-09-12T17:35:12.022 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.020+0000 7fea77fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:35:12.023 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.022+0000 7feba972b800 20 handle_bi_update(): bucket=:error-at-do-reshard[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.34]): orig_sources= new_sources= 2024-09-12T17:35:12.023 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.022+0000 7feba972b800 20 handle_bi_update(): bucket=:error-at-do-reshard[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.34]): potential sources added=[] removed=[] 2024-09-12T17:35:12.023 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.022+0000 7feba972b800 20 handle_bi_update(): bucket=:error-at-do-reshard[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.34]): orig_dests= new_dests= 2024-09-12T17:35:12.023 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.022+0000 7feba972b800 20 handle_bi_update(): bucket=:error-at-do-reshard[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.34]): potential dests added=[] removed=[] 2024-09-12T17:35:12.028 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.027+0000 7feba972b800 -1 Injecting error=-5 at location=do_reshard 2024-09-12T17:35:12.039 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.038+0000 7feba972b800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.34 : hit (requested=0x17, cached=0x17) 2024-09-12T17:35:12.039 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.038+0000 7feba972b800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.34 2024-09-12T17:35:12.040 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.039+0000 7feba972b800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.34 info.flags=0x17 2024-09-12T17:35:12.040 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.039+0000 7feba972b800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.34 to cache LRU end 2024-09-12T17:35:12.041 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.039+0000 7feba972b800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:35:12.041 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.039+0000 7feba972b800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.34, ofs0, ns] 2024-09-12T17:35:12.041 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.040+0000 7fea88ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497087 cookie 93831378996928 notifier 7007 bl.length()=963 2024-09-12T17:35:12.041 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.040+0000 7fea88ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.34 info.flags=0x17 2024-09-12T17:35:12.041 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.040+0000 7fea88ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.34 to cache LRU end 2024-09-12T17:35:12.041 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.040+0000 7fea88ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:35:12.043 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.042+0000 7feba972b800 20 handle_bi_update(): bucket=:error-at-do-reshard[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.34]): orig_sources= new_sources= 2024-09-12T17:35:12.043 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.042+0000 7feba972b800 20 handle_bi_update(): bucket=:error-at-do-reshard[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.34]): potential sources added=[] removed=[] 2024-09-12T17:35:12.043 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.042+0000 7feba972b800 20 handle_bi_update(): bucket=:error-at-do-reshard[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.34]): orig_dests= new_dests= 2024-09-12T17:35:12.043 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.042+0000 7feba972b800 20 handle_bi_update(): bucket=:error-at-do-reshard[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.34]): potential dests added=[] removed=[] 2024-09-12T17:35:12.043 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.042+0000 7feba972b800 1 execute INFO: reshard of bucket "error-at-do-reshard" canceled due to errors 2024-09-12T17:35:12.045 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.044+0000 7fea5b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:35:12.047 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.046+0000 7feba972b800 20 remove_watcher() i=0 2024-09-12T17:35:12.047 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.046+0000 7feba972b800 2 removed watcher, disabling cache 2024-09-12T17:35:12.048 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.047+0000 7feba972b800 20 remove_watcher() i=1 2024-09-12T17:35:12.049 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.048+0000 7feba972b800 20 remove_watcher() i=2 2024-09-12T17:35:12.050 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.049+0000 7feba972b800 20 remove_watcher() i=3 2024-09-12T17:35:12.051 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.050+0000 7feba972b800 20 remove_watcher() i=4 2024-09-12T17:35:12.052 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.051+0000 7feba972b800 20 remove_watcher() i=5 2024-09-12T17:35:12.053 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.052+0000 7feba972b800 20 remove_watcher() i=6 2024-09-12T17:35:12.054 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.053+0000 7feba972b800 20 remove_watcher() i=7 2024-09-12T17:35:12.066 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-09-12T17:35:12.095 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:35:12.096 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:35:12.134 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.133+0000 7f4387f28800 20 rados->read ofs=0 len=0 2024-09-12T17:35:12.138 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.135+0000 7f4387f28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:12.138 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.135+0000 7f4387f28800 20 realm 2024-09-12T17:35:12.138 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.135+0000 7f4387f28800 20 rados->read ofs=0 len=0 2024-09-12T17:35:12.138 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.135+0000 7f4387f28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:12.138 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.135+0000 7f4387f28800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:35:12.138 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.135+0000 7f4387f28800 20 rados->read ofs=0 len=0 2024-09-12T17:35:12.138 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.135+0000 7f4387f28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:12.138 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.135+0000 7f4387f28800 20 rados->read ofs=0 len=0 2024-09-12T17:35:12.138 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.136+0000 7f4387f28800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:35:12.139 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.136+0000 7f4387f28800 20 rados->read ofs=0 len=0 2024-09-12T17:35:12.139 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.136+0000 7f4387f28800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:35:12.139 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.136+0000 7f4387f28800 20 searching for the correct realm 2024-09-12T17:35:12.140 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.139+0000 7f437b35c640 0 -- 172.21.15.37:0/893246039 >> [v2:172.21.15.40:6800/2441293461,v1:172.21.15.40:6801/2441293461] conn(0x7f4374075060 msgr2=0x7f43740a4570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:35:12.144 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.143+0000 7f4383b5d640 0 -- 172.21.15.37:0/893246039 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7f436c0643d0 msgr2=0x7f436c064850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:35:12.351 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.349+0000 7f4387f28800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:35:12.351 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.349+0000 7f4387f28800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:35:12.351 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.349+0000 7f4387f28800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:35:12.351 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.349+0000 7f4387f28800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:35:12.351 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.349+0000 7f4387f28800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:35:12.351 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.349+0000 7f4387f28800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:35:12.351 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.349+0000 7f4387f28800 20 rados->read ofs=0 len=0 2024-09-12T17:35:12.351 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.350+0000 7f4387f28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:12.352 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.350+0000 7f4387f28800 20 rados->read ofs=0 len=0 2024-09-12T17:35:12.353 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.350+0000 7f4387f28800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:35:12.353 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.350+0000 7f4387f28800 20 rados->read ofs=0 len=0 2024-09-12T17:35:12.353 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.351+0000 7f4387f28800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:35:12.353 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.351+0000 7f4387f28800 20 zone default found 2024-09-12T17:35:12.353 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.351+0000 7f4387f28800 4 Realm: () 2024-09-12T17:35:12.353 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.351+0000 7f4387f28800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:35:12.354 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.351+0000 7f4387f28800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:35:12.354 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.351+0000 7f4387f28800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:35:12.354 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.351+0000 7f4387f28800 20 zonegroup default 2024-09-12T17:35:12.354 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.351+0000 7f4387f28800 20 rados->read ofs=0 len=0 2024-09-12T17:35:12.354 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.351+0000 7f4387f28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:12.354 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.351+0000 7f4387f28800 20 rados->read ofs=0 len=0 2024-09-12T17:35:12.354 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.351+0000 7f4387f28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:12.354 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.351+0000 7f4387f28800 20 rados->read ofs=0 len=0 2024-09-12T17:35:12.354 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.352+0000 7f4387f28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:12.354 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.352+0000 7f4387f28800 20 started sync module instance, tier type = 2024-09-12T17:35:12.354 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.352+0000 7f4387f28800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:35:12.362 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.361+0000 7f4387f28800 20 add_watcher() i=0 2024-09-12T17:35:12.362 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.361+0000 7f4387f28800 20 add_watcher() i=1 2024-09-12T17:35:12.362 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.361+0000 7f4387f28800 20 add_watcher() i=2 2024-09-12T17:35:12.362 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.361+0000 7f4387f28800 20 add_watcher() i=3 2024-09-12T17:35:12.362 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.361+0000 7f4387f28800 20 add_watcher() i=4 2024-09-12T17:35:12.363 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.361+0000 7f4387f28800 20 add_watcher() i=5 2024-09-12T17:35:12.363 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.361+0000 7f4387f28800 20 add_watcher() i=6 2024-09-12T17:35:12.363 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.362+0000 7f4387f28800 20 add_watcher() i=7 2024-09-12T17:35:12.363 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.362+0000 7f4387f28800 2 all 8 watchers are set, enabling cache 2024-09-12T17:35:12.366 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.364+0000 7f4239fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:35:12.366 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.364+0000 7f4387f28800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:35:12.366 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.364+0000 7f4387f28800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:35:12.366 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.364+0000 7f4387f28800 5 note: GC not initialized 2024-09-12T17:35:12.366 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.365+0000 7f4238fe1640 20 reqs_thread_entry: start 2024-09-12T17:35:12.366 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.365+0000 7f4387f28800 20 init_complete bucket index max shards: 11 2024-09-12T17:35:12.366 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.365+0000 7f4387f28800 20 Filter name: none 2024-09-12T17:35:12.366 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.365+0000 7f41b27fc640 20 reqs_thread_entry: start 2024-09-12T17:35:12.366 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.365+0000 7f4387f28800 20 rados->read ofs=0 len=0 2024-09-12T17:35:12.367 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.366+0000 7f4387f28800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:35:12.368 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.366+0000 7f4387f28800 20 rados->read ofs=0 len=0 2024-09-12T17:35:12.368 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.366+0000 7f4387f28800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:35:12.368 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.366+0000 7f4387f28800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:35:12.368 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.366+0000 7f4387f28800 20 rados->read ofs=0 len=0 2024-09-12T17:35:12.368 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.367+0000 7f4387f28800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:35:12.368 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.367+0000 7f4387f28800 20 rados->read ofs=0 len=0 2024-09-12T17:35:12.368 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.367+0000 7f4387f28800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:35:12.369 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.367+0000 7f4387f28800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:35:12.370 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.369+0000 7f4239fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:35:12.372 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.371+0000 7f4387f28800 20 remove_watcher() i=0 2024-09-12T17:35:12.372 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.371+0000 7f4387f28800 2 removed watcher, disabling cache 2024-09-12T17:35:12.373 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.373+0000 7f4387f28800 20 remove_watcher() i=1 2024-09-12T17:35:12.374 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.374+0000 7f4387f28800 20 remove_watcher() i=2 2024-09-12T17:35:12.376 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.375+0000 7f4387f28800 20 remove_watcher() i=3 2024-09-12T17:35:12.377 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.376+0000 7f4387f28800 20 remove_watcher() i=4 2024-09-12T17:35:12.378 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.377+0000 7f4387f28800 20 remove_watcher() i=5 2024-09-12T17:35:12.379 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.378+0000 7f4387f28800 20 remove_watcher() i=6 2024-09-12T17:35:12.380 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.379+0000 7f4387f28800 20 remove_watcher() i=7 2024-09-12T17:35:12.391 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:35:12.391 INFO:tasks.workunit.client.0.smithi037.stderr:BUCKET_STATS: 2024-09-12T17:35:12.392 INFO:tasks.workunit.client.0.smithi037.stderr:bucket: error-at-do-reshard id: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.34 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:35:12.392 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:35:12.483 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bucket reshard --bucket error-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:35:12.515 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:35:12.515 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:35:12.554 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.553+0000 7fdf04ebb800 20 rados->read ofs=0 len=0 2024-09-12T17:35:12.556 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.555+0000 7fdf04ebb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:12.556 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.555+0000 7fdf04ebb800 20 realm 2024-09-12T17:35:12.556 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.555+0000 7fdf04ebb800 20 rados->read ofs=0 len=0 2024-09-12T17:35:12.556 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.555+0000 7fdf04ebb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:12.556 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.555+0000 7fdf04ebb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:35:12.556 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.555+0000 7fdf04ebb800 20 rados->read ofs=0 len=0 2024-09-12T17:35:12.556 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.555+0000 7fdf04ebb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:12.556 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.555+0000 7fdf04ebb800 20 rados->read ofs=0 len=0 2024-09-12T17:35:12.557 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.556+0000 7fdf04ebb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:35:12.557 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.556+0000 7fdf04ebb800 20 rados->read ofs=0 len=0 2024-09-12T17:35:12.557 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.556+0000 7fdf04ebb800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:35:12.557 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.556+0000 7fdf04ebb800 20 searching for the correct realm 2024-09-12T17:35:12.560 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.559+0000 7fdf021a4640 0 -- 172.21.15.37:0/2888823157 >> [v2:172.21.15.40:6800/2441293461,v1:172.21.15.40:6801/2441293461] conn(0x7fdef4027040 msgr2=0x7fdef4067410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:35:12.767 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.767+0000 7fdf029a5640 0 -- 172.21.15.37:0/2888823157 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7fdef809d900 msgr2=0x7fdef8064410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:35:12.976 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.975+0000 7fdf04ebb800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:35:12.976 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.975+0000 7fdf04ebb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:35:12.976 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.975+0000 7fdf04ebb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:35:12.977 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.975+0000 7fdf04ebb800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:35:12.977 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.975+0000 7fdf04ebb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:35:12.977 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.975+0000 7fdf04ebb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:35:12.977 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.975+0000 7fdf04ebb800 20 rados->read ofs=0 len=0 2024-09-12T17:35:12.977 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.975+0000 7fdf04ebb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:12.977 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.975+0000 7fdf04ebb800 20 rados->read ofs=0 len=0 2024-09-12T17:35:12.978 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.976+0000 7fdf04ebb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:35:12.978 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.976+0000 7fdf04ebb800 20 rados->read ofs=0 len=0 2024-09-12T17:35:12.978 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.976+0000 7fdf04ebb800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:35:12.978 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.976+0000 7fdf04ebb800 20 zone default found 2024-09-12T17:35:12.978 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.976+0000 7fdf04ebb800 4 Realm: () 2024-09-12T17:35:12.978 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.976+0000 7fdf04ebb800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:35:12.978 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.976+0000 7fdf04ebb800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:35:12.978 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.976+0000 7fdf04ebb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:35:12.978 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.976+0000 7fdf04ebb800 20 zonegroup default 2024-09-12T17:35:12.978 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.976+0000 7fdf04ebb800 20 rados->read ofs=0 len=0 2024-09-12T17:35:12.979 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.977+0000 7fdf04ebb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:12.979 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.977+0000 7fdf04ebb800 20 rados->read ofs=0 len=0 2024-09-12T17:35:12.979 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.977+0000 7fdf04ebb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:12.979 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.977+0000 7fdf04ebb800 20 rados->read ofs=0 len=0 2024-09-12T17:35:12.979 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.978+0000 7fdf04ebb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:12.979 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.978+0000 7fdf04ebb800 20 started sync module instance, tier type = 2024-09-12T17:35:12.979 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.978+0000 7fdf04ebb800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:35:12.990 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.989+0000 7fdf04ebb800 20 add_watcher() i=0 2024-09-12T17:35:12.990 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.989+0000 7fdf04ebb800 20 add_watcher() i=1 2024-09-12T17:35:12.990 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.989+0000 7fdf04ebb800 20 add_watcher() i=2 2024-09-12T17:35:12.990 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.989+0000 7fdf04ebb800 20 add_watcher() i=3 2024-09-12T17:35:12.990 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.989+0000 7fdf04ebb800 20 add_watcher() i=4 2024-09-12T17:35:12.990 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.989+0000 7fdf04ebb800 20 add_watcher() i=5 2024-09-12T17:35:12.990 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.989+0000 7fdf04ebb800 20 add_watcher() i=6 2024-09-12T17:35:12.990 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.990+0000 7fdf04ebb800 20 add_watcher() i=7 2024-09-12T17:35:12.991 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.990+0000 7fdf04ebb800 2 all 8 watchers are set, enabling cache 2024-09-12T17:35:12.992 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.992+0000 7fddb97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:35:12.993 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.992+0000 7fdf04ebb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:35:12.994 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.992+0000 7fdf04ebb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:35:12.994 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.992+0000 7fdf04ebb800 5 note: GC not initialized 2024-09-12T17:35:12.994 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.992+0000 7fdd33fff640 20 reqs_thread_entry: start 2024-09-12T17:35:12.994 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.992+0000 7fdf04ebb800 20 init_complete bucket index max shards: 11 2024-09-12T17:35:12.994 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.993+0000 7fdf04ebb800 20 Filter name: none 2024-09-12T17:35:12.994 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.993+0000 7fdd31ffb640 20 reqs_thread_entry: start 2024-09-12T17:35:12.994 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.993+0000 7fdf04ebb800 10 cache get: name=default.rgw.meta+root+error-at-do-reshard : miss 2024-09-12T17:35:12.994 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.993+0000 7fdf04ebb800 20 rados->read ofs=0 len=0 2024-09-12T17:35:12.995 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.993+0000 7fdf04ebb800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:35:12.995 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.993+0000 7fdf04ebb800 10 cache put: name=default.rgw.meta+root+error-at-do-reshard info.flags=0x11 2024-09-12T17:35:12.995 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.993+0000 7fdf04ebb800 10 adding default.rgw.meta+root+error-at-do-reshard to cache LRU end 2024-09-12T17:35:12.995 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.993+0000 7fdf04ebb800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.34 : miss 2024-09-12T17:35:12.995 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.993+0000 7fdf04ebb800 20 rados->read ofs=0 len=0 2024-09-12T17:35:12.995 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.994+0000 7fdf04ebb800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:35:12.995 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.994+0000 7fdf04ebb800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.34 info.flags=0x17 2024-09-12T17:35:12.995 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.994+0000 7fdf04ebb800 10 adding default.rgw.meta+root+.bucket.meta.error-at-do-reshard:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.34 to cache LRU end 2024-09-12T17:35:12.995 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.994+0000 7fdf04ebb800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:35:12.995 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.994+0000 7fdf04ebb800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:35:12.996 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:12.994+0000 7fdf04ebb800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.34 2024-09-12T17:35:13.001 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.001+0000 7fdf04ebb800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.34 info.flags=0x17 2024-09-12T17:35:13.002 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.001+0000 7fdf04ebb800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.34 to cache LRU end 2024-09-12T17:35:13.002 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.001+0000 7fdf04ebb800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:35:13.002 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.001+0000 7fdf04ebb800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.34, ofs0, ns] 2024-09-12T17:35:13.002 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.001+0000 7fdde67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497088 cookie 94635669375760 notifier 7040 bl.length()=995 2024-09-12T17:35:13.002 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.001+0000 7fdde67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.34 info.flags=0x17 2024-09-12T17:35:13.002 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.001+0000 7fdde67fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.34 to cache LRU end 2024-09-12T17:35:13.002 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.001+0000 7fdde67fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:35:13.004 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.003+0000 7fdf04ebb800 20 handle_bi_update(): bucket=:error-at-do-reshard[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.34]): orig_sources= new_sources= 2024-09-12T17:35:13.004 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.003+0000 7fdf04ebb800 20 handle_bi_update(): bucket=:error-at-do-reshard[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.34]): potential sources added=[] removed=[] 2024-09-12T17:35:13.004 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.003+0000 7fdf04ebb800 20 handle_bi_update(): bucket=:error-at-do-reshard[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.34]): orig_dests= new_dests= 2024-09-12T17:35:13.004 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.003+0000 7fdf04ebb800 20 handle_bi_update(): bucket=:error-at-do-reshard[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.34]): potential dests added=[] removed=[] 2024-09-12T17:35:13.010 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.009+0000 7fdf04ebb800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.34.1.0 2024-09-12T17:35:13.010 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.009+0000 7fdf04ebb800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.34.1.0 2024-09-12T17:35:13.010 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.009+0000 7fdf04ebb800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.34.1.1 2024-09-12T17:35:13.010 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.009+0000 7fdf04ebb800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.34.1.1 2024-09-12T17:35:13.010 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.009+0000 7fdf04ebb800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.34.1.2 2024-09-12T17:35:13.010 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.009+0000 7fdf04ebb800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.34.1.2 2024-09-12T17:35:13.010 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.009+0000 7fdf04ebb800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.34.1.3 2024-09-12T17:35:13.010 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.009+0000 7fdf04ebb800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.34.1.3 2024-09-12T17:35:13.010 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.009+0000 7fdf04ebb800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.34.1.4 2024-09-12T17:35:13.010 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.009+0000 7fdf04ebb800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.34.1.4 2024-09-12T17:35:13.010 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.009+0000 7fdf04ebb800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.34.1.5 2024-09-12T17:35:13.010 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.009+0000 7fdf04ebb800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.34.1.5 2024-09-12T17:35:13.011 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.009+0000 7fdf04ebb800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.34.1.6 2024-09-12T17:35:13.011 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.009+0000 7fdf04ebb800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.34.1.6 2024-09-12T17:35:13.011 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.009+0000 7fdf04ebb800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.34.1.7 2024-09-12T17:35:13.011 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.009+0000 7fdf04ebb800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.34.1.7 2024-09-12T17:35:13.011 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.009+0000 7fdf04ebb800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.34.1.8 2024-09-12T17:35:13.011 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.009+0000 7fdf04ebb800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.34.1.8 2024-09-12T17:35:13.011 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.009+0000 7fdf04ebb800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.34.1.9 2024-09-12T17:35:13.011 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.009+0000 7fdf04ebb800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.34.1.9 2024-09-12T17:35:13.011 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.009+0000 7fdf04ebb800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.34.1.10 2024-09-12T17:35:13.011 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.009+0000 7fdf04ebb800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.34.1.10 2024-09-12T17:35:13.011 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.009+0000 7fdf04ebb800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.34.1.11 2024-09-12T17:35:13.011 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.009+0000 7fdf04ebb800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.34.1.11 2024-09-12T17:35:13.011 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.009+0000 7fdf04ebb800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.34.0 2024-09-12T17:35:13.012 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.009+0000 7fdf04ebb800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.34.1 2024-09-12T17:35:13.012 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.010+0000 7fdf04ebb800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.34.2 2024-09-12T17:35:13.012 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.011+0000 7fdf04ebb800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.34.3 2024-09-12T17:35:13.012 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.011+0000 7fdf04ebb800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.34.4 2024-09-12T17:35:13.013 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.012+0000 7fdf04ebb800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.34.5 2024-09-12T17:35:13.013 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.012+0000 7fdf04ebb800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.34.6 2024-09-12T17:35:13.014 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.013+0000 7fdf04ebb800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.34.7 2024-09-12T17:35:13.015 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.014+0000 7fdf04ebb800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.34.8 2024-09-12T17:35:13.015 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.015+0000 7fdf04ebb800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.34.9 2024-09-12T17:35:13.016 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.015+0000 7fdf04ebb800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.34.10 2024-09-12T17:35:13.020 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.019+0000 7fdf04ebb800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.34 : hit (requested=0x17, cached=0x17) 2024-09-12T17:35:13.020 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.019+0000 7fdf04ebb800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.34 2024-09-12T17:35:13.021 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.021+0000 7fdf04ebb800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.34 info.flags=0x17 2024-09-12T17:35:13.021 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.021+0000 7fdf04ebb800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.34 to cache LRU end 2024-09-12T17:35:13.021 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.021+0000 7fdf04ebb800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:35:13.021 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.021+0000 7fdf04ebb800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.34, ofs0, ns] 2024-09-12T17:35:13.022 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.021+0000 7fdde67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497089 cookie 94635669375760 notifier 7040 bl.length()=995 2024-09-12T17:35:13.022 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.021+0000 7fdde67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.34 info.flags=0x17 2024-09-12T17:35:13.022 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.021+0000 7fdde67fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.34 to cache LRU end 2024-09-12T17:35:13.022 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.021+0000 7fdde67fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:35:13.023 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.023+0000 7fdf04ebb800 20 handle_bi_update(): bucket=:error-at-do-reshard[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.34]): orig_sources= new_sources= 2024-09-12T17:35:13.023 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.023+0000 7fdf04ebb800 20 handle_bi_update(): bucket=:error-at-do-reshard[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.34]): potential sources added=[] removed=[] 2024-09-12T17:35:13.023 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.023+0000 7fdf04ebb800 20 handle_bi_update(): bucket=:error-at-do-reshard[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.34]): orig_dests= new_dests= 2024-09-12T17:35:13.023 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.023+0000 7fdf04ebb800 20 handle_bi_update(): bucket=:error-at-do-reshard[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.34]): potential dests added=[] removed=[] 2024-09-12T17:35:13.026 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.025+0000 7fdf04ebb800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.34.0 2024-09-12T17:35:13.026 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.026+0000 7fdf04ebb800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.34.1 2024-09-12T17:35:13.027 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.026+0000 7fdf04ebb800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.34.2 2024-09-12T17:35:13.027 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.027+0000 7fdf04ebb800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.34.3 2024-09-12T17:35:13.028 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.027+0000 7fdf04ebb800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.34.4 2024-09-12T17:35:13.028 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.027+0000 7fdf04ebb800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.34.5 2024-09-12T17:35:13.028 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.028+0000 7fdf04ebb800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.34.6 2024-09-12T17:35:13.029 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.028+0000 7fdf04ebb800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.34.7 2024-09-12T17:35:13.029 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.029+0000 7fdf04ebb800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.34.8 2024-09-12T17:35:13.029 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.029+0000 7fdf04ebb800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.34.9 2024-09-12T17:35:13.030 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.029+0000 7fdf04ebb800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.34.10 2024-09-12T17:35:13.030 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.030+0000 7fdf04ebb800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.34 : hit (requested=0x17, cached=0x17) 2024-09-12T17:35:13.031 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.030+0000 7fdf04ebb800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.34 2024-09-12T17:35:13.032 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.031+0000 7fdf04ebb800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.34 info.flags=0x17 2024-09-12T17:35:13.032 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.031+0000 7fdf04ebb800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.34 to cache LRU end 2024-09-12T17:35:13.032 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.031+0000 7fdf04ebb800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:35:13.032 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.031+0000 7fdf04ebb800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.34, ofs0, ns] 2024-09-12T17:35:13.033 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.032+0000 7fdde67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497090 cookie 94635669375760 notifier 7040 bl.length()=963 2024-09-12T17:35:13.033 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.032+0000 7fdde67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.34 info.flags=0x17 2024-09-12T17:35:13.033 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.032+0000 7fdde67fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.34 to cache LRU end 2024-09-12T17:35:13.033 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.032+0000 7fdde67fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:35:13.034 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.034+0000 7fdf04ebb800 20 handle_bi_update(): bucket=:error-at-do-reshard[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.34]): orig_sources= new_sources= 2024-09-12T17:35:13.034 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.034+0000 7fdf04ebb800 20 handle_bi_update(): bucket=:error-at-do-reshard[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.34]): potential sources added=[] removed=[] 2024-09-12T17:35:13.035 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.034+0000 7fdf04ebb800 20 handle_bi_update(): bucket=:error-at-do-reshard[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.34]): orig_dests= new_dests= 2024-09-12T17:35:13.035 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.034+0000 7fdf04ebb800 20 handle_bi_update(): bucket=:error-at-do-reshard[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.34]): potential dests added=[] removed=[] 2024-09-12T17:35:13.038 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.037+0000 7fdf04ebb800 1 execute INFO: reshard of bucket "error-at-do-reshard" from 11 shards to 12 shards completed successfully 2024-09-12T17:35:13.040 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.039+0000 7fddb97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:35:13.042 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.042+0000 7fdf04ebb800 20 remove_watcher() i=0 2024-09-12T17:35:13.043 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.042+0000 7fdf04ebb800 2 removed watcher, disabling cache 2024-09-12T17:35:13.044 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.043+0000 7fdf04ebb800 20 remove_watcher() i=1 2024-09-12T17:35:13.045 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.044+0000 7fdf04ebb800 20 remove_watcher() i=2 2024-09-12T17:35:13.046 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.045+0000 7fdf04ebb800 20 remove_watcher() i=3 2024-09-12T17:35:13.047 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.046+0000 7fdf04ebb800 20 remove_watcher() i=4 2024-09-12T17:35:13.048 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.047+0000 7fdf04ebb800 20 remove_watcher() i=5 2024-09-12T17:35:13.049 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.048+0000 7fdf04ebb800 20 remove_watcher() i=6 2024-09-12T17:35:13.050 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.050+0000 7fdf04ebb800 20 remove_watcher() i=7 2024-09-12T17:35:13.064 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-09-12T17:35:13.094 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:35:13.094 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:35:13.134 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.133+0000 7f20168bb800 20 rados->read ofs=0 len=0 2024-09-12T17:35:13.136 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.135+0000 7f20168bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:13.136 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.135+0000 7f20168bb800 20 realm 2024-09-12T17:35:13.136 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.135+0000 7f20168bb800 20 rados->read ofs=0 len=0 2024-09-12T17:35:13.136 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.135+0000 7f20168bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:13.137 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.135+0000 7f20168bb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:35:13.137 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.135+0000 7f20168bb800 20 rados->read ofs=0 len=0 2024-09-12T17:35:13.137 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.135+0000 7f20168bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:13.137 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.135+0000 7f20168bb800 20 rados->read ofs=0 len=0 2024-09-12T17:35:13.137 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.136+0000 7f20168bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:35:13.137 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.136+0000 7f20168bb800 20 rados->read ofs=0 len=0 2024-09-12T17:35:13.138 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.136+0000 7f20168bb800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:35:13.138 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.136+0000 7f20168bb800 20 searching for the correct realm 2024-09-12T17:35:13.140 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.140+0000 7f2014ba6640 0 -- 172.21.15.37:0/3934874070 >> [v2:172.21.15.40:6818/1210108009,v1:172.21.15.40:6819/1210108009] conn(0x7f200807a030 msgr2=0x7f20080aadf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:35:13.144 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.143+0000 7f20143a5640 0 -- 172.21.15.37:0/3934874070 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7f200807ab60 msgr2=0x7f20080c1370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:35:13.351 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.350+0000 7f20168bb800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:35:13.352 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.350+0000 7f20168bb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:35:13.352 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.350+0000 7f20168bb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:35:13.352 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.350+0000 7f20168bb800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:35:13.352 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.350+0000 7f20168bb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:35:13.352 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.350+0000 7f20168bb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:35:13.352 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.350+0000 7f20168bb800 20 rados->read ofs=0 len=0 2024-09-12T17:35:13.352 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.351+0000 7f20168bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:13.352 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.351+0000 7f20168bb800 20 rados->read ofs=0 len=0 2024-09-12T17:35:13.353 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.351+0000 7f20168bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:35:13.354 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.351+0000 7f20168bb800 20 rados->read ofs=0 len=0 2024-09-12T17:35:13.354 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.352+0000 7f20168bb800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:35:13.354 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.352+0000 7f20168bb800 20 zone default found 2024-09-12T17:35:13.354 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.352+0000 7f20168bb800 4 Realm: () 2024-09-12T17:35:13.354 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.352+0000 7f20168bb800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:35:13.354 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.352+0000 7f20168bb800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:35:13.354 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.352+0000 7f20168bb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:35:13.354 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.352+0000 7f20168bb800 20 zonegroup default 2024-09-12T17:35:13.354 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.352+0000 7f20168bb800 20 rados->read ofs=0 len=0 2024-09-12T17:35:13.354 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.352+0000 7f20168bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:13.354 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.352+0000 7f20168bb800 20 rados->read ofs=0 len=0 2024-09-12T17:35:13.354 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.352+0000 7f20168bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:13.355 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.352+0000 7f20168bb800 20 rados->read ofs=0 len=0 2024-09-12T17:35:13.355 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.353+0000 7f20168bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:13.355 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.353+0000 7f20168bb800 20 started sync module instance, tier type = 2024-09-12T17:35:13.355 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.353+0000 7f20168bb800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:35:13.364 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.363+0000 7f20168bb800 20 add_watcher() i=0 2024-09-12T17:35:13.364 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.363+0000 7f20168bb800 20 add_watcher() i=1 2024-09-12T17:35:13.364 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.363+0000 7f20168bb800 20 add_watcher() i=2 2024-09-12T17:35:13.365 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.363+0000 7f20168bb800 20 add_watcher() i=3 2024-09-12T17:35:13.365 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.363+0000 7f20168bb800 20 add_watcher() i=4 2024-09-12T17:35:13.365 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.363+0000 7f20168bb800 20 add_watcher() i=5 2024-09-12T17:35:13.365 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.363+0000 7f20168bb800 20 add_watcher() i=6 2024-09-12T17:35:13.366 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.365+0000 7f20168bb800 20 add_watcher() i=7 2024-09-12T17:35:13.366 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.365+0000 7f20168bb800 2 all 8 watchers are set, enabling cache 2024-09-12T17:35:13.368 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.368+0000 7f1ecafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:35:13.369 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.368+0000 7f20168bb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:35:13.370 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.368+0000 7f20168bb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:35:13.370 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.368+0000 7f20168bb800 5 note: GC not initialized 2024-09-12T17:35:13.370 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.368+0000 7f1ec9fdb640 20 reqs_thread_entry: start 2024-09-12T17:35:13.370 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.368+0000 7f20168bb800 20 init_complete bucket index max shards: 11 2024-09-12T17:35:13.370 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.368+0000 7f20168bb800 20 Filter name: none 2024-09-12T17:35:13.370 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.369+0000 7f1e3b7fe640 20 reqs_thread_entry: start 2024-09-12T17:35:13.370 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.369+0000 7f20168bb800 20 rados->read ofs=0 len=0 2024-09-12T17:35:13.370 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.369+0000 7f20168bb800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:35:13.370 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.369+0000 7f20168bb800 20 rados->read ofs=0 len=0 2024-09-12T17:35:13.371 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.370+0000 7f20168bb800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:35:13.371 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.370+0000 7f20168bb800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:35:13.371 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.370+0000 7f20168bb800 20 rados->read ofs=0 len=0 2024-09-12T17:35:13.371 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.370+0000 7f20168bb800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:35:13.371 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.370+0000 7f20168bb800 20 rados->read ofs=0 len=0 2024-09-12T17:35:13.372 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.371+0000 7f20168bb800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:35:13.372 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.371+0000 7f20168bb800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:35:13.374 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.373+0000 7f1ecafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:35:13.376 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.376+0000 7f20168bb800 20 remove_watcher() i=0 2024-09-12T17:35:13.376 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.376+0000 7f20168bb800 2 removed watcher, disabling cache 2024-09-12T17:35:13.377 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.377+0000 7f20168bb800 20 remove_watcher() i=1 2024-09-12T17:35:13.379 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.379+0000 7f20168bb800 20 remove_watcher() i=2 2024-09-12T17:35:13.380 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.380+0000 7f20168bb800 20 remove_watcher() i=3 2024-09-12T17:35:13.382 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.381+0000 7f20168bb800 20 remove_watcher() i=4 2024-09-12T17:35:13.383 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.382+0000 7f20168bb800 20 remove_watcher() i=5 2024-09-12T17:35:13.384 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.383+0000 7f20168bb800 20 remove_watcher() i=6 2024-09-12T17:35:13.385 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:13.384+0000 7f20168bb800 20 remove_watcher() i=7 2024-09-12T17:35:13.396 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:35:13.396 INFO:tasks.workunit.client.0.smithi037.stderr:BUCKET_STATS: 2024-09-12T17:35:13.397 INFO:tasks.workunit.client.0.smithi037.stderr:bucket: error-at-do-reshard id: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.34 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T17:35:13.397 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:35:13.745 INFO:tasks.workunit.client.0.smithi037.stderr:TEST: reshard bucket with abort at do_reshard 2024-09-12T17:35:13.745 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:35:14.533 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-09-12T17:35:14.565 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:35:14.565 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:35:14.604 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:14.603+0000 7ff84b526800 20 rados->read ofs=0 len=0 2024-09-12T17:35:14.606 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:14.605+0000 7ff84b526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:14.606 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:14.605+0000 7ff84b526800 20 realm 2024-09-12T17:35:14.606 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:14.605+0000 7ff84b526800 20 rados->read ofs=0 len=0 2024-09-12T17:35:14.606 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:14.605+0000 7ff84b526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:14.607 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:14.605+0000 7ff84b526800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:35:14.607 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:14.605+0000 7ff84b526800 20 rados->read ofs=0 len=0 2024-09-12T17:35:14.607 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:14.605+0000 7ff84b526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:14.607 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:14.605+0000 7ff84b526800 20 rados->read ofs=0 len=0 2024-09-12T17:35:14.608 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:14.606+0000 7ff84b526800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:35:14.608 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:14.606+0000 7ff84b526800 20 rados->read ofs=0 len=0 2024-09-12T17:35:14.608 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:14.607+0000 7ff84b526800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:35:14.608 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:14.607+0000 7ff84b526800 20 searching for the correct realm 2024-09-12T17:35:14.610 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:14.610+0000 7ff846908640 0 -- 172.21.15.37:0/640791749 >> [v2:172.21.15.40:6800/2441293461,v1:172.21.15.40:6801/2441293461] conn(0x7ff838027040 msgr2=0x7ff838090a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:35:14.615 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:14.614+0000 7ff847109640 0 -- 172.21.15.37:0/640791749 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7ff83c098930 msgr2=0x7ff83c088430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:35:14.822 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:14.821+0000 7ff84b526800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:35:14.822 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:14.821+0000 7ff84b526800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:35:14.822 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:14.821+0000 7ff84b526800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:35:14.822 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:14.821+0000 7ff84b526800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:35:14.822 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:14.821+0000 7ff84b526800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:35:14.822 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:14.821+0000 7ff84b526800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:35:14.822 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:14.821+0000 7ff84b526800 20 rados->read ofs=0 len=0 2024-09-12T17:35:14.822 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:14.821+0000 7ff84b526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:14.823 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:14.821+0000 7ff84b526800 20 rados->read ofs=0 len=0 2024-09-12T17:35:14.824 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:14.821+0000 7ff84b526800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:35:14.824 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:14.821+0000 7ff84b526800 20 rados->read ofs=0 len=0 2024-09-12T17:35:14.824 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:14.822+0000 7ff84b526800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:35:14.824 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:14.822+0000 7ff84b526800 20 zone default found 2024-09-12T17:35:14.825 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:14.822+0000 7ff84b526800 4 Realm: () 2024-09-12T17:35:14.825 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:14.822+0000 7ff84b526800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:35:14.825 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:14.822+0000 7ff84b526800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:35:14.825 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:14.822+0000 7ff84b526800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:35:14.825 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:14.822+0000 7ff84b526800 20 zonegroup default 2024-09-12T17:35:14.825 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:14.822+0000 7ff84b526800 20 rados->read ofs=0 len=0 2024-09-12T17:35:14.825 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:14.822+0000 7ff84b526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:14.825 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:14.822+0000 7ff84b526800 20 rados->read ofs=0 len=0 2024-09-12T17:35:14.825 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:14.822+0000 7ff84b526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:14.825 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:14.822+0000 7ff84b526800 20 rados->read ofs=0 len=0 2024-09-12T17:35:14.826 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:14.823+0000 7ff84b526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:14.826 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:14.823+0000 7ff84b526800 20 started sync module instance, tier type = 2024-09-12T17:35:14.826 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:14.823+0000 7ff84b526800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:35:14.835 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:14.834+0000 7ff84b526800 20 add_watcher() i=0 2024-09-12T17:35:14.835 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:14.834+0000 7ff84b526800 20 add_watcher() i=1 2024-09-12T17:35:14.835 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:14.834+0000 7ff84b526800 20 add_watcher() i=2 2024-09-12T17:35:14.835 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:14.834+0000 7ff84b526800 20 add_watcher() i=3 2024-09-12T17:35:14.835 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:14.834+0000 7ff84b526800 20 add_watcher() i=4 2024-09-12T17:35:14.836 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:14.834+0000 7ff84b526800 20 add_watcher() i=5 2024-09-12T17:35:14.836 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:14.834+0000 7ff84b526800 20 add_watcher() i=6 2024-09-12T17:35:14.836 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:14.835+0000 7ff84b526800 20 add_watcher() i=7 2024-09-12T17:35:14.836 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:14.835+0000 7ff84b526800 2 all 8 watchers are set, enabling cache 2024-09-12T17:35:14.838 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:14.837+0000 7ff6fdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:35:14.838 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:14.837+0000 7ff84b526800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:35:14.838 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:14.837+0000 7ff84b526800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:35:14.838 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:14.837+0000 7ff84b526800 5 note: GC not initialized 2024-09-12T17:35:14.839 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:14.838+0000 7ff6fcfe1640 20 reqs_thread_entry: start 2024-09-12T17:35:14.839 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:14.838+0000 7ff84b526800 20 init_complete bucket index max shards: 11 2024-09-12T17:35:14.839 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:14.838+0000 7ff84b526800 20 Filter name: none 2024-09-12T17:35:14.839 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:14.838+0000 7ff6767fc640 20 reqs_thread_entry: start 2024-09-12T17:35:14.839 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:14.838+0000 7ff84b526800 20 rados->read ofs=0 len=0 2024-09-12T17:35:14.840 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:14.839+0000 7ff84b526800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:35:14.840 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:14.839+0000 7ff84b526800 20 rados->read ofs=0 len=0 2024-09-12T17:35:14.840 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:14.839+0000 7ff84b526800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:35:14.841 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:14.839+0000 7ff84b526800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:35:14.841 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:14.839+0000 7ff84b526800 20 rados->read ofs=0 len=0 2024-09-12T17:35:14.841 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:14.840+0000 7ff84b526800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:35:14.841 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:14.840+0000 7ff84b526800 20 rados->read ofs=0 len=0 2024-09-12T17:35:14.842 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:14.840+0000 7ff84b526800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:35:14.842 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:14.840+0000 7ff84b526800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:35:14.843 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:14.842+0000 7ff6fdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:35:14.847 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:14.846+0000 7ff84b526800 20 remove_watcher() i=0 2024-09-12T17:35:14.847 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:14.846+0000 7ff84b526800 2 removed watcher, disabling cache 2024-09-12T17:35:14.848 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:14.848+0000 7ff84b526800 20 remove_watcher() i=1 2024-09-12T17:35:14.850 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:14.849+0000 7ff84b526800 20 remove_watcher() i=2 2024-09-12T17:35:14.851 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:14.850+0000 7ff84b526800 20 remove_watcher() i=3 2024-09-12T17:35:14.853 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:14.853+0000 7ff84b526800 20 remove_watcher() i=4 2024-09-12T17:35:14.855 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:14.854+0000 7ff84b526800 20 remove_watcher() i=5 2024-09-12T17:35:14.856 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:14.855+0000 7ff84b526800 20 remove_watcher() i=6 2024-09-12T17:35:14.857 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:14.856+0000 7ff84b526800 20 remove_watcher() i=7 2024-09-12T17:35:14.868 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:35:14.869 INFO:tasks.workunit.client.0.smithi037.stderr:BUCKET_STATS: 2024-09-12T17:35:14.869 INFO:tasks.workunit.client.0.smithi037.stderr:bucket: abort-at-do-reshard id: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.35 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:35:14.869 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:35:14.870 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at do_reshard 2024-09-12T17:35:14.905 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:35:14.905 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:35:14.945 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:14.944+0000 7fe38d12c800 20 rados->read ofs=0 len=0 2024-09-12T17:35:14.947 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:14.946+0000 7fe38d12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:14.947 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:14.946+0000 7fe38d12c800 20 realm 2024-09-12T17:35:14.947 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:14.946+0000 7fe38d12c800 20 rados->read ofs=0 len=0 2024-09-12T17:35:14.947 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:14.946+0000 7fe38d12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:14.947 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:14.946+0000 7fe38d12c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:35:14.947 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:14.946+0000 7fe38d12c800 20 rados->read ofs=0 len=0 2024-09-12T17:35:14.947 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:14.946+0000 7fe38d12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:14.947 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:14.946+0000 7fe38d12c800 20 rados->read ofs=0 len=0 2024-09-12T17:35:14.948 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:14.947+0000 7fe38d12c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:35:14.948 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:14.947+0000 7fe38d12c800 20 rados->read ofs=0 len=0 2024-09-12T17:35:14.948 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:14.947+0000 7fe38d12c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:35:14.948 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:14.947+0000 7fe38d12c800 20 searching for the correct realm 2024-09-12T17:35:14.950 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:14.949+0000 7fe388e4f640 0 -- 172.21.15.37:0/976055060 >> [v2:172.21.15.37:6800/1206746176,v1:172.21.15.37:6801/1206746176] conn(0x7fe380012970 msgr2=0x7fe380010440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:35:15.155 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.154+0000 7fe389650640 0 -- 172.21.15.37:0/976055060 >> [v2:172.21.15.40:6818/1210108009,v1:172.21.15.40:6819/1210108009] conn(0x7fe37c0480f0 msgr2=0x7fe37c055ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:35:15.162 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.161+0000 7fe38d12c800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:35:15.162 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.161+0000 7fe38d12c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:35:15.162 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.161+0000 7fe38d12c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:35:15.162 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.161+0000 7fe38d12c800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:35:15.162 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.161+0000 7fe38d12c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:35:15.162 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.161+0000 7fe38d12c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:35:15.162 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.161+0000 7fe38d12c800 20 rados->read ofs=0 len=0 2024-09-12T17:35:15.162 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.161+0000 7fe38d12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:15.162 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.161+0000 7fe38d12c800 20 rados->read ofs=0 len=0 2024-09-12T17:35:15.163 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.162+0000 7fe38d12c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:35:15.163 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.162+0000 7fe38d12c800 20 rados->read ofs=0 len=0 2024-09-12T17:35:15.163 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.162+0000 7fe38d12c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:35:15.163 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.162+0000 7fe38d12c800 20 zone default found 2024-09-12T17:35:15.163 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.162+0000 7fe38d12c800 4 Realm: () 2024-09-12T17:35:15.164 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.162+0000 7fe38d12c800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:35:15.164 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.162+0000 7fe38d12c800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:35:15.164 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.162+0000 7fe38d12c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:35:15.164 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.162+0000 7fe38d12c800 20 zonegroup default 2024-09-12T17:35:15.164 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.162+0000 7fe38d12c800 20 rados->read ofs=0 len=0 2024-09-12T17:35:15.164 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.162+0000 7fe38d12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:15.164 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.162+0000 7fe38d12c800 20 rados->read ofs=0 len=0 2024-09-12T17:35:15.164 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.163+0000 7fe38d12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:15.165 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.163+0000 7fe38d12c800 20 rados->read ofs=0 len=0 2024-09-12T17:35:15.165 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.163+0000 7fe38d12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:15.165 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.163+0000 7fe38d12c800 20 started sync module instance, tier type = 2024-09-12T17:35:15.165 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.163+0000 7fe38d12c800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:35:15.175 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.174+0000 7fe38d12c800 20 add_watcher() i=0 2024-09-12T17:35:15.175 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.174+0000 7fe38d12c800 20 add_watcher() i=1 2024-09-12T17:35:15.175 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.174+0000 7fe38d12c800 20 add_watcher() i=2 2024-09-12T17:35:15.175 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.174+0000 7fe38d12c800 20 add_watcher() i=3 2024-09-12T17:35:15.175 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.174+0000 7fe38d12c800 20 add_watcher() i=4 2024-09-12T17:35:15.176 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.174+0000 7fe38d12c800 20 add_watcher() i=5 2024-09-12T17:35:15.176 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.174+0000 7fe38d12c800 20 add_watcher() i=6 2024-09-12T17:35:15.176 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.175+0000 7fe38d12c800 20 add_watcher() i=7 2024-09-12T17:35:15.176 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.176+0000 7fe38d12c800 2 all 8 watchers are set, enabling cache 2024-09-12T17:35:15.178 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.177+0000 7fe23efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:35:15.179 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.178+0000 7fe38d12c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:35:15.179 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.178+0000 7fe38d12c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:35:15.179 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.178+0000 7fe38d12c800 5 note: GC not initialized 2024-09-12T17:35:15.179 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.178+0000 7fe23dfe3640 20 reqs_thread_entry: start 2024-09-12T17:35:15.179 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.178+0000 7fe38d12c800 20 init_complete bucket index max shards: 11 2024-09-12T17:35:15.179 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.178+0000 7fe38d12c800 20 Filter name: none 2024-09-12T17:35:15.180 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.178+0000 7fe1af7fe640 20 reqs_thread_entry: start 2024-09-12T17:35:15.180 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.178+0000 7fe38d12c800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-12T17:35:15.180 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.178+0000 7fe38d12c800 20 rados->read ofs=0 len=0 2024-09-12T17:35:15.180 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.179+0000 7fe38d12c800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:35:15.181 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.179+0000 7fe38d12c800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-12T17:35:15.181 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.179+0000 7fe38d12c800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-12T17:35:15.181 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.179+0000 7fe38d12c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.35 : miss 2024-09-12T17:35:15.181 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.179+0000 7fe38d12c800 20 rados->read ofs=0 len=0 2024-09-12T17:35:15.181 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.180+0000 7fe38d12c800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:35:15.181 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.180+0000 7fe38d12c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.35 info.flags=0x17 2024-09-12T17:35:15.181 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.180+0000 7fe38d12c800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.35 to cache LRU end 2024-09-12T17:35:15.181 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.180+0000 7fe38d12c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:35:15.181 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.180+0000 7fe38d12c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:35:15.181 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.180+0000 7fe38d12c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.35 2024-09-12T17:35:15.187 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.186+0000 7fe38d12c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.35 info.flags=0x17 2024-09-12T17:35:15.187 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.186+0000 7fe38d12c800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.35 to cache LRU end 2024-09-12T17:35:15.187 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.186+0000 7fe38d12c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:35:15.187 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.186+0000 7fe38d12c800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.35, ofs0, ns] 2024-09-12T17:35:15.188 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.187+0000 7fe25f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496983 cookie 94815905296992 notifier 7569 bl.length()=995 2024-09-12T17:35:15.188 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.187+0000 7fe25f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.35 info.flags=0x17 2024-09-12T17:35:15.188 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.187+0000 7fe25f7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.35 to cache LRU end 2024-09-12T17:35:15.188 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.187+0000 7fe25f7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:35:15.189 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.188+0000 7fe38d12c800 20 handle_bi_update(): bucket=:abort-at-do-reshard[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.35]): orig_sources= new_sources= 2024-09-12T17:35:15.189 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.188+0000 7fe38d12c800 20 handle_bi_update(): bucket=:abort-at-do-reshard[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.35]): potential sources added=[] removed=[] 2024-09-12T17:35:15.189 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.188+0000 7fe38d12c800 20 handle_bi_update(): bucket=:abort-at-do-reshard[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.35]): orig_dests= new_dests= 2024-09-12T17:35:15.189 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.188+0000 7fe38d12c800 20 handle_bi_update(): bucket=:abort-at-do-reshard[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.35]): potential dests added=[] removed=[] 2024-09-12T17:35:15.195 INFO:tasks.workunit.client.0.smithi037.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fe38d12c800 time 2024-09-12T17:35:15.194817+0000 2024-09-12T17:35:15.195 INFO:tasks.workunit.client.0.smithi037.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:35:15.195 INFO:tasks.workunit.client.0.smithi037.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:35:15.195 INFO:tasks.workunit.client.0.smithi037.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fe38e98c71a] 2024-09-12T17:35:15.195 INFO:tasks.workunit.client.0.smithi037.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fe38e98c8d8] 2024-09-12T17:35:15.196 INFO:tasks.workunit.client.0.smithi037.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x563c0a84a841] 2024-09-12T17:35:15.196 INFO:tasks.workunit.client.0.smithi037.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x563c0a85a57a] 2024-09-12T17:35:15.196 INFO:tasks.workunit.client.0.smithi037.stderr: 5: main() 2024-09-12T17:35:15.196 INFO:tasks.workunit.client.0.smithi037.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7fe38d629590] 2024-09-12T17:35:15.196 INFO:tasks.workunit.client.0.smithi037.stderr: 7: __libc_start_main() 2024-09-12T17:35:15.196 INFO:tasks.workunit.client.0.smithi037.stderr: 8: _start() 2024-09-12T17:35:15.196 INFO:tasks.workunit.client.0.smithi037.stderr:*** Caught signal (Aborted) ** 2024-09-12T17:35:15.196 INFO:tasks.workunit.client.0.smithi037.stderr: in thread 7fe38d12c800 thread_name:radosgw-admin 2024-09-12T17:35:15.196 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.194+0000 7fe38d12c800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fe38d12c800 time 2024-09-12T17:35:15.194817+0000 2024-09-12T17:35:15.196 INFO:tasks.workunit.client.0.smithi037.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:35:15.196 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:35:15.196 INFO:tasks.workunit.client.0.smithi037.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:35:15.197 INFO:tasks.workunit.client.0.smithi037.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fe38e98c71a] 2024-09-12T17:35:15.197 INFO:tasks.workunit.client.0.smithi037.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fe38e98c8d8] 2024-09-12T17:35:15.197 INFO:tasks.workunit.client.0.smithi037.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x563c0a84a841] 2024-09-12T17:35:15.197 INFO:tasks.workunit.client.0.smithi037.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x563c0a85a57a] 2024-09-12T17:35:15.197 INFO:tasks.workunit.client.0.smithi037.stderr: 5: main() 2024-09-12T17:35:15.197 INFO:tasks.workunit.client.0.smithi037.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7fe38d629590] 2024-09-12T17:35:15.197 INFO:tasks.workunit.client.0.smithi037.stderr: 7: __libc_start_main() 2024-09-12T17:35:15.197 INFO:tasks.workunit.client.0.smithi037.stderr: 8: _start() 2024-09-12T17:35:15.197 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:35:15.217 INFO:tasks.workunit.client.0.smithi037.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:35:15.217 INFO:tasks.workunit.client.0.smithi037.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fe38d63e6f0] 2024-09-12T17:35:15.217 INFO:tasks.workunit.client.0.smithi037.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fe38d68b99c] 2024-09-12T17:35:15.217 INFO:tasks.workunit.client.0.smithi037.stderr: 3: raise() 2024-09-12T17:35:15.218 INFO:tasks.workunit.client.0.smithi037.stderr: 4: abort() 2024-09-12T17:35:15.218 INFO:tasks.workunit.client.0.smithi037.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fe38e98c774] 2024-09-12T17:35:15.218 INFO:tasks.workunit.client.0.smithi037.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fe38e98c8d8] 2024-09-12T17:35:15.218 INFO:tasks.workunit.client.0.smithi037.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x563c0a84a841] 2024-09-12T17:35:15.218 INFO:tasks.workunit.client.0.smithi037.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x563c0a85a57a] 2024-09-12T17:35:15.218 INFO:tasks.workunit.client.0.smithi037.stderr: 9: main() 2024-09-12T17:35:15.218 INFO:tasks.workunit.client.0.smithi037.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7fe38d629590] 2024-09-12T17:35:15.218 INFO:tasks.workunit.client.0.smithi037.stderr: 11: __libc_start_main() 2024-09-12T17:35:15.218 INFO:tasks.workunit.client.0.smithi037.stderr: 12: _start() 2024-09-12T17:35:15.218 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.195+0000 7fe38d12c800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:35:15.218 INFO:tasks.workunit.client.0.smithi037.stderr: in thread 7fe38d12c800 thread_name:radosgw-admin 2024-09-12T17:35:15.218 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:35:15.218 INFO:tasks.workunit.client.0.smithi037.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:35:15.218 INFO:tasks.workunit.client.0.smithi037.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fe38d63e6f0] 2024-09-12T17:35:15.219 INFO:tasks.workunit.client.0.smithi037.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fe38d68b99c] 2024-09-12T17:35:15.219 INFO:tasks.workunit.client.0.smithi037.stderr: 3: raise() 2024-09-12T17:35:15.219 INFO:tasks.workunit.client.0.smithi037.stderr: 4: abort() 2024-09-12T17:35:15.219 INFO:tasks.workunit.client.0.smithi037.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fe38e98c774] 2024-09-12T17:35:15.219 INFO:tasks.workunit.client.0.smithi037.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fe38e98c8d8] 2024-09-12T17:35:15.219 INFO:tasks.workunit.client.0.smithi037.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x563c0a84a841] 2024-09-12T17:35:15.219 INFO:tasks.workunit.client.0.smithi037.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x563c0a85a57a] 2024-09-12T17:35:15.219 INFO:tasks.workunit.client.0.smithi037.stderr: 9: main() 2024-09-12T17:35:15.219 INFO:tasks.workunit.client.0.smithi037.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7fe38d629590] 2024-09-12T17:35:15.219 INFO:tasks.workunit.client.0.smithi037.stderr: 11: __libc_start_main() 2024-09-12T17:35:15.219 INFO:tasks.workunit.client.0.smithi037.stderr: 12: _start() 2024-09-12T17:35:15.219 INFO:tasks.workunit.client.0.smithi037.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:35:15.219 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:35:15.220 INFO:tasks.workunit.client.0.smithi037.stderr:--- begin dump of recent events --- 2024-09-12T17:35:15.220 INFO:tasks.workunit.client.0.smithi037.stderr: -499> 2024-09-12T17:35:14.927+0000 7fe38d12c800 5 AuthRegistry(0x563c0c4b8ee0) adding auth protocol: cephx 2024-09-12T17:35:15.220 INFO:tasks.workunit.client.0.smithi037.stderr: -498> 2024-09-12T17:35:14.927+0000 7fe38d12c800 5 AuthRegistry(0x563c0c4b8ee0) adding auth protocol: cephx 2024-09-12T17:35:15.220 INFO:tasks.workunit.client.0.smithi037.stderr: -497> 2024-09-12T17:35:14.927+0000 7fe38d12c800 5 AuthRegistry(0x563c0c4b8ee0) adding auth protocol: cephx 2024-09-12T17:35:15.220 INFO:tasks.workunit.client.0.smithi037.stderr: -496> 2024-09-12T17:35:14.927+0000 7fe38d12c800 5 AuthRegistry(0x563c0c4b8ee0) adding con mode: secure 2024-09-12T17:35:15.220 INFO:tasks.workunit.client.0.smithi037.stderr: -495> 2024-09-12T17:35:14.927+0000 7fe38d12c800 5 AuthRegistry(0x563c0c4b8ee0) adding con mode: crc 2024-09-12T17:35:15.220 INFO:tasks.workunit.client.0.smithi037.stderr: -494> 2024-09-12T17:35:14.927+0000 7fe38d12c800 5 AuthRegistry(0x563c0c4b8ee0) adding con mode: secure 2024-09-12T17:35:15.220 INFO:tasks.workunit.client.0.smithi037.stderr: -493> 2024-09-12T17:35:14.927+0000 7fe38d12c800 5 AuthRegistry(0x563c0c4b8ee0) adding con mode: crc 2024-09-12T17:35:15.220 INFO:tasks.workunit.client.0.smithi037.stderr: -492> 2024-09-12T17:35:14.927+0000 7fe38d12c800 5 AuthRegistry(0x563c0c4b8ee0) adding con mode: secure 2024-09-12T17:35:15.220 INFO:tasks.workunit.client.0.smithi037.stderr: -491> 2024-09-12T17:35:14.927+0000 7fe38d12c800 5 AuthRegistry(0x563c0c4b8ee0) adding con mode: crc 2024-09-12T17:35:15.220 INFO:tasks.workunit.client.0.smithi037.stderr: -490> 2024-09-12T17:35:14.927+0000 7fe38d12c800 5 AuthRegistry(0x563c0c4b8ee0) adding con mode: crc 2024-09-12T17:35:15.220 INFO:tasks.workunit.client.0.smithi037.stderr: -489> 2024-09-12T17:35:14.927+0000 7fe38d12c800 5 AuthRegistry(0x563c0c4b8ee0) adding con mode: secure 2024-09-12T17:35:15.220 INFO:tasks.workunit.client.0.smithi037.stderr: -488> 2024-09-12T17:35:14.927+0000 7fe38d12c800 5 AuthRegistry(0x563c0c4b8ee0) adding con mode: crc 2024-09-12T17:35:15.221 INFO:tasks.workunit.client.0.smithi037.stderr: -487> 2024-09-12T17:35:14.927+0000 7fe38d12c800 5 AuthRegistry(0x563c0c4b8ee0) adding con mode: secure 2024-09-12T17:35:15.221 INFO:tasks.workunit.client.0.smithi037.stderr: -486> 2024-09-12T17:35:14.927+0000 7fe38d12c800 5 AuthRegistry(0x563c0c4b8ee0) adding con mode: crc 2024-09-12T17:35:15.221 INFO:tasks.workunit.client.0.smithi037.stderr: -485> 2024-09-12T17:35:14.927+0000 7fe38d12c800 5 AuthRegistry(0x563c0c4b8ee0) adding con mode: secure 2024-09-12T17:35:15.221 INFO:tasks.workunit.client.0.smithi037.stderr: -484> 2024-09-12T17:35:14.927+0000 7fe38d12c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:35:15.221 INFO:tasks.workunit.client.0.smithi037.stderr: -483> 2024-09-12T17:35:14.928+0000 7fe38d12c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:35:15.221 INFO:tasks.workunit.client.0.smithi037.stderr: -482> 2024-09-12T17:35:14.928+0000 7fe38d12c800 5 asok(0x563c0c296730) register_command rotate-key hook 0x563c0c4b9028 2024-09-12T17:35:15.221 INFO:tasks.workunit.client.0.smithi037.stderr: -481> 2024-09-12T17:35:14.928+0000 7fe38d12c800 10 monclient: _reopen_session rank -1 2024-09-12T17:35:15.221 INFO:tasks.workunit.client.0.smithi037.stderr: -480> 2024-09-12T17:35:14.928+0000 7fe38d12c800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T17:35:15.221 INFO:tasks.workunit.client.0.smithi037.stderr: -479> 2024-09-12T17:35:14.928+0000 7fe38d12c800 10 monclient(hunting): picked mon.noname-c con 0x563c0c3fad80 addr [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] 2024-09-12T17:35:15.221 INFO:tasks.workunit.client.0.smithi037.stderr: -478> 2024-09-12T17:35:14.928+0000 7fe38d12c800 10 monclient(hunting): picked mon.noname-a con 0x563c0c3fd9c0 addr [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] 2024-09-12T17:35:15.221 INFO:tasks.workunit.client.0.smithi037.stderr: -477> 2024-09-12T17:35:14.928+0000 7fe38d12c800 10 monclient(hunting): picked mon.noname-b con 0x563c0c400ee0 addr [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] 2024-09-12T17:35:15.221 INFO:tasks.workunit.client.0.smithi037.stderr: -476> 2024-09-12T17:35:14.928+0000 7fe38d12c800 10 monclient(hunting): start opening mon connection 2024-09-12T17:35:15.221 INFO:tasks.workunit.client.0.smithi037.stderr: -475> 2024-09-12T17:35:14.928+0000 7fe38d12c800 10 monclient(hunting): start opening mon connection 2024-09-12T17:35:15.221 INFO:tasks.workunit.client.0.smithi037.stderr: -474> 2024-09-12T17:35:14.928+0000 7fe38d12c800 10 monclient(hunting): start opening mon connection 2024-09-12T17:35:15.222 INFO:tasks.workunit.client.0.smithi037.stderr: -473> 2024-09-12T17:35:14.928+0000 7fe38d12c800 10 monclient(hunting): _renew_subs 2024-09-12T17:35:15.222 INFO:tasks.workunit.client.0.smithi037.stderr: -472> 2024-09-12T17:35:14.928+0000 7fe38d12c800 10 monclient(hunting): authenticate will time out at 2302.525194s 2024-09-12T17:35:15.222 INFO:tasks.workunit.client.0.smithi037.stderr: -471> 2024-09-12T17:35:14.928+0000 7fe388e4f640 10 monclient(hunting): get_auth_request con 0x563c0c3fad80 auth_method 0 2024-09-12T17:35:15.222 INFO:tasks.workunit.client.0.smithi037.stderr: -470> 2024-09-12T17:35:14.928+0000 7fe388e4f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:35:15.222 INFO:tasks.workunit.client.0.smithi037.stderr: -469> 2024-09-12T17:35:14.928+0000 7fe388e4f640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:35:15.222 INFO:tasks.workunit.client.0.smithi037.stderr: -468> 2024-09-12T17:35:14.928+0000 7fe388e4f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:35:15.222 INFO:tasks.workunit.client.0.smithi037.stderr: -467> 2024-09-12T17:35:14.928+0000 7fe38864e640 10 monclient(hunting): get_auth_request con 0x563c0c3fd9c0 auth_method 0 2024-09-12T17:35:15.222 INFO:tasks.workunit.client.0.smithi037.stderr: -466> 2024-09-12T17:35:14.928+0000 7fe38864e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:35:15.222 INFO:tasks.workunit.client.0.smithi037.stderr: -465> 2024-09-12T17:35:14.928+0000 7fe38864e640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:35:15.222 INFO:tasks.workunit.client.0.smithi037.stderr: -464> 2024-09-12T17:35:14.928+0000 7fe38864e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:35:15.222 INFO:tasks.workunit.client.0.smithi037.stderr: -463> 2024-09-12T17:35:14.928+0000 7fe38864e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:35:15.222 INFO:tasks.workunit.client.0.smithi037.stderr: -462> 2024-09-12T17:35:14.928+0000 7fe38864e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:35:15.222 INFO:tasks.workunit.client.0.smithi037.stderr: -461> 2024-09-12T17:35:14.928+0000 7fe38864e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:35:15.223 INFO:tasks.workunit.client.0.smithi037.stderr: -460> 2024-09-12T17:35:14.928+0000 7fe388e4f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:35:15.223 INFO:tasks.workunit.client.0.smithi037.stderr: -459> 2024-09-12T17:35:14.928+0000 7fe388e4f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:35:15.223 INFO:tasks.workunit.client.0.smithi037.stderr: -458> 2024-09-12T17:35:14.928+0000 7fe388e4f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:35:15.223 INFO:tasks.workunit.client.0.smithi037.stderr: -457> 2024-09-12T17:35:14.928+0000 7fe389650640 10 monclient(hunting): get_auth_request con 0x563c0c400ee0 auth_method 0 2024-09-12T17:35:15.223 INFO:tasks.workunit.client.0.smithi037.stderr: -456> 2024-09-12T17:35:14.928+0000 7fe389650640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:35:15.223 INFO:tasks.workunit.client.0.smithi037.stderr: -455> 2024-09-12T17:35:14.928+0000 7fe389650640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:35:15.223 INFO:tasks.workunit.client.0.smithi037.stderr: -454> 2024-09-12T17:35:14.928+0000 7fe389650640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:35:15.223 INFO:tasks.workunit.client.0.smithi037.stderr: -453> 2024-09-12T17:35:14.928+0000 7fe38864e640 10 monclient(hunting): handle_auth_done global_id 7560 payload 824 2024-09-12T17:35:15.223 INFO:tasks.workunit.client.0.smithi037.stderr: -452> 2024-09-12T17:35:14.928+0000 7fe38864e640 10 monclient: _finish_hunting 0 2024-09-12T17:35:15.223 INFO:tasks.workunit.client.0.smithi037.stderr: -451> 2024-09-12T17:35:14.928+0000 7fe38864e640 1 monclient: found mon.noname-a 2024-09-12T17:35:15.223 INFO:tasks.workunit.client.0.smithi037.stderr: -450> 2024-09-12T17:35:14.928+0000 7fe38864e640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.37:3300/0 2024-09-12T17:35:15.223 INFO:tasks.workunit.client.0.smithi037.stderr: -449> 2024-09-12T17:35:14.928+0000 7fe27560a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:35:15.223 INFO:tasks.workunit.client.0.smithi037.stderr: -448> 2024-09-12T17:35:14.928+0000 7fe27560a640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:35:15.223 INFO:tasks.workunit.client.0.smithi037.stderr: -447> 2024-09-12T17:35:14.928+0000 7fe27560a640 10 monclient: dump: 2024-09-12T17:35:15.224 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:35:15.224 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:35:15.224 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:35:15.224 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:35:15.224 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:35:15.224 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:35:15.224 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:35:15.224 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:35:15.224 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:35:15.224 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:35:15.224 INFO:tasks.workunit.client.0.smithi037.stderr: -446> 2024-09-12T17:35:14.928+0000 7fe27560a640 10 monclient: _finish_auth 0 2024-09-12T17:35:15.224 INFO:tasks.workunit.client.0.smithi037.stderr: -445> 2024-09-12T17:35:14.928+0000 7fe27560a640 10 monclient: _check_auth_tickets 2024-09-12T17:35:15.224 INFO:tasks.workunit.client.0.smithi037.stderr: -444> 2024-09-12T17:35:14.928+0000 7fe38d12c800 5 monclient: authenticate success, global_id 7560 2024-09-12T17:35:15.225 INFO:tasks.workunit.client.0.smithi037.stderr: -443> 2024-09-12T17:35:14.928+0000 7fe38d12c800 10 monclient: _renew_subs 2024-09-12T17:35:15.225 INFO:tasks.workunit.client.0.smithi037.stderr: -442> 2024-09-12T17:35:14.928+0000 7fe38d12c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.37:3300/0 2024-09-12T17:35:15.225 INFO:tasks.workunit.client.0.smithi037.stderr: -441> 2024-09-12T17:35:14.928+0000 7fe27560a640 10 monclient: handle_config config(0 keys) 2024-09-12T17:35:15.225 INFO:tasks.workunit.client.0.smithi037.stderr: -440> 2024-09-12T17:35:14.928+0000 7fe27560a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:35:15.225 INFO:tasks.workunit.client.0.smithi037.stderr: -439> 2024-09-12T17:35:14.928+0000 7fe27560a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:35:15.225 INFO:tasks.workunit.client.0.smithi037.stderr: -438> 2024-09-12T17:35:14.928+0000 7fe27560a640 10 monclient: dump: 2024-09-12T17:35:15.225 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:35:15.225 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:35:15.225 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:35:15.225 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:35:15.225 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:35:15.225 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:35:15.225 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:35:15.225 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:35:15.226 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:35:15.226 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:35:15.226 INFO:tasks.workunit.client.0.smithi037.stderr: -437> 2024-09-12T17:35:14.928+0000 7fe276e0d640 4 set_mon_vals no callback set 2024-09-12T17:35:15.226 INFO:tasks.workunit.client.0.smithi037.stderr: -436> 2024-09-12T17:35:14.928+0000 7fe38d12c800 10 monclient: _renew_subs 2024-09-12T17:35:15.226 INFO:tasks.workunit.client.0.smithi037.stderr: -435> 2024-09-12T17:35:14.928+0000 7fe38d12c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.37:3300/0 2024-09-12T17:35:15.226 INFO:tasks.workunit.client.0.smithi037.stderr: -434> 2024-09-12T17:35:14.928+0000 7fe38d12c800 1 librados: init done 2024-09-12T17:35:15.226 INFO:tasks.workunit.client.0.smithi037.stderr: -433> 2024-09-12T17:35:14.930+0000 7fe27560a640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:35:15.226 INFO:tasks.workunit.client.0.smithi037.stderr: -432> 2024-09-12T17:35:14.930+0000 7fe27560a640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.40:6816/3916250676,v1:172.21.15.40:6817/3916250676] 2024-09-12T17:35:15.226 INFO:tasks.workunit.client.0.smithi037.stderr: -431> 2024-09-12T17:35:14.930+0000 7fe27560a640 4 mgrc reconnect Starting new session with [v2:172.21.15.40:6816/3916250676,v1:172.21.15.40:6817/3916250676] 2024-09-12T17:35:15.226 INFO:tasks.workunit.client.0.smithi037.stderr: -430> 2024-09-12T17:35:14.931+0000 7fe388e4f640 10 monclient: get_auth_request con 0x7fe270076470 auth_method 0 2024-09-12T17:35:15.226 INFO:tasks.workunit.client.0.smithi037.stderr: -429> 2024-09-12T17:35:14.931+0000 7fe389650640 10 monclient: get_auth_request con 0x563c0c4fa890 auth_method 0 2024-09-12T17:35:15.226 INFO:tasks.workunit.client.0.smithi037.stderr: -428> 2024-09-12T17:35:14.932+0000 7fe388e4f640 10 monclient: get_auth_request con 0x563c0c504060 auth_method 0 2024-09-12T17:35:15.226 INFO:tasks.workunit.client.0.smithi037.stderr: -427> 2024-09-12T17:35:14.933+0000 7fe38864e640 10 monclient: get_auth_request con 0x563c0c5090f0 auth_method 0 2024-09-12T17:35:15.227 INFO:tasks.workunit.client.0.smithi037.stderr: -426> 2024-09-12T17:35:14.934+0000 7fe38d12c800 10 monclient: build_initial_monmap 2024-09-12T17:35:15.227 INFO:tasks.workunit.client.0.smithi037.stderr: -425> 2024-09-12T17:35:14.934+0000 7fe38d12c800 1 build_initial for_mkfs: 0 2024-09-12T17:35:15.227 INFO:tasks.workunit.client.0.smithi037.stderr: -424> 2024-09-12T17:35:14.934+0000 7fe38d12c800 10 monclient: monmap: 2024-09-12T17:35:15.227 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 0 2024-09-12T17:35:15.227 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:35:15.227 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 0.000000 2024-09-12T17:35:15.227 INFO:tasks.workunit.client.0.smithi037.stderr:created 0.000000 2024-09-12T17:35:15.227 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 0 (unknown) 2024-09-12T17:35:15.227 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:35:15.227 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.noname-a 2024-09-12T17:35:15.227 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.noname-b 2024-09-12T17:35:15.227 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.noname-c 2024-09-12T17:35:15.227 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:35:15.227 INFO:tasks.workunit.client.0.smithi037.stderr: -423> 2024-09-12T17:35:14.934+0000 7fe38d12c800 5 AuthRegistry(0x563c0c50cf70) adding auth protocol: cephx 2024-09-12T17:35:15.228 INFO:tasks.workunit.client.0.smithi037.stderr: -422> 2024-09-12T17:35:14.934+0000 7fe38d12c800 5 AuthRegistry(0x563c0c50cf70) adding auth protocol: cephx 2024-09-12T17:35:15.228 INFO:tasks.workunit.client.0.smithi037.stderr: -421> 2024-09-12T17:35:14.934+0000 7fe38d12c800 5 AuthRegistry(0x563c0c50cf70) adding auth protocol: cephx 2024-09-12T17:35:15.228 INFO:tasks.workunit.client.0.smithi037.stderr: -420> 2024-09-12T17:35:14.934+0000 7fe38d12c800 5 AuthRegistry(0x563c0c50cf70) adding con mode: secure 2024-09-12T17:35:15.228 INFO:tasks.workunit.client.0.smithi037.stderr: -419> 2024-09-12T17:35:14.934+0000 7fe38d12c800 5 AuthRegistry(0x563c0c50cf70) adding con mode: crc 2024-09-12T17:35:15.228 INFO:tasks.workunit.client.0.smithi037.stderr: -418> 2024-09-12T17:35:14.934+0000 7fe38d12c800 5 AuthRegistry(0x563c0c50cf70) adding con mode: secure 2024-09-12T17:35:15.228 INFO:tasks.workunit.client.0.smithi037.stderr: -417> 2024-09-12T17:35:14.934+0000 7fe38d12c800 5 AuthRegistry(0x563c0c50cf70) adding con mode: crc 2024-09-12T17:35:15.228 INFO:tasks.workunit.client.0.smithi037.stderr: -416> 2024-09-12T17:35:14.934+0000 7fe38d12c800 5 AuthRegistry(0x563c0c50cf70) adding con mode: secure 2024-09-12T17:35:15.228 INFO:tasks.workunit.client.0.smithi037.stderr: -415> 2024-09-12T17:35:14.934+0000 7fe38d12c800 5 AuthRegistry(0x563c0c50cf70) adding con mode: crc 2024-09-12T17:35:15.228 INFO:tasks.workunit.client.0.smithi037.stderr: -414> 2024-09-12T17:35:14.934+0000 7fe38d12c800 5 AuthRegistry(0x563c0c50cf70) adding con mode: crc 2024-09-12T17:35:15.228 INFO:tasks.workunit.client.0.smithi037.stderr: -413> 2024-09-12T17:35:14.934+0000 7fe38d12c800 5 AuthRegistry(0x563c0c50cf70) adding con mode: secure 2024-09-12T17:35:15.228 INFO:tasks.workunit.client.0.smithi037.stderr: -412> 2024-09-12T17:35:14.934+0000 7fe38d12c800 5 AuthRegistry(0x563c0c50cf70) adding con mode: crc 2024-09-12T17:35:15.228 INFO:tasks.workunit.client.0.smithi037.stderr: -411> 2024-09-12T17:35:14.934+0000 7fe38d12c800 5 AuthRegistry(0x563c0c50cf70) adding con mode: secure 2024-09-12T17:35:15.228 INFO:tasks.workunit.client.0.smithi037.stderr: -410> 2024-09-12T17:35:14.934+0000 7fe38d12c800 5 AuthRegistry(0x563c0c50cf70) adding con mode: crc 2024-09-12T17:35:15.229 INFO:tasks.workunit.client.0.smithi037.stderr: -409> 2024-09-12T17:35:14.934+0000 7fe38d12c800 5 AuthRegistry(0x563c0c50cf70) adding con mode: secure 2024-09-12T17:35:15.229 INFO:tasks.workunit.client.0.smithi037.stderr: -408> 2024-09-12T17:35:14.934+0000 7fe38d12c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:35:15.229 INFO:tasks.workunit.client.0.smithi037.stderr: -407> 2024-09-12T17:35:14.934+0000 7fe38d12c800 5 asok(0x563c0c296730) register_command objecter_requests cmddesc objecter_requests hook 0x563c0c510920 EEXIST 2024-09-12T17:35:15.229 INFO:tasks.workunit.client.0.smithi037.stderr: -406> 2024-09-12T17:35:14.935+0000 7fe38d12c800 10 monclient: init 2024-09-12T17:35:15.229 INFO:tasks.workunit.client.0.smithi037.stderr: -405> 2024-09-12T17:35:14.935+0000 7fe38d12c800 5 AuthRegistry(0x563c0c50bf28) adding auth protocol: cephx 2024-09-12T17:35:15.229 INFO:tasks.workunit.client.0.smithi037.stderr: -404> 2024-09-12T17:35:14.935+0000 7fe38d12c800 5 AuthRegistry(0x563c0c50bf28) adding auth protocol: cephx 2024-09-12T17:35:15.229 INFO:tasks.workunit.client.0.smithi037.stderr: -403> 2024-09-12T17:35:14.935+0000 7fe38d12c800 5 AuthRegistry(0x563c0c50bf28) adding auth protocol: cephx 2024-09-12T17:35:15.229 INFO:tasks.workunit.client.0.smithi037.stderr: -402> 2024-09-12T17:35:14.935+0000 7fe38d12c800 5 AuthRegistry(0x563c0c50bf28) adding con mode: secure 2024-09-12T17:35:15.229 INFO:tasks.workunit.client.0.smithi037.stderr: -401> 2024-09-12T17:35:14.935+0000 7fe38d12c800 5 AuthRegistry(0x563c0c50bf28) adding con mode: crc 2024-09-12T17:35:15.229 INFO:tasks.workunit.client.0.smithi037.stderr: -400> 2024-09-12T17:35:14.935+0000 7fe38d12c800 5 AuthRegistry(0x563c0c50bf28) adding con mode: secure 2024-09-12T17:35:15.229 INFO:tasks.workunit.client.0.smithi037.stderr: -399> 2024-09-12T17:35:14.935+0000 7fe38d12c800 5 AuthRegistry(0x563c0c50bf28) adding con mode: crc 2024-09-12T17:35:15.229 INFO:tasks.workunit.client.0.smithi037.stderr: -398> 2024-09-12T17:35:14.935+0000 7fe38d12c800 5 AuthRegistry(0x563c0c50bf28) adding con mode: secure 2024-09-12T17:35:15.229 INFO:tasks.workunit.client.0.smithi037.stderr: -397> 2024-09-12T17:35:14.935+0000 7fe38d12c800 5 AuthRegistry(0x563c0c50bf28) adding con mode: crc 2024-09-12T17:35:15.230 INFO:tasks.workunit.client.0.smithi037.stderr: -396> 2024-09-12T17:35:14.935+0000 7fe38d12c800 5 AuthRegistry(0x563c0c50bf28) adding con mode: crc 2024-09-12T17:35:15.230 INFO:tasks.workunit.client.0.smithi037.stderr: -395> 2024-09-12T17:35:14.935+0000 7fe38d12c800 5 AuthRegistry(0x563c0c50bf28) adding con mode: secure 2024-09-12T17:35:15.230 INFO:tasks.workunit.client.0.smithi037.stderr: -394> 2024-09-12T17:35:14.935+0000 7fe38d12c800 5 AuthRegistry(0x563c0c50bf28) adding con mode: crc 2024-09-12T17:35:15.230 INFO:tasks.workunit.client.0.smithi037.stderr: -393> 2024-09-12T17:35:14.935+0000 7fe38d12c800 5 AuthRegistry(0x563c0c50bf28) adding con mode: secure 2024-09-12T17:35:15.230 INFO:tasks.workunit.client.0.smithi037.stderr: -392> 2024-09-12T17:35:14.935+0000 7fe38d12c800 5 AuthRegistry(0x563c0c50bf28) adding con mode: crc 2024-09-12T17:35:15.230 INFO:tasks.workunit.client.0.smithi037.stderr: -391> 2024-09-12T17:35:14.935+0000 7fe38d12c800 5 AuthRegistry(0x563c0c50bf28) adding con mode: secure 2024-09-12T17:35:15.230 INFO:tasks.workunit.client.0.smithi037.stderr: -390> 2024-09-12T17:35:14.935+0000 7fe38d12c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:35:15.230 INFO:tasks.workunit.client.0.smithi037.stderr: -389> 2024-09-12T17:35:14.935+0000 7fe38d12c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:35:15.230 INFO:tasks.workunit.client.0.smithi037.stderr: -388> 2024-09-12T17:35:14.935+0000 7fe38d12c800 5 asok(0x563c0c296730) register_command rotate-key cmddesc rotate-key hook 0x563c0c50c070 EEXIST 2024-09-12T17:35:15.230 INFO:tasks.workunit.client.0.smithi037.stderr: -387> 2024-09-12T17:35:14.935+0000 7fe38d12c800 10 monclient: _reopen_session rank -1 2024-09-12T17:35:15.230 INFO:tasks.workunit.client.0.smithi037.stderr: -386> 2024-09-12T17:35:14.935+0000 7fe38d12c800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T17:35:15.230 INFO:tasks.workunit.client.0.smithi037.stderr: -385> 2024-09-12T17:35:14.935+0000 7fe38d12c800 10 monclient(hunting): picked mon.noname-a con 0x563c0c534610 addr [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] 2024-09-12T17:35:15.230 INFO:tasks.workunit.client.0.smithi037.stderr: -384> 2024-09-12T17:35:14.935+0000 7fe38d12c800 10 monclient(hunting): picked mon.noname-c con 0x563c0c5368e0 addr [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] 2024-09-12T17:35:15.231 INFO:tasks.workunit.client.0.smithi037.stderr: -383> 2024-09-12T17:35:14.935+0000 7fe38d12c800 10 monclient(hunting): picked mon.noname-b con 0x563c0c532de0 addr [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] 2024-09-12T17:35:15.231 INFO:tasks.workunit.client.0.smithi037.stderr: -382> 2024-09-12T17:35:14.935+0000 7fe38d12c800 10 monclient(hunting): start opening mon connection 2024-09-12T17:35:15.231 INFO:tasks.workunit.client.0.smithi037.stderr: -381> 2024-09-12T17:35:14.935+0000 7fe38d12c800 10 monclient(hunting): start opening mon connection 2024-09-12T17:35:15.231 INFO:tasks.workunit.client.0.smithi037.stderr: -380> 2024-09-12T17:35:14.935+0000 7fe38d12c800 10 monclient(hunting): start opening mon connection 2024-09-12T17:35:15.231 INFO:tasks.workunit.client.0.smithi037.stderr: -379> 2024-09-12T17:35:14.935+0000 7fe38d12c800 10 monclient(hunting): _renew_subs 2024-09-12T17:35:15.231 INFO:tasks.workunit.client.0.smithi037.stderr: -378> 2024-09-12T17:35:14.935+0000 7fe38d12c800 10 monclient(hunting): authenticate will time out at 2302.532547s 2024-09-12T17:35:15.231 INFO:tasks.workunit.client.0.smithi037.stderr: -377> 2024-09-12T17:35:14.935+0000 7fe38864e640 10 monclient(hunting): get_auth_request con 0x563c0c5368e0 auth_method 0 2024-09-12T17:35:15.231 INFO:tasks.workunit.client.0.smithi037.stderr: -376> 2024-09-12T17:35:14.935+0000 7fe38864e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:35:15.231 INFO:tasks.workunit.client.0.smithi037.stderr: -375> 2024-09-12T17:35:14.935+0000 7fe38864e640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:35:15.231 INFO:tasks.workunit.client.0.smithi037.stderr: -374> 2024-09-12T17:35:14.935+0000 7fe38864e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:35:15.231 INFO:tasks.workunit.client.0.smithi037.stderr: -373> 2024-09-12T17:35:14.935+0000 7fe388e4f640 10 monclient(hunting): get_auth_request con 0x563c0c534610 auth_method 0 2024-09-12T17:35:15.231 INFO:tasks.workunit.client.0.smithi037.stderr: -372> 2024-09-12T17:35:14.935+0000 7fe388e4f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:35:15.231 INFO:tasks.workunit.client.0.smithi037.stderr: -371> 2024-09-12T17:35:14.935+0000 7fe388e4f640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:35:15.231 INFO:tasks.workunit.client.0.smithi037.stderr: -370> 2024-09-12T17:35:14.935+0000 7fe388e4f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:35:15.232 INFO:tasks.workunit.client.0.smithi037.stderr: -369> 2024-09-12T17:35:14.935+0000 7fe389650640 10 monclient(hunting): get_auth_request con 0x563c0c532de0 auth_method 0 2024-09-12T17:35:15.232 INFO:tasks.workunit.client.0.smithi037.stderr: -368> 2024-09-12T17:35:14.935+0000 7fe389650640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:35:15.232 INFO:tasks.workunit.client.0.smithi037.stderr: -367> 2024-09-12T17:35:14.935+0000 7fe389650640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:35:15.232 INFO:tasks.workunit.client.0.smithi037.stderr: -366> 2024-09-12T17:35:14.935+0000 7fe389650640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:35:15.232 INFO:tasks.workunit.client.0.smithi037.stderr: -365> 2024-09-12T17:35:14.935+0000 7fe38864e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:35:15.232 INFO:tasks.workunit.client.0.smithi037.stderr: -364> 2024-09-12T17:35:14.935+0000 7fe38864e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:35:15.232 INFO:tasks.workunit.client.0.smithi037.stderr: -363> 2024-09-12T17:35:14.935+0000 7fe38864e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:35:15.232 INFO:tasks.workunit.client.0.smithi037.stderr: -362> 2024-09-12T17:35:14.935+0000 7fe388e4f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:35:15.232 INFO:tasks.workunit.client.0.smithi037.stderr: -361> 2024-09-12T17:35:14.935+0000 7fe388e4f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:35:15.232 INFO:tasks.workunit.client.0.smithi037.stderr: -360> 2024-09-12T17:35:14.935+0000 7fe388e4f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:35:15.232 INFO:tasks.workunit.client.0.smithi037.stderr: -359> 2024-09-12T17:35:14.935+0000 7fe389650640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:35:15.232 INFO:tasks.workunit.client.0.smithi037.stderr: -358> 2024-09-12T17:35:14.935+0000 7fe389650640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:35:15.232 INFO:tasks.workunit.client.0.smithi037.stderr: -357> 2024-09-12T17:35:14.935+0000 7fe389650640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:35:15.233 INFO:tasks.workunit.client.0.smithi037.stderr: -356> 2024-09-12T17:35:14.935+0000 7fe38864e640 10 monclient(hunting): handle_auth_done global_id 7085 payload 824 2024-09-12T17:35:15.233 INFO:tasks.workunit.client.0.smithi037.stderr: -355> 2024-09-12T17:35:14.935+0000 7fe38864e640 10 monclient: _finish_hunting 0 2024-09-12T17:35:15.233 INFO:tasks.workunit.client.0.smithi037.stderr: -354> 2024-09-12T17:35:14.935+0000 7fe38864e640 1 monclient: found mon.noname-c 2024-09-12T17:35:15.233 INFO:tasks.workunit.client.0.smithi037.stderr: -353> 2024-09-12T17:35:14.935+0000 7fe38864e640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.37:3301/0 2024-09-12T17:35:15.233 INFO:tasks.workunit.client.0.smithi037.stderr: -352> 2024-09-12T17:35:14.936+0000 7fe26e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:35:15.233 INFO:tasks.workunit.client.0.smithi037.stderr: -351> 2024-09-12T17:35:14.936+0000 7fe26e7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:35:15.233 INFO:tasks.workunit.client.0.smithi037.stderr: -350> 2024-09-12T17:35:14.936+0000 7fe26e7fc640 10 monclient: dump: 2024-09-12T17:35:15.233 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:35:15.233 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:35:15.233 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:35:15.233 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:35:15.233 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:35:15.233 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:35:15.233 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:35:15.234 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:35:15.234 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:35:15.234 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:35:15.234 INFO:tasks.workunit.client.0.smithi037.stderr: -349> 2024-09-12T17:35:14.936+0000 7fe26e7fc640 10 monclient: _finish_auth 0 2024-09-12T17:35:15.234 INFO:tasks.workunit.client.0.smithi037.stderr: -348> 2024-09-12T17:35:14.936+0000 7fe26e7fc640 10 monclient: _check_auth_tickets 2024-09-12T17:35:15.234 INFO:tasks.workunit.client.0.smithi037.stderr: -347> 2024-09-12T17:35:14.936+0000 7fe26e7fc640 10 monclient: handle_config config(0 keys) 2024-09-12T17:35:15.234 INFO:tasks.workunit.client.0.smithi037.stderr: -346> 2024-09-12T17:35:14.936+0000 7fe26e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:35:15.234 INFO:tasks.workunit.client.0.smithi037.stderr: -345> 2024-09-12T17:35:14.936+0000 7fe26e7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:35:15.234 INFO:tasks.workunit.client.0.smithi037.stderr: -344> 2024-09-12T17:35:14.936+0000 7fe26e7fc640 10 monclient: dump: 2024-09-12T17:35:15.234 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:35:15.234 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:35:15.234 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:35:15.234 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:35:15.235 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:35:15.235 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:35:15.235 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:35:15.235 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:35:15.235 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:35:15.235 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:35:15.235 INFO:tasks.workunit.client.0.smithi037.stderr: -343> 2024-09-12T17:35:14.936+0000 7fe38d12c800 5 monclient: authenticate success, global_id 7085 2024-09-12T17:35:15.235 INFO:tasks.workunit.client.0.smithi037.stderr: -342> 2024-09-12T17:35:14.936+0000 7fe38d12c800 10 monclient: _renew_subs 2024-09-12T17:35:15.235 INFO:tasks.workunit.client.0.smithi037.stderr: -341> 2024-09-12T17:35:14.936+0000 7fe389e51640 4 set_mon_vals no callback set 2024-09-12T17:35:15.235 INFO:tasks.workunit.client.0.smithi037.stderr: -340> 2024-09-12T17:35:14.936+0000 7fe38d12c800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.37:3301/0 2024-09-12T17:35:15.235 INFO:tasks.workunit.client.0.smithi037.stderr: -339> 2024-09-12T17:35:14.936+0000 7fe38d12c800 10 monclient: _renew_subs 2024-09-12T17:35:15.235 INFO:tasks.workunit.client.0.smithi037.stderr: -338> 2024-09-12T17:35:14.936+0000 7fe38d12c800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.37:3301/0 2024-09-12T17:35:15.235 INFO:tasks.workunit.client.0.smithi037.stderr: -337> 2024-09-12T17:35:14.937+0000 7fe26e7fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:35:15.235 INFO:tasks.workunit.client.0.smithi037.stderr: -336> 2024-09-12T17:35:14.937+0000 7fe26e7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.40:6816/3916250676,v1:172.21.15.40:6817/3916250676] 2024-09-12T17:35:15.236 INFO:tasks.workunit.client.0.smithi037.stderr: -335> 2024-09-12T17:35:14.937+0000 7fe26e7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.40:6816/3916250676,v1:172.21.15.40:6817/3916250676] 2024-09-12T17:35:15.236 INFO:tasks.workunit.client.0.smithi037.stderr: -334> 2024-09-12T17:35:14.938+0000 7fe388e4f640 10 monclient: get_auth_request con 0x7fe260076380 auth_method 0 2024-09-12T17:35:15.236 INFO:tasks.workunit.client.0.smithi037.stderr: -333> 2024-09-12T17:35:14.938+0000 7fe38d12c800 10 monclient: get_monmap_and_config 2024-09-12T17:35:15.236 INFO:tasks.workunit.client.0.smithi037.stderr: -332> 2024-09-12T17:35:14.938+0000 7fe38d12c800 10 monclient: build_initial_monmap 2024-09-12T17:35:15.236 INFO:tasks.workunit.client.0.smithi037.stderr: -331> 2024-09-12T17:35:14.938+0000 7fe38d12c800 1 build_initial for_mkfs: 0 2024-09-12T17:35:15.236 INFO:tasks.workunit.client.0.smithi037.stderr: -330> 2024-09-12T17:35:14.938+0000 7fe38d12c800 10 monclient: monmap: 2024-09-12T17:35:15.236 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 0 2024-09-12T17:35:15.236 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:35:15.236 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 0.000000 2024-09-12T17:35:15.236 INFO:tasks.workunit.client.0.smithi037.stderr:created 0.000000 2024-09-12T17:35:15.236 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 0 (unknown) 2024-09-12T17:35:15.236 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:35:15.236 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.noname-a 2024-09-12T17:35:15.236 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.noname-b 2024-09-12T17:35:15.237 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.noname-c 2024-09-12T17:35:15.237 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:35:15.237 INFO:tasks.workunit.client.0.smithi037.stderr: -329> 2024-09-12T17:35:14.938+0000 7fe38d12c800 5 AuthRegistry(0x563c0c5542b0) adding auth protocol: cephx 2024-09-12T17:35:15.237 INFO:tasks.workunit.client.0.smithi037.stderr: -328> 2024-09-12T17:35:14.938+0000 7fe38d12c800 5 AuthRegistry(0x563c0c5542b0) adding auth protocol: cephx 2024-09-12T17:35:15.237 INFO:tasks.workunit.client.0.smithi037.stderr: -327> 2024-09-12T17:35:14.938+0000 7fe38d12c800 5 AuthRegistry(0x563c0c5542b0) adding auth protocol: cephx 2024-09-12T17:35:15.237 INFO:tasks.workunit.client.0.smithi037.stderr: -326> 2024-09-12T17:35:14.938+0000 7fe38d12c800 5 AuthRegistry(0x563c0c5542b0) adding con mode: secure 2024-09-12T17:35:15.237 INFO:tasks.workunit.client.0.smithi037.stderr: -325> 2024-09-12T17:35:14.938+0000 7fe38d12c800 5 AuthRegistry(0x563c0c5542b0) adding con mode: crc 2024-09-12T17:35:15.237 INFO:tasks.workunit.client.0.smithi037.stderr: -324> 2024-09-12T17:35:14.938+0000 7fe38d12c800 5 AuthRegistry(0x563c0c5542b0) adding con mode: secure 2024-09-12T17:35:15.237 INFO:tasks.workunit.client.0.smithi037.stderr: -323> 2024-09-12T17:35:14.938+0000 7fe38d12c800 5 AuthRegistry(0x563c0c5542b0) adding con mode: crc 2024-09-12T17:35:15.237 INFO:tasks.workunit.client.0.smithi037.stderr: -322> 2024-09-12T17:35:14.938+0000 7fe38d12c800 5 AuthRegistry(0x563c0c5542b0) adding con mode: secure 2024-09-12T17:35:15.237 INFO:tasks.workunit.client.0.smithi037.stderr: -321> 2024-09-12T17:35:14.938+0000 7fe38d12c800 5 AuthRegistry(0x563c0c5542b0) adding con mode: crc 2024-09-12T17:35:15.237 INFO:tasks.workunit.client.0.smithi037.stderr: -320> 2024-09-12T17:35:14.938+0000 7fe38d12c800 5 AuthRegistry(0x563c0c5542b0) adding con mode: crc 2024-09-12T17:35:15.237 INFO:tasks.workunit.client.0.smithi037.stderr: -319> 2024-09-12T17:35:14.938+0000 7fe38d12c800 5 AuthRegistry(0x563c0c5542b0) adding con mode: secure 2024-09-12T17:35:15.237 INFO:tasks.workunit.client.0.smithi037.stderr: -318> 2024-09-12T17:35:14.938+0000 7fe38d12c800 5 AuthRegistry(0x563c0c5542b0) adding con mode: crc 2024-09-12T17:35:15.237 INFO:tasks.workunit.client.0.smithi037.stderr: -317> 2024-09-12T17:35:14.938+0000 7fe38d12c800 5 AuthRegistry(0x563c0c5542b0) adding con mode: secure 2024-09-12T17:35:15.238 INFO:tasks.workunit.client.0.smithi037.stderr: -316> 2024-09-12T17:35:14.938+0000 7fe38d12c800 5 AuthRegistry(0x563c0c5542b0) adding con mode: crc 2024-09-12T17:35:15.238 INFO:tasks.workunit.client.0.smithi037.stderr: -315> 2024-09-12T17:35:14.938+0000 7fe38d12c800 5 AuthRegistry(0x563c0c5542b0) adding con mode: secure 2024-09-12T17:35:15.238 INFO:tasks.workunit.client.0.smithi037.stderr: -314> 2024-09-12T17:35:14.938+0000 7fe38d12c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:35:15.238 INFO:tasks.workunit.client.0.smithi037.stderr: -313> 2024-09-12T17:35:14.938+0000 7fe38d12c800 10 monclient: init 2024-09-12T17:35:15.238 INFO:tasks.workunit.client.0.smithi037.stderr: -312> 2024-09-12T17:35:14.938+0000 7fe38d12c800 5 AuthRegistry(0x7ffc663b2e60) adding auth protocol: cephx 2024-09-12T17:35:15.238 INFO:tasks.workunit.client.0.smithi037.stderr: -311> 2024-09-12T17:35:14.938+0000 7fe38d12c800 5 AuthRegistry(0x7ffc663b2e60) adding auth protocol: cephx 2024-09-12T17:35:15.238 INFO:tasks.workunit.client.0.smithi037.stderr: -310> 2024-09-12T17:35:14.938+0000 7fe38d12c800 5 AuthRegistry(0x7ffc663b2e60) adding auth protocol: cephx 2024-09-12T17:35:15.238 INFO:tasks.workunit.client.0.smithi037.stderr: -309> 2024-09-12T17:35:14.938+0000 7fe38d12c800 5 AuthRegistry(0x7ffc663b2e60) adding con mode: secure 2024-09-12T17:35:15.238 INFO:tasks.workunit.client.0.smithi037.stderr: -308> 2024-09-12T17:35:14.938+0000 7fe38d12c800 5 AuthRegistry(0x7ffc663b2e60) adding con mode: crc 2024-09-12T17:35:15.238 INFO:tasks.workunit.client.0.smithi037.stderr: -307> 2024-09-12T17:35:14.938+0000 7fe38d12c800 5 AuthRegistry(0x7ffc663b2e60) adding con mode: secure 2024-09-12T17:35:15.238 INFO:tasks.workunit.client.0.smithi037.stderr: -306> 2024-09-12T17:35:14.938+0000 7fe38d12c800 5 AuthRegistry(0x7ffc663b2e60) adding con mode: crc 2024-09-12T17:35:15.238 INFO:tasks.workunit.client.0.smithi037.stderr: -305> 2024-09-12T17:35:14.938+0000 7fe38d12c800 5 AuthRegistry(0x7ffc663b2e60) adding con mode: secure 2024-09-12T17:35:15.238 INFO:tasks.workunit.client.0.smithi037.stderr: -304> 2024-09-12T17:35:14.938+0000 7fe38d12c800 5 AuthRegistry(0x7ffc663b2e60) adding con mode: crc 2024-09-12T17:35:15.238 INFO:tasks.workunit.client.0.smithi037.stderr: -303> 2024-09-12T17:35:14.938+0000 7fe38d12c800 5 AuthRegistry(0x7ffc663b2e60) adding con mode: crc 2024-09-12T17:35:15.239 INFO:tasks.workunit.client.0.smithi037.stderr: -302> 2024-09-12T17:35:14.938+0000 7fe38d12c800 5 AuthRegistry(0x7ffc663b2e60) adding con mode: secure 2024-09-12T17:35:15.239 INFO:tasks.workunit.client.0.smithi037.stderr: -301> 2024-09-12T17:35:14.938+0000 7fe38d12c800 5 AuthRegistry(0x7ffc663b2e60) adding con mode: crc 2024-09-12T17:35:15.239 INFO:tasks.workunit.client.0.smithi037.stderr: -300> 2024-09-12T17:35:14.938+0000 7fe38d12c800 5 AuthRegistry(0x7ffc663b2e60) adding con mode: secure 2024-09-12T17:35:15.239 INFO:tasks.workunit.client.0.smithi037.stderr: -299> 2024-09-12T17:35:14.938+0000 7fe38d12c800 5 AuthRegistry(0x7ffc663b2e60) adding con mode: crc 2024-09-12T17:35:15.239 INFO:tasks.workunit.client.0.smithi037.stderr: -298> 2024-09-12T17:35:14.938+0000 7fe38d12c800 5 AuthRegistry(0x7ffc663b2e60) adding con mode: secure 2024-09-12T17:35:15.239 INFO:tasks.workunit.client.0.smithi037.stderr: -297> 2024-09-12T17:35:14.938+0000 7fe38d12c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:35:15.239 INFO:tasks.workunit.client.0.smithi037.stderr: -296> 2024-09-12T17:35:14.939+0000 7fe38d12c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:35:15.239 INFO:tasks.workunit.client.0.smithi037.stderr: -295> 2024-09-12T17:35:14.939+0000 7fe38d12c800 5 asok(0x563c0c296730) register_command rotate-key cmddesc rotate-key hook 0x7ffc663b2fa8 EEXIST 2024-09-12T17:35:15.239 INFO:tasks.workunit.client.0.smithi037.stderr: -294> 2024-09-12T17:35:14.939+0000 7fe38d12c800 10 monclient: _reopen_session rank -1 2024-09-12T17:35:15.239 INFO:tasks.workunit.client.0.smithi037.stderr: -293> 2024-09-12T17:35:14.939+0000 7fe38d12c800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T17:35:15.239 INFO:tasks.workunit.client.0.smithi037.stderr: -292> 2024-09-12T17:35:14.939+0000 7fe38d12c800 10 monclient(hunting): picked mon.noname-c con 0x563c0c588830 addr [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] 2024-09-12T17:35:15.239 INFO:tasks.workunit.client.0.smithi037.stderr: -291> 2024-09-12T17:35:14.939+0000 7fe38d12c800 10 monclient(hunting): picked mon.noname-a con 0x563c0c582dd0 addr [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] 2024-09-12T17:35:15.239 INFO:tasks.workunit.client.0.smithi037.stderr: -290> 2024-09-12T17:35:14.939+0000 7fe38d12c800 10 monclient(hunting): picked mon.noname-b con 0x563c0c558670 addr [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] 2024-09-12T17:35:15.239 INFO:tasks.workunit.client.0.smithi037.stderr: -289> 2024-09-12T17:35:14.939+0000 7fe38d12c800 10 monclient(hunting): start opening mon connection 2024-09-12T17:35:15.239 INFO:tasks.workunit.client.0.smithi037.stderr: -288> 2024-09-12T17:35:14.939+0000 7fe38d12c800 10 monclient(hunting): start opening mon connection 2024-09-12T17:35:15.240 INFO:tasks.workunit.client.0.smithi037.stderr: -287> 2024-09-12T17:35:14.939+0000 7fe38d12c800 10 monclient(hunting): start opening mon connection 2024-09-12T17:35:15.240 INFO:tasks.workunit.client.0.smithi037.stderr: -286> 2024-09-12T17:35:14.939+0000 7fe38d12c800 10 monclient(hunting): _renew_subs 2024-09-12T17:35:15.240 INFO:tasks.workunit.client.0.smithi037.stderr: -285> 2024-09-12T17:35:14.939+0000 7fe38d12c800 10 monclient(hunting): authenticate will time out at 2302.536265s 2024-09-12T17:35:15.240 INFO:tasks.workunit.client.0.smithi037.stderr: -284> 2024-09-12T17:35:14.939+0000 7fe388e4f640 10 monclient(hunting): get_auth_request con 0x563c0c588830 auth_method 0 2024-09-12T17:35:15.240 INFO:tasks.workunit.client.0.smithi037.stderr: -283> 2024-09-12T17:35:14.939+0000 7fe388e4f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:35:15.240 INFO:tasks.workunit.client.0.smithi037.stderr: -282> 2024-09-12T17:35:14.939+0000 7fe388e4f640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:35:15.240 INFO:tasks.workunit.client.0.smithi037.stderr: -281> 2024-09-12T17:35:14.939+0000 7fe388e4f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:35:15.240 INFO:tasks.workunit.client.0.smithi037.stderr: -280> 2024-09-12T17:35:14.939+0000 7fe38864e640 10 monclient(hunting): get_auth_request con 0x563c0c582dd0 auth_method 0 2024-09-12T17:35:15.240 INFO:tasks.workunit.client.0.smithi037.stderr: -279> 2024-09-12T17:35:14.939+0000 7fe38864e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:35:15.240 INFO:tasks.workunit.client.0.smithi037.stderr: -278> 2024-09-12T17:35:14.939+0000 7fe38864e640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:35:15.240 INFO:tasks.workunit.client.0.smithi037.stderr: -277> 2024-09-12T17:35:14.939+0000 7fe38864e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:35:15.240 INFO:tasks.workunit.client.0.smithi037.stderr: -276> 2024-09-12T17:35:14.939+0000 7fe38864e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:35:15.240 INFO:tasks.workunit.client.0.smithi037.stderr: -275> 2024-09-12T17:35:14.939+0000 7fe38864e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:35:15.241 INFO:tasks.workunit.client.0.smithi037.stderr: -274> 2024-09-12T17:35:14.939+0000 7fe38864e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:35:15.241 INFO:tasks.workunit.client.0.smithi037.stderr: -273> 2024-09-12T17:35:14.939+0000 7fe388e4f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:35:15.241 INFO:tasks.workunit.client.0.smithi037.stderr: -272> 2024-09-12T17:35:14.939+0000 7fe388e4f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:35:15.241 INFO:tasks.workunit.client.0.smithi037.stderr: -271> 2024-09-12T17:35:14.939+0000 7fe388e4f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:35:15.241 INFO:tasks.workunit.client.0.smithi037.stderr: -270> 2024-09-12T17:35:14.939+0000 7fe389650640 10 monclient(hunting): get_auth_request con 0x563c0c558670 auth_method 0 2024-09-12T17:35:15.241 INFO:tasks.workunit.client.0.smithi037.stderr: -269> 2024-09-12T17:35:14.939+0000 7fe389650640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:35:15.241 INFO:tasks.workunit.client.0.smithi037.stderr: -268> 2024-09-12T17:35:14.939+0000 7fe389650640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:35:15.241 INFO:tasks.workunit.client.0.smithi037.stderr: -267> 2024-09-12T17:35:14.939+0000 7fe389650640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:35:15.241 INFO:tasks.workunit.client.0.smithi037.stderr: -266> 2024-09-12T17:35:14.939+0000 7fe38864e640 10 monclient(hunting): handle_auth_done global_id 7566 payload 274 2024-09-12T17:35:15.241 INFO:tasks.workunit.client.0.smithi037.stderr: -265> 2024-09-12T17:35:14.939+0000 7fe38864e640 10 monclient: _finish_hunting 0 2024-09-12T17:35:15.241 INFO:tasks.workunit.client.0.smithi037.stderr: -264> 2024-09-12T17:35:14.939+0000 7fe38864e640 1 monclient: found mon.noname-a 2024-09-12T17:35:15.241 INFO:tasks.workunit.client.0.smithi037.stderr: -263> 2024-09-12T17:35:14.939+0000 7fe38864e640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.37:3300/0 2024-09-12T17:35:15.241 INFO:tasks.workunit.client.0.smithi037.stderr: -262> 2024-09-12T17:35:14.939+0000 7fe25ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:35:15.241 INFO:tasks.workunit.client.0.smithi037.stderr: -261> 2024-09-12T17:35:14.939+0000 7fe25ffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:35:15.242 INFO:tasks.workunit.client.0.smithi037.stderr: -260> 2024-09-12T17:35:14.939+0000 7fe25ffff640 10 monclient: dump: 2024-09-12T17:35:15.242 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:35:15.242 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:35:15.242 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:35:15.242 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:35:15.242 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:35:15.242 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:35:15.242 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:35:15.242 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:35:15.242 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:35:15.242 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:35:15.242 INFO:tasks.workunit.client.0.smithi037.stderr: -259> 2024-09-12T17:35:14.939+0000 7fe25ffff640 10 monclient: _finish_auth 0 2024-09-12T17:35:15.242 INFO:tasks.workunit.client.0.smithi037.stderr: -258> 2024-09-12T17:35:14.939+0000 7fe25ffff640 10 monclient: _check_auth_tickets 2024-09-12T17:35:15.242 INFO:tasks.workunit.client.0.smithi037.stderr: -257> 2024-09-12T17:35:14.939+0000 7fe25ffff640 10 monclient: handle_config config(0 keys) 2024-09-12T17:35:15.243 INFO:tasks.workunit.client.0.smithi037.stderr: -256> 2024-09-12T17:35:14.939+0000 7fe25ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:35:15.243 INFO:tasks.workunit.client.0.smithi037.stderr: -255> 2024-09-12T17:35:14.939+0000 7fe25ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:35:15.243 INFO:tasks.workunit.client.0.smithi037.stderr: -254> 2024-09-12T17:35:14.939+0000 7fe25ffff640 10 monclient: dump: 2024-09-12T17:35:15.243 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:35:15.243 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:35:15.243 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:35:15.243 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:35:15.243 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:35:15.243 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:35:15.243 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:35:15.243 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:35:15.243 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:35:15.243 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:35:15.243 INFO:tasks.workunit.client.0.smithi037.stderr: -253> 2024-09-12T17:35:14.939+0000 7fe38d12c800 5 monclient: authenticate success, global_id 7566 2024-09-12T17:35:15.244 INFO:tasks.workunit.client.0.smithi037.stderr: -252> 2024-09-12T17:35:14.939+0000 7fe38d12c800 10 monclient: get_monmap_and_config success 2024-09-12T17:35:15.244 INFO:tasks.workunit.client.0.smithi037.stderr: -251> 2024-09-12T17:35:14.939+0000 7fe38d12c800 4 set_mon_vals no callback set 2024-09-12T17:35:15.244 INFO:tasks.workunit.client.0.smithi037.stderr: -250> 2024-09-12T17:35:14.940+0000 7fe38d12c800 10 monclient: shutdown 2024-09-12T17:35:15.244 INFO:tasks.workunit.client.0.smithi037.stderr: -249> 2024-09-12T17:35:14.940+0000 7fe38d12c800 10 monclient: build_initial_monmap 2024-09-12T17:35:15.244 INFO:tasks.workunit.client.0.smithi037.stderr: -248> 2024-09-12T17:35:14.940+0000 7fe38d12c800 1 build_initial for_mkfs: 0 2024-09-12T17:35:15.244 INFO:tasks.workunit.client.0.smithi037.stderr: -247> 2024-09-12T17:35:14.940+0000 7fe38d12c800 10 monclient: monmap: 2024-09-12T17:35:15.244 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 0 2024-09-12T17:35:15.244 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:35:15.244 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 0.000000 2024-09-12T17:35:15.244 INFO:tasks.workunit.client.0.smithi037.stderr:created 0.000000 2024-09-12T17:35:15.244 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 0 (unknown) 2024-09-12T17:35:15.244 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:35:15.244 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.noname-a 2024-09-12T17:35:15.244 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.noname-b 2024-09-12T17:35:15.245 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.noname-c 2024-09-12T17:35:15.245 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:35:15.245 INFO:tasks.workunit.client.0.smithi037.stderr: -246> 2024-09-12T17:35:14.940+0000 7fe38d12c800 5 AuthRegistry(0x563c0c583d90) adding auth protocol: cephx 2024-09-12T17:35:15.245 INFO:tasks.workunit.client.0.smithi037.stderr: -245> 2024-09-12T17:35:14.940+0000 7fe38d12c800 5 AuthRegistry(0x563c0c583d90) adding auth protocol: cephx 2024-09-12T17:35:15.245 INFO:tasks.workunit.client.0.smithi037.stderr: -244> 2024-09-12T17:35:14.940+0000 7fe38d12c800 5 AuthRegistry(0x563c0c583d90) adding auth protocol: cephx 2024-09-12T17:35:15.245 INFO:tasks.workunit.client.0.smithi037.stderr: -243> 2024-09-12T17:35:14.940+0000 7fe38d12c800 5 AuthRegistry(0x563c0c583d90) adding con mode: secure 2024-09-12T17:35:15.245 INFO:tasks.workunit.client.0.smithi037.stderr: -242> 2024-09-12T17:35:14.940+0000 7fe38d12c800 5 AuthRegistry(0x563c0c583d90) adding con mode: crc 2024-09-12T17:35:15.245 INFO:tasks.workunit.client.0.smithi037.stderr: -241> 2024-09-12T17:35:14.940+0000 7fe38d12c800 5 AuthRegistry(0x563c0c583d90) adding con mode: secure 2024-09-12T17:35:15.245 INFO:tasks.workunit.client.0.smithi037.stderr: -240> 2024-09-12T17:35:14.940+0000 7fe38d12c800 5 AuthRegistry(0x563c0c583d90) adding con mode: crc 2024-09-12T17:35:15.245 INFO:tasks.workunit.client.0.smithi037.stderr: -239> 2024-09-12T17:35:14.940+0000 7fe38d12c800 5 AuthRegistry(0x563c0c583d90) adding con mode: secure 2024-09-12T17:35:15.245 INFO:tasks.workunit.client.0.smithi037.stderr: -238> 2024-09-12T17:35:14.940+0000 7fe38d12c800 5 AuthRegistry(0x563c0c583d90) adding con mode: crc 2024-09-12T17:35:15.245 INFO:tasks.workunit.client.0.smithi037.stderr: -237> 2024-09-12T17:35:14.940+0000 7fe38d12c800 5 AuthRegistry(0x563c0c583d90) adding con mode: crc 2024-09-12T17:35:15.245 INFO:tasks.workunit.client.0.smithi037.stderr: -236> 2024-09-12T17:35:14.940+0000 7fe38d12c800 5 AuthRegistry(0x563c0c583d90) adding con mode: secure 2024-09-12T17:35:15.246 INFO:tasks.workunit.client.0.smithi037.stderr: -235> 2024-09-12T17:35:14.940+0000 7fe38d12c800 5 AuthRegistry(0x563c0c583d90) adding con mode: crc 2024-09-12T17:35:15.246 INFO:tasks.workunit.client.0.smithi037.stderr: -234> 2024-09-12T17:35:14.940+0000 7fe38d12c800 5 AuthRegistry(0x563c0c583d90) adding con mode: secure 2024-09-12T17:35:15.246 INFO:tasks.workunit.client.0.smithi037.stderr: -233> 2024-09-12T17:35:14.940+0000 7fe38d12c800 5 AuthRegistry(0x563c0c583d90) adding con mode: crc 2024-09-12T17:35:15.246 INFO:tasks.workunit.client.0.smithi037.stderr: -232> 2024-09-12T17:35:14.940+0000 7fe38d12c800 5 AuthRegistry(0x563c0c583d90) adding con mode: secure 2024-09-12T17:35:15.246 INFO:tasks.workunit.client.0.smithi037.stderr: -231> 2024-09-12T17:35:14.940+0000 7fe38d12c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:35:15.246 INFO:tasks.workunit.client.0.smithi037.stderr: -230> 2024-09-12T17:35:14.940+0000 7fe38d12c800 1 librados: starting msgr at 2024-09-12T17:35:15.246 INFO:tasks.workunit.client.0.smithi037.stderr: -229> 2024-09-12T17:35:14.940+0000 7fe38d12c800 1 librados: starting objecter 2024-09-12T17:35:15.246 INFO:tasks.workunit.client.0.smithi037.stderr: -228> 2024-09-12T17:35:14.940+0000 7fe38d12c800 5 asok(0x563c0c296730) register_command objecter_requests cmddesc objecter_requests hook 0x563c0c534c90 EEXIST 2024-09-12T17:35:15.246 INFO:tasks.workunit.client.0.smithi037.stderr: -227> 2024-09-12T17:35:14.940+0000 7fe38d12c800 1 librados: setting wanted keys 2024-09-12T17:35:15.246 INFO:tasks.workunit.client.0.smithi037.stderr: -226> 2024-09-12T17:35:14.940+0000 7fe38d12c800 1 librados: calling monclient init 2024-09-12T17:35:15.246 INFO:tasks.workunit.client.0.smithi037.stderr: -225> 2024-09-12T17:35:14.940+0000 7fe38d12c800 10 monclient: init 2024-09-12T17:35:15.246 INFO:tasks.workunit.client.0.smithi037.stderr: -224> 2024-09-12T17:35:14.940+0000 7fe38d12c800 5 AuthRegistry(0x563c0c54c3c0) adding auth protocol: cephx 2024-09-12T17:35:15.246 INFO:tasks.workunit.client.0.smithi037.stderr: -223> 2024-09-12T17:35:14.940+0000 7fe38d12c800 5 AuthRegistry(0x563c0c54c3c0) adding auth protocol: cephx 2024-09-12T17:35:15.246 INFO:tasks.workunit.client.0.smithi037.stderr: -222> 2024-09-12T17:35:14.940+0000 7fe38d12c800 5 AuthRegistry(0x563c0c54c3c0) adding auth protocol: cephx 2024-09-12T17:35:15.247 INFO:tasks.workunit.client.0.smithi037.stderr: -221> 2024-09-12T17:35:14.940+0000 7fe38d12c800 5 AuthRegistry(0x563c0c54c3c0) adding con mode: secure 2024-09-12T17:35:15.247 INFO:tasks.workunit.client.0.smithi037.stderr: -220> 2024-09-12T17:35:14.940+0000 7fe38d12c800 5 AuthRegistry(0x563c0c54c3c0) adding con mode: crc 2024-09-12T17:35:15.247 INFO:tasks.workunit.client.0.smithi037.stderr: -219> 2024-09-12T17:35:14.940+0000 7fe38d12c800 5 AuthRegistry(0x563c0c54c3c0) adding con mode: secure 2024-09-12T17:35:15.247 INFO:tasks.workunit.client.0.smithi037.stderr: -218> 2024-09-12T17:35:14.940+0000 7fe38d12c800 5 AuthRegistry(0x563c0c54c3c0) adding con mode: crc 2024-09-12T17:35:15.247 INFO:tasks.workunit.client.0.smithi037.stderr: -217> 2024-09-12T17:35:14.940+0000 7fe38d12c800 5 AuthRegistry(0x563c0c54c3c0) adding con mode: secure 2024-09-12T17:35:15.247 INFO:tasks.workunit.client.0.smithi037.stderr: -216> 2024-09-12T17:35:14.941+0000 7fe38d12c800 5 AuthRegistry(0x563c0c54c3c0) adding con mode: crc 2024-09-12T17:35:15.247 INFO:tasks.workunit.client.0.smithi037.stderr: -215> 2024-09-12T17:35:14.941+0000 7fe38d12c800 5 AuthRegistry(0x563c0c54c3c0) adding con mode: crc 2024-09-12T17:35:15.247 INFO:tasks.workunit.client.0.smithi037.stderr: -214> 2024-09-12T17:35:14.941+0000 7fe38d12c800 5 AuthRegistry(0x563c0c54c3c0) adding con mode: secure 2024-09-12T17:35:15.247 INFO:tasks.workunit.client.0.smithi037.stderr: -213> 2024-09-12T17:35:14.941+0000 7fe38d12c800 5 AuthRegistry(0x563c0c54c3c0) adding con mode: crc 2024-09-12T17:35:15.247 INFO:tasks.workunit.client.0.smithi037.stderr: -212> 2024-09-12T17:35:14.941+0000 7fe38d12c800 5 AuthRegistry(0x563c0c54c3c0) adding con mode: secure 2024-09-12T17:35:15.247 INFO:tasks.workunit.client.0.smithi037.stderr: -211> 2024-09-12T17:35:14.941+0000 7fe38d12c800 5 AuthRegistry(0x563c0c54c3c0) adding con mode: crc 2024-09-12T17:35:15.247 INFO:tasks.workunit.client.0.smithi037.stderr: -210> 2024-09-12T17:35:14.941+0000 7fe38d12c800 5 AuthRegistry(0x563c0c54c3c0) adding con mode: secure 2024-09-12T17:35:15.247 INFO:tasks.workunit.client.0.smithi037.stderr: -209> 2024-09-12T17:35:14.941+0000 7fe38d12c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:35:15.248 INFO:tasks.workunit.client.0.smithi037.stderr: -208> 2024-09-12T17:35:14.941+0000 7fe38d12c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:35:15.248 INFO:tasks.workunit.client.0.smithi037.stderr: -207> 2024-09-12T17:35:14.941+0000 7fe38d12c800 5 asok(0x563c0c296730) register_command rotate-key cmddesc rotate-key hook 0x563c0c54c508 EEXIST 2024-09-12T17:35:15.248 INFO:tasks.workunit.client.0.smithi037.stderr: -206> 2024-09-12T17:35:14.941+0000 7fe38d12c800 10 monclient: _reopen_session rank -1 2024-09-12T17:35:15.248 INFO:tasks.workunit.client.0.smithi037.stderr: -205> 2024-09-12T17:35:14.941+0000 7fe38d12c800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T17:35:15.248 INFO:tasks.workunit.client.0.smithi037.stderr: -204> 2024-09-12T17:35:14.941+0000 7fe38d12c800 10 monclient(hunting): picked mon.noname-a con 0x563c0c558670 addr [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] 2024-09-12T17:35:15.248 INFO:tasks.workunit.client.0.smithi037.stderr: -203> 2024-09-12T17:35:14.941+0000 7fe38d12c800 10 monclient(hunting): picked mon.noname-b con 0x563c0c582dd0 addr [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] 2024-09-12T17:35:15.248 INFO:tasks.workunit.client.0.smithi037.stderr: -202> 2024-09-12T17:35:14.941+0000 7fe38d12c800 10 monclient(hunting): picked mon.noname-c con 0x563c0c588830 addr [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] 2024-09-12T17:35:15.248 INFO:tasks.workunit.client.0.smithi037.stderr: -201> 2024-09-12T17:35:14.941+0000 7fe38d12c800 10 monclient(hunting): start opening mon connection 2024-09-12T17:35:15.248 INFO:tasks.workunit.client.0.smithi037.stderr: -200> 2024-09-12T17:35:14.941+0000 7fe38d12c800 10 monclient(hunting): start opening mon connection 2024-09-12T17:35:15.248 INFO:tasks.workunit.client.0.smithi037.stderr: -199> 2024-09-12T17:35:14.941+0000 7fe38d12c800 10 monclient(hunting): start opening mon connection 2024-09-12T17:35:15.248 INFO:tasks.workunit.client.0.smithi037.stderr: -198> 2024-09-12T17:35:14.941+0000 7fe38d12c800 10 monclient(hunting): _renew_subs 2024-09-12T17:35:15.248 INFO:tasks.workunit.client.0.smithi037.stderr: -197> 2024-09-12T17:35:14.941+0000 7fe38d12c800 10 monclient(hunting): authenticate will time out at 2302.538531s 2024-09-12T17:35:15.248 INFO:tasks.workunit.client.0.smithi037.stderr: -196> 2024-09-12T17:35:14.941+0000 7fe388e4f640 10 monclient(hunting): get_auth_request con 0x563c0c558670 auth_method 0 2024-09-12T17:35:15.249 INFO:tasks.workunit.client.0.smithi037.stderr: -195> 2024-09-12T17:35:14.941+0000 7fe388e4f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:35:15.249 INFO:tasks.workunit.client.0.smithi037.stderr: -194> 2024-09-12T17:35:14.941+0000 7fe388e4f640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:35:15.249 INFO:tasks.workunit.client.0.smithi037.stderr: -193> 2024-09-12T17:35:14.941+0000 7fe388e4f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:35:15.249 INFO:tasks.workunit.client.0.smithi037.stderr: -192> 2024-09-12T17:35:14.941+0000 7fe389650640 10 monclient(hunting): get_auth_request con 0x563c0c588830 auth_method 0 2024-09-12T17:35:15.249 INFO:tasks.workunit.client.0.smithi037.stderr: -191> 2024-09-12T17:35:14.941+0000 7fe389650640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:35:15.249 INFO:tasks.workunit.client.0.smithi037.stderr: -190> 2024-09-12T17:35:14.941+0000 7fe389650640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:35:15.249 INFO:tasks.workunit.client.0.smithi037.stderr: -189> 2024-09-12T17:35:14.941+0000 7fe389650640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:35:15.249 INFO:tasks.workunit.client.0.smithi037.stderr: -188> 2024-09-12T17:35:14.941+0000 7fe388e4f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:35:15.249 INFO:tasks.workunit.client.0.smithi037.stderr: -187> 2024-09-12T17:35:14.941+0000 7fe388e4f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:35:15.249 INFO:tasks.workunit.client.0.smithi037.stderr: -186> 2024-09-12T17:35:14.941+0000 7fe388e4f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:35:15.249 INFO:tasks.workunit.client.0.smithi037.stderr: -185> 2024-09-12T17:35:14.941+0000 7fe389650640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:35:15.249 INFO:tasks.workunit.client.0.smithi037.stderr: -184> 2024-09-12T17:35:14.941+0000 7fe389650640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:35:15.249 INFO:tasks.workunit.client.0.smithi037.stderr: -183> 2024-09-12T17:35:14.941+0000 7fe389650640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:35:15.249 INFO:tasks.workunit.client.0.smithi037.stderr: -182> 2024-09-12T17:35:14.941+0000 7fe388e4f640 10 monclient(hunting): handle_auth_done global_id 7569 payload 824 2024-09-12T17:35:15.250 INFO:tasks.workunit.client.0.smithi037.stderr: -181> 2024-09-12T17:35:14.941+0000 7fe388e4f640 10 monclient: _finish_hunting 0 2024-09-12T17:35:15.250 INFO:tasks.workunit.client.0.smithi037.stderr: -180> 2024-09-12T17:35:14.941+0000 7fe388e4f640 1 monclient: found mon.noname-a 2024-09-12T17:35:15.250 INFO:tasks.workunit.client.0.smithi037.stderr: -179> 2024-09-12T17:35:14.941+0000 7fe388e4f640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.37:3300/0 2024-09-12T17:35:15.250 INFO:tasks.workunit.client.0.smithi037.stderr: -178> 2024-09-12T17:35:14.941+0000 7fe38864e640 10 monclient: get_auth_request con 0x563c0c582dd0 auth_method 0 2024-09-12T17:35:15.250 INFO:tasks.workunit.client.0.smithi037.stderr: -177> 2024-09-12T17:35:14.942+0000 7fe25e7fc640 10 monclient: ms_handle_reset current mon [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] 2024-09-12T17:35:15.250 INFO:tasks.workunit.client.0.smithi037.stderr: -176> 2024-09-12T17:35:14.942+0000 7fe25e7fc640 10 monclient: _reopen_session rank -1 2024-09-12T17:35:15.250 INFO:tasks.workunit.client.0.smithi037.stderr: -175> 2024-09-12T17:35:14.942+0000 7fe25e7fc640 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T17:35:15.250 INFO:tasks.workunit.client.0.smithi037.stderr: -174> 2024-09-12T17:35:14.942+0000 7fe25e7fc640 10 monclient(hunting): picked mon.noname-a con 0x7fe2540020c0 addr [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] 2024-09-12T17:35:15.250 INFO:tasks.workunit.client.0.smithi037.stderr: -173> 2024-09-12T17:35:14.942+0000 7fe25e7fc640 10 monclient(hunting): picked mon.noname-b con 0x563c0c582dd0 addr [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] 2024-09-12T17:35:15.250 INFO:tasks.workunit.client.0.smithi037.stderr: -172> 2024-09-12T17:35:14.942+0000 7fe25e7fc640 10 monclient(hunting): picked mon.noname-c con 0x563c0c588830 addr [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] 2024-09-12T17:35:15.250 INFO:tasks.workunit.client.0.smithi037.stderr: -171> 2024-09-12T17:35:14.942+0000 7fe25e7fc640 10 monclient(hunting): start opening mon connection 2024-09-12T17:35:15.250 INFO:tasks.workunit.client.0.smithi037.stderr: -170> 2024-09-12T17:35:14.942+0000 7fe25e7fc640 10 monclient(hunting): start opening mon connection 2024-09-12T17:35:15.250 INFO:tasks.workunit.client.0.smithi037.stderr: -169> 2024-09-12T17:35:14.942+0000 7fe25e7fc640 10 monclient(hunting): start opening mon connection 2024-09-12T17:35:15.251 INFO:tasks.workunit.client.0.smithi037.stderr: -168> 2024-09-12T17:35:14.942+0000 7fe25e7fc640 10 monclient(hunting): _renew_subs 2024-09-12T17:35:15.251 INFO:tasks.workunit.client.0.smithi037.stderr: -167> 2024-09-12T17:35:14.942+0000 7fe388e4f640 10 monclient(hunting): get_auth_request con 0x7fe2540020c0 auth_method 0 2024-09-12T17:35:15.251 INFO:tasks.workunit.client.0.smithi037.stderr: -166> 2024-09-12T17:35:14.942+0000 7fe388e4f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:35:15.251 INFO:tasks.workunit.client.0.smithi037.stderr: -165> 2024-09-12T17:35:14.942+0000 7fe388e4f640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:35:15.251 INFO:tasks.workunit.client.0.smithi037.stderr: -164> 2024-09-12T17:35:14.942+0000 7fe388e4f640 10 monclient(hunting): _init_auth already have auth, reseting 2024-09-12T17:35:15.251 INFO:tasks.workunit.client.0.smithi037.stderr: -163> 2024-09-12T17:35:14.942+0000 7fe389650640 10 monclient(hunting): get_auth_request con 0x563c0c588830 auth_method 0 2024-09-12T17:35:15.251 INFO:tasks.workunit.client.0.smithi037.stderr: -162> 2024-09-12T17:35:14.942+0000 7fe389650640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:35:15.251 INFO:tasks.workunit.client.0.smithi037.stderr: -161> 2024-09-12T17:35:14.942+0000 7fe389650640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:35:15.251 INFO:tasks.workunit.client.0.smithi037.stderr: -160> 2024-09-12T17:35:14.942+0000 7fe389650640 10 monclient(hunting): _init_auth already have auth, reseting 2024-09-12T17:35:15.251 INFO:tasks.workunit.client.0.smithi037.stderr: -159> 2024-09-12T17:35:14.942+0000 7fe38864e640 10 monclient(hunting): get_auth_request con 0x563c0c582dd0 auth_method 0 2024-09-12T17:35:15.252 INFO:tasks.workunit.client.0.smithi037.stderr: -158> 2024-09-12T17:35:14.942+0000 7fe38864e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:35:15.252 INFO:tasks.workunit.client.0.smithi037.stderr: -157> 2024-09-12T17:35:14.942+0000 7fe38864e640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:35:15.252 INFO:tasks.workunit.client.0.smithi037.stderr: -156> 2024-09-12T17:35:14.942+0000 7fe38864e640 10 monclient(hunting): _init_auth already have auth, reseting 2024-09-12T17:35:15.252 INFO:tasks.workunit.client.0.smithi037.stderr: -155> 2024-09-12T17:35:14.942+0000 7fe388e4f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:35:15.252 INFO:tasks.workunit.client.0.smithi037.stderr: -154> 2024-09-12T17:35:14.942+0000 7fe388e4f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:35:15.252 INFO:tasks.workunit.client.0.smithi037.stderr: -153> 2024-09-12T17:35:14.942+0000 7fe388e4f640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-09-12T17:35:15.252 INFO:tasks.workunit.client.0.smithi037.stderr: -152> 2024-09-12T17:35:14.942+0000 7fe389650640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:35:15.252 INFO:tasks.workunit.client.0.smithi037.stderr: -151> 2024-09-12T17:35:14.942+0000 7fe389650640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:35:15.252 INFO:tasks.workunit.client.0.smithi037.stderr: -150> 2024-09-12T17:35:14.942+0000 7fe389650640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-09-12T17:35:15.252 INFO:tasks.workunit.client.0.smithi037.stderr: -149> 2024-09-12T17:35:14.942+0000 7fe38864e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:35:15.252 INFO:tasks.workunit.client.0.smithi037.stderr: -148> 2024-09-12T17:35:14.942+0000 7fe38864e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:35:15.252 INFO:tasks.workunit.client.0.smithi037.stderr: -147> 2024-09-12T17:35:14.942+0000 7fe38864e640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-09-12T17:35:15.253 INFO:tasks.workunit.client.0.smithi037.stderr: -146> 2024-09-12T17:35:14.942+0000 7fe388e4f640 10 monclient(hunting): handle_auth_done global_id 7569 payload 293 2024-09-12T17:35:15.253 INFO:tasks.workunit.client.0.smithi037.stderr: -145> 2024-09-12T17:35:14.942+0000 7fe388e4f640 10 monclient: _finish_hunting 0 2024-09-12T17:35:15.253 INFO:tasks.workunit.client.0.smithi037.stderr: -144> 2024-09-12T17:35:14.942+0000 7fe388e4f640 1 monclient: found mon.noname-a 2024-09-12T17:35:15.253 INFO:tasks.workunit.client.0.smithi037.stderr: -143> 2024-09-12T17:35:14.942+0000 7fe388e4f640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.37:3300/0 2024-09-12T17:35:15.253 INFO:tasks.workunit.client.0.smithi037.stderr: -142> 2024-09-12T17:35:14.942+0000 7fe25e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:35:15.253 INFO:tasks.workunit.client.0.smithi037.stderr: -141> 2024-09-12T17:35:14.942+0000 7fe25e7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:35:15.253 INFO:tasks.workunit.client.0.smithi037.stderr: -140> 2024-09-12T17:35:14.942+0000 7fe25e7fc640 10 monclient: dump: 2024-09-12T17:35:15.253 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:35:15.253 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:35:15.253 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:35:15.253 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:35:15.253 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:35:15.253 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:35:15.253 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:35:15.254 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:35:15.254 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:35:15.254 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:35:15.254 INFO:tasks.workunit.client.0.smithi037.stderr: -139> 2024-09-12T17:35:14.942+0000 7fe25e7fc640 10 monclient: _finish_auth 0 2024-09-12T17:35:15.254 INFO:tasks.workunit.client.0.smithi037.stderr: -138> 2024-09-12T17:35:14.942+0000 7fe25e7fc640 10 monclient: _check_auth_tickets 2024-09-12T17:35:15.254 INFO:tasks.workunit.client.0.smithi037.stderr: -137> 2024-09-12T17:35:14.942+0000 7fe25e7fc640 10 monclient: handle_config config(0 keys) 2024-09-12T17:35:15.254 INFO:tasks.workunit.client.0.smithi037.stderr: -136> 2024-09-12T17:35:14.942+0000 7fe25e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:35:15.254 INFO:tasks.workunit.client.0.smithi037.stderr: -135> 2024-09-12T17:35:14.942+0000 7fe25e7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:35:15.254 INFO:tasks.workunit.client.0.smithi037.stderr: -134> 2024-09-12T17:35:14.942+0000 7fe25e7fc640 10 monclient: dump: 2024-09-12T17:35:15.254 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:35:15.254 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:35:15.254 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:35:15.254 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:35:15.254 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:35:15.255 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:35:15.255 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:35:15.255 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:35:15.255 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:35:15.255 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:35:15.255 INFO:tasks.workunit.client.0.smithi037.stderr: -133> 2024-09-12T17:35:14.942+0000 7fe38d12c800 5 monclient: authenticate success, global_id 7569 2024-09-12T17:35:15.255 INFO:tasks.workunit.client.0.smithi037.stderr: -132> 2024-09-12T17:35:14.942+0000 7fe38d12c800 10 monclient: _renew_subs 2024-09-12T17:35:15.255 INFO:tasks.workunit.client.0.smithi037.stderr: -131> 2024-09-12T17:35:14.942+0000 7fe38d12c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.37:3300/0 2024-09-12T17:35:15.255 INFO:tasks.workunit.client.0.smithi037.stderr: -130> 2024-09-12T17:35:14.942+0000 7fe25ffff640 4 set_mon_vals no callback set 2024-09-12T17:35:15.255 INFO:tasks.workunit.client.0.smithi037.stderr: -129> 2024-09-12T17:35:14.942+0000 7fe38d12c800 10 monclient: _renew_subs 2024-09-12T17:35:15.255 INFO:tasks.workunit.client.0.smithi037.stderr: -128> 2024-09-12T17:35:14.942+0000 7fe38d12c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.37:3300/0 2024-09-12T17:35:15.255 INFO:tasks.workunit.client.0.smithi037.stderr: -127> 2024-09-12T17:35:14.942+0000 7fe38d12c800 1 librados: init done 2024-09-12T17:35:15.255 INFO:tasks.workunit.client.0.smithi037.stderr: -126> 2024-09-12T17:35:14.942+0000 7fe38d12c800 5 asok(0x563c0c296730) register_command cr dump hook 0x563c0c5581f8 2024-09-12T17:35:15.256 INFO:tasks.workunit.client.0.smithi037.stderr: -125> 2024-09-12T17:35:14.944+0000 7fe38d12c800 20 rados->read ofs=0 len=0 2024-09-12T17:35:15.256 INFO:tasks.workunit.client.0.smithi037.stderr: -124> 2024-09-12T17:35:14.945+0000 7fe25e7fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:35:15.256 INFO:tasks.workunit.client.0.smithi037.stderr: -123> 2024-09-12T17:35:14.945+0000 7fe25e7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.40:6816/3916250676,v1:172.21.15.40:6817/3916250676] 2024-09-12T17:35:15.256 INFO:tasks.workunit.client.0.smithi037.stderr: -122> 2024-09-12T17:35:14.945+0000 7fe25e7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.40:6816/3916250676,v1:172.21.15.40:6817/3916250676] 2024-09-12T17:35:15.256 INFO:tasks.workunit.client.0.smithi037.stderr: -121> 2024-09-12T17:35:14.945+0000 7fe38864e640 10 monclient: get_auth_request con 0x563c0c558670 auth_method 0 2024-09-12T17:35:15.256 INFO:tasks.workunit.client.0.smithi037.stderr: -120> 2024-09-12T17:35:14.945+0000 7fe389650640 10 monclient: get_auth_request con 0x563c0c59b8f0 auth_method 0 2024-09-12T17:35:15.256 INFO:tasks.workunit.client.0.smithi037.stderr: -119> 2024-09-12T17:35:14.946+0000 7fe38d12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:15.256 INFO:tasks.workunit.client.0.smithi037.stderr: -118> 2024-09-12T17:35:14.946+0000 7fe38d12c800 20 realm 2024-09-12T17:35:15.256 INFO:tasks.workunit.client.0.smithi037.stderr: -117> 2024-09-12T17:35:14.946+0000 7fe38d12c800 20 rados->read ofs=0 len=0 2024-09-12T17:35:15.256 INFO:tasks.workunit.client.0.smithi037.stderr: -116> 2024-09-12T17:35:14.946+0000 7fe38d12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:15.256 INFO:tasks.workunit.client.0.smithi037.stderr: -115> 2024-09-12T17:35:14.946+0000 7fe38d12c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:35:15.256 INFO:tasks.workunit.client.0.smithi037.stderr: -114> 2024-09-12T17:35:14.946+0000 7fe38d12c800 20 rados->read ofs=0 len=0 2024-09-12T17:35:15.256 INFO:tasks.workunit.client.0.smithi037.stderr: -113> 2024-09-12T17:35:14.946+0000 7fe38d12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:15.257 INFO:tasks.workunit.client.0.smithi037.stderr: -112> 2024-09-12T17:35:14.946+0000 7fe38d12c800 20 rados->read ofs=0 len=0 2024-09-12T17:35:15.257 INFO:tasks.workunit.client.0.smithi037.stderr: -111> 2024-09-12T17:35:14.946+0000 7fe388e4f640 10 monclient: get_auth_request con 0x563c0c59fbb0 auth_method 0 2024-09-12T17:35:15.257 INFO:tasks.workunit.client.0.smithi037.stderr: -110> 2024-09-12T17:35:14.947+0000 7fe38d12c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:35:15.257 INFO:tasks.workunit.client.0.smithi037.stderr: -109> 2024-09-12T17:35:14.947+0000 7fe38d12c800 20 rados->read ofs=0 len=0 2024-09-12T17:35:15.257 INFO:tasks.workunit.client.0.smithi037.stderr: -108> 2024-09-12T17:35:14.947+0000 7fe38d12c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:35:15.257 INFO:tasks.workunit.client.0.smithi037.stderr: -107> 2024-09-12T17:35:14.947+0000 7fe38d12c800 20 searching for the correct realm 2024-09-12T17:35:15.257 INFO:tasks.workunit.client.0.smithi037.stderr: -106> 2024-09-12T17:35:14.947+0000 7fe38864e640 10 monclient: get_auth_request con 0x563c0c5a4d80 auth_method 0 2024-09-12T17:35:15.257 INFO:tasks.workunit.client.0.smithi037.stderr: -105> 2024-09-12T17:35:14.948+0000 7fe389650640 10 monclient: get_auth_request con 0x7fe37c0480f0 auth_method 0 2024-09-12T17:35:15.257 INFO:tasks.workunit.client.0.smithi037.stderr: -104> 2024-09-12T17:35:14.949+0000 7fe388e4f640 10 monclient: get_auth_request con 0x7fe380012970 auth_method 0 2024-09-12T17:35:15.257 INFO:tasks.workunit.client.0.smithi037.stderr: -103> 2024-09-12T17:35:14.949+0000 7fe388e4f640 0 -- 172.21.15.37:0/976055060 >> [v2:172.21.15.37:6800/1206746176,v1:172.21.15.37:6801/1206746176] conn(0x7fe380012970 msgr2=0x7fe380010440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:35:15.257 INFO:tasks.workunit.client.0.smithi037.stderr: -102> 2024-09-12T17:35:15.150+0000 7fe388e4f640 10 monclient: get_auth_request con 0x7fe380012970 auth_method 0 2024-09-12T17:35:15.257 INFO:tasks.workunit.client.0.smithi037.stderr: -101> 2024-09-12T17:35:15.151+0000 7fe38864e640 10 monclient: get_auth_request con 0x7fe378080040 auth_method 0 2024-09-12T17:35:15.257 INFO:tasks.workunit.client.0.smithi037.stderr: -100> 2024-09-12T17:35:15.153+0000 7fe389650640 10 monclient: get_auth_request con 0x7fe37c096180 auth_method 0 2024-09-12T17:35:15.258 INFO:tasks.workunit.client.0.smithi037.stderr: -99> 2024-09-12T17:35:15.154+0000 7fe389650640 0 -- 172.21.15.37:0/976055060 >> [v2:172.21.15.40:6818/1210108009,v1:172.21.15.40:6819/1210108009] conn(0x7fe37c0480f0 msgr2=0x7fe37c055ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:35:15.258 INFO:tasks.workunit.client.0.smithi037.stderr: -98> 2024-09-12T17:35:15.154+0000 7fe25e7fc640 1 client.7569.objecter ms_handle_reset 0x7fe37c0480f0 session 0x7fe37c051070 osd.7 2024-09-12T17:35:15.258 INFO:tasks.workunit.client.0.smithi037.stderr: -97> 2024-09-12T17:35:15.154+0000 7fe25e7fc640 10 monclient: _renew_subs 2024-09-12T17:35:15.258 INFO:tasks.workunit.client.0.smithi037.stderr: -96> 2024-09-12T17:35:15.154+0000 7fe25e7fc640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.37:3300/0 2024-09-12T17:35:15.258 INFO:tasks.workunit.client.0.smithi037.stderr: -95> 2024-09-12T17:35:15.155+0000 7fe389650640 10 monclient: get_auth_request con 0x7fe25408e610 auth_method 0 2024-09-12T17:35:15.258 INFO:tasks.workunit.client.0.smithi037.stderr: -94> 2024-09-12T17:35:15.156+0000 7fe388e4f640 10 monclient: get_auth_request con 0x7fe37c0613f0 auth_method 0 2024-09-12T17:35:15.258 INFO:tasks.workunit.client.0.smithi037.stderr: -93> 2024-09-12T17:35:15.161+0000 7fe38d12c800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:35:15.258 INFO:tasks.workunit.client.0.smithi037.stderr: -92> 2024-09-12T17:35:15.161+0000 7fe38d12c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:35:15.258 INFO:tasks.workunit.client.0.smithi037.stderr: -91> 2024-09-12T17:35:15.161+0000 7fe38d12c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:35:15.258 INFO:tasks.workunit.client.0.smithi037.stderr: -90> 2024-09-12T17:35:15.161+0000 7fe38d12c800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:35:15.258 INFO:tasks.workunit.client.0.smithi037.stderr: -89> 2024-09-12T17:35:15.161+0000 7fe38d12c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:35:15.258 INFO:tasks.workunit.client.0.smithi037.stderr: -88> 2024-09-12T17:35:15.161+0000 7fe38d12c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:35:15.258 INFO:tasks.workunit.client.0.smithi037.stderr: -87> 2024-09-12T17:35:15.161+0000 7fe38d12c800 20 rados->read ofs=0 len=0 2024-09-12T17:35:15.259 INFO:tasks.workunit.client.0.smithi037.stderr: -86> 2024-09-12T17:35:15.161+0000 7fe38d12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:15.259 INFO:tasks.workunit.client.0.smithi037.stderr: -85> 2024-09-12T17:35:15.161+0000 7fe38d12c800 20 rados->read ofs=0 len=0 2024-09-12T17:35:15.259 INFO:tasks.workunit.client.0.smithi037.stderr: -84> 2024-09-12T17:35:15.162+0000 7fe38d12c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:35:15.259 INFO:tasks.workunit.client.0.smithi037.stderr: -83> 2024-09-12T17:35:15.162+0000 7fe38d12c800 20 rados->read ofs=0 len=0 2024-09-12T17:35:15.259 INFO:tasks.workunit.client.0.smithi037.stderr: -82> 2024-09-12T17:35:15.162+0000 7fe38d12c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:35:15.259 INFO:tasks.workunit.client.0.smithi037.stderr: -81> 2024-09-12T17:35:15.162+0000 7fe38d12c800 20 zone default found 2024-09-12T17:35:15.259 INFO:tasks.workunit.client.0.smithi037.stderr: -80> 2024-09-12T17:35:15.162+0000 7fe38d12c800 4 Realm: () 2024-09-12T17:35:15.259 INFO:tasks.workunit.client.0.smithi037.stderr: -79> 2024-09-12T17:35:15.162+0000 7fe38d12c800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:35:15.259 INFO:tasks.workunit.client.0.smithi037.stderr: -78> 2024-09-12T17:35:15.162+0000 7fe38d12c800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:35:15.259 INFO:tasks.workunit.client.0.smithi037.stderr: -77> 2024-09-12T17:35:15.162+0000 7fe38d12c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:35:15.259 INFO:tasks.workunit.client.0.smithi037.stderr: -76> 2024-09-12T17:35:15.162+0000 7fe38d12c800 20 zonegroup default 2024-09-12T17:35:15.259 INFO:tasks.workunit.client.0.smithi037.stderr: -75> 2024-09-12T17:35:15.162+0000 7fe38d12c800 20 rados->read ofs=0 len=0 2024-09-12T17:35:15.259 INFO:tasks.workunit.client.0.smithi037.stderr: -74> 2024-09-12T17:35:15.162+0000 7fe38d12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:15.259 INFO:tasks.workunit.client.0.smithi037.stderr: -73> 2024-09-12T17:35:15.162+0000 7fe38d12c800 20 rados->read ofs=0 len=0 2024-09-12T17:35:15.260 INFO:tasks.workunit.client.0.smithi037.stderr: -72> 2024-09-12T17:35:15.163+0000 7fe38d12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:15.260 INFO:tasks.workunit.client.0.smithi037.stderr: -71> 2024-09-12T17:35:15.163+0000 7fe38d12c800 20 rados->read ofs=0 len=0 2024-09-12T17:35:15.260 INFO:tasks.workunit.client.0.smithi037.stderr: -70> 2024-09-12T17:35:15.163+0000 7fe38d12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:15.260 INFO:tasks.workunit.client.0.smithi037.stderr: -69> 2024-09-12T17:35:15.163+0000 7fe38d12c800 20 started sync module instance, tier type = 2024-09-12T17:35:15.260 INFO:tasks.workunit.client.0.smithi037.stderr: -68> 2024-09-12T17:35:15.163+0000 7fe38d12c800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:35:15.260 INFO:tasks.workunit.client.0.smithi037.stderr: -67> 2024-09-12T17:35:15.174+0000 7fe38d12c800 20 add_watcher() i=0 2024-09-12T17:35:15.260 INFO:tasks.workunit.client.0.smithi037.stderr: -66> 2024-09-12T17:35:15.174+0000 7fe38d12c800 20 add_watcher() i=1 2024-09-12T17:35:15.260 INFO:tasks.workunit.client.0.smithi037.stderr: -65> 2024-09-12T17:35:15.174+0000 7fe38d12c800 20 add_watcher() i=2 2024-09-12T17:35:15.260 INFO:tasks.workunit.client.0.smithi037.stderr: -64> 2024-09-12T17:35:15.174+0000 7fe38d12c800 20 add_watcher() i=3 2024-09-12T17:35:15.261 INFO:tasks.workunit.client.0.smithi037.stderr: -63> 2024-09-12T17:35:15.174+0000 7fe38d12c800 20 add_watcher() i=4 2024-09-12T17:35:15.261 INFO:tasks.workunit.client.0.smithi037.stderr: -62> 2024-09-12T17:35:15.174+0000 7fe38d12c800 20 add_watcher() i=5 2024-09-12T17:35:15.261 INFO:tasks.workunit.client.0.smithi037.stderr: -61> 2024-09-12T17:35:15.174+0000 7fe38d12c800 20 add_watcher() i=6 2024-09-12T17:35:15.261 INFO:tasks.workunit.client.0.smithi037.stderr: -60> 2024-09-12T17:35:15.175+0000 7fe38d12c800 20 add_watcher() i=7 2024-09-12T17:35:15.261 INFO:tasks.workunit.client.0.smithi037.stderr: -59> 2024-09-12T17:35:15.176+0000 7fe38d12c800 2 all 8 watchers are set, enabling cache 2024-09-12T17:35:15.261 INFO:tasks.workunit.client.0.smithi037.stderr: -58> 2024-09-12T17:35:15.177+0000 7fe38d12c800 5 AuthRegistry(0x7ffc663b3330) adding auth protocol: cephx 2024-09-12T17:35:15.261 INFO:tasks.workunit.client.0.smithi037.stderr: -57> 2024-09-12T17:35:15.177+0000 7fe38d12c800 5 AuthRegistry(0x7ffc663b3330) adding auth protocol: cephx 2024-09-12T17:35:15.261 INFO:tasks.workunit.client.0.smithi037.stderr: -56> 2024-09-12T17:35:15.177+0000 7fe38d12c800 5 AuthRegistry(0x7ffc663b3330) adding auth protocol: cephx 2024-09-12T17:35:15.261 INFO:tasks.workunit.client.0.smithi037.stderr: -55> 2024-09-12T17:35:15.177+0000 7fe38d12c800 5 AuthRegistry(0x7ffc663b3330) adding con mode: secure 2024-09-12T17:35:15.261 INFO:tasks.workunit.client.0.smithi037.stderr: -54> 2024-09-12T17:35:15.177+0000 7fe38d12c800 5 AuthRegistry(0x7ffc663b3330) adding con mode: crc 2024-09-12T17:35:15.261 INFO:tasks.workunit.client.0.smithi037.stderr: -53> 2024-09-12T17:35:15.177+0000 7fe38d12c800 5 AuthRegistry(0x7ffc663b3330) adding con mode: secure 2024-09-12T17:35:15.261 INFO:tasks.workunit.client.0.smithi037.stderr: -52> 2024-09-12T17:35:15.177+0000 7fe38d12c800 5 AuthRegistry(0x7ffc663b3330) adding con mode: crc 2024-09-12T17:35:15.262 INFO:tasks.workunit.client.0.smithi037.stderr: -51> 2024-09-12T17:35:15.177+0000 7fe38d12c800 5 AuthRegistry(0x7ffc663b3330) adding con mode: secure 2024-09-12T17:35:15.262 INFO:tasks.workunit.client.0.smithi037.stderr: -50> 2024-09-12T17:35:15.177+0000 7fe38d12c800 5 AuthRegistry(0x7ffc663b3330) adding con mode: crc 2024-09-12T17:35:15.262 INFO:tasks.workunit.client.0.smithi037.stderr: -49> 2024-09-12T17:35:15.177+0000 7fe38d12c800 5 AuthRegistry(0x7ffc663b3330) adding con mode: crc 2024-09-12T17:35:15.262 INFO:tasks.workunit.client.0.smithi037.stderr: -48> 2024-09-12T17:35:15.177+0000 7fe38d12c800 5 AuthRegistry(0x7ffc663b3330) adding con mode: secure 2024-09-12T17:35:15.262 INFO:tasks.workunit.client.0.smithi037.stderr: -47> 2024-09-12T17:35:15.177+0000 7fe38d12c800 5 AuthRegistry(0x7ffc663b3330) adding con mode: crc 2024-09-12T17:35:15.262 INFO:tasks.workunit.client.0.smithi037.stderr: -46> 2024-09-12T17:35:15.177+0000 7fe38d12c800 5 AuthRegistry(0x7ffc663b3330) adding con mode: secure 2024-09-12T17:35:15.262 INFO:tasks.workunit.client.0.smithi037.stderr: -45> 2024-09-12T17:35:15.177+0000 7fe38d12c800 5 AuthRegistry(0x7ffc663b3330) adding con mode: crc 2024-09-12T17:35:15.262 INFO:tasks.workunit.client.0.smithi037.stderr: -44> 2024-09-12T17:35:15.177+0000 7fe38d12c800 5 AuthRegistry(0x7ffc663b3330) adding con mode: secure 2024-09-12T17:35:15.262 INFO:tasks.workunit.client.0.smithi037.stderr: -43> 2024-09-12T17:35:15.177+0000 7fe23efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:35:15.262 INFO:tasks.workunit.client.0.smithi037.stderr: -42> 2024-09-12T17:35:15.178+0000 7fe38d12c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:35:15.262 INFO:tasks.workunit.client.0.smithi037.stderr: -41> 2024-09-12T17:35:15.178+0000 7fe38d12c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:35:15.262 INFO:tasks.workunit.client.0.smithi037.stderr: -40> 2024-09-12T17:35:15.178+0000 7fe38d12c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:35:15.262 INFO:tasks.workunit.client.0.smithi037.stderr: -39> 2024-09-12T17:35:15.178+0000 7fe38d12c800 5 asok(0x563c0c296730) register_command cache list hook 0x563c0c583bf0 2024-09-12T17:35:15.262 INFO:tasks.workunit.client.0.smithi037.stderr: -38> 2024-09-12T17:35:15.178+0000 7fe38d12c800 5 asok(0x563c0c296730) register_command cache inspect hook 0x563c0c583bf0 2024-09-12T17:35:15.263 INFO:tasks.workunit.client.0.smithi037.stderr: -37> 2024-09-12T17:35:15.178+0000 7fe38d12c800 5 asok(0x563c0c296730) register_command cache erase hook 0x563c0c583bf0 2024-09-12T17:35:15.263 INFO:tasks.workunit.client.0.smithi037.stderr: -36> 2024-09-12T17:35:15.178+0000 7fe38d12c800 5 asok(0x563c0c296730) register_command cache zap hook 0x563c0c583bf0 2024-09-12T17:35:15.263 INFO:tasks.workunit.client.0.smithi037.stderr: -35> 2024-09-12T17:35:15.178+0000 7fe38d12c800 5 note: GC not initialized 2024-09-12T17:35:15.263 INFO:tasks.workunit.client.0.smithi037.stderr: -34> 2024-09-12T17:35:15.178+0000 7fe23dfe3640 20 reqs_thread_entry: start 2024-09-12T17:35:15.263 INFO:tasks.workunit.client.0.smithi037.stderr: -33> 2024-09-12T17:35:15.178+0000 7fe38d12c800 5 asok(0x563c0c296730) register_command sync trace show hook 0x7fe37c088070 2024-09-12T17:35:15.263 INFO:tasks.workunit.client.0.smithi037.stderr: -32> 2024-09-12T17:35:15.178+0000 7fe38d12c800 5 asok(0x563c0c296730) register_command sync trace history hook 0x7fe37c088070 2024-09-12T17:35:15.263 INFO:tasks.workunit.client.0.smithi037.stderr: -31> 2024-09-12T17:35:15.178+0000 7fe38d12c800 5 asok(0x563c0c296730) register_command sync trace active hook 0x7fe37c088070 2024-09-12T17:35:15.263 INFO:tasks.workunit.client.0.smithi037.stderr: -30> 2024-09-12T17:35:15.178+0000 7fe38d12c800 5 asok(0x563c0c296730) register_command sync trace active_short hook 0x7fe37c088070 2024-09-12T17:35:15.263 INFO:tasks.workunit.client.0.smithi037.stderr: -29> 2024-09-12T17:35:15.178+0000 7fe38d12c800 20 init_complete bucket index max shards: 11 2024-09-12T17:35:15.263 INFO:tasks.workunit.client.0.smithi037.stderr: -28> 2024-09-12T17:35:15.178+0000 7fe38d12c800 20 Filter name: none 2024-09-12T17:35:15.263 INFO:tasks.workunit.client.0.smithi037.stderr: -27> 2024-09-12T17:35:15.178+0000 7fe1af7fe640 20 reqs_thread_entry: start 2024-09-12T17:35:15.263 INFO:tasks.workunit.client.0.smithi037.stderr: -26> 2024-09-12T17:35:15.178+0000 7fe38d12c800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-12T17:35:15.263 INFO:tasks.workunit.client.0.smithi037.stderr: -25> 2024-09-12T17:35:15.178+0000 7fe38d12c800 20 rados->read ofs=0 len=0 2024-09-12T17:35:15.263 INFO:tasks.workunit.client.0.smithi037.stderr: -24> 2024-09-12T17:35:15.179+0000 7fe38d12c800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:35:15.264 INFO:tasks.workunit.client.0.smithi037.stderr: -23> 2024-09-12T17:35:15.179+0000 7fe38d12c800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-12T17:35:15.264 INFO:tasks.workunit.client.0.smithi037.stderr: -22> 2024-09-12T17:35:15.179+0000 7fe38d12c800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-12T17:35:15.264 INFO:tasks.workunit.client.0.smithi037.stderr: -21> 2024-09-12T17:35:15.179+0000 7fe38d12c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.35 : miss 2024-09-12T17:35:15.264 INFO:tasks.workunit.client.0.smithi037.stderr: -20> 2024-09-12T17:35:15.179+0000 7fe38d12c800 20 rados->read ofs=0 len=0 2024-09-12T17:35:15.264 INFO:tasks.workunit.client.0.smithi037.stderr: -19> 2024-09-12T17:35:15.180+0000 7fe38d12c800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:35:15.264 INFO:tasks.workunit.client.0.smithi037.stderr: -18> 2024-09-12T17:35:15.180+0000 7fe38d12c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.35 info.flags=0x17 2024-09-12T17:35:15.264 INFO:tasks.workunit.client.0.smithi037.stderr: -17> 2024-09-12T17:35:15.180+0000 7fe38d12c800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.35 to cache LRU end 2024-09-12T17:35:15.264 INFO:tasks.workunit.client.0.smithi037.stderr: -16> 2024-09-12T17:35:15.180+0000 7fe38d12c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:35:15.264 INFO:tasks.workunit.client.0.smithi037.stderr: -15> 2024-09-12T17:35:15.180+0000 7fe38d12c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:35:15.264 INFO:tasks.workunit.client.0.smithi037.stderr: -14> 2024-09-12T17:35:15.180+0000 7fe38d12c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.35 2024-09-12T17:35:15.264 INFO:tasks.workunit.client.0.smithi037.stderr: -13> 2024-09-12T17:35:15.186+0000 7fe38d12c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.35 info.flags=0x17 2024-09-12T17:35:15.264 INFO:tasks.workunit.client.0.smithi037.stderr: -12> 2024-09-12T17:35:15.186+0000 7fe38d12c800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.35 to cache LRU end 2024-09-12T17:35:15.264 INFO:tasks.workunit.client.0.smithi037.stderr: -11> 2024-09-12T17:35:15.186+0000 7fe38d12c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:35:15.265 INFO:tasks.workunit.client.0.smithi037.stderr: -10> 2024-09-12T17:35:15.186+0000 7fe38d12c800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.35, ofs0, ns] 2024-09-12T17:35:15.265 INFO:tasks.workunit.client.0.smithi037.stderr: -9> 2024-09-12T17:35:15.187+0000 7fe25f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496983 cookie 94815905296992 notifier 7569 bl.length()=995 2024-09-12T17:35:15.265 INFO:tasks.workunit.client.0.smithi037.stderr: -8> 2024-09-12T17:35:15.187+0000 7fe25f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.35 info.flags=0x17 2024-09-12T17:35:15.265 INFO:tasks.workunit.client.0.smithi037.stderr: -7> 2024-09-12T17:35:15.187+0000 7fe25f7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.35 to cache LRU end 2024-09-12T17:35:15.265 INFO:tasks.workunit.client.0.smithi037.stderr: -6> 2024-09-12T17:35:15.187+0000 7fe25f7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:35:15.265 INFO:tasks.workunit.client.0.smithi037.stderr: -5> 2024-09-12T17:35:15.188+0000 7fe38d12c800 20 handle_bi_update(): bucket=:abort-at-do-reshard[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.35]): orig_sources= new_sources= 2024-09-12T17:35:15.265 INFO:tasks.workunit.client.0.smithi037.stderr: -4> 2024-09-12T17:35:15.188+0000 7fe38d12c800 20 handle_bi_update(): bucket=:abort-at-do-reshard[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.35]): potential sources added=[] removed=[] 2024-09-12T17:35:15.265 INFO:tasks.workunit.client.0.smithi037.stderr: -3> 2024-09-12T17:35:15.188+0000 7fe38d12c800 20 handle_bi_update(): bucket=:abort-at-do-reshard[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.35]): orig_dests= new_dests= 2024-09-12T17:35:15.265 INFO:tasks.workunit.client.0.smithi037.stderr: -2> 2024-09-12T17:35:15.188+0000 7fe38d12c800 20 handle_bi_update(): bucket=:abort-at-do-reshard[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.35]): potential dests added=[] removed=[] 2024-09-12T17:35:15.265 INFO:tasks.workunit.client.0.smithi037.stderr: -1> 2024-09-12T17:35:15.194+0000 7fe38d12c800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fe38d12c800 time 2024-09-12T17:35:15.194817+0000 2024-09-12T17:35:15.265 INFO:tasks.workunit.client.0.smithi037.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:35:15.265 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:35:15.265 INFO:tasks.workunit.client.0.smithi037.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:35:15.265 INFO:tasks.workunit.client.0.smithi037.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fe38e98c71a] 2024-09-12T17:35:15.266 INFO:tasks.workunit.client.0.smithi037.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fe38e98c8d8] 2024-09-12T17:35:15.266 INFO:tasks.workunit.client.0.smithi037.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x563c0a84a841] 2024-09-12T17:35:15.266 INFO:tasks.workunit.client.0.smithi037.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x563c0a85a57a] 2024-09-12T17:35:15.266 INFO:tasks.workunit.client.0.smithi037.stderr: 5: main() 2024-09-12T17:35:15.266 INFO:tasks.workunit.client.0.smithi037.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7fe38d629590] 2024-09-12T17:35:15.266 INFO:tasks.workunit.client.0.smithi037.stderr: 7: __libc_start_main() 2024-09-12T17:35:15.266 INFO:tasks.workunit.client.0.smithi037.stderr: 8: _start() 2024-09-12T17:35:15.266 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:35:15.266 INFO:tasks.workunit.client.0.smithi037.stderr: 0> 2024-09-12T17:35:15.195+0000 7fe38d12c800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:35:15.266 INFO:tasks.workunit.client.0.smithi037.stderr: in thread 7fe38d12c800 thread_name:radosgw-admin 2024-09-12T17:35:15.266 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:35:15.266 INFO:tasks.workunit.client.0.smithi037.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:35:15.266 INFO:tasks.workunit.client.0.smithi037.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fe38d63e6f0] 2024-09-12T17:35:15.266 INFO:tasks.workunit.client.0.smithi037.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fe38d68b99c] 2024-09-12T17:35:15.266 INFO:tasks.workunit.client.0.smithi037.stderr: 3: raise() 2024-09-12T17:35:15.266 INFO:tasks.workunit.client.0.smithi037.stderr: 4: abort() 2024-09-12T17:35:15.267 INFO:tasks.workunit.client.0.smithi037.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fe38e98c774] 2024-09-12T17:35:15.267 INFO:tasks.workunit.client.0.smithi037.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fe38e98c8d8] 2024-09-12T17:35:15.267 INFO:tasks.workunit.client.0.smithi037.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x563c0a84a841] 2024-09-12T17:35:15.267 INFO:tasks.workunit.client.0.smithi037.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x563c0a85a57a] 2024-09-12T17:35:15.267 INFO:tasks.workunit.client.0.smithi037.stderr: 9: main() 2024-09-12T17:35:15.267 INFO:tasks.workunit.client.0.smithi037.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7fe38d629590] 2024-09-12T17:35:15.267 INFO:tasks.workunit.client.0.smithi037.stderr: 11: __libc_start_main() 2024-09-12T17:35:15.267 INFO:tasks.workunit.client.0.smithi037.stderr: 12: _start() 2024-09-12T17:35:15.267 INFO:tasks.workunit.client.0.smithi037.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:35:15.267 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:35:15.267 INFO:tasks.workunit.client.0.smithi037.stderr:--- logging levels --- 2024-09-12T17:35:15.267 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 none 2024-09-12T17:35:15.267 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 lockdep 2024-09-12T17:35:15.267 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 context 2024-09-12T17:35:15.267 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 1 crush 2024-09-12T17:35:15.268 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mds 2024-09-12T17:35:15.268 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mds_balancer 2024-09-12T17:35:15.268 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mds_locker 2024-09-12T17:35:15.268 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mds_log 2024-09-12T17:35:15.268 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mds_log_expire 2024-09-12T17:35:15.268 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mds_migrator 2024-09-12T17:35:15.268 INFO:tasks.workunit.client.0.smithi037.stderr: 3/ 5 mds_quiesce 2024-09-12T17:35:15.268 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 buffer 2024-09-12T17:35:15.268 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 timer 2024-09-12T17:35:15.268 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 filer 2024-09-12T17:35:15.268 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 striper 2024-09-12T17:35:15.268 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 objecter 2024-09-12T17:35:15.268 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 rados 2024-09-12T17:35:15.268 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 rbd 2024-09-12T17:35:15.269 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 rbd_mirror 2024-09-12T17:35:15.269 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 rbd_replay 2024-09-12T17:35:15.269 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 rbd_pwl 2024-09-12T17:35:15.269 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 journaler 2024-09-12T17:35:15.269 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 objectcacher 2024-09-12T17:35:15.269 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:35:15.269 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 client 2024-09-12T17:35:15.269 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 osd 2024-09-12T17:35:15.269 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 optracker 2024-09-12T17:35:15.269 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 objclass 2024-09-12T17:35:15.269 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 3 filestore 2024-09-12T17:35:15.269 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 3 journal 2024-09-12T17:35:15.269 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 0 ms 2024-09-12T17:35:15.269 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mon 2024-09-12T17:35:15.270 INFO:tasks.workunit.client.0.smithi037.stderr: 0/10 monc 2024-09-12T17:35:15.270 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 paxos 2024-09-12T17:35:15.270 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 tp 2024-09-12T17:35:15.270 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 auth 2024-09-12T17:35:15.270 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 crypto 2024-09-12T17:35:15.270 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 1 finisher 2024-09-12T17:35:15.270 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 1 reserver 2024-09-12T17:35:15.270 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 heartbeatmap 2024-09-12T17:35:15.270 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 perfcounter 2024-09-12T17:35:15.270 INFO:tasks.workunit.client.0.smithi037.stderr: 20/20 rgw 2024-09-12T17:35:15.270 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 rgw_sync 2024-09-12T17:35:15.270 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 rgw_datacache 2024-09-12T17:35:15.270 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 rgw_access 2024-09-12T17:35:15.270 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:35:15.271 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 rgw_flight 2024-09-12T17:35:15.271 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:35:15.271 INFO:tasks.workunit.client.0.smithi037.stderr: 20/20 rgw_notification 2024-09-12T17:35:15.271 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 javaclient 2024-09-12T17:35:15.271 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 asok 2024-09-12T17:35:15.271 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 1 throttle 2024-09-12T17:35:15.271 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 0 refs 2024-09-12T17:35:15.271 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 compressor 2024-09-12T17:35:15.271 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 bluestore 2024-09-12T17:35:15.271 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 bluefs 2024-09-12T17:35:15.271 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 3 bdev 2024-09-12T17:35:15.271 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 kstore 2024-09-12T17:35:15.271 INFO:tasks.workunit.client.0.smithi037.stderr: 4/ 5 rocksdb 2024-09-12T17:35:15.271 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 fuse 2024-09-12T17:35:15.271 INFO:tasks.workunit.client.0.smithi037.stderr: 2/ 5 mgr 2024-09-12T17:35:15.272 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mgrc 2024-09-12T17:35:15.272 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 dpdk 2024-09-12T17:35:15.272 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 eventtrace 2024-09-12T17:35:15.272 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 prioritycache 2024-09-12T17:35:15.272 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 test 2024-09-12T17:35:15.272 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:35:15.272 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 cephsqlite 2024-09-12T17:35:15.272 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:35:15.272 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore 2024-09-12T17:35:15.272 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_onode 2024-09-12T17:35:15.272 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_odata 2024-09-12T17:35:15.272 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_omap 2024-09-12T17:35:15.272 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_tm 2024-09-12T17:35:15.272 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_t 2024-09-12T17:35:15.273 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:35:15.273 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_epm 2024-09-12T17:35:15.273 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_lba 2024-09-12T17:35:15.273 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:35:15.273 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_cache 2024-09-12T17:35:15.273 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_journal 2024-09-12T17:35:15.273 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_device 2024-09-12T17:35:15.273 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_backref 2024-09-12T17:35:15.273 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 alienstore 2024-09-12T17:35:15.273 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mclock 2024-09-12T17:35:15.273 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 cyanstore 2024-09-12T17:35:15.273 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 ceph_exporter 2024-09-12T17:35:15.273 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 memstore 2024-09-12T17:35:15.274 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 trace 2024-09-12T17:35:15.274 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 ceph_dedup 2024-09-12T17:35:15.274 INFO:tasks.workunit.client.0.smithi037.stderr: -2/-2 (syslog threshold) 2024-09-12T17:35:15.274 INFO:tasks.workunit.client.0.smithi037.stderr: 99/99 (stderr threshold) 2024-09-12T17:35:15.274 INFO:tasks.workunit.client.0.smithi037.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:35:15.274 INFO:tasks.workunit.client.0.smithi037.stderr: 7fe1af7fe640 / http_manager 2024-09-12T17:35:15.274 INFO:tasks.workunit.client.0.smithi037.stderr: 7fe23dfe3640 / http_manager 2024-09-12T17:35:15.274 INFO:tasks.workunit.client.0.smithi037.stderr: 7fe23efe5640 / rgw_dt_lg_renew 2024-09-12T17:35:15.274 INFO:tasks.workunit.client.0.smithi037.stderr: 7fe25e7fc640 / ms_dispatch 2024-09-12T17:35:15.274 INFO:tasks.workunit.client.0.smithi037.stderr: 7fe25f7fe640 / io_context_pool 2024-09-12T17:35:15.274 INFO:tasks.workunit.client.0.smithi037.stderr: 7fe25ffff640 / io_context_pool 2024-09-12T17:35:15.274 INFO:tasks.workunit.client.0.smithi037.stderr: 7fe26e7fc640 / ms_dispatch 2024-09-12T17:35:15.274 INFO:tasks.workunit.client.0.smithi037.stderr: 7fe27560a640 / ms_dispatch 2024-09-12T17:35:15.274 INFO:tasks.workunit.client.0.smithi037.stderr: 7fe276e0d640 / io_context_pool 2024-09-12T17:35:15.274 INFO:tasks.workunit.client.0.smithi037.stderr: 7fe38864e640 / msgr-worker-2 2024-09-12T17:35:15.275 INFO:tasks.workunit.client.0.smithi037.stderr: 7fe388e4f640 / msgr-worker-1 2024-09-12T17:35:15.275 INFO:tasks.workunit.client.0.smithi037.stderr: 7fe389650640 / msgr-worker-0 2024-09-12T17:35:15.275 INFO:tasks.workunit.client.0.smithi037.stderr: 7fe389e51640 / io_context_pool 2024-09-12T17:35:15.275 INFO:tasks.workunit.client.0.smithi037.stderr: 7fe38d12c800 / radosgw-admin 2024-09-12T17:35:15.275 INFO:tasks.workunit.client.0.smithi037.stderr: max_recent 500 2024-09-12T17:35:15.275 INFO:tasks.workunit.client.0.smithi037.stderr: max_new 1000 2024-09-12T17:35:15.275 INFO:tasks.workunit.client.0.smithi037.stderr: log_file /var/log/ceph/ceph-client.admin.127888.log 2024-09-12T17:35:15.275 INFO:tasks.workunit.client.0.smithi037.stderr:--- end dump of recent events --- 2024-09-12T17:35:15.275 INFO:tasks.workunit.client.0.smithi037.stderr:--- begin dump of recent events --- 2024-09-12T17:35:15.275 INFO:tasks.workunit.client.0.smithi037.stderr: -499> 2024-09-12T17:35:14.927+0000 7fe38d12c800 5 AuthRegistry(0x563c0c4b8ee0) adding auth protocol: cephx 2024-09-12T17:35:15.275 INFO:tasks.workunit.client.0.smithi037.stderr: -498> 2024-09-12T17:35:14.927+0000 7fe38d12c800 5 AuthRegistry(0x563c0c4b8ee0) adding auth protocol: cephx 2024-09-12T17:35:15.275 INFO:tasks.workunit.client.0.smithi037.stderr: -497> 2024-09-12T17:35:14.927+0000 7fe38d12c800 5 AuthRegistry(0x563c0c4b8ee0) adding auth protocol: cephx 2024-09-12T17:35:15.275 INFO:tasks.workunit.client.0.smithi037.stderr: -496> 2024-09-12T17:35:14.927+0000 7fe38d12c800 5 AuthRegistry(0x563c0c4b8ee0) adding con mode: secure 2024-09-12T17:35:15.276 INFO:tasks.workunit.client.0.smithi037.stderr: -495> 2024-09-12T17:35:14.927+0000 7fe38d12c800 5 AuthRegistry(0x563c0c4b8ee0) adding con mode: crc 2024-09-12T17:35:15.276 INFO:tasks.workunit.client.0.smithi037.stderr: -494> 2024-09-12T17:35:14.927+0000 7fe38d12c800 5 AuthRegistry(0x563c0c4b8ee0) adding con mode: secure 2024-09-12T17:35:15.276 INFO:tasks.workunit.client.0.smithi037.stderr: -493> 2024-09-12T17:35:14.927+0000 7fe38d12c800 5 AuthRegistry(0x563c0c4b8ee0) adding con mode: crc 2024-09-12T17:35:15.276 INFO:tasks.workunit.client.0.smithi037.stderr: -492> 2024-09-12T17:35:14.927+0000 7fe38d12c800 5 AuthRegistry(0x563c0c4b8ee0) adding con mode: secure 2024-09-12T17:35:15.276 INFO:tasks.workunit.client.0.smithi037.stderr: -491> 2024-09-12T17:35:14.927+0000 7fe38d12c800 5 AuthRegistry(0x563c0c4b8ee0) adding con mode: crc 2024-09-12T17:35:15.276 INFO:tasks.workunit.client.0.smithi037.stderr: -490> 2024-09-12T17:35:14.927+0000 7fe38d12c800 5 AuthRegistry(0x563c0c4b8ee0) adding con mode: crc 2024-09-12T17:35:15.276 INFO:tasks.workunit.client.0.smithi037.stderr: -489> 2024-09-12T17:35:14.927+0000 7fe38d12c800 5 AuthRegistry(0x563c0c4b8ee0) adding con mode: secure 2024-09-12T17:35:15.276 INFO:tasks.workunit.client.0.smithi037.stderr: -488> 2024-09-12T17:35:14.927+0000 7fe38d12c800 5 AuthRegistry(0x563c0c4b8ee0) adding con mode: crc 2024-09-12T17:35:15.276 INFO:tasks.workunit.client.0.smithi037.stderr: -487> 2024-09-12T17:35:14.927+0000 7fe38d12c800 5 AuthRegistry(0x563c0c4b8ee0) adding con mode: secure 2024-09-12T17:35:15.276 INFO:tasks.workunit.client.0.smithi037.stderr: -486> 2024-09-12T17:35:14.927+0000 7fe38d12c800 5 AuthRegistry(0x563c0c4b8ee0) adding con mode: crc 2024-09-12T17:35:15.276 INFO:tasks.workunit.client.0.smithi037.stderr: -485> 2024-09-12T17:35:14.927+0000 7fe38d12c800 5 AuthRegistry(0x563c0c4b8ee0) adding con mode: secure 2024-09-12T17:35:15.276 INFO:tasks.workunit.client.0.smithi037.stderr: -484> 2024-09-12T17:35:14.927+0000 7fe38d12c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:35:15.276 INFO:tasks.workunit.client.0.smithi037.stderr: -483> 2024-09-12T17:35:14.928+0000 7fe38d12c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:35:15.277 INFO:tasks.workunit.client.0.smithi037.stderr: -482> 2024-09-12T17:35:14.928+0000 7fe38d12c800 5 asok(0x563c0c296730) register_command rotate-key hook 0x563c0c4b9028 2024-09-12T17:35:15.277 INFO:tasks.workunit.client.0.smithi037.stderr: -481> 2024-09-12T17:35:14.928+0000 7fe38d12c800 10 monclient: _reopen_session rank -1 2024-09-12T17:35:15.277 INFO:tasks.workunit.client.0.smithi037.stderr: -480> 2024-09-12T17:35:14.928+0000 7fe38d12c800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T17:35:15.277 INFO:tasks.workunit.client.0.smithi037.stderr: -479> 2024-09-12T17:35:14.928+0000 7fe38d12c800 10 monclient(hunting): picked mon.noname-c con 0x563c0c3fad80 addr [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] 2024-09-12T17:35:15.277 INFO:tasks.workunit.client.0.smithi037.stderr: -478> 2024-09-12T17:35:14.928+0000 7fe38d12c800 10 monclient(hunting): picked mon.noname-a con 0x563c0c3fd9c0 addr [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] 2024-09-12T17:35:15.277 INFO:tasks.workunit.client.0.smithi037.stderr: -477> 2024-09-12T17:35:14.928+0000 7fe38d12c800 10 monclient(hunting): picked mon.noname-b con 0x563c0c400ee0 addr [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] 2024-09-12T17:35:15.277 INFO:tasks.workunit.client.0.smithi037.stderr: -476> 2024-09-12T17:35:14.928+0000 7fe38d12c800 10 monclient(hunting): start opening mon connection 2024-09-12T17:35:15.277 INFO:tasks.workunit.client.0.smithi037.stderr: -475> 2024-09-12T17:35:14.928+0000 7fe38d12c800 10 monclient(hunting): start opening mon connection 2024-09-12T17:35:15.277 INFO:tasks.workunit.client.0.smithi037.stderr: -474> 2024-09-12T17:35:14.928+0000 7fe38d12c800 10 monclient(hunting): start opening mon connection 2024-09-12T17:35:15.277 INFO:tasks.workunit.client.0.smithi037.stderr: -473> 2024-09-12T17:35:14.928+0000 7fe38d12c800 10 monclient(hunting): _renew_subs 2024-09-12T17:35:15.277 INFO:tasks.workunit.client.0.smithi037.stderr: -472> 2024-09-12T17:35:14.928+0000 7fe38d12c800 10 monclient(hunting): authenticate will time out at 2302.525194s 2024-09-12T17:35:15.277 INFO:tasks.workunit.client.0.smithi037.stderr: -471> 2024-09-12T17:35:14.928+0000 7fe388e4f640 10 monclient(hunting): get_auth_request con 0x563c0c3fad80 auth_method 0 2024-09-12T17:35:15.277 INFO:tasks.workunit.client.0.smithi037.stderr: -470> 2024-09-12T17:35:14.928+0000 7fe388e4f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:35:15.278 INFO:tasks.workunit.client.0.smithi037.stderr: -469> 2024-09-12T17:35:14.928+0000 7fe388e4f640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:35:15.278 INFO:tasks.workunit.client.0.smithi037.stderr: -468> 2024-09-12T17:35:14.928+0000 7fe388e4f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:35:15.278 INFO:tasks.workunit.client.0.smithi037.stderr: -467> 2024-09-12T17:35:14.928+0000 7fe38864e640 10 monclient(hunting): get_auth_request con 0x563c0c3fd9c0 auth_method 0 2024-09-12T17:35:15.278 INFO:tasks.workunit.client.0.smithi037.stderr: -466> 2024-09-12T17:35:14.928+0000 7fe38864e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:35:15.278 INFO:tasks.workunit.client.0.smithi037.stderr: -465> 2024-09-12T17:35:14.928+0000 7fe38864e640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:35:15.278 INFO:tasks.workunit.client.0.smithi037.stderr: -464> 2024-09-12T17:35:14.928+0000 7fe38864e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:35:15.278 INFO:tasks.workunit.client.0.smithi037.stderr: -463> 2024-09-12T17:35:14.928+0000 7fe38864e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:35:15.278 INFO:tasks.workunit.client.0.smithi037.stderr: -462> 2024-09-12T17:35:14.928+0000 7fe38864e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:35:15.278 INFO:tasks.workunit.client.0.smithi037.stderr: -461> 2024-09-12T17:35:14.928+0000 7fe38864e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:35:15.278 INFO:tasks.workunit.client.0.smithi037.stderr: -460> 2024-09-12T17:35:14.928+0000 7fe388e4f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:35:15.278 INFO:tasks.workunit.client.0.smithi037.stderr: -459> 2024-09-12T17:35:14.928+0000 7fe388e4f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:35:15.278 INFO:tasks.workunit.client.0.smithi037.stderr: -458> 2024-09-12T17:35:14.928+0000 7fe388e4f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:35:15.278 INFO:tasks.workunit.client.0.smithi037.stderr: -457> 2024-09-12T17:35:14.928+0000 7fe389650640 10 monclient(hunting): get_auth_request con 0x563c0c400ee0 auth_method 0 2024-09-12T17:35:15.278 INFO:tasks.workunit.client.0.smithi037.stderr: -456> 2024-09-12T17:35:14.928+0000 7fe389650640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:35:15.278 INFO:tasks.workunit.client.0.smithi037.stderr: -455> 2024-09-12T17:35:14.928+0000 7fe389650640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:35:15.279 INFO:tasks.workunit.client.0.smithi037.stderr: -454> 2024-09-12T17:35:14.928+0000 7fe389650640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:35:15.279 INFO:tasks.workunit.client.0.smithi037.stderr: -453> 2024-09-12T17:35:14.928+0000 7fe38864e640 10 monclient(hunting): handle_auth_done global_id 7560 payload 824 2024-09-12T17:35:15.279 INFO:tasks.workunit.client.0.smithi037.stderr: -452> 2024-09-12T17:35:14.928+0000 7fe38864e640 10 monclient: _finish_hunting 0 2024-09-12T17:35:15.279 INFO:tasks.workunit.client.0.smithi037.stderr: -451> 2024-09-12T17:35:14.928+0000 7fe38864e640 1 monclient: found mon.noname-a 2024-09-12T17:35:15.279 INFO:tasks.workunit.client.0.smithi037.stderr: -450> 2024-09-12T17:35:14.928+0000 7fe38864e640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.37:3300/0 2024-09-12T17:35:15.279 INFO:tasks.workunit.client.0.smithi037.stderr: -449> 2024-09-12T17:35:14.928+0000 7fe27560a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:35:15.279 INFO:tasks.workunit.client.0.smithi037.stderr: -448> 2024-09-12T17:35:14.928+0000 7fe27560a640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:35:15.279 INFO:tasks.workunit.client.0.smithi037.stderr: -447> 2024-09-12T17:35:14.928+0000 7fe27560a640 10 monclient: dump: 2024-09-12T17:35:15.279 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:35:15.279 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:35:15.279 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:35:15.279 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:35:15.279 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:35:15.280 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:35:15.280 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:35:15.280 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:35:15.280 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:35:15.280 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:35:15.280 INFO:tasks.workunit.client.0.smithi037.stderr: -446> 2024-09-12T17:35:14.928+0000 7fe27560a640 10 monclient: _finish_auth 0 2024-09-12T17:35:15.280 INFO:tasks.workunit.client.0.smithi037.stderr: -445> 2024-09-12T17:35:14.928+0000 7fe27560a640 10 monclient: _check_auth_tickets 2024-09-12T17:35:15.280 INFO:tasks.workunit.client.0.smithi037.stderr: -444> 2024-09-12T17:35:14.928+0000 7fe38d12c800 5 monclient: authenticate success, global_id 7560 2024-09-12T17:35:15.280 INFO:tasks.workunit.client.0.smithi037.stderr: -443> 2024-09-12T17:35:14.928+0000 7fe38d12c800 10 monclient: _renew_subs 2024-09-12T17:35:15.280 INFO:tasks.workunit.client.0.smithi037.stderr: -442> 2024-09-12T17:35:14.928+0000 7fe38d12c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.37:3300/0 2024-09-12T17:35:15.280 INFO:tasks.workunit.client.0.smithi037.stderr: -441> 2024-09-12T17:35:14.928+0000 7fe27560a640 10 monclient: handle_config config(0 keys) 2024-09-12T17:35:15.280 INFO:tasks.workunit.client.0.smithi037.stderr: -440> 2024-09-12T17:35:14.928+0000 7fe27560a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:35:15.280 INFO:tasks.workunit.client.0.smithi037.stderr: -439> 2024-09-12T17:35:14.928+0000 7fe27560a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:35:15.280 INFO:tasks.workunit.client.0.smithi037.stderr: -438> 2024-09-12T17:35:14.928+0000 7fe27560a640 10 monclient: dump: 2024-09-12T17:35:15.281 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:35:15.281 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:35:15.281 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:35:15.281 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:35:15.281 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:35:15.281 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:35:15.281 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:35:15.281 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:35:15.281 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:35:15.281 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:35:15.281 INFO:tasks.workunit.client.0.smithi037.stderr: -437> 2024-09-12T17:35:14.928+0000 7fe276e0d640 4 set_mon_vals no callback set 2024-09-12T17:35:15.281 INFO:tasks.workunit.client.0.smithi037.stderr: -436> 2024-09-12T17:35:14.928+0000 7fe38d12c800 10 monclient: _renew_subs 2024-09-12T17:35:15.281 INFO:tasks.workunit.client.0.smithi037.stderr: -435> 2024-09-12T17:35:14.928+0000 7fe38d12c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.37:3300/0 2024-09-12T17:35:15.282 INFO:tasks.workunit.client.0.smithi037.stderr: -434> 2024-09-12T17:35:14.928+0000 7fe38d12c800 1 librados: init done 2024-09-12T17:35:15.282 INFO:tasks.workunit.client.0.smithi037.stderr: -433> 2024-09-12T17:35:14.930+0000 7fe27560a640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:35:15.282 INFO:tasks.workunit.client.0.smithi037.stderr: -432> 2024-09-12T17:35:14.930+0000 7fe27560a640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.40:6816/3916250676,v1:172.21.15.40:6817/3916250676] 2024-09-12T17:35:15.282 INFO:tasks.workunit.client.0.smithi037.stderr: -431> 2024-09-12T17:35:14.930+0000 7fe27560a640 4 mgrc reconnect Starting new session with [v2:172.21.15.40:6816/3916250676,v1:172.21.15.40:6817/3916250676] 2024-09-12T17:35:15.282 INFO:tasks.workunit.client.0.smithi037.stderr: -430> 2024-09-12T17:35:14.931+0000 7fe388e4f640 10 monclient: get_auth_request con 0x7fe270076470 auth_method 0 2024-09-12T17:35:15.282 INFO:tasks.workunit.client.0.smithi037.stderr: -429> 2024-09-12T17:35:14.931+0000 7fe389650640 10 monclient: get_auth_request con 0x563c0c4fa890 auth_method 0 2024-09-12T17:35:15.282 INFO:tasks.workunit.client.0.smithi037.stderr: -428> 2024-09-12T17:35:14.932+0000 7fe388e4f640 10 monclient: get_auth_request con 0x563c0c504060 auth_method 0 2024-09-12T17:35:15.282 INFO:tasks.workunit.client.0.smithi037.stderr: -427> 2024-09-12T17:35:14.933+0000 7fe38864e640 10 monclient: get_auth_request con 0x563c0c5090f0 auth_method 0 2024-09-12T17:35:15.282 INFO:tasks.workunit.client.0.smithi037.stderr: -426> 2024-09-12T17:35:14.934+0000 7fe38d12c800 10 monclient: build_initial_monmap 2024-09-12T17:35:15.282 INFO:tasks.workunit.client.0.smithi037.stderr: -425> 2024-09-12T17:35:14.934+0000 7fe38d12c800 1 build_initial for_mkfs: 0 2024-09-12T17:35:15.282 INFO:tasks.workunit.client.0.smithi037.stderr: -424> 2024-09-12T17:35:14.934+0000 7fe38d12c800 10 monclient: monmap: 2024-09-12T17:35:15.282 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 0 2024-09-12T17:35:15.282 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:35:15.282 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 0.000000 2024-09-12T17:35:15.283 INFO:tasks.workunit.client.0.smithi037.stderr:created 0.000000 2024-09-12T17:35:15.283 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 0 (unknown) 2024-09-12T17:35:15.283 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:35:15.283 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.noname-a 2024-09-12T17:35:15.283 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.noname-b 2024-09-12T17:35:15.283 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.noname-c 2024-09-12T17:35:15.283 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:35:15.283 INFO:tasks.workunit.client.0.smithi037.stderr: -423> 2024-09-12T17:35:14.934+0000 7fe38d12c800 5 AuthRegistry(0x563c0c50cf70) adding auth protocol: cephx 2024-09-12T17:35:15.283 INFO:tasks.workunit.client.0.smithi037.stderr: -422> 2024-09-12T17:35:14.934+0000 7fe38d12c800 5 AuthRegistry(0x563c0c50cf70) adding auth protocol: cephx 2024-09-12T17:35:15.283 INFO:tasks.workunit.client.0.smithi037.stderr: -421> 2024-09-12T17:35:14.934+0000 7fe38d12c800 5 AuthRegistry(0x563c0c50cf70) adding auth protocol: cephx 2024-09-12T17:35:15.283 INFO:tasks.workunit.client.0.smithi037.stderr: -420> 2024-09-12T17:35:14.934+0000 7fe38d12c800 5 AuthRegistry(0x563c0c50cf70) adding con mode: secure 2024-09-12T17:35:15.283 INFO:tasks.workunit.client.0.smithi037.stderr: -419> 2024-09-12T17:35:14.934+0000 7fe38d12c800 5 AuthRegistry(0x563c0c50cf70) adding con mode: crc 2024-09-12T17:35:15.283 INFO:tasks.workunit.client.0.smithi037.stderr: -418> 2024-09-12T17:35:14.934+0000 7fe38d12c800 5 AuthRegistry(0x563c0c50cf70) adding con mode: secure 2024-09-12T17:35:15.284 INFO:tasks.workunit.client.0.smithi037.stderr: -417> 2024-09-12T17:35:14.934+0000 7fe38d12c800 5 AuthRegistry(0x563c0c50cf70) adding con mode: crc 2024-09-12T17:35:15.284 INFO:tasks.workunit.client.0.smithi037.stderr: -416> 2024-09-12T17:35:14.934+0000 7fe38d12c800 5 AuthRegistry(0x563c0c50cf70) adding con mode: secure 2024-09-12T17:35:15.284 INFO:tasks.workunit.client.0.smithi037.stderr: -415> 2024-09-12T17:35:14.934+0000 7fe38d12c800 5 AuthRegistry(0x563c0c50cf70) adding con mode: crc 2024-09-12T17:35:15.284 INFO:tasks.workunit.client.0.smithi037.stderr: -414> 2024-09-12T17:35:14.934+0000 7fe38d12c800 5 AuthRegistry(0x563c0c50cf70) adding con mode: crc 2024-09-12T17:35:15.284 INFO:tasks.workunit.client.0.smithi037.stderr: -413> 2024-09-12T17:35:14.934+0000 7fe38d12c800 5 AuthRegistry(0x563c0c50cf70) adding con mode: secure 2024-09-12T17:35:15.284 INFO:tasks.workunit.client.0.smithi037.stderr: -412> 2024-09-12T17:35:14.934+0000 7fe38d12c800 5 AuthRegistry(0x563c0c50cf70) adding con mode: crc 2024-09-12T17:35:15.284 INFO:tasks.workunit.client.0.smithi037.stderr: -411> 2024-09-12T17:35:14.934+0000 7fe38d12c800 5 AuthRegistry(0x563c0c50cf70) adding con mode: secure 2024-09-12T17:35:15.284 INFO:tasks.workunit.client.0.smithi037.stderr: -410> 2024-09-12T17:35:14.934+0000 7fe38d12c800 5 AuthRegistry(0x563c0c50cf70) adding con mode: crc 2024-09-12T17:35:15.284 INFO:tasks.workunit.client.0.smithi037.stderr: -409> 2024-09-12T17:35:14.934+0000 7fe38d12c800 5 AuthRegistry(0x563c0c50cf70) adding con mode: secure 2024-09-12T17:35:15.284 INFO:tasks.workunit.client.0.smithi037.stderr: -408> 2024-09-12T17:35:14.934+0000 7fe38d12c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:35:15.284 INFO:tasks.workunit.client.0.smithi037.stderr: -407> 2024-09-12T17:35:14.934+0000 7fe38d12c800 5 asok(0x563c0c296730) register_command objecter_requests cmddesc objecter_requests hook 0x563c0c510920 EEXIST 2024-09-12T17:35:15.284 INFO:tasks.workunit.client.0.smithi037.stderr: -406> 2024-09-12T17:35:14.935+0000 7fe38d12c800 10 monclient: init 2024-09-12T17:35:15.284 INFO:tasks.workunit.client.0.smithi037.stderr: -405> 2024-09-12T17:35:14.935+0000 7fe38d12c800 5 AuthRegistry(0x563c0c50bf28) adding auth protocol: cephx 2024-09-12T17:35:15.285 INFO:tasks.workunit.client.0.smithi037.stderr: -404> 2024-09-12T17:35:14.935+0000 7fe38d12c800 5 AuthRegistry(0x563c0c50bf28) adding auth protocol: cephx 2024-09-12T17:35:15.285 INFO:tasks.workunit.client.0.smithi037.stderr: -403> 2024-09-12T17:35:14.935+0000 7fe38d12c800 5 AuthRegistry(0x563c0c50bf28) adding auth protocol: cephx 2024-09-12T17:35:15.285 INFO:tasks.workunit.client.0.smithi037.stderr: -402> 2024-09-12T17:35:14.935+0000 7fe38d12c800 5 AuthRegistry(0x563c0c50bf28) adding con mode: secure 2024-09-12T17:35:15.285 INFO:tasks.workunit.client.0.smithi037.stderr: -401> 2024-09-12T17:35:14.935+0000 7fe38d12c800 5 AuthRegistry(0x563c0c50bf28) adding con mode: crc 2024-09-12T17:35:15.285 INFO:tasks.workunit.client.0.smithi037.stderr: -400> 2024-09-12T17:35:14.935+0000 7fe38d12c800 5 AuthRegistry(0x563c0c50bf28) adding con mode: secure 2024-09-12T17:35:15.285 INFO:tasks.workunit.client.0.smithi037.stderr: -399> 2024-09-12T17:35:14.935+0000 7fe38d12c800 5 AuthRegistry(0x563c0c50bf28) adding con mode: crc 2024-09-12T17:35:15.285 INFO:tasks.workunit.client.0.smithi037.stderr: -398> 2024-09-12T17:35:14.935+0000 7fe38d12c800 5 AuthRegistry(0x563c0c50bf28) adding con mode: secure 2024-09-12T17:35:15.285 INFO:tasks.workunit.client.0.smithi037.stderr: -397> 2024-09-12T17:35:14.935+0000 7fe38d12c800 5 AuthRegistry(0x563c0c50bf28) adding con mode: crc 2024-09-12T17:35:15.285 INFO:tasks.workunit.client.0.smithi037.stderr: -396> 2024-09-12T17:35:14.935+0000 7fe38d12c800 5 AuthRegistry(0x563c0c50bf28) adding con mode: crc 2024-09-12T17:35:15.285 INFO:tasks.workunit.client.0.smithi037.stderr: -395> 2024-09-12T17:35:14.935+0000 7fe38d12c800 5 AuthRegistry(0x563c0c50bf28) adding con mode: secure 2024-09-12T17:35:15.285 INFO:tasks.workunit.client.0.smithi037.stderr: -394> 2024-09-12T17:35:14.935+0000 7fe38d12c800 5 AuthRegistry(0x563c0c50bf28) adding con mode: crc 2024-09-12T17:35:15.285 INFO:tasks.workunit.client.0.smithi037.stderr: -393> 2024-09-12T17:35:14.935+0000 7fe38d12c800 5 AuthRegistry(0x563c0c50bf28) adding con mode: secure 2024-09-12T17:35:15.285 INFO:tasks.workunit.client.0.smithi037.stderr: -392> 2024-09-12T17:35:14.935+0000 7fe38d12c800 5 AuthRegistry(0x563c0c50bf28) adding con mode: crc 2024-09-12T17:35:15.285 INFO:tasks.workunit.client.0.smithi037.stderr: -391> 2024-09-12T17:35:14.935+0000 7fe38d12c800 5 AuthRegistry(0x563c0c50bf28) adding con mode: secure 2024-09-12T17:35:15.286 INFO:tasks.workunit.client.0.smithi037.stderr: -390> 2024-09-12T17:35:14.935+0000 7fe38d12c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:35:15.286 INFO:tasks.workunit.client.0.smithi037.stderr: -389> 2024-09-12T17:35:14.935+0000 7fe38d12c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:35:15.286 INFO:tasks.workunit.client.0.smithi037.stderr: -388> 2024-09-12T17:35:14.935+0000 7fe38d12c800 5 asok(0x563c0c296730) register_command rotate-key cmddesc rotate-key hook 0x563c0c50c070 EEXIST 2024-09-12T17:35:15.286 INFO:tasks.workunit.client.0.smithi037.stderr: -387> 2024-09-12T17:35:14.935+0000 7fe38d12c800 10 monclient: _reopen_session rank -1 2024-09-12T17:35:15.286 INFO:tasks.workunit.client.0.smithi037.stderr: -386> 2024-09-12T17:35:14.935+0000 7fe38d12c800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T17:35:15.286 INFO:tasks.workunit.client.0.smithi037.stderr: -385> 2024-09-12T17:35:14.935+0000 7fe38d12c800 10 monclient(hunting): picked mon.noname-a con 0x563c0c534610 addr [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] 2024-09-12T17:35:15.286 INFO:tasks.workunit.client.0.smithi037.stderr: -384> 2024-09-12T17:35:14.935+0000 7fe38d12c800 10 monclient(hunting): picked mon.noname-c con 0x563c0c5368e0 addr [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] 2024-09-12T17:35:15.286 INFO:tasks.workunit.client.0.smithi037.stderr: -383> 2024-09-12T17:35:14.935+0000 7fe38d12c800 10 monclient(hunting): picked mon.noname-b con 0x563c0c532de0 addr [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] 2024-09-12T17:35:15.286 INFO:tasks.workunit.client.0.smithi037.stderr: -382> 2024-09-12T17:35:14.935+0000 7fe38d12c800 10 monclient(hunting): start opening mon connection 2024-09-12T17:35:15.286 INFO:tasks.workunit.client.0.smithi037.stderr: -381> 2024-09-12T17:35:14.935+0000 7fe38d12c800 10 monclient(hunting): start opening mon connection 2024-09-12T17:35:15.286 INFO:tasks.workunit.client.0.smithi037.stderr: -380> 2024-09-12T17:35:14.935+0000 7fe38d12c800 10 monclient(hunting): start opening mon connection 2024-09-12T17:35:15.286 INFO:tasks.workunit.client.0.smithi037.stderr: -379> 2024-09-12T17:35:14.935+0000 7fe38d12c800 10 monclient(hunting): _renew_subs 2024-09-12T17:35:15.286 INFO:tasks.workunit.client.0.smithi037.stderr: -378> 2024-09-12T17:35:14.935+0000 7fe38d12c800 10 monclient(hunting): authenticate will time out at 2302.532547s 2024-09-12T17:35:15.287 INFO:tasks.workunit.client.0.smithi037.stderr: -377> 2024-09-12T17:35:14.935+0000 7fe38864e640 10 monclient(hunting): get_auth_request con 0x563c0c5368e0 auth_method 0 2024-09-12T17:35:15.287 INFO:tasks.workunit.client.0.smithi037.stderr: -376> 2024-09-12T17:35:14.935+0000 7fe38864e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:35:15.287 INFO:tasks.workunit.client.0.smithi037.stderr: -375> 2024-09-12T17:35:14.935+0000 7fe38864e640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:35:15.287 INFO:tasks.workunit.client.0.smithi037.stderr: -374> 2024-09-12T17:35:14.935+0000 7fe38864e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:35:15.287 INFO:tasks.workunit.client.0.smithi037.stderr: -373> 2024-09-12T17:35:14.935+0000 7fe388e4f640 10 monclient(hunting): get_auth_request con 0x563c0c534610 auth_method 0 2024-09-12T17:35:15.287 INFO:tasks.workunit.client.0.smithi037.stderr: -372> 2024-09-12T17:35:14.935+0000 7fe388e4f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:35:15.287 INFO:tasks.workunit.client.0.smithi037.stderr: -371> 2024-09-12T17:35:14.935+0000 7fe388e4f640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:35:15.287 INFO:tasks.workunit.client.0.smithi037.stderr: -370> 2024-09-12T17:35:14.935+0000 7fe388e4f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:35:15.287 INFO:tasks.workunit.client.0.smithi037.stderr: -369> 2024-09-12T17:35:14.935+0000 7fe389650640 10 monclient(hunting): get_auth_request con 0x563c0c532de0 auth_method 0 2024-09-12T17:35:15.287 INFO:tasks.workunit.client.0.smithi037.stderr: -368> 2024-09-12T17:35:14.935+0000 7fe389650640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:35:15.287 INFO:tasks.workunit.client.0.smithi037.stderr: -367> 2024-09-12T17:35:14.935+0000 7fe389650640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:35:15.287 INFO:tasks.workunit.client.0.smithi037.stderr: -366> 2024-09-12T17:35:14.935+0000 7fe389650640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:35:15.287 INFO:tasks.workunit.client.0.smithi037.stderr: -365> 2024-09-12T17:35:14.935+0000 7fe38864e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:35:15.287 INFO:tasks.workunit.client.0.smithi037.stderr: -364> 2024-09-12T17:35:14.935+0000 7fe38864e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:35:15.288 INFO:tasks.workunit.client.0.smithi037.stderr: -363> 2024-09-12T17:35:14.935+0000 7fe38864e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:35:15.288 INFO:tasks.workunit.client.0.smithi037.stderr: -362> 2024-09-12T17:35:14.935+0000 7fe388e4f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:35:15.288 INFO:tasks.workunit.client.0.smithi037.stderr: -361> 2024-09-12T17:35:14.935+0000 7fe388e4f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:35:15.288 INFO:tasks.workunit.client.0.smithi037.stderr: -360> 2024-09-12T17:35:14.935+0000 7fe388e4f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:35:15.288 INFO:tasks.workunit.client.0.smithi037.stderr: -359> 2024-09-12T17:35:14.935+0000 7fe389650640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:35:15.288 INFO:tasks.workunit.client.0.smithi037.stderr: -358> 2024-09-12T17:35:14.935+0000 7fe389650640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:35:15.288 INFO:tasks.workunit.client.0.smithi037.stderr: -357> 2024-09-12T17:35:14.935+0000 7fe389650640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:35:15.288 INFO:tasks.workunit.client.0.smithi037.stderr: -356> 2024-09-12T17:35:14.935+0000 7fe38864e640 10 monclient(hunting): handle_auth_done global_id 7085 payload 824 2024-09-12T17:35:15.288 INFO:tasks.workunit.client.0.smithi037.stderr: -355> 2024-09-12T17:35:14.935+0000 7fe38864e640 10 monclient: _finish_hunting 0 2024-09-12T17:35:15.288 INFO:tasks.workunit.client.0.smithi037.stderr: -354> 2024-09-12T17:35:14.935+0000 7fe38864e640 1 monclient: found mon.noname-c 2024-09-12T17:35:15.288 INFO:tasks.workunit.client.0.smithi037.stderr: -353> 2024-09-12T17:35:14.935+0000 7fe38864e640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.37:3301/0 2024-09-12T17:35:15.288 INFO:tasks.workunit.client.0.smithi037.stderr: -352> 2024-09-12T17:35:14.936+0000 7fe26e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:35:15.288 INFO:tasks.workunit.client.0.smithi037.stderr: -351> 2024-09-12T17:35:14.936+0000 7fe26e7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:35:15.289 INFO:tasks.workunit.client.0.smithi037.stderr: -350> 2024-09-12T17:35:14.936+0000 7fe26e7fc640 10 monclient: dump: 2024-09-12T17:35:15.289 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:35:15.289 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:35:15.289 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:35:15.289 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:35:15.289 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:35:15.289 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:35:15.289 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:35:15.289 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:35:15.289 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:35:15.289 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:35:15.289 INFO:tasks.workunit.client.0.smithi037.stderr: -349> 2024-09-12T17:35:14.936+0000 7fe26e7fc640 10 monclient: _finish_auth 0 2024-09-12T17:35:15.289 INFO:tasks.workunit.client.0.smithi037.stderr: -348> 2024-09-12T17:35:14.936+0000 7fe26e7fc640 10 monclient: _check_auth_tickets 2024-09-12T17:35:15.290 INFO:tasks.workunit.client.0.smithi037.stderr: -347> 2024-09-12T17:35:14.936+0000 7fe26e7fc640 10 monclient: handle_config config(0 keys) 2024-09-12T17:35:15.290 INFO:tasks.workunit.client.0.smithi037.stderr: -346> 2024-09-12T17:35:14.936+0000 7fe26e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:35:15.290 INFO:tasks.workunit.client.0.smithi037.stderr: -345> 2024-09-12T17:35:14.936+0000 7fe26e7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:35:15.290 INFO:tasks.workunit.client.0.smithi037.stderr: -344> 2024-09-12T17:35:14.936+0000 7fe26e7fc640 10 monclient: dump: 2024-09-12T17:35:15.290 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:35:15.290 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:35:15.290 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:35:15.290 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:35:15.290 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:35:15.290 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:35:15.290 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:35:15.290 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:35:15.290 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:35:15.291 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:35:15.291 INFO:tasks.workunit.client.0.smithi037.stderr: -343> 2024-09-12T17:35:14.936+0000 7fe38d12c800 5 monclient: authenticate success, global_id 7085 2024-09-12T17:35:15.291 INFO:tasks.workunit.client.0.smithi037.stderr: -342> 2024-09-12T17:35:14.936+0000 7fe38d12c800 10 monclient: _renew_subs 2024-09-12T17:35:15.291 INFO:tasks.workunit.client.0.smithi037.stderr: -341> 2024-09-12T17:35:14.936+0000 7fe389e51640 4 set_mon_vals no callback set 2024-09-12T17:35:15.291 INFO:tasks.workunit.client.0.smithi037.stderr: -340> 2024-09-12T17:35:14.936+0000 7fe38d12c800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.37:3301/0 2024-09-12T17:35:15.291 INFO:tasks.workunit.client.0.smithi037.stderr: -339> 2024-09-12T17:35:14.936+0000 7fe38d12c800 10 monclient: _renew_subs 2024-09-12T17:35:15.291 INFO:tasks.workunit.client.0.smithi037.stderr: -338> 2024-09-12T17:35:14.936+0000 7fe38d12c800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.37:3301/0 2024-09-12T17:35:15.291 INFO:tasks.workunit.client.0.smithi037.stderr: -337> 2024-09-12T17:35:14.937+0000 7fe26e7fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:35:15.291 INFO:tasks.workunit.client.0.smithi037.stderr: -336> 2024-09-12T17:35:14.937+0000 7fe26e7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.40:6816/3916250676,v1:172.21.15.40:6817/3916250676] 2024-09-12T17:35:15.291 INFO:tasks.workunit.client.0.smithi037.stderr: -335> 2024-09-12T17:35:14.937+0000 7fe26e7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.40:6816/3916250676,v1:172.21.15.40:6817/3916250676] 2024-09-12T17:35:15.291 INFO:tasks.workunit.client.0.smithi037.stderr: -334> 2024-09-12T17:35:14.938+0000 7fe388e4f640 10 monclient: get_auth_request con 0x7fe260076380 auth_method 0 2024-09-12T17:35:15.291 INFO:tasks.workunit.client.0.smithi037.stderr: -333> 2024-09-12T17:35:14.938+0000 7fe38d12c800 10 monclient: get_monmap_and_config 2024-09-12T17:35:15.291 INFO:tasks.workunit.client.0.smithi037.stderr: -332> 2024-09-12T17:35:14.938+0000 7fe38d12c800 10 monclient: build_initial_monmap 2024-09-12T17:35:15.291 INFO:tasks.workunit.client.0.smithi037.stderr: -331> 2024-09-12T17:35:14.938+0000 7fe38d12c800 1 build_initial for_mkfs: 0 2024-09-12T17:35:15.292 INFO:tasks.workunit.client.0.smithi037.stderr: -330> 2024-09-12T17:35:14.938+0000 7fe38d12c800 10 monclient: monmap: 2024-09-12T17:35:15.292 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 0 2024-09-12T17:35:15.292 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:35:15.292 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 0.000000 2024-09-12T17:35:15.292 INFO:tasks.workunit.client.0.smithi037.stderr:created 0.000000 2024-09-12T17:35:15.292 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 0 (unknown) 2024-09-12T17:35:15.292 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:35:15.292 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.noname-a 2024-09-12T17:35:15.292 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.noname-b 2024-09-12T17:35:15.292 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.noname-c 2024-09-12T17:35:15.292 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:35:15.292 INFO:tasks.workunit.client.0.smithi037.stderr: -329> 2024-09-12T17:35:14.938+0000 7fe38d12c800 5 AuthRegistry(0x563c0c5542b0) adding auth protocol: cephx 2024-09-12T17:35:15.292 INFO:tasks.workunit.client.0.smithi037.stderr: -328> 2024-09-12T17:35:14.938+0000 7fe38d12c800 5 AuthRegistry(0x563c0c5542b0) adding auth protocol: cephx 2024-09-12T17:35:15.293 INFO:tasks.workunit.client.0.smithi037.stderr: -327> 2024-09-12T17:35:14.938+0000 7fe38d12c800 5 AuthRegistry(0x563c0c5542b0) adding auth protocol: cephx 2024-09-12T17:35:15.293 INFO:tasks.workunit.client.0.smithi037.stderr: -326> 2024-09-12T17:35:14.938+0000 7fe38d12c800 5 AuthRegistry(0x563c0c5542b0) adding con mode: secure 2024-09-12T17:35:15.293 INFO:tasks.workunit.client.0.smithi037.stderr: -325> 2024-09-12T17:35:14.938+0000 7fe38d12c800 5 AuthRegistry(0x563c0c5542b0) adding con mode: crc 2024-09-12T17:35:15.293 INFO:tasks.workunit.client.0.smithi037.stderr: -324> 2024-09-12T17:35:14.938+0000 7fe38d12c800 5 AuthRegistry(0x563c0c5542b0) adding con mode: secure 2024-09-12T17:35:15.293 INFO:tasks.workunit.client.0.smithi037.stderr: -323> 2024-09-12T17:35:14.938+0000 7fe38d12c800 5 AuthRegistry(0x563c0c5542b0) adding con mode: crc 2024-09-12T17:35:15.293 INFO:tasks.workunit.client.0.smithi037.stderr: -322> 2024-09-12T17:35:14.938+0000 7fe38d12c800 5 AuthRegistry(0x563c0c5542b0) adding con mode: secure 2024-09-12T17:35:15.293 INFO:tasks.workunit.client.0.smithi037.stderr: -321> 2024-09-12T17:35:14.938+0000 7fe38d12c800 5 AuthRegistry(0x563c0c5542b0) adding con mode: crc 2024-09-12T17:35:15.293 INFO:tasks.workunit.client.0.smithi037.stderr: -320> 2024-09-12T17:35:14.938+0000 7fe38d12c800 5 AuthRegistry(0x563c0c5542b0) adding con mode: crc 2024-09-12T17:35:15.293 INFO:tasks.workunit.client.0.smithi037.stderr: -319> 2024-09-12T17:35:14.938+0000 7fe38d12c800 5 AuthRegistry(0x563c0c5542b0) adding con mode: secure 2024-09-12T17:35:15.293 INFO:tasks.workunit.client.0.smithi037.stderr: -318> 2024-09-12T17:35:14.938+0000 7fe38d12c800 5 AuthRegistry(0x563c0c5542b0) adding con mode: crc 2024-09-12T17:35:15.293 INFO:tasks.workunit.client.0.smithi037.stderr: -317> 2024-09-12T17:35:14.938+0000 7fe38d12c800 5 AuthRegistry(0x563c0c5542b0) adding con mode: secure 2024-09-12T17:35:15.293 INFO:tasks.workunit.client.0.smithi037.stderr: -316> 2024-09-12T17:35:14.938+0000 7fe38d12c800 5 AuthRegistry(0x563c0c5542b0) adding con mode: crc 2024-09-12T17:35:15.293 INFO:tasks.workunit.client.0.smithi037.stderr: -315> 2024-09-12T17:35:14.938+0000 7fe38d12c800 5 AuthRegistry(0x563c0c5542b0) adding con mode: secure 2024-09-12T17:35:15.293 INFO:tasks.workunit.client.0.smithi037.stderr: -314> 2024-09-12T17:35:14.938+0000 7fe38d12c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:35:15.294 INFO:tasks.workunit.client.0.smithi037.stderr: -313> 2024-09-12T17:35:14.938+0000 7fe38d12c800 10 monclient: init 2024-09-12T17:35:15.294 INFO:tasks.workunit.client.0.smithi037.stderr: -312> 2024-09-12T17:35:14.938+0000 7fe38d12c800 5 AuthRegistry(0x7ffc663b2e60) adding auth protocol: cephx 2024-09-12T17:35:15.294 INFO:tasks.workunit.client.0.smithi037.stderr: -311> 2024-09-12T17:35:14.938+0000 7fe38d12c800 5 AuthRegistry(0x7ffc663b2e60) adding auth protocol: cephx 2024-09-12T17:35:15.294 INFO:tasks.workunit.client.0.smithi037.stderr: -310> 2024-09-12T17:35:14.938+0000 7fe38d12c800 5 AuthRegistry(0x7ffc663b2e60) adding auth protocol: cephx 2024-09-12T17:35:15.294 INFO:tasks.workunit.client.0.smithi037.stderr: -309> 2024-09-12T17:35:14.938+0000 7fe38d12c800 5 AuthRegistry(0x7ffc663b2e60) adding con mode: secure 2024-09-12T17:35:15.294 INFO:tasks.workunit.client.0.smithi037.stderr: -308> 2024-09-12T17:35:14.938+0000 7fe38d12c800 5 AuthRegistry(0x7ffc663b2e60) adding con mode: crc 2024-09-12T17:35:15.294 INFO:tasks.workunit.client.0.smithi037.stderr: -307> 2024-09-12T17:35:14.938+0000 7fe38d12c800 5 AuthRegistry(0x7ffc663b2e60) adding con mode: secure 2024-09-12T17:35:15.294 INFO:tasks.workunit.client.0.smithi037.stderr: -306> 2024-09-12T17:35:14.938+0000 7fe38d12c800 5 AuthRegistry(0x7ffc663b2e60) adding con mode: crc 2024-09-12T17:35:15.294 INFO:tasks.workunit.client.0.smithi037.stderr: -305> 2024-09-12T17:35:14.938+0000 7fe38d12c800 5 AuthRegistry(0x7ffc663b2e60) adding con mode: secure 2024-09-12T17:35:15.294 INFO:tasks.workunit.client.0.smithi037.stderr: -304> 2024-09-12T17:35:14.938+0000 7fe38d12c800 5 AuthRegistry(0x7ffc663b2e60) adding con mode: crc 2024-09-12T17:35:15.295 INFO:tasks.workunit.client.0.smithi037.stderr: -303> 2024-09-12T17:35:14.938+0000 7fe38d12c800 5 AuthRegistry(0x7ffc663b2e60) adding con mode: crc 2024-09-12T17:35:15.295 INFO:tasks.workunit.client.0.smithi037.stderr: -302> 2024-09-12T17:35:14.938+0000 7fe38d12c800 5 AuthRegistry(0x7ffc663b2e60) adding con mode: secure 2024-09-12T17:35:15.295 INFO:tasks.workunit.client.0.smithi037.stderr: -301> 2024-09-12T17:35:14.938+0000 7fe38d12c800 5 AuthRegistry(0x7ffc663b2e60) adding con mode: crc 2024-09-12T17:35:15.295 INFO:tasks.workunit.client.0.smithi037.stderr: -300> 2024-09-12T17:35:14.938+0000 7fe38d12c800 5 AuthRegistry(0x7ffc663b2e60) adding con mode: secure 2024-09-12T17:35:15.295 INFO:tasks.workunit.client.0.smithi037.stderr: -299> 2024-09-12T17:35:14.938+0000 7fe38d12c800 5 AuthRegistry(0x7ffc663b2e60) adding con mode: crc 2024-09-12T17:35:15.295 INFO:tasks.workunit.client.0.smithi037.stderr: -298> 2024-09-12T17:35:14.938+0000 7fe38d12c800 5 AuthRegistry(0x7ffc663b2e60) adding con mode: secure 2024-09-12T17:35:15.295 INFO:tasks.workunit.client.0.smithi037.stderr: -297> 2024-09-12T17:35:14.938+0000 7fe38d12c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:35:15.295 INFO:tasks.workunit.client.0.smithi037.stderr: -296> 2024-09-12T17:35:14.939+0000 7fe38d12c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:35:15.295 INFO:tasks.workunit.client.0.smithi037.stderr: -295> 2024-09-12T17:35:14.939+0000 7fe38d12c800 5 asok(0x563c0c296730) register_command rotate-key cmddesc rotate-key hook 0x7ffc663b2fa8 EEXIST 2024-09-12T17:35:15.295 INFO:tasks.workunit.client.0.smithi037.stderr: -294> 2024-09-12T17:35:14.939+0000 7fe38d12c800 10 monclient: _reopen_session rank -1 2024-09-12T17:35:15.295 INFO:tasks.workunit.client.0.smithi037.stderr: -293> 2024-09-12T17:35:14.939+0000 7fe38d12c800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T17:35:15.295 INFO:tasks.workunit.client.0.smithi037.stderr: -292> 2024-09-12T17:35:14.939+0000 7fe38d12c800 10 monclient(hunting): picked mon.noname-c con 0x563c0c588830 addr [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] 2024-09-12T17:35:15.295 INFO:tasks.workunit.client.0.smithi037.stderr: -291> 2024-09-12T17:35:14.939+0000 7fe38d12c800 10 monclient(hunting): picked mon.noname-a con 0x563c0c582dd0 addr [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] 2024-09-12T17:35:15.296 INFO:tasks.workunit.client.0.smithi037.stderr: -290> 2024-09-12T17:35:14.939+0000 7fe38d12c800 10 monclient(hunting): picked mon.noname-b con 0x563c0c558670 addr [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] 2024-09-12T17:35:15.296 INFO:tasks.workunit.client.0.smithi037.stderr: -289> 2024-09-12T17:35:14.939+0000 7fe38d12c800 10 monclient(hunting): start opening mon connection 2024-09-12T17:35:15.296 INFO:tasks.workunit.client.0.smithi037.stderr: -288> 2024-09-12T17:35:14.939+0000 7fe38d12c800 10 monclient(hunting): start opening mon connection 2024-09-12T17:35:15.296 INFO:tasks.workunit.client.0.smithi037.stderr: -287> 2024-09-12T17:35:14.939+0000 7fe38d12c800 10 monclient(hunting): start opening mon connection 2024-09-12T17:35:15.296 INFO:tasks.workunit.client.0.smithi037.stderr: -286> 2024-09-12T17:35:14.939+0000 7fe38d12c800 10 monclient(hunting): _renew_subs 2024-09-12T17:35:15.296 INFO:tasks.workunit.client.0.smithi037.stderr: -285> 2024-09-12T17:35:14.939+0000 7fe38d12c800 10 monclient(hunting): authenticate will time out at 2302.536265s 2024-09-12T17:35:15.296 INFO:tasks.workunit.client.0.smithi037.stderr: -284> 2024-09-12T17:35:14.939+0000 7fe388e4f640 10 monclient(hunting): get_auth_request con 0x563c0c588830 auth_method 0 2024-09-12T17:35:15.296 INFO:tasks.workunit.client.0.smithi037.stderr: -283> 2024-09-12T17:35:14.939+0000 7fe388e4f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:35:15.296 INFO:tasks.workunit.client.0.smithi037.stderr: -282> 2024-09-12T17:35:14.939+0000 7fe388e4f640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:35:15.296 INFO:tasks.workunit.client.0.smithi037.stderr: -281> 2024-09-12T17:35:14.939+0000 7fe388e4f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:35:15.296 INFO:tasks.workunit.client.0.smithi037.stderr: -280> 2024-09-12T17:35:14.939+0000 7fe38864e640 10 monclient(hunting): get_auth_request con 0x563c0c582dd0 auth_method 0 2024-09-12T17:35:15.296 INFO:tasks.workunit.client.0.smithi037.stderr: -279> 2024-09-12T17:35:14.939+0000 7fe38864e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:35:15.296 INFO:tasks.workunit.client.0.smithi037.stderr: -278> 2024-09-12T17:35:14.939+0000 7fe38864e640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:35:15.297 INFO:tasks.workunit.client.0.smithi037.stderr: -277> 2024-09-12T17:35:14.939+0000 7fe38864e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:35:15.297 INFO:tasks.workunit.client.0.smithi037.stderr: -276> 2024-09-12T17:35:14.939+0000 7fe38864e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:35:15.297 INFO:tasks.workunit.client.0.smithi037.stderr: -275> 2024-09-12T17:35:14.939+0000 7fe38864e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:35:15.297 INFO:tasks.workunit.client.0.smithi037.stderr: -274> 2024-09-12T17:35:14.939+0000 7fe38864e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:35:15.297 INFO:tasks.workunit.client.0.smithi037.stderr: -273> 2024-09-12T17:35:14.939+0000 7fe388e4f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:35:15.297 INFO:tasks.workunit.client.0.smithi037.stderr: -272> 2024-09-12T17:35:14.939+0000 7fe388e4f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:35:15.297 INFO:tasks.workunit.client.0.smithi037.stderr: -271> 2024-09-12T17:35:14.939+0000 7fe388e4f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:35:15.297 INFO:tasks.workunit.client.0.smithi037.stderr: -270> 2024-09-12T17:35:14.939+0000 7fe389650640 10 monclient(hunting): get_auth_request con 0x563c0c558670 auth_method 0 2024-09-12T17:35:15.297 INFO:tasks.workunit.client.0.smithi037.stderr: -269> 2024-09-12T17:35:14.939+0000 7fe389650640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:35:15.297 INFO:tasks.workunit.client.0.smithi037.stderr: -268> 2024-09-12T17:35:14.939+0000 7fe389650640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:35:15.297 INFO:tasks.workunit.client.0.smithi037.stderr: -267> 2024-09-12T17:35:14.939+0000 7fe389650640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:35:15.297 INFO:tasks.workunit.client.0.smithi037.stderr: -266> 2024-09-12T17:35:14.939+0000 7fe38864e640 10 monclient(hunting): handle_auth_done global_id 7566 payload 274 2024-09-12T17:35:15.297 INFO:tasks.workunit.client.0.smithi037.stderr: -265> 2024-09-12T17:35:14.939+0000 7fe38864e640 10 monclient: _finish_hunting 0 2024-09-12T17:35:15.298 INFO:tasks.workunit.client.0.smithi037.stderr: -264> 2024-09-12T17:35:14.939+0000 7fe38864e640 1 monclient: found mon.noname-a 2024-09-12T17:35:15.298 INFO:tasks.workunit.client.0.smithi037.stderr: -263> 2024-09-12T17:35:14.939+0000 7fe38864e640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.37:3300/0 2024-09-12T17:35:15.298 INFO:tasks.workunit.client.0.smithi037.stderr: -262> 2024-09-12T17:35:14.939+0000 7fe25ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:35:15.298 INFO:tasks.workunit.client.0.smithi037.stderr: -261> 2024-09-12T17:35:14.939+0000 7fe25ffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:35:15.298 INFO:tasks.workunit.client.0.smithi037.stderr: -260> 2024-09-12T17:35:14.939+0000 7fe25ffff640 10 monclient: dump: 2024-09-12T17:35:15.298 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:35:15.298 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:35:15.298 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:35:15.298 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:35:15.298 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:35:15.298 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:35:15.298 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:35:15.298 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:35:15.299 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:35:15.299 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:35:15.299 INFO:tasks.workunit.client.0.smithi037.stderr: -259> 2024-09-12T17:35:14.939+0000 7fe25ffff640 10 monclient: _finish_auth 0 2024-09-12T17:35:15.299 INFO:tasks.workunit.client.0.smithi037.stderr: -258> 2024-09-12T17:35:14.939+0000 7fe25ffff640 10 monclient: _check_auth_tickets 2024-09-12T17:35:15.299 INFO:tasks.workunit.client.0.smithi037.stderr: -257> 2024-09-12T17:35:14.939+0000 7fe25ffff640 10 monclient: handle_config config(0 keys) 2024-09-12T17:35:15.299 INFO:tasks.workunit.client.0.smithi037.stderr: -256> 2024-09-12T17:35:14.939+0000 7fe25ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:35:15.299 INFO:tasks.workunit.client.0.smithi037.stderr: -255> 2024-09-12T17:35:14.939+0000 7fe25ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:35:15.299 INFO:tasks.workunit.client.0.smithi037.stderr: -254> 2024-09-12T17:35:14.939+0000 7fe25ffff640 10 monclient: dump: 2024-09-12T17:35:15.299 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:35:15.299 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:35:15.299 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:35:15.299 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:35:15.299 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:35:15.299 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:35:15.300 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:35:15.300 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:35:15.300 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:35:15.300 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:35:15.300 INFO:tasks.workunit.client.0.smithi037.stderr: -253> 2024-09-12T17:35:14.939+0000 7fe38d12c800 5 monclient: authenticate success, global_id 7566 2024-09-12T17:35:15.300 INFO:tasks.workunit.client.0.smithi037.stderr: -252> 2024-09-12T17:35:14.939+0000 7fe38d12c800 10 monclient: get_monmap_and_config success 2024-09-12T17:35:15.300 INFO:tasks.workunit.client.0.smithi037.stderr: -251> 2024-09-12T17:35:14.939+0000 7fe38d12c800 4 set_mon_vals no callback set 2024-09-12T17:35:15.300 INFO:tasks.workunit.client.0.smithi037.stderr: -250> 2024-09-12T17:35:14.940+0000 7fe38d12c800 10 monclient: shutdown 2024-09-12T17:35:15.300 INFO:tasks.workunit.client.0.smithi037.stderr: -249> 2024-09-12T17:35:14.940+0000 7fe38d12c800 10 monclient: build_initial_monmap 2024-09-12T17:35:15.300 INFO:tasks.workunit.client.0.smithi037.stderr: -248> 2024-09-12T17:35:14.940+0000 7fe38d12c800 1 build_initial for_mkfs: 0 2024-09-12T17:35:15.300 INFO:tasks.workunit.client.0.smithi037.stderr: -247> 2024-09-12T17:35:14.940+0000 7fe38d12c800 10 monclient: monmap: 2024-09-12T17:35:15.300 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 0 2024-09-12T17:35:15.300 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:35:15.301 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 0.000000 2024-09-12T17:35:15.301 INFO:tasks.workunit.client.0.smithi037.stderr:created 0.000000 2024-09-12T17:35:15.301 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 0 (unknown) 2024-09-12T17:35:15.301 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:35:15.301 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.noname-a 2024-09-12T17:35:15.301 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.noname-b 2024-09-12T17:35:15.301 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.noname-c 2024-09-12T17:35:15.301 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:35:15.301 INFO:tasks.workunit.client.0.smithi037.stderr: -246> 2024-09-12T17:35:14.940+0000 7fe38d12c800 5 AuthRegistry(0x563c0c583d90) adding auth protocol: cephx 2024-09-12T17:35:15.301 INFO:tasks.workunit.client.0.smithi037.stderr: -245> 2024-09-12T17:35:14.940+0000 7fe38d12c800 5 AuthRegistry(0x563c0c583d90) adding auth protocol: cephx 2024-09-12T17:35:15.301 INFO:tasks.workunit.client.0.smithi037.stderr: -244> 2024-09-12T17:35:14.940+0000 7fe38d12c800 5 AuthRegistry(0x563c0c583d90) adding auth protocol: cephx 2024-09-12T17:35:15.301 INFO:tasks.workunit.client.0.smithi037.stderr: -243> 2024-09-12T17:35:14.940+0000 7fe38d12c800 5 AuthRegistry(0x563c0c583d90) adding con mode: secure 2024-09-12T17:35:15.301 INFO:tasks.workunit.client.0.smithi037.stderr: -242> 2024-09-12T17:35:14.940+0000 7fe38d12c800 5 AuthRegistry(0x563c0c583d90) adding con mode: crc 2024-09-12T17:35:15.301 INFO:tasks.workunit.client.0.smithi037.stderr: -241> 2024-09-12T17:35:14.940+0000 7fe38d12c800 5 AuthRegistry(0x563c0c583d90) adding con mode: secure 2024-09-12T17:35:15.302 INFO:tasks.workunit.client.0.smithi037.stderr: -240> 2024-09-12T17:35:14.940+0000 7fe38d12c800 5 AuthRegistry(0x563c0c583d90) adding con mode: crc 2024-09-12T17:35:15.302 INFO:tasks.workunit.client.0.smithi037.stderr: -239> 2024-09-12T17:35:14.940+0000 7fe38d12c800 5 AuthRegistry(0x563c0c583d90) adding con mode: secure 2024-09-12T17:35:15.302 INFO:tasks.workunit.client.0.smithi037.stderr: -238> 2024-09-12T17:35:14.940+0000 7fe38d12c800 5 AuthRegistry(0x563c0c583d90) adding con mode: crc 2024-09-12T17:35:15.302 INFO:tasks.workunit.client.0.smithi037.stderr: -237> 2024-09-12T17:35:14.940+0000 7fe38d12c800 5 AuthRegistry(0x563c0c583d90) adding con mode: crc 2024-09-12T17:35:15.302 INFO:tasks.workunit.client.0.smithi037.stderr: -236> 2024-09-12T17:35:14.940+0000 7fe38d12c800 5 AuthRegistry(0x563c0c583d90) adding con mode: secure 2024-09-12T17:35:15.302 INFO:tasks.workunit.client.0.smithi037.stderr: -235> 2024-09-12T17:35:14.940+0000 7fe38d12c800 5 AuthRegistry(0x563c0c583d90) adding con mode: crc 2024-09-12T17:35:15.302 INFO:tasks.workunit.client.0.smithi037.stderr: -234> 2024-09-12T17:35:14.940+0000 7fe38d12c800 5 AuthRegistry(0x563c0c583d90) adding con mode: secure 2024-09-12T17:35:15.302 INFO:tasks.workunit.client.0.smithi037.stderr: -233> 2024-09-12T17:35:14.940+0000 7fe38d12c800 5 AuthRegistry(0x563c0c583d90) adding con mode: crc 2024-09-12T17:35:15.302 INFO:tasks.workunit.client.0.smithi037.stderr: -232> 2024-09-12T17:35:14.940+0000 7fe38d12c800 5 AuthRegistry(0x563c0c583d90) adding con mode: secure 2024-09-12T17:35:15.302 INFO:tasks.workunit.client.0.smithi037.stderr: -231> 2024-09-12T17:35:14.940+0000 7fe38d12c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:35:15.302 INFO:tasks.workunit.client.0.smithi037.stderr: -230> 2024-09-12T17:35:14.940+0000 7fe38d12c800 1 librados: starting msgr at 2024-09-12T17:35:15.302 INFO:tasks.workunit.client.0.smithi037.stderr: -229> 2024-09-12T17:35:14.940+0000 7fe38d12c800 1 librados: starting objecter 2024-09-12T17:35:15.302 INFO:tasks.workunit.client.0.smithi037.stderr: -228> 2024-09-12T17:35:14.940+0000 7fe38d12c800 5 asok(0x563c0c296730) register_command objecter_requests cmddesc objecter_requests hook 0x563c0c534c90 EEXIST 2024-09-12T17:35:15.303 INFO:tasks.workunit.client.0.smithi037.stderr: -227> 2024-09-12T17:35:14.940+0000 7fe38d12c800 1 librados: setting wanted keys 2024-09-12T17:35:15.303 INFO:tasks.workunit.client.0.smithi037.stderr: -226> 2024-09-12T17:35:14.940+0000 7fe38d12c800 1 librados: calling monclient init 2024-09-12T17:35:15.303 INFO:tasks.workunit.client.0.smithi037.stderr: -225> 2024-09-12T17:35:14.940+0000 7fe38d12c800 10 monclient: init 2024-09-12T17:35:15.303 INFO:tasks.workunit.client.0.smithi037.stderr: -224> 2024-09-12T17:35:14.940+0000 7fe38d12c800 5 AuthRegistry(0x563c0c54c3c0) adding auth protocol: cephx 2024-09-12T17:35:15.303 INFO:tasks.workunit.client.0.smithi037.stderr: -223> 2024-09-12T17:35:14.940+0000 7fe38d12c800 5 AuthRegistry(0x563c0c54c3c0) adding auth protocol: cephx 2024-09-12T17:35:15.303 INFO:tasks.workunit.client.0.smithi037.stderr: -222> 2024-09-12T17:35:14.940+0000 7fe38d12c800 5 AuthRegistry(0x563c0c54c3c0) adding auth protocol: cephx 2024-09-12T17:35:15.303 INFO:tasks.workunit.client.0.smithi037.stderr: -221> 2024-09-12T17:35:14.940+0000 7fe38d12c800 5 AuthRegistry(0x563c0c54c3c0) adding con mode: secure 2024-09-12T17:35:15.303 INFO:tasks.workunit.client.0.smithi037.stderr: -220> 2024-09-12T17:35:14.940+0000 7fe38d12c800 5 AuthRegistry(0x563c0c54c3c0) adding con mode: crc 2024-09-12T17:35:15.303 INFO:tasks.workunit.client.0.smithi037.stderr: -219> 2024-09-12T17:35:14.940+0000 7fe38d12c800 5 AuthRegistry(0x563c0c54c3c0) adding con mode: secure 2024-09-12T17:35:15.303 INFO:tasks.workunit.client.0.smithi037.stderr: -218> 2024-09-12T17:35:14.940+0000 7fe38d12c800 5 AuthRegistry(0x563c0c54c3c0) adding con mode: crc 2024-09-12T17:35:15.303 INFO:tasks.workunit.client.0.smithi037.stderr: -217> 2024-09-12T17:35:14.940+0000 7fe38d12c800 5 AuthRegistry(0x563c0c54c3c0) adding con mode: secure 2024-09-12T17:35:15.303 INFO:tasks.workunit.client.0.smithi037.stderr: -216> 2024-09-12T17:35:14.941+0000 7fe38d12c800 5 AuthRegistry(0x563c0c54c3c0) adding con mode: crc 2024-09-12T17:35:15.303 INFO:tasks.workunit.client.0.smithi037.stderr: -215> 2024-09-12T17:35:14.941+0000 7fe38d12c800 5 AuthRegistry(0x563c0c54c3c0) adding con mode: crc 2024-09-12T17:35:15.303 INFO:tasks.workunit.client.0.smithi037.stderr: -214> 2024-09-12T17:35:14.941+0000 7fe38d12c800 5 AuthRegistry(0x563c0c54c3c0) adding con mode: secure 2024-09-12T17:35:15.304 INFO:tasks.workunit.client.0.smithi037.stderr: -213> 2024-09-12T17:35:14.941+0000 7fe38d12c800 5 AuthRegistry(0x563c0c54c3c0) adding con mode: crc 2024-09-12T17:35:15.304 INFO:tasks.workunit.client.0.smithi037.stderr: -212> 2024-09-12T17:35:14.941+0000 7fe38d12c800 5 AuthRegistry(0x563c0c54c3c0) adding con mode: secure 2024-09-12T17:35:15.304 INFO:tasks.workunit.client.0.smithi037.stderr: -211> 2024-09-12T17:35:14.941+0000 7fe38d12c800 5 AuthRegistry(0x563c0c54c3c0) adding con mode: crc 2024-09-12T17:35:15.304 INFO:tasks.workunit.client.0.smithi037.stderr: -210> 2024-09-12T17:35:14.941+0000 7fe38d12c800 5 AuthRegistry(0x563c0c54c3c0) adding con mode: secure 2024-09-12T17:35:15.304 INFO:tasks.workunit.client.0.smithi037.stderr: -209> 2024-09-12T17:35:14.941+0000 7fe38d12c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:35:15.304 INFO:tasks.workunit.client.0.smithi037.stderr: -208> 2024-09-12T17:35:14.941+0000 7fe38d12c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:35:15.304 INFO:tasks.workunit.client.0.smithi037.stderr: -207> 2024-09-12T17:35:14.941+0000 7fe38d12c800 5 asok(0x563c0c296730) register_command rotate-key cmddesc rotate-key hook 0x563c0c54c508 EEXIST 2024-09-12T17:35:15.304 INFO:tasks.workunit.client.0.smithi037.stderr: -206> 2024-09-12T17:35:14.941+0000 7fe38d12c800 10 monclient: _reopen_session rank -1 2024-09-12T17:35:15.304 INFO:tasks.workunit.client.0.smithi037.stderr: -205> 2024-09-12T17:35:14.941+0000 7fe38d12c800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T17:35:15.304 INFO:tasks.workunit.client.0.smithi037.stderr: -204> 2024-09-12T17:35:14.941+0000 7fe38d12c800 10 monclient(hunting): picked mon.noname-a con 0x563c0c558670 addr [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] 2024-09-12T17:35:15.304 INFO:tasks.workunit.client.0.smithi037.stderr: -203> 2024-09-12T17:35:14.941+0000 7fe38d12c800 10 monclient(hunting): picked mon.noname-b con 0x563c0c582dd0 addr [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] 2024-09-12T17:35:15.304 INFO:tasks.workunit.client.0.smithi037.stderr: -202> 2024-09-12T17:35:14.941+0000 7fe38d12c800 10 monclient(hunting): picked mon.noname-c con 0x563c0c588830 addr [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] 2024-09-12T17:35:15.304 INFO:tasks.workunit.client.0.smithi037.stderr: -201> 2024-09-12T17:35:14.941+0000 7fe38d12c800 10 monclient(hunting): start opening mon connection 2024-09-12T17:35:15.304 INFO:tasks.workunit.client.0.smithi037.stderr: -200> 2024-09-12T17:35:14.941+0000 7fe38d12c800 10 monclient(hunting): start opening mon connection 2024-09-12T17:35:15.305 INFO:tasks.workunit.client.0.smithi037.stderr: -199> 2024-09-12T17:35:14.941+0000 7fe38d12c800 10 monclient(hunting): start opening mon connection 2024-09-12T17:35:15.305 INFO:tasks.workunit.client.0.smithi037.stderr: -198> 2024-09-12T17:35:14.941+0000 7fe38d12c800 10 monclient(hunting): _renew_subs 2024-09-12T17:35:15.305 INFO:tasks.workunit.client.0.smithi037.stderr: -197> 2024-09-12T17:35:14.941+0000 7fe38d12c800 10 monclient(hunting): authenticate will time out at 2302.538531s 2024-09-12T17:35:15.305 INFO:tasks.workunit.client.0.smithi037.stderr: -196> 2024-09-12T17:35:14.941+0000 7fe388e4f640 10 monclient(hunting): get_auth_request con 0x563c0c558670 auth_method 0 2024-09-12T17:35:15.305 INFO:tasks.workunit.client.0.smithi037.stderr: -195> 2024-09-12T17:35:14.941+0000 7fe388e4f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:35:15.305 INFO:tasks.workunit.client.0.smithi037.stderr: -194> 2024-09-12T17:35:14.941+0000 7fe388e4f640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:35:15.305 INFO:tasks.workunit.client.0.smithi037.stderr: -193> 2024-09-12T17:35:14.941+0000 7fe388e4f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:35:15.305 INFO:tasks.workunit.client.0.smithi037.stderr: -192> 2024-09-12T17:35:14.941+0000 7fe389650640 10 monclient(hunting): get_auth_request con 0x563c0c588830 auth_method 0 2024-09-12T17:35:15.305 INFO:tasks.workunit.client.0.smithi037.stderr: -191> 2024-09-12T17:35:14.941+0000 7fe389650640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:35:15.305 INFO:tasks.workunit.client.0.smithi037.stderr: -190> 2024-09-12T17:35:14.941+0000 7fe389650640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:35:15.305 INFO:tasks.workunit.client.0.smithi037.stderr: -189> 2024-09-12T17:35:14.941+0000 7fe389650640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:35:15.305 INFO:tasks.workunit.client.0.smithi037.stderr: -188> 2024-09-12T17:35:14.941+0000 7fe388e4f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:35:15.305 INFO:tasks.workunit.client.0.smithi037.stderr: -187> 2024-09-12T17:35:14.941+0000 7fe388e4f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:35:15.305 INFO:tasks.workunit.client.0.smithi037.stderr: -186> 2024-09-12T17:35:14.941+0000 7fe388e4f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:35:15.306 INFO:tasks.workunit.client.0.smithi037.stderr: -185> 2024-09-12T17:35:14.941+0000 7fe389650640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:35:15.306 INFO:tasks.workunit.client.0.smithi037.stderr: -184> 2024-09-12T17:35:14.941+0000 7fe389650640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:35:15.306 INFO:tasks.workunit.client.0.smithi037.stderr: -183> 2024-09-12T17:35:14.941+0000 7fe389650640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:35:15.306 INFO:tasks.workunit.client.0.smithi037.stderr: -182> 2024-09-12T17:35:14.941+0000 7fe388e4f640 10 monclient(hunting): handle_auth_done global_id 7569 payload 824 2024-09-12T17:35:15.306 INFO:tasks.workunit.client.0.smithi037.stderr: -181> 2024-09-12T17:35:14.941+0000 7fe388e4f640 10 monclient: _finish_hunting 0 2024-09-12T17:35:15.306 INFO:tasks.workunit.client.0.smithi037.stderr: -180> 2024-09-12T17:35:14.941+0000 7fe388e4f640 1 monclient: found mon.noname-a 2024-09-12T17:35:15.306 INFO:tasks.workunit.client.0.smithi037.stderr: -179> 2024-09-12T17:35:14.941+0000 7fe388e4f640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.37:3300/0 2024-09-12T17:35:15.306 INFO:tasks.workunit.client.0.smithi037.stderr: -178> 2024-09-12T17:35:14.941+0000 7fe38864e640 10 monclient: get_auth_request con 0x563c0c582dd0 auth_method 0 2024-09-12T17:35:15.306 INFO:tasks.workunit.client.0.smithi037.stderr: -177> 2024-09-12T17:35:14.942+0000 7fe25e7fc640 10 monclient: ms_handle_reset current mon [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] 2024-09-12T17:35:15.306 INFO:tasks.workunit.client.0.smithi037.stderr: -176> 2024-09-12T17:35:14.942+0000 7fe25e7fc640 10 monclient: _reopen_session rank -1 2024-09-12T17:35:15.306 INFO:tasks.workunit.client.0.smithi037.stderr: -175> 2024-09-12T17:35:14.942+0000 7fe25e7fc640 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T17:35:15.306 INFO:tasks.workunit.client.0.smithi037.stderr: -174> 2024-09-12T17:35:14.942+0000 7fe25e7fc640 10 monclient(hunting): picked mon.noname-a con 0x7fe2540020c0 addr [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] 2024-09-12T17:35:15.306 INFO:tasks.workunit.client.0.smithi037.stderr: -173> 2024-09-12T17:35:14.942+0000 7fe25e7fc640 10 monclient(hunting): picked mon.noname-b con 0x563c0c582dd0 addr [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] 2024-09-12T17:35:15.307 INFO:tasks.workunit.client.0.smithi037.stderr: -172> 2024-09-12T17:35:14.942+0000 7fe25e7fc640 10 monclient(hunting): picked mon.noname-c con 0x563c0c588830 addr [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] 2024-09-12T17:35:15.307 INFO:tasks.workunit.client.0.smithi037.stderr: -171> 2024-09-12T17:35:14.942+0000 7fe25e7fc640 10 monclient(hunting): start opening mon connection 2024-09-12T17:35:15.307 INFO:tasks.workunit.client.0.smithi037.stderr: -170> 2024-09-12T17:35:14.942+0000 7fe25e7fc640 10 monclient(hunting): start opening mon connection 2024-09-12T17:35:15.307 INFO:tasks.workunit.client.0.smithi037.stderr: -169> 2024-09-12T17:35:14.942+0000 7fe25e7fc640 10 monclient(hunting): start opening mon connection 2024-09-12T17:35:15.307 INFO:tasks.workunit.client.0.smithi037.stderr: -168> 2024-09-12T17:35:14.942+0000 7fe25e7fc640 10 monclient(hunting): _renew_subs 2024-09-12T17:35:15.307 INFO:tasks.workunit.client.0.smithi037.stderr: -167> 2024-09-12T17:35:14.942+0000 7fe388e4f640 10 monclient(hunting): get_auth_request con 0x7fe2540020c0 auth_method 0 2024-09-12T17:35:15.307 INFO:tasks.workunit.client.0.smithi037.stderr: -166> 2024-09-12T17:35:14.942+0000 7fe388e4f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:35:15.307 INFO:tasks.workunit.client.0.smithi037.stderr: -165> 2024-09-12T17:35:14.942+0000 7fe388e4f640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:35:15.307 INFO:tasks.workunit.client.0.smithi037.stderr: -164> 2024-09-12T17:35:14.942+0000 7fe388e4f640 10 monclient(hunting): _init_auth already have auth, reseting 2024-09-12T17:35:15.307 INFO:tasks.workunit.client.0.smithi037.stderr: -163> 2024-09-12T17:35:14.942+0000 7fe389650640 10 monclient(hunting): get_auth_request con 0x563c0c588830 auth_method 0 2024-09-12T17:35:15.307 INFO:tasks.workunit.client.0.smithi037.stderr: -162> 2024-09-12T17:35:14.942+0000 7fe389650640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:35:15.307 INFO:tasks.workunit.client.0.smithi037.stderr: -161> 2024-09-12T17:35:14.942+0000 7fe389650640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:35:15.307 INFO:tasks.workunit.client.0.smithi037.stderr: -160> 2024-09-12T17:35:14.942+0000 7fe389650640 10 monclient(hunting): _init_auth already have auth, reseting 2024-09-12T17:35:15.307 INFO:tasks.workunit.client.0.smithi037.stderr: -159> 2024-09-12T17:35:14.942+0000 7fe38864e640 10 monclient(hunting): get_auth_request con 0x563c0c582dd0 auth_method 0 2024-09-12T17:35:15.308 INFO:tasks.workunit.client.0.smithi037.stderr: -158> 2024-09-12T17:35:14.942+0000 7fe38864e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:35:15.308 INFO:tasks.workunit.client.0.smithi037.stderr: -157> 2024-09-12T17:35:14.942+0000 7fe38864e640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:35:15.308 INFO:tasks.workunit.client.0.smithi037.stderr: -156> 2024-09-12T17:35:14.942+0000 7fe38864e640 10 monclient(hunting): _init_auth already have auth, reseting 2024-09-12T17:35:15.308 INFO:tasks.workunit.client.0.smithi037.stderr: -155> 2024-09-12T17:35:14.942+0000 7fe388e4f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:35:15.308 INFO:tasks.workunit.client.0.smithi037.stderr: -154> 2024-09-12T17:35:14.942+0000 7fe388e4f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:35:15.308 INFO:tasks.workunit.client.0.smithi037.stderr: -153> 2024-09-12T17:35:14.942+0000 7fe388e4f640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-09-12T17:35:15.308 INFO:tasks.workunit.client.0.smithi037.stderr: -152> 2024-09-12T17:35:14.942+0000 7fe389650640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:35:15.308 INFO:tasks.workunit.client.0.smithi037.stderr: -151> 2024-09-12T17:35:14.942+0000 7fe389650640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:35:15.308 INFO:tasks.workunit.client.0.smithi037.stderr: -150> 2024-09-12T17:35:14.942+0000 7fe389650640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-09-12T17:35:15.308 INFO:tasks.workunit.client.0.smithi037.stderr: -149> 2024-09-12T17:35:14.942+0000 7fe38864e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:35:15.308 INFO:tasks.workunit.client.0.smithi037.stderr: -148> 2024-09-12T17:35:14.942+0000 7fe38864e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:35:15.308 INFO:tasks.workunit.client.0.smithi037.stderr: -147> 2024-09-12T17:35:14.942+0000 7fe38864e640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-09-12T17:35:15.308 INFO:tasks.workunit.client.0.smithi037.stderr: -146> 2024-09-12T17:35:14.942+0000 7fe388e4f640 10 monclient(hunting): handle_auth_done global_id 7569 payload 293 2024-09-12T17:35:15.309 INFO:tasks.workunit.client.0.smithi037.stderr: -145> 2024-09-12T17:35:14.942+0000 7fe388e4f640 10 monclient: _finish_hunting 0 2024-09-12T17:35:15.309 INFO:tasks.workunit.client.0.smithi037.stderr: -144> 2024-09-12T17:35:14.942+0000 7fe388e4f640 1 monclient: found mon.noname-a 2024-09-12T17:35:15.309 INFO:tasks.workunit.client.0.smithi037.stderr: -143> 2024-09-12T17:35:14.942+0000 7fe388e4f640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.37:3300/0 2024-09-12T17:35:15.309 INFO:tasks.workunit.client.0.smithi037.stderr: -142> 2024-09-12T17:35:14.942+0000 7fe25e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:35:15.309 INFO:tasks.workunit.client.0.smithi037.stderr: -141> 2024-09-12T17:35:14.942+0000 7fe25e7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:35:15.309 INFO:tasks.workunit.client.0.smithi037.stderr: -140> 2024-09-12T17:35:14.942+0000 7fe25e7fc640 10 monclient: dump: 2024-09-12T17:35:15.309 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:35:15.309 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:35:15.309 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:35:15.309 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:35:15.309 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:35:15.309 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:35:15.309 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:35:15.309 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:35:15.310 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:35:15.310 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:35:15.310 INFO:tasks.workunit.client.0.smithi037.stderr: -139> 2024-09-12T17:35:14.942+0000 7fe25e7fc640 10 monclient: _finish_auth 0 2024-09-12T17:35:15.310 INFO:tasks.workunit.client.0.smithi037.stderr: -138> 2024-09-12T17:35:14.942+0000 7fe25e7fc640 10 monclient: _check_auth_tickets 2024-09-12T17:35:15.310 INFO:tasks.workunit.client.0.smithi037.stderr: -137> 2024-09-12T17:35:14.942+0000 7fe25e7fc640 10 monclient: handle_config config(0 keys) 2024-09-12T17:35:15.310 INFO:tasks.workunit.client.0.smithi037.stderr: -136> 2024-09-12T17:35:14.942+0000 7fe25e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:35:15.310 INFO:tasks.workunit.client.0.smithi037.stderr: -135> 2024-09-12T17:35:14.942+0000 7fe25e7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:35:15.310 INFO:tasks.workunit.client.0.smithi037.stderr: -134> 2024-09-12T17:35:14.942+0000 7fe25e7fc640 10 monclient: dump: 2024-09-12T17:35:15.310 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:35:15.310 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:35:15.310 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:35:15.310 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:35:15.311 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:35:15.311 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:35:15.311 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:35:15.311 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:35:15.311 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:35:15.311 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:35:15.311 INFO:tasks.workunit.client.0.smithi037.stderr: -133> 2024-09-12T17:35:14.942+0000 7fe38d12c800 5 monclient: authenticate success, global_id 7569 2024-09-12T17:35:15.311 INFO:tasks.workunit.client.0.smithi037.stderr: -132> 2024-09-12T17:35:14.942+0000 7fe38d12c800 10 monclient: _renew_subs 2024-09-12T17:35:15.311 INFO:tasks.workunit.client.0.smithi037.stderr: -131> 2024-09-12T17:35:14.942+0000 7fe38d12c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.37:3300/0 2024-09-12T17:35:15.311 INFO:tasks.workunit.client.0.smithi037.stderr: -130> 2024-09-12T17:35:14.942+0000 7fe25ffff640 4 set_mon_vals no callback set 2024-09-12T17:35:15.311 INFO:tasks.workunit.client.0.smithi037.stderr: -129> 2024-09-12T17:35:14.942+0000 7fe38d12c800 10 monclient: _renew_subs 2024-09-12T17:35:15.312 INFO:tasks.workunit.client.0.smithi037.stderr: -128> 2024-09-12T17:35:14.942+0000 7fe38d12c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.37:3300/0 2024-09-12T17:35:15.312 INFO:tasks.workunit.client.0.smithi037.stderr: -127> 2024-09-12T17:35:14.942+0000 7fe38d12c800 1 librados: init done 2024-09-12T17:35:15.312 INFO:tasks.workunit.client.0.smithi037.stderr: -126> 2024-09-12T17:35:14.942+0000 7fe38d12c800 5 asok(0x563c0c296730) register_command cr dump hook 0x563c0c5581f8 2024-09-12T17:35:15.312 INFO:tasks.workunit.client.0.smithi037.stderr: -125> 2024-09-12T17:35:14.944+0000 7fe38d12c800 20 rados->read ofs=0 len=0 2024-09-12T17:35:15.312 INFO:tasks.workunit.client.0.smithi037.stderr: -124> 2024-09-12T17:35:14.945+0000 7fe25e7fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:35:15.312 INFO:tasks.workunit.client.0.smithi037.stderr: -123> 2024-09-12T17:35:14.945+0000 7fe25e7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.40:6816/3916250676,v1:172.21.15.40:6817/3916250676] 2024-09-12T17:35:15.312 INFO:tasks.workunit.client.0.smithi037.stderr: -122> 2024-09-12T17:35:14.945+0000 7fe25e7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.40:6816/3916250676,v1:172.21.15.40:6817/3916250676] 2024-09-12T17:35:15.312 INFO:tasks.workunit.client.0.smithi037.stderr: -121> 2024-09-12T17:35:14.945+0000 7fe38864e640 10 monclient: get_auth_request con 0x563c0c558670 auth_method 0 2024-09-12T17:35:15.312 INFO:tasks.workunit.client.0.smithi037.stderr: -120> 2024-09-12T17:35:14.945+0000 7fe389650640 10 monclient: get_auth_request con 0x563c0c59b8f0 auth_method 0 2024-09-12T17:35:15.312 INFO:tasks.workunit.client.0.smithi037.stderr: -119> 2024-09-12T17:35:14.946+0000 7fe38d12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:15.312 INFO:tasks.workunit.client.0.smithi037.stderr: -118> 2024-09-12T17:35:14.946+0000 7fe38d12c800 20 realm 2024-09-12T17:35:15.312 INFO:tasks.workunit.client.0.smithi037.stderr: -117> 2024-09-12T17:35:14.946+0000 7fe38d12c800 20 rados->read ofs=0 len=0 2024-09-12T17:35:15.312 INFO:tasks.workunit.client.0.smithi037.stderr: -116> 2024-09-12T17:35:14.946+0000 7fe38d12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:15.312 INFO:tasks.workunit.client.0.smithi037.stderr: -115> 2024-09-12T17:35:14.946+0000 7fe38d12c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:35:15.313 INFO:tasks.workunit.client.0.smithi037.stderr: -114> 2024-09-12T17:35:14.946+0000 7fe38d12c800 20 rados->read ofs=0 len=0 2024-09-12T17:35:15.313 INFO:tasks.workunit.client.0.smithi037.stderr: -113> 2024-09-12T17:35:14.946+0000 7fe38d12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:15.313 INFO:tasks.workunit.client.0.smithi037.stderr: -112> 2024-09-12T17:35:14.946+0000 7fe38d12c800 20 rados->read ofs=0 len=0 2024-09-12T17:35:15.313 INFO:tasks.workunit.client.0.smithi037.stderr: -111> 2024-09-12T17:35:14.946+0000 7fe388e4f640 10 monclient: get_auth_request con 0x563c0c59fbb0 auth_method 0 2024-09-12T17:35:15.313 INFO:tasks.workunit.client.0.smithi037.stderr: -110> 2024-09-12T17:35:14.947+0000 7fe38d12c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:35:15.313 INFO:tasks.workunit.client.0.smithi037.stderr: -109> 2024-09-12T17:35:14.947+0000 7fe38d12c800 20 rados->read ofs=0 len=0 2024-09-12T17:35:15.313 INFO:tasks.workunit.client.0.smithi037.stderr: -108> 2024-09-12T17:35:14.947+0000 7fe38d12c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:35:15.313 INFO:tasks.workunit.client.0.smithi037.stderr: -107> 2024-09-12T17:35:14.947+0000 7fe38d12c800 20 searching for the correct realm 2024-09-12T17:35:15.313 INFO:tasks.workunit.client.0.smithi037.stderr: -106> 2024-09-12T17:35:14.947+0000 7fe38864e640 10 monclient: get_auth_request con 0x563c0c5a4d80 auth_method 0 2024-09-12T17:35:15.313 INFO:tasks.workunit.client.0.smithi037.stderr: -105> 2024-09-12T17:35:14.948+0000 7fe389650640 10 monclient: get_auth_request con 0x7fe37c0480f0 auth_method 0 2024-09-12T17:35:15.313 INFO:tasks.workunit.client.0.smithi037.stderr: -104> 2024-09-12T17:35:14.949+0000 7fe388e4f640 10 monclient: get_auth_request con 0x7fe380012970 auth_method 0 2024-09-12T17:35:15.313 INFO:tasks.workunit.client.0.smithi037.stderr: -103> 2024-09-12T17:35:14.949+0000 7fe388e4f640 0 -- 172.21.15.37:0/976055060 >> [v2:172.21.15.37:6800/1206746176,v1:172.21.15.37:6801/1206746176] conn(0x7fe380012970 msgr2=0x7fe380010440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:35:15.313 INFO:tasks.workunit.client.0.smithi037.stderr: -102> 2024-09-12T17:35:15.150+0000 7fe388e4f640 10 monclient: get_auth_request con 0x7fe380012970 auth_method 0 2024-09-12T17:35:15.314 INFO:tasks.workunit.client.0.smithi037.stderr: -101> 2024-09-12T17:35:15.151+0000 7fe38864e640 10 monclient: get_auth_request con 0x7fe378080040 auth_method 0 2024-09-12T17:35:15.314 INFO:tasks.workunit.client.0.smithi037.stderr: -100> 2024-09-12T17:35:15.153+0000 7fe389650640 10 monclient: get_auth_request con 0x7fe37c096180 auth_method 0 2024-09-12T17:35:15.314 INFO:tasks.workunit.client.0.smithi037.stderr: -99> 2024-09-12T17:35:15.154+0000 7fe389650640 0 -- 172.21.15.37:0/976055060 >> [v2:172.21.15.40:6818/1210108009,v1:172.21.15.40:6819/1210108009] conn(0x7fe37c0480f0 msgr2=0x7fe37c055ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:35:15.314 INFO:tasks.workunit.client.0.smithi037.stderr: -98> 2024-09-12T17:35:15.154+0000 7fe25e7fc640 1 client.7569.objecter ms_handle_reset 0x7fe37c0480f0 session 0x7fe37c051070 osd.7 2024-09-12T17:35:15.314 INFO:tasks.workunit.client.0.smithi037.stderr: -97> 2024-09-12T17:35:15.154+0000 7fe25e7fc640 10 monclient: _renew_subs 2024-09-12T17:35:15.314 INFO:tasks.workunit.client.0.smithi037.stderr: -96> 2024-09-12T17:35:15.154+0000 7fe25e7fc640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.37:3300/0 2024-09-12T17:35:15.314 INFO:tasks.workunit.client.0.smithi037.stderr: -95> 2024-09-12T17:35:15.155+0000 7fe389650640 10 monclient: get_auth_request con 0x7fe25408e610 auth_method 0 2024-09-12T17:35:15.314 INFO:tasks.workunit.client.0.smithi037.stderr: -94> 2024-09-12T17:35:15.156+0000 7fe388e4f640 10 monclient: get_auth_request con 0x7fe37c0613f0 auth_method 0 2024-09-12T17:35:15.314 INFO:tasks.workunit.client.0.smithi037.stderr: -93> 2024-09-12T17:35:15.161+0000 7fe38d12c800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:35:15.314 INFO:tasks.workunit.client.0.smithi037.stderr: -92> 2024-09-12T17:35:15.161+0000 7fe38d12c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:35:15.314 INFO:tasks.workunit.client.0.smithi037.stderr: -91> 2024-09-12T17:35:15.161+0000 7fe38d12c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:35:15.314 INFO:tasks.workunit.client.0.smithi037.stderr: -90> 2024-09-12T17:35:15.161+0000 7fe38d12c800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:35:15.315 INFO:tasks.workunit.client.0.smithi037.stderr: -89> 2024-09-12T17:35:15.161+0000 7fe38d12c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:35:15.315 INFO:tasks.workunit.client.0.smithi037.stderr: -88> 2024-09-12T17:35:15.161+0000 7fe38d12c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:35:15.315 INFO:tasks.workunit.client.0.smithi037.stderr: -87> 2024-09-12T17:35:15.161+0000 7fe38d12c800 20 rados->read ofs=0 len=0 2024-09-12T17:35:15.315 INFO:tasks.workunit.client.0.smithi037.stderr: -86> 2024-09-12T17:35:15.161+0000 7fe38d12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:15.315 INFO:tasks.workunit.client.0.smithi037.stderr: -85> 2024-09-12T17:35:15.161+0000 7fe38d12c800 20 rados->read ofs=0 len=0 2024-09-12T17:35:15.315 INFO:tasks.workunit.client.0.smithi037.stderr: -84> 2024-09-12T17:35:15.162+0000 7fe38d12c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:35:15.315 INFO:tasks.workunit.client.0.smithi037.stderr: -83> 2024-09-12T17:35:15.162+0000 7fe38d12c800 20 rados->read ofs=0 len=0 2024-09-12T17:35:15.315 INFO:tasks.workunit.client.0.smithi037.stderr: -82> 2024-09-12T17:35:15.162+0000 7fe38d12c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:35:15.315 INFO:tasks.workunit.client.0.smithi037.stderr: -81> 2024-09-12T17:35:15.162+0000 7fe38d12c800 20 zone default found 2024-09-12T17:35:15.315 INFO:tasks.workunit.client.0.smithi037.stderr: -80> 2024-09-12T17:35:15.162+0000 7fe38d12c800 4 Realm: () 2024-09-12T17:35:15.315 INFO:tasks.workunit.client.0.smithi037.stderr: -79> 2024-09-12T17:35:15.162+0000 7fe38d12c800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:35:15.315 INFO:tasks.workunit.client.0.smithi037.stderr: -78> 2024-09-12T17:35:15.162+0000 7fe38d12c800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:35:15.315 INFO:tasks.workunit.client.0.smithi037.stderr: -77> 2024-09-12T17:35:15.162+0000 7fe38d12c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:35:15.316 INFO:tasks.workunit.client.0.smithi037.stderr: -76> 2024-09-12T17:35:15.162+0000 7fe38d12c800 20 zonegroup default 2024-09-12T17:35:15.316 INFO:tasks.workunit.client.0.smithi037.stderr: -75> 2024-09-12T17:35:15.162+0000 7fe38d12c800 20 rados->read ofs=0 len=0 2024-09-12T17:35:15.316 INFO:tasks.workunit.client.0.smithi037.stderr: -74> 2024-09-12T17:35:15.162+0000 7fe38d12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:15.316 INFO:tasks.workunit.client.0.smithi037.stderr: -73> 2024-09-12T17:35:15.162+0000 7fe38d12c800 20 rados->read ofs=0 len=0 2024-09-12T17:35:15.316 INFO:tasks.workunit.client.0.smithi037.stderr: -72> 2024-09-12T17:35:15.163+0000 7fe38d12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:15.316 INFO:tasks.workunit.client.0.smithi037.stderr: -71> 2024-09-12T17:35:15.163+0000 7fe38d12c800 20 rados->read ofs=0 len=0 2024-09-12T17:35:15.316 INFO:tasks.workunit.client.0.smithi037.stderr: -70> 2024-09-12T17:35:15.163+0000 7fe38d12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:15.316 INFO:tasks.workunit.client.0.smithi037.stderr: -69> 2024-09-12T17:35:15.163+0000 7fe38d12c800 20 started sync module instance, tier type = 2024-09-12T17:35:15.316 INFO:tasks.workunit.client.0.smithi037.stderr: -68> 2024-09-12T17:35:15.163+0000 7fe38d12c800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:35:15.316 INFO:tasks.workunit.client.0.smithi037.stderr: -67> 2024-09-12T17:35:15.174+0000 7fe38d12c800 20 add_watcher() i=0 2024-09-12T17:35:15.316 INFO:tasks.workunit.client.0.smithi037.stderr: -66> 2024-09-12T17:35:15.174+0000 7fe38d12c800 20 add_watcher() i=1 2024-09-12T17:35:15.316 INFO:tasks.workunit.client.0.smithi037.stderr: -65> 2024-09-12T17:35:15.174+0000 7fe38d12c800 20 add_watcher() i=2 2024-09-12T17:35:15.316 INFO:tasks.workunit.client.0.smithi037.stderr: -64> 2024-09-12T17:35:15.174+0000 7fe38d12c800 20 add_watcher() i=3 2024-09-12T17:35:15.317 INFO:tasks.workunit.client.0.smithi037.stderr: -63> 2024-09-12T17:35:15.174+0000 7fe38d12c800 20 add_watcher() i=4 2024-09-12T17:35:15.317 INFO:tasks.workunit.client.0.smithi037.stderr: -62> 2024-09-12T17:35:15.174+0000 7fe38d12c800 20 add_watcher() i=5 2024-09-12T17:35:15.317 INFO:tasks.workunit.client.0.smithi037.stderr: -61> 2024-09-12T17:35:15.174+0000 7fe38d12c800 20 add_watcher() i=6 2024-09-12T17:35:15.317 INFO:tasks.workunit.client.0.smithi037.stderr: -60> 2024-09-12T17:35:15.175+0000 7fe38d12c800 20 add_watcher() i=7 2024-09-12T17:35:15.317 INFO:tasks.workunit.client.0.smithi037.stderr: -59> 2024-09-12T17:35:15.176+0000 7fe38d12c800 2 all 8 watchers are set, enabling cache 2024-09-12T17:35:15.317 INFO:tasks.workunit.client.0.smithi037.stderr: -58> 2024-09-12T17:35:15.177+0000 7fe38d12c800 5 AuthRegistry(0x7ffc663b3330) adding auth protocol: cephx 2024-09-12T17:35:15.317 INFO:tasks.workunit.client.0.smithi037.stderr: -57> 2024-09-12T17:35:15.177+0000 7fe38d12c800 5 AuthRegistry(0x7ffc663b3330) adding auth protocol: cephx 2024-09-12T17:35:15.317 INFO:tasks.workunit.client.0.smithi037.stderr: -56> 2024-09-12T17:35:15.177+0000 7fe38d12c800 5 AuthRegistry(0x7ffc663b3330) adding auth protocol: cephx 2024-09-12T17:35:15.317 INFO:tasks.workunit.client.0.smithi037.stderr: -55> 2024-09-12T17:35:15.177+0000 7fe38d12c800 5 AuthRegistry(0x7ffc663b3330) adding con mode: secure 2024-09-12T17:35:15.317 INFO:tasks.workunit.client.0.smithi037.stderr: -54> 2024-09-12T17:35:15.177+0000 7fe38d12c800 5 AuthRegistry(0x7ffc663b3330) adding con mode: crc 2024-09-12T17:35:15.317 INFO:tasks.workunit.client.0.smithi037.stderr: -53> 2024-09-12T17:35:15.177+0000 7fe38d12c800 5 AuthRegistry(0x7ffc663b3330) adding con mode: secure 2024-09-12T17:35:15.317 INFO:tasks.workunit.client.0.smithi037.stderr: -52> 2024-09-12T17:35:15.177+0000 7fe38d12c800 5 AuthRegistry(0x7ffc663b3330) adding con mode: crc 2024-09-12T17:35:15.317 INFO:tasks.workunit.client.0.smithi037.stderr: -51> 2024-09-12T17:35:15.177+0000 7fe38d12c800 5 AuthRegistry(0x7ffc663b3330) adding con mode: secure 2024-09-12T17:35:15.317 INFO:tasks.workunit.client.0.smithi037.stderr: -50> 2024-09-12T17:35:15.177+0000 7fe38d12c800 5 AuthRegistry(0x7ffc663b3330) adding con mode: crc 2024-09-12T17:35:15.318 INFO:tasks.workunit.client.0.smithi037.stderr: -49> 2024-09-12T17:35:15.177+0000 7fe38d12c800 5 AuthRegistry(0x7ffc663b3330) adding con mode: crc 2024-09-12T17:35:15.318 INFO:tasks.workunit.client.0.smithi037.stderr: -48> 2024-09-12T17:35:15.177+0000 7fe38d12c800 5 AuthRegistry(0x7ffc663b3330) adding con mode: secure 2024-09-12T17:35:15.318 INFO:tasks.workunit.client.0.smithi037.stderr: -47> 2024-09-12T17:35:15.177+0000 7fe38d12c800 5 AuthRegistry(0x7ffc663b3330) adding con mode: crc 2024-09-12T17:35:15.318 INFO:tasks.workunit.client.0.smithi037.stderr: -46> 2024-09-12T17:35:15.177+0000 7fe38d12c800 5 AuthRegistry(0x7ffc663b3330) adding con mode: secure 2024-09-12T17:35:15.318 INFO:tasks.workunit.client.0.smithi037.stderr: -45> 2024-09-12T17:35:15.177+0000 7fe38d12c800 5 AuthRegistry(0x7ffc663b3330) adding con mode: crc 2024-09-12T17:35:15.318 INFO:tasks.workunit.client.0.smithi037.stderr: -44> 2024-09-12T17:35:15.177+0000 7fe38d12c800 5 AuthRegistry(0x7ffc663b3330) adding con mode: secure 2024-09-12T17:35:15.318 INFO:tasks.workunit.client.0.smithi037.stderr: -43> 2024-09-12T17:35:15.177+0000 7fe23efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:35:15.318 INFO:tasks.workunit.client.0.smithi037.stderr: -42> 2024-09-12T17:35:15.178+0000 7fe38d12c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:35:15.318 INFO:tasks.workunit.client.0.smithi037.stderr: -41> 2024-09-12T17:35:15.178+0000 7fe38d12c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:35:15.318 INFO:tasks.workunit.client.0.smithi037.stderr: -40> 2024-09-12T17:35:15.178+0000 7fe38d12c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:35:15.318 INFO:tasks.workunit.client.0.smithi037.stderr: -39> 2024-09-12T17:35:15.178+0000 7fe38d12c800 5 asok(0x563c0c296730) register_command cache list hook 0x563c0c583bf0 2024-09-12T17:35:15.318 INFO:tasks.workunit.client.0.smithi037.stderr: -38> 2024-09-12T17:35:15.178+0000 7fe38d12c800 5 asok(0x563c0c296730) register_command cache inspect hook 0x563c0c583bf0 2024-09-12T17:35:15.318 INFO:tasks.workunit.client.0.smithi037.stderr: -37> 2024-09-12T17:35:15.178+0000 7fe38d12c800 5 asok(0x563c0c296730) register_command cache erase hook 0x563c0c583bf0 2024-09-12T17:35:15.318 INFO:tasks.workunit.client.0.smithi037.stderr: -36> 2024-09-12T17:35:15.178+0000 7fe38d12c800 5 asok(0x563c0c296730) register_command cache zap hook 0x563c0c583bf0 2024-09-12T17:35:15.318 INFO:tasks.workunit.client.0.smithi037.stderr: -35> 2024-09-12T17:35:15.178+0000 7fe38d12c800 5 note: GC not initialized 2024-09-12T17:35:15.319 INFO:tasks.workunit.client.0.smithi037.stderr: -34> 2024-09-12T17:35:15.178+0000 7fe23dfe3640 20 reqs_thread_entry: start 2024-09-12T17:35:15.319 INFO:tasks.workunit.client.0.smithi037.stderr: -33> 2024-09-12T17:35:15.178+0000 7fe38d12c800 5 asok(0x563c0c296730) register_command sync trace show hook 0x7fe37c088070 2024-09-12T17:35:15.319 INFO:tasks.workunit.client.0.smithi037.stderr: -32> 2024-09-12T17:35:15.178+0000 7fe38d12c800 5 asok(0x563c0c296730) register_command sync trace history hook 0x7fe37c088070 2024-09-12T17:35:15.319 INFO:tasks.workunit.client.0.smithi037.stderr: -31> 2024-09-12T17:35:15.178+0000 7fe38d12c800 5 asok(0x563c0c296730) register_command sync trace active hook 0x7fe37c088070 2024-09-12T17:35:15.319 INFO:tasks.workunit.client.0.smithi037.stderr: -30> 2024-09-12T17:35:15.178+0000 7fe38d12c800 5 asok(0x563c0c296730) register_command sync trace active_short hook 0x7fe37c088070 2024-09-12T17:35:15.319 INFO:tasks.workunit.client.0.smithi037.stderr: -29> 2024-09-12T17:35:15.178+0000 7fe38d12c800 20 init_complete bucket index max shards: 11 2024-09-12T17:35:15.319 INFO:tasks.workunit.client.0.smithi037.stderr: -28> 2024-09-12T17:35:15.178+0000 7fe38d12c800 20 Filter name: none 2024-09-12T17:35:15.319 INFO:tasks.workunit.client.0.smithi037.stderr: -27> 2024-09-12T17:35:15.178+0000 7fe1af7fe640 20 reqs_thread_entry: start 2024-09-12T17:35:15.319 INFO:tasks.workunit.client.0.smithi037.stderr: -26> 2024-09-12T17:35:15.178+0000 7fe38d12c800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-12T17:35:15.319 INFO:tasks.workunit.client.0.smithi037.stderr: -25> 2024-09-12T17:35:15.178+0000 7fe38d12c800 20 rados->read ofs=0 len=0 2024-09-12T17:35:15.319 INFO:tasks.workunit.client.0.smithi037.stderr: -24> 2024-09-12T17:35:15.179+0000 7fe38d12c800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:35:15.319 INFO:tasks.workunit.client.0.smithi037.stderr: -23> 2024-09-12T17:35:15.179+0000 7fe38d12c800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-12T17:35:15.319 INFO:tasks.workunit.client.0.smithi037.stderr: -22> 2024-09-12T17:35:15.179+0000 7fe38d12c800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-12T17:35:15.319 INFO:tasks.workunit.client.0.smithi037.stderr: -21> 2024-09-12T17:35:15.179+0000 7fe38d12c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.35 : miss 2024-09-12T17:35:15.320 INFO:tasks.workunit.client.0.smithi037.stderr: -20> 2024-09-12T17:35:15.179+0000 7fe38d12c800 20 rados->read ofs=0 len=0 2024-09-12T17:35:15.320 INFO:tasks.workunit.client.0.smithi037.stderr: -19> 2024-09-12T17:35:15.180+0000 7fe38d12c800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:35:15.320 INFO:tasks.workunit.client.0.smithi037.stderr: -18> 2024-09-12T17:35:15.180+0000 7fe38d12c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.35 info.flags=0x17 2024-09-12T17:35:15.320 INFO:tasks.workunit.client.0.smithi037.stderr: -17> 2024-09-12T17:35:15.180+0000 7fe38d12c800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.35 to cache LRU end 2024-09-12T17:35:15.320 INFO:tasks.workunit.client.0.smithi037.stderr: -16> 2024-09-12T17:35:15.180+0000 7fe38d12c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:35:15.320 INFO:tasks.workunit.client.0.smithi037.stderr: -15> 2024-09-12T17:35:15.180+0000 7fe38d12c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:35:15.320 INFO:tasks.workunit.client.0.smithi037.stderr: -14> 2024-09-12T17:35:15.180+0000 7fe38d12c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.35 2024-09-12T17:35:15.320 INFO:tasks.workunit.client.0.smithi037.stderr: -13> 2024-09-12T17:35:15.186+0000 7fe38d12c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.35 info.flags=0x17 2024-09-12T17:35:15.320 INFO:tasks.workunit.client.0.smithi037.stderr: -12> 2024-09-12T17:35:15.186+0000 7fe38d12c800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.35 to cache LRU end 2024-09-12T17:35:15.320 INFO:tasks.workunit.client.0.smithi037.stderr: -11> 2024-09-12T17:35:15.186+0000 7fe38d12c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:35:15.320 INFO:tasks.workunit.client.0.smithi037.stderr: -10> 2024-09-12T17:35:15.186+0000 7fe38d12c800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.35, ofs0, ns] 2024-09-12T17:35:15.320 INFO:tasks.workunit.client.0.smithi037.stderr: -9> 2024-09-12T17:35:15.187+0000 7fe25f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496983 cookie 94815905296992 notifier 7569 bl.length()=995 2024-09-12T17:35:15.320 INFO:tasks.workunit.client.0.smithi037.stderr: -8> 2024-09-12T17:35:15.187+0000 7fe25f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.35 info.flags=0x17 2024-09-12T17:35:15.321 INFO:tasks.workunit.client.0.smithi037.stderr: -7> 2024-09-12T17:35:15.187+0000 7fe25f7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.35 to cache LRU end 2024-09-12T17:35:15.321 INFO:tasks.workunit.client.0.smithi037.stderr: -6> 2024-09-12T17:35:15.187+0000 7fe25f7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:35:15.321 INFO:tasks.workunit.client.0.smithi037.stderr: -5> 2024-09-12T17:35:15.188+0000 7fe38d12c800 20 handle_bi_update(): bucket=:abort-at-do-reshard[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.35]): orig_sources= new_sources= 2024-09-12T17:35:15.321 INFO:tasks.workunit.client.0.smithi037.stderr: -4> 2024-09-12T17:35:15.188+0000 7fe38d12c800 20 handle_bi_update(): bucket=:abort-at-do-reshard[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.35]): potential sources added=[] removed=[] 2024-09-12T17:35:15.321 INFO:tasks.workunit.client.0.smithi037.stderr: -3> 2024-09-12T17:35:15.188+0000 7fe38d12c800 20 handle_bi_update(): bucket=:abort-at-do-reshard[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.35]): orig_dests= new_dests= 2024-09-12T17:35:15.321 INFO:tasks.workunit.client.0.smithi037.stderr: -2> 2024-09-12T17:35:15.188+0000 7fe38d12c800 20 handle_bi_update(): bucket=:abort-at-do-reshard[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.35]): potential dests added=[] removed=[] 2024-09-12T17:35:15.321 INFO:tasks.workunit.client.0.smithi037.stderr: -1> 2024-09-12T17:35:15.194+0000 7fe38d12c800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fe38d12c800 time 2024-09-12T17:35:15.194817+0000 2024-09-12T17:35:15.321 INFO:tasks.workunit.client.0.smithi037.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:35:15.321 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:35:15.321 INFO:tasks.workunit.client.0.smithi037.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:35:15.321 INFO:tasks.workunit.client.0.smithi037.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fe38e98c71a] 2024-09-12T17:35:15.321 INFO:tasks.workunit.client.0.smithi037.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fe38e98c8d8] 2024-09-12T17:35:15.321 INFO:tasks.workunit.client.0.smithi037.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x563c0a84a841] 2024-09-12T17:35:15.322 INFO:tasks.workunit.client.0.smithi037.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x563c0a85a57a] 2024-09-12T17:35:15.322 INFO:tasks.workunit.client.0.smithi037.stderr: 5: main() 2024-09-12T17:35:15.322 INFO:tasks.workunit.client.0.smithi037.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7fe38d629590] 2024-09-12T17:35:15.322 INFO:tasks.workunit.client.0.smithi037.stderr: 7: __libc_start_main() 2024-09-12T17:35:15.322 INFO:tasks.workunit.client.0.smithi037.stderr: 8: _start() 2024-09-12T17:35:15.322 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:35:15.322 INFO:tasks.workunit.client.0.smithi037.stderr: 0> 2024-09-12T17:35:15.195+0000 7fe38d12c800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:35:15.322 INFO:tasks.workunit.client.0.smithi037.stderr: in thread 7fe38d12c800 thread_name:radosgw-admin 2024-09-12T17:35:15.322 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:35:15.322 INFO:tasks.workunit.client.0.smithi037.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:35:15.322 INFO:tasks.workunit.client.0.smithi037.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fe38d63e6f0] 2024-09-12T17:35:15.322 INFO:tasks.workunit.client.0.smithi037.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fe38d68b99c] 2024-09-12T17:35:15.323 INFO:tasks.workunit.client.0.smithi037.stderr: 3: raise() 2024-09-12T17:35:15.323 INFO:tasks.workunit.client.0.smithi037.stderr: 4: abort() 2024-09-12T17:35:15.323 INFO:tasks.workunit.client.0.smithi037.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fe38e98c774] 2024-09-12T17:35:15.323 INFO:tasks.workunit.client.0.smithi037.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fe38e98c8d8] 2024-09-12T17:35:15.323 INFO:tasks.workunit.client.0.smithi037.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x563c0a84a841] 2024-09-12T17:35:15.323 INFO:tasks.workunit.client.0.smithi037.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x563c0a85a57a] 2024-09-12T17:35:15.323 INFO:tasks.workunit.client.0.smithi037.stderr: 9: main() 2024-09-12T17:35:15.323 INFO:tasks.workunit.client.0.smithi037.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7fe38d629590] 2024-09-12T17:35:15.323 INFO:tasks.workunit.client.0.smithi037.stderr: 11: __libc_start_main() 2024-09-12T17:35:15.323 INFO:tasks.workunit.client.0.smithi037.stderr: 12: _start() 2024-09-12T17:35:15.323 INFO:tasks.workunit.client.0.smithi037.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:35:15.323 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:35:15.323 INFO:tasks.workunit.client.0.smithi037.stderr:--- logging levels --- 2024-09-12T17:35:15.324 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 none 2024-09-12T17:35:15.324 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 lockdep 2024-09-12T17:35:15.324 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 context 2024-09-12T17:35:15.324 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 1 crush 2024-09-12T17:35:15.324 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mds 2024-09-12T17:35:15.324 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mds_balancer 2024-09-12T17:35:15.324 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mds_locker 2024-09-12T17:35:15.324 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mds_log 2024-09-12T17:35:15.324 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mds_log_expire 2024-09-12T17:35:15.324 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mds_migrator 2024-09-12T17:35:15.324 INFO:tasks.workunit.client.0.smithi037.stderr: 3/ 5 mds_quiesce 2024-09-12T17:35:15.324 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 buffer 2024-09-12T17:35:15.324 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 timer 2024-09-12T17:35:15.324 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 filer 2024-09-12T17:35:15.325 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 striper 2024-09-12T17:35:15.325 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 objecter 2024-09-12T17:35:15.325 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 rados 2024-09-12T17:35:15.325 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 rbd 2024-09-12T17:35:15.325 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 rbd_mirror 2024-09-12T17:35:15.325 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 rbd_replay 2024-09-12T17:35:15.325 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 rbd_pwl 2024-09-12T17:35:15.325 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 journaler 2024-09-12T17:35:15.325 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 objectcacher 2024-09-12T17:35:15.325 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:35:15.325 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 client 2024-09-12T17:35:15.325 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 osd 2024-09-12T17:35:15.325 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 optracker 2024-09-12T17:35:15.325 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 objclass 2024-09-12T17:35:15.326 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 3 filestore 2024-09-12T17:35:15.326 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 3 journal 2024-09-12T17:35:15.326 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 0 ms 2024-09-12T17:35:15.326 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mon 2024-09-12T17:35:15.326 INFO:tasks.workunit.client.0.smithi037.stderr: 0/10 monc 2024-09-12T17:35:15.326 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 paxos 2024-09-12T17:35:15.326 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 tp 2024-09-12T17:35:15.326 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 auth 2024-09-12T17:35:15.326 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 crypto 2024-09-12T17:35:15.326 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 1 finisher 2024-09-12T17:35:15.326 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 1 reserver 2024-09-12T17:35:15.326 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 heartbeatmap 2024-09-12T17:35:15.326 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 perfcounter 2024-09-12T17:35:15.326 INFO:tasks.workunit.client.0.smithi037.stderr: 20/20 rgw 2024-09-12T17:35:15.326 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 rgw_sync 2024-09-12T17:35:15.327 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 rgw_datacache 2024-09-12T17:35:15.327 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 rgw_access 2024-09-12T17:35:15.327 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:35:15.327 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 rgw_flight 2024-09-12T17:35:15.327 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:35:15.327 INFO:tasks.workunit.client.0.smithi037.stderr: 20/20 rgw_notification 2024-09-12T17:35:15.327 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 javaclient 2024-09-12T17:35:15.327 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 asok 2024-09-12T17:35:15.327 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 1 throttle 2024-09-12T17:35:15.327 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 0 refs 2024-09-12T17:35:15.327 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 compressor 2024-09-12T17:35:15.327 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 bluestore 2024-09-12T17:35:15.327 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 bluefs 2024-09-12T17:35:15.327 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 3 bdev 2024-09-12T17:35:15.328 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 kstore 2024-09-12T17:35:15.328 INFO:tasks.workunit.client.0.smithi037.stderr: 4/ 5 rocksdb 2024-09-12T17:35:15.328 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 fuse 2024-09-12T17:35:15.328 INFO:tasks.workunit.client.0.smithi037.stderr: 2/ 5 mgr 2024-09-12T17:35:15.328 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mgrc 2024-09-12T17:35:15.328 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 dpdk 2024-09-12T17:35:15.328 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 eventtrace 2024-09-12T17:35:15.328 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 prioritycache 2024-09-12T17:35:15.328 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 test 2024-09-12T17:35:15.328 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:35:15.328 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 cephsqlite 2024-09-12T17:35:15.328 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:35:15.328 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore 2024-09-12T17:35:15.328 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_onode 2024-09-12T17:35:15.328 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_odata 2024-09-12T17:35:15.329 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_omap 2024-09-12T17:35:15.329 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_tm 2024-09-12T17:35:15.329 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_t 2024-09-12T17:35:15.329 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:35:15.329 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_epm 2024-09-12T17:35:15.329 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_lba 2024-09-12T17:35:15.329 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:35:15.329 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_cache 2024-09-12T17:35:15.329 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_journal 2024-09-12T17:35:15.329 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_device 2024-09-12T17:35:15.329 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_backref 2024-09-12T17:35:15.329 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 alienstore 2024-09-12T17:35:15.329 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mclock 2024-09-12T17:35:15.329 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 cyanstore 2024-09-12T17:35:15.329 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 ceph_exporter 2024-09-12T17:35:15.330 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 memstore 2024-09-12T17:35:15.330 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 trace 2024-09-12T17:35:15.330 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 ceph_dedup 2024-09-12T17:35:15.330 INFO:tasks.workunit.client.0.smithi037.stderr: -2/-2 (syslog threshold) 2024-09-12T17:35:15.330 INFO:tasks.workunit.client.0.smithi037.stderr: 99/99 (stderr threshold) 2024-09-12T17:35:15.330 INFO:tasks.workunit.client.0.smithi037.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:35:15.330 INFO:tasks.workunit.client.0.smithi037.stderr: 7fe1af7fe640 / http_manager 2024-09-12T17:35:15.330 INFO:tasks.workunit.client.0.smithi037.stderr: 7fe23dfe3640 / http_manager 2024-09-12T17:35:15.330 INFO:tasks.workunit.client.0.smithi037.stderr: 7fe23efe5640 / rgw_dt_lg_renew 2024-09-12T17:35:15.330 INFO:tasks.workunit.client.0.smithi037.stderr: 7fe25e7fc640 / ms_dispatch 2024-09-12T17:35:15.330 INFO:tasks.workunit.client.0.smithi037.stderr: 7fe25f7fe640 / io_context_pool 2024-09-12T17:35:15.330 INFO:tasks.workunit.client.0.smithi037.stderr: 7fe25ffff640 / io_context_pool 2024-09-12T17:35:15.330 INFO:tasks.workunit.client.0.smithi037.stderr: 7fe26e7fc640 / ms_dispatch 2024-09-12T17:35:15.330 INFO:tasks.workunit.client.0.smithi037.stderr: 7fe27560a640 / ms_dispatch 2024-09-12T17:35:15.330 INFO:tasks.workunit.client.0.smithi037.stderr: 7fe276e0d640 / io_context_pool 2024-09-12T17:35:15.331 INFO:tasks.workunit.client.0.smithi037.stderr: 7fe38864e640 / msgr-worker-2 2024-09-12T17:35:15.331 INFO:tasks.workunit.client.0.smithi037.stderr: 7fe388e4f640 / msgr-worker-1 2024-09-12T17:35:15.331 INFO:tasks.workunit.client.0.smithi037.stderr: 7fe389650640 / msgr-worker-0 2024-09-12T17:35:15.331 INFO:tasks.workunit.client.0.smithi037.stderr: 7fe389e51640 / io_context_pool 2024-09-12T17:35:15.331 INFO:tasks.workunit.client.0.smithi037.stderr: 7fe38d12c800 / radosgw-admin 2024-09-12T17:35:15.331 INFO:tasks.workunit.client.0.smithi037.stderr: max_recent 500 2024-09-12T17:35:15.331 INFO:tasks.workunit.client.0.smithi037.stderr: max_new 1000 2024-09-12T17:35:15.331 INFO:tasks.workunit.client.0.smithi037.stderr: log_file /var/lib/ceph/crash/2024-09-12T17:35:15.196232Z_89c1f59b-c783-471a-9474-0f50fbcab064/log 2024-09-12T17:35:15.331 INFO:tasks.workunit.client.0.smithi037.stderr:--- end dump of recent events --- 2024-09-12T17:35:15.331 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-09-12T17:35:15.332 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:35:15.332 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:35:15.469 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.468+0000 7f191d5ae640 0 --2- 172.21.15.37:0/1222148751 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55580d0e5db0 0x55580d0ec030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-12T17:35:15.478 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.477+0000 7f1921925800 20 rados->read ofs=0 len=0 2024-09-12T17:35:15.480 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.479+0000 7f1921925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:15.480 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.479+0000 7f1921925800 20 realm 2024-09-12T17:35:15.480 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.479+0000 7f1921925800 20 rados->read ofs=0 len=0 2024-09-12T17:35:15.480 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.479+0000 7f1921925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:15.480 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.479+0000 7f1921925800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:35:15.480 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.479+0000 7f1921925800 20 rados->read ofs=0 len=0 2024-09-12T17:35:15.481 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.479+0000 7f1921925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:15.481 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.479+0000 7f1921925800 20 rados->read ofs=0 len=0 2024-09-12T17:35:15.481 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.480+0000 7f1921925800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:35:15.481 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.480+0000 7f1921925800 20 rados->read ofs=0 len=0 2024-09-12T17:35:15.481 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.481+0000 7f1921925800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:35:15.481 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.481+0000 7f1921925800 20 searching for the correct realm 2024-09-12T17:35:15.483 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.483+0000 7f191d5ae640 0 -- 172.21.15.37:0/4280672186 >> [v2:172.21.15.37:6800/1206746176,v1:172.21.15.37:6801/1206746176] conn(0x7f1918061040 msgr2=0x7f19180a5d70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:35:15.487 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.487+0000 7f191d5ae640 0 -- 172.21.15.37:0/4280672186 >> [v2:172.21.15.37:6800/1206746176,v1:172.21.15.37:6801/1206746176] conn(0x7f17e8086b10 msgr2=0x7f17e8088f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:35:15.494 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.493+0000 7f1921925800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:35:15.494 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.493+0000 7f1921925800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:35:15.494 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.493+0000 7f1921925800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:35:15.494 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.493+0000 7f1921925800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:35:15.494 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.493+0000 7f1921925800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:35:15.494 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.493+0000 7f1921925800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:35:15.494 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.493+0000 7f1921925800 20 rados->read ofs=0 len=0 2024-09-12T17:35:15.494 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.493+0000 7f1921925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:15.494 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.493+0000 7f1921925800 20 rados->read ofs=0 len=0 2024-09-12T17:35:15.496 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.493+0000 7f1921925800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:35:15.496 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.493+0000 7f1921925800 20 rados->read ofs=0 len=0 2024-09-12T17:35:15.496 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.494+0000 7f1921925800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:35:15.496 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.494+0000 7f1921925800 20 zone default found 2024-09-12T17:35:15.496 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.494+0000 7f1921925800 4 Realm: () 2024-09-12T17:35:15.496 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.494+0000 7f1921925800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:35:15.496 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.494+0000 7f1921925800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:35:15.496 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.494+0000 7f1921925800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:35:15.497 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.494+0000 7f1921925800 20 zonegroup default 2024-09-12T17:35:15.497 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.494+0000 7f1921925800 20 rados->read ofs=0 len=0 2024-09-12T17:35:15.497 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.494+0000 7f1921925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:15.497 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.494+0000 7f1921925800 20 rados->read ofs=0 len=0 2024-09-12T17:35:15.497 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.494+0000 7f1921925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:15.497 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.494+0000 7f1921925800 20 rados->read ofs=0 len=0 2024-09-12T17:35:15.497 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.495+0000 7f1921925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:15.497 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.495+0000 7f1921925800 20 started sync module instance, tier type = 2024-09-12T17:35:15.497 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.495+0000 7f1921925800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:35:15.506 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.505+0000 7f1921925800 20 add_watcher() i=0 2024-09-12T17:35:15.506 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.505+0000 7f1921925800 20 add_watcher() i=1 2024-09-12T17:35:15.506 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.505+0000 7f1921925800 20 add_watcher() i=2 2024-09-12T17:35:15.506 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.505+0000 7f1921925800 20 add_watcher() i=3 2024-09-12T17:35:15.506 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.505+0000 7f1921925800 20 add_watcher() i=4 2024-09-12T17:35:15.506 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.505+0000 7f1921925800 20 add_watcher() i=5 2024-09-12T17:35:15.507 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.505+0000 7f1921925800 20 add_watcher() i=6 2024-09-12T17:35:15.507 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.506+0000 7f1921925800 20 add_watcher() i=7 2024-09-12T17:35:15.507 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.506+0000 7f1921925800 2 all 8 watchers are set, enabling cache 2024-09-12T17:35:15.509 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.508+0000 7f17d37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:35:15.510 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.508+0000 7f1921925800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:35:15.510 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.508+0000 7f1921925800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:35:15.510 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.508+0000 7f1921925800 5 note: GC not initialized 2024-09-12T17:35:15.510 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.509+0000 7f17d27e4640 20 reqs_thread_entry: start 2024-09-12T17:35:15.510 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.509+0000 7f1921925800 20 init_complete bucket index max shards: 11 2024-09-12T17:35:15.510 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.509+0000 7f1921925800 20 Filter name: none 2024-09-12T17:35:15.510 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.509+0000 7f1743fff640 20 reqs_thread_entry: start 2024-09-12T17:35:15.510 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.509+0000 7f1921925800 20 rados->read ofs=0 len=0 2024-09-12T17:35:15.511 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.510+0000 7f1921925800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:35:15.511 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.510+0000 7f1921925800 20 rados->read ofs=0 len=0 2024-09-12T17:35:15.511 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.510+0000 7f1921925800 20 rados_obj.operate() r=0 bl.length=465 2024-09-12T17:35:15.511 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.510+0000 7f1921925800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:35:15.512 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.510+0000 7f1921925800 20 rados->read ofs=0 len=0 2024-09-12T17:35:15.512 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.511+0000 7f1921925800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:35:15.512 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.511+0000 7f1921925800 20 rados->read ofs=0 len=0 2024-09-12T17:35:15.512 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.511+0000 7f1921925800 20 rados_obj.operate() r=0 bl.length=465 2024-09-12T17:35:15.512 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.511+0000 7f1921925800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:35:15.513 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.513+0000 7f17d37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:35:15.516 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.515+0000 7f1921925800 20 remove_watcher() i=0 2024-09-12T17:35:15.516 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.515+0000 7f1921925800 2 removed watcher, disabling cache 2024-09-12T17:35:15.517 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.517+0000 7f1921925800 20 remove_watcher() i=1 2024-09-12T17:35:15.518 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.518+0000 7f1921925800 20 remove_watcher() i=2 2024-09-12T17:35:15.520 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.519+0000 7f1921925800 20 remove_watcher() i=3 2024-09-12T17:35:15.521 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.520+0000 7f1921925800 20 remove_watcher() i=4 2024-09-12T17:35:15.522 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.521+0000 7f1921925800 20 remove_watcher() i=5 2024-09-12T17:35:15.523 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.522+0000 7f1921925800 20 remove_watcher() i=6 2024-09-12T17:35:15.524 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.523+0000 7f1921925800 20 remove_watcher() i=7 2024-09-12T17:35:15.535 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:35:15.535 INFO:tasks.workunit.client.0.smithi037.stderr:BUCKET_STATS: 2024-09-12T17:35:15.535 INFO:tasks.workunit.client.0.smithi037.stderr:bucket: abort-at-do-reshard id: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.35 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:35:15.535 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:35:15.626 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:35:15.658 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:35:15.658 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:35:15.698 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.698+0000 7fd73c131800 20 rados->read ofs=0 len=0 2024-09-12T17:35:15.700 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.699+0000 7fd73c131800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:15.700 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.699+0000 7fd73c131800 20 realm 2024-09-12T17:35:15.701 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.699+0000 7fd73c131800 20 rados->read ofs=0 len=0 2024-09-12T17:35:15.701 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.699+0000 7fd73c131800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:15.701 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.699+0000 7fd73c131800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:35:15.701 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.699+0000 7fd73c131800 20 rados->read ofs=0 len=0 2024-09-12T17:35:15.701 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.700+0000 7fd73c131800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:15.701 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.700+0000 7fd73c131800 20 rados->read ofs=0 len=0 2024-09-12T17:35:15.702 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.701+0000 7fd73c131800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:35:15.702 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.701+0000 7fd73c131800 20 rados->read ofs=0 len=0 2024-09-12T17:35:15.702 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.701+0000 7fd73c131800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:35:15.702 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.701+0000 7fd73c131800 20 searching for the correct realm 2024-09-12T17:35:15.706 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.705+0000 7fd72f619640 0 -- 172.21.15.37:0/1937088 >> [v2:172.21.15.40:6800/2441293461,v1:172.21.15.40:6801/2441293461] conn(0x7fd7280bf040 msgr2=0x7fd7280a3510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:35:15.709 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.709+0000 7fd73861b640 0 -- 172.21.15.37:0/1937088 >> [v2:172.21.15.40:6808/2253405131,v1:172.21.15.40:6809/2253405131] conn(0x7fd720067820 msgr2=0x7fd720068840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:35:15.714 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.712+0000 7fd73c131800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:35:15.714 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.712+0000 7fd73c131800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:35:15.714 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.712+0000 7fd73c131800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:35:15.714 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.712+0000 7fd73c131800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:35:15.714 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.712+0000 7fd73c131800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:35:15.714 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.712+0000 7fd73c131800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:35:15.714 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.712+0000 7fd73c131800 20 rados->read ofs=0 len=0 2024-09-12T17:35:15.715 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.712+0000 7fd73c131800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:15.715 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.712+0000 7fd73c131800 20 rados->read ofs=0 len=0 2024-09-12T17:35:15.715 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.713+0000 7fd73c131800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:35:15.715 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.713+0000 7fd73c131800 20 rados->read ofs=0 len=0 2024-09-12T17:35:15.715 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.713+0000 7fd73c131800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:35:15.715 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.713+0000 7fd73c131800 20 zone default found 2024-09-12T17:35:15.715 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.713+0000 7fd73c131800 4 Realm: () 2024-09-12T17:35:15.715 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.713+0000 7fd73c131800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:35:15.715 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.713+0000 7fd73c131800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:35:15.715 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.713+0000 7fd73c131800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:35:15.715 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.713+0000 7fd73c131800 20 zonegroup default 2024-09-12T17:35:15.715 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.713+0000 7fd73c131800 20 rados->read ofs=0 len=0 2024-09-12T17:35:15.715 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.713+0000 7fd73c131800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:15.716 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.713+0000 7fd73c131800 20 rados->read ofs=0 len=0 2024-09-12T17:35:15.716 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.714+0000 7fd73c131800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:15.716 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.714+0000 7fd73c131800 20 rados->read ofs=0 len=0 2024-09-12T17:35:15.716 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.714+0000 7fd73c131800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:15.717 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.714+0000 7fd73c131800 20 started sync module instance, tier type = 2024-09-12T17:35:15.717 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.714+0000 7fd73c131800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:35:15.725 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.724+0000 7fd73c131800 20 add_watcher() i=0 2024-09-12T17:35:15.725 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.724+0000 7fd73c131800 20 add_watcher() i=1 2024-09-12T17:35:15.725 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.724+0000 7fd73c131800 20 add_watcher() i=2 2024-09-12T17:35:15.725 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.724+0000 7fd73c131800 20 add_watcher() i=3 2024-09-12T17:35:15.725 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.724+0000 7fd73c131800 20 add_watcher() i=4 2024-09-12T17:35:15.725 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.724+0000 7fd73c131800 20 add_watcher() i=5 2024-09-12T17:35:15.725 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.724+0000 7fd73c131800 20 add_watcher() i=6 2024-09-12T17:35:15.725 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.725+0000 7fd73c131800 20 add_watcher() i=7 2024-09-12T17:35:15.725 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.725+0000 7fd73c131800 2 all 8 watchers are set, enabling cache 2024-09-12T17:35:15.727 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.726+0000 7fd5edfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:35:15.728 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.727+0000 7fd73c131800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:35:15.728 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.727+0000 7fd73c131800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:35:15.728 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.727+0000 7fd73c131800 5 note: GC not initialized 2024-09-12T17:35:15.728 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.727+0000 7fd5ecfe1640 20 reqs_thread_entry: start 2024-09-12T17:35:15.728 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.727+0000 7fd73c131800 20 init_complete bucket index max shards: 11 2024-09-12T17:35:15.728 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.727+0000 7fd73c131800 20 Filter name: none 2024-09-12T17:35:15.728 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.727+0000 7fd5667fc640 20 reqs_thread_entry: start 2024-09-12T17:35:15.729 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.727+0000 7fd73c131800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-12T17:35:15.729 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.727+0000 7fd73c131800 20 rados->read ofs=0 len=0 2024-09-12T17:35:15.729 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.728+0000 7fd73c131800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:35:15.729 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.728+0000 7fd73c131800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-12T17:35:15.729 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.728+0000 7fd73c131800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-12T17:35:15.730 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.728+0000 7fd73c131800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.35 : miss 2024-09-12T17:35:15.730 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.728+0000 7fd73c131800 20 rados->read ofs=0 len=0 2024-09-12T17:35:15.730 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.728+0000 7fd73c131800 20 rados_obj.operate() r=0 bl.length=465 2024-09-12T17:35:15.730 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.728+0000 7fd73c131800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.35 info.flags=0x17 2024-09-12T17:35:15.730 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.728+0000 7fd73c131800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.35 to cache LRU end 2024-09-12T17:35:15.730 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.728+0000 7fd73c131800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:35:15.730 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.728+0000 7fd73c131800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:35:15.730 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.728+0000 7fd73c131800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.35 2024-09-12T17:35:15.730 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.729+0000 7fd73c131800 0 INFO: RGWReshardLock::lock found lock on abort-at-do-reshard:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.35 to be held by another RGW process; skipping for now 2024-09-12T17:35:15.731 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.730+0000 7fd5edfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:35:15.733 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.733+0000 7fd73c131800 20 remove_watcher() i=0 2024-09-12T17:35:15.733 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.733+0000 7fd73c131800 2 removed watcher, disabling cache 2024-09-12T17:35:15.735 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.734+0000 7fd73c131800 20 remove_watcher() i=1 2024-09-12T17:35:15.735 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.735+0000 7fd73c131800 20 remove_watcher() i=2 2024-09-12T17:35:15.737 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.736+0000 7fd73c131800 20 remove_watcher() i=3 2024-09-12T17:35:15.738 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.737+0000 7fd73c131800 20 remove_watcher() i=4 2024-09-12T17:35:15.739 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.738+0000 7fd73c131800 20 remove_watcher() i=5 2024-09-12T17:35:15.740 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.739+0000 7fd73c131800 20 remove_watcher() i=6 2024-09-12T17:35:15.741 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:15.740+0000 7fd73c131800 20 remove_watcher() i=7 2024-09-12T17:35:15.752 INFO:tasks.workunit.client.0.smithi037.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T17:35:45.769 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:35:45.806 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:35:45.806 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:35:45.851 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:45.850+0000 7fe8de144800 20 rados->read ofs=0 len=0 2024-09-12T17:35:45.853 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:45.852+0000 7fe8de144800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:45.853 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:45.852+0000 7fe8de144800 20 realm 2024-09-12T17:35:45.853 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:45.852+0000 7fe8de144800 20 rados->read ofs=0 len=0 2024-09-12T17:35:45.853 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:45.852+0000 7fe8de144800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:45.853 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:45.852+0000 7fe8de144800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:35:45.853 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:45.852+0000 7fe8de144800 20 rados->read ofs=0 len=0 2024-09-12T17:35:45.853 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:45.852+0000 7fe8de144800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:45.853 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:45.852+0000 7fe8de144800 20 rados->read ofs=0 len=0 2024-09-12T17:35:45.854 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:45.853+0000 7fe8de144800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:35:45.854 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:45.853+0000 7fe8de144800 20 rados->read ofs=0 len=0 2024-09-12T17:35:45.854 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:45.854+0000 7fe8de144800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:35:45.855 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:45.854+0000 7fe8de144800 20 searching for the correct realm 2024-09-12T17:35:45.858 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:45.857+0000 7fe8da6f5640 0 -- 172.21.15.37:0/774450422 >> [v2:172.21.15.40:6818/1210108009,v1:172.21.15.40:6819/1210108009] conn(0x7fe8d0078070 msgr2=0x7fe8d0087430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:35:45.863 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:45.862+0000 7fe8d9ef4640 0 -- 172.21.15.37:0/774450422 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7fe8d006b960 msgr2=0x7fe8d0079400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:35:46.071 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.070+0000 7fe8de144800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:35:46.072 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.070+0000 7fe8de144800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:35:46.072 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.070+0000 7fe8de144800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:35:46.072 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.070+0000 7fe8de144800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:35:46.072 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.070+0000 7fe8de144800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:35:46.072 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.070+0000 7fe8de144800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:35:46.072 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.070+0000 7fe8de144800 20 rados->read ofs=0 len=0 2024-09-12T17:35:46.072 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.071+0000 7fe8de144800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:46.072 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.071+0000 7fe8de144800 20 rados->read ofs=0 len=0 2024-09-12T17:35:46.073 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.071+0000 7fe8de144800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:35:46.074 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.071+0000 7fe8de144800 20 rados->read ofs=0 len=0 2024-09-12T17:35:46.074 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.072+0000 7fe8de144800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:35:46.074 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.072+0000 7fe8de144800 20 zone default found 2024-09-12T17:35:46.074 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.072+0000 7fe8de144800 4 Realm: () 2024-09-12T17:35:46.074 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.072+0000 7fe8de144800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:35:46.074 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.072+0000 7fe8de144800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:35:46.074 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.072+0000 7fe8de144800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:35:46.074 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.072+0000 7fe8de144800 20 zonegroup default 2024-09-12T17:35:46.074 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.072+0000 7fe8de144800 20 rados->read ofs=0 len=0 2024-09-12T17:35:46.074 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.072+0000 7fe8de144800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:46.074 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.072+0000 7fe8de144800 20 rados->read ofs=0 len=0 2024-09-12T17:35:46.074 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.072+0000 7fe8de144800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:46.074 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.072+0000 7fe8de144800 20 rados->read ofs=0 len=0 2024-09-12T17:35:46.074 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.073+0000 7fe8de144800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:46.075 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.073+0000 7fe8de144800 20 started sync module instance, tier type = 2024-09-12T17:35:46.075 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.073+0000 7fe8de144800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:35:46.084 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.083+0000 7fe8de144800 20 add_watcher() i=0 2024-09-12T17:35:46.084 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.083+0000 7fe8de144800 20 add_watcher() i=1 2024-09-12T17:35:46.084 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.083+0000 7fe8de144800 20 add_watcher() i=2 2024-09-12T17:35:46.084 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.083+0000 7fe8de144800 20 add_watcher() i=3 2024-09-12T17:35:46.084 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.083+0000 7fe8de144800 20 add_watcher() i=4 2024-09-12T17:35:46.084 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.083+0000 7fe8de144800 20 add_watcher() i=5 2024-09-12T17:35:46.084 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.083+0000 7fe8de144800 20 add_watcher() i=6 2024-09-12T17:35:46.085 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.084+0000 7fe8de144800 20 add_watcher() i=7 2024-09-12T17:35:46.085 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.084+0000 7fe8de144800 2 all 8 watchers are set, enabling cache 2024-09-12T17:35:46.087 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.086+0000 7fe78ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:35:46.088 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.087+0000 7fe8de144800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:35:46.088 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.087+0000 7fe8de144800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:35:46.088 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.087+0000 7fe8de144800 5 note: GC not initialized 2024-09-12T17:35:46.088 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.087+0000 7fe78efe5640 20 reqs_thread_entry: start 2024-09-12T17:35:46.089 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.087+0000 7fe8de144800 20 init_complete bucket index max shards: 11 2024-09-12T17:35:46.089 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.087+0000 7fe8de144800 20 Filter name: none 2024-09-12T17:35:46.089 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.087+0000 7fe78cfe1640 20 reqs_thread_entry: start 2024-09-12T17:35:46.089 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.087+0000 7fe8de144800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-12T17:35:46.089 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.087+0000 7fe8de144800 20 rados->read ofs=0 len=0 2024-09-12T17:35:46.089 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.088+0000 7fe8de144800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:35:46.090 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.088+0000 7fe8de144800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-12T17:35:46.090 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.088+0000 7fe8de144800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-12T17:35:46.090 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.088+0000 7fe8de144800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.35 : miss 2024-09-12T17:35:46.090 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.088+0000 7fe8de144800 20 rados->read ofs=0 len=0 2024-09-12T17:35:46.090 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.088+0000 7fe8de144800 20 rados_obj.operate() r=0 bl.length=465 2024-09-12T17:35:46.090 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.088+0000 7fe8de144800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.35 info.flags=0x17 2024-09-12T17:35:46.090 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.088+0000 7fe8de144800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.35 to cache LRU end 2024-09-12T17:35:46.090 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.088+0000 7fe8de144800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:35:46.090 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.088+0000 7fe8de144800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:35:46.090 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.088+0000 7fe8de144800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.35 2024-09-12T17:35:46.091 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.090+0000 7fe8de144800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T17:35:46.098 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.098+0000 7fe8de144800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.35 info.flags=0x17 2024-09-12T17:35:46.099 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.098+0000 7fe8de144800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.35 to cache LRU end 2024-09-12T17:35:46.099 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.098+0000 7fe8de144800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:35:46.099 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.098+0000 7fe8de144800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.35, ofs0, ns] 2024-09-12T17:35:46.099 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.098+0000 7fe7bd7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496984 cookie 94328357923808 notifier 7142 bl.length()=995 2024-09-12T17:35:46.099 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.098+0000 7fe7bd7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.35 info.flags=0x17 2024-09-12T17:35:46.099 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.098+0000 7fe7bd7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.35 to cache LRU end 2024-09-12T17:35:46.099 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.098+0000 7fe7bd7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:35:46.100 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.100+0000 7fe8de144800 20 handle_bi_update(): bucket=:abort-at-do-reshard[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.35]): orig_sources= new_sources= 2024-09-12T17:35:46.101 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.100+0000 7fe8de144800 20 handle_bi_update(): bucket=:abort-at-do-reshard[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.35]): potential sources added=[] removed=[] 2024-09-12T17:35:46.101 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.100+0000 7fe8de144800 20 handle_bi_update(): bucket=:abort-at-do-reshard[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.35]): orig_dests= new_dests= 2024-09-12T17:35:46.101 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.100+0000 7fe8de144800 20 handle_bi_update(): bucket=:abort-at-do-reshard[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.35]): potential dests added=[] removed=[] 2024-09-12T17:35:46.107 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.106+0000 7fe8de144800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.35.2.0 2024-09-12T17:35:46.107 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.106+0000 7fe8de144800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.35.2.0 2024-09-12T17:35:46.107 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.106+0000 7fe8de144800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.35.2.1 2024-09-12T17:35:46.107 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.106+0000 7fe8de144800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.35.2.1 2024-09-12T17:35:46.107 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.106+0000 7fe8de144800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.35.2.2 2024-09-12T17:35:46.107 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.106+0000 7fe8de144800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.35.2.2 2024-09-12T17:35:46.107 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.106+0000 7fe8de144800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.35.2.3 2024-09-12T17:35:46.107 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.106+0000 7fe8de144800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.35.2.3 2024-09-12T17:35:46.107 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.106+0000 7fe8de144800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.35.2.4 2024-09-12T17:35:46.107 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.106+0000 7fe8de144800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.35.2.4 2024-09-12T17:35:46.108 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.106+0000 7fe8de144800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.35.2.5 2024-09-12T17:35:46.108 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.106+0000 7fe8de144800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.35.2.5 2024-09-12T17:35:46.108 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.106+0000 7fe8de144800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.35.2.6 2024-09-12T17:35:46.108 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.106+0000 7fe8de144800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.35.2.6 2024-09-12T17:35:46.108 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.106+0000 7fe8de144800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.35.2.7 2024-09-12T17:35:46.108 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.106+0000 7fe8de144800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.35.2.7 2024-09-12T17:35:46.108 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.106+0000 7fe8de144800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.35.2.8 2024-09-12T17:35:46.108 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.106+0000 7fe8de144800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.35.2.8 2024-09-12T17:35:46.108 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.106+0000 7fe8de144800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.35.2.9 2024-09-12T17:35:46.108 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.106+0000 7fe8de144800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.35.2.9 2024-09-12T17:35:46.108 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.106+0000 7fe8de144800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.35.2.10 2024-09-12T17:35:46.108 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.106+0000 7fe8de144800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.35.2.10 2024-09-12T17:35:46.108 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.106+0000 7fe8de144800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.35.2.11 2024-09-12T17:35:46.109 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.106+0000 7fe8de144800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.35.2.11 2024-09-12T17:35:46.109 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.106+0000 7fe8de144800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.35.0 2024-09-12T17:35:46.109 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.106+0000 7fe8de144800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.35.1 2024-09-12T17:35:46.109 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.107+0000 7fe8de144800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.35.2 2024-09-12T17:35:46.110 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.108+0000 7fe8de144800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.35.3 2024-09-12T17:35:46.110 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.108+0000 7fe8de144800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.35.4 2024-09-12T17:35:46.110 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.109+0000 7fe8de144800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.35.5 2024-09-12T17:35:46.110 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.109+0000 7fe8de144800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.35.6 2024-09-12T17:35:46.111 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.110+0000 7fe8de144800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.35.7 2024-09-12T17:35:46.111 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.111+0000 7fe8de144800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.35.8 2024-09-12T17:35:46.112 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.111+0000 7fe8de144800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.35.9 2024-09-12T17:35:46.112 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.112+0000 7fe8de144800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.35.10 2024-09-12T17:35:46.117 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.117+0000 7fe8de144800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.35 : hit (requested=0x17, cached=0x17) 2024-09-12T17:35:46.117 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.117+0000 7fe8de144800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.35 2024-09-12T17:35:46.119 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.118+0000 7fe8de144800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.35 info.flags=0x17 2024-09-12T17:35:46.119 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.118+0000 7fe8de144800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.35 to cache LRU end 2024-09-12T17:35:46.119 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.118+0000 7fe8de144800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:35:46.119 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.118+0000 7fe8de144800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.35, ofs0, ns] 2024-09-12T17:35:46.119 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.118+0000 7fe7bd7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496985 cookie 94328357923808 notifier 7142 bl.length()=995 2024-09-12T17:35:46.119 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.118+0000 7fe7bd7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.35 info.flags=0x17 2024-09-12T17:35:46.120 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.118+0000 7fe7bd7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.35 to cache LRU end 2024-09-12T17:35:46.120 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.118+0000 7fe7bd7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:35:46.121 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.120+0000 7fe8de144800 20 handle_bi_update(): bucket=:abort-at-do-reshard[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.35]): orig_sources= new_sources= 2024-09-12T17:35:46.121 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.120+0000 7fe8de144800 20 handle_bi_update(): bucket=:abort-at-do-reshard[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.35]): potential sources added=[] removed=[] 2024-09-12T17:35:46.121 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.120+0000 7fe8de144800 20 handle_bi_update(): bucket=:abort-at-do-reshard[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.35]): orig_dests= new_dests= 2024-09-12T17:35:46.121 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.120+0000 7fe8de144800 20 handle_bi_update(): bucket=:abort-at-do-reshard[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.35]): potential dests added=[] removed=[] 2024-09-12T17:35:46.124 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.123+0000 7fe8de144800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.35.0 2024-09-12T17:35:46.124 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.123+0000 7fe8de144800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.35.1 2024-09-12T17:35:46.124 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.124+0000 7fe8de144800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.35.2 2024-09-12T17:35:46.125 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.124+0000 7fe8de144800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.35.3 2024-09-12T17:35:46.125 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.125+0000 7fe8de144800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.35.4 2024-09-12T17:35:46.126 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.125+0000 7fe8de144800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.35.5 2024-09-12T17:35:46.126 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.125+0000 7fe8de144800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.35.6 2024-09-12T17:35:46.126 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.126+0000 7fe8de144800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.35.7 2024-09-12T17:35:46.127 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.126+0000 7fe8de144800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.35.8 2024-09-12T17:35:46.127 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.126+0000 7fe8de144800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.35.9 2024-09-12T17:35:46.127 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.127+0000 7fe8de144800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.35.10 2024-09-12T17:35:46.128 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.127+0000 7fe8de144800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.35 : hit (requested=0x17, cached=0x17) 2024-09-12T17:35:46.128 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.127+0000 7fe8de144800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.35 2024-09-12T17:35:46.129 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.129+0000 7fe8de144800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.35 info.flags=0x17 2024-09-12T17:35:46.129 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.129+0000 7fe8de144800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.35 to cache LRU end 2024-09-12T17:35:46.129 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.129+0000 7fe8de144800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:35:46.129 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.129+0000 7fe8de144800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.35, ofs0, ns] 2024-09-12T17:35:46.130 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.129+0000 7fe7bd7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496986 cookie 94328357923808 notifier 7142 bl.length()=963 2024-09-12T17:35:46.130 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.129+0000 7fe7bd7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.35 info.flags=0x17 2024-09-12T17:35:46.130 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.129+0000 7fe7bd7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.35 to cache LRU end 2024-09-12T17:35:46.130 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.129+0000 7fe7bd7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:35:46.131 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.131+0000 7fe8de144800 20 handle_bi_update(): bucket=:abort-at-do-reshard[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.35]): orig_sources= new_sources= 2024-09-12T17:35:46.131 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.131+0000 7fe8de144800 20 handle_bi_update(): bucket=:abort-at-do-reshard[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.35]): potential sources added=[] removed=[] 2024-09-12T17:35:46.131 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.131+0000 7fe8de144800 20 handle_bi_update(): bucket=:abort-at-do-reshard[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.35]): orig_dests= new_dests= 2024-09-12T17:35:46.132 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.131+0000 7fe8de144800 20 handle_bi_update(): bucket=:abort-at-do-reshard[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.35]): potential dests added=[] removed=[] 2024-09-12T17:35:46.135 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.134+0000 7fe8de144800 1 execute INFO: reshard of bucket "abort-at-do-reshard" from 11 shards to 12 shards completed successfully 2024-09-12T17:35:46.137 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.136+0000 7fe78ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:35:46.140 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.139+0000 7fe8de144800 20 remove_watcher() i=0 2024-09-12T17:35:46.140 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.139+0000 7fe8de144800 2 removed watcher, disabling cache 2024-09-12T17:35:46.141 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.140+0000 7fe8de144800 20 remove_watcher() i=1 2024-09-12T17:35:46.142 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.142+0000 7fe8de144800 20 remove_watcher() i=2 2024-09-12T17:35:46.143 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.143+0000 7fe8de144800 20 remove_watcher() i=3 2024-09-12T17:35:46.144 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.144+0000 7fe8de144800 20 remove_watcher() i=4 2024-09-12T17:35:46.146 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.145+0000 7fe8de144800 20 remove_watcher() i=5 2024-09-12T17:35:46.146 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.146+0000 7fe8de144800 20 remove_watcher() i=6 2024-09-12T17:35:46.147 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.147+0000 7fe8de144800 20 remove_watcher() i=7 2024-09-12T17:35:46.161 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-09-12T17:35:46.190 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:35:46.190 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:35:46.229 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.229+0000 7f491a742800 20 rados->read ofs=0 len=0 2024-09-12T17:35:46.232 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.231+0000 7f491a742800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:46.232 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.231+0000 7f491a742800 20 realm 2024-09-12T17:35:46.232 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.231+0000 7f491a742800 20 rados->read ofs=0 len=0 2024-09-12T17:35:46.232 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.231+0000 7f491a742800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:46.232 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.231+0000 7f491a742800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:35:46.232 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.231+0000 7f491a742800 20 rados->read ofs=0 len=0 2024-09-12T17:35:46.232 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.231+0000 7f491a742800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:46.232 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.231+0000 7f491a742800 20 rados->read ofs=0 len=0 2024-09-12T17:35:46.233 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.232+0000 7f491a742800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:35:46.233 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.232+0000 7f491a742800 20 rados->read ofs=0 len=0 2024-09-12T17:35:46.233 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.232+0000 7f491a742800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:35:46.233 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.232+0000 7f491a742800 20 searching for the correct realm 2024-09-12T17:35:46.236 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.235+0000 7f4915c85640 0 -- 172.21.15.37:0/2841380222 >> [v2:172.21.15.40:6800/2441293461,v1:172.21.15.40:6801/2441293461] conn(0x7f4908074020 msgr2=0x7f49080a4f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:35:46.442 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.441+0000 7f4916486640 0 -- 172.21.15.37:0/2841380222 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7f490c053930 msgr2=0x7f490c016400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:35:46.649 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.647+0000 7f491a742800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:35:46.649 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.647+0000 7f491a742800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:35:46.649 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.647+0000 7f491a742800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:35:46.649 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.647+0000 7f491a742800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:35:46.649 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.647+0000 7f491a742800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:35:46.649 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.647+0000 7f491a742800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:35:46.649 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.647+0000 7f491a742800 20 rados->read ofs=0 len=0 2024-09-12T17:35:46.649 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.647+0000 7f491a742800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:46.649 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.647+0000 7f491a742800 20 rados->read ofs=0 len=0 2024-09-12T17:35:46.650 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.647+0000 7f491a742800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:35:46.651 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.647+0000 7f491a742800 20 rados->read ofs=0 len=0 2024-09-12T17:35:46.651 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.648+0000 7f491a742800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:35:46.651 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.648+0000 7f491a742800 20 zone default found 2024-09-12T17:35:46.651 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.648+0000 7f491a742800 4 Realm: () 2024-09-12T17:35:46.651 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.648+0000 7f491a742800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:35:46.651 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.648+0000 7f491a742800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:35:46.651 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.648+0000 7f491a742800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:35:46.651 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.648+0000 7f491a742800 20 zonegroup default 2024-09-12T17:35:46.651 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.648+0000 7f491a742800 20 rados->read ofs=0 len=0 2024-09-12T17:35:46.651 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.648+0000 7f491a742800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:46.651 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.648+0000 7f491a742800 20 rados->read ofs=0 len=0 2024-09-12T17:35:46.651 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.649+0000 7f491a742800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:46.651 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.649+0000 7f491a742800 20 rados->read ofs=0 len=0 2024-09-12T17:35:46.651 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.649+0000 7f491a742800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:46.652 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.649+0000 7f491a742800 20 started sync module instance, tier type = 2024-09-12T17:35:46.652 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.649+0000 7f491a742800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:35:46.661 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.659+0000 7f491a742800 20 add_watcher() i=0 2024-09-12T17:35:46.661 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.659+0000 7f491a742800 20 add_watcher() i=1 2024-09-12T17:35:46.661 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.659+0000 7f491a742800 20 add_watcher() i=2 2024-09-12T17:35:46.661 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.659+0000 7f491a742800 20 add_watcher() i=3 2024-09-12T17:35:46.661 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.659+0000 7f491a742800 20 add_watcher() i=4 2024-09-12T17:35:46.661 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.659+0000 7f491a742800 20 add_watcher() i=5 2024-09-12T17:35:46.662 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.659+0000 7f491a742800 20 add_watcher() i=6 2024-09-12T17:35:46.662 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.660+0000 7f491a742800 20 add_watcher() i=7 2024-09-12T17:35:46.662 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.660+0000 7f491a742800 2 all 8 watchers are set, enabling cache 2024-09-12T17:35:46.665 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.662+0000 7f47ccfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:35:46.665 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.663+0000 7f491a742800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:35:46.665 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.663+0000 7f491a742800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:35:46.665 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.663+0000 7f491a742800 5 note: GC not initialized 2024-09-12T17:35:46.665 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.663+0000 7f47477fe640 20 reqs_thread_entry: start 2024-09-12T17:35:46.665 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.663+0000 7f491a742800 20 init_complete bucket index max shards: 11 2024-09-12T17:35:46.665 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.663+0000 7f491a742800 20 Filter name: none 2024-09-12T17:35:46.665 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.663+0000 7f47457fa640 20 reqs_thread_entry: start 2024-09-12T17:35:46.666 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.663+0000 7f491a742800 20 rados->read ofs=0 len=0 2024-09-12T17:35:46.666 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.664+0000 7f491a742800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:35:46.666 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.664+0000 7f491a742800 20 rados->read ofs=0 len=0 2024-09-12T17:35:46.666 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.664+0000 7f491a742800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:35:46.667 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.664+0000 7f491a742800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:35:46.667 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.664+0000 7f491a742800 20 rados->read ofs=0 len=0 2024-09-12T17:35:46.667 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.665+0000 7f491a742800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T17:35:46.667 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.665+0000 7f491a742800 20 rados->read ofs=0 len=0 2024-09-12T17:35:46.667 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.665+0000 7f491a742800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T17:35:46.667 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.665+0000 7f491a742800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:35:46.668 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.667+0000 7f47ccfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:35:46.671 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.669+0000 7f491a742800 20 remove_watcher() i=0 2024-09-12T17:35:46.671 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.669+0000 7f491a742800 2 removed watcher, disabling cache 2024-09-12T17:35:46.672 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.670+0000 7f491a742800 20 remove_watcher() i=1 2024-09-12T17:35:46.674 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.672+0000 7f491a742800 20 remove_watcher() i=2 2024-09-12T17:35:46.675 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.673+0000 7f491a742800 20 remove_watcher() i=3 2024-09-12T17:35:46.676 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.674+0000 7f491a742800 20 remove_watcher() i=4 2024-09-12T17:35:46.677 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.676+0000 7f491a742800 20 remove_watcher() i=5 2024-09-12T17:35:46.678 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.677+0000 7f491a742800 20 remove_watcher() i=6 2024-09-12T17:35:46.679 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:46.678+0000 7f491a742800 20 remove_watcher() i=7 2024-09-12T17:35:46.691 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:35:46.691 INFO:tasks.workunit.client.0.smithi037.stderr:BUCKET_STATS: 2024-09-12T17:35:46.691 INFO:tasks.workunit.client.0.smithi037.stderr:bucket: abort-at-do-reshard id: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.35 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T17:35:46.691 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:35:47.037 INFO:tasks.workunit.client.0.smithi037.stderr:TEST: reshard bucket with EIO injected at logrecord_writes 2024-09-12T17:35:47.037 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:35:47.824 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bucket stats --bucket error-at-logrecord-writes 2024-09-12T17:35:47.854 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:35:47.854 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:35:47.894 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:47.892+0000 7fca34298800 20 rados->read ofs=0 len=0 2024-09-12T17:35:47.896 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:47.894+0000 7fca34298800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:47.896 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:47.894+0000 7fca34298800 20 realm 2024-09-12T17:35:47.896 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:47.894+0000 7fca34298800 20 rados->read ofs=0 len=0 2024-09-12T17:35:47.896 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:47.894+0000 7fca34298800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:47.896 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:47.894+0000 7fca34298800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:35:47.896 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:47.894+0000 7fca34298800 20 rados->read ofs=0 len=0 2024-09-12T17:35:47.896 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:47.894+0000 7fca34298800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:47.896 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:47.894+0000 7fca34298800 20 rados->read ofs=0 len=0 2024-09-12T17:35:47.897 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:47.895+0000 7fca34298800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:35:47.897 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:47.895+0000 7fca34298800 20 rados->read ofs=0 len=0 2024-09-12T17:35:47.897 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:47.895+0000 7fca34298800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:35:47.897 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:47.895+0000 7fca34298800 20 searching for the correct realm 2024-09-12T17:35:47.900 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:47.899+0000 7fca32583640 0 -- 172.21.15.37:0/3797819593 >> [v2:172.21.15.40:6818/1210108009,v1:172.21.15.40:6819/1210108009] conn(0x7fca28079070 msgr2=0x7fca2808fac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:35:47.904 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:47.902+0000 7fca31d82640 0 -- 172.21.15.37:0/3797819593 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7fca28069040 msgr2=0x7fca28086830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:35:48.110 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.108+0000 7fca34298800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:35:48.110 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.108+0000 7fca34298800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:35:48.110 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.108+0000 7fca34298800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:35:48.110 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.108+0000 7fca34298800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:35:48.110 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.108+0000 7fca34298800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:35:48.110 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.108+0000 7fca34298800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:35:48.110 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.108+0000 7fca34298800 20 rados->read ofs=0 len=0 2024-09-12T17:35:48.110 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.108+0000 7fca34298800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:48.111 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.108+0000 7fca34298800 20 rados->read ofs=0 len=0 2024-09-12T17:35:48.112 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.108+0000 7fca34298800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:35:48.112 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.108+0000 7fca34298800 20 rados->read ofs=0 len=0 2024-09-12T17:35:48.112 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.109+0000 7fca34298800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:35:48.112 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.109+0000 7fca34298800 20 zone default found 2024-09-12T17:35:48.112 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.109+0000 7fca34298800 4 Realm: () 2024-09-12T17:35:48.112 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.109+0000 7fca34298800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:35:48.112 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.109+0000 7fca34298800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:35:48.112 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.109+0000 7fca34298800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:35:48.112 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.109+0000 7fca34298800 20 zonegroup default 2024-09-12T17:35:48.112 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.109+0000 7fca34298800 20 rados->read ofs=0 len=0 2024-09-12T17:35:48.113 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.109+0000 7fca34298800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:48.113 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.109+0000 7fca34298800 20 rados->read ofs=0 len=0 2024-09-12T17:35:48.113 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.109+0000 7fca34298800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:48.113 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.109+0000 7fca34298800 20 rados->read ofs=0 len=0 2024-09-12T17:35:48.113 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.110+0000 7fca34298800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:48.113 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.110+0000 7fca34298800 20 started sync module instance, tier type = 2024-09-12T17:35:48.113 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.110+0000 7fca34298800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:35:48.121 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.119+0000 7fca34298800 20 add_watcher() i=0 2024-09-12T17:35:48.121 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.119+0000 7fca34298800 20 add_watcher() i=1 2024-09-12T17:35:48.121 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.119+0000 7fca34298800 20 add_watcher() i=2 2024-09-12T17:35:48.121 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.119+0000 7fca34298800 20 add_watcher() i=3 2024-09-12T17:35:48.121 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.119+0000 7fca34298800 20 add_watcher() i=4 2024-09-12T17:35:48.121 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.119+0000 7fca34298800 20 add_watcher() i=5 2024-09-12T17:35:48.121 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.119+0000 7fca34298800 20 add_watcher() i=6 2024-09-12T17:35:48.122 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.120+0000 7fca34298800 20 add_watcher() i=7 2024-09-12T17:35:48.122 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.120+0000 7fca34298800 2 all 8 watchers are set, enabling cache 2024-09-12T17:35:48.123 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.122+0000 7fc8e37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:35:48.124 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.122+0000 7fca34298800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:35:48.124 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.122+0000 7fca34298800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:35:48.125 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.122+0000 7fca34298800 5 note: GC not initialized 2024-09-12T17:35:48.125 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.122+0000 7fc8e27fc640 20 reqs_thread_entry: start 2024-09-12T17:35:48.125 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.122+0000 7fca34298800 20 init_complete bucket index max shards: 11 2024-09-12T17:35:48.125 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.122+0000 7fca34298800 20 Filter name: none 2024-09-12T17:35:48.125 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.123+0000 7fc853fff640 20 reqs_thread_entry: start 2024-09-12T17:35:48.125 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.123+0000 7fca34298800 20 rados->read ofs=0 len=0 2024-09-12T17:35:48.126 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.123+0000 7fca34298800 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T17:35:48.126 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.123+0000 7fca34298800 20 rados->read ofs=0 len=0 2024-09-12T17:35:48.126 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.124+0000 7fca34298800 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T17:35:48.126 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.124+0000 7fca34298800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:35:48.126 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.124+0000 7fca34298800 20 rados->read ofs=0 len=0 2024-09-12T17:35:48.126 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.124+0000 7fca34298800 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T17:35:48.127 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.124+0000 7fca34298800 20 rados->read ofs=0 len=0 2024-09-12T17:35:48.127 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.125+0000 7fca34298800 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T17:35:48.127 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.125+0000 7fca34298800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:35:48.129 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.127+0000 7fc8e37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:35:48.131 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.129+0000 7fca34298800 20 remove_watcher() i=0 2024-09-12T17:35:48.131 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.129+0000 7fca34298800 2 removed watcher, disabling cache 2024-09-12T17:35:48.132 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.130+0000 7fca34298800 20 remove_watcher() i=1 2024-09-12T17:35:48.133 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.131+0000 7fca34298800 20 remove_watcher() i=2 2024-09-12T17:35:48.134 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.133+0000 7fca34298800 20 remove_watcher() i=3 2024-09-12T17:35:48.135 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.134+0000 7fca34298800 20 remove_watcher() i=4 2024-09-12T17:35:48.136 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.135+0000 7fca34298800 20 remove_watcher() i=5 2024-09-12T17:35:48.137 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.136+0000 7fca34298800 20 remove_watcher() i=6 2024-09-12T17:35:48.138 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.137+0000 7fca34298800 20 remove_watcher() i=7 2024-09-12T17:35:48.150 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:35:48.150 INFO:tasks.workunit.client.0.smithi037.stderr:BUCKET_STATS: 2024-09-12T17:35:48.150 INFO:tasks.workunit.client.0.smithi037.stderr:bucket: error-at-logrecord-writes id: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.36 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:35:48.150 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:35:48.151 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bucket reshard --bucket error-at-logrecord-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at logrecord_writes 2024-09-12T17:35:48.186 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:35:48.186 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:35:48.226 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.224+0000 7f6f71542800 20 rados->read ofs=0 len=0 2024-09-12T17:35:48.227 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.226+0000 7f6f71542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:48.227 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.226+0000 7f6f71542800 20 realm 2024-09-12T17:35:48.227 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.226+0000 7f6f71542800 20 rados->read ofs=0 len=0 2024-09-12T17:35:48.228 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.226+0000 7f6f71542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:48.228 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.226+0000 7f6f71542800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:35:48.228 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.226+0000 7f6f71542800 20 rados->read ofs=0 len=0 2024-09-12T17:35:48.228 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.226+0000 7f6f71542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:48.228 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.226+0000 7f6f71542800 20 rados->read ofs=0 len=0 2024-09-12T17:35:48.229 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.227+0000 7f6f71542800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:35:48.229 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.227+0000 7f6f71542800 20 rados->read ofs=0 len=0 2024-09-12T17:35:48.229 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.227+0000 7f6f71542800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:35:48.229 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.227+0000 7f6f71542800 20 searching for the correct realm 2024-09-12T17:35:48.230 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.229+0000 7f6f6d286640 0 -- 172.21.15.37:0/125595836 >> [v2:172.21.15.37:6800/1206746176,v1:172.21.15.37:6801/1206746176] conn(0x555bff248650 msgr2=0x7f6f68080f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:35:48.436 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.434+0000 7f6f6da87640 0 -- 172.21.15.37:0/125595836 >> [v2:172.21.15.40:6818/1210108009,v1:172.21.15.40:6819/1210108009] conn(0x7f6f580030f0 msgr2=0x7f6f64018400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:35:48.643 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.641+0000 7f6f71542800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:35:48.643 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.641+0000 7f6f71542800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:35:48.644 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.641+0000 7f6f71542800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:35:48.644 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.641+0000 7f6f71542800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:35:48.644 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.641+0000 7f6f71542800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:35:48.644 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.641+0000 7f6f71542800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:35:48.644 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.641+0000 7f6f71542800 20 rados->read ofs=0 len=0 2024-09-12T17:35:48.644 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.642+0000 7f6f71542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:48.644 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.642+0000 7f6f71542800 20 rados->read ofs=0 len=0 2024-09-12T17:35:48.645 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.642+0000 7f6f71542800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:35:48.645 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.642+0000 7f6f71542800 20 rados->read ofs=0 len=0 2024-09-12T17:35:48.646 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.643+0000 7f6f71542800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:35:48.646 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.643+0000 7f6f71542800 20 zone default found 2024-09-12T17:35:48.646 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.643+0000 7f6f71542800 4 Realm: () 2024-09-12T17:35:48.646 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.643+0000 7f6f71542800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:35:48.646 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.643+0000 7f6f71542800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:35:48.646 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.643+0000 7f6f71542800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:35:48.646 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.643+0000 7f6f71542800 20 zonegroup default 2024-09-12T17:35:48.646 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.643+0000 7f6f71542800 20 rados->read ofs=0 len=0 2024-09-12T17:35:48.646 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.643+0000 7f6f71542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:48.646 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.643+0000 7f6f71542800 20 rados->read ofs=0 len=0 2024-09-12T17:35:48.646 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.643+0000 7f6f71542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:48.646 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.643+0000 7f6f71542800 20 rados->read ofs=0 len=0 2024-09-12T17:35:48.646 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.644+0000 7f6f71542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:48.647 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.644+0000 7f6f71542800 20 started sync module instance, tier type = 2024-09-12T17:35:48.647 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.644+0000 7f6f71542800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:35:48.656 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.654+0000 7f6f71542800 20 add_watcher() i=0 2024-09-12T17:35:48.656 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.654+0000 7f6f71542800 20 add_watcher() i=1 2024-09-12T17:35:48.656 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.654+0000 7f6f71542800 20 add_watcher() i=2 2024-09-12T17:35:48.656 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.654+0000 7f6f71542800 20 add_watcher() i=3 2024-09-12T17:35:48.656 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.654+0000 7f6f71542800 20 add_watcher() i=4 2024-09-12T17:35:48.656 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.654+0000 7f6f71542800 20 add_watcher() i=5 2024-09-12T17:35:48.657 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.654+0000 7f6f71542800 20 add_watcher() i=6 2024-09-12T17:35:48.657 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.655+0000 7f6f71542800 20 add_watcher() i=7 2024-09-12T17:35:48.657 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.655+0000 7f6f71542800 2 all 8 watchers are set, enabling cache 2024-09-12T17:35:48.659 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.657+0000 7f6e23fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:35:48.660 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.657+0000 7f6f71542800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:35:48.660 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.657+0000 7f6f71542800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:35:48.660 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.657+0000 7f6f71542800 5 note: GC not initialized 2024-09-12T17:35:48.660 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.658+0000 7f6e22fe5640 20 reqs_thread_entry: start 2024-09-12T17:35:48.660 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.658+0000 7f6f71542800 20 init_complete bucket index max shards: 11 2024-09-12T17:35:48.660 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.658+0000 7f6f71542800 20 Filter name: none 2024-09-12T17:35:48.660 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.658+0000 7f6e20fe1640 20 reqs_thread_entry: start 2024-09-12T17:35:48.660 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.658+0000 7f6f71542800 10 cache get: name=default.rgw.meta+root+error-at-logrecord-writes : miss 2024-09-12T17:35:48.660 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.658+0000 7f6f71542800 20 rados->read ofs=0 len=0 2024-09-12T17:35:48.661 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.659+0000 7f6f71542800 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T17:35:48.661 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.659+0000 7f6f71542800 10 cache put: name=default.rgw.meta+root+error-at-logrecord-writes info.flags=0x11 2024-09-12T17:35:48.661 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.659+0000 7f6f71542800 10 adding default.rgw.meta+root+error-at-logrecord-writes to cache LRU end 2024-09-12T17:35:48.661 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.659+0000 7f6f71542800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.36 : miss 2024-09-12T17:35:48.661 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.659+0000 7f6f71542800 20 rados->read ofs=0 len=0 2024-09-12T17:35:48.661 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.659+0000 7f6f71542800 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T17:35:48.661 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.659+0000 7f6f71542800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.36 info.flags=0x17 2024-09-12T17:35:48.662 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.659+0000 7f6f71542800 10 adding default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.36 to cache LRU end 2024-09-12T17:35:48.662 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.659+0000 7f6f71542800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:35:48.662 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.659+0000 7f6f71542800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:35:48.662 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.659+0000 7f6f71542800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.36 2024-09-12T17:35:48.666 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.665+0000 7f6f71542800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.36 info.flags=0x17 2024-09-12T17:35:48.667 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.665+0000 7f6f71542800 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.36 to cache LRU end 2024-09-12T17:35:48.667 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.665+0000 7f6f71542800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:35:48.667 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.665+0000 7f6f71542800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.36, ofs0, ns] 2024-09-12T17:35:48.667 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.665+0000 7f6e50ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496999 cookie 93853613394800 notifier 7680 bl.length()=1007 2024-09-12T17:35:48.667 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.665+0000 7f6e50ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.36 info.flags=0x17 2024-09-12T17:35:48.667 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.665+0000 7f6e50ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.36 to cache LRU end 2024-09-12T17:35:48.667 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.665+0000 7f6e50ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:35:48.668 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.667+0000 7f6f71542800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.36]): orig_sources= new_sources= 2024-09-12T17:35:48.668 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.667+0000 7f6f71542800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.36]): potential sources added=[] removed=[] 2024-09-12T17:35:48.669 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.667+0000 7f6f71542800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.36]): orig_dests= new_dests= 2024-09-12T17:35:48.669 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.667+0000 7f6f71542800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.36]): potential dests added=[] removed=[] 2024-09-12T17:35:48.671 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.670+0000 7f6f71542800 -1 Injecting error=-5 at location=logrecord_writes 2024-09-12T17:35:48.671 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.670+0000 7f6f71542800 0 ERROR: init_reshard failed to pause writes to the current index: (5) Input/output error 2024-09-12T17:35:48.677 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.675+0000 7f6f71542800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.36 : hit (requested=0x17, cached=0x17) 2024-09-12T17:35:48.677 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.675+0000 7f6f71542800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.36 2024-09-12T17:35:48.678 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.676+0000 7f6f71542800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.36 info.flags=0x17 2024-09-12T17:35:48.678 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.676+0000 7f6f71542800 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.36 to cache LRU end 2024-09-12T17:35:48.679 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.676+0000 7f6f71542800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:35:48.679 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.676+0000 7f6f71542800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.36, ofs0, ns] 2024-09-12T17:35:48.679 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.677+0000 7f6e3ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497000 cookie 93853613394800 notifier 7680 bl.length()=975 2024-09-12T17:35:48.679 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.677+0000 7f6e3ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.36 info.flags=0x17 2024-09-12T17:35:48.679 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.677+0000 7f6e3ffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.36 to cache LRU end 2024-09-12T17:35:48.679 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.677+0000 7f6e3ffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:35:48.680 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.678+0000 7f6f71542800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.36]): orig_sources= new_sources= 2024-09-12T17:35:48.680 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.678+0000 7f6f71542800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.36]): potential sources added=[] removed=[] 2024-09-12T17:35:48.680 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.678+0000 7f6f71542800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.36]): orig_dests= new_dests= 2024-09-12T17:35:48.680 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.678+0000 7f6f71542800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.36]): potential dests added=[] removed=[] 2024-09-12T17:35:48.682 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.680+0000 7f6e23fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:35:48.685 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.683+0000 7f6f71542800 20 remove_watcher() i=0 2024-09-12T17:35:48.685 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.683+0000 7f6f71542800 2 removed watcher, disabling cache 2024-09-12T17:35:48.686 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.684+0000 7f6f71542800 20 remove_watcher() i=1 2024-09-12T17:35:48.687 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.685+0000 7f6f71542800 20 remove_watcher() i=2 2024-09-12T17:35:48.688 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.686+0000 7f6f71542800 20 remove_watcher() i=3 2024-09-12T17:35:48.689 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.688+0000 7f6f71542800 20 remove_watcher() i=4 2024-09-12T17:35:48.690 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.688+0000 7f6f71542800 20 remove_watcher() i=5 2024-09-12T17:35:48.691 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.689+0000 7f6f71542800 20 remove_watcher() i=6 2024-09-12T17:35:48.692 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.690+0000 7f6f71542800 20 remove_watcher() i=7 2024-09-12T17:35:48.704 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bucket stats --bucket error-at-logrecord-writes 2024-09-12T17:35:48.734 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:35:48.734 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:35:48.774 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.772+0000 7fa90aabb800 20 rados->read ofs=0 len=0 2024-09-12T17:35:48.775 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.773+0000 7fa90aabb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:48.775 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.773+0000 7fa90aabb800 20 realm 2024-09-12T17:35:48.775 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.773+0000 7fa90aabb800 20 rados->read ofs=0 len=0 2024-09-12T17:35:48.776 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.773+0000 7fa90aabb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:48.776 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.774+0000 7fa90aabb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:35:48.776 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.774+0000 7fa90aabb800 20 rados->read ofs=0 len=0 2024-09-12T17:35:48.776 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.774+0000 7fa90aabb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:48.776 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.774+0000 7fa90aabb800 20 rados->read ofs=0 len=0 2024-09-12T17:35:48.776 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.775+0000 7fa90aabb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:35:48.777 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.775+0000 7fa90aabb800 20 rados->read ofs=0 len=0 2024-09-12T17:35:48.777 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.775+0000 7fa90aabb800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:35:48.777 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.775+0000 7fa90aabb800 20 searching for the correct realm 2024-09-12T17:35:48.780 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.778+0000 7fa908da6640 0 -- 172.21.15.37:0/681501195 >> [v2:172.21.15.40:6818/1210108009,v1:172.21.15.40:6819/1210108009] conn(0x7fa8fc033060 msgr2=0x7fa8fc065d60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:35:48.784 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.782+0000 7fa9085a5640 0 -- 172.21.15.37:0/681501195 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7fa8fc0672f0 msgr2=0x7fa8fc065460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:35:48.990 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.988+0000 7fa90aabb800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:35:48.990 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.988+0000 7fa90aabb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:35:48.991 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.988+0000 7fa90aabb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:35:48.991 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.988+0000 7fa90aabb800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:35:48.991 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.988+0000 7fa90aabb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:35:48.991 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.988+0000 7fa90aabb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:35:48.991 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.988+0000 7fa90aabb800 20 rados->read ofs=0 len=0 2024-09-12T17:35:48.991 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.989+0000 7fa90aabb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:48.991 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.989+0000 7fa90aabb800 20 rados->read ofs=0 len=0 2024-09-12T17:35:48.992 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.989+0000 7fa90aabb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:35:48.992 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.989+0000 7fa90aabb800 20 rados->read ofs=0 len=0 2024-09-12T17:35:48.992 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.990+0000 7fa90aabb800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:35:48.992 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.990+0000 7fa90aabb800 20 zone default found 2024-09-12T17:35:48.992 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.990+0000 7fa90aabb800 4 Realm: () 2024-09-12T17:35:48.992 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.990+0000 7fa90aabb800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:35:48.992 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.990+0000 7fa90aabb800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:35:48.992 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.990+0000 7fa90aabb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:35:48.992 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.990+0000 7fa90aabb800 20 zonegroup default 2024-09-12T17:35:48.993 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.990+0000 7fa90aabb800 20 rados->read ofs=0 len=0 2024-09-12T17:35:48.993 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.990+0000 7fa90aabb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:48.993 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.990+0000 7fa90aabb800 20 rados->read ofs=0 len=0 2024-09-12T17:35:48.993 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.990+0000 7fa90aabb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:48.993 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.990+0000 7fa90aabb800 20 rados->read ofs=0 len=0 2024-09-12T17:35:48.993 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.991+0000 7fa90aabb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:48.993 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.991+0000 7fa90aabb800 20 started sync module instance, tier type = 2024-09-12T17:35:48.994 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:48.991+0000 7fa90aabb800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:35:49.002 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.001+0000 7fa90aabb800 20 add_watcher() i=0 2024-09-12T17:35:49.002 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.001+0000 7fa90aabb800 20 add_watcher() i=1 2024-09-12T17:35:49.003 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.001+0000 7fa90aabb800 20 add_watcher() i=2 2024-09-12T17:35:49.003 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.001+0000 7fa90aabb800 20 add_watcher() i=3 2024-09-12T17:35:49.003 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.001+0000 7fa90aabb800 20 add_watcher() i=4 2024-09-12T17:35:49.003 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.001+0000 7fa90aabb800 20 add_watcher() i=5 2024-09-12T17:35:49.003 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.001+0000 7fa90aabb800 20 add_watcher() i=6 2024-09-12T17:35:49.003 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.001+0000 7fa90aabb800 20 add_watcher() i=7 2024-09-12T17:35:49.003 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.002+0000 7fa90aabb800 2 all 8 watchers are set, enabling cache 2024-09-12T17:35:49.005 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.003+0000 7fa7befdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:35:49.006 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.004+0000 7fa90aabb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:35:49.006 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.004+0000 7fa90aabb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:35:49.006 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.004+0000 7fa90aabb800 5 note: GC not initialized 2024-09-12T17:35:49.006 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.004+0000 7fa7bdfdb640 20 reqs_thread_entry: start 2024-09-12T17:35:49.006 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.004+0000 7fa90aabb800 20 init_complete bucket index max shards: 11 2024-09-12T17:35:49.006 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.004+0000 7fa90aabb800 20 Filter name: none 2024-09-12T17:35:49.006 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.004+0000 7fa72f7fe640 20 reqs_thread_entry: start 2024-09-12T17:35:49.006 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.004+0000 7fa90aabb800 20 rados->read ofs=0 len=0 2024-09-12T17:35:49.007 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.005+0000 7fa90aabb800 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T17:35:49.008 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.005+0000 7fa90aabb800 20 rados->read ofs=0 len=0 2024-09-12T17:35:49.008 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.005+0000 7fa90aabb800 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T17:35:49.008 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.005+0000 7fa90aabb800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:35:49.008 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.005+0000 7fa90aabb800 20 rados->read ofs=0 len=0 2024-09-12T17:35:49.008 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.006+0000 7fa90aabb800 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T17:35:49.008 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.006+0000 7fa90aabb800 20 rados->read ofs=0 len=0 2024-09-12T17:35:49.008 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.006+0000 7fa90aabb800 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T17:35:49.008 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.006+0000 7fa90aabb800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:35:49.010 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.008+0000 7fa7befdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:35:49.012 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.010+0000 7fa90aabb800 20 remove_watcher() i=0 2024-09-12T17:35:49.012 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.010+0000 7fa90aabb800 2 removed watcher, disabling cache 2024-09-12T17:35:49.013 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.011+0000 7fa90aabb800 20 remove_watcher() i=1 2024-09-12T17:35:49.014 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.012+0000 7fa90aabb800 20 remove_watcher() i=2 2024-09-12T17:35:49.015 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.013+0000 7fa90aabb800 20 remove_watcher() i=3 2024-09-12T17:35:49.016 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.014+0000 7fa90aabb800 20 remove_watcher() i=4 2024-09-12T17:35:49.017 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.015+0000 7fa90aabb800 20 remove_watcher() i=5 2024-09-12T17:35:49.018 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.016+0000 7fa90aabb800 20 remove_watcher() i=6 2024-09-12T17:35:49.019 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.017+0000 7fa90aabb800 20 remove_watcher() i=7 2024-09-12T17:35:49.030 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:35:49.030 INFO:tasks.workunit.client.0.smithi037.stderr:BUCKET_STATS: 2024-09-12T17:35:49.030 INFO:tasks.workunit.client.0.smithi037.stderr:bucket: error-at-logrecord-writes id: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.36 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:35:49.031 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:35:49.120 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bucket reshard --bucket error-at-logrecord-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:35:49.152 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:35:49.153 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:35:49.192 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.191+0000 7f0c4ea98800 20 rados->read ofs=0 len=0 2024-09-12T17:35:49.194 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.192+0000 7f0c4ea98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:49.194 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.192+0000 7f0c4ea98800 20 realm 2024-09-12T17:35:49.194 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.192+0000 7f0c4ea98800 20 rados->read ofs=0 len=0 2024-09-12T17:35:49.194 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.192+0000 7f0c4ea98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:49.194 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.192+0000 7f0c4ea98800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:35:49.194 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.192+0000 7f0c4ea98800 20 rados->read ofs=0 len=0 2024-09-12T17:35:49.194 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.192+0000 7f0c4ea98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:49.194 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.192+0000 7f0c4ea98800 20 rados->read ofs=0 len=0 2024-09-12T17:35:49.195 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.193+0000 7f0c4ea98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:35:49.195 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.193+0000 7f0c4ea98800 20 rados->read ofs=0 len=0 2024-09-12T17:35:49.196 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.194+0000 7f0c4ea98800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:35:49.196 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.194+0000 7f0c4ea98800 20 searching for the correct realm 2024-09-12T17:35:49.199 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.197+0000 7f0c4bd81640 0 -- 172.21.15.37:0/4232625781 >> [v2:172.21.15.37:6816/2964054205,v1:172.21.15.37:6817/2964054205] conn(0x5616079dbe00 msgr2=0x5616079de2c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:35:49.203 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.201+0000 7f0c4c582640 0 -- 172.21.15.37:0/4232625781 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7f0c4006e0c0 msgr2=0x7f0c40099660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:35:49.208 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.206+0000 7f0c4ea98800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:35:49.208 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.206+0000 7f0c4ea98800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:35:49.208 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.206+0000 7f0c4ea98800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:35:49.208 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.206+0000 7f0c4ea98800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:35:49.208 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.206+0000 7f0c4ea98800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:35:49.208 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.206+0000 7f0c4ea98800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:35:49.208 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.206+0000 7f0c4ea98800 20 rados->read ofs=0 len=0 2024-09-12T17:35:49.209 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.206+0000 7f0c4ea98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:49.209 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.206+0000 7f0c4ea98800 20 rados->read ofs=0 len=0 2024-09-12T17:35:49.210 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.206+0000 7f0c4ea98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:35:49.210 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.206+0000 7f0c4ea98800 20 rados->read ofs=0 len=0 2024-09-12T17:35:49.210 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.207+0000 7f0c4ea98800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:35:49.210 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.207+0000 7f0c4ea98800 20 zone default found 2024-09-12T17:35:49.210 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.207+0000 7f0c4ea98800 4 Realm: () 2024-09-12T17:35:49.210 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.207+0000 7f0c4ea98800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:35:49.210 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.207+0000 7f0c4ea98800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:35:49.210 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.207+0000 7f0c4ea98800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:35:49.210 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.207+0000 7f0c4ea98800 20 zonegroup default 2024-09-12T17:35:49.210 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.207+0000 7f0c4ea98800 20 rados->read ofs=0 len=0 2024-09-12T17:35:49.210 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.207+0000 7f0c4ea98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:49.211 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.207+0000 7f0c4ea98800 20 rados->read ofs=0 len=0 2024-09-12T17:35:49.211 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.207+0000 7f0c4ea98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:49.211 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.207+0000 7f0c4ea98800 20 rados->read ofs=0 len=0 2024-09-12T17:35:49.211 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.208+0000 7f0c4ea98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:49.211 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.208+0000 7f0c4ea98800 20 started sync module instance, tier type = 2024-09-12T17:35:49.211 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.208+0000 7f0c4ea98800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:35:49.219 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.217+0000 7f0c4ea98800 20 add_watcher() i=0 2024-09-12T17:35:49.219 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.217+0000 7f0c4ea98800 20 add_watcher() i=1 2024-09-12T17:35:49.219 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.217+0000 7f0c4ea98800 20 add_watcher() i=2 2024-09-12T17:35:49.219 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.217+0000 7f0c4ea98800 20 add_watcher() i=3 2024-09-12T17:35:49.219 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.217+0000 7f0c4ea98800 20 add_watcher() i=4 2024-09-12T17:35:49.220 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.217+0000 7f0c4ea98800 20 add_watcher() i=5 2024-09-12T17:35:49.220 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.217+0000 7f0c4ea98800 20 add_watcher() i=6 2024-09-12T17:35:49.220 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.218+0000 7f0c4ea98800 20 add_watcher() i=7 2024-09-12T17:35:49.220 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.218+0000 7f0c4ea98800 2 all 8 watchers are set, enabling cache 2024-09-12T17:35:49.222 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.220+0000 7f0b02fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:35:49.222 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.220+0000 7f0c4ea98800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:35:49.222 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.220+0000 7f0c4ea98800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:35:49.222 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.220+0000 7f0c4ea98800 5 note: GC not initialized 2024-09-12T17:35:49.223 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.220+0000 7f0b01fdb640 20 reqs_thread_entry: start 2024-09-12T17:35:49.223 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.220+0000 7f0c4ea98800 20 init_complete bucket index max shards: 11 2024-09-12T17:35:49.223 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.220+0000 7f0c4ea98800 20 Filter name: none 2024-09-12T17:35:49.223 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.221+0000 7f0a737fe640 20 reqs_thread_entry: start 2024-09-12T17:35:49.224 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.221+0000 7f0c4ea98800 10 cache get: name=default.rgw.meta+root+error-at-logrecord-writes : miss 2024-09-12T17:35:49.224 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.221+0000 7f0c4ea98800 20 rados->read ofs=0 len=0 2024-09-12T17:35:49.224 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.221+0000 7f0c4ea98800 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T17:35:49.224 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.221+0000 7f0c4ea98800 10 cache put: name=default.rgw.meta+root+error-at-logrecord-writes info.flags=0x11 2024-09-12T17:35:49.224 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.221+0000 7f0c4ea98800 10 adding default.rgw.meta+root+error-at-logrecord-writes to cache LRU end 2024-09-12T17:35:49.224 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.221+0000 7f0c4ea98800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.36 : miss 2024-09-12T17:35:49.224 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.221+0000 7f0c4ea98800 20 rados->read ofs=0 len=0 2024-09-12T17:35:49.224 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.221+0000 7f0c4ea98800 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T17:35:49.224 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.221+0000 7f0c4ea98800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.36 info.flags=0x17 2024-09-12T17:35:49.224 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.221+0000 7f0c4ea98800 10 adding default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.36 to cache LRU end 2024-09-12T17:35:49.224 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.221+0000 7f0c4ea98800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:35:49.224 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.221+0000 7f0c4ea98800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:35:49.224 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.222+0000 7f0c4ea98800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.36 2024-09-12T17:35:49.230 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.228+0000 7f0c4ea98800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.36 info.flags=0x17 2024-09-12T17:35:49.230 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.228+0000 7f0c4ea98800 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.36 to cache LRU end 2024-09-12T17:35:49.230 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.228+0000 7f0c4ea98800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:35:49.230 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.228+0000 7f0c4ea98800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.36, ofs0, ns] 2024-09-12T17:35:49.231 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.229+0000 7f0b237fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497001 cookie 94652617078512 notifier 7217 bl.length()=1007 2024-09-12T17:35:49.231 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.229+0000 7f0b237fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.36 info.flags=0x17 2024-09-12T17:35:49.231 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.229+0000 7f0b237fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.36 to cache LRU end 2024-09-12T17:35:49.231 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.229+0000 7f0b237fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:35:49.232 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.230+0000 7f0c4ea98800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.36]): orig_sources= new_sources= 2024-09-12T17:35:49.232 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.230+0000 7f0c4ea98800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.36]): potential sources added=[] removed=[] 2024-09-12T17:35:49.232 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.230+0000 7f0c4ea98800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.36]): orig_dests= new_dests= 2024-09-12T17:35:49.232 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.230+0000 7f0c4ea98800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.36]): potential dests added=[] removed=[] 2024-09-12T17:35:49.240 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.238+0000 7f0c4ea98800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.36.1.0 2024-09-12T17:35:49.240 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.238+0000 7f0c4ea98800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.36.1.0 2024-09-12T17:35:49.240 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.238+0000 7f0c4ea98800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.36.1.1 2024-09-12T17:35:49.240 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.238+0000 7f0c4ea98800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.36.1.1 2024-09-12T17:35:49.240 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.238+0000 7f0c4ea98800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.36.1.2 2024-09-12T17:35:49.240 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.238+0000 7f0c4ea98800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.36.1.2 2024-09-12T17:35:49.240 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.238+0000 7f0c4ea98800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.36.1.3 2024-09-12T17:35:49.240 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.238+0000 7f0c4ea98800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.36.1.3 2024-09-12T17:35:49.240 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.238+0000 7f0c4ea98800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.36.1.4 2024-09-12T17:35:49.240 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.238+0000 7f0c4ea98800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.36.1.4 2024-09-12T17:35:49.240 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.238+0000 7f0c4ea98800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.36.1.5 2024-09-12T17:35:49.240 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.238+0000 7f0c4ea98800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.36.1.5 2024-09-12T17:35:49.241 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.238+0000 7f0c4ea98800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.36.1.6 2024-09-12T17:35:49.241 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.238+0000 7f0c4ea98800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.36.1.6 2024-09-12T17:35:49.241 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.238+0000 7f0c4ea98800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.36.1.7 2024-09-12T17:35:49.241 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.238+0000 7f0c4ea98800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.36.1.7 2024-09-12T17:35:49.241 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.238+0000 7f0c4ea98800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.36.1.8 2024-09-12T17:35:49.241 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.238+0000 7f0c4ea98800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.36.1.8 2024-09-12T17:35:49.241 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.238+0000 7f0c4ea98800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.36.1.9 2024-09-12T17:35:49.241 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.238+0000 7f0c4ea98800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.36.1.9 2024-09-12T17:35:49.241 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.238+0000 7f0c4ea98800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.36.1.10 2024-09-12T17:35:49.241 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.238+0000 7f0c4ea98800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.36.1.10 2024-09-12T17:35:49.241 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.238+0000 7f0c4ea98800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.36.1.11 2024-09-12T17:35:49.241 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.238+0000 7f0c4ea98800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.36.1.11 2024-09-12T17:35:49.241 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.238+0000 7f0c4ea98800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.36.0 2024-09-12T17:35:49.242 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.238+0000 7f0c4ea98800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.36.1 2024-09-12T17:35:49.242 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.239+0000 7f0c4ea98800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.36.2 2024-09-12T17:35:49.242 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.239+0000 7f0c4ea98800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.36.3 2024-09-12T17:35:49.242 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.240+0000 7f0c4ea98800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.36.4 2024-09-12T17:35:49.243 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.241+0000 7f0c4ea98800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.36.5 2024-09-12T17:35:49.243 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.242+0000 7f0c4ea98800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.36.6 2024-09-12T17:35:49.244 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.242+0000 7f0c4ea98800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.36.7 2024-09-12T17:35:49.245 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.243+0000 7f0c4ea98800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.36.8 2024-09-12T17:35:49.245 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.244+0000 7f0c4ea98800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.36.9 2024-09-12T17:35:49.246 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.244+0000 7f0c4ea98800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.36.10 2024-09-12T17:35:49.249 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.247+0000 7f0c4ea98800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.36 : hit (requested=0x17, cached=0x17) 2024-09-12T17:35:49.249 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.247+0000 7f0c4ea98800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.36 2024-09-12T17:35:49.251 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.249+0000 7f0c4ea98800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.36 info.flags=0x17 2024-09-12T17:35:49.251 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.249+0000 7f0c4ea98800 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.36 to cache LRU end 2024-09-12T17:35:49.251 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.249+0000 7f0c4ea98800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:35:49.251 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.249+0000 7f0c4ea98800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.36, ofs0, ns] 2024-09-12T17:35:49.251 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.249+0000 7f0b22ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497002 cookie 94652617078512 notifier 7217 bl.length()=1007 2024-09-12T17:35:49.252 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.249+0000 7f0b22ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.36 info.flags=0x17 2024-09-12T17:35:49.252 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.249+0000 7f0b22ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.36 to cache LRU end 2024-09-12T17:35:49.252 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.249+0000 7f0b22ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:35:49.253 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.251+0000 7f0c4ea98800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.36]): orig_sources= new_sources= 2024-09-12T17:35:49.253 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.251+0000 7f0c4ea98800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.36]): potential sources added=[] removed=[] 2024-09-12T17:35:49.253 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.251+0000 7f0c4ea98800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.36]): orig_dests= new_dests= 2024-09-12T17:35:49.253 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.251+0000 7f0c4ea98800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.36]): potential dests added=[] removed=[] 2024-09-12T17:35:49.256 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.254+0000 7f0c4ea98800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.36.0 2024-09-12T17:35:49.256 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.254+0000 7f0c4ea98800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.36.1 2024-09-12T17:35:49.257 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.255+0000 7f0c4ea98800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.36.2 2024-09-12T17:35:49.257 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.255+0000 7f0c4ea98800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.36.3 2024-09-12T17:35:49.257 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.255+0000 7f0c4ea98800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.36.4 2024-09-12T17:35:49.257 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.256+0000 7f0c4ea98800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.36.5 2024-09-12T17:35:49.258 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.256+0000 7f0c4ea98800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.36.6 2024-09-12T17:35:49.258 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.256+0000 7f0c4ea98800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.36.7 2024-09-12T17:35:49.259 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.257+0000 7f0c4ea98800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.36.8 2024-09-12T17:35:49.259 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.257+0000 7f0c4ea98800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.36.9 2024-09-12T17:35:49.259 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.257+0000 7f0c4ea98800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.36.10 2024-09-12T17:35:49.259 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.258+0000 7f0c4ea98800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.36 : hit (requested=0x17, cached=0x17) 2024-09-12T17:35:49.259 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.258+0000 7f0c4ea98800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.36 2024-09-12T17:35:49.261 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.259+0000 7f0c4ea98800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.36 info.flags=0x17 2024-09-12T17:35:49.261 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.259+0000 7f0c4ea98800 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.36 to cache LRU end 2024-09-12T17:35:49.261 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.259+0000 7f0c4ea98800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:35:49.261 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.259+0000 7f0c4ea98800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.36, ofs0, ns] 2024-09-12T17:35:49.261 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.259+0000 7f0b237fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497003 cookie 94652617078512 notifier 7217 bl.length()=975 2024-09-12T17:35:49.261 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.259+0000 7f0b237fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.36 info.flags=0x17 2024-09-12T17:35:49.261 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.259+0000 7f0b237fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.36 to cache LRU end 2024-09-12T17:35:49.262 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.259+0000 7f0b237fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:35:49.262 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.261+0000 7f0c4ea98800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.36]): orig_sources= new_sources= 2024-09-12T17:35:49.263 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.261+0000 7f0c4ea98800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.36]): potential sources added=[] removed=[] 2024-09-12T17:35:49.263 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.261+0000 7f0c4ea98800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.36]): orig_dests= new_dests= 2024-09-12T17:35:49.263 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.261+0000 7f0c4ea98800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.36]): potential dests added=[] removed=[] 2024-09-12T17:35:49.265 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.264+0000 7f0c4ea98800 1 execute INFO: reshard of bucket "error-at-logrecord-writes" from 11 shards to 12 shards completed successfully 2024-09-12T17:35:49.267 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.266+0000 7f0b02fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:35:49.270 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.268+0000 7f0c4ea98800 20 remove_watcher() i=0 2024-09-12T17:35:49.270 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.268+0000 7f0c4ea98800 2 removed watcher, disabling cache 2024-09-12T17:35:49.271 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.269+0000 7f0c4ea98800 20 remove_watcher() i=1 2024-09-12T17:35:49.272 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.270+0000 7f0c4ea98800 20 remove_watcher() i=2 2024-09-12T17:35:49.273 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.271+0000 7f0c4ea98800 20 remove_watcher() i=3 2024-09-12T17:35:49.274 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.272+0000 7f0c4ea98800 20 remove_watcher() i=4 2024-09-12T17:35:49.275 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.273+0000 7f0c4ea98800 20 remove_watcher() i=5 2024-09-12T17:35:49.277 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.275+0000 7f0c4ea98800 20 remove_watcher() i=6 2024-09-12T17:35:49.278 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.276+0000 7f0c4ea98800 20 remove_watcher() i=7 2024-09-12T17:35:49.291 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bucket stats --bucket error-at-logrecord-writes 2024-09-12T17:35:49.320 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:35:49.320 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:35:49.359 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.357+0000 7f3a91146800 20 rados->read ofs=0 len=0 2024-09-12T17:35:49.361 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.358+0000 7f3a91146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:49.361 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.358+0000 7f3a91146800 20 realm 2024-09-12T17:35:49.361 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.358+0000 7f3a91146800 20 rados->read ofs=0 len=0 2024-09-12T17:35:49.361 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.359+0000 7f3a91146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:49.361 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.359+0000 7f3a91146800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:35:49.361 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.359+0000 7f3a91146800 20 rados->read ofs=0 len=0 2024-09-12T17:35:49.362 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.359+0000 7f3a91146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:49.362 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.359+0000 7f3a91146800 20 rados->read ofs=0 len=0 2024-09-12T17:35:49.362 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.360+0000 7f3a91146800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:35:49.363 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.360+0000 7f3a91146800 20 rados->read ofs=0 len=0 2024-09-12T17:35:49.363 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.360+0000 7f3a91146800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:35:49.363 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.360+0000 7f3a91146800 20 searching for the correct realm 2024-09-12T17:35:49.565 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.563+0000 7f3a8642f640 0 -- 172.21.15.37:0/2784740940 >> [v2:172.21.15.40:6800/2441293461,v1:172.21.15.40:6801/2441293461] conn(0x7f3a8006d070 msgr2=0x7f3a800903b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:35:49.772 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.771+0000 7f3a8ec30640 0 -- 172.21.15.37:0/2784740940 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7f3a7805e410 msgr2=0x7f3a7805e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:35:49.981 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.979+0000 7f3a91146800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:35:49.982 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.979+0000 7f3a91146800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:35:49.982 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.979+0000 7f3a91146800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:35:49.982 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.979+0000 7f3a91146800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:35:49.982 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.979+0000 7f3a91146800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:35:49.982 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.979+0000 7f3a91146800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:35:49.983 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.979+0000 7f3a91146800 20 rados->read ofs=0 len=0 2024-09-12T17:35:49.983 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.979+0000 7f3a91146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:49.983 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.979+0000 7f3a91146800 20 rados->read ofs=0 len=0 2024-09-12T17:35:49.983 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.980+0000 7f3a91146800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:35:49.983 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.980+0000 7f3a91146800 20 rados->read ofs=0 len=0 2024-09-12T17:35:49.985 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.980+0000 7f3a91146800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:35:49.985 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.980+0000 7f3a91146800 20 zone default found 2024-09-12T17:35:49.985 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.980+0000 7f3a91146800 4 Realm: () 2024-09-12T17:35:49.986 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.980+0000 7f3a91146800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:35:49.986 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.980+0000 7f3a91146800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:35:49.986 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.980+0000 7f3a91146800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:35:49.986 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.980+0000 7f3a91146800 20 zonegroup default 2024-09-12T17:35:49.986 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.980+0000 7f3a91146800 20 rados->read ofs=0 len=0 2024-09-12T17:35:49.986 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.980+0000 7f3a91146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:49.987 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.980+0000 7f3a91146800 20 rados->read ofs=0 len=0 2024-09-12T17:35:49.987 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.981+0000 7f3a91146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:49.987 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.981+0000 7f3a91146800 20 rados->read ofs=0 len=0 2024-09-12T17:35:49.987 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.981+0000 7f3a91146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:49.987 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.981+0000 7f3a91146800 20 started sync module instance, tier type = 2024-09-12T17:35:49.987 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.981+0000 7f3a91146800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:35:49.995 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.992+0000 7f3a91146800 20 add_watcher() i=0 2024-09-12T17:35:49.995 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.992+0000 7f3a91146800 20 add_watcher() i=1 2024-09-12T17:35:49.995 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.992+0000 7f3a91146800 20 add_watcher() i=2 2024-09-12T17:35:49.996 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.992+0000 7f3a91146800 20 add_watcher() i=3 2024-09-12T17:35:49.996 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.992+0000 7f3a91146800 20 add_watcher() i=4 2024-09-12T17:35:49.996 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.992+0000 7f3a91146800 20 add_watcher() i=5 2024-09-12T17:35:49.996 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.992+0000 7f3a91146800 20 add_watcher() i=6 2024-09-12T17:35:49.997 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.993+0000 7f3a91146800 20 add_watcher() i=7 2024-09-12T17:35:49.997 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.993+0000 7f3a91146800 2 all 8 watchers are set, enabling cache 2024-09-12T17:35:50.001 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.995+0000 7f39457e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:35:50.001 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.995+0000 7f3a91146800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:35:50.001 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.995+0000 7f3a91146800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:35:50.001 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.996+0000 7f3a91146800 5 note: GC not initialized 2024-09-12T17:35:50.002 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.996+0000 7f38bffff640 20 reqs_thread_entry: start 2024-09-12T17:35:50.002 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.996+0000 7f3a91146800 20 init_complete bucket index max shards: 11 2024-09-12T17:35:50.002 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.996+0000 7f3a91146800 20 Filter name: none 2024-09-12T17:35:50.002 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.996+0000 7f38bdffb640 20 reqs_thread_entry: start 2024-09-12T17:35:50.002 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.996+0000 7f3a91146800 20 rados->read ofs=0 len=0 2024-09-12T17:35:50.003 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.997+0000 7f3a91146800 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T17:35:50.003 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.997+0000 7f3a91146800 20 rados->read ofs=0 len=0 2024-09-12T17:35:50.003 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.998+0000 7f3a91146800 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T17:35:50.003 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.998+0000 7f3a91146800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:35:50.003 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.998+0000 7f3a91146800 20 rados->read ofs=0 len=0 2024-09-12T17:35:50.004 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.998+0000 7f3a91146800 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T17:35:50.004 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.998+0000 7f3a91146800 20 rados->read ofs=0 len=0 2024-09-12T17:35:50.004 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.999+0000 7f3a91146800 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T17:35:50.004 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:49.999+0000 7f3a91146800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:35:50.005 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:50.001+0000 7f39457e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:35:50.006 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:50.004+0000 7f3a91146800 20 remove_watcher() i=0 2024-09-12T17:35:50.006 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:50.004+0000 7f3a91146800 2 removed watcher, disabling cache 2024-09-12T17:35:50.007 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:50.005+0000 7f3a91146800 20 remove_watcher() i=1 2024-09-12T17:35:50.008 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:50.006+0000 7f3a91146800 20 remove_watcher() i=2 2024-09-12T17:35:50.009 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:50.008+0000 7f3a91146800 20 remove_watcher() i=3 2024-09-12T17:35:50.011 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:50.009+0000 7f3a91146800 20 remove_watcher() i=4 2024-09-12T17:35:50.012 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:50.010+0000 7f3a91146800 20 remove_watcher() i=5 2024-09-12T17:35:50.013 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:50.011+0000 7f3a91146800 20 remove_watcher() i=6 2024-09-12T17:35:50.014 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:50.012+0000 7f3a91146800 20 remove_watcher() i=7 2024-09-12T17:35:50.026 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:35:50.026 INFO:tasks.workunit.client.0.smithi037.stderr:BUCKET_STATS: 2024-09-12T17:35:50.026 INFO:tasks.workunit.client.0.smithi037.stderr:bucket: error-at-logrecord-writes id: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.36 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T17:35:50.026 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:35:50.401 INFO:tasks.workunit.client.0.smithi037.stderr:TEST: reshard bucket with abort at logrecord_writes 2024-09-12T17:35:50.401 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:35:51.201 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bucket stats --bucket abort-at-logrecord-writes 2024-09-12T17:35:51.230 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:35:51.230 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:35:51.269 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.268+0000 7fa2c5b0c800 20 rados->read ofs=0 len=0 2024-09-12T17:35:51.271 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.269+0000 7fa2c5b0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:51.272 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.269+0000 7fa2c5b0c800 20 realm 2024-09-12T17:35:51.272 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.269+0000 7fa2c5b0c800 20 rados->read ofs=0 len=0 2024-09-12T17:35:51.272 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.269+0000 7fa2c5b0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:51.272 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.269+0000 7fa2c5b0c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:35:51.272 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.270+0000 7fa2c5b0c800 20 rados->read ofs=0 len=0 2024-09-12T17:35:51.272 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.270+0000 7fa2c5b0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:51.272 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.270+0000 7fa2c5b0c800 20 rados->read ofs=0 len=0 2024-09-12T17:35:51.273 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.271+0000 7fa2c5b0c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:35:51.273 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.271+0000 7fa2c5b0c800 20 rados->read ofs=0 len=0 2024-09-12T17:35:51.273 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.271+0000 7fa2c5b0c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:35:51.273 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.271+0000 7fa2c5b0c800 20 searching for the correct realm 2024-09-12T17:35:51.276 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.275+0000 7fa2c3df7640 0 -- 172.21.15.37:0/714416966 >> [v2:172.21.15.37:6824/3990661154,v1:172.21.15.37:6825/3990661154] conn(0x5638e983d850 msgr2=0x5638e983fc90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:35:51.280 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.278+0000 7fa2c2df5640 0 -- 172.21.15.37:0/714416966 >> [v2:172.21.15.40:6800/2441293461,v1:172.21.15.40:6801/2441293461] conn(0x7fa2b407d070 msgr2=0x7fa2b407d450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:35:51.284 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.282+0000 7fa2c5b0c800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:35:51.284 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.282+0000 7fa2c5b0c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:35:51.284 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.282+0000 7fa2c5b0c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:35:51.284 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.282+0000 7fa2c5b0c800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:35:51.284 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.282+0000 7fa2c5b0c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:35:51.284 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.282+0000 7fa2c5b0c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:35:51.284 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.282+0000 7fa2c5b0c800 20 rados->read ofs=0 len=0 2024-09-12T17:35:51.284 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.282+0000 7fa2c5b0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:51.284 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.282+0000 7fa2c5b0c800 20 rados->read ofs=0 len=0 2024-09-12T17:35:51.286 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.282+0000 7fa2c5b0c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:35:51.286 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.282+0000 7fa2c5b0c800 20 rados->read ofs=0 len=0 2024-09-12T17:35:51.286 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.283+0000 7fa2c5b0c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:35:51.286 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.283+0000 7fa2c5b0c800 20 zone default found 2024-09-12T17:35:51.286 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.283+0000 7fa2c5b0c800 4 Realm: () 2024-09-12T17:35:51.286 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.283+0000 7fa2c5b0c800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:35:51.286 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.283+0000 7fa2c5b0c800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:35:51.286 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.283+0000 7fa2c5b0c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:35:51.286 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.283+0000 7fa2c5b0c800 20 zonegroup default 2024-09-12T17:35:51.287 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.283+0000 7fa2c5b0c800 20 rados->read ofs=0 len=0 2024-09-12T17:35:51.287 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.283+0000 7fa2c5b0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:51.287 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.283+0000 7fa2c5b0c800 20 rados->read ofs=0 len=0 2024-09-12T17:35:51.287 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.284+0000 7fa2c5b0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:51.287 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.284+0000 7fa2c5b0c800 20 rados->read ofs=0 len=0 2024-09-12T17:35:51.287 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.284+0000 7fa2c5b0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:51.287 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.284+0000 7fa2c5b0c800 20 started sync module instance, tier type = 2024-09-12T17:35:51.287 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.284+0000 7fa2c5b0c800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:35:51.295 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.293+0000 7fa2c5b0c800 20 add_watcher() i=0 2024-09-12T17:35:51.295 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.293+0000 7fa2c5b0c800 20 add_watcher() i=1 2024-09-12T17:35:51.295 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.293+0000 7fa2c5b0c800 20 add_watcher() i=2 2024-09-12T17:35:51.295 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.293+0000 7fa2c5b0c800 20 add_watcher() i=3 2024-09-12T17:35:51.295 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.293+0000 7fa2c5b0c800 20 add_watcher() i=4 2024-09-12T17:35:51.295 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.293+0000 7fa2c5b0c800 20 add_watcher() i=5 2024-09-12T17:35:51.295 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.293+0000 7fa2c5b0c800 20 add_watcher() i=6 2024-09-12T17:35:51.296 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.294+0000 7fa2c5b0c800 20 add_watcher() i=7 2024-09-12T17:35:51.296 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.294+0000 7fa2c5b0c800 2 all 8 watchers are set, enabling cache 2024-09-12T17:35:51.298 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.296+0000 7fa179fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:35:51.298 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.296+0000 7fa2c5b0c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:35:51.298 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.296+0000 7fa2c5b0c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:35:51.298 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.296+0000 7fa2c5b0c800 5 note: GC not initialized 2024-09-12T17:35:51.299 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.296+0000 7fa178fe1640 20 reqs_thread_entry: start 2024-09-12T17:35:51.299 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.296+0000 7fa2c5b0c800 20 init_complete bucket index max shards: 11 2024-09-12T17:35:51.299 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.296+0000 7fa2c5b0c800 20 Filter name: none 2024-09-12T17:35:51.299 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.297+0000 7fa0f27fc640 20 reqs_thread_entry: start 2024-09-12T17:35:51.299 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.297+0000 7fa2c5b0c800 20 rados->read ofs=0 len=0 2024-09-12T17:35:51.299 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.297+0000 7fa2c5b0c800 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T17:35:51.300 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.297+0000 7fa2c5b0c800 20 rados->read ofs=0 len=0 2024-09-12T17:35:51.300 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.298+0000 7fa2c5b0c800 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T17:35:51.300 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.298+0000 7fa2c5b0c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:35:51.300 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.298+0000 7fa2c5b0c800 20 rados->read ofs=0 len=0 2024-09-12T17:35:51.300 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.298+0000 7fa2c5b0c800 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T17:35:51.301 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.298+0000 7fa2c5b0c800 20 rados->read ofs=0 len=0 2024-09-12T17:35:51.301 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.299+0000 7fa2c5b0c800 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T17:35:51.301 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.299+0000 7fa2c5b0c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:35:51.302 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.300+0000 7fa179fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:35:51.304 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.302+0000 7fa2c5b0c800 20 remove_watcher() i=0 2024-09-12T17:35:51.304 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.302+0000 7fa2c5b0c800 2 removed watcher, disabling cache 2024-09-12T17:35:51.305 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.304+0000 7fa2c5b0c800 20 remove_watcher() i=1 2024-09-12T17:35:51.306 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.305+0000 7fa2c5b0c800 20 remove_watcher() i=2 2024-09-12T17:35:51.308 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.306+0000 7fa2c5b0c800 20 remove_watcher() i=3 2024-09-12T17:35:51.309 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.307+0000 7fa2c5b0c800 20 remove_watcher() i=4 2024-09-12T17:35:51.310 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.308+0000 7fa2c5b0c800 20 remove_watcher() i=5 2024-09-12T17:35:51.311 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.309+0000 7fa2c5b0c800 20 remove_watcher() i=6 2024-09-12T17:35:51.312 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.310+0000 7fa2c5b0c800 20 remove_watcher() i=7 2024-09-12T17:35:51.323 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:35:51.323 INFO:tasks.workunit.client.0.smithi037.stderr:BUCKET_STATS: 2024-09-12T17:35:51.323 INFO:tasks.workunit.client.0.smithi037.stderr:bucket: abort-at-logrecord-writes id: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.37 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:35:51.323 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:35:51.325 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bucket reshard --bucket abort-at-logrecord-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at logrecord_writes 2024-09-12T17:35:51.359 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:35:51.359 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:35:51.399 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.397+0000 7f8e4332e800 20 rados->read ofs=0 len=0 2024-09-12T17:35:51.400 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.398+0000 7f8e4332e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:51.400 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.398+0000 7f8e4332e800 20 realm 2024-09-12T17:35:51.400 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.398+0000 7f8e4332e800 20 rados->read ofs=0 len=0 2024-09-12T17:35:51.401 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.398+0000 7f8e4332e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:51.401 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.398+0000 7f8e4332e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:35:51.401 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.398+0000 7f8e4332e800 20 rados->read ofs=0 len=0 2024-09-12T17:35:51.401 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.398+0000 7f8e4332e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:51.401 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.398+0000 7f8e4332e800 20 rados->read ofs=0 len=0 2024-09-12T17:35:51.401 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.399+0000 7f8e4332e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:35:51.401 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.399+0000 7f8e4332e800 20 rados->read ofs=0 len=0 2024-09-12T17:35:51.402 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.400+0000 7f8e4332e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:35:51.402 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.400+0000 7f8e4332e800 20 searching for the correct realm 2024-09-12T17:35:51.404 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.403+0000 7f8e3f76c640 0 -- 172.21.15.37:0/4162972020 >> [v2:172.21.15.40:6818/1210108009,v1:172.21.15.40:6819/1210108009] conn(0x7f8e34096120 msgr2=0x7f8e340cafb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:35:51.408 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.406+0000 7f8e3ef6b640 0 -- 172.21.15.37:0/4162972020 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7f8e340b1b90 msgr2=0x7f8e340b9050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:35:51.615 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.613+0000 7f8e4332e800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:35:51.615 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.613+0000 7f8e4332e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:35:51.615 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.613+0000 7f8e4332e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:35:51.615 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.613+0000 7f8e4332e800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:35:51.615 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.613+0000 7f8e4332e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:35:51.615 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.613+0000 7f8e4332e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:35:51.616 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.613+0000 7f8e4332e800 20 rados->read ofs=0 len=0 2024-09-12T17:35:51.616 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.613+0000 7f8e4332e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:51.616 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.613+0000 7f8e4332e800 20 rados->read ofs=0 len=0 2024-09-12T17:35:51.617 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.614+0000 7f8e4332e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:35:51.617 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.614+0000 7f8e4332e800 20 rados->read ofs=0 len=0 2024-09-12T17:35:51.617 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.614+0000 7f8e4332e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:35:51.617 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.614+0000 7f8e4332e800 20 zone default found 2024-09-12T17:35:51.617 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.614+0000 7f8e4332e800 4 Realm: () 2024-09-12T17:35:51.617 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.614+0000 7f8e4332e800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:35:51.617 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.614+0000 7f8e4332e800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:35:51.617 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.614+0000 7f8e4332e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:35:51.617 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.614+0000 7f8e4332e800 20 zonegroup default 2024-09-12T17:35:51.618 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.614+0000 7f8e4332e800 20 rados->read ofs=0 len=0 2024-09-12T17:35:51.618 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.614+0000 7f8e4332e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:51.618 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.614+0000 7f8e4332e800 20 rados->read ofs=0 len=0 2024-09-12T17:35:51.618 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.615+0000 7f8e4332e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:51.618 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.615+0000 7f8e4332e800 20 rados->read ofs=0 len=0 2024-09-12T17:35:51.618 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.615+0000 7f8e4332e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:51.618 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.615+0000 7f8e4332e800 20 started sync module instance, tier type = 2024-09-12T17:35:51.618 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.615+0000 7f8e4332e800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:35:51.626 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.624+0000 7f8e4332e800 20 add_watcher() i=0 2024-09-12T17:35:51.626 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.624+0000 7f8e4332e800 20 add_watcher() i=1 2024-09-12T17:35:51.626 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.624+0000 7f8e4332e800 20 add_watcher() i=2 2024-09-12T17:35:51.626 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.624+0000 7f8e4332e800 20 add_watcher() i=3 2024-09-12T17:35:51.626 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.624+0000 7f8e4332e800 20 add_watcher() i=4 2024-09-12T17:35:51.626 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.624+0000 7f8e4332e800 20 add_watcher() i=5 2024-09-12T17:35:51.626 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.624+0000 7f8e4332e800 20 add_watcher() i=6 2024-09-12T17:35:51.627 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.625+0000 7f8e4332e800 20 add_watcher() i=7 2024-09-12T17:35:51.627 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.625+0000 7f8e4332e800 2 all 8 watchers are set, enabling cache 2024-09-12T17:35:51.630 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.627+0000 7f8cf57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:35:51.630 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.627+0000 7f8e4332e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:35:51.630 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.627+0000 7f8e4332e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:35:51.630 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.627+0000 7f8e4332e800 5 note: GC not initialized 2024-09-12T17:35:51.630 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.628+0000 7f8c6ffff640 20 reqs_thread_entry: start 2024-09-12T17:35:51.630 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.628+0000 7f8e4332e800 20 init_complete bucket index max shards: 11 2024-09-12T17:35:51.630 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.628+0000 7f8e4332e800 20 Filter name: none 2024-09-12T17:35:51.630 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.628+0000 7f8c6dffb640 20 reqs_thread_entry: start 2024-09-12T17:35:51.630 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.628+0000 7f8e4332e800 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-12T17:35:51.630 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.628+0000 7f8e4332e800 20 rados->read ofs=0 len=0 2024-09-12T17:35:51.631 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.628+0000 7f8e4332e800 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T17:35:51.631 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.628+0000 7f8e4332e800 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-12T17:35:51.631 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.628+0000 7f8e4332e800 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-12T17:35:51.631 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.628+0000 7f8e4332e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.37 : miss 2024-09-12T17:35:51.631 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.628+0000 7f8e4332e800 20 rados->read ofs=0 len=0 2024-09-12T17:35:51.631 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.629+0000 7f8e4332e800 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T17:35:51.631 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.629+0000 7f8e4332e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.37 info.flags=0x17 2024-09-12T17:35:51.631 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.629+0000 7f8e4332e800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.37 to cache LRU end 2024-09-12T17:35:51.632 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.629+0000 7f8e4332e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:35:51.632 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.629+0000 7f8e4332e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:35:51.632 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.629+0000 7f8e4332e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.37 2024-09-12T17:35:51.637 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.635+0000 7f8e4332e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.37 info.flags=0x17 2024-09-12T17:35:51.637 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.635+0000 7f8e4332e800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.37 to cache LRU end 2024-09-12T17:35:51.637 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.635+0000 7f8e4332e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:35:51.637 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.635+0000 7f8e4332e800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.37, ofs0, ns] 2024-09-12T17:35:51.637 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.635+0000 7f8d227fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497000 cookie 94581504149664 notifier 7767 bl.length()=1007 2024-09-12T17:35:51.638 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.636+0000 7f8d227fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.37 info.flags=0x17 2024-09-12T17:35:51.638 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.636+0000 7f8d227fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.37 to cache LRU end 2024-09-12T17:35:51.638 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.636+0000 7f8d227fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:35:51.639 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.637+0000 7f8e4332e800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.37]): orig_sources= new_sources= 2024-09-12T17:35:51.639 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.637+0000 7f8e4332e800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.37]): potential sources added=[] removed=[] 2024-09-12T17:35:51.639 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.637+0000 7f8e4332e800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.37]): orig_dests= new_dests= 2024-09-12T17:35:51.639 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.637+0000 7f8e4332e800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.37]): potential dests added=[] removed=[] 2024-09-12T17:35:51.641 INFO:tasks.workunit.client.0.smithi037.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f8e4332e800 time 2024-09-12T17:35:51.641634+0000 2024-09-12T17:35:51.641 INFO:tasks.workunit.client.0.smithi037.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:35:51.642 INFO:tasks.workunit.client.0.smithi037.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:35:51.642 INFO:tasks.workunit.client.0.smithi037.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f8e4498c71a] 2024-09-12T17:35:51.643 INFO:tasks.workunit.client.0.smithi037.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f8e4498c8d8] 2024-09-12T17:35:51.643 INFO:tasks.workunit.client.0.smithi037.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x560576758841] 2024-09-12T17:35:51.643 INFO:tasks.workunit.client.0.smithi037.stderr: 4: radosgw-admin(+0xd7490c) [0x560576c6690c] 2024-09-12T17:35:51.643 INFO:tasks.workunit.client.0.smithi037.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x56057676850d] 2024-09-12T17:35:51.643 INFO:tasks.workunit.client.0.smithi037.stderr: 6: main() 2024-09-12T17:35:51.643 INFO:tasks.workunit.client.0.smithi037.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f8e43629590] 2024-09-12T17:35:51.643 INFO:tasks.workunit.client.0.smithi037.stderr: 8: __libc_start_main() 2024-09-12T17:35:51.643 INFO:tasks.workunit.client.0.smithi037.stderr: 9: _start() 2024-09-12T17:35:51.643 INFO:tasks.workunit.client.0.smithi037.stderr:*** Caught signal (Aborted) ** 2024-09-12T17:35:51.643 INFO:tasks.workunit.client.0.smithi037.stderr: in thread 7f8e4332e800 thread_name:radosgw-admin 2024-09-12T17:35:51.643 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.640+0000 7f8e4332e800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f8e4332e800 time 2024-09-12T17:35:51.641634+0000 2024-09-12T17:35:51.643 INFO:tasks.workunit.client.0.smithi037.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:35:51.643 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:35:51.643 INFO:tasks.workunit.client.0.smithi037.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:35:51.644 INFO:tasks.workunit.client.0.smithi037.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f8e4498c71a] 2024-09-12T17:35:51.644 INFO:tasks.workunit.client.0.smithi037.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f8e4498c8d8] 2024-09-12T17:35:51.644 INFO:tasks.workunit.client.0.smithi037.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x560576758841] 2024-09-12T17:35:51.644 INFO:tasks.workunit.client.0.smithi037.stderr: 4: radosgw-admin(+0xd7490c) [0x560576c6690c] 2024-09-12T17:35:51.644 INFO:tasks.workunit.client.0.smithi037.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x56057676850d] 2024-09-12T17:35:51.644 INFO:tasks.workunit.client.0.smithi037.stderr: 6: main() 2024-09-12T17:35:51.644 INFO:tasks.workunit.client.0.smithi037.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f8e43629590] 2024-09-12T17:35:51.644 INFO:tasks.workunit.client.0.smithi037.stderr: 8: __libc_start_main() 2024-09-12T17:35:51.644 INFO:tasks.workunit.client.0.smithi037.stderr: 9: _start() 2024-09-12T17:35:51.644 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:35:51.658 INFO:tasks.workunit.client.0.smithi037.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:35:51.659 INFO:tasks.workunit.client.0.smithi037.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f8e4363e6f0] 2024-09-12T17:35:51.659 INFO:tasks.workunit.client.0.smithi037.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f8e4368b99c] 2024-09-12T17:35:51.659 INFO:tasks.workunit.client.0.smithi037.stderr: 3: raise() 2024-09-12T17:35:51.659 INFO:tasks.workunit.client.0.smithi037.stderr: 4: abort() 2024-09-12T17:35:51.659 INFO:tasks.workunit.client.0.smithi037.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f8e4498c774] 2024-09-12T17:35:51.659 INFO:tasks.workunit.client.0.smithi037.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f8e4498c8d8] 2024-09-12T17:35:51.659 INFO:tasks.workunit.client.0.smithi037.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x560576758841] 2024-09-12T17:35:51.659 INFO:tasks.workunit.client.0.smithi037.stderr: 8: radosgw-admin(+0xd7490c) [0x560576c6690c] 2024-09-12T17:35:51.659 INFO:tasks.workunit.client.0.smithi037.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x56057676850d] 2024-09-12T17:35:51.660 INFO:tasks.workunit.client.0.smithi037.stderr: 10: main() 2024-09-12T17:35:51.660 INFO:tasks.workunit.client.0.smithi037.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f8e43629590] 2024-09-12T17:35:51.660 INFO:tasks.workunit.client.0.smithi037.stderr: 12: __libc_start_main() 2024-09-12T17:35:51.660 INFO:tasks.workunit.client.0.smithi037.stderr: 13: _start() 2024-09-12T17:35:51.660 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.641+0000 7f8e4332e800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:35:51.660 INFO:tasks.workunit.client.0.smithi037.stderr: in thread 7f8e4332e800 thread_name:radosgw-admin 2024-09-12T17:35:51.660 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:35:51.660 INFO:tasks.workunit.client.0.smithi037.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:35:51.660 INFO:tasks.workunit.client.0.smithi037.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f8e4363e6f0] 2024-09-12T17:35:51.660 INFO:tasks.workunit.client.0.smithi037.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f8e4368b99c] 2024-09-12T17:35:51.660 INFO:tasks.workunit.client.0.smithi037.stderr: 3: raise() 2024-09-12T17:35:51.660 INFO:tasks.workunit.client.0.smithi037.stderr: 4: abort() 2024-09-12T17:35:51.660 INFO:tasks.workunit.client.0.smithi037.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f8e4498c774] 2024-09-12T17:35:51.660 INFO:tasks.workunit.client.0.smithi037.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f8e4498c8d8] 2024-09-12T17:35:51.661 INFO:tasks.workunit.client.0.smithi037.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x560576758841] 2024-09-12T17:35:51.661 INFO:tasks.workunit.client.0.smithi037.stderr: 8: radosgw-admin(+0xd7490c) [0x560576c6690c] 2024-09-12T17:35:51.661 INFO:tasks.workunit.client.0.smithi037.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x56057676850d] 2024-09-12T17:35:51.661 INFO:tasks.workunit.client.0.smithi037.stderr: 10: main() 2024-09-12T17:35:51.661 INFO:tasks.workunit.client.0.smithi037.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f8e43629590] 2024-09-12T17:35:51.661 INFO:tasks.workunit.client.0.smithi037.stderr: 12: __libc_start_main() 2024-09-12T17:35:51.661 INFO:tasks.workunit.client.0.smithi037.stderr: 13: _start() 2024-09-12T17:35:51.661 INFO:tasks.workunit.client.0.smithi037.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:35:51.661 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:35:51.661 INFO:tasks.workunit.client.0.smithi037.stderr:--- begin dump of recent events --- 2024-09-12T17:35:51.661 INFO:tasks.workunit.client.0.smithi037.stderr: -499> 2024-09-12T17:35:51.379+0000 7f8e4332e800 10 monclient: get_monmap_and_config success 2024-09-12T17:35:51.661 INFO:tasks.workunit.client.0.smithi037.stderr: -498> 2024-09-12T17:35:51.379+0000 7f8e4332e800 4 set_mon_vals no callback set 2024-09-12T17:35:51.661 INFO:tasks.workunit.client.0.smithi037.stderr: -497> 2024-09-12T17:35:51.380+0000 7f8e4332e800 10 monclient: shutdown 2024-09-12T17:35:51.662 INFO:tasks.workunit.client.0.smithi037.stderr: -496> 2024-09-12T17:35:51.380+0000 7f8e4332e800 5 asok(0x560578c32730) unregister_commands rotate-key 2024-09-12T17:35:51.662 INFO:tasks.workunit.client.0.smithi037.stderr: -495> 2024-09-12T17:35:51.380+0000 7f8e4332e800 10 monclient: build_initial_monmap 2024-09-12T17:35:51.662 INFO:tasks.workunit.client.0.smithi037.stderr: -494> 2024-09-12T17:35:51.380+0000 7f8e4332e800 1 build_initial for_mkfs: 0 2024-09-12T17:35:51.662 INFO:tasks.workunit.client.0.smithi037.stderr: -493> 2024-09-12T17:35:51.380+0000 7f8e4332e800 10 monclient: monmap: 2024-09-12T17:35:51.662 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 0 2024-09-12T17:35:51.662 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:35:51.662 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 0.000000 2024-09-12T17:35:51.662 INFO:tasks.workunit.client.0.smithi037.stderr:created 0.000000 2024-09-12T17:35:51.662 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 0 (unknown) 2024-09-12T17:35:51.662 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:35:51.662 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.noname-a 2024-09-12T17:35:51.662 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.noname-b 2024-09-12T17:35:51.662 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.noname-c 2024-09-12T17:35:51.662 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:35:51.663 INFO:tasks.workunit.client.0.smithi037.stderr: -492> 2024-09-12T17:35:51.380+0000 7f8e4332e800 5 AuthRegistry(0x560578e59320) adding auth protocol: cephx 2024-09-12T17:35:51.663 INFO:tasks.workunit.client.0.smithi037.stderr: -491> 2024-09-12T17:35:51.380+0000 7f8e4332e800 5 AuthRegistry(0x560578e59320) adding auth protocol: cephx 2024-09-12T17:35:51.663 INFO:tasks.workunit.client.0.smithi037.stderr: -490> 2024-09-12T17:35:51.380+0000 7f8e4332e800 5 AuthRegistry(0x560578e59320) adding auth protocol: cephx 2024-09-12T17:35:51.663 INFO:tasks.workunit.client.0.smithi037.stderr: -489> 2024-09-12T17:35:51.380+0000 7f8e4332e800 5 AuthRegistry(0x560578e59320) adding con mode: secure 2024-09-12T17:35:51.663 INFO:tasks.workunit.client.0.smithi037.stderr: -488> 2024-09-12T17:35:51.380+0000 7f8e4332e800 5 AuthRegistry(0x560578e59320) adding con mode: crc 2024-09-12T17:35:51.663 INFO:tasks.workunit.client.0.smithi037.stderr: -487> 2024-09-12T17:35:51.380+0000 7f8e4332e800 5 AuthRegistry(0x560578e59320) adding con mode: secure 2024-09-12T17:35:51.663 INFO:tasks.workunit.client.0.smithi037.stderr: -486> 2024-09-12T17:35:51.380+0000 7f8e4332e800 5 AuthRegistry(0x560578e59320) adding con mode: crc 2024-09-12T17:35:51.663 INFO:tasks.workunit.client.0.smithi037.stderr: -485> 2024-09-12T17:35:51.380+0000 7f8e4332e800 5 AuthRegistry(0x560578e59320) adding con mode: secure 2024-09-12T17:35:51.663 INFO:tasks.workunit.client.0.smithi037.stderr: -484> 2024-09-12T17:35:51.380+0000 7f8e4332e800 5 AuthRegistry(0x560578e59320) adding con mode: crc 2024-09-12T17:35:51.663 INFO:tasks.workunit.client.0.smithi037.stderr: -483> 2024-09-12T17:35:51.380+0000 7f8e4332e800 5 AuthRegistry(0x560578e59320) adding con mode: crc 2024-09-12T17:35:51.663 INFO:tasks.workunit.client.0.smithi037.stderr: -482> 2024-09-12T17:35:51.380+0000 7f8e4332e800 5 AuthRegistry(0x560578e59320) adding con mode: secure 2024-09-12T17:35:51.663 INFO:tasks.workunit.client.0.smithi037.stderr: -481> 2024-09-12T17:35:51.380+0000 7f8e4332e800 5 AuthRegistry(0x560578e59320) adding con mode: crc 2024-09-12T17:35:51.663 INFO:tasks.workunit.client.0.smithi037.stderr: -480> 2024-09-12T17:35:51.380+0000 7f8e4332e800 5 AuthRegistry(0x560578e59320) adding con mode: secure 2024-09-12T17:35:51.663 INFO:tasks.workunit.client.0.smithi037.stderr: -479> 2024-09-12T17:35:51.380+0000 7f8e4332e800 5 AuthRegistry(0x560578e59320) adding con mode: crc 2024-09-12T17:35:51.663 INFO:tasks.workunit.client.0.smithi037.stderr: -478> 2024-09-12T17:35:51.380+0000 7f8e4332e800 5 AuthRegistry(0x560578e59320) adding con mode: secure 2024-09-12T17:35:51.664 INFO:tasks.workunit.client.0.smithi037.stderr: -477> 2024-09-12T17:35:51.380+0000 7f8e4332e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:35:51.664 INFO:tasks.workunit.client.0.smithi037.stderr: -476> 2024-09-12T17:35:51.380+0000 7f8e4332e800 1 librados: starting msgr at 2024-09-12T17:35:51.664 INFO:tasks.workunit.client.0.smithi037.stderr: -475> 2024-09-12T17:35:51.380+0000 7f8e4332e800 1 librados: starting objecter 2024-09-12T17:35:51.664 INFO:tasks.workunit.client.0.smithi037.stderr: -474> 2024-09-12T17:35:51.380+0000 7f8e4332e800 5 asok(0x560578c32730) register_command objecter_requests hook 0x560578e551f0 2024-09-12T17:35:51.664 INFO:tasks.workunit.client.0.smithi037.stderr: -473> 2024-09-12T17:35:51.380+0000 7f8e4332e800 1 librados: setting wanted keys 2024-09-12T17:35:51.664 INFO:tasks.workunit.client.0.smithi037.stderr: -472> 2024-09-12T17:35:51.380+0000 7f8e4332e800 1 librados: calling monclient init 2024-09-12T17:35:51.664 INFO:tasks.workunit.client.0.smithi037.stderr: -471> 2024-09-12T17:35:51.380+0000 7f8e4332e800 10 monclient: init 2024-09-12T17:35:51.664 INFO:tasks.workunit.client.0.smithi037.stderr: -470> 2024-09-12T17:35:51.380+0000 7f8e4332e800 5 AuthRegistry(0x560578e53d30) adding auth protocol: cephx 2024-09-12T17:35:51.664 INFO:tasks.workunit.client.0.smithi037.stderr: -469> 2024-09-12T17:35:51.380+0000 7f8e4332e800 5 AuthRegistry(0x560578e53d30) adding auth protocol: cephx 2024-09-12T17:35:51.664 INFO:tasks.workunit.client.0.smithi037.stderr: -468> 2024-09-12T17:35:51.380+0000 7f8e4332e800 5 AuthRegistry(0x560578e53d30) adding auth protocol: cephx 2024-09-12T17:35:51.664 INFO:tasks.workunit.client.0.smithi037.stderr: -467> 2024-09-12T17:35:51.380+0000 7f8e4332e800 5 AuthRegistry(0x560578e53d30) adding con mode: secure 2024-09-12T17:35:51.664 INFO:tasks.workunit.client.0.smithi037.stderr: -466> 2024-09-12T17:35:51.380+0000 7f8e4332e800 5 AuthRegistry(0x560578e53d30) adding con mode: crc 2024-09-12T17:35:51.664 INFO:tasks.workunit.client.0.smithi037.stderr: -465> 2024-09-12T17:35:51.380+0000 7f8e4332e800 5 AuthRegistry(0x560578e53d30) adding con mode: secure 2024-09-12T17:35:51.664 INFO:tasks.workunit.client.0.smithi037.stderr: -464> 2024-09-12T17:35:51.380+0000 7f8e4332e800 5 AuthRegistry(0x560578e53d30) adding con mode: crc 2024-09-12T17:35:51.665 INFO:tasks.workunit.client.0.smithi037.stderr: -463> 2024-09-12T17:35:51.380+0000 7f8e4332e800 5 AuthRegistry(0x560578e53d30) adding con mode: secure 2024-09-12T17:35:51.665 INFO:tasks.workunit.client.0.smithi037.stderr: -462> 2024-09-12T17:35:51.380+0000 7f8e4332e800 5 AuthRegistry(0x560578e53d30) adding con mode: crc 2024-09-12T17:35:51.665 INFO:tasks.workunit.client.0.smithi037.stderr: -461> 2024-09-12T17:35:51.380+0000 7f8e4332e800 5 AuthRegistry(0x560578e53d30) adding con mode: crc 2024-09-12T17:35:51.665 INFO:tasks.workunit.client.0.smithi037.stderr: -460> 2024-09-12T17:35:51.380+0000 7f8e4332e800 5 AuthRegistry(0x560578e53d30) adding con mode: secure 2024-09-12T17:35:51.665 INFO:tasks.workunit.client.0.smithi037.stderr: -459> 2024-09-12T17:35:51.380+0000 7f8e4332e800 5 AuthRegistry(0x560578e53d30) adding con mode: crc 2024-09-12T17:35:51.665 INFO:tasks.workunit.client.0.smithi037.stderr: -458> 2024-09-12T17:35:51.380+0000 7f8e4332e800 5 AuthRegistry(0x560578e53d30) adding con mode: secure 2024-09-12T17:35:51.665 INFO:tasks.workunit.client.0.smithi037.stderr: -457> 2024-09-12T17:35:51.380+0000 7f8e4332e800 5 AuthRegistry(0x560578e53d30) adding con mode: crc 2024-09-12T17:35:51.665 INFO:tasks.workunit.client.0.smithi037.stderr: -456> 2024-09-12T17:35:51.380+0000 7f8e4332e800 5 AuthRegistry(0x560578e53d30) adding con mode: secure 2024-09-12T17:35:51.665 INFO:tasks.workunit.client.0.smithi037.stderr: -455> 2024-09-12T17:35:51.380+0000 7f8e4332e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:35:51.665 INFO:tasks.workunit.client.0.smithi037.stderr: -454> 2024-09-12T17:35:51.381+0000 7f8e4332e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:35:51.665 INFO:tasks.workunit.client.0.smithi037.stderr: -453> 2024-09-12T17:35:51.381+0000 7f8e4332e800 5 asok(0x560578c32730) register_command rotate-key hook 0x560578e53e78 2024-09-12T17:35:51.665 INFO:tasks.workunit.client.0.smithi037.stderr: -452> 2024-09-12T17:35:51.381+0000 7f8e4332e800 10 monclient: _reopen_session rank -1 2024-09-12T17:35:51.665 INFO:tasks.workunit.client.0.smithi037.stderr: -451> 2024-09-12T17:35:51.381+0000 7f8e4332e800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T17:35:51.666 INFO:tasks.workunit.client.0.smithi037.stderr: -450> 2024-09-12T17:35:51.381+0000 7f8e4332e800 10 monclient(hunting): picked mon.noname-c con 0x560578d99a40 addr [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] 2024-09-12T17:35:51.666 INFO:tasks.workunit.client.0.smithi037.stderr: -449> 2024-09-12T17:35:51.381+0000 7f8e4332e800 10 monclient(hunting): picked mon.noname-a con 0x560578d99e20 addr [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] 2024-09-12T17:35:51.666 INFO:tasks.workunit.client.0.smithi037.stderr: -448> 2024-09-12T17:35:51.381+0000 7f8e4332e800 10 monclient(hunting): picked mon.noname-b con 0x560578d9d1b0 addr [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] 2024-09-12T17:35:51.666 INFO:tasks.workunit.client.0.smithi037.stderr: -447> 2024-09-12T17:35:51.381+0000 7f8e4332e800 10 monclient(hunting): start opening mon connection 2024-09-12T17:35:51.666 INFO:tasks.workunit.client.0.smithi037.stderr: -446> 2024-09-12T17:35:51.381+0000 7f8e4332e800 10 monclient(hunting): start opening mon connection 2024-09-12T17:35:51.666 INFO:tasks.workunit.client.0.smithi037.stderr: -445> 2024-09-12T17:35:51.381+0000 7f8e4332e800 10 monclient(hunting): start opening mon connection 2024-09-12T17:35:51.666 INFO:tasks.workunit.client.0.smithi037.stderr: -444> 2024-09-12T17:35:51.381+0000 7f8e4332e800 10 monclient(hunting): _renew_subs 2024-09-12T17:35:51.666 INFO:tasks.workunit.client.0.smithi037.stderr: -443> 2024-09-12T17:35:51.381+0000 7f8e4332e800 10 monclient(hunting): authenticate will time out at 2338.979418s 2024-09-12T17:35:51.666 INFO:tasks.workunit.client.0.smithi037.stderr: -442> 2024-09-12T17:35:51.381+0000 7f8e3e76a640 10 monclient(hunting): get_auth_request con 0x560578d99e20 auth_method 0 2024-09-12T17:35:51.666 INFO:tasks.workunit.client.0.smithi037.stderr: -441> 2024-09-12T17:35:51.381+0000 7f8e3e76a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:35:51.666 INFO:tasks.workunit.client.0.smithi037.stderr: -440> 2024-09-12T17:35:51.381+0000 7f8e3e76a640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:35:51.666 INFO:tasks.workunit.client.0.smithi037.stderr: -439> 2024-09-12T17:35:51.381+0000 7f8e3e76a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:35:51.666 INFO:tasks.workunit.client.0.smithi037.stderr: -438> 2024-09-12T17:35:51.381+0000 7f8e3ef6b640 10 monclient(hunting): get_auth_request con 0x560578d99a40 auth_method 0 2024-09-12T17:35:51.666 INFO:tasks.workunit.client.0.smithi037.stderr: -437> 2024-09-12T17:35:51.381+0000 7f8e3ef6b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:35:51.667 INFO:tasks.workunit.client.0.smithi037.stderr: -436> 2024-09-12T17:35:51.381+0000 7f8e3ef6b640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:35:51.667 INFO:tasks.workunit.client.0.smithi037.stderr: -435> 2024-09-12T17:35:51.381+0000 7f8e3ef6b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:35:51.667 INFO:tasks.workunit.client.0.smithi037.stderr: -434> 2024-09-12T17:35:51.381+0000 7f8e3e76a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:35:51.667 INFO:tasks.workunit.client.0.smithi037.stderr: -433> 2024-09-12T17:35:51.381+0000 7f8e3e76a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:35:51.667 INFO:tasks.workunit.client.0.smithi037.stderr: -432> 2024-09-12T17:35:51.381+0000 7f8e3e76a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:35:51.667 INFO:tasks.workunit.client.0.smithi037.stderr: -431> 2024-09-12T17:35:51.381+0000 7f8e3ef6b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:35:51.667 INFO:tasks.workunit.client.0.smithi037.stderr: -430> 2024-09-12T17:35:51.381+0000 7f8e3ef6b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:35:51.667 INFO:tasks.workunit.client.0.smithi037.stderr: -429> 2024-09-12T17:35:51.381+0000 7f8e3ef6b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:35:51.667 INFO:tasks.workunit.client.0.smithi037.stderr: -428> 2024-09-12T17:35:51.381+0000 7f8e3f76c640 10 monclient(hunting): get_auth_request con 0x560578d9d1b0 auth_method 0 2024-09-12T17:35:51.667 INFO:tasks.workunit.client.0.smithi037.stderr: -427> 2024-09-12T17:35:51.381+0000 7f8e3f76c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:35:51.667 INFO:tasks.workunit.client.0.smithi037.stderr: -426> 2024-09-12T17:35:51.381+0000 7f8e3f76c640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:35:51.667 INFO:tasks.workunit.client.0.smithi037.stderr: -425> 2024-09-12T17:35:51.381+0000 7f8e3f76c640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:35:51.667 INFO:tasks.workunit.client.0.smithi037.stderr: -424> 2024-09-12T17:35:51.381+0000 7f8e3e76a640 10 monclient(hunting): handle_auth_done global_id 7758 payload 824 2024-09-12T17:35:51.667 INFO:tasks.workunit.client.0.smithi037.stderr: -423> 2024-09-12T17:35:51.381+0000 7f8e3e76a640 10 monclient: _finish_hunting 0 2024-09-12T17:35:51.668 INFO:tasks.workunit.client.0.smithi037.stderr: -422> 2024-09-12T17:35:51.381+0000 7f8e3e76a640 1 monclient: found mon.noname-a 2024-09-12T17:35:51.668 INFO:tasks.workunit.client.0.smithi037.stderr: -421> 2024-09-12T17:35:51.381+0000 7f8e3e76a640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.37:3300/0 2024-09-12T17:35:51.668 INFO:tasks.workunit.client.0.smithi037.stderr: -420> 2024-09-12T17:35:51.382+0000 7f8d2b606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:35:51.668 INFO:tasks.workunit.client.0.smithi037.stderr: -419> 2024-09-12T17:35:51.382+0000 7f8d2b606640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:35:51.668 INFO:tasks.workunit.client.0.smithi037.stderr: -418> 2024-09-12T17:35:51.382+0000 7f8d2b606640 10 monclient: dump: 2024-09-12T17:35:51.668 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:35:51.668 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:35:51.668 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:35:51.668 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:35:51.668 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:35:51.668 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:35:51.668 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:35:51.668 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:35:51.668 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:35:51.669 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:35:51.669 INFO:tasks.workunit.client.0.smithi037.stderr: -417> 2024-09-12T17:35:51.382+0000 7f8d2b606640 10 monclient: _finish_auth 0 2024-09-12T17:35:51.669 INFO:tasks.workunit.client.0.smithi037.stderr: -416> 2024-09-12T17:35:51.382+0000 7f8d2b606640 10 monclient: _check_auth_tickets 2024-09-12T17:35:51.669 INFO:tasks.workunit.client.0.smithi037.stderr: -415> 2024-09-12T17:35:51.382+0000 7f8e4332e800 5 monclient: authenticate success, global_id 7758 2024-09-12T17:35:51.669 INFO:tasks.workunit.client.0.smithi037.stderr: -414> 2024-09-12T17:35:51.382+0000 7f8e4332e800 10 monclient: _renew_subs 2024-09-12T17:35:51.669 INFO:tasks.workunit.client.0.smithi037.stderr: -413> 2024-09-12T17:35:51.382+0000 7f8e4332e800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.37:3300/0 2024-09-12T17:35:51.669 INFO:tasks.workunit.client.0.smithi037.stderr: -412> 2024-09-12T17:35:51.382+0000 7f8d2b606640 10 monclient: handle_config config(0 keys) 2024-09-12T17:35:51.669 INFO:tasks.workunit.client.0.smithi037.stderr: -411> 2024-09-12T17:35:51.382+0000 7f8d2b606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:35:51.669 INFO:tasks.workunit.client.0.smithi037.stderr: -410> 2024-09-12T17:35:51.382+0000 7f8d2b606640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:35:51.669 INFO:tasks.workunit.client.0.smithi037.stderr: -409> 2024-09-12T17:35:51.382+0000 7f8d2b606640 10 monclient: dump: 2024-09-12T17:35:51.669 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:35:51.669 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:35:51.669 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:35:51.669 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:35:51.669 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:35:51.670 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:35:51.670 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:35:51.670 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:35:51.670 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:35:51.670 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:35:51.670 INFO:tasks.workunit.client.0.smithi037.stderr: -408> 2024-09-12T17:35:51.382+0000 7f8d2ce09640 4 set_mon_vals no callback set 2024-09-12T17:35:51.670 INFO:tasks.workunit.client.0.smithi037.stderr: -407> 2024-09-12T17:35:51.382+0000 7f8e4332e800 10 monclient: _renew_subs 2024-09-12T17:35:51.670 INFO:tasks.workunit.client.0.smithi037.stderr: -406> 2024-09-12T17:35:51.382+0000 7f8e4332e800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.37:3300/0 2024-09-12T17:35:51.670 INFO:tasks.workunit.client.0.smithi037.stderr: -405> 2024-09-12T17:35:51.382+0000 7f8e4332e800 1 librados: init done 2024-09-12T17:35:51.670 INFO:tasks.workunit.client.0.smithi037.stderr: -404> 2024-09-12T17:35:51.384+0000 7f8d2b606640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:35:51.670 INFO:tasks.workunit.client.0.smithi037.stderr: -403> 2024-09-12T17:35:51.384+0000 7f8d2b606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.40:6816/3916250676,v1:172.21.15.40:6817/3916250676] 2024-09-12T17:35:51.670 INFO:tasks.workunit.client.0.smithi037.stderr: -402> 2024-09-12T17:35:51.384+0000 7f8d2b606640 4 mgrc reconnect Starting new session with [v2:172.21.15.40:6816/3916250676,v1:172.21.15.40:6817/3916250676] 2024-09-12T17:35:51.670 INFO:tasks.workunit.client.0.smithi037.stderr: -401> 2024-09-12T17:35:51.384+0000 7f8e3ef6b640 10 monclient: get_auth_request con 0x7f8d240764a0 auth_method 0 2024-09-12T17:35:51.670 INFO:tasks.workunit.client.0.smithi037.stderr: -400> 2024-09-12T17:35:51.384+0000 7f8e3f76c640 10 monclient: get_auth_request con 0x560578e7c4f0 auth_method 0 2024-09-12T17:35:51.670 INFO:tasks.workunit.client.0.smithi037.stderr: -399> 2024-09-12T17:35:51.385+0000 7f8e3ef6b640 10 monclient: get_auth_request con 0x560578e9ef70 auth_method 0 2024-09-12T17:35:51.671 INFO:tasks.workunit.client.0.smithi037.stderr: -398> 2024-09-12T17:35:51.386+0000 7f8e3e76a640 10 monclient: get_auth_request con 0x560578ea44b0 auth_method 0 2024-09-12T17:35:51.671 INFO:tasks.workunit.client.0.smithi037.stderr: -397> 2024-09-12T17:35:51.387+0000 7f8e4332e800 10 monclient: build_initial_monmap 2024-09-12T17:35:51.671 INFO:tasks.workunit.client.0.smithi037.stderr: -396> 2024-09-12T17:35:51.387+0000 7f8e4332e800 1 build_initial for_mkfs: 0 2024-09-12T17:35:51.671 INFO:tasks.workunit.client.0.smithi037.stderr: -395> 2024-09-12T17:35:51.387+0000 7f8e4332e800 10 monclient: monmap: 2024-09-12T17:35:51.671 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 0 2024-09-12T17:35:51.671 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:35:51.671 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 0.000000 2024-09-12T17:35:51.671 INFO:tasks.workunit.client.0.smithi037.stderr:created 0.000000 2024-09-12T17:35:51.671 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 0 (unknown) 2024-09-12T17:35:51.671 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:35:51.671 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.noname-a 2024-09-12T17:35:51.671 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.noname-b 2024-09-12T17:35:51.671 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.noname-c 2024-09-12T17:35:51.671 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:35:51.671 INFO:tasks.workunit.client.0.smithi037.stderr: -394> 2024-09-12T17:35:51.387+0000 7f8e4332e800 5 AuthRegistry(0x560578ea8430) adding auth protocol: cephx 2024-09-12T17:35:51.672 INFO:tasks.workunit.client.0.smithi037.stderr: -393> 2024-09-12T17:35:51.387+0000 7f8e4332e800 5 AuthRegistry(0x560578ea8430) adding auth protocol: cephx 2024-09-12T17:35:51.672 INFO:tasks.workunit.client.0.smithi037.stderr: -392> 2024-09-12T17:35:51.387+0000 7f8e4332e800 5 AuthRegistry(0x560578ea8430) adding auth protocol: cephx 2024-09-12T17:35:51.672 INFO:tasks.workunit.client.0.smithi037.stderr: -391> 2024-09-12T17:35:51.387+0000 7f8e4332e800 5 AuthRegistry(0x560578ea8430) adding con mode: secure 2024-09-12T17:35:51.672 INFO:tasks.workunit.client.0.smithi037.stderr: -390> 2024-09-12T17:35:51.387+0000 7f8e4332e800 5 AuthRegistry(0x560578ea8430) adding con mode: crc 2024-09-12T17:35:51.672 INFO:tasks.workunit.client.0.smithi037.stderr: -389> 2024-09-12T17:35:51.387+0000 7f8e4332e800 5 AuthRegistry(0x560578ea8430) adding con mode: secure 2024-09-12T17:35:51.672 INFO:tasks.workunit.client.0.smithi037.stderr: -388> 2024-09-12T17:35:51.387+0000 7f8e4332e800 5 AuthRegistry(0x560578ea8430) adding con mode: crc 2024-09-12T17:35:51.672 INFO:tasks.workunit.client.0.smithi037.stderr: -387> 2024-09-12T17:35:51.387+0000 7f8e4332e800 5 AuthRegistry(0x560578ea8430) adding con mode: secure 2024-09-12T17:35:51.672 INFO:tasks.workunit.client.0.smithi037.stderr: -386> 2024-09-12T17:35:51.387+0000 7f8e4332e800 5 AuthRegistry(0x560578ea8430) adding con mode: crc 2024-09-12T17:35:51.672 INFO:tasks.workunit.client.0.smithi037.stderr: -385> 2024-09-12T17:35:51.387+0000 7f8e4332e800 5 AuthRegistry(0x560578ea8430) adding con mode: crc 2024-09-12T17:35:51.672 INFO:tasks.workunit.client.0.smithi037.stderr: -384> 2024-09-12T17:35:51.387+0000 7f8e4332e800 5 AuthRegistry(0x560578ea8430) adding con mode: secure 2024-09-12T17:35:51.672 INFO:tasks.workunit.client.0.smithi037.stderr: -383> 2024-09-12T17:35:51.387+0000 7f8e4332e800 5 AuthRegistry(0x560578ea8430) adding con mode: crc 2024-09-12T17:35:51.672 INFO:tasks.workunit.client.0.smithi037.stderr: -382> 2024-09-12T17:35:51.387+0000 7f8e4332e800 5 AuthRegistry(0x560578ea8430) adding con mode: secure 2024-09-12T17:35:51.672 INFO:tasks.workunit.client.0.smithi037.stderr: -381> 2024-09-12T17:35:51.387+0000 7f8e4332e800 5 AuthRegistry(0x560578ea8430) adding con mode: crc 2024-09-12T17:35:51.673 INFO:tasks.workunit.client.0.smithi037.stderr: -380> 2024-09-12T17:35:51.387+0000 7f8e4332e800 5 AuthRegistry(0x560578ea8430) adding con mode: secure 2024-09-12T17:35:51.673 INFO:tasks.workunit.client.0.smithi037.stderr: -379> 2024-09-12T17:35:51.387+0000 7f8e4332e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:35:51.673 INFO:tasks.workunit.client.0.smithi037.stderr: -378> 2024-09-12T17:35:51.388+0000 7f8e4332e800 5 asok(0x560578c32730) register_command objecter_requests cmddesc objecter_requests hook 0x560578eabe20 EEXIST 2024-09-12T17:35:51.673 INFO:tasks.workunit.client.0.smithi037.stderr: -377> 2024-09-12T17:35:51.388+0000 7f8e4332e800 10 monclient: init 2024-09-12T17:35:51.673 INFO:tasks.workunit.client.0.smithi037.stderr: -376> 2024-09-12T17:35:51.388+0000 7f8e4332e800 5 AuthRegistry(0x560578ea73e8) adding auth protocol: cephx 2024-09-12T17:35:51.673 INFO:tasks.workunit.client.0.smithi037.stderr: -375> 2024-09-12T17:35:51.388+0000 7f8e4332e800 5 AuthRegistry(0x560578ea73e8) adding auth protocol: cephx 2024-09-12T17:35:51.673 INFO:tasks.workunit.client.0.smithi037.stderr: -374> 2024-09-12T17:35:51.388+0000 7f8e4332e800 5 AuthRegistry(0x560578ea73e8) adding auth protocol: cephx 2024-09-12T17:35:51.673 INFO:tasks.workunit.client.0.smithi037.stderr: -373> 2024-09-12T17:35:51.388+0000 7f8e4332e800 5 AuthRegistry(0x560578ea73e8) adding con mode: secure 2024-09-12T17:35:51.673 INFO:tasks.workunit.client.0.smithi037.stderr: -372> 2024-09-12T17:35:51.388+0000 7f8e4332e800 5 AuthRegistry(0x560578ea73e8) adding con mode: crc 2024-09-12T17:35:51.673 INFO:tasks.workunit.client.0.smithi037.stderr: -371> 2024-09-12T17:35:51.388+0000 7f8e4332e800 5 AuthRegistry(0x560578ea73e8) adding con mode: secure 2024-09-12T17:35:51.674 INFO:tasks.workunit.client.0.smithi037.stderr: -370> 2024-09-12T17:35:51.388+0000 7f8e4332e800 5 AuthRegistry(0x560578ea73e8) adding con mode: crc 2024-09-12T17:35:51.674 INFO:tasks.workunit.client.0.smithi037.stderr: -369> 2024-09-12T17:35:51.388+0000 7f8e4332e800 5 AuthRegistry(0x560578ea73e8) adding con mode: secure 2024-09-12T17:35:51.674 INFO:tasks.workunit.client.0.smithi037.stderr: -368> 2024-09-12T17:35:51.388+0000 7f8e4332e800 5 AuthRegistry(0x560578ea73e8) adding con mode: crc 2024-09-12T17:35:51.674 INFO:tasks.workunit.client.0.smithi037.stderr: -367> 2024-09-12T17:35:51.388+0000 7f8e4332e800 5 AuthRegistry(0x560578ea73e8) adding con mode: crc 2024-09-12T17:35:51.674 INFO:tasks.workunit.client.0.smithi037.stderr: -366> 2024-09-12T17:35:51.388+0000 7f8e4332e800 5 AuthRegistry(0x560578ea73e8) adding con mode: secure 2024-09-12T17:35:51.674 INFO:tasks.workunit.client.0.smithi037.stderr: -365> 2024-09-12T17:35:51.388+0000 7f8e4332e800 5 AuthRegistry(0x560578ea73e8) adding con mode: crc 2024-09-12T17:35:51.674 INFO:tasks.workunit.client.0.smithi037.stderr: -364> 2024-09-12T17:35:51.388+0000 7f8e4332e800 5 AuthRegistry(0x560578ea73e8) adding con mode: secure 2024-09-12T17:35:51.674 INFO:tasks.workunit.client.0.smithi037.stderr: -363> 2024-09-12T17:35:51.388+0000 7f8e4332e800 5 AuthRegistry(0x560578ea73e8) adding con mode: crc 2024-09-12T17:35:51.674 INFO:tasks.workunit.client.0.smithi037.stderr: -362> 2024-09-12T17:35:51.388+0000 7f8e4332e800 5 AuthRegistry(0x560578ea73e8) adding con mode: secure 2024-09-12T17:35:51.674 INFO:tasks.workunit.client.0.smithi037.stderr: -361> 2024-09-12T17:35:51.388+0000 7f8e4332e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:35:51.674 INFO:tasks.workunit.client.0.smithi037.stderr: -360> 2024-09-12T17:35:51.388+0000 7f8e4332e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:35:51.674 INFO:tasks.workunit.client.0.smithi037.stderr: -359> 2024-09-12T17:35:51.388+0000 7f8e4332e800 5 asok(0x560578c32730) register_command rotate-key cmddesc rotate-key hook 0x560578ea7530 EEXIST 2024-09-12T17:35:51.674 INFO:tasks.workunit.client.0.smithi037.stderr: -358> 2024-09-12T17:35:51.388+0000 7f8e4332e800 10 monclient: _reopen_session rank -1 2024-09-12T17:35:51.675 INFO:tasks.workunit.client.0.smithi037.stderr: -357> 2024-09-12T17:35:51.388+0000 7f8e4332e800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T17:35:51.675 INFO:tasks.workunit.client.0.smithi037.stderr: -356> 2024-09-12T17:35:51.388+0000 7f8e4332e800 10 monclient(hunting): picked mon.noname-b con 0x560578ecfb10 addr [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] 2024-09-12T17:35:51.675 INFO:tasks.workunit.client.0.smithi037.stderr: -355> 2024-09-12T17:35:51.388+0000 7f8e4332e800 10 monclient(hunting): picked mon.noname-a con 0x560578ed1de0 addr [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] 2024-09-12T17:35:51.675 INFO:tasks.workunit.client.0.smithi037.stderr: -354> 2024-09-12T17:35:51.388+0000 7f8e4332e800 10 monclient(hunting): picked mon.noname-c con 0x560578ece2e0 addr [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] 2024-09-12T17:35:51.675 INFO:tasks.workunit.client.0.smithi037.stderr: -353> 2024-09-12T17:35:51.388+0000 7f8e4332e800 10 monclient(hunting): start opening mon connection 2024-09-12T17:35:51.675 INFO:tasks.workunit.client.0.smithi037.stderr: -352> 2024-09-12T17:35:51.388+0000 7f8e4332e800 10 monclient(hunting): start opening mon connection 2024-09-12T17:35:51.675 INFO:tasks.workunit.client.0.smithi037.stderr: -351> 2024-09-12T17:35:51.388+0000 7f8e4332e800 10 monclient(hunting): start opening mon connection 2024-09-12T17:35:51.675 INFO:tasks.workunit.client.0.smithi037.stderr: -350> 2024-09-12T17:35:51.388+0000 7f8e4332e800 10 monclient(hunting): _renew_subs 2024-09-12T17:35:51.675 INFO:tasks.workunit.client.0.smithi037.stderr: -349> 2024-09-12T17:35:51.388+0000 7f8e4332e800 10 monclient(hunting): authenticate will time out at 2338.986704s 2024-09-12T17:35:51.675 INFO:tasks.workunit.client.0.smithi037.stderr: -348> 2024-09-12T17:35:51.388+0000 7f8e3e76a640 10 monclient(hunting): get_auth_request con 0x560578ed1de0 auth_method 0 2024-09-12T17:35:51.675 INFO:tasks.workunit.client.0.smithi037.stderr: -347> 2024-09-12T17:35:51.388+0000 7f8e3e76a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:35:51.675 INFO:tasks.workunit.client.0.smithi037.stderr: -346> 2024-09-12T17:35:51.388+0000 7f8e3e76a640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:35:51.675 INFO:tasks.workunit.client.0.smithi037.stderr: -345> 2024-09-12T17:35:51.388+0000 7f8e3e76a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:35:51.676 INFO:tasks.workunit.client.0.smithi037.stderr: -344> 2024-09-12T17:35:51.388+0000 7f8e3f76c640 10 monclient(hunting): get_auth_request con 0x560578ece2e0 auth_method 0 2024-09-12T17:35:51.676 INFO:tasks.workunit.client.0.smithi037.stderr: -343> 2024-09-12T17:35:51.388+0000 7f8e3f76c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:35:51.676 INFO:tasks.workunit.client.0.smithi037.stderr: -342> 2024-09-12T17:35:51.388+0000 7f8e3f76c640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:35:51.676 INFO:tasks.workunit.client.0.smithi037.stderr: -341> 2024-09-12T17:35:51.388+0000 7f8e3f76c640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:35:51.676 INFO:tasks.workunit.client.0.smithi037.stderr: -340> 2024-09-12T17:35:51.388+0000 7f8e3e76a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:35:51.676 INFO:tasks.workunit.client.0.smithi037.stderr: -339> 2024-09-12T17:35:51.388+0000 7f8e3e76a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:35:51.676 INFO:tasks.workunit.client.0.smithi037.stderr: -338> 2024-09-12T17:35:51.388+0000 7f8e3e76a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:35:51.676 INFO:tasks.workunit.client.0.smithi037.stderr: -337> 2024-09-12T17:35:51.388+0000 7f8e3ef6b640 10 monclient(hunting): get_auth_request con 0x560578ecfb10 auth_method 0 2024-09-12T17:35:51.676 INFO:tasks.workunit.client.0.smithi037.stderr: -336> 2024-09-12T17:35:51.388+0000 7f8e3ef6b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:35:51.676 INFO:tasks.workunit.client.0.smithi037.stderr: -335> 2024-09-12T17:35:51.388+0000 7f8e3ef6b640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:35:51.676 INFO:tasks.workunit.client.0.smithi037.stderr: -334> 2024-09-12T17:35:51.388+0000 7f8e3ef6b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:35:51.676 INFO:tasks.workunit.client.0.smithi037.stderr: -333> 2024-09-12T17:35:51.388+0000 7f8e3f76c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:35:51.676 INFO:tasks.workunit.client.0.smithi037.stderr: -332> 2024-09-12T17:35:51.388+0000 7f8e3f76c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:35:51.676 INFO:tasks.workunit.client.0.smithi037.stderr: -331> 2024-09-12T17:35:51.388+0000 7f8e3f76c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:35:51.677 INFO:tasks.workunit.client.0.smithi037.stderr: -330> 2024-09-12T17:35:51.388+0000 7f8e3ef6b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:35:51.677 INFO:tasks.workunit.client.0.smithi037.stderr: -329> 2024-09-12T17:35:51.389+0000 7f8e3ef6b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:35:51.677 INFO:tasks.workunit.client.0.smithi037.stderr: -328> 2024-09-12T17:35:51.389+0000 7f8e3ef6b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:35:51.677 INFO:tasks.workunit.client.0.smithi037.stderr: -327> 2024-09-12T17:35:51.389+0000 7f8e3e76a640 10 monclient(hunting): handle_auth_done global_id 7761 payload 824 2024-09-12T17:35:51.677 INFO:tasks.workunit.client.0.smithi037.stderr: -326> 2024-09-12T17:35:51.389+0000 7f8e3e76a640 10 monclient: _finish_hunting 0 2024-09-12T17:35:51.677 INFO:tasks.workunit.client.0.smithi037.stderr: -325> 2024-09-12T17:35:51.389+0000 7f8e3e76a640 1 monclient: found mon.noname-a 2024-09-12T17:35:51.677 INFO:tasks.workunit.client.0.smithi037.stderr: -324> 2024-09-12T17:35:51.389+0000 7f8e3e76a640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.37:3300/0 2024-09-12T17:35:51.677 INFO:tasks.workunit.client.0.smithi037.stderr: -323> 2024-09-12T17:35:51.389+0000 7f8d28e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:35:51.677 INFO:tasks.workunit.client.0.smithi037.stderr: -322> 2024-09-12T17:35:51.389+0000 7f8d28e01640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:35:51.677 INFO:tasks.workunit.client.0.smithi037.stderr: -321> 2024-09-12T17:35:51.389+0000 7f8d28e01640 10 monclient: dump: 2024-09-12T17:35:51.677 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:35:51.677 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:35:51.677 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:35:51.678 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:35:51.678 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:35:51.678 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:35:51.678 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:35:51.678 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:35:51.678 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:35:51.678 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:35:51.678 INFO:tasks.workunit.client.0.smithi037.stderr: -320> 2024-09-12T17:35:51.389+0000 7f8d28e01640 10 monclient: _finish_auth 0 2024-09-12T17:35:51.678 INFO:tasks.workunit.client.0.smithi037.stderr: -319> 2024-09-12T17:35:51.389+0000 7f8d28e01640 10 monclient: _check_auth_tickets 2024-09-12T17:35:51.678 INFO:tasks.workunit.client.0.smithi037.stderr: -318> 2024-09-12T17:35:51.389+0000 7f8d28e01640 10 monclient: handle_config config(0 keys) 2024-09-12T17:35:51.678 INFO:tasks.workunit.client.0.smithi037.stderr: -317> 2024-09-12T17:35:51.389+0000 7f8d28e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:35:51.678 INFO:tasks.workunit.client.0.smithi037.stderr: -316> 2024-09-12T17:35:51.389+0000 7f8d28e01640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:35:51.678 INFO:tasks.workunit.client.0.smithi037.stderr: -315> 2024-09-12T17:35:51.389+0000 7f8d28e01640 10 monclient: dump: 2024-09-12T17:35:51.678 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:35:51.679 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:35:51.679 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:35:51.679 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:35:51.679 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:35:51.679 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:35:51.679 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:35:51.679 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:35:51.679 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:35:51.679 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:35:51.679 INFO:tasks.workunit.client.0.smithi037.stderr: -314> 2024-09-12T17:35:51.389+0000 7f8e4332e800 5 monclient: authenticate success, global_id 7761 2024-09-12T17:35:51.679 INFO:tasks.workunit.client.0.smithi037.stderr: -313> 2024-09-12T17:35:51.389+0000 7f8e4332e800 10 monclient: _renew_subs 2024-09-12T17:35:51.679 INFO:tasks.workunit.client.0.smithi037.stderr: -312> 2024-09-12T17:35:51.389+0000 7f8e4332e800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.37:3300/0 2024-09-12T17:35:51.679 INFO:tasks.workunit.client.0.smithi037.stderr: -311> 2024-09-12T17:35:51.389+0000 7f8e3ff6d640 4 set_mon_vals no callback set 2024-09-12T17:35:51.680 INFO:tasks.workunit.client.0.smithi037.stderr: -310> 2024-09-12T17:35:51.389+0000 7f8e4332e800 10 monclient: _renew_subs 2024-09-12T17:35:51.680 INFO:tasks.workunit.client.0.smithi037.stderr: -309> 2024-09-12T17:35:51.389+0000 7f8e4332e800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.37:3300/0 2024-09-12T17:35:51.680 INFO:tasks.workunit.client.0.smithi037.stderr: -308> 2024-09-12T17:35:51.391+0000 7f8d28e01640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:35:51.680 INFO:tasks.workunit.client.0.smithi037.stderr: -307> 2024-09-12T17:35:51.391+0000 7f8d28e01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.40:6816/3916250676,v1:172.21.15.40:6817/3916250676] 2024-09-12T17:35:51.680 INFO:tasks.workunit.client.0.smithi037.stderr: -306> 2024-09-12T17:35:51.391+0000 7f8d28e01640 4 mgrc reconnect Starting new session with [v2:172.21.15.40:6816/3916250676,v1:172.21.15.40:6817/3916250676] 2024-09-12T17:35:51.680 INFO:tasks.workunit.client.0.smithi037.stderr: -305> 2024-09-12T17:35:51.391+0000 7f8e3ef6b640 10 monclient: get_auth_request con 0x7f8d18076380 auth_method 0 2024-09-12T17:35:51.680 INFO:tasks.workunit.client.0.smithi037.stderr: -304> 2024-09-12T17:35:51.391+0000 7f8e4332e800 10 monclient: get_monmap_and_config 2024-09-12T17:35:51.680 INFO:tasks.workunit.client.0.smithi037.stderr: -303> 2024-09-12T17:35:51.391+0000 7f8e4332e800 10 monclient: build_initial_monmap 2024-09-12T17:35:51.680 INFO:tasks.workunit.client.0.smithi037.stderr: -302> 2024-09-12T17:35:51.391+0000 7f8e4332e800 1 build_initial for_mkfs: 0 2024-09-12T17:35:51.680 INFO:tasks.workunit.client.0.smithi037.stderr: -301> 2024-09-12T17:35:51.391+0000 7f8e4332e800 10 monclient: monmap: 2024-09-12T17:35:51.680 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 0 2024-09-12T17:35:51.680 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:35:51.680 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 0.000000 2024-09-12T17:35:51.681 INFO:tasks.workunit.client.0.smithi037.stderr:created 0.000000 2024-09-12T17:35:51.681 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 0 (unknown) 2024-09-12T17:35:51.681 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:35:51.681 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.noname-a 2024-09-12T17:35:51.681 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.noname-b 2024-09-12T17:35:51.681 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.noname-c 2024-09-12T17:35:51.681 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:35:51.681 INFO:tasks.workunit.client.0.smithi037.stderr: -300> 2024-09-12T17:35:51.391+0000 7f8e4332e800 5 AuthRegistry(0x560578eef650) adding auth protocol: cephx 2024-09-12T17:35:51.681 INFO:tasks.workunit.client.0.smithi037.stderr: -299> 2024-09-12T17:35:51.391+0000 7f8e4332e800 5 AuthRegistry(0x560578eef650) adding auth protocol: cephx 2024-09-12T17:35:51.681 INFO:tasks.workunit.client.0.smithi037.stderr: -298> 2024-09-12T17:35:51.391+0000 7f8e4332e800 5 AuthRegistry(0x560578eef650) adding auth protocol: cephx 2024-09-12T17:35:51.681 INFO:tasks.workunit.client.0.smithi037.stderr: -297> 2024-09-12T17:35:51.391+0000 7f8e4332e800 5 AuthRegistry(0x560578eef650) adding con mode: secure 2024-09-12T17:35:51.681 INFO:tasks.workunit.client.0.smithi037.stderr: -296> 2024-09-12T17:35:51.391+0000 7f8e4332e800 5 AuthRegistry(0x560578eef650) adding con mode: crc 2024-09-12T17:35:51.681 INFO:tasks.workunit.client.0.smithi037.stderr: -295> 2024-09-12T17:35:51.391+0000 7f8e4332e800 5 AuthRegistry(0x560578eef650) adding con mode: secure 2024-09-12T17:35:51.681 INFO:tasks.workunit.client.0.smithi037.stderr: -294> 2024-09-12T17:35:51.391+0000 7f8e4332e800 5 AuthRegistry(0x560578eef650) adding con mode: crc 2024-09-12T17:35:51.682 INFO:tasks.workunit.client.0.smithi037.stderr: -293> 2024-09-12T17:35:51.391+0000 7f8e4332e800 5 AuthRegistry(0x560578eef650) adding con mode: secure 2024-09-12T17:35:51.682 INFO:tasks.workunit.client.0.smithi037.stderr: -292> 2024-09-12T17:35:51.391+0000 7f8e4332e800 5 AuthRegistry(0x560578eef650) adding con mode: crc 2024-09-12T17:35:51.682 INFO:tasks.workunit.client.0.smithi037.stderr: -291> 2024-09-12T17:35:51.391+0000 7f8e4332e800 5 AuthRegistry(0x560578eef650) adding con mode: crc 2024-09-12T17:35:51.682 INFO:tasks.workunit.client.0.smithi037.stderr: -290> 2024-09-12T17:35:51.391+0000 7f8e4332e800 5 AuthRegistry(0x560578eef650) adding con mode: secure 2024-09-12T17:35:51.682 INFO:tasks.workunit.client.0.smithi037.stderr: -289> 2024-09-12T17:35:51.391+0000 7f8e4332e800 5 AuthRegistry(0x560578eef650) adding con mode: crc 2024-09-12T17:35:51.682 INFO:tasks.workunit.client.0.smithi037.stderr: -288> 2024-09-12T17:35:51.391+0000 7f8e4332e800 5 AuthRegistry(0x560578eef650) adding con mode: secure 2024-09-12T17:35:51.682 INFO:tasks.workunit.client.0.smithi037.stderr: -287> 2024-09-12T17:35:51.391+0000 7f8e4332e800 5 AuthRegistry(0x560578eef650) adding con mode: crc 2024-09-12T17:35:51.682 INFO:tasks.workunit.client.0.smithi037.stderr: -286> 2024-09-12T17:35:51.391+0000 7f8e4332e800 5 AuthRegistry(0x560578eef650) adding con mode: secure 2024-09-12T17:35:51.682 INFO:tasks.workunit.client.0.smithi037.stderr: -285> 2024-09-12T17:35:51.391+0000 7f8e4332e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:35:51.682 INFO:tasks.workunit.client.0.smithi037.stderr: -284> 2024-09-12T17:35:51.392+0000 7f8e4332e800 10 monclient: init 2024-09-12T17:35:51.682 INFO:tasks.workunit.client.0.smithi037.stderr: -283> 2024-09-12T17:35:51.392+0000 7f8e4332e800 5 AuthRegistry(0x7ffef27ad510) adding auth protocol: cephx 2024-09-12T17:35:51.682 INFO:tasks.workunit.client.0.smithi037.stderr: -282> 2024-09-12T17:35:51.392+0000 7f8e4332e800 5 AuthRegistry(0x7ffef27ad510) adding auth protocol: cephx 2024-09-12T17:35:51.682 INFO:tasks.workunit.client.0.smithi037.stderr: -281> 2024-09-12T17:35:51.392+0000 7f8e4332e800 5 AuthRegistry(0x7ffef27ad510) adding auth protocol: cephx 2024-09-12T17:35:51.682 INFO:tasks.workunit.client.0.smithi037.stderr: -280> 2024-09-12T17:35:51.392+0000 7f8e4332e800 5 AuthRegistry(0x7ffef27ad510) adding con mode: secure 2024-09-12T17:35:51.683 INFO:tasks.workunit.client.0.smithi037.stderr: -279> 2024-09-12T17:35:51.392+0000 7f8e4332e800 5 AuthRegistry(0x7ffef27ad510) adding con mode: crc 2024-09-12T17:35:51.683 INFO:tasks.workunit.client.0.smithi037.stderr: -278> 2024-09-12T17:35:51.392+0000 7f8e4332e800 5 AuthRegistry(0x7ffef27ad510) adding con mode: secure 2024-09-12T17:35:51.683 INFO:tasks.workunit.client.0.smithi037.stderr: -277> 2024-09-12T17:35:51.392+0000 7f8e4332e800 5 AuthRegistry(0x7ffef27ad510) adding con mode: crc 2024-09-12T17:35:51.683 INFO:tasks.workunit.client.0.smithi037.stderr: -276> 2024-09-12T17:35:51.392+0000 7f8e4332e800 5 AuthRegistry(0x7ffef27ad510) adding con mode: secure 2024-09-12T17:35:51.683 INFO:tasks.workunit.client.0.smithi037.stderr: -275> 2024-09-12T17:35:51.392+0000 7f8e4332e800 5 AuthRegistry(0x7ffef27ad510) adding con mode: crc 2024-09-12T17:35:51.683 INFO:tasks.workunit.client.0.smithi037.stderr: -274> 2024-09-12T17:35:51.392+0000 7f8e4332e800 5 AuthRegistry(0x7ffef27ad510) adding con mode: crc 2024-09-12T17:35:51.683 INFO:tasks.workunit.client.0.smithi037.stderr: -273> 2024-09-12T17:35:51.392+0000 7f8e4332e800 5 AuthRegistry(0x7ffef27ad510) adding con mode: secure 2024-09-12T17:35:51.683 INFO:tasks.workunit.client.0.smithi037.stderr: -272> 2024-09-12T17:35:51.392+0000 7f8e4332e800 5 AuthRegistry(0x7ffef27ad510) adding con mode: crc 2024-09-12T17:35:51.683 INFO:tasks.workunit.client.0.smithi037.stderr: -271> 2024-09-12T17:35:51.392+0000 7f8e4332e800 5 AuthRegistry(0x7ffef27ad510) adding con mode: secure 2024-09-12T17:35:51.683 INFO:tasks.workunit.client.0.smithi037.stderr: -270> 2024-09-12T17:35:51.392+0000 7f8e4332e800 5 AuthRegistry(0x7ffef27ad510) adding con mode: crc 2024-09-12T17:35:51.683 INFO:tasks.workunit.client.0.smithi037.stderr: -269> 2024-09-12T17:35:51.392+0000 7f8e4332e800 5 AuthRegistry(0x7ffef27ad510) adding con mode: secure 2024-09-12T17:35:51.683 INFO:tasks.workunit.client.0.smithi037.stderr: -268> 2024-09-12T17:35:51.392+0000 7f8e4332e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:35:51.683 INFO:tasks.workunit.client.0.smithi037.stderr: -267> 2024-09-12T17:35:51.392+0000 7f8e4332e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:35:51.684 INFO:tasks.workunit.client.0.smithi037.stderr: -266> 2024-09-12T17:35:51.392+0000 7f8e4332e800 5 asok(0x560578c32730) register_command rotate-key cmddesc rotate-key hook 0x7ffef27ad658 EEXIST 2024-09-12T17:35:51.684 INFO:tasks.workunit.client.0.smithi037.stderr: -265> 2024-09-12T17:35:51.392+0000 7f8e4332e800 10 monclient: _reopen_session rank -1 2024-09-12T17:35:51.684 INFO:tasks.workunit.client.0.smithi037.stderr: -264> 2024-09-12T17:35:51.392+0000 7f8e4332e800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T17:35:51.684 INFO:tasks.workunit.client.0.smithi037.stderr: -263> 2024-09-12T17:35:51.392+0000 7f8e4332e800 10 monclient(hunting): picked mon.noname-c con 0x560578f23cf0 addr [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] 2024-09-12T17:35:51.684 INFO:tasks.workunit.client.0.smithi037.stderr: -262> 2024-09-12T17:35:51.392+0000 7f8e4332e800 10 monclient(hunting): picked mon.noname-b con 0x560578ef4c40 addr [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] 2024-09-12T17:35:51.684 INFO:tasks.workunit.client.0.smithi037.stderr: -261> 2024-09-12T17:35:51.392+0000 7f8e4332e800 10 monclient(hunting): picked mon.noname-a con 0x560578f1f590 addr [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] 2024-09-12T17:35:51.684 INFO:tasks.workunit.client.0.smithi037.stderr: -260> 2024-09-12T17:35:51.392+0000 7f8e4332e800 10 monclient(hunting): start opening mon connection 2024-09-12T17:35:51.684 INFO:tasks.workunit.client.0.smithi037.stderr: -259> 2024-09-12T17:35:51.392+0000 7f8e4332e800 10 monclient(hunting): start opening mon connection 2024-09-12T17:35:51.684 INFO:tasks.workunit.client.0.smithi037.stderr: -258> 2024-09-12T17:35:51.392+0000 7f8e4332e800 10 monclient(hunting): start opening mon connection 2024-09-12T17:35:51.684 INFO:tasks.workunit.client.0.smithi037.stderr: -257> 2024-09-12T17:35:51.392+0000 7f8e4332e800 10 monclient(hunting): _renew_subs 2024-09-12T17:35:51.684 INFO:tasks.workunit.client.0.smithi037.stderr: -256> 2024-09-12T17:35:51.392+0000 7f8e4332e800 10 monclient(hunting): authenticate will time out at 2338.990637s 2024-09-12T17:35:51.684 INFO:tasks.workunit.client.0.smithi037.stderr: -255> 2024-09-12T17:35:51.392+0000 7f8e3ef6b640 10 monclient(hunting): get_auth_request con 0x560578f23cf0 auth_method 0 2024-09-12T17:35:51.684 INFO:tasks.workunit.client.0.smithi037.stderr: -254> 2024-09-12T17:35:51.392+0000 7f8e3ef6b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:35:51.684 INFO:tasks.workunit.client.0.smithi037.stderr: -253> 2024-09-12T17:35:51.392+0000 7f8e3ef6b640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:35:51.685 INFO:tasks.workunit.client.0.smithi037.stderr: -252> 2024-09-12T17:35:51.392+0000 7f8e3ef6b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:35:51.685 INFO:tasks.workunit.client.0.smithi037.stderr: -251> 2024-09-12T17:35:51.392+0000 7f8e3f76c640 10 monclient(hunting): get_auth_request con 0x560578f1f590 auth_method 0 2024-09-12T17:35:51.685 INFO:tasks.workunit.client.0.smithi037.stderr: -250> 2024-09-12T17:35:51.392+0000 7f8e3f76c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:35:51.685 INFO:tasks.workunit.client.0.smithi037.stderr: -249> 2024-09-12T17:35:51.392+0000 7f8e3f76c640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:35:51.685 INFO:tasks.workunit.client.0.smithi037.stderr: -248> 2024-09-12T17:35:51.392+0000 7f8e3f76c640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:35:51.685 INFO:tasks.workunit.client.0.smithi037.stderr: -247> 2024-09-12T17:35:51.392+0000 7f8e3ef6b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:35:51.685 INFO:tasks.workunit.client.0.smithi037.stderr: -246> 2024-09-12T17:35:51.392+0000 7f8e3ef6b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:35:51.685 INFO:tasks.workunit.client.0.smithi037.stderr: -245> 2024-09-12T17:35:51.392+0000 7f8e3ef6b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:35:51.685 INFO:tasks.workunit.client.0.smithi037.stderr: -244> 2024-09-12T17:35:51.392+0000 7f8e3f76c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:35:51.686 INFO:tasks.workunit.client.0.smithi037.stderr: -243> 2024-09-12T17:35:51.392+0000 7f8e3f76c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:35:51.686 INFO:tasks.workunit.client.0.smithi037.stderr: -242> 2024-09-12T17:35:51.392+0000 7f8e3f76c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:35:51.686 INFO:tasks.workunit.client.0.smithi037.stderr: -241> 2024-09-12T17:35:51.392+0000 7f8e3e76a640 10 monclient(hunting): get_auth_request con 0x560578ef4c40 auth_method 0 2024-09-12T17:35:51.686 INFO:tasks.workunit.client.0.smithi037.stderr: -240> 2024-09-12T17:35:51.392+0000 7f8e3e76a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:35:51.686 INFO:tasks.workunit.client.0.smithi037.stderr: -239> 2024-09-12T17:35:51.392+0000 7f8e3e76a640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:35:51.686 INFO:tasks.workunit.client.0.smithi037.stderr: -238> 2024-09-12T17:35:51.392+0000 7f8e3e76a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:35:51.686 INFO:tasks.workunit.client.0.smithi037.stderr: -237> 2024-09-12T17:35:51.392+0000 7f8e3ef6b640 10 monclient(hunting): handle_auth_done global_id 7268 payload 274 2024-09-12T17:35:51.686 INFO:tasks.workunit.client.0.smithi037.stderr: -236> 2024-09-12T17:35:51.392+0000 7f8e3ef6b640 10 monclient: _finish_hunting 0 2024-09-12T17:35:51.686 INFO:tasks.workunit.client.0.smithi037.stderr: -235> 2024-09-12T17:35:51.392+0000 7f8e3ef6b640 1 monclient: found mon.noname-c 2024-09-12T17:35:51.686 INFO:tasks.workunit.client.0.smithi037.stderr: -234> 2024-09-12T17:35:51.392+0000 7f8e3ef6b640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.37:3301/0 2024-09-12T17:35:51.686 INFO:tasks.workunit.client.0.smithi037.stderr: -233> 2024-09-12T17:35:51.393+0000 7f8d227fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:35:51.686 INFO:tasks.workunit.client.0.smithi037.stderr: -232> 2024-09-12T17:35:51.393+0000 7f8d227fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:35:51.686 INFO:tasks.workunit.client.0.smithi037.stderr: -231> 2024-09-12T17:35:51.393+0000 7f8d227fc640 10 monclient: dump: 2024-09-12T17:35:51.686 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:35:51.687 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:35:51.687 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:35:51.687 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:35:51.687 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:35:51.687 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:35:51.687 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:35:51.687 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:35:51.687 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:35:51.687 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:35:51.687 INFO:tasks.workunit.client.0.smithi037.stderr: -230> 2024-09-12T17:35:51.393+0000 7f8d227fc640 10 monclient: _finish_auth 0 2024-09-12T17:35:51.687 INFO:tasks.workunit.client.0.smithi037.stderr: -229> 2024-09-12T17:35:51.393+0000 7f8d227fc640 10 monclient: _check_auth_tickets 2024-09-12T17:35:51.687 INFO:tasks.workunit.client.0.smithi037.stderr: -228> 2024-09-12T17:35:51.393+0000 7f8d227fc640 10 monclient: handle_config config(0 keys) 2024-09-12T17:35:51.687 INFO:tasks.workunit.client.0.smithi037.stderr: -227> 2024-09-12T17:35:51.393+0000 7f8d227fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:35:51.688 INFO:tasks.workunit.client.0.smithi037.stderr: -226> 2024-09-12T17:35:51.393+0000 7f8d227fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:35:51.688 INFO:tasks.workunit.client.0.smithi037.stderr: -225> 2024-09-12T17:35:51.393+0000 7f8d227fc640 10 monclient: dump: 2024-09-12T17:35:51.688 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:35:51.688 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:35:51.688 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:35:51.688 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:35:51.688 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:35:51.688 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:35:51.688 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:35:51.688 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:35:51.688 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:35:51.688 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:35:51.688 INFO:tasks.workunit.client.0.smithi037.stderr: -224> 2024-09-12T17:35:51.393+0000 7f8e4332e800 5 monclient: authenticate success, global_id 7268 2024-09-12T17:35:51.689 INFO:tasks.workunit.client.0.smithi037.stderr: -223> 2024-09-12T17:35:51.393+0000 7f8e4332e800 10 monclient: get_monmap_and_config success 2024-09-12T17:35:51.689 INFO:tasks.workunit.client.0.smithi037.stderr: -222> 2024-09-12T17:35:51.393+0000 7f8e4332e800 4 set_mon_vals no callback set 2024-09-12T17:35:51.689 INFO:tasks.workunit.client.0.smithi037.stderr: -221> 2024-09-12T17:35:51.393+0000 7f8e4332e800 10 monclient: shutdown 2024-09-12T17:35:51.689 INFO:tasks.workunit.client.0.smithi037.stderr: -220> 2024-09-12T17:35:51.393+0000 7f8e4332e800 10 monclient: build_initial_monmap 2024-09-12T17:35:51.689 INFO:tasks.workunit.client.0.smithi037.stderr: -219> 2024-09-12T17:35:51.393+0000 7f8e4332e800 1 build_initial for_mkfs: 0 2024-09-12T17:35:51.689 INFO:tasks.workunit.client.0.smithi037.stderr: -218> 2024-09-12T17:35:51.393+0000 7f8e4332e800 10 monclient: monmap: 2024-09-12T17:35:51.689 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 0 2024-09-12T17:35:51.689 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:35:51.689 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 0.000000 2024-09-12T17:35:51.689 INFO:tasks.workunit.client.0.smithi037.stderr:created 0.000000 2024-09-12T17:35:51.689 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 0 (unknown) 2024-09-12T17:35:51.689 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:35:51.689 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.noname-a 2024-09-12T17:35:51.689 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.noname-b 2024-09-12T17:35:51.690 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.noname-c 2024-09-12T17:35:51.690 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:35:51.690 INFO:tasks.workunit.client.0.smithi037.stderr: -217> 2024-09-12T17:35:51.394+0000 7f8e4332e800 5 AuthRegistry(0x560578f161e0) adding auth protocol: cephx 2024-09-12T17:35:51.690 INFO:tasks.workunit.client.0.smithi037.stderr: -216> 2024-09-12T17:35:51.394+0000 7f8e4332e800 5 AuthRegistry(0x560578f161e0) adding auth protocol: cephx 2024-09-12T17:35:51.690 INFO:tasks.workunit.client.0.smithi037.stderr: -215> 2024-09-12T17:35:51.394+0000 7f8e4332e800 5 AuthRegistry(0x560578f161e0) adding auth protocol: cephx 2024-09-12T17:35:51.690 INFO:tasks.workunit.client.0.smithi037.stderr: -214> 2024-09-12T17:35:51.394+0000 7f8e4332e800 5 AuthRegistry(0x560578f161e0) adding con mode: secure 2024-09-12T17:35:51.690 INFO:tasks.workunit.client.0.smithi037.stderr: -213> 2024-09-12T17:35:51.394+0000 7f8e4332e800 5 AuthRegistry(0x560578f161e0) adding con mode: crc 2024-09-12T17:35:51.690 INFO:tasks.workunit.client.0.smithi037.stderr: -212> 2024-09-12T17:35:51.394+0000 7f8e4332e800 5 AuthRegistry(0x560578f161e0) adding con mode: secure 2024-09-12T17:35:51.690 INFO:tasks.workunit.client.0.smithi037.stderr: -211> 2024-09-12T17:35:51.394+0000 7f8e4332e800 5 AuthRegistry(0x560578f161e0) adding con mode: crc 2024-09-12T17:35:51.690 INFO:tasks.workunit.client.0.smithi037.stderr: -210> 2024-09-12T17:35:51.394+0000 7f8e4332e800 5 AuthRegistry(0x560578f161e0) adding con mode: secure 2024-09-12T17:35:51.690 INFO:tasks.workunit.client.0.smithi037.stderr: -209> 2024-09-12T17:35:51.394+0000 7f8e4332e800 5 AuthRegistry(0x560578f161e0) adding con mode: crc 2024-09-12T17:35:51.690 INFO:tasks.workunit.client.0.smithi037.stderr: -208> 2024-09-12T17:35:51.394+0000 7f8e4332e800 5 AuthRegistry(0x560578f161e0) adding con mode: crc 2024-09-12T17:35:51.690 INFO:tasks.workunit.client.0.smithi037.stderr: -207> 2024-09-12T17:35:51.394+0000 7f8e4332e800 5 AuthRegistry(0x560578f161e0) adding con mode: secure 2024-09-12T17:35:51.690 INFO:tasks.workunit.client.0.smithi037.stderr: -206> 2024-09-12T17:35:51.394+0000 7f8e4332e800 5 AuthRegistry(0x560578f161e0) adding con mode: crc 2024-09-12T17:35:51.691 INFO:tasks.workunit.client.0.smithi037.stderr: -205> 2024-09-12T17:35:51.394+0000 7f8e4332e800 5 AuthRegistry(0x560578f161e0) adding con mode: secure 2024-09-12T17:35:51.691 INFO:tasks.workunit.client.0.smithi037.stderr: -204> 2024-09-12T17:35:51.394+0000 7f8e4332e800 5 AuthRegistry(0x560578f161e0) adding con mode: crc 2024-09-12T17:35:51.691 INFO:tasks.workunit.client.0.smithi037.stderr: -203> 2024-09-12T17:35:51.394+0000 7f8e4332e800 5 AuthRegistry(0x560578f161e0) adding con mode: secure 2024-09-12T17:35:51.691 INFO:tasks.workunit.client.0.smithi037.stderr: -202> 2024-09-12T17:35:51.394+0000 7f8e4332e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:35:51.691 INFO:tasks.workunit.client.0.smithi037.stderr: -201> 2024-09-12T17:35:51.394+0000 7f8e4332e800 1 librados: starting msgr at 2024-09-12T17:35:51.691 INFO:tasks.workunit.client.0.smithi037.stderr: -200> 2024-09-12T17:35:51.394+0000 7f8e4332e800 1 librados: starting objecter 2024-09-12T17:35:51.691 INFO:tasks.workunit.client.0.smithi037.stderr: -199> 2024-09-12T17:35:51.394+0000 7f8e4332e800 5 asok(0x560578c32730) register_command objecter_requests cmddesc objecter_requests hook 0x560578f1e360 EEXIST 2024-09-12T17:35:51.691 INFO:tasks.workunit.client.0.smithi037.stderr: -198> 2024-09-12T17:35:51.394+0000 7f8e4332e800 1 librados: setting wanted keys 2024-09-12T17:35:51.691 INFO:tasks.workunit.client.0.smithi037.stderr: -197> 2024-09-12T17:35:51.394+0000 7f8e4332e800 1 librados: calling monclient init 2024-09-12T17:35:51.691 INFO:tasks.workunit.client.0.smithi037.stderr: -196> 2024-09-12T17:35:51.394+0000 7f8e4332e800 10 monclient: init 2024-09-12T17:35:51.691 INFO:tasks.workunit.client.0.smithi037.stderr: -195> 2024-09-12T17:35:51.394+0000 7f8e4332e800 5 AuthRegistry(0x560578ee78c0) adding auth protocol: cephx 2024-09-12T17:35:51.691 INFO:tasks.workunit.client.0.smithi037.stderr: -194> 2024-09-12T17:35:51.394+0000 7f8e4332e800 5 AuthRegistry(0x560578ee78c0) adding auth protocol: cephx 2024-09-12T17:35:51.691 INFO:tasks.workunit.client.0.smithi037.stderr: -193> 2024-09-12T17:35:51.394+0000 7f8e4332e800 5 AuthRegistry(0x560578ee78c0) adding auth protocol: cephx 2024-09-12T17:35:51.691 INFO:tasks.workunit.client.0.smithi037.stderr: -192> 2024-09-12T17:35:51.394+0000 7f8e4332e800 5 AuthRegistry(0x560578ee78c0) adding con mode: secure 2024-09-12T17:35:51.692 INFO:tasks.workunit.client.0.smithi037.stderr: -191> 2024-09-12T17:35:51.394+0000 7f8e4332e800 5 AuthRegistry(0x560578ee78c0) adding con mode: crc 2024-09-12T17:35:51.692 INFO:tasks.workunit.client.0.smithi037.stderr: -190> 2024-09-12T17:35:51.394+0000 7f8e4332e800 5 AuthRegistry(0x560578ee78c0) adding con mode: secure 2024-09-12T17:35:51.692 INFO:tasks.workunit.client.0.smithi037.stderr: -189> 2024-09-12T17:35:51.394+0000 7f8e4332e800 5 AuthRegistry(0x560578ee78c0) adding con mode: crc 2024-09-12T17:35:51.692 INFO:tasks.workunit.client.0.smithi037.stderr: -188> 2024-09-12T17:35:51.394+0000 7f8e4332e800 5 AuthRegistry(0x560578ee78c0) adding con mode: secure 2024-09-12T17:35:51.692 INFO:tasks.workunit.client.0.smithi037.stderr: -187> 2024-09-12T17:35:51.394+0000 7f8e4332e800 5 AuthRegistry(0x560578ee78c0) adding con mode: crc 2024-09-12T17:35:51.692 INFO:tasks.workunit.client.0.smithi037.stderr: -186> 2024-09-12T17:35:51.394+0000 7f8e4332e800 5 AuthRegistry(0x560578ee78c0) adding con mode: crc 2024-09-12T17:35:51.692 INFO:tasks.workunit.client.0.smithi037.stderr: -185> 2024-09-12T17:35:51.394+0000 7f8e4332e800 5 AuthRegistry(0x560578ee78c0) adding con mode: secure 2024-09-12T17:35:51.692 INFO:tasks.workunit.client.0.smithi037.stderr: -184> 2024-09-12T17:35:51.394+0000 7f8e4332e800 5 AuthRegistry(0x560578ee78c0) adding con mode: crc 2024-09-12T17:35:51.692 INFO:tasks.workunit.client.0.smithi037.stderr: -183> 2024-09-12T17:35:51.394+0000 7f8e4332e800 5 AuthRegistry(0x560578ee78c0) adding con mode: secure 2024-09-12T17:35:51.692 INFO:tasks.workunit.client.0.smithi037.stderr: -182> 2024-09-12T17:35:51.394+0000 7f8e4332e800 5 AuthRegistry(0x560578ee78c0) adding con mode: crc 2024-09-12T17:35:51.692 INFO:tasks.workunit.client.0.smithi037.stderr: -181> 2024-09-12T17:35:51.394+0000 7f8e4332e800 5 AuthRegistry(0x560578ee78c0) adding con mode: secure 2024-09-12T17:35:51.692 INFO:tasks.workunit.client.0.smithi037.stderr: -180> 2024-09-12T17:35:51.394+0000 7f8e4332e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:35:51.692 INFO:tasks.workunit.client.0.smithi037.stderr: -179> 2024-09-12T17:35:51.394+0000 7f8e4332e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:35:51.693 INFO:tasks.workunit.client.0.smithi037.stderr: -178> 2024-09-12T17:35:51.394+0000 7f8e4332e800 5 asok(0x560578c32730) register_command rotate-key cmddesc rotate-key hook 0x560578ee7a08 EEXIST 2024-09-12T17:35:51.693 INFO:tasks.workunit.client.0.smithi037.stderr: -177> 2024-09-12T17:35:51.394+0000 7f8e4332e800 10 monclient: _reopen_session rank -1 2024-09-12T17:35:51.693 INFO:tasks.workunit.client.0.smithi037.stderr: -176> 2024-09-12T17:35:51.394+0000 7f8e4332e800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T17:35:51.693 INFO:tasks.workunit.client.0.smithi037.stderr: -175> 2024-09-12T17:35:51.394+0000 7f8e4332e800 10 monclient(hunting): picked mon.noname-b con 0x560578ef4c40 addr [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] 2024-09-12T17:35:51.693 INFO:tasks.workunit.client.0.smithi037.stderr: -174> 2024-09-12T17:35:51.394+0000 7f8e4332e800 10 monclient(hunting): picked mon.noname-a con 0x560578f1f590 addr [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] 2024-09-12T17:35:51.693 INFO:tasks.workunit.client.0.smithi037.stderr: -173> 2024-09-12T17:35:51.394+0000 7f8e4332e800 10 monclient(hunting): picked mon.noname-c con 0x560578f23cf0 addr [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] 2024-09-12T17:35:51.693 INFO:tasks.workunit.client.0.smithi037.stderr: -172> 2024-09-12T17:35:51.394+0000 7f8e4332e800 10 monclient(hunting): start opening mon connection 2024-09-12T17:35:51.693 INFO:tasks.workunit.client.0.smithi037.stderr: -171> 2024-09-12T17:35:51.394+0000 7f8e4332e800 10 monclient(hunting): start opening mon connection 2024-09-12T17:35:51.693 INFO:tasks.workunit.client.0.smithi037.stderr: -170> 2024-09-12T17:35:51.394+0000 7f8e4332e800 10 monclient(hunting): start opening mon connection 2024-09-12T17:35:51.693 INFO:tasks.workunit.client.0.smithi037.stderr: -169> 2024-09-12T17:35:51.394+0000 7f8e4332e800 10 monclient(hunting): _renew_subs 2024-09-12T17:35:51.693 INFO:tasks.workunit.client.0.smithi037.stderr: -168> 2024-09-12T17:35:51.394+0000 7f8e4332e800 10 monclient(hunting): authenticate will time out at 2338.992980s 2024-09-12T17:35:51.693 INFO:tasks.workunit.client.0.smithi037.stderr: -167> 2024-09-12T17:35:51.395+0000 7f8e3e76a640 10 monclient(hunting): get_auth_request con 0x560578f1f590 auth_method 0 2024-09-12T17:35:51.694 INFO:tasks.workunit.client.0.smithi037.stderr: -166> 2024-09-12T17:35:51.395+0000 7f8e3e76a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:35:51.694 INFO:tasks.workunit.client.0.smithi037.stderr: -165> 2024-09-12T17:35:51.395+0000 7f8e3e76a640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:35:51.694 INFO:tasks.workunit.client.0.smithi037.stderr: -164> 2024-09-12T17:35:51.395+0000 7f8e3e76a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:35:51.694 INFO:tasks.workunit.client.0.smithi037.stderr: -163> 2024-09-12T17:35:51.395+0000 7f8e3f76c640 10 monclient(hunting): get_auth_request con 0x560578f23cf0 auth_method 0 2024-09-12T17:35:51.694 INFO:tasks.workunit.client.0.smithi037.stderr: -162> 2024-09-12T17:35:51.395+0000 7f8e3f76c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:35:51.694 INFO:tasks.workunit.client.0.smithi037.stderr: -161> 2024-09-12T17:35:51.395+0000 7f8e3f76c640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:35:51.694 INFO:tasks.workunit.client.0.smithi037.stderr: -160> 2024-09-12T17:35:51.395+0000 7f8e3f76c640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:35:51.694 INFO:tasks.workunit.client.0.smithi037.stderr: -159> 2024-09-12T17:35:51.395+0000 7f8e3e76a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:35:51.694 INFO:tasks.workunit.client.0.smithi037.stderr: -158> 2024-09-12T17:35:51.395+0000 7f8e3e76a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:35:51.694 INFO:tasks.workunit.client.0.smithi037.stderr: -157> 2024-09-12T17:35:51.395+0000 7f8e3e76a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:35:51.694 INFO:tasks.workunit.client.0.smithi037.stderr: -156> 2024-09-12T17:35:51.395+0000 7f8e3f76c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:35:51.694 INFO:tasks.workunit.client.0.smithi037.stderr: -155> 2024-09-12T17:35:51.395+0000 7f8e3f76c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:35:51.694 INFO:tasks.workunit.client.0.smithi037.stderr: -154> 2024-09-12T17:35:51.395+0000 7f8e3f76c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:35:51.695 INFO:tasks.workunit.client.0.smithi037.stderr: -153> 2024-09-12T17:35:51.395+0000 7f8e3ef6b640 10 monclient(hunting): get_auth_request con 0x560578ef4c40 auth_method 0 2024-09-12T17:35:51.695 INFO:tasks.workunit.client.0.smithi037.stderr: -152> 2024-09-12T17:35:51.395+0000 7f8e3ef6b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:35:51.695 INFO:tasks.workunit.client.0.smithi037.stderr: -151> 2024-09-12T17:35:51.395+0000 7f8e3ef6b640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:35:51.695 INFO:tasks.workunit.client.0.smithi037.stderr: -150> 2024-09-12T17:35:51.395+0000 7f8e3ef6b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:35:51.695 INFO:tasks.workunit.client.0.smithi037.stderr: -149> 2024-09-12T17:35:51.395+0000 7f8e3ef6b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:35:51.695 INFO:tasks.workunit.client.0.smithi037.stderr: -148> 2024-09-12T17:35:51.395+0000 7f8e3ef6b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:35:51.695 INFO:tasks.workunit.client.0.smithi037.stderr: -147> 2024-09-12T17:35:51.395+0000 7f8e3ef6b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:35:51.695 INFO:tasks.workunit.client.0.smithi037.stderr: -146> 2024-09-12T17:35:51.395+0000 7f8e3e76a640 10 monclient(hunting): handle_auth_done global_id 7767 payload 824 2024-09-12T17:35:51.695 INFO:tasks.workunit.client.0.smithi037.stderr: -145> 2024-09-12T17:35:51.395+0000 7f8e3e76a640 10 monclient: _finish_hunting 0 2024-09-12T17:35:51.695 INFO:tasks.workunit.client.0.smithi037.stderr: -144> 2024-09-12T17:35:51.395+0000 7f8e3e76a640 1 monclient: found mon.noname-a 2024-09-12T17:35:51.695 INFO:tasks.workunit.client.0.smithi037.stderr: -143> 2024-09-12T17:35:51.395+0000 7f8e3e76a640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.37:3300/0 2024-09-12T17:35:51.695 INFO:tasks.workunit.client.0.smithi037.stderr: -142> 2024-09-12T17:35:51.395+0000 7f8d20ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:35:51.695 INFO:tasks.workunit.client.0.smithi037.stderr: -141> 2024-09-12T17:35:51.395+0000 7f8d20ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:35:51.695 INFO:tasks.workunit.client.0.smithi037.stderr: -140> 2024-09-12T17:35:51.395+0000 7f8d20ff9640 10 monclient: dump: 2024-09-12T17:35:51.696 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:35:51.696 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:35:51.696 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:35:51.696 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:35:51.696 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:35:51.696 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:35:51.696 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:35:51.696 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:35:51.696 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:35:51.696 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:35:51.696 INFO:tasks.workunit.client.0.smithi037.stderr: -139> 2024-09-12T17:35:51.395+0000 7f8d20ff9640 10 monclient: _finish_auth 0 2024-09-12T17:35:51.696 INFO:tasks.workunit.client.0.smithi037.stderr: -138> 2024-09-12T17:35:51.395+0000 7f8d20ff9640 10 monclient: _check_auth_tickets 2024-09-12T17:35:51.696 INFO:tasks.workunit.client.0.smithi037.stderr: -137> 2024-09-12T17:35:51.395+0000 7f8d20ff9640 10 monclient: handle_config config(0 keys) 2024-09-12T17:35:51.696 INFO:tasks.workunit.client.0.smithi037.stderr: -136> 2024-09-12T17:35:51.395+0000 7f8d20ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:35:51.697 INFO:tasks.workunit.client.0.smithi037.stderr: -135> 2024-09-12T17:35:51.395+0000 7f8d20ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:35:51.697 INFO:tasks.workunit.client.0.smithi037.stderr: -134> 2024-09-12T17:35:51.395+0000 7f8d20ff9640 10 monclient: dump: 2024-09-12T17:35:51.697 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:35:51.697 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:35:51.697 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:35:51.697 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:35:51.697 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:35:51.697 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:35:51.697 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:35:51.697 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:35:51.697 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:35:51.697 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:35:51.697 INFO:tasks.workunit.client.0.smithi037.stderr: -133> 2024-09-12T17:35:51.395+0000 7f8d227fc640 4 set_mon_vals no callback set 2024-09-12T17:35:51.698 INFO:tasks.workunit.client.0.smithi037.stderr: -132> 2024-09-12T17:35:51.395+0000 7f8e4332e800 5 monclient: authenticate success, global_id 7767 2024-09-12T17:35:51.698 INFO:tasks.workunit.client.0.smithi037.stderr: -131> 2024-09-12T17:35:51.395+0000 7f8e4332e800 10 monclient: _renew_subs 2024-09-12T17:35:51.698 INFO:tasks.workunit.client.0.smithi037.stderr: -130> 2024-09-12T17:35:51.395+0000 7f8e4332e800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.37:3300/0 2024-09-12T17:35:51.698 INFO:tasks.workunit.client.0.smithi037.stderr: -129> 2024-09-12T17:35:51.395+0000 7f8e4332e800 10 monclient: _renew_subs 2024-09-12T17:35:51.698 INFO:tasks.workunit.client.0.smithi037.stderr: -128> 2024-09-12T17:35:51.395+0000 7f8e4332e800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.37:3300/0 2024-09-12T17:35:51.698 INFO:tasks.workunit.client.0.smithi037.stderr: -127> 2024-09-12T17:35:51.395+0000 7f8e4332e800 1 librados: init done 2024-09-12T17:35:51.698 INFO:tasks.workunit.client.0.smithi037.stderr: -126> 2024-09-12T17:35:51.395+0000 7f8e4332e800 5 asok(0x560578c32730) register_command cr dump hook 0x560578f15d48 2024-09-12T17:35:51.698 INFO:tasks.workunit.client.0.smithi037.stderr: -125> 2024-09-12T17:35:51.397+0000 7f8e4332e800 20 rados->read ofs=0 len=0 2024-09-12T17:35:51.698 INFO:tasks.workunit.client.0.smithi037.stderr: -124> 2024-09-12T17:35:51.397+0000 7f8d20ff9640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:35:51.698 INFO:tasks.workunit.client.0.smithi037.stderr: -123> 2024-09-12T17:35:51.397+0000 7f8d20ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.40:6816/3916250676,v1:172.21.15.40:6817/3916250676] 2024-09-12T17:35:51.698 INFO:tasks.workunit.client.0.smithi037.stderr: -122> 2024-09-12T17:35:51.397+0000 7f8d20ff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.40:6816/3916250676,v1:172.21.15.40:6817/3916250676] 2024-09-12T17:35:51.698 INFO:tasks.workunit.client.0.smithi037.stderr: -121> 2024-09-12T17:35:51.397+0000 7f8e3ef6b640 10 monclient: get_auth_request con 0x7f8d08076470 auth_method 0 2024-09-12T17:35:51.698 INFO:tasks.workunit.client.0.smithi037.stderr: -120> 2024-09-12T17:35:51.398+0000 7f8e3f76c640 10 monclient: get_auth_request con 0x560578f3e5c0 auth_method 0 2024-09-12T17:35:51.698 INFO:tasks.workunit.client.0.smithi037.stderr: -119> 2024-09-12T17:35:51.398+0000 7f8e4332e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:51.699 INFO:tasks.workunit.client.0.smithi037.stderr: -118> 2024-09-12T17:35:51.398+0000 7f8e4332e800 20 realm 2024-09-12T17:35:51.699 INFO:tasks.workunit.client.0.smithi037.stderr: -117> 2024-09-12T17:35:51.398+0000 7f8e4332e800 20 rados->read ofs=0 len=0 2024-09-12T17:35:51.699 INFO:tasks.workunit.client.0.smithi037.stderr: -116> 2024-09-12T17:35:51.398+0000 7f8e4332e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:51.699 INFO:tasks.workunit.client.0.smithi037.stderr: -115> 2024-09-12T17:35:51.398+0000 7f8e4332e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:35:51.699 INFO:tasks.workunit.client.0.smithi037.stderr: -114> 2024-09-12T17:35:51.398+0000 7f8e4332e800 20 rados->read ofs=0 len=0 2024-09-12T17:35:51.699 INFO:tasks.workunit.client.0.smithi037.stderr: -113> 2024-09-12T17:35:51.398+0000 7f8e4332e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:51.699 INFO:tasks.workunit.client.0.smithi037.stderr: -112> 2024-09-12T17:35:51.398+0000 7f8e4332e800 20 rados->read ofs=0 len=0 2024-09-12T17:35:51.699 INFO:tasks.workunit.client.0.smithi037.stderr: -111> 2024-09-12T17:35:51.399+0000 7f8e3ef6b640 10 monclient: get_auth_request con 0x560578f42790 auth_method 0 2024-09-12T17:35:51.699 INFO:tasks.workunit.client.0.smithi037.stderr: -110> 2024-09-12T17:35:51.399+0000 7f8e4332e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:35:51.699 INFO:tasks.workunit.client.0.smithi037.stderr: -109> 2024-09-12T17:35:51.399+0000 7f8e4332e800 20 rados->read ofs=0 len=0 2024-09-12T17:35:51.699 INFO:tasks.workunit.client.0.smithi037.stderr: -108> 2024-09-12T17:35:51.400+0000 7f8e4332e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:35:51.699 INFO:tasks.workunit.client.0.smithi037.stderr: -107> 2024-09-12T17:35:51.400+0000 7f8e4332e800 20 searching for the correct realm 2024-09-12T17:35:51.699 INFO:tasks.workunit.client.0.smithi037.stderr: -106> 2024-09-12T17:35:51.400+0000 7f8e3e76a640 10 monclient: get_auth_request con 0x560578f479e0 auth_method 0 2024-09-12T17:35:51.699 INFO:tasks.workunit.client.0.smithi037.stderr: -105> 2024-09-12T17:35:51.400+0000 7f8e3f76c640 10 monclient: get_auth_request con 0x7f8e34096120 auth_method 0 2024-09-12T17:35:51.700 INFO:tasks.workunit.client.0.smithi037.stderr: -104> 2024-09-12T17:35:51.401+0000 7f8e3ef6b640 10 monclient: get_auth_request con 0x7f8e38017020 auth_method 0 2024-09-12T17:35:51.700 INFO:tasks.workunit.client.0.smithi037.stderr: -103> 2024-09-12T17:35:51.402+0000 7f8e3e76a640 10 monclient: get_auth_request con 0x7f8e3004f430 auth_method 0 2024-09-12T17:35:51.700 INFO:tasks.workunit.client.0.smithi037.stderr: -102> 2024-09-12T17:35:51.403+0000 7f8e3f76c640 0 -- 172.21.15.37:0/4162972020 >> [v2:172.21.15.40:6818/1210108009,v1:172.21.15.40:6819/1210108009] conn(0x7f8e34096120 msgr2=0x7f8e340cafb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:35:51.700 INFO:tasks.workunit.client.0.smithi037.stderr: -101> 2024-09-12T17:35:51.403+0000 7f8d20ff9640 1 client.7767.objecter ms_handle_reset 0x7f8e34096120 session 0x7f8e34005040 osd.7 2024-09-12T17:35:51.700 INFO:tasks.workunit.client.0.smithi037.stderr: -100> 2024-09-12T17:35:51.403+0000 7f8d20ff9640 10 monclient: _renew_subs 2024-09-12T17:35:51.700 INFO:tasks.workunit.client.0.smithi037.stderr: -99> 2024-09-12T17:35:51.403+0000 7f8d20ff9640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.37:3300/0 2024-09-12T17:35:51.700 INFO:tasks.workunit.client.0.smithi037.stderr: -98> 2024-09-12T17:35:51.403+0000 7f8e3f76c640 10 monclient: get_auth_request con 0x7f8d08086b10 auth_method 0 2024-09-12T17:35:51.700 INFO:tasks.workunit.client.0.smithi037.stderr: -97> 2024-09-12T17:35:51.404+0000 7f8e3f76c640 10 monclient: get_auth_request con 0x7f8e340d4b80 auth_method 0 2024-09-12T17:35:51.700 INFO:tasks.workunit.client.0.smithi037.stderr: -96> 2024-09-12T17:35:51.406+0000 7f8e3ef6b640 10 monclient: get_auth_request con 0x7f8e340b1b90 auth_method 0 2024-09-12T17:35:51.700 INFO:tasks.workunit.client.0.smithi037.stderr: -95> 2024-09-12T17:35:51.406+0000 7f8e3ef6b640 0 -- 172.21.15.37:0/4162972020 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7f8e340b1b90 msgr2=0x7f8e340b9050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:35:51.700 INFO:tasks.workunit.client.0.smithi037.stderr: -94> 2024-09-12T17:35:51.608+0000 7f8e3ef6b640 10 monclient: get_auth_request con 0x7f8e340b1b90 auth_method 0 2024-09-12T17:35:51.700 INFO:tasks.workunit.client.0.smithi037.stderr: -93> 2024-09-12T17:35:51.613+0000 7f8e4332e800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:35:51.701 INFO:tasks.workunit.client.0.smithi037.stderr: -92> 2024-09-12T17:35:51.613+0000 7f8e4332e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:35:51.701 INFO:tasks.workunit.client.0.smithi037.stderr: -91> 2024-09-12T17:35:51.613+0000 7f8e4332e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:35:51.701 INFO:tasks.workunit.client.0.smithi037.stderr: -90> 2024-09-12T17:35:51.613+0000 7f8e4332e800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:35:51.701 INFO:tasks.workunit.client.0.smithi037.stderr: -89> 2024-09-12T17:35:51.613+0000 7f8e4332e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:35:51.701 INFO:tasks.workunit.client.0.smithi037.stderr: -88> 2024-09-12T17:35:51.613+0000 7f8e4332e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:35:51.701 INFO:tasks.workunit.client.0.smithi037.stderr: -87> 2024-09-12T17:35:51.613+0000 7f8e4332e800 20 rados->read ofs=0 len=0 2024-09-12T17:35:51.701 INFO:tasks.workunit.client.0.smithi037.stderr: -86> 2024-09-12T17:35:51.613+0000 7f8e4332e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:51.701 INFO:tasks.workunit.client.0.smithi037.stderr: -85> 2024-09-12T17:35:51.613+0000 7f8e4332e800 20 rados->read ofs=0 len=0 2024-09-12T17:35:51.701 INFO:tasks.workunit.client.0.smithi037.stderr: -84> 2024-09-12T17:35:51.614+0000 7f8e4332e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:35:51.701 INFO:tasks.workunit.client.0.smithi037.stderr: -83> 2024-09-12T17:35:51.614+0000 7f8e4332e800 20 rados->read ofs=0 len=0 2024-09-12T17:35:51.701 INFO:tasks.workunit.client.0.smithi037.stderr: -82> 2024-09-12T17:35:51.614+0000 7f8e4332e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:35:51.701 INFO:tasks.workunit.client.0.smithi037.stderr: -81> 2024-09-12T17:35:51.614+0000 7f8e4332e800 20 zone default found 2024-09-12T17:35:51.701 INFO:tasks.workunit.client.0.smithi037.stderr: -80> 2024-09-12T17:35:51.614+0000 7f8e4332e800 4 Realm: () 2024-09-12T17:35:51.702 INFO:tasks.workunit.client.0.smithi037.stderr: -79> 2024-09-12T17:35:51.614+0000 7f8e4332e800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:35:51.702 INFO:tasks.workunit.client.0.smithi037.stderr: -78> 2024-09-12T17:35:51.614+0000 7f8e4332e800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:35:51.702 INFO:tasks.workunit.client.0.smithi037.stderr: -77> 2024-09-12T17:35:51.614+0000 7f8e4332e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:35:51.702 INFO:tasks.workunit.client.0.smithi037.stderr: -76> 2024-09-12T17:35:51.614+0000 7f8e4332e800 20 zonegroup default 2024-09-12T17:35:51.702 INFO:tasks.workunit.client.0.smithi037.stderr: -75> 2024-09-12T17:35:51.614+0000 7f8e4332e800 20 rados->read ofs=0 len=0 2024-09-12T17:35:51.702 INFO:tasks.workunit.client.0.smithi037.stderr: -74> 2024-09-12T17:35:51.614+0000 7f8e4332e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:51.702 INFO:tasks.workunit.client.0.smithi037.stderr: -73> 2024-09-12T17:35:51.614+0000 7f8e4332e800 20 rados->read ofs=0 len=0 2024-09-12T17:35:51.702 INFO:tasks.workunit.client.0.smithi037.stderr: -72> 2024-09-12T17:35:51.615+0000 7f8e4332e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:51.702 INFO:tasks.workunit.client.0.smithi037.stderr: -71> 2024-09-12T17:35:51.615+0000 7f8e4332e800 20 rados->read ofs=0 len=0 2024-09-12T17:35:51.702 INFO:tasks.workunit.client.0.smithi037.stderr: -70> 2024-09-12T17:35:51.615+0000 7f8e4332e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:51.702 INFO:tasks.workunit.client.0.smithi037.stderr: -69> 2024-09-12T17:35:51.615+0000 7f8e4332e800 20 started sync module instance, tier type = 2024-09-12T17:35:51.702 INFO:tasks.workunit.client.0.smithi037.stderr: -68> 2024-09-12T17:35:51.615+0000 7f8e4332e800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:35:51.702 INFO:tasks.workunit.client.0.smithi037.stderr: -67> 2024-09-12T17:35:51.624+0000 7f8e4332e800 20 add_watcher() i=0 2024-09-12T17:35:51.702 INFO:tasks.workunit.client.0.smithi037.stderr: -66> 2024-09-12T17:35:51.624+0000 7f8e4332e800 20 add_watcher() i=1 2024-09-12T17:35:51.703 INFO:tasks.workunit.client.0.smithi037.stderr: -65> 2024-09-12T17:35:51.624+0000 7f8e4332e800 20 add_watcher() i=2 2024-09-12T17:35:51.703 INFO:tasks.workunit.client.0.smithi037.stderr: -64> 2024-09-12T17:35:51.624+0000 7f8e4332e800 20 add_watcher() i=3 2024-09-12T17:35:51.703 INFO:tasks.workunit.client.0.smithi037.stderr: -63> 2024-09-12T17:35:51.624+0000 7f8e4332e800 20 add_watcher() i=4 2024-09-12T17:35:51.703 INFO:tasks.workunit.client.0.smithi037.stderr: -62> 2024-09-12T17:35:51.624+0000 7f8e4332e800 20 add_watcher() i=5 2024-09-12T17:35:51.703 INFO:tasks.workunit.client.0.smithi037.stderr: -61> 2024-09-12T17:35:51.624+0000 7f8e4332e800 20 add_watcher() i=6 2024-09-12T17:35:51.703 INFO:tasks.workunit.client.0.smithi037.stderr: -60> 2024-09-12T17:35:51.625+0000 7f8e4332e800 20 add_watcher() i=7 2024-09-12T17:35:51.703 INFO:tasks.workunit.client.0.smithi037.stderr: -59> 2024-09-12T17:35:51.625+0000 7f8e4332e800 2 all 8 watchers are set, enabling cache 2024-09-12T17:35:51.703 INFO:tasks.workunit.client.0.smithi037.stderr: -58> 2024-09-12T17:35:51.627+0000 7f8e4332e800 5 AuthRegistry(0x7ffef27ad9e0) adding auth protocol: cephx 2024-09-12T17:35:51.703 INFO:tasks.workunit.client.0.smithi037.stderr: -57> 2024-09-12T17:35:51.627+0000 7f8e4332e800 5 AuthRegistry(0x7ffef27ad9e0) adding auth protocol: cephx 2024-09-12T17:35:51.703 INFO:tasks.workunit.client.0.smithi037.stderr: -56> 2024-09-12T17:35:51.627+0000 7f8e4332e800 5 AuthRegistry(0x7ffef27ad9e0) adding auth protocol: cephx 2024-09-12T17:35:51.703 INFO:tasks.workunit.client.0.smithi037.stderr: -55> 2024-09-12T17:35:51.627+0000 7f8e4332e800 5 AuthRegistry(0x7ffef27ad9e0) adding con mode: secure 2024-09-12T17:35:51.703 INFO:tasks.workunit.client.0.smithi037.stderr: -54> 2024-09-12T17:35:51.627+0000 7f8e4332e800 5 AuthRegistry(0x7ffef27ad9e0) adding con mode: crc 2024-09-12T17:35:51.703 INFO:tasks.workunit.client.0.smithi037.stderr: -53> 2024-09-12T17:35:51.627+0000 7f8e4332e800 5 AuthRegistry(0x7ffef27ad9e0) adding con mode: secure 2024-09-12T17:35:51.703 INFO:tasks.workunit.client.0.smithi037.stderr: -52> 2024-09-12T17:35:51.627+0000 7f8e4332e800 5 AuthRegistry(0x7ffef27ad9e0) adding con mode: crc 2024-09-12T17:35:51.704 INFO:tasks.workunit.client.0.smithi037.stderr: -51> 2024-09-12T17:35:51.627+0000 7f8e4332e800 5 AuthRegistry(0x7ffef27ad9e0) adding con mode: secure 2024-09-12T17:35:51.704 INFO:tasks.workunit.client.0.smithi037.stderr: -50> 2024-09-12T17:35:51.627+0000 7f8e4332e800 5 AuthRegistry(0x7ffef27ad9e0) adding con mode: crc 2024-09-12T17:35:51.704 INFO:tasks.workunit.client.0.smithi037.stderr: -49> 2024-09-12T17:35:51.627+0000 7f8e4332e800 5 AuthRegistry(0x7ffef27ad9e0) adding con mode: crc 2024-09-12T17:35:51.704 INFO:tasks.workunit.client.0.smithi037.stderr: -48> 2024-09-12T17:35:51.627+0000 7f8e4332e800 5 AuthRegistry(0x7ffef27ad9e0) adding con mode: secure 2024-09-12T17:35:51.704 INFO:tasks.workunit.client.0.smithi037.stderr: -47> 2024-09-12T17:35:51.627+0000 7f8e4332e800 5 AuthRegistry(0x7ffef27ad9e0) adding con mode: crc 2024-09-12T17:35:51.704 INFO:tasks.workunit.client.0.smithi037.stderr: -46> 2024-09-12T17:35:51.627+0000 7f8e4332e800 5 AuthRegistry(0x7ffef27ad9e0) adding con mode: secure 2024-09-12T17:35:51.704 INFO:tasks.workunit.client.0.smithi037.stderr: -45> 2024-09-12T17:35:51.627+0000 7f8e4332e800 5 AuthRegistry(0x7ffef27ad9e0) adding con mode: crc 2024-09-12T17:35:51.704 INFO:tasks.workunit.client.0.smithi037.stderr: -44> 2024-09-12T17:35:51.627+0000 7f8e4332e800 5 AuthRegistry(0x7ffef27ad9e0) adding con mode: secure 2024-09-12T17:35:51.704 INFO:tasks.workunit.client.0.smithi037.stderr: -43> 2024-09-12T17:35:51.627+0000 7f8cf57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:35:51.704 INFO:tasks.workunit.client.0.smithi037.stderr: -42> 2024-09-12T17:35:51.627+0000 7f8e4332e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:35:51.704 INFO:tasks.workunit.client.0.smithi037.stderr: -41> 2024-09-12T17:35:51.627+0000 7f8e4332e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:35:51.704 INFO:tasks.workunit.client.0.smithi037.stderr: -40> 2024-09-12T17:35:51.627+0000 7f8e4332e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:35:51.704 INFO:tasks.workunit.client.0.smithi037.stderr: -39> 2024-09-12T17:35:51.627+0000 7f8e4332e800 5 asok(0x560578c32730) register_command cache list hook 0x560578f1ca50 2024-09-12T17:35:51.705 INFO:tasks.workunit.client.0.smithi037.stderr: -38> 2024-09-12T17:35:51.627+0000 7f8e4332e800 5 asok(0x560578c32730) register_command cache inspect hook 0x560578f1ca50 2024-09-12T17:35:51.705 INFO:tasks.workunit.client.0.smithi037.stderr: -37> 2024-09-12T17:35:51.627+0000 7f8e4332e800 5 asok(0x560578c32730) register_command cache erase hook 0x560578f1ca50 2024-09-12T17:35:51.705 INFO:tasks.workunit.client.0.smithi037.stderr: -36> 2024-09-12T17:35:51.627+0000 7f8e4332e800 5 asok(0x560578c32730) register_command cache zap hook 0x560578f1ca50 2024-09-12T17:35:51.705 INFO:tasks.workunit.client.0.smithi037.stderr: -35> 2024-09-12T17:35:51.627+0000 7f8e4332e800 5 note: GC not initialized 2024-09-12T17:35:51.705 INFO:tasks.workunit.client.0.smithi037.stderr: -34> 2024-09-12T17:35:51.628+0000 7f8c6ffff640 20 reqs_thread_entry: start 2024-09-12T17:35:51.705 INFO:tasks.workunit.client.0.smithi037.stderr: -33> 2024-09-12T17:35:51.628+0000 7f8e4332e800 5 asok(0x560578c32730) register_command sync trace show hook 0x7f8e30013070 2024-09-12T17:35:51.705 INFO:tasks.workunit.client.0.smithi037.stderr: -32> 2024-09-12T17:35:51.628+0000 7f8e4332e800 5 asok(0x560578c32730) register_command sync trace history hook 0x7f8e30013070 2024-09-12T17:35:51.705 INFO:tasks.workunit.client.0.smithi037.stderr: -31> 2024-09-12T17:35:51.628+0000 7f8e4332e800 5 asok(0x560578c32730) register_command sync trace active hook 0x7f8e30013070 2024-09-12T17:35:51.705 INFO:tasks.workunit.client.0.smithi037.stderr: -30> 2024-09-12T17:35:51.628+0000 7f8e4332e800 5 asok(0x560578c32730) register_command sync trace active_short hook 0x7f8e30013070 2024-09-12T17:35:51.705 INFO:tasks.workunit.client.0.smithi037.stderr: -29> 2024-09-12T17:35:51.628+0000 7f8e4332e800 20 init_complete bucket index max shards: 11 2024-09-12T17:35:51.705 INFO:tasks.workunit.client.0.smithi037.stderr: -28> 2024-09-12T17:35:51.628+0000 7f8e4332e800 20 Filter name: none 2024-09-12T17:35:51.706 INFO:tasks.workunit.client.0.smithi037.stderr: -27> 2024-09-12T17:35:51.628+0000 7f8c6dffb640 20 reqs_thread_entry: start 2024-09-12T17:35:51.706 INFO:tasks.workunit.client.0.smithi037.stderr: -26> 2024-09-12T17:35:51.628+0000 7f8e4332e800 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-12T17:35:51.706 INFO:tasks.workunit.client.0.smithi037.stderr: -25> 2024-09-12T17:35:51.628+0000 7f8e4332e800 20 rados->read ofs=0 len=0 2024-09-12T17:35:51.706 INFO:tasks.workunit.client.0.smithi037.stderr: -24> 2024-09-12T17:35:51.628+0000 7f8e4332e800 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T17:35:51.706 INFO:tasks.workunit.client.0.smithi037.stderr: -23> 2024-09-12T17:35:51.628+0000 7f8e4332e800 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-12T17:35:51.706 INFO:tasks.workunit.client.0.smithi037.stderr: -22> 2024-09-12T17:35:51.628+0000 7f8e4332e800 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-12T17:35:51.706 INFO:tasks.workunit.client.0.smithi037.stderr: -21> 2024-09-12T17:35:51.628+0000 7f8e4332e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.37 : miss 2024-09-12T17:35:51.706 INFO:tasks.workunit.client.0.smithi037.stderr: -20> 2024-09-12T17:35:51.628+0000 7f8e4332e800 20 rados->read ofs=0 len=0 2024-09-12T17:35:51.706 INFO:tasks.workunit.client.0.smithi037.stderr: -19> 2024-09-12T17:35:51.629+0000 7f8e4332e800 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T17:35:51.706 INFO:tasks.workunit.client.0.smithi037.stderr: -18> 2024-09-12T17:35:51.629+0000 7f8e4332e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.37 info.flags=0x17 2024-09-12T17:35:51.706 INFO:tasks.workunit.client.0.smithi037.stderr: -17> 2024-09-12T17:35:51.629+0000 7f8e4332e800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.37 to cache LRU end 2024-09-12T17:35:51.706 INFO:tasks.workunit.client.0.smithi037.stderr: -16> 2024-09-12T17:35:51.629+0000 7f8e4332e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:35:51.706 INFO:tasks.workunit.client.0.smithi037.stderr: -15> 2024-09-12T17:35:51.629+0000 7f8e4332e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:35:51.706 INFO:tasks.workunit.client.0.smithi037.stderr: -14> 2024-09-12T17:35:51.629+0000 7f8e4332e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.37 2024-09-12T17:35:51.707 INFO:tasks.workunit.client.0.smithi037.stderr: -13> 2024-09-12T17:35:51.635+0000 7f8e4332e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.37 info.flags=0x17 2024-09-12T17:35:51.707 INFO:tasks.workunit.client.0.smithi037.stderr: -12> 2024-09-12T17:35:51.635+0000 7f8e4332e800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.37 to cache LRU end 2024-09-12T17:35:51.707 INFO:tasks.workunit.client.0.smithi037.stderr: -11> 2024-09-12T17:35:51.635+0000 7f8e4332e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:35:51.707 INFO:tasks.workunit.client.0.smithi037.stderr: -10> 2024-09-12T17:35:51.635+0000 7f8e4332e800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.37, ofs0, ns] 2024-09-12T17:35:51.707 INFO:tasks.workunit.client.0.smithi037.stderr: -9> 2024-09-12T17:35:51.635+0000 7f8d227fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497000 cookie 94581504149664 notifier 7767 bl.length()=1007 2024-09-12T17:35:51.707 INFO:tasks.workunit.client.0.smithi037.stderr: -8> 2024-09-12T17:35:51.636+0000 7f8d227fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.37 info.flags=0x17 2024-09-12T17:35:51.707 INFO:tasks.workunit.client.0.smithi037.stderr: -7> 2024-09-12T17:35:51.636+0000 7f8d227fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.37 to cache LRU end 2024-09-12T17:35:51.707 INFO:tasks.workunit.client.0.smithi037.stderr: -6> 2024-09-12T17:35:51.636+0000 7f8d227fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:35:51.707 INFO:tasks.workunit.client.0.smithi037.stderr: -5> 2024-09-12T17:35:51.637+0000 7f8e4332e800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.37]): orig_sources= new_sources= 2024-09-12T17:35:51.707 INFO:tasks.workunit.client.0.smithi037.stderr: -4> 2024-09-12T17:35:51.637+0000 7f8e4332e800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.37]): potential sources added=[] removed=[] 2024-09-12T17:35:51.707 INFO:tasks.workunit.client.0.smithi037.stderr: -3> 2024-09-12T17:35:51.637+0000 7f8e4332e800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.37]): orig_dests= new_dests= 2024-09-12T17:35:51.707 INFO:tasks.workunit.client.0.smithi037.stderr: -2> 2024-09-12T17:35:51.637+0000 7f8e4332e800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.37]): potential dests added=[] removed=[] 2024-09-12T17:35:51.708 INFO:tasks.workunit.client.0.smithi037.stderr: -1> 2024-09-12T17:35:51.640+0000 7f8e4332e800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f8e4332e800 time 2024-09-12T17:35:51.641634+0000 2024-09-12T17:35:51.708 INFO:tasks.workunit.client.0.smithi037.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:35:51.708 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:35:51.708 INFO:tasks.workunit.client.0.smithi037.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:35:51.708 INFO:tasks.workunit.client.0.smithi037.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f8e4498c71a] 2024-09-12T17:35:51.708 INFO:tasks.workunit.client.0.smithi037.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f8e4498c8d8] 2024-09-12T17:35:51.708 INFO:tasks.workunit.client.0.smithi037.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x560576758841] 2024-09-12T17:35:51.708 INFO:tasks.workunit.client.0.smithi037.stderr: 4: radosgw-admin(+0xd7490c) [0x560576c6690c] 2024-09-12T17:35:51.708 INFO:tasks.workunit.client.0.smithi037.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x56057676850d] 2024-09-12T17:35:51.708 INFO:tasks.workunit.client.0.smithi037.stderr: 6: main() 2024-09-12T17:35:51.708 INFO:tasks.workunit.client.0.smithi037.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f8e43629590] 2024-09-12T17:35:51.708 INFO:tasks.workunit.client.0.smithi037.stderr: 8: __libc_start_main() 2024-09-12T17:35:51.708 INFO:tasks.workunit.client.0.smithi037.stderr: 9: _start() 2024-09-12T17:35:51.709 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:35:51.709 INFO:tasks.workunit.client.0.smithi037.stderr: 0> 2024-09-12T17:35:51.641+0000 7f8e4332e800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:35:51.709 INFO:tasks.workunit.client.0.smithi037.stderr: in thread 7f8e4332e800 thread_name:radosgw-admin 2024-09-12T17:35:51.709 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:35:51.709 INFO:tasks.workunit.client.0.smithi037.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:35:51.709 INFO:tasks.workunit.client.0.smithi037.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f8e4363e6f0] 2024-09-12T17:35:51.709 INFO:tasks.workunit.client.0.smithi037.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f8e4368b99c] 2024-09-12T17:35:51.709 INFO:tasks.workunit.client.0.smithi037.stderr: 3: raise() 2024-09-12T17:35:51.709 INFO:tasks.workunit.client.0.smithi037.stderr: 4: abort() 2024-09-12T17:35:51.709 INFO:tasks.workunit.client.0.smithi037.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f8e4498c774] 2024-09-12T17:35:51.709 INFO:tasks.workunit.client.0.smithi037.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f8e4498c8d8] 2024-09-12T17:35:51.709 INFO:tasks.workunit.client.0.smithi037.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x560576758841] 2024-09-12T17:35:51.709 INFO:tasks.workunit.client.0.smithi037.stderr: 8: radosgw-admin(+0xd7490c) [0x560576c6690c] 2024-09-12T17:35:51.709 INFO:tasks.workunit.client.0.smithi037.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x56057676850d] 2024-09-12T17:35:51.710 INFO:tasks.workunit.client.0.smithi037.stderr: 10: main() 2024-09-12T17:35:51.710 INFO:tasks.workunit.client.0.smithi037.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f8e43629590] 2024-09-12T17:35:51.710 INFO:tasks.workunit.client.0.smithi037.stderr: 12: __libc_start_main() 2024-09-12T17:35:51.710 INFO:tasks.workunit.client.0.smithi037.stderr: 13: _start() 2024-09-12T17:35:51.710 INFO:tasks.workunit.client.0.smithi037.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:35:51.710 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:35:51.710 INFO:tasks.workunit.client.0.smithi037.stderr:--- logging levels --- 2024-09-12T17:35:51.710 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 none 2024-09-12T17:35:51.710 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 lockdep 2024-09-12T17:35:51.710 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 context 2024-09-12T17:35:51.710 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 1 crush 2024-09-12T17:35:51.710 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mds 2024-09-12T17:35:51.710 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mds_balancer 2024-09-12T17:35:51.710 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mds_locker 2024-09-12T17:35:51.711 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mds_log 2024-09-12T17:35:51.711 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mds_log_expire 2024-09-12T17:35:51.711 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mds_migrator 2024-09-12T17:35:51.711 INFO:tasks.workunit.client.0.smithi037.stderr: 3/ 5 mds_quiesce 2024-09-12T17:35:51.711 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 buffer 2024-09-12T17:35:51.711 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 timer 2024-09-12T17:35:51.711 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 filer 2024-09-12T17:35:51.711 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 striper 2024-09-12T17:35:51.711 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 objecter 2024-09-12T17:35:51.711 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 rados 2024-09-12T17:35:51.711 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 rbd 2024-09-12T17:35:51.711 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 rbd_mirror 2024-09-12T17:35:51.711 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 rbd_replay 2024-09-12T17:35:51.711 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 rbd_pwl 2024-09-12T17:35:51.712 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 journaler 2024-09-12T17:35:51.712 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 objectcacher 2024-09-12T17:35:51.712 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:35:51.712 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 client 2024-09-12T17:35:51.712 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 osd 2024-09-12T17:35:51.712 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 optracker 2024-09-12T17:35:51.712 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 objclass 2024-09-12T17:35:51.712 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 3 filestore 2024-09-12T17:35:51.712 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 3 journal 2024-09-12T17:35:51.712 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 0 ms 2024-09-12T17:35:51.712 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mon 2024-09-12T17:35:51.712 INFO:tasks.workunit.client.0.smithi037.stderr: 0/10 monc 2024-09-12T17:35:51.712 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 paxos 2024-09-12T17:35:51.712 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 tp 2024-09-12T17:35:51.713 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 auth 2024-09-12T17:35:51.713 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 crypto 2024-09-12T17:35:51.713 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 1 finisher 2024-09-12T17:35:51.713 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 1 reserver 2024-09-12T17:35:51.713 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 heartbeatmap 2024-09-12T17:35:51.713 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 perfcounter 2024-09-12T17:35:51.713 INFO:tasks.workunit.client.0.smithi037.stderr: 20/20 rgw 2024-09-12T17:35:51.713 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 rgw_sync 2024-09-12T17:35:51.713 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 rgw_datacache 2024-09-12T17:35:51.713 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 rgw_access 2024-09-12T17:35:51.713 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:35:51.713 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 rgw_flight 2024-09-12T17:35:51.713 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:35:51.713 INFO:tasks.workunit.client.0.smithi037.stderr: 20/20 rgw_notification 2024-09-12T17:35:51.714 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 javaclient 2024-09-12T17:35:51.714 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 asok 2024-09-12T17:35:51.714 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 1 throttle 2024-09-12T17:35:51.714 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 0 refs 2024-09-12T17:35:51.714 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 compressor 2024-09-12T17:35:51.714 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 bluestore 2024-09-12T17:35:51.714 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 bluefs 2024-09-12T17:35:51.714 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 3 bdev 2024-09-12T17:35:51.714 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 kstore 2024-09-12T17:35:51.714 INFO:tasks.workunit.client.0.smithi037.stderr: 4/ 5 rocksdb 2024-09-12T17:35:51.714 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 fuse 2024-09-12T17:35:51.714 INFO:tasks.workunit.client.0.smithi037.stderr: 2/ 5 mgr 2024-09-12T17:35:51.714 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mgrc 2024-09-12T17:35:51.714 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 dpdk 2024-09-12T17:35:51.715 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 eventtrace 2024-09-12T17:35:51.715 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 prioritycache 2024-09-12T17:35:51.715 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 test 2024-09-12T17:35:51.715 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:35:51.715 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 cephsqlite 2024-09-12T17:35:51.715 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:35:51.715 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore 2024-09-12T17:35:51.715 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_onode 2024-09-12T17:35:51.715 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_odata 2024-09-12T17:35:51.715 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_omap 2024-09-12T17:35:51.715 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_tm 2024-09-12T17:35:51.715 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_t 2024-09-12T17:35:51.715 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:35:51.715 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_epm 2024-09-12T17:35:51.716 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_lba 2024-09-12T17:35:51.716 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:35:51.716 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_cache 2024-09-12T17:35:51.716 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_journal 2024-09-12T17:35:51.716 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_device 2024-09-12T17:35:51.716 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_backref 2024-09-12T17:35:51.716 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 alienstore 2024-09-12T17:35:51.716 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mclock 2024-09-12T17:35:51.716 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 cyanstore 2024-09-12T17:35:51.716 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 ceph_exporter 2024-09-12T17:35:51.716 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 memstore 2024-09-12T17:35:51.716 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 trace 2024-09-12T17:35:51.716 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 ceph_dedup 2024-09-12T17:35:51.716 INFO:tasks.workunit.client.0.smithi037.stderr: -2/-2 (syslog threshold) 2024-09-12T17:35:51.717 INFO:tasks.workunit.client.0.smithi037.stderr: 99/99 (stderr threshold) 2024-09-12T17:35:51.717 INFO:tasks.workunit.client.0.smithi037.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:35:51.717 INFO:tasks.workunit.client.0.smithi037.stderr: 7f8c6dffb640 / http_manager 2024-09-12T17:35:51.717 INFO:tasks.workunit.client.0.smithi037.stderr: 7f8c6ffff640 / http_manager 2024-09-12T17:35:51.717 INFO:tasks.workunit.client.0.smithi037.stderr: 7f8cf57e2640 / rgw_dt_lg_renew 2024-09-12T17:35:51.717 INFO:tasks.workunit.client.0.smithi037.stderr: 7f8d20ff9640 / ms_dispatch 2024-09-12T17:35:51.717 INFO:tasks.workunit.client.0.smithi037.stderr: 7f8d227fc640 / io_context_pool 2024-09-12T17:35:51.717 INFO:tasks.workunit.client.0.smithi037.stderr: 7f8d28e01640 / ms_dispatch 2024-09-12T17:35:51.717 INFO:tasks.workunit.client.0.smithi037.stderr: 7f8d2b606640 / ms_dispatch 2024-09-12T17:35:51.717 INFO:tasks.workunit.client.0.smithi037.stderr: 7f8d2ce09640 / io_context_pool 2024-09-12T17:35:51.717 INFO:tasks.workunit.client.0.smithi037.stderr: 7f8e3e76a640 / msgr-worker-2 2024-09-12T17:35:51.717 INFO:tasks.workunit.client.0.smithi037.stderr: 7f8e3ef6b640 / msgr-worker-1 2024-09-12T17:35:51.717 INFO:tasks.workunit.client.0.smithi037.stderr: 7f8e3f76c640 / msgr-worker-0 2024-09-12T17:35:51.718 INFO:tasks.workunit.client.0.smithi037.stderr: 7f8e3ff6d640 / io_context_pool 2024-09-12T17:35:51.718 INFO:tasks.workunit.client.0.smithi037.stderr: 7f8e4332e800 / radosgw-admin 2024-09-12T17:35:51.718 INFO:tasks.workunit.client.0.smithi037.stderr: max_recent 500 2024-09-12T17:35:51.718 INFO:tasks.workunit.client.0.smithi037.stderr: max_new 1000 2024-09-12T17:35:51.718 INFO:tasks.workunit.client.0.smithi037.stderr: log_file /var/log/ceph/ceph-client.admin.134367.log 2024-09-12T17:35:51.718 INFO:tasks.workunit.client.0.smithi037.stderr:--- end dump of recent events --- 2024-09-12T17:35:51.718 INFO:tasks.workunit.client.0.smithi037.stderr:--- begin dump of recent events --- 2024-09-12T17:35:51.718 INFO:tasks.workunit.client.0.smithi037.stderr: -499> 2024-09-12T17:35:51.379+0000 7f8e4332e800 10 monclient: get_monmap_and_config success 2024-09-12T17:35:51.718 INFO:tasks.workunit.client.0.smithi037.stderr: -498> 2024-09-12T17:35:51.379+0000 7f8e4332e800 4 set_mon_vals no callback set 2024-09-12T17:35:51.718 INFO:tasks.workunit.client.0.smithi037.stderr: -497> 2024-09-12T17:35:51.380+0000 7f8e4332e800 10 monclient: shutdown 2024-09-12T17:35:51.718 INFO:tasks.workunit.client.0.smithi037.stderr: -496> 2024-09-12T17:35:51.380+0000 7f8e4332e800 5 asok(0x560578c32730) unregister_commands rotate-key 2024-09-12T17:35:51.718 INFO:tasks.workunit.client.0.smithi037.stderr: -495> 2024-09-12T17:35:51.380+0000 7f8e4332e800 10 monclient: build_initial_monmap 2024-09-12T17:35:51.718 INFO:tasks.workunit.client.0.smithi037.stderr: -494> 2024-09-12T17:35:51.380+0000 7f8e4332e800 1 build_initial for_mkfs: 0 2024-09-12T17:35:51.718 INFO:tasks.workunit.client.0.smithi037.stderr: -493> 2024-09-12T17:35:51.380+0000 7f8e4332e800 10 monclient: monmap: 2024-09-12T17:35:51.719 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 0 2024-09-12T17:35:51.719 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:35:51.719 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 0.000000 2024-09-12T17:35:51.719 INFO:tasks.workunit.client.0.smithi037.stderr:created 0.000000 2024-09-12T17:35:51.719 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 0 (unknown) 2024-09-12T17:35:51.719 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:35:51.719 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.noname-a 2024-09-12T17:35:51.719 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.noname-b 2024-09-12T17:35:51.719 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.noname-c 2024-09-12T17:35:51.719 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:35:51.719 INFO:tasks.workunit.client.0.smithi037.stderr: -492> 2024-09-12T17:35:51.380+0000 7f8e4332e800 5 AuthRegistry(0x560578e59320) adding auth protocol: cephx 2024-09-12T17:35:51.719 INFO:tasks.workunit.client.0.smithi037.stderr: -491> 2024-09-12T17:35:51.380+0000 7f8e4332e800 5 AuthRegistry(0x560578e59320) adding auth protocol: cephx 2024-09-12T17:35:51.719 INFO:tasks.workunit.client.0.smithi037.stderr: -490> 2024-09-12T17:35:51.380+0000 7f8e4332e800 5 AuthRegistry(0x560578e59320) adding auth protocol: cephx 2024-09-12T17:35:51.720 INFO:tasks.workunit.client.0.smithi037.stderr: -489> 2024-09-12T17:35:51.380+0000 7f8e4332e800 5 AuthRegistry(0x560578e59320) adding con mode: secure 2024-09-12T17:35:51.720 INFO:tasks.workunit.client.0.smithi037.stderr: -488> 2024-09-12T17:35:51.380+0000 7f8e4332e800 5 AuthRegistry(0x560578e59320) adding con mode: crc 2024-09-12T17:35:51.720 INFO:tasks.workunit.client.0.smithi037.stderr: -487> 2024-09-12T17:35:51.380+0000 7f8e4332e800 5 AuthRegistry(0x560578e59320) adding con mode: secure 2024-09-12T17:35:51.720 INFO:tasks.workunit.client.0.smithi037.stderr: -486> 2024-09-12T17:35:51.380+0000 7f8e4332e800 5 AuthRegistry(0x560578e59320) adding con mode: crc 2024-09-12T17:35:51.720 INFO:tasks.workunit.client.0.smithi037.stderr: -485> 2024-09-12T17:35:51.380+0000 7f8e4332e800 5 AuthRegistry(0x560578e59320) adding con mode: secure 2024-09-12T17:35:51.720 INFO:tasks.workunit.client.0.smithi037.stderr: -484> 2024-09-12T17:35:51.380+0000 7f8e4332e800 5 AuthRegistry(0x560578e59320) adding con mode: crc 2024-09-12T17:35:51.720 INFO:tasks.workunit.client.0.smithi037.stderr: -483> 2024-09-12T17:35:51.380+0000 7f8e4332e800 5 AuthRegistry(0x560578e59320) adding con mode: crc 2024-09-12T17:35:51.720 INFO:tasks.workunit.client.0.smithi037.stderr: -482> 2024-09-12T17:35:51.380+0000 7f8e4332e800 5 AuthRegistry(0x560578e59320) adding con mode: secure 2024-09-12T17:35:51.720 INFO:tasks.workunit.client.0.smithi037.stderr: -481> 2024-09-12T17:35:51.380+0000 7f8e4332e800 5 AuthRegistry(0x560578e59320) adding con mode: crc 2024-09-12T17:35:51.720 INFO:tasks.workunit.client.0.smithi037.stderr: -480> 2024-09-12T17:35:51.380+0000 7f8e4332e800 5 AuthRegistry(0x560578e59320) adding con mode: secure 2024-09-12T17:35:51.720 INFO:tasks.workunit.client.0.smithi037.stderr: -479> 2024-09-12T17:35:51.380+0000 7f8e4332e800 5 AuthRegistry(0x560578e59320) adding con mode: crc 2024-09-12T17:35:51.720 INFO:tasks.workunit.client.0.smithi037.stderr: -478> 2024-09-12T17:35:51.380+0000 7f8e4332e800 5 AuthRegistry(0x560578e59320) adding con mode: secure 2024-09-12T17:35:51.720 INFO:tasks.workunit.client.0.smithi037.stderr: -477> 2024-09-12T17:35:51.380+0000 7f8e4332e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:35:51.720 INFO:tasks.workunit.client.0.smithi037.stderr: -476> 2024-09-12T17:35:51.380+0000 7f8e4332e800 1 librados: starting msgr at 2024-09-12T17:35:51.721 INFO:tasks.workunit.client.0.smithi037.stderr: -475> 2024-09-12T17:35:51.380+0000 7f8e4332e800 1 librados: starting objecter 2024-09-12T17:35:51.721 INFO:tasks.workunit.client.0.smithi037.stderr: -474> 2024-09-12T17:35:51.380+0000 7f8e4332e800 5 asok(0x560578c32730) register_command objecter_requests hook 0x560578e551f0 2024-09-12T17:35:51.721 INFO:tasks.workunit.client.0.smithi037.stderr: -473> 2024-09-12T17:35:51.380+0000 7f8e4332e800 1 librados: setting wanted keys 2024-09-12T17:35:51.721 INFO:tasks.workunit.client.0.smithi037.stderr: -472> 2024-09-12T17:35:51.380+0000 7f8e4332e800 1 librados: calling monclient init 2024-09-12T17:35:51.721 INFO:tasks.workunit.client.0.smithi037.stderr: -471> 2024-09-12T17:35:51.380+0000 7f8e4332e800 10 monclient: init 2024-09-12T17:35:51.721 INFO:tasks.workunit.client.0.smithi037.stderr: -470> 2024-09-12T17:35:51.380+0000 7f8e4332e800 5 AuthRegistry(0x560578e53d30) adding auth protocol: cephx 2024-09-12T17:35:51.721 INFO:tasks.workunit.client.0.smithi037.stderr: -469> 2024-09-12T17:35:51.380+0000 7f8e4332e800 5 AuthRegistry(0x560578e53d30) adding auth protocol: cephx 2024-09-12T17:35:51.721 INFO:tasks.workunit.client.0.smithi037.stderr: -468> 2024-09-12T17:35:51.380+0000 7f8e4332e800 5 AuthRegistry(0x560578e53d30) adding auth protocol: cephx 2024-09-12T17:35:51.721 INFO:tasks.workunit.client.0.smithi037.stderr: -467> 2024-09-12T17:35:51.380+0000 7f8e4332e800 5 AuthRegistry(0x560578e53d30) adding con mode: secure 2024-09-12T17:35:51.721 INFO:tasks.workunit.client.0.smithi037.stderr: -466> 2024-09-12T17:35:51.380+0000 7f8e4332e800 5 AuthRegistry(0x560578e53d30) adding con mode: crc 2024-09-12T17:35:51.721 INFO:tasks.workunit.client.0.smithi037.stderr: -465> 2024-09-12T17:35:51.380+0000 7f8e4332e800 5 AuthRegistry(0x560578e53d30) adding con mode: secure 2024-09-12T17:35:51.721 INFO:tasks.workunit.client.0.smithi037.stderr: -464> 2024-09-12T17:35:51.380+0000 7f8e4332e800 5 AuthRegistry(0x560578e53d30) adding con mode: crc 2024-09-12T17:35:51.721 INFO:tasks.workunit.client.0.smithi037.stderr: -463> 2024-09-12T17:35:51.380+0000 7f8e4332e800 5 AuthRegistry(0x560578e53d30) adding con mode: secure 2024-09-12T17:35:51.722 INFO:tasks.workunit.client.0.smithi037.stderr: -462> 2024-09-12T17:35:51.380+0000 7f8e4332e800 5 AuthRegistry(0x560578e53d30) adding con mode: crc 2024-09-12T17:35:51.722 INFO:tasks.workunit.client.0.smithi037.stderr: -461> 2024-09-12T17:35:51.380+0000 7f8e4332e800 5 AuthRegistry(0x560578e53d30) adding con mode: crc 2024-09-12T17:35:51.722 INFO:tasks.workunit.client.0.smithi037.stderr: -460> 2024-09-12T17:35:51.380+0000 7f8e4332e800 5 AuthRegistry(0x560578e53d30) adding con mode: secure 2024-09-12T17:35:51.722 INFO:tasks.workunit.client.0.smithi037.stderr: -459> 2024-09-12T17:35:51.380+0000 7f8e4332e800 5 AuthRegistry(0x560578e53d30) adding con mode: crc 2024-09-12T17:35:51.722 INFO:tasks.workunit.client.0.smithi037.stderr: -458> 2024-09-12T17:35:51.380+0000 7f8e4332e800 5 AuthRegistry(0x560578e53d30) adding con mode: secure 2024-09-12T17:35:51.722 INFO:tasks.workunit.client.0.smithi037.stderr: -457> 2024-09-12T17:35:51.380+0000 7f8e4332e800 5 AuthRegistry(0x560578e53d30) adding con mode: crc 2024-09-12T17:35:51.722 INFO:tasks.workunit.client.0.smithi037.stderr: -456> 2024-09-12T17:35:51.380+0000 7f8e4332e800 5 AuthRegistry(0x560578e53d30) adding con mode: secure 2024-09-12T17:35:51.722 INFO:tasks.workunit.client.0.smithi037.stderr: -455> 2024-09-12T17:35:51.380+0000 7f8e4332e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:35:51.722 INFO:tasks.workunit.client.0.smithi037.stderr: -454> 2024-09-12T17:35:51.381+0000 7f8e4332e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:35:51.722 INFO:tasks.workunit.client.0.smithi037.stderr: -453> 2024-09-12T17:35:51.381+0000 7f8e4332e800 5 asok(0x560578c32730) register_command rotate-key hook 0x560578e53e78 2024-09-12T17:35:51.722 INFO:tasks.workunit.client.0.smithi037.stderr: -452> 2024-09-12T17:35:51.381+0000 7f8e4332e800 10 monclient: _reopen_session rank -1 2024-09-12T17:35:51.722 INFO:tasks.workunit.client.0.smithi037.stderr: -451> 2024-09-12T17:35:51.381+0000 7f8e4332e800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T17:35:51.722 INFO:tasks.workunit.client.0.smithi037.stderr: -450> 2024-09-12T17:35:51.381+0000 7f8e4332e800 10 monclient(hunting): picked mon.noname-c con 0x560578d99a40 addr [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] 2024-09-12T17:35:51.722 INFO:tasks.workunit.client.0.smithi037.stderr: -449> 2024-09-12T17:35:51.381+0000 7f8e4332e800 10 monclient(hunting): picked mon.noname-a con 0x560578d99e20 addr [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] 2024-09-12T17:35:51.723 INFO:tasks.workunit.client.0.smithi037.stderr: -448> 2024-09-12T17:35:51.381+0000 7f8e4332e800 10 monclient(hunting): picked mon.noname-b con 0x560578d9d1b0 addr [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] 2024-09-12T17:35:51.723 INFO:tasks.workunit.client.0.smithi037.stderr: -447> 2024-09-12T17:35:51.381+0000 7f8e4332e800 10 monclient(hunting): start opening mon connection 2024-09-12T17:35:51.723 INFO:tasks.workunit.client.0.smithi037.stderr: -446> 2024-09-12T17:35:51.381+0000 7f8e4332e800 10 monclient(hunting): start opening mon connection 2024-09-12T17:35:51.723 INFO:tasks.workunit.client.0.smithi037.stderr: -445> 2024-09-12T17:35:51.381+0000 7f8e4332e800 10 monclient(hunting): start opening mon connection 2024-09-12T17:35:51.723 INFO:tasks.workunit.client.0.smithi037.stderr: -444> 2024-09-12T17:35:51.381+0000 7f8e4332e800 10 monclient(hunting): _renew_subs 2024-09-12T17:35:51.723 INFO:tasks.workunit.client.0.smithi037.stderr: -443> 2024-09-12T17:35:51.381+0000 7f8e4332e800 10 monclient(hunting): authenticate will time out at 2338.979418s 2024-09-12T17:35:51.723 INFO:tasks.workunit.client.0.smithi037.stderr: -442> 2024-09-12T17:35:51.381+0000 7f8e3e76a640 10 monclient(hunting): get_auth_request con 0x560578d99e20 auth_method 0 2024-09-12T17:35:51.723 INFO:tasks.workunit.client.0.smithi037.stderr: -441> 2024-09-12T17:35:51.381+0000 7f8e3e76a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:35:51.723 INFO:tasks.workunit.client.0.smithi037.stderr: -440> 2024-09-12T17:35:51.381+0000 7f8e3e76a640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:35:51.723 INFO:tasks.workunit.client.0.smithi037.stderr: -439> 2024-09-12T17:35:51.381+0000 7f8e3e76a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:35:51.723 INFO:tasks.workunit.client.0.smithi037.stderr: -438> 2024-09-12T17:35:51.381+0000 7f8e3ef6b640 10 monclient(hunting): get_auth_request con 0x560578d99a40 auth_method 0 2024-09-12T17:35:51.723 INFO:tasks.workunit.client.0.smithi037.stderr: -437> 2024-09-12T17:35:51.381+0000 7f8e3ef6b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:35:51.723 INFO:tasks.workunit.client.0.smithi037.stderr: -436> 2024-09-12T17:35:51.381+0000 7f8e3ef6b640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:35:51.724 INFO:tasks.workunit.client.0.smithi037.stderr: -435> 2024-09-12T17:35:51.381+0000 7f8e3ef6b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:35:51.724 INFO:tasks.workunit.client.0.smithi037.stderr: -434> 2024-09-12T17:35:51.381+0000 7f8e3e76a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:35:51.724 INFO:tasks.workunit.client.0.smithi037.stderr: -433> 2024-09-12T17:35:51.381+0000 7f8e3e76a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:35:51.724 INFO:tasks.workunit.client.0.smithi037.stderr: -432> 2024-09-12T17:35:51.381+0000 7f8e3e76a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:35:51.724 INFO:tasks.workunit.client.0.smithi037.stderr: -431> 2024-09-12T17:35:51.381+0000 7f8e3ef6b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:35:51.724 INFO:tasks.workunit.client.0.smithi037.stderr: -430> 2024-09-12T17:35:51.381+0000 7f8e3ef6b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:35:51.724 INFO:tasks.workunit.client.0.smithi037.stderr: -429> 2024-09-12T17:35:51.381+0000 7f8e3ef6b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:35:51.724 INFO:tasks.workunit.client.0.smithi037.stderr: -428> 2024-09-12T17:35:51.381+0000 7f8e3f76c640 10 monclient(hunting): get_auth_request con 0x560578d9d1b0 auth_method 0 2024-09-12T17:35:51.724 INFO:tasks.workunit.client.0.smithi037.stderr: -427> 2024-09-12T17:35:51.381+0000 7f8e3f76c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:35:51.724 INFO:tasks.workunit.client.0.smithi037.stderr: -426> 2024-09-12T17:35:51.381+0000 7f8e3f76c640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:35:51.724 INFO:tasks.workunit.client.0.smithi037.stderr: -425> 2024-09-12T17:35:51.381+0000 7f8e3f76c640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:35:51.724 INFO:tasks.workunit.client.0.smithi037.stderr: -424> 2024-09-12T17:35:51.381+0000 7f8e3e76a640 10 monclient(hunting): handle_auth_done global_id 7758 payload 824 2024-09-12T17:35:51.724 INFO:tasks.workunit.client.0.smithi037.stderr: -423> 2024-09-12T17:35:51.381+0000 7f8e3e76a640 10 monclient: _finish_hunting 0 2024-09-12T17:35:51.725 INFO:tasks.workunit.client.0.smithi037.stderr: -422> 2024-09-12T17:35:51.381+0000 7f8e3e76a640 1 monclient: found mon.noname-a 2024-09-12T17:35:51.725 INFO:tasks.workunit.client.0.smithi037.stderr: -421> 2024-09-12T17:35:51.381+0000 7f8e3e76a640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.37:3300/0 2024-09-12T17:35:51.725 INFO:tasks.workunit.client.0.smithi037.stderr: -420> 2024-09-12T17:35:51.382+0000 7f8d2b606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:35:51.725 INFO:tasks.workunit.client.0.smithi037.stderr: -419> 2024-09-12T17:35:51.382+0000 7f8d2b606640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:35:51.725 INFO:tasks.workunit.client.0.smithi037.stderr: -418> 2024-09-12T17:35:51.382+0000 7f8d2b606640 10 monclient: dump: 2024-09-12T17:35:51.725 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:35:51.725 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:35:51.725 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:35:51.725 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:35:51.725 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:35:51.725 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:35:51.725 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:35:51.725 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:35:51.725 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:35:51.726 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:35:51.726 INFO:tasks.workunit.client.0.smithi037.stderr: -417> 2024-09-12T17:35:51.382+0000 7f8d2b606640 10 monclient: _finish_auth 0 2024-09-12T17:35:51.726 INFO:tasks.workunit.client.0.smithi037.stderr: -416> 2024-09-12T17:35:51.382+0000 7f8d2b606640 10 monclient: _check_auth_tickets 2024-09-12T17:35:51.726 INFO:tasks.workunit.client.0.smithi037.stderr: -415> 2024-09-12T17:35:51.382+0000 7f8e4332e800 5 monclient: authenticate success, global_id 7758 2024-09-12T17:35:51.726 INFO:tasks.workunit.client.0.smithi037.stderr: -414> 2024-09-12T17:35:51.382+0000 7f8e4332e800 10 monclient: _renew_subs 2024-09-12T17:35:51.726 INFO:tasks.workunit.client.0.smithi037.stderr: -413> 2024-09-12T17:35:51.382+0000 7f8e4332e800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.37:3300/0 2024-09-12T17:35:51.726 INFO:tasks.workunit.client.0.smithi037.stderr: -412> 2024-09-12T17:35:51.382+0000 7f8d2b606640 10 monclient: handle_config config(0 keys) 2024-09-12T17:35:51.726 INFO:tasks.workunit.client.0.smithi037.stderr: -411> 2024-09-12T17:35:51.382+0000 7f8d2b606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:35:51.726 INFO:tasks.workunit.client.0.smithi037.stderr: -410> 2024-09-12T17:35:51.382+0000 7f8d2b606640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:35:51.726 INFO:tasks.workunit.client.0.smithi037.stderr: -409> 2024-09-12T17:35:51.382+0000 7f8d2b606640 10 monclient: dump: 2024-09-12T17:35:51.726 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:35:51.726 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:35:51.726 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:35:51.726 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:35:51.727 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:35:51.727 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:35:51.727 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:35:51.727 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:35:51.727 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:35:51.727 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:35:51.727 INFO:tasks.workunit.client.0.smithi037.stderr: -408> 2024-09-12T17:35:51.382+0000 7f8d2ce09640 4 set_mon_vals no callback set 2024-09-12T17:35:51.727 INFO:tasks.workunit.client.0.smithi037.stderr: -407> 2024-09-12T17:35:51.382+0000 7f8e4332e800 10 monclient: _renew_subs 2024-09-12T17:35:51.727 INFO:tasks.workunit.client.0.smithi037.stderr: -406> 2024-09-12T17:35:51.382+0000 7f8e4332e800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.37:3300/0 2024-09-12T17:35:51.727 INFO:tasks.workunit.client.0.smithi037.stderr: -405> 2024-09-12T17:35:51.382+0000 7f8e4332e800 1 librados: init done 2024-09-12T17:35:51.727 INFO:tasks.workunit.client.0.smithi037.stderr: -404> 2024-09-12T17:35:51.384+0000 7f8d2b606640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:35:51.727 INFO:tasks.workunit.client.0.smithi037.stderr: -403> 2024-09-12T17:35:51.384+0000 7f8d2b606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.40:6816/3916250676,v1:172.21.15.40:6817/3916250676] 2024-09-12T17:35:51.727 INFO:tasks.workunit.client.0.smithi037.stderr: -402> 2024-09-12T17:35:51.384+0000 7f8d2b606640 4 mgrc reconnect Starting new session with [v2:172.21.15.40:6816/3916250676,v1:172.21.15.40:6817/3916250676] 2024-09-12T17:35:51.727 INFO:tasks.workunit.client.0.smithi037.stderr: -401> 2024-09-12T17:35:51.384+0000 7f8e3ef6b640 10 monclient: get_auth_request con 0x7f8d240764a0 auth_method 0 2024-09-12T17:35:51.728 INFO:tasks.workunit.client.0.smithi037.stderr: -400> 2024-09-12T17:35:51.384+0000 7f8e3f76c640 10 monclient: get_auth_request con 0x560578e7c4f0 auth_method 0 2024-09-12T17:35:51.728 INFO:tasks.workunit.client.0.smithi037.stderr: -399> 2024-09-12T17:35:51.385+0000 7f8e3ef6b640 10 monclient: get_auth_request con 0x560578e9ef70 auth_method 0 2024-09-12T17:35:51.728 INFO:tasks.workunit.client.0.smithi037.stderr: -398> 2024-09-12T17:35:51.386+0000 7f8e3e76a640 10 monclient: get_auth_request con 0x560578ea44b0 auth_method 0 2024-09-12T17:35:51.728 INFO:tasks.workunit.client.0.smithi037.stderr: -397> 2024-09-12T17:35:51.387+0000 7f8e4332e800 10 monclient: build_initial_monmap 2024-09-12T17:35:51.728 INFO:tasks.workunit.client.0.smithi037.stderr: -396> 2024-09-12T17:35:51.387+0000 7f8e4332e800 1 build_initial for_mkfs: 0 2024-09-12T17:35:51.728 INFO:tasks.workunit.client.0.smithi037.stderr: -395> 2024-09-12T17:35:51.387+0000 7f8e4332e800 10 monclient: monmap: 2024-09-12T17:35:51.728 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 0 2024-09-12T17:35:51.728 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:35:51.728 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 0.000000 2024-09-12T17:35:51.728 INFO:tasks.workunit.client.0.smithi037.stderr:created 0.000000 2024-09-12T17:35:51.728 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 0 (unknown) 2024-09-12T17:35:51.728 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:35:51.728 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.noname-a 2024-09-12T17:35:51.729 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.noname-b 2024-09-12T17:35:51.729 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.noname-c 2024-09-12T17:35:51.729 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:35:51.729 INFO:tasks.workunit.client.0.smithi037.stderr: -394> 2024-09-12T17:35:51.387+0000 7f8e4332e800 5 AuthRegistry(0x560578ea8430) adding auth protocol: cephx 2024-09-12T17:35:51.729 INFO:tasks.workunit.client.0.smithi037.stderr: -393> 2024-09-12T17:35:51.387+0000 7f8e4332e800 5 AuthRegistry(0x560578ea8430) adding auth protocol: cephx 2024-09-12T17:35:51.729 INFO:tasks.workunit.client.0.smithi037.stderr: -392> 2024-09-12T17:35:51.387+0000 7f8e4332e800 5 AuthRegistry(0x560578ea8430) adding auth protocol: cephx 2024-09-12T17:35:51.729 INFO:tasks.workunit.client.0.smithi037.stderr: -391> 2024-09-12T17:35:51.387+0000 7f8e4332e800 5 AuthRegistry(0x560578ea8430) adding con mode: secure 2024-09-12T17:35:51.729 INFO:tasks.workunit.client.0.smithi037.stderr: -390> 2024-09-12T17:35:51.387+0000 7f8e4332e800 5 AuthRegistry(0x560578ea8430) adding con mode: crc 2024-09-12T17:35:51.729 INFO:tasks.workunit.client.0.smithi037.stderr: -389> 2024-09-12T17:35:51.387+0000 7f8e4332e800 5 AuthRegistry(0x560578ea8430) adding con mode: secure 2024-09-12T17:35:51.729 INFO:tasks.workunit.client.0.smithi037.stderr: -388> 2024-09-12T17:35:51.387+0000 7f8e4332e800 5 AuthRegistry(0x560578ea8430) adding con mode: crc 2024-09-12T17:35:51.729 INFO:tasks.workunit.client.0.smithi037.stderr: -387> 2024-09-12T17:35:51.387+0000 7f8e4332e800 5 AuthRegistry(0x560578ea8430) adding con mode: secure 2024-09-12T17:35:51.729 INFO:tasks.workunit.client.0.smithi037.stderr: -386> 2024-09-12T17:35:51.387+0000 7f8e4332e800 5 AuthRegistry(0x560578ea8430) adding con mode: crc 2024-09-12T17:35:51.729 INFO:tasks.workunit.client.0.smithi037.stderr: -385> 2024-09-12T17:35:51.387+0000 7f8e4332e800 5 AuthRegistry(0x560578ea8430) adding con mode: crc 2024-09-12T17:35:51.729 INFO:tasks.workunit.client.0.smithi037.stderr: -384> 2024-09-12T17:35:51.387+0000 7f8e4332e800 5 AuthRegistry(0x560578ea8430) adding con mode: secure 2024-09-12T17:35:51.730 INFO:tasks.workunit.client.0.smithi037.stderr: -383> 2024-09-12T17:35:51.387+0000 7f8e4332e800 5 AuthRegistry(0x560578ea8430) adding con mode: crc 2024-09-12T17:35:51.730 INFO:tasks.workunit.client.0.smithi037.stderr: -382> 2024-09-12T17:35:51.387+0000 7f8e4332e800 5 AuthRegistry(0x560578ea8430) adding con mode: secure 2024-09-12T17:35:51.730 INFO:tasks.workunit.client.0.smithi037.stderr: -381> 2024-09-12T17:35:51.387+0000 7f8e4332e800 5 AuthRegistry(0x560578ea8430) adding con mode: crc 2024-09-12T17:35:51.730 INFO:tasks.workunit.client.0.smithi037.stderr: -380> 2024-09-12T17:35:51.387+0000 7f8e4332e800 5 AuthRegistry(0x560578ea8430) adding con mode: secure 2024-09-12T17:35:51.730 INFO:tasks.workunit.client.0.smithi037.stderr: -379> 2024-09-12T17:35:51.387+0000 7f8e4332e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:35:51.730 INFO:tasks.workunit.client.0.smithi037.stderr: -378> 2024-09-12T17:35:51.388+0000 7f8e4332e800 5 asok(0x560578c32730) register_command objecter_requests cmddesc objecter_requests hook 0x560578eabe20 EEXIST 2024-09-12T17:35:51.730 INFO:tasks.workunit.client.0.smithi037.stderr: -377> 2024-09-12T17:35:51.388+0000 7f8e4332e800 10 monclient: init 2024-09-12T17:35:51.730 INFO:tasks.workunit.client.0.smithi037.stderr: -376> 2024-09-12T17:35:51.388+0000 7f8e4332e800 5 AuthRegistry(0x560578ea73e8) adding auth protocol: cephx 2024-09-12T17:35:51.730 INFO:tasks.workunit.client.0.smithi037.stderr: -375> 2024-09-12T17:35:51.388+0000 7f8e4332e800 5 AuthRegistry(0x560578ea73e8) adding auth protocol: cephx 2024-09-12T17:35:51.730 INFO:tasks.workunit.client.0.smithi037.stderr: -374> 2024-09-12T17:35:51.388+0000 7f8e4332e800 5 AuthRegistry(0x560578ea73e8) adding auth protocol: cephx 2024-09-12T17:35:51.730 INFO:tasks.workunit.client.0.smithi037.stderr: -373> 2024-09-12T17:35:51.388+0000 7f8e4332e800 5 AuthRegistry(0x560578ea73e8) adding con mode: secure 2024-09-12T17:35:51.730 INFO:tasks.workunit.client.0.smithi037.stderr: -372> 2024-09-12T17:35:51.388+0000 7f8e4332e800 5 AuthRegistry(0x560578ea73e8) adding con mode: crc 2024-09-12T17:35:51.730 INFO:tasks.workunit.client.0.smithi037.stderr: -371> 2024-09-12T17:35:51.388+0000 7f8e4332e800 5 AuthRegistry(0x560578ea73e8) adding con mode: secure 2024-09-12T17:35:51.731 INFO:tasks.workunit.client.0.smithi037.stderr: -370> 2024-09-12T17:35:51.388+0000 7f8e4332e800 5 AuthRegistry(0x560578ea73e8) adding con mode: crc 2024-09-12T17:35:51.731 INFO:tasks.workunit.client.0.smithi037.stderr: -369> 2024-09-12T17:35:51.388+0000 7f8e4332e800 5 AuthRegistry(0x560578ea73e8) adding con mode: secure 2024-09-12T17:35:51.731 INFO:tasks.workunit.client.0.smithi037.stderr: -368> 2024-09-12T17:35:51.388+0000 7f8e4332e800 5 AuthRegistry(0x560578ea73e8) adding con mode: crc 2024-09-12T17:35:51.731 INFO:tasks.workunit.client.0.smithi037.stderr: -367> 2024-09-12T17:35:51.388+0000 7f8e4332e800 5 AuthRegistry(0x560578ea73e8) adding con mode: crc 2024-09-12T17:35:51.731 INFO:tasks.workunit.client.0.smithi037.stderr: -366> 2024-09-12T17:35:51.388+0000 7f8e4332e800 5 AuthRegistry(0x560578ea73e8) adding con mode: secure 2024-09-12T17:35:51.731 INFO:tasks.workunit.client.0.smithi037.stderr: -365> 2024-09-12T17:35:51.388+0000 7f8e4332e800 5 AuthRegistry(0x560578ea73e8) adding con mode: crc 2024-09-12T17:35:51.731 INFO:tasks.workunit.client.0.smithi037.stderr: -364> 2024-09-12T17:35:51.388+0000 7f8e4332e800 5 AuthRegistry(0x560578ea73e8) adding con mode: secure 2024-09-12T17:35:51.731 INFO:tasks.workunit.client.0.smithi037.stderr: -363> 2024-09-12T17:35:51.388+0000 7f8e4332e800 5 AuthRegistry(0x560578ea73e8) adding con mode: crc 2024-09-12T17:35:51.731 INFO:tasks.workunit.client.0.smithi037.stderr: -362> 2024-09-12T17:35:51.388+0000 7f8e4332e800 5 AuthRegistry(0x560578ea73e8) adding con mode: secure 2024-09-12T17:35:51.731 INFO:tasks.workunit.client.0.smithi037.stderr: -361> 2024-09-12T17:35:51.388+0000 7f8e4332e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:35:51.732 INFO:tasks.workunit.client.0.smithi037.stderr: -360> 2024-09-12T17:35:51.388+0000 7f8e4332e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:35:51.732 INFO:tasks.workunit.client.0.smithi037.stderr: -359> 2024-09-12T17:35:51.388+0000 7f8e4332e800 5 asok(0x560578c32730) register_command rotate-key cmddesc rotate-key hook 0x560578ea7530 EEXIST 2024-09-12T17:35:51.732 INFO:tasks.workunit.client.0.smithi037.stderr: -358> 2024-09-12T17:35:51.388+0000 7f8e4332e800 10 monclient: _reopen_session rank -1 2024-09-12T17:35:51.732 INFO:tasks.workunit.client.0.smithi037.stderr: -357> 2024-09-12T17:35:51.388+0000 7f8e4332e800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T17:35:51.732 INFO:tasks.workunit.client.0.smithi037.stderr: -356> 2024-09-12T17:35:51.388+0000 7f8e4332e800 10 monclient(hunting): picked mon.noname-b con 0x560578ecfb10 addr [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] 2024-09-12T17:35:51.732 INFO:tasks.workunit.client.0.smithi037.stderr: -355> 2024-09-12T17:35:51.388+0000 7f8e4332e800 10 monclient(hunting): picked mon.noname-a con 0x560578ed1de0 addr [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] 2024-09-12T17:35:51.732 INFO:tasks.workunit.client.0.smithi037.stderr: -354> 2024-09-12T17:35:51.388+0000 7f8e4332e800 10 monclient(hunting): picked mon.noname-c con 0x560578ece2e0 addr [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] 2024-09-12T17:35:51.732 INFO:tasks.workunit.client.0.smithi037.stderr: -353> 2024-09-12T17:35:51.388+0000 7f8e4332e800 10 monclient(hunting): start opening mon connection 2024-09-12T17:35:51.732 INFO:tasks.workunit.client.0.smithi037.stderr: -352> 2024-09-12T17:35:51.388+0000 7f8e4332e800 10 monclient(hunting): start opening mon connection 2024-09-12T17:35:51.732 INFO:tasks.workunit.client.0.smithi037.stderr: -351> 2024-09-12T17:35:51.388+0000 7f8e4332e800 10 monclient(hunting): start opening mon connection 2024-09-12T17:35:51.732 INFO:tasks.workunit.client.0.smithi037.stderr: -350> 2024-09-12T17:35:51.388+0000 7f8e4332e800 10 monclient(hunting): _renew_subs 2024-09-12T17:35:51.732 INFO:tasks.workunit.client.0.smithi037.stderr: -349> 2024-09-12T17:35:51.388+0000 7f8e4332e800 10 monclient(hunting): authenticate will time out at 2338.986704s 2024-09-12T17:35:51.732 INFO:tasks.workunit.client.0.smithi037.stderr: -348> 2024-09-12T17:35:51.388+0000 7f8e3e76a640 10 monclient(hunting): get_auth_request con 0x560578ed1de0 auth_method 0 2024-09-12T17:35:51.733 INFO:tasks.workunit.client.0.smithi037.stderr: -347> 2024-09-12T17:35:51.388+0000 7f8e3e76a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:35:51.733 INFO:tasks.workunit.client.0.smithi037.stderr: -346> 2024-09-12T17:35:51.388+0000 7f8e3e76a640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:35:51.733 INFO:tasks.workunit.client.0.smithi037.stderr: -345> 2024-09-12T17:35:51.388+0000 7f8e3e76a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:35:51.733 INFO:tasks.workunit.client.0.smithi037.stderr: -344> 2024-09-12T17:35:51.388+0000 7f8e3f76c640 10 monclient(hunting): get_auth_request con 0x560578ece2e0 auth_method 0 2024-09-12T17:35:51.733 INFO:tasks.workunit.client.0.smithi037.stderr: -343> 2024-09-12T17:35:51.388+0000 7f8e3f76c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:35:51.733 INFO:tasks.workunit.client.0.smithi037.stderr: -342> 2024-09-12T17:35:51.388+0000 7f8e3f76c640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:35:51.733 INFO:tasks.workunit.client.0.smithi037.stderr: -341> 2024-09-12T17:35:51.388+0000 7f8e3f76c640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:35:51.733 INFO:tasks.workunit.client.0.smithi037.stderr: -340> 2024-09-12T17:35:51.388+0000 7f8e3e76a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:35:51.733 INFO:tasks.workunit.client.0.smithi037.stderr: -339> 2024-09-12T17:35:51.388+0000 7f8e3e76a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:35:51.733 INFO:tasks.workunit.client.0.smithi037.stderr: -338> 2024-09-12T17:35:51.388+0000 7f8e3e76a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:35:51.733 INFO:tasks.workunit.client.0.smithi037.stderr: -337> 2024-09-12T17:35:51.388+0000 7f8e3ef6b640 10 monclient(hunting): get_auth_request con 0x560578ecfb10 auth_method 0 2024-09-12T17:35:51.733 INFO:tasks.workunit.client.0.smithi037.stderr: -336> 2024-09-12T17:35:51.388+0000 7f8e3ef6b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:35:51.733 INFO:tasks.workunit.client.0.smithi037.stderr: -335> 2024-09-12T17:35:51.388+0000 7f8e3ef6b640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:35:51.733 INFO:tasks.workunit.client.0.smithi037.stderr: -334> 2024-09-12T17:35:51.388+0000 7f8e3ef6b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:35:51.734 INFO:tasks.workunit.client.0.smithi037.stderr: -333> 2024-09-12T17:35:51.388+0000 7f8e3f76c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:35:51.734 INFO:tasks.workunit.client.0.smithi037.stderr: -332> 2024-09-12T17:35:51.388+0000 7f8e3f76c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:35:51.734 INFO:tasks.workunit.client.0.smithi037.stderr: -331> 2024-09-12T17:35:51.388+0000 7f8e3f76c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:35:51.734 INFO:tasks.workunit.client.0.smithi037.stderr: -330> 2024-09-12T17:35:51.388+0000 7f8e3ef6b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:35:51.734 INFO:tasks.workunit.client.0.smithi037.stderr: -329> 2024-09-12T17:35:51.389+0000 7f8e3ef6b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:35:51.734 INFO:tasks.workunit.client.0.smithi037.stderr: -328> 2024-09-12T17:35:51.389+0000 7f8e3ef6b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:35:51.734 INFO:tasks.workunit.client.0.smithi037.stderr: -327> 2024-09-12T17:35:51.389+0000 7f8e3e76a640 10 monclient(hunting): handle_auth_done global_id 7761 payload 824 2024-09-12T17:35:51.734 INFO:tasks.workunit.client.0.smithi037.stderr: -326> 2024-09-12T17:35:51.389+0000 7f8e3e76a640 10 monclient: _finish_hunting 0 2024-09-12T17:35:51.734 INFO:tasks.workunit.client.0.smithi037.stderr: -325> 2024-09-12T17:35:51.389+0000 7f8e3e76a640 1 monclient: found mon.noname-a 2024-09-12T17:35:51.734 INFO:tasks.workunit.client.0.smithi037.stderr: -324> 2024-09-12T17:35:51.389+0000 7f8e3e76a640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.37:3300/0 2024-09-12T17:35:51.734 INFO:tasks.workunit.client.0.smithi037.stderr: -323> 2024-09-12T17:35:51.389+0000 7f8d28e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:35:51.734 INFO:tasks.workunit.client.0.smithi037.stderr: -322> 2024-09-12T17:35:51.389+0000 7f8d28e01640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:35:51.734 INFO:tasks.workunit.client.0.smithi037.stderr: -321> 2024-09-12T17:35:51.389+0000 7f8d28e01640 10 monclient: dump: 2024-09-12T17:35:51.735 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:35:51.735 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:35:51.735 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:35:51.735 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:35:51.735 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:35:51.735 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:35:51.735 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:35:51.735 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:35:51.735 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:35:51.736 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:35:51.736 INFO:tasks.workunit.client.0.smithi037.stderr: -320> 2024-09-12T17:35:51.389+0000 7f8d28e01640 10 monclient: _finish_auth 0 2024-09-12T17:35:51.736 INFO:tasks.workunit.client.0.smithi037.stderr: -319> 2024-09-12T17:35:51.389+0000 7f8d28e01640 10 monclient: _check_auth_tickets 2024-09-12T17:35:51.736 INFO:tasks.workunit.client.0.smithi037.stderr: -318> 2024-09-12T17:35:51.389+0000 7f8d28e01640 10 monclient: handle_config config(0 keys) 2024-09-12T17:35:51.736 INFO:tasks.workunit.client.0.smithi037.stderr: -317> 2024-09-12T17:35:51.389+0000 7f8d28e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:35:51.736 INFO:tasks.workunit.client.0.smithi037.stderr: -316> 2024-09-12T17:35:51.389+0000 7f8d28e01640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:35:51.736 INFO:tasks.workunit.client.0.smithi037.stderr: -315> 2024-09-12T17:35:51.389+0000 7f8d28e01640 10 monclient: dump: 2024-09-12T17:35:51.736 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:35:51.736 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:35:51.736 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:35:51.736 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:35:51.736 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:35:51.736 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:35:51.737 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:35:51.737 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:35:51.737 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:35:51.737 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:35:51.737 INFO:tasks.workunit.client.0.smithi037.stderr: -314> 2024-09-12T17:35:51.389+0000 7f8e4332e800 5 monclient: authenticate success, global_id 7761 2024-09-12T17:35:51.737 INFO:tasks.workunit.client.0.smithi037.stderr: -313> 2024-09-12T17:35:51.389+0000 7f8e4332e800 10 monclient: _renew_subs 2024-09-12T17:35:51.737 INFO:tasks.workunit.client.0.smithi037.stderr: -312> 2024-09-12T17:35:51.389+0000 7f8e4332e800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.37:3300/0 2024-09-12T17:35:51.737 INFO:tasks.workunit.client.0.smithi037.stderr: -311> 2024-09-12T17:35:51.389+0000 7f8e3ff6d640 4 set_mon_vals no callback set 2024-09-12T17:35:51.737 INFO:tasks.workunit.client.0.smithi037.stderr: -310> 2024-09-12T17:35:51.389+0000 7f8e4332e800 10 monclient: _renew_subs 2024-09-12T17:35:51.737 INFO:tasks.workunit.client.0.smithi037.stderr: -309> 2024-09-12T17:35:51.389+0000 7f8e4332e800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.37:3300/0 2024-09-12T17:35:51.737 INFO:tasks.workunit.client.0.smithi037.stderr: -308> 2024-09-12T17:35:51.391+0000 7f8d28e01640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:35:51.737 INFO:tasks.workunit.client.0.smithi037.stderr: -307> 2024-09-12T17:35:51.391+0000 7f8d28e01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.40:6816/3916250676,v1:172.21.15.40:6817/3916250676] 2024-09-12T17:35:51.737 INFO:tasks.workunit.client.0.smithi037.stderr: -306> 2024-09-12T17:35:51.391+0000 7f8d28e01640 4 mgrc reconnect Starting new session with [v2:172.21.15.40:6816/3916250676,v1:172.21.15.40:6817/3916250676] 2024-09-12T17:35:51.738 INFO:tasks.workunit.client.0.smithi037.stderr: -305> 2024-09-12T17:35:51.391+0000 7f8e3ef6b640 10 monclient: get_auth_request con 0x7f8d18076380 auth_method 0 2024-09-12T17:35:51.738 INFO:tasks.workunit.client.0.smithi037.stderr: -304> 2024-09-12T17:35:51.391+0000 7f8e4332e800 10 monclient: get_monmap_and_config 2024-09-12T17:35:51.738 INFO:tasks.workunit.client.0.smithi037.stderr: -303> 2024-09-12T17:35:51.391+0000 7f8e4332e800 10 monclient: build_initial_monmap 2024-09-12T17:35:51.738 INFO:tasks.workunit.client.0.smithi037.stderr: -302> 2024-09-12T17:35:51.391+0000 7f8e4332e800 1 build_initial for_mkfs: 0 2024-09-12T17:35:51.738 INFO:tasks.workunit.client.0.smithi037.stderr: -301> 2024-09-12T17:35:51.391+0000 7f8e4332e800 10 monclient: monmap: 2024-09-12T17:35:51.738 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 0 2024-09-12T17:35:51.738 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:35:51.738 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 0.000000 2024-09-12T17:35:51.738 INFO:tasks.workunit.client.0.smithi037.stderr:created 0.000000 2024-09-12T17:35:51.738 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 0 (unknown) 2024-09-12T17:35:51.739 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:35:51.739 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.noname-a 2024-09-12T17:35:51.739 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.noname-b 2024-09-12T17:35:51.739 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.noname-c 2024-09-12T17:35:51.739 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:35:51.739 INFO:tasks.workunit.client.0.smithi037.stderr: -300> 2024-09-12T17:35:51.391+0000 7f8e4332e800 5 AuthRegistry(0x560578eef650) adding auth protocol: cephx 2024-09-12T17:35:51.739 INFO:tasks.workunit.client.0.smithi037.stderr: -299> 2024-09-12T17:35:51.391+0000 7f8e4332e800 5 AuthRegistry(0x560578eef650) adding auth protocol: cephx 2024-09-12T17:35:51.739 INFO:tasks.workunit.client.0.smithi037.stderr: -298> 2024-09-12T17:35:51.391+0000 7f8e4332e800 5 AuthRegistry(0x560578eef650) adding auth protocol: cephx 2024-09-12T17:35:51.739 INFO:tasks.workunit.client.0.smithi037.stderr: -297> 2024-09-12T17:35:51.391+0000 7f8e4332e800 5 AuthRegistry(0x560578eef650) adding con mode: secure 2024-09-12T17:35:51.739 INFO:tasks.workunit.client.0.smithi037.stderr: -296> 2024-09-12T17:35:51.391+0000 7f8e4332e800 5 AuthRegistry(0x560578eef650) adding con mode: crc 2024-09-12T17:35:51.739 INFO:tasks.workunit.client.0.smithi037.stderr: -295> 2024-09-12T17:35:51.391+0000 7f8e4332e800 5 AuthRegistry(0x560578eef650) adding con mode: secure 2024-09-12T17:35:51.739 INFO:tasks.workunit.client.0.smithi037.stderr: -294> 2024-09-12T17:35:51.391+0000 7f8e4332e800 5 AuthRegistry(0x560578eef650) adding con mode: crc 2024-09-12T17:35:51.739 INFO:tasks.workunit.client.0.smithi037.stderr: -293> 2024-09-12T17:35:51.391+0000 7f8e4332e800 5 AuthRegistry(0x560578eef650) adding con mode: secure 2024-09-12T17:35:51.740 INFO:tasks.workunit.client.0.smithi037.stderr: -292> 2024-09-12T17:35:51.391+0000 7f8e4332e800 5 AuthRegistry(0x560578eef650) adding con mode: crc 2024-09-12T17:35:51.740 INFO:tasks.workunit.client.0.smithi037.stderr: -291> 2024-09-12T17:35:51.391+0000 7f8e4332e800 5 AuthRegistry(0x560578eef650) adding con mode: crc 2024-09-12T17:35:51.740 INFO:tasks.workunit.client.0.smithi037.stderr: -290> 2024-09-12T17:35:51.391+0000 7f8e4332e800 5 AuthRegistry(0x560578eef650) adding con mode: secure 2024-09-12T17:35:51.740 INFO:tasks.workunit.client.0.smithi037.stderr: -289> 2024-09-12T17:35:51.391+0000 7f8e4332e800 5 AuthRegistry(0x560578eef650) adding con mode: crc 2024-09-12T17:35:51.740 INFO:tasks.workunit.client.0.smithi037.stderr: -288> 2024-09-12T17:35:51.391+0000 7f8e4332e800 5 AuthRegistry(0x560578eef650) adding con mode: secure 2024-09-12T17:35:51.740 INFO:tasks.workunit.client.0.smithi037.stderr: -287> 2024-09-12T17:35:51.391+0000 7f8e4332e800 5 AuthRegistry(0x560578eef650) adding con mode: crc 2024-09-12T17:35:51.740 INFO:tasks.workunit.client.0.smithi037.stderr: -286> 2024-09-12T17:35:51.391+0000 7f8e4332e800 5 AuthRegistry(0x560578eef650) adding con mode: secure 2024-09-12T17:35:51.740 INFO:tasks.workunit.client.0.smithi037.stderr: -285> 2024-09-12T17:35:51.391+0000 7f8e4332e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:35:51.740 INFO:tasks.workunit.client.0.smithi037.stderr: -284> 2024-09-12T17:35:51.392+0000 7f8e4332e800 10 monclient: init 2024-09-12T17:35:51.740 INFO:tasks.workunit.client.0.smithi037.stderr: -283> 2024-09-12T17:35:51.392+0000 7f8e4332e800 5 AuthRegistry(0x7ffef27ad510) adding auth protocol: cephx 2024-09-12T17:35:51.740 INFO:tasks.workunit.client.0.smithi037.stderr: -282> 2024-09-12T17:35:51.392+0000 7f8e4332e800 5 AuthRegistry(0x7ffef27ad510) adding auth protocol: cephx 2024-09-12T17:35:51.740 INFO:tasks.workunit.client.0.smithi037.stderr: -281> 2024-09-12T17:35:51.392+0000 7f8e4332e800 5 AuthRegistry(0x7ffef27ad510) adding auth protocol: cephx 2024-09-12T17:35:51.741 INFO:tasks.workunit.client.0.smithi037.stderr: -280> 2024-09-12T17:35:51.392+0000 7f8e4332e800 5 AuthRegistry(0x7ffef27ad510) adding con mode: secure 2024-09-12T17:35:51.741 INFO:tasks.workunit.client.0.smithi037.stderr: -279> 2024-09-12T17:35:51.392+0000 7f8e4332e800 5 AuthRegistry(0x7ffef27ad510) adding con mode: crc 2024-09-12T17:35:51.741 INFO:tasks.workunit.client.0.smithi037.stderr: -278> 2024-09-12T17:35:51.392+0000 7f8e4332e800 5 AuthRegistry(0x7ffef27ad510) adding con mode: secure 2024-09-12T17:35:51.741 INFO:tasks.workunit.client.0.smithi037.stderr: -277> 2024-09-12T17:35:51.392+0000 7f8e4332e800 5 AuthRegistry(0x7ffef27ad510) adding con mode: crc 2024-09-12T17:35:51.741 INFO:tasks.workunit.client.0.smithi037.stderr: -276> 2024-09-12T17:35:51.392+0000 7f8e4332e800 5 AuthRegistry(0x7ffef27ad510) adding con mode: secure 2024-09-12T17:35:51.741 INFO:tasks.workunit.client.0.smithi037.stderr: -275> 2024-09-12T17:35:51.392+0000 7f8e4332e800 5 AuthRegistry(0x7ffef27ad510) adding con mode: crc 2024-09-12T17:35:51.741 INFO:tasks.workunit.client.0.smithi037.stderr: -274> 2024-09-12T17:35:51.392+0000 7f8e4332e800 5 AuthRegistry(0x7ffef27ad510) adding con mode: crc 2024-09-12T17:35:51.741 INFO:tasks.workunit.client.0.smithi037.stderr: -273> 2024-09-12T17:35:51.392+0000 7f8e4332e800 5 AuthRegistry(0x7ffef27ad510) adding con mode: secure 2024-09-12T17:35:51.741 INFO:tasks.workunit.client.0.smithi037.stderr: -272> 2024-09-12T17:35:51.392+0000 7f8e4332e800 5 AuthRegistry(0x7ffef27ad510) adding con mode: crc 2024-09-12T17:35:51.741 INFO:tasks.workunit.client.0.smithi037.stderr: -271> 2024-09-12T17:35:51.392+0000 7f8e4332e800 5 AuthRegistry(0x7ffef27ad510) adding con mode: secure 2024-09-12T17:35:51.741 INFO:tasks.workunit.client.0.smithi037.stderr: -270> 2024-09-12T17:35:51.392+0000 7f8e4332e800 5 AuthRegistry(0x7ffef27ad510) adding con mode: crc 2024-09-12T17:35:51.741 INFO:tasks.workunit.client.0.smithi037.stderr: -269> 2024-09-12T17:35:51.392+0000 7f8e4332e800 5 AuthRegistry(0x7ffef27ad510) adding con mode: secure 2024-09-12T17:35:51.741 INFO:tasks.workunit.client.0.smithi037.stderr: -268> 2024-09-12T17:35:51.392+0000 7f8e4332e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:35:51.742 INFO:tasks.workunit.client.0.smithi037.stderr: -267> 2024-09-12T17:35:51.392+0000 7f8e4332e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:35:51.742 INFO:tasks.workunit.client.0.smithi037.stderr: -266> 2024-09-12T17:35:51.392+0000 7f8e4332e800 5 asok(0x560578c32730) register_command rotate-key cmddesc rotate-key hook 0x7ffef27ad658 EEXIST 2024-09-12T17:35:51.742 INFO:tasks.workunit.client.0.smithi037.stderr: -265> 2024-09-12T17:35:51.392+0000 7f8e4332e800 10 monclient: _reopen_session rank -1 2024-09-12T17:35:51.742 INFO:tasks.workunit.client.0.smithi037.stderr: -264> 2024-09-12T17:35:51.392+0000 7f8e4332e800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T17:35:51.742 INFO:tasks.workunit.client.0.smithi037.stderr: -263> 2024-09-12T17:35:51.392+0000 7f8e4332e800 10 monclient(hunting): picked mon.noname-c con 0x560578f23cf0 addr [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] 2024-09-12T17:35:51.742 INFO:tasks.workunit.client.0.smithi037.stderr: -262> 2024-09-12T17:35:51.392+0000 7f8e4332e800 10 monclient(hunting): picked mon.noname-b con 0x560578ef4c40 addr [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] 2024-09-12T17:35:51.742 INFO:tasks.workunit.client.0.smithi037.stderr: -261> 2024-09-12T17:35:51.392+0000 7f8e4332e800 10 monclient(hunting): picked mon.noname-a con 0x560578f1f590 addr [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] 2024-09-12T17:35:51.742 INFO:tasks.workunit.client.0.smithi037.stderr: -260> 2024-09-12T17:35:51.392+0000 7f8e4332e800 10 monclient(hunting): start opening mon connection 2024-09-12T17:35:51.742 INFO:tasks.workunit.client.0.smithi037.stderr: -259> 2024-09-12T17:35:51.392+0000 7f8e4332e800 10 monclient(hunting): start opening mon connection 2024-09-12T17:35:51.742 INFO:tasks.workunit.client.0.smithi037.stderr: -258> 2024-09-12T17:35:51.392+0000 7f8e4332e800 10 monclient(hunting): start opening mon connection 2024-09-12T17:35:51.742 INFO:tasks.workunit.client.0.smithi037.stderr: -257> 2024-09-12T17:35:51.392+0000 7f8e4332e800 10 monclient(hunting): _renew_subs 2024-09-12T17:35:51.742 INFO:tasks.workunit.client.0.smithi037.stderr: -256> 2024-09-12T17:35:51.392+0000 7f8e4332e800 10 monclient(hunting): authenticate will time out at 2338.990637s 2024-09-12T17:35:51.742 INFO:tasks.workunit.client.0.smithi037.stderr: -255> 2024-09-12T17:35:51.392+0000 7f8e3ef6b640 10 monclient(hunting): get_auth_request con 0x560578f23cf0 auth_method 0 2024-09-12T17:35:51.742 INFO:tasks.workunit.client.0.smithi037.stderr: -254> 2024-09-12T17:35:51.392+0000 7f8e3ef6b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:35:51.743 INFO:tasks.workunit.client.0.smithi037.stderr: -253> 2024-09-12T17:35:51.392+0000 7f8e3ef6b640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:35:51.743 INFO:tasks.workunit.client.0.smithi037.stderr: -252> 2024-09-12T17:35:51.392+0000 7f8e3ef6b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:35:51.743 INFO:tasks.workunit.client.0.smithi037.stderr: -251> 2024-09-12T17:35:51.392+0000 7f8e3f76c640 10 monclient(hunting): get_auth_request con 0x560578f1f590 auth_method 0 2024-09-12T17:35:51.743 INFO:tasks.workunit.client.0.smithi037.stderr: -250> 2024-09-12T17:35:51.392+0000 7f8e3f76c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:35:51.743 INFO:tasks.workunit.client.0.smithi037.stderr: -249> 2024-09-12T17:35:51.392+0000 7f8e3f76c640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:35:51.743 INFO:tasks.workunit.client.0.smithi037.stderr: -248> 2024-09-12T17:35:51.392+0000 7f8e3f76c640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:35:51.743 INFO:tasks.workunit.client.0.smithi037.stderr: -247> 2024-09-12T17:35:51.392+0000 7f8e3ef6b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:35:51.743 INFO:tasks.workunit.client.0.smithi037.stderr: -246> 2024-09-12T17:35:51.392+0000 7f8e3ef6b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:35:51.743 INFO:tasks.workunit.client.0.smithi037.stderr: -245> 2024-09-12T17:35:51.392+0000 7f8e3ef6b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:35:51.743 INFO:tasks.workunit.client.0.smithi037.stderr: -244> 2024-09-12T17:35:51.392+0000 7f8e3f76c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:35:51.743 INFO:tasks.workunit.client.0.smithi037.stderr: -243> 2024-09-12T17:35:51.392+0000 7f8e3f76c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:35:51.743 INFO:tasks.workunit.client.0.smithi037.stderr: -242> 2024-09-12T17:35:51.392+0000 7f8e3f76c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:35:51.743 INFO:tasks.workunit.client.0.smithi037.stderr: -241> 2024-09-12T17:35:51.392+0000 7f8e3e76a640 10 monclient(hunting): get_auth_request con 0x560578ef4c40 auth_method 0 2024-09-12T17:35:51.743 INFO:tasks.workunit.client.0.smithi037.stderr: -240> 2024-09-12T17:35:51.392+0000 7f8e3e76a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:35:51.744 INFO:tasks.workunit.client.0.smithi037.stderr: -239> 2024-09-12T17:35:51.392+0000 7f8e3e76a640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:35:51.744 INFO:tasks.workunit.client.0.smithi037.stderr: -238> 2024-09-12T17:35:51.392+0000 7f8e3e76a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:35:51.744 INFO:tasks.workunit.client.0.smithi037.stderr: -237> 2024-09-12T17:35:51.392+0000 7f8e3ef6b640 10 monclient(hunting): handle_auth_done global_id 7268 payload 274 2024-09-12T17:35:51.744 INFO:tasks.workunit.client.0.smithi037.stderr: -236> 2024-09-12T17:35:51.392+0000 7f8e3ef6b640 10 monclient: _finish_hunting 0 2024-09-12T17:35:51.744 INFO:tasks.workunit.client.0.smithi037.stderr: -235> 2024-09-12T17:35:51.392+0000 7f8e3ef6b640 1 monclient: found mon.noname-c 2024-09-12T17:35:51.744 INFO:tasks.workunit.client.0.smithi037.stderr: -234> 2024-09-12T17:35:51.392+0000 7f8e3ef6b640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.37:3301/0 2024-09-12T17:35:51.744 INFO:tasks.workunit.client.0.smithi037.stderr: -233> 2024-09-12T17:35:51.393+0000 7f8d227fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:35:51.744 INFO:tasks.workunit.client.0.smithi037.stderr: -232> 2024-09-12T17:35:51.393+0000 7f8d227fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:35:51.744 INFO:tasks.workunit.client.0.smithi037.stderr: -231> 2024-09-12T17:35:51.393+0000 7f8d227fc640 10 monclient: dump: 2024-09-12T17:35:51.744 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:35:51.744 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:35:51.744 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:35:51.744 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:35:51.745 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:35:51.745 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:35:51.745 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:35:51.745 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:35:51.745 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:35:51.745 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:35:51.745 INFO:tasks.workunit.client.0.smithi037.stderr: -230> 2024-09-12T17:35:51.393+0000 7f8d227fc640 10 monclient: _finish_auth 0 2024-09-12T17:35:51.745 INFO:tasks.workunit.client.0.smithi037.stderr: -229> 2024-09-12T17:35:51.393+0000 7f8d227fc640 10 monclient: _check_auth_tickets 2024-09-12T17:35:51.745 INFO:tasks.workunit.client.0.smithi037.stderr: -228> 2024-09-12T17:35:51.393+0000 7f8d227fc640 10 monclient: handle_config config(0 keys) 2024-09-12T17:35:51.745 INFO:tasks.workunit.client.0.smithi037.stderr: -227> 2024-09-12T17:35:51.393+0000 7f8d227fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:35:51.745 INFO:tasks.workunit.client.0.smithi037.stderr: -226> 2024-09-12T17:35:51.393+0000 7f8d227fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:35:51.745 INFO:tasks.workunit.client.0.smithi037.stderr: -225> 2024-09-12T17:35:51.393+0000 7f8d227fc640 10 monclient: dump: 2024-09-12T17:35:51.745 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:35:51.746 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:35:51.746 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:35:51.746 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:35:51.746 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:35:51.746 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:35:51.746 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:35:51.746 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:35:51.746 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:35:51.746 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:35:51.746 INFO:tasks.workunit.client.0.smithi037.stderr: -224> 2024-09-12T17:35:51.393+0000 7f8e4332e800 5 monclient: authenticate success, global_id 7268 2024-09-12T17:35:51.746 INFO:tasks.workunit.client.0.smithi037.stderr: -223> 2024-09-12T17:35:51.393+0000 7f8e4332e800 10 monclient: get_monmap_and_config success 2024-09-12T17:35:51.746 INFO:tasks.workunit.client.0.smithi037.stderr: -222> 2024-09-12T17:35:51.393+0000 7f8e4332e800 4 set_mon_vals no callback set 2024-09-12T17:35:51.746 INFO:tasks.workunit.client.0.smithi037.stderr: -221> 2024-09-12T17:35:51.393+0000 7f8e4332e800 10 monclient: shutdown 2024-09-12T17:35:51.746 INFO:tasks.workunit.client.0.smithi037.stderr: -220> 2024-09-12T17:35:51.393+0000 7f8e4332e800 10 monclient: build_initial_monmap 2024-09-12T17:35:51.747 INFO:tasks.workunit.client.0.smithi037.stderr: -219> 2024-09-12T17:35:51.393+0000 7f8e4332e800 1 build_initial for_mkfs: 0 2024-09-12T17:35:51.747 INFO:tasks.workunit.client.0.smithi037.stderr: -218> 2024-09-12T17:35:51.393+0000 7f8e4332e800 10 monclient: monmap: 2024-09-12T17:35:51.747 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 0 2024-09-12T17:35:51.747 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:35:51.747 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 0.000000 2024-09-12T17:35:51.747 INFO:tasks.workunit.client.0.smithi037.stderr:created 0.000000 2024-09-12T17:35:51.747 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 0 (unknown) 2024-09-12T17:35:51.747 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:35:51.747 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.noname-a 2024-09-12T17:35:51.747 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.noname-b 2024-09-12T17:35:51.747 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.noname-c 2024-09-12T17:35:51.747 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:35:51.747 INFO:tasks.workunit.client.0.smithi037.stderr: -217> 2024-09-12T17:35:51.394+0000 7f8e4332e800 5 AuthRegistry(0x560578f161e0) adding auth protocol: cephx 2024-09-12T17:35:51.747 INFO:tasks.workunit.client.0.smithi037.stderr: -216> 2024-09-12T17:35:51.394+0000 7f8e4332e800 5 AuthRegistry(0x560578f161e0) adding auth protocol: cephx 2024-09-12T17:35:51.748 INFO:tasks.workunit.client.0.smithi037.stderr: -215> 2024-09-12T17:35:51.394+0000 7f8e4332e800 5 AuthRegistry(0x560578f161e0) adding auth protocol: cephx 2024-09-12T17:35:51.748 INFO:tasks.workunit.client.0.smithi037.stderr: -214> 2024-09-12T17:35:51.394+0000 7f8e4332e800 5 AuthRegistry(0x560578f161e0) adding con mode: secure 2024-09-12T17:35:51.748 INFO:tasks.workunit.client.0.smithi037.stderr: -213> 2024-09-12T17:35:51.394+0000 7f8e4332e800 5 AuthRegistry(0x560578f161e0) adding con mode: crc 2024-09-12T17:35:51.748 INFO:tasks.workunit.client.0.smithi037.stderr: -212> 2024-09-12T17:35:51.394+0000 7f8e4332e800 5 AuthRegistry(0x560578f161e0) adding con mode: secure 2024-09-12T17:35:51.748 INFO:tasks.workunit.client.0.smithi037.stderr: -211> 2024-09-12T17:35:51.394+0000 7f8e4332e800 5 AuthRegistry(0x560578f161e0) adding con mode: crc 2024-09-12T17:35:51.748 INFO:tasks.workunit.client.0.smithi037.stderr: -210> 2024-09-12T17:35:51.394+0000 7f8e4332e800 5 AuthRegistry(0x560578f161e0) adding con mode: secure 2024-09-12T17:35:51.748 INFO:tasks.workunit.client.0.smithi037.stderr: -209> 2024-09-12T17:35:51.394+0000 7f8e4332e800 5 AuthRegistry(0x560578f161e0) adding con mode: crc 2024-09-12T17:35:51.748 INFO:tasks.workunit.client.0.smithi037.stderr: -208> 2024-09-12T17:35:51.394+0000 7f8e4332e800 5 AuthRegistry(0x560578f161e0) adding con mode: crc 2024-09-12T17:35:51.748 INFO:tasks.workunit.client.0.smithi037.stderr: -207> 2024-09-12T17:35:51.394+0000 7f8e4332e800 5 AuthRegistry(0x560578f161e0) adding con mode: secure 2024-09-12T17:35:51.748 INFO:tasks.workunit.client.0.smithi037.stderr: -206> 2024-09-12T17:35:51.394+0000 7f8e4332e800 5 AuthRegistry(0x560578f161e0) adding con mode: crc 2024-09-12T17:35:51.748 INFO:tasks.workunit.client.0.smithi037.stderr: -205> 2024-09-12T17:35:51.394+0000 7f8e4332e800 5 AuthRegistry(0x560578f161e0) adding con mode: secure 2024-09-12T17:35:51.748 INFO:tasks.workunit.client.0.smithi037.stderr: -204> 2024-09-12T17:35:51.394+0000 7f8e4332e800 5 AuthRegistry(0x560578f161e0) adding con mode: crc 2024-09-12T17:35:51.748 INFO:tasks.workunit.client.0.smithi037.stderr: -203> 2024-09-12T17:35:51.394+0000 7f8e4332e800 5 AuthRegistry(0x560578f161e0) adding con mode: secure 2024-09-12T17:35:51.748 INFO:tasks.workunit.client.0.smithi037.stderr: -202> 2024-09-12T17:35:51.394+0000 7f8e4332e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:35:51.749 INFO:tasks.workunit.client.0.smithi037.stderr: -201> 2024-09-12T17:35:51.394+0000 7f8e4332e800 1 librados: starting msgr at 2024-09-12T17:35:51.749 INFO:tasks.workunit.client.0.smithi037.stderr: -200> 2024-09-12T17:35:51.394+0000 7f8e4332e800 1 librados: starting objecter 2024-09-12T17:35:51.749 INFO:tasks.workunit.client.0.smithi037.stderr: -199> 2024-09-12T17:35:51.394+0000 7f8e4332e800 5 asok(0x560578c32730) register_command objecter_requests cmddesc objecter_requests hook 0x560578f1e360 EEXIST 2024-09-12T17:35:51.749 INFO:tasks.workunit.client.0.smithi037.stderr: -198> 2024-09-12T17:35:51.394+0000 7f8e4332e800 1 librados: setting wanted keys 2024-09-12T17:35:51.749 INFO:tasks.workunit.client.0.smithi037.stderr: -197> 2024-09-12T17:35:51.394+0000 7f8e4332e800 1 librados: calling monclient init 2024-09-12T17:35:51.749 INFO:tasks.workunit.client.0.smithi037.stderr: -196> 2024-09-12T17:35:51.394+0000 7f8e4332e800 10 monclient: init 2024-09-12T17:35:51.749 INFO:tasks.workunit.client.0.smithi037.stderr: -195> 2024-09-12T17:35:51.394+0000 7f8e4332e800 5 AuthRegistry(0x560578ee78c0) adding auth protocol: cephx 2024-09-12T17:35:51.749 INFO:tasks.workunit.client.0.smithi037.stderr: -194> 2024-09-12T17:35:51.394+0000 7f8e4332e800 5 AuthRegistry(0x560578ee78c0) adding auth protocol: cephx 2024-09-12T17:35:51.749 INFO:tasks.workunit.client.0.smithi037.stderr: -193> 2024-09-12T17:35:51.394+0000 7f8e4332e800 5 AuthRegistry(0x560578ee78c0) adding auth protocol: cephx 2024-09-12T17:35:51.749 INFO:tasks.workunit.client.0.smithi037.stderr: -192> 2024-09-12T17:35:51.394+0000 7f8e4332e800 5 AuthRegistry(0x560578ee78c0) adding con mode: secure 2024-09-12T17:35:51.749 INFO:tasks.workunit.client.0.smithi037.stderr: -191> 2024-09-12T17:35:51.394+0000 7f8e4332e800 5 AuthRegistry(0x560578ee78c0) adding con mode: crc 2024-09-12T17:35:51.749 INFO:tasks.workunit.client.0.smithi037.stderr: -190> 2024-09-12T17:35:51.394+0000 7f8e4332e800 5 AuthRegistry(0x560578ee78c0) adding con mode: secure 2024-09-12T17:35:51.749 INFO:tasks.workunit.client.0.smithi037.stderr: -189> 2024-09-12T17:35:51.394+0000 7f8e4332e800 5 AuthRegistry(0x560578ee78c0) adding con mode: crc 2024-09-12T17:35:51.749 INFO:tasks.workunit.client.0.smithi037.stderr: -188> 2024-09-12T17:35:51.394+0000 7f8e4332e800 5 AuthRegistry(0x560578ee78c0) adding con mode: secure 2024-09-12T17:35:51.750 INFO:tasks.workunit.client.0.smithi037.stderr: -187> 2024-09-12T17:35:51.394+0000 7f8e4332e800 5 AuthRegistry(0x560578ee78c0) adding con mode: crc 2024-09-12T17:35:51.750 INFO:tasks.workunit.client.0.smithi037.stderr: -186> 2024-09-12T17:35:51.394+0000 7f8e4332e800 5 AuthRegistry(0x560578ee78c0) adding con mode: crc 2024-09-12T17:35:51.750 INFO:tasks.workunit.client.0.smithi037.stderr: -185> 2024-09-12T17:35:51.394+0000 7f8e4332e800 5 AuthRegistry(0x560578ee78c0) adding con mode: secure 2024-09-12T17:35:51.750 INFO:tasks.workunit.client.0.smithi037.stderr: -184> 2024-09-12T17:35:51.394+0000 7f8e4332e800 5 AuthRegistry(0x560578ee78c0) adding con mode: crc 2024-09-12T17:35:51.750 INFO:tasks.workunit.client.0.smithi037.stderr: -183> 2024-09-12T17:35:51.394+0000 7f8e4332e800 5 AuthRegistry(0x560578ee78c0) adding con mode: secure 2024-09-12T17:35:51.750 INFO:tasks.workunit.client.0.smithi037.stderr: -182> 2024-09-12T17:35:51.394+0000 7f8e4332e800 5 AuthRegistry(0x560578ee78c0) adding con mode: crc 2024-09-12T17:35:51.750 INFO:tasks.workunit.client.0.smithi037.stderr: -181> 2024-09-12T17:35:51.394+0000 7f8e4332e800 5 AuthRegistry(0x560578ee78c0) adding con mode: secure 2024-09-12T17:35:51.750 INFO:tasks.workunit.client.0.smithi037.stderr: -180> 2024-09-12T17:35:51.394+0000 7f8e4332e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:35:51.750 INFO:tasks.workunit.client.0.smithi037.stderr: -179> 2024-09-12T17:35:51.394+0000 7f8e4332e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:35:51.750 INFO:tasks.workunit.client.0.smithi037.stderr: -178> 2024-09-12T17:35:51.394+0000 7f8e4332e800 5 asok(0x560578c32730) register_command rotate-key cmddesc rotate-key hook 0x560578ee7a08 EEXIST 2024-09-12T17:35:51.750 INFO:tasks.workunit.client.0.smithi037.stderr: -177> 2024-09-12T17:35:51.394+0000 7f8e4332e800 10 monclient: _reopen_session rank -1 2024-09-12T17:35:51.750 INFO:tasks.workunit.client.0.smithi037.stderr: -176> 2024-09-12T17:35:51.394+0000 7f8e4332e800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T17:35:51.750 INFO:tasks.workunit.client.0.smithi037.stderr: -175> 2024-09-12T17:35:51.394+0000 7f8e4332e800 10 monclient(hunting): picked mon.noname-b con 0x560578ef4c40 addr [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] 2024-09-12T17:35:51.750 INFO:tasks.workunit.client.0.smithi037.stderr: -174> 2024-09-12T17:35:51.394+0000 7f8e4332e800 10 monclient(hunting): picked mon.noname-a con 0x560578f1f590 addr [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] 2024-09-12T17:35:51.751 INFO:tasks.workunit.client.0.smithi037.stderr: -173> 2024-09-12T17:35:51.394+0000 7f8e4332e800 10 monclient(hunting): picked mon.noname-c con 0x560578f23cf0 addr [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] 2024-09-12T17:35:51.751 INFO:tasks.workunit.client.0.smithi037.stderr: -172> 2024-09-12T17:35:51.394+0000 7f8e4332e800 10 monclient(hunting): start opening mon connection 2024-09-12T17:35:51.751 INFO:tasks.workunit.client.0.smithi037.stderr: -171> 2024-09-12T17:35:51.394+0000 7f8e4332e800 10 monclient(hunting): start opening mon connection 2024-09-12T17:35:51.751 INFO:tasks.workunit.client.0.smithi037.stderr: -170> 2024-09-12T17:35:51.394+0000 7f8e4332e800 10 monclient(hunting): start opening mon connection 2024-09-12T17:35:51.751 INFO:tasks.workunit.client.0.smithi037.stderr: -169> 2024-09-12T17:35:51.394+0000 7f8e4332e800 10 monclient(hunting): _renew_subs 2024-09-12T17:35:51.751 INFO:tasks.workunit.client.0.smithi037.stderr: -168> 2024-09-12T17:35:51.394+0000 7f8e4332e800 10 monclient(hunting): authenticate will time out at 2338.992980s 2024-09-12T17:35:51.751 INFO:tasks.workunit.client.0.smithi037.stderr: -167> 2024-09-12T17:35:51.395+0000 7f8e3e76a640 10 monclient(hunting): get_auth_request con 0x560578f1f590 auth_method 0 2024-09-12T17:35:51.751 INFO:tasks.workunit.client.0.smithi037.stderr: -166> 2024-09-12T17:35:51.395+0000 7f8e3e76a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:35:51.751 INFO:tasks.workunit.client.0.smithi037.stderr: -165> 2024-09-12T17:35:51.395+0000 7f8e3e76a640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:35:51.751 INFO:tasks.workunit.client.0.smithi037.stderr: -164> 2024-09-12T17:35:51.395+0000 7f8e3e76a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:35:51.751 INFO:tasks.workunit.client.0.smithi037.stderr: -163> 2024-09-12T17:35:51.395+0000 7f8e3f76c640 10 monclient(hunting): get_auth_request con 0x560578f23cf0 auth_method 0 2024-09-12T17:35:51.751 INFO:tasks.workunit.client.0.smithi037.stderr: -162> 2024-09-12T17:35:51.395+0000 7f8e3f76c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:35:51.751 INFO:tasks.workunit.client.0.smithi037.stderr: -161> 2024-09-12T17:35:51.395+0000 7f8e3f76c640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:35:51.751 INFO:tasks.workunit.client.0.smithi037.stderr: -160> 2024-09-12T17:35:51.395+0000 7f8e3f76c640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:35:51.752 INFO:tasks.workunit.client.0.smithi037.stderr: -159> 2024-09-12T17:35:51.395+0000 7f8e3e76a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:35:51.752 INFO:tasks.workunit.client.0.smithi037.stderr: -158> 2024-09-12T17:35:51.395+0000 7f8e3e76a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:35:51.752 INFO:tasks.workunit.client.0.smithi037.stderr: -157> 2024-09-12T17:35:51.395+0000 7f8e3e76a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:35:51.752 INFO:tasks.workunit.client.0.smithi037.stderr: -156> 2024-09-12T17:35:51.395+0000 7f8e3f76c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:35:51.752 INFO:tasks.workunit.client.0.smithi037.stderr: -155> 2024-09-12T17:35:51.395+0000 7f8e3f76c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:35:51.752 INFO:tasks.workunit.client.0.smithi037.stderr: -154> 2024-09-12T17:35:51.395+0000 7f8e3f76c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:35:51.752 INFO:tasks.workunit.client.0.smithi037.stderr: -153> 2024-09-12T17:35:51.395+0000 7f8e3ef6b640 10 monclient(hunting): get_auth_request con 0x560578ef4c40 auth_method 0 2024-09-12T17:35:51.752 INFO:tasks.workunit.client.0.smithi037.stderr: -152> 2024-09-12T17:35:51.395+0000 7f8e3ef6b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:35:51.752 INFO:tasks.workunit.client.0.smithi037.stderr: -151> 2024-09-12T17:35:51.395+0000 7f8e3ef6b640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:35:51.752 INFO:tasks.workunit.client.0.smithi037.stderr: -150> 2024-09-12T17:35:51.395+0000 7f8e3ef6b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:35:51.752 INFO:tasks.workunit.client.0.smithi037.stderr: -149> 2024-09-12T17:35:51.395+0000 7f8e3ef6b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:35:51.752 INFO:tasks.workunit.client.0.smithi037.stderr: -148> 2024-09-12T17:35:51.395+0000 7f8e3ef6b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:35:51.752 INFO:tasks.workunit.client.0.smithi037.stderr: -147> 2024-09-12T17:35:51.395+0000 7f8e3ef6b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:35:51.753 INFO:tasks.workunit.client.0.smithi037.stderr: -146> 2024-09-12T17:35:51.395+0000 7f8e3e76a640 10 monclient(hunting): handle_auth_done global_id 7767 payload 824 2024-09-12T17:35:51.753 INFO:tasks.workunit.client.0.smithi037.stderr: -145> 2024-09-12T17:35:51.395+0000 7f8e3e76a640 10 monclient: _finish_hunting 0 2024-09-12T17:35:51.753 INFO:tasks.workunit.client.0.smithi037.stderr: -144> 2024-09-12T17:35:51.395+0000 7f8e3e76a640 1 monclient: found mon.noname-a 2024-09-12T17:35:51.753 INFO:tasks.workunit.client.0.smithi037.stderr: -143> 2024-09-12T17:35:51.395+0000 7f8e3e76a640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.37:3300/0 2024-09-12T17:35:51.753 INFO:tasks.workunit.client.0.smithi037.stderr: -142> 2024-09-12T17:35:51.395+0000 7f8d20ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:35:51.753 INFO:tasks.workunit.client.0.smithi037.stderr: -141> 2024-09-12T17:35:51.395+0000 7f8d20ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:35:51.753 INFO:tasks.workunit.client.0.smithi037.stderr: -140> 2024-09-12T17:35:51.395+0000 7f8d20ff9640 10 monclient: dump: 2024-09-12T17:35:51.753 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:35:51.753 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:35:51.753 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:35:51.753 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:35:51.753 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:35:51.753 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:35:51.753 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:35:51.754 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:35:51.754 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:35:51.754 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:35:51.754 INFO:tasks.workunit.client.0.smithi037.stderr: -139> 2024-09-12T17:35:51.395+0000 7f8d20ff9640 10 monclient: _finish_auth 0 2024-09-12T17:35:51.754 INFO:tasks.workunit.client.0.smithi037.stderr: -138> 2024-09-12T17:35:51.395+0000 7f8d20ff9640 10 monclient: _check_auth_tickets 2024-09-12T17:35:51.754 INFO:tasks.workunit.client.0.smithi037.stderr: -137> 2024-09-12T17:35:51.395+0000 7f8d20ff9640 10 monclient: handle_config config(0 keys) 2024-09-12T17:35:51.754 INFO:tasks.workunit.client.0.smithi037.stderr: -136> 2024-09-12T17:35:51.395+0000 7f8d20ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:35:51.754 INFO:tasks.workunit.client.0.smithi037.stderr: -135> 2024-09-12T17:35:51.395+0000 7f8d20ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:35:51.754 INFO:tasks.workunit.client.0.smithi037.stderr: -134> 2024-09-12T17:35:51.395+0000 7f8d20ff9640 10 monclient: dump: 2024-09-12T17:35:51.754 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:35:51.754 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:35:51.754 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:35:51.754 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:35:51.754 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:35:51.755 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:35:51.755 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:35:51.755 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:35:51.755 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:35:51.755 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:35:51.755 INFO:tasks.workunit.client.0.smithi037.stderr: -133> 2024-09-12T17:35:51.395+0000 7f8d227fc640 4 set_mon_vals no callback set 2024-09-12T17:35:51.755 INFO:tasks.workunit.client.0.smithi037.stderr: -132> 2024-09-12T17:35:51.395+0000 7f8e4332e800 5 monclient: authenticate success, global_id 7767 2024-09-12T17:35:51.755 INFO:tasks.workunit.client.0.smithi037.stderr: -131> 2024-09-12T17:35:51.395+0000 7f8e4332e800 10 monclient: _renew_subs 2024-09-12T17:35:51.755 INFO:tasks.workunit.client.0.smithi037.stderr: -130> 2024-09-12T17:35:51.395+0000 7f8e4332e800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.37:3300/0 2024-09-12T17:35:51.755 INFO:tasks.workunit.client.0.smithi037.stderr: -129> 2024-09-12T17:35:51.395+0000 7f8e4332e800 10 monclient: _renew_subs 2024-09-12T17:35:51.755 INFO:tasks.workunit.client.0.smithi037.stderr: -128> 2024-09-12T17:35:51.395+0000 7f8e4332e800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.37:3300/0 2024-09-12T17:35:51.755 INFO:tasks.workunit.client.0.smithi037.stderr: -127> 2024-09-12T17:35:51.395+0000 7f8e4332e800 1 librados: init done 2024-09-12T17:35:51.755 INFO:tasks.workunit.client.0.smithi037.stderr: -126> 2024-09-12T17:35:51.395+0000 7f8e4332e800 5 asok(0x560578c32730) register_command cr dump hook 0x560578f15d48 2024-09-12T17:35:51.755 INFO:tasks.workunit.client.0.smithi037.stderr: -125> 2024-09-12T17:35:51.397+0000 7f8e4332e800 20 rados->read ofs=0 len=0 2024-09-12T17:35:51.756 INFO:tasks.workunit.client.0.smithi037.stderr: -124> 2024-09-12T17:35:51.397+0000 7f8d20ff9640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:35:51.756 INFO:tasks.workunit.client.0.smithi037.stderr: -123> 2024-09-12T17:35:51.397+0000 7f8d20ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.40:6816/3916250676,v1:172.21.15.40:6817/3916250676] 2024-09-12T17:35:51.756 INFO:tasks.workunit.client.0.smithi037.stderr: -122> 2024-09-12T17:35:51.397+0000 7f8d20ff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.40:6816/3916250676,v1:172.21.15.40:6817/3916250676] 2024-09-12T17:35:51.756 INFO:tasks.workunit.client.0.smithi037.stderr: -121> 2024-09-12T17:35:51.397+0000 7f8e3ef6b640 10 monclient: get_auth_request con 0x7f8d08076470 auth_method 0 2024-09-12T17:35:51.756 INFO:tasks.workunit.client.0.smithi037.stderr: -120> 2024-09-12T17:35:51.398+0000 7f8e3f76c640 10 monclient: get_auth_request con 0x560578f3e5c0 auth_method 0 2024-09-12T17:35:51.756 INFO:tasks.workunit.client.0.smithi037.stderr: -119> 2024-09-12T17:35:51.398+0000 7f8e4332e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:51.756 INFO:tasks.workunit.client.0.smithi037.stderr: -118> 2024-09-12T17:35:51.398+0000 7f8e4332e800 20 realm 2024-09-12T17:35:51.756 INFO:tasks.workunit.client.0.smithi037.stderr: -117> 2024-09-12T17:35:51.398+0000 7f8e4332e800 20 rados->read ofs=0 len=0 2024-09-12T17:35:51.756 INFO:tasks.workunit.client.0.smithi037.stderr: -116> 2024-09-12T17:35:51.398+0000 7f8e4332e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:51.756 INFO:tasks.workunit.client.0.smithi037.stderr: -115> 2024-09-12T17:35:51.398+0000 7f8e4332e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:35:51.757 INFO:tasks.workunit.client.0.smithi037.stderr: -114> 2024-09-12T17:35:51.398+0000 7f8e4332e800 20 rados->read ofs=0 len=0 2024-09-12T17:35:51.757 INFO:tasks.workunit.client.0.smithi037.stderr: -113> 2024-09-12T17:35:51.398+0000 7f8e4332e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:51.757 INFO:tasks.workunit.client.0.smithi037.stderr: -112> 2024-09-12T17:35:51.398+0000 7f8e4332e800 20 rados->read ofs=0 len=0 2024-09-12T17:35:51.757 INFO:tasks.workunit.client.0.smithi037.stderr: -111> 2024-09-12T17:35:51.399+0000 7f8e3ef6b640 10 monclient: get_auth_request con 0x560578f42790 auth_method 0 2024-09-12T17:35:51.757 INFO:tasks.workunit.client.0.smithi037.stderr: -110> 2024-09-12T17:35:51.399+0000 7f8e4332e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:35:51.757 INFO:tasks.workunit.client.0.smithi037.stderr: -109> 2024-09-12T17:35:51.399+0000 7f8e4332e800 20 rados->read ofs=0 len=0 2024-09-12T17:35:51.757 INFO:tasks.workunit.client.0.smithi037.stderr: -108> 2024-09-12T17:35:51.400+0000 7f8e4332e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:35:51.757 INFO:tasks.workunit.client.0.smithi037.stderr: -107> 2024-09-12T17:35:51.400+0000 7f8e4332e800 20 searching for the correct realm 2024-09-12T17:35:51.757 INFO:tasks.workunit.client.0.smithi037.stderr: -106> 2024-09-12T17:35:51.400+0000 7f8e3e76a640 10 monclient: get_auth_request con 0x560578f479e0 auth_method 0 2024-09-12T17:35:51.757 INFO:tasks.workunit.client.0.smithi037.stderr: -105> 2024-09-12T17:35:51.400+0000 7f8e3f76c640 10 monclient: get_auth_request con 0x7f8e34096120 auth_method 0 2024-09-12T17:35:51.757 INFO:tasks.workunit.client.0.smithi037.stderr: -104> 2024-09-12T17:35:51.401+0000 7f8e3ef6b640 10 monclient: get_auth_request con 0x7f8e38017020 auth_method 0 2024-09-12T17:35:51.757 INFO:tasks.workunit.client.0.smithi037.stderr: -103> 2024-09-12T17:35:51.402+0000 7f8e3e76a640 10 monclient: get_auth_request con 0x7f8e3004f430 auth_method 0 2024-09-12T17:35:51.757 INFO:tasks.workunit.client.0.smithi037.stderr: -102> 2024-09-12T17:35:51.403+0000 7f8e3f76c640 0 -- 172.21.15.37:0/4162972020 >> [v2:172.21.15.40:6818/1210108009,v1:172.21.15.40:6819/1210108009] conn(0x7f8e34096120 msgr2=0x7f8e340cafb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:35:51.757 INFO:tasks.workunit.client.0.smithi037.stderr: -101> 2024-09-12T17:35:51.403+0000 7f8d20ff9640 1 client.7767.objecter ms_handle_reset 0x7f8e34096120 session 0x7f8e34005040 osd.7 2024-09-12T17:35:51.758 INFO:tasks.workunit.client.0.smithi037.stderr: -100> 2024-09-12T17:35:51.403+0000 7f8d20ff9640 10 monclient: _renew_subs 2024-09-12T17:35:51.758 INFO:tasks.workunit.client.0.smithi037.stderr: -99> 2024-09-12T17:35:51.403+0000 7f8d20ff9640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.37:3300/0 2024-09-12T17:35:51.758 INFO:tasks.workunit.client.0.smithi037.stderr: -98> 2024-09-12T17:35:51.403+0000 7f8e3f76c640 10 monclient: get_auth_request con 0x7f8d08086b10 auth_method 0 2024-09-12T17:35:51.758 INFO:tasks.workunit.client.0.smithi037.stderr: -97> 2024-09-12T17:35:51.404+0000 7f8e3f76c640 10 monclient: get_auth_request con 0x7f8e340d4b80 auth_method 0 2024-09-12T17:35:51.758 INFO:tasks.workunit.client.0.smithi037.stderr: -96> 2024-09-12T17:35:51.406+0000 7f8e3ef6b640 10 monclient: get_auth_request con 0x7f8e340b1b90 auth_method 0 2024-09-12T17:35:51.758 INFO:tasks.workunit.client.0.smithi037.stderr: -95> 2024-09-12T17:35:51.406+0000 7f8e3ef6b640 0 -- 172.21.15.37:0/4162972020 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7f8e340b1b90 msgr2=0x7f8e340b9050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:35:51.758 INFO:tasks.workunit.client.0.smithi037.stderr: -94> 2024-09-12T17:35:51.608+0000 7f8e3ef6b640 10 monclient: get_auth_request con 0x7f8e340b1b90 auth_method 0 2024-09-12T17:35:51.758 INFO:tasks.workunit.client.0.smithi037.stderr: -93> 2024-09-12T17:35:51.613+0000 7f8e4332e800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:35:51.758 INFO:tasks.workunit.client.0.smithi037.stderr: -92> 2024-09-12T17:35:51.613+0000 7f8e4332e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:35:51.758 INFO:tasks.workunit.client.0.smithi037.stderr: -91> 2024-09-12T17:35:51.613+0000 7f8e4332e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:35:51.758 INFO:tasks.workunit.client.0.smithi037.stderr: -90> 2024-09-12T17:35:51.613+0000 7f8e4332e800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:35:51.758 INFO:tasks.workunit.client.0.smithi037.stderr: -89> 2024-09-12T17:35:51.613+0000 7f8e4332e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:35:51.758 INFO:tasks.workunit.client.0.smithi037.stderr: -88> 2024-09-12T17:35:51.613+0000 7f8e4332e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:35:51.759 INFO:tasks.workunit.client.0.smithi037.stderr: -87> 2024-09-12T17:35:51.613+0000 7f8e4332e800 20 rados->read ofs=0 len=0 2024-09-12T17:35:51.759 INFO:tasks.workunit.client.0.smithi037.stderr: -86> 2024-09-12T17:35:51.613+0000 7f8e4332e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:51.759 INFO:tasks.workunit.client.0.smithi037.stderr: -85> 2024-09-12T17:35:51.613+0000 7f8e4332e800 20 rados->read ofs=0 len=0 2024-09-12T17:35:51.759 INFO:tasks.workunit.client.0.smithi037.stderr: -84> 2024-09-12T17:35:51.614+0000 7f8e4332e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:35:51.759 INFO:tasks.workunit.client.0.smithi037.stderr: -83> 2024-09-12T17:35:51.614+0000 7f8e4332e800 20 rados->read ofs=0 len=0 2024-09-12T17:35:51.759 INFO:tasks.workunit.client.0.smithi037.stderr: -82> 2024-09-12T17:35:51.614+0000 7f8e4332e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:35:51.759 INFO:tasks.workunit.client.0.smithi037.stderr: -81> 2024-09-12T17:35:51.614+0000 7f8e4332e800 20 zone default found 2024-09-12T17:35:51.759 INFO:tasks.workunit.client.0.smithi037.stderr: -80> 2024-09-12T17:35:51.614+0000 7f8e4332e800 4 Realm: () 2024-09-12T17:35:51.759 INFO:tasks.workunit.client.0.smithi037.stderr: -79> 2024-09-12T17:35:51.614+0000 7f8e4332e800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:35:51.759 INFO:tasks.workunit.client.0.smithi037.stderr: -78> 2024-09-12T17:35:51.614+0000 7f8e4332e800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:35:51.760 INFO:tasks.workunit.client.0.smithi037.stderr: -77> 2024-09-12T17:35:51.614+0000 7f8e4332e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:35:51.760 INFO:tasks.workunit.client.0.smithi037.stderr: -76> 2024-09-12T17:35:51.614+0000 7f8e4332e800 20 zonegroup default 2024-09-12T17:35:51.760 INFO:tasks.workunit.client.0.smithi037.stderr: -75> 2024-09-12T17:35:51.614+0000 7f8e4332e800 20 rados->read ofs=0 len=0 2024-09-12T17:35:51.760 INFO:tasks.workunit.client.0.smithi037.stderr: -74> 2024-09-12T17:35:51.614+0000 7f8e4332e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:51.760 INFO:tasks.workunit.client.0.smithi037.stderr: -73> 2024-09-12T17:35:51.614+0000 7f8e4332e800 20 rados->read ofs=0 len=0 2024-09-12T17:35:51.760 INFO:tasks.workunit.client.0.smithi037.stderr: -72> 2024-09-12T17:35:51.615+0000 7f8e4332e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:51.760 INFO:tasks.workunit.client.0.smithi037.stderr: -71> 2024-09-12T17:35:51.615+0000 7f8e4332e800 20 rados->read ofs=0 len=0 2024-09-12T17:35:51.760 INFO:tasks.workunit.client.0.smithi037.stderr: -70> 2024-09-12T17:35:51.615+0000 7f8e4332e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:51.760 INFO:tasks.workunit.client.0.smithi037.stderr: -69> 2024-09-12T17:35:51.615+0000 7f8e4332e800 20 started sync module instance, tier type = 2024-09-12T17:35:51.760 INFO:tasks.workunit.client.0.smithi037.stderr: -68> 2024-09-12T17:35:51.615+0000 7f8e4332e800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:35:51.760 INFO:tasks.workunit.client.0.smithi037.stderr: -67> 2024-09-12T17:35:51.624+0000 7f8e4332e800 20 add_watcher() i=0 2024-09-12T17:35:51.760 INFO:tasks.workunit.client.0.smithi037.stderr: -66> 2024-09-12T17:35:51.624+0000 7f8e4332e800 20 add_watcher() i=1 2024-09-12T17:35:51.760 INFO:tasks.workunit.client.0.smithi037.stderr: -65> 2024-09-12T17:35:51.624+0000 7f8e4332e800 20 add_watcher() i=2 2024-09-12T17:35:51.761 INFO:tasks.workunit.client.0.smithi037.stderr: -64> 2024-09-12T17:35:51.624+0000 7f8e4332e800 20 add_watcher() i=3 2024-09-12T17:35:51.761 INFO:tasks.workunit.client.0.smithi037.stderr: -63> 2024-09-12T17:35:51.624+0000 7f8e4332e800 20 add_watcher() i=4 2024-09-12T17:35:51.761 INFO:tasks.workunit.client.0.smithi037.stderr: -62> 2024-09-12T17:35:51.624+0000 7f8e4332e800 20 add_watcher() i=5 2024-09-12T17:35:51.761 INFO:tasks.workunit.client.0.smithi037.stderr: -61> 2024-09-12T17:35:51.624+0000 7f8e4332e800 20 add_watcher() i=6 2024-09-12T17:35:51.761 INFO:tasks.workunit.client.0.smithi037.stderr: -60> 2024-09-12T17:35:51.625+0000 7f8e4332e800 20 add_watcher() i=7 2024-09-12T17:35:51.761 INFO:tasks.workunit.client.0.smithi037.stderr: -59> 2024-09-12T17:35:51.625+0000 7f8e4332e800 2 all 8 watchers are set, enabling cache 2024-09-12T17:35:51.761 INFO:tasks.workunit.client.0.smithi037.stderr: -58> 2024-09-12T17:35:51.627+0000 7f8e4332e800 5 AuthRegistry(0x7ffef27ad9e0) adding auth protocol: cephx 2024-09-12T17:35:51.761 INFO:tasks.workunit.client.0.smithi037.stderr: -57> 2024-09-12T17:35:51.627+0000 7f8e4332e800 5 AuthRegistry(0x7ffef27ad9e0) adding auth protocol: cephx 2024-09-12T17:35:51.761 INFO:tasks.workunit.client.0.smithi037.stderr: -56> 2024-09-12T17:35:51.627+0000 7f8e4332e800 5 AuthRegistry(0x7ffef27ad9e0) adding auth protocol: cephx 2024-09-12T17:35:51.761 INFO:tasks.workunit.client.0.smithi037.stderr: -55> 2024-09-12T17:35:51.627+0000 7f8e4332e800 5 AuthRegistry(0x7ffef27ad9e0) adding con mode: secure 2024-09-12T17:35:51.761 INFO:tasks.workunit.client.0.smithi037.stderr: -54> 2024-09-12T17:35:51.627+0000 7f8e4332e800 5 AuthRegistry(0x7ffef27ad9e0) adding con mode: crc 2024-09-12T17:35:51.761 INFO:tasks.workunit.client.0.smithi037.stderr: -53> 2024-09-12T17:35:51.627+0000 7f8e4332e800 5 AuthRegistry(0x7ffef27ad9e0) adding con mode: secure 2024-09-12T17:35:51.761 INFO:tasks.workunit.client.0.smithi037.stderr: -52> 2024-09-12T17:35:51.627+0000 7f8e4332e800 5 AuthRegistry(0x7ffef27ad9e0) adding con mode: crc 2024-09-12T17:35:51.762 INFO:tasks.workunit.client.0.smithi037.stderr: -51> 2024-09-12T17:35:51.627+0000 7f8e4332e800 5 AuthRegistry(0x7ffef27ad9e0) adding con mode: secure 2024-09-12T17:35:51.762 INFO:tasks.workunit.client.0.smithi037.stderr: -50> 2024-09-12T17:35:51.627+0000 7f8e4332e800 5 AuthRegistry(0x7ffef27ad9e0) adding con mode: crc 2024-09-12T17:35:51.762 INFO:tasks.workunit.client.0.smithi037.stderr: -49> 2024-09-12T17:35:51.627+0000 7f8e4332e800 5 AuthRegistry(0x7ffef27ad9e0) adding con mode: crc 2024-09-12T17:35:51.762 INFO:tasks.workunit.client.0.smithi037.stderr: -48> 2024-09-12T17:35:51.627+0000 7f8e4332e800 5 AuthRegistry(0x7ffef27ad9e0) adding con mode: secure 2024-09-12T17:35:51.762 INFO:tasks.workunit.client.0.smithi037.stderr: -47> 2024-09-12T17:35:51.627+0000 7f8e4332e800 5 AuthRegistry(0x7ffef27ad9e0) adding con mode: crc 2024-09-12T17:35:51.762 INFO:tasks.workunit.client.0.smithi037.stderr: -46> 2024-09-12T17:35:51.627+0000 7f8e4332e800 5 AuthRegistry(0x7ffef27ad9e0) adding con mode: secure 2024-09-12T17:35:51.762 INFO:tasks.workunit.client.0.smithi037.stderr: -45> 2024-09-12T17:35:51.627+0000 7f8e4332e800 5 AuthRegistry(0x7ffef27ad9e0) adding con mode: crc 2024-09-12T17:35:51.762 INFO:tasks.workunit.client.0.smithi037.stderr: -44> 2024-09-12T17:35:51.627+0000 7f8e4332e800 5 AuthRegistry(0x7ffef27ad9e0) adding con mode: secure 2024-09-12T17:35:51.762 INFO:tasks.workunit.client.0.smithi037.stderr: -43> 2024-09-12T17:35:51.627+0000 7f8cf57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:35:51.762 INFO:tasks.workunit.client.0.smithi037.stderr: -42> 2024-09-12T17:35:51.627+0000 7f8e4332e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:35:51.762 INFO:tasks.workunit.client.0.smithi037.stderr: -41> 2024-09-12T17:35:51.627+0000 7f8e4332e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:35:51.762 INFO:tasks.workunit.client.0.smithi037.stderr: -40> 2024-09-12T17:35:51.627+0000 7f8e4332e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:35:51.762 INFO:tasks.workunit.client.0.smithi037.stderr: -39> 2024-09-12T17:35:51.627+0000 7f8e4332e800 5 asok(0x560578c32730) register_command cache list hook 0x560578f1ca50 2024-09-12T17:35:51.762 INFO:tasks.workunit.client.0.smithi037.stderr: -38> 2024-09-12T17:35:51.627+0000 7f8e4332e800 5 asok(0x560578c32730) register_command cache inspect hook 0x560578f1ca50 2024-09-12T17:35:51.763 INFO:tasks.workunit.client.0.smithi037.stderr: -37> 2024-09-12T17:35:51.627+0000 7f8e4332e800 5 asok(0x560578c32730) register_command cache erase hook 0x560578f1ca50 2024-09-12T17:35:51.763 INFO:tasks.workunit.client.0.smithi037.stderr: -36> 2024-09-12T17:35:51.627+0000 7f8e4332e800 5 asok(0x560578c32730) register_command cache zap hook 0x560578f1ca50 2024-09-12T17:35:51.763 INFO:tasks.workunit.client.0.smithi037.stderr: -35> 2024-09-12T17:35:51.627+0000 7f8e4332e800 5 note: GC not initialized 2024-09-12T17:35:51.763 INFO:tasks.workunit.client.0.smithi037.stderr: -34> 2024-09-12T17:35:51.628+0000 7f8c6ffff640 20 reqs_thread_entry: start 2024-09-12T17:35:51.763 INFO:tasks.workunit.client.0.smithi037.stderr: -33> 2024-09-12T17:35:51.628+0000 7f8e4332e800 5 asok(0x560578c32730) register_command sync trace show hook 0x7f8e30013070 2024-09-12T17:35:51.763 INFO:tasks.workunit.client.0.smithi037.stderr: -32> 2024-09-12T17:35:51.628+0000 7f8e4332e800 5 asok(0x560578c32730) register_command sync trace history hook 0x7f8e30013070 2024-09-12T17:35:51.763 INFO:tasks.workunit.client.0.smithi037.stderr: -31> 2024-09-12T17:35:51.628+0000 7f8e4332e800 5 asok(0x560578c32730) register_command sync trace active hook 0x7f8e30013070 2024-09-12T17:35:51.763 INFO:tasks.workunit.client.0.smithi037.stderr: -30> 2024-09-12T17:35:51.628+0000 7f8e4332e800 5 asok(0x560578c32730) register_command sync trace active_short hook 0x7f8e30013070 2024-09-12T17:35:51.763 INFO:tasks.workunit.client.0.smithi037.stderr: -29> 2024-09-12T17:35:51.628+0000 7f8e4332e800 20 init_complete bucket index max shards: 11 2024-09-12T17:35:51.763 INFO:tasks.workunit.client.0.smithi037.stderr: -28> 2024-09-12T17:35:51.628+0000 7f8e4332e800 20 Filter name: none 2024-09-12T17:35:51.763 INFO:tasks.workunit.client.0.smithi037.stderr: -27> 2024-09-12T17:35:51.628+0000 7f8c6dffb640 20 reqs_thread_entry: start 2024-09-12T17:35:51.763 INFO:tasks.workunit.client.0.smithi037.stderr: -26> 2024-09-12T17:35:51.628+0000 7f8e4332e800 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-12T17:35:51.763 INFO:tasks.workunit.client.0.smithi037.stderr: -25> 2024-09-12T17:35:51.628+0000 7f8e4332e800 20 rados->read ofs=0 len=0 2024-09-12T17:35:51.763 INFO:tasks.workunit.client.0.smithi037.stderr: -24> 2024-09-12T17:35:51.628+0000 7f8e4332e800 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T17:35:51.764 INFO:tasks.workunit.client.0.smithi037.stderr: -23> 2024-09-12T17:35:51.628+0000 7f8e4332e800 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-12T17:35:51.764 INFO:tasks.workunit.client.0.smithi037.stderr: -22> 2024-09-12T17:35:51.628+0000 7f8e4332e800 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-12T17:35:51.764 INFO:tasks.workunit.client.0.smithi037.stderr: -21> 2024-09-12T17:35:51.628+0000 7f8e4332e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.37 : miss 2024-09-12T17:35:51.764 INFO:tasks.workunit.client.0.smithi037.stderr: -20> 2024-09-12T17:35:51.628+0000 7f8e4332e800 20 rados->read ofs=0 len=0 2024-09-12T17:35:51.764 INFO:tasks.workunit.client.0.smithi037.stderr: -19> 2024-09-12T17:35:51.629+0000 7f8e4332e800 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T17:35:51.764 INFO:tasks.workunit.client.0.smithi037.stderr: -18> 2024-09-12T17:35:51.629+0000 7f8e4332e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.37 info.flags=0x17 2024-09-12T17:35:51.764 INFO:tasks.workunit.client.0.smithi037.stderr: -17> 2024-09-12T17:35:51.629+0000 7f8e4332e800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.37 to cache LRU end 2024-09-12T17:35:51.764 INFO:tasks.workunit.client.0.smithi037.stderr: -16> 2024-09-12T17:35:51.629+0000 7f8e4332e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:35:51.764 INFO:tasks.workunit.client.0.smithi037.stderr: -15> 2024-09-12T17:35:51.629+0000 7f8e4332e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:35:51.764 INFO:tasks.workunit.client.0.smithi037.stderr: -14> 2024-09-12T17:35:51.629+0000 7f8e4332e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.37 2024-09-12T17:35:51.764 INFO:tasks.workunit.client.0.smithi037.stderr: -13> 2024-09-12T17:35:51.635+0000 7f8e4332e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.37 info.flags=0x17 2024-09-12T17:35:51.764 INFO:tasks.workunit.client.0.smithi037.stderr: -12> 2024-09-12T17:35:51.635+0000 7f8e4332e800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.37 to cache LRU end 2024-09-12T17:35:51.764 INFO:tasks.workunit.client.0.smithi037.stderr: -11> 2024-09-12T17:35:51.635+0000 7f8e4332e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:35:51.765 INFO:tasks.workunit.client.0.smithi037.stderr: -10> 2024-09-12T17:35:51.635+0000 7f8e4332e800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.37, ofs0, ns] 2024-09-12T17:35:51.765 INFO:tasks.workunit.client.0.smithi037.stderr: -9> 2024-09-12T17:35:51.635+0000 7f8d227fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497000 cookie 94581504149664 notifier 7767 bl.length()=1007 2024-09-12T17:35:51.765 INFO:tasks.workunit.client.0.smithi037.stderr: -8> 2024-09-12T17:35:51.636+0000 7f8d227fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.37 info.flags=0x17 2024-09-12T17:35:51.765 INFO:tasks.workunit.client.0.smithi037.stderr: -7> 2024-09-12T17:35:51.636+0000 7f8d227fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.37 to cache LRU end 2024-09-12T17:35:51.765 INFO:tasks.workunit.client.0.smithi037.stderr: -6> 2024-09-12T17:35:51.636+0000 7f8d227fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:35:51.765 INFO:tasks.workunit.client.0.smithi037.stderr: -5> 2024-09-12T17:35:51.637+0000 7f8e4332e800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.37]): orig_sources= new_sources= 2024-09-12T17:35:51.765 INFO:tasks.workunit.client.0.smithi037.stderr: -4> 2024-09-12T17:35:51.637+0000 7f8e4332e800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.37]): potential sources added=[] removed=[] 2024-09-12T17:35:51.765 INFO:tasks.workunit.client.0.smithi037.stderr: -3> 2024-09-12T17:35:51.637+0000 7f8e4332e800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.37]): orig_dests= new_dests= 2024-09-12T17:35:51.765 INFO:tasks.workunit.client.0.smithi037.stderr: -2> 2024-09-12T17:35:51.637+0000 7f8e4332e800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.37]): potential dests added=[] removed=[] 2024-09-12T17:35:51.765 INFO:tasks.workunit.client.0.smithi037.stderr: -1> 2024-09-12T17:35:51.640+0000 7f8e4332e800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f8e4332e800 time 2024-09-12T17:35:51.641634+0000 2024-09-12T17:35:51.765 INFO:tasks.workunit.client.0.smithi037.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:35:51.765 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:35:51.765 INFO:tasks.workunit.client.0.smithi037.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:35:51.766 INFO:tasks.workunit.client.0.smithi037.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f8e4498c71a] 2024-09-12T17:35:51.766 INFO:tasks.workunit.client.0.smithi037.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f8e4498c8d8] 2024-09-12T17:35:51.766 INFO:tasks.workunit.client.0.smithi037.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x560576758841] 2024-09-12T17:35:51.766 INFO:tasks.workunit.client.0.smithi037.stderr: 4: radosgw-admin(+0xd7490c) [0x560576c6690c] 2024-09-12T17:35:51.766 INFO:tasks.workunit.client.0.smithi037.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x56057676850d] 2024-09-12T17:35:51.766 INFO:tasks.workunit.client.0.smithi037.stderr: 6: main() 2024-09-12T17:35:51.766 INFO:tasks.workunit.client.0.smithi037.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f8e43629590] 2024-09-12T17:35:51.766 INFO:tasks.workunit.client.0.smithi037.stderr: 8: __libc_start_main() 2024-09-12T17:35:51.766 INFO:tasks.workunit.client.0.smithi037.stderr: 9: _start() 2024-09-12T17:35:51.766 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:35:51.766 INFO:tasks.workunit.client.0.smithi037.stderr: 0> 2024-09-12T17:35:51.641+0000 7f8e4332e800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:35:51.766 INFO:tasks.workunit.client.0.smithi037.stderr: in thread 7f8e4332e800 thread_name:radosgw-admin 2024-09-12T17:35:51.766 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:35:51.767 INFO:tasks.workunit.client.0.smithi037.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:35:51.767 INFO:tasks.workunit.client.0.smithi037.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f8e4363e6f0] 2024-09-12T17:35:51.767 INFO:tasks.workunit.client.0.smithi037.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f8e4368b99c] 2024-09-12T17:35:51.767 INFO:tasks.workunit.client.0.smithi037.stderr: 3: raise() 2024-09-12T17:35:51.767 INFO:tasks.workunit.client.0.smithi037.stderr: 4: abort() 2024-09-12T17:35:51.767 INFO:tasks.workunit.client.0.smithi037.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f8e4498c774] 2024-09-12T17:35:51.767 INFO:tasks.workunit.client.0.smithi037.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f8e4498c8d8] 2024-09-12T17:35:51.767 INFO:tasks.workunit.client.0.smithi037.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x560576758841] 2024-09-12T17:35:51.767 INFO:tasks.workunit.client.0.smithi037.stderr: 8: radosgw-admin(+0xd7490c) [0x560576c6690c] 2024-09-12T17:35:51.767 INFO:tasks.workunit.client.0.smithi037.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x56057676850d] 2024-09-12T17:35:51.767 INFO:tasks.workunit.client.0.smithi037.stderr: 10: main() 2024-09-12T17:35:51.767 INFO:tasks.workunit.client.0.smithi037.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f8e43629590] 2024-09-12T17:35:51.767 INFO:tasks.workunit.client.0.smithi037.stderr: 12: __libc_start_main() 2024-09-12T17:35:51.767 INFO:tasks.workunit.client.0.smithi037.stderr: 13: _start() 2024-09-12T17:35:51.768 INFO:tasks.workunit.client.0.smithi037.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:35:51.768 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:35:51.768 INFO:tasks.workunit.client.0.smithi037.stderr:--- logging levels --- 2024-09-12T17:35:51.768 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 none 2024-09-12T17:35:51.768 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 lockdep 2024-09-12T17:35:51.768 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 context 2024-09-12T17:35:51.768 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 1 crush 2024-09-12T17:35:51.768 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mds 2024-09-12T17:35:51.768 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mds_balancer 2024-09-12T17:35:51.768 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mds_locker 2024-09-12T17:35:51.768 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mds_log 2024-09-12T17:35:51.768 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mds_log_expire 2024-09-12T17:35:51.768 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mds_migrator 2024-09-12T17:35:51.769 INFO:tasks.workunit.client.0.smithi037.stderr: 3/ 5 mds_quiesce 2024-09-12T17:35:51.769 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 buffer 2024-09-12T17:35:51.769 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 timer 2024-09-12T17:35:51.769 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 filer 2024-09-12T17:35:51.769 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 striper 2024-09-12T17:35:51.769 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 objecter 2024-09-12T17:35:51.769 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 rados 2024-09-12T17:35:51.769 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 rbd 2024-09-12T17:35:51.769 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 rbd_mirror 2024-09-12T17:35:51.769 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 rbd_replay 2024-09-12T17:35:51.769 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 rbd_pwl 2024-09-12T17:35:51.769 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 journaler 2024-09-12T17:35:51.769 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 objectcacher 2024-09-12T17:35:51.769 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:35:51.770 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 client 2024-09-12T17:35:51.770 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 osd 2024-09-12T17:35:51.770 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 optracker 2024-09-12T17:35:51.770 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 objclass 2024-09-12T17:35:51.770 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 3 filestore 2024-09-12T17:35:51.771 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 3 journal 2024-09-12T17:35:51.771 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 0 ms 2024-09-12T17:35:51.771 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mon 2024-09-12T17:35:51.771 INFO:tasks.workunit.client.0.smithi037.stderr: 0/10 monc 2024-09-12T17:35:51.771 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 paxos 2024-09-12T17:35:51.771 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 tp 2024-09-12T17:35:51.771 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 auth 2024-09-12T17:35:51.771 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 crypto 2024-09-12T17:35:51.771 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 1 finisher 2024-09-12T17:35:51.771 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 1 reserver 2024-09-12T17:35:51.771 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 heartbeatmap 2024-09-12T17:35:51.771 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 perfcounter 2024-09-12T17:35:51.771 INFO:tasks.workunit.client.0.smithi037.stderr: 20/20 rgw 2024-09-12T17:35:51.771 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 rgw_sync 2024-09-12T17:35:51.772 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 rgw_datacache 2024-09-12T17:35:51.772 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 rgw_access 2024-09-12T17:35:51.772 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:35:51.772 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 rgw_flight 2024-09-12T17:35:51.772 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:35:51.772 INFO:tasks.workunit.client.0.smithi037.stderr: 20/20 rgw_notification 2024-09-12T17:35:51.772 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 javaclient 2024-09-12T17:35:51.772 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 asok 2024-09-12T17:35:51.772 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 1 throttle 2024-09-12T17:35:51.772 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 0 refs 2024-09-12T17:35:51.772 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 compressor 2024-09-12T17:35:51.772 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 bluestore 2024-09-12T17:35:51.772 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 bluefs 2024-09-12T17:35:51.773 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 3 bdev 2024-09-12T17:35:51.773 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 kstore 2024-09-12T17:35:51.773 INFO:tasks.workunit.client.0.smithi037.stderr: 4/ 5 rocksdb 2024-09-12T17:35:51.773 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 fuse 2024-09-12T17:35:51.773 INFO:tasks.workunit.client.0.smithi037.stderr: 2/ 5 mgr 2024-09-12T17:35:51.773 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mgrc 2024-09-12T17:35:51.773 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 dpdk 2024-09-12T17:35:51.773 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 eventtrace 2024-09-12T17:35:51.773 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 prioritycache 2024-09-12T17:35:51.773 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 test 2024-09-12T17:35:51.773 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:35:51.773 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 cephsqlite 2024-09-12T17:35:51.773 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:35:51.773 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore 2024-09-12T17:35:51.773 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_onode 2024-09-12T17:35:51.774 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_odata 2024-09-12T17:35:51.774 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_omap 2024-09-12T17:35:51.774 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_tm 2024-09-12T17:35:51.774 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_t 2024-09-12T17:35:51.774 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:35:51.774 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_epm 2024-09-12T17:35:51.774 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_lba 2024-09-12T17:35:51.774 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:35:51.774 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_cache 2024-09-12T17:35:51.774 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_journal 2024-09-12T17:35:51.774 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_device 2024-09-12T17:35:51.774 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_backref 2024-09-12T17:35:51.774 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 alienstore 2024-09-12T17:35:51.774 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mclock 2024-09-12T17:35:51.775 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 cyanstore 2024-09-12T17:35:51.775 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 ceph_exporter 2024-09-12T17:35:51.775 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 memstore 2024-09-12T17:35:51.775 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 trace 2024-09-12T17:35:51.775 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 ceph_dedup 2024-09-12T17:35:51.775 INFO:tasks.workunit.client.0.smithi037.stderr: -2/-2 (syslog threshold) 2024-09-12T17:35:51.775 INFO:tasks.workunit.client.0.smithi037.stderr: 99/99 (stderr threshold) 2024-09-12T17:35:51.775 INFO:tasks.workunit.client.0.smithi037.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:35:51.775 INFO:tasks.workunit.client.0.smithi037.stderr: 7f8c6dffb640 / http_manager 2024-09-12T17:35:51.775 INFO:tasks.workunit.client.0.smithi037.stderr: 7f8c6ffff640 / http_manager 2024-09-12T17:35:51.775 INFO:tasks.workunit.client.0.smithi037.stderr: 7f8cf57e2640 / rgw_dt_lg_renew 2024-09-12T17:35:51.775 INFO:tasks.workunit.client.0.smithi037.stderr: 7f8d20ff9640 / ms_dispatch 2024-09-12T17:35:51.775 INFO:tasks.workunit.client.0.smithi037.stderr: 7f8d227fc640 / io_context_pool 2024-09-12T17:35:51.775 INFO:tasks.workunit.client.0.smithi037.stderr: 7f8d28e01640 / ms_dispatch 2024-09-12T17:35:51.776 INFO:tasks.workunit.client.0.smithi037.stderr: 7f8d2b606640 / ms_dispatch 2024-09-12T17:35:51.776 INFO:tasks.workunit.client.0.smithi037.stderr: 7f8d2ce09640 / io_context_pool 2024-09-12T17:35:51.776 INFO:tasks.workunit.client.0.smithi037.stderr: 7f8e3e76a640 / msgr-worker-2 2024-09-12T17:35:51.776 INFO:tasks.workunit.client.0.smithi037.stderr: 7f8e3ef6b640 / msgr-worker-1 2024-09-12T17:35:51.776 INFO:tasks.workunit.client.0.smithi037.stderr: 7f8e3f76c640 / msgr-worker-0 2024-09-12T17:35:51.776 INFO:tasks.workunit.client.0.smithi037.stderr: 7f8e3ff6d640 / io_context_pool 2024-09-12T17:35:51.776 INFO:tasks.workunit.client.0.smithi037.stderr: 7f8e4332e800 / radosgw-admin 2024-09-12T17:35:51.776 INFO:tasks.workunit.client.0.smithi037.stderr: max_recent 500 2024-09-12T17:35:51.776 INFO:tasks.workunit.client.0.smithi037.stderr: max_new 1000 2024-09-12T17:35:51.776 INFO:tasks.workunit.client.0.smithi037.stderr: log_file /var/lib/ceph/crash/2024-09-12T17:35:51.643312Z_254e91d1-2589-4d8c-b0bd-d10745247671/log 2024-09-12T17:35:51.776 INFO:tasks.workunit.client.0.smithi037.stderr:--- end dump of recent events --- 2024-09-12T17:35:51.776 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bucket stats --bucket abort-at-logrecord-writes 2024-09-12T17:35:51.778 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:35:51.778 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:35:51.778 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.719+0000 7f75e5b19800 20 rados->read ofs=0 len=0 2024-09-12T17:35:51.778 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.721+0000 7f75e5b19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:51.778 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.721+0000 7f75e5b19800 20 realm 2024-09-12T17:35:51.779 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.721+0000 7f75e5b19800 20 rados->read ofs=0 len=0 2024-09-12T17:35:51.779 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.721+0000 7f75e5b19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:51.779 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.721+0000 7f75e5b19800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:35:51.779 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.721+0000 7f75e5b19800 20 rados->read ofs=0 len=0 2024-09-12T17:35:51.779 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.722+0000 7f75e5b19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:51.779 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.722+0000 7f75e5b19800 20 rados->read ofs=0 len=0 2024-09-12T17:35:51.779 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.722+0000 7f75e5b19800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:35:51.779 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.722+0000 7f75e5b19800 20 rados->read ofs=0 len=0 2024-09-12T17:35:51.779 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.723+0000 7f75e5b19800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:35:51.779 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.723+0000 7f75e5b19800 20 searching for the correct realm 2024-09-12T17:35:51.779 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.725+0000 7f75e2e02640 0 -- 172.21.15.37:0/4174172133 >> [v2:172.21.15.40:6800/2441293461,v1:172.21.15.40:6801/2441293461] conn(0x7f75d4089050 msgr2=0x7f75d40639b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:35:51.779 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.730+0000 7f75e3603640 0 -- 172.21.15.37:0/4174172133 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7f75d8074600 msgr2=0x7f75d8001950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:35:51.939 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.936+0000 7f75e5b19800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:35:51.939 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.936+0000 7f75e5b19800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:35:51.939 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.936+0000 7f75e5b19800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:35:51.939 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.936+0000 7f75e5b19800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:35:51.939 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.936+0000 7f75e5b19800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:35:51.939 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.936+0000 7f75e5b19800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:35:51.939 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.936+0000 7f75e5b19800 20 rados->read ofs=0 len=0 2024-09-12T17:35:51.939 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.937+0000 7f75e5b19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:51.939 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.937+0000 7f75e5b19800 20 rados->read ofs=0 len=0 2024-09-12T17:35:51.939 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.937+0000 7f75e5b19800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:35:51.940 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.937+0000 7f75e5b19800 20 rados->read ofs=0 len=0 2024-09-12T17:35:51.941 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.937+0000 7f75e5b19800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:35:51.941 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.937+0000 7f75e5b19800 20 zone default found 2024-09-12T17:35:51.941 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.937+0000 7f75e5b19800 4 Realm: () 2024-09-12T17:35:51.941 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.937+0000 7f75e5b19800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:35:51.941 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.937+0000 7f75e5b19800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:35:51.941 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.937+0000 7f75e5b19800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:35:51.941 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.937+0000 7f75e5b19800 20 zonegroup default 2024-09-12T17:35:51.941 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.937+0000 7f75e5b19800 20 rados->read ofs=0 len=0 2024-09-12T17:35:51.941 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.937+0000 7f75e5b19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:51.942 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.938+0000 7f75e5b19800 20 rados->read ofs=0 len=0 2024-09-12T17:35:51.942 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.938+0000 7f75e5b19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:51.942 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.938+0000 7f75e5b19800 20 rados->read ofs=0 len=0 2024-09-12T17:35:51.942 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.938+0000 7f75e5b19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:51.942 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.938+0000 7f75e5b19800 20 started sync module instance, tier type = 2024-09-12T17:35:51.942 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.938+0000 7f75e5b19800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:35:51.949 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.947+0000 7f75e5b19800 20 add_watcher() i=0 2024-09-12T17:35:51.949 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.948+0000 7f75e5b19800 20 add_watcher() i=1 2024-09-12T17:35:51.949 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.948+0000 7f75e5b19800 20 add_watcher() i=2 2024-09-12T17:35:51.950 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.948+0000 7f75e5b19800 20 add_watcher() i=3 2024-09-12T17:35:51.950 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.948+0000 7f75e5b19800 20 add_watcher() i=4 2024-09-12T17:35:51.950 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.948+0000 7f75e5b19800 20 add_watcher() i=5 2024-09-12T17:35:51.950 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.948+0000 7f75e5b19800 20 add_watcher() i=6 2024-09-12T17:35:51.950 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.948+0000 7f75e5b19800 20 add_watcher() i=7 2024-09-12T17:35:51.950 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.948+0000 7f75e5b19800 2 all 8 watchers are set, enabling cache 2024-09-12T17:35:51.952 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.950+0000 7f7499fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:35:51.953 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.950+0000 7f75e5b19800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:35:51.953 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.950+0000 7f75e5b19800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:35:51.953 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.950+0000 7f75e5b19800 5 note: GC not initialized 2024-09-12T17:35:51.953 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.951+0000 7f7498fe1640 20 reqs_thread_entry: start 2024-09-12T17:35:51.953 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.951+0000 7f75e5b19800 20 init_complete bucket index max shards: 11 2024-09-12T17:35:51.954 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.951+0000 7f75e5b19800 20 Filter name: none 2024-09-12T17:35:51.954 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.951+0000 7f74127fc640 20 reqs_thread_entry: start 2024-09-12T17:35:51.954 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.951+0000 7f75e5b19800 20 rados->read ofs=0 len=0 2024-09-12T17:35:51.954 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.951+0000 7f75e5b19800 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T17:35:51.954 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.951+0000 7f75e5b19800 20 rados->read ofs=0 len=0 2024-09-12T17:35:51.955 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.952+0000 7f75e5b19800 20 rados_obj.operate() r=0 bl.length=471 2024-09-12T17:35:51.955 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.952+0000 7f75e5b19800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:35:51.955 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.952+0000 7f75e5b19800 20 rados->read ofs=0 len=0 2024-09-12T17:35:51.955 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.952+0000 7f75e5b19800 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T17:35:51.955 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.952+0000 7f75e5b19800 20 rados->read ofs=0 len=0 2024-09-12T17:35:51.955 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.952+0000 7f75e5b19800 20 rados_obj.operate() r=0 bl.length=471 2024-09-12T17:35:51.955 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.952+0000 7f75e5b19800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:35:51.956 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.954+0000 7f7499fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:35:51.958 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.956+0000 7f75e5b19800 20 remove_watcher() i=0 2024-09-12T17:35:51.958 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.956+0000 7f75e5b19800 2 removed watcher, disabling cache 2024-09-12T17:35:51.959 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.958+0000 7f75e5b19800 20 remove_watcher() i=1 2024-09-12T17:35:51.960 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.959+0000 7f75e5b19800 20 remove_watcher() i=2 2024-09-12T17:35:51.961 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.960+0000 7f75e5b19800 20 remove_watcher() i=3 2024-09-12T17:35:51.962 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.961+0000 7f75e5b19800 20 remove_watcher() i=4 2024-09-12T17:35:51.963 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.962+0000 7f75e5b19800 20 remove_watcher() i=5 2024-09-12T17:35:51.964 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.963+0000 7f75e5b19800 20 remove_watcher() i=6 2024-09-12T17:35:51.965 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:51.964+0000 7f75e5b19800 20 remove_watcher() i=7 2024-09-12T17:35:51.977 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:35:51.977 INFO:tasks.workunit.client.0.smithi037.stderr:BUCKET_STATS: 2024-09-12T17:35:51.977 INFO:tasks.workunit.client.0.smithi037.stderr:bucket: abort-at-logrecord-writes id: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.37 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:35:51.977 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:35:52.067 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bucket reshard --bucket abort-at-logrecord-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:35:52.099 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:35:52.100 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:35:52.138 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:52.136+0000 7f674ed46800 20 rados->read ofs=0 len=0 2024-09-12T17:35:52.140 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:52.138+0000 7f674ed46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:52.141 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:52.138+0000 7f674ed46800 20 realm 2024-09-12T17:35:52.141 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:52.138+0000 7f674ed46800 20 rados->read ofs=0 len=0 2024-09-12T17:35:52.141 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:52.138+0000 7f674ed46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:52.141 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:52.138+0000 7f674ed46800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:35:52.141 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:52.138+0000 7f674ed46800 20 rados->read ofs=0 len=0 2024-09-12T17:35:52.141 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:52.138+0000 7f674ed46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:52.141 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:52.138+0000 7f674ed46800 20 rados->read ofs=0 len=0 2024-09-12T17:35:52.142 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:52.139+0000 7f674ed46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:35:52.142 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:52.139+0000 7f674ed46800 20 rados->read ofs=0 len=0 2024-09-12T17:35:52.142 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:52.140+0000 7f674ed46800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:35:52.142 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:52.140+0000 7f674ed46800 20 searching for the correct realm 2024-09-12T17:35:52.145 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:52.143+0000 7f674c036640 0 -- 172.21.15.37:0/333073574 >> [v2:172.21.15.37:6816/2964054205,v1:172.21.15.37:6817/2964054205] conn(0x55b65e6e6740 msgr2=0x55b65e6e8c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:35:52.150 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:52.147+0000 7f674c837640 0 -- 172.21.15.37:0/333073574 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7f674004f910 msgr2=0x7f674000f3d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:35:52.153 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:52.151+0000 7f674ed46800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:35:52.154 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:52.151+0000 7f674ed46800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:35:52.154 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:52.151+0000 7f674ed46800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:35:52.154 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:52.151+0000 7f674ed46800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:35:52.154 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:52.151+0000 7f674ed46800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:35:52.154 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:52.151+0000 7f674ed46800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:35:52.154 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:52.151+0000 7f674ed46800 20 rados->read ofs=0 len=0 2024-09-12T17:35:52.154 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:52.152+0000 7f674ed46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:52.154 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:52.152+0000 7f674ed46800 20 rados->read ofs=0 len=0 2024-09-12T17:35:52.154 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:52.152+0000 7f674ed46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:35:52.154 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:52.152+0000 7f674ed46800 20 rados->read ofs=0 len=0 2024-09-12T17:35:52.156 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:52.152+0000 7f674ed46800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:35:52.156 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:52.152+0000 7f674ed46800 20 zone default found 2024-09-12T17:35:52.156 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:52.152+0000 7f674ed46800 4 Realm: () 2024-09-12T17:35:52.156 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:52.152+0000 7f674ed46800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:35:52.156 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:52.152+0000 7f674ed46800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:35:52.156 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:52.152+0000 7f674ed46800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:35:52.156 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:52.152+0000 7f674ed46800 20 zonegroup default 2024-09-12T17:35:52.156 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:52.152+0000 7f674ed46800 20 rados->read ofs=0 len=0 2024-09-12T17:35:52.156 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:52.153+0000 7f674ed46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:52.156 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:52.153+0000 7f674ed46800 20 rados->read ofs=0 len=0 2024-09-12T17:35:52.156 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:52.153+0000 7f674ed46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:52.156 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:52.153+0000 7f674ed46800 20 rados->read ofs=0 len=0 2024-09-12T17:35:52.157 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:52.153+0000 7f674ed46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:35:52.157 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:52.153+0000 7f674ed46800 20 started sync module instance, tier type = 2024-09-12T17:35:52.157 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:52.153+0000 7f674ed46800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:35:52.164 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:52.162+0000 7f674ed46800 20 add_watcher() i=0 2024-09-12T17:35:52.164 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:52.162+0000 7f674ed46800 20 add_watcher() i=1 2024-09-12T17:35:52.165 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:52.162+0000 7f674ed46800 20 add_watcher() i=2 2024-09-12T17:35:52.165 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:52.162+0000 7f674ed46800 20 add_watcher() i=3 2024-09-12T17:35:52.165 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:52.162+0000 7f674ed46800 20 add_watcher() i=4 2024-09-12T17:35:52.165 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:52.162+0000 7f674ed46800 20 add_watcher() i=5 2024-09-12T17:35:52.165 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:52.162+0000 7f674ed46800 20 add_watcher() i=6 2024-09-12T17:35:52.165 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:52.163+0000 7f674ed46800 20 add_watcher() i=7 2024-09-12T17:35:52.165 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:52.163+0000 7f674ed46800 2 all 8 watchers are set, enabling cache 2024-09-12T17:35:52.167 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:52.165+0000 7f66037e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:35:52.168 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:52.166+0000 7f674ed46800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:35:52.168 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:52.166+0000 7f674ed46800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:35:52.169 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:52.166+0000 7f674ed46800 5 note: GC not initialized 2024-09-12T17:35:52.169 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:52.166+0000 7f66027e4640 20 reqs_thread_entry: start 2024-09-12T17:35:52.169 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:52.166+0000 7f674ed46800 20 init_complete bucket index max shards: 11 2024-09-12T17:35:52.169 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:52.166+0000 7f674ed46800 20 Filter name: none 2024-09-12T17:35:52.169 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:52.166+0000 7f65fb7fe640 20 reqs_thread_entry: start 2024-09-12T17:35:52.169 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:52.166+0000 7f674ed46800 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-12T17:35:52.169 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:52.166+0000 7f674ed46800 20 rados->read ofs=0 len=0 2024-09-12T17:35:52.170 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:52.167+0000 7f674ed46800 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T17:35:52.170 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:52.167+0000 7f674ed46800 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-12T17:35:52.170 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:52.167+0000 7f674ed46800 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-12T17:35:52.170 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:52.167+0000 7f674ed46800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.37 : miss 2024-09-12T17:35:52.171 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:52.167+0000 7f674ed46800 20 rados->read ofs=0 len=0 2024-09-12T17:35:52.171 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:52.167+0000 7f674ed46800 20 rados_obj.operate() r=0 bl.length=471 2024-09-12T17:35:52.171 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:52.167+0000 7f674ed46800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.37 info.flags=0x17 2024-09-12T17:35:52.171 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:52.167+0000 7f674ed46800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.37 to cache LRU end 2024-09-12T17:35:52.171 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:52.167+0000 7f674ed46800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:35:52.171 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:52.167+0000 7f674ed46800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:35:52.171 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:52.167+0000 7f674ed46800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.37 2024-09-12T17:35:52.171 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:52.168+0000 7f674ed46800 0 INFO: RGWReshardLock::lock found lock on abort-at-logrecord-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.37 to be held by another RGW process; skipping for now 2024-09-12T17:35:52.171 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:52.169+0000 7f66037e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:35:52.173 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:52.171+0000 7f674ed46800 20 remove_watcher() i=0 2024-09-12T17:35:52.173 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:52.171+0000 7f674ed46800 2 removed watcher, disabling cache 2024-09-12T17:35:52.174 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:52.173+0000 7f674ed46800 20 remove_watcher() i=1 2024-09-12T17:35:52.175 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:52.174+0000 7f674ed46800 20 remove_watcher() i=2 2024-09-12T17:35:52.176 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:52.175+0000 7f674ed46800 20 remove_watcher() i=3 2024-09-12T17:35:52.177 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:52.176+0000 7f674ed46800 20 remove_watcher() i=4 2024-09-12T17:35:52.179 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:52.177+0000 7f674ed46800 20 remove_watcher() i=5 2024-09-12T17:35:52.179 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:52.178+0000 7f674ed46800 20 remove_watcher() i=6 2024-09-12T17:35:52.180 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:35:52.179+0000 7f674ed46800 20 remove_watcher() i=7 2024-09-12T17:35:52.191 INFO:tasks.workunit.client.0.smithi037.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T17:36:22.218 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bucket reshard --bucket abort-at-logrecord-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:36:22.255 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:36:22.255 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:36:22.301 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.300+0000 7f6fa3a0f800 20 rados->read ofs=0 len=0 2024-09-12T17:36:22.302 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.301+0000 7f6fa3a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:22.302 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.301+0000 7f6fa3a0f800 20 realm 2024-09-12T17:36:22.302 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.301+0000 7f6fa3a0f800 20 rados->read ofs=0 len=0 2024-09-12T17:36:22.302 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.301+0000 7f6fa3a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:22.302 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.301+0000 7f6fa3a0f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:36:22.303 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.301+0000 7f6fa3a0f800 20 rados->read ofs=0 len=0 2024-09-12T17:36:22.303 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.301+0000 7f6fa3a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:22.303 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.301+0000 7f6fa3a0f800 20 rados->read ofs=0 len=0 2024-09-12T17:36:22.303 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.302+0000 7f6fa3a0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:36:22.303 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.302+0000 7f6fa3a0f800 20 rados->read ofs=0 len=0 2024-09-12T17:36:22.303 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.303+0000 7f6fa3a0f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:36:22.304 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.303+0000 7f6fa3a0f800 20 searching for the correct realm 2024-09-12T17:36:22.308 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.306+0000 7f6f9e991640 0 -- 172.21.15.37:0/2084391780 >> [v2:172.21.15.37:6816/2964054205,v1:172.21.15.37:6817/2964054205] conn(0x55d6fb19ff60 msgr2=0x55d6fb1a2420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:36:22.311 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.311+0000 7f6f9f192640 0 -- 172.21.15.37:0/2084391780 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7f6f940dac00 msgr2=0x7f6f940dc560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:36:22.316 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.315+0000 7f6fa3a0f800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:36:22.316 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.315+0000 7f6fa3a0f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:36:22.316 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.315+0000 7f6fa3a0f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:36:22.317 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.315+0000 7f6fa3a0f800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:36:22.317 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.315+0000 7f6fa3a0f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:36:22.317 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.315+0000 7f6fa3a0f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:36:22.317 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.315+0000 7f6fa3a0f800 20 rados->read ofs=0 len=0 2024-09-12T17:36:22.317 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.316+0000 7f6fa3a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:22.317 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.316+0000 7f6fa3a0f800 20 rados->read ofs=0 len=0 2024-09-12T17:36:22.318 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.316+0000 7f6fa3a0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:36:22.318 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.316+0000 7f6fa3a0f800 20 rados->read ofs=0 len=0 2024-09-12T17:36:22.318 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.316+0000 7f6fa3a0f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:36:22.318 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.316+0000 7f6fa3a0f800 20 zone default found 2024-09-12T17:36:22.318 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.316+0000 7f6fa3a0f800 4 Realm: () 2024-09-12T17:36:22.319 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.316+0000 7f6fa3a0f800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:36:22.319 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.316+0000 7f6fa3a0f800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:36:22.319 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.316+0000 7f6fa3a0f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:36:22.319 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.316+0000 7f6fa3a0f800 20 zonegroup default 2024-09-12T17:36:22.319 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.316+0000 7f6fa3a0f800 20 rados->read ofs=0 len=0 2024-09-12T17:36:22.319 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.317+0000 7f6fa3a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:22.319 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.317+0000 7f6fa3a0f800 20 rados->read ofs=0 len=0 2024-09-12T17:36:22.319 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.317+0000 7f6fa3a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:22.319 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.317+0000 7f6fa3a0f800 20 rados->read ofs=0 len=0 2024-09-12T17:36:22.319 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.317+0000 7f6fa3a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:22.319 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.317+0000 7f6fa3a0f800 20 started sync module instance, tier type = 2024-09-12T17:36:22.319 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.317+0000 7f6fa3a0f800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:36:22.329 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.328+0000 7f6fa3a0f800 20 add_watcher() i=0 2024-09-12T17:36:22.329 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.328+0000 7f6fa3a0f800 20 add_watcher() i=1 2024-09-12T17:36:22.329 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.328+0000 7f6fa3a0f800 20 add_watcher() i=2 2024-09-12T17:36:22.329 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.328+0000 7f6fa3a0f800 20 add_watcher() i=3 2024-09-12T17:36:22.329 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.328+0000 7f6fa3a0f800 20 add_watcher() i=4 2024-09-12T17:36:22.329 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.328+0000 7f6fa3a0f800 20 add_watcher() i=5 2024-09-12T17:36:22.329 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.328+0000 7f6fa3a0f800 20 add_watcher() i=6 2024-09-12T17:36:22.330 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.329+0000 7f6fa3a0f800 20 add_watcher() i=7 2024-09-12T17:36:22.330 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.329+0000 7f6fa3a0f800 2 all 8 watchers are set, enabling cache 2024-09-12T17:36:22.331 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.331+0000 7f6e55fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:36:22.332 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.331+0000 7f6fa3a0f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:36:22.333 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.331+0000 7f6fa3a0f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:36:22.333 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.331+0000 7f6fa3a0f800 5 note: GC not initialized 2024-09-12T17:36:22.333 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.331+0000 7f6e54fe1640 20 reqs_thread_entry: start 2024-09-12T17:36:22.333 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.331+0000 7f6fa3a0f800 20 init_complete bucket index max shards: 11 2024-09-12T17:36:22.333 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.332+0000 7f6fa3a0f800 20 Filter name: none 2024-09-12T17:36:22.333 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.332+0000 7f6dce7fc640 20 reqs_thread_entry: start 2024-09-12T17:36:22.333 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.332+0000 7f6fa3a0f800 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-12T17:36:22.333 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.332+0000 7f6fa3a0f800 20 rados->read ofs=0 len=0 2024-09-12T17:36:22.334 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.332+0000 7f6fa3a0f800 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T17:36:22.334 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.332+0000 7f6fa3a0f800 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-12T17:36:22.334 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.332+0000 7f6fa3a0f800 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-12T17:36:22.334 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.332+0000 7f6fa3a0f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.37 : miss 2024-09-12T17:36:22.334 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.332+0000 7f6fa3a0f800 20 rados->read ofs=0 len=0 2024-09-12T17:36:22.334 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.333+0000 7f6fa3a0f800 20 rados_obj.operate() r=0 bl.length=471 2024-09-12T17:36:22.334 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.333+0000 7f6fa3a0f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.37 info.flags=0x17 2024-09-12T17:36:22.335 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.333+0000 7f6fa3a0f800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.37 to cache LRU end 2024-09-12T17:36:22.335 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.333+0000 7f6fa3a0f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:36:22.335 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.333+0000 7f6fa3a0f800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:36:22.335 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.333+0000 7f6fa3a0f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.37 2024-09-12T17:36:22.335 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.334+0000 7f6fa3a0f800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T17:36:22.342 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.342+0000 7f6fa3a0f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.37 info.flags=0x17 2024-09-12T17:36:22.342 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.342+0000 7f6fa3a0f800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.37 to cache LRU end 2024-09-12T17:36:22.343 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.342+0000 7f6fa3a0f800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:36:22.343 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.342+0000 7f6fa3a0f800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.37, ofs0, ns] 2024-09-12T17:36:22.343 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.342+0000 7f6e82ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497001 cookie 94381824173728 notifier 7322 bl.length()=1007 2024-09-12T17:36:22.343 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.342+0000 7f6e82ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.37 info.flags=0x17 2024-09-12T17:36:22.343 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.342+0000 7f6e82ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.37 to cache LRU end 2024-09-12T17:36:22.343 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.342+0000 7f6e82ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:36:22.344 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.344+0000 7f6fa3a0f800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.37]): orig_sources= new_sources= 2024-09-12T17:36:22.345 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.344+0000 7f6fa3a0f800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.37]): potential sources added=[] removed=[] 2024-09-12T17:36:22.345 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.344+0000 7f6fa3a0f800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.37]): orig_dests= new_dests= 2024-09-12T17:36:22.345 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.344+0000 7f6fa3a0f800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.37]): potential dests added=[] removed=[] 2024-09-12T17:36:22.350 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.349+0000 7f6fa3a0f800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.37.2.0 2024-09-12T17:36:22.350 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.349+0000 7f6fa3a0f800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.37.2.0 2024-09-12T17:36:22.350 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.349+0000 7f6fa3a0f800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.37.2.1 2024-09-12T17:36:22.350 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.349+0000 7f6fa3a0f800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.37.2.1 2024-09-12T17:36:22.350 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.349+0000 7f6fa3a0f800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.37.2.2 2024-09-12T17:36:22.350 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.349+0000 7f6fa3a0f800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.37.2.2 2024-09-12T17:36:22.350 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.349+0000 7f6fa3a0f800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.37.2.3 2024-09-12T17:36:22.350 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.349+0000 7f6fa3a0f800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.37.2.3 2024-09-12T17:36:22.350 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.349+0000 7f6fa3a0f800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.37.2.4 2024-09-12T17:36:22.350 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.349+0000 7f6fa3a0f800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.37.2.4 2024-09-12T17:36:22.350 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.349+0000 7f6fa3a0f800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.37.2.5 2024-09-12T17:36:22.350 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.349+0000 7f6fa3a0f800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.37.2.5 2024-09-12T17:36:22.351 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.349+0000 7f6fa3a0f800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.37.2.6 2024-09-12T17:36:22.351 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.349+0000 7f6fa3a0f800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.37.2.6 2024-09-12T17:36:22.351 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.349+0000 7f6fa3a0f800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.37.2.7 2024-09-12T17:36:22.351 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.349+0000 7f6fa3a0f800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.37.2.7 2024-09-12T17:36:22.351 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.349+0000 7f6fa3a0f800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.37.2.8 2024-09-12T17:36:22.351 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.349+0000 7f6fa3a0f800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.37.2.8 2024-09-12T17:36:22.351 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.349+0000 7f6fa3a0f800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.37.2.9 2024-09-12T17:36:22.351 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.349+0000 7f6fa3a0f800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.37.2.9 2024-09-12T17:36:22.351 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.349+0000 7f6fa3a0f800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.37.2.10 2024-09-12T17:36:22.351 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.349+0000 7f6fa3a0f800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.37.2.10 2024-09-12T17:36:22.351 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.349+0000 7f6fa3a0f800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.37.2.11 2024-09-12T17:36:22.351 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.349+0000 7f6fa3a0f800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.37.2.11 2024-09-12T17:36:22.351 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.349+0000 7f6fa3a0f800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.37.0 2024-09-12T17:36:22.352 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.349+0000 7f6fa3a0f800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.37.1 2024-09-12T17:36:22.352 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.350+0000 7f6fa3a0f800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.37.2 2024-09-12T17:36:22.352 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.351+0000 7f6fa3a0f800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.37.3 2024-09-12T17:36:22.352 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.351+0000 7f6fa3a0f800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.37.4 2024-09-12T17:36:22.352 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.351+0000 7f6fa3a0f800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.37.5 2024-09-12T17:36:22.353 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.352+0000 7f6fa3a0f800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.37.6 2024-09-12T17:36:22.353 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.353+0000 7f6fa3a0f800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.37.7 2024-09-12T17:36:22.354 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.353+0000 7f6fa3a0f800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.37.8 2024-09-12T17:36:22.354 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.354+0000 7f6fa3a0f800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.37.9 2024-09-12T17:36:22.355 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.354+0000 7f6fa3a0f800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.37.10 2024-09-12T17:36:22.359 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.358+0000 7f6fa3a0f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.37 : hit (requested=0x17, cached=0x17) 2024-09-12T17:36:22.359 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.358+0000 7f6fa3a0f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.37 2024-09-12T17:36:22.361 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.360+0000 7f6fa3a0f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.37 info.flags=0x17 2024-09-12T17:36:22.361 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.360+0000 7f6fa3a0f800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.37 to cache LRU end 2024-09-12T17:36:22.361 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.360+0000 7f6fa3a0f800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:36:22.361 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.360+0000 7f6fa3a0f800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.37, ofs0, ns] 2024-09-12T17:36:22.361 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.360+0000 7f6e82ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497002 cookie 94381824173728 notifier 7322 bl.length()=1007 2024-09-12T17:36:22.361 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.360+0000 7f6e82ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.37 info.flags=0x17 2024-09-12T17:36:22.361 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.360+0000 7f6e82ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.37 to cache LRU end 2024-09-12T17:36:22.361 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.360+0000 7f6e82ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:36:22.362 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.361+0000 7f6fa3a0f800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.37]): orig_sources= new_sources= 2024-09-12T17:36:22.362 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.361+0000 7f6fa3a0f800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.37]): potential sources added=[] removed=[] 2024-09-12T17:36:22.362 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.361+0000 7f6fa3a0f800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.37]): orig_dests= new_dests= 2024-09-12T17:36:22.362 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.361+0000 7f6fa3a0f800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.37]): potential dests added=[] removed=[] 2024-09-12T17:36:22.365 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.364+0000 7f6fa3a0f800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.37.0 2024-09-12T17:36:22.365 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.364+0000 7f6fa3a0f800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.37.1 2024-09-12T17:36:22.365 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.365+0000 7f6fa3a0f800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.37.2 2024-09-12T17:36:22.366 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.365+0000 7f6fa3a0f800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.37.3 2024-09-12T17:36:22.366 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.365+0000 7f6fa3a0f800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.37.4 2024-09-12T17:36:22.366 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.366+0000 7f6fa3a0f800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.37.5 2024-09-12T17:36:22.367 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.366+0000 7f6fa3a0f800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.37.6 2024-09-12T17:36:22.367 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.367+0000 7f6fa3a0f800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.37.7 2024-09-12T17:36:22.368 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.367+0000 7f6fa3a0f800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.37.8 2024-09-12T17:36:22.368 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.367+0000 7f6fa3a0f800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.37.9 2024-09-12T17:36:22.368 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.368+0000 7f6fa3a0f800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.37.10 2024-09-12T17:36:22.369 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.368+0000 7f6fa3a0f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.37 : hit (requested=0x17, cached=0x17) 2024-09-12T17:36:22.369 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.368+0000 7f6fa3a0f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.37 2024-09-12T17:36:22.371 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.370+0000 7f6fa3a0f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.37 info.flags=0x17 2024-09-12T17:36:22.371 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.370+0000 7f6fa3a0f800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.37 to cache LRU end 2024-09-12T17:36:22.371 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.370+0000 7f6fa3a0f800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:36:22.371 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.370+0000 7f6fa3a0f800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.37, ofs0, ns] 2024-09-12T17:36:22.371 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.370+0000 7f6e82ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497003 cookie 94381824173728 notifier 7322 bl.length()=975 2024-09-12T17:36:22.371 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.370+0000 7f6e82ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.37 info.flags=0x17 2024-09-12T17:36:22.371 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.370+0000 7f6e82ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.37 to cache LRU end 2024-09-12T17:36:22.371 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.370+0000 7f6e82ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:36:22.372 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.372+0000 7f6fa3a0f800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.37]): orig_sources= new_sources= 2024-09-12T17:36:22.372 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.372+0000 7f6fa3a0f800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.37]): potential sources added=[] removed=[] 2024-09-12T17:36:22.372 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.372+0000 7f6fa3a0f800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.37]): orig_dests= new_dests= 2024-09-12T17:36:22.372 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.372+0000 7f6fa3a0f800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.37]): potential dests added=[] removed=[] 2024-09-12T17:36:22.374 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.374+0000 7f6fa3a0f800 1 execute INFO: reshard of bucket "abort-at-logrecord-writes" from 11 shards to 12 shards completed successfully 2024-09-12T17:36:22.376 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.376+0000 7f6e55fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:36:22.378 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.378+0000 7f6fa3a0f800 20 remove_watcher() i=0 2024-09-12T17:36:22.379 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.378+0000 7f6fa3a0f800 2 removed watcher, disabling cache 2024-09-12T17:36:22.379 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.379+0000 7f6fa3a0f800 20 remove_watcher() i=1 2024-09-12T17:36:22.380 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.380+0000 7f6fa3a0f800 20 remove_watcher() i=2 2024-09-12T17:36:22.382 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.381+0000 7f6fa3a0f800 20 remove_watcher() i=3 2024-09-12T17:36:22.383 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.382+0000 7f6fa3a0f800 20 remove_watcher() i=4 2024-09-12T17:36:22.384 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.383+0000 7f6fa3a0f800 20 remove_watcher() i=5 2024-09-12T17:36:22.385 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.384+0000 7f6fa3a0f800 20 remove_watcher() i=6 2024-09-12T17:36:22.386 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.385+0000 7f6fa3a0f800 20 remove_watcher() i=7 2024-09-12T17:36:22.399 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bucket stats --bucket abort-at-logrecord-writes 2024-09-12T17:36:22.428 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:36:22.428 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:36:22.467 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.466+0000 7f770f215800 20 rados->read ofs=0 len=0 2024-09-12T17:36:22.468 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.467+0000 7f770f215800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:22.469 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.467+0000 7f770f215800 20 realm 2024-09-12T17:36:22.469 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.467+0000 7f770f215800 20 rados->read ofs=0 len=0 2024-09-12T17:36:22.469 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.468+0000 7f770f215800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:22.469 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.468+0000 7f770f215800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:36:22.469 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.468+0000 7f770f215800 20 rados->read ofs=0 len=0 2024-09-12T17:36:22.469 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.468+0000 7f770f215800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:22.469 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.468+0000 7f770f215800 20 rados->read ofs=0 len=0 2024-09-12T17:36:22.469 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.469+0000 7f770f215800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:36:22.469 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.469+0000 7f770f215800 20 rados->read ofs=0 len=0 2024-09-12T17:36:22.470 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.469+0000 7f770f215800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:36:22.470 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.469+0000 7f770f215800 20 searching for the correct realm 2024-09-12T17:36:22.472 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.472+0000 7f770a191640 0 -- 172.21.15.37:0/1575502074 >> [v2:172.21.15.40:6800/2441293461,v1:172.21.15.40:6801/2441293461] conn(0x7f76fc027040 msgr2=0x7f76fc0373f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:36:22.477 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.476+0000 7f770a992640 0 -- 172.21.15.37:0/1575502074 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7f7700022540 msgr2=0x7f770005c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:36:22.683 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.682+0000 7f770f215800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:36:22.684 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.682+0000 7f770f215800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:36:22.684 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.682+0000 7f770f215800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:36:22.684 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.682+0000 7f770f215800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:36:22.684 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.682+0000 7f770f215800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:36:22.684 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.682+0000 7f770f215800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:36:22.684 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.682+0000 7f770f215800 20 rados->read ofs=0 len=0 2024-09-12T17:36:22.684 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.683+0000 7f770f215800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:22.684 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.683+0000 7f770f215800 20 rados->read ofs=0 len=0 2024-09-12T17:36:22.685 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.683+0000 7f770f215800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:36:22.685 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.683+0000 7f770f215800 20 rados->read ofs=0 len=0 2024-09-12T17:36:22.686 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.683+0000 7f770f215800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:36:22.686 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.683+0000 7f770f215800 20 zone default found 2024-09-12T17:36:22.686 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.683+0000 7f770f215800 4 Realm: () 2024-09-12T17:36:22.686 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.683+0000 7f770f215800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:36:22.686 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.683+0000 7f770f215800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:36:22.686 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.683+0000 7f770f215800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:36:22.686 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.683+0000 7f770f215800 20 zonegroup default 2024-09-12T17:36:22.686 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.683+0000 7f770f215800 20 rados->read ofs=0 len=0 2024-09-12T17:36:22.686 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.684+0000 7f770f215800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:22.686 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.684+0000 7f770f215800 20 rados->read ofs=0 len=0 2024-09-12T17:36:22.686 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.684+0000 7f770f215800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:22.686 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.684+0000 7f770f215800 20 rados->read ofs=0 len=0 2024-09-12T17:36:22.686 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.684+0000 7f770f215800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:22.686 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.684+0000 7f770f215800 20 started sync module instance, tier type = 2024-09-12T17:36:22.687 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.684+0000 7f770f215800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:36:22.696 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.695+0000 7f770f215800 20 add_watcher() i=0 2024-09-12T17:36:22.696 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.695+0000 7f770f215800 20 add_watcher() i=1 2024-09-12T17:36:22.696 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.695+0000 7f770f215800 20 add_watcher() i=2 2024-09-12T17:36:22.696 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.695+0000 7f770f215800 20 add_watcher() i=3 2024-09-12T17:36:22.696 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.695+0000 7f770f215800 20 add_watcher() i=4 2024-09-12T17:36:22.696 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.695+0000 7f770f215800 20 add_watcher() i=5 2024-09-12T17:36:22.696 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.695+0000 7f770f215800 20 add_watcher() i=6 2024-09-12T17:36:22.696 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.696+0000 7f770f215800 20 add_watcher() i=7 2024-09-12T17:36:22.697 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.696+0000 7f770f215800 2 all 8 watchers are set, enabling cache 2024-09-12T17:36:22.698 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.697+0000 7f75c17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:36:22.699 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.698+0000 7f770f215800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:36:22.699 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.698+0000 7f770f215800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:36:22.699 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.698+0000 7f770f215800 5 note: GC not initialized 2024-09-12T17:36:22.699 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.698+0000 7f753bfff640 20 reqs_thread_entry: start 2024-09-12T17:36:22.699 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.698+0000 7f770f215800 20 init_complete bucket index max shards: 11 2024-09-12T17:36:22.699 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.698+0000 7f770f215800 20 Filter name: none 2024-09-12T17:36:22.700 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.698+0000 7f7539ffb640 20 reqs_thread_entry: start 2024-09-12T17:36:22.700 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.698+0000 7f770f215800 20 rados->read ofs=0 len=0 2024-09-12T17:36:22.700 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.699+0000 7f770f215800 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T17:36:22.700 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.699+0000 7f770f215800 20 rados->read ofs=0 len=0 2024-09-12T17:36:22.701 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.699+0000 7f770f215800 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T17:36:22.701 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.699+0000 7f770f215800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:36:22.701 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.699+0000 7f770f215800 20 rados->read ofs=0 len=0 2024-09-12T17:36:22.701 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.700+0000 7f770f215800 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T17:36:22.701 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.700+0000 7f770f215800 20 rados->read ofs=0 len=0 2024-09-12T17:36:22.701 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.700+0000 7f770f215800 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T17:36:22.701 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.700+0000 7f770f215800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:36:22.703 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.702+0000 7f75c17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:36:22.706 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.705+0000 7f770f215800 20 remove_watcher() i=0 2024-09-12T17:36:22.706 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.705+0000 7f770f215800 2 removed watcher, disabling cache 2024-09-12T17:36:22.707 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.707+0000 7f770f215800 20 remove_watcher() i=1 2024-09-12T17:36:22.708 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.708+0000 7f770f215800 20 remove_watcher() i=2 2024-09-12T17:36:22.709 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.709+0000 7f770f215800 20 remove_watcher() i=3 2024-09-12T17:36:22.711 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.710+0000 7f770f215800 20 remove_watcher() i=4 2024-09-12T17:36:22.712 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.711+0000 7f770f215800 20 remove_watcher() i=5 2024-09-12T17:36:22.713 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.712+0000 7f770f215800 20 remove_watcher() i=6 2024-09-12T17:36:22.714 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:22.713+0000 7f770f215800 20 remove_watcher() i=7 2024-09-12T17:36:22.725 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:36:22.726 INFO:tasks.workunit.client.0.smithi037.stderr:BUCKET_STATS: 2024-09-12T17:36:22.726 INFO:tasks.workunit.client.0.smithi037.stderr:bucket: abort-at-logrecord-writes id: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.37 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T17:36:22.726 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:36:23.078 INFO:tasks.workunit.client.0.smithi037.stderr:TEST: reshard bucket with EIO injected at change_reshard_state 2024-09-12T17:36:23.078 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:36:23.879 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-12T17:36:23.908 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:36:23.908 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:36:23.947 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:23.947+0000 7fc1b8814800 20 rados->read ofs=0 len=0 2024-09-12T17:36:23.949 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:23.948+0000 7fc1b8814800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:23.949 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:23.948+0000 7fc1b8814800 20 realm 2024-09-12T17:36:23.949 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:23.948+0000 7fc1b8814800 20 rados->read ofs=0 len=0 2024-09-12T17:36:23.949 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:23.948+0000 7fc1b8814800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:23.950 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:23.948+0000 7fc1b8814800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:36:23.950 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:23.948+0000 7fc1b8814800 20 rados->read ofs=0 len=0 2024-09-12T17:36:23.950 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:23.949+0000 7fc1b8814800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:23.950 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:23.949+0000 7fc1b8814800 20 rados->read ofs=0 len=0 2024-09-12T17:36:23.950 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:23.950+0000 7fc1b8814800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:36:23.950 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:23.950+0000 7fc1b8814800 20 rados->read ofs=0 len=0 2024-09-12T17:36:23.951 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:23.950+0000 7fc1b8814800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:36:23.951 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:23.950+0000 7fc1b8814800 20 searching for the correct realm 2024-09-12T17:36:23.954 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:23.953+0000 7fc1b46cc640 0 -- 172.21.15.37:0/932963744 >> [v2:172.21.15.40:6818/1210108009,v1:172.21.15.40:6819/1210108009] conn(0x7fc1a8018070 msgr2=0x7fc1a808b780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:36:23.958 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:23.957+0000 7fc1b3ecb640 0 -- 172.21.15.37:0/932963744 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7fc1a8076a30 msgr2=0x7fc1a8097a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:36:24.165 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.164+0000 7fc1b8814800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:36:24.165 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.164+0000 7fc1b8814800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:36:24.165 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.164+0000 7fc1b8814800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:36:24.166 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.164+0000 7fc1b8814800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:36:24.166 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.164+0000 7fc1b8814800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:36:24.166 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.164+0000 7fc1b8814800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:36:24.166 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.164+0000 7fc1b8814800 20 rados->read ofs=0 len=0 2024-09-12T17:36:24.166 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.164+0000 7fc1b8814800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:24.166 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.164+0000 7fc1b8814800 20 rados->read ofs=0 len=0 2024-09-12T17:36:24.167 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.165+0000 7fc1b8814800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:36:24.167 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.165+0000 7fc1b8814800 20 rados->read ofs=0 len=0 2024-09-12T17:36:24.167 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.165+0000 7fc1b8814800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:36:24.167 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.165+0000 7fc1b8814800 20 zone default found 2024-09-12T17:36:24.167 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.165+0000 7fc1b8814800 4 Realm: () 2024-09-12T17:36:24.167 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.165+0000 7fc1b8814800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:36:24.167 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.165+0000 7fc1b8814800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:36:24.167 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.165+0000 7fc1b8814800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:36:24.168 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.165+0000 7fc1b8814800 20 zonegroup default 2024-09-12T17:36:24.168 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.165+0000 7fc1b8814800 20 rados->read ofs=0 len=0 2024-09-12T17:36:24.168 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.165+0000 7fc1b8814800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:24.168 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.166+0000 7fc1b8814800 20 rados->read ofs=0 len=0 2024-09-12T17:36:24.168 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.166+0000 7fc1b8814800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:24.168 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.166+0000 7fc1b8814800 20 rados->read ofs=0 len=0 2024-09-12T17:36:24.168 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.166+0000 7fc1b8814800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:24.168 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.166+0000 7fc1b8814800 20 started sync module instance, tier type = 2024-09-12T17:36:24.168 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.166+0000 7fc1b8814800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:36:24.177 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.176+0000 7fc1b8814800 20 add_watcher() i=0 2024-09-12T17:36:24.177 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.176+0000 7fc1b8814800 20 add_watcher() i=1 2024-09-12T17:36:24.177 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.176+0000 7fc1b8814800 20 add_watcher() i=2 2024-09-12T17:36:24.177 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.176+0000 7fc1b8814800 20 add_watcher() i=3 2024-09-12T17:36:24.177 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.176+0000 7fc1b8814800 20 add_watcher() i=4 2024-09-12T17:36:24.177 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.176+0000 7fc1b8814800 20 add_watcher() i=5 2024-09-12T17:36:24.177 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.176+0000 7fc1b8814800 20 add_watcher() i=6 2024-09-12T17:36:24.178 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.177+0000 7fc1b8814800 20 add_watcher() i=7 2024-09-12T17:36:24.178 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.177+0000 7fc1b8814800 2 all 8 watchers are set, enabling cache 2024-09-12T17:36:24.180 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.179+0000 7fc069fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:36:24.181 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.179+0000 7fc1b8814800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:36:24.181 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.179+0000 7fc1b8814800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:36:24.181 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.179+0000 7fc1b8814800 5 note: GC not initialized 2024-09-12T17:36:24.181 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.180+0000 7fc068fe1640 20 reqs_thread_entry: start 2024-09-12T17:36:24.181 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.180+0000 7fc1b8814800 20 init_complete bucket index max shards: 11 2024-09-12T17:36:24.181 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.180+0000 7fc1b8814800 20 Filter name: none 2024-09-12T17:36:24.181 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.180+0000 7fbfe27fc640 20 reqs_thread_entry: start 2024-09-12T17:36:24.181 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.180+0000 7fc1b8814800 20 rados->read ofs=0 len=0 2024-09-12T17:36:24.182 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.180+0000 7fc1b8814800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:36:24.182 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.181+0000 7fc1b8814800 20 rados->read ofs=0 len=0 2024-09-12T17:36:24.182 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.181+0000 7fc1b8814800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:36:24.182 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.181+0000 7fc1b8814800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:36:24.182 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.181+0000 7fc1b8814800 20 rados->read ofs=0 len=0 2024-09-12T17:36:24.183 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.181+0000 7fc1b8814800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:36:24.183 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.181+0000 7fc1b8814800 20 rados->read ofs=0 len=0 2024-09-12T17:36:24.183 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.182+0000 7fc1b8814800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:36:24.183 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.182+0000 7fc1b8814800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:36:24.184 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.184+0000 7fc069fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:36:24.187 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.186+0000 7fc1b8814800 20 remove_watcher() i=0 2024-09-12T17:36:24.187 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.186+0000 7fc1b8814800 2 removed watcher, disabling cache 2024-09-12T17:36:24.188 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.187+0000 7fc1b8814800 20 remove_watcher() i=1 2024-09-12T17:36:24.189 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.188+0000 7fc1b8814800 20 remove_watcher() i=2 2024-09-12T17:36:24.190 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.190+0000 7fc1b8814800 20 remove_watcher() i=3 2024-09-12T17:36:24.191 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.191+0000 7fc1b8814800 20 remove_watcher() i=4 2024-09-12T17:36:24.193 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.192+0000 7fc1b8814800 20 remove_watcher() i=5 2024-09-12T17:36:24.194 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.193+0000 7fc1b8814800 20 remove_watcher() i=6 2024-09-12T17:36:24.195 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.194+0000 7fc1b8814800 20 remove_watcher() i=7 2024-09-12T17:36:24.206 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:36:24.206 INFO:tasks.workunit.client.0.smithi037.stderr:BUCKET_STATS: 2024-09-12T17:36:24.206 INFO:tasks.workunit.client.0.smithi037.stderr:bucket: error-at-change-reshard-state id: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.38 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:36:24.206 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:36:24.208 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bucket reshard --bucket error-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at change_reshard_state 2024-09-12T17:36:24.243 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:36:24.243 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:36:24.283 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.282+0000 7f28ad146800 20 rados->read ofs=0 len=0 2024-09-12T17:36:24.285 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.284+0000 7f28ad146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:24.285 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.284+0000 7f28ad146800 20 realm 2024-09-12T17:36:24.285 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.284+0000 7f28ad146800 20 rados->read ofs=0 len=0 2024-09-12T17:36:24.286 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.284+0000 7f28ad146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:24.286 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.284+0000 7f28ad146800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:36:24.286 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.284+0000 7f28ad146800 20 rados->read ofs=0 len=0 2024-09-12T17:36:24.286 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.284+0000 7f28ad146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:24.286 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.284+0000 7f28ad146800 20 rados->read ofs=0 len=0 2024-09-12T17:36:24.286 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.285+0000 7f28ad146800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:36:24.287 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.285+0000 7f28ad146800 20 rados->read ofs=0 len=0 2024-09-12T17:36:24.287 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.286+0000 7f28ad146800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:36:24.287 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.286+0000 7f28ad146800 20 searching for the correct realm 2024-09-12T17:36:24.288 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.287+0000 7f28aac30640 0 -- 172.21.15.37:0/377081190 >> [v2:172.21.15.37:6800/1206746176,v1:172.21.15.37:6801/1206746176] conn(0x5625a7043a40 msgr2=0x7f28a405b3d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:36:24.494 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.493+0000 7f28ab431640 0 -- 172.21.15.37:0/377081190 >> [v2:172.21.15.40:6818/1210108009,v1:172.21.15.40:6819/1210108009] conn(0x7f289402a040 msgr2=0x7f289401a470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:36:24.500 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.499+0000 7f28ad146800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:36:24.500 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.499+0000 7f28ad146800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:36:24.501 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.499+0000 7f28ad146800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:36:24.501 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.499+0000 7f28ad146800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:36:24.501 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.499+0000 7f28ad146800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:36:24.501 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.499+0000 7f28ad146800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:36:24.501 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.499+0000 7f28ad146800 20 rados->read ofs=0 len=0 2024-09-12T17:36:24.501 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.499+0000 7f28ad146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:24.501 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.500+0000 7f28ad146800 20 rados->read ofs=0 len=0 2024-09-12T17:36:24.502 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.500+0000 7f28ad146800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:36:24.502 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.500+0000 7f28ad146800 20 rados->read ofs=0 len=0 2024-09-12T17:36:24.502 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.500+0000 7f28ad146800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:36:24.503 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.500+0000 7f28ad146800 20 zone default found 2024-09-12T17:36:24.503 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.500+0000 7f28ad146800 4 Realm: () 2024-09-12T17:36:24.503 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.500+0000 7f28ad146800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:36:24.503 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.500+0000 7f28ad146800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:36:24.503 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.500+0000 7f28ad146800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:36:24.503 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.500+0000 7f28ad146800 20 zonegroup default 2024-09-12T17:36:24.503 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.500+0000 7f28ad146800 20 rados->read ofs=0 len=0 2024-09-12T17:36:24.503 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.501+0000 7f28ad146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:24.503 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.501+0000 7f28ad146800 20 rados->read ofs=0 len=0 2024-09-12T17:36:24.503 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.501+0000 7f28ad146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:24.503 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.501+0000 7f28ad146800 20 rados->read ofs=0 len=0 2024-09-12T17:36:24.503 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.501+0000 7f28ad146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:24.503 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.501+0000 7f28ad146800 20 started sync module instance, tier type = 2024-09-12T17:36:24.503 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.501+0000 7f28ad146800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:36:24.513 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.512+0000 7f28ad146800 20 add_watcher() i=0 2024-09-12T17:36:24.513 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.512+0000 7f28ad146800 20 add_watcher() i=1 2024-09-12T17:36:24.513 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.512+0000 7f28ad146800 20 add_watcher() i=2 2024-09-12T17:36:24.513 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.512+0000 7f28ad146800 20 add_watcher() i=3 2024-09-12T17:36:24.513 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.512+0000 7f28ad146800 20 add_watcher() i=4 2024-09-12T17:36:24.513 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.512+0000 7f28ad146800 20 add_watcher() i=5 2024-09-12T17:36:24.513 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.512+0000 7f28ad146800 20 add_watcher() i=6 2024-09-12T17:36:24.514 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.513+0000 7f28ad146800 20 add_watcher() i=7 2024-09-12T17:36:24.514 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.513+0000 7f28ad146800 2 all 8 watchers are set, enabling cache 2024-09-12T17:36:24.515 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.515+0000 7f27617e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:36:24.516 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.515+0000 7f28ad146800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:36:24.516 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.515+0000 7f28ad146800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:36:24.516 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.515+0000 7f28ad146800 5 note: GC not initialized 2024-09-12T17:36:24.516 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.515+0000 7f26dbfff640 20 reqs_thread_entry: start 2024-09-12T17:36:24.516 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.515+0000 7f28ad146800 20 init_complete bucket index max shards: 11 2024-09-12T17:36:24.517 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.515+0000 7f28ad146800 20 Filter name: none 2024-09-12T17:36:24.517 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.515+0000 7f26d9ffb640 20 reqs_thread_entry: start 2024-09-12T17:36:24.517 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.515+0000 7f28ad146800 10 cache get: name=default.rgw.meta+root+error-at-change-reshard-state : miss 2024-09-12T17:36:24.517 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.515+0000 7f28ad146800 20 rados->read ofs=0 len=0 2024-09-12T17:36:24.517 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.516+0000 7f28ad146800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:36:24.518 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.516+0000 7f28ad146800 10 cache put: name=default.rgw.meta+root+error-at-change-reshard-state info.flags=0x11 2024-09-12T17:36:24.518 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.516+0000 7f28ad146800 10 adding default.rgw.meta+root+error-at-change-reshard-state to cache LRU end 2024-09-12T17:36:24.518 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.516+0000 7f28ad146800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.38 : miss 2024-09-12T17:36:24.518 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.516+0000 7f28ad146800 20 rados->read ofs=0 len=0 2024-09-12T17:36:24.518 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.516+0000 7f28ad146800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:36:24.518 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.517+0000 7f28ad146800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.38 info.flags=0x17 2024-09-12T17:36:24.518 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.517+0000 7f28ad146800 10 adding default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.38 to cache LRU end 2024-09-12T17:36:24.518 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.517+0000 7f28ad146800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:36:24.518 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.517+0000 7f28ad146800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:36:24.518 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.517+0000 7f28ad146800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.38 2024-09-12T17:36:24.525 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.524+0000 7f28ad146800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.38 info.flags=0x17 2024-09-12T17:36:24.525 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.524+0000 7f28ad146800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.38 to cache LRU end 2024-09-12T17:36:24.525 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.524+0000 7f28ad146800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:36:24.525 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.524+0000 7f28ad146800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.38, ofs0, ns] 2024-09-12T17:36:24.525 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.524+0000 7f278dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497006 cookie 94719717655920 notifier 7367 bl.length()=1015 2024-09-12T17:36:24.526 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.524+0000 7f278dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.38 info.flags=0x17 2024-09-12T17:36:24.526 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.524+0000 7f278dffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.38 to cache LRU end 2024-09-12T17:36:24.526 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.524+0000 7f278dffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:36:24.527 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.526+0000 7f28ad146800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.38]): orig_sources= new_sources= 2024-09-12T17:36:24.527 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.526+0000 7f28ad146800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.38]): potential sources added=[] removed=[] 2024-09-12T17:36:24.527 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.526+0000 7f28ad146800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.38]): orig_dests= new_dests= 2024-09-12T17:36:24.527 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.526+0000 7f28ad146800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.38]): potential dests added=[] removed=[] 2024-09-12T17:36:24.533 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.533+0000 7f28ad146800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.38.1.0 2024-09-12T17:36:24.534 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.533+0000 7f28ad146800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.38.1.0 2024-09-12T17:36:24.534 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.533+0000 7f28ad146800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.38.1.1 2024-09-12T17:36:24.534 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.533+0000 7f28ad146800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.38.1.1 2024-09-12T17:36:24.534 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.533+0000 7f28ad146800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.38.1.2 2024-09-12T17:36:24.534 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.533+0000 7f28ad146800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.38.1.2 2024-09-12T17:36:24.534 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.533+0000 7f28ad146800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.38.1.3 2024-09-12T17:36:24.534 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.533+0000 7f28ad146800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.38.1.3 2024-09-12T17:36:24.534 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.533+0000 7f28ad146800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.38.1.4 2024-09-12T17:36:24.534 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.533+0000 7f28ad146800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.38.1.4 2024-09-12T17:36:24.534 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.533+0000 7f28ad146800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.38.1.5 2024-09-12T17:36:24.534 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.533+0000 7f28ad146800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.38.1.5 2024-09-12T17:36:24.534 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.533+0000 7f28ad146800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.38.1.6 2024-09-12T17:36:24.534 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.533+0000 7f28ad146800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.38.1.6 2024-09-12T17:36:24.535 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.533+0000 7f28ad146800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.38.1.7 2024-09-12T17:36:24.535 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.533+0000 7f28ad146800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.38.1.7 2024-09-12T17:36:24.535 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.533+0000 7f28ad146800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.38.1.8 2024-09-12T17:36:24.535 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.533+0000 7f28ad146800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.38.1.8 2024-09-12T17:36:24.535 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.533+0000 7f28ad146800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.38.1.9 2024-09-12T17:36:24.535 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.533+0000 7f28ad146800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.38.1.9 2024-09-12T17:36:24.535 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.533+0000 7f28ad146800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.38.1.10 2024-09-12T17:36:24.535 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.533+0000 7f28ad146800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.38.1.10 2024-09-12T17:36:24.535 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.533+0000 7f28ad146800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.38.1.11 2024-09-12T17:36:24.535 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.533+0000 7f28ad146800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.38.1.11 2024-09-12T17:36:24.535 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.533+0000 7f28ad146800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.38.0 2024-09-12T17:36:24.536 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.533+0000 7f28ad146800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.38.1 2024-09-12T17:36:24.536 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.534+0000 7f28ad146800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.38.2 2024-09-12T17:36:24.536 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.535+0000 7f28ad146800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.38.3 2024-09-12T17:36:24.536 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.535+0000 7f28ad146800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.38.4 2024-09-12T17:36:24.537 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.536+0000 7f28ad146800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.38.5 2024-09-12T17:36:24.537 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.536+0000 7f28ad146800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.38.6 2024-09-12T17:36:24.538 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.537+0000 7f28ad146800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.38.7 2024-09-12T17:36:24.539 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.538+0000 7f28ad146800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.38.8 2024-09-12T17:36:24.539 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.539+0000 7f28ad146800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.38.9 2024-09-12T17:36:24.540 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.539+0000 7f28ad146800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.38.10 2024-09-12T17:36:24.546 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.545+0000 7f28ad146800 -1 Injecting error=-5 at location=change_reshard_state 2024-09-12T17:36:24.546 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.545+0000 7f28ad146800 0 ERROR: change_reshard_state failed to commit target index layout: (5) Input/output error 2024-09-12T17:36:24.560 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.557+0000 7f28ad146800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.38 : hit (requested=0x17, cached=0x17) 2024-09-12T17:36:24.560 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.557+0000 7f28ad146800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.38 2024-09-12T17:36:24.561 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.558+0000 7f28ad146800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.38 info.flags=0x17 2024-09-12T17:36:24.561 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.558+0000 7f28ad146800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.38 to cache LRU end 2024-09-12T17:36:24.561 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.558+0000 7f28ad146800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:36:24.561 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.558+0000 7f28ad146800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.38, ofs0, ns] 2024-09-12T17:36:24.561 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.559+0000 7f278e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497007 cookie 94719717655920 notifier 7367 bl.length()=983 2024-09-12T17:36:24.561 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.559+0000 7f278e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.38 info.flags=0x17 2024-09-12T17:36:24.561 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.559+0000 7f278e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.38 to cache LRU end 2024-09-12T17:36:24.561 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.559+0000 7f278e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:36:24.562 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.560+0000 7f28ad146800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.38]): orig_sources= new_sources= 2024-09-12T17:36:24.562 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.560+0000 7f28ad146800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.38]): potential sources added=[] removed=[] 2024-09-12T17:36:24.562 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.560+0000 7f28ad146800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.38]): orig_dests= new_dests= 2024-09-12T17:36:24.562 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.560+0000 7f28ad146800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.38]): potential dests added=[] removed=[] 2024-09-12T17:36:24.562 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.560+0000 7f28ad146800 1 execute INFO: reshard of bucket "error-at-change-reshard-state" canceled due to errors 2024-09-12T17:36:24.563 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.562+0000 7f27617e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:36:24.566 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.565+0000 7f28ad146800 20 remove_watcher() i=0 2024-09-12T17:36:24.566 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.565+0000 7f28ad146800 2 removed watcher, disabling cache 2024-09-12T17:36:24.567 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.566+0000 7f28ad146800 20 remove_watcher() i=1 2024-09-12T17:36:24.568 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.567+0000 7f28ad146800 20 remove_watcher() i=2 2024-09-12T17:36:24.569 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.568+0000 7f28ad146800 20 remove_watcher() i=3 2024-09-12T17:36:24.570 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.569+0000 7f28ad146800 20 remove_watcher() i=4 2024-09-12T17:36:24.571 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.570+0000 7f28ad146800 20 remove_watcher() i=5 2024-09-12T17:36:24.572 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.571+0000 7f28ad146800 20 remove_watcher() i=6 2024-09-12T17:36:24.573 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.572+0000 7f28ad146800 20 remove_watcher() i=7 2024-09-12T17:36:24.586 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-12T17:36:24.616 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:36:24.616 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:36:24.655 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.654+0000 7f3afd322800 20 rados->read ofs=0 len=0 2024-09-12T17:36:24.657 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.656+0000 7f3afd322800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:24.657 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.656+0000 7f3afd322800 20 realm 2024-09-12T17:36:24.657 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.656+0000 7f3afd322800 20 rados->read ofs=0 len=0 2024-09-12T17:36:24.657 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.656+0000 7f3afd322800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:24.657 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.656+0000 7f3afd322800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:36:24.657 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.656+0000 7f3afd322800 20 rados->read ofs=0 len=0 2024-09-12T17:36:24.657 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.656+0000 7f3afd322800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:24.657 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.656+0000 7f3afd322800 20 rados->read ofs=0 len=0 2024-09-12T17:36:24.658 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.657+0000 7f3afd322800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:36:24.658 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.657+0000 7f3afd322800 20 rados->read ofs=0 len=0 2024-09-12T17:36:24.658 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.657+0000 7f3afd322800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:36:24.659 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.657+0000 7f3afd322800 20 searching for the correct realm 2024-09-12T17:36:24.662 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.661+0000 7f3af9703640 0 -- 172.21.15.37:0/1681293683 >> [v2:172.21.15.37:6824/3990661154,v1:172.21.15.37:6825/3990661154] conn(0x55ddb82ed7a0 msgr2=0x55ddb82efc60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:36:24.666 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.665+0000 7f3af0701640 0 -- 172.21.15.37:0/1681293683 >> [v2:172.21.15.40:6800/2441293461,v1:172.21.15.40:6801/2441293461] conn(0x7f3ae806b020 msgr2=0x7f3ae80a3d10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:36:24.670 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.669+0000 7f3afd322800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:36:24.670 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.669+0000 7f3afd322800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:36:24.670 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.669+0000 7f3afd322800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:36:24.670 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.669+0000 7f3afd322800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:36:24.670 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.669+0000 7f3afd322800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:36:24.670 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.669+0000 7f3afd322800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:36:24.671 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.669+0000 7f3afd322800 20 rados->read ofs=0 len=0 2024-09-12T17:36:24.671 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.669+0000 7f3afd322800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:24.671 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.669+0000 7f3afd322800 20 rados->read ofs=0 len=0 2024-09-12T17:36:24.672 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.670+0000 7f3afd322800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:36:24.672 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.670+0000 7f3afd322800 20 rados->read ofs=0 len=0 2024-09-12T17:36:24.672 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.670+0000 7f3afd322800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:36:24.672 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.670+0000 7f3afd322800 20 zone default found 2024-09-12T17:36:24.672 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.670+0000 7f3afd322800 4 Realm: () 2024-09-12T17:36:24.672 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.670+0000 7f3afd322800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:36:24.672 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.670+0000 7f3afd322800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:36:24.672 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.670+0000 7f3afd322800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:36:24.672 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.670+0000 7f3afd322800 20 zonegroup default 2024-09-12T17:36:24.673 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.670+0000 7f3afd322800 20 rados->read ofs=0 len=0 2024-09-12T17:36:24.673 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.670+0000 7f3afd322800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:24.673 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.670+0000 7f3afd322800 20 rados->read ofs=0 len=0 2024-09-12T17:36:24.673 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.671+0000 7f3afd322800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:24.673 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.671+0000 7f3afd322800 20 rados->read ofs=0 len=0 2024-09-12T17:36:24.673 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.671+0000 7f3afd322800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:24.673 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.671+0000 7f3afd322800 20 started sync module instance, tier type = 2024-09-12T17:36:24.673 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.671+0000 7f3afd322800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:36:24.682 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.681+0000 7f3afd322800 20 add_watcher() i=0 2024-09-12T17:36:24.682 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.681+0000 7f3afd322800 20 add_watcher() i=1 2024-09-12T17:36:24.682 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.681+0000 7f3afd322800 20 add_watcher() i=2 2024-09-12T17:36:24.682 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.681+0000 7f3afd322800 20 add_watcher() i=3 2024-09-12T17:36:24.682 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.681+0000 7f3afd322800 20 add_watcher() i=4 2024-09-12T17:36:24.682 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.681+0000 7f3afd322800 20 add_watcher() i=5 2024-09-12T17:36:24.682 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.681+0000 7f3afd322800 20 add_watcher() i=6 2024-09-12T17:36:24.683 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.682+0000 7f3afd322800 20 add_watcher() i=7 2024-09-12T17:36:24.683 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.682+0000 7f3afd322800 2 all 8 watchers are set, enabling cache 2024-09-12T17:36:24.685 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.684+0000 7f39aefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:36:24.687 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.684+0000 7f3afd322800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:36:24.687 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.684+0000 7f3afd322800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:36:24.687 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.684+0000 7f3afd322800 5 note: GC not initialized 2024-09-12T17:36:24.687 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.685+0000 7f39adfe3640 20 reqs_thread_entry: start 2024-09-12T17:36:24.687 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.685+0000 7f3afd322800 20 init_complete bucket index max shards: 11 2024-09-12T17:36:24.687 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.685+0000 7f3afd322800 20 Filter name: none 2024-09-12T17:36:24.687 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.685+0000 7f391f7fe640 20 reqs_thread_entry: start 2024-09-12T17:36:24.687 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.685+0000 7f3afd322800 20 rados->read ofs=0 len=0 2024-09-12T17:36:24.687 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.685+0000 7f3afd322800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:36:24.687 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.685+0000 7f3afd322800 20 rados->read ofs=0 len=0 2024-09-12T17:36:24.688 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.686+0000 7f3afd322800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:36:24.688 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.686+0000 7f3afd322800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:36:24.688 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.686+0000 7f3afd322800 20 rados->read ofs=0 len=0 2024-09-12T17:36:24.688 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.686+0000 7f3afd322800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:36:24.689 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.687+0000 7f3afd322800 20 rados->read ofs=0 len=0 2024-09-12T17:36:24.689 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.687+0000 7f3afd322800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:36:24.689 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.687+0000 7f3afd322800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:36:24.689 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.689+0000 7f39aefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:36:24.692 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.691+0000 7f3afd322800 20 remove_watcher() i=0 2024-09-12T17:36:24.692 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.691+0000 7f3afd322800 2 removed watcher, disabling cache 2024-09-12T17:36:24.693 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.692+0000 7f3afd322800 20 remove_watcher() i=1 2024-09-12T17:36:24.694 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.693+0000 7f3afd322800 20 remove_watcher() i=2 2024-09-12T17:36:24.695 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.694+0000 7f3afd322800 20 remove_watcher() i=3 2024-09-12T17:36:24.696 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.695+0000 7f3afd322800 20 remove_watcher() i=4 2024-09-12T17:36:24.697 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.696+0000 7f3afd322800 20 remove_watcher() i=5 2024-09-12T17:36:24.698 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.697+0000 7f3afd322800 20 remove_watcher() i=6 2024-09-12T17:36:24.699 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.698+0000 7f3afd322800 20 remove_watcher() i=7 2024-09-12T17:36:24.710 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:36:24.710 INFO:tasks.workunit.client.0.smithi037.stderr:BUCKET_STATS: 2024-09-12T17:36:24.710 INFO:tasks.workunit.client.0.smithi037.stderr:bucket: error-at-change-reshard-state id: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.38 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:36:24.710 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:36:24.800 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bucket reshard --bucket error-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:36:24.833 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:36:24.833 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:36:24.873 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.872+0000 7fa3ba908800 20 rados->read ofs=0 len=0 2024-09-12T17:36:24.874 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.873+0000 7fa3ba908800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:24.874 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.873+0000 7fa3ba908800 20 realm 2024-09-12T17:36:24.874 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.873+0000 7fa3ba908800 20 rados->read ofs=0 len=0 2024-09-12T17:36:24.875 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.873+0000 7fa3ba908800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:24.875 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.873+0000 7fa3ba908800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:36:24.875 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.873+0000 7fa3ba908800 20 rados->read ofs=0 len=0 2024-09-12T17:36:24.875 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.874+0000 7fa3ba908800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:24.875 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.874+0000 7fa3ba908800 20 rados->read ofs=0 len=0 2024-09-12T17:36:24.876 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.875+0000 7fa3ba908800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:36:24.876 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.875+0000 7fa3ba908800 20 rados->read ofs=0 len=0 2024-09-12T17:36:24.876 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.875+0000 7fa3ba908800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:36:24.876 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.875+0000 7fa3ba908800 20 searching for the correct realm 2024-09-12T17:36:24.878 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.878+0000 7fa3b7bf1640 0 -- 172.21.15.37:0/1810758491 >> [v2:172.21.15.40:6800/2441293461,v1:172.21.15.40:6801/2441293461] conn(0x7fa3a801f060 msgr2=0x7fa3a8067470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:36:24.882 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:24.881+0000 7fa3b83f2640 0 -- 172.21.15.37:0/1810758491 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7fa3ac06db90 msgr2=0x7fa3ac066610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:36:25.089 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.087+0000 7fa3ba908800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:36:25.089 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.087+0000 7fa3ba908800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:36:25.089 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.087+0000 7fa3ba908800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:36:25.089 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.087+0000 7fa3ba908800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:36:25.089 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.087+0000 7fa3ba908800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:36:25.089 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.087+0000 7fa3ba908800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:36:25.089 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.087+0000 7fa3ba908800 20 rados->read ofs=0 len=0 2024-09-12T17:36:25.089 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.088+0000 7fa3ba908800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:25.090 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.088+0000 7fa3ba908800 20 rados->read ofs=0 len=0 2024-09-12T17:36:25.090 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.088+0000 7fa3ba908800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:36:25.090 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.088+0000 7fa3ba908800 20 rados->read ofs=0 len=0 2024-09-12T17:36:25.091 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.088+0000 7fa3ba908800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:36:25.091 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.088+0000 7fa3ba908800 20 zone default found 2024-09-12T17:36:25.091 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.088+0000 7fa3ba908800 4 Realm: () 2024-09-12T17:36:25.091 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.088+0000 7fa3ba908800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:36:25.091 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.088+0000 7fa3ba908800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:36:25.092 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.088+0000 7fa3ba908800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:36:25.092 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.088+0000 7fa3ba908800 20 zonegroup default 2024-09-12T17:36:25.092 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.088+0000 7fa3ba908800 20 rados->read ofs=0 len=0 2024-09-12T17:36:25.092 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.089+0000 7fa3ba908800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:25.092 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.089+0000 7fa3ba908800 20 rados->read ofs=0 len=0 2024-09-12T17:36:25.092 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.089+0000 7fa3ba908800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:25.092 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.089+0000 7fa3ba908800 20 rados->read ofs=0 len=0 2024-09-12T17:36:25.092 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.089+0000 7fa3ba908800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:25.092 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.089+0000 7fa3ba908800 20 started sync module instance, tier type = 2024-09-12T17:36:25.092 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.089+0000 7fa3ba908800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:36:25.100 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.099+0000 7fa3ba908800 20 add_watcher() i=0 2024-09-12T17:36:25.100 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.099+0000 7fa3ba908800 20 add_watcher() i=1 2024-09-12T17:36:25.101 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.099+0000 7fa3ba908800 20 add_watcher() i=2 2024-09-12T17:36:25.101 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.099+0000 7fa3ba908800 20 add_watcher() i=3 2024-09-12T17:36:25.101 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.099+0000 7fa3ba908800 20 add_watcher() i=4 2024-09-12T17:36:25.101 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.099+0000 7fa3ba908800 20 add_watcher() i=5 2024-09-12T17:36:25.101 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.099+0000 7fa3ba908800 20 add_watcher() i=6 2024-09-12T17:36:25.101 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.100+0000 7fa3ba908800 20 add_watcher() i=7 2024-09-12T17:36:25.101 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.100+0000 7fa3ba908800 2 all 8 watchers are set, enabling cache 2024-09-12T17:36:25.103 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.102+0000 7fa26efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:36:25.104 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.102+0000 7fa3ba908800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:36:25.104 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.102+0000 7fa3ba908800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:36:25.104 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.102+0000 7fa3ba908800 5 note: GC not initialized 2024-09-12T17:36:25.104 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.103+0000 7fa26dfdb640 20 reqs_thread_entry: start 2024-09-12T17:36:25.104 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.103+0000 7fa3ba908800 20 init_complete bucket index max shards: 11 2024-09-12T17:36:25.104 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.103+0000 7fa3ba908800 20 Filter name: none 2024-09-12T17:36:25.104 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.103+0000 7fa1df7fe640 20 reqs_thread_entry: start 2024-09-12T17:36:25.104 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.103+0000 7fa3ba908800 10 cache get: name=default.rgw.meta+root+error-at-change-reshard-state : miss 2024-09-12T17:36:25.104 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.103+0000 7fa3ba908800 20 rados->read ofs=0 len=0 2024-09-12T17:36:25.105 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.104+0000 7fa3ba908800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:36:25.105 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.104+0000 7fa3ba908800 10 cache put: name=default.rgw.meta+root+error-at-change-reshard-state info.flags=0x11 2024-09-12T17:36:25.106 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.104+0000 7fa3ba908800 10 adding default.rgw.meta+root+error-at-change-reshard-state to cache LRU end 2024-09-12T17:36:25.106 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.104+0000 7fa3ba908800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.38 : miss 2024-09-12T17:36:25.106 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.104+0000 7fa3ba908800 20 rados->read ofs=0 len=0 2024-09-12T17:36:25.106 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.104+0000 7fa3ba908800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:36:25.106 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.104+0000 7fa3ba908800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.38 info.flags=0x17 2024-09-12T17:36:25.106 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.104+0000 7fa3ba908800 10 adding default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.38 to cache LRU end 2024-09-12T17:36:25.106 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.104+0000 7fa3ba908800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:36:25.106 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.104+0000 7fa3ba908800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:36:25.106 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.104+0000 7fa3ba908800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.38 2024-09-12T17:36:25.110 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.110+0000 7fa3ba908800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.38 info.flags=0x17 2024-09-12T17:36:25.110 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.110+0000 7fa3ba908800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.38 to cache LRU end 2024-09-12T17:36:25.110 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.110+0000 7fa3ba908800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:36:25.111 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.110+0000 7fa3ba908800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.38, ofs0, ns] 2024-09-12T17:36:25.111 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.110+0000 7fa28effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497008 cookie 94794165998208 notifier 7403 bl.length()=1015 2024-09-12T17:36:25.111 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.110+0000 7fa28effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.38 info.flags=0x17 2024-09-12T17:36:25.111 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.110+0000 7fa28effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.38 to cache LRU end 2024-09-12T17:36:25.111 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.110+0000 7fa28effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:36:25.112 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.112+0000 7fa3ba908800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.38]): orig_sources= new_sources= 2024-09-12T17:36:25.113 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.112+0000 7fa3ba908800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.38]): potential sources added=[] removed=[] 2024-09-12T17:36:25.113 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.112+0000 7fa3ba908800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.38]): orig_dests= new_dests= 2024-09-12T17:36:25.113 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.112+0000 7fa3ba908800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.38]): potential dests added=[] removed=[] 2024-09-12T17:36:25.118 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.117+0000 7fa3ba908800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.38.1.0 2024-09-12T17:36:25.118 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.117+0000 7fa3ba908800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.38.1.0 2024-09-12T17:36:25.118 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.117+0000 7fa3ba908800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.38.1.1 2024-09-12T17:36:25.118 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.117+0000 7fa3ba908800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.38.1.1 2024-09-12T17:36:25.118 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.117+0000 7fa3ba908800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.38.1.2 2024-09-12T17:36:25.118 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.117+0000 7fa3ba908800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.38.1.2 2024-09-12T17:36:25.118 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.117+0000 7fa3ba908800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.38.1.3 2024-09-12T17:36:25.119 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.117+0000 7fa3ba908800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.38.1.3 2024-09-12T17:36:25.119 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.117+0000 7fa3ba908800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.38.1.4 2024-09-12T17:36:25.119 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.117+0000 7fa3ba908800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.38.1.4 2024-09-12T17:36:25.119 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.117+0000 7fa3ba908800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.38.1.5 2024-09-12T17:36:25.119 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.117+0000 7fa3ba908800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.38.1.5 2024-09-12T17:36:25.119 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.117+0000 7fa3ba908800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.38.1.6 2024-09-12T17:36:25.119 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.117+0000 7fa3ba908800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.38.1.6 2024-09-12T17:36:25.119 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.117+0000 7fa3ba908800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.38.1.7 2024-09-12T17:36:25.119 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.117+0000 7fa3ba908800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.38.1.7 2024-09-12T17:36:25.119 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.117+0000 7fa3ba908800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.38.1.8 2024-09-12T17:36:25.119 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.117+0000 7fa3ba908800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.38.1.8 2024-09-12T17:36:25.119 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.117+0000 7fa3ba908800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.38.1.9 2024-09-12T17:36:25.120 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.117+0000 7fa3ba908800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.38.1.9 2024-09-12T17:36:25.120 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.117+0000 7fa3ba908800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.38.1.10 2024-09-12T17:36:25.120 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.117+0000 7fa3ba908800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.38.1.10 2024-09-12T17:36:25.120 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.117+0000 7fa3ba908800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.38.1.11 2024-09-12T17:36:25.120 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.117+0000 7fa3ba908800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.38.1.11 2024-09-12T17:36:25.120 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.117+0000 7fa3ba908800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.38.0 2024-09-12T17:36:25.120 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.117+0000 7fa3ba908800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.38.1 2024-09-12T17:36:25.121 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.118+0000 7fa3ba908800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.38.2 2024-09-12T17:36:25.121 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.118+0000 7fa3ba908800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.38.3 2024-09-12T17:36:25.121 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.119+0000 7fa3ba908800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.38.4 2024-09-12T17:36:25.121 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.119+0000 7fa3ba908800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.38.5 2024-09-12T17:36:25.121 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.120+0000 7fa3ba908800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.38.6 2024-09-12T17:36:25.121 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.120+0000 7fa3ba908800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.38.7 2024-09-12T17:36:25.122 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.121+0000 7fa3ba908800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.38.8 2024-09-12T17:36:25.122 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.122+0000 7fa3ba908800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.38.9 2024-09-12T17:36:25.123 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.122+0000 7fa3ba908800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.38.10 2024-09-12T17:36:25.126 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.125+0000 7fa3ba908800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.38 : hit (requested=0x17, cached=0x17) 2024-09-12T17:36:25.126 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.125+0000 7fa3ba908800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.38 2024-09-12T17:36:25.128 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.127+0000 7fa3ba908800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.38 info.flags=0x17 2024-09-12T17:36:25.128 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.127+0000 7fa3ba908800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.38 to cache LRU end 2024-09-12T17:36:25.128 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.127+0000 7fa3ba908800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:36:25.128 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.127+0000 7fa3ba908800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.38, ofs0, ns] 2024-09-12T17:36:25.128 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.127+0000 7fa28effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497009 cookie 94794165998208 notifier 7403 bl.length()=1015 2024-09-12T17:36:25.128 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.127+0000 7fa28effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.38 info.flags=0x17 2024-09-12T17:36:25.128 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.127+0000 7fa28effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.38 to cache LRU end 2024-09-12T17:36:25.128 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.127+0000 7fa28effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:36:25.130 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.128+0000 7fa3ba908800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.38]): orig_sources= new_sources= 2024-09-12T17:36:25.130 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.128+0000 7fa3ba908800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.38]): potential sources added=[] removed=[] 2024-09-12T17:36:25.130 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.128+0000 7fa3ba908800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.38]): orig_dests= new_dests= 2024-09-12T17:36:25.130 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.128+0000 7fa3ba908800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.38]): potential dests added=[] removed=[] 2024-09-12T17:36:25.132 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.131+0000 7fa3ba908800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.38.0 2024-09-12T17:36:25.132 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.131+0000 7fa3ba908800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.38.1 2024-09-12T17:36:25.132 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.132+0000 7fa3ba908800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.38.2 2024-09-12T17:36:25.133 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.132+0000 7fa3ba908800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.38.3 2024-09-12T17:36:25.133 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.132+0000 7fa3ba908800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.38.4 2024-09-12T17:36:25.133 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.133+0000 7fa3ba908800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.38.5 2024-09-12T17:36:25.134 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.133+0000 7fa3ba908800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.38.6 2024-09-12T17:36:25.134 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.133+0000 7fa3ba908800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.38.7 2024-09-12T17:36:25.134 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.134+0000 7fa3ba908800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.38.8 2024-09-12T17:36:25.135 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.134+0000 7fa3ba908800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.38.9 2024-09-12T17:36:25.135 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.134+0000 7fa3ba908800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.38.10 2024-09-12T17:36:25.135 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.135+0000 7fa3ba908800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.38 : hit (requested=0x17, cached=0x17) 2024-09-12T17:36:25.135 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.135+0000 7fa3ba908800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.38 2024-09-12T17:36:25.137 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.136+0000 7fa3ba908800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.38 info.flags=0x17 2024-09-12T17:36:25.137 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.136+0000 7fa3ba908800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.38 to cache LRU end 2024-09-12T17:36:25.137 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.136+0000 7fa3ba908800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:36:25.137 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.136+0000 7fa3ba908800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.38, ofs0, ns] 2024-09-12T17:36:25.137 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.136+0000 7fa28effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497010 cookie 94794165998208 notifier 7403 bl.length()=983 2024-09-12T17:36:25.137 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.136+0000 7fa28effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.38 info.flags=0x17 2024-09-12T17:36:25.137 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.136+0000 7fa28effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.38 to cache LRU end 2024-09-12T17:36:25.138 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.136+0000 7fa28effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:36:25.138 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.138+0000 7fa3ba908800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.38]): orig_sources= new_sources= 2024-09-12T17:36:25.139 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.138+0000 7fa3ba908800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.38]): potential sources added=[] removed=[] 2024-09-12T17:36:25.139 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.138+0000 7fa3ba908800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.38]): orig_dests= new_dests= 2024-09-12T17:36:25.139 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.138+0000 7fa3ba908800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.38]): potential dests added=[] removed=[] 2024-09-12T17:36:25.141 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.140+0000 7fa3ba908800 1 execute INFO: reshard of bucket "error-at-change-reshard-state" from 11 shards to 12 shards completed successfully 2024-09-12T17:36:25.143 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.142+0000 7fa26efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:36:25.145 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.144+0000 7fa3ba908800 20 remove_watcher() i=0 2024-09-12T17:36:25.145 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.144+0000 7fa3ba908800 2 removed watcher, disabling cache 2024-09-12T17:36:25.146 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.145+0000 7fa3ba908800 20 remove_watcher() i=1 2024-09-12T17:36:25.147 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.146+0000 7fa3ba908800 20 remove_watcher() i=2 2024-09-12T17:36:25.148 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.147+0000 7fa3ba908800 20 remove_watcher() i=3 2024-09-12T17:36:25.149 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.149+0000 7fa3ba908800 20 remove_watcher() i=4 2024-09-12T17:36:25.150 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.150+0000 7fa3ba908800 20 remove_watcher() i=5 2024-09-12T17:36:25.151 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.150+0000 7fa3ba908800 20 remove_watcher() i=6 2024-09-12T17:36:25.152 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.151+0000 7fa3ba908800 20 remove_watcher() i=7 2024-09-12T17:36:25.164 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-12T17:36:25.194 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:36:25.194 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:36:25.234 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.233+0000 7fbc3e12e800 20 rados->read ofs=0 len=0 2024-09-12T17:36:25.236 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.235+0000 7fbc3e12e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:25.236 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.235+0000 7fbc3e12e800 20 realm 2024-09-12T17:36:25.236 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.235+0000 7fbc3e12e800 20 rados->read ofs=0 len=0 2024-09-12T17:36:25.236 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.235+0000 7fbc3e12e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:25.236 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.235+0000 7fbc3e12e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:36:25.236 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.235+0000 7fbc3e12e800 20 rados->read ofs=0 len=0 2024-09-12T17:36:25.236 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.235+0000 7fbc3e12e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:25.236 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.235+0000 7fbc3e12e800 20 rados->read ofs=0 len=0 2024-09-12T17:36:25.237 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.236+0000 7fbc3e12e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:36:25.237 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.236+0000 7fbc3e12e800 20 rados->read ofs=0 len=0 2024-09-12T17:36:25.237 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.236+0000 7fbc3e12e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:36:25.237 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.236+0000 7fbc3e12e800 20 searching for the correct realm 2024-09-12T17:36:25.238 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.238+0000 7fbc39eb0640 0 -- 172.21.15.37:0/3107951825 >> [v2:172.21.15.37:6800/1206746176,v1:172.21.15.37:6801/1206746176] conn(0x7fbc34026040 msgr2=0x7fbc34016400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:36:25.445 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.444+0000 7fbc3a6b1640 0 -- 172.21.15.37:0/3107951825 >> [v2:172.21.15.40:6818/1210108009,v1:172.21.15.40:6819/1210108009] conn(0x7fbc30061040 msgr2=0x7fbc3006d920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:36:25.451 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.451+0000 7fbc3e12e800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:36:25.452 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.451+0000 7fbc3e12e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:36:25.452 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.451+0000 7fbc3e12e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:36:25.452 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.451+0000 7fbc3e12e800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:36:25.452 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.451+0000 7fbc3e12e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:36:25.452 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.451+0000 7fbc3e12e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:36:25.452 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.451+0000 7fbc3e12e800 20 rados->read ofs=0 len=0 2024-09-12T17:36:25.452 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.451+0000 7fbc3e12e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:25.452 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.451+0000 7fbc3e12e800 20 rados->read ofs=0 len=0 2024-09-12T17:36:25.453 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.451+0000 7fbc3e12e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:36:25.453 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.451+0000 7fbc3e12e800 20 rados->read ofs=0 len=0 2024-09-12T17:36:25.453 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.452+0000 7fbc3e12e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:36:25.453 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.452+0000 7fbc3e12e800 20 zone default found 2024-09-12T17:36:25.453 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.452+0000 7fbc3e12e800 4 Realm: () 2024-09-12T17:36:25.453 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.452+0000 7fbc3e12e800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:36:25.454 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.452+0000 7fbc3e12e800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:36:25.454 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.452+0000 7fbc3e12e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:36:25.454 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.452+0000 7fbc3e12e800 20 zonegroup default 2024-09-12T17:36:25.454 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.452+0000 7fbc3e12e800 20 rados->read ofs=0 len=0 2024-09-12T17:36:25.454 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.452+0000 7fbc3e12e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:25.454 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.452+0000 7fbc3e12e800 20 rados->read ofs=0 len=0 2024-09-12T17:36:25.454 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.452+0000 7fbc3e12e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:25.454 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.452+0000 7fbc3e12e800 20 rados->read ofs=0 len=0 2024-09-12T17:36:25.454 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.453+0000 7fbc3e12e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:25.455 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.453+0000 7fbc3e12e800 20 started sync module instance, tier type = 2024-09-12T17:36:25.455 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.453+0000 7fbc3e12e800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:36:25.464 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.463+0000 7fbc3e12e800 20 add_watcher() i=0 2024-09-12T17:36:25.464 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.463+0000 7fbc3e12e800 20 add_watcher() i=1 2024-09-12T17:36:25.464 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.463+0000 7fbc3e12e800 20 add_watcher() i=2 2024-09-12T17:36:25.464 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.463+0000 7fbc3e12e800 20 add_watcher() i=3 2024-09-12T17:36:25.464 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.463+0000 7fbc3e12e800 20 add_watcher() i=4 2024-09-12T17:36:25.465 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.463+0000 7fbc3e12e800 20 add_watcher() i=5 2024-09-12T17:36:25.465 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.463+0000 7fbc3e12e800 20 add_watcher() i=6 2024-09-12T17:36:25.465 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.464+0000 7fbc3e12e800 20 add_watcher() i=7 2024-09-12T17:36:25.465 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.464+0000 7fbc3e12e800 2 all 8 watchers are set, enabling cache 2024-09-12T17:36:25.466 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.466+0000 7fbaeffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:36:25.467 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.466+0000 7fbc3e12e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:36:25.467 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.466+0000 7fbc3e12e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:36:25.468 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.466+0000 7fbc3e12e800 5 note: GC not initialized 2024-09-12T17:36:25.468 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.466+0000 7fbaeefe5640 20 reqs_thread_entry: start 2024-09-12T17:36:25.468 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.466+0000 7fbc3e12e800 20 init_complete bucket index max shards: 11 2024-09-12T17:36:25.468 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.466+0000 7fbc3e12e800 20 Filter name: none 2024-09-12T17:36:25.468 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.467+0000 7fbaecfe1640 20 reqs_thread_entry: start 2024-09-12T17:36:25.468 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.467+0000 7fbc3e12e800 20 rados->read ofs=0 len=0 2024-09-12T17:36:25.469 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.467+0000 7fbc3e12e800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:36:25.469 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.467+0000 7fbc3e12e800 20 rados->read ofs=0 len=0 2024-09-12T17:36:25.469 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.468+0000 7fbc3e12e800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:36:25.469 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.468+0000 7fbc3e12e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:36:25.469 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.468+0000 7fbc3e12e800 20 rados->read ofs=0 len=0 2024-09-12T17:36:25.470 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.468+0000 7fbc3e12e800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:36:25.470 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.468+0000 7fbc3e12e800 20 rados->read ofs=0 len=0 2024-09-12T17:36:25.470 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.469+0000 7fbc3e12e800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:36:25.470 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.469+0000 7fbc3e12e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:36:25.471 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.470+0000 7fbaeffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:36:25.473 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.473+0000 7fbc3e12e800 20 remove_watcher() i=0 2024-09-12T17:36:25.474 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.473+0000 7fbc3e12e800 2 removed watcher, disabling cache 2024-09-12T17:36:25.475 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.474+0000 7fbc3e12e800 20 remove_watcher() i=1 2024-09-12T17:36:25.476 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.475+0000 7fbc3e12e800 20 remove_watcher() i=2 2024-09-12T17:36:25.477 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.476+0000 7fbc3e12e800 20 remove_watcher() i=3 2024-09-12T17:36:25.478 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.477+0000 7fbc3e12e800 20 remove_watcher() i=4 2024-09-12T17:36:25.479 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.478+0000 7fbc3e12e800 20 remove_watcher() i=5 2024-09-12T17:36:25.480 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.479+0000 7fbc3e12e800 20 remove_watcher() i=6 2024-09-12T17:36:25.481 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:25.480+0000 7fbc3e12e800 20 remove_watcher() i=7 2024-09-12T17:36:25.493 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:36:25.493 INFO:tasks.workunit.client.0.smithi037.stderr:BUCKET_STATS: 2024-09-12T17:36:25.493 INFO:tasks.workunit.client.0.smithi037.stderr:bucket: error-at-change-reshard-state id: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.38 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T17:36:25.493 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:36:25.845 INFO:tasks.workunit.client.0.smithi037.stderr:TEST: reshard bucket with ECANCELED injected at change_reshard_state 2024-09-12T17:36:25.845 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:36:26.626 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-12T17:36:26.655 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:36:26.655 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:36:26.694 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:26.693+0000 7f9e1432c800 20 rados->read ofs=0 len=0 2024-09-12T17:36:26.696 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:26.695+0000 7f9e1432c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:26.696 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:26.695+0000 7f9e1432c800 20 realm 2024-09-12T17:36:26.696 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:26.695+0000 7f9e1432c800 20 rados->read ofs=0 len=0 2024-09-12T17:36:26.696 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:26.695+0000 7f9e1432c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:26.696 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:26.695+0000 7f9e1432c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:36:26.696 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:26.695+0000 7f9e1432c800 20 rados->read ofs=0 len=0 2024-09-12T17:36:26.696 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:26.695+0000 7f9e1432c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:26.697 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:26.695+0000 7f9e1432c800 20 rados->read ofs=0 len=0 2024-09-12T17:36:26.697 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:26.696+0000 7f9e1432c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:36:26.697 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:26.696+0000 7f9e1432c800 20 rados->read ofs=0 len=0 2024-09-12T17:36:26.697 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:26.696+0000 7f9e1432c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:36:26.697 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:26.696+0000 7f9e1432c800 20 searching for the correct realm 2024-09-12T17:36:26.700 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:26.699+0000 7f9e0f855640 0 -- 172.21.15.37:0/3394332566 >> [v2:172.21.15.40:6800/2441293461,v1:172.21.15.40:6801/2441293461] conn(0x7f9e00072b80 msgr2=0x7f9e0003c510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:36:26.704 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:26.703+0000 7f9e10056640 0 -- 172.21.15.37:0/3394332566 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7f9e04097b90 msgr2=0x7f9e04082860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:36:26.912 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:26.911+0000 7f9e1432c800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:36:26.912 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:26.911+0000 7f9e1432c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:36:26.912 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:26.911+0000 7f9e1432c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:36:26.912 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:26.911+0000 7f9e1432c800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:36:26.912 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:26.911+0000 7f9e1432c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:36:26.913 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:26.911+0000 7f9e1432c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:36:26.913 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:26.911+0000 7f9e1432c800 20 rados->read ofs=0 len=0 2024-09-12T17:36:26.913 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:26.911+0000 7f9e1432c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:26.913 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:26.911+0000 7f9e1432c800 20 rados->read ofs=0 len=0 2024-09-12T17:36:26.913 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:26.911+0000 7f9e1432c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:36:26.913 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:26.911+0000 7f9e1432c800 20 rados->read ofs=0 len=0 2024-09-12T17:36:26.914 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:26.912+0000 7f9e1432c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:36:26.914 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:26.912+0000 7f9e1432c800 20 zone default found 2024-09-12T17:36:26.914 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:26.912+0000 7f9e1432c800 4 Realm: () 2024-09-12T17:36:26.914 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:26.912+0000 7f9e1432c800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:36:26.915 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:26.912+0000 7f9e1432c800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:36:26.915 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:26.912+0000 7f9e1432c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:36:26.915 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:26.912+0000 7f9e1432c800 20 zonegroup default 2024-09-12T17:36:26.915 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:26.912+0000 7f9e1432c800 20 rados->read ofs=0 len=0 2024-09-12T17:36:26.915 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:26.912+0000 7f9e1432c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:26.915 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:26.912+0000 7f9e1432c800 20 rados->read ofs=0 len=0 2024-09-12T17:36:26.915 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:26.912+0000 7f9e1432c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:26.915 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:26.912+0000 7f9e1432c800 20 rados->read ofs=0 len=0 2024-09-12T17:36:26.915 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:26.913+0000 7f9e1432c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:26.915 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:26.913+0000 7f9e1432c800 20 started sync module instance, tier type = 2024-09-12T17:36:26.915 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:26.913+0000 7f9e1432c800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:36:26.923 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:26.922+0000 7f9e1432c800 20 add_watcher() i=0 2024-09-12T17:36:26.923 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:26.922+0000 7f9e1432c800 20 add_watcher() i=1 2024-09-12T17:36:26.923 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:26.922+0000 7f9e1432c800 20 add_watcher() i=2 2024-09-12T17:36:26.923 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:26.922+0000 7f9e1432c800 20 add_watcher() i=3 2024-09-12T17:36:26.923 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:26.922+0000 7f9e1432c800 20 add_watcher() i=4 2024-09-12T17:36:26.923 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:26.922+0000 7f9e1432c800 20 add_watcher() i=5 2024-09-12T17:36:26.923 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:26.922+0000 7f9e1432c800 20 add_watcher() i=6 2024-09-12T17:36:26.924 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:26.923+0000 7f9e1432c800 20 add_watcher() i=7 2024-09-12T17:36:26.924 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:26.923+0000 7f9e1432c800 2 all 8 watchers are set, enabling cache 2024-09-12T17:36:26.925 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:26.925+0000 7f9cc6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:36:26.927 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:26.925+0000 7f9e1432c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:36:26.927 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:26.925+0000 7f9e1432c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:36:26.927 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:26.925+0000 7f9e1432c800 5 note: GC not initialized 2024-09-12T17:36:26.927 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:26.925+0000 7f9cc5fdb640 20 reqs_thread_entry: start 2024-09-12T17:36:26.927 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:26.926+0000 7f9e1432c800 20 init_complete bucket index max shards: 11 2024-09-12T17:36:26.927 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:26.926+0000 7f9e1432c800 20 Filter name: none 2024-09-12T17:36:26.927 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:26.926+0000 7f9c377fe640 20 reqs_thread_entry: start 2024-09-12T17:36:26.927 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:26.926+0000 7f9e1432c800 20 rados->read ofs=0 len=0 2024-09-12T17:36:26.929 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:26.926+0000 7f9e1432c800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:36:26.929 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:26.926+0000 7f9e1432c800 20 rados->read ofs=0 len=0 2024-09-12T17:36:26.929 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:26.927+0000 7f9e1432c800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:36:26.929 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:26.927+0000 7f9e1432c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:36:26.929 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:26.927+0000 7f9e1432c800 20 rados->read ofs=0 len=0 2024-09-12T17:36:26.929 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:26.927+0000 7f9e1432c800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:36:26.929 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:26.927+0000 7f9e1432c800 20 rados->read ofs=0 len=0 2024-09-12T17:36:26.930 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:26.928+0000 7f9e1432c800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:36:26.930 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:26.928+0000 7f9e1432c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:36:26.930 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:26.930+0000 7f9cc6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:36:26.933 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:26.932+0000 7f9e1432c800 20 remove_watcher() i=0 2024-09-12T17:36:26.933 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:26.932+0000 7f9e1432c800 2 removed watcher, disabling cache 2024-09-12T17:36:26.934 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:26.933+0000 7f9e1432c800 20 remove_watcher() i=1 2024-09-12T17:36:26.935 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:26.934+0000 7f9e1432c800 20 remove_watcher() i=2 2024-09-12T17:36:26.936 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:26.935+0000 7f9e1432c800 20 remove_watcher() i=3 2024-09-12T17:36:26.937 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:26.936+0000 7f9e1432c800 20 remove_watcher() i=4 2024-09-12T17:36:26.938 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:26.937+0000 7f9e1432c800 20 remove_watcher() i=5 2024-09-12T17:36:26.939 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:26.938+0000 7f9e1432c800 20 remove_watcher() i=6 2024-09-12T17:36:26.940 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:26.939+0000 7f9e1432c800 20 remove_watcher() i=7 2024-09-12T17:36:26.951 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:36:26.951 INFO:tasks.workunit.client.0.smithi037.stderr:BUCKET_STATS: 2024-09-12T17:36:26.951 INFO:tasks.workunit.client.0.smithi037.stderr:bucket: error-at-change-reshard-state id: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.39 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:36:26.951 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:36:26.953 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bucket reshard --bucket error-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at change_reshard_state --inject-error-code 125 2024-09-12T17:36:26.990 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:36:26.990 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:36:27.030 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.029+0000 7f5a4e810800 20 rados->read ofs=0 len=0 2024-09-12T17:36:27.032 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.031+0000 7f5a4e810800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:27.032 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.031+0000 7f5a4e810800 20 realm 2024-09-12T17:36:27.032 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.031+0000 7f5a4e810800 20 rados->read ofs=0 len=0 2024-09-12T17:36:27.032 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.031+0000 7f5a4e810800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:27.032 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.031+0000 7f5a4e810800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:36:27.032 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.031+0000 7f5a4e810800 20 rados->read ofs=0 len=0 2024-09-12T17:36:27.032 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.031+0000 7f5a4e810800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:27.032 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.031+0000 7f5a4e810800 20 rados->read ofs=0 len=0 2024-09-12T17:36:27.033 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.032+0000 7f5a4e810800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:36:27.033 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.032+0000 7f5a4e810800 20 rados->read ofs=0 len=0 2024-09-12T17:36:27.033 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.032+0000 7f5a4e810800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:36:27.033 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.032+0000 7f5a4e810800 20 searching for the correct realm 2024-09-12T17:36:27.036 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.035+0000 7f5a417bb640 0 -- 172.21.15.37:0/1665756351 >> [v2:172.21.15.40:6800/2441293461,v1:172.21.15.40:6801/2441293461] conn(0x7f5a3c066f00 msgr2=0x7f5a3c066970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:36:27.242 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.242+0000 7f5a49fbc640 0 -- 172.21.15.37:0/1665756351 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7f5a340b6810 msgr2=0x7f5a340b6c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:36:27.451 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.449+0000 7f5a4e810800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:36:27.451 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.449+0000 7f5a4e810800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:36:27.451 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.449+0000 7f5a4e810800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:36:27.451 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.449+0000 7f5a4e810800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:36:27.451 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.449+0000 7f5a4e810800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:36:27.451 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.449+0000 7f5a4e810800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:36:27.451 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.449+0000 7f5a4e810800 20 rados->read ofs=0 len=0 2024-09-12T17:36:27.451 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.450+0000 7f5a4e810800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:27.451 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.450+0000 7f5a4e810800 20 rados->read ofs=0 len=0 2024-09-12T17:36:27.453 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.450+0000 7f5a4e810800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:36:27.453 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.450+0000 7f5a4e810800 20 rados->read ofs=0 len=0 2024-09-12T17:36:27.453 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.451+0000 7f5a4e810800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:36:27.453 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.451+0000 7f5a4e810800 20 zone default found 2024-09-12T17:36:27.453 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.451+0000 7f5a4e810800 4 Realm: () 2024-09-12T17:36:27.453 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.451+0000 7f5a4e810800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:36:27.453 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.451+0000 7f5a4e810800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:36:27.453 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.451+0000 7f5a4e810800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:36:27.453 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.451+0000 7f5a4e810800 20 zonegroup default 2024-09-12T17:36:27.453 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.451+0000 7f5a4e810800 20 rados->read ofs=0 len=0 2024-09-12T17:36:27.453 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.451+0000 7f5a4e810800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:27.454 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.451+0000 7f5a4e810800 20 rados->read ofs=0 len=0 2024-09-12T17:36:27.454 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.451+0000 7f5a4e810800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:27.454 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.451+0000 7f5a4e810800 20 rados->read ofs=0 len=0 2024-09-12T17:36:27.454 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.452+0000 7f5a4e810800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:27.454 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.452+0000 7f5a4e810800 20 started sync module instance, tier type = 2024-09-12T17:36:27.454 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.452+0000 7f5a4e810800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:36:27.464 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.463+0000 7f5a4e810800 20 add_watcher() i=0 2024-09-12T17:36:27.464 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.463+0000 7f5a4e810800 20 add_watcher() i=1 2024-09-12T17:36:27.464 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.463+0000 7f5a4e810800 20 add_watcher() i=2 2024-09-12T17:36:27.464 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.463+0000 7f5a4e810800 20 add_watcher() i=3 2024-09-12T17:36:27.464 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.463+0000 7f5a4e810800 20 add_watcher() i=4 2024-09-12T17:36:27.464 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.463+0000 7f5a4e810800 20 add_watcher() i=5 2024-09-12T17:36:27.464 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.463+0000 7f5a4e810800 20 add_watcher() i=6 2024-09-12T17:36:27.465 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.464+0000 7f5a4e810800 20 add_watcher() i=7 2024-09-12T17:36:27.465 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.464+0000 7f5a4e810800 2 all 8 watchers are set, enabling cache 2024-09-12T17:36:27.467 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.466+0000 7f58fb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:36:27.468 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.466+0000 7f5a4e810800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:36:27.468 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.466+0000 7f5a4e810800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:36:27.468 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.466+0000 7f5a4e810800 5 note: GC not initialized 2024-09-12T17:36:27.468 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.467+0000 7f58fa7fc640 20 reqs_thread_entry: start 2024-09-12T17:36:27.468 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.467+0000 7f5a4e810800 20 init_complete bucket index max shards: 11 2024-09-12T17:36:27.468 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.467+0000 7f5a4e810800 20 Filter name: none 2024-09-12T17:36:27.468 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.467+0000 7f586bfff640 20 reqs_thread_entry: start 2024-09-12T17:36:27.468 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.467+0000 7f5a4e810800 10 cache get: name=default.rgw.meta+root+error-at-change-reshard-state : miss 2024-09-12T17:36:27.468 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.467+0000 7f5a4e810800 20 rados->read ofs=0 len=0 2024-09-12T17:36:27.469 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.468+0000 7f5a4e810800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:36:27.469 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.468+0000 7f5a4e810800 10 cache put: name=default.rgw.meta+root+error-at-change-reshard-state info.flags=0x11 2024-09-12T17:36:27.469 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.468+0000 7f5a4e810800 10 adding default.rgw.meta+root+error-at-change-reshard-state to cache LRU end 2024-09-12T17:36:27.469 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.468+0000 7f5a4e810800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.39 : miss 2024-09-12T17:36:27.470 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.468+0000 7f5a4e810800 20 rados->read ofs=0 len=0 2024-09-12T17:36:27.470 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.468+0000 7f5a4e810800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:36:27.470 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.468+0000 7f5a4e810800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.39 info.flags=0x17 2024-09-12T17:36:27.470 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.468+0000 7f5a4e810800 10 adding default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.39 to cache LRU end 2024-09-12T17:36:27.470 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.468+0000 7f5a4e810800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:36:27.470 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.468+0000 7f5a4e810800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:36:27.470 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.468+0000 7f5a4e810800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.39 2024-09-12T17:36:27.476 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.475+0000 7f5a4e810800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.39 info.flags=0x17 2024-09-12T17:36:27.476 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.476+0000 7f5a4e810800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.39 to cache LRU end 2024-09-12T17:36:27.476 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.476+0000 7f5a4e810800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:36:27.476 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.476+0000 7f5a4e810800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.39, ofs0, ns] 2024-09-12T17:36:27.477 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.476+0000 7f592cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497013 cookie 94137799857632 notifier 7977 bl.length()=1015 2024-09-12T17:36:27.477 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.476+0000 7f592cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.39 info.flags=0x17 2024-09-12T17:36:27.477 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.476+0000 7f592cff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.39 to cache LRU end 2024-09-12T17:36:27.477 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.476+0000 7f592cff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:36:27.478 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.478+0000 7f5a4e810800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.39]): orig_sources= new_sources= 2024-09-12T17:36:27.479 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.478+0000 7f5a4e810800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.39]): potential sources added=[] removed=[] 2024-09-12T17:36:27.479 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.478+0000 7f5a4e810800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.39]): orig_dests= new_dests= 2024-09-12T17:36:27.479 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.478+0000 7f5a4e810800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.39]): potential dests added=[] removed=[] 2024-09-12T17:36:27.485 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.484+0000 7f5a4e810800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.39.1.0 2024-09-12T17:36:27.485 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.484+0000 7f5a4e810800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.39.1.0 2024-09-12T17:36:27.485 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.484+0000 7f5a4e810800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.39.1.1 2024-09-12T17:36:27.485 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.484+0000 7f5a4e810800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.39.1.1 2024-09-12T17:36:27.485 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.484+0000 7f5a4e810800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.39.1.2 2024-09-12T17:36:27.485 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.484+0000 7f5a4e810800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.39.1.2 2024-09-12T17:36:27.485 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.484+0000 7f5a4e810800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.39.1.3 2024-09-12T17:36:27.485 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.484+0000 7f5a4e810800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.39.1.3 2024-09-12T17:36:27.485 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.484+0000 7f5a4e810800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.39.1.4 2024-09-12T17:36:27.486 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.484+0000 7f5a4e810800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.39.1.4 2024-09-12T17:36:27.486 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.484+0000 7f5a4e810800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.39.1.5 2024-09-12T17:36:27.486 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.484+0000 7f5a4e810800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.39.1.5 2024-09-12T17:36:27.486 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.484+0000 7f5a4e810800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.39.1.6 2024-09-12T17:36:27.486 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.484+0000 7f5a4e810800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.39.1.6 2024-09-12T17:36:27.486 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.484+0000 7f5a4e810800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.39.1.7 2024-09-12T17:36:27.486 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.484+0000 7f5a4e810800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.39.1.7 2024-09-12T17:36:27.486 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.484+0000 7f5a4e810800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.39.1.8 2024-09-12T17:36:27.486 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.484+0000 7f5a4e810800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.39.1.8 2024-09-12T17:36:27.486 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.484+0000 7f5a4e810800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.39.1.9 2024-09-12T17:36:27.486 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.484+0000 7f5a4e810800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.39.1.9 2024-09-12T17:36:27.486 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.484+0000 7f5a4e810800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.39.1.10 2024-09-12T17:36:27.486 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.484+0000 7f5a4e810800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.39.1.10 2024-09-12T17:36:27.486 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.484+0000 7f5a4e810800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.39.1.11 2024-09-12T17:36:27.487 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.484+0000 7f5a4e810800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.39.1.11 2024-09-12T17:36:27.487 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.484+0000 7f5a4e810800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.39.0 2024-09-12T17:36:27.487 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.484+0000 7f5a4e810800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.39.1 2024-09-12T17:36:27.487 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.485+0000 7f5a4e810800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.39.2 2024-09-12T17:36:27.487 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.486+0000 7f5a4e810800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.39.3 2024-09-12T17:36:27.488 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.486+0000 7f5a4e810800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.39.4 2024-09-12T17:36:27.488 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.487+0000 7f5a4e810800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.39.5 2024-09-12T17:36:27.488 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.488+0000 7f5a4e810800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.39.6 2024-09-12T17:36:27.489 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.488+0000 7f5a4e810800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.39.7 2024-09-12T17:36:27.489 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.489+0000 7f5a4e810800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.39.8 2024-09-12T17:36:27.490 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.490+0000 7f5a4e810800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.39.9 2024-09-12T17:36:27.491 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.490+0000 7f5a4e810800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.39.10 2024-09-12T17:36:27.495 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.494+0000 7f5a4e810800 -1 Injecting error=-125 at location=change_reshard_state 2024-09-12T17:36:27.495 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.494+0000 7f5a4e810800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.39 : hit (requested=0x17, cached=0x17) 2024-09-12T17:36:27.495 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.494+0000 7f5a4e810800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.39 2024-09-12T17:36:27.497 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.496+0000 7f5a4e810800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.39 info.flags=0x17 2024-09-12T17:36:27.497 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.496+0000 7f5a4e810800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.39 to cache LRU end 2024-09-12T17:36:27.497 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.496+0000 7f5a4e810800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:36:27.497 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.496+0000 7f5a4e810800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.39, ofs0, ns] 2024-09-12T17:36:27.497 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.496+0000 7f592d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497014 cookie 94137799857632 notifier 7977 bl.length()=1015 2024-09-12T17:36:27.497 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.496+0000 7f592d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.39 info.flags=0x17 2024-09-12T17:36:27.497 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.496+0000 7f592d7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.39 to cache LRU end 2024-09-12T17:36:27.497 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.496+0000 7f592d7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:36:27.499 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.498+0000 7f5a4e810800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.39]): orig_sources= new_sources= 2024-09-12T17:36:27.499 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.498+0000 7f5a4e810800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.39]): potential sources added=[] removed=[] 2024-09-12T17:36:27.499 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.498+0000 7f5a4e810800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.39]): orig_dests= new_dests= 2024-09-12T17:36:27.499 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.498+0000 7f5a4e810800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.39]): potential dests added=[] removed=[] 2024-09-12T17:36:27.501 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.501+0000 7f5a4e810800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.39.0 2024-09-12T17:36:27.502 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.501+0000 7f5a4e810800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.39.1 2024-09-12T17:36:27.502 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.502+0000 7f5a4e810800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.39.2 2024-09-12T17:36:27.503 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.502+0000 7f5a4e810800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.39.3 2024-09-12T17:36:27.503 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.502+0000 7f5a4e810800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.39.4 2024-09-12T17:36:27.503 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.503+0000 7f5a4e810800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.39.5 2024-09-12T17:36:27.504 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.503+0000 7f5a4e810800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.39.6 2024-09-12T17:36:27.504 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.503+0000 7f5a4e810800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.39.7 2024-09-12T17:36:27.504 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.504+0000 7f5a4e810800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.39.8 2024-09-12T17:36:27.505 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.504+0000 7f5a4e810800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.39.9 2024-09-12T17:36:27.505 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.504+0000 7f5a4e810800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.39.10 2024-09-12T17:36:27.505 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.505+0000 7f5a4e810800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.39 : hit (requested=0x17, cached=0x17) 2024-09-12T17:36:27.506 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.505+0000 7f5a4e810800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.39 2024-09-12T17:36:27.507 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.506+0000 7f5a4e810800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.39 info.flags=0x17 2024-09-12T17:36:27.507 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.506+0000 7f5a4e810800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.39 to cache LRU end 2024-09-12T17:36:27.507 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.506+0000 7f5a4e810800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:36:27.508 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.506+0000 7f5a4e810800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.39, ofs0, ns] 2024-09-12T17:36:27.508 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.507+0000 7f592cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497015 cookie 94137799857632 notifier 7977 bl.length()=983 2024-09-12T17:36:27.508 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.507+0000 7f592cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.39 info.flags=0x17 2024-09-12T17:36:27.508 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.507+0000 7f592cff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.39 to cache LRU end 2024-09-12T17:36:27.508 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.507+0000 7f592cff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:36:27.509 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.508+0000 7f5a4e810800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.39]): orig_sources= new_sources= 2024-09-12T17:36:27.509 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.508+0000 7f5a4e810800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.39]): potential sources added=[] removed=[] 2024-09-12T17:36:27.509 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.508+0000 7f5a4e810800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.39]): orig_dests= new_dests= 2024-09-12T17:36:27.509 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.508+0000 7f5a4e810800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.39]): potential dests added=[] removed=[] 2024-09-12T17:36:27.512 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.511+0000 7f5a4e810800 1 execute INFO: reshard of bucket "error-at-change-reshard-state" from 11 shards to 12 shards completed successfully 2024-09-12T17:36:27.514 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.513+0000 7f58fb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:36:27.516 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.516+0000 7f5a4e810800 20 remove_watcher() i=0 2024-09-12T17:36:27.517 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.516+0000 7f5a4e810800 2 removed watcher, disabling cache 2024-09-12T17:36:27.517 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.517+0000 7f5a4e810800 20 remove_watcher() i=1 2024-09-12T17:36:27.519 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.518+0000 7f5a4e810800 20 remove_watcher() i=2 2024-09-12T17:36:27.520 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.519+0000 7f5a4e810800 20 remove_watcher() i=3 2024-09-12T17:36:27.521 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.521+0000 7f5a4e810800 20 remove_watcher() i=4 2024-09-12T17:36:27.523 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.522+0000 7f5a4e810800 20 remove_watcher() i=5 2024-09-12T17:36:27.523 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.523+0000 7f5a4e810800 20 remove_watcher() i=6 2024-09-12T17:36:27.525 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.524+0000 7f5a4e810800 20 remove_watcher() i=7 2024-09-12T17:36:27.538 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-12T17:36:27.569 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:36:27.569 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:36:27.609 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.608+0000 7fe8ad528800 20 rados->read ofs=0 len=0 2024-09-12T17:36:27.611 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.610+0000 7fe8ad528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:27.611 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.610+0000 7fe8ad528800 20 realm 2024-09-12T17:36:27.611 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.610+0000 7fe8ad528800 20 rados->read ofs=0 len=0 2024-09-12T17:36:27.611 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.610+0000 7fe8ad528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:27.611 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.610+0000 7fe8ad528800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:36:27.611 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.610+0000 7fe8ad528800 20 rados->read ofs=0 len=0 2024-09-12T17:36:27.611 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.610+0000 7fe8ad528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:27.611 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.610+0000 7fe8ad528800 20 rados->read ofs=0 len=0 2024-09-12T17:36:27.612 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.611+0000 7fe8ad528800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:36:27.612 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.611+0000 7fe8ad528800 20 rados->read ofs=0 len=0 2024-09-12T17:36:27.612 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.611+0000 7fe8ad528800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:36:27.612 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.611+0000 7fe8ad528800 20 searching for the correct realm 2024-09-12T17:36:27.616 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.615+0000 7fe8a9a4c640 0 -- 172.21.15.37:0/411221145 >> [v2:172.21.15.37:6824/3990661154,v1:172.21.15.37:6825/3990661154] conn(0x55fc9e824f50 msgr2=0x55fc9e827340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:36:27.620 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.619+0000 7fe8a8a4a640 0 -- 172.21.15.37:0/411221145 >> [v2:172.21.15.40:6800/2441293461,v1:172.21.15.40:6801/2441293461] conn(0x7fe89c03c040 msgr2=0x7fe89c02e920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:36:27.624 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.623+0000 7fe8ad528800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:36:27.624 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.623+0000 7fe8ad528800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:36:27.624 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.623+0000 7fe8ad528800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:36:27.624 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.623+0000 7fe8ad528800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:36:27.624 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.623+0000 7fe8ad528800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:36:27.624 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.623+0000 7fe8ad528800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:36:27.624 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.623+0000 7fe8ad528800 20 rados->read ofs=0 len=0 2024-09-12T17:36:27.624 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.623+0000 7fe8ad528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:27.624 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.623+0000 7fe8ad528800 20 rados->read ofs=0 len=0 2024-09-12T17:36:27.625 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.623+0000 7fe8ad528800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:36:27.625 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.623+0000 7fe8ad528800 20 rados->read ofs=0 len=0 2024-09-12T17:36:27.626 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.624+0000 7fe8ad528800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:36:27.626 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.624+0000 7fe8ad528800 20 zone default found 2024-09-12T17:36:27.626 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.624+0000 7fe8ad528800 4 Realm: () 2024-09-12T17:36:27.626 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.624+0000 7fe8ad528800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:36:27.626 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.624+0000 7fe8ad528800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:36:27.626 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.624+0000 7fe8ad528800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:36:27.626 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.624+0000 7fe8ad528800 20 zonegroup default 2024-09-12T17:36:27.626 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.624+0000 7fe8ad528800 20 rados->read ofs=0 len=0 2024-09-12T17:36:27.626 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.624+0000 7fe8ad528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:27.626 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.624+0000 7fe8ad528800 20 rados->read ofs=0 len=0 2024-09-12T17:36:27.626 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.624+0000 7fe8ad528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:27.626 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.624+0000 7fe8ad528800 20 rados->read ofs=0 len=0 2024-09-12T17:36:27.626 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.624+0000 7fe8ad528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:27.626 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.625+0000 7fe8ad528800 20 started sync module instance, tier type = 2024-09-12T17:36:27.627 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.625+0000 7fe8ad528800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:36:27.635 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.634+0000 7fe8ad528800 20 add_watcher() i=0 2024-09-12T17:36:27.635 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.634+0000 7fe8ad528800 20 add_watcher() i=1 2024-09-12T17:36:27.635 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.634+0000 7fe8ad528800 20 add_watcher() i=2 2024-09-12T17:36:27.635 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.634+0000 7fe8ad528800 20 add_watcher() i=3 2024-09-12T17:36:27.635 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.634+0000 7fe8ad528800 20 add_watcher() i=4 2024-09-12T17:36:27.635 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.634+0000 7fe8ad528800 20 add_watcher() i=5 2024-09-12T17:36:27.635 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.634+0000 7fe8ad528800 20 add_watcher() i=6 2024-09-12T17:36:27.635 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.635+0000 7fe8ad528800 20 add_watcher() i=7 2024-09-12T17:36:27.636 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.635+0000 7fe8ad528800 2 all 8 watchers are set, enabling cache 2024-09-12T17:36:27.637 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.636+0000 7fe75ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:36:27.640 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.637+0000 7fe8ad528800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:36:27.640 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.637+0000 7fe8ad528800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:36:27.640 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.637+0000 7fe8ad528800 5 note: GC not initialized 2024-09-12T17:36:27.640 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.637+0000 7fe75efe5640 20 reqs_thread_entry: start 2024-09-12T17:36:27.640 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.637+0000 7fe8ad528800 20 init_complete bucket index max shards: 11 2024-09-12T17:36:27.640 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.637+0000 7fe8ad528800 20 Filter name: none 2024-09-12T17:36:27.640 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.637+0000 7fe75cfe1640 20 reqs_thread_entry: start 2024-09-12T17:36:27.640 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.637+0000 7fe8ad528800 20 rados->read ofs=0 len=0 2024-09-12T17:36:27.641 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.638+0000 7fe8ad528800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:36:27.641 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.638+0000 7fe8ad528800 20 rados->read ofs=0 len=0 2024-09-12T17:36:27.642 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.639+0000 7fe8ad528800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:36:27.642 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.639+0000 7fe8ad528800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:36:27.642 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.639+0000 7fe8ad528800 20 rados->read ofs=0 len=0 2024-09-12T17:36:27.642 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.639+0000 7fe8ad528800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:36:27.642 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.639+0000 7fe8ad528800 20 rados->read ofs=0 len=0 2024-09-12T17:36:27.642 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.639+0000 7fe8ad528800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:36:27.642 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.639+0000 7fe8ad528800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:36:27.642 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.641+0000 7fe75ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:36:27.644 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.644+0000 7fe8ad528800 20 remove_watcher() i=0 2024-09-12T17:36:27.644 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.644+0000 7fe8ad528800 2 removed watcher, disabling cache 2024-09-12T17:36:27.645 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.645+0000 7fe8ad528800 20 remove_watcher() i=1 2024-09-12T17:36:27.647 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.646+0000 7fe8ad528800 20 remove_watcher() i=2 2024-09-12T17:36:27.647 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.647+0000 7fe8ad528800 20 remove_watcher() i=3 2024-09-12T17:36:27.649 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.648+0000 7fe8ad528800 20 remove_watcher() i=4 2024-09-12T17:36:27.650 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.649+0000 7fe8ad528800 20 remove_watcher() i=5 2024-09-12T17:36:27.651 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.650+0000 7fe8ad528800 20 remove_watcher() i=6 2024-09-12T17:36:27.652 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:27.651+0000 7fe8ad528800 20 remove_watcher() i=7 2024-09-12T17:36:27.663 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:36:27.663 INFO:tasks.workunit.client.0.smithi037.stderr:BUCKET_STATS: 2024-09-12T17:36:27.663 INFO:tasks.workunit.client.0.smithi037.stderr:bucket: error-at-change-reshard-state id: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.39 num_objects: 20 size_kb: 1 num_shards: 12 2024-09-12T17:36:27.663 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:36:28.023 INFO:tasks.workunit.client.0.smithi037.stderr:TEST: reshard bucket with abort at change_reshard_state 2024-09-12T17:36:28.023 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:36:28.819 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bucket stats --bucket abort-at-change-reshard-state 2024-09-12T17:36:28.848 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:36:28.848 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:36:28.887 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:28.886+0000 7f146d8b7800 20 rados->read ofs=0 len=0 2024-09-12T17:36:28.889 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:28.888+0000 7f146d8b7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:28.889 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:28.888+0000 7f146d8b7800 20 realm 2024-09-12T17:36:28.889 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:28.888+0000 7f146d8b7800 20 rados->read ofs=0 len=0 2024-09-12T17:36:28.890 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:28.888+0000 7f146d8b7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:28.890 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:28.888+0000 7f146d8b7800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:36:28.890 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:28.888+0000 7f146d8b7800 20 rados->read ofs=0 len=0 2024-09-12T17:36:28.890 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:28.889+0000 7f146d8b7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:28.890 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:28.889+0000 7f146d8b7800 20 rados->read ofs=0 len=0 2024-09-12T17:36:28.891 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:28.890+0000 7f146d8b7800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:36:28.891 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:28.890+0000 7f146d8b7800 20 rados->read ofs=0 len=0 2024-09-12T17:36:28.891 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:28.890+0000 7f146d8b7800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:36:28.891 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:28.890+0000 7f146d8b7800 20 searching for the correct realm 2024-09-12T17:36:28.893 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:28.893+0000 7f146aba0640 0 -- 172.21.15.37:0/3399267012 >> [v2:172.21.15.40:6800/2441293461,v1:172.21.15.40:6801/2441293461] conn(0x7f145c076c80 msgr2=0x7f145c089360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:36:28.897 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:28.897+0000 7f146b3a1640 0 -- 172.21.15.37:0/3399267012 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7f14600a42f0 msgr2=0x7f14600bc700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:36:29.108 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.105+0000 7f146d8b7800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:36:29.108 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.105+0000 7f146d8b7800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:36:29.109 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.105+0000 7f146d8b7800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:36:29.109 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.105+0000 7f146d8b7800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:36:29.109 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.105+0000 7f146d8b7800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:36:29.109 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.105+0000 7f146d8b7800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:36:29.110 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.105+0000 7f146d8b7800 20 rados->read ofs=0 len=0 2024-09-12T17:36:29.110 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.105+0000 7f146d8b7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:29.110 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.105+0000 7f146d8b7800 20 rados->read ofs=0 len=0 2024-09-12T17:36:29.111 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.105+0000 7f146d8b7800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:36:29.111 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.105+0000 7f146d8b7800 20 rados->read ofs=0 len=0 2024-09-12T17:36:29.111 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.106+0000 7f146d8b7800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:36:29.111 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.106+0000 7f146d8b7800 20 zone default found 2024-09-12T17:36:29.112 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.106+0000 7f146d8b7800 4 Realm: () 2024-09-12T17:36:29.112 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.106+0000 7f146d8b7800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:36:29.112 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.106+0000 7f146d8b7800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:36:29.112 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.106+0000 7f146d8b7800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:36:29.113 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.106+0000 7f146d8b7800 20 zonegroup default 2024-09-12T17:36:29.113 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.106+0000 7f146d8b7800 20 rados->read ofs=0 len=0 2024-09-12T17:36:29.113 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.106+0000 7f146d8b7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:29.113 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.106+0000 7f146d8b7800 20 rados->read ofs=0 len=0 2024-09-12T17:36:29.113 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.107+0000 7f146d8b7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:29.114 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.107+0000 7f146d8b7800 20 rados->read ofs=0 len=0 2024-09-12T17:36:29.114 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.107+0000 7f146d8b7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:29.114 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.107+0000 7f146d8b7800 20 started sync module instance, tier type = 2024-09-12T17:36:29.114 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.107+0000 7f146d8b7800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:36:29.119 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.118+0000 7f146d8b7800 20 add_watcher() i=0 2024-09-12T17:36:29.119 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.118+0000 7f146d8b7800 20 add_watcher() i=1 2024-09-12T17:36:29.119 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.118+0000 7f146d8b7800 20 add_watcher() i=2 2024-09-12T17:36:29.119 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.118+0000 7f146d8b7800 20 add_watcher() i=3 2024-09-12T17:36:29.120 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.118+0000 7f146d8b7800 20 add_watcher() i=4 2024-09-12T17:36:29.120 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.118+0000 7f146d8b7800 20 add_watcher() i=5 2024-09-12T17:36:29.120 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.118+0000 7f146d8b7800 20 add_watcher() i=6 2024-09-12T17:36:29.125 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.119+0000 7f146d8b7800 20 add_watcher() i=7 2024-09-12T17:36:29.125 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.119+0000 7f146d8b7800 2 all 8 watchers are set, enabling cache 2024-09-12T17:36:29.125 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.120+0000 7f1321fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:36:29.125 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.121+0000 7f146d8b7800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:36:29.125 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.121+0000 7f146d8b7800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:36:29.126 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.121+0000 7f146d8b7800 5 note: GC not initialized 2024-09-12T17:36:29.126 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.121+0000 7f1320fe1640 20 reqs_thread_entry: start 2024-09-12T17:36:29.126 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.121+0000 7f146d8b7800 20 init_complete bucket index max shards: 11 2024-09-12T17:36:29.126 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.121+0000 7f146d8b7800 20 Filter name: none 2024-09-12T17:36:29.126 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.121+0000 7f129a7fc640 20 reqs_thread_entry: start 2024-09-12T17:36:29.126 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.121+0000 7f146d8b7800 20 rados->read ofs=0 len=0 2024-09-12T17:36:29.127 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.122+0000 7f146d8b7800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:36:29.127 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.122+0000 7f146d8b7800 20 rados->read ofs=0 len=0 2024-09-12T17:36:29.127 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.123+0000 7f146d8b7800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:36:29.127 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.123+0000 7f146d8b7800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:36:29.127 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.123+0000 7f146d8b7800 20 rados->read ofs=0 len=0 2024-09-12T17:36:29.127 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.123+0000 7f146d8b7800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:36:29.127 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.123+0000 7f146d8b7800 20 rados->read ofs=0 len=0 2024-09-12T17:36:29.128 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.124+0000 7f146d8b7800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:36:29.128 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.124+0000 7f146d8b7800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:36:29.129 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.125+0000 7f1321fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:36:29.129 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.128+0000 7f146d8b7800 20 remove_watcher() i=0 2024-09-12T17:36:29.129 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.128+0000 7f146d8b7800 2 removed watcher, disabling cache 2024-09-12T17:36:29.130 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.129+0000 7f146d8b7800 20 remove_watcher() i=1 2024-09-12T17:36:29.131 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.130+0000 7f146d8b7800 20 remove_watcher() i=2 2024-09-12T17:36:29.132 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.131+0000 7f146d8b7800 20 remove_watcher() i=3 2024-09-12T17:36:29.133 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.132+0000 7f146d8b7800 20 remove_watcher() i=4 2024-09-12T17:36:29.134 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.133+0000 7f146d8b7800 20 remove_watcher() i=5 2024-09-12T17:36:29.135 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.134+0000 7f146d8b7800 20 remove_watcher() i=6 2024-09-12T17:36:29.136 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.135+0000 7f146d8b7800 20 remove_watcher() i=7 2024-09-12T17:36:29.147 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:36:29.147 INFO:tasks.workunit.client.0.smithi037.stderr:BUCKET_STATS: 2024-09-12T17:36:29.148 INFO:tasks.workunit.client.0.smithi037.stderr:bucket: abort-at-change-reshard-state id: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:36:29.148 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:36:29.149 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bucket reshard --bucket abort-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at change_reshard_state 2024-09-12T17:36:29.184 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:36:29.184 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:36:29.223 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.222+0000 7fe597832800 20 rados->read ofs=0 len=0 2024-09-12T17:36:29.225 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.224+0000 7fe597832800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:29.225 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.224+0000 7fe597832800 20 realm 2024-09-12T17:36:29.225 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.224+0000 7fe597832800 20 rados->read ofs=0 len=0 2024-09-12T17:36:29.225 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.224+0000 7fe597832800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:29.225 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.224+0000 7fe597832800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:36:29.226 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.224+0000 7fe597832800 20 rados->read ofs=0 len=0 2024-09-12T17:36:29.226 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.224+0000 7fe597832800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:29.226 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.224+0000 7fe597832800 20 rados->read ofs=0 len=0 2024-09-12T17:36:29.226 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.225+0000 7fe597832800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:36:29.226 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.225+0000 7fe597832800 20 rados->read ofs=0 len=0 2024-09-12T17:36:29.227 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.226+0000 7fe597832800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:36:29.227 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.226+0000 7fe597832800 20 searching for the correct realm 2024-09-12T17:36:29.229 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.229+0000 7fe58a352640 0 -- 172.21.15.37:0/1147036893 >> [v2:172.21.15.40:6800/2441293461,v1:172.21.15.40:6801/2441293461] conn(0x7fe584080040 msgr2=0x7fe58408f940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:36:29.233 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.233+0000 7fe592b53640 0 -- 172.21.15.37:0/1147036893 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7fe57c01abb0 msgr2=0x7fe57c07c970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:36:29.442 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.440+0000 7fe597832800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:36:29.442 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.440+0000 7fe597832800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:36:29.442 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.440+0000 7fe597832800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:36:29.442 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.440+0000 7fe597832800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:36:29.442 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.440+0000 7fe597832800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:36:29.442 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.440+0000 7fe597832800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:36:29.442 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.440+0000 7fe597832800 20 rados->read ofs=0 len=0 2024-09-12T17:36:29.442 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.441+0000 7fe597832800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:29.442 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.441+0000 7fe597832800 20 rados->read ofs=0 len=0 2024-09-12T17:36:29.443 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.441+0000 7fe597832800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:36:29.443 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.441+0000 7fe597832800 20 rados->read ofs=0 len=0 2024-09-12T17:36:29.444 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.442+0000 7fe597832800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:36:29.444 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.442+0000 7fe597832800 20 zone default found 2024-09-12T17:36:29.444 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.442+0000 7fe597832800 4 Realm: () 2024-09-12T17:36:29.444 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.442+0000 7fe597832800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:36:29.444 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.442+0000 7fe597832800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:36:29.444 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.442+0000 7fe597832800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:36:29.444 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.442+0000 7fe597832800 20 zonegroup default 2024-09-12T17:36:29.444 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.442+0000 7fe597832800 20 rados->read ofs=0 len=0 2024-09-12T17:36:29.444 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.442+0000 7fe597832800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:29.444 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.442+0000 7fe597832800 20 rados->read ofs=0 len=0 2024-09-12T17:36:29.444 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.442+0000 7fe597832800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:29.445 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.442+0000 7fe597832800 20 rados->read ofs=0 len=0 2024-09-12T17:36:29.445 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.443+0000 7fe597832800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:29.445 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.443+0000 7fe597832800 20 started sync module instance, tier type = 2024-09-12T17:36:29.445 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.443+0000 7fe597832800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:36:29.454 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.453+0000 7fe597832800 20 add_watcher() i=0 2024-09-12T17:36:29.454 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.453+0000 7fe597832800 20 add_watcher() i=1 2024-09-12T17:36:29.454 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.453+0000 7fe597832800 20 add_watcher() i=2 2024-09-12T17:36:29.454 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.453+0000 7fe597832800 20 add_watcher() i=3 2024-09-12T17:36:29.454 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.453+0000 7fe597832800 20 add_watcher() i=4 2024-09-12T17:36:29.454 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.453+0000 7fe597832800 20 add_watcher() i=5 2024-09-12T17:36:29.454 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.453+0000 7fe597832800 20 add_watcher() i=6 2024-09-12T17:36:29.455 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.454+0000 7fe597832800 20 add_watcher() i=7 2024-09-12T17:36:29.455 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.454+0000 7fe597832800 2 all 8 watchers are set, enabling cache 2024-09-12T17:36:29.457 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.456+0000 7fe4497e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:36:29.457 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.456+0000 7fe597832800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:36:29.457 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.456+0000 7fe597832800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:36:29.457 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.456+0000 7fe597832800 5 note: GC not initialized 2024-09-12T17:36:29.458 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.456+0000 7fe3c3fff640 20 reqs_thread_entry: start 2024-09-12T17:36:29.459 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.457+0000 7fe597832800 20 init_complete bucket index max shards: 11 2024-09-12T17:36:29.459 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.457+0000 7fe597832800 20 Filter name: none 2024-09-12T17:36:29.459 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.457+0000 7fe3c1ffb640 20 reqs_thread_entry: start 2024-09-12T17:36:29.459 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.457+0000 7fe597832800 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-12T17:36:29.459 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.457+0000 7fe597832800 20 rados->read ofs=0 len=0 2024-09-12T17:36:29.459 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.457+0000 7fe597832800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:36:29.459 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.457+0000 7fe597832800 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-12T17:36:29.459 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.457+0000 7fe597832800 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-12T17:36:29.459 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.457+0000 7fe597832800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40 : miss 2024-09-12T17:36:29.459 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.457+0000 7fe597832800 20 rados->read ofs=0 len=0 2024-09-12T17:36:29.459 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.458+0000 7fe597832800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:36:29.459 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.458+0000 7fe597832800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40 info.flags=0x17 2024-09-12T17:36:29.460 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.458+0000 7fe597832800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40 to cache LRU end 2024-09-12T17:36:29.460 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.458+0000 7fe597832800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:36:29.460 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.458+0000 7fe597832800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:36:29.460 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.458+0000 7fe597832800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40 2024-09-12T17:36:29.464 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.463+0000 7fe597832800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40 info.flags=0x17 2024-09-12T17:36:29.464 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.463+0000 7fe597832800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40 to cache LRU end 2024-09-12T17:36:29.464 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.463+0000 7fe597832800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:36:29.464 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.463+0000 7fe597832800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40, ofs0, ns] 2024-09-12T17:36:29.465 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.464+0000 7fe475ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497008 cookie 93935619823760 notifier 7496 bl.length()=1015 2024-09-12T17:36:29.465 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.464+0000 7fe475ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40 info.flags=0x17 2024-09-12T17:36:29.465 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.464+0000 7fe475ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40 to cache LRU end 2024-09-12T17:36:29.465 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.464+0000 7fe475ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:36:29.466 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.465+0000 7fe597832800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40]): orig_sources= new_sources= 2024-09-12T17:36:29.466 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.465+0000 7fe597832800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40]): potential sources added=[] removed=[] 2024-09-12T17:36:29.466 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.465+0000 7fe597832800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40]): orig_dests= new_dests= 2024-09-12T17:36:29.466 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.465+0000 7fe597832800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40]): potential dests added=[] removed=[] 2024-09-12T17:36:29.471 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.471+0000 7fe597832800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40.1.0 2024-09-12T17:36:29.472 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.471+0000 7fe597832800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40.1.0 2024-09-12T17:36:29.472 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.471+0000 7fe597832800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40.1.1 2024-09-12T17:36:29.472 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.471+0000 7fe597832800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40.1.1 2024-09-12T17:36:29.472 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.471+0000 7fe597832800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40.1.2 2024-09-12T17:36:29.472 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.471+0000 7fe597832800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40.1.2 2024-09-12T17:36:29.472 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.471+0000 7fe597832800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40.1.3 2024-09-12T17:36:29.472 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.471+0000 7fe597832800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40.1.3 2024-09-12T17:36:29.472 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.471+0000 7fe597832800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40.1.4 2024-09-12T17:36:29.472 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.471+0000 7fe597832800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40.1.4 2024-09-12T17:36:29.472 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.471+0000 7fe597832800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40.1.5 2024-09-12T17:36:29.472 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.471+0000 7fe597832800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40.1.5 2024-09-12T17:36:29.473 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.471+0000 7fe597832800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40.1.6 2024-09-12T17:36:29.473 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.471+0000 7fe597832800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40.1.6 2024-09-12T17:36:29.473 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.471+0000 7fe597832800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40.1.7 2024-09-12T17:36:29.473 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.471+0000 7fe597832800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40.1.7 2024-09-12T17:36:29.473 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.471+0000 7fe597832800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40.1.8 2024-09-12T17:36:29.473 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.471+0000 7fe597832800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40.1.8 2024-09-12T17:36:29.473 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.471+0000 7fe597832800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40.1.9 2024-09-12T17:36:29.473 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.471+0000 7fe597832800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40.1.9 2024-09-12T17:36:29.473 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.471+0000 7fe597832800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40.1.10 2024-09-12T17:36:29.473 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.471+0000 7fe597832800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40.1.10 2024-09-12T17:36:29.473 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.471+0000 7fe597832800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40.1.11 2024-09-12T17:36:29.473 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.471+0000 7fe597832800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40.1.11 2024-09-12T17:36:29.473 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.471+0000 7fe597832800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40.0 2024-09-12T17:36:29.477 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.471+0000 7fe597832800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40.1 2024-09-12T17:36:29.477 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.472+0000 7fe597832800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40.2 2024-09-12T17:36:29.477 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.472+0000 7fe597832800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40.3 2024-09-12T17:36:29.477 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.473+0000 7fe597832800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40.4 2024-09-12T17:36:29.477 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.474+0000 7fe597832800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40.5 2024-09-12T17:36:29.477 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.474+0000 7fe597832800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40.6 2024-09-12T17:36:29.477 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.475+0000 7fe597832800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40.7 2024-09-12T17:36:29.477 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.475+0000 7fe597832800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40.8 2024-09-12T17:36:29.477 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.476+0000 7fe597832800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40.9 2024-09-12T17:36:29.478 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.476+0000 7fe597832800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40.10 2024-09-12T17:36:29.480 INFO:tasks.workunit.client.0.smithi037.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fe597832800 time 2024-09-12T17:36:29.480591+0000 2024-09-12T17:36:29.480 INFO:tasks.workunit.client.0.smithi037.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:36:29.481 INFO:tasks.workunit.client.0.smithi037.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:36:29.481 INFO:tasks.workunit.client.0.smithi037.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fe59858c71a] 2024-09-12T17:36:29.481 INFO:tasks.workunit.client.0.smithi037.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fe59858c8d8] 2024-09-12T17:36:29.481 INFO:tasks.workunit.client.0.smithi037.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x556f16309841] 2024-09-12T17:36:29.481 INFO:tasks.workunit.client.0.smithi037.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x556f16318734] 2024-09-12T17:36:29.481 INFO:tasks.workunit.client.0.smithi037.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x556f163195d4] 2024-09-12T17:36:29.481 INFO:tasks.workunit.client.0.smithi037.stderr: 6: main() 2024-09-12T17:36:29.482 INFO:tasks.workunit.client.0.smithi037.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fe597229590] 2024-09-12T17:36:29.482 INFO:tasks.workunit.client.0.smithi037.stderr: 8: __libc_start_main() 2024-09-12T17:36:29.482 INFO:tasks.workunit.client.0.smithi037.stderr: 9: _start() 2024-09-12T17:36:29.482 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.480+0000 7fe597832800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fe597832800 time 2024-09-12T17:36:29.480591+0000 2024-09-12T17:36:29.482 INFO:tasks.workunit.client.0.smithi037.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:36:29.482 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:36:29.482 INFO:tasks.workunit.client.0.smithi037.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:36:29.482 INFO:tasks.workunit.client.0.smithi037.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fe59858c71a] 2024-09-12T17:36:29.482 INFO:tasks.workunit.client.0.smithi037.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fe59858c8d8] 2024-09-12T17:36:29.482 INFO:tasks.workunit.client.0.smithi037.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x556f16309841] 2024-09-12T17:36:29.482 INFO:tasks.workunit.client.0.smithi037.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x556f16318734] 2024-09-12T17:36:29.482 INFO:tasks.workunit.client.0.smithi037.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x556f163195d4] 2024-09-12T17:36:29.482 INFO:tasks.workunit.client.0.smithi037.stderr: 6: main() 2024-09-12T17:36:29.483 INFO:tasks.workunit.client.0.smithi037.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fe597229590] 2024-09-12T17:36:29.483 INFO:tasks.workunit.client.0.smithi037.stderr: 8: __libc_start_main() 2024-09-12T17:36:29.483 INFO:tasks.workunit.client.0.smithi037.stderr: 9: _start() 2024-09-12T17:36:29.483 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:36:29.483 INFO:tasks.workunit.client.0.smithi037.stderr:*** Caught signal (Aborted) ** 2024-09-12T17:36:29.483 INFO:tasks.workunit.client.0.smithi037.stderr: in thread 7fe597832800 thread_name:radosgw-admin 2024-09-12T17:36:29.500 INFO:tasks.workunit.client.0.smithi037.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:36:29.500 INFO:tasks.workunit.client.0.smithi037.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fe59723e6f0] 2024-09-12T17:36:29.501 INFO:tasks.workunit.client.0.smithi037.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fe59728b99c] 2024-09-12T17:36:29.501 INFO:tasks.workunit.client.0.smithi037.stderr: 3: raise() 2024-09-12T17:36:29.501 INFO:tasks.workunit.client.0.smithi037.stderr: 4: abort() 2024-09-12T17:36:29.501 INFO:tasks.workunit.client.0.smithi037.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fe59858c774] 2024-09-12T17:36:29.501 INFO:tasks.workunit.client.0.smithi037.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fe59858c8d8] 2024-09-12T17:36:29.501 INFO:tasks.workunit.client.0.smithi037.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x556f16309841] 2024-09-12T17:36:29.501 INFO:tasks.workunit.client.0.smithi037.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x556f16318734] 2024-09-12T17:36:29.501 INFO:tasks.workunit.client.0.smithi037.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x556f163195d4] 2024-09-12T17:36:29.501 INFO:tasks.workunit.client.0.smithi037.stderr: 10: main() 2024-09-12T17:36:29.501 INFO:tasks.workunit.client.0.smithi037.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fe597229590] 2024-09-12T17:36:29.501 INFO:tasks.workunit.client.0.smithi037.stderr: 12: __libc_start_main() 2024-09-12T17:36:29.501 INFO:tasks.workunit.client.0.smithi037.stderr: 13: _start() 2024-09-12T17:36:29.502 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.481+0000 7fe597832800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:36:29.502 INFO:tasks.workunit.client.0.smithi037.stderr: in thread 7fe597832800 thread_name:radosgw-admin 2024-09-12T17:36:29.502 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:36:29.502 INFO:tasks.workunit.client.0.smithi037.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:36:29.502 INFO:tasks.workunit.client.0.smithi037.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fe59723e6f0] 2024-09-12T17:36:29.502 INFO:tasks.workunit.client.0.smithi037.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fe59728b99c] 2024-09-12T17:36:29.502 INFO:tasks.workunit.client.0.smithi037.stderr: 3: raise() 2024-09-12T17:36:29.502 INFO:tasks.workunit.client.0.smithi037.stderr: 4: abort() 2024-09-12T17:36:29.502 INFO:tasks.workunit.client.0.smithi037.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fe59858c774] 2024-09-12T17:36:29.502 INFO:tasks.workunit.client.0.smithi037.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fe59858c8d8] 2024-09-12T17:36:29.502 INFO:tasks.workunit.client.0.smithi037.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x556f16309841] 2024-09-12T17:36:29.502 INFO:tasks.workunit.client.0.smithi037.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x556f16318734] 2024-09-12T17:36:29.502 INFO:tasks.workunit.client.0.smithi037.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x556f163195d4] 2024-09-12T17:36:29.503 INFO:tasks.workunit.client.0.smithi037.stderr: 10: main() 2024-09-12T17:36:29.503 INFO:tasks.workunit.client.0.smithi037.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fe597229590] 2024-09-12T17:36:29.503 INFO:tasks.workunit.client.0.smithi037.stderr: 12: __libc_start_main() 2024-09-12T17:36:29.503 INFO:tasks.workunit.client.0.smithi037.stderr: 13: _start() 2024-09-12T17:36:29.503 INFO:tasks.workunit.client.0.smithi037.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:36:29.503 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:36:29.503 INFO:tasks.workunit.client.0.smithi037.stderr:--- begin dump of recent events --- 2024-09-12T17:36:29.503 INFO:tasks.workunit.client.0.smithi037.stderr: -499> 2024-09-12T17:36:29.205+0000 7fe597832800 5 AuthRegistry(0x556f1730afc0) adding con mode: crc 2024-09-12T17:36:29.503 INFO:tasks.workunit.client.0.smithi037.stderr: -498> 2024-09-12T17:36:29.205+0000 7fe597832800 5 AuthRegistry(0x556f1730afc0) adding con mode: secure 2024-09-12T17:36:29.503 INFO:tasks.workunit.client.0.smithi037.stderr: -497> 2024-09-12T17:36:29.205+0000 7fe597832800 5 AuthRegistry(0x556f1730afc0) adding con mode: crc 2024-09-12T17:36:29.503 INFO:tasks.workunit.client.0.smithi037.stderr: -496> 2024-09-12T17:36:29.205+0000 7fe597832800 5 AuthRegistry(0x556f1730afc0) adding con mode: crc 2024-09-12T17:36:29.503 INFO:tasks.workunit.client.0.smithi037.stderr: -495> 2024-09-12T17:36:29.205+0000 7fe597832800 5 AuthRegistry(0x556f1730afc0) adding con mode: secure 2024-09-12T17:36:29.503 INFO:tasks.workunit.client.0.smithi037.stderr: -494> 2024-09-12T17:36:29.205+0000 7fe597832800 5 AuthRegistry(0x556f1730afc0) adding con mode: crc 2024-09-12T17:36:29.503 INFO:tasks.workunit.client.0.smithi037.stderr: -493> 2024-09-12T17:36:29.205+0000 7fe597832800 5 AuthRegistry(0x556f1730afc0) adding con mode: secure 2024-09-12T17:36:29.504 INFO:tasks.workunit.client.0.smithi037.stderr: -492> 2024-09-12T17:36:29.205+0000 7fe597832800 5 AuthRegistry(0x556f1730afc0) adding con mode: crc 2024-09-12T17:36:29.504 INFO:tasks.workunit.client.0.smithi037.stderr: -491> 2024-09-12T17:36:29.205+0000 7fe597832800 5 AuthRegistry(0x556f1730afc0) adding con mode: secure 2024-09-12T17:36:29.504 INFO:tasks.workunit.client.0.smithi037.stderr: -490> 2024-09-12T17:36:29.205+0000 7fe597832800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:36:29.504 INFO:tasks.workunit.client.0.smithi037.stderr: -489> 2024-09-12T17:36:29.206+0000 7fe597832800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:36:29.504 INFO:tasks.workunit.client.0.smithi037.stderr: -488> 2024-09-12T17:36:29.206+0000 7fe597832800 5 asok(0x556f170e8730) register_command rotate-key hook 0x556f1730b108 2024-09-12T17:36:29.504 INFO:tasks.workunit.client.0.smithi037.stderr: -487> 2024-09-12T17:36:29.206+0000 7fe597832800 10 monclient: _reopen_session rank -1 2024-09-12T17:36:29.504 INFO:tasks.workunit.client.0.smithi037.stderr: -486> 2024-09-12T17:36:29.206+0000 7fe597832800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T17:36:29.504 INFO:tasks.workunit.client.0.smithi037.stderr: -485> 2024-09-12T17:36:29.206+0000 7fe597832800 10 monclient(hunting): picked mon.noname-c con 0x556f171b8650 addr [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] 2024-09-12T17:36:29.504 INFO:tasks.workunit.client.0.smithi037.stderr: -484> 2024-09-12T17:36:29.206+0000 7fe597832800 10 monclient(hunting): picked mon.noname-a con 0x556f1724df90 addr [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] 2024-09-12T17:36:29.504 INFO:tasks.workunit.client.0.smithi037.stderr: -483> 2024-09-12T17:36:29.206+0000 7fe597832800 10 monclient(hunting): picked mon.noname-b con 0x556f17254460 addr [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] 2024-09-12T17:36:29.504 INFO:tasks.workunit.client.0.smithi037.stderr: -482> 2024-09-12T17:36:29.206+0000 7fe597832800 10 monclient(hunting): start opening mon connection 2024-09-12T17:36:29.505 INFO:tasks.workunit.client.0.smithi037.stderr: -481> 2024-09-12T17:36:29.206+0000 7fe597832800 10 monclient(hunting): start opening mon connection 2024-09-12T17:36:29.505 INFO:tasks.workunit.client.0.smithi037.stderr: -480> 2024-09-12T17:36:29.206+0000 7fe597832800 10 monclient(hunting): start opening mon connection 2024-09-12T17:36:29.505 INFO:tasks.workunit.client.0.smithi037.stderr: -479> 2024-09-12T17:36:29.206+0000 7fe597832800 10 monclient(hunting): _renew_subs 2024-09-12T17:36:29.505 INFO:tasks.workunit.client.0.smithi037.stderr: -478> 2024-09-12T17:36:29.206+0000 7fe597832800 10 monclient(hunting): authenticate will time out at 2376.803261s 2024-09-12T17:36:29.505 INFO:tasks.workunit.client.0.smithi037.stderr: -477> 2024-09-12T17:36:29.206+0000 7fe58a352640 10 monclient(hunting): get_auth_request con 0x556f1724df90 auth_method 0 2024-09-12T17:36:29.505 INFO:tasks.workunit.client.0.smithi037.stderr: -476> 2024-09-12T17:36:29.206+0000 7fe58a352640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:36:29.505 INFO:tasks.workunit.client.0.smithi037.stderr: -475> 2024-09-12T17:36:29.206+0000 7fe58a352640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:36:29.505 INFO:tasks.workunit.client.0.smithi037.stderr: -474> 2024-09-12T17:36:29.206+0000 7fe58a352640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:36:29.505 INFO:tasks.workunit.client.0.smithi037.stderr: -473> 2024-09-12T17:36:29.206+0000 7fe592b53640 10 monclient(hunting): get_auth_request con 0x556f171b8650 auth_method 0 2024-09-12T17:36:29.505 INFO:tasks.workunit.client.0.smithi037.stderr: -472> 2024-09-12T17:36:29.206+0000 7fe592b53640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:36:29.505 INFO:tasks.workunit.client.0.smithi037.stderr: -471> 2024-09-12T17:36:29.206+0000 7fe592b53640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:36:29.505 INFO:tasks.workunit.client.0.smithi037.stderr: -470> 2024-09-12T17:36:29.206+0000 7fe592b53640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:36:29.505 INFO:tasks.workunit.client.0.smithi037.stderr: -469> 2024-09-12T17:36:29.206+0000 7fe58a352640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:36:29.505 INFO:tasks.workunit.client.0.smithi037.stderr: -468> 2024-09-12T17:36:29.206+0000 7fe58a352640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:36:29.506 INFO:tasks.workunit.client.0.smithi037.stderr: -467> 2024-09-12T17:36:29.206+0000 7fe58a352640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:36:29.506 INFO:tasks.workunit.client.0.smithi037.stderr: -466> 2024-09-12T17:36:29.206+0000 7fe593354640 10 monclient(hunting): get_auth_request con 0x556f17254460 auth_method 0 2024-09-12T17:36:29.506 INFO:tasks.workunit.client.0.smithi037.stderr: -465> 2024-09-12T17:36:29.206+0000 7fe593354640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:36:29.506 INFO:tasks.workunit.client.0.smithi037.stderr: -464> 2024-09-12T17:36:29.206+0000 7fe593354640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:36:29.506 INFO:tasks.workunit.client.0.smithi037.stderr: -463> 2024-09-12T17:36:29.206+0000 7fe593354640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:36:29.506 INFO:tasks.workunit.client.0.smithi037.stderr: -462> 2024-09-12T17:36:29.206+0000 7fe592b53640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:36:29.506 INFO:tasks.workunit.client.0.smithi037.stderr: -461> 2024-09-12T17:36:29.206+0000 7fe592b53640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:36:29.506 INFO:tasks.workunit.client.0.smithi037.stderr: -460> 2024-09-12T17:36:29.206+0000 7fe592b53640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:36:29.506 INFO:tasks.workunit.client.0.smithi037.stderr: -459> 2024-09-12T17:36:29.206+0000 7fe593354640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:36:29.506 INFO:tasks.workunit.client.0.smithi037.stderr: -458> 2024-09-12T17:36:29.206+0000 7fe593354640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:36:29.507 INFO:tasks.workunit.client.0.smithi037.stderr: -457> 2024-09-12T17:36:29.206+0000 7fe593354640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:36:29.507 INFO:tasks.workunit.client.0.smithi037.stderr: -456> 2024-09-12T17:36:29.206+0000 7fe58a352640 10 monclient(hunting): handle_auth_done global_id 8025 payload 824 2024-09-12T17:36:29.507 INFO:tasks.workunit.client.0.smithi037.stderr: -455> 2024-09-12T17:36:29.206+0000 7fe58a352640 10 monclient: _finish_hunting 0 2024-09-12T17:36:29.507 INFO:tasks.workunit.client.0.smithi037.stderr: -454> 2024-09-12T17:36:29.206+0000 7fe58a352640 1 monclient: found mon.noname-a 2024-09-12T17:36:29.507 INFO:tasks.workunit.client.0.smithi037.stderr: -453> 2024-09-12T17:36:29.206+0000 7fe58a352640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.37:3300/0 2024-09-12T17:36:29.507 INFO:tasks.workunit.client.0.smithi037.stderr: -452> 2024-09-12T17:36:29.206+0000 7fe47f606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:36:29.507 INFO:tasks.workunit.client.0.smithi037.stderr: -451> 2024-09-12T17:36:29.206+0000 7fe47f606640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:36:29.507 INFO:tasks.workunit.client.0.smithi037.stderr: -450> 2024-09-12T17:36:29.206+0000 7fe47f606640 10 monclient: dump: 2024-09-12T17:36:29.507 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:36:29.507 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:36:29.507 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:36:29.507 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:36:29.507 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:36:29.508 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:36:29.508 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:36:29.508 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:36:29.508 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:36:29.508 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:36:29.508 INFO:tasks.workunit.client.0.smithi037.stderr: -449> 2024-09-12T17:36:29.206+0000 7fe47f606640 10 monclient: _finish_auth 0 2024-09-12T17:36:29.508 INFO:tasks.workunit.client.0.smithi037.stderr: -448> 2024-09-12T17:36:29.206+0000 7fe47f606640 10 monclient: _check_auth_tickets 2024-09-12T17:36:29.508 INFO:tasks.workunit.client.0.smithi037.stderr: -447> 2024-09-12T17:36:29.206+0000 7fe47f606640 10 monclient: handle_config config(0 keys) 2024-09-12T17:36:29.508 INFO:tasks.workunit.client.0.smithi037.stderr: -446> 2024-09-12T17:36:29.206+0000 7fe47f606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:36:29.508 INFO:tasks.workunit.client.0.smithi037.stderr: -445> 2024-09-12T17:36:29.206+0000 7fe47f606640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:36:29.509 INFO:tasks.workunit.client.0.smithi037.stderr: -444> 2024-09-12T17:36:29.206+0000 7fe47f606640 10 monclient: dump: 2024-09-12T17:36:29.509 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:36:29.509 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:36:29.509 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:36:29.509 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:36:29.509 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:36:29.509 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:36:29.509 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:36:29.509 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:36:29.509 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:36:29.510 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:36:29.510 INFO:tasks.workunit.client.0.smithi037.stderr: -443> 2024-09-12T17:36:29.206+0000 7fe597832800 5 monclient: authenticate success, global_id 8025 2024-09-12T17:36:29.510 INFO:tasks.workunit.client.0.smithi037.stderr: -442> 2024-09-12T17:36:29.206+0000 7fe597832800 10 monclient: _renew_subs 2024-09-12T17:36:29.510 INFO:tasks.workunit.client.0.smithi037.stderr: -441> 2024-09-12T17:36:29.206+0000 7fe597832800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.37:3300/0 2024-09-12T17:36:29.510 INFO:tasks.workunit.client.0.smithi037.stderr: -440> 2024-09-12T17:36:29.206+0000 7fe480e09640 4 set_mon_vals no callback set 2024-09-12T17:36:29.510 INFO:tasks.workunit.client.0.smithi037.stderr: -439> 2024-09-12T17:36:29.207+0000 7fe597832800 10 monclient: _renew_subs 2024-09-12T17:36:29.510 INFO:tasks.workunit.client.0.smithi037.stderr: -438> 2024-09-12T17:36:29.207+0000 7fe597832800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.37:3300/0 2024-09-12T17:36:29.510 INFO:tasks.workunit.client.0.smithi037.stderr: -437> 2024-09-12T17:36:29.207+0000 7fe597832800 1 librados: init done 2024-09-12T17:36:29.510 INFO:tasks.workunit.client.0.smithi037.stderr: -436> 2024-09-12T17:36:29.209+0000 7fe47f606640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:36:29.510 INFO:tasks.workunit.client.0.smithi037.stderr: -435> 2024-09-12T17:36:29.209+0000 7fe47f606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.40:6816/3916250676,v1:172.21.15.40:6817/3916250676] 2024-09-12T17:36:29.510 INFO:tasks.workunit.client.0.smithi037.stderr: -434> 2024-09-12T17:36:29.209+0000 7fe47f606640 4 mgrc reconnect Starting new session with [v2:172.21.15.40:6816/3916250676,v1:172.21.15.40:6817/3916250676] 2024-09-12T17:36:29.510 INFO:tasks.workunit.client.0.smithi037.stderr: -433> 2024-09-12T17:36:29.209+0000 7fe592b53640 10 monclient: get_auth_request con 0x7fe4780764a0 auth_method 0 2024-09-12T17:36:29.510 INFO:tasks.workunit.client.0.smithi037.stderr: -432> 2024-09-12T17:36:29.209+0000 7fe593354640 10 monclient: get_auth_request con 0x556f17333490 auth_method 0 2024-09-12T17:36:29.511 INFO:tasks.workunit.client.0.smithi037.stderr: -431> 2024-09-12T17:36:29.210+0000 7fe592b53640 10 monclient: get_auth_request con 0x556f17356480 auth_method 0 2024-09-12T17:36:29.511 INFO:tasks.workunit.client.0.smithi037.stderr: -430> 2024-09-12T17:36:29.212+0000 7fe58a352640 10 monclient: get_auth_request con 0x556f17359ce0 auth_method 0 2024-09-12T17:36:29.511 INFO:tasks.workunit.client.0.smithi037.stderr: -429> 2024-09-12T17:36:29.213+0000 7fe597832800 10 monclient: build_initial_monmap 2024-09-12T17:36:29.511 INFO:tasks.workunit.client.0.smithi037.stderr: -428> 2024-09-12T17:36:29.213+0000 7fe597832800 1 build_initial for_mkfs: 0 2024-09-12T17:36:29.511 INFO:tasks.workunit.client.0.smithi037.stderr: -427> 2024-09-12T17:36:29.213+0000 7fe597832800 10 monclient: monmap: 2024-09-12T17:36:29.511 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 0 2024-09-12T17:36:29.511 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:36:29.511 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 0.000000 2024-09-12T17:36:29.511 INFO:tasks.workunit.client.0.smithi037.stderr:created 0.000000 2024-09-12T17:36:29.511 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 0 (unknown) 2024-09-12T17:36:29.511 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:36:29.511 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.noname-a 2024-09-12T17:36:29.511 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.noname-b 2024-09-12T17:36:29.511 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.noname-c 2024-09-12T17:36:29.512 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:36:29.512 INFO:tasks.workunit.client.0.smithi037.stderr: -426> 2024-09-12T17:36:29.213+0000 7fe597832800 5 AuthRegistry(0x556f1735f5f0) adding auth protocol: cephx 2024-09-12T17:36:29.512 INFO:tasks.workunit.client.0.smithi037.stderr: -425> 2024-09-12T17:36:29.213+0000 7fe597832800 5 AuthRegistry(0x556f1735f5f0) adding auth protocol: cephx 2024-09-12T17:36:29.512 INFO:tasks.workunit.client.0.smithi037.stderr: -424> 2024-09-12T17:36:29.213+0000 7fe597832800 5 AuthRegistry(0x556f1735f5f0) adding auth protocol: cephx 2024-09-12T17:36:29.512 INFO:tasks.workunit.client.0.smithi037.stderr: -423> 2024-09-12T17:36:29.213+0000 7fe597832800 5 AuthRegistry(0x556f1735f5f0) adding con mode: secure 2024-09-12T17:36:29.512 INFO:tasks.workunit.client.0.smithi037.stderr: -422> 2024-09-12T17:36:29.213+0000 7fe597832800 5 AuthRegistry(0x556f1735f5f0) adding con mode: crc 2024-09-12T17:36:29.512 INFO:tasks.workunit.client.0.smithi037.stderr: -421> 2024-09-12T17:36:29.213+0000 7fe597832800 5 AuthRegistry(0x556f1735f5f0) adding con mode: secure 2024-09-12T17:36:29.512 INFO:tasks.workunit.client.0.smithi037.stderr: -420> 2024-09-12T17:36:29.213+0000 7fe597832800 5 AuthRegistry(0x556f1735f5f0) adding con mode: crc 2024-09-12T17:36:29.512 INFO:tasks.workunit.client.0.smithi037.stderr: -419> 2024-09-12T17:36:29.213+0000 7fe597832800 5 AuthRegistry(0x556f1735f5f0) adding con mode: secure 2024-09-12T17:36:29.512 INFO:tasks.workunit.client.0.smithi037.stderr: -418> 2024-09-12T17:36:29.213+0000 7fe597832800 5 AuthRegistry(0x556f1735f5f0) adding con mode: crc 2024-09-12T17:36:29.512 INFO:tasks.workunit.client.0.smithi037.stderr: -417> 2024-09-12T17:36:29.213+0000 7fe597832800 5 AuthRegistry(0x556f1735f5f0) adding con mode: crc 2024-09-12T17:36:29.512 INFO:tasks.workunit.client.0.smithi037.stderr: -416> 2024-09-12T17:36:29.213+0000 7fe597832800 5 AuthRegistry(0x556f1735f5f0) adding con mode: secure 2024-09-12T17:36:29.512 INFO:tasks.workunit.client.0.smithi037.stderr: -415> 2024-09-12T17:36:29.213+0000 7fe597832800 5 AuthRegistry(0x556f1735f5f0) adding con mode: crc 2024-09-12T17:36:29.513 INFO:tasks.workunit.client.0.smithi037.stderr: -414> 2024-09-12T17:36:29.213+0000 7fe597832800 5 AuthRegistry(0x556f1735f5f0) adding con mode: secure 2024-09-12T17:36:29.513 INFO:tasks.workunit.client.0.smithi037.stderr: -413> 2024-09-12T17:36:29.213+0000 7fe597832800 5 AuthRegistry(0x556f1735f5f0) adding con mode: crc 2024-09-12T17:36:29.513 INFO:tasks.workunit.client.0.smithi037.stderr: -412> 2024-09-12T17:36:29.213+0000 7fe597832800 5 AuthRegistry(0x556f1735f5f0) adding con mode: secure 2024-09-12T17:36:29.513 INFO:tasks.workunit.client.0.smithi037.stderr: -411> 2024-09-12T17:36:29.213+0000 7fe597832800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:36:29.513 INFO:tasks.workunit.client.0.smithi037.stderr: -410> 2024-09-12T17:36:29.213+0000 7fe597832800 5 asok(0x556f170e8730) register_command objecter_requests cmddesc objecter_requests hook 0x556f17362fa0 EEXIST 2024-09-12T17:36:29.513 INFO:tasks.workunit.client.0.smithi037.stderr: -409> 2024-09-12T17:36:29.213+0000 7fe597832800 10 monclient: init 2024-09-12T17:36:29.513 INFO:tasks.workunit.client.0.smithi037.stderr: -408> 2024-09-12T17:36:29.213+0000 7fe597832800 5 AuthRegistry(0x556f1735e5a8) adding auth protocol: cephx 2024-09-12T17:36:29.513 INFO:tasks.workunit.client.0.smithi037.stderr: -407> 2024-09-12T17:36:29.213+0000 7fe597832800 5 AuthRegistry(0x556f1735e5a8) adding auth protocol: cephx 2024-09-12T17:36:29.513 INFO:tasks.workunit.client.0.smithi037.stderr: -406> 2024-09-12T17:36:29.213+0000 7fe597832800 5 AuthRegistry(0x556f1735e5a8) adding auth protocol: cephx 2024-09-12T17:36:29.513 INFO:tasks.workunit.client.0.smithi037.stderr: -405> 2024-09-12T17:36:29.213+0000 7fe597832800 5 AuthRegistry(0x556f1735e5a8) adding con mode: secure 2024-09-12T17:36:29.513 INFO:tasks.workunit.client.0.smithi037.stderr: -404> 2024-09-12T17:36:29.213+0000 7fe597832800 5 AuthRegistry(0x556f1735e5a8) adding con mode: crc 2024-09-12T17:36:29.513 INFO:tasks.workunit.client.0.smithi037.stderr: -403> 2024-09-12T17:36:29.213+0000 7fe597832800 5 AuthRegistry(0x556f1735e5a8) adding con mode: secure 2024-09-12T17:36:29.513 INFO:tasks.workunit.client.0.smithi037.stderr: -402> 2024-09-12T17:36:29.213+0000 7fe597832800 5 AuthRegistry(0x556f1735e5a8) adding con mode: crc 2024-09-12T17:36:29.514 INFO:tasks.workunit.client.0.smithi037.stderr: -401> 2024-09-12T17:36:29.213+0000 7fe597832800 5 AuthRegistry(0x556f1735e5a8) adding con mode: secure 2024-09-12T17:36:29.514 INFO:tasks.workunit.client.0.smithi037.stderr: -400> 2024-09-12T17:36:29.213+0000 7fe597832800 5 AuthRegistry(0x556f1735e5a8) adding con mode: crc 2024-09-12T17:36:29.514 INFO:tasks.workunit.client.0.smithi037.stderr: -399> 2024-09-12T17:36:29.213+0000 7fe597832800 5 AuthRegistry(0x556f1735e5a8) adding con mode: crc 2024-09-12T17:36:29.514 INFO:tasks.workunit.client.0.smithi037.stderr: -398> 2024-09-12T17:36:29.213+0000 7fe597832800 5 AuthRegistry(0x556f1735e5a8) adding con mode: secure 2024-09-12T17:36:29.514 INFO:tasks.workunit.client.0.smithi037.stderr: -397> 2024-09-12T17:36:29.213+0000 7fe597832800 5 AuthRegistry(0x556f1735e5a8) adding con mode: crc 2024-09-12T17:36:29.514 INFO:tasks.workunit.client.0.smithi037.stderr: -396> 2024-09-12T17:36:29.213+0000 7fe597832800 5 AuthRegistry(0x556f1735e5a8) adding con mode: secure 2024-09-12T17:36:29.514 INFO:tasks.workunit.client.0.smithi037.stderr: -395> 2024-09-12T17:36:29.213+0000 7fe597832800 5 AuthRegistry(0x556f1735e5a8) adding con mode: crc 2024-09-12T17:36:29.514 INFO:tasks.workunit.client.0.smithi037.stderr: -394> 2024-09-12T17:36:29.213+0000 7fe597832800 5 AuthRegistry(0x556f1735e5a8) adding con mode: secure 2024-09-12T17:36:29.514 INFO:tasks.workunit.client.0.smithi037.stderr: -393> 2024-09-12T17:36:29.213+0000 7fe597832800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:36:29.514 INFO:tasks.workunit.client.0.smithi037.stderr: -392> 2024-09-12T17:36:29.214+0000 7fe597832800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:36:29.514 INFO:tasks.workunit.client.0.smithi037.stderr: -391> 2024-09-12T17:36:29.214+0000 7fe597832800 5 asok(0x556f170e8730) register_command rotate-key cmddesc rotate-key hook 0x556f1735e6f0 EEXIST 2024-09-12T17:36:29.514 INFO:tasks.workunit.client.0.smithi037.stderr: -390> 2024-09-12T17:36:29.214+0000 7fe597832800 10 monclient: _reopen_session rank -1 2024-09-12T17:36:29.514 INFO:tasks.workunit.client.0.smithi037.stderr: -389> 2024-09-12T17:36:29.214+0000 7fe597832800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T17:36:29.515 INFO:tasks.workunit.client.0.smithi037.stderr: -388> 2024-09-12T17:36:29.214+0000 7fe597832800 10 monclient(hunting): picked mon.noname-c con 0x556f17386c90 addr [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] 2024-09-12T17:36:29.515 INFO:tasks.workunit.client.0.smithi037.stderr: -387> 2024-09-12T17:36:29.214+0000 7fe597832800 10 monclient(hunting): picked mon.noname-b con 0x556f17388f60 addr [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] 2024-09-12T17:36:29.515 INFO:tasks.workunit.client.0.smithi037.stderr: -386> 2024-09-12T17:36:29.214+0000 7fe597832800 10 monclient(hunting): picked mon.noname-a con 0x556f17385460 addr [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] 2024-09-12T17:36:29.515 INFO:tasks.workunit.client.0.smithi037.stderr: -385> 2024-09-12T17:36:29.214+0000 7fe597832800 10 monclient(hunting): start opening mon connection 2024-09-12T17:36:29.515 INFO:tasks.workunit.client.0.smithi037.stderr: -384> 2024-09-12T17:36:29.214+0000 7fe597832800 10 monclient(hunting): start opening mon connection 2024-09-12T17:36:29.515 INFO:tasks.workunit.client.0.smithi037.stderr: -383> 2024-09-12T17:36:29.214+0000 7fe597832800 10 monclient(hunting): start opening mon connection 2024-09-12T17:36:29.515 INFO:tasks.workunit.client.0.smithi037.stderr: -382> 2024-09-12T17:36:29.214+0000 7fe597832800 10 monclient(hunting): _renew_subs 2024-09-12T17:36:29.515 INFO:tasks.workunit.client.0.smithi037.stderr: -381> 2024-09-12T17:36:29.214+0000 7fe597832800 10 monclient(hunting): authenticate will time out at 2376.811295s 2024-09-12T17:36:29.515 INFO:tasks.workunit.client.0.smithi037.stderr: -380> 2024-09-12T17:36:29.214+0000 7fe593354640 10 monclient(hunting): get_auth_request con 0x556f17385460 auth_method 0 2024-09-12T17:36:29.515 INFO:tasks.workunit.client.0.smithi037.stderr: -379> 2024-09-12T17:36:29.214+0000 7fe593354640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:36:29.515 INFO:tasks.workunit.client.0.smithi037.stderr: -378> 2024-09-12T17:36:29.214+0000 7fe593354640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:36:29.515 INFO:tasks.workunit.client.0.smithi037.stderr: -377> 2024-09-12T17:36:29.214+0000 7fe593354640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:36:29.515 INFO:tasks.workunit.client.0.smithi037.stderr: -376> 2024-09-12T17:36:29.214+0000 7fe592b53640 10 monclient(hunting): get_auth_request con 0x556f17386c90 auth_method 0 2024-09-12T17:36:29.516 INFO:tasks.workunit.client.0.smithi037.stderr: -375> 2024-09-12T17:36:29.214+0000 7fe592b53640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:36:29.516 INFO:tasks.workunit.client.0.smithi037.stderr: -374> 2024-09-12T17:36:29.214+0000 7fe592b53640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:36:29.516 INFO:tasks.workunit.client.0.smithi037.stderr: -373> 2024-09-12T17:36:29.214+0000 7fe592b53640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:36:29.516 INFO:tasks.workunit.client.0.smithi037.stderr: -372> 2024-09-12T17:36:29.214+0000 7fe58a352640 10 monclient(hunting): get_auth_request con 0x556f17388f60 auth_method 0 2024-09-12T17:36:29.516 INFO:tasks.workunit.client.0.smithi037.stderr: -371> 2024-09-12T17:36:29.214+0000 7fe58a352640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:36:29.516 INFO:tasks.workunit.client.0.smithi037.stderr: -370> 2024-09-12T17:36:29.214+0000 7fe58a352640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:36:29.516 INFO:tasks.workunit.client.0.smithi037.stderr: -369> 2024-09-12T17:36:29.214+0000 7fe58a352640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:36:29.516 INFO:tasks.workunit.client.0.smithi037.stderr: -368> 2024-09-12T17:36:29.214+0000 7fe593354640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:36:29.516 INFO:tasks.workunit.client.0.smithi037.stderr: -367> 2024-09-12T17:36:29.214+0000 7fe593354640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:36:29.516 INFO:tasks.workunit.client.0.smithi037.stderr: -366> 2024-09-12T17:36:29.214+0000 7fe593354640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:36:29.517 INFO:tasks.workunit.client.0.smithi037.stderr: -365> 2024-09-12T17:36:29.214+0000 7fe592b53640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:36:29.517 INFO:tasks.workunit.client.0.smithi037.stderr: -364> 2024-09-12T17:36:29.214+0000 7fe592b53640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:36:29.517 INFO:tasks.workunit.client.0.smithi037.stderr: -363> 2024-09-12T17:36:29.214+0000 7fe592b53640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:36:29.517 INFO:tasks.workunit.client.0.smithi037.stderr: -362> 2024-09-12T17:36:29.214+0000 7fe58a352640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:36:29.517 INFO:tasks.workunit.client.0.smithi037.stderr: -361> 2024-09-12T17:36:29.214+0000 7fe58a352640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:36:29.517 INFO:tasks.workunit.client.0.smithi037.stderr: -360> 2024-09-12T17:36:29.214+0000 7fe58a352640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:36:29.517 INFO:tasks.workunit.client.0.smithi037.stderr: -359> 2024-09-12T17:36:29.214+0000 7fe593354640 10 monclient(hunting): handle_auth_done global_id 8028 payload 824 2024-09-12T17:36:29.517 INFO:tasks.workunit.client.0.smithi037.stderr: -358> 2024-09-12T17:36:29.214+0000 7fe593354640 10 monclient: _finish_hunting 0 2024-09-12T17:36:29.517 INFO:tasks.workunit.client.0.smithi037.stderr: -357> 2024-09-12T17:36:29.214+0000 7fe593354640 1 monclient: found mon.noname-a 2024-09-12T17:36:29.517 INFO:tasks.workunit.client.0.smithi037.stderr: -356> 2024-09-12T17:36:29.214+0000 7fe593354640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.37:3300/0 2024-09-12T17:36:29.517 INFO:tasks.workunit.client.0.smithi037.stderr: -355> 2024-09-12T17:36:29.215+0000 7fe47ce01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:36:29.517 INFO:tasks.workunit.client.0.smithi037.stderr: -354> 2024-09-12T17:36:29.215+0000 7fe47ce01640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:36:29.518 INFO:tasks.workunit.client.0.smithi037.stderr: -353> 2024-09-12T17:36:29.215+0000 7fe47ce01640 10 monclient: dump: 2024-09-12T17:36:29.518 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:36:29.518 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:36:29.518 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:36:29.518 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:36:29.518 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:36:29.518 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:36:29.518 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:36:29.518 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:36:29.518 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:36:29.518 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:36:29.518 INFO:tasks.workunit.client.0.smithi037.stderr: -352> 2024-09-12T17:36:29.215+0000 7fe47ce01640 10 monclient: _finish_auth 0 2024-09-12T17:36:29.518 INFO:tasks.workunit.client.0.smithi037.stderr: -351> 2024-09-12T17:36:29.215+0000 7fe47ce01640 10 monclient: _check_auth_tickets 2024-09-12T17:36:29.519 INFO:tasks.workunit.client.0.smithi037.stderr: -350> 2024-09-12T17:36:29.215+0000 7fe47ce01640 10 monclient: handle_config config(0 keys) 2024-09-12T17:36:29.519 INFO:tasks.workunit.client.0.smithi037.stderr: -349> 2024-09-12T17:36:29.215+0000 7fe47ce01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:36:29.519 INFO:tasks.workunit.client.0.smithi037.stderr: -348> 2024-09-12T17:36:29.215+0000 7fe47ce01640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:36:29.519 INFO:tasks.workunit.client.0.smithi037.stderr: -347> 2024-09-12T17:36:29.215+0000 7fe47ce01640 10 monclient: dump: 2024-09-12T17:36:29.519 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:36:29.519 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:36:29.519 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:36:29.519 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:36:29.519 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:36:29.519 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:36:29.519 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:36:29.520 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:36:29.520 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:36:29.520 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:36:29.520 INFO:tasks.workunit.client.0.smithi037.stderr: -346> 2024-09-12T17:36:29.215+0000 7fe593b55640 4 set_mon_vals no callback set 2024-09-12T17:36:29.520 INFO:tasks.workunit.client.0.smithi037.stderr: -345> 2024-09-12T17:36:29.215+0000 7fe597832800 5 monclient: authenticate success, global_id 8028 2024-09-12T17:36:29.520 INFO:tasks.workunit.client.0.smithi037.stderr: -344> 2024-09-12T17:36:29.215+0000 7fe597832800 10 monclient: _renew_subs 2024-09-12T17:36:29.520 INFO:tasks.workunit.client.0.smithi037.stderr: -343> 2024-09-12T17:36:29.215+0000 7fe597832800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.37:3300/0 2024-09-12T17:36:29.520 INFO:tasks.workunit.client.0.smithi037.stderr: -342> 2024-09-12T17:36:29.215+0000 7fe597832800 10 monclient: _renew_subs 2024-09-12T17:36:29.520 INFO:tasks.workunit.client.0.smithi037.stderr: -341> 2024-09-12T17:36:29.215+0000 7fe597832800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.37:3300/0 2024-09-12T17:36:29.520 INFO:tasks.workunit.client.0.smithi037.stderr: -340> 2024-09-12T17:36:29.217+0000 7fe47ce01640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:36:29.520 INFO:tasks.workunit.client.0.smithi037.stderr: -339> 2024-09-12T17:36:29.217+0000 7fe47ce01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.40:6816/3916250676,v1:172.21.15.40:6817/3916250676] 2024-09-12T17:36:29.520 INFO:tasks.workunit.client.0.smithi037.stderr: -338> 2024-09-12T17:36:29.217+0000 7fe47ce01640 4 mgrc reconnect Starting new session with [v2:172.21.15.40:6816/3916250676,v1:172.21.15.40:6817/3916250676] 2024-09-12T17:36:29.521 INFO:tasks.workunit.client.0.smithi037.stderr: -337> 2024-09-12T17:36:29.217+0000 7fe592b53640 10 monclient: get_auth_request con 0x7fe46c07a790 auth_method 0 2024-09-12T17:36:29.521 INFO:tasks.workunit.client.0.smithi037.stderr: -336> 2024-09-12T17:36:29.217+0000 7fe597832800 10 monclient: get_monmap_and_config 2024-09-12T17:36:29.521 INFO:tasks.workunit.client.0.smithi037.stderr: -335> 2024-09-12T17:36:29.217+0000 7fe597832800 10 monclient: build_initial_monmap 2024-09-12T17:36:29.521 INFO:tasks.workunit.client.0.smithi037.stderr: -334> 2024-09-12T17:36:29.217+0000 7fe597832800 1 build_initial for_mkfs: 0 2024-09-12T17:36:29.521 INFO:tasks.workunit.client.0.smithi037.stderr: -333> 2024-09-12T17:36:29.217+0000 7fe597832800 10 monclient: monmap: 2024-09-12T17:36:29.521 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 0 2024-09-12T17:36:29.521 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:36:29.521 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 0.000000 2024-09-12T17:36:29.521 INFO:tasks.workunit.client.0.smithi037.stderr:created 0.000000 2024-09-12T17:36:29.521 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 0 (unknown) 2024-09-12T17:36:29.521 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:36:29.521 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.noname-a 2024-09-12T17:36:29.521 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.noname-b 2024-09-12T17:36:29.521 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.noname-c 2024-09-12T17:36:29.522 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:36:29.522 INFO:tasks.workunit.client.0.smithi037.stderr: -332> 2024-09-12T17:36:29.217+0000 7fe597832800 5 AuthRegistry(0x556f171b6a40) adding auth protocol: cephx 2024-09-12T17:36:29.522 INFO:tasks.workunit.client.0.smithi037.stderr: -331> 2024-09-12T17:36:29.217+0000 7fe597832800 5 AuthRegistry(0x556f171b6a40) adding auth protocol: cephx 2024-09-12T17:36:29.522 INFO:tasks.workunit.client.0.smithi037.stderr: -330> 2024-09-12T17:36:29.217+0000 7fe597832800 5 AuthRegistry(0x556f171b6a40) adding auth protocol: cephx 2024-09-12T17:36:29.522 INFO:tasks.workunit.client.0.smithi037.stderr: -329> 2024-09-12T17:36:29.217+0000 7fe597832800 5 AuthRegistry(0x556f171b6a40) adding con mode: secure 2024-09-12T17:36:29.522 INFO:tasks.workunit.client.0.smithi037.stderr: -328> 2024-09-12T17:36:29.217+0000 7fe597832800 5 AuthRegistry(0x556f171b6a40) adding con mode: crc 2024-09-12T17:36:29.522 INFO:tasks.workunit.client.0.smithi037.stderr: -327> 2024-09-12T17:36:29.217+0000 7fe597832800 5 AuthRegistry(0x556f171b6a40) adding con mode: secure 2024-09-12T17:36:29.522 INFO:tasks.workunit.client.0.smithi037.stderr: -326> 2024-09-12T17:36:29.217+0000 7fe597832800 5 AuthRegistry(0x556f171b6a40) adding con mode: crc 2024-09-12T17:36:29.522 INFO:tasks.workunit.client.0.smithi037.stderr: -325> 2024-09-12T17:36:29.217+0000 7fe597832800 5 AuthRegistry(0x556f171b6a40) adding con mode: secure 2024-09-12T17:36:29.522 INFO:tasks.workunit.client.0.smithi037.stderr: -324> 2024-09-12T17:36:29.217+0000 7fe597832800 5 AuthRegistry(0x556f171b6a40) adding con mode: crc 2024-09-12T17:36:29.522 INFO:tasks.workunit.client.0.smithi037.stderr: -323> 2024-09-12T17:36:29.217+0000 7fe597832800 5 AuthRegistry(0x556f171b6a40) adding con mode: crc 2024-09-12T17:36:29.522 INFO:tasks.workunit.client.0.smithi037.stderr: -322> 2024-09-12T17:36:29.217+0000 7fe597832800 5 AuthRegistry(0x556f171b6a40) adding con mode: secure 2024-09-12T17:36:29.522 INFO:tasks.workunit.client.0.smithi037.stderr: -321> 2024-09-12T17:36:29.217+0000 7fe597832800 5 AuthRegistry(0x556f171b6a40) adding con mode: crc 2024-09-12T17:36:29.523 INFO:tasks.workunit.client.0.smithi037.stderr: -320> 2024-09-12T17:36:29.217+0000 7fe597832800 5 AuthRegistry(0x556f171b6a40) adding con mode: secure 2024-09-12T17:36:29.523 INFO:tasks.workunit.client.0.smithi037.stderr: -319> 2024-09-12T17:36:29.217+0000 7fe597832800 5 AuthRegistry(0x556f171b6a40) adding con mode: crc 2024-09-12T17:36:29.523 INFO:tasks.workunit.client.0.smithi037.stderr: -318> 2024-09-12T17:36:29.217+0000 7fe597832800 5 AuthRegistry(0x556f171b6a40) adding con mode: secure 2024-09-12T17:36:29.523 INFO:tasks.workunit.client.0.smithi037.stderr: -317> 2024-09-12T17:36:29.217+0000 7fe597832800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:36:29.523 INFO:tasks.workunit.client.0.smithi037.stderr: -316> 2024-09-12T17:36:29.217+0000 7fe597832800 10 monclient: init 2024-09-12T17:36:29.523 INFO:tasks.workunit.client.0.smithi037.stderr: -315> 2024-09-12T17:36:29.217+0000 7fe597832800 5 AuthRegistry(0x7ffee1109100) adding auth protocol: cephx 2024-09-12T17:36:29.523 INFO:tasks.workunit.client.0.smithi037.stderr: -314> 2024-09-12T17:36:29.217+0000 7fe597832800 5 AuthRegistry(0x7ffee1109100) adding auth protocol: cephx 2024-09-12T17:36:29.523 INFO:tasks.workunit.client.0.smithi037.stderr: -313> 2024-09-12T17:36:29.217+0000 7fe597832800 5 AuthRegistry(0x7ffee1109100) adding auth protocol: cephx 2024-09-12T17:36:29.523 INFO:tasks.workunit.client.0.smithi037.stderr: -312> 2024-09-12T17:36:29.217+0000 7fe597832800 5 AuthRegistry(0x7ffee1109100) adding con mode: secure 2024-09-12T17:36:29.523 INFO:tasks.workunit.client.0.smithi037.stderr: -311> 2024-09-12T17:36:29.217+0000 7fe597832800 5 AuthRegistry(0x7ffee1109100) adding con mode: crc 2024-09-12T17:36:29.523 INFO:tasks.workunit.client.0.smithi037.stderr: -310> 2024-09-12T17:36:29.217+0000 7fe597832800 5 AuthRegistry(0x7ffee1109100) adding con mode: secure 2024-09-12T17:36:29.523 INFO:tasks.workunit.client.0.smithi037.stderr: -309> 2024-09-12T17:36:29.217+0000 7fe597832800 5 AuthRegistry(0x7ffee1109100) adding con mode: crc 2024-09-12T17:36:29.523 INFO:tasks.workunit.client.0.smithi037.stderr: -308> 2024-09-12T17:36:29.217+0000 7fe597832800 5 AuthRegistry(0x7ffee1109100) adding con mode: secure 2024-09-12T17:36:29.524 INFO:tasks.workunit.client.0.smithi037.stderr: -307> 2024-09-12T17:36:29.217+0000 7fe597832800 5 AuthRegistry(0x7ffee1109100) adding con mode: crc 2024-09-12T17:36:29.524 INFO:tasks.workunit.client.0.smithi037.stderr: -306> 2024-09-12T17:36:29.217+0000 7fe597832800 5 AuthRegistry(0x7ffee1109100) adding con mode: crc 2024-09-12T17:36:29.524 INFO:tasks.workunit.client.0.smithi037.stderr: -305> 2024-09-12T17:36:29.217+0000 7fe597832800 5 AuthRegistry(0x7ffee1109100) adding con mode: secure 2024-09-12T17:36:29.524 INFO:tasks.workunit.client.0.smithi037.stderr: -304> 2024-09-12T17:36:29.217+0000 7fe597832800 5 AuthRegistry(0x7ffee1109100) adding con mode: crc 2024-09-12T17:36:29.524 INFO:tasks.workunit.client.0.smithi037.stderr: -303> 2024-09-12T17:36:29.217+0000 7fe597832800 5 AuthRegistry(0x7ffee1109100) adding con mode: secure 2024-09-12T17:36:29.524 INFO:tasks.workunit.client.0.smithi037.stderr: -302> 2024-09-12T17:36:29.217+0000 7fe597832800 5 AuthRegistry(0x7ffee1109100) adding con mode: crc 2024-09-12T17:36:29.524 INFO:tasks.workunit.client.0.smithi037.stderr: -301> 2024-09-12T17:36:29.217+0000 7fe597832800 5 AuthRegistry(0x7ffee1109100) adding con mode: secure 2024-09-12T17:36:29.524 INFO:tasks.workunit.client.0.smithi037.stderr: -300> 2024-09-12T17:36:29.218+0000 7fe597832800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:36:29.524 INFO:tasks.workunit.client.0.smithi037.stderr: -299> 2024-09-12T17:36:29.218+0000 7fe597832800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:36:29.524 INFO:tasks.workunit.client.0.smithi037.stderr: -298> 2024-09-12T17:36:29.218+0000 7fe597832800 5 asok(0x556f170e8730) register_command rotate-key cmddesc rotate-key hook 0x7ffee1109248 EEXIST 2024-09-12T17:36:29.524 INFO:tasks.workunit.client.0.smithi037.stderr: -297> 2024-09-12T17:36:29.218+0000 7fe597832800 10 monclient: _reopen_session rank -1 2024-09-12T17:36:29.524 INFO:tasks.workunit.client.0.smithi037.stderr: -296> 2024-09-12T17:36:29.218+0000 7fe597832800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T17:36:29.524 INFO:tasks.workunit.client.0.smithi037.stderr: -295> 2024-09-12T17:36:29.218+0000 7fe597832800 10 monclient(hunting): picked mon.noname-c con 0x556f173a8b10 addr [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] 2024-09-12T17:36:29.525 INFO:tasks.workunit.client.0.smithi037.stderr: -294> 2024-09-12T17:36:29.218+0000 7fe597832800 10 monclient(hunting): picked mon.noname-a con 0x556f173d9310 addr [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] 2024-09-12T17:36:29.525 INFO:tasks.workunit.client.0.smithi037.stderr: -293> 2024-09-12T17:36:29.218+0000 7fe597832800 10 monclient(hunting): picked mon.noname-b con 0x556f173d4d10 addr [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] 2024-09-12T17:36:29.525 INFO:tasks.workunit.client.0.smithi037.stderr: -292> 2024-09-12T17:36:29.218+0000 7fe597832800 10 monclient(hunting): start opening mon connection 2024-09-12T17:36:29.525 INFO:tasks.workunit.client.0.smithi037.stderr: -291> 2024-09-12T17:36:29.218+0000 7fe597832800 10 monclient(hunting): start opening mon connection 2024-09-12T17:36:29.525 INFO:tasks.workunit.client.0.smithi037.stderr: -290> 2024-09-12T17:36:29.218+0000 7fe597832800 10 monclient(hunting): start opening mon connection 2024-09-12T17:36:29.525 INFO:tasks.workunit.client.0.smithi037.stderr: -289> 2024-09-12T17:36:29.218+0000 7fe597832800 10 monclient(hunting): _renew_subs 2024-09-12T17:36:29.525 INFO:tasks.workunit.client.0.smithi037.stderr: -288> 2024-09-12T17:36:29.218+0000 7fe597832800 10 monclient(hunting): authenticate will time out at 2376.815401s 2024-09-12T17:36:29.525 INFO:tasks.workunit.client.0.smithi037.stderr: -287> 2024-09-12T17:36:29.218+0000 7fe58a352640 10 monclient(hunting): get_auth_request con 0x556f173d9310 auth_method 0 2024-09-12T17:36:29.525 INFO:tasks.workunit.client.0.smithi037.stderr: -286> 2024-09-12T17:36:29.218+0000 7fe58a352640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:36:29.525 INFO:tasks.workunit.client.0.smithi037.stderr: -285> 2024-09-12T17:36:29.218+0000 7fe58a352640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:36:29.525 INFO:tasks.workunit.client.0.smithi037.stderr: -284> 2024-09-12T17:36:29.218+0000 7fe58a352640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:36:29.525 INFO:tasks.workunit.client.0.smithi037.stderr: -283> 2024-09-12T17:36:29.218+0000 7fe592b53640 10 monclient(hunting): get_auth_request con 0x556f173a8b10 auth_method 0 2024-09-12T17:36:29.525 INFO:tasks.workunit.client.0.smithi037.stderr: -282> 2024-09-12T17:36:29.218+0000 7fe592b53640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:36:29.525 INFO:tasks.workunit.client.0.smithi037.stderr: -281> 2024-09-12T17:36:29.218+0000 7fe592b53640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:36:29.526 INFO:tasks.workunit.client.0.smithi037.stderr: -280> 2024-09-12T17:36:29.218+0000 7fe592b53640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:36:29.526 INFO:tasks.workunit.client.0.smithi037.stderr: -279> 2024-09-12T17:36:29.218+0000 7fe58a352640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:36:29.526 INFO:tasks.workunit.client.0.smithi037.stderr: -278> 2024-09-12T17:36:29.218+0000 7fe58a352640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:36:29.526 INFO:tasks.workunit.client.0.smithi037.stderr: -277> 2024-09-12T17:36:29.218+0000 7fe58a352640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:36:29.526 INFO:tasks.workunit.client.0.smithi037.stderr: -276> 2024-09-12T17:36:29.218+0000 7fe592b53640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:36:29.526 INFO:tasks.workunit.client.0.smithi037.stderr: -275> 2024-09-12T17:36:29.218+0000 7fe592b53640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:36:29.526 INFO:tasks.workunit.client.0.smithi037.stderr: -274> 2024-09-12T17:36:29.218+0000 7fe592b53640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:36:29.526 INFO:tasks.workunit.client.0.smithi037.stderr: -273> 2024-09-12T17:36:29.218+0000 7fe593354640 10 monclient(hunting): get_auth_request con 0x556f173d4d10 auth_method 0 2024-09-12T17:36:29.526 INFO:tasks.workunit.client.0.smithi037.stderr: -272> 2024-09-12T17:36:29.218+0000 7fe593354640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:36:29.526 INFO:tasks.workunit.client.0.smithi037.stderr: -271> 2024-09-12T17:36:29.218+0000 7fe593354640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:36:29.526 INFO:tasks.workunit.client.0.smithi037.stderr: -270> 2024-09-12T17:36:29.218+0000 7fe593354640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:36:29.526 INFO:tasks.workunit.client.0.smithi037.stderr: -269> 2024-09-12T17:36:29.218+0000 7fe58a352640 10 monclient(hunting): handle_auth_done global_id 8031 payload 274 2024-09-12T17:36:29.527 INFO:tasks.workunit.client.0.smithi037.stderr: -268> 2024-09-12T17:36:29.218+0000 7fe58a352640 10 monclient: _finish_hunting 0 2024-09-12T17:36:29.527 INFO:tasks.workunit.client.0.smithi037.stderr: -267> 2024-09-12T17:36:29.218+0000 7fe58a352640 1 monclient: found mon.noname-a 2024-09-12T17:36:29.527 INFO:tasks.workunit.client.0.smithi037.stderr: -266> 2024-09-12T17:36:29.218+0000 7fe58a352640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.37:3300/0 2024-09-12T17:36:29.527 INFO:tasks.workunit.client.0.smithi037.stderr: -265> 2024-09-12T17:36:29.218+0000 7fe4767fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:36:29.527 INFO:tasks.workunit.client.0.smithi037.stderr: -264> 2024-09-12T17:36:29.218+0000 7fe4767fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:36:29.527 INFO:tasks.workunit.client.0.smithi037.stderr: -263> 2024-09-12T17:36:29.218+0000 7fe4767fc640 10 monclient: dump: 2024-09-12T17:36:29.527 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:36:29.527 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:36:29.527 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:36:29.527 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:36:29.527 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:36:29.528 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:36:29.528 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:36:29.528 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:36:29.528 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:36:29.528 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:36:29.528 INFO:tasks.workunit.client.0.smithi037.stderr: -262> 2024-09-12T17:36:29.218+0000 7fe4767fc640 10 monclient: _finish_auth 0 2024-09-12T17:36:29.528 INFO:tasks.workunit.client.0.smithi037.stderr: -261> 2024-09-12T17:36:29.218+0000 7fe4767fc640 10 monclient: _check_auth_tickets 2024-09-12T17:36:29.528 INFO:tasks.workunit.client.0.smithi037.stderr: -260> 2024-09-12T17:36:29.218+0000 7fe4767fc640 10 monclient: handle_config config(0 keys) 2024-09-12T17:36:29.528 INFO:tasks.workunit.client.0.smithi037.stderr: -259> 2024-09-12T17:36:29.218+0000 7fe597832800 5 monclient: authenticate success, global_id 8031 2024-09-12T17:36:29.529 INFO:tasks.workunit.client.0.smithi037.stderr: -258> 2024-09-12T17:36:29.218+0000 7fe597832800 10 monclient: get_monmap_and_config success 2024-09-12T17:36:29.529 INFO:tasks.workunit.client.0.smithi037.stderr: -257> 2024-09-12T17:36:29.218+0000 7fe597832800 4 set_mon_vals no callback set 2024-09-12T17:36:29.529 INFO:tasks.workunit.client.0.smithi037.stderr: -256> 2024-09-12T17:36:29.218+0000 7fe4767fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:36:29.529 INFO:tasks.workunit.client.0.smithi037.stderr: -255> 2024-09-12T17:36:29.218+0000 7fe4767fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:36:29.529 INFO:tasks.workunit.client.0.smithi037.stderr: -254> 2024-09-12T17:36:29.219+0000 7fe4767fc640 10 monclient: dump: 2024-09-12T17:36:29.529 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:36:29.529 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:36:29.529 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:36:29.529 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:36:29.529 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:36:29.529 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:36:29.529 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:36:29.530 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:36:29.530 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:36:29.530 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:36:29.530 INFO:tasks.workunit.client.0.smithi037.stderr: -253> 2024-09-12T17:36:29.219+0000 7fe597832800 10 monclient: shutdown 2024-09-12T17:36:29.530 INFO:tasks.workunit.client.0.smithi037.stderr: -252> 2024-09-12T17:36:29.219+0000 7fe597832800 10 monclient: build_initial_monmap 2024-09-12T17:36:29.530 INFO:tasks.workunit.client.0.smithi037.stderr: -251> 2024-09-12T17:36:29.219+0000 7fe597832800 1 build_initial for_mkfs: 0 2024-09-12T17:36:29.530 INFO:tasks.workunit.client.0.smithi037.stderr: -250> 2024-09-12T17:36:29.219+0000 7fe597832800 10 monclient: monmap: 2024-09-12T17:36:29.530 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 0 2024-09-12T17:36:29.530 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:36:29.530 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 0.000000 2024-09-12T17:36:29.530 INFO:tasks.workunit.client.0.smithi037.stderr:created 0.000000 2024-09-12T17:36:29.530 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 0 (unknown) 2024-09-12T17:36:29.531 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:36:29.531 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.noname-a 2024-09-12T17:36:29.531 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.noname-b 2024-09-12T17:36:29.531 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.noname-c 2024-09-12T17:36:29.531 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:36:29.531 INFO:tasks.workunit.client.0.smithi037.stderr: -249> 2024-09-12T17:36:29.219+0000 7fe597832800 5 AuthRegistry(0x556f173d5290) adding auth protocol: cephx 2024-09-12T17:36:29.531 INFO:tasks.workunit.client.0.smithi037.stderr: -248> 2024-09-12T17:36:29.219+0000 7fe597832800 5 AuthRegistry(0x556f173d5290) adding auth protocol: cephx 2024-09-12T17:36:29.531 INFO:tasks.workunit.client.0.smithi037.stderr: -247> 2024-09-12T17:36:29.219+0000 7fe597832800 5 AuthRegistry(0x556f173d5290) adding auth protocol: cephx 2024-09-12T17:36:29.531 INFO:tasks.workunit.client.0.smithi037.stderr: -246> 2024-09-12T17:36:29.219+0000 7fe597832800 5 AuthRegistry(0x556f173d5290) adding con mode: secure 2024-09-12T17:36:29.531 INFO:tasks.workunit.client.0.smithi037.stderr: -245> 2024-09-12T17:36:29.219+0000 7fe597832800 5 AuthRegistry(0x556f173d5290) adding con mode: crc 2024-09-12T17:36:29.532 INFO:tasks.workunit.client.0.smithi037.stderr: -244> 2024-09-12T17:36:29.219+0000 7fe597832800 5 AuthRegistry(0x556f173d5290) adding con mode: secure 2024-09-12T17:36:29.532 INFO:tasks.workunit.client.0.smithi037.stderr: -243> 2024-09-12T17:36:29.219+0000 7fe597832800 5 AuthRegistry(0x556f173d5290) adding con mode: crc 2024-09-12T17:36:29.532 INFO:tasks.workunit.client.0.smithi037.stderr: -242> 2024-09-12T17:36:29.219+0000 7fe597832800 5 AuthRegistry(0x556f173d5290) adding con mode: secure 2024-09-12T17:36:29.532 INFO:tasks.workunit.client.0.smithi037.stderr: -241> 2024-09-12T17:36:29.219+0000 7fe597832800 5 AuthRegistry(0x556f173d5290) adding con mode: crc 2024-09-12T17:36:29.532 INFO:tasks.workunit.client.0.smithi037.stderr: -240> 2024-09-12T17:36:29.219+0000 7fe597832800 5 AuthRegistry(0x556f173d5290) adding con mode: crc 2024-09-12T17:36:29.532 INFO:tasks.workunit.client.0.smithi037.stderr: -239> 2024-09-12T17:36:29.219+0000 7fe597832800 5 AuthRegistry(0x556f173d5290) adding con mode: secure 2024-09-12T17:36:29.532 INFO:tasks.workunit.client.0.smithi037.stderr: -238> 2024-09-12T17:36:29.219+0000 7fe597832800 5 AuthRegistry(0x556f173d5290) adding con mode: crc 2024-09-12T17:36:29.532 INFO:tasks.workunit.client.0.smithi037.stderr: -237> 2024-09-12T17:36:29.219+0000 7fe597832800 5 AuthRegistry(0x556f173d5290) adding con mode: secure 2024-09-12T17:36:29.532 INFO:tasks.workunit.client.0.smithi037.stderr: -236> 2024-09-12T17:36:29.219+0000 7fe597832800 5 AuthRegistry(0x556f173d5290) adding con mode: crc 2024-09-12T17:36:29.532 INFO:tasks.workunit.client.0.smithi037.stderr: -235> 2024-09-12T17:36:29.219+0000 7fe597832800 5 AuthRegistry(0x556f173d5290) adding con mode: secure 2024-09-12T17:36:29.532 INFO:tasks.workunit.client.0.smithi037.stderr: -234> 2024-09-12T17:36:29.219+0000 7fe597832800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:36:29.532 INFO:tasks.workunit.client.0.smithi037.stderr: -233> 2024-09-12T17:36:29.219+0000 7fe597832800 1 librados: starting msgr at 2024-09-12T17:36:29.532 INFO:tasks.workunit.client.0.smithi037.stderr: -232> 2024-09-12T17:36:29.219+0000 7fe597832800 1 librados: starting objecter 2024-09-12T17:36:29.533 INFO:tasks.workunit.client.0.smithi037.stderr: -231> 2024-09-12T17:36:29.219+0000 7fe597832800 5 asok(0x556f170e8730) register_command objecter_requests cmddesc objecter_requests hook 0x556f173ca460 EEXIST 2024-09-12T17:36:29.533 INFO:tasks.workunit.client.0.smithi037.stderr: -230> 2024-09-12T17:36:29.220+0000 7fe597832800 1 librados: setting wanted keys 2024-09-12T17:36:29.533 INFO:tasks.workunit.client.0.smithi037.stderr: -229> 2024-09-12T17:36:29.220+0000 7fe597832800 1 librados: calling monclient init 2024-09-12T17:36:29.533 INFO:tasks.workunit.client.0.smithi037.stderr: -228> 2024-09-12T17:36:29.220+0000 7fe597832800 10 monclient: init 2024-09-12T17:36:29.533 INFO:tasks.workunit.client.0.smithi037.stderr: -227> 2024-09-12T17:36:29.220+0000 7fe597832800 5 AuthRegistry(0x556f1739ea40) adding auth protocol: cephx 2024-09-12T17:36:29.533 INFO:tasks.workunit.client.0.smithi037.stderr: -226> 2024-09-12T17:36:29.220+0000 7fe597832800 5 AuthRegistry(0x556f1739ea40) adding auth protocol: cephx 2024-09-12T17:36:29.533 INFO:tasks.workunit.client.0.smithi037.stderr: -225> 2024-09-12T17:36:29.220+0000 7fe597832800 5 AuthRegistry(0x556f1739ea40) adding auth protocol: cephx 2024-09-12T17:36:29.533 INFO:tasks.workunit.client.0.smithi037.stderr: -224> 2024-09-12T17:36:29.220+0000 7fe597832800 5 AuthRegistry(0x556f1739ea40) adding con mode: secure 2024-09-12T17:36:29.533 INFO:tasks.workunit.client.0.smithi037.stderr: -223> 2024-09-12T17:36:29.220+0000 7fe597832800 5 AuthRegistry(0x556f1739ea40) adding con mode: crc 2024-09-12T17:36:29.533 INFO:tasks.workunit.client.0.smithi037.stderr: -222> 2024-09-12T17:36:29.220+0000 7fe597832800 5 AuthRegistry(0x556f1739ea40) adding con mode: secure 2024-09-12T17:36:29.533 INFO:tasks.workunit.client.0.smithi037.stderr: -221> 2024-09-12T17:36:29.220+0000 7fe597832800 5 AuthRegistry(0x556f1739ea40) adding con mode: crc 2024-09-12T17:36:29.533 INFO:tasks.workunit.client.0.smithi037.stderr: -220> 2024-09-12T17:36:29.220+0000 7fe597832800 5 AuthRegistry(0x556f1739ea40) adding con mode: secure 2024-09-12T17:36:29.533 INFO:tasks.workunit.client.0.smithi037.stderr: -219> 2024-09-12T17:36:29.220+0000 7fe597832800 5 AuthRegistry(0x556f1739ea40) adding con mode: crc 2024-09-12T17:36:29.533 INFO:tasks.workunit.client.0.smithi037.stderr: -218> 2024-09-12T17:36:29.220+0000 7fe597832800 5 AuthRegistry(0x556f1739ea40) adding con mode: crc 2024-09-12T17:36:29.534 INFO:tasks.workunit.client.0.smithi037.stderr: -217> 2024-09-12T17:36:29.220+0000 7fe597832800 5 AuthRegistry(0x556f1739ea40) adding con mode: secure 2024-09-12T17:36:29.534 INFO:tasks.workunit.client.0.smithi037.stderr: -216> 2024-09-12T17:36:29.220+0000 7fe597832800 5 AuthRegistry(0x556f1739ea40) adding con mode: crc 2024-09-12T17:36:29.534 INFO:tasks.workunit.client.0.smithi037.stderr: -215> 2024-09-12T17:36:29.220+0000 7fe597832800 5 AuthRegistry(0x556f1739ea40) adding con mode: secure 2024-09-12T17:36:29.534 INFO:tasks.workunit.client.0.smithi037.stderr: -214> 2024-09-12T17:36:29.220+0000 7fe597832800 5 AuthRegistry(0x556f1739ea40) adding con mode: crc 2024-09-12T17:36:29.534 INFO:tasks.workunit.client.0.smithi037.stderr: -213> 2024-09-12T17:36:29.220+0000 7fe597832800 5 AuthRegistry(0x556f1739ea40) adding con mode: secure 2024-09-12T17:36:29.534 INFO:tasks.workunit.client.0.smithi037.stderr: -212> 2024-09-12T17:36:29.220+0000 7fe597832800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:36:29.534 INFO:tasks.workunit.client.0.smithi037.stderr: -211> 2024-09-12T17:36:29.220+0000 7fe597832800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:36:29.534 INFO:tasks.workunit.client.0.smithi037.stderr: -210> 2024-09-12T17:36:29.220+0000 7fe597832800 5 asok(0x556f170e8730) register_command rotate-key cmddesc rotate-key hook 0x556f1739eb88 EEXIST 2024-09-12T17:36:29.534 INFO:tasks.workunit.client.0.smithi037.stderr: -209> 2024-09-12T17:36:29.220+0000 7fe597832800 10 monclient: _reopen_session rank -1 2024-09-12T17:36:29.534 INFO:tasks.workunit.client.0.smithi037.stderr: -208> 2024-09-12T17:36:29.220+0000 7fe597832800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T17:36:29.534 INFO:tasks.workunit.client.0.smithi037.stderr: -207> 2024-09-12T17:36:29.220+0000 7fe597832800 10 monclient(hunting): picked mon.noname-a con 0x556f173a8b10 addr [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] 2024-09-12T17:36:29.534 INFO:tasks.workunit.client.0.smithi037.stderr: -206> 2024-09-12T17:36:29.220+0000 7fe597832800 10 monclient(hunting): picked mon.noname-c con 0x556f173d4d10 addr [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] 2024-09-12T17:36:29.534 INFO:tasks.workunit.client.0.smithi037.stderr: -205> 2024-09-12T17:36:29.220+0000 7fe597832800 10 monclient(hunting): picked mon.noname-b con 0x556f173d9310 addr [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] 2024-09-12T17:36:29.535 INFO:tasks.workunit.client.0.smithi037.stderr: -204> 2024-09-12T17:36:29.220+0000 7fe597832800 10 monclient(hunting): start opening mon connection 2024-09-12T17:36:29.535 INFO:tasks.workunit.client.0.smithi037.stderr: -203> 2024-09-12T17:36:29.220+0000 7fe597832800 10 monclient(hunting): start opening mon connection 2024-09-12T17:36:29.535 INFO:tasks.workunit.client.0.smithi037.stderr: -202> 2024-09-12T17:36:29.220+0000 7fe597832800 10 monclient(hunting): start opening mon connection 2024-09-12T17:36:29.535 INFO:tasks.workunit.client.0.smithi037.stderr: -201> 2024-09-12T17:36:29.220+0000 7fe597832800 10 monclient(hunting): _renew_subs 2024-09-12T17:36:29.535 INFO:tasks.workunit.client.0.smithi037.stderr: -200> 2024-09-12T17:36:29.220+0000 7fe597832800 10 monclient(hunting): authenticate will time out at 2376.817633s 2024-09-12T17:36:29.535 INFO:tasks.workunit.client.0.smithi037.stderr: -199> 2024-09-12T17:36:29.220+0000 7fe58a352640 10 monclient(hunting): get_auth_request con 0x556f173d4d10 auth_method 0 2024-09-12T17:36:29.535 INFO:tasks.workunit.client.0.smithi037.stderr: -198> 2024-09-12T17:36:29.220+0000 7fe58a352640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:36:29.535 INFO:tasks.workunit.client.0.smithi037.stderr: -197> 2024-09-12T17:36:29.220+0000 7fe58a352640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:36:29.535 INFO:tasks.workunit.client.0.smithi037.stderr: -196> 2024-09-12T17:36:29.220+0000 7fe58a352640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:36:29.535 INFO:tasks.workunit.client.0.smithi037.stderr: -195> 2024-09-12T17:36:29.220+0000 7fe592b53640 10 monclient(hunting): get_auth_request con 0x556f173a8b10 auth_method 0 2024-09-12T17:36:29.535 INFO:tasks.workunit.client.0.smithi037.stderr: -194> 2024-09-12T17:36:29.220+0000 7fe592b53640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:36:29.535 INFO:tasks.workunit.client.0.smithi037.stderr: -193> 2024-09-12T17:36:29.220+0000 7fe592b53640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:36:29.535 INFO:tasks.workunit.client.0.smithi037.stderr: -192> 2024-09-12T17:36:29.220+0000 7fe592b53640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:36:29.535 INFO:tasks.workunit.client.0.smithi037.stderr: -191> 2024-09-12T17:36:29.220+0000 7fe58a352640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:36:29.536 INFO:tasks.workunit.client.0.smithi037.stderr: -190> 2024-09-12T17:36:29.220+0000 7fe58a352640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:36:29.536 INFO:tasks.workunit.client.0.smithi037.stderr: -189> 2024-09-12T17:36:29.220+0000 7fe58a352640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:36:29.536 INFO:tasks.workunit.client.0.smithi037.stderr: -188> 2024-09-12T17:36:29.220+0000 7fe592b53640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:36:29.536 INFO:tasks.workunit.client.0.smithi037.stderr: -187> 2024-09-12T17:36:29.220+0000 7fe592b53640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:36:29.536 INFO:tasks.workunit.client.0.smithi037.stderr: -186> 2024-09-12T17:36:29.220+0000 7fe592b53640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:36:29.536 INFO:tasks.workunit.client.0.smithi037.stderr: -185> 2024-09-12T17:36:29.220+0000 7fe593354640 10 monclient(hunting): get_auth_request con 0x556f173d9310 auth_method 0 2024-09-12T17:36:29.536 INFO:tasks.workunit.client.0.smithi037.stderr: -184> 2024-09-12T17:36:29.220+0000 7fe593354640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:36:29.536 INFO:tasks.workunit.client.0.smithi037.stderr: -183> 2024-09-12T17:36:29.220+0000 7fe593354640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:36:29.536 INFO:tasks.workunit.client.0.smithi037.stderr: -182> 2024-09-12T17:36:29.220+0000 7fe593354640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:36:29.536 INFO:tasks.workunit.client.0.smithi037.stderr: -181> 2024-09-12T17:36:29.220+0000 7fe58a352640 10 monclient(hunting): handle_auth_done global_id 7496 payload 824 2024-09-12T17:36:29.536 INFO:tasks.workunit.client.0.smithi037.stderr: -180> 2024-09-12T17:36:29.220+0000 7fe58a352640 10 monclient: _finish_hunting 0 2024-09-12T17:36:29.536 INFO:tasks.workunit.client.0.smithi037.stderr: -179> 2024-09-12T17:36:29.220+0000 7fe58a352640 1 monclient: found mon.noname-c 2024-09-12T17:36:29.536 INFO:tasks.workunit.client.0.smithi037.stderr: -178> 2024-09-12T17:36:29.220+0000 7fe58a352640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.37:3301/0 2024-09-12T17:36:29.536 INFO:tasks.workunit.client.0.smithi037.stderr: -177> 2024-09-12T17:36:29.221+0000 7fe474ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:36:29.537 INFO:tasks.workunit.client.0.smithi037.stderr: -176> 2024-09-12T17:36:29.221+0000 7fe474ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:36:29.537 INFO:tasks.workunit.client.0.smithi037.stderr: -175> 2024-09-12T17:36:29.221+0000 7fe474ff9640 10 monclient: dump: 2024-09-12T17:36:29.537 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:36:29.537 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:36:29.537 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:36:29.537 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:36:29.537 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:36:29.537 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:36:29.537 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:36:29.537 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:36:29.537 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:36:29.537 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:36:29.537 INFO:tasks.workunit.client.0.smithi037.stderr: -174> 2024-09-12T17:36:29.221+0000 7fe474ff9640 10 monclient: _finish_auth 0 2024-09-12T17:36:29.538 INFO:tasks.workunit.client.0.smithi037.stderr: -173> 2024-09-12T17:36:29.221+0000 7fe474ff9640 10 monclient: _check_auth_tickets 2024-09-12T17:36:29.538 INFO:tasks.workunit.client.0.smithi037.stderr: -172> 2024-09-12T17:36:29.221+0000 7fe474ff9640 10 monclient: handle_config config(0 keys) 2024-09-12T17:36:29.538 INFO:tasks.workunit.client.0.smithi037.stderr: -171> 2024-09-12T17:36:29.221+0000 7fe474ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:36:29.538 INFO:tasks.workunit.client.0.smithi037.stderr: -170> 2024-09-12T17:36:29.221+0000 7fe474ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:36:29.538 INFO:tasks.workunit.client.0.smithi037.stderr: -169> 2024-09-12T17:36:29.221+0000 7fe474ff9640 10 monclient: dump: 2024-09-12T17:36:29.538 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:36:29.538 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:36:29.538 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:36:29.538 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:36:29.538 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:36:29.538 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:36:29.538 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:36:29.538 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:36:29.538 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:36:29.539 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:36:29.539 INFO:tasks.workunit.client.0.smithi037.stderr: -168> 2024-09-12T17:36:29.221+0000 7fe597832800 5 monclient: authenticate success, global_id 7496 2024-09-12T17:36:29.539 INFO:tasks.workunit.client.0.smithi037.stderr: -167> 2024-09-12T17:36:29.221+0000 7fe4767fc640 4 set_mon_vals no callback set 2024-09-12T17:36:29.539 INFO:tasks.workunit.client.0.smithi037.stderr: -166> 2024-09-12T17:36:29.221+0000 7fe597832800 10 monclient: _renew_subs 2024-09-12T17:36:29.539 INFO:tasks.workunit.client.0.smithi037.stderr: -165> 2024-09-12T17:36:29.221+0000 7fe597832800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.37:3301/0 2024-09-12T17:36:29.539 INFO:tasks.workunit.client.0.smithi037.stderr: -164> 2024-09-12T17:36:29.221+0000 7fe597832800 10 monclient: _renew_subs 2024-09-12T17:36:29.539 INFO:tasks.workunit.client.0.smithi037.stderr: -163> 2024-09-12T17:36:29.221+0000 7fe597832800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.37:3301/0 2024-09-12T17:36:29.539 INFO:tasks.workunit.client.0.smithi037.stderr: -162> 2024-09-12T17:36:29.221+0000 7fe597832800 1 librados: init done 2024-09-12T17:36:29.539 INFO:tasks.workunit.client.0.smithi037.stderr: -161> 2024-09-12T17:36:29.221+0000 7fe597832800 5 asok(0x556f170e8730) register_command cr dump hook 0x556f173ccdb8 2024-09-12T17:36:29.539 INFO:tasks.workunit.client.0.smithi037.stderr: -160> 2024-09-12T17:36:29.222+0000 7fe597832800 20 rados->read ofs=0 len=0 2024-09-12T17:36:29.539 INFO:tasks.workunit.client.0.smithi037.stderr: -159> 2024-09-12T17:36:29.223+0000 7fe474ff9640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:36:29.539 INFO:tasks.workunit.client.0.smithi037.stderr: -158> 2024-09-12T17:36:29.223+0000 7fe474ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.40:6816/3916250676,v1:172.21.15.40:6817/3916250676] 2024-09-12T17:36:29.539 INFO:tasks.workunit.client.0.smithi037.stderr: -157> 2024-09-12T17:36:29.223+0000 7fe474ff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.40:6816/3916250676,v1:172.21.15.40:6817/3916250676] 2024-09-12T17:36:29.540 INFO:tasks.workunit.client.0.smithi037.stderr: -156> 2024-09-12T17:36:29.223+0000 7fe592b53640 10 monclient: get_auth_request con 0x7fe45c076470 auth_method 0 2024-09-12T17:36:29.540 INFO:tasks.workunit.client.0.smithi037.stderr: -155> 2024-09-12T17:36:29.223+0000 7fe593354640 10 monclient: get_auth_request con 0x556f173f3360 auth_method 0 2024-09-12T17:36:29.540 INFO:tasks.workunit.client.0.smithi037.stderr: -154> 2024-09-12T17:36:29.224+0000 7fe597832800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:29.540 INFO:tasks.workunit.client.0.smithi037.stderr: -153> 2024-09-12T17:36:29.224+0000 7fe597832800 20 realm 2024-09-12T17:36:29.540 INFO:tasks.workunit.client.0.smithi037.stderr: -152> 2024-09-12T17:36:29.224+0000 7fe597832800 20 rados->read ofs=0 len=0 2024-09-12T17:36:29.540 INFO:tasks.workunit.client.0.smithi037.stderr: -151> 2024-09-12T17:36:29.224+0000 7fe597832800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:29.540 INFO:tasks.workunit.client.0.smithi037.stderr: -150> 2024-09-12T17:36:29.224+0000 7fe597832800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:36:29.540 INFO:tasks.workunit.client.0.smithi037.stderr: -149> 2024-09-12T17:36:29.224+0000 7fe597832800 20 rados->read ofs=0 len=0 2024-09-12T17:36:29.540 INFO:tasks.workunit.client.0.smithi037.stderr: -148> 2024-09-12T17:36:29.224+0000 7fe597832800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:29.540 INFO:tasks.workunit.client.0.smithi037.stderr: -147> 2024-09-12T17:36:29.224+0000 7fe597832800 20 rados->read ofs=0 len=0 2024-09-12T17:36:29.540 INFO:tasks.workunit.client.0.smithi037.stderr: -146> 2024-09-12T17:36:29.225+0000 7fe592b53640 10 monclient: get_auth_request con 0x556f173f76f0 auth_method 0 2024-09-12T17:36:29.540 INFO:tasks.workunit.client.0.smithi037.stderr: -145> 2024-09-12T17:36:29.225+0000 7fe597832800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:36:29.540 INFO:tasks.workunit.client.0.smithi037.stderr: -144> 2024-09-12T17:36:29.225+0000 7fe597832800 20 rados->read ofs=0 len=0 2024-09-12T17:36:29.541 INFO:tasks.workunit.client.0.smithi037.stderr: -143> 2024-09-12T17:36:29.226+0000 7fe597832800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:36:29.541 INFO:tasks.workunit.client.0.smithi037.stderr: -142> 2024-09-12T17:36:29.226+0000 7fe597832800 20 searching for the correct realm 2024-09-12T17:36:29.541 INFO:tasks.workunit.client.0.smithi037.stderr: -141> 2024-09-12T17:36:29.226+0000 7fe58a352640 10 monclient: get_auth_request con 0x556f173fc990 auth_method 0 2024-09-12T17:36:29.541 INFO:tasks.workunit.client.0.smithi037.stderr: -140> 2024-09-12T17:36:29.227+0000 7fe593354640 10 monclient: get_auth_request con 0x7fe57c0a42a0 auth_method 0 2024-09-12T17:36:29.541 INFO:tasks.workunit.client.0.smithi037.stderr: -139> 2024-09-12T17:36:29.227+0000 7fe592b53640 10 monclient: get_auth_request con 0x7fe58c0646c0 auth_method 0 2024-09-12T17:36:29.541 INFO:tasks.workunit.client.0.smithi037.stderr: -138> 2024-09-12T17:36:29.228+0000 7fe58a352640 10 monclient: get_auth_request con 0x7fe584080040 auth_method 0 2024-09-12T17:36:29.541 INFO:tasks.workunit.client.0.smithi037.stderr: -137> 2024-09-12T17:36:29.229+0000 7fe58a352640 0 -- 172.21.15.37:0/1147036893 >> [v2:172.21.15.40:6800/2441293461,v1:172.21.15.40:6801/2441293461] conn(0x7fe584080040 msgr2=0x7fe58408f940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:36:29.541 INFO:tasks.workunit.client.0.smithi037.stderr: -136> 2024-09-12T17:36:29.229+0000 7fe474ff9640 1 client.7496.objecter ms_handle_reset 0x7fe584080040 session 0x7fe584005040 osd.4 2024-09-12T17:36:29.541 INFO:tasks.workunit.client.0.smithi037.stderr: -135> 2024-09-12T17:36:29.229+0000 7fe474ff9640 10 monclient: _renew_subs 2024-09-12T17:36:29.541 INFO:tasks.workunit.client.0.smithi037.stderr: -134> 2024-09-12T17:36:29.229+0000 7fe474ff9640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.37:3301/0 2024-09-12T17:36:29.541 INFO:tasks.workunit.client.0.smithi037.stderr: -133> 2024-09-12T17:36:29.229+0000 7fe58a352640 10 monclient: get_auth_request con 0x7fe45c086b10 auth_method 0 2024-09-12T17:36:29.541 INFO:tasks.workunit.client.0.smithi037.stderr: -132> 2024-09-12T17:36:29.230+0000 7fe593354640 10 monclient: get_auth_request con 0x7fe57c089800 auth_method 0 2024-09-12T17:36:29.541 INFO:tasks.workunit.client.0.smithi037.stderr: -131> 2024-09-12T17:36:29.233+0000 7fe592b53640 10 monclient: get_auth_request con 0x7fe57c01abb0 auth_method 0 2024-09-12T17:36:29.541 INFO:tasks.workunit.client.0.smithi037.stderr: -130> 2024-09-12T17:36:29.233+0000 7fe592b53640 0 -- 172.21.15.37:0/1147036893 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7fe57c01abb0 msgr2=0x7fe57c07c970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:36:29.542 INFO:tasks.workunit.client.0.smithi037.stderr: -129> 2024-09-12T17:36:29.434+0000 7fe592b53640 10 monclient: get_auth_request con 0x7fe57c01abb0 auth_method 0 2024-09-12T17:36:29.542 INFO:tasks.workunit.client.0.smithi037.stderr: -128> 2024-09-12T17:36:29.440+0000 7fe597832800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:36:29.542 INFO:tasks.workunit.client.0.smithi037.stderr: -127> 2024-09-12T17:36:29.440+0000 7fe597832800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:36:29.542 INFO:tasks.workunit.client.0.smithi037.stderr: -126> 2024-09-12T17:36:29.440+0000 7fe597832800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:36:29.542 INFO:tasks.workunit.client.0.smithi037.stderr: -125> 2024-09-12T17:36:29.440+0000 7fe597832800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:36:29.542 INFO:tasks.workunit.client.0.smithi037.stderr: -124> 2024-09-12T17:36:29.440+0000 7fe597832800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:36:29.542 INFO:tasks.workunit.client.0.smithi037.stderr: -123> 2024-09-12T17:36:29.440+0000 7fe597832800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:36:29.542 INFO:tasks.workunit.client.0.smithi037.stderr: -122> 2024-09-12T17:36:29.440+0000 7fe597832800 20 rados->read ofs=0 len=0 2024-09-12T17:36:29.542 INFO:tasks.workunit.client.0.smithi037.stderr: -121> 2024-09-12T17:36:29.441+0000 7fe597832800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:29.542 INFO:tasks.workunit.client.0.smithi037.stderr: -120> 2024-09-12T17:36:29.441+0000 7fe597832800 20 rados->read ofs=0 len=0 2024-09-12T17:36:29.542 INFO:tasks.workunit.client.0.smithi037.stderr: -119> 2024-09-12T17:36:29.441+0000 7fe597832800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:36:29.542 INFO:tasks.workunit.client.0.smithi037.stderr: -118> 2024-09-12T17:36:29.441+0000 7fe597832800 20 rados->read ofs=0 len=0 2024-09-12T17:36:29.542 INFO:tasks.workunit.client.0.smithi037.stderr: -117> 2024-09-12T17:36:29.442+0000 7fe597832800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:36:29.543 INFO:tasks.workunit.client.0.smithi037.stderr: -116> 2024-09-12T17:36:29.442+0000 7fe597832800 20 zone default found 2024-09-12T17:36:29.543 INFO:tasks.workunit.client.0.smithi037.stderr: -115> 2024-09-12T17:36:29.442+0000 7fe597832800 4 Realm: () 2024-09-12T17:36:29.543 INFO:tasks.workunit.client.0.smithi037.stderr: -114> 2024-09-12T17:36:29.442+0000 7fe597832800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:36:29.543 INFO:tasks.workunit.client.0.smithi037.stderr: -113> 2024-09-12T17:36:29.442+0000 7fe597832800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:36:29.543 INFO:tasks.workunit.client.0.smithi037.stderr: -112> 2024-09-12T17:36:29.442+0000 7fe597832800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:36:29.543 INFO:tasks.workunit.client.0.smithi037.stderr: -111> 2024-09-12T17:36:29.442+0000 7fe597832800 20 zonegroup default 2024-09-12T17:36:29.543 INFO:tasks.workunit.client.0.smithi037.stderr: -110> 2024-09-12T17:36:29.442+0000 7fe597832800 20 rados->read ofs=0 len=0 2024-09-12T17:36:29.543 INFO:tasks.workunit.client.0.smithi037.stderr: -109> 2024-09-12T17:36:29.442+0000 7fe597832800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:29.543 INFO:tasks.workunit.client.0.smithi037.stderr: -108> 2024-09-12T17:36:29.442+0000 7fe597832800 20 rados->read ofs=0 len=0 2024-09-12T17:36:29.543 INFO:tasks.workunit.client.0.smithi037.stderr: -107> 2024-09-12T17:36:29.442+0000 7fe597832800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:29.543 INFO:tasks.workunit.client.0.smithi037.stderr: -106> 2024-09-12T17:36:29.442+0000 7fe597832800 20 rados->read ofs=0 len=0 2024-09-12T17:36:29.543 INFO:tasks.workunit.client.0.smithi037.stderr: -105> 2024-09-12T17:36:29.443+0000 7fe597832800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:29.543 INFO:tasks.workunit.client.0.smithi037.stderr: -104> 2024-09-12T17:36:29.443+0000 7fe597832800 20 started sync module instance, tier type = 2024-09-12T17:36:29.543 INFO:tasks.workunit.client.0.smithi037.stderr: -103> 2024-09-12T17:36:29.443+0000 7fe597832800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:36:29.544 INFO:tasks.workunit.client.0.smithi037.stderr: -102> 2024-09-12T17:36:29.453+0000 7fe597832800 20 add_watcher() i=0 2024-09-12T17:36:29.544 INFO:tasks.workunit.client.0.smithi037.stderr: -101> 2024-09-12T17:36:29.453+0000 7fe597832800 20 add_watcher() i=1 2024-09-12T17:36:29.544 INFO:tasks.workunit.client.0.smithi037.stderr: -100> 2024-09-12T17:36:29.453+0000 7fe597832800 20 add_watcher() i=2 2024-09-12T17:36:29.544 INFO:tasks.workunit.client.0.smithi037.stderr: -99> 2024-09-12T17:36:29.453+0000 7fe597832800 20 add_watcher() i=3 2024-09-12T17:36:29.544 INFO:tasks.workunit.client.0.smithi037.stderr: -98> 2024-09-12T17:36:29.453+0000 7fe597832800 20 add_watcher() i=4 2024-09-12T17:36:29.544 INFO:tasks.workunit.client.0.smithi037.stderr: -97> 2024-09-12T17:36:29.453+0000 7fe597832800 20 add_watcher() i=5 2024-09-12T17:36:29.544 INFO:tasks.workunit.client.0.smithi037.stderr: -96> 2024-09-12T17:36:29.453+0000 7fe597832800 20 add_watcher() i=6 2024-09-12T17:36:29.544 INFO:tasks.workunit.client.0.smithi037.stderr: -95> 2024-09-12T17:36:29.454+0000 7fe597832800 20 add_watcher() i=7 2024-09-12T17:36:29.544 INFO:tasks.workunit.client.0.smithi037.stderr: -94> 2024-09-12T17:36:29.454+0000 7fe597832800 2 all 8 watchers are set, enabling cache 2024-09-12T17:36:29.544 INFO:tasks.workunit.client.0.smithi037.stderr: -93> 2024-09-12T17:36:29.456+0000 7fe597832800 5 AuthRegistry(0x7ffee11095d0) adding auth protocol: cephx 2024-09-12T17:36:29.544 INFO:tasks.workunit.client.0.smithi037.stderr: -92> 2024-09-12T17:36:29.456+0000 7fe597832800 5 AuthRegistry(0x7ffee11095d0) adding auth protocol: cephx 2024-09-12T17:36:29.544 INFO:tasks.workunit.client.0.smithi037.stderr: -91> 2024-09-12T17:36:29.456+0000 7fe597832800 5 AuthRegistry(0x7ffee11095d0) adding auth protocol: cephx 2024-09-12T17:36:29.544 INFO:tasks.workunit.client.0.smithi037.stderr: -90> 2024-09-12T17:36:29.456+0000 7fe597832800 5 AuthRegistry(0x7ffee11095d0) adding con mode: secure 2024-09-12T17:36:29.545 INFO:tasks.workunit.client.0.smithi037.stderr: -89> 2024-09-12T17:36:29.456+0000 7fe597832800 5 AuthRegistry(0x7ffee11095d0) adding con mode: crc 2024-09-12T17:36:29.545 INFO:tasks.workunit.client.0.smithi037.stderr: -88> 2024-09-12T17:36:29.456+0000 7fe597832800 5 AuthRegistry(0x7ffee11095d0) adding con mode: secure 2024-09-12T17:36:29.545 INFO:tasks.workunit.client.0.smithi037.stderr: -87> 2024-09-12T17:36:29.456+0000 7fe597832800 5 AuthRegistry(0x7ffee11095d0) adding con mode: crc 2024-09-12T17:36:29.545 INFO:tasks.workunit.client.0.smithi037.stderr: -86> 2024-09-12T17:36:29.456+0000 7fe597832800 5 AuthRegistry(0x7ffee11095d0) adding con mode: secure 2024-09-12T17:36:29.545 INFO:tasks.workunit.client.0.smithi037.stderr: -85> 2024-09-12T17:36:29.456+0000 7fe597832800 5 AuthRegistry(0x7ffee11095d0) adding con mode: crc 2024-09-12T17:36:29.545 INFO:tasks.workunit.client.0.smithi037.stderr: -84> 2024-09-12T17:36:29.456+0000 7fe597832800 5 AuthRegistry(0x7ffee11095d0) adding con mode: crc 2024-09-12T17:36:29.545 INFO:tasks.workunit.client.0.smithi037.stderr: -83> 2024-09-12T17:36:29.456+0000 7fe597832800 5 AuthRegistry(0x7ffee11095d0) adding con mode: secure 2024-09-12T17:36:29.545 INFO:tasks.workunit.client.0.smithi037.stderr: -82> 2024-09-12T17:36:29.456+0000 7fe597832800 5 AuthRegistry(0x7ffee11095d0) adding con mode: crc 2024-09-12T17:36:29.545 INFO:tasks.workunit.client.0.smithi037.stderr: -81> 2024-09-12T17:36:29.456+0000 7fe597832800 5 AuthRegistry(0x7ffee11095d0) adding con mode: secure 2024-09-12T17:36:29.545 INFO:tasks.workunit.client.0.smithi037.stderr: -80> 2024-09-12T17:36:29.456+0000 7fe597832800 5 AuthRegistry(0x7ffee11095d0) adding con mode: crc 2024-09-12T17:36:29.545 INFO:tasks.workunit.client.0.smithi037.stderr: -79> 2024-09-12T17:36:29.456+0000 7fe597832800 5 AuthRegistry(0x7ffee11095d0) adding con mode: secure 2024-09-12T17:36:29.545 INFO:tasks.workunit.client.0.smithi037.stderr: -78> 2024-09-12T17:36:29.456+0000 7fe4497e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:36:29.545 INFO:tasks.workunit.client.0.smithi037.stderr: -77> 2024-09-12T17:36:29.456+0000 7fe597832800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:36:29.545 INFO:tasks.workunit.client.0.smithi037.stderr: -76> 2024-09-12T17:36:29.456+0000 7fe597832800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:36:29.546 INFO:tasks.workunit.client.0.smithi037.stderr: -75> 2024-09-12T17:36:29.456+0000 7fe597832800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:36:29.546 INFO:tasks.workunit.client.0.smithi037.stderr: -74> 2024-09-12T17:36:29.456+0000 7fe597832800 5 asok(0x556f170e8730) register_command cache list hook 0x556f173cf5a0 2024-09-12T17:36:29.546 INFO:tasks.workunit.client.0.smithi037.stderr: -73> 2024-09-12T17:36:29.456+0000 7fe597832800 5 asok(0x556f170e8730) register_command cache inspect hook 0x556f173cf5a0 2024-09-12T17:36:29.546 INFO:tasks.workunit.client.0.smithi037.stderr: -72> 2024-09-12T17:36:29.456+0000 7fe597832800 5 asok(0x556f170e8730) register_command cache erase hook 0x556f173cf5a0 2024-09-12T17:36:29.546 INFO:tasks.workunit.client.0.smithi037.stderr: -71> 2024-09-12T17:36:29.456+0000 7fe597832800 5 asok(0x556f170e8730) register_command cache zap hook 0x556f173cf5a0 2024-09-12T17:36:29.546 INFO:tasks.workunit.client.0.smithi037.stderr: -70> 2024-09-12T17:36:29.456+0000 7fe597832800 5 note: GC not initialized 2024-09-12T17:36:29.546 INFO:tasks.workunit.client.0.smithi037.stderr: -69> 2024-09-12T17:36:29.456+0000 7fe3c3fff640 20 reqs_thread_entry: start 2024-09-12T17:36:29.546 INFO:tasks.workunit.client.0.smithi037.stderr: -68> 2024-09-12T17:36:29.456+0000 7fe597832800 5 asok(0x556f170e8730) register_command sync trace show hook 0x7fe58c0055d0 2024-09-12T17:36:29.546 INFO:tasks.workunit.client.0.smithi037.stderr: -67> 2024-09-12T17:36:29.456+0000 7fe597832800 5 asok(0x556f170e8730) register_command sync trace history hook 0x7fe58c0055d0 2024-09-12T17:36:29.546 INFO:tasks.workunit.client.0.smithi037.stderr: -66> 2024-09-12T17:36:29.456+0000 7fe597832800 5 asok(0x556f170e8730) register_command sync trace active hook 0x7fe58c0055d0 2024-09-12T17:36:29.546 INFO:tasks.workunit.client.0.smithi037.stderr: -65> 2024-09-12T17:36:29.456+0000 7fe597832800 5 asok(0x556f170e8730) register_command sync trace active_short hook 0x7fe58c0055d0 2024-09-12T17:36:29.546 INFO:tasks.workunit.client.0.smithi037.stderr: -64> 2024-09-12T17:36:29.457+0000 7fe597832800 20 init_complete bucket index max shards: 11 2024-09-12T17:36:29.546 INFO:tasks.workunit.client.0.smithi037.stderr: -63> 2024-09-12T17:36:29.457+0000 7fe597832800 20 Filter name: none 2024-09-12T17:36:29.547 INFO:tasks.workunit.client.0.smithi037.stderr: -62> 2024-09-12T17:36:29.457+0000 7fe3c1ffb640 20 reqs_thread_entry: start 2024-09-12T17:36:29.547 INFO:tasks.workunit.client.0.smithi037.stderr: -61> 2024-09-12T17:36:29.457+0000 7fe597832800 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-12T17:36:29.547 INFO:tasks.workunit.client.0.smithi037.stderr: -60> 2024-09-12T17:36:29.457+0000 7fe597832800 20 rados->read ofs=0 len=0 2024-09-12T17:36:29.547 INFO:tasks.workunit.client.0.smithi037.stderr: -59> 2024-09-12T17:36:29.457+0000 7fe597832800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:36:29.547 INFO:tasks.workunit.client.0.smithi037.stderr: -58> 2024-09-12T17:36:29.457+0000 7fe597832800 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-12T17:36:29.547 INFO:tasks.workunit.client.0.smithi037.stderr: -57> 2024-09-12T17:36:29.457+0000 7fe597832800 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-12T17:36:29.547 INFO:tasks.workunit.client.0.smithi037.stderr: -56> 2024-09-12T17:36:29.457+0000 7fe597832800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40 : miss 2024-09-12T17:36:29.547 INFO:tasks.workunit.client.0.smithi037.stderr: -55> 2024-09-12T17:36:29.457+0000 7fe597832800 20 rados->read ofs=0 len=0 2024-09-12T17:36:29.547 INFO:tasks.workunit.client.0.smithi037.stderr: -54> 2024-09-12T17:36:29.458+0000 7fe597832800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:36:29.547 INFO:tasks.workunit.client.0.smithi037.stderr: -53> 2024-09-12T17:36:29.458+0000 7fe597832800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40 info.flags=0x17 2024-09-12T17:36:29.547 INFO:tasks.workunit.client.0.smithi037.stderr: -52> 2024-09-12T17:36:29.458+0000 7fe597832800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40 to cache LRU end 2024-09-12T17:36:29.547 INFO:tasks.workunit.client.0.smithi037.stderr: -51> 2024-09-12T17:36:29.458+0000 7fe597832800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:36:29.548 INFO:tasks.workunit.client.0.smithi037.stderr: -50> 2024-09-12T17:36:29.458+0000 7fe597832800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:36:29.548 INFO:tasks.workunit.client.0.smithi037.stderr: -49> 2024-09-12T17:36:29.458+0000 7fe597832800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40 2024-09-12T17:36:29.548 INFO:tasks.workunit.client.0.smithi037.stderr: -48> 2024-09-12T17:36:29.463+0000 7fe597832800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40 info.flags=0x17 2024-09-12T17:36:29.548 INFO:tasks.workunit.client.0.smithi037.stderr: -47> 2024-09-12T17:36:29.463+0000 7fe597832800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40 to cache LRU end 2024-09-12T17:36:29.548 INFO:tasks.workunit.client.0.smithi037.stderr: -46> 2024-09-12T17:36:29.463+0000 7fe597832800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:36:29.548 INFO:tasks.workunit.client.0.smithi037.stderr: -45> 2024-09-12T17:36:29.463+0000 7fe597832800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40, ofs0, ns] 2024-09-12T17:36:29.548 INFO:tasks.workunit.client.0.smithi037.stderr: -44> 2024-09-12T17:36:29.464+0000 7fe475ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497008 cookie 93935619823760 notifier 7496 bl.length()=1015 2024-09-12T17:36:29.548 INFO:tasks.workunit.client.0.smithi037.stderr: -43> 2024-09-12T17:36:29.464+0000 7fe475ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40 info.flags=0x17 2024-09-12T17:36:29.548 INFO:tasks.workunit.client.0.smithi037.stderr: -42> 2024-09-12T17:36:29.464+0000 7fe475ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40 to cache LRU end 2024-09-12T17:36:29.548 INFO:tasks.workunit.client.0.smithi037.stderr: -41> 2024-09-12T17:36:29.464+0000 7fe475ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:36:29.548 INFO:tasks.workunit.client.0.smithi037.stderr: -40> 2024-09-12T17:36:29.465+0000 7fe597832800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40]): orig_sources= new_sources= 2024-09-12T17:36:29.548 INFO:tasks.workunit.client.0.smithi037.stderr: -39> 2024-09-12T17:36:29.465+0000 7fe597832800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40]): potential sources added=[] removed=[] 2024-09-12T17:36:29.549 INFO:tasks.workunit.client.0.smithi037.stderr: -38> 2024-09-12T17:36:29.465+0000 7fe597832800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40]): orig_dests= new_dests= 2024-09-12T17:36:29.549 INFO:tasks.workunit.client.0.smithi037.stderr: -37> 2024-09-12T17:36:29.465+0000 7fe597832800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40]): potential dests added=[] removed=[] 2024-09-12T17:36:29.549 INFO:tasks.workunit.client.0.smithi037.stderr: -36> 2024-09-12T17:36:29.471+0000 7fe597832800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40.1.0 2024-09-12T17:36:29.549 INFO:tasks.workunit.client.0.smithi037.stderr: -35> 2024-09-12T17:36:29.471+0000 7fe597832800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40.1.0 2024-09-12T17:36:29.549 INFO:tasks.workunit.client.0.smithi037.stderr: -34> 2024-09-12T17:36:29.471+0000 7fe597832800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40.1.1 2024-09-12T17:36:29.549 INFO:tasks.workunit.client.0.smithi037.stderr: -33> 2024-09-12T17:36:29.471+0000 7fe597832800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40.1.1 2024-09-12T17:36:29.549 INFO:tasks.workunit.client.0.smithi037.stderr: -32> 2024-09-12T17:36:29.471+0000 7fe597832800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40.1.2 2024-09-12T17:36:29.549 INFO:tasks.workunit.client.0.smithi037.stderr: -31> 2024-09-12T17:36:29.471+0000 7fe597832800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40.1.2 2024-09-12T17:36:29.549 INFO:tasks.workunit.client.0.smithi037.stderr: -30> 2024-09-12T17:36:29.471+0000 7fe597832800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40.1.3 2024-09-12T17:36:29.550 INFO:tasks.workunit.client.0.smithi037.stderr: -29> 2024-09-12T17:36:29.471+0000 7fe597832800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40.1.3 2024-09-12T17:36:29.550 INFO:tasks.workunit.client.0.smithi037.stderr: -28> 2024-09-12T17:36:29.471+0000 7fe597832800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40.1.4 2024-09-12T17:36:29.550 INFO:tasks.workunit.client.0.smithi037.stderr: -27> 2024-09-12T17:36:29.471+0000 7fe597832800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40.1.4 2024-09-12T17:36:29.550 INFO:tasks.workunit.client.0.smithi037.stderr: -26> 2024-09-12T17:36:29.471+0000 7fe597832800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40.1.5 2024-09-12T17:36:29.550 INFO:tasks.workunit.client.0.smithi037.stderr: -25> 2024-09-12T17:36:29.471+0000 7fe597832800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40.1.5 2024-09-12T17:36:29.550 INFO:tasks.workunit.client.0.smithi037.stderr: -24> 2024-09-12T17:36:29.471+0000 7fe597832800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40.1.6 2024-09-12T17:36:29.550 INFO:tasks.workunit.client.0.smithi037.stderr: -23> 2024-09-12T17:36:29.471+0000 7fe597832800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40.1.6 2024-09-12T17:36:29.550 INFO:tasks.workunit.client.0.smithi037.stderr: -22> 2024-09-12T17:36:29.471+0000 7fe597832800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40.1.7 2024-09-12T17:36:29.550 INFO:tasks.workunit.client.0.smithi037.stderr: -21> 2024-09-12T17:36:29.471+0000 7fe597832800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40.1.7 2024-09-12T17:36:29.550 INFO:tasks.workunit.client.0.smithi037.stderr: -20> 2024-09-12T17:36:29.471+0000 7fe597832800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40.1.8 2024-09-12T17:36:29.550 INFO:tasks.workunit.client.0.smithi037.stderr: -19> 2024-09-12T17:36:29.471+0000 7fe597832800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40.1.8 2024-09-12T17:36:29.550 INFO:tasks.workunit.client.0.smithi037.stderr: -18> 2024-09-12T17:36:29.471+0000 7fe597832800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40.1.9 2024-09-12T17:36:29.550 INFO:tasks.workunit.client.0.smithi037.stderr: -17> 2024-09-12T17:36:29.471+0000 7fe597832800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40.1.9 2024-09-12T17:36:29.550 INFO:tasks.workunit.client.0.smithi037.stderr: -16> 2024-09-12T17:36:29.471+0000 7fe597832800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40.1.10 2024-09-12T17:36:29.551 INFO:tasks.workunit.client.0.smithi037.stderr: -15> 2024-09-12T17:36:29.471+0000 7fe597832800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40.1.10 2024-09-12T17:36:29.551 INFO:tasks.workunit.client.0.smithi037.stderr: -14> 2024-09-12T17:36:29.471+0000 7fe597832800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40.1.11 2024-09-12T17:36:29.551 INFO:tasks.workunit.client.0.smithi037.stderr: -13> 2024-09-12T17:36:29.471+0000 7fe597832800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40.1.11 2024-09-12T17:36:29.551 INFO:tasks.workunit.client.0.smithi037.stderr: -12> 2024-09-12T17:36:29.471+0000 7fe597832800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40.0 2024-09-12T17:36:29.551 INFO:tasks.workunit.client.0.smithi037.stderr: -11> 2024-09-12T17:36:29.471+0000 7fe597832800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40.1 2024-09-12T17:36:29.551 INFO:tasks.workunit.client.0.smithi037.stderr: -10> 2024-09-12T17:36:29.472+0000 7fe597832800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40.2 2024-09-12T17:36:29.551 INFO:tasks.workunit.client.0.smithi037.stderr: -9> 2024-09-12T17:36:29.472+0000 7fe597832800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40.3 2024-09-12T17:36:29.551 INFO:tasks.workunit.client.0.smithi037.stderr: -8> 2024-09-12T17:36:29.473+0000 7fe597832800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40.4 2024-09-12T17:36:29.551 INFO:tasks.workunit.client.0.smithi037.stderr: -7> 2024-09-12T17:36:29.474+0000 7fe597832800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40.5 2024-09-12T17:36:29.551 INFO:tasks.workunit.client.0.smithi037.stderr: -6> 2024-09-12T17:36:29.474+0000 7fe597832800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40.6 2024-09-12T17:36:29.551 INFO:tasks.workunit.client.0.smithi037.stderr: -5> 2024-09-12T17:36:29.475+0000 7fe597832800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40.7 2024-09-12T17:36:29.551 INFO:tasks.workunit.client.0.smithi037.stderr: -4> 2024-09-12T17:36:29.475+0000 7fe597832800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40.8 2024-09-12T17:36:29.551 INFO:tasks.workunit.client.0.smithi037.stderr: -3> 2024-09-12T17:36:29.476+0000 7fe597832800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40.9 2024-09-12T17:36:29.552 INFO:tasks.workunit.client.0.smithi037.stderr: -2> 2024-09-12T17:36:29.476+0000 7fe597832800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40.10 2024-09-12T17:36:29.552 INFO:tasks.workunit.client.0.smithi037.stderr: -1> 2024-09-12T17:36:29.480+0000 7fe597832800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fe597832800 time 2024-09-12T17:36:29.480591+0000 2024-09-12T17:36:29.552 INFO:tasks.workunit.client.0.smithi037.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:36:29.552 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:36:29.552 INFO:tasks.workunit.client.0.smithi037.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:36:29.552 INFO:tasks.workunit.client.0.smithi037.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fe59858c71a] 2024-09-12T17:36:29.552 INFO:tasks.workunit.client.0.smithi037.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fe59858c8d8] 2024-09-12T17:36:29.552 INFO:tasks.workunit.client.0.smithi037.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x556f16309841] 2024-09-12T17:36:29.553 INFO:tasks.workunit.client.0.smithi037.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x556f16318734] 2024-09-12T17:36:29.553 INFO:tasks.workunit.client.0.smithi037.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x556f163195d4] 2024-09-12T17:36:29.553 INFO:tasks.workunit.client.0.smithi037.stderr: 6: main() 2024-09-12T17:36:29.553 INFO:tasks.workunit.client.0.smithi037.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fe597229590] 2024-09-12T17:36:29.553 INFO:tasks.workunit.client.0.smithi037.stderr: 8: __libc_start_main() 2024-09-12T17:36:29.553 INFO:tasks.workunit.client.0.smithi037.stderr: 9: _start() 2024-09-12T17:36:29.553 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:36:29.553 INFO:tasks.workunit.client.0.smithi037.stderr: 0> 2024-09-12T17:36:29.481+0000 7fe597832800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:36:29.553 INFO:tasks.workunit.client.0.smithi037.stderr: in thread 7fe597832800 thread_name:radosgw-admin 2024-09-12T17:36:29.553 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:36:29.553 INFO:tasks.workunit.client.0.smithi037.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:36:29.554 INFO:tasks.workunit.client.0.smithi037.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fe59723e6f0] 2024-09-12T17:36:29.554 INFO:tasks.workunit.client.0.smithi037.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fe59728b99c] 2024-09-12T17:36:29.554 INFO:tasks.workunit.client.0.smithi037.stderr: 3: raise() 2024-09-12T17:36:29.554 INFO:tasks.workunit.client.0.smithi037.stderr: 4: abort() 2024-09-12T17:36:29.554 INFO:tasks.workunit.client.0.smithi037.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fe59858c774] 2024-09-12T17:36:29.554 INFO:tasks.workunit.client.0.smithi037.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fe59858c8d8] 2024-09-12T17:36:29.554 INFO:tasks.workunit.client.0.smithi037.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x556f16309841] 2024-09-12T17:36:29.554 INFO:tasks.workunit.client.0.smithi037.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x556f16318734] 2024-09-12T17:36:29.554 INFO:tasks.workunit.client.0.smithi037.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x556f163195d4] 2024-09-12T17:36:29.554 INFO:tasks.workunit.client.0.smithi037.stderr: 10: main() 2024-09-12T17:36:29.554 INFO:tasks.workunit.client.0.smithi037.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fe597229590] 2024-09-12T17:36:29.554 INFO:tasks.workunit.client.0.smithi037.stderr: 12: __libc_start_main() 2024-09-12T17:36:29.554 INFO:tasks.workunit.client.0.smithi037.stderr: 13: _start() 2024-09-12T17:36:29.555 INFO:tasks.workunit.client.0.smithi037.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:36:29.555 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:36:29.555 INFO:tasks.workunit.client.0.smithi037.stderr:--- logging levels --- 2024-09-12T17:36:29.555 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 none 2024-09-12T17:36:29.555 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 lockdep 2024-09-12T17:36:29.555 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 context 2024-09-12T17:36:29.555 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 1 crush 2024-09-12T17:36:29.555 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mds 2024-09-12T17:36:29.555 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mds_balancer 2024-09-12T17:36:29.555 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mds_locker 2024-09-12T17:36:29.555 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mds_log 2024-09-12T17:36:29.555 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mds_log_expire 2024-09-12T17:36:29.555 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mds_migrator 2024-09-12T17:36:29.556 INFO:tasks.workunit.client.0.smithi037.stderr: 3/ 5 mds_quiesce 2024-09-12T17:36:29.556 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 buffer 2024-09-12T17:36:29.556 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 timer 2024-09-12T17:36:29.556 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 filer 2024-09-12T17:36:29.556 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 striper 2024-09-12T17:36:29.556 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 objecter 2024-09-12T17:36:29.556 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 rados 2024-09-12T17:36:29.556 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 rbd 2024-09-12T17:36:29.556 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 rbd_mirror 2024-09-12T17:36:29.556 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 rbd_replay 2024-09-12T17:36:29.556 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 rbd_pwl 2024-09-12T17:36:29.556 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 journaler 2024-09-12T17:36:29.556 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 objectcacher 2024-09-12T17:36:29.556 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:36:29.557 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 client 2024-09-12T17:36:29.557 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 osd 2024-09-12T17:36:29.557 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 optracker 2024-09-12T17:36:29.557 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 objclass 2024-09-12T17:36:29.557 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 3 filestore 2024-09-12T17:36:29.557 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 3 journal 2024-09-12T17:36:29.557 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 0 ms 2024-09-12T17:36:29.557 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mon 2024-09-12T17:36:29.557 INFO:tasks.workunit.client.0.smithi037.stderr: 0/10 monc 2024-09-12T17:36:29.557 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 paxos 2024-09-12T17:36:29.557 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 tp 2024-09-12T17:36:29.557 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 auth 2024-09-12T17:36:29.557 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 crypto 2024-09-12T17:36:29.557 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 1 finisher 2024-09-12T17:36:29.558 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 1 reserver 2024-09-12T17:36:29.558 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 heartbeatmap 2024-09-12T17:36:29.558 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 perfcounter 2024-09-12T17:36:29.558 INFO:tasks.workunit.client.0.smithi037.stderr: 20/20 rgw 2024-09-12T17:36:29.558 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 rgw_sync 2024-09-12T17:36:29.558 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 rgw_datacache 2024-09-12T17:36:29.558 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 rgw_access 2024-09-12T17:36:29.558 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:36:29.558 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 rgw_flight 2024-09-12T17:36:29.558 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:36:29.558 INFO:tasks.workunit.client.0.smithi037.stderr: 20/20 rgw_notification 2024-09-12T17:36:29.558 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 javaclient 2024-09-12T17:36:29.558 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 asok 2024-09-12T17:36:29.559 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 1 throttle 2024-09-12T17:36:29.559 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 0 refs 2024-09-12T17:36:29.559 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 compressor 2024-09-12T17:36:29.559 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 bluestore 2024-09-12T17:36:29.559 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 bluefs 2024-09-12T17:36:29.559 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 3 bdev 2024-09-12T17:36:29.559 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 kstore 2024-09-12T17:36:29.559 INFO:tasks.workunit.client.0.smithi037.stderr: 4/ 5 rocksdb 2024-09-12T17:36:29.559 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 fuse 2024-09-12T17:36:29.559 INFO:tasks.workunit.client.0.smithi037.stderr: 2/ 5 mgr 2024-09-12T17:36:29.559 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mgrc 2024-09-12T17:36:29.559 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 dpdk 2024-09-12T17:36:29.560 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 eventtrace 2024-09-12T17:36:29.560 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 prioritycache 2024-09-12T17:36:29.560 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 test 2024-09-12T17:36:29.560 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:36:29.560 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 cephsqlite 2024-09-12T17:36:29.560 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:36:29.560 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore 2024-09-12T17:36:29.560 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_onode 2024-09-12T17:36:29.560 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_odata 2024-09-12T17:36:29.560 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_omap 2024-09-12T17:36:29.560 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_tm 2024-09-12T17:36:29.560 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_t 2024-09-12T17:36:29.560 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:36:29.560 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_epm 2024-09-12T17:36:29.561 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_lba 2024-09-12T17:36:29.561 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:36:29.561 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_cache 2024-09-12T17:36:29.561 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_journal 2024-09-12T17:36:29.561 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_device 2024-09-12T17:36:29.561 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_backref 2024-09-12T17:36:29.561 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 alienstore 2024-09-12T17:36:29.561 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mclock 2024-09-12T17:36:29.561 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 cyanstore 2024-09-12T17:36:29.561 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 ceph_exporter 2024-09-12T17:36:29.561 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 memstore 2024-09-12T17:36:29.561 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 trace 2024-09-12T17:36:29.561 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 ceph_dedup 2024-09-12T17:36:29.562 INFO:tasks.workunit.client.0.smithi037.stderr: -2/-2 (syslog threshold) 2024-09-12T17:36:29.562 INFO:tasks.workunit.client.0.smithi037.stderr: 99/99 (stderr threshold) 2024-09-12T17:36:29.562 INFO:tasks.workunit.client.0.smithi037.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:36:29.562 INFO:tasks.workunit.client.0.smithi037.stderr: 7fe3c1ffb640 / http_manager 2024-09-12T17:36:29.562 INFO:tasks.workunit.client.0.smithi037.stderr: 7fe3c3fff640 / http_manager 2024-09-12T17:36:29.562 INFO:tasks.workunit.client.0.smithi037.stderr: 7fe4497e2640 / rgw_dt_lg_renew 2024-09-12T17:36:29.562 INFO:tasks.workunit.client.0.smithi037.stderr: 7fe474ff9640 / ms_dispatch 2024-09-12T17:36:29.562 INFO:tasks.workunit.client.0.smithi037.stderr: 7fe475ffb640 / io_context_pool 2024-09-12T17:36:29.562 INFO:tasks.workunit.client.0.smithi037.stderr: 7fe4767fc640 / io_context_pool 2024-09-12T17:36:29.562 INFO:tasks.workunit.client.0.smithi037.stderr: 7fe47ce01640 / ms_dispatch 2024-09-12T17:36:29.562 INFO:tasks.workunit.client.0.smithi037.stderr: 7fe47f606640 / ms_dispatch 2024-09-12T17:36:29.562 INFO:tasks.workunit.client.0.smithi037.stderr: 7fe480e09640 / io_context_pool 2024-09-12T17:36:29.562 INFO:tasks.workunit.client.0.smithi037.stderr: 7fe58a352640 / msgr-worker-2 2024-09-12T17:36:29.562 INFO:tasks.workunit.client.0.smithi037.stderr: 7fe592b53640 / msgr-worker-1 2024-09-12T17:36:29.563 INFO:tasks.workunit.client.0.smithi037.stderr: 7fe593354640 / msgr-worker-0 2024-09-12T17:36:29.563 INFO:tasks.workunit.client.0.smithi037.stderr: 7fe593b55640 / io_context_pool 2024-09-12T17:36:29.563 INFO:tasks.workunit.client.0.smithi037.stderr: 7fe597832800 / radosgw-admin 2024-09-12T17:36:29.563 INFO:tasks.workunit.client.0.smithi037.stderr: max_recent 500 2024-09-12T17:36:29.563 INFO:tasks.workunit.client.0.smithi037.stderr: max_new 1000 2024-09-12T17:36:29.563 INFO:tasks.workunit.client.0.smithi037.stderr: log_file /var/log/ceph/ceph-client.admin.142613.log 2024-09-12T17:36:29.563 INFO:tasks.workunit.client.0.smithi037.stderr:--- end dump of recent events --- 2024-09-12T17:36:29.563 INFO:tasks.workunit.client.0.smithi037.stderr:--- begin dump of recent events --- 2024-09-12T17:36:29.563 INFO:tasks.workunit.client.0.smithi037.stderr: -499> 2024-09-12T17:36:29.205+0000 7fe597832800 5 AuthRegistry(0x556f1730afc0) adding con mode: crc 2024-09-12T17:36:29.563 INFO:tasks.workunit.client.0.smithi037.stderr: -498> 2024-09-12T17:36:29.205+0000 7fe597832800 5 AuthRegistry(0x556f1730afc0) adding con mode: secure 2024-09-12T17:36:29.563 INFO:tasks.workunit.client.0.smithi037.stderr: -497> 2024-09-12T17:36:29.205+0000 7fe597832800 5 AuthRegistry(0x556f1730afc0) adding con mode: crc 2024-09-12T17:36:29.563 INFO:tasks.workunit.client.0.smithi037.stderr: -496> 2024-09-12T17:36:29.205+0000 7fe597832800 5 AuthRegistry(0x556f1730afc0) adding con mode: crc 2024-09-12T17:36:29.563 INFO:tasks.workunit.client.0.smithi037.stderr: -495> 2024-09-12T17:36:29.205+0000 7fe597832800 5 AuthRegistry(0x556f1730afc0) adding con mode: secure 2024-09-12T17:36:29.564 INFO:tasks.workunit.client.0.smithi037.stderr: -494> 2024-09-12T17:36:29.205+0000 7fe597832800 5 AuthRegistry(0x556f1730afc0) adding con mode: crc 2024-09-12T17:36:29.564 INFO:tasks.workunit.client.0.smithi037.stderr: -493> 2024-09-12T17:36:29.205+0000 7fe597832800 5 AuthRegistry(0x556f1730afc0) adding con mode: secure 2024-09-12T17:36:29.564 INFO:tasks.workunit.client.0.smithi037.stderr: -492> 2024-09-12T17:36:29.205+0000 7fe597832800 5 AuthRegistry(0x556f1730afc0) adding con mode: crc 2024-09-12T17:36:29.564 INFO:tasks.workunit.client.0.smithi037.stderr: -491> 2024-09-12T17:36:29.205+0000 7fe597832800 5 AuthRegistry(0x556f1730afc0) adding con mode: secure 2024-09-12T17:36:29.564 INFO:tasks.workunit.client.0.smithi037.stderr: -490> 2024-09-12T17:36:29.205+0000 7fe597832800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:36:29.564 INFO:tasks.workunit.client.0.smithi037.stderr: -489> 2024-09-12T17:36:29.206+0000 7fe597832800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:36:29.564 INFO:tasks.workunit.client.0.smithi037.stderr: -488> 2024-09-12T17:36:29.206+0000 7fe597832800 5 asok(0x556f170e8730) register_command rotate-key hook 0x556f1730b108 2024-09-12T17:36:29.564 INFO:tasks.workunit.client.0.smithi037.stderr: -487> 2024-09-12T17:36:29.206+0000 7fe597832800 10 monclient: _reopen_session rank -1 2024-09-12T17:36:29.564 INFO:tasks.workunit.client.0.smithi037.stderr: -486> 2024-09-12T17:36:29.206+0000 7fe597832800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T17:36:29.564 INFO:tasks.workunit.client.0.smithi037.stderr: -485> 2024-09-12T17:36:29.206+0000 7fe597832800 10 monclient(hunting): picked mon.noname-c con 0x556f171b8650 addr [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] 2024-09-12T17:36:29.564 INFO:tasks.workunit.client.0.smithi037.stderr: -484> 2024-09-12T17:36:29.206+0000 7fe597832800 10 monclient(hunting): picked mon.noname-a con 0x556f1724df90 addr [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] 2024-09-12T17:36:29.564 INFO:tasks.workunit.client.0.smithi037.stderr: -483> 2024-09-12T17:36:29.206+0000 7fe597832800 10 monclient(hunting): picked mon.noname-b con 0x556f17254460 addr [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] 2024-09-12T17:36:29.564 INFO:tasks.workunit.client.0.smithi037.stderr: -482> 2024-09-12T17:36:29.206+0000 7fe597832800 10 monclient(hunting): start opening mon connection 2024-09-12T17:36:29.564 INFO:tasks.workunit.client.0.smithi037.stderr: -481> 2024-09-12T17:36:29.206+0000 7fe597832800 10 monclient(hunting): start opening mon connection 2024-09-12T17:36:29.565 INFO:tasks.workunit.client.0.smithi037.stderr: -480> 2024-09-12T17:36:29.206+0000 7fe597832800 10 monclient(hunting): start opening mon connection 2024-09-12T17:36:29.565 INFO:tasks.workunit.client.0.smithi037.stderr: -479> 2024-09-12T17:36:29.206+0000 7fe597832800 10 monclient(hunting): _renew_subs 2024-09-12T17:36:29.565 INFO:tasks.workunit.client.0.smithi037.stderr: -478> 2024-09-12T17:36:29.206+0000 7fe597832800 10 monclient(hunting): authenticate will time out at 2376.803261s 2024-09-12T17:36:29.565 INFO:tasks.workunit.client.0.smithi037.stderr: -477> 2024-09-12T17:36:29.206+0000 7fe58a352640 10 monclient(hunting): get_auth_request con 0x556f1724df90 auth_method 0 2024-09-12T17:36:29.565 INFO:tasks.workunit.client.0.smithi037.stderr: -476> 2024-09-12T17:36:29.206+0000 7fe58a352640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:36:29.565 INFO:tasks.workunit.client.0.smithi037.stderr: -475> 2024-09-12T17:36:29.206+0000 7fe58a352640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:36:29.565 INFO:tasks.workunit.client.0.smithi037.stderr: -474> 2024-09-12T17:36:29.206+0000 7fe58a352640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:36:29.565 INFO:tasks.workunit.client.0.smithi037.stderr: -473> 2024-09-12T17:36:29.206+0000 7fe592b53640 10 monclient(hunting): get_auth_request con 0x556f171b8650 auth_method 0 2024-09-12T17:36:29.565 INFO:tasks.workunit.client.0.smithi037.stderr: -472> 2024-09-12T17:36:29.206+0000 7fe592b53640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:36:29.565 INFO:tasks.workunit.client.0.smithi037.stderr: -471> 2024-09-12T17:36:29.206+0000 7fe592b53640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:36:29.565 INFO:tasks.workunit.client.0.smithi037.stderr: -470> 2024-09-12T17:36:29.206+0000 7fe592b53640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:36:29.565 INFO:tasks.workunit.client.0.smithi037.stderr: -469> 2024-09-12T17:36:29.206+0000 7fe58a352640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:36:29.565 INFO:tasks.workunit.client.0.smithi037.stderr: -468> 2024-09-12T17:36:29.206+0000 7fe58a352640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:36:29.566 INFO:tasks.workunit.client.0.smithi037.stderr: -467> 2024-09-12T17:36:29.206+0000 7fe58a352640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:36:29.566 INFO:tasks.workunit.client.0.smithi037.stderr: -466> 2024-09-12T17:36:29.206+0000 7fe593354640 10 monclient(hunting): get_auth_request con 0x556f17254460 auth_method 0 2024-09-12T17:36:29.566 INFO:tasks.workunit.client.0.smithi037.stderr: -465> 2024-09-12T17:36:29.206+0000 7fe593354640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:36:29.566 INFO:tasks.workunit.client.0.smithi037.stderr: -464> 2024-09-12T17:36:29.206+0000 7fe593354640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:36:29.566 INFO:tasks.workunit.client.0.smithi037.stderr: -463> 2024-09-12T17:36:29.206+0000 7fe593354640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:36:29.566 INFO:tasks.workunit.client.0.smithi037.stderr: -462> 2024-09-12T17:36:29.206+0000 7fe592b53640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:36:29.566 INFO:tasks.workunit.client.0.smithi037.stderr: -461> 2024-09-12T17:36:29.206+0000 7fe592b53640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:36:29.566 INFO:tasks.workunit.client.0.smithi037.stderr: -460> 2024-09-12T17:36:29.206+0000 7fe592b53640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:36:29.566 INFO:tasks.workunit.client.0.smithi037.stderr: -459> 2024-09-12T17:36:29.206+0000 7fe593354640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:36:29.567 INFO:tasks.workunit.client.0.smithi037.stderr: -458> 2024-09-12T17:36:29.206+0000 7fe593354640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:36:29.567 INFO:tasks.workunit.client.0.smithi037.stderr: -457> 2024-09-12T17:36:29.206+0000 7fe593354640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:36:29.567 INFO:tasks.workunit.client.0.smithi037.stderr: -456> 2024-09-12T17:36:29.206+0000 7fe58a352640 10 monclient(hunting): handle_auth_done global_id 8025 payload 824 2024-09-12T17:36:29.567 INFO:tasks.workunit.client.0.smithi037.stderr: -455> 2024-09-12T17:36:29.206+0000 7fe58a352640 10 monclient: _finish_hunting 0 2024-09-12T17:36:29.567 INFO:tasks.workunit.client.0.smithi037.stderr: -454> 2024-09-12T17:36:29.206+0000 7fe58a352640 1 monclient: found mon.noname-a 2024-09-12T17:36:29.567 INFO:tasks.workunit.client.0.smithi037.stderr: -453> 2024-09-12T17:36:29.206+0000 7fe58a352640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.37:3300/0 2024-09-12T17:36:29.567 INFO:tasks.workunit.client.0.smithi037.stderr: -452> 2024-09-12T17:36:29.206+0000 7fe47f606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:36:29.567 INFO:tasks.workunit.client.0.smithi037.stderr: -451> 2024-09-12T17:36:29.206+0000 7fe47f606640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:36:29.567 INFO:tasks.workunit.client.0.smithi037.stderr: -450> 2024-09-12T17:36:29.206+0000 7fe47f606640 10 monclient: dump: 2024-09-12T17:36:29.567 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:36:29.567 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:36:29.567 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:36:29.568 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:36:29.568 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:36:29.568 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:36:29.568 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:36:29.568 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:36:29.568 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:36:29.568 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:36:29.568 INFO:tasks.workunit.client.0.smithi037.stderr: -449> 2024-09-12T17:36:29.206+0000 7fe47f606640 10 monclient: _finish_auth 0 2024-09-12T17:36:29.568 INFO:tasks.workunit.client.0.smithi037.stderr: -448> 2024-09-12T17:36:29.206+0000 7fe47f606640 10 monclient: _check_auth_tickets 2024-09-12T17:36:29.568 INFO:tasks.workunit.client.0.smithi037.stderr: -447> 2024-09-12T17:36:29.206+0000 7fe47f606640 10 monclient: handle_config config(0 keys) 2024-09-12T17:36:29.568 INFO:tasks.workunit.client.0.smithi037.stderr: -446> 2024-09-12T17:36:29.206+0000 7fe47f606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:36:29.569 INFO:tasks.workunit.client.0.smithi037.stderr: -445> 2024-09-12T17:36:29.206+0000 7fe47f606640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:36:29.569 INFO:tasks.workunit.client.0.smithi037.stderr: -444> 2024-09-12T17:36:29.206+0000 7fe47f606640 10 monclient: dump: 2024-09-12T17:36:29.569 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:36:29.569 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:36:29.569 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:36:29.569 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:36:29.569 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:36:29.569 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:36:29.569 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:36:29.569 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:36:29.569 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:36:29.569 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:36:29.569 INFO:tasks.workunit.client.0.smithi037.stderr: -443> 2024-09-12T17:36:29.206+0000 7fe597832800 5 monclient: authenticate success, global_id 8025 2024-09-12T17:36:29.569 INFO:tasks.workunit.client.0.smithi037.stderr: -442> 2024-09-12T17:36:29.206+0000 7fe597832800 10 monclient: _renew_subs 2024-09-12T17:36:29.570 INFO:tasks.workunit.client.0.smithi037.stderr: -441> 2024-09-12T17:36:29.206+0000 7fe597832800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.37:3300/0 2024-09-12T17:36:29.570 INFO:tasks.workunit.client.0.smithi037.stderr: -440> 2024-09-12T17:36:29.206+0000 7fe480e09640 4 set_mon_vals no callback set 2024-09-12T17:36:29.570 INFO:tasks.workunit.client.0.smithi037.stderr: -439> 2024-09-12T17:36:29.207+0000 7fe597832800 10 monclient: _renew_subs 2024-09-12T17:36:29.570 INFO:tasks.workunit.client.0.smithi037.stderr: -438> 2024-09-12T17:36:29.207+0000 7fe597832800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.37:3300/0 2024-09-12T17:36:29.570 INFO:tasks.workunit.client.0.smithi037.stderr: -437> 2024-09-12T17:36:29.207+0000 7fe597832800 1 librados: init done 2024-09-12T17:36:29.570 INFO:tasks.workunit.client.0.smithi037.stderr: -436> 2024-09-12T17:36:29.209+0000 7fe47f606640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:36:29.570 INFO:tasks.workunit.client.0.smithi037.stderr: -435> 2024-09-12T17:36:29.209+0000 7fe47f606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.40:6816/3916250676,v1:172.21.15.40:6817/3916250676] 2024-09-12T17:36:29.570 INFO:tasks.workunit.client.0.smithi037.stderr: -434> 2024-09-12T17:36:29.209+0000 7fe47f606640 4 mgrc reconnect Starting new session with [v2:172.21.15.40:6816/3916250676,v1:172.21.15.40:6817/3916250676] 2024-09-12T17:36:29.570 INFO:tasks.workunit.client.0.smithi037.stderr: -433> 2024-09-12T17:36:29.209+0000 7fe592b53640 10 monclient: get_auth_request con 0x7fe4780764a0 auth_method 0 2024-09-12T17:36:29.570 INFO:tasks.workunit.client.0.smithi037.stderr: -432> 2024-09-12T17:36:29.209+0000 7fe593354640 10 monclient: get_auth_request con 0x556f17333490 auth_method 0 2024-09-12T17:36:29.570 INFO:tasks.workunit.client.0.smithi037.stderr: -431> 2024-09-12T17:36:29.210+0000 7fe592b53640 10 monclient: get_auth_request con 0x556f17356480 auth_method 0 2024-09-12T17:36:29.570 INFO:tasks.workunit.client.0.smithi037.stderr: -430> 2024-09-12T17:36:29.212+0000 7fe58a352640 10 monclient: get_auth_request con 0x556f17359ce0 auth_method 0 2024-09-12T17:36:29.570 INFO:tasks.workunit.client.0.smithi037.stderr: -429> 2024-09-12T17:36:29.213+0000 7fe597832800 10 monclient: build_initial_monmap 2024-09-12T17:36:29.571 INFO:tasks.workunit.client.0.smithi037.stderr: -428> 2024-09-12T17:36:29.213+0000 7fe597832800 1 build_initial for_mkfs: 0 2024-09-12T17:36:29.571 INFO:tasks.workunit.client.0.smithi037.stderr: -427> 2024-09-12T17:36:29.213+0000 7fe597832800 10 monclient: monmap: 2024-09-12T17:36:29.571 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 0 2024-09-12T17:36:29.571 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:36:29.571 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 0.000000 2024-09-12T17:36:29.571 INFO:tasks.workunit.client.0.smithi037.stderr:created 0.000000 2024-09-12T17:36:29.571 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 0 (unknown) 2024-09-12T17:36:29.571 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:36:29.571 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.noname-a 2024-09-12T17:36:29.571 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.noname-b 2024-09-12T17:36:29.571 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.noname-c 2024-09-12T17:36:29.571 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:36:29.571 INFO:tasks.workunit.client.0.smithi037.stderr: -426> 2024-09-12T17:36:29.213+0000 7fe597832800 5 AuthRegistry(0x556f1735f5f0) adding auth protocol: cephx 2024-09-12T17:36:29.571 INFO:tasks.workunit.client.0.smithi037.stderr: -425> 2024-09-12T17:36:29.213+0000 7fe597832800 5 AuthRegistry(0x556f1735f5f0) adding auth protocol: cephx 2024-09-12T17:36:29.572 INFO:tasks.workunit.client.0.smithi037.stderr: -424> 2024-09-12T17:36:29.213+0000 7fe597832800 5 AuthRegistry(0x556f1735f5f0) adding auth protocol: cephx 2024-09-12T17:36:29.572 INFO:tasks.workunit.client.0.smithi037.stderr: -423> 2024-09-12T17:36:29.213+0000 7fe597832800 5 AuthRegistry(0x556f1735f5f0) adding con mode: secure 2024-09-12T17:36:29.572 INFO:tasks.workunit.client.0.smithi037.stderr: -422> 2024-09-12T17:36:29.213+0000 7fe597832800 5 AuthRegistry(0x556f1735f5f0) adding con mode: crc 2024-09-12T17:36:29.572 INFO:tasks.workunit.client.0.smithi037.stderr: -421> 2024-09-12T17:36:29.213+0000 7fe597832800 5 AuthRegistry(0x556f1735f5f0) adding con mode: secure 2024-09-12T17:36:29.572 INFO:tasks.workunit.client.0.smithi037.stderr: -420> 2024-09-12T17:36:29.213+0000 7fe597832800 5 AuthRegistry(0x556f1735f5f0) adding con mode: crc 2024-09-12T17:36:29.572 INFO:tasks.workunit.client.0.smithi037.stderr: -419> 2024-09-12T17:36:29.213+0000 7fe597832800 5 AuthRegistry(0x556f1735f5f0) adding con mode: secure 2024-09-12T17:36:29.572 INFO:tasks.workunit.client.0.smithi037.stderr: -418> 2024-09-12T17:36:29.213+0000 7fe597832800 5 AuthRegistry(0x556f1735f5f0) adding con mode: crc 2024-09-12T17:36:29.572 INFO:tasks.workunit.client.0.smithi037.stderr: -417> 2024-09-12T17:36:29.213+0000 7fe597832800 5 AuthRegistry(0x556f1735f5f0) adding con mode: crc 2024-09-12T17:36:29.572 INFO:tasks.workunit.client.0.smithi037.stderr: -416> 2024-09-12T17:36:29.213+0000 7fe597832800 5 AuthRegistry(0x556f1735f5f0) adding con mode: secure 2024-09-12T17:36:29.572 INFO:tasks.workunit.client.0.smithi037.stderr: -415> 2024-09-12T17:36:29.213+0000 7fe597832800 5 AuthRegistry(0x556f1735f5f0) adding con mode: crc 2024-09-12T17:36:29.572 INFO:tasks.workunit.client.0.smithi037.stderr: -414> 2024-09-12T17:36:29.213+0000 7fe597832800 5 AuthRegistry(0x556f1735f5f0) adding con mode: secure 2024-09-12T17:36:29.572 INFO:tasks.workunit.client.0.smithi037.stderr: -413> 2024-09-12T17:36:29.213+0000 7fe597832800 5 AuthRegistry(0x556f1735f5f0) adding con mode: crc 2024-09-12T17:36:29.573 INFO:tasks.workunit.client.0.smithi037.stderr: -412> 2024-09-12T17:36:29.213+0000 7fe597832800 5 AuthRegistry(0x556f1735f5f0) adding con mode: secure 2024-09-12T17:36:29.573 INFO:tasks.workunit.client.0.smithi037.stderr: -411> 2024-09-12T17:36:29.213+0000 7fe597832800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:36:29.573 INFO:tasks.workunit.client.0.smithi037.stderr: -410> 2024-09-12T17:36:29.213+0000 7fe597832800 5 asok(0x556f170e8730) register_command objecter_requests cmddesc objecter_requests hook 0x556f17362fa0 EEXIST 2024-09-12T17:36:29.573 INFO:tasks.workunit.client.0.smithi037.stderr: -409> 2024-09-12T17:36:29.213+0000 7fe597832800 10 monclient: init 2024-09-12T17:36:29.573 INFO:tasks.workunit.client.0.smithi037.stderr: -408> 2024-09-12T17:36:29.213+0000 7fe597832800 5 AuthRegistry(0x556f1735e5a8) adding auth protocol: cephx 2024-09-12T17:36:29.573 INFO:tasks.workunit.client.0.smithi037.stderr: -407> 2024-09-12T17:36:29.213+0000 7fe597832800 5 AuthRegistry(0x556f1735e5a8) adding auth protocol: cephx 2024-09-12T17:36:29.573 INFO:tasks.workunit.client.0.smithi037.stderr: -406> 2024-09-12T17:36:29.213+0000 7fe597832800 5 AuthRegistry(0x556f1735e5a8) adding auth protocol: cephx 2024-09-12T17:36:29.573 INFO:tasks.workunit.client.0.smithi037.stderr: -405> 2024-09-12T17:36:29.213+0000 7fe597832800 5 AuthRegistry(0x556f1735e5a8) adding con mode: secure 2024-09-12T17:36:29.573 INFO:tasks.workunit.client.0.smithi037.stderr: -404> 2024-09-12T17:36:29.213+0000 7fe597832800 5 AuthRegistry(0x556f1735e5a8) adding con mode: crc 2024-09-12T17:36:29.573 INFO:tasks.workunit.client.0.smithi037.stderr: -403> 2024-09-12T17:36:29.213+0000 7fe597832800 5 AuthRegistry(0x556f1735e5a8) adding con mode: secure 2024-09-12T17:36:29.573 INFO:tasks.workunit.client.0.smithi037.stderr: -402> 2024-09-12T17:36:29.213+0000 7fe597832800 5 AuthRegistry(0x556f1735e5a8) adding con mode: crc 2024-09-12T17:36:29.573 INFO:tasks.workunit.client.0.smithi037.stderr: -401> 2024-09-12T17:36:29.213+0000 7fe597832800 5 AuthRegistry(0x556f1735e5a8) adding con mode: secure 2024-09-12T17:36:29.573 INFO:tasks.workunit.client.0.smithi037.stderr: -400> 2024-09-12T17:36:29.213+0000 7fe597832800 5 AuthRegistry(0x556f1735e5a8) adding con mode: crc 2024-09-12T17:36:29.573 INFO:tasks.workunit.client.0.smithi037.stderr: -399> 2024-09-12T17:36:29.213+0000 7fe597832800 5 AuthRegistry(0x556f1735e5a8) adding con mode: crc 2024-09-12T17:36:29.574 INFO:tasks.workunit.client.0.smithi037.stderr: -398> 2024-09-12T17:36:29.213+0000 7fe597832800 5 AuthRegistry(0x556f1735e5a8) adding con mode: secure 2024-09-12T17:36:29.574 INFO:tasks.workunit.client.0.smithi037.stderr: -397> 2024-09-12T17:36:29.213+0000 7fe597832800 5 AuthRegistry(0x556f1735e5a8) adding con mode: crc 2024-09-12T17:36:29.574 INFO:tasks.workunit.client.0.smithi037.stderr: -396> 2024-09-12T17:36:29.213+0000 7fe597832800 5 AuthRegistry(0x556f1735e5a8) adding con mode: secure 2024-09-12T17:36:29.574 INFO:tasks.workunit.client.0.smithi037.stderr: -395> 2024-09-12T17:36:29.213+0000 7fe597832800 5 AuthRegistry(0x556f1735e5a8) adding con mode: crc 2024-09-12T17:36:29.574 INFO:tasks.workunit.client.0.smithi037.stderr: -394> 2024-09-12T17:36:29.213+0000 7fe597832800 5 AuthRegistry(0x556f1735e5a8) adding con mode: secure 2024-09-12T17:36:29.574 INFO:tasks.workunit.client.0.smithi037.stderr: -393> 2024-09-12T17:36:29.213+0000 7fe597832800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:36:29.574 INFO:tasks.workunit.client.0.smithi037.stderr: -392> 2024-09-12T17:36:29.214+0000 7fe597832800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:36:29.574 INFO:tasks.workunit.client.0.smithi037.stderr: -391> 2024-09-12T17:36:29.214+0000 7fe597832800 5 asok(0x556f170e8730) register_command rotate-key cmddesc rotate-key hook 0x556f1735e6f0 EEXIST 2024-09-12T17:36:29.574 INFO:tasks.workunit.client.0.smithi037.stderr: -390> 2024-09-12T17:36:29.214+0000 7fe597832800 10 monclient: _reopen_session rank -1 2024-09-12T17:36:29.574 INFO:tasks.workunit.client.0.smithi037.stderr: -389> 2024-09-12T17:36:29.214+0000 7fe597832800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T17:36:29.575 INFO:tasks.workunit.client.0.smithi037.stderr: -388> 2024-09-12T17:36:29.214+0000 7fe597832800 10 monclient(hunting): picked mon.noname-c con 0x556f17386c90 addr [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] 2024-09-12T17:36:29.575 INFO:tasks.workunit.client.0.smithi037.stderr: -387> 2024-09-12T17:36:29.214+0000 7fe597832800 10 monclient(hunting): picked mon.noname-b con 0x556f17388f60 addr [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] 2024-09-12T17:36:29.575 INFO:tasks.workunit.client.0.smithi037.stderr: -386> 2024-09-12T17:36:29.214+0000 7fe597832800 10 monclient(hunting): picked mon.noname-a con 0x556f17385460 addr [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] 2024-09-12T17:36:29.575 INFO:tasks.workunit.client.0.smithi037.stderr: -385> 2024-09-12T17:36:29.214+0000 7fe597832800 10 monclient(hunting): start opening mon connection 2024-09-12T17:36:29.575 INFO:tasks.workunit.client.0.smithi037.stderr: -384> 2024-09-12T17:36:29.214+0000 7fe597832800 10 monclient(hunting): start opening mon connection 2024-09-12T17:36:29.575 INFO:tasks.workunit.client.0.smithi037.stderr: -383> 2024-09-12T17:36:29.214+0000 7fe597832800 10 monclient(hunting): start opening mon connection 2024-09-12T17:36:29.575 INFO:tasks.workunit.client.0.smithi037.stderr: -382> 2024-09-12T17:36:29.214+0000 7fe597832800 10 monclient(hunting): _renew_subs 2024-09-12T17:36:29.575 INFO:tasks.workunit.client.0.smithi037.stderr: -381> 2024-09-12T17:36:29.214+0000 7fe597832800 10 monclient(hunting): authenticate will time out at 2376.811295s 2024-09-12T17:36:29.575 INFO:tasks.workunit.client.0.smithi037.stderr: -380> 2024-09-12T17:36:29.214+0000 7fe593354640 10 monclient(hunting): get_auth_request con 0x556f17385460 auth_method 0 2024-09-12T17:36:29.575 INFO:tasks.workunit.client.0.smithi037.stderr: -379> 2024-09-12T17:36:29.214+0000 7fe593354640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:36:29.575 INFO:tasks.workunit.client.0.smithi037.stderr: -378> 2024-09-12T17:36:29.214+0000 7fe593354640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:36:29.575 INFO:tasks.workunit.client.0.smithi037.stderr: -377> 2024-09-12T17:36:29.214+0000 7fe593354640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:36:29.575 INFO:tasks.workunit.client.0.smithi037.stderr: -376> 2024-09-12T17:36:29.214+0000 7fe592b53640 10 monclient(hunting): get_auth_request con 0x556f17386c90 auth_method 0 2024-09-12T17:36:29.576 INFO:tasks.workunit.client.0.smithi037.stderr: -375> 2024-09-12T17:36:29.214+0000 7fe592b53640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:36:29.576 INFO:tasks.workunit.client.0.smithi037.stderr: -374> 2024-09-12T17:36:29.214+0000 7fe592b53640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:36:29.576 INFO:tasks.workunit.client.0.smithi037.stderr: -373> 2024-09-12T17:36:29.214+0000 7fe592b53640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:36:29.576 INFO:tasks.workunit.client.0.smithi037.stderr: -372> 2024-09-12T17:36:29.214+0000 7fe58a352640 10 monclient(hunting): get_auth_request con 0x556f17388f60 auth_method 0 2024-09-12T17:36:29.576 INFO:tasks.workunit.client.0.smithi037.stderr: -371> 2024-09-12T17:36:29.214+0000 7fe58a352640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:36:29.576 INFO:tasks.workunit.client.0.smithi037.stderr: -370> 2024-09-12T17:36:29.214+0000 7fe58a352640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:36:29.576 INFO:tasks.workunit.client.0.smithi037.stderr: -369> 2024-09-12T17:36:29.214+0000 7fe58a352640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:36:29.576 INFO:tasks.workunit.client.0.smithi037.stderr: -368> 2024-09-12T17:36:29.214+0000 7fe593354640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:36:29.576 INFO:tasks.workunit.client.0.smithi037.stderr: -367> 2024-09-12T17:36:29.214+0000 7fe593354640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:36:29.576 INFO:tasks.workunit.client.0.smithi037.stderr: -366> 2024-09-12T17:36:29.214+0000 7fe593354640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:36:29.576 INFO:tasks.workunit.client.0.smithi037.stderr: -365> 2024-09-12T17:36:29.214+0000 7fe592b53640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:36:29.576 INFO:tasks.workunit.client.0.smithi037.stderr: -364> 2024-09-12T17:36:29.214+0000 7fe592b53640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:36:29.577 INFO:tasks.workunit.client.0.smithi037.stderr: -363> 2024-09-12T17:36:29.214+0000 7fe592b53640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:36:29.577 INFO:tasks.workunit.client.0.smithi037.stderr: -362> 2024-09-12T17:36:29.214+0000 7fe58a352640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:36:29.577 INFO:tasks.workunit.client.0.smithi037.stderr: -361> 2024-09-12T17:36:29.214+0000 7fe58a352640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:36:29.577 INFO:tasks.workunit.client.0.smithi037.stderr: -360> 2024-09-12T17:36:29.214+0000 7fe58a352640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:36:29.577 INFO:tasks.workunit.client.0.smithi037.stderr: -359> 2024-09-12T17:36:29.214+0000 7fe593354640 10 monclient(hunting): handle_auth_done global_id 8028 payload 824 2024-09-12T17:36:29.577 INFO:tasks.workunit.client.0.smithi037.stderr: -358> 2024-09-12T17:36:29.214+0000 7fe593354640 10 monclient: _finish_hunting 0 2024-09-12T17:36:29.577 INFO:tasks.workunit.client.0.smithi037.stderr: -357> 2024-09-12T17:36:29.214+0000 7fe593354640 1 monclient: found mon.noname-a 2024-09-12T17:36:29.577 INFO:tasks.workunit.client.0.smithi037.stderr: -356> 2024-09-12T17:36:29.214+0000 7fe593354640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.37:3300/0 2024-09-12T17:36:29.577 INFO:tasks.workunit.client.0.smithi037.stderr: -355> 2024-09-12T17:36:29.215+0000 7fe47ce01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:36:29.577 INFO:tasks.workunit.client.0.smithi037.stderr: -354> 2024-09-12T17:36:29.215+0000 7fe47ce01640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:36:29.577 INFO:tasks.workunit.client.0.smithi037.stderr: -353> 2024-09-12T17:36:29.215+0000 7fe47ce01640 10 monclient: dump: 2024-09-12T17:36:29.577 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:36:29.577 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:36:29.577 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:36:29.578 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:36:29.578 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:36:29.578 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:36:29.578 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:36:29.578 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:36:29.578 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:36:29.578 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:36:29.578 INFO:tasks.workunit.client.0.smithi037.stderr: -352> 2024-09-12T17:36:29.215+0000 7fe47ce01640 10 monclient: _finish_auth 0 2024-09-12T17:36:29.578 INFO:tasks.workunit.client.0.smithi037.stderr: -351> 2024-09-12T17:36:29.215+0000 7fe47ce01640 10 monclient: _check_auth_tickets 2024-09-12T17:36:29.578 INFO:tasks.workunit.client.0.smithi037.stderr: -350> 2024-09-12T17:36:29.215+0000 7fe47ce01640 10 monclient: handle_config config(0 keys) 2024-09-12T17:36:29.579 INFO:tasks.workunit.client.0.smithi037.stderr: -349> 2024-09-12T17:36:29.215+0000 7fe47ce01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:36:29.579 INFO:tasks.workunit.client.0.smithi037.stderr: -348> 2024-09-12T17:36:29.215+0000 7fe47ce01640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:36:29.579 INFO:tasks.workunit.client.0.smithi037.stderr: -347> 2024-09-12T17:36:29.215+0000 7fe47ce01640 10 monclient: dump: 2024-09-12T17:36:29.579 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:36:29.579 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:36:29.579 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:36:29.579 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:36:29.579 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:36:29.579 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:36:29.579 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:36:29.579 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:36:29.579 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:36:29.579 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:36:29.580 INFO:tasks.workunit.client.0.smithi037.stderr: -346> 2024-09-12T17:36:29.215+0000 7fe593b55640 4 set_mon_vals no callback set 2024-09-12T17:36:29.580 INFO:tasks.workunit.client.0.smithi037.stderr: -345> 2024-09-12T17:36:29.215+0000 7fe597832800 5 monclient: authenticate success, global_id 8028 2024-09-12T17:36:29.580 INFO:tasks.workunit.client.0.smithi037.stderr: -344> 2024-09-12T17:36:29.215+0000 7fe597832800 10 monclient: _renew_subs 2024-09-12T17:36:29.580 INFO:tasks.workunit.client.0.smithi037.stderr: -343> 2024-09-12T17:36:29.215+0000 7fe597832800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.37:3300/0 2024-09-12T17:36:29.580 INFO:tasks.workunit.client.0.smithi037.stderr: -342> 2024-09-12T17:36:29.215+0000 7fe597832800 10 monclient: _renew_subs 2024-09-12T17:36:29.580 INFO:tasks.workunit.client.0.smithi037.stderr: -341> 2024-09-12T17:36:29.215+0000 7fe597832800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.37:3300/0 2024-09-12T17:36:29.580 INFO:tasks.workunit.client.0.smithi037.stderr: -340> 2024-09-12T17:36:29.217+0000 7fe47ce01640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:36:29.580 INFO:tasks.workunit.client.0.smithi037.stderr: -339> 2024-09-12T17:36:29.217+0000 7fe47ce01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.40:6816/3916250676,v1:172.21.15.40:6817/3916250676] 2024-09-12T17:36:29.580 INFO:tasks.workunit.client.0.smithi037.stderr: -338> 2024-09-12T17:36:29.217+0000 7fe47ce01640 4 mgrc reconnect Starting new session with [v2:172.21.15.40:6816/3916250676,v1:172.21.15.40:6817/3916250676] 2024-09-12T17:36:29.580 INFO:tasks.workunit.client.0.smithi037.stderr: -337> 2024-09-12T17:36:29.217+0000 7fe592b53640 10 monclient: get_auth_request con 0x7fe46c07a790 auth_method 0 2024-09-12T17:36:29.580 INFO:tasks.workunit.client.0.smithi037.stderr: -336> 2024-09-12T17:36:29.217+0000 7fe597832800 10 monclient: get_monmap_and_config 2024-09-12T17:36:29.580 INFO:tasks.workunit.client.0.smithi037.stderr: -335> 2024-09-12T17:36:29.217+0000 7fe597832800 10 monclient: build_initial_monmap 2024-09-12T17:36:29.580 INFO:tasks.workunit.client.0.smithi037.stderr: -334> 2024-09-12T17:36:29.217+0000 7fe597832800 1 build_initial for_mkfs: 0 2024-09-12T17:36:29.581 INFO:tasks.workunit.client.0.smithi037.stderr: -333> 2024-09-12T17:36:29.217+0000 7fe597832800 10 monclient: monmap: 2024-09-12T17:36:29.581 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 0 2024-09-12T17:36:29.581 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:36:29.581 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 0.000000 2024-09-12T17:36:29.581 INFO:tasks.workunit.client.0.smithi037.stderr:created 0.000000 2024-09-12T17:36:29.581 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 0 (unknown) 2024-09-12T17:36:29.581 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:36:29.581 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.noname-a 2024-09-12T17:36:29.581 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.noname-b 2024-09-12T17:36:29.581 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.noname-c 2024-09-12T17:36:29.581 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:36:29.581 INFO:tasks.workunit.client.0.smithi037.stderr: -332> 2024-09-12T17:36:29.217+0000 7fe597832800 5 AuthRegistry(0x556f171b6a40) adding auth protocol: cephx 2024-09-12T17:36:29.581 INFO:tasks.workunit.client.0.smithi037.stderr: -331> 2024-09-12T17:36:29.217+0000 7fe597832800 5 AuthRegistry(0x556f171b6a40) adding auth protocol: cephx 2024-09-12T17:36:29.581 INFO:tasks.workunit.client.0.smithi037.stderr: -330> 2024-09-12T17:36:29.217+0000 7fe597832800 5 AuthRegistry(0x556f171b6a40) adding auth protocol: cephx 2024-09-12T17:36:29.582 INFO:tasks.workunit.client.0.smithi037.stderr: -329> 2024-09-12T17:36:29.217+0000 7fe597832800 5 AuthRegistry(0x556f171b6a40) adding con mode: secure 2024-09-12T17:36:29.582 INFO:tasks.workunit.client.0.smithi037.stderr: -328> 2024-09-12T17:36:29.217+0000 7fe597832800 5 AuthRegistry(0x556f171b6a40) adding con mode: crc 2024-09-12T17:36:29.582 INFO:tasks.workunit.client.0.smithi037.stderr: -327> 2024-09-12T17:36:29.217+0000 7fe597832800 5 AuthRegistry(0x556f171b6a40) adding con mode: secure 2024-09-12T17:36:29.582 INFO:tasks.workunit.client.0.smithi037.stderr: -326> 2024-09-12T17:36:29.217+0000 7fe597832800 5 AuthRegistry(0x556f171b6a40) adding con mode: crc 2024-09-12T17:36:29.582 INFO:tasks.workunit.client.0.smithi037.stderr: -325> 2024-09-12T17:36:29.217+0000 7fe597832800 5 AuthRegistry(0x556f171b6a40) adding con mode: secure 2024-09-12T17:36:29.582 INFO:tasks.workunit.client.0.smithi037.stderr: -324> 2024-09-12T17:36:29.217+0000 7fe597832800 5 AuthRegistry(0x556f171b6a40) adding con mode: crc 2024-09-12T17:36:29.582 INFO:tasks.workunit.client.0.smithi037.stderr: -323> 2024-09-12T17:36:29.217+0000 7fe597832800 5 AuthRegistry(0x556f171b6a40) adding con mode: crc 2024-09-12T17:36:29.582 INFO:tasks.workunit.client.0.smithi037.stderr: -322> 2024-09-12T17:36:29.217+0000 7fe597832800 5 AuthRegistry(0x556f171b6a40) adding con mode: secure 2024-09-12T17:36:29.582 INFO:tasks.workunit.client.0.smithi037.stderr: -321> 2024-09-12T17:36:29.217+0000 7fe597832800 5 AuthRegistry(0x556f171b6a40) adding con mode: crc 2024-09-12T17:36:29.582 INFO:tasks.workunit.client.0.smithi037.stderr: -320> 2024-09-12T17:36:29.217+0000 7fe597832800 5 AuthRegistry(0x556f171b6a40) adding con mode: secure 2024-09-12T17:36:29.582 INFO:tasks.workunit.client.0.smithi037.stderr: -319> 2024-09-12T17:36:29.217+0000 7fe597832800 5 AuthRegistry(0x556f171b6a40) adding con mode: crc 2024-09-12T17:36:29.582 INFO:tasks.workunit.client.0.smithi037.stderr: -318> 2024-09-12T17:36:29.217+0000 7fe597832800 5 AuthRegistry(0x556f171b6a40) adding con mode: secure 2024-09-12T17:36:29.583 INFO:tasks.workunit.client.0.smithi037.stderr: -317> 2024-09-12T17:36:29.217+0000 7fe597832800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:36:29.583 INFO:tasks.workunit.client.0.smithi037.stderr: -316> 2024-09-12T17:36:29.217+0000 7fe597832800 10 monclient: init 2024-09-12T17:36:29.583 INFO:tasks.workunit.client.0.smithi037.stderr: -315> 2024-09-12T17:36:29.217+0000 7fe597832800 5 AuthRegistry(0x7ffee1109100) adding auth protocol: cephx 2024-09-12T17:36:29.583 INFO:tasks.workunit.client.0.smithi037.stderr: -314> 2024-09-12T17:36:29.217+0000 7fe597832800 5 AuthRegistry(0x7ffee1109100) adding auth protocol: cephx 2024-09-12T17:36:29.583 INFO:tasks.workunit.client.0.smithi037.stderr: -313> 2024-09-12T17:36:29.217+0000 7fe597832800 5 AuthRegistry(0x7ffee1109100) adding auth protocol: cephx 2024-09-12T17:36:29.583 INFO:tasks.workunit.client.0.smithi037.stderr: -312> 2024-09-12T17:36:29.217+0000 7fe597832800 5 AuthRegistry(0x7ffee1109100) adding con mode: secure 2024-09-12T17:36:29.583 INFO:tasks.workunit.client.0.smithi037.stderr: -311> 2024-09-12T17:36:29.217+0000 7fe597832800 5 AuthRegistry(0x7ffee1109100) adding con mode: crc 2024-09-12T17:36:29.583 INFO:tasks.workunit.client.0.smithi037.stderr: -310> 2024-09-12T17:36:29.217+0000 7fe597832800 5 AuthRegistry(0x7ffee1109100) adding con mode: secure 2024-09-12T17:36:29.583 INFO:tasks.workunit.client.0.smithi037.stderr: -309> 2024-09-12T17:36:29.217+0000 7fe597832800 5 AuthRegistry(0x7ffee1109100) adding con mode: crc 2024-09-12T17:36:29.583 INFO:tasks.workunit.client.0.smithi037.stderr: -308> 2024-09-12T17:36:29.217+0000 7fe597832800 5 AuthRegistry(0x7ffee1109100) adding con mode: secure 2024-09-12T17:36:29.583 INFO:tasks.workunit.client.0.smithi037.stderr: -307> 2024-09-12T17:36:29.217+0000 7fe597832800 5 AuthRegistry(0x7ffee1109100) adding con mode: crc 2024-09-12T17:36:29.583 INFO:tasks.workunit.client.0.smithi037.stderr: -306> 2024-09-12T17:36:29.217+0000 7fe597832800 5 AuthRegistry(0x7ffee1109100) adding con mode: crc 2024-09-12T17:36:29.583 INFO:tasks.workunit.client.0.smithi037.stderr: -305> 2024-09-12T17:36:29.217+0000 7fe597832800 5 AuthRegistry(0x7ffee1109100) adding con mode: secure 2024-09-12T17:36:29.583 INFO:tasks.workunit.client.0.smithi037.stderr: -304> 2024-09-12T17:36:29.217+0000 7fe597832800 5 AuthRegistry(0x7ffee1109100) adding con mode: crc 2024-09-12T17:36:29.584 INFO:tasks.workunit.client.0.smithi037.stderr: -303> 2024-09-12T17:36:29.217+0000 7fe597832800 5 AuthRegistry(0x7ffee1109100) adding con mode: secure 2024-09-12T17:36:29.584 INFO:tasks.workunit.client.0.smithi037.stderr: -302> 2024-09-12T17:36:29.217+0000 7fe597832800 5 AuthRegistry(0x7ffee1109100) adding con mode: crc 2024-09-12T17:36:29.584 INFO:tasks.workunit.client.0.smithi037.stderr: -301> 2024-09-12T17:36:29.217+0000 7fe597832800 5 AuthRegistry(0x7ffee1109100) adding con mode: secure 2024-09-12T17:36:29.584 INFO:tasks.workunit.client.0.smithi037.stderr: -300> 2024-09-12T17:36:29.218+0000 7fe597832800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:36:29.584 INFO:tasks.workunit.client.0.smithi037.stderr: -299> 2024-09-12T17:36:29.218+0000 7fe597832800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:36:29.584 INFO:tasks.workunit.client.0.smithi037.stderr: -298> 2024-09-12T17:36:29.218+0000 7fe597832800 5 asok(0x556f170e8730) register_command rotate-key cmddesc rotate-key hook 0x7ffee1109248 EEXIST 2024-09-12T17:36:29.584 INFO:tasks.workunit.client.0.smithi037.stderr: -297> 2024-09-12T17:36:29.218+0000 7fe597832800 10 monclient: _reopen_session rank -1 2024-09-12T17:36:29.584 INFO:tasks.workunit.client.0.smithi037.stderr: -296> 2024-09-12T17:36:29.218+0000 7fe597832800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T17:36:29.584 INFO:tasks.workunit.client.0.smithi037.stderr: -295> 2024-09-12T17:36:29.218+0000 7fe597832800 10 monclient(hunting): picked mon.noname-c con 0x556f173a8b10 addr [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] 2024-09-12T17:36:29.584 INFO:tasks.workunit.client.0.smithi037.stderr: -294> 2024-09-12T17:36:29.218+0000 7fe597832800 10 monclient(hunting): picked mon.noname-a con 0x556f173d9310 addr [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] 2024-09-12T17:36:29.584 INFO:tasks.workunit.client.0.smithi037.stderr: -293> 2024-09-12T17:36:29.218+0000 7fe597832800 10 monclient(hunting): picked mon.noname-b con 0x556f173d4d10 addr [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] 2024-09-12T17:36:29.584 INFO:tasks.workunit.client.0.smithi037.stderr: -292> 2024-09-12T17:36:29.218+0000 7fe597832800 10 monclient(hunting): start opening mon connection 2024-09-12T17:36:29.585 INFO:tasks.workunit.client.0.smithi037.stderr: -291> 2024-09-12T17:36:29.218+0000 7fe597832800 10 monclient(hunting): start opening mon connection 2024-09-12T17:36:29.585 INFO:tasks.workunit.client.0.smithi037.stderr: -290> 2024-09-12T17:36:29.218+0000 7fe597832800 10 monclient(hunting): start opening mon connection 2024-09-12T17:36:29.585 INFO:tasks.workunit.client.0.smithi037.stderr: -289> 2024-09-12T17:36:29.218+0000 7fe597832800 10 monclient(hunting): _renew_subs 2024-09-12T17:36:29.585 INFO:tasks.workunit.client.0.smithi037.stderr: -288> 2024-09-12T17:36:29.218+0000 7fe597832800 10 monclient(hunting): authenticate will time out at 2376.815401s 2024-09-12T17:36:29.585 INFO:tasks.workunit.client.0.smithi037.stderr: -287> 2024-09-12T17:36:29.218+0000 7fe58a352640 10 monclient(hunting): get_auth_request con 0x556f173d9310 auth_method 0 2024-09-12T17:36:29.585 INFO:tasks.workunit.client.0.smithi037.stderr: -286> 2024-09-12T17:36:29.218+0000 7fe58a352640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:36:29.585 INFO:tasks.workunit.client.0.smithi037.stderr: -285> 2024-09-12T17:36:29.218+0000 7fe58a352640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:36:29.585 INFO:tasks.workunit.client.0.smithi037.stderr: -284> 2024-09-12T17:36:29.218+0000 7fe58a352640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:36:29.585 INFO:tasks.workunit.client.0.smithi037.stderr: -283> 2024-09-12T17:36:29.218+0000 7fe592b53640 10 monclient(hunting): get_auth_request con 0x556f173a8b10 auth_method 0 2024-09-12T17:36:29.585 INFO:tasks.workunit.client.0.smithi037.stderr: -282> 2024-09-12T17:36:29.218+0000 7fe592b53640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:36:29.585 INFO:tasks.workunit.client.0.smithi037.stderr: -281> 2024-09-12T17:36:29.218+0000 7fe592b53640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:36:29.585 INFO:tasks.workunit.client.0.smithi037.stderr: -280> 2024-09-12T17:36:29.218+0000 7fe592b53640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:36:29.585 INFO:tasks.workunit.client.0.smithi037.stderr: -279> 2024-09-12T17:36:29.218+0000 7fe58a352640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:36:29.586 INFO:tasks.workunit.client.0.smithi037.stderr: -278> 2024-09-12T17:36:29.218+0000 7fe58a352640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:36:29.586 INFO:tasks.workunit.client.0.smithi037.stderr: -277> 2024-09-12T17:36:29.218+0000 7fe58a352640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:36:29.586 INFO:tasks.workunit.client.0.smithi037.stderr: -276> 2024-09-12T17:36:29.218+0000 7fe592b53640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:36:29.586 INFO:tasks.workunit.client.0.smithi037.stderr: -275> 2024-09-12T17:36:29.218+0000 7fe592b53640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:36:29.586 INFO:tasks.workunit.client.0.smithi037.stderr: -274> 2024-09-12T17:36:29.218+0000 7fe592b53640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:36:29.586 INFO:tasks.workunit.client.0.smithi037.stderr: -273> 2024-09-12T17:36:29.218+0000 7fe593354640 10 monclient(hunting): get_auth_request con 0x556f173d4d10 auth_method 0 2024-09-12T17:36:29.586 INFO:tasks.workunit.client.0.smithi037.stderr: -272> 2024-09-12T17:36:29.218+0000 7fe593354640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:36:29.586 INFO:tasks.workunit.client.0.smithi037.stderr: -271> 2024-09-12T17:36:29.218+0000 7fe593354640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:36:29.586 INFO:tasks.workunit.client.0.smithi037.stderr: -270> 2024-09-12T17:36:29.218+0000 7fe593354640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:36:29.586 INFO:tasks.workunit.client.0.smithi037.stderr: -269> 2024-09-12T17:36:29.218+0000 7fe58a352640 10 monclient(hunting): handle_auth_done global_id 8031 payload 274 2024-09-12T17:36:29.586 INFO:tasks.workunit.client.0.smithi037.stderr: -268> 2024-09-12T17:36:29.218+0000 7fe58a352640 10 monclient: _finish_hunting 0 2024-09-12T17:36:29.586 INFO:tasks.workunit.client.0.smithi037.stderr: -267> 2024-09-12T17:36:29.218+0000 7fe58a352640 1 monclient: found mon.noname-a 2024-09-12T17:36:29.586 INFO:tasks.workunit.client.0.smithi037.stderr: -266> 2024-09-12T17:36:29.218+0000 7fe58a352640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.37:3300/0 2024-09-12T17:36:29.586 INFO:tasks.workunit.client.0.smithi037.stderr: -265> 2024-09-12T17:36:29.218+0000 7fe4767fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:36:29.587 INFO:tasks.workunit.client.0.smithi037.stderr: -264> 2024-09-12T17:36:29.218+0000 7fe4767fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:36:29.587 INFO:tasks.workunit.client.0.smithi037.stderr: -263> 2024-09-12T17:36:29.218+0000 7fe4767fc640 10 monclient: dump: 2024-09-12T17:36:29.587 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:36:29.587 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:36:29.587 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:36:29.587 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:36:29.587 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:36:29.587 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:36:29.587 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:36:29.587 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:36:29.587 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:36:29.587 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:36:29.587 INFO:tasks.workunit.client.0.smithi037.stderr: -262> 2024-09-12T17:36:29.218+0000 7fe4767fc640 10 monclient: _finish_auth 0 2024-09-12T17:36:29.588 INFO:tasks.workunit.client.0.smithi037.stderr: -261> 2024-09-12T17:36:29.218+0000 7fe4767fc640 10 monclient: _check_auth_tickets 2024-09-12T17:36:29.588 INFO:tasks.workunit.client.0.smithi037.stderr: -260> 2024-09-12T17:36:29.218+0000 7fe4767fc640 10 monclient: handle_config config(0 keys) 2024-09-12T17:36:29.588 INFO:tasks.workunit.client.0.smithi037.stderr: -259> 2024-09-12T17:36:29.218+0000 7fe597832800 5 monclient: authenticate success, global_id 8031 2024-09-12T17:36:29.588 INFO:tasks.workunit.client.0.smithi037.stderr: -258> 2024-09-12T17:36:29.218+0000 7fe597832800 10 monclient: get_monmap_and_config success 2024-09-12T17:36:29.588 INFO:tasks.workunit.client.0.smithi037.stderr: -257> 2024-09-12T17:36:29.218+0000 7fe597832800 4 set_mon_vals no callback set 2024-09-12T17:36:29.588 INFO:tasks.workunit.client.0.smithi037.stderr: -256> 2024-09-12T17:36:29.218+0000 7fe4767fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:36:29.588 INFO:tasks.workunit.client.0.smithi037.stderr: -255> 2024-09-12T17:36:29.218+0000 7fe4767fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:36:29.588 INFO:tasks.workunit.client.0.smithi037.stderr: -254> 2024-09-12T17:36:29.219+0000 7fe4767fc640 10 monclient: dump: 2024-09-12T17:36:29.588 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:36:29.588 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:36:29.588 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:36:29.588 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:36:29.588 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:36:29.588 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:36:29.589 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:36:29.589 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:36:29.589 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:36:29.589 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:36:29.589 INFO:tasks.workunit.client.0.smithi037.stderr: -253> 2024-09-12T17:36:29.219+0000 7fe597832800 10 monclient: shutdown 2024-09-12T17:36:29.589 INFO:tasks.workunit.client.0.smithi037.stderr: -252> 2024-09-12T17:36:29.219+0000 7fe597832800 10 monclient: build_initial_monmap 2024-09-12T17:36:29.589 INFO:tasks.workunit.client.0.smithi037.stderr: -251> 2024-09-12T17:36:29.219+0000 7fe597832800 1 build_initial for_mkfs: 0 2024-09-12T17:36:29.589 INFO:tasks.workunit.client.0.smithi037.stderr: -250> 2024-09-12T17:36:29.219+0000 7fe597832800 10 monclient: monmap: 2024-09-12T17:36:29.589 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 0 2024-09-12T17:36:29.589 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:36:29.589 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 0.000000 2024-09-12T17:36:29.589 INFO:tasks.workunit.client.0.smithi037.stderr:created 0.000000 2024-09-12T17:36:29.589 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 0 (unknown) 2024-09-12T17:36:29.590 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:36:29.590 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.noname-a 2024-09-12T17:36:29.590 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.noname-b 2024-09-12T17:36:29.590 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.noname-c 2024-09-12T17:36:29.590 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:36:29.590 INFO:tasks.workunit.client.0.smithi037.stderr: -249> 2024-09-12T17:36:29.219+0000 7fe597832800 5 AuthRegistry(0x556f173d5290) adding auth protocol: cephx 2024-09-12T17:36:29.590 INFO:tasks.workunit.client.0.smithi037.stderr: -248> 2024-09-12T17:36:29.219+0000 7fe597832800 5 AuthRegistry(0x556f173d5290) adding auth protocol: cephx 2024-09-12T17:36:29.590 INFO:tasks.workunit.client.0.smithi037.stderr: -247> 2024-09-12T17:36:29.219+0000 7fe597832800 5 AuthRegistry(0x556f173d5290) adding auth protocol: cephx 2024-09-12T17:36:29.590 INFO:tasks.workunit.client.0.smithi037.stderr: -246> 2024-09-12T17:36:29.219+0000 7fe597832800 5 AuthRegistry(0x556f173d5290) adding con mode: secure 2024-09-12T17:36:29.590 INFO:tasks.workunit.client.0.smithi037.stderr: -245> 2024-09-12T17:36:29.219+0000 7fe597832800 5 AuthRegistry(0x556f173d5290) adding con mode: crc 2024-09-12T17:36:29.590 INFO:tasks.workunit.client.0.smithi037.stderr: -244> 2024-09-12T17:36:29.219+0000 7fe597832800 5 AuthRegistry(0x556f173d5290) adding con mode: secure 2024-09-12T17:36:29.590 INFO:tasks.workunit.client.0.smithi037.stderr: -243> 2024-09-12T17:36:29.219+0000 7fe597832800 5 AuthRegistry(0x556f173d5290) adding con mode: crc 2024-09-12T17:36:29.590 INFO:tasks.workunit.client.0.smithi037.stderr: -242> 2024-09-12T17:36:29.219+0000 7fe597832800 5 AuthRegistry(0x556f173d5290) adding con mode: secure 2024-09-12T17:36:29.591 INFO:tasks.workunit.client.0.smithi037.stderr: -241> 2024-09-12T17:36:29.219+0000 7fe597832800 5 AuthRegistry(0x556f173d5290) adding con mode: crc 2024-09-12T17:36:29.591 INFO:tasks.workunit.client.0.smithi037.stderr: -240> 2024-09-12T17:36:29.219+0000 7fe597832800 5 AuthRegistry(0x556f173d5290) adding con mode: crc 2024-09-12T17:36:29.591 INFO:tasks.workunit.client.0.smithi037.stderr: -239> 2024-09-12T17:36:29.219+0000 7fe597832800 5 AuthRegistry(0x556f173d5290) adding con mode: secure 2024-09-12T17:36:29.591 INFO:tasks.workunit.client.0.smithi037.stderr: -238> 2024-09-12T17:36:29.219+0000 7fe597832800 5 AuthRegistry(0x556f173d5290) adding con mode: crc 2024-09-12T17:36:29.591 INFO:tasks.workunit.client.0.smithi037.stderr: -237> 2024-09-12T17:36:29.219+0000 7fe597832800 5 AuthRegistry(0x556f173d5290) adding con mode: secure 2024-09-12T17:36:29.591 INFO:tasks.workunit.client.0.smithi037.stderr: -236> 2024-09-12T17:36:29.219+0000 7fe597832800 5 AuthRegistry(0x556f173d5290) adding con mode: crc 2024-09-12T17:36:29.591 INFO:tasks.workunit.client.0.smithi037.stderr: -235> 2024-09-12T17:36:29.219+0000 7fe597832800 5 AuthRegistry(0x556f173d5290) adding con mode: secure 2024-09-12T17:36:29.591 INFO:tasks.workunit.client.0.smithi037.stderr: -234> 2024-09-12T17:36:29.219+0000 7fe597832800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:36:29.591 INFO:tasks.workunit.client.0.smithi037.stderr: -233> 2024-09-12T17:36:29.219+0000 7fe597832800 1 librados: starting msgr at 2024-09-12T17:36:29.591 INFO:tasks.workunit.client.0.smithi037.stderr: -232> 2024-09-12T17:36:29.219+0000 7fe597832800 1 librados: starting objecter 2024-09-12T17:36:29.591 INFO:tasks.workunit.client.0.smithi037.stderr: -231> 2024-09-12T17:36:29.219+0000 7fe597832800 5 asok(0x556f170e8730) register_command objecter_requests cmddesc objecter_requests hook 0x556f173ca460 EEXIST 2024-09-12T17:36:29.591 INFO:tasks.workunit.client.0.smithi037.stderr: -230> 2024-09-12T17:36:29.220+0000 7fe597832800 1 librados: setting wanted keys 2024-09-12T17:36:29.591 INFO:tasks.workunit.client.0.smithi037.stderr: -229> 2024-09-12T17:36:29.220+0000 7fe597832800 1 librados: calling monclient init 2024-09-12T17:36:29.592 INFO:tasks.workunit.client.0.smithi037.stderr: -228> 2024-09-12T17:36:29.220+0000 7fe597832800 10 monclient: init 2024-09-12T17:36:29.592 INFO:tasks.workunit.client.0.smithi037.stderr: -227> 2024-09-12T17:36:29.220+0000 7fe597832800 5 AuthRegistry(0x556f1739ea40) adding auth protocol: cephx 2024-09-12T17:36:29.592 INFO:tasks.workunit.client.0.smithi037.stderr: -226> 2024-09-12T17:36:29.220+0000 7fe597832800 5 AuthRegistry(0x556f1739ea40) adding auth protocol: cephx 2024-09-12T17:36:29.592 INFO:tasks.workunit.client.0.smithi037.stderr: -225> 2024-09-12T17:36:29.220+0000 7fe597832800 5 AuthRegistry(0x556f1739ea40) adding auth protocol: cephx 2024-09-12T17:36:29.592 INFO:tasks.workunit.client.0.smithi037.stderr: -224> 2024-09-12T17:36:29.220+0000 7fe597832800 5 AuthRegistry(0x556f1739ea40) adding con mode: secure 2024-09-12T17:36:29.592 INFO:tasks.workunit.client.0.smithi037.stderr: -223> 2024-09-12T17:36:29.220+0000 7fe597832800 5 AuthRegistry(0x556f1739ea40) adding con mode: crc 2024-09-12T17:36:29.592 INFO:tasks.workunit.client.0.smithi037.stderr: -222> 2024-09-12T17:36:29.220+0000 7fe597832800 5 AuthRegistry(0x556f1739ea40) adding con mode: secure 2024-09-12T17:36:29.592 INFO:tasks.workunit.client.0.smithi037.stderr: -221> 2024-09-12T17:36:29.220+0000 7fe597832800 5 AuthRegistry(0x556f1739ea40) adding con mode: crc 2024-09-12T17:36:29.592 INFO:tasks.workunit.client.0.smithi037.stderr: -220> 2024-09-12T17:36:29.220+0000 7fe597832800 5 AuthRegistry(0x556f1739ea40) adding con mode: secure 2024-09-12T17:36:29.592 INFO:tasks.workunit.client.0.smithi037.stderr: -219> 2024-09-12T17:36:29.220+0000 7fe597832800 5 AuthRegistry(0x556f1739ea40) adding con mode: crc 2024-09-12T17:36:29.592 INFO:tasks.workunit.client.0.smithi037.stderr: -218> 2024-09-12T17:36:29.220+0000 7fe597832800 5 AuthRegistry(0x556f1739ea40) adding con mode: crc 2024-09-12T17:36:29.593 INFO:tasks.workunit.client.0.smithi037.stderr: -217> 2024-09-12T17:36:29.220+0000 7fe597832800 5 AuthRegistry(0x556f1739ea40) adding con mode: secure 2024-09-12T17:36:29.593 INFO:tasks.workunit.client.0.smithi037.stderr: -216> 2024-09-12T17:36:29.220+0000 7fe597832800 5 AuthRegistry(0x556f1739ea40) adding con mode: crc 2024-09-12T17:36:29.593 INFO:tasks.workunit.client.0.smithi037.stderr: -215> 2024-09-12T17:36:29.220+0000 7fe597832800 5 AuthRegistry(0x556f1739ea40) adding con mode: secure 2024-09-12T17:36:29.593 INFO:tasks.workunit.client.0.smithi037.stderr: -214> 2024-09-12T17:36:29.220+0000 7fe597832800 5 AuthRegistry(0x556f1739ea40) adding con mode: crc 2024-09-12T17:36:29.593 INFO:tasks.workunit.client.0.smithi037.stderr: -213> 2024-09-12T17:36:29.220+0000 7fe597832800 5 AuthRegistry(0x556f1739ea40) adding con mode: secure 2024-09-12T17:36:29.593 INFO:tasks.workunit.client.0.smithi037.stderr: -212> 2024-09-12T17:36:29.220+0000 7fe597832800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:36:29.593 INFO:tasks.workunit.client.0.smithi037.stderr: -211> 2024-09-12T17:36:29.220+0000 7fe597832800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:36:29.593 INFO:tasks.workunit.client.0.smithi037.stderr: -210> 2024-09-12T17:36:29.220+0000 7fe597832800 5 asok(0x556f170e8730) register_command rotate-key cmddesc rotate-key hook 0x556f1739eb88 EEXIST 2024-09-12T17:36:29.593 INFO:tasks.workunit.client.0.smithi037.stderr: -209> 2024-09-12T17:36:29.220+0000 7fe597832800 10 monclient: _reopen_session rank -1 2024-09-12T17:36:29.594 INFO:tasks.workunit.client.0.smithi037.stderr: -208> 2024-09-12T17:36:29.220+0000 7fe597832800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T17:36:29.594 INFO:tasks.workunit.client.0.smithi037.stderr: -207> 2024-09-12T17:36:29.220+0000 7fe597832800 10 monclient(hunting): picked mon.noname-a con 0x556f173a8b10 addr [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] 2024-09-12T17:36:29.594 INFO:tasks.workunit.client.0.smithi037.stderr: -206> 2024-09-12T17:36:29.220+0000 7fe597832800 10 monclient(hunting): picked mon.noname-c con 0x556f173d4d10 addr [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] 2024-09-12T17:36:29.594 INFO:tasks.workunit.client.0.smithi037.stderr: -205> 2024-09-12T17:36:29.220+0000 7fe597832800 10 monclient(hunting): picked mon.noname-b con 0x556f173d9310 addr [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] 2024-09-12T17:36:29.594 INFO:tasks.workunit.client.0.smithi037.stderr: -204> 2024-09-12T17:36:29.220+0000 7fe597832800 10 monclient(hunting): start opening mon connection 2024-09-12T17:36:29.594 INFO:tasks.workunit.client.0.smithi037.stderr: -203> 2024-09-12T17:36:29.220+0000 7fe597832800 10 monclient(hunting): start opening mon connection 2024-09-12T17:36:29.594 INFO:tasks.workunit.client.0.smithi037.stderr: -202> 2024-09-12T17:36:29.220+0000 7fe597832800 10 monclient(hunting): start opening mon connection 2024-09-12T17:36:29.594 INFO:tasks.workunit.client.0.smithi037.stderr: -201> 2024-09-12T17:36:29.220+0000 7fe597832800 10 monclient(hunting): _renew_subs 2024-09-12T17:36:29.594 INFO:tasks.workunit.client.0.smithi037.stderr: -200> 2024-09-12T17:36:29.220+0000 7fe597832800 10 monclient(hunting): authenticate will time out at 2376.817633s 2024-09-12T17:36:29.594 INFO:tasks.workunit.client.0.smithi037.stderr: -199> 2024-09-12T17:36:29.220+0000 7fe58a352640 10 monclient(hunting): get_auth_request con 0x556f173d4d10 auth_method 0 2024-09-12T17:36:29.594 INFO:tasks.workunit.client.0.smithi037.stderr: -198> 2024-09-12T17:36:29.220+0000 7fe58a352640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:36:29.595 INFO:tasks.workunit.client.0.smithi037.stderr: -197> 2024-09-12T17:36:29.220+0000 7fe58a352640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:36:29.595 INFO:tasks.workunit.client.0.smithi037.stderr: -196> 2024-09-12T17:36:29.220+0000 7fe58a352640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:36:29.595 INFO:tasks.workunit.client.0.smithi037.stderr: -195> 2024-09-12T17:36:29.220+0000 7fe592b53640 10 monclient(hunting): get_auth_request con 0x556f173a8b10 auth_method 0 2024-09-12T17:36:29.595 INFO:tasks.workunit.client.0.smithi037.stderr: -194> 2024-09-12T17:36:29.220+0000 7fe592b53640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:36:29.595 INFO:tasks.workunit.client.0.smithi037.stderr: -193> 2024-09-12T17:36:29.220+0000 7fe592b53640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:36:29.595 INFO:tasks.workunit.client.0.smithi037.stderr: -192> 2024-09-12T17:36:29.220+0000 7fe592b53640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:36:29.595 INFO:tasks.workunit.client.0.smithi037.stderr: -191> 2024-09-12T17:36:29.220+0000 7fe58a352640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:36:29.595 INFO:tasks.workunit.client.0.smithi037.stderr: -190> 2024-09-12T17:36:29.220+0000 7fe58a352640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:36:29.596 INFO:tasks.workunit.client.0.smithi037.stderr: -189> 2024-09-12T17:36:29.220+0000 7fe58a352640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:36:29.596 INFO:tasks.workunit.client.0.smithi037.stderr: -188> 2024-09-12T17:36:29.220+0000 7fe592b53640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:36:29.596 INFO:tasks.workunit.client.0.smithi037.stderr: -187> 2024-09-12T17:36:29.220+0000 7fe592b53640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:36:29.596 INFO:tasks.workunit.client.0.smithi037.stderr: -186> 2024-09-12T17:36:29.220+0000 7fe592b53640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:36:29.596 INFO:tasks.workunit.client.0.smithi037.stderr: -185> 2024-09-12T17:36:29.220+0000 7fe593354640 10 monclient(hunting): get_auth_request con 0x556f173d9310 auth_method 0 2024-09-12T17:36:29.596 INFO:tasks.workunit.client.0.smithi037.stderr: -184> 2024-09-12T17:36:29.220+0000 7fe593354640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:36:29.597 INFO:tasks.workunit.client.0.smithi037.stderr: -183> 2024-09-12T17:36:29.220+0000 7fe593354640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:36:29.597 INFO:tasks.workunit.client.0.smithi037.stderr: -182> 2024-09-12T17:36:29.220+0000 7fe593354640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:36:29.597 INFO:tasks.workunit.client.0.smithi037.stderr: -181> 2024-09-12T17:36:29.220+0000 7fe58a352640 10 monclient(hunting): handle_auth_done global_id 7496 payload 824 2024-09-12T17:36:29.597 INFO:tasks.workunit.client.0.smithi037.stderr: -180> 2024-09-12T17:36:29.220+0000 7fe58a352640 10 monclient: _finish_hunting 0 2024-09-12T17:36:29.597 INFO:tasks.workunit.client.0.smithi037.stderr: -179> 2024-09-12T17:36:29.220+0000 7fe58a352640 1 monclient: found mon.noname-c 2024-09-12T17:36:29.597 INFO:tasks.workunit.client.0.smithi037.stderr: -178> 2024-09-12T17:36:29.220+0000 7fe58a352640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.37:3301/0 2024-09-12T17:36:29.597 INFO:tasks.workunit.client.0.smithi037.stderr: -177> 2024-09-12T17:36:29.221+0000 7fe474ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:36:29.597 INFO:tasks.workunit.client.0.smithi037.stderr: -176> 2024-09-12T17:36:29.221+0000 7fe474ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:36:29.597 INFO:tasks.workunit.client.0.smithi037.stderr: -175> 2024-09-12T17:36:29.221+0000 7fe474ff9640 10 monclient: dump: 2024-09-12T17:36:29.598 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:36:29.598 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:36:29.598 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:36:29.598 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:36:29.598 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:36:29.598 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:36:29.599 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:36:29.599 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:36:29.599 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:36:29.599 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:36:29.599 INFO:tasks.workunit.client.0.smithi037.stderr: -174> 2024-09-12T17:36:29.221+0000 7fe474ff9640 10 monclient: _finish_auth 0 2024-09-12T17:36:29.599 INFO:tasks.workunit.client.0.smithi037.stderr: -173> 2024-09-12T17:36:29.221+0000 7fe474ff9640 10 monclient: _check_auth_tickets 2024-09-12T17:36:29.599 INFO:tasks.workunit.client.0.smithi037.stderr: -172> 2024-09-12T17:36:29.221+0000 7fe474ff9640 10 monclient: handle_config config(0 keys) 2024-09-12T17:36:29.599 INFO:tasks.workunit.client.0.smithi037.stderr: -171> 2024-09-12T17:36:29.221+0000 7fe474ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:36:29.599 INFO:tasks.workunit.client.0.smithi037.stderr: -170> 2024-09-12T17:36:29.221+0000 7fe474ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:36:29.600 INFO:tasks.workunit.client.0.smithi037.stderr: -169> 2024-09-12T17:36:29.221+0000 7fe474ff9640 10 monclient: dump: 2024-09-12T17:36:29.600 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:36:29.600 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:36:29.600 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:36:29.600 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:36:29.600 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:36:29.600 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:36:29.600 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:36:29.600 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:36:29.600 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:36:29.600 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:36:29.600 INFO:tasks.workunit.client.0.smithi037.stderr: -168> 2024-09-12T17:36:29.221+0000 7fe597832800 5 monclient: authenticate success, global_id 7496 2024-09-12T17:36:29.601 INFO:tasks.workunit.client.0.smithi037.stderr: -167> 2024-09-12T17:36:29.221+0000 7fe4767fc640 4 set_mon_vals no callback set 2024-09-12T17:36:29.601 INFO:tasks.workunit.client.0.smithi037.stderr: -166> 2024-09-12T17:36:29.221+0000 7fe597832800 10 monclient: _renew_subs 2024-09-12T17:36:29.601 INFO:tasks.workunit.client.0.smithi037.stderr: -165> 2024-09-12T17:36:29.221+0000 7fe597832800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.37:3301/0 2024-09-12T17:36:29.601 INFO:tasks.workunit.client.0.smithi037.stderr: -164> 2024-09-12T17:36:29.221+0000 7fe597832800 10 monclient: _renew_subs 2024-09-12T17:36:29.601 INFO:tasks.workunit.client.0.smithi037.stderr: -163> 2024-09-12T17:36:29.221+0000 7fe597832800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.37:3301/0 2024-09-12T17:36:29.601 INFO:tasks.workunit.client.0.smithi037.stderr: -162> 2024-09-12T17:36:29.221+0000 7fe597832800 1 librados: init done 2024-09-12T17:36:29.601 INFO:tasks.workunit.client.0.smithi037.stderr: -161> 2024-09-12T17:36:29.221+0000 7fe597832800 5 asok(0x556f170e8730) register_command cr dump hook 0x556f173ccdb8 2024-09-12T17:36:29.601 INFO:tasks.workunit.client.0.smithi037.stderr: -160> 2024-09-12T17:36:29.222+0000 7fe597832800 20 rados->read ofs=0 len=0 2024-09-12T17:36:29.602 INFO:tasks.workunit.client.0.smithi037.stderr: -159> 2024-09-12T17:36:29.223+0000 7fe474ff9640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:36:29.602 INFO:tasks.workunit.client.0.smithi037.stderr: -158> 2024-09-12T17:36:29.223+0000 7fe474ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.40:6816/3916250676,v1:172.21.15.40:6817/3916250676] 2024-09-12T17:36:29.602 INFO:tasks.workunit.client.0.smithi037.stderr: -157> 2024-09-12T17:36:29.223+0000 7fe474ff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.40:6816/3916250676,v1:172.21.15.40:6817/3916250676] 2024-09-12T17:36:29.602 INFO:tasks.workunit.client.0.smithi037.stderr: -156> 2024-09-12T17:36:29.223+0000 7fe592b53640 10 monclient: get_auth_request con 0x7fe45c076470 auth_method 0 2024-09-12T17:36:29.602 INFO:tasks.workunit.client.0.smithi037.stderr: -155> 2024-09-12T17:36:29.223+0000 7fe593354640 10 monclient: get_auth_request con 0x556f173f3360 auth_method 0 2024-09-12T17:36:29.602 INFO:tasks.workunit.client.0.smithi037.stderr: -154> 2024-09-12T17:36:29.224+0000 7fe597832800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:29.602 INFO:tasks.workunit.client.0.smithi037.stderr: -153> 2024-09-12T17:36:29.224+0000 7fe597832800 20 realm 2024-09-12T17:36:29.602 INFO:tasks.workunit.client.0.smithi037.stderr: -152> 2024-09-12T17:36:29.224+0000 7fe597832800 20 rados->read ofs=0 len=0 2024-09-12T17:36:29.602 INFO:tasks.workunit.client.0.smithi037.stderr: -151> 2024-09-12T17:36:29.224+0000 7fe597832800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:29.602 INFO:tasks.workunit.client.0.smithi037.stderr: -150> 2024-09-12T17:36:29.224+0000 7fe597832800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:36:29.602 INFO:tasks.workunit.client.0.smithi037.stderr: -149> 2024-09-12T17:36:29.224+0000 7fe597832800 20 rados->read ofs=0 len=0 2024-09-12T17:36:29.602 INFO:tasks.workunit.client.0.smithi037.stderr: -148> 2024-09-12T17:36:29.224+0000 7fe597832800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:29.603 INFO:tasks.workunit.client.0.smithi037.stderr: -147> 2024-09-12T17:36:29.224+0000 7fe597832800 20 rados->read ofs=0 len=0 2024-09-12T17:36:29.603 INFO:tasks.workunit.client.0.smithi037.stderr: -146> 2024-09-12T17:36:29.225+0000 7fe592b53640 10 monclient: get_auth_request con 0x556f173f76f0 auth_method 0 2024-09-12T17:36:29.603 INFO:tasks.workunit.client.0.smithi037.stderr: -145> 2024-09-12T17:36:29.225+0000 7fe597832800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:36:29.603 INFO:tasks.workunit.client.0.smithi037.stderr: -144> 2024-09-12T17:36:29.225+0000 7fe597832800 20 rados->read ofs=0 len=0 2024-09-12T17:36:29.603 INFO:tasks.workunit.client.0.smithi037.stderr: -143> 2024-09-12T17:36:29.226+0000 7fe597832800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:36:29.603 INFO:tasks.workunit.client.0.smithi037.stderr: -142> 2024-09-12T17:36:29.226+0000 7fe597832800 20 searching for the correct realm 2024-09-12T17:36:29.603 INFO:tasks.workunit.client.0.smithi037.stderr: -141> 2024-09-12T17:36:29.226+0000 7fe58a352640 10 monclient: get_auth_request con 0x556f173fc990 auth_method 0 2024-09-12T17:36:29.603 INFO:tasks.workunit.client.0.smithi037.stderr: -140> 2024-09-12T17:36:29.227+0000 7fe593354640 10 monclient: get_auth_request con 0x7fe57c0a42a0 auth_method 0 2024-09-12T17:36:29.603 INFO:tasks.workunit.client.0.smithi037.stderr: -139> 2024-09-12T17:36:29.227+0000 7fe592b53640 10 monclient: get_auth_request con 0x7fe58c0646c0 auth_method 0 2024-09-12T17:36:29.604 INFO:tasks.workunit.client.0.smithi037.stderr: -138> 2024-09-12T17:36:29.228+0000 7fe58a352640 10 monclient: get_auth_request con 0x7fe584080040 auth_method 0 2024-09-12T17:36:29.604 INFO:tasks.workunit.client.0.smithi037.stderr: -137> 2024-09-12T17:36:29.229+0000 7fe58a352640 0 -- 172.21.15.37:0/1147036893 >> [v2:172.21.15.40:6800/2441293461,v1:172.21.15.40:6801/2441293461] conn(0x7fe584080040 msgr2=0x7fe58408f940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:36:29.604 INFO:tasks.workunit.client.0.smithi037.stderr: -136> 2024-09-12T17:36:29.229+0000 7fe474ff9640 1 client.7496.objecter ms_handle_reset 0x7fe584080040 session 0x7fe584005040 osd.4 2024-09-12T17:36:29.604 INFO:tasks.workunit.client.0.smithi037.stderr: -135> 2024-09-12T17:36:29.229+0000 7fe474ff9640 10 monclient: _renew_subs 2024-09-12T17:36:29.604 INFO:tasks.workunit.client.0.smithi037.stderr: -134> 2024-09-12T17:36:29.229+0000 7fe474ff9640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.37:3301/0 2024-09-12T17:36:29.604 INFO:tasks.workunit.client.0.smithi037.stderr: -133> 2024-09-12T17:36:29.229+0000 7fe58a352640 10 monclient: get_auth_request con 0x7fe45c086b10 auth_method 0 2024-09-12T17:36:29.604 INFO:tasks.workunit.client.0.smithi037.stderr: -132> 2024-09-12T17:36:29.230+0000 7fe593354640 10 monclient: get_auth_request con 0x7fe57c089800 auth_method 0 2024-09-12T17:36:29.604 INFO:tasks.workunit.client.0.smithi037.stderr: -131> 2024-09-12T17:36:29.233+0000 7fe592b53640 10 monclient: get_auth_request con 0x7fe57c01abb0 auth_method 0 2024-09-12T17:36:29.604 INFO:tasks.workunit.client.0.smithi037.stderr: -130> 2024-09-12T17:36:29.233+0000 7fe592b53640 0 -- 172.21.15.37:0/1147036893 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7fe57c01abb0 msgr2=0x7fe57c07c970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:36:29.604 INFO:tasks.workunit.client.0.smithi037.stderr: -129> 2024-09-12T17:36:29.434+0000 7fe592b53640 10 monclient: get_auth_request con 0x7fe57c01abb0 auth_method 0 2024-09-12T17:36:29.604 INFO:tasks.workunit.client.0.smithi037.stderr: -128> 2024-09-12T17:36:29.440+0000 7fe597832800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:36:29.604 INFO:tasks.workunit.client.0.smithi037.stderr: -127> 2024-09-12T17:36:29.440+0000 7fe597832800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:36:29.604 INFO:tasks.workunit.client.0.smithi037.stderr: -126> 2024-09-12T17:36:29.440+0000 7fe597832800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:36:29.605 INFO:tasks.workunit.client.0.smithi037.stderr: -125> 2024-09-12T17:36:29.440+0000 7fe597832800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:36:29.605 INFO:tasks.workunit.client.0.smithi037.stderr: -124> 2024-09-12T17:36:29.440+0000 7fe597832800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:36:29.605 INFO:tasks.workunit.client.0.smithi037.stderr: -123> 2024-09-12T17:36:29.440+0000 7fe597832800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:36:29.605 INFO:tasks.workunit.client.0.smithi037.stderr: -122> 2024-09-12T17:36:29.440+0000 7fe597832800 20 rados->read ofs=0 len=0 2024-09-12T17:36:29.605 INFO:tasks.workunit.client.0.smithi037.stderr: -121> 2024-09-12T17:36:29.441+0000 7fe597832800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:29.605 INFO:tasks.workunit.client.0.smithi037.stderr: -120> 2024-09-12T17:36:29.441+0000 7fe597832800 20 rados->read ofs=0 len=0 2024-09-12T17:36:29.605 INFO:tasks.workunit.client.0.smithi037.stderr: -119> 2024-09-12T17:36:29.441+0000 7fe597832800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:36:29.605 INFO:tasks.workunit.client.0.smithi037.stderr: -118> 2024-09-12T17:36:29.441+0000 7fe597832800 20 rados->read ofs=0 len=0 2024-09-12T17:36:29.605 INFO:tasks.workunit.client.0.smithi037.stderr: -117> 2024-09-12T17:36:29.442+0000 7fe597832800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:36:29.606 INFO:tasks.workunit.client.0.smithi037.stderr: -116> 2024-09-12T17:36:29.442+0000 7fe597832800 20 zone default found 2024-09-12T17:36:29.606 INFO:tasks.workunit.client.0.smithi037.stderr: -115> 2024-09-12T17:36:29.442+0000 7fe597832800 4 Realm: () 2024-09-12T17:36:29.606 INFO:tasks.workunit.client.0.smithi037.stderr: -114> 2024-09-12T17:36:29.442+0000 7fe597832800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:36:29.606 INFO:tasks.workunit.client.0.smithi037.stderr: -113> 2024-09-12T17:36:29.442+0000 7fe597832800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:36:29.606 INFO:tasks.workunit.client.0.smithi037.stderr: -112> 2024-09-12T17:36:29.442+0000 7fe597832800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:36:29.606 INFO:tasks.workunit.client.0.smithi037.stderr: -111> 2024-09-12T17:36:29.442+0000 7fe597832800 20 zonegroup default 2024-09-12T17:36:29.606 INFO:tasks.workunit.client.0.smithi037.stderr: -110> 2024-09-12T17:36:29.442+0000 7fe597832800 20 rados->read ofs=0 len=0 2024-09-12T17:36:29.606 INFO:tasks.workunit.client.0.smithi037.stderr: -109> 2024-09-12T17:36:29.442+0000 7fe597832800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:29.606 INFO:tasks.workunit.client.0.smithi037.stderr: -108> 2024-09-12T17:36:29.442+0000 7fe597832800 20 rados->read ofs=0 len=0 2024-09-12T17:36:29.606 INFO:tasks.workunit.client.0.smithi037.stderr: -107> 2024-09-12T17:36:29.442+0000 7fe597832800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:29.606 INFO:tasks.workunit.client.0.smithi037.stderr: -106> 2024-09-12T17:36:29.442+0000 7fe597832800 20 rados->read ofs=0 len=0 2024-09-12T17:36:29.606 INFO:tasks.workunit.client.0.smithi037.stderr: -105> 2024-09-12T17:36:29.443+0000 7fe597832800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:29.606 INFO:tasks.workunit.client.0.smithi037.stderr: -104> 2024-09-12T17:36:29.443+0000 7fe597832800 20 started sync module instance, tier type = 2024-09-12T17:36:29.606 INFO:tasks.workunit.client.0.smithi037.stderr: -103> 2024-09-12T17:36:29.443+0000 7fe597832800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:36:29.607 INFO:tasks.workunit.client.0.smithi037.stderr: -102> 2024-09-12T17:36:29.453+0000 7fe597832800 20 add_watcher() i=0 2024-09-12T17:36:29.607 INFO:tasks.workunit.client.0.smithi037.stderr: -101> 2024-09-12T17:36:29.453+0000 7fe597832800 20 add_watcher() i=1 2024-09-12T17:36:29.607 INFO:tasks.workunit.client.0.smithi037.stderr: -100> 2024-09-12T17:36:29.453+0000 7fe597832800 20 add_watcher() i=2 2024-09-12T17:36:29.607 INFO:tasks.workunit.client.0.smithi037.stderr: -99> 2024-09-12T17:36:29.453+0000 7fe597832800 20 add_watcher() i=3 2024-09-12T17:36:29.607 INFO:tasks.workunit.client.0.smithi037.stderr: -98> 2024-09-12T17:36:29.453+0000 7fe597832800 20 add_watcher() i=4 2024-09-12T17:36:29.607 INFO:tasks.workunit.client.0.smithi037.stderr: -97> 2024-09-12T17:36:29.453+0000 7fe597832800 20 add_watcher() i=5 2024-09-12T17:36:29.607 INFO:tasks.workunit.client.0.smithi037.stderr: -96> 2024-09-12T17:36:29.453+0000 7fe597832800 20 add_watcher() i=6 2024-09-12T17:36:29.607 INFO:tasks.workunit.client.0.smithi037.stderr: -95> 2024-09-12T17:36:29.454+0000 7fe597832800 20 add_watcher() i=7 2024-09-12T17:36:29.607 INFO:tasks.workunit.client.0.smithi037.stderr: -94> 2024-09-12T17:36:29.454+0000 7fe597832800 2 all 8 watchers are set, enabling cache 2024-09-12T17:36:29.608 INFO:tasks.workunit.client.0.smithi037.stderr: -93> 2024-09-12T17:36:29.456+0000 7fe597832800 5 AuthRegistry(0x7ffee11095d0) adding auth protocol: cephx 2024-09-12T17:36:29.608 INFO:tasks.workunit.client.0.smithi037.stderr: -92> 2024-09-12T17:36:29.456+0000 7fe597832800 5 AuthRegistry(0x7ffee11095d0) adding auth protocol: cephx 2024-09-12T17:36:29.608 INFO:tasks.workunit.client.0.smithi037.stderr: -91> 2024-09-12T17:36:29.456+0000 7fe597832800 5 AuthRegistry(0x7ffee11095d0) adding auth protocol: cephx 2024-09-12T17:36:29.608 INFO:tasks.workunit.client.0.smithi037.stderr: -90> 2024-09-12T17:36:29.456+0000 7fe597832800 5 AuthRegistry(0x7ffee11095d0) adding con mode: secure 2024-09-12T17:36:29.608 INFO:tasks.workunit.client.0.smithi037.stderr: -89> 2024-09-12T17:36:29.456+0000 7fe597832800 5 AuthRegistry(0x7ffee11095d0) adding con mode: crc 2024-09-12T17:36:29.608 INFO:tasks.workunit.client.0.smithi037.stderr: -88> 2024-09-12T17:36:29.456+0000 7fe597832800 5 AuthRegistry(0x7ffee11095d0) adding con mode: secure 2024-09-12T17:36:29.608 INFO:tasks.workunit.client.0.smithi037.stderr: -87> 2024-09-12T17:36:29.456+0000 7fe597832800 5 AuthRegistry(0x7ffee11095d0) adding con mode: crc 2024-09-12T17:36:29.608 INFO:tasks.workunit.client.0.smithi037.stderr: -86> 2024-09-12T17:36:29.456+0000 7fe597832800 5 AuthRegistry(0x7ffee11095d0) adding con mode: secure 2024-09-12T17:36:29.608 INFO:tasks.workunit.client.0.smithi037.stderr: -85> 2024-09-12T17:36:29.456+0000 7fe597832800 5 AuthRegistry(0x7ffee11095d0) adding con mode: crc 2024-09-12T17:36:29.608 INFO:tasks.workunit.client.0.smithi037.stderr: -84> 2024-09-12T17:36:29.456+0000 7fe597832800 5 AuthRegistry(0x7ffee11095d0) adding con mode: crc 2024-09-12T17:36:29.608 INFO:tasks.workunit.client.0.smithi037.stderr: -83> 2024-09-12T17:36:29.456+0000 7fe597832800 5 AuthRegistry(0x7ffee11095d0) adding con mode: secure 2024-09-12T17:36:29.608 INFO:tasks.workunit.client.0.smithi037.stderr: -82> 2024-09-12T17:36:29.456+0000 7fe597832800 5 AuthRegistry(0x7ffee11095d0) adding con mode: crc 2024-09-12T17:36:29.608 INFO:tasks.workunit.client.0.smithi037.stderr: -81> 2024-09-12T17:36:29.456+0000 7fe597832800 5 AuthRegistry(0x7ffee11095d0) adding con mode: secure 2024-09-12T17:36:29.609 INFO:tasks.workunit.client.0.smithi037.stderr: -80> 2024-09-12T17:36:29.456+0000 7fe597832800 5 AuthRegistry(0x7ffee11095d0) adding con mode: crc 2024-09-12T17:36:29.609 INFO:tasks.workunit.client.0.smithi037.stderr: -79> 2024-09-12T17:36:29.456+0000 7fe597832800 5 AuthRegistry(0x7ffee11095d0) adding con mode: secure 2024-09-12T17:36:29.609 INFO:tasks.workunit.client.0.smithi037.stderr: -78> 2024-09-12T17:36:29.456+0000 7fe4497e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:36:29.609 INFO:tasks.workunit.client.0.smithi037.stderr: -77> 2024-09-12T17:36:29.456+0000 7fe597832800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:36:29.609 INFO:tasks.workunit.client.0.smithi037.stderr: -76> 2024-09-12T17:36:29.456+0000 7fe597832800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:36:29.609 INFO:tasks.workunit.client.0.smithi037.stderr: -75> 2024-09-12T17:36:29.456+0000 7fe597832800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:36:29.609 INFO:tasks.workunit.client.0.smithi037.stderr: -74> 2024-09-12T17:36:29.456+0000 7fe597832800 5 asok(0x556f170e8730) register_command cache list hook 0x556f173cf5a0 2024-09-12T17:36:29.609 INFO:tasks.workunit.client.0.smithi037.stderr: -73> 2024-09-12T17:36:29.456+0000 7fe597832800 5 asok(0x556f170e8730) register_command cache inspect hook 0x556f173cf5a0 2024-09-12T17:36:29.609 INFO:tasks.workunit.client.0.smithi037.stderr: -72> 2024-09-12T17:36:29.456+0000 7fe597832800 5 asok(0x556f170e8730) register_command cache erase hook 0x556f173cf5a0 2024-09-12T17:36:29.610 INFO:tasks.workunit.client.0.smithi037.stderr: -71> 2024-09-12T17:36:29.456+0000 7fe597832800 5 asok(0x556f170e8730) register_command cache zap hook 0x556f173cf5a0 2024-09-12T17:36:29.610 INFO:tasks.workunit.client.0.smithi037.stderr: -70> 2024-09-12T17:36:29.456+0000 7fe597832800 5 note: GC not initialized 2024-09-12T17:36:29.610 INFO:tasks.workunit.client.0.smithi037.stderr: -69> 2024-09-12T17:36:29.456+0000 7fe3c3fff640 20 reqs_thread_entry: start 2024-09-12T17:36:29.610 INFO:tasks.workunit.client.0.smithi037.stderr: -68> 2024-09-12T17:36:29.456+0000 7fe597832800 5 asok(0x556f170e8730) register_command sync trace show hook 0x7fe58c0055d0 2024-09-12T17:36:29.610 INFO:tasks.workunit.client.0.smithi037.stderr: -67> 2024-09-12T17:36:29.456+0000 7fe597832800 5 asok(0x556f170e8730) register_command sync trace history hook 0x7fe58c0055d0 2024-09-12T17:36:29.610 INFO:tasks.workunit.client.0.smithi037.stderr: -66> 2024-09-12T17:36:29.456+0000 7fe597832800 5 asok(0x556f170e8730) register_command sync trace active hook 0x7fe58c0055d0 2024-09-12T17:36:29.610 INFO:tasks.workunit.client.0.smithi037.stderr: -65> 2024-09-12T17:36:29.456+0000 7fe597832800 5 asok(0x556f170e8730) register_command sync trace active_short hook 0x7fe58c0055d0 2024-09-12T17:36:29.610 INFO:tasks.workunit.client.0.smithi037.stderr: -64> 2024-09-12T17:36:29.457+0000 7fe597832800 20 init_complete bucket index max shards: 11 2024-09-12T17:36:29.610 INFO:tasks.workunit.client.0.smithi037.stderr: -63> 2024-09-12T17:36:29.457+0000 7fe597832800 20 Filter name: none 2024-09-12T17:36:29.610 INFO:tasks.workunit.client.0.smithi037.stderr: -62> 2024-09-12T17:36:29.457+0000 7fe3c1ffb640 20 reqs_thread_entry: start 2024-09-12T17:36:29.610 INFO:tasks.workunit.client.0.smithi037.stderr: -61> 2024-09-12T17:36:29.457+0000 7fe597832800 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-12T17:36:29.611 INFO:tasks.workunit.client.0.smithi037.stderr: -60> 2024-09-12T17:36:29.457+0000 7fe597832800 20 rados->read ofs=0 len=0 2024-09-12T17:36:29.611 INFO:tasks.workunit.client.0.smithi037.stderr: -59> 2024-09-12T17:36:29.457+0000 7fe597832800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:36:29.611 INFO:tasks.workunit.client.0.smithi037.stderr: -58> 2024-09-12T17:36:29.457+0000 7fe597832800 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-12T17:36:29.611 INFO:tasks.workunit.client.0.smithi037.stderr: -57> 2024-09-12T17:36:29.457+0000 7fe597832800 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-12T17:36:29.611 INFO:tasks.workunit.client.0.smithi037.stderr: -56> 2024-09-12T17:36:29.457+0000 7fe597832800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40 : miss 2024-09-12T17:36:29.611 INFO:tasks.workunit.client.0.smithi037.stderr: -55> 2024-09-12T17:36:29.457+0000 7fe597832800 20 rados->read ofs=0 len=0 2024-09-12T17:36:29.611 INFO:tasks.workunit.client.0.smithi037.stderr: -54> 2024-09-12T17:36:29.458+0000 7fe597832800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:36:29.611 INFO:tasks.workunit.client.0.smithi037.stderr: -53> 2024-09-12T17:36:29.458+0000 7fe597832800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40 info.flags=0x17 2024-09-12T17:36:29.611 INFO:tasks.workunit.client.0.smithi037.stderr: -52> 2024-09-12T17:36:29.458+0000 7fe597832800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40 to cache LRU end 2024-09-12T17:36:29.611 INFO:tasks.workunit.client.0.smithi037.stderr: -51> 2024-09-12T17:36:29.458+0000 7fe597832800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:36:29.611 INFO:tasks.workunit.client.0.smithi037.stderr: -50> 2024-09-12T17:36:29.458+0000 7fe597832800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:36:29.612 INFO:tasks.workunit.client.0.smithi037.stderr: -49> 2024-09-12T17:36:29.458+0000 7fe597832800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40 2024-09-12T17:36:29.612 INFO:tasks.workunit.client.0.smithi037.stderr: -48> 2024-09-12T17:36:29.463+0000 7fe597832800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40 info.flags=0x17 2024-09-12T17:36:29.612 INFO:tasks.workunit.client.0.smithi037.stderr: -47> 2024-09-12T17:36:29.463+0000 7fe597832800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40 to cache LRU end 2024-09-12T17:36:29.612 INFO:tasks.workunit.client.0.smithi037.stderr: -46> 2024-09-12T17:36:29.463+0000 7fe597832800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:36:29.612 INFO:tasks.workunit.client.0.smithi037.stderr: -45> 2024-09-12T17:36:29.463+0000 7fe597832800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40, ofs0, ns] 2024-09-12T17:36:29.612 INFO:tasks.workunit.client.0.smithi037.stderr: -44> 2024-09-12T17:36:29.464+0000 7fe475ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497008 cookie 93935619823760 notifier 7496 bl.length()=1015 2024-09-12T17:36:29.612 INFO:tasks.workunit.client.0.smithi037.stderr: -43> 2024-09-12T17:36:29.464+0000 7fe475ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40 info.flags=0x17 2024-09-12T17:36:29.612 INFO:tasks.workunit.client.0.smithi037.stderr: -42> 2024-09-12T17:36:29.464+0000 7fe475ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40 to cache LRU end 2024-09-12T17:36:29.612 INFO:tasks.workunit.client.0.smithi037.stderr: -41> 2024-09-12T17:36:29.464+0000 7fe475ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:36:29.612 INFO:tasks.workunit.client.0.smithi037.stderr: -40> 2024-09-12T17:36:29.465+0000 7fe597832800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40]): orig_sources= new_sources= 2024-09-12T17:36:29.613 INFO:tasks.workunit.client.0.smithi037.stderr: -39> 2024-09-12T17:36:29.465+0000 7fe597832800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40]): potential sources added=[] removed=[] 2024-09-12T17:36:29.613 INFO:tasks.workunit.client.0.smithi037.stderr: -38> 2024-09-12T17:36:29.465+0000 7fe597832800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40]): orig_dests= new_dests= 2024-09-12T17:36:29.613 INFO:tasks.workunit.client.0.smithi037.stderr: -37> 2024-09-12T17:36:29.465+0000 7fe597832800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40]): potential dests added=[] removed=[] 2024-09-12T17:36:29.613 INFO:tasks.workunit.client.0.smithi037.stderr: -36> 2024-09-12T17:36:29.471+0000 7fe597832800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40.1.0 2024-09-12T17:36:29.613 INFO:tasks.workunit.client.0.smithi037.stderr: -35> 2024-09-12T17:36:29.471+0000 7fe597832800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40.1.0 2024-09-12T17:36:29.613 INFO:tasks.workunit.client.0.smithi037.stderr: -34> 2024-09-12T17:36:29.471+0000 7fe597832800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40.1.1 2024-09-12T17:36:29.613 INFO:tasks.workunit.client.0.smithi037.stderr: -33> 2024-09-12T17:36:29.471+0000 7fe597832800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40.1.1 2024-09-12T17:36:29.613 INFO:tasks.workunit.client.0.smithi037.stderr: -32> 2024-09-12T17:36:29.471+0000 7fe597832800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40.1.2 2024-09-12T17:36:29.613 INFO:tasks.workunit.client.0.smithi037.stderr: -31> 2024-09-12T17:36:29.471+0000 7fe597832800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40.1.2 2024-09-12T17:36:29.613 INFO:tasks.workunit.client.0.smithi037.stderr: -30> 2024-09-12T17:36:29.471+0000 7fe597832800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40.1.3 2024-09-12T17:36:29.613 INFO:tasks.workunit.client.0.smithi037.stderr: -29> 2024-09-12T17:36:29.471+0000 7fe597832800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40.1.3 2024-09-12T17:36:29.614 INFO:tasks.workunit.client.0.smithi037.stderr: -28> 2024-09-12T17:36:29.471+0000 7fe597832800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40.1.4 2024-09-12T17:36:29.614 INFO:tasks.workunit.client.0.smithi037.stderr: -27> 2024-09-12T17:36:29.471+0000 7fe597832800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40.1.4 2024-09-12T17:36:29.614 INFO:tasks.workunit.client.0.smithi037.stderr: -26> 2024-09-12T17:36:29.471+0000 7fe597832800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40.1.5 2024-09-12T17:36:29.614 INFO:tasks.workunit.client.0.smithi037.stderr: -25> 2024-09-12T17:36:29.471+0000 7fe597832800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40.1.5 2024-09-12T17:36:29.614 INFO:tasks.workunit.client.0.smithi037.stderr: -24> 2024-09-12T17:36:29.471+0000 7fe597832800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40.1.6 2024-09-12T17:36:29.614 INFO:tasks.workunit.client.0.smithi037.stderr: -23> 2024-09-12T17:36:29.471+0000 7fe597832800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40.1.6 2024-09-12T17:36:29.614 INFO:tasks.workunit.client.0.smithi037.stderr: -22> 2024-09-12T17:36:29.471+0000 7fe597832800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40.1.7 2024-09-12T17:36:29.614 INFO:tasks.workunit.client.0.smithi037.stderr: -21> 2024-09-12T17:36:29.471+0000 7fe597832800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40.1.7 2024-09-12T17:36:29.614 INFO:tasks.workunit.client.0.smithi037.stderr: -20> 2024-09-12T17:36:29.471+0000 7fe597832800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40.1.8 2024-09-12T17:36:29.615 INFO:tasks.workunit.client.0.smithi037.stderr: -19> 2024-09-12T17:36:29.471+0000 7fe597832800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40.1.8 2024-09-12T17:36:29.615 INFO:tasks.workunit.client.0.smithi037.stderr: -18> 2024-09-12T17:36:29.471+0000 7fe597832800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40.1.9 2024-09-12T17:36:29.615 INFO:tasks.workunit.client.0.smithi037.stderr: -17> 2024-09-12T17:36:29.471+0000 7fe597832800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40.1.9 2024-09-12T17:36:29.615 INFO:tasks.workunit.client.0.smithi037.stderr: -16> 2024-09-12T17:36:29.471+0000 7fe597832800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40.1.10 2024-09-12T17:36:29.615 INFO:tasks.workunit.client.0.smithi037.stderr: -15> 2024-09-12T17:36:29.471+0000 7fe597832800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40.1.10 2024-09-12T17:36:29.615 INFO:tasks.workunit.client.0.smithi037.stderr: -14> 2024-09-12T17:36:29.471+0000 7fe597832800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40.1.11 2024-09-12T17:36:29.615 INFO:tasks.workunit.client.0.smithi037.stderr: -13> 2024-09-12T17:36:29.471+0000 7fe597832800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40.1.11 2024-09-12T17:36:29.615 INFO:tasks.workunit.client.0.smithi037.stderr: -12> 2024-09-12T17:36:29.471+0000 7fe597832800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40.0 2024-09-12T17:36:29.615 INFO:tasks.workunit.client.0.smithi037.stderr: -11> 2024-09-12T17:36:29.471+0000 7fe597832800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40.1 2024-09-12T17:36:29.615 INFO:tasks.workunit.client.0.smithi037.stderr: -10> 2024-09-12T17:36:29.472+0000 7fe597832800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40.2 2024-09-12T17:36:29.615 INFO:tasks.workunit.client.0.smithi037.stderr: -9> 2024-09-12T17:36:29.472+0000 7fe597832800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40.3 2024-09-12T17:36:29.616 INFO:tasks.workunit.client.0.smithi037.stderr: -8> 2024-09-12T17:36:29.473+0000 7fe597832800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40.4 2024-09-12T17:36:29.616 INFO:tasks.workunit.client.0.smithi037.stderr: -7> 2024-09-12T17:36:29.474+0000 7fe597832800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40.5 2024-09-12T17:36:29.616 INFO:tasks.workunit.client.0.smithi037.stderr: -6> 2024-09-12T17:36:29.474+0000 7fe597832800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40.6 2024-09-12T17:36:29.616 INFO:tasks.workunit.client.0.smithi037.stderr: -5> 2024-09-12T17:36:29.475+0000 7fe597832800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40.7 2024-09-12T17:36:29.616 INFO:tasks.workunit.client.0.smithi037.stderr: -4> 2024-09-12T17:36:29.475+0000 7fe597832800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40.8 2024-09-12T17:36:29.616 INFO:tasks.workunit.client.0.smithi037.stderr: -3> 2024-09-12T17:36:29.476+0000 7fe597832800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40.9 2024-09-12T17:36:29.616 INFO:tasks.workunit.client.0.smithi037.stderr: -2> 2024-09-12T17:36:29.476+0000 7fe597832800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40.10 2024-09-12T17:36:29.616 INFO:tasks.workunit.client.0.smithi037.stderr: -1> 2024-09-12T17:36:29.480+0000 7fe597832800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fe597832800 time 2024-09-12T17:36:29.480591+0000 2024-09-12T17:36:29.617 INFO:tasks.workunit.client.0.smithi037.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:36:29.617 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:36:29.617 INFO:tasks.workunit.client.0.smithi037.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:36:29.617 INFO:tasks.workunit.client.0.smithi037.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fe59858c71a] 2024-09-12T17:36:29.617 INFO:tasks.workunit.client.0.smithi037.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fe59858c8d8] 2024-09-12T17:36:29.617 INFO:tasks.workunit.client.0.smithi037.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x556f16309841] 2024-09-12T17:36:29.617 INFO:tasks.workunit.client.0.smithi037.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x556f16318734] 2024-09-12T17:36:29.617 INFO:tasks.workunit.client.0.smithi037.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x556f163195d4] 2024-09-12T17:36:29.617 INFO:tasks.workunit.client.0.smithi037.stderr: 6: main() 2024-09-12T17:36:29.617 INFO:tasks.workunit.client.0.smithi037.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fe597229590] 2024-09-12T17:36:29.617 INFO:tasks.workunit.client.0.smithi037.stderr: 8: __libc_start_main() 2024-09-12T17:36:29.617 INFO:tasks.workunit.client.0.smithi037.stderr: 9: _start() 2024-09-12T17:36:29.617 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:36:29.618 INFO:tasks.workunit.client.0.smithi037.stderr: 0> 2024-09-12T17:36:29.481+0000 7fe597832800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:36:29.618 INFO:tasks.workunit.client.0.smithi037.stderr: in thread 7fe597832800 thread_name:radosgw-admin 2024-09-12T17:36:29.618 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:36:29.618 INFO:tasks.workunit.client.0.smithi037.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:36:29.618 INFO:tasks.workunit.client.0.smithi037.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fe59723e6f0] 2024-09-12T17:36:29.618 INFO:tasks.workunit.client.0.smithi037.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fe59728b99c] 2024-09-12T17:36:29.618 INFO:tasks.workunit.client.0.smithi037.stderr: 3: raise() 2024-09-12T17:36:29.618 INFO:tasks.workunit.client.0.smithi037.stderr: 4: abort() 2024-09-12T17:36:29.618 INFO:tasks.workunit.client.0.smithi037.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fe59858c774] 2024-09-12T17:36:29.619 INFO:tasks.workunit.client.0.smithi037.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fe59858c8d8] 2024-09-12T17:36:29.619 INFO:tasks.workunit.client.0.smithi037.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x556f16309841] 2024-09-12T17:36:29.619 INFO:tasks.workunit.client.0.smithi037.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x556f16318734] 2024-09-12T17:36:29.619 INFO:tasks.workunit.client.0.smithi037.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x556f163195d4] 2024-09-12T17:36:29.619 INFO:tasks.workunit.client.0.smithi037.stderr: 10: main() 2024-09-12T17:36:29.619 INFO:tasks.workunit.client.0.smithi037.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fe597229590] 2024-09-12T17:36:29.619 INFO:tasks.workunit.client.0.smithi037.stderr: 12: __libc_start_main() 2024-09-12T17:36:29.619 INFO:tasks.workunit.client.0.smithi037.stderr: 13: _start() 2024-09-12T17:36:29.619 INFO:tasks.workunit.client.0.smithi037.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:36:29.619 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:36:29.619 INFO:tasks.workunit.client.0.smithi037.stderr:--- logging levels --- 2024-09-12T17:36:29.619 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 none 2024-09-12T17:36:29.620 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 lockdep 2024-09-12T17:36:29.620 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 context 2024-09-12T17:36:29.620 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 1 crush 2024-09-12T17:36:29.620 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mds 2024-09-12T17:36:29.620 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mds_balancer 2024-09-12T17:36:29.620 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mds_locker 2024-09-12T17:36:29.620 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mds_log 2024-09-12T17:36:29.620 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mds_log_expire 2024-09-12T17:36:29.621 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mds_migrator 2024-09-12T17:36:29.621 INFO:tasks.workunit.client.0.smithi037.stderr: 3/ 5 mds_quiesce 2024-09-12T17:36:29.621 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 buffer 2024-09-12T17:36:29.621 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 timer 2024-09-12T17:36:29.621 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 filer 2024-09-12T17:36:29.621 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 striper 2024-09-12T17:36:29.621 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 objecter 2024-09-12T17:36:29.621 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 rados 2024-09-12T17:36:29.621 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 rbd 2024-09-12T17:36:29.621 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 rbd_mirror 2024-09-12T17:36:29.621 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 rbd_replay 2024-09-12T17:36:29.621 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 rbd_pwl 2024-09-12T17:36:29.622 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 journaler 2024-09-12T17:36:29.622 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 objectcacher 2024-09-12T17:36:29.622 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:36:29.622 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 client 2024-09-12T17:36:29.622 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 osd 2024-09-12T17:36:29.622 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 optracker 2024-09-12T17:36:29.622 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 objclass 2024-09-12T17:36:29.622 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 3 filestore 2024-09-12T17:36:29.622 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 3 journal 2024-09-12T17:36:29.622 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 0 ms 2024-09-12T17:36:29.622 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mon 2024-09-12T17:36:29.623 INFO:tasks.workunit.client.0.smithi037.stderr: 0/10 monc 2024-09-12T17:36:29.623 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 paxos 2024-09-12T17:36:29.623 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 tp 2024-09-12T17:36:29.623 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 auth 2024-09-12T17:36:29.623 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 crypto 2024-09-12T17:36:29.623 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 1 finisher 2024-09-12T17:36:29.623 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 1 reserver 2024-09-12T17:36:29.623 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 heartbeatmap 2024-09-12T17:36:29.623 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 perfcounter 2024-09-12T17:36:29.623 INFO:tasks.workunit.client.0.smithi037.stderr: 20/20 rgw 2024-09-12T17:36:29.623 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 rgw_sync 2024-09-12T17:36:29.623 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 rgw_datacache 2024-09-12T17:36:29.624 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 rgw_access 2024-09-12T17:36:29.624 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:36:29.624 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 rgw_flight 2024-09-12T17:36:29.624 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:36:29.624 INFO:tasks.workunit.client.0.smithi037.stderr: 20/20 rgw_notification 2024-09-12T17:36:29.624 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 javaclient 2024-09-12T17:36:29.624 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 asok 2024-09-12T17:36:29.624 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 1 throttle 2024-09-12T17:36:29.624 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 0 refs 2024-09-12T17:36:29.624 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 compressor 2024-09-12T17:36:29.624 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 bluestore 2024-09-12T17:36:29.624 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 bluefs 2024-09-12T17:36:29.625 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 3 bdev 2024-09-12T17:36:29.625 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 kstore 2024-09-12T17:36:29.625 INFO:tasks.workunit.client.0.smithi037.stderr: 4/ 5 rocksdb 2024-09-12T17:36:29.625 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 fuse 2024-09-12T17:36:29.625 INFO:tasks.workunit.client.0.smithi037.stderr: 2/ 5 mgr 2024-09-12T17:36:29.625 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mgrc 2024-09-12T17:36:29.625 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 dpdk 2024-09-12T17:36:29.625 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 eventtrace 2024-09-12T17:36:29.625 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 prioritycache 2024-09-12T17:36:29.625 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 test 2024-09-12T17:36:29.626 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:36:29.626 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 cephsqlite 2024-09-12T17:36:29.626 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:36:29.626 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore 2024-09-12T17:36:29.626 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_onode 2024-09-12T17:36:29.626 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_odata 2024-09-12T17:36:29.626 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_omap 2024-09-12T17:36:29.626 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_tm 2024-09-12T17:36:29.626 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_t 2024-09-12T17:36:29.626 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:36:29.626 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_epm 2024-09-12T17:36:29.626 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_lba 2024-09-12T17:36:29.626 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:36:29.627 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_cache 2024-09-12T17:36:29.627 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_journal 2024-09-12T17:36:29.627 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_device 2024-09-12T17:36:29.627 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_backref 2024-09-12T17:36:29.627 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 alienstore 2024-09-12T17:36:29.627 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mclock 2024-09-12T17:36:29.627 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 cyanstore 2024-09-12T17:36:29.627 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 ceph_exporter 2024-09-12T17:36:29.627 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 memstore 2024-09-12T17:36:29.628 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 trace 2024-09-12T17:36:29.628 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 ceph_dedup 2024-09-12T17:36:29.628 INFO:tasks.workunit.client.0.smithi037.stderr: -2/-2 (syslog threshold) 2024-09-12T17:36:29.628 INFO:tasks.workunit.client.0.smithi037.stderr: 99/99 (stderr threshold) 2024-09-12T17:36:29.628 INFO:tasks.workunit.client.0.smithi037.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:36:29.628 INFO:tasks.workunit.client.0.smithi037.stderr: 7fe3c1ffb640 / http_manager 2024-09-12T17:36:29.629 INFO:tasks.workunit.client.0.smithi037.stderr: 7fe3c3fff640 / http_manager 2024-09-12T17:36:29.629 INFO:tasks.workunit.client.0.smithi037.stderr: 7fe4497e2640 / rgw_dt_lg_renew 2024-09-12T17:36:29.629 INFO:tasks.workunit.client.0.smithi037.stderr: 7fe474ff9640 / ms_dispatch 2024-09-12T17:36:29.629 INFO:tasks.workunit.client.0.smithi037.stderr: 7fe475ffb640 / io_context_pool 2024-09-12T17:36:29.629 INFO:tasks.workunit.client.0.smithi037.stderr: 7fe4767fc640 / io_context_pool 2024-09-12T17:36:29.629 INFO:tasks.workunit.client.0.smithi037.stderr: 7fe47ce01640 / ms_dispatch 2024-09-12T17:36:29.629 INFO:tasks.workunit.client.0.smithi037.stderr: 7fe47f606640 / ms_dispatch 2024-09-12T17:36:29.629 INFO:tasks.workunit.client.0.smithi037.stderr: 7fe480e09640 / io_context_pool 2024-09-12T17:36:29.629 INFO:tasks.workunit.client.0.smithi037.stderr: 7fe58a352640 / msgr-worker-2 2024-09-12T17:36:29.629 INFO:tasks.workunit.client.0.smithi037.stderr: 7fe592b53640 / msgr-worker-1 2024-09-12T17:36:29.629 INFO:tasks.workunit.client.0.smithi037.stderr: 7fe593354640 / msgr-worker-0 2024-09-12T17:36:29.629 INFO:tasks.workunit.client.0.smithi037.stderr: 7fe593b55640 / io_context_pool 2024-09-12T17:36:29.629 INFO:tasks.workunit.client.0.smithi037.stderr: 7fe597832800 / radosgw-admin 2024-09-12T17:36:29.629 INFO:tasks.workunit.client.0.smithi037.stderr: max_recent 500 2024-09-12T17:36:29.630 INFO:tasks.workunit.client.0.smithi037.stderr: max_new 1000 2024-09-12T17:36:29.630 INFO:tasks.workunit.client.0.smithi037.stderr: log_file /var/lib/ceph/crash/2024-09-12T17:36:29.482240Z_00d98e8d-fef2-4433-808b-e98adc661194/log 2024-09-12T17:36:29.630 INFO:tasks.workunit.client.0.smithi037.stderr:--- end dump of recent events --- 2024-09-12T17:36:29.630 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bucket stats --bucket abort-at-change-reshard-state 2024-09-12T17:36:29.635 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:36:29.635 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:36:29.635 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.560+0000 7fc36d92c800 20 rados->read ofs=0 len=0 2024-09-12T17:36:29.635 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.562+0000 7fc36d92c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:29.635 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.562+0000 7fc36d92c800 20 realm 2024-09-12T17:36:29.635 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.562+0000 7fc36d92c800 20 rados->read ofs=0 len=0 2024-09-12T17:36:29.635 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.562+0000 7fc36d92c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:29.636 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.562+0000 7fc36d92c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:36:29.636 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.562+0000 7fc36d92c800 20 rados->read ofs=0 len=0 2024-09-12T17:36:29.636 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.562+0000 7fc36d92c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:29.636 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.562+0000 7fc36d92c800 20 rados->read ofs=0 len=0 2024-09-12T17:36:29.636 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.563+0000 7fc36d92c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:36:29.636 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.563+0000 7fc36d92c800 20 rados->read ofs=0 len=0 2024-09-12T17:36:29.636 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.564+0000 7fc36d92c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:36:29.636 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.564+0000 7fc36d92c800 20 searching for the correct realm 2024-09-12T17:36:29.636 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.568+0000 7fc368e4e640 0 -- 172.21.15.37:0/2886619104 >> [v2:172.21.15.40:6800/2441293461,v1:172.21.15.40:6801/2441293461] conn(0x7fc35c07f040 msgr2=0x7fc35c063930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:36:29.636 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.571+0000 7fc368e4e640 0 -- 172.21.15.37:0/2886619104 >> [v2:172.21.15.40:6800/2441293461,v1:172.21.15.40:6801/2441293461] conn(0x7fc234086b10 msgr2=0x7fc234088f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:36:29.636 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.575+0000 7fc36d92c800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:36:29.636 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.575+0000 7fc36d92c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:36:29.636 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.575+0000 7fc36d92c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:36:29.637 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.575+0000 7fc36d92c800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:36:29.637 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.575+0000 7fc36d92c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:36:29.637 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.575+0000 7fc36d92c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:36:29.637 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.575+0000 7fc36d92c800 20 rados->read ofs=0 len=0 2024-09-12T17:36:29.637 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.576+0000 7fc36d92c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:29.637 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.576+0000 7fc36d92c800 20 rados->read ofs=0 len=0 2024-09-12T17:36:29.637 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.576+0000 7fc36d92c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:36:29.637 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.576+0000 7fc36d92c800 20 rados->read ofs=0 len=0 2024-09-12T17:36:29.637 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.576+0000 7fc36d92c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:36:29.637 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.576+0000 7fc36d92c800 20 zone default found 2024-09-12T17:36:29.637 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.576+0000 7fc36d92c800 4 Realm: () 2024-09-12T17:36:29.637 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.576+0000 7fc36d92c800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:36:29.637 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.576+0000 7fc36d92c800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:36:29.637 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.576+0000 7fc36d92c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:36:29.638 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.576+0000 7fc36d92c800 20 zonegroup default 2024-09-12T17:36:29.638 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.576+0000 7fc36d92c800 20 rados->read ofs=0 len=0 2024-09-12T17:36:29.638 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.577+0000 7fc36d92c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:29.638 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.577+0000 7fc36d92c800 20 rados->read ofs=0 len=0 2024-09-12T17:36:29.638 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.577+0000 7fc36d92c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:29.638 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.577+0000 7fc36d92c800 20 rados->read ofs=0 len=0 2024-09-12T17:36:29.638 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.577+0000 7fc36d92c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:29.638 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.577+0000 7fc36d92c800 20 started sync module instance, tier type = 2024-09-12T17:36:29.638 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.577+0000 7fc36d92c800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:36:29.638 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.587+0000 7fc36d92c800 20 add_watcher() i=0 2024-09-12T17:36:29.638 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.587+0000 7fc36d92c800 20 add_watcher() i=1 2024-09-12T17:36:29.638 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.587+0000 7fc36d92c800 20 add_watcher() i=2 2024-09-12T17:36:29.638 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.587+0000 7fc36d92c800 20 add_watcher() i=3 2024-09-12T17:36:29.638 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.587+0000 7fc36d92c800 20 add_watcher() i=4 2024-09-12T17:36:29.639 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.587+0000 7fc36d92c800 20 add_watcher() i=5 2024-09-12T17:36:29.639 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.587+0000 7fc36d92c800 20 add_watcher() i=6 2024-09-12T17:36:29.639 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.588+0000 7fc36d92c800 20 add_watcher() i=7 2024-09-12T17:36:29.639 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.588+0000 7fc36d92c800 2 all 8 watchers are set, enabling cache 2024-09-12T17:36:29.639 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.590+0000 7fc21f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:36:29.639 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.590+0000 7fc36d92c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:36:29.639 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.590+0000 7fc36d92c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:36:29.639 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.590+0000 7fc36d92c800 5 note: GC not initialized 2024-09-12T17:36:29.639 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.590+0000 7fc21e7e4640 20 reqs_thread_entry: start 2024-09-12T17:36:29.639 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.590+0000 7fc36d92c800 20 init_complete bucket index max shards: 11 2024-09-12T17:36:29.639 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.590+0000 7fc36d92c800 20 Filter name: none 2024-09-12T17:36:29.639 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.590+0000 7fc18ffff640 20 reqs_thread_entry: start 2024-09-12T17:36:29.639 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.590+0000 7fc36d92c800 20 rados->read ofs=0 len=0 2024-09-12T17:36:29.639 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.591+0000 7fc36d92c800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:36:29.640 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.591+0000 7fc36d92c800 20 rados->read ofs=0 len=0 2024-09-12T17:36:29.640 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.591+0000 7fc36d92c800 20 rados_obj.operate() r=0 bl.length=475 2024-09-12T17:36:29.640 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.591+0000 7fc36d92c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:36:29.640 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.591+0000 7fc36d92c800 20 rados->read ofs=0 len=0 2024-09-12T17:36:29.640 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.592+0000 7fc36d92c800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:36:29.640 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.592+0000 7fc36d92c800 20 rados->read ofs=0 len=0 2024-09-12T17:36:29.640 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.592+0000 7fc36d92c800 20 rados_obj.operate() r=0 bl.length=475 2024-09-12T17:36:29.640 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.592+0000 7fc36d92c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:36:29.640 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.594+0000 7fc21f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:36:29.640 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.596+0000 7fc36d92c800 20 remove_watcher() i=0 2024-09-12T17:36:29.640 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.596+0000 7fc36d92c800 2 removed watcher, disabling cache 2024-09-12T17:36:29.640 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.597+0000 7fc36d92c800 20 remove_watcher() i=1 2024-09-12T17:36:29.640 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.598+0000 7fc36d92c800 20 remove_watcher() i=2 2024-09-12T17:36:29.641 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.600+0000 7fc36d92c800 20 remove_watcher() i=3 2024-09-12T17:36:29.641 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.601+0000 7fc36d92c800 20 remove_watcher() i=4 2024-09-12T17:36:29.641 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.602+0000 7fc36d92c800 20 remove_watcher() i=5 2024-09-12T17:36:29.641 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.603+0000 7fc36d92c800 20 remove_watcher() i=6 2024-09-12T17:36:29.641 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.604+0000 7fc36d92c800 20 remove_watcher() i=7 2024-09-12T17:36:29.641 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:36:29.641 INFO:tasks.workunit.client.0.smithi037.stderr:BUCKET_STATS: 2024-09-12T17:36:29.641 INFO:tasks.workunit.client.0.smithi037.stderr:bucket: abort-at-change-reshard-state id: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:36:29.641 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:36:29.706 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bucket reshard --bucket abort-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:36:29.739 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:36:29.739 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:36:29.779 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.778+0000 7f3a69898800 20 rados->read ofs=0 len=0 2024-09-12T17:36:29.781 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.780+0000 7f3a69898800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:29.781 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.780+0000 7f3a69898800 20 realm 2024-09-12T17:36:29.781 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.780+0000 7f3a69898800 20 rados->read ofs=0 len=0 2024-09-12T17:36:29.781 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.780+0000 7f3a69898800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:29.782 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.780+0000 7f3a69898800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:36:29.782 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.780+0000 7f3a69898800 20 rados->read ofs=0 len=0 2024-09-12T17:36:29.782 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.780+0000 7f3a69898800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:29.782 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.780+0000 7f3a69898800 20 rados->read ofs=0 len=0 2024-09-12T17:36:29.782 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.781+0000 7f3a69898800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:36:29.783 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.781+0000 7f3a69898800 20 rados->read ofs=0 len=0 2024-09-12T17:36:29.783 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.782+0000 7f3a69898800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:36:29.783 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.782+0000 7f3a69898800 20 searching for the correct realm 2024-09-12T17:36:29.786 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.785+0000 7f3a67b83640 0 -- 172.21.15.37:0/2366387174 >> [v2:172.21.15.40:6818/1210108009,v1:172.21.15.40:6819/1210108009] conn(0x7f3a5c01a040 msgr2=0x7f3a5c067790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:36:29.789 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.789+0000 7f3a66b81640 0 -- 172.21.15.37:0/2366387174 >> [v2:172.21.15.40:6800/2441293461,v1:172.21.15.40:6801/2441293461] conn(0x7f3a5809b060 msgr2=0x7f3a5806ba10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:36:29.795 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.794+0000 7f3a69898800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:36:29.795 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.794+0000 7f3a69898800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:36:29.795 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.794+0000 7f3a69898800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:36:29.795 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.794+0000 7f3a69898800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:36:29.795 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.794+0000 7f3a69898800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:36:29.795 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.794+0000 7f3a69898800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:36:29.795 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.794+0000 7f3a69898800 20 rados->read ofs=0 len=0 2024-09-12T17:36:29.796 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.794+0000 7f3a69898800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:29.796 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.794+0000 7f3a69898800 20 rados->read ofs=0 len=0 2024-09-12T17:36:29.797 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.795+0000 7f3a69898800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:36:29.797 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.795+0000 7f3a69898800 20 rados->read ofs=0 len=0 2024-09-12T17:36:29.797 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.795+0000 7f3a69898800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:36:29.797 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.795+0000 7f3a69898800 20 zone default found 2024-09-12T17:36:29.797 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.795+0000 7f3a69898800 4 Realm: () 2024-09-12T17:36:29.797 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.795+0000 7f3a69898800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:36:29.797 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.795+0000 7f3a69898800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:36:29.797 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.795+0000 7f3a69898800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:36:29.798 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.795+0000 7f3a69898800 20 zonegroup default 2024-09-12T17:36:29.798 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.795+0000 7f3a69898800 20 rados->read ofs=0 len=0 2024-09-12T17:36:29.798 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.795+0000 7f3a69898800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:29.798 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.795+0000 7f3a69898800 20 rados->read ofs=0 len=0 2024-09-12T17:36:29.798 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.796+0000 7f3a69898800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:29.798 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.796+0000 7f3a69898800 20 rados->read ofs=0 len=0 2024-09-12T17:36:29.798 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.796+0000 7f3a69898800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:29.798 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.796+0000 7f3a69898800 20 started sync module instance, tier type = 2024-09-12T17:36:29.798 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.796+0000 7f3a69898800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:36:29.806 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.806+0000 7f3a69898800 20 add_watcher() i=0 2024-09-12T17:36:29.807 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.806+0000 7f3a69898800 20 add_watcher() i=1 2024-09-12T17:36:29.807 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.806+0000 7f3a69898800 20 add_watcher() i=2 2024-09-12T17:36:29.807 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.806+0000 7f3a69898800 20 add_watcher() i=3 2024-09-12T17:36:29.807 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.806+0000 7f3a69898800 20 add_watcher() i=4 2024-09-12T17:36:29.807 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.806+0000 7f3a69898800 20 add_watcher() i=5 2024-09-12T17:36:29.807 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.806+0000 7f3a69898800 20 add_watcher() i=6 2024-09-12T17:36:29.807 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.806+0000 7f3a69898800 20 add_watcher() i=7 2024-09-12T17:36:29.808 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.806+0000 7f3a69898800 2 all 8 watchers are set, enabling cache 2024-09-12T17:36:29.810 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.808+0000 7f391dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:36:29.810 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.809+0000 7f3a69898800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:36:29.810 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.809+0000 7f3a69898800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:36:29.810 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.809+0000 7f3a69898800 5 note: GC not initialized 2024-09-12T17:36:29.811 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.809+0000 7f391cfe1640 20 reqs_thread_entry: start 2024-09-12T17:36:29.811 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.809+0000 7f3a69898800 20 init_complete bucket index max shards: 11 2024-09-12T17:36:29.811 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.809+0000 7f3a69898800 20 Filter name: none 2024-09-12T17:36:29.811 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.809+0000 7f38967fc640 20 reqs_thread_entry: start 2024-09-12T17:36:29.811 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.809+0000 7f3a69898800 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-12T17:36:29.811 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.809+0000 7f3a69898800 20 rados->read ofs=0 len=0 2024-09-12T17:36:29.811 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.809+0000 7f3a69898800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:36:29.811 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.809+0000 7f3a69898800 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-12T17:36:29.811 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.809+0000 7f3a69898800 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-12T17:36:29.811 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.809+0000 7f3a69898800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40 : miss 2024-09-12T17:36:29.811 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.809+0000 7f3a69898800 20 rados->read ofs=0 len=0 2024-09-12T17:36:29.812 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.810+0000 7f3a69898800 20 rados_obj.operate() r=0 bl.length=475 2024-09-12T17:36:29.812 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.810+0000 7f3a69898800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40 info.flags=0x17 2024-09-12T17:36:29.812 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.810+0000 7f3a69898800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40 to cache LRU end 2024-09-12T17:36:29.813 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.810+0000 7f3a69898800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:36:29.813 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.810+0000 7f3a69898800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:36:29.813 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.810+0000 7f3a69898800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40 2024-09-12T17:36:29.813 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.811+0000 7f3a69898800 0 INFO: RGWReshardLock::lock found lock on abort-at-change-reshard-state:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40 to be held by another RGW process; skipping for now 2024-09-12T17:36:29.813 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.812+0000 7f391dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:36:29.815 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.814+0000 7f3a69898800 20 remove_watcher() i=0 2024-09-12T17:36:29.815 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.814+0000 7f3a69898800 2 removed watcher, disabling cache 2024-09-12T17:36:29.816 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.816+0000 7f3a69898800 20 remove_watcher() i=1 2024-09-12T17:36:29.817 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.817+0000 7f3a69898800 20 remove_watcher() i=2 2024-09-12T17:36:29.818 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.818+0000 7f3a69898800 20 remove_watcher() i=3 2024-09-12T17:36:29.820 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.819+0000 7f3a69898800 20 remove_watcher() i=4 2024-09-12T17:36:29.821 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.820+0000 7f3a69898800 20 remove_watcher() i=5 2024-09-12T17:36:29.821 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.821+0000 7f3a69898800 20 remove_watcher() i=6 2024-09-12T17:36:29.822 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:29.822+0000 7f3a69898800 20 remove_watcher() i=7 2024-09-12T17:36:29.834 INFO:tasks.workunit.client.0.smithi037.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T17:36:59.861 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bucket reshard --bucket abort-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:36:59.900 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:36:59.900 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:36:59.946 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:59.944+0000 7f5e6c12c800 20 rados->read ofs=0 len=0 2024-09-12T17:36:59.948 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:59.946+0000 7f5e6c12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:59.948 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:59.946+0000 7f5e6c12c800 20 realm 2024-09-12T17:36:59.948 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:59.946+0000 7f5e6c12c800 20 rados->read ofs=0 len=0 2024-09-12T17:36:59.948 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:59.946+0000 7f5e6c12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:59.948 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:59.946+0000 7f5e6c12c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:36:59.948 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:59.946+0000 7f5e6c12c800 20 rados->read ofs=0 len=0 2024-09-12T17:36:59.948 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:59.946+0000 7f5e6c12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:59.948 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:59.946+0000 7f5e6c12c800 20 rados->read ofs=0 len=0 2024-09-12T17:36:59.949 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:59.947+0000 7f5e6c12c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:36:59.949 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:59.947+0000 7f5e6c12c800 20 rados->read ofs=0 len=0 2024-09-12T17:36:59.949 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:59.947+0000 7f5e6c12c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:36:59.949 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:59.947+0000 7f5e6c12c800 20 searching for the correct realm 2024-09-12T17:36:59.953 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:59.951+0000 7f5e6853f640 0 -- 172.21.15.37:0/207207308 >> [v2:172.21.15.40:6818/1210108009,v1:172.21.15.40:6819/1210108009] conn(0x7f5e5c092030 msgr2=0x7f5e5c0e68f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:36:59.957 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:59.955+0000 7f5e67d3e640 0 -- 172.21.15.37:0/207207308 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7f5e5c0dfc20 msgr2=0x7f5e5c0976a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:36:59.963 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:59.960+0000 7f5e6c12c800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:36:59.963 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:59.960+0000 7f5e6c12c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:36:59.963 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:59.960+0000 7f5e6c12c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:36:59.963 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:59.960+0000 7f5e6c12c800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:36:59.963 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:59.960+0000 7f5e6c12c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:36:59.963 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:59.960+0000 7f5e6c12c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:36:59.963 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:59.960+0000 7f5e6c12c800 20 rados->read ofs=0 len=0 2024-09-12T17:36:59.963 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:59.961+0000 7f5e6c12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:59.963 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:59.961+0000 7f5e6c12c800 20 rados->read ofs=0 len=0 2024-09-12T17:36:59.963 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:59.961+0000 7f5e6c12c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:36:59.964 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:59.961+0000 7f5e6c12c800 20 rados->read ofs=0 len=0 2024-09-12T17:36:59.965 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:59.961+0000 7f5e6c12c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:36:59.965 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:59.961+0000 7f5e6c12c800 20 zone default found 2024-09-12T17:36:59.965 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:59.961+0000 7f5e6c12c800 4 Realm: () 2024-09-12T17:36:59.965 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:59.961+0000 7f5e6c12c800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:36:59.965 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:59.961+0000 7f5e6c12c800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:36:59.965 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:59.961+0000 7f5e6c12c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:36:59.965 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:59.961+0000 7f5e6c12c800 20 zonegroup default 2024-09-12T17:36:59.965 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:59.961+0000 7f5e6c12c800 20 rados->read ofs=0 len=0 2024-09-12T17:36:59.965 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:59.962+0000 7f5e6c12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:59.966 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:59.962+0000 7f5e6c12c800 20 rados->read ofs=0 len=0 2024-09-12T17:36:59.966 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:59.962+0000 7f5e6c12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:59.966 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:59.962+0000 7f5e6c12c800 20 rados->read ofs=0 len=0 2024-09-12T17:36:59.966 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:59.962+0000 7f5e6c12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:36:59.966 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:59.962+0000 7f5e6c12c800 20 started sync module instance, tier type = 2024-09-12T17:36:59.966 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:59.962+0000 7f5e6c12c800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:36:59.976 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:59.974+0000 7f5e6c12c800 20 add_watcher() i=0 2024-09-12T17:36:59.976 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:59.974+0000 7f5e6c12c800 20 add_watcher() i=1 2024-09-12T17:36:59.976 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:59.974+0000 7f5e6c12c800 20 add_watcher() i=2 2024-09-12T17:36:59.977 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:59.974+0000 7f5e6c12c800 20 add_watcher() i=3 2024-09-12T17:36:59.977 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:59.974+0000 7f5e6c12c800 20 add_watcher() i=4 2024-09-12T17:36:59.977 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:59.974+0000 7f5e6c12c800 20 add_watcher() i=5 2024-09-12T17:36:59.977 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:59.974+0000 7f5e6c12c800 20 add_watcher() i=6 2024-09-12T17:36:59.980 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:59.976+0000 7f5e6c12c800 20 add_watcher() i=7 2024-09-12T17:36:59.980 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:59.976+0000 7f5e6c12c800 2 all 8 watchers are set, enabling cache 2024-09-12T17:36:59.982 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:59.978+0000 7f5d1dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:36:59.983 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:59.978+0000 7f5e6c12c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:36:59.983 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:59.978+0000 7f5e6c12c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:36:59.983 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:59.978+0000 7f5e6c12c800 5 note: GC not initialized 2024-09-12T17:36:59.983 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:59.978+0000 7f5d1cfe1640 20 reqs_thread_entry: start 2024-09-12T17:36:59.983 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:59.979+0000 7f5e6c12c800 20 init_complete bucket index max shards: 11 2024-09-12T17:36:59.983 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:59.979+0000 7f5e6c12c800 20 Filter name: none 2024-09-12T17:36:59.983 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:59.979+0000 7f5c967fc640 20 reqs_thread_entry: start 2024-09-12T17:36:59.983 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:59.979+0000 7f5e6c12c800 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-12T17:36:59.983 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:59.979+0000 7f5e6c12c800 20 rados->read ofs=0 len=0 2024-09-12T17:36:59.983 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:59.979+0000 7f5e6c12c800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:36:59.983 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:59.979+0000 7f5e6c12c800 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-12T17:36:59.983 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:59.979+0000 7f5e6c12c800 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-12T17:36:59.983 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:59.979+0000 7f5e6c12c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40 : miss 2024-09-12T17:36:59.984 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:59.979+0000 7f5e6c12c800 20 rados->read ofs=0 len=0 2024-09-12T17:36:59.984 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:59.980+0000 7f5e6c12c800 20 rados_obj.operate() r=0 bl.length=475 2024-09-12T17:36:59.984 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:59.980+0000 7f5e6c12c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40 info.flags=0x17 2024-09-12T17:36:59.984 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:59.980+0000 7f5e6c12c800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40 to cache LRU end 2024-09-12T17:36:59.985 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:59.980+0000 7f5e6c12c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:36:59.985 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:59.980+0000 7f5e6c12c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:36:59.985 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:59.980+0000 7f5e6c12c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40 2024-09-12T17:36:59.985 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:59.981+0000 7f5e6c12c800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T17:36:59.991 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:59.990+0000 7f5e6c12c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40 info.flags=0x17 2024-09-12T17:36:59.991 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:59.990+0000 7f5e6c12c800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40 to cache LRU end 2024-09-12T17:36:59.992 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:59.990+0000 7f5e6c12c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:36:59.992 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:59.990+0000 7f5e6c12c800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40, ofs0, ns] 2024-09-12T17:36:59.993 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:59.990+0000 7f5d46ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497009 cookie 94105888421712 notifier 8088 bl.length()=1015 2024-09-12T17:36:59.993 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:59.990+0000 7f5d46ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40 info.flags=0x17 2024-09-12T17:36:59.993 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:59.990+0000 7f5d46ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40 to cache LRU end 2024-09-12T17:36:59.993 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:59.990+0000 7f5d46ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:36:59.993 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:59.992+0000 7f5e6c12c800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40]): orig_sources= new_sources= 2024-09-12T17:36:59.994 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:59.992+0000 7f5e6c12c800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40]): potential sources added=[] removed=[] 2024-09-12T17:36:59.994 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:59.992+0000 7f5e6c12c800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40]): orig_dests= new_dests= 2024-09-12T17:36:59.994 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:59.992+0000 7f5e6c12c800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40]): potential dests added=[] removed=[] 2024-09-12T17:37:00.001 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:59.998+0000 7f5e6c12c800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40.2.0 2024-09-12T17:37:00.001 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:59.998+0000 7f5e6c12c800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40.2.0 2024-09-12T17:37:00.001 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:59.998+0000 7f5e6c12c800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40.2.1 2024-09-12T17:37:00.001 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:59.998+0000 7f5e6c12c800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40.2.1 2024-09-12T17:37:00.001 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:59.998+0000 7f5e6c12c800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40.2.2 2024-09-12T17:37:00.001 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:59.998+0000 7f5e6c12c800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40.2.2 2024-09-12T17:37:00.001 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:59.998+0000 7f5e6c12c800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40.2.3 2024-09-12T17:37:00.001 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:59.998+0000 7f5e6c12c800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40.2.3 2024-09-12T17:37:00.001 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:59.998+0000 7f5e6c12c800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40.2.4 2024-09-12T17:37:00.001 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:59.998+0000 7f5e6c12c800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40.2.4 2024-09-12T17:37:00.001 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:59.998+0000 7f5e6c12c800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40.2.5 2024-09-12T17:37:00.001 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:59.998+0000 7f5e6c12c800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40.2.5 2024-09-12T17:37:00.001 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:59.998+0000 7f5e6c12c800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40.2.6 2024-09-12T17:37:00.002 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:59.998+0000 7f5e6c12c800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40.2.6 2024-09-12T17:37:00.002 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:59.998+0000 7f5e6c12c800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40.2.7 2024-09-12T17:37:00.002 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:59.998+0000 7f5e6c12c800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40.2.7 2024-09-12T17:37:00.002 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:59.998+0000 7f5e6c12c800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40.2.8 2024-09-12T17:37:00.002 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:59.998+0000 7f5e6c12c800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40.2.8 2024-09-12T17:37:00.002 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:59.998+0000 7f5e6c12c800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40.2.9 2024-09-12T17:37:00.002 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:59.998+0000 7f5e6c12c800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40.2.9 2024-09-12T17:37:00.002 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:59.998+0000 7f5e6c12c800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40.2.10 2024-09-12T17:37:00.002 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:59.998+0000 7f5e6c12c800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40.2.10 2024-09-12T17:37:00.002 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:59.998+0000 7f5e6c12c800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40.2.11 2024-09-12T17:37:00.002 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:59.998+0000 7f5e6c12c800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40.2.11 2024-09-12T17:37:00.002 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:59.998+0000 7f5e6c12c800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40.0 2024-09-12T17:37:00.002 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:59.999+0000 7f5e6c12c800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40.1 2024-09-12T17:37:00.003 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:36:59.999+0000 7f5e6c12c800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40.2 2024-09-12T17:37:00.003 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.000+0000 7f5e6c12c800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40.3 2024-09-12T17:37:00.003 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.000+0000 7f5e6c12c800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40.4 2024-09-12T17:37:00.003 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.001+0000 7f5e6c12c800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40.5 2024-09-12T17:37:00.004 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.001+0000 7f5e6c12c800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40.6 2024-09-12T17:37:00.004 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.002+0000 7f5e6c12c800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40.7 2024-09-12T17:37:00.004 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.002+0000 7f5e6c12c800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40.8 2024-09-12T17:37:00.004 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.002+0000 7f5e6c12c800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40.9 2024-09-12T17:37:00.005 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.003+0000 7f5e6c12c800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40.10 2024-09-12T17:37:00.008 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.006+0000 7f5e6c12c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40 : hit (requested=0x17, cached=0x17) 2024-09-12T17:37:00.008 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.006+0000 7f5e6c12c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40 2024-09-12T17:37:00.009 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.007+0000 7f5e6c12c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40 info.flags=0x17 2024-09-12T17:37:00.009 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.007+0000 7f5e6c12c800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40 to cache LRU end 2024-09-12T17:37:00.009 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.007+0000 7f5e6c12c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:37:00.010 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.007+0000 7f5e6c12c800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40, ofs0, ns] 2024-09-12T17:37:00.010 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.008+0000 7f5d46ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497010 cookie 94105888421712 notifier 8088 bl.length()=1015 2024-09-12T17:37:00.010 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.008+0000 7f5d46ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40 info.flags=0x17 2024-09-12T17:37:00.010 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.008+0000 7f5d46ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40 to cache LRU end 2024-09-12T17:37:00.010 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.008+0000 7f5d46ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:37:00.011 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.009+0000 7f5e6c12c800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40]): orig_sources= new_sources= 2024-09-12T17:37:00.011 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.009+0000 7f5e6c12c800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40]): potential sources added=[] removed=[] 2024-09-12T17:37:00.012 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.009+0000 7f5e6c12c800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40]): orig_dests= new_dests= 2024-09-12T17:37:00.012 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.009+0000 7f5e6c12c800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40]): potential dests added=[] removed=[] 2024-09-12T17:37:00.014 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.012+0000 7f5e6c12c800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40.0 2024-09-12T17:37:00.014 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.012+0000 7f5e6c12c800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40.1 2024-09-12T17:37:00.014 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.013+0000 7f5e6c12c800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40.2 2024-09-12T17:37:00.014 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.013+0000 7f5e6c12c800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40.3 2024-09-12T17:37:00.015 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.013+0000 7f5e6c12c800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40.4 2024-09-12T17:37:00.015 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.014+0000 7f5e6c12c800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40.5 2024-09-12T17:37:00.015 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.014+0000 7f5e6c12c800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40.6 2024-09-12T17:37:00.016 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.014+0000 7f5e6c12c800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40.7 2024-09-12T17:37:00.016 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.014+0000 7f5e6c12c800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40.8 2024-09-12T17:37:00.017 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.015+0000 7f5e6c12c800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40.9 2024-09-12T17:37:00.017 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.015+0000 7f5e6c12c800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40.10 2024-09-12T17:37:00.017 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.015+0000 7f5e6c12c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40 : hit (requested=0x17, cached=0x17) 2024-09-12T17:37:00.017 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.015+0000 7f5e6c12c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40 2024-09-12T17:37:00.019 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.017+0000 7f5e6c12c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40 info.flags=0x17 2024-09-12T17:37:00.019 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.017+0000 7f5e6c12c800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40 to cache LRU end 2024-09-12T17:37:00.019 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.017+0000 7f5e6c12c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:37:00.019 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.017+0000 7f5e6c12c800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40, ofs0, ns] 2024-09-12T17:37:00.019 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.017+0000 7f5d467fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497011 cookie 94105888421712 notifier 8088 bl.length()=983 2024-09-12T17:37:00.020 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.017+0000 7f5d467fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40 info.flags=0x17 2024-09-12T17:37:00.020 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.017+0000 7f5d467fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40 to cache LRU end 2024-09-12T17:37:00.020 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.017+0000 7f5d467fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T17:37:00.021 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.019+0000 7f5e6c12c800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40]): orig_sources= new_sources= 2024-09-12T17:37:00.021 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.019+0000 7f5e6c12c800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40]): potential sources added=[] removed=[] 2024-09-12T17:37:00.021 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.019+0000 7f5e6c12c800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40]): orig_dests= new_dests= 2024-09-12T17:37:00.021 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.019+0000 7f5e6c12c800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40]): potential dests added=[] removed=[] 2024-09-12T17:37:00.023 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.021+0000 7f5e6c12c800 1 execute INFO: reshard of bucket "abort-at-change-reshard-state" from 11 shards to 12 shards completed successfully 2024-09-12T17:37:00.025 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.024+0000 7f5d1dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:37:00.028 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.026+0000 7f5e6c12c800 20 remove_watcher() i=0 2024-09-12T17:37:00.028 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.026+0000 7f5e6c12c800 2 removed watcher, disabling cache 2024-09-12T17:37:00.029 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.027+0000 7f5e6c12c800 20 remove_watcher() i=1 2024-09-12T17:37:00.030 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.028+0000 7f5e6c12c800 20 remove_watcher() i=2 2024-09-12T17:37:00.031 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.030+0000 7f5e6c12c800 20 remove_watcher() i=3 2024-09-12T17:37:00.032 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.031+0000 7f5e6c12c800 20 remove_watcher() i=4 2024-09-12T17:37:00.033 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.032+0000 7f5e6c12c800 20 remove_watcher() i=5 2024-09-12T17:37:00.034 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.033+0000 7f5e6c12c800 20 remove_watcher() i=6 2024-09-12T17:37:00.036 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.034+0000 7f5e6c12c800 20 remove_watcher() i=7 2024-09-12T17:37:00.049 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bucket stats --bucket abort-at-change-reshard-state 2024-09-12T17:37:00.078 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:37:00.078 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:37:00.117 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.115+0000 7efcb5d26800 20 rados->read ofs=0 len=0 2024-09-12T17:37:00.119 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.117+0000 7efcb5d26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:00.119 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.117+0000 7efcb5d26800 20 realm 2024-09-12T17:37:00.119 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.117+0000 7efcb5d26800 20 rados->read ofs=0 len=0 2024-09-12T17:37:00.119 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.117+0000 7efcb5d26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:00.119 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.117+0000 7efcb5d26800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:37:00.119 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.117+0000 7efcb5d26800 20 rados->read ofs=0 len=0 2024-09-12T17:37:00.119 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.117+0000 7efcb5d26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:00.119 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.117+0000 7efcb5d26800 20 rados->read ofs=0 len=0 2024-09-12T17:37:00.120 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.118+0000 7efcb5d26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:37:00.120 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.118+0000 7efcb5d26800 20 rados->read ofs=0 len=0 2024-09-12T17:37:00.120 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.118+0000 7efcb5d26800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:37:00.120 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.118+0000 7efcb5d26800 20 searching for the correct realm 2024-09-12T17:37:00.123 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.122+0000 7efcb1108640 0 -- 172.21.15.37:0/3217591762 >> [v2:172.21.15.37:6816/2964054205,v1:172.21.15.37:6817/2964054205] conn(0x5583fc428d90 msgr2=0x5583fc42b180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:37:00.127 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.125+0000 7efcb1909640 0 -- 172.21.15.37:0/3217591762 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7efca80a7130 msgr2=0x7efca80d5650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:37:00.132 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.130+0000 7efcb5d26800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:37:00.132 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.130+0000 7efcb5d26800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:37:00.132 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.130+0000 7efcb5d26800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:37:00.132 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.130+0000 7efcb5d26800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:37:00.132 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.130+0000 7efcb5d26800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:37:00.132 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.130+0000 7efcb5d26800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:37:00.132 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.130+0000 7efcb5d26800 20 rados->read ofs=0 len=0 2024-09-12T17:37:00.133 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.130+0000 7efcb5d26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:00.133 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.130+0000 7efcb5d26800 20 rados->read ofs=0 len=0 2024-09-12T17:37:00.133 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.130+0000 7efcb5d26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:37:00.133 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.130+0000 7efcb5d26800 20 rados->read ofs=0 len=0 2024-09-12T17:37:00.134 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.130+0000 7efcb5d26800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:37:00.134 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.130+0000 7efcb5d26800 20 zone default found 2024-09-12T17:37:00.134 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.130+0000 7efcb5d26800 4 Realm: () 2024-09-12T17:37:00.135 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.130+0000 7efcb5d26800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:37:00.135 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.130+0000 7efcb5d26800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:37:00.135 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.130+0000 7efcb5d26800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:37:00.135 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.130+0000 7efcb5d26800 20 zonegroup default 2024-09-12T17:37:00.135 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.130+0000 7efcb5d26800 20 rados->read ofs=0 len=0 2024-09-12T17:37:00.135 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.131+0000 7efcb5d26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:00.135 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.131+0000 7efcb5d26800 20 rados->read ofs=0 len=0 2024-09-12T17:37:00.135 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.131+0000 7efcb5d26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:00.135 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.131+0000 7efcb5d26800 20 rados->read ofs=0 len=0 2024-09-12T17:37:00.135 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.131+0000 7efcb5d26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:00.135 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.131+0000 7efcb5d26800 20 started sync module instance, tier type = 2024-09-12T17:37:00.136 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.131+0000 7efcb5d26800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:37:00.143 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.141+0000 7efcb5d26800 20 add_watcher() i=0 2024-09-12T17:37:00.143 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.141+0000 7efcb5d26800 20 add_watcher() i=1 2024-09-12T17:37:00.143 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.141+0000 7efcb5d26800 20 add_watcher() i=2 2024-09-12T17:37:00.143 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.141+0000 7efcb5d26800 20 add_watcher() i=3 2024-09-12T17:37:00.143 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.141+0000 7efcb5d26800 20 add_watcher() i=4 2024-09-12T17:37:00.143 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.141+0000 7efcb5d26800 20 add_watcher() i=5 2024-09-12T17:37:00.143 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.141+0000 7efcb5d26800 20 add_watcher() i=6 2024-09-12T17:37:00.143 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.142+0000 7efcb5d26800 20 add_watcher() i=7 2024-09-12T17:37:00.144 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.142+0000 7efcb5d26800 2 all 8 watchers are set, enabling cache 2024-09-12T17:37:00.145 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.143+0000 7efb637fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:37:00.146 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.144+0000 7efcb5d26800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:37:00.146 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.144+0000 7efcb5d26800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:37:00.147 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.144+0000 7efcb5d26800 5 note: GC not initialized 2024-09-12T17:37:00.147 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.144+0000 7efb627fc640 20 reqs_thread_entry: start 2024-09-12T17:37:00.147 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.144+0000 7efcb5d26800 20 init_complete bucket index max shards: 11 2024-09-12T17:37:00.147 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.144+0000 7efcb5d26800 20 Filter name: none 2024-09-12T17:37:00.147 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.144+0000 7efad7fff640 20 reqs_thread_entry: start 2024-09-12T17:37:00.147 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.144+0000 7efcb5d26800 20 rados->read ofs=0 len=0 2024-09-12T17:37:00.147 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.145+0000 7efcb5d26800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:37:00.147 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.145+0000 7efcb5d26800 20 rados->read ofs=0 len=0 2024-09-12T17:37:00.148 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.145+0000 7efcb5d26800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:37:00.148 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.145+0000 7efcb5d26800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:37:00.148 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.145+0000 7efcb5d26800 20 rados->read ofs=0 len=0 2024-09-12T17:37:00.149 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.146+0000 7efcb5d26800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T17:37:00.149 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.146+0000 7efcb5d26800 20 rados->read ofs=0 len=0 2024-09-12T17:37:00.149 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.146+0000 7efcb5d26800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:37:00.149 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.146+0000 7efcb5d26800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:37:00.150 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.148+0000 7efb637fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:37:00.152 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.150+0000 7efcb5d26800 20 remove_watcher() i=0 2024-09-12T17:37:00.152 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.150+0000 7efcb5d26800 2 removed watcher, disabling cache 2024-09-12T17:37:00.153 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.151+0000 7efcb5d26800 20 remove_watcher() i=1 2024-09-12T17:37:00.154 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.152+0000 7efcb5d26800 20 remove_watcher() i=2 2024-09-12T17:37:00.156 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.154+0000 7efcb5d26800 20 remove_watcher() i=3 2024-09-12T17:37:00.157 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.155+0000 7efcb5d26800 20 remove_watcher() i=4 2024-09-12T17:37:00.158 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.156+0000 7efcb5d26800 20 remove_watcher() i=5 2024-09-12T17:37:00.159 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.157+0000 7efcb5d26800 20 remove_watcher() i=6 2024-09-12T17:37:00.160 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.158+0000 7efcb5d26800 20 remove_watcher() i=7 2024-09-12T17:37:00.171 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:37:00.171 INFO:tasks.workunit.client.0.smithi037.stderr:BUCKET_STATS: 2024-09-12T17:37:00.171 INFO:tasks.workunit.client.0.smithi037.stderr:bucket: abort-at-change-reshard-state id: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T17:37:00.171 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:37:00.513 INFO:tasks.workunit.client.0.smithi037.stderr: test: logrecord could be stopped after reshard failed 2024-09-12T17:37:00.515 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T17:37:00.544 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:37:00.544 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:37:00.584 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.582+0000 7fa5e9526800 20 rados->read ofs=0 len=0 2024-09-12T17:37:00.586 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.584+0000 7fa5e9526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:00.586 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.584+0000 7fa5e9526800 20 realm 2024-09-12T17:37:00.586 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.584+0000 7fa5e9526800 20 rados->read ofs=0 len=0 2024-09-12T17:37:00.586 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.584+0000 7fa5e9526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:00.586 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.584+0000 7fa5e9526800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:37:00.587 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.584+0000 7fa5e9526800 20 rados->read ofs=0 len=0 2024-09-12T17:37:00.587 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.584+0000 7fa5e9526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:00.587 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.584+0000 7fa5e9526800 20 rados->read ofs=0 len=0 2024-09-12T17:37:00.587 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.585+0000 7fa5e9526800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:37:00.587 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.585+0000 7fa5e9526800 20 rados->read ofs=0 len=0 2024-09-12T17:37:00.587 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.585+0000 7fa5e9526800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:37:00.587 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.585+0000 7fa5e9526800 20 searching for the correct realm 2024-09-12T17:37:00.590 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.588+0000 7fa5e4a6e640 0 -- 172.21.15.37:0/1233135234 >> [v2:172.21.15.40:6800/2441293461,v1:172.21.15.40:6801/2441293461] conn(0x7fa5d8017040 msgr2=0x7fa5d808eb10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:37:00.597 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.592+0000 7fa5e526f640 0 -- 172.21.15.37:0/1233135234 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7fa5dc00e3c0 msgr2=0x7fa5dc00e840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:37:00.801 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.798+0000 7fa5e9526800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:37:00.801 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.799+0000 7fa5e9526800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:37:00.801 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.799+0000 7fa5e9526800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:37:00.801 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.799+0000 7fa5e9526800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:37:00.801 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.799+0000 7fa5e9526800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:37:00.801 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.799+0000 7fa5e9526800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:37:00.801 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.799+0000 7fa5e9526800 20 rados->read ofs=0 len=0 2024-09-12T17:37:00.801 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.799+0000 7fa5e9526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:00.801 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.799+0000 7fa5e9526800 20 rados->read ofs=0 len=0 2024-09-12T17:37:00.801 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.799+0000 7fa5e9526800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:37:00.802 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.799+0000 7fa5e9526800 20 rados->read ofs=0 len=0 2024-09-12T17:37:00.803 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.799+0000 7fa5e9526800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:37:00.803 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.799+0000 7fa5e9526800 20 zone default found 2024-09-12T17:37:00.803 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.799+0000 7fa5e9526800 4 Realm: () 2024-09-12T17:37:00.803 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.799+0000 7fa5e9526800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:37:00.803 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.799+0000 7fa5e9526800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:37:00.803 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.799+0000 7fa5e9526800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:37:00.803 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.799+0000 7fa5e9526800 20 zonegroup default 2024-09-12T17:37:00.803 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.799+0000 7fa5e9526800 20 rados->read ofs=0 len=0 2024-09-12T17:37:00.803 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.800+0000 7fa5e9526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:00.803 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.800+0000 7fa5e9526800 20 rados->read ofs=0 len=0 2024-09-12T17:37:00.803 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.800+0000 7fa5e9526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:00.804 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.800+0000 7fa5e9526800 20 rados->read ofs=0 len=0 2024-09-12T17:37:00.804 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.800+0000 7fa5e9526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:00.804 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.800+0000 7fa5e9526800 20 started sync module instance, tier type = 2024-09-12T17:37:00.804 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.800+0000 7fa5e9526800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:37:00.812 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.810+0000 7fa5e9526800 20 add_watcher() i=0 2024-09-12T17:37:00.812 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.810+0000 7fa5e9526800 20 add_watcher() i=1 2024-09-12T17:37:00.812 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.810+0000 7fa5e9526800 20 add_watcher() i=2 2024-09-12T17:37:00.812 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.810+0000 7fa5e9526800 20 add_watcher() i=3 2024-09-12T17:37:00.812 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.810+0000 7fa5e9526800 20 add_watcher() i=4 2024-09-12T17:37:00.812 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.810+0000 7fa5e9526800 20 add_watcher() i=5 2024-09-12T17:37:00.812 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.810+0000 7fa5e9526800 20 add_watcher() i=6 2024-09-12T17:37:00.812 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.811+0000 7fa5e9526800 20 add_watcher() i=7 2024-09-12T17:37:00.813 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.811+0000 7fa5e9526800 2 all 8 watchers are set, enabling cache 2024-09-12T17:37:00.814 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.813+0000 7fa49bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:37:00.815 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.813+0000 7fa5e9526800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:37:00.815 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.813+0000 7fa5e9526800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:37:00.816 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.813+0000 7fa5e9526800 5 note: GC not initialized 2024-09-12T17:37:00.816 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.813+0000 7fa49afe5640 20 reqs_thread_entry: start 2024-09-12T17:37:00.816 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.813+0000 7fa5e9526800 20 init_complete bucket index max shards: 11 2024-09-12T17:37:00.816 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.813+0000 7fa5e9526800 20 Filter name: none 2024-09-12T17:37:00.816 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.814+0000 7fa498fe1640 20 reqs_thread_entry: start 2024-09-12T17:37:00.816 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.814+0000 7fa5e9526800 20 rados->read ofs=0 len=0 2024-09-12T17:37:00.817 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.814+0000 7fa5e9526800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:37:00.817 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.814+0000 7fa5e9526800 20 rados->read ofs=0 len=0 2024-09-12T17:37:00.817 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.815+0000 7fa5e9526800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:37:00.817 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.815+0000 7fa5e9526800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:37:00.817 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.815+0000 7fa5e9526800 20 rados->read ofs=0 len=0 2024-09-12T17:37:00.817 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.815+0000 7fa5e9526800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:37:00.817 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.815+0000 7fa5e9526800 20 rados->read ofs=0 len=0 2024-09-12T17:37:00.818 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.815+0000 7fa5e9526800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:37:00.818 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.815+0000 7fa5e9526800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:37:00.819 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.817+0000 7fa49bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:37:00.821 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.819+0000 7fa5e9526800 20 remove_watcher() i=0 2024-09-12T17:37:00.821 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.819+0000 7fa5e9526800 2 removed watcher, disabling cache 2024-09-12T17:37:00.822 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.821+0000 7fa5e9526800 20 remove_watcher() i=1 2024-09-12T17:37:00.823 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.822+0000 7fa5e9526800 20 remove_watcher() i=2 2024-09-12T17:37:00.824 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.823+0000 7fa5e9526800 20 remove_watcher() i=3 2024-09-12T17:37:00.825 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.824+0000 7fa5e9526800 20 remove_watcher() i=4 2024-09-12T17:37:00.826 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.825+0000 7fa5e9526800 20 remove_watcher() i=5 2024-09-12T17:37:00.827 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.826+0000 7fa5e9526800 20 remove_watcher() i=6 2024-09-12T17:37:00.828 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.827+0000 7fa5e9526800 20 remove_watcher() i=7 2024-09-12T17:37:00.840 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:37:00.840 INFO:tasks.workunit.client.0.smithi037.stderr:BUCKET_STATS: 2024-09-12T17:37:00.840 INFO:tasks.workunit.client.0.smithi037.stderr:bucket: a-bucket id: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 num_objects: 8 size_kb: 1 num_shards: 13 2024-09-12T17:37:00.840 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:37:00.841 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T17:37:00.870 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:37:00.870 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:37:00.909 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.907+0000 7f8926b2f800 20 rados->read ofs=0 len=0 2024-09-12T17:37:00.911 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.909+0000 7f8926b2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:00.911 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.909+0000 7f8926b2f800 20 realm 2024-09-12T17:37:00.911 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.909+0000 7f8926b2f800 20 rados->read ofs=0 len=0 2024-09-12T17:37:00.911 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.909+0000 7f8926b2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:00.911 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.909+0000 7f8926b2f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:37:00.911 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.909+0000 7f8926b2f800 20 rados->read ofs=0 len=0 2024-09-12T17:37:00.911 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.909+0000 7f8926b2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:00.912 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.909+0000 7f8926b2f800 20 rados->read ofs=0 len=0 2024-09-12T17:37:00.912 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.910+0000 7f8926b2f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:37:00.912 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.910+0000 7f8926b2f800 20 rados->read ofs=0 len=0 2024-09-12T17:37:00.913 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.911+0000 7f8926b2f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:37:00.913 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.911+0000 7f8926b2f800 20 searching for the correct realm 2024-09-12T17:37:00.915 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.914+0000 7f8922075640 0 -- 172.21.15.37:0/2543600920 >> [v2:172.21.15.40:6800/2441293461,v1:172.21.15.40:6801/2441293461] conn(0x7f891408f070 msgr2=0x7f8914061a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:37:00.919 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:00.918+0000 7f8922876640 0 -- 172.21.15.37:0/2543600920 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7f89180da710 msgr2=0x7f89180ac150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:37:01.126 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.123+0000 7f8926b2f800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:37:01.126 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.123+0000 7f8926b2f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:37:01.126 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.123+0000 7f8926b2f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:37:01.127 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.123+0000 7f8926b2f800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:37:01.127 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.123+0000 7f8926b2f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:37:01.127 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.123+0000 7f8926b2f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:37:01.127 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.123+0000 7f8926b2f800 20 rados->read ofs=0 len=0 2024-09-12T17:37:01.127 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.124+0000 7f8926b2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:01.127 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.124+0000 7f8926b2f800 20 rados->read ofs=0 len=0 2024-09-12T17:37:01.127 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.124+0000 7f8926b2f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:37:01.127 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.124+0000 7f8926b2f800 20 rados->read ofs=0 len=0 2024-09-12T17:37:01.128 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.124+0000 7f8926b2f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:37:01.128 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.124+0000 7f8926b2f800 20 zone default found 2024-09-12T17:37:01.128 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.124+0000 7f8926b2f800 4 Realm: () 2024-09-12T17:37:01.129 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.124+0000 7f8926b2f800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:37:01.129 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.124+0000 7f8926b2f800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:37:01.129 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.124+0000 7f8926b2f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:37:01.129 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.124+0000 7f8926b2f800 20 zonegroup default 2024-09-12T17:37:01.129 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.124+0000 7f8926b2f800 20 rados->read ofs=0 len=0 2024-09-12T17:37:01.129 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.125+0000 7f8926b2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:01.129 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.125+0000 7f8926b2f800 20 rados->read ofs=0 len=0 2024-09-12T17:37:01.129 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.125+0000 7f8926b2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:01.129 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.125+0000 7f8926b2f800 20 rados->read ofs=0 len=0 2024-09-12T17:37:01.129 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.125+0000 7f8926b2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:01.129 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.125+0000 7f8926b2f800 20 started sync module instance, tier type = 2024-09-12T17:37:01.129 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.125+0000 7f8926b2f800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:37:01.137 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.135+0000 7f8926b2f800 20 add_watcher() i=0 2024-09-12T17:37:01.137 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.135+0000 7f8926b2f800 20 add_watcher() i=1 2024-09-12T17:37:01.138 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.135+0000 7f8926b2f800 20 add_watcher() i=2 2024-09-12T17:37:01.138 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.135+0000 7f8926b2f800 20 add_watcher() i=3 2024-09-12T17:37:01.138 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.135+0000 7f8926b2f800 20 add_watcher() i=4 2024-09-12T17:37:01.138 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.135+0000 7f8926b2f800 20 add_watcher() i=5 2024-09-12T17:37:01.138 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.135+0000 7f8926b2f800 20 add_watcher() i=6 2024-09-12T17:37:01.139 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.137+0000 7f8926b2f800 20 add_watcher() i=7 2024-09-12T17:37:01.139 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.137+0000 7f8926b2f800 2 all 8 watchers are set, enabling cache 2024-09-12T17:37:01.143 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.139+0000 7f87d97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:37:01.143 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.139+0000 7f8926b2f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:37:01.144 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.139+0000 7f8926b2f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:37:01.144 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.139+0000 7f8926b2f800 5 note: GC not initialized 2024-09-12T17:37:01.144 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.139+0000 7f8753fff640 20 reqs_thread_entry: start 2024-09-12T17:37:01.144 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.140+0000 7f8926b2f800 20 init_complete bucket index max shards: 11 2024-09-12T17:37:01.144 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.140+0000 7f8926b2f800 20 Filter name: none 2024-09-12T17:37:01.144 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.140+0000 7f8751ffb640 20 reqs_thread_entry: start 2024-09-12T17:37:01.145 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.140+0000 7f8926b2f800 20 rados->read ofs=0 len=0 2024-09-12T17:37:01.145 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.140+0000 7f8926b2f800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:37:01.145 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.140+0000 7f8926b2f800 20 rados->read ofs=0 len=0 2024-09-12T17:37:01.145 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.140+0000 7f8926b2f800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:37:01.145 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.141+0000 7f8926b2f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:37:01.145 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.141+0000 7f8926b2f800 20 rados->read ofs=0 len=0 2024-09-12T17:37:01.145 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.141+0000 7f8926b2f800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:37:01.146 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.141+0000 7f8926b2f800 20 rados->read ofs=0 len=0 2024-09-12T17:37:01.146 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.141+0000 7f8926b2f800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:37:01.146 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.141+0000 7f8926b2f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:37:01.146 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.143+0000 7f87d97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:37:01.147 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.145+0000 7f8926b2f800 20 remove_watcher() i=0 2024-09-12T17:37:01.147 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.145+0000 7f8926b2f800 2 removed watcher, disabling cache 2024-09-12T17:37:01.148 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.146+0000 7f8926b2f800 20 remove_watcher() i=1 2024-09-12T17:37:01.150 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.148+0000 7f8926b2f800 20 remove_watcher() i=2 2024-09-12T17:37:01.151 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.149+0000 7f8926b2f800 20 remove_watcher() i=3 2024-09-12T17:37:01.152 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.150+0000 7f8926b2f800 20 remove_watcher() i=4 2024-09-12T17:37:01.153 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.151+0000 7f8926b2f800 20 remove_watcher() i=5 2024-09-12T17:37:01.154 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.152+0000 7f8926b2f800 20 remove_watcher() i=6 2024-09-12T17:37:01.155 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.153+0000 7f8926b2f800 20 remove_watcher() i=7 2024-09-12T17:37:01.167 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 14 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at change_reshard_state 2024-09-12T17:37:01.202 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:37:01.202 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:37:01.241 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.240+0000 7f3c43c31800 20 rados->read ofs=0 len=0 2024-09-12T17:37:01.243 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.241+0000 7f3c43c31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:01.244 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.241+0000 7f3c43c31800 20 realm 2024-09-12T17:37:01.244 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.241+0000 7f3c43c31800 20 rados->read ofs=0 len=0 2024-09-12T17:37:01.244 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.241+0000 7f3c43c31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:01.244 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.241+0000 7f3c43c31800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:37:01.244 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.241+0000 7f3c43c31800 20 rados->read ofs=0 len=0 2024-09-12T17:37:01.244 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.242+0000 7f3c43c31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:01.244 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.242+0000 7f3c43c31800 20 rados->read ofs=0 len=0 2024-09-12T17:37:01.245 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.242+0000 7f3c43c31800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:37:01.245 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.242+0000 7f3c43c31800 20 rados->read ofs=0 len=0 2024-09-12T17:37:01.245 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.243+0000 7f3c43c31800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:37:01.245 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.243+0000 7f3c43c31800 20 searching for the correct realm 2024-09-12T17:37:01.247 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.245+0000 7f3c3e78a640 0 -- 172.21.15.37:0/3860369574 >> [v2:172.21.15.40:6800/2441293461,v1:172.21.15.40:6801/2441293461] conn(0x7f3c3006b020 msgr2=0x7f3c3005a460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:37:01.251 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.250+0000 7f3c3ef8b640 0 -- 172.21.15.37:0/3860369574 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7f3c3403d400 msgr2=0x7f3c3403d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:37:01.458 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.456+0000 7f3c43c31800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:37:01.458 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.456+0000 7f3c43c31800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:37:01.458 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.456+0000 7f3c43c31800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:37:01.459 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.456+0000 7f3c43c31800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:37:01.459 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.456+0000 7f3c43c31800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:37:01.459 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.456+0000 7f3c43c31800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:37:01.459 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.456+0000 7f3c43c31800 20 rados->read ofs=0 len=0 2024-09-12T17:37:01.459 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.456+0000 7f3c43c31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:01.459 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.456+0000 7f3c43c31800 20 rados->read ofs=0 len=0 2024-09-12T17:37:01.460 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.457+0000 7f3c43c31800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:37:01.460 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.457+0000 7f3c43c31800 20 rados->read ofs=0 len=0 2024-09-12T17:37:01.460 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.457+0000 7f3c43c31800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:37:01.460 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.457+0000 7f3c43c31800 20 zone default found 2024-09-12T17:37:01.460 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.457+0000 7f3c43c31800 4 Realm: () 2024-09-12T17:37:01.460 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.457+0000 7f3c43c31800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:37:01.461 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.457+0000 7f3c43c31800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:37:01.461 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.457+0000 7f3c43c31800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:37:01.461 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.457+0000 7f3c43c31800 20 zonegroup default 2024-09-12T17:37:01.461 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.457+0000 7f3c43c31800 20 rados->read ofs=0 len=0 2024-09-12T17:37:01.461 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.458+0000 7f3c43c31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:01.461 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.458+0000 7f3c43c31800 20 rados->read ofs=0 len=0 2024-09-12T17:37:01.461 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.458+0000 7f3c43c31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:01.461 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.458+0000 7f3c43c31800 20 rados->read ofs=0 len=0 2024-09-12T17:37:01.461 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.458+0000 7f3c43c31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:01.461 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.458+0000 7f3c43c31800 20 started sync module instance, tier type = 2024-09-12T17:37:01.461 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.458+0000 7f3c43c31800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:37:01.470 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.468+0000 7f3c43c31800 20 add_watcher() i=0 2024-09-12T17:37:01.470 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.468+0000 7f3c43c31800 20 add_watcher() i=1 2024-09-12T17:37:01.470 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.468+0000 7f3c43c31800 20 add_watcher() i=2 2024-09-12T17:37:01.470 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.468+0000 7f3c43c31800 20 add_watcher() i=3 2024-09-12T17:37:01.470 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.468+0000 7f3c43c31800 20 add_watcher() i=4 2024-09-12T17:37:01.471 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.468+0000 7f3c43c31800 20 add_watcher() i=5 2024-09-12T17:37:01.471 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.468+0000 7f3c43c31800 20 add_watcher() i=6 2024-09-12T17:37:01.471 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.469+0000 7f3c43c31800 20 add_watcher() i=7 2024-09-12T17:37:01.471 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.469+0000 7f3c43c31800 2 all 8 watchers are set, enabling cache 2024-09-12T17:37:01.473 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.471+0000 7f3af57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:37:01.474 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.471+0000 7f3c43c31800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:37:01.474 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.471+0000 7f3c43c31800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:37:01.474 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.472+0000 7f3c43c31800 5 note: GC not initialized 2024-09-12T17:37:01.474 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.472+0000 7f3a6ffff640 20 reqs_thread_entry: start 2024-09-12T17:37:01.474 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.472+0000 7f3c43c31800 20 init_complete bucket index max shards: 11 2024-09-12T17:37:01.474 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.472+0000 7f3c43c31800 20 Filter name: none 2024-09-12T17:37:01.474 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.472+0000 7f3a6dffb640 20 reqs_thread_entry: start 2024-09-12T17:37:01.474 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.472+0000 7f3c43c31800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:37:01.475 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.472+0000 7f3c43c31800 20 rados->read ofs=0 len=0 2024-09-12T17:37:01.475 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.473+0000 7f3c43c31800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:37:01.475 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.473+0000 7f3c43c31800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:37:01.475 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.473+0000 7f3c43c31800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:37:01.476 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.473+0000 7f3c43c31800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 : miss 2024-09-12T17:37:01.476 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.473+0000 7f3c43c31800 20 rados->read ofs=0 len=0 2024-09-12T17:37:01.476 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.473+0000 7f3c43c31800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:37:01.476 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.473+0000 7f3c43c31800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 info.flags=0x17 2024-09-12T17:37:01.476 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.473+0000 7f3c43c31800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 to cache LRU end 2024-09-12T17:37:01.476 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.473+0000 7f3c43c31800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:37:01.476 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.473+0000 7f3c43c31800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:37:01.476 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.473+0000 7f3c43c31800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 2024-09-12T17:37:01.481 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.479+0000 7f3c43c31800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 info.flags=0x17 2024-09-12T17:37:01.481 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.479+0000 7f3c43c31800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 to cache LRU end 2024-09-12T17:37:01.481 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.479+0000 7f3c43c31800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:37:01.481 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.479+0000 7f3c43c31800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18, ofs0, ns] 2024-09-12T17:37:01.481 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.479+0000 7f3b21ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497017 cookie 94110392943808 notifier 7616 bl.length()=911 2024-09-12T17:37:01.481 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.479+0000 7f3b21ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 info.flags=0x17 2024-09-12T17:37:01.481 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.479+0000 7f3b21ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 to cache LRU end 2024-09-12T17:37:01.481 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.479+0000 7f3b21ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:37:01.482 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.481+0000 7f3c43c31800 20 handle_bi_update(): bucket=:a-bucket[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18]): orig_sources= new_sources= 2024-09-12T17:37:01.482 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.481+0000 7f3c43c31800 20 handle_bi_update(): bucket=:a-bucket[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18]): potential sources added=[] removed=[] 2024-09-12T17:37:01.483 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.481+0000 7f3c43c31800 20 handle_bi_update(): bucket=:a-bucket[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18]): orig_dests= new_dests= 2024-09-12T17:37:01.483 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.481+0000 7f3c43c31800 20 handle_bi_update(): bucket=:a-bucket[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18]): potential dests added=[] removed=[] 2024-09-12T17:37:01.488 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.486+0000 7f3c43c31800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.3.0 2024-09-12T17:37:01.489 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.486+0000 7f3c43c31800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.3.0 2024-09-12T17:37:01.489 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.486+0000 7f3c43c31800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.3.1 2024-09-12T17:37:01.489 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.486+0000 7f3c43c31800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.3.1 2024-09-12T17:37:01.489 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.486+0000 7f3c43c31800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.3.2 2024-09-12T17:37:01.489 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.486+0000 7f3c43c31800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.3.2 2024-09-12T17:37:01.489 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.486+0000 7f3c43c31800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.3.3 2024-09-12T17:37:01.489 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.486+0000 7f3c43c31800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.3.3 2024-09-12T17:37:01.489 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.486+0000 7f3c43c31800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.3.4 2024-09-12T17:37:01.489 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.486+0000 7f3c43c31800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.3.4 2024-09-12T17:37:01.489 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.486+0000 7f3c43c31800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.3.5 2024-09-12T17:37:01.489 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.486+0000 7f3c43c31800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.3.5 2024-09-12T17:37:01.489 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.486+0000 7f3c43c31800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.3.6 2024-09-12T17:37:01.490 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.486+0000 7f3c43c31800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.3.6 2024-09-12T17:37:01.490 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.486+0000 7f3c43c31800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.3.7 2024-09-12T17:37:01.490 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.486+0000 7f3c43c31800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.3.7 2024-09-12T17:37:01.490 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.486+0000 7f3c43c31800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.3.8 2024-09-12T17:37:01.490 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.486+0000 7f3c43c31800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.3.8 2024-09-12T17:37:01.490 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.486+0000 7f3c43c31800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.3.9 2024-09-12T17:37:01.490 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.486+0000 7f3c43c31800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.3.9 2024-09-12T17:37:01.490 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.486+0000 7f3c43c31800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.3.10 2024-09-12T17:37:01.490 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.486+0000 7f3c43c31800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.3.10 2024-09-12T17:37:01.490 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.486+0000 7f3c43c31800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.3.11 2024-09-12T17:37:01.490 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.486+0000 7f3c43c31800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.3.11 2024-09-12T17:37:01.490 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.486+0000 7f3c43c31800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.3.12 2024-09-12T17:37:01.490 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.486+0000 7f3c43c31800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.3.12 2024-09-12T17:37:01.490 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.486+0000 7f3c43c31800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.3.13 2024-09-12T17:37:01.491 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.486+0000 7f3c43c31800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.3.13 2024-09-12T17:37:01.491 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.486+0000 7f3c43c31800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.0 2024-09-12T17:37:01.491 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.486+0000 7f3c43c31800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.0 2024-09-12T17:37:01.491 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.487+0000 7f3c43c31800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.1 2024-09-12T17:37:01.491 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.487+0000 7f3c43c31800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.1 2024-09-12T17:37:01.492 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.487+0000 7f3c43c31800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.2 2024-09-12T17:37:01.492 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.487+0000 7f3c43c31800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.2 2024-09-12T17:37:01.492 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.488+0000 7f3c43c31800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.3 2024-09-12T17:37:01.492 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.488+0000 7f3c43c31800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.3 2024-09-12T17:37:01.492 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.489+0000 7f3c43c31800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.4 2024-09-12T17:37:01.492 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.489+0000 7f3c43c31800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.4 2024-09-12T17:37:01.492 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.489+0000 7f3c43c31800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.5 2024-09-12T17:37:01.492 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.489+0000 7f3c43c31800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.5 2024-09-12T17:37:01.492 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.490+0000 7f3c43c31800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.6 2024-09-12T17:37:01.492 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.490+0000 7f3c43c31800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.6 2024-09-12T17:37:01.493 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.490+0000 7f3c43c31800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.7 2024-09-12T17:37:01.493 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.490+0000 7f3c43c31800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.7 2024-09-12T17:37:01.493 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.491+0000 7f3c43c31800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.8 2024-09-12T17:37:01.493 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.491+0000 7f3c43c31800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.8 2024-09-12T17:37:01.493 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.491+0000 7f3c43c31800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.9 2024-09-12T17:37:01.493 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.491+0000 7f3c43c31800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.9 2024-09-12T17:37:01.494 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.492+0000 7f3c43c31800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.10 2024-09-12T17:37:01.494 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.492+0000 7f3c43c31800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.10 2024-09-12T17:37:01.494 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.492+0000 7f3c43c31800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.11 2024-09-12T17:37:01.494 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.492+0000 7f3c43c31800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.11 2024-09-12T17:37:01.495 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.493+0000 7f3c43c31800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.12 2024-09-12T17:37:01.495 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.493+0000 7f3c43c31800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.12 2024-09-12T17:37:01.496 INFO:tasks.workunit.client.0.smithi037.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f3c43c31800 time 2024-09-12T17:37:01.496805+0000 2024-09-12T17:37:01.496 INFO:tasks.workunit.client.0.smithi037.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:37:01.497 INFO:tasks.workunit.client.0.smithi037.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:37:01.497 INFO:tasks.workunit.client.0.smithi037.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f3c4498c71a] 2024-09-12T17:37:01.497 INFO:tasks.workunit.client.0.smithi037.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f3c4498c8d8] 2024-09-12T17:37:01.497 INFO:tasks.workunit.client.0.smithi037.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5597c7860841] 2024-09-12T17:37:01.498 INFO:tasks.workunit.client.0.smithi037.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x5597c786f734] 2024-09-12T17:37:01.498 INFO:tasks.workunit.client.0.smithi037.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x5597c78705d4] 2024-09-12T17:37:01.498 INFO:tasks.workunit.client.0.smithi037.stderr: 6: main() 2024-09-12T17:37:01.498 INFO:tasks.workunit.client.0.smithi037.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f3c43629590] 2024-09-12T17:37:01.498 INFO:tasks.workunit.client.0.smithi037.stderr: 8: __libc_start_main() 2024-09-12T17:37:01.498 INFO:tasks.workunit.client.0.smithi037.stderr: 9: _start() 2024-09-12T17:37:01.498 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.495+0000 7f3c43c31800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f3c43c31800 time 2024-09-12T17:37:01.496805+0000 2024-09-12T17:37:01.498 INFO:tasks.workunit.client.0.smithi037.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:37:01.498 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:37:01.498 INFO:tasks.workunit.client.0.smithi037.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:37:01.498 INFO:tasks.workunit.client.0.smithi037.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f3c4498c71a] 2024-09-12T17:37:01.499 INFO:tasks.workunit.client.0.smithi037.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f3c4498c8d8] 2024-09-12T17:37:01.499 INFO:tasks.workunit.client.0.smithi037.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5597c7860841] 2024-09-12T17:37:01.499 INFO:tasks.workunit.client.0.smithi037.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x5597c786f734] 2024-09-12T17:37:01.499 INFO:tasks.workunit.client.0.smithi037.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x5597c78705d4] 2024-09-12T17:37:01.499 INFO:tasks.workunit.client.0.smithi037.stderr: 6: main() 2024-09-12T17:37:01.499 INFO:tasks.workunit.client.0.smithi037.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f3c43629590] 2024-09-12T17:37:01.499 INFO:tasks.workunit.client.0.smithi037.stderr: 8: __libc_start_main() 2024-09-12T17:37:01.499 INFO:tasks.workunit.client.0.smithi037.stderr: 9: _start() 2024-09-12T17:37:01.499 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:37:01.499 INFO:tasks.workunit.client.0.smithi037.stderr:*** Caught signal (Aborted) ** 2024-09-12T17:37:01.499 INFO:tasks.workunit.client.0.smithi037.stderr: in thread 7f3c43c31800 thread_name:radosgw-admin 2024-09-12T17:37:01.520 INFO:tasks.workunit.client.0.smithi037.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:37:01.520 INFO:tasks.workunit.client.0.smithi037.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f3c4363e6f0] 2024-09-12T17:37:01.520 INFO:tasks.workunit.client.0.smithi037.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f3c4368b99c] 2024-09-12T17:37:01.520 INFO:tasks.workunit.client.0.smithi037.stderr: 3: raise() 2024-09-12T17:37:01.520 INFO:tasks.workunit.client.0.smithi037.stderr: 4: abort() 2024-09-12T17:37:01.520 INFO:tasks.workunit.client.0.smithi037.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f3c4498c774] 2024-09-12T17:37:01.521 INFO:tasks.workunit.client.0.smithi037.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f3c4498c8d8] 2024-09-12T17:37:01.521 INFO:tasks.workunit.client.0.smithi037.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5597c7860841] 2024-09-12T17:37:01.521 INFO:tasks.workunit.client.0.smithi037.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x5597c786f734] 2024-09-12T17:37:01.521 INFO:tasks.workunit.client.0.smithi037.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x5597c78705d4] 2024-09-12T17:37:01.521 INFO:tasks.workunit.client.0.smithi037.stderr: 10: main() 2024-09-12T17:37:01.521 INFO:tasks.workunit.client.0.smithi037.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f3c43629590] 2024-09-12T17:37:01.521 INFO:tasks.workunit.client.0.smithi037.stderr: 12: __libc_start_main() 2024-09-12T17:37:01.521 INFO:tasks.workunit.client.0.smithi037.stderr: 13: _start() 2024-09-12T17:37:01.521 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.496+0000 7f3c43c31800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:37:01.521 INFO:tasks.workunit.client.0.smithi037.stderr: in thread 7f3c43c31800 thread_name:radosgw-admin 2024-09-12T17:37:01.522 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:37:01.522 INFO:tasks.workunit.client.0.smithi037.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:37:01.522 INFO:tasks.workunit.client.0.smithi037.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f3c4363e6f0] 2024-09-12T17:37:01.522 INFO:tasks.workunit.client.0.smithi037.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f3c4368b99c] 2024-09-12T17:37:01.522 INFO:tasks.workunit.client.0.smithi037.stderr: 3: raise() 2024-09-12T17:37:01.522 INFO:tasks.workunit.client.0.smithi037.stderr: 4: abort() 2024-09-12T17:37:01.522 INFO:tasks.workunit.client.0.smithi037.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f3c4498c774] 2024-09-12T17:37:01.522 INFO:tasks.workunit.client.0.smithi037.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f3c4498c8d8] 2024-09-12T17:37:01.522 INFO:tasks.workunit.client.0.smithi037.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5597c7860841] 2024-09-12T17:37:01.522 INFO:tasks.workunit.client.0.smithi037.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x5597c786f734] 2024-09-12T17:37:01.522 INFO:tasks.workunit.client.0.smithi037.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x5597c78705d4] 2024-09-12T17:37:01.522 INFO:tasks.workunit.client.0.smithi037.stderr: 10: main() 2024-09-12T17:37:01.523 INFO:tasks.workunit.client.0.smithi037.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f3c43629590] 2024-09-12T17:37:01.523 INFO:tasks.workunit.client.0.smithi037.stderr: 12: __libc_start_main() 2024-09-12T17:37:01.523 INFO:tasks.workunit.client.0.smithi037.stderr: 13: _start() 2024-09-12T17:37:01.523 INFO:tasks.workunit.client.0.smithi037.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:37:01.523 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:37:01.523 INFO:tasks.workunit.client.0.smithi037.stderr:--- begin dump of recent events --- 2024-09-12T17:37:01.523 INFO:tasks.workunit.client.0.smithi037.stderr: -499> 2024-09-12T17:37:01.223+0000 7f3c3ef8b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:37:01.523 INFO:tasks.workunit.client.0.smithi037.stderr: -498> 2024-09-12T17:37:01.223+0000 7f3c3f78c640 10 monclient(hunting): get_auth_request con 0x5597c86f3380 auth_method 0 2024-09-12T17:37:01.523 INFO:tasks.workunit.client.0.smithi037.stderr: -497> 2024-09-12T17:37:01.223+0000 7f3c3f78c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:37:01.523 INFO:tasks.workunit.client.0.smithi037.stderr: -496> 2024-09-12T17:37:01.223+0000 7f3c3f78c640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:37:01.523 INFO:tasks.workunit.client.0.smithi037.stderr: -495> 2024-09-12T17:37:01.223+0000 7f3c3f78c640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:37:01.523 INFO:tasks.workunit.client.0.smithi037.stderr: -494> 2024-09-12T17:37:01.223+0000 7f3c3e78a640 10 monclient(hunting): get_auth_request con 0x5597c86efe20 auth_method 0 2024-09-12T17:37:01.524 INFO:tasks.workunit.client.0.smithi037.stderr: -493> 2024-09-12T17:37:01.223+0000 7f3c3e78a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:37:01.524 INFO:tasks.workunit.client.0.smithi037.stderr: -492> 2024-09-12T17:37:01.223+0000 7f3c3e78a640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:37:01.524 INFO:tasks.workunit.client.0.smithi037.stderr: -491> 2024-09-12T17:37:01.223+0000 7f3c3e78a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:37:01.524 INFO:tasks.workunit.client.0.smithi037.stderr: -490> 2024-09-12T17:37:01.223+0000 7f3c3f78c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:37:01.524 INFO:tasks.workunit.client.0.smithi037.stderr: -489> 2024-09-12T17:37:01.223+0000 7f3c3f78c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:37:01.524 INFO:tasks.workunit.client.0.smithi037.stderr: -488> 2024-09-12T17:37:01.223+0000 7f3c3f78c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:37:01.524 INFO:tasks.workunit.client.0.smithi037.stderr: -487> 2024-09-12T17:37:01.223+0000 7f3c3ef8b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:37:01.525 INFO:tasks.workunit.client.0.smithi037.stderr: -486> 2024-09-12T17:37:01.223+0000 7f3c3ef8b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:37:01.525 INFO:tasks.workunit.client.0.smithi037.stderr: -485> 2024-09-12T17:37:01.223+0000 7f3c3ef8b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:37:01.525 INFO:tasks.workunit.client.0.smithi037.stderr: -484> 2024-09-12T17:37:01.224+0000 7f3c3e78a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:37:01.525 INFO:tasks.workunit.client.0.smithi037.stderr: -483> 2024-09-12T17:37:01.224+0000 7f3c3e78a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:37:01.525 INFO:tasks.workunit.client.0.smithi037.stderr: -482> 2024-09-12T17:37:01.224+0000 7f3c3e78a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:37:01.525 INFO:tasks.workunit.client.0.smithi037.stderr: -481> 2024-09-12T17:37:01.224+0000 7f3c3ef8b640 10 monclient(hunting): handle_auth_done global_id 7607 payload 824 2024-09-12T17:37:01.525 INFO:tasks.workunit.client.0.smithi037.stderr: -480> 2024-09-12T17:37:01.224+0000 7f3c3ef8b640 10 monclient: _finish_hunting 0 2024-09-12T17:37:01.525 INFO:tasks.workunit.client.0.smithi037.stderr: -479> 2024-09-12T17:37:01.224+0000 7f3c3ef8b640 1 monclient: found mon.noname-c 2024-09-12T17:37:01.525 INFO:tasks.workunit.client.0.smithi037.stderr: -478> 2024-09-12T17:37:01.224+0000 7f3c3ef8b640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.37:3301/0 2024-09-12T17:37:01.525 INFO:tasks.workunit.client.0.smithi037.stderr: -477> 2024-09-12T17:37:01.224+0000 7f3b2b606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:37:01.526 INFO:tasks.workunit.client.0.smithi037.stderr: -476> 2024-09-12T17:37:01.224+0000 7f3b2b606640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:37:01.526 INFO:tasks.workunit.client.0.smithi037.stderr: -475> 2024-09-12T17:37:01.224+0000 7f3b2b606640 10 monclient: dump: 2024-09-12T17:37:01.526 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:37:01.526 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:37:01.526 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:37:01.526 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:37:01.526 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:37:01.526 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:37:01.527 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:37:01.527 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:37:01.527 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:37:01.527 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:37:01.527 INFO:tasks.workunit.client.0.smithi037.stderr: -474> 2024-09-12T17:37:01.224+0000 7f3b2b606640 10 monclient: _finish_auth 0 2024-09-12T17:37:01.527 INFO:tasks.workunit.client.0.smithi037.stderr: -473> 2024-09-12T17:37:01.224+0000 7f3b2b606640 10 monclient: _check_auth_tickets 2024-09-12T17:37:01.527 INFO:tasks.workunit.client.0.smithi037.stderr: -472> 2024-09-12T17:37:01.224+0000 7f3b2b606640 10 monclient: handle_config config(0 keys) 2024-09-12T17:37:01.527 INFO:tasks.workunit.client.0.smithi037.stderr: -471> 2024-09-12T17:37:01.224+0000 7f3b2b606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:37:01.527 INFO:tasks.workunit.client.0.smithi037.stderr: -470> 2024-09-12T17:37:01.224+0000 7f3b2b606640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:37:01.528 INFO:tasks.workunit.client.0.smithi037.stderr: -469> 2024-09-12T17:37:01.224+0000 7f3b2b606640 10 monclient: dump: 2024-09-12T17:37:01.528 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:37:01.528 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:37:01.528 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:37:01.528 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:37:01.528 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:37:01.529 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:37:01.529 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:37:01.529 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:37:01.529 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:37:01.529 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:37:01.529 INFO:tasks.workunit.client.0.smithi037.stderr: -468> 2024-09-12T17:37:01.224+0000 7f3c43c31800 5 monclient: authenticate success, global_id 7607 2024-09-12T17:37:01.529 INFO:tasks.workunit.client.0.smithi037.stderr: -467> 2024-09-12T17:37:01.224+0000 7f3c43c31800 10 monclient: _renew_subs 2024-09-12T17:37:01.529 INFO:tasks.workunit.client.0.smithi037.stderr: -466> 2024-09-12T17:37:01.224+0000 7f3c43c31800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.37:3301/0 2024-09-12T17:37:01.529 INFO:tasks.workunit.client.0.smithi037.stderr: -465> 2024-09-12T17:37:01.224+0000 7f3b2ce09640 4 set_mon_vals no callback set 2024-09-12T17:37:01.529 INFO:tasks.workunit.client.0.smithi037.stderr: -464> 2024-09-12T17:37:01.224+0000 7f3c43c31800 10 monclient: _renew_subs 2024-09-12T17:37:01.530 INFO:tasks.workunit.client.0.smithi037.stderr: -463> 2024-09-12T17:37:01.224+0000 7f3c43c31800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.37:3301/0 2024-09-12T17:37:01.530 INFO:tasks.workunit.client.0.smithi037.stderr: -462> 2024-09-12T17:37:01.224+0000 7f3c43c31800 1 librados: init done 2024-09-12T17:37:01.530 INFO:tasks.workunit.client.0.smithi037.stderr: -461> 2024-09-12T17:37:01.226+0000 7f3b2b606640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:37:01.530 INFO:tasks.workunit.client.0.smithi037.stderr: -460> 2024-09-12T17:37:01.226+0000 7f3b2b606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.40:6816/3916250676,v1:172.21.15.40:6817/3916250676] 2024-09-12T17:37:01.530 INFO:tasks.workunit.client.0.smithi037.stderr: -459> 2024-09-12T17:37:01.226+0000 7f3b2b606640 4 mgrc reconnect Starting new session with [v2:172.21.15.40:6816/3916250676,v1:172.21.15.40:6817/3916250676] 2024-09-12T17:37:01.530 INFO:tasks.workunit.client.0.smithi037.stderr: -458> 2024-09-12T17:37:01.226+0000 7f3c3e78a640 10 monclient: get_auth_request con 0x7f3b24076470 auth_method 0 2024-09-12T17:37:01.530 INFO:tasks.workunit.client.0.smithi037.stderr: -457> 2024-09-12T17:37:01.226+0000 7f3c3f78c640 10 monclient: get_auth_request con 0x5597c87f1d50 auth_method 0 2024-09-12T17:37:01.530 INFO:tasks.workunit.client.0.smithi037.stderr: -456> 2024-09-12T17:37:01.227+0000 7f3c3ef8b640 10 monclient: get_auth_request con 0x5597c87f4f30 auth_method 0 2024-09-12T17:37:01.530 INFO:tasks.workunit.client.0.smithi037.stderr: -455> 2024-09-12T17:37:01.229+0000 7f3c3e78a640 10 monclient: get_auth_request con 0x5597c87f9fc0 auth_method 0 2024-09-12T17:37:01.530 INFO:tasks.workunit.client.0.smithi037.stderr: -454> 2024-09-12T17:37:01.229+0000 7f3c43c31800 10 monclient: build_initial_monmap 2024-09-12T17:37:01.531 INFO:tasks.workunit.client.0.smithi037.stderr: -453> 2024-09-12T17:37:01.229+0000 7f3c43c31800 1 build_initial for_mkfs: 0 2024-09-12T17:37:01.531 INFO:tasks.workunit.client.0.smithi037.stderr: -452> 2024-09-12T17:37:01.229+0000 7f3c43c31800 10 monclient: monmap: 2024-09-12T17:37:01.531 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 0 2024-09-12T17:37:01.531 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:37:01.531 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 0.000000 2024-09-12T17:37:01.531 INFO:tasks.workunit.client.0.smithi037.stderr:created 0.000000 2024-09-12T17:37:01.531 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 0 (unknown) 2024-09-12T17:37:01.531 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:37:01.531 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.noname-a 2024-09-12T17:37:01.531 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.noname-b 2024-09-12T17:37:01.531 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.noname-c 2024-09-12T17:37:01.531 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:37:01.531 INFO:tasks.workunit.client.0.smithi037.stderr: -451> 2024-09-12T17:37:01.229+0000 7f3c43c31800 5 AuthRegistry(0x5597c87fde70) adding auth protocol: cephx 2024-09-12T17:37:01.532 INFO:tasks.workunit.client.0.smithi037.stderr: -450> 2024-09-12T17:37:01.229+0000 7f3c43c31800 5 AuthRegistry(0x5597c87fde70) adding auth protocol: cephx 2024-09-12T17:37:01.532 INFO:tasks.workunit.client.0.smithi037.stderr: -449> 2024-09-12T17:37:01.229+0000 7f3c43c31800 5 AuthRegistry(0x5597c87fde70) adding auth protocol: cephx 2024-09-12T17:37:01.532 INFO:tasks.workunit.client.0.smithi037.stderr: -448> 2024-09-12T17:37:01.229+0000 7f3c43c31800 5 AuthRegistry(0x5597c87fde70) adding con mode: secure 2024-09-12T17:37:01.532 INFO:tasks.workunit.client.0.smithi037.stderr: -447> 2024-09-12T17:37:01.229+0000 7f3c43c31800 5 AuthRegistry(0x5597c87fde70) adding con mode: crc 2024-09-12T17:37:01.532 INFO:tasks.workunit.client.0.smithi037.stderr: -446> 2024-09-12T17:37:01.229+0000 7f3c43c31800 5 AuthRegistry(0x5597c87fde70) adding con mode: secure 2024-09-12T17:37:01.532 INFO:tasks.workunit.client.0.smithi037.stderr: -445> 2024-09-12T17:37:01.229+0000 7f3c43c31800 5 AuthRegistry(0x5597c87fde70) adding con mode: crc 2024-09-12T17:37:01.532 INFO:tasks.workunit.client.0.smithi037.stderr: -444> 2024-09-12T17:37:01.229+0000 7f3c43c31800 5 AuthRegistry(0x5597c87fde70) adding con mode: secure 2024-09-12T17:37:01.532 INFO:tasks.workunit.client.0.smithi037.stderr: -443> 2024-09-12T17:37:01.229+0000 7f3c43c31800 5 AuthRegistry(0x5597c87fde70) adding con mode: crc 2024-09-12T17:37:01.532 INFO:tasks.workunit.client.0.smithi037.stderr: -442> 2024-09-12T17:37:01.229+0000 7f3c43c31800 5 AuthRegistry(0x5597c87fde70) adding con mode: crc 2024-09-12T17:37:01.532 INFO:tasks.workunit.client.0.smithi037.stderr: -441> 2024-09-12T17:37:01.229+0000 7f3c43c31800 5 AuthRegistry(0x5597c87fde70) adding con mode: secure 2024-09-12T17:37:01.533 INFO:tasks.workunit.client.0.smithi037.stderr: -440> 2024-09-12T17:37:01.229+0000 7f3c43c31800 5 AuthRegistry(0x5597c87fde70) adding con mode: crc 2024-09-12T17:37:01.533 INFO:tasks.workunit.client.0.smithi037.stderr: -439> 2024-09-12T17:37:01.229+0000 7f3c43c31800 5 AuthRegistry(0x5597c87fde70) adding con mode: secure 2024-09-12T17:37:01.533 INFO:tasks.workunit.client.0.smithi037.stderr: -438> 2024-09-12T17:37:01.229+0000 7f3c43c31800 5 AuthRegistry(0x5597c87fde70) adding con mode: crc 2024-09-12T17:37:01.533 INFO:tasks.workunit.client.0.smithi037.stderr: -437> 2024-09-12T17:37:01.229+0000 7f3c43c31800 5 AuthRegistry(0x5597c87fde70) adding con mode: secure 2024-09-12T17:37:01.533 INFO:tasks.workunit.client.0.smithi037.stderr: -436> 2024-09-12T17:37:01.230+0000 7f3c43c31800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:37:01.533 INFO:tasks.workunit.client.0.smithi037.stderr: -435> 2024-09-12T17:37:01.230+0000 7f3c43c31800 5 asok(0x5597c8588730) register_command objecter_requests cmddesc objecter_requests hook 0x5597c8801360 EEXIST 2024-09-12T17:37:01.533 INFO:tasks.workunit.client.0.smithi037.stderr: -434> 2024-09-12T17:37:01.230+0000 7f3c43c31800 10 monclient: init 2024-09-12T17:37:01.533 INFO:tasks.workunit.client.0.smithi037.stderr: -433> 2024-09-12T17:37:01.230+0000 7f3c43c31800 5 AuthRegistry(0x5597c87fce28) adding auth protocol: cephx 2024-09-12T17:37:01.533 INFO:tasks.workunit.client.0.smithi037.stderr: -432> 2024-09-12T17:37:01.230+0000 7f3c43c31800 5 AuthRegistry(0x5597c87fce28) adding auth protocol: cephx 2024-09-12T17:37:01.533 INFO:tasks.workunit.client.0.smithi037.stderr: -431> 2024-09-12T17:37:01.230+0000 7f3c43c31800 5 AuthRegistry(0x5597c87fce28) adding auth protocol: cephx 2024-09-12T17:37:01.533 INFO:tasks.workunit.client.0.smithi037.stderr: -430> 2024-09-12T17:37:01.230+0000 7f3c43c31800 5 AuthRegistry(0x5597c87fce28) adding con mode: secure 2024-09-12T17:37:01.533 INFO:tasks.workunit.client.0.smithi037.stderr: -429> 2024-09-12T17:37:01.230+0000 7f3c43c31800 5 AuthRegistry(0x5597c87fce28) adding con mode: crc 2024-09-12T17:37:01.533 INFO:tasks.workunit.client.0.smithi037.stderr: -428> 2024-09-12T17:37:01.230+0000 7f3c43c31800 5 AuthRegistry(0x5597c87fce28) adding con mode: secure 2024-09-12T17:37:01.534 INFO:tasks.workunit.client.0.smithi037.stderr: -427> 2024-09-12T17:37:01.230+0000 7f3c43c31800 5 AuthRegistry(0x5597c87fce28) adding con mode: crc 2024-09-12T17:37:01.534 INFO:tasks.workunit.client.0.smithi037.stderr: -426> 2024-09-12T17:37:01.230+0000 7f3c43c31800 5 AuthRegistry(0x5597c87fce28) adding con mode: secure 2024-09-12T17:37:01.534 INFO:tasks.workunit.client.0.smithi037.stderr: -425> 2024-09-12T17:37:01.230+0000 7f3c43c31800 5 AuthRegistry(0x5597c87fce28) adding con mode: crc 2024-09-12T17:37:01.534 INFO:tasks.workunit.client.0.smithi037.stderr: -424> 2024-09-12T17:37:01.230+0000 7f3c43c31800 5 AuthRegistry(0x5597c87fce28) adding con mode: crc 2024-09-12T17:37:01.534 INFO:tasks.workunit.client.0.smithi037.stderr: -423> 2024-09-12T17:37:01.230+0000 7f3c43c31800 5 AuthRegistry(0x5597c87fce28) adding con mode: secure 2024-09-12T17:37:01.534 INFO:tasks.workunit.client.0.smithi037.stderr: -422> 2024-09-12T17:37:01.230+0000 7f3c43c31800 5 AuthRegistry(0x5597c87fce28) adding con mode: crc 2024-09-12T17:37:01.534 INFO:tasks.workunit.client.0.smithi037.stderr: -421> 2024-09-12T17:37:01.230+0000 7f3c43c31800 5 AuthRegistry(0x5597c87fce28) adding con mode: secure 2024-09-12T17:37:01.534 INFO:tasks.workunit.client.0.smithi037.stderr: -420> 2024-09-12T17:37:01.230+0000 7f3c43c31800 5 AuthRegistry(0x5597c87fce28) adding con mode: crc 2024-09-12T17:37:01.534 INFO:tasks.workunit.client.0.smithi037.stderr: -419> 2024-09-12T17:37:01.230+0000 7f3c43c31800 5 AuthRegistry(0x5597c87fce28) adding con mode: secure 2024-09-12T17:37:01.534 INFO:tasks.workunit.client.0.smithi037.stderr: -418> 2024-09-12T17:37:01.230+0000 7f3c43c31800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:37:01.534 INFO:tasks.workunit.client.0.smithi037.stderr: -417> 2024-09-12T17:37:01.230+0000 7f3c43c31800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:37:01.534 INFO:tasks.workunit.client.0.smithi037.stderr: -416> 2024-09-12T17:37:01.230+0000 7f3c43c31800 5 asok(0x5597c8588730) register_command rotate-key cmddesc rotate-key hook 0x5597c87fcf70 EEXIST 2024-09-12T17:37:01.534 INFO:tasks.workunit.client.0.smithi037.stderr: -415> 2024-09-12T17:37:01.230+0000 7f3c43c31800 10 monclient: _reopen_session rank -1 2024-09-12T17:37:01.535 INFO:tasks.workunit.client.0.smithi037.stderr: -414> 2024-09-12T17:37:01.230+0000 7f3c43c31800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T17:37:01.535 INFO:tasks.workunit.client.0.smithi037.stderr: -413> 2024-09-12T17:37:01.230+0000 7f3c43c31800 10 monclient(hunting): picked mon.noname-b con 0x5597c8825680 addr [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] 2024-09-12T17:37:01.535 INFO:tasks.workunit.client.0.smithi037.stderr: -412> 2024-09-12T17:37:01.230+0000 7f3c43c31800 10 monclient(hunting): picked mon.noname-c con 0x5597c8825a60 addr [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] 2024-09-12T17:37:01.535 INFO:tasks.workunit.client.0.smithi037.stderr: -411> 2024-09-12T17:37:01.230+0000 7f3c43c31800 10 monclient(hunting): picked mon.noname-a con 0x5597c8824390 addr [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] 2024-09-12T17:37:01.535 INFO:tasks.workunit.client.0.smithi037.stderr: -410> 2024-09-12T17:37:01.230+0000 7f3c43c31800 10 monclient(hunting): start opening mon connection 2024-09-12T17:37:01.535 INFO:tasks.workunit.client.0.smithi037.stderr: -409> 2024-09-12T17:37:01.230+0000 7f3c43c31800 10 monclient(hunting): start opening mon connection 2024-09-12T17:37:01.535 INFO:tasks.workunit.client.0.smithi037.stderr: -408> 2024-09-12T17:37:01.230+0000 7f3c43c31800 10 monclient(hunting): start opening mon connection 2024-09-12T17:37:01.535 INFO:tasks.workunit.client.0.smithi037.stderr: -407> 2024-09-12T17:37:01.230+0000 7f3c43c31800 10 monclient(hunting): _renew_subs 2024-09-12T17:37:01.535 INFO:tasks.workunit.client.0.smithi037.stderr: -406> 2024-09-12T17:37:01.230+0000 7f3c43c31800 10 monclient(hunting): authenticate will time out at 2408.828849s 2024-09-12T17:37:01.535 INFO:tasks.workunit.client.0.smithi037.stderr: -405> 2024-09-12T17:37:01.230+0000 7f3c3f78c640 10 monclient(hunting): get_auth_request con 0x5597c8824390 auth_method 0 2024-09-12T17:37:01.535 INFO:tasks.workunit.client.0.smithi037.stderr: -404> 2024-09-12T17:37:01.230+0000 7f3c3f78c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:37:01.535 INFO:tasks.workunit.client.0.smithi037.stderr: -403> 2024-09-12T17:37:01.230+0000 7f3c3f78c640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:37:01.535 INFO:tasks.workunit.client.0.smithi037.stderr: -402> 2024-09-12T17:37:01.230+0000 7f3c3f78c640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:37:01.535 INFO:tasks.workunit.client.0.smithi037.stderr: -401> 2024-09-12T17:37:01.231+0000 7f3c3e78a640 10 monclient(hunting): get_auth_request con 0x5597c8825a60 auth_method 0 2024-09-12T17:37:01.535 INFO:tasks.workunit.client.0.smithi037.stderr: -400> 2024-09-12T17:37:01.231+0000 7f3c3e78a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:37:01.536 INFO:tasks.workunit.client.0.smithi037.stderr: -399> 2024-09-12T17:37:01.231+0000 7f3c3e78a640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:37:01.536 INFO:tasks.workunit.client.0.smithi037.stderr: -398> 2024-09-12T17:37:01.231+0000 7f3c3e78a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:37:01.536 INFO:tasks.workunit.client.0.smithi037.stderr: -397> 2024-09-12T17:37:01.231+0000 7f3c3ef8b640 10 monclient(hunting): get_auth_request con 0x5597c8825680 auth_method 0 2024-09-12T17:37:01.536 INFO:tasks.workunit.client.0.smithi037.stderr: -396> 2024-09-12T17:37:01.231+0000 7f3c3ef8b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:37:01.536 INFO:tasks.workunit.client.0.smithi037.stderr: -395> 2024-09-12T17:37:01.231+0000 7f3c3ef8b640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:37:01.536 INFO:tasks.workunit.client.0.smithi037.stderr: -394> 2024-09-12T17:37:01.231+0000 7f3c3ef8b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:37:01.536 INFO:tasks.workunit.client.0.smithi037.stderr: -393> 2024-09-12T17:37:01.231+0000 7f3c3f78c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:37:01.536 INFO:tasks.workunit.client.0.smithi037.stderr: -392> 2024-09-12T17:37:01.231+0000 7f3c3f78c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:37:01.536 INFO:tasks.workunit.client.0.smithi037.stderr: -391> 2024-09-12T17:37:01.231+0000 7f3c3f78c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:37:01.536 INFO:tasks.workunit.client.0.smithi037.stderr: -390> 2024-09-12T17:37:01.231+0000 7f3c3e78a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:37:01.536 INFO:tasks.workunit.client.0.smithi037.stderr: -389> 2024-09-12T17:37:01.231+0000 7f3c3e78a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:37:01.536 INFO:tasks.workunit.client.0.smithi037.stderr: -388> 2024-09-12T17:37:01.231+0000 7f3c3e78a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:37:01.536 INFO:tasks.workunit.client.0.smithi037.stderr: -387> 2024-09-12T17:37:01.231+0000 7f3c3ef8b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:37:01.536 INFO:tasks.workunit.client.0.smithi037.stderr: -386> 2024-09-12T17:37:01.231+0000 7f3c3ef8b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:37:01.537 INFO:tasks.workunit.client.0.smithi037.stderr: -385> 2024-09-12T17:37:01.231+0000 7f3c3ef8b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:37:01.537 INFO:tasks.workunit.client.0.smithi037.stderr: -384> 2024-09-12T17:37:01.231+0000 7f3c3f78c640 10 monclient(hunting): handle_auth_done global_id 8154 payload 824 2024-09-12T17:37:01.537 INFO:tasks.workunit.client.0.smithi037.stderr: -383> 2024-09-12T17:37:01.231+0000 7f3c3f78c640 10 monclient: _finish_hunting 0 2024-09-12T17:37:01.537 INFO:tasks.workunit.client.0.smithi037.stderr: -382> 2024-09-12T17:37:01.231+0000 7f3c3f78c640 1 monclient: found mon.noname-a 2024-09-12T17:37:01.537 INFO:tasks.workunit.client.0.smithi037.stderr: -381> 2024-09-12T17:37:01.231+0000 7f3c3f78c640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.37:3300/0 2024-09-12T17:37:01.537 INFO:tasks.workunit.client.0.smithi037.stderr: -380> 2024-09-12T17:37:01.231+0000 7f3b28e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:37:01.537 INFO:tasks.workunit.client.0.smithi037.stderr: -379> 2024-09-12T17:37:01.231+0000 7f3b28e01640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:37:01.537 INFO:tasks.workunit.client.0.smithi037.stderr: -378> 2024-09-12T17:37:01.231+0000 7f3b28e01640 10 monclient: dump: 2024-09-12T17:37:01.537 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:37:01.537 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:37:01.537 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:37:01.537 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:37:01.537 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:37:01.537 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:37:01.538 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:37:01.538 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:37:01.538 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:37:01.538 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:37:01.538 INFO:tasks.workunit.client.0.smithi037.stderr: -377> 2024-09-12T17:37:01.231+0000 7f3b28e01640 10 monclient: _finish_auth 0 2024-09-12T17:37:01.538 INFO:tasks.workunit.client.0.smithi037.stderr: -376> 2024-09-12T17:37:01.231+0000 7f3b28e01640 10 monclient: _check_auth_tickets 2024-09-12T17:37:01.538 INFO:tasks.workunit.client.0.smithi037.stderr: -375> 2024-09-12T17:37:01.231+0000 7f3c43c31800 5 monclient: authenticate success, global_id 8154 2024-09-12T17:37:01.538 INFO:tasks.workunit.client.0.smithi037.stderr: -374> 2024-09-12T17:37:01.231+0000 7f3c43c31800 10 monclient: _renew_subs 2024-09-12T17:37:01.538 INFO:tasks.workunit.client.0.smithi037.stderr: -373> 2024-09-12T17:37:01.231+0000 7f3c43c31800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.37:3300/0 2024-09-12T17:37:01.538 INFO:tasks.workunit.client.0.smithi037.stderr: -372> 2024-09-12T17:37:01.231+0000 7f3b28e01640 10 monclient: handle_config config(0 keys) 2024-09-12T17:37:01.538 INFO:tasks.workunit.client.0.smithi037.stderr: -371> 2024-09-12T17:37:01.231+0000 7f3b28e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:37:01.538 INFO:tasks.workunit.client.0.smithi037.stderr: -370> 2024-09-12T17:37:01.231+0000 7f3b28e01640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:37:01.538 INFO:tasks.workunit.client.0.smithi037.stderr: -369> 2024-09-12T17:37:01.231+0000 7f3b28e01640 10 monclient: dump: 2024-09-12T17:37:01.538 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:37:01.538 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:37:01.539 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:37:01.539 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:37:01.539 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:37:01.539 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:37:01.539 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:37:01.539 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:37:01.539 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:37:01.539 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:37:01.539 INFO:tasks.workunit.client.0.smithi037.stderr: -368> 2024-09-12T17:37:01.231+0000 7f3c3ff8d640 4 set_mon_vals no callback set 2024-09-12T17:37:01.539 INFO:tasks.workunit.client.0.smithi037.stderr: -367> 2024-09-12T17:37:01.231+0000 7f3c43c31800 10 monclient: _renew_subs 2024-09-12T17:37:01.539 INFO:tasks.workunit.client.0.smithi037.stderr: -366> 2024-09-12T17:37:01.231+0000 7f3c43c31800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.37:3300/0 2024-09-12T17:37:01.539 INFO:tasks.workunit.client.0.smithi037.stderr: -365> 2024-09-12T17:37:01.233+0000 7f3b28e01640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:37:01.539 INFO:tasks.workunit.client.0.smithi037.stderr: -364> 2024-09-12T17:37:01.233+0000 7f3b28e01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.40:6816/3916250676,v1:172.21.15.40:6817/3916250676] 2024-09-12T17:37:01.539 INFO:tasks.workunit.client.0.smithi037.stderr: -363> 2024-09-12T17:37:01.233+0000 7f3b28e01640 4 mgrc reconnect Starting new session with [v2:172.21.15.40:6816/3916250676,v1:172.21.15.40:6817/3916250676] 2024-09-12T17:37:01.540 INFO:tasks.workunit.client.0.smithi037.stderr: -362> 2024-09-12T17:37:01.234+0000 7f3c3ef8b640 10 monclient: get_auth_request con 0x7f3b18076380 auth_method 0 2024-09-12T17:37:01.540 INFO:tasks.workunit.client.0.smithi037.stderr: -361> 2024-09-12T17:37:01.234+0000 7f3c43c31800 10 monclient: get_monmap_and_config 2024-09-12T17:37:01.540 INFO:tasks.workunit.client.0.smithi037.stderr: -360> 2024-09-12T17:37:01.234+0000 7f3c43c31800 10 monclient: build_initial_monmap 2024-09-12T17:37:01.540 INFO:tasks.workunit.client.0.smithi037.stderr: -359> 2024-09-12T17:37:01.234+0000 7f3c43c31800 1 build_initial for_mkfs: 0 2024-09-12T17:37:01.540 INFO:tasks.workunit.client.0.smithi037.stderr: -358> 2024-09-12T17:37:01.234+0000 7f3c43c31800 10 monclient: monmap: 2024-09-12T17:37:01.540 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 0 2024-09-12T17:37:01.540 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:37:01.540 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 0.000000 2024-09-12T17:37:01.540 INFO:tasks.workunit.client.0.smithi037.stderr:created 0.000000 2024-09-12T17:37:01.540 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 0 (unknown) 2024-09-12T17:37:01.540 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:37:01.540 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.noname-a 2024-09-12T17:37:01.540 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.noname-b 2024-09-12T17:37:01.541 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.noname-c 2024-09-12T17:37:01.541 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:37:01.541 INFO:tasks.workunit.client.0.smithi037.stderr: -357> 2024-09-12T17:37:01.234+0000 7f3c43c31800 5 AuthRegistry(0x5597c88453d0) adding auth protocol: cephx 2024-09-12T17:37:01.541 INFO:tasks.workunit.client.0.smithi037.stderr: -356> 2024-09-12T17:37:01.234+0000 7f3c43c31800 5 AuthRegistry(0x5597c88453d0) adding auth protocol: cephx 2024-09-12T17:37:01.541 INFO:tasks.workunit.client.0.smithi037.stderr: -355> 2024-09-12T17:37:01.234+0000 7f3c43c31800 5 AuthRegistry(0x5597c88453d0) adding auth protocol: cephx 2024-09-12T17:37:01.541 INFO:tasks.workunit.client.0.smithi037.stderr: -354> 2024-09-12T17:37:01.234+0000 7f3c43c31800 5 AuthRegistry(0x5597c88453d0) adding con mode: secure 2024-09-12T17:37:01.541 INFO:tasks.workunit.client.0.smithi037.stderr: -353> 2024-09-12T17:37:01.234+0000 7f3c43c31800 5 AuthRegistry(0x5597c88453d0) adding con mode: crc 2024-09-12T17:37:01.541 INFO:tasks.workunit.client.0.smithi037.stderr: -352> 2024-09-12T17:37:01.234+0000 7f3c43c31800 5 AuthRegistry(0x5597c88453d0) adding con mode: secure 2024-09-12T17:37:01.541 INFO:tasks.workunit.client.0.smithi037.stderr: -351> 2024-09-12T17:37:01.234+0000 7f3c43c31800 5 AuthRegistry(0x5597c88453d0) adding con mode: crc 2024-09-12T17:37:01.541 INFO:tasks.workunit.client.0.smithi037.stderr: -350> 2024-09-12T17:37:01.234+0000 7f3c43c31800 5 AuthRegistry(0x5597c88453d0) adding con mode: secure 2024-09-12T17:37:01.541 INFO:tasks.workunit.client.0.smithi037.stderr: -349> 2024-09-12T17:37:01.234+0000 7f3c43c31800 5 AuthRegistry(0x5597c88453d0) adding con mode: crc 2024-09-12T17:37:01.541 INFO:tasks.workunit.client.0.smithi037.stderr: -348> 2024-09-12T17:37:01.234+0000 7f3c43c31800 5 AuthRegistry(0x5597c88453d0) adding con mode: crc 2024-09-12T17:37:01.541 INFO:tasks.workunit.client.0.smithi037.stderr: -347> 2024-09-12T17:37:01.234+0000 7f3c43c31800 5 AuthRegistry(0x5597c88453d0) adding con mode: secure 2024-09-12T17:37:01.542 INFO:tasks.workunit.client.0.smithi037.stderr: -346> 2024-09-12T17:37:01.234+0000 7f3c43c31800 5 AuthRegistry(0x5597c88453d0) adding con mode: crc 2024-09-12T17:37:01.542 INFO:tasks.workunit.client.0.smithi037.stderr: -345> 2024-09-12T17:37:01.234+0000 7f3c43c31800 5 AuthRegistry(0x5597c88453d0) adding con mode: secure 2024-09-12T17:37:01.542 INFO:tasks.workunit.client.0.smithi037.stderr: -344> 2024-09-12T17:37:01.234+0000 7f3c43c31800 5 AuthRegistry(0x5597c88453d0) adding con mode: crc 2024-09-12T17:37:01.542 INFO:tasks.workunit.client.0.smithi037.stderr: -343> 2024-09-12T17:37:01.234+0000 7f3c43c31800 5 AuthRegistry(0x5597c88453d0) adding con mode: secure 2024-09-12T17:37:01.542 INFO:tasks.workunit.client.0.smithi037.stderr: -342> 2024-09-12T17:37:01.234+0000 7f3c43c31800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:37:01.542 INFO:tasks.workunit.client.0.smithi037.stderr: -341> 2024-09-12T17:37:01.234+0000 7f3c43c31800 10 monclient: init 2024-09-12T17:37:01.542 INFO:tasks.workunit.client.0.smithi037.stderr: -340> 2024-09-12T17:37:01.234+0000 7f3c43c31800 5 AuthRegistry(0x7ffc9737a960) adding auth protocol: cephx 2024-09-12T17:37:01.542 INFO:tasks.workunit.client.0.smithi037.stderr: -339> 2024-09-12T17:37:01.234+0000 7f3c43c31800 5 AuthRegistry(0x7ffc9737a960) adding auth protocol: cephx 2024-09-12T17:37:01.542 INFO:tasks.workunit.client.0.smithi037.stderr: -338> 2024-09-12T17:37:01.234+0000 7f3c43c31800 5 AuthRegistry(0x7ffc9737a960) adding auth protocol: cephx 2024-09-12T17:37:01.542 INFO:tasks.workunit.client.0.smithi037.stderr: -337> 2024-09-12T17:37:01.234+0000 7f3c43c31800 5 AuthRegistry(0x7ffc9737a960) adding con mode: secure 2024-09-12T17:37:01.542 INFO:tasks.workunit.client.0.smithi037.stderr: -336> 2024-09-12T17:37:01.234+0000 7f3c43c31800 5 AuthRegistry(0x7ffc9737a960) adding con mode: crc 2024-09-12T17:37:01.542 INFO:tasks.workunit.client.0.smithi037.stderr: -335> 2024-09-12T17:37:01.234+0000 7f3c43c31800 5 AuthRegistry(0x7ffc9737a960) adding con mode: secure 2024-09-12T17:37:01.542 INFO:tasks.workunit.client.0.smithi037.stderr: -334> 2024-09-12T17:37:01.234+0000 7f3c43c31800 5 AuthRegistry(0x7ffc9737a960) adding con mode: crc 2024-09-12T17:37:01.543 INFO:tasks.workunit.client.0.smithi037.stderr: -333> 2024-09-12T17:37:01.234+0000 7f3c43c31800 5 AuthRegistry(0x7ffc9737a960) adding con mode: secure 2024-09-12T17:37:01.543 INFO:tasks.workunit.client.0.smithi037.stderr: -332> 2024-09-12T17:37:01.234+0000 7f3c43c31800 5 AuthRegistry(0x7ffc9737a960) adding con mode: crc 2024-09-12T17:37:01.543 INFO:tasks.workunit.client.0.smithi037.stderr: -331> 2024-09-12T17:37:01.234+0000 7f3c43c31800 5 AuthRegistry(0x7ffc9737a960) adding con mode: crc 2024-09-12T17:37:01.543 INFO:tasks.workunit.client.0.smithi037.stderr: -330> 2024-09-12T17:37:01.234+0000 7f3c43c31800 5 AuthRegistry(0x7ffc9737a960) adding con mode: secure 2024-09-12T17:37:01.543 INFO:tasks.workunit.client.0.smithi037.stderr: -329> 2024-09-12T17:37:01.234+0000 7f3c43c31800 5 AuthRegistry(0x7ffc9737a960) adding con mode: crc 2024-09-12T17:37:01.543 INFO:tasks.workunit.client.0.smithi037.stderr: -328> 2024-09-12T17:37:01.234+0000 7f3c43c31800 5 AuthRegistry(0x7ffc9737a960) adding con mode: secure 2024-09-12T17:37:01.543 INFO:tasks.workunit.client.0.smithi037.stderr: -327> 2024-09-12T17:37:01.234+0000 7f3c43c31800 5 AuthRegistry(0x7ffc9737a960) adding con mode: crc 2024-09-12T17:37:01.543 INFO:tasks.workunit.client.0.smithi037.stderr: -326> 2024-09-12T17:37:01.234+0000 7f3c43c31800 5 AuthRegistry(0x7ffc9737a960) adding con mode: secure 2024-09-12T17:37:01.543 INFO:tasks.workunit.client.0.smithi037.stderr: -325> 2024-09-12T17:37:01.234+0000 7f3c43c31800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:37:01.543 INFO:tasks.workunit.client.0.smithi037.stderr: -324> 2024-09-12T17:37:01.235+0000 7f3c43c31800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:37:01.543 INFO:tasks.workunit.client.0.smithi037.stderr: -323> 2024-09-12T17:37:01.235+0000 7f3c43c31800 5 asok(0x5597c8588730) register_command rotate-key cmddesc rotate-key hook 0x7ffc9737aaa8 EEXIST 2024-09-12T17:37:01.543 INFO:tasks.workunit.client.0.smithi037.stderr: -322> 2024-09-12T17:37:01.235+0000 7f3c43c31800 10 monclient: _reopen_session rank -1 2024-09-12T17:37:01.543 INFO:tasks.workunit.client.0.smithi037.stderr: -321> 2024-09-12T17:37:01.235+0000 7f3c43c31800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T17:37:01.544 INFO:tasks.workunit.client.0.smithi037.stderr: -320> 2024-09-12T17:37:01.235+0000 7f3c43c31800 10 monclient(hunting): picked mon.noname-a con 0x5597c8874f60 addr [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] 2024-09-12T17:37:01.544 INFO:tasks.workunit.client.0.smithi037.stderr: -319> 2024-09-12T17:37:01.235+0000 7f3c43c31800 10 monclient(hunting): picked mon.noname-c con 0x5597c887a810 addr [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] 2024-09-12T17:37:01.544 INFO:tasks.workunit.client.0.smithi037.stderr: -318> 2024-09-12T17:37:01.235+0000 7f3c43c31800 10 monclient(hunting): picked mon.noname-b con 0x5597c8877830 addr [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] 2024-09-12T17:37:01.544 INFO:tasks.workunit.client.0.smithi037.stderr: -317> 2024-09-12T17:37:01.235+0000 7f3c43c31800 10 monclient(hunting): start opening mon connection 2024-09-12T17:37:01.544 INFO:tasks.workunit.client.0.smithi037.stderr: -316> 2024-09-12T17:37:01.235+0000 7f3c43c31800 10 monclient(hunting): start opening mon connection 2024-09-12T17:37:01.544 INFO:tasks.workunit.client.0.smithi037.stderr: -315> 2024-09-12T17:37:01.235+0000 7f3c43c31800 10 monclient(hunting): start opening mon connection 2024-09-12T17:37:01.544 INFO:tasks.workunit.client.0.smithi037.stderr: -314> 2024-09-12T17:37:01.235+0000 7f3c43c31800 10 monclient(hunting): _renew_subs 2024-09-12T17:37:01.544 INFO:tasks.workunit.client.0.smithi037.stderr: -313> 2024-09-12T17:37:01.235+0000 7f3c43c31800 10 monclient(hunting): authenticate will time out at 2408.833258s 2024-09-12T17:37:01.544 INFO:tasks.workunit.client.0.smithi037.stderr: -312> 2024-09-12T17:37:01.235+0000 7f3c3ef8b640 10 monclient(hunting): get_auth_request con 0x5597c8874f60 auth_method 0 2024-09-12T17:37:01.544 INFO:tasks.workunit.client.0.smithi037.stderr: -311> 2024-09-12T17:37:01.235+0000 7f3c3ef8b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:37:01.544 INFO:tasks.workunit.client.0.smithi037.stderr: -310> 2024-09-12T17:37:01.235+0000 7f3c3ef8b640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:37:01.544 INFO:tasks.workunit.client.0.smithi037.stderr: -309> 2024-09-12T17:37:01.235+0000 7f3c3ef8b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:37:01.545 INFO:tasks.workunit.client.0.smithi037.stderr: -308> 2024-09-12T17:37:01.235+0000 7f3c3e78a640 10 monclient(hunting): get_auth_request con 0x5597c887a810 auth_method 0 2024-09-12T17:37:01.545 INFO:tasks.workunit.client.0.smithi037.stderr: -307> 2024-09-12T17:37:01.235+0000 7f3c3e78a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:37:01.545 INFO:tasks.workunit.client.0.smithi037.stderr: -306> 2024-09-12T17:37:01.235+0000 7f3c3e78a640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:37:01.545 INFO:tasks.workunit.client.0.smithi037.stderr: -305> 2024-09-12T17:37:01.235+0000 7f3c3e78a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:37:01.545 INFO:tasks.workunit.client.0.smithi037.stderr: -304> 2024-09-12T17:37:01.235+0000 7f3c3ef8b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:37:01.545 INFO:tasks.workunit.client.0.smithi037.stderr: -303> 2024-09-12T17:37:01.235+0000 7f3c3ef8b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:37:01.545 INFO:tasks.workunit.client.0.smithi037.stderr: -302> 2024-09-12T17:37:01.235+0000 7f3c3ef8b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:37:01.545 INFO:tasks.workunit.client.0.smithi037.stderr: -301> 2024-09-12T17:37:01.235+0000 7f3c3f78c640 10 monclient(hunting): get_auth_request con 0x5597c8877830 auth_method 0 2024-09-12T17:37:01.546 INFO:tasks.workunit.client.0.smithi037.stderr: -300> 2024-09-12T17:37:01.235+0000 7f3c3f78c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:37:01.546 INFO:tasks.workunit.client.0.smithi037.stderr: -299> 2024-09-12T17:37:01.235+0000 7f3c3f78c640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:37:01.546 INFO:tasks.workunit.client.0.smithi037.stderr: -298> 2024-09-12T17:37:01.235+0000 7f3c3f78c640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:37:01.546 INFO:tasks.workunit.client.0.smithi037.stderr: -297> 2024-09-12T17:37:01.235+0000 7f3c3e78a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:37:01.546 INFO:tasks.workunit.client.0.smithi037.stderr: -296> 2024-09-12T17:37:01.235+0000 7f3c3e78a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:37:01.546 INFO:tasks.workunit.client.0.smithi037.stderr: -295> 2024-09-12T17:37:01.235+0000 7f3c3e78a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:37:01.546 INFO:tasks.workunit.client.0.smithi037.stderr: -294> 2024-09-12T17:37:01.235+0000 7f3c3f78c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:37:01.546 INFO:tasks.workunit.client.0.smithi037.stderr: -293> 2024-09-12T17:37:01.235+0000 7f3c3f78c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:37:01.546 INFO:tasks.workunit.client.0.smithi037.stderr: -292> 2024-09-12T17:37:01.235+0000 7f3c3f78c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:37:01.546 INFO:tasks.workunit.client.0.smithi037.stderr: -291> 2024-09-12T17:37:01.235+0000 7f3c3ef8b640 10 monclient(hunting): handle_auth_done global_id 8157 payload 274 2024-09-12T17:37:01.546 INFO:tasks.workunit.client.0.smithi037.stderr: -290> 2024-09-12T17:37:01.235+0000 7f3c3ef8b640 10 monclient: _finish_hunting 0 2024-09-12T17:37:01.546 INFO:tasks.workunit.client.0.smithi037.stderr: -289> 2024-09-12T17:37:01.235+0000 7f3c3ef8b640 1 monclient: found mon.noname-a 2024-09-12T17:37:01.546 INFO:tasks.workunit.client.0.smithi037.stderr: -288> 2024-09-12T17:37:01.235+0000 7f3c3ef8b640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.37:3300/0 2024-09-12T17:37:01.547 INFO:tasks.workunit.client.0.smithi037.stderr: -287> 2024-09-12T17:37:01.235+0000 7f3b227fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:37:01.547 INFO:tasks.workunit.client.0.smithi037.stderr: -286> 2024-09-12T17:37:01.235+0000 7f3b227fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:37:01.547 INFO:tasks.workunit.client.0.smithi037.stderr: -285> 2024-09-12T17:37:01.235+0000 7f3b227fc640 10 monclient: dump: 2024-09-12T17:37:01.547 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:37:01.547 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:37:01.547 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:37:01.547 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:37:01.547 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:37:01.547 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:37:01.547 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:37:01.547 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:37:01.548 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:37:01.548 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:37:01.548 INFO:tasks.workunit.client.0.smithi037.stderr: -284> 2024-09-12T17:37:01.235+0000 7f3b227fc640 10 monclient: _finish_auth 0 2024-09-12T17:37:01.548 INFO:tasks.workunit.client.0.smithi037.stderr: -283> 2024-09-12T17:37:01.235+0000 7f3b227fc640 10 monclient: _check_auth_tickets 2024-09-12T17:37:01.548 INFO:tasks.workunit.client.0.smithi037.stderr: -282> 2024-09-12T17:37:01.235+0000 7f3b227fc640 10 monclient: handle_config config(0 keys) 2024-09-12T17:37:01.548 INFO:tasks.workunit.client.0.smithi037.stderr: -281> 2024-09-12T17:37:01.235+0000 7f3b227fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:37:01.548 INFO:tasks.workunit.client.0.smithi037.stderr: -280> 2024-09-12T17:37:01.235+0000 7f3b227fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:37:01.548 INFO:tasks.workunit.client.0.smithi037.stderr: -279> 2024-09-12T17:37:01.235+0000 7f3b227fc640 10 monclient: dump: 2024-09-12T17:37:01.548 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:37:01.548 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:37:01.548 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:37:01.548 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:37:01.548 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:37:01.549 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:37:01.549 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:37:01.549 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:37:01.549 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:37:01.549 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:37:01.549 INFO:tasks.workunit.client.0.smithi037.stderr: -278> 2024-09-12T17:37:01.235+0000 7f3c43c31800 5 monclient: authenticate success, global_id 8157 2024-09-12T17:37:01.549 INFO:tasks.workunit.client.0.smithi037.stderr: -277> 2024-09-12T17:37:01.235+0000 7f3c43c31800 10 monclient: get_monmap_and_config success 2024-09-12T17:37:01.549 INFO:tasks.workunit.client.0.smithi037.stderr: -276> 2024-09-12T17:37:01.235+0000 7f3c43c31800 4 set_mon_vals no callback set 2024-09-12T17:37:01.549 INFO:tasks.workunit.client.0.smithi037.stderr: -275> 2024-09-12T17:37:01.236+0000 7f3c43c31800 10 monclient: shutdown 2024-09-12T17:37:01.549 INFO:tasks.workunit.client.0.smithi037.stderr: -274> 2024-09-12T17:37:01.236+0000 7f3c43c31800 10 monclient: build_initial_monmap 2024-09-12T17:37:01.549 INFO:tasks.workunit.client.0.smithi037.stderr: -273> 2024-09-12T17:37:01.236+0000 7f3c43c31800 1 build_initial for_mkfs: 0 2024-09-12T17:37:01.549 INFO:tasks.workunit.client.0.smithi037.stderr: -272> 2024-09-12T17:37:01.236+0000 7f3c43c31800 10 monclient: monmap: 2024-09-12T17:37:01.549 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 0 2024-09-12T17:37:01.550 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:37:01.550 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 0.000000 2024-09-12T17:37:01.550 INFO:tasks.workunit.client.0.smithi037.stderr:created 0.000000 2024-09-12T17:37:01.550 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 0 (unknown) 2024-09-12T17:37:01.550 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:37:01.550 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.noname-a 2024-09-12T17:37:01.550 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.noname-b 2024-09-12T17:37:01.550 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.noname-c 2024-09-12T17:37:01.550 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:37:01.550 INFO:tasks.workunit.client.0.smithi037.stderr: -271> 2024-09-12T17:37:01.236+0000 7f3c43c31800 5 AuthRegistry(0x5597c86344a0) adding auth protocol: cephx 2024-09-12T17:37:01.550 INFO:tasks.workunit.client.0.smithi037.stderr: -270> 2024-09-12T17:37:01.236+0000 7f3c43c31800 5 AuthRegistry(0x5597c86344a0) adding auth protocol: cephx 2024-09-12T17:37:01.550 INFO:tasks.workunit.client.0.smithi037.stderr: -269> 2024-09-12T17:37:01.236+0000 7f3c43c31800 5 AuthRegistry(0x5597c86344a0) adding auth protocol: cephx 2024-09-12T17:37:01.550 INFO:tasks.workunit.client.0.smithi037.stderr: -268> 2024-09-12T17:37:01.236+0000 7f3c43c31800 5 AuthRegistry(0x5597c86344a0) adding con mode: secure 2024-09-12T17:37:01.550 INFO:tasks.workunit.client.0.smithi037.stderr: -267> 2024-09-12T17:37:01.236+0000 7f3c43c31800 5 AuthRegistry(0x5597c86344a0) adding con mode: crc 2024-09-12T17:37:01.551 INFO:tasks.workunit.client.0.smithi037.stderr: -266> 2024-09-12T17:37:01.236+0000 7f3c43c31800 5 AuthRegistry(0x5597c86344a0) adding con mode: secure 2024-09-12T17:37:01.551 INFO:tasks.workunit.client.0.smithi037.stderr: -265> 2024-09-12T17:37:01.236+0000 7f3c43c31800 5 AuthRegistry(0x5597c86344a0) adding con mode: crc 2024-09-12T17:37:01.551 INFO:tasks.workunit.client.0.smithi037.stderr: -264> 2024-09-12T17:37:01.236+0000 7f3c43c31800 5 AuthRegistry(0x5597c86344a0) adding con mode: secure 2024-09-12T17:37:01.551 INFO:tasks.workunit.client.0.smithi037.stderr: -263> 2024-09-12T17:37:01.236+0000 7f3c43c31800 5 AuthRegistry(0x5597c86344a0) adding con mode: crc 2024-09-12T17:37:01.551 INFO:tasks.workunit.client.0.smithi037.stderr: -262> 2024-09-12T17:37:01.236+0000 7f3c43c31800 5 AuthRegistry(0x5597c86344a0) adding con mode: crc 2024-09-12T17:37:01.551 INFO:tasks.workunit.client.0.smithi037.stderr: -261> 2024-09-12T17:37:01.236+0000 7f3c43c31800 5 AuthRegistry(0x5597c86344a0) adding con mode: secure 2024-09-12T17:37:01.551 INFO:tasks.workunit.client.0.smithi037.stderr: -260> 2024-09-12T17:37:01.236+0000 7f3c43c31800 5 AuthRegistry(0x5597c86344a0) adding con mode: crc 2024-09-12T17:37:01.551 INFO:tasks.workunit.client.0.smithi037.stderr: -259> 2024-09-12T17:37:01.236+0000 7f3c43c31800 5 AuthRegistry(0x5597c86344a0) adding con mode: secure 2024-09-12T17:37:01.551 INFO:tasks.workunit.client.0.smithi037.stderr: -258> 2024-09-12T17:37:01.236+0000 7f3c43c31800 5 AuthRegistry(0x5597c86344a0) adding con mode: crc 2024-09-12T17:37:01.551 INFO:tasks.workunit.client.0.smithi037.stderr: -257> 2024-09-12T17:37:01.236+0000 7f3c43c31800 5 AuthRegistry(0x5597c86344a0) adding con mode: secure 2024-09-12T17:37:01.551 INFO:tasks.workunit.client.0.smithi037.stderr: -256> 2024-09-12T17:37:01.236+0000 7f3c43c31800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:37:01.551 INFO:tasks.workunit.client.0.smithi037.stderr: -255> 2024-09-12T17:37:01.236+0000 7f3c43c31800 1 librados: starting msgr at 2024-09-12T17:37:01.551 INFO:tasks.workunit.client.0.smithi037.stderr: -254> 2024-09-12T17:37:01.236+0000 7f3c43c31800 1 librados: starting objecter 2024-09-12T17:37:01.551 INFO:tasks.workunit.client.0.smithi037.stderr: -253> 2024-09-12T17:37:01.236+0000 7f3c43c31800 5 asok(0x5597c8588730) register_command objecter_requests cmddesc objecter_requests hook 0x5597c8849eb0 EEXIST 2024-09-12T17:37:01.552 INFO:tasks.workunit.client.0.smithi037.stderr: -252> 2024-09-12T17:37:01.237+0000 7f3c43c31800 1 librados: setting wanted keys 2024-09-12T17:37:01.552 INFO:tasks.workunit.client.0.smithi037.stderr: -251> 2024-09-12T17:37:01.237+0000 7f3c43c31800 1 librados: calling monclient init 2024-09-12T17:37:01.552 INFO:tasks.workunit.client.0.smithi037.stderr: -250> 2024-09-12T17:37:01.237+0000 7f3c43c31800 10 monclient: init 2024-09-12T17:37:01.552 INFO:tasks.workunit.client.0.smithi037.stderr: -249> 2024-09-12T17:37:01.237+0000 7f3c43c31800 5 AuthRegistry(0x5597c8839f40) adding auth protocol: cephx 2024-09-12T17:37:01.552 INFO:tasks.workunit.client.0.smithi037.stderr: -248> 2024-09-12T17:37:01.237+0000 7f3c43c31800 5 AuthRegistry(0x5597c8839f40) adding auth protocol: cephx 2024-09-12T17:37:01.552 INFO:tasks.workunit.client.0.smithi037.stderr: -247> 2024-09-12T17:37:01.237+0000 7f3c43c31800 5 AuthRegistry(0x5597c8839f40) adding auth protocol: cephx 2024-09-12T17:37:01.552 INFO:tasks.workunit.client.0.smithi037.stderr: -246> 2024-09-12T17:37:01.237+0000 7f3c43c31800 5 AuthRegistry(0x5597c8839f40) adding con mode: secure 2024-09-12T17:37:01.552 INFO:tasks.workunit.client.0.smithi037.stderr: -245> 2024-09-12T17:37:01.237+0000 7f3c43c31800 5 AuthRegistry(0x5597c8839f40) adding con mode: crc 2024-09-12T17:37:01.553 INFO:tasks.workunit.client.0.smithi037.stderr: -244> 2024-09-12T17:37:01.237+0000 7f3c43c31800 5 AuthRegistry(0x5597c8839f40) adding con mode: secure 2024-09-12T17:37:01.553 INFO:tasks.workunit.client.0.smithi037.stderr: -243> 2024-09-12T17:37:01.237+0000 7f3c43c31800 5 AuthRegistry(0x5597c8839f40) adding con mode: crc 2024-09-12T17:37:01.553 INFO:tasks.workunit.client.0.smithi037.stderr: -242> 2024-09-12T17:37:01.237+0000 7f3c43c31800 5 AuthRegistry(0x5597c8839f40) adding con mode: secure 2024-09-12T17:37:01.553 INFO:tasks.workunit.client.0.smithi037.stderr: -241> 2024-09-12T17:37:01.237+0000 7f3c43c31800 5 AuthRegistry(0x5597c8839f40) adding con mode: crc 2024-09-12T17:37:01.553 INFO:tasks.workunit.client.0.smithi037.stderr: -240> 2024-09-12T17:37:01.237+0000 7f3c43c31800 5 AuthRegistry(0x5597c8839f40) adding con mode: crc 2024-09-12T17:37:01.553 INFO:tasks.workunit.client.0.smithi037.stderr: -239> 2024-09-12T17:37:01.237+0000 7f3c43c31800 5 AuthRegistry(0x5597c8839f40) adding con mode: secure 2024-09-12T17:37:01.554 INFO:tasks.workunit.client.0.smithi037.stderr: -238> 2024-09-12T17:37:01.237+0000 7f3c43c31800 5 AuthRegistry(0x5597c8839f40) adding con mode: crc 2024-09-12T17:37:01.554 INFO:tasks.workunit.client.0.smithi037.stderr: -237> 2024-09-12T17:37:01.237+0000 7f3c43c31800 5 AuthRegistry(0x5597c8839f40) adding con mode: secure 2024-09-12T17:37:01.554 INFO:tasks.workunit.client.0.smithi037.stderr: -236> 2024-09-12T17:37:01.237+0000 7f3c43c31800 5 AuthRegistry(0x5597c8839f40) adding con mode: crc 2024-09-12T17:37:01.554 INFO:tasks.workunit.client.0.smithi037.stderr: -235> 2024-09-12T17:37:01.237+0000 7f3c43c31800 5 AuthRegistry(0x5597c8839f40) adding con mode: secure 2024-09-12T17:37:01.554 INFO:tasks.workunit.client.0.smithi037.stderr: -234> 2024-09-12T17:37:01.237+0000 7f3c43c31800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:37:01.554 INFO:tasks.workunit.client.0.smithi037.stderr: -233> 2024-09-12T17:37:01.237+0000 7f3c43c31800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:37:01.554 INFO:tasks.workunit.client.0.smithi037.stderr: -232> 2024-09-12T17:37:01.237+0000 7f3c43c31800 5 asok(0x5597c8588730) register_command rotate-key cmddesc rotate-key hook 0x5597c883a088 EEXIST 2024-09-12T17:37:01.554 INFO:tasks.workunit.client.0.smithi037.stderr: -231> 2024-09-12T17:37:01.237+0000 7f3c43c31800 10 monclient: _reopen_session rank -1 2024-09-12T17:37:01.554 INFO:tasks.workunit.client.0.smithi037.stderr: -230> 2024-09-12T17:37:01.237+0000 7f3c43c31800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T17:37:01.555 INFO:tasks.workunit.client.0.smithi037.stderr: -229> 2024-09-12T17:37:01.237+0000 7f3c43c31800 10 monclient(hunting): picked mon.noname-c con 0x5597c8874f60 addr [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] 2024-09-12T17:37:01.555 INFO:tasks.workunit.client.0.smithi037.stderr: -228> 2024-09-12T17:37:01.237+0000 7f3c43c31800 10 monclient(hunting): picked mon.noname-b con 0x5597c8877830 addr [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] 2024-09-12T17:37:01.555 INFO:tasks.workunit.client.0.smithi037.stderr: -227> 2024-09-12T17:37:01.237+0000 7f3c43c31800 10 monclient(hunting): picked mon.noname-a con 0x5597c887a810 addr [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] 2024-09-12T17:37:01.555 INFO:tasks.workunit.client.0.smithi037.stderr: -226> 2024-09-12T17:37:01.237+0000 7f3c43c31800 10 monclient(hunting): start opening mon connection 2024-09-12T17:37:01.555 INFO:tasks.workunit.client.0.smithi037.stderr: -225> 2024-09-12T17:37:01.237+0000 7f3c43c31800 10 monclient(hunting): start opening mon connection 2024-09-12T17:37:01.555 INFO:tasks.workunit.client.0.smithi037.stderr: -224> 2024-09-12T17:37:01.237+0000 7f3c43c31800 10 monclient(hunting): start opening mon connection 2024-09-12T17:37:01.555 INFO:tasks.workunit.client.0.smithi037.stderr: -223> 2024-09-12T17:37:01.237+0000 7f3c43c31800 10 monclient(hunting): _renew_subs 2024-09-12T17:37:01.556 INFO:tasks.workunit.client.0.smithi037.stderr: -222> 2024-09-12T17:37:01.237+0000 7f3c43c31800 10 monclient(hunting): authenticate will time out at 2408.835593s 2024-09-12T17:37:01.556 INFO:tasks.workunit.client.0.smithi037.stderr: -221> 2024-09-12T17:37:01.237+0000 7f3c3ef8b640 10 monclient(hunting): get_auth_request con 0x5597c8874f60 auth_method 0 2024-09-12T17:37:01.556 INFO:tasks.workunit.client.0.smithi037.stderr: -220> 2024-09-12T17:37:01.237+0000 7f3c3ef8b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:37:01.556 INFO:tasks.workunit.client.0.smithi037.stderr: -219> 2024-09-12T17:37:01.237+0000 7f3c3ef8b640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:37:01.556 INFO:tasks.workunit.client.0.smithi037.stderr: -218> 2024-09-12T17:37:01.237+0000 7f3c3ef8b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:37:01.556 INFO:tasks.workunit.client.0.smithi037.stderr: -217> 2024-09-12T17:37:01.237+0000 7f3c3f78c640 10 monclient(hunting): get_auth_request con 0x5597c887a810 auth_method 0 2024-09-12T17:37:01.556 INFO:tasks.workunit.client.0.smithi037.stderr: -216> 2024-09-12T17:37:01.237+0000 7f3c3f78c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:37:01.556 INFO:tasks.workunit.client.0.smithi037.stderr: -215> 2024-09-12T17:37:01.237+0000 7f3c3f78c640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:37:01.556 INFO:tasks.workunit.client.0.smithi037.stderr: -214> 2024-09-12T17:37:01.237+0000 7f3c3f78c640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:37:01.556 INFO:tasks.workunit.client.0.smithi037.stderr: -213> 2024-09-12T17:37:01.237+0000 7f3c3e78a640 10 monclient(hunting): get_auth_request con 0x5597c8877830 auth_method 0 2024-09-12T17:37:01.556 INFO:tasks.workunit.client.0.smithi037.stderr: -212> 2024-09-12T17:37:01.237+0000 7f3c3e78a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:37:01.556 INFO:tasks.workunit.client.0.smithi037.stderr: -211> 2024-09-12T17:37:01.237+0000 7f3c3e78a640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:37:01.556 INFO:tasks.workunit.client.0.smithi037.stderr: -210> 2024-09-12T17:37:01.237+0000 7f3c3e78a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:37:01.557 INFO:tasks.workunit.client.0.smithi037.stderr: -209> 2024-09-12T17:37:01.237+0000 7f3c3ef8b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:37:01.557 INFO:tasks.workunit.client.0.smithi037.stderr: -208> 2024-09-12T17:37:01.237+0000 7f3c3ef8b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:37:01.557 INFO:tasks.workunit.client.0.smithi037.stderr: -207> 2024-09-12T17:37:01.237+0000 7f3c3ef8b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:37:01.557 INFO:tasks.workunit.client.0.smithi037.stderr: -206> 2024-09-12T17:37:01.237+0000 7f3c3f78c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:37:01.557 INFO:tasks.workunit.client.0.smithi037.stderr: -205> 2024-09-12T17:37:01.237+0000 7f3c3f78c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:37:01.557 INFO:tasks.workunit.client.0.smithi037.stderr: -204> 2024-09-12T17:37:01.237+0000 7f3c3f78c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:37:01.557 INFO:tasks.workunit.client.0.smithi037.stderr: -203> 2024-09-12T17:37:01.237+0000 7f3c3e78a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:37:01.557 INFO:tasks.workunit.client.0.smithi037.stderr: -202> 2024-09-12T17:37:01.237+0000 7f3c3e78a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:37:01.557 INFO:tasks.workunit.client.0.smithi037.stderr: -201> 2024-09-12T17:37:01.237+0000 7f3c3e78a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:37:01.557 INFO:tasks.workunit.client.0.smithi037.stderr: -200> 2024-09-12T17:37:01.237+0000 7f3c3ef8b640 10 monclient(hunting): handle_auth_done global_id 7616 payload 824 2024-09-12T17:37:01.557 INFO:tasks.workunit.client.0.smithi037.stderr: -199> 2024-09-12T17:37:01.237+0000 7f3c3ef8b640 10 monclient: _finish_hunting 0 2024-09-12T17:37:01.557 INFO:tasks.workunit.client.0.smithi037.stderr: -198> 2024-09-12T17:37:01.237+0000 7f3c3ef8b640 1 monclient: found mon.noname-c 2024-09-12T17:37:01.557 INFO:tasks.workunit.client.0.smithi037.stderr: -197> 2024-09-12T17:37:01.237+0000 7f3c3ef8b640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.37:3301/0 2024-09-12T17:37:01.558 INFO:tasks.workunit.client.0.smithi037.stderr: -196> 2024-09-12T17:37:01.238+0000 7f3b20ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:37:01.558 INFO:tasks.workunit.client.0.smithi037.stderr: -195> 2024-09-12T17:37:01.238+0000 7f3b20ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:37:01.558 INFO:tasks.workunit.client.0.smithi037.stderr: -194> 2024-09-12T17:37:01.238+0000 7f3b20ff9640 10 monclient: dump: 2024-09-12T17:37:01.558 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:37:01.558 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:37:01.558 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:37:01.558 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:37:01.558 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:37:01.558 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:37:01.558 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:37:01.558 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:37:01.558 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:37:01.558 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:37:01.559 INFO:tasks.workunit.client.0.smithi037.stderr: -193> 2024-09-12T17:37:01.238+0000 7f3b20ff9640 10 monclient: _finish_auth 0 2024-09-12T17:37:01.559 INFO:tasks.workunit.client.0.smithi037.stderr: -192> 2024-09-12T17:37:01.238+0000 7f3b20ff9640 10 monclient: _check_auth_tickets 2024-09-12T17:37:01.559 INFO:tasks.workunit.client.0.smithi037.stderr: -191> 2024-09-12T17:37:01.238+0000 7f3b20ff9640 10 monclient: handle_config config(0 keys) 2024-09-12T17:37:01.559 INFO:tasks.workunit.client.0.smithi037.stderr: -190> 2024-09-12T17:37:01.238+0000 7f3b20ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:37:01.559 INFO:tasks.workunit.client.0.smithi037.stderr: -189> 2024-09-12T17:37:01.238+0000 7f3b20ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:37:01.559 INFO:tasks.workunit.client.0.smithi037.stderr: -188> 2024-09-12T17:37:01.238+0000 7f3b20ff9640 10 monclient: dump: 2024-09-12T17:37:01.559 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:37:01.559 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:37:01.559 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:37:01.560 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:37:01.560 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:37:01.560 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:37:01.560 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:37:01.560 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:37:01.560 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:37:01.560 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:37:01.560 INFO:tasks.workunit.client.0.smithi037.stderr: -187> 2024-09-12T17:37:01.238+0000 7f3c43c31800 5 monclient: authenticate success, global_id 7616 2024-09-12T17:37:01.560 INFO:tasks.workunit.client.0.smithi037.stderr: -186> 2024-09-12T17:37:01.238+0000 7f3c43c31800 10 monclient: _renew_subs 2024-09-12T17:37:01.560 INFO:tasks.workunit.client.0.smithi037.stderr: -185> 2024-09-12T17:37:01.238+0000 7f3b227fc640 4 set_mon_vals no callback set 2024-09-12T17:37:01.560 INFO:tasks.workunit.client.0.smithi037.stderr: -184> 2024-09-12T17:37:01.238+0000 7f3c43c31800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.37:3301/0 2024-09-12T17:37:01.561 INFO:tasks.workunit.client.0.smithi037.stderr: -183> 2024-09-12T17:37:01.238+0000 7f3c43c31800 10 monclient: _renew_subs 2024-09-12T17:37:01.561 INFO:tasks.workunit.client.0.smithi037.stderr: -182> 2024-09-12T17:37:01.238+0000 7f3c43c31800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.37:3301/0 2024-09-12T17:37:01.561 INFO:tasks.workunit.client.0.smithi037.stderr: -181> 2024-09-12T17:37:01.238+0000 7f3c43c31800 1 librados: init done 2024-09-12T17:37:01.561 INFO:tasks.workunit.client.0.smithi037.stderr: -180> 2024-09-12T17:37:01.238+0000 7f3c43c31800 5 asok(0x5597c8588730) register_command cr dump hook 0x5597c8871978 2024-09-12T17:37:01.561 INFO:tasks.workunit.client.0.smithi037.stderr: -179> 2024-09-12T17:37:01.240+0000 7f3c43c31800 20 rados->read ofs=0 len=0 2024-09-12T17:37:01.561 INFO:tasks.workunit.client.0.smithi037.stderr: -178> 2024-09-12T17:37:01.240+0000 7f3b20ff9640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:37:01.561 INFO:tasks.workunit.client.0.smithi037.stderr: -177> 2024-09-12T17:37:01.240+0000 7f3b20ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.40:6816/3916250676,v1:172.21.15.40:6817/3916250676] 2024-09-12T17:37:01.561 INFO:tasks.workunit.client.0.smithi037.stderr: -176> 2024-09-12T17:37:01.240+0000 7f3b20ff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.40:6816/3916250676,v1:172.21.15.40:6817/3916250676] 2024-09-12T17:37:01.561 INFO:tasks.workunit.client.0.smithi037.stderr: -175> 2024-09-12T17:37:01.241+0000 7f3c3e78a640 10 monclient: get_auth_request con 0x7f3b08076470 auth_method 0 2024-09-12T17:37:01.561 INFO:tasks.workunit.client.0.smithi037.stderr: -174> 2024-09-12T17:37:01.241+0000 7f3c3f78c640 10 monclient: get_auth_request con 0x5597c88951e0 auth_method 0 2024-09-12T17:37:01.561 INFO:tasks.workunit.client.0.smithi037.stderr: -173> 2024-09-12T17:37:01.241+0000 7f3c43c31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:01.561 INFO:tasks.workunit.client.0.smithi037.stderr: -172> 2024-09-12T17:37:01.241+0000 7f3c43c31800 20 realm 2024-09-12T17:37:01.561 INFO:tasks.workunit.client.0.smithi037.stderr: -171> 2024-09-12T17:37:01.241+0000 7f3c43c31800 20 rados->read ofs=0 len=0 2024-09-12T17:37:01.562 INFO:tasks.workunit.client.0.smithi037.stderr: -170> 2024-09-12T17:37:01.241+0000 7f3c43c31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:01.562 INFO:tasks.workunit.client.0.smithi037.stderr: -169> 2024-09-12T17:37:01.241+0000 7f3c43c31800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:37:01.562 INFO:tasks.workunit.client.0.smithi037.stderr: -168> 2024-09-12T17:37:01.241+0000 7f3c43c31800 20 rados->read ofs=0 len=0 2024-09-12T17:37:01.562 INFO:tasks.workunit.client.0.smithi037.stderr: -167> 2024-09-12T17:37:01.242+0000 7f3c43c31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:01.562 INFO:tasks.workunit.client.0.smithi037.stderr: -166> 2024-09-12T17:37:01.242+0000 7f3c43c31800 20 rados->read ofs=0 len=0 2024-09-12T17:37:01.562 INFO:tasks.workunit.client.0.smithi037.stderr: -165> 2024-09-12T17:37:01.242+0000 7f3c3ef8b640 10 monclient: get_auth_request con 0x5597c8899450 auth_method 0 2024-09-12T17:37:01.562 INFO:tasks.workunit.client.0.smithi037.stderr: -164> 2024-09-12T17:37:01.242+0000 7f3c43c31800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:37:01.562 INFO:tasks.workunit.client.0.smithi037.stderr: -163> 2024-09-12T17:37:01.242+0000 7f3c43c31800 20 rados->read ofs=0 len=0 2024-09-12T17:37:01.563 INFO:tasks.workunit.client.0.smithi037.stderr: -162> 2024-09-12T17:37:01.243+0000 7f3c43c31800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:37:01.563 INFO:tasks.workunit.client.0.smithi037.stderr: -161> 2024-09-12T17:37:01.243+0000 7f3c43c31800 20 searching for the correct realm 2024-09-12T17:37:01.563 INFO:tasks.workunit.client.0.smithi037.stderr: -160> 2024-09-12T17:37:01.243+0000 7f3c3e78a640 10 monclient: get_auth_request con 0x5597c889e720 auth_method 0 2024-09-12T17:37:01.563 INFO:tasks.workunit.client.0.smithi037.stderr: -159> 2024-09-12T17:37:01.244+0000 7f3c3f78c640 10 monclient: get_auth_request con 0x7f3c3402f950 auth_method 0 2024-09-12T17:37:01.563 INFO:tasks.workunit.client.0.smithi037.stderr: -158> 2024-09-12T17:37:01.244+0000 7f3c3ef8b640 10 monclient: get_auth_request con 0x7f3c38065e50 auth_method 0 2024-09-12T17:37:01.564 INFO:tasks.workunit.client.0.smithi037.stderr: -157> 2024-09-12T17:37:01.245+0000 7f3c3e78a640 10 monclient: get_auth_request con 0x7f3c3006b020 auth_method 0 2024-09-12T17:37:01.564 INFO:tasks.workunit.client.0.smithi037.stderr: -156> 2024-09-12T17:37:01.245+0000 7f3c3e78a640 0 -- 172.21.15.37:0/3860369574 >> [v2:172.21.15.40:6800/2441293461,v1:172.21.15.40:6801/2441293461] conn(0x7f3c3006b020 msgr2=0x7f3c3005a460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:37:01.564 INFO:tasks.workunit.client.0.smithi037.stderr: -155> 2024-09-12T17:37:01.245+0000 7f3b20ff9640 1 client.7616.objecter ms_handle_reset 0x7f3c3006b020 session 0x7f3c300ba070 osd.4 2024-09-12T17:37:01.564 INFO:tasks.workunit.client.0.smithi037.stderr: -154> 2024-09-12T17:37:01.245+0000 7f3b20ff9640 10 monclient: _renew_subs 2024-09-12T17:37:01.564 INFO:tasks.workunit.client.0.smithi037.stderr: -153> 2024-09-12T17:37:01.245+0000 7f3b20ff9640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.37:3301/0 2024-09-12T17:37:01.564 INFO:tasks.workunit.client.0.smithi037.stderr: -152> 2024-09-12T17:37:01.245+0000 7f3c3e78a640 10 monclient: get_auth_request con 0x7f3b08086b10 auth_method 0 2024-09-12T17:37:01.565 INFO:tasks.workunit.client.0.smithi037.stderr: -151> 2024-09-12T17:37:01.247+0000 7f3c3f78c640 10 monclient: get_auth_request con 0x7f3c3401a8b0 auth_method 0 2024-09-12T17:37:01.565 INFO:tasks.workunit.client.0.smithi037.stderr: -150> 2024-09-12T17:37:01.250+0000 7f3c3ef8b640 10 monclient: get_auth_request con 0x7f3c3403d400 auth_method 0 2024-09-12T17:37:01.565 INFO:tasks.workunit.client.0.smithi037.stderr: -149> 2024-09-12T17:37:01.250+0000 7f3c3ef8b640 0 -- 172.21.15.37:0/3860369574 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7f3c3403d400 msgr2=0x7f3c3403d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:37:01.565 INFO:tasks.workunit.client.0.smithi037.stderr: -148> 2024-09-12T17:37:01.451+0000 7f3c3ef8b640 10 monclient: get_auth_request con 0x7f3c3403d400 auth_method 0 2024-09-12T17:37:01.566 INFO:tasks.workunit.client.0.smithi037.stderr: -147> 2024-09-12T17:37:01.456+0000 7f3c43c31800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:37:01.566 INFO:tasks.workunit.client.0.smithi037.stderr: -146> 2024-09-12T17:37:01.456+0000 7f3c43c31800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:37:01.566 INFO:tasks.workunit.client.0.smithi037.stderr: -145> 2024-09-12T17:37:01.456+0000 7f3c43c31800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:37:01.566 INFO:tasks.workunit.client.0.smithi037.stderr: -144> 2024-09-12T17:37:01.456+0000 7f3c43c31800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:37:01.566 INFO:tasks.workunit.client.0.smithi037.stderr: -143> 2024-09-12T17:37:01.456+0000 7f3c43c31800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:37:01.566 INFO:tasks.workunit.client.0.smithi037.stderr: -142> 2024-09-12T17:37:01.456+0000 7f3c43c31800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:37:01.567 INFO:tasks.workunit.client.0.smithi037.stderr: -141> 2024-09-12T17:37:01.456+0000 7f3c43c31800 20 rados->read ofs=0 len=0 2024-09-12T17:37:01.567 INFO:tasks.workunit.client.0.smithi037.stderr: -140> 2024-09-12T17:37:01.456+0000 7f3c43c31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:01.567 INFO:tasks.workunit.client.0.smithi037.stderr: -139> 2024-09-12T17:37:01.456+0000 7f3c43c31800 20 rados->read ofs=0 len=0 2024-09-12T17:37:01.567 INFO:tasks.workunit.client.0.smithi037.stderr: -138> 2024-09-12T17:37:01.457+0000 7f3c43c31800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:37:01.567 INFO:tasks.workunit.client.0.smithi037.stderr: -137> 2024-09-12T17:37:01.457+0000 7f3c43c31800 20 rados->read ofs=0 len=0 2024-09-12T17:37:01.568 INFO:tasks.workunit.client.0.smithi037.stderr: -136> 2024-09-12T17:37:01.457+0000 7f3c43c31800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:37:01.568 INFO:tasks.workunit.client.0.smithi037.stderr: -135> 2024-09-12T17:37:01.457+0000 7f3c43c31800 20 zone default found 2024-09-12T17:37:01.568 INFO:tasks.workunit.client.0.smithi037.stderr: -134> 2024-09-12T17:37:01.457+0000 7f3c43c31800 4 Realm: () 2024-09-12T17:37:01.568 INFO:tasks.workunit.client.0.smithi037.stderr: -133> 2024-09-12T17:37:01.457+0000 7f3c43c31800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:37:01.568 INFO:tasks.workunit.client.0.smithi037.stderr: -132> 2024-09-12T17:37:01.457+0000 7f3c43c31800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:37:01.569 INFO:tasks.workunit.client.0.smithi037.stderr: -131> 2024-09-12T17:37:01.457+0000 7f3c43c31800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:37:01.569 INFO:tasks.workunit.client.0.smithi037.stderr: -130> 2024-09-12T17:37:01.457+0000 7f3c43c31800 20 zonegroup default 2024-09-12T17:37:01.569 INFO:tasks.workunit.client.0.smithi037.stderr: -129> 2024-09-12T17:37:01.457+0000 7f3c43c31800 20 rados->read ofs=0 len=0 2024-09-12T17:37:01.569 INFO:tasks.workunit.client.0.smithi037.stderr: -128> 2024-09-12T17:37:01.458+0000 7f3c43c31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:01.569 INFO:tasks.workunit.client.0.smithi037.stderr: -127> 2024-09-12T17:37:01.458+0000 7f3c43c31800 20 rados->read ofs=0 len=0 2024-09-12T17:37:01.570 INFO:tasks.workunit.client.0.smithi037.stderr: -126> 2024-09-12T17:37:01.458+0000 7f3c43c31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:01.570 INFO:tasks.workunit.client.0.smithi037.stderr: -125> 2024-09-12T17:37:01.458+0000 7f3c43c31800 20 rados->read ofs=0 len=0 2024-09-12T17:37:01.570 INFO:tasks.workunit.client.0.smithi037.stderr: -124> 2024-09-12T17:37:01.458+0000 7f3c43c31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:01.570 INFO:tasks.workunit.client.0.smithi037.stderr: -123> 2024-09-12T17:37:01.458+0000 7f3c43c31800 20 started sync module instance, tier type = 2024-09-12T17:37:01.570 INFO:tasks.workunit.client.0.smithi037.stderr: -122> 2024-09-12T17:37:01.458+0000 7f3c43c31800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:37:01.570 INFO:tasks.workunit.client.0.smithi037.stderr: -121> 2024-09-12T17:37:01.468+0000 7f3c43c31800 20 add_watcher() i=0 2024-09-12T17:37:01.570 INFO:tasks.workunit.client.0.smithi037.stderr: -120> 2024-09-12T17:37:01.468+0000 7f3c43c31800 20 add_watcher() i=1 2024-09-12T17:37:01.570 INFO:tasks.workunit.client.0.smithi037.stderr: -119> 2024-09-12T17:37:01.468+0000 7f3c43c31800 20 add_watcher() i=2 2024-09-12T17:37:01.571 INFO:tasks.workunit.client.0.smithi037.stderr: -118> 2024-09-12T17:37:01.468+0000 7f3c43c31800 20 add_watcher() i=3 2024-09-12T17:37:01.571 INFO:tasks.workunit.client.0.smithi037.stderr: -117> 2024-09-12T17:37:01.468+0000 7f3c43c31800 20 add_watcher() i=4 2024-09-12T17:37:01.571 INFO:tasks.workunit.client.0.smithi037.stderr: -116> 2024-09-12T17:37:01.468+0000 7f3c43c31800 20 add_watcher() i=5 2024-09-12T17:37:01.571 INFO:tasks.workunit.client.0.smithi037.stderr: -115> 2024-09-12T17:37:01.468+0000 7f3c43c31800 20 add_watcher() i=6 2024-09-12T17:37:01.571 INFO:tasks.workunit.client.0.smithi037.stderr: -114> 2024-09-12T17:37:01.469+0000 7f3c43c31800 20 add_watcher() i=7 2024-09-12T17:37:01.571 INFO:tasks.workunit.client.0.smithi037.stderr: -113> 2024-09-12T17:37:01.469+0000 7f3c43c31800 2 all 8 watchers are set, enabling cache 2024-09-12T17:37:01.571 INFO:tasks.workunit.client.0.smithi037.stderr: -112> 2024-09-12T17:37:01.471+0000 7f3c43c31800 5 AuthRegistry(0x7ffc9737ae30) adding auth protocol: cephx 2024-09-12T17:37:01.571 INFO:tasks.workunit.client.0.smithi037.stderr: -111> 2024-09-12T17:37:01.471+0000 7f3c43c31800 5 AuthRegistry(0x7ffc9737ae30) adding auth protocol: cephx 2024-09-12T17:37:01.571 INFO:tasks.workunit.client.0.smithi037.stderr: -110> 2024-09-12T17:37:01.471+0000 7f3c43c31800 5 AuthRegistry(0x7ffc9737ae30) adding auth protocol: cephx 2024-09-12T17:37:01.571 INFO:tasks.workunit.client.0.smithi037.stderr: -109> 2024-09-12T17:37:01.471+0000 7f3c43c31800 5 AuthRegistry(0x7ffc9737ae30) adding con mode: secure 2024-09-12T17:37:01.571 INFO:tasks.workunit.client.0.smithi037.stderr: -108> 2024-09-12T17:37:01.471+0000 7f3c43c31800 5 AuthRegistry(0x7ffc9737ae30) adding con mode: crc 2024-09-12T17:37:01.571 INFO:tasks.workunit.client.0.smithi037.stderr: -107> 2024-09-12T17:37:01.471+0000 7f3c43c31800 5 AuthRegistry(0x7ffc9737ae30) adding con mode: secure 2024-09-12T17:37:01.572 INFO:tasks.workunit.client.0.smithi037.stderr: -106> 2024-09-12T17:37:01.471+0000 7f3c43c31800 5 AuthRegistry(0x7ffc9737ae30) adding con mode: crc 2024-09-12T17:37:01.572 INFO:tasks.workunit.client.0.smithi037.stderr: -105> 2024-09-12T17:37:01.471+0000 7f3c43c31800 5 AuthRegistry(0x7ffc9737ae30) adding con mode: secure 2024-09-12T17:37:01.572 INFO:tasks.workunit.client.0.smithi037.stderr: -104> 2024-09-12T17:37:01.471+0000 7f3c43c31800 5 AuthRegistry(0x7ffc9737ae30) adding con mode: crc 2024-09-12T17:37:01.572 INFO:tasks.workunit.client.0.smithi037.stderr: -103> 2024-09-12T17:37:01.471+0000 7f3c43c31800 5 AuthRegistry(0x7ffc9737ae30) adding con mode: crc 2024-09-12T17:37:01.572 INFO:tasks.workunit.client.0.smithi037.stderr: -102> 2024-09-12T17:37:01.471+0000 7f3c43c31800 5 AuthRegistry(0x7ffc9737ae30) adding con mode: secure 2024-09-12T17:37:01.573 INFO:tasks.workunit.client.0.smithi037.stderr: -101> 2024-09-12T17:37:01.471+0000 7f3c43c31800 5 AuthRegistry(0x7ffc9737ae30) adding con mode: crc 2024-09-12T17:37:01.573 INFO:tasks.workunit.client.0.smithi037.stderr: -100> 2024-09-12T17:37:01.471+0000 7f3c43c31800 5 AuthRegistry(0x7ffc9737ae30) adding con mode: secure 2024-09-12T17:37:01.573 INFO:tasks.workunit.client.0.smithi037.stderr: -99> 2024-09-12T17:37:01.471+0000 7f3c43c31800 5 AuthRegistry(0x7ffc9737ae30) adding con mode: crc 2024-09-12T17:37:01.573 INFO:tasks.workunit.client.0.smithi037.stderr: -98> 2024-09-12T17:37:01.471+0000 7f3af57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:37:01.573 INFO:tasks.workunit.client.0.smithi037.stderr: -97> 2024-09-12T17:37:01.471+0000 7f3c43c31800 5 AuthRegistry(0x7ffc9737ae30) adding con mode: secure 2024-09-12T17:37:01.574 INFO:tasks.workunit.client.0.smithi037.stderr: -96> 2024-09-12T17:37:01.471+0000 7f3c43c31800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:37:01.574 INFO:tasks.workunit.client.0.smithi037.stderr: -95> 2024-09-12T17:37:01.471+0000 7f3c43c31800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:37:01.574 INFO:tasks.workunit.client.0.smithi037.stderr: -94> 2024-09-12T17:37:01.471+0000 7f3c43c31800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:37:01.574 INFO:tasks.workunit.client.0.smithi037.stderr: -93> 2024-09-12T17:37:01.471+0000 7f3c43c31800 5 asok(0x5597c8588730) register_command cache list hook 0x5597c887f3b0 2024-09-12T17:37:01.574 INFO:tasks.workunit.client.0.smithi037.stderr: -92> 2024-09-12T17:37:01.471+0000 7f3c43c31800 5 asok(0x5597c8588730) register_command cache inspect hook 0x5597c887f3b0 2024-09-12T17:37:01.574 INFO:tasks.workunit.client.0.smithi037.stderr: -91> 2024-09-12T17:37:01.471+0000 7f3c43c31800 5 asok(0x5597c8588730) register_command cache erase hook 0x5597c887f3b0 2024-09-12T17:37:01.574 INFO:tasks.workunit.client.0.smithi037.stderr: -90> 2024-09-12T17:37:01.471+0000 7f3c43c31800 5 asok(0x5597c8588730) register_command cache zap hook 0x5597c887f3b0 2024-09-12T17:37:01.574 INFO:tasks.workunit.client.0.smithi037.stderr: -89> 2024-09-12T17:37:01.472+0000 7f3c43c31800 5 note: GC not initialized 2024-09-12T17:37:01.574 INFO:tasks.workunit.client.0.smithi037.stderr: -88> 2024-09-12T17:37:01.472+0000 7f3a6ffff640 20 reqs_thread_entry: start 2024-09-12T17:37:01.574 INFO:tasks.workunit.client.0.smithi037.stderr: -87> 2024-09-12T17:37:01.472+0000 7f3c43c31800 5 asok(0x5597c8588730) register_command sync trace show hook 0x7f3c3001c450 2024-09-12T17:37:01.575 INFO:tasks.workunit.client.0.smithi037.stderr: -86> 2024-09-12T17:37:01.472+0000 7f3c43c31800 5 asok(0x5597c8588730) register_command sync trace history hook 0x7f3c3001c450 2024-09-12T17:37:01.575 INFO:tasks.workunit.client.0.smithi037.stderr: -85> 2024-09-12T17:37:01.472+0000 7f3c43c31800 5 asok(0x5597c8588730) register_command sync trace active hook 0x7f3c3001c450 2024-09-12T17:37:01.575 INFO:tasks.workunit.client.0.smithi037.stderr: -84> 2024-09-12T17:37:01.472+0000 7f3c43c31800 5 asok(0x5597c8588730) register_command sync trace active_short hook 0x7f3c3001c450 2024-09-12T17:37:01.575 INFO:tasks.workunit.client.0.smithi037.stderr: -83> 2024-09-12T17:37:01.472+0000 7f3c43c31800 20 init_complete bucket index max shards: 11 2024-09-12T17:37:01.575 INFO:tasks.workunit.client.0.smithi037.stderr: -82> 2024-09-12T17:37:01.472+0000 7f3c43c31800 20 Filter name: none 2024-09-12T17:37:01.575 INFO:tasks.workunit.client.0.smithi037.stderr: -81> 2024-09-12T17:37:01.472+0000 7f3a6dffb640 20 reqs_thread_entry: start 2024-09-12T17:37:01.575 INFO:tasks.workunit.client.0.smithi037.stderr: -80> 2024-09-12T17:37:01.472+0000 7f3c43c31800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:37:01.575 INFO:tasks.workunit.client.0.smithi037.stderr: -79> 2024-09-12T17:37:01.472+0000 7f3c43c31800 20 rados->read ofs=0 len=0 2024-09-12T17:37:01.575 INFO:tasks.workunit.client.0.smithi037.stderr: -78> 2024-09-12T17:37:01.473+0000 7f3c43c31800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:37:01.575 INFO:tasks.workunit.client.0.smithi037.stderr: -77> 2024-09-12T17:37:01.473+0000 7f3c43c31800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:37:01.576 INFO:tasks.workunit.client.0.smithi037.stderr: -76> 2024-09-12T17:37:01.473+0000 7f3c43c31800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:37:01.576 INFO:tasks.workunit.client.0.smithi037.stderr: -75> 2024-09-12T17:37:01.473+0000 7f3c43c31800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 : miss 2024-09-12T17:37:01.576 INFO:tasks.workunit.client.0.smithi037.stderr: -74> 2024-09-12T17:37:01.473+0000 7f3c43c31800 20 rados->read ofs=0 len=0 2024-09-12T17:37:01.576 INFO:tasks.workunit.client.0.smithi037.stderr: -73> 2024-09-12T17:37:01.473+0000 7f3c43c31800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:37:01.576 INFO:tasks.workunit.client.0.smithi037.stderr: -72> 2024-09-12T17:37:01.473+0000 7f3c43c31800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 info.flags=0x17 2024-09-12T17:37:01.576 INFO:tasks.workunit.client.0.smithi037.stderr: -71> 2024-09-12T17:37:01.473+0000 7f3c43c31800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 to cache LRU end 2024-09-12T17:37:01.576 INFO:tasks.workunit.client.0.smithi037.stderr: -70> 2024-09-12T17:37:01.473+0000 7f3c43c31800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:37:01.577 INFO:tasks.workunit.client.0.smithi037.stderr: -69> 2024-09-12T17:37:01.473+0000 7f3c43c31800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:37:01.577 INFO:tasks.workunit.client.0.smithi037.stderr: -68> 2024-09-12T17:37:01.473+0000 7f3c43c31800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 2024-09-12T17:37:01.577 INFO:tasks.workunit.client.0.smithi037.stderr: -67> 2024-09-12T17:37:01.479+0000 7f3c43c31800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 info.flags=0x17 2024-09-12T17:37:01.577 INFO:tasks.workunit.client.0.smithi037.stderr: -66> 2024-09-12T17:37:01.479+0000 7f3c43c31800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 to cache LRU end 2024-09-12T17:37:01.577 INFO:tasks.workunit.client.0.smithi037.stderr: -65> 2024-09-12T17:37:01.479+0000 7f3c43c31800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:37:01.577 INFO:tasks.workunit.client.0.smithi037.stderr: -64> 2024-09-12T17:37:01.479+0000 7f3c43c31800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18, ofs0, ns] 2024-09-12T17:37:01.577 INFO:tasks.workunit.client.0.smithi037.stderr: -63> 2024-09-12T17:37:01.479+0000 7f3b21ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497017 cookie 94110392943808 notifier 7616 bl.length()=911 2024-09-12T17:37:01.577 INFO:tasks.workunit.client.0.smithi037.stderr: -62> 2024-09-12T17:37:01.479+0000 7f3b21ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 info.flags=0x17 2024-09-12T17:37:01.577 INFO:tasks.workunit.client.0.smithi037.stderr: -61> 2024-09-12T17:37:01.479+0000 7f3b21ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 to cache LRU end 2024-09-12T17:37:01.577 INFO:tasks.workunit.client.0.smithi037.stderr: -60> 2024-09-12T17:37:01.479+0000 7f3b21ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:37:01.577 INFO:tasks.workunit.client.0.smithi037.stderr: -59> 2024-09-12T17:37:01.481+0000 7f3c43c31800 20 handle_bi_update(): bucket=:a-bucket[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18]): orig_sources= new_sources= 2024-09-12T17:37:01.577 INFO:tasks.workunit.client.0.smithi037.stderr: -58> 2024-09-12T17:37:01.481+0000 7f3c43c31800 20 handle_bi_update(): bucket=:a-bucket[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18]): potential sources added=[] removed=[] 2024-09-12T17:37:01.578 INFO:tasks.workunit.client.0.smithi037.stderr: -57> 2024-09-12T17:37:01.481+0000 7f3c43c31800 20 handle_bi_update(): bucket=:a-bucket[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18]): orig_dests= new_dests= 2024-09-12T17:37:01.578 INFO:tasks.workunit.client.0.smithi037.stderr: -56> 2024-09-12T17:37:01.481+0000 7f3c43c31800 20 handle_bi_update(): bucket=:a-bucket[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18]): potential dests added=[] removed=[] 2024-09-12T17:37:01.578 INFO:tasks.workunit.client.0.smithi037.stderr: -55> 2024-09-12T17:37:01.486+0000 7f3c43c31800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.3.0 2024-09-12T17:37:01.578 INFO:tasks.workunit.client.0.smithi037.stderr: -54> 2024-09-12T17:37:01.486+0000 7f3c43c31800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.3.0 2024-09-12T17:37:01.578 INFO:tasks.workunit.client.0.smithi037.stderr: -53> 2024-09-12T17:37:01.486+0000 7f3c43c31800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.3.1 2024-09-12T17:37:01.578 INFO:tasks.workunit.client.0.smithi037.stderr: -52> 2024-09-12T17:37:01.486+0000 7f3c43c31800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.3.1 2024-09-12T17:37:01.578 INFO:tasks.workunit.client.0.smithi037.stderr: -51> 2024-09-12T17:37:01.486+0000 7f3c43c31800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.3.2 2024-09-12T17:37:01.578 INFO:tasks.workunit.client.0.smithi037.stderr: -50> 2024-09-12T17:37:01.486+0000 7f3c43c31800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.3.2 2024-09-12T17:37:01.579 INFO:tasks.workunit.client.0.smithi037.stderr: -49> 2024-09-12T17:37:01.486+0000 7f3c43c31800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.3.3 2024-09-12T17:37:01.579 INFO:tasks.workunit.client.0.smithi037.stderr: -48> 2024-09-12T17:37:01.486+0000 7f3c43c31800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.3.3 2024-09-12T17:37:01.579 INFO:tasks.workunit.client.0.smithi037.stderr: -47> 2024-09-12T17:37:01.486+0000 7f3c43c31800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.3.4 2024-09-12T17:37:01.579 INFO:tasks.workunit.client.0.smithi037.stderr: -46> 2024-09-12T17:37:01.486+0000 7f3c43c31800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.3.4 2024-09-12T17:37:01.579 INFO:tasks.workunit.client.0.smithi037.stderr: -45> 2024-09-12T17:37:01.486+0000 7f3c43c31800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.3.5 2024-09-12T17:37:01.579 INFO:tasks.workunit.client.0.smithi037.stderr: -44> 2024-09-12T17:37:01.486+0000 7f3c43c31800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.3.5 2024-09-12T17:37:01.579 INFO:tasks.workunit.client.0.smithi037.stderr: -43> 2024-09-12T17:37:01.486+0000 7f3c43c31800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.3.6 2024-09-12T17:37:01.579 INFO:tasks.workunit.client.0.smithi037.stderr: -42> 2024-09-12T17:37:01.486+0000 7f3c43c31800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.3.6 2024-09-12T17:37:01.579 INFO:tasks.workunit.client.0.smithi037.stderr: -41> 2024-09-12T17:37:01.486+0000 7f3c43c31800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.3.7 2024-09-12T17:37:01.579 INFO:tasks.workunit.client.0.smithi037.stderr: -40> 2024-09-12T17:37:01.486+0000 7f3c43c31800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.3.7 2024-09-12T17:37:01.579 INFO:tasks.workunit.client.0.smithi037.stderr: -39> 2024-09-12T17:37:01.486+0000 7f3c43c31800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.3.8 2024-09-12T17:37:01.579 INFO:tasks.workunit.client.0.smithi037.stderr: -38> 2024-09-12T17:37:01.486+0000 7f3c43c31800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.3.8 2024-09-12T17:37:01.579 INFO:tasks.workunit.client.0.smithi037.stderr: -37> 2024-09-12T17:37:01.486+0000 7f3c43c31800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.3.9 2024-09-12T17:37:01.580 INFO:tasks.workunit.client.0.smithi037.stderr: -36> 2024-09-12T17:37:01.486+0000 7f3c43c31800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.3.9 2024-09-12T17:37:01.580 INFO:tasks.workunit.client.0.smithi037.stderr: -35> 2024-09-12T17:37:01.486+0000 7f3c43c31800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.3.10 2024-09-12T17:37:01.580 INFO:tasks.workunit.client.0.smithi037.stderr: -34> 2024-09-12T17:37:01.486+0000 7f3c43c31800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.3.10 2024-09-12T17:37:01.580 INFO:tasks.workunit.client.0.smithi037.stderr: -33> 2024-09-12T17:37:01.486+0000 7f3c43c31800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.3.11 2024-09-12T17:37:01.580 INFO:tasks.workunit.client.0.smithi037.stderr: -32> 2024-09-12T17:37:01.486+0000 7f3c43c31800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.3.11 2024-09-12T17:37:01.580 INFO:tasks.workunit.client.0.smithi037.stderr: -31> 2024-09-12T17:37:01.486+0000 7f3c43c31800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.3.12 2024-09-12T17:37:01.580 INFO:tasks.workunit.client.0.smithi037.stderr: -30> 2024-09-12T17:37:01.486+0000 7f3c43c31800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.3.12 2024-09-12T17:37:01.580 INFO:tasks.workunit.client.0.smithi037.stderr: -29> 2024-09-12T17:37:01.486+0000 7f3c43c31800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.3.13 2024-09-12T17:37:01.580 INFO:tasks.workunit.client.0.smithi037.stderr: -28> 2024-09-12T17:37:01.486+0000 7f3c43c31800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.3.13 2024-09-12T17:37:01.580 INFO:tasks.workunit.client.0.smithi037.stderr: -27> 2024-09-12T17:37:01.486+0000 7f3c43c31800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.0 2024-09-12T17:37:01.580 INFO:tasks.workunit.client.0.smithi037.stderr: -26> 2024-09-12T17:37:01.486+0000 7f3c43c31800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.0 2024-09-12T17:37:01.580 INFO:tasks.workunit.client.0.smithi037.stderr: -25> 2024-09-12T17:37:01.487+0000 7f3c43c31800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.1 2024-09-12T17:37:01.581 INFO:tasks.workunit.client.0.smithi037.stderr: -24> 2024-09-12T17:37:01.487+0000 7f3c43c31800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.1 2024-09-12T17:37:01.581 INFO:tasks.workunit.client.0.smithi037.stderr: -23> 2024-09-12T17:37:01.487+0000 7f3c43c31800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.2 2024-09-12T17:37:01.581 INFO:tasks.workunit.client.0.smithi037.stderr: -22> 2024-09-12T17:37:01.487+0000 7f3c43c31800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.2 2024-09-12T17:37:01.581 INFO:tasks.workunit.client.0.smithi037.stderr: -21> 2024-09-12T17:37:01.488+0000 7f3c43c31800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.3 2024-09-12T17:37:01.581 INFO:tasks.workunit.client.0.smithi037.stderr: -20> 2024-09-12T17:37:01.488+0000 7f3c43c31800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.3 2024-09-12T17:37:01.582 INFO:tasks.workunit.client.0.smithi037.stderr: -19> 2024-09-12T17:37:01.489+0000 7f3c43c31800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.4 2024-09-12T17:37:01.582 INFO:tasks.workunit.client.0.smithi037.stderr: -18> 2024-09-12T17:37:01.489+0000 7f3c43c31800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.4 2024-09-12T17:37:01.582 INFO:tasks.workunit.client.0.smithi037.stderr: -17> 2024-09-12T17:37:01.489+0000 7f3c43c31800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.5 2024-09-12T17:37:01.582 INFO:tasks.workunit.client.0.smithi037.stderr: -16> 2024-09-12T17:37:01.489+0000 7f3c43c31800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.5 2024-09-12T17:37:01.582 INFO:tasks.workunit.client.0.smithi037.stderr: -15> 2024-09-12T17:37:01.490+0000 7f3c43c31800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.6 2024-09-12T17:37:01.582 INFO:tasks.workunit.client.0.smithi037.stderr: -14> 2024-09-12T17:37:01.490+0000 7f3c43c31800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.6 2024-09-12T17:37:01.582 INFO:tasks.workunit.client.0.smithi037.stderr: -13> 2024-09-12T17:37:01.490+0000 7f3c43c31800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.7 2024-09-12T17:37:01.582 INFO:tasks.workunit.client.0.smithi037.stderr: -12> 2024-09-12T17:37:01.490+0000 7f3c43c31800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.7 2024-09-12T17:37:01.582 INFO:tasks.workunit.client.0.smithi037.stderr: -11> 2024-09-12T17:37:01.491+0000 7f3c43c31800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.8 2024-09-12T17:37:01.582 INFO:tasks.workunit.client.0.smithi037.stderr: -10> 2024-09-12T17:37:01.491+0000 7f3c43c31800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.8 2024-09-12T17:37:01.582 INFO:tasks.workunit.client.0.smithi037.stderr: -9> 2024-09-12T17:37:01.491+0000 7f3c43c31800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.9 2024-09-12T17:37:01.582 INFO:tasks.workunit.client.0.smithi037.stderr: -8> 2024-09-12T17:37:01.491+0000 7f3c43c31800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.9 2024-09-12T17:37:01.582 INFO:tasks.workunit.client.0.smithi037.stderr: -7> 2024-09-12T17:37:01.492+0000 7f3c43c31800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.10 2024-09-12T17:37:01.582 INFO:tasks.workunit.client.0.smithi037.stderr: -6> 2024-09-12T17:37:01.492+0000 7f3c43c31800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.10 2024-09-12T17:37:01.583 INFO:tasks.workunit.client.0.smithi037.stderr: -5> 2024-09-12T17:37:01.492+0000 7f3c43c31800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.11 2024-09-12T17:37:01.583 INFO:tasks.workunit.client.0.smithi037.stderr: -4> 2024-09-12T17:37:01.492+0000 7f3c43c31800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.11 2024-09-12T17:37:01.583 INFO:tasks.workunit.client.0.smithi037.stderr: -3> 2024-09-12T17:37:01.493+0000 7f3c43c31800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.12 2024-09-12T17:37:01.583 INFO:tasks.workunit.client.0.smithi037.stderr: -2> 2024-09-12T17:37:01.493+0000 7f3c43c31800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.12 2024-09-12T17:37:01.583 INFO:tasks.workunit.client.0.smithi037.stderr: -1> 2024-09-12T17:37:01.495+0000 7f3c43c31800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f3c43c31800 time 2024-09-12T17:37:01.496805+0000 2024-09-12T17:37:01.583 INFO:tasks.workunit.client.0.smithi037.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:37:01.583 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:37:01.583 INFO:tasks.workunit.client.0.smithi037.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:37:01.583 INFO:tasks.workunit.client.0.smithi037.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f3c4498c71a] 2024-09-12T17:37:01.583 INFO:tasks.workunit.client.0.smithi037.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f3c4498c8d8] 2024-09-12T17:37:01.584 INFO:tasks.workunit.client.0.smithi037.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5597c7860841] 2024-09-12T17:37:01.584 INFO:tasks.workunit.client.0.smithi037.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x5597c786f734] 2024-09-12T17:37:01.584 INFO:tasks.workunit.client.0.smithi037.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x5597c78705d4] 2024-09-12T17:37:01.584 INFO:tasks.workunit.client.0.smithi037.stderr: 6: main() 2024-09-12T17:37:01.584 INFO:tasks.workunit.client.0.smithi037.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f3c43629590] 2024-09-12T17:37:01.584 INFO:tasks.workunit.client.0.smithi037.stderr: 8: __libc_start_main() 2024-09-12T17:37:01.584 INFO:tasks.workunit.client.0.smithi037.stderr: 9: _start() 2024-09-12T17:37:01.584 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:37:01.584 INFO:tasks.workunit.client.0.smithi037.stderr: 0> 2024-09-12T17:37:01.496+0000 7f3c43c31800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:37:01.585 INFO:tasks.workunit.client.0.smithi037.stderr: in thread 7f3c43c31800 thread_name:radosgw-admin 2024-09-12T17:37:01.585 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:37:01.585 INFO:tasks.workunit.client.0.smithi037.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:37:01.585 INFO:tasks.workunit.client.0.smithi037.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f3c4363e6f0] 2024-09-12T17:37:01.585 INFO:tasks.workunit.client.0.smithi037.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f3c4368b99c] 2024-09-12T17:37:01.585 INFO:tasks.workunit.client.0.smithi037.stderr: 3: raise() 2024-09-12T17:37:01.585 INFO:tasks.workunit.client.0.smithi037.stderr: 4: abort() 2024-09-12T17:37:01.585 INFO:tasks.workunit.client.0.smithi037.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f3c4498c774] 2024-09-12T17:37:01.585 INFO:tasks.workunit.client.0.smithi037.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f3c4498c8d8] 2024-09-12T17:37:01.585 INFO:tasks.workunit.client.0.smithi037.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5597c7860841] 2024-09-12T17:37:01.585 INFO:tasks.workunit.client.0.smithi037.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x5597c786f734] 2024-09-12T17:37:01.585 INFO:tasks.workunit.client.0.smithi037.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x5597c78705d4] 2024-09-12T17:37:01.586 INFO:tasks.workunit.client.0.smithi037.stderr: 10: main() 2024-09-12T17:37:01.586 INFO:tasks.workunit.client.0.smithi037.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f3c43629590] 2024-09-12T17:37:01.586 INFO:tasks.workunit.client.0.smithi037.stderr: 12: __libc_start_main() 2024-09-12T17:37:01.586 INFO:tasks.workunit.client.0.smithi037.stderr: 13: _start() 2024-09-12T17:37:01.586 INFO:tasks.workunit.client.0.smithi037.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:37:01.586 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:37:01.586 INFO:tasks.workunit.client.0.smithi037.stderr:--- logging levels --- 2024-09-12T17:37:01.586 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 none 2024-09-12T17:37:01.587 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 lockdep 2024-09-12T17:37:01.587 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 context 2024-09-12T17:37:01.587 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 1 crush 2024-09-12T17:37:01.587 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mds 2024-09-12T17:37:01.587 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mds_balancer 2024-09-12T17:37:01.587 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mds_locker 2024-09-12T17:37:01.587 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mds_log 2024-09-12T17:37:01.587 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mds_log_expire 2024-09-12T17:37:01.587 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mds_migrator 2024-09-12T17:37:01.587 INFO:tasks.workunit.client.0.smithi037.stderr: 3/ 5 mds_quiesce 2024-09-12T17:37:01.588 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 buffer 2024-09-12T17:37:01.588 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 timer 2024-09-12T17:37:01.588 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 filer 2024-09-12T17:37:01.588 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 striper 2024-09-12T17:37:01.588 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 objecter 2024-09-12T17:37:01.588 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 rados 2024-09-12T17:37:01.588 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 rbd 2024-09-12T17:37:01.588 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 rbd_mirror 2024-09-12T17:37:01.588 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 rbd_replay 2024-09-12T17:37:01.589 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 rbd_pwl 2024-09-12T17:37:01.589 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 journaler 2024-09-12T17:37:01.589 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 objectcacher 2024-09-12T17:37:01.589 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:37:01.589 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 client 2024-09-12T17:37:01.589 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 osd 2024-09-12T17:37:01.589 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 optracker 2024-09-12T17:37:01.589 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 objclass 2024-09-12T17:37:01.589 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 3 filestore 2024-09-12T17:37:01.590 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 3 journal 2024-09-12T17:37:01.590 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 0 ms 2024-09-12T17:37:01.590 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mon 2024-09-12T17:37:01.590 INFO:tasks.workunit.client.0.smithi037.stderr: 0/10 monc 2024-09-12T17:37:01.590 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 paxos 2024-09-12T17:37:01.590 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 tp 2024-09-12T17:37:01.590 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 auth 2024-09-12T17:37:01.590 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 crypto 2024-09-12T17:37:01.590 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 1 finisher 2024-09-12T17:37:01.591 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 1 reserver 2024-09-12T17:37:01.591 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 heartbeatmap 2024-09-12T17:37:01.591 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 perfcounter 2024-09-12T17:37:01.591 INFO:tasks.workunit.client.0.smithi037.stderr: 20/20 rgw 2024-09-12T17:37:01.591 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 rgw_sync 2024-09-12T17:37:01.591 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 rgw_datacache 2024-09-12T17:37:01.591 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 rgw_access 2024-09-12T17:37:01.592 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:37:01.592 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 rgw_flight 2024-09-12T17:37:01.592 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:37:01.592 INFO:tasks.workunit.client.0.smithi037.stderr: 20/20 rgw_notification 2024-09-12T17:37:01.592 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 javaclient 2024-09-12T17:37:01.592 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 asok 2024-09-12T17:37:01.592 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 1 throttle 2024-09-12T17:37:01.592 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 0 refs 2024-09-12T17:37:01.592 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 compressor 2024-09-12T17:37:01.592 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 bluestore 2024-09-12T17:37:01.592 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 bluefs 2024-09-12T17:37:01.593 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 3 bdev 2024-09-12T17:37:01.593 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 kstore 2024-09-12T17:37:01.593 INFO:tasks.workunit.client.0.smithi037.stderr: 4/ 5 rocksdb 2024-09-12T17:37:01.593 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 fuse 2024-09-12T17:37:01.593 INFO:tasks.workunit.client.0.smithi037.stderr: 2/ 5 mgr 2024-09-12T17:37:01.593 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mgrc 2024-09-12T17:37:01.593 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 dpdk 2024-09-12T17:37:01.593 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 eventtrace 2024-09-12T17:37:01.593 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 prioritycache 2024-09-12T17:37:01.593 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 test 2024-09-12T17:37:01.593 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:37:01.593 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 cephsqlite 2024-09-12T17:37:01.593 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:37:01.593 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore 2024-09-12T17:37:01.594 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_onode 2024-09-12T17:37:01.594 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_odata 2024-09-12T17:37:01.594 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_omap 2024-09-12T17:37:01.594 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_tm 2024-09-12T17:37:01.594 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_t 2024-09-12T17:37:01.594 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:37:01.594 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_epm 2024-09-12T17:37:01.594 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_lba 2024-09-12T17:37:01.594 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:37:01.594 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_cache 2024-09-12T17:37:01.594 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_journal 2024-09-12T17:37:01.594 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_device 2024-09-12T17:37:01.594 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_backref 2024-09-12T17:37:01.594 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 alienstore 2024-09-12T17:37:01.594 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mclock 2024-09-12T17:37:01.595 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 cyanstore 2024-09-12T17:37:01.595 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 ceph_exporter 2024-09-12T17:37:01.595 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 memstore 2024-09-12T17:37:01.595 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 trace 2024-09-12T17:37:01.595 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 ceph_dedup 2024-09-12T17:37:01.595 INFO:tasks.workunit.client.0.smithi037.stderr: -2/-2 (syslog threshold) 2024-09-12T17:37:01.595 INFO:tasks.workunit.client.0.smithi037.stderr: 99/99 (stderr threshold) 2024-09-12T17:37:01.595 INFO:tasks.workunit.client.0.smithi037.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:37:01.595 INFO:tasks.workunit.client.0.smithi037.stderr: 7f3a6dffb640 / http_manager 2024-09-12T17:37:01.595 INFO:tasks.workunit.client.0.smithi037.stderr: 7f3a6ffff640 / http_manager 2024-09-12T17:37:01.595 INFO:tasks.workunit.client.0.smithi037.stderr: 7f3af57e2640 / rgw_dt_lg_renew 2024-09-12T17:37:01.595 INFO:tasks.workunit.client.0.smithi037.stderr: 7f3b20ff9640 / ms_dispatch 2024-09-12T17:37:01.596 INFO:tasks.workunit.client.0.smithi037.stderr: 7f3b21ffb640 / io_context_pool 2024-09-12T17:37:01.596 INFO:tasks.workunit.client.0.smithi037.stderr: 7f3b227fc640 / io_context_pool 2024-09-12T17:37:01.596 INFO:tasks.workunit.client.0.smithi037.stderr: 7f3b28e01640 / ms_dispatch 2024-09-12T17:37:01.596 INFO:tasks.workunit.client.0.smithi037.stderr: 7f3b2b606640 / ms_dispatch 2024-09-12T17:37:01.596 INFO:tasks.workunit.client.0.smithi037.stderr: 7f3b2ce09640 / io_context_pool 2024-09-12T17:37:01.596 INFO:tasks.workunit.client.0.smithi037.stderr: 7f3c3e78a640 / msgr-worker-2 2024-09-12T17:37:01.596 INFO:tasks.workunit.client.0.smithi037.stderr: 7f3c3ef8b640 / msgr-worker-1 2024-09-12T17:37:01.596 INFO:tasks.workunit.client.0.smithi037.stderr: 7f3c3f78c640 / msgr-worker-0 2024-09-12T17:37:01.596 INFO:tasks.workunit.client.0.smithi037.stderr: 7f3c3ff8d640 / io_context_pool 2024-09-12T17:37:01.596 INFO:tasks.workunit.client.0.smithi037.stderr: 7f3c43c31800 / radosgw-admin 2024-09-12T17:37:01.596 INFO:tasks.workunit.client.0.smithi037.stderr: max_recent 500 2024-09-12T17:37:01.596 INFO:tasks.workunit.client.0.smithi037.stderr: max_new 1000 2024-09-12T17:37:01.596 INFO:tasks.workunit.client.0.smithi037.stderr: log_file /var/log/ceph/ceph-client.admin.146736.log 2024-09-12T17:37:01.597 INFO:tasks.workunit.client.0.smithi037.stderr:--- end dump of recent events --- 2024-09-12T17:37:01.597 INFO:tasks.workunit.client.0.smithi037.stderr:--- begin dump of recent events --- 2024-09-12T17:37:01.597 INFO:tasks.workunit.client.0.smithi037.stderr: -499> 2024-09-12T17:37:01.223+0000 7f3c3ef8b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:37:01.597 INFO:tasks.workunit.client.0.smithi037.stderr: -498> 2024-09-12T17:37:01.223+0000 7f3c3f78c640 10 monclient(hunting): get_auth_request con 0x5597c86f3380 auth_method 0 2024-09-12T17:37:01.597 INFO:tasks.workunit.client.0.smithi037.stderr: -497> 2024-09-12T17:37:01.223+0000 7f3c3f78c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:37:01.597 INFO:tasks.workunit.client.0.smithi037.stderr: -496> 2024-09-12T17:37:01.223+0000 7f3c3f78c640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:37:01.597 INFO:tasks.workunit.client.0.smithi037.stderr: -495> 2024-09-12T17:37:01.223+0000 7f3c3f78c640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:37:01.597 INFO:tasks.workunit.client.0.smithi037.stderr: -494> 2024-09-12T17:37:01.223+0000 7f3c3e78a640 10 monclient(hunting): get_auth_request con 0x5597c86efe20 auth_method 0 2024-09-12T17:37:01.597 INFO:tasks.workunit.client.0.smithi037.stderr: -493> 2024-09-12T17:37:01.223+0000 7f3c3e78a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:37:01.597 INFO:tasks.workunit.client.0.smithi037.stderr: -492> 2024-09-12T17:37:01.223+0000 7f3c3e78a640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:37:01.597 INFO:tasks.workunit.client.0.smithi037.stderr: -491> 2024-09-12T17:37:01.223+0000 7f3c3e78a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:37:01.598 INFO:tasks.workunit.client.0.smithi037.stderr: -490> 2024-09-12T17:37:01.223+0000 7f3c3f78c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:37:01.598 INFO:tasks.workunit.client.0.smithi037.stderr: -489> 2024-09-12T17:37:01.223+0000 7f3c3f78c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:37:01.598 INFO:tasks.workunit.client.0.smithi037.stderr: -488> 2024-09-12T17:37:01.223+0000 7f3c3f78c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:37:01.598 INFO:tasks.workunit.client.0.smithi037.stderr: -487> 2024-09-12T17:37:01.223+0000 7f3c3ef8b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:37:01.598 INFO:tasks.workunit.client.0.smithi037.stderr: -486> 2024-09-12T17:37:01.223+0000 7f3c3ef8b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:37:01.598 INFO:tasks.workunit.client.0.smithi037.stderr: -485> 2024-09-12T17:37:01.223+0000 7f3c3ef8b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:37:01.598 INFO:tasks.workunit.client.0.smithi037.stderr: -484> 2024-09-12T17:37:01.224+0000 7f3c3e78a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:37:01.598 INFO:tasks.workunit.client.0.smithi037.stderr: -483> 2024-09-12T17:37:01.224+0000 7f3c3e78a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:37:01.598 INFO:tasks.workunit.client.0.smithi037.stderr: -482> 2024-09-12T17:37:01.224+0000 7f3c3e78a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:37:01.598 INFO:tasks.workunit.client.0.smithi037.stderr: -481> 2024-09-12T17:37:01.224+0000 7f3c3ef8b640 10 monclient(hunting): handle_auth_done global_id 7607 payload 824 2024-09-12T17:37:01.598 INFO:tasks.workunit.client.0.smithi037.stderr: -480> 2024-09-12T17:37:01.224+0000 7f3c3ef8b640 10 monclient: _finish_hunting 0 2024-09-12T17:37:01.598 INFO:tasks.workunit.client.0.smithi037.stderr: -479> 2024-09-12T17:37:01.224+0000 7f3c3ef8b640 1 monclient: found mon.noname-c 2024-09-12T17:37:01.599 INFO:tasks.workunit.client.0.smithi037.stderr: -478> 2024-09-12T17:37:01.224+0000 7f3c3ef8b640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.37:3301/0 2024-09-12T17:37:01.599 INFO:tasks.workunit.client.0.smithi037.stderr: -477> 2024-09-12T17:37:01.224+0000 7f3b2b606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:37:01.599 INFO:tasks.workunit.client.0.smithi037.stderr: -476> 2024-09-12T17:37:01.224+0000 7f3b2b606640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:37:01.599 INFO:tasks.workunit.client.0.smithi037.stderr: -475> 2024-09-12T17:37:01.224+0000 7f3b2b606640 10 monclient: dump: 2024-09-12T17:37:01.599 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:37:01.599 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:37:01.599 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:37:01.599 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:37:01.599 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:37:01.599 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:37:01.599 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:37:01.599 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:37:01.600 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:37:01.600 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:37:01.600 INFO:tasks.workunit.client.0.smithi037.stderr: -474> 2024-09-12T17:37:01.224+0000 7f3b2b606640 10 monclient: _finish_auth 0 2024-09-12T17:37:01.600 INFO:tasks.workunit.client.0.smithi037.stderr: -473> 2024-09-12T17:37:01.224+0000 7f3b2b606640 10 monclient: _check_auth_tickets 2024-09-12T17:37:01.600 INFO:tasks.workunit.client.0.smithi037.stderr: -472> 2024-09-12T17:37:01.224+0000 7f3b2b606640 10 monclient: handle_config config(0 keys) 2024-09-12T17:37:01.600 INFO:tasks.workunit.client.0.smithi037.stderr: -471> 2024-09-12T17:37:01.224+0000 7f3b2b606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:37:01.600 INFO:tasks.workunit.client.0.smithi037.stderr: -470> 2024-09-12T17:37:01.224+0000 7f3b2b606640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:37:01.600 INFO:tasks.workunit.client.0.smithi037.stderr: -469> 2024-09-12T17:37:01.224+0000 7f3b2b606640 10 monclient: dump: 2024-09-12T17:37:01.601 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:37:01.601 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:37:01.601 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:37:01.601 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:37:01.601 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:37:01.601 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:37:01.601 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:37:01.601 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:37:01.601 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:37:01.601 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:37:01.601 INFO:tasks.workunit.client.0.smithi037.stderr: -468> 2024-09-12T17:37:01.224+0000 7f3c43c31800 5 monclient: authenticate success, global_id 7607 2024-09-12T17:37:01.601 INFO:tasks.workunit.client.0.smithi037.stderr: -467> 2024-09-12T17:37:01.224+0000 7f3c43c31800 10 monclient: _renew_subs 2024-09-12T17:37:01.601 INFO:tasks.workunit.client.0.smithi037.stderr: -466> 2024-09-12T17:37:01.224+0000 7f3c43c31800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.37:3301/0 2024-09-12T17:37:01.601 INFO:tasks.workunit.client.0.smithi037.stderr: -465> 2024-09-12T17:37:01.224+0000 7f3b2ce09640 4 set_mon_vals no callback set 2024-09-12T17:37:01.602 INFO:tasks.workunit.client.0.smithi037.stderr: -464> 2024-09-12T17:37:01.224+0000 7f3c43c31800 10 monclient: _renew_subs 2024-09-12T17:37:01.602 INFO:tasks.workunit.client.0.smithi037.stderr: -463> 2024-09-12T17:37:01.224+0000 7f3c43c31800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.37:3301/0 2024-09-12T17:37:01.602 INFO:tasks.workunit.client.0.smithi037.stderr: -462> 2024-09-12T17:37:01.224+0000 7f3c43c31800 1 librados: init done 2024-09-12T17:37:01.602 INFO:tasks.workunit.client.0.smithi037.stderr: -461> 2024-09-12T17:37:01.226+0000 7f3b2b606640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:37:01.602 INFO:tasks.workunit.client.0.smithi037.stderr: -460> 2024-09-12T17:37:01.226+0000 7f3b2b606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.40:6816/3916250676,v1:172.21.15.40:6817/3916250676] 2024-09-12T17:37:01.602 INFO:tasks.workunit.client.0.smithi037.stderr: -459> 2024-09-12T17:37:01.226+0000 7f3b2b606640 4 mgrc reconnect Starting new session with [v2:172.21.15.40:6816/3916250676,v1:172.21.15.40:6817/3916250676] 2024-09-12T17:37:01.602 INFO:tasks.workunit.client.0.smithi037.stderr: -458> 2024-09-12T17:37:01.226+0000 7f3c3e78a640 10 monclient: get_auth_request con 0x7f3b24076470 auth_method 0 2024-09-12T17:37:01.602 INFO:tasks.workunit.client.0.smithi037.stderr: -457> 2024-09-12T17:37:01.226+0000 7f3c3f78c640 10 monclient: get_auth_request con 0x5597c87f1d50 auth_method 0 2024-09-12T17:37:01.602 INFO:tasks.workunit.client.0.smithi037.stderr: -456> 2024-09-12T17:37:01.227+0000 7f3c3ef8b640 10 monclient: get_auth_request con 0x5597c87f4f30 auth_method 0 2024-09-12T17:37:01.602 INFO:tasks.workunit.client.0.smithi037.stderr: -455> 2024-09-12T17:37:01.229+0000 7f3c3e78a640 10 monclient: get_auth_request con 0x5597c87f9fc0 auth_method 0 2024-09-12T17:37:01.602 INFO:tasks.workunit.client.0.smithi037.stderr: -454> 2024-09-12T17:37:01.229+0000 7f3c43c31800 10 monclient: build_initial_monmap 2024-09-12T17:37:01.602 INFO:tasks.workunit.client.0.smithi037.stderr: -453> 2024-09-12T17:37:01.229+0000 7f3c43c31800 1 build_initial for_mkfs: 0 2024-09-12T17:37:01.602 INFO:tasks.workunit.client.0.smithi037.stderr: -452> 2024-09-12T17:37:01.229+0000 7f3c43c31800 10 monclient: monmap: 2024-09-12T17:37:01.603 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 0 2024-09-12T17:37:01.603 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:37:01.603 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 0.000000 2024-09-12T17:37:01.603 INFO:tasks.workunit.client.0.smithi037.stderr:created 0.000000 2024-09-12T17:37:01.603 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 0 (unknown) 2024-09-12T17:37:01.603 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:37:01.603 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.noname-a 2024-09-12T17:37:01.603 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.noname-b 2024-09-12T17:37:01.603 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.noname-c 2024-09-12T17:37:01.603 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:37:01.603 INFO:tasks.workunit.client.0.smithi037.stderr: -451> 2024-09-12T17:37:01.229+0000 7f3c43c31800 5 AuthRegistry(0x5597c87fde70) adding auth protocol: cephx 2024-09-12T17:37:01.603 INFO:tasks.workunit.client.0.smithi037.stderr: -450> 2024-09-12T17:37:01.229+0000 7f3c43c31800 5 AuthRegistry(0x5597c87fde70) adding auth protocol: cephx 2024-09-12T17:37:01.603 INFO:tasks.workunit.client.0.smithi037.stderr: -449> 2024-09-12T17:37:01.229+0000 7f3c43c31800 5 AuthRegistry(0x5597c87fde70) adding auth protocol: cephx 2024-09-12T17:37:01.603 INFO:tasks.workunit.client.0.smithi037.stderr: -448> 2024-09-12T17:37:01.229+0000 7f3c43c31800 5 AuthRegistry(0x5597c87fde70) adding con mode: secure 2024-09-12T17:37:01.604 INFO:tasks.workunit.client.0.smithi037.stderr: -447> 2024-09-12T17:37:01.229+0000 7f3c43c31800 5 AuthRegistry(0x5597c87fde70) adding con mode: crc 2024-09-12T17:37:01.604 INFO:tasks.workunit.client.0.smithi037.stderr: -446> 2024-09-12T17:37:01.229+0000 7f3c43c31800 5 AuthRegistry(0x5597c87fde70) adding con mode: secure 2024-09-12T17:37:01.604 INFO:tasks.workunit.client.0.smithi037.stderr: -445> 2024-09-12T17:37:01.229+0000 7f3c43c31800 5 AuthRegistry(0x5597c87fde70) adding con mode: crc 2024-09-12T17:37:01.604 INFO:tasks.workunit.client.0.smithi037.stderr: -444> 2024-09-12T17:37:01.229+0000 7f3c43c31800 5 AuthRegistry(0x5597c87fde70) adding con mode: secure 2024-09-12T17:37:01.604 INFO:tasks.workunit.client.0.smithi037.stderr: -443> 2024-09-12T17:37:01.229+0000 7f3c43c31800 5 AuthRegistry(0x5597c87fde70) adding con mode: crc 2024-09-12T17:37:01.604 INFO:tasks.workunit.client.0.smithi037.stderr: -442> 2024-09-12T17:37:01.229+0000 7f3c43c31800 5 AuthRegistry(0x5597c87fde70) adding con mode: crc 2024-09-12T17:37:01.604 INFO:tasks.workunit.client.0.smithi037.stderr: -441> 2024-09-12T17:37:01.229+0000 7f3c43c31800 5 AuthRegistry(0x5597c87fde70) adding con mode: secure 2024-09-12T17:37:01.604 INFO:tasks.workunit.client.0.smithi037.stderr: -440> 2024-09-12T17:37:01.229+0000 7f3c43c31800 5 AuthRegistry(0x5597c87fde70) adding con mode: crc 2024-09-12T17:37:01.604 INFO:tasks.workunit.client.0.smithi037.stderr: -439> 2024-09-12T17:37:01.229+0000 7f3c43c31800 5 AuthRegistry(0x5597c87fde70) adding con mode: secure 2024-09-12T17:37:01.604 INFO:tasks.workunit.client.0.smithi037.stderr: -438> 2024-09-12T17:37:01.229+0000 7f3c43c31800 5 AuthRegistry(0x5597c87fde70) adding con mode: crc 2024-09-12T17:37:01.604 INFO:tasks.workunit.client.0.smithi037.stderr: -437> 2024-09-12T17:37:01.229+0000 7f3c43c31800 5 AuthRegistry(0x5597c87fde70) adding con mode: secure 2024-09-12T17:37:01.605 INFO:tasks.workunit.client.0.smithi037.stderr: -436> 2024-09-12T17:37:01.230+0000 7f3c43c31800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:37:01.605 INFO:tasks.workunit.client.0.smithi037.stderr: -435> 2024-09-12T17:37:01.230+0000 7f3c43c31800 5 asok(0x5597c8588730) register_command objecter_requests cmddesc objecter_requests hook 0x5597c8801360 EEXIST 2024-09-12T17:37:01.605 INFO:tasks.workunit.client.0.smithi037.stderr: -434> 2024-09-12T17:37:01.230+0000 7f3c43c31800 10 monclient: init 2024-09-12T17:37:01.605 INFO:tasks.workunit.client.0.smithi037.stderr: -433> 2024-09-12T17:37:01.230+0000 7f3c43c31800 5 AuthRegistry(0x5597c87fce28) adding auth protocol: cephx 2024-09-12T17:37:01.605 INFO:tasks.workunit.client.0.smithi037.stderr: -432> 2024-09-12T17:37:01.230+0000 7f3c43c31800 5 AuthRegistry(0x5597c87fce28) adding auth protocol: cephx 2024-09-12T17:37:01.605 INFO:tasks.workunit.client.0.smithi037.stderr: -431> 2024-09-12T17:37:01.230+0000 7f3c43c31800 5 AuthRegistry(0x5597c87fce28) adding auth protocol: cephx 2024-09-12T17:37:01.605 INFO:tasks.workunit.client.0.smithi037.stderr: -430> 2024-09-12T17:37:01.230+0000 7f3c43c31800 5 AuthRegistry(0x5597c87fce28) adding con mode: secure 2024-09-12T17:37:01.605 INFO:tasks.workunit.client.0.smithi037.stderr: -429> 2024-09-12T17:37:01.230+0000 7f3c43c31800 5 AuthRegistry(0x5597c87fce28) adding con mode: crc 2024-09-12T17:37:01.605 INFO:tasks.workunit.client.0.smithi037.stderr: -428> 2024-09-12T17:37:01.230+0000 7f3c43c31800 5 AuthRegistry(0x5597c87fce28) adding con mode: secure 2024-09-12T17:37:01.605 INFO:tasks.workunit.client.0.smithi037.stderr: -427> 2024-09-12T17:37:01.230+0000 7f3c43c31800 5 AuthRegistry(0x5597c87fce28) adding con mode: crc 2024-09-12T17:37:01.605 INFO:tasks.workunit.client.0.smithi037.stderr: -426> 2024-09-12T17:37:01.230+0000 7f3c43c31800 5 AuthRegistry(0x5597c87fce28) adding con mode: secure 2024-09-12T17:37:01.605 INFO:tasks.workunit.client.0.smithi037.stderr: -425> 2024-09-12T17:37:01.230+0000 7f3c43c31800 5 AuthRegistry(0x5597c87fce28) adding con mode: crc 2024-09-12T17:37:01.605 INFO:tasks.workunit.client.0.smithi037.stderr: -424> 2024-09-12T17:37:01.230+0000 7f3c43c31800 5 AuthRegistry(0x5597c87fce28) adding con mode: crc 2024-09-12T17:37:01.606 INFO:tasks.workunit.client.0.smithi037.stderr: -423> 2024-09-12T17:37:01.230+0000 7f3c43c31800 5 AuthRegistry(0x5597c87fce28) adding con mode: secure 2024-09-12T17:37:01.606 INFO:tasks.workunit.client.0.smithi037.stderr: -422> 2024-09-12T17:37:01.230+0000 7f3c43c31800 5 AuthRegistry(0x5597c87fce28) adding con mode: crc 2024-09-12T17:37:01.606 INFO:tasks.workunit.client.0.smithi037.stderr: -421> 2024-09-12T17:37:01.230+0000 7f3c43c31800 5 AuthRegistry(0x5597c87fce28) adding con mode: secure 2024-09-12T17:37:01.606 INFO:tasks.workunit.client.0.smithi037.stderr: -420> 2024-09-12T17:37:01.230+0000 7f3c43c31800 5 AuthRegistry(0x5597c87fce28) adding con mode: crc 2024-09-12T17:37:01.606 INFO:tasks.workunit.client.0.smithi037.stderr: -419> 2024-09-12T17:37:01.230+0000 7f3c43c31800 5 AuthRegistry(0x5597c87fce28) adding con mode: secure 2024-09-12T17:37:01.606 INFO:tasks.workunit.client.0.smithi037.stderr: -418> 2024-09-12T17:37:01.230+0000 7f3c43c31800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:37:01.606 INFO:tasks.workunit.client.0.smithi037.stderr: -417> 2024-09-12T17:37:01.230+0000 7f3c43c31800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:37:01.606 INFO:tasks.workunit.client.0.smithi037.stderr: -416> 2024-09-12T17:37:01.230+0000 7f3c43c31800 5 asok(0x5597c8588730) register_command rotate-key cmddesc rotate-key hook 0x5597c87fcf70 EEXIST 2024-09-12T17:37:01.606 INFO:tasks.workunit.client.0.smithi037.stderr: -415> 2024-09-12T17:37:01.230+0000 7f3c43c31800 10 monclient: _reopen_session rank -1 2024-09-12T17:37:01.606 INFO:tasks.workunit.client.0.smithi037.stderr: -414> 2024-09-12T17:37:01.230+0000 7f3c43c31800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T17:37:01.606 INFO:tasks.workunit.client.0.smithi037.stderr: -413> 2024-09-12T17:37:01.230+0000 7f3c43c31800 10 monclient(hunting): picked mon.noname-b con 0x5597c8825680 addr [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] 2024-09-12T17:37:01.606 INFO:tasks.workunit.client.0.smithi037.stderr: -412> 2024-09-12T17:37:01.230+0000 7f3c43c31800 10 monclient(hunting): picked mon.noname-c con 0x5597c8825a60 addr [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] 2024-09-12T17:37:01.607 INFO:tasks.workunit.client.0.smithi037.stderr: -411> 2024-09-12T17:37:01.230+0000 7f3c43c31800 10 monclient(hunting): picked mon.noname-a con 0x5597c8824390 addr [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] 2024-09-12T17:37:01.607 INFO:tasks.workunit.client.0.smithi037.stderr: -410> 2024-09-12T17:37:01.230+0000 7f3c43c31800 10 monclient(hunting): start opening mon connection 2024-09-12T17:37:01.607 INFO:tasks.workunit.client.0.smithi037.stderr: -409> 2024-09-12T17:37:01.230+0000 7f3c43c31800 10 monclient(hunting): start opening mon connection 2024-09-12T17:37:01.607 INFO:tasks.workunit.client.0.smithi037.stderr: -408> 2024-09-12T17:37:01.230+0000 7f3c43c31800 10 monclient(hunting): start opening mon connection 2024-09-12T17:37:01.607 INFO:tasks.workunit.client.0.smithi037.stderr: -407> 2024-09-12T17:37:01.230+0000 7f3c43c31800 10 monclient(hunting): _renew_subs 2024-09-12T17:37:01.607 INFO:tasks.workunit.client.0.smithi037.stderr: -406> 2024-09-12T17:37:01.230+0000 7f3c43c31800 10 monclient(hunting): authenticate will time out at 2408.828849s 2024-09-12T17:37:01.607 INFO:tasks.workunit.client.0.smithi037.stderr: -405> 2024-09-12T17:37:01.230+0000 7f3c3f78c640 10 monclient(hunting): get_auth_request con 0x5597c8824390 auth_method 0 2024-09-12T17:37:01.607 INFO:tasks.workunit.client.0.smithi037.stderr: -404> 2024-09-12T17:37:01.230+0000 7f3c3f78c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:37:01.607 INFO:tasks.workunit.client.0.smithi037.stderr: -403> 2024-09-12T17:37:01.230+0000 7f3c3f78c640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:37:01.607 INFO:tasks.workunit.client.0.smithi037.stderr: -402> 2024-09-12T17:37:01.230+0000 7f3c3f78c640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:37:01.607 INFO:tasks.workunit.client.0.smithi037.stderr: -401> 2024-09-12T17:37:01.231+0000 7f3c3e78a640 10 monclient(hunting): get_auth_request con 0x5597c8825a60 auth_method 0 2024-09-12T17:37:01.607 INFO:tasks.workunit.client.0.smithi037.stderr: -400> 2024-09-12T17:37:01.231+0000 7f3c3e78a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:37:01.608 INFO:tasks.workunit.client.0.smithi037.stderr: -399> 2024-09-12T17:37:01.231+0000 7f3c3e78a640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:37:01.608 INFO:tasks.workunit.client.0.smithi037.stderr: -398> 2024-09-12T17:37:01.231+0000 7f3c3e78a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:37:01.608 INFO:tasks.workunit.client.0.smithi037.stderr: -397> 2024-09-12T17:37:01.231+0000 7f3c3ef8b640 10 monclient(hunting): get_auth_request con 0x5597c8825680 auth_method 0 2024-09-12T17:37:01.608 INFO:tasks.workunit.client.0.smithi037.stderr: -396> 2024-09-12T17:37:01.231+0000 7f3c3ef8b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:37:01.608 INFO:tasks.workunit.client.0.smithi037.stderr: -395> 2024-09-12T17:37:01.231+0000 7f3c3ef8b640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:37:01.608 INFO:tasks.workunit.client.0.smithi037.stderr: -394> 2024-09-12T17:37:01.231+0000 7f3c3ef8b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:37:01.608 INFO:tasks.workunit.client.0.smithi037.stderr: -393> 2024-09-12T17:37:01.231+0000 7f3c3f78c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:37:01.608 INFO:tasks.workunit.client.0.smithi037.stderr: -392> 2024-09-12T17:37:01.231+0000 7f3c3f78c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:37:01.608 INFO:tasks.workunit.client.0.smithi037.stderr: -391> 2024-09-12T17:37:01.231+0000 7f3c3f78c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:37:01.608 INFO:tasks.workunit.client.0.smithi037.stderr: -390> 2024-09-12T17:37:01.231+0000 7f3c3e78a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:37:01.608 INFO:tasks.workunit.client.0.smithi037.stderr: -389> 2024-09-12T17:37:01.231+0000 7f3c3e78a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:37:01.608 INFO:tasks.workunit.client.0.smithi037.stderr: -388> 2024-09-12T17:37:01.231+0000 7f3c3e78a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:37:01.608 INFO:tasks.workunit.client.0.smithi037.stderr: -387> 2024-09-12T17:37:01.231+0000 7f3c3ef8b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:37:01.608 INFO:tasks.workunit.client.0.smithi037.stderr: -386> 2024-09-12T17:37:01.231+0000 7f3c3ef8b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:37:01.609 INFO:tasks.workunit.client.0.smithi037.stderr: -385> 2024-09-12T17:37:01.231+0000 7f3c3ef8b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:37:01.609 INFO:tasks.workunit.client.0.smithi037.stderr: -384> 2024-09-12T17:37:01.231+0000 7f3c3f78c640 10 monclient(hunting): handle_auth_done global_id 8154 payload 824 2024-09-12T17:37:01.609 INFO:tasks.workunit.client.0.smithi037.stderr: -383> 2024-09-12T17:37:01.231+0000 7f3c3f78c640 10 monclient: _finish_hunting 0 2024-09-12T17:37:01.609 INFO:tasks.workunit.client.0.smithi037.stderr: -382> 2024-09-12T17:37:01.231+0000 7f3c3f78c640 1 monclient: found mon.noname-a 2024-09-12T17:37:01.609 INFO:tasks.workunit.client.0.smithi037.stderr: -381> 2024-09-12T17:37:01.231+0000 7f3c3f78c640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.37:3300/0 2024-09-12T17:37:01.609 INFO:tasks.workunit.client.0.smithi037.stderr: -380> 2024-09-12T17:37:01.231+0000 7f3b28e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:37:01.609 INFO:tasks.workunit.client.0.smithi037.stderr: -379> 2024-09-12T17:37:01.231+0000 7f3b28e01640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:37:01.609 INFO:tasks.workunit.client.0.smithi037.stderr: -378> 2024-09-12T17:37:01.231+0000 7f3b28e01640 10 monclient: dump: 2024-09-12T17:37:01.609 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:37:01.609 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:37:01.609 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:37:01.609 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:37:01.609 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:37:01.609 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:37:01.610 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:37:01.610 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:37:01.610 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:37:01.610 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:37:01.610 INFO:tasks.workunit.client.0.smithi037.stderr: -377> 2024-09-12T17:37:01.231+0000 7f3b28e01640 10 monclient: _finish_auth 0 2024-09-12T17:37:01.610 INFO:tasks.workunit.client.0.smithi037.stderr: -376> 2024-09-12T17:37:01.231+0000 7f3b28e01640 10 monclient: _check_auth_tickets 2024-09-12T17:37:01.610 INFO:tasks.workunit.client.0.smithi037.stderr: -375> 2024-09-12T17:37:01.231+0000 7f3c43c31800 5 monclient: authenticate success, global_id 8154 2024-09-12T17:37:01.610 INFO:tasks.workunit.client.0.smithi037.stderr: -374> 2024-09-12T17:37:01.231+0000 7f3c43c31800 10 monclient: _renew_subs 2024-09-12T17:37:01.610 INFO:tasks.workunit.client.0.smithi037.stderr: -373> 2024-09-12T17:37:01.231+0000 7f3c43c31800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.37:3300/0 2024-09-12T17:37:01.610 INFO:tasks.workunit.client.0.smithi037.stderr: -372> 2024-09-12T17:37:01.231+0000 7f3b28e01640 10 monclient: handle_config config(0 keys) 2024-09-12T17:37:01.610 INFO:tasks.workunit.client.0.smithi037.stderr: -371> 2024-09-12T17:37:01.231+0000 7f3b28e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:37:01.610 INFO:tasks.workunit.client.0.smithi037.stderr: -370> 2024-09-12T17:37:01.231+0000 7f3b28e01640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:37:01.611 INFO:tasks.workunit.client.0.smithi037.stderr: -369> 2024-09-12T17:37:01.231+0000 7f3b28e01640 10 monclient: dump: 2024-09-12T17:37:01.611 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:37:01.611 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:37:01.611 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:37:01.611 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:37:01.611 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:37:01.611 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:37:01.611 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:37:01.611 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:37:01.611 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:37:01.611 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:37:01.611 INFO:tasks.workunit.client.0.smithi037.stderr: -368> 2024-09-12T17:37:01.231+0000 7f3c3ff8d640 4 set_mon_vals no callback set 2024-09-12T17:37:01.611 INFO:tasks.workunit.client.0.smithi037.stderr: -367> 2024-09-12T17:37:01.231+0000 7f3c43c31800 10 monclient: _renew_subs 2024-09-12T17:37:01.611 INFO:tasks.workunit.client.0.smithi037.stderr: -366> 2024-09-12T17:37:01.231+0000 7f3c43c31800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.37:3300/0 2024-09-12T17:37:01.612 INFO:tasks.workunit.client.0.smithi037.stderr: -365> 2024-09-12T17:37:01.233+0000 7f3b28e01640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:37:01.612 INFO:tasks.workunit.client.0.smithi037.stderr: -364> 2024-09-12T17:37:01.233+0000 7f3b28e01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.40:6816/3916250676,v1:172.21.15.40:6817/3916250676] 2024-09-12T17:37:01.612 INFO:tasks.workunit.client.0.smithi037.stderr: -363> 2024-09-12T17:37:01.233+0000 7f3b28e01640 4 mgrc reconnect Starting new session with [v2:172.21.15.40:6816/3916250676,v1:172.21.15.40:6817/3916250676] 2024-09-12T17:37:01.612 INFO:tasks.workunit.client.0.smithi037.stderr: -362> 2024-09-12T17:37:01.234+0000 7f3c3ef8b640 10 monclient: get_auth_request con 0x7f3b18076380 auth_method 0 2024-09-12T17:37:01.612 INFO:tasks.workunit.client.0.smithi037.stderr: -361> 2024-09-12T17:37:01.234+0000 7f3c43c31800 10 monclient: get_monmap_and_config 2024-09-12T17:37:01.612 INFO:tasks.workunit.client.0.smithi037.stderr: -360> 2024-09-12T17:37:01.234+0000 7f3c43c31800 10 monclient: build_initial_monmap 2024-09-12T17:37:01.612 INFO:tasks.workunit.client.0.smithi037.stderr: -359> 2024-09-12T17:37:01.234+0000 7f3c43c31800 1 build_initial for_mkfs: 0 2024-09-12T17:37:01.612 INFO:tasks.workunit.client.0.smithi037.stderr: -358> 2024-09-12T17:37:01.234+0000 7f3c43c31800 10 monclient: monmap: 2024-09-12T17:37:01.612 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 0 2024-09-12T17:37:01.612 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:37:01.612 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 0.000000 2024-09-12T17:37:01.612 INFO:tasks.workunit.client.0.smithi037.stderr:created 0.000000 2024-09-12T17:37:01.612 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 0 (unknown) 2024-09-12T17:37:01.612 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:37:01.613 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.noname-a 2024-09-12T17:37:01.613 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.noname-b 2024-09-12T17:37:01.613 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.noname-c 2024-09-12T17:37:01.613 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:37:01.613 INFO:tasks.workunit.client.0.smithi037.stderr: -357> 2024-09-12T17:37:01.234+0000 7f3c43c31800 5 AuthRegistry(0x5597c88453d0) adding auth protocol: cephx 2024-09-12T17:37:01.613 INFO:tasks.workunit.client.0.smithi037.stderr: -356> 2024-09-12T17:37:01.234+0000 7f3c43c31800 5 AuthRegistry(0x5597c88453d0) adding auth protocol: cephx 2024-09-12T17:37:01.613 INFO:tasks.workunit.client.0.smithi037.stderr: -355> 2024-09-12T17:37:01.234+0000 7f3c43c31800 5 AuthRegistry(0x5597c88453d0) adding auth protocol: cephx 2024-09-12T17:37:01.613 INFO:tasks.workunit.client.0.smithi037.stderr: -354> 2024-09-12T17:37:01.234+0000 7f3c43c31800 5 AuthRegistry(0x5597c88453d0) adding con mode: secure 2024-09-12T17:37:01.613 INFO:tasks.workunit.client.0.smithi037.stderr: -353> 2024-09-12T17:37:01.234+0000 7f3c43c31800 5 AuthRegistry(0x5597c88453d0) adding con mode: crc 2024-09-12T17:37:01.613 INFO:tasks.workunit.client.0.smithi037.stderr: -352> 2024-09-12T17:37:01.234+0000 7f3c43c31800 5 AuthRegistry(0x5597c88453d0) adding con mode: secure 2024-09-12T17:37:01.613 INFO:tasks.workunit.client.0.smithi037.stderr: -351> 2024-09-12T17:37:01.234+0000 7f3c43c31800 5 AuthRegistry(0x5597c88453d0) adding con mode: crc 2024-09-12T17:37:01.614 INFO:tasks.workunit.client.0.smithi037.stderr: -350> 2024-09-12T17:37:01.234+0000 7f3c43c31800 5 AuthRegistry(0x5597c88453d0) adding con mode: secure 2024-09-12T17:37:01.614 INFO:tasks.workunit.client.0.smithi037.stderr: -349> 2024-09-12T17:37:01.234+0000 7f3c43c31800 5 AuthRegistry(0x5597c88453d0) adding con mode: crc 2024-09-12T17:37:01.614 INFO:tasks.workunit.client.0.smithi037.stderr: -348> 2024-09-12T17:37:01.234+0000 7f3c43c31800 5 AuthRegistry(0x5597c88453d0) adding con mode: crc 2024-09-12T17:37:01.614 INFO:tasks.workunit.client.0.smithi037.stderr: -347> 2024-09-12T17:37:01.234+0000 7f3c43c31800 5 AuthRegistry(0x5597c88453d0) adding con mode: secure 2024-09-12T17:37:01.614 INFO:tasks.workunit.client.0.smithi037.stderr: -346> 2024-09-12T17:37:01.234+0000 7f3c43c31800 5 AuthRegistry(0x5597c88453d0) adding con mode: crc 2024-09-12T17:37:01.614 INFO:tasks.workunit.client.0.smithi037.stderr: -345> 2024-09-12T17:37:01.234+0000 7f3c43c31800 5 AuthRegistry(0x5597c88453d0) adding con mode: secure 2024-09-12T17:37:01.614 INFO:tasks.workunit.client.0.smithi037.stderr: -344> 2024-09-12T17:37:01.234+0000 7f3c43c31800 5 AuthRegistry(0x5597c88453d0) adding con mode: crc 2024-09-12T17:37:01.614 INFO:tasks.workunit.client.0.smithi037.stderr: -343> 2024-09-12T17:37:01.234+0000 7f3c43c31800 5 AuthRegistry(0x5597c88453d0) adding con mode: secure 2024-09-12T17:37:01.614 INFO:tasks.workunit.client.0.smithi037.stderr: -342> 2024-09-12T17:37:01.234+0000 7f3c43c31800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:37:01.615 INFO:tasks.workunit.client.0.smithi037.stderr: -341> 2024-09-12T17:37:01.234+0000 7f3c43c31800 10 monclient: init 2024-09-12T17:37:01.615 INFO:tasks.workunit.client.0.smithi037.stderr: -340> 2024-09-12T17:37:01.234+0000 7f3c43c31800 5 AuthRegistry(0x7ffc9737a960) adding auth protocol: cephx 2024-09-12T17:37:01.615 INFO:tasks.workunit.client.0.smithi037.stderr: -339> 2024-09-12T17:37:01.234+0000 7f3c43c31800 5 AuthRegistry(0x7ffc9737a960) adding auth protocol: cephx 2024-09-12T17:37:01.615 INFO:tasks.workunit.client.0.smithi037.stderr: -338> 2024-09-12T17:37:01.234+0000 7f3c43c31800 5 AuthRegistry(0x7ffc9737a960) adding auth protocol: cephx 2024-09-12T17:37:01.615 INFO:tasks.workunit.client.0.smithi037.stderr: -337> 2024-09-12T17:37:01.234+0000 7f3c43c31800 5 AuthRegistry(0x7ffc9737a960) adding con mode: secure 2024-09-12T17:37:01.615 INFO:tasks.workunit.client.0.smithi037.stderr: -336> 2024-09-12T17:37:01.234+0000 7f3c43c31800 5 AuthRegistry(0x7ffc9737a960) adding con mode: crc 2024-09-12T17:37:01.615 INFO:tasks.workunit.client.0.smithi037.stderr: -335> 2024-09-12T17:37:01.234+0000 7f3c43c31800 5 AuthRegistry(0x7ffc9737a960) adding con mode: secure 2024-09-12T17:37:01.615 INFO:tasks.workunit.client.0.smithi037.stderr: -334> 2024-09-12T17:37:01.234+0000 7f3c43c31800 5 AuthRegistry(0x7ffc9737a960) adding con mode: crc 2024-09-12T17:37:01.616 INFO:tasks.workunit.client.0.smithi037.stderr: -333> 2024-09-12T17:37:01.234+0000 7f3c43c31800 5 AuthRegistry(0x7ffc9737a960) adding con mode: secure 2024-09-12T17:37:01.616 INFO:tasks.workunit.client.0.smithi037.stderr: -332> 2024-09-12T17:37:01.234+0000 7f3c43c31800 5 AuthRegistry(0x7ffc9737a960) adding con mode: crc 2024-09-12T17:37:01.616 INFO:tasks.workunit.client.0.smithi037.stderr: -331> 2024-09-12T17:37:01.234+0000 7f3c43c31800 5 AuthRegistry(0x7ffc9737a960) adding con mode: crc 2024-09-12T17:37:01.616 INFO:tasks.workunit.client.0.smithi037.stderr: -330> 2024-09-12T17:37:01.234+0000 7f3c43c31800 5 AuthRegistry(0x7ffc9737a960) adding con mode: secure 2024-09-12T17:37:01.616 INFO:tasks.workunit.client.0.smithi037.stderr: -329> 2024-09-12T17:37:01.234+0000 7f3c43c31800 5 AuthRegistry(0x7ffc9737a960) adding con mode: crc 2024-09-12T17:37:01.616 INFO:tasks.workunit.client.0.smithi037.stderr: -328> 2024-09-12T17:37:01.234+0000 7f3c43c31800 5 AuthRegistry(0x7ffc9737a960) adding con mode: secure 2024-09-12T17:37:01.616 INFO:tasks.workunit.client.0.smithi037.stderr: -327> 2024-09-12T17:37:01.234+0000 7f3c43c31800 5 AuthRegistry(0x7ffc9737a960) adding con mode: crc 2024-09-12T17:37:01.616 INFO:tasks.workunit.client.0.smithi037.stderr: -326> 2024-09-12T17:37:01.234+0000 7f3c43c31800 5 AuthRegistry(0x7ffc9737a960) adding con mode: secure 2024-09-12T17:37:01.616 INFO:tasks.workunit.client.0.smithi037.stderr: -325> 2024-09-12T17:37:01.234+0000 7f3c43c31800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:37:01.617 INFO:tasks.workunit.client.0.smithi037.stderr: -324> 2024-09-12T17:37:01.235+0000 7f3c43c31800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:37:01.620 INFO:tasks.workunit.client.0.smithi037.stderr: -323> 2024-09-12T17:37:01.235+0000 7f3c43c31800 5 asok(0x5597c8588730) register_command rotate-key cmddesc rotate-key hook 0x7ffc9737aaa8 EEXIST 2024-09-12T17:37:01.620 INFO:tasks.workunit.client.0.smithi037.stderr: -322> 2024-09-12T17:37:01.235+0000 7f3c43c31800 10 monclient: _reopen_session rank -1 2024-09-12T17:37:01.620 INFO:tasks.workunit.client.0.smithi037.stderr: -321> 2024-09-12T17:37:01.235+0000 7f3c43c31800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T17:37:01.620 INFO:tasks.workunit.client.0.smithi037.stderr: -320> 2024-09-12T17:37:01.235+0000 7f3c43c31800 10 monclient(hunting): picked mon.noname-a con 0x5597c8874f60 addr [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] 2024-09-12T17:37:01.620 INFO:tasks.workunit.client.0.smithi037.stderr: -319> 2024-09-12T17:37:01.235+0000 7f3c43c31800 10 monclient(hunting): picked mon.noname-c con 0x5597c887a810 addr [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] 2024-09-12T17:37:01.620 INFO:tasks.workunit.client.0.smithi037.stderr: -318> 2024-09-12T17:37:01.235+0000 7f3c43c31800 10 monclient(hunting): picked mon.noname-b con 0x5597c8877830 addr [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] 2024-09-12T17:37:01.621 INFO:tasks.workunit.client.0.smithi037.stderr: -317> 2024-09-12T17:37:01.235+0000 7f3c43c31800 10 monclient(hunting): start opening mon connection 2024-09-12T17:37:01.621 INFO:tasks.workunit.client.0.smithi037.stderr: -316> 2024-09-12T17:37:01.235+0000 7f3c43c31800 10 monclient(hunting): start opening mon connection 2024-09-12T17:37:01.621 INFO:tasks.workunit.client.0.smithi037.stderr: -315> 2024-09-12T17:37:01.235+0000 7f3c43c31800 10 monclient(hunting): start opening mon connection 2024-09-12T17:37:01.621 INFO:tasks.workunit.client.0.smithi037.stderr: -314> 2024-09-12T17:37:01.235+0000 7f3c43c31800 10 monclient(hunting): _renew_subs 2024-09-12T17:37:01.621 INFO:tasks.workunit.client.0.smithi037.stderr: -313> 2024-09-12T17:37:01.235+0000 7f3c43c31800 10 monclient(hunting): authenticate will time out at 2408.833258s 2024-09-12T17:37:01.621 INFO:tasks.workunit.client.0.smithi037.stderr: -312> 2024-09-12T17:37:01.235+0000 7f3c3ef8b640 10 monclient(hunting): get_auth_request con 0x5597c8874f60 auth_method 0 2024-09-12T17:37:01.621 INFO:tasks.workunit.client.0.smithi037.stderr: -311> 2024-09-12T17:37:01.235+0000 7f3c3ef8b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:37:01.621 INFO:tasks.workunit.client.0.smithi037.stderr: -310> 2024-09-12T17:37:01.235+0000 7f3c3ef8b640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:37:01.621 INFO:tasks.workunit.client.0.smithi037.stderr: -309> 2024-09-12T17:37:01.235+0000 7f3c3ef8b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:37:01.622 INFO:tasks.workunit.client.0.smithi037.stderr: -308> 2024-09-12T17:37:01.235+0000 7f3c3e78a640 10 monclient(hunting): get_auth_request con 0x5597c887a810 auth_method 0 2024-09-12T17:37:01.622 INFO:tasks.workunit.client.0.smithi037.stderr: -307> 2024-09-12T17:37:01.235+0000 7f3c3e78a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:37:01.622 INFO:tasks.workunit.client.0.smithi037.stderr: -306> 2024-09-12T17:37:01.235+0000 7f3c3e78a640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:37:01.622 INFO:tasks.workunit.client.0.smithi037.stderr: -305> 2024-09-12T17:37:01.235+0000 7f3c3e78a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:37:01.622 INFO:tasks.workunit.client.0.smithi037.stderr: -304> 2024-09-12T17:37:01.235+0000 7f3c3ef8b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:37:01.622 INFO:tasks.workunit.client.0.smithi037.stderr: -303> 2024-09-12T17:37:01.235+0000 7f3c3ef8b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:37:01.622 INFO:tasks.workunit.client.0.smithi037.stderr: -302> 2024-09-12T17:37:01.235+0000 7f3c3ef8b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:37:01.622 INFO:tasks.workunit.client.0.smithi037.stderr: -301> 2024-09-12T17:37:01.235+0000 7f3c3f78c640 10 monclient(hunting): get_auth_request con 0x5597c8877830 auth_method 0 2024-09-12T17:37:01.623 INFO:tasks.workunit.client.0.smithi037.stderr: -300> 2024-09-12T17:37:01.235+0000 7f3c3f78c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:37:01.623 INFO:tasks.workunit.client.0.smithi037.stderr: -299> 2024-09-12T17:37:01.235+0000 7f3c3f78c640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:37:01.623 INFO:tasks.workunit.client.0.smithi037.stderr: -298> 2024-09-12T17:37:01.235+0000 7f3c3f78c640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:37:01.623 INFO:tasks.workunit.client.0.smithi037.stderr: -297> 2024-09-12T17:37:01.235+0000 7f3c3e78a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:37:01.623 INFO:tasks.workunit.client.0.smithi037.stderr: -296> 2024-09-12T17:37:01.235+0000 7f3c3e78a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:37:01.623 INFO:tasks.workunit.client.0.smithi037.stderr: -295> 2024-09-12T17:37:01.235+0000 7f3c3e78a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:37:01.623 INFO:tasks.workunit.client.0.smithi037.stderr: -294> 2024-09-12T17:37:01.235+0000 7f3c3f78c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:37:01.623 INFO:tasks.workunit.client.0.smithi037.stderr: -293> 2024-09-12T17:37:01.235+0000 7f3c3f78c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:37:01.624 INFO:tasks.workunit.client.0.smithi037.stderr: -292> 2024-09-12T17:37:01.235+0000 7f3c3f78c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:37:01.624 INFO:tasks.workunit.client.0.smithi037.stderr: -291> 2024-09-12T17:37:01.235+0000 7f3c3ef8b640 10 monclient(hunting): handle_auth_done global_id 8157 payload 274 2024-09-12T17:37:01.624 INFO:tasks.workunit.client.0.smithi037.stderr: -290> 2024-09-12T17:37:01.235+0000 7f3c3ef8b640 10 monclient: _finish_hunting 0 2024-09-12T17:37:01.624 INFO:tasks.workunit.client.0.smithi037.stderr: -289> 2024-09-12T17:37:01.235+0000 7f3c3ef8b640 1 monclient: found mon.noname-a 2024-09-12T17:37:01.624 INFO:tasks.workunit.client.0.smithi037.stderr: -288> 2024-09-12T17:37:01.235+0000 7f3c3ef8b640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.37:3300/0 2024-09-12T17:37:01.624 INFO:tasks.workunit.client.0.smithi037.stderr: -287> 2024-09-12T17:37:01.235+0000 7f3b227fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:37:01.624 INFO:tasks.workunit.client.0.smithi037.stderr: -286> 2024-09-12T17:37:01.235+0000 7f3b227fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:37:01.624 INFO:tasks.workunit.client.0.smithi037.stderr: -285> 2024-09-12T17:37:01.235+0000 7f3b227fc640 10 monclient: dump: 2024-09-12T17:37:01.625 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:37:01.625 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:37:01.625 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:37:01.625 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:37:01.625 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:37:01.625 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:37:01.625 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:37:01.625 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:37:01.626 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:37:01.626 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:37:01.626 INFO:tasks.workunit.client.0.smithi037.stderr: -284> 2024-09-12T17:37:01.235+0000 7f3b227fc640 10 monclient: _finish_auth 0 2024-09-12T17:37:01.626 INFO:tasks.workunit.client.0.smithi037.stderr: -283> 2024-09-12T17:37:01.235+0000 7f3b227fc640 10 monclient: _check_auth_tickets 2024-09-12T17:37:01.626 INFO:tasks.workunit.client.0.smithi037.stderr: -282> 2024-09-12T17:37:01.235+0000 7f3b227fc640 10 monclient: handle_config config(0 keys) 2024-09-12T17:37:01.626 INFO:tasks.workunit.client.0.smithi037.stderr: -281> 2024-09-12T17:37:01.235+0000 7f3b227fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:37:01.626 INFO:tasks.workunit.client.0.smithi037.stderr: -280> 2024-09-12T17:37:01.235+0000 7f3b227fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:37:01.626 INFO:tasks.workunit.client.0.smithi037.stderr: -279> 2024-09-12T17:37:01.235+0000 7f3b227fc640 10 monclient: dump: 2024-09-12T17:37:01.627 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:37:01.627 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:37:01.627 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:37:01.627 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:37:01.627 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:37:01.627 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:37:01.627 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:37:01.627 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:37:01.627 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:37:01.627 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:37:01.627 INFO:tasks.workunit.client.0.smithi037.stderr: -278> 2024-09-12T17:37:01.235+0000 7f3c43c31800 5 monclient: authenticate success, global_id 8157 2024-09-12T17:37:01.627 INFO:tasks.workunit.client.0.smithi037.stderr: -277> 2024-09-12T17:37:01.235+0000 7f3c43c31800 10 monclient: get_monmap_and_config success 2024-09-12T17:37:01.628 INFO:tasks.workunit.client.0.smithi037.stderr: -276> 2024-09-12T17:37:01.235+0000 7f3c43c31800 4 set_mon_vals no callback set 2024-09-12T17:37:01.628 INFO:tasks.workunit.client.0.smithi037.stderr: -275> 2024-09-12T17:37:01.236+0000 7f3c43c31800 10 monclient: shutdown 2024-09-12T17:37:01.628 INFO:tasks.workunit.client.0.smithi037.stderr: -274> 2024-09-12T17:37:01.236+0000 7f3c43c31800 10 monclient: build_initial_monmap 2024-09-12T17:37:01.628 INFO:tasks.workunit.client.0.smithi037.stderr: -273> 2024-09-12T17:37:01.236+0000 7f3c43c31800 1 build_initial for_mkfs: 0 2024-09-12T17:37:01.628 INFO:tasks.workunit.client.0.smithi037.stderr: -272> 2024-09-12T17:37:01.236+0000 7f3c43c31800 10 monclient: monmap: 2024-09-12T17:37:01.628 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 0 2024-09-12T17:37:01.628 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:37:01.628 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 0.000000 2024-09-12T17:37:01.628 INFO:tasks.workunit.client.0.smithi037.stderr:created 0.000000 2024-09-12T17:37:01.628 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 0 (unknown) 2024-09-12T17:37:01.629 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:37:01.629 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.noname-a 2024-09-12T17:37:01.629 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.noname-b 2024-09-12T17:37:01.629 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.noname-c 2024-09-12T17:37:01.629 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:37:01.630 INFO:tasks.workunit.client.0.smithi037.stderr: -271> 2024-09-12T17:37:01.236+0000 7f3c43c31800 5 AuthRegistry(0x5597c86344a0) adding auth protocol: cephx 2024-09-12T17:37:01.630 INFO:tasks.workunit.client.0.smithi037.stderr: -270> 2024-09-12T17:37:01.236+0000 7f3c43c31800 5 AuthRegistry(0x5597c86344a0) adding auth protocol: cephx 2024-09-12T17:37:01.630 INFO:tasks.workunit.client.0.smithi037.stderr: -269> 2024-09-12T17:37:01.236+0000 7f3c43c31800 5 AuthRegistry(0x5597c86344a0) adding auth protocol: cephx 2024-09-12T17:37:01.630 INFO:tasks.workunit.client.0.smithi037.stderr: -268> 2024-09-12T17:37:01.236+0000 7f3c43c31800 5 AuthRegistry(0x5597c86344a0) adding con mode: secure 2024-09-12T17:37:01.630 INFO:tasks.workunit.client.0.smithi037.stderr: -267> 2024-09-12T17:37:01.236+0000 7f3c43c31800 5 AuthRegistry(0x5597c86344a0) adding con mode: crc 2024-09-12T17:37:01.630 INFO:tasks.workunit.client.0.smithi037.stderr: -266> 2024-09-12T17:37:01.236+0000 7f3c43c31800 5 AuthRegistry(0x5597c86344a0) adding con mode: secure 2024-09-12T17:37:01.630 INFO:tasks.workunit.client.0.smithi037.stderr: -265> 2024-09-12T17:37:01.236+0000 7f3c43c31800 5 AuthRegistry(0x5597c86344a0) adding con mode: crc 2024-09-12T17:37:01.630 INFO:tasks.workunit.client.0.smithi037.stderr: -264> 2024-09-12T17:37:01.236+0000 7f3c43c31800 5 AuthRegistry(0x5597c86344a0) adding con mode: secure 2024-09-12T17:37:01.631 INFO:tasks.workunit.client.0.smithi037.stderr: -263> 2024-09-12T17:37:01.236+0000 7f3c43c31800 5 AuthRegistry(0x5597c86344a0) adding con mode: crc 2024-09-12T17:37:01.631 INFO:tasks.workunit.client.0.smithi037.stderr: -262> 2024-09-12T17:37:01.236+0000 7f3c43c31800 5 AuthRegistry(0x5597c86344a0) adding con mode: crc 2024-09-12T17:37:01.631 INFO:tasks.workunit.client.0.smithi037.stderr: -261> 2024-09-12T17:37:01.236+0000 7f3c43c31800 5 AuthRegistry(0x5597c86344a0) adding con mode: secure 2024-09-12T17:37:01.631 INFO:tasks.workunit.client.0.smithi037.stderr: -260> 2024-09-12T17:37:01.236+0000 7f3c43c31800 5 AuthRegistry(0x5597c86344a0) adding con mode: crc 2024-09-12T17:37:01.631 INFO:tasks.workunit.client.0.smithi037.stderr: -259> 2024-09-12T17:37:01.236+0000 7f3c43c31800 5 AuthRegistry(0x5597c86344a0) adding con mode: secure 2024-09-12T17:37:01.631 INFO:tasks.workunit.client.0.smithi037.stderr: -258> 2024-09-12T17:37:01.236+0000 7f3c43c31800 5 AuthRegistry(0x5597c86344a0) adding con mode: crc 2024-09-12T17:37:01.631 INFO:tasks.workunit.client.0.smithi037.stderr: -257> 2024-09-12T17:37:01.236+0000 7f3c43c31800 5 AuthRegistry(0x5597c86344a0) adding con mode: secure 2024-09-12T17:37:01.631 INFO:tasks.workunit.client.0.smithi037.stderr: -256> 2024-09-12T17:37:01.236+0000 7f3c43c31800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:37:01.631 INFO:tasks.workunit.client.0.smithi037.stderr: -255> 2024-09-12T17:37:01.236+0000 7f3c43c31800 1 librados: starting msgr at 2024-09-12T17:37:01.631 INFO:tasks.workunit.client.0.smithi037.stderr: -254> 2024-09-12T17:37:01.236+0000 7f3c43c31800 1 librados: starting objecter 2024-09-12T17:37:01.631 INFO:tasks.workunit.client.0.smithi037.stderr: -253> 2024-09-12T17:37:01.236+0000 7f3c43c31800 5 asok(0x5597c8588730) register_command objecter_requests cmddesc objecter_requests hook 0x5597c8849eb0 EEXIST 2024-09-12T17:37:01.631 INFO:tasks.workunit.client.0.smithi037.stderr: -252> 2024-09-12T17:37:01.237+0000 7f3c43c31800 1 librados: setting wanted keys 2024-09-12T17:37:01.631 INFO:tasks.workunit.client.0.smithi037.stderr: -251> 2024-09-12T17:37:01.237+0000 7f3c43c31800 1 librados: calling monclient init 2024-09-12T17:37:01.631 INFO:tasks.workunit.client.0.smithi037.stderr: -250> 2024-09-12T17:37:01.237+0000 7f3c43c31800 10 monclient: init 2024-09-12T17:37:01.632 INFO:tasks.workunit.client.0.smithi037.stderr: -249> 2024-09-12T17:37:01.237+0000 7f3c43c31800 5 AuthRegistry(0x5597c8839f40) adding auth protocol: cephx 2024-09-12T17:37:01.632 INFO:tasks.workunit.client.0.smithi037.stderr: -248> 2024-09-12T17:37:01.237+0000 7f3c43c31800 5 AuthRegistry(0x5597c8839f40) adding auth protocol: cephx 2024-09-12T17:37:01.632 INFO:tasks.workunit.client.0.smithi037.stderr: -247> 2024-09-12T17:37:01.237+0000 7f3c43c31800 5 AuthRegistry(0x5597c8839f40) adding auth protocol: cephx 2024-09-12T17:37:01.632 INFO:tasks.workunit.client.0.smithi037.stderr: -246> 2024-09-12T17:37:01.237+0000 7f3c43c31800 5 AuthRegistry(0x5597c8839f40) adding con mode: secure 2024-09-12T17:37:01.632 INFO:tasks.workunit.client.0.smithi037.stderr: -245> 2024-09-12T17:37:01.237+0000 7f3c43c31800 5 AuthRegistry(0x5597c8839f40) adding con mode: crc 2024-09-12T17:37:01.632 INFO:tasks.workunit.client.0.smithi037.stderr: -244> 2024-09-12T17:37:01.237+0000 7f3c43c31800 5 AuthRegistry(0x5597c8839f40) adding con mode: secure 2024-09-12T17:37:01.632 INFO:tasks.workunit.client.0.smithi037.stderr: -243> 2024-09-12T17:37:01.237+0000 7f3c43c31800 5 AuthRegistry(0x5597c8839f40) adding con mode: crc 2024-09-12T17:37:01.632 INFO:tasks.workunit.client.0.smithi037.stderr: -242> 2024-09-12T17:37:01.237+0000 7f3c43c31800 5 AuthRegistry(0x5597c8839f40) adding con mode: secure 2024-09-12T17:37:01.632 INFO:tasks.workunit.client.0.smithi037.stderr: -241> 2024-09-12T17:37:01.237+0000 7f3c43c31800 5 AuthRegistry(0x5597c8839f40) adding con mode: crc 2024-09-12T17:37:01.632 INFO:tasks.workunit.client.0.smithi037.stderr: -240> 2024-09-12T17:37:01.237+0000 7f3c43c31800 5 AuthRegistry(0x5597c8839f40) adding con mode: crc 2024-09-12T17:37:01.632 INFO:tasks.workunit.client.0.smithi037.stderr: -239> 2024-09-12T17:37:01.237+0000 7f3c43c31800 5 AuthRegistry(0x5597c8839f40) adding con mode: secure 2024-09-12T17:37:01.632 INFO:tasks.workunit.client.0.smithi037.stderr: -238> 2024-09-12T17:37:01.237+0000 7f3c43c31800 5 AuthRegistry(0x5597c8839f40) adding con mode: crc 2024-09-12T17:37:01.633 INFO:tasks.workunit.client.0.smithi037.stderr: -237> 2024-09-12T17:37:01.237+0000 7f3c43c31800 5 AuthRegistry(0x5597c8839f40) adding con mode: secure 2024-09-12T17:37:01.633 INFO:tasks.workunit.client.0.smithi037.stderr: -236> 2024-09-12T17:37:01.237+0000 7f3c43c31800 5 AuthRegistry(0x5597c8839f40) adding con mode: crc 2024-09-12T17:37:01.633 INFO:tasks.workunit.client.0.smithi037.stderr: -235> 2024-09-12T17:37:01.237+0000 7f3c43c31800 5 AuthRegistry(0x5597c8839f40) adding con mode: secure 2024-09-12T17:37:01.633 INFO:tasks.workunit.client.0.smithi037.stderr: -234> 2024-09-12T17:37:01.237+0000 7f3c43c31800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:37:01.633 INFO:tasks.workunit.client.0.smithi037.stderr: -233> 2024-09-12T17:37:01.237+0000 7f3c43c31800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:37:01.633 INFO:tasks.workunit.client.0.smithi037.stderr: -232> 2024-09-12T17:37:01.237+0000 7f3c43c31800 5 asok(0x5597c8588730) register_command rotate-key cmddesc rotate-key hook 0x5597c883a088 EEXIST 2024-09-12T17:37:01.633 INFO:tasks.workunit.client.0.smithi037.stderr: -231> 2024-09-12T17:37:01.237+0000 7f3c43c31800 10 monclient: _reopen_session rank -1 2024-09-12T17:37:01.633 INFO:tasks.workunit.client.0.smithi037.stderr: -230> 2024-09-12T17:37:01.237+0000 7f3c43c31800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T17:37:01.633 INFO:tasks.workunit.client.0.smithi037.stderr: -229> 2024-09-12T17:37:01.237+0000 7f3c43c31800 10 monclient(hunting): picked mon.noname-c con 0x5597c8874f60 addr [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] 2024-09-12T17:37:01.633 INFO:tasks.workunit.client.0.smithi037.stderr: -228> 2024-09-12T17:37:01.237+0000 7f3c43c31800 10 monclient(hunting): picked mon.noname-b con 0x5597c8877830 addr [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] 2024-09-12T17:37:01.633 INFO:tasks.workunit.client.0.smithi037.stderr: -227> 2024-09-12T17:37:01.237+0000 7f3c43c31800 10 monclient(hunting): picked mon.noname-a con 0x5597c887a810 addr [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] 2024-09-12T17:37:01.634 INFO:tasks.workunit.client.0.smithi037.stderr: -226> 2024-09-12T17:37:01.237+0000 7f3c43c31800 10 monclient(hunting): start opening mon connection 2024-09-12T17:37:01.634 INFO:tasks.workunit.client.0.smithi037.stderr: -225> 2024-09-12T17:37:01.237+0000 7f3c43c31800 10 monclient(hunting): start opening mon connection 2024-09-12T17:37:01.634 INFO:tasks.workunit.client.0.smithi037.stderr: -224> 2024-09-12T17:37:01.237+0000 7f3c43c31800 10 monclient(hunting): start opening mon connection 2024-09-12T17:37:01.634 INFO:tasks.workunit.client.0.smithi037.stderr: -223> 2024-09-12T17:37:01.237+0000 7f3c43c31800 10 monclient(hunting): _renew_subs 2024-09-12T17:37:01.634 INFO:tasks.workunit.client.0.smithi037.stderr: -222> 2024-09-12T17:37:01.237+0000 7f3c43c31800 10 monclient(hunting): authenticate will time out at 2408.835593s 2024-09-12T17:37:01.634 INFO:tasks.workunit.client.0.smithi037.stderr: -221> 2024-09-12T17:37:01.237+0000 7f3c3ef8b640 10 monclient(hunting): get_auth_request con 0x5597c8874f60 auth_method 0 2024-09-12T17:37:01.634 INFO:tasks.workunit.client.0.smithi037.stderr: -220> 2024-09-12T17:37:01.237+0000 7f3c3ef8b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:37:01.634 INFO:tasks.workunit.client.0.smithi037.stderr: -219> 2024-09-12T17:37:01.237+0000 7f3c3ef8b640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:37:01.634 INFO:tasks.workunit.client.0.smithi037.stderr: -218> 2024-09-12T17:37:01.237+0000 7f3c3ef8b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:37:01.634 INFO:tasks.workunit.client.0.smithi037.stderr: -217> 2024-09-12T17:37:01.237+0000 7f3c3f78c640 10 monclient(hunting): get_auth_request con 0x5597c887a810 auth_method 0 2024-09-12T17:37:01.634 INFO:tasks.workunit.client.0.smithi037.stderr: -216> 2024-09-12T17:37:01.237+0000 7f3c3f78c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:37:01.634 INFO:tasks.workunit.client.0.smithi037.stderr: -215> 2024-09-12T17:37:01.237+0000 7f3c3f78c640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:37:01.634 INFO:tasks.workunit.client.0.smithi037.stderr: -214> 2024-09-12T17:37:01.237+0000 7f3c3f78c640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:37:01.634 INFO:tasks.workunit.client.0.smithi037.stderr: -213> 2024-09-12T17:37:01.237+0000 7f3c3e78a640 10 monclient(hunting): get_auth_request con 0x5597c8877830 auth_method 0 2024-09-12T17:37:01.635 INFO:tasks.workunit.client.0.smithi037.stderr: -212> 2024-09-12T17:37:01.237+0000 7f3c3e78a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:37:01.635 INFO:tasks.workunit.client.0.smithi037.stderr: -211> 2024-09-12T17:37:01.237+0000 7f3c3e78a640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:37:01.635 INFO:tasks.workunit.client.0.smithi037.stderr: -210> 2024-09-12T17:37:01.237+0000 7f3c3e78a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:37:01.635 INFO:tasks.workunit.client.0.smithi037.stderr: -209> 2024-09-12T17:37:01.237+0000 7f3c3ef8b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:37:01.635 INFO:tasks.workunit.client.0.smithi037.stderr: -208> 2024-09-12T17:37:01.237+0000 7f3c3ef8b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:37:01.635 INFO:tasks.workunit.client.0.smithi037.stderr: -207> 2024-09-12T17:37:01.237+0000 7f3c3ef8b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:37:01.635 INFO:tasks.workunit.client.0.smithi037.stderr: -206> 2024-09-12T17:37:01.237+0000 7f3c3f78c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:37:01.635 INFO:tasks.workunit.client.0.smithi037.stderr: -205> 2024-09-12T17:37:01.237+0000 7f3c3f78c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:37:01.635 INFO:tasks.workunit.client.0.smithi037.stderr: -204> 2024-09-12T17:37:01.237+0000 7f3c3f78c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:37:01.635 INFO:tasks.workunit.client.0.smithi037.stderr: -203> 2024-09-12T17:37:01.237+0000 7f3c3e78a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:37:01.635 INFO:tasks.workunit.client.0.smithi037.stderr: -202> 2024-09-12T17:37:01.237+0000 7f3c3e78a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:37:01.635 INFO:tasks.workunit.client.0.smithi037.stderr: -201> 2024-09-12T17:37:01.237+0000 7f3c3e78a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:37:01.635 INFO:tasks.workunit.client.0.smithi037.stderr: -200> 2024-09-12T17:37:01.237+0000 7f3c3ef8b640 10 monclient(hunting): handle_auth_done global_id 7616 payload 824 2024-09-12T17:37:01.635 INFO:tasks.workunit.client.0.smithi037.stderr: -199> 2024-09-12T17:37:01.237+0000 7f3c3ef8b640 10 monclient: _finish_hunting 0 2024-09-12T17:37:01.636 INFO:tasks.workunit.client.0.smithi037.stderr: -198> 2024-09-12T17:37:01.237+0000 7f3c3ef8b640 1 monclient: found mon.noname-c 2024-09-12T17:37:01.636 INFO:tasks.workunit.client.0.smithi037.stderr: -197> 2024-09-12T17:37:01.237+0000 7f3c3ef8b640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.37:3301/0 2024-09-12T17:37:01.636 INFO:tasks.workunit.client.0.smithi037.stderr: -196> 2024-09-12T17:37:01.238+0000 7f3b20ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:37:01.636 INFO:tasks.workunit.client.0.smithi037.stderr: -195> 2024-09-12T17:37:01.238+0000 7f3b20ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:37:01.636 INFO:tasks.workunit.client.0.smithi037.stderr: -194> 2024-09-12T17:37:01.238+0000 7f3b20ff9640 10 monclient: dump: 2024-09-12T17:37:01.636 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:37:01.636 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:37:01.636 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:37:01.636 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:37:01.636 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:37:01.636 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:37:01.636 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:37:01.636 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:37:01.636 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:37:01.636 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:37:01.637 INFO:tasks.workunit.client.0.smithi037.stderr: -193> 2024-09-12T17:37:01.238+0000 7f3b20ff9640 10 monclient: _finish_auth 0 2024-09-12T17:37:01.637 INFO:tasks.workunit.client.0.smithi037.stderr: -192> 2024-09-12T17:37:01.238+0000 7f3b20ff9640 10 monclient: _check_auth_tickets 2024-09-12T17:37:01.637 INFO:tasks.workunit.client.0.smithi037.stderr: -191> 2024-09-12T17:37:01.238+0000 7f3b20ff9640 10 monclient: handle_config config(0 keys) 2024-09-12T17:37:01.637 INFO:tasks.workunit.client.0.smithi037.stderr: -190> 2024-09-12T17:37:01.238+0000 7f3b20ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:37:01.637 INFO:tasks.workunit.client.0.smithi037.stderr: -189> 2024-09-12T17:37:01.238+0000 7f3b20ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:37:01.637 INFO:tasks.workunit.client.0.smithi037.stderr: -188> 2024-09-12T17:37:01.238+0000 7f3b20ff9640 10 monclient: dump: 2024-09-12T17:37:01.637 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:37:01.637 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:37:01.637 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:37:01.637 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:37:01.637 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:37:01.637 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:37:01.637 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:37:01.637 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:37:01.637 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:37:01.638 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:37:01.638 INFO:tasks.workunit.client.0.smithi037.stderr: -187> 2024-09-12T17:37:01.238+0000 7f3c43c31800 5 monclient: authenticate success, global_id 7616 2024-09-12T17:37:01.638 INFO:tasks.workunit.client.0.smithi037.stderr: -186> 2024-09-12T17:37:01.238+0000 7f3c43c31800 10 monclient: _renew_subs 2024-09-12T17:37:01.638 INFO:tasks.workunit.client.0.smithi037.stderr: -185> 2024-09-12T17:37:01.238+0000 7f3b227fc640 4 set_mon_vals no callback set 2024-09-12T17:37:01.638 INFO:tasks.workunit.client.0.smithi037.stderr: -184> 2024-09-12T17:37:01.238+0000 7f3c43c31800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.37:3301/0 2024-09-12T17:37:01.638 INFO:tasks.workunit.client.0.smithi037.stderr: -183> 2024-09-12T17:37:01.238+0000 7f3c43c31800 10 monclient: _renew_subs 2024-09-12T17:37:01.638 INFO:tasks.workunit.client.0.smithi037.stderr: -182> 2024-09-12T17:37:01.238+0000 7f3c43c31800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.37:3301/0 2024-09-12T17:37:01.638 INFO:tasks.workunit.client.0.smithi037.stderr: -181> 2024-09-12T17:37:01.238+0000 7f3c43c31800 1 librados: init done 2024-09-12T17:37:01.638 INFO:tasks.workunit.client.0.smithi037.stderr: -180> 2024-09-12T17:37:01.238+0000 7f3c43c31800 5 asok(0x5597c8588730) register_command cr dump hook 0x5597c8871978 2024-09-12T17:37:01.638 INFO:tasks.workunit.client.0.smithi037.stderr: -179> 2024-09-12T17:37:01.240+0000 7f3c43c31800 20 rados->read ofs=0 len=0 2024-09-12T17:37:01.638 INFO:tasks.workunit.client.0.smithi037.stderr: -178> 2024-09-12T17:37:01.240+0000 7f3b20ff9640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:37:01.638 INFO:tasks.workunit.client.0.smithi037.stderr: -177> 2024-09-12T17:37:01.240+0000 7f3b20ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.40:6816/3916250676,v1:172.21.15.40:6817/3916250676] 2024-09-12T17:37:01.638 INFO:tasks.workunit.client.0.smithi037.stderr: -176> 2024-09-12T17:37:01.240+0000 7f3b20ff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.40:6816/3916250676,v1:172.21.15.40:6817/3916250676] 2024-09-12T17:37:01.638 INFO:tasks.workunit.client.0.smithi037.stderr: -175> 2024-09-12T17:37:01.241+0000 7f3c3e78a640 10 monclient: get_auth_request con 0x7f3b08076470 auth_method 0 2024-09-12T17:37:01.638 INFO:tasks.workunit.client.0.smithi037.stderr: -174> 2024-09-12T17:37:01.241+0000 7f3c3f78c640 10 monclient: get_auth_request con 0x5597c88951e0 auth_method 0 2024-09-12T17:37:01.639 INFO:tasks.workunit.client.0.smithi037.stderr: -173> 2024-09-12T17:37:01.241+0000 7f3c43c31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:01.639 INFO:tasks.workunit.client.0.smithi037.stderr: -172> 2024-09-12T17:37:01.241+0000 7f3c43c31800 20 realm 2024-09-12T17:37:01.639 INFO:tasks.workunit.client.0.smithi037.stderr: -171> 2024-09-12T17:37:01.241+0000 7f3c43c31800 20 rados->read ofs=0 len=0 2024-09-12T17:37:01.639 INFO:tasks.workunit.client.0.smithi037.stderr: -170> 2024-09-12T17:37:01.241+0000 7f3c43c31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:01.639 INFO:tasks.workunit.client.0.smithi037.stderr: -169> 2024-09-12T17:37:01.241+0000 7f3c43c31800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:37:01.639 INFO:tasks.workunit.client.0.smithi037.stderr: -168> 2024-09-12T17:37:01.241+0000 7f3c43c31800 20 rados->read ofs=0 len=0 2024-09-12T17:37:01.639 INFO:tasks.workunit.client.0.smithi037.stderr: -167> 2024-09-12T17:37:01.242+0000 7f3c43c31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:01.639 INFO:tasks.workunit.client.0.smithi037.stderr: -166> 2024-09-12T17:37:01.242+0000 7f3c43c31800 20 rados->read ofs=0 len=0 2024-09-12T17:37:01.639 INFO:tasks.workunit.client.0.smithi037.stderr: -165> 2024-09-12T17:37:01.242+0000 7f3c3ef8b640 10 monclient: get_auth_request con 0x5597c8899450 auth_method 0 2024-09-12T17:37:01.639 INFO:tasks.workunit.client.0.smithi037.stderr: -164> 2024-09-12T17:37:01.242+0000 7f3c43c31800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:37:01.639 INFO:tasks.workunit.client.0.smithi037.stderr: -163> 2024-09-12T17:37:01.242+0000 7f3c43c31800 20 rados->read ofs=0 len=0 2024-09-12T17:37:01.639 INFO:tasks.workunit.client.0.smithi037.stderr: -162> 2024-09-12T17:37:01.243+0000 7f3c43c31800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:37:01.639 INFO:tasks.workunit.client.0.smithi037.stderr: -161> 2024-09-12T17:37:01.243+0000 7f3c43c31800 20 searching for the correct realm 2024-09-12T17:37:01.639 INFO:tasks.workunit.client.0.smithi037.stderr: -160> 2024-09-12T17:37:01.243+0000 7f3c3e78a640 10 monclient: get_auth_request con 0x5597c889e720 auth_method 0 2024-09-12T17:37:01.640 INFO:tasks.workunit.client.0.smithi037.stderr: -159> 2024-09-12T17:37:01.244+0000 7f3c3f78c640 10 monclient: get_auth_request con 0x7f3c3402f950 auth_method 0 2024-09-12T17:37:01.640 INFO:tasks.workunit.client.0.smithi037.stderr: -158> 2024-09-12T17:37:01.244+0000 7f3c3ef8b640 10 monclient: get_auth_request con 0x7f3c38065e50 auth_method 0 2024-09-12T17:37:01.640 INFO:tasks.workunit.client.0.smithi037.stderr: -157> 2024-09-12T17:37:01.245+0000 7f3c3e78a640 10 monclient: get_auth_request con 0x7f3c3006b020 auth_method 0 2024-09-12T17:37:01.640 INFO:tasks.workunit.client.0.smithi037.stderr: -156> 2024-09-12T17:37:01.245+0000 7f3c3e78a640 0 -- 172.21.15.37:0/3860369574 >> [v2:172.21.15.40:6800/2441293461,v1:172.21.15.40:6801/2441293461] conn(0x7f3c3006b020 msgr2=0x7f3c3005a460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:37:01.640 INFO:tasks.workunit.client.0.smithi037.stderr: -155> 2024-09-12T17:37:01.245+0000 7f3b20ff9640 1 client.7616.objecter ms_handle_reset 0x7f3c3006b020 session 0x7f3c300ba070 osd.4 2024-09-12T17:37:01.640 INFO:tasks.workunit.client.0.smithi037.stderr: -154> 2024-09-12T17:37:01.245+0000 7f3b20ff9640 10 monclient: _renew_subs 2024-09-12T17:37:01.640 INFO:tasks.workunit.client.0.smithi037.stderr: -153> 2024-09-12T17:37:01.245+0000 7f3b20ff9640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.37:3301/0 2024-09-12T17:37:01.640 INFO:tasks.workunit.client.0.smithi037.stderr: -152> 2024-09-12T17:37:01.245+0000 7f3c3e78a640 10 monclient: get_auth_request con 0x7f3b08086b10 auth_method 0 2024-09-12T17:37:01.640 INFO:tasks.workunit.client.0.smithi037.stderr: -151> 2024-09-12T17:37:01.247+0000 7f3c3f78c640 10 monclient: get_auth_request con 0x7f3c3401a8b0 auth_method 0 2024-09-12T17:37:01.640 INFO:tasks.workunit.client.0.smithi037.stderr: -150> 2024-09-12T17:37:01.250+0000 7f3c3ef8b640 10 monclient: get_auth_request con 0x7f3c3403d400 auth_method 0 2024-09-12T17:37:01.640 INFO:tasks.workunit.client.0.smithi037.stderr: -149> 2024-09-12T17:37:01.250+0000 7f3c3ef8b640 0 -- 172.21.15.37:0/3860369574 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7f3c3403d400 msgr2=0x7f3c3403d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:37:01.640 INFO:tasks.workunit.client.0.smithi037.stderr: -148> 2024-09-12T17:37:01.451+0000 7f3c3ef8b640 10 monclient: get_auth_request con 0x7f3c3403d400 auth_method 0 2024-09-12T17:37:01.640 INFO:tasks.workunit.client.0.smithi037.stderr: -147> 2024-09-12T17:37:01.456+0000 7f3c43c31800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:37:01.640 INFO:tasks.workunit.client.0.smithi037.stderr: -146> 2024-09-12T17:37:01.456+0000 7f3c43c31800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:37:01.641 INFO:tasks.workunit.client.0.smithi037.stderr: -145> 2024-09-12T17:37:01.456+0000 7f3c43c31800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:37:01.641 INFO:tasks.workunit.client.0.smithi037.stderr: -144> 2024-09-12T17:37:01.456+0000 7f3c43c31800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:37:01.641 INFO:tasks.workunit.client.0.smithi037.stderr: -143> 2024-09-12T17:37:01.456+0000 7f3c43c31800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:37:01.641 INFO:tasks.workunit.client.0.smithi037.stderr: -142> 2024-09-12T17:37:01.456+0000 7f3c43c31800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:37:01.641 INFO:tasks.workunit.client.0.smithi037.stderr: -141> 2024-09-12T17:37:01.456+0000 7f3c43c31800 20 rados->read ofs=0 len=0 2024-09-12T17:37:01.641 INFO:tasks.workunit.client.0.smithi037.stderr: -140> 2024-09-12T17:37:01.456+0000 7f3c43c31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:01.641 INFO:tasks.workunit.client.0.smithi037.stderr: -139> 2024-09-12T17:37:01.456+0000 7f3c43c31800 20 rados->read ofs=0 len=0 2024-09-12T17:37:01.641 INFO:tasks.workunit.client.0.smithi037.stderr: -138> 2024-09-12T17:37:01.457+0000 7f3c43c31800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:37:01.641 INFO:tasks.workunit.client.0.smithi037.stderr: -137> 2024-09-12T17:37:01.457+0000 7f3c43c31800 20 rados->read ofs=0 len=0 2024-09-12T17:37:01.641 INFO:tasks.workunit.client.0.smithi037.stderr: -136> 2024-09-12T17:37:01.457+0000 7f3c43c31800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:37:01.641 INFO:tasks.workunit.client.0.smithi037.stderr: -135> 2024-09-12T17:37:01.457+0000 7f3c43c31800 20 zone default found 2024-09-12T17:37:01.641 INFO:tasks.workunit.client.0.smithi037.stderr: -134> 2024-09-12T17:37:01.457+0000 7f3c43c31800 4 Realm: () 2024-09-12T17:37:01.641 INFO:tasks.workunit.client.0.smithi037.stderr: -133> 2024-09-12T17:37:01.457+0000 7f3c43c31800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:37:01.641 INFO:tasks.workunit.client.0.smithi037.stderr: -132> 2024-09-12T17:37:01.457+0000 7f3c43c31800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:37:01.641 INFO:tasks.workunit.client.0.smithi037.stderr: -131> 2024-09-12T17:37:01.457+0000 7f3c43c31800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:37:01.642 INFO:tasks.workunit.client.0.smithi037.stderr: -130> 2024-09-12T17:37:01.457+0000 7f3c43c31800 20 zonegroup default 2024-09-12T17:37:01.642 INFO:tasks.workunit.client.0.smithi037.stderr: -129> 2024-09-12T17:37:01.457+0000 7f3c43c31800 20 rados->read ofs=0 len=0 2024-09-12T17:37:01.642 INFO:tasks.workunit.client.0.smithi037.stderr: -128> 2024-09-12T17:37:01.458+0000 7f3c43c31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:01.642 INFO:tasks.workunit.client.0.smithi037.stderr: -127> 2024-09-12T17:37:01.458+0000 7f3c43c31800 20 rados->read ofs=0 len=0 2024-09-12T17:37:01.642 INFO:tasks.workunit.client.0.smithi037.stderr: -126> 2024-09-12T17:37:01.458+0000 7f3c43c31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:01.642 INFO:tasks.workunit.client.0.smithi037.stderr: -125> 2024-09-12T17:37:01.458+0000 7f3c43c31800 20 rados->read ofs=0 len=0 2024-09-12T17:37:01.642 INFO:tasks.workunit.client.0.smithi037.stderr: -124> 2024-09-12T17:37:01.458+0000 7f3c43c31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:01.642 INFO:tasks.workunit.client.0.smithi037.stderr: -123> 2024-09-12T17:37:01.458+0000 7f3c43c31800 20 started sync module instance, tier type = 2024-09-12T17:37:01.642 INFO:tasks.workunit.client.0.smithi037.stderr: -122> 2024-09-12T17:37:01.458+0000 7f3c43c31800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:37:01.642 INFO:tasks.workunit.client.0.smithi037.stderr: -121> 2024-09-12T17:37:01.468+0000 7f3c43c31800 20 add_watcher() i=0 2024-09-12T17:37:01.642 INFO:tasks.workunit.client.0.smithi037.stderr: -120> 2024-09-12T17:37:01.468+0000 7f3c43c31800 20 add_watcher() i=1 2024-09-12T17:37:01.642 INFO:tasks.workunit.client.0.smithi037.stderr: -119> 2024-09-12T17:37:01.468+0000 7f3c43c31800 20 add_watcher() i=2 2024-09-12T17:37:01.642 INFO:tasks.workunit.client.0.smithi037.stderr: -118> 2024-09-12T17:37:01.468+0000 7f3c43c31800 20 add_watcher() i=3 2024-09-12T17:37:01.642 INFO:tasks.workunit.client.0.smithi037.stderr: -117> 2024-09-12T17:37:01.468+0000 7f3c43c31800 20 add_watcher() i=4 2024-09-12T17:37:01.643 INFO:tasks.workunit.client.0.smithi037.stderr: -116> 2024-09-12T17:37:01.468+0000 7f3c43c31800 20 add_watcher() i=5 2024-09-12T17:37:01.643 INFO:tasks.workunit.client.0.smithi037.stderr: -115> 2024-09-12T17:37:01.468+0000 7f3c43c31800 20 add_watcher() i=6 2024-09-12T17:37:01.643 INFO:tasks.workunit.client.0.smithi037.stderr: -114> 2024-09-12T17:37:01.469+0000 7f3c43c31800 20 add_watcher() i=7 2024-09-12T17:37:01.643 INFO:tasks.workunit.client.0.smithi037.stderr: -113> 2024-09-12T17:37:01.469+0000 7f3c43c31800 2 all 8 watchers are set, enabling cache 2024-09-12T17:37:01.643 INFO:tasks.workunit.client.0.smithi037.stderr: -112> 2024-09-12T17:37:01.471+0000 7f3c43c31800 5 AuthRegistry(0x7ffc9737ae30) adding auth protocol: cephx 2024-09-12T17:37:01.643 INFO:tasks.workunit.client.0.smithi037.stderr: -111> 2024-09-12T17:37:01.471+0000 7f3c43c31800 5 AuthRegistry(0x7ffc9737ae30) adding auth protocol: cephx 2024-09-12T17:37:01.643 INFO:tasks.workunit.client.0.smithi037.stderr: -110> 2024-09-12T17:37:01.471+0000 7f3c43c31800 5 AuthRegistry(0x7ffc9737ae30) adding auth protocol: cephx 2024-09-12T17:37:01.643 INFO:tasks.workunit.client.0.smithi037.stderr: -109> 2024-09-12T17:37:01.471+0000 7f3c43c31800 5 AuthRegistry(0x7ffc9737ae30) adding con mode: secure 2024-09-12T17:37:01.643 INFO:tasks.workunit.client.0.smithi037.stderr: -108> 2024-09-12T17:37:01.471+0000 7f3c43c31800 5 AuthRegistry(0x7ffc9737ae30) adding con mode: crc 2024-09-12T17:37:01.643 INFO:tasks.workunit.client.0.smithi037.stderr: -107> 2024-09-12T17:37:01.471+0000 7f3c43c31800 5 AuthRegistry(0x7ffc9737ae30) adding con mode: secure 2024-09-12T17:37:01.643 INFO:tasks.workunit.client.0.smithi037.stderr: -106> 2024-09-12T17:37:01.471+0000 7f3c43c31800 5 AuthRegistry(0x7ffc9737ae30) adding con mode: crc 2024-09-12T17:37:01.643 INFO:tasks.workunit.client.0.smithi037.stderr: -105> 2024-09-12T17:37:01.471+0000 7f3c43c31800 5 AuthRegistry(0x7ffc9737ae30) adding con mode: secure 2024-09-12T17:37:01.643 INFO:tasks.workunit.client.0.smithi037.stderr: -104> 2024-09-12T17:37:01.471+0000 7f3c43c31800 5 AuthRegistry(0x7ffc9737ae30) adding con mode: crc 2024-09-12T17:37:01.643 INFO:tasks.workunit.client.0.smithi037.stderr: -103> 2024-09-12T17:37:01.471+0000 7f3c43c31800 5 AuthRegistry(0x7ffc9737ae30) adding con mode: crc 2024-09-12T17:37:01.643 INFO:tasks.workunit.client.0.smithi037.stderr: -102> 2024-09-12T17:37:01.471+0000 7f3c43c31800 5 AuthRegistry(0x7ffc9737ae30) adding con mode: secure 2024-09-12T17:37:01.644 INFO:tasks.workunit.client.0.smithi037.stderr: -101> 2024-09-12T17:37:01.471+0000 7f3c43c31800 5 AuthRegistry(0x7ffc9737ae30) adding con mode: crc 2024-09-12T17:37:01.644 INFO:tasks.workunit.client.0.smithi037.stderr: -100> 2024-09-12T17:37:01.471+0000 7f3c43c31800 5 AuthRegistry(0x7ffc9737ae30) adding con mode: secure 2024-09-12T17:37:01.644 INFO:tasks.workunit.client.0.smithi037.stderr: -99> 2024-09-12T17:37:01.471+0000 7f3c43c31800 5 AuthRegistry(0x7ffc9737ae30) adding con mode: crc 2024-09-12T17:37:01.644 INFO:tasks.workunit.client.0.smithi037.stderr: -98> 2024-09-12T17:37:01.471+0000 7f3af57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:37:01.644 INFO:tasks.workunit.client.0.smithi037.stderr: -97> 2024-09-12T17:37:01.471+0000 7f3c43c31800 5 AuthRegistry(0x7ffc9737ae30) adding con mode: secure 2024-09-12T17:37:01.644 INFO:tasks.workunit.client.0.smithi037.stderr: -96> 2024-09-12T17:37:01.471+0000 7f3c43c31800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:37:01.644 INFO:tasks.workunit.client.0.smithi037.stderr: -95> 2024-09-12T17:37:01.471+0000 7f3c43c31800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:37:01.644 INFO:tasks.workunit.client.0.smithi037.stderr: -94> 2024-09-12T17:37:01.471+0000 7f3c43c31800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:37:01.644 INFO:tasks.workunit.client.0.smithi037.stderr: -93> 2024-09-12T17:37:01.471+0000 7f3c43c31800 5 asok(0x5597c8588730) register_command cache list hook 0x5597c887f3b0 2024-09-12T17:37:01.644 INFO:tasks.workunit.client.0.smithi037.stderr: -92> 2024-09-12T17:37:01.471+0000 7f3c43c31800 5 asok(0x5597c8588730) register_command cache inspect hook 0x5597c887f3b0 2024-09-12T17:37:01.644 INFO:tasks.workunit.client.0.smithi037.stderr: -91> 2024-09-12T17:37:01.471+0000 7f3c43c31800 5 asok(0x5597c8588730) register_command cache erase hook 0x5597c887f3b0 2024-09-12T17:37:01.644 INFO:tasks.workunit.client.0.smithi037.stderr: -90> 2024-09-12T17:37:01.471+0000 7f3c43c31800 5 asok(0x5597c8588730) register_command cache zap hook 0x5597c887f3b0 2024-09-12T17:37:01.644 INFO:tasks.workunit.client.0.smithi037.stderr: -89> 2024-09-12T17:37:01.472+0000 7f3c43c31800 5 note: GC not initialized 2024-09-12T17:37:01.644 INFO:tasks.workunit.client.0.smithi037.stderr: -88> 2024-09-12T17:37:01.472+0000 7f3a6ffff640 20 reqs_thread_entry: start 2024-09-12T17:37:01.645 INFO:tasks.workunit.client.0.smithi037.stderr: -87> 2024-09-12T17:37:01.472+0000 7f3c43c31800 5 asok(0x5597c8588730) register_command sync trace show hook 0x7f3c3001c450 2024-09-12T17:37:01.645 INFO:tasks.workunit.client.0.smithi037.stderr: -86> 2024-09-12T17:37:01.472+0000 7f3c43c31800 5 asok(0x5597c8588730) register_command sync trace history hook 0x7f3c3001c450 2024-09-12T17:37:01.645 INFO:tasks.workunit.client.0.smithi037.stderr: -85> 2024-09-12T17:37:01.472+0000 7f3c43c31800 5 asok(0x5597c8588730) register_command sync trace active hook 0x7f3c3001c450 2024-09-12T17:37:01.645 INFO:tasks.workunit.client.0.smithi037.stderr: -84> 2024-09-12T17:37:01.472+0000 7f3c43c31800 5 asok(0x5597c8588730) register_command sync trace active_short hook 0x7f3c3001c450 2024-09-12T17:37:01.645 INFO:tasks.workunit.client.0.smithi037.stderr: -83> 2024-09-12T17:37:01.472+0000 7f3c43c31800 20 init_complete bucket index max shards: 11 2024-09-12T17:37:01.645 INFO:tasks.workunit.client.0.smithi037.stderr: -82> 2024-09-12T17:37:01.472+0000 7f3c43c31800 20 Filter name: none 2024-09-12T17:37:01.645 INFO:tasks.workunit.client.0.smithi037.stderr: -81> 2024-09-12T17:37:01.472+0000 7f3a6dffb640 20 reqs_thread_entry: start 2024-09-12T17:37:01.645 INFO:tasks.workunit.client.0.smithi037.stderr: -80> 2024-09-12T17:37:01.472+0000 7f3c43c31800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:37:01.645 INFO:tasks.workunit.client.0.smithi037.stderr: -79> 2024-09-12T17:37:01.472+0000 7f3c43c31800 20 rados->read ofs=0 len=0 2024-09-12T17:37:01.645 INFO:tasks.workunit.client.0.smithi037.stderr: -78> 2024-09-12T17:37:01.473+0000 7f3c43c31800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:37:01.645 INFO:tasks.workunit.client.0.smithi037.stderr: -77> 2024-09-12T17:37:01.473+0000 7f3c43c31800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:37:01.645 INFO:tasks.workunit.client.0.smithi037.stderr: -76> 2024-09-12T17:37:01.473+0000 7f3c43c31800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:37:01.645 INFO:tasks.workunit.client.0.smithi037.stderr: -75> 2024-09-12T17:37:01.473+0000 7f3c43c31800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 : miss 2024-09-12T17:37:01.646 INFO:tasks.workunit.client.0.smithi037.stderr: -74> 2024-09-12T17:37:01.473+0000 7f3c43c31800 20 rados->read ofs=0 len=0 2024-09-12T17:37:01.646 INFO:tasks.workunit.client.0.smithi037.stderr: -73> 2024-09-12T17:37:01.473+0000 7f3c43c31800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:37:01.646 INFO:tasks.workunit.client.0.smithi037.stderr: -72> 2024-09-12T17:37:01.473+0000 7f3c43c31800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 info.flags=0x17 2024-09-12T17:37:01.646 INFO:tasks.workunit.client.0.smithi037.stderr: -71> 2024-09-12T17:37:01.473+0000 7f3c43c31800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 to cache LRU end 2024-09-12T17:37:01.646 INFO:tasks.workunit.client.0.smithi037.stderr: -70> 2024-09-12T17:37:01.473+0000 7f3c43c31800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:37:01.646 INFO:tasks.workunit.client.0.smithi037.stderr: -69> 2024-09-12T17:37:01.473+0000 7f3c43c31800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:37:01.646 INFO:tasks.workunit.client.0.smithi037.stderr: -68> 2024-09-12T17:37:01.473+0000 7f3c43c31800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 2024-09-12T17:37:01.646 INFO:tasks.workunit.client.0.smithi037.stderr: -67> 2024-09-12T17:37:01.479+0000 7f3c43c31800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 info.flags=0x17 2024-09-12T17:37:01.646 INFO:tasks.workunit.client.0.smithi037.stderr: -66> 2024-09-12T17:37:01.479+0000 7f3c43c31800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 to cache LRU end 2024-09-12T17:37:01.646 INFO:tasks.workunit.client.0.smithi037.stderr: -65> 2024-09-12T17:37:01.479+0000 7f3c43c31800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:37:01.646 INFO:tasks.workunit.client.0.smithi037.stderr: -64> 2024-09-12T17:37:01.479+0000 7f3c43c31800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18, ofs0, ns] 2024-09-12T17:37:01.646 INFO:tasks.workunit.client.0.smithi037.stderr: -63> 2024-09-12T17:37:01.479+0000 7f3b21ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497017 cookie 94110392943808 notifier 7616 bl.length()=911 2024-09-12T17:37:01.646 INFO:tasks.workunit.client.0.smithi037.stderr: -62> 2024-09-12T17:37:01.479+0000 7f3b21ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 info.flags=0x17 2024-09-12T17:37:01.646 INFO:tasks.workunit.client.0.smithi037.stderr: -61> 2024-09-12T17:37:01.479+0000 7f3b21ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 to cache LRU end 2024-09-12T17:37:01.647 INFO:tasks.workunit.client.0.smithi037.stderr: -60> 2024-09-12T17:37:01.479+0000 7f3b21ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:37:01.647 INFO:tasks.workunit.client.0.smithi037.stderr: -59> 2024-09-12T17:37:01.481+0000 7f3c43c31800 20 handle_bi_update(): bucket=:a-bucket[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18]): orig_sources= new_sources= 2024-09-12T17:37:01.647 INFO:tasks.workunit.client.0.smithi037.stderr: -58> 2024-09-12T17:37:01.481+0000 7f3c43c31800 20 handle_bi_update(): bucket=:a-bucket[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18]): potential sources added=[] removed=[] 2024-09-12T17:37:01.647 INFO:tasks.workunit.client.0.smithi037.stderr: -57> 2024-09-12T17:37:01.481+0000 7f3c43c31800 20 handle_bi_update(): bucket=:a-bucket[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18]): orig_dests= new_dests= 2024-09-12T17:37:01.647 INFO:tasks.workunit.client.0.smithi037.stderr: -56> 2024-09-12T17:37:01.481+0000 7f3c43c31800 20 handle_bi_update(): bucket=:a-bucket[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18]): potential dests added=[] removed=[] 2024-09-12T17:37:01.647 INFO:tasks.workunit.client.0.smithi037.stderr: -55> 2024-09-12T17:37:01.486+0000 7f3c43c31800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.3.0 2024-09-12T17:37:01.647 INFO:tasks.workunit.client.0.smithi037.stderr: -54> 2024-09-12T17:37:01.486+0000 7f3c43c31800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.3.0 2024-09-12T17:37:01.647 INFO:tasks.workunit.client.0.smithi037.stderr: -53> 2024-09-12T17:37:01.486+0000 7f3c43c31800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.3.1 2024-09-12T17:37:01.647 INFO:tasks.workunit.client.0.smithi037.stderr: -52> 2024-09-12T17:37:01.486+0000 7f3c43c31800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.3.1 2024-09-12T17:37:01.647 INFO:tasks.workunit.client.0.smithi037.stderr: -51> 2024-09-12T17:37:01.486+0000 7f3c43c31800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.3.2 2024-09-12T17:37:01.647 INFO:tasks.workunit.client.0.smithi037.stderr: -50> 2024-09-12T17:37:01.486+0000 7f3c43c31800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.3.2 2024-09-12T17:37:01.647 INFO:tasks.workunit.client.0.smithi037.stderr: -49> 2024-09-12T17:37:01.486+0000 7f3c43c31800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.3.3 2024-09-12T17:37:01.647 INFO:tasks.workunit.client.0.smithi037.stderr: -48> 2024-09-12T17:37:01.486+0000 7f3c43c31800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.3.3 2024-09-12T17:37:01.648 INFO:tasks.workunit.client.0.smithi037.stderr: -47> 2024-09-12T17:37:01.486+0000 7f3c43c31800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.3.4 2024-09-12T17:37:01.648 INFO:tasks.workunit.client.0.smithi037.stderr: -46> 2024-09-12T17:37:01.486+0000 7f3c43c31800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.3.4 2024-09-12T17:37:01.648 INFO:tasks.workunit.client.0.smithi037.stderr: -45> 2024-09-12T17:37:01.486+0000 7f3c43c31800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.3.5 2024-09-12T17:37:01.648 INFO:tasks.workunit.client.0.smithi037.stderr: -44> 2024-09-12T17:37:01.486+0000 7f3c43c31800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.3.5 2024-09-12T17:37:01.648 INFO:tasks.workunit.client.0.smithi037.stderr: -43> 2024-09-12T17:37:01.486+0000 7f3c43c31800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.3.6 2024-09-12T17:37:01.648 INFO:tasks.workunit.client.0.smithi037.stderr: -42> 2024-09-12T17:37:01.486+0000 7f3c43c31800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.3.6 2024-09-12T17:37:01.648 INFO:tasks.workunit.client.0.smithi037.stderr: -41> 2024-09-12T17:37:01.486+0000 7f3c43c31800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.3.7 2024-09-12T17:37:01.648 INFO:tasks.workunit.client.0.smithi037.stderr: -40> 2024-09-12T17:37:01.486+0000 7f3c43c31800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.3.7 2024-09-12T17:37:01.648 INFO:tasks.workunit.client.0.smithi037.stderr: -39> 2024-09-12T17:37:01.486+0000 7f3c43c31800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.3.8 2024-09-12T17:37:01.648 INFO:tasks.workunit.client.0.smithi037.stderr: -38> 2024-09-12T17:37:01.486+0000 7f3c43c31800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.3.8 2024-09-12T17:37:01.648 INFO:tasks.workunit.client.0.smithi037.stderr: -37> 2024-09-12T17:37:01.486+0000 7f3c43c31800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.3.9 2024-09-12T17:37:01.648 INFO:tasks.workunit.client.0.smithi037.stderr: -36> 2024-09-12T17:37:01.486+0000 7f3c43c31800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.3.9 2024-09-12T17:37:01.648 INFO:tasks.workunit.client.0.smithi037.stderr: -35> 2024-09-12T17:37:01.486+0000 7f3c43c31800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.3.10 2024-09-12T17:37:01.648 INFO:tasks.workunit.client.0.smithi037.stderr: -34> 2024-09-12T17:37:01.486+0000 7f3c43c31800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.3.10 2024-09-12T17:37:01.649 INFO:tasks.workunit.client.0.smithi037.stderr: -33> 2024-09-12T17:37:01.486+0000 7f3c43c31800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.3.11 2024-09-12T17:37:01.649 INFO:tasks.workunit.client.0.smithi037.stderr: -32> 2024-09-12T17:37:01.486+0000 7f3c43c31800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.3.11 2024-09-12T17:37:01.649 INFO:tasks.workunit.client.0.smithi037.stderr: -31> 2024-09-12T17:37:01.486+0000 7f3c43c31800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.3.12 2024-09-12T17:37:01.649 INFO:tasks.workunit.client.0.smithi037.stderr: -30> 2024-09-12T17:37:01.486+0000 7f3c43c31800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.3.12 2024-09-12T17:37:01.649 INFO:tasks.workunit.client.0.smithi037.stderr: -29> 2024-09-12T17:37:01.486+0000 7f3c43c31800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.3.13 2024-09-12T17:37:01.649 INFO:tasks.workunit.client.0.smithi037.stderr: -28> 2024-09-12T17:37:01.486+0000 7f3c43c31800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.3.13 2024-09-12T17:37:01.649 INFO:tasks.workunit.client.0.smithi037.stderr: -27> 2024-09-12T17:37:01.486+0000 7f3c43c31800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.0 2024-09-12T17:37:01.649 INFO:tasks.workunit.client.0.smithi037.stderr: -26> 2024-09-12T17:37:01.486+0000 7f3c43c31800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.0 2024-09-12T17:37:01.649 INFO:tasks.workunit.client.0.smithi037.stderr: -25> 2024-09-12T17:37:01.487+0000 7f3c43c31800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.1 2024-09-12T17:37:01.649 INFO:tasks.workunit.client.0.smithi037.stderr: -24> 2024-09-12T17:37:01.487+0000 7f3c43c31800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.1 2024-09-12T17:37:01.649 INFO:tasks.workunit.client.0.smithi037.stderr: -23> 2024-09-12T17:37:01.487+0000 7f3c43c31800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.2 2024-09-12T17:37:01.649 INFO:tasks.workunit.client.0.smithi037.stderr: -22> 2024-09-12T17:37:01.487+0000 7f3c43c31800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.2 2024-09-12T17:37:01.649 INFO:tasks.workunit.client.0.smithi037.stderr: -21> 2024-09-12T17:37:01.488+0000 7f3c43c31800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.3 2024-09-12T17:37:01.649 INFO:tasks.workunit.client.0.smithi037.stderr: -20> 2024-09-12T17:37:01.488+0000 7f3c43c31800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.3 2024-09-12T17:37:01.650 INFO:tasks.workunit.client.0.smithi037.stderr: -19> 2024-09-12T17:37:01.489+0000 7f3c43c31800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.4 2024-09-12T17:37:01.650 INFO:tasks.workunit.client.0.smithi037.stderr: -18> 2024-09-12T17:37:01.489+0000 7f3c43c31800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.4 2024-09-12T17:37:01.650 INFO:tasks.workunit.client.0.smithi037.stderr: -17> 2024-09-12T17:37:01.489+0000 7f3c43c31800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.5 2024-09-12T17:37:01.650 INFO:tasks.workunit.client.0.smithi037.stderr: -16> 2024-09-12T17:37:01.489+0000 7f3c43c31800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.5 2024-09-12T17:37:01.650 INFO:tasks.workunit.client.0.smithi037.stderr: -15> 2024-09-12T17:37:01.490+0000 7f3c43c31800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.6 2024-09-12T17:37:01.650 INFO:tasks.workunit.client.0.smithi037.stderr: -14> 2024-09-12T17:37:01.490+0000 7f3c43c31800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.6 2024-09-12T17:37:01.650 INFO:tasks.workunit.client.0.smithi037.stderr: -13> 2024-09-12T17:37:01.490+0000 7f3c43c31800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.7 2024-09-12T17:37:01.650 INFO:tasks.workunit.client.0.smithi037.stderr: -12> 2024-09-12T17:37:01.490+0000 7f3c43c31800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.7 2024-09-12T17:37:01.650 INFO:tasks.workunit.client.0.smithi037.stderr: -11> 2024-09-12T17:37:01.491+0000 7f3c43c31800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.8 2024-09-12T17:37:01.650 INFO:tasks.workunit.client.0.smithi037.stderr: -10> 2024-09-12T17:37:01.491+0000 7f3c43c31800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.8 2024-09-12T17:37:01.650 INFO:tasks.workunit.client.0.smithi037.stderr: -9> 2024-09-12T17:37:01.491+0000 7f3c43c31800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.9 2024-09-12T17:37:01.650 INFO:tasks.workunit.client.0.smithi037.stderr: -8> 2024-09-12T17:37:01.491+0000 7f3c43c31800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.9 2024-09-12T17:37:01.650 INFO:tasks.workunit.client.0.smithi037.stderr: -7> 2024-09-12T17:37:01.492+0000 7f3c43c31800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.10 2024-09-12T17:37:01.650 INFO:tasks.workunit.client.0.smithi037.stderr: -6> 2024-09-12T17:37:01.492+0000 7f3c43c31800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.10 2024-09-12T17:37:01.650 INFO:tasks.workunit.client.0.smithi037.stderr: -5> 2024-09-12T17:37:01.492+0000 7f3c43c31800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.11 2024-09-12T17:37:01.651 INFO:tasks.workunit.client.0.smithi037.stderr: -4> 2024-09-12T17:37:01.492+0000 7f3c43c31800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.11 2024-09-12T17:37:01.651 INFO:tasks.workunit.client.0.smithi037.stderr: -3> 2024-09-12T17:37:01.493+0000 7f3c43c31800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.12 2024-09-12T17:37:01.651 INFO:tasks.workunit.client.0.smithi037.stderr: -2> 2024-09-12T17:37:01.493+0000 7f3c43c31800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.12 2024-09-12T17:37:01.651 INFO:tasks.workunit.client.0.smithi037.stderr: -1> 2024-09-12T17:37:01.495+0000 7f3c43c31800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f3c43c31800 time 2024-09-12T17:37:01.496805+0000 2024-09-12T17:37:01.651 INFO:tasks.workunit.client.0.smithi037.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:37:01.651 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:37:01.651 INFO:tasks.workunit.client.0.smithi037.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:37:01.651 INFO:tasks.workunit.client.0.smithi037.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f3c4498c71a] 2024-09-12T17:37:01.651 INFO:tasks.workunit.client.0.smithi037.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f3c4498c8d8] 2024-09-12T17:37:01.651 INFO:tasks.workunit.client.0.smithi037.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5597c7860841] 2024-09-12T17:37:01.651 INFO:tasks.workunit.client.0.smithi037.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x5597c786f734] 2024-09-12T17:37:01.651 INFO:tasks.workunit.client.0.smithi037.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x5597c78705d4] 2024-09-12T17:37:01.651 INFO:tasks.workunit.client.0.smithi037.stderr: 6: main() 2024-09-12T17:37:01.651 INFO:tasks.workunit.client.0.smithi037.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f3c43629590] 2024-09-12T17:37:01.651 INFO:tasks.workunit.client.0.smithi037.stderr: 8: __libc_start_main() 2024-09-12T17:37:01.652 INFO:tasks.workunit.client.0.smithi037.stderr: 9: _start() 2024-09-12T17:37:01.652 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:37:01.652 INFO:tasks.workunit.client.0.smithi037.stderr: 0> 2024-09-12T17:37:01.496+0000 7f3c43c31800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:37:01.652 INFO:tasks.workunit.client.0.smithi037.stderr: in thread 7f3c43c31800 thread_name:radosgw-admin 2024-09-12T17:37:01.652 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:37:01.652 INFO:tasks.workunit.client.0.smithi037.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:37:01.652 INFO:tasks.workunit.client.0.smithi037.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f3c4363e6f0] 2024-09-12T17:37:01.652 INFO:tasks.workunit.client.0.smithi037.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f3c4368b99c] 2024-09-12T17:37:01.652 INFO:tasks.workunit.client.0.smithi037.stderr: 3: raise() 2024-09-12T17:37:01.652 INFO:tasks.workunit.client.0.smithi037.stderr: 4: abort() 2024-09-12T17:37:01.652 INFO:tasks.workunit.client.0.smithi037.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f3c4498c774] 2024-09-12T17:37:01.652 INFO:tasks.workunit.client.0.smithi037.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f3c4498c8d8] 2024-09-12T17:37:01.652 INFO:tasks.workunit.client.0.smithi037.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5597c7860841] 2024-09-12T17:37:01.652 INFO:tasks.workunit.client.0.smithi037.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x5597c786f734] 2024-09-12T17:37:01.652 INFO:tasks.workunit.client.0.smithi037.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x5597c78705d4] 2024-09-12T17:37:01.653 INFO:tasks.workunit.client.0.smithi037.stderr: 10: main() 2024-09-12T17:37:01.653 INFO:tasks.workunit.client.0.smithi037.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f3c43629590] 2024-09-12T17:37:01.653 INFO:tasks.workunit.client.0.smithi037.stderr: 12: __libc_start_main() 2024-09-12T17:37:01.653 INFO:tasks.workunit.client.0.smithi037.stderr: 13: _start() 2024-09-12T17:37:01.653 INFO:tasks.workunit.client.0.smithi037.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:37:01.653 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:37:01.653 INFO:tasks.workunit.client.0.smithi037.stderr:--- logging levels --- 2024-09-12T17:37:01.653 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 none 2024-09-12T17:37:01.653 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 lockdep 2024-09-12T17:37:01.653 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 context 2024-09-12T17:37:01.653 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 1 crush 2024-09-12T17:37:01.653 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mds 2024-09-12T17:37:01.653 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mds_balancer 2024-09-12T17:37:01.653 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mds_locker 2024-09-12T17:37:01.653 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mds_log 2024-09-12T17:37:01.654 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mds_log_expire 2024-09-12T17:37:01.654 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mds_migrator 2024-09-12T17:37:01.654 INFO:tasks.workunit.client.0.smithi037.stderr: 3/ 5 mds_quiesce 2024-09-12T17:37:01.654 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 buffer 2024-09-12T17:37:01.654 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 timer 2024-09-12T17:37:01.654 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 filer 2024-09-12T17:37:01.654 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 striper 2024-09-12T17:37:01.654 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 objecter 2024-09-12T17:37:01.654 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 rados 2024-09-12T17:37:01.654 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 rbd 2024-09-12T17:37:01.654 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 rbd_mirror 2024-09-12T17:37:01.654 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 rbd_replay 2024-09-12T17:37:01.654 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 rbd_pwl 2024-09-12T17:37:01.655 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 journaler 2024-09-12T17:37:01.655 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 objectcacher 2024-09-12T17:37:01.655 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:37:01.655 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 client 2024-09-12T17:37:01.655 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 osd 2024-09-12T17:37:01.655 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 optracker 2024-09-12T17:37:01.655 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 objclass 2024-09-12T17:37:01.655 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 3 filestore 2024-09-12T17:37:01.655 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 3 journal 2024-09-12T17:37:01.655 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 0 ms 2024-09-12T17:37:01.655 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mon 2024-09-12T17:37:01.655 INFO:tasks.workunit.client.0.smithi037.stderr: 0/10 monc 2024-09-12T17:37:01.655 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 paxos 2024-09-12T17:37:01.655 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 tp 2024-09-12T17:37:01.655 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 auth 2024-09-12T17:37:01.656 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 crypto 2024-09-12T17:37:01.656 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 1 finisher 2024-09-12T17:37:01.656 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 1 reserver 2024-09-12T17:37:01.656 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 heartbeatmap 2024-09-12T17:37:01.656 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 perfcounter 2024-09-12T17:37:01.656 INFO:tasks.workunit.client.0.smithi037.stderr: 20/20 rgw 2024-09-12T17:37:01.656 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 rgw_sync 2024-09-12T17:37:01.656 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 rgw_datacache 2024-09-12T17:37:01.656 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 rgw_access 2024-09-12T17:37:01.656 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:37:01.656 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 rgw_flight 2024-09-12T17:37:01.656 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:37:01.656 INFO:tasks.workunit.client.0.smithi037.stderr: 20/20 rgw_notification 2024-09-12T17:37:01.656 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 javaclient 2024-09-12T17:37:01.656 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 asok 2024-09-12T17:37:01.657 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 1 throttle 2024-09-12T17:37:01.657 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 0 refs 2024-09-12T17:37:01.657 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 compressor 2024-09-12T17:37:01.657 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 bluestore 2024-09-12T17:37:01.657 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 bluefs 2024-09-12T17:37:01.657 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 3 bdev 2024-09-12T17:37:01.657 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 kstore 2024-09-12T17:37:01.657 INFO:tasks.workunit.client.0.smithi037.stderr: 4/ 5 rocksdb 2024-09-12T17:37:01.657 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 fuse 2024-09-12T17:37:01.657 INFO:tasks.workunit.client.0.smithi037.stderr: 2/ 5 mgr 2024-09-12T17:37:01.657 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mgrc 2024-09-12T17:37:01.657 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 dpdk 2024-09-12T17:37:01.657 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 eventtrace 2024-09-12T17:37:01.658 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 prioritycache 2024-09-12T17:37:01.658 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 test 2024-09-12T17:37:01.658 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:37:01.658 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 cephsqlite 2024-09-12T17:37:01.658 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:37:01.658 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore 2024-09-12T17:37:01.658 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_onode 2024-09-12T17:37:01.658 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_odata 2024-09-12T17:37:01.658 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_omap 2024-09-12T17:37:01.658 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_tm 2024-09-12T17:37:01.658 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_t 2024-09-12T17:37:01.658 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:37:01.658 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_epm 2024-09-12T17:37:01.658 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_lba 2024-09-12T17:37:01.658 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:37:01.659 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_cache 2024-09-12T17:37:01.659 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_journal 2024-09-12T17:37:01.659 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_device 2024-09-12T17:37:01.659 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_backref 2024-09-12T17:37:01.659 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 alienstore 2024-09-12T17:37:01.659 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mclock 2024-09-12T17:37:01.659 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 cyanstore 2024-09-12T17:37:01.659 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 ceph_exporter 2024-09-12T17:37:01.659 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 memstore 2024-09-12T17:37:01.659 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 trace 2024-09-12T17:37:01.659 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 ceph_dedup 2024-09-12T17:37:01.659 INFO:tasks.workunit.client.0.smithi037.stderr: -2/-2 (syslog threshold) 2024-09-12T17:37:01.659 INFO:tasks.workunit.client.0.smithi037.stderr: 99/99 (stderr threshold) 2024-09-12T17:37:01.659 INFO:tasks.workunit.client.0.smithi037.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:37:01.659 INFO:tasks.workunit.client.0.smithi037.stderr: 7f3a6dffb640 / http_manager 2024-09-12T17:37:01.660 INFO:tasks.workunit.client.0.smithi037.stderr: 7f3a6ffff640 / http_manager 2024-09-12T17:37:01.660 INFO:tasks.workunit.client.0.smithi037.stderr: 7f3af57e2640 / rgw_dt_lg_renew 2024-09-12T17:37:01.660 INFO:tasks.workunit.client.0.smithi037.stderr: 7f3b20ff9640 / ms_dispatch 2024-09-12T17:37:01.660 INFO:tasks.workunit.client.0.smithi037.stderr: 7f3b21ffb640 / io_context_pool 2024-09-12T17:37:01.660 INFO:tasks.workunit.client.0.smithi037.stderr: 7f3b227fc640 / io_context_pool 2024-09-12T17:37:01.660 INFO:tasks.workunit.client.0.smithi037.stderr: 7f3b28e01640 / ms_dispatch 2024-09-12T17:37:01.660 INFO:tasks.workunit.client.0.smithi037.stderr: 7f3b2b606640 / ms_dispatch 2024-09-12T17:37:01.660 INFO:tasks.workunit.client.0.smithi037.stderr: 7f3b2ce09640 / io_context_pool 2024-09-12T17:37:01.660 INFO:tasks.workunit.client.0.smithi037.stderr: 7f3c3e78a640 / msgr-worker-2 2024-09-12T17:37:01.660 INFO:tasks.workunit.client.0.smithi037.stderr: 7f3c3ef8b640 / msgr-worker-1 2024-09-12T17:37:01.660 INFO:tasks.workunit.client.0.smithi037.stderr: 7f3c3f78c640 / msgr-worker-0 2024-09-12T17:37:01.660 INFO:tasks.workunit.client.0.smithi037.stderr: 7f3c3ff8d640 / io_context_pool 2024-09-12T17:37:01.660 INFO:tasks.workunit.client.0.smithi037.stderr: 7f3c43c31800 / radosgw-admin 2024-09-12T17:37:01.660 INFO:tasks.workunit.client.0.smithi037.stderr: max_recent 500 2024-09-12T17:37:01.661 INFO:tasks.workunit.client.0.smithi037.stderr: max_new 1000 2024-09-12T17:37:01.661 INFO:tasks.workunit.client.0.smithi037.stderr: log_file /var/lib/ceph/crash/2024-09-12T17:37:01.498471Z_4f933404-b296-4b67-8d3e-4340b08b3fe3/log 2024-09-12T17:37:01.661 INFO:tasks.workunit.client.0.smithi037.stderr:--- end dump of recent events --- 2024-09-12T17:37:01.661 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T17:37:01.662 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:37:01.662 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:37:01.662 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.577+0000 7fa18b13c800 20 rados->read ofs=0 len=0 2024-09-12T17:37:01.662 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.579+0000 7fa18b13c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:01.663 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.579+0000 7fa18b13c800 20 realm 2024-09-12T17:37:01.663 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.579+0000 7fa18b13c800 20 rados->read ofs=0 len=0 2024-09-12T17:37:01.663 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.579+0000 7fa18b13c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:01.663 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.579+0000 7fa18b13c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:37:01.663 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.579+0000 7fa18b13c800 20 rados->read ofs=0 len=0 2024-09-12T17:37:01.663 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.579+0000 7fa18b13c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:01.663 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.579+0000 7fa18b13c800 20 rados->read ofs=0 len=0 2024-09-12T17:37:01.663 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.580+0000 7fa18b13c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:37:01.663 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.580+0000 7fa18b13c800 20 rados->read ofs=0 len=0 2024-09-12T17:37:01.663 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.580+0000 7fa18b13c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:37:01.663 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.580+0000 7fa18b13c800 20 searching for the correct realm 2024-09-12T17:37:01.663 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.582+0000 7fa186e81640 0 -- 172.21.15.37:0/1542065152 >> [v2:172.21.15.37:6800/1206746176,v1:172.21.15.37:6801/1206746176] conn(0x7fa180027040 msgr2=0x7fa18002c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:37:01.789 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.787+0000 7fa187682640 0 -- 172.21.15.37:0/1542065152 >> [v2:172.21.15.40:6818/1210108009,v1:172.21.15.40:6819/1210108009] conn(0x7fa17c059960 msgr2=0x7fa17c04f420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:37:01.795 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.793+0000 7fa18b13c800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:37:01.795 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.793+0000 7fa18b13c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:37:01.795 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.793+0000 7fa18b13c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:37:01.795 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.793+0000 7fa18b13c800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:37:01.795 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.793+0000 7fa18b13c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:37:01.795 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.793+0000 7fa18b13c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:37:01.795 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.793+0000 7fa18b13c800 20 rados->read ofs=0 len=0 2024-09-12T17:37:01.795 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.793+0000 7fa18b13c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:01.795 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.793+0000 7fa18b13c800 20 rados->read ofs=0 len=0 2024-09-12T17:37:01.796 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.794+0000 7fa18b13c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:37:01.796 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.794+0000 7fa18b13c800 20 rados->read ofs=0 len=0 2024-09-12T17:37:01.796 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.794+0000 7fa18b13c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:37:01.797 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.794+0000 7fa18b13c800 20 zone default found 2024-09-12T17:37:01.797 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.794+0000 7fa18b13c800 4 Realm: () 2024-09-12T17:37:01.797 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.794+0000 7fa18b13c800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:37:01.797 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.794+0000 7fa18b13c800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:37:01.797 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.794+0000 7fa18b13c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:37:01.797 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.794+0000 7fa18b13c800 20 zonegroup default 2024-09-12T17:37:01.797 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.794+0000 7fa18b13c800 20 rados->read ofs=0 len=0 2024-09-12T17:37:01.797 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.794+0000 7fa18b13c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:01.797 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.794+0000 7fa18b13c800 20 rados->read ofs=0 len=0 2024-09-12T17:37:01.798 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.795+0000 7fa18b13c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:01.798 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.795+0000 7fa18b13c800 20 rados->read ofs=0 len=0 2024-09-12T17:37:01.798 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.795+0000 7fa18b13c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:01.798 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.795+0000 7fa18b13c800 20 started sync module instance, tier type = 2024-09-12T17:37:01.798 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.795+0000 7fa18b13c800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:37:01.808 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.806+0000 7fa18b13c800 20 add_watcher() i=0 2024-09-12T17:37:01.808 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.806+0000 7fa18b13c800 20 add_watcher() i=1 2024-09-12T17:37:01.808 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.806+0000 7fa18b13c800 20 add_watcher() i=2 2024-09-12T17:37:01.808 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.806+0000 7fa18b13c800 20 add_watcher() i=3 2024-09-12T17:37:01.808 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.806+0000 7fa18b13c800 20 add_watcher() i=4 2024-09-12T17:37:01.808 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.806+0000 7fa18b13c800 20 add_watcher() i=5 2024-09-12T17:37:01.808 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.806+0000 7fa18b13c800 20 add_watcher() i=6 2024-09-12T17:37:01.809 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.807+0000 7fa18b13c800 20 add_watcher() i=7 2024-09-12T17:37:01.809 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.807+0000 7fa18b13c800 2 all 8 watchers are set, enabling cache 2024-09-12T17:37:01.812 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.809+0000 7fa03d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:37:01.812 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.809+0000 7fa18b13c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:37:01.812 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.809+0000 7fa18b13c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:37:01.812 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.809+0000 7fa18b13c800 5 note: GC not initialized 2024-09-12T17:37:01.812 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.809+0000 7f9fb7fff640 20 reqs_thread_entry: start 2024-09-12T17:37:01.812 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.809+0000 7fa18b13c800 20 init_complete bucket index max shards: 11 2024-09-12T17:37:01.812 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.809+0000 7fa18b13c800 20 Filter name: none 2024-09-12T17:37:01.812 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.810+0000 7f9fb5ffb640 20 reqs_thread_entry: start 2024-09-12T17:37:01.812 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.810+0000 7fa18b13c800 20 rados->read ofs=0 len=0 2024-09-12T17:37:01.812 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.810+0000 7fa18b13c800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:37:01.812 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.810+0000 7fa18b13c800 20 rados->read ofs=0 len=0 2024-09-12T17:37:01.813 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.811+0000 7fa18b13c800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T17:37:01.813 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.811+0000 7fa18b13c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:37:01.813 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.811+0000 7fa18b13c800 20 rados->read ofs=0 len=0 2024-09-12T17:37:01.813 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.811+0000 7fa18b13c800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:37:01.814 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.811+0000 7fa18b13c800 20 rados->read ofs=0 len=0 2024-09-12T17:37:01.814 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.811+0000 7fa18b13c800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T17:37:01.814 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.811+0000 7fa18b13c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:37:01.815 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.813+0000 7fa03d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:37:01.817 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.816+0000 7fa18b13c800 20 remove_watcher() i=0 2024-09-12T17:37:01.817 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.816+0000 7fa18b13c800 2 removed watcher, disabling cache 2024-09-12T17:37:01.818 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.817+0000 7fa18b13c800 20 remove_watcher() i=1 2024-09-12T17:37:01.819 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.818+0000 7fa18b13c800 20 remove_watcher() i=2 2024-09-12T17:37:01.825 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.820+0000 7fa18b13c800 20 remove_watcher() i=3 2024-09-12T17:37:01.826 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.821+0000 7fa18b13c800 20 remove_watcher() i=4 2024-09-12T17:37:01.826 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.822+0000 7fa18b13c800 20 remove_watcher() i=5 2024-09-12T17:37:01.826 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.823+0000 7fa18b13c800 20 remove_watcher() i=6 2024-09-12T17:37:01.826 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.824+0000 7fa18b13c800 20 remove_watcher() i=7 2024-09-12T17:37:01.874 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-12T17:37:01.904 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:37:01.904 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:37:01.943 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.941+0000 7f7a0bc2f800 20 rados->read ofs=0 len=0 2024-09-12T17:37:01.945 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.943+0000 7f7a0bc2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:01.945 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.943+0000 7f7a0bc2f800 20 realm 2024-09-12T17:37:01.945 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.943+0000 7f7a0bc2f800 20 rados->read ofs=0 len=0 2024-09-12T17:37:01.945 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.943+0000 7f7a0bc2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:01.945 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.943+0000 7f7a0bc2f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:37:01.945 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.943+0000 7f7a0bc2f800 20 rados->read ofs=0 len=0 2024-09-12T17:37:01.945 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.943+0000 7f7a0bc2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:01.945 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.943+0000 7f7a0bc2f800 20 rados->read ofs=0 len=0 2024-09-12T17:37:01.946 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.944+0000 7f7a0bc2f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:37:01.946 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.944+0000 7f7a0bc2f800 20 rados->read ofs=0 len=0 2024-09-12T17:37:01.946 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.944+0000 7f7a0bc2f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:37:01.946 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.944+0000 7f7a0bc2f800 20 searching for the correct realm 2024-09-12T17:37:01.949 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.948+0000 7f7a08f18640 0 -- 172.21.15.37:0/3473272798 >> [v2:172.21.15.37:6816/2964054205,v1:172.21.15.37:6817/2964054205] conn(0x55fc073e9a30 msgr2=0x55fc073ebef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:37:01.953 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:01.951+0000 7f7a09719640 0 -- 172.21.15.37:0/3473272798 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7f7a00096860 msgr2=0x7f7a00004340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:37:02.160 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:02.157+0000 7f7a0bc2f800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:37:02.160 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:02.157+0000 7f7a0bc2f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:37:02.160 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:02.157+0000 7f7a0bc2f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:37:02.160 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:02.157+0000 7f7a0bc2f800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:37:02.160 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:02.157+0000 7f7a0bc2f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:37:02.160 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:02.157+0000 7f7a0bc2f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:37:02.160 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:02.157+0000 7f7a0bc2f800 20 rados->read ofs=0 len=0 2024-09-12T17:37:02.160 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:02.158+0000 7f7a0bc2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:02.160 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:02.158+0000 7f7a0bc2f800 20 rados->read ofs=0 len=0 2024-09-12T17:37:02.162 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:02.158+0000 7f7a0bc2f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:37:02.162 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:02.158+0000 7f7a0bc2f800 20 rados->read ofs=0 len=0 2024-09-12T17:37:02.162 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:02.159+0000 7f7a0bc2f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:37:02.162 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:02.159+0000 7f7a0bc2f800 20 zone default found 2024-09-12T17:37:02.162 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:02.159+0000 7f7a0bc2f800 4 Realm: () 2024-09-12T17:37:02.162 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:02.159+0000 7f7a0bc2f800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:37:02.163 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:02.159+0000 7f7a0bc2f800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:37:02.163 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:02.159+0000 7f7a0bc2f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:37:02.163 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:02.159+0000 7f7a0bc2f800 20 zonegroup default 2024-09-12T17:37:02.163 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:02.159+0000 7f7a0bc2f800 20 rados->read ofs=0 len=0 2024-09-12T17:37:02.163 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:02.159+0000 7f7a0bc2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:02.163 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:02.159+0000 7f7a0bc2f800 20 rados->read ofs=0 len=0 2024-09-12T17:37:02.163 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:02.159+0000 7f7a0bc2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:02.163 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:02.159+0000 7f7a0bc2f800 20 rados->read ofs=0 len=0 2024-09-12T17:37:02.163 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:02.159+0000 7f7a0bc2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:02.163 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:02.159+0000 7f7a0bc2f800 20 started sync module instance, tier type = 2024-09-12T17:37:02.163 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:02.159+0000 7f7a0bc2f800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:37:02.172 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:02.170+0000 7f7a0bc2f800 20 add_watcher() i=0 2024-09-12T17:37:02.172 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:02.170+0000 7f7a0bc2f800 20 add_watcher() i=1 2024-09-12T17:37:02.172 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:02.170+0000 7f7a0bc2f800 20 add_watcher() i=2 2024-09-12T17:37:02.172 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:02.170+0000 7f7a0bc2f800 20 add_watcher() i=3 2024-09-12T17:37:02.172 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:02.170+0000 7f7a0bc2f800 20 add_watcher() i=4 2024-09-12T17:37:02.172 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:02.170+0000 7f7a0bc2f800 20 add_watcher() i=5 2024-09-12T17:37:02.173 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:02.171+0000 7f7a0bc2f800 20 add_watcher() i=6 2024-09-12T17:37:02.173 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:02.171+0000 7f7a0bc2f800 20 add_watcher() i=7 2024-09-12T17:37:02.173 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:02.171+0000 7f7a0bc2f800 2 all 8 watchers are set, enabling cache 2024-09-12T17:37:02.174 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:02.173+0000 7f78bf7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:37:02.175 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:02.173+0000 7f7a0bc2f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:37:02.176 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:02.173+0000 7f7a0bc2f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:37:02.176 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:02.173+0000 7f7a0bc2f800 5 note: GC not initialized 2024-09-12T17:37:02.176 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:02.173+0000 7f78be7e4640 20 reqs_thread_entry: start 2024-09-12T17:37:02.176 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:02.173+0000 7f7a0bc2f800 20 init_complete bucket index max shards: 11 2024-09-12T17:37:02.176 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:02.173+0000 7f7a0bc2f800 20 Filter name: none 2024-09-12T17:37:02.176 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:02.174+0000 7f782ffff640 20 reqs_thread_entry: start 2024-09-12T17:37:02.176 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:02.174+0000 7f7a0bc2f800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:37:02.176 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:02.174+0000 7f7a0bc2f800 20 rados->read ofs=0 len=0 2024-09-12T17:37:02.178 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:02.174+0000 7f7a0bc2f800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:37:02.178 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:02.174+0000 7f7a0bc2f800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:37:02.178 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:02.174+0000 7f7a0bc2f800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:37:02.178 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:02.174+0000 7f7a0bc2f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 : miss 2024-09-12T17:37:02.178 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:02.174+0000 7f7a0bc2f800 20 rados->read ofs=0 len=0 2024-09-12T17:37:02.178 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:02.174+0000 7f7a0bc2f800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T17:37:02.178 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:02.175+0000 7f7a0bc2f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 info.flags=0x17 2024-09-12T17:37:02.178 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:02.175+0000 7f7a0bc2f800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 to cache LRU end 2024-09-12T17:37:02.179 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:02.175+0000 7f7a0bc2f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:37:02.179 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:02.175+0000 7f7a0bc2f800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:37:02.179 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:02.175+0000 7f7a0bc2f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 2024-09-12T17:37:02.179 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:02.175+0000 7f7a0bc2f800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.0 2024-09-12T17:37:02.179 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:02.175+0000 7f7a0bc2f800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.0 2024-09-12T17:37:02.179 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:02.175+0000 7f7a0bc2f800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.1 2024-09-12T17:37:02.179 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:02.175+0000 7f7a0bc2f800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.1 2024-09-12T17:37:02.179 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:02.176+0000 7f7a0bc2f800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.2 2024-09-12T17:37:02.179 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:02.176+0000 7f7a0bc2f800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.2 2024-09-12T17:37:02.179 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:02.176+0000 7f7a0bc2f800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.3 2024-09-12T17:37:02.179 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:02.176+0000 7f7a0bc2f800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.3 2024-09-12T17:37:02.180 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:02.177+0000 7f7a0bc2f800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.4 2024-09-12T17:37:02.180 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:02.177+0000 7f7a0bc2f800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.4 2024-09-12T17:37:02.180 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:02.177+0000 7f7a0bc2f800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.5 2024-09-12T17:37:02.181 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:02.177+0000 7f7a0bc2f800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.5 2024-09-12T17:37:02.181 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:02.177+0000 7f7a0bc2f800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.6 2024-09-12T17:37:02.181 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:02.177+0000 7f7a0bc2f800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.6 2024-09-12T17:37:02.181 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:02.178+0000 7f7a0bc2f800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.7 2024-09-12T17:37:02.181 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:02.178+0000 7f7a0bc2f800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.7 2024-09-12T17:37:02.181 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:02.178+0000 7f7a0bc2f800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.8 2024-09-12T17:37:02.181 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:02.178+0000 7f7a0bc2f800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.8 2024-09-12T17:37:02.181 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:02.179+0000 7f7a0bc2f800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.9 2024-09-12T17:37:02.181 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:02.179+0000 7f7a0bc2f800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.9 2024-09-12T17:37:02.182 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:02.179+0000 7f7a0bc2f800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.10 2024-09-12T17:37:02.182 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:02.179+0000 7f7a0bc2f800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.10 2024-09-12T17:37:02.182 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:02.180+0000 7f7a0bc2f800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.11 2024-09-12T17:37:02.182 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:02.180+0000 7f7a0bc2f800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.11 2024-09-12T17:37:02.182 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:02.180+0000 7f7a0bc2f800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.12 2024-09-12T17:37:02.182 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:02.180+0000 7f7a0bc2f800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.12 2024-09-12T17:37:02.183 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:02.181+0000 7f78bf7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:37:02.185 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:02.184+0000 7f7a0bc2f800 20 remove_watcher() i=0 2024-09-12T17:37:02.185 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:02.184+0000 7f7a0bc2f800 2 removed watcher, disabling cache 2024-09-12T17:37:02.186 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:02.185+0000 7f7a0bc2f800 20 remove_watcher() i=1 2024-09-12T17:37:02.188 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:02.186+0000 7f7a0bc2f800 20 remove_watcher() i=2 2024-09-12T17:37:02.189 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:02.188+0000 7f7a0bc2f800 20 remove_watcher() i=3 2024-09-12T17:37:02.190 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:02.189+0000 7f7a0bc2f800 20 remove_watcher() i=4 2024-09-12T17:37:02.191 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:02.190+0000 7f7a0bc2f800 20 remove_watcher() i=5 2024-09-12T17:37:02.192 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:02.191+0000 7f7a0bc2f800 20 remove_watcher() i=6 2024-09-12T17:37:02.193 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:02.192+0000 7f7a0bc2f800 20 remove_watcher() i=7 2024-09-12T17:37:32.234 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T17:37:32.270 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:37:32.270 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:37:32.316 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.315+0000 7f1c4d724800 20 rados->read ofs=0 len=0 2024-09-12T17:37:32.317 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.317+0000 7f1c4d724800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:32.317 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.317+0000 7f1c4d724800 20 realm 2024-09-12T17:37:32.318 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.317+0000 7f1c4d724800 20 rados->read ofs=0 len=0 2024-09-12T17:37:32.318 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.317+0000 7f1c4d724800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:32.318 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.317+0000 7f1c4d724800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:37:32.318 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.317+0000 7f1c4d724800 20 rados->read ofs=0 len=0 2024-09-12T17:37:32.318 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.317+0000 7f1c4d724800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:32.318 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.317+0000 7f1c4d724800 20 rados->read ofs=0 len=0 2024-09-12T17:37:32.319 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.318+0000 7f1c4d724800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:37:32.319 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.318+0000 7f1c4d724800 20 rados->read ofs=0 len=0 2024-09-12T17:37:32.319 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.318+0000 7f1c4d724800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:37:32.319 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.318+0000 7f1c4d724800 20 searching for the correct realm 2024-09-12T17:37:32.322 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.322+0000 7f1c48c67640 0 -- 172.21.15.37:0/1612283879 >> [v2:172.21.15.40:6800/2441293461,v1:172.21.15.40:6801/2441293461] conn(0x7f1c3c06b020 msgr2=0x7f1c3c064a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:37:32.327 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.326+0000 7f1c49468640 0 -- 172.21.15.37:0/1612283879 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7f1c4000c040 msgr2=0x7f1c40066920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:37:32.534 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.534+0000 7f1c4d724800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:37:32.535 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.534+0000 7f1c4d724800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:37:32.535 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.534+0000 7f1c4d724800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:37:32.535 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.534+0000 7f1c4d724800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:37:32.535 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.534+0000 7f1c4d724800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:37:32.535 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.534+0000 7f1c4d724800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:37:32.535 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.534+0000 7f1c4d724800 20 rados->read ofs=0 len=0 2024-09-12T17:37:32.535 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.534+0000 7f1c4d724800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:32.535 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.534+0000 7f1c4d724800 20 rados->read ofs=0 len=0 2024-09-12T17:37:32.536 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.534+0000 7f1c4d724800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:37:32.537 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.534+0000 7f1c4d724800 20 rados->read ofs=0 len=0 2024-09-12T17:37:32.537 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.535+0000 7f1c4d724800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:37:32.537 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.535+0000 7f1c4d724800 20 zone default found 2024-09-12T17:37:32.537 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.535+0000 7f1c4d724800 4 Realm: () 2024-09-12T17:37:32.537 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.535+0000 7f1c4d724800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:37:32.537 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.535+0000 7f1c4d724800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:37:32.537 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.535+0000 7f1c4d724800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:37:32.537 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.535+0000 7f1c4d724800 20 zonegroup default 2024-09-12T17:37:32.537 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.535+0000 7f1c4d724800 20 rados->read ofs=0 len=0 2024-09-12T17:37:32.537 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.535+0000 7f1c4d724800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:32.537 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.535+0000 7f1c4d724800 20 rados->read ofs=0 len=0 2024-09-12T17:37:32.537 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.536+0000 7f1c4d724800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:32.538 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.536+0000 7f1c4d724800 20 rados->read ofs=0 len=0 2024-09-12T17:37:32.538 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.536+0000 7f1c4d724800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:32.538 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.536+0000 7f1c4d724800 20 started sync module instance, tier type = 2024-09-12T17:37:32.538 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.536+0000 7f1c4d724800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:37:32.551 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.550+0000 7f1c4d724800 20 add_watcher() i=0 2024-09-12T17:37:32.551 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.550+0000 7f1c4d724800 20 add_watcher() i=1 2024-09-12T17:37:32.551 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.550+0000 7f1c4d724800 20 add_watcher() i=2 2024-09-12T17:37:32.551 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.550+0000 7f1c4d724800 20 add_watcher() i=3 2024-09-12T17:37:32.551 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.550+0000 7f1c4d724800 20 add_watcher() i=4 2024-09-12T17:37:32.551 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.550+0000 7f1c4d724800 20 add_watcher() i=5 2024-09-12T17:37:32.552 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.550+0000 7f1c4d724800 20 add_watcher() i=6 2024-09-12T17:37:32.552 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.551+0000 7f1c4d724800 20 add_watcher() i=7 2024-09-12T17:37:32.552 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.551+0000 7f1c4d724800 2 all 8 watchers are set, enabling cache 2024-09-12T17:37:32.554 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.554+0000 7f1afffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:37:32.555 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.554+0000 7f1c4d724800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:37:32.555 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.554+0000 7f1c4d724800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:37:32.555 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.554+0000 7f1c4d724800 5 note: GC not initialized 2024-09-12T17:37:32.556 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.554+0000 7f1afefe5640 20 reqs_thread_entry: start 2024-09-12T17:37:32.556 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.554+0000 7f1c4d724800 20 init_complete bucket index max shards: 11 2024-09-12T17:37:32.556 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.555+0000 7f1c4d724800 20 Filter name: none 2024-09-12T17:37:32.556 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.555+0000 7f1afcfe1640 20 reqs_thread_entry: start 2024-09-12T17:37:32.556 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.555+0000 7f1c4d724800 20 rados->read ofs=0 len=0 2024-09-12T17:37:32.557 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.555+0000 7f1c4d724800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:37:32.557 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.555+0000 7f1c4d724800 20 rados->read ofs=0 len=0 2024-09-12T17:37:32.557 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.556+0000 7f1c4d724800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T17:37:32.557 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.556+0000 7f1c4d724800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:37:32.557 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.556+0000 7f1c4d724800 20 rados->read ofs=0 len=0 2024-09-12T17:37:32.557 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.556+0000 7f1c4d724800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:37:32.558 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.556+0000 7f1c4d724800 20 rados->read ofs=0 len=0 2024-09-12T17:37:32.558 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.557+0000 7f1c4d724800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T17:37:32.558 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.557+0000 7f1c4d724800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:37:32.559 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.559+0000 7f1afffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:37:32.562 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.562+0000 7f1c4d724800 20 remove_watcher() i=0 2024-09-12T17:37:32.562 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.562+0000 7f1c4d724800 2 removed watcher, disabling cache 2024-09-12T17:37:32.563 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.563+0000 7f1c4d724800 20 remove_watcher() i=1 2024-09-12T17:37:32.565 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.564+0000 7f1c4d724800 20 remove_watcher() i=2 2024-09-12T17:37:32.566 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.565+0000 7f1c4d724800 20 remove_watcher() i=3 2024-09-12T17:37:32.567 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.566+0000 7f1c4d724800 20 remove_watcher() i=4 2024-09-12T17:37:32.568 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.567+0000 7f1c4d724800 20 remove_watcher() i=5 2024-09-12T17:37:32.569 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.569+0000 7f1c4d724800 20 remove_watcher() i=6 2024-09-12T17:37:32.570 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.570+0000 7f1c4d724800 20 remove_watcher() i=7 2024-09-12T17:37:32.677 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-12T17:37:32.706 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:37:32.706 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:37:32.747 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.746+0000 7f520ec98800 20 rados->read ofs=0 len=0 2024-09-12T17:37:32.747 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.746+0000 7f520ec98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:32.747 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.746+0000 7f520ec98800 20 realm 2024-09-12T17:37:32.748 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.746+0000 7f520ec98800 20 rados->read ofs=0 len=0 2024-09-12T17:37:32.748 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.747+0000 7f520ec98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:32.748 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.747+0000 7f520ec98800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:37:32.748 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.747+0000 7f520ec98800 20 rados->read ofs=0 len=0 2024-09-12T17:37:32.748 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.747+0000 7f520ec98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:32.748 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.747+0000 7f520ec98800 20 rados->read ofs=0 len=0 2024-09-12T17:37:32.749 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.748+0000 7f520ec98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:37:32.749 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.748+0000 7f520ec98800 20 rados->read ofs=0 len=0 2024-09-12T17:37:32.749 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.748+0000 7f520ec98800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:37:32.749 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.748+0000 7f520ec98800 20 searching for the correct realm 2024-09-12T17:37:32.753 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.752+0000 7f520cf83640 0 -- 172.21.15.37:0/3752060510 >> [v2:172.21.15.40:6808/2253405131,v1:172.21.15.40:6809/2253405131] conn(0x7f520000b040 msgr2=0x7f520004c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:37:32.960 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.960+0000 7f520c782640 0 -- 172.21.15.37:0/3752060510 >> [v2:172.21.15.40:6826/4130399962,v1:172.21.15.40:6827/4130399962] conn(0x563155d893f0 msgr2=0x563155d8b7e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:37:32.964 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.963+0000 7f520ec98800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:37:32.964 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.963+0000 7f520ec98800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:37:32.964 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.963+0000 7f520ec98800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:37:32.964 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.963+0000 7f520ec98800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:37:32.964 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.963+0000 7f520ec98800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:37:32.964 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.963+0000 7f520ec98800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:37:32.964 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.963+0000 7f520ec98800 20 rados->read ofs=0 len=0 2024-09-12T17:37:32.965 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.963+0000 7f520ec98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:32.965 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.963+0000 7f520ec98800 20 rados->read ofs=0 len=0 2024-09-12T17:37:32.966 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.964+0000 7f520ec98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:37:32.966 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.964+0000 7f520ec98800 20 rados->read ofs=0 len=0 2024-09-12T17:37:32.966 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.964+0000 7f520ec98800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:37:32.966 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.964+0000 7f520ec98800 20 zone default found 2024-09-12T17:37:32.966 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.964+0000 7f520ec98800 4 Realm: () 2024-09-12T17:37:32.966 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.964+0000 7f520ec98800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:37:32.966 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.964+0000 7f520ec98800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:37:32.966 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.964+0000 7f520ec98800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:37:32.966 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.964+0000 7f520ec98800 20 zonegroup default 2024-09-12T17:37:32.966 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.964+0000 7f520ec98800 20 rados->read ofs=0 len=0 2024-09-12T17:37:32.966 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.964+0000 7f520ec98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:32.967 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.964+0000 7f520ec98800 20 rados->read ofs=0 len=0 2024-09-12T17:37:32.967 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.965+0000 7f520ec98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:32.967 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.965+0000 7f520ec98800 20 rados->read ofs=0 len=0 2024-09-12T17:37:32.967 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.965+0000 7f520ec98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:32.967 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.965+0000 7f520ec98800 20 started sync module instance, tier type = 2024-09-12T17:37:32.967 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.965+0000 7f520ec98800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:37:32.976 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.975+0000 7f520ec98800 20 add_watcher() i=0 2024-09-12T17:37:32.976 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.975+0000 7f520ec98800 20 add_watcher() i=1 2024-09-12T17:37:32.976 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.975+0000 7f520ec98800 20 add_watcher() i=2 2024-09-12T17:37:32.976 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.975+0000 7f520ec98800 20 add_watcher() i=3 2024-09-12T17:37:32.976 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.975+0000 7f520ec98800 20 add_watcher() i=4 2024-09-12T17:37:32.976 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.975+0000 7f520ec98800 20 add_watcher() i=5 2024-09-12T17:37:32.977 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.975+0000 7f520ec98800 20 add_watcher() i=6 2024-09-12T17:37:32.977 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.976+0000 7f520ec98800 20 add_watcher() i=7 2024-09-12T17:37:32.977 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.976+0000 7f520ec98800 2 all 8 watchers are set, enabling cache 2024-09-12T17:37:32.979 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.978+0000 7f50c2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:37:32.980 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.978+0000 7f520ec98800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:37:32.980 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.978+0000 7f520ec98800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:37:32.980 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.978+0000 7f520ec98800 5 note: GC not initialized 2024-09-12T17:37:32.980 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.979+0000 7f50c1fdb640 20 reqs_thread_entry: start 2024-09-12T17:37:32.980 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.979+0000 7f520ec98800 20 init_complete bucket index max shards: 11 2024-09-12T17:37:32.980 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.979+0000 7f520ec98800 20 Filter name: none 2024-09-12T17:37:32.980 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.979+0000 7f50337fe640 20 reqs_thread_entry: start 2024-09-12T17:37:32.980 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.979+0000 7f520ec98800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:37:32.981 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.979+0000 7f520ec98800 20 rados->read ofs=0 len=0 2024-09-12T17:37:32.981 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.979+0000 7f520ec98800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:37:32.981 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.979+0000 7f520ec98800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:37:32.982 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.979+0000 7f520ec98800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:37:32.982 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.979+0000 7f520ec98800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 : miss 2024-09-12T17:37:32.982 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.979+0000 7f520ec98800 20 rados->read ofs=0 len=0 2024-09-12T17:37:32.982 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.980+0000 7f520ec98800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:37:32.982 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.980+0000 7f520ec98800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 info.flags=0x17 2024-09-12T17:37:32.982 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.980+0000 7f520ec98800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 to cache LRU end 2024-09-12T17:37:32.982 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.980+0000 7f520ec98800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:37:32.982 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.980+0000 7f520ec98800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:37:32.982 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.980+0000 7f520ec98800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 2024-09-12T17:37:32.982 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.980+0000 7f520ec98800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.0 2024-09-12T17:37:32.982 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.980+0000 7f520ec98800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.0 2024-09-12T17:37:32.982 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.981+0000 7f520ec98800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.1 2024-09-12T17:37:32.982 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.981+0000 7f520ec98800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.1 2024-09-12T17:37:32.983 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.981+0000 7f520ec98800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.2 2024-09-12T17:37:32.983 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.981+0000 7f520ec98800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.2 2024-09-12T17:37:32.983 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.982+0000 7f520ec98800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.3 2024-09-12T17:37:32.983 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.982+0000 7f520ec98800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.3 2024-09-12T17:37:32.984 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.983+0000 7f520ec98800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.4 2024-09-12T17:37:32.984 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.983+0000 7f520ec98800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.4 2024-09-12T17:37:32.984 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.983+0000 7f520ec98800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.5 2024-09-12T17:37:32.984 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.983+0000 7f520ec98800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.5 2024-09-12T17:37:32.984 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.983+0000 7f520ec98800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.6 2024-09-12T17:37:32.984 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.983+0000 7f520ec98800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.6 2024-09-12T17:37:32.985 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.984+0000 7f520ec98800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.7 2024-09-12T17:37:32.985 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.984+0000 7f520ec98800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.7 2024-09-12T17:37:32.985 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.984+0000 7f520ec98800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.8 2024-09-12T17:37:32.985 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.984+0000 7f520ec98800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.8 2024-09-12T17:37:32.985 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.985+0000 7f520ec98800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.9 2024-09-12T17:37:32.985 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.985+0000 7f520ec98800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.9 2024-09-12T17:37:32.986 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.985+0000 7f520ec98800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.10 2024-09-12T17:37:32.986 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.985+0000 7f520ec98800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.10 2024-09-12T17:37:32.986 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.985+0000 7f520ec98800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.11 2024-09-12T17:37:32.986 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.985+0000 7f520ec98800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.11 2024-09-12T17:37:32.987 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.986+0000 7f520ec98800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.12 2024-09-12T17:37:32.987 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.986+0000 7f520ec98800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.12 2024-09-12T17:37:32.988 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.987+0000 7f50c2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:37:32.990 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.989+0000 7f520ec98800 20 remove_watcher() i=0 2024-09-12T17:37:32.990 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.989+0000 7f520ec98800 2 removed watcher, disabling cache 2024-09-12T17:37:32.991 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.990+0000 7f520ec98800 20 remove_watcher() i=1 2024-09-12T17:37:32.992 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.992+0000 7f520ec98800 20 remove_watcher() i=2 2024-09-12T17:37:32.993 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.993+0000 7f520ec98800 20 remove_watcher() i=3 2024-09-12T17:37:32.994 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.994+0000 7f520ec98800 20 remove_watcher() i=4 2024-09-12T17:37:32.995 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.995+0000 7f520ec98800 20 remove_watcher() i=5 2024-09-12T17:37:32.997 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.996+0000 7f520ec98800 20 remove_watcher() i=6 2024-09-12T17:37:32.998 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:32.997+0000 7f520ec98800 20 remove_watcher() i=7 2024-09-12T17:37:33.011 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T17:37:33.040 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:37:33.040 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:37:33.079 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.078+0000 7f0c3a526800 20 rados->read ofs=0 len=0 2024-09-12T17:37:33.081 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.080+0000 7f0c3a526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:33.081 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.080+0000 7f0c3a526800 20 realm 2024-09-12T17:37:33.081 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.080+0000 7f0c3a526800 20 rados->read ofs=0 len=0 2024-09-12T17:37:33.081 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.080+0000 7f0c3a526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:33.081 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.080+0000 7f0c3a526800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:37:33.081 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.080+0000 7f0c3a526800 20 rados->read ofs=0 len=0 2024-09-12T17:37:33.081 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.080+0000 7f0c3a526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:33.081 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.080+0000 7f0c3a526800 20 rados->read ofs=0 len=0 2024-09-12T17:37:33.082 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.081+0000 7f0c3a526800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:37:33.082 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.081+0000 7f0c3a526800 20 rados->read ofs=0 len=0 2024-09-12T17:37:33.082 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.081+0000 7f0c3a526800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:37:33.082 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.081+0000 7f0c3a526800 20 searching for the correct realm 2024-09-12T17:37:33.086 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.085+0000 7f0c3595c640 0 -- 172.21.15.37:0/786231393 >> [v2:172.21.15.37:6816/2964054205,v1:172.21.15.37:6817/2964054205] conn(0x55c74b9dab60 msgr2=0x55c74b9dcf50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:37:33.090 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.089+0000 7f0c3615d640 0 -- 172.21.15.37:0/786231393 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7f0c2c0683d0 msgr2=0x7f0c2c0a0040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:37:33.094 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.093+0000 7f0c3a526800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:37:33.094 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.093+0000 7f0c3a526800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:37:33.094 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.093+0000 7f0c3a526800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:37:33.094 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.093+0000 7f0c3a526800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:37:33.094 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.093+0000 7f0c3a526800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:37:33.094 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.093+0000 7f0c3a526800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:37:33.095 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.093+0000 7f0c3a526800 20 rados->read ofs=0 len=0 2024-09-12T17:37:33.095 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.094+0000 7f0c3a526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:33.095 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.094+0000 7f0c3a526800 20 rados->read ofs=0 len=0 2024-09-12T17:37:33.095 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.094+0000 7f0c3a526800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:37:33.096 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.094+0000 7f0c3a526800 20 rados->read ofs=0 len=0 2024-09-12T17:37:33.096 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.094+0000 7f0c3a526800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:37:33.096 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.094+0000 7f0c3a526800 20 zone default found 2024-09-12T17:37:33.096 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.094+0000 7f0c3a526800 4 Realm: () 2024-09-12T17:37:33.096 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.094+0000 7f0c3a526800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:37:33.096 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.094+0000 7f0c3a526800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:37:33.096 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.094+0000 7f0c3a526800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:37:33.096 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.094+0000 7f0c3a526800 20 zonegroup default 2024-09-12T17:37:33.096 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.094+0000 7f0c3a526800 20 rados->read ofs=0 len=0 2024-09-12T17:37:33.096 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.095+0000 7f0c3a526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:33.096 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.095+0000 7f0c3a526800 20 rados->read ofs=0 len=0 2024-09-12T17:37:33.097 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.095+0000 7f0c3a526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:33.097 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.095+0000 7f0c3a526800 20 rados->read ofs=0 len=0 2024-09-12T17:37:33.097 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.095+0000 7f0c3a526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:33.097 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.095+0000 7f0c3a526800 20 started sync module instance, tier type = 2024-09-12T17:37:33.097 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.095+0000 7f0c3a526800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:37:33.106 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.105+0000 7f0c3a526800 20 add_watcher() i=0 2024-09-12T17:37:33.106 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.105+0000 7f0c3a526800 20 add_watcher() i=1 2024-09-12T17:37:33.106 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.105+0000 7f0c3a526800 20 add_watcher() i=2 2024-09-12T17:37:33.106 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.105+0000 7f0c3a526800 20 add_watcher() i=3 2024-09-12T17:37:33.106 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.105+0000 7f0c3a526800 20 add_watcher() i=4 2024-09-12T17:37:33.106 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.105+0000 7f0c3a526800 20 add_watcher() i=5 2024-09-12T17:37:33.106 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.105+0000 7f0c3a526800 20 add_watcher() i=6 2024-09-12T17:37:33.107 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.106+0000 7f0c3a526800 20 add_watcher() i=7 2024-09-12T17:37:33.107 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.106+0000 7f0c3a526800 2 all 8 watchers are set, enabling cache 2024-09-12T17:37:33.108 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.108+0000 7f0aecfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:37:33.109 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.108+0000 7f0c3a526800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:37:33.109 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.108+0000 7f0c3a526800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:37:33.109 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.108+0000 7f0c3a526800 5 note: GC not initialized 2024-09-12T17:37:33.109 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.108+0000 7f0a677fe640 20 reqs_thread_entry: start 2024-09-12T17:37:33.109 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.108+0000 7f0c3a526800 20 init_complete bucket index max shards: 11 2024-09-12T17:37:33.110 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.108+0000 7f0c3a526800 20 Filter name: none 2024-09-12T17:37:33.110 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.108+0000 7f0a657fa640 20 reqs_thread_entry: start 2024-09-12T17:37:33.110 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.108+0000 7f0c3a526800 20 rados->read ofs=0 len=0 2024-09-12T17:37:33.111 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.109+0000 7f0c3a526800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:37:33.111 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.109+0000 7f0c3a526800 20 rados->read ofs=0 len=0 2024-09-12T17:37:33.111 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.109+0000 7f0c3a526800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:37:33.111 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.109+0000 7f0c3a526800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:37:33.111 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.109+0000 7f0c3a526800 20 rados->read ofs=0 len=0 2024-09-12T17:37:33.111 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.110+0000 7f0c3a526800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:37:33.111 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.110+0000 7f0c3a526800 20 rados->read ofs=0 len=0 2024-09-12T17:37:33.111 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.110+0000 7f0c3a526800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:37:33.111 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.110+0000 7f0c3a526800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:37:33.113 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.112+0000 7f0aecfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:37:33.115 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.114+0000 7f0c3a526800 20 remove_watcher() i=0 2024-09-12T17:37:33.115 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.114+0000 7f0c3a526800 2 removed watcher, disabling cache 2024-09-12T17:37:33.116 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.116+0000 7f0c3a526800 20 remove_watcher() i=1 2024-09-12T17:37:33.117 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.117+0000 7f0c3a526800 20 remove_watcher() i=2 2024-09-12T17:37:33.118 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.118+0000 7f0c3a526800 20 remove_watcher() i=3 2024-09-12T17:37:33.120 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.119+0000 7f0c3a526800 20 remove_watcher() i=4 2024-09-12T17:37:33.121 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.120+0000 7f0c3a526800 20 remove_watcher() i=5 2024-09-12T17:37:33.122 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.121+0000 7f0c3a526800 20 remove_watcher() i=6 2024-09-12T17:37:33.123 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.122+0000 7f0c3a526800 20 remove_watcher() i=7 2024-09-12T17:37:33.134 INFO:tasks.workunit.client.0.smithi037.stderr: test: duplicated entries should be purged before reshard 2024-09-12T17:37:33.136 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T17:37:33.165 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:37:33.165 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:37:33.205 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.204+0000 7fb03d725800 20 rados->read ofs=0 len=0 2024-09-12T17:37:33.208 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.207+0000 7fb03d725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:33.208 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.207+0000 7fb03d725800 20 realm 2024-09-12T17:37:33.208 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.207+0000 7fb03d725800 20 rados->read ofs=0 len=0 2024-09-12T17:37:33.208 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.207+0000 7fb03d725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:33.208 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.207+0000 7fb03d725800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:37:33.208 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.207+0000 7fb03d725800 20 rados->read ofs=0 len=0 2024-09-12T17:37:33.208 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.207+0000 7fb03d725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:33.208 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.207+0000 7fb03d725800 20 rados->read ofs=0 len=0 2024-09-12T17:37:33.209 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.208+0000 7fb03d725800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:37:33.209 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.208+0000 7fb03d725800 20 rados->read ofs=0 len=0 2024-09-12T17:37:33.209 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.208+0000 7fb03d725800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:37:33.209 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.208+0000 7fb03d725800 20 searching for the correct realm 2024-09-12T17:37:33.212 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.212+0000 7fb038b32640 0 -- 172.21.15.37:0/3803723605 >> [v2:172.21.15.37:6816/2964054205,v1:172.21.15.37:6817/2964054205] conn(0x55a39d27ed70 msgr2=0x55a39d281160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:37:33.216 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.216+0000 7fb039333640 0 -- 172.21.15.37:0/3803723605 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7fb03004b900 msgr2=0x7fb030008430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:37:33.221 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.221+0000 7fb03d725800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:37:33.221 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.221+0000 7fb03d725800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:37:33.222 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.221+0000 7fb03d725800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:37:33.222 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.221+0000 7fb03d725800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:37:33.222 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.221+0000 7fb03d725800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:37:33.222 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.221+0000 7fb03d725800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:37:33.222 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.221+0000 7fb03d725800 20 rados->read ofs=0 len=0 2024-09-12T17:37:33.222 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.221+0000 7fb03d725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:33.222 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.221+0000 7fb03d725800 20 rados->read ofs=0 len=0 2024-09-12T17:37:33.224 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.221+0000 7fb03d725800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:37:33.224 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.221+0000 7fb03d725800 20 rados->read ofs=0 len=0 2024-09-12T17:37:33.224 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.222+0000 7fb03d725800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:37:33.224 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.222+0000 7fb03d725800 20 zone default found 2024-09-12T17:37:33.224 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.222+0000 7fb03d725800 4 Realm: () 2024-09-12T17:37:33.224 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.222+0000 7fb03d725800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:37:33.224 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.222+0000 7fb03d725800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:37:33.224 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.222+0000 7fb03d725800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:37:33.224 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.222+0000 7fb03d725800 20 zonegroup default 2024-09-12T17:37:33.224 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.222+0000 7fb03d725800 20 rados->read ofs=0 len=0 2024-09-12T17:37:33.224 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.222+0000 7fb03d725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:33.225 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.222+0000 7fb03d725800 20 rados->read ofs=0 len=0 2024-09-12T17:37:33.225 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.222+0000 7fb03d725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:33.225 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.222+0000 7fb03d725800 20 rados->read ofs=0 len=0 2024-09-12T17:37:33.225 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.222+0000 7fb03d725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:33.225 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.222+0000 7fb03d725800 20 started sync module instance, tier type = 2024-09-12T17:37:33.225 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.222+0000 7fb03d725800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:37:33.232 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.232+0000 7fb03d725800 20 add_watcher() i=0 2024-09-12T17:37:33.233 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.232+0000 7fb03d725800 20 add_watcher() i=1 2024-09-12T17:37:33.233 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.232+0000 7fb03d725800 20 add_watcher() i=2 2024-09-12T17:37:33.233 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.232+0000 7fb03d725800 20 add_watcher() i=3 2024-09-12T17:37:33.233 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.232+0000 7fb03d725800 20 add_watcher() i=4 2024-09-12T17:37:33.233 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.232+0000 7fb03d725800 20 add_watcher() i=5 2024-09-12T17:37:33.233 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.232+0000 7fb03d725800 20 add_watcher() i=6 2024-09-12T17:37:33.233 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.233+0000 7fb03d725800 20 add_watcher() i=7 2024-09-12T17:37:33.233 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.233+0000 7fb03d725800 2 all 8 watchers are set, enabling cache 2024-09-12T17:37:33.235 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.235+0000 7faeef7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:37:33.236 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.235+0000 7fb03d725800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:37:33.236 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.235+0000 7fb03d725800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:37:33.236 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.235+0000 7fb03d725800 5 note: GC not initialized 2024-09-12T17:37:33.236 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.235+0000 7faeee7e4640 20 reqs_thread_entry: start 2024-09-12T17:37:33.236 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.235+0000 7fb03d725800 20 init_complete bucket index max shards: 11 2024-09-12T17:37:33.237 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.235+0000 7fb03d725800 20 Filter name: none 2024-09-12T17:37:33.237 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.235+0000 7fae5ffff640 20 reqs_thread_entry: start 2024-09-12T17:37:33.237 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.235+0000 7fb03d725800 20 rados->read ofs=0 len=0 2024-09-12T17:37:33.237 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.236+0000 7fb03d725800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:37:33.237 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.236+0000 7fb03d725800 20 rados->read ofs=0 len=0 2024-09-12T17:37:33.237 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.237+0000 7fb03d725800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:37:33.238 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.237+0000 7fb03d725800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:37:33.238 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.237+0000 7fb03d725800 20 rados->read ofs=0 len=0 2024-09-12T17:37:33.238 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.237+0000 7fb03d725800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:37:33.238 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.237+0000 7fb03d725800 20 rados->read ofs=0 len=0 2024-09-12T17:37:33.238 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.237+0000 7fb03d725800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:37:33.238 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.237+0000 7fb03d725800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:37:33.240 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.239+0000 7faeef7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:37:33.242 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.241+0000 7fb03d725800 20 remove_watcher() i=0 2024-09-12T17:37:33.242 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.241+0000 7fb03d725800 2 removed watcher, disabling cache 2024-09-12T17:37:33.243 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.243+0000 7fb03d725800 20 remove_watcher() i=1 2024-09-12T17:37:33.244 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.244+0000 7fb03d725800 20 remove_watcher() i=2 2024-09-12T17:37:33.245 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.245+0000 7fb03d725800 20 remove_watcher() i=3 2024-09-12T17:37:33.246 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.246+0000 7fb03d725800 20 remove_watcher() i=4 2024-09-12T17:37:33.247 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.247+0000 7fb03d725800 20 remove_watcher() i=5 2024-09-12T17:37:33.248 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.248+0000 7fb03d725800 20 remove_watcher() i=6 2024-09-12T17:37:33.249 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.249+0000 7fb03d725800 20 remove_watcher() i=7 2024-09-12T17:37:33.261 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:37:33.261 INFO:tasks.workunit.client.0.smithi037.stderr:BUCKET_STATS: 2024-09-12T17:37:33.261 INFO:tasks.workunit.client.0.smithi037.stderr:bucket: a-bucket id: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 num_objects: 10 size_kb: 1 num_shards: 13 2024-09-12T17:37:33.261 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:37:33.262 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 14 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at do_reshard 2024-09-12T17:37:33.297 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:37:33.297 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:37:33.337 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.336+0000 7ff94940f800 20 rados->read ofs=0 len=0 2024-09-12T17:37:33.340 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.337+0000 7ff94940f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:33.340 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.337+0000 7ff94940f800 20 realm 2024-09-12T17:37:33.340 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.337+0000 7ff94940f800 20 rados->read ofs=0 len=0 2024-09-12T17:37:33.340 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.337+0000 7ff94940f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:33.340 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.337+0000 7ff94940f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:37:33.340 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.337+0000 7ff94940f800 20 rados->read ofs=0 len=0 2024-09-12T17:37:33.340 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.338+0000 7ff94940f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:33.340 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.338+0000 7ff94940f800 20 rados->read ofs=0 len=0 2024-09-12T17:37:33.341 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.338+0000 7ff94940f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:37:33.341 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.338+0000 7ff94940f800 20 rados->read ofs=0 len=0 2024-09-12T17:37:33.341 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.339+0000 7ff94940f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:37:33.341 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.339+0000 7ff94940f800 20 searching for the correct realm 2024-09-12T17:37:33.342 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.342+0000 7ff944347640 0 -- 172.21.15.37:0/2870448384 >> [v2:172.21.15.40:6800/2441293461,v1:172.21.15.40:6801/2441293461] conn(0x7ff93400e070 msgr2=0x7ff934082a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:37:33.346 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.345+0000 7ff944b48640 0 -- 172.21.15.37:0/2870448384 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7ff93806f980 msgr2=0x7ff93803e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:37:33.553 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.551+0000 7ff94940f800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:37:33.553 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.551+0000 7ff94940f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:37:33.553 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.551+0000 7ff94940f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:37:33.553 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.551+0000 7ff94940f800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:37:33.553 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.551+0000 7ff94940f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:37:33.553 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.551+0000 7ff94940f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:37:33.553 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.551+0000 7ff94940f800 20 rados->read ofs=0 len=0 2024-09-12T17:37:33.553 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.552+0000 7ff94940f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:33.553 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.552+0000 7ff94940f800 20 rados->read ofs=0 len=0 2024-09-12T17:37:33.553 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.552+0000 7ff94940f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:37:33.554 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.552+0000 7ff94940f800 20 rados->read ofs=0 len=0 2024-09-12T17:37:33.554 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.552+0000 7ff94940f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:37:33.554 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.552+0000 7ff94940f800 20 zone default found 2024-09-12T17:37:33.555 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.552+0000 7ff94940f800 4 Realm: () 2024-09-12T17:37:33.555 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.552+0000 7ff94940f800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:37:33.555 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.552+0000 7ff94940f800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:37:33.555 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.552+0000 7ff94940f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:37:33.555 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.552+0000 7ff94940f800 20 zonegroup default 2024-09-12T17:37:33.555 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.552+0000 7ff94940f800 20 rados->read ofs=0 len=0 2024-09-12T17:37:33.555 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.553+0000 7ff94940f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:33.555 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.553+0000 7ff94940f800 20 rados->read ofs=0 len=0 2024-09-12T17:37:33.555 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.553+0000 7ff94940f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:33.555 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.553+0000 7ff94940f800 20 rados->read ofs=0 len=0 2024-09-12T17:37:33.555 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.554+0000 7ff94940f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:33.555 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.554+0000 7ff94940f800 20 started sync module instance, tier type = 2024-09-12T17:37:33.555 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.554+0000 7ff94940f800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:37:33.565 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.564+0000 7ff94940f800 20 add_watcher() i=0 2024-09-12T17:37:33.565 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.564+0000 7ff94940f800 20 add_watcher() i=1 2024-09-12T17:37:33.565 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.564+0000 7ff94940f800 20 add_watcher() i=2 2024-09-12T17:37:33.565 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.564+0000 7ff94940f800 20 add_watcher() i=3 2024-09-12T17:37:33.565 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.564+0000 7ff94940f800 20 add_watcher() i=4 2024-09-12T17:37:33.566 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.564+0000 7ff94940f800 20 add_watcher() i=5 2024-09-12T17:37:33.566 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.565+0000 7ff94940f800 20 add_watcher() i=6 2024-09-12T17:37:33.566 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.565+0000 7ff94940f800 20 add_watcher() i=7 2024-09-12T17:37:33.566 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.565+0000 7ff94940f800 2 all 8 watchers are set, enabling cache 2024-09-12T17:37:33.568 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.568+0000 7ff7fb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:37:33.569 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.568+0000 7ff94940f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:37:33.569 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.568+0000 7ff94940f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:37:33.569 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.568+0000 7ff94940f800 5 note: GC not initialized 2024-09-12T17:37:33.570 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.568+0000 7ff7fa7e4640 20 reqs_thread_entry: start 2024-09-12T17:37:33.570 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.568+0000 7ff94940f800 20 init_complete bucket index max shards: 11 2024-09-12T17:37:33.570 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.569+0000 7ff94940f800 20 Filter name: none 2024-09-12T17:37:33.570 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.569+0000 7ff7f37fe640 20 reqs_thread_entry: start 2024-09-12T17:37:33.570 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.569+0000 7ff94940f800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:37:33.570 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.569+0000 7ff94940f800 20 rados->read ofs=0 len=0 2024-09-12T17:37:33.571 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.569+0000 7ff94940f800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:37:33.571 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.569+0000 7ff94940f800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:37:33.571 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.569+0000 7ff94940f800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:37:33.571 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.569+0000 7ff94940f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 : miss 2024-09-12T17:37:33.571 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.569+0000 7ff94940f800 20 rados->read ofs=0 len=0 2024-09-12T17:37:33.571 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.570+0000 7ff94940f800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:37:33.571 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.570+0000 7ff94940f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 info.flags=0x17 2024-09-12T17:37:33.571 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.570+0000 7ff94940f800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 to cache LRU end 2024-09-12T17:37:33.571 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.570+0000 7ff94940f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:37:33.571 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.570+0000 7ff94940f800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:37:33.571 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.570+0000 7ff94940f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 2024-09-12T17:37:33.576 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.576+0000 7ff94940f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 info.flags=0x17 2024-09-12T17:37:33.577 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.576+0000 7ff94940f800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 to cache LRU end 2024-09-12T17:37:33.577 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.576+0000 7ff94940f800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:37:33.577 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.576+0000 7ff94940f800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18, ofs0, ns] 2024-09-12T17:37:33.577 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.576+0000 7ff81bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497019 cookie 94901150878768 notifier 8289 bl.length()=911 2024-09-12T17:37:33.577 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.576+0000 7ff81bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 info.flags=0x17 2024-09-12T17:37:33.577 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.576+0000 7ff81bfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 to cache LRU end 2024-09-12T17:37:33.578 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.576+0000 7ff81bfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:37:33.579 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.578+0000 7ff94940f800 20 handle_bi_update(): bucket=:a-bucket[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18]): orig_sources= new_sources= 2024-09-12T17:37:33.579 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.578+0000 7ff94940f800 20 handle_bi_update(): bucket=:a-bucket[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18]): potential sources added=[] removed=[] 2024-09-12T17:37:33.579 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.578+0000 7ff94940f800 20 handle_bi_update(): bucket=:a-bucket[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18]): orig_dests= new_dests= 2024-09-12T17:37:33.579 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.578+0000 7ff94940f800 20 handle_bi_update(): bucket=:a-bucket[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18]): potential dests added=[] removed=[] 2024-09-12T17:37:33.585 INFO:tasks.workunit.client.0.smithi037.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7ff94940f800 time 2024-09-12T17:37:33.585025+0000 2024-09-12T17:37:33.585 INFO:tasks.workunit.client.0.smithi037.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:37:33.585 INFO:tasks.workunit.client.0.smithi037.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:37:33.585 INFO:tasks.workunit.client.0.smithi037.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7ff94a58c71a] 2024-09-12T17:37:33.585 INFO:tasks.workunit.client.0.smithi037.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7ff94a58c8d8] 2024-09-12T17:37:33.586 INFO:tasks.workunit.client.0.smithi037.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x564fe4049841] 2024-09-12T17:37:33.586 INFO:tasks.workunit.client.0.smithi037.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x564fe405957a] 2024-09-12T17:37:33.586 INFO:tasks.workunit.client.0.smithi037.stderr: 5: main() 2024-09-12T17:37:33.586 INFO:tasks.workunit.client.0.smithi037.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7ff949229590] 2024-09-12T17:37:33.586 INFO:tasks.workunit.client.0.smithi037.stderr: 7: __libc_start_main() 2024-09-12T17:37:33.586 INFO:tasks.workunit.client.0.smithi037.stderr: 8: _start() 2024-09-12T17:37:33.586 INFO:tasks.workunit.client.0.smithi037.stderr:*** Caught signal (Aborted) ** 2024-09-12T17:37:33.586 INFO:tasks.workunit.client.0.smithi037.stderr: in thread 7ff94940f800 thread_name:radosgw-admin 2024-09-12T17:37:33.586 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.584+0000 7ff94940f800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7ff94940f800 time 2024-09-12T17:37:33.585025+0000 2024-09-12T17:37:33.586 INFO:tasks.workunit.client.0.smithi037.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:37:33.586 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:37:33.586 INFO:tasks.workunit.client.0.smithi037.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:37:33.586 INFO:tasks.workunit.client.0.smithi037.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7ff94a58c71a] 2024-09-12T17:37:33.586 INFO:tasks.workunit.client.0.smithi037.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7ff94a58c8d8] 2024-09-12T17:37:33.587 INFO:tasks.workunit.client.0.smithi037.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x564fe4049841] 2024-09-12T17:37:33.587 INFO:tasks.workunit.client.0.smithi037.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x564fe405957a] 2024-09-12T17:37:33.587 INFO:tasks.workunit.client.0.smithi037.stderr: 5: main() 2024-09-12T17:37:33.587 INFO:tasks.workunit.client.0.smithi037.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7ff949229590] 2024-09-12T17:37:33.587 INFO:tasks.workunit.client.0.smithi037.stderr: 7: __libc_start_main() 2024-09-12T17:37:33.587 INFO:tasks.workunit.client.0.smithi037.stderr: 8: _start() 2024-09-12T17:37:33.587 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:37:33.607 INFO:tasks.workunit.client.0.smithi037.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:37:33.607 INFO:tasks.workunit.client.0.smithi037.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7ff94923e6f0] 2024-09-12T17:37:33.607 INFO:tasks.workunit.client.0.smithi037.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7ff94928b99c] 2024-09-12T17:37:33.607 INFO:tasks.workunit.client.0.smithi037.stderr: 3: raise() 2024-09-12T17:37:33.607 INFO:tasks.workunit.client.0.smithi037.stderr: 4: abort() 2024-09-12T17:37:33.608 INFO:tasks.workunit.client.0.smithi037.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7ff94a58c774] 2024-09-12T17:37:33.608 INFO:tasks.workunit.client.0.smithi037.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7ff94a58c8d8] 2024-09-12T17:37:33.608 INFO:tasks.workunit.client.0.smithi037.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x564fe4049841] 2024-09-12T17:37:33.608 INFO:tasks.workunit.client.0.smithi037.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x564fe405957a] 2024-09-12T17:37:33.608 INFO:tasks.workunit.client.0.smithi037.stderr: 9: main() 2024-09-12T17:37:33.608 INFO:tasks.workunit.client.0.smithi037.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7ff949229590] 2024-09-12T17:37:33.608 INFO:tasks.workunit.client.0.smithi037.stderr: 11: __libc_start_main() 2024-09-12T17:37:33.608 INFO:tasks.workunit.client.0.smithi037.stderr: 12: _start() 2024-09-12T17:37:33.608 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.585+0000 7ff94940f800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:37:33.608 INFO:tasks.workunit.client.0.smithi037.stderr: in thread 7ff94940f800 thread_name:radosgw-admin 2024-09-12T17:37:33.608 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:37:33.608 INFO:tasks.workunit.client.0.smithi037.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:37:33.609 INFO:tasks.workunit.client.0.smithi037.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7ff94923e6f0] 2024-09-12T17:37:33.609 INFO:tasks.workunit.client.0.smithi037.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7ff94928b99c] 2024-09-12T17:37:33.609 INFO:tasks.workunit.client.0.smithi037.stderr: 3: raise() 2024-09-12T17:37:33.609 INFO:tasks.workunit.client.0.smithi037.stderr: 4: abort() 2024-09-12T17:37:33.609 INFO:tasks.workunit.client.0.smithi037.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7ff94a58c774] 2024-09-12T17:37:33.609 INFO:tasks.workunit.client.0.smithi037.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7ff94a58c8d8] 2024-09-12T17:37:33.609 INFO:tasks.workunit.client.0.smithi037.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x564fe4049841] 2024-09-12T17:37:33.609 INFO:tasks.workunit.client.0.smithi037.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x564fe405957a] 2024-09-12T17:37:33.609 INFO:tasks.workunit.client.0.smithi037.stderr: 9: main() 2024-09-12T17:37:33.609 INFO:tasks.workunit.client.0.smithi037.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7ff949229590] 2024-09-12T17:37:33.609 INFO:tasks.workunit.client.0.smithi037.stderr: 11: __libc_start_main() 2024-09-12T17:37:33.609 INFO:tasks.workunit.client.0.smithi037.stderr: 12: _start() 2024-09-12T17:37:33.610 INFO:tasks.workunit.client.0.smithi037.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:37:33.610 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:37:33.610 INFO:tasks.workunit.client.0.smithi037.stderr:--- begin dump of recent events --- 2024-09-12T17:37:33.610 INFO:tasks.workunit.client.0.smithi037.stderr: -499> 2024-09-12T17:37:33.319+0000 7ff94940f800 5 asok(0x564fe530e730) unregister_commands rotate-key 2024-09-12T17:37:33.610 INFO:tasks.workunit.client.0.smithi037.stderr: -498> 2024-09-12T17:37:33.319+0000 7ff94940f800 10 monclient: build_initial_monmap 2024-09-12T17:37:33.610 INFO:tasks.workunit.client.0.smithi037.stderr: -497> 2024-09-12T17:37:33.319+0000 7ff94940f800 1 build_initial for_mkfs: 0 2024-09-12T17:37:33.610 INFO:tasks.workunit.client.0.smithi037.stderr: -496> 2024-09-12T17:37:33.319+0000 7ff94940f800 10 monclient: monmap: 2024-09-12T17:37:33.610 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 0 2024-09-12T17:37:33.610 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:37:33.610 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 0.000000 2024-09-12T17:37:33.610 INFO:tasks.workunit.client.0.smithi037.stderr:created 0.000000 2024-09-12T17:37:33.610 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 0 (unknown) 2024-09-12T17:37:33.610 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:37:33.610 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.noname-a 2024-09-12T17:37:33.611 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.noname-b 2024-09-12T17:37:33.611 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.noname-c 2024-09-12T17:37:33.611 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:37:33.611 INFO:tasks.workunit.client.0.smithi037.stderr: -495> 2024-09-12T17:37:33.319+0000 7ff94940f800 5 AuthRegistry(0x564fe55351b0) adding auth protocol: cephx 2024-09-12T17:37:33.611 INFO:tasks.workunit.client.0.smithi037.stderr: -494> 2024-09-12T17:37:33.319+0000 7ff94940f800 5 AuthRegistry(0x564fe55351b0) adding auth protocol: cephx 2024-09-12T17:37:33.611 INFO:tasks.workunit.client.0.smithi037.stderr: -493> 2024-09-12T17:37:33.319+0000 7ff94940f800 5 AuthRegistry(0x564fe55351b0) adding auth protocol: cephx 2024-09-12T17:37:33.611 INFO:tasks.workunit.client.0.smithi037.stderr: -492> 2024-09-12T17:37:33.319+0000 7ff94940f800 5 AuthRegistry(0x564fe55351b0) adding con mode: secure 2024-09-12T17:37:33.611 INFO:tasks.workunit.client.0.smithi037.stderr: -491> 2024-09-12T17:37:33.319+0000 7ff94940f800 5 AuthRegistry(0x564fe55351b0) adding con mode: crc 2024-09-12T17:37:33.611 INFO:tasks.workunit.client.0.smithi037.stderr: -490> 2024-09-12T17:37:33.319+0000 7ff94940f800 5 AuthRegistry(0x564fe55351b0) adding con mode: secure 2024-09-12T17:37:33.611 INFO:tasks.workunit.client.0.smithi037.stderr: -489> 2024-09-12T17:37:33.319+0000 7ff94940f800 5 AuthRegistry(0x564fe55351b0) adding con mode: crc 2024-09-12T17:37:33.611 INFO:tasks.workunit.client.0.smithi037.stderr: -488> 2024-09-12T17:37:33.319+0000 7ff94940f800 5 AuthRegistry(0x564fe55351b0) adding con mode: secure 2024-09-12T17:37:33.611 INFO:tasks.workunit.client.0.smithi037.stderr: -487> 2024-09-12T17:37:33.319+0000 7ff94940f800 5 AuthRegistry(0x564fe55351b0) adding con mode: crc 2024-09-12T17:37:33.611 INFO:tasks.workunit.client.0.smithi037.stderr: -486> 2024-09-12T17:37:33.319+0000 7ff94940f800 5 AuthRegistry(0x564fe55351b0) adding con mode: crc 2024-09-12T17:37:33.612 INFO:tasks.workunit.client.0.smithi037.stderr: -485> 2024-09-12T17:37:33.319+0000 7ff94940f800 5 AuthRegistry(0x564fe55351b0) adding con mode: secure 2024-09-12T17:37:33.612 INFO:tasks.workunit.client.0.smithi037.stderr: -484> 2024-09-12T17:37:33.319+0000 7ff94940f800 5 AuthRegistry(0x564fe55351b0) adding con mode: crc 2024-09-12T17:37:33.612 INFO:tasks.workunit.client.0.smithi037.stderr: -483> 2024-09-12T17:37:33.319+0000 7ff94940f800 5 AuthRegistry(0x564fe55351b0) adding con mode: secure 2024-09-12T17:37:33.612 INFO:tasks.workunit.client.0.smithi037.stderr: -482> 2024-09-12T17:37:33.319+0000 7ff94940f800 5 AuthRegistry(0x564fe55351b0) adding con mode: crc 2024-09-12T17:37:33.612 INFO:tasks.workunit.client.0.smithi037.stderr: -481> 2024-09-12T17:37:33.319+0000 7ff94940f800 5 AuthRegistry(0x564fe55351b0) adding con mode: secure 2024-09-12T17:37:33.612 INFO:tasks.workunit.client.0.smithi037.stderr: -480> 2024-09-12T17:37:33.319+0000 7ff94940f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:37:33.612 INFO:tasks.workunit.client.0.smithi037.stderr: -479> 2024-09-12T17:37:33.319+0000 7ff94940f800 1 librados: starting msgr at 2024-09-12T17:37:33.612 INFO:tasks.workunit.client.0.smithi037.stderr: -478> 2024-09-12T17:37:33.319+0000 7ff94940f800 1 librados: starting objecter 2024-09-12T17:37:33.612 INFO:tasks.workunit.client.0.smithi037.stderr: -477> 2024-09-12T17:37:33.319+0000 7ff94940f800 5 asok(0x564fe530e730) register_command objecter_requests hook 0x564fe5534a80 2024-09-12T17:37:33.612 INFO:tasks.workunit.client.0.smithi037.stderr: -476> 2024-09-12T17:37:33.319+0000 7ff94940f800 1 librados: setting wanted keys 2024-09-12T17:37:33.612 INFO:tasks.workunit.client.0.smithi037.stderr: -475> 2024-09-12T17:37:33.319+0000 7ff94940f800 1 librados: calling monclient init 2024-09-12T17:37:33.612 INFO:tasks.workunit.client.0.smithi037.stderr: -474> 2024-09-12T17:37:33.319+0000 7ff94940f800 10 monclient: init 2024-09-12T17:37:33.612 INFO:tasks.workunit.client.0.smithi037.stderr: -473> 2024-09-12T17:37:33.319+0000 7ff94940f800 5 AuthRegistry(0x564fe552fb80) adding auth protocol: cephx 2024-09-12T17:37:33.612 INFO:tasks.workunit.client.0.smithi037.stderr: -472> 2024-09-12T17:37:33.319+0000 7ff94940f800 5 AuthRegistry(0x564fe552fb80) adding auth protocol: cephx 2024-09-12T17:37:33.612 INFO:tasks.workunit.client.0.smithi037.stderr: -471> 2024-09-12T17:37:33.319+0000 7ff94940f800 5 AuthRegistry(0x564fe552fb80) adding auth protocol: cephx 2024-09-12T17:37:33.613 INFO:tasks.workunit.client.0.smithi037.stderr: -470> 2024-09-12T17:37:33.319+0000 7ff94940f800 5 AuthRegistry(0x564fe552fb80) adding con mode: secure 2024-09-12T17:37:33.613 INFO:tasks.workunit.client.0.smithi037.stderr: -469> 2024-09-12T17:37:33.319+0000 7ff94940f800 5 AuthRegistry(0x564fe552fb80) adding con mode: crc 2024-09-12T17:37:33.613 INFO:tasks.workunit.client.0.smithi037.stderr: -468> 2024-09-12T17:37:33.319+0000 7ff94940f800 5 AuthRegistry(0x564fe552fb80) adding con mode: secure 2024-09-12T17:37:33.613 INFO:tasks.workunit.client.0.smithi037.stderr: -467> 2024-09-12T17:37:33.319+0000 7ff94940f800 5 AuthRegistry(0x564fe552fb80) adding con mode: crc 2024-09-12T17:37:33.613 INFO:tasks.workunit.client.0.smithi037.stderr: -466> 2024-09-12T17:37:33.319+0000 7ff94940f800 5 AuthRegistry(0x564fe552fb80) adding con mode: secure 2024-09-12T17:37:33.613 INFO:tasks.workunit.client.0.smithi037.stderr: -465> 2024-09-12T17:37:33.319+0000 7ff94940f800 5 AuthRegistry(0x564fe552fb80) adding con mode: crc 2024-09-12T17:37:33.613 INFO:tasks.workunit.client.0.smithi037.stderr: -464> 2024-09-12T17:37:33.319+0000 7ff94940f800 5 AuthRegistry(0x564fe552fb80) adding con mode: crc 2024-09-12T17:37:33.613 INFO:tasks.workunit.client.0.smithi037.stderr: -463> 2024-09-12T17:37:33.319+0000 7ff94940f800 5 AuthRegistry(0x564fe552fb80) adding con mode: secure 2024-09-12T17:37:33.613 INFO:tasks.workunit.client.0.smithi037.stderr: -462> 2024-09-12T17:37:33.319+0000 7ff94940f800 5 AuthRegistry(0x564fe552fb80) adding con mode: crc 2024-09-12T17:37:33.613 INFO:tasks.workunit.client.0.smithi037.stderr: -461> 2024-09-12T17:37:33.319+0000 7ff94940f800 5 AuthRegistry(0x564fe552fb80) adding con mode: secure 2024-09-12T17:37:33.613 INFO:tasks.workunit.client.0.smithi037.stderr: -460> 2024-09-12T17:37:33.319+0000 7ff94940f800 5 AuthRegistry(0x564fe552fb80) adding con mode: crc 2024-09-12T17:37:33.613 INFO:tasks.workunit.client.0.smithi037.stderr: -459> 2024-09-12T17:37:33.319+0000 7ff94940f800 5 AuthRegistry(0x564fe552fb80) adding con mode: secure 2024-09-12T17:37:33.613 INFO:tasks.workunit.client.0.smithi037.stderr: -458> 2024-09-12T17:37:33.319+0000 7ff94940f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:37:33.614 INFO:tasks.workunit.client.0.smithi037.stderr: -457> 2024-09-12T17:37:33.320+0000 7ff94940f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:37:33.614 INFO:tasks.workunit.client.0.smithi037.stderr: -456> 2024-09-12T17:37:33.320+0000 7ff94940f800 5 asok(0x564fe530e730) register_command rotate-key hook 0x564fe552fcc8 2024-09-12T17:37:33.614 INFO:tasks.workunit.client.0.smithi037.stderr: -455> 2024-09-12T17:37:33.320+0000 7ff94940f800 10 monclient: _reopen_session rank -1 2024-09-12T17:37:33.614 INFO:tasks.workunit.client.0.smithi037.stderr: -454> 2024-09-12T17:37:33.320+0000 7ff94940f800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T17:37:33.614 INFO:tasks.workunit.client.0.smithi037.stderr: -453> 2024-09-12T17:37:33.320+0000 7ff94940f800 10 monclient(hunting): picked mon.noname-a con 0x564fe5475a40 addr [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] 2024-09-12T17:37:33.614 INFO:tasks.workunit.client.0.smithi037.stderr: -452> 2024-09-12T17:37:33.320+0000 7ff94940f800 10 monclient(hunting): picked mon.noname-b con 0x564fe5475e20 addr [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] 2024-09-12T17:37:33.614 INFO:tasks.workunit.client.0.smithi037.stderr: -451> 2024-09-12T17:37:33.320+0000 7ff94940f800 10 monclient(hunting): picked mon.noname-c con 0x564fe54791b0 addr [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] 2024-09-12T17:37:33.614 INFO:tasks.workunit.client.0.smithi037.stderr: -450> 2024-09-12T17:37:33.320+0000 7ff94940f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:37:33.614 INFO:tasks.workunit.client.0.smithi037.stderr: -449> 2024-09-12T17:37:33.320+0000 7ff94940f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:37:33.614 INFO:tasks.workunit.client.0.smithi037.stderr: -448> 2024-09-12T17:37:33.320+0000 7ff94940f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:37:33.614 INFO:tasks.workunit.client.0.smithi037.stderr: -447> 2024-09-12T17:37:33.320+0000 7ff94940f800 10 monclient(hunting): _renew_subs 2024-09-12T17:37:33.614 INFO:tasks.workunit.client.0.smithi037.stderr: -446> 2024-09-12T17:37:33.320+0000 7ff94940f800 10 monclient(hunting): authenticate will time out at 2440.917190s 2024-09-12T17:37:33.614 INFO:tasks.workunit.client.0.smithi037.stderr: -445> 2024-09-12T17:37:33.320+0000 7ff944b48640 10 monclient(hunting): get_auth_request con 0x564fe5475a40 auth_method 0 2024-09-12T17:37:33.615 INFO:tasks.workunit.client.0.smithi037.stderr: -444> 2024-09-12T17:37:33.320+0000 7ff944b48640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:37:33.615 INFO:tasks.workunit.client.0.smithi037.stderr: -443> 2024-09-12T17:37:33.320+0000 7ff944b48640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:37:33.615 INFO:tasks.workunit.client.0.smithi037.stderr: -442> 2024-09-12T17:37:33.320+0000 7ff944b48640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:37:33.615 INFO:tasks.workunit.client.0.smithi037.stderr: -441> 2024-09-12T17:37:33.320+0000 7ff945349640 10 monclient(hunting): get_auth_request con 0x564fe54791b0 auth_method 0 2024-09-12T17:37:33.615 INFO:tasks.workunit.client.0.smithi037.stderr: -440> 2024-09-12T17:37:33.320+0000 7ff945349640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:37:33.615 INFO:tasks.workunit.client.0.smithi037.stderr: -439> 2024-09-12T17:37:33.320+0000 7ff945349640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:37:33.615 INFO:tasks.workunit.client.0.smithi037.stderr: -438> 2024-09-12T17:37:33.320+0000 7ff945349640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:37:33.615 INFO:tasks.workunit.client.0.smithi037.stderr: -437> 2024-09-12T17:37:33.320+0000 7ff944b48640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:37:33.615 INFO:tasks.workunit.client.0.smithi037.stderr: -436> 2024-09-12T17:37:33.320+0000 7ff944b48640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:37:33.615 INFO:tasks.workunit.client.0.smithi037.stderr: -435> 2024-09-12T17:37:33.320+0000 7ff944b48640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:37:33.615 INFO:tasks.workunit.client.0.smithi037.stderr: -434> 2024-09-12T17:37:33.320+0000 7ff944347640 10 monclient(hunting): get_auth_request con 0x564fe5475e20 auth_method 0 2024-09-12T17:37:33.615 INFO:tasks.workunit.client.0.smithi037.stderr: -433> 2024-09-12T17:37:33.320+0000 7ff944347640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:37:33.615 INFO:tasks.workunit.client.0.smithi037.stderr: -432> 2024-09-12T17:37:33.320+0000 7ff944347640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:37:33.615 INFO:tasks.workunit.client.0.smithi037.stderr: -431> 2024-09-12T17:37:33.320+0000 7ff944347640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:37:33.615 INFO:tasks.workunit.client.0.smithi037.stderr: -430> 2024-09-12T17:37:33.320+0000 7ff945349640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:37:33.616 INFO:tasks.workunit.client.0.smithi037.stderr: -429> 2024-09-12T17:37:33.320+0000 7ff945349640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:37:33.616 INFO:tasks.workunit.client.0.smithi037.stderr: -428> 2024-09-12T17:37:33.320+0000 7ff945349640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:37:33.616 INFO:tasks.workunit.client.0.smithi037.stderr: -427> 2024-09-12T17:37:33.320+0000 7ff944b48640 10 monclient(hunting): handle_auth_done global_id 8280 payload 824 2024-09-12T17:37:33.616 INFO:tasks.workunit.client.0.smithi037.stderr: -426> 2024-09-12T17:37:33.320+0000 7ff944b48640 10 monclient: _finish_hunting 0 2024-09-12T17:37:33.616 INFO:tasks.workunit.client.0.smithi037.stderr: -425> 2024-09-12T17:37:33.320+0000 7ff944b48640 1 monclient: found mon.noname-a 2024-09-12T17:37:33.616 INFO:tasks.workunit.client.0.smithi037.stderr: -424> 2024-09-12T17:37:33.320+0000 7ff944b48640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.37:3300/0 2024-09-12T17:37:33.616 INFO:tasks.workunit.client.0.smithi037.stderr: -423> 2024-09-12T17:37:33.320+0000 7ff83160a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:37:33.616 INFO:tasks.workunit.client.0.smithi037.stderr: -422> 2024-09-12T17:37:33.320+0000 7ff83160a640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:37:33.616 INFO:tasks.workunit.client.0.smithi037.stderr: -421> 2024-09-12T17:37:33.320+0000 7ff83160a640 10 monclient: dump: 2024-09-12T17:37:33.616 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:37:33.616 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:37:33.616 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:37:33.616 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:37:33.616 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:37:33.617 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:37:33.617 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:37:33.617 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:37:33.617 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:37:33.617 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:37:33.617 INFO:tasks.workunit.client.0.smithi037.stderr: -420> 2024-09-12T17:37:33.320+0000 7ff83160a640 10 monclient: _finish_auth 0 2024-09-12T17:37:33.617 INFO:tasks.workunit.client.0.smithi037.stderr: -419> 2024-09-12T17:37:33.320+0000 7ff83160a640 10 monclient: _check_auth_tickets 2024-09-12T17:37:33.617 INFO:tasks.workunit.client.0.smithi037.stderr: -418> 2024-09-12T17:37:33.320+0000 7ff94940f800 5 monclient: authenticate success, global_id 8280 2024-09-12T17:37:33.617 INFO:tasks.workunit.client.0.smithi037.stderr: -417> 2024-09-12T17:37:33.320+0000 7ff94940f800 10 monclient: _renew_subs 2024-09-12T17:37:33.617 INFO:tasks.workunit.client.0.smithi037.stderr: -416> 2024-09-12T17:37:33.320+0000 7ff94940f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.37:3300/0 2024-09-12T17:37:33.617 INFO:tasks.workunit.client.0.smithi037.stderr: -415> 2024-09-12T17:37:33.320+0000 7ff83160a640 10 monclient: handle_config config(0 keys) 2024-09-12T17:37:33.617 INFO:tasks.workunit.client.0.smithi037.stderr: -414> 2024-09-12T17:37:33.320+0000 7ff83160a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:37:33.617 INFO:tasks.workunit.client.0.smithi037.stderr: -413> 2024-09-12T17:37:33.320+0000 7ff83160a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:37:33.617 INFO:tasks.workunit.client.0.smithi037.stderr: -412> 2024-09-12T17:37:33.320+0000 7ff83160a640 10 monclient: dump: 2024-09-12T17:37:33.618 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:37:33.618 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:37:33.618 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:37:33.618 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:37:33.618 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:37:33.618 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:37:33.618 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:37:33.618 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:37:33.618 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:37:33.618 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:37:33.618 INFO:tasks.workunit.client.0.smithi037.stderr: -411> 2024-09-12T17:37:33.320+0000 7ff832e0d640 4 set_mon_vals no callback set 2024-09-12T17:37:33.618 INFO:tasks.workunit.client.0.smithi037.stderr: -410> 2024-09-12T17:37:33.320+0000 7ff94940f800 10 monclient: _renew_subs 2024-09-12T17:37:33.618 INFO:tasks.workunit.client.0.smithi037.stderr: -409> 2024-09-12T17:37:33.320+0000 7ff94940f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.37:3300/0 2024-09-12T17:37:33.619 INFO:tasks.workunit.client.0.smithi037.stderr: -408> 2024-09-12T17:37:33.320+0000 7ff94940f800 1 librados: init done 2024-09-12T17:37:33.619 INFO:tasks.workunit.client.0.smithi037.stderr: -407> 2024-09-12T17:37:33.322+0000 7ff83160a640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:37:33.619 INFO:tasks.workunit.client.0.smithi037.stderr: -406> 2024-09-12T17:37:33.322+0000 7ff83160a640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.40:6816/3916250676,v1:172.21.15.40:6817/3916250676] 2024-09-12T17:37:33.619 INFO:tasks.workunit.client.0.smithi037.stderr: -405> 2024-09-12T17:37:33.322+0000 7ff83160a640 4 mgrc reconnect Starting new session with [v2:172.21.15.40:6816/3916250676,v1:172.21.15.40:6817/3916250676] 2024-09-12T17:37:33.619 INFO:tasks.workunit.client.0.smithi037.stderr: -404> 2024-09-12T17:37:33.323+0000 7ff944347640 10 monclient: get_auth_request con 0x7ff82c076470 auth_method 0 2024-09-12T17:37:33.619 INFO:tasks.workunit.client.0.smithi037.stderr: -403> 2024-09-12T17:37:33.323+0000 7ff945349640 10 monclient: get_auth_request con 0x564fe55585b0 auth_method 0 2024-09-12T17:37:33.619 INFO:tasks.workunit.client.0.smithi037.stderr: -402> 2024-09-12T17:37:33.324+0000 7ff944b48640 10 monclient: get_auth_request con 0x564fe557af20 auth_method 0 2024-09-12T17:37:33.619 INFO:tasks.workunit.client.0.smithi037.stderr: -401> 2024-09-12T17:37:33.325+0000 7ff944347640 10 monclient: get_auth_request con 0x564fe557e780 auth_method 0 2024-09-12T17:37:33.619 INFO:tasks.workunit.client.0.smithi037.stderr: -400> 2024-09-12T17:37:33.326+0000 7ff94940f800 10 monclient: build_initial_monmap 2024-09-12T17:37:33.619 INFO:tasks.workunit.client.0.smithi037.stderr: -399> 2024-09-12T17:37:33.326+0000 7ff94940f800 1 build_initial for_mkfs: 0 2024-09-12T17:37:33.619 INFO:tasks.workunit.client.0.smithi037.stderr: -398> 2024-09-12T17:37:33.326+0000 7ff94940f800 10 monclient: monmap: 2024-09-12T17:37:33.619 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 0 2024-09-12T17:37:33.619 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:37:33.620 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 0.000000 2024-09-12T17:37:33.620 INFO:tasks.workunit.client.0.smithi037.stderr:created 0.000000 2024-09-12T17:37:33.620 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 0 (unknown) 2024-09-12T17:37:33.620 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:37:33.620 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.noname-a 2024-09-12T17:37:33.620 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.noname-b 2024-09-12T17:37:33.620 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.noname-c 2024-09-12T17:37:33.620 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:37:33.620 INFO:tasks.workunit.client.0.smithi037.stderr: -397> 2024-09-12T17:37:33.326+0000 7ff94940f800 5 AuthRegistry(0x564fe5584060) adding auth protocol: cephx 2024-09-12T17:37:33.620 INFO:tasks.workunit.client.0.smithi037.stderr: -396> 2024-09-12T17:37:33.326+0000 7ff94940f800 5 AuthRegistry(0x564fe5584060) adding auth protocol: cephx 2024-09-12T17:37:33.620 INFO:tasks.workunit.client.0.smithi037.stderr: -395> 2024-09-12T17:37:33.326+0000 7ff94940f800 5 AuthRegistry(0x564fe5584060) adding auth protocol: cephx 2024-09-12T17:37:33.620 INFO:tasks.workunit.client.0.smithi037.stderr: -394> 2024-09-12T17:37:33.326+0000 7ff94940f800 5 AuthRegistry(0x564fe5584060) adding con mode: secure 2024-09-12T17:37:33.620 INFO:tasks.workunit.client.0.smithi037.stderr: -393> 2024-09-12T17:37:33.326+0000 7ff94940f800 5 AuthRegistry(0x564fe5584060) adding con mode: crc 2024-09-12T17:37:33.620 INFO:tasks.workunit.client.0.smithi037.stderr: -392> 2024-09-12T17:37:33.326+0000 7ff94940f800 5 AuthRegistry(0x564fe5584060) adding con mode: secure 2024-09-12T17:37:33.621 INFO:tasks.workunit.client.0.smithi037.stderr: -391> 2024-09-12T17:37:33.326+0000 7ff94940f800 5 AuthRegistry(0x564fe5584060) adding con mode: crc 2024-09-12T17:37:33.621 INFO:tasks.workunit.client.0.smithi037.stderr: -390> 2024-09-12T17:37:33.326+0000 7ff94940f800 5 AuthRegistry(0x564fe5584060) adding con mode: secure 2024-09-12T17:37:33.621 INFO:tasks.workunit.client.0.smithi037.stderr: -389> 2024-09-12T17:37:33.326+0000 7ff94940f800 5 AuthRegistry(0x564fe5584060) adding con mode: crc 2024-09-12T17:37:33.621 INFO:tasks.workunit.client.0.smithi037.stderr: -388> 2024-09-12T17:37:33.326+0000 7ff94940f800 5 AuthRegistry(0x564fe5584060) adding con mode: crc 2024-09-12T17:37:33.621 INFO:tasks.workunit.client.0.smithi037.stderr: -387> 2024-09-12T17:37:33.326+0000 7ff94940f800 5 AuthRegistry(0x564fe5584060) adding con mode: secure 2024-09-12T17:37:33.621 INFO:tasks.workunit.client.0.smithi037.stderr: -386> 2024-09-12T17:37:33.326+0000 7ff94940f800 5 AuthRegistry(0x564fe5584060) adding con mode: crc 2024-09-12T17:37:33.621 INFO:tasks.workunit.client.0.smithi037.stderr: -385> 2024-09-12T17:37:33.326+0000 7ff94940f800 5 AuthRegistry(0x564fe5584060) adding con mode: secure 2024-09-12T17:37:33.621 INFO:tasks.workunit.client.0.smithi037.stderr: -384> 2024-09-12T17:37:33.326+0000 7ff94940f800 5 AuthRegistry(0x564fe5584060) adding con mode: crc 2024-09-12T17:37:33.621 INFO:tasks.workunit.client.0.smithi037.stderr: -383> 2024-09-12T17:37:33.326+0000 7ff94940f800 5 AuthRegistry(0x564fe5584060) adding con mode: secure 2024-09-12T17:37:33.621 INFO:tasks.workunit.client.0.smithi037.stderr: -382> 2024-09-12T17:37:33.326+0000 7ff94940f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:37:33.621 INFO:tasks.workunit.client.0.smithi037.stderr: -381> 2024-09-12T17:37:33.326+0000 7ff94940f800 5 asok(0x564fe530e730) register_command objecter_requests cmddesc objecter_requests hook 0x564fe5587ab0 EEXIST 2024-09-12T17:37:33.621 INFO:tasks.workunit.client.0.smithi037.stderr: -380> 2024-09-12T17:37:33.327+0000 7ff94940f800 10 monclient: init 2024-09-12T17:37:33.621 INFO:tasks.workunit.client.0.smithi037.stderr: -379> 2024-09-12T17:37:33.327+0000 7ff94940f800 5 AuthRegistry(0x564fe55830b8) adding auth protocol: cephx 2024-09-12T17:37:33.621 INFO:tasks.workunit.client.0.smithi037.stderr: -378> 2024-09-12T17:37:33.327+0000 7ff94940f800 5 AuthRegistry(0x564fe55830b8) adding auth protocol: cephx 2024-09-12T17:37:33.622 INFO:tasks.workunit.client.0.smithi037.stderr: -377> 2024-09-12T17:37:33.327+0000 7ff94940f800 5 AuthRegistry(0x564fe55830b8) adding auth protocol: cephx 2024-09-12T17:37:33.622 INFO:tasks.workunit.client.0.smithi037.stderr: -376> 2024-09-12T17:37:33.327+0000 7ff94940f800 5 AuthRegistry(0x564fe55830b8) adding con mode: secure 2024-09-12T17:37:33.622 INFO:tasks.workunit.client.0.smithi037.stderr: -375> 2024-09-12T17:37:33.327+0000 7ff94940f800 5 AuthRegistry(0x564fe55830b8) adding con mode: crc 2024-09-12T17:37:33.622 INFO:tasks.workunit.client.0.smithi037.stderr: -374> 2024-09-12T17:37:33.327+0000 7ff94940f800 5 AuthRegistry(0x564fe55830b8) adding con mode: secure 2024-09-12T17:37:33.622 INFO:tasks.workunit.client.0.smithi037.stderr: -373> 2024-09-12T17:37:33.327+0000 7ff94940f800 5 AuthRegistry(0x564fe55830b8) adding con mode: crc 2024-09-12T17:37:33.622 INFO:tasks.workunit.client.0.smithi037.stderr: -372> 2024-09-12T17:37:33.327+0000 7ff94940f800 5 AuthRegistry(0x564fe55830b8) adding con mode: secure 2024-09-12T17:37:33.622 INFO:tasks.workunit.client.0.smithi037.stderr: -371> 2024-09-12T17:37:33.327+0000 7ff94940f800 5 AuthRegistry(0x564fe55830b8) adding con mode: crc 2024-09-12T17:37:33.622 INFO:tasks.workunit.client.0.smithi037.stderr: -370> 2024-09-12T17:37:33.327+0000 7ff94940f800 5 AuthRegistry(0x564fe55830b8) adding con mode: crc 2024-09-12T17:37:33.622 INFO:tasks.workunit.client.0.smithi037.stderr: -369> 2024-09-12T17:37:33.327+0000 7ff94940f800 5 AuthRegistry(0x564fe55830b8) adding con mode: secure 2024-09-12T17:37:33.622 INFO:tasks.workunit.client.0.smithi037.stderr: -368> 2024-09-12T17:37:33.327+0000 7ff94940f800 5 AuthRegistry(0x564fe55830b8) adding con mode: crc 2024-09-12T17:37:33.622 INFO:tasks.workunit.client.0.smithi037.stderr: -367> 2024-09-12T17:37:33.327+0000 7ff94940f800 5 AuthRegistry(0x564fe55830b8) adding con mode: secure 2024-09-12T17:37:33.622 INFO:tasks.workunit.client.0.smithi037.stderr: -366> 2024-09-12T17:37:33.327+0000 7ff94940f800 5 AuthRegistry(0x564fe55830b8) adding con mode: crc 2024-09-12T17:37:33.622 INFO:tasks.workunit.client.0.smithi037.stderr: -365> 2024-09-12T17:37:33.327+0000 7ff94940f800 5 AuthRegistry(0x564fe55830b8) adding con mode: secure 2024-09-12T17:37:33.622 INFO:tasks.workunit.client.0.smithi037.stderr: -364> 2024-09-12T17:37:33.327+0000 7ff94940f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:37:33.623 INFO:tasks.workunit.client.0.smithi037.stderr: -363> 2024-09-12T17:37:33.327+0000 7ff94940f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:37:33.623 INFO:tasks.workunit.client.0.smithi037.stderr: -362> 2024-09-12T17:37:33.327+0000 7ff94940f800 5 asok(0x564fe530e730) register_command rotate-key cmddesc rotate-key hook 0x564fe5583200 EEXIST 2024-09-12T17:37:33.623 INFO:tasks.workunit.client.0.smithi037.stderr: -361> 2024-09-12T17:37:33.327+0000 7ff94940f800 10 monclient: _reopen_session rank -1 2024-09-12T17:37:33.623 INFO:tasks.workunit.client.0.smithi037.stderr: -360> 2024-09-12T17:37:33.327+0000 7ff94940f800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T17:37:33.623 INFO:tasks.workunit.client.0.smithi037.stderr: -359> 2024-09-12T17:37:33.327+0000 7ff94940f800 10 monclient(hunting): picked mon.noname-b con 0x564fe55ab7a0 addr [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] 2024-09-12T17:37:33.623 INFO:tasks.workunit.client.0.smithi037.stderr: -358> 2024-09-12T17:37:33.327+0000 7ff94940f800 10 monclient(hunting): picked mon.noname-a con 0x564fe55ada70 addr [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] 2024-09-12T17:37:33.623 INFO:tasks.workunit.client.0.smithi037.stderr: -357> 2024-09-12T17:37:33.327+0000 7ff94940f800 10 monclient(hunting): picked mon.noname-c con 0x564fe55a9f70 addr [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] 2024-09-12T17:37:33.623 INFO:tasks.workunit.client.0.smithi037.stderr: -356> 2024-09-12T17:37:33.327+0000 7ff94940f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:37:33.623 INFO:tasks.workunit.client.0.smithi037.stderr: -355> 2024-09-12T17:37:33.327+0000 7ff94940f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:37:33.623 INFO:tasks.workunit.client.0.smithi037.stderr: -354> 2024-09-12T17:37:33.327+0000 7ff94940f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:37:33.623 INFO:tasks.workunit.client.0.smithi037.stderr: -353> 2024-09-12T17:37:33.327+0000 7ff94940f800 10 monclient(hunting): _renew_subs 2024-09-12T17:37:33.623 INFO:tasks.workunit.client.0.smithi037.stderr: -352> 2024-09-12T17:37:33.327+0000 7ff94940f800 10 monclient(hunting): authenticate will time out at 2440.924607s 2024-09-12T17:37:33.623 INFO:tasks.workunit.client.0.smithi037.stderr: -351> 2024-09-12T17:37:33.327+0000 7ff944347640 10 monclient(hunting): get_auth_request con 0x564fe55ada70 auth_method 0 2024-09-12T17:37:33.623 INFO:tasks.workunit.client.0.smithi037.stderr: -350> 2024-09-12T17:37:33.327+0000 7ff944347640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:37:33.623 INFO:tasks.workunit.client.0.smithi037.stderr: -349> 2024-09-12T17:37:33.327+0000 7ff944347640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:37:33.624 INFO:tasks.workunit.client.0.smithi037.stderr: -348> 2024-09-12T17:37:33.327+0000 7ff944347640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:37:33.624 INFO:tasks.workunit.client.0.smithi037.stderr: -347> 2024-09-12T17:37:33.327+0000 7ff945349640 10 monclient(hunting): get_auth_request con 0x564fe55a9f70 auth_method 0 2024-09-12T17:37:33.624 INFO:tasks.workunit.client.0.smithi037.stderr: -346> 2024-09-12T17:37:33.327+0000 7ff945349640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:37:33.624 INFO:tasks.workunit.client.0.smithi037.stderr: -345> 2024-09-12T17:37:33.327+0000 7ff945349640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:37:33.624 INFO:tasks.workunit.client.0.smithi037.stderr: -344> 2024-09-12T17:37:33.327+0000 7ff945349640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:37:33.624 INFO:tasks.workunit.client.0.smithi037.stderr: -343> 2024-09-12T17:37:33.327+0000 7ff944b48640 10 monclient(hunting): get_auth_request con 0x564fe55ab7a0 auth_method 0 2024-09-12T17:37:33.624 INFO:tasks.workunit.client.0.smithi037.stderr: -342> 2024-09-12T17:37:33.327+0000 7ff944b48640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:37:33.624 INFO:tasks.workunit.client.0.smithi037.stderr: -341> 2024-09-12T17:37:33.327+0000 7ff944b48640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:37:33.624 INFO:tasks.workunit.client.0.smithi037.stderr: -340> 2024-09-12T17:37:33.327+0000 7ff944b48640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:37:33.624 INFO:tasks.workunit.client.0.smithi037.stderr: -339> 2024-09-12T17:37:33.327+0000 7ff944347640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:37:33.624 INFO:tasks.workunit.client.0.smithi037.stderr: -338> 2024-09-12T17:37:33.327+0000 7ff944347640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:37:33.624 INFO:tasks.workunit.client.0.smithi037.stderr: -337> 2024-09-12T17:37:33.327+0000 7ff944347640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:37:33.624 INFO:tasks.workunit.client.0.smithi037.stderr: -336> 2024-09-12T17:37:33.327+0000 7ff945349640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:37:33.625 INFO:tasks.workunit.client.0.smithi037.stderr: -335> 2024-09-12T17:37:33.327+0000 7ff945349640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:37:33.625 INFO:tasks.workunit.client.0.smithi037.stderr: -334> 2024-09-12T17:37:33.327+0000 7ff945349640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:37:33.625 INFO:tasks.workunit.client.0.smithi037.stderr: -333> 2024-09-12T17:37:33.327+0000 7ff944b48640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:37:33.625 INFO:tasks.workunit.client.0.smithi037.stderr: -332> 2024-09-12T17:37:33.327+0000 7ff944b48640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:37:33.625 INFO:tasks.workunit.client.0.smithi037.stderr: -331> 2024-09-12T17:37:33.327+0000 7ff944b48640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:37:33.625 INFO:tasks.workunit.client.0.smithi037.stderr: -330> 2024-09-12T17:37:33.327+0000 7ff944347640 10 monclient(hunting): handle_auth_done global_id 8283 payload 824 2024-09-12T17:37:33.625 INFO:tasks.workunit.client.0.smithi037.stderr: -329> 2024-09-12T17:37:33.328+0000 7ff944347640 10 monclient: _finish_hunting 0 2024-09-12T17:37:33.625 INFO:tasks.workunit.client.0.smithi037.stderr: -328> 2024-09-12T17:37:33.328+0000 7ff944347640 1 monclient: found mon.noname-a 2024-09-12T17:37:33.625 INFO:tasks.workunit.client.0.smithi037.stderr: -327> 2024-09-12T17:37:33.328+0000 7ff944347640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.37:3300/0 2024-09-12T17:37:33.625 INFO:tasks.workunit.client.0.smithi037.stderr: -326> 2024-09-12T17:37:33.328+0000 7ff82a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:37:33.625 INFO:tasks.workunit.client.0.smithi037.stderr: -325> 2024-09-12T17:37:33.328+0000 7ff82a7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:37:33.625 INFO:tasks.workunit.client.0.smithi037.stderr: -324> 2024-09-12T17:37:33.328+0000 7ff82a7fc640 10 monclient: dump: 2024-09-12T17:37:33.625 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:37:33.626 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:37:33.626 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:37:33.626 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:37:33.626 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:37:33.626 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:37:33.626 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:37:33.626 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:37:33.626 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:37:33.626 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:37:33.626 INFO:tasks.workunit.client.0.smithi037.stderr: -323> 2024-09-12T17:37:33.328+0000 7ff82a7fc640 10 monclient: _finish_auth 0 2024-09-12T17:37:33.626 INFO:tasks.workunit.client.0.smithi037.stderr: -322> 2024-09-12T17:37:33.328+0000 7ff82a7fc640 10 monclient: _check_auth_tickets 2024-09-12T17:37:33.626 INFO:tasks.workunit.client.0.smithi037.stderr: -321> 2024-09-12T17:37:33.328+0000 7ff82a7fc640 10 monclient: handle_config config(0 keys) 2024-09-12T17:37:33.626 INFO:tasks.workunit.client.0.smithi037.stderr: -320> 2024-09-12T17:37:33.328+0000 7ff82a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:37:33.626 INFO:tasks.workunit.client.0.smithi037.stderr: -319> 2024-09-12T17:37:33.328+0000 7ff82a7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:37:33.627 INFO:tasks.workunit.client.0.smithi037.stderr: -318> 2024-09-12T17:37:33.328+0000 7ff82a7fc640 10 monclient: dump: 2024-09-12T17:37:33.627 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:37:33.627 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:37:33.627 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:37:33.627 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:37:33.627 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:37:33.627 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:37:33.627 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:37:33.627 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:37:33.627 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:37:33.627 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:37:33.627 INFO:tasks.workunit.client.0.smithi037.stderr: -317> 2024-09-12T17:37:33.328+0000 7ff945b4a640 4 set_mon_vals no callback set 2024-09-12T17:37:33.628 INFO:tasks.workunit.client.0.smithi037.stderr: -316> 2024-09-12T17:37:33.328+0000 7ff94940f800 5 monclient: authenticate success, global_id 8283 2024-09-12T17:37:33.628 INFO:tasks.workunit.client.0.smithi037.stderr: -315> 2024-09-12T17:37:33.328+0000 7ff94940f800 10 monclient: _renew_subs 2024-09-12T17:37:33.628 INFO:tasks.workunit.client.0.smithi037.stderr: -314> 2024-09-12T17:37:33.328+0000 7ff94940f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.37:3300/0 2024-09-12T17:37:33.628 INFO:tasks.workunit.client.0.smithi037.stderr: -313> 2024-09-12T17:37:33.328+0000 7ff94940f800 10 monclient: _renew_subs 2024-09-12T17:37:33.628 INFO:tasks.workunit.client.0.smithi037.stderr: -312> 2024-09-12T17:37:33.328+0000 7ff94940f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.37:3300/0 2024-09-12T17:37:33.628 INFO:tasks.workunit.client.0.smithi037.stderr: -311> 2024-09-12T17:37:33.330+0000 7ff82a7fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:37:33.628 INFO:tasks.workunit.client.0.smithi037.stderr: -310> 2024-09-12T17:37:33.330+0000 7ff82a7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.40:6816/3916250676,v1:172.21.15.40:6817/3916250676] 2024-09-12T17:37:33.628 INFO:tasks.workunit.client.0.smithi037.stderr: -309> 2024-09-12T17:37:33.330+0000 7ff82a7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.40:6816/3916250676,v1:172.21.15.40:6817/3916250676] 2024-09-12T17:37:33.628 INFO:tasks.workunit.client.0.smithi037.stderr: -308> 2024-09-12T17:37:33.330+0000 7ff94940f800 10 monclient: get_monmap_and_config 2024-09-12T17:37:33.628 INFO:tasks.workunit.client.0.smithi037.stderr: -307> 2024-09-12T17:37:33.330+0000 7ff94940f800 10 monclient: build_initial_monmap 2024-09-12T17:37:33.629 INFO:tasks.workunit.client.0.smithi037.stderr: -306> 2024-09-12T17:37:33.330+0000 7ff94940f800 1 build_initial for_mkfs: 0 2024-09-12T17:37:33.629 INFO:tasks.workunit.client.0.smithi037.stderr: -305> 2024-09-12T17:37:33.330+0000 7ff94940f800 10 monclient: monmap: 2024-09-12T17:37:33.629 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 0 2024-09-12T17:37:33.629 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:37:33.629 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 0.000000 2024-09-12T17:37:33.629 INFO:tasks.workunit.client.0.smithi037.stderr:created 0.000000 2024-09-12T17:37:33.629 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 0 (unknown) 2024-09-12T17:37:33.629 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:37:33.629 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.noname-a 2024-09-12T17:37:33.629 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.noname-b 2024-09-12T17:37:33.629 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.noname-c 2024-09-12T17:37:33.629 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:37:33.630 INFO:tasks.workunit.client.0.smithi037.stderr: -304> 2024-09-12T17:37:33.330+0000 7ff94940f800 5 AuthRegistry(0x564fe55cb630) adding auth protocol: cephx 2024-09-12T17:37:33.630 INFO:tasks.workunit.client.0.smithi037.stderr: -303> 2024-09-12T17:37:33.330+0000 7ff94940f800 5 AuthRegistry(0x564fe55cb630) adding auth protocol: cephx 2024-09-12T17:37:33.630 INFO:tasks.workunit.client.0.smithi037.stderr: -302> 2024-09-12T17:37:33.330+0000 7ff94940f800 5 AuthRegistry(0x564fe55cb630) adding auth protocol: cephx 2024-09-12T17:37:33.630 INFO:tasks.workunit.client.0.smithi037.stderr: -301> 2024-09-12T17:37:33.330+0000 7ff94940f800 5 AuthRegistry(0x564fe55cb630) adding con mode: secure 2024-09-12T17:37:33.630 INFO:tasks.workunit.client.0.smithi037.stderr: -300> 2024-09-12T17:37:33.330+0000 7ff94940f800 5 AuthRegistry(0x564fe55cb630) adding con mode: crc 2024-09-12T17:37:33.630 INFO:tasks.workunit.client.0.smithi037.stderr: -299> 2024-09-12T17:37:33.330+0000 7ff94940f800 5 AuthRegistry(0x564fe55cb630) adding con mode: secure 2024-09-12T17:37:33.630 INFO:tasks.workunit.client.0.smithi037.stderr: -298> 2024-09-12T17:37:33.330+0000 7ff94940f800 5 AuthRegistry(0x564fe55cb630) adding con mode: crc 2024-09-12T17:37:33.630 INFO:tasks.workunit.client.0.smithi037.stderr: -297> 2024-09-12T17:37:33.330+0000 7ff94940f800 5 AuthRegistry(0x564fe55cb630) adding con mode: secure 2024-09-12T17:37:33.630 INFO:tasks.workunit.client.0.smithi037.stderr: -296> 2024-09-12T17:37:33.330+0000 7ff94940f800 5 AuthRegistry(0x564fe55cb630) adding con mode: crc 2024-09-12T17:37:33.630 INFO:tasks.workunit.client.0.smithi037.stderr: -295> 2024-09-12T17:37:33.330+0000 7ff94940f800 5 AuthRegistry(0x564fe55cb630) adding con mode: crc 2024-09-12T17:37:33.630 INFO:tasks.workunit.client.0.smithi037.stderr: -294> 2024-09-12T17:37:33.330+0000 7ff94940f800 5 AuthRegistry(0x564fe55cb630) adding con mode: secure 2024-09-12T17:37:33.630 INFO:tasks.workunit.client.0.smithi037.stderr: -293> 2024-09-12T17:37:33.330+0000 7ff94940f800 5 AuthRegistry(0x564fe55cb630) adding con mode: crc 2024-09-12T17:37:33.630 INFO:tasks.workunit.client.0.smithi037.stderr: -292> 2024-09-12T17:37:33.330+0000 7ff94940f800 5 AuthRegistry(0x564fe55cb630) adding con mode: secure 2024-09-12T17:37:33.631 INFO:tasks.workunit.client.0.smithi037.stderr: -291> 2024-09-12T17:37:33.330+0000 7ff94940f800 5 AuthRegistry(0x564fe55cb630) adding con mode: crc 2024-09-12T17:37:33.631 INFO:tasks.workunit.client.0.smithi037.stderr: -290> 2024-09-12T17:37:33.330+0000 7ff94940f800 5 AuthRegistry(0x564fe55cb630) adding con mode: secure 2024-09-12T17:37:33.631 INFO:tasks.workunit.client.0.smithi037.stderr: -289> 2024-09-12T17:37:33.330+0000 7ff944b48640 10 monclient: get_auth_request con 0x7ff81c076380 auth_method 0 2024-09-12T17:37:33.631 INFO:tasks.workunit.client.0.smithi037.stderr: -288> 2024-09-12T17:37:33.330+0000 7ff94940f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:37:33.631 INFO:tasks.workunit.client.0.smithi037.stderr: -287> 2024-09-12T17:37:33.331+0000 7ff94940f800 10 monclient: init 2024-09-12T17:37:33.631 INFO:tasks.workunit.client.0.smithi037.stderr: -286> 2024-09-12T17:37:33.331+0000 7ff94940f800 5 AuthRegistry(0x7ffef42b9960) adding auth protocol: cephx 2024-09-12T17:37:33.631 INFO:tasks.workunit.client.0.smithi037.stderr: -285> 2024-09-12T17:37:33.331+0000 7ff94940f800 5 AuthRegistry(0x7ffef42b9960) adding auth protocol: cephx 2024-09-12T17:37:33.631 INFO:tasks.workunit.client.0.smithi037.stderr: -284> 2024-09-12T17:37:33.331+0000 7ff94940f800 5 AuthRegistry(0x7ffef42b9960) adding auth protocol: cephx 2024-09-12T17:37:33.631 INFO:tasks.workunit.client.0.smithi037.stderr: -283> 2024-09-12T17:37:33.331+0000 7ff94940f800 5 AuthRegistry(0x7ffef42b9960) adding con mode: secure 2024-09-12T17:37:33.631 INFO:tasks.workunit.client.0.smithi037.stderr: -282> 2024-09-12T17:37:33.331+0000 7ff94940f800 5 AuthRegistry(0x7ffef42b9960) adding con mode: crc 2024-09-12T17:37:33.631 INFO:tasks.workunit.client.0.smithi037.stderr: -281> 2024-09-12T17:37:33.331+0000 7ff94940f800 5 AuthRegistry(0x7ffef42b9960) adding con mode: secure 2024-09-12T17:37:33.631 INFO:tasks.workunit.client.0.smithi037.stderr: -280> 2024-09-12T17:37:33.331+0000 7ff94940f800 5 AuthRegistry(0x7ffef42b9960) adding con mode: crc 2024-09-12T17:37:33.631 INFO:tasks.workunit.client.0.smithi037.stderr: -279> 2024-09-12T17:37:33.331+0000 7ff94940f800 5 AuthRegistry(0x7ffef42b9960) adding con mode: secure 2024-09-12T17:37:33.631 INFO:tasks.workunit.client.0.smithi037.stderr: -278> 2024-09-12T17:37:33.331+0000 7ff94940f800 5 AuthRegistry(0x7ffef42b9960) adding con mode: crc 2024-09-12T17:37:33.632 INFO:tasks.workunit.client.0.smithi037.stderr: -277> 2024-09-12T17:37:33.331+0000 7ff94940f800 5 AuthRegistry(0x7ffef42b9960) adding con mode: crc 2024-09-12T17:37:33.632 INFO:tasks.workunit.client.0.smithi037.stderr: -276> 2024-09-12T17:37:33.331+0000 7ff94940f800 5 AuthRegistry(0x7ffef42b9960) adding con mode: secure 2024-09-12T17:37:33.632 INFO:tasks.workunit.client.0.smithi037.stderr: -275> 2024-09-12T17:37:33.331+0000 7ff94940f800 5 AuthRegistry(0x7ffef42b9960) adding con mode: crc 2024-09-12T17:37:33.632 INFO:tasks.workunit.client.0.smithi037.stderr: -274> 2024-09-12T17:37:33.331+0000 7ff94940f800 5 AuthRegistry(0x7ffef42b9960) adding con mode: secure 2024-09-12T17:37:33.632 INFO:tasks.workunit.client.0.smithi037.stderr: -273> 2024-09-12T17:37:33.331+0000 7ff94940f800 5 AuthRegistry(0x7ffef42b9960) adding con mode: crc 2024-09-12T17:37:33.632 INFO:tasks.workunit.client.0.smithi037.stderr: -272> 2024-09-12T17:37:33.331+0000 7ff94940f800 5 AuthRegistry(0x7ffef42b9960) adding con mode: secure 2024-09-12T17:37:33.632 INFO:tasks.workunit.client.0.smithi037.stderr: -271> 2024-09-12T17:37:33.331+0000 7ff94940f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:37:33.632 INFO:tasks.workunit.client.0.smithi037.stderr: -270> 2024-09-12T17:37:33.331+0000 7ff94940f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:37:33.632 INFO:tasks.workunit.client.0.smithi037.stderr: -269> 2024-09-12T17:37:33.331+0000 7ff94940f800 5 asok(0x564fe530e730) register_command rotate-key cmddesc rotate-key hook 0x7ffef42b9aa8 EEXIST 2024-09-12T17:37:33.632 INFO:tasks.workunit.client.0.smithi037.stderr: -268> 2024-09-12T17:37:33.331+0000 7ff94940f800 10 monclient: _reopen_session rank -1 2024-09-12T17:37:33.632 INFO:tasks.workunit.client.0.smithi037.stderr: -267> 2024-09-12T17:37:33.331+0000 7ff94940f800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T17:37:33.632 INFO:tasks.workunit.client.0.smithi037.stderr: -266> 2024-09-12T17:37:33.331+0000 7ff94940f800 10 monclient(hunting): picked mon.noname-a con 0x564fe55d3610 addr [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] 2024-09-12T17:37:33.632 INFO:tasks.workunit.client.0.smithi037.stderr: -265> 2024-09-12T17:37:33.331+0000 7ff94940f800 10 monclient(hunting): picked mon.noname-b con 0x564fe5607970 addr [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] 2024-09-12T17:37:33.632 INFO:tasks.workunit.client.0.smithi037.stderr: -264> 2024-09-12T17:37:33.331+0000 7ff94940f800 10 monclient(hunting): picked mon.noname-c con 0x564fe55ff3e0 addr [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] 2024-09-12T17:37:33.633 INFO:tasks.workunit.client.0.smithi037.stderr: -263> 2024-09-12T17:37:33.331+0000 7ff94940f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:37:33.633 INFO:tasks.workunit.client.0.smithi037.stderr: -262> 2024-09-12T17:37:33.331+0000 7ff94940f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:37:33.633 INFO:tasks.workunit.client.0.smithi037.stderr: -261> 2024-09-12T17:37:33.331+0000 7ff94940f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:37:33.633 INFO:tasks.workunit.client.0.smithi037.stderr: -260> 2024-09-12T17:37:33.331+0000 7ff94940f800 10 monclient(hunting): _renew_subs 2024-09-12T17:37:33.633 INFO:tasks.workunit.client.0.smithi037.stderr: -259> 2024-09-12T17:37:33.331+0000 7ff94940f800 10 monclient(hunting): authenticate will time out at 2440.928601s 2024-09-12T17:37:33.633 INFO:tasks.workunit.client.0.smithi037.stderr: -258> 2024-09-12T17:37:33.331+0000 7ff944b48640 10 monclient(hunting): get_auth_request con 0x564fe55d3610 auth_method 0 2024-09-12T17:37:33.633 INFO:tasks.workunit.client.0.smithi037.stderr: -257> 2024-09-12T17:37:33.331+0000 7ff944b48640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:37:33.633 INFO:tasks.workunit.client.0.smithi037.stderr: -256> 2024-09-12T17:37:33.331+0000 7ff944b48640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:37:33.633 INFO:tasks.workunit.client.0.smithi037.stderr: -255> 2024-09-12T17:37:33.331+0000 7ff944b48640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:37:33.633 INFO:tasks.workunit.client.0.smithi037.stderr: -254> 2024-09-12T17:37:33.331+0000 7ff945349640 10 monclient(hunting): get_auth_request con 0x564fe55ff3e0 auth_method 0 2024-09-12T17:37:33.633 INFO:tasks.workunit.client.0.smithi037.stderr: -253> 2024-09-12T17:37:33.331+0000 7ff945349640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:37:33.633 INFO:tasks.workunit.client.0.smithi037.stderr: -252> 2024-09-12T17:37:33.331+0000 7ff945349640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:37:33.633 INFO:tasks.workunit.client.0.smithi037.stderr: -251> 2024-09-12T17:37:33.331+0000 7ff945349640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:37:33.633 INFO:tasks.workunit.client.0.smithi037.stderr: -250> 2024-09-12T17:37:33.331+0000 7ff944347640 10 monclient(hunting): get_auth_request con 0x564fe5607970 auth_method 0 2024-09-12T17:37:33.634 INFO:tasks.workunit.client.0.smithi037.stderr: -249> 2024-09-12T17:37:33.331+0000 7ff944347640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:37:33.634 INFO:tasks.workunit.client.0.smithi037.stderr: -248> 2024-09-12T17:37:33.331+0000 7ff944347640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:37:33.634 INFO:tasks.workunit.client.0.smithi037.stderr: -247> 2024-09-12T17:37:33.331+0000 7ff944347640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:37:33.634 INFO:tasks.workunit.client.0.smithi037.stderr: -246> 2024-09-12T17:37:33.331+0000 7ff945349640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:37:33.634 INFO:tasks.workunit.client.0.smithi037.stderr: -245> 2024-09-12T17:37:33.331+0000 7ff945349640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:37:33.634 INFO:tasks.workunit.client.0.smithi037.stderr: -244> 2024-09-12T17:37:33.331+0000 7ff945349640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:37:33.634 INFO:tasks.workunit.client.0.smithi037.stderr: -243> 2024-09-12T17:37:33.331+0000 7ff944b48640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:37:33.634 INFO:tasks.workunit.client.0.smithi037.stderr: -242> 2024-09-12T17:37:33.331+0000 7ff944b48640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:37:33.634 INFO:tasks.workunit.client.0.smithi037.stderr: -241> 2024-09-12T17:37:33.331+0000 7ff944b48640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:37:33.634 INFO:tasks.workunit.client.0.smithi037.stderr: -240> 2024-09-12T17:37:33.331+0000 7ff944347640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:37:33.634 INFO:tasks.workunit.client.0.smithi037.stderr: -239> 2024-09-12T17:37:33.331+0000 7ff944347640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:37:33.634 INFO:tasks.workunit.client.0.smithi037.stderr: -238> 2024-09-12T17:37:33.331+0000 7ff944347640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:37:33.634 INFO:tasks.workunit.client.0.smithi037.stderr: -237> 2024-09-12T17:37:33.331+0000 7ff945349640 10 monclient(hunting): handle_auth_done global_id 7727 payload 274 2024-09-12T17:37:33.635 INFO:tasks.workunit.client.0.smithi037.stderr: -236> 2024-09-12T17:37:33.331+0000 7ff945349640 10 monclient: _finish_hunting 0 2024-09-12T17:37:33.635 INFO:tasks.workunit.client.0.smithi037.stderr: -235> 2024-09-12T17:37:33.331+0000 7ff945349640 1 monclient: found mon.noname-c 2024-09-12T17:37:33.635 INFO:tasks.workunit.client.0.smithi037.stderr: -234> 2024-09-12T17:37:33.331+0000 7ff945349640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.37:3301/0 2024-09-12T17:37:33.635 INFO:tasks.workunit.client.0.smithi037.stderr: -233> 2024-09-12T17:37:33.332+0000 7ff81bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:37:33.635 INFO:tasks.workunit.client.0.smithi037.stderr: -232> 2024-09-12T17:37:33.332+0000 7ff81bfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:37:33.635 INFO:tasks.workunit.client.0.smithi037.stderr: -231> 2024-09-12T17:37:33.332+0000 7ff81bfff640 10 monclient: dump: 2024-09-12T17:37:33.635 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:37:33.635 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:37:33.635 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:37:33.635 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:37:33.635 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:37:33.635 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:37:33.635 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:37:33.635 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:37:33.636 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:37:33.636 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:37:33.636 INFO:tasks.workunit.client.0.smithi037.stderr: -230> 2024-09-12T17:37:33.332+0000 7ff81bfff640 10 monclient: _finish_auth 0 2024-09-12T17:37:33.636 INFO:tasks.workunit.client.0.smithi037.stderr: -229> 2024-09-12T17:37:33.332+0000 7ff81bfff640 10 monclient: _check_auth_tickets 2024-09-12T17:37:33.636 INFO:tasks.workunit.client.0.smithi037.stderr: -228> 2024-09-12T17:37:33.332+0000 7ff81bfff640 10 monclient: handle_config config(0 keys) 2024-09-12T17:37:33.636 INFO:tasks.workunit.client.0.smithi037.stderr: -227> 2024-09-12T17:37:33.332+0000 7ff94940f800 5 monclient: authenticate success, global_id 7727 2024-09-12T17:37:33.636 INFO:tasks.workunit.client.0.smithi037.stderr: -226> 2024-09-12T17:37:33.332+0000 7ff94940f800 10 monclient: get_monmap_and_config success 2024-09-12T17:37:33.636 INFO:tasks.workunit.client.0.smithi037.stderr: -225> 2024-09-12T17:37:33.332+0000 7ff94940f800 4 set_mon_vals no callback set 2024-09-12T17:37:33.636 INFO:tasks.workunit.client.0.smithi037.stderr: -224> 2024-09-12T17:37:33.332+0000 7ff81bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:37:33.636 INFO:tasks.workunit.client.0.smithi037.stderr: -223> 2024-09-12T17:37:33.332+0000 7ff81bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:37:33.636 INFO:tasks.workunit.client.0.smithi037.stderr: -222> 2024-09-12T17:37:33.332+0000 7ff81bfff640 10 monclient: dump: 2024-09-12T17:37:33.636 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:37:33.636 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:37:33.637 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:37:33.637 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:37:33.637 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:37:33.637 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:37:33.637 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:37:33.637 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:37:33.637 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:37:33.637 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:37:33.637 INFO:tasks.workunit.client.0.smithi037.stderr: -221> 2024-09-12T17:37:33.332+0000 7ff94940f800 10 monclient: shutdown 2024-09-12T17:37:33.637 INFO:tasks.workunit.client.0.smithi037.stderr: -220> 2024-09-12T17:37:33.332+0000 7ff94940f800 10 monclient: build_initial_monmap 2024-09-12T17:37:33.637 INFO:tasks.workunit.client.0.smithi037.stderr: -219> 2024-09-12T17:37:33.332+0000 7ff94940f800 1 build_initial for_mkfs: 0 2024-09-12T17:37:33.637 INFO:tasks.workunit.client.0.smithi037.stderr: -218> 2024-09-12T17:37:33.332+0000 7ff94940f800 10 monclient: monmap: 2024-09-12T17:37:33.637 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 0 2024-09-12T17:37:33.637 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:37:33.638 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 0.000000 2024-09-12T17:37:33.638 INFO:tasks.workunit.client.0.smithi037.stderr:created 0.000000 2024-09-12T17:37:33.638 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 0 (unknown) 2024-09-12T17:37:33.638 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:37:33.638 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.noname-a 2024-09-12T17:37:33.638 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.noname-b 2024-09-12T17:37:33.638 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.noname-c 2024-09-12T17:37:33.638 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:37:33.638 INFO:tasks.workunit.client.0.smithi037.stderr: -217> 2024-09-12T17:37:33.332+0000 7ff94940f800 5 AuthRegistry(0x564fe55fe4a0) adding auth protocol: cephx 2024-09-12T17:37:33.638 INFO:tasks.workunit.client.0.smithi037.stderr: -216> 2024-09-12T17:37:33.332+0000 7ff94940f800 5 AuthRegistry(0x564fe55fe4a0) adding auth protocol: cephx 2024-09-12T17:37:33.638 INFO:tasks.workunit.client.0.smithi037.stderr: -215> 2024-09-12T17:37:33.332+0000 7ff94940f800 5 AuthRegistry(0x564fe55fe4a0) adding auth protocol: cephx 2024-09-12T17:37:33.638 INFO:tasks.workunit.client.0.smithi037.stderr: -214> 2024-09-12T17:37:33.332+0000 7ff94940f800 5 AuthRegistry(0x564fe55fe4a0) adding con mode: secure 2024-09-12T17:37:33.638 INFO:tasks.workunit.client.0.smithi037.stderr: -213> 2024-09-12T17:37:33.332+0000 7ff94940f800 5 AuthRegistry(0x564fe55fe4a0) adding con mode: crc 2024-09-12T17:37:33.639 INFO:tasks.workunit.client.0.smithi037.stderr: -212> 2024-09-12T17:37:33.332+0000 7ff94940f800 5 AuthRegistry(0x564fe55fe4a0) adding con mode: secure 2024-09-12T17:37:33.639 INFO:tasks.workunit.client.0.smithi037.stderr: -211> 2024-09-12T17:37:33.332+0000 7ff94940f800 5 AuthRegistry(0x564fe55fe4a0) adding con mode: crc 2024-09-12T17:37:33.639 INFO:tasks.workunit.client.0.smithi037.stderr: -210> 2024-09-12T17:37:33.332+0000 7ff94940f800 5 AuthRegistry(0x564fe55fe4a0) adding con mode: secure 2024-09-12T17:37:33.639 INFO:tasks.workunit.client.0.smithi037.stderr: -209> 2024-09-12T17:37:33.332+0000 7ff94940f800 5 AuthRegistry(0x564fe55fe4a0) adding con mode: crc 2024-09-12T17:37:33.639 INFO:tasks.workunit.client.0.smithi037.stderr: -208> 2024-09-12T17:37:33.332+0000 7ff94940f800 5 AuthRegistry(0x564fe55fe4a0) adding con mode: crc 2024-09-12T17:37:33.639 INFO:tasks.workunit.client.0.smithi037.stderr: -207> 2024-09-12T17:37:33.332+0000 7ff94940f800 5 AuthRegistry(0x564fe55fe4a0) adding con mode: secure 2024-09-12T17:37:33.639 INFO:tasks.workunit.client.0.smithi037.stderr: -206> 2024-09-12T17:37:33.332+0000 7ff94940f800 5 AuthRegistry(0x564fe55fe4a0) adding con mode: crc 2024-09-12T17:37:33.639 INFO:tasks.workunit.client.0.smithi037.stderr: -205> 2024-09-12T17:37:33.332+0000 7ff94940f800 5 AuthRegistry(0x564fe55fe4a0) adding con mode: secure 2024-09-12T17:37:33.639 INFO:tasks.workunit.client.0.smithi037.stderr: -204> 2024-09-12T17:37:33.332+0000 7ff94940f800 5 AuthRegistry(0x564fe55fe4a0) adding con mode: crc 2024-09-12T17:37:33.639 INFO:tasks.workunit.client.0.smithi037.stderr: -203> 2024-09-12T17:37:33.332+0000 7ff94940f800 5 AuthRegistry(0x564fe55fe4a0) adding con mode: secure 2024-09-12T17:37:33.639 INFO:tasks.workunit.client.0.smithi037.stderr: -202> 2024-09-12T17:37:33.333+0000 7ff94940f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:37:33.639 INFO:tasks.workunit.client.0.smithi037.stderr: -201> 2024-09-12T17:37:33.333+0000 7ff94940f800 1 librados: starting msgr at 2024-09-12T17:37:33.639 INFO:tasks.workunit.client.0.smithi037.stderr: -200> 2024-09-12T17:37:33.333+0000 7ff94940f800 1 librados: starting objecter 2024-09-12T17:37:33.639 INFO:tasks.workunit.client.0.smithi037.stderr: -199> 2024-09-12T17:37:33.333+0000 7ff94940f800 5 asok(0x564fe530e730) register_command objecter_requests cmddesc objecter_requests hook 0x564fe5602cd0 EEXIST 2024-09-12T17:37:33.639 INFO:tasks.workunit.client.0.smithi037.stderr: -198> 2024-09-12T17:37:33.333+0000 7ff94940f800 1 librados: setting wanted keys 2024-09-12T17:37:33.640 INFO:tasks.workunit.client.0.smithi037.stderr: -197> 2024-09-12T17:37:33.333+0000 7ff94940f800 1 librados: calling monclient init 2024-09-12T17:37:33.640 INFO:tasks.workunit.client.0.smithi037.stderr: -196> 2024-09-12T17:37:33.333+0000 7ff94940f800 10 monclient: init 2024-09-12T17:37:33.640 INFO:tasks.workunit.client.0.smithi037.stderr: -195> 2024-09-12T17:37:33.333+0000 7ff94940f800 5 AuthRegistry(0x564fe55c3550) adding auth protocol: cephx 2024-09-12T17:37:33.640 INFO:tasks.workunit.client.0.smithi037.stderr: -194> 2024-09-12T17:37:33.333+0000 7ff94940f800 5 AuthRegistry(0x564fe55c3550) adding auth protocol: cephx 2024-09-12T17:37:33.640 INFO:tasks.workunit.client.0.smithi037.stderr: -193> 2024-09-12T17:37:33.333+0000 7ff94940f800 5 AuthRegistry(0x564fe55c3550) adding auth protocol: cephx 2024-09-12T17:37:33.640 INFO:tasks.workunit.client.0.smithi037.stderr: -192> 2024-09-12T17:37:33.333+0000 7ff94940f800 5 AuthRegistry(0x564fe55c3550) adding con mode: secure 2024-09-12T17:37:33.640 INFO:tasks.workunit.client.0.smithi037.stderr: -191> 2024-09-12T17:37:33.333+0000 7ff94940f800 5 AuthRegistry(0x564fe55c3550) adding con mode: crc 2024-09-12T17:37:33.640 INFO:tasks.workunit.client.0.smithi037.stderr: -190> 2024-09-12T17:37:33.333+0000 7ff94940f800 5 AuthRegistry(0x564fe55c3550) adding con mode: secure 2024-09-12T17:37:33.640 INFO:tasks.workunit.client.0.smithi037.stderr: -189> 2024-09-12T17:37:33.333+0000 7ff94940f800 5 AuthRegistry(0x564fe55c3550) adding con mode: crc 2024-09-12T17:37:33.640 INFO:tasks.workunit.client.0.smithi037.stderr: -188> 2024-09-12T17:37:33.333+0000 7ff94940f800 5 AuthRegistry(0x564fe55c3550) adding con mode: secure 2024-09-12T17:37:33.640 INFO:tasks.workunit.client.0.smithi037.stderr: -187> 2024-09-12T17:37:33.333+0000 7ff94940f800 5 AuthRegistry(0x564fe55c3550) adding con mode: crc 2024-09-12T17:37:33.640 INFO:tasks.workunit.client.0.smithi037.stderr: -186> 2024-09-12T17:37:33.333+0000 7ff94940f800 5 AuthRegistry(0x564fe55c3550) adding con mode: crc 2024-09-12T17:37:33.640 INFO:tasks.workunit.client.0.smithi037.stderr: -185> 2024-09-12T17:37:33.333+0000 7ff94940f800 5 AuthRegistry(0x564fe55c3550) adding con mode: secure 2024-09-12T17:37:33.641 INFO:tasks.workunit.client.0.smithi037.stderr: -184> 2024-09-12T17:37:33.333+0000 7ff94940f800 5 AuthRegistry(0x564fe55c3550) adding con mode: crc 2024-09-12T17:37:33.641 INFO:tasks.workunit.client.0.smithi037.stderr: -183> 2024-09-12T17:37:33.333+0000 7ff94940f800 5 AuthRegistry(0x564fe55c3550) adding con mode: secure 2024-09-12T17:37:33.641 INFO:tasks.workunit.client.0.smithi037.stderr: -182> 2024-09-12T17:37:33.333+0000 7ff94940f800 5 AuthRegistry(0x564fe55c3550) adding con mode: crc 2024-09-12T17:37:33.641 INFO:tasks.workunit.client.0.smithi037.stderr: -181> 2024-09-12T17:37:33.333+0000 7ff94940f800 5 AuthRegistry(0x564fe55c3550) adding con mode: secure 2024-09-12T17:37:33.641 INFO:tasks.workunit.client.0.smithi037.stderr: -180> 2024-09-12T17:37:33.333+0000 7ff94940f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:37:33.641 INFO:tasks.workunit.client.0.smithi037.stderr: -179> 2024-09-12T17:37:33.333+0000 7ff94940f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:37:33.641 INFO:tasks.workunit.client.0.smithi037.stderr: -178> 2024-09-12T17:37:33.333+0000 7ff94940f800 5 asok(0x564fe530e730) register_command rotate-key cmddesc rotate-key hook 0x564fe55c3698 EEXIST 2024-09-12T17:37:33.641 INFO:tasks.workunit.client.0.smithi037.stderr: -177> 2024-09-12T17:37:33.333+0000 7ff94940f800 10 monclient: _reopen_session rank -1 2024-09-12T17:37:33.641 INFO:tasks.workunit.client.0.smithi037.stderr: -176> 2024-09-12T17:37:33.333+0000 7ff94940f800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T17:37:33.641 INFO:tasks.workunit.client.0.smithi037.stderr: -175> 2024-09-12T17:37:33.333+0000 7ff94940f800 10 monclient(hunting): picked mon.noname-c con 0x564fe55d3610 addr [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] 2024-09-12T17:37:33.641 INFO:tasks.workunit.client.0.smithi037.stderr: -174> 2024-09-12T17:37:33.333+0000 7ff94940f800 10 monclient(hunting): picked mon.noname-a con 0x564fe55ff3e0 addr [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] 2024-09-12T17:37:33.641 INFO:tasks.workunit.client.0.smithi037.stderr: -173> 2024-09-12T17:37:33.333+0000 7ff94940f800 10 monclient(hunting): picked mon.noname-b con 0x564fe5607970 addr [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] 2024-09-12T17:37:33.641 INFO:tasks.workunit.client.0.smithi037.stderr: -172> 2024-09-12T17:37:33.333+0000 7ff94940f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:37:33.642 INFO:tasks.workunit.client.0.smithi037.stderr: -171> 2024-09-12T17:37:33.333+0000 7ff94940f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:37:33.642 INFO:tasks.workunit.client.0.smithi037.stderr: -170> 2024-09-12T17:37:33.333+0000 7ff94940f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:37:33.642 INFO:tasks.workunit.client.0.smithi037.stderr: -169> 2024-09-12T17:37:33.333+0000 7ff94940f800 10 monclient(hunting): _renew_subs 2024-09-12T17:37:33.642 INFO:tasks.workunit.client.0.smithi037.stderr: -168> 2024-09-12T17:37:33.333+0000 7ff94940f800 10 monclient(hunting): authenticate will time out at 2440.930916s 2024-09-12T17:37:33.642 INFO:tasks.workunit.client.0.smithi037.stderr: -167> 2024-09-12T17:37:33.334+0000 7ff944347640 10 monclient(hunting): get_auth_request con 0x564fe55ff3e0 auth_method 0 2024-09-12T17:37:33.642 INFO:tasks.workunit.client.0.smithi037.stderr: -166> 2024-09-12T17:37:33.334+0000 7ff944347640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:37:33.642 INFO:tasks.workunit.client.0.smithi037.stderr: -165> 2024-09-12T17:37:33.334+0000 7ff944347640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:37:33.642 INFO:tasks.workunit.client.0.smithi037.stderr: -164> 2024-09-12T17:37:33.334+0000 7ff944347640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:37:33.642 INFO:tasks.workunit.client.0.smithi037.stderr: -163> 2024-09-12T17:37:33.334+0000 7ff944b48640 10 monclient(hunting): get_auth_request con 0x564fe55d3610 auth_method 0 2024-09-12T17:37:33.642 INFO:tasks.workunit.client.0.smithi037.stderr: -162> 2024-09-12T17:37:33.334+0000 7ff944b48640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:37:33.642 INFO:tasks.workunit.client.0.smithi037.stderr: -161> 2024-09-12T17:37:33.334+0000 7ff944b48640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:37:33.642 INFO:tasks.workunit.client.0.smithi037.stderr: -160> 2024-09-12T17:37:33.334+0000 7ff944b48640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:37:33.642 INFO:tasks.workunit.client.0.smithi037.stderr: -159> 2024-09-12T17:37:33.334+0000 7ff944347640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:37:33.642 INFO:tasks.workunit.client.0.smithi037.stderr: -158> 2024-09-12T17:37:33.334+0000 7ff944347640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:37:33.643 INFO:tasks.workunit.client.0.smithi037.stderr: -157> 2024-09-12T17:37:33.334+0000 7ff944347640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:37:33.643 INFO:tasks.workunit.client.0.smithi037.stderr: -156> 2024-09-12T17:37:33.334+0000 7ff945349640 10 monclient(hunting): get_auth_request con 0x564fe5607970 auth_method 0 2024-09-12T17:37:33.643 INFO:tasks.workunit.client.0.smithi037.stderr: -155> 2024-09-12T17:37:33.334+0000 7ff945349640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:37:33.643 INFO:tasks.workunit.client.0.smithi037.stderr: -154> 2024-09-12T17:37:33.334+0000 7ff945349640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:37:33.643 INFO:tasks.workunit.client.0.smithi037.stderr: -153> 2024-09-12T17:37:33.334+0000 7ff945349640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:37:33.643 INFO:tasks.workunit.client.0.smithi037.stderr: -152> 2024-09-12T17:37:33.334+0000 7ff944b48640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:37:33.643 INFO:tasks.workunit.client.0.smithi037.stderr: -151> 2024-09-12T17:37:33.334+0000 7ff944b48640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:37:33.643 INFO:tasks.workunit.client.0.smithi037.stderr: -150> 2024-09-12T17:37:33.334+0000 7ff944b48640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:37:33.643 INFO:tasks.workunit.client.0.smithi037.stderr: -149> 2024-09-12T17:37:33.334+0000 7ff945349640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:37:33.643 INFO:tasks.workunit.client.0.smithi037.stderr: -148> 2024-09-12T17:37:33.334+0000 7ff945349640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:37:33.643 INFO:tasks.workunit.client.0.smithi037.stderr: -147> 2024-09-12T17:37:33.334+0000 7ff945349640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:37:33.643 INFO:tasks.workunit.client.0.smithi037.stderr: -146> 2024-09-12T17:37:33.334+0000 7ff944347640 10 monclient(hunting): handle_auth_done global_id 8289 payload 824 2024-09-12T17:37:33.643 INFO:tasks.workunit.client.0.smithi037.stderr: -145> 2024-09-12T17:37:33.334+0000 7ff944347640 10 monclient: _finish_hunting 0 2024-09-12T17:37:33.644 INFO:tasks.workunit.client.0.smithi037.stderr: -144> 2024-09-12T17:37:33.334+0000 7ff944347640 1 monclient: found mon.noname-a 2024-09-12T17:37:33.644 INFO:tasks.workunit.client.0.smithi037.stderr: -143> 2024-09-12T17:37:33.334+0000 7ff944347640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.37:3300/0 2024-09-12T17:37:33.644 INFO:tasks.workunit.client.0.smithi037.stderr: -142> 2024-09-12T17:37:33.334+0000 7ff81a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:37:33.644 INFO:tasks.workunit.client.0.smithi037.stderr: -141> 2024-09-12T17:37:33.334+0000 7ff81a7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:37:33.644 INFO:tasks.workunit.client.0.smithi037.stderr: -140> 2024-09-12T17:37:33.334+0000 7ff81a7fc640 10 monclient: dump: 2024-09-12T17:37:33.644 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:37:33.644 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:37:33.644 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:37:33.644 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:37:33.644 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:37:33.644 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:37:33.644 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:37:33.644 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:37:33.645 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:37:33.645 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:37:33.645 INFO:tasks.workunit.client.0.smithi037.stderr: -139> 2024-09-12T17:37:33.334+0000 7ff81a7fc640 10 monclient: _finish_auth 0 2024-09-12T17:37:33.645 INFO:tasks.workunit.client.0.smithi037.stderr: -138> 2024-09-12T17:37:33.334+0000 7ff81a7fc640 10 monclient: _check_auth_tickets 2024-09-12T17:37:33.645 INFO:tasks.workunit.client.0.smithi037.stderr: -137> 2024-09-12T17:37:33.334+0000 7ff81a7fc640 10 monclient: handle_config config(0 keys) 2024-09-12T17:37:33.645 INFO:tasks.workunit.client.0.smithi037.stderr: -136> 2024-09-12T17:37:33.334+0000 7ff81a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:37:33.645 INFO:tasks.workunit.client.0.smithi037.stderr: -135> 2024-09-12T17:37:33.334+0000 7ff81a7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:37:33.645 INFO:tasks.workunit.client.0.smithi037.stderr: -134> 2024-09-12T17:37:33.334+0000 7ff81a7fc640 10 monclient: dump: 2024-09-12T17:37:33.645 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:37:33.645 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:37:33.645 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:37:33.645 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:37:33.645 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:37:33.645 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:37:33.646 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:37:33.646 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:37:33.646 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:37:33.646 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:37:33.646 INFO:tasks.workunit.client.0.smithi037.stderr: -133> 2024-09-12T17:37:33.334+0000 7ff81bfff640 4 set_mon_vals no callback set 2024-09-12T17:37:33.646 INFO:tasks.workunit.client.0.smithi037.stderr: -132> 2024-09-12T17:37:33.334+0000 7ff94940f800 5 monclient: authenticate success, global_id 8289 2024-09-12T17:37:33.646 INFO:tasks.workunit.client.0.smithi037.stderr: -131> 2024-09-12T17:37:33.334+0000 7ff94940f800 10 monclient: _renew_subs 2024-09-12T17:37:33.646 INFO:tasks.workunit.client.0.smithi037.stderr: -130> 2024-09-12T17:37:33.334+0000 7ff94940f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.37:3300/0 2024-09-12T17:37:33.646 INFO:tasks.workunit.client.0.smithi037.stderr: -129> 2024-09-12T17:37:33.334+0000 7ff94940f800 10 monclient: _renew_subs 2024-09-12T17:37:33.646 INFO:tasks.workunit.client.0.smithi037.stderr: -128> 2024-09-12T17:37:33.334+0000 7ff94940f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.37:3300/0 2024-09-12T17:37:33.646 INFO:tasks.workunit.client.0.smithi037.stderr: -127> 2024-09-12T17:37:33.334+0000 7ff94940f800 1 librados: init done 2024-09-12T17:37:33.646 INFO:tasks.workunit.client.0.smithi037.stderr: -126> 2024-09-12T17:37:33.334+0000 7ff94940f800 5 asok(0x564fe530e730) register_command cr dump hook 0x564fe55ffe58 2024-09-12T17:37:33.646 INFO:tasks.workunit.client.0.smithi037.stderr: -125> 2024-09-12T17:37:33.336+0000 7ff94940f800 20 rados->read ofs=0 len=0 2024-09-12T17:37:33.646 INFO:tasks.workunit.client.0.smithi037.stderr: -124> 2024-09-12T17:37:33.336+0000 7ff81a7fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:37:33.647 INFO:tasks.workunit.client.0.smithi037.stderr: -123> 2024-09-12T17:37:33.336+0000 7ff81a7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.40:6816/3916250676,v1:172.21.15.40:6817/3916250676] 2024-09-12T17:37:33.647 INFO:tasks.workunit.client.0.smithi037.stderr: -122> 2024-09-12T17:37:33.336+0000 7ff81a7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.40:6816/3916250676,v1:172.21.15.40:6817/3916250676] 2024-09-12T17:37:33.647 INFO:tasks.workunit.client.0.smithi037.stderr: -121> 2024-09-12T17:37:33.337+0000 7ff944b48640 10 monclient: get_auth_request con 0x7ff8100764a0 auth_method 0 2024-09-12T17:37:33.647 INFO:tasks.workunit.client.0.smithi037.stderr: -120> 2024-09-12T17:37:33.337+0000 7ff945349640 10 monclient: get_auth_request con 0x564fe561cd00 auth_method 0 2024-09-12T17:37:33.647 INFO:tasks.workunit.client.0.smithi037.stderr: -119> 2024-09-12T17:37:33.337+0000 7ff94940f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:33.647 INFO:tasks.workunit.client.0.smithi037.stderr: -118> 2024-09-12T17:37:33.337+0000 7ff94940f800 20 realm 2024-09-12T17:37:33.647 INFO:tasks.workunit.client.0.smithi037.stderr: -117> 2024-09-12T17:37:33.337+0000 7ff94940f800 20 rados->read ofs=0 len=0 2024-09-12T17:37:33.647 INFO:tasks.workunit.client.0.smithi037.stderr: -116> 2024-09-12T17:37:33.337+0000 7ff94940f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:33.647 INFO:tasks.workunit.client.0.smithi037.stderr: -115> 2024-09-12T17:37:33.337+0000 7ff94940f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:37:33.647 INFO:tasks.workunit.client.0.smithi037.stderr: -114> 2024-09-12T17:37:33.337+0000 7ff94940f800 20 rados->read ofs=0 len=0 2024-09-12T17:37:33.647 INFO:tasks.workunit.client.0.smithi037.stderr: -113> 2024-09-12T17:37:33.338+0000 7ff94940f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:33.647 INFO:tasks.workunit.client.0.smithi037.stderr: -112> 2024-09-12T17:37:33.338+0000 7ff94940f800 20 rados->read ofs=0 len=0 2024-09-12T17:37:33.647 INFO:tasks.workunit.client.0.smithi037.stderr: -111> 2024-09-12T17:37:33.338+0000 7ff944b48640 10 monclient: get_auth_request con 0x564fe5620f20 auth_method 0 2024-09-12T17:37:33.648 INFO:tasks.workunit.client.0.smithi037.stderr: -110> 2024-09-12T17:37:33.338+0000 7ff94940f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:37:33.648 INFO:tasks.workunit.client.0.smithi037.stderr: -109> 2024-09-12T17:37:33.338+0000 7ff94940f800 20 rados->read ofs=0 len=0 2024-09-12T17:37:33.648 INFO:tasks.workunit.client.0.smithi037.stderr: -108> 2024-09-12T17:37:33.339+0000 7ff94940f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:37:33.648 INFO:tasks.workunit.client.0.smithi037.stderr: -107> 2024-09-12T17:37:33.339+0000 7ff94940f800 20 searching for the correct realm 2024-09-12T17:37:33.648 INFO:tasks.workunit.client.0.smithi037.stderr: -106> 2024-09-12T17:37:33.339+0000 7ff944347640 10 monclient: get_auth_request con 0x564fe56261a0 auth_method 0 2024-09-12T17:37:33.648 INFO:tasks.workunit.client.0.smithi037.stderr: -105> 2024-09-12T17:37:33.340+0000 7ff945349640 10 monclient: get_auth_request con 0x7ff93806f4e0 auth_method 0 2024-09-12T17:37:33.648 INFO:tasks.workunit.client.0.smithi037.stderr: -104> 2024-09-12T17:37:33.340+0000 7ff944b48640 10 monclient: get_auth_request con 0x7ff93c079040 auth_method 0 2024-09-12T17:37:33.648 INFO:tasks.workunit.client.0.smithi037.stderr: -103> 2024-09-12T17:37:33.341+0000 7ff944347640 10 monclient: get_auth_request con 0x7ff93400e070 auth_method 0 2024-09-12T17:37:33.648 INFO:tasks.workunit.client.0.smithi037.stderr: -102> 2024-09-12T17:37:33.342+0000 7ff944347640 0 -- 172.21.15.37:0/2870448384 >> [v2:172.21.15.40:6800/2441293461,v1:172.21.15.40:6801/2441293461] conn(0x7ff93400e070 msgr2=0x7ff934082a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:37:33.648 INFO:tasks.workunit.client.0.smithi037.stderr: -101> 2024-09-12T17:37:33.342+0000 7ff81a7fc640 1 client.8289.objecter ms_handle_reset 0x7ff93400e070 session 0x7ff934080040 osd.4 2024-09-12T17:37:33.648 INFO:tasks.workunit.client.0.smithi037.stderr: -100> 2024-09-12T17:37:33.342+0000 7ff81a7fc640 10 monclient: _renew_subs 2024-09-12T17:37:33.648 INFO:tasks.workunit.client.0.smithi037.stderr: -99> 2024-09-12T17:37:33.342+0000 7ff81a7fc640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.37:3300/0 2024-09-12T17:37:33.648 INFO:tasks.workunit.client.0.smithi037.stderr: -98> 2024-09-12T17:37:33.342+0000 7ff944347640 10 monclient: get_auth_request con 0x7ff810086b40 auth_method 0 2024-09-12T17:37:33.649 INFO:tasks.workunit.client.0.smithi037.stderr: -97> 2024-09-12T17:37:33.343+0000 7ff945349640 10 monclient: get_auth_request con 0x7ff938003090 auth_method 0 2024-09-12T17:37:33.649 INFO:tasks.workunit.client.0.smithi037.stderr: -96> 2024-09-12T17:37:33.345+0000 7ff944b48640 10 monclient: get_auth_request con 0x7ff93806f980 auth_method 0 2024-09-12T17:37:33.649 INFO:tasks.workunit.client.0.smithi037.stderr: -95> 2024-09-12T17:37:33.345+0000 7ff944b48640 0 -- 172.21.15.37:0/2870448384 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7ff93806f980 msgr2=0x7ff93803e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:37:33.649 INFO:tasks.workunit.client.0.smithi037.stderr: -94> 2024-09-12T17:37:33.546+0000 7ff944b48640 10 monclient: get_auth_request con 0x7ff93806f980 auth_method 0 2024-09-12T17:37:33.649 INFO:tasks.workunit.client.0.smithi037.stderr: -93> 2024-09-12T17:37:33.551+0000 7ff94940f800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:37:33.649 INFO:tasks.workunit.client.0.smithi037.stderr: -92> 2024-09-12T17:37:33.551+0000 7ff94940f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:37:33.649 INFO:tasks.workunit.client.0.smithi037.stderr: -91> 2024-09-12T17:37:33.551+0000 7ff94940f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:37:33.649 INFO:tasks.workunit.client.0.smithi037.stderr: -90> 2024-09-12T17:37:33.551+0000 7ff94940f800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:37:33.649 INFO:tasks.workunit.client.0.smithi037.stderr: -89> 2024-09-12T17:37:33.551+0000 7ff94940f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:37:33.649 INFO:tasks.workunit.client.0.smithi037.stderr: -88> 2024-09-12T17:37:33.551+0000 7ff94940f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:37:33.649 INFO:tasks.workunit.client.0.smithi037.stderr: -87> 2024-09-12T17:37:33.551+0000 7ff94940f800 20 rados->read ofs=0 len=0 2024-09-12T17:37:33.649 INFO:tasks.workunit.client.0.smithi037.stderr: -86> 2024-09-12T17:37:33.552+0000 7ff94940f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:33.649 INFO:tasks.workunit.client.0.smithi037.stderr: -85> 2024-09-12T17:37:33.552+0000 7ff94940f800 20 rados->read ofs=0 len=0 2024-09-12T17:37:33.650 INFO:tasks.workunit.client.0.smithi037.stderr: -84> 2024-09-12T17:37:33.552+0000 7ff94940f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:37:33.650 INFO:tasks.workunit.client.0.smithi037.stderr: -83> 2024-09-12T17:37:33.552+0000 7ff94940f800 20 rados->read ofs=0 len=0 2024-09-12T17:37:33.650 INFO:tasks.workunit.client.0.smithi037.stderr: -82> 2024-09-12T17:37:33.552+0000 7ff94940f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:37:33.650 INFO:tasks.workunit.client.0.smithi037.stderr: -81> 2024-09-12T17:37:33.552+0000 7ff94940f800 20 zone default found 2024-09-12T17:37:33.650 INFO:tasks.workunit.client.0.smithi037.stderr: -80> 2024-09-12T17:37:33.552+0000 7ff94940f800 4 Realm: () 2024-09-12T17:37:33.650 INFO:tasks.workunit.client.0.smithi037.stderr: -79> 2024-09-12T17:37:33.552+0000 7ff94940f800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:37:33.650 INFO:tasks.workunit.client.0.smithi037.stderr: -78> 2024-09-12T17:37:33.552+0000 7ff94940f800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:37:33.650 INFO:tasks.workunit.client.0.smithi037.stderr: -77> 2024-09-12T17:37:33.552+0000 7ff94940f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:37:33.650 INFO:tasks.workunit.client.0.smithi037.stderr: -76> 2024-09-12T17:37:33.552+0000 7ff94940f800 20 zonegroup default 2024-09-12T17:37:33.650 INFO:tasks.workunit.client.0.smithi037.stderr: -75> 2024-09-12T17:37:33.552+0000 7ff94940f800 20 rados->read ofs=0 len=0 2024-09-12T17:37:33.650 INFO:tasks.workunit.client.0.smithi037.stderr: -74> 2024-09-12T17:37:33.553+0000 7ff94940f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:33.650 INFO:tasks.workunit.client.0.smithi037.stderr: -73> 2024-09-12T17:37:33.553+0000 7ff94940f800 20 rados->read ofs=0 len=0 2024-09-12T17:37:33.650 INFO:tasks.workunit.client.0.smithi037.stderr: -72> 2024-09-12T17:37:33.553+0000 7ff94940f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:33.650 INFO:tasks.workunit.client.0.smithi037.stderr: -71> 2024-09-12T17:37:33.553+0000 7ff94940f800 20 rados->read ofs=0 len=0 2024-09-12T17:37:33.651 INFO:tasks.workunit.client.0.smithi037.stderr: -70> 2024-09-12T17:37:33.554+0000 7ff94940f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:33.651 INFO:tasks.workunit.client.0.smithi037.stderr: -69> 2024-09-12T17:37:33.554+0000 7ff94940f800 20 started sync module instance, tier type = 2024-09-12T17:37:33.651 INFO:tasks.workunit.client.0.smithi037.stderr: -68> 2024-09-12T17:37:33.554+0000 7ff94940f800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:37:33.651 INFO:tasks.workunit.client.0.smithi037.stderr: -67> 2024-09-12T17:37:33.564+0000 7ff94940f800 20 add_watcher() i=0 2024-09-12T17:37:33.651 INFO:tasks.workunit.client.0.smithi037.stderr: -66> 2024-09-12T17:37:33.564+0000 7ff94940f800 20 add_watcher() i=1 2024-09-12T17:37:33.651 INFO:tasks.workunit.client.0.smithi037.stderr: -65> 2024-09-12T17:37:33.564+0000 7ff94940f800 20 add_watcher() i=2 2024-09-12T17:37:33.651 INFO:tasks.workunit.client.0.smithi037.stderr: -64> 2024-09-12T17:37:33.564+0000 7ff94940f800 20 add_watcher() i=3 2024-09-12T17:37:33.651 INFO:tasks.workunit.client.0.smithi037.stderr: -63> 2024-09-12T17:37:33.564+0000 7ff94940f800 20 add_watcher() i=4 2024-09-12T17:37:33.651 INFO:tasks.workunit.client.0.smithi037.stderr: -62> 2024-09-12T17:37:33.564+0000 7ff94940f800 20 add_watcher() i=5 2024-09-12T17:37:33.651 INFO:tasks.workunit.client.0.smithi037.stderr: -61> 2024-09-12T17:37:33.565+0000 7ff94940f800 20 add_watcher() i=6 2024-09-12T17:37:33.651 INFO:tasks.workunit.client.0.smithi037.stderr: -60> 2024-09-12T17:37:33.565+0000 7ff94940f800 20 add_watcher() i=7 2024-09-12T17:37:33.651 INFO:tasks.workunit.client.0.smithi037.stderr: -59> 2024-09-12T17:37:33.565+0000 7ff94940f800 2 all 8 watchers are set, enabling cache 2024-09-12T17:37:33.651 INFO:tasks.workunit.client.0.smithi037.stderr: -58> 2024-09-12T17:37:33.568+0000 7ff94940f800 5 AuthRegistry(0x7ffef42b9e30) adding auth protocol: cephx 2024-09-12T17:37:33.652 INFO:tasks.workunit.client.0.smithi037.stderr: -57> 2024-09-12T17:37:33.568+0000 7ff94940f800 5 AuthRegistry(0x7ffef42b9e30) adding auth protocol: cephx 2024-09-12T17:37:33.652 INFO:tasks.workunit.client.0.smithi037.stderr: -56> 2024-09-12T17:37:33.568+0000 7ff94940f800 5 AuthRegistry(0x7ffef42b9e30) adding auth protocol: cephx 2024-09-12T17:37:33.652 INFO:tasks.workunit.client.0.smithi037.stderr: -55> 2024-09-12T17:37:33.568+0000 7ff94940f800 5 AuthRegistry(0x7ffef42b9e30) adding con mode: secure 2024-09-12T17:37:33.652 INFO:tasks.workunit.client.0.smithi037.stderr: -54> 2024-09-12T17:37:33.568+0000 7ff94940f800 5 AuthRegistry(0x7ffef42b9e30) adding con mode: crc 2024-09-12T17:37:33.652 INFO:tasks.workunit.client.0.smithi037.stderr: -53> 2024-09-12T17:37:33.568+0000 7ff94940f800 5 AuthRegistry(0x7ffef42b9e30) adding con mode: secure 2024-09-12T17:37:33.652 INFO:tasks.workunit.client.0.smithi037.stderr: -52> 2024-09-12T17:37:33.568+0000 7ff94940f800 5 AuthRegistry(0x7ffef42b9e30) adding con mode: crc 2024-09-12T17:37:33.652 INFO:tasks.workunit.client.0.smithi037.stderr: -51> 2024-09-12T17:37:33.568+0000 7ff7fb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:37:33.652 INFO:tasks.workunit.client.0.smithi037.stderr: -50> 2024-09-12T17:37:33.568+0000 7ff94940f800 5 AuthRegistry(0x7ffef42b9e30) adding con mode: secure 2024-09-12T17:37:33.652 INFO:tasks.workunit.client.0.smithi037.stderr: -49> 2024-09-12T17:37:33.568+0000 7ff94940f800 5 AuthRegistry(0x7ffef42b9e30) adding con mode: crc 2024-09-12T17:37:33.652 INFO:tasks.workunit.client.0.smithi037.stderr: -48> 2024-09-12T17:37:33.568+0000 7ff94940f800 5 AuthRegistry(0x7ffef42b9e30) adding con mode: crc 2024-09-12T17:37:33.652 INFO:tasks.workunit.client.0.smithi037.stderr: -47> 2024-09-12T17:37:33.568+0000 7ff94940f800 5 AuthRegistry(0x7ffef42b9e30) adding con mode: secure 2024-09-12T17:37:33.652 INFO:tasks.workunit.client.0.smithi037.stderr: -46> 2024-09-12T17:37:33.568+0000 7ff94940f800 5 AuthRegistry(0x7ffef42b9e30) adding con mode: crc 2024-09-12T17:37:33.652 INFO:tasks.workunit.client.0.smithi037.stderr: -45> 2024-09-12T17:37:33.568+0000 7ff94940f800 5 AuthRegistry(0x7ffef42b9e30) adding con mode: secure 2024-09-12T17:37:33.653 INFO:tasks.workunit.client.0.smithi037.stderr: -44> 2024-09-12T17:37:33.568+0000 7ff94940f800 5 AuthRegistry(0x7ffef42b9e30) adding con mode: crc 2024-09-12T17:37:33.653 INFO:tasks.workunit.client.0.smithi037.stderr: -43> 2024-09-12T17:37:33.568+0000 7ff94940f800 5 AuthRegistry(0x7ffef42b9e30) adding con mode: secure 2024-09-12T17:37:33.653 INFO:tasks.workunit.client.0.smithi037.stderr: -42> 2024-09-12T17:37:33.568+0000 7ff94940f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:37:33.653 INFO:tasks.workunit.client.0.smithi037.stderr: -41> 2024-09-12T17:37:33.568+0000 7ff94940f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:37:33.653 INFO:tasks.workunit.client.0.smithi037.stderr: -40> 2024-09-12T17:37:33.568+0000 7ff94940f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:37:33.653 INFO:tasks.workunit.client.0.smithi037.stderr: -39> 2024-09-12T17:37:33.568+0000 7ff94940f800 5 asok(0x564fe530e730) register_command cache list hook 0x564fe55f91c0 2024-09-12T17:37:33.653 INFO:tasks.workunit.client.0.smithi037.stderr: -38> 2024-09-12T17:37:33.568+0000 7ff94940f800 5 asok(0x564fe530e730) register_command cache inspect hook 0x564fe55f91c0 2024-09-12T17:37:33.653 INFO:tasks.workunit.client.0.smithi037.stderr: -37> 2024-09-12T17:37:33.568+0000 7ff94940f800 5 asok(0x564fe530e730) register_command cache erase hook 0x564fe55f91c0 2024-09-12T17:37:33.653 INFO:tasks.workunit.client.0.smithi037.stderr: -36> 2024-09-12T17:37:33.568+0000 7ff94940f800 5 asok(0x564fe530e730) register_command cache zap hook 0x564fe55f91c0 2024-09-12T17:37:33.653 INFO:tasks.workunit.client.0.smithi037.stderr: -35> 2024-09-12T17:37:33.568+0000 7ff94940f800 5 note: GC not initialized 2024-09-12T17:37:33.653 INFO:tasks.workunit.client.0.smithi037.stderr: -34> 2024-09-12T17:37:33.568+0000 7ff7fa7e4640 20 reqs_thread_entry: start 2024-09-12T17:37:33.653 INFO:tasks.workunit.client.0.smithi037.stderr: -33> 2024-09-12T17:37:33.568+0000 7ff94940f800 5 asok(0x564fe530e730) register_command sync trace show hook 0x7ff93c04dda0 2024-09-12T17:37:33.653 INFO:tasks.workunit.client.0.smithi037.stderr: -32> 2024-09-12T17:37:33.568+0000 7ff94940f800 5 asok(0x564fe530e730) register_command sync trace history hook 0x7ff93c04dda0 2024-09-12T17:37:33.653 INFO:tasks.workunit.client.0.smithi037.stderr: -31> 2024-09-12T17:37:33.568+0000 7ff94940f800 5 asok(0x564fe530e730) register_command sync trace active hook 0x7ff93c04dda0 2024-09-12T17:37:33.654 INFO:tasks.workunit.client.0.smithi037.stderr: -30> 2024-09-12T17:37:33.568+0000 7ff94940f800 5 asok(0x564fe530e730) register_command sync trace active_short hook 0x7ff93c04dda0 2024-09-12T17:37:33.654 INFO:tasks.workunit.client.0.smithi037.stderr: -29> 2024-09-12T17:37:33.568+0000 7ff94940f800 20 init_complete bucket index max shards: 11 2024-09-12T17:37:33.654 INFO:tasks.workunit.client.0.smithi037.stderr: -28> 2024-09-12T17:37:33.569+0000 7ff94940f800 20 Filter name: none 2024-09-12T17:37:33.654 INFO:tasks.workunit.client.0.smithi037.stderr: -27> 2024-09-12T17:37:33.569+0000 7ff7f37fe640 20 reqs_thread_entry: start 2024-09-12T17:37:33.654 INFO:tasks.workunit.client.0.smithi037.stderr: -26> 2024-09-12T17:37:33.569+0000 7ff94940f800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:37:33.654 INFO:tasks.workunit.client.0.smithi037.stderr: -25> 2024-09-12T17:37:33.569+0000 7ff94940f800 20 rados->read ofs=0 len=0 2024-09-12T17:37:33.654 INFO:tasks.workunit.client.0.smithi037.stderr: -24> 2024-09-12T17:37:33.569+0000 7ff94940f800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:37:33.654 INFO:tasks.workunit.client.0.smithi037.stderr: -23> 2024-09-12T17:37:33.569+0000 7ff94940f800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:37:33.654 INFO:tasks.workunit.client.0.smithi037.stderr: -22> 2024-09-12T17:37:33.569+0000 7ff94940f800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:37:33.654 INFO:tasks.workunit.client.0.smithi037.stderr: -21> 2024-09-12T17:37:33.569+0000 7ff94940f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 : miss 2024-09-12T17:37:33.654 INFO:tasks.workunit.client.0.smithi037.stderr: -20> 2024-09-12T17:37:33.569+0000 7ff94940f800 20 rados->read ofs=0 len=0 2024-09-12T17:37:33.654 INFO:tasks.workunit.client.0.smithi037.stderr: -19> 2024-09-12T17:37:33.570+0000 7ff94940f800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:37:33.655 INFO:tasks.workunit.client.0.smithi037.stderr: -18> 2024-09-12T17:37:33.570+0000 7ff94940f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 info.flags=0x17 2024-09-12T17:37:33.655 INFO:tasks.workunit.client.0.smithi037.stderr: -17> 2024-09-12T17:37:33.570+0000 7ff94940f800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 to cache LRU end 2024-09-12T17:37:33.655 INFO:tasks.workunit.client.0.smithi037.stderr: -16> 2024-09-12T17:37:33.570+0000 7ff94940f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:37:33.655 INFO:tasks.workunit.client.0.smithi037.stderr: -15> 2024-09-12T17:37:33.570+0000 7ff94940f800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:37:33.655 INFO:tasks.workunit.client.0.smithi037.stderr: -14> 2024-09-12T17:37:33.570+0000 7ff94940f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 2024-09-12T17:37:33.655 INFO:tasks.workunit.client.0.smithi037.stderr: -13> 2024-09-12T17:37:33.576+0000 7ff94940f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 info.flags=0x17 2024-09-12T17:37:33.655 INFO:tasks.workunit.client.0.smithi037.stderr: -12> 2024-09-12T17:37:33.576+0000 7ff94940f800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 to cache LRU end 2024-09-12T17:37:33.655 INFO:tasks.workunit.client.0.smithi037.stderr: -11> 2024-09-12T17:37:33.576+0000 7ff94940f800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:37:33.655 INFO:tasks.workunit.client.0.smithi037.stderr: -10> 2024-09-12T17:37:33.576+0000 7ff94940f800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18, ofs0, ns] 2024-09-12T17:37:33.655 INFO:tasks.workunit.client.0.smithi037.stderr: -9> 2024-09-12T17:37:33.576+0000 7ff81bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497019 cookie 94901150878768 notifier 8289 bl.length()=911 2024-09-12T17:37:33.655 INFO:tasks.workunit.client.0.smithi037.stderr: -8> 2024-09-12T17:37:33.576+0000 7ff81bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 info.flags=0x17 2024-09-12T17:37:33.655 INFO:tasks.workunit.client.0.smithi037.stderr: -7> 2024-09-12T17:37:33.576+0000 7ff81bfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 to cache LRU end 2024-09-12T17:37:33.655 INFO:tasks.workunit.client.0.smithi037.stderr: -6> 2024-09-12T17:37:33.576+0000 7ff81bfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:37:33.656 INFO:tasks.workunit.client.0.smithi037.stderr: -5> 2024-09-12T17:37:33.578+0000 7ff94940f800 20 handle_bi_update(): bucket=:a-bucket[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18]): orig_sources= new_sources= 2024-09-12T17:37:33.656 INFO:tasks.workunit.client.0.smithi037.stderr: -4> 2024-09-12T17:37:33.578+0000 7ff94940f800 20 handle_bi_update(): bucket=:a-bucket[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18]): potential sources added=[] removed=[] 2024-09-12T17:37:33.656 INFO:tasks.workunit.client.0.smithi037.stderr: -3> 2024-09-12T17:37:33.578+0000 7ff94940f800 20 handle_bi_update(): bucket=:a-bucket[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18]): orig_dests= new_dests= 2024-09-12T17:37:33.656 INFO:tasks.workunit.client.0.smithi037.stderr: -2> 2024-09-12T17:37:33.578+0000 7ff94940f800 20 handle_bi_update(): bucket=:a-bucket[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18]): potential dests added=[] removed=[] 2024-09-12T17:37:33.656 INFO:tasks.workunit.client.0.smithi037.stderr: -1> 2024-09-12T17:37:33.584+0000 7ff94940f800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7ff94940f800 time 2024-09-12T17:37:33.585025+0000 2024-09-12T17:37:33.656 INFO:tasks.workunit.client.0.smithi037.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:37:33.656 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:37:33.656 INFO:tasks.workunit.client.0.smithi037.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:37:33.656 INFO:tasks.workunit.client.0.smithi037.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7ff94a58c71a] 2024-09-12T17:37:33.656 INFO:tasks.workunit.client.0.smithi037.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7ff94a58c8d8] 2024-09-12T17:37:33.656 INFO:tasks.workunit.client.0.smithi037.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x564fe4049841] 2024-09-12T17:37:33.656 INFO:tasks.workunit.client.0.smithi037.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x564fe405957a] 2024-09-12T17:37:33.657 INFO:tasks.workunit.client.0.smithi037.stderr: 5: main() 2024-09-12T17:37:33.657 INFO:tasks.workunit.client.0.smithi037.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7ff949229590] 2024-09-12T17:37:33.657 INFO:tasks.workunit.client.0.smithi037.stderr: 7: __libc_start_main() 2024-09-12T17:37:33.657 INFO:tasks.workunit.client.0.smithi037.stderr: 8: _start() 2024-09-12T17:37:33.657 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:37:33.657 INFO:tasks.workunit.client.0.smithi037.stderr: 0> 2024-09-12T17:37:33.585+0000 7ff94940f800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:37:33.657 INFO:tasks.workunit.client.0.smithi037.stderr: in thread 7ff94940f800 thread_name:radosgw-admin 2024-09-12T17:37:33.657 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:37:33.657 INFO:tasks.workunit.client.0.smithi037.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:37:33.657 INFO:tasks.workunit.client.0.smithi037.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7ff94923e6f0] 2024-09-12T17:37:33.657 INFO:tasks.workunit.client.0.smithi037.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7ff94928b99c] 2024-09-12T17:37:33.657 INFO:tasks.workunit.client.0.smithi037.stderr: 3: raise() 2024-09-12T17:37:33.657 INFO:tasks.workunit.client.0.smithi037.stderr: 4: abort() 2024-09-12T17:37:33.658 INFO:tasks.workunit.client.0.smithi037.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7ff94a58c774] 2024-09-12T17:37:33.658 INFO:tasks.workunit.client.0.smithi037.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7ff94a58c8d8] 2024-09-12T17:37:33.658 INFO:tasks.workunit.client.0.smithi037.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x564fe4049841] 2024-09-12T17:37:33.658 INFO:tasks.workunit.client.0.smithi037.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x564fe405957a] 2024-09-12T17:37:33.658 INFO:tasks.workunit.client.0.smithi037.stderr: 9: main() 2024-09-12T17:37:33.658 INFO:tasks.workunit.client.0.smithi037.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7ff949229590] 2024-09-12T17:37:33.658 INFO:tasks.workunit.client.0.smithi037.stderr: 11: __libc_start_main() 2024-09-12T17:37:33.658 INFO:tasks.workunit.client.0.smithi037.stderr: 12: _start() 2024-09-12T17:37:33.658 INFO:tasks.workunit.client.0.smithi037.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:37:33.658 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:37:33.658 INFO:tasks.workunit.client.0.smithi037.stderr:--- logging levels --- 2024-09-12T17:37:33.658 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 none 2024-09-12T17:37:33.658 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 lockdep 2024-09-12T17:37:33.658 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 context 2024-09-12T17:37:33.659 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 1 crush 2024-09-12T17:37:33.659 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mds 2024-09-12T17:37:33.659 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mds_balancer 2024-09-12T17:37:33.659 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mds_locker 2024-09-12T17:37:33.659 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mds_log 2024-09-12T17:37:33.659 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mds_log_expire 2024-09-12T17:37:33.659 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mds_migrator 2024-09-12T17:37:33.659 INFO:tasks.workunit.client.0.smithi037.stderr: 3/ 5 mds_quiesce 2024-09-12T17:37:33.659 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 buffer 2024-09-12T17:37:33.659 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 timer 2024-09-12T17:37:33.659 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 filer 2024-09-12T17:37:33.659 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 striper 2024-09-12T17:37:33.659 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 objecter 2024-09-12T17:37:33.660 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 rados 2024-09-12T17:37:33.660 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 rbd 2024-09-12T17:37:33.660 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 rbd_mirror 2024-09-12T17:37:33.660 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 rbd_replay 2024-09-12T17:37:33.660 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 rbd_pwl 2024-09-12T17:37:33.660 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 journaler 2024-09-12T17:37:33.660 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 objectcacher 2024-09-12T17:37:33.660 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:37:33.660 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 client 2024-09-12T17:37:33.660 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 osd 2024-09-12T17:37:33.660 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 optracker 2024-09-12T17:37:33.660 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 objclass 2024-09-12T17:37:33.660 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 3 filestore 2024-09-12T17:37:33.661 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 3 journal 2024-09-12T17:37:33.661 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 0 ms 2024-09-12T17:37:33.661 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mon 2024-09-12T17:37:33.661 INFO:tasks.workunit.client.0.smithi037.stderr: 0/10 monc 2024-09-12T17:37:33.661 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 paxos 2024-09-12T17:37:33.661 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 tp 2024-09-12T17:37:33.661 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 auth 2024-09-12T17:37:33.661 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 crypto 2024-09-12T17:37:33.661 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 1 finisher 2024-09-12T17:37:33.661 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 1 reserver 2024-09-12T17:37:33.661 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 heartbeatmap 2024-09-12T17:37:33.661 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 perfcounter 2024-09-12T17:37:33.661 INFO:tasks.workunit.client.0.smithi037.stderr: 20/20 rgw 2024-09-12T17:37:33.661 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 rgw_sync 2024-09-12T17:37:33.662 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 rgw_datacache 2024-09-12T17:37:33.662 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 rgw_access 2024-09-12T17:37:33.662 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:37:33.662 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 rgw_flight 2024-09-12T17:37:33.662 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:37:33.662 INFO:tasks.workunit.client.0.smithi037.stderr: 20/20 rgw_notification 2024-09-12T17:37:33.662 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 javaclient 2024-09-12T17:37:33.662 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 asok 2024-09-12T17:37:33.662 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 1 throttle 2024-09-12T17:37:33.662 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 0 refs 2024-09-12T17:37:33.662 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 compressor 2024-09-12T17:37:33.662 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 bluestore 2024-09-12T17:37:33.662 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 bluefs 2024-09-12T17:37:33.663 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 3 bdev 2024-09-12T17:37:33.663 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 kstore 2024-09-12T17:37:33.663 INFO:tasks.workunit.client.0.smithi037.stderr: 4/ 5 rocksdb 2024-09-12T17:37:33.663 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 fuse 2024-09-12T17:37:33.663 INFO:tasks.workunit.client.0.smithi037.stderr: 2/ 5 mgr 2024-09-12T17:37:33.663 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mgrc 2024-09-12T17:37:33.663 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 dpdk 2024-09-12T17:37:33.663 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 eventtrace 2024-09-12T17:37:33.663 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 prioritycache 2024-09-12T17:37:33.663 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 test 2024-09-12T17:37:33.663 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:37:33.663 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 cephsqlite 2024-09-12T17:37:33.663 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:37:33.663 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore 2024-09-12T17:37:33.664 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_onode 2024-09-12T17:37:33.664 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_odata 2024-09-12T17:37:33.664 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_omap 2024-09-12T17:37:33.664 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_tm 2024-09-12T17:37:33.664 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_t 2024-09-12T17:37:33.664 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:37:33.664 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_epm 2024-09-12T17:37:33.664 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_lba 2024-09-12T17:37:33.664 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:37:33.664 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_cache 2024-09-12T17:37:33.664 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_journal 2024-09-12T17:37:33.664 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_device 2024-09-12T17:37:33.664 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_backref 2024-09-12T17:37:33.665 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 alienstore 2024-09-12T17:37:33.665 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mclock 2024-09-12T17:37:33.665 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 cyanstore 2024-09-12T17:37:33.665 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 ceph_exporter 2024-09-12T17:37:33.665 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 memstore 2024-09-12T17:37:33.665 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 trace 2024-09-12T17:37:33.665 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 ceph_dedup 2024-09-12T17:37:33.665 INFO:tasks.workunit.client.0.smithi037.stderr: -2/-2 (syslog threshold) 2024-09-12T17:37:33.665 INFO:tasks.workunit.client.0.smithi037.stderr: 99/99 (stderr threshold) 2024-09-12T17:37:33.665 INFO:tasks.workunit.client.0.smithi037.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:37:33.665 INFO:tasks.workunit.client.0.smithi037.stderr: 7ff7f37fe640 / http_manager 2024-09-12T17:37:33.665 INFO:tasks.workunit.client.0.smithi037.stderr: 7ff7fa7e4640 / http_manager 2024-09-12T17:37:33.665 INFO:tasks.workunit.client.0.smithi037.stderr: 7ff7fb7e6640 / rgw_dt_lg_renew 2024-09-12T17:37:33.665 INFO:tasks.workunit.client.0.smithi037.stderr: 7ff81a7fc640 / ms_dispatch 2024-09-12T17:37:33.666 INFO:tasks.workunit.client.0.smithi037.stderr: 7ff81bfff640 / io_context_pool 2024-09-12T17:37:33.666 INFO:tasks.workunit.client.0.smithi037.stderr: 7ff82a7fc640 / ms_dispatch 2024-09-12T17:37:33.666 INFO:tasks.workunit.client.0.smithi037.stderr: 7ff83160a640 / ms_dispatch 2024-09-12T17:37:33.666 INFO:tasks.workunit.client.0.smithi037.stderr: 7ff832e0d640 / io_context_pool 2024-09-12T17:37:33.666 INFO:tasks.workunit.client.0.smithi037.stderr: 7ff944347640 / msgr-worker-2 2024-09-12T17:37:33.666 INFO:tasks.workunit.client.0.smithi037.stderr: 7ff944b48640 / msgr-worker-1 2024-09-12T17:37:33.666 INFO:tasks.workunit.client.0.smithi037.stderr: 7ff945349640 / msgr-worker-0 2024-09-12T17:37:33.666 INFO:tasks.workunit.client.0.smithi037.stderr: 7ff945b4a640 / io_context_pool 2024-09-12T17:37:33.666 INFO:tasks.workunit.client.0.smithi037.stderr: 7ff94940f800 / radosgw-admin 2024-09-12T17:37:33.666 INFO:tasks.workunit.client.0.smithi037.stderr: max_recent 500 2024-09-12T17:37:33.666 INFO:tasks.workunit.client.0.smithi037.stderr: max_new 1000 2024-09-12T17:37:33.666 INFO:tasks.workunit.client.0.smithi037.stderr: log_file /var/log/ceph/ceph-client.admin.150860.log 2024-09-12T17:37:33.666 INFO:tasks.workunit.client.0.smithi037.stderr:--- end dump of recent events --- 2024-09-12T17:37:33.667 INFO:tasks.workunit.client.0.smithi037.stderr:--- begin dump of recent events --- 2024-09-12T17:37:33.667 INFO:tasks.workunit.client.0.smithi037.stderr: -499> 2024-09-12T17:37:33.319+0000 7ff94940f800 5 asok(0x564fe530e730) unregister_commands rotate-key 2024-09-12T17:37:33.667 INFO:tasks.workunit.client.0.smithi037.stderr: -498> 2024-09-12T17:37:33.319+0000 7ff94940f800 10 monclient: build_initial_monmap 2024-09-12T17:37:33.667 INFO:tasks.workunit.client.0.smithi037.stderr: -497> 2024-09-12T17:37:33.319+0000 7ff94940f800 1 build_initial for_mkfs: 0 2024-09-12T17:37:33.667 INFO:tasks.workunit.client.0.smithi037.stderr: -496> 2024-09-12T17:37:33.319+0000 7ff94940f800 10 monclient: monmap: 2024-09-12T17:37:33.667 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 0 2024-09-12T17:37:33.667 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:37:33.667 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 0.000000 2024-09-12T17:37:33.667 INFO:tasks.workunit.client.0.smithi037.stderr:created 0.000000 2024-09-12T17:37:33.667 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 0 (unknown) 2024-09-12T17:37:33.667 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:37:33.667 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.noname-a 2024-09-12T17:37:33.667 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.noname-b 2024-09-12T17:37:33.667 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.noname-c 2024-09-12T17:37:33.668 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:37:33.668 INFO:tasks.workunit.client.0.smithi037.stderr: -495> 2024-09-12T17:37:33.319+0000 7ff94940f800 5 AuthRegistry(0x564fe55351b0) adding auth protocol: cephx 2024-09-12T17:37:33.668 INFO:tasks.workunit.client.0.smithi037.stderr: -494> 2024-09-12T17:37:33.319+0000 7ff94940f800 5 AuthRegistry(0x564fe55351b0) adding auth protocol: cephx 2024-09-12T17:37:33.668 INFO:tasks.workunit.client.0.smithi037.stderr: -493> 2024-09-12T17:37:33.319+0000 7ff94940f800 5 AuthRegistry(0x564fe55351b0) adding auth protocol: cephx 2024-09-12T17:37:33.668 INFO:tasks.workunit.client.0.smithi037.stderr: -492> 2024-09-12T17:37:33.319+0000 7ff94940f800 5 AuthRegistry(0x564fe55351b0) adding con mode: secure 2024-09-12T17:37:33.668 INFO:tasks.workunit.client.0.smithi037.stderr: -491> 2024-09-12T17:37:33.319+0000 7ff94940f800 5 AuthRegistry(0x564fe55351b0) adding con mode: crc 2024-09-12T17:37:33.668 INFO:tasks.workunit.client.0.smithi037.stderr: -490> 2024-09-12T17:37:33.319+0000 7ff94940f800 5 AuthRegistry(0x564fe55351b0) adding con mode: secure 2024-09-12T17:37:33.668 INFO:tasks.workunit.client.0.smithi037.stderr: -489> 2024-09-12T17:37:33.319+0000 7ff94940f800 5 AuthRegistry(0x564fe55351b0) adding con mode: crc 2024-09-12T17:37:33.668 INFO:tasks.workunit.client.0.smithi037.stderr: -488> 2024-09-12T17:37:33.319+0000 7ff94940f800 5 AuthRegistry(0x564fe55351b0) adding con mode: secure 2024-09-12T17:37:33.668 INFO:tasks.workunit.client.0.smithi037.stderr: -487> 2024-09-12T17:37:33.319+0000 7ff94940f800 5 AuthRegistry(0x564fe55351b0) adding con mode: crc 2024-09-12T17:37:33.668 INFO:tasks.workunit.client.0.smithi037.stderr: -486> 2024-09-12T17:37:33.319+0000 7ff94940f800 5 AuthRegistry(0x564fe55351b0) adding con mode: crc 2024-09-12T17:37:33.668 INFO:tasks.workunit.client.0.smithi037.stderr: -485> 2024-09-12T17:37:33.319+0000 7ff94940f800 5 AuthRegistry(0x564fe55351b0) adding con mode: secure 2024-09-12T17:37:33.668 INFO:tasks.workunit.client.0.smithi037.stderr: -484> 2024-09-12T17:37:33.319+0000 7ff94940f800 5 AuthRegistry(0x564fe55351b0) adding con mode: crc 2024-09-12T17:37:33.669 INFO:tasks.workunit.client.0.smithi037.stderr: -483> 2024-09-12T17:37:33.319+0000 7ff94940f800 5 AuthRegistry(0x564fe55351b0) adding con mode: secure 2024-09-12T17:37:33.669 INFO:tasks.workunit.client.0.smithi037.stderr: -482> 2024-09-12T17:37:33.319+0000 7ff94940f800 5 AuthRegistry(0x564fe55351b0) adding con mode: crc 2024-09-12T17:37:33.669 INFO:tasks.workunit.client.0.smithi037.stderr: -481> 2024-09-12T17:37:33.319+0000 7ff94940f800 5 AuthRegistry(0x564fe55351b0) adding con mode: secure 2024-09-12T17:37:33.669 INFO:tasks.workunit.client.0.smithi037.stderr: -480> 2024-09-12T17:37:33.319+0000 7ff94940f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:37:33.669 INFO:tasks.workunit.client.0.smithi037.stderr: -479> 2024-09-12T17:37:33.319+0000 7ff94940f800 1 librados: starting msgr at 2024-09-12T17:37:33.669 INFO:tasks.workunit.client.0.smithi037.stderr: -478> 2024-09-12T17:37:33.319+0000 7ff94940f800 1 librados: starting objecter 2024-09-12T17:37:33.669 INFO:tasks.workunit.client.0.smithi037.stderr: -477> 2024-09-12T17:37:33.319+0000 7ff94940f800 5 asok(0x564fe530e730) register_command objecter_requests hook 0x564fe5534a80 2024-09-12T17:37:33.669 INFO:tasks.workunit.client.0.smithi037.stderr: -476> 2024-09-12T17:37:33.319+0000 7ff94940f800 1 librados: setting wanted keys 2024-09-12T17:37:33.669 INFO:tasks.workunit.client.0.smithi037.stderr: -475> 2024-09-12T17:37:33.319+0000 7ff94940f800 1 librados: calling monclient init 2024-09-12T17:37:33.669 INFO:tasks.workunit.client.0.smithi037.stderr: -474> 2024-09-12T17:37:33.319+0000 7ff94940f800 10 monclient: init 2024-09-12T17:37:33.669 INFO:tasks.workunit.client.0.smithi037.stderr: -473> 2024-09-12T17:37:33.319+0000 7ff94940f800 5 AuthRegistry(0x564fe552fb80) adding auth protocol: cephx 2024-09-12T17:37:33.669 INFO:tasks.workunit.client.0.smithi037.stderr: -472> 2024-09-12T17:37:33.319+0000 7ff94940f800 5 AuthRegistry(0x564fe552fb80) adding auth protocol: cephx 2024-09-12T17:37:33.669 INFO:tasks.workunit.client.0.smithi037.stderr: -471> 2024-09-12T17:37:33.319+0000 7ff94940f800 5 AuthRegistry(0x564fe552fb80) adding auth protocol: cephx 2024-09-12T17:37:33.670 INFO:tasks.workunit.client.0.smithi037.stderr: -470> 2024-09-12T17:37:33.319+0000 7ff94940f800 5 AuthRegistry(0x564fe552fb80) adding con mode: secure 2024-09-12T17:37:33.670 INFO:tasks.workunit.client.0.smithi037.stderr: -469> 2024-09-12T17:37:33.319+0000 7ff94940f800 5 AuthRegistry(0x564fe552fb80) adding con mode: crc 2024-09-12T17:37:33.670 INFO:tasks.workunit.client.0.smithi037.stderr: -468> 2024-09-12T17:37:33.319+0000 7ff94940f800 5 AuthRegistry(0x564fe552fb80) adding con mode: secure 2024-09-12T17:37:33.670 INFO:tasks.workunit.client.0.smithi037.stderr: -467> 2024-09-12T17:37:33.319+0000 7ff94940f800 5 AuthRegistry(0x564fe552fb80) adding con mode: crc 2024-09-12T17:37:33.670 INFO:tasks.workunit.client.0.smithi037.stderr: -466> 2024-09-12T17:37:33.319+0000 7ff94940f800 5 AuthRegistry(0x564fe552fb80) adding con mode: secure 2024-09-12T17:37:33.670 INFO:tasks.workunit.client.0.smithi037.stderr: -465> 2024-09-12T17:37:33.319+0000 7ff94940f800 5 AuthRegistry(0x564fe552fb80) adding con mode: crc 2024-09-12T17:37:33.670 INFO:tasks.workunit.client.0.smithi037.stderr: -464> 2024-09-12T17:37:33.319+0000 7ff94940f800 5 AuthRegistry(0x564fe552fb80) adding con mode: crc 2024-09-12T17:37:33.670 INFO:tasks.workunit.client.0.smithi037.stderr: -463> 2024-09-12T17:37:33.319+0000 7ff94940f800 5 AuthRegistry(0x564fe552fb80) adding con mode: secure 2024-09-12T17:37:33.670 INFO:tasks.workunit.client.0.smithi037.stderr: -462> 2024-09-12T17:37:33.319+0000 7ff94940f800 5 AuthRegistry(0x564fe552fb80) adding con mode: crc 2024-09-12T17:37:33.670 INFO:tasks.workunit.client.0.smithi037.stderr: -461> 2024-09-12T17:37:33.319+0000 7ff94940f800 5 AuthRegistry(0x564fe552fb80) adding con mode: secure 2024-09-12T17:37:33.670 INFO:tasks.workunit.client.0.smithi037.stderr: -460> 2024-09-12T17:37:33.319+0000 7ff94940f800 5 AuthRegistry(0x564fe552fb80) adding con mode: crc 2024-09-12T17:37:33.670 INFO:tasks.workunit.client.0.smithi037.stderr: -459> 2024-09-12T17:37:33.319+0000 7ff94940f800 5 AuthRegistry(0x564fe552fb80) adding con mode: secure 2024-09-12T17:37:33.670 INFO:tasks.workunit.client.0.smithi037.stderr: -458> 2024-09-12T17:37:33.319+0000 7ff94940f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:37:33.670 INFO:tasks.workunit.client.0.smithi037.stderr: -457> 2024-09-12T17:37:33.320+0000 7ff94940f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:37:33.671 INFO:tasks.workunit.client.0.smithi037.stderr: -456> 2024-09-12T17:37:33.320+0000 7ff94940f800 5 asok(0x564fe530e730) register_command rotate-key hook 0x564fe552fcc8 2024-09-12T17:37:33.671 INFO:tasks.workunit.client.0.smithi037.stderr: -455> 2024-09-12T17:37:33.320+0000 7ff94940f800 10 monclient: _reopen_session rank -1 2024-09-12T17:37:33.671 INFO:tasks.workunit.client.0.smithi037.stderr: -454> 2024-09-12T17:37:33.320+0000 7ff94940f800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T17:37:33.671 INFO:tasks.workunit.client.0.smithi037.stderr: -453> 2024-09-12T17:37:33.320+0000 7ff94940f800 10 monclient(hunting): picked mon.noname-a con 0x564fe5475a40 addr [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] 2024-09-12T17:37:33.671 INFO:tasks.workunit.client.0.smithi037.stderr: -452> 2024-09-12T17:37:33.320+0000 7ff94940f800 10 monclient(hunting): picked mon.noname-b con 0x564fe5475e20 addr [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] 2024-09-12T17:37:33.671 INFO:tasks.workunit.client.0.smithi037.stderr: -451> 2024-09-12T17:37:33.320+0000 7ff94940f800 10 monclient(hunting): picked mon.noname-c con 0x564fe54791b0 addr [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] 2024-09-12T17:37:33.671 INFO:tasks.workunit.client.0.smithi037.stderr: -450> 2024-09-12T17:37:33.320+0000 7ff94940f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:37:33.671 INFO:tasks.workunit.client.0.smithi037.stderr: -449> 2024-09-12T17:37:33.320+0000 7ff94940f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:37:33.671 INFO:tasks.workunit.client.0.smithi037.stderr: -448> 2024-09-12T17:37:33.320+0000 7ff94940f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:37:33.671 INFO:tasks.workunit.client.0.smithi037.stderr: -447> 2024-09-12T17:37:33.320+0000 7ff94940f800 10 monclient(hunting): _renew_subs 2024-09-12T17:37:33.671 INFO:tasks.workunit.client.0.smithi037.stderr: -446> 2024-09-12T17:37:33.320+0000 7ff94940f800 10 monclient(hunting): authenticate will time out at 2440.917190s 2024-09-12T17:37:33.671 INFO:tasks.workunit.client.0.smithi037.stderr: -445> 2024-09-12T17:37:33.320+0000 7ff944b48640 10 monclient(hunting): get_auth_request con 0x564fe5475a40 auth_method 0 2024-09-12T17:37:33.671 INFO:tasks.workunit.client.0.smithi037.stderr: -444> 2024-09-12T17:37:33.320+0000 7ff944b48640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:37:33.672 INFO:tasks.workunit.client.0.smithi037.stderr: -443> 2024-09-12T17:37:33.320+0000 7ff944b48640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:37:33.672 INFO:tasks.workunit.client.0.smithi037.stderr: -442> 2024-09-12T17:37:33.320+0000 7ff944b48640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:37:33.672 INFO:tasks.workunit.client.0.smithi037.stderr: -441> 2024-09-12T17:37:33.320+0000 7ff945349640 10 monclient(hunting): get_auth_request con 0x564fe54791b0 auth_method 0 2024-09-12T17:37:33.672 INFO:tasks.workunit.client.0.smithi037.stderr: -440> 2024-09-12T17:37:33.320+0000 7ff945349640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:37:33.672 INFO:tasks.workunit.client.0.smithi037.stderr: -439> 2024-09-12T17:37:33.320+0000 7ff945349640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:37:33.672 INFO:tasks.workunit.client.0.smithi037.stderr: -438> 2024-09-12T17:37:33.320+0000 7ff945349640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:37:33.672 INFO:tasks.workunit.client.0.smithi037.stderr: -437> 2024-09-12T17:37:33.320+0000 7ff944b48640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:37:33.672 INFO:tasks.workunit.client.0.smithi037.stderr: -436> 2024-09-12T17:37:33.320+0000 7ff944b48640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:37:33.672 INFO:tasks.workunit.client.0.smithi037.stderr: -435> 2024-09-12T17:37:33.320+0000 7ff944b48640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:37:33.672 INFO:tasks.workunit.client.0.smithi037.stderr: -434> 2024-09-12T17:37:33.320+0000 7ff944347640 10 monclient(hunting): get_auth_request con 0x564fe5475e20 auth_method 0 2024-09-12T17:37:33.672 INFO:tasks.workunit.client.0.smithi037.stderr: -433> 2024-09-12T17:37:33.320+0000 7ff944347640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:37:33.672 INFO:tasks.workunit.client.0.smithi037.stderr: -432> 2024-09-12T17:37:33.320+0000 7ff944347640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:37:33.672 INFO:tasks.workunit.client.0.smithi037.stderr: -431> 2024-09-12T17:37:33.320+0000 7ff944347640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:37:33.673 INFO:tasks.workunit.client.0.smithi037.stderr: -430> 2024-09-12T17:37:33.320+0000 7ff945349640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:37:33.673 INFO:tasks.workunit.client.0.smithi037.stderr: -429> 2024-09-12T17:37:33.320+0000 7ff945349640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:37:33.673 INFO:tasks.workunit.client.0.smithi037.stderr: -428> 2024-09-12T17:37:33.320+0000 7ff945349640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:37:33.673 INFO:tasks.workunit.client.0.smithi037.stderr: -427> 2024-09-12T17:37:33.320+0000 7ff944b48640 10 monclient(hunting): handle_auth_done global_id 8280 payload 824 2024-09-12T17:37:33.673 INFO:tasks.workunit.client.0.smithi037.stderr: -426> 2024-09-12T17:37:33.320+0000 7ff944b48640 10 monclient: _finish_hunting 0 2024-09-12T17:37:33.673 INFO:tasks.workunit.client.0.smithi037.stderr: -425> 2024-09-12T17:37:33.320+0000 7ff944b48640 1 monclient: found mon.noname-a 2024-09-12T17:37:33.673 INFO:tasks.workunit.client.0.smithi037.stderr: -424> 2024-09-12T17:37:33.320+0000 7ff944b48640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.37:3300/0 2024-09-12T17:37:33.673 INFO:tasks.workunit.client.0.smithi037.stderr: -423> 2024-09-12T17:37:33.320+0000 7ff83160a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:37:33.673 INFO:tasks.workunit.client.0.smithi037.stderr: -422> 2024-09-12T17:37:33.320+0000 7ff83160a640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:37:33.673 INFO:tasks.workunit.client.0.smithi037.stderr: -421> 2024-09-12T17:37:33.320+0000 7ff83160a640 10 monclient: dump: 2024-09-12T17:37:33.673 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:37:33.673 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:37:33.673 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:37:33.673 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:37:33.674 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:37:33.674 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:37:33.674 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:37:33.674 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:37:33.674 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:37:33.674 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:37:33.674 INFO:tasks.workunit.client.0.smithi037.stderr: -420> 2024-09-12T17:37:33.320+0000 7ff83160a640 10 monclient: _finish_auth 0 2024-09-12T17:37:33.674 INFO:tasks.workunit.client.0.smithi037.stderr: -419> 2024-09-12T17:37:33.320+0000 7ff83160a640 10 monclient: _check_auth_tickets 2024-09-12T17:37:33.674 INFO:tasks.workunit.client.0.smithi037.stderr: -418> 2024-09-12T17:37:33.320+0000 7ff94940f800 5 monclient: authenticate success, global_id 8280 2024-09-12T17:37:33.674 INFO:tasks.workunit.client.0.smithi037.stderr: -417> 2024-09-12T17:37:33.320+0000 7ff94940f800 10 monclient: _renew_subs 2024-09-12T17:37:33.674 INFO:tasks.workunit.client.0.smithi037.stderr: -416> 2024-09-12T17:37:33.320+0000 7ff94940f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.37:3300/0 2024-09-12T17:37:33.674 INFO:tasks.workunit.client.0.smithi037.stderr: -415> 2024-09-12T17:37:33.320+0000 7ff83160a640 10 monclient: handle_config config(0 keys) 2024-09-12T17:37:33.674 INFO:tasks.workunit.client.0.smithi037.stderr: -414> 2024-09-12T17:37:33.320+0000 7ff83160a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:37:33.674 INFO:tasks.workunit.client.0.smithi037.stderr: -413> 2024-09-12T17:37:33.320+0000 7ff83160a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:37:33.675 INFO:tasks.workunit.client.0.smithi037.stderr: -412> 2024-09-12T17:37:33.320+0000 7ff83160a640 10 monclient: dump: 2024-09-12T17:37:33.675 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:37:33.675 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:37:33.675 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:37:33.675 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:37:33.675 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:37:33.675 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:37:33.675 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:37:33.675 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:37:33.675 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:37:33.675 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:37:33.675 INFO:tasks.workunit.client.0.smithi037.stderr: -411> 2024-09-12T17:37:33.320+0000 7ff832e0d640 4 set_mon_vals no callback set 2024-09-12T17:37:33.675 INFO:tasks.workunit.client.0.smithi037.stderr: -410> 2024-09-12T17:37:33.320+0000 7ff94940f800 10 monclient: _renew_subs 2024-09-12T17:37:33.675 INFO:tasks.workunit.client.0.smithi037.stderr: -409> 2024-09-12T17:37:33.320+0000 7ff94940f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.37:3300/0 2024-09-12T17:37:33.676 INFO:tasks.workunit.client.0.smithi037.stderr: -408> 2024-09-12T17:37:33.320+0000 7ff94940f800 1 librados: init done 2024-09-12T17:37:33.676 INFO:tasks.workunit.client.0.smithi037.stderr: -407> 2024-09-12T17:37:33.322+0000 7ff83160a640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:37:33.676 INFO:tasks.workunit.client.0.smithi037.stderr: -406> 2024-09-12T17:37:33.322+0000 7ff83160a640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.40:6816/3916250676,v1:172.21.15.40:6817/3916250676] 2024-09-12T17:37:33.676 INFO:tasks.workunit.client.0.smithi037.stderr: -405> 2024-09-12T17:37:33.322+0000 7ff83160a640 4 mgrc reconnect Starting new session with [v2:172.21.15.40:6816/3916250676,v1:172.21.15.40:6817/3916250676] 2024-09-12T17:37:33.676 INFO:tasks.workunit.client.0.smithi037.stderr: -404> 2024-09-12T17:37:33.323+0000 7ff944347640 10 monclient: get_auth_request con 0x7ff82c076470 auth_method 0 2024-09-12T17:37:33.676 INFO:tasks.workunit.client.0.smithi037.stderr: -403> 2024-09-12T17:37:33.323+0000 7ff945349640 10 monclient: get_auth_request con 0x564fe55585b0 auth_method 0 2024-09-12T17:37:33.676 INFO:tasks.workunit.client.0.smithi037.stderr: -402> 2024-09-12T17:37:33.324+0000 7ff944b48640 10 monclient: get_auth_request con 0x564fe557af20 auth_method 0 2024-09-12T17:37:33.676 INFO:tasks.workunit.client.0.smithi037.stderr: -401> 2024-09-12T17:37:33.325+0000 7ff944347640 10 monclient: get_auth_request con 0x564fe557e780 auth_method 0 2024-09-12T17:37:33.676 INFO:tasks.workunit.client.0.smithi037.stderr: -400> 2024-09-12T17:37:33.326+0000 7ff94940f800 10 monclient: build_initial_monmap 2024-09-12T17:37:33.676 INFO:tasks.workunit.client.0.smithi037.stderr: -399> 2024-09-12T17:37:33.326+0000 7ff94940f800 1 build_initial for_mkfs: 0 2024-09-12T17:37:33.676 INFO:tasks.workunit.client.0.smithi037.stderr: -398> 2024-09-12T17:37:33.326+0000 7ff94940f800 10 monclient: monmap: 2024-09-12T17:37:33.676 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 0 2024-09-12T17:37:33.676 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:37:33.677 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 0.000000 2024-09-12T17:37:33.677 INFO:tasks.workunit.client.0.smithi037.stderr:created 0.000000 2024-09-12T17:37:33.677 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 0 (unknown) 2024-09-12T17:37:33.677 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:37:33.677 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.noname-a 2024-09-12T17:37:33.677 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.noname-b 2024-09-12T17:37:33.677 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.noname-c 2024-09-12T17:37:33.677 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:37:33.677 INFO:tasks.workunit.client.0.smithi037.stderr: -397> 2024-09-12T17:37:33.326+0000 7ff94940f800 5 AuthRegistry(0x564fe5584060) adding auth protocol: cephx 2024-09-12T17:37:33.677 INFO:tasks.workunit.client.0.smithi037.stderr: -396> 2024-09-12T17:37:33.326+0000 7ff94940f800 5 AuthRegistry(0x564fe5584060) adding auth protocol: cephx 2024-09-12T17:37:33.677 INFO:tasks.workunit.client.0.smithi037.stderr: -395> 2024-09-12T17:37:33.326+0000 7ff94940f800 5 AuthRegistry(0x564fe5584060) adding auth protocol: cephx 2024-09-12T17:37:33.677 INFO:tasks.workunit.client.0.smithi037.stderr: -394> 2024-09-12T17:37:33.326+0000 7ff94940f800 5 AuthRegistry(0x564fe5584060) adding con mode: secure 2024-09-12T17:37:33.677 INFO:tasks.workunit.client.0.smithi037.stderr: -393> 2024-09-12T17:37:33.326+0000 7ff94940f800 5 AuthRegistry(0x564fe5584060) adding con mode: crc 2024-09-12T17:37:33.677 INFO:tasks.workunit.client.0.smithi037.stderr: -392> 2024-09-12T17:37:33.326+0000 7ff94940f800 5 AuthRegistry(0x564fe5584060) adding con mode: secure 2024-09-12T17:37:33.678 INFO:tasks.workunit.client.0.smithi037.stderr: -391> 2024-09-12T17:37:33.326+0000 7ff94940f800 5 AuthRegistry(0x564fe5584060) adding con mode: crc 2024-09-12T17:37:33.678 INFO:tasks.workunit.client.0.smithi037.stderr: -390> 2024-09-12T17:37:33.326+0000 7ff94940f800 5 AuthRegistry(0x564fe5584060) adding con mode: secure 2024-09-12T17:37:33.678 INFO:tasks.workunit.client.0.smithi037.stderr: -389> 2024-09-12T17:37:33.326+0000 7ff94940f800 5 AuthRegistry(0x564fe5584060) adding con mode: crc 2024-09-12T17:37:33.678 INFO:tasks.workunit.client.0.smithi037.stderr: -388> 2024-09-12T17:37:33.326+0000 7ff94940f800 5 AuthRegistry(0x564fe5584060) adding con mode: crc 2024-09-12T17:37:33.678 INFO:tasks.workunit.client.0.smithi037.stderr: -387> 2024-09-12T17:37:33.326+0000 7ff94940f800 5 AuthRegistry(0x564fe5584060) adding con mode: secure 2024-09-12T17:37:33.678 INFO:tasks.workunit.client.0.smithi037.stderr: -386> 2024-09-12T17:37:33.326+0000 7ff94940f800 5 AuthRegistry(0x564fe5584060) adding con mode: crc 2024-09-12T17:37:33.678 INFO:tasks.workunit.client.0.smithi037.stderr: -385> 2024-09-12T17:37:33.326+0000 7ff94940f800 5 AuthRegistry(0x564fe5584060) adding con mode: secure 2024-09-12T17:37:33.678 INFO:tasks.workunit.client.0.smithi037.stderr: -384> 2024-09-12T17:37:33.326+0000 7ff94940f800 5 AuthRegistry(0x564fe5584060) adding con mode: crc 2024-09-12T17:37:33.678 INFO:tasks.workunit.client.0.smithi037.stderr: -383> 2024-09-12T17:37:33.326+0000 7ff94940f800 5 AuthRegistry(0x564fe5584060) adding con mode: secure 2024-09-12T17:37:33.678 INFO:tasks.workunit.client.0.smithi037.stderr: -382> 2024-09-12T17:37:33.326+0000 7ff94940f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:37:33.678 INFO:tasks.workunit.client.0.smithi037.stderr: -381> 2024-09-12T17:37:33.326+0000 7ff94940f800 5 asok(0x564fe530e730) register_command objecter_requests cmddesc objecter_requests hook 0x564fe5587ab0 EEXIST 2024-09-12T17:37:33.678 INFO:tasks.workunit.client.0.smithi037.stderr: -380> 2024-09-12T17:37:33.327+0000 7ff94940f800 10 monclient: init 2024-09-12T17:37:33.678 INFO:tasks.workunit.client.0.smithi037.stderr: -379> 2024-09-12T17:37:33.327+0000 7ff94940f800 5 AuthRegistry(0x564fe55830b8) adding auth protocol: cephx 2024-09-12T17:37:33.679 INFO:tasks.workunit.client.0.smithi037.stderr: -378> 2024-09-12T17:37:33.327+0000 7ff94940f800 5 AuthRegistry(0x564fe55830b8) adding auth protocol: cephx 2024-09-12T17:37:33.679 INFO:tasks.workunit.client.0.smithi037.stderr: -377> 2024-09-12T17:37:33.327+0000 7ff94940f800 5 AuthRegistry(0x564fe55830b8) adding auth protocol: cephx 2024-09-12T17:37:33.679 INFO:tasks.workunit.client.0.smithi037.stderr: -376> 2024-09-12T17:37:33.327+0000 7ff94940f800 5 AuthRegistry(0x564fe55830b8) adding con mode: secure 2024-09-12T17:37:33.679 INFO:tasks.workunit.client.0.smithi037.stderr: -375> 2024-09-12T17:37:33.327+0000 7ff94940f800 5 AuthRegistry(0x564fe55830b8) adding con mode: crc 2024-09-12T17:37:33.679 INFO:tasks.workunit.client.0.smithi037.stderr: -374> 2024-09-12T17:37:33.327+0000 7ff94940f800 5 AuthRegistry(0x564fe55830b8) adding con mode: secure 2024-09-12T17:37:33.679 INFO:tasks.workunit.client.0.smithi037.stderr: -373> 2024-09-12T17:37:33.327+0000 7ff94940f800 5 AuthRegistry(0x564fe55830b8) adding con mode: crc 2024-09-12T17:37:33.679 INFO:tasks.workunit.client.0.smithi037.stderr: -372> 2024-09-12T17:37:33.327+0000 7ff94940f800 5 AuthRegistry(0x564fe55830b8) adding con mode: secure 2024-09-12T17:37:33.679 INFO:tasks.workunit.client.0.smithi037.stderr: -371> 2024-09-12T17:37:33.327+0000 7ff94940f800 5 AuthRegistry(0x564fe55830b8) adding con mode: crc 2024-09-12T17:37:33.679 INFO:tasks.workunit.client.0.smithi037.stderr: -370> 2024-09-12T17:37:33.327+0000 7ff94940f800 5 AuthRegistry(0x564fe55830b8) adding con mode: crc 2024-09-12T17:37:33.679 INFO:tasks.workunit.client.0.smithi037.stderr: -369> 2024-09-12T17:37:33.327+0000 7ff94940f800 5 AuthRegistry(0x564fe55830b8) adding con mode: secure 2024-09-12T17:37:33.679 INFO:tasks.workunit.client.0.smithi037.stderr: -368> 2024-09-12T17:37:33.327+0000 7ff94940f800 5 AuthRegistry(0x564fe55830b8) adding con mode: crc 2024-09-12T17:37:33.679 INFO:tasks.workunit.client.0.smithi037.stderr: -367> 2024-09-12T17:37:33.327+0000 7ff94940f800 5 AuthRegistry(0x564fe55830b8) adding con mode: secure 2024-09-12T17:37:33.679 INFO:tasks.workunit.client.0.smithi037.stderr: -366> 2024-09-12T17:37:33.327+0000 7ff94940f800 5 AuthRegistry(0x564fe55830b8) adding con mode: crc 2024-09-12T17:37:33.680 INFO:tasks.workunit.client.0.smithi037.stderr: -365> 2024-09-12T17:37:33.327+0000 7ff94940f800 5 AuthRegistry(0x564fe55830b8) adding con mode: secure 2024-09-12T17:37:33.680 INFO:tasks.workunit.client.0.smithi037.stderr: -364> 2024-09-12T17:37:33.327+0000 7ff94940f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:37:33.680 INFO:tasks.workunit.client.0.smithi037.stderr: -363> 2024-09-12T17:37:33.327+0000 7ff94940f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:37:33.680 INFO:tasks.workunit.client.0.smithi037.stderr: -362> 2024-09-12T17:37:33.327+0000 7ff94940f800 5 asok(0x564fe530e730) register_command rotate-key cmddesc rotate-key hook 0x564fe5583200 EEXIST 2024-09-12T17:37:33.680 INFO:tasks.workunit.client.0.smithi037.stderr: -361> 2024-09-12T17:37:33.327+0000 7ff94940f800 10 monclient: _reopen_session rank -1 2024-09-12T17:37:33.680 INFO:tasks.workunit.client.0.smithi037.stderr: -360> 2024-09-12T17:37:33.327+0000 7ff94940f800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T17:37:33.680 INFO:tasks.workunit.client.0.smithi037.stderr: -359> 2024-09-12T17:37:33.327+0000 7ff94940f800 10 monclient(hunting): picked mon.noname-b con 0x564fe55ab7a0 addr [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] 2024-09-12T17:37:33.680 INFO:tasks.workunit.client.0.smithi037.stderr: -358> 2024-09-12T17:37:33.327+0000 7ff94940f800 10 monclient(hunting): picked mon.noname-a con 0x564fe55ada70 addr [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] 2024-09-12T17:37:33.680 INFO:tasks.workunit.client.0.smithi037.stderr: -357> 2024-09-12T17:37:33.327+0000 7ff94940f800 10 monclient(hunting): picked mon.noname-c con 0x564fe55a9f70 addr [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] 2024-09-12T17:37:33.680 INFO:tasks.workunit.client.0.smithi037.stderr: -356> 2024-09-12T17:37:33.327+0000 7ff94940f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:37:33.680 INFO:tasks.workunit.client.0.smithi037.stderr: -355> 2024-09-12T17:37:33.327+0000 7ff94940f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:37:33.680 INFO:tasks.workunit.client.0.smithi037.stderr: -354> 2024-09-12T17:37:33.327+0000 7ff94940f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:37:33.681 INFO:tasks.workunit.client.0.smithi037.stderr: -353> 2024-09-12T17:37:33.327+0000 7ff94940f800 10 monclient(hunting): _renew_subs 2024-09-12T17:37:33.681 INFO:tasks.workunit.client.0.smithi037.stderr: -352> 2024-09-12T17:37:33.327+0000 7ff94940f800 10 monclient(hunting): authenticate will time out at 2440.924607s 2024-09-12T17:37:33.681 INFO:tasks.workunit.client.0.smithi037.stderr: -351> 2024-09-12T17:37:33.327+0000 7ff944347640 10 monclient(hunting): get_auth_request con 0x564fe55ada70 auth_method 0 2024-09-12T17:37:33.681 INFO:tasks.workunit.client.0.smithi037.stderr: -350> 2024-09-12T17:37:33.327+0000 7ff944347640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:37:33.681 INFO:tasks.workunit.client.0.smithi037.stderr: -349> 2024-09-12T17:37:33.327+0000 7ff944347640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:37:33.681 INFO:tasks.workunit.client.0.smithi037.stderr: -348> 2024-09-12T17:37:33.327+0000 7ff944347640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:37:33.681 INFO:tasks.workunit.client.0.smithi037.stderr: -347> 2024-09-12T17:37:33.327+0000 7ff945349640 10 monclient(hunting): get_auth_request con 0x564fe55a9f70 auth_method 0 2024-09-12T17:37:33.681 INFO:tasks.workunit.client.0.smithi037.stderr: -346> 2024-09-12T17:37:33.327+0000 7ff945349640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:37:33.681 INFO:tasks.workunit.client.0.smithi037.stderr: -345> 2024-09-12T17:37:33.327+0000 7ff945349640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:37:33.681 INFO:tasks.workunit.client.0.smithi037.stderr: -344> 2024-09-12T17:37:33.327+0000 7ff945349640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:37:33.681 INFO:tasks.workunit.client.0.smithi037.stderr: -343> 2024-09-12T17:37:33.327+0000 7ff944b48640 10 monclient(hunting): get_auth_request con 0x564fe55ab7a0 auth_method 0 2024-09-12T17:37:33.681 INFO:tasks.workunit.client.0.smithi037.stderr: -342> 2024-09-12T17:37:33.327+0000 7ff944b48640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:37:33.681 INFO:tasks.workunit.client.0.smithi037.stderr: -341> 2024-09-12T17:37:33.327+0000 7ff944b48640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:37:33.682 INFO:tasks.workunit.client.0.smithi037.stderr: -340> 2024-09-12T17:37:33.327+0000 7ff944b48640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:37:33.682 INFO:tasks.workunit.client.0.smithi037.stderr: -339> 2024-09-12T17:37:33.327+0000 7ff944347640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:37:33.682 INFO:tasks.workunit.client.0.smithi037.stderr: -338> 2024-09-12T17:37:33.327+0000 7ff944347640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:37:33.682 INFO:tasks.workunit.client.0.smithi037.stderr: -337> 2024-09-12T17:37:33.327+0000 7ff944347640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:37:33.682 INFO:tasks.workunit.client.0.smithi037.stderr: -336> 2024-09-12T17:37:33.327+0000 7ff945349640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:37:33.682 INFO:tasks.workunit.client.0.smithi037.stderr: -335> 2024-09-12T17:37:33.327+0000 7ff945349640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:37:33.682 INFO:tasks.workunit.client.0.smithi037.stderr: -334> 2024-09-12T17:37:33.327+0000 7ff945349640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:37:33.682 INFO:tasks.workunit.client.0.smithi037.stderr: -333> 2024-09-12T17:37:33.327+0000 7ff944b48640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:37:33.682 INFO:tasks.workunit.client.0.smithi037.stderr: -332> 2024-09-12T17:37:33.327+0000 7ff944b48640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:37:33.682 INFO:tasks.workunit.client.0.smithi037.stderr: -331> 2024-09-12T17:37:33.327+0000 7ff944b48640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:37:33.682 INFO:tasks.workunit.client.0.smithi037.stderr: -330> 2024-09-12T17:37:33.327+0000 7ff944347640 10 monclient(hunting): handle_auth_done global_id 8283 payload 824 2024-09-12T17:37:33.682 INFO:tasks.workunit.client.0.smithi037.stderr: -329> 2024-09-12T17:37:33.328+0000 7ff944347640 10 monclient: _finish_hunting 0 2024-09-12T17:37:33.682 INFO:tasks.workunit.client.0.smithi037.stderr: -328> 2024-09-12T17:37:33.328+0000 7ff944347640 1 monclient: found mon.noname-a 2024-09-12T17:37:33.682 INFO:tasks.workunit.client.0.smithi037.stderr: -327> 2024-09-12T17:37:33.328+0000 7ff944347640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.37:3300/0 2024-09-12T17:37:33.683 INFO:tasks.workunit.client.0.smithi037.stderr: -326> 2024-09-12T17:37:33.328+0000 7ff82a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:37:33.683 INFO:tasks.workunit.client.0.smithi037.stderr: -325> 2024-09-12T17:37:33.328+0000 7ff82a7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:37:33.683 INFO:tasks.workunit.client.0.smithi037.stderr: -324> 2024-09-12T17:37:33.328+0000 7ff82a7fc640 10 monclient: dump: 2024-09-12T17:37:33.683 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:37:33.683 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:37:33.683 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:37:33.683 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:37:33.683 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:37:33.683 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:37:33.683 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:37:33.683 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:37:33.683 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:37:33.683 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:37:33.684 INFO:tasks.workunit.client.0.smithi037.stderr: -323> 2024-09-12T17:37:33.328+0000 7ff82a7fc640 10 monclient: _finish_auth 0 2024-09-12T17:37:33.684 INFO:tasks.workunit.client.0.smithi037.stderr: -322> 2024-09-12T17:37:33.328+0000 7ff82a7fc640 10 monclient: _check_auth_tickets 2024-09-12T17:37:33.684 INFO:tasks.workunit.client.0.smithi037.stderr: -321> 2024-09-12T17:37:33.328+0000 7ff82a7fc640 10 monclient: handle_config config(0 keys) 2024-09-12T17:37:33.684 INFO:tasks.workunit.client.0.smithi037.stderr: -320> 2024-09-12T17:37:33.328+0000 7ff82a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:37:33.684 INFO:tasks.workunit.client.0.smithi037.stderr: -319> 2024-09-12T17:37:33.328+0000 7ff82a7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:37:33.684 INFO:tasks.workunit.client.0.smithi037.stderr: -318> 2024-09-12T17:37:33.328+0000 7ff82a7fc640 10 monclient: dump: 2024-09-12T17:37:33.684 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:37:33.684 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:37:33.684 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:37:33.684 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:37:33.684 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:37:33.684 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:37:33.684 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:37:33.684 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:37:33.685 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:37:33.685 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:37:33.685 INFO:tasks.workunit.client.0.smithi037.stderr: -317> 2024-09-12T17:37:33.328+0000 7ff945b4a640 4 set_mon_vals no callback set 2024-09-12T17:37:33.685 INFO:tasks.workunit.client.0.smithi037.stderr: -316> 2024-09-12T17:37:33.328+0000 7ff94940f800 5 monclient: authenticate success, global_id 8283 2024-09-12T17:37:33.685 INFO:tasks.workunit.client.0.smithi037.stderr: -315> 2024-09-12T17:37:33.328+0000 7ff94940f800 10 monclient: _renew_subs 2024-09-12T17:37:33.685 INFO:tasks.workunit.client.0.smithi037.stderr: -314> 2024-09-12T17:37:33.328+0000 7ff94940f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.37:3300/0 2024-09-12T17:37:33.685 INFO:tasks.workunit.client.0.smithi037.stderr: -313> 2024-09-12T17:37:33.328+0000 7ff94940f800 10 monclient: _renew_subs 2024-09-12T17:37:33.685 INFO:tasks.workunit.client.0.smithi037.stderr: -312> 2024-09-12T17:37:33.328+0000 7ff94940f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.37:3300/0 2024-09-12T17:37:33.685 INFO:tasks.workunit.client.0.smithi037.stderr: -311> 2024-09-12T17:37:33.330+0000 7ff82a7fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:37:33.685 INFO:tasks.workunit.client.0.smithi037.stderr: -310> 2024-09-12T17:37:33.330+0000 7ff82a7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.40:6816/3916250676,v1:172.21.15.40:6817/3916250676] 2024-09-12T17:37:33.685 INFO:tasks.workunit.client.0.smithi037.stderr: -309> 2024-09-12T17:37:33.330+0000 7ff82a7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.40:6816/3916250676,v1:172.21.15.40:6817/3916250676] 2024-09-12T17:37:33.685 INFO:tasks.workunit.client.0.smithi037.stderr: -308> 2024-09-12T17:37:33.330+0000 7ff94940f800 10 monclient: get_monmap_and_config 2024-09-12T17:37:33.685 INFO:tasks.workunit.client.0.smithi037.stderr: -307> 2024-09-12T17:37:33.330+0000 7ff94940f800 10 monclient: build_initial_monmap 2024-09-12T17:37:33.685 INFO:tasks.workunit.client.0.smithi037.stderr: -306> 2024-09-12T17:37:33.330+0000 7ff94940f800 1 build_initial for_mkfs: 0 2024-09-12T17:37:33.686 INFO:tasks.workunit.client.0.smithi037.stderr: -305> 2024-09-12T17:37:33.330+0000 7ff94940f800 10 monclient: monmap: 2024-09-12T17:37:33.686 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 0 2024-09-12T17:37:33.686 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:37:33.686 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 0.000000 2024-09-12T17:37:33.686 INFO:tasks.workunit.client.0.smithi037.stderr:created 0.000000 2024-09-12T17:37:33.686 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 0 (unknown) 2024-09-12T17:37:33.686 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:37:33.686 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.noname-a 2024-09-12T17:37:33.686 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.noname-b 2024-09-12T17:37:33.686 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.noname-c 2024-09-12T17:37:33.686 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:37:33.686 INFO:tasks.workunit.client.0.smithi037.stderr: -304> 2024-09-12T17:37:33.330+0000 7ff94940f800 5 AuthRegistry(0x564fe55cb630) adding auth protocol: cephx 2024-09-12T17:37:33.686 INFO:tasks.workunit.client.0.smithi037.stderr: -303> 2024-09-12T17:37:33.330+0000 7ff94940f800 5 AuthRegistry(0x564fe55cb630) adding auth protocol: cephx 2024-09-12T17:37:33.686 INFO:tasks.workunit.client.0.smithi037.stderr: -302> 2024-09-12T17:37:33.330+0000 7ff94940f800 5 AuthRegistry(0x564fe55cb630) adding auth protocol: cephx 2024-09-12T17:37:33.687 INFO:tasks.workunit.client.0.smithi037.stderr: -301> 2024-09-12T17:37:33.330+0000 7ff94940f800 5 AuthRegistry(0x564fe55cb630) adding con mode: secure 2024-09-12T17:37:33.687 INFO:tasks.workunit.client.0.smithi037.stderr: -300> 2024-09-12T17:37:33.330+0000 7ff94940f800 5 AuthRegistry(0x564fe55cb630) adding con mode: crc 2024-09-12T17:37:33.687 INFO:tasks.workunit.client.0.smithi037.stderr: -299> 2024-09-12T17:37:33.330+0000 7ff94940f800 5 AuthRegistry(0x564fe55cb630) adding con mode: secure 2024-09-12T17:37:33.687 INFO:tasks.workunit.client.0.smithi037.stderr: -298> 2024-09-12T17:37:33.330+0000 7ff94940f800 5 AuthRegistry(0x564fe55cb630) adding con mode: crc 2024-09-12T17:37:33.687 INFO:tasks.workunit.client.0.smithi037.stderr: -297> 2024-09-12T17:37:33.330+0000 7ff94940f800 5 AuthRegistry(0x564fe55cb630) adding con mode: secure 2024-09-12T17:37:33.687 INFO:tasks.workunit.client.0.smithi037.stderr: -296> 2024-09-12T17:37:33.330+0000 7ff94940f800 5 AuthRegistry(0x564fe55cb630) adding con mode: crc 2024-09-12T17:37:33.687 INFO:tasks.workunit.client.0.smithi037.stderr: -295> 2024-09-12T17:37:33.330+0000 7ff94940f800 5 AuthRegistry(0x564fe55cb630) adding con mode: crc 2024-09-12T17:37:33.687 INFO:tasks.workunit.client.0.smithi037.stderr: -294> 2024-09-12T17:37:33.330+0000 7ff94940f800 5 AuthRegistry(0x564fe55cb630) adding con mode: secure 2024-09-12T17:37:33.687 INFO:tasks.workunit.client.0.smithi037.stderr: -293> 2024-09-12T17:37:33.330+0000 7ff94940f800 5 AuthRegistry(0x564fe55cb630) adding con mode: crc 2024-09-12T17:37:33.687 INFO:tasks.workunit.client.0.smithi037.stderr: -292> 2024-09-12T17:37:33.330+0000 7ff94940f800 5 AuthRegistry(0x564fe55cb630) adding con mode: secure 2024-09-12T17:37:33.687 INFO:tasks.workunit.client.0.smithi037.stderr: -291> 2024-09-12T17:37:33.330+0000 7ff94940f800 5 AuthRegistry(0x564fe55cb630) adding con mode: crc 2024-09-12T17:37:33.687 INFO:tasks.workunit.client.0.smithi037.stderr: -290> 2024-09-12T17:37:33.330+0000 7ff94940f800 5 AuthRegistry(0x564fe55cb630) adding con mode: secure 2024-09-12T17:37:33.687 INFO:tasks.workunit.client.0.smithi037.stderr: -289> 2024-09-12T17:37:33.330+0000 7ff944b48640 10 monclient: get_auth_request con 0x7ff81c076380 auth_method 0 2024-09-12T17:37:33.688 INFO:tasks.workunit.client.0.smithi037.stderr: -288> 2024-09-12T17:37:33.330+0000 7ff94940f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:37:33.688 INFO:tasks.workunit.client.0.smithi037.stderr: -287> 2024-09-12T17:37:33.331+0000 7ff94940f800 10 monclient: init 2024-09-12T17:37:33.688 INFO:tasks.workunit.client.0.smithi037.stderr: -286> 2024-09-12T17:37:33.331+0000 7ff94940f800 5 AuthRegistry(0x7ffef42b9960) adding auth protocol: cephx 2024-09-12T17:37:33.688 INFO:tasks.workunit.client.0.smithi037.stderr: -285> 2024-09-12T17:37:33.331+0000 7ff94940f800 5 AuthRegistry(0x7ffef42b9960) adding auth protocol: cephx 2024-09-12T17:37:33.688 INFO:tasks.workunit.client.0.smithi037.stderr: -284> 2024-09-12T17:37:33.331+0000 7ff94940f800 5 AuthRegistry(0x7ffef42b9960) adding auth protocol: cephx 2024-09-12T17:37:33.688 INFO:tasks.workunit.client.0.smithi037.stderr: -283> 2024-09-12T17:37:33.331+0000 7ff94940f800 5 AuthRegistry(0x7ffef42b9960) adding con mode: secure 2024-09-12T17:37:33.688 INFO:tasks.workunit.client.0.smithi037.stderr: -282> 2024-09-12T17:37:33.331+0000 7ff94940f800 5 AuthRegistry(0x7ffef42b9960) adding con mode: crc 2024-09-12T17:37:33.688 INFO:tasks.workunit.client.0.smithi037.stderr: -281> 2024-09-12T17:37:33.331+0000 7ff94940f800 5 AuthRegistry(0x7ffef42b9960) adding con mode: secure 2024-09-12T17:37:33.688 INFO:tasks.workunit.client.0.smithi037.stderr: -280> 2024-09-12T17:37:33.331+0000 7ff94940f800 5 AuthRegistry(0x7ffef42b9960) adding con mode: crc 2024-09-12T17:37:33.688 INFO:tasks.workunit.client.0.smithi037.stderr: -279> 2024-09-12T17:37:33.331+0000 7ff94940f800 5 AuthRegistry(0x7ffef42b9960) adding con mode: secure 2024-09-12T17:37:33.688 INFO:tasks.workunit.client.0.smithi037.stderr: -278> 2024-09-12T17:37:33.331+0000 7ff94940f800 5 AuthRegistry(0x7ffef42b9960) adding con mode: crc 2024-09-12T17:37:33.688 INFO:tasks.workunit.client.0.smithi037.stderr: -277> 2024-09-12T17:37:33.331+0000 7ff94940f800 5 AuthRegistry(0x7ffef42b9960) adding con mode: crc 2024-09-12T17:37:33.688 INFO:tasks.workunit.client.0.smithi037.stderr: -276> 2024-09-12T17:37:33.331+0000 7ff94940f800 5 AuthRegistry(0x7ffef42b9960) adding con mode: secure 2024-09-12T17:37:33.689 INFO:tasks.workunit.client.0.smithi037.stderr: -275> 2024-09-12T17:37:33.331+0000 7ff94940f800 5 AuthRegistry(0x7ffef42b9960) adding con mode: crc 2024-09-12T17:37:33.689 INFO:tasks.workunit.client.0.smithi037.stderr: -274> 2024-09-12T17:37:33.331+0000 7ff94940f800 5 AuthRegistry(0x7ffef42b9960) adding con mode: secure 2024-09-12T17:37:33.689 INFO:tasks.workunit.client.0.smithi037.stderr: -273> 2024-09-12T17:37:33.331+0000 7ff94940f800 5 AuthRegistry(0x7ffef42b9960) adding con mode: crc 2024-09-12T17:37:33.689 INFO:tasks.workunit.client.0.smithi037.stderr: -272> 2024-09-12T17:37:33.331+0000 7ff94940f800 5 AuthRegistry(0x7ffef42b9960) adding con mode: secure 2024-09-12T17:37:33.689 INFO:tasks.workunit.client.0.smithi037.stderr: -271> 2024-09-12T17:37:33.331+0000 7ff94940f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:37:33.689 INFO:tasks.workunit.client.0.smithi037.stderr: -270> 2024-09-12T17:37:33.331+0000 7ff94940f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:37:33.689 INFO:tasks.workunit.client.0.smithi037.stderr: -269> 2024-09-12T17:37:33.331+0000 7ff94940f800 5 asok(0x564fe530e730) register_command rotate-key cmddesc rotate-key hook 0x7ffef42b9aa8 EEXIST 2024-09-12T17:37:33.689 INFO:tasks.workunit.client.0.smithi037.stderr: -268> 2024-09-12T17:37:33.331+0000 7ff94940f800 10 monclient: _reopen_session rank -1 2024-09-12T17:37:33.689 INFO:tasks.workunit.client.0.smithi037.stderr: -267> 2024-09-12T17:37:33.331+0000 7ff94940f800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T17:37:33.689 INFO:tasks.workunit.client.0.smithi037.stderr: -266> 2024-09-12T17:37:33.331+0000 7ff94940f800 10 monclient(hunting): picked mon.noname-a con 0x564fe55d3610 addr [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] 2024-09-12T17:37:33.689 INFO:tasks.workunit.client.0.smithi037.stderr: -265> 2024-09-12T17:37:33.331+0000 7ff94940f800 10 monclient(hunting): picked mon.noname-b con 0x564fe5607970 addr [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] 2024-09-12T17:37:33.689 INFO:tasks.workunit.client.0.smithi037.stderr: -264> 2024-09-12T17:37:33.331+0000 7ff94940f800 10 monclient(hunting): picked mon.noname-c con 0x564fe55ff3e0 addr [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] 2024-09-12T17:37:33.689 INFO:tasks.workunit.client.0.smithi037.stderr: -263> 2024-09-12T17:37:33.331+0000 7ff94940f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:37:33.689 INFO:tasks.workunit.client.0.smithi037.stderr: -262> 2024-09-12T17:37:33.331+0000 7ff94940f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:37:33.690 INFO:tasks.workunit.client.0.smithi037.stderr: -261> 2024-09-12T17:37:33.331+0000 7ff94940f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:37:33.690 INFO:tasks.workunit.client.0.smithi037.stderr: -260> 2024-09-12T17:37:33.331+0000 7ff94940f800 10 monclient(hunting): _renew_subs 2024-09-12T17:37:33.690 INFO:tasks.workunit.client.0.smithi037.stderr: -259> 2024-09-12T17:37:33.331+0000 7ff94940f800 10 monclient(hunting): authenticate will time out at 2440.928601s 2024-09-12T17:37:33.690 INFO:tasks.workunit.client.0.smithi037.stderr: -258> 2024-09-12T17:37:33.331+0000 7ff944b48640 10 monclient(hunting): get_auth_request con 0x564fe55d3610 auth_method 0 2024-09-12T17:37:33.690 INFO:tasks.workunit.client.0.smithi037.stderr: -257> 2024-09-12T17:37:33.331+0000 7ff944b48640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:37:33.690 INFO:tasks.workunit.client.0.smithi037.stderr: -256> 2024-09-12T17:37:33.331+0000 7ff944b48640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:37:33.690 INFO:tasks.workunit.client.0.smithi037.stderr: -255> 2024-09-12T17:37:33.331+0000 7ff944b48640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:37:33.690 INFO:tasks.workunit.client.0.smithi037.stderr: -254> 2024-09-12T17:37:33.331+0000 7ff945349640 10 monclient(hunting): get_auth_request con 0x564fe55ff3e0 auth_method 0 2024-09-12T17:37:33.690 INFO:tasks.workunit.client.0.smithi037.stderr: -253> 2024-09-12T17:37:33.331+0000 7ff945349640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:37:33.690 INFO:tasks.workunit.client.0.smithi037.stderr: -252> 2024-09-12T17:37:33.331+0000 7ff945349640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:37:33.690 INFO:tasks.workunit.client.0.smithi037.stderr: -251> 2024-09-12T17:37:33.331+0000 7ff945349640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:37:33.690 INFO:tasks.workunit.client.0.smithi037.stderr: -250> 2024-09-12T17:37:33.331+0000 7ff944347640 10 monclient(hunting): get_auth_request con 0x564fe5607970 auth_method 0 2024-09-12T17:37:33.691 INFO:tasks.workunit.client.0.smithi037.stderr: -249> 2024-09-12T17:37:33.331+0000 7ff944347640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:37:33.691 INFO:tasks.workunit.client.0.smithi037.stderr: -248> 2024-09-12T17:37:33.331+0000 7ff944347640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:37:33.691 INFO:tasks.workunit.client.0.smithi037.stderr: -247> 2024-09-12T17:37:33.331+0000 7ff944347640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:37:33.691 INFO:tasks.workunit.client.0.smithi037.stderr: -246> 2024-09-12T17:37:33.331+0000 7ff945349640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:37:33.691 INFO:tasks.workunit.client.0.smithi037.stderr: -245> 2024-09-12T17:37:33.331+0000 7ff945349640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:37:33.691 INFO:tasks.workunit.client.0.smithi037.stderr: -244> 2024-09-12T17:37:33.331+0000 7ff945349640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:37:33.691 INFO:tasks.workunit.client.0.smithi037.stderr: -243> 2024-09-12T17:37:33.331+0000 7ff944b48640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:37:33.691 INFO:tasks.workunit.client.0.smithi037.stderr: -242> 2024-09-12T17:37:33.331+0000 7ff944b48640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:37:33.691 INFO:tasks.workunit.client.0.smithi037.stderr: -241> 2024-09-12T17:37:33.331+0000 7ff944b48640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:37:33.691 INFO:tasks.workunit.client.0.smithi037.stderr: -240> 2024-09-12T17:37:33.331+0000 7ff944347640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:37:33.691 INFO:tasks.workunit.client.0.smithi037.stderr: -239> 2024-09-12T17:37:33.331+0000 7ff944347640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:37:33.691 INFO:tasks.workunit.client.0.smithi037.stderr: -238> 2024-09-12T17:37:33.331+0000 7ff944347640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:37:33.691 INFO:tasks.workunit.client.0.smithi037.stderr: -237> 2024-09-12T17:37:33.331+0000 7ff945349640 10 monclient(hunting): handle_auth_done global_id 7727 payload 274 2024-09-12T17:37:33.691 INFO:tasks.workunit.client.0.smithi037.stderr: -236> 2024-09-12T17:37:33.331+0000 7ff945349640 10 monclient: _finish_hunting 0 2024-09-12T17:37:33.692 INFO:tasks.workunit.client.0.smithi037.stderr: -235> 2024-09-12T17:37:33.331+0000 7ff945349640 1 monclient: found mon.noname-c 2024-09-12T17:37:33.692 INFO:tasks.workunit.client.0.smithi037.stderr: -234> 2024-09-12T17:37:33.331+0000 7ff945349640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.37:3301/0 2024-09-12T17:37:33.692 INFO:tasks.workunit.client.0.smithi037.stderr: -233> 2024-09-12T17:37:33.332+0000 7ff81bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:37:33.692 INFO:tasks.workunit.client.0.smithi037.stderr: -232> 2024-09-12T17:37:33.332+0000 7ff81bfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:37:33.692 INFO:tasks.workunit.client.0.smithi037.stderr: -231> 2024-09-12T17:37:33.332+0000 7ff81bfff640 10 monclient: dump: 2024-09-12T17:37:33.692 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:37:33.692 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:37:33.692 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:37:33.692 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:37:33.692 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:37:33.692 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:37:33.692 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:37:33.692 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:37:33.693 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:37:33.693 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:37:33.693 INFO:tasks.workunit.client.0.smithi037.stderr: -230> 2024-09-12T17:37:33.332+0000 7ff81bfff640 10 monclient: _finish_auth 0 2024-09-12T17:37:33.693 INFO:tasks.workunit.client.0.smithi037.stderr: -229> 2024-09-12T17:37:33.332+0000 7ff81bfff640 10 monclient: _check_auth_tickets 2024-09-12T17:37:33.693 INFO:tasks.workunit.client.0.smithi037.stderr: -228> 2024-09-12T17:37:33.332+0000 7ff81bfff640 10 monclient: handle_config config(0 keys) 2024-09-12T17:37:33.693 INFO:tasks.workunit.client.0.smithi037.stderr: -227> 2024-09-12T17:37:33.332+0000 7ff94940f800 5 monclient: authenticate success, global_id 7727 2024-09-12T17:37:33.693 INFO:tasks.workunit.client.0.smithi037.stderr: -226> 2024-09-12T17:37:33.332+0000 7ff94940f800 10 monclient: get_monmap_and_config success 2024-09-12T17:37:33.693 INFO:tasks.workunit.client.0.smithi037.stderr: -225> 2024-09-12T17:37:33.332+0000 7ff94940f800 4 set_mon_vals no callback set 2024-09-12T17:37:33.693 INFO:tasks.workunit.client.0.smithi037.stderr: -224> 2024-09-12T17:37:33.332+0000 7ff81bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:37:33.693 INFO:tasks.workunit.client.0.smithi037.stderr: -223> 2024-09-12T17:37:33.332+0000 7ff81bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:37:33.693 INFO:tasks.workunit.client.0.smithi037.stderr: -222> 2024-09-12T17:37:33.332+0000 7ff81bfff640 10 monclient: dump: 2024-09-12T17:37:33.693 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:37:33.694 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:37:33.694 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:37:33.694 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:37:33.694 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:37:33.694 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:37:33.694 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:37:33.694 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:37:33.694 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:37:33.694 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:37:33.694 INFO:tasks.workunit.client.0.smithi037.stderr: -221> 2024-09-12T17:37:33.332+0000 7ff94940f800 10 monclient: shutdown 2024-09-12T17:37:33.694 INFO:tasks.workunit.client.0.smithi037.stderr: -220> 2024-09-12T17:37:33.332+0000 7ff94940f800 10 monclient: build_initial_monmap 2024-09-12T17:37:33.694 INFO:tasks.workunit.client.0.smithi037.stderr: -219> 2024-09-12T17:37:33.332+0000 7ff94940f800 1 build_initial for_mkfs: 0 2024-09-12T17:37:33.694 INFO:tasks.workunit.client.0.smithi037.stderr: -218> 2024-09-12T17:37:33.332+0000 7ff94940f800 10 monclient: monmap: 2024-09-12T17:37:33.695 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 0 2024-09-12T17:37:33.695 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:37:33.695 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 0.000000 2024-09-12T17:37:33.695 INFO:tasks.workunit.client.0.smithi037.stderr:created 0.000000 2024-09-12T17:37:33.695 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 0 (unknown) 2024-09-12T17:37:33.695 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:37:33.695 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.noname-a 2024-09-12T17:37:33.695 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.noname-b 2024-09-12T17:37:33.695 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.noname-c 2024-09-12T17:37:33.695 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:37:33.695 INFO:tasks.workunit.client.0.smithi037.stderr: -217> 2024-09-12T17:37:33.332+0000 7ff94940f800 5 AuthRegistry(0x564fe55fe4a0) adding auth protocol: cephx 2024-09-12T17:37:33.695 INFO:tasks.workunit.client.0.smithi037.stderr: -216> 2024-09-12T17:37:33.332+0000 7ff94940f800 5 AuthRegistry(0x564fe55fe4a0) adding auth protocol: cephx 2024-09-12T17:37:33.695 INFO:tasks.workunit.client.0.smithi037.stderr: -215> 2024-09-12T17:37:33.332+0000 7ff94940f800 5 AuthRegistry(0x564fe55fe4a0) adding auth protocol: cephx 2024-09-12T17:37:33.696 INFO:tasks.workunit.client.0.smithi037.stderr: -214> 2024-09-12T17:37:33.332+0000 7ff94940f800 5 AuthRegistry(0x564fe55fe4a0) adding con mode: secure 2024-09-12T17:37:33.696 INFO:tasks.workunit.client.0.smithi037.stderr: -213> 2024-09-12T17:37:33.332+0000 7ff94940f800 5 AuthRegistry(0x564fe55fe4a0) adding con mode: crc 2024-09-12T17:37:33.696 INFO:tasks.workunit.client.0.smithi037.stderr: -212> 2024-09-12T17:37:33.332+0000 7ff94940f800 5 AuthRegistry(0x564fe55fe4a0) adding con mode: secure 2024-09-12T17:37:33.696 INFO:tasks.workunit.client.0.smithi037.stderr: -211> 2024-09-12T17:37:33.332+0000 7ff94940f800 5 AuthRegistry(0x564fe55fe4a0) adding con mode: crc 2024-09-12T17:37:33.696 INFO:tasks.workunit.client.0.smithi037.stderr: -210> 2024-09-12T17:37:33.332+0000 7ff94940f800 5 AuthRegistry(0x564fe55fe4a0) adding con mode: secure 2024-09-12T17:37:33.696 INFO:tasks.workunit.client.0.smithi037.stderr: -209> 2024-09-12T17:37:33.332+0000 7ff94940f800 5 AuthRegistry(0x564fe55fe4a0) adding con mode: crc 2024-09-12T17:37:33.696 INFO:tasks.workunit.client.0.smithi037.stderr: -208> 2024-09-12T17:37:33.332+0000 7ff94940f800 5 AuthRegistry(0x564fe55fe4a0) adding con mode: crc 2024-09-12T17:37:33.696 INFO:tasks.workunit.client.0.smithi037.stderr: -207> 2024-09-12T17:37:33.332+0000 7ff94940f800 5 AuthRegistry(0x564fe55fe4a0) adding con mode: secure 2024-09-12T17:37:33.696 INFO:tasks.workunit.client.0.smithi037.stderr: -206> 2024-09-12T17:37:33.332+0000 7ff94940f800 5 AuthRegistry(0x564fe55fe4a0) adding con mode: crc 2024-09-12T17:37:33.696 INFO:tasks.workunit.client.0.smithi037.stderr: -205> 2024-09-12T17:37:33.332+0000 7ff94940f800 5 AuthRegistry(0x564fe55fe4a0) adding con mode: secure 2024-09-12T17:37:33.696 INFO:tasks.workunit.client.0.smithi037.stderr: -204> 2024-09-12T17:37:33.332+0000 7ff94940f800 5 AuthRegistry(0x564fe55fe4a0) adding con mode: crc 2024-09-12T17:37:33.696 INFO:tasks.workunit.client.0.smithi037.stderr: -203> 2024-09-12T17:37:33.332+0000 7ff94940f800 5 AuthRegistry(0x564fe55fe4a0) adding con mode: secure 2024-09-12T17:37:33.696 INFO:tasks.workunit.client.0.smithi037.stderr: -202> 2024-09-12T17:37:33.333+0000 7ff94940f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:37:33.697 INFO:tasks.workunit.client.0.smithi037.stderr: -201> 2024-09-12T17:37:33.333+0000 7ff94940f800 1 librados: starting msgr at 2024-09-12T17:37:33.697 INFO:tasks.workunit.client.0.smithi037.stderr: -200> 2024-09-12T17:37:33.333+0000 7ff94940f800 1 librados: starting objecter 2024-09-12T17:37:33.697 INFO:tasks.workunit.client.0.smithi037.stderr: -199> 2024-09-12T17:37:33.333+0000 7ff94940f800 5 asok(0x564fe530e730) register_command objecter_requests cmddesc objecter_requests hook 0x564fe5602cd0 EEXIST 2024-09-12T17:37:33.697 INFO:tasks.workunit.client.0.smithi037.stderr: -198> 2024-09-12T17:37:33.333+0000 7ff94940f800 1 librados: setting wanted keys 2024-09-12T17:37:33.697 INFO:tasks.workunit.client.0.smithi037.stderr: -197> 2024-09-12T17:37:33.333+0000 7ff94940f800 1 librados: calling monclient init 2024-09-12T17:37:33.697 INFO:tasks.workunit.client.0.smithi037.stderr: -196> 2024-09-12T17:37:33.333+0000 7ff94940f800 10 monclient: init 2024-09-12T17:37:33.697 INFO:tasks.workunit.client.0.smithi037.stderr: -195> 2024-09-12T17:37:33.333+0000 7ff94940f800 5 AuthRegistry(0x564fe55c3550) adding auth protocol: cephx 2024-09-12T17:37:33.697 INFO:tasks.workunit.client.0.smithi037.stderr: -194> 2024-09-12T17:37:33.333+0000 7ff94940f800 5 AuthRegistry(0x564fe55c3550) adding auth protocol: cephx 2024-09-12T17:37:33.697 INFO:tasks.workunit.client.0.smithi037.stderr: -193> 2024-09-12T17:37:33.333+0000 7ff94940f800 5 AuthRegistry(0x564fe55c3550) adding auth protocol: cephx 2024-09-12T17:37:33.697 INFO:tasks.workunit.client.0.smithi037.stderr: -192> 2024-09-12T17:37:33.333+0000 7ff94940f800 5 AuthRegistry(0x564fe55c3550) adding con mode: secure 2024-09-12T17:37:33.697 INFO:tasks.workunit.client.0.smithi037.stderr: -191> 2024-09-12T17:37:33.333+0000 7ff94940f800 5 AuthRegistry(0x564fe55c3550) adding con mode: crc 2024-09-12T17:37:33.697 INFO:tasks.workunit.client.0.smithi037.stderr: -190> 2024-09-12T17:37:33.333+0000 7ff94940f800 5 AuthRegistry(0x564fe55c3550) adding con mode: secure 2024-09-12T17:37:33.697 INFO:tasks.workunit.client.0.smithi037.stderr: -189> 2024-09-12T17:37:33.333+0000 7ff94940f800 5 AuthRegistry(0x564fe55c3550) adding con mode: crc 2024-09-12T17:37:33.697 INFO:tasks.workunit.client.0.smithi037.stderr: -188> 2024-09-12T17:37:33.333+0000 7ff94940f800 5 AuthRegistry(0x564fe55c3550) adding con mode: secure 2024-09-12T17:37:33.698 INFO:tasks.workunit.client.0.smithi037.stderr: -187> 2024-09-12T17:37:33.333+0000 7ff94940f800 5 AuthRegistry(0x564fe55c3550) adding con mode: crc 2024-09-12T17:37:33.698 INFO:tasks.workunit.client.0.smithi037.stderr: -186> 2024-09-12T17:37:33.333+0000 7ff94940f800 5 AuthRegistry(0x564fe55c3550) adding con mode: crc 2024-09-12T17:37:33.698 INFO:tasks.workunit.client.0.smithi037.stderr: -185> 2024-09-12T17:37:33.333+0000 7ff94940f800 5 AuthRegistry(0x564fe55c3550) adding con mode: secure 2024-09-12T17:37:33.698 INFO:tasks.workunit.client.0.smithi037.stderr: -184> 2024-09-12T17:37:33.333+0000 7ff94940f800 5 AuthRegistry(0x564fe55c3550) adding con mode: crc 2024-09-12T17:37:33.698 INFO:tasks.workunit.client.0.smithi037.stderr: -183> 2024-09-12T17:37:33.333+0000 7ff94940f800 5 AuthRegistry(0x564fe55c3550) adding con mode: secure 2024-09-12T17:37:33.698 INFO:tasks.workunit.client.0.smithi037.stderr: -182> 2024-09-12T17:37:33.333+0000 7ff94940f800 5 AuthRegistry(0x564fe55c3550) adding con mode: crc 2024-09-12T17:37:33.698 INFO:tasks.workunit.client.0.smithi037.stderr: -181> 2024-09-12T17:37:33.333+0000 7ff94940f800 5 AuthRegistry(0x564fe55c3550) adding con mode: secure 2024-09-12T17:37:33.698 INFO:tasks.workunit.client.0.smithi037.stderr: -180> 2024-09-12T17:37:33.333+0000 7ff94940f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:37:33.698 INFO:tasks.workunit.client.0.smithi037.stderr: -179> 2024-09-12T17:37:33.333+0000 7ff94940f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:37:33.698 INFO:tasks.workunit.client.0.smithi037.stderr: -178> 2024-09-12T17:37:33.333+0000 7ff94940f800 5 asok(0x564fe530e730) register_command rotate-key cmddesc rotate-key hook 0x564fe55c3698 EEXIST 2024-09-12T17:37:33.698 INFO:tasks.workunit.client.0.smithi037.stderr: -177> 2024-09-12T17:37:33.333+0000 7ff94940f800 10 monclient: _reopen_session rank -1 2024-09-12T17:37:33.698 INFO:tasks.workunit.client.0.smithi037.stderr: -176> 2024-09-12T17:37:33.333+0000 7ff94940f800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T17:37:33.698 INFO:tasks.workunit.client.0.smithi037.stderr: -175> 2024-09-12T17:37:33.333+0000 7ff94940f800 10 monclient(hunting): picked mon.noname-c con 0x564fe55d3610 addr [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] 2024-09-12T17:37:33.699 INFO:tasks.workunit.client.0.smithi037.stderr: -174> 2024-09-12T17:37:33.333+0000 7ff94940f800 10 monclient(hunting): picked mon.noname-a con 0x564fe55ff3e0 addr [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] 2024-09-12T17:37:33.699 INFO:tasks.workunit.client.0.smithi037.stderr: -173> 2024-09-12T17:37:33.333+0000 7ff94940f800 10 monclient(hunting): picked mon.noname-b con 0x564fe5607970 addr [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] 2024-09-12T17:37:33.699 INFO:tasks.workunit.client.0.smithi037.stderr: -172> 2024-09-12T17:37:33.333+0000 7ff94940f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:37:33.699 INFO:tasks.workunit.client.0.smithi037.stderr: -171> 2024-09-12T17:37:33.333+0000 7ff94940f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:37:33.699 INFO:tasks.workunit.client.0.smithi037.stderr: -170> 2024-09-12T17:37:33.333+0000 7ff94940f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:37:33.699 INFO:tasks.workunit.client.0.smithi037.stderr: -169> 2024-09-12T17:37:33.333+0000 7ff94940f800 10 monclient(hunting): _renew_subs 2024-09-12T17:37:33.699 INFO:tasks.workunit.client.0.smithi037.stderr: -168> 2024-09-12T17:37:33.333+0000 7ff94940f800 10 monclient(hunting): authenticate will time out at 2440.930916s 2024-09-12T17:37:33.699 INFO:tasks.workunit.client.0.smithi037.stderr: -167> 2024-09-12T17:37:33.334+0000 7ff944347640 10 monclient(hunting): get_auth_request con 0x564fe55ff3e0 auth_method 0 2024-09-12T17:37:33.699 INFO:tasks.workunit.client.0.smithi037.stderr: -166> 2024-09-12T17:37:33.334+0000 7ff944347640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:37:33.699 INFO:tasks.workunit.client.0.smithi037.stderr: -165> 2024-09-12T17:37:33.334+0000 7ff944347640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:37:33.699 INFO:tasks.workunit.client.0.smithi037.stderr: -164> 2024-09-12T17:37:33.334+0000 7ff944347640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:37:33.699 INFO:tasks.workunit.client.0.smithi037.stderr: -163> 2024-09-12T17:37:33.334+0000 7ff944b48640 10 monclient(hunting): get_auth_request con 0x564fe55d3610 auth_method 0 2024-09-12T17:37:33.699 INFO:tasks.workunit.client.0.smithi037.stderr: -162> 2024-09-12T17:37:33.334+0000 7ff944b48640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:37:33.699 INFO:tasks.workunit.client.0.smithi037.stderr: -161> 2024-09-12T17:37:33.334+0000 7ff944b48640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:37:33.700 INFO:tasks.workunit.client.0.smithi037.stderr: -160> 2024-09-12T17:37:33.334+0000 7ff944b48640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:37:33.700 INFO:tasks.workunit.client.0.smithi037.stderr: -159> 2024-09-12T17:37:33.334+0000 7ff944347640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:37:33.700 INFO:tasks.workunit.client.0.smithi037.stderr: -158> 2024-09-12T17:37:33.334+0000 7ff944347640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:37:33.700 INFO:tasks.workunit.client.0.smithi037.stderr: -157> 2024-09-12T17:37:33.334+0000 7ff944347640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:37:33.700 INFO:tasks.workunit.client.0.smithi037.stderr: -156> 2024-09-12T17:37:33.334+0000 7ff945349640 10 monclient(hunting): get_auth_request con 0x564fe5607970 auth_method 0 2024-09-12T17:37:33.700 INFO:tasks.workunit.client.0.smithi037.stderr: -155> 2024-09-12T17:37:33.334+0000 7ff945349640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:37:33.700 INFO:tasks.workunit.client.0.smithi037.stderr: -154> 2024-09-12T17:37:33.334+0000 7ff945349640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:37:33.700 INFO:tasks.workunit.client.0.smithi037.stderr: -153> 2024-09-12T17:37:33.334+0000 7ff945349640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:37:33.700 INFO:tasks.workunit.client.0.smithi037.stderr: -152> 2024-09-12T17:37:33.334+0000 7ff944b48640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:37:33.700 INFO:tasks.workunit.client.0.smithi037.stderr: -151> 2024-09-12T17:37:33.334+0000 7ff944b48640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:37:33.700 INFO:tasks.workunit.client.0.smithi037.stderr: -150> 2024-09-12T17:37:33.334+0000 7ff944b48640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:37:33.700 INFO:tasks.workunit.client.0.smithi037.stderr: -149> 2024-09-12T17:37:33.334+0000 7ff945349640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:37:33.700 INFO:tasks.workunit.client.0.smithi037.stderr: -148> 2024-09-12T17:37:33.334+0000 7ff945349640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:37:33.701 INFO:tasks.workunit.client.0.smithi037.stderr: -147> 2024-09-12T17:37:33.334+0000 7ff945349640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:37:33.701 INFO:tasks.workunit.client.0.smithi037.stderr: -146> 2024-09-12T17:37:33.334+0000 7ff944347640 10 monclient(hunting): handle_auth_done global_id 8289 payload 824 2024-09-12T17:37:33.701 INFO:tasks.workunit.client.0.smithi037.stderr: -145> 2024-09-12T17:37:33.334+0000 7ff944347640 10 monclient: _finish_hunting 0 2024-09-12T17:37:33.701 INFO:tasks.workunit.client.0.smithi037.stderr: -144> 2024-09-12T17:37:33.334+0000 7ff944347640 1 monclient: found mon.noname-a 2024-09-12T17:37:33.701 INFO:tasks.workunit.client.0.smithi037.stderr: -143> 2024-09-12T17:37:33.334+0000 7ff944347640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.37:3300/0 2024-09-12T17:37:33.701 INFO:tasks.workunit.client.0.smithi037.stderr: -142> 2024-09-12T17:37:33.334+0000 7ff81a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:37:33.701 INFO:tasks.workunit.client.0.smithi037.stderr: -141> 2024-09-12T17:37:33.334+0000 7ff81a7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:37:33.701 INFO:tasks.workunit.client.0.smithi037.stderr: -140> 2024-09-12T17:37:33.334+0000 7ff81a7fc640 10 monclient: dump: 2024-09-12T17:37:33.701 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:37:33.701 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:37:33.701 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:37:33.701 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:37:33.701 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:37:33.702 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:37:33.702 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:37:33.702 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:37:33.702 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:37:33.702 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:37:33.702 INFO:tasks.workunit.client.0.smithi037.stderr: -139> 2024-09-12T17:37:33.334+0000 7ff81a7fc640 10 monclient: _finish_auth 0 2024-09-12T17:37:33.702 INFO:tasks.workunit.client.0.smithi037.stderr: -138> 2024-09-12T17:37:33.334+0000 7ff81a7fc640 10 monclient: _check_auth_tickets 2024-09-12T17:37:33.702 INFO:tasks.workunit.client.0.smithi037.stderr: -137> 2024-09-12T17:37:33.334+0000 7ff81a7fc640 10 monclient: handle_config config(0 keys) 2024-09-12T17:37:33.702 INFO:tasks.workunit.client.0.smithi037.stderr: -136> 2024-09-12T17:37:33.334+0000 7ff81a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:37:33.702 INFO:tasks.workunit.client.0.smithi037.stderr: -135> 2024-09-12T17:37:33.334+0000 7ff81a7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:37:33.702 INFO:tasks.workunit.client.0.smithi037.stderr: -134> 2024-09-12T17:37:33.334+0000 7ff81a7fc640 10 monclient: dump: 2024-09-12T17:37:33.702 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:37:33.702 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:37:33.702 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:37:33.703 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:37:33.703 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:37:33.703 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:37:33.703 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:37:33.703 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:37:33.703 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:37:33.703 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:37:33.703 INFO:tasks.workunit.client.0.smithi037.stderr: -133> 2024-09-12T17:37:33.334+0000 7ff81bfff640 4 set_mon_vals no callback set 2024-09-12T17:37:33.703 INFO:tasks.workunit.client.0.smithi037.stderr: -132> 2024-09-12T17:37:33.334+0000 7ff94940f800 5 monclient: authenticate success, global_id 8289 2024-09-12T17:37:33.703 INFO:tasks.workunit.client.0.smithi037.stderr: -131> 2024-09-12T17:37:33.334+0000 7ff94940f800 10 monclient: _renew_subs 2024-09-12T17:37:33.703 INFO:tasks.workunit.client.0.smithi037.stderr: -130> 2024-09-12T17:37:33.334+0000 7ff94940f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.37:3300/0 2024-09-12T17:37:33.703 INFO:tasks.workunit.client.0.smithi037.stderr: -129> 2024-09-12T17:37:33.334+0000 7ff94940f800 10 monclient: _renew_subs 2024-09-12T17:37:33.703 INFO:tasks.workunit.client.0.smithi037.stderr: -128> 2024-09-12T17:37:33.334+0000 7ff94940f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.37:3300/0 2024-09-12T17:37:33.704 INFO:tasks.workunit.client.0.smithi037.stderr: -127> 2024-09-12T17:37:33.334+0000 7ff94940f800 1 librados: init done 2024-09-12T17:37:33.704 INFO:tasks.workunit.client.0.smithi037.stderr: -126> 2024-09-12T17:37:33.334+0000 7ff94940f800 5 asok(0x564fe530e730) register_command cr dump hook 0x564fe55ffe58 2024-09-12T17:37:33.704 INFO:tasks.workunit.client.0.smithi037.stderr: -125> 2024-09-12T17:37:33.336+0000 7ff94940f800 20 rados->read ofs=0 len=0 2024-09-12T17:37:33.704 INFO:tasks.workunit.client.0.smithi037.stderr: -124> 2024-09-12T17:37:33.336+0000 7ff81a7fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:37:33.704 INFO:tasks.workunit.client.0.smithi037.stderr: -123> 2024-09-12T17:37:33.336+0000 7ff81a7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.40:6816/3916250676,v1:172.21.15.40:6817/3916250676] 2024-09-12T17:37:33.704 INFO:tasks.workunit.client.0.smithi037.stderr: -122> 2024-09-12T17:37:33.336+0000 7ff81a7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.40:6816/3916250676,v1:172.21.15.40:6817/3916250676] 2024-09-12T17:37:33.704 INFO:tasks.workunit.client.0.smithi037.stderr: -121> 2024-09-12T17:37:33.337+0000 7ff944b48640 10 monclient: get_auth_request con 0x7ff8100764a0 auth_method 0 2024-09-12T17:37:33.704 INFO:tasks.workunit.client.0.smithi037.stderr: -120> 2024-09-12T17:37:33.337+0000 7ff945349640 10 monclient: get_auth_request con 0x564fe561cd00 auth_method 0 2024-09-12T17:37:33.704 INFO:tasks.workunit.client.0.smithi037.stderr: -119> 2024-09-12T17:37:33.337+0000 7ff94940f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:33.704 INFO:tasks.workunit.client.0.smithi037.stderr: -118> 2024-09-12T17:37:33.337+0000 7ff94940f800 20 realm 2024-09-12T17:37:33.704 INFO:tasks.workunit.client.0.smithi037.stderr: -117> 2024-09-12T17:37:33.337+0000 7ff94940f800 20 rados->read ofs=0 len=0 2024-09-12T17:37:33.704 INFO:tasks.workunit.client.0.smithi037.stderr: -116> 2024-09-12T17:37:33.337+0000 7ff94940f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:33.704 INFO:tasks.workunit.client.0.smithi037.stderr: -115> 2024-09-12T17:37:33.337+0000 7ff94940f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:37:33.705 INFO:tasks.workunit.client.0.smithi037.stderr: -114> 2024-09-12T17:37:33.337+0000 7ff94940f800 20 rados->read ofs=0 len=0 2024-09-12T17:37:33.705 INFO:tasks.workunit.client.0.smithi037.stderr: -113> 2024-09-12T17:37:33.338+0000 7ff94940f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:33.705 INFO:tasks.workunit.client.0.smithi037.stderr: -112> 2024-09-12T17:37:33.338+0000 7ff94940f800 20 rados->read ofs=0 len=0 2024-09-12T17:37:33.705 INFO:tasks.workunit.client.0.smithi037.stderr: -111> 2024-09-12T17:37:33.338+0000 7ff944b48640 10 monclient: get_auth_request con 0x564fe5620f20 auth_method 0 2024-09-12T17:37:33.705 INFO:tasks.workunit.client.0.smithi037.stderr: -110> 2024-09-12T17:37:33.338+0000 7ff94940f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:37:33.705 INFO:tasks.workunit.client.0.smithi037.stderr: -109> 2024-09-12T17:37:33.338+0000 7ff94940f800 20 rados->read ofs=0 len=0 2024-09-12T17:37:33.705 INFO:tasks.workunit.client.0.smithi037.stderr: -108> 2024-09-12T17:37:33.339+0000 7ff94940f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:37:33.705 INFO:tasks.workunit.client.0.smithi037.stderr: -107> 2024-09-12T17:37:33.339+0000 7ff94940f800 20 searching for the correct realm 2024-09-12T17:37:33.705 INFO:tasks.workunit.client.0.smithi037.stderr: -106> 2024-09-12T17:37:33.339+0000 7ff944347640 10 monclient: get_auth_request con 0x564fe56261a0 auth_method 0 2024-09-12T17:37:33.705 INFO:tasks.workunit.client.0.smithi037.stderr: -105> 2024-09-12T17:37:33.340+0000 7ff945349640 10 monclient: get_auth_request con 0x7ff93806f4e0 auth_method 0 2024-09-12T17:37:33.705 INFO:tasks.workunit.client.0.smithi037.stderr: -104> 2024-09-12T17:37:33.340+0000 7ff944b48640 10 monclient: get_auth_request con 0x7ff93c079040 auth_method 0 2024-09-12T17:37:33.705 INFO:tasks.workunit.client.0.smithi037.stderr: -103> 2024-09-12T17:37:33.341+0000 7ff944347640 10 monclient: get_auth_request con 0x7ff93400e070 auth_method 0 2024-09-12T17:37:33.705 INFO:tasks.workunit.client.0.smithi037.stderr: -102> 2024-09-12T17:37:33.342+0000 7ff944347640 0 -- 172.21.15.37:0/2870448384 >> [v2:172.21.15.40:6800/2441293461,v1:172.21.15.40:6801/2441293461] conn(0x7ff93400e070 msgr2=0x7ff934082a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:37:33.705 INFO:tasks.workunit.client.0.smithi037.stderr: -101> 2024-09-12T17:37:33.342+0000 7ff81a7fc640 1 client.8289.objecter ms_handle_reset 0x7ff93400e070 session 0x7ff934080040 osd.4 2024-09-12T17:37:33.706 INFO:tasks.workunit.client.0.smithi037.stderr: -100> 2024-09-12T17:37:33.342+0000 7ff81a7fc640 10 monclient: _renew_subs 2024-09-12T17:37:33.706 INFO:tasks.workunit.client.0.smithi037.stderr: -99> 2024-09-12T17:37:33.342+0000 7ff81a7fc640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.37:3300/0 2024-09-12T17:37:33.706 INFO:tasks.workunit.client.0.smithi037.stderr: -98> 2024-09-12T17:37:33.342+0000 7ff944347640 10 monclient: get_auth_request con 0x7ff810086b40 auth_method 0 2024-09-12T17:37:33.706 INFO:tasks.workunit.client.0.smithi037.stderr: -97> 2024-09-12T17:37:33.343+0000 7ff945349640 10 monclient: get_auth_request con 0x7ff938003090 auth_method 0 2024-09-12T17:37:33.706 INFO:tasks.workunit.client.0.smithi037.stderr: -96> 2024-09-12T17:37:33.345+0000 7ff944b48640 10 monclient: get_auth_request con 0x7ff93806f980 auth_method 0 2024-09-12T17:37:33.706 INFO:tasks.workunit.client.0.smithi037.stderr: -95> 2024-09-12T17:37:33.345+0000 7ff944b48640 0 -- 172.21.15.37:0/2870448384 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7ff93806f980 msgr2=0x7ff93803e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:37:33.706 INFO:tasks.workunit.client.0.smithi037.stderr: -94> 2024-09-12T17:37:33.546+0000 7ff944b48640 10 monclient: get_auth_request con 0x7ff93806f980 auth_method 0 2024-09-12T17:37:33.706 INFO:tasks.workunit.client.0.smithi037.stderr: -93> 2024-09-12T17:37:33.551+0000 7ff94940f800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:37:33.706 INFO:tasks.workunit.client.0.smithi037.stderr: -92> 2024-09-12T17:37:33.551+0000 7ff94940f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:37:33.706 INFO:tasks.workunit.client.0.smithi037.stderr: -91> 2024-09-12T17:37:33.551+0000 7ff94940f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:37:33.706 INFO:tasks.workunit.client.0.smithi037.stderr: -90> 2024-09-12T17:37:33.551+0000 7ff94940f800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:37:33.706 INFO:tasks.workunit.client.0.smithi037.stderr: -89> 2024-09-12T17:37:33.551+0000 7ff94940f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:37:33.706 INFO:tasks.workunit.client.0.smithi037.stderr: -88> 2024-09-12T17:37:33.551+0000 7ff94940f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:37:33.706 INFO:tasks.workunit.client.0.smithi037.stderr: -87> 2024-09-12T17:37:33.551+0000 7ff94940f800 20 rados->read ofs=0 len=0 2024-09-12T17:37:33.706 INFO:tasks.workunit.client.0.smithi037.stderr: -86> 2024-09-12T17:37:33.552+0000 7ff94940f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:33.707 INFO:tasks.workunit.client.0.smithi037.stderr: -85> 2024-09-12T17:37:33.552+0000 7ff94940f800 20 rados->read ofs=0 len=0 2024-09-12T17:37:33.707 INFO:tasks.workunit.client.0.smithi037.stderr: -84> 2024-09-12T17:37:33.552+0000 7ff94940f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:37:33.707 INFO:tasks.workunit.client.0.smithi037.stderr: -83> 2024-09-12T17:37:33.552+0000 7ff94940f800 20 rados->read ofs=0 len=0 2024-09-12T17:37:33.707 INFO:tasks.workunit.client.0.smithi037.stderr: -82> 2024-09-12T17:37:33.552+0000 7ff94940f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:37:33.707 INFO:tasks.workunit.client.0.smithi037.stderr: -81> 2024-09-12T17:37:33.552+0000 7ff94940f800 20 zone default found 2024-09-12T17:37:33.707 INFO:tasks.workunit.client.0.smithi037.stderr: -80> 2024-09-12T17:37:33.552+0000 7ff94940f800 4 Realm: () 2024-09-12T17:37:33.707 INFO:tasks.workunit.client.0.smithi037.stderr: -79> 2024-09-12T17:37:33.552+0000 7ff94940f800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:37:33.707 INFO:tasks.workunit.client.0.smithi037.stderr: -78> 2024-09-12T17:37:33.552+0000 7ff94940f800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:37:33.707 INFO:tasks.workunit.client.0.smithi037.stderr: -77> 2024-09-12T17:37:33.552+0000 7ff94940f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:37:33.707 INFO:tasks.workunit.client.0.smithi037.stderr: -76> 2024-09-12T17:37:33.552+0000 7ff94940f800 20 zonegroup default 2024-09-12T17:37:33.707 INFO:tasks.workunit.client.0.smithi037.stderr: -75> 2024-09-12T17:37:33.552+0000 7ff94940f800 20 rados->read ofs=0 len=0 2024-09-12T17:37:33.707 INFO:tasks.workunit.client.0.smithi037.stderr: -74> 2024-09-12T17:37:33.553+0000 7ff94940f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:33.707 INFO:tasks.workunit.client.0.smithi037.stderr: -73> 2024-09-12T17:37:33.553+0000 7ff94940f800 20 rados->read ofs=0 len=0 2024-09-12T17:37:33.708 INFO:tasks.workunit.client.0.smithi037.stderr: -72> 2024-09-12T17:37:33.553+0000 7ff94940f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:33.708 INFO:tasks.workunit.client.0.smithi037.stderr: -71> 2024-09-12T17:37:33.553+0000 7ff94940f800 20 rados->read ofs=0 len=0 2024-09-12T17:37:33.708 INFO:tasks.workunit.client.0.smithi037.stderr: -70> 2024-09-12T17:37:33.554+0000 7ff94940f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:33.708 INFO:tasks.workunit.client.0.smithi037.stderr: -69> 2024-09-12T17:37:33.554+0000 7ff94940f800 20 started sync module instance, tier type = 2024-09-12T17:37:33.708 INFO:tasks.workunit.client.0.smithi037.stderr: -68> 2024-09-12T17:37:33.554+0000 7ff94940f800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:37:33.708 INFO:tasks.workunit.client.0.smithi037.stderr: -67> 2024-09-12T17:37:33.564+0000 7ff94940f800 20 add_watcher() i=0 2024-09-12T17:37:33.708 INFO:tasks.workunit.client.0.smithi037.stderr: -66> 2024-09-12T17:37:33.564+0000 7ff94940f800 20 add_watcher() i=1 2024-09-12T17:37:33.708 INFO:tasks.workunit.client.0.smithi037.stderr: -65> 2024-09-12T17:37:33.564+0000 7ff94940f800 20 add_watcher() i=2 2024-09-12T17:37:33.708 INFO:tasks.workunit.client.0.smithi037.stderr: -64> 2024-09-12T17:37:33.564+0000 7ff94940f800 20 add_watcher() i=3 2024-09-12T17:37:33.708 INFO:tasks.workunit.client.0.smithi037.stderr: -63> 2024-09-12T17:37:33.564+0000 7ff94940f800 20 add_watcher() i=4 2024-09-12T17:37:33.708 INFO:tasks.workunit.client.0.smithi037.stderr: -62> 2024-09-12T17:37:33.564+0000 7ff94940f800 20 add_watcher() i=5 2024-09-12T17:37:33.708 INFO:tasks.workunit.client.0.smithi037.stderr: -61> 2024-09-12T17:37:33.565+0000 7ff94940f800 20 add_watcher() i=6 2024-09-12T17:37:33.708 INFO:tasks.workunit.client.0.smithi037.stderr: -60> 2024-09-12T17:37:33.565+0000 7ff94940f800 20 add_watcher() i=7 2024-09-12T17:37:33.709 INFO:tasks.workunit.client.0.smithi037.stderr: -59> 2024-09-12T17:37:33.565+0000 7ff94940f800 2 all 8 watchers are set, enabling cache 2024-09-12T17:37:33.709 INFO:tasks.workunit.client.0.smithi037.stderr: -58> 2024-09-12T17:37:33.568+0000 7ff94940f800 5 AuthRegistry(0x7ffef42b9e30) adding auth protocol: cephx 2024-09-12T17:37:33.709 INFO:tasks.workunit.client.0.smithi037.stderr: -57> 2024-09-12T17:37:33.568+0000 7ff94940f800 5 AuthRegistry(0x7ffef42b9e30) adding auth protocol: cephx 2024-09-12T17:37:33.709 INFO:tasks.workunit.client.0.smithi037.stderr: -56> 2024-09-12T17:37:33.568+0000 7ff94940f800 5 AuthRegistry(0x7ffef42b9e30) adding auth protocol: cephx 2024-09-12T17:37:33.709 INFO:tasks.workunit.client.0.smithi037.stderr: -55> 2024-09-12T17:37:33.568+0000 7ff94940f800 5 AuthRegistry(0x7ffef42b9e30) adding con mode: secure 2024-09-12T17:37:33.709 INFO:tasks.workunit.client.0.smithi037.stderr: -54> 2024-09-12T17:37:33.568+0000 7ff94940f800 5 AuthRegistry(0x7ffef42b9e30) adding con mode: crc 2024-09-12T17:37:33.709 INFO:tasks.workunit.client.0.smithi037.stderr: -53> 2024-09-12T17:37:33.568+0000 7ff94940f800 5 AuthRegistry(0x7ffef42b9e30) adding con mode: secure 2024-09-12T17:37:33.709 INFO:tasks.workunit.client.0.smithi037.stderr: -52> 2024-09-12T17:37:33.568+0000 7ff94940f800 5 AuthRegistry(0x7ffef42b9e30) adding con mode: crc 2024-09-12T17:37:33.709 INFO:tasks.workunit.client.0.smithi037.stderr: -51> 2024-09-12T17:37:33.568+0000 7ff7fb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:37:33.709 INFO:tasks.workunit.client.0.smithi037.stderr: -50> 2024-09-12T17:37:33.568+0000 7ff94940f800 5 AuthRegistry(0x7ffef42b9e30) adding con mode: secure 2024-09-12T17:37:33.709 INFO:tasks.workunit.client.0.smithi037.stderr: -49> 2024-09-12T17:37:33.568+0000 7ff94940f800 5 AuthRegistry(0x7ffef42b9e30) adding con mode: crc 2024-09-12T17:37:33.709 INFO:tasks.workunit.client.0.smithi037.stderr: -48> 2024-09-12T17:37:33.568+0000 7ff94940f800 5 AuthRegistry(0x7ffef42b9e30) adding con mode: crc 2024-09-12T17:37:33.709 INFO:tasks.workunit.client.0.smithi037.stderr: -47> 2024-09-12T17:37:33.568+0000 7ff94940f800 5 AuthRegistry(0x7ffef42b9e30) adding con mode: secure 2024-09-12T17:37:33.710 INFO:tasks.workunit.client.0.smithi037.stderr: -46> 2024-09-12T17:37:33.568+0000 7ff94940f800 5 AuthRegistry(0x7ffef42b9e30) adding con mode: crc 2024-09-12T17:37:33.710 INFO:tasks.workunit.client.0.smithi037.stderr: -45> 2024-09-12T17:37:33.568+0000 7ff94940f800 5 AuthRegistry(0x7ffef42b9e30) adding con mode: secure 2024-09-12T17:37:33.710 INFO:tasks.workunit.client.0.smithi037.stderr: -44> 2024-09-12T17:37:33.568+0000 7ff94940f800 5 AuthRegistry(0x7ffef42b9e30) adding con mode: crc 2024-09-12T17:37:33.710 INFO:tasks.workunit.client.0.smithi037.stderr: -43> 2024-09-12T17:37:33.568+0000 7ff94940f800 5 AuthRegistry(0x7ffef42b9e30) adding con mode: secure 2024-09-12T17:37:33.710 INFO:tasks.workunit.client.0.smithi037.stderr: -42> 2024-09-12T17:37:33.568+0000 7ff94940f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:37:33.710 INFO:tasks.workunit.client.0.smithi037.stderr: -41> 2024-09-12T17:37:33.568+0000 7ff94940f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:37:33.710 INFO:tasks.workunit.client.0.smithi037.stderr: -40> 2024-09-12T17:37:33.568+0000 7ff94940f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:37:33.710 INFO:tasks.workunit.client.0.smithi037.stderr: -39> 2024-09-12T17:37:33.568+0000 7ff94940f800 5 asok(0x564fe530e730) register_command cache list hook 0x564fe55f91c0 2024-09-12T17:37:33.710 INFO:tasks.workunit.client.0.smithi037.stderr: -38> 2024-09-12T17:37:33.568+0000 7ff94940f800 5 asok(0x564fe530e730) register_command cache inspect hook 0x564fe55f91c0 2024-09-12T17:37:33.710 INFO:tasks.workunit.client.0.smithi037.stderr: -37> 2024-09-12T17:37:33.568+0000 7ff94940f800 5 asok(0x564fe530e730) register_command cache erase hook 0x564fe55f91c0 2024-09-12T17:37:33.710 INFO:tasks.workunit.client.0.smithi037.stderr: -36> 2024-09-12T17:37:33.568+0000 7ff94940f800 5 asok(0x564fe530e730) register_command cache zap hook 0x564fe55f91c0 2024-09-12T17:37:33.710 INFO:tasks.workunit.client.0.smithi037.stderr: -35> 2024-09-12T17:37:33.568+0000 7ff94940f800 5 note: GC not initialized 2024-09-12T17:37:33.710 INFO:tasks.workunit.client.0.smithi037.stderr: -34> 2024-09-12T17:37:33.568+0000 7ff7fa7e4640 20 reqs_thread_entry: start 2024-09-12T17:37:33.710 INFO:tasks.workunit.client.0.smithi037.stderr: -33> 2024-09-12T17:37:33.568+0000 7ff94940f800 5 asok(0x564fe530e730) register_command sync trace show hook 0x7ff93c04dda0 2024-09-12T17:37:33.711 INFO:tasks.workunit.client.0.smithi037.stderr: -32> 2024-09-12T17:37:33.568+0000 7ff94940f800 5 asok(0x564fe530e730) register_command sync trace history hook 0x7ff93c04dda0 2024-09-12T17:37:33.711 INFO:tasks.workunit.client.0.smithi037.stderr: -31> 2024-09-12T17:37:33.568+0000 7ff94940f800 5 asok(0x564fe530e730) register_command sync trace active hook 0x7ff93c04dda0 2024-09-12T17:37:33.711 INFO:tasks.workunit.client.0.smithi037.stderr: -30> 2024-09-12T17:37:33.568+0000 7ff94940f800 5 asok(0x564fe530e730) register_command sync trace active_short hook 0x7ff93c04dda0 2024-09-12T17:37:33.711 INFO:tasks.workunit.client.0.smithi037.stderr: -29> 2024-09-12T17:37:33.568+0000 7ff94940f800 20 init_complete bucket index max shards: 11 2024-09-12T17:37:33.711 INFO:tasks.workunit.client.0.smithi037.stderr: -28> 2024-09-12T17:37:33.569+0000 7ff94940f800 20 Filter name: none 2024-09-12T17:37:33.711 INFO:tasks.workunit.client.0.smithi037.stderr: -27> 2024-09-12T17:37:33.569+0000 7ff7f37fe640 20 reqs_thread_entry: start 2024-09-12T17:37:33.711 INFO:tasks.workunit.client.0.smithi037.stderr: -26> 2024-09-12T17:37:33.569+0000 7ff94940f800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:37:33.711 INFO:tasks.workunit.client.0.smithi037.stderr: -25> 2024-09-12T17:37:33.569+0000 7ff94940f800 20 rados->read ofs=0 len=0 2024-09-12T17:37:33.711 INFO:tasks.workunit.client.0.smithi037.stderr: -24> 2024-09-12T17:37:33.569+0000 7ff94940f800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:37:33.711 INFO:tasks.workunit.client.0.smithi037.stderr: -23> 2024-09-12T17:37:33.569+0000 7ff94940f800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:37:33.711 INFO:tasks.workunit.client.0.smithi037.stderr: -22> 2024-09-12T17:37:33.569+0000 7ff94940f800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:37:33.711 INFO:tasks.workunit.client.0.smithi037.stderr: -21> 2024-09-12T17:37:33.569+0000 7ff94940f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 : miss 2024-09-12T17:37:33.711 INFO:tasks.workunit.client.0.smithi037.stderr: -20> 2024-09-12T17:37:33.569+0000 7ff94940f800 20 rados->read ofs=0 len=0 2024-09-12T17:37:33.711 INFO:tasks.workunit.client.0.smithi037.stderr: -19> 2024-09-12T17:37:33.570+0000 7ff94940f800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:37:33.712 INFO:tasks.workunit.client.0.smithi037.stderr: -18> 2024-09-12T17:37:33.570+0000 7ff94940f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 info.flags=0x17 2024-09-12T17:37:33.712 INFO:tasks.workunit.client.0.smithi037.stderr: -17> 2024-09-12T17:37:33.570+0000 7ff94940f800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 to cache LRU end 2024-09-12T17:37:33.712 INFO:tasks.workunit.client.0.smithi037.stderr: -16> 2024-09-12T17:37:33.570+0000 7ff94940f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:37:33.712 INFO:tasks.workunit.client.0.smithi037.stderr: -15> 2024-09-12T17:37:33.570+0000 7ff94940f800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:37:33.712 INFO:tasks.workunit.client.0.smithi037.stderr: -14> 2024-09-12T17:37:33.570+0000 7ff94940f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 2024-09-12T17:37:33.712 INFO:tasks.workunit.client.0.smithi037.stderr: -13> 2024-09-12T17:37:33.576+0000 7ff94940f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 info.flags=0x17 2024-09-12T17:37:33.712 INFO:tasks.workunit.client.0.smithi037.stderr: -12> 2024-09-12T17:37:33.576+0000 7ff94940f800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 to cache LRU end 2024-09-12T17:37:33.712 INFO:tasks.workunit.client.0.smithi037.stderr: -11> 2024-09-12T17:37:33.576+0000 7ff94940f800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:37:33.712 INFO:tasks.workunit.client.0.smithi037.stderr: -10> 2024-09-12T17:37:33.576+0000 7ff94940f800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18, ofs0, ns] 2024-09-12T17:37:33.712 INFO:tasks.workunit.client.0.smithi037.stderr: -9> 2024-09-12T17:37:33.576+0000 7ff81bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497019 cookie 94901150878768 notifier 8289 bl.length()=911 2024-09-12T17:37:33.712 INFO:tasks.workunit.client.0.smithi037.stderr: -8> 2024-09-12T17:37:33.576+0000 7ff81bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 info.flags=0x17 2024-09-12T17:37:33.712 INFO:tasks.workunit.client.0.smithi037.stderr: -7> 2024-09-12T17:37:33.576+0000 7ff81bfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 to cache LRU end 2024-09-12T17:37:33.712 INFO:tasks.workunit.client.0.smithi037.stderr: -6> 2024-09-12T17:37:33.576+0000 7ff81bfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:37:33.713 INFO:tasks.workunit.client.0.smithi037.stderr: -5> 2024-09-12T17:37:33.578+0000 7ff94940f800 20 handle_bi_update(): bucket=:a-bucket[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18]): orig_sources= new_sources= 2024-09-12T17:37:33.713 INFO:tasks.workunit.client.0.smithi037.stderr: -4> 2024-09-12T17:37:33.578+0000 7ff94940f800 20 handle_bi_update(): bucket=:a-bucket[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18]): potential sources added=[] removed=[] 2024-09-12T17:37:33.713 INFO:tasks.workunit.client.0.smithi037.stderr: -3> 2024-09-12T17:37:33.578+0000 7ff94940f800 20 handle_bi_update(): bucket=:a-bucket[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18]): orig_dests= new_dests= 2024-09-12T17:37:33.713 INFO:tasks.workunit.client.0.smithi037.stderr: -2> 2024-09-12T17:37:33.578+0000 7ff94940f800 20 handle_bi_update(): bucket=:a-bucket[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18]): potential dests added=[] removed=[] 2024-09-12T17:37:33.713 INFO:tasks.workunit.client.0.smithi037.stderr: -1> 2024-09-12T17:37:33.584+0000 7ff94940f800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7ff94940f800 time 2024-09-12T17:37:33.585025+0000 2024-09-12T17:37:33.713 INFO:tasks.workunit.client.0.smithi037.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:37:33.713 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:37:33.713 INFO:tasks.workunit.client.0.smithi037.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:37:33.713 INFO:tasks.workunit.client.0.smithi037.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7ff94a58c71a] 2024-09-12T17:37:33.713 INFO:tasks.workunit.client.0.smithi037.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7ff94a58c8d8] 2024-09-12T17:37:33.713 INFO:tasks.workunit.client.0.smithi037.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x564fe4049841] 2024-09-12T17:37:33.713 INFO:tasks.workunit.client.0.smithi037.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x564fe405957a] 2024-09-12T17:37:33.713 INFO:tasks.workunit.client.0.smithi037.stderr: 5: main() 2024-09-12T17:37:33.714 INFO:tasks.workunit.client.0.smithi037.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7ff949229590] 2024-09-12T17:37:33.714 INFO:tasks.workunit.client.0.smithi037.stderr: 7: __libc_start_main() 2024-09-12T17:37:33.714 INFO:tasks.workunit.client.0.smithi037.stderr: 8: _start() 2024-09-12T17:37:33.714 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:37:33.714 INFO:tasks.workunit.client.0.smithi037.stderr: 0> 2024-09-12T17:37:33.585+0000 7ff94940f800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:37:33.714 INFO:tasks.workunit.client.0.smithi037.stderr: in thread 7ff94940f800 thread_name:radosgw-admin 2024-09-12T17:37:33.714 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:37:33.714 INFO:tasks.workunit.client.0.smithi037.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:37:33.714 INFO:tasks.workunit.client.0.smithi037.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7ff94923e6f0] 2024-09-12T17:37:33.714 INFO:tasks.workunit.client.0.smithi037.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7ff94928b99c] 2024-09-12T17:37:33.714 INFO:tasks.workunit.client.0.smithi037.stderr: 3: raise() 2024-09-12T17:37:33.714 INFO:tasks.workunit.client.0.smithi037.stderr: 4: abort() 2024-09-12T17:37:33.714 INFO:tasks.workunit.client.0.smithi037.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7ff94a58c774] 2024-09-12T17:37:33.714 INFO:tasks.workunit.client.0.smithi037.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7ff94a58c8d8] 2024-09-12T17:37:33.715 INFO:tasks.workunit.client.0.smithi037.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x564fe4049841] 2024-09-12T17:37:33.715 INFO:tasks.workunit.client.0.smithi037.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x564fe405957a] 2024-09-12T17:37:33.715 INFO:tasks.workunit.client.0.smithi037.stderr: 9: main() 2024-09-12T17:37:33.715 INFO:tasks.workunit.client.0.smithi037.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7ff949229590] 2024-09-12T17:37:33.715 INFO:tasks.workunit.client.0.smithi037.stderr: 11: __libc_start_main() 2024-09-12T17:37:33.715 INFO:tasks.workunit.client.0.smithi037.stderr: 12: _start() 2024-09-12T17:37:33.715 INFO:tasks.workunit.client.0.smithi037.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:37:33.715 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:37:33.715 INFO:tasks.workunit.client.0.smithi037.stderr:--- logging levels --- 2024-09-12T17:37:33.715 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 none 2024-09-12T17:37:33.715 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 lockdep 2024-09-12T17:37:33.715 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 context 2024-09-12T17:37:33.715 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 1 crush 2024-09-12T17:37:33.716 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mds 2024-09-12T17:37:33.716 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mds_balancer 2024-09-12T17:37:33.716 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mds_locker 2024-09-12T17:37:33.716 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mds_log 2024-09-12T17:37:33.716 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mds_log_expire 2024-09-12T17:37:33.716 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mds_migrator 2024-09-12T17:37:33.716 INFO:tasks.workunit.client.0.smithi037.stderr: 3/ 5 mds_quiesce 2024-09-12T17:37:33.716 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 buffer 2024-09-12T17:37:33.716 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 timer 2024-09-12T17:37:33.716 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 filer 2024-09-12T17:37:33.716 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 striper 2024-09-12T17:37:33.716 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 objecter 2024-09-12T17:37:33.716 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 rados 2024-09-12T17:37:33.716 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 rbd 2024-09-12T17:37:33.717 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 rbd_mirror 2024-09-12T17:37:33.717 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 rbd_replay 2024-09-12T17:37:33.717 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 rbd_pwl 2024-09-12T17:37:33.717 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 journaler 2024-09-12T17:37:33.717 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 objectcacher 2024-09-12T17:37:33.717 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:37:33.717 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 client 2024-09-12T17:37:33.717 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 osd 2024-09-12T17:37:33.717 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 optracker 2024-09-12T17:37:33.717 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 objclass 2024-09-12T17:37:33.717 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 3 filestore 2024-09-12T17:37:33.717 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 3 journal 2024-09-12T17:37:33.717 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 0 ms 2024-09-12T17:37:33.717 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mon 2024-09-12T17:37:33.718 INFO:tasks.workunit.client.0.smithi037.stderr: 0/10 monc 2024-09-12T17:37:33.718 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 paxos 2024-09-12T17:37:33.718 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 tp 2024-09-12T17:37:33.718 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 auth 2024-09-12T17:37:33.718 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 crypto 2024-09-12T17:37:33.718 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 1 finisher 2024-09-12T17:37:33.718 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 1 reserver 2024-09-12T17:37:33.718 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 heartbeatmap 2024-09-12T17:37:33.718 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 perfcounter 2024-09-12T17:37:33.718 INFO:tasks.workunit.client.0.smithi037.stderr: 20/20 rgw 2024-09-12T17:37:33.718 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 rgw_sync 2024-09-12T17:37:33.718 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 rgw_datacache 2024-09-12T17:37:33.718 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 rgw_access 2024-09-12T17:37:33.719 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:37:33.719 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 rgw_flight 2024-09-12T17:37:33.719 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:37:33.719 INFO:tasks.workunit.client.0.smithi037.stderr: 20/20 rgw_notification 2024-09-12T17:37:33.719 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 javaclient 2024-09-12T17:37:33.719 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 asok 2024-09-12T17:37:33.719 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 1 throttle 2024-09-12T17:37:33.719 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 0 refs 2024-09-12T17:37:33.719 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 compressor 2024-09-12T17:37:33.719 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 bluestore 2024-09-12T17:37:33.719 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 bluefs 2024-09-12T17:37:33.719 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 3 bdev 2024-09-12T17:37:33.719 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 kstore 2024-09-12T17:37:33.719 INFO:tasks.workunit.client.0.smithi037.stderr: 4/ 5 rocksdb 2024-09-12T17:37:33.720 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 fuse 2024-09-12T17:37:33.720 INFO:tasks.workunit.client.0.smithi037.stderr: 2/ 5 mgr 2024-09-12T17:37:33.720 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mgrc 2024-09-12T17:37:33.720 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 dpdk 2024-09-12T17:37:33.720 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 eventtrace 2024-09-12T17:37:33.720 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 prioritycache 2024-09-12T17:37:33.720 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 test 2024-09-12T17:37:33.720 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:37:33.720 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 cephsqlite 2024-09-12T17:37:33.720 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:37:33.720 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore 2024-09-12T17:37:33.720 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_onode 2024-09-12T17:37:33.720 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_odata 2024-09-12T17:37:33.721 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_omap 2024-09-12T17:37:33.721 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_tm 2024-09-12T17:37:33.721 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_t 2024-09-12T17:37:33.721 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:37:33.721 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_epm 2024-09-12T17:37:33.721 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_lba 2024-09-12T17:37:33.721 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:37:33.721 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_cache 2024-09-12T17:37:33.721 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_journal 2024-09-12T17:37:33.721 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_device 2024-09-12T17:37:33.721 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_backref 2024-09-12T17:37:33.721 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 alienstore 2024-09-12T17:37:33.721 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mclock 2024-09-12T17:37:33.722 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 cyanstore 2024-09-12T17:37:33.722 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 ceph_exporter 2024-09-12T17:37:33.722 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 memstore 2024-09-12T17:37:33.722 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 trace 2024-09-12T17:37:33.722 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 ceph_dedup 2024-09-12T17:37:33.722 INFO:tasks.workunit.client.0.smithi037.stderr: -2/-2 (syslog threshold) 2024-09-12T17:37:33.722 INFO:tasks.workunit.client.0.smithi037.stderr: 99/99 (stderr threshold) 2024-09-12T17:37:33.722 INFO:tasks.workunit.client.0.smithi037.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:37:33.722 INFO:tasks.workunit.client.0.smithi037.stderr: 7ff7f37fe640 / http_manager 2024-09-12T17:37:33.722 INFO:tasks.workunit.client.0.smithi037.stderr: 7ff7fa7e4640 / http_manager 2024-09-12T17:37:33.722 INFO:tasks.workunit.client.0.smithi037.stderr: 7ff7fb7e6640 / rgw_dt_lg_renew 2024-09-12T17:37:33.722 INFO:tasks.workunit.client.0.smithi037.stderr: 7ff81a7fc640 / ms_dispatch 2024-09-12T17:37:33.722 INFO:tasks.workunit.client.0.smithi037.stderr: 7ff81bfff640 / io_context_pool 2024-09-12T17:37:33.722 INFO:tasks.workunit.client.0.smithi037.stderr: 7ff82a7fc640 / ms_dispatch 2024-09-12T17:37:33.723 INFO:tasks.workunit.client.0.smithi037.stderr: 7ff83160a640 / ms_dispatch 2024-09-12T17:37:33.723 INFO:tasks.workunit.client.0.smithi037.stderr: 7ff832e0d640 / io_context_pool 2024-09-12T17:37:33.723 INFO:tasks.workunit.client.0.smithi037.stderr: 7ff944347640 / msgr-worker-2 2024-09-12T17:37:33.723 INFO:tasks.workunit.client.0.smithi037.stderr: 7ff944b48640 / msgr-worker-1 2024-09-12T17:37:33.723 INFO:tasks.workunit.client.0.smithi037.stderr: 7ff945349640 / msgr-worker-0 2024-09-12T17:37:33.723 INFO:tasks.workunit.client.0.smithi037.stderr: 7ff945b4a640 / io_context_pool 2024-09-12T17:37:33.723 INFO:tasks.workunit.client.0.smithi037.stderr: 7ff94940f800 / radosgw-admin 2024-09-12T17:37:33.723 INFO:tasks.workunit.client.0.smithi037.stderr: max_recent 500 2024-09-12T17:37:33.723 INFO:tasks.workunit.client.0.smithi037.stderr: max_new 1000 2024-09-12T17:37:33.723 INFO:tasks.workunit.client.0.smithi037.stderr: log_file /var/lib/ceph/crash/2024-09-12T17:37:33.586412Z_515c73df-fa2a-4da7-a698-48b554a59e9c/log 2024-09-12T17:37:33.723 INFO:tasks.workunit.client.0.smithi037.stderr:--- end dump of recent events --- 2024-09-12T17:37:33.723 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T17:37:33.725 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:37:33.725 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:37:33.725 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.663+0000 7fd82a540800 20 rados->read ofs=0 len=0 2024-09-12T17:37:33.725 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.665+0000 7fd82a540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:33.725 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.665+0000 7fd82a540800 20 realm 2024-09-12T17:37:33.725 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.665+0000 7fd82a540800 20 rados->read ofs=0 len=0 2024-09-12T17:37:33.725 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.665+0000 7fd82a540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:33.726 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.665+0000 7fd82a540800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:37:33.726 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.665+0000 7fd82a540800 20 rados->read ofs=0 len=0 2024-09-12T17:37:33.726 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.665+0000 7fd82a540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:33.726 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.665+0000 7fd82a540800 20 rados->read ofs=0 len=0 2024-09-12T17:37:33.726 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.666+0000 7fd82a540800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:37:33.726 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.666+0000 7fd82a540800 20 rados->read ofs=0 len=0 2024-09-12T17:37:33.726 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.666+0000 7fd82a540800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:37:33.726 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.666+0000 7fd82a540800 20 searching for the correct realm 2024-09-12T17:37:33.726 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.670+0000 7fd826a87640 0 -- 172.21.15.37:0/1226886067 >> [v2:172.21.15.40:6818/1210108009,v1:172.21.15.40:6819/1210108009] conn(0x7fd81c0470b0 msgr2=0x7fd81c07f370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:37:33.726 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.673+0000 7fd826286640 0 -- 172.21.15.37:0/1226886067 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7fd81c049360 msgr2=0x7fd81c069a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:37:33.881 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.880+0000 7fd82a540800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:37:33.881 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.880+0000 7fd82a540800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:37:33.882 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.880+0000 7fd82a540800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:37:33.882 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.880+0000 7fd82a540800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:37:33.882 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.880+0000 7fd82a540800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:37:33.882 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.880+0000 7fd82a540800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:37:33.882 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.880+0000 7fd82a540800 20 rados->read ofs=0 len=0 2024-09-12T17:37:33.882 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.880+0000 7fd82a540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:33.882 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.880+0000 7fd82a540800 20 rados->read ofs=0 len=0 2024-09-12T17:37:33.883 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.881+0000 7fd82a540800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:37:33.883 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.881+0000 7fd82a540800 20 rados->read ofs=0 len=0 2024-09-12T17:37:33.883 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.881+0000 7fd82a540800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:37:33.883 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.881+0000 7fd82a540800 20 zone default found 2024-09-12T17:37:33.883 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.881+0000 7fd82a540800 4 Realm: () 2024-09-12T17:37:33.884 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.881+0000 7fd82a540800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:37:33.884 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.881+0000 7fd82a540800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:37:33.884 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.881+0000 7fd82a540800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:37:33.884 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.881+0000 7fd82a540800 20 zonegroup default 2024-09-12T17:37:33.884 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.881+0000 7fd82a540800 20 rados->read ofs=0 len=0 2024-09-12T17:37:33.884 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.882+0000 7fd82a540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:33.884 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.882+0000 7fd82a540800 20 rados->read ofs=0 len=0 2024-09-12T17:37:33.884 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.882+0000 7fd82a540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:33.884 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.882+0000 7fd82a540800 20 rados->read ofs=0 len=0 2024-09-12T17:37:33.884 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.882+0000 7fd82a540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:33.884 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.882+0000 7fd82a540800 20 started sync module instance, tier type = 2024-09-12T17:37:33.884 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.882+0000 7fd82a540800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:37:33.894 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.893+0000 7fd82a540800 20 add_watcher() i=0 2024-09-12T17:37:33.894 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.893+0000 7fd82a540800 20 add_watcher() i=1 2024-09-12T17:37:33.894 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.893+0000 7fd82a540800 20 add_watcher() i=2 2024-09-12T17:37:33.894 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.893+0000 7fd82a540800 20 add_watcher() i=3 2024-09-12T17:37:33.894 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.893+0000 7fd82a540800 20 add_watcher() i=4 2024-09-12T17:37:33.894 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.893+0000 7fd82a540800 20 add_watcher() i=5 2024-09-12T17:37:33.894 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.893+0000 7fd82a540800 20 add_watcher() i=6 2024-09-12T17:37:33.895 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.894+0000 7fd82a540800 20 add_watcher() i=7 2024-09-12T17:37:33.895 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.894+0000 7fd82a540800 2 all 8 watchers are set, enabling cache 2024-09-12T17:37:33.897 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.896+0000 7fd6dcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:37:33.898 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.897+0000 7fd82a540800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:37:33.898 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.897+0000 7fd82a540800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:37:33.898 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.897+0000 7fd82a540800 5 note: GC not initialized 2024-09-12T17:37:33.898 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.897+0000 7fd6577fe640 20 reqs_thread_entry: start 2024-09-12T17:37:33.898 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.897+0000 7fd82a540800 20 init_complete bucket index max shards: 11 2024-09-12T17:37:33.898 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.897+0000 7fd82a540800 20 Filter name: none 2024-09-12T17:37:33.898 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.897+0000 7fd6557fa640 20 reqs_thread_entry: start 2024-09-12T17:37:33.898 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.897+0000 7fd82a540800 20 rados->read ofs=0 len=0 2024-09-12T17:37:33.899 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.898+0000 7fd82a540800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:37:33.899 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.898+0000 7fd82a540800 20 rados->read ofs=0 len=0 2024-09-12T17:37:33.899 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.898+0000 7fd82a540800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T17:37:33.899 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.898+0000 7fd82a540800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:37:33.899 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.898+0000 7fd82a540800 20 rados->read ofs=0 len=0 2024-09-12T17:37:33.900 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.899+0000 7fd82a540800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:37:33.900 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.899+0000 7fd82a540800 20 rados->read ofs=0 len=0 2024-09-12T17:37:33.900 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.899+0000 7fd82a540800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T17:37:33.900 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.899+0000 7fd82a540800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:37:33.901 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.901+0000 7fd6dcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:37:33.904 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.903+0000 7fd82a540800 20 remove_watcher() i=0 2024-09-12T17:37:33.904 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.903+0000 7fd82a540800 2 removed watcher, disabling cache 2024-09-12T17:37:33.905 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.905+0000 7fd82a540800 20 remove_watcher() i=1 2024-09-12T17:37:33.906 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.906+0000 7fd82a540800 20 remove_watcher() i=2 2024-09-12T17:37:33.908 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.907+0000 7fd82a540800 20 remove_watcher() i=3 2024-09-12T17:37:33.909 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.909+0000 7fd82a540800 20 remove_watcher() i=4 2024-09-12T17:37:33.910 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.910+0000 7fd82a540800 20 remove_watcher() i=5 2024-09-12T17:37:33.911 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.911+0000 7fd82a540800 20 remove_watcher() i=6 2024-09-12T17:37:33.912 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:33.912+0000 7fd82a540800 20 remove_watcher() i=7 2024-09-12T17:37:33.960 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-12T17:37:33.989 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:37:33.989 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:37:34.029 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:34.028+0000 7f3035f35800 20 rados->read ofs=0 len=0 2024-09-12T17:37:34.031 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:34.030+0000 7f3035f35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:34.031 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:34.030+0000 7f3035f35800 20 realm 2024-09-12T17:37:34.031 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:34.030+0000 7f3035f35800 20 rados->read ofs=0 len=0 2024-09-12T17:37:34.031 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:34.030+0000 7f3035f35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:34.031 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:34.030+0000 7f3035f35800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:37:34.031 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:34.030+0000 7f3035f35800 20 rados->read ofs=0 len=0 2024-09-12T17:37:34.031 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:34.030+0000 7f3035f35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:34.031 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:34.030+0000 7f3035f35800 20 rados->read ofs=0 len=0 2024-09-12T17:37:34.032 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:34.031+0000 7f3035f35800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:37:34.032 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:34.031+0000 7f3035f35800 20 rados->read ofs=0 len=0 2024-09-12T17:37:34.032 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:34.032+0000 7f3035f35800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:37:34.033 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:34.032+0000 7f3035f35800 20 searching for the correct realm 2024-09-12T17:37:34.036 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:34.035+0000 7f303147c640 0 -- 172.21.15.37:0/3983620207 >> [v2:172.21.15.37:6816/2964054205,v1:172.21.15.37:6817/2964054205] conn(0x56209b56e6f0 msgr2=0x56209b570bb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:37:34.040 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:34.039+0000 7f3031c7d640 0 -- 172.21.15.37:0/3983620207 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7f30280ab070 msgr2=0x7f30280c40c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:37:34.045 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:34.044+0000 7f3035f35800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:37:34.045 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:34.044+0000 7f3035f35800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:37:34.045 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:34.044+0000 7f3035f35800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:37:34.045 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:34.044+0000 7f3035f35800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:37:34.045 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:34.044+0000 7f3035f35800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:37:34.045 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:34.044+0000 7f3035f35800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:37:34.045 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:34.044+0000 7f3035f35800 20 rados->read ofs=0 len=0 2024-09-12T17:37:34.045 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:34.044+0000 7f3035f35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:34.045 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:34.044+0000 7f3035f35800 20 rados->read ofs=0 len=0 2024-09-12T17:37:34.046 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:34.044+0000 7f3035f35800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:37:34.047 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:34.044+0000 7f3035f35800 20 rados->read ofs=0 len=0 2024-09-12T17:37:34.047 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:34.045+0000 7f3035f35800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:37:34.047 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:34.045+0000 7f3035f35800 20 zone default found 2024-09-12T17:37:34.047 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:34.045+0000 7f3035f35800 4 Realm: () 2024-09-12T17:37:34.047 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:34.045+0000 7f3035f35800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:37:34.047 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:34.045+0000 7f3035f35800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:37:34.047 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:34.045+0000 7f3035f35800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:37:34.047 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:34.045+0000 7f3035f35800 20 zonegroup default 2024-09-12T17:37:34.047 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:34.045+0000 7f3035f35800 20 rados->read ofs=0 len=0 2024-09-12T17:37:34.047 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:34.045+0000 7f3035f35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:34.047 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:34.045+0000 7f3035f35800 20 rados->read ofs=0 len=0 2024-09-12T17:37:34.047 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:34.045+0000 7f3035f35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:34.047 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:34.045+0000 7f3035f35800 20 rados->read ofs=0 len=0 2024-09-12T17:37:34.048 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:34.046+0000 7f3035f35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:37:34.048 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:34.046+0000 7f3035f35800 20 started sync module instance, tier type = 2024-09-12T17:37:34.048 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:34.046+0000 7f3035f35800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:37:34.056 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:34.055+0000 7f3035f35800 20 add_watcher() i=0 2024-09-12T17:37:34.056 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:34.055+0000 7f3035f35800 20 add_watcher() i=1 2024-09-12T17:37:34.056 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:34.055+0000 7f3035f35800 20 add_watcher() i=2 2024-09-12T17:37:34.056 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:34.055+0000 7f3035f35800 20 add_watcher() i=3 2024-09-12T17:37:34.056 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:34.055+0000 7f3035f35800 20 add_watcher() i=4 2024-09-12T17:37:34.056 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:34.055+0000 7f3035f35800 20 add_watcher() i=5 2024-09-12T17:37:34.056 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:34.055+0000 7f3035f35800 20 add_watcher() i=6 2024-09-12T17:37:34.057 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:34.056+0000 7f3035f35800 20 add_watcher() i=7 2024-09-12T17:37:34.057 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:34.056+0000 7f3035f35800 2 all 8 watchers are set, enabling cache 2024-09-12T17:37:34.058 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:34.058+0000 7f2ed37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:37:34.059 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:34.058+0000 7f3035f35800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:37:34.060 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:34.058+0000 7f3035f35800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:37:34.060 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:34.058+0000 7f3035f35800 5 note: GC not initialized 2024-09-12T17:37:34.060 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:34.058+0000 7f2ed27fc640 20 reqs_thread_entry: start 2024-09-12T17:37:34.060 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:34.058+0000 7f3035f35800 20 init_complete bucket index max shards: 11 2024-09-12T17:37:34.060 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:34.059+0000 7f3035f35800 20 Filter name: none 2024-09-12T17:37:34.060 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:34.059+0000 7f2e57fff640 20 reqs_thread_entry: start 2024-09-12T17:37:34.060 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:34.059+0000 7f3035f35800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:37:34.060 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:34.059+0000 7f3035f35800 20 rados->read ofs=0 len=0 2024-09-12T17:37:34.061 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:34.059+0000 7f3035f35800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:37:34.062 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:34.059+0000 7f3035f35800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:37:34.062 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:34.059+0000 7f3035f35800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:37:34.062 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:34.059+0000 7f3035f35800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 : miss 2024-09-12T17:37:34.062 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:34.059+0000 7f3035f35800 20 rados->read ofs=0 len=0 2024-09-12T17:37:34.062 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:34.060+0000 7f3035f35800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T17:37:34.062 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:34.060+0000 7f3035f35800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 info.flags=0x17 2024-09-12T17:37:34.062 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:34.060+0000 7f3035f35800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 to cache LRU end 2024-09-12T17:37:34.062 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:34.060+0000 7f3035f35800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:37:34.062 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:34.060+0000 7f3035f35800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:37:34.062 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:34.060+0000 7f3035f35800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 2024-09-12T17:37:34.062 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:34.060+0000 7f3035f35800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.0 2024-09-12T17:37:34.062 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:34.060+0000 7f3035f35800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.0 2024-09-12T17:37:34.062 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:34.060+0000 7f3035f35800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.1 2024-09-12T17:37:34.062 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:34.060+0000 7f3035f35800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.1 2024-09-12T17:37:34.063 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:34.061+0000 7f3035f35800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.2 2024-09-12T17:37:34.063 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:34.061+0000 7f3035f35800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.2 2024-09-12T17:37:34.063 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:34.061+0000 7f3035f35800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.3 2024-09-12T17:37:34.063 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:34.061+0000 7f3035f35800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.3 2024-09-12T17:37:34.063 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:34.062+0000 7f3035f35800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.4 2024-09-12T17:37:34.064 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:34.062+0000 7f3035f35800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.4 2024-09-12T17:37:34.064 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:34.062+0000 7f3035f35800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.5 2024-09-12T17:37:34.064 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:34.062+0000 7f3035f35800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.5 2024-09-12T17:37:34.064 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:34.063+0000 7f3035f35800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.6 2024-09-12T17:37:34.064 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:34.063+0000 7f3035f35800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.6 2024-09-12T17:37:34.064 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:34.063+0000 7f3035f35800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.7 2024-09-12T17:37:34.065 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:34.063+0000 7f3035f35800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.7 2024-09-12T17:37:34.065 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:34.063+0000 7f3035f35800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.8 2024-09-12T17:37:34.065 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:34.063+0000 7f3035f35800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.8 2024-09-12T17:37:34.065 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:34.064+0000 7f3035f35800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.9 2024-09-12T17:37:34.065 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:34.064+0000 7f3035f35800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.9 2024-09-12T17:37:34.065 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:34.064+0000 7f3035f35800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.10 2024-09-12T17:37:34.066 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:34.064+0000 7f3035f35800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.10 2024-09-12T17:37:34.066 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:34.065+0000 7f3035f35800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.11 2024-09-12T17:37:34.066 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:34.065+0000 7f3035f35800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.11 2024-09-12T17:37:34.066 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:34.065+0000 7f3035f35800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.12 2024-09-12T17:37:34.066 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:34.065+0000 7f3035f35800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.12 2024-09-12T17:37:34.067 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:34.066+0000 7f2ed37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:37:34.069 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:34.068+0000 7f3035f35800 20 remove_watcher() i=0 2024-09-12T17:37:34.069 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:34.068+0000 7f3035f35800 2 removed watcher, disabling cache 2024-09-12T17:37:34.070 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:34.069+0000 7f3035f35800 20 remove_watcher() i=1 2024-09-12T17:37:34.071 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:34.070+0000 7f3035f35800 20 remove_watcher() i=2 2024-09-12T17:37:34.072 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:34.071+0000 7f3035f35800 20 remove_watcher() i=3 2024-09-12T17:37:34.073 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:34.072+0000 7f3035f35800 20 remove_watcher() i=4 2024-09-12T17:37:34.074 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:34.073+0000 7f3035f35800 20 remove_watcher() i=5 2024-09-12T17:37:34.075 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:34.074+0000 7f3035f35800 20 remove_watcher() i=6 2024-09-12T17:37:34.076 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:37:34.075+0000 7f3035f35800 20 remove_watcher() i=7 2024-09-12T17:38:04.106 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 14 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at logrecord_writes 2024-09-12T17:38:04.145 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:38:04.145 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:38:04.190 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.189+0000 7ff03f20f800 20 rados->read ofs=0 len=0 2024-09-12T17:38:04.192 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.191+0000 7ff03f20f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:04.192 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.191+0000 7ff03f20f800 20 realm 2024-09-12T17:38:04.192 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.191+0000 7ff03f20f800 20 rados->read ofs=0 len=0 2024-09-12T17:38:04.192 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.191+0000 7ff03f20f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:04.192 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.191+0000 7ff03f20f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:38:04.192 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.191+0000 7ff03f20f800 20 rados->read ofs=0 len=0 2024-09-12T17:38:04.192 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.191+0000 7ff03f20f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:04.192 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.191+0000 7ff03f20f800 20 rados->read ofs=0 len=0 2024-09-12T17:38:04.193 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.192+0000 7ff03f20f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:38:04.193 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.192+0000 7ff03f20f800 20 rados->read ofs=0 len=0 2024-09-12T17:38:04.193 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.193+0000 7ff03f20f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:38:04.194 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.193+0000 7ff03f20f800 20 searching for the correct realm 2024-09-12T17:38:04.197 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.196+0000 7ff03a191640 0 -- 172.21.15.37:0/2555455407 >> [v2:172.21.15.40:6800/2441293461,v1:172.21.15.40:6801/2441293461] conn(0x7ff02c048460 msgr2=0x7ff02c067940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:38:04.404 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.403+0000 7ff03a992640 0 -- 172.21.15.37:0/2555455407 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7ff030093b90 msgr2=0x7ff0300a2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:38:04.612 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.611+0000 7ff03f20f800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:38:04.612 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.611+0000 7ff03f20f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:38:04.612 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.611+0000 7ff03f20f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:38:04.612 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.611+0000 7ff03f20f800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:38:04.612 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.611+0000 7ff03f20f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:38:04.612 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.611+0000 7ff03f20f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:38:04.613 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.611+0000 7ff03f20f800 20 rados->read ofs=0 len=0 2024-09-12T17:38:04.613 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.611+0000 7ff03f20f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:04.613 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.611+0000 7ff03f20f800 20 rados->read ofs=0 len=0 2024-09-12T17:38:04.614 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.612+0000 7ff03f20f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:38:04.614 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.612+0000 7ff03f20f800 20 rados->read ofs=0 len=0 2024-09-12T17:38:04.614 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.612+0000 7ff03f20f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:38:04.614 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.612+0000 7ff03f20f800 20 zone default found 2024-09-12T17:38:04.614 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.612+0000 7ff03f20f800 4 Realm: () 2024-09-12T17:38:04.614 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.612+0000 7ff03f20f800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:38:04.614 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.612+0000 7ff03f20f800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:38:04.614 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.612+0000 7ff03f20f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:38:04.614 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.612+0000 7ff03f20f800 20 zonegroup default 2024-09-12T17:38:04.614 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.612+0000 7ff03f20f800 20 rados->read ofs=0 len=0 2024-09-12T17:38:04.614 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.612+0000 7ff03f20f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:04.614 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.612+0000 7ff03f20f800 20 rados->read ofs=0 len=0 2024-09-12T17:38:04.615 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.613+0000 7ff03f20f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:04.615 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.613+0000 7ff03f20f800 20 rados->read ofs=0 len=0 2024-09-12T17:38:04.615 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.613+0000 7ff03f20f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:04.615 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.613+0000 7ff03f20f800 20 started sync module instance, tier type = 2024-09-12T17:38:04.615 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.613+0000 7ff03f20f800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:38:04.625 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.624+0000 7ff03f20f800 20 add_watcher() i=0 2024-09-12T17:38:04.625 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.624+0000 7ff03f20f800 20 add_watcher() i=1 2024-09-12T17:38:04.626 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.624+0000 7ff03f20f800 20 add_watcher() i=2 2024-09-12T17:38:04.626 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.624+0000 7ff03f20f800 20 add_watcher() i=3 2024-09-12T17:38:04.626 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.624+0000 7ff03f20f800 20 add_watcher() i=4 2024-09-12T17:38:04.626 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.624+0000 7ff03f20f800 20 add_watcher() i=5 2024-09-12T17:38:04.626 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.624+0000 7ff03f20f800 20 add_watcher() i=6 2024-09-12T17:38:04.627 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.626+0000 7ff03f20f800 20 add_watcher() i=7 2024-09-12T17:38:04.627 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.626+0000 7ff03f20f800 2 all 8 watchers are set, enabling cache 2024-09-12T17:38:04.631 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.628+0000 7feef17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:38:04.631 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.628+0000 7ff03f20f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:38:04.631 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.628+0000 7ff03f20f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:38:04.631 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.629+0000 7ff03f20f800 5 note: GC not initialized 2024-09-12T17:38:04.631 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.629+0000 7fee6bfff640 20 reqs_thread_entry: start 2024-09-12T17:38:04.631 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.629+0000 7ff03f20f800 20 init_complete bucket index max shards: 11 2024-09-12T17:38:04.631 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.629+0000 7ff03f20f800 20 Filter name: none 2024-09-12T17:38:04.631 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.629+0000 7fee69ffb640 20 reqs_thread_entry: start 2024-09-12T17:38:04.632 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.629+0000 7ff03f20f800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:38:04.632 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.629+0000 7ff03f20f800 20 rados->read ofs=0 len=0 2024-09-12T17:38:04.632 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.630+0000 7ff03f20f800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:38:04.632 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.630+0000 7ff03f20f800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:38:04.632 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.630+0000 7ff03f20f800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:38:04.632 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.630+0000 7ff03f20f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 : miss 2024-09-12T17:38:04.632 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.630+0000 7ff03f20f800 20 rados->read ofs=0 len=0 2024-09-12T17:38:04.633 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.630+0000 7ff03f20f800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T17:38:04.633 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.630+0000 7ff03f20f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 info.flags=0x17 2024-09-12T17:38:04.634 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.630+0000 7ff03f20f800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 to cache LRU end 2024-09-12T17:38:04.634 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.630+0000 7ff03f20f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:38:04.634 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.630+0000 7ff03f20f800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:38:04.634 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.630+0000 7ff03f20f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 2024-09-12T17:38:04.634 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.632+0000 7ff03f20f800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T17:38:04.641 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.641+0000 7ff03f20f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 info.flags=0x17 2024-09-12T17:38:04.642 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.641+0000 7ff03f20f800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 to cache LRU end 2024-09-12T17:38:04.642 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.641+0000 7ff03f20f800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:38:04.642 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.641+0000 7ff03f20f800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18, ofs0, ns] 2024-09-12T17:38:04.642 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.641+0000 7fef1dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497020 cookie 94430637274448 notifier 7784 bl.length()=911 2024-09-12T17:38:04.642 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.641+0000 7fef1dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 info.flags=0x17 2024-09-12T17:38:04.643 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.641+0000 7fef1dffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 to cache LRU end 2024-09-12T17:38:04.643 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.641+0000 7fef1dffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:38:04.644 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.643+0000 7ff03f20f800 20 handle_bi_update(): bucket=:a-bucket[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18]): orig_sources= new_sources= 2024-09-12T17:38:04.644 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.643+0000 7ff03f20f800 20 handle_bi_update(): bucket=:a-bucket[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18]): potential sources added=[] removed=[] 2024-09-12T17:38:04.644 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.643+0000 7ff03f20f800 20 handle_bi_update(): bucket=:a-bucket[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18]): orig_dests= new_dests= 2024-09-12T17:38:04.644 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.643+0000 7ff03f20f800 20 handle_bi_update(): bucket=:a-bucket[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18]): potential dests added=[] removed=[] 2024-09-12T17:38:04.648 INFO:tasks.workunit.client.0.smithi037.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7ff03f20f800 time 2024-09-12T17:38:04.648240+0000 2024-09-12T17:38:04.648 INFO:tasks.workunit.client.0.smithi037.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:38:04.649 INFO:tasks.workunit.client.0.smithi037.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:38:04.649 INFO:tasks.workunit.client.0.smithi037.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7ff04038c71a] 2024-09-12T17:38:04.649 INFO:tasks.workunit.client.0.smithi037.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7ff04038c8d8] 2024-09-12T17:38:04.649 INFO:tasks.workunit.client.0.smithi037.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e2576f6841] 2024-09-12T17:38:04.649 INFO:tasks.workunit.client.0.smithi037.stderr: 4: radosgw-admin(+0xd7490c) [0x55e257c0490c] 2024-09-12T17:38:04.649 INFO:tasks.workunit.client.0.smithi037.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55e25770650d] 2024-09-12T17:38:04.649 INFO:tasks.workunit.client.0.smithi037.stderr: 6: main() 2024-09-12T17:38:04.649 INFO:tasks.workunit.client.0.smithi037.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7ff03f029590] 2024-09-12T17:38:04.649 INFO:tasks.workunit.client.0.smithi037.stderr: 8: __libc_start_main() 2024-09-12T17:38:04.649 INFO:tasks.workunit.client.0.smithi037.stderr: 9: _start() 2024-09-12T17:38:04.649 INFO:tasks.workunit.client.0.smithi037.stderr:*** Caught signal (Aborted) ** 2024-09-12T17:38:04.650 INFO:tasks.workunit.client.0.smithi037.stderr: in thread 7ff03f20f800 thread_name:radosgw-admin 2024-09-12T17:38:04.650 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.648+0000 7ff03f20f800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7ff03f20f800 time 2024-09-12T17:38:04.648240+0000 2024-09-12T17:38:04.650 INFO:tasks.workunit.client.0.smithi037.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:38:04.650 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:38:04.650 INFO:tasks.workunit.client.0.smithi037.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:38:04.650 INFO:tasks.workunit.client.0.smithi037.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7ff04038c71a] 2024-09-12T17:38:04.650 INFO:tasks.workunit.client.0.smithi037.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7ff04038c8d8] 2024-09-12T17:38:04.650 INFO:tasks.workunit.client.0.smithi037.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e2576f6841] 2024-09-12T17:38:04.650 INFO:tasks.workunit.client.0.smithi037.stderr: 4: radosgw-admin(+0xd7490c) [0x55e257c0490c] 2024-09-12T17:38:04.650 INFO:tasks.workunit.client.0.smithi037.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55e25770650d] 2024-09-12T17:38:04.650 INFO:tasks.workunit.client.0.smithi037.stderr: 6: main() 2024-09-12T17:38:04.650 INFO:tasks.workunit.client.0.smithi037.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7ff03f029590] 2024-09-12T17:38:04.650 INFO:tasks.workunit.client.0.smithi037.stderr: 8: __libc_start_main() 2024-09-12T17:38:04.650 INFO:tasks.workunit.client.0.smithi037.stderr: 9: _start() 2024-09-12T17:38:04.650 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:38:04.666 INFO:tasks.workunit.client.0.smithi037.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:38:04.666 INFO:tasks.workunit.client.0.smithi037.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7ff03f03e6f0] 2024-09-12T17:38:04.666 INFO:tasks.workunit.client.0.smithi037.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7ff03f08b99c] 2024-09-12T17:38:04.666 INFO:tasks.workunit.client.0.smithi037.stderr: 3: raise() 2024-09-12T17:38:04.666 INFO:tasks.workunit.client.0.smithi037.stderr: 4: abort() 2024-09-12T17:38:04.666 INFO:tasks.workunit.client.0.smithi037.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7ff04038c774] 2024-09-12T17:38:04.667 INFO:tasks.workunit.client.0.smithi037.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7ff04038c8d8] 2024-09-12T17:38:04.667 INFO:tasks.workunit.client.0.smithi037.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e2576f6841] 2024-09-12T17:38:04.667 INFO:tasks.workunit.client.0.smithi037.stderr: 8: radosgw-admin(+0xd7490c) [0x55e257c0490c] 2024-09-12T17:38:04.667 INFO:tasks.workunit.client.0.smithi037.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55e25770650d] 2024-09-12T17:38:04.667 INFO:tasks.workunit.client.0.smithi037.stderr: 10: main() 2024-09-12T17:38:04.667 INFO:tasks.workunit.client.0.smithi037.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7ff03f029590] 2024-09-12T17:38:04.667 INFO:tasks.workunit.client.0.smithi037.stderr: 12: __libc_start_main() 2024-09-12T17:38:04.667 INFO:tasks.workunit.client.0.smithi037.stderr: 13: _start() 2024-09-12T17:38:04.667 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.649+0000 7ff03f20f800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:38:04.667 INFO:tasks.workunit.client.0.smithi037.stderr: in thread 7ff03f20f800 thread_name:radosgw-admin 2024-09-12T17:38:04.667 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:38:04.667 INFO:tasks.workunit.client.0.smithi037.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:38:04.668 INFO:tasks.workunit.client.0.smithi037.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7ff03f03e6f0] 2024-09-12T17:38:04.668 INFO:tasks.workunit.client.0.smithi037.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7ff03f08b99c] 2024-09-12T17:38:04.668 INFO:tasks.workunit.client.0.smithi037.stderr: 3: raise() 2024-09-12T17:38:04.668 INFO:tasks.workunit.client.0.smithi037.stderr: 4: abort() 2024-09-12T17:38:04.668 INFO:tasks.workunit.client.0.smithi037.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7ff04038c774] 2024-09-12T17:38:04.668 INFO:tasks.workunit.client.0.smithi037.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7ff04038c8d8] 2024-09-12T17:38:04.668 INFO:tasks.workunit.client.0.smithi037.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e2576f6841] 2024-09-12T17:38:04.668 INFO:tasks.workunit.client.0.smithi037.stderr: 8: radosgw-admin(+0xd7490c) [0x55e257c0490c] 2024-09-12T17:38:04.668 INFO:tasks.workunit.client.0.smithi037.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55e25770650d] 2024-09-12T17:38:04.668 INFO:tasks.workunit.client.0.smithi037.stderr: 10: main() 2024-09-12T17:38:04.668 INFO:tasks.workunit.client.0.smithi037.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7ff03f029590] 2024-09-12T17:38:04.668 INFO:tasks.workunit.client.0.smithi037.stderr: 12: __libc_start_main() 2024-09-12T17:38:04.668 INFO:tasks.workunit.client.0.smithi037.stderr: 13: _start() 2024-09-12T17:38:04.669 INFO:tasks.workunit.client.0.smithi037.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:38:04.669 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:38:04.669 INFO:tasks.workunit.client.0.smithi037.stderr:--- begin dump of recent events --- 2024-09-12T17:38:04.669 INFO:tasks.workunit.client.0.smithi037.stderr: -499> 2024-09-12T17:38:04.169+0000 7fef28e09640 10 monclient: handle_config config(0 keys) 2024-09-12T17:38:04.669 INFO:tasks.workunit.client.0.smithi037.stderr: -498> 2024-09-12T17:38:04.169+0000 7ff03f20f800 10 monclient: get_monmap_and_config success 2024-09-12T17:38:04.669 INFO:tasks.workunit.client.0.smithi037.stderr: -497> 2024-09-12T17:38:04.169+0000 7ff03f20f800 4 set_mon_vals no callback set 2024-09-12T17:38:04.669 INFO:tasks.workunit.client.0.smithi037.stderr: -496> 2024-09-12T17:38:04.169+0000 7fef28e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:38:04.669 INFO:tasks.workunit.client.0.smithi037.stderr: -495> 2024-09-12T17:38:04.169+0000 7fef28e09640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:38:04.669 INFO:tasks.workunit.client.0.smithi037.stderr: -494> 2024-09-12T17:38:04.169+0000 7fef28e09640 10 monclient: dump: 2024-09-12T17:38:04.669 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:38:04.669 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:38:04.669 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:38:04.669 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:38:04.670 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:38:04.670 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:38:04.670 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:38:04.670 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:38:04.670 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:38:04.670 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:38:04.670 INFO:tasks.workunit.client.0.smithi037.stderr: -493> 2024-09-12T17:38:04.170+0000 7ff03f20f800 10 monclient: shutdown 2024-09-12T17:38:04.670 INFO:tasks.workunit.client.0.smithi037.stderr: -492> 2024-09-12T17:38:04.170+0000 7ff03f20f800 5 asok(0x55e258655730) unregister_commands rotate-key 2024-09-12T17:38:04.670 INFO:tasks.workunit.client.0.smithi037.stderr: -491> 2024-09-12T17:38:04.170+0000 7ff03f20f800 10 monclient: build_initial_monmap 2024-09-12T17:38:04.670 INFO:tasks.workunit.client.0.smithi037.stderr: -490> 2024-09-12T17:38:04.170+0000 7ff03f20f800 1 build_initial for_mkfs: 0 2024-09-12T17:38:04.670 INFO:tasks.workunit.client.0.smithi037.stderr: -489> 2024-09-12T17:38:04.170+0000 7ff03f20f800 10 monclient: monmap: 2024-09-12T17:38:04.670 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 0 2024-09-12T17:38:04.670 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:38:04.671 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 0.000000 2024-09-12T17:38:04.671 INFO:tasks.workunit.client.0.smithi037.stderr:created 0.000000 2024-09-12T17:38:04.671 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 0 (unknown) 2024-09-12T17:38:04.671 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:38:04.671 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.noname-a 2024-09-12T17:38:04.671 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.noname-b 2024-09-12T17:38:04.671 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.noname-c 2024-09-12T17:38:04.671 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:38:04.671 INFO:tasks.workunit.client.0.smithi037.stderr: -488> 2024-09-12T17:38:04.170+0000 7ff03f20f800 5 AuthRegistry(0x55e25887d870) adding auth protocol: cephx 2024-09-12T17:38:04.671 INFO:tasks.workunit.client.0.smithi037.stderr: -487> 2024-09-12T17:38:04.170+0000 7ff03f20f800 5 AuthRegistry(0x55e25887d870) adding auth protocol: cephx 2024-09-12T17:38:04.671 INFO:tasks.workunit.client.0.smithi037.stderr: -486> 2024-09-12T17:38:04.170+0000 7ff03f20f800 5 AuthRegistry(0x55e25887d870) adding auth protocol: cephx 2024-09-12T17:38:04.671 INFO:tasks.workunit.client.0.smithi037.stderr: -485> 2024-09-12T17:38:04.170+0000 7ff03f20f800 5 AuthRegistry(0x55e25887d870) adding con mode: secure 2024-09-12T17:38:04.671 INFO:tasks.workunit.client.0.smithi037.stderr: -484> 2024-09-12T17:38:04.170+0000 7ff03f20f800 5 AuthRegistry(0x55e25887d870) adding con mode: crc 2024-09-12T17:38:04.671 INFO:tasks.workunit.client.0.smithi037.stderr: -483> 2024-09-12T17:38:04.170+0000 7ff03f20f800 5 AuthRegistry(0x55e25887d870) adding con mode: secure 2024-09-12T17:38:04.671 INFO:tasks.workunit.client.0.smithi037.stderr: -482> 2024-09-12T17:38:04.170+0000 7ff03f20f800 5 AuthRegistry(0x55e25887d870) adding con mode: crc 2024-09-12T17:38:04.672 INFO:tasks.workunit.client.0.smithi037.stderr: -481> 2024-09-12T17:38:04.170+0000 7ff03f20f800 5 AuthRegistry(0x55e25887d870) adding con mode: secure 2024-09-12T17:38:04.672 INFO:tasks.workunit.client.0.smithi037.stderr: -480> 2024-09-12T17:38:04.170+0000 7ff03f20f800 5 AuthRegistry(0x55e25887d870) adding con mode: crc 2024-09-12T17:38:04.672 INFO:tasks.workunit.client.0.smithi037.stderr: -479> 2024-09-12T17:38:04.170+0000 7ff03f20f800 5 AuthRegistry(0x55e25887d870) adding con mode: crc 2024-09-12T17:38:04.672 INFO:tasks.workunit.client.0.smithi037.stderr: -478> 2024-09-12T17:38:04.170+0000 7ff03f20f800 5 AuthRegistry(0x55e25887d870) adding con mode: secure 2024-09-12T17:38:04.672 INFO:tasks.workunit.client.0.smithi037.stderr: -477> 2024-09-12T17:38:04.170+0000 7ff03f20f800 5 AuthRegistry(0x55e25887d870) adding con mode: crc 2024-09-12T17:38:04.672 INFO:tasks.workunit.client.0.smithi037.stderr: -476> 2024-09-12T17:38:04.170+0000 7ff03f20f800 5 AuthRegistry(0x55e25887d870) adding con mode: secure 2024-09-12T17:38:04.672 INFO:tasks.workunit.client.0.smithi037.stderr: -475> 2024-09-12T17:38:04.170+0000 7ff03f20f800 5 AuthRegistry(0x55e25887d870) adding con mode: crc 2024-09-12T17:38:04.672 INFO:tasks.workunit.client.0.smithi037.stderr: -474> 2024-09-12T17:38:04.170+0000 7ff03f20f800 5 AuthRegistry(0x55e25887d870) adding con mode: secure 2024-09-12T17:38:04.672 INFO:tasks.workunit.client.0.smithi037.stderr: -473> 2024-09-12T17:38:04.170+0000 7ff03f20f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:38:04.672 INFO:tasks.workunit.client.0.smithi037.stderr: -472> 2024-09-12T17:38:04.170+0000 7ff03f20f800 1 librados: starting msgr at 2024-09-12T17:38:04.672 INFO:tasks.workunit.client.0.smithi037.stderr: -471> 2024-09-12T17:38:04.170+0000 7ff03f20f800 1 librados: starting objecter 2024-09-12T17:38:04.672 INFO:tasks.workunit.client.0.smithi037.stderr: -470> 2024-09-12T17:38:04.170+0000 7ff03f20f800 5 asok(0x55e258655730) register_command objecter_requests hook 0x55e2588a9320 2024-09-12T17:38:04.672 INFO:tasks.workunit.client.0.smithi037.stderr: -469> 2024-09-12T17:38:04.170+0000 7ff03f20f800 1 librados: setting wanted keys 2024-09-12T17:38:04.672 INFO:tasks.workunit.client.0.smithi037.stderr: -468> 2024-09-12T17:38:04.170+0000 7ff03f20f800 1 librados: calling monclient init 2024-09-12T17:38:04.673 INFO:tasks.workunit.client.0.smithi037.stderr: -467> 2024-09-12T17:38:04.170+0000 7ff03f20f800 10 monclient: init 2024-09-12T17:38:04.673 INFO:tasks.workunit.client.0.smithi037.stderr: -466> 2024-09-12T17:38:04.170+0000 7ff03f20f800 5 AuthRegistry(0x55e258878240) adding auth protocol: cephx 2024-09-12T17:38:04.673 INFO:tasks.workunit.client.0.smithi037.stderr: -465> 2024-09-12T17:38:04.170+0000 7ff03f20f800 5 AuthRegistry(0x55e258878240) adding auth protocol: cephx 2024-09-12T17:38:04.673 INFO:tasks.workunit.client.0.smithi037.stderr: -464> 2024-09-12T17:38:04.170+0000 7ff03f20f800 5 AuthRegistry(0x55e258878240) adding auth protocol: cephx 2024-09-12T17:38:04.673 INFO:tasks.workunit.client.0.smithi037.stderr: -463> 2024-09-12T17:38:04.170+0000 7ff03f20f800 5 AuthRegistry(0x55e258878240) adding con mode: secure 2024-09-12T17:38:04.673 INFO:tasks.workunit.client.0.smithi037.stderr: -462> 2024-09-12T17:38:04.170+0000 7ff03f20f800 5 AuthRegistry(0x55e258878240) adding con mode: crc 2024-09-12T17:38:04.673 INFO:tasks.workunit.client.0.smithi037.stderr: -461> 2024-09-12T17:38:04.170+0000 7ff03f20f800 5 AuthRegistry(0x55e258878240) adding con mode: secure 2024-09-12T17:38:04.673 INFO:tasks.workunit.client.0.smithi037.stderr: -460> 2024-09-12T17:38:04.170+0000 7ff03f20f800 5 AuthRegistry(0x55e258878240) adding con mode: crc 2024-09-12T17:38:04.673 INFO:tasks.workunit.client.0.smithi037.stderr: -459> 2024-09-12T17:38:04.170+0000 7ff03f20f800 5 AuthRegistry(0x55e258878240) adding con mode: secure 2024-09-12T17:38:04.673 INFO:tasks.workunit.client.0.smithi037.stderr: -458> 2024-09-12T17:38:04.170+0000 7ff03f20f800 5 AuthRegistry(0x55e258878240) adding con mode: crc 2024-09-12T17:38:04.673 INFO:tasks.workunit.client.0.smithi037.stderr: -457> 2024-09-12T17:38:04.170+0000 7ff03f20f800 5 AuthRegistry(0x55e258878240) adding con mode: crc 2024-09-12T17:38:04.673 INFO:tasks.workunit.client.0.smithi037.stderr: -456> 2024-09-12T17:38:04.170+0000 7ff03f20f800 5 AuthRegistry(0x55e258878240) adding con mode: secure 2024-09-12T17:38:04.673 INFO:tasks.workunit.client.0.smithi037.stderr: -455> 2024-09-12T17:38:04.170+0000 7ff03f20f800 5 AuthRegistry(0x55e258878240) adding con mode: crc 2024-09-12T17:38:04.674 INFO:tasks.workunit.client.0.smithi037.stderr: -454> 2024-09-12T17:38:04.170+0000 7ff03f20f800 5 AuthRegistry(0x55e258878240) adding con mode: secure 2024-09-12T17:38:04.674 INFO:tasks.workunit.client.0.smithi037.stderr: -453> 2024-09-12T17:38:04.170+0000 7ff03f20f800 5 AuthRegistry(0x55e258878240) adding con mode: crc 2024-09-12T17:38:04.674 INFO:tasks.workunit.client.0.smithi037.stderr: -452> 2024-09-12T17:38:04.170+0000 7ff03f20f800 5 AuthRegistry(0x55e258878240) adding con mode: secure 2024-09-12T17:38:04.674 INFO:tasks.workunit.client.0.smithi037.stderr: -451> 2024-09-12T17:38:04.171+0000 7ff03f20f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:38:04.674 INFO:tasks.workunit.client.0.smithi037.stderr: -450> 2024-09-12T17:38:04.171+0000 7ff03f20f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:38:04.674 INFO:tasks.workunit.client.0.smithi037.stderr: -449> 2024-09-12T17:38:04.171+0000 7ff03f20f800 5 asok(0x55e258655730) register_command rotate-key hook 0x55e258878388 2024-09-12T17:38:04.674 INFO:tasks.workunit.client.0.smithi037.stderr: -448> 2024-09-12T17:38:04.171+0000 7ff03f20f800 10 monclient: _reopen_session rank -1 2024-09-12T17:38:04.674 INFO:tasks.workunit.client.0.smithi037.stderr: -447> 2024-09-12T17:38:04.171+0000 7ff03f20f800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T17:38:04.674 INFO:tasks.workunit.client.0.smithi037.stderr: -446> 2024-09-12T17:38:04.171+0000 7ff03f20f800 10 monclient(hunting): picked mon.noname-c con 0x55e258725650 addr [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] 2024-09-12T17:38:04.674 INFO:tasks.workunit.client.0.smithi037.stderr: -445> 2024-09-12T17:38:04.171+0000 7ff03f20f800 10 monclient(hunting): picked mon.noname-b con 0x55e2587baf90 addr [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] 2024-09-12T17:38:04.674 INFO:tasks.workunit.client.0.smithi037.stderr: -444> 2024-09-12T17:38:04.171+0000 7ff03f20f800 10 monclient(hunting): picked mon.noname-a con 0x55e2587c1290 addr [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] 2024-09-12T17:38:04.674 INFO:tasks.workunit.client.0.smithi037.stderr: -443> 2024-09-12T17:38:04.171+0000 7ff03f20f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:38:04.674 INFO:tasks.workunit.client.0.smithi037.stderr: -442> 2024-09-12T17:38:04.171+0000 7ff03f20f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:38:04.674 INFO:tasks.workunit.client.0.smithi037.stderr: -441> 2024-09-12T17:38:04.171+0000 7ff03f20f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:38:04.675 INFO:tasks.workunit.client.0.smithi037.stderr: -440> 2024-09-12T17:38:04.171+0000 7ff03f20f800 10 monclient(hunting): _renew_subs 2024-09-12T17:38:04.675 INFO:tasks.workunit.client.0.smithi037.stderr: -439> 2024-09-12T17:38:04.171+0000 7ff03f20f800 10 monclient(hunting): authenticate will time out at 2471.768519s 2024-09-12T17:38:04.675 INFO:tasks.workunit.client.0.smithi037.stderr: -438> 2024-09-12T17:38:04.171+0000 7ff03a992640 10 monclient(hunting): get_auth_request con 0x55e258725650 auth_method 0 2024-09-12T17:38:04.675 INFO:tasks.workunit.client.0.smithi037.stderr: -437> 2024-09-12T17:38:04.171+0000 7ff03a992640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:38:04.675 INFO:tasks.workunit.client.0.smithi037.stderr: -436> 2024-09-12T17:38:04.171+0000 7ff03a992640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:38:04.675 INFO:tasks.workunit.client.0.smithi037.stderr: -435> 2024-09-12T17:38:04.171+0000 7ff03a992640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:38:04.675 INFO:tasks.workunit.client.0.smithi037.stderr: -434> 2024-09-12T17:38:04.171+0000 7ff03b193640 10 monclient(hunting): get_auth_request con 0x55e2587c1290 auth_method 0 2024-09-12T17:38:04.675 INFO:tasks.workunit.client.0.smithi037.stderr: -433> 2024-09-12T17:38:04.171+0000 7ff03b193640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:38:04.675 INFO:tasks.workunit.client.0.smithi037.stderr: -432> 2024-09-12T17:38:04.171+0000 7ff03b193640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:38:04.675 INFO:tasks.workunit.client.0.smithi037.stderr: -431> 2024-09-12T17:38:04.171+0000 7ff03b193640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:38:04.675 INFO:tasks.workunit.client.0.smithi037.stderr: -430> 2024-09-12T17:38:04.171+0000 7ff03a992640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:38:04.675 INFO:tasks.workunit.client.0.smithi037.stderr: -429> 2024-09-12T17:38:04.171+0000 7ff03a992640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:38:04.675 INFO:tasks.workunit.client.0.smithi037.stderr: -428> 2024-09-12T17:38:04.171+0000 7ff03a992640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:38:04.675 INFO:tasks.workunit.client.0.smithi037.stderr: -427> 2024-09-12T17:38:04.171+0000 7ff03b193640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:38:04.676 INFO:tasks.workunit.client.0.smithi037.stderr: -426> 2024-09-12T17:38:04.171+0000 7ff03b193640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:38:04.676 INFO:tasks.workunit.client.0.smithi037.stderr: -425> 2024-09-12T17:38:04.171+0000 7ff03b193640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:38:04.676 INFO:tasks.workunit.client.0.smithi037.stderr: -424> 2024-09-12T17:38:04.171+0000 7ff03a191640 10 monclient(hunting): get_auth_request con 0x55e2587baf90 auth_method 0 2024-09-12T17:38:04.676 INFO:tasks.workunit.client.0.smithi037.stderr: -423> 2024-09-12T17:38:04.171+0000 7ff03a191640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:38:04.676 INFO:tasks.workunit.client.0.smithi037.stderr: -422> 2024-09-12T17:38:04.171+0000 7ff03a191640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:38:04.676 INFO:tasks.workunit.client.0.smithi037.stderr: -421> 2024-09-12T17:38:04.171+0000 7ff03a191640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:38:04.676 INFO:tasks.workunit.client.0.smithi037.stderr: -420> 2024-09-12T17:38:04.171+0000 7ff03a992640 10 monclient(hunting): handle_auth_done global_id 7775 payload 824 2024-09-12T17:38:04.676 INFO:tasks.workunit.client.0.smithi037.stderr: -419> 2024-09-12T17:38:04.171+0000 7ff03a992640 10 monclient: _finish_hunting 0 2024-09-12T17:38:04.676 INFO:tasks.workunit.client.0.smithi037.stderr: -418> 2024-09-12T17:38:04.171+0000 7ff03a992640 1 monclient: found mon.noname-c 2024-09-12T17:38:04.676 INFO:tasks.workunit.client.0.smithi037.stderr: -417> 2024-09-12T17:38:04.171+0000 7ff03a992640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.37:3301/0 2024-09-12T17:38:04.676 INFO:tasks.workunit.client.0.smithi037.stderr: -416> 2024-09-12T17:38:04.172+0000 7fef27606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:38:04.676 INFO:tasks.workunit.client.0.smithi037.stderr: -415> 2024-09-12T17:38:04.172+0000 7fef27606640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:38:04.676 INFO:tasks.workunit.client.0.smithi037.stderr: -414> 2024-09-12T17:38:04.172+0000 7fef27606640 10 monclient: dump: 2024-09-12T17:38:04.677 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:38:04.677 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:38:04.677 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:38:04.677 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:38:04.677 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:38:04.677 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:38:04.677 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:38:04.677 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:38:04.677 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:38:04.677 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:38:04.677 INFO:tasks.workunit.client.0.smithi037.stderr: -413> 2024-09-12T17:38:04.172+0000 7fef27606640 10 monclient: _finish_auth 0 2024-09-12T17:38:04.677 INFO:tasks.workunit.client.0.smithi037.stderr: -412> 2024-09-12T17:38:04.172+0000 7fef27606640 10 monclient: _check_auth_tickets 2024-09-12T17:38:04.677 INFO:tasks.workunit.client.0.smithi037.stderr: -411> 2024-09-12T17:38:04.172+0000 7fef27606640 10 monclient: handle_config config(0 keys) 2024-09-12T17:38:04.678 INFO:tasks.workunit.client.0.smithi037.stderr: -410> 2024-09-12T17:38:04.172+0000 7fef27606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:38:04.678 INFO:tasks.workunit.client.0.smithi037.stderr: -409> 2024-09-12T17:38:04.172+0000 7fef27606640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:38:04.678 INFO:tasks.workunit.client.0.smithi037.stderr: -408> 2024-09-12T17:38:04.172+0000 7fef27606640 10 monclient: dump: 2024-09-12T17:38:04.678 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:38:04.678 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:38:04.678 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:38:04.678 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:38:04.678 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:38:04.678 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:38:04.678 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:38:04.678 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:38:04.678 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:38:04.678 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:38:04.678 INFO:tasks.workunit.client.0.smithi037.stderr: -407> 2024-09-12T17:38:04.172+0000 7ff03f20f800 5 monclient: authenticate success, global_id 7775 2024-09-12T17:38:04.679 INFO:tasks.workunit.client.0.smithi037.stderr: -406> 2024-09-12T17:38:04.172+0000 7ff03f20f800 10 monclient: _renew_subs 2024-09-12T17:38:04.679 INFO:tasks.workunit.client.0.smithi037.stderr: -405> 2024-09-12T17:38:04.172+0000 7ff03f20f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.37:3301/0 2024-09-12T17:38:04.679 INFO:tasks.workunit.client.0.smithi037.stderr: -404> 2024-09-12T17:38:04.172+0000 7fef28e09640 4 set_mon_vals no callback set 2024-09-12T17:38:04.679 INFO:tasks.workunit.client.0.smithi037.stderr: -403> 2024-09-12T17:38:04.172+0000 7ff03f20f800 10 monclient: _renew_subs 2024-09-12T17:38:04.679 INFO:tasks.workunit.client.0.smithi037.stderr: -402> 2024-09-12T17:38:04.172+0000 7ff03f20f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.37:3301/0 2024-09-12T17:38:04.679 INFO:tasks.workunit.client.0.smithi037.stderr: -401> 2024-09-12T17:38:04.172+0000 7ff03f20f800 1 librados: init done 2024-09-12T17:38:04.679 INFO:tasks.workunit.client.0.smithi037.stderr: -400> 2024-09-12T17:38:04.174+0000 7fef27606640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:38:04.679 INFO:tasks.workunit.client.0.smithi037.stderr: -399> 2024-09-12T17:38:04.174+0000 7fef27606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.40:6816/3916250676,v1:172.21.15.40:6817/3916250676] 2024-09-12T17:38:04.679 INFO:tasks.workunit.client.0.smithi037.stderr: -398> 2024-09-12T17:38:04.174+0000 7fef27606640 4 mgrc reconnect Starting new session with [v2:172.21.15.40:6816/3916250676,v1:172.21.15.40:6817/3916250676] 2024-09-12T17:38:04.679 INFO:tasks.workunit.client.0.smithi037.stderr: -397> 2024-09-12T17:38:04.174+0000 7ff03a191640 10 monclient: get_auth_request con 0x7fef20076470 auth_method 0 2024-09-12T17:38:04.679 INFO:tasks.workunit.client.0.smithi037.stderr: -396> 2024-09-12T17:38:04.175+0000 7ff03b193640 10 monclient: get_auth_request con 0x55e2588a0b10 auth_method 0 2024-09-12T17:38:04.679 INFO:tasks.workunit.client.0.smithi037.stderr: -395> 2024-09-12T17:38:04.176+0000 7ff03a992640 10 monclient: get_auth_request con 0x55e2588c3120 auth_method 0 2024-09-12T17:38:04.680 INFO:tasks.workunit.client.0.smithi037.stderr: -394> 2024-09-12T17:38:04.178+0000 7ff03a191640 10 monclient: get_auth_request con 0x55e2588c8760 auth_method 0 2024-09-12T17:38:04.680 INFO:tasks.workunit.client.0.smithi037.stderr: -393> 2024-09-12T17:38:04.178+0000 7ff03f20f800 10 monclient: build_initial_monmap 2024-09-12T17:38:04.680 INFO:tasks.workunit.client.0.smithi037.stderr: -392> 2024-09-12T17:38:04.178+0000 7ff03f20f800 1 build_initial for_mkfs: 0 2024-09-12T17:38:04.680 INFO:tasks.workunit.client.0.smithi037.stderr: -391> 2024-09-12T17:38:04.178+0000 7ff03f20f800 10 monclient: monmap: 2024-09-12T17:38:04.680 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 0 2024-09-12T17:38:04.680 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:38:04.680 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 0.000000 2024-09-12T17:38:04.680 INFO:tasks.workunit.client.0.smithi037.stderr:created 0.000000 2024-09-12T17:38:04.680 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 0 (unknown) 2024-09-12T17:38:04.680 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:38:04.680 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.noname-a 2024-09-12T17:38:04.680 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.noname-b 2024-09-12T17:38:04.680 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.noname-c 2024-09-12T17:38:04.680 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:38:04.681 INFO:tasks.workunit.client.0.smithi037.stderr: -390> 2024-09-12T17:38:04.178+0000 7ff03f20f800 5 AuthRegistry(0x55e2588cc610) adding auth protocol: cephx 2024-09-12T17:38:04.681 INFO:tasks.workunit.client.0.smithi037.stderr: -389> 2024-09-12T17:38:04.178+0000 7ff03f20f800 5 AuthRegistry(0x55e2588cc610) adding auth protocol: cephx 2024-09-12T17:38:04.681 INFO:tasks.workunit.client.0.smithi037.stderr: -388> 2024-09-12T17:38:04.178+0000 7ff03f20f800 5 AuthRegistry(0x55e2588cc610) adding auth protocol: cephx 2024-09-12T17:38:04.681 INFO:tasks.workunit.client.0.smithi037.stderr: -387> 2024-09-12T17:38:04.178+0000 7ff03f20f800 5 AuthRegistry(0x55e2588cc610) adding con mode: secure 2024-09-12T17:38:04.681 INFO:tasks.workunit.client.0.smithi037.stderr: -386> 2024-09-12T17:38:04.178+0000 7ff03f20f800 5 AuthRegistry(0x55e2588cc610) adding con mode: crc 2024-09-12T17:38:04.681 INFO:tasks.workunit.client.0.smithi037.stderr: -385> 2024-09-12T17:38:04.178+0000 7ff03f20f800 5 AuthRegistry(0x55e2588cc610) adding con mode: secure 2024-09-12T17:38:04.681 INFO:tasks.workunit.client.0.smithi037.stderr: -384> 2024-09-12T17:38:04.178+0000 7ff03f20f800 5 AuthRegistry(0x55e2588cc610) adding con mode: crc 2024-09-12T17:38:04.681 INFO:tasks.workunit.client.0.smithi037.stderr: -383> 2024-09-12T17:38:04.178+0000 7ff03f20f800 5 AuthRegistry(0x55e2588cc610) adding con mode: secure 2024-09-12T17:38:04.681 INFO:tasks.workunit.client.0.smithi037.stderr: -382> 2024-09-12T17:38:04.178+0000 7ff03f20f800 5 AuthRegistry(0x55e2588cc610) adding con mode: crc 2024-09-12T17:38:04.681 INFO:tasks.workunit.client.0.smithi037.stderr: -381> 2024-09-12T17:38:04.178+0000 7ff03f20f800 5 AuthRegistry(0x55e2588cc610) adding con mode: crc 2024-09-12T17:38:04.681 INFO:tasks.workunit.client.0.smithi037.stderr: -380> 2024-09-12T17:38:04.178+0000 7ff03f20f800 5 AuthRegistry(0x55e2588cc610) adding con mode: secure 2024-09-12T17:38:04.681 INFO:tasks.workunit.client.0.smithi037.stderr: -379> 2024-09-12T17:38:04.178+0000 7ff03f20f800 5 AuthRegistry(0x55e2588cc610) adding con mode: crc 2024-09-12T17:38:04.681 INFO:tasks.workunit.client.0.smithi037.stderr: -378> 2024-09-12T17:38:04.178+0000 7ff03f20f800 5 AuthRegistry(0x55e2588cc610) adding con mode: secure 2024-09-12T17:38:04.682 INFO:tasks.workunit.client.0.smithi037.stderr: -377> 2024-09-12T17:38:04.178+0000 7ff03f20f800 5 AuthRegistry(0x55e2588cc610) adding con mode: crc 2024-09-12T17:38:04.682 INFO:tasks.workunit.client.0.smithi037.stderr: -376> 2024-09-12T17:38:04.178+0000 7ff03f20f800 5 AuthRegistry(0x55e2588cc610) adding con mode: secure 2024-09-12T17:38:04.682 INFO:tasks.workunit.client.0.smithi037.stderr: -375> 2024-09-12T17:38:04.179+0000 7ff03f20f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:38:04.682 INFO:tasks.workunit.client.0.smithi037.stderr: -374> 2024-09-12T17:38:04.179+0000 7ff03f20f800 5 asok(0x55e258655730) register_command objecter_requests cmddesc objecter_requests hook 0x55e2588cffe0 EEXIST 2024-09-12T17:38:04.682 INFO:tasks.workunit.client.0.smithi037.stderr: -373> 2024-09-12T17:38:04.179+0000 7ff03f20f800 10 monclient: init 2024-09-12T17:38:04.682 INFO:tasks.workunit.client.0.smithi037.stderr: -372> 2024-09-12T17:38:04.179+0000 7ff03f20f800 5 AuthRegistry(0x55e2588cb5c8) adding auth protocol: cephx 2024-09-12T17:38:04.682 INFO:tasks.workunit.client.0.smithi037.stderr: -371> 2024-09-12T17:38:04.179+0000 7ff03f20f800 5 AuthRegistry(0x55e2588cb5c8) adding auth protocol: cephx 2024-09-12T17:38:04.682 INFO:tasks.workunit.client.0.smithi037.stderr: -370> 2024-09-12T17:38:04.179+0000 7ff03f20f800 5 AuthRegistry(0x55e2588cb5c8) adding auth protocol: cephx 2024-09-12T17:38:04.682 INFO:tasks.workunit.client.0.smithi037.stderr: -369> 2024-09-12T17:38:04.179+0000 7ff03f20f800 5 AuthRegistry(0x55e2588cb5c8) adding con mode: secure 2024-09-12T17:38:04.682 INFO:tasks.workunit.client.0.smithi037.stderr: -368> 2024-09-12T17:38:04.179+0000 7ff03f20f800 5 AuthRegistry(0x55e2588cb5c8) adding con mode: crc 2024-09-12T17:38:04.682 INFO:tasks.workunit.client.0.smithi037.stderr: -367> 2024-09-12T17:38:04.179+0000 7ff03f20f800 5 AuthRegistry(0x55e2588cb5c8) adding con mode: secure 2024-09-12T17:38:04.682 INFO:tasks.workunit.client.0.smithi037.stderr: -366> 2024-09-12T17:38:04.179+0000 7ff03f20f800 5 AuthRegistry(0x55e2588cb5c8) adding con mode: crc 2024-09-12T17:38:04.682 INFO:tasks.workunit.client.0.smithi037.stderr: -365> 2024-09-12T17:38:04.179+0000 7ff03f20f800 5 AuthRegistry(0x55e2588cb5c8) adding con mode: secure 2024-09-12T17:38:04.682 INFO:tasks.workunit.client.0.smithi037.stderr: -364> 2024-09-12T17:38:04.179+0000 7ff03f20f800 5 AuthRegistry(0x55e2588cb5c8) adding con mode: crc 2024-09-12T17:38:04.683 INFO:tasks.workunit.client.0.smithi037.stderr: -363> 2024-09-12T17:38:04.179+0000 7ff03f20f800 5 AuthRegistry(0x55e2588cb5c8) adding con mode: crc 2024-09-12T17:38:04.683 INFO:tasks.workunit.client.0.smithi037.stderr: -362> 2024-09-12T17:38:04.179+0000 7ff03f20f800 5 AuthRegistry(0x55e2588cb5c8) adding con mode: secure 2024-09-12T17:38:04.683 INFO:tasks.workunit.client.0.smithi037.stderr: -361> 2024-09-12T17:38:04.179+0000 7ff03f20f800 5 AuthRegistry(0x55e2588cb5c8) adding con mode: crc 2024-09-12T17:38:04.683 INFO:tasks.workunit.client.0.smithi037.stderr: -360> 2024-09-12T17:38:04.179+0000 7ff03f20f800 5 AuthRegistry(0x55e2588cb5c8) adding con mode: secure 2024-09-12T17:38:04.683 INFO:tasks.workunit.client.0.smithi037.stderr: -359> 2024-09-12T17:38:04.179+0000 7ff03f20f800 5 AuthRegistry(0x55e2588cb5c8) adding con mode: crc 2024-09-12T17:38:04.683 INFO:tasks.workunit.client.0.smithi037.stderr: -358> 2024-09-12T17:38:04.179+0000 7ff03f20f800 5 AuthRegistry(0x55e2588cb5c8) adding con mode: secure 2024-09-12T17:38:04.683 INFO:tasks.workunit.client.0.smithi037.stderr: -357> 2024-09-12T17:38:04.179+0000 7ff03f20f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:38:04.683 INFO:tasks.workunit.client.0.smithi037.stderr: -356> 2024-09-12T17:38:04.180+0000 7ff03f20f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:38:04.683 INFO:tasks.workunit.client.0.smithi037.stderr: -355> 2024-09-12T17:38:04.180+0000 7ff03f20f800 5 asok(0x55e258655730) register_command rotate-key cmddesc rotate-key hook 0x55e2588cb710 EEXIST 2024-09-12T17:38:04.683 INFO:tasks.workunit.client.0.smithi037.stderr: -354> 2024-09-12T17:38:04.180+0000 7ff03f20f800 10 monclient: _reopen_session rank -1 2024-09-12T17:38:04.683 INFO:tasks.workunit.client.0.smithi037.stderr: -353> 2024-09-12T17:38:04.180+0000 7ff03f20f800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T17:38:04.683 INFO:tasks.workunit.client.0.smithi037.stderr: -352> 2024-09-12T17:38:04.180+0000 7ff03f20f800 10 monclient(hunting): picked mon.noname-c con 0x55e2588f3cd0 addr [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] 2024-09-12T17:38:04.683 INFO:tasks.workunit.client.0.smithi037.stderr: -351> 2024-09-12T17:38:04.180+0000 7ff03f20f800 10 monclient(hunting): picked mon.noname-a con 0x55e2588f5fa0 addr [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] 2024-09-12T17:38:04.683 INFO:tasks.workunit.client.0.smithi037.stderr: -350> 2024-09-12T17:38:04.180+0000 7ff03f20f800 10 monclient(hunting): picked mon.noname-b con 0x55e2588f24a0 addr [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] 2024-09-12T17:38:04.684 INFO:tasks.workunit.client.0.smithi037.stderr: -349> 2024-09-12T17:38:04.180+0000 7ff03f20f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:38:04.684 INFO:tasks.workunit.client.0.smithi037.stderr: -348> 2024-09-12T17:38:04.180+0000 7ff03f20f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:38:04.684 INFO:tasks.workunit.client.0.smithi037.stderr: -347> 2024-09-12T17:38:04.180+0000 7ff03f20f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:38:04.684 INFO:tasks.workunit.client.0.smithi037.stderr: -346> 2024-09-12T17:38:04.180+0000 7ff03f20f800 10 monclient(hunting): _renew_subs 2024-09-12T17:38:04.684 INFO:tasks.workunit.client.0.smithi037.stderr: -345> 2024-09-12T17:38:04.180+0000 7ff03f20f800 10 monclient(hunting): authenticate will time out at 2471.777165s 2024-09-12T17:38:04.684 INFO:tasks.workunit.client.0.smithi037.stderr: -344> 2024-09-12T17:38:04.180+0000 7ff03a992640 10 monclient(hunting): get_auth_request con 0x55e2588f3cd0 auth_method 0 2024-09-12T17:38:04.684 INFO:tasks.workunit.client.0.smithi037.stderr: -343> 2024-09-12T17:38:04.180+0000 7ff03a992640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:38:04.684 INFO:tasks.workunit.client.0.smithi037.stderr: -342> 2024-09-12T17:38:04.180+0000 7ff03a992640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:38:04.684 INFO:tasks.workunit.client.0.smithi037.stderr: -341> 2024-09-12T17:38:04.180+0000 7ff03a992640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:38:04.684 INFO:tasks.workunit.client.0.smithi037.stderr: -340> 2024-09-12T17:38:04.180+0000 7ff03a191640 10 monclient(hunting): get_auth_request con 0x55e2588f5fa0 auth_method 0 2024-09-12T17:38:04.684 INFO:tasks.workunit.client.0.smithi037.stderr: -339> 2024-09-12T17:38:04.180+0000 7ff03a191640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:38:04.684 INFO:tasks.workunit.client.0.smithi037.stderr: -338> 2024-09-12T17:38:04.180+0000 7ff03a191640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:38:04.684 INFO:tasks.workunit.client.0.smithi037.stderr: -337> 2024-09-12T17:38:04.180+0000 7ff03a191640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:38:04.684 INFO:tasks.workunit.client.0.smithi037.stderr: -336> 2024-09-12T17:38:04.180+0000 7ff03a992640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:38:04.684 INFO:tasks.workunit.client.0.smithi037.stderr: -335> 2024-09-12T17:38:04.180+0000 7ff03a992640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:38:04.685 INFO:tasks.workunit.client.0.smithi037.stderr: -334> 2024-09-12T17:38:04.180+0000 7ff03a992640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:38:04.685 INFO:tasks.workunit.client.0.smithi037.stderr: -333> 2024-09-12T17:38:04.180+0000 7ff03b193640 10 monclient(hunting): get_auth_request con 0x55e2588f24a0 auth_method 0 2024-09-12T17:38:04.685 INFO:tasks.workunit.client.0.smithi037.stderr: -332> 2024-09-12T17:38:04.180+0000 7ff03b193640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:38:04.685 INFO:tasks.workunit.client.0.smithi037.stderr: -331> 2024-09-12T17:38:04.180+0000 7ff03b193640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:38:04.685 INFO:tasks.workunit.client.0.smithi037.stderr: -330> 2024-09-12T17:38:04.180+0000 7ff03b193640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:38:04.685 INFO:tasks.workunit.client.0.smithi037.stderr: -329> 2024-09-12T17:38:04.180+0000 7ff03a191640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:38:04.685 INFO:tasks.workunit.client.0.smithi037.stderr: -328> 2024-09-12T17:38:04.180+0000 7ff03a191640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:38:04.685 INFO:tasks.workunit.client.0.smithi037.stderr: -327> 2024-09-12T17:38:04.180+0000 7ff03a191640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:38:04.685 INFO:tasks.workunit.client.0.smithi037.stderr: -326> 2024-09-12T17:38:04.180+0000 7ff03b193640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:38:04.685 INFO:tasks.workunit.client.0.smithi037.stderr: -325> 2024-09-12T17:38:04.180+0000 7ff03b193640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:38:04.685 INFO:tasks.workunit.client.0.smithi037.stderr: -324> 2024-09-12T17:38:04.180+0000 7ff03b193640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:38:04.685 INFO:tasks.workunit.client.0.smithi037.stderr: -323> 2024-09-12T17:38:04.180+0000 7ff03a992640 10 monclient(hunting): handle_auth_done global_id 7778 payload 824 2024-09-12T17:38:04.686 INFO:tasks.workunit.client.0.smithi037.stderr: -322> 2024-09-12T17:38:04.180+0000 7ff03a992640 10 monclient: _finish_hunting 0 2024-09-12T17:38:04.686 INFO:tasks.workunit.client.0.smithi037.stderr: -321> 2024-09-12T17:38:04.180+0000 7ff03a992640 1 monclient: found mon.noname-c 2024-09-12T17:38:04.686 INFO:tasks.workunit.client.0.smithi037.stderr: -320> 2024-09-12T17:38:04.180+0000 7ff03a992640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.37:3301/0 2024-09-12T17:38:04.686 INFO:tasks.workunit.client.0.smithi037.stderr: -319> 2024-09-12T17:38:04.180+0000 7fef24e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:38:04.686 INFO:tasks.workunit.client.0.smithi037.stderr: -318> 2024-09-12T17:38:04.180+0000 7fef24e01640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:38:04.686 INFO:tasks.workunit.client.0.smithi037.stderr: -317> 2024-09-12T17:38:04.180+0000 7fef24e01640 10 monclient: dump: 2024-09-12T17:38:04.686 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:38:04.686 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:38:04.686 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:38:04.686 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:38:04.686 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:38:04.686 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:38:04.686 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:38:04.686 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:38:04.687 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:38:04.687 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:38:04.687 INFO:tasks.workunit.client.0.smithi037.stderr: -316> 2024-09-12T17:38:04.180+0000 7fef24e01640 10 monclient: _finish_auth 0 2024-09-12T17:38:04.687 INFO:tasks.workunit.client.0.smithi037.stderr: -315> 2024-09-12T17:38:04.180+0000 7fef24e01640 10 monclient: _check_auth_tickets 2024-09-12T17:38:04.687 INFO:tasks.workunit.client.0.smithi037.stderr: -314> 2024-09-12T17:38:04.180+0000 7fef24e01640 10 monclient: handle_config config(0 keys) 2024-09-12T17:38:04.687 INFO:tasks.workunit.client.0.smithi037.stderr: -313> 2024-09-12T17:38:04.180+0000 7fef24e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:38:04.687 INFO:tasks.workunit.client.0.smithi037.stderr: -312> 2024-09-12T17:38:04.180+0000 7fef24e01640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:38:04.687 INFO:tasks.workunit.client.0.smithi037.stderr: -311> 2024-09-12T17:38:04.180+0000 7fef24e01640 10 monclient: dump: 2024-09-12T17:38:04.687 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:38:04.687 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:38:04.687 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:38:04.687 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:38:04.687 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:38:04.688 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:38:04.688 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:38:04.688 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:38:04.688 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:38:04.688 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:38:04.688 INFO:tasks.workunit.client.0.smithi037.stderr: -310> 2024-09-12T17:38:04.180+0000 7ff03f20f800 5 monclient: authenticate success, global_id 7778 2024-09-12T17:38:04.688 INFO:tasks.workunit.client.0.smithi037.stderr: -309> 2024-09-12T17:38:04.180+0000 7ff03f20f800 10 monclient: _renew_subs 2024-09-12T17:38:04.688 INFO:tasks.workunit.client.0.smithi037.stderr: -308> 2024-09-12T17:38:04.180+0000 7ff03f20f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.37:3301/0 2024-09-12T17:38:04.688 INFO:tasks.workunit.client.0.smithi037.stderr: -307> 2024-09-12T17:38:04.180+0000 7ff03b994640 4 set_mon_vals no callback set 2024-09-12T17:38:04.688 INFO:tasks.workunit.client.0.smithi037.stderr: -306> 2024-09-12T17:38:04.181+0000 7ff03f20f800 10 monclient: _renew_subs 2024-09-12T17:38:04.688 INFO:tasks.workunit.client.0.smithi037.stderr: -305> 2024-09-12T17:38:04.181+0000 7ff03f20f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.37:3301/0 2024-09-12T17:38:04.688 INFO:tasks.workunit.client.0.smithi037.stderr: -304> 2024-09-12T17:38:04.182+0000 7fef24e01640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:38:04.689 INFO:tasks.workunit.client.0.smithi037.stderr: -303> 2024-09-12T17:38:04.182+0000 7fef24e01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.40:6816/3916250676,v1:172.21.15.40:6817/3916250676] 2024-09-12T17:38:04.689 INFO:tasks.workunit.client.0.smithi037.stderr: -302> 2024-09-12T17:38:04.182+0000 7fef24e01640 4 mgrc reconnect Starting new session with [v2:172.21.15.40:6816/3916250676,v1:172.21.15.40:6817/3916250676] 2024-09-12T17:38:04.689 INFO:tasks.workunit.client.0.smithi037.stderr: -301> 2024-09-12T17:38:04.183+0000 7ff03a191640 10 monclient: get_auth_request con 0x7fef14076380 auth_method 0 2024-09-12T17:38:04.689 INFO:tasks.workunit.client.0.smithi037.stderr: -300> 2024-09-12T17:38:04.183+0000 7ff03f20f800 10 monclient: get_monmap_and_config 2024-09-12T17:38:04.689 INFO:tasks.workunit.client.0.smithi037.stderr: -299> 2024-09-12T17:38:04.183+0000 7ff03f20f800 10 monclient: build_initial_monmap 2024-09-12T17:38:04.689 INFO:tasks.workunit.client.0.smithi037.stderr: -298> 2024-09-12T17:38:04.183+0000 7ff03f20f800 1 build_initial for_mkfs: 0 2024-09-12T17:38:04.689 INFO:tasks.workunit.client.0.smithi037.stderr: -297> 2024-09-12T17:38:04.183+0000 7ff03f20f800 10 monclient: monmap: 2024-09-12T17:38:04.689 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 0 2024-09-12T17:38:04.689 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:38:04.689 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 0.000000 2024-09-12T17:38:04.689 INFO:tasks.workunit.client.0.smithi037.stderr:created 0.000000 2024-09-12T17:38:04.689 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 0 (unknown) 2024-09-12T17:38:04.690 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:38:04.690 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.noname-a 2024-09-12T17:38:04.690 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.noname-b 2024-09-12T17:38:04.690 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.noname-c 2024-09-12T17:38:04.690 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:38:04.690 INFO:tasks.workunit.client.0.smithi037.stderr: -296> 2024-09-12T17:38:04.183+0000 7ff03f20f800 5 AuthRegistry(0x55e258913b50) adding auth protocol: cephx 2024-09-12T17:38:04.690 INFO:tasks.workunit.client.0.smithi037.stderr: -295> 2024-09-12T17:38:04.183+0000 7ff03f20f800 5 AuthRegistry(0x55e258913b50) adding auth protocol: cephx 2024-09-12T17:38:04.690 INFO:tasks.workunit.client.0.smithi037.stderr: -294> 2024-09-12T17:38:04.183+0000 7ff03f20f800 5 AuthRegistry(0x55e258913b50) adding auth protocol: cephx 2024-09-12T17:38:04.690 INFO:tasks.workunit.client.0.smithi037.stderr: -293> 2024-09-12T17:38:04.183+0000 7ff03f20f800 5 AuthRegistry(0x55e258913b50) adding con mode: secure 2024-09-12T17:38:04.690 INFO:tasks.workunit.client.0.smithi037.stderr: -292> 2024-09-12T17:38:04.183+0000 7ff03f20f800 5 AuthRegistry(0x55e258913b50) adding con mode: crc 2024-09-12T17:38:04.690 INFO:tasks.workunit.client.0.smithi037.stderr: -291> 2024-09-12T17:38:04.183+0000 7ff03f20f800 5 AuthRegistry(0x55e258913b50) adding con mode: secure 2024-09-12T17:38:04.690 INFO:tasks.workunit.client.0.smithi037.stderr: -290> 2024-09-12T17:38:04.183+0000 7ff03f20f800 5 AuthRegistry(0x55e258913b50) adding con mode: crc 2024-09-12T17:38:04.690 INFO:tasks.workunit.client.0.smithi037.stderr: -289> 2024-09-12T17:38:04.183+0000 7ff03f20f800 5 AuthRegistry(0x55e258913b50) adding con mode: secure 2024-09-12T17:38:04.691 INFO:tasks.workunit.client.0.smithi037.stderr: -288> 2024-09-12T17:38:04.183+0000 7ff03f20f800 5 AuthRegistry(0x55e258913b50) adding con mode: crc 2024-09-12T17:38:04.691 INFO:tasks.workunit.client.0.smithi037.stderr: -287> 2024-09-12T17:38:04.183+0000 7ff03f20f800 5 AuthRegistry(0x55e258913b50) adding con mode: crc 2024-09-12T17:38:04.691 INFO:tasks.workunit.client.0.smithi037.stderr: -286> 2024-09-12T17:38:04.183+0000 7ff03f20f800 5 AuthRegistry(0x55e258913b50) adding con mode: secure 2024-09-12T17:38:04.691 INFO:tasks.workunit.client.0.smithi037.stderr: -285> 2024-09-12T17:38:04.183+0000 7ff03f20f800 5 AuthRegistry(0x55e258913b50) adding con mode: crc 2024-09-12T17:38:04.691 INFO:tasks.workunit.client.0.smithi037.stderr: -284> 2024-09-12T17:38:04.183+0000 7ff03f20f800 5 AuthRegistry(0x55e258913b50) adding con mode: secure 2024-09-12T17:38:04.691 INFO:tasks.workunit.client.0.smithi037.stderr: -283> 2024-09-12T17:38:04.183+0000 7ff03f20f800 5 AuthRegistry(0x55e258913b50) adding con mode: crc 2024-09-12T17:38:04.691 INFO:tasks.workunit.client.0.smithi037.stderr: -282> 2024-09-12T17:38:04.183+0000 7ff03f20f800 5 AuthRegistry(0x55e258913b50) adding con mode: secure 2024-09-12T17:38:04.691 INFO:tasks.workunit.client.0.smithi037.stderr: -281> 2024-09-12T17:38:04.183+0000 7ff03f20f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:38:04.691 INFO:tasks.workunit.client.0.smithi037.stderr: -280> 2024-09-12T17:38:04.183+0000 7ff03f20f800 10 monclient: init 2024-09-12T17:38:04.691 INFO:tasks.workunit.client.0.smithi037.stderr: -279> 2024-09-12T17:38:04.183+0000 7ff03f20f800 5 AuthRegistry(0x7ffcf2278070) adding auth protocol: cephx 2024-09-12T17:38:04.691 INFO:tasks.workunit.client.0.smithi037.stderr: -278> 2024-09-12T17:38:04.183+0000 7ff03f20f800 5 AuthRegistry(0x7ffcf2278070) adding auth protocol: cephx 2024-09-12T17:38:04.691 INFO:tasks.workunit.client.0.smithi037.stderr: -277> 2024-09-12T17:38:04.183+0000 7ff03f20f800 5 AuthRegistry(0x7ffcf2278070) adding auth protocol: cephx 2024-09-12T17:38:04.691 INFO:tasks.workunit.client.0.smithi037.stderr: -276> 2024-09-12T17:38:04.183+0000 7ff03f20f800 5 AuthRegistry(0x7ffcf2278070) adding con mode: secure 2024-09-12T17:38:04.692 INFO:tasks.workunit.client.0.smithi037.stderr: -275> 2024-09-12T17:38:04.183+0000 7ff03f20f800 5 AuthRegistry(0x7ffcf2278070) adding con mode: crc 2024-09-12T17:38:04.692 INFO:tasks.workunit.client.0.smithi037.stderr: -274> 2024-09-12T17:38:04.183+0000 7ff03f20f800 5 AuthRegistry(0x7ffcf2278070) adding con mode: secure 2024-09-12T17:38:04.692 INFO:tasks.workunit.client.0.smithi037.stderr: -273> 2024-09-12T17:38:04.183+0000 7ff03f20f800 5 AuthRegistry(0x7ffcf2278070) adding con mode: crc 2024-09-12T17:38:04.692 INFO:tasks.workunit.client.0.smithi037.stderr: -272> 2024-09-12T17:38:04.183+0000 7ff03f20f800 5 AuthRegistry(0x7ffcf2278070) adding con mode: secure 2024-09-12T17:38:04.692 INFO:tasks.workunit.client.0.smithi037.stderr: -271> 2024-09-12T17:38:04.183+0000 7ff03f20f800 5 AuthRegistry(0x7ffcf2278070) adding con mode: crc 2024-09-12T17:38:04.692 INFO:tasks.workunit.client.0.smithi037.stderr: -270> 2024-09-12T17:38:04.183+0000 7ff03f20f800 5 AuthRegistry(0x7ffcf2278070) adding con mode: crc 2024-09-12T17:38:04.692 INFO:tasks.workunit.client.0.smithi037.stderr: -269> 2024-09-12T17:38:04.183+0000 7ff03f20f800 5 AuthRegistry(0x7ffcf2278070) adding con mode: secure 2024-09-12T17:38:04.692 INFO:tasks.workunit.client.0.smithi037.stderr: -268> 2024-09-12T17:38:04.183+0000 7ff03f20f800 5 AuthRegistry(0x7ffcf2278070) adding con mode: crc 2024-09-12T17:38:04.692 INFO:tasks.workunit.client.0.smithi037.stderr: -267> 2024-09-12T17:38:04.183+0000 7ff03f20f800 5 AuthRegistry(0x7ffcf2278070) adding con mode: secure 2024-09-12T17:38:04.692 INFO:tasks.workunit.client.0.smithi037.stderr: -266> 2024-09-12T17:38:04.183+0000 7ff03f20f800 5 AuthRegistry(0x7ffcf2278070) adding con mode: crc 2024-09-12T17:38:04.692 INFO:tasks.workunit.client.0.smithi037.stderr: -265> 2024-09-12T17:38:04.183+0000 7ff03f20f800 5 AuthRegistry(0x7ffcf2278070) adding con mode: secure 2024-09-12T17:38:04.692 INFO:tasks.workunit.client.0.smithi037.stderr: -264> 2024-09-12T17:38:04.183+0000 7ff03f20f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:38:04.692 INFO:tasks.workunit.client.0.smithi037.stderr: -263> 2024-09-12T17:38:04.183+0000 7ff03f20f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:38:04.693 INFO:tasks.workunit.client.0.smithi037.stderr: -262> 2024-09-12T17:38:04.184+0000 7ff03f20f800 5 asok(0x55e258655730) register_command rotate-key cmddesc rotate-key hook 0x7ffcf22781b8 EEXIST 2024-09-12T17:38:04.693 INFO:tasks.workunit.client.0.smithi037.stderr: -261> 2024-09-12T17:38:04.184+0000 7ff03f20f800 10 monclient: _reopen_session rank -1 2024-09-12T17:38:04.693 INFO:tasks.workunit.client.0.smithi037.stderr: -260> 2024-09-12T17:38:04.184+0000 7ff03f20f800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T17:38:04.693 INFO:tasks.workunit.client.0.smithi037.stderr: -259> 2024-09-12T17:38:04.184+0000 7ff03f20f800 10 monclient(hunting): picked mon.noname-a con 0x55e258948040 addr [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] 2024-09-12T17:38:04.693 INFO:tasks.workunit.client.0.smithi037.stderr: -258> 2024-09-12T17:38:04.184+0000 7ff03f20f800 10 monclient(hunting): picked mon.noname-b con 0x55e258918e60 addr [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] 2024-09-12T17:38:04.693 INFO:tasks.workunit.client.0.smithi037.stderr: -257> 2024-09-12T17:38:04.184+0000 7ff03f20f800 10 monclient(hunting): picked mon.noname-c con 0x55e258943470 addr [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] 2024-09-12T17:38:04.693 INFO:tasks.workunit.client.0.smithi037.stderr: -256> 2024-09-12T17:38:04.184+0000 7ff03f20f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:38:04.693 INFO:tasks.workunit.client.0.smithi037.stderr: -255> 2024-09-12T17:38:04.184+0000 7ff03f20f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:38:04.693 INFO:tasks.workunit.client.0.smithi037.stderr: -254> 2024-09-12T17:38:04.184+0000 7ff03f20f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:38:04.693 INFO:tasks.workunit.client.0.smithi037.stderr: -253> 2024-09-12T17:38:04.184+0000 7ff03f20f800 10 monclient(hunting): _renew_subs 2024-09-12T17:38:04.693 INFO:tasks.workunit.client.0.smithi037.stderr: -252> 2024-09-12T17:38:04.184+0000 7ff03f20f800 10 monclient(hunting): authenticate will time out at 2471.781135s 2024-09-12T17:38:04.693 INFO:tasks.workunit.client.0.smithi037.stderr: -251> 2024-09-12T17:38:04.184+0000 7ff03a992640 10 monclient(hunting): get_auth_request con 0x55e258948040 auth_method 0 2024-09-12T17:38:04.693 INFO:tasks.workunit.client.0.smithi037.stderr: -250> 2024-09-12T17:38:04.184+0000 7ff03a992640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:38:04.694 INFO:tasks.workunit.client.0.smithi037.stderr: -249> 2024-09-12T17:38:04.184+0000 7ff03a992640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:38:04.694 INFO:tasks.workunit.client.0.smithi037.stderr: -248> 2024-09-12T17:38:04.184+0000 7ff03a992640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:38:04.694 INFO:tasks.workunit.client.0.smithi037.stderr: -247> 2024-09-12T17:38:04.184+0000 7ff03b193640 10 monclient(hunting): get_auth_request con 0x55e258943470 auth_method 0 2024-09-12T17:38:04.694 INFO:tasks.workunit.client.0.smithi037.stderr: -246> 2024-09-12T17:38:04.184+0000 7ff03b193640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:38:04.694 INFO:tasks.workunit.client.0.smithi037.stderr: -245> 2024-09-12T17:38:04.184+0000 7ff03b193640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:38:04.694 INFO:tasks.workunit.client.0.smithi037.stderr: -244> 2024-09-12T17:38:04.184+0000 7ff03b193640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:38:04.694 INFO:tasks.workunit.client.0.smithi037.stderr: -243> 2024-09-12T17:38:04.184+0000 7ff03a992640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:38:04.694 INFO:tasks.workunit.client.0.smithi037.stderr: -242> 2024-09-12T17:38:04.184+0000 7ff03a992640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:38:04.694 INFO:tasks.workunit.client.0.smithi037.stderr: -241> 2024-09-12T17:38:04.184+0000 7ff03a992640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:38:04.694 INFO:tasks.workunit.client.0.smithi037.stderr: -240> 2024-09-12T17:38:04.184+0000 7ff03b193640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:38:04.694 INFO:tasks.workunit.client.0.smithi037.stderr: -239> 2024-09-12T17:38:04.184+0000 7ff03b193640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:38:04.694 INFO:tasks.workunit.client.0.smithi037.stderr: -238> 2024-09-12T17:38:04.184+0000 7ff03b193640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:38:04.694 INFO:tasks.workunit.client.0.smithi037.stderr: -237> 2024-09-12T17:38:04.184+0000 7ff03a992640 10 monclient(hunting): handle_auth_done global_id 8337 payload 274 2024-09-12T17:38:04.694 INFO:tasks.workunit.client.0.smithi037.stderr: -236> 2024-09-12T17:38:04.184+0000 7ff03a992640 10 monclient: _finish_hunting 0 2024-09-12T17:38:04.695 INFO:tasks.workunit.client.0.smithi037.stderr: -235> 2024-09-12T17:38:04.184+0000 7ff03a992640 1 monclient: found mon.noname-a 2024-09-12T17:38:04.695 INFO:tasks.workunit.client.0.smithi037.stderr: -234> 2024-09-12T17:38:04.184+0000 7ff03a992640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.37:3300/0 2024-09-12T17:38:04.695 INFO:tasks.workunit.client.0.smithi037.stderr: -233> 2024-09-12T17:38:04.184+0000 7ff03a191640 10 monclient: get_auth_request con 0x55e258918e60 auth_method 0 2024-09-12T17:38:04.695 INFO:tasks.workunit.client.0.smithi037.stderr: -232> 2024-09-12T17:38:04.184+0000 7fef1e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:38:04.695 INFO:tasks.workunit.client.0.smithi037.stderr: -231> 2024-09-12T17:38:04.184+0000 7fef1e7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:38:04.695 INFO:tasks.workunit.client.0.smithi037.stderr: -230> 2024-09-12T17:38:04.184+0000 7fef1e7fc640 10 monclient: dump: 2024-09-12T17:38:04.695 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:38:04.695 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:38:04.695 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:38:04.695 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:38:04.695 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:38:04.695 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:38:04.695 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:38:04.695 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:38:04.696 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:38:04.696 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:38:04.696 INFO:tasks.workunit.client.0.smithi037.stderr: -229> 2024-09-12T17:38:04.184+0000 7fef1e7fc640 10 monclient: _finish_auth 0 2024-09-12T17:38:04.696 INFO:tasks.workunit.client.0.smithi037.stderr: -228> 2024-09-12T17:38:04.184+0000 7fef1e7fc640 10 monclient: _check_auth_tickets 2024-09-12T17:38:04.696 INFO:tasks.workunit.client.0.smithi037.stderr: -227> 2024-09-12T17:38:04.184+0000 7fef1e7fc640 10 monclient: handle_config config(0 keys) 2024-09-12T17:38:04.696 INFO:tasks.workunit.client.0.smithi037.stderr: -226> 2024-09-12T17:38:04.184+0000 7fef1e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:38:04.696 INFO:tasks.workunit.client.0.smithi037.stderr: -225> 2024-09-12T17:38:04.184+0000 7fef1e7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:38:04.696 INFO:tasks.workunit.client.0.smithi037.stderr: -224> 2024-09-12T17:38:04.184+0000 7fef1e7fc640 10 monclient: dump: 2024-09-12T17:38:04.696 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:38:04.696 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:38:04.696 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:38:04.696 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:38:04.696 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:38:04.697 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:38:04.697 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:38:04.697 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:38:04.697 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:38:04.697 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:38:04.697 INFO:tasks.workunit.client.0.smithi037.stderr: -223> 2024-09-12T17:38:04.184+0000 7ff03f20f800 5 monclient: authenticate success, global_id 8337 2024-09-12T17:38:04.697 INFO:tasks.workunit.client.0.smithi037.stderr: -222> 2024-09-12T17:38:04.184+0000 7ff03f20f800 10 monclient: get_monmap_and_config success 2024-09-12T17:38:04.697 INFO:tasks.workunit.client.0.smithi037.stderr: -221> 2024-09-12T17:38:04.184+0000 7ff03f20f800 4 set_mon_vals no callback set 2024-09-12T17:38:04.697 INFO:tasks.workunit.client.0.smithi037.stderr: -220> 2024-09-12T17:38:04.185+0000 7ff03f20f800 10 monclient: shutdown 2024-09-12T17:38:04.697 INFO:tasks.workunit.client.0.smithi037.stderr: -219> 2024-09-12T17:38:04.185+0000 7ff03f20f800 10 monclient: build_initial_monmap 2024-09-12T17:38:04.697 INFO:tasks.workunit.client.0.smithi037.stderr: -218> 2024-09-12T17:38:04.185+0000 7ff03f20f800 1 build_initial for_mkfs: 0 2024-09-12T17:38:04.697 INFO:tasks.workunit.client.0.smithi037.stderr: -217> 2024-09-12T17:38:04.185+0000 7ff03f20f800 10 monclient: monmap: 2024-09-12T17:38:04.697 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 0 2024-09-12T17:38:04.698 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:38:04.698 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 0.000000 2024-09-12T17:38:04.698 INFO:tasks.workunit.client.0.smithi037.stderr:created 0.000000 2024-09-12T17:38:04.698 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 0 (unknown) 2024-09-12T17:38:04.698 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:38:04.698 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.noname-a 2024-09-12T17:38:04.698 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.noname-b 2024-09-12T17:38:04.698 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.noname-c 2024-09-12T17:38:04.698 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:38:04.698 INFO:tasks.workunit.client.0.smithi037.stderr: -216> 2024-09-12T17:38:04.185+0000 7ff03f20f800 5 AuthRegistry(0x55e258944270) adding auth protocol: cephx 2024-09-12T17:38:04.698 INFO:tasks.workunit.client.0.smithi037.stderr: -215> 2024-09-12T17:38:04.185+0000 7ff03f20f800 5 AuthRegistry(0x55e258944270) adding auth protocol: cephx 2024-09-12T17:38:04.698 INFO:tasks.workunit.client.0.smithi037.stderr: -214> 2024-09-12T17:38:04.185+0000 7ff03f20f800 5 AuthRegistry(0x55e258944270) adding auth protocol: cephx 2024-09-12T17:38:04.698 INFO:tasks.workunit.client.0.smithi037.stderr: -213> 2024-09-12T17:38:04.185+0000 7ff03f20f800 5 AuthRegistry(0x55e258944270) adding con mode: secure 2024-09-12T17:38:04.699 INFO:tasks.workunit.client.0.smithi037.stderr: -212> 2024-09-12T17:38:04.185+0000 7ff03f20f800 5 AuthRegistry(0x55e258944270) adding con mode: crc 2024-09-12T17:38:04.699 INFO:tasks.workunit.client.0.smithi037.stderr: -211> 2024-09-12T17:38:04.185+0000 7ff03f20f800 5 AuthRegistry(0x55e258944270) adding con mode: secure 2024-09-12T17:38:04.699 INFO:tasks.workunit.client.0.smithi037.stderr: -210> 2024-09-12T17:38:04.185+0000 7ff03f20f800 5 AuthRegistry(0x55e258944270) adding con mode: crc 2024-09-12T17:38:04.699 INFO:tasks.workunit.client.0.smithi037.stderr: -209> 2024-09-12T17:38:04.185+0000 7ff03f20f800 5 AuthRegistry(0x55e258944270) adding con mode: secure 2024-09-12T17:38:04.699 INFO:tasks.workunit.client.0.smithi037.stderr: -208> 2024-09-12T17:38:04.185+0000 7ff03f20f800 5 AuthRegistry(0x55e258944270) adding con mode: crc 2024-09-12T17:38:04.699 INFO:tasks.workunit.client.0.smithi037.stderr: -207> 2024-09-12T17:38:04.185+0000 7ff03f20f800 5 AuthRegistry(0x55e258944270) adding con mode: crc 2024-09-12T17:38:04.699 INFO:tasks.workunit.client.0.smithi037.stderr: -206> 2024-09-12T17:38:04.185+0000 7ff03f20f800 5 AuthRegistry(0x55e258944270) adding con mode: secure 2024-09-12T17:38:04.699 INFO:tasks.workunit.client.0.smithi037.stderr: -205> 2024-09-12T17:38:04.185+0000 7ff03f20f800 5 AuthRegistry(0x55e258944270) adding con mode: crc 2024-09-12T17:38:04.699 INFO:tasks.workunit.client.0.smithi037.stderr: -204> 2024-09-12T17:38:04.185+0000 7ff03f20f800 5 AuthRegistry(0x55e258944270) adding con mode: secure 2024-09-12T17:38:04.699 INFO:tasks.workunit.client.0.smithi037.stderr: -203> 2024-09-12T17:38:04.185+0000 7ff03f20f800 5 AuthRegistry(0x55e258944270) adding con mode: crc 2024-09-12T17:38:04.699 INFO:tasks.workunit.client.0.smithi037.stderr: -202> 2024-09-12T17:38:04.185+0000 7ff03f20f800 5 AuthRegistry(0x55e258944270) adding con mode: secure 2024-09-12T17:38:04.699 INFO:tasks.workunit.client.0.smithi037.stderr: -201> 2024-09-12T17:38:04.185+0000 7ff03f20f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:38:04.699 INFO:tasks.workunit.client.0.smithi037.stderr: -200> 2024-09-12T17:38:04.185+0000 7ff03f20f800 1 librados: starting msgr at 2024-09-12T17:38:04.699 INFO:tasks.workunit.client.0.smithi037.stderr: -199> 2024-09-12T17:38:04.185+0000 7ff03f20f800 1 librados: starting objecter 2024-09-12T17:38:04.700 INFO:tasks.workunit.client.0.smithi037.stderr: -198> 2024-09-12T17:38:04.185+0000 7ff03f20f800 5 asok(0x55e258655730) register_command objecter_requests cmddesc objecter_requests hook 0x55e2588b9970 EEXIST 2024-09-12T17:38:04.700 INFO:tasks.workunit.client.0.smithi037.stderr: -197> 2024-09-12T17:38:04.186+0000 7ff03f20f800 1 librados: setting wanted keys 2024-09-12T17:38:04.700 INFO:tasks.workunit.client.0.smithi037.stderr: -196> 2024-09-12T17:38:04.186+0000 7ff03f20f800 1 librados: calling monclient init 2024-09-12T17:38:04.700 INFO:tasks.workunit.client.0.smithi037.stderr: -195> 2024-09-12T17:38:04.186+0000 7ff03f20f800 10 monclient: init 2024-09-12T17:38:04.700 INFO:tasks.workunit.client.0.smithi037.stderr: -194> 2024-09-12T17:38:04.186+0000 7ff03f20f800 5 AuthRegistry(0x55e25890ba80) adding auth protocol: cephx 2024-09-12T17:38:04.700 INFO:tasks.workunit.client.0.smithi037.stderr: -193> 2024-09-12T17:38:04.186+0000 7ff03f20f800 5 AuthRegistry(0x55e25890ba80) adding auth protocol: cephx 2024-09-12T17:38:04.700 INFO:tasks.workunit.client.0.smithi037.stderr: -192> 2024-09-12T17:38:04.186+0000 7ff03f20f800 5 AuthRegistry(0x55e25890ba80) adding auth protocol: cephx 2024-09-12T17:38:04.700 INFO:tasks.workunit.client.0.smithi037.stderr: -191> 2024-09-12T17:38:04.186+0000 7ff03f20f800 5 AuthRegistry(0x55e25890ba80) adding con mode: secure 2024-09-12T17:38:04.700 INFO:tasks.workunit.client.0.smithi037.stderr: -190> 2024-09-12T17:38:04.186+0000 7ff03f20f800 5 AuthRegistry(0x55e25890ba80) adding con mode: crc 2024-09-12T17:38:04.700 INFO:tasks.workunit.client.0.smithi037.stderr: -189> 2024-09-12T17:38:04.186+0000 7ff03f20f800 5 AuthRegistry(0x55e25890ba80) adding con mode: secure 2024-09-12T17:38:04.700 INFO:tasks.workunit.client.0.smithi037.stderr: -188> 2024-09-12T17:38:04.186+0000 7ff03f20f800 5 AuthRegistry(0x55e25890ba80) adding con mode: crc 2024-09-12T17:38:04.700 INFO:tasks.workunit.client.0.smithi037.stderr: -187> 2024-09-12T17:38:04.186+0000 7ff03f20f800 5 AuthRegistry(0x55e25890ba80) adding con mode: secure 2024-09-12T17:38:04.700 INFO:tasks.workunit.client.0.smithi037.stderr: -186> 2024-09-12T17:38:04.186+0000 7ff03f20f800 5 AuthRegistry(0x55e25890ba80) adding con mode: crc 2024-09-12T17:38:04.701 INFO:tasks.workunit.client.0.smithi037.stderr: -185> 2024-09-12T17:38:04.186+0000 7ff03f20f800 5 AuthRegistry(0x55e25890ba80) adding con mode: crc 2024-09-12T17:38:04.701 INFO:tasks.workunit.client.0.smithi037.stderr: -184> 2024-09-12T17:38:04.186+0000 7ff03f20f800 5 AuthRegistry(0x55e25890ba80) adding con mode: secure 2024-09-12T17:38:04.701 INFO:tasks.workunit.client.0.smithi037.stderr: -183> 2024-09-12T17:38:04.186+0000 7ff03f20f800 5 AuthRegistry(0x55e25890ba80) adding con mode: crc 2024-09-12T17:38:04.701 INFO:tasks.workunit.client.0.smithi037.stderr: -182> 2024-09-12T17:38:04.186+0000 7ff03f20f800 5 AuthRegistry(0x55e25890ba80) adding con mode: secure 2024-09-12T17:38:04.701 INFO:tasks.workunit.client.0.smithi037.stderr: -181> 2024-09-12T17:38:04.186+0000 7ff03f20f800 5 AuthRegistry(0x55e25890ba80) adding con mode: crc 2024-09-12T17:38:04.701 INFO:tasks.workunit.client.0.smithi037.stderr: -180> 2024-09-12T17:38:04.186+0000 7ff03f20f800 5 AuthRegistry(0x55e25890ba80) adding con mode: secure 2024-09-12T17:38:04.701 INFO:tasks.workunit.client.0.smithi037.stderr: -179> 2024-09-12T17:38:04.186+0000 7ff03f20f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:38:04.701 INFO:tasks.workunit.client.0.smithi037.stderr: -178> 2024-09-12T17:38:04.186+0000 7ff03f20f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:38:04.701 INFO:tasks.workunit.client.0.smithi037.stderr: -177> 2024-09-12T17:38:04.186+0000 7ff03f20f800 5 asok(0x55e258655730) register_command rotate-key cmddesc rotate-key hook 0x55e25890bbc8 EEXIST 2024-09-12T17:38:04.701 INFO:tasks.workunit.client.0.smithi037.stderr: -176> 2024-09-12T17:38:04.186+0000 7ff03f20f800 10 monclient: _reopen_session rank -1 2024-09-12T17:38:04.701 INFO:tasks.workunit.client.0.smithi037.stderr: -175> 2024-09-12T17:38:04.186+0000 7ff03f20f800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T17:38:04.701 INFO:tasks.workunit.client.0.smithi037.stderr: -174> 2024-09-12T17:38:04.186+0000 7ff03f20f800 10 monclient(hunting): picked mon.noname-b con 0x55e258918e60 addr [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] 2024-09-12T17:38:04.701 INFO:tasks.workunit.client.0.smithi037.stderr: -173> 2024-09-12T17:38:04.186+0000 7ff03f20f800 10 monclient(hunting): picked mon.noname-c con 0x55e258943470 addr [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] 2024-09-12T17:38:04.701 INFO:tasks.workunit.client.0.smithi037.stderr: -172> 2024-09-12T17:38:04.186+0000 7ff03f20f800 10 monclient(hunting): picked mon.noname-a con 0x55e258948040 addr [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] 2024-09-12T17:38:04.702 INFO:tasks.workunit.client.0.smithi037.stderr: -171> 2024-09-12T17:38:04.186+0000 7ff03f20f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:38:04.702 INFO:tasks.workunit.client.0.smithi037.stderr: -170> 2024-09-12T17:38:04.186+0000 7ff03f20f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:38:04.702 INFO:tasks.workunit.client.0.smithi037.stderr: -169> 2024-09-12T17:38:04.186+0000 7ff03f20f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:38:04.702 INFO:tasks.workunit.client.0.smithi037.stderr: -168> 2024-09-12T17:38:04.186+0000 7ff03f20f800 10 monclient(hunting): _renew_subs 2024-09-12T17:38:04.702 INFO:tasks.workunit.client.0.smithi037.stderr: -167> 2024-09-12T17:38:04.186+0000 7ff03f20f800 10 monclient(hunting): authenticate will time out at 2471.783627s 2024-09-12T17:38:04.702 INFO:tasks.workunit.client.0.smithi037.stderr: -166> 2024-09-12T17:38:04.186+0000 7ff03a191640 10 monclient(hunting): get_auth_request con 0x55e258943470 auth_method 0 2024-09-12T17:38:04.702 INFO:tasks.workunit.client.0.smithi037.stderr: -165> 2024-09-12T17:38:04.186+0000 7ff03a191640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:38:04.702 INFO:tasks.workunit.client.0.smithi037.stderr: -164> 2024-09-12T17:38:04.186+0000 7ff03a191640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:38:04.702 INFO:tasks.workunit.client.0.smithi037.stderr: -163> 2024-09-12T17:38:04.186+0000 7ff03a191640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:38:04.702 INFO:tasks.workunit.client.0.smithi037.stderr: -162> 2024-09-12T17:38:04.186+0000 7ff03b193640 10 monclient(hunting): get_auth_request con 0x55e258948040 auth_method 0 2024-09-12T17:38:04.702 INFO:tasks.workunit.client.0.smithi037.stderr: -161> 2024-09-12T17:38:04.186+0000 7ff03b193640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:38:04.702 INFO:tasks.workunit.client.0.smithi037.stderr: -160> 2024-09-12T17:38:04.186+0000 7ff03b193640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:38:04.702 INFO:tasks.workunit.client.0.smithi037.stderr: -159> 2024-09-12T17:38:04.186+0000 7ff03b193640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:38:04.702 INFO:tasks.workunit.client.0.smithi037.stderr: -158> 2024-09-12T17:38:04.186+0000 7ff03a191640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:38:04.703 INFO:tasks.workunit.client.0.smithi037.stderr: -157> 2024-09-12T17:38:04.186+0000 7ff03a191640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:38:04.703 INFO:tasks.workunit.client.0.smithi037.stderr: -156> 2024-09-12T17:38:04.186+0000 7ff03a191640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:38:04.703 INFO:tasks.workunit.client.0.smithi037.stderr: -155> 2024-09-12T17:38:04.186+0000 7ff03b193640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:38:04.703 INFO:tasks.workunit.client.0.smithi037.stderr: -154> 2024-09-12T17:38:04.186+0000 7ff03b193640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:38:04.703 INFO:tasks.workunit.client.0.smithi037.stderr: -153> 2024-09-12T17:38:04.186+0000 7ff03b193640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:38:04.703 INFO:tasks.workunit.client.0.smithi037.stderr: -152> 2024-09-12T17:38:04.186+0000 7ff03a992640 10 monclient(hunting): get_auth_request con 0x55e258918e60 auth_method 0 2024-09-12T17:38:04.703 INFO:tasks.workunit.client.0.smithi037.stderr: -151> 2024-09-12T17:38:04.186+0000 7ff03a992640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:38:04.703 INFO:tasks.workunit.client.0.smithi037.stderr: -150> 2024-09-12T17:38:04.186+0000 7ff03a992640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:38:04.703 INFO:tasks.workunit.client.0.smithi037.stderr: -149> 2024-09-12T17:38:04.186+0000 7ff03a992640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:38:04.703 INFO:tasks.workunit.client.0.smithi037.stderr: -148> 2024-09-12T17:38:04.186+0000 7ff03a191640 10 monclient(hunting): handle_auth_done global_id 7784 payload 824 2024-09-12T17:38:04.703 INFO:tasks.workunit.client.0.smithi037.stderr: -147> 2024-09-12T17:38:04.187+0000 7ff03a191640 10 monclient: _finish_hunting 0 2024-09-12T17:38:04.703 INFO:tasks.workunit.client.0.smithi037.stderr: -146> 2024-09-12T17:38:04.187+0000 7ff03a191640 1 monclient: found mon.noname-c 2024-09-12T17:38:04.703 INFO:tasks.workunit.client.0.smithi037.stderr: -145> 2024-09-12T17:38:04.187+0000 7ff03a191640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.37:3301/0 2024-09-12T17:38:04.704 INFO:tasks.workunit.client.0.smithi037.stderr: -144> 2024-09-12T17:38:04.187+0000 7fef1cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:38:04.704 INFO:tasks.workunit.client.0.smithi037.stderr: -143> 2024-09-12T17:38:04.187+0000 7fef1cff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:38:04.704 INFO:tasks.workunit.client.0.smithi037.stderr: -142> 2024-09-12T17:38:04.187+0000 7fef1cff9640 10 monclient: dump: 2024-09-12T17:38:04.704 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:38:04.704 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:38:04.704 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:38:04.704 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:38:04.704 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:38:04.704 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:38:04.704 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:38:04.704 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:38:04.704 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:38:04.704 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:38:04.705 INFO:tasks.workunit.client.0.smithi037.stderr: -141> 2024-09-12T17:38:04.187+0000 7fef1cff9640 10 monclient: _finish_auth 0 2024-09-12T17:38:04.705 INFO:tasks.workunit.client.0.smithi037.stderr: -140> 2024-09-12T17:38:04.187+0000 7fef1cff9640 10 monclient: _check_auth_tickets 2024-09-12T17:38:04.705 INFO:tasks.workunit.client.0.smithi037.stderr: -139> 2024-09-12T17:38:04.187+0000 7fef1cff9640 10 monclient: handle_config config(0 keys) 2024-09-12T17:38:04.705 INFO:tasks.workunit.client.0.smithi037.stderr: -138> 2024-09-12T17:38:04.187+0000 7fef1cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:38:04.705 INFO:tasks.workunit.client.0.smithi037.stderr: -137> 2024-09-12T17:38:04.187+0000 7fef1cff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:38:04.705 INFO:tasks.workunit.client.0.smithi037.stderr: -136> 2024-09-12T17:38:04.187+0000 7fef1cff9640 10 monclient: dump: 2024-09-12T17:38:04.705 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:38:04.705 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:38:04.705 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:38:04.705 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:38:04.705 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:38:04.705 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:38:04.705 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:38:04.706 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:38:04.706 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:38:04.706 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:38:04.706 INFO:tasks.workunit.client.0.smithi037.stderr: -135> 2024-09-12T17:38:04.187+0000 7ff03f20f800 5 monclient: authenticate success, global_id 7784 2024-09-12T17:38:04.706 INFO:tasks.workunit.client.0.smithi037.stderr: -134> 2024-09-12T17:38:04.187+0000 7ff03f20f800 10 monclient: _renew_subs 2024-09-12T17:38:04.706 INFO:tasks.workunit.client.0.smithi037.stderr: -133> 2024-09-12T17:38:04.187+0000 7fef1e7fc640 4 set_mon_vals no callback set 2024-09-12T17:38:04.706 INFO:tasks.workunit.client.0.smithi037.stderr: -132> 2024-09-12T17:38:04.187+0000 7ff03f20f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.37:3301/0 2024-09-12T17:38:04.706 INFO:tasks.workunit.client.0.smithi037.stderr: -131> 2024-09-12T17:38:04.187+0000 7ff03f20f800 10 monclient: _renew_subs 2024-09-12T17:38:04.706 INFO:tasks.workunit.client.0.smithi037.stderr: -130> 2024-09-12T17:38:04.187+0000 7ff03f20f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.37:3301/0 2024-09-12T17:38:04.707 INFO:tasks.workunit.client.0.smithi037.stderr: -129> 2024-09-12T17:38:04.187+0000 7ff03f20f800 1 librados: init done 2024-09-12T17:38:04.707 INFO:tasks.workunit.client.0.smithi037.stderr: -128> 2024-09-12T17:38:04.187+0000 7ff03f20f800 5 asok(0x55e258655730) register_command cr dump hook 0x55e25893cdb8 2024-09-12T17:38:04.707 INFO:tasks.workunit.client.0.smithi037.stderr: -127> 2024-09-12T17:38:04.189+0000 7ff03f20f800 20 rados->read ofs=0 len=0 2024-09-12T17:38:04.707 INFO:tasks.workunit.client.0.smithi037.stderr: -126> 2024-09-12T17:38:04.190+0000 7fef1cff9640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:38:04.707 INFO:tasks.workunit.client.0.smithi037.stderr: -125> 2024-09-12T17:38:04.190+0000 7fef1cff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.40:6816/3916250676,v1:172.21.15.40:6817/3916250676] 2024-09-12T17:38:04.707 INFO:tasks.workunit.client.0.smithi037.stderr: -124> 2024-09-12T17:38:04.190+0000 7fef1cff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.40:6816/3916250676,v1:172.21.15.40:6817/3916250676] 2024-09-12T17:38:04.707 INFO:tasks.workunit.client.0.smithi037.stderr: -123> 2024-09-12T17:38:04.190+0000 7ff03a992640 10 monclient: get_auth_request con 0x7fef04076470 auth_method 0 2024-09-12T17:38:04.707 INFO:tasks.workunit.client.0.smithi037.stderr: -122> 2024-09-12T17:38:04.190+0000 7ff03b193640 10 monclient: get_auth_request con 0x55e2589620d0 auth_method 0 2024-09-12T17:38:04.707 INFO:tasks.workunit.client.0.smithi037.stderr: -121> 2024-09-12T17:38:04.191+0000 7ff03f20f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:04.707 INFO:tasks.workunit.client.0.smithi037.stderr: -120> 2024-09-12T17:38:04.191+0000 7ff03f20f800 20 realm 2024-09-12T17:38:04.707 INFO:tasks.workunit.client.0.smithi037.stderr: -119> 2024-09-12T17:38:04.191+0000 7ff03f20f800 20 rados->read ofs=0 len=0 2024-09-12T17:38:04.707 INFO:tasks.workunit.client.0.smithi037.stderr: -118> 2024-09-12T17:38:04.191+0000 7ff03f20f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:04.707 INFO:tasks.workunit.client.0.smithi037.stderr: -117> 2024-09-12T17:38:04.191+0000 7ff03f20f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:38:04.708 INFO:tasks.workunit.client.0.smithi037.stderr: -116> 2024-09-12T17:38:04.191+0000 7ff03f20f800 20 rados->read ofs=0 len=0 2024-09-12T17:38:04.708 INFO:tasks.workunit.client.0.smithi037.stderr: -115> 2024-09-12T17:38:04.191+0000 7ff03f20f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:04.708 INFO:tasks.workunit.client.0.smithi037.stderr: -114> 2024-09-12T17:38:04.191+0000 7ff03f20f800 20 rados->read ofs=0 len=0 2024-09-12T17:38:04.708 INFO:tasks.workunit.client.0.smithi037.stderr: -113> 2024-09-12T17:38:04.191+0000 7ff03a992640 10 monclient: get_auth_request con 0x55e2589662d0 auth_method 0 2024-09-12T17:38:04.708 INFO:tasks.workunit.client.0.smithi037.stderr: -112> 2024-09-12T17:38:04.192+0000 7ff03f20f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:38:04.708 INFO:tasks.workunit.client.0.smithi037.stderr: -111> 2024-09-12T17:38:04.192+0000 7ff03f20f800 20 rados->read ofs=0 len=0 2024-09-12T17:38:04.708 INFO:tasks.workunit.client.0.smithi037.stderr: -110> 2024-09-12T17:38:04.193+0000 7ff03f20f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:38:04.708 INFO:tasks.workunit.client.0.smithi037.stderr: -109> 2024-09-12T17:38:04.193+0000 7ff03f20f800 20 searching for the correct realm 2024-09-12T17:38:04.708 INFO:tasks.workunit.client.0.smithi037.stderr: -108> 2024-09-12T17:38:04.193+0000 7ff03a191640 10 monclient: get_auth_request con 0x55e25896b540 auth_method 0 2024-09-12T17:38:04.708 INFO:tasks.workunit.client.0.smithi037.stderr: -107> 2024-09-12T17:38:04.193+0000 7fef1cff9640 1 client.7784.objecter ms_handle_reset 0x55e25896b540 session 0x55e25896aec0 osd.3 2024-09-12T17:38:04.708 INFO:tasks.workunit.client.0.smithi037.stderr: -106> 2024-09-12T17:38:04.193+0000 7fef1cff9640 10 monclient: _renew_subs 2024-09-12T17:38:04.708 INFO:tasks.workunit.client.0.smithi037.stderr: -105> 2024-09-12T17:38:04.193+0000 7fef1cff9640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.37:3301/0 2024-09-12T17:38:04.708 INFO:tasks.workunit.client.0.smithi037.stderr: -104> 2024-09-12T17:38:04.193+0000 7ff03a191640 10 monclient: get_auth_request con 0x7fef04086b70 auth_method 0 2024-09-12T17:38:04.709 INFO:tasks.workunit.client.0.smithi037.stderr: -103> 2024-09-12T17:38:04.194+0000 7ff03b193640 10 monclient: get_auth_request con 0x7ff030008070 auth_method 0 2024-09-12T17:38:04.709 INFO:tasks.workunit.client.0.smithi037.stderr: -102> 2024-09-12T17:38:04.195+0000 7ff03a992640 10 monclient: get_auth_request con 0x7ff034076040 auth_method 0 2024-09-12T17:38:04.709 INFO:tasks.workunit.client.0.smithi037.stderr: -101> 2024-09-12T17:38:04.196+0000 7ff03a191640 10 monclient: get_auth_request con 0x7ff02c048460 auth_method 0 2024-09-12T17:38:04.709 INFO:tasks.workunit.client.0.smithi037.stderr: -100> 2024-09-12T17:38:04.196+0000 7ff03a191640 0 -- 172.21.15.37:0/2555455407 >> [v2:172.21.15.40:6800/2441293461,v1:172.21.15.40:6801/2441293461] conn(0x7ff02c048460 msgr2=0x7ff02c067940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:38:04.709 INFO:tasks.workunit.client.0.smithi037.stderr: -99> 2024-09-12T17:38:04.397+0000 7ff03a191640 10 monclient: get_auth_request con 0x7ff02c048460 auth_method 0 2024-09-12T17:38:04.709 INFO:tasks.workunit.client.0.smithi037.stderr: -98> 2024-09-12T17:38:04.400+0000 7ff03b193640 10 monclient: get_auth_request con 0x7ff030075bb0 auth_method 0 2024-09-12T17:38:04.709 INFO:tasks.workunit.client.0.smithi037.stderr: -97> 2024-09-12T17:38:04.403+0000 7ff03a992640 10 monclient: get_auth_request con 0x7ff030093b90 auth_method 0 2024-09-12T17:38:04.709 INFO:tasks.workunit.client.0.smithi037.stderr: -96> 2024-09-12T17:38:04.403+0000 7ff03a992640 0 -- 172.21.15.37:0/2555455407 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7ff030093b90 msgr2=0x7ff0300a2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:38:04.709 INFO:tasks.workunit.client.0.smithi037.stderr: -95> 2024-09-12T17:38:04.604+0000 7ff03a992640 10 monclient: get_auth_request con 0x7ff030093b90 auth_method 0 2024-09-12T17:38:04.709 INFO:tasks.workunit.client.0.smithi037.stderr: -94> 2024-09-12T17:38:04.611+0000 7ff03f20f800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:38:04.709 INFO:tasks.workunit.client.0.smithi037.stderr: -93> 2024-09-12T17:38:04.611+0000 7ff03f20f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:38:04.709 INFO:tasks.workunit.client.0.smithi037.stderr: -92> 2024-09-12T17:38:04.611+0000 7ff03f20f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:38:04.709 INFO:tasks.workunit.client.0.smithi037.stderr: -91> 2024-09-12T17:38:04.611+0000 7ff03f20f800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:38:04.710 INFO:tasks.workunit.client.0.smithi037.stderr: -90> 2024-09-12T17:38:04.611+0000 7ff03f20f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:38:04.710 INFO:tasks.workunit.client.0.smithi037.stderr: -89> 2024-09-12T17:38:04.611+0000 7ff03f20f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:38:04.710 INFO:tasks.workunit.client.0.smithi037.stderr: -88> 2024-09-12T17:38:04.611+0000 7ff03f20f800 20 rados->read ofs=0 len=0 2024-09-12T17:38:04.710 INFO:tasks.workunit.client.0.smithi037.stderr: -87> 2024-09-12T17:38:04.611+0000 7ff03f20f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:04.710 INFO:tasks.workunit.client.0.smithi037.stderr: -86> 2024-09-12T17:38:04.611+0000 7ff03f20f800 20 rados->read ofs=0 len=0 2024-09-12T17:38:04.710 INFO:tasks.workunit.client.0.smithi037.stderr: -85> 2024-09-12T17:38:04.612+0000 7ff03f20f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:38:04.710 INFO:tasks.workunit.client.0.smithi037.stderr: -84> 2024-09-12T17:38:04.612+0000 7ff03f20f800 20 rados->read ofs=0 len=0 2024-09-12T17:38:04.710 INFO:tasks.workunit.client.0.smithi037.stderr: -83> 2024-09-12T17:38:04.612+0000 7ff03f20f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:38:04.710 INFO:tasks.workunit.client.0.smithi037.stderr: -82> 2024-09-12T17:38:04.612+0000 7ff03f20f800 20 zone default found 2024-09-12T17:38:04.710 INFO:tasks.workunit.client.0.smithi037.stderr: -81> 2024-09-12T17:38:04.612+0000 7ff03f20f800 4 Realm: () 2024-09-12T17:38:04.710 INFO:tasks.workunit.client.0.smithi037.stderr: -80> 2024-09-12T17:38:04.612+0000 7ff03f20f800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:38:04.710 INFO:tasks.workunit.client.0.smithi037.stderr: -79> 2024-09-12T17:38:04.612+0000 7ff03f20f800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:38:04.710 INFO:tasks.workunit.client.0.smithi037.stderr: -78> 2024-09-12T17:38:04.612+0000 7ff03f20f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:38:04.710 INFO:tasks.workunit.client.0.smithi037.stderr: -77> 2024-09-12T17:38:04.612+0000 7ff03f20f800 20 zonegroup default 2024-09-12T17:38:04.711 INFO:tasks.workunit.client.0.smithi037.stderr: -76> 2024-09-12T17:38:04.612+0000 7ff03f20f800 20 rados->read ofs=0 len=0 2024-09-12T17:38:04.711 INFO:tasks.workunit.client.0.smithi037.stderr: -75> 2024-09-12T17:38:04.612+0000 7ff03f20f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:04.711 INFO:tasks.workunit.client.0.smithi037.stderr: -74> 2024-09-12T17:38:04.612+0000 7ff03f20f800 20 rados->read ofs=0 len=0 2024-09-12T17:38:04.711 INFO:tasks.workunit.client.0.smithi037.stderr: -73> 2024-09-12T17:38:04.613+0000 7ff03f20f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:04.711 INFO:tasks.workunit.client.0.smithi037.stderr: -72> 2024-09-12T17:38:04.613+0000 7ff03f20f800 20 rados->read ofs=0 len=0 2024-09-12T17:38:04.711 INFO:tasks.workunit.client.0.smithi037.stderr: -71> 2024-09-12T17:38:04.613+0000 7ff03f20f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:04.711 INFO:tasks.workunit.client.0.smithi037.stderr: -70> 2024-09-12T17:38:04.613+0000 7ff03f20f800 20 started sync module instance, tier type = 2024-09-12T17:38:04.711 INFO:tasks.workunit.client.0.smithi037.stderr: -69> 2024-09-12T17:38:04.613+0000 7ff03f20f800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:38:04.711 INFO:tasks.workunit.client.0.smithi037.stderr: -68> 2024-09-12T17:38:04.624+0000 7ff03f20f800 20 add_watcher() i=0 2024-09-12T17:38:04.711 INFO:tasks.workunit.client.0.smithi037.stderr: -67> 2024-09-12T17:38:04.624+0000 7ff03f20f800 20 add_watcher() i=1 2024-09-12T17:38:04.711 INFO:tasks.workunit.client.0.smithi037.stderr: -66> 2024-09-12T17:38:04.624+0000 7ff03f20f800 20 add_watcher() i=2 2024-09-12T17:38:04.711 INFO:tasks.workunit.client.0.smithi037.stderr: -65> 2024-09-12T17:38:04.624+0000 7ff03f20f800 20 add_watcher() i=3 2024-09-12T17:38:04.711 INFO:tasks.workunit.client.0.smithi037.stderr: -64> 2024-09-12T17:38:04.624+0000 7ff03f20f800 20 add_watcher() i=4 2024-09-12T17:38:04.711 INFO:tasks.workunit.client.0.smithi037.stderr: -63> 2024-09-12T17:38:04.624+0000 7ff03f20f800 20 add_watcher() i=5 2024-09-12T17:38:04.712 INFO:tasks.workunit.client.0.smithi037.stderr: -62> 2024-09-12T17:38:04.624+0000 7ff03f20f800 20 add_watcher() i=6 2024-09-12T17:38:04.712 INFO:tasks.workunit.client.0.smithi037.stderr: -61> 2024-09-12T17:38:04.626+0000 7ff03f20f800 20 add_watcher() i=7 2024-09-12T17:38:04.712 INFO:tasks.workunit.client.0.smithi037.stderr: -60> 2024-09-12T17:38:04.626+0000 7ff03f20f800 2 all 8 watchers are set, enabling cache 2024-09-12T17:38:04.712 INFO:tasks.workunit.client.0.smithi037.stderr: -59> 2024-09-12T17:38:04.628+0000 7ff03f20f800 5 AuthRegistry(0x7ffcf2278540) adding auth protocol: cephx 2024-09-12T17:38:04.712 INFO:tasks.workunit.client.0.smithi037.stderr: -58> 2024-09-12T17:38:04.628+0000 7ff03f20f800 5 AuthRegistry(0x7ffcf2278540) adding auth protocol: cephx 2024-09-12T17:38:04.712 INFO:tasks.workunit.client.0.smithi037.stderr: -57> 2024-09-12T17:38:04.628+0000 7ff03f20f800 5 AuthRegistry(0x7ffcf2278540) adding auth protocol: cephx 2024-09-12T17:38:04.712 INFO:tasks.workunit.client.0.smithi037.stderr: -56> 2024-09-12T17:38:04.628+0000 7ff03f20f800 5 AuthRegistry(0x7ffcf2278540) adding con mode: secure 2024-09-12T17:38:04.712 INFO:tasks.workunit.client.0.smithi037.stderr: -55> 2024-09-12T17:38:04.628+0000 7ff03f20f800 5 AuthRegistry(0x7ffcf2278540) adding con mode: crc 2024-09-12T17:38:04.712 INFO:tasks.workunit.client.0.smithi037.stderr: -54> 2024-09-12T17:38:04.628+0000 7ff03f20f800 5 AuthRegistry(0x7ffcf2278540) adding con mode: secure 2024-09-12T17:38:04.712 INFO:tasks.workunit.client.0.smithi037.stderr: -53> 2024-09-12T17:38:04.628+0000 7ff03f20f800 5 AuthRegistry(0x7ffcf2278540) adding con mode: crc 2024-09-12T17:38:04.712 INFO:tasks.workunit.client.0.smithi037.stderr: -52> 2024-09-12T17:38:04.628+0000 7ff03f20f800 5 AuthRegistry(0x7ffcf2278540) adding con mode: secure 2024-09-12T17:38:04.712 INFO:tasks.workunit.client.0.smithi037.stderr: -51> 2024-09-12T17:38:04.628+0000 7ff03f20f800 5 AuthRegistry(0x7ffcf2278540) adding con mode: crc 2024-09-12T17:38:04.712 INFO:tasks.workunit.client.0.smithi037.stderr: -50> 2024-09-12T17:38:04.628+0000 7ff03f20f800 5 AuthRegistry(0x7ffcf2278540) adding con mode: crc 2024-09-12T17:38:04.713 INFO:tasks.workunit.client.0.smithi037.stderr: -49> 2024-09-12T17:38:04.628+0000 7ff03f20f800 5 AuthRegistry(0x7ffcf2278540) adding con mode: secure 2024-09-12T17:38:04.713 INFO:tasks.workunit.client.0.smithi037.stderr: -48> 2024-09-12T17:38:04.628+0000 7ff03f20f800 5 AuthRegistry(0x7ffcf2278540) adding con mode: crc 2024-09-12T17:38:04.713 INFO:tasks.workunit.client.0.smithi037.stderr: -47> 2024-09-12T17:38:04.628+0000 7ff03f20f800 5 AuthRegistry(0x7ffcf2278540) adding con mode: secure 2024-09-12T17:38:04.713 INFO:tasks.workunit.client.0.smithi037.stderr: -46> 2024-09-12T17:38:04.628+0000 7ff03f20f800 5 AuthRegistry(0x7ffcf2278540) adding con mode: crc 2024-09-12T17:38:04.713 INFO:tasks.workunit.client.0.smithi037.stderr: -45> 2024-09-12T17:38:04.628+0000 7ff03f20f800 5 AuthRegistry(0x7ffcf2278540) adding con mode: secure 2024-09-12T17:38:04.713 INFO:tasks.workunit.client.0.smithi037.stderr: -44> 2024-09-12T17:38:04.628+0000 7feef17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:38:04.713 INFO:tasks.workunit.client.0.smithi037.stderr: -43> 2024-09-12T17:38:04.628+0000 7ff03f20f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:38:04.713 INFO:tasks.workunit.client.0.smithi037.stderr: -42> 2024-09-12T17:38:04.628+0000 7ff03f20f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:38:04.713 INFO:tasks.workunit.client.0.smithi037.stderr: -41> 2024-09-12T17:38:04.628+0000 7ff03f20f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:38:04.713 INFO:tasks.workunit.client.0.smithi037.stderr: -40> 2024-09-12T17:38:04.628+0000 7ff03f20f800 5 asok(0x55e258655730) register_command cache list hook 0x55e258916990 2024-09-12T17:38:04.713 INFO:tasks.workunit.client.0.smithi037.stderr: -39> 2024-09-12T17:38:04.628+0000 7ff03f20f800 5 asok(0x55e258655730) register_command cache inspect hook 0x55e258916990 2024-09-12T17:38:04.713 INFO:tasks.workunit.client.0.smithi037.stderr: -38> 2024-09-12T17:38:04.628+0000 7ff03f20f800 5 asok(0x55e258655730) register_command cache erase hook 0x55e258916990 2024-09-12T17:38:04.713 INFO:tasks.workunit.client.0.smithi037.stderr: -37> 2024-09-12T17:38:04.628+0000 7ff03f20f800 5 asok(0x55e258655730) register_command cache zap hook 0x55e258916990 2024-09-12T17:38:04.713 INFO:tasks.workunit.client.0.smithi037.stderr: -36> 2024-09-12T17:38:04.629+0000 7ff03f20f800 5 note: GC not initialized 2024-09-12T17:38:04.714 INFO:tasks.workunit.client.0.smithi037.stderr: -35> 2024-09-12T17:38:04.629+0000 7fee6bfff640 20 reqs_thread_entry: start 2024-09-12T17:38:04.714 INFO:tasks.workunit.client.0.smithi037.stderr: -34> 2024-09-12T17:38:04.629+0000 7ff03f20f800 5 asok(0x55e258655730) register_command sync trace show hook 0x7ff02c0043a0 2024-09-12T17:38:04.714 INFO:tasks.workunit.client.0.smithi037.stderr: -33> 2024-09-12T17:38:04.629+0000 7ff03f20f800 5 asok(0x55e258655730) register_command sync trace history hook 0x7ff02c0043a0 2024-09-12T17:38:04.714 INFO:tasks.workunit.client.0.smithi037.stderr: -32> 2024-09-12T17:38:04.629+0000 7ff03f20f800 5 asok(0x55e258655730) register_command sync trace active hook 0x7ff02c0043a0 2024-09-12T17:38:04.714 INFO:tasks.workunit.client.0.smithi037.stderr: -31> 2024-09-12T17:38:04.629+0000 7ff03f20f800 5 asok(0x55e258655730) register_command sync trace active_short hook 0x7ff02c0043a0 2024-09-12T17:38:04.714 INFO:tasks.workunit.client.0.smithi037.stderr: -30> 2024-09-12T17:38:04.629+0000 7ff03f20f800 20 init_complete bucket index max shards: 11 2024-09-12T17:38:04.714 INFO:tasks.workunit.client.0.smithi037.stderr: -29> 2024-09-12T17:38:04.629+0000 7ff03f20f800 20 Filter name: none 2024-09-12T17:38:04.714 INFO:tasks.workunit.client.0.smithi037.stderr: -28> 2024-09-12T17:38:04.629+0000 7fee69ffb640 20 reqs_thread_entry: start 2024-09-12T17:38:04.714 INFO:tasks.workunit.client.0.smithi037.stderr: -27> 2024-09-12T17:38:04.629+0000 7ff03f20f800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:38:04.714 INFO:tasks.workunit.client.0.smithi037.stderr: -26> 2024-09-12T17:38:04.629+0000 7ff03f20f800 20 rados->read ofs=0 len=0 2024-09-12T17:38:04.714 INFO:tasks.workunit.client.0.smithi037.stderr: -25> 2024-09-12T17:38:04.630+0000 7ff03f20f800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:38:04.714 INFO:tasks.workunit.client.0.smithi037.stderr: -24> 2024-09-12T17:38:04.630+0000 7ff03f20f800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:38:04.714 INFO:tasks.workunit.client.0.smithi037.stderr: -23> 2024-09-12T17:38:04.630+0000 7ff03f20f800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:38:04.714 INFO:tasks.workunit.client.0.smithi037.stderr: -22> 2024-09-12T17:38:04.630+0000 7ff03f20f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 : miss 2024-09-12T17:38:04.715 INFO:tasks.workunit.client.0.smithi037.stderr: -21> 2024-09-12T17:38:04.630+0000 7ff03f20f800 20 rados->read ofs=0 len=0 2024-09-12T17:38:04.715 INFO:tasks.workunit.client.0.smithi037.stderr: -20> 2024-09-12T17:38:04.630+0000 7ff03f20f800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T17:38:04.715 INFO:tasks.workunit.client.0.smithi037.stderr: -19> 2024-09-12T17:38:04.630+0000 7ff03f20f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 info.flags=0x17 2024-09-12T17:38:04.715 INFO:tasks.workunit.client.0.smithi037.stderr: -18> 2024-09-12T17:38:04.630+0000 7ff03f20f800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 to cache LRU end 2024-09-12T17:38:04.715 INFO:tasks.workunit.client.0.smithi037.stderr: -17> 2024-09-12T17:38:04.630+0000 7ff03f20f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:38:04.715 INFO:tasks.workunit.client.0.smithi037.stderr: -16> 2024-09-12T17:38:04.630+0000 7ff03f20f800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:38:04.715 INFO:tasks.workunit.client.0.smithi037.stderr: -15> 2024-09-12T17:38:04.630+0000 7ff03f20f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 2024-09-12T17:38:04.715 INFO:tasks.workunit.client.0.smithi037.stderr: -14> 2024-09-12T17:38:04.632+0000 7ff03f20f800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T17:38:04.715 INFO:tasks.workunit.client.0.smithi037.stderr: -13> 2024-09-12T17:38:04.641+0000 7ff03f20f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 info.flags=0x17 2024-09-12T17:38:04.715 INFO:tasks.workunit.client.0.smithi037.stderr: -12> 2024-09-12T17:38:04.641+0000 7ff03f20f800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 to cache LRU end 2024-09-12T17:38:04.715 INFO:tasks.workunit.client.0.smithi037.stderr: -11> 2024-09-12T17:38:04.641+0000 7ff03f20f800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:38:04.715 INFO:tasks.workunit.client.0.smithi037.stderr: -10> 2024-09-12T17:38:04.641+0000 7ff03f20f800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18, ofs0, ns] 2024-09-12T17:38:04.715 INFO:tasks.workunit.client.0.smithi037.stderr: -9> 2024-09-12T17:38:04.641+0000 7fef1dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497020 cookie 94430637274448 notifier 7784 bl.length()=911 2024-09-12T17:38:04.715 INFO:tasks.workunit.client.0.smithi037.stderr: -8> 2024-09-12T17:38:04.641+0000 7fef1dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 info.flags=0x17 2024-09-12T17:38:04.716 INFO:tasks.workunit.client.0.smithi037.stderr: -7> 2024-09-12T17:38:04.641+0000 7fef1dffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 to cache LRU end 2024-09-12T17:38:04.716 INFO:tasks.workunit.client.0.smithi037.stderr: -6> 2024-09-12T17:38:04.641+0000 7fef1dffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:38:04.716 INFO:tasks.workunit.client.0.smithi037.stderr: -5> 2024-09-12T17:38:04.643+0000 7ff03f20f800 20 handle_bi_update(): bucket=:a-bucket[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18]): orig_sources= new_sources= 2024-09-12T17:38:04.716 INFO:tasks.workunit.client.0.smithi037.stderr: -4> 2024-09-12T17:38:04.643+0000 7ff03f20f800 20 handle_bi_update(): bucket=:a-bucket[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18]): potential sources added=[] removed=[] 2024-09-12T17:38:04.716 INFO:tasks.workunit.client.0.smithi037.stderr: -3> 2024-09-12T17:38:04.643+0000 7ff03f20f800 20 handle_bi_update(): bucket=:a-bucket[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18]): orig_dests= new_dests= 2024-09-12T17:38:04.716 INFO:tasks.workunit.client.0.smithi037.stderr: -2> 2024-09-12T17:38:04.643+0000 7ff03f20f800 20 handle_bi_update(): bucket=:a-bucket[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18]): potential dests added=[] removed=[] 2024-09-12T17:38:04.716 INFO:tasks.workunit.client.0.smithi037.stderr: -1> 2024-09-12T17:38:04.648+0000 7ff03f20f800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7ff03f20f800 time 2024-09-12T17:38:04.648240+0000 2024-09-12T17:38:04.716 INFO:tasks.workunit.client.0.smithi037.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:38:04.716 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:38:04.716 INFO:tasks.workunit.client.0.smithi037.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:38:04.716 INFO:tasks.workunit.client.0.smithi037.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7ff04038c71a] 2024-09-12T17:38:04.716 INFO:tasks.workunit.client.0.smithi037.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7ff04038c8d8] 2024-09-12T17:38:04.716 INFO:tasks.workunit.client.0.smithi037.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e2576f6841] 2024-09-12T17:38:04.717 INFO:tasks.workunit.client.0.smithi037.stderr: 4: radosgw-admin(+0xd7490c) [0x55e257c0490c] 2024-09-12T17:38:04.717 INFO:tasks.workunit.client.0.smithi037.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55e25770650d] 2024-09-12T17:38:04.717 INFO:tasks.workunit.client.0.smithi037.stderr: 6: main() 2024-09-12T17:38:04.717 INFO:tasks.workunit.client.0.smithi037.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7ff03f029590] 2024-09-12T17:38:04.717 INFO:tasks.workunit.client.0.smithi037.stderr: 8: __libc_start_main() 2024-09-12T17:38:04.717 INFO:tasks.workunit.client.0.smithi037.stderr: 9: _start() 2024-09-12T17:38:04.717 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:38:04.717 INFO:tasks.workunit.client.0.smithi037.stderr: 0> 2024-09-12T17:38:04.649+0000 7ff03f20f800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:38:04.717 INFO:tasks.workunit.client.0.smithi037.stderr: in thread 7ff03f20f800 thread_name:radosgw-admin 2024-09-12T17:38:04.717 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:38:04.717 INFO:tasks.workunit.client.0.smithi037.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:38:04.717 INFO:tasks.workunit.client.0.smithi037.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7ff03f03e6f0] 2024-09-12T17:38:04.717 INFO:tasks.workunit.client.0.smithi037.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7ff03f08b99c] 2024-09-12T17:38:04.718 INFO:tasks.workunit.client.0.smithi037.stderr: 3: raise() 2024-09-12T17:38:04.718 INFO:tasks.workunit.client.0.smithi037.stderr: 4: abort() 2024-09-12T17:38:04.718 INFO:tasks.workunit.client.0.smithi037.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7ff04038c774] 2024-09-12T17:38:04.718 INFO:tasks.workunit.client.0.smithi037.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7ff04038c8d8] 2024-09-12T17:38:04.718 INFO:tasks.workunit.client.0.smithi037.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e2576f6841] 2024-09-12T17:38:04.718 INFO:tasks.workunit.client.0.smithi037.stderr: 8: radosgw-admin(+0xd7490c) [0x55e257c0490c] 2024-09-12T17:38:04.718 INFO:tasks.workunit.client.0.smithi037.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55e25770650d] 2024-09-12T17:38:04.718 INFO:tasks.workunit.client.0.smithi037.stderr: 10: main() 2024-09-12T17:38:04.718 INFO:tasks.workunit.client.0.smithi037.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7ff03f029590] 2024-09-12T17:38:04.718 INFO:tasks.workunit.client.0.smithi037.stderr: 12: __libc_start_main() 2024-09-12T17:38:04.718 INFO:tasks.workunit.client.0.smithi037.stderr: 13: _start() 2024-09-12T17:38:04.718 INFO:tasks.workunit.client.0.smithi037.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:38:04.718 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:38:04.718 INFO:tasks.workunit.client.0.smithi037.stderr:--- logging levels --- 2024-09-12T17:38:04.718 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 none 2024-09-12T17:38:04.719 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 lockdep 2024-09-12T17:38:04.719 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 context 2024-09-12T17:38:04.719 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 1 crush 2024-09-12T17:38:04.719 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mds 2024-09-12T17:38:04.719 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mds_balancer 2024-09-12T17:38:04.719 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mds_locker 2024-09-12T17:38:04.719 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mds_log 2024-09-12T17:38:04.719 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mds_log_expire 2024-09-12T17:38:04.719 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mds_migrator 2024-09-12T17:38:04.719 INFO:tasks.workunit.client.0.smithi037.stderr: 3/ 5 mds_quiesce 2024-09-12T17:38:04.719 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 buffer 2024-09-12T17:38:04.719 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 timer 2024-09-12T17:38:04.719 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 filer 2024-09-12T17:38:04.719 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 striper 2024-09-12T17:38:04.720 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 objecter 2024-09-12T17:38:04.720 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 rados 2024-09-12T17:38:04.720 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 rbd 2024-09-12T17:38:04.720 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 rbd_mirror 2024-09-12T17:38:04.720 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 rbd_replay 2024-09-12T17:38:04.720 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 rbd_pwl 2024-09-12T17:38:04.720 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 journaler 2024-09-12T17:38:04.720 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 objectcacher 2024-09-12T17:38:04.720 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:38:04.720 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 client 2024-09-12T17:38:04.720 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 osd 2024-09-12T17:38:04.720 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 optracker 2024-09-12T17:38:04.720 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 objclass 2024-09-12T17:38:04.720 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 3 filestore 2024-09-12T17:38:04.721 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 3 journal 2024-09-12T17:38:04.721 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 0 ms 2024-09-12T17:38:04.721 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mon 2024-09-12T17:38:04.721 INFO:tasks.workunit.client.0.smithi037.stderr: 0/10 monc 2024-09-12T17:38:04.721 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 paxos 2024-09-12T17:38:04.721 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 tp 2024-09-12T17:38:04.721 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 auth 2024-09-12T17:38:04.721 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 crypto 2024-09-12T17:38:04.721 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 1 finisher 2024-09-12T17:38:04.721 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 1 reserver 2024-09-12T17:38:04.721 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 heartbeatmap 2024-09-12T17:38:04.721 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 perfcounter 2024-09-12T17:38:04.721 INFO:tasks.workunit.client.0.smithi037.stderr: 20/20 rgw 2024-09-12T17:38:04.721 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 rgw_sync 2024-09-12T17:38:04.722 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 rgw_datacache 2024-09-12T17:38:04.722 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 rgw_access 2024-09-12T17:38:04.722 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:38:04.722 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 rgw_flight 2024-09-12T17:38:04.722 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:38:04.722 INFO:tasks.workunit.client.0.smithi037.stderr: 20/20 rgw_notification 2024-09-12T17:38:04.722 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 javaclient 2024-09-12T17:38:04.722 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 asok 2024-09-12T17:38:04.722 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 1 throttle 2024-09-12T17:38:04.722 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 0 refs 2024-09-12T17:38:04.723 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 compressor 2024-09-12T17:38:04.723 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 bluestore 2024-09-12T17:38:04.723 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 bluefs 2024-09-12T17:38:04.723 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 3 bdev 2024-09-12T17:38:04.723 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 kstore 2024-09-12T17:38:04.723 INFO:tasks.workunit.client.0.smithi037.stderr: 4/ 5 rocksdb 2024-09-12T17:38:04.723 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 fuse 2024-09-12T17:38:04.723 INFO:tasks.workunit.client.0.smithi037.stderr: 2/ 5 mgr 2024-09-12T17:38:04.723 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mgrc 2024-09-12T17:38:04.723 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 dpdk 2024-09-12T17:38:04.723 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 eventtrace 2024-09-12T17:38:04.723 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 prioritycache 2024-09-12T17:38:04.723 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 test 2024-09-12T17:38:04.724 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:38:04.724 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 cephsqlite 2024-09-12T17:38:04.724 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:38:04.724 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore 2024-09-12T17:38:04.724 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_onode 2024-09-12T17:38:04.724 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_odata 2024-09-12T17:38:04.724 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_omap 2024-09-12T17:38:04.724 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_tm 2024-09-12T17:38:04.724 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_t 2024-09-12T17:38:04.724 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:38:04.724 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_epm 2024-09-12T17:38:04.724 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_lba 2024-09-12T17:38:04.724 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:38:04.724 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_cache 2024-09-12T17:38:04.725 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_journal 2024-09-12T17:38:04.725 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_device 2024-09-12T17:38:04.725 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_backref 2024-09-12T17:38:04.725 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 alienstore 2024-09-12T17:38:04.725 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mclock 2024-09-12T17:38:04.725 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 cyanstore 2024-09-12T17:38:04.725 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 ceph_exporter 2024-09-12T17:38:04.725 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 memstore 2024-09-12T17:38:04.725 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 trace 2024-09-12T17:38:04.725 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 ceph_dedup 2024-09-12T17:38:04.725 INFO:tasks.workunit.client.0.smithi037.stderr: -2/-2 (syslog threshold) 2024-09-12T17:38:04.725 INFO:tasks.workunit.client.0.smithi037.stderr: 99/99 (stderr threshold) 2024-09-12T17:38:04.725 INFO:tasks.workunit.client.0.smithi037.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:38:04.725 INFO:tasks.workunit.client.0.smithi037.stderr: 7fee69ffb640 / http_manager 2024-09-12T17:38:04.726 INFO:tasks.workunit.client.0.smithi037.stderr: 7fee6bfff640 / http_manager 2024-09-12T17:38:04.726 INFO:tasks.workunit.client.0.smithi037.stderr: 7feef17e2640 / rgw_dt_lg_renew 2024-09-12T17:38:04.726 INFO:tasks.workunit.client.0.smithi037.stderr: 7fef1cff9640 / ms_dispatch 2024-09-12T17:38:04.726 INFO:tasks.workunit.client.0.smithi037.stderr: 7fef1dffb640 / io_context_pool 2024-09-12T17:38:04.726 INFO:tasks.workunit.client.0.smithi037.stderr: 7fef1e7fc640 / io_context_pool 2024-09-12T17:38:04.726 INFO:tasks.workunit.client.0.smithi037.stderr: 7fef24e01640 / ms_dispatch 2024-09-12T17:38:04.726 INFO:tasks.workunit.client.0.smithi037.stderr: 7fef27606640 / ms_dispatch 2024-09-12T17:38:04.726 INFO:tasks.workunit.client.0.smithi037.stderr: 7fef28e09640 / io_context_pool 2024-09-12T17:38:04.726 INFO:tasks.workunit.client.0.smithi037.stderr: 7ff03a191640 / msgr-worker-2 2024-09-12T17:38:04.726 INFO:tasks.workunit.client.0.smithi037.stderr: 7ff03a992640 / msgr-worker-1 2024-09-12T17:38:04.726 INFO:tasks.workunit.client.0.smithi037.stderr: 7ff03b193640 / msgr-worker-0 2024-09-12T17:38:04.726 INFO:tasks.workunit.client.0.smithi037.stderr: 7ff03b994640 / io_context_pool 2024-09-12T17:38:04.726 INFO:tasks.workunit.client.0.smithi037.stderr: 7ff03f20f800 / radosgw-admin 2024-09-12T17:38:04.726 INFO:tasks.workunit.client.0.smithi037.stderr: max_recent 500 2024-09-12T17:38:04.727 INFO:tasks.workunit.client.0.smithi037.stderr: max_new 1000 2024-09-12T17:38:04.727 INFO:tasks.workunit.client.0.smithi037.stderr: log_file /var/log/ceph/ceph-client.admin.152627.log 2024-09-12T17:38:04.727 INFO:tasks.workunit.client.0.smithi037.stderr:--- end dump of recent events --- 2024-09-12T17:38:04.727 INFO:tasks.workunit.client.0.smithi037.stderr:--- begin dump of recent events --- 2024-09-12T17:38:04.727 INFO:tasks.workunit.client.0.smithi037.stderr: -499> 2024-09-12T17:38:04.169+0000 7fef28e09640 10 monclient: handle_config config(0 keys) 2024-09-12T17:38:04.727 INFO:tasks.workunit.client.0.smithi037.stderr: -498> 2024-09-12T17:38:04.169+0000 7ff03f20f800 10 monclient: get_monmap_and_config success 2024-09-12T17:38:04.727 INFO:tasks.workunit.client.0.smithi037.stderr: -497> 2024-09-12T17:38:04.169+0000 7ff03f20f800 4 set_mon_vals no callback set 2024-09-12T17:38:04.727 INFO:tasks.workunit.client.0.smithi037.stderr: -496> 2024-09-12T17:38:04.169+0000 7fef28e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:38:04.727 INFO:tasks.workunit.client.0.smithi037.stderr: -495> 2024-09-12T17:38:04.169+0000 7fef28e09640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:38:04.727 INFO:tasks.workunit.client.0.smithi037.stderr: -494> 2024-09-12T17:38:04.169+0000 7fef28e09640 10 monclient: dump: 2024-09-12T17:38:04.727 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:38:04.727 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:38:04.727 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:38:04.728 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:38:04.728 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:38:04.728 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:38:04.728 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:38:04.728 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:38:04.728 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:38:04.728 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:38:04.728 INFO:tasks.workunit.client.0.smithi037.stderr: -493> 2024-09-12T17:38:04.170+0000 7ff03f20f800 10 monclient: shutdown 2024-09-12T17:38:04.728 INFO:tasks.workunit.client.0.smithi037.stderr: -492> 2024-09-12T17:38:04.170+0000 7ff03f20f800 5 asok(0x55e258655730) unregister_commands rotate-key 2024-09-12T17:38:04.728 INFO:tasks.workunit.client.0.smithi037.stderr: -491> 2024-09-12T17:38:04.170+0000 7ff03f20f800 10 monclient: build_initial_monmap 2024-09-12T17:38:04.728 INFO:tasks.workunit.client.0.smithi037.stderr: -490> 2024-09-12T17:38:04.170+0000 7ff03f20f800 1 build_initial for_mkfs: 0 2024-09-12T17:38:04.728 INFO:tasks.workunit.client.0.smithi037.stderr: -489> 2024-09-12T17:38:04.170+0000 7ff03f20f800 10 monclient: monmap: 2024-09-12T17:38:04.728 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 0 2024-09-12T17:38:04.729 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:38:04.729 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 0.000000 2024-09-12T17:38:04.729 INFO:tasks.workunit.client.0.smithi037.stderr:created 0.000000 2024-09-12T17:38:04.729 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 0 (unknown) 2024-09-12T17:38:04.729 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:38:04.729 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.noname-a 2024-09-12T17:38:04.729 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.noname-b 2024-09-12T17:38:04.729 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.noname-c 2024-09-12T17:38:04.729 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:38:04.729 INFO:tasks.workunit.client.0.smithi037.stderr: -488> 2024-09-12T17:38:04.170+0000 7ff03f20f800 5 AuthRegistry(0x55e25887d870) adding auth protocol: cephx 2024-09-12T17:38:04.729 INFO:tasks.workunit.client.0.smithi037.stderr: -487> 2024-09-12T17:38:04.170+0000 7ff03f20f800 5 AuthRegistry(0x55e25887d870) adding auth protocol: cephx 2024-09-12T17:38:04.729 INFO:tasks.workunit.client.0.smithi037.stderr: -486> 2024-09-12T17:38:04.170+0000 7ff03f20f800 5 AuthRegistry(0x55e25887d870) adding auth protocol: cephx 2024-09-12T17:38:04.729 INFO:tasks.workunit.client.0.smithi037.stderr: -485> 2024-09-12T17:38:04.170+0000 7ff03f20f800 5 AuthRegistry(0x55e25887d870) adding con mode: secure 2024-09-12T17:38:04.730 INFO:tasks.workunit.client.0.smithi037.stderr: -484> 2024-09-12T17:38:04.170+0000 7ff03f20f800 5 AuthRegistry(0x55e25887d870) adding con mode: crc 2024-09-12T17:38:04.730 INFO:tasks.workunit.client.0.smithi037.stderr: -483> 2024-09-12T17:38:04.170+0000 7ff03f20f800 5 AuthRegistry(0x55e25887d870) adding con mode: secure 2024-09-12T17:38:04.730 INFO:tasks.workunit.client.0.smithi037.stderr: -482> 2024-09-12T17:38:04.170+0000 7ff03f20f800 5 AuthRegistry(0x55e25887d870) adding con mode: crc 2024-09-12T17:38:04.730 INFO:tasks.workunit.client.0.smithi037.stderr: -481> 2024-09-12T17:38:04.170+0000 7ff03f20f800 5 AuthRegistry(0x55e25887d870) adding con mode: secure 2024-09-12T17:38:04.730 INFO:tasks.workunit.client.0.smithi037.stderr: -480> 2024-09-12T17:38:04.170+0000 7ff03f20f800 5 AuthRegistry(0x55e25887d870) adding con mode: crc 2024-09-12T17:38:04.730 INFO:tasks.workunit.client.0.smithi037.stderr: -479> 2024-09-12T17:38:04.170+0000 7ff03f20f800 5 AuthRegistry(0x55e25887d870) adding con mode: crc 2024-09-12T17:38:04.730 INFO:tasks.workunit.client.0.smithi037.stderr: -478> 2024-09-12T17:38:04.170+0000 7ff03f20f800 5 AuthRegistry(0x55e25887d870) adding con mode: secure 2024-09-12T17:38:04.730 INFO:tasks.workunit.client.0.smithi037.stderr: -477> 2024-09-12T17:38:04.170+0000 7ff03f20f800 5 AuthRegistry(0x55e25887d870) adding con mode: crc 2024-09-12T17:38:04.730 INFO:tasks.workunit.client.0.smithi037.stderr: -476> 2024-09-12T17:38:04.170+0000 7ff03f20f800 5 AuthRegistry(0x55e25887d870) adding con mode: secure 2024-09-12T17:38:04.730 INFO:tasks.workunit.client.0.smithi037.stderr: -475> 2024-09-12T17:38:04.170+0000 7ff03f20f800 5 AuthRegistry(0x55e25887d870) adding con mode: crc 2024-09-12T17:38:04.730 INFO:tasks.workunit.client.0.smithi037.stderr: -474> 2024-09-12T17:38:04.170+0000 7ff03f20f800 5 AuthRegistry(0x55e25887d870) adding con mode: secure 2024-09-12T17:38:04.730 INFO:tasks.workunit.client.0.smithi037.stderr: -473> 2024-09-12T17:38:04.170+0000 7ff03f20f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:38:04.730 INFO:tasks.workunit.client.0.smithi037.stderr: -472> 2024-09-12T17:38:04.170+0000 7ff03f20f800 1 librados: starting msgr at 2024-09-12T17:38:04.730 INFO:tasks.workunit.client.0.smithi037.stderr: -471> 2024-09-12T17:38:04.170+0000 7ff03f20f800 1 librados: starting objecter 2024-09-12T17:38:04.730 INFO:tasks.workunit.client.0.smithi037.stderr: -470> 2024-09-12T17:38:04.170+0000 7ff03f20f800 5 asok(0x55e258655730) register_command objecter_requests hook 0x55e2588a9320 2024-09-12T17:38:04.731 INFO:tasks.workunit.client.0.smithi037.stderr: -469> 2024-09-12T17:38:04.170+0000 7ff03f20f800 1 librados: setting wanted keys 2024-09-12T17:38:04.731 INFO:tasks.workunit.client.0.smithi037.stderr: -468> 2024-09-12T17:38:04.170+0000 7ff03f20f800 1 librados: calling monclient init 2024-09-12T17:38:04.731 INFO:tasks.workunit.client.0.smithi037.stderr: -467> 2024-09-12T17:38:04.170+0000 7ff03f20f800 10 monclient: init 2024-09-12T17:38:04.731 INFO:tasks.workunit.client.0.smithi037.stderr: -466> 2024-09-12T17:38:04.170+0000 7ff03f20f800 5 AuthRegistry(0x55e258878240) adding auth protocol: cephx 2024-09-12T17:38:04.731 INFO:tasks.workunit.client.0.smithi037.stderr: -465> 2024-09-12T17:38:04.170+0000 7ff03f20f800 5 AuthRegistry(0x55e258878240) adding auth protocol: cephx 2024-09-12T17:38:04.731 INFO:tasks.workunit.client.0.smithi037.stderr: -464> 2024-09-12T17:38:04.170+0000 7ff03f20f800 5 AuthRegistry(0x55e258878240) adding auth protocol: cephx 2024-09-12T17:38:04.731 INFO:tasks.workunit.client.0.smithi037.stderr: -463> 2024-09-12T17:38:04.170+0000 7ff03f20f800 5 AuthRegistry(0x55e258878240) adding con mode: secure 2024-09-12T17:38:04.731 INFO:tasks.workunit.client.0.smithi037.stderr: -462> 2024-09-12T17:38:04.170+0000 7ff03f20f800 5 AuthRegistry(0x55e258878240) adding con mode: crc 2024-09-12T17:38:04.731 INFO:tasks.workunit.client.0.smithi037.stderr: -461> 2024-09-12T17:38:04.170+0000 7ff03f20f800 5 AuthRegistry(0x55e258878240) adding con mode: secure 2024-09-12T17:38:04.731 INFO:tasks.workunit.client.0.smithi037.stderr: -460> 2024-09-12T17:38:04.170+0000 7ff03f20f800 5 AuthRegistry(0x55e258878240) adding con mode: crc 2024-09-12T17:38:04.731 INFO:tasks.workunit.client.0.smithi037.stderr: -459> 2024-09-12T17:38:04.170+0000 7ff03f20f800 5 AuthRegistry(0x55e258878240) adding con mode: secure 2024-09-12T17:38:04.731 INFO:tasks.workunit.client.0.smithi037.stderr: -458> 2024-09-12T17:38:04.170+0000 7ff03f20f800 5 AuthRegistry(0x55e258878240) adding con mode: crc 2024-09-12T17:38:04.731 INFO:tasks.workunit.client.0.smithi037.stderr: -457> 2024-09-12T17:38:04.170+0000 7ff03f20f800 5 AuthRegistry(0x55e258878240) adding con mode: crc 2024-09-12T17:38:04.731 INFO:tasks.workunit.client.0.smithi037.stderr: -456> 2024-09-12T17:38:04.170+0000 7ff03f20f800 5 AuthRegistry(0x55e258878240) adding con mode: secure 2024-09-12T17:38:04.732 INFO:tasks.workunit.client.0.smithi037.stderr: -455> 2024-09-12T17:38:04.170+0000 7ff03f20f800 5 AuthRegistry(0x55e258878240) adding con mode: crc 2024-09-12T17:38:04.732 INFO:tasks.workunit.client.0.smithi037.stderr: -454> 2024-09-12T17:38:04.170+0000 7ff03f20f800 5 AuthRegistry(0x55e258878240) adding con mode: secure 2024-09-12T17:38:04.732 INFO:tasks.workunit.client.0.smithi037.stderr: -453> 2024-09-12T17:38:04.170+0000 7ff03f20f800 5 AuthRegistry(0x55e258878240) adding con mode: crc 2024-09-12T17:38:04.732 INFO:tasks.workunit.client.0.smithi037.stderr: -452> 2024-09-12T17:38:04.170+0000 7ff03f20f800 5 AuthRegistry(0x55e258878240) adding con mode: secure 2024-09-12T17:38:04.732 INFO:tasks.workunit.client.0.smithi037.stderr: -451> 2024-09-12T17:38:04.171+0000 7ff03f20f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:38:04.732 INFO:tasks.workunit.client.0.smithi037.stderr: -450> 2024-09-12T17:38:04.171+0000 7ff03f20f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:38:04.732 INFO:tasks.workunit.client.0.smithi037.stderr: -449> 2024-09-12T17:38:04.171+0000 7ff03f20f800 5 asok(0x55e258655730) register_command rotate-key hook 0x55e258878388 2024-09-12T17:38:04.732 INFO:tasks.workunit.client.0.smithi037.stderr: -448> 2024-09-12T17:38:04.171+0000 7ff03f20f800 10 monclient: _reopen_session rank -1 2024-09-12T17:38:04.732 INFO:tasks.workunit.client.0.smithi037.stderr: -447> 2024-09-12T17:38:04.171+0000 7ff03f20f800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T17:38:04.732 INFO:tasks.workunit.client.0.smithi037.stderr: -446> 2024-09-12T17:38:04.171+0000 7ff03f20f800 10 monclient(hunting): picked mon.noname-c con 0x55e258725650 addr [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] 2024-09-12T17:38:04.732 INFO:tasks.workunit.client.0.smithi037.stderr: -445> 2024-09-12T17:38:04.171+0000 7ff03f20f800 10 monclient(hunting): picked mon.noname-b con 0x55e2587baf90 addr [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] 2024-09-12T17:38:04.732 INFO:tasks.workunit.client.0.smithi037.stderr: -444> 2024-09-12T17:38:04.171+0000 7ff03f20f800 10 monclient(hunting): picked mon.noname-a con 0x55e2587c1290 addr [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] 2024-09-12T17:38:04.732 INFO:tasks.workunit.client.0.smithi037.stderr: -443> 2024-09-12T17:38:04.171+0000 7ff03f20f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:38:04.733 INFO:tasks.workunit.client.0.smithi037.stderr: -442> 2024-09-12T17:38:04.171+0000 7ff03f20f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:38:04.733 INFO:tasks.workunit.client.0.smithi037.stderr: -441> 2024-09-12T17:38:04.171+0000 7ff03f20f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:38:04.733 INFO:tasks.workunit.client.0.smithi037.stderr: -440> 2024-09-12T17:38:04.171+0000 7ff03f20f800 10 monclient(hunting): _renew_subs 2024-09-12T17:38:04.733 INFO:tasks.workunit.client.0.smithi037.stderr: -439> 2024-09-12T17:38:04.171+0000 7ff03f20f800 10 monclient(hunting): authenticate will time out at 2471.768519s 2024-09-12T17:38:04.733 INFO:tasks.workunit.client.0.smithi037.stderr: -438> 2024-09-12T17:38:04.171+0000 7ff03a992640 10 monclient(hunting): get_auth_request con 0x55e258725650 auth_method 0 2024-09-12T17:38:04.733 INFO:tasks.workunit.client.0.smithi037.stderr: -437> 2024-09-12T17:38:04.171+0000 7ff03a992640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:38:04.733 INFO:tasks.workunit.client.0.smithi037.stderr: -436> 2024-09-12T17:38:04.171+0000 7ff03a992640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:38:04.733 INFO:tasks.workunit.client.0.smithi037.stderr: -435> 2024-09-12T17:38:04.171+0000 7ff03a992640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:38:04.733 INFO:tasks.workunit.client.0.smithi037.stderr: -434> 2024-09-12T17:38:04.171+0000 7ff03b193640 10 monclient(hunting): get_auth_request con 0x55e2587c1290 auth_method 0 2024-09-12T17:38:04.733 INFO:tasks.workunit.client.0.smithi037.stderr: -433> 2024-09-12T17:38:04.171+0000 7ff03b193640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:38:04.733 INFO:tasks.workunit.client.0.smithi037.stderr: -432> 2024-09-12T17:38:04.171+0000 7ff03b193640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:38:04.734 INFO:tasks.workunit.client.0.smithi037.stderr: -431> 2024-09-12T17:38:04.171+0000 7ff03b193640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:38:04.734 INFO:tasks.workunit.client.0.smithi037.stderr: -430> 2024-09-12T17:38:04.171+0000 7ff03a992640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:38:04.734 INFO:tasks.workunit.client.0.smithi037.stderr: -429> 2024-09-12T17:38:04.171+0000 7ff03a992640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:38:04.734 INFO:tasks.workunit.client.0.smithi037.stderr: -428> 2024-09-12T17:38:04.171+0000 7ff03a992640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:38:04.734 INFO:tasks.workunit.client.0.smithi037.stderr: -427> 2024-09-12T17:38:04.171+0000 7ff03b193640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:38:04.734 INFO:tasks.workunit.client.0.smithi037.stderr: -426> 2024-09-12T17:38:04.171+0000 7ff03b193640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:38:04.734 INFO:tasks.workunit.client.0.smithi037.stderr: -425> 2024-09-12T17:38:04.171+0000 7ff03b193640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:38:04.734 INFO:tasks.workunit.client.0.smithi037.stderr: -424> 2024-09-12T17:38:04.171+0000 7ff03a191640 10 monclient(hunting): get_auth_request con 0x55e2587baf90 auth_method 0 2024-09-12T17:38:04.734 INFO:tasks.workunit.client.0.smithi037.stderr: -423> 2024-09-12T17:38:04.171+0000 7ff03a191640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:38:04.734 INFO:tasks.workunit.client.0.smithi037.stderr: -422> 2024-09-12T17:38:04.171+0000 7ff03a191640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:38:04.734 INFO:tasks.workunit.client.0.smithi037.stderr: -421> 2024-09-12T17:38:04.171+0000 7ff03a191640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:38:04.734 INFO:tasks.workunit.client.0.smithi037.stderr: -420> 2024-09-12T17:38:04.171+0000 7ff03a992640 10 monclient(hunting): handle_auth_done global_id 7775 payload 824 2024-09-12T17:38:04.734 INFO:tasks.workunit.client.0.smithi037.stderr: -419> 2024-09-12T17:38:04.171+0000 7ff03a992640 10 monclient: _finish_hunting 0 2024-09-12T17:38:04.734 INFO:tasks.workunit.client.0.smithi037.stderr: -418> 2024-09-12T17:38:04.171+0000 7ff03a992640 1 monclient: found mon.noname-c 2024-09-12T17:38:04.734 INFO:tasks.workunit.client.0.smithi037.stderr: -417> 2024-09-12T17:38:04.171+0000 7ff03a992640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.37:3301/0 2024-09-12T17:38:04.735 INFO:tasks.workunit.client.0.smithi037.stderr: -416> 2024-09-12T17:38:04.172+0000 7fef27606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:38:04.735 INFO:tasks.workunit.client.0.smithi037.stderr: -415> 2024-09-12T17:38:04.172+0000 7fef27606640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:38:04.735 INFO:tasks.workunit.client.0.smithi037.stderr: -414> 2024-09-12T17:38:04.172+0000 7fef27606640 10 monclient: dump: 2024-09-12T17:38:04.735 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:38:04.735 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:38:04.735 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:38:04.735 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:38:04.735 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:38:04.735 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:38:04.735 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:38:04.735 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:38:04.735 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:38:04.735 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:38:04.735 INFO:tasks.workunit.client.0.smithi037.stderr: -413> 2024-09-12T17:38:04.172+0000 7fef27606640 10 monclient: _finish_auth 0 2024-09-12T17:38:04.735 INFO:tasks.workunit.client.0.smithi037.stderr: -412> 2024-09-12T17:38:04.172+0000 7fef27606640 10 monclient: _check_auth_tickets 2024-09-12T17:38:04.736 INFO:tasks.workunit.client.0.smithi037.stderr: -411> 2024-09-12T17:38:04.172+0000 7fef27606640 10 monclient: handle_config config(0 keys) 2024-09-12T17:38:04.736 INFO:tasks.workunit.client.0.smithi037.stderr: -410> 2024-09-12T17:38:04.172+0000 7fef27606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:38:04.736 INFO:tasks.workunit.client.0.smithi037.stderr: -409> 2024-09-12T17:38:04.172+0000 7fef27606640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:38:04.736 INFO:tasks.workunit.client.0.smithi037.stderr: -408> 2024-09-12T17:38:04.172+0000 7fef27606640 10 monclient: dump: 2024-09-12T17:38:04.736 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:38:04.736 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:38:04.736 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:38:04.736 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:38:04.736 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:38:04.736 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:38:04.736 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:38:04.736 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:38:04.736 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:38:04.736 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:38:04.737 INFO:tasks.workunit.client.0.smithi037.stderr: -407> 2024-09-12T17:38:04.172+0000 7ff03f20f800 5 monclient: authenticate success, global_id 7775 2024-09-12T17:38:04.737 INFO:tasks.workunit.client.0.smithi037.stderr: -406> 2024-09-12T17:38:04.172+0000 7ff03f20f800 10 monclient: _renew_subs 2024-09-12T17:38:04.737 INFO:tasks.workunit.client.0.smithi037.stderr: -405> 2024-09-12T17:38:04.172+0000 7ff03f20f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.37:3301/0 2024-09-12T17:38:04.737 INFO:tasks.workunit.client.0.smithi037.stderr: -404> 2024-09-12T17:38:04.172+0000 7fef28e09640 4 set_mon_vals no callback set 2024-09-12T17:38:04.737 INFO:tasks.workunit.client.0.smithi037.stderr: -403> 2024-09-12T17:38:04.172+0000 7ff03f20f800 10 monclient: _renew_subs 2024-09-12T17:38:04.737 INFO:tasks.workunit.client.0.smithi037.stderr: -402> 2024-09-12T17:38:04.172+0000 7ff03f20f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.37:3301/0 2024-09-12T17:38:04.737 INFO:tasks.workunit.client.0.smithi037.stderr: -401> 2024-09-12T17:38:04.172+0000 7ff03f20f800 1 librados: init done 2024-09-12T17:38:04.737 INFO:tasks.workunit.client.0.smithi037.stderr: -400> 2024-09-12T17:38:04.174+0000 7fef27606640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:38:04.737 INFO:tasks.workunit.client.0.smithi037.stderr: -399> 2024-09-12T17:38:04.174+0000 7fef27606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.40:6816/3916250676,v1:172.21.15.40:6817/3916250676] 2024-09-12T17:38:04.737 INFO:tasks.workunit.client.0.smithi037.stderr: -398> 2024-09-12T17:38:04.174+0000 7fef27606640 4 mgrc reconnect Starting new session with [v2:172.21.15.40:6816/3916250676,v1:172.21.15.40:6817/3916250676] 2024-09-12T17:38:04.737 INFO:tasks.workunit.client.0.smithi037.stderr: -397> 2024-09-12T17:38:04.174+0000 7ff03a191640 10 monclient: get_auth_request con 0x7fef20076470 auth_method 0 2024-09-12T17:38:04.737 INFO:tasks.workunit.client.0.smithi037.stderr: -396> 2024-09-12T17:38:04.175+0000 7ff03b193640 10 monclient: get_auth_request con 0x55e2588a0b10 auth_method 0 2024-09-12T17:38:04.737 INFO:tasks.workunit.client.0.smithi037.stderr: -395> 2024-09-12T17:38:04.176+0000 7ff03a992640 10 monclient: get_auth_request con 0x55e2588c3120 auth_method 0 2024-09-12T17:38:04.737 INFO:tasks.workunit.client.0.smithi037.stderr: -394> 2024-09-12T17:38:04.178+0000 7ff03a191640 10 monclient: get_auth_request con 0x55e2588c8760 auth_method 0 2024-09-12T17:38:04.738 INFO:tasks.workunit.client.0.smithi037.stderr: -393> 2024-09-12T17:38:04.178+0000 7ff03f20f800 10 monclient: build_initial_monmap 2024-09-12T17:38:04.738 INFO:tasks.workunit.client.0.smithi037.stderr: -392> 2024-09-12T17:38:04.178+0000 7ff03f20f800 1 build_initial for_mkfs: 0 2024-09-12T17:38:04.738 INFO:tasks.workunit.client.0.smithi037.stderr: -391> 2024-09-12T17:38:04.178+0000 7ff03f20f800 10 monclient: monmap: 2024-09-12T17:38:04.738 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 0 2024-09-12T17:38:04.738 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:38:04.738 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 0.000000 2024-09-12T17:38:04.738 INFO:tasks.workunit.client.0.smithi037.stderr:created 0.000000 2024-09-12T17:38:04.738 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 0 (unknown) 2024-09-12T17:38:04.738 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:38:04.738 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.noname-a 2024-09-12T17:38:04.738 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.noname-b 2024-09-12T17:38:04.738 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.noname-c 2024-09-12T17:38:04.738 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:38:04.739 INFO:tasks.workunit.client.0.smithi037.stderr: -390> 2024-09-12T17:38:04.178+0000 7ff03f20f800 5 AuthRegistry(0x55e2588cc610) adding auth protocol: cephx 2024-09-12T17:38:04.739 INFO:tasks.workunit.client.0.smithi037.stderr: -389> 2024-09-12T17:38:04.178+0000 7ff03f20f800 5 AuthRegistry(0x55e2588cc610) adding auth protocol: cephx 2024-09-12T17:38:04.739 INFO:tasks.workunit.client.0.smithi037.stderr: -388> 2024-09-12T17:38:04.178+0000 7ff03f20f800 5 AuthRegistry(0x55e2588cc610) adding auth protocol: cephx 2024-09-12T17:38:04.739 INFO:tasks.workunit.client.0.smithi037.stderr: -387> 2024-09-12T17:38:04.178+0000 7ff03f20f800 5 AuthRegistry(0x55e2588cc610) adding con mode: secure 2024-09-12T17:38:04.739 INFO:tasks.workunit.client.0.smithi037.stderr: -386> 2024-09-12T17:38:04.178+0000 7ff03f20f800 5 AuthRegistry(0x55e2588cc610) adding con mode: crc 2024-09-12T17:38:04.739 INFO:tasks.workunit.client.0.smithi037.stderr: -385> 2024-09-12T17:38:04.178+0000 7ff03f20f800 5 AuthRegistry(0x55e2588cc610) adding con mode: secure 2024-09-12T17:38:04.739 INFO:tasks.workunit.client.0.smithi037.stderr: -384> 2024-09-12T17:38:04.178+0000 7ff03f20f800 5 AuthRegistry(0x55e2588cc610) adding con mode: crc 2024-09-12T17:38:04.739 INFO:tasks.workunit.client.0.smithi037.stderr: -383> 2024-09-12T17:38:04.178+0000 7ff03f20f800 5 AuthRegistry(0x55e2588cc610) adding con mode: secure 2024-09-12T17:38:04.739 INFO:tasks.workunit.client.0.smithi037.stderr: -382> 2024-09-12T17:38:04.178+0000 7ff03f20f800 5 AuthRegistry(0x55e2588cc610) adding con mode: crc 2024-09-12T17:38:04.739 INFO:tasks.workunit.client.0.smithi037.stderr: -381> 2024-09-12T17:38:04.178+0000 7ff03f20f800 5 AuthRegistry(0x55e2588cc610) adding con mode: crc 2024-09-12T17:38:04.739 INFO:tasks.workunit.client.0.smithi037.stderr: -380> 2024-09-12T17:38:04.178+0000 7ff03f20f800 5 AuthRegistry(0x55e2588cc610) adding con mode: secure 2024-09-12T17:38:04.739 INFO:tasks.workunit.client.0.smithi037.stderr: -379> 2024-09-12T17:38:04.178+0000 7ff03f20f800 5 AuthRegistry(0x55e2588cc610) adding con mode: crc 2024-09-12T17:38:04.739 INFO:tasks.workunit.client.0.smithi037.stderr: -378> 2024-09-12T17:38:04.178+0000 7ff03f20f800 5 AuthRegistry(0x55e2588cc610) adding con mode: secure 2024-09-12T17:38:04.740 INFO:tasks.workunit.client.0.smithi037.stderr: -377> 2024-09-12T17:38:04.178+0000 7ff03f20f800 5 AuthRegistry(0x55e2588cc610) adding con mode: crc 2024-09-12T17:38:04.740 INFO:tasks.workunit.client.0.smithi037.stderr: -376> 2024-09-12T17:38:04.178+0000 7ff03f20f800 5 AuthRegistry(0x55e2588cc610) adding con mode: secure 2024-09-12T17:38:04.740 INFO:tasks.workunit.client.0.smithi037.stderr: -375> 2024-09-12T17:38:04.179+0000 7ff03f20f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:38:04.740 INFO:tasks.workunit.client.0.smithi037.stderr: -374> 2024-09-12T17:38:04.179+0000 7ff03f20f800 5 asok(0x55e258655730) register_command objecter_requests cmddesc objecter_requests hook 0x55e2588cffe0 EEXIST 2024-09-12T17:38:04.740 INFO:tasks.workunit.client.0.smithi037.stderr: -373> 2024-09-12T17:38:04.179+0000 7ff03f20f800 10 monclient: init 2024-09-12T17:38:04.740 INFO:tasks.workunit.client.0.smithi037.stderr: -372> 2024-09-12T17:38:04.179+0000 7ff03f20f800 5 AuthRegistry(0x55e2588cb5c8) adding auth protocol: cephx 2024-09-12T17:38:04.740 INFO:tasks.workunit.client.0.smithi037.stderr: -371> 2024-09-12T17:38:04.179+0000 7ff03f20f800 5 AuthRegistry(0x55e2588cb5c8) adding auth protocol: cephx 2024-09-12T17:38:04.740 INFO:tasks.workunit.client.0.smithi037.stderr: -370> 2024-09-12T17:38:04.179+0000 7ff03f20f800 5 AuthRegistry(0x55e2588cb5c8) adding auth protocol: cephx 2024-09-12T17:38:04.740 INFO:tasks.workunit.client.0.smithi037.stderr: -369> 2024-09-12T17:38:04.179+0000 7ff03f20f800 5 AuthRegistry(0x55e2588cb5c8) adding con mode: secure 2024-09-12T17:38:04.740 INFO:tasks.workunit.client.0.smithi037.stderr: -368> 2024-09-12T17:38:04.179+0000 7ff03f20f800 5 AuthRegistry(0x55e2588cb5c8) adding con mode: crc 2024-09-12T17:38:04.740 INFO:tasks.workunit.client.0.smithi037.stderr: -367> 2024-09-12T17:38:04.179+0000 7ff03f20f800 5 AuthRegistry(0x55e2588cb5c8) adding con mode: secure 2024-09-12T17:38:04.740 INFO:tasks.workunit.client.0.smithi037.stderr: -366> 2024-09-12T17:38:04.179+0000 7ff03f20f800 5 AuthRegistry(0x55e2588cb5c8) adding con mode: crc 2024-09-12T17:38:04.740 INFO:tasks.workunit.client.0.smithi037.stderr: -365> 2024-09-12T17:38:04.179+0000 7ff03f20f800 5 AuthRegistry(0x55e2588cb5c8) adding con mode: secure 2024-09-12T17:38:04.741 INFO:tasks.workunit.client.0.smithi037.stderr: -364> 2024-09-12T17:38:04.179+0000 7ff03f20f800 5 AuthRegistry(0x55e2588cb5c8) adding con mode: crc 2024-09-12T17:38:04.741 INFO:tasks.workunit.client.0.smithi037.stderr: -363> 2024-09-12T17:38:04.179+0000 7ff03f20f800 5 AuthRegistry(0x55e2588cb5c8) adding con mode: crc 2024-09-12T17:38:04.741 INFO:tasks.workunit.client.0.smithi037.stderr: -362> 2024-09-12T17:38:04.179+0000 7ff03f20f800 5 AuthRegistry(0x55e2588cb5c8) adding con mode: secure 2024-09-12T17:38:04.741 INFO:tasks.workunit.client.0.smithi037.stderr: -361> 2024-09-12T17:38:04.179+0000 7ff03f20f800 5 AuthRegistry(0x55e2588cb5c8) adding con mode: crc 2024-09-12T17:38:04.741 INFO:tasks.workunit.client.0.smithi037.stderr: -360> 2024-09-12T17:38:04.179+0000 7ff03f20f800 5 AuthRegistry(0x55e2588cb5c8) adding con mode: secure 2024-09-12T17:38:04.741 INFO:tasks.workunit.client.0.smithi037.stderr: -359> 2024-09-12T17:38:04.179+0000 7ff03f20f800 5 AuthRegistry(0x55e2588cb5c8) adding con mode: crc 2024-09-12T17:38:04.741 INFO:tasks.workunit.client.0.smithi037.stderr: -358> 2024-09-12T17:38:04.179+0000 7ff03f20f800 5 AuthRegistry(0x55e2588cb5c8) adding con mode: secure 2024-09-12T17:38:04.741 INFO:tasks.workunit.client.0.smithi037.stderr: -357> 2024-09-12T17:38:04.179+0000 7ff03f20f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:38:04.741 INFO:tasks.workunit.client.0.smithi037.stderr: -356> 2024-09-12T17:38:04.180+0000 7ff03f20f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:38:04.741 INFO:tasks.workunit.client.0.smithi037.stderr: -355> 2024-09-12T17:38:04.180+0000 7ff03f20f800 5 asok(0x55e258655730) register_command rotate-key cmddesc rotate-key hook 0x55e2588cb710 EEXIST 2024-09-12T17:38:04.741 INFO:tasks.workunit.client.0.smithi037.stderr: -354> 2024-09-12T17:38:04.180+0000 7ff03f20f800 10 monclient: _reopen_session rank -1 2024-09-12T17:38:04.741 INFO:tasks.workunit.client.0.smithi037.stderr: -353> 2024-09-12T17:38:04.180+0000 7ff03f20f800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T17:38:04.741 INFO:tasks.workunit.client.0.smithi037.stderr: -352> 2024-09-12T17:38:04.180+0000 7ff03f20f800 10 monclient(hunting): picked mon.noname-c con 0x55e2588f3cd0 addr [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] 2024-09-12T17:38:04.742 INFO:tasks.workunit.client.0.smithi037.stderr: -351> 2024-09-12T17:38:04.180+0000 7ff03f20f800 10 monclient(hunting): picked mon.noname-a con 0x55e2588f5fa0 addr [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] 2024-09-12T17:38:04.742 INFO:tasks.workunit.client.0.smithi037.stderr: -350> 2024-09-12T17:38:04.180+0000 7ff03f20f800 10 monclient(hunting): picked mon.noname-b con 0x55e2588f24a0 addr [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] 2024-09-12T17:38:04.742 INFO:tasks.workunit.client.0.smithi037.stderr: -349> 2024-09-12T17:38:04.180+0000 7ff03f20f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:38:04.742 INFO:tasks.workunit.client.0.smithi037.stderr: -348> 2024-09-12T17:38:04.180+0000 7ff03f20f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:38:04.742 INFO:tasks.workunit.client.0.smithi037.stderr: -347> 2024-09-12T17:38:04.180+0000 7ff03f20f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:38:04.742 INFO:tasks.workunit.client.0.smithi037.stderr: -346> 2024-09-12T17:38:04.180+0000 7ff03f20f800 10 monclient(hunting): _renew_subs 2024-09-12T17:38:04.742 INFO:tasks.workunit.client.0.smithi037.stderr: -345> 2024-09-12T17:38:04.180+0000 7ff03f20f800 10 monclient(hunting): authenticate will time out at 2471.777165s 2024-09-12T17:38:04.742 INFO:tasks.workunit.client.0.smithi037.stderr: -344> 2024-09-12T17:38:04.180+0000 7ff03a992640 10 monclient(hunting): get_auth_request con 0x55e2588f3cd0 auth_method 0 2024-09-12T17:38:04.742 INFO:tasks.workunit.client.0.smithi037.stderr: -343> 2024-09-12T17:38:04.180+0000 7ff03a992640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:38:04.742 INFO:tasks.workunit.client.0.smithi037.stderr: -342> 2024-09-12T17:38:04.180+0000 7ff03a992640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:38:04.742 INFO:tasks.workunit.client.0.smithi037.stderr: -341> 2024-09-12T17:38:04.180+0000 7ff03a992640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:38:04.742 INFO:tasks.workunit.client.0.smithi037.stderr: -340> 2024-09-12T17:38:04.180+0000 7ff03a191640 10 monclient(hunting): get_auth_request con 0x55e2588f5fa0 auth_method 0 2024-09-12T17:38:04.742 INFO:tasks.workunit.client.0.smithi037.stderr: -339> 2024-09-12T17:38:04.180+0000 7ff03a191640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:38:04.743 INFO:tasks.workunit.client.0.smithi037.stderr: -338> 2024-09-12T17:38:04.180+0000 7ff03a191640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:38:04.743 INFO:tasks.workunit.client.0.smithi037.stderr: -337> 2024-09-12T17:38:04.180+0000 7ff03a191640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:38:04.743 INFO:tasks.workunit.client.0.smithi037.stderr: -336> 2024-09-12T17:38:04.180+0000 7ff03a992640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:38:04.743 INFO:tasks.workunit.client.0.smithi037.stderr: -335> 2024-09-12T17:38:04.180+0000 7ff03a992640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:38:04.743 INFO:tasks.workunit.client.0.smithi037.stderr: -334> 2024-09-12T17:38:04.180+0000 7ff03a992640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:38:04.743 INFO:tasks.workunit.client.0.smithi037.stderr: -333> 2024-09-12T17:38:04.180+0000 7ff03b193640 10 monclient(hunting): get_auth_request con 0x55e2588f24a0 auth_method 0 2024-09-12T17:38:04.743 INFO:tasks.workunit.client.0.smithi037.stderr: -332> 2024-09-12T17:38:04.180+0000 7ff03b193640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:38:04.743 INFO:tasks.workunit.client.0.smithi037.stderr: -331> 2024-09-12T17:38:04.180+0000 7ff03b193640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:38:04.743 INFO:tasks.workunit.client.0.smithi037.stderr: -330> 2024-09-12T17:38:04.180+0000 7ff03b193640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:38:04.743 INFO:tasks.workunit.client.0.smithi037.stderr: -329> 2024-09-12T17:38:04.180+0000 7ff03a191640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:38:04.743 INFO:tasks.workunit.client.0.smithi037.stderr: -328> 2024-09-12T17:38:04.180+0000 7ff03a191640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:38:04.743 INFO:tasks.workunit.client.0.smithi037.stderr: -327> 2024-09-12T17:38:04.180+0000 7ff03a191640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:38:04.743 INFO:tasks.workunit.client.0.smithi037.stderr: -326> 2024-09-12T17:38:04.180+0000 7ff03b193640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:38:04.744 INFO:tasks.workunit.client.0.smithi037.stderr: -325> 2024-09-12T17:38:04.180+0000 7ff03b193640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:38:04.744 INFO:tasks.workunit.client.0.smithi037.stderr: -324> 2024-09-12T17:38:04.180+0000 7ff03b193640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:38:04.744 INFO:tasks.workunit.client.0.smithi037.stderr: -323> 2024-09-12T17:38:04.180+0000 7ff03a992640 10 monclient(hunting): handle_auth_done global_id 7778 payload 824 2024-09-12T17:38:04.744 INFO:tasks.workunit.client.0.smithi037.stderr: -322> 2024-09-12T17:38:04.180+0000 7ff03a992640 10 monclient: _finish_hunting 0 2024-09-12T17:38:04.744 INFO:tasks.workunit.client.0.smithi037.stderr: -321> 2024-09-12T17:38:04.180+0000 7ff03a992640 1 monclient: found mon.noname-c 2024-09-12T17:38:04.744 INFO:tasks.workunit.client.0.smithi037.stderr: -320> 2024-09-12T17:38:04.180+0000 7ff03a992640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.37:3301/0 2024-09-12T17:38:04.744 INFO:tasks.workunit.client.0.smithi037.stderr: -319> 2024-09-12T17:38:04.180+0000 7fef24e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:38:04.744 INFO:tasks.workunit.client.0.smithi037.stderr: -318> 2024-09-12T17:38:04.180+0000 7fef24e01640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:38:04.744 INFO:tasks.workunit.client.0.smithi037.stderr: -317> 2024-09-12T17:38:04.180+0000 7fef24e01640 10 monclient: dump: 2024-09-12T17:38:04.744 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:38:04.744 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:38:04.744 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:38:04.744 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:38:04.745 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:38:04.745 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:38:04.745 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:38:04.745 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:38:04.745 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:38:04.745 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:38:04.745 INFO:tasks.workunit.client.0.smithi037.stderr: -316> 2024-09-12T17:38:04.180+0000 7fef24e01640 10 monclient: _finish_auth 0 2024-09-12T17:38:04.745 INFO:tasks.workunit.client.0.smithi037.stderr: -315> 2024-09-12T17:38:04.180+0000 7fef24e01640 10 monclient: _check_auth_tickets 2024-09-12T17:38:04.745 INFO:tasks.workunit.client.0.smithi037.stderr: -314> 2024-09-12T17:38:04.180+0000 7fef24e01640 10 monclient: handle_config config(0 keys) 2024-09-12T17:38:04.745 INFO:tasks.workunit.client.0.smithi037.stderr: -313> 2024-09-12T17:38:04.180+0000 7fef24e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:38:04.746 INFO:tasks.workunit.client.0.smithi037.stderr: -312> 2024-09-12T17:38:04.180+0000 7fef24e01640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:38:04.746 INFO:tasks.workunit.client.0.smithi037.stderr: -311> 2024-09-12T17:38:04.180+0000 7fef24e01640 10 monclient: dump: 2024-09-12T17:38:04.746 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:38:04.746 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:38:04.746 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:38:04.746 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:38:04.746 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:38:04.746 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:38:04.746 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:38:04.746 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:38:04.746 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:38:04.746 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:38:04.747 INFO:tasks.workunit.client.0.smithi037.stderr: -310> 2024-09-12T17:38:04.180+0000 7ff03f20f800 5 monclient: authenticate success, global_id 7778 2024-09-12T17:38:04.747 INFO:tasks.workunit.client.0.smithi037.stderr: -309> 2024-09-12T17:38:04.180+0000 7ff03f20f800 10 monclient: _renew_subs 2024-09-12T17:38:04.747 INFO:tasks.workunit.client.0.smithi037.stderr: -308> 2024-09-12T17:38:04.180+0000 7ff03f20f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.37:3301/0 2024-09-12T17:38:04.747 INFO:tasks.workunit.client.0.smithi037.stderr: -307> 2024-09-12T17:38:04.180+0000 7ff03b994640 4 set_mon_vals no callback set 2024-09-12T17:38:04.747 INFO:tasks.workunit.client.0.smithi037.stderr: -306> 2024-09-12T17:38:04.181+0000 7ff03f20f800 10 monclient: _renew_subs 2024-09-12T17:38:04.747 INFO:tasks.workunit.client.0.smithi037.stderr: -305> 2024-09-12T17:38:04.181+0000 7ff03f20f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.37:3301/0 2024-09-12T17:38:04.747 INFO:tasks.workunit.client.0.smithi037.stderr: -304> 2024-09-12T17:38:04.182+0000 7fef24e01640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:38:04.747 INFO:tasks.workunit.client.0.smithi037.stderr: -303> 2024-09-12T17:38:04.182+0000 7fef24e01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.40:6816/3916250676,v1:172.21.15.40:6817/3916250676] 2024-09-12T17:38:04.747 INFO:tasks.workunit.client.0.smithi037.stderr: -302> 2024-09-12T17:38:04.182+0000 7fef24e01640 4 mgrc reconnect Starting new session with [v2:172.21.15.40:6816/3916250676,v1:172.21.15.40:6817/3916250676] 2024-09-12T17:38:04.747 INFO:tasks.workunit.client.0.smithi037.stderr: -301> 2024-09-12T17:38:04.183+0000 7ff03a191640 10 monclient: get_auth_request con 0x7fef14076380 auth_method 0 2024-09-12T17:38:04.747 INFO:tasks.workunit.client.0.smithi037.stderr: -300> 2024-09-12T17:38:04.183+0000 7ff03f20f800 10 monclient: get_monmap_and_config 2024-09-12T17:38:04.747 INFO:tasks.workunit.client.0.smithi037.stderr: -299> 2024-09-12T17:38:04.183+0000 7ff03f20f800 10 monclient: build_initial_monmap 2024-09-12T17:38:04.747 INFO:tasks.workunit.client.0.smithi037.stderr: -298> 2024-09-12T17:38:04.183+0000 7ff03f20f800 1 build_initial for_mkfs: 0 2024-09-12T17:38:04.748 INFO:tasks.workunit.client.0.smithi037.stderr: -297> 2024-09-12T17:38:04.183+0000 7ff03f20f800 10 monclient: monmap: 2024-09-12T17:38:04.748 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 0 2024-09-12T17:38:04.748 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:38:04.748 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 0.000000 2024-09-12T17:38:04.748 INFO:tasks.workunit.client.0.smithi037.stderr:created 0.000000 2024-09-12T17:38:04.748 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 0 (unknown) 2024-09-12T17:38:04.748 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:38:04.748 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.noname-a 2024-09-12T17:38:04.748 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.noname-b 2024-09-12T17:38:04.748 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.noname-c 2024-09-12T17:38:04.748 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:38:04.748 INFO:tasks.workunit.client.0.smithi037.stderr: -296> 2024-09-12T17:38:04.183+0000 7ff03f20f800 5 AuthRegistry(0x55e258913b50) adding auth protocol: cephx 2024-09-12T17:38:04.748 INFO:tasks.workunit.client.0.smithi037.stderr: -295> 2024-09-12T17:38:04.183+0000 7ff03f20f800 5 AuthRegistry(0x55e258913b50) adding auth protocol: cephx 2024-09-12T17:38:04.749 INFO:tasks.workunit.client.0.smithi037.stderr: -294> 2024-09-12T17:38:04.183+0000 7ff03f20f800 5 AuthRegistry(0x55e258913b50) adding auth protocol: cephx 2024-09-12T17:38:04.749 INFO:tasks.workunit.client.0.smithi037.stderr: -293> 2024-09-12T17:38:04.183+0000 7ff03f20f800 5 AuthRegistry(0x55e258913b50) adding con mode: secure 2024-09-12T17:38:04.749 INFO:tasks.workunit.client.0.smithi037.stderr: -292> 2024-09-12T17:38:04.183+0000 7ff03f20f800 5 AuthRegistry(0x55e258913b50) adding con mode: crc 2024-09-12T17:38:04.749 INFO:tasks.workunit.client.0.smithi037.stderr: -291> 2024-09-12T17:38:04.183+0000 7ff03f20f800 5 AuthRegistry(0x55e258913b50) adding con mode: secure 2024-09-12T17:38:04.749 INFO:tasks.workunit.client.0.smithi037.stderr: -290> 2024-09-12T17:38:04.183+0000 7ff03f20f800 5 AuthRegistry(0x55e258913b50) adding con mode: crc 2024-09-12T17:38:04.749 INFO:tasks.workunit.client.0.smithi037.stderr: -289> 2024-09-12T17:38:04.183+0000 7ff03f20f800 5 AuthRegistry(0x55e258913b50) adding con mode: secure 2024-09-12T17:38:04.749 INFO:tasks.workunit.client.0.smithi037.stderr: -288> 2024-09-12T17:38:04.183+0000 7ff03f20f800 5 AuthRegistry(0x55e258913b50) adding con mode: crc 2024-09-12T17:38:04.749 INFO:tasks.workunit.client.0.smithi037.stderr: -287> 2024-09-12T17:38:04.183+0000 7ff03f20f800 5 AuthRegistry(0x55e258913b50) adding con mode: crc 2024-09-12T17:38:04.749 INFO:tasks.workunit.client.0.smithi037.stderr: -286> 2024-09-12T17:38:04.183+0000 7ff03f20f800 5 AuthRegistry(0x55e258913b50) adding con mode: secure 2024-09-12T17:38:04.749 INFO:tasks.workunit.client.0.smithi037.stderr: -285> 2024-09-12T17:38:04.183+0000 7ff03f20f800 5 AuthRegistry(0x55e258913b50) adding con mode: crc 2024-09-12T17:38:04.749 INFO:tasks.workunit.client.0.smithi037.stderr: -284> 2024-09-12T17:38:04.183+0000 7ff03f20f800 5 AuthRegistry(0x55e258913b50) adding con mode: secure 2024-09-12T17:38:04.749 INFO:tasks.workunit.client.0.smithi037.stderr: -283> 2024-09-12T17:38:04.183+0000 7ff03f20f800 5 AuthRegistry(0x55e258913b50) adding con mode: crc 2024-09-12T17:38:04.749 INFO:tasks.workunit.client.0.smithi037.stderr: -282> 2024-09-12T17:38:04.183+0000 7ff03f20f800 5 AuthRegistry(0x55e258913b50) adding con mode: secure 2024-09-12T17:38:04.749 INFO:tasks.workunit.client.0.smithi037.stderr: -281> 2024-09-12T17:38:04.183+0000 7ff03f20f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:38:04.750 INFO:tasks.workunit.client.0.smithi037.stderr: -280> 2024-09-12T17:38:04.183+0000 7ff03f20f800 10 monclient: init 2024-09-12T17:38:04.750 INFO:tasks.workunit.client.0.smithi037.stderr: -279> 2024-09-12T17:38:04.183+0000 7ff03f20f800 5 AuthRegistry(0x7ffcf2278070) adding auth protocol: cephx 2024-09-12T17:38:04.750 INFO:tasks.workunit.client.0.smithi037.stderr: -278> 2024-09-12T17:38:04.183+0000 7ff03f20f800 5 AuthRegistry(0x7ffcf2278070) adding auth protocol: cephx 2024-09-12T17:38:04.750 INFO:tasks.workunit.client.0.smithi037.stderr: -277> 2024-09-12T17:38:04.183+0000 7ff03f20f800 5 AuthRegistry(0x7ffcf2278070) adding auth protocol: cephx 2024-09-12T17:38:04.750 INFO:tasks.workunit.client.0.smithi037.stderr: -276> 2024-09-12T17:38:04.183+0000 7ff03f20f800 5 AuthRegistry(0x7ffcf2278070) adding con mode: secure 2024-09-12T17:38:04.750 INFO:tasks.workunit.client.0.smithi037.stderr: -275> 2024-09-12T17:38:04.183+0000 7ff03f20f800 5 AuthRegistry(0x7ffcf2278070) adding con mode: crc 2024-09-12T17:38:04.750 INFO:tasks.workunit.client.0.smithi037.stderr: -274> 2024-09-12T17:38:04.183+0000 7ff03f20f800 5 AuthRegistry(0x7ffcf2278070) adding con mode: secure 2024-09-12T17:38:04.750 INFO:tasks.workunit.client.0.smithi037.stderr: -273> 2024-09-12T17:38:04.183+0000 7ff03f20f800 5 AuthRegistry(0x7ffcf2278070) adding con mode: crc 2024-09-12T17:38:04.750 INFO:tasks.workunit.client.0.smithi037.stderr: -272> 2024-09-12T17:38:04.183+0000 7ff03f20f800 5 AuthRegistry(0x7ffcf2278070) adding con mode: secure 2024-09-12T17:38:04.750 INFO:tasks.workunit.client.0.smithi037.stderr: -271> 2024-09-12T17:38:04.183+0000 7ff03f20f800 5 AuthRegistry(0x7ffcf2278070) adding con mode: crc 2024-09-12T17:38:04.750 INFO:tasks.workunit.client.0.smithi037.stderr: -270> 2024-09-12T17:38:04.183+0000 7ff03f20f800 5 AuthRegistry(0x7ffcf2278070) adding con mode: crc 2024-09-12T17:38:04.750 INFO:tasks.workunit.client.0.smithi037.stderr: -269> 2024-09-12T17:38:04.183+0000 7ff03f20f800 5 AuthRegistry(0x7ffcf2278070) adding con mode: secure 2024-09-12T17:38:04.750 INFO:tasks.workunit.client.0.smithi037.stderr: -268> 2024-09-12T17:38:04.183+0000 7ff03f20f800 5 AuthRegistry(0x7ffcf2278070) adding con mode: crc 2024-09-12T17:38:04.750 INFO:tasks.workunit.client.0.smithi037.stderr: -267> 2024-09-12T17:38:04.183+0000 7ff03f20f800 5 AuthRegistry(0x7ffcf2278070) adding con mode: secure 2024-09-12T17:38:04.751 INFO:tasks.workunit.client.0.smithi037.stderr: -266> 2024-09-12T17:38:04.183+0000 7ff03f20f800 5 AuthRegistry(0x7ffcf2278070) adding con mode: crc 2024-09-12T17:38:04.751 INFO:tasks.workunit.client.0.smithi037.stderr: -265> 2024-09-12T17:38:04.183+0000 7ff03f20f800 5 AuthRegistry(0x7ffcf2278070) adding con mode: secure 2024-09-12T17:38:04.751 INFO:tasks.workunit.client.0.smithi037.stderr: -264> 2024-09-12T17:38:04.183+0000 7ff03f20f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:38:04.751 INFO:tasks.workunit.client.0.smithi037.stderr: -263> 2024-09-12T17:38:04.183+0000 7ff03f20f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:38:04.751 INFO:tasks.workunit.client.0.smithi037.stderr: -262> 2024-09-12T17:38:04.184+0000 7ff03f20f800 5 asok(0x55e258655730) register_command rotate-key cmddesc rotate-key hook 0x7ffcf22781b8 EEXIST 2024-09-12T17:38:04.751 INFO:tasks.workunit.client.0.smithi037.stderr: -261> 2024-09-12T17:38:04.184+0000 7ff03f20f800 10 monclient: _reopen_session rank -1 2024-09-12T17:38:04.751 INFO:tasks.workunit.client.0.smithi037.stderr: -260> 2024-09-12T17:38:04.184+0000 7ff03f20f800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T17:38:04.751 INFO:tasks.workunit.client.0.smithi037.stderr: -259> 2024-09-12T17:38:04.184+0000 7ff03f20f800 10 monclient(hunting): picked mon.noname-a con 0x55e258948040 addr [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] 2024-09-12T17:38:04.751 INFO:tasks.workunit.client.0.smithi037.stderr: -258> 2024-09-12T17:38:04.184+0000 7ff03f20f800 10 monclient(hunting): picked mon.noname-b con 0x55e258918e60 addr [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] 2024-09-12T17:38:04.751 INFO:tasks.workunit.client.0.smithi037.stderr: -257> 2024-09-12T17:38:04.184+0000 7ff03f20f800 10 monclient(hunting): picked mon.noname-c con 0x55e258943470 addr [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] 2024-09-12T17:38:04.751 INFO:tasks.workunit.client.0.smithi037.stderr: -256> 2024-09-12T17:38:04.184+0000 7ff03f20f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:38:04.751 INFO:tasks.workunit.client.0.smithi037.stderr: -255> 2024-09-12T17:38:04.184+0000 7ff03f20f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:38:04.751 INFO:tasks.workunit.client.0.smithi037.stderr: -254> 2024-09-12T17:38:04.184+0000 7ff03f20f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:38:04.752 INFO:tasks.workunit.client.0.smithi037.stderr: -253> 2024-09-12T17:38:04.184+0000 7ff03f20f800 10 monclient(hunting): _renew_subs 2024-09-12T17:38:04.752 INFO:tasks.workunit.client.0.smithi037.stderr: -252> 2024-09-12T17:38:04.184+0000 7ff03f20f800 10 monclient(hunting): authenticate will time out at 2471.781135s 2024-09-12T17:38:04.752 INFO:tasks.workunit.client.0.smithi037.stderr: -251> 2024-09-12T17:38:04.184+0000 7ff03a992640 10 monclient(hunting): get_auth_request con 0x55e258948040 auth_method 0 2024-09-12T17:38:04.752 INFO:tasks.workunit.client.0.smithi037.stderr: -250> 2024-09-12T17:38:04.184+0000 7ff03a992640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:38:04.752 INFO:tasks.workunit.client.0.smithi037.stderr: -249> 2024-09-12T17:38:04.184+0000 7ff03a992640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:38:04.752 INFO:tasks.workunit.client.0.smithi037.stderr: -248> 2024-09-12T17:38:04.184+0000 7ff03a992640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:38:04.752 INFO:tasks.workunit.client.0.smithi037.stderr: -247> 2024-09-12T17:38:04.184+0000 7ff03b193640 10 monclient(hunting): get_auth_request con 0x55e258943470 auth_method 0 2024-09-12T17:38:04.752 INFO:tasks.workunit.client.0.smithi037.stderr: -246> 2024-09-12T17:38:04.184+0000 7ff03b193640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:38:04.752 INFO:tasks.workunit.client.0.smithi037.stderr: -245> 2024-09-12T17:38:04.184+0000 7ff03b193640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:38:04.752 INFO:tasks.workunit.client.0.smithi037.stderr: -244> 2024-09-12T17:38:04.184+0000 7ff03b193640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:38:04.752 INFO:tasks.workunit.client.0.smithi037.stderr: -243> 2024-09-12T17:38:04.184+0000 7ff03a992640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:38:04.753 INFO:tasks.workunit.client.0.smithi037.stderr: -242> 2024-09-12T17:38:04.184+0000 7ff03a992640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:38:04.753 INFO:tasks.workunit.client.0.smithi037.stderr: -241> 2024-09-12T17:38:04.184+0000 7ff03a992640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:38:04.753 INFO:tasks.workunit.client.0.smithi037.stderr: -240> 2024-09-12T17:38:04.184+0000 7ff03b193640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:38:04.753 INFO:tasks.workunit.client.0.smithi037.stderr: -239> 2024-09-12T17:38:04.184+0000 7ff03b193640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:38:04.753 INFO:tasks.workunit.client.0.smithi037.stderr: -238> 2024-09-12T17:38:04.184+0000 7ff03b193640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:38:04.753 INFO:tasks.workunit.client.0.smithi037.stderr: -237> 2024-09-12T17:38:04.184+0000 7ff03a992640 10 monclient(hunting): handle_auth_done global_id 8337 payload 274 2024-09-12T17:38:04.753 INFO:tasks.workunit.client.0.smithi037.stderr: -236> 2024-09-12T17:38:04.184+0000 7ff03a992640 10 monclient: _finish_hunting 0 2024-09-12T17:38:04.753 INFO:tasks.workunit.client.0.smithi037.stderr: -235> 2024-09-12T17:38:04.184+0000 7ff03a992640 1 monclient: found mon.noname-a 2024-09-12T17:38:04.753 INFO:tasks.workunit.client.0.smithi037.stderr: -234> 2024-09-12T17:38:04.184+0000 7ff03a992640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.37:3300/0 2024-09-12T17:38:04.753 INFO:tasks.workunit.client.0.smithi037.stderr: -233> 2024-09-12T17:38:04.184+0000 7ff03a191640 10 monclient: get_auth_request con 0x55e258918e60 auth_method 0 2024-09-12T17:38:04.753 INFO:tasks.workunit.client.0.smithi037.stderr: -232> 2024-09-12T17:38:04.184+0000 7fef1e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:38:04.753 INFO:tasks.workunit.client.0.smithi037.stderr: -231> 2024-09-12T17:38:04.184+0000 7fef1e7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:38:04.753 INFO:tasks.workunit.client.0.smithi037.stderr: -230> 2024-09-12T17:38:04.184+0000 7fef1e7fc640 10 monclient: dump: 2024-09-12T17:38:04.753 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:38:04.754 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:38:04.754 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:38:04.754 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:38:04.754 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:38:04.754 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:38:04.754 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:38:04.754 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:38:04.754 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:38:04.754 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:38:04.754 INFO:tasks.workunit.client.0.smithi037.stderr: -229> 2024-09-12T17:38:04.184+0000 7fef1e7fc640 10 monclient: _finish_auth 0 2024-09-12T17:38:04.754 INFO:tasks.workunit.client.0.smithi037.stderr: -228> 2024-09-12T17:38:04.184+0000 7fef1e7fc640 10 monclient: _check_auth_tickets 2024-09-12T17:38:04.754 INFO:tasks.workunit.client.0.smithi037.stderr: -227> 2024-09-12T17:38:04.184+0000 7fef1e7fc640 10 monclient: handle_config config(0 keys) 2024-09-12T17:38:04.754 INFO:tasks.workunit.client.0.smithi037.stderr: -226> 2024-09-12T17:38:04.184+0000 7fef1e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:38:04.755 INFO:tasks.workunit.client.0.smithi037.stderr: -225> 2024-09-12T17:38:04.184+0000 7fef1e7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:38:04.755 INFO:tasks.workunit.client.0.smithi037.stderr: -224> 2024-09-12T17:38:04.184+0000 7fef1e7fc640 10 monclient: dump: 2024-09-12T17:38:04.755 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:38:04.755 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:38:04.755 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:38:04.755 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:38:04.755 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:38:04.755 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:38:04.755 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:38:04.755 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:38:04.755 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:38:04.755 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:38:04.756 INFO:tasks.workunit.client.0.smithi037.stderr: -223> 2024-09-12T17:38:04.184+0000 7ff03f20f800 5 monclient: authenticate success, global_id 8337 2024-09-12T17:38:04.756 INFO:tasks.workunit.client.0.smithi037.stderr: -222> 2024-09-12T17:38:04.184+0000 7ff03f20f800 10 monclient: get_monmap_and_config success 2024-09-12T17:38:04.756 INFO:tasks.workunit.client.0.smithi037.stderr: -221> 2024-09-12T17:38:04.184+0000 7ff03f20f800 4 set_mon_vals no callback set 2024-09-12T17:38:04.756 INFO:tasks.workunit.client.0.smithi037.stderr: -220> 2024-09-12T17:38:04.185+0000 7ff03f20f800 10 monclient: shutdown 2024-09-12T17:38:04.756 INFO:tasks.workunit.client.0.smithi037.stderr: -219> 2024-09-12T17:38:04.185+0000 7ff03f20f800 10 monclient: build_initial_monmap 2024-09-12T17:38:04.756 INFO:tasks.workunit.client.0.smithi037.stderr: -218> 2024-09-12T17:38:04.185+0000 7ff03f20f800 1 build_initial for_mkfs: 0 2024-09-12T17:38:04.756 INFO:tasks.workunit.client.0.smithi037.stderr: -217> 2024-09-12T17:38:04.185+0000 7ff03f20f800 10 monclient: monmap: 2024-09-12T17:38:04.756 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 0 2024-09-12T17:38:04.756 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:38:04.756 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 0.000000 2024-09-12T17:38:04.756 INFO:tasks.workunit.client.0.smithi037.stderr:created 0.000000 2024-09-12T17:38:04.756 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 0 (unknown) 2024-09-12T17:38:04.756 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:38:04.757 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.noname-a 2024-09-12T17:38:04.757 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.noname-b 2024-09-12T17:38:04.757 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.noname-c 2024-09-12T17:38:04.757 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:38:04.757 INFO:tasks.workunit.client.0.smithi037.stderr: -216> 2024-09-12T17:38:04.185+0000 7ff03f20f800 5 AuthRegistry(0x55e258944270) adding auth protocol: cephx 2024-09-12T17:38:04.757 INFO:tasks.workunit.client.0.smithi037.stderr: -215> 2024-09-12T17:38:04.185+0000 7ff03f20f800 5 AuthRegistry(0x55e258944270) adding auth protocol: cephx 2024-09-12T17:38:04.757 INFO:tasks.workunit.client.0.smithi037.stderr: -214> 2024-09-12T17:38:04.185+0000 7ff03f20f800 5 AuthRegistry(0x55e258944270) adding auth protocol: cephx 2024-09-12T17:38:04.757 INFO:tasks.workunit.client.0.smithi037.stderr: -213> 2024-09-12T17:38:04.185+0000 7ff03f20f800 5 AuthRegistry(0x55e258944270) adding con mode: secure 2024-09-12T17:38:04.757 INFO:tasks.workunit.client.0.smithi037.stderr: -212> 2024-09-12T17:38:04.185+0000 7ff03f20f800 5 AuthRegistry(0x55e258944270) adding con mode: crc 2024-09-12T17:38:04.757 INFO:tasks.workunit.client.0.smithi037.stderr: -211> 2024-09-12T17:38:04.185+0000 7ff03f20f800 5 AuthRegistry(0x55e258944270) adding con mode: secure 2024-09-12T17:38:04.757 INFO:tasks.workunit.client.0.smithi037.stderr: -210> 2024-09-12T17:38:04.185+0000 7ff03f20f800 5 AuthRegistry(0x55e258944270) adding con mode: crc 2024-09-12T17:38:04.757 INFO:tasks.workunit.client.0.smithi037.stderr: -209> 2024-09-12T17:38:04.185+0000 7ff03f20f800 5 AuthRegistry(0x55e258944270) adding con mode: secure 2024-09-12T17:38:04.758 INFO:tasks.workunit.client.0.smithi037.stderr: -208> 2024-09-12T17:38:04.185+0000 7ff03f20f800 5 AuthRegistry(0x55e258944270) adding con mode: crc 2024-09-12T17:38:04.758 INFO:tasks.workunit.client.0.smithi037.stderr: -207> 2024-09-12T17:38:04.185+0000 7ff03f20f800 5 AuthRegistry(0x55e258944270) adding con mode: crc 2024-09-12T17:38:04.758 INFO:tasks.workunit.client.0.smithi037.stderr: -206> 2024-09-12T17:38:04.185+0000 7ff03f20f800 5 AuthRegistry(0x55e258944270) adding con mode: secure 2024-09-12T17:38:04.758 INFO:tasks.workunit.client.0.smithi037.stderr: -205> 2024-09-12T17:38:04.185+0000 7ff03f20f800 5 AuthRegistry(0x55e258944270) adding con mode: crc 2024-09-12T17:38:04.758 INFO:tasks.workunit.client.0.smithi037.stderr: -204> 2024-09-12T17:38:04.185+0000 7ff03f20f800 5 AuthRegistry(0x55e258944270) adding con mode: secure 2024-09-12T17:38:04.758 INFO:tasks.workunit.client.0.smithi037.stderr: -203> 2024-09-12T17:38:04.185+0000 7ff03f20f800 5 AuthRegistry(0x55e258944270) adding con mode: crc 2024-09-12T17:38:04.758 INFO:tasks.workunit.client.0.smithi037.stderr: -202> 2024-09-12T17:38:04.185+0000 7ff03f20f800 5 AuthRegistry(0x55e258944270) adding con mode: secure 2024-09-12T17:38:04.758 INFO:tasks.workunit.client.0.smithi037.stderr: -201> 2024-09-12T17:38:04.185+0000 7ff03f20f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:38:04.758 INFO:tasks.workunit.client.0.smithi037.stderr: -200> 2024-09-12T17:38:04.185+0000 7ff03f20f800 1 librados: starting msgr at 2024-09-12T17:38:04.758 INFO:tasks.workunit.client.0.smithi037.stderr: -199> 2024-09-12T17:38:04.185+0000 7ff03f20f800 1 librados: starting objecter 2024-09-12T17:38:04.758 INFO:tasks.workunit.client.0.smithi037.stderr: -198> 2024-09-12T17:38:04.185+0000 7ff03f20f800 5 asok(0x55e258655730) register_command objecter_requests cmddesc objecter_requests hook 0x55e2588b9970 EEXIST 2024-09-12T17:38:04.758 INFO:tasks.workunit.client.0.smithi037.stderr: -197> 2024-09-12T17:38:04.186+0000 7ff03f20f800 1 librados: setting wanted keys 2024-09-12T17:38:04.758 INFO:tasks.workunit.client.0.smithi037.stderr: -196> 2024-09-12T17:38:04.186+0000 7ff03f20f800 1 librados: calling monclient init 2024-09-12T17:38:04.758 INFO:tasks.workunit.client.0.smithi037.stderr: -195> 2024-09-12T17:38:04.186+0000 7ff03f20f800 10 monclient: init 2024-09-12T17:38:04.759 INFO:tasks.workunit.client.0.smithi037.stderr: -194> 2024-09-12T17:38:04.186+0000 7ff03f20f800 5 AuthRegistry(0x55e25890ba80) adding auth protocol: cephx 2024-09-12T17:38:04.759 INFO:tasks.workunit.client.0.smithi037.stderr: -193> 2024-09-12T17:38:04.186+0000 7ff03f20f800 5 AuthRegistry(0x55e25890ba80) adding auth protocol: cephx 2024-09-12T17:38:04.759 INFO:tasks.workunit.client.0.smithi037.stderr: -192> 2024-09-12T17:38:04.186+0000 7ff03f20f800 5 AuthRegistry(0x55e25890ba80) adding auth protocol: cephx 2024-09-12T17:38:04.759 INFO:tasks.workunit.client.0.smithi037.stderr: -191> 2024-09-12T17:38:04.186+0000 7ff03f20f800 5 AuthRegistry(0x55e25890ba80) adding con mode: secure 2024-09-12T17:38:04.759 INFO:tasks.workunit.client.0.smithi037.stderr: -190> 2024-09-12T17:38:04.186+0000 7ff03f20f800 5 AuthRegistry(0x55e25890ba80) adding con mode: crc 2024-09-12T17:38:04.759 INFO:tasks.workunit.client.0.smithi037.stderr: -189> 2024-09-12T17:38:04.186+0000 7ff03f20f800 5 AuthRegistry(0x55e25890ba80) adding con mode: secure 2024-09-12T17:38:04.759 INFO:tasks.workunit.client.0.smithi037.stderr: -188> 2024-09-12T17:38:04.186+0000 7ff03f20f800 5 AuthRegistry(0x55e25890ba80) adding con mode: crc 2024-09-12T17:38:04.759 INFO:tasks.workunit.client.0.smithi037.stderr: -187> 2024-09-12T17:38:04.186+0000 7ff03f20f800 5 AuthRegistry(0x55e25890ba80) adding con mode: secure 2024-09-12T17:38:04.759 INFO:tasks.workunit.client.0.smithi037.stderr: -186> 2024-09-12T17:38:04.186+0000 7ff03f20f800 5 AuthRegistry(0x55e25890ba80) adding con mode: crc 2024-09-12T17:38:04.759 INFO:tasks.workunit.client.0.smithi037.stderr: -185> 2024-09-12T17:38:04.186+0000 7ff03f20f800 5 AuthRegistry(0x55e25890ba80) adding con mode: crc 2024-09-12T17:38:04.759 INFO:tasks.workunit.client.0.smithi037.stderr: -184> 2024-09-12T17:38:04.186+0000 7ff03f20f800 5 AuthRegistry(0x55e25890ba80) adding con mode: secure 2024-09-12T17:38:04.759 INFO:tasks.workunit.client.0.smithi037.stderr: -183> 2024-09-12T17:38:04.186+0000 7ff03f20f800 5 AuthRegistry(0x55e25890ba80) adding con mode: crc 2024-09-12T17:38:04.759 INFO:tasks.workunit.client.0.smithi037.stderr: -182> 2024-09-12T17:38:04.186+0000 7ff03f20f800 5 AuthRegistry(0x55e25890ba80) adding con mode: secure 2024-09-12T17:38:04.760 INFO:tasks.workunit.client.0.smithi037.stderr: -181> 2024-09-12T17:38:04.186+0000 7ff03f20f800 5 AuthRegistry(0x55e25890ba80) adding con mode: crc 2024-09-12T17:38:04.760 INFO:tasks.workunit.client.0.smithi037.stderr: -180> 2024-09-12T17:38:04.186+0000 7ff03f20f800 5 AuthRegistry(0x55e25890ba80) adding con mode: secure 2024-09-12T17:38:04.760 INFO:tasks.workunit.client.0.smithi037.stderr: -179> 2024-09-12T17:38:04.186+0000 7ff03f20f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:38:04.760 INFO:tasks.workunit.client.0.smithi037.stderr: -178> 2024-09-12T17:38:04.186+0000 7ff03f20f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:38:04.760 INFO:tasks.workunit.client.0.smithi037.stderr: -177> 2024-09-12T17:38:04.186+0000 7ff03f20f800 5 asok(0x55e258655730) register_command rotate-key cmddesc rotate-key hook 0x55e25890bbc8 EEXIST 2024-09-12T17:38:04.760 INFO:tasks.workunit.client.0.smithi037.stderr: -176> 2024-09-12T17:38:04.186+0000 7ff03f20f800 10 monclient: _reopen_session rank -1 2024-09-12T17:38:04.760 INFO:tasks.workunit.client.0.smithi037.stderr: -175> 2024-09-12T17:38:04.186+0000 7ff03f20f800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T17:38:04.760 INFO:tasks.workunit.client.0.smithi037.stderr: -174> 2024-09-12T17:38:04.186+0000 7ff03f20f800 10 monclient(hunting): picked mon.noname-b con 0x55e258918e60 addr [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] 2024-09-12T17:38:04.760 INFO:tasks.workunit.client.0.smithi037.stderr: -173> 2024-09-12T17:38:04.186+0000 7ff03f20f800 10 monclient(hunting): picked mon.noname-c con 0x55e258943470 addr [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] 2024-09-12T17:38:04.760 INFO:tasks.workunit.client.0.smithi037.stderr: -172> 2024-09-12T17:38:04.186+0000 7ff03f20f800 10 monclient(hunting): picked mon.noname-a con 0x55e258948040 addr [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] 2024-09-12T17:38:04.760 INFO:tasks.workunit.client.0.smithi037.stderr: -171> 2024-09-12T17:38:04.186+0000 7ff03f20f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:38:04.760 INFO:tasks.workunit.client.0.smithi037.stderr: -170> 2024-09-12T17:38:04.186+0000 7ff03f20f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:38:04.760 INFO:tasks.workunit.client.0.smithi037.stderr: -169> 2024-09-12T17:38:04.186+0000 7ff03f20f800 10 monclient(hunting): start opening mon connection 2024-09-12T17:38:04.760 INFO:tasks.workunit.client.0.smithi037.stderr: -168> 2024-09-12T17:38:04.186+0000 7ff03f20f800 10 monclient(hunting): _renew_subs 2024-09-12T17:38:04.761 INFO:tasks.workunit.client.0.smithi037.stderr: -167> 2024-09-12T17:38:04.186+0000 7ff03f20f800 10 monclient(hunting): authenticate will time out at 2471.783627s 2024-09-12T17:38:04.761 INFO:tasks.workunit.client.0.smithi037.stderr: -166> 2024-09-12T17:38:04.186+0000 7ff03a191640 10 monclient(hunting): get_auth_request con 0x55e258943470 auth_method 0 2024-09-12T17:38:04.761 INFO:tasks.workunit.client.0.smithi037.stderr: -165> 2024-09-12T17:38:04.186+0000 7ff03a191640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:38:04.761 INFO:tasks.workunit.client.0.smithi037.stderr: -164> 2024-09-12T17:38:04.186+0000 7ff03a191640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:38:04.761 INFO:tasks.workunit.client.0.smithi037.stderr: -163> 2024-09-12T17:38:04.186+0000 7ff03a191640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:38:04.761 INFO:tasks.workunit.client.0.smithi037.stderr: -162> 2024-09-12T17:38:04.186+0000 7ff03b193640 10 monclient(hunting): get_auth_request con 0x55e258948040 auth_method 0 2024-09-12T17:38:04.761 INFO:tasks.workunit.client.0.smithi037.stderr: -161> 2024-09-12T17:38:04.186+0000 7ff03b193640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:38:04.761 INFO:tasks.workunit.client.0.smithi037.stderr: -160> 2024-09-12T17:38:04.186+0000 7ff03b193640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:38:04.761 INFO:tasks.workunit.client.0.smithi037.stderr: -159> 2024-09-12T17:38:04.186+0000 7ff03b193640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:38:04.761 INFO:tasks.workunit.client.0.smithi037.stderr: -158> 2024-09-12T17:38:04.186+0000 7ff03a191640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:38:04.761 INFO:tasks.workunit.client.0.smithi037.stderr: -157> 2024-09-12T17:38:04.186+0000 7ff03a191640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:38:04.761 INFO:tasks.workunit.client.0.smithi037.stderr: -156> 2024-09-12T17:38:04.186+0000 7ff03a191640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:38:04.761 INFO:tasks.workunit.client.0.smithi037.stderr: -155> 2024-09-12T17:38:04.186+0000 7ff03b193640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:38:04.762 INFO:tasks.workunit.client.0.smithi037.stderr: -154> 2024-09-12T17:38:04.186+0000 7ff03b193640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:38:04.762 INFO:tasks.workunit.client.0.smithi037.stderr: -153> 2024-09-12T17:38:04.186+0000 7ff03b193640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:38:04.762 INFO:tasks.workunit.client.0.smithi037.stderr: -152> 2024-09-12T17:38:04.186+0000 7ff03a992640 10 monclient(hunting): get_auth_request con 0x55e258918e60 auth_method 0 2024-09-12T17:38:04.762 INFO:tasks.workunit.client.0.smithi037.stderr: -151> 2024-09-12T17:38:04.186+0000 7ff03a992640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:38:04.762 INFO:tasks.workunit.client.0.smithi037.stderr: -150> 2024-09-12T17:38:04.186+0000 7ff03a992640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:38:04.762 INFO:tasks.workunit.client.0.smithi037.stderr: -149> 2024-09-12T17:38:04.186+0000 7ff03a992640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:38:04.762 INFO:tasks.workunit.client.0.smithi037.stderr: -148> 2024-09-12T17:38:04.186+0000 7ff03a191640 10 monclient(hunting): handle_auth_done global_id 7784 payload 824 2024-09-12T17:38:04.762 INFO:tasks.workunit.client.0.smithi037.stderr: -147> 2024-09-12T17:38:04.187+0000 7ff03a191640 10 monclient: _finish_hunting 0 2024-09-12T17:38:04.762 INFO:tasks.workunit.client.0.smithi037.stderr: -146> 2024-09-12T17:38:04.187+0000 7ff03a191640 1 monclient: found mon.noname-c 2024-09-12T17:38:04.762 INFO:tasks.workunit.client.0.smithi037.stderr: -145> 2024-09-12T17:38:04.187+0000 7ff03a191640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.37:3301/0 2024-09-12T17:38:04.762 INFO:tasks.workunit.client.0.smithi037.stderr: -144> 2024-09-12T17:38:04.187+0000 7fef1cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:38:04.762 INFO:tasks.workunit.client.0.smithi037.stderr: -143> 2024-09-12T17:38:04.187+0000 7fef1cff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:38:04.762 INFO:tasks.workunit.client.0.smithi037.stderr: -142> 2024-09-12T17:38:04.187+0000 7fef1cff9640 10 monclient: dump: 2024-09-12T17:38:04.762 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:38:04.763 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:38:04.763 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:38:04.763 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:38:04.763 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:38:04.763 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:38:04.763 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:38:04.763 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:38:04.763 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:38:04.763 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:38:04.763 INFO:tasks.workunit.client.0.smithi037.stderr: -141> 2024-09-12T17:38:04.187+0000 7fef1cff9640 10 monclient: _finish_auth 0 2024-09-12T17:38:04.763 INFO:tasks.workunit.client.0.smithi037.stderr: -140> 2024-09-12T17:38:04.187+0000 7fef1cff9640 10 monclient: _check_auth_tickets 2024-09-12T17:38:04.763 INFO:tasks.workunit.client.0.smithi037.stderr: -139> 2024-09-12T17:38:04.187+0000 7fef1cff9640 10 monclient: handle_config config(0 keys) 2024-09-12T17:38:04.763 INFO:tasks.workunit.client.0.smithi037.stderr: -138> 2024-09-12T17:38:04.187+0000 7fef1cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:38:04.763 INFO:tasks.workunit.client.0.smithi037.stderr: -137> 2024-09-12T17:38:04.187+0000 7fef1cff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:38:04.764 INFO:tasks.workunit.client.0.smithi037.stderr: -136> 2024-09-12T17:38:04.187+0000 7fef1cff9640 10 monclient: dump: 2024-09-12T17:38:04.764 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:38:04.764 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:38:04.764 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:38:04.764 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:38:04.764 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:38:04.764 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:38:04.764 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:38:04.764 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:38:04.764 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:38:04.764 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:38:04.764 INFO:tasks.workunit.client.0.smithi037.stderr: -135> 2024-09-12T17:38:04.187+0000 7ff03f20f800 5 monclient: authenticate success, global_id 7784 2024-09-12T17:38:04.764 INFO:tasks.workunit.client.0.smithi037.stderr: -134> 2024-09-12T17:38:04.187+0000 7ff03f20f800 10 monclient: _renew_subs 2024-09-12T17:38:04.765 INFO:tasks.workunit.client.0.smithi037.stderr: -133> 2024-09-12T17:38:04.187+0000 7fef1e7fc640 4 set_mon_vals no callback set 2024-09-12T17:38:04.765 INFO:tasks.workunit.client.0.smithi037.stderr: -132> 2024-09-12T17:38:04.187+0000 7ff03f20f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.37:3301/0 2024-09-12T17:38:04.765 INFO:tasks.workunit.client.0.smithi037.stderr: -131> 2024-09-12T17:38:04.187+0000 7ff03f20f800 10 monclient: _renew_subs 2024-09-12T17:38:04.765 INFO:tasks.workunit.client.0.smithi037.stderr: -130> 2024-09-12T17:38:04.187+0000 7ff03f20f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.37:3301/0 2024-09-12T17:38:04.765 INFO:tasks.workunit.client.0.smithi037.stderr: -129> 2024-09-12T17:38:04.187+0000 7ff03f20f800 1 librados: init done 2024-09-12T17:38:04.765 INFO:tasks.workunit.client.0.smithi037.stderr: -128> 2024-09-12T17:38:04.187+0000 7ff03f20f800 5 asok(0x55e258655730) register_command cr dump hook 0x55e25893cdb8 2024-09-12T17:38:04.765 INFO:tasks.workunit.client.0.smithi037.stderr: -127> 2024-09-12T17:38:04.189+0000 7ff03f20f800 20 rados->read ofs=0 len=0 2024-09-12T17:38:04.765 INFO:tasks.workunit.client.0.smithi037.stderr: -126> 2024-09-12T17:38:04.190+0000 7fef1cff9640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:38:04.765 INFO:tasks.workunit.client.0.smithi037.stderr: -125> 2024-09-12T17:38:04.190+0000 7fef1cff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.40:6816/3916250676,v1:172.21.15.40:6817/3916250676] 2024-09-12T17:38:04.765 INFO:tasks.workunit.client.0.smithi037.stderr: -124> 2024-09-12T17:38:04.190+0000 7fef1cff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.40:6816/3916250676,v1:172.21.15.40:6817/3916250676] 2024-09-12T17:38:04.765 INFO:tasks.workunit.client.0.smithi037.stderr: -123> 2024-09-12T17:38:04.190+0000 7ff03a992640 10 monclient: get_auth_request con 0x7fef04076470 auth_method 0 2024-09-12T17:38:04.765 INFO:tasks.workunit.client.0.smithi037.stderr: -122> 2024-09-12T17:38:04.190+0000 7ff03b193640 10 monclient: get_auth_request con 0x55e2589620d0 auth_method 0 2024-09-12T17:38:04.765 INFO:tasks.workunit.client.0.smithi037.stderr: -121> 2024-09-12T17:38:04.191+0000 7ff03f20f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:04.765 INFO:tasks.workunit.client.0.smithi037.stderr: -120> 2024-09-12T17:38:04.191+0000 7ff03f20f800 20 realm 2024-09-12T17:38:04.766 INFO:tasks.workunit.client.0.smithi037.stderr: -119> 2024-09-12T17:38:04.191+0000 7ff03f20f800 20 rados->read ofs=0 len=0 2024-09-12T17:38:04.766 INFO:tasks.workunit.client.0.smithi037.stderr: -118> 2024-09-12T17:38:04.191+0000 7ff03f20f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:04.766 INFO:tasks.workunit.client.0.smithi037.stderr: -117> 2024-09-12T17:38:04.191+0000 7ff03f20f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:38:04.766 INFO:tasks.workunit.client.0.smithi037.stderr: -116> 2024-09-12T17:38:04.191+0000 7ff03f20f800 20 rados->read ofs=0 len=0 2024-09-12T17:38:04.766 INFO:tasks.workunit.client.0.smithi037.stderr: -115> 2024-09-12T17:38:04.191+0000 7ff03f20f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:04.766 INFO:tasks.workunit.client.0.smithi037.stderr: -114> 2024-09-12T17:38:04.191+0000 7ff03f20f800 20 rados->read ofs=0 len=0 2024-09-12T17:38:04.766 INFO:tasks.workunit.client.0.smithi037.stderr: -113> 2024-09-12T17:38:04.191+0000 7ff03a992640 10 monclient: get_auth_request con 0x55e2589662d0 auth_method 0 2024-09-12T17:38:04.766 INFO:tasks.workunit.client.0.smithi037.stderr: -112> 2024-09-12T17:38:04.192+0000 7ff03f20f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:38:04.766 INFO:tasks.workunit.client.0.smithi037.stderr: -111> 2024-09-12T17:38:04.192+0000 7ff03f20f800 20 rados->read ofs=0 len=0 2024-09-12T17:38:04.766 INFO:tasks.workunit.client.0.smithi037.stderr: -110> 2024-09-12T17:38:04.193+0000 7ff03f20f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:38:04.766 INFO:tasks.workunit.client.0.smithi037.stderr: -109> 2024-09-12T17:38:04.193+0000 7ff03f20f800 20 searching for the correct realm 2024-09-12T17:38:04.766 INFO:tasks.workunit.client.0.smithi037.stderr: -108> 2024-09-12T17:38:04.193+0000 7ff03a191640 10 monclient: get_auth_request con 0x55e25896b540 auth_method 0 2024-09-12T17:38:04.766 INFO:tasks.workunit.client.0.smithi037.stderr: -107> 2024-09-12T17:38:04.193+0000 7fef1cff9640 1 client.7784.objecter ms_handle_reset 0x55e25896b540 session 0x55e25896aec0 osd.3 2024-09-12T17:38:04.767 INFO:tasks.workunit.client.0.smithi037.stderr: -106> 2024-09-12T17:38:04.193+0000 7fef1cff9640 10 monclient: _renew_subs 2024-09-12T17:38:04.767 INFO:tasks.workunit.client.0.smithi037.stderr: -105> 2024-09-12T17:38:04.193+0000 7fef1cff9640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.37:3301/0 2024-09-12T17:38:04.767 INFO:tasks.workunit.client.0.smithi037.stderr: -104> 2024-09-12T17:38:04.193+0000 7ff03a191640 10 monclient: get_auth_request con 0x7fef04086b70 auth_method 0 2024-09-12T17:38:04.767 INFO:tasks.workunit.client.0.smithi037.stderr: -103> 2024-09-12T17:38:04.194+0000 7ff03b193640 10 monclient: get_auth_request con 0x7ff030008070 auth_method 0 2024-09-12T17:38:04.767 INFO:tasks.workunit.client.0.smithi037.stderr: -102> 2024-09-12T17:38:04.195+0000 7ff03a992640 10 monclient: get_auth_request con 0x7ff034076040 auth_method 0 2024-09-12T17:38:04.767 INFO:tasks.workunit.client.0.smithi037.stderr: -101> 2024-09-12T17:38:04.196+0000 7ff03a191640 10 monclient: get_auth_request con 0x7ff02c048460 auth_method 0 2024-09-12T17:38:04.767 INFO:tasks.workunit.client.0.smithi037.stderr: -100> 2024-09-12T17:38:04.196+0000 7ff03a191640 0 -- 172.21.15.37:0/2555455407 >> [v2:172.21.15.40:6800/2441293461,v1:172.21.15.40:6801/2441293461] conn(0x7ff02c048460 msgr2=0x7ff02c067940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:38:04.767 INFO:tasks.workunit.client.0.smithi037.stderr: -99> 2024-09-12T17:38:04.397+0000 7ff03a191640 10 monclient: get_auth_request con 0x7ff02c048460 auth_method 0 2024-09-12T17:38:04.767 INFO:tasks.workunit.client.0.smithi037.stderr: -98> 2024-09-12T17:38:04.400+0000 7ff03b193640 10 monclient: get_auth_request con 0x7ff030075bb0 auth_method 0 2024-09-12T17:38:04.767 INFO:tasks.workunit.client.0.smithi037.stderr: -97> 2024-09-12T17:38:04.403+0000 7ff03a992640 10 monclient: get_auth_request con 0x7ff030093b90 auth_method 0 2024-09-12T17:38:04.767 INFO:tasks.workunit.client.0.smithi037.stderr: -96> 2024-09-12T17:38:04.403+0000 7ff03a992640 0 -- 172.21.15.37:0/2555455407 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7ff030093b90 msgr2=0x7ff0300a2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:38:04.767 INFO:tasks.workunit.client.0.smithi037.stderr: -95> 2024-09-12T17:38:04.604+0000 7ff03a992640 10 monclient: get_auth_request con 0x7ff030093b90 auth_method 0 2024-09-12T17:38:04.767 INFO:tasks.workunit.client.0.smithi037.stderr: -94> 2024-09-12T17:38:04.611+0000 7ff03f20f800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:38:04.768 INFO:tasks.workunit.client.0.smithi037.stderr: -93> 2024-09-12T17:38:04.611+0000 7ff03f20f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:38:04.768 INFO:tasks.workunit.client.0.smithi037.stderr: -92> 2024-09-12T17:38:04.611+0000 7ff03f20f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:38:04.768 INFO:tasks.workunit.client.0.smithi037.stderr: -91> 2024-09-12T17:38:04.611+0000 7ff03f20f800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:38:04.768 INFO:tasks.workunit.client.0.smithi037.stderr: -90> 2024-09-12T17:38:04.611+0000 7ff03f20f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:38:04.768 INFO:tasks.workunit.client.0.smithi037.stderr: -89> 2024-09-12T17:38:04.611+0000 7ff03f20f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:38:04.768 INFO:tasks.workunit.client.0.smithi037.stderr: -88> 2024-09-12T17:38:04.611+0000 7ff03f20f800 20 rados->read ofs=0 len=0 2024-09-12T17:38:04.768 INFO:tasks.workunit.client.0.smithi037.stderr: -87> 2024-09-12T17:38:04.611+0000 7ff03f20f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:04.768 INFO:tasks.workunit.client.0.smithi037.stderr: -86> 2024-09-12T17:38:04.611+0000 7ff03f20f800 20 rados->read ofs=0 len=0 2024-09-12T17:38:04.768 INFO:tasks.workunit.client.0.smithi037.stderr: -85> 2024-09-12T17:38:04.612+0000 7ff03f20f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:38:04.768 INFO:tasks.workunit.client.0.smithi037.stderr: -84> 2024-09-12T17:38:04.612+0000 7ff03f20f800 20 rados->read ofs=0 len=0 2024-09-12T17:38:04.768 INFO:tasks.workunit.client.0.smithi037.stderr: -83> 2024-09-12T17:38:04.612+0000 7ff03f20f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:38:04.768 INFO:tasks.workunit.client.0.smithi037.stderr: -82> 2024-09-12T17:38:04.612+0000 7ff03f20f800 20 zone default found 2024-09-12T17:38:04.768 INFO:tasks.workunit.client.0.smithi037.stderr: -81> 2024-09-12T17:38:04.612+0000 7ff03f20f800 4 Realm: () 2024-09-12T17:38:04.769 INFO:tasks.workunit.client.0.smithi037.stderr: -80> 2024-09-12T17:38:04.612+0000 7ff03f20f800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:38:04.769 INFO:tasks.workunit.client.0.smithi037.stderr: -79> 2024-09-12T17:38:04.612+0000 7ff03f20f800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:38:04.769 INFO:tasks.workunit.client.0.smithi037.stderr: -78> 2024-09-12T17:38:04.612+0000 7ff03f20f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:38:04.769 INFO:tasks.workunit.client.0.smithi037.stderr: -77> 2024-09-12T17:38:04.612+0000 7ff03f20f800 20 zonegroup default 2024-09-12T17:38:04.769 INFO:tasks.workunit.client.0.smithi037.stderr: -76> 2024-09-12T17:38:04.612+0000 7ff03f20f800 20 rados->read ofs=0 len=0 2024-09-12T17:38:04.769 INFO:tasks.workunit.client.0.smithi037.stderr: -75> 2024-09-12T17:38:04.612+0000 7ff03f20f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:04.769 INFO:tasks.workunit.client.0.smithi037.stderr: -74> 2024-09-12T17:38:04.612+0000 7ff03f20f800 20 rados->read ofs=0 len=0 2024-09-12T17:38:04.769 INFO:tasks.workunit.client.0.smithi037.stderr: -73> 2024-09-12T17:38:04.613+0000 7ff03f20f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:04.769 INFO:tasks.workunit.client.0.smithi037.stderr: -72> 2024-09-12T17:38:04.613+0000 7ff03f20f800 20 rados->read ofs=0 len=0 2024-09-12T17:38:04.769 INFO:tasks.workunit.client.0.smithi037.stderr: -71> 2024-09-12T17:38:04.613+0000 7ff03f20f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:04.769 INFO:tasks.workunit.client.0.smithi037.stderr: -70> 2024-09-12T17:38:04.613+0000 7ff03f20f800 20 started sync module instance, tier type = 2024-09-12T17:38:04.769 INFO:tasks.workunit.client.0.smithi037.stderr: -69> 2024-09-12T17:38:04.613+0000 7ff03f20f800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:38:04.769 INFO:tasks.workunit.client.0.smithi037.stderr: -68> 2024-09-12T17:38:04.624+0000 7ff03f20f800 20 add_watcher() i=0 2024-09-12T17:38:04.769 INFO:tasks.workunit.client.0.smithi037.stderr: -67> 2024-09-12T17:38:04.624+0000 7ff03f20f800 20 add_watcher() i=1 2024-09-12T17:38:04.770 INFO:tasks.workunit.client.0.smithi037.stderr: -66> 2024-09-12T17:38:04.624+0000 7ff03f20f800 20 add_watcher() i=2 2024-09-12T17:38:04.770 INFO:tasks.workunit.client.0.smithi037.stderr: -65> 2024-09-12T17:38:04.624+0000 7ff03f20f800 20 add_watcher() i=3 2024-09-12T17:38:04.770 INFO:tasks.workunit.client.0.smithi037.stderr: -64> 2024-09-12T17:38:04.624+0000 7ff03f20f800 20 add_watcher() i=4 2024-09-12T17:38:04.770 INFO:tasks.workunit.client.0.smithi037.stderr: -63> 2024-09-12T17:38:04.624+0000 7ff03f20f800 20 add_watcher() i=5 2024-09-12T17:38:04.770 INFO:tasks.workunit.client.0.smithi037.stderr: -62> 2024-09-12T17:38:04.624+0000 7ff03f20f800 20 add_watcher() i=6 2024-09-12T17:38:04.770 INFO:tasks.workunit.client.0.smithi037.stderr: -61> 2024-09-12T17:38:04.626+0000 7ff03f20f800 20 add_watcher() i=7 2024-09-12T17:38:04.770 INFO:tasks.workunit.client.0.smithi037.stderr: -60> 2024-09-12T17:38:04.626+0000 7ff03f20f800 2 all 8 watchers are set, enabling cache 2024-09-12T17:38:04.770 INFO:tasks.workunit.client.0.smithi037.stderr: -59> 2024-09-12T17:38:04.628+0000 7ff03f20f800 5 AuthRegistry(0x7ffcf2278540) adding auth protocol: cephx 2024-09-12T17:38:04.770 INFO:tasks.workunit.client.0.smithi037.stderr: -58> 2024-09-12T17:38:04.628+0000 7ff03f20f800 5 AuthRegistry(0x7ffcf2278540) adding auth protocol: cephx 2024-09-12T17:38:04.770 INFO:tasks.workunit.client.0.smithi037.stderr: -57> 2024-09-12T17:38:04.628+0000 7ff03f20f800 5 AuthRegistry(0x7ffcf2278540) adding auth protocol: cephx 2024-09-12T17:38:04.770 INFO:tasks.workunit.client.0.smithi037.stderr: -56> 2024-09-12T17:38:04.628+0000 7ff03f20f800 5 AuthRegistry(0x7ffcf2278540) adding con mode: secure 2024-09-12T17:38:04.770 INFO:tasks.workunit.client.0.smithi037.stderr: -55> 2024-09-12T17:38:04.628+0000 7ff03f20f800 5 AuthRegistry(0x7ffcf2278540) adding con mode: crc 2024-09-12T17:38:04.770 INFO:tasks.workunit.client.0.smithi037.stderr: -54> 2024-09-12T17:38:04.628+0000 7ff03f20f800 5 AuthRegistry(0x7ffcf2278540) adding con mode: secure 2024-09-12T17:38:04.770 INFO:tasks.workunit.client.0.smithi037.stderr: -53> 2024-09-12T17:38:04.628+0000 7ff03f20f800 5 AuthRegistry(0x7ffcf2278540) adding con mode: crc 2024-09-12T17:38:04.771 INFO:tasks.workunit.client.0.smithi037.stderr: -52> 2024-09-12T17:38:04.628+0000 7ff03f20f800 5 AuthRegistry(0x7ffcf2278540) adding con mode: secure 2024-09-12T17:38:04.771 INFO:tasks.workunit.client.0.smithi037.stderr: -51> 2024-09-12T17:38:04.628+0000 7ff03f20f800 5 AuthRegistry(0x7ffcf2278540) adding con mode: crc 2024-09-12T17:38:04.771 INFO:tasks.workunit.client.0.smithi037.stderr: -50> 2024-09-12T17:38:04.628+0000 7ff03f20f800 5 AuthRegistry(0x7ffcf2278540) adding con mode: crc 2024-09-12T17:38:04.771 INFO:tasks.workunit.client.0.smithi037.stderr: -49> 2024-09-12T17:38:04.628+0000 7ff03f20f800 5 AuthRegistry(0x7ffcf2278540) adding con mode: secure 2024-09-12T17:38:04.771 INFO:tasks.workunit.client.0.smithi037.stderr: -48> 2024-09-12T17:38:04.628+0000 7ff03f20f800 5 AuthRegistry(0x7ffcf2278540) adding con mode: crc 2024-09-12T17:38:04.771 INFO:tasks.workunit.client.0.smithi037.stderr: -47> 2024-09-12T17:38:04.628+0000 7ff03f20f800 5 AuthRegistry(0x7ffcf2278540) adding con mode: secure 2024-09-12T17:38:04.771 INFO:tasks.workunit.client.0.smithi037.stderr: -46> 2024-09-12T17:38:04.628+0000 7ff03f20f800 5 AuthRegistry(0x7ffcf2278540) adding con mode: crc 2024-09-12T17:38:04.771 INFO:tasks.workunit.client.0.smithi037.stderr: -45> 2024-09-12T17:38:04.628+0000 7ff03f20f800 5 AuthRegistry(0x7ffcf2278540) adding con mode: secure 2024-09-12T17:38:04.771 INFO:tasks.workunit.client.0.smithi037.stderr: -44> 2024-09-12T17:38:04.628+0000 7feef17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:38:04.771 INFO:tasks.workunit.client.0.smithi037.stderr: -43> 2024-09-12T17:38:04.628+0000 7ff03f20f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:38:04.771 INFO:tasks.workunit.client.0.smithi037.stderr: -42> 2024-09-12T17:38:04.628+0000 7ff03f20f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:38:04.771 INFO:tasks.workunit.client.0.smithi037.stderr: -41> 2024-09-12T17:38:04.628+0000 7ff03f20f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:38:04.771 INFO:tasks.workunit.client.0.smithi037.stderr: -40> 2024-09-12T17:38:04.628+0000 7ff03f20f800 5 asok(0x55e258655730) register_command cache list hook 0x55e258916990 2024-09-12T17:38:04.771 INFO:tasks.workunit.client.0.smithi037.stderr: -39> 2024-09-12T17:38:04.628+0000 7ff03f20f800 5 asok(0x55e258655730) register_command cache inspect hook 0x55e258916990 2024-09-12T17:38:04.772 INFO:tasks.workunit.client.0.smithi037.stderr: -38> 2024-09-12T17:38:04.628+0000 7ff03f20f800 5 asok(0x55e258655730) register_command cache erase hook 0x55e258916990 2024-09-12T17:38:04.772 INFO:tasks.workunit.client.0.smithi037.stderr: -37> 2024-09-12T17:38:04.628+0000 7ff03f20f800 5 asok(0x55e258655730) register_command cache zap hook 0x55e258916990 2024-09-12T17:38:04.772 INFO:tasks.workunit.client.0.smithi037.stderr: -36> 2024-09-12T17:38:04.629+0000 7ff03f20f800 5 note: GC not initialized 2024-09-12T17:38:04.772 INFO:tasks.workunit.client.0.smithi037.stderr: -35> 2024-09-12T17:38:04.629+0000 7fee6bfff640 20 reqs_thread_entry: start 2024-09-12T17:38:04.772 INFO:tasks.workunit.client.0.smithi037.stderr: -34> 2024-09-12T17:38:04.629+0000 7ff03f20f800 5 asok(0x55e258655730) register_command sync trace show hook 0x7ff02c0043a0 2024-09-12T17:38:04.772 INFO:tasks.workunit.client.0.smithi037.stderr: -33> 2024-09-12T17:38:04.629+0000 7ff03f20f800 5 asok(0x55e258655730) register_command sync trace history hook 0x7ff02c0043a0 2024-09-12T17:38:04.772 INFO:tasks.workunit.client.0.smithi037.stderr: -32> 2024-09-12T17:38:04.629+0000 7ff03f20f800 5 asok(0x55e258655730) register_command sync trace active hook 0x7ff02c0043a0 2024-09-12T17:38:04.772 INFO:tasks.workunit.client.0.smithi037.stderr: -31> 2024-09-12T17:38:04.629+0000 7ff03f20f800 5 asok(0x55e258655730) register_command sync trace active_short hook 0x7ff02c0043a0 2024-09-12T17:38:04.772 INFO:tasks.workunit.client.0.smithi037.stderr: -30> 2024-09-12T17:38:04.629+0000 7ff03f20f800 20 init_complete bucket index max shards: 11 2024-09-12T17:38:04.772 INFO:tasks.workunit.client.0.smithi037.stderr: -29> 2024-09-12T17:38:04.629+0000 7ff03f20f800 20 Filter name: none 2024-09-12T17:38:04.772 INFO:tasks.workunit.client.0.smithi037.stderr: -28> 2024-09-12T17:38:04.629+0000 7fee69ffb640 20 reqs_thread_entry: start 2024-09-12T17:38:04.772 INFO:tasks.workunit.client.0.smithi037.stderr: -27> 2024-09-12T17:38:04.629+0000 7ff03f20f800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:38:04.772 INFO:tasks.workunit.client.0.smithi037.stderr: -26> 2024-09-12T17:38:04.629+0000 7ff03f20f800 20 rados->read ofs=0 len=0 2024-09-12T17:38:04.773 INFO:tasks.workunit.client.0.smithi037.stderr: -25> 2024-09-12T17:38:04.630+0000 7ff03f20f800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:38:04.773 INFO:tasks.workunit.client.0.smithi037.stderr: -24> 2024-09-12T17:38:04.630+0000 7ff03f20f800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:38:04.773 INFO:tasks.workunit.client.0.smithi037.stderr: -23> 2024-09-12T17:38:04.630+0000 7ff03f20f800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:38:04.773 INFO:tasks.workunit.client.0.smithi037.stderr: -22> 2024-09-12T17:38:04.630+0000 7ff03f20f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 : miss 2024-09-12T17:38:04.773 INFO:tasks.workunit.client.0.smithi037.stderr: -21> 2024-09-12T17:38:04.630+0000 7ff03f20f800 20 rados->read ofs=0 len=0 2024-09-12T17:38:04.773 INFO:tasks.workunit.client.0.smithi037.stderr: -20> 2024-09-12T17:38:04.630+0000 7ff03f20f800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T17:38:04.773 INFO:tasks.workunit.client.0.smithi037.stderr: -19> 2024-09-12T17:38:04.630+0000 7ff03f20f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 info.flags=0x17 2024-09-12T17:38:04.773 INFO:tasks.workunit.client.0.smithi037.stderr: -18> 2024-09-12T17:38:04.630+0000 7ff03f20f800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 to cache LRU end 2024-09-12T17:38:04.773 INFO:tasks.workunit.client.0.smithi037.stderr: -17> 2024-09-12T17:38:04.630+0000 7ff03f20f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:38:04.773 INFO:tasks.workunit.client.0.smithi037.stderr: -16> 2024-09-12T17:38:04.630+0000 7ff03f20f800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:38:04.773 INFO:tasks.workunit.client.0.smithi037.stderr: -15> 2024-09-12T17:38:04.630+0000 7ff03f20f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 2024-09-12T17:38:04.773 INFO:tasks.workunit.client.0.smithi037.stderr: -14> 2024-09-12T17:38:04.632+0000 7ff03f20f800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T17:38:04.773 INFO:tasks.workunit.client.0.smithi037.stderr: -13> 2024-09-12T17:38:04.641+0000 7ff03f20f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 info.flags=0x17 2024-09-12T17:38:04.774 INFO:tasks.workunit.client.0.smithi037.stderr: -12> 2024-09-12T17:38:04.641+0000 7ff03f20f800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 to cache LRU end 2024-09-12T17:38:04.774 INFO:tasks.workunit.client.0.smithi037.stderr: -11> 2024-09-12T17:38:04.641+0000 7ff03f20f800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:38:04.774 INFO:tasks.workunit.client.0.smithi037.stderr: -10> 2024-09-12T17:38:04.641+0000 7ff03f20f800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18, ofs0, ns] 2024-09-12T17:38:04.774 INFO:tasks.workunit.client.0.smithi037.stderr: -9> 2024-09-12T17:38:04.641+0000 7fef1dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497020 cookie 94430637274448 notifier 7784 bl.length()=911 2024-09-12T17:38:04.774 INFO:tasks.workunit.client.0.smithi037.stderr: -8> 2024-09-12T17:38:04.641+0000 7fef1dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 info.flags=0x17 2024-09-12T17:38:04.774 INFO:tasks.workunit.client.0.smithi037.stderr: -7> 2024-09-12T17:38:04.641+0000 7fef1dffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 to cache LRU end 2024-09-12T17:38:04.774 INFO:tasks.workunit.client.0.smithi037.stderr: -6> 2024-09-12T17:38:04.641+0000 7fef1dffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:38:04.774 INFO:tasks.workunit.client.0.smithi037.stderr: -5> 2024-09-12T17:38:04.643+0000 7ff03f20f800 20 handle_bi_update(): bucket=:a-bucket[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18]): orig_sources= new_sources= 2024-09-12T17:38:04.774 INFO:tasks.workunit.client.0.smithi037.stderr: -4> 2024-09-12T17:38:04.643+0000 7ff03f20f800 20 handle_bi_update(): bucket=:a-bucket[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18]): potential sources added=[] removed=[] 2024-09-12T17:38:04.774 INFO:tasks.workunit.client.0.smithi037.stderr: -3> 2024-09-12T17:38:04.643+0000 7ff03f20f800 20 handle_bi_update(): bucket=:a-bucket[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18]): orig_dests= new_dests= 2024-09-12T17:38:04.774 INFO:tasks.workunit.client.0.smithi037.stderr: -2> 2024-09-12T17:38:04.643+0000 7ff03f20f800 20 handle_bi_update(): bucket=:a-bucket[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18]): potential dests added=[] removed=[] 2024-09-12T17:38:04.774 INFO:tasks.workunit.client.0.smithi037.stderr: -1> 2024-09-12T17:38:04.648+0000 7ff03f20f800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7ff03f20f800 time 2024-09-12T17:38:04.648240+0000 2024-09-12T17:38:04.774 INFO:tasks.workunit.client.0.smithi037.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:38:04.774 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:38:04.775 INFO:tasks.workunit.client.0.smithi037.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:38:04.775 INFO:tasks.workunit.client.0.smithi037.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7ff04038c71a] 2024-09-12T17:38:04.775 INFO:tasks.workunit.client.0.smithi037.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7ff04038c8d8] 2024-09-12T17:38:04.775 INFO:tasks.workunit.client.0.smithi037.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e2576f6841] 2024-09-12T17:38:04.775 INFO:tasks.workunit.client.0.smithi037.stderr: 4: radosgw-admin(+0xd7490c) [0x55e257c0490c] 2024-09-12T17:38:04.775 INFO:tasks.workunit.client.0.smithi037.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55e25770650d] 2024-09-12T17:38:04.775 INFO:tasks.workunit.client.0.smithi037.stderr: 6: main() 2024-09-12T17:38:04.775 INFO:tasks.workunit.client.0.smithi037.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7ff03f029590] 2024-09-12T17:38:04.775 INFO:tasks.workunit.client.0.smithi037.stderr: 8: __libc_start_main() 2024-09-12T17:38:04.775 INFO:tasks.workunit.client.0.smithi037.stderr: 9: _start() 2024-09-12T17:38:04.775 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:38:04.775 INFO:tasks.workunit.client.0.smithi037.stderr: 0> 2024-09-12T17:38:04.649+0000 7ff03f20f800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:38:04.775 INFO:tasks.workunit.client.0.smithi037.stderr: in thread 7ff03f20f800 thread_name:radosgw-admin 2024-09-12T17:38:04.775 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:38:04.776 INFO:tasks.workunit.client.0.smithi037.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:38:04.776 INFO:tasks.workunit.client.0.smithi037.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7ff03f03e6f0] 2024-09-12T17:38:04.776 INFO:tasks.workunit.client.0.smithi037.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7ff03f08b99c] 2024-09-12T17:38:04.776 INFO:tasks.workunit.client.0.smithi037.stderr: 3: raise() 2024-09-12T17:38:04.776 INFO:tasks.workunit.client.0.smithi037.stderr: 4: abort() 2024-09-12T17:38:04.776 INFO:tasks.workunit.client.0.smithi037.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7ff04038c774] 2024-09-12T17:38:04.776 INFO:tasks.workunit.client.0.smithi037.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7ff04038c8d8] 2024-09-12T17:38:04.776 INFO:tasks.workunit.client.0.smithi037.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e2576f6841] 2024-09-12T17:38:04.776 INFO:tasks.workunit.client.0.smithi037.stderr: 8: radosgw-admin(+0xd7490c) [0x55e257c0490c] 2024-09-12T17:38:04.776 INFO:tasks.workunit.client.0.smithi037.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55e25770650d] 2024-09-12T17:38:04.776 INFO:tasks.workunit.client.0.smithi037.stderr: 10: main() 2024-09-12T17:38:04.776 INFO:tasks.workunit.client.0.smithi037.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7ff03f029590] 2024-09-12T17:38:04.776 INFO:tasks.workunit.client.0.smithi037.stderr: 12: __libc_start_main() 2024-09-12T17:38:04.776 INFO:tasks.workunit.client.0.smithi037.stderr: 13: _start() 2024-09-12T17:38:04.777 INFO:tasks.workunit.client.0.smithi037.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:38:04.777 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:38:04.777 INFO:tasks.workunit.client.0.smithi037.stderr:--- logging levels --- 2024-09-12T17:38:04.777 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 none 2024-09-12T17:38:04.777 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 lockdep 2024-09-12T17:38:04.777 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 context 2024-09-12T17:38:04.777 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 1 crush 2024-09-12T17:38:04.777 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mds 2024-09-12T17:38:04.777 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mds_balancer 2024-09-12T17:38:04.777 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mds_locker 2024-09-12T17:38:04.777 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mds_log 2024-09-12T17:38:04.777 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mds_log_expire 2024-09-12T17:38:04.777 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mds_migrator 2024-09-12T17:38:04.777 INFO:tasks.workunit.client.0.smithi037.stderr: 3/ 5 mds_quiesce 2024-09-12T17:38:04.778 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 buffer 2024-09-12T17:38:04.778 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 timer 2024-09-12T17:38:04.778 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 filer 2024-09-12T17:38:04.778 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 striper 2024-09-12T17:38:04.778 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 objecter 2024-09-12T17:38:04.778 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 rados 2024-09-12T17:38:04.778 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 rbd 2024-09-12T17:38:04.778 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 rbd_mirror 2024-09-12T17:38:04.778 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 rbd_replay 2024-09-12T17:38:04.778 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 rbd_pwl 2024-09-12T17:38:04.778 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 journaler 2024-09-12T17:38:04.778 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 objectcacher 2024-09-12T17:38:04.778 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:38:04.779 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 client 2024-09-12T17:38:04.779 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 osd 2024-09-12T17:38:04.779 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 optracker 2024-09-12T17:38:04.779 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 objclass 2024-09-12T17:38:04.779 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 3 filestore 2024-09-12T17:38:04.779 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 3 journal 2024-09-12T17:38:04.779 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 0 ms 2024-09-12T17:38:04.779 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mon 2024-09-12T17:38:04.779 INFO:tasks.workunit.client.0.smithi037.stderr: 0/10 monc 2024-09-12T17:38:04.779 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 paxos 2024-09-12T17:38:04.779 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 tp 2024-09-12T17:38:04.779 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 auth 2024-09-12T17:38:04.779 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 crypto 2024-09-12T17:38:04.780 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 1 finisher 2024-09-12T17:38:04.780 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 1 reserver 2024-09-12T17:38:04.780 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 heartbeatmap 2024-09-12T17:38:04.780 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 perfcounter 2024-09-12T17:38:04.780 INFO:tasks.workunit.client.0.smithi037.stderr: 20/20 rgw 2024-09-12T17:38:04.780 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 rgw_sync 2024-09-12T17:38:04.780 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 rgw_datacache 2024-09-12T17:38:04.780 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 rgw_access 2024-09-12T17:38:04.780 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:38:04.780 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 rgw_flight 2024-09-12T17:38:04.780 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:38:04.780 INFO:tasks.workunit.client.0.smithi037.stderr: 20/20 rgw_notification 2024-09-12T17:38:04.780 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 javaclient 2024-09-12T17:38:04.780 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 asok 2024-09-12T17:38:04.781 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 1 throttle 2024-09-12T17:38:04.781 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 0 refs 2024-09-12T17:38:04.781 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 compressor 2024-09-12T17:38:04.781 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 bluestore 2024-09-12T17:38:04.781 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 bluefs 2024-09-12T17:38:04.781 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 3 bdev 2024-09-12T17:38:04.781 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 kstore 2024-09-12T17:38:04.781 INFO:tasks.workunit.client.0.smithi037.stderr: 4/ 5 rocksdb 2024-09-12T17:38:04.781 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 fuse 2024-09-12T17:38:04.781 INFO:tasks.workunit.client.0.smithi037.stderr: 2/ 5 mgr 2024-09-12T17:38:04.781 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mgrc 2024-09-12T17:38:04.781 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 dpdk 2024-09-12T17:38:04.781 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 eventtrace 2024-09-12T17:38:04.781 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 prioritycache 2024-09-12T17:38:04.782 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 test 2024-09-12T17:38:04.782 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:38:04.782 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 cephsqlite 2024-09-12T17:38:04.782 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:38:04.782 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore 2024-09-12T17:38:04.782 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_onode 2024-09-12T17:38:04.782 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_odata 2024-09-12T17:38:04.782 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_omap 2024-09-12T17:38:04.783 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_tm 2024-09-12T17:38:04.783 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_t 2024-09-12T17:38:04.783 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:38:04.783 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_epm 2024-09-12T17:38:04.783 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_lba 2024-09-12T17:38:04.783 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:38:04.783 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_cache 2024-09-12T17:38:04.783 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_journal 2024-09-12T17:38:04.783 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_device 2024-09-12T17:38:04.783 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_backref 2024-09-12T17:38:04.783 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 alienstore 2024-09-12T17:38:04.784 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mclock 2024-09-12T17:38:04.784 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 cyanstore 2024-09-12T17:38:04.784 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 ceph_exporter 2024-09-12T17:38:04.784 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 memstore 2024-09-12T17:38:04.784 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 trace 2024-09-12T17:38:04.784 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 ceph_dedup 2024-09-12T17:38:04.784 INFO:tasks.workunit.client.0.smithi037.stderr: -2/-2 (syslog threshold) 2024-09-12T17:38:04.784 INFO:tasks.workunit.client.0.smithi037.stderr: 99/99 (stderr threshold) 2024-09-12T17:38:04.784 INFO:tasks.workunit.client.0.smithi037.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:38:04.784 INFO:tasks.workunit.client.0.smithi037.stderr: 7fee69ffb640 / http_manager 2024-09-12T17:38:04.784 INFO:tasks.workunit.client.0.smithi037.stderr: 7fee6bfff640 / http_manager 2024-09-12T17:38:04.784 INFO:tasks.workunit.client.0.smithi037.stderr: 7feef17e2640 / rgw_dt_lg_renew 2024-09-12T17:38:04.784 INFO:tasks.workunit.client.0.smithi037.stderr: 7fef1cff9640 / ms_dispatch 2024-09-12T17:38:04.785 INFO:tasks.workunit.client.0.smithi037.stderr: 7fef1dffb640 / io_context_pool 2024-09-12T17:38:04.785 INFO:tasks.workunit.client.0.smithi037.stderr: 7fef1e7fc640 / io_context_pool 2024-09-12T17:38:04.785 INFO:tasks.workunit.client.0.smithi037.stderr: 7fef24e01640 / ms_dispatch 2024-09-12T17:38:04.785 INFO:tasks.workunit.client.0.smithi037.stderr: 7fef27606640 / ms_dispatch 2024-09-12T17:38:04.785 INFO:tasks.workunit.client.0.smithi037.stderr: 7fef28e09640 / io_context_pool 2024-09-12T17:38:04.785 INFO:tasks.workunit.client.0.smithi037.stderr: 7ff03a191640 / msgr-worker-2 2024-09-12T17:38:04.785 INFO:tasks.workunit.client.0.smithi037.stderr: 7ff03a992640 / msgr-worker-1 2024-09-12T17:38:04.785 INFO:tasks.workunit.client.0.smithi037.stderr: 7ff03b193640 / msgr-worker-0 2024-09-12T17:38:04.785 INFO:tasks.workunit.client.0.smithi037.stderr: 7ff03b994640 / io_context_pool 2024-09-12T17:38:04.785 INFO:tasks.workunit.client.0.smithi037.stderr: 7ff03f20f800 / radosgw-admin 2024-09-12T17:38:04.785 INFO:tasks.workunit.client.0.smithi037.stderr: max_recent 500 2024-09-12T17:38:04.785 INFO:tasks.workunit.client.0.smithi037.stderr: max_new 1000 2024-09-12T17:38:04.785 INFO:tasks.workunit.client.0.smithi037.stderr: log_file /var/lib/ceph/crash/2024-09-12T17:38:04.649995Z_72805753-891a-4e99-abe2-a1413fabcf4e/log 2024-09-12T17:38:04.785 INFO:tasks.workunit.client.0.smithi037.stderr:--- end dump of recent events --- 2024-09-12T17:38:04.786 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-12T17:38:04.787 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:38:04.787 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:38:04.787 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.734+0000 7f254ef46800 20 rados->read ofs=0 len=0 2024-09-12T17:38:04.787 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.736+0000 7f254ef46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:04.787 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.736+0000 7f254ef46800 20 realm 2024-09-12T17:38:04.787 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.736+0000 7f254ef46800 20 rados->read ofs=0 len=0 2024-09-12T17:38:04.788 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.736+0000 7f254ef46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:04.788 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.736+0000 7f254ef46800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:38:04.788 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.736+0000 7f254ef46800 20 rados->read ofs=0 len=0 2024-09-12T17:38:04.788 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.736+0000 7f254ef46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:04.788 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.736+0000 7f254ef46800 20 rados->read ofs=0 len=0 2024-09-12T17:38:04.788 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.737+0000 7f254ef46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:38:04.788 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.737+0000 7f254ef46800 20 rados->read ofs=0 len=0 2024-09-12T17:38:04.788 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.738+0000 7f254ef46800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:38:04.788 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.738+0000 7f254ef46800 20 searching for the correct realm 2024-09-12T17:38:04.788 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.741+0000 7f254c236640 0 -- 172.21.15.37:0/4026297945 >> [v2:172.21.15.40:6800/2441293461,v1:172.21.15.40:6801/2441293461] conn(0x7f253c045180 msgr2=0x7f253c060c40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:38:04.788 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.745+0000 7f254ca37640 0 -- 172.21.15.37:0/4026297945 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7f25400633d0 msgr2=0x7f2540063830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:38:04.954 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.953+0000 7f254ef46800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:38:04.954 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.953+0000 7f254ef46800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:38:04.954 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.953+0000 7f254ef46800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:38:04.955 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.953+0000 7f254ef46800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:38:04.955 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.953+0000 7f254ef46800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:38:04.955 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.953+0000 7f254ef46800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:38:04.955 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.953+0000 7f254ef46800 20 rados->read ofs=0 len=0 2024-09-12T17:38:04.955 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.953+0000 7f254ef46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:04.955 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.953+0000 7f254ef46800 20 rados->read ofs=0 len=0 2024-09-12T17:38:04.956 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.954+0000 7f254ef46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:38:04.956 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.954+0000 7f254ef46800 20 rados->read ofs=0 len=0 2024-09-12T17:38:04.956 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.954+0000 7f254ef46800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:38:04.956 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.954+0000 7f254ef46800 20 zone default found 2024-09-12T17:38:04.956 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.954+0000 7f254ef46800 4 Realm: () 2024-09-12T17:38:04.956 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.954+0000 7f254ef46800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:38:04.956 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.954+0000 7f254ef46800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:38:04.956 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.954+0000 7f254ef46800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:38:04.956 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.954+0000 7f254ef46800 20 zonegroup default 2024-09-12T17:38:04.956 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.954+0000 7f254ef46800 20 rados->read ofs=0 len=0 2024-09-12T17:38:04.957 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.955+0000 7f254ef46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:04.957 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.955+0000 7f254ef46800 20 rados->read ofs=0 len=0 2024-09-12T17:38:04.957 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.955+0000 7f254ef46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:04.957 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.955+0000 7f254ef46800 20 rados->read ofs=0 len=0 2024-09-12T17:38:04.957 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.955+0000 7f254ef46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:04.958 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.955+0000 7f254ef46800 20 started sync module instance, tier type = 2024-09-12T17:38:04.958 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.955+0000 7f254ef46800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:38:04.967 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.966+0000 7f254ef46800 20 add_watcher() i=0 2024-09-12T17:38:04.967 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.966+0000 7f254ef46800 20 add_watcher() i=1 2024-09-12T17:38:04.967 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.966+0000 7f254ef46800 20 add_watcher() i=2 2024-09-12T17:38:04.967 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.966+0000 7f254ef46800 20 add_watcher() i=3 2024-09-12T17:38:04.967 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.966+0000 7f254ef46800 20 add_watcher() i=4 2024-09-12T17:38:04.967 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.966+0000 7f254ef46800 20 add_watcher() i=5 2024-09-12T17:38:04.967 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.966+0000 7f254ef46800 20 add_watcher() i=6 2024-09-12T17:38:04.967 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.967+0000 7f254ef46800 20 add_watcher() i=7 2024-09-12T17:38:04.968 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.967+0000 7f254ef46800 2 all 8 watchers are set, enabling cache 2024-09-12T17:38:04.969 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.969+0000 7f24037e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:38:04.970 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.969+0000 7f254ef46800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:38:04.970 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.969+0000 7f254ef46800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:38:04.970 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.969+0000 7f254ef46800 5 note: GC not initialized 2024-09-12T17:38:04.971 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.969+0000 7f24027e4640 20 reqs_thread_entry: start 2024-09-12T17:38:04.971 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.970+0000 7f254ef46800 20 init_complete bucket index max shards: 11 2024-09-12T17:38:04.971 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.970+0000 7f254ef46800 20 Filter name: none 2024-09-12T17:38:04.971 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.970+0000 7f23fbfff640 20 reqs_thread_entry: start 2024-09-12T17:38:04.971 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.970+0000 7f254ef46800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:38:04.971 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.970+0000 7f254ef46800 20 rados->read ofs=0 len=0 2024-09-12T17:38:04.972 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.970+0000 7f254ef46800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:38:04.972 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.970+0000 7f254ef46800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:38:04.972 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.970+0000 7f254ef46800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:38:04.972 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.970+0000 7f254ef46800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 : miss 2024-09-12T17:38:04.972 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.970+0000 7f254ef46800 20 rados->read ofs=0 len=0 2024-09-12T17:38:04.972 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.971+0000 7f254ef46800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T17:38:04.972 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.971+0000 7f254ef46800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 info.flags=0x17 2024-09-12T17:38:04.972 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.971+0000 7f254ef46800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 to cache LRU end 2024-09-12T17:38:04.972 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.971+0000 7f254ef46800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:38:04.973 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.971+0000 7f254ef46800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:38:04.973 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.971+0000 7f254ef46800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 2024-09-12T17:38:04.973 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.971+0000 7f254ef46800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.0 2024-09-12T17:38:04.973 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.971+0000 7f254ef46800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.0 2024-09-12T17:38:04.973 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.972+0000 7f254ef46800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.1 2024-09-12T17:38:04.973 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.972+0000 7f254ef46800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.1 2024-09-12T17:38:04.974 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.972+0000 7f254ef46800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.2 2024-09-12T17:38:04.974 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.972+0000 7f254ef46800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.2 2024-09-12T17:38:04.974 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.972+0000 7f254ef46800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.3 2024-09-12T17:38:04.974 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.972+0000 7f254ef46800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.3 2024-09-12T17:38:04.974 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.973+0000 7f254ef46800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.4 2024-09-12T17:38:04.975 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.973+0000 7f254ef46800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.4 2024-09-12T17:38:04.975 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.973+0000 7f254ef46800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.5 2024-09-12T17:38:04.975 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.973+0000 7f254ef46800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.5 2024-09-12T17:38:04.975 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.974+0000 7f254ef46800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.6 2024-09-12T17:38:04.975 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.974+0000 7f254ef46800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.6 2024-09-12T17:38:04.975 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.974+0000 7f254ef46800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.7 2024-09-12T17:38:04.975 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.974+0000 7f254ef46800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.7 2024-09-12T17:38:04.976 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.975+0000 7f254ef46800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.8 2024-09-12T17:38:04.976 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.975+0000 7f254ef46800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.8 2024-09-12T17:38:04.976 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.975+0000 7f254ef46800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.9 2024-09-12T17:38:04.976 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.975+0000 7f254ef46800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.9 2024-09-12T17:38:04.976 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.975+0000 7f254ef46800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.10 2024-09-12T17:38:04.976 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.975+0000 7f254ef46800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.10 2024-09-12T17:38:04.977 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.976+0000 7f254ef46800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.11 2024-09-12T17:38:04.977 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.976+0000 7f254ef46800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.11 2024-09-12T17:38:04.977 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.976+0000 7f254ef46800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.12 2024-09-12T17:38:04.977 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.976+0000 7f254ef46800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.12 2024-09-12T17:38:04.978 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.977+0000 7f24037e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:38:04.981 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.980+0000 7f254ef46800 20 remove_watcher() i=0 2024-09-12T17:38:04.981 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.980+0000 7f254ef46800 2 removed watcher, disabling cache 2024-09-12T17:38:04.982 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.981+0000 7f254ef46800 20 remove_watcher() i=1 2024-09-12T17:38:04.983 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.982+0000 7f254ef46800 20 remove_watcher() i=2 2024-09-12T17:38:04.984 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.984+0000 7f254ef46800 20 remove_watcher() i=3 2024-09-12T17:38:04.985 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.985+0000 7f254ef46800 20 remove_watcher() i=4 2024-09-12T17:38:04.987 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.986+0000 7f254ef46800 20 remove_watcher() i=5 2024-09-12T17:38:04.988 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.987+0000 7f254ef46800 20 remove_watcher() i=6 2024-09-12T17:38:04.989 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:04.988+0000 7f254ef46800 20 remove_watcher() i=7 2024-09-12T17:38:05.001 INFO:tasks.workunit.client.0.smithi037.stderr: test: duplicated entries can be purged manually 2024-09-12T17:38:35.025 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T17:38:35.058 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:38:35.058 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:38:35.104 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.103+0000 7f011812d800 20 rados->read ofs=0 len=0 2024-09-12T17:38:35.106 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.105+0000 7f011812d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:35.106 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.105+0000 7f011812d800 20 realm 2024-09-12T17:38:35.106 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.105+0000 7f011812d800 20 rados->read ofs=0 len=0 2024-09-12T17:38:35.107 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.105+0000 7f011812d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:35.107 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.105+0000 7f011812d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:38:35.107 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.105+0000 7f011812d800 20 rados->read ofs=0 len=0 2024-09-12T17:38:35.107 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.106+0000 7f011812d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:35.107 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.106+0000 7f011812d800 20 rados->read ofs=0 len=0 2024-09-12T17:38:35.107 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.106+0000 7f011812d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:38:35.107 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.106+0000 7f011812d800 20 rados->read ofs=0 len=0 2024-09-12T17:38:35.107 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.107+0000 7f011812d800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:38:35.108 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.107+0000 7f011812d800 20 searching for the correct realm 2024-09-12T17:38:35.110 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.109+0000 7f0113e76640 0 -- 172.21.15.37:0/328600246 >> [v2:172.21.15.37:6800/1206746176,v1:172.21.15.37:6801/1206746176] conn(0x7f010c0aeb50 msgr2=0x7f010c0a4a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:38:35.114 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.113+0000 7f0113e76640 0 -- 172.21.15.37:0/328600246 >> [v2:172.21.15.37:6800/1206746176,v1:172.21.15.37:6801/1206746176] conn(0x7effdc086af0 msgr2=0x7effdc088f20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:38:35.121 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.120+0000 7f011812d800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:38:35.121 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.120+0000 7f011812d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:38:35.121 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.120+0000 7f011812d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:38:35.122 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.120+0000 7f011812d800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:38:35.122 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.120+0000 7f011812d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:38:35.122 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.120+0000 7f011812d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:38:35.122 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.120+0000 7f011812d800 20 rados->read ofs=0 len=0 2024-09-12T17:38:35.122 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.120+0000 7f011812d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:35.122 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.120+0000 7f011812d800 20 rados->read ofs=0 len=0 2024-09-12T17:38:35.122 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.121+0000 7f011812d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:38:35.122 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.121+0000 7f011812d800 20 rados->read ofs=0 len=0 2024-09-12T17:38:35.123 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.121+0000 7f011812d800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:38:35.123 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.121+0000 7f011812d800 20 zone default found 2024-09-12T17:38:35.123 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.121+0000 7f011812d800 4 Realm: () 2024-09-12T17:38:35.123 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.121+0000 7f011812d800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:38:35.123 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.121+0000 7f011812d800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:38:35.124 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.121+0000 7f011812d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:38:35.124 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.121+0000 7f011812d800 20 zonegroup default 2024-09-12T17:38:35.124 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.121+0000 7f011812d800 20 rados->read ofs=0 len=0 2024-09-12T17:38:35.124 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.121+0000 7f011812d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:35.124 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.122+0000 7f011812d800 20 rados->read ofs=0 len=0 2024-09-12T17:38:35.124 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.122+0000 7f011812d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:35.124 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.122+0000 7f011812d800 20 rados->read ofs=0 len=0 2024-09-12T17:38:35.124 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.122+0000 7f011812d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:35.124 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.122+0000 7f011812d800 20 started sync module instance, tier type = 2024-09-12T17:38:35.124 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.122+0000 7f011812d800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:38:35.133 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.132+0000 7f011812d800 20 add_watcher() i=0 2024-09-12T17:38:35.133 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.132+0000 7f011812d800 20 add_watcher() i=1 2024-09-12T17:38:35.133 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.132+0000 7f011812d800 20 add_watcher() i=2 2024-09-12T17:38:35.133 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.132+0000 7f011812d800 20 add_watcher() i=3 2024-09-12T17:38:35.133 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.132+0000 7f011812d800 20 add_watcher() i=4 2024-09-12T17:38:35.133 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.132+0000 7f011812d800 20 add_watcher() i=5 2024-09-12T17:38:35.133 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.132+0000 7f011812d800 20 add_watcher() i=6 2024-09-12T17:38:35.134 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.133+0000 7f011812d800 20 add_watcher() i=7 2024-09-12T17:38:35.134 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.133+0000 7f011812d800 2 all 8 watchers are set, enabling cache 2024-09-12T17:38:35.135 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.135+0000 7effc9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:38:35.136 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.135+0000 7f011812d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:38:35.137 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.135+0000 7f011812d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:38:35.137 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.135+0000 7f011812d800 5 note: GC not initialized 2024-09-12T17:38:35.137 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.135+0000 7effc8fe1640 20 reqs_thread_entry: start 2024-09-12T17:38:35.137 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.136+0000 7f011812d800 20 init_complete bucket index max shards: 11 2024-09-12T17:38:35.137 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.136+0000 7f011812d800 20 Filter name: none 2024-09-12T17:38:35.137 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.136+0000 7eff427fc640 20 reqs_thread_entry: start 2024-09-12T17:38:35.137 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.136+0000 7f011812d800 20 rados->read ofs=0 len=0 2024-09-12T17:38:35.138 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.136+0000 7f011812d800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:38:35.138 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.136+0000 7f011812d800 20 rados->read ofs=0 len=0 2024-09-12T17:38:35.138 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.137+0000 7f011812d800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T17:38:35.138 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.137+0000 7f011812d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:38:35.138 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.137+0000 7f011812d800 20 rados->read ofs=0 len=0 2024-09-12T17:38:35.138 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.137+0000 7f011812d800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:38:35.138 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.137+0000 7f011812d800 20 rados->read ofs=0 len=0 2024-09-12T17:38:35.139 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.138+0000 7f011812d800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T17:38:35.139 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.138+0000 7f011812d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:38:35.141 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.140+0000 7effc9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:38:35.143 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.142+0000 7f011812d800 20 remove_watcher() i=0 2024-09-12T17:38:35.143 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.142+0000 7f011812d800 2 removed watcher, disabling cache 2024-09-12T17:38:35.144 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.144+0000 7f011812d800 20 remove_watcher() i=1 2024-09-12T17:38:35.146 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.145+0000 7f011812d800 20 remove_watcher() i=2 2024-09-12T17:38:35.147 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.146+0000 7f011812d800 20 remove_watcher() i=3 2024-09-12T17:38:35.148 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.147+0000 7f011812d800 20 remove_watcher() i=4 2024-09-12T17:38:35.149 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.148+0000 7f011812d800 20 remove_watcher() i=5 2024-09-12T17:38:35.150 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.149+0000 7f011812d800 20 remove_watcher() i=6 2024-09-12T17:38:35.151 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.150+0000 7f011812d800 20 remove_watcher() i=7 2024-09-12T17:38:35.163 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:38:35.163 INFO:tasks.workunit.client.0.smithi037.stderr:BUCKET_STATS: 2024-09-12T17:38:35.163 INFO:tasks.workunit.client.0.smithi037.stderr:bucket: a-bucket id: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 num_objects: 11 size_kb: 1 num_shards: 13 2024-09-12T17:38:35.163 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:38:35.164 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 14 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at do_reshard 2024-09-12T17:38:35.199 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:38:35.199 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:38:35.239 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.238+0000 7f6068742800 20 rados->read ofs=0 len=0 2024-09-12T17:38:35.240 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.239+0000 7f6068742800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:35.240 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.239+0000 7f6068742800 20 realm 2024-09-12T17:38:35.240 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.239+0000 7f6068742800 20 rados->read ofs=0 len=0 2024-09-12T17:38:35.240 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.239+0000 7f6068742800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:35.241 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.239+0000 7f6068742800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:38:35.241 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.239+0000 7f6068742800 20 rados->read ofs=0 len=0 2024-09-12T17:38:35.241 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.239+0000 7f6068742800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:35.241 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.239+0000 7f6068742800 20 rados->read ofs=0 len=0 2024-09-12T17:38:35.241 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.240+0000 7f6068742800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:38:35.241 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.240+0000 7f6068742800 20 rados->read ofs=0 len=0 2024-09-12T17:38:35.242 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.241+0000 7f6068742800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:38:35.242 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.241+0000 7f6068742800 20 searching for the correct realm 2024-09-12T17:38:35.446 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.446+0000 7f6063c85640 0 -- 172.21.15.37:0/1307656127 >> [v2:172.21.15.40:6800/2441293461,v1:172.21.15.40:6801/2441293461] conn(0x7f6054098040 msgr2=0x7f6054001030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:38:35.452 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.451+0000 7f6064486640 0 -- 172.21.15.37:0/1307656127 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7f60580a23f0 msgr2=0x7f60580a2870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:38:35.660 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.659+0000 7f6068742800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:38:35.660 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.659+0000 7f6068742800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:38:35.661 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.659+0000 7f6068742800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:38:35.661 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.659+0000 7f6068742800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:38:35.661 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.659+0000 7f6068742800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:38:35.661 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.659+0000 7f6068742800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:38:35.661 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.659+0000 7f6068742800 20 rados->read ofs=0 len=0 2024-09-12T17:38:35.661 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.660+0000 7f6068742800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:35.661 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.660+0000 7f6068742800 20 rados->read ofs=0 len=0 2024-09-12T17:38:35.662 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.660+0000 7f6068742800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:38:35.662 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.660+0000 7f6068742800 20 rados->read ofs=0 len=0 2024-09-12T17:38:35.662 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.661+0000 7f6068742800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:38:35.662 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.661+0000 7f6068742800 20 zone default found 2024-09-12T17:38:35.662 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.661+0000 7f6068742800 4 Realm: () 2024-09-12T17:38:35.662 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.661+0000 7f6068742800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:38:35.663 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.661+0000 7f6068742800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:38:35.663 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.661+0000 7f6068742800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:38:35.663 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.661+0000 7f6068742800 20 zonegroup default 2024-09-12T17:38:35.663 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.661+0000 7f6068742800 20 rados->read ofs=0 len=0 2024-09-12T17:38:35.663 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.661+0000 7f6068742800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:35.663 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.661+0000 7f6068742800 20 rados->read ofs=0 len=0 2024-09-12T17:38:35.663 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.661+0000 7f6068742800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:35.663 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.661+0000 7f6068742800 20 rados->read ofs=0 len=0 2024-09-12T17:38:35.664 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.662+0000 7f6068742800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:35.664 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.662+0000 7f6068742800 20 started sync module instance, tier type = 2024-09-12T17:38:35.664 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.662+0000 7f6068742800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:38:35.674 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.673+0000 7f6068742800 20 add_watcher() i=0 2024-09-12T17:38:35.674 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.673+0000 7f6068742800 20 add_watcher() i=1 2024-09-12T17:38:35.674 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.673+0000 7f6068742800 20 add_watcher() i=2 2024-09-12T17:38:35.674 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.673+0000 7f6068742800 20 add_watcher() i=3 2024-09-12T17:38:35.674 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.673+0000 7f6068742800 20 add_watcher() i=4 2024-09-12T17:38:35.674 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.673+0000 7f6068742800 20 add_watcher() i=5 2024-09-12T17:38:35.674 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.673+0000 7f6068742800 20 add_watcher() i=6 2024-09-12T17:38:35.675 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.674+0000 7f6068742800 20 add_watcher() i=7 2024-09-12T17:38:35.675 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.674+0000 7f6068742800 2 all 8 watchers are set, enabling cache 2024-09-12T17:38:35.677 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.677+0000 7f5f1a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:38:35.678 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.677+0000 7f6068742800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:38:35.678 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.677+0000 7f6068742800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:38:35.678 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.677+0000 7f6068742800 5 note: GC not initialized 2024-09-12T17:38:35.678 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.677+0000 7f5f197e2640 20 reqs_thread_entry: start 2024-09-12T17:38:35.678 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.677+0000 7f6068742800 20 init_complete bucket index max shards: 11 2024-09-12T17:38:35.679 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.677+0000 7f6068742800 20 Filter name: none 2024-09-12T17:38:35.679 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.678+0000 7f5e8affd640 20 reqs_thread_entry: start 2024-09-12T17:38:35.679 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.678+0000 7f6068742800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:38:35.679 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.678+0000 7f6068742800 20 rados->read ofs=0 len=0 2024-09-12T17:38:35.680 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.678+0000 7f6068742800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:38:35.680 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.678+0000 7f6068742800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:38:35.680 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.678+0000 7f6068742800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:38:35.680 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.678+0000 7f6068742800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 : miss 2024-09-12T17:38:35.680 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.678+0000 7f6068742800 20 rados->read ofs=0 len=0 2024-09-12T17:38:35.680 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.679+0000 7f6068742800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T17:38:35.680 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.679+0000 7f6068742800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 info.flags=0x17 2024-09-12T17:38:35.680 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.679+0000 7f6068742800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 to cache LRU end 2024-09-12T17:38:35.680 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.679+0000 7f6068742800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:38:35.680 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.679+0000 7f6068742800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:38:35.680 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.679+0000 7f6068742800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 2024-09-12T17:38:35.681 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.680+0000 7f6068742800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T17:38:35.689 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.689+0000 7f6068742800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 info.flags=0x17 2024-09-12T17:38:35.690 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.689+0000 7f6068742800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 to cache LRU end 2024-09-12T17:38:35.690 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.689+0000 7f6068742800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:38:35.690 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.689+0000 7f6068742800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18, ofs0, ns] 2024-09-12T17:38:35.690 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.689+0000 7f5f3affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497021 cookie 94433256320512 notifier 8397 bl.length()=911 2024-09-12T17:38:35.690 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.689+0000 7f5f3affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 info.flags=0x17 2024-09-12T17:38:35.690 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.689+0000 7f5f3affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 to cache LRU end 2024-09-12T17:38:35.690 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.689+0000 7f5f3affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:38:35.692 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.691+0000 7f6068742800 20 handle_bi_update(): bucket=:a-bucket[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18]): orig_sources= new_sources= 2024-09-12T17:38:35.692 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.691+0000 7f6068742800 20 handle_bi_update(): bucket=:a-bucket[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18]): potential sources added=[] removed=[] 2024-09-12T17:38:35.692 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.691+0000 7f6068742800 20 handle_bi_update(): bucket=:a-bucket[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18]): orig_dests= new_dests= 2024-09-12T17:38:35.692 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.691+0000 7f6068742800 20 handle_bi_update(): bucket=:a-bucket[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18]): potential dests added=[] removed=[] 2024-09-12T17:38:35.697 INFO:tasks.workunit.client.0.smithi037.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f6068742800 time 2024-09-12T17:38:35.698004+0000 2024-09-12T17:38:35.698 INFO:tasks.workunit.client.0.smithi037.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:38:35.698 INFO:tasks.workunit.client.0.smithi037.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:38:35.698 INFO:tasks.workunit.client.0.smithi037.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f6069f8c71a] 2024-09-12T17:38:35.698 INFO:tasks.workunit.client.0.smithi037.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f6069f8c8d8] 2024-09-12T17:38:35.698 INFO:tasks.workunit.client.0.smithi037.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e2f3348841] 2024-09-12T17:38:35.699 INFO:tasks.workunit.client.0.smithi037.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55e2f335857a] 2024-09-12T17:38:35.699 INFO:tasks.workunit.client.0.smithi037.stderr: 5: main() 2024-09-12T17:38:35.699 INFO:tasks.workunit.client.0.smithi037.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f6068c29590] 2024-09-12T17:38:35.699 INFO:tasks.workunit.client.0.smithi037.stderr: 7: __libc_start_main() 2024-09-12T17:38:35.699 INFO:tasks.workunit.client.0.smithi037.stderr: 8: _start() 2024-09-12T17:38:35.699 INFO:tasks.workunit.client.0.smithi037.stderr:*** Caught signal (Aborted) ** 2024-09-12T17:38:35.699 INFO:tasks.workunit.client.0.smithi037.stderr: in thread 7f6068742800 thread_name:radosgw-admin 2024-09-12T17:38:35.699 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.698+0000 7f6068742800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f6068742800 time 2024-09-12T17:38:35.698004+0000 2024-09-12T17:38:35.699 INFO:tasks.workunit.client.0.smithi037.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:38:35.699 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:38:35.699 INFO:tasks.workunit.client.0.smithi037.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:38:35.699 INFO:tasks.workunit.client.0.smithi037.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f6069f8c71a] 2024-09-12T17:38:35.700 INFO:tasks.workunit.client.0.smithi037.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f6069f8c8d8] 2024-09-12T17:38:35.700 INFO:tasks.workunit.client.0.smithi037.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e2f3348841] 2024-09-12T17:38:35.700 INFO:tasks.workunit.client.0.smithi037.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55e2f335857a] 2024-09-12T17:38:35.700 INFO:tasks.workunit.client.0.smithi037.stderr: 5: main() 2024-09-12T17:38:35.700 INFO:tasks.workunit.client.0.smithi037.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f6068c29590] 2024-09-12T17:38:35.700 INFO:tasks.workunit.client.0.smithi037.stderr: 7: __libc_start_main() 2024-09-12T17:38:35.700 INFO:tasks.workunit.client.0.smithi037.stderr: 8: _start() 2024-09-12T17:38:35.700 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:38:35.722 INFO:tasks.workunit.client.0.smithi037.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:38:35.723 INFO:tasks.workunit.client.0.smithi037.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f6068c3e6f0] 2024-09-12T17:38:35.723 INFO:tasks.workunit.client.0.smithi037.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f6068c8b99c] 2024-09-12T17:38:35.723 INFO:tasks.workunit.client.0.smithi037.stderr: 3: raise() 2024-09-12T17:38:35.723 INFO:tasks.workunit.client.0.smithi037.stderr: 4: abort() 2024-09-12T17:38:35.723 INFO:tasks.workunit.client.0.smithi037.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f6069f8c774] 2024-09-12T17:38:35.723 INFO:tasks.workunit.client.0.smithi037.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f6069f8c8d8] 2024-09-12T17:38:35.723 INFO:tasks.workunit.client.0.smithi037.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e2f3348841] 2024-09-12T17:38:35.723 INFO:tasks.workunit.client.0.smithi037.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55e2f335857a] 2024-09-12T17:38:35.723 INFO:tasks.workunit.client.0.smithi037.stderr: 9: main() 2024-09-12T17:38:35.723 INFO:tasks.workunit.client.0.smithi037.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f6068c29590] 2024-09-12T17:38:35.723 INFO:tasks.workunit.client.0.smithi037.stderr: 11: __libc_start_main() 2024-09-12T17:38:35.723 INFO:tasks.workunit.client.0.smithi037.stderr: 12: _start() 2024-09-12T17:38:35.723 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.698+0000 7f6068742800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:38:35.724 INFO:tasks.workunit.client.0.smithi037.stderr: in thread 7f6068742800 thread_name:radosgw-admin 2024-09-12T17:38:35.724 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:38:35.724 INFO:tasks.workunit.client.0.smithi037.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:38:35.724 INFO:tasks.workunit.client.0.smithi037.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f6068c3e6f0] 2024-09-12T17:38:35.724 INFO:tasks.workunit.client.0.smithi037.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f6068c8b99c] 2024-09-12T17:38:35.724 INFO:tasks.workunit.client.0.smithi037.stderr: 3: raise() 2024-09-12T17:38:35.724 INFO:tasks.workunit.client.0.smithi037.stderr: 4: abort() 2024-09-12T17:38:35.724 INFO:tasks.workunit.client.0.smithi037.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f6069f8c774] 2024-09-12T17:38:35.724 INFO:tasks.workunit.client.0.smithi037.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f6069f8c8d8] 2024-09-12T17:38:35.724 INFO:tasks.workunit.client.0.smithi037.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e2f3348841] 2024-09-12T17:38:35.724 INFO:tasks.workunit.client.0.smithi037.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55e2f335857a] 2024-09-12T17:38:35.724 INFO:tasks.workunit.client.0.smithi037.stderr: 9: main() 2024-09-12T17:38:35.725 INFO:tasks.workunit.client.0.smithi037.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f6068c29590] 2024-09-12T17:38:35.725 INFO:tasks.workunit.client.0.smithi037.stderr: 11: __libc_start_main() 2024-09-12T17:38:35.725 INFO:tasks.workunit.client.0.smithi037.stderr: 12: _start() 2024-09-12T17:38:35.725 INFO:tasks.workunit.client.0.smithi037.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:38:35.725 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:38:35.725 INFO:tasks.workunit.client.0.smithi037.stderr:--- begin dump of recent events --- 2024-09-12T17:38:35.725 INFO:tasks.workunit.client.0.smithi037.stderr: -499> 2024-09-12T17:38:35.220+0000 7f5f5260c640 10 monclient: handle_config config(0 keys) 2024-09-12T17:38:35.725 INFO:tasks.workunit.client.0.smithi037.stderr: -498> 2024-09-12T17:38:35.220+0000 7f6068742800 5 monclient: authenticate success, global_id 8385 2024-09-12T17:38:35.725 INFO:tasks.workunit.client.0.smithi037.stderr: -497> 2024-09-12T17:38:35.220+0000 7f6068742800 10 monclient: get_monmap_and_config success 2024-09-12T17:38:35.725 INFO:tasks.workunit.client.0.smithi037.stderr: -496> 2024-09-12T17:38:35.220+0000 7f6068742800 4 set_mon_vals no callback set 2024-09-12T17:38:35.725 INFO:tasks.workunit.client.0.smithi037.stderr: -495> 2024-09-12T17:38:35.220+0000 7f5f5260c640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:38:35.725 INFO:tasks.workunit.client.0.smithi037.stderr: -494> 2024-09-12T17:38:35.220+0000 7f5f5260c640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:38:35.725 INFO:tasks.workunit.client.0.smithi037.stderr: -493> 2024-09-12T17:38:35.220+0000 7f5f5260c640 10 monclient: dump: 2024-09-12T17:38:35.726 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:38:35.726 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:38:35.726 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:38:35.726 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:38:35.726 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:38:35.726 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:38:35.726 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:38:35.726 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:38:35.726 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:38:35.726 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:38:35.726 INFO:tasks.workunit.client.0.smithi037.stderr: -492> 2024-09-12T17:38:35.220+0000 7f6068742800 10 monclient: shutdown 2024-09-12T17:38:35.726 INFO:tasks.workunit.client.0.smithi037.stderr: -491> 2024-09-12T17:38:35.220+0000 7f6068742800 5 asok(0x55e2f480b730) unregister_commands rotate-key 2024-09-12T17:38:35.726 INFO:tasks.workunit.client.0.smithi037.stderr: -490> 2024-09-12T17:38:35.221+0000 7f6068742800 10 monclient: build_initial_monmap 2024-09-12T17:38:35.726 INFO:tasks.workunit.client.0.smithi037.stderr: -489> 2024-09-12T17:38:35.221+0000 7f6068742800 1 build_initial for_mkfs: 0 2024-09-12T17:38:35.727 INFO:tasks.workunit.client.0.smithi037.stderr: -488> 2024-09-12T17:38:35.221+0000 7f6068742800 10 monclient: monmap: 2024-09-12T17:38:35.727 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 0 2024-09-12T17:38:35.727 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:38:35.727 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 0.000000 2024-09-12T17:38:35.727 INFO:tasks.workunit.client.0.smithi037.stderr:created 0.000000 2024-09-12T17:38:35.727 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 0 (unknown) 2024-09-12T17:38:35.727 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:38:35.727 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.noname-a 2024-09-12T17:38:35.727 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.noname-b 2024-09-12T17:38:35.727 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.noname-c 2024-09-12T17:38:35.727 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:38:35.727 INFO:tasks.workunit.client.0.smithi037.stderr: -487> 2024-09-12T17:38:35.221+0000 7f6068742800 5 AuthRegistry(0x55e2f4a346c0) adding auth protocol: cephx 2024-09-12T17:38:35.727 INFO:tasks.workunit.client.0.smithi037.stderr: -486> 2024-09-12T17:38:35.221+0000 7f6068742800 5 AuthRegistry(0x55e2f4a346c0) adding auth protocol: cephx 2024-09-12T17:38:35.728 INFO:tasks.workunit.client.0.smithi037.stderr: -485> 2024-09-12T17:38:35.221+0000 7f6068742800 5 AuthRegistry(0x55e2f4a346c0) adding auth protocol: cephx 2024-09-12T17:38:35.728 INFO:tasks.workunit.client.0.smithi037.stderr: -484> 2024-09-12T17:38:35.221+0000 7f6068742800 5 AuthRegistry(0x55e2f4a346c0) adding con mode: secure 2024-09-12T17:38:35.728 INFO:tasks.workunit.client.0.smithi037.stderr: -483> 2024-09-12T17:38:35.221+0000 7f6068742800 5 AuthRegistry(0x55e2f4a346c0) adding con mode: crc 2024-09-12T17:38:35.728 INFO:tasks.workunit.client.0.smithi037.stderr: -482> 2024-09-12T17:38:35.221+0000 7f6068742800 5 AuthRegistry(0x55e2f4a346c0) adding con mode: secure 2024-09-12T17:38:35.728 INFO:tasks.workunit.client.0.smithi037.stderr: -481> 2024-09-12T17:38:35.221+0000 7f6068742800 5 AuthRegistry(0x55e2f4a346c0) adding con mode: crc 2024-09-12T17:38:35.728 INFO:tasks.workunit.client.0.smithi037.stderr: -480> 2024-09-12T17:38:35.221+0000 7f6068742800 5 AuthRegistry(0x55e2f4a346c0) adding con mode: secure 2024-09-12T17:38:35.728 INFO:tasks.workunit.client.0.smithi037.stderr: -479> 2024-09-12T17:38:35.221+0000 7f6068742800 5 AuthRegistry(0x55e2f4a346c0) adding con mode: crc 2024-09-12T17:38:35.728 INFO:tasks.workunit.client.0.smithi037.stderr: -478> 2024-09-12T17:38:35.221+0000 7f6068742800 5 AuthRegistry(0x55e2f4a346c0) adding con mode: crc 2024-09-12T17:38:35.728 INFO:tasks.workunit.client.0.smithi037.stderr: -477> 2024-09-12T17:38:35.221+0000 7f6068742800 5 AuthRegistry(0x55e2f4a346c0) adding con mode: secure 2024-09-12T17:38:35.728 INFO:tasks.workunit.client.0.smithi037.stderr: -476> 2024-09-12T17:38:35.221+0000 7f6068742800 5 AuthRegistry(0x55e2f4a346c0) adding con mode: crc 2024-09-12T17:38:35.728 INFO:tasks.workunit.client.0.smithi037.stderr: -475> 2024-09-12T17:38:35.221+0000 7f6068742800 5 AuthRegistry(0x55e2f4a346c0) adding con mode: secure 2024-09-12T17:38:35.728 INFO:tasks.workunit.client.0.smithi037.stderr: -474> 2024-09-12T17:38:35.221+0000 7f6068742800 5 AuthRegistry(0x55e2f4a346c0) adding con mode: crc 2024-09-12T17:38:35.728 INFO:tasks.workunit.client.0.smithi037.stderr: -473> 2024-09-12T17:38:35.221+0000 7f6068742800 5 AuthRegistry(0x55e2f4a346c0) adding con mode: secure 2024-09-12T17:38:35.728 INFO:tasks.workunit.client.0.smithi037.stderr: -472> 2024-09-12T17:38:35.221+0000 7f6068742800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:38:35.729 INFO:tasks.workunit.client.0.smithi037.stderr: -471> 2024-09-12T17:38:35.221+0000 7f6068742800 1 librados: starting msgr at 2024-09-12T17:38:35.729 INFO:tasks.workunit.client.0.smithi037.stderr: -470> 2024-09-12T17:38:35.221+0000 7f6068742800 1 librados: starting objecter 2024-09-12T17:38:35.729 INFO:tasks.workunit.client.0.smithi037.stderr: -469> 2024-09-12T17:38:35.221+0000 7f6068742800 5 asok(0x55e2f480b730) register_command objecter_requests hook 0x55e2f4a2fa30 2024-09-12T17:38:35.729 INFO:tasks.workunit.client.0.smithi037.stderr: -468> 2024-09-12T17:38:35.221+0000 7f6068742800 1 librados: setting wanted keys 2024-09-12T17:38:35.729 INFO:tasks.workunit.client.0.smithi037.stderr: -467> 2024-09-12T17:38:35.221+0000 7f6068742800 1 librados: calling monclient init 2024-09-12T17:38:35.729 INFO:tasks.workunit.client.0.smithi037.stderr: -466> 2024-09-12T17:38:35.221+0000 7f6068742800 10 monclient: init 2024-09-12T17:38:35.729 INFO:tasks.workunit.client.0.smithi037.stderr: -465> 2024-09-12T17:38:35.221+0000 7f6068742800 5 AuthRegistry(0x55e2f4a2d0e0) adding auth protocol: cephx 2024-09-12T17:38:35.729 INFO:tasks.workunit.client.0.smithi037.stderr: -464> 2024-09-12T17:38:35.221+0000 7f6068742800 5 AuthRegistry(0x55e2f4a2d0e0) adding auth protocol: cephx 2024-09-12T17:38:35.729 INFO:tasks.workunit.client.0.smithi037.stderr: -463> 2024-09-12T17:38:35.221+0000 7f6068742800 5 AuthRegistry(0x55e2f4a2d0e0) adding auth protocol: cephx 2024-09-12T17:38:35.729 INFO:tasks.workunit.client.0.smithi037.stderr: -462> 2024-09-12T17:38:35.221+0000 7f6068742800 5 AuthRegistry(0x55e2f4a2d0e0) adding con mode: secure 2024-09-12T17:38:35.729 INFO:tasks.workunit.client.0.smithi037.stderr: -461> 2024-09-12T17:38:35.221+0000 7f6068742800 5 AuthRegistry(0x55e2f4a2d0e0) adding con mode: crc 2024-09-12T17:38:35.729 INFO:tasks.workunit.client.0.smithi037.stderr: -460> 2024-09-12T17:38:35.221+0000 7f6068742800 5 AuthRegistry(0x55e2f4a2d0e0) adding con mode: secure 2024-09-12T17:38:35.729 INFO:tasks.workunit.client.0.smithi037.stderr: -459> 2024-09-12T17:38:35.221+0000 7f6068742800 5 AuthRegistry(0x55e2f4a2d0e0) adding con mode: crc 2024-09-12T17:38:35.730 INFO:tasks.workunit.client.0.smithi037.stderr: -458> 2024-09-12T17:38:35.221+0000 7f6068742800 5 AuthRegistry(0x55e2f4a2d0e0) adding con mode: secure 2024-09-12T17:38:35.730 INFO:tasks.workunit.client.0.smithi037.stderr: -457> 2024-09-12T17:38:35.221+0000 7f6068742800 5 AuthRegistry(0x55e2f4a2d0e0) adding con mode: crc 2024-09-12T17:38:35.730 INFO:tasks.workunit.client.0.smithi037.stderr: -456> 2024-09-12T17:38:35.221+0000 7f6068742800 5 AuthRegistry(0x55e2f4a2d0e0) adding con mode: crc 2024-09-12T17:38:35.730 INFO:tasks.workunit.client.0.smithi037.stderr: -455> 2024-09-12T17:38:35.221+0000 7f6068742800 5 AuthRegistry(0x55e2f4a2d0e0) adding con mode: secure 2024-09-12T17:38:35.730 INFO:tasks.workunit.client.0.smithi037.stderr: -454> 2024-09-12T17:38:35.221+0000 7f6068742800 5 AuthRegistry(0x55e2f4a2d0e0) adding con mode: crc 2024-09-12T17:38:35.730 INFO:tasks.workunit.client.0.smithi037.stderr: -453> 2024-09-12T17:38:35.221+0000 7f6068742800 5 AuthRegistry(0x55e2f4a2d0e0) adding con mode: secure 2024-09-12T17:38:35.730 INFO:tasks.workunit.client.0.smithi037.stderr: -452> 2024-09-12T17:38:35.221+0000 7f6068742800 5 AuthRegistry(0x55e2f4a2d0e0) adding con mode: crc 2024-09-12T17:38:35.730 INFO:tasks.workunit.client.0.smithi037.stderr: -451> 2024-09-12T17:38:35.221+0000 7f6068742800 5 AuthRegistry(0x55e2f4a2d0e0) adding con mode: secure 2024-09-12T17:38:35.730 INFO:tasks.workunit.client.0.smithi037.stderr: -450> 2024-09-12T17:38:35.221+0000 7f6068742800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:38:35.730 INFO:tasks.workunit.client.0.smithi037.stderr: -449> 2024-09-12T17:38:35.222+0000 7f6068742800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:38:35.730 INFO:tasks.workunit.client.0.smithi037.stderr: -448> 2024-09-12T17:38:35.222+0000 7f6068742800 5 asok(0x55e2f480b730) register_command rotate-key hook 0x55e2f4a2d228 2024-09-12T17:38:35.730 INFO:tasks.workunit.client.0.smithi037.stderr: -447> 2024-09-12T17:38:35.222+0000 7f6068742800 10 monclient: _reopen_session rank -1 2024-09-12T17:38:35.731 INFO:tasks.workunit.client.0.smithi037.stderr: -446> 2024-09-12T17:38:35.222+0000 7f6068742800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T17:38:35.731 INFO:tasks.workunit.client.0.smithi037.stderr: -445> 2024-09-12T17:38:35.222+0000 7f6068742800 10 monclient(hunting): picked mon.noname-a con 0x55e2f48d8120 addr [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] 2024-09-12T17:38:35.731 INFO:tasks.workunit.client.0.smithi037.stderr: -444> 2024-09-12T17:38:35.222+0000 7f6068742800 10 monclient(hunting): picked mon.noname-b con 0x55e2f496f2f0 addr [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] 2024-09-12T17:38:35.731 INFO:tasks.workunit.client.0.smithi037.stderr: -443> 2024-09-12T17:38:35.222+0000 7f6068742800 10 monclient(hunting): picked mon.noname-c con 0x55e2f4972470 addr [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] 2024-09-12T17:38:35.731 INFO:tasks.workunit.client.0.smithi037.stderr: -442> 2024-09-12T17:38:35.222+0000 7f6068742800 10 monclient(hunting): start opening mon connection 2024-09-12T17:38:35.731 INFO:tasks.workunit.client.0.smithi037.stderr: -441> 2024-09-12T17:38:35.222+0000 7f6068742800 10 monclient(hunting): start opening mon connection 2024-09-12T17:38:35.731 INFO:tasks.workunit.client.0.smithi037.stderr: -440> 2024-09-12T17:38:35.222+0000 7f6068742800 10 monclient(hunting): start opening mon connection 2024-09-12T17:38:35.731 INFO:tasks.workunit.client.0.smithi037.stderr: -439> 2024-09-12T17:38:35.222+0000 7f6068742800 10 monclient(hunting): _renew_subs 2024-09-12T17:38:35.731 INFO:tasks.workunit.client.0.smithi037.stderr: -438> 2024-09-12T17:38:35.222+0000 7f6068742800 10 monclient(hunting): authenticate will time out at 2502.819224s 2024-09-12T17:38:35.731 INFO:tasks.workunit.client.0.smithi037.stderr: -437> 2024-09-12T17:38:35.222+0000 7f6064486640 10 monclient(hunting): get_auth_request con 0x55e2f48d8120 auth_method 0 2024-09-12T17:38:35.731 INFO:tasks.workunit.client.0.smithi037.stderr: -436> 2024-09-12T17:38:35.222+0000 7f6064486640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:38:35.731 INFO:tasks.workunit.client.0.smithi037.stderr: -435> 2024-09-12T17:38:35.222+0000 7f6064486640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:38:35.731 INFO:tasks.workunit.client.0.smithi037.stderr: -434> 2024-09-12T17:38:35.222+0000 7f6064486640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:38:35.732 INFO:tasks.workunit.client.0.smithi037.stderr: -433> 2024-09-12T17:38:35.222+0000 7f6064c87640 10 monclient(hunting): get_auth_request con 0x55e2f4972470 auth_method 0 2024-09-12T17:38:35.732 INFO:tasks.workunit.client.0.smithi037.stderr: -432> 2024-09-12T17:38:35.222+0000 7f6064c87640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:38:35.732 INFO:tasks.workunit.client.0.smithi037.stderr: -431> 2024-09-12T17:38:35.222+0000 7f6064c87640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:38:35.732 INFO:tasks.workunit.client.0.smithi037.stderr: -430> 2024-09-12T17:38:35.222+0000 7f6064c87640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:38:35.732 INFO:tasks.workunit.client.0.smithi037.stderr: -429> 2024-09-12T17:38:35.222+0000 7f6064486640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:38:35.732 INFO:tasks.workunit.client.0.smithi037.stderr: -428> 2024-09-12T17:38:35.222+0000 7f6064486640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:38:35.732 INFO:tasks.workunit.client.0.smithi037.stderr: -427> 2024-09-12T17:38:35.222+0000 7f6064486640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:38:35.732 INFO:tasks.workunit.client.0.smithi037.stderr: -426> 2024-09-12T17:38:35.222+0000 7f6064c87640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:38:35.732 INFO:tasks.workunit.client.0.smithi037.stderr: -425> 2024-09-12T17:38:35.222+0000 7f6064c87640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:38:35.732 INFO:tasks.workunit.client.0.smithi037.stderr: -424> 2024-09-12T17:38:35.222+0000 7f6064c87640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:38:35.732 INFO:tasks.workunit.client.0.smithi037.stderr: -423> 2024-09-12T17:38:35.222+0000 7f6064486640 10 monclient(hunting): handle_auth_done global_id 8388 payload 824 2024-09-12T17:38:35.732 INFO:tasks.workunit.client.0.smithi037.stderr: -422> 2024-09-12T17:38:35.222+0000 7f6064486640 10 monclient: _finish_hunting 0 2024-09-12T17:38:35.732 INFO:tasks.workunit.client.0.smithi037.stderr: -421> 2024-09-12T17:38:35.222+0000 7f6064486640 1 monclient: found mon.noname-a 2024-09-12T17:38:35.732 INFO:tasks.workunit.client.0.smithi037.stderr: -420> 2024-09-12T17:38:35.222+0000 7f6064486640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.37:3300/0 2024-09-12T17:38:35.733 INFO:tasks.workunit.client.0.smithi037.stderr: -419> 2024-09-12T17:38:35.222+0000 7f5f50e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:38:35.733 INFO:tasks.workunit.client.0.smithi037.stderr: -418> 2024-09-12T17:38:35.222+0000 7f5f50e09640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:38:35.733 INFO:tasks.workunit.client.0.smithi037.stderr: -417> 2024-09-12T17:38:35.222+0000 7f5f50e09640 10 monclient: dump: 2024-09-12T17:38:35.733 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:38:35.733 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:38:35.733 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:38:35.733 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:38:35.733 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:38:35.733 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:38:35.733 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:38:35.733 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:38:35.733 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:38:35.733 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:38:35.734 INFO:tasks.workunit.client.0.smithi037.stderr: -416> 2024-09-12T17:38:35.222+0000 7f5f50e09640 10 monclient: _finish_auth 0 2024-09-12T17:38:35.734 INFO:tasks.workunit.client.0.smithi037.stderr: -415> 2024-09-12T17:38:35.222+0000 7f5f50e09640 10 monclient: _check_auth_tickets 2024-09-12T17:38:35.734 INFO:tasks.workunit.client.0.smithi037.stderr: -414> 2024-09-12T17:38:35.222+0000 7f5f50e09640 10 monclient: handle_config config(0 keys) 2024-09-12T17:38:35.734 INFO:tasks.workunit.client.0.smithi037.stderr: -413> 2024-09-12T17:38:35.222+0000 7f5f50e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:38:35.734 INFO:tasks.workunit.client.0.smithi037.stderr: -412> 2024-09-12T17:38:35.222+0000 7f5f50e09640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:38:35.734 INFO:tasks.workunit.client.0.smithi037.stderr: -411> 2024-09-12T17:38:35.222+0000 7f5f50e09640 10 monclient: dump: 2024-09-12T17:38:35.734 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:38:35.734 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:38:35.734 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:38:35.734 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:38:35.734 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:38:35.734 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:38:35.734 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:38:35.734 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:38:35.735 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:38:35.735 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:38:35.735 INFO:tasks.workunit.client.0.smithi037.stderr: -410> 2024-09-12T17:38:35.222+0000 7f6068742800 5 monclient: authenticate success, global_id 8388 2024-09-12T17:38:35.735 INFO:tasks.workunit.client.0.smithi037.stderr: -409> 2024-09-12T17:38:35.222+0000 7f6068742800 10 monclient: _renew_subs 2024-09-12T17:38:35.735 INFO:tasks.workunit.client.0.smithi037.stderr: -408> 2024-09-12T17:38:35.222+0000 7f6068742800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.37:3300/0 2024-09-12T17:38:35.735 INFO:tasks.workunit.client.0.smithi037.stderr: -407> 2024-09-12T17:38:35.222+0000 7f5f5260c640 4 set_mon_vals no callback set 2024-09-12T17:38:35.735 INFO:tasks.workunit.client.0.smithi037.stderr: -406> 2024-09-12T17:38:35.222+0000 7f6068742800 10 monclient: _renew_subs 2024-09-12T17:38:35.735 INFO:tasks.workunit.client.0.smithi037.stderr: -405> 2024-09-12T17:38:35.222+0000 7f6068742800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.37:3300/0 2024-09-12T17:38:35.735 INFO:tasks.workunit.client.0.smithi037.stderr: -404> 2024-09-12T17:38:35.222+0000 7f6068742800 1 librados: init done 2024-09-12T17:38:35.735 INFO:tasks.workunit.client.0.smithi037.stderr: -403> 2024-09-12T17:38:35.224+0000 7f5f50e09640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:38:35.735 INFO:tasks.workunit.client.0.smithi037.stderr: -402> 2024-09-12T17:38:35.224+0000 7f5f50e09640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.40:6816/3916250676,v1:172.21.15.40:6817/3916250676] 2024-09-12T17:38:35.735 INFO:tasks.workunit.client.0.smithi037.stderr: -401> 2024-09-12T17:38:35.224+0000 7f5f50e09640 4 mgrc reconnect Starting new session with [v2:172.21.15.40:6816/3916250676,v1:172.21.15.40:6817/3916250676] 2024-09-12T17:38:35.735 INFO:tasks.workunit.client.0.smithi037.stderr: -400> 2024-09-12T17:38:35.225+0000 7f6063c85640 10 monclient: get_auth_request con 0x7f5f4c076470 auth_method 0 2024-09-12T17:38:35.735 INFO:tasks.workunit.client.0.smithi037.stderr: -399> 2024-09-12T17:38:35.225+0000 7f6064c87640 10 monclient: get_auth_request con 0x55e2f4a6dbb0 auth_method 0 2024-09-12T17:38:35.736 INFO:tasks.workunit.client.0.smithi037.stderr: -398> 2024-09-12T17:38:35.226+0000 7f6064486640 10 monclient: get_auth_request con 0x55e2f4a78ec0 auth_method 0 2024-09-12T17:38:35.736 INFO:tasks.workunit.client.0.smithi037.stderr: -397> 2024-09-12T17:38:35.227+0000 7f6063c85640 10 monclient: get_auth_request con 0x55e2f4a7e400 auth_method 0 2024-09-12T17:38:35.736 INFO:tasks.workunit.client.0.smithi037.stderr: -396> 2024-09-12T17:38:35.228+0000 7f6068742800 10 monclient: build_initial_monmap 2024-09-12T17:38:35.736 INFO:tasks.workunit.client.0.smithi037.stderr: -395> 2024-09-12T17:38:35.228+0000 7f6068742800 1 build_initial for_mkfs: 0 2024-09-12T17:38:35.736 INFO:tasks.workunit.client.0.smithi037.stderr: -394> 2024-09-12T17:38:35.228+0000 7f6068742800 10 monclient: monmap: 2024-09-12T17:38:35.736 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 0 2024-09-12T17:38:35.736 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:38:35.736 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 0.000000 2024-09-12T17:38:35.736 INFO:tasks.workunit.client.0.smithi037.stderr:created 0.000000 2024-09-12T17:38:35.736 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 0 (unknown) 2024-09-12T17:38:35.736 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:38:35.736 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.noname-a 2024-09-12T17:38:35.736 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.noname-b 2024-09-12T17:38:35.737 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.noname-c 2024-09-12T17:38:35.737 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:38:35.737 INFO:tasks.workunit.client.0.smithi037.stderr: -393> 2024-09-12T17:38:35.228+0000 7f6068742800 5 AuthRegistry(0x55e2f4a82330) adding auth protocol: cephx 2024-09-12T17:38:35.737 INFO:tasks.workunit.client.0.smithi037.stderr: -392> 2024-09-12T17:38:35.228+0000 7f6068742800 5 AuthRegistry(0x55e2f4a82330) adding auth protocol: cephx 2024-09-12T17:38:35.737 INFO:tasks.workunit.client.0.smithi037.stderr: -391> 2024-09-12T17:38:35.228+0000 7f6068742800 5 AuthRegistry(0x55e2f4a82330) adding auth protocol: cephx 2024-09-12T17:38:35.737 INFO:tasks.workunit.client.0.smithi037.stderr: -390> 2024-09-12T17:38:35.228+0000 7f6068742800 5 AuthRegistry(0x55e2f4a82330) adding con mode: secure 2024-09-12T17:38:35.737 INFO:tasks.workunit.client.0.smithi037.stderr: -389> 2024-09-12T17:38:35.228+0000 7f6068742800 5 AuthRegistry(0x55e2f4a82330) adding con mode: crc 2024-09-12T17:38:35.737 INFO:tasks.workunit.client.0.smithi037.stderr: -388> 2024-09-12T17:38:35.228+0000 7f6068742800 5 AuthRegistry(0x55e2f4a82330) adding con mode: secure 2024-09-12T17:38:35.737 INFO:tasks.workunit.client.0.smithi037.stderr: -387> 2024-09-12T17:38:35.228+0000 7f6068742800 5 AuthRegistry(0x55e2f4a82330) adding con mode: crc 2024-09-12T17:38:35.737 INFO:tasks.workunit.client.0.smithi037.stderr: -386> 2024-09-12T17:38:35.228+0000 7f6068742800 5 AuthRegistry(0x55e2f4a82330) adding con mode: secure 2024-09-12T17:38:35.737 INFO:tasks.workunit.client.0.smithi037.stderr: -385> 2024-09-12T17:38:35.228+0000 7f6068742800 5 AuthRegistry(0x55e2f4a82330) adding con mode: crc 2024-09-12T17:38:35.737 INFO:tasks.workunit.client.0.smithi037.stderr: -384> 2024-09-12T17:38:35.228+0000 7f6068742800 5 AuthRegistry(0x55e2f4a82330) adding con mode: crc 2024-09-12T17:38:35.737 INFO:tasks.workunit.client.0.smithi037.stderr: -383> 2024-09-12T17:38:35.228+0000 7f6068742800 5 AuthRegistry(0x55e2f4a82330) adding con mode: secure 2024-09-12T17:38:35.738 INFO:tasks.workunit.client.0.smithi037.stderr: -382> 2024-09-12T17:38:35.228+0000 7f6068742800 5 AuthRegistry(0x55e2f4a82330) adding con mode: crc 2024-09-12T17:38:35.738 INFO:tasks.workunit.client.0.smithi037.stderr: -381> 2024-09-12T17:38:35.228+0000 7f6068742800 5 AuthRegistry(0x55e2f4a82330) adding con mode: secure 2024-09-12T17:38:35.738 INFO:tasks.workunit.client.0.smithi037.stderr: -380> 2024-09-12T17:38:35.228+0000 7f6068742800 5 AuthRegistry(0x55e2f4a82330) adding con mode: crc 2024-09-12T17:38:35.738 INFO:tasks.workunit.client.0.smithi037.stderr: -379> 2024-09-12T17:38:35.228+0000 7f6068742800 5 AuthRegistry(0x55e2f4a82330) adding con mode: secure 2024-09-12T17:38:35.738 INFO:tasks.workunit.client.0.smithi037.stderr: -378> 2024-09-12T17:38:35.228+0000 7f6068742800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:38:35.738 INFO:tasks.workunit.client.0.smithi037.stderr: -377> 2024-09-12T17:38:35.229+0000 7f6068742800 5 asok(0x55e2f480b730) register_command objecter_requests cmddesc objecter_requests hook 0x55e2f4a85d00 EEXIST 2024-09-12T17:38:35.738 INFO:tasks.workunit.client.0.smithi037.stderr: -376> 2024-09-12T17:38:35.229+0000 7f6068742800 10 monclient: init 2024-09-12T17:38:35.738 INFO:tasks.workunit.client.0.smithi037.stderr: -375> 2024-09-12T17:38:35.229+0000 7f6068742800 5 AuthRegistry(0x55e2f4a812e8) adding auth protocol: cephx 2024-09-12T17:38:35.738 INFO:tasks.workunit.client.0.smithi037.stderr: -374> 2024-09-12T17:38:35.229+0000 7f6068742800 5 AuthRegistry(0x55e2f4a812e8) adding auth protocol: cephx 2024-09-12T17:38:35.738 INFO:tasks.workunit.client.0.smithi037.stderr: -373> 2024-09-12T17:38:35.229+0000 7f6068742800 5 AuthRegistry(0x55e2f4a812e8) adding auth protocol: cephx 2024-09-12T17:38:35.738 INFO:tasks.workunit.client.0.smithi037.stderr: -372> 2024-09-12T17:38:35.229+0000 7f6068742800 5 AuthRegistry(0x55e2f4a812e8) adding con mode: secure 2024-09-12T17:38:35.738 INFO:tasks.workunit.client.0.smithi037.stderr: -371> 2024-09-12T17:38:35.229+0000 7f6068742800 5 AuthRegistry(0x55e2f4a812e8) adding con mode: crc 2024-09-12T17:38:35.738 INFO:tasks.workunit.client.0.smithi037.stderr: -370> 2024-09-12T17:38:35.229+0000 7f6068742800 5 AuthRegistry(0x55e2f4a812e8) adding con mode: secure 2024-09-12T17:38:35.739 INFO:tasks.workunit.client.0.smithi037.stderr: -369> 2024-09-12T17:38:35.229+0000 7f6068742800 5 AuthRegistry(0x55e2f4a812e8) adding con mode: crc 2024-09-12T17:38:35.739 INFO:tasks.workunit.client.0.smithi037.stderr: -368> 2024-09-12T17:38:35.229+0000 7f6068742800 5 AuthRegistry(0x55e2f4a812e8) adding con mode: secure 2024-09-12T17:38:35.739 INFO:tasks.workunit.client.0.smithi037.stderr: -367> 2024-09-12T17:38:35.229+0000 7f6068742800 5 AuthRegistry(0x55e2f4a812e8) adding con mode: crc 2024-09-12T17:38:35.739 INFO:tasks.workunit.client.0.smithi037.stderr: -366> 2024-09-12T17:38:35.229+0000 7f6068742800 5 AuthRegistry(0x55e2f4a812e8) adding con mode: crc 2024-09-12T17:38:35.739 INFO:tasks.workunit.client.0.smithi037.stderr: -365> 2024-09-12T17:38:35.229+0000 7f6068742800 5 AuthRegistry(0x55e2f4a812e8) adding con mode: secure 2024-09-12T17:38:35.739 INFO:tasks.workunit.client.0.smithi037.stderr: -364> 2024-09-12T17:38:35.229+0000 7f6068742800 5 AuthRegistry(0x55e2f4a812e8) adding con mode: crc 2024-09-12T17:38:35.739 INFO:tasks.workunit.client.0.smithi037.stderr: -363> 2024-09-12T17:38:35.229+0000 7f6068742800 5 AuthRegistry(0x55e2f4a812e8) adding con mode: secure 2024-09-12T17:38:35.739 INFO:tasks.workunit.client.0.smithi037.stderr: -362> 2024-09-12T17:38:35.229+0000 7f6068742800 5 AuthRegistry(0x55e2f4a812e8) adding con mode: crc 2024-09-12T17:38:35.739 INFO:tasks.workunit.client.0.smithi037.stderr: -361> 2024-09-12T17:38:35.229+0000 7f6068742800 5 AuthRegistry(0x55e2f4a812e8) adding con mode: secure 2024-09-12T17:38:35.739 INFO:tasks.workunit.client.0.smithi037.stderr: -360> 2024-09-12T17:38:35.229+0000 7f6068742800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:38:35.739 INFO:tasks.workunit.client.0.smithi037.stderr: -359> 2024-09-12T17:38:35.229+0000 7f6068742800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:38:35.739 INFO:tasks.workunit.client.0.smithi037.stderr: -358> 2024-09-12T17:38:35.229+0000 7f6068742800 5 asok(0x55e2f480b730) register_command rotate-key cmddesc rotate-key hook 0x55e2f4a81430 EEXIST 2024-09-12T17:38:35.739 INFO:tasks.workunit.client.0.smithi037.stderr: -357> 2024-09-12T17:38:35.229+0000 7f6068742800 10 monclient: _reopen_session rank -1 2024-09-12T17:38:35.740 INFO:tasks.workunit.client.0.smithi037.stderr: -356> 2024-09-12T17:38:35.229+0000 7f6068742800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T17:38:35.740 INFO:tasks.workunit.client.0.smithi037.stderr: -355> 2024-09-12T17:38:35.229+0000 7f6068742800 10 monclient(hunting): picked mon.noname-b con 0x55e2f4aa99f0 addr [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] 2024-09-12T17:38:35.740 INFO:tasks.workunit.client.0.smithi037.stderr: -354> 2024-09-12T17:38:35.229+0000 7f6068742800 10 monclient(hunting): picked mon.noname-c con 0x55e2f4aabcc0 addr [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] 2024-09-12T17:38:35.740 INFO:tasks.workunit.client.0.smithi037.stderr: -353> 2024-09-12T17:38:35.229+0000 7f6068742800 10 monclient(hunting): picked mon.noname-a con 0x55e2f4aa81c0 addr [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] 2024-09-12T17:38:35.740 INFO:tasks.workunit.client.0.smithi037.stderr: -352> 2024-09-12T17:38:35.229+0000 7f6068742800 10 monclient(hunting): start opening mon connection 2024-09-12T17:38:35.740 INFO:tasks.workunit.client.0.smithi037.stderr: -351> 2024-09-12T17:38:35.229+0000 7f6068742800 10 monclient(hunting): start opening mon connection 2024-09-12T17:38:35.740 INFO:tasks.workunit.client.0.smithi037.stderr: -350> 2024-09-12T17:38:35.229+0000 7f6068742800 10 monclient(hunting): start opening mon connection 2024-09-12T17:38:35.740 INFO:tasks.workunit.client.0.smithi037.stderr: -349> 2024-09-12T17:38:35.229+0000 7f6068742800 10 monclient(hunting): _renew_subs 2024-09-12T17:38:35.740 INFO:tasks.workunit.client.0.smithi037.stderr: -348> 2024-09-12T17:38:35.229+0000 7f6068742800 10 monclient(hunting): authenticate will time out at 2502.826708s 2024-09-12T17:38:35.740 INFO:tasks.workunit.client.0.smithi037.stderr: -347> 2024-09-12T17:38:35.229+0000 7f6064c87640 10 monclient(hunting): get_auth_request con 0x55e2f4aa81c0 auth_method 0 2024-09-12T17:38:35.740 INFO:tasks.workunit.client.0.smithi037.stderr: -346> 2024-09-12T17:38:35.229+0000 7f6064c87640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:38:35.740 INFO:tasks.workunit.client.0.smithi037.stderr: -345> 2024-09-12T17:38:35.229+0000 7f6064c87640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:38:35.740 INFO:tasks.workunit.client.0.smithi037.stderr: -344> 2024-09-12T17:38:35.229+0000 7f6064c87640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:38:35.741 INFO:tasks.workunit.client.0.smithi037.stderr: -343> 2024-09-12T17:38:35.229+0000 7f6063c85640 10 monclient(hunting): get_auth_request con 0x55e2f4aabcc0 auth_method 0 2024-09-12T17:38:35.741 INFO:tasks.workunit.client.0.smithi037.stderr: -342> 2024-09-12T17:38:35.229+0000 7f6063c85640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:38:35.741 INFO:tasks.workunit.client.0.smithi037.stderr: -341> 2024-09-12T17:38:35.229+0000 7f6063c85640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:38:35.741 INFO:tasks.workunit.client.0.smithi037.stderr: -340> 2024-09-12T17:38:35.229+0000 7f6063c85640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:38:35.741 INFO:tasks.workunit.client.0.smithi037.stderr: -339> 2024-09-12T17:38:35.229+0000 7f6064c87640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:38:35.741 INFO:tasks.workunit.client.0.smithi037.stderr: -338> 2024-09-12T17:38:35.229+0000 7f6064c87640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:38:35.741 INFO:tasks.workunit.client.0.smithi037.stderr: -337> 2024-09-12T17:38:35.229+0000 7f6064c87640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:38:35.741 INFO:tasks.workunit.client.0.smithi037.stderr: -336> 2024-09-12T17:38:35.229+0000 7f6064486640 10 monclient(hunting): get_auth_request con 0x55e2f4aa99f0 auth_method 0 2024-09-12T17:38:35.741 INFO:tasks.workunit.client.0.smithi037.stderr: -335> 2024-09-12T17:38:35.229+0000 7f6064486640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:38:35.741 INFO:tasks.workunit.client.0.smithi037.stderr: -334> 2024-09-12T17:38:35.229+0000 7f6064486640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:38:35.741 INFO:tasks.workunit.client.0.smithi037.stderr: -333> 2024-09-12T17:38:35.229+0000 7f6064486640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:38:35.741 INFO:tasks.workunit.client.0.smithi037.stderr: -332> 2024-09-12T17:38:35.229+0000 7f6063c85640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:38:35.741 INFO:tasks.workunit.client.0.smithi037.stderr: -331> 2024-09-12T17:38:35.229+0000 7f6063c85640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:38:35.742 INFO:tasks.workunit.client.0.smithi037.stderr: -330> 2024-09-12T17:38:35.229+0000 7f6063c85640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:38:35.742 INFO:tasks.workunit.client.0.smithi037.stderr: -329> 2024-09-12T17:38:35.230+0000 7f6064486640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:38:35.742 INFO:tasks.workunit.client.0.smithi037.stderr: -328> 2024-09-12T17:38:35.230+0000 7f6064486640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:38:35.742 INFO:tasks.workunit.client.0.smithi037.stderr: -327> 2024-09-12T17:38:35.230+0000 7f6064486640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:38:35.742 INFO:tasks.workunit.client.0.smithi037.stderr: -326> 2024-09-12T17:38:35.230+0000 7f6064c87640 10 monclient(hunting): handle_auth_done global_id 8391 payload 824 2024-09-12T17:38:35.742 INFO:tasks.workunit.client.0.smithi037.stderr: -325> 2024-09-12T17:38:35.230+0000 7f6064c87640 10 monclient: _finish_hunting 0 2024-09-12T17:38:35.742 INFO:tasks.workunit.client.0.smithi037.stderr: -324> 2024-09-12T17:38:35.230+0000 7f6064c87640 1 monclient: found mon.noname-a 2024-09-12T17:38:35.742 INFO:tasks.workunit.client.0.smithi037.stderr: -323> 2024-09-12T17:38:35.230+0000 7f6064c87640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.37:3300/0 2024-09-12T17:38:35.742 INFO:tasks.workunit.client.0.smithi037.stderr: -322> 2024-09-12T17:38:35.230+0000 7f5f49ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:38:35.742 INFO:tasks.workunit.client.0.smithi037.stderr: -321> 2024-09-12T17:38:35.230+0000 7f5f49ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:38:35.742 INFO:tasks.workunit.client.0.smithi037.stderr: -320> 2024-09-12T17:38:35.230+0000 7f5f49ffb640 10 monclient: dump: 2024-09-12T17:38:35.742 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:38:35.742 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:38:35.742 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:38:35.743 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:38:35.743 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:38:35.743 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:38:35.743 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:38:35.743 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:38:35.743 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:38:35.743 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:38:35.743 INFO:tasks.workunit.client.0.smithi037.stderr: -319> 2024-09-12T17:38:35.230+0000 7f5f49ffb640 10 monclient: _finish_auth 0 2024-09-12T17:38:35.743 INFO:tasks.workunit.client.0.smithi037.stderr: -318> 2024-09-12T17:38:35.230+0000 7f5f49ffb640 10 monclient: _check_auth_tickets 2024-09-12T17:38:35.743 INFO:tasks.workunit.client.0.smithi037.stderr: -317> 2024-09-12T17:38:35.230+0000 7f5f49ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T17:38:35.743 INFO:tasks.workunit.client.0.smithi037.stderr: -316> 2024-09-12T17:38:35.230+0000 7f5f49ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:38:35.743 INFO:tasks.workunit.client.0.smithi037.stderr: -315> 2024-09-12T17:38:35.230+0000 7f5f49ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:38:35.743 INFO:tasks.workunit.client.0.smithi037.stderr: -314> 2024-09-12T17:38:35.230+0000 7f5f49ffb640 10 monclient: dump: 2024-09-12T17:38:35.744 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:38:35.744 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:38:35.744 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:38:35.744 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:38:35.744 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:38:35.744 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:38:35.744 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:38:35.744 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:38:35.744 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:38:35.744 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:38:35.744 INFO:tasks.workunit.client.0.smithi037.stderr: -313> 2024-09-12T17:38:35.230+0000 7f6068742800 5 monclient: authenticate success, global_id 8391 2024-09-12T17:38:35.744 INFO:tasks.workunit.client.0.smithi037.stderr: -312> 2024-09-12T17:38:35.230+0000 7f6068742800 10 monclient: _renew_subs 2024-09-12T17:38:35.744 INFO:tasks.workunit.client.0.smithi037.stderr: -311> 2024-09-12T17:38:35.230+0000 7f6065488640 4 set_mon_vals no callback set 2024-09-12T17:38:35.744 INFO:tasks.workunit.client.0.smithi037.stderr: -310> 2024-09-12T17:38:35.230+0000 7f6068742800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.37:3300/0 2024-09-12T17:38:35.745 INFO:tasks.workunit.client.0.smithi037.stderr: -309> 2024-09-12T17:38:35.230+0000 7f6068742800 10 monclient: _renew_subs 2024-09-12T17:38:35.745 INFO:tasks.workunit.client.0.smithi037.stderr: -308> 2024-09-12T17:38:35.230+0000 7f6068742800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.37:3300/0 2024-09-12T17:38:35.745 INFO:tasks.workunit.client.0.smithi037.stderr: -307> 2024-09-12T17:38:35.232+0000 7f5f49ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:38:35.745 INFO:tasks.workunit.client.0.smithi037.stderr: -306> 2024-09-12T17:38:35.232+0000 7f5f49ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.40:6816/3916250676,v1:172.21.15.40:6817/3916250676] 2024-09-12T17:38:35.745 INFO:tasks.workunit.client.0.smithi037.stderr: -305> 2024-09-12T17:38:35.232+0000 7f5f49ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.40:6816/3916250676,v1:172.21.15.40:6817/3916250676] 2024-09-12T17:38:35.745 INFO:tasks.workunit.client.0.smithi037.stderr: -304> 2024-09-12T17:38:35.232+0000 7f6064486640 10 monclient: get_auth_request con 0x7f5f3c076380 auth_method 0 2024-09-12T17:38:35.745 INFO:tasks.workunit.client.0.smithi037.stderr: -303> 2024-09-12T17:38:35.232+0000 7f6068742800 10 monclient: get_monmap_and_config 2024-09-12T17:38:35.745 INFO:tasks.workunit.client.0.smithi037.stderr: -302> 2024-09-12T17:38:35.232+0000 7f6068742800 10 monclient: build_initial_monmap 2024-09-12T17:38:35.745 INFO:tasks.workunit.client.0.smithi037.stderr: -301> 2024-09-12T17:38:35.232+0000 7f6068742800 1 build_initial for_mkfs: 0 2024-09-12T17:38:35.745 INFO:tasks.workunit.client.0.smithi037.stderr: -300> 2024-09-12T17:38:35.232+0000 7f6068742800 10 monclient: monmap: 2024-09-12T17:38:35.745 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 0 2024-09-12T17:38:35.745 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:38:35.745 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 0.000000 2024-09-12T17:38:35.746 INFO:tasks.workunit.client.0.smithi037.stderr:created 0.000000 2024-09-12T17:38:35.746 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 0 (unknown) 2024-09-12T17:38:35.746 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:38:35.746 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.noname-a 2024-09-12T17:38:35.746 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.noname-b 2024-09-12T17:38:35.746 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.noname-c 2024-09-12T17:38:35.746 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:38:35.746 INFO:tasks.workunit.client.0.smithi037.stderr: -299> 2024-09-12T17:38:35.232+0000 7f6068742800 5 AuthRegistry(0x55e2f4ac98a0) adding auth protocol: cephx 2024-09-12T17:38:35.746 INFO:tasks.workunit.client.0.smithi037.stderr: -298> 2024-09-12T17:38:35.232+0000 7f6068742800 5 AuthRegistry(0x55e2f4ac98a0) adding auth protocol: cephx 2024-09-12T17:38:35.746 INFO:tasks.workunit.client.0.smithi037.stderr: -297> 2024-09-12T17:38:35.232+0000 7f6068742800 5 AuthRegistry(0x55e2f4ac98a0) adding auth protocol: cephx 2024-09-12T17:38:35.746 INFO:tasks.workunit.client.0.smithi037.stderr: -296> 2024-09-12T17:38:35.232+0000 7f6068742800 5 AuthRegistry(0x55e2f4ac98a0) adding con mode: secure 2024-09-12T17:38:35.746 INFO:tasks.workunit.client.0.smithi037.stderr: -295> 2024-09-12T17:38:35.232+0000 7f6068742800 5 AuthRegistry(0x55e2f4ac98a0) adding con mode: crc 2024-09-12T17:38:35.746 INFO:tasks.workunit.client.0.smithi037.stderr: -294> 2024-09-12T17:38:35.232+0000 7f6068742800 5 AuthRegistry(0x55e2f4ac98a0) adding con mode: secure 2024-09-12T17:38:35.746 INFO:tasks.workunit.client.0.smithi037.stderr: -293> 2024-09-12T17:38:35.232+0000 7f6068742800 5 AuthRegistry(0x55e2f4ac98a0) adding con mode: crc 2024-09-12T17:38:35.747 INFO:tasks.workunit.client.0.smithi037.stderr: -292> 2024-09-12T17:38:35.232+0000 7f6068742800 5 AuthRegistry(0x55e2f4ac98a0) adding con mode: secure 2024-09-12T17:38:35.747 INFO:tasks.workunit.client.0.smithi037.stderr: -291> 2024-09-12T17:38:35.232+0000 7f6068742800 5 AuthRegistry(0x55e2f4ac98a0) adding con mode: crc 2024-09-12T17:38:35.747 INFO:tasks.workunit.client.0.smithi037.stderr: -290> 2024-09-12T17:38:35.232+0000 7f6068742800 5 AuthRegistry(0x55e2f4ac98a0) adding con mode: crc 2024-09-12T17:38:35.747 INFO:tasks.workunit.client.0.smithi037.stderr: -289> 2024-09-12T17:38:35.232+0000 7f6068742800 5 AuthRegistry(0x55e2f4ac98a0) adding con mode: secure 2024-09-12T17:38:35.747 INFO:tasks.workunit.client.0.smithi037.stderr: -288> 2024-09-12T17:38:35.232+0000 7f6068742800 5 AuthRegistry(0x55e2f4ac98a0) adding con mode: crc 2024-09-12T17:38:35.747 INFO:tasks.workunit.client.0.smithi037.stderr: -287> 2024-09-12T17:38:35.232+0000 7f6068742800 5 AuthRegistry(0x55e2f4ac98a0) adding con mode: secure 2024-09-12T17:38:35.747 INFO:tasks.workunit.client.0.smithi037.stderr: -286> 2024-09-12T17:38:35.232+0000 7f6068742800 5 AuthRegistry(0x55e2f4ac98a0) adding con mode: crc 2024-09-12T17:38:35.747 INFO:tasks.workunit.client.0.smithi037.stderr: -285> 2024-09-12T17:38:35.232+0000 7f6068742800 5 AuthRegistry(0x55e2f4ac98a0) adding con mode: secure 2024-09-12T17:38:35.747 INFO:tasks.workunit.client.0.smithi037.stderr: -284> 2024-09-12T17:38:35.233+0000 7f6068742800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:38:35.747 INFO:tasks.workunit.client.0.smithi037.stderr: -283> 2024-09-12T17:38:35.233+0000 7f6068742800 10 monclient: init 2024-09-12T17:38:35.747 INFO:tasks.workunit.client.0.smithi037.stderr: -282> 2024-09-12T17:38:35.233+0000 7f6068742800 5 AuthRegistry(0x7ffc00f834f0) adding auth protocol: cephx 2024-09-12T17:38:35.747 INFO:tasks.workunit.client.0.smithi037.stderr: -281> 2024-09-12T17:38:35.233+0000 7f6068742800 5 AuthRegistry(0x7ffc00f834f0) adding auth protocol: cephx 2024-09-12T17:38:35.747 INFO:tasks.workunit.client.0.smithi037.stderr: -280> 2024-09-12T17:38:35.233+0000 7f6068742800 5 AuthRegistry(0x7ffc00f834f0) adding auth protocol: cephx 2024-09-12T17:38:35.747 INFO:tasks.workunit.client.0.smithi037.stderr: -279> 2024-09-12T17:38:35.233+0000 7f6068742800 5 AuthRegistry(0x7ffc00f834f0) adding con mode: secure 2024-09-12T17:38:35.748 INFO:tasks.workunit.client.0.smithi037.stderr: -278> 2024-09-12T17:38:35.233+0000 7f6068742800 5 AuthRegistry(0x7ffc00f834f0) adding con mode: crc 2024-09-12T17:38:35.748 INFO:tasks.workunit.client.0.smithi037.stderr: -277> 2024-09-12T17:38:35.233+0000 7f6068742800 5 AuthRegistry(0x7ffc00f834f0) adding con mode: secure 2024-09-12T17:38:35.748 INFO:tasks.workunit.client.0.smithi037.stderr: -276> 2024-09-12T17:38:35.233+0000 7f6068742800 5 AuthRegistry(0x7ffc00f834f0) adding con mode: crc 2024-09-12T17:38:35.748 INFO:tasks.workunit.client.0.smithi037.stderr: -275> 2024-09-12T17:38:35.233+0000 7f6068742800 5 AuthRegistry(0x7ffc00f834f0) adding con mode: secure 2024-09-12T17:38:35.748 INFO:tasks.workunit.client.0.smithi037.stderr: -274> 2024-09-12T17:38:35.233+0000 7f6068742800 5 AuthRegistry(0x7ffc00f834f0) adding con mode: crc 2024-09-12T17:38:35.748 INFO:tasks.workunit.client.0.smithi037.stderr: -273> 2024-09-12T17:38:35.233+0000 7f6068742800 5 AuthRegistry(0x7ffc00f834f0) adding con mode: crc 2024-09-12T17:38:35.748 INFO:tasks.workunit.client.0.smithi037.stderr: -272> 2024-09-12T17:38:35.233+0000 7f6068742800 5 AuthRegistry(0x7ffc00f834f0) adding con mode: secure 2024-09-12T17:38:35.748 INFO:tasks.workunit.client.0.smithi037.stderr: -271> 2024-09-12T17:38:35.233+0000 7f6068742800 5 AuthRegistry(0x7ffc00f834f0) adding con mode: crc 2024-09-12T17:38:35.748 INFO:tasks.workunit.client.0.smithi037.stderr: -270> 2024-09-12T17:38:35.233+0000 7f6068742800 5 AuthRegistry(0x7ffc00f834f0) adding con mode: secure 2024-09-12T17:38:35.748 INFO:tasks.workunit.client.0.smithi037.stderr: -269> 2024-09-12T17:38:35.233+0000 7f6068742800 5 AuthRegistry(0x7ffc00f834f0) adding con mode: crc 2024-09-12T17:38:35.748 INFO:tasks.workunit.client.0.smithi037.stderr: -268> 2024-09-12T17:38:35.233+0000 7f6068742800 5 AuthRegistry(0x7ffc00f834f0) adding con mode: secure 2024-09-12T17:38:35.748 INFO:tasks.workunit.client.0.smithi037.stderr: -267> 2024-09-12T17:38:35.233+0000 7f6068742800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:38:35.748 INFO:tasks.workunit.client.0.smithi037.stderr: -266> 2024-09-12T17:38:35.233+0000 7f6068742800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:38:35.749 INFO:tasks.workunit.client.0.smithi037.stderr: -265> 2024-09-12T17:38:35.233+0000 7f6068742800 5 asok(0x55e2f480b730) register_command rotate-key cmddesc rotate-key hook 0x7ffc00f83638 EEXIST 2024-09-12T17:38:35.749 INFO:tasks.workunit.client.0.smithi037.stderr: -264> 2024-09-12T17:38:35.233+0000 7f6068742800 10 monclient: _reopen_session rank -1 2024-09-12T17:38:35.749 INFO:tasks.workunit.client.0.smithi037.stderr: -263> 2024-09-12T17:38:35.233+0000 7f6068742800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T17:38:35.749 INFO:tasks.workunit.client.0.smithi037.stderr: -262> 2024-09-12T17:38:35.233+0000 7f6068742800 10 monclient(hunting): picked mon.noname-c con 0x55e2f4afde80 addr [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] 2024-09-12T17:38:35.749 INFO:tasks.workunit.client.0.smithi037.stderr: -261> 2024-09-12T17:38:35.233+0000 7f6068742800 10 monclient(hunting): picked mon.noname-b con 0x55e2f4af8420 addr [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] 2024-09-12T17:38:35.749 INFO:tasks.workunit.client.0.smithi037.stderr: -260> 2024-09-12T17:38:35.233+0000 7f6068742800 10 monclient(hunting): picked mon.noname-a con 0x55e2f4acdcc0 addr [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] 2024-09-12T17:38:35.749 INFO:tasks.workunit.client.0.smithi037.stderr: -259> 2024-09-12T17:38:35.233+0000 7f6068742800 10 monclient(hunting): start opening mon connection 2024-09-12T17:38:35.749 INFO:tasks.workunit.client.0.smithi037.stderr: -258> 2024-09-12T17:38:35.233+0000 7f6068742800 10 monclient(hunting): start opening mon connection 2024-09-12T17:38:35.749 INFO:tasks.workunit.client.0.smithi037.stderr: -257> 2024-09-12T17:38:35.233+0000 7f6068742800 10 monclient(hunting): start opening mon connection 2024-09-12T17:38:35.749 INFO:tasks.workunit.client.0.smithi037.stderr: -256> 2024-09-12T17:38:35.233+0000 7f6068742800 10 monclient(hunting): _renew_subs 2024-09-12T17:38:35.749 INFO:tasks.workunit.client.0.smithi037.stderr: -255> 2024-09-12T17:38:35.233+0000 7f6068742800 10 monclient(hunting): authenticate will time out at 2502.830834s 2024-09-12T17:38:35.749 INFO:tasks.workunit.client.0.smithi037.stderr: -254> 2024-09-12T17:38:35.233+0000 7f6064486640 10 monclient(hunting): get_auth_request con 0x55e2f4afde80 auth_method 0 2024-09-12T17:38:35.749 INFO:tasks.workunit.client.0.smithi037.stderr: -253> 2024-09-12T17:38:35.233+0000 7f6064486640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:38:35.749 INFO:tasks.workunit.client.0.smithi037.stderr: -252> 2024-09-12T17:38:35.233+0000 7f6064486640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:38:35.750 INFO:tasks.workunit.client.0.smithi037.stderr: -251> 2024-09-12T17:38:35.233+0000 7f6064486640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:38:35.750 INFO:tasks.workunit.client.0.smithi037.stderr: -250> 2024-09-12T17:38:35.233+0000 7f6064c87640 10 monclient(hunting): get_auth_request con 0x55e2f4acdcc0 auth_method 0 2024-09-12T17:38:35.750 INFO:tasks.workunit.client.0.smithi037.stderr: -249> 2024-09-12T17:38:35.233+0000 7f6064c87640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:38:35.750 INFO:tasks.workunit.client.0.smithi037.stderr: -248> 2024-09-12T17:38:35.233+0000 7f6064c87640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:38:35.750 INFO:tasks.workunit.client.0.smithi037.stderr: -247> 2024-09-12T17:38:35.233+0000 7f6064c87640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:38:35.750 INFO:tasks.workunit.client.0.smithi037.stderr: -246> 2024-09-12T17:38:35.234+0000 7f6064486640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:38:35.750 INFO:tasks.workunit.client.0.smithi037.stderr: -245> 2024-09-12T17:38:35.234+0000 7f6064486640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:38:35.750 INFO:tasks.workunit.client.0.smithi037.stderr: -244> 2024-09-12T17:38:35.234+0000 7f6064486640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:38:35.750 INFO:tasks.workunit.client.0.smithi037.stderr: -243> 2024-09-12T17:38:35.234+0000 7f6064c87640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:38:35.750 INFO:tasks.workunit.client.0.smithi037.stderr: -242> 2024-09-12T17:38:35.234+0000 7f6064c87640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:38:35.750 INFO:tasks.workunit.client.0.smithi037.stderr: -241> 2024-09-12T17:38:35.234+0000 7f6064c87640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:38:35.750 INFO:tasks.workunit.client.0.smithi037.stderr: -240> 2024-09-12T17:38:35.234+0000 7f6063c85640 10 monclient(hunting): get_auth_request con 0x55e2f4af8420 auth_method 0 2024-09-12T17:38:35.750 INFO:tasks.workunit.client.0.smithi037.stderr: -239> 2024-09-12T17:38:35.234+0000 7f6063c85640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:38:35.751 INFO:tasks.workunit.client.0.smithi037.stderr: -238> 2024-09-12T17:38:35.234+0000 7f6063c85640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:38:35.751 INFO:tasks.workunit.client.0.smithi037.stderr: -237> 2024-09-12T17:38:35.234+0000 7f6063c85640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:38:35.751 INFO:tasks.workunit.client.0.smithi037.stderr: -236> 2024-09-12T17:38:35.234+0000 7f6064486640 10 monclient(hunting): handle_auth_done global_id 7832 payload 274 2024-09-12T17:38:35.751 INFO:tasks.workunit.client.0.smithi037.stderr: -235> 2024-09-12T17:38:35.234+0000 7f6064486640 10 monclient: _finish_hunting 0 2024-09-12T17:38:35.751 INFO:tasks.workunit.client.0.smithi037.stderr: -234> 2024-09-12T17:38:35.234+0000 7f6064486640 1 monclient: found mon.noname-c 2024-09-12T17:38:35.751 INFO:tasks.workunit.client.0.smithi037.stderr: -233> 2024-09-12T17:38:35.234+0000 7f6064486640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.37:3301/0 2024-09-12T17:38:35.751 INFO:tasks.workunit.client.0.smithi037.stderr: -232> 2024-09-12T17:38:35.234+0000 7f5f3b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:38:35.751 INFO:tasks.workunit.client.0.smithi037.stderr: -231> 2024-09-12T17:38:35.234+0000 7f5f3b7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:38:35.751 INFO:tasks.workunit.client.0.smithi037.stderr: -230> 2024-09-12T17:38:35.234+0000 7f5f3b7fe640 10 monclient: dump: 2024-09-12T17:38:35.751 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:38:35.751 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:38:35.751 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:38:35.751 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:38:35.752 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:38:35.752 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:38:35.752 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:38:35.752 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:38:35.752 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:38:35.752 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:38:35.752 INFO:tasks.workunit.client.0.smithi037.stderr: -229> 2024-09-12T17:38:35.234+0000 7f5f3b7fe640 10 monclient: _finish_auth 0 2024-09-12T17:38:35.752 INFO:tasks.workunit.client.0.smithi037.stderr: -228> 2024-09-12T17:38:35.234+0000 7f5f3b7fe640 10 monclient: _check_auth_tickets 2024-09-12T17:38:35.752 INFO:tasks.workunit.client.0.smithi037.stderr: -227> 2024-09-12T17:38:35.234+0000 7f5f3b7fe640 10 monclient: handle_config config(0 keys) 2024-09-12T17:38:35.752 INFO:tasks.workunit.client.0.smithi037.stderr: -226> 2024-09-12T17:38:35.234+0000 7f6068742800 5 monclient: authenticate success, global_id 7832 2024-09-12T17:38:35.752 INFO:tasks.workunit.client.0.smithi037.stderr: -225> 2024-09-12T17:38:35.234+0000 7f5f3b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:38:35.752 INFO:tasks.workunit.client.0.smithi037.stderr: -224> 2024-09-12T17:38:35.234+0000 7f5f3b7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:38:35.752 INFO:tasks.workunit.client.0.smithi037.stderr: -223> 2024-09-12T17:38:35.234+0000 7f5f3b7fe640 10 monclient: dump: 2024-09-12T17:38:35.752 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:38:35.753 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:38:35.753 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:38:35.753 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:38:35.753 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:38:35.753 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:38:35.753 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:38:35.753 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:38:35.753 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:38:35.753 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:38:35.753 INFO:tasks.workunit.client.0.smithi037.stderr: -222> 2024-09-12T17:38:35.234+0000 7f6068742800 10 monclient: get_monmap_and_config success 2024-09-12T17:38:35.753 INFO:tasks.workunit.client.0.smithi037.stderr: -221> 2024-09-12T17:38:35.234+0000 7f6068742800 4 set_mon_vals no callback set 2024-09-12T17:38:35.753 INFO:tasks.workunit.client.0.smithi037.stderr: -220> 2024-09-12T17:38:35.234+0000 7f6068742800 10 monclient: shutdown 2024-09-12T17:38:35.753 INFO:tasks.workunit.client.0.smithi037.stderr: -219> 2024-09-12T17:38:35.235+0000 7f6068742800 10 monclient: build_initial_monmap 2024-09-12T17:38:35.754 INFO:tasks.workunit.client.0.smithi037.stderr: -218> 2024-09-12T17:38:35.235+0000 7f6068742800 1 build_initial for_mkfs: 0 2024-09-12T17:38:35.754 INFO:tasks.workunit.client.0.smithi037.stderr: -217> 2024-09-12T17:38:35.235+0000 7f6068742800 10 monclient: monmap: 2024-09-12T17:38:35.754 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 0 2024-09-12T17:38:35.754 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:38:35.754 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 0.000000 2024-09-12T17:38:35.754 INFO:tasks.workunit.client.0.smithi037.stderr:created 0.000000 2024-09-12T17:38:35.754 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 0 (unknown) 2024-09-12T17:38:35.754 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:38:35.754 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.noname-a 2024-09-12T17:38:35.754 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.noname-b 2024-09-12T17:38:35.754 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.noname-c 2024-09-12T17:38:35.754 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:38:35.754 INFO:tasks.workunit.client.0.smithi037.stderr: -216> 2024-09-12T17:38:35.235+0000 7f6068742800 5 AuthRegistry(0x55e2f4af93e0) adding auth protocol: cephx 2024-09-12T17:38:35.754 INFO:tasks.workunit.client.0.smithi037.stderr: -215> 2024-09-12T17:38:35.235+0000 7f6068742800 5 AuthRegistry(0x55e2f4af93e0) adding auth protocol: cephx 2024-09-12T17:38:35.755 INFO:tasks.workunit.client.0.smithi037.stderr: -214> 2024-09-12T17:38:35.235+0000 7f6068742800 5 AuthRegistry(0x55e2f4af93e0) adding auth protocol: cephx 2024-09-12T17:38:35.755 INFO:tasks.workunit.client.0.smithi037.stderr: -213> 2024-09-12T17:38:35.235+0000 7f6068742800 5 AuthRegistry(0x55e2f4af93e0) adding con mode: secure 2024-09-12T17:38:35.755 INFO:tasks.workunit.client.0.smithi037.stderr: -212> 2024-09-12T17:38:35.235+0000 7f6068742800 5 AuthRegistry(0x55e2f4af93e0) adding con mode: crc 2024-09-12T17:38:35.755 INFO:tasks.workunit.client.0.smithi037.stderr: -211> 2024-09-12T17:38:35.235+0000 7f6068742800 5 AuthRegistry(0x55e2f4af93e0) adding con mode: secure 2024-09-12T17:38:35.755 INFO:tasks.workunit.client.0.smithi037.stderr: -210> 2024-09-12T17:38:35.235+0000 7f6068742800 5 AuthRegistry(0x55e2f4af93e0) adding con mode: crc 2024-09-12T17:38:35.755 INFO:tasks.workunit.client.0.smithi037.stderr: -209> 2024-09-12T17:38:35.235+0000 7f6068742800 5 AuthRegistry(0x55e2f4af93e0) adding con mode: secure 2024-09-12T17:38:35.755 INFO:tasks.workunit.client.0.smithi037.stderr: -208> 2024-09-12T17:38:35.235+0000 7f6068742800 5 AuthRegistry(0x55e2f4af93e0) adding con mode: crc 2024-09-12T17:38:35.755 INFO:tasks.workunit.client.0.smithi037.stderr: -207> 2024-09-12T17:38:35.235+0000 7f6068742800 5 AuthRegistry(0x55e2f4af93e0) adding con mode: crc 2024-09-12T17:38:35.755 INFO:tasks.workunit.client.0.smithi037.stderr: -206> 2024-09-12T17:38:35.235+0000 7f6068742800 5 AuthRegistry(0x55e2f4af93e0) adding con mode: secure 2024-09-12T17:38:35.755 INFO:tasks.workunit.client.0.smithi037.stderr: -205> 2024-09-12T17:38:35.235+0000 7f6068742800 5 AuthRegistry(0x55e2f4af93e0) adding con mode: crc 2024-09-12T17:38:35.755 INFO:tasks.workunit.client.0.smithi037.stderr: -204> 2024-09-12T17:38:35.235+0000 7f6068742800 5 AuthRegistry(0x55e2f4af93e0) adding con mode: secure 2024-09-12T17:38:35.755 INFO:tasks.workunit.client.0.smithi037.stderr: -203> 2024-09-12T17:38:35.235+0000 7f6068742800 5 AuthRegistry(0x55e2f4af93e0) adding con mode: crc 2024-09-12T17:38:35.755 INFO:tasks.workunit.client.0.smithi037.stderr: -202> 2024-09-12T17:38:35.235+0000 7f6068742800 5 AuthRegistry(0x55e2f4af93e0) adding con mode: secure 2024-09-12T17:38:35.756 INFO:tasks.workunit.client.0.smithi037.stderr: -201> 2024-09-12T17:38:35.235+0000 7f6068742800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:38:35.756 INFO:tasks.workunit.client.0.smithi037.stderr: -200> 2024-09-12T17:38:35.235+0000 7f6068742800 1 librados: starting msgr at 2024-09-12T17:38:35.756 INFO:tasks.workunit.client.0.smithi037.stderr: -199> 2024-09-12T17:38:35.235+0000 7f6068742800 1 librados: starting objecter 2024-09-12T17:38:35.756 INFO:tasks.workunit.client.0.smithi037.stderr: -198> 2024-09-12T17:38:35.235+0000 7f6068742800 5 asok(0x55e2f480b730) register_command objecter_requests cmddesc objecter_requests hook 0x55e2f4af0d60 EEXIST 2024-09-12T17:38:35.756 INFO:tasks.workunit.client.0.smithi037.stderr: -197> 2024-09-12T17:38:35.235+0000 7f6068742800 1 librados: setting wanted keys 2024-09-12T17:38:35.756 INFO:tasks.workunit.client.0.smithi037.stderr: -196> 2024-09-12T17:38:35.235+0000 7f6068742800 1 librados: calling monclient init 2024-09-12T17:38:35.756 INFO:tasks.workunit.client.0.smithi037.stderr: -195> 2024-09-12T17:38:35.235+0000 7f6068742800 10 monclient: init 2024-09-12T17:38:35.756 INFO:tasks.workunit.client.0.smithi037.stderr: -194> 2024-09-12T17:38:35.235+0000 7f6068742800 5 AuthRegistry(0x55e2f4ac17a0) adding auth protocol: cephx 2024-09-12T17:38:35.756 INFO:tasks.workunit.client.0.smithi037.stderr: -193> 2024-09-12T17:38:35.235+0000 7f6068742800 5 AuthRegistry(0x55e2f4ac17a0) adding auth protocol: cephx 2024-09-12T17:38:35.756 INFO:tasks.workunit.client.0.smithi037.stderr: -192> 2024-09-12T17:38:35.235+0000 7f6068742800 5 AuthRegistry(0x55e2f4ac17a0) adding auth protocol: cephx 2024-09-12T17:38:35.756 INFO:tasks.workunit.client.0.smithi037.stderr: -191> 2024-09-12T17:38:35.235+0000 7f6068742800 5 AuthRegistry(0x55e2f4ac17a0) adding con mode: secure 2024-09-12T17:38:35.756 INFO:tasks.workunit.client.0.smithi037.stderr: -190> 2024-09-12T17:38:35.235+0000 7f6068742800 5 AuthRegistry(0x55e2f4ac17a0) adding con mode: crc 2024-09-12T17:38:35.756 INFO:tasks.workunit.client.0.smithi037.stderr: -189> 2024-09-12T17:38:35.235+0000 7f6068742800 5 AuthRegistry(0x55e2f4ac17a0) adding con mode: secure 2024-09-12T17:38:35.756 INFO:tasks.workunit.client.0.smithi037.stderr: -188> 2024-09-12T17:38:35.235+0000 7f6068742800 5 AuthRegistry(0x55e2f4ac17a0) adding con mode: crc 2024-09-12T17:38:35.757 INFO:tasks.workunit.client.0.smithi037.stderr: -187> 2024-09-12T17:38:35.235+0000 7f6068742800 5 AuthRegistry(0x55e2f4ac17a0) adding con mode: secure 2024-09-12T17:38:35.757 INFO:tasks.workunit.client.0.smithi037.stderr: -186> 2024-09-12T17:38:35.235+0000 7f6068742800 5 AuthRegistry(0x55e2f4ac17a0) adding con mode: crc 2024-09-12T17:38:35.757 INFO:tasks.workunit.client.0.smithi037.stderr: -185> 2024-09-12T17:38:35.235+0000 7f6068742800 5 AuthRegistry(0x55e2f4ac17a0) adding con mode: crc 2024-09-12T17:38:35.757 INFO:tasks.workunit.client.0.smithi037.stderr: -184> 2024-09-12T17:38:35.235+0000 7f6068742800 5 AuthRegistry(0x55e2f4ac17a0) adding con mode: secure 2024-09-12T17:38:35.757 INFO:tasks.workunit.client.0.smithi037.stderr: -183> 2024-09-12T17:38:35.235+0000 7f6068742800 5 AuthRegistry(0x55e2f4ac17a0) adding con mode: crc 2024-09-12T17:38:35.757 INFO:tasks.workunit.client.0.smithi037.stderr: -182> 2024-09-12T17:38:35.235+0000 7f6068742800 5 AuthRegistry(0x55e2f4ac17a0) adding con mode: secure 2024-09-12T17:38:35.757 INFO:tasks.workunit.client.0.smithi037.stderr: -181> 2024-09-12T17:38:35.235+0000 7f6068742800 5 AuthRegistry(0x55e2f4ac17a0) adding con mode: crc 2024-09-12T17:38:35.757 INFO:tasks.workunit.client.0.smithi037.stderr: -180> 2024-09-12T17:38:35.235+0000 7f6068742800 5 AuthRegistry(0x55e2f4ac17a0) adding con mode: secure 2024-09-12T17:38:35.757 INFO:tasks.workunit.client.0.smithi037.stderr: -179> 2024-09-12T17:38:35.235+0000 7f6068742800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:38:35.757 INFO:tasks.workunit.client.0.smithi037.stderr: -178> 2024-09-12T17:38:35.235+0000 7f6068742800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:38:35.757 INFO:tasks.workunit.client.0.smithi037.stderr: -177> 2024-09-12T17:38:35.235+0000 7f6068742800 5 asok(0x55e2f480b730) register_command rotate-key cmddesc rotate-key hook 0x55e2f4ac18e8 EEXIST 2024-09-12T17:38:35.757 INFO:tasks.workunit.client.0.smithi037.stderr: -176> 2024-09-12T17:38:35.236+0000 7f6068742800 10 monclient: _reopen_session rank -1 2024-09-12T17:38:35.757 INFO:tasks.workunit.client.0.smithi037.stderr: -175> 2024-09-12T17:38:35.236+0000 7f6068742800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T17:38:35.758 INFO:tasks.workunit.client.0.smithi037.stderr: -174> 2024-09-12T17:38:35.236+0000 7f6068742800 10 monclient(hunting): picked mon.noname-a con 0x55e2f4acdcc0 addr [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] 2024-09-12T17:38:35.758 INFO:tasks.workunit.client.0.smithi037.stderr: -173> 2024-09-12T17:38:35.236+0000 7f6068742800 10 monclient(hunting): picked mon.noname-c con 0x55e2f4af8420 addr [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] 2024-09-12T17:38:35.758 INFO:tasks.workunit.client.0.smithi037.stderr: -172> 2024-09-12T17:38:35.236+0000 7f6068742800 10 monclient(hunting): picked mon.noname-b con 0x55e2f4afde80 addr [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] 2024-09-12T17:38:35.758 INFO:tasks.workunit.client.0.smithi037.stderr: -171> 2024-09-12T17:38:35.236+0000 7f6068742800 10 monclient(hunting): start opening mon connection 2024-09-12T17:38:35.758 INFO:tasks.workunit.client.0.smithi037.stderr: -170> 2024-09-12T17:38:35.236+0000 7f6068742800 10 monclient(hunting): start opening mon connection 2024-09-12T17:38:35.758 INFO:tasks.workunit.client.0.smithi037.stderr: -169> 2024-09-12T17:38:35.236+0000 7f6068742800 10 monclient(hunting): start opening mon connection 2024-09-12T17:38:35.758 INFO:tasks.workunit.client.0.smithi037.stderr: -168> 2024-09-12T17:38:35.236+0000 7f6068742800 10 monclient(hunting): _renew_subs 2024-09-12T17:38:35.758 INFO:tasks.workunit.client.0.smithi037.stderr: -167> 2024-09-12T17:38:35.236+0000 7f6068742800 10 monclient(hunting): authenticate will time out at 2502.833058s 2024-09-12T17:38:35.758 INFO:tasks.workunit.client.0.smithi037.stderr: -166> 2024-09-12T17:38:35.236+0000 7f6064486640 10 monclient(hunting): get_auth_request con 0x55e2f4acdcc0 auth_method 0 2024-09-12T17:38:35.758 INFO:tasks.workunit.client.0.smithi037.stderr: -165> 2024-09-12T17:38:35.236+0000 7f6064486640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:38:35.758 INFO:tasks.workunit.client.0.smithi037.stderr: -164> 2024-09-12T17:38:35.236+0000 7f6064486640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:38:35.758 INFO:tasks.workunit.client.0.smithi037.stderr: -163> 2024-09-12T17:38:35.236+0000 7f6064486640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:38:35.758 INFO:tasks.workunit.client.0.smithi037.stderr: -162> 2024-09-12T17:38:35.236+0000 7f6063c85640 10 monclient(hunting): get_auth_request con 0x55e2f4af8420 auth_method 0 2024-09-12T17:38:35.759 INFO:tasks.workunit.client.0.smithi037.stderr: -161> 2024-09-12T17:38:35.236+0000 7f6063c85640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:38:35.759 INFO:tasks.workunit.client.0.smithi037.stderr: -160> 2024-09-12T17:38:35.236+0000 7f6063c85640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:38:35.759 INFO:tasks.workunit.client.0.smithi037.stderr: -159> 2024-09-12T17:38:35.236+0000 7f6063c85640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:38:35.759 INFO:tasks.workunit.client.0.smithi037.stderr: -158> 2024-09-12T17:38:35.236+0000 7f6064486640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:38:35.759 INFO:tasks.workunit.client.0.smithi037.stderr: -157> 2024-09-12T17:38:35.236+0000 7f6064486640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:38:35.759 INFO:tasks.workunit.client.0.smithi037.stderr: -156> 2024-09-12T17:38:35.236+0000 7f6064486640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:38:35.759 INFO:tasks.workunit.client.0.smithi037.stderr: -155> 2024-09-12T17:38:35.236+0000 7f6063c85640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:38:35.759 INFO:tasks.workunit.client.0.smithi037.stderr: -154> 2024-09-12T17:38:35.236+0000 7f6063c85640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:38:35.759 INFO:tasks.workunit.client.0.smithi037.stderr: -153> 2024-09-12T17:38:35.236+0000 7f6063c85640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:38:35.759 INFO:tasks.workunit.client.0.smithi037.stderr: -152> 2024-09-12T17:38:35.236+0000 7f6064c87640 10 monclient(hunting): get_auth_request con 0x55e2f4afde80 auth_method 0 2024-09-12T17:38:35.759 INFO:tasks.workunit.client.0.smithi037.stderr: -151> 2024-09-12T17:38:35.236+0000 7f6064c87640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:38:35.759 INFO:tasks.workunit.client.0.smithi037.stderr: -150> 2024-09-12T17:38:35.236+0000 7f6064c87640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:38:35.759 INFO:tasks.workunit.client.0.smithi037.stderr: -149> 2024-09-12T17:38:35.236+0000 7f6064c87640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:38:35.760 INFO:tasks.workunit.client.0.smithi037.stderr: -148> 2024-09-12T17:38:35.236+0000 7f6064486640 10 monclient(hunting): handle_auth_done global_id 8397 payload 824 2024-09-12T17:38:35.760 INFO:tasks.workunit.client.0.smithi037.stderr: -147> 2024-09-12T17:38:35.236+0000 7f6064486640 10 monclient: _finish_hunting 0 2024-09-12T17:38:35.760 INFO:tasks.workunit.client.0.smithi037.stderr: -146> 2024-09-12T17:38:35.236+0000 7f6064486640 1 monclient: found mon.noname-a 2024-09-12T17:38:35.760 INFO:tasks.workunit.client.0.smithi037.stderr: -145> 2024-09-12T17:38:35.236+0000 7f6064486640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.37:3300/0 2024-09-12T17:38:35.760 INFO:tasks.workunit.client.0.smithi037.stderr: -144> 2024-09-12T17:38:35.236+0000 7f5f39ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:38:35.760 INFO:tasks.workunit.client.0.smithi037.stderr: -143> 2024-09-12T17:38:35.236+0000 7f5f39ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:38:35.760 INFO:tasks.workunit.client.0.smithi037.stderr: -142> 2024-09-12T17:38:35.236+0000 7f5f39ffb640 10 monclient: dump: 2024-09-12T17:38:35.760 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:38:35.760 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:38:35.760 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:38:35.760 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:38:35.760 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:38:35.760 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:38:35.761 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:38:35.761 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:38:35.761 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:38:35.761 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:38:35.761 INFO:tasks.workunit.client.0.smithi037.stderr: -141> 2024-09-12T17:38:35.236+0000 7f5f39ffb640 10 monclient: _finish_auth 0 2024-09-12T17:38:35.761 INFO:tasks.workunit.client.0.smithi037.stderr: -140> 2024-09-12T17:38:35.236+0000 7f5f39ffb640 10 monclient: _check_auth_tickets 2024-09-12T17:38:35.761 INFO:tasks.workunit.client.0.smithi037.stderr: -139> 2024-09-12T17:38:35.236+0000 7f6068742800 5 monclient: authenticate success, global_id 8397 2024-09-12T17:38:35.761 INFO:tasks.workunit.client.0.smithi037.stderr: -138> 2024-09-12T17:38:35.236+0000 7f6068742800 10 monclient: _renew_subs 2024-09-12T17:38:35.761 INFO:tasks.workunit.client.0.smithi037.stderr: -137> 2024-09-12T17:38:35.236+0000 7f6068742800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.37:3300/0 2024-09-12T17:38:35.761 INFO:tasks.workunit.client.0.smithi037.stderr: -136> 2024-09-12T17:38:35.236+0000 7f5f39ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T17:38:35.761 INFO:tasks.workunit.client.0.smithi037.stderr: -135> 2024-09-12T17:38:35.236+0000 7f5f39ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:38:35.761 INFO:tasks.workunit.client.0.smithi037.stderr: -134> 2024-09-12T17:38:35.236+0000 7f5f39ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:38:35.762 INFO:tasks.workunit.client.0.smithi037.stderr: -133> 2024-09-12T17:38:35.236+0000 7f5f39ffb640 10 monclient: dump: 2024-09-12T17:38:35.762 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:38:35.762 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:38:35.762 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:38:35.762 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:38:35.762 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:38:35.762 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:38:35.762 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:38:35.762 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:38:35.762 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:38:35.762 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:38:35.762 INFO:tasks.workunit.client.0.smithi037.stderr: -132> 2024-09-12T17:38:35.236+0000 7f5f3b7fe640 4 set_mon_vals no callback set 2024-09-12T17:38:35.762 INFO:tasks.workunit.client.0.smithi037.stderr: -131> 2024-09-12T17:38:35.236+0000 7f6068742800 10 monclient: _renew_subs 2024-09-12T17:38:35.762 INFO:tasks.workunit.client.0.smithi037.stderr: -130> 2024-09-12T17:38:35.236+0000 7f6068742800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.37:3300/0 2024-09-12T17:38:35.763 INFO:tasks.workunit.client.0.smithi037.stderr: -129> 2024-09-12T17:38:35.236+0000 7f6068742800 1 librados: init done 2024-09-12T17:38:35.763 INFO:tasks.workunit.client.0.smithi037.stderr: -128> 2024-09-12T17:38:35.236+0000 7f6068742800 5 asok(0x55e2f480b730) register_command cr dump hook 0x55e2f4aee6c8 2024-09-12T17:38:35.763 INFO:tasks.workunit.client.0.smithi037.stderr: -127> 2024-09-12T17:38:35.238+0000 7f6068742800 20 rados->read ofs=0 len=0 2024-09-12T17:38:35.763 INFO:tasks.workunit.client.0.smithi037.stderr: -126> 2024-09-12T17:38:35.238+0000 7f5f39ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:38:35.763 INFO:tasks.workunit.client.0.smithi037.stderr: -125> 2024-09-12T17:38:35.238+0000 7f5f39ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.40:6816/3916250676,v1:172.21.15.40:6817/3916250676] 2024-09-12T17:38:35.763 INFO:tasks.workunit.client.0.smithi037.stderr: -124> 2024-09-12T17:38:35.238+0000 7f5f39ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.40:6816/3916250676,v1:172.21.15.40:6817/3916250676] 2024-09-12T17:38:35.763 INFO:tasks.workunit.client.0.smithi037.stderr: -123> 2024-09-12T17:38:35.238+0000 7f6063c85640 10 monclient: get_auth_request con 0x7f5f2c076470 auth_method 0 2024-09-12T17:38:35.763 INFO:tasks.workunit.client.0.smithi037.stderr: -122> 2024-09-12T17:38:35.239+0000 7f6064c87640 10 monclient: get_auth_request con 0x55e2f4b18120 auth_method 0 2024-09-12T17:38:35.763 INFO:tasks.workunit.client.0.smithi037.stderr: -121> 2024-09-12T17:38:35.239+0000 7f6068742800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:35.763 INFO:tasks.workunit.client.0.smithi037.stderr: -120> 2024-09-12T17:38:35.239+0000 7f6068742800 20 realm 2024-09-12T17:38:35.763 INFO:tasks.workunit.client.0.smithi037.stderr: -119> 2024-09-12T17:38:35.239+0000 7f6068742800 20 rados->read ofs=0 len=0 2024-09-12T17:38:35.763 INFO:tasks.workunit.client.0.smithi037.stderr: -118> 2024-09-12T17:38:35.239+0000 7f6068742800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:35.763 INFO:tasks.workunit.client.0.smithi037.stderr: -117> 2024-09-12T17:38:35.239+0000 7f6068742800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:38:35.764 INFO:tasks.workunit.client.0.smithi037.stderr: -116> 2024-09-12T17:38:35.239+0000 7f6068742800 20 rados->read ofs=0 len=0 2024-09-12T17:38:35.764 INFO:tasks.workunit.client.0.smithi037.stderr: -115> 2024-09-12T17:38:35.239+0000 7f6068742800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:35.764 INFO:tasks.workunit.client.0.smithi037.stderr: -114> 2024-09-12T17:38:35.239+0000 7f6068742800 20 rados->read ofs=0 len=0 2024-09-12T17:38:35.764 INFO:tasks.workunit.client.0.smithi037.stderr: -113> 2024-09-12T17:38:35.240+0000 7f6064486640 10 monclient: get_auth_request con 0x55e2f4b1c3b0 auth_method 0 2024-09-12T17:38:35.764 INFO:tasks.workunit.client.0.smithi037.stderr: -112> 2024-09-12T17:38:35.240+0000 7f6068742800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:38:35.764 INFO:tasks.workunit.client.0.smithi037.stderr: -111> 2024-09-12T17:38:35.240+0000 7f6068742800 20 rados->read ofs=0 len=0 2024-09-12T17:38:35.764 INFO:tasks.workunit.client.0.smithi037.stderr: -110> 2024-09-12T17:38:35.241+0000 7f6068742800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:38:35.764 INFO:tasks.workunit.client.0.smithi037.stderr: -109> 2024-09-12T17:38:35.241+0000 7f6068742800 20 searching for the correct realm 2024-09-12T17:38:35.764 INFO:tasks.workunit.client.0.smithi037.stderr: -108> 2024-09-12T17:38:35.241+0000 7f6063c85640 10 monclient: get_auth_request con 0x55e2f4b21650 auth_method 0 2024-09-12T17:38:35.764 INFO:tasks.workunit.client.0.smithi037.stderr: -107> 2024-09-12T17:38:35.242+0000 7f6064c87640 10 monclient: get_auth_request con 0x7f6058085990 auth_method 0 2024-09-12T17:38:35.764 INFO:tasks.workunit.client.0.smithi037.stderr: -106> 2024-09-12T17:38:35.242+0000 7f6064486640 10 monclient: get_auth_request con 0x7f605c064be0 auth_method 0 2024-09-12T17:38:35.764 INFO:tasks.workunit.client.0.smithi037.stderr: -105> 2024-09-12T17:38:35.444+0000 7f6064486640 10 monclient: get_auth_request con 0x7f605c064be0 auth_method 0 2024-09-12T17:38:35.764 INFO:tasks.workunit.client.0.smithi037.stderr: -104> 2024-09-12T17:38:35.445+0000 7f6063c85640 10 monclient: get_auth_request con 0x7f6054098040 auth_method 0 2024-09-12T17:38:35.764 INFO:tasks.workunit.client.0.smithi037.stderr: -103> 2024-09-12T17:38:35.446+0000 7f6063c85640 0 -- 172.21.15.37:0/1307656127 >> [v2:172.21.15.40:6800/2441293461,v1:172.21.15.40:6801/2441293461] conn(0x7f6054098040 msgr2=0x7f6054001030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:38:35.765 INFO:tasks.workunit.client.0.smithi037.stderr: -102> 2024-09-12T17:38:35.446+0000 7f5f39ffb640 1 client.8397.objecter ms_handle_reset 0x7f6054098040 session 0x7f6054086e90 osd.4 2024-09-12T17:38:35.765 INFO:tasks.workunit.client.0.smithi037.stderr: -101> 2024-09-12T17:38:35.446+0000 7f5f39ffb640 10 monclient: _renew_subs 2024-09-12T17:38:35.765 INFO:tasks.workunit.client.0.smithi037.stderr: -100> 2024-09-12T17:38:35.446+0000 7f5f39ffb640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.37:3300/0 2024-09-12T17:38:35.765 INFO:tasks.workunit.client.0.smithi037.stderr: -99> 2024-09-12T17:38:35.446+0000 7f6063c85640 10 monclient: get_auth_request con 0x7f5f2c086b10 auth_method 0 2024-09-12T17:38:35.765 INFO:tasks.workunit.client.0.smithi037.stderr: -98> 2024-09-12T17:38:35.448+0000 7f6064c87640 10 monclient: get_auth_request con 0x7f605806c940 auth_method 0 2024-09-12T17:38:35.765 INFO:tasks.workunit.client.0.smithi037.stderr: -97> 2024-09-12T17:38:35.451+0000 7f6064486640 10 monclient: get_auth_request con 0x7f60580a23f0 auth_method 0 2024-09-12T17:38:35.765 INFO:tasks.workunit.client.0.smithi037.stderr: -96> 2024-09-12T17:38:35.451+0000 7f6064486640 0 -- 172.21.15.37:0/1307656127 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7f60580a23f0 msgr2=0x7f60580a2870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:38:35.765 INFO:tasks.workunit.client.0.smithi037.stderr: -95> 2024-09-12T17:38:35.653+0000 7f6064486640 10 monclient: get_auth_request con 0x7f60580a23f0 auth_method 0 2024-09-12T17:38:35.765 INFO:tasks.workunit.client.0.smithi037.stderr: -94> 2024-09-12T17:38:35.659+0000 7f6068742800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:38:35.765 INFO:tasks.workunit.client.0.smithi037.stderr: -93> 2024-09-12T17:38:35.659+0000 7f6068742800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:38:35.765 INFO:tasks.workunit.client.0.smithi037.stderr: -92> 2024-09-12T17:38:35.659+0000 7f6068742800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:38:35.765 INFO:tasks.workunit.client.0.smithi037.stderr: -91> 2024-09-12T17:38:35.659+0000 7f6068742800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:38:35.766 INFO:tasks.workunit.client.0.smithi037.stderr: -90> 2024-09-12T17:38:35.659+0000 7f6068742800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:38:35.766 INFO:tasks.workunit.client.0.smithi037.stderr: -89> 2024-09-12T17:38:35.659+0000 7f6068742800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:38:35.766 INFO:tasks.workunit.client.0.smithi037.stderr: -88> 2024-09-12T17:38:35.659+0000 7f6068742800 20 rados->read ofs=0 len=0 2024-09-12T17:38:35.766 INFO:tasks.workunit.client.0.smithi037.stderr: -87> 2024-09-12T17:38:35.660+0000 7f6068742800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:35.766 INFO:tasks.workunit.client.0.smithi037.stderr: -86> 2024-09-12T17:38:35.660+0000 7f6068742800 20 rados->read ofs=0 len=0 2024-09-12T17:38:35.766 INFO:tasks.workunit.client.0.smithi037.stderr: -85> 2024-09-12T17:38:35.660+0000 7f6068742800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:38:35.766 INFO:tasks.workunit.client.0.smithi037.stderr: -84> 2024-09-12T17:38:35.660+0000 7f6068742800 20 rados->read ofs=0 len=0 2024-09-12T17:38:35.766 INFO:tasks.workunit.client.0.smithi037.stderr: -83> 2024-09-12T17:38:35.661+0000 7f6068742800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:38:35.766 INFO:tasks.workunit.client.0.smithi037.stderr: -82> 2024-09-12T17:38:35.661+0000 7f6068742800 20 zone default found 2024-09-12T17:38:35.766 INFO:tasks.workunit.client.0.smithi037.stderr: -81> 2024-09-12T17:38:35.661+0000 7f6068742800 4 Realm: () 2024-09-12T17:38:35.767 INFO:tasks.workunit.client.0.smithi037.stderr: -80> 2024-09-12T17:38:35.661+0000 7f6068742800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:38:35.767 INFO:tasks.workunit.client.0.smithi037.stderr: -79> 2024-09-12T17:38:35.661+0000 7f6068742800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:38:35.767 INFO:tasks.workunit.client.0.smithi037.stderr: -78> 2024-09-12T17:38:35.661+0000 7f6068742800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:38:35.767 INFO:tasks.workunit.client.0.smithi037.stderr: -77> 2024-09-12T17:38:35.661+0000 7f6068742800 20 zonegroup default 2024-09-12T17:38:35.767 INFO:tasks.workunit.client.0.smithi037.stderr: -76> 2024-09-12T17:38:35.661+0000 7f6068742800 20 rados->read ofs=0 len=0 2024-09-12T17:38:35.767 INFO:tasks.workunit.client.0.smithi037.stderr: -75> 2024-09-12T17:38:35.661+0000 7f6068742800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:35.767 INFO:tasks.workunit.client.0.smithi037.stderr: -74> 2024-09-12T17:38:35.661+0000 7f6068742800 20 rados->read ofs=0 len=0 2024-09-12T17:38:35.767 INFO:tasks.workunit.client.0.smithi037.stderr: -73> 2024-09-12T17:38:35.661+0000 7f6068742800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:35.767 INFO:tasks.workunit.client.0.smithi037.stderr: -72> 2024-09-12T17:38:35.661+0000 7f6068742800 20 rados->read ofs=0 len=0 2024-09-12T17:38:35.767 INFO:tasks.workunit.client.0.smithi037.stderr: -71> 2024-09-12T17:38:35.662+0000 7f6068742800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:35.767 INFO:tasks.workunit.client.0.smithi037.stderr: -70> 2024-09-12T17:38:35.662+0000 7f6068742800 20 started sync module instance, tier type = 2024-09-12T17:38:35.767 INFO:tasks.workunit.client.0.smithi037.stderr: -69> 2024-09-12T17:38:35.662+0000 7f6068742800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:38:35.767 INFO:tasks.workunit.client.0.smithi037.stderr: -68> 2024-09-12T17:38:35.673+0000 7f6068742800 20 add_watcher() i=0 2024-09-12T17:38:35.768 INFO:tasks.workunit.client.0.smithi037.stderr: -67> 2024-09-12T17:38:35.673+0000 7f6068742800 20 add_watcher() i=1 2024-09-12T17:38:35.768 INFO:tasks.workunit.client.0.smithi037.stderr: -66> 2024-09-12T17:38:35.673+0000 7f6068742800 20 add_watcher() i=2 2024-09-12T17:38:35.768 INFO:tasks.workunit.client.0.smithi037.stderr: -65> 2024-09-12T17:38:35.673+0000 7f6068742800 20 add_watcher() i=3 2024-09-12T17:38:35.768 INFO:tasks.workunit.client.0.smithi037.stderr: -64> 2024-09-12T17:38:35.673+0000 7f6068742800 20 add_watcher() i=4 2024-09-12T17:38:35.768 INFO:tasks.workunit.client.0.smithi037.stderr: -63> 2024-09-12T17:38:35.673+0000 7f6068742800 20 add_watcher() i=5 2024-09-12T17:38:35.768 INFO:tasks.workunit.client.0.smithi037.stderr: -62> 2024-09-12T17:38:35.673+0000 7f6068742800 20 add_watcher() i=6 2024-09-12T17:38:35.768 INFO:tasks.workunit.client.0.smithi037.stderr: -61> 2024-09-12T17:38:35.674+0000 7f6068742800 20 add_watcher() i=7 2024-09-12T17:38:35.768 INFO:tasks.workunit.client.0.smithi037.stderr: -60> 2024-09-12T17:38:35.674+0000 7f6068742800 2 all 8 watchers are set, enabling cache 2024-09-12T17:38:35.768 INFO:tasks.workunit.client.0.smithi037.stderr: -59> 2024-09-12T17:38:35.677+0000 7f6068742800 5 AuthRegistry(0x7ffc00f839c0) adding auth protocol: cephx 2024-09-12T17:38:35.768 INFO:tasks.workunit.client.0.smithi037.stderr: -58> 2024-09-12T17:38:35.677+0000 7f6068742800 5 AuthRegistry(0x7ffc00f839c0) adding auth protocol: cephx 2024-09-12T17:38:35.768 INFO:tasks.workunit.client.0.smithi037.stderr: -57> 2024-09-12T17:38:35.677+0000 7f6068742800 5 AuthRegistry(0x7ffc00f839c0) adding auth protocol: cephx 2024-09-12T17:38:35.768 INFO:tasks.workunit.client.0.smithi037.stderr: -56> 2024-09-12T17:38:35.677+0000 7f6068742800 5 AuthRegistry(0x7ffc00f839c0) adding con mode: secure 2024-09-12T17:38:35.768 INFO:tasks.workunit.client.0.smithi037.stderr: -55> 2024-09-12T17:38:35.677+0000 7f6068742800 5 AuthRegistry(0x7ffc00f839c0) adding con mode: crc 2024-09-12T17:38:35.769 INFO:tasks.workunit.client.0.smithi037.stderr: -54> 2024-09-12T17:38:35.677+0000 7f6068742800 5 AuthRegistry(0x7ffc00f839c0) adding con mode: secure 2024-09-12T17:38:35.769 INFO:tasks.workunit.client.0.smithi037.stderr: -53> 2024-09-12T17:38:35.677+0000 7f6068742800 5 AuthRegistry(0x7ffc00f839c0) adding con mode: crc 2024-09-12T17:38:35.769 INFO:tasks.workunit.client.0.smithi037.stderr: -52> 2024-09-12T17:38:35.677+0000 7f6068742800 5 AuthRegistry(0x7ffc00f839c0) adding con mode: secure 2024-09-12T17:38:35.769 INFO:tasks.workunit.client.0.smithi037.stderr: -51> 2024-09-12T17:38:35.677+0000 7f6068742800 5 AuthRegistry(0x7ffc00f839c0) adding con mode: crc 2024-09-12T17:38:35.769 INFO:tasks.workunit.client.0.smithi037.stderr: -50> 2024-09-12T17:38:35.677+0000 7f6068742800 5 AuthRegistry(0x7ffc00f839c0) adding con mode: crc 2024-09-12T17:38:35.769 INFO:tasks.workunit.client.0.smithi037.stderr: -49> 2024-09-12T17:38:35.677+0000 7f6068742800 5 AuthRegistry(0x7ffc00f839c0) adding con mode: secure 2024-09-12T17:38:35.769 INFO:tasks.workunit.client.0.smithi037.stderr: -48> 2024-09-12T17:38:35.677+0000 7f6068742800 5 AuthRegistry(0x7ffc00f839c0) adding con mode: crc 2024-09-12T17:38:35.769 INFO:tasks.workunit.client.0.smithi037.stderr: -47> 2024-09-12T17:38:35.677+0000 7f6068742800 5 AuthRegistry(0x7ffc00f839c0) adding con mode: secure 2024-09-12T17:38:35.769 INFO:tasks.workunit.client.0.smithi037.stderr: -46> 2024-09-12T17:38:35.677+0000 7f6068742800 5 AuthRegistry(0x7ffc00f839c0) adding con mode: crc 2024-09-12T17:38:35.769 INFO:tasks.workunit.client.0.smithi037.stderr: -45> 2024-09-12T17:38:35.677+0000 7f6068742800 5 AuthRegistry(0x7ffc00f839c0) adding con mode: secure 2024-09-12T17:38:35.769 INFO:tasks.workunit.client.0.smithi037.stderr: -44> 2024-09-12T17:38:35.677+0000 7f5f1a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:38:35.769 INFO:tasks.workunit.client.0.smithi037.stderr: -43> 2024-09-12T17:38:35.677+0000 7f6068742800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:38:35.769 INFO:tasks.workunit.client.0.smithi037.stderr: -42> 2024-09-12T17:38:35.677+0000 7f6068742800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:38:35.770 INFO:tasks.workunit.client.0.smithi037.stderr: -41> 2024-09-12T17:38:35.677+0000 7f6068742800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:38:35.770 INFO:tasks.workunit.client.0.smithi037.stderr: -40> 2024-09-12T17:38:35.677+0000 7f6068742800 5 asok(0x55e2f480b730) register_command cache list hook 0x55e2f4af5190 2024-09-12T17:38:35.770 INFO:tasks.workunit.client.0.smithi037.stderr: -39> 2024-09-12T17:38:35.677+0000 7f6068742800 5 asok(0x55e2f480b730) register_command cache inspect hook 0x55e2f4af5190 2024-09-12T17:38:35.770 INFO:tasks.workunit.client.0.smithi037.stderr: -38> 2024-09-12T17:38:35.677+0000 7f6068742800 5 asok(0x55e2f480b730) register_command cache erase hook 0x55e2f4af5190 2024-09-12T17:38:35.770 INFO:tasks.workunit.client.0.smithi037.stderr: -37> 2024-09-12T17:38:35.677+0000 7f6068742800 5 asok(0x55e2f480b730) register_command cache zap hook 0x55e2f4af5190 2024-09-12T17:38:35.770 INFO:tasks.workunit.client.0.smithi037.stderr: -36> 2024-09-12T17:38:35.677+0000 7f6068742800 5 note: GC not initialized 2024-09-12T17:38:35.770 INFO:tasks.workunit.client.0.smithi037.stderr: -35> 2024-09-12T17:38:35.677+0000 7f5f197e2640 20 reqs_thread_entry: start 2024-09-12T17:38:35.770 INFO:tasks.workunit.client.0.smithi037.stderr: -34> 2024-09-12T17:38:35.677+0000 7f6068742800 5 asok(0x55e2f480b730) register_command sync trace show hook 0x7f605c0056b0 2024-09-12T17:38:35.770 INFO:tasks.workunit.client.0.smithi037.stderr: -33> 2024-09-12T17:38:35.677+0000 7f6068742800 5 asok(0x55e2f480b730) register_command sync trace history hook 0x7f605c0056b0 2024-09-12T17:38:35.770 INFO:tasks.workunit.client.0.smithi037.stderr: -32> 2024-09-12T17:38:35.677+0000 7f6068742800 5 asok(0x55e2f480b730) register_command sync trace active hook 0x7f605c0056b0 2024-09-12T17:38:35.770 INFO:tasks.workunit.client.0.smithi037.stderr: -31> 2024-09-12T17:38:35.677+0000 7f6068742800 5 asok(0x55e2f480b730) register_command sync trace active_short hook 0x7f605c0056b0 2024-09-12T17:38:35.770 INFO:tasks.workunit.client.0.smithi037.stderr: -30> 2024-09-12T17:38:35.677+0000 7f6068742800 20 init_complete bucket index max shards: 11 2024-09-12T17:38:35.770 INFO:tasks.workunit.client.0.smithi037.stderr: -29> 2024-09-12T17:38:35.677+0000 7f6068742800 20 Filter name: none 2024-09-12T17:38:35.770 INFO:tasks.workunit.client.0.smithi037.stderr: -28> 2024-09-12T17:38:35.678+0000 7f5e8affd640 20 reqs_thread_entry: start 2024-09-12T17:38:35.771 INFO:tasks.workunit.client.0.smithi037.stderr: -27> 2024-09-12T17:38:35.678+0000 7f6068742800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:38:35.771 INFO:tasks.workunit.client.0.smithi037.stderr: -26> 2024-09-12T17:38:35.678+0000 7f6068742800 20 rados->read ofs=0 len=0 2024-09-12T17:38:35.771 INFO:tasks.workunit.client.0.smithi037.stderr: -25> 2024-09-12T17:38:35.678+0000 7f6068742800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:38:35.771 INFO:tasks.workunit.client.0.smithi037.stderr: -24> 2024-09-12T17:38:35.678+0000 7f6068742800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:38:35.771 INFO:tasks.workunit.client.0.smithi037.stderr: -23> 2024-09-12T17:38:35.678+0000 7f6068742800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:38:35.771 INFO:tasks.workunit.client.0.smithi037.stderr: -22> 2024-09-12T17:38:35.678+0000 7f6068742800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 : miss 2024-09-12T17:38:35.771 INFO:tasks.workunit.client.0.smithi037.stderr: -21> 2024-09-12T17:38:35.678+0000 7f6068742800 20 rados->read ofs=0 len=0 2024-09-12T17:38:35.771 INFO:tasks.workunit.client.0.smithi037.stderr: -20> 2024-09-12T17:38:35.679+0000 7f6068742800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T17:38:35.771 INFO:tasks.workunit.client.0.smithi037.stderr: -19> 2024-09-12T17:38:35.679+0000 7f6068742800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 info.flags=0x17 2024-09-12T17:38:35.771 INFO:tasks.workunit.client.0.smithi037.stderr: -18> 2024-09-12T17:38:35.679+0000 7f6068742800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 to cache LRU end 2024-09-12T17:38:35.771 INFO:tasks.workunit.client.0.smithi037.stderr: -17> 2024-09-12T17:38:35.679+0000 7f6068742800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:38:35.771 INFO:tasks.workunit.client.0.smithi037.stderr: -16> 2024-09-12T17:38:35.679+0000 7f6068742800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:38:35.772 INFO:tasks.workunit.client.0.smithi037.stderr: -15> 2024-09-12T17:38:35.679+0000 7f6068742800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 2024-09-12T17:38:35.772 INFO:tasks.workunit.client.0.smithi037.stderr: -14> 2024-09-12T17:38:35.680+0000 7f6068742800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T17:38:35.772 INFO:tasks.workunit.client.0.smithi037.stderr: -13> 2024-09-12T17:38:35.689+0000 7f6068742800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 info.flags=0x17 2024-09-12T17:38:35.772 INFO:tasks.workunit.client.0.smithi037.stderr: -12> 2024-09-12T17:38:35.689+0000 7f6068742800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 to cache LRU end 2024-09-12T17:38:35.772 INFO:tasks.workunit.client.0.smithi037.stderr: -11> 2024-09-12T17:38:35.689+0000 7f6068742800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:38:35.772 INFO:tasks.workunit.client.0.smithi037.stderr: -10> 2024-09-12T17:38:35.689+0000 7f6068742800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18, ofs0, ns] 2024-09-12T17:38:35.772 INFO:tasks.workunit.client.0.smithi037.stderr: -9> 2024-09-12T17:38:35.689+0000 7f5f3affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497021 cookie 94433256320512 notifier 8397 bl.length()=911 2024-09-12T17:38:35.772 INFO:tasks.workunit.client.0.smithi037.stderr: -8> 2024-09-12T17:38:35.689+0000 7f5f3affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 info.flags=0x17 2024-09-12T17:38:35.772 INFO:tasks.workunit.client.0.smithi037.stderr: -7> 2024-09-12T17:38:35.689+0000 7f5f3affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 to cache LRU end 2024-09-12T17:38:35.772 INFO:tasks.workunit.client.0.smithi037.stderr: -6> 2024-09-12T17:38:35.689+0000 7f5f3affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:38:35.772 INFO:tasks.workunit.client.0.smithi037.stderr: -5> 2024-09-12T17:38:35.691+0000 7f6068742800 20 handle_bi_update(): bucket=:a-bucket[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18]): orig_sources= new_sources= 2024-09-12T17:38:35.772 INFO:tasks.workunit.client.0.smithi037.stderr: -4> 2024-09-12T17:38:35.691+0000 7f6068742800 20 handle_bi_update(): bucket=:a-bucket[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18]): potential sources added=[] removed=[] 2024-09-12T17:38:35.772 INFO:tasks.workunit.client.0.smithi037.stderr: -3> 2024-09-12T17:38:35.691+0000 7f6068742800 20 handle_bi_update(): bucket=:a-bucket[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18]): orig_dests= new_dests= 2024-09-12T17:38:35.772 INFO:tasks.workunit.client.0.smithi037.stderr: -2> 2024-09-12T17:38:35.691+0000 7f6068742800 20 handle_bi_update(): bucket=:a-bucket[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18]): potential dests added=[] removed=[] 2024-09-12T17:38:35.773 INFO:tasks.workunit.client.0.smithi037.stderr: -1> 2024-09-12T17:38:35.698+0000 7f6068742800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f6068742800 time 2024-09-12T17:38:35.698004+0000 2024-09-12T17:38:35.773 INFO:tasks.workunit.client.0.smithi037.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:38:35.773 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:38:35.773 INFO:tasks.workunit.client.0.smithi037.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:38:35.773 INFO:tasks.workunit.client.0.smithi037.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f6069f8c71a] 2024-09-12T17:38:35.773 INFO:tasks.workunit.client.0.smithi037.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f6069f8c8d8] 2024-09-12T17:38:35.773 INFO:tasks.workunit.client.0.smithi037.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e2f3348841] 2024-09-12T17:38:35.773 INFO:tasks.workunit.client.0.smithi037.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55e2f335857a] 2024-09-12T17:38:35.773 INFO:tasks.workunit.client.0.smithi037.stderr: 5: main() 2024-09-12T17:38:35.773 INFO:tasks.workunit.client.0.smithi037.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f6068c29590] 2024-09-12T17:38:35.773 INFO:tasks.workunit.client.0.smithi037.stderr: 7: __libc_start_main() 2024-09-12T17:38:35.773 INFO:tasks.workunit.client.0.smithi037.stderr: 8: _start() 2024-09-12T17:38:35.773 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:38:35.774 INFO:tasks.workunit.client.0.smithi037.stderr: 0> 2024-09-12T17:38:35.698+0000 7f6068742800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:38:35.774 INFO:tasks.workunit.client.0.smithi037.stderr: in thread 7f6068742800 thread_name:radosgw-admin 2024-09-12T17:38:35.774 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:38:35.774 INFO:tasks.workunit.client.0.smithi037.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:38:35.774 INFO:tasks.workunit.client.0.smithi037.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f6068c3e6f0] 2024-09-12T17:38:35.774 INFO:tasks.workunit.client.0.smithi037.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f6068c8b99c] 2024-09-12T17:38:35.774 INFO:tasks.workunit.client.0.smithi037.stderr: 3: raise() 2024-09-12T17:38:35.774 INFO:tasks.workunit.client.0.smithi037.stderr: 4: abort() 2024-09-12T17:38:35.774 INFO:tasks.workunit.client.0.smithi037.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f6069f8c774] 2024-09-12T17:38:35.774 INFO:tasks.workunit.client.0.smithi037.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f6069f8c8d8] 2024-09-12T17:38:35.774 INFO:tasks.workunit.client.0.smithi037.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e2f3348841] 2024-09-12T17:38:35.774 INFO:tasks.workunit.client.0.smithi037.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55e2f335857a] 2024-09-12T17:38:35.774 INFO:tasks.workunit.client.0.smithi037.stderr: 9: main() 2024-09-12T17:38:35.775 INFO:tasks.workunit.client.0.smithi037.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f6068c29590] 2024-09-12T17:38:35.775 INFO:tasks.workunit.client.0.smithi037.stderr: 11: __libc_start_main() 2024-09-12T17:38:35.775 INFO:tasks.workunit.client.0.smithi037.stderr: 12: _start() 2024-09-12T17:38:35.775 INFO:tasks.workunit.client.0.smithi037.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:38:35.775 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:38:35.775 INFO:tasks.workunit.client.0.smithi037.stderr:--- logging levels --- 2024-09-12T17:38:35.775 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 none 2024-09-12T17:38:35.775 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 lockdep 2024-09-12T17:38:35.775 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 context 2024-09-12T17:38:35.775 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 1 crush 2024-09-12T17:38:35.775 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mds 2024-09-12T17:38:35.775 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mds_balancer 2024-09-12T17:38:35.775 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mds_locker 2024-09-12T17:38:35.775 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mds_log 2024-09-12T17:38:35.776 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mds_log_expire 2024-09-12T17:38:35.776 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mds_migrator 2024-09-12T17:38:35.776 INFO:tasks.workunit.client.0.smithi037.stderr: 3/ 5 mds_quiesce 2024-09-12T17:38:35.776 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 buffer 2024-09-12T17:38:35.776 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 timer 2024-09-12T17:38:35.776 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 filer 2024-09-12T17:38:35.776 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 striper 2024-09-12T17:38:35.776 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 objecter 2024-09-12T17:38:35.776 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 rados 2024-09-12T17:38:35.776 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 rbd 2024-09-12T17:38:35.776 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 rbd_mirror 2024-09-12T17:38:35.776 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 rbd_replay 2024-09-12T17:38:35.776 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 rbd_pwl 2024-09-12T17:38:35.777 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 journaler 2024-09-12T17:38:35.777 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 objectcacher 2024-09-12T17:38:35.777 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:38:35.777 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 client 2024-09-12T17:38:35.777 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 osd 2024-09-12T17:38:35.777 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 optracker 2024-09-12T17:38:35.777 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 objclass 2024-09-12T17:38:35.777 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 3 filestore 2024-09-12T17:38:35.777 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 3 journal 2024-09-12T17:38:35.777 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 0 ms 2024-09-12T17:38:35.777 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mon 2024-09-12T17:38:35.777 INFO:tasks.workunit.client.0.smithi037.stderr: 0/10 monc 2024-09-12T17:38:35.777 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 paxos 2024-09-12T17:38:35.777 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 tp 2024-09-12T17:38:35.778 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 auth 2024-09-12T17:38:35.778 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 crypto 2024-09-12T17:38:35.778 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 1 finisher 2024-09-12T17:38:35.778 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 1 reserver 2024-09-12T17:38:35.778 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 heartbeatmap 2024-09-12T17:38:35.778 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 perfcounter 2024-09-12T17:38:35.778 INFO:tasks.workunit.client.0.smithi037.stderr: 20/20 rgw 2024-09-12T17:38:35.778 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 rgw_sync 2024-09-12T17:38:35.778 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 rgw_datacache 2024-09-12T17:38:35.778 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 rgw_access 2024-09-12T17:38:35.778 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:38:35.778 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 rgw_flight 2024-09-12T17:38:35.778 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:38:35.778 INFO:tasks.workunit.client.0.smithi037.stderr: 20/20 rgw_notification 2024-09-12T17:38:35.778 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 javaclient 2024-09-12T17:38:35.779 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 asok 2024-09-12T17:38:35.779 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 1 throttle 2024-09-12T17:38:35.779 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 0 refs 2024-09-12T17:38:35.779 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 compressor 2024-09-12T17:38:35.779 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 bluestore 2024-09-12T17:38:35.779 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 bluefs 2024-09-12T17:38:35.779 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 3 bdev 2024-09-12T17:38:35.779 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 kstore 2024-09-12T17:38:35.779 INFO:tasks.workunit.client.0.smithi037.stderr: 4/ 5 rocksdb 2024-09-12T17:38:35.779 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 fuse 2024-09-12T17:38:35.779 INFO:tasks.workunit.client.0.smithi037.stderr: 2/ 5 mgr 2024-09-12T17:38:35.779 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mgrc 2024-09-12T17:38:35.779 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 dpdk 2024-09-12T17:38:35.780 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 eventtrace 2024-09-12T17:38:35.780 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 prioritycache 2024-09-12T17:38:35.780 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 test 2024-09-12T17:38:35.780 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:38:35.780 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 cephsqlite 2024-09-12T17:38:35.780 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:38:35.780 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore 2024-09-12T17:38:35.780 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_onode 2024-09-12T17:38:35.780 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_odata 2024-09-12T17:38:35.780 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_omap 2024-09-12T17:38:35.780 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_tm 2024-09-12T17:38:35.780 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_t 2024-09-12T17:38:35.780 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:38:35.780 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_epm 2024-09-12T17:38:35.781 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_lba 2024-09-12T17:38:35.781 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:38:35.781 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_cache 2024-09-12T17:38:35.781 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_journal 2024-09-12T17:38:35.781 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_device 2024-09-12T17:38:35.781 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_backref 2024-09-12T17:38:35.781 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 alienstore 2024-09-12T17:38:35.781 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mclock 2024-09-12T17:38:35.781 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 cyanstore 2024-09-12T17:38:35.781 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 ceph_exporter 2024-09-12T17:38:35.781 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 memstore 2024-09-12T17:38:35.781 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 trace 2024-09-12T17:38:35.781 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 ceph_dedup 2024-09-12T17:38:35.782 INFO:tasks.workunit.client.0.smithi037.stderr: -2/-2 (syslog threshold) 2024-09-12T17:38:35.782 INFO:tasks.workunit.client.0.smithi037.stderr: 99/99 (stderr threshold) 2024-09-12T17:38:35.782 INFO:tasks.workunit.client.0.smithi037.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:38:35.782 INFO:tasks.workunit.client.0.smithi037.stderr: 7f5e8affd640 / http_manager 2024-09-12T17:38:35.782 INFO:tasks.workunit.client.0.smithi037.stderr: 7f5f197e2640 / http_manager 2024-09-12T17:38:35.782 INFO:tasks.workunit.client.0.smithi037.stderr: 7f5f1a7e4640 / rgw_dt_lg_renew 2024-09-12T17:38:35.782 INFO:tasks.workunit.client.0.smithi037.stderr: 7f5f39ffb640 / ms_dispatch 2024-09-12T17:38:35.782 INFO:tasks.workunit.client.0.smithi037.stderr: 7f5f3affd640 / io_context_pool 2024-09-12T17:38:35.782 INFO:tasks.workunit.client.0.smithi037.stderr: 7f5f3b7fe640 / io_context_pool 2024-09-12T17:38:35.782 INFO:tasks.workunit.client.0.smithi037.stderr: 7f5f49ffb640 / ms_dispatch 2024-09-12T17:38:35.782 INFO:tasks.workunit.client.0.smithi037.stderr: 7f5f50e09640 / ms_dispatch 2024-09-12T17:38:35.782 INFO:tasks.workunit.client.0.smithi037.stderr: 7f5f5260c640 / io_context_pool 2024-09-12T17:38:35.782 INFO:tasks.workunit.client.0.smithi037.stderr: 7f6063c85640 / msgr-worker-2 2024-09-12T17:38:35.782 INFO:tasks.workunit.client.0.smithi037.stderr: 7f6064486640 / msgr-worker-1 2024-09-12T17:38:35.783 INFO:tasks.workunit.client.0.smithi037.stderr: 7f6064c87640 / msgr-worker-0 2024-09-12T17:38:35.783 INFO:tasks.workunit.client.0.smithi037.stderr: 7f6065488640 / io_context_pool 2024-09-12T17:38:35.783 INFO:tasks.workunit.client.0.smithi037.stderr: 7f6068742800 / radosgw-admin 2024-09-12T17:38:35.783 INFO:tasks.workunit.client.0.smithi037.stderr: max_recent 500 2024-09-12T17:38:35.783 INFO:tasks.workunit.client.0.smithi037.stderr: max_new 1000 2024-09-12T17:38:35.783 INFO:tasks.workunit.client.0.smithi037.stderr: log_file /var/log/ceph/ceph-client.admin.154394.log 2024-09-12T17:38:35.783 INFO:tasks.workunit.client.0.smithi037.stderr:--- end dump of recent events --- 2024-09-12T17:38:35.783 INFO:tasks.workunit.client.0.smithi037.stderr:--- begin dump of recent events --- 2024-09-12T17:38:35.783 INFO:tasks.workunit.client.0.smithi037.stderr: -499> 2024-09-12T17:38:35.220+0000 7f5f5260c640 10 monclient: handle_config config(0 keys) 2024-09-12T17:38:35.783 INFO:tasks.workunit.client.0.smithi037.stderr: -498> 2024-09-12T17:38:35.220+0000 7f6068742800 5 monclient: authenticate success, global_id 8385 2024-09-12T17:38:35.783 INFO:tasks.workunit.client.0.smithi037.stderr: -497> 2024-09-12T17:38:35.220+0000 7f6068742800 10 monclient: get_monmap_and_config success 2024-09-12T17:38:35.783 INFO:tasks.workunit.client.0.smithi037.stderr: -496> 2024-09-12T17:38:35.220+0000 7f6068742800 4 set_mon_vals no callback set 2024-09-12T17:38:35.783 INFO:tasks.workunit.client.0.smithi037.stderr: -495> 2024-09-12T17:38:35.220+0000 7f5f5260c640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:38:35.784 INFO:tasks.workunit.client.0.smithi037.stderr: -494> 2024-09-12T17:38:35.220+0000 7f5f5260c640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:38:35.784 INFO:tasks.workunit.client.0.smithi037.stderr: -493> 2024-09-12T17:38:35.220+0000 7f5f5260c640 10 monclient: dump: 2024-09-12T17:38:35.784 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:38:35.784 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:38:35.784 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:38:35.784 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:38:35.784 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:38:35.784 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:38:35.784 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:38:35.784 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:38:35.784 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:38:35.784 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:38:35.784 INFO:tasks.workunit.client.0.smithi037.stderr: -492> 2024-09-12T17:38:35.220+0000 7f6068742800 10 monclient: shutdown 2024-09-12T17:38:35.785 INFO:tasks.workunit.client.0.smithi037.stderr: -491> 2024-09-12T17:38:35.220+0000 7f6068742800 5 asok(0x55e2f480b730) unregister_commands rotate-key 2024-09-12T17:38:35.785 INFO:tasks.workunit.client.0.smithi037.stderr: -490> 2024-09-12T17:38:35.221+0000 7f6068742800 10 monclient: build_initial_monmap 2024-09-12T17:38:35.785 INFO:tasks.workunit.client.0.smithi037.stderr: -489> 2024-09-12T17:38:35.221+0000 7f6068742800 1 build_initial for_mkfs: 0 2024-09-12T17:38:35.785 INFO:tasks.workunit.client.0.smithi037.stderr: -488> 2024-09-12T17:38:35.221+0000 7f6068742800 10 monclient: monmap: 2024-09-12T17:38:35.785 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 0 2024-09-12T17:38:35.785 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:38:35.785 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 0.000000 2024-09-12T17:38:35.785 INFO:tasks.workunit.client.0.smithi037.stderr:created 0.000000 2024-09-12T17:38:35.785 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 0 (unknown) 2024-09-12T17:38:35.785 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:38:35.785 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.noname-a 2024-09-12T17:38:35.785 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.noname-b 2024-09-12T17:38:35.785 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.noname-c 2024-09-12T17:38:35.786 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:38:35.786 INFO:tasks.workunit.client.0.smithi037.stderr: -487> 2024-09-12T17:38:35.221+0000 7f6068742800 5 AuthRegistry(0x55e2f4a346c0) adding auth protocol: cephx 2024-09-12T17:38:35.786 INFO:tasks.workunit.client.0.smithi037.stderr: -486> 2024-09-12T17:38:35.221+0000 7f6068742800 5 AuthRegistry(0x55e2f4a346c0) adding auth protocol: cephx 2024-09-12T17:38:35.786 INFO:tasks.workunit.client.0.smithi037.stderr: -485> 2024-09-12T17:38:35.221+0000 7f6068742800 5 AuthRegistry(0x55e2f4a346c0) adding auth protocol: cephx 2024-09-12T17:38:35.786 INFO:tasks.workunit.client.0.smithi037.stderr: -484> 2024-09-12T17:38:35.221+0000 7f6068742800 5 AuthRegistry(0x55e2f4a346c0) adding con mode: secure 2024-09-12T17:38:35.786 INFO:tasks.workunit.client.0.smithi037.stderr: -483> 2024-09-12T17:38:35.221+0000 7f6068742800 5 AuthRegistry(0x55e2f4a346c0) adding con mode: crc 2024-09-12T17:38:35.786 INFO:tasks.workunit.client.0.smithi037.stderr: -482> 2024-09-12T17:38:35.221+0000 7f6068742800 5 AuthRegistry(0x55e2f4a346c0) adding con mode: secure 2024-09-12T17:38:35.786 INFO:tasks.workunit.client.0.smithi037.stderr: -481> 2024-09-12T17:38:35.221+0000 7f6068742800 5 AuthRegistry(0x55e2f4a346c0) adding con mode: crc 2024-09-12T17:38:35.786 INFO:tasks.workunit.client.0.smithi037.stderr: -480> 2024-09-12T17:38:35.221+0000 7f6068742800 5 AuthRegistry(0x55e2f4a346c0) adding con mode: secure 2024-09-12T17:38:35.786 INFO:tasks.workunit.client.0.smithi037.stderr: -479> 2024-09-12T17:38:35.221+0000 7f6068742800 5 AuthRegistry(0x55e2f4a346c0) adding con mode: crc 2024-09-12T17:38:35.786 INFO:tasks.workunit.client.0.smithi037.stderr: -478> 2024-09-12T17:38:35.221+0000 7f6068742800 5 AuthRegistry(0x55e2f4a346c0) adding con mode: crc 2024-09-12T17:38:35.786 INFO:tasks.workunit.client.0.smithi037.stderr: -477> 2024-09-12T17:38:35.221+0000 7f6068742800 5 AuthRegistry(0x55e2f4a346c0) adding con mode: secure 2024-09-12T17:38:35.787 INFO:tasks.workunit.client.0.smithi037.stderr: -476> 2024-09-12T17:38:35.221+0000 7f6068742800 5 AuthRegistry(0x55e2f4a346c0) adding con mode: crc 2024-09-12T17:38:35.787 INFO:tasks.workunit.client.0.smithi037.stderr: -475> 2024-09-12T17:38:35.221+0000 7f6068742800 5 AuthRegistry(0x55e2f4a346c0) adding con mode: secure 2024-09-12T17:38:35.787 INFO:tasks.workunit.client.0.smithi037.stderr: -474> 2024-09-12T17:38:35.221+0000 7f6068742800 5 AuthRegistry(0x55e2f4a346c0) adding con mode: crc 2024-09-12T17:38:35.787 INFO:tasks.workunit.client.0.smithi037.stderr: -473> 2024-09-12T17:38:35.221+0000 7f6068742800 5 AuthRegistry(0x55e2f4a346c0) adding con mode: secure 2024-09-12T17:38:35.787 INFO:tasks.workunit.client.0.smithi037.stderr: -472> 2024-09-12T17:38:35.221+0000 7f6068742800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:38:35.787 INFO:tasks.workunit.client.0.smithi037.stderr: -471> 2024-09-12T17:38:35.221+0000 7f6068742800 1 librados: starting msgr at 2024-09-12T17:38:35.787 INFO:tasks.workunit.client.0.smithi037.stderr: -470> 2024-09-12T17:38:35.221+0000 7f6068742800 1 librados: starting objecter 2024-09-12T17:38:35.787 INFO:tasks.workunit.client.0.smithi037.stderr: -469> 2024-09-12T17:38:35.221+0000 7f6068742800 5 asok(0x55e2f480b730) register_command objecter_requests hook 0x55e2f4a2fa30 2024-09-12T17:38:35.787 INFO:tasks.workunit.client.0.smithi037.stderr: -468> 2024-09-12T17:38:35.221+0000 7f6068742800 1 librados: setting wanted keys 2024-09-12T17:38:35.787 INFO:tasks.workunit.client.0.smithi037.stderr: -467> 2024-09-12T17:38:35.221+0000 7f6068742800 1 librados: calling monclient init 2024-09-12T17:38:35.787 INFO:tasks.workunit.client.0.smithi037.stderr: -466> 2024-09-12T17:38:35.221+0000 7f6068742800 10 monclient: init 2024-09-12T17:38:35.787 INFO:tasks.workunit.client.0.smithi037.stderr: -465> 2024-09-12T17:38:35.221+0000 7f6068742800 5 AuthRegistry(0x55e2f4a2d0e0) adding auth protocol: cephx 2024-09-12T17:38:35.787 INFO:tasks.workunit.client.0.smithi037.stderr: -464> 2024-09-12T17:38:35.221+0000 7f6068742800 5 AuthRegistry(0x55e2f4a2d0e0) adding auth protocol: cephx 2024-09-12T17:38:35.787 INFO:tasks.workunit.client.0.smithi037.stderr: -463> 2024-09-12T17:38:35.221+0000 7f6068742800 5 AuthRegistry(0x55e2f4a2d0e0) adding auth protocol: cephx 2024-09-12T17:38:35.788 INFO:tasks.workunit.client.0.smithi037.stderr: -462> 2024-09-12T17:38:35.221+0000 7f6068742800 5 AuthRegistry(0x55e2f4a2d0e0) adding con mode: secure 2024-09-12T17:38:35.788 INFO:tasks.workunit.client.0.smithi037.stderr: -461> 2024-09-12T17:38:35.221+0000 7f6068742800 5 AuthRegistry(0x55e2f4a2d0e0) adding con mode: crc 2024-09-12T17:38:35.788 INFO:tasks.workunit.client.0.smithi037.stderr: -460> 2024-09-12T17:38:35.221+0000 7f6068742800 5 AuthRegistry(0x55e2f4a2d0e0) adding con mode: secure 2024-09-12T17:38:35.788 INFO:tasks.workunit.client.0.smithi037.stderr: -459> 2024-09-12T17:38:35.221+0000 7f6068742800 5 AuthRegistry(0x55e2f4a2d0e0) adding con mode: crc 2024-09-12T17:38:35.788 INFO:tasks.workunit.client.0.smithi037.stderr: -458> 2024-09-12T17:38:35.221+0000 7f6068742800 5 AuthRegistry(0x55e2f4a2d0e0) adding con mode: secure 2024-09-12T17:38:35.788 INFO:tasks.workunit.client.0.smithi037.stderr: -457> 2024-09-12T17:38:35.221+0000 7f6068742800 5 AuthRegistry(0x55e2f4a2d0e0) adding con mode: crc 2024-09-12T17:38:35.788 INFO:tasks.workunit.client.0.smithi037.stderr: -456> 2024-09-12T17:38:35.221+0000 7f6068742800 5 AuthRegistry(0x55e2f4a2d0e0) adding con mode: crc 2024-09-12T17:38:35.788 INFO:tasks.workunit.client.0.smithi037.stderr: -455> 2024-09-12T17:38:35.221+0000 7f6068742800 5 AuthRegistry(0x55e2f4a2d0e0) adding con mode: secure 2024-09-12T17:38:35.788 INFO:tasks.workunit.client.0.smithi037.stderr: -454> 2024-09-12T17:38:35.221+0000 7f6068742800 5 AuthRegistry(0x55e2f4a2d0e0) adding con mode: crc 2024-09-12T17:38:35.788 INFO:tasks.workunit.client.0.smithi037.stderr: -453> 2024-09-12T17:38:35.221+0000 7f6068742800 5 AuthRegistry(0x55e2f4a2d0e0) adding con mode: secure 2024-09-12T17:38:35.788 INFO:tasks.workunit.client.0.smithi037.stderr: -452> 2024-09-12T17:38:35.221+0000 7f6068742800 5 AuthRegistry(0x55e2f4a2d0e0) adding con mode: crc 2024-09-12T17:38:35.788 INFO:tasks.workunit.client.0.smithi037.stderr: -451> 2024-09-12T17:38:35.221+0000 7f6068742800 5 AuthRegistry(0x55e2f4a2d0e0) adding con mode: secure 2024-09-12T17:38:35.788 INFO:tasks.workunit.client.0.smithi037.stderr: -450> 2024-09-12T17:38:35.221+0000 7f6068742800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:38:35.789 INFO:tasks.workunit.client.0.smithi037.stderr: -449> 2024-09-12T17:38:35.222+0000 7f6068742800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:38:35.789 INFO:tasks.workunit.client.0.smithi037.stderr: -448> 2024-09-12T17:38:35.222+0000 7f6068742800 5 asok(0x55e2f480b730) register_command rotate-key hook 0x55e2f4a2d228 2024-09-12T17:38:35.789 INFO:tasks.workunit.client.0.smithi037.stderr: -447> 2024-09-12T17:38:35.222+0000 7f6068742800 10 monclient: _reopen_session rank -1 2024-09-12T17:38:35.789 INFO:tasks.workunit.client.0.smithi037.stderr: -446> 2024-09-12T17:38:35.222+0000 7f6068742800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T17:38:35.789 INFO:tasks.workunit.client.0.smithi037.stderr: -445> 2024-09-12T17:38:35.222+0000 7f6068742800 10 monclient(hunting): picked mon.noname-a con 0x55e2f48d8120 addr [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] 2024-09-12T17:38:35.789 INFO:tasks.workunit.client.0.smithi037.stderr: -444> 2024-09-12T17:38:35.222+0000 7f6068742800 10 monclient(hunting): picked mon.noname-b con 0x55e2f496f2f0 addr [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] 2024-09-12T17:38:35.789 INFO:tasks.workunit.client.0.smithi037.stderr: -443> 2024-09-12T17:38:35.222+0000 7f6068742800 10 monclient(hunting): picked mon.noname-c con 0x55e2f4972470 addr [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] 2024-09-12T17:38:35.789 INFO:tasks.workunit.client.0.smithi037.stderr: -442> 2024-09-12T17:38:35.222+0000 7f6068742800 10 monclient(hunting): start opening mon connection 2024-09-12T17:38:35.789 INFO:tasks.workunit.client.0.smithi037.stderr: -441> 2024-09-12T17:38:35.222+0000 7f6068742800 10 monclient(hunting): start opening mon connection 2024-09-12T17:38:35.789 INFO:tasks.workunit.client.0.smithi037.stderr: -440> 2024-09-12T17:38:35.222+0000 7f6068742800 10 monclient(hunting): start opening mon connection 2024-09-12T17:38:35.789 INFO:tasks.workunit.client.0.smithi037.stderr: -439> 2024-09-12T17:38:35.222+0000 7f6068742800 10 monclient(hunting): _renew_subs 2024-09-12T17:38:35.789 INFO:tasks.workunit.client.0.smithi037.stderr: -438> 2024-09-12T17:38:35.222+0000 7f6068742800 10 monclient(hunting): authenticate will time out at 2502.819224s 2024-09-12T17:38:35.789 INFO:tasks.workunit.client.0.smithi037.stderr: -437> 2024-09-12T17:38:35.222+0000 7f6064486640 10 monclient(hunting): get_auth_request con 0x55e2f48d8120 auth_method 0 2024-09-12T17:38:35.790 INFO:tasks.workunit.client.0.smithi037.stderr: -436> 2024-09-12T17:38:35.222+0000 7f6064486640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:38:35.790 INFO:tasks.workunit.client.0.smithi037.stderr: -435> 2024-09-12T17:38:35.222+0000 7f6064486640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:38:35.790 INFO:tasks.workunit.client.0.smithi037.stderr: -434> 2024-09-12T17:38:35.222+0000 7f6064486640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:38:35.790 INFO:tasks.workunit.client.0.smithi037.stderr: -433> 2024-09-12T17:38:35.222+0000 7f6064c87640 10 monclient(hunting): get_auth_request con 0x55e2f4972470 auth_method 0 2024-09-12T17:38:35.790 INFO:tasks.workunit.client.0.smithi037.stderr: -432> 2024-09-12T17:38:35.222+0000 7f6064c87640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:38:35.790 INFO:tasks.workunit.client.0.smithi037.stderr: -431> 2024-09-12T17:38:35.222+0000 7f6064c87640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:38:35.790 INFO:tasks.workunit.client.0.smithi037.stderr: -430> 2024-09-12T17:38:35.222+0000 7f6064c87640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:38:35.790 INFO:tasks.workunit.client.0.smithi037.stderr: -429> 2024-09-12T17:38:35.222+0000 7f6064486640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:38:35.790 INFO:tasks.workunit.client.0.smithi037.stderr: -428> 2024-09-12T17:38:35.222+0000 7f6064486640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:38:35.790 INFO:tasks.workunit.client.0.smithi037.stderr: -427> 2024-09-12T17:38:35.222+0000 7f6064486640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:38:35.790 INFO:tasks.workunit.client.0.smithi037.stderr: -426> 2024-09-12T17:38:35.222+0000 7f6064c87640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:38:35.790 INFO:tasks.workunit.client.0.smithi037.stderr: -425> 2024-09-12T17:38:35.222+0000 7f6064c87640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:38:35.790 INFO:tasks.workunit.client.0.smithi037.stderr: -424> 2024-09-12T17:38:35.222+0000 7f6064c87640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:38:35.791 INFO:tasks.workunit.client.0.smithi037.stderr: -423> 2024-09-12T17:38:35.222+0000 7f6064486640 10 monclient(hunting): handle_auth_done global_id 8388 payload 824 2024-09-12T17:38:35.791 INFO:tasks.workunit.client.0.smithi037.stderr: -422> 2024-09-12T17:38:35.222+0000 7f6064486640 10 monclient: _finish_hunting 0 2024-09-12T17:38:35.791 INFO:tasks.workunit.client.0.smithi037.stderr: -421> 2024-09-12T17:38:35.222+0000 7f6064486640 1 monclient: found mon.noname-a 2024-09-12T17:38:35.791 INFO:tasks.workunit.client.0.smithi037.stderr: -420> 2024-09-12T17:38:35.222+0000 7f6064486640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.37:3300/0 2024-09-12T17:38:35.791 INFO:tasks.workunit.client.0.smithi037.stderr: -419> 2024-09-12T17:38:35.222+0000 7f5f50e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:38:35.791 INFO:tasks.workunit.client.0.smithi037.stderr: -418> 2024-09-12T17:38:35.222+0000 7f5f50e09640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:38:35.791 INFO:tasks.workunit.client.0.smithi037.stderr: -417> 2024-09-12T17:38:35.222+0000 7f5f50e09640 10 monclient: dump: 2024-09-12T17:38:35.791 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:38:35.791 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:38:35.791 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:38:35.791 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:38:35.791 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:38:35.791 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:38:35.792 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:38:35.792 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:38:35.792 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:38:35.792 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:38:35.792 INFO:tasks.workunit.client.0.smithi037.stderr: -416> 2024-09-12T17:38:35.222+0000 7f5f50e09640 10 monclient: _finish_auth 0 2024-09-12T17:38:35.792 INFO:tasks.workunit.client.0.smithi037.stderr: -415> 2024-09-12T17:38:35.222+0000 7f5f50e09640 10 monclient: _check_auth_tickets 2024-09-12T17:38:35.792 INFO:tasks.workunit.client.0.smithi037.stderr: -414> 2024-09-12T17:38:35.222+0000 7f5f50e09640 10 monclient: handle_config config(0 keys) 2024-09-12T17:38:35.792 INFO:tasks.workunit.client.0.smithi037.stderr: -413> 2024-09-12T17:38:35.222+0000 7f5f50e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:38:35.792 INFO:tasks.workunit.client.0.smithi037.stderr: -412> 2024-09-12T17:38:35.222+0000 7f5f50e09640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:38:35.792 INFO:tasks.workunit.client.0.smithi037.stderr: -411> 2024-09-12T17:38:35.222+0000 7f5f50e09640 10 monclient: dump: 2024-09-12T17:38:35.792 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:38:35.792 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:38:35.792 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:38:35.792 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:38:35.793 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:38:35.793 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:38:35.793 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:38:35.793 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:38:35.793 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:38:35.793 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:38:35.793 INFO:tasks.workunit.client.0.smithi037.stderr: -410> 2024-09-12T17:38:35.222+0000 7f6068742800 5 monclient: authenticate success, global_id 8388 2024-09-12T17:38:35.793 INFO:tasks.workunit.client.0.smithi037.stderr: -409> 2024-09-12T17:38:35.222+0000 7f6068742800 10 monclient: _renew_subs 2024-09-12T17:38:35.793 INFO:tasks.workunit.client.0.smithi037.stderr: -408> 2024-09-12T17:38:35.222+0000 7f6068742800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.37:3300/0 2024-09-12T17:38:35.793 INFO:tasks.workunit.client.0.smithi037.stderr: -407> 2024-09-12T17:38:35.222+0000 7f5f5260c640 4 set_mon_vals no callback set 2024-09-12T17:38:35.793 INFO:tasks.workunit.client.0.smithi037.stderr: -406> 2024-09-12T17:38:35.222+0000 7f6068742800 10 monclient: _renew_subs 2024-09-12T17:38:35.793 INFO:tasks.workunit.client.0.smithi037.stderr: -405> 2024-09-12T17:38:35.222+0000 7f6068742800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.37:3300/0 2024-09-12T17:38:35.793 INFO:tasks.workunit.client.0.smithi037.stderr: -404> 2024-09-12T17:38:35.222+0000 7f6068742800 1 librados: init done 2024-09-12T17:38:35.794 INFO:tasks.workunit.client.0.smithi037.stderr: -403> 2024-09-12T17:38:35.224+0000 7f5f50e09640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:38:35.794 INFO:tasks.workunit.client.0.smithi037.stderr: -402> 2024-09-12T17:38:35.224+0000 7f5f50e09640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.40:6816/3916250676,v1:172.21.15.40:6817/3916250676] 2024-09-12T17:38:35.794 INFO:tasks.workunit.client.0.smithi037.stderr: -401> 2024-09-12T17:38:35.224+0000 7f5f50e09640 4 mgrc reconnect Starting new session with [v2:172.21.15.40:6816/3916250676,v1:172.21.15.40:6817/3916250676] 2024-09-12T17:38:35.794 INFO:tasks.workunit.client.0.smithi037.stderr: -400> 2024-09-12T17:38:35.225+0000 7f6063c85640 10 monclient: get_auth_request con 0x7f5f4c076470 auth_method 0 2024-09-12T17:38:35.794 INFO:tasks.workunit.client.0.smithi037.stderr: -399> 2024-09-12T17:38:35.225+0000 7f6064c87640 10 monclient: get_auth_request con 0x55e2f4a6dbb0 auth_method 0 2024-09-12T17:38:35.794 INFO:tasks.workunit.client.0.smithi037.stderr: -398> 2024-09-12T17:38:35.226+0000 7f6064486640 10 monclient: get_auth_request con 0x55e2f4a78ec0 auth_method 0 2024-09-12T17:38:35.794 INFO:tasks.workunit.client.0.smithi037.stderr: -397> 2024-09-12T17:38:35.227+0000 7f6063c85640 10 monclient: get_auth_request con 0x55e2f4a7e400 auth_method 0 2024-09-12T17:38:35.794 INFO:tasks.workunit.client.0.smithi037.stderr: -396> 2024-09-12T17:38:35.228+0000 7f6068742800 10 monclient: build_initial_monmap 2024-09-12T17:38:35.794 INFO:tasks.workunit.client.0.smithi037.stderr: -395> 2024-09-12T17:38:35.228+0000 7f6068742800 1 build_initial for_mkfs: 0 2024-09-12T17:38:35.794 INFO:tasks.workunit.client.0.smithi037.stderr: -394> 2024-09-12T17:38:35.228+0000 7f6068742800 10 monclient: monmap: 2024-09-12T17:38:35.794 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 0 2024-09-12T17:38:35.794 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:38:35.794 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 0.000000 2024-09-12T17:38:35.794 INFO:tasks.workunit.client.0.smithi037.stderr:created 0.000000 2024-09-12T17:38:35.795 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 0 (unknown) 2024-09-12T17:38:35.795 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:38:35.795 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.noname-a 2024-09-12T17:38:35.795 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.noname-b 2024-09-12T17:38:35.795 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.noname-c 2024-09-12T17:38:35.795 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:38:35.795 INFO:tasks.workunit.client.0.smithi037.stderr: -393> 2024-09-12T17:38:35.228+0000 7f6068742800 5 AuthRegistry(0x55e2f4a82330) adding auth protocol: cephx 2024-09-12T17:38:35.795 INFO:tasks.workunit.client.0.smithi037.stderr: -392> 2024-09-12T17:38:35.228+0000 7f6068742800 5 AuthRegistry(0x55e2f4a82330) adding auth protocol: cephx 2024-09-12T17:38:35.795 INFO:tasks.workunit.client.0.smithi037.stderr: -391> 2024-09-12T17:38:35.228+0000 7f6068742800 5 AuthRegistry(0x55e2f4a82330) adding auth protocol: cephx 2024-09-12T17:38:35.795 INFO:tasks.workunit.client.0.smithi037.stderr: -390> 2024-09-12T17:38:35.228+0000 7f6068742800 5 AuthRegistry(0x55e2f4a82330) adding con mode: secure 2024-09-12T17:38:35.795 INFO:tasks.workunit.client.0.smithi037.stderr: -389> 2024-09-12T17:38:35.228+0000 7f6068742800 5 AuthRegistry(0x55e2f4a82330) adding con mode: crc 2024-09-12T17:38:35.795 INFO:tasks.workunit.client.0.smithi037.stderr: -388> 2024-09-12T17:38:35.228+0000 7f6068742800 5 AuthRegistry(0x55e2f4a82330) adding con mode: secure 2024-09-12T17:38:35.795 INFO:tasks.workunit.client.0.smithi037.stderr: -387> 2024-09-12T17:38:35.228+0000 7f6068742800 5 AuthRegistry(0x55e2f4a82330) adding con mode: crc 2024-09-12T17:38:35.796 INFO:tasks.workunit.client.0.smithi037.stderr: -386> 2024-09-12T17:38:35.228+0000 7f6068742800 5 AuthRegistry(0x55e2f4a82330) adding con mode: secure 2024-09-12T17:38:35.796 INFO:tasks.workunit.client.0.smithi037.stderr: -385> 2024-09-12T17:38:35.228+0000 7f6068742800 5 AuthRegistry(0x55e2f4a82330) adding con mode: crc 2024-09-12T17:38:35.796 INFO:tasks.workunit.client.0.smithi037.stderr: -384> 2024-09-12T17:38:35.228+0000 7f6068742800 5 AuthRegistry(0x55e2f4a82330) adding con mode: crc 2024-09-12T17:38:35.796 INFO:tasks.workunit.client.0.smithi037.stderr: -383> 2024-09-12T17:38:35.228+0000 7f6068742800 5 AuthRegistry(0x55e2f4a82330) adding con mode: secure 2024-09-12T17:38:35.796 INFO:tasks.workunit.client.0.smithi037.stderr: -382> 2024-09-12T17:38:35.228+0000 7f6068742800 5 AuthRegistry(0x55e2f4a82330) adding con mode: crc 2024-09-12T17:38:35.796 INFO:tasks.workunit.client.0.smithi037.stderr: -381> 2024-09-12T17:38:35.228+0000 7f6068742800 5 AuthRegistry(0x55e2f4a82330) adding con mode: secure 2024-09-12T17:38:35.796 INFO:tasks.workunit.client.0.smithi037.stderr: -380> 2024-09-12T17:38:35.228+0000 7f6068742800 5 AuthRegistry(0x55e2f4a82330) adding con mode: crc 2024-09-12T17:38:35.796 INFO:tasks.workunit.client.0.smithi037.stderr: -379> 2024-09-12T17:38:35.228+0000 7f6068742800 5 AuthRegistry(0x55e2f4a82330) adding con mode: secure 2024-09-12T17:38:35.796 INFO:tasks.workunit.client.0.smithi037.stderr: -378> 2024-09-12T17:38:35.228+0000 7f6068742800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:38:35.796 INFO:tasks.workunit.client.0.smithi037.stderr: -377> 2024-09-12T17:38:35.229+0000 7f6068742800 5 asok(0x55e2f480b730) register_command objecter_requests cmddesc objecter_requests hook 0x55e2f4a85d00 EEXIST 2024-09-12T17:38:35.796 INFO:tasks.workunit.client.0.smithi037.stderr: -376> 2024-09-12T17:38:35.229+0000 7f6068742800 10 monclient: init 2024-09-12T17:38:35.796 INFO:tasks.workunit.client.0.smithi037.stderr: -375> 2024-09-12T17:38:35.229+0000 7f6068742800 5 AuthRegistry(0x55e2f4a812e8) adding auth protocol: cephx 2024-09-12T17:38:35.796 INFO:tasks.workunit.client.0.smithi037.stderr: -374> 2024-09-12T17:38:35.229+0000 7f6068742800 5 AuthRegistry(0x55e2f4a812e8) adding auth protocol: cephx 2024-09-12T17:38:35.796 INFO:tasks.workunit.client.0.smithi037.stderr: -373> 2024-09-12T17:38:35.229+0000 7f6068742800 5 AuthRegistry(0x55e2f4a812e8) adding auth protocol: cephx 2024-09-12T17:38:35.796 INFO:tasks.workunit.client.0.smithi037.stderr: -372> 2024-09-12T17:38:35.229+0000 7f6068742800 5 AuthRegistry(0x55e2f4a812e8) adding con mode: secure 2024-09-12T17:38:35.797 INFO:tasks.workunit.client.0.smithi037.stderr: -371> 2024-09-12T17:38:35.229+0000 7f6068742800 5 AuthRegistry(0x55e2f4a812e8) adding con mode: crc 2024-09-12T17:38:35.797 INFO:tasks.workunit.client.0.smithi037.stderr: -370> 2024-09-12T17:38:35.229+0000 7f6068742800 5 AuthRegistry(0x55e2f4a812e8) adding con mode: secure 2024-09-12T17:38:35.797 INFO:tasks.workunit.client.0.smithi037.stderr: -369> 2024-09-12T17:38:35.229+0000 7f6068742800 5 AuthRegistry(0x55e2f4a812e8) adding con mode: crc 2024-09-12T17:38:35.797 INFO:tasks.workunit.client.0.smithi037.stderr: -368> 2024-09-12T17:38:35.229+0000 7f6068742800 5 AuthRegistry(0x55e2f4a812e8) adding con mode: secure 2024-09-12T17:38:35.797 INFO:tasks.workunit.client.0.smithi037.stderr: -367> 2024-09-12T17:38:35.229+0000 7f6068742800 5 AuthRegistry(0x55e2f4a812e8) adding con mode: crc 2024-09-12T17:38:35.797 INFO:tasks.workunit.client.0.smithi037.stderr: -366> 2024-09-12T17:38:35.229+0000 7f6068742800 5 AuthRegistry(0x55e2f4a812e8) adding con mode: crc 2024-09-12T17:38:35.797 INFO:tasks.workunit.client.0.smithi037.stderr: -365> 2024-09-12T17:38:35.229+0000 7f6068742800 5 AuthRegistry(0x55e2f4a812e8) adding con mode: secure 2024-09-12T17:38:35.797 INFO:tasks.workunit.client.0.smithi037.stderr: -364> 2024-09-12T17:38:35.229+0000 7f6068742800 5 AuthRegistry(0x55e2f4a812e8) adding con mode: crc 2024-09-12T17:38:35.797 INFO:tasks.workunit.client.0.smithi037.stderr: -363> 2024-09-12T17:38:35.229+0000 7f6068742800 5 AuthRegistry(0x55e2f4a812e8) adding con mode: secure 2024-09-12T17:38:35.797 INFO:tasks.workunit.client.0.smithi037.stderr: -362> 2024-09-12T17:38:35.229+0000 7f6068742800 5 AuthRegistry(0x55e2f4a812e8) adding con mode: crc 2024-09-12T17:38:35.797 INFO:tasks.workunit.client.0.smithi037.stderr: -361> 2024-09-12T17:38:35.229+0000 7f6068742800 5 AuthRegistry(0x55e2f4a812e8) adding con mode: secure 2024-09-12T17:38:35.797 INFO:tasks.workunit.client.0.smithi037.stderr: -360> 2024-09-12T17:38:35.229+0000 7f6068742800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:38:35.797 INFO:tasks.workunit.client.0.smithi037.stderr: -359> 2024-09-12T17:38:35.229+0000 7f6068742800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:38:35.798 INFO:tasks.workunit.client.0.smithi037.stderr: -358> 2024-09-12T17:38:35.229+0000 7f6068742800 5 asok(0x55e2f480b730) register_command rotate-key cmddesc rotate-key hook 0x55e2f4a81430 EEXIST 2024-09-12T17:38:35.798 INFO:tasks.workunit.client.0.smithi037.stderr: -357> 2024-09-12T17:38:35.229+0000 7f6068742800 10 monclient: _reopen_session rank -1 2024-09-12T17:38:35.798 INFO:tasks.workunit.client.0.smithi037.stderr: -356> 2024-09-12T17:38:35.229+0000 7f6068742800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T17:38:35.798 INFO:tasks.workunit.client.0.smithi037.stderr: -355> 2024-09-12T17:38:35.229+0000 7f6068742800 10 monclient(hunting): picked mon.noname-b con 0x55e2f4aa99f0 addr [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] 2024-09-12T17:38:35.798 INFO:tasks.workunit.client.0.smithi037.stderr: -354> 2024-09-12T17:38:35.229+0000 7f6068742800 10 monclient(hunting): picked mon.noname-c con 0x55e2f4aabcc0 addr [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] 2024-09-12T17:38:35.798 INFO:tasks.workunit.client.0.smithi037.stderr: -353> 2024-09-12T17:38:35.229+0000 7f6068742800 10 monclient(hunting): picked mon.noname-a con 0x55e2f4aa81c0 addr [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] 2024-09-12T17:38:35.798 INFO:tasks.workunit.client.0.smithi037.stderr: -352> 2024-09-12T17:38:35.229+0000 7f6068742800 10 monclient(hunting): start opening mon connection 2024-09-12T17:38:35.798 INFO:tasks.workunit.client.0.smithi037.stderr: -351> 2024-09-12T17:38:35.229+0000 7f6068742800 10 monclient(hunting): start opening mon connection 2024-09-12T17:38:35.798 INFO:tasks.workunit.client.0.smithi037.stderr: -350> 2024-09-12T17:38:35.229+0000 7f6068742800 10 monclient(hunting): start opening mon connection 2024-09-12T17:38:35.798 INFO:tasks.workunit.client.0.smithi037.stderr: -349> 2024-09-12T17:38:35.229+0000 7f6068742800 10 monclient(hunting): _renew_subs 2024-09-12T17:38:35.798 INFO:tasks.workunit.client.0.smithi037.stderr: -348> 2024-09-12T17:38:35.229+0000 7f6068742800 10 monclient(hunting): authenticate will time out at 2502.826708s 2024-09-12T17:38:35.798 INFO:tasks.workunit.client.0.smithi037.stderr: -347> 2024-09-12T17:38:35.229+0000 7f6064c87640 10 monclient(hunting): get_auth_request con 0x55e2f4aa81c0 auth_method 0 2024-09-12T17:38:35.798 INFO:tasks.workunit.client.0.smithi037.stderr: -346> 2024-09-12T17:38:35.229+0000 7f6064c87640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:38:35.799 INFO:tasks.workunit.client.0.smithi037.stderr: -345> 2024-09-12T17:38:35.229+0000 7f6064c87640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:38:35.799 INFO:tasks.workunit.client.0.smithi037.stderr: -344> 2024-09-12T17:38:35.229+0000 7f6064c87640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:38:35.799 INFO:tasks.workunit.client.0.smithi037.stderr: -343> 2024-09-12T17:38:35.229+0000 7f6063c85640 10 monclient(hunting): get_auth_request con 0x55e2f4aabcc0 auth_method 0 2024-09-12T17:38:35.799 INFO:tasks.workunit.client.0.smithi037.stderr: -342> 2024-09-12T17:38:35.229+0000 7f6063c85640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:38:35.799 INFO:tasks.workunit.client.0.smithi037.stderr: -341> 2024-09-12T17:38:35.229+0000 7f6063c85640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:38:35.799 INFO:tasks.workunit.client.0.smithi037.stderr: -340> 2024-09-12T17:38:35.229+0000 7f6063c85640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:38:35.799 INFO:tasks.workunit.client.0.smithi037.stderr: -339> 2024-09-12T17:38:35.229+0000 7f6064c87640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:38:35.799 INFO:tasks.workunit.client.0.smithi037.stderr: -338> 2024-09-12T17:38:35.229+0000 7f6064c87640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:38:35.799 INFO:tasks.workunit.client.0.smithi037.stderr: -337> 2024-09-12T17:38:35.229+0000 7f6064c87640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:38:35.799 INFO:tasks.workunit.client.0.smithi037.stderr: -336> 2024-09-12T17:38:35.229+0000 7f6064486640 10 monclient(hunting): get_auth_request con 0x55e2f4aa99f0 auth_method 0 2024-09-12T17:38:35.799 INFO:tasks.workunit.client.0.smithi037.stderr: -335> 2024-09-12T17:38:35.229+0000 7f6064486640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:38:35.799 INFO:tasks.workunit.client.0.smithi037.stderr: -334> 2024-09-12T17:38:35.229+0000 7f6064486640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:38:35.799 INFO:tasks.workunit.client.0.smithi037.stderr: -333> 2024-09-12T17:38:35.229+0000 7f6064486640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:38:35.799 INFO:tasks.workunit.client.0.smithi037.stderr: -332> 2024-09-12T17:38:35.229+0000 7f6063c85640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:38:35.800 INFO:tasks.workunit.client.0.smithi037.stderr: -331> 2024-09-12T17:38:35.229+0000 7f6063c85640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:38:35.800 INFO:tasks.workunit.client.0.smithi037.stderr: -330> 2024-09-12T17:38:35.229+0000 7f6063c85640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:38:35.800 INFO:tasks.workunit.client.0.smithi037.stderr: -329> 2024-09-12T17:38:35.230+0000 7f6064486640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:38:35.800 INFO:tasks.workunit.client.0.smithi037.stderr: -328> 2024-09-12T17:38:35.230+0000 7f6064486640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:38:35.800 INFO:tasks.workunit.client.0.smithi037.stderr: -327> 2024-09-12T17:38:35.230+0000 7f6064486640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:38:35.800 INFO:tasks.workunit.client.0.smithi037.stderr: -326> 2024-09-12T17:38:35.230+0000 7f6064c87640 10 monclient(hunting): handle_auth_done global_id 8391 payload 824 2024-09-12T17:38:35.800 INFO:tasks.workunit.client.0.smithi037.stderr: -325> 2024-09-12T17:38:35.230+0000 7f6064c87640 10 monclient: _finish_hunting 0 2024-09-12T17:38:35.800 INFO:tasks.workunit.client.0.smithi037.stderr: -324> 2024-09-12T17:38:35.230+0000 7f6064c87640 1 monclient: found mon.noname-a 2024-09-12T17:38:35.800 INFO:tasks.workunit.client.0.smithi037.stderr: -323> 2024-09-12T17:38:35.230+0000 7f6064c87640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.37:3300/0 2024-09-12T17:38:35.800 INFO:tasks.workunit.client.0.smithi037.stderr: -322> 2024-09-12T17:38:35.230+0000 7f5f49ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:38:35.800 INFO:tasks.workunit.client.0.smithi037.stderr: -321> 2024-09-12T17:38:35.230+0000 7f5f49ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:38:35.800 INFO:tasks.workunit.client.0.smithi037.stderr: -320> 2024-09-12T17:38:35.230+0000 7f5f49ffb640 10 monclient: dump: 2024-09-12T17:38:35.801 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:38:35.801 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:38:35.801 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:38:35.801 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:38:35.801 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:38:35.801 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:38:35.801 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:38:35.801 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:38:35.801 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:38:35.801 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:38:35.801 INFO:tasks.workunit.client.0.smithi037.stderr: -319> 2024-09-12T17:38:35.230+0000 7f5f49ffb640 10 monclient: _finish_auth 0 2024-09-12T17:38:35.801 INFO:tasks.workunit.client.0.smithi037.stderr: -318> 2024-09-12T17:38:35.230+0000 7f5f49ffb640 10 monclient: _check_auth_tickets 2024-09-12T17:38:35.801 INFO:tasks.workunit.client.0.smithi037.stderr: -317> 2024-09-12T17:38:35.230+0000 7f5f49ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T17:38:35.801 INFO:tasks.workunit.client.0.smithi037.stderr: -316> 2024-09-12T17:38:35.230+0000 7f5f49ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:38:35.802 INFO:tasks.workunit.client.0.smithi037.stderr: -315> 2024-09-12T17:38:35.230+0000 7f5f49ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:38:35.802 INFO:tasks.workunit.client.0.smithi037.stderr: -314> 2024-09-12T17:38:35.230+0000 7f5f49ffb640 10 monclient: dump: 2024-09-12T17:38:35.802 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:38:35.802 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:38:35.802 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:38:35.802 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:38:35.802 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:38:35.802 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:38:35.802 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:38:35.802 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:38:35.802 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:38:35.802 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:38:35.802 INFO:tasks.workunit.client.0.smithi037.stderr: -313> 2024-09-12T17:38:35.230+0000 7f6068742800 5 monclient: authenticate success, global_id 8391 2024-09-12T17:38:35.803 INFO:tasks.workunit.client.0.smithi037.stderr: -312> 2024-09-12T17:38:35.230+0000 7f6068742800 10 monclient: _renew_subs 2024-09-12T17:38:35.803 INFO:tasks.workunit.client.0.smithi037.stderr: -311> 2024-09-12T17:38:35.230+0000 7f6065488640 4 set_mon_vals no callback set 2024-09-12T17:38:35.803 INFO:tasks.workunit.client.0.smithi037.stderr: -310> 2024-09-12T17:38:35.230+0000 7f6068742800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.37:3300/0 2024-09-12T17:38:35.803 INFO:tasks.workunit.client.0.smithi037.stderr: -309> 2024-09-12T17:38:35.230+0000 7f6068742800 10 monclient: _renew_subs 2024-09-12T17:38:35.803 INFO:tasks.workunit.client.0.smithi037.stderr: -308> 2024-09-12T17:38:35.230+0000 7f6068742800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.37:3300/0 2024-09-12T17:38:35.803 INFO:tasks.workunit.client.0.smithi037.stderr: -307> 2024-09-12T17:38:35.232+0000 7f5f49ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:38:35.803 INFO:tasks.workunit.client.0.smithi037.stderr: -306> 2024-09-12T17:38:35.232+0000 7f5f49ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.40:6816/3916250676,v1:172.21.15.40:6817/3916250676] 2024-09-12T17:38:35.803 INFO:tasks.workunit.client.0.smithi037.stderr: -305> 2024-09-12T17:38:35.232+0000 7f5f49ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.40:6816/3916250676,v1:172.21.15.40:6817/3916250676] 2024-09-12T17:38:35.803 INFO:tasks.workunit.client.0.smithi037.stderr: -304> 2024-09-12T17:38:35.232+0000 7f6064486640 10 monclient: get_auth_request con 0x7f5f3c076380 auth_method 0 2024-09-12T17:38:35.803 INFO:tasks.workunit.client.0.smithi037.stderr: -303> 2024-09-12T17:38:35.232+0000 7f6068742800 10 monclient: get_monmap_and_config 2024-09-12T17:38:35.803 INFO:tasks.workunit.client.0.smithi037.stderr: -302> 2024-09-12T17:38:35.232+0000 7f6068742800 10 monclient: build_initial_monmap 2024-09-12T17:38:35.803 INFO:tasks.workunit.client.0.smithi037.stderr: -301> 2024-09-12T17:38:35.232+0000 7f6068742800 1 build_initial for_mkfs: 0 2024-09-12T17:38:35.803 INFO:tasks.workunit.client.0.smithi037.stderr: -300> 2024-09-12T17:38:35.232+0000 7f6068742800 10 monclient: monmap: 2024-09-12T17:38:35.804 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 0 2024-09-12T17:38:35.804 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:38:35.804 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 0.000000 2024-09-12T17:38:35.804 INFO:tasks.workunit.client.0.smithi037.stderr:created 0.000000 2024-09-12T17:38:35.804 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 0 (unknown) 2024-09-12T17:38:35.804 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:38:35.804 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.noname-a 2024-09-12T17:38:35.804 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.noname-b 2024-09-12T17:38:35.804 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.noname-c 2024-09-12T17:38:35.804 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:38:35.804 INFO:tasks.workunit.client.0.smithi037.stderr: -299> 2024-09-12T17:38:35.232+0000 7f6068742800 5 AuthRegistry(0x55e2f4ac98a0) adding auth protocol: cephx 2024-09-12T17:38:35.804 INFO:tasks.workunit.client.0.smithi037.stderr: -298> 2024-09-12T17:38:35.232+0000 7f6068742800 5 AuthRegistry(0x55e2f4ac98a0) adding auth protocol: cephx 2024-09-12T17:38:35.804 INFO:tasks.workunit.client.0.smithi037.stderr: -297> 2024-09-12T17:38:35.232+0000 7f6068742800 5 AuthRegistry(0x55e2f4ac98a0) adding auth protocol: cephx 2024-09-12T17:38:35.805 INFO:tasks.workunit.client.0.smithi037.stderr: -296> 2024-09-12T17:38:35.232+0000 7f6068742800 5 AuthRegistry(0x55e2f4ac98a0) adding con mode: secure 2024-09-12T17:38:35.805 INFO:tasks.workunit.client.0.smithi037.stderr: -295> 2024-09-12T17:38:35.232+0000 7f6068742800 5 AuthRegistry(0x55e2f4ac98a0) adding con mode: crc 2024-09-12T17:38:35.805 INFO:tasks.workunit.client.0.smithi037.stderr: -294> 2024-09-12T17:38:35.232+0000 7f6068742800 5 AuthRegistry(0x55e2f4ac98a0) adding con mode: secure 2024-09-12T17:38:35.805 INFO:tasks.workunit.client.0.smithi037.stderr: -293> 2024-09-12T17:38:35.232+0000 7f6068742800 5 AuthRegistry(0x55e2f4ac98a0) adding con mode: crc 2024-09-12T17:38:35.805 INFO:tasks.workunit.client.0.smithi037.stderr: -292> 2024-09-12T17:38:35.232+0000 7f6068742800 5 AuthRegistry(0x55e2f4ac98a0) adding con mode: secure 2024-09-12T17:38:35.805 INFO:tasks.workunit.client.0.smithi037.stderr: -291> 2024-09-12T17:38:35.232+0000 7f6068742800 5 AuthRegistry(0x55e2f4ac98a0) adding con mode: crc 2024-09-12T17:38:35.805 INFO:tasks.workunit.client.0.smithi037.stderr: -290> 2024-09-12T17:38:35.232+0000 7f6068742800 5 AuthRegistry(0x55e2f4ac98a0) adding con mode: crc 2024-09-12T17:38:35.805 INFO:tasks.workunit.client.0.smithi037.stderr: -289> 2024-09-12T17:38:35.232+0000 7f6068742800 5 AuthRegistry(0x55e2f4ac98a0) adding con mode: secure 2024-09-12T17:38:35.805 INFO:tasks.workunit.client.0.smithi037.stderr: -288> 2024-09-12T17:38:35.232+0000 7f6068742800 5 AuthRegistry(0x55e2f4ac98a0) adding con mode: crc 2024-09-12T17:38:35.805 INFO:tasks.workunit.client.0.smithi037.stderr: -287> 2024-09-12T17:38:35.232+0000 7f6068742800 5 AuthRegistry(0x55e2f4ac98a0) adding con mode: secure 2024-09-12T17:38:35.805 INFO:tasks.workunit.client.0.smithi037.stderr: -286> 2024-09-12T17:38:35.232+0000 7f6068742800 5 AuthRegistry(0x55e2f4ac98a0) adding con mode: crc 2024-09-12T17:38:35.805 INFO:tasks.workunit.client.0.smithi037.stderr: -285> 2024-09-12T17:38:35.232+0000 7f6068742800 5 AuthRegistry(0x55e2f4ac98a0) adding con mode: secure 2024-09-12T17:38:35.805 INFO:tasks.workunit.client.0.smithi037.stderr: -284> 2024-09-12T17:38:35.233+0000 7f6068742800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:38:35.806 INFO:tasks.workunit.client.0.smithi037.stderr: -283> 2024-09-12T17:38:35.233+0000 7f6068742800 10 monclient: init 2024-09-12T17:38:35.806 INFO:tasks.workunit.client.0.smithi037.stderr: -282> 2024-09-12T17:38:35.233+0000 7f6068742800 5 AuthRegistry(0x7ffc00f834f0) adding auth protocol: cephx 2024-09-12T17:38:35.806 INFO:tasks.workunit.client.0.smithi037.stderr: -281> 2024-09-12T17:38:35.233+0000 7f6068742800 5 AuthRegistry(0x7ffc00f834f0) adding auth protocol: cephx 2024-09-12T17:38:35.806 INFO:tasks.workunit.client.0.smithi037.stderr: -280> 2024-09-12T17:38:35.233+0000 7f6068742800 5 AuthRegistry(0x7ffc00f834f0) adding auth protocol: cephx 2024-09-12T17:38:35.806 INFO:tasks.workunit.client.0.smithi037.stderr: -279> 2024-09-12T17:38:35.233+0000 7f6068742800 5 AuthRegistry(0x7ffc00f834f0) adding con mode: secure 2024-09-12T17:38:35.806 INFO:tasks.workunit.client.0.smithi037.stderr: -278> 2024-09-12T17:38:35.233+0000 7f6068742800 5 AuthRegistry(0x7ffc00f834f0) adding con mode: crc 2024-09-12T17:38:35.806 INFO:tasks.workunit.client.0.smithi037.stderr: -277> 2024-09-12T17:38:35.233+0000 7f6068742800 5 AuthRegistry(0x7ffc00f834f0) adding con mode: secure 2024-09-12T17:38:35.806 INFO:tasks.workunit.client.0.smithi037.stderr: -276> 2024-09-12T17:38:35.233+0000 7f6068742800 5 AuthRegistry(0x7ffc00f834f0) adding con mode: crc 2024-09-12T17:38:35.806 INFO:tasks.workunit.client.0.smithi037.stderr: -275> 2024-09-12T17:38:35.233+0000 7f6068742800 5 AuthRegistry(0x7ffc00f834f0) adding con mode: secure 2024-09-12T17:38:35.806 INFO:tasks.workunit.client.0.smithi037.stderr: -274> 2024-09-12T17:38:35.233+0000 7f6068742800 5 AuthRegistry(0x7ffc00f834f0) adding con mode: crc 2024-09-12T17:38:35.806 INFO:tasks.workunit.client.0.smithi037.stderr: -273> 2024-09-12T17:38:35.233+0000 7f6068742800 5 AuthRegistry(0x7ffc00f834f0) adding con mode: crc 2024-09-12T17:38:35.806 INFO:tasks.workunit.client.0.smithi037.stderr: -272> 2024-09-12T17:38:35.233+0000 7f6068742800 5 AuthRegistry(0x7ffc00f834f0) adding con mode: secure 2024-09-12T17:38:35.807 INFO:tasks.workunit.client.0.smithi037.stderr: -271> 2024-09-12T17:38:35.233+0000 7f6068742800 5 AuthRegistry(0x7ffc00f834f0) adding con mode: crc 2024-09-12T17:38:35.807 INFO:tasks.workunit.client.0.smithi037.stderr: -270> 2024-09-12T17:38:35.233+0000 7f6068742800 5 AuthRegistry(0x7ffc00f834f0) adding con mode: secure 2024-09-12T17:38:35.807 INFO:tasks.workunit.client.0.smithi037.stderr: -269> 2024-09-12T17:38:35.233+0000 7f6068742800 5 AuthRegistry(0x7ffc00f834f0) adding con mode: crc 2024-09-12T17:38:35.807 INFO:tasks.workunit.client.0.smithi037.stderr: -268> 2024-09-12T17:38:35.233+0000 7f6068742800 5 AuthRegistry(0x7ffc00f834f0) adding con mode: secure 2024-09-12T17:38:35.807 INFO:tasks.workunit.client.0.smithi037.stderr: -267> 2024-09-12T17:38:35.233+0000 7f6068742800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:38:35.807 INFO:tasks.workunit.client.0.smithi037.stderr: -266> 2024-09-12T17:38:35.233+0000 7f6068742800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:38:35.807 INFO:tasks.workunit.client.0.smithi037.stderr: -265> 2024-09-12T17:38:35.233+0000 7f6068742800 5 asok(0x55e2f480b730) register_command rotate-key cmddesc rotate-key hook 0x7ffc00f83638 EEXIST 2024-09-12T17:38:35.807 INFO:tasks.workunit.client.0.smithi037.stderr: -264> 2024-09-12T17:38:35.233+0000 7f6068742800 10 monclient: _reopen_session rank -1 2024-09-12T17:38:35.807 INFO:tasks.workunit.client.0.smithi037.stderr: -263> 2024-09-12T17:38:35.233+0000 7f6068742800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T17:38:35.807 INFO:tasks.workunit.client.0.smithi037.stderr: -262> 2024-09-12T17:38:35.233+0000 7f6068742800 10 monclient(hunting): picked mon.noname-c con 0x55e2f4afde80 addr [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] 2024-09-12T17:38:35.807 INFO:tasks.workunit.client.0.smithi037.stderr: -261> 2024-09-12T17:38:35.233+0000 7f6068742800 10 monclient(hunting): picked mon.noname-b con 0x55e2f4af8420 addr [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] 2024-09-12T17:38:35.807 INFO:tasks.workunit.client.0.smithi037.stderr: -260> 2024-09-12T17:38:35.233+0000 7f6068742800 10 monclient(hunting): picked mon.noname-a con 0x55e2f4acdcc0 addr [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] 2024-09-12T17:38:35.807 INFO:tasks.workunit.client.0.smithi037.stderr: -259> 2024-09-12T17:38:35.233+0000 7f6068742800 10 monclient(hunting): start opening mon connection 2024-09-12T17:38:35.807 INFO:tasks.workunit.client.0.smithi037.stderr: -258> 2024-09-12T17:38:35.233+0000 7f6068742800 10 monclient(hunting): start opening mon connection 2024-09-12T17:38:35.808 INFO:tasks.workunit.client.0.smithi037.stderr: -257> 2024-09-12T17:38:35.233+0000 7f6068742800 10 monclient(hunting): start opening mon connection 2024-09-12T17:38:35.808 INFO:tasks.workunit.client.0.smithi037.stderr: -256> 2024-09-12T17:38:35.233+0000 7f6068742800 10 monclient(hunting): _renew_subs 2024-09-12T17:38:35.808 INFO:tasks.workunit.client.0.smithi037.stderr: -255> 2024-09-12T17:38:35.233+0000 7f6068742800 10 monclient(hunting): authenticate will time out at 2502.830834s 2024-09-12T17:38:35.808 INFO:tasks.workunit.client.0.smithi037.stderr: -254> 2024-09-12T17:38:35.233+0000 7f6064486640 10 monclient(hunting): get_auth_request con 0x55e2f4afde80 auth_method 0 2024-09-12T17:38:35.808 INFO:tasks.workunit.client.0.smithi037.stderr: -253> 2024-09-12T17:38:35.233+0000 7f6064486640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:38:35.808 INFO:tasks.workunit.client.0.smithi037.stderr: -252> 2024-09-12T17:38:35.233+0000 7f6064486640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:38:35.808 INFO:tasks.workunit.client.0.smithi037.stderr: -251> 2024-09-12T17:38:35.233+0000 7f6064486640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:38:35.808 INFO:tasks.workunit.client.0.smithi037.stderr: -250> 2024-09-12T17:38:35.233+0000 7f6064c87640 10 monclient(hunting): get_auth_request con 0x55e2f4acdcc0 auth_method 0 2024-09-12T17:38:35.808 INFO:tasks.workunit.client.0.smithi037.stderr: -249> 2024-09-12T17:38:35.233+0000 7f6064c87640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:38:35.808 INFO:tasks.workunit.client.0.smithi037.stderr: -248> 2024-09-12T17:38:35.233+0000 7f6064c87640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:38:35.808 INFO:tasks.workunit.client.0.smithi037.stderr: -247> 2024-09-12T17:38:35.233+0000 7f6064c87640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:38:35.808 INFO:tasks.workunit.client.0.smithi037.stderr: -246> 2024-09-12T17:38:35.234+0000 7f6064486640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:38:35.808 INFO:tasks.workunit.client.0.smithi037.stderr: -245> 2024-09-12T17:38:35.234+0000 7f6064486640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:38:35.809 INFO:tasks.workunit.client.0.smithi037.stderr: -244> 2024-09-12T17:38:35.234+0000 7f6064486640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:38:35.809 INFO:tasks.workunit.client.0.smithi037.stderr: -243> 2024-09-12T17:38:35.234+0000 7f6064c87640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:38:35.809 INFO:tasks.workunit.client.0.smithi037.stderr: -242> 2024-09-12T17:38:35.234+0000 7f6064c87640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:38:35.809 INFO:tasks.workunit.client.0.smithi037.stderr: -241> 2024-09-12T17:38:35.234+0000 7f6064c87640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:38:35.809 INFO:tasks.workunit.client.0.smithi037.stderr: -240> 2024-09-12T17:38:35.234+0000 7f6063c85640 10 monclient(hunting): get_auth_request con 0x55e2f4af8420 auth_method 0 2024-09-12T17:38:35.809 INFO:tasks.workunit.client.0.smithi037.stderr: -239> 2024-09-12T17:38:35.234+0000 7f6063c85640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:38:35.809 INFO:tasks.workunit.client.0.smithi037.stderr: -238> 2024-09-12T17:38:35.234+0000 7f6063c85640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:38:35.809 INFO:tasks.workunit.client.0.smithi037.stderr: -237> 2024-09-12T17:38:35.234+0000 7f6063c85640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:38:35.809 INFO:tasks.workunit.client.0.smithi037.stderr: -236> 2024-09-12T17:38:35.234+0000 7f6064486640 10 monclient(hunting): handle_auth_done global_id 7832 payload 274 2024-09-12T17:38:35.809 INFO:tasks.workunit.client.0.smithi037.stderr: -235> 2024-09-12T17:38:35.234+0000 7f6064486640 10 monclient: _finish_hunting 0 2024-09-12T17:38:35.809 INFO:tasks.workunit.client.0.smithi037.stderr: -234> 2024-09-12T17:38:35.234+0000 7f6064486640 1 monclient: found mon.noname-c 2024-09-12T17:38:35.809 INFO:tasks.workunit.client.0.smithi037.stderr: -233> 2024-09-12T17:38:35.234+0000 7f6064486640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.37:3301/0 2024-09-12T17:38:35.809 INFO:tasks.workunit.client.0.smithi037.stderr: -232> 2024-09-12T17:38:35.234+0000 7f5f3b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:38:35.809 INFO:tasks.workunit.client.0.smithi037.stderr: -231> 2024-09-12T17:38:35.234+0000 7f5f3b7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:38:35.810 INFO:tasks.workunit.client.0.smithi037.stderr: -230> 2024-09-12T17:38:35.234+0000 7f5f3b7fe640 10 monclient: dump: 2024-09-12T17:38:35.810 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:38:35.810 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:38:35.810 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:38:35.810 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:38:35.810 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:38:35.810 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:38:35.810 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:38:35.810 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:38:35.810 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:38:35.810 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:38:35.810 INFO:tasks.workunit.client.0.smithi037.stderr: -229> 2024-09-12T17:38:35.234+0000 7f5f3b7fe640 10 monclient: _finish_auth 0 2024-09-12T17:38:35.810 INFO:tasks.workunit.client.0.smithi037.stderr: -228> 2024-09-12T17:38:35.234+0000 7f5f3b7fe640 10 monclient: _check_auth_tickets 2024-09-12T17:38:35.811 INFO:tasks.workunit.client.0.smithi037.stderr: -227> 2024-09-12T17:38:35.234+0000 7f5f3b7fe640 10 monclient: handle_config config(0 keys) 2024-09-12T17:38:35.811 INFO:tasks.workunit.client.0.smithi037.stderr: -226> 2024-09-12T17:38:35.234+0000 7f6068742800 5 monclient: authenticate success, global_id 7832 2024-09-12T17:38:35.811 INFO:tasks.workunit.client.0.smithi037.stderr: -225> 2024-09-12T17:38:35.234+0000 7f5f3b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:38:35.811 INFO:tasks.workunit.client.0.smithi037.stderr: -224> 2024-09-12T17:38:35.234+0000 7f5f3b7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:38:35.811 INFO:tasks.workunit.client.0.smithi037.stderr: -223> 2024-09-12T17:38:35.234+0000 7f5f3b7fe640 10 monclient: dump: 2024-09-12T17:38:35.811 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:38:35.811 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:38:35.811 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:38:35.811 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:38:35.811 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:38:35.811 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:38:35.811 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:38:35.811 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:38:35.811 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:38:35.812 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:38:35.812 INFO:tasks.workunit.client.0.smithi037.stderr: -222> 2024-09-12T17:38:35.234+0000 7f6068742800 10 monclient: get_monmap_and_config success 2024-09-12T17:38:35.812 INFO:tasks.workunit.client.0.smithi037.stderr: -221> 2024-09-12T17:38:35.234+0000 7f6068742800 4 set_mon_vals no callback set 2024-09-12T17:38:35.812 INFO:tasks.workunit.client.0.smithi037.stderr: -220> 2024-09-12T17:38:35.234+0000 7f6068742800 10 monclient: shutdown 2024-09-12T17:38:35.812 INFO:tasks.workunit.client.0.smithi037.stderr: -219> 2024-09-12T17:38:35.235+0000 7f6068742800 10 monclient: build_initial_monmap 2024-09-12T17:38:35.812 INFO:tasks.workunit.client.0.smithi037.stderr: -218> 2024-09-12T17:38:35.235+0000 7f6068742800 1 build_initial for_mkfs: 0 2024-09-12T17:38:35.812 INFO:tasks.workunit.client.0.smithi037.stderr: -217> 2024-09-12T17:38:35.235+0000 7f6068742800 10 monclient: monmap: 2024-09-12T17:38:35.812 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 0 2024-09-12T17:38:35.812 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:38:35.812 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 0.000000 2024-09-12T17:38:35.812 INFO:tasks.workunit.client.0.smithi037.stderr:created 0.000000 2024-09-12T17:38:35.812 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 0 (unknown) 2024-09-12T17:38:35.812 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:38:35.813 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.noname-a 2024-09-12T17:38:35.813 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.noname-b 2024-09-12T17:38:35.813 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.noname-c 2024-09-12T17:38:35.813 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:38:35.813 INFO:tasks.workunit.client.0.smithi037.stderr: -216> 2024-09-12T17:38:35.235+0000 7f6068742800 5 AuthRegistry(0x55e2f4af93e0) adding auth protocol: cephx 2024-09-12T17:38:35.813 INFO:tasks.workunit.client.0.smithi037.stderr: -215> 2024-09-12T17:38:35.235+0000 7f6068742800 5 AuthRegistry(0x55e2f4af93e0) adding auth protocol: cephx 2024-09-12T17:38:35.813 INFO:tasks.workunit.client.0.smithi037.stderr: -214> 2024-09-12T17:38:35.235+0000 7f6068742800 5 AuthRegistry(0x55e2f4af93e0) adding auth protocol: cephx 2024-09-12T17:38:35.813 INFO:tasks.workunit.client.0.smithi037.stderr: -213> 2024-09-12T17:38:35.235+0000 7f6068742800 5 AuthRegistry(0x55e2f4af93e0) adding con mode: secure 2024-09-12T17:38:35.813 INFO:tasks.workunit.client.0.smithi037.stderr: -212> 2024-09-12T17:38:35.235+0000 7f6068742800 5 AuthRegistry(0x55e2f4af93e0) adding con mode: crc 2024-09-12T17:38:35.813 INFO:tasks.workunit.client.0.smithi037.stderr: -211> 2024-09-12T17:38:35.235+0000 7f6068742800 5 AuthRegistry(0x55e2f4af93e0) adding con mode: secure 2024-09-12T17:38:35.813 INFO:tasks.workunit.client.0.smithi037.stderr: -210> 2024-09-12T17:38:35.235+0000 7f6068742800 5 AuthRegistry(0x55e2f4af93e0) adding con mode: crc 2024-09-12T17:38:35.813 INFO:tasks.workunit.client.0.smithi037.stderr: -209> 2024-09-12T17:38:35.235+0000 7f6068742800 5 AuthRegistry(0x55e2f4af93e0) adding con mode: secure 2024-09-12T17:38:35.813 INFO:tasks.workunit.client.0.smithi037.stderr: -208> 2024-09-12T17:38:35.235+0000 7f6068742800 5 AuthRegistry(0x55e2f4af93e0) adding con mode: crc 2024-09-12T17:38:35.813 INFO:tasks.workunit.client.0.smithi037.stderr: -207> 2024-09-12T17:38:35.235+0000 7f6068742800 5 AuthRegistry(0x55e2f4af93e0) adding con mode: crc 2024-09-12T17:38:35.814 INFO:tasks.workunit.client.0.smithi037.stderr: -206> 2024-09-12T17:38:35.235+0000 7f6068742800 5 AuthRegistry(0x55e2f4af93e0) adding con mode: secure 2024-09-12T17:38:35.814 INFO:tasks.workunit.client.0.smithi037.stderr: -205> 2024-09-12T17:38:35.235+0000 7f6068742800 5 AuthRegistry(0x55e2f4af93e0) adding con mode: crc 2024-09-12T17:38:35.814 INFO:tasks.workunit.client.0.smithi037.stderr: -204> 2024-09-12T17:38:35.235+0000 7f6068742800 5 AuthRegistry(0x55e2f4af93e0) adding con mode: secure 2024-09-12T17:38:35.814 INFO:tasks.workunit.client.0.smithi037.stderr: -203> 2024-09-12T17:38:35.235+0000 7f6068742800 5 AuthRegistry(0x55e2f4af93e0) adding con mode: crc 2024-09-12T17:38:35.814 INFO:tasks.workunit.client.0.smithi037.stderr: -202> 2024-09-12T17:38:35.235+0000 7f6068742800 5 AuthRegistry(0x55e2f4af93e0) adding con mode: secure 2024-09-12T17:38:35.814 INFO:tasks.workunit.client.0.smithi037.stderr: -201> 2024-09-12T17:38:35.235+0000 7f6068742800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:38:35.814 INFO:tasks.workunit.client.0.smithi037.stderr: -200> 2024-09-12T17:38:35.235+0000 7f6068742800 1 librados: starting msgr at 2024-09-12T17:38:35.814 INFO:tasks.workunit.client.0.smithi037.stderr: -199> 2024-09-12T17:38:35.235+0000 7f6068742800 1 librados: starting objecter 2024-09-12T17:38:35.814 INFO:tasks.workunit.client.0.smithi037.stderr: -198> 2024-09-12T17:38:35.235+0000 7f6068742800 5 asok(0x55e2f480b730) register_command objecter_requests cmddesc objecter_requests hook 0x55e2f4af0d60 EEXIST 2024-09-12T17:38:35.814 INFO:tasks.workunit.client.0.smithi037.stderr: -197> 2024-09-12T17:38:35.235+0000 7f6068742800 1 librados: setting wanted keys 2024-09-12T17:38:35.814 INFO:tasks.workunit.client.0.smithi037.stderr: -196> 2024-09-12T17:38:35.235+0000 7f6068742800 1 librados: calling monclient init 2024-09-12T17:38:35.814 INFO:tasks.workunit.client.0.smithi037.stderr: -195> 2024-09-12T17:38:35.235+0000 7f6068742800 10 monclient: init 2024-09-12T17:38:35.814 INFO:tasks.workunit.client.0.smithi037.stderr: -194> 2024-09-12T17:38:35.235+0000 7f6068742800 5 AuthRegistry(0x55e2f4ac17a0) adding auth protocol: cephx 2024-09-12T17:38:35.814 INFO:tasks.workunit.client.0.smithi037.stderr: -193> 2024-09-12T17:38:35.235+0000 7f6068742800 5 AuthRegistry(0x55e2f4ac17a0) adding auth protocol: cephx 2024-09-12T17:38:35.814 INFO:tasks.workunit.client.0.smithi037.stderr: -192> 2024-09-12T17:38:35.235+0000 7f6068742800 5 AuthRegistry(0x55e2f4ac17a0) adding auth protocol: cephx 2024-09-12T17:38:35.815 INFO:tasks.workunit.client.0.smithi037.stderr: -191> 2024-09-12T17:38:35.235+0000 7f6068742800 5 AuthRegistry(0x55e2f4ac17a0) adding con mode: secure 2024-09-12T17:38:35.815 INFO:tasks.workunit.client.0.smithi037.stderr: -190> 2024-09-12T17:38:35.235+0000 7f6068742800 5 AuthRegistry(0x55e2f4ac17a0) adding con mode: crc 2024-09-12T17:38:35.815 INFO:tasks.workunit.client.0.smithi037.stderr: -189> 2024-09-12T17:38:35.235+0000 7f6068742800 5 AuthRegistry(0x55e2f4ac17a0) adding con mode: secure 2024-09-12T17:38:35.815 INFO:tasks.workunit.client.0.smithi037.stderr: -188> 2024-09-12T17:38:35.235+0000 7f6068742800 5 AuthRegistry(0x55e2f4ac17a0) adding con mode: crc 2024-09-12T17:38:35.815 INFO:tasks.workunit.client.0.smithi037.stderr: -187> 2024-09-12T17:38:35.235+0000 7f6068742800 5 AuthRegistry(0x55e2f4ac17a0) adding con mode: secure 2024-09-12T17:38:35.815 INFO:tasks.workunit.client.0.smithi037.stderr: -186> 2024-09-12T17:38:35.235+0000 7f6068742800 5 AuthRegistry(0x55e2f4ac17a0) adding con mode: crc 2024-09-12T17:38:35.815 INFO:tasks.workunit.client.0.smithi037.stderr: -185> 2024-09-12T17:38:35.235+0000 7f6068742800 5 AuthRegistry(0x55e2f4ac17a0) adding con mode: crc 2024-09-12T17:38:35.815 INFO:tasks.workunit.client.0.smithi037.stderr: -184> 2024-09-12T17:38:35.235+0000 7f6068742800 5 AuthRegistry(0x55e2f4ac17a0) adding con mode: secure 2024-09-12T17:38:35.815 INFO:tasks.workunit.client.0.smithi037.stderr: -183> 2024-09-12T17:38:35.235+0000 7f6068742800 5 AuthRegistry(0x55e2f4ac17a0) adding con mode: crc 2024-09-12T17:38:35.815 INFO:tasks.workunit.client.0.smithi037.stderr: -182> 2024-09-12T17:38:35.235+0000 7f6068742800 5 AuthRegistry(0x55e2f4ac17a0) adding con mode: secure 2024-09-12T17:38:35.815 INFO:tasks.workunit.client.0.smithi037.stderr: -181> 2024-09-12T17:38:35.235+0000 7f6068742800 5 AuthRegistry(0x55e2f4ac17a0) adding con mode: crc 2024-09-12T17:38:35.815 INFO:tasks.workunit.client.0.smithi037.stderr: -180> 2024-09-12T17:38:35.235+0000 7f6068742800 5 AuthRegistry(0x55e2f4ac17a0) adding con mode: secure 2024-09-12T17:38:35.815 INFO:tasks.workunit.client.0.smithi037.stderr: -179> 2024-09-12T17:38:35.235+0000 7f6068742800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:38:35.816 INFO:tasks.workunit.client.0.smithi037.stderr: -178> 2024-09-12T17:38:35.235+0000 7f6068742800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:38:35.816 INFO:tasks.workunit.client.0.smithi037.stderr: -177> 2024-09-12T17:38:35.235+0000 7f6068742800 5 asok(0x55e2f480b730) register_command rotate-key cmddesc rotate-key hook 0x55e2f4ac18e8 EEXIST 2024-09-12T17:38:35.816 INFO:tasks.workunit.client.0.smithi037.stderr: -176> 2024-09-12T17:38:35.236+0000 7f6068742800 10 monclient: _reopen_session rank -1 2024-09-12T17:38:35.816 INFO:tasks.workunit.client.0.smithi037.stderr: -175> 2024-09-12T17:38:35.236+0000 7f6068742800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T17:38:35.816 INFO:tasks.workunit.client.0.smithi037.stderr: -174> 2024-09-12T17:38:35.236+0000 7f6068742800 10 monclient(hunting): picked mon.noname-a con 0x55e2f4acdcc0 addr [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] 2024-09-12T17:38:35.816 INFO:tasks.workunit.client.0.smithi037.stderr: -173> 2024-09-12T17:38:35.236+0000 7f6068742800 10 monclient(hunting): picked mon.noname-c con 0x55e2f4af8420 addr [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] 2024-09-12T17:38:35.816 INFO:tasks.workunit.client.0.smithi037.stderr: -172> 2024-09-12T17:38:35.236+0000 7f6068742800 10 monclient(hunting): picked mon.noname-b con 0x55e2f4afde80 addr [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] 2024-09-12T17:38:35.816 INFO:tasks.workunit.client.0.smithi037.stderr: -171> 2024-09-12T17:38:35.236+0000 7f6068742800 10 monclient(hunting): start opening mon connection 2024-09-12T17:38:35.816 INFO:tasks.workunit.client.0.smithi037.stderr: -170> 2024-09-12T17:38:35.236+0000 7f6068742800 10 monclient(hunting): start opening mon connection 2024-09-12T17:38:35.816 INFO:tasks.workunit.client.0.smithi037.stderr: -169> 2024-09-12T17:38:35.236+0000 7f6068742800 10 monclient(hunting): start opening mon connection 2024-09-12T17:38:35.816 INFO:tasks.workunit.client.0.smithi037.stderr: -168> 2024-09-12T17:38:35.236+0000 7f6068742800 10 monclient(hunting): _renew_subs 2024-09-12T17:38:35.816 INFO:tasks.workunit.client.0.smithi037.stderr: -167> 2024-09-12T17:38:35.236+0000 7f6068742800 10 monclient(hunting): authenticate will time out at 2502.833058s 2024-09-12T17:38:35.816 INFO:tasks.workunit.client.0.smithi037.stderr: -166> 2024-09-12T17:38:35.236+0000 7f6064486640 10 monclient(hunting): get_auth_request con 0x55e2f4acdcc0 auth_method 0 2024-09-12T17:38:35.816 INFO:tasks.workunit.client.0.smithi037.stderr: -165> 2024-09-12T17:38:35.236+0000 7f6064486640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:38:35.817 INFO:tasks.workunit.client.0.smithi037.stderr: -164> 2024-09-12T17:38:35.236+0000 7f6064486640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:38:35.817 INFO:tasks.workunit.client.0.smithi037.stderr: -163> 2024-09-12T17:38:35.236+0000 7f6064486640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:38:35.817 INFO:tasks.workunit.client.0.smithi037.stderr: -162> 2024-09-12T17:38:35.236+0000 7f6063c85640 10 monclient(hunting): get_auth_request con 0x55e2f4af8420 auth_method 0 2024-09-12T17:38:35.817 INFO:tasks.workunit.client.0.smithi037.stderr: -161> 2024-09-12T17:38:35.236+0000 7f6063c85640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:38:35.817 INFO:tasks.workunit.client.0.smithi037.stderr: -160> 2024-09-12T17:38:35.236+0000 7f6063c85640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:38:35.817 INFO:tasks.workunit.client.0.smithi037.stderr: -159> 2024-09-12T17:38:35.236+0000 7f6063c85640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:38:35.817 INFO:tasks.workunit.client.0.smithi037.stderr: -158> 2024-09-12T17:38:35.236+0000 7f6064486640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:38:35.817 INFO:tasks.workunit.client.0.smithi037.stderr: -157> 2024-09-12T17:38:35.236+0000 7f6064486640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:38:35.817 INFO:tasks.workunit.client.0.smithi037.stderr: -156> 2024-09-12T17:38:35.236+0000 7f6064486640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:38:35.818 INFO:tasks.workunit.client.0.smithi037.stderr: -155> 2024-09-12T17:38:35.236+0000 7f6063c85640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:38:35.818 INFO:tasks.workunit.client.0.smithi037.stderr: -154> 2024-09-12T17:38:35.236+0000 7f6063c85640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:38:35.818 INFO:tasks.workunit.client.0.smithi037.stderr: -153> 2024-09-12T17:38:35.236+0000 7f6063c85640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:38:35.818 INFO:tasks.workunit.client.0.smithi037.stderr: -152> 2024-09-12T17:38:35.236+0000 7f6064c87640 10 monclient(hunting): get_auth_request con 0x55e2f4afde80 auth_method 0 2024-09-12T17:38:35.818 INFO:tasks.workunit.client.0.smithi037.stderr: -151> 2024-09-12T17:38:35.236+0000 7f6064c87640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:38:35.818 INFO:tasks.workunit.client.0.smithi037.stderr: -150> 2024-09-12T17:38:35.236+0000 7f6064c87640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:38:35.818 INFO:tasks.workunit.client.0.smithi037.stderr: -149> 2024-09-12T17:38:35.236+0000 7f6064c87640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:38:35.818 INFO:tasks.workunit.client.0.smithi037.stderr: -148> 2024-09-12T17:38:35.236+0000 7f6064486640 10 monclient(hunting): handle_auth_done global_id 8397 payload 824 2024-09-12T17:38:35.818 INFO:tasks.workunit.client.0.smithi037.stderr: -147> 2024-09-12T17:38:35.236+0000 7f6064486640 10 monclient: _finish_hunting 0 2024-09-12T17:38:35.818 INFO:tasks.workunit.client.0.smithi037.stderr: -146> 2024-09-12T17:38:35.236+0000 7f6064486640 1 monclient: found mon.noname-a 2024-09-12T17:38:35.818 INFO:tasks.workunit.client.0.smithi037.stderr: -145> 2024-09-12T17:38:35.236+0000 7f6064486640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.37:3300/0 2024-09-12T17:38:35.818 INFO:tasks.workunit.client.0.smithi037.stderr: -144> 2024-09-12T17:38:35.236+0000 7f5f39ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:38:35.818 INFO:tasks.workunit.client.0.smithi037.stderr: -143> 2024-09-12T17:38:35.236+0000 7f5f39ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:38:35.819 INFO:tasks.workunit.client.0.smithi037.stderr: -142> 2024-09-12T17:38:35.236+0000 7f5f39ffb640 10 monclient: dump: 2024-09-12T17:38:35.819 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:38:35.819 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:38:35.819 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:38:35.819 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:38:35.819 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:38:35.819 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:38:35.819 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:38:35.819 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:38:35.819 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:38:35.819 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:38:35.819 INFO:tasks.workunit.client.0.smithi037.stderr: -141> 2024-09-12T17:38:35.236+0000 7f5f39ffb640 10 monclient: _finish_auth 0 2024-09-12T17:38:35.819 INFO:tasks.workunit.client.0.smithi037.stderr: -140> 2024-09-12T17:38:35.236+0000 7f5f39ffb640 10 monclient: _check_auth_tickets 2024-09-12T17:38:35.820 INFO:tasks.workunit.client.0.smithi037.stderr: -139> 2024-09-12T17:38:35.236+0000 7f6068742800 5 monclient: authenticate success, global_id 8397 2024-09-12T17:38:35.820 INFO:tasks.workunit.client.0.smithi037.stderr: -138> 2024-09-12T17:38:35.236+0000 7f6068742800 10 monclient: _renew_subs 2024-09-12T17:38:35.820 INFO:tasks.workunit.client.0.smithi037.stderr: -137> 2024-09-12T17:38:35.236+0000 7f6068742800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.37:3300/0 2024-09-12T17:38:35.820 INFO:tasks.workunit.client.0.smithi037.stderr: -136> 2024-09-12T17:38:35.236+0000 7f5f39ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T17:38:35.820 INFO:tasks.workunit.client.0.smithi037.stderr: -135> 2024-09-12T17:38:35.236+0000 7f5f39ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:38:35.820 INFO:tasks.workunit.client.0.smithi037.stderr: -134> 2024-09-12T17:38:35.236+0000 7f5f39ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:38:35.820 INFO:tasks.workunit.client.0.smithi037.stderr: -133> 2024-09-12T17:38:35.236+0000 7f5f39ffb640 10 monclient: dump: 2024-09-12T17:38:35.820 INFO:tasks.workunit.client.0.smithi037.stderr:epoch 1 2024-09-12T17:38:35.820 INFO:tasks.workunit.client.0.smithi037.stderr:fsid 46ca2ab5-4447-4511-b6c4-0ec801120127 2024-09-12T17:38:35.820 INFO:tasks.workunit.client.0.smithi037.stderr:last_changed 2024-09-12T17:09:29.814081+0000 2024-09-12T17:38:35.820 INFO:tasks.workunit.client.0.smithi037.stderr:created 2024-09-12T17:09:29.814081+0000 2024-09-12T17:38:35.820 INFO:tasks.workunit.client.0.smithi037.stderr:min_mon_release 19 (squid) 2024-09-12T17:38:35.821 INFO:tasks.workunit.client.0.smithi037.stderr:election_strategy: 1 2024-09-12T17:38:35.821 INFO:tasks.workunit.client.0.smithi037.stderr:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-12T17:38:35.821 INFO:tasks.workunit.client.0.smithi037.stderr:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2024-09-12T17:38:35.821 INFO:tasks.workunit.client.0.smithi037.stderr:2: [v2:172.21.15.37:3301/0,v1:172.21.15.37:6790/0] mon.c 2024-09-12T17:38:35.821 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:38:35.821 INFO:tasks.workunit.client.0.smithi037.stderr: -132> 2024-09-12T17:38:35.236+0000 7f5f3b7fe640 4 set_mon_vals no callback set 2024-09-12T17:38:35.821 INFO:tasks.workunit.client.0.smithi037.stderr: -131> 2024-09-12T17:38:35.236+0000 7f6068742800 10 monclient: _renew_subs 2024-09-12T17:38:35.821 INFO:tasks.workunit.client.0.smithi037.stderr: -130> 2024-09-12T17:38:35.236+0000 7f6068742800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.37:3300/0 2024-09-12T17:38:35.821 INFO:tasks.workunit.client.0.smithi037.stderr: -129> 2024-09-12T17:38:35.236+0000 7f6068742800 1 librados: init done 2024-09-12T17:38:35.821 INFO:tasks.workunit.client.0.smithi037.stderr: -128> 2024-09-12T17:38:35.236+0000 7f6068742800 5 asok(0x55e2f480b730) register_command cr dump hook 0x55e2f4aee6c8 2024-09-12T17:38:35.821 INFO:tasks.workunit.client.0.smithi037.stderr: -127> 2024-09-12T17:38:35.238+0000 7f6068742800 20 rados->read ofs=0 len=0 2024-09-12T17:38:35.821 INFO:tasks.workunit.client.0.smithi037.stderr: -126> 2024-09-12T17:38:35.238+0000 7f5f39ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:38:35.822 INFO:tasks.workunit.client.0.smithi037.stderr: -125> 2024-09-12T17:38:35.238+0000 7f5f39ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.40:6816/3916250676,v1:172.21.15.40:6817/3916250676] 2024-09-12T17:38:35.822 INFO:tasks.workunit.client.0.smithi037.stderr: -124> 2024-09-12T17:38:35.238+0000 7f5f39ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.40:6816/3916250676,v1:172.21.15.40:6817/3916250676] 2024-09-12T17:38:35.822 INFO:tasks.workunit.client.0.smithi037.stderr: -123> 2024-09-12T17:38:35.238+0000 7f6063c85640 10 monclient: get_auth_request con 0x7f5f2c076470 auth_method 0 2024-09-12T17:38:35.822 INFO:tasks.workunit.client.0.smithi037.stderr: -122> 2024-09-12T17:38:35.239+0000 7f6064c87640 10 monclient: get_auth_request con 0x55e2f4b18120 auth_method 0 2024-09-12T17:38:35.822 INFO:tasks.workunit.client.0.smithi037.stderr: -121> 2024-09-12T17:38:35.239+0000 7f6068742800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:35.822 INFO:tasks.workunit.client.0.smithi037.stderr: -120> 2024-09-12T17:38:35.239+0000 7f6068742800 20 realm 2024-09-12T17:38:35.822 INFO:tasks.workunit.client.0.smithi037.stderr: -119> 2024-09-12T17:38:35.239+0000 7f6068742800 20 rados->read ofs=0 len=0 2024-09-12T17:38:35.822 INFO:tasks.workunit.client.0.smithi037.stderr: -118> 2024-09-12T17:38:35.239+0000 7f6068742800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:35.822 INFO:tasks.workunit.client.0.smithi037.stderr: -117> 2024-09-12T17:38:35.239+0000 7f6068742800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:38:35.822 INFO:tasks.workunit.client.0.smithi037.stderr: -116> 2024-09-12T17:38:35.239+0000 7f6068742800 20 rados->read ofs=0 len=0 2024-09-12T17:38:35.822 INFO:tasks.workunit.client.0.smithi037.stderr: -115> 2024-09-12T17:38:35.239+0000 7f6068742800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:35.822 INFO:tasks.workunit.client.0.smithi037.stderr: -114> 2024-09-12T17:38:35.239+0000 7f6068742800 20 rados->read ofs=0 len=0 2024-09-12T17:38:35.822 INFO:tasks.workunit.client.0.smithi037.stderr: -113> 2024-09-12T17:38:35.240+0000 7f6064486640 10 monclient: get_auth_request con 0x55e2f4b1c3b0 auth_method 0 2024-09-12T17:38:35.823 INFO:tasks.workunit.client.0.smithi037.stderr: -112> 2024-09-12T17:38:35.240+0000 7f6068742800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:38:35.823 INFO:tasks.workunit.client.0.smithi037.stderr: -111> 2024-09-12T17:38:35.240+0000 7f6068742800 20 rados->read ofs=0 len=0 2024-09-12T17:38:35.823 INFO:tasks.workunit.client.0.smithi037.stderr: -110> 2024-09-12T17:38:35.241+0000 7f6068742800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:38:35.823 INFO:tasks.workunit.client.0.smithi037.stderr: -109> 2024-09-12T17:38:35.241+0000 7f6068742800 20 searching for the correct realm 2024-09-12T17:38:35.823 INFO:tasks.workunit.client.0.smithi037.stderr: -108> 2024-09-12T17:38:35.241+0000 7f6063c85640 10 monclient: get_auth_request con 0x55e2f4b21650 auth_method 0 2024-09-12T17:38:35.823 INFO:tasks.workunit.client.0.smithi037.stderr: -107> 2024-09-12T17:38:35.242+0000 7f6064c87640 10 monclient: get_auth_request con 0x7f6058085990 auth_method 0 2024-09-12T17:38:35.823 INFO:tasks.workunit.client.0.smithi037.stderr: -106> 2024-09-12T17:38:35.242+0000 7f6064486640 10 monclient: get_auth_request con 0x7f605c064be0 auth_method 0 2024-09-12T17:38:35.823 INFO:tasks.workunit.client.0.smithi037.stderr: -105> 2024-09-12T17:38:35.444+0000 7f6064486640 10 monclient: get_auth_request con 0x7f605c064be0 auth_method 0 2024-09-12T17:38:35.823 INFO:tasks.workunit.client.0.smithi037.stderr: -104> 2024-09-12T17:38:35.445+0000 7f6063c85640 10 monclient: get_auth_request con 0x7f6054098040 auth_method 0 2024-09-12T17:38:35.823 INFO:tasks.workunit.client.0.smithi037.stderr: -103> 2024-09-12T17:38:35.446+0000 7f6063c85640 0 -- 172.21.15.37:0/1307656127 >> [v2:172.21.15.40:6800/2441293461,v1:172.21.15.40:6801/2441293461] conn(0x7f6054098040 msgr2=0x7f6054001030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:38:35.823 INFO:tasks.workunit.client.0.smithi037.stderr: -102> 2024-09-12T17:38:35.446+0000 7f5f39ffb640 1 client.8397.objecter ms_handle_reset 0x7f6054098040 session 0x7f6054086e90 osd.4 2024-09-12T17:38:35.823 INFO:tasks.workunit.client.0.smithi037.stderr: -101> 2024-09-12T17:38:35.446+0000 7f5f39ffb640 10 monclient: _renew_subs 2024-09-12T17:38:35.823 INFO:tasks.workunit.client.0.smithi037.stderr: -100> 2024-09-12T17:38:35.446+0000 7f5f39ffb640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.37:3300/0 2024-09-12T17:38:35.823 INFO:tasks.workunit.client.0.smithi037.stderr: -99> 2024-09-12T17:38:35.446+0000 7f6063c85640 10 monclient: get_auth_request con 0x7f5f2c086b10 auth_method 0 2024-09-12T17:38:35.824 INFO:tasks.workunit.client.0.smithi037.stderr: -98> 2024-09-12T17:38:35.448+0000 7f6064c87640 10 monclient: get_auth_request con 0x7f605806c940 auth_method 0 2024-09-12T17:38:35.824 INFO:tasks.workunit.client.0.smithi037.stderr: -97> 2024-09-12T17:38:35.451+0000 7f6064486640 10 monclient: get_auth_request con 0x7f60580a23f0 auth_method 0 2024-09-12T17:38:35.824 INFO:tasks.workunit.client.0.smithi037.stderr: -96> 2024-09-12T17:38:35.451+0000 7f6064486640 0 -- 172.21.15.37:0/1307656127 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7f60580a23f0 msgr2=0x7f60580a2870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:38:35.824 INFO:tasks.workunit.client.0.smithi037.stderr: -95> 2024-09-12T17:38:35.653+0000 7f6064486640 10 monclient: get_auth_request con 0x7f60580a23f0 auth_method 0 2024-09-12T17:38:35.824 INFO:tasks.workunit.client.0.smithi037.stderr: -94> 2024-09-12T17:38:35.659+0000 7f6068742800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:38:35.824 INFO:tasks.workunit.client.0.smithi037.stderr: -93> 2024-09-12T17:38:35.659+0000 7f6068742800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:38:35.824 INFO:tasks.workunit.client.0.smithi037.stderr: -92> 2024-09-12T17:38:35.659+0000 7f6068742800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:38:35.824 INFO:tasks.workunit.client.0.smithi037.stderr: -91> 2024-09-12T17:38:35.659+0000 7f6068742800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:38:35.824 INFO:tasks.workunit.client.0.smithi037.stderr: -90> 2024-09-12T17:38:35.659+0000 7f6068742800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:38:35.824 INFO:tasks.workunit.client.0.smithi037.stderr: -89> 2024-09-12T17:38:35.659+0000 7f6068742800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:38:35.824 INFO:tasks.workunit.client.0.smithi037.stderr: -88> 2024-09-12T17:38:35.659+0000 7f6068742800 20 rados->read ofs=0 len=0 2024-09-12T17:38:35.824 INFO:tasks.workunit.client.0.smithi037.stderr: -87> 2024-09-12T17:38:35.660+0000 7f6068742800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:35.825 INFO:tasks.workunit.client.0.smithi037.stderr: -86> 2024-09-12T17:38:35.660+0000 7f6068742800 20 rados->read ofs=0 len=0 2024-09-12T17:38:35.825 INFO:tasks.workunit.client.0.smithi037.stderr: -85> 2024-09-12T17:38:35.660+0000 7f6068742800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:38:35.825 INFO:tasks.workunit.client.0.smithi037.stderr: -84> 2024-09-12T17:38:35.660+0000 7f6068742800 20 rados->read ofs=0 len=0 2024-09-12T17:38:35.825 INFO:tasks.workunit.client.0.smithi037.stderr: -83> 2024-09-12T17:38:35.661+0000 7f6068742800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:38:35.825 INFO:tasks.workunit.client.0.smithi037.stderr: -82> 2024-09-12T17:38:35.661+0000 7f6068742800 20 zone default found 2024-09-12T17:38:35.825 INFO:tasks.workunit.client.0.smithi037.stderr: -81> 2024-09-12T17:38:35.661+0000 7f6068742800 4 Realm: () 2024-09-12T17:38:35.825 INFO:tasks.workunit.client.0.smithi037.stderr: -80> 2024-09-12T17:38:35.661+0000 7f6068742800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:38:35.825 INFO:tasks.workunit.client.0.smithi037.stderr: -79> 2024-09-12T17:38:35.661+0000 7f6068742800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:38:35.825 INFO:tasks.workunit.client.0.smithi037.stderr: -78> 2024-09-12T17:38:35.661+0000 7f6068742800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:38:35.825 INFO:tasks.workunit.client.0.smithi037.stderr: -77> 2024-09-12T17:38:35.661+0000 7f6068742800 20 zonegroup default 2024-09-12T17:38:35.825 INFO:tasks.workunit.client.0.smithi037.stderr: -76> 2024-09-12T17:38:35.661+0000 7f6068742800 20 rados->read ofs=0 len=0 2024-09-12T17:38:35.825 INFO:tasks.workunit.client.0.smithi037.stderr: -75> 2024-09-12T17:38:35.661+0000 7f6068742800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:35.825 INFO:tasks.workunit.client.0.smithi037.stderr: -74> 2024-09-12T17:38:35.661+0000 7f6068742800 20 rados->read ofs=0 len=0 2024-09-12T17:38:35.826 INFO:tasks.workunit.client.0.smithi037.stderr: -73> 2024-09-12T17:38:35.661+0000 7f6068742800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:35.826 INFO:tasks.workunit.client.0.smithi037.stderr: -72> 2024-09-12T17:38:35.661+0000 7f6068742800 20 rados->read ofs=0 len=0 2024-09-12T17:38:35.826 INFO:tasks.workunit.client.0.smithi037.stderr: -71> 2024-09-12T17:38:35.662+0000 7f6068742800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:35.826 INFO:tasks.workunit.client.0.smithi037.stderr: -70> 2024-09-12T17:38:35.662+0000 7f6068742800 20 started sync module instance, tier type = 2024-09-12T17:38:35.826 INFO:tasks.workunit.client.0.smithi037.stderr: -69> 2024-09-12T17:38:35.662+0000 7f6068742800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:38:35.826 INFO:tasks.workunit.client.0.smithi037.stderr: -68> 2024-09-12T17:38:35.673+0000 7f6068742800 20 add_watcher() i=0 2024-09-12T17:38:35.826 INFO:tasks.workunit.client.0.smithi037.stderr: -67> 2024-09-12T17:38:35.673+0000 7f6068742800 20 add_watcher() i=1 2024-09-12T17:38:35.826 INFO:tasks.workunit.client.0.smithi037.stderr: -66> 2024-09-12T17:38:35.673+0000 7f6068742800 20 add_watcher() i=2 2024-09-12T17:38:35.826 INFO:tasks.workunit.client.0.smithi037.stderr: -65> 2024-09-12T17:38:35.673+0000 7f6068742800 20 add_watcher() i=3 2024-09-12T17:38:35.826 INFO:tasks.workunit.client.0.smithi037.stderr: -64> 2024-09-12T17:38:35.673+0000 7f6068742800 20 add_watcher() i=4 2024-09-12T17:38:35.826 INFO:tasks.workunit.client.0.smithi037.stderr: -63> 2024-09-12T17:38:35.673+0000 7f6068742800 20 add_watcher() i=5 2024-09-12T17:38:35.826 INFO:tasks.workunit.client.0.smithi037.stderr: -62> 2024-09-12T17:38:35.673+0000 7f6068742800 20 add_watcher() i=6 2024-09-12T17:38:35.826 INFO:tasks.workunit.client.0.smithi037.stderr: -61> 2024-09-12T17:38:35.674+0000 7f6068742800 20 add_watcher() i=7 2024-09-12T17:38:35.826 INFO:tasks.workunit.client.0.smithi037.stderr: -60> 2024-09-12T17:38:35.674+0000 7f6068742800 2 all 8 watchers are set, enabling cache 2024-09-12T17:38:35.827 INFO:tasks.workunit.client.0.smithi037.stderr: -59> 2024-09-12T17:38:35.677+0000 7f6068742800 5 AuthRegistry(0x7ffc00f839c0) adding auth protocol: cephx 2024-09-12T17:38:35.827 INFO:tasks.workunit.client.0.smithi037.stderr: -58> 2024-09-12T17:38:35.677+0000 7f6068742800 5 AuthRegistry(0x7ffc00f839c0) adding auth protocol: cephx 2024-09-12T17:38:35.827 INFO:tasks.workunit.client.0.smithi037.stderr: -57> 2024-09-12T17:38:35.677+0000 7f6068742800 5 AuthRegistry(0x7ffc00f839c0) adding auth protocol: cephx 2024-09-12T17:38:35.827 INFO:tasks.workunit.client.0.smithi037.stderr: -56> 2024-09-12T17:38:35.677+0000 7f6068742800 5 AuthRegistry(0x7ffc00f839c0) adding con mode: secure 2024-09-12T17:38:35.827 INFO:tasks.workunit.client.0.smithi037.stderr: -55> 2024-09-12T17:38:35.677+0000 7f6068742800 5 AuthRegistry(0x7ffc00f839c0) adding con mode: crc 2024-09-12T17:38:35.827 INFO:tasks.workunit.client.0.smithi037.stderr: -54> 2024-09-12T17:38:35.677+0000 7f6068742800 5 AuthRegistry(0x7ffc00f839c0) adding con mode: secure 2024-09-12T17:38:35.827 INFO:tasks.workunit.client.0.smithi037.stderr: -53> 2024-09-12T17:38:35.677+0000 7f6068742800 5 AuthRegistry(0x7ffc00f839c0) adding con mode: crc 2024-09-12T17:38:35.827 INFO:tasks.workunit.client.0.smithi037.stderr: -52> 2024-09-12T17:38:35.677+0000 7f6068742800 5 AuthRegistry(0x7ffc00f839c0) adding con mode: secure 2024-09-12T17:38:35.827 INFO:tasks.workunit.client.0.smithi037.stderr: -51> 2024-09-12T17:38:35.677+0000 7f6068742800 5 AuthRegistry(0x7ffc00f839c0) adding con mode: crc 2024-09-12T17:38:35.827 INFO:tasks.workunit.client.0.smithi037.stderr: -50> 2024-09-12T17:38:35.677+0000 7f6068742800 5 AuthRegistry(0x7ffc00f839c0) adding con mode: crc 2024-09-12T17:38:35.827 INFO:tasks.workunit.client.0.smithi037.stderr: -49> 2024-09-12T17:38:35.677+0000 7f6068742800 5 AuthRegistry(0x7ffc00f839c0) adding con mode: secure 2024-09-12T17:38:35.827 INFO:tasks.workunit.client.0.smithi037.stderr: -48> 2024-09-12T17:38:35.677+0000 7f6068742800 5 AuthRegistry(0x7ffc00f839c0) adding con mode: crc 2024-09-12T17:38:35.827 INFO:tasks.workunit.client.0.smithi037.stderr: -47> 2024-09-12T17:38:35.677+0000 7f6068742800 5 AuthRegistry(0x7ffc00f839c0) adding con mode: secure 2024-09-12T17:38:35.828 INFO:tasks.workunit.client.0.smithi037.stderr: -46> 2024-09-12T17:38:35.677+0000 7f6068742800 5 AuthRegistry(0x7ffc00f839c0) adding con mode: crc 2024-09-12T17:38:35.828 INFO:tasks.workunit.client.0.smithi037.stderr: -45> 2024-09-12T17:38:35.677+0000 7f6068742800 5 AuthRegistry(0x7ffc00f839c0) adding con mode: secure 2024-09-12T17:38:35.828 INFO:tasks.workunit.client.0.smithi037.stderr: -44> 2024-09-12T17:38:35.677+0000 7f5f1a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:38:35.828 INFO:tasks.workunit.client.0.smithi037.stderr: -43> 2024-09-12T17:38:35.677+0000 7f6068742800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:38:35.828 INFO:tasks.workunit.client.0.smithi037.stderr: -42> 2024-09-12T17:38:35.677+0000 7f6068742800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:38:35.828 INFO:tasks.workunit.client.0.smithi037.stderr: -41> 2024-09-12T17:38:35.677+0000 7f6068742800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:38:35.828 INFO:tasks.workunit.client.0.smithi037.stderr: -40> 2024-09-12T17:38:35.677+0000 7f6068742800 5 asok(0x55e2f480b730) register_command cache list hook 0x55e2f4af5190 2024-09-12T17:38:35.828 INFO:tasks.workunit.client.0.smithi037.stderr: -39> 2024-09-12T17:38:35.677+0000 7f6068742800 5 asok(0x55e2f480b730) register_command cache inspect hook 0x55e2f4af5190 2024-09-12T17:38:35.828 INFO:tasks.workunit.client.0.smithi037.stderr: -38> 2024-09-12T17:38:35.677+0000 7f6068742800 5 asok(0x55e2f480b730) register_command cache erase hook 0x55e2f4af5190 2024-09-12T17:38:35.828 INFO:tasks.workunit.client.0.smithi037.stderr: -37> 2024-09-12T17:38:35.677+0000 7f6068742800 5 asok(0x55e2f480b730) register_command cache zap hook 0x55e2f4af5190 2024-09-12T17:38:35.828 INFO:tasks.workunit.client.0.smithi037.stderr: -36> 2024-09-12T17:38:35.677+0000 7f6068742800 5 note: GC not initialized 2024-09-12T17:38:35.828 INFO:tasks.workunit.client.0.smithi037.stderr: -35> 2024-09-12T17:38:35.677+0000 7f5f197e2640 20 reqs_thread_entry: start 2024-09-12T17:38:35.828 INFO:tasks.workunit.client.0.smithi037.stderr: -34> 2024-09-12T17:38:35.677+0000 7f6068742800 5 asok(0x55e2f480b730) register_command sync trace show hook 0x7f605c0056b0 2024-09-12T17:38:35.828 INFO:tasks.workunit.client.0.smithi037.stderr: -33> 2024-09-12T17:38:35.677+0000 7f6068742800 5 asok(0x55e2f480b730) register_command sync trace history hook 0x7f605c0056b0 2024-09-12T17:38:35.829 INFO:tasks.workunit.client.0.smithi037.stderr: -32> 2024-09-12T17:38:35.677+0000 7f6068742800 5 asok(0x55e2f480b730) register_command sync trace active hook 0x7f605c0056b0 2024-09-12T17:38:35.829 INFO:tasks.workunit.client.0.smithi037.stderr: -31> 2024-09-12T17:38:35.677+0000 7f6068742800 5 asok(0x55e2f480b730) register_command sync trace active_short hook 0x7f605c0056b0 2024-09-12T17:38:35.829 INFO:tasks.workunit.client.0.smithi037.stderr: -30> 2024-09-12T17:38:35.677+0000 7f6068742800 20 init_complete bucket index max shards: 11 2024-09-12T17:38:35.829 INFO:tasks.workunit.client.0.smithi037.stderr: -29> 2024-09-12T17:38:35.677+0000 7f6068742800 20 Filter name: none 2024-09-12T17:38:35.829 INFO:tasks.workunit.client.0.smithi037.stderr: -28> 2024-09-12T17:38:35.678+0000 7f5e8affd640 20 reqs_thread_entry: start 2024-09-12T17:38:35.829 INFO:tasks.workunit.client.0.smithi037.stderr: -27> 2024-09-12T17:38:35.678+0000 7f6068742800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:38:35.829 INFO:tasks.workunit.client.0.smithi037.stderr: -26> 2024-09-12T17:38:35.678+0000 7f6068742800 20 rados->read ofs=0 len=0 2024-09-12T17:38:35.829 INFO:tasks.workunit.client.0.smithi037.stderr: -25> 2024-09-12T17:38:35.678+0000 7f6068742800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:38:35.829 INFO:tasks.workunit.client.0.smithi037.stderr: -24> 2024-09-12T17:38:35.678+0000 7f6068742800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:38:35.829 INFO:tasks.workunit.client.0.smithi037.stderr: -23> 2024-09-12T17:38:35.678+0000 7f6068742800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:38:35.829 INFO:tasks.workunit.client.0.smithi037.stderr: -22> 2024-09-12T17:38:35.678+0000 7f6068742800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 : miss 2024-09-12T17:38:35.829 INFO:tasks.workunit.client.0.smithi037.stderr: -21> 2024-09-12T17:38:35.678+0000 7f6068742800 20 rados->read ofs=0 len=0 2024-09-12T17:38:35.830 INFO:tasks.workunit.client.0.smithi037.stderr: -20> 2024-09-12T17:38:35.679+0000 7f6068742800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T17:38:35.830 INFO:tasks.workunit.client.0.smithi037.stderr: -19> 2024-09-12T17:38:35.679+0000 7f6068742800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 info.flags=0x17 2024-09-12T17:38:35.830 INFO:tasks.workunit.client.0.smithi037.stderr: -18> 2024-09-12T17:38:35.679+0000 7f6068742800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 to cache LRU end 2024-09-12T17:38:35.830 INFO:tasks.workunit.client.0.smithi037.stderr: -17> 2024-09-12T17:38:35.679+0000 7f6068742800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:38:35.830 INFO:tasks.workunit.client.0.smithi037.stderr: -16> 2024-09-12T17:38:35.679+0000 7f6068742800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:38:35.830 INFO:tasks.workunit.client.0.smithi037.stderr: -15> 2024-09-12T17:38:35.679+0000 7f6068742800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 2024-09-12T17:38:35.830 INFO:tasks.workunit.client.0.smithi037.stderr: -14> 2024-09-12T17:38:35.680+0000 7f6068742800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T17:38:35.830 INFO:tasks.workunit.client.0.smithi037.stderr: -13> 2024-09-12T17:38:35.689+0000 7f6068742800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 info.flags=0x17 2024-09-12T17:38:35.830 INFO:tasks.workunit.client.0.smithi037.stderr: -12> 2024-09-12T17:38:35.689+0000 7f6068742800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 to cache LRU end 2024-09-12T17:38:35.830 INFO:tasks.workunit.client.0.smithi037.stderr: -11> 2024-09-12T17:38:35.689+0000 7f6068742800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:38:35.831 INFO:tasks.workunit.client.0.smithi037.stderr: -10> 2024-09-12T17:38:35.689+0000 7f6068742800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18, ofs0, ns] 2024-09-12T17:38:35.831 INFO:tasks.workunit.client.0.smithi037.stderr: -9> 2024-09-12T17:38:35.689+0000 7f5f3affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497021 cookie 94433256320512 notifier 8397 bl.length()=911 2024-09-12T17:38:35.831 INFO:tasks.workunit.client.0.smithi037.stderr: -8> 2024-09-12T17:38:35.689+0000 7f5f3affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 info.flags=0x17 2024-09-12T17:38:35.831 INFO:tasks.workunit.client.0.smithi037.stderr: -7> 2024-09-12T17:38:35.689+0000 7f5f3affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 to cache LRU end 2024-09-12T17:38:35.831 INFO:tasks.workunit.client.0.smithi037.stderr: -6> 2024-09-12T17:38:35.689+0000 7f5f3affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:38:35.831 INFO:tasks.workunit.client.0.smithi037.stderr: -5> 2024-09-12T17:38:35.691+0000 7f6068742800 20 handle_bi_update(): bucket=:a-bucket[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18]): orig_sources= new_sources= 2024-09-12T17:38:35.831 INFO:tasks.workunit.client.0.smithi037.stderr: -4> 2024-09-12T17:38:35.691+0000 7f6068742800 20 handle_bi_update(): bucket=:a-bucket[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18]): potential sources added=[] removed=[] 2024-09-12T17:38:35.831 INFO:tasks.workunit.client.0.smithi037.stderr: -3> 2024-09-12T17:38:35.691+0000 7f6068742800 20 handle_bi_update(): bucket=:a-bucket[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18]): orig_dests= new_dests= 2024-09-12T17:38:35.831 INFO:tasks.workunit.client.0.smithi037.stderr: -2> 2024-09-12T17:38:35.691+0000 7f6068742800 20 handle_bi_update(): bucket=:a-bucket[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18]): potential dests added=[] removed=[] 2024-09-12T17:38:35.831 INFO:tasks.workunit.client.0.smithi037.stderr: -1> 2024-09-12T17:38:35.698+0000 7f6068742800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f6068742800 time 2024-09-12T17:38:35.698004+0000 2024-09-12T17:38:35.831 INFO:tasks.workunit.client.0.smithi037.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4762-gbad475c1/rpm/el9/BUILD/ceph-19.3.0-4762-gbad475c1/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:38:35.832 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:38:35.832 INFO:tasks.workunit.client.0.smithi037.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:38:35.832 INFO:tasks.workunit.client.0.smithi037.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f6069f8c71a] 2024-09-12T17:38:35.832 INFO:tasks.workunit.client.0.smithi037.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f6069f8c8d8] 2024-09-12T17:38:35.832 INFO:tasks.workunit.client.0.smithi037.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e2f3348841] 2024-09-12T17:38:35.832 INFO:tasks.workunit.client.0.smithi037.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55e2f335857a] 2024-09-12T17:38:35.832 INFO:tasks.workunit.client.0.smithi037.stderr: 5: main() 2024-09-12T17:38:35.832 INFO:tasks.workunit.client.0.smithi037.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f6068c29590] 2024-09-12T17:38:35.832 INFO:tasks.workunit.client.0.smithi037.stderr: 7: __libc_start_main() 2024-09-12T17:38:35.832 INFO:tasks.workunit.client.0.smithi037.stderr: 8: _start() 2024-09-12T17:38:35.832 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:38:35.832 INFO:tasks.workunit.client.0.smithi037.stderr: 0> 2024-09-12T17:38:35.698+0000 7f6068742800 -1 *** Caught signal (Aborted) ** 2024-09-12T17:38:35.833 INFO:tasks.workunit.client.0.smithi037.stderr: in thread 7f6068742800 thread_name:radosgw-admin 2024-09-12T17:38:35.833 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:38:35.833 INFO:tasks.workunit.client.0.smithi037.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:38:35.833 INFO:tasks.workunit.client.0.smithi037.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f6068c3e6f0] 2024-09-12T17:38:35.833 INFO:tasks.workunit.client.0.smithi037.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f6068c8b99c] 2024-09-12T17:38:35.833 INFO:tasks.workunit.client.0.smithi037.stderr: 3: raise() 2024-09-12T17:38:35.833 INFO:tasks.workunit.client.0.smithi037.stderr: 4: abort() 2024-09-12T17:38:35.833 INFO:tasks.workunit.client.0.smithi037.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f6069f8c774] 2024-09-12T17:38:35.833 INFO:tasks.workunit.client.0.smithi037.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f6069f8c8d8] 2024-09-12T17:38:35.833 INFO:tasks.workunit.client.0.smithi037.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e2f3348841] 2024-09-12T17:38:35.833 INFO:tasks.workunit.client.0.smithi037.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55e2f335857a] 2024-09-12T17:38:35.833 INFO:tasks.workunit.client.0.smithi037.stderr: 9: main() 2024-09-12T17:38:35.833 INFO:tasks.workunit.client.0.smithi037.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f6068c29590] 2024-09-12T17:38:35.833 INFO:tasks.workunit.client.0.smithi037.stderr: 11: __libc_start_main() 2024-09-12T17:38:35.834 INFO:tasks.workunit.client.0.smithi037.stderr: 12: _start() 2024-09-12T17:38:35.834 INFO:tasks.workunit.client.0.smithi037.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:38:35.834 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:38:35.834 INFO:tasks.workunit.client.0.smithi037.stderr:--- logging levels --- 2024-09-12T17:38:35.834 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 none 2024-09-12T17:38:35.834 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 lockdep 2024-09-12T17:38:35.834 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 context 2024-09-12T17:38:35.834 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 1 crush 2024-09-12T17:38:35.834 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mds 2024-09-12T17:38:35.834 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mds_balancer 2024-09-12T17:38:35.834 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mds_locker 2024-09-12T17:38:35.834 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mds_log 2024-09-12T17:38:35.835 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mds_log_expire 2024-09-12T17:38:35.835 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mds_migrator 2024-09-12T17:38:35.835 INFO:tasks.workunit.client.0.smithi037.stderr: 3/ 5 mds_quiesce 2024-09-12T17:38:35.835 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 buffer 2024-09-12T17:38:35.835 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 timer 2024-09-12T17:38:35.835 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 filer 2024-09-12T17:38:35.835 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 striper 2024-09-12T17:38:35.835 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 1 objecter 2024-09-12T17:38:35.835 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 rados 2024-09-12T17:38:35.835 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 rbd 2024-09-12T17:38:35.835 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 rbd_mirror 2024-09-12T17:38:35.835 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 rbd_replay 2024-09-12T17:38:35.835 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 rbd_pwl 2024-09-12T17:38:35.836 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 journaler 2024-09-12T17:38:35.836 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 objectcacher 2024-09-12T17:38:35.836 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:38:35.836 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 client 2024-09-12T17:38:35.836 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 osd 2024-09-12T17:38:35.836 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 optracker 2024-09-12T17:38:35.836 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 objclass 2024-09-12T17:38:35.836 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 3 filestore 2024-09-12T17:38:35.836 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 3 journal 2024-09-12T17:38:35.836 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 0 ms 2024-09-12T17:38:35.836 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mon 2024-09-12T17:38:35.836 INFO:tasks.workunit.client.0.smithi037.stderr: 0/10 monc 2024-09-12T17:38:35.836 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 paxos 2024-09-12T17:38:35.837 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 tp 2024-09-12T17:38:35.837 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 auth 2024-09-12T17:38:35.837 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 crypto 2024-09-12T17:38:35.837 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 1 finisher 2024-09-12T17:38:35.837 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 1 reserver 2024-09-12T17:38:35.837 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 heartbeatmap 2024-09-12T17:38:35.837 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 perfcounter 2024-09-12T17:38:35.837 INFO:tasks.workunit.client.0.smithi037.stderr: 20/20 rgw 2024-09-12T17:38:35.837 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 rgw_sync 2024-09-12T17:38:35.837 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 rgw_datacache 2024-09-12T17:38:35.837 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 rgw_access 2024-09-12T17:38:35.837 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:38:35.837 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 rgw_flight 2024-09-12T17:38:35.837 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:38:35.838 INFO:tasks.workunit.client.0.smithi037.stderr: 20/20 rgw_notification 2024-09-12T17:38:35.838 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 javaclient 2024-09-12T17:38:35.838 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 asok 2024-09-12T17:38:35.838 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 1 throttle 2024-09-12T17:38:35.838 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 0 refs 2024-09-12T17:38:35.838 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 compressor 2024-09-12T17:38:35.838 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 bluestore 2024-09-12T17:38:35.838 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 bluefs 2024-09-12T17:38:35.838 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 3 bdev 2024-09-12T17:38:35.838 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 kstore 2024-09-12T17:38:35.838 INFO:tasks.workunit.client.0.smithi037.stderr: 4/ 5 rocksdb 2024-09-12T17:38:35.838 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 fuse 2024-09-12T17:38:35.838 INFO:tasks.workunit.client.0.smithi037.stderr: 2/ 5 mgr 2024-09-12T17:38:35.839 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mgrc 2024-09-12T17:38:35.839 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 dpdk 2024-09-12T17:38:35.839 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 eventtrace 2024-09-12T17:38:35.839 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 prioritycache 2024-09-12T17:38:35.839 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 test 2024-09-12T17:38:35.839 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:38:35.839 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 cephsqlite 2024-09-12T17:38:35.839 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:38:35.839 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore 2024-09-12T17:38:35.839 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_onode 2024-09-12T17:38:35.839 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_odata 2024-09-12T17:38:35.839 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_omap 2024-09-12T17:38:35.839 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_tm 2024-09-12T17:38:35.839 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_t 2024-09-12T17:38:35.840 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:38:35.840 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_epm 2024-09-12T17:38:35.840 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_lba 2024-09-12T17:38:35.840 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:38:35.840 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_cache 2024-09-12T17:38:35.840 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_journal 2024-09-12T17:38:35.840 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_device 2024-09-12T17:38:35.840 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 seastore_backref 2024-09-12T17:38:35.840 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 alienstore 2024-09-12T17:38:35.840 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 mclock 2024-09-12T17:38:35.840 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 cyanstore 2024-09-12T17:38:35.840 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 ceph_exporter 2024-09-12T17:38:35.841 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 memstore 2024-09-12T17:38:35.841 INFO:tasks.workunit.client.0.smithi037.stderr: 1/ 5 trace 2024-09-12T17:38:35.841 INFO:tasks.workunit.client.0.smithi037.stderr: 0/ 5 ceph_dedup 2024-09-12T17:38:35.841 INFO:tasks.workunit.client.0.smithi037.stderr: -2/-2 (syslog threshold) 2024-09-12T17:38:35.841 INFO:tasks.workunit.client.0.smithi037.stderr: 99/99 (stderr threshold) 2024-09-12T17:38:35.841 INFO:tasks.workunit.client.0.smithi037.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:38:35.841 INFO:tasks.workunit.client.0.smithi037.stderr: 7f5e8affd640 / http_manager 2024-09-12T17:38:35.841 INFO:tasks.workunit.client.0.smithi037.stderr: 7f5f197e2640 / http_manager 2024-09-12T17:38:35.841 INFO:tasks.workunit.client.0.smithi037.stderr: 7f5f1a7e4640 / rgw_dt_lg_renew 2024-09-12T17:38:35.841 INFO:tasks.workunit.client.0.smithi037.stderr: 7f5f39ffb640 / ms_dispatch 2024-09-12T17:38:35.841 INFO:tasks.workunit.client.0.smithi037.stderr: 7f5f3affd640 / io_context_pool 2024-09-12T17:38:35.841 INFO:tasks.workunit.client.0.smithi037.stderr: 7f5f3b7fe640 / io_context_pool 2024-09-12T17:38:35.841 INFO:tasks.workunit.client.0.smithi037.stderr: 7f5f49ffb640 / ms_dispatch 2024-09-12T17:38:35.841 INFO:tasks.workunit.client.0.smithi037.stderr: 7f5f50e09640 / ms_dispatch 2024-09-12T17:38:35.842 INFO:tasks.workunit.client.0.smithi037.stderr: 7f5f5260c640 / io_context_pool 2024-09-12T17:38:35.842 INFO:tasks.workunit.client.0.smithi037.stderr: 7f6063c85640 / msgr-worker-2 2024-09-12T17:38:35.842 INFO:tasks.workunit.client.0.smithi037.stderr: 7f6064486640 / msgr-worker-1 2024-09-12T17:38:35.842 INFO:tasks.workunit.client.0.smithi037.stderr: 7f6064c87640 / msgr-worker-0 2024-09-12T17:38:35.842 INFO:tasks.workunit.client.0.smithi037.stderr: 7f6065488640 / io_context_pool 2024-09-12T17:38:35.842 INFO:tasks.workunit.client.0.smithi037.stderr: 7f6068742800 / radosgw-admin 2024-09-12T17:38:35.842 INFO:tasks.workunit.client.0.smithi037.stderr: max_recent 500 2024-09-12T17:38:35.842 INFO:tasks.workunit.client.0.smithi037.stderr: max_new 1000 2024-09-12T17:38:35.842 INFO:tasks.workunit.client.0.smithi037.stderr: log_file /var/lib/ceph/crash/2024-09-12T17:38:35.699445Z_2a94fbbe-df19-4f51-b326-5ca04ee868e1/log 2024-09-12T17:38:35.842 INFO:tasks.workunit.client.0.smithi037.stderr:--- end dump of recent events --- 2024-09-12T17:38:35.842 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T17:38:35.844 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:38:35.844 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:38:35.844 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.782+0000 7f40e8935800 20 rados->read ofs=0 len=0 2024-09-12T17:38:35.844 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.784+0000 7f40e8935800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:35.844 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.784+0000 7f40e8935800 20 realm 2024-09-12T17:38:35.844 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.784+0000 7f40e8935800 20 rados->read ofs=0 len=0 2024-09-12T17:38:35.844 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.784+0000 7f40e8935800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:35.844 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.784+0000 7f40e8935800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:38:35.844 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.784+0000 7f40e8935800 20 rados->read ofs=0 len=0 2024-09-12T17:38:35.844 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.784+0000 7f40e8935800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:35.845 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.784+0000 7f40e8935800 20 rados->read ofs=0 len=0 2024-09-12T17:38:35.845 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.785+0000 7f40e8935800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:38:35.845 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.785+0000 7f40e8935800 20 rados->read ofs=0 len=0 2024-09-12T17:38:35.845 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.786+0000 7f40e8935800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:38:35.845 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.786+0000 7f40e8935800 20 searching for the correct realm 2024-09-12T17:38:35.845 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.789+0000 7f40e3e20640 0 -- 172.21.15.37:0/66250006 >> [v2:172.21.15.40:6800/2441293461,v1:172.21.15.40:6801/2441293461] conn(0x7f40d4038030 msgr2=0x7f40d40a3970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:38:35.997 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:35.996+0000 7f40e4621640 0 -- 172.21.15.37:0/66250006 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7f40d8082440 msgr2=0x7f40d80828a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:38:36.204 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.203+0000 7f40e8935800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:38:36.205 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.204+0000 7f40e8935800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:38:36.205 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.204+0000 7f40e8935800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:38:36.205 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.204+0000 7f40e8935800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:38:36.205 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.204+0000 7f40e8935800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:38:36.205 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.204+0000 7f40e8935800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:38:36.205 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.204+0000 7f40e8935800 20 rados->read ofs=0 len=0 2024-09-12T17:38:36.205 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.204+0000 7f40e8935800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:36.205 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.204+0000 7f40e8935800 20 rados->read ofs=0 len=0 2024-09-12T17:38:36.206 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.204+0000 7f40e8935800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:38:36.206 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.204+0000 7f40e8935800 20 rados->read ofs=0 len=0 2024-09-12T17:38:36.206 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.205+0000 7f40e8935800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:38:36.206 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.205+0000 7f40e8935800 20 zone default found 2024-09-12T17:38:36.206 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.205+0000 7f40e8935800 4 Realm: () 2024-09-12T17:38:36.206 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.205+0000 7f40e8935800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:38:36.206 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.205+0000 7f40e8935800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:38:36.206 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.205+0000 7f40e8935800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:38:36.206 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.205+0000 7f40e8935800 20 zonegroup default 2024-09-12T17:38:36.206 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.205+0000 7f40e8935800 20 rados->read ofs=0 len=0 2024-09-12T17:38:36.207 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.205+0000 7f40e8935800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:36.207 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.205+0000 7f40e8935800 20 rados->read ofs=0 len=0 2024-09-12T17:38:36.207 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.206+0000 7f40e8935800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:36.207 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.206+0000 7f40e8935800 20 rados->read ofs=0 len=0 2024-09-12T17:38:36.207 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.206+0000 7f40e8935800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:36.207 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.206+0000 7f40e8935800 20 started sync module instance, tier type = 2024-09-12T17:38:36.208 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.206+0000 7f40e8935800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:38:36.217 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.216+0000 7f40e8935800 20 add_watcher() i=0 2024-09-12T17:38:36.217 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.216+0000 7f40e8935800 20 add_watcher() i=1 2024-09-12T17:38:36.217 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.216+0000 7f40e8935800 20 add_watcher() i=2 2024-09-12T17:38:36.217 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.216+0000 7f40e8935800 20 add_watcher() i=3 2024-09-12T17:38:36.217 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.216+0000 7f40e8935800 20 add_watcher() i=4 2024-09-12T17:38:36.217 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.216+0000 7f40e8935800 20 add_watcher() i=5 2024-09-12T17:38:36.217 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.216+0000 7f40e8935800 20 add_watcher() i=6 2024-09-12T17:38:36.218 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.217+0000 7f40e8935800 20 add_watcher() i=7 2024-09-12T17:38:36.218 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.217+0000 7f40e8935800 2 all 8 watchers are set, enabling cache 2024-09-12T17:38:36.219 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.219+0000 7f3f9afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:38:36.220 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.219+0000 7f40e8935800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:38:36.221 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.219+0000 7f40e8935800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:38:36.221 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.219+0000 7f40e8935800 5 note: GC not initialized 2024-09-12T17:38:36.221 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.220+0000 7f3f99fdb640 20 reqs_thread_entry: start 2024-09-12T17:38:36.221 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.220+0000 7f40e8935800 20 init_complete bucket index max shards: 11 2024-09-12T17:38:36.221 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.220+0000 7f40e8935800 20 Filter name: none 2024-09-12T17:38:36.221 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.220+0000 7f3f0b7fe640 20 reqs_thread_entry: start 2024-09-12T17:38:36.221 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.220+0000 7f40e8935800 20 rados->read ofs=0 len=0 2024-09-12T17:38:36.222 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.220+0000 7f40e8935800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:38:36.222 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.220+0000 7f40e8935800 20 rados->read ofs=0 len=0 2024-09-12T17:38:36.222 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.221+0000 7f40e8935800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T17:38:36.222 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.221+0000 7f40e8935800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:38:36.222 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.221+0000 7f40e8935800 20 rados->read ofs=0 len=0 2024-09-12T17:38:36.223 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.222+0000 7f40e8935800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:38:36.223 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.222+0000 7f40e8935800 20 rados->read ofs=0 len=0 2024-09-12T17:38:36.223 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.222+0000 7f40e8935800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T17:38:36.223 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.222+0000 7f40e8935800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:38:36.225 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.224+0000 7f3f9afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:38:36.227 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.226+0000 7f40e8935800 20 remove_watcher() i=0 2024-09-12T17:38:36.227 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.226+0000 7f40e8935800 2 removed watcher, disabling cache 2024-09-12T17:38:36.228 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.228+0000 7f40e8935800 20 remove_watcher() i=1 2024-09-12T17:38:36.230 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.229+0000 7f40e8935800 20 remove_watcher() i=2 2024-09-12T17:38:36.231 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.230+0000 7f40e8935800 20 remove_watcher() i=3 2024-09-12T17:38:36.232 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.231+0000 7f40e8935800 20 remove_watcher() i=4 2024-09-12T17:38:36.233 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.232+0000 7f40e8935800 20 remove_watcher() i=5 2024-09-12T17:38:36.236 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.233+0000 7f40e8935800 20 remove_watcher() i=6 2024-09-12T17:38:36.236 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.234+0000 7f40e8935800 20 remove_watcher() i=7 2024-09-12T17:38:36.286 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-12T17:38:36.315 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:38:36.315 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:38:36.355 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.354+0000 7f2a55726800 20 rados->read ofs=0 len=0 2024-09-12T17:38:36.356 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.355+0000 7f2a55726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:36.356 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.355+0000 7f2a55726800 20 realm 2024-09-12T17:38:36.357 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.355+0000 7f2a55726800 20 rados->read ofs=0 len=0 2024-09-12T17:38:36.357 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.355+0000 7f2a55726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:36.357 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.355+0000 7f2a55726800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:38:36.357 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.355+0000 7f2a55726800 20 rados->read ofs=0 len=0 2024-09-12T17:38:36.357 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.356+0000 7f2a55726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:36.357 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.356+0000 7f2a55726800 20 rados->read ofs=0 len=0 2024-09-12T17:38:36.358 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.357+0000 7f2a55726800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:38:36.358 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.357+0000 7f2a55726800 20 rados->read ofs=0 len=0 2024-09-12T17:38:36.358 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.357+0000 7f2a55726800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:38:36.358 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.357+0000 7f2a55726800 20 searching for the correct realm 2024-09-12T17:38:36.361 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.361+0000 7f2a50bd8640 0 -- 172.21.15.37:0/1674454096 >> [v2:172.21.15.37:6816/2964054205,v1:172.21.15.37:6817/2964054205] conn(0x564e67a705e0 msgr2=0x564e67a72aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:38:36.365 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.364+0000 7f2a513d9640 0 -- 172.21.15.37:0/1674454096 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7f2a480383e0 msgr2=0x7f2a48038860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:38:36.370 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.369+0000 7f2a55726800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:38:36.370 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.369+0000 7f2a55726800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:38:36.370 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.369+0000 7f2a55726800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:38:36.371 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.369+0000 7f2a55726800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:38:36.371 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.369+0000 7f2a55726800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:38:36.371 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.369+0000 7f2a55726800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:38:36.371 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.369+0000 7f2a55726800 20 rados->read ofs=0 len=0 2024-09-12T17:38:36.371 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.369+0000 7f2a55726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:36.371 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.369+0000 7f2a55726800 20 rados->read ofs=0 len=0 2024-09-12T17:38:36.371 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.370+0000 7f2a55726800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:38:36.371 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.370+0000 7f2a55726800 20 rados->read ofs=0 len=0 2024-09-12T17:38:36.372 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.370+0000 7f2a55726800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:38:36.372 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.370+0000 7f2a55726800 20 zone default found 2024-09-12T17:38:36.372 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.370+0000 7f2a55726800 4 Realm: () 2024-09-12T17:38:36.373 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.370+0000 7f2a55726800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:38:36.373 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.370+0000 7f2a55726800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:38:36.373 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.370+0000 7f2a55726800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:38:36.373 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.370+0000 7f2a55726800 20 zonegroup default 2024-09-12T17:38:36.373 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.370+0000 7f2a55726800 20 rados->read ofs=0 len=0 2024-09-12T17:38:36.373 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.370+0000 7f2a55726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:36.373 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.370+0000 7f2a55726800 20 rados->read ofs=0 len=0 2024-09-12T17:38:36.373 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.371+0000 7f2a55726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:36.373 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.371+0000 7f2a55726800 20 rados->read ofs=0 len=0 2024-09-12T17:38:36.373 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.371+0000 7f2a55726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:38:36.373 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.371+0000 7f2a55726800 20 started sync module instance, tier type = 2024-09-12T17:38:36.373 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.371+0000 7f2a55726800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:38:36.381 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.380+0000 7f2a55726800 20 add_watcher() i=0 2024-09-12T17:38:36.381 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.380+0000 7f2a55726800 20 add_watcher() i=1 2024-09-12T17:38:36.381 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.380+0000 7f2a55726800 20 add_watcher() i=2 2024-09-12T17:38:36.381 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.380+0000 7f2a55726800 20 add_watcher() i=3 2024-09-12T17:38:36.381 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.380+0000 7f2a55726800 20 add_watcher() i=4 2024-09-12T17:38:36.382 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.380+0000 7f2a55726800 20 add_watcher() i=5 2024-09-12T17:38:36.382 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.380+0000 7f2a55726800 20 add_watcher() i=6 2024-09-12T17:38:36.382 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.381+0000 7f2a55726800 20 add_watcher() i=7 2024-09-12T17:38:36.382 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.381+0000 7f2a55726800 2 all 8 watchers are set, enabling cache 2024-09-12T17:38:36.384 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.383+0000 7f29077e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:38:36.385 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.383+0000 7f2a55726800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:38:36.385 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.383+0000 7f2a55726800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:38:36.385 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.383+0000 7f2a55726800 5 note: GC not initialized 2024-09-12T17:38:36.385 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.383+0000 7f29067e4640 20 reqs_thread_entry: start 2024-09-12T17:38:36.385 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.384+0000 7f2a55726800 20 init_complete bucket index max shards: 11 2024-09-12T17:38:36.385 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.384+0000 7f2a55726800 20 Filter name: none 2024-09-12T17:38:36.385 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.384+0000 7f2877fff640 20 reqs_thread_entry: start 2024-09-12T17:38:36.385 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.384+0000 7f2a55726800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:38:36.385 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.384+0000 7f2a55726800 20 rados->read ofs=0 len=0 2024-09-12T17:38:36.386 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.384+0000 7f2a55726800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:38:36.387 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.384+0000 7f2a55726800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:38:36.387 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.384+0000 7f2a55726800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:38:36.387 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.384+0000 7f2a55726800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 : miss 2024-09-12T17:38:36.387 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.384+0000 7f2a55726800 20 rados->read ofs=0 len=0 2024-09-12T17:38:36.387 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.385+0000 7f2a55726800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T17:38:36.387 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.385+0000 7f2a55726800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 info.flags=0x17 2024-09-12T17:38:36.387 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.385+0000 7f2a55726800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 to cache LRU end 2024-09-12T17:38:36.387 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.385+0000 7f2a55726800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:38:36.387 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.385+0000 7f2a55726800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:38:36.387 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.385+0000 7f2a55726800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 2024-09-12T17:38:36.387 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.385+0000 7f2a55726800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.0 2024-09-12T17:38:36.387 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.385+0000 7f2a55726800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.0 2024-09-12T17:38:36.387 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.385+0000 7f2a55726800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.1 2024-09-12T17:38:36.388 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.385+0000 7f2a55726800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.1 2024-09-12T17:38:36.388 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.386+0000 7f2a55726800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.2 2024-09-12T17:38:36.388 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.386+0000 7f2a55726800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.2 2024-09-12T17:38:36.388 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.386+0000 7f2a55726800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.3 2024-09-12T17:38:36.388 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.386+0000 7f2a55726800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.3 2024-09-12T17:38:36.389 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.386+0000 7f2a55726800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.4 2024-09-12T17:38:36.389 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.386+0000 7f2a55726800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.4 2024-09-12T17:38:36.389 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.387+0000 7f2a55726800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.5 2024-09-12T17:38:36.389 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.387+0000 7f2a55726800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.5 2024-09-12T17:38:36.389 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.387+0000 7f2a55726800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.6 2024-09-12T17:38:36.389 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.387+0000 7f2a55726800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.6 2024-09-12T17:38:36.389 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.387+0000 7f2a55726800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.7 2024-09-12T17:38:36.389 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.387+0000 7f2a55726800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.7 2024-09-12T17:38:36.389 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.388+0000 7f2a55726800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.8 2024-09-12T17:38:36.389 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.388+0000 7f2a55726800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.8 2024-09-12T17:38:36.390 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.388+0000 7f2a55726800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.9 2024-09-12T17:38:36.390 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.388+0000 7f2a55726800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.9 2024-09-12T17:38:36.390 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.389+0000 7f2a55726800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.10 2024-09-12T17:38:36.390 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.389+0000 7f2a55726800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.10 2024-09-12T17:38:36.390 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.389+0000 7f2a55726800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.11 2024-09-12T17:38:36.390 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.389+0000 7f2a55726800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.11 2024-09-12T17:38:36.390 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.389+0000 7f2a55726800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.12 2024-09-12T17:38:36.390 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.389+0000 7f2a55726800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.12 2024-09-12T17:38:36.391 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.390+0000 7f29077e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:38:36.393 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.393+0000 7f2a55726800 20 remove_watcher() i=0 2024-09-12T17:38:36.393 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.393+0000 7f2a55726800 2 removed watcher, disabling cache 2024-09-12T17:38:36.394 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.394+0000 7f2a55726800 20 remove_watcher() i=1 2024-09-12T17:38:36.395 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.395+0000 7f2a55726800 20 remove_watcher() i=2 2024-09-12T17:38:36.396 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.396+0000 7f2a55726800 20 remove_watcher() i=3 2024-09-12T17:38:36.397 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.397+0000 7f2a55726800 20 remove_watcher() i=4 2024-09-12T17:38:36.398 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.398+0000 7f2a55726800 20 remove_watcher() i=5 2024-09-12T17:38:36.399 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.399+0000 7f2a55726800 20 remove_watcher() i=6 2024-09-12T17:38:36.400 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:38:36.400+0000 7f2a55726800 20 remove_watcher() i=7 2024-09-12T17:39:06.445 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin reshardlog purge --bucket a-bucket 2024-09-12T17:39:06.478 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:39:06.478 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:39:06.524 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.523+0000 7f0a84d26800 20 rados->read ofs=0 len=0 2024-09-12T17:39:06.526 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.525+0000 7f0a84d26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:06.526 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.525+0000 7f0a84d26800 20 realm 2024-09-12T17:39:06.526 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.525+0000 7f0a84d26800 20 rados->read ofs=0 len=0 2024-09-12T17:39:06.526 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.525+0000 7f0a84d26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:06.526 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.525+0000 7f0a84d26800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:39:06.526 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.525+0000 7f0a84d26800 20 rados->read ofs=0 len=0 2024-09-12T17:39:06.526 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.525+0000 7f0a84d26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:06.527 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.525+0000 7f0a84d26800 20 rados->read ofs=0 len=0 2024-09-12T17:39:06.527 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.526+0000 7f0a84d26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:39:06.527 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.527+0000 7f0a84d26800 20 rados->read ofs=0 len=0 2024-09-12T17:39:06.528 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.527+0000 7f0a84d26800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:39:06.528 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.527+0000 7f0a84d26800 20 searching for the correct realm 2024-09-12T17:39:06.531 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.531+0000 7f0a781d8640 0 -- 172.21.15.37:0/185523196 >> [v2:172.21.15.37:6816/2964054205,v1:172.21.15.37:6817/2964054205] conn(0x55f5247adf30 msgr2=0x55f5247b03f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:39:06.536 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.535+0000 7f0a809d9640 0 -- 172.21.15.37:0/185523196 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7f0a68066a50 msgr2=0x7f0a6809d310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:39:06.541 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.540+0000 7f0a84d26800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:39:06.541 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.540+0000 7f0a84d26800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:39:06.541 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.540+0000 7f0a84d26800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:39:06.541 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.540+0000 7f0a84d26800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:39:06.541 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.540+0000 7f0a84d26800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:39:06.541 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.540+0000 7f0a84d26800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:39:06.541 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.540+0000 7f0a84d26800 20 rados->read ofs=0 len=0 2024-09-12T17:39:06.542 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.540+0000 7f0a84d26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:06.542 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.540+0000 7f0a84d26800 20 rados->read ofs=0 len=0 2024-09-12T17:39:06.543 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.540+0000 7f0a84d26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:39:06.543 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.540+0000 7f0a84d26800 20 rados->read ofs=0 len=0 2024-09-12T17:39:06.544 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.541+0000 7f0a84d26800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:39:06.544 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.541+0000 7f0a84d26800 20 zone default found 2024-09-12T17:39:06.544 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.541+0000 7f0a84d26800 4 Realm: () 2024-09-12T17:39:06.544 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.541+0000 7f0a84d26800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:39:06.544 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.541+0000 7f0a84d26800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:39:06.544 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.541+0000 7f0a84d26800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:39:06.544 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.541+0000 7f0a84d26800 20 zonegroup default 2024-09-12T17:39:06.544 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.541+0000 7f0a84d26800 20 rados->read ofs=0 len=0 2024-09-12T17:39:06.544 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.541+0000 7f0a84d26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:06.544 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.541+0000 7f0a84d26800 20 rados->read ofs=0 len=0 2024-09-12T17:39:06.544 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.542+0000 7f0a84d26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:06.545 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.542+0000 7f0a84d26800 20 rados->read ofs=0 len=0 2024-09-12T17:39:06.545 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.542+0000 7f0a84d26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:06.545 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.542+0000 7f0a84d26800 20 started sync module instance, tier type = 2024-09-12T17:39:06.545 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.542+0000 7f0a84d26800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:39:06.553 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.553+0000 7f0a84d26800 20 add_watcher() i=0 2024-09-12T17:39:06.554 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.553+0000 7f0a84d26800 20 add_watcher() i=1 2024-09-12T17:39:06.554 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.553+0000 7f0a84d26800 20 add_watcher() i=2 2024-09-12T17:39:06.554 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.553+0000 7f0a84d26800 20 add_watcher() i=3 2024-09-12T17:39:06.554 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.553+0000 7f0a84d26800 20 add_watcher() i=4 2024-09-12T17:39:06.554 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.553+0000 7f0a84d26800 20 add_watcher() i=5 2024-09-12T17:39:06.554 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.553+0000 7f0a84d26800 20 add_watcher() i=6 2024-09-12T17:39:06.554 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.554+0000 7f0a84d26800 20 add_watcher() i=7 2024-09-12T17:39:06.554 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.554+0000 7f0a84d26800 2 all 8 watchers are set, enabling cache 2024-09-12T17:39:06.556 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.556+0000 7f09377e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:39:06.557 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.556+0000 7f0a84d26800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:39:06.557 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.556+0000 7f0a84d26800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:39:06.557 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.556+0000 7f0a84d26800 5 note: GC not initialized 2024-09-12T17:39:06.558 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.556+0000 7f09367e4640 20 reqs_thread_entry: start 2024-09-12T17:39:06.558 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.556+0000 7f0a84d26800 20 init_complete bucket index max shards: 11 2024-09-12T17:39:06.558 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.556+0000 7f0a84d26800 20 Filter name: none 2024-09-12T17:39:06.558 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.557+0000 7f092f7fe640 20 reqs_thread_entry: start 2024-09-12T17:39:06.558 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.557+0000 7f0a84d26800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:39:06.558 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.557+0000 7f0a84d26800 20 rados->read ofs=0 len=0 2024-09-12T17:39:06.559 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.557+0000 7f0a84d26800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:39:06.559 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.557+0000 7f0a84d26800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:39:06.559 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.557+0000 7f0a84d26800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:39:06.559 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.557+0000 7f0a84d26800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 : miss 2024-09-12T17:39:06.559 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.557+0000 7f0a84d26800 20 rados->read ofs=0 len=0 2024-09-12T17:39:06.559 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.557+0000 7f0a84d26800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T17:39:06.559 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.558+0000 7f0a84d26800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 info.flags=0x17 2024-09-12T17:39:06.560 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.558+0000 7f0a84d26800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 to cache LRU end 2024-09-12T17:39:06.560 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.558+0000 7f0a84d26800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:39:06.560 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.558+0000 7f0a84d26800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:39:06.560 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.558+0000 7f0a84d26800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 2024-09-12T17:39:06.563 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.562+0000 7f09377e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:39:06.565 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.565+0000 7f0a84d26800 20 remove_watcher() i=0 2024-09-12T17:39:06.565 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.565+0000 7f0a84d26800 2 removed watcher, disabling cache 2024-09-12T17:39:06.566 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.566+0000 7f0a84d26800 20 remove_watcher() i=1 2024-09-12T17:39:06.567 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.567+0000 7f0a84d26800 20 remove_watcher() i=2 2024-09-12T17:39:06.568 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.568+0000 7f0a84d26800 20 remove_watcher() i=3 2024-09-12T17:39:06.569 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.569+0000 7f0a84d26800 20 remove_watcher() i=4 2024-09-12T17:39:06.571 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.570+0000 7f0a84d26800 20 remove_watcher() i=5 2024-09-12T17:39:06.572 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.571+0000 7f0a84d26800 20 remove_watcher() i=6 2024-09-12T17:39:06.573 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.572+0000 7f0a84d26800 20 remove_watcher() i=7 2024-09-12T17:39:06.587 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-12T17:39:06.617 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:39:06.617 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:39:06.657 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.656+0000 7f7e45498800 20 rados->read ofs=0 len=0 2024-09-12T17:39:06.659 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.658+0000 7f7e45498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:06.659 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.658+0000 7f7e45498800 20 realm 2024-09-12T17:39:06.659 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.658+0000 7f7e45498800 20 rados->read ofs=0 len=0 2024-09-12T17:39:06.659 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.658+0000 7f7e45498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:06.659 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.658+0000 7f7e45498800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:39:06.659 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.658+0000 7f7e45498800 20 rados->read ofs=0 len=0 2024-09-12T17:39:06.659 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.658+0000 7f7e45498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:06.660 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.658+0000 7f7e45498800 20 rados->read ofs=0 len=0 2024-09-12T17:39:06.660 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.659+0000 7f7e45498800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:39:06.660 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.659+0000 7f7e45498800 20 rados->read ofs=0 len=0 2024-09-12T17:39:06.661 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.660+0000 7f7e45498800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:39:06.661 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.660+0000 7f7e45498800 20 searching for the correct realm 2024-09-12T17:39:06.664 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.663+0000 7f7e42788640 0 -- 172.21.15.37:0/2614713759 >> [v2:172.21.15.37:6816/2964054205,v1:172.21.15.37:6817/2964054205] conn(0x5611333ef9e0 msgr2=0x5611333f1ea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:39:06.667 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.667+0000 7f7e42f89640 0 -- 172.21.15.37:0/2614713759 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7f7e38071e10 msgr2=0x7f7e3809e270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:39:06.672 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.671+0000 7f7e45498800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:39:06.672 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.671+0000 7f7e45498800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:39:06.673 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.671+0000 7f7e45498800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:39:06.673 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.671+0000 7f7e45498800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:39:06.673 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.671+0000 7f7e45498800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:39:06.673 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.671+0000 7f7e45498800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:39:06.673 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.671+0000 7f7e45498800 20 rados->read ofs=0 len=0 2024-09-12T17:39:06.673 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.671+0000 7f7e45498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:06.673 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.671+0000 7f7e45498800 20 rados->read ofs=0 len=0 2024-09-12T17:39:06.673 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.672+0000 7f7e45498800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:39:06.673 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.672+0000 7f7e45498800 20 rados->read ofs=0 len=0 2024-09-12T17:39:06.674 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.672+0000 7f7e45498800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:39:06.674 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.672+0000 7f7e45498800 20 zone default found 2024-09-12T17:39:06.675 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.672+0000 7f7e45498800 4 Realm: () 2024-09-12T17:39:06.675 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.672+0000 7f7e45498800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:39:06.675 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.672+0000 7f7e45498800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:39:06.675 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.672+0000 7f7e45498800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:39:06.675 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.672+0000 7f7e45498800 20 zonegroup default 2024-09-12T17:39:06.675 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.672+0000 7f7e45498800 20 rados->read ofs=0 len=0 2024-09-12T17:39:06.675 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.673+0000 7f7e45498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:06.675 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.673+0000 7f7e45498800 20 rados->read ofs=0 len=0 2024-09-12T17:39:06.675 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.673+0000 7f7e45498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:06.675 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.673+0000 7f7e45498800 20 rados->read ofs=0 len=0 2024-09-12T17:39:06.675 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.673+0000 7f7e45498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:06.675 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.673+0000 7f7e45498800 20 started sync module instance, tier type = 2024-09-12T17:39:06.675 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.673+0000 7f7e45498800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:39:06.683 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.682+0000 7f7e45498800 20 add_watcher() i=0 2024-09-12T17:39:06.683 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.682+0000 7f7e45498800 20 add_watcher() i=1 2024-09-12T17:39:06.683 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.682+0000 7f7e45498800 20 add_watcher() i=2 2024-09-12T17:39:06.684 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.682+0000 7f7e45498800 20 add_watcher() i=3 2024-09-12T17:39:06.684 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.682+0000 7f7e45498800 20 add_watcher() i=4 2024-09-12T17:39:06.684 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.682+0000 7f7e45498800 20 add_watcher() i=5 2024-09-12T17:39:06.684 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.682+0000 7f7e45498800 20 add_watcher() i=6 2024-09-12T17:39:06.684 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.683+0000 7f7e45498800 20 add_watcher() i=7 2024-09-12T17:39:06.684 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.683+0000 7f7e45498800 2 all 8 watchers are set, enabling cache 2024-09-12T17:39:06.687 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.685+0000 7f7cf97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:39:06.687 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.686+0000 7f7e45498800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:39:06.687 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.686+0000 7f7e45498800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:39:06.687 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.686+0000 7f7e45498800 5 note: GC not initialized 2024-09-12T17:39:06.687 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.686+0000 7f7c73fff640 20 reqs_thread_entry: start 2024-09-12T17:39:06.687 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.686+0000 7f7e45498800 20 init_complete bucket index max shards: 11 2024-09-12T17:39:06.687 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.686+0000 7f7e45498800 20 Filter name: none 2024-09-12T17:39:06.688 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.686+0000 7f7c71ffb640 20 reqs_thread_entry: start 2024-09-12T17:39:06.688 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.686+0000 7f7e45498800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:39:06.688 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.686+0000 7f7e45498800 20 rados->read ofs=0 len=0 2024-09-12T17:39:06.689 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.687+0000 7f7e45498800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:39:06.689 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.687+0000 7f7e45498800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:39:06.689 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.687+0000 7f7e45498800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:39:06.689 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.687+0000 7f7e45498800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 : miss 2024-09-12T17:39:06.689 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.687+0000 7f7e45498800 20 rados->read ofs=0 len=0 2024-09-12T17:39:06.689 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.687+0000 7f7e45498800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T17:39:06.690 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.687+0000 7f7e45498800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 info.flags=0x17 2024-09-12T17:39:06.690 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.687+0000 7f7e45498800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 to cache LRU end 2024-09-12T17:39:06.690 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.687+0000 7f7e45498800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:39:06.690 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.687+0000 7f7e45498800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:39:06.690 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.688+0000 7f7e45498800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 2024-09-12T17:39:06.690 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.688+0000 7f7e45498800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.0 2024-09-12T17:39:06.690 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.688+0000 7f7e45498800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.0 2024-09-12T17:39:06.690 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.688+0000 7f7e45498800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.1 2024-09-12T17:39:06.690 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.688+0000 7f7e45498800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.1 2024-09-12T17:39:06.690 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.688+0000 7f7e45498800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.2 2024-09-12T17:39:06.691 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.688+0000 7f7e45498800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.2 2024-09-12T17:39:06.692 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.689+0000 7f7e45498800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.3 2024-09-12T17:39:06.692 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.689+0000 7f7e45498800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.3 2024-09-12T17:39:06.692 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.689+0000 7f7e45498800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.4 2024-09-12T17:39:06.692 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.689+0000 7f7e45498800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.4 2024-09-12T17:39:06.692 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.690+0000 7f7e45498800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.5 2024-09-12T17:39:06.692 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.690+0000 7f7e45498800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.5 2024-09-12T17:39:06.692 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.690+0000 7f7e45498800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.6 2024-09-12T17:39:06.692 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.690+0000 7f7e45498800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.6 2024-09-12T17:39:06.692 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.690+0000 7f7e45498800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.7 2024-09-12T17:39:06.693 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.690+0000 7f7e45498800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.7 2024-09-12T17:39:06.693 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.691+0000 7f7e45498800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.8 2024-09-12T17:39:06.693 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.691+0000 7f7e45498800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.8 2024-09-12T17:39:06.693 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.691+0000 7f7e45498800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.9 2024-09-12T17:39:06.693 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.691+0000 7f7e45498800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.9 2024-09-12T17:39:06.694 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.691+0000 7f7e45498800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.10 2024-09-12T17:39:06.694 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.691+0000 7f7e45498800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.10 2024-09-12T17:39:06.694 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.692+0000 7f7e45498800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.11 2024-09-12T17:39:06.694 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.692+0000 7f7e45498800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.11 2024-09-12T17:39:06.694 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.692+0000 7f7e45498800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.12 2024-09-12T17:39:06.694 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.692+0000 7f7e45498800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.12 2024-09-12T17:39:06.695 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.693+0000 7f7cf97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:39:06.696 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.696+0000 7f7e45498800 20 remove_watcher() i=0 2024-09-12T17:39:06.696 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.696+0000 7f7e45498800 2 removed watcher, disabling cache 2024-09-12T17:39:06.697 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.697+0000 7f7e45498800 20 remove_watcher() i=1 2024-09-12T17:39:06.698 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.698+0000 7f7e45498800 20 remove_watcher() i=2 2024-09-12T17:39:06.699 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.699+0000 7f7e45498800 20 remove_watcher() i=3 2024-09-12T17:39:06.700 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.700+0000 7f7e45498800 20 remove_watcher() i=4 2024-09-12T17:39:06.701 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.701+0000 7f7e45498800 20 remove_watcher() i=5 2024-09-12T17:39:06.702 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.701+0000 7f7e45498800 20 remove_watcher() i=6 2024-09-12T17:39:06.703 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.702+0000 7f7e45498800 20 remove_watcher() i=7 2024-09-12T17:39:06.714 INFO:tasks.workunit.client.0.smithi037.stderr:check reshard logrecord successfully 2024-09-12T17:39:06.714 INFO:tasks.workunit.client.0.smithi037.stderr: test: reshard versioned bucket 2024-09-12T17:39:06.716 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bucket stats --bucket myver 2024-09-12T17:39:06.745 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:39:06.745 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:39:06.785 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.784+0000 7fb726d19800 20 rados->read ofs=0 len=0 2024-09-12T17:39:06.787 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.786+0000 7fb726d19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:06.787 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.786+0000 7fb726d19800 20 realm 2024-09-12T17:39:06.787 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.786+0000 7fb726d19800 20 rados->read ofs=0 len=0 2024-09-12T17:39:06.787 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.786+0000 7fb726d19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:06.787 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.786+0000 7fb726d19800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:39:06.787 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.786+0000 7fb726d19800 20 rados->read ofs=0 len=0 2024-09-12T17:39:06.787 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.786+0000 7fb726d19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:06.787 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.786+0000 7fb726d19800 20 rados->read ofs=0 len=0 2024-09-12T17:39:06.788 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.787+0000 7fb726d19800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:39:06.788 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.787+0000 7fb726d19800 20 rados->read ofs=0 len=0 2024-09-12T17:39:06.788 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.787+0000 7fb726d19800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:39:06.788 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.787+0000 7fb726d19800 20 searching for the correct realm 2024-09-12T17:39:06.791 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.791+0000 7fb724002640 0 -- 172.21.15.37:0/226150092 >> [v2:172.21.15.37:6816/2964054205,v1:172.21.15.37:6817/2964054205] conn(0x5569361fa880 msgr2=0x5569361fccb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:39:06.795 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.794+0000 7fb724803640 0 -- 172.21.15.37:0/226150092 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7fb7180613f0 msgr2=0x7fb718061850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:39:06.799 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.798+0000 7fb726d19800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:39:06.799 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.798+0000 7fb726d19800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:39:06.799 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.798+0000 7fb726d19800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:39:06.799 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.798+0000 7fb726d19800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:39:06.800 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.798+0000 7fb726d19800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:39:06.800 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.798+0000 7fb726d19800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:39:06.800 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.798+0000 7fb726d19800 20 rados->read ofs=0 len=0 2024-09-12T17:39:06.800 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.798+0000 7fb726d19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:06.800 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.798+0000 7fb726d19800 20 rados->read ofs=0 len=0 2024-09-12T17:39:06.802 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.799+0000 7fb726d19800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:39:06.802 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.799+0000 7fb726d19800 20 rados->read ofs=0 len=0 2024-09-12T17:39:06.802 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.799+0000 7fb726d19800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:39:06.802 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.799+0000 7fb726d19800 20 zone default found 2024-09-12T17:39:06.802 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.799+0000 7fb726d19800 4 Realm: () 2024-09-12T17:39:06.802 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.799+0000 7fb726d19800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:39:06.802 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.799+0000 7fb726d19800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:39:06.802 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.799+0000 7fb726d19800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:39:06.802 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.799+0000 7fb726d19800 20 zonegroup default 2024-09-12T17:39:06.802 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.799+0000 7fb726d19800 20 rados->read ofs=0 len=0 2024-09-12T17:39:06.802 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.799+0000 7fb726d19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:06.803 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.799+0000 7fb726d19800 20 rados->read ofs=0 len=0 2024-09-12T17:39:06.803 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.800+0000 7fb726d19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:06.803 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.800+0000 7fb726d19800 20 rados->read ofs=0 len=0 2024-09-12T17:39:06.803 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.800+0000 7fb726d19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:06.803 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.800+0000 7fb726d19800 20 started sync module instance, tier type = 2024-09-12T17:39:06.803 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.800+0000 7fb726d19800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:39:06.810 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.809+0000 7fb726d19800 20 add_watcher() i=0 2024-09-12T17:39:06.810 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.809+0000 7fb726d19800 20 add_watcher() i=1 2024-09-12T17:39:06.810 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.809+0000 7fb726d19800 20 add_watcher() i=2 2024-09-12T17:39:06.810 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.809+0000 7fb726d19800 20 add_watcher() i=3 2024-09-12T17:39:06.810 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.809+0000 7fb726d19800 20 add_watcher() i=4 2024-09-12T17:39:06.811 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.809+0000 7fb726d19800 20 add_watcher() i=5 2024-09-12T17:39:06.811 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.809+0000 7fb726d19800 20 add_watcher() i=6 2024-09-12T17:39:06.811 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.810+0000 7fb726d19800 20 add_watcher() i=7 2024-09-12T17:39:06.811 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.810+0000 7fb726d19800 2 all 8 watchers are set, enabling cache 2024-09-12T17:39:06.813 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.812+0000 7fb5dafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:39:06.814 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.812+0000 7fb726d19800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:39:06.814 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.812+0000 7fb726d19800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:39:06.814 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.812+0000 7fb726d19800 5 note: GC not initialized 2024-09-12T17:39:06.814 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.813+0000 7fb5d9fdb640 20 reqs_thread_entry: start 2024-09-12T17:39:06.814 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.813+0000 7fb726d19800 20 init_complete bucket index max shards: 11 2024-09-12T17:39:06.815 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.813+0000 7fb726d19800 20 Filter name: none 2024-09-12T17:39:06.815 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.813+0000 7fb54b7fe640 20 reqs_thread_entry: start 2024-09-12T17:39:06.815 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.813+0000 7fb726d19800 20 rados->read ofs=0 len=0 2024-09-12T17:39:06.815 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.813+0000 7fb726d19800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:39:06.815 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.814+0000 7fb726d19800 20 rados->read ofs=0 len=0 2024-09-12T17:39:06.816 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.814+0000 7fb726d19800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:39:06.816 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.814+0000 7fb726d19800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:39:06.816 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.814+0000 7fb726d19800 20 rados->read ofs=0 len=0 2024-09-12T17:39:06.816 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.814+0000 7fb726d19800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:39:06.816 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.814+0000 7fb726d19800 20 rados->read ofs=0 len=0 2024-09-12T17:39:06.816 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.815+0000 7fb726d19800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:39:06.816 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.815+0000 7fb726d19800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:39:06.817 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.816+0000 7fb5dafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:39:06.819 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.818+0000 7fb726d19800 20 remove_watcher() i=0 2024-09-12T17:39:06.819 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.818+0000 7fb726d19800 2 removed watcher, disabling cache 2024-09-12T17:39:06.820 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.820+0000 7fb726d19800 20 remove_watcher() i=1 2024-09-12T17:39:06.821 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.821+0000 7fb726d19800 20 remove_watcher() i=2 2024-09-12T17:39:06.822 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.822+0000 7fb726d19800 20 remove_watcher() i=3 2024-09-12T17:39:06.823 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.823+0000 7fb726d19800 20 remove_watcher() i=4 2024-09-12T17:39:06.824 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.824+0000 7fb726d19800 20 remove_watcher() i=5 2024-09-12T17:39:06.825 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.825+0000 7fb726d19800 20 remove_watcher() i=6 2024-09-12T17:39:06.826 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.826+0000 7fb726d19800 20 remove_watcher() i=7 2024-09-12T17:39:06.838 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:39:06.838 INFO:tasks.workunit.client.0.smithi037.stderr:BUCKET_STATS: 2024-09-12T17:39:06.838 INFO:tasks.workunit.client.0.smithi037.stderr:bucket: myver id: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19 num_objects: 0 size_kb: 0 num_shards: 11 2024-09-12T17:39:06.838 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:39:06.839 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bucket reshard --bucket myver --num-shards 12 2024-09-12T17:39:06.871 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:39:06.871 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:39:06.911 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.910+0000 7f72a6b2e800 20 rados->read ofs=0 len=0 2024-09-12T17:39:06.912 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.911+0000 7f72a6b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:06.912 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.911+0000 7f72a6b2e800 20 realm 2024-09-12T17:39:06.913 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.911+0000 7f72a6b2e800 20 rados->read ofs=0 len=0 2024-09-12T17:39:06.913 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.912+0000 7f72a6b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:06.913 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.912+0000 7f72a6b2e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:39:06.913 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.912+0000 7f72a6b2e800 20 rados->read ofs=0 len=0 2024-09-12T17:39:06.913 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.912+0000 7f72a6b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:06.913 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.912+0000 7f72a6b2e800 20 rados->read ofs=0 len=0 2024-09-12T17:39:06.914 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.913+0000 7f72a6b2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:39:06.914 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.913+0000 7f72a6b2e800 20 rados->read ofs=0 len=0 2024-09-12T17:39:06.914 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.913+0000 7f72a6b2e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:39:06.914 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.913+0000 7f72a6b2e800 20 searching for the correct realm 2024-09-12T17:39:06.916 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:06.915+0000 7f72a20dc640 0 -- 172.21.15.37:0/3045928368 >> [v2:172.21.15.40:6800/2441293461,v1:172.21.15.40:6801/2441293461] conn(0x7f729403c070 msgr2=0x7f7294003020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:39:07.122 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.122+0000 7f72a28dd640 0 -- 172.21.15.37:0/3045928368 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7f729804b1c0 msgr2=0x7f7298098040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:39:07.331 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.329+0000 7f72a6b2e800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:39:07.331 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.329+0000 7f72a6b2e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:39:07.331 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.329+0000 7f72a6b2e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:39:07.331 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.329+0000 7f72a6b2e800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:39:07.331 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.329+0000 7f72a6b2e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:39:07.331 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.329+0000 7f72a6b2e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:39:07.331 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.329+0000 7f72a6b2e800 20 rados->read ofs=0 len=0 2024-09-12T17:39:07.331 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.330+0000 7f72a6b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:07.331 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.330+0000 7f72a6b2e800 20 rados->read ofs=0 len=0 2024-09-12T17:39:07.331 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.330+0000 7f72a6b2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:39:07.332 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.330+0000 7f72a6b2e800 20 rados->read ofs=0 len=0 2024-09-12T17:39:07.333 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.330+0000 7f72a6b2e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:39:07.333 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.330+0000 7f72a6b2e800 20 zone default found 2024-09-12T17:39:07.333 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.330+0000 7f72a6b2e800 4 Realm: () 2024-09-12T17:39:07.333 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.330+0000 7f72a6b2e800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:39:07.333 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.330+0000 7f72a6b2e800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:39:07.333 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.330+0000 7f72a6b2e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:39:07.333 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.330+0000 7f72a6b2e800 20 zonegroup default 2024-09-12T17:39:07.334 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.330+0000 7f72a6b2e800 20 rados->read ofs=0 len=0 2024-09-12T17:39:07.334 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.331+0000 7f72a6b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:07.334 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.331+0000 7f72a6b2e800 20 rados->read ofs=0 len=0 2024-09-12T17:39:07.334 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.331+0000 7f72a6b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:07.334 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.331+0000 7f72a6b2e800 20 rados->read ofs=0 len=0 2024-09-12T17:39:07.334 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.331+0000 7f72a6b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:07.334 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.331+0000 7f72a6b2e800 20 started sync module instance, tier type = 2024-09-12T17:39:07.334 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.331+0000 7f72a6b2e800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:39:07.343 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.342+0000 7f72a6b2e800 20 add_watcher() i=0 2024-09-12T17:39:07.343 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.342+0000 7f72a6b2e800 20 add_watcher() i=1 2024-09-12T17:39:07.343 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.342+0000 7f72a6b2e800 20 add_watcher() i=2 2024-09-12T17:39:07.343 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.342+0000 7f72a6b2e800 20 add_watcher() i=3 2024-09-12T17:39:07.343 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.342+0000 7f72a6b2e800 20 add_watcher() i=4 2024-09-12T17:39:07.343 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.342+0000 7f72a6b2e800 20 add_watcher() i=5 2024-09-12T17:39:07.343 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.342+0000 7f72a6b2e800 20 add_watcher() i=6 2024-09-12T17:39:07.343 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.343+0000 7f72a6b2e800 20 add_watcher() i=7 2024-09-12T17:39:07.344 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.343+0000 7f72a6b2e800 2 all 8 watchers are set, enabling cache 2024-09-12T17:39:07.345 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.345+0000 7f71597e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:39:07.346 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.345+0000 7f72a6b2e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:39:07.346 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.345+0000 7f72a6b2e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:39:07.346 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.345+0000 7f72a6b2e800 5 note: GC not initialized 2024-09-12T17:39:07.346 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.345+0000 7f70d3fff640 20 reqs_thread_entry: start 2024-09-12T17:39:07.347 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.345+0000 7f72a6b2e800 20 init_complete bucket index max shards: 11 2024-09-12T17:39:07.347 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.345+0000 7f72a6b2e800 20 Filter name: none 2024-09-12T17:39:07.347 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.345+0000 7f70d1ffb640 20 reqs_thread_entry: start 2024-09-12T17:39:07.347 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.346+0000 7f72a6b2e800 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-12T17:39:07.347 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.346+0000 7f72a6b2e800 20 rados->read ofs=0 len=0 2024-09-12T17:39:07.348 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.346+0000 7f72a6b2e800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:39:07.348 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.346+0000 7f72a6b2e800 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-12T17:39:07.348 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.346+0000 7f72a6b2e800 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-12T17:39:07.348 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.346+0000 7f72a6b2e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19 : miss 2024-09-12T17:39:07.348 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.346+0000 7f72a6b2e800 20 rados->read ofs=0 len=0 2024-09-12T17:39:07.348 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.346+0000 7f72a6b2e800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:39:07.348 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.346+0000 7f72a6b2e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19 info.flags=0x17 2024-09-12T17:39:07.348 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.346+0000 7f72a6b2e800 10 adding default.rgw.meta+root+.bucket.meta.myver:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19 to cache LRU end 2024-09-12T17:39:07.348 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.346+0000 7f72a6b2e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:39:07.348 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.346+0000 7f72a6b2e800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:39:07.348 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.346+0000 7f72a6b2e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19 2024-09-12T17:39:07.353 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.353+0000 7f72a6b2e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19 info.flags=0x17 2024-09-12T17:39:07.353 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.353+0000 7f72a6b2e800 10 moving default.rgw.meta+root+.bucket.meta.myver:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19 to cache LRU end 2024-09-12T17:39:07.353 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.353+0000 7f72a6b2e800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:39:07.353 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.353+0000 7f72a6b2e800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19, ofs0, ns] 2024-09-12T17:39:07.354 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.353+0000 7f7185ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497093 cookie 94206321425584 notifier 8514 bl.length()=905 2024-09-12T17:39:07.354 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.353+0000 7f7185ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19 info.flags=0x17 2024-09-12T17:39:07.354 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.353+0000 7f7185ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19 to cache LRU end 2024-09-12T17:39:07.354 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.353+0000 7f7185ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:39:07.355 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.355+0000 7f72a6b2e800 20 handle_bi_update(): bucket=:myver[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19]): orig_sources= new_sources= 2024-09-12T17:39:07.356 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.355+0000 7f72a6b2e800 20 handle_bi_update(): bucket=:myver[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19]): potential sources added=[] removed=[] 2024-09-12T17:39:07.356 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.355+0000 7f72a6b2e800 20 handle_bi_update(): bucket=:myver[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19]): orig_dests= new_dests= 2024-09-12T17:39:07.356 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.355+0000 7f72a6b2e800 20 handle_bi_update(): bucket=:myver[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19]): potential dests added=[] removed=[] 2024-09-12T17:39:07.361 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.360+0000 7f72a6b2e800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.1.0 2024-09-12T17:39:07.361 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.360+0000 7f72a6b2e800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.1.0 2024-09-12T17:39:07.361 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.360+0000 7f72a6b2e800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.1.1 2024-09-12T17:39:07.361 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.360+0000 7f72a6b2e800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.1.1 2024-09-12T17:39:07.362 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.360+0000 7f72a6b2e800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.1.2 2024-09-12T17:39:07.362 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.360+0000 7f72a6b2e800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.1.2 2024-09-12T17:39:07.362 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.360+0000 7f72a6b2e800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.1.3 2024-09-12T17:39:07.362 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.360+0000 7f72a6b2e800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.1.3 2024-09-12T17:39:07.362 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.360+0000 7f72a6b2e800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.1.4 2024-09-12T17:39:07.362 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.360+0000 7f72a6b2e800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.1.4 2024-09-12T17:39:07.362 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.360+0000 7f72a6b2e800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.1.5 2024-09-12T17:39:07.362 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.360+0000 7f72a6b2e800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.1.5 2024-09-12T17:39:07.362 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.360+0000 7f72a6b2e800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.1.6 2024-09-12T17:39:07.362 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.360+0000 7f72a6b2e800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.1.6 2024-09-12T17:39:07.362 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.360+0000 7f72a6b2e800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.1.7 2024-09-12T17:39:07.363 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.360+0000 7f72a6b2e800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.1.7 2024-09-12T17:39:07.363 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.360+0000 7f72a6b2e800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.1.8 2024-09-12T17:39:07.363 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.360+0000 7f72a6b2e800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.1.8 2024-09-12T17:39:07.363 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.360+0000 7f72a6b2e800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.1.9 2024-09-12T17:39:07.363 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.360+0000 7f72a6b2e800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.1.9 2024-09-12T17:39:07.363 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.360+0000 7f72a6b2e800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.1.10 2024-09-12T17:39:07.363 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.360+0000 7f72a6b2e800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.1.10 2024-09-12T17:39:07.363 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.360+0000 7f72a6b2e800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.1.11 2024-09-12T17:39:07.363 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.360+0000 7f72a6b2e800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.1.11 2024-09-12T17:39:07.363 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.360+0000 7f72a6b2e800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.0 2024-09-12T17:39:07.363 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.361+0000 7f72a6b2e800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.1 2024-09-12T17:39:07.365 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.361+0000 7f72a6b2e800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.2 2024-09-12T17:39:07.365 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.361+0000 7f72a6b2e800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.3 2024-09-12T17:39:07.365 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.362+0000 7f72a6b2e800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.4 2024-09-12T17:39:07.365 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.362+0000 7f72a6b2e800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.5 2024-09-12T17:39:07.365 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.363+0000 7f72a6b2e800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.6 2024-09-12T17:39:07.365 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.364+0000 7f72a6b2e800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.7 2024-09-12T17:39:07.366 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.364+0000 7f72a6b2e800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.8 2024-09-12T17:39:07.366 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.365+0000 7f72a6b2e800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.9 2024-09-12T17:39:07.367 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.365+0000 7f72a6b2e800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.10 2024-09-12T17:39:07.367 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.366+0000 7f72a6b2e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19 : hit (requested=0x17, cached=0x17) 2024-09-12T17:39:07.367 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.366+0000 7f72a6b2e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19 2024-09-12T17:39:07.369 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.367+0000 7f72a6b2e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19 info.flags=0x17 2024-09-12T17:39:07.369 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.367+0000 7f72a6b2e800 10 moving default.rgw.meta+root+.bucket.meta.myver:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19 to cache LRU end 2024-09-12T17:39:07.369 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.367+0000 7f72a6b2e800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:39:07.369 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.367+0000 7f72a6b2e800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19, ofs0, ns] 2024-09-12T17:39:07.369 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.368+0000 7f71867fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497094 cookie 94206321425584 notifier 8514 bl.length()=905 2024-09-12T17:39:07.369 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.368+0000 7f71867fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19 info.flags=0x17 2024-09-12T17:39:07.369 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.368+0000 7f71867fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19 to cache LRU end 2024-09-12T17:39:07.369 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.368+0000 7f71867fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:39:07.370 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.370+0000 7f72a6b2e800 20 handle_bi_update(): bucket=:myver[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19]): orig_sources= new_sources= 2024-09-12T17:39:07.371 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.370+0000 7f72a6b2e800 20 handle_bi_update(): bucket=:myver[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19]): potential sources added=[] removed=[] 2024-09-12T17:39:07.371 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.370+0000 7f72a6b2e800 20 handle_bi_update(): bucket=:myver[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19]): orig_dests= new_dests= 2024-09-12T17:39:07.371 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.370+0000 7f72a6b2e800 20 handle_bi_update(): bucket=:myver[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19]): potential dests added=[] removed=[] 2024-09-12T17:39:07.373 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.373+0000 7f72a6b2e800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.0 2024-09-12T17:39:07.374 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.373+0000 7f72a6b2e800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.1 2024-09-12T17:39:07.374 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.373+0000 7f72a6b2e800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.2 2024-09-12T17:39:07.375 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.374+0000 7f72a6b2e800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.3 2024-09-12T17:39:07.375 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.374+0000 7f72a6b2e800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.4 2024-09-12T17:39:07.375 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.374+0000 7f72a6b2e800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.5 2024-09-12T17:39:07.376 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.375+0000 7f72a6b2e800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.6 2024-09-12T17:39:07.376 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.375+0000 7f72a6b2e800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.7 2024-09-12T17:39:07.376 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.375+0000 7f72a6b2e800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.8 2024-09-12T17:39:07.377 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.376+0000 7f72a6b2e800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.9 2024-09-12T17:39:07.377 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.376+0000 7f72a6b2e800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.10 2024-09-12T17:39:07.377 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.376+0000 7f72a6b2e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19 : hit (requested=0x17, cached=0x17) 2024-09-12T17:39:07.377 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.376+0000 7f72a6b2e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19 2024-09-12T17:39:07.379 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.378+0000 7f72a6b2e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19 info.flags=0x17 2024-09-12T17:39:07.379 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.378+0000 7f72a6b2e800 10 moving default.rgw.meta+root+.bucket.meta.myver:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19 to cache LRU end 2024-09-12T17:39:07.379 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.378+0000 7f72a6b2e800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:39:07.379 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.378+0000 7f72a6b2e800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19, ofs0, ns] 2024-09-12T17:39:07.379 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.378+0000 7f7185ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497095 cookie 94206321425584 notifier 8514 bl.length()=873 2024-09-12T17:39:07.380 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.378+0000 7f7185ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19 info.flags=0x17 2024-09-12T17:39:07.380 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.378+0000 7f7185ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19 to cache LRU end 2024-09-12T17:39:07.380 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.378+0000 7f7185ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:39:07.381 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.380+0000 7f72a6b2e800 20 handle_bi_update(): bucket=:myver[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19]): orig_sources= new_sources= 2024-09-12T17:39:07.381 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.380+0000 7f72a6b2e800 20 handle_bi_update(): bucket=:myver[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19]): potential sources added=[] removed=[] 2024-09-12T17:39:07.381 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.380+0000 7f72a6b2e800 20 handle_bi_update(): bucket=:myver[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19]): orig_dests= new_dests= 2024-09-12T17:39:07.381 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.380+0000 7f72a6b2e800 20 handle_bi_update(): bucket=:myver[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19]): potential dests added=[] removed=[] 2024-09-12T17:39:07.383 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.383+0000 7f72a6b2e800 1 execute INFO: reshard of bucket "myver" from 11 shards to 12 shards completed successfully 2024-09-12T17:39:07.385 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.385+0000 7f71597e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:39:07.388 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.387+0000 7f72a6b2e800 20 remove_watcher() i=0 2024-09-12T17:39:07.388 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.387+0000 7f72a6b2e800 2 removed watcher, disabling cache 2024-09-12T17:39:07.389 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.388+0000 7f72a6b2e800 20 remove_watcher() i=1 2024-09-12T17:39:07.390 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.389+0000 7f72a6b2e800 20 remove_watcher() i=2 2024-09-12T17:39:07.391 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.391+0000 7f72a6b2e800 20 remove_watcher() i=3 2024-09-12T17:39:07.393 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.392+0000 7f72a6b2e800 20 remove_watcher() i=4 2024-09-12T17:39:07.393 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.393+0000 7f72a6b2e800 20 remove_watcher() i=5 2024-09-12T17:39:07.394 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.394+0000 7f72a6b2e800 20 remove_watcher() i=6 2024-09-12T17:39:07.396 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.395+0000 7f72a6b2e800 20 remove_watcher() i=7 2024-09-12T17:39:07.409 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bucket stats --bucket myver 2024-09-12T17:39:07.438 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:39:07.438 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:39:07.477 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.476+0000 7f5c80c10800 20 rados->read ofs=0 len=0 2024-09-12T17:39:07.479 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.478+0000 7f5c80c10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:07.479 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.478+0000 7f5c80c10800 20 realm 2024-09-12T17:39:07.479 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.478+0000 7f5c80c10800 20 rados->read ofs=0 len=0 2024-09-12T17:39:07.479 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.478+0000 7f5c80c10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:07.479 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.478+0000 7f5c80c10800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:39:07.479 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.478+0000 7f5c80c10800 20 rados->read ofs=0 len=0 2024-09-12T17:39:07.479 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.478+0000 7f5c80c10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:07.479 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.478+0000 7f5c80c10800 20 rados->read ofs=0 len=0 2024-09-12T17:39:07.480 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.479+0000 7f5c80c10800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:39:07.480 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.479+0000 7f5c80c10800 20 rados->read ofs=0 len=0 2024-09-12T17:39:07.480 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.479+0000 7f5c80c10800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:39:07.480 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.479+0000 7f5c80c10800 20 searching for the correct realm 2024-09-12T17:39:07.483 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.482+0000 7f5c7bbbb640 0 -- 172.21.15.37:0/3137156066 >> [v2:172.21.15.40:6800/2441293461,v1:172.21.15.40:6801/2441293461] conn(0x7f5c6c07cb60 msgr2=0x7f5c6c041450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:39:07.487 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.487+0000 7f5c7c3bc640 0 -- 172.21.15.37:0/3137156066 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7f5c7003c400 msgr2=0x7f5c7003c860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:39:07.695 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.694+0000 7f5c80c10800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:39:07.695 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.694+0000 7f5c80c10800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:39:07.695 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.694+0000 7f5c80c10800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:39:07.695 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.694+0000 7f5c80c10800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:39:07.695 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.694+0000 7f5c80c10800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:39:07.695 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.694+0000 7f5c80c10800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:39:07.695 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.694+0000 7f5c80c10800 20 rados->read ofs=0 len=0 2024-09-12T17:39:07.696 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.694+0000 7f5c80c10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:07.696 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.694+0000 7f5c80c10800 20 rados->read ofs=0 len=0 2024-09-12T17:39:07.697 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.694+0000 7f5c80c10800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:39:07.697 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.694+0000 7f5c80c10800 20 rados->read ofs=0 len=0 2024-09-12T17:39:07.698 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.695+0000 7f5c80c10800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:39:07.698 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.695+0000 7f5c80c10800 20 zone default found 2024-09-12T17:39:07.698 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.695+0000 7f5c80c10800 4 Realm: () 2024-09-12T17:39:07.698 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.695+0000 7f5c80c10800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:39:07.698 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.695+0000 7f5c80c10800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:39:07.698 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.695+0000 7f5c80c10800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:39:07.698 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.695+0000 7f5c80c10800 20 zonegroup default 2024-09-12T17:39:07.698 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.695+0000 7f5c80c10800 20 rados->read ofs=0 len=0 2024-09-12T17:39:07.699 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.695+0000 7f5c80c10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:07.699 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.695+0000 7f5c80c10800 20 rados->read ofs=0 len=0 2024-09-12T17:39:07.699 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.695+0000 7f5c80c10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:07.699 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.695+0000 7f5c80c10800 20 rados->read ofs=0 len=0 2024-09-12T17:39:07.699 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.696+0000 7f5c80c10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:07.699 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.696+0000 7f5c80c10800 20 started sync module instance, tier type = 2024-09-12T17:39:07.699 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.696+0000 7f5c80c10800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:39:07.707 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.706+0000 7f5c80c10800 20 add_watcher() i=0 2024-09-12T17:39:07.707 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.706+0000 7f5c80c10800 20 add_watcher() i=1 2024-09-12T17:39:07.707 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.706+0000 7f5c80c10800 20 add_watcher() i=2 2024-09-12T17:39:07.707 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.706+0000 7f5c80c10800 20 add_watcher() i=3 2024-09-12T17:39:07.707 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.706+0000 7f5c80c10800 20 add_watcher() i=4 2024-09-12T17:39:07.708 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.706+0000 7f5c80c10800 20 add_watcher() i=5 2024-09-12T17:39:07.708 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.706+0000 7f5c80c10800 20 add_watcher() i=6 2024-09-12T17:39:07.708 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.707+0000 7f5c80c10800 20 add_watcher() i=7 2024-09-12T17:39:07.708 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.707+0000 7f5c80c10800 2 all 8 watchers are set, enabling cache 2024-09-12T17:39:07.710 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.708+0000 7f5b337de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:39:07.710 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.708+0000 7f5c80c10800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:39:07.710 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.708+0000 7f5c80c10800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:39:07.710 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.709+0000 7f5c80c10800 5 note: GC not initialized 2024-09-12T17:39:07.710 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.709+0000 7f5b327dc640 20 reqs_thread_entry: start 2024-09-12T17:39:07.710 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.709+0000 7f5c80c10800 20 init_complete bucket index max shards: 11 2024-09-12T17:39:07.710 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.709+0000 7f5c80c10800 20 Filter name: none 2024-09-12T17:39:07.711 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.709+0000 7f5b2b7fe640 20 reqs_thread_entry: start 2024-09-12T17:39:07.711 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.709+0000 7f5c80c10800 20 rados->read ofs=0 len=0 2024-09-12T17:39:07.712 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.709+0000 7f5c80c10800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:39:07.712 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.709+0000 7f5c80c10800 20 rados->read ofs=0 len=0 2024-09-12T17:39:07.712 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.711+0000 7f5c80c10800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:39:07.712 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.711+0000 7f5c80c10800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:39:07.712 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.711+0000 7f5c80c10800 20 rados->read ofs=0 len=0 2024-09-12T17:39:07.712 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.711+0000 7f5c80c10800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:39:07.712 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.711+0000 7f5c80c10800 20 rados->read ofs=0 len=0 2024-09-12T17:39:07.713 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.711+0000 7f5c80c10800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:39:07.713 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.711+0000 7f5c80c10800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:39:07.714 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.713+0000 7f5b337de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:39:07.716 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.716+0000 7f5c80c10800 20 remove_watcher() i=0 2024-09-12T17:39:07.716 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.716+0000 7f5c80c10800 2 removed watcher, disabling cache 2024-09-12T17:39:07.717 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.717+0000 7f5c80c10800 20 remove_watcher() i=1 2024-09-12T17:39:07.719 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.718+0000 7f5c80c10800 20 remove_watcher() i=2 2024-09-12T17:39:07.720 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.719+0000 7f5c80c10800 20 remove_watcher() i=3 2024-09-12T17:39:07.721 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.720+0000 7f5c80c10800 20 remove_watcher() i=4 2024-09-12T17:39:07.722 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.721+0000 7f5c80c10800 20 remove_watcher() i=5 2024-09-12T17:39:07.723 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.722+0000 7f5c80c10800 20 remove_watcher() i=6 2024-09-12T17:39:07.724 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:07.723+0000 7f5c80c10800 20 remove_watcher() i=7 2024-09-12T17:39:07.735 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:39:07.735 INFO:tasks.workunit.client.0.smithi037.stderr:BUCKET_STATS: 2024-09-12T17:39:07.735 INFO:tasks.workunit.client.0.smithi037.stderr:bucket: myver id: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19 num_objects: 0 size_kb: 0 num_shards: 12 2024-09-12T17:39:07.735 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:39:07.813 INFO:tasks.workunit.client.0.smithi037.stderr: test: reshard removes olh entries with empty name 2024-09-12T17:39:08.118 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T17:39:08.147 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:39:08.147 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:39:08.186 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.185+0000 7ff23952d800 20 rados->read ofs=0 len=0 2024-09-12T17:39:08.188 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.187+0000 7ff23952d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:08.188 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.187+0000 7ff23952d800 20 realm 2024-09-12T17:39:08.188 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.187+0000 7ff23952d800 20 rados->read ofs=0 len=0 2024-09-12T17:39:08.189 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.187+0000 7ff23952d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:08.189 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.187+0000 7ff23952d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:39:08.189 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.187+0000 7ff23952d800 20 rados->read ofs=0 len=0 2024-09-12T17:39:08.189 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.188+0000 7ff23952d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:08.189 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.188+0000 7ff23952d800 20 rados->read ofs=0 len=0 2024-09-12T17:39:08.190 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.188+0000 7ff23952d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:39:08.190 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.188+0000 7ff23952d800 20 rados->read ofs=0 len=0 2024-09-12T17:39:08.190 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.189+0000 7ff23952d800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:39:08.190 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.189+0000 7ff23952d800 20 searching for the correct realm 2024-09-12T17:39:08.192 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.192+0000 7ff235a77640 0 -- 172.21.15.37:0/2530843838 >> [v2:172.21.15.40:6818/1210108009,v1:172.21.15.40:6819/1210108009] conn(0x7ff22c02b070 msgr2=0x7ff22c03a960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:39:08.196 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.195+0000 7ff235276640 0 -- 172.21.15.37:0/2530843838 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7ff22c058040 msgr2=0x7ff22c0393e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:39:08.201 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.200+0000 7ff23952d800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:39:08.201 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.200+0000 7ff23952d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:39:08.201 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.200+0000 7ff23952d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:39:08.201 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.200+0000 7ff23952d800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:39:08.201 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.200+0000 7ff23952d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:39:08.201 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.200+0000 7ff23952d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:39:08.201 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.200+0000 7ff23952d800 20 rados->read ofs=0 len=0 2024-09-12T17:39:08.202 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.200+0000 7ff23952d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:08.202 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.200+0000 7ff23952d800 20 rados->read ofs=0 len=0 2024-09-12T17:39:08.203 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.200+0000 7ff23952d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:39:08.203 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.200+0000 7ff23952d800 20 rados->read ofs=0 len=0 2024-09-12T17:39:08.203 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.201+0000 7ff23952d800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:39:08.204 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.201+0000 7ff23952d800 20 zone default found 2024-09-12T17:39:08.204 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.201+0000 7ff23952d800 4 Realm: () 2024-09-12T17:39:08.204 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.201+0000 7ff23952d800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:39:08.204 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.201+0000 7ff23952d800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:39:08.204 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.201+0000 7ff23952d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:39:08.204 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.201+0000 7ff23952d800 20 zonegroup default 2024-09-12T17:39:08.204 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.201+0000 7ff23952d800 20 rados->read ofs=0 len=0 2024-09-12T17:39:08.204 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.201+0000 7ff23952d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:08.204 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.201+0000 7ff23952d800 20 rados->read ofs=0 len=0 2024-09-12T17:39:08.204 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.202+0000 7ff23952d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:08.205 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.202+0000 7ff23952d800 20 rados->read ofs=0 len=0 2024-09-12T17:39:08.205 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.202+0000 7ff23952d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:08.205 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.202+0000 7ff23952d800 20 started sync module instance, tier type = 2024-09-12T17:39:08.205 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.202+0000 7ff23952d800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:39:08.212 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.211+0000 7ff23952d800 20 add_watcher() i=0 2024-09-12T17:39:08.212 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.211+0000 7ff23952d800 20 add_watcher() i=1 2024-09-12T17:39:08.212 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.211+0000 7ff23952d800 20 add_watcher() i=2 2024-09-12T17:39:08.212 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.211+0000 7ff23952d800 20 add_watcher() i=3 2024-09-12T17:39:08.212 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.211+0000 7ff23952d800 20 add_watcher() i=4 2024-09-12T17:39:08.213 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.211+0000 7ff23952d800 20 add_watcher() i=5 2024-09-12T17:39:08.213 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.211+0000 7ff23952d800 20 add_watcher() i=6 2024-09-12T17:39:08.213 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.212+0000 7ff23952d800 20 add_watcher() i=7 2024-09-12T17:39:08.213 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.212+0000 7ff23952d800 2 all 8 watchers are set, enabling cache 2024-09-12T17:39:08.215 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.214+0000 7ff0eb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:39:08.215 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.214+0000 7ff23952d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:39:08.215 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.214+0000 7ff23952d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:39:08.215 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.214+0000 7ff23952d800 5 note: GC not initialized 2024-09-12T17:39:08.215 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.214+0000 7ff0ea7e4640 20 reqs_thread_entry: start 2024-09-12T17:39:08.216 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.214+0000 7ff23952d800 20 init_complete bucket index max shards: 11 2024-09-12T17:39:08.216 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.214+0000 7ff23952d800 20 Filter name: none 2024-09-12T17:39:08.216 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.215+0000 7ff05bfff640 20 reqs_thread_entry: start 2024-09-12T17:39:08.216 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.215+0000 7ff23952d800 20 rados->read ofs=0 len=0 2024-09-12T17:39:08.217 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.215+0000 7ff23952d800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:39:08.217 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.215+0000 7ff23952d800 20 rados->read ofs=0 len=0 2024-09-12T17:39:08.217 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.216+0000 7ff23952d800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:39:08.217 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.216+0000 7ff23952d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:39:08.217 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.216+0000 7ff23952d800 20 rados->read ofs=0 len=0 2024-09-12T17:39:08.217 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.216+0000 7ff23952d800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:39:08.217 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.216+0000 7ff23952d800 20 rados->read ofs=0 len=0 2024-09-12T17:39:08.217 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.216+0000 7ff23952d800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:39:08.217 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.216+0000 7ff23952d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:39:08.219 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.218+0000 7ff0eb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:39:08.221 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.220+0000 7ff23952d800 20 remove_watcher() i=0 2024-09-12T17:39:08.221 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.220+0000 7ff23952d800 2 removed watcher, disabling cache 2024-09-12T17:39:08.222 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.222+0000 7ff23952d800 20 remove_watcher() i=1 2024-09-12T17:39:08.223 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.223+0000 7ff23952d800 20 remove_watcher() i=2 2024-09-12T17:39:08.224 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.224+0000 7ff23952d800 20 remove_watcher() i=3 2024-09-12T17:39:08.225 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.225+0000 7ff23952d800 20 remove_watcher() i=4 2024-09-12T17:39:08.226 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.226+0000 7ff23952d800 20 remove_watcher() i=5 2024-09-12T17:39:08.227 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.227+0000 7ff23952d800 20 remove_watcher() i=6 2024-09-12T17:39:08.228 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.228+0000 7ff23952d800 20 remove_watcher() i=7 2024-09-12T17:39:08.239 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:39:08.240 INFO:tasks.workunit.client.0.smithi037.stderr:BUCKET_STATS: 2024-09-12T17:39:08.240 INFO:tasks.workunit.client.0.smithi037.stderr:bucket: a-bucket id: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 num_objects: 0 size_kb: 0 num_shards: 13 2024-09-12T17:39:08.240 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:39:08.241 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bucket layout --bucket a-bucket 2024-09-12T17:39:08.270 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:39:08.270 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:39:08.309 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.308+0000 7f542ec10800 20 rados->read ofs=0 len=0 2024-09-12T17:39:08.311 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.310+0000 7f542ec10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:08.311 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.310+0000 7f542ec10800 20 realm 2024-09-12T17:39:08.311 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.310+0000 7f542ec10800 20 rados->read ofs=0 len=0 2024-09-12T17:39:08.311 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.310+0000 7f542ec10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:08.311 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.310+0000 7f542ec10800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:39:08.312 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.310+0000 7f542ec10800 20 rados->read ofs=0 len=0 2024-09-12T17:39:08.312 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.310+0000 7f542ec10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:08.312 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.310+0000 7f542ec10800 20 rados->read ofs=0 len=0 2024-09-12T17:39:08.312 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.311+0000 7f542ec10800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:39:08.312 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.311+0000 7f542ec10800 20 rados->read ofs=0 len=0 2024-09-12T17:39:08.313 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.312+0000 7f542ec10800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:39:08.313 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.312+0000 7f542ec10800 20 searching for the correct realm 2024-09-12T17:39:08.316 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.315+0000 7f542ab7b640 0 -- 172.21.15.37:0/2962941812 >> [v2:172.21.15.40:6818/1210108009,v1:172.21.15.40:6819/1210108009] conn(0x7f542006c040 msgr2=0x7f5420080950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:39:08.319 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.318+0000 7f542a37a640 0 -- 172.21.15.37:0/2962941812 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7f5420061400 msgr2=0x7f5420061860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:39:08.526 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.524+0000 7f542ec10800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:39:08.526 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.524+0000 7f542ec10800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:39:08.526 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.524+0000 7f542ec10800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:39:08.526 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.524+0000 7f542ec10800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:39:08.526 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.524+0000 7f542ec10800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:39:08.526 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.524+0000 7f542ec10800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:39:08.526 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.524+0000 7f542ec10800 20 rados->read ofs=0 len=0 2024-09-12T17:39:08.526 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.525+0000 7f542ec10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:08.526 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.525+0000 7f542ec10800 20 rados->read ofs=0 len=0 2024-09-12T17:39:08.526 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.525+0000 7f542ec10800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:39:08.527 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.525+0000 7f542ec10800 20 rados->read ofs=0 len=0 2024-09-12T17:39:08.528 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.525+0000 7f542ec10800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:39:08.528 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.525+0000 7f542ec10800 20 zone default found 2024-09-12T17:39:08.528 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.525+0000 7f542ec10800 4 Realm: () 2024-09-12T17:39:08.528 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.525+0000 7f542ec10800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:39:08.528 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.525+0000 7f542ec10800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:39:08.528 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.525+0000 7f542ec10800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:39:08.528 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.525+0000 7f542ec10800 20 zonegroup default 2024-09-12T17:39:08.529 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.525+0000 7f542ec10800 20 rados->read ofs=0 len=0 2024-09-12T17:39:08.529 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.526+0000 7f542ec10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:08.529 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.526+0000 7f542ec10800 20 rados->read ofs=0 len=0 2024-09-12T17:39:08.529 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.526+0000 7f542ec10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:08.529 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.526+0000 7f542ec10800 20 rados->read ofs=0 len=0 2024-09-12T17:39:08.529 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.526+0000 7f542ec10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:08.529 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.526+0000 7f542ec10800 20 started sync module instance, tier type = 2024-09-12T17:39:08.529 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.526+0000 7f542ec10800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:39:08.537 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.536+0000 7f542ec10800 20 add_watcher() i=0 2024-09-12T17:39:08.538 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.536+0000 7f542ec10800 20 add_watcher() i=1 2024-09-12T17:39:08.538 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.536+0000 7f542ec10800 20 add_watcher() i=2 2024-09-12T17:39:08.538 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.536+0000 7f542ec10800 20 add_watcher() i=3 2024-09-12T17:39:08.538 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.536+0000 7f542ec10800 20 add_watcher() i=4 2024-09-12T17:39:08.538 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.536+0000 7f542ec10800 20 add_watcher() i=5 2024-09-12T17:39:08.538 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.536+0000 7f542ec10800 20 add_watcher() i=6 2024-09-12T17:39:08.538 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.538+0000 7f542ec10800 20 add_watcher() i=7 2024-09-12T17:39:08.539 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.538+0000 7f542ec10800 2 all 8 watchers are set, enabling cache 2024-09-12T17:39:08.540 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.539+0000 7f52e0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:39:08.541 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.540+0000 7f542ec10800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:39:08.541 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.540+0000 7f542ec10800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:39:08.541 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.540+0000 7f542ec10800 5 note: GC not initialized 2024-09-12T17:39:08.541 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.540+0000 7f525b7fe640 20 reqs_thread_entry: start 2024-09-12T17:39:08.541 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.540+0000 7f542ec10800 20 init_complete bucket index max shards: 11 2024-09-12T17:39:08.541 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.540+0000 7f542ec10800 20 Filter name: none 2024-09-12T17:39:08.541 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.540+0000 7f52597fa640 20 reqs_thread_entry: start 2024-09-12T17:39:08.541 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.540+0000 7f542ec10800 20 rados->read ofs=0 len=0 2024-09-12T17:39:08.542 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.541+0000 7f542ec10800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:39:08.542 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.541+0000 7f542ec10800 20 rados->read ofs=0 len=0 2024-09-12T17:39:08.542 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.541+0000 7f542ec10800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:39:08.542 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.541+0000 7f542ec10800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:39:08.543 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.542+0000 7f52e0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:39:08.545 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.544+0000 7f542ec10800 20 remove_watcher() i=0 2024-09-12T17:39:08.545 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.544+0000 7f542ec10800 2 removed watcher, disabling cache 2024-09-12T17:39:08.546 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.546+0000 7f542ec10800 20 remove_watcher() i=1 2024-09-12T17:39:08.547 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.547+0000 7f542ec10800 20 remove_watcher() i=2 2024-09-12T17:39:08.548 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.548+0000 7f542ec10800 20 remove_watcher() i=3 2024-09-12T17:39:08.549 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.549+0000 7f542ec10800 20 remove_watcher() i=4 2024-09-12T17:39:08.550 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.550+0000 7f542ec10800 20 remove_watcher() i=5 2024-09-12T17:39:08.552 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.551+0000 7f542ec10800 20 remove_watcher() i=6 2024-09-12T17:39:08.553 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.552+0000 7f542ec10800 20 remove_watcher() i=7 2024-09-12T17:39:08.566 INFO:tasks.workunit.client.0.smithi037.stderr:rados -p default.rgw.buckets.index setomapval .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.0 --omap-key-file /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/olh_noname_key < /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/olh_noname_val 2024-09-12T17:39:08.593 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:39:08.594 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:39:08.612 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bi list --bucket a-bucket 2024-09-12T17:39:08.641 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:39:08.641 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:39:08.681 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.680+0000 7fd771d33800 20 rados->read ofs=0 len=0 2024-09-12T17:39:08.683 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.682+0000 7fd771d33800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:08.683 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.682+0000 7fd771d33800 20 realm 2024-09-12T17:39:08.683 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.682+0000 7fd771d33800 20 rados->read ofs=0 len=0 2024-09-12T17:39:08.683 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.682+0000 7fd771d33800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:08.683 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.682+0000 7fd771d33800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:39:08.683 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.682+0000 7fd771d33800 20 rados->read ofs=0 len=0 2024-09-12T17:39:08.683 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.682+0000 7fd771d33800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:08.684 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.682+0000 7fd771d33800 20 rados->read ofs=0 len=0 2024-09-12T17:39:08.684 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.683+0000 7fd771d33800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:39:08.684 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.683+0000 7fd771d33800 20 rados->read ofs=0 len=0 2024-09-12T17:39:08.685 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.683+0000 7fd771d33800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:39:08.685 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.683+0000 7fd771d33800 20 searching for the correct realm 2024-09-12T17:39:08.685 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.685+0000 7fd76da1a640 0 -- 172.21.15.37:0/4245922929 >> [v2:172.21.15.37:6800/1206746176,v1:172.21.15.37:6801/1206746176] conn(0x7fd768067040 msgr2=0x7fd76805c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:39:08.892 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.891+0000 7fd76e21b640 0 -- 172.21.15.37:0/4245922929 >> [v2:172.21.15.40:6818/1210108009,v1:172.21.15.40:6819/1210108009] conn(0x7fd764093040 msgr2=0x7fd76405f690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:39:08.898 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.897+0000 7fd771d33800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:39:08.899 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.897+0000 7fd771d33800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:39:08.899 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.897+0000 7fd771d33800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:39:08.899 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.897+0000 7fd771d33800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:39:08.899 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.897+0000 7fd771d33800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:39:08.899 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.897+0000 7fd771d33800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:39:08.899 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.897+0000 7fd771d33800 20 rados->read ofs=0 len=0 2024-09-12T17:39:08.899 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.897+0000 7fd771d33800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:08.899 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.897+0000 7fd771d33800 20 rados->read ofs=0 len=0 2024-09-12T17:39:08.899 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.898+0000 7fd771d33800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:39:08.899 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.898+0000 7fd771d33800 20 rados->read ofs=0 len=0 2024-09-12T17:39:08.901 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.898+0000 7fd771d33800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:39:08.901 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.898+0000 7fd771d33800 20 zone default found 2024-09-12T17:39:08.901 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.898+0000 7fd771d33800 4 Realm: () 2024-09-12T17:39:08.901 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.898+0000 7fd771d33800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:39:08.901 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.898+0000 7fd771d33800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:39:08.901 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.898+0000 7fd771d33800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:39:08.901 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.898+0000 7fd771d33800 20 zonegroup default 2024-09-12T17:39:08.901 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.898+0000 7fd771d33800 20 rados->read ofs=0 len=0 2024-09-12T17:39:08.901 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.899+0000 7fd771d33800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:08.902 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.899+0000 7fd771d33800 20 rados->read ofs=0 len=0 2024-09-12T17:39:08.902 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.899+0000 7fd771d33800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:08.902 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.899+0000 7fd771d33800 20 rados->read ofs=0 len=0 2024-09-12T17:39:08.902 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.899+0000 7fd771d33800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:08.902 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.899+0000 7fd771d33800 20 started sync module instance, tier type = 2024-09-12T17:39:08.902 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.899+0000 7fd771d33800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:39:08.910 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.909+0000 7fd771d33800 20 add_watcher() i=0 2024-09-12T17:39:08.910 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.909+0000 7fd771d33800 20 add_watcher() i=1 2024-09-12T17:39:08.910 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.909+0000 7fd771d33800 20 add_watcher() i=2 2024-09-12T17:39:08.910 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.909+0000 7fd771d33800 20 add_watcher() i=3 2024-09-12T17:39:08.910 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.909+0000 7fd771d33800 20 add_watcher() i=4 2024-09-12T17:39:08.911 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.909+0000 7fd771d33800 20 add_watcher() i=5 2024-09-12T17:39:08.911 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.909+0000 7fd771d33800 20 add_watcher() i=6 2024-09-12T17:39:08.911 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.910+0000 7fd771d33800 20 add_watcher() i=7 2024-09-12T17:39:08.911 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.910+0000 7fd771d33800 2 all 8 watchers are set, enabling cache 2024-09-12T17:39:08.912 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.912+0000 7fd61f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:39:08.914 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.912+0000 7fd771d33800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:39:08.914 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.912+0000 7fd771d33800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:39:08.914 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.912+0000 7fd771d33800 5 note: GC not initialized 2024-09-12T17:39:08.914 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.912+0000 7fd61e7fc640 20 reqs_thread_entry: start 2024-09-12T17:39:08.914 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.913+0000 7fd771d33800 20 init_complete bucket index max shards: 11 2024-09-12T17:39:08.914 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.913+0000 7fd771d33800 20 Filter name: none 2024-09-12T17:39:08.914 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.913+0000 7fd58ffff640 20 reqs_thread_entry: start 2024-09-12T17:39:08.914 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.913+0000 7fd771d33800 20 rados->read ofs=0 len=0 2024-09-12T17:39:08.915 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.913+0000 7fd771d33800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:39:08.915 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.913+0000 7fd771d33800 20 rados->read ofs=0 len=0 2024-09-12T17:39:08.916 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.914+0000 7fd771d33800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:39:08.916 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.914+0000 7fd771d33800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:39:08.916 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.914+0000 7fd771d33800 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2024-09-12T17:39:08.916 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.914+0000 7fd771d33800 20 INFO: main: starting shard=0 2024-09-12T17:39:08.916 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.914+0000 7fd771d33800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.0 2024-09-12T17:39:08.916 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.914+0000 7fd771d33800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.0 2024-09-12T17:39:08.916 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.914+0000 7fd771d33800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T17:39:08.916 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.914+0000 7fd771d33800 20 INFO: main: starting shard=1 2024-09-12T17:39:08.916 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.914+0000 7fd771d33800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.1 2024-09-12T17:39:08.916 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.914+0000 7fd771d33800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.1 2024-09-12T17:39:08.916 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.915+0000 7fd771d33800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:39:08.916 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.915+0000 7fd771d33800 20 INFO: main: starting shard=2 2024-09-12T17:39:08.917 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.915+0000 7fd771d33800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.2 2024-09-12T17:39:08.917 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.915+0000 7fd771d33800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.2 2024-09-12T17:39:08.917 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.916+0000 7fd771d33800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:39:08.917 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.916+0000 7fd771d33800 20 INFO: main: starting shard=3 2024-09-12T17:39:08.917 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.916+0000 7fd771d33800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.3 2024-09-12T17:39:08.917 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.916+0000 7fd771d33800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.3 2024-09-12T17:39:08.918 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.916+0000 7fd771d33800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:39:08.918 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.916+0000 7fd771d33800 20 INFO: main: starting shard=4 2024-09-12T17:39:08.918 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.916+0000 7fd771d33800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.4 2024-09-12T17:39:08.918 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.916+0000 7fd771d33800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.4 2024-09-12T17:39:08.918 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.917+0000 7fd771d33800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:39:08.918 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.917+0000 7fd771d33800 20 INFO: main: starting shard=5 2024-09-12T17:39:08.918 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.917+0000 7fd771d33800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.5 2024-09-12T17:39:08.919 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.917+0000 7fd771d33800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.5 2024-09-12T17:39:08.919 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.918+0000 7fd771d33800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:39:08.919 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.918+0000 7fd771d33800 20 INFO: main: starting shard=6 2024-09-12T17:39:08.919 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.918+0000 7fd771d33800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.6 2024-09-12T17:39:08.919 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.918+0000 7fd771d33800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.6 2024-09-12T17:39:08.919 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.918+0000 7fd771d33800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:39:08.919 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.918+0000 7fd771d33800 20 INFO: main: starting shard=7 2024-09-12T17:39:08.919 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.918+0000 7fd771d33800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.7 2024-09-12T17:39:08.920 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.918+0000 7fd771d33800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.7 2024-09-12T17:39:08.920 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.919+0000 7fd771d33800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:39:08.920 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.919+0000 7fd771d33800 20 INFO: main: starting shard=8 2024-09-12T17:39:08.920 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.919+0000 7fd771d33800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.8 2024-09-12T17:39:08.920 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.919+0000 7fd771d33800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.8 2024-09-12T17:39:08.920 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.919+0000 7fd771d33800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:39:08.920 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.919+0000 7fd771d33800 20 INFO: main: starting shard=9 2024-09-12T17:39:08.920 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.919+0000 7fd771d33800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.9 2024-09-12T17:39:08.920 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.919+0000 7fd771d33800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.9 2024-09-12T17:39:08.921 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.920+0000 7fd771d33800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:39:08.921 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.920+0000 7fd771d33800 20 INFO: main: starting shard=10 2024-09-12T17:39:08.921 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.920+0000 7fd771d33800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.10 2024-09-12T17:39:08.921 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.920+0000 7fd771d33800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.10 2024-09-12T17:39:08.922 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.921+0000 7fd771d33800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:39:08.922 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.921+0000 7fd771d33800 20 INFO: main: starting shard=11 2024-09-12T17:39:08.922 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.921+0000 7fd771d33800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.11 2024-09-12T17:39:08.922 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.921+0000 7fd771d33800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.11 2024-09-12T17:39:08.922 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.921+0000 7fd771d33800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:39:08.922 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.921+0000 7fd771d33800 20 INFO: main: starting shard=12 2024-09-12T17:39:08.922 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.921+0000 7fd771d33800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.12 2024-09-12T17:39:08.922 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.921+0000 7fd771d33800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.12 2024-09-12T17:39:08.923 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.922+0000 7fd771d33800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:39:08.923 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.922+0000 7fd771d33800 20 INFO: main: done 2024-09-12T17:39:08.923 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.923+0000 7fd61f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:39:08.929 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.925+0000 7fd771d33800 20 remove_watcher() i=0 2024-09-12T17:39:08.929 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.925+0000 7fd771d33800 2 removed watcher, disabling cache 2024-09-12T17:39:08.929 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.926+0000 7fd771d33800 20 remove_watcher() i=1 2024-09-12T17:39:08.929 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.927+0000 7fd771d33800 20 remove_watcher() i=2 2024-09-12T17:39:08.929 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.928+0000 7fd771d33800 20 remove_watcher() i=3 2024-09-12T17:39:08.930 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.930+0000 7fd771d33800 20 remove_watcher() i=4 2024-09-12T17:39:08.931 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.931+0000 7fd771d33800 20 remove_watcher() i=5 2024-09-12T17:39:08.933 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.932+0000 7fd771d33800 20 remove_watcher() i=6 2024-09-12T17:39:08.933 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:08.933+0000 7fd771d33800 20 remove_watcher() i=7 2024-09-12T17:39:08.946 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 1 --yes-i-really-mean-it 2024-09-12T17:39:08.979 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:39:08.979 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:39:09.019 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.018+0000 7f6872946800 20 rados->read ofs=0 len=0 2024-09-12T17:39:09.021 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.020+0000 7f6872946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:09.021 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.020+0000 7f6872946800 20 realm 2024-09-12T17:39:09.021 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.020+0000 7f6872946800 20 rados->read ofs=0 len=0 2024-09-12T17:39:09.021 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.020+0000 7f6872946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:09.021 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.020+0000 7f6872946800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:39:09.021 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.020+0000 7f6872946800 20 rados->read ofs=0 len=0 2024-09-12T17:39:09.021 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.020+0000 7f6872946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:09.022 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.020+0000 7f6872946800 20 rados->read ofs=0 len=0 2024-09-12T17:39:09.022 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.021+0000 7f6872946800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:39:09.023 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.021+0000 7f6872946800 20 rados->read ofs=0 len=0 2024-09-12T17:39:09.023 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.022+0000 7f6872946800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:39:09.023 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.022+0000 7f6872946800 20 searching for the correct realm 2024-09-12T17:39:09.024 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.024+0000 7f6870437640 0 -- 172.21.15.37:0/1600061979 >> [v2:172.21.15.37:6800/1206746176,v1:172.21.15.37:6801/1206746176] conn(0x55ff5a9fbd10 msgr2=0x7f6868082aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:39:09.231 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.230+0000 7f6870c38640 0 -- 172.21.15.37:0/1600061979 >> [v2:172.21.15.40:6818/1210108009,v1:172.21.15.40:6819/1210108009] conn(0x7f68640749f0 msgr2=0x7f686406c410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:39:09.238 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.237+0000 7f6872946800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:39:09.238 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.237+0000 7f6872946800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:39:09.238 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.237+0000 7f6872946800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:39:09.238 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.237+0000 7f6872946800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:39:09.238 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.237+0000 7f6872946800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:39:09.238 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.237+0000 7f6872946800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:39:09.238 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.237+0000 7f6872946800 20 rados->read ofs=0 len=0 2024-09-12T17:39:09.238 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.237+0000 7f6872946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:09.238 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.237+0000 7f6872946800 20 rados->read ofs=0 len=0 2024-09-12T17:39:09.240 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.238+0000 7f6872946800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:39:09.240 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.238+0000 7f6872946800 20 rados->read ofs=0 len=0 2024-09-12T17:39:09.240 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.238+0000 7f6872946800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:39:09.240 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.238+0000 7f6872946800 20 zone default found 2024-09-12T17:39:09.240 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.238+0000 7f6872946800 4 Realm: () 2024-09-12T17:39:09.240 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.238+0000 7f6872946800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:39:09.240 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.238+0000 7f6872946800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:39:09.240 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.238+0000 7f6872946800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:39:09.240 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.238+0000 7f6872946800 20 zonegroup default 2024-09-12T17:39:09.240 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.238+0000 7f6872946800 20 rados->read ofs=0 len=0 2024-09-12T17:39:09.240 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.238+0000 7f6872946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:09.241 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.238+0000 7f6872946800 20 rados->read ofs=0 len=0 2024-09-12T17:39:09.241 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.239+0000 7f6872946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:09.241 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.239+0000 7f6872946800 20 rados->read ofs=0 len=0 2024-09-12T17:39:09.241 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.239+0000 7f6872946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:09.241 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.239+0000 7f6872946800 20 started sync module instance, tier type = 2024-09-12T17:39:09.241 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.239+0000 7f6872946800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:39:09.250 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.249+0000 7f6872946800 20 add_watcher() i=0 2024-09-12T17:39:09.250 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.249+0000 7f6872946800 20 add_watcher() i=1 2024-09-12T17:39:09.250 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.249+0000 7f6872946800 20 add_watcher() i=2 2024-09-12T17:39:09.250 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.249+0000 7f6872946800 20 add_watcher() i=3 2024-09-12T17:39:09.250 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.249+0000 7f6872946800 20 add_watcher() i=4 2024-09-12T17:39:09.251 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.249+0000 7f6872946800 20 add_watcher() i=5 2024-09-12T17:39:09.251 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.249+0000 7f6872946800 20 add_watcher() i=6 2024-09-12T17:39:09.251 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.250+0000 7f6872946800 20 add_watcher() i=7 2024-09-12T17:39:09.251 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.250+0000 7f6872946800 2 all 8 watchers are set, enabling cache 2024-09-12T17:39:09.253 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.252+0000 7f6726fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:39:09.254 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.253+0000 7f6872946800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:39:09.254 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.253+0000 7f6872946800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:39:09.254 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.253+0000 7f6872946800 5 note: GC not initialized 2024-09-12T17:39:09.254 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.253+0000 7f6725fdb640 20 reqs_thread_entry: start 2024-09-12T17:39:09.254 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.253+0000 7f6872946800 20 init_complete bucket index max shards: 11 2024-09-12T17:39:09.254 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.253+0000 7f6872946800 20 Filter name: none 2024-09-12T17:39:09.254 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.253+0000 7f66977fe640 20 reqs_thread_entry: start 2024-09-12T17:39:09.255 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.253+0000 7f6872946800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:39:09.255 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.253+0000 7f6872946800 20 rados->read ofs=0 len=0 2024-09-12T17:39:09.255 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.254+0000 7f6872946800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:39:09.256 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.254+0000 7f6872946800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:39:09.256 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.254+0000 7f6872946800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:39:09.256 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.254+0000 7f6872946800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 : miss 2024-09-12T17:39:09.256 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.254+0000 7f6872946800 20 rados->read ofs=0 len=0 2024-09-12T17:39:09.256 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.255+0000 7f6872946800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:39:09.256 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.255+0000 7f6872946800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 info.flags=0x17 2024-09-12T17:39:09.256 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.255+0000 7f6872946800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 to cache LRU end 2024-09-12T17:39:09.256 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.255+0000 7f6872946800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:39:09.256 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.255+0000 7f6872946800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:39:09.256 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.255+0000 7f6872946800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 2024-09-12T17:39:09.259 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.258+0000 7f6872946800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 info.flags=0x17 2024-09-12T17:39:09.259 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.258+0000 7f6872946800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 to cache LRU end 2024-09-12T17:39:09.260 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.258+0000 7f6872946800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:39:09.260 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.258+0000 7f6872946800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18, ofs0, ns] 2024-09-12T17:39:09.260 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.259+0000 7f6746ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497023 cookie 94555227837616 notifier 8607 bl.length()=911 2024-09-12T17:39:09.260 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.259+0000 7f6746ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 info.flags=0x17 2024-09-12T17:39:09.260 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.259+0000 7f6746ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 to cache LRU end 2024-09-12T17:39:09.260 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.259+0000 7f6746ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:39:09.261 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.260+0000 7f6872946800 20 handle_bi_update(): bucket=:a-bucket[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18]): orig_sources= new_sources= 2024-09-12T17:39:09.261 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.260+0000 7f6872946800 20 handle_bi_update(): bucket=:a-bucket[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18]): potential sources added=[] removed=[] 2024-09-12T17:39:09.261 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.260+0000 7f6872946800 20 handle_bi_update(): bucket=:a-bucket[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18]): orig_dests= new_dests= 2024-09-12T17:39:09.261 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.260+0000 7f6872946800 20 handle_bi_update(): bucket=:a-bucket[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18]): potential dests added=[] removed=[] 2024-09-12T17:39:09.267 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.266+0000 7f6872946800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.3.0 2024-09-12T17:39:09.267 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.266+0000 7f6872946800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.3.0 2024-09-12T17:39:09.267 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.266+0000 7f6872946800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.0 2024-09-12T17:39:09.267 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.266+0000 7f6872946800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.0 2024-09-12T17:39:09.268 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.267+0000 7f6872946800 10 Dropping entry with empty name, idx=�1001_04/57/0457f727ec113e418d5b16d206b200ed068c0533554883ce811df7c932a3df68/2018_12_11/2889999/3386469/metadata.gz 2024-09-12T17:39:09.268 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.267+0000 7f6872946800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.1 2024-09-12T17:39:09.268 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.267+0000 7f6872946800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.1 2024-09-12T17:39:09.268 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.268+0000 7f6872946800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.2 2024-09-12T17:39:09.268 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.268+0000 7f6872946800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.2 2024-09-12T17:39:09.269 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.268+0000 7f6872946800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.3 2024-09-12T17:39:09.269 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.268+0000 7f6872946800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.3 2024-09-12T17:39:09.269 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.269+0000 7f6872946800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.4 2024-09-12T17:39:09.270 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.269+0000 7f6872946800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.4 2024-09-12T17:39:09.270 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.269+0000 7f6872946800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.5 2024-09-12T17:39:09.270 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.269+0000 7f6872946800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.5 2024-09-12T17:39:09.270 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.270+0000 7f6872946800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.6 2024-09-12T17:39:09.270 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.270+0000 7f6872946800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.6 2024-09-12T17:39:09.271 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.270+0000 7f6872946800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.7 2024-09-12T17:39:09.271 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.270+0000 7f6872946800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.7 2024-09-12T17:39:09.272 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.271+0000 7f6872946800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.8 2024-09-12T17:39:09.272 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.271+0000 7f6872946800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.8 2024-09-12T17:39:09.272 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.272+0000 7f6872946800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.9 2024-09-12T17:39:09.272 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.272+0000 7f6872946800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.9 2024-09-12T17:39:09.273 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.272+0000 7f6872946800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.10 2024-09-12T17:39:09.273 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.272+0000 7f6872946800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.10 2024-09-12T17:39:09.273 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.273+0000 7f6872946800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.11 2024-09-12T17:39:09.273 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.273+0000 7f6872946800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.11 2024-09-12T17:39:09.274 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.273+0000 7f6872946800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.12 2024-09-12T17:39:09.274 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.273+0000 7f6872946800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.12 2024-09-12T17:39:09.274 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.274+0000 7f6872946800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 : hit (requested=0x17, cached=0x17) 2024-09-12T17:39:09.274 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.274+0000 7f6872946800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 2024-09-12T17:39:09.276 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.275+0000 7f6872946800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 info.flags=0x17 2024-09-12T17:39:09.276 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.275+0000 7f6872946800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 to cache LRU end 2024-09-12T17:39:09.276 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.275+0000 7f6872946800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:39:09.276 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.275+0000 7f6872946800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18, ofs0, ns] 2024-09-12T17:39:09.276 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.275+0000 7f67477fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497024 cookie 94555227837616 notifier 8607 bl.length()=911 2024-09-12T17:39:09.277 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.275+0000 7f67477fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 info.flags=0x17 2024-09-12T17:39:09.277 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.275+0000 7f67477fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 to cache LRU end 2024-09-12T17:39:09.277 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.275+0000 7f67477fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:39:09.278 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.277+0000 7f6872946800 20 handle_bi_update(): bucket=:a-bucket[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18]): orig_sources= new_sources= 2024-09-12T17:39:09.278 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.277+0000 7f6872946800 20 handle_bi_update(): bucket=:a-bucket[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18]): potential sources added=[] removed=[] 2024-09-12T17:39:09.278 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.277+0000 7f6872946800 20 handle_bi_update(): bucket=:a-bucket[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18]): orig_dests= new_dests= 2024-09-12T17:39:09.278 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.277+0000 7f6872946800 20 handle_bi_update(): bucket=:a-bucket[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18]): potential dests added=[] removed=[] 2024-09-12T17:39:09.281 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.280+0000 7f6872946800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.0 2024-09-12T17:39:09.281 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.280+0000 7f6872946800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.0 2024-09-12T17:39:09.282 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.281+0000 7f6872946800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.1 2024-09-12T17:39:09.282 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.281+0000 7f6872946800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.1 2024-09-12T17:39:09.282 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.281+0000 7f6872946800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.2 2024-09-12T17:39:09.282 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.281+0000 7f6872946800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.2 2024-09-12T17:39:09.283 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.282+0000 7f6872946800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.3 2024-09-12T17:39:09.283 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.282+0000 7f6872946800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.3 2024-09-12T17:39:09.283 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.283+0000 7f6872946800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.4 2024-09-12T17:39:09.283 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.283+0000 7f6872946800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.4 2024-09-12T17:39:09.284 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.283+0000 7f6872946800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.5 2024-09-12T17:39:09.284 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.283+0000 7f6872946800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.5 2024-09-12T17:39:09.284 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.284+0000 7f6872946800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.6 2024-09-12T17:39:09.284 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.284+0000 7f6872946800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.6 2024-09-12T17:39:09.285 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.284+0000 7f6872946800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.7 2024-09-12T17:39:09.285 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.284+0000 7f6872946800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.7 2024-09-12T17:39:09.285 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.284+0000 7f6872946800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.8 2024-09-12T17:39:09.285 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.284+0000 7f6872946800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.8 2024-09-12T17:39:09.285 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.285+0000 7f6872946800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.9 2024-09-12T17:39:09.285 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.285+0000 7f6872946800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.9 2024-09-12T17:39:09.286 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.285+0000 7f6872946800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.10 2024-09-12T17:39:09.286 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.285+0000 7f6872946800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.10 2024-09-12T17:39:09.286 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.285+0000 7f6872946800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.11 2024-09-12T17:39:09.286 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.285+0000 7f6872946800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.11 2024-09-12T17:39:09.287 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.286+0000 7f6872946800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.12 2024-09-12T17:39:09.287 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.286+0000 7f6872946800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.2.12 2024-09-12T17:39:09.287 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.286+0000 7f6872946800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 : hit (requested=0x17, cached=0x17) 2024-09-12T17:39:09.287 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.286+0000 7f6872946800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 2024-09-12T17:39:09.288 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.287+0000 7f6872946800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 info.flags=0x17 2024-09-12T17:39:09.288 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.287+0000 7f6872946800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 to cache LRU end 2024-09-12T17:39:09.288 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.287+0000 7f6872946800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:39:09.288 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.287+0000 7f6872946800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18, ofs0, ns] 2024-09-12T17:39:09.289 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.287+0000 7f6746ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497025 cookie 94555227837616 notifier 8607 bl.length()=879 2024-09-12T17:39:09.289 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.288+0000 7f6746ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 info.flags=0x17 2024-09-12T17:39:09.289 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.288+0000 7f6746ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18 to cache LRU end 2024-09-12T17:39:09.289 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.288+0000 7f6746ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:39:09.290 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.289+0000 7f6872946800 20 handle_bi_update(): bucket=:a-bucket[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18]): orig_sources= new_sources= 2024-09-12T17:39:09.290 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.289+0000 7f6872946800 20 handle_bi_update(): bucket=:a-bucket[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18]): potential sources added=[] removed=[] 2024-09-12T17:39:09.290 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.289+0000 7f6872946800 20 handle_bi_update(): bucket=:a-bucket[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18]): orig_dests= new_dests= 2024-09-12T17:39:09.290 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.289+0000 7f6872946800 20 handle_bi_update(): bucket=:a-bucket[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18]): potential dests added=[] removed=[] 2024-09-12T17:39:09.292 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.292+0000 7f6872946800 1 execute INFO: reshard of bucket "a-bucket" from 13 shards to 1 shards completed successfully 2024-09-12T17:39:09.294 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.294+0000 7f6726fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:39:09.297 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.296+0000 7f6872946800 20 remove_watcher() i=0 2024-09-12T17:39:09.297 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.296+0000 7f6872946800 2 removed watcher, disabling cache 2024-09-12T17:39:09.298 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.297+0000 7f6872946800 20 remove_watcher() i=1 2024-09-12T17:39:09.299 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.298+0000 7f6872946800 20 remove_watcher() i=2 2024-09-12T17:39:09.300 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.299+0000 7f6872946800 20 remove_watcher() i=3 2024-09-12T17:39:09.301 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.300+0000 7f6872946800 20 remove_watcher() i=4 2024-09-12T17:39:09.302 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.301+0000 7f6872946800 20 remove_watcher() i=5 2024-09-12T17:39:09.303 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.302+0000 7f6872946800 20 remove_watcher() i=6 2024-09-12T17:39:09.304 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.303+0000 7f6872946800 20 remove_watcher() i=7 2024-09-12T17:39:09.316 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bi list --bucket a-bucket 2024-09-12T17:39:09.346 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:39:09.346 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:39:09.385 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.384+0000 7f36fc613800 20 rados->read ofs=0 len=0 2024-09-12T17:39:09.387 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.386+0000 7f36fc613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:09.388 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.386+0000 7f36fc613800 20 realm 2024-09-12T17:39:09.388 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.386+0000 7f36fc613800 20 rados->read ofs=0 len=0 2024-09-12T17:39:09.388 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.387+0000 7f36fc613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:09.388 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.387+0000 7f36fc613800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:39:09.388 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.387+0000 7f36fc613800 20 rados->read ofs=0 len=0 2024-09-12T17:39:09.388 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.387+0000 7f36fc613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:09.388 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.387+0000 7f36fc613800 20 rados->read ofs=0 len=0 2024-09-12T17:39:09.389 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.388+0000 7f36fc613800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:39:09.389 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.388+0000 7f36fc613800 20 rados->read ofs=0 len=0 2024-09-12T17:39:09.389 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.388+0000 7f36fc613800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:39:09.389 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.388+0000 7f36fc613800 20 searching for the correct realm 2024-09-12T17:39:09.391 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.391+0000 7f36f7547640 0 -- 172.21.15.37:0/778573414 >> [v2:172.21.15.40:6800/2441293461,v1:172.21.15.40:6801/2441293461] conn(0x7f36e8027040 msgr2=0x7f36e8066980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:39:09.395 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.395+0000 7f36f7d48640 0 -- 172.21.15.37:0/778573414 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7f36ec04c820 msgr2=0x7f36ec0a6640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:39:09.602 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.601+0000 7f36fc613800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:39:09.602 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.601+0000 7f36fc613800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:39:09.603 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.601+0000 7f36fc613800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:39:09.603 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.601+0000 7f36fc613800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:39:09.603 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.601+0000 7f36fc613800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:39:09.603 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.601+0000 7f36fc613800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:39:09.603 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.601+0000 7f36fc613800 20 rados->read ofs=0 len=0 2024-09-12T17:39:09.603 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.602+0000 7f36fc613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:09.603 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.602+0000 7f36fc613800 20 rados->read ofs=0 len=0 2024-09-12T17:39:09.604 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.602+0000 7f36fc613800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:39:09.604 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.602+0000 7f36fc613800 20 rados->read ofs=0 len=0 2024-09-12T17:39:09.604 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.602+0000 7f36fc613800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:39:09.604 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.602+0000 7f36fc613800 20 zone default found 2024-09-12T17:39:09.605 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.602+0000 7f36fc613800 4 Realm: () 2024-09-12T17:39:09.605 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.602+0000 7f36fc613800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:39:09.605 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.602+0000 7f36fc613800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:39:09.605 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.602+0000 7f36fc613800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:39:09.605 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.602+0000 7f36fc613800 20 zonegroup default 2024-09-12T17:39:09.605 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.602+0000 7f36fc613800 20 rados->read ofs=0 len=0 2024-09-12T17:39:09.605 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.603+0000 7f36fc613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:09.605 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.603+0000 7f36fc613800 20 rados->read ofs=0 len=0 2024-09-12T17:39:09.605 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.603+0000 7f36fc613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:09.605 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.603+0000 7f36fc613800 20 rados->read ofs=0 len=0 2024-09-12T17:39:09.605 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.603+0000 7f36fc613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:09.605 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.603+0000 7f36fc613800 20 started sync module instance, tier type = 2024-09-12T17:39:09.605 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.603+0000 7f36fc613800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:39:09.614 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.614+0000 7f36fc613800 20 add_watcher() i=0 2024-09-12T17:39:09.615 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.614+0000 7f36fc613800 20 add_watcher() i=1 2024-09-12T17:39:09.615 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.614+0000 7f36fc613800 20 add_watcher() i=2 2024-09-12T17:39:09.615 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.614+0000 7f36fc613800 20 add_watcher() i=3 2024-09-12T17:39:09.615 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.614+0000 7f36fc613800 20 add_watcher() i=4 2024-09-12T17:39:09.615 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.614+0000 7f36fc613800 20 add_watcher() i=5 2024-09-12T17:39:09.615 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.614+0000 7f36fc613800 20 add_watcher() i=6 2024-09-12T17:39:09.615 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.615+0000 7f36fc613800 20 add_watcher() i=7 2024-09-12T17:39:09.615 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.615+0000 7f36fc613800 2 all 8 watchers are set, enabling cache 2024-09-12T17:39:09.617 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.616+0000 7f35adfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:39:09.618 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.617+0000 7f36fc613800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:39:09.618 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.617+0000 7f36fc613800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:39:09.618 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.617+0000 7f36fc613800 5 note: GC not initialized 2024-09-12T17:39:09.618 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.617+0000 7f35acfe1640 20 reqs_thread_entry: start 2024-09-12T17:39:09.618 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.617+0000 7f36fc613800 20 init_complete bucket index max shards: 11 2024-09-12T17:39:09.618 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.617+0000 7f36fc613800 20 Filter name: none 2024-09-12T17:39:09.619 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.617+0000 7f35267fc640 20 reqs_thread_entry: start 2024-09-12T17:39:09.619 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.617+0000 7f36fc613800 20 rados->read ofs=0 len=0 2024-09-12T17:39:09.619 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.618+0000 7f36fc613800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T17:39:09.620 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.618+0000 7f36fc613800 20 rados->read ofs=0 len=0 2024-09-12T17:39:09.620 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.619+0000 7f36fc613800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T17:39:09.620 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.619+0000 7f36fc613800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:39:09.620 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.619+0000 7f36fc613800 20 INFO: main: max_entries=1000, index=gen=3, max_shards=1 2024-09-12T17:39:09.620 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.619+0000 7f36fc613800 20 INFO: main: starting shard=0 2024-09-12T17:39:09.620 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.619+0000 7f36fc613800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.3.0 2024-09-12T17:39:09.620 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.619+0000 7f36fc613800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18.3.0 2024-09-12T17:39:09.620 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.619+0000 7f36fc613800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:39:09.621 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.619+0000 7f36fc613800 20 INFO: main: done 2024-09-12T17:39:09.621 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.620+0000 7f35adfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:39:09.623 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.623+0000 7f36fc613800 20 remove_watcher() i=0 2024-09-12T17:39:09.624 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.623+0000 7f36fc613800 2 removed watcher, disabling cache 2024-09-12T17:39:09.625 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.624+0000 7f36fc613800 20 remove_watcher() i=1 2024-09-12T17:39:09.626 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.626+0000 7f36fc613800 20 remove_watcher() i=2 2024-09-12T17:39:09.628 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.627+0000 7f36fc613800 20 remove_watcher() i=3 2024-09-12T17:39:09.629 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.628+0000 7f36fc613800 20 remove_watcher() i=4 2024-09-12T17:39:09.630 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.629+0000 7f36fc613800 20 remove_watcher() i=5 2024-09-12T17:39:09.631 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.630+0000 7f36fc613800 20 remove_watcher() i=6 2024-09-12T17:39:09.632 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.631+0000 7f36fc613800 20 remove_watcher() i=7 2024-09-12T17:39:09.643 INFO:tasks.workunit.client.0.smithi037.stderr: test: PUT succeeds during reshard 2024-09-12T17:39:09.645 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bucket stats --bucket myver 2024-09-12T17:39:09.674 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:39:09.675 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:39:09.714 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.713+0000 7f2a02540800 20 rados->read ofs=0 len=0 2024-09-12T17:39:09.716 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.715+0000 7f2a02540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:09.716 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.715+0000 7f2a02540800 20 realm 2024-09-12T17:39:09.716 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.715+0000 7f2a02540800 20 rados->read ofs=0 len=0 2024-09-12T17:39:09.716 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.715+0000 7f2a02540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:09.716 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.715+0000 7f2a02540800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:39:09.716 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.715+0000 7f2a02540800 20 rados->read ofs=0 len=0 2024-09-12T17:39:09.717 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.715+0000 7f2a02540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:09.717 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.715+0000 7f2a02540800 20 rados->read ofs=0 len=0 2024-09-12T17:39:09.717 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.716+0000 7f2a02540800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:39:09.717 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.716+0000 7f2a02540800 20 rados->read ofs=0 len=0 2024-09-12T17:39:09.718 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.717+0000 7f2a02540800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:39:09.718 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.717+0000 7f2a02540800 20 searching for the correct realm 2024-09-12T17:39:09.722 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.721+0000 7f29feac1640 0 -- 172.21.15.37:0/667027450 >> [v2:172.21.15.40:6808/2253405131,v1:172.21.15.40:6809/2253405131] conn(0x7f29e803a940 msgr2=0x7f29e800f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:39:09.929 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.928+0000 7f29fe2c0640 0 -- 172.21.15.37:0/667027450 >> [v2:172.21.15.40:6826/4130399962,v1:172.21.15.40:6827/4130399962] conn(0x55d5f5cbd860 msgr2=0x55d5f5cbfd20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:39:09.932 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.931+0000 7f2a02540800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:39:09.933 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.931+0000 7f2a02540800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:39:09.933 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.931+0000 7f2a02540800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:39:09.933 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.931+0000 7f2a02540800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:39:09.933 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.931+0000 7f2a02540800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:39:09.933 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.931+0000 7f2a02540800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:39:09.933 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.931+0000 7f2a02540800 20 rados->read ofs=0 len=0 2024-09-12T17:39:09.933 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.932+0000 7f2a02540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:09.933 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.932+0000 7f2a02540800 20 rados->read ofs=0 len=0 2024-09-12T17:39:09.934 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.932+0000 7f2a02540800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:39:09.935 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.932+0000 7f2a02540800 20 rados->read ofs=0 len=0 2024-09-12T17:39:09.935 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.933+0000 7f2a02540800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:39:09.935 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.933+0000 7f2a02540800 20 zone default found 2024-09-12T17:39:09.935 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.933+0000 7f2a02540800 4 Realm: () 2024-09-12T17:39:09.935 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.933+0000 7f2a02540800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:39:09.935 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.933+0000 7f2a02540800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:39:09.935 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.933+0000 7f2a02540800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:39:09.935 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.933+0000 7f2a02540800 20 zonegroup default 2024-09-12T17:39:09.935 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.933+0000 7f2a02540800 20 rados->read ofs=0 len=0 2024-09-12T17:39:09.935 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.933+0000 7f2a02540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:09.935 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.933+0000 7f2a02540800 20 rados->read ofs=0 len=0 2024-09-12T17:39:09.935 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.933+0000 7f2a02540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:09.936 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.933+0000 7f2a02540800 20 rados->read ofs=0 len=0 2024-09-12T17:39:09.936 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.934+0000 7f2a02540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:09.936 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.934+0000 7f2a02540800 20 started sync module instance, tier type = 2024-09-12T17:39:09.936 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.934+0000 7f2a02540800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:39:09.945 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.944+0000 7f2a02540800 20 add_watcher() i=0 2024-09-12T17:39:09.945 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.944+0000 7f2a02540800 20 add_watcher() i=1 2024-09-12T17:39:09.945 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.944+0000 7f2a02540800 20 add_watcher() i=2 2024-09-12T17:39:09.945 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.944+0000 7f2a02540800 20 add_watcher() i=3 2024-09-12T17:39:09.945 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.944+0000 7f2a02540800 20 add_watcher() i=4 2024-09-12T17:39:09.945 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.944+0000 7f2a02540800 20 add_watcher() i=5 2024-09-12T17:39:09.945 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.944+0000 7f2a02540800 20 add_watcher() i=6 2024-09-12T17:39:09.949 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.945+0000 7f2a02540800 20 add_watcher() i=7 2024-09-12T17:39:09.950 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.945+0000 7f2a02540800 2 all 8 watchers are set, enabling cache 2024-09-12T17:39:09.950 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.947+0000 7f28b4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:39:09.950 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.947+0000 7f2a02540800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:39:09.950 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.947+0000 7f2a02540800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:39:09.950 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.947+0000 7f2a02540800 5 note: GC not initialized 2024-09-12T17:39:09.950 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.947+0000 7f282f7fe640 20 reqs_thread_entry: start 2024-09-12T17:39:09.950 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.947+0000 7f2a02540800 20 init_complete bucket index max shards: 11 2024-09-12T17:39:09.950 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.947+0000 7f2a02540800 20 Filter name: none 2024-09-12T17:39:09.950 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.948+0000 7f282d7fa640 20 reqs_thread_entry: start 2024-09-12T17:39:09.950 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.948+0000 7f2a02540800 20 rados->read ofs=0 len=0 2024-09-12T17:39:09.950 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.948+0000 7f2a02540800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:39:09.950 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.948+0000 7f2a02540800 20 rados->read ofs=0 len=0 2024-09-12T17:39:09.951 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.949+0000 7f2a02540800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:39:09.951 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.949+0000 7f2a02540800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:39:09.951 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.949+0000 7f2a02540800 20 rados->read ofs=0 len=0 2024-09-12T17:39:09.951 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.949+0000 7f2a02540800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:39:09.951 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.949+0000 7f2a02540800 20 rados->read ofs=0 len=0 2024-09-12T17:39:09.951 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.949+0000 7f2a02540800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:39:09.951 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.949+0000 7f2a02540800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:39:09.952 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.951+0000 7f28b4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:39:09.955 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.954+0000 7f2a02540800 20 remove_watcher() i=0 2024-09-12T17:39:09.955 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.954+0000 7f2a02540800 2 removed watcher, disabling cache 2024-09-12T17:39:09.956 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.955+0000 7f2a02540800 20 remove_watcher() i=1 2024-09-12T17:39:09.957 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.957+0000 7f2a02540800 20 remove_watcher() i=2 2024-09-12T17:39:09.958 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.958+0000 7f2a02540800 20 remove_watcher() i=3 2024-09-12T17:39:09.959 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.959+0000 7f2a02540800 20 remove_watcher() i=4 2024-09-12T17:39:09.960 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.960+0000 7f2a02540800 20 remove_watcher() i=5 2024-09-12T17:39:09.961 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.961+0000 7f2a02540800 20 remove_watcher() i=6 2024-09-12T17:39:09.962 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:09.962+0000 7f2a02540800 20 remove_watcher() i=7 2024-09-12T17:39:09.974 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:39:09.974 INFO:tasks.workunit.client.0.smithi037.stderr:BUCKET_STATS: 2024-09-12T17:39:09.974 INFO:tasks.workunit.client.0.smithi037.stderr:bucket: myver id: 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19 num_objects: 0 size_kb: 0 num_shards: 12 2024-09-12T17:39:09.974 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:39:09.975 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin --inject-delay-at=do_reshard --inject-delay-ms=5000 bucket reshard --bucket myver --num-shards 13 2024-09-12T17:39:10.009 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:39:10.010 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:39:10.049 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:10.048+0000 7ff2ee546800 20 rados->read ofs=0 len=0 2024-09-12T17:39:10.051 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:10.050+0000 7ff2ee546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:10.051 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:10.050+0000 7ff2ee546800 20 realm 2024-09-12T17:39:10.051 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:10.050+0000 7ff2ee546800 20 rados->read ofs=0 len=0 2024-09-12T17:39:10.051 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:10.050+0000 7ff2ee546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:10.051 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:10.050+0000 7ff2ee546800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:39:10.051 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:10.050+0000 7ff2ee546800 20 rados->read ofs=0 len=0 2024-09-12T17:39:10.051 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:10.050+0000 7ff2ee546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:10.052 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:10.050+0000 7ff2ee546800 20 rados->read ofs=0 len=0 2024-09-12T17:39:10.052 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:10.051+0000 7ff2ee546800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:39:10.052 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:10.051+0000 7ff2ee546800 20 rados->read ofs=0 len=0 2024-09-12T17:39:10.053 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:10.052+0000 7ff2ee546800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:39:10.053 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:10.052+0000 7ff2ee546800 20 searching for the correct realm 2024-09-12T17:39:10.055 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:10.055+0000 7ff2eb836640 0 -- 172.21.15.37:0/31783070 >> [v2:172.21.15.40:6800/2441293461,v1:172.21.15.40:6801/2441293461] conn(0x7ff2dc03c070 msgr2=0x7ff2dc001740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:39:10.263 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:10.262+0000 7ff2ec037640 0 -- 172.21.15.37:0/31783070 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7ff2e003eb70 msgr2=0x7ff2e005fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:39:10.470 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:10.469+0000 7ff2ee546800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:39:10.470 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:10.469+0000 7ff2ee546800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:39:10.470 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:10.469+0000 7ff2ee546800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:39:10.470 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:10.469+0000 7ff2ee546800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:39:10.471 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:10.469+0000 7ff2ee546800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:39:10.471 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:10.469+0000 7ff2ee546800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:39:10.471 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:10.469+0000 7ff2ee546800 20 rados->read ofs=0 len=0 2024-09-12T17:39:10.471 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:10.469+0000 7ff2ee546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:10.471 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:10.469+0000 7ff2ee546800 20 rados->read ofs=0 len=0 2024-09-12T17:39:10.472 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:10.470+0000 7ff2ee546800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:39:10.472 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:10.470+0000 7ff2ee546800 20 rados->read ofs=0 len=0 2024-09-12T17:39:10.472 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:10.470+0000 7ff2ee546800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:39:10.472 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:10.471+0000 7ff2ee546800 20 zone default found 2024-09-12T17:39:10.472 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:10.471+0000 7ff2ee546800 4 Realm: () 2024-09-12T17:39:10.472 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:10.471+0000 7ff2ee546800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:39:10.472 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:10.471+0000 7ff2ee546800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:39:10.472 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:10.471+0000 7ff2ee546800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:39:10.473 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:10.471+0000 7ff2ee546800 20 zonegroup default 2024-09-12T17:39:10.473 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:10.471+0000 7ff2ee546800 20 rados->read ofs=0 len=0 2024-09-12T17:39:10.473 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:10.471+0000 7ff2ee546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:10.473 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:10.471+0000 7ff2ee546800 20 rados->read ofs=0 len=0 2024-09-12T17:39:10.474 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:10.472+0000 7ff2ee546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:10.474 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:10.472+0000 7ff2ee546800 20 rados->read ofs=0 len=0 2024-09-12T17:39:10.474 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:10.472+0000 7ff2ee546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:10.474 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:10.472+0000 7ff2ee546800 20 started sync module instance, tier type = 2024-09-12T17:39:10.474 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:10.472+0000 7ff2ee546800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:39:10.484 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:10.483+0000 7ff2ee546800 20 add_watcher() i=0 2024-09-12T17:39:10.484 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:10.483+0000 7ff2ee546800 20 add_watcher() i=1 2024-09-12T17:39:10.484 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:10.483+0000 7ff2ee546800 20 add_watcher() i=2 2024-09-12T17:39:10.484 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:10.483+0000 7ff2ee546800 20 add_watcher() i=3 2024-09-12T17:39:10.484 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:10.483+0000 7ff2ee546800 20 add_watcher() i=4 2024-09-12T17:39:10.484 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:10.483+0000 7ff2ee546800 20 add_watcher() i=5 2024-09-12T17:39:10.484 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:10.483+0000 7ff2ee546800 20 add_watcher() i=6 2024-09-12T17:39:10.485 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:10.484+0000 7ff2ee546800 20 add_watcher() i=7 2024-09-12T17:39:10.485 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:10.484+0000 7ff2ee546800 2 all 8 watchers are set, enabling cache 2024-09-12T17:39:10.487 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:10.486+0000 7ff1a2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:39:10.488 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:10.486+0000 7ff2ee546800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:39:10.488 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:10.486+0000 7ff2ee546800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:39:10.488 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:10.486+0000 7ff2ee546800 5 note: GC not initialized 2024-09-12T17:39:10.488 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:10.487+0000 7ff1a1fdb640 20 reqs_thread_entry: start 2024-09-12T17:39:10.488 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:10.487+0000 7ff2ee546800 20 init_complete bucket index max shards: 11 2024-09-12T17:39:10.488 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:10.487+0000 7ff2ee546800 20 Filter name: none 2024-09-12T17:39:10.488 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:10.487+0000 7ff1137fe640 20 reqs_thread_entry: start 2024-09-12T17:39:10.488 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:10.487+0000 7ff2ee546800 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-12T17:39:10.488 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:10.487+0000 7ff2ee546800 20 rados->read ofs=0 len=0 2024-09-12T17:39:10.489 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:10.488+0000 7ff2ee546800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:39:10.489 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:10.488+0000 7ff2ee546800 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-12T17:39:10.489 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:10.488+0000 7ff2ee546800 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-12T17:39:10.489 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:10.488+0000 7ff2ee546800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19 : miss 2024-09-12T17:39:10.489 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:10.488+0000 7ff2ee546800 20 rados->read ofs=0 len=0 2024-09-12T17:39:10.489 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:10.488+0000 7ff2ee546800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:39:10.490 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:10.488+0000 7ff2ee546800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19 info.flags=0x17 2024-09-12T17:39:10.490 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:10.488+0000 7ff2ee546800 10 adding default.rgw.meta+root+.bucket.meta.myver:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19 to cache LRU end 2024-09-12T17:39:10.490 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:10.488+0000 7ff2ee546800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:39:10.490 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:10.488+0000 7ff2ee546800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:39:10.490 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:10.488+0000 7ff2ee546800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19 2024-09-12T17:39:10.495 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:10.494+0000 7ff2ee546800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19 info.flags=0x17 2024-09-12T17:39:10.495 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:10.494+0000 7ff2ee546800 10 moving default.rgw.meta+root+.bucket.meta.myver:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19 to cache LRU end 2024-09-12T17:39:10.495 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:10.494+0000 7ff2ee546800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:39:10.495 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:10.494+0000 7ff2ee546800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19, ofs0, ns] 2024-09-12T17:39:10.496 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:10.495+0000 7ff1c2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497096 cookie 94158495869664 notifier 8075 bl.length()=905 2024-09-12T17:39:10.496 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:10.495+0000 7ff1c2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19 info.flags=0x17 2024-09-12T17:39:10.496 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:10.495+0000 7ff1c2ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19 to cache LRU end 2024-09-12T17:39:10.496 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:10.495+0000 7ff1c2ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:39:10.497 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:10.497+0000 7ff2ee546800 20 handle_bi_update(): bucket=:myver[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19]): orig_sources= new_sources= 2024-09-12T17:39:10.497 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:10.497+0000 7ff2ee546800 20 handle_bi_update(): bucket=:myver[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19]): potential sources added=[] removed=[] 2024-09-12T17:39:10.497 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:10.497+0000 7ff2ee546800 20 handle_bi_update(): bucket=:myver[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19]): orig_dests= new_dests= 2024-09-12T17:39:10.498 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:10.497+0000 7ff2ee546800 20 handle_bi_update(): bucket=:myver[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19]): potential dests added=[] removed=[] 2024-09-12T17:39:10.503 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:10.502+0000 7ff2ee546800 -1 Injecting delay=5.000000000s at location=do_reshard 2024-09-12T17:39:11.042 INFO:tasks.workunit.client.0.smithi037.stderr:put object successful 2024-09-12T17:39:15.504 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:15.503+0000 7ff2ee546800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.2.0 2024-09-12T17:39:15.504 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:15.503+0000 7ff2ee546800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.2.0 2024-09-12T17:39:15.504 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:15.503+0000 7ff2ee546800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.2.1 2024-09-12T17:39:15.504 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:15.503+0000 7ff2ee546800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.2.1 2024-09-12T17:39:15.505 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:15.503+0000 7ff2ee546800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.2.2 2024-09-12T17:39:15.505 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:15.503+0000 7ff2ee546800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.2.2 2024-09-12T17:39:15.505 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:15.503+0000 7ff2ee546800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.2.3 2024-09-12T17:39:15.505 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:15.503+0000 7ff2ee546800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.2.3 2024-09-12T17:39:15.505 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:15.503+0000 7ff2ee546800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.2.4 2024-09-12T17:39:15.505 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:15.503+0000 7ff2ee546800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.2.4 2024-09-12T17:39:15.505 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:15.503+0000 7ff2ee546800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.2.5 2024-09-12T17:39:15.505 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:15.503+0000 7ff2ee546800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.2.5 2024-09-12T17:39:15.505 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:15.503+0000 7ff2ee546800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.2.6 2024-09-12T17:39:15.505 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:15.503+0000 7ff2ee546800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.2.6 2024-09-12T17:39:15.505 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:15.503+0000 7ff2ee546800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.2.7 2024-09-12T17:39:15.505 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:15.503+0000 7ff2ee546800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.2.7 2024-09-12T17:39:15.506 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:15.503+0000 7ff2ee546800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.2.8 2024-09-12T17:39:15.506 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:15.503+0000 7ff2ee546800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.2.8 2024-09-12T17:39:15.506 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:15.503+0000 7ff2ee546800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.2.9 2024-09-12T17:39:15.506 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:15.503+0000 7ff2ee546800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.2.9 2024-09-12T17:39:15.506 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:15.503+0000 7ff2ee546800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.2.10 2024-09-12T17:39:15.506 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:15.503+0000 7ff2ee546800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.2.10 2024-09-12T17:39:15.506 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:15.503+0000 7ff2ee546800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.2.11 2024-09-12T17:39:15.506 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:15.503+0000 7ff2ee546800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.2.11 2024-09-12T17:39:15.506 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:15.503+0000 7ff2ee546800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.2.12 2024-09-12T17:39:15.506 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:15.503+0000 7ff2ee546800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.2.12 2024-09-12T17:39:15.506 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:15.503+0000 7ff2ee546800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.1.0 2024-09-12T17:39:15.506 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:15.503+0000 7ff2ee546800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.1.0 2024-09-12T17:39:15.506 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:15.503+0000 7ff2ee546800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.1.1 2024-09-12T17:39:15.507 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:15.503+0000 7ff2ee546800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.1.1 2024-09-12T17:39:15.508 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:15.504+0000 7ff2ee546800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.1.2 2024-09-12T17:39:15.508 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:15.504+0000 7ff2ee546800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.1.2 2024-09-12T17:39:15.508 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:15.504+0000 7ff2ee546800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.1.3 2024-09-12T17:39:15.508 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:15.504+0000 7ff2ee546800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.1.3 2024-09-12T17:39:15.508 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:15.505+0000 7ff2ee546800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.1.4 2024-09-12T17:39:15.509 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:15.505+0000 7ff2ee546800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.1.4 2024-09-12T17:39:15.509 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:15.506+0000 7ff2ee546800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.1.5 2024-09-12T17:39:15.509 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:15.506+0000 7ff2ee546800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.1.5 2024-09-12T17:39:15.509 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:15.507+0000 7ff2ee546800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.1.6 2024-09-12T17:39:15.509 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:15.507+0000 7ff2ee546800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.1.6 2024-09-12T17:39:15.509 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:15.507+0000 7ff2ee546800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.1.7 2024-09-12T17:39:15.509 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:15.507+0000 7ff2ee546800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.1.7 2024-09-12T17:39:15.509 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:15.508+0000 7ff2ee546800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.1.8 2024-09-12T17:39:15.510 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:15.508+0000 7ff2ee546800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.1.8 2024-09-12T17:39:15.510 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:15.508+0000 7ff2ee546800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.1.9 2024-09-12T17:39:15.510 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:15.508+0000 7ff2ee546800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.1.9 2024-09-12T17:39:15.510 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:15.509+0000 7ff2ee546800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.1.10 2024-09-12T17:39:15.510 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:15.509+0000 7ff2ee546800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.1.10 2024-09-12T17:39:15.511 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:15.510+0000 7ff2ee546800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.1.11 2024-09-12T17:39:15.511 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:15.510+0000 7ff2ee546800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.1.11 2024-09-12T17:39:15.513 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:15.512+0000 7ff2ee546800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19 : hit (requested=0x17, cached=0x17) 2024-09-12T17:39:15.513 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:15.512+0000 7ff2ee546800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19 2024-09-12T17:39:15.515 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:15.514+0000 7ff2ee546800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19 info.flags=0x17 2024-09-12T17:39:15.515 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:15.514+0000 7ff2ee546800 10 moving default.rgw.meta+root+.bucket.meta.myver:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19 to cache LRU end 2024-09-12T17:39:15.515 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:15.514+0000 7ff2ee546800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:39:15.515 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:15.514+0000 7ff2ee546800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19, ofs0, ns] 2024-09-12T17:39:15.516 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:15.515+0000 7ff1c2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497097 cookie 94158495869664 notifier 8075 bl.length()=905 2024-09-12T17:39:15.516 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:15.515+0000 7ff1c2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19 info.flags=0x17 2024-09-12T17:39:15.516 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:15.515+0000 7ff1c2ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19 to cache LRU end 2024-09-12T17:39:15.516 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:15.515+0000 7ff1c2ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:39:15.517 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:15.517+0000 7ff2ee546800 20 handle_bi_update(): bucket=:myver[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19]): orig_sources= new_sources= 2024-09-12T17:39:15.518 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:15.517+0000 7ff2ee546800 20 handle_bi_update(): bucket=:myver[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19]): potential sources added=[] removed=[] 2024-09-12T17:39:15.518 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:15.517+0000 7ff2ee546800 20 handle_bi_update(): bucket=:myver[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19]): orig_dests= new_dests= 2024-09-12T17:39:15.518 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:15.517+0000 7ff2ee546800 20 handle_bi_update(): bucket=:myver[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19]): potential dests added=[] removed=[] 2024-09-12T17:39:15.521 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:15.520+0000 7ff2ee546800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.1.0 2024-09-12T17:39:15.521 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:15.520+0000 7ff2ee546800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.1.0 2024-09-12T17:39:15.521 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:15.521+0000 7ff2ee546800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.1.1 2024-09-12T17:39:15.521 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:15.521+0000 7ff2ee546800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.1.1 2024-09-12T17:39:15.522 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:15.521+0000 7ff2ee546800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.1.2 2024-09-12T17:39:15.522 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:15.521+0000 7ff2ee546800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.1.2 2024-09-12T17:39:15.522 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:15.522+0000 7ff2ee546800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.1.3 2024-09-12T17:39:15.522 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:15.522+0000 7ff2ee546800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.1.3 2024-09-12T17:39:15.523 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:15.522+0000 7ff2ee546800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.1.4 2024-09-12T17:39:15.523 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:15.522+0000 7ff2ee546800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.1.4 2024-09-12T17:39:15.523 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:15.522+0000 7ff2ee546800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.1.5 2024-09-12T17:39:15.523 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:15.522+0000 7ff2ee546800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.1.5 2024-09-12T17:39:15.524 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:15.523+0000 7ff2ee546800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.1.6 2024-09-12T17:39:15.524 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:15.523+0000 7ff2ee546800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.1.6 2024-09-12T17:39:15.524 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:15.523+0000 7ff2ee546800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.1.7 2024-09-12T17:39:15.524 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:15.523+0000 7ff2ee546800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.1.7 2024-09-12T17:39:15.524 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:15.524+0000 7ff2ee546800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.1.8 2024-09-12T17:39:15.524 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:15.524+0000 7ff2ee546800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.1.8 2024-09-12T17:39:15.525 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:15.524+0000 7ff2ee546800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.1.9 2024-09-12T17:39:15.525 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:15.524+0000 7ff2ee546800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.1.9 2024-09-12T17:39:15.525 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:15.525+0000 7ff2ee546800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.1.10 2024-09-12T17:39:15.525 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:15.525+0000 7ff2ee546800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.1.10 2024-09-12T17:39:15.526 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:15.525+0000 7ff2ee546800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.1.11 2024-09-12T17:39:15.526 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:15.525+0000 7ff2ee546800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.1.11 2024-09-12T17:39:15.528 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:15.527+0000 7ff2ee546800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19 : hit (requested=0x17, cached=0x17) 2024-09-12T17:39:15.528 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:15.527+0000 7ff2ee546800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19 2024-09-12T17:39:15.530 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:15.529+0000 7ff2ee546800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19 info.flags=0x17 2024-09-12T17:39:15.530 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:15.529+0000 7ff2ee546800 10 moving default.rgw.meta+root+.bucket.meta.myver:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19 to cache LRU end 2024-09-12T17:39:15.530 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:15.529+0000 7ff2ee546800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:39:15.530 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:15.529+0000 7ff2ee546800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19, ofs0, ns] 2024-09-12T17:39:15.530 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:15.529+0000 7ff1c37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497098 cookie 94158495869664 notifier 8075 bl.length()=873 2024-09-12T17:39:15.531 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:15.529+0000 7ff1c37fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19 info.flags=0x17 2024-09-12T17:39:15.531 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:15.529+0000 7ff1c37fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19 to cache LRU end 2024-09-12T17:39:15.531 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:15.529+0000 7ff1c37fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:39:15.532 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:15.531+0000 7ff2ee546800 20 handle_bi_update(): bucket=:myver[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19]): orig_sources= new_sources= 2024-09-12T17:39:15.532 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:15.531+0000 7ff2ee546800 20 handle_bi_update(): bucket=:myver[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19]): potential sources added=[] removed=[] 2024-09-12T17:39:15.532 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:15.531+0000 7ff2ee546800 20 handle_bi_update(): bucket=:myver[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19]): orig_dests= new_dests= 2024-09-12T17:39:15.532 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:15.531+0000 7ff2ee546800 20 handle_bi_update(): bucket=:myver[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19]): potential dests added=[] removed=[] 2024-09-12T17:39:15.535 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:15.535+0000 7ff2ee546800 1 execute INFO: reshard of bucket "myver" from 12 shards to 13 shards completed successfully 2024-09-12T17:39:15.538 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:15.537+0000 7ff1a2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:39:15.540 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:15.540+0000 7ff2ee546800 20 remove_watcher() i=0 2024-09-12T17:39:15.540 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:15.540+0000 7ff2ee546800 2 removed watcher, disabling cache 2024-09-12T17:39:15.542 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:15.541+0000 7ff2ee546800 20 remove_watcher() i=1 2024-09-12T17:39:15.543 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:15.542+0000 7ff2ee546800 20 remove_watcher() i=2 2024-09-12T17:39:15.544 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:15.544+0000 7ff2ee546800 20 remove_watcher() i=3 2024-09-12T17:39:15.545 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:15.545+0000 7ff2ee546800 20 remove_watcher() i=4 2024-09-12T17:39:15.547 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:15.546+0000 7ff2ee546800 20 remove_watcher() i=5 2024-09-12T17:39:15.548 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:15.547+0000 7ff2ee546800 20 remove_watcher() i=6 2024-09-12T17:39:15.549 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:15.549+0000 7ff2ee546800 20 remove_watcher() i=7 2024-09-12T17:39:16.046 INFO:tasks.workunit.client.0.smithi037.stderr:TEST: check that bucket stats are correct after reshard with unlinked entries 2024-09-12T17:39:16.047 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T17:39:16.379 INFO:tasks.workunit.client.0.smithi037.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-12T17:39:16.792 INFO:tasks.workunit.client.0.smithi037.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-09-12T17:39:18.294 INFO:tasks.workunit.client.0.smithi037.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T17:39:18.296 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bi list --bucket myver --object x 2024-09-12T17:39:18.330 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:39:18.330 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:39:18.373 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.371+0000 7fad8391f800 20 rados->read ofs=0 len=0 2024-09-12T17:39:18.375 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.373+0000 7fad8391f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:18.375 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.373+0000 7fad8391f800 20 realm 2024-09-12T17:39:18.375 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.373+0000 7fad8391f800 20 rados->read ofs=0 len=0 2024-09-12T17:39:18.375 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.373+0000 7fad8391f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:18.375 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.373+0000 7fad8391f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:39:18.375 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.373+0000 7fad8391f800 20 rados->read ofs=0 len=0 2024-09-12T17:39:18.375 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.373+0000 7fad8391f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:18.375 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.373+0000 7fad8391f800 20 rados->read ofs=0 len=0 2024-09-12T17:39:18.376 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.374+0000 7fad8391f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:39:18.376 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.374+0000 7fad8391f800 20 rados->read ofs=0 len=0 2024-09-12T17:39:18.376 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.375+0000 7fad8391f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:39:18.376 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.375+0000 7fad8391f800 20 searching for the correct realm 2024-09-12T17:39:18.379 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.378+0000 7fad7eea8640 0 -- 172.21.15.37:0/1808733818 >> [v2:172.21.15.40:6800/2441293461,v1:172.21.15.40:6801/2441293461] conn(0x7fad7006d030 msgr2=0x7fad70019450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:39:18.384 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.382+0000 7fad7f6a9640 0 -- 172.21.15.37:0/1808733818 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7fad740a0140 msgr2=0x7fad74038870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:39:18.590 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.588+0000 7fad8391f800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:39:18.591 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.588+0000 7fad8391f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:39:18.591 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.588+0000 7fad8391f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:39:18.591 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.588+0000 7fad8391f800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:39:18.591 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.588+0000 7fad8391f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:39:18.591 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.588+0000 7fad8391f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:39:18.591 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.588+0000 7fad8391f800 20 rados->read ofs=0 len=0 2024-09-12T17:39:18.591 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.589+0000 7fad8391f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:18.592 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.589+0000 7fad8391f800 20 rados->read ofs=0 len=0 2024-09-12T17:39:18.593 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.589+0000 7fad8391f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:39:18.593 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.589+0000 7fad8391f800 20 rados->read ofs=0 len=0 2024-09-12T17:39:18.593 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.590+0000 7fad8391f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:39:18.593 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.590+0000 7fad8391f800 20 zone default found 2024-09-12T17:39:18.593 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.590+0000 7fad8391f800 4 Realm: () 2024-09-12T17:39:18.593 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.590+0000 7fad8391f800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:39:18.593 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.590+0000 7fad8391f800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:39:18.593 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.590+0000 7fad8391f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:39:18.593 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.590+0000 7fad8391f800 20 zonegroup default 2024-09-12T17:39:18.593 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.590+0000 7fad8391f800 20 rados->read ofs=0 len=0 2024-09-12T17:39:18.593 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.590+0000 7fad8391f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:18.594 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.590+0000 7fad8391f800 20 rados->read ofs=0 len=0 2024-09-12T17:39:18.594 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.590+0000 7fad8391f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:18.594 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.590+0000 7fad8391f800 20 rados->read ofs=0 len=0 2024-09-12T17:39:18.594 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.590+0000 7fad8391f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:18.594 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.590+0000 7fad8391f800 20 started sync module instance, tier type = 2024-09-12T17:39:18.594 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.590+0000 7fad8391f800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:39:18.603 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.601+0000 7fad8391f800 20 add_watcher() i=0 2024-09-12T17:39:18.603 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.601+0000 7fad8391f800 20 add_watcher() i=1 2024-09-12T17:39:18.603 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.601+0000 7fad8391f800 20 add_watcher() i=2 2024-09-12T17:39:18.603 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.601+0000 7fad8391f800 20 add_watcher() i=3 2024-09-12T17:39:18.603 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.601+0000 7fad8391f800 20 add_watcher() i=4 2024-09-12T17:39:18.603 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.601+0000 7fad8391f800 20 add_watcher() i=5 2024-09-12T17:39:18.603 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.601+0000 7fad8391f800 20 add_watcher() i=6 2024-09-12T17:39:18.604 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.602+0000 7fad8391f800 20 add_watcher() i=7 2024-09-12T17:39:18.604 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.602+0000 7fad8391f800 2 all 8 watchers are set, enabling cache 2024-09-12T17:39:18.606 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.604+0000 7fac367e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:39:18.607 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.605+0000 7fad8391f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:39:18.607 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.605+0000 7fad8391f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:39:18.607 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.605+0000 7fad8391f800 5 note: GC not initialized 2024-09-12T17:39:18.607 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.605+0000 7fac357e2640 20 reqs_thread_entry: start 2024-09-12T17:39:18.607 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.605+0000 7fad8391f800 20 init_complete bucket index max shards: 11 2024-09-12T17:39:18.607 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.605+0000 7fad8391f800 20 Filter name: none 2024-09-12T17:39:18.607 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.605+0000 7fac2e7fc640 20 reqs_thread_entry: start 2024-09-12T17:39:18.607 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.605+0000 7fad8391f800 20 rados->read ofs=0 len=0 2024-09-12T17:39:18.608 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.606+0000 7fad8391f800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:39:18.608 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.606+0000 7fad8391f800 20 rados->read ofs=0 len=0 2024-09-12T17:39:18.609 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.607+0000 7fad8391f800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:39:18.609 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.607+0000 7fad8391f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:39:18.609 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.607+0000 7fad8391f800 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2024-09-12T17:39:18.609 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.607+0000 7fad8391f800 20 INFO: main: starting shard=0 2024-09-12T17:39:18.609 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.607+0000 7fad8391f800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.2.0 2024-09-12T17:39:18.609 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.607+0000 7fad8391f800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.2.0 2024-09-12T17:39:18.610 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.607+0000 7fad8391f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:39:18.610 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.607+0000 7fad8391f800 20 INFO: main: starting shard=1 2024-09-12T17:39:18.610 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.607+0000 7fad8391f800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.2.1 2024-09-12T17:39:18.610 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.607+0000 7fad8391f800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.2.1 2024-09-12T17:39:18.610 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.608+0000 7fad8391f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:39:18.610 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.608+0000 7fad8391f800 20 INFO: main: starting shard=2 2024-09-12T17:39:18.610 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.608+0000 7fad8391f800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.2.2 2024-09-12T17:39:18.610 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.608+0000 7fad8391f800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.2.2 2024-09-12T17:39:18.611 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.608+0000 7fad8391f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:39:18.611 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.608+0000 7fad8391f800 20 INFO: main: starting shard=3 2024-09-12T17:39:18.611 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.608+0000 7fad8391f800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.2.3 2024-09-12T17:39:18.611 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.608+0000 7fad8391f800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.2.3 2024-09-12T17:39:18.611 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.609+0000 7fad8391f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:39:18.611 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.609+0000 7fad8391f800 20 INFO: main: starting shard=4 2024-09-12T17:39:18.611 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.609+0000 7fad8391f800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.2.4 2024-09-12T17:39:18.611 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.609+0000 7fad8391f800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.2.4 2024-09-12T17:39:18.612 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.610+0000 7fad8391f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:39:18.612 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.610+0000 7fad8391f800 20 INFO: main: starting shard=5 2024-09-12T17:39:18.612 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.610+0000 7fad8391f800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.2.5 2024-09-12T17:39:18.613 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.610+0000 7fad8391f800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.2.5 2024-09-12T17:39:18.613 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.610+0000 7fad8391f800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T17:39:18.613 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.610+0000 7fad8391f800 20 INFO: main: starting shard=6 2024-09-12T17:39:18.613 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.610+0000 7fad8391f800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.2.6 2024-09-12T17:39:18.613 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.610+0000 7fad8391f800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.2.6 2024-09-12T17:39:18.613 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.611+0000 7fad8391f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:39:18.613 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.611+0000 7fad8391f800 20 INFO: main: starting shard=7 2024-09-12T17:39:18.613 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.611+0000 7fad8391f800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.2.7 2024-09-12T17:39:18.613 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.611+0000 7fad8391f800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.2.7 2024-09-12T17:39:18.614 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.611+0000 7fad8391f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:39:18.614 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.611+0000 7fad8391f800 20 INFO: main: starting shard=8 2024-09-12T17:39:18.614 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.611+0000 7fad8391f800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.2.8 2024-09-12T17:39:18.614 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.611+0000 7fad8391f800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.2.8 2024-09-12T17:39:18.614 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.612+0000 7fad8391f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:39:18.614 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.612+0000 7fad8391f800 20 INFO: main: starting shard=9 2024-09-12T17:39:18.614 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.612+0000 7fad8391f800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.2.9 2024-09-12T17:39:18.614 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.612+0000 7fad8391f800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.2.9 2024-09-12T17:39:18.615 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.613+0000 7fad8391f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:39:18.615 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.613+0000 7fad8391f800 20 INFO: main: starting shard=10 2024-09-12T17:39:18.615 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.613+0000 7fad8391f800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.2.10 2024-09-12T17:39:18.615 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.613+0000 7fad8391f800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.2.10 2024-09-12T17:39:18.615 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.613+0000 7fad8391f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:39:18.615 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.613+0000 7fad8391f800 20 INFO: main: starting shard=11 2024-09-12T17:39:18.615 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.613+0000 7fad8391f800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.2.11 2024-09-12T17:39:18.615 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.613+0000 7fad8391f800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.2.11 2024-09-12T17:39:18.616 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.614+0000 7fad8391f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:39:18.616 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.614+0000 7fad8391f800 20 INFO: main: starting shard=12 2024-09-12T17:39:18.616 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.614+0000 7fad8391f800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.2.12 2024-09-12T17:39:18.616 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.614+0000 7fad8391f800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.2.12 2024-09-12T17:39:18.616 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.614+0000 7fad8391f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:39:18.616 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.614+0000 7fad8391f800 20 INFO: main: done 2024-09-12T17:39:18.617 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.615+0000 7fac367e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:39:18.620 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.618+0000 7fad8391f800 20 remove_watcher() i=0 2024-09-12T17:39:18.620 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.618+0000 7fad8391f800 2 removed watcher, disabling cache 2024-09-12T17:39:18.621 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.619+0000 7fad8391f800 20 remove_watcher() i=1 2024-09-12T17:39:18.622 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.620+0000 7fad8391f800 20 remove_watcher() i=2 2024-09-12T17:39:18.623 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.621+0000 7fad8391f800 20 remove_watcher() i=3 2024-09-12T17:39:18.624 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.623+0000 7fad8391f800 20 remove_watcher() i=4 2024-09-12T17:39:18.625 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.624+0000 7fad8391f800 20 remove_watcher() i=5 2024-09-12T17:39:18.626 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.625+0000 7fad8391f800 20 remove_watcher() i=6 2024-09-12T17:39:18.627 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.626+0000 7fad8391f800 20 remove_watcher() i=7 2024-09-12T17:39:18.747 INFO:tasks.workunit.client.0.smithi037.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T17:39:18.748 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bi list --bucket myver --object y 2024-09-12T17:39:18.780 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:39:18.781 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:39:18.819 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.817+0000 7f7315d23800 20 rados->read ofs=0 len=0 2024-09-12T17:39:18.821 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.819+0000 7f7315d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:18.821 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.819+0000 7f7315d23800 20 realm 2024-09-12T17:39:18.822 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.819+0000 7f7315d23800 20 rados->read ofs=0 len=0 2024-09-12T17:39:18.822 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.820+0000 7f7315d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:18.822 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.820+0000 7f7315d23800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:39:18.822 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.820+0000 7f7315d23800 20 rados->read ofs=0 len=0 2024-09-12T17:39:18.822 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.820+0000 7f7315d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:18.822 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.820+0000 7f7315d23800 20 rados->read ofs=0 len=0 2024-09-12T17:39:18.822 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.821+0000 7f7315d23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:39:18.822 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.821+0000 7f7315d23800 20 rados->read ofs=0 len=0 2024-09-12T17:39:18.823 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.821+0000 7f7315d23800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:39:18.823 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.821+0000 7f7315d23800 20 searching for the correct realm 2024-09-12T17:39:18.827 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.825+0000 7f731120b640 0 -- 172.21.15.37:0/3341991468 >> [v2:172.21.15.40:6800/2441293461,v1:172.21.15.40:6801/2441293461] conn(0x7f7304027040 msgr2=0x7f7304049410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:39:18.831 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.829+0000 7f731120b640 0 -- 172.21.15.37:0/3341991468 >> [v2:172.21.15.40:6800/2441293461,v1:172.21.15.40:6801/2441293461] conn(0x7f71dc086a90 msgr2=0x7f71dc088ec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:39:18.835 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.833+0000 7f7315d23800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:39:18.835 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.833+0000 7f7315d23800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:39:18.835 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.833+0000 7f7315d23800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:39:18.835 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.833+0000 7f7315d23800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:39:18.835 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.833+0000 7f7315d23800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:39:18.835 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.833+0000 7f7315d23800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:39:18.835 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.833+0000 7f7315d23800 20 rados->read ofs=0 len=0 2024-09-12T17:39:18.836 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.833+0000 7f7315d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:18.836 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.833+0000 7f7315d23800 20 rados->read ofs=0 len=0 2024-09-12T17:39:18.837 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.834+0000 7f7315d23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:39:18.837 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.834+0000 7f7315d23800 20 rados->read ofs=0 len=0 2024-09-12T17:39:18.837 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.834+0000 7f7315d23800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:39:18.837 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.834+0000 7f7315d23800 20 zone default found 2024-09-12T17:39:18.837 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.834+0000 7f7315d23800 4 Realm: () 2024-09-12T17:39:18.837 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.834+0000 7f7315d23800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:39:18.837 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.834+0000 7f7315d23800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:39:18.837 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.834+0000 7f7315d23800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:39:18.837 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.834+0000 7f7315d23800 20 zonegroup default 2024-09-12T17:39:18.837 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.834+0000 7f7315d23800 20 rados->read ofs=0 len=0 2024-09-12T17:39:18.837 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.834+0000 7f7315d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:18.838 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.834+0000 7f7315d23800 20 rados->read ofs=0 len=0 2024-09-12T17:39:18.838 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.835+0000 7f7315d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:18.838 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.835+0000 7f7315d23800 20 rados->read ofs=0 len=0 2024-09-12T17:39:18.838 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.835+0000 7f7315d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:18.838 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.835+0000 7f7315d23800 20 started sync module instance, tier type = 2024-09-12T17:39:18.838 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.835+0000 7f7315d23800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:39:18.847 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.845+0000 7f7315d23800 20 add_watcher() i=0 2024-09-12T17:39:18.847 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.845+0000 7f7315d23800 20 add_watcher() i=1 2024-09-12T17:39:18.847 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.845+0000 7f7315d23800 20 add_watcher() i=2 2024-09-12T17:39:18.847 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.845+0000 7f7315d23800 20 add_watcher() i=3 2024-09-12T17:39:18.847 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.845+0000 7f7315d23800 20 add_watcher() i=4 2024-09-12T17:39:18.847 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.845+0000 7f7315d23800 20 add_watcher() i=5 2024-09-12T17:39:18.847 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.845+0000 7f7315d23800 20 add_watcher() i=6 2024-09-12T17:39:18.848 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.846+0000 7f7315d23800 20 add_watcher() i=7 2024-09-12T17:39:18.848 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.846+0000 7f7315d23800 2 all 8 watchers are set, enabling cache 2024-09-12T17:39:18.849 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.848+0000 7f71c3fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:39:18.850 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.848+0000 7f7315d23800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:39:18.851 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.848+0000 7f7315d23800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:39:18.851 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.848+0000 7f7315d23800 5 note: GC not initialized 2024-09-12T17:39:18.851 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.848+0000 7f71c2ffd640 20 reqs_thread_entry: start 2024-09-12T17:39:18.851 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.849+0000 7f7315d23800 20 init_complete bucket index max shards: 11 2024-09-12T17:39:18.851 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.849+0000 7f7315d23800 20 Filter name: none 2024-09-12T17:39:18.851 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.849+0000 7f71c0ff9640 20 reqs_thread_entry: start 2024-09-12T17:39:18.851 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.849+0000 7f7315d23800 20 rados->read ofs=0 len=0 2024-09-12T17:39:18.851 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.850+0000 7f7315d23800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:39:18.851 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.850+0000 7f7315d23800 20 rados->read ofs=0 len=0 2024-09-12T17:39:18.852 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.850+0000 7f7315d23800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:39:18.852 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.850+0000 7f7315d23800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:39:18.852 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.850+0000 7f7315d23800 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2024-09-12T17:39:18.852 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.850+0000 7f7315d23800 20 INFO: main: starting shard=0 2024-09-12T17:39:18.852 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.850+0000 7f7315d23800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.2.0 2024-09-12T17:39:18.852 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.850+0000 7f7315d23800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.2.0 2024-09-12T17:39:18.853 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.851+0000 7f7315d23800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:39:18.853 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.851+0000 7f7315d23800 20 INFO: main: starting shard=1 2024-09-12T17:39:18.853 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.851+0000 7f7315d23800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.2.1 2024-09-12T17:39:18.853 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.851+0000 7f7315d23800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.2.1 2024-09-12T17:39:18.853 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.851+0000 7f7315d23800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:39:18.854 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.851+0000 7f7315d23800 20 INFO: main: starting shard=2 2024-09-12T17:39:18.854 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.851+0000 7f7315d23800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.2.2 2024-09-12T17:39:18.854 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.851+0000 7f7315d23800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.2.2 2024-09-12T17:39:18.854 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.852+0000 7f7315d23800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:39:18.854 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.852+0000 7f7315d23800 20 INFO: main: starting shard=3 2024-09-12T17:39:18.854 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.852+0000 7f7315d23800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.2.3 2024-09-12T17:39:18.854 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.852+0000 7f7315d23800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.2.3 2024-09-12T17:39:18.854 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.853+0000 7f7315d23800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:39:18.855 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.853+0000 7f7315d23800 20 INFO: main: starting shard=4 2024-09-12T17:39:18.855 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.853+0000 7f7315d23800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.2.4 2024-09-12T17:39:18.855 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.853+0000 7f7315d23800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.2.4 2024-09-12T17:39:18.855 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.853+0000 7f7315d23800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:39:18.856 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.853+0000 7f7315d23800 20 INFO: main: starting shard=5 2024-09-12T17:39:18.856 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.853+0000 7f7315d23800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.2.5 2024-09-12T17:39:18.856 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.853+0000 7f7315d23800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.2.5 2024-09-12T17:39:18.856 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.853+0000 7f7315d23800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:39:18.856 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.853+0000 7f7315d23800 20 INFO: main: starting shard=6 2024-09-12T17:39:18.856 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.853+0000 7f7315d23800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.2.6 2024-09-12T17:39:18.856 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.853+0000 7f7315d23800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.2.6 2024-09-12T17:39:18.857 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.854+0000 7f7315d23800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:39:18.857 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.854+0000 7f7315d23800 20 INFO: main: starting shard=7 2024-09-12T17:39:18.857 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.854+0000 7f7315d23800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.2.7 2024-09-12T17:39:18.857 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.854+0000 7f7315d23800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.2.7 2024-09-12T17:39:18.857 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.855+0000 7f7315d23800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:39:18.857 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.855+0000 7f7315d23800 20 INFO: main: starting shard=8 2024-09-12T17:39:18.857 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.855+0000 7f7315d23800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.2.8 2024-09-12T17:39:18.857 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.855+0000 7f7315d23800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.2.8 2024-09-12T17:39:18.857 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.855+0000 7f7315d23800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:39:18.857 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.855+0000 7f7315d23800 20 INFO: main: starting shard=9 2024-09-12T17:39:18.858 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.855+0000 7f7315d23800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.2.9 2024-09-12T17:39:18.858 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.855+0000 7f7315d23800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.2.9 2024-09-12T17:39:18.858 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.856+0000 7f7315d23800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T17:39:18.858 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.856+0000 7f7315d23800 20 INFO: main: starting shard=10 2024-09-12T17:39:18.858 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.856+0000 7f7315d23800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.2.10 2024-09-12T17:39:18.858 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.856+0000 7f7315d23800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.2.10 2024-09-12T17:39:18.858 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.856+0000 7f7315d23800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:39:18.858 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.856+0000 7f7315d23800 20 INFO: main: starting shard=11 2024-09-12T17:39:18.859 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.856+0000 7f7315d23800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.2.11 2024-09-12T17:39:18.859 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.856+0000 7f7315d23800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.2.11 2024-09-12T17:39:18.859 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.857+0000 7f7315d23800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:39:18.859 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.857+0000 7f7315d23800 20 INFO: main: starting shard=12 2024-09-12T17:39:18.859 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.857+0000 7f7315d23800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.2.12 2024-09-12T17:39:18.859 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.857+0000 7f7315d23800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.2.12 2024-09-12T17:39:18.860 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.858+0000 7f7315d23800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:39:18.860 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.858+0000 7f7315d23800 20 INFO: main: done 2024-09-12T17:39:18.860 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.858+0000 7f71c3fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:39:18.865 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.861+0000 7f7315d23800 20 remove_watcher() i=0 2024-09-12T17:39:18.866 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.861+0000 7f7315d23800 2 removed watcher, disabling cache 2024-09-12T17:39:18.866 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.862+0000 7f7315d23800 20 remove_watcher() i=1 2024-09-12T17:39:18.866 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.863+0000 7f7315d23800 20 remove_watcher() i=2 2024-09-12T17:39:18.866 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.865+0000 7f7315d23800 20 remove_watcher() i=3 2024-09-12T17:39:18.868 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.866+0000 7f7315d23800 20 remove_watcher() i=4 2024-09-12T17:39:18.869 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.867+0000 7f7315d23800 20 remove_watcher() i=5 2024-09-12T17:39:18.870 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.868+0000 7f7315d23800 20 remove_watcher() i=6 2024-09-12T17:39:18.871 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:18.869+0000 7f7315d23800 20 remove_watcher() i=7 2024-09-12T17:39:18.988 INFO:tasks.workunit.client.0.smithi037.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T17:39:18.989 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bi list --bucket myver --object z 2024-09-12T17:39:19.022 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:39:19.022 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:39:19.061 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:19.059+0000 7fb878840800 20 rados->read ofs=0 len=0 2024-09-12T17:39:19.063 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:19.061+0000 7fb878840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:19.063 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:19.061+0000 7fb878840800 20 realm 2024-09-12T17:39:19.064 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:19.061+0000 7fb878840800 20 rados->read ofs=0 len=0 2024-09-12T17:39:19.064 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:19.061+0000 7fb878840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:19.064 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:19.061+0000 7fb878840800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:39:19.064 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:19.061+0000 7fb878840800 20 rados->read ofs=0 len=0 2024-09-12T17:39:19.064 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:19.062+0000 7fb878840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:19.064 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:19.062+0000 7fb878840800 20 rados->read ofs=0 len=0 2024-09-12T17:39:19.065 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:19.062+0000 7fb878840800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:39:19.066 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:19.062+0000 7fb878840800 20 rados->read ofs=0 len=0 2024-09-12T17:39:19.066 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:19.063+0000 7fb878840800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:39:19.066 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:19.063+0000 7fb878840800 20 searching for the correct realm 2024-09-12T17:39:19.068 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:19.066+0000 7fb876b2b640 0 -- 172.21.15.37:0/2478844726 >> [v2:172.21.15.40:6818/1210108009,v1:172.21.15.40:6819/1210108009] conn(0x7fb86c06b020 msgr2=0x7fb86c0baaa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:39:19.072 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:19.070+0000 7fb87632a640 0 -- 172.21.15.37:0/2478844726 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7fb86c0639a0 msgr2=0x7fb86c007c20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:39:19.279 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:19.276+0000 7fb878840800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:39:19.279 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:19.276+0000 7fb878840800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:39:19.279 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:19.276+0000 7fb878840800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:39:19.279 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:19.276+0000 7fb878840800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:39:19.279 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:19.276+0000 7fb878840800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:39:19.279 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:19.276+0000 7fb878840800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:39:19.279 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:19.276+0000 7fb878840800 20 rados->read ofs=0 len=0 2024-09-12T17:39:19.280 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:19.277+0000 7fb878840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:19.280 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:19.277+0000 7fb878840800 20 rados->read ofs=0 len=0 2024-09-12T17:39:19.281 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:19.277+0000 7fb878840800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:39:19.281 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:19.277+0000 7fb878840800 20 rados->read ofs=0 len=0 2024-09-12T17:39:19.281 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:19.278+0000 7fb878840800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:39:19.281 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:19.278+0000 7fb878840800 20 zone default found 2024-09-12T17:39:19.281 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:19.278+0000 7fb878840800 4 Realm: () 2024-09-12T17:39:19.281 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:19.278+0000 7fb878840800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:39:19.281 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:19.278+0000 7fb878840800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:39:19.281 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:19.278+0000 7fb878840800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:39:19.281 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:19.278+0000 7fb878840800 20 zonegroup default 2024-09-12T17:39:19.281 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:19.278+0000 7fb878840800 20 rados->read ofs=0 len=0 2024-09-12T17:39:19.281 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:19.278+0000 7fb878840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:19.284 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:19.278+0000 7fb878840800 20 rados->read ofs=0 len=0 2024-09-12T17:39:19.284 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:19.278+0000 7fb878840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:19.284 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:19.278+0000 7fb878840800 20 rados->read ofs=0 len=0 2024-09-12T17:39:19.284 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:19.279+0000 7fb878840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:19.284 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:19.279+0000 7fb878840800 20 started sync module instance, tier type = 2024-09-12T17:39:19.284 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:19.279+0000 7fb878840800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:39:19.291 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:19.289+0000 7fb878840800 20 add_watcher() i=0 2024-09-12T17:39:19.292 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:19.289+0000 7fb878840800 20 add_watcher() i=1 2024-09-12T17:39:19.292 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:19.289+0000 7fb878840800 20 add_watcher() i=2 2024-09-12T17:39:19.292 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:19.289+0000 7fb878840800 20 add_watcher() i=3 2024-09-12T17:39:19.292 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:19.289+0000 7fb878840800 20 add_watcher() i=4 2024-09-12T17:39:19.292 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:19.289+0000 7fb878840800 20 add_watcher() i=5 2024-09-12T17:39:19.292 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:19.289+0000 7fb878840800 20 add_watcher() i=6 2024-09-12T17:39:19.292 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:19.290+0000 7fb878840800 20 add_watcher() i=7 2024-09-12T17:39:19.292 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:19.290+0000 7fb878840800 2 all 8 watchers are set, enabling cache 2024-09-12T17:39:19.294 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:19.292+0000 7fb72cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:39:19.295 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:19.293+0000 7fb878840800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:39:19.295 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:19.293+0000 7fb878840800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:39:19.295 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:19.293+0000 7fb878840800 5 note: GC not initialized 2024-09-12T17:39:19.295 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:19.293+0000 7fb6a77fe640 20 reqs_thread_entry: start 2024-09-12T17:39:19.296 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:19.293+0000 7fb878840800 20 init_complete bucket index max shards: 11 2024-09-12T17:39:19.296 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:19.293+0000 7fb878840800 20 Filter name: none 2024-09-12T17:39:19.297 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:19.293+0000 7fb6a57fa640 20 reqs_thread_entry: start 2024-09-12T17:39:19.297 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:19.293+0000 7fb878840800 20 rados->read ofs=0 len=0 2024-09-12T17:39:19.297 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:19.294+0000 7fb878840800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:39:19.297 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:19.294+0000 7fb878840800 20 rados->read ofs=0 len=0 2024-09-12T17:39:19.297 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:19.294+0000 7fb878840800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:39:19.297 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:19.294+0000 7fb878840800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:39:19.297 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:19.294+0000 7fb878840800 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2024-09-12T17:39:19.297 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:19.294+0000 7fb878840800 20 INFO: main: starting shard=0 2024-09-12T17:39:19.297 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:19.294+0000 7fb878840800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.2.0 2024-09-12T17:39:19.297 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:19.294+0000 7fb878840800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.2.0 2024-09-12T17:39:19.298 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:19.295+0000 7fb878840800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T17:39:19.298 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:19.295+0000 7fb878840800 20 INFO: main: starting shard=1 2024-09-12T17:39:19.298 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:19.295+0000 7fb878840800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.2.1 2024-09-12T17:39:19.298 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:19.295+0000 7fb878840800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.2.1 2024-09-12T17:39:19.298 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:19.295+0000 7fb878840800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:39:19.298 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:19.295+0000 7fb878840800 20 INFO: main: starting shard=2 2024-09-12T17:39:19.299 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:19.295+0000 7fb878840800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.2.2 2024-09-12T17:39:19.299 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:19.295+0000 7fb878840800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.2.2 2024-09-12T17:39:19.299 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:19.296+0000 7fb878840800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:39:19.299 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:19.296+0000 7fb878840800 20 INFO: main: starting shard=3 2024-09-12T17:39:19.299 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:19.296+0000 7fb878840800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.2.3 2024-09-12T17:39:19.299 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:19.296+0000 7fb878840800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.2.3 2024-09-12T17:39:19.299 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:19.296+0000 7fb878840800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:39:19.299 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:19.296+0000 7fb878840800 20 INFO: main: starting shard=4 2024-09-12T17:39:19.299 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:19.296+0000 7fb878840800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.2.4 2024-09-12T17:39:19.299 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:19.296+0000 7fb878840800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.2.4 2024-09-12T17:39:19.300 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:19.297+0000 7fb878840800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:39:19.300 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:19.297+0000 7fb878840800 20 INFO: main: starting shard=5 2024-09-12T17:39:19.300 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:19.297+0000 7fb878840800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.2.5 2024-09-12T17:39:19.300 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:19.297+0000 7fb878840800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.2.5 2024-09-12T17:39:19.300 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:19.297+0000 7fb878840800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:39:19.300 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:19.297+0000 7fb878840800 20 INFO: main: starting shard=6 2024-09-12T17:39:19.300 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:19.297+0000 7fb878840800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.2.6 2024-09-12T17:39:19.301 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:19.297+0000 7fb878840800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.2.6 2024-09-12T17:39:19.301 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:19.298+0000 7fb878840800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:39:19.301 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:19.298+0000 7fb878840800 20 INFO: main: starting shard=7 2024-09-12T17:39:19.301 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:19.298+0000 7fb878840800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.2.7 2024-09-12T17:39:19.301 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:19.298+0000 7fb878840800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.2.7 2024-09-12T17:39:19.301 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:19.298+0000 7fb878840800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:39:19.302 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:19.298+0000 7fb878840800 20 INFO: main: starting shard=8 2024-09-12T17:39:19.302 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:19.298+0000 7fb878840800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.2.8 2024-09-12T17:39:19.302 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:19.298+0000 7fb878840800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.2.8 2024-09-12T17:39:19.302 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:19.299+0000 7fb878840800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:39:19.302 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:19.299+0000 7fb878840800 20 INFO: main: starting shard=9 2024-09-12T17:39:19.302 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:19.299+0000 7fb878840800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.2.9 2024-09-12T17:39:19.302 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:19.299+0000 7fb878840800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.2.9 2024-09-12T17:39:19.302 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:19.300+0000 7fb878840800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:39:19.302 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:19.300+0000 7fb878840800 20 INFO: main: starting shard=10 2024-09-12T17:39:19.302 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:19.300+0000 7fb878840800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.2.10 2024-09-12T17:39:19.303 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:19.300+0000 7fb878840800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.2.10 2024-09-12T17:39:19.303 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:19.301+0000 7fb878840800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:39:19.304 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:19.301+0000 7fb878840800 20 INFO: main: starting shard=11 2024-09-12T17:39:19.304 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:19.301+0000 7fb878840800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.2.11 2024-09-12T17:39:19.304 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:19.301+0000 7fb878840800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.2.11 2024-09-12T17:39:19.304 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:19.301+0000 7fb878840800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:39:19.304 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:19.301+0000 7fb878840800 20 INFO: main: starting shard=12 2024-09-12T17:39:19.304 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:19.301+0000 7fb878840800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.2.12 2024-09-12T17:39:19.304 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:19.301+0000 7fb878840800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.2.12 2024-09-12T17:39:19.304 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:19.302+0000 7fb878840800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:39:19.304 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:19.302+0000 7fb878840800 20 INFO: main: done 2024-09-12T17:39:19.305 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:19.303+0000 7fb72cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:39:19.307 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:19.306+0000 7fb878840800 20 remove_watcher() i=0 2024-09-12T17:39:19.307 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:19.306+0000 7fb878840800 2 removed watcher, disabling cache 2024-09-12T17:39:19.308 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:19.307+0000 7fb878840800 20 remove_watcher() i=1 2024-09-12T17:39:19.309 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:19.308+0000 7fb878840800 20 remove_watcher() i=2 2024-09-12T17:39:19.311 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:19.309+0000 7fb878840800 20 remove_watcher() i=3 2024-09-12T17:39:19.312 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:19.310+0000 7fb878840800 20 remove_watcher() i=4 2024-09-12T17:39:19.313 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:19.311+0000 7fb878840800 20 remove_watcher() i=5 2024-09-12T17:39:19.314 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:19.312+0000 7fb878840800 20 remove_watcher() i=6 2024-09-12T17:39:19.315 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:19.313+0000 7fb878840800 20 remove_watcher() i=7 2024-09-12T17:39:19.353 INFO:tasks.workunit.client.0.smithi037.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-12T17:39:19.769 INFO:tasks.workunit.client.0.smithi037.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-09-12T17:39:20.178 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bucket reshard --bucket myver --num-shards 17 --yes-i-really-mean-it 2024-09-12T17:39:20.210 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:39:20.211 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:39:20.250 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.248+0000 7f0db7b3a800 20 rados->read ofs=0 len=0 2024-09-12T17:39:20.252 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.249+0000 7f0db7b3a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:20.252 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.249+0000 7f0db7b3a800 20 realm 2024-09-12T17:39:20.252 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.249+0000 7f0db7b3a800 20 rados->read ofs=0 len=0 2024-09-12T17:39:20.252 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.249+0000 7f0db7b3a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:20.252 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.249+0000 7f0db7b3a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:39:20.252 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.249+0000 7f0db7b3a800 20 rados->read ofs=0 len=0 2024-09-12T17:39:20.252 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.250+0000 7f0db7b3a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:20.252 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.250+0000 7f0db7b3a800 20 rados->read ofs=0 len=0 2024-09-12T17:39:20.253 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.251+0000 7f0db7b3a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:39:20.253 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.251+0000 7f0db7b3a800 20 rados->read ofs=0 len=0 2024-09-12T17:39:20.253 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.251+0000 7f0db7b3a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:39:20.253 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.251+0000 7f0db7b3a800 20 searching for the correct realm 2024-09-12T17:39:20.256 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.254+0000 7f0db3080640 0 -- 172.21.15.37:0/2217646865 >> [v2:172.21.15.40:6800/2441293461,v1:172.21.15.40:6801/2441293461] conn(0x7f0da40689a0 msgr2=0x7f0da4048900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:39:20.260 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.258+0000 7f0db3881640 0 -- 172.21.15.37:0/2217646865 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7f0da80dd7f0 msgr2=0x7f0da80c1300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:39:20.468 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.465+0000 7f0db7b3a800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:39:20.468 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.465+0000 7f0db7b3a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:39:20.468 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.465+0000 7f0db7b3a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:39:20.468 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.465+0000 7f0db7b3a800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:39:20.468 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.465+0000 7f0db7b3a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:39:20.468 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.465+0000 7f0db7b3a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:39:20.468 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.465+0000 7f0db7b3a800 20 rados->read ofs=0 len=0 2024-09-12T17:39:20.469 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.465+0000 7f0db7b3a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:20.469 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.465+0000 7f0db7b3a800 20 rados->read ofs=0 len=0 2024-09-12T17:39:20.469 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.465+0000 7f0db7b3a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:39:20.469 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.465+0000 7f0db7b3a800 20 rados->read ofs=0 len=0 2024-09-12T17:39:20.469 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.466+0000 7f0db7b3a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:39:20.469 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.466+0000 7f0db7b3a800 20 zone default found 2024-09-12T17:39:20.469 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.466+0000 7f0db7b3a800 4 Realm: () 2024-09-12T17:39:20.469 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.466+0000 7f0db7b3a800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:39:20.469 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.466+0000 7f0db7b3a800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:39:20.469 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.466+0000 7f0db7b3a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:39:20.469 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.466+0000 7f0db7b3a800 20 zonegroup default 2024-09-12T17:39:20.469 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.466+0000 7f0db7b3a800 20 rados->read ofs=0 len=0 2024-09-12T17:39:20.470 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.466+0000 7f0db7b3a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:20.470 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.466+0000 7f0db7b3a800 20 rados->read ofs=0 len=0 2024-09-12T17:39:20.470 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.467+0000 7f0db7b3a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:20.470 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.467+0000 7f0db7b3a800 20 rados->read ofs=0 len=0 2024-09-12T17:39:20.471 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.467+0000 7f0db7b3a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:20.471 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.467+0000 7f0db7b3a800 20 started sync module instance, tier type = 2024-09-12T17:39:20.471 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.467+0000 7f0db7b3a800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:39:20.479 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.477+0000 7f0db7b3a800 20 add_watcher() i=0 2024-09-12T17:39:20.479 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.477+0000 7f0db7b3a800 20 add_watcher() i=1 2024-09-12T17:39:20.479 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.477+0000 7f0db7b3a800 20 add_watcher() i=2 2024-09-12T17:39:20.479 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.477+0000 7f0db7b3a800 20 add_watcher() i=3 2024-09-12T17:39:20.479 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.477+0000 7f0db7b3a800 20 add_watcher() i=4 2024-09-12T17:39:20.479 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.477+0000 7f0db7b3a800 20 add_watcher() i=5 2024-09-12T17:39:20.479 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.477+0000 7f0db7b3a800 20 add_watcher() i=6 2024-09-12T17:39:20.480 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.478+0000 7f0db7b3a800 20 add_watcher() i=7 2024-09-12T17:39:20.480 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.478+0000 7f0db7b3a800 2 all 8 watchers are set, enabling cache 2024-09-12T17:39:20.481 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.480+0000 7f0c69fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:39:20.482 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.480+0000 7f0db7b3a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:39:20.482 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.480+0000 7f0db7b3a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:39:20.483 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.480+0000 7f0db7b3a800 5 note: GC not initialized 2024-09-12T17:39:20.483 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.480+0000 7f0c68fe1640 20 reqs_thread_entry: start 2024-09-12T17:39:20.483 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.481+0000 7f0db7b3a800 20 init_complete bucket index max shards: 11 2024-09-12T17:39:20.483 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.481+0000 7f0db7b3a800 20 Filter name: none 2024-09-12T17:39:20.483 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.481+0000 7f0be27fc640 20 reqs_thread_entry: start 2024-09-12T17:39:20.483 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.481+0000 7f0db7b3a800 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-12T17:39:20.483 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.481+0000 7f0db7b3a800 20 rados->read ofs=0 len=0 2024-09-12T17:39:20.484 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.481+0000 7f0db7b3a800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:39:20.484 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.481+0000 7f0db7b3a800 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-12T17:39:20.484 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.481+0000 7f0db7b3a800 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-12T17:39:20.484 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.481+0000 7f0db7b3a800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19 : miss 2024-09-12T17:39:20.484 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.481+0000 7f0db7b3a800 20 rados->read ofs=0 len=0 2024-09-12T17:39:20.484 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.482+0000 7f0db7b3a800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:39:20.484 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.482+0000 7f0db7b3a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19 info.flags=0x17 2024-09-12T17:39:20.484 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.482+0000 7f0db7b3a800 10 adding default.rgw.meta+root+.bucket.meta.myver:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19 to cache LRU end 2024-09-12T17:39:20.484 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.482+0000 7f0db7b3a800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:39:20.485 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.482+0000 7f0db7b3a800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:39:20.485 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.482+0000 7f0db7b3a800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19 2024-09-12T17:39:20.490 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.488+0000 7f0db7b3a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19 info.flags=0x17 2024-09-12T17:39:20.490 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.488+0000 7f0db7b3a800 10 moving default.rgw.meta+root+.bucket.meta.myver:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19 to cache LRU end 2024-09-12T17:39:20.490 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.488+0000 7f0db7b3a800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:39:20.490 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.488+0000 7f0db7b3a800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19, ofs0, ns] 2024-09-12T17:39:20.491 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.489+0000 7f0c92ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497099 cookie 94060071628032 notifier 8162 bl.length()=905 2024-09-12T17:39:20.491 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.489+0000 7f0c92ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19 info.flags=0x17 2024-09-12T17:39:20.491 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.489+0000 7f0c92ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19 to cache LRU end 2024-09-12T17:39:20.491 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.489+0000 7f0c92ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:39:20.492 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.491+0000 7f0db7b3a800 20 handle_bi_update(): bucket=:myver[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19]): orig_sources= new_sources= 2024-09-12T17:39:20.492 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.491+0000 7f0db7b3a800 20 handle_bi_update(): bucket=:myver[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19]): potential sources added=[] removed=[] 2024-09-12T17:39:20.493 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.491+0000 7f0db7b3a800 20 handle_bi_update(): bucket=:myver[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19]): orig_dests= new_dests= 2024-09-12T17:39:20.493 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.491+0000 7f0db7b3a800 20 handle_bi_update(): bucket=:myver[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19]): potential dests added=[] removed=[] 2024-09-12T17:39:20.499 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.497+0000 7f0db7b3a800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.3.0 2024-09-12T17:39:20.499 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.497+0000 7f0db7b3a800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.3.0 2024-09-12T17:39:20.499 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.497+0000 7f0db7b3a800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.3.1 2024-09-12T17:39:20.499 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.497+0000 7f0db7b3a800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.3.1 2024-09-12T17:39:20.499 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.497+0000 7f0db7b3a800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.3.2 2024-09-12T17:39:20.500 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.497+0000 7f0db7b3a800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.3.2 2024-09-12T17:39:20.500 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.497+0000 7f0db7b3a800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.3.3 2024-09-12T17:39:20.500 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.497+0000 7f0db7b3a800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.3.3 2024-09-12T17:39:20.500 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.497+0000 7f0db7b3a800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.3.4 2024-09-12T17:39:20.500 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.497+0000 7f0db7b3a800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.3.4 2024-09-12T17:39:20.500 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.497+0000 7f0db7b3a800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.3.5 2024-09-12T17:39:20.500 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.497+0000 7f0db7b3a800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.3.5 2024-09-12T17:39:20.500 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.497+0000 7f0db7b3a800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.3.6 2024-09-12T17:39:20.500 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.497+0000 7f0db7b3a800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.3.6 2024-09-12T17:39:20.500 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.497+0000 7f0db7b3a800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.3.7 2024-09-12T17:39:20.500 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.497+0000 7f0db7b3a800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.3.7 2024-09-12T17:39:20.500 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.497+0000 7f0db7b3a800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.3.8 2024-09-12T17:39:20.500 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.497+0000 7f0db7b3a800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.3.8 2024-09-12T17:39:20.501 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.497+0000 7f0db7b3a800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.3.9 2024-09-12T17:39:20.501 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.497+0000 7f0db7b3a800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.3.9 2024-09-12T17:39:20.501 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.497+0000 7f0db7b3a800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.3.10 2024-09-12T17:39:20.501 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.497+0000 7f0db7b3a800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.3.10 2024-09-12T17:39:20.501 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.497+0000 7f0db7b3a800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.3.11 2024-09-12T17:39:20.501 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.497+0000 7f0db7b3a800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.3.11 2024-09-12T17:39:20.501 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.497+0000 7f0db7b3a800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.3.12 2024-09-12T17:39:20.501 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.497+0000 7f0db7b3a800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.3.12 2024-09-12T17:39:20.501 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.497+0000 7f0db7b3a800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.3.13 2024-09-12T17:39:20.501 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.497+0000 7f0db7b3a800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.3.13 2024-09-12T17:39:20.501 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.497+0000 7f0db7b3a800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.3.14 2024-09-12T17:39:20.501 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.497+0000 7f0db7b3a800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.3.14 2024-09-12T17:39:20.501 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.497+0000 7f0db7b3a800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.3.15 2024-09-12T17:39:20.501 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.497+0000 7f0db7b3a800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.3.15 2024-09-12T17:39:20.502 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.497+0000 7f0db7b3a800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.3.16 2024-09-12T17:39:20.502 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.497+0000 7f0db7b3a800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.3.16 2024-09-12T17:39:20.502 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.497+0000 7f0db7b3a800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.2.0 2024-09-12T17:39:20.502 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.497+0000 7f0db7b3a800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.2.0 2024-09-12T17:39:20.502 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.497+0000 7f0db7b3a800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.2.1 2024-09-12T17:39:20.502 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.497+0000 7f0db7b3a800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.2.1 2024-09-12T17:39:20.503 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.498+0000 7f0db7b3a800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.2.2 2024-09-12T17:39:20.503 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.498+0000 7f0db7b3a800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.2.2 2024-09-12T17:39:20.503 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.498+0000 7f0db7b3a800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.2.3 2024-09-12T17:39:20.503 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.498+0000 7f0db7b3a800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.2.3 2024-09-12T17:39:20.503 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.499+0000 7f0db7b3a800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.2.4 2024-09-12T17:39:20.503 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.499+0000 7f0db7b3a800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.2.4 2024-09-12T17:39:20.503 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.499+0000 7f0db7b3a800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.2.5 2024-09-12T17:39:20.503 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.499+0000 7f0db7b3a800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.2.5 2024-09-12T17:39:20.503 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.500+0000 7f0db7b3a800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.2.6 2024-09-12T17:39:20.504 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.500+0000 7f0db7b3a800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.2.6 2024-09-12T17:39:20.504 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.500+0000 7f0db7b3a800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.2.7 2024-09-12T17:39:20.504 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.500+0000 7f0db7b3a800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.2.7 2024-09-12T17:39:20.504 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.501+0000 7f0db7b3a800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.2.8 2024-09-12T17:39:20.504 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.501+0000 7f0db7b3a800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.2.8 2024-09-12T17:39:20.504 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.502+0000 7f0db7b3a800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.2.9 2024-09-12T17:39:20.504 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.502+0000 7f0db7b3a800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.2.9 2024-09-12T17:39:20.505 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.503+0000 7f0db7b3a800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.2.10 2024-09-12T17:39:20.505 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.503+0000 7f0db7b3a800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.2.10 2024-09-12T17:39:20.505 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.503+0000 7f0db7b3a800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.2.11 2024-09-12T17:39:20.505 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.503+0000 7f0db7b3a800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.2.11 2024-09-12T17:39:20.505 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.504+0000 7f0db7b3a800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.2.12 2024-09-12T17:39:20.505 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.504+0000 7f0db7b3a800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.2.12 2024-09-12T17:39:20.509 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.507+0000 7f0db7b3a800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19 : hit (requested=0x17, cached=0x17) 2024-09-12T17:39:20.509 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.507+0000 7f0db7b3a800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19 2024-09-12T17:39:20.510 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.508+0000 7f0db7b3a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19 info.flags=0x17 2024-09-12T17:39:20.510 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.508+0000 7f0db7b3a800 10 moving default.rgw.meta+root+.bucket.meta.myver:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19 to cache LRU end 2024-09-12T17:39:20.510 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.508+0000 7f0db7b3a800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:39:20.511 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.508+0000 7f0db7b3a800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19, ofs0, ns] 2024-09-12T17:39:20.511 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.509+0000 7f0c92ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497100 cookie 94060071628032 notifier 8162 bl.length()=905 2024-09-12T17:39:20.511 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.509+0000 7f0c92ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19 info.flags=0x17 2024-09-12T17:39:20.511 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.509+0000 7f0c92ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19 to cache LRU end 2024-09-12T17:39:20.511 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.509+0000 7f0c92ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:39:20.512 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.510+0000 7f0db7b3a800 20 handle_bi_update(): bucket=:myver[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19]): orig_sources= new_sources= 2024-09-12T17:39:20.512 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.510+0000 7f0db7b3a800 20 handle_bi_update(): bucket=:myver[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19]): potential sources added=[] removed=[] 2024-09-12T17:39:20.512 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.510+0000 7f0db7b3a800 20 handle_bi_update(): bucket=:myver[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19]): orig_dests= new_dests= 2024-09-12T17:39:20.512 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.510+0000 7f0db7b3a800 20 handle_bi_update(): bucket=:myver[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19]): potential dests added=[] removed=[] 2024-09-12T17:39:20.515 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.513+0000 7f0db7b3a800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.2.0 2024-09-12T17:39:20.515 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.513+0000 7f0db7b3a800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.2.0 2024-09-12T17:39:20.515 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.513+0000 7f0db7b3a800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.2.1 2024-09-12T17:39:20.515 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.513+0000 7f0db7b3a800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.2.1 2024-09-12T17:39:20.516 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.514+0000 7f0db7b3a800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.2.2 2024-09-12T17:39:20.516 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.514+0000 7f0db7b3a800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.2.2 2024-09-12T17:39:20.516 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.514+0000 7f0db7b3a800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.2.3 2024-09-12T17:39:20.516 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.514+0000 7f0db7b3a800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.2.3 2024-09-12T17:39:20.516 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.515+0000 7f0db7b3a800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.2.4 2024-09-12T17:39:20.516 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.515+0000 7f0db7b3a800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.2.4 2024-09-12T17:39:20.517 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.515+0000 7f0db7b3a800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.2.5 2024-09-12T17:39:20.517 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.515+0000 7f0db7b3a800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.2.5 2024-09-12T17:39:20.517 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.515+0000 7f0db7b3a800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.2.6 2024-09-12T17:39:20.517 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.515+0000 7f0db7b3a800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.2.6 2024-09-12T17:39:20.517 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.516+0000 7f0db7b3a800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.2.7 2024-09-12T17:39:20.517 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.516+0000 7f0db7b3a800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.2.7 2024-09-12T17:39:20.518 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.516+0000 7f0db7b3a800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.2.8 2024-09-12T17:39:20.518 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.516+0000 7f0db7b3a800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.2.8 2024-09-12T17:39:20.518 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.516+0000 7f0db7b3a800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.2.9 2024-09-12T17:39:20.518 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.516+0000 7f0db7b3a800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.2.9 2024-09-12T17:39:20.519 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.517+0000 7f0db7b3a800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.2.10 2024-09-12T17:39:20.519 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.517+0000 7f0db7b3a800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.2.10 2024-09-12T17:39:20.519 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.517+0000 7f0db7b3a800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.2.11 2024-09-12T17:39:20.519 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.517+0000 7f0db7b3a800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.2.11 2024-09-12T17:39:20.520 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.517+0000 7f0db7b3a800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.2.12 2024-09-12T17:39:20.520 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.517+0000 7f0db7b3a800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.2.12 2024-09-12T17:39:20.520 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.518+0000 7f0db7b3a800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19 : hit (requested=0x17, cached=0x17) 2024-09-12T17:39:20.520 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.518+0000 7f0db7b3a800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19 2024-09-12T17:39:20.521 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.519+0000 7f0db7b3a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19 info.flags=0x17 2024-09-12T17:39:20.521 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.519+0000 7f0db7b3a800 10 moving default.rgw.meta+root+.bucket.meta.myver:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19 to cache LRU end 2024-09-12T17:39:20.521 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.519+0000 7f0db7b3a800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:39:20.521 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.519+0000 7f0db7b3a800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19, ofs0, ns] 2024-09-12T17:39:20.522 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.520+0000 7f0c927fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497101 cookie 94060071628032 notifier 8162 bl.length()=873 2024-09-12T17:39:20.522 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.520+0000 7f0c927fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19 info.flags=0x17 2024-09-12T17:39:20.522 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.520+0000 7f0c927fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19 to cache LRU end 2024-09-12T17:39:20.522 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.520+0000 7f0c927fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:39:20.523 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.522+0000 7f0db7b3a800 20 handle_bi_update(): bucket=:myver[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19]): orig_sources= new_sources= 2024-09-12T17:39:20.523 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.522+0000 7f0db7b3a800 20 handle_bi_update(): bucket=:myver[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19]): potential sources added=[] removed=[] 2024-09-12T17:39:20.524 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.522+0000 7f0db7b3a800 20 handle_bi_update(): bucket=:myver[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19]): orig_dests= new_dests= 2024-09-12T17:39:20.524 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.522+0000 7f0db7b3a800 20 handle_bi_update(): bucket=:myver[722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19]): potential dests added=[] removed=[] 2024-09-12T17:39:20.526 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.524+0000 7f0db7b3a800 1 execute INFO: reshard of bucket "myver" from 13 shards to 17 shards completed successfully 2024-09-12T17:39:20.528 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.526+0000 7f0c69fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:39:20.532 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.530+0000 7f0db7b3a800 20 remove_watcher() i=0 2024-09-12T17:39:20.532 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.530+0000 7f0db7b3a800 2 removed watcher, disabling cache 2024-09-12T17:39:20.532 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.531+0000 7f0db7b3a800 20 remove_watcher() i=1 2024-09-12T17:39:20.533 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.532+0000 7f0db7b3a800 20 remove_watcher() i=2 2024-09-12T17:39:20.535 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.534+0000 7f0db7b3a800 20 remove_watcher() i=3 2024-09-12T17:39:20.536 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.535+0000 7f0db7b3a800 20 remove_watcher() i=4 2024-09-12T17:39:20.537 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.536+0000 7f0db7b3a800 20 remove_watcher() i=5 2024-09-12T17:39:20.538 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.537+0000 7f0db7b3a800 20 remove_watcher() i=6 2024-09-12T17:39:20.539 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.538+0000 7f0db7b3a800 20 remove_watcher() i=7 2024-09-12T17:39:20.553 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bucket check unlinked --bucket myver --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-12T17:39:20.589 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:39:20.589 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:39:20.629 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.627+0000 7faaa9922800 20 rados->read ofs=0 len=0 2024-09-12T17:39:20.630 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.628+0000 7faaa9922800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:20.630 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.628+0000 7faaa9922800 20 realm 2024-09-12T17:39:20.631 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.628+0000 7faaa9922800 20 rados->read ofs=0 len=0 2024-09-12T17:39:20.631 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.629+0000 7faaa9922800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:20.631 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.629+0000 7faaa9922800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:39:20.631 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.629+0000 7faaa9922800 20 rados->read ofs=0 len=0 2024-09-12T17:39:20.631 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.629+0000 7faaa9922800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:20.631 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.629+0000 7faaa9922800 20 rados->read ofs=0 len=0 2024-09-12T17:39:20.632 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.630+0000 7faaa9922800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:39:20.633 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.630+0000 7faaa9922800 20 rados->read ofs=0 len=0 2024-09-12T17:39:20.633 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.630+0000 7faaa9922800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:39:20.633 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.630+0000 7faaa9922800 20 searching for the correct realm 2024-09-12T17:39:20.635 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.634+0000 7faaa5d03640 0 -- 172.21.15.37:0/3336053982 >> [v2:172.21.15.37:6824/3990661154,v1:172.21.15.37:6825/3990661154] conn(0x56441a5cf750 msgr2=0x56441a5d1bc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:39:20.639 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.638+0000 7faaa5502640 0 -- 172.21.15.37:0/3336053982 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7faa9c04deb0 msgr2=0x7faa9c0c68f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:39:20.645 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.643+0000 7faaa9922800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:39:20.645 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.643+0000 7faaa9922800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:39:20.645 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.643+0000 7faaa9922800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:39:20.645 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.643+0000 7faaa9922800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:39:20.645 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.643+0000 7faaa9922800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:39:20.645 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.643+0000 7faaa9922800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:39:20.646 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.643+0000 7faaa9922800 20 rados->read ofs=0 len=0 2024-09-12T17:39:20.646 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.643+0000 7faaa9922800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:20.646 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.643+0000 7faaa9922800 20 rados->read ofs=0 len=0 2024-09-12T17:39:20.646 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.643+0000 7faaa9922800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:39:20.646 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.643+0000 7faaa9922800 20 rados->read ofs=0 len=0 2024-09-12T17:39:20.647 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.644+0000 7faaa9922800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:39:20.647 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.644+0000 7faaa9922800 20 zone default found 2024-09-12T17:39:20.647 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.644+0000 7faaa9922800 4 Realm: () 2024-09-12T17:39:20.647 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.644+0000 7faaa9922800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:39:20.647 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.644+0000 7faaa9922800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:39:20.647 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.644+0000 7faaa9922800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:39:20.647 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.644+0000 7faaa9922800 20 zonegroup default 2024-09-12T17:39:20.648 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.644+0000 7faaa9922800 20 rados->read ofs=0 len=0 2024-09-12T17:39:20.648 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.644+0000 7faaa9922800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:20.648 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.644+0000 7faaa9922800 20 rados->read ofs=0 len=0 2024-09-12T17:39:20.648 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.644+0000 7faaa9922800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:20.648 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.645+0000 7faaa9922800 20 rados->read ofs=0 len=0 2024-09-12T17:39:20.648 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.645+0000 7faaa9922800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:20.648 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.645+0000 7faaa9922800 20 started sync module instance, tier type = 2024-09-12T17:39:20.648 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.645+0000 7faaa9922800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:39:20.656 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.654+0000 7faaa9922800 20 add_watcher() i=0 2024-09-12T17:39:20.656 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.654+0000 7faaa9922800 20 add_watcher() i=1 2024-09-12T17:39:20.656 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.654+0000 7faaa9922800 20 add_watcher() i=2 2024-09-12T17:39:20.656 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.654+0000 7faaa9922800 20 add_watcher() i=3 2024-09-12T17:39:20.656 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.654+0000 7faaa9922800 20 add_watcher() i=4 2024-09-12T17:39:20.656 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.654+0000 7faaa9922800 20 add_watcher() i=5 2024-09-12T17:39:20.656 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.654+0000 7faaa9922800 20 add_watcher() i=6 2024-09-12T17:39:20.657 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.655+0000 7faaa9922800 20 add_watcher() i=7 2024-09-12T17:39:20.657 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.655+0000 7faaa9922800 2 all 8 watchers are set, enabling cache 2024-09-12T17:39:20.658 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.657+0000 7fa95b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:39:20.659 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.657+0000 7faaa9922800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:39:20.659 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.657+0000 7faaa9922800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:39:20.659 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.657+0000 7faaa9922800 5 note: GC not initialized 2024-09-12T17:39:20.659 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.657+0000 7fa95a7e4640 20 reqs_thread_entry: start 2024-09-12T17:39:20.660 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.657+0000 7faaa9922800 20 init_complete bucket index max shards: 11 2024-09-12T17:39:20.660 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.657+0000 7faaa9922800 20 Filter name: none 2024-09-12T17:39:20.660 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.657+0000 7fa8cbfff640 20 reqs_thread_entry: start 2024-09-12T17:39:20.660 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.658+0000 7faaa9922800 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-12T17:39:20.660 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.658+0000 7faaa9922800 20 rados->read ofs=0 len=0 2024-09-12T17:39:20.661 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.658+0000 7faaa9922800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:39:20.661 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.658+0000 7faaa9922800 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-12T17:39:20.661 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.658+0000 7faaa9922800 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-12T17:39:20.661 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.658+0000 7faaa9922800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19 : miss 2024-09-12T17:39:20.661 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.658+0000 7faaa9922800 20 rados->read ofs=0 len=0 2024-09-12T17:39:20.661 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.659+0000 7faaa9922800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:39:20.661 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.659+0000 7faaa9922800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19 info.flags=0x17 2024-09-12T17:39:20.661 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.659+0000 7faaa9922800 10 adding default.rgw.meta+root+.bucket.meta.myver:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19 to cache LRU end 2024-09-12T17:39:20.661 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.659+0000 7faaa9922800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:39:20.662 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.659+0000 7faaa9922800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:39:20.662 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.659+0000 7faaa9922800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19 2024-09-12T17:39:20.662 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.659+0000 7faaa9922800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.3.0 2024-09-12T17:39:20.662 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.659+0000 7faaa9922800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.3.0 2024-09-12T17:39:20.662 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.659+0000 7faaa9922800 1 NOTICE: finished shard 0 (0 entries removed) 2024-09-12T17:39:20.662 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.659+0000 7faaa9922800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.3.1 2024-09-12T17:39:20.662 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.659+0000 7faaa9922800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.3.1 2024-09-12T17:39:20.662 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.660+0000 7faaa9922800 1 NOTICE: finished shard 1 (0 entries removed) 2024-09-12T17:39:20.663 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.660+0000 7faaa9922800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.3.2 2024-09-12T17:39:20.663 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.660+0000 7faaa9922800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.3.2 2024-09-12T17:39:20.663 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.661+0000 7faaa9922800 1 NOTICE: finished shard 2 (0 entries removed) 2024-09-12T17:39:20.663 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.661+0000 7faaa9922800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.3.3 2024-09-12T17:39:20.663 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.661+0000 7faaa9922800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.3.3 2024-09-12T17:39:20.663 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.662+0000 7faaa9922800 1 NOTICE: finished shard 3 (0 entries removed) 2024-09-12T17:39:20.664 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.662+0000 7faaa9922800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.3.4 2024-09-12T17:39:20.664 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.662+0000 7faaa9922800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.3.4 2024-09-12T17:39:20.664 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.662+0000 7faaa9922800 1 NOTICE: finished shard 4 (0 entries removed) 2024-09-12T17:39:20.664 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.662+0000 7faaa9922800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.3.5 2024-09-12T17:39:20.664 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.662+0000 7faaa9922800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.3.5 2024-09-12T17:39:20.665 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.663+0000 7faaa9922800 1 NOTICE: finished shard 5 (0 entries removed) 2024-09-12T17:39:20.665 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.663+0000 7faaa9922800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.3.6 2024-09-12T17:39:20.665 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.663+0000 7faaa9922800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.3.6 2024-09-12T17:39:20.665 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.664+0000 7faaa9922800 1 NOTICE: finished shard 6 (0 entries removed) 2024-09-12T17:39:20.665 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.664+0000 7faaa9922800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.3.7 2024-09-12T17:39:20.665 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.664+0000 7faaa9922800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.3.7 2024-09-12T17:39:20.666 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.664+0000 7faaa9922800 1 NOTICE: finished shard 7 (0 entries removed) 2024-09-12T17:39:20.666 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.664+0000 7faaa9922800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.3.8 2024-09-12T17:39:20.666 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.664+0000 7faaa9922800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.3.8 2024-09-12T17:39:20.666 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.665+0000 7faaa9922800 1 NOTICE: finished shard 8 (0 entries removed) 2024-09-12T17:39:20.667 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.665+0000 7faaa9922800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.3.9 2024-09-12T17:39:20.667 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.665+0000 7faaa9922800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.3.9 2024-09-12T17:39:20.667 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.665+0000 7faaa9922800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.3.10 2024-09-12T17:39:20.667 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.665+0000 7faaa9922800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.3.10 2024-09-12T17:39:20.668 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.666+0000 7faaa9922800 1 NOTICE: finished shard 10 (0 entries removed) 2024-09-12T17:39:20.668 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.666+0000 7faaa9922800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.3.11 2024-09-12T17:39:20.668 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.666+0000 7faaa9922800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.3.11 2024-09-12T17:39:20.668 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.667+0000 7faaa9922800 1 NOTICE: finished shard 11 (0 entries removed) 2024-09-12T17:39:20.669 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.667+0000 7faaa9922800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.3.12 2024-09-12T17:39:20.669 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.667+0000 7faaa9922800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.3.12 2024-09-12T17:39:20.669 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.667+0000 7faaa9922800 1 NOTICE: finished shard 12 (0 entries removed) 2024-09-12T17:39:20.669 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.667+0000 7faaa9922800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.3.13 2024-09-12T17:39:20.669 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.667+0000 7faaa9922800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.3.13 2024-09-12T17:39:20.670 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.668+0000 7faaa9922800 1 NOTICE: finished shard 13 (0 entries removed) 2024-09-12T17:39:20.670 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.668+0000 7faaa9922800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.3.14 2024-09-12T17:39:20.670 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.668+0000 7faaa9922800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.3.14 2024-09-12T17:39:20.670 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.669+0000 7faaa9922800 1 NOTICE: finished shard 14 (0 entries removed) 2024-09-12T17:39:20.670 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.669+0000 7faaa9922800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.3.15 2024-09-12T17:39:20.670 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.669+0000 7faaa9922800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.3.15 2024-09-12T17:39:20.671 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.669+0000 7faaa9922800 1 NOTICE: finished shard 15 (0 entries removed) 2024-09-12T17:39:20.671 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.669+0000 7faaa9922800 10 bucket_obj is .dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.3.16 2024-09-12T17:39:20.671 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.669+0000 7faaa9922800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.3.16 2024-09-12T17:39:20.671 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.669+0000 7faaa9922800 1 NOTICE: finished shard 16 (0 entries removed) 2024-09-12T17:39:20.671 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.669+0000 7faaa9922800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.3.9 2024-09-12T17:39:20.672 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.670+0000 7faaa9922800 20 get_obj_state: octx=0x56441a343190 obj=myver:x state=0x56441a60d1a8 s->prefetch_data=0 2024-09-12T17:39:20.672 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.670+0000 7faaa9922800 20 get_obj_state: setting s->obj_tag to dclxrvaj0pv1wbfghe0mjzeiqkd7invx 2024-09-12T17:39:20.672 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.670+0000 7faaa9922800 20 get_obj_state_impl: setting s->olh_tag to tziut0wt6x8s4u0ggwjq935tpgphxi06 2024-09-12T17:39:20.672 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.670+0000 7faaa9922800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=tziut0wt6x8s4u0ggwjq935tpgphxi06 2024-09-12T17:39:20.673 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.672+0000 7faaa9922800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.3.9 2024-09-12T17:39:20.675 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.673+0000 7faaa9922800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.3.9 2024-09-12T17:39:20.676 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.674+0000 7faaa9922800 20 olh_log_entry: epoch=2 op=2 key=x[] 2024-09-12T17:39:20.676 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.674+0000 7faaa9922800 20 olh_log_entry: epoch=2 op=3 key=x[JwL-mglHCKyf1PH8kuiODPvLHv0oFTG] 2024-09-12T17:39:20.676 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.674+0000 7faaa9922800 20 get_obj_state: octx=0x56441a343190 obj=myver:_:JwL-mglHCKyf1PH8kuiODPvLHv0oFTG_x state=0x56441a60a148 s->prefetch_data=0 2024-09-12T17:39:20.676 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.674+0000 7faaa9922800 10 manifest: total_size = 22 2024-09-12T17:39:20.676 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.674+0000 7faaa9922800 20 get_obj_state: setting s->obj_tag to 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.11390973822230411223 2024-09-12T17:39:20.676 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.674+0000 7faaa9922800 20 get_obj_state: octx=0x56441a343190 obj=myver:_:JwL-mglHCKyf1PH8kuiODPvLHv0oFTG_x state=0x56441a60a148 s->prefetch_data=0 2024-09-12T17:39:20.676 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.674+0000 7faaa9922800 20 prepare_atomic_modification: state is not atomic. state=0x56441a60a148 2024-09-12T17:39:20.676 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.674+0000 7faaa9922800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.3.9 2024-09-12T17:39:20.680 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.678+0000 7fa988ff9640 20 handle_completion(): completion ok for obj=x[JwL-mglHCKyf1PH8kuiODPvLHv0oFTG] 2024-09-12T17:39:20.680 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.678+0000 7faaa9922800 20 get_obj_state: octx=0x56441a343190 obj=myver:x state=0x56441a60d1a8 s->prefetch_data=0 2024-09-12T17:39:20.680 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.679+0000 7faaa9922800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=tziut0wt6x8s4u0ggwjq935tpgphxi06 2024-09-12T17:39:20.683 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.682+0000 7faaa9922800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.3.9 2024-09-12T17:39:20.684 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.683+0000 7faaa9922800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.3.9 2024-09-12T17:39:20.685 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.683+0000 7faaa9922800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.3.9 2024-09-12T17:39:20.685 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.684+0000 7faaa9922800 20 get_obj_state: octx=0x56441a343190 obj=myver:y state=0x56441a647c38 s->prefetch_data=0 2024-09-12T17:39:20.686 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.684+0000 7faaa9922800 20 get_obj_state: setting s->obj_tag to 6kf8bd922ez1pfb4ujzquc9fq6p7ovg8 2024-09-12T17:39:20.686 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.684+0000 7faaa9922800 20 get_obj_state_impl: setting s->olh_tag to viqb7qk82w9s6hzghzo386xwklc2su58 2024-09-12T17:39:20.686 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.684+0000 7faaa9922800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=viqb7qk82w9s6hzghzo386xwklc2su58 2024-09-12T17:39:20.687 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.686+0000 7faaa9922800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.3.9 2024-09-12T17:39:20.691 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.689+0000 7faaa9922800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.3.9 2024-09-12T17:39:20.692 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.689+0000 7faaa9922800 20 olh_log_entry: epoch=2 op=2 key=y[] 2024-09-12T17:39:20.692 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.689+0000 7faaa9922800 20 olh_log_entry: epoch=2 op=3 key=y[rz0Ukk8Gid3JiyuHo9pQ71HJU7.2IAk] 2024-09-12T17:39:20.692 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.689+0000 7faaa9922800 20 get_obj_state: octx=0x56441a343190 obj=myver:_:rz0Ukk8Gid3JiyuHo9pQ71HJU7.2IAk_y state=0x56441a608128 s->prefetch_data=0 2024-09-12T17:39:20.692 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.690+0000 7faaa9922800 10 manifest: total_size = 9 2024-09-12T17:39:20.692 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.690+0000 7faaa9922800 20 get_obj_state: setting s->obj_tag to 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.6629367462101646510 2024-09-12T17:39:20.692 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.690+0000 7faaa9922800 20 get_obj_state: octx=0x56441a343190 obj=myver:_:rz0Ukk8Gid3JiyuHo9pQ71HJU7.2IAk_y state=0x56441a608128 s->prefetch_data=0 2024-09-12T17:39:20.692 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.690+0000 7faaa9922800 20 prepare_atomic_modification: state is not atomic. state=0x56441a608128 2024-09-12T17:39:20.692 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.690+0000 7faaa9922800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.3.9 2024-09-12T17:39:20.698 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.696+0000 7faaa9922800 20 get_obj_state: octx=0x56441a343190 obj=myver:y state=0x56441a647c38 s->prefetch_data=0 2024-09-12T17:39:20.698 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.696+0000 7fa988ff9640 20 handle_completion(): completion ok for obj=y[rz0Ukk8Gid3JiyuHo9pQ71HJU7.2IAk] 2024-09-12T17:39:20.698 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.696+0000 7faaa9922800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=viqb7qk82w9s6hzghzo386xwklc2su58 2024-09-12T17:39:20.701 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.699+0000 7faaa9922800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.3.9 2024-09-12T17:39:20.702 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.701+0000 7faaa9922800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.3.9 2024-09-12T17:39:20.703 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.701+0000 7faaa9922800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.3.9 2024-09-12T17:39:20.703 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.701+0000 7faaa9922800 20 get_obj_state: octx=0x7faa9c063f40 obj=myver:z state=0x56441a647b88 s->prefetch_data=0 2024-09-12T17:39:20.704 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.702+0000 7faaa9922800 20 get_obj_state: setting s->obj_tag to fc7kjy2tx7jekhjnxp17j06q86qfevzc 2024-09-12T17:39:20.704 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.702+0000 7faaa9922800 20 get_obj_state_impl: setting s->olh_tag to qpjd15q4ol2wkd3k968p4uu84hlz0ecy 2024-09-12T17:39:20.704 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.702+0000 7faaa9922800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=qpjd15q4ol2wkd3k968p4uu84hlz0ecy 2024-09-12T17:39:20.705 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.703+0000 7faaa9922800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.3.9 2024-09-12T17:39:20.707 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.704+0000 7faaa9922800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.3.9 2024-09-12T17:39:20.707 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.705+0000 7faaa9922800 20 olh_log_entry: epoch=2 op=2 key=z[] 2024-09-12T17:39:20.707 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.705+0000 7faaa9922800 20 olh_log_entry: epoch=2 op=3 key=z[MvSdQSBbXy3eNGsB9IJCTJZuWk4IZVJ] 2024-09-12T17:39:20.707 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.705+0000 7faaa9922800 20 get_obj_state: octx=0x7faa9c063f40 obj=myver:_:MvSdQSBbXy3eNGsB9IJCTJZuWk4IZVJ_z state=0x56441a608128 s->prefetch_data=0 2024-09-12T17:39:20.707 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.705+0000 7faaa9922800 10 manifest: total_size = 11 2024-09-12T17:39:20.707 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.705+0000 7faaa9922800 20 get_obj_state: setting s->obj_tag to 722b129a-cf7a-4aca-b594-5b9492d130e2.4623.3447338842350346077 2024-09-12T17:39:20.707 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.705+0000 7faaa9922800 20 get_obj_state: octx=0x7faa9c063f40 obj=myver:_:MvSdQSBbXy3eNGsB9IJCTJZuWk4IZVJ_z state=0x56441a608128 s->prefetch_data=0 2024-09-12T17:39:20.707 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.705+0000 7faaa9922800 20 prepare_atomic_modification: state is not atomic. state=0x56441a608128 2024-09-12T17:39:20.707 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.705+0000 7faaa9922800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.3.9 2024-09-12T17:39:20.711 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.709+0000 7fa988ff9640 20 handle_completion(): completion ok for obj=z[MvSdQSBbXy3eNGsB9IJCTJZuWk4IZVJ] 2024-09-12T17:39:20.711 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.709+0000 7faaa9922800 20 get_obj_state: octx=0x7faa9c063f40 obj=myver:z state=0x56441a647b88 s->prefetch_data=0 2024-09-12T17:39:20.711 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.709+0000 7faaa9922800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=qpjd15q4ol2wkd3k968p4uu84hlz0ecy 2024-09-12T17:39:20.714 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.712+0000 7faaa9922800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.3.9 2024-09-12T17:39:20.715 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.713+0000 7faaa9922800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.19.3.9 2024-09-12T17:39:20.715 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.713+0000 7faaa9922800 1 NOTICE: finished shard 9 (3 entries removed) 2024-09-12T17:39:20.715 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.713+0000 7faaa9922800 1 NOTICE: finished all shards (3 entries removed) 2024-09-12T17:39:20.716 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.714+0000 7fa95b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:39:20.718 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.717+0000 7faaa9922800 20 remove_watcher() i=0 2024-09-12T17:39:20.719 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.717+0000 7faaa9922800 2 removed watcher, disabling cache 2024-09-12T17:39:20.719 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.718+0000 7faaa9922800 20 remove_watcher() i=1 2024-09-12T17:39:20.721 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.719+0000 7faaa9922800 20 remove_watcher() i=2 2024-09-12T17:39:20.722 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.721+0000 7faaa9922800 20 remove_watcher() i=3 2024-09-12T17:39:20.723 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.721+0000 7faaa9922800 20 remove_watcher() i=4 2024-09-12T17:39:20.724 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.722+0000 7faaa9922800 20 remove_watcher() i=5 2024-09-12T17:39:20.725 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.724+0000 7faaa9922800 20 remove_watcher() i=6 2024-09-12T17:39:20.727 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.726+0000 7faaa9922800 20 remove_watcher() i=7 2024-09-12T17:39:20.872 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bucket stats --bucket myver 2024-09-12T17:39:20.902 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:39:20.902 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:39:20.941 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.939+0000 7ff2b9325800 20 rados->read ofs=0 len=0 2024-09-12T17:39:20.943 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.941+0000 7ff2b9325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:20.943 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.941+0000 7ff2b9325800 20 realm 2024-09-12T17:39:20.943 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.941+0000 7ff2b9325800 20 rados->read ofs=0 len=0 2024-09-12T17:39:20.943 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.941+0000 7ff2b9325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:20.943 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.941+0000 7ff2b9325800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:39:20.944 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.941+0000 7ff2b9325800 20 rados->read ofs=0 len=0 2024-09-12T17:39:20.944 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.941+0000 7ff2b9325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:20.944 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.941+0000 7ff2b9325800 20 rados->read ofs=0 len=0 2024-09-12T17:39:20.944 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.942+0000 7ff2b9325800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:39:20.944 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.942+0000 7ff2b9325800 20 rados->read ofs=0 len=0 2024-09-12T17:39:20.945 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.942+0000 7ff2b9325800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:39:20.945 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.943+0000 7ff2b9325800 20 searching for the correct realm 2024-09-12T17:39:20.947 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:20.945+0000 7ff2b4732640 0 -- 172.21.15.37:0/726620248 >> [v2:172.21.15.40:6800/2441293461,v1:172.21.15.40:6801/2441293461] conn(0x7ff2a408e070 msgr2=0x7ff2a408ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:39:21.153 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:21.152+0000 7ff2b4f33640 0 -- 172.21.15.37:0/726620248 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7ff29c040920 msgr2=0x7ff29c0513b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:39:21.360 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:21.358+0000 7ff2b9325800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:39:21.360 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:21.358+0000 7ff2b9325800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:39:21.361 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:21.358+0000 7ff2b9325800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:39:21.361 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:21.358+0000 7ff2b9325800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:39:21.361 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:21.358+0000 7ff2b9325800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:39:21.361 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:21.358+0000 7ff2b9325800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:39:21.361 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:21.358+0000 7ff2b9325800 20 rados->read ofs=0 len=0 2024-09-12T17:39:21.361 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:21.359+0000 7ff2b9325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:21.361 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:21.359+0000 7ff2b9325800 20 rados->read ofs=0 len=0 2024-09-12T17:39:21.362 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:21.359+0000 7ff2b9325800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:39:21.362 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:21.359+0000 7ff2b9325800 20 rados->read ofs=0 len=0 2024-09-12T17:39:21.362 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:21.359+0000 7ff2b9325800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:39:21.363 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:21.359+0000 7ff2b9325800 20 zone default found 2024-09-12T17:39:21.363 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:21.359+0000 7ff2b9325800 4 Realm: () 2024-09-12T17:39:21.363 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:21.359+0000 7ff2b9325800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:39:21.363 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:21.359+0000 7ff2b9325800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:39:21.363 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:21.359+0000 7ff2b9325800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:39:21.363 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:21.359+0000 7ff2b9325800 20 zonegroup default 2024-09-12T17:39:21.363 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:21.359+0000 7ff2b9325800 20 rados->read ofs=0 len=0 2024-09-12T17:39:21.363 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:21.360+0000 7ff2b9325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:21.363 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:21.360+0000 7ff2b9325800 20 rados->read ofs=0 len=0 2024-09-12T17:39:21.363 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:21.360+0000 7ff2b9325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:21.363 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:21.360+0000 7ff2b9325800 20 rados->read ofs=0 len=0 2024-09-12T17:39:21.363 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:21.360+0000 7ff2b9325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:21.363 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:21.360+0000 7ff2b9325800 20 started sync module instance, tier type = 2024-09-12T17:39:21.364 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:21.360+0000 7ff2b9325800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:39:21.373 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:21.371+0000 7ff2b9325800 20 add_watcher() i=0 2024-09-12T17:39:21.373 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:21.371+0000 7ff2b9325800 20 add_watcher() i=1 2024-09-12T17:39:21.373 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:21.371+0000 7ff2b9325800 20 add_watcher() i=2 2024-09-12T17:39:21.373 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:21.371+0000 7ff2b9325800 20 add_watcher() i=3 2024-09-12T17:39:21.373 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:21.371+0000 7ff2b9325800 20 add_watcher() i=4 2024-09-12T17:39:21.373 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:21.371+0000 7ff2b9325800 20 add_watcher() i=5 2024-09-12T17:39:21.373 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:21.371+0000 7ff2b9325800 20 add_watcher() i=6 2024-09-12T17:39:21.374 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:21.372+0000 7ff2b9325800 20 add_watcher() i=7 2024-09-12T17:39:21.374 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:21.372+0000 7ff2b9325800 2 all 8 watchers are set, enabling cache 2024-09-12T17:39:21.376 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:21.375+0000 7ff16afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:39:21.377 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:21.375+0000 7ff2b9325800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:39:21.378 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:21.375+0000 7ff2b9325800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:39:21.378 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:21.375+0000 7ff2b9325800 5 note: GC not initialized 2024-09-12T17:39:21.378 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:21.375+0000 7ff169fe3640 20 reqs_thread_entry: start 2024-09-12T17:39:21.378 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:21.376+0000 7ff2b9325800 20 init_complete bucket index max shards: 11 2024-09-12T17:39:21.378 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:21.376+0000 7ff2b9325800 20 Filter name: none 2024-09-12T17:39:21.378 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:21.376+0000 7ff0db7fe640 20 reqs_thread_entry: start 2024-09-12T17:39:21.378 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:21.376+0000 7ff2b9325800 20 rados->read ofs=0 len=0 2024-09-12T17:39:21.379 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:21.376+0000 7ff2b9325800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:39:21.379 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:21.376+0000 7ff2b9325800 20 rados->read ofs=0 len=0 2024-09-12T17:39:21.379 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:21.377+0000 7ff2b9325800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:39:21.379 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:21.377+0000 7ff2b9325800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:39:21.379 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:21.377+0000 7ff2b9325800 20 rados->read ofs=0 len=0 2024-09-12T17:39:21.379 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:21.377+0000 7ff2b9325800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:39:21.379 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:21.377+0000 7ff2b9325800 20 rados->read ofs=0 len=0 2024-09-12T17:39:21.380 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:21.378+0000 7ff2b9325800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:39:21.380 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:21.378+0000 7ff2b9325800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:39:21.382 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:21.380+0000 7ff16afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:39:21.384 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:21.383+0000 7ff2b9325800 20 remove_watcher() i=0 2024-09-12T17:39:21.384 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:21.383+0000 7ff2b9325800 2 removed watcher, disabling cache 2024-09-12T17:39:21.386 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:21.384+0000 7ff2b9325800 20 remove_watcher() i=1 2024-09-12T17:39:21.387 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:21.385+0000 7ff2b9325800 20 remove_watcher() i=2 2024-09-12T17:39:21.388 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:21.387+0000 7ff2b9325800 20 remove_watcher() i=3 2024-09-12T17:39:21.390 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:21.388+0000 7ff2b9325800 20 remove_watcher() i=4 2024-09-12T17:39:21.390 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:21.389+0000 7ff2b9325800 20 remove_watcher() i=5 2024-09-12T17:39:21.392 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:21.390+0000 7ff2b9325800 20 remove_watcher() i=6 2024-09-12T17:39:21.393 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T17:39:21.391+0000 7ff2b9325800 20 remove_watcher() i=7 2024-09-12T17:39:21.405 INFO:tasks.workunit.client.0.smithi037.stderr:{'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}} 2024-09-12T17:39:21.405 INFO:tasks.workunit.client.0.smithi037.stderr:Deleting bucket a-bucket 2024-09-12T17:39:21.488 INFO:tasks.workunit.client.0.smithi037.stderr:Deleting bucket myver 2024-09-12T17:39:21.733 INFO:tasks.workunit.client.0.smithi037.stderr:Completed resharding tests 2024-09-12T17:39:21.734 INFO:tasks.workunit.client.0.smithi037.stdout:connected to http://localhost:80 2024-09-12T17:39:21.814 INFO:tasks.workunit.client.0.smithi037.stderr:+ deactivate 2024-09-12T17:39:21.814 INFO:tasks.workunit.client.0.smithi037.stderr:+ '[' -n /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin ']' 2024-09-12T17:39:21.814 INFO:tasks.workunit.client.0.smithi037.stderr:+ PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-12T17:39:21.814 INFO:tasks.workunit.client.0.smithi037.stderr:+ export PATH 2024-09-12T17:39:21.814 INFO:tasks.workunit.client.0.smithi037.stderr:+ unset _OLD_VIRTUAL_PATH 2024-09-12T17:39:21.814 INFO:tasks.workunit.client.0.smithi037.stderr:+ '[' -n '' ']' 2024-09-12T17:39:21.814 INFO:tasks.workunit.client.0.smithi037.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T17:39:21.814 INFO:tasks.workunit.client.0.smithi037.stderr:+ hash -r 2024-09-12T17:39:21.815 INFO:tasks.workunit.client.0.smithi037.stderr:+ '[' -n '' ']' 2024-09-12T17:39:21.815 INFO:tasks.workunit.client.0.smithi037.stderr:+ unset VIRTUAL_ENV 2024-09-12T17:39:21.815 INFO:tasks.workunit.client.0.smithi037.stderr:+ '[' '!' '' = nondestructive ']' 2024-09-12T17:39:21.815 INFO:tasks.workunit.client.0.smithi037.stderr:+ unset -f deactivate 2024-09-12T17:39:21.815 INFO:tasks.workunit.client.0.smithi037.stderr:+ echo OK. 2024-09-12T17:39:21.816 INFO:tasks.workunit.client.0.smithi037.stdout:OK. 2024-09-12T17:39:21.817 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:39:21.817 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:39:21.898 INFO:tasks.workunit:Stopping ['rgw/run-reshard.sh'] on client.0... 2024-09-12T17:39:21.898 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T17:39:22.321 DEBUG:teuthology.parallel:result is None 2024-09-12T17:39:22.322 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T17:39:22.364 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T17:39:22.364 DEBUG:teuthology.orchestra.run.smithi037:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T17:39:22.435 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T17:39:22.436 INFO:teuthology.run_tasks:Running task s3tests-java... 2024-09-12T17:39:22.452 DEBUG:tasks.s3tests_java:S3 Tests Java: __INIT__ 2024-09-12T17:39:22.452 DEBUG:tasks.s3tests_java:S3 Tests Java: SETUP 2024-09-12T17:39:22.452 INFO:tasks.s3tests_java:S3 Tests Java: Downloading test suite... 2024-09-12T17:39:22.453 DEBUG:teuthology.orchestra.run.smithi037:> git clone -b ceph-master https://github.com/ceph/java_s3tests.git /home/ubuntu/cephtest/s3-tests-java 2024-09-12T17:39:22.505 INFO:teuthology.orchestra.run.smithi037.stderr:Cloning into '/home/ubuntu/cephtest/s3-tests-java'... 2024-09-12T17:39:26.772 INFO:tasks.s3tests_java:S3 Tests Java: Installing required packages... 2024-09-12T17:39:26.772 DEBUG:teuthology.orchestra.run.smithi037:> /home/ubuntu/cephtest/s3-tests-java/bootstrap.sh 2024-09-12T17:39:28.901 INFO:teuthology.orchestra.run.smithi037.stderr:/home/ubuntu/cephtest/s3-tests-java/bootstrap.sh: missing required RPM packages. Installing via sudo. 2024-09-12T17:39:29.491 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:32:25 ago on Thu 12 Sep 2024 05:07:04 PM UTC. 2024-09-12T17:39:29.639 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2024-09-12T17:39:29.639 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-09-12T17:39:29.640 INFO:teuthology.orchestra.run.smithi037.stdout: Package Arch Version Repository Size 2024-09-12T17:39:29.640 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-09-12T17:39:29.640 INFO:teuthology.orchestra.run.smithi037.stdout:Installing: 2024-09-12T17:39:29.640 INFO:teuthology.orchestra.run.smithi037.stdout: java-1.8.0-openjdk x86_64 1:1.8.0.362.b09-4.el9 appstream 426 k 2024-09-12T17:39:29.640 INFO:teuthology.orchestra.run.smithi037.stdout: java-1.8.0-openjdk-devel x86_64 1:1.8.0.362.b09-4.el9 appstream 9.3 M 2024-09-12T17:39:29.640 INFO:teuthology.orchestra.run.smithi037.stdout:Installing dependencies: 2024-09-12T17:39:29.640 INFO:teuthology.orchestra.run.smithi037.stdout: java-1.8.0-openjdk-headless x86_64 1:1.8.0.362.b09-4.el9 appstream 32 M 2024-09-12T17:39:29.640 INFO:teuthology.orchestra.run.smithi037.stdout:Installing weak dependencies: 2024-09-12T17:39:29.640 INFO:teuthology.orchestra.run.smithi037.stdout: gtk2 x86_64 2.24.33-8.el9 appstream 3.5 M 2024-09-12T17:39:29.640 INFO:teuthology.orchestra.run.smithi037.stdout: libcanberra-gtk2 x86_64 0.30-27.el9 appstream 26 k 2024-09-12T17:39:29.640 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:39:29.641 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2024-09-12T17:39:29.641 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-09-12T17:39:29.641 INFO:teuthology.orchestra.run.smithi037.stdout:Install 5 Packages 2024-09-12T17:39:29.641 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:39:29.641 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 46 M 2024-09-12T17:39:29.641 INFO:teuthology.orchestra.run.smithi037.stdout:Installed size: 166 M 2024-09-12T17:39:29.642 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading Packages: 2024-09-12T17:39:29.915 INFO:teuthology.orchestra.run.smithi037.stdout:(1/5): java-1.8.0-openjdk-1.8.0.362.b09-4.el9.x 2.7 MB/s | 426 kB 00:00 2024-09-12T17:39:30.640 INFO:teuthology.orchestra.run.smithi037.stdout:(2/5): gtk2-2.24.33-8.el9.x86_64.rpm 4.0 MB/s | 3.5 MB 00:00 2024-09-12T17:39:30.682 INFO:teuthology.orchestra.run.smithi037.stdout:(3/5): libcanberra-gtk2-0.30-27.el9.x86_64.rpm 623 kB/s | 26 kB 00:00 2024-09-12T17:39:32.174 INFO:teuthology.orchestra.run.smithi037.stdout:(4/5): java-1.8.0-openjdk-devel-1.8.0.362.b09-4 3.9 MB/s | 9.3 MB 00:02 2024-09-12T17:39:35.877 INFO:teuthology.orchestra.run.smithi037.stdout:(5/5): java-1.8.0-openjdk-headless-1.8.0.362.b0 5.4 MB/s | 32 MB 00:05 2024-09-12T17:39:35.877 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2024-09-12T17:39:35.877 INFO:teuthology.orchestra.run.smithi037.stdout:Total 7.3 MB/s | 46 MB 00:06 2024-09-12T17:39:36.316 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2024-09-12T17:39:36.339 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction check succeeded. 2024-09-12T17:39:36.339 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2024-09-12T17:39:36.845 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded. 2024-09-12T17:39:36.846 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2024-09-12T17:39:37.387 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 1/1 2024-09-12T17:39:37.542 INFO:teuthology.orchestra.run.smithi037.stdout: Preparing : 1/1 2024-09-12T17:39:37.722 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libcanberra-gtk2-0.30-27.el9.x86_64 1/5 2024-09-12T17:39:38.360 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : gtk2-2.24.33-8.el9.x86_64 2/5 2024-09-12T17:39:38.401 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 3/5 2024-09-12T17:39:38.653 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 3/5 2024-09-12T17:39:38.685 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 4/5 2024-09-12T17:39:38.927 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 4/5 2024-09-12T17:39:38.964 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_6 5/5 2024-09-12T17:39:38.973 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_6 5/5 2024-09-12T17:39:38.982 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 5/5 2024-09-12T17:39:39.016 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 5/5 2024-09-12T17:39:42.142 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_6 5/5 2024-09-12T17:39:42.142 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : gtk2-2.24.33-8.el9.x86_64 1/5 2024-09-12T17:39:42.142 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 2/5 2024-09-12T17:39:42.142 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_6 3/5 2024-09-12T17:39:42.142 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 4/5 2024-09-12T17:39:42.676 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libcanberra-gtk2-0.30-27.el9.x86_64 5/5 2024-09-12T17:39:42.676 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:39:42.676 INFO:teuthology.orchestra.run.smithi037.stdout:Installed: 2024-09-12T17:39:42.676 INFO:teuthology.orchestra.run.smithi037.stdout: gtk2-2.24.33-8.el9.x86_64 2024-09-12T17:39:42.676 INFO:teuthology.orchestra.run.smithi037.stdout: java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 2024-09-12T17:39:42.677 INFO:teuthology.orchestra.run.smithi037.stdout: java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_64 2024-09-12T17:39:42.677 INFO:teuthology.orchestra.run.smithi037.stdout: java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x86_64 2024-09-12T17:39:42.677 INFO:teuthology.orchestra.run.smithi037.stdout: libcanberra-gtk2-0.30-27.el9.x86_64 2024-09-12T17:39:42.677 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:39:42.677 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2024-09-12T17:39:43.110 INFO:teuthology.orchestra.run.smithi037.stdout: Gradle will be installed under /opt/gradle 2024-09-12T17:39:43.212 INFO:teuthology.orchestra.run.smithi037.stderr:--2024-09-12 17:39:43-- https://services.gradle.org/distributions/gradle-6.0.1-bin.zip 2024-09-12T17:39:43.537 INFO:teuthology.orchestra.run.smithi037.stderr:Resolving services.gradle.org (services.gradle.org)... 104.16.72.101, 104.16.73.101, 2606:4700::6810:4965, ... 2024-09-12T17:39:43.551 INFO:teuthology.orchestra.run.smithi037.stderr:Connecting to services.gradle.org (services.gradle.org)|104.16.72.101|:443... connected. 2024-09-12T17:39:43.621 INFO:teuthology.orchestra.run.smithi037.stderr:HTTP request sent, awaiting response... 301 Moved Permanently 2024-09-12T17:39:43.621 INFO:teuthology.orchestra.run.smithi037.stderr:Location: https://github.com/gradle/gradle-distributions/releases/download/v6.0.1/gradle-6.0.1-bin.zip [following] 2024-09-12T17:39:43.622 INFO:teuthology.orchestra.run.smithi037.stderr:--2024-09-12 17:39:43-- https://github.com/gradle/gradle-distributions/releases/download/v6.0.1/gradle-6.0.1-bin.zip 2024-09-12T17:39:43.622 INFO:teuthology.orchestra.run.smithi037.stderr:Resolving github.com (github.com)... 140.82.112.4 2024-09-12T17:39:43.631 INFO:teuthology.orchestra.run.smithi037.stderr:Connecting to github.com (github.com)|140.82.112.4|:443... connected. 2024-09-12T17:39:43.772 INFO:teuthology.orchestra.run.smithi037.stderr:HTTP request sent, awaiting response... 302 Found 2024-09-12T17:39:43.772 INFO:teuthology.orchestra.run.smithi037.stderr:Location: https://objects.githubusercontent.com/github-production-release-asset-2e65be/696192900/8f418ba1-c336-448c-95c6-5180382113cb?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=releaseassetproduction%2F20240912%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20240912T173943Z&X-Amz-Expires=300&X-Amz-Signature=cb63e86558674d4ad247544e843e9b7cbf58fd633d207c8b1cb963bfb32a5a70&X-Amz-SignedHeaders=host&actor_id=0&key_id=0&repo_id=696192900&response-content-disposition=attachment%3B%20filename%3Dgradle-6.0.1-bin.zip&response-content-type=application%2Foctet-stream [following] 2024-09-12T17:39:43.772 INFO:teuthology.orchestra.run.smithi037.stderr:--2024-09-12 17:39:43-- https://objects.githubusercontent.com/github-production-release-asset-2e65be/696192900/8f418ba1-c336-448c-95c6-5180382113cb?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=releaseassetproduction%2F20240912%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20240912T173943Z&X-Amz-Expires=300&X-Amz-Signature=cb63e86558674d4ad247544e843e9b7cbf58fd633d207c8b1cb963bfb32a5a70&X-Amz-SignedHeaders=host&actor_id=0&key_id=0&repo_id=696192900&response-content-disposition=attachment%3B%20filename%3Dgradle-6.0.1-bin.zip&response-content-type=application%2Foctet-stream 2024-09-12T17:39:43.772 INFO:teuthology.orchestra.run.smithi037.stderr:Resolving objects.githubusercontent.com (objects.githubusercontent.com)... 185.199.110.133, 185.199.109.133, 185.199.108.133, ... 2024-09-12T17:39:43.784 INFO:teuthology.orchestra.run.smithi037.stderr:Connecting to objects.githubusercontent.com (objects.githubusercontent.com)|185.199.110.133|:443... connected. 2024-09-12T17:39:43.862 INFO:teuthology.orchestra.run.smithi037.stderr:HTTP request sent, awaiting response... 200 OK 2024-09-12T17:39:43.862 INFO:teuthology.orchestra.run.smithi037.stderr:Length: 95129672 (91M) [application/octet-stream] 2024-09-12T17:39:43.862 INFO:teuthology.orchestra.run.smithi037.stderr:Saving to: ‘gradle-6.0.1-bin.zip’ 2024-09-12T17:39:43.863 INFO:teuthology.orchestra.run.smithi037.stderr: 2024-09-12T17:39:43.875 INFO:teuthology.orchestra.run.smithi037.stderr: 0K .......... .......... .......... .......... .......... 0% 3.49M 26s 2024-09-12T17:39:43.887 INFO:teuthology.orchestra.run.smithi037.stderr: 50K .......... .......... .......... .......... .......... 0% 4.06M 24s 2024-09-12T17:39:43.896 INFO:teuthology.orchestra.run.smithi037.stderr: 100K .......... .......... .......... .......... .......... 0% 5.52M 22s 2024-09-12T17:39:43.898 INFO:teuthology.orchestra.run.smithi037.stderr: 150K .......... .......... .......... .......... .......... 0% 23.7M 17s 2024-09-12T17:39:43.900 INFO:teuthology.orchestra.run.smithi037.stderr: 200K .......... .......... .......... .......... .......... 0% 22.2M 14s 2024-09-12T17:39:43.903 INFO:teuthology.orchestra.run.smithi037.stderr: 250K .......... .......... .......... .......... .......... 0% 29.9M 13s 2024-09-12T17:39:43.909 INFO:teuthology.orchestra.run.smithi037.stderr: 300K .......... .......... .......... .......... .......... 0% 7.10M 13s 2024-09-12T17:39:43.913 INFO:teuthology.orchestra.run.smithi037.stderr: 350K .......... .......... .......... .......... .......... 0% 48.4M 11s 2024-09-12T17:39:43.913 INFO:teuthology.orchestra.run.smithi037.stderr: 400K .......... .......... .......... .......... .......... 0% 32.1M 10s 2024-09-12T17:39:43.913 INFO:teuthology.orchestra.run.smithi037.stderr: 450K .......... .......... .......... .......... .......... 0% 110M 9s 2024-09-12T17:39:43.917 INFO:teuthology.orchestra.run.smithi037.stderr: 500K .......... .......... .......... .......... .......... 0% 69.5M 9s 2024-09-12T17:39:43.918 INFO:teuthology.orchestra.run.smithi037.stderr: 550K .......... .......... .......... .......... .......... 0% 43.8M 8s 2024-09-12T17:39:43.920 INFO:teuthology.orchestra.run.smithi037.stderr: 600K .......... .......... .......... .......... .......... 0% 9.01M 8s 2024-09-12T17:39:45.505 INFO:teuthology.orchestra.run.smithi037.stderr: 650K .......... .......... .......... .......... .......... 0% 117M 8s 2024-09-12T17:39:45.505 INFO:teuthology.orchestra.run.smithi037.stderr: 700K .......... .......... .......... .......... .......... 0% 29.1M 7s 2024-09-12T17:39:45.505 INFO:teuthology.orchestra.run.smithi037.stderr: 750K .......... .......... .......... .......... .......... 0% 268M 7s 2024-09-12T17:39:45.506 INFO:teuthology.orchestra.run.smithi037.stderr: 800K .......... .......... .......... .......... .......... 0% 69.0M 7s 2024-09-12T17:39:45.506 INFO:teuthology.orchestra.run.smithi037.stderr: 850K .......... .......... .......... .......... .......... 0% 49.0M 6s 2024-09-12T17:39:45.506 INFO:teuthology.orchestra.run.smithi037.stderr: 900K .......... .......... .......... .......... .......... 1% 210M 6s 2024-09-12T17:39:45.506 INFO:teuthology.orchestra.run.smithi037.stderr: 950K .......... .......... .......... .......... .......... 1% 272M 6s 2024-09-12T17:39:45.506 INFO:teuthology.orchestra.run.smithi037.stderr: 1000K .......... .......... .......... .......... .......... 1% 85.2M 5s 2024-09-12T17:39:45.506 INFO:teuthology.orchestra.run.smithi037.stderr: 1050K .......... .......... .......... .......... .......... 1% 84.1M 5s 2024-09-12T17:39:45.506 INFO:teuthology.orchestra.run.smithi037.stderr: 1100K .......... .......... .......... .......... .......... 1% 75.2M 5s 2024-09-12T17:39:45.506 INFO:teuthology.orchestra.run.smithi037.stderr: 1150K .......... .......... .......... .......... .......... 1% 98.7M 5s 2024-09-12T17:39:45.506 INFO:teuthology.orchestra.run.smithi037.stderr: 1200K .......... .......... .......... .......... .......... 1% 240M 5s 2024-09-12T17:39:45.506 INFO:teuthology.orchestra.run.smithi037.stderr: 1250K .......... .......... .......... .......... .......... 1% 9.23M 5s 2024-09-12T17:39:45.506 INFO:teuthology.orchestra.run.smithi037.stderr: 1300K .......... .......... .......... .......... .......... 1% 260M 5s 2024-09-12T17:39:45.506 INFO:teuthology.orchestra.run.smithi037.stderr: 1350K .......... .......... .......... .......... .......... 1% 87.9M 5s 2024-09-12T17:39:45.506 INFO:teuthology.orchestra.run.smithi037.stderr: 1400K .......... .......... .......... .......... .......... 1% 288M 4s 2024-09-12T17:39:45.507 INFO:teuthology.orchestra.run.smithi037.stderr: 1450K .......... .......... .......... .......... .......... 1% 282M 4s 2024-09-12T17:39:45.507 INFO:teuthology.orchestra.run.smithi037.stderr: 1500K .......... .......... .......... .......... .......... 1% 101M 4s 2024-09-12T17:39:45.507 INFO:teuthology.orchestra.run.smithi037.stderr: 1550K .......... .......... .......... .......... .......... 1% 121M 4s 2024-09-12T17:39:45.507 INFO:teuthology.orchestra.run.smithi037.stderr: 1600K .......... .......... .......... .......... .......... 1% 137M 4s 2024-09-12T17:39:45.507 INFO:teuthology.orchestra.run.smithi037.stderr: 1650K .......... .......... .......... .......... .......... 1% 319M 4s 2024-09-12T17:39:45.507 INFO:teuthology.orchestra.run.smithi037.stderr: 1700K .......... .......... .......... .......... .......... 1% 123M 4s 2024-09-12T17:39:45.507 INFO:teuthology.orchestra.run.smithi037.stderr: 1750K .......... .......... .......... .......... .......... 1% 137M 4s 2024-09-12T17:39:45.507 INFO:teuthology.orchestra.run.smithi037.stderr: 1800K .......... .......... .......... .......... .......... 1% 154M 4s 2024-09-12T17:39:45.507 INFO:teuthology.orchestra.run.smithi037.stderr: 1850K .......... .......... .......... .......... .......... 2% 311M 4s 2024-09-12T17:39:45.507 INFO:teuthology.orchestra.run.smithi037.stderr: 1900K .......... .......... .......... .......... .......... 2% 129M 3s 2024-09-12T17:39:45.507 INFO:teuthology.orchestra.run.smithi037.stderr: 1950K .......... .......... .......... .......... .......... 2% 166M 3s 2024-09-12T17:39:45.507 INFO:teuthology.orchestra.run.smithi037.stderr: 2000K .......... .......... .......... .......... .......... 2% 164M 3s 2024-09-12T17:39:45.507 INFO:teuthology.orchestra.run.smithi037.stderr: 2050K .......... .......... .......... .......... .......... 2% 163M 3s 2024-09-12T17:39:45.507 INFO:teuthology.orchestra.run.smithi037.stderr: 2100K .......... .......... .......... .......... .......... 2% 253M 3s 2024-09-12T17:39:45.508 INFO:teuthology.orchestra.run.smithi037.stderr: 2150K .......... .......... .......... .......... .......... 2% 173M 3s 2024-09-12T17:39:45.508 INFO:teuthology.orchestra.run.smithi037.stderr: 2200K .......... .......... .......... .......... .......... 2% 17.9M 3s 2024-09-12T17:39:45.508 INFO:teuthology.orchestra.run.smithi037.stderr: 2250K .......... .......... .......... .......... .......... 2% 46.2M 3s 2024-09-12T17:39:45.508 INFO:teuthology.orchestra.run.smithi037.stderr: 2300K .......... .......... .......... .......... .......... 2% 132M 3s 2024-09-12T17:39:45.508 INFO:teuthology.orchestra.run.smithi037.stderr: 2350K .......... .......... .......... .......... .......... 2% 317M 3s 2024-09-12T17:39:45.508 INFO:teuthology.orchestra.run.smithi037.stderr: 2400K .......... .......... .......... .......... .......... 2% 289M 3s 2024-09-12T17:39:45.508 INFO:teuthology.orchestra.run.smithi037.stderr: 2450K .......... .......... .......... .......... .......... 2% 306M 3s 2024-09-12T17:39:45.508 INFO:teuthology.orchestra.run.smithi037.stderr: 2500K .......... .......... .......... .......... .......... 2% 37.8M 3s 2024-09-12T17:39:45.508 INFO:teuthology.orchestra.run.smithi037.stderr: 2550K .......... .......... .......... .......... .......... 2% 190M 3s 2024-09-12T17:39:45.508 INFO:teuthology.orchestra.run.smithi037.stderr: 2600K .......... .......... .......... .......... .......... 2% 197M 3s 2024-09-12T17:39:45.508 INFO:teuthology.orchestra.run.smithi037.stderr: 2650K .......... .......... .......... .......... .......... 2% 305M 3s 2024-09-12T17:39:45.508 INFO:teuthology.orchestra.run.smithi037.stderr: 2700K .......... .......... .......... .......... .......... 2% 245M 3s 2024-09-12T17:39:45.508 INFO:teuthology.orchestra.run.smithi037.stderr: 2750K .......... .......... .......... .......... .......... 3% 225M 3s 2024-09-12T17:39:45.508 INFO:teuthology.orchestra.run.smithi037.stderr: 2800K .......... .......... .......... .......... .......... 3% 296M 3s 2024-09-12T17:39:45.509 INFO:teuthology.orchestra.run.smithi037.stderr: 2850K .......... .......... .......... .......... .......... 3% 238M 3s 2024-09-12T17:39:45.509 INFO:teuthology.orchestra.run.smithi037.stderr: 2900K .......... .......... .......... .......... .......... 3% 205M 3s 2024-09-12T17:39:45.509 INFO:teuthology.orchestra.run.smithi037.stderr: 2950K .......... .......... .......... .......... .......... 3% 291M 2s 2024-09-12T17:39:45.509 INFO:teuthology.orchestra.run.smithi037.stderr: 3000K .......... .......... .......... .......... .......... 3% 285M 2s 2024-09-12T17:39:45.509 INFO:teuthology.orchestra.run.smithi037.stderr: 3050K .......... .......... .......... .......... .......... 3% 295M 2s 2024-09-12T17:39:45.509 INFO:teuthology.orchestra.run.smithi037.stderr: 3100K .......... .......... .......... .......... .......... 3% 223M 2s 2024-09-12T17:39:45.509 INFO:teuthology.orchestra.run.smithi037.stderr: 3150K .......... .......... .......... .......... .......... 3% 296M 2s 2024-09-12T17:39:45.509 INFO:teuthology.orchestra.run.smithi037.stderr: 3200K .......... .......... .......... .......... .......... 3% 236M 2s 2024-09-12T17:39:45.509 INFO:teuthology.orchestra.run.smithi037.stderr: 3250K .......... .......... .......... .......... .......... 3% 272M 2s 2024-09-12T17:39:45.509 INFO:teuthology.orchestra.run.smithi037.stderr: 3300K .......... .......... .......... .......... .......... 3% 270M 2s 2024-09-12T17:39:45.509 INFO:teuthology.orchestra.run.smithi037.stderr: 3350K .......... .......... .......... .......... .......... 3% 298M 2s 2024-09-12T17:39:45.509 INFO:teuthology.orchestra.run.smithi037.stderr: 3400K .......... .......... .......... .......... .......... 3% 298M 2s 2024-09-12T17:39:45.509 INFO:teuthology.orchestra.run.smithi037.stderr: 3450K .......... .......... .......... .......... .......... 3% 318M 2s 2024-09-12T17:39:45.509 INFO:teuthology.orchestra.run.smithi037.stderr: 3500K .......... .......... .......... .......... .......... 3% 278M 2s 2024-09-12T17:39:45.510 INFO:teuthology.orchestra.run.smithi037.stderr: 3550K .......... .......... .......... .......... .......... 3% 292M 2s 2024-09-12T17:39:45.510 INFO:teuthology.orchestra.run.smithi037.stderr: 3600K .......... .......... .......... .......... .......... 3% 304M 2s 2024-09-12T17:39:45.510 INFO:teuthology.orchestra.run.smithi037.stderr: 3650K .......... .......... .......... .......... .......... 3% 341M 2s 2024-09-12T17:39:45.510 INFO:teuthology.orchestra.run.smithi037.stderr: 3700K .......... .......... .......... .......... .......... 4% 297M 2s 2024-09-12T17:39:45.510 INFO:teuthology.orchestra.run.smithi037.stderr: 3750K .......... .......... .......... .......... .......... 4% 308M 2s 2024-09-12T17:39:45.510 INFO:teuthology.orchestra.run.smithi037.stderr: 3800K .......... .......... .......... .......... .......... 4% 335M 2s 2024-09-12T17:39:45.510 INFO:teuthology.orchestra.run.smithi037.stderr: 3850K .......... .......... .......... .......... .......... 4% 334M 2s 2024-09-12T17:39:45.510 INFO:teuthology.orchestra.run.smithi037.stderr: 3900K .......... .......... .......... .......... .......... 4% 276M 2s 2024-09-12T17:39:45.510 INFO:teuthology.orchestra.run.smithi037.stderr: 3950K .......... .......... .......... .......... .......... 4% 339M 2s 2024-09-12T17:39:45.510 INFO:teuthology.orchestra.run.smithi037.stderr: 4000K .......... .......... .......... .......... .......... 4% 322M 2s 2024-09-12T17:39:45.510 INFO:teuthology.orchestra.run.smithi037.stderr: 4050K .......... .......... .......... .......... .......... 4% 331M 2s 2024-09-12T17:39:45.510 INFO:teuthology.orchestra.run.smithi037.stderr: 4100K .......... .......... .......... .......... .......... 4% 260M 2s 2024-09-12T17:39:45.510 INFO:teuthology.orchestra.run.smithi037.stderr: 4150K .......... .......... .......... .......... .......... 4% 321M 2s 2024-09-12T17:39:45.510 INFO:teuthology.orchestra.run.smithi037.stderr: 4200K .......... .......... .......... .......... .......... 4% 276M 2s 2024-09-12T17:39:45.510 INFO:teuthology.orchestra.run.smithi037.stderr: 4250K .......... .......... .......... .......... .......... 4% 198M 2s 2024-09-12T17:39:45.511 INFO:teuthology.orchestra.run.smithi037.stderr: 4300K .......... .......... .......... .......... .......... 4% 259M 2s 2024-09-12T17:39:45.511 INFO:teuthology.orchestra.run.smithi037.stderr: 4350K .......... .......... .......... .......... .......... 4% 300M 2s 2024-09-12T17:39:45.511 INFO:teuthology.orchestra.run.smithi037.stderr: 4400K .......... .......... .......... .......... .......... 4% 14.0M 2s 2024-09-12T17:39:45.511 INFO:teuthology.orchestra.run.smithi037.stderr: 4450K .......... .......... .......... .......... .......... 4% 239M 2s 2024-09-12T17:39:45.511 INFO:teuthology.orchestra.run.smithi037.stderr: 4500K .......... .......... .......... .......... .......... 4% 271M 2s 2024-09-12T17:39:45.511 INFO:teuthology.orchestra.run.smithi037.stderr: 4550K .......... .......... .......... .......... .......... 4% 297M 2s 2024-09-12T17:39:45.511 INFO:teuthology.orchestra.run.smithi037.stderr: 4600K .......... .......... .......... .......... .......... 5% 286M 2s 2024-09-12T17:39:45.511 INFO:teuthology.orchestra.run.smithi037.stderr: 4650K .......... .......... .......... .......... .......... 5% 309M 2s 2024-09-12T17:39:45.511 INFO:teuthology.orchestra.run.smithi037.stderr: 4700K .......... .......... .......... .......... .......... 5% 331M 2s 2024-09-12T17:39:45.511 INFO:teuthology.orchestra.run.smithi037.stderr: 4750K .......... .......... .......... .......... .......... 5% 315M 2s 2024-09-12T17:39:45.511 INFO:teuthology.orchestra.run.smithi037.stderr: 4800K .......... .......... .......... .......... .......... 5% 244M 2s 2024-09-12T17:39:45.511 INFO:teuthology.orchestra.run.smithi037.stderr: 4850K .......... .......... .......... .......... .......... 5% 311M 2s 2024-09-12T17:39:45.511 INFO:teuthology.orchestra.run.smithi037.stderr: 4900K .......... .......... .......... .......... .......... 5% 334M 2s 2024-09-12T17:39:45.511 INFO:teuthology.orchestra.run.smithi037.stderr: 4950K .......... .......... .......... .......... .......... 5% 338M 2s 2024-09-12T17:39:45.512 INFO:teuthology.orchestra.run.smithi037.stderr: 5000K .......... .......... .......... .......... .......... 5% 278M 2s 2024-09-12T17:39:45.512 INFO:teuthology.orchestra.run.smithi037.stderr: 5050K .......... .......... .......... .......... .......... 5% 313M 2s 2024-09-12T17:39:45.512 INFO:teuthology.orchestra.run.smithi037.stderr: 5100K .......... .......... .......... .......... .......... 5% 312M 2s 2024-09-12T17:39:45.512 INFO:teuthology.orchestra.run.smithi037.stderr: 5150K .......... .......... .......... .......... .......... 5% 325M 2s 2024-09-12T17:39:45.512 INFO:teuthology.orchestra.run.smithi037.stderr: 5200K .......... .......... .......... .......... .......... 5% 284M 2s 2024-09-12T17:39:45.512 INFO:teuthology.orchestra.run.smithi037.stderr: 5250K .......... .......... .......... .......... .......... 5% 310M 2s 2024-09-12T17:39:45.512 INFO:teuthology.orchestra.run.smithi037.stderr: 5300K .......... .......... .......... .......... .......... 5% 315M 2s 2024-09-12T17:39:45.512 INFO:teuthology.orchestra.run.smithi037.stderr: 5350K .......... .......... .......... .......... .......... 5% 247M 2s 2024-09-12T17:39:45.512 INFO:teuthology.orchestra.run.smithi037.stderr: 5400K .......... .......... .......... .......... .......... 5% 252M 2s 2024-09-12T17:39:45.512 INFO:teuthology.orchestra.run.smithi037.stderr: 5450K .......... .......... .......... .......... .......... 5% 333M 2s 2024-09-12T17:39:45.512 INFO:teuthology.orchestra.run.smithi037.stderr: 5500K .......... .......... .......... .......... .......... 5% 328M 1s 2024-09-12T17:39:45.512 INFO:teuthology.orchestra.run.smithi037.stderr: 5550K .......... .......... .......... .......... .......... 6% 293M 1s 2024-09-12T17:39:45.512 INFO:teuthology.orchestra.run.smithi037.stderr: 5600K .......... .......... .......... .......... .......... 6% 262M 1s 2024-09-12T17:39:45.512 INFO:teuthology.orchestra.run.smithi037.stderr: 5650K .......... .......... .......... .......... .......... 6% 342M 1s 2024-09-12T17:39:45.512 INFO:teuthology.orchestra.run.smithi037.stderr: 5700K .......... .......... .......... .......... .......... 6% 290M 1s 2024-09-12T17:39:45.513 INFO:teuthology.orchestra.run.smithi037.stderr: 5750K .......... .......... .......... .......... .......... 6% 326M 1s 2024-09-12T17:39:45.513 INFO:teuthology.orchestra.run.smithi037.stderr: 5800K .......... .......... .......... .......... .......... 6% 289M 1s 2024-09-12T17:39:45.513 INFO:teuthology.orchestra.run.smithi037.stderr: 5850K .......... .......... .......... .......... .......... 6% 319M 1s 2024-09-12T17:39:45.513 INFO:teuthology.orchestra.run.smithi037.stderr: 5900K .......... .......... .......... .......... .......... 6% 301M 1s 2024-09-12T17:39:45.513 INFO:teuthology.orchestra.run.smithi037.stderr: 5950K .......... .......... .......... .......... .......... 6% 323M 1s 2024-09-12T17:39:45.513 INFO:teuthology.orchestra.run.smithi037.stderr: 6000K .......... .......... .......... .......... .......... 6% 282M 1s 2024-09-12T17:39:45.513 INFO:teuthology.orchestra.run.smithi037.stderr: 6050K .......... .......... .......... .......... .......... 6% 334M 1s 2024-09-12T17:39:45.513 INFO:teuthology.orchestra.run.smithi037.stderr: 6100K .......... .......... .......... .......... .......... 6% 321M 1s 2024-09-12T17:39:45.513 INFO:teuthology.orchestra.run.smithi037.stderr: 6150K .......... .......... .......... .......... .......... 6% 328M 1s 2024-09-12T17:39:45.513 INFO:teuthology.orchestra.run.smithi037.stderr: 6200K .......... .......... .......... .......... .......... 6% 316M 1s 2024-09-12T17:39:45.513 INFO:teuthology.orchestra.run.smithi037.stderr: 6250K .......... .......... .......... .......... .......... 6% 303M 1s 2024-09-12T17:39:45.513 INFO:teuthology.orchestra.run.smithi037.stderr: 6300K .......... .......... .......... .......... .......... 6% 322M 1s 2024-09-12T17:39:45.513 INFO:teuthology.orchestra.run.smithi037.stderr: 6350K .......... .......... .......... .......... .......... 6% 298M 1s 2024-09-12T17:39:45.514 INFO:teuthology.orchestra.run.smithi037.stderr: 6400K .......... .......... .......... .......... .......... 6% 253M 1s 2024-09-12T17:39:45.514 INFO:teuthology.orchestra.run.smithi037.stderr: 6450K .......... .......... .......... .......... .......... 6% 325M 1s 2024-09-12T17:39:45.514 INFO:teuthology.orchestra.run.smithi037.stderr: 6500K .......... .......... .......... .......... .......... 7% 301M 1s 2024-09-12T17:39:45.514 INFO:teuthology.orchestra.run.smithi037.stderr: 6550K .......... .......... .......... .......... .......... 7% 265M 1s 2024-09-12T17:39:45.514 INFO:teuthology.orchestra.run.smithi037.stderr: 6600K .......... .......... .......... .......... .......... 7% 279M 1s 2024-09-12T17:39:45.514 INFO:teuthology.orchestra.run.smithi037.stderr: 6650K .......... .......... .......... .......... .......... 7% 315M 1s 2024-09-12T17:39:45.514 INFO:teuthology.orchestra.run.smithi037.stderr: 6700K .......... .......... .......... .......... .......... 7% 321M 1s 2024-09-12T17:39:45.514 INFO:teuthology.orchestra.run.smithi037.stderr: 6750K .......... .......... .......... .......... .......... 7% 300M 1s 2024-09-12T17:39:45.514 INFO:teuthology.orchestra.run.smithi037.stderr: 6800K .......... .......... .......... .......... .......... 7% 264M 1s 2024-09-12T17:39:45.514 INFO:teuthology.orchestra.run.smithi037.stderr: 6850K .......... .......... .......... .......... .......... 7% 290M 1s 2024-09-12T17:39:45.514 INFO:teuthology.orchestra.run.smithi037.stderr: 6900K .......... .......... .......... .......... .......... 7% 291M 1s 2024-09-12T17:39:45.514 INFO:teuthology.orchestra.run.smithi037.stderr: 6950K .......... .......... .......... .......... .......... 7% 292M 1s 2024-09-12T17:39:45.514 INFO:teuthology.orchestra.run.smithi037.stderr: 7000K .......... .......... .......... .......... .......... 7% 280M 1s 2024-09-12T17:39:45.514 INFO:teuthology.orchestra.run.smithi037.stderr: 7050K .......... .......... .......... .......... .......... 7% 280M 1s 2024-09-12T17:39:45.514 INFO:teuthology.orchestra.run.smithi037.stderr: 7100K .......... .......... .......... .......... .......... 7% 226M 1s 2024-09-12T17:39:45.515 INFO:teuthology.orchestra.run.smithi037.stderr: 7150K .......... .......... .......... .......... .......... 7% 303M 1s 2024-09-12T17:39:45.515 INFO:teuthology.orchestra.run.smithi037.stderr: 7200K .......... .......... .......... .......... .......... 7% 286M 1s 2024-09-12T17:39:45.515 INFO:teuthology.orchestra.run.smithi037.stderr: 7250K .......... .......... .......... .......... .......... 7% 313M 1s 2024-09-12T17:39:45.515 INFO:teuthology.orchestra.run.smithi037.stderr: 7300K .......... .......... .......... .......... .......... 7% 278M 1s 2024-09-12T17:39:45.515 INFO:teuthology.orchestra.run.smithi037.stderr: 7350K .......... .......... .......... .......... .......... 7% 265M 1s 2024-09-12T17:39:45.515 INFO:teuthology.orchestra.run.smithi037.stderr: 7400K .......... .......... .......... .......... .......... 8% 29.5M 1s 2024-09-12T17:39:45.515 INFO:teuthology.orchestra.run.smithi037.stderr: 7450K .......... .......... .......... .......... .......... 8% 293M 1s 2024-09-12T17:39:45.515 INFO:teuthology.orchestra.run.smithi037.stderr: 7500K .......... .......... .......... .......... .......... 8% 265M 1s 2024-09-12T17:39:45.515 INFO:teuthology.orchestra.run.smithi037.stderr: 7550K .......... .......... .......... .......... .......... 8% 201M 1s 2024-09-12T17:39:45.515 INFO:teuthology.orchestra.run.smithi037.stderr: 7600K .......... .......... .......... .......... .......... 8% 237M 1s 2024-09-12T17:39:45.515 INFO:teuthology.orchestra.run.smithi037.stderr: 7650K .......... .......... .......... .......... .......... 8% 346M 1s 2024-09-12T17:39:45.515 INFO:teuthology.orchestra.run.smithi037.stderr: 7700K .......... .......... .......... .......... .......... 8% 316M 1s 2024-09-12T17:39:45.515 INFO:teuthology.orchestra.run.smithi037.stderr: 7750K .......... .......... .......... .......... .......... 8% 248M 1s 2024-09-12T17:39:45.515 INFO:teuthology.orchestra.run.smithi037.stderr: 7800K .......... .......... .......... .......... .......... 8% 155M 1s 2024-09-12T17:39:45.516 INFO:teuthology.orchestra.run.smithi037.stderr: 7850K .......... .......... .......... .......... .......... 8% 282M 1s 2024-09-12T17:39:45.516 INFO:teuthology.orchestra.run.smithi037.stderr: 7900K .......... .......... .......... .......... .......... 8% 284M 1s 2024-09-12T17:39:45.516 INFO:teuthology.orchestra.run.smithi037.stderr: 7950K .......... .......... .......... .......... .......... 8% 365M 1s 2024-09-12T17:39:45.516 INFO:teuthology.orchestra.run.smithi037.stderr: 8000K .......... .......... .......... .......... .......... 8% 313M 1s 2024-09-12T17:39:45.516 INFO:teuthology.orchestra.run.smithi037.stderr: 8050K .......... .......... .......... .......... .......... 8% 333M 1s 2024-09-12T17:39:45.516 INFO:teuthology.orchestra.run.smithi037.stderr: 8100K .......... .......... .......... .......... .......... 8% 275M 1s 2024-09-12T17:39:45.516 INFO:teuthology.orchestra.run.smithi037.stderr: 8150K .......... .......... .......... .......... .......... 8% 336M 1s 2024-09-12T17:39:45.516 INFO:teuthology.orchestra.run.smithi037.stderr: 8200K .......... .......... .......... .......... .......... 8% 197M 1s 2024-09-12T17:39:45.516 INFO:teuthology.orchestra.run.smithi037.stderr: 8250K .......... .......... .......... .......... .......... 8% 323M 1s 2024-09-12T17:39:45.516 INFO:teuthology.orchestra.run.smithi037.stderr: 8300K .......... .......... .......... .......... .......... 8% 246M 1s 2024-09-12T17:39:45.516 INFO:teuthology.orchestra.run.smithi037.stderr: 8350K .......... .......... .......... .......... .......... 9% 291M 1s 2024-09-12T17:39:45.516 INFO:teuthology.orchestra.run.smithi037.stderr: 8400K .......... .......... .......... .......... .......... 9% 364M 1s 2024-09-12T17:39:45.516 INFO:teuthology.orchestra.run.smithi037.stderr: 8450K .......... .......... .......... .......... .......... 9% 354M 1s 2024-09-12T17:39:45.516 INFO:teuthology.orchestra.run.smithi037.stderr: 8500K .......... .......... .......... .......... .......... 9% 294M 1s 2024-09-12T17:39:45.516 INFO:teuthology.orchestra.run.smithi037.stderr: 8550K .......... .......... .......... .......... .......... 9% 306M 1s 2024-09-12T17:39:45.517 INFO:teuthology.orchestra.run.smithi037.stderr: 8600K .......... .......... .......... .......... .......... 9% 319M 1s 2024-09-12T17:39:45.517 INFO:teuthology.orchestra.run.smithi037.stderr: 8650K .......... .......... .......... .......... .......... 9% 340M 1s 2024-09-12T17:39:45.517 INFO:teuthology.orchestra.run.smithi037.stderr: 8700K .......... .......... .......... .......... .......... 9% 277M 1s 2024-09-12T17:39:45.517 INFO:teuthology.orchestra.run.smithi037.stderr: 8750K .......... .......... .......... .......... .......... 9% 327M 1s 2024-09-12T17:39:45.517 INFO:teuthology.orchestra.run.smithi037.stderr: 8800K .......... .......... .......... .......... .......... 9% 341M 1s 2024-09-12T17:39:45.517 INFO:teuthology.orchestra.run.smithi037.stderr: 8850K .......... .......... .......... .......... .......... 9% 251M 1s 2024-09-12T17:39:45.517 INFO:teuthology.orchestra.run.smithi037.stderr: 8900K .......... .......... .......... .......... .......... 9% 297M 1s 2024-09-12T17:39:45.517 INFO:teuthology.orchestra.run.smithi037.stderr: 8950K .......... .......... .......... .......... .......... 9% 304M 1s 2024-09-12T17:39:45.517 INFO:teuthology.orchestra.run.smithi037.stderr: 9000K .......... .......... .......... .......... .......... 9% 321M 1s 2024-09-12T17:39:45.517 INFO:teuthology.orchestra.run.smithi037.stderr: 9050K .......... .......... .......... .......... .......... 9% 316M 1s 2024-09-12T17:39:45.517 INFO:teuthology.orchestra.run.smithi037.stderr: 9100K .......... .......... .......... .......... .......... 9% 229M 1s 2024-09-12T17:39:45.517 INFO:teuthology.orchestra.run.smithi037.stderr: 9150K .......... .......... .......... .......... .......... 9% 325M 1s 2024-09-12T17:39:45.517 INFO:teuthology.orchestra.run.smithi037.stderr: 9200K .......... .......... .......... .......... .......... 9% 349M 1s 2024-09-12T17:39:45.517 INFO:teuthology.orchestra.run.smithi037.stderr: 9250K .......... .......... .......... .......... .......... 10% 120M 1s 2024-09-12T17:39:45.517 INFO:teuthology.orchestra.run.smithi037.stderr: 9300K .......... .......... .......... .......... .......... 10% 82.6M 1s 2024-09-12T17:39:45.518 INFO:teuthology.orchestra.run.smithi037.stderr: 9350K .......... .......... .......... .......... .......... 10% 239M 1s 2024-09-12T17:39:45.518 INFO:teuthology.orchestra.run.smithi037.stderr: 9400K .......... .......... .......... .......... .......... 10% 257M 1s 2024-09-12T17:39:45.518 INFO:teuthology.orchestra.run.smithi037.stderr: 9450K .......... .......... .......... .......... .......... 10% 124M 1s 2024-09-12T17:39:45.518 INFO:teuthology.orchestra.run.smithi037.stderr: 9500K .......... .......... .......... .......... .......... 10% 251M 1s 2024-09-12T17:39:45.518 INFO:teuthology.orchestra.run.smithi037.stderr: 9550K .......... .......... .......... .......... .......... 10% 316M 1s 2024-09-12T17:39:45.518 INFO:teuthology.orchestra.run.smithi037.stderr: 9600K .......... .......... .......... .......... .......... 10% 274M 1s 2024-09-12T17:39:45.518 INFO:teuthology.orchestra.run.smithi037.stderr: 9650K .......... .......... .......... .......... .......... 10% 305M 1s 2024-09-12T17:39:45.518 INFO:teuthology.orchestra.run.smithi037.stderr: 9700K .......... .......... .......... .......... .......... 10% 250M 1s 2024-09-12T17:39:45.518 INFO:teuthology.orchestra.run.smithi037.stderr: 9750K .......... .......... .......... .......... .......... 10% 310M 1s 2024-09-12T17:39:45.518 INFO:teuthology.orchestra.run.smithi037.stderr: 9800K .......... .......... .......... .......... .......... 10% 304M 1s 2024-09-12T17:39:45.518 INFO:teuthology.orchestra.run.smithi037.stderr: 9850K .......... .......... .......... .......... .......... 10% 313M 1s 2024-09-12T17:39:45.518 INFO:teuthology.orchestra.run.smithi037.stderr: 9900K .......... .......... .......... .......... .......... 10% 234M 1s 2024-09-12T17:39:45.518 INFO:teuthology.orchestra.run.smithi037.stderr: 9950K .......... .......... .......... .......... .......... 10% 307M 1s 2024-09-12T17:39:45.518 INFO:teuthology.orchestra.run.smithi037.stderr: 10000K .......... .......... .......... .......... .......... 10% 307M 1s 2024-09-12T17:39:45.519 INFO:teuthology.orchestra.run.smithi037.stderr: 10050K .......... .......... .......... .......... .......... 10% 319M 1s 2024-09-12T17:39:45.519 INFO:teuthology.orchestra.run.smithi037.stderr: 10100K .......... .......... .......... .......... .......... 10% 268M 1s 2024-09-12T17:39:45.519 INFO:teuthology.orchestra.run.smithi037.stderr: 10150K .......... .......... .......... .......... .......... 10% 313M 1s 2024-09-12T17:39:45.519 INFO:teuthology.orchestra.run.smithi037.stderr: 10200K .......... .......... .......... .......... .......... 11% 43.0M 1s 2024-09-12T17:39:45.519 INFO:teuthology.orchestra.run.smithi037.stderr: 10250K .......... .......... .......... .......... .......... 11% 307M 1s 2024-09-12T17:39:45.519 INFO:teuthology.orchestra.run.smithi037.stderr: 10300K .......... .......... .......... .......... .......... 11% 309M 1s 2024-09-12T17:39:45.519 INFO:teuthology.orchestra.run.smithi037.stderr: 10350K .......... .......... .......... .......... .......... 11% 240M 1s 2024-09-12T17:39:45.519 INFO:teuthology.orchestra.run.smithi037.stderr: 10400K .......... .......... .......... .......... .......... 11% 298M 1s 2024-09-12T17:39:45.519 INFO:teuthology.orchestra.run.smithi037.stderr: 10450K .......... .......... .......... .......... .......... 11% 300M 1s 2024-09-12T17:39:45.519 INFO:teuthology.orchestra.run.smithi037.stderr: 10500K .......... .......... .......... .......... .......... 11% 288M 1s 2024-09-12T17:39:45.519 INFO:teuthology.orchestra.run.smithi037.stderr: 10550K .......... .......... .......... .......... .......... 11% 256M 1s 2024-09-12T17:39:45.519 INFO:teuthology.orchestra.run.smithi037.stderr: 10600K .......... .......... .......... .......... .......... 11% 309M 1s 2024-09-12T17:39:45.519 INFO:teuthology.orchestra.run.smithi037.stderr: 10650K .......... .......... .......... .......... .......... 11% 320M 1s 2024-09-12T17:39:45.519 INFO:teuthology.orchestra.run.smithi037.stderr: 10700K .......... .......... .......... .......... .......... 11% 302M 1s 2024-09-12T17:39:45.519 INFO:teuthology.orchestra.run.smithi037.stderr: 10750K .......... .......... .......... .......... .......... 11% 269M 1s 2024-09-12T17:39:45.520 INFO:teuthology.orchestra.run.smithi037.stderr: 10800K .......... .......... .......... .......... .......... 11% 279M 1s 2024-09-12T17:39:45.520 INFO:teuthology.orchestra.run.smithi037.stderr: 10850K .......... .......... .......... .......... .......... 11% 331M 1s 2024-09-12T17:39:45.520 INFO:teuthology.orchestra.run.smithi037.stderr: 10900K .......... .......... .......... .......... .......... 11% 101M 1s 2024-09-12T17:39:45.520 INFO:teuthology.orchestra.run.smithi037.stderr: 10950K .......... .......... .......... .......... .......... 11% 279M 1s 2024-09-12T17:39:45.520 INFO:teuthology.orchestra.run.smithi037.stderr: 11000K .......... .......... .......... .......... .......... 11% 276M 1s 2024-09-12T17:39:45.520 INFO:teuthology.orchestra.run.smithi037.stderr: 11050K .......... .......... .......... .......... .......... 11% 323M 1s 2024-09-12T17:39:45.520 INFO:teuthology.orchestra.run.smithi037.stderr: 11100K .......... .......... .......... .......... .......... 12% 338M 1s 2024-09-12T17:39:45.520 INFO:teuthology.orchestra.run.smithi037.stderr: 11150K .......... .......... .......... .......... .......... 12% 259M 1s 2024-09-12T17:39:45.520 INFO:teuthology.orchestra.run.smithi037.stderr: 11200K .......... .......... .......... .......... .......... 12% 330M 1s 2024-09-12T17:39:45.520 INFO:teuthology.orchestra.run.smithi037.stderr: 11250K .......... .......... .......... .......... .......... 12% 274M 1s 2024-09-12T17:39:45.520 INFO:teuthology.orchestra.run.smithi037.stderr: 11300K .......... .......... .......... .......... .......... 12% 324M 1s 2024-09-12T17:39:45.520 INFO:teuthology.orchestra.run.smithi037.stderr: 11350K .......... .......... .......... .......... .......... 12% 322M 1s 2024-09-12T17:39:45.520 INFO:teuthology.orchestra.run.smithi037.stderr: 11400K .......... .......... .......... .......... .......... 12% 306M 1s 2024-09-12T17:39:45.520 INFO:teuthology.orchestra.run.smithi037.stderr: 11450K .......... .......... .......... .......... .......... 12% 326M 1s 2024-09-12T17:39:45.521 INFO:teuthology.orchestra.run.smithi037.stderr: 11500K .......... .......... .......... .......... .......... 12% 324M 1s 2024-09-12T17:39:45.521 INFO:teuthology.orchestra.run.smithi037.stderr: 11550K .......... .......... .......... .......... .......... 12% 284M 1s 2024-09-12T17:39:45.521 INFO:teuthology.orchestra.run.smithi037.stderr: 11600K .......... .......... .......... .......... .......... 12% 309M 1s 2024-09-12T17:39:45.521 INFO:teuthology.orchestra.run.smithi037.stderr: 11650K .......... .......... .......... .......... .......... 12% 326M 1s 2024-09-12T17:39:45.521 INFO:teuthology.orchestra.run.smithi037.stderr: 11700K .......... .......... .......... .......... .......... 12% 315M 1s 2024-09-12T17:39:45.521 INFO:teuthology.orchestra.run.smithi037.stderr: 11750K .......... .......... .......... .......... .......... 12% 313M 1s 2024-09-12T17:39:45.521 INFO:teuthology.orchestra.run.smithi037.stderr: 11800K .......... .......... .......... .......... .......... 12% 293M 1s 2024-09-12T17:39:45.521 INFO:teuthology.orchestra.run.smithi037.stderr: 11850K .......... .......... .......... .......... .......... 12% 317M 1s 2024-09-12T17:39:45.521 INFO:teuthology.orchestra.run.smithi037.stderr: 11900K .......... .......... .......... .......... .......... 12% 290M 1s 2024-09-12T17:39:45.521 INFO:teuthology.orchestra.run.smithi037.stderr: 11950K .......... .......... .......... .......... .......... 12% 227M 1s 2024-09-12T17:39:45.521 INFO:teuthology.orchestra.run.smithi037.stderr: 12000K .......... .......... .......... .......... .......... 12% 315M 1s 2024-09-12T17:39:45.521 INFO:teuthology.orchestra.run.smithi037.stderr: 12050K .......... .......... .......... .......... .......... 13% 268M 1s 2024-09-12T17:39:45.521 INFO:teuthology.orchestra.run.smithi037.stderr: 12100K .......... .......... .......... .......... .......... 13% 264M 1s 2024-09-12T17:39:45.521 INFO:teuthology.orchestra.run.smithi037.stderr: 12150K .......... .......... .......... .......... .......... 13% 270M 1s 2024-09-12T17:39:45.522 INFO:teuthology.orchestra.run.smithi037.stderr: 12200K .......... .......... .......... .......... .......... 13% 309M 1s 2024-09-12T17:39:45.522 INFO:teuthology.orchestra.run.smithi037.stderr: 12250K .......... .......... .......... .......... .......... 13% 311M 1s 2024-09-12T17:39:45.522 INFO:teuthology.orchestra.run.smithi037.stderr: 12300K .......... .......... .......... .......... .......... 13% 233M 1s 2024-09-12T17:39:45.522 INFO:teuthology.orchestra.run.smithi037.stderr: 12350K .......... .......... .......... .......... .......... 13% 254M 1s 2024-09-12T17:39:45.522 INFO:teuthology.orchestra.run.smithi037.stderr: 12400K .......... .......... .......... .......... .......... 13% 272M 1s 2024-09-12T17:39:45.522 INFO:teuthology.orchestra.run.smithi037.stderr: 12450K .......... .......... .......... .......... .......... 13% 177M 1s 2024-09-12T17:39:45.522 INFO:teuthology.orchestra.run.smithi037.stderr: 12500K .......... .......... .......... .......... .......... 13% 135M 1s 2024-09-12T17:39:45.522 INFO:teuthology.orchestra.run.smithi037.stderr: 12550K .......... .......... .......... .......... .......... 13% 138M 1s 2024-09-12T17:39:45.522 INFO:teuthology.orchestra.run.smithi037.stderr: 12600K .......... .......... .......... .......... .......... 13% 231M 1s 2024-09-12T17:39:45.522 INFO:teuthology.orchestra.run.smithi037.stderr: 12650K .......... .......... .......... .......... .......... 13% 270M 1s 2024-09-12T17:39:45.522 INFO:teuthology.orchestra.run.smithi037.stderr: 12700K .......... .......... .......... .......... .......... 13% 256M 1s 2024-09-12T17:39:45.522 INFO:teuthology.orchestra.run.smithi037.stderr: 12750K .......... .......... .......... .......... .......... 13% 246M 1s 2024-09-12T17:39:45.522 INFO:teuthology.orchestra.run.smithi037.stderr: 12800K .......... .......... .......... .......... .......... 13% 240M 1s 2024-09-12T17:39:45.522 INFO:teuthology.orchestra.run.smithi037.stderr: 12850K .......... .......... .......... .......... .......... 13% 321M 1s 2024-09-12T17:39:45.523 INFO:teuthology.orchestra.run.smithi037.stderr: 12900K .......... .......... .......... .......... .......... 13% 302M 1s 2024-09-12T17:39:45.523 INFO:teuthology.orchestra.run.smithi037.stderr: 12950K .......... .......... .......... .......... .......... 13% 302M 1s 2024-09-12T17:39:45.523 INFO:teuthology.orchestra.run.smithi037.stderr: 13000K .......... .......... .......... .......... .......... 14% 356M 1s 2024-09-12T17:39:45.523 INFO:teuthology.orchestra.run.smithi037.stderr: 13050K .......... .......... .......... .......... .......... 14% 376M 1s 2024-09-12T17:39:45.523 INFO:teuthology.orchestra.run.smithi037.stderr: 13100K .......... .......... .......... .......... .......... 14% 69.0M 1s 2024-09-12T17:39:45.523 INFO:teuthology.orchestra.run.smithi037.stderr: 13150K .......... .......... .......... .......... .......... 14% 76.0M 1s 2024-09-12T17:39:45.523 INFO:teuthology.orchestra.run.smithi037.stderr: 13200K .......... .......... .......... .......... .......... 14% 342M 1s 2024-09-12T17:39:45.523 INFO:teuthology.orchestra.run.smithi037.stderr: 13250K .......... .......... .......... .......... .......... 14% 338M 1s 2024-09-12T17:39:45.523 INFO:teuthology.orchestra.run.smithi037.stderr: 13300K .......... .......... .......... .......... .......... 14% 362M 1s 2024-09-12T17:39:45.523 INFO:teuthology.orchestra.run.smithi037.stderr: 13350K .......... .......... .......... .......... .......... 14% 292M 1s 2024-09-12T17:39:45.523 INFO:teuthology.orchestra.run.smithi037.stderr: 13400K .......... .......... .......... .......... .......... 14% 317M 1s 2024-09-12T17:39:45.523 INFO:teuthology.orchestra.run.smithi037.stderr: 13450K .......... .......... .......... .......... .......... 14% 346M 1s 2024-09-12T17:39:45.523 INFO:teuthology.orchestra.run.smithi037.stderr: 13500K .......... .......... .......... .......... .......... 14% 338M 1s 2024-09-12T17:39:45.523 INFO:teuthology.orchestra.run.smithi037.stderr: 13550K .......... .......... .......... .......... .......... 14% 250M 1s 2024-09-12T17:39:45.523 INFO:teuthology.orchestra.run.smithi037.stderr: 13600K .......... .......... .......... .......... .......... 14% 328M 1s 2024-09-12T17:39:45.524 INFO:teuthology.orchestra.run.smithi037.stderr: 13650K .......... .......... .......... .......... .......... 14% 308M 1s 2024-09-12T17:39:45.524 INFO:teuthology.orchestra.run.smithi037.stderr: 13700K .......... .......... .......... .......... .......... 14% 345M 1s 2024-09-12T17:39:45.524 INFO:teuthology.orchestra.run.smithi037.stderr: 13750K .......... .......... .......... .......... .......... 14% 245M 1s 2024-09-12T17:39:45.524 INFO:teuthology.orchestra.run.smithi037.stderr: 13800K .......... .......... .......... .......... .......... 14% 319M 1s 2024-09-12T17:39:45.524 INFO:teuthology.orchestra.run.smithi037.stderr: 13850K .......... .......... .......... .......... .......... 14% 345M 1s 2024-09-12T17:39:45.524 INFO:teuthology.orchestra.run.smithi037.stderr: 13900K .......... .......... .......... .......... .......... 15% 122M 1s 2024-09-12T17:39:45.524 INFO:teuthology.orchestra.run.smithi037.stderr: 13950K .......... .......... .......... .......... .......... 15% 276M 1s 2024-09-12T17:39:45.524 INFO:teuthology.orchestra.run.smithi037.stderr: 14000K .......... .......... .......... .......... .......... 15% 227M 1s 2024-09-12T17:39:45.524 INFO:teuthology.orchestra.run.smithi037.stderr: 14050K .......... .......... .......... .......... .......... 15% 313M 1s 2024-09-12T17:39:45.524 INFO:teuthology.orchestra.run.smithi037.stderr: 14100K .......... .......... .......... .......... .......... 15% 333M 1s 2024-09-12T17:39:45.524 INFO:teuthology.orchestra.run.smithi037.stderr: 14150K .......... .......... .......... .......... .......... 15% 299M 1s 2024-09-12T17:39:45.524 INFO:teuthology.orchestra.run.smithi037.stderr: 14200K .......... .......... .......... .......... .......... 15% 318M 1s 2024-09-12T17:39:45.524 INFO:teuthology.orchestra.run.smithi037.stderr: 14250K .......... .......... .......... .......... .......... 15% 348M 1s 2024-09-12T17:39:45.524 INFO:teuthology.orchestra.run.smithi037.stderr: 14300K .......... .......... .......... .......... .......... 15% 333M 1s 2024-09-12T17:39:45.525 INFO:teuthology.orchestra.run.smithi037.stderr: 14350K .......... .......... .......... .......... .......... 15% 131M 1s 2024-09-12T17:39:45.525 INFO:teuthology.orchestra.run.smithi037.stderr: 14400K .......... .......... .......... .......... .......... 15% 298M 1s 2024-09-12T17:39:45.525 INFO:teuthology.orchestra.run.smithi037.stderr: 14450K .......... .......... .......... .......... .......... 15% 329M 1s 2024-09-12T17:39:45.525 INFO:teuthology.orchestra.run.smithi037.stderr: 14500K .......... .......... .......... .......... .......... 15% 344M 1s 2024-09-12T17:39:45.525 INFO:teuthology.orchestra.run.smithi037.stderr: 14550K .......... .......... .......... .......... .......... 15% 301M 1s 2024-09-12T17:39:45.525 INFO:teuthology.orchestra.run.smithi037.stderr: 14600K .......... .......... .......... .......... .......... 15% 346M 1s 2024-09-12T17:39:45.525 INFO:teuthology.orchestra.run.smithi037.stderr: 14650K .......... .......... .......... .......... .......... 15% 349M 1s 2024-09-12T17:39:45.525 INFO:teuthology.orchestra.run.smithi037.stderr: 14700K .......... .......... .......... .......... .......... 15% 288M 1s 2024-09-12T17:39:45.525 INFO:teuthology.orchestra.run.smithi037.stderr: 14750K .......... .......... .......... .......... .......... 15% 262M 1s 2024-09-12T17:39:45.525 INFO:teuthology.orchestra.run.smithi037.stderr: 14800K .......... .......... .......... .......... .......... 15% 236M 1s 2024-09-12T17:39:45.525 INFO:teuthology.orchestra.run.smithi037.stderr: 14850K .......... .......... .......... .......... .......... 16% 311M 1s 2024-09-12T17:39:45.525 INFO:teuthology.orchestra.run.smithi037.stderr: 14900K .......... .......... .......... .......... .......... 16% 322M 1s 2024-09-12T17:39:45.525 INFO:teuthology.orchestra.run.smithi037.stderr: 14950K .......... .......... .......... .......... .......... 16% 299M 1s 2024-09-12T17:39:45.525 INFO:teuthology.orchestra.run.smithi037.stderr: 15000K .......... .......... .......... .......... .......... 16% 281M 1s 2024-09-12T17:39:45.526 INFO:teuthology.orchestra.run.smithi037.stderr: 15050K .......... .......... .......... .......... .......... 16% 328M 1s 2024-09-12T17:39:45.526 INFO:teuthology.orchestra.run.smithi037.stderr: 15100K .......... .......... .......... .......... .......... 16% 294M 1s 2024-09-12T17:39:45.526 INFO:teuthology.orchestra.run.smithi037.stderr: 15150K .......... .......... .......... .......... .......... 16% 274M 1s 2024-09-12T17:39:45.526 INFO:teuthology.orchestra.run.smithi037.stderr: 15200K .......... .......... .......... .......... .......... 16% 326M 1s 2024-09-12T17:39:45.526 INFO:teuthology.orchestra.run.smithi037.stderr: 15250K .......... .......... .......... .......... .......... 16% 284M 1s 2024-09-12T17:39:45.526 INFO:teuthology.orchestra.run.smithi037.stderr: 15300K .......... .......... .......... .......... .......... 16% 329M 1s 2024-09-12T17:39:45.526 INFO:teuthology.orchestra.run.smithi037.stderr: 15350K .......... .......... .......... .......... .......... 16% 301M 1s 2024-09-12T17:39:45.526 INFO:teuthology.orchestra.run.smithi037.stderr: 15400K .......... .......... .......... .......... .......... 16% 301M 1s 2024-09-12T17:39:45.526 INFO:teuthology.orchestra.run.smithi037.stderr: 15450K .......... .......... .......... .......... .......... 16% 330M 1s 2024-09-12T17:39:45.526 INFO:teuthology.orchestra.run.smithi037.stderr: 15500K .......... .......... .......... .......... .......... 16% 321M 1s 2024-09-12T17:39:45.526 INFO:teuthology.orchestra.run.smithi037.stderr: 15550K .......... .......... .......... .......... .......... 16% 150M 1s 2024-09-12T17:39:45.526 INFO:teuthology.orchestra.run.smithi037.stderr: 15600K .......... .......... .......... .......... .......... 16% 113M 1s 2024-09-12T17:39:45.526 INFO:teuthology.orchestra.run.smithi037.stderr: 15650K .......... .......... .......... .......... .......... 16% 294M 1s 2024-09-12T17:39:45.526 INFO:teuthology.orchestra.run.smithi037.stderr: 15700K .......... .......... .......... .......... .......... 16% 118M 1s 2024-09-12T17:39:45.527 INFO:teuthology.orchestra.run.smithi037.stderr: 15750K .......... .......... .......... .......... .......... 17% 302M 1s 2024-09-12T17:39:45.527 INFO:teuthology.orchestra.run.smithi037.stderr: 15800K .......... .......... .......... .......... .......... 17% 345M 1s 2024-09-12T17:39:45.527 INFO:teuthology.orchestra.run.smithi037.stderr: 15850K .......... .......... .......... .......... .......... 17% 349M 1s 2024-09-12T17:39:45.527 INFO:teuthology.orchestra.run.smithi037.stderr: 15900K .......... .......... .......... .......... .......... 17% 351M 1s 2024-09-12T17:39:45.527 INFO:teuthology.orchestra.run.smithi037.stderr: 15950K .......... .......... .......... .......... .......... 17% 220M 1s 2024-09-12T17:39:45.527 INFO:teuthology.orchestra.run.smithi037.stderr: 16000K .......... .......... .......... .......... .......... 17% 307M 1s 2024-09-12T17:39:45.527 INFO:teuthology.orchestra.run.smithi037.stderr: 16050K .......... .......... .......... .......... .......... 17% 315M 1s 2024-09-12T17:39:45.527 INFO:teuthology.orchestra.run.smithi037.stderr: 16100K .......... .......... .......... .......... .......... 17% 298M 1s 2024-09-12T17:39:45.527 INFO:teuthology.orchestra.run.smithi037.stderr: 16150K .......... .......... .......... .......... .......... 17% 94.8M 1s 2024-09-12T17:39:45.527 INFO:teuthology.orchestra.run.smithi037.stderr: 16200K .......... .......... .......... .......... .......... 17% 65.2M 1s 2024-09-12T17:39:45.527 INFO:teuthology.orchestra.run.smithi037.stderr: 16250K .......... .......... .......... .......... .......... 17% 304M 1s 2024-09-12T17:39:45.527 INFO:teuthology.orchestra.run.smithi037.stderr: 16300K .......... .......... .......... .......... .......... 17% 329M 1s 2024-09-12T17:39:45.527 INFO:teuthology.orchestra.run.smithi037.stderr: 16350K .......... .......... .......... .......... .......... 17% 238M 1s 2024-09-12T17:39:45.527 INFO:teuthology.orchestra.run.smithi037.stderr: 16400K .......... .......... .......... .......... .......... 17% 331M 1s 2024-09-12T17:39:45.527 INFO:teuthology.orchestra.run.smithi037.stderr: 16450K .......... .......... .......... .......... .......... 17% 288M 1s 2024-09-12T17:39:45.528 INFO:teuthology.orchestra.run.smithi037.stderr: 16500K .......... .......... .......... .......... .......... 17% 325M 1s 2024-09-12T17:39:45.528 INFO:teuthology.orchestra.run.smithi037.stderr: 16550K .......... .......... .......... .......... .......... 17% 301M 1s 2024-09-12T17:39:45.528 INFO:teuthology.orchestra.run.smithi037.stderr: 16600K .......... .......... .......... .......... .......... 17% 320M 1s 2024-09-12T17:39:45.528 INFO:teuthology.orchestra.run.smithi037.stderr: 16650K .......... .......... .......... .......... .......... 17% 116M 1s 2024-09-12T17:39:45.528 INFO:teuthology.orchestra.run.smithi037.stderr: 16700K .......... .......... .......... .......... .......... 18% 334M 1s 2024-09-12T17:39:45.528 INFO:teuthology.orchestra.run.smithi037.stderr: 16750K .......... .......... .......... .......... .......... 18% 298M 1s 2024-09-12T17:39:45.528 INFO:teuthology.orchestra.run.smithi037.stderr: 16800K .......... .......... .......... .......... .......... 18% 330M 1s 2024-09-12T17:39:45.528 INFO:teuthology.orchestra.run.smithi037.stderr: 16850K .......... .......... .......... .......... .......... 18% 289M 1s 2024-09-12T17:39:45.528 INFO:teuthology.orchestra.run.smithi037.stderr: 16900K .......... .......... .......... .......... .......... 18% 326M 1s 2024-09-12T17:39:45.528 INFO:teuthology.orchestra.run.smithi037.stderr: 16950K .......... .......... .......... .......... .......... 18% 296M 1s 2024-09-12T17:39:45.528 INFO:teuthology.orchestra.run.smithi037.stderr: 17000K .......... .......... .......... .......... .......... 18% 294M 1s 2024-09-12T17:39:45.528 INFO:teuthology.orchestra.run.smithi037.stderr: 17050K .......... .......... .......... .......... .......... 18% 326M 1s 2024-09-12T17:39:45.528 INFO:teuthology.orchestra.run.smithi037.stderr: 17100K .......... .......... .......... .......... .......... 18% 303M 1s 2024-09-12T17:39:45.529 INFO:teuthology.orchestra.run.smithi037.stderr: 17150K .......... .......... .......... .......... .......... 18% 263M 1s 2024-09-12T17:39:45.529 INFO:teuthology.orchestra.run.smithi037.stderr: 17200K .......... .......... .......... .......... .......... 18% 276M 1s 2024-09-12T17:39:45.529 INFO:teuthology.orchestra.run.smithi037.stderr: 17250K .......... .......... .......... .......... .......... 18% 302M 1s 2024-09-12T17:39:45.529 INFO:teuthology.orchestra.run.smithi037.stderr: 17300K .......... .......... .......... .......... .......... 18% 272M 1s 2024-09-12T17:39:45.529 INFO:teuthology.orchestra.run.smithi037.stderr: 17350K .......... .......... .......... .......... .......... 18% 61.0M 1s 2024-09-12T17:39:45.529 INFO:teuthology.orchestra.run.smithi037.stderr: 17400K .......... .......... .......... .......... .......... 18% 306M 1s 2024-09-12T17:39:45.529 INFO:teuthology.orchestra.run.smithi037.stderr: 17450K .......... .......... .......... .......... .......... 18% 324M 1s 2024-09-12T17:39:45.529 INFO:teuthology.orchestra.run.smithi037.stderr: 17500K .......... .......... .......... .......... .......... 18% 322M 1s 2024-09-12T17:39:45.529 INFO:teuthology.orchestra.run.smithi037.stderr: 17550K .......... .......... .......... .......... .......... 18% 273M 1s 2024-09-12T17:39:45.529 INFO:teuthology.orchestra.run.smithi037.stderr: 17600K .......... .......... .......... .......... .......... 18% 292M 1s 2024-09-12T17:39:45.529 INFO:teuthology.orchestra.run.smithi037.stderr: 17650K .......... .......... .......... .......... .......... 19% 340M 1s 2024-09-12T17:39:45.529 INFO:teuthology.orchestra.run.smithi037.stderr: 17700K .......... .......... .......... .......... .......... 19% 315M 1s 2024-09-12T17:39:45.529 INFO:teuthology.orchestra.run.smithi037.stderr: 17750K .......... .......... .......... .......... .......... 19% 290M 1s 2024-09-12T17:39:45.529 INFO:teuthology.orchestra.run.smithi037.stderr: 17800K .......... .......... .......... .......... .......... 19% 326M 1s 2024-09-12T17:39:45.529 INFO:teuthology.orchestra.run.smithi037.stderr: 17850K .......... .......... .......... .......... .......... 19% 241M 1s 2024-09-12T17:39:45.530 INFO:teuthology.orchestra.run.smithi037.stderr: 17900K .......... .......... .......... .......... .......... 19% 299M 1s 2024-09-12T17:39:45.530 INFO:teuthology.orchestra.run.smithi037.stderr: 17950K .......... .......... .......... .......... .......... 19% 337M 1s 2024-09-12T17:39:45.530 INFO:teuthology.orchestra.run.smithi037.stderr: 18000K .......... .......... .......... .......... .......... 19% 298M 1s 2024-09-12T17:39:45.530 INFO:teuthology.orchestra.run.smithi037.stderr: 18050K .......... .......... .......... .......... .......... 19% 274M 1s 2024-09-12T17:39:45.530 INFO:teuthology.orchestra.run.smithi037.stderr: 18100K .......... .......... .......... .......... .......... 19% 302M 1s 2024-09-12T17:39:45.530 INFO:teuthology.orchestra.run.smithi037.stderr: 18150K .......... .......... .......... .......... .......... 19% 84.1M 1s 2024-09-12T17:39:45.530 INFO:teuthology.orchestra.run.smithi037.stderr: 18200K .......... .......... .......... .......... .......... 19% 308M 1s 2024-09-12T17:39:45.530 INFO:teuthology.orchestra.run.smithi037.stderr: 18250K .......... .......... .......... .......... .......... 19% 298M 1s 2024-09-12T17:39:45.530 INFO:teuthology.orchestra.run.smithi037.stderr: 18300K .......... .......... .......... .......... .......... 19% 332M 1s 2024-09-12T17:39:45.530 INFO:teuthology.orchestra.run.smithi037.stderr: 18350K .......... .......... .......... .......... .......... 19% 284M 1s 2024-09-12T17:39:45.530 INFO:teuthology.orchestra.run.smithi037.stderr: 18400K .......... .......... .......... .......... .......... 19% 318M 1s 2024-09-12T17:39:45.530 INFO:teuthology.orchestra.run.smithi037.stderr: 18450K .......... .......... .......... .......... .......... 19% 320M 1s 2024-09-12T17:39:45.530 INFO:teuthology.orchestra.run.smithi037.stderr: 18500K .......... .......... .......... .......... .......... 19% 360M 1s 2024-09-12T17:39:45.530 INFO:teuthology.orchestra.run.smithi037.stderr: 18550K .......... .......... .......... .......... .......... 20% 307M 1s 2024-09-12T17:39:45.531 INFO:teuthology.orchestra.run.smithi037.stderr: 18600K .......... .......... .......... .......... .......... 20% 354M 1s 2024-09-12T17:39:45.531 INFO:teuthology.orchestra.run.smithi037.stderr: 18650K .......... .......... .......... .......... .......... 20% 348M 1s 2024-09-12T17:39:45.531 INFO:teuthology.orchestra.run.smithi037.stderr: 18700K .......... .......... .......... .......... .......... 20% 338M 1s 2024-09-12T17:39:45.531 INFO:teuthology.orchestra.run.smithi037.stderr: 18750K .......... .......... .......... .......... .......... 20% 246M 1s 2024-09-12T17:39:45.531 INFO:teuthology.orchestra.run.smithi037.stderr: 18800K .......... .......... .......... .......... .......... 20% 328M 1s 2024-09-12T17:39:45.531 INFO:teuthology.orchestra.run.smithi037.stderr: 18850K .......... .......... .......... .......... .......... 20% 347M 1s 2024-09-12T17:39:45.531 INFO:teuthology.orchestra.run.smithi037.stderr: 18900K .......... .......... .......... .......... .......... 20% 311M 1s 2024-09-12T17:39:45.531 INFO:teuthology.orchestra.run.smithi037.stderr: 18950K .......... .......... .......... .......... .......... 20% 318M 1s 2024-09-12T17:39:45.531 INFO:teuthology.orchestra.run.smithi037.stderr: 19000K .......... .......... .......... .......... .......... 20% 353M 1s 2024-09-12T17:39:45.531 INFO:teuthology.orchestra.run.smithi037.stderr: 19050K .......... .......... .......... .......... .......... 20% 317M 1s 2024-09-12T17:39:45.531 INFO:teuthology.orchestra.run.smithi037.stderr: 19100K .......... .......... .......... .......... .......... 20% 356M 1s 2024-09-12T17:39:45.531 INFO:teuthology.orchestra.run.smithi037.stderr: 19150K .......... .......... .......... .......... .......... 20% 136M 1s 2024-09-12T17:39:45.531 INFO:teuthology.orchestra.run.smithi037.stderr: 19200K .......... .......... .......... .......... .......... 20% 204M 1s 2024-09-12T17:39:45.531 INFO:teuthology.orchestra.run.smithi037.stderr: 19250K .......... .......... .......... .......... .......... 20% 97.6M 1s 2024-09-12T17:39:45.532 INFO:teuthology.orchestra.run.smithi037.stderr: 19300K .......... .......... .......... .......... .......... 20% 191M 1s 2024-09-12T17:39:45.532 INFO:teuthology.orchestra.run.smithi037.stderr: 19350K .......... .......... .......... .......... .......... 20% 156M 1s 2024-09-12T17:39:45.532 INFO:teuthology.orchestra.run.smithi037.stderr: 19400K .......... .......... .......... .......... .......... 20% 309M 1s 2024-09-12T17:39:45.532 INFO:teuthology.orchestra.run.smithi037.stderr: 19450K .......... .......... .......... .......... .......... 20% 315M 1s 2024-09-12T17:39:45.532 INFO:teuthology.orchestra.run.smithi037.stderr: 19500K .......... .......... .......... .......... .......... 21% 322M 1s 2024-09-12T17:39:45.532 INFO:teuthology.orchestra.run.smithi037.stderr: 19550K .......... .......... .......... .......... .......... 21% 291M 1s 2024-09-12T17:39:45.532 INFO:teuthology.orchestra.run.smithi037.stderr: 19600K .......... .......... .......... .......... .......... 21% 111M 1s 2024-09-12T17:39:45.532 INFO:teuthology.orchestra.run.smithi037.stderr: 19650K .......... .......... .......... .......... .......... 21% 275M 1s 2024-09-12T17:39:45.532 INFO:teuthology.orchestra.run.smithi037.stderr: 19700K .......... .......... .......... .......... .......... 21% 154M 1s 2024-09-12T17:39:45.532 INFO:teuthology.orchestra.run.smithi037.stderr: 19750K .......... .......... .......... .......... .......... 21% 183M 1s 2024-09-12T17:39:45.532 INFO:teuthology.orchestra.run.smithi037.stderr: 19800K .......... .......... .......... .......... .......... 21% 204M 1s 2024-09-12T17:39:45.532 INFO:teuthology.orchestra.run.smithi037.stderr: 19850K .......... .......... .......... .......... .......... 21% 210M 1s 2024-09-12T17:39:45.532 INFO:teuthology.orchestra.run.smithi037.stderr: 19900K .......... .......... .......... .......... .......... 21% 231M 1s 2024-09-12T17:39:45.532 INFO:teuthology.orchestra.run.smithi037.stderr: 19950K .......... .......... .......... .......... .......... 21% 186M 1s 2024-09-12T17:39:45.533 INFO:teuthology.orchestra.run.smithi037.stderr: 20000K .......... .......... .......... .......... .......... 21% 220M 1s 2024-09-12T17:39:45.533 INFO:teuthology.orchestra.run.smithi037.stderr: 20050K .......... .......... .......... .......... .......... 21% 209M 1s 2024-09-12T17:39:45.533 INFO:teuthology.orchestra.run.smithi037.stderr: 20100K .......... .......... .......... .......... .......... 21% 205M 1s 2024-09-12T17:39:45.533 INFO:teuthology.orchestra.run.smithi037.stderr: 20150K .......... .......... .......... .......... .......... 21% 205M 1s 2024-09-12T17:39:45.533 INFO:teuthology.orchestra.run.smithi037.stderr: 20200K .......... .......... .......... .......... .......... 21% 218M 1s 2024-09-12T17:39:45.533 INFO:teuthology.orchestra.run.smithi037.stderr: 20250K .......... .......... .......... .......... .......... 21% 226M 1s 2024-09-12T17:39:45.533 INFO:teuthology.orchestra.run.smithi037.stderr: 20300K .......... .......... .......... .......... .......... 21% 221M 1s 2024-09-12T17:39:45.533 INFO:teuthology.orchestra.run.smithi037.stderr: 20350K .......... .......... .......... .......... .......... 21% 163M 1s 2024-09-12T17:39:45.533 INFO:teuthology.orchestra.run.smithi037.stderr: 20400K .......... .......... .......... .......... .......... 22% 215M 1s 2024-09-12T17:39:45.533 INFO:teuthology.orchestra.run.smithi037.stderr: 20450K .......... .......... .......... .......... .......... 22% 207M 1s 2024-09-12T17:39:45.533 INFO:teuthology.orchestra.run.smithi037.stderr: 20500K .......... .......... .......... .......... .......... 22% 212M 1s 2024-09-12T17:39:45.533 INFO:teuthology.orchestra.run.smithi037.stderr: 20550K .......... .......... .......... .......... .......... 22% 195M 1s 2024-09-12T17:39:45.533 INFO:teuthology.orchestra.run.smithi037.stderr: 20600K .......... .......... .......... .......... .......... 22% 224M 1s 2024-09-12T17:39:45.533 INFO:teuthology.orchestra.run.smithi037.stderr: 20650K .......... .......... .......... .......... .......... 22% 229M 1s 2024-09-12T17:39:45.533 INFO:teuthology.orchestra.run.smithi037.stderr: 20700K .......... .......... .......... .......... .......... 22% 176M 1s 2024-09-12T17:39:45.534 INFO:teuthology.orchestra.run.smithi037.stderr: 20750K .......... .......... .......... .......... .......... 22% 220M 1s 2024-09-12T17:39:45.534 INFO:teuthology.orchestra.run.smithi037.stderr: 20800K .......... .......... .......... .......... .......... 22% 225M 1s 2024-09-12T17:39:45.534 INFO:teuthology.orchestra.run.smithi037.stderr: 20850K .......... .......... .......... .......... .......... 22% 221M 1s 2024-09-12T17:39:45.534 INFO:teuthology.orchestra.run.smithi037.stderr: 20900K .......... .......... .......... .......... .......... 22% 196M 1s 2024-09-12T17:39:45.534 INFO:teuthology.orchestra.run.smithi037.stderr: 20950K .......... .......... .......... .......... .......... 22% 225M 1s 2024-09-12T17:39:45.534 INFO:teuthology.orchestra.run.smithi037.stderr: 21000K .......... .......... .......... .......... .......... 22% 225M 1s 2024-09-12T17:39:45.534 INFO:teuthology.orchestra.run.smithi037.stderr: 21050K .......... .......... .......... .......... .......... 22% 224M 1s 2024-09-12T17:39:45.534 INFO:teuthology.orchestra.run.smithi037.stderr: 21100K .......... .......... .......... .......... .......... 22% 206M 1s 2024-09-12T17:39:45.534 INFO:teuthology.orchestra.run.smithi037.stderr: 21150K .......... .......... .......... .......... .......... 22% 192M 1s 2024-09-12T17:39:45.534 INFO:teuthology.orchestra.run.smithi037.stderr: 21200K .......... .......... .......... .......... .......... 22% 228M 1s 2024-09-12T17:39:45.534 INFO:teuthology.orchestra.run.smithi037.stderr: 21250K .......... .......... .......... .......... .......... 22% 228M 1s 2024-09-12T17:39:45.534 INFO:teuthology.orchestra.run.smithi037.stderr: 21300K .......... .......... .......... .......... .......... 22% 203M 1s 2024-09-12T17:39:45.534 INFO:teuthology.orchestra.run.smithi037.stderr: 21350K .......... .......... .......... .......... .......... 23% 216M 1s 2024-09-12T17:39:45.534 INFO:teuthology.orchestra.run.smithi037.stderr: 21400K .......... .......... .......... .......... .......... 23% 229M 1s 2024-09-12T17:39:45.535 INFO:teuthology.orchestra.run.smithi037.stderr: 21450K .......... .......... .......... .......... .......... 23% 227M 1s 2024-09-12T17:39:45.535 INFO:teuthology.orchestra.run.smithi037.stderr: 21500K .......... .......... .......... .......... .......... 23% 182M 1s 2024-09-12T17:39:45.535 INFO:teuthology.orchestra.run.smithi037.stderr: 21550K .......... .......... .......... .......... .......... 23% 210M 1s 2024-09-12T17:39:45.535 INFO:teuthology.orchestra.run.smithi037.stderr: 21600K .......... .......... .......... .......... .......... 23% 222M 1s 2024-09-12T17:39:45.535 INFO:teuthology.orchestra.run.smithi037.stderr: 21650K .......... .......... .......... .......... .......... 23% 226M 1s 2024-09-12T17:39:45.535 INFO:teuthology.orchestra.run.smithi037.stderr: 21700K .......... .......... .......... .......... .......... 23% 196M 1s 2024-09-12T17:39:45.535 INFO:teuthology.orchestra.run.smithi037.stderr: 21750K .......... .......... .......... .......... .......... 23% 237M 1s 2024-09-12T17:39:45.535 INFO:teuthology.orchestra.run.smithi037.stderr: 21800K .......... .......... .......... .......... .......... 23% 183M 1s 2024-09-12T17:39:45.535 INFO:teuthology.orchestra.run.smithi037.stderr: 21850K .......... .......... .......... .......... .......... 23% 209M 1s 2024-09-12T17:39:45.535 INFO:teuthology.orchestra.run.smithi037.stderr: 21900K .......... .......... .......... .......... .......... 23% 221M 1s 2024-09-12T17:39:45.535 INFO:teuthology.orchestra.run.smithi037.stderr: 21950K .......... .......... .......... .......... .......... 23% 214M 1s 2024-09-12T17:39:45.535 INFO:teuthology.orchestra.run.smithi037.stderr: 22000K .......... .......... .......... .......... .......... 23% 194M 1s 2024-09-12T17:39:45.535 INFO:teuthology.orchestra.run.smithi037.stderr: 22050K .......... .......... .......... .......... .......... 23% 219M 1s 2024-09-12T17:39:45.535 INFO:teuthology.orchestra.run.smithi037.stderr: 22100K .......... .......... .......... .......... .......... 23% 225M 1s 2024-09-12T17:39:45.536 INFO:teuthology.orchestra.run.smithi037.stderr: 22150K .......... .......... .......... .......... .......... 23% 231M 1s 2024-09-12T17:39:45.536 INFO:teuthology.orchestra.run.smithi037.stderr: 22200K .......... .......... .......... .......... .......... 23% 183M 1s 2024-09-12T17:39:45.536 INFO:teuthology.orchestra.run.smithi037.stderr: 22250K .......... .......... .......... .......... .......... 24% 223M 1s 2024-09-12T17:39:45.536 INFO:teuthology.orchestra.run.smithi037.stderr: 22300K .......... .......... .......... .......... .......... 24% 226M 1s 2024-09-12T17:39:45.536 INFO:teuthology.orchestra.run.smithi037.stderr: 22350K .......... .......... .......... .......... .......... 24% 227M 1s 2024-09-12T17:39:45.536 INFO:teuthology.orchestra.run.smithi037.stderr: 22400K .......... .......... .......... .......... .......... 24% 158M 1s 2024-09-12T17:39:45.536 INFO:teuthology.orchestra.run.smithi037.stderr: 22450K .......... .......... .......... .......... .......... 24% 211M 1s 2024-09-12T17:39:45.536 INFO:teuthology.orchestra.run.smithi037.stderr: 22500K .......... .......... .......... .......... .......... 24% 211M 1s 2024-09-12T17:39:45.536 INFO:teuthology.orchestra.run.smithi037.stderr: 22550K .......... .......... .......... .......... .......... 24% 218M 1s 2024-09-12T17:39:45.536 INFO:teuthology.orchestra.run.smithi037.stderr: 22600K .......... .......... .......... .......... .......... 24% 169M 1s 2024-09-12T17:39:45.536 INFO:teuthology.orchestra.run.smithi037.stderr: 22650K .......... .......... .......... .......... .......... 24% 218M 1s 2024-09-12T17:39:45.536 INFO:teuthology.orchestra.run.smithi037.stderr: 22700K .......... .......... .......... .......... .......... 24% 226M 1s 2024-09-12T17:39:45.536 INFO:teuthology.orchestra.run.smithi037.stderr: 22750K .......... .......... .......... .......... .......... 24% 224M 1s 2024-09-12T17:39:45.536 INFO:teuthology.orchestra.run.smithi037.stderr: 22800K .......... .......... .......... .......... .......... 24% 204M 1s 2024-09-12T17:39:45.537 INFO:teuthology.orchestra.run.smithi037.stderr: 22850K .......... .......... .......... .......... .......... 24% 202M 1s 2024-09-12T17:39:45.537 INFO:teuthology.orchestra.run.smithi037.stderr: 22900K .......... .......... .......... .......... .......... 24% 206M 1s 2024-09-12T17:39:45.537 INFO:teuthology.orchestra.run.smithi037.stderr: 22950K .......... .......... .......... .......... .......... 24% 221M 1s 2024-09-12T17:39:45.537 INFO:teuthology.orchestra.run.smithi037.stderr: 23000K .......... .......... .......... .......... .......... 24% 229M 1s 2024-09-12T17:39:45.537 INFO:teuthology.orchestra.run.smithi037.stderr: 23050K .......... .......... .......... .......... .......... 24% 218M 1s 2024-09-12T17:39:45.537 INFO:teuthology.orchestra.run.smithi037.stderr: 23100K .......... .......... .......... .......... .......... 24% 184M 1s 2024-09-12T17:39:45.537 INFO:teuthology.orchestra.run.smithi037.stderr: 23150K .......... .......... .......... .......... .......... 24% 223M 1s 2024-09-12T17:39:45.537 INFO:teuthology.orchestra.run.smithi037.stderr: 23200K .......... .......... .......... .......... .......... 25% 216M 1s 2024-09-12T17:39:45.537 INFO:teuthology.orchestra.run.smithi037.stderr: 23250K .......... .......... .......... .......... .......... 25% 218M 1s 2024-09-12T17:39:45.537 INFO:teuthology.orchestra.run.smithi037.stderr: 23300K .......... .......... .......... .......... .......... 25% 186M 1s 2024-09-12T17:39:45.537 INFO:teuthology.orchestra.run.smithi037.stderr: 23350K .......... .......... .......... .......... .......... 25% 231M 1s 2024-09-12T17:39:45.537 INFO:teuthology.orchestra.run.smithi037.stderr: 23400K .......... .......... .......... .......... .......... 25% 222M 1s 2024-09-12T17:39:45.537 INFO:teuthology.orchestra.run.smithi037.stderr: 23450K .......... .......... .......... .......... .......... 25% 220M 0s 2024-09-12T17:39:45.537 INFO:teuthology.orchestra.run.smithi037.stderr: 23500K .......... .......... .......... .......... .......... 25% 181M 0s 2024-09-12T17:39:45.537 INFO:teuthology.orchestra.run.smithi037.stderr: 23550K .......... .......... .......... .......... .......... 25% 229M 0s 2024-09-12T17:39:45.538 INFO:teuthology.orchestra.run.smithi037.stderr: 23600K .......... .......... .......... .......... .......... 25% 230M 0s 2024-09-12T17:39:45.538 INFO:teuthology.orchestra.run.smithi037.stderr: 23650K .......... .......... .......... .......... .......... 25% 227M 0s 2024-09-12T17:39:45.538 INFO:teuthology.orchestra.run.smithi037.stderr: 23700K .......... .......... .......... .......... .......... 25% 197M 0s 2024-09-12T17:39:45.538 INFO:teuthology.orchestra.run.smithi037.stderr: 23750K .......... .......... .......... .......... .......... 25% 220M 0s 2024-09-12T17:39:45.538 INFO:teuthology.orchestra.run.smithi037.stderr: 23800K .......... .......... .......... .......... .......... 25% 219M 0s 2024-09-12T17:39:45.538 INFO:teuthology.orchestra.run.smithi037.stderr: 23850K .......... .......... .......... .......... .......... 25% 220M 0s 2024-09-12T17:39:45.538 INFO:teuthology.orchestra.run.smithi037.stderr: 23900K .......... .......... .......... .......... .......... 25% 191M 0s 2024-09-12T17:39:45.538 INFO:teuthology.orchestra.run.smithi037.stderr: 23950K .......... .......... .......... .......... .......... 25% 216M 0s 2024-09-12T17:39:45.538 INFO:teuthology.orchestra.run.smithi037.stderr: 24000K .......... .......... .......... .......... .......... 25% 208M 0s 2024-09-12T17:39:45.538 INFO:teuthology.orchestra.run.smithi037.stderr: 24050K .......... .......... .......... .......... .......... 25% 218M 0s 2024-09-12T17:39:45.538 INFO:teuthology.orchestra.run.smithi037.stderr: 24100K .......... .......... .......... .......... .......... 25% 195M 0s 2024-09-12T17:39:45.538 INFO:teuthology.orchestra.run.smithi037.stderr: 24150K .......... .......... .......... .......... .......... 26% 207M 0s 2024-09-12T17:39:45.538 INFO:teuthology.orchestra.run.smithi037.stderr: 24200K .......... .......... .......... .......... .......... 26% 216M 0s 2024-09-12T17:39:45.538 INFO:teuthology.orchestra.run.smithi037.stderr: 24250K .......... .......... .......... .......... .......... 26% 207M 0s 2024-09-12T17:39:45.539 INFO:teuthology.orchestra.run.smithi037.stderr: 24300K .......... .......... .......... .......... .......... 26% 170M 0s 2024-09-12T17:39:45.539 INFO:teuthology.orchestra.run.smithi037.stderr: 24350K .......... .......... .......... .......... .......... 26% 207M 0s 2024-09-12T17:39:45.539 INFO:teuthology.orchestra.run.smithi037.stderr: 24400K .......... .......... .......... .......... .......... 26% 217M 0s 2024-09-12T17:39:45.539 INFO:teuthology.orchestra.run.smithi037.stderr: 24450K .......... .......... .......... .......... .......... 26% 211M 0s 2024-09-12T17:39:45.539 INFO:teuthology.orchestra.run.smithi037.stderr: 24500K .......... .......... .......... .......... .......... 26% 196M 0s 2024-09-12T17:39:45.539 INFO:teuthology.orchestra.run.smithi037.stderr: 24550K .......... .......... .......... .......... .......... 26% 202M 0s 2024-09-12T17:39:45.539 INFO:teuthology.orchestra.run.smithi037.stderr: 24600K .......... .......... .......... .......... .......... 26% 223M 0s 2024-09-12T17:39:45.539 INFO:teuthology.orchestra.run.smithi037.stderr: 24650K .......... .......... .......... .......... .......... 26% 197M 0s 2024-09-12T17:39:45.539 INFO:teuthology.orchestra.run.smithi037.stderr: 24700K .......... .......... .......... .......... .......... 26% 180M 0s 2024-09-12T17:39:45.539 INFO:teuthology.orchestra.run.smithi037.stderr: 24750K .......... .......... .......... .......... .......... 26% 215M 0s 2024-09-12T17:39:45.539 INFO:teuthology.orchestra.run.smithi037.stderr: 24800K .......... .......... .......... .......... .......... 26% 224M 0s 2024-09-12T17:39:45.539 INFO:teuthology.orchestra.run.smithi037.stderr: 24850K .......... .......... .......... .......... .......... 26% 229M 0s 2024-09-12T17:39:45.539 INFO:teuthology.orchestra.run.smithi037.stderr: 24900K .......... .......... .......... .......... .......... 26% 200M 0s 2024-09-12T17:39:45.539 INFO:teuthology.orchestra.run.smithi037.stderr: 24950K .......... .......... .......... .......... .......... 26% 224M 0s 2024-09-12T17:39:45.539 INFO:teuthology.orchestra.run.smithi037.stderr: 25000K .......... .......... .......... .......... .......... 26% 202M 0s 2024-09-12T17:39:45.540 INFO:teuthology.orchestra.run.smithi037.stderr: 25050K .......... .......... .......... .......... .......... 27% 222M 0s 2024-09-12T17:39:45.540 INFO:teuthology.orchestra.run.smithi037.stderr: 25100K .......... .......... .......... .......... .......... 27% 181M 0s 2024-09-12T17:39:45.540 INFO:teuthology.orchestra.run.smithi037.stderr: 25150K .......... .......... .......... .......... .......... 27% 225M 0s 2024-09-12T17:39:45.540 INFO:teuthology.orchestra.run.smithi037.stderr: 25200K .......... .......... .......... .......... .......... 27% 210M 0s 2024-09-12T17:39:45.540 INFO:teuthology.orchestra.run.smithi037.stderr: 25250K .......... .......... .......... .......... .......... 27% 217M 0s 2024-09-12T17:39:45.540 INFO:teuthology.orchestra.run.smithi037.stderr: 25300K .......... .......... .......... .......... .......... 27% 205M 0s 2024-09-12T17:39:45.540 INFO:teuthology.orchestra.run.smithi037.stderr: 25350K .......... .......... .......... .......... .......... 27% 229M 0s 2024-09-12T17:39:45.540 INFO:teuthology.orchestra.run.smithi037.stderr: 25400K .......... .......... .......... .......... .......... 27% 214M 0s 2024-09-12T17:39:45.540 INFO:teuthology.orchestra.run.smithi037.stderr: 25450K .......... .......... .......... .......... .......... 27% 214M 0s 2024-09-12T17:39:45.540 INFO:teuthology.orchestra.run.smithi037.stderr: 25500K .......... .......... .......... .......... .......... 27% 184M 0s 2024-09-12T17:39:45.540 INFO:teuthology.orchestra.run.smithi037.stderr: 25550K .......... .......... .......... .......... .......... 27% 222M 0s 2024-09-12T17:39:45.540 INFO:teuthology.orchestra.run.smithi037.stderr: 25600K .......... .......... .......... .......... .......... 27% 229M 0s 2024-09-12T17:39:45.540 INFO:teuthology.orchestra.run.smithi037.stderr: 25650K .......... .......... .......... .......... .......... 27% 211M 0s 2024-09-12T17:39:45.540 INFO:teuthology.orchestra.run.smithi037.stderr: 25700K .......... .......... .......... .......... .......... 27% 204M 0s 2024-09-12T17:39:45.540 INFO:teuthology.orchestra.run.smithi037.stderr: 25750K .......... .......... .......... .......... .......... 27% 229M 0s 2024-09-12T17:39:45.541 INFO:teuthology.orchestra.run.smithi037.stderr: 25800K .......... .......... .......... .......... .......... 27% 224M 0s 2024-09-12T17:39:45.541 INFO:teuthology.orchestra.run.smithi037.stderr: 25850K .......... .......... .......... .......... .......... 27% 210M 0s 2024-09-12T17:39:45.541 INFO:teuthology.orchestra.run.smithi037.stderr: 25900K .......... .......... .......... .......... .......... 27% 175M 0s 2024-09-12T17:39:45.541 INFO:teuthology.orchestra.run.smithi037.stderr: 25950K .......... .......... .......... .......... .......... 27% 229M 0s 2024-09-12T17:39:45.541 INFO:teuthology.orchestra.run.smithi037.stderr: 26000K .......... .......... .......... .......... .......... 28% 207M 0s 2024-09-12T17:39:45.541 INFO:teuthology.orchestra.run.smithi037.stderr: 26050K .......... .......... .......... .......... .......... 28% 225M 0s 2024-09-12T17:39:45.541 INFO:teuthology.orchestra.run.smithi037.stderr: 26100K .......... .......... .......... .......... .......... 28% 203M 0s 2024-09-12T17:39:45.541 INFO:teuthology.orchestra.run.smithi037.stderr: 26150K .......... .......... .......... .......... .......... 28% 226M 0s 2024-09-12T17:39:45.541 INFO:teuthology.orchestra.run.smithi037.stderr: 26200K .......... .......... .......... .......... .......... 28% 217M 0s 2024-09-12T17:39:45.541 INFO:teuthology.orchestra.run.smithi037.stderr: 26250K .......... .......... .......... .......... .......... 28% 221M 0s 2024-09-12T17:39:45.541 INFO:teuthology.orchestra.run.smithi037.stderr: 26300K .......... .......... .......... .......... .......... 28% 183M 0s 2024-09-12T17:39:45.541 INFO:teuthology.orchestra.run.smithi037.stderr: 26350K .......... .......... .......... .......... .......... 28% 220M 0s 2024-09-12T17:39:45.541 INFO:teuthology.orchestra.run.smithi037.stderr: 26400K .......... .......... .......... .......... .......... 28% 217M 0s 2024-09-12T17:39:45.541 INFO:teuthology.orchestra.run.smithi037.stderr: 26450K .......... .......... .......... .......... .......... 28% 231M 0s 2024-09-12T17:39:45.542 INFO:teuthology.orchestra.run.smithi037.stderr: 26500K .......... .......... .......... .......... .......... 28% 197M 0s 2024-09-12T17:39:45.542 INFO:teuthology.orchestra.run.smithi037.stderr: 26550K .......... .......... .......... .......... .......... 28% 225M 0s 2024-09-12T17:39:45.542 INFO:teuthology.orchestra.run.smithi037.stderr: 26600K .......... .......... .......... .......... .......... 28% 230M 0s 2024-09-12T17:39:45.542 INFO:teuthology.orchestra.run.smithi037.stderr: 26650K .......... .......... .......... .......... .......... 28% 218M 0s 2024-09-12T17:39:45.542 INFO:teuthology.orchestra.run.smithi037.stderr: 26700K .......... .......... .......... .......... .......... 28% 184M 0s 2024-09-12T17:39:45.542 INFO:teuthology.orchestra.run.smithi037.stderr: 26750K .......... .......... .......... .......... .......... 28% 227M 0s 2024-09-12T17:39:45.542 INFO:teuthology.orchestra.run.smithi037.stderr: 26800K .......... .......... .......... .......... .......... 28% 224M 0s 2024-09-12T17:39:45.542 INFO:teuthology.orchestra.run.smithi037.stderr: 26850K .......... .......... .......... .......... .......... 28% 219M 0s 2024-09-12T17:39:45.542 INFO:teuthology.orchestra.run.smithi037.stderr: 26900K .......... .......... .......... .......... .......... 29% 198M 0s 2024-09-12T17:39:45.542 INFO:teuthology.orchestra.run.smithi037.stderr: 26950K .......... .......... .......... .......... .......... 29% 221M 0s 2024-09-12T17:39:45.542 INFO:teuthology.orchestra.run.smithi037.stderr: 27000K .......... .......... .......... .......... .......... 29% 226M 0s 2024-09-12T17:39:45.542 INFO:teuthology.orchestra.run.smithi037.stderr: 27050K .......... .......... .......... .......... .......... 29% 224M 0s 2024-09-12T17:39:45.542 INFO:teuthology.orchestra.run.smithi037.stderr: 27100K .......... .......... .......... .......... .......... 29% 189M 0s 2024-09-12T17:39:45.542 INFO:teuthology.orchestra.run.smithi037.stderr: 27150K .......... .......... .......... .......... .......... 29% 200M 0s 2024-09-12T17:39:45.542 INFO:teuthology.orchestra.run.smithi037.stderr: 27200K .......... .......... .......... .......... .......... 29% 229M 0s 2024-09-12T17:39:45.543 INFO:teuthology.orchestra.run.smithi037.stderr: 27250K .......... .......... .......... .......... .......... 29% 222M 0s 2024-09-12T17:39:45.543 INFO:teuthology.orchestra.run.smithi037.stderr: 27300K .......... .......... .......... .......... .......... 29% 200M 0s 2024-09-12T17:39:45.543 INFO:teuthology.orchestra.run.smithi037.stderr: 27350K .......... .......... .......... .......... .......... 29% 231M 0s 2024-09-12T17:39:45.543 INFO:teuthology.orchestra.run.smithi037.stderr: 27400K .......... .......... .......... .......... .......... 29% 208M 0s 2024-09-12T17:39:45.543 INFO:teuthology.orchestra.run.smithi037.stderr: 27450K .......... .......... .......... .......... .......... 29% 233M 0s 2024-09-12T17:39:45.543 INFO:teuthology.orchestra.run.smithi037.stderr: 27500K .......... .......... .......... .......... .......... 29% 180M 0s 2024-09-12T17:39:45.543 INFO:teuthology.orchestra.run.smithi037.stderr: 27550K .......... .......... .......... .......... .......... 29% 219M 0s 2024-09-12T17:39:45.543 INFO:teuthology.orchestra.run.smithi037.stderr: 27600K .......... .......... .......... .......... .......... 29% 210M 0s 2024-09-12T17:39:45.543 INFO:teuthology.orchestra.run.smithi037.stderr: 27650K .......... .......... .......... .......... .......... 29% 226M 0s 2024-09-12T17:39:45.543 INFO:teuthology.orchestra.run.smithi037.stderr: 27700K .......... .......... .......... .......... .......... 29% 208M 0s 2024-09-12T17:39:45.543 INFO:teuthology.orchestra.run.smithi037.stderr: 27750K .......... .......... .......... .......... .......... 29% 222M 0s 2024-09-12T17:39:45.543 INFO:teuthology.orchestra.run.smithi037.stderr: 27800K .......... .......... .......... .......... .......... 29% 214M 0s 2024-09-12T17:39:45.543 INFO:teuthology.orchestra.run.smithi037.stderr: 27850K .......... .......... .......... .......... .......... 30% 212M 0s 2024-09-12T17:39:45.543 INFO:teuthology.orchestra.run.smithi037.stderr: 27900K .......... .......... .......... .......... .......... 30% 176M 0s 2024-09-12T17:39:45.544 INFO:teuthology.orchestra.run.smithi037.stderr: 27950K .......... .......... .......... .......... .......... 30% 223M 0s 2024-09-12T17:39:45.544 INFO:teuthology.orchestra.run.smithi037.stderr: 28000K .......... .......... .......... .......... .......... 30% 216M 0s 2024-09-12T17:39:45.544 INFO:teuthology.orchestra.run.smithi037.stderr: 28050K .......... .......... .......... .......... .......... 30% 253M 0s 2024-09-12T17:39:45.544 INFO:teuthology.orchestra.run.smithi037.stderr: 28100K .......... .......... .......... .......... .......... 30% 332M 0s 2024-09-12T17:39:45.544 INFO:teuthology.orchestra.run.smithi037.stderr: 28150K .......... .......... .......... .......... .......... 30% 377M 0s 2024-09-12T17:39:45.544 INFO:teuthology.orchestra.run.smithi037.stderr: 28200K .......... .......... .......... .......... .......... 30% 378M 0s 2024-09-12T17:39:45.544 INFO:teuthology.orchestra.run.smithi037.stderr: 28250K .......... .......... .......... .......... .......... 30% 381M 0s 2024-09-12T17:39:45.544 INFO:teuthology.orchestra.run.smithi037.stderr: 28300K .......... .......... .......... .......... .......... 30% 307M 0s 2024-09-12T17:39:45.544 INFO:teuthology.orchestra.run.smithi037.stderr: 28350K .......... .......... .......... .......... .......... 30% 353M 0s 2024-09-12T17:39:45.544 INFO:teuthology.orchestra.run.smithi037.stderr: 28400K .......... .......... .......... .......... .......... 30% 375M 0s 2024-09-12T17:39:45.544 INFO:teuthology.orchestra.run.smithi037.stderr: 28450K .......... .......... .......... .......... .......... 30% 384M 0s 2024-09-12T17:39:45.544 INFO:teuthology.orchestra.run.smithi037.stderr: 28500K .......... .......... .......... .......... .......... 30% 334M 0s 2024-09-12T17:39:45.544 INFO:teuthology.orchestra.run.smithi037.stderr: 28550K .......... .......... .......... .......... .......... 30% 364M 0s 2024-09-12T17:39:45.544 INFO:teuthology.orchestra.run.smithi037.stderr: 28600K .......... .......... .......... .......... .......... 30% 352M 0s 2024-09-12T17:39:45.544 INFO:teuthology.orchestra.run.smithi037.stderr: 28650K .......... .......... .......... .......... .......... 30% 335M 0s 2024-09-12T17:39:45.545 INFO:teuthology.orchestra.run.smithi037.stderr: 28700K .......... .......... .......... .......... .......... 30% 293M 0s 2024-09-12T17:39:45.545 INFO:teuthology.orchestra.run.smithi037.stderr: 28750K .......... .......... .......... .......... .......... 31% 360M 0s 2024-09-12T17:39:45.545 INFO:teuthology.orchestra.run.smithi037.stderr: 28800K .......... .......... .......... .......... .......... 31% 339M 0s 2024-09-12T17:39:45.545 INFO:teuthology.orchestra.run.smithi037.stderr: 28850K .......... .......... .......... .......... .......... 31% 358M 0s 2024-09-12T17:39:45.545 INFO:teuthology.orchestra.run.smithi037.stderr: 28900K .......... .......... .......... .......... .......... 31% 348M 0s 2024-09-12T17:39:45.545 INFO:teuthology.orchestra.run.smithi037.stderr: 28950K .......... .......... .......... .......... .......... 31% 384M 0s 2024-09-12T17:39:45.545 INFO:teuthology.orchestra.run.smithi037.stderr: 29000K .......... .......... .......... .......... .......... 31% 371M 0s 2024-09-12T17:39:45.545 INFO:teuthology.orchestra.run.smithi037.stderr: 29050K .......... .......... .......... .......... .......... 31% 381M 0s 2024-09-12T17:39:45.545 INFO:teuthology.orchestra.run.smithi037.stderr: 29100K .......... .......... .......... .......... .......... 31% 305M 0s 2024-09-12T17:39:45.545 INFO:teuthology.orchestra.run.smithi037.stderr: 29150K .......... .......... .......... .......... .......... 31% 367M 0s 2024-09-12T17:39:45.545 INFO:teuthology.orchestra.run.smithi037.stderr: 29200K .......... .......... .......... .......... .......... 31% 372M 0s 2024-09-12T17:39:45.545 INFO:teuthology.orchestra.run.smithi037.stderr: 29250K .......... .......... .......... .......... .......... 31% 355M 0s 2024-09-12T17:39:45.545 INFO:teuthology.orchestra.run.smithi037.stderr: 29300K .......... .......... .......... .......... .......... 31% 322M 0s 2024-09-12T17:39:45.545 INFO:teuthology.orchestra.run.smithi037.stderr: 29350K .......... .......... .......... .......... .......... 31% 331M 0s 2024-09-12T17:39:45.546 INFO:teuthology.orchestra.run.smithi037.stderr: 29400K .......... .......... .......... .......... .......... 31% 379M 0s 2024-09-12T17:39:45.546 INFO:teuthology.orchestra.run.smithi037.stderr: 29450K .......... .......... .......... .......... .......... 31% 364M 0s 2024-09-12T17:39:45.546 INFO:teuthology.orchestra.run.smithi037.stderr: 29500K .......... .......... .......... .......... .......... 31% 324M 0s 2024-09-12T17:39:45.546 INFO:teuthology.orchestra.run.smithi037.stderr: 29550K .......... .......... .......... .......... .......... 31% 161M 0s 2024-09-12T17:39:45.546 INFO:teuthology.orchestra.run.smithi037.stderr: 29600K .......... .......... .......... .......... .......... 31% 345M 0s 2024-09-12T17:39:45.546 INFO:teuthology.orchestra.run.smithi037.stderr: 29650K .......... .......... .......... .......... .......... 31% 365M 0s 2024-09-12T17:39:45.546 INFO:teuthology.orchestra.run.smithi037.stderr: 29700K .......... .......... .......... .......... .......... 32% 216M 0s 2024-09-12T17:39:45.546 INFO:teuthology.orchestra.run.smithi037.stderr: 29750K .......... .......... .......... .......... .......... 32% 363M 0s 2024-09-12T17:39:45.546 INFO:teuthology.orchestra.run.smithi037.stderr: 29800K .......... .......... .......... .......... .......... 32% 379M 0s 2024-09-12T17:39:45.546 INFO:teuthology.orchestra.run.smithi037.stderr: 29850K .......... .......... .......... .......... .......... 32% 388M 0s 2024-09-12T17:39:45.546 INFO:teuthology.orchestra.run.smithi037.stderr: 29900K .......... .......... .......... .......... .......... 32% 273M 0s 2024-09-12T17:39:45.546 INFO:teuthology.orchestra.run.smithi037.stderr: 29950K .......... .......... .......... .......... .......... 32% 163M 0s 2024-09-12T17:39:45.546 INFO:teuthology.orchestra.run.smithi037.stderr: 30000K .......... .......... .......... .......... .......... 32% 267M 0s 2024-09-12T17:39:45.546 INFO:teuthology.orchestra.run.smithi037.stderr: 30050K .......... .......... .......... .......... .......... 32% 159M 0s 2024-09-12T17:39:45.547 INFO:teuthology.orchestra.run.smithi037.stderr: 30100K .......... .......... .......... .......... .......... 32% 222M 0s 2024-09-12T17:39:45.547 INFO:teuthology.orchestra.run.smithi037.stderr: 30150K .......... .......... .......... .......... .......... 32% 276M 0s 2024-09-12T17:39:45.547 INFO:teuthology.orchestra.run.smithi037.stderr: 30200K .......... .......... .......... .......... .......... 32% 115M 0s 2024-09-12T17:39:45.547 INFO:teuthology.orchestra.run.smithi037.stderr: 30250K .......... .......... .......... .......... .......... 32% 344M 0s 2024-09-12T17:39:45.547 INFO:teuthology.orchestra.run.smithi037.stderr: 30300K .......... .......... .......... .......... .......... 32% 307M 0s 2024-09-12T17:39:45.547 INFO:teuthology.orchestra.run.smithi037.stderr: 30350K .......... .......... .......... .......... .......... 32% 308M 0s 2024-09-12T17:39:45.547 INFO:teuthology.orchestra.run.smithi037.stderr: 30400K .......... .......... .......... .......... .......... 32% 389M 0s 2024-09-12T17:39:45.547 INFO:teuthology.orchestra.run.smithi037.stderr: 30450K .......... .......... .......... .......... .......... 32% 150M 0s 2024-09-12T17:39:45.547 INFO:teuthology.orchestra.run.smithi037.stderr: 30500K .......... .......... .......... .......... .......... 32% 49.1M 0s 2024-09-12T17:39:45.547 INFO:teuthology.orchestra.run.smithi037.stderr: 30550K .......... .......... .......... .......... .......... 32% 211M 0s 2024-09-12T17:39:45.547 INFO:teuthology.orchestra.run.smithi037.stderr: 30600K .......... .......... .......... .......... .......... 32% 374M 0s 2024-09-12T17:39:45.547 INFO:teuthology.orchestra.run.smithi037.stderr: 30650K .......... .......... .......... .......... .......... 33% 362M 0s 2024-09-12T17:39:45.547 INFO:teuthology.orchestra.run.smithi037.stderr: 30700K .......... .......... .......... .......... .......... 33% 349M 0s 2024-09-12T17:39:45.547 INFO:teuthology.orchestra.run.smithi037.stderr: 30750K .......... .......... .......... .......... .......... 33% 321M 0s 2024-09-12T17:39:45.547 INFO:teuthology.orchestra.run.smithi037.stderr: 30800K .......... .......... .......... .......... .......... 33% 362M 0s 2024-09-12T17:39:45.548 INFO:teuthology.orchestra.run.smithi037.stderr: 30850K .......... .......... .......... .......... .......... 33% 358M 0s 2024-09-12T17:39:45.548 INFO:teuthology.orchestra.run.smithi037.stderr: 30900K .......... .......... .......... .......... .......... 33% 377M 0s 2024-09-12T17:39:45.548 INFO:teuthology.orchestra.run.smithi037.stderr: 30950K .......... .......... .......... .......... .......... 33% 218M 0s 2024-09-12T17:39:45.548 INFO:teuthology.orchestra.run.smithi037.stderr: 31000K .......... .......... .......... .......... .......... 33% 133M 0s 2024-09-12T17:39:45.548 INFO:teuthology.orchestra.run.smithi037.stderr: 31050K .......... .......... .......... .......... .......... 33% 198M 0s 2024-09-12T17:39:45.548 INFO:teuthology.orchestra.run.smithi037.stderr: 31100K .......... .......... .......... .......... .......... 33% 240M 0s 2024-09-12T17:39:45.548 INFO:teuthology.orchestra.run.smithi037.stderr: 31150K .......... .......... .......... .......... .......... 33% 244M 0s 2024-09-12T17:39:45.548 INFO:teuthology.orchestra.run.smithi037.stderr: 31200K .......... .......... .......... .......... .......... 33% 246M 0s 2024-09-12T17:39:45.548 INFO:teuthology.orchestra.run.smithi037.stderr: 31250K .......... .......... .......... .......... .......... 33% 219M 0s 2024-09-12T17:39:45.548 INFO:teuthology.orchestra.run.smithi037.stderr: 31300K .......... .......... .......... .......... .......... 33% 241M 0s 2024-09-12T17:39:45.548 INFO:teuthology.orchestra.run.smithi037.stderr: 31350K .......... .......... .......... .......... .......... 33% 142M 0s 2024-09-12T17:39:45.548 INFO:teuthology.orchestra.run.smithi037.stderr: 31400K .......... .......... .......... .......... .......... 33% 280M 0s 2024-09-12T17:39:45.548 INFO:teuthology.orchestra.run.smithi037.stderr: 31450K .......... .......... .......... .......... .......... 33% 310M 0s 2024-09-12T17:39:45.548 INFO:teuthology.orchestra.run.smithi037.stderr: 31500K .......... .......... .......... .......... .......... 33% 388M 0s 2024-09-12T17:39:45.549 INFO:teuthology.orchestra.run.smithi037.stderr: 31550K .......... .......... .......... .......... .......... 34% 315M 0s 2024-09-12T17:39:45.549 INFO:teuthology.orchestra.run.smithi037.stderr: 31600K .......... .......... .......... .......... .......... 34% 382M 0s 2024-09-12T17:39:45.549 INFO:teuthology.orchestra.run.smithi037.stderr: 31650K .......... .......... .......... .......... .......... 34% 345M 0s 2024-09-12T17:39:45.549 INFO:teuthology.orchestra.run.smithi037.stderr: 31700K .......... .......... .......... .......... .......... 34% 375M 0s 2024-09-12T17:39:45.549 INFO:teuthology.orchestra.run.smithi037.stderr: 31750K .......... .......... .......... .......... .......... 34% 376M 0s 2024-09-12T17:39:45.549 INFO:teuthology.orchestra.run.smithi037.stderr: 31800K .......... .......... .......... .......... .......... 34% 376M 0s 2024-09-12T17:39:45.549 INFO:teuthology.orchestra.run.smithi037.stderr: 31850K .......... .......... .......... .......... .......... 34% 316M 0s 2024-09-12T17:39:45.549 INFO:teuthology.orchestra.run.smithi037.stderr: 31900K .......... .......... .......... .......... .......... 34% 362M 0s 2024-09-12T17:39:45.549 INFO:teuthology.orchestra.run.smithi037.stderr: 31950K .......... .......... .......... .......... .......... 34% 57.4M 0s 2024-09-12T17:39:45.549 INFO:teuthology.orchestra.run.smithi037.stderr: 32000K .......... .......... .......... .......... .......... 34% 333M 0s 2024-09-12T17:39:45.549 INFO:teuthology.orchestra.run.smithi037.stderr: 32050K .......... .......... .......... .......... .......... 34% 346M 0s 2024-09-12T17:39:45.549 INFO:teuthology.orchestra.run.smithi037.stderr: 32100K .......... .......... .......... .......... .......... 34% 370M 0s 2024-09-12T17:39:45.549 INFO:teuthology.orchestra.run.smithi037.stderr: 32150K .......... .......... .......... .......... .......... 34% 367M 0s 2024-09-12T17:39:45.549 INFO:teuthology.orchestra.run.smithi037.stderr: 32200K .......... .......... .......... .......... .......... 34% 399M 0s 2024-09-12T17:39:45.549 INFO:teuthology.orchestra.run.smithi037.stderr: 32250K .......... .......... .......... .......... .......... 34% 309M 0s 2024-09-12T17:39:45.550 INFO:teuthology.orchestra.run.smithi037.stderr: 32300K .......... .......... .......... .......... .......... 34% 393M 0s 2024-09-12T17:39:45.550 INFO:teuthology.orchestra.run.smithi037.stderr: 32350K .......... .......... .......... .......... .......... 34% 372M 0s 2024-09-12T17:39:45.550 INFO:teuthology.orchestra.run.smithi037.stderr: 32400K .......... .......... .......... .......... .......... 34% 359M 0s 2024-09-12T17:39:45.550 INFO:teuthology.orchestra.run.smithi037.stderr: 32450K .......... .......... .......... .......... .......... 34% 346M 0s 2024-09-12T17:39:45.550 INFO:teuthology.orchestra.run.smithi037.stderr: 32500K .......... .......... .......... .......... .......... 35% 382M 0s 2024-09-12T17:39:45.550 INFO:teuthology.orchestra.run.smithi037.stderr: 32550K .......... .......... .......... .......... .......... 35% 371M 0s 2024-09-12T17:39:45.550 INFO:teuthology.orchestra.run.smithi037.stderr: 32600K .......... .......... .......... .......... .......... 35% 386M 0s 2024-09-12T17:39:45.550 INFO:teuthology.orchestra.run.smithi037.stderr: 32650K .......... .......... .......... .......... .......... 35% 324M 0s 2024-09-12T17:39:45.550 INFO:teuthology.orchestra.run.smithi037.stderr: 32700K .......... .......... .......... .......... .......... 35% 382M 0s 2024-09-12T17:39:45.550 INFO:teuthology.orchestra.run.smithi037.stderr: 32750K .......... .......... .......... .......... .......... 35% 355M 0s 2024-09-12T17:39:45.550 INFO:teuthology.orchestra.run.smithi037.stderr: 32800K .......... .......... .......... .......... .......... 35% 378M 0s 2024-09-12T17:39:45.550 INFO:teuthology.orchestra.run.smithi037.stderr: 32850K .......... .......... .......... .......... .......... 35% 353M 0s 2024-09-12T17:39:45.550 INFO:teuthology.orchestra.run.smithi037.stderr: 32900K .......... .......... .......... .......... .......... 35% 319M 0s 2024-09-12T17:39:45.550 INFO:teuthology.orchestra.run.smithi037.stderr: 32950K .......... .......... .......... .......... .......... 35% 393M 0s 2024-09-12T17:39:45.551 INFO:teuthology.orchestra.run.smithi037.stderr: 33000K .......... .......... .......... .......... .......... 35% 379M 0s 2024-09-12T17:39:45.551 INFO:teuthology.orchestra.run.smithi037.stderr: 33050K .......... .......... .......... .......... .......... 35% 328M 0s 2024-09-12T17:39:45.551 INFO:teuthology.orchestra.run.smithi037.stderr: 33100K .......... .......... .......... .......... .......... 35% 369M 0s 2024-09-12T17:39:45.551 INFO:teuthology.orchestra.run.smithi037.stderr: 33150K .......... .......... .......... .......... .......... 35% 152M 0s 2024-09-12T17:39:45.551 INFO:teuthology.orchestra.run.smithi037.stderr: 33200K .......... .......... .......... .......... .......... 35% 267M 0s 2024-09-12T17:39:45.551 INFO:teuthology.orchestra.run.smithi037.stderr: 33250K .......... .......... .......... .......... .......... 35% 144M 0s 2024-09-12T17:39:45.551 INFO:teuthology.orchestra.run.smithi037.stderr: 33300K .......... .......... .......... .......... .......... 35% 216M 0s 2024-09-12T17:39:45.551 INFO:teuthology.orchestra.run.smithi037.stderr: 33350K .......... .......... .......... .......... .......... 35% 358M 0s 2024-09-12T17:39:45.551 INFO:teuthology.orchestra.run.smithi037.stderr: 33400K .......... .......... .......... .......... .......... 36% 396M 0s 2024-09-12T17:39:45.551 INFO:teuthology.orchestra.run.smithi037.stderr: 33450K .......... .......... .......... .......... .......... 36% 320M 0s 2024-09-12T17:39:45.551 INFO:teuthology.orchestra.run.smithi037.stderr: 33500K .......... .......... .......... .......... .......... 36% 218M 0s 2024-09-12T17:39:45.551 INFO:teuthology.orchestra.run.smithi037.stderr: 33550K .......... .......... .......... .......... .......... 36% 48.0M 0s 2024-09-12T17:39:45.551 INFO:teuthology.orchestra.run.smithi037.stderr: 33600K .......... .......... .......... .......... .......... 36% 134M 0s 2024-09-12T17:39:45.552 INFO:teuthology.orchestra.run.smithi037.stderr: 33650K .......... .......... .......... .......... .......... 36% 308M 0s 2024-09-12T17:39:45.552 INFO:teuthology.orchestra.run.smithi037.stderr: 33700K .......... .......... .......... .......... .......... 36% 281M 0s 2024-09-12T17:39:45.552 INFO:teuthology.orchestra.run.smithi037.stderr: 33750K .......... .......... .......... .......... .......... 36% 370M 0s 2024-09-12T17:39:45.552 INFO:teuthology.orchestra.run.smithi037.stderr: 33800K .......... .......... .......... .......... .......... 36% 385M 0s 2024-09-12T17:39:45.552 INFO:teuthology.orchestra.run.smithi037.stderr: 33850K .......... .......... .......... .......... .......... 36% 312M 0s 2024-09-12T17:39:45.552 INFO:teuthology.orchestra.run.smithi037.stderr: 33900K .......... .......... .......... .......... .......... 36% 307M 0s 2024-09-12T17:39:45.552 INFO:teuthology.orchestra.run.smithi037.stderr: 33950K .......... .......... .......... .......... .......... 36% 394M 0s 2024-09-12T17:39:45.552 INFO:teuthology.orchestra.run.smithi037.stderr: 34000K .......... .......... .......... .......... .......... 36% 342M 0s 2024-09-12T17:39:45.552 INFO:teuthology.orchestra.run.smithi037.stderr: 34050K .......... .......... .......... .......... .......... 36% 241M 0s 2024-09-12T17:39:45.552 INFO:teuthology.orchestra.run.smithi037.stderr: 34100K .......... .......... .......... .......... .......... 36% 375M 0s 2024-09-12T17:39:45.552 INFO:teuthology.orchestra.run.smithi037.stderr: 34150K .......... .......... .......... .......... .......... 36% 153M 0s 2024-09-12T17:39:45.552 INFO:teuthology.orchestra.run.smithi037.stderr: 34200K .......... .......... .......... .......... .......... 36% 327M 0s 2024-09-12T17:39:45.552 INFO:teuthology.orchestra.run.smithi037.stderr: 34250K .......... .......... .......... .......... .......... 36% 109M 0s 2024-09-12T17:39:45.552 INFO:teuthology.orchestra.run.smithi037.stderr: 34300K .......... .......... .......... .......... .......... 36% 89.7M 0s 2024-09-12T17:39:45.553 INFO:teuthology.orchestra.run.smithi037.stderr: 34350K .......... .......... .......... .......... .......... 37% 318M 0s 2024-09-12T17:39:45.553 INFO:teuthology.orchestra.run.smithi037.stderr: 34400K .......... .......... .......... .......... .......... 37% 385M 0s 2024-09-12T17:39:45.553 INFO:teuthology.orchestra.run.smithi037.stderr: 34450K .......... .......... .......... .......... .......... 37% 334M 0s 2024-09-12T17:39:45.553 INFO:teuthology.orchestra.run.smithi037.stderr: 34500K .......... .......... .......... .......... .......... 37% 277M 0s 2024-09-12T17:39:45.553 INFO:teuthology.orchestra.run.smithi037.stderr: 34550K .......... .......... .......... .......... .......... 37% 298M 0s 2024-09-12T17:39:45.553 INFO:teuthology.orchestra.run.smithi037.stderr: 34600K .......... .......... .......... .......... .......... 37% 350M 0s 2024-09-12T17:39:45.553 INFO:teuthology.orchestra.run.smithi037.stderr: 34650K .......... .......... .......... .......... .......... 37% 318M 0s 2024-09-12T17:39:45.553 INFO:teuthology.orchestra.run.smithi037.stderr: 34700K .......... .......... .......... .......... .......... 37% 381M 0s 2024-09-12T17:39:45.553 INFO:teuthology.orchestra.run.smithi037.stderr: 34750K .......... .......... .......... .......... .......... 37% 380M 0s 2024-09-12T17:39:45.553 INFO:teuthology.orchestra.run.smithi037.stderr: 34800K .......... .......... .......... .......... .......... 37% 321M 0s 2024-09-12T17:39:45.553 INFO:teuthology.orchestra.run.smithi037.stderr: 34850K .......... .......... .......... .......... .......... 37% 340M 0s 2024-09-12T17:39:45.553 INFO:teuthology.orchestra.run.smithi037.stderr: 34900K .......... .......... .......... .......... .......... 37% 283M 0s 2024-09-12T17:39:45.553 INFO:teuthology.orchestra.run.smithi037.stderr: 34950K .......... .......... .......... .......... .......... 37% 73.1M 0s 2024-09-12T17:39:45.553 INFO:teuthology.orchestra.run.smithi037.stderr: 35000K .......... .......... .......... .......... .......... 37% 376M 0s 2024-09-12T17:39:45.553 INFO:teuthology.orchestra.run.smithi037.stderr: 35050K .......... .......... .......... .......... .......... 37% 323M 0s 2024-09-12T17:39:45.554 INFO:teuthology.orchestra.run.smithi037.stderr: 35100K .......... .......... .......... .......... .......... 37% 92.9M 0s 2024-09-12T17:39:45.554 INFO:teuthology.orchestra.run.smithi037.stderr: 35150K .......... .......... .......... .......... .......... 37% 371M 0s 2024-09-12T17:39:45.554 INFO:teuthology.orchestra.run.smithi037.stderr: 35200K .......... .......... .......... .......... .......... 37% 378M 0s 2024-09-12T17:39:45.554 INFO:teuthology.orchestra.run.smithi037.stderr: 35250K .......... .......... .......... .......... .......... 37% 348M 0s 2024-09-12T17:39:45.554 INFO:teuthology.orchestra.run.smithi037.stderr: 35300K .......... .......... .......... .......... .......... 38% 379M 0s 2024-09-12T17:39:45.554 INFO:teuthology.orchestra.run.smithi037.stderr: 35350K .......... .......... .......... .......... .......... 38% 375M 0s 2024-09-12T17:39:45.554 INFO:teuthology.orchestra.run.smithi037.stderr: 35400K .......... .......... .......... .......... .......... 38% 298M 0s 2024-09-12T17:39:45.554 INFO:teuthology.orchestra.run.smithi037.stderr: 35450K .......... .......... .......... .......... .......... 38% 374M 0s 2024-09-12T17:39:45.554 INFO:teuthology.orchestra.run.smithi037.stderr: 35500K .......... .......... .......... .......... .......... 38% 375M 0s 2024-09-12T17:39:45.554 INFO:teuthology.orchestra.run.smithi037.stderr: 35550K .......... .......... .......... .......... .......... 38% 308M 0s 2024-09-12T17:39:45.554 INFO:teuthology.orchestra.run.smithi037.stderr: 35600K .......... .......... .......... .......... .......... 38% 372M 0s 2024-09-12T17:39:45.554 INFO:teuthology.orchestra.run.smithi037.stderr: 35650K .......... .......... .......... .......... .......... 38% 352M 0s 2024-09-12T17:39:45.554 INFO:teuthology.orchestra.run.smithi037.stderr: 35700K .......... .......... .......... .......... .......... 38% 362M 0s 2024-09-12T17:39:45.554 INFO:teuthology.orchestra.run.smithi037.stderr: 35750K .......... .......... .......... .......... .......... 38% 344M 0s 2024-09-12T17:39:45.554 INFO:teuthology.orchestra.run.smithi037.stderr: 35800K .......... .......... .......... .......... .......... 38% 380M 0s 2024-09-12T17:39:45.555 INFO:teuthology.orchestra.run.smithi037.stderr: 35850K .......... .......... .......... .......... .......... 38% 373M 0s 2024-09-12T17:39:45.555 INFO:teuthology.orchestra.run.smithi037.stderr: 35900K .......... .......... .......... .......... .......... 38% 333M 0s 2024-09-12T17:39:45.555 INFO:teuthology.orchestra.run.smithi037.stderr: 35950K .......... .......... .......... .......... .......... 38% 321M 0s 2024-09-12T17:39:45.555 INFO:teuthology.orchestra.run.smithi037.stderr: 36000K .......... .......... .......... .......... .......... 38% 382M 0s 2024-09-12T17:39:45.555 INFO:teuthology.orchestra.run.smithi037.stderr: 36050K .......... .......... .......... .......... .......... 38% 380M 0s 2024-09-12T17:39:45.555 INFO:teuthology.orchestra.run.smithi037.stderr: 36100K .......... .......... .......... .......... .......... 38% 324M 0s 2024-09-12T17:39:45.555 INFO:teuthology.orchestra.run.smithi037.stderr: 36150K .......... .......... .......... .......... .......... 38% 345M 0s 2024-09-12T17:39:45.555 INFO:teuthology.orchestra.run.smithi037.stderr: 36200K .......... .......... .......... .......... .......... 39% 378M 0s 2024-09-12T17:39:45.555 INFO:teuthology.orchestra.run.smithi037.stderr: 36250K .......... .......... .......... .......... .......... 39% 315M 0s 2024-09-12T17:39:45.555 INFO:teuthology.orchestra.run.smithi037.stderr: 36300K .......... .......... .......... .......... .......... 39% 387M 0s 2024-09-12T17:39:45.555 INFO:teuthology.orchestra.run.smithi037.stderr: 36350K .......... .......... .......... .......... .......... 39% 315M 0s 2024-09-12T17:39:45.555 INFO:teuthology.orchestra.run.smithi037.stderr: 36400K .......... .......... .......... .......... .......... 39% 391M 0s 2024-09-12T17:39:45.555 INFO:teuthology.orchestra.run.smithi037.stderr: 36450K .......... .......... .......... .......... .......... 39% 362M 0s 2024-09-12T17:39:45.556 INFO:teuthology.orchestra.run.smithi037.stderr: 36500K .......... .......... .......... .......... .......... 39% 361M 0s 2024-09-12T17:39:45.556 INFO:teuthology.orchestra.run.smithi037.stderr: 36550K .......... .......... .......... .......... .......... 39% 346M 0s 2024-09-12T17:39:45.556 INFO:teuthology.orchestra.run.smithi037.stderr: 36600K .......... .......... .......... .......... .......... 39% 54.7M 0s 2024-09-12T17:39:45.556 INFO:teuthology.orchestra.run.smithi037.stderr: 36650K .......... .......... .......... .......... .......... 39% 354M 0s 2024-09-12T17:39:45.556 INFO:teuthology.orchestra.run.smithi037.stderr: 36700K .......... .......... .......... .......... .......... 39% 54.5M 0s 2024-09-12T17:39:45.556 INFO:teuthology.orchestra.run.smithi037.stderr: 36750K .......... .......... .......... .......... .......... 39% 318M 0s 2024-09-12T17:39:45.556 INFO:teuthology.orchestra.run.smithi037.stderr: 36800K .......... .......... .......... .......... .......... 39% 374M 0s 2024-09-12T17:39:45.556 INFO:teuthology.orchestra.run.smithi037.stderr: 36850K .......... .......... .......... .......... .......... 39% 380M 0s 2024-09-12T17:39:45.556 INFO:teuthology.orchestra.run.smithi037.stderr: 36900K .......... .......... .......... .......... .......... 39% 299M 0s 2024-09-12T17:39:45.556 INFO:teuthology.orchestra.run.smithi037.stderr: 36950K .......... .......... .......... .......... .......... 39% 279M 0s 2024-09-12T17:39:45.556 INFO:teuthology.orchestra.run.smithi037.stderr: 37000K .......... .......... .......... .......... .......... 39% 334M 0s 2024-09-12T17:39:45.556 INFO:teuthology.orchestra.run.smithi037.stderr: 37050K .......... .......... .......... .......... .......... 39% 381M 0s 2024-09-12T17:39:45.556 INFO:teuthology.orchestra.run.smithi037.stderr: 37100K .......... .......... .......... .......... .......... 39% 383M 0s 2024-09-12T17:39:45.556 INFO:teuthology.orchestra.run.smithi037.stderr: 37150K .......... .......... .......... .......... .......... 40% 290M 0s 2024-09-12T17:39:45.556 INFO:teuthology.orchestra.run.smithi037.stderr: 37200K .......... .......... .......... .......... .......... 40% 389M 0s 2024-09-12T17:39:45.557 INFO:teuthology.orchestra.run.smithi037.stderr: 37250K .......... .......... .......... .......... .......... 40% 368M 0s 2024-09-12T17:39:45.557 INFO:teuthology.orchestra.run.smithi037.stderr: 37300K .......... .......... .......... .......... .......... 40% 323M 0s 2024-09-12T17:39:45.557 INFO:teuthology.orchestra.run.smithi037.stderr: 37350K .......... .......... .......... .......... .......... 40% 319M 0s 2024-09-12T17:39:45.557 INFO:teuthology.orchestra.run.smithi037.stderr: 37400K .......... .......... .......... .......... .......... 40% 83.4M 0s 2024-09-12T17:39:45.557 INFO:teuthology.orchestra.run.smithi037.stderr: 37450K .......... .......... .......... .......... .......... 40% 168M 0s 2024-09-12T17:39:45.557 INFO:teuthology.orchestra.run.smithi037.stderr: 37500K .......... .......... .......... .......... .......... 40% 277M 0s 2024-09-12T17:39:45.557 INFO:teuthology.orchestra.run.smithi037.stderr: 37550K .......... .......... .......... .......... .......... 40% 314M 0s 2024-09-12T17:39:45.557 INFO:teuthology.orchestra.run.smithi037.stderr: 37600K .......... .......... .......... .......... .......... 40% 386M 0s 2024-09-12T17:39:45.557 INFO:teuthology.orchestra.run.smithi037.stderr: 37650K .......... .......... .......... .......... .......... 40% 185M 0s 2024-09-12T17:39:45.557 INFO:teuthology.orchestra.run.smithi037.stderr: 37700K .......... .......... .......... .......... .......... 40% 384M 0s 2024-09-12T17:39:45.557 INFO:teuthology.orchestra.run.smithi037.stderr: 37750K .......... .......... .......... .......... .......... 40% 316M 0s 2024-09-12T17:39:45.557 INFO:teuthology.orchestra.run.smithi037.stderr: 37800K .......... .......... .......... .......... .......... 40% 375M 0s 2024-09-12T17:39:45.557 INFO:teuthology.orchestra.run.smithi037.stderr: 37850K .......... .......... .......... .......... .......... 40% 372M 0s 2024-09-12T17:39:45.557 INFO:teuthology.orchestra.run.smithi037.stderr: 37900K .......... .......... .......... .......... .......... 40% 159M 0s 2024-09-12T17:39:45.558 INFO:teuthology.orchestra.run.smithi037.stderr: 37950K .......... .......... .......... .......... .......... 40% 319M 0s 2024-09-12T17:39:45.558 INFO:teuthology.orchestra.run.smithi037.stderr: 38000K .......... .......... .......... .......... .......... 40% 122M 0s 2024-09-12T17:39:45.558 INFO:teuthology.orchestra.run.smithi037.stderr: 38050K .......... .......... .......... .......... .......... 41% 368M 0s 2024-09-12T17:39:45.558 INFO:teuthology.orchestra.run.smithi037.stderr: 38100K .......... .......... .......... .......... .......... 41% 389M 0s 2024-09-12T17:39:45.558 INFO:teuthology.orchestra.run.smithi037.stderr: 38150K .......... .......... .......... .......... .......... 41% 106M 0s 2024-09-12T17:39:45.558 INFO:teuthology.orchestra.run.smithi037.stderr: 38200K .......... .......... .......... .......... .......... 41% 130M 0s 2024-09-12T17:39:45.558 INFO:teuthology.orchestra.run.smithi037.stderr: 38250K .......... .......... .......... .......... .......... 41% 267M 0s 2024-09-12T17:39:45.558 INFO:teuthology.orchestra.run.smithi037.stderr: 38300K .......... .......... .......... .......... .......... 41% 374M 0s 2024-09-12T17:39:45.558 INFO:teuthology.orchestra.run.smithi037.stderr: 38350K .......... .......... .......... .......... .......... 41% 154M 0s 2024-09-12T17:39:45.558 INFO:teuthology.orchestra.run.smithi037.stderr: 38400K .......... .......... .......... .......... .......... 41% 350M 0s 2024-09-12T17:39:45.558 INFO:teuthology.orchestra.run.smithi037.stderr: 38450K .......... .......... .......... .......... .......... 41% 382M 0s 2024-09-12T17:39:45.558 INFO:teuthology.orchestra.run.smithi037.stderr: 38500K .......... .......... .......... .......... .......... 41% 372M 0s 2024-09-12T17:39:45.558 INFO:teuthology.orchestra.run.smithi037.stderr: 38550K .......... .......... .......... .......... .......... 41% 339M 0s 2024-09-12T17:39:45.558 INFO:teuthology.orchestra.run.smithi037.stderr: 38600K .......... .......... .......... .......... .......... 41% 379M 0s 2024-09-12T17:39:45.559 INFO:teuthology.orchestra.run.smithi037.stderr: 38650K .......... .......... .......... .......... .......... 41% 376M 0s 2024-09-12T17:39:45.559 INFO:teuthology.orchestra.run.smithi037.stderr: 38700K .......... .......... .......... .......... .......... 41% 376M 0s 2024-09-12T17:39:45.559 INFO:teuthology.orchestra.run.smithi037.stderr: 38750K .......... .......... .......... .......... .......... 41% 313M 0s 2024-09-12T17:39:45.559 INFO:teuthology.orchestra.run.smithi037.stderr: 38800K .......... .......... .......... .......... .......... 41% 361M 0s 2024-09-12T17:39:45.559 INFO:teuthology.orchestra.run.smithi037.stderr: 38850K .......... .......... .......... .......... .......... 41% 384M 0s 2024-09-12T17:39:45.559 INFO:teuthology.orchestra.run.smithi037.stderr: 38900K .......... .......... .......... .......... .......... 41% 390M 0s 2024-09-12T17:39:45.559 INFO:teuthology.orchestra.run.smithi037.stderr: 38950K .......... .......... .......... .......... .......... 41% 255M 0s 2024-09-12T17:39:45.559 INFO:teuthology.orchestra.run.smithi037.stderr: 39000K .......... .......... .......... .......... .......... 42% 379M 0s 2024-09-12T17:39:45.559 INFO:teuthology.orchestra.run.smithi037.stderr: 39050K .......... .......... .......... .......... .......... 42% 385M 0s 2024-09-12T17:39:45.559 INFO:teuthology.orchestra.run.smithi037.stderr: 39100K .......... .......... .......... .......... .......... 42% 328M 0s 2024-09-12T17:39:45.559 INFO:teuthology.orchestra.run.smithi037.stderr: 39150K .......... .......... .......... .......... .......... 42% 354M 0s 2024-09-12T17:39:45.559 INFO:teuthology.orchestra.run.smithi037.stderr: 39200K .......... .......... .......... .......... .......... 42% 390M 0s 2024-09-12T17:39:45.559 INFO:teuthology.orchestra.run.smithi037.stderr: 39250K .......... .......... .......... .......... .......... 42% 318M 0s 2024-09-12T17:39:45.559 INFO:teuthology.orchestra.run.smithi037.stderr: 39300K .......... .......... .......... .......... .......... 42% 383M 0s 2024-09-12T17:39:45.560 INFO:teuthology.orchestra.run.smithi037.stderr: 39350K .......... .......... .......... .......... .......... 42% 378M 0s 2024-09-12T17:39:45.560 INFO:teuthology.orchestra.run.smithi037.stderr: 39400K .......... .......... .......... .......... .......... 42% 398M 0s 2024-09-12T17:39:45.560 INFO:teuthology.orchestra.run.smithi037.stderr: 39450K .......... .......... .......... .......... .......... 42% 314M 0s 2024-09-12T17:39:45.560 INFO:teuthology.orchestra.run.smithi037.stderr: 39500K .......... .......... .......... .......... .......... 42% 379M 0s 2024-09-12T17:39:45.560 INFO:teuthology.orchestra.run.smithi037.stderr: 39550K .......... .......... .......... .......... .......... 42% 252M 0s 2024-09-12T17:39:45.560 INFO:teuthology.orchestra.run.smithi037.stderr: 39600K .......... .......... .......... .......... .......... 42% 81.6M 0s 2024-09-12T17:39:45.560 INFO:teuthology.orchestra.run.smithi037.stderr: 39650K .......... .......... .......... .......... .......... 42% 281M 0s 2024-09-12T17:39:45.560 INFO:teuthology.orchestra.run.smithi037.stderr: 39700K .......... .......... .......... .......... .......... 42% 382M 0s 2024-09-12T17:39:45.560 INFO:teuthology.orchestra.run.smithi037.stderr: 39750K .......... .......... .......... .......... .......... 42% 63.7M 0s 2024-09-12T17:39:45.560 INFO:teuthology.orchestra.run.smithi037.stderr: 39800K .......... .......... .......... .......... .......... 42% 160M 0s 2024-09-12T17:39:45.560 INFO:teuthology.orchestra.run.smithi037.stderr: 39850K .......... .......... .......... .......... .......... 42% 298M 0s 2024-09-12T17:39:45.560 INFO:teuthology.orchestra.run.smithi037.stderr: 39900K .......... .......... .......... .......... .......... 43% 357M 0s 2024-09-12T17:39:45.560 INFO:teuthology.orchestra.run.smithi037.stderr: 39950K .......... .......... .......... .......... .......... 43% 367M 0s 2024-09-12T17:39:45.560 INFO:teuthology.orchestra.run.smithi037.stderr: 40000K .......... .......... .......... .......... .......... 43% 397M 0s 2024-09-12T17:39:45.561 INFO:teuthology.orchestra.run.smithi037.stderr: 40050K .......... .......... .......... .......... .......... 43% 303M 0s 2024-09-12T17:39:45.561 INFO:teuthology.orchestra.run.smithi037.stderr: 40100K .......... .......... .......... .......... .......... 43% 367M 0s 2024-09-12T17:39:45.561 INFO:teuthology.orchestra.run.smithi037.stderr: 40150K .......... .......... .......... .......... .......... 43% 378M 0s 2024-09-12T17:39:45.561 INFO:teuthology.orchestra.run.smithi037.stderr: 40200K .......... .......... .......... .......... .......... 43% 393M 0s 2024-09-12T17:39:45.561 INFO:teuthology.orchestra.run.smithi037.stderr: 40250K .......... .......... .......... .......... .......... 43% 338M 0s 2024-09-12T17:39:45.561 INFO:teuthology.orchestra.run.smithi037.stderr: 40300K .......... .......... .......... .......... .......... 43% 394M 0s 2024-09-12T17:39:45.561 INFO:teuthology.orchestra.run.smithi037.stderr: 40350K .......... .......... .......... .......... .......... 43% 380M 0s 2024-09-12T17:39:45.561 INFO:teuthology.orchestra.run.smithi037.stderr: 40400K .......... .......... .......... .......... .......... 43% 390M 0s 2024-09-12T17:39:45.561 INFO:teuthology.orchestra.run.smithi037.stderr: 40450K .......... .......... .......... .......... .......... 43% 154M 0s 2024-09-12T17:39:45.561 INFO:teuthology.orchestra.run.smithi037.stderr: 40500K .......... .......... .......... .......... .......... 43% 128M 0s 2024-09-12T17:39:45.561 INFO:teuthology.orchestra.run.smithi037.stderr: 40550K .......... .......... .......... .......... .......... 43% 143M 0s 2024-09-12T17:39:45.561 INFO:teuthology.orchestra.run.smithi037.stderr: 40600K .......... .......... .......... .......... .......... 43% 300M 0s 2024-09-12T17:39:45.561 INFO:teuthology.orchestra.run.smithi037.stderr: 40650K .......... .......... .......... .......... .......... 43% 382M 0s 2024-09-12T17:39:45.561 INFO:teuthology.orchestra.run.smithi037.stderr: 40700K .......... .......... .......... .......... .......... 43% 93.5M 0s 2024-09-12T17:39:45.562 INFO:teuthology.orchestra.run.smithi037.stderr: 40750K .......... .......... .......... .......... .......... 43% 280M 0s 2024-09-12T17:39:45.562 INFO:teuthology.orchestra.run.smithi037.stderr: 40800K .......... .......... .......... .......... .......... 43% 344M 0s 2024-09-12T17:39:45.562 INFO:teuthology.orchestra.run.smithi037.stderr: 40850K .......... .......... .......... .......... .......... 44% 357M 0s 2024-09-12T17:39:45.562 INFO:teuthology.orchestra.run.smithi037.stderr: 40900K .......... .......... .......... .......... .......... 44% 387M 0s 2024-09-12T17:39:45.562 INFO:teuthology.orchestra.run.smithi037.stderr: 40950K .......... .......... .......... .......... .......... 44% 377M 0s 2024-09-12T17:39:45.562 INFO:teuthology.orchestra.run.smithi037.stderr: 41000K .......... .......... .......... .......... .......... 44% 369M 0s 2024-09-12T17:39:45.562 INFO:teuthology.orchestra.run.smithi037.stderr: 41050K .......... .......... .......... .......... .......... 44% 361M 0s 2024-09-12T17:39:45.562 INFO:teuthology.orchestra.run.smithi037.stderr: 41100K .......... .......... .......... .......... .......... 44% 349M 0s 2024-09-12T17:39:45.562 INFO:teuthology.orchestra.run.smithi037.stderr: 41150K .......... .......... .......... .......... .......... 44% 156M 0s 2024-09-12T17:39:45.562 INFO:teuthology.orchestra.run.smithi037.stderr: 41200K .......... .......... .......... .......... .......... 44% 105M 0s 2024-09-12T17:39:45.562 INFO:teuthology.orchestra.run.smithi037.stderr: 41250K .......... .......... .......... .......... .......... 44% 166M 0s 2024-09-12T17:39:45.562 INFO:teuthology.orchestra.run.smithi037.stderr: 41300K .......... .......... .......... .......... .......... 44% 205M 0s 2024-09-12T17:39:45.562 INFO:teuthology.orchestra.run.smithi037.stderr: 41350K .......... .......... .......... .......... .......... 44% 322M 0s 2024-09-12T17:39:45.562 INFO:teuthology.orchestra.run.smithi037.stderr: 41400K .......... .......... .......... .......... .......... 44% 200M 0s 2024-09-12T17:39:45.563 INFO:teuthology.orchestra.run.smithi037.stderr: 41450K .......... .......... .......... .......... .......... 44% 106M 0s 2024-09-12T17:39:45.563 INFO:teuthology.orchestra.run.smithi037.stderr: 41500K .......... .......... .......... .......... .......... 44% 354M 0s 2024-09-12T17:39:45.563 INFO:teuthology.orchestra.run.smithi037.stderr: 41550K .......... .......... .......... .......... .......... 44% 319M 0s 2024-09-12T17:39:45.563 INFO:teuthology.orchestra.run.smithi037.stderr: 41600K .......... .......... .......... .......... .......... 44% 378M 0s 2024-09-12T17:39:45.563 INFO:teuthology.orchestra.run.smithi037.stderr: 41650K .......... .......... .......... .......... .......... 44% 306M 0s 2024-09-12T17:39:45.563 INFO:teuthology.orchestra.run.smithi037.stderr: 41700K .......... .......... .......... .......... .......... 44% 406M 0s 2024-09-12T17:39:45.563 INFO:teuthology.orchestra.run.smithi037.stderr: 41750K .......... .......... .......... .......... .......... 44% 326M 0s 2024-09-12T17:39:45.563 INFO:teuthology.orchestra.run.smithi037.stderr: 41800K .......... .......... .......... .......... .......... 45% 383M 0s 2024-09-12T17:39:45.563 INFO:teuthology.orchestra.run.smithi037.stderr: 41850K .......... .......... .......... .......... .......... 45% 358M 0s 2024-09-12T17:39:45.563 INFO:teuthology.orchestra.run.smithi037.stderr: 41900K .......... .......... .......... .......... .......... 45% 391M 0s 2024-09-12T17:39:45.563 INFO:teuthology.orchestra.run.smithi037.stderr: 41950K .......... .......... .......... .......... .......... 45% 319M 0s 2024-09-12T17:39:45.563 INFO:teuthology.orchestra.run.smithi037.stderr: 42000K .......... .......... .......... .......... .......... 45% 376M 0s 2024-09-12T17:39:45.563 INFO:teuthology.orchestra.run.smithi037.stderr: 42050K .......... .......... .......... .......... .......... 45% 385M 0s 2024-09-12T17:39:45.563 INFO:teuthology.orchestra.run.smithi037.stderr: 42100K .......... .......... .......... .......... .......... 45% 377M 0s 2024-09-12T17:39:45.564 INFO:teuthology.orchestra.run.smithi037.stderr: 42150K .......... .......... .......... .......... .......... 45% 310M 0s 2024-09-12T17:39:45.564 INFO:teuthology.orchestra.run.smithi037.stderr: 42200K .......... .......... .......... .......... .......... 45% 346M 0s 2024-09-12T17:39:45.564 INFO:teuthology.orchestra.run.smithi037.stderr: 42250K .......... .......... .......... .......... .......... 45% 366M 0s 2024-09-12T17:39:45.564 INFO:teuthology.orchestra.run.smithi037.stderr: 42300K .......... .......... .......... .......... .......... 45% 385M 0s 2024-09-12T17:39:45.564 INFO:teuthology.orchestra.run.smithi037.stderr: 42350K .......... .......... .......... .......... .......... 45% 320M 0s 2024-09-12T17:39:45.564 INFO:teuthology.orchestra.run.smithi037.stderr: 42400K .......... .......... .......... .......... .......... 45% 385M 0s 2024-09-12T17:39:45.564 INFO:teuthology.orchestra.run.smithi037.stderr: 42450K .......... .......... .......... .......... .......... 45% 323M 0s 2024-09-12T17:39:45.564 INFO:teuthology.orchestra.run.smithi037.stderr: 42500K .......... .......... .......... .......... .......... 45% 373M 0s 2024-09-12T17:39:45.564 INFO:teuthology.orchestra.run.smithi037.stderr: 42550K .......... .......... .......... .......... .......... 45% 303M 0s 2024-09-12T17:39:45.564 INFO:teuthology.orchestra.run.smithi037.stderr: 42600K .......... .......... .......... .......... .......... 45% 381M 0s 2024-09-12T17:39:45.564 INFO:teuthology.orchestra.run.smithi037.stderr: 42650K .......... .......... .......... .......... .......... 45% 173M 0s 2024-09-12T17:39:45.564 INFO:teuthology.orchestra.run.smithi037.stderr: 42700K .......... .......... .......... .......... .......... 46% 309M 0s 2024-09-12T17:39:45.564 INFO:teuthology.orchestra.run.smithi037.stderr: 42750K .......... .......... .......... .......... .......... 46% 301M 0s 2024-09-12T17:39:45.564 INFO:teuthology.orchestra.run.smithi037.stderr: 42800K .......... .......... .......... .......... .......... 46% 72.4M 0s 2024-09-12T17:39:45.564 INFO:teuthology.orchestra.run.smithi037.stderr: 42850K .......... .......... .......... .......... .......... 46% 76.4M 0s 2024-09-12T17:39:45.565 INFO:teuthology.orchestra.run.smithi037.stderr: 42900K .......... .......... .......... .......... .......... 46% 307M 0s 2024-09-12T17:39:45.565 INFO:teuthology.orchestra.run.smithi037.stderr: 42950K .......... .......... .......... .......... .......... 46% 199M 0s 2024-09-12T17:39:45.565 INFO:teuthology.orchestra.run.smithi037.stderr: 43000K .......... .......... .......... .......... .......... 46% 369M 0s 2024-09-12T17:39:45.565 INFO:teuthology.orchestra.run.smithi037.stderr: 43050K .......... .......... .......... .......... .......... 46% 368M 0s 2024-09-12T17:39:45.565 INFO:teuthology.orchestra.run.smithi037.stderr: 43100K .......... .......... .......... .......... .......... 46% 381M 0s 2024-09-12T17:39:45.565 INFO:teuthology.orchestra.run.smithi037.stderr: 43150K .......... .......... .......... .......... .......... 46% 286M 0s 2024-09-12T17:39:45.565 INFO:teuthology.orchestra.run.smithi037.stderr: 43200K .......... .......... .......... .......... .......... 46% 370M 0s 2024-09-12T17:39:45.565 INFO:teuthology.orchestra.run.smithi037.stderr: 43250K .......... .......... .......... .......... .......... 46% 376M 0s 2024-09-12T17:39:45.565 INFO:teuthology.orchestra.run.smithi037.stderr: 43300K .......... .......... .......... .......... .......... 46% 391M 0s 2024-09-12T17:39:45.565 INFO:teuthology.orchestra.run.smithi037.stderr: 43350K .......... .......... .......... .......... .......... 46% 347M 0s 2024-09-12T17:39:45.565 INFO:teuthology.orchestra.run.smithi037.stderr: 43400K .......... .......... .......... .......... .......... 46% 386M 0s 2024-09-12T17:39:45.565 INFO:teuthology.orchestra.run.smithi037.stderr: 43450K .......... .......... .......... .......... .......... 46% 380M 0s 2024-09-12T17:39:45.565 INFO:teuthology.orchestra.run.smithi037.stderr: 43500K .......... .......... .......... .......... .......... 46% 372M 0s 2024-09-12T17:39:45.565 INFO:teuthology.orchestra.run.smithi037.stderr: 43550K .......... .......... .......... .......... .......... 46% 309M 0s 2024-09-12T17:39:45.566 INFO:teuthology.orchestra.run.smithi037.stderr: 43600K .......... .......... .......... .......... .......... 46% 110M 0s 2024-09-12T17:39:45.566 INFO:teuthology.orchestra.run.smithi037.stderr: 43650K .......... .......... .......... .......... .......... 47% 238M 0s 2024-09-12T17:39:45.566 INFO:teuthology.orchestra.run.smithi037.stderr: 43700K .......... .......... .......... .......... .......... 47% 361M 0s 2024-09-12T17:39:45.566 INFO:teuthology.orchestra.run.smithi037.stderr: 43750K .......... .......... .......... .......... .......... 47% 73.0M 0s 2024-09-12T17:39:45.566 INFO:teuthology.orchestra.run.smithi037.stderr: 43800K .......... .......... .......... .......... .......... 47% 130M 0s 2024-09-12T17:39:45.566 INFO:teuthology.orchestra.run.smithi037.stderr: 43850K .......... .......... .......... .......... .......... 47% 253M 0s 2024-09-12T17:39:45.566 INFO:teuthology.orchestra.run.smithi037.stderr: 43900K .......... .......... .......... .......... .......... 47% 361M 0s 2024-09-12T17:39:45.566 INFO:teuthology.orchestra.run.smithi037.stderr: 43950K .......... .......... .......... .......... .......... 47% 315M 0s 2024-09-12T17:39:45.566 INFO:teuthology.orchestra.run.smithi037.stderr: 44000K .......... .......... .......... .......... .......... 47% 376M 0s 2024-09-12T17:39:45.566 INFO:teuthology.orchestra.run.smithi037.stderr: 44050K .......... .......... .......... .......... .......... 47% 383M 0s 2024-09-12T17:39:45.566 INFO:teuthology.orchestra.run.smithi037.stderr: 44100K .......... .......... .......... .......... .......... 47% 383M 0s 2024-09-12T17:39:45.566 INFO:teuthology.orchestra.run.smithi037.stderr: 44150K .......... .......... .......... .......... .......... 47% 343M 0s 2024-09-12T17:39:45.566 INFO:teuthology.orchestra.run.smithi037.stderr: 44200K .......... .......... .......... .......... .......... 47% 351M 0s 2024-09-12T17:39:45.566 INFO:teuthology.orchestra.run.smithi037.stderr: 44250K .......... .......... .......... .......... .......... 47% 142M 0s 2024-09-12T17:39:45.567 INFO:teuthology.orchestra.run.smithi037.stderr: 44300K .......... .......... .......... .......... .......... 47% 299M 0s 2024-09-12T17:39:45.567 INFO:teuthology.orchestra.run.smithi037.stderr: 44350K .......... .......... .......... .......... .......... 47% 228M 0s 2024-09-12T17:39:45.567 INFO:teuthology.orchestra.run.smithi037.stderr: 44400K .......... .......... .......... .......... .......... 47% 303M 0s 2024-09-12T17:39:45.567 INFO:teuthology.orchestra.run.smithi037.stderr: 44450K .......... .......... .......... .......... .......... 47% 220M 0s 2024-09-12T17:39:45.567 INFO:teuthology.orchestra.run.smithi037.stderr: 44500K .......... .......... .......... .......... .......... 47% 80.4M 0s 2024-09-12T17:39:45.567 INFO:teuthology.orchestra.run.smithi037.stderr: 44550K .......... .......... .......... .......... .......... 48% 280M 0s 2024-09-12T17:39:45.567 INFO:teuthology.orchestra.run.smithi037.stderr: 44600K .......... .......... .......... .......... .......... 48% 281M 0s 2024-09-12T17:39:45.567 INFO:teuthology.orchestra.run.smithi037.stderr: 44650K .......... .......... .......... .......... .......... 48% 305M 0s 2024-09-12T17:39:45.567 INFO:teuthology.orchestra.run.smithi037.stderr: 44700K .......... .......... .......... .......... .......... 48% 289M 0s 2024-09-12T17:39:45.567 INFO:teuthology.orchestra.run.smithi037.stderr: 44750K .......... .......... .......... .......... .......... 48% 229M 0s 2024-09-12T17:39:45.567 INFO:teuthology.orchestra.run.smithi037.stderr: 44800K .......... .......... .......... .......... .......... 48% 316M 0s 2024-09-12T17:39:45.567 INFO:teuthology.orchestra.run.smithi037.stderr: 44850K .......... .......... .......... .......... .......... 48% 290M 0s 2024-09-12T17:39:45.567 INFO:teuthology.orchestra.run.smithi037.stderr: 44900K .......... .......... .......... .......... .......... 48% 298M 0s 2024-09-12T17:39:45.567 INFO:teuthology.orchestra.run.smithi037.stderr: 44950K .......... .......... .......... .......... .......... 48% 271M 0s 2024-09-12T17:39:45.567 INFO:teuthology.orchestra.run.smithi037.stderr: 45000K .......... .......... .......... .......... .......... 48% 308M 0s 2024-09-12T17:39:45.568 INFO:teuthology.orchestra.run.smithi037.stderr: 45050K .......... .......... .......... .......... .......... 48% 318M 0s 2024-09-12T17:39:45.568 INFO:teuthology.orchestra.run.smithi037.stderr: 45100K .......... .......... .......... .......... .......... 48% 264M 0s 2024-09-12T17:39:45.568 INFO:teuthology.orchestra.run.smithi037.stderr: 45150K .......... .......... .......... .......... .......... 48% 236M 0s 2024-09-12T17:39:45.568 INFO:teuthology.orchestra.run.smithi037.stderr: 45200K .......... .......... .......... .......... .......... 48% 257M 0s 2024-09-12T17:39:45.568 INFO:teuthology.orchestra.run.smithi037.stderr: 45250K .......... .......... .......... .......... .......... 48% 303M 0s 2024-09-12T17:39:45.568 INFO:teuthology.orchestra.run.smithi037.stderr: 45300K .......... .......... .......... .......... .......... 48% 313M 0s 2024-09-12T17:39:45.568 INFO:teuthology.orchestra.run.smithi037.stderr: 45350K .......... .......... .......... .......... .......... 48% 286M 0s 2024-09-12T17:39:45.568 INFO:teuthology.orchestra.run.smithi037.stderr: 45400K .......... .......... .......... .......... .......... 48% 369M 0s 2024-09-12T17:39:45.568 INFO:teuthology.orchestra.run.smithi037.stderr: 45450K .......... .......... .......... .......... .......... 48% 283M 0s 2024-09-12T17:39:45.568 INFO:teuthology.orchestra.run.smithi037.stderr: 45500K .......... .......... .......... .......... .......... 49% 275M 0s 2024-09-12T17:39:45.568 INFO:teuthology.orchestra.run.smithi037.stderr: 45550K .......... .......... .......... .......... .......... 49% 254M 0s 2024-09-12T17:39:45.568 INFO:teuthology.orchestra.run.smithi037.stderr: 45600K .......... .......... .......... .......... .......... 49% 280M 0s 2024-09-12T17:39:45.568 INFO:teuthology.orchestra.run.smithi037.stderr: 45650K .......... .......... .......... .......... .......... 49% 303M 0s 2024-09-12T17:39:45.568 INFO:teuthology.orchestra.run.smithi037.stderr: 45700K .......... .......... .......... .......... .......... 49% 300M 0s 2024-09-12T17:39:45.569 INFO:teuthology.orchestra.run.smithi037.stderr: 45750K .......... .......... .......... .......... .......... 49% 265M 0s 2024-09-12T17:39:45.569 INFO:teuthology.orchestra.run.smithi037.stderr: 45800K .......... .......... .......... .......... .......... 49% 324M 0s 2024-09-12T17:39:45.569 INFO:teuthology.orchestra.run.smithi037.stderr: 45850K .......... .......... .......... .......... .......... 49% 56.4M 0s 2024-09-12T17:39:45.569 INFO:teuthology.orchestra.run.smithi037.stderr: 45900K .......... .......... .......... .......... .......... 49% 293M 0s 2024-09-12T17:39:45.569 INFO:teuthology.orchestra.run.smithi037.stderr: 45950K .......... .......... .......... .......... .......... 49% 250M 0s 2024-09-12T17:39:45.569 INFO:teuthology.orchestra.run.smithi037.stderr: 46000K .......... .......... .......... .......... .......... 49% 291M 0s 2024-09-12T17:39:45.569 INFO:teuthology.orchestra.run.smithi037.stderr: 46050K .......... .......... .......... .......... .......... 49% 297M 0s 2024-09-12T17:39:45.569 INFO:teuthology.orchestra.run.smithi037.stderr: 46100K .......... .......... .......... .......... .......... 49% 282M 0s 2024-09-12T17:39:45.569 INFO:teuthology.orchestra.run.smithi037.stderr: 46150K .......... .......... .......... .......... .......... 49% 253M 0s 2024-09-12T17:39:45.569 INFO:teuthology.orchestra.run.smithi037.stderr: 46200K .......... .......... .......... .......... .......... 49% 312M 0s 2024-09-12T17:39:45.569 INFO:teuthology.orchestra.run.smithi037.stderr: 46250K .......... .......... .......... .......... .......... 49% 289M 0s 2024-09-12T17:39:45.569 INFO:teuthology.orchestra.run.smithi037.stderr: 46300K .......... .......... .......... .......... .......... 49% 311M 0s 2024-09-12T17:39:45.569 INFO:teuthology.orchestra.run.smithi037.stderr: 46350K .......... .......... .......... .......... .......... 49% 244M 0s 2024-09-12T17:39:45.569 INFO:teuthology.orchestra.run.smithi037.stderr: 46400K .......... .......... .......... .......... .......... 49% 285M 0s 2024-09-12T17:39:45.570 INFO:teuthology.orchestra.run.smithi037.stderr: 46450K .......... .......... .......... .......... .......... 50% 298M 0s 2024-09-12T17:39:45.570 INFO:teuthology.orchestra.run.smithi037.stderr: 46500K .......... .......... .......... .......... .......... 50% 329M 0s 2024-09-12T17:39:45.570 INFO:teuthology.orchestra.run.smithi037.stderr: 46550K .......... .......... .......... .......... .......... 50% 248M 0s 2024-09-12T17:39:45.570 INFO:teuthology.orchestra.run.smithi037.stderr: 46600K .......... .......... .......... .......... .......... 50% 310M 0s 2024-09-12T17:39:45.570 INFO:teuthology.orchestra.run.smithi037.stderr: 46650K .......... .......... .......... .......... .......... 50% 320M 0s 2024-09-12T17:39:45.570 INFO:teuthology.orchestra.run.smithi037.stderr: 46700K .......... .......... .......... .......... .......... 50% 299M 0s 2024-09-12T17:39:45.570 INFO:teuthology.orchestra.run.smithi037.stderr: 46750K .......... .......... .......... .......... .......... 50% 254M 0s 2024-09-12T17:39:45.570 INFO:teuthology.orchestra.run.smithi037.stderr: 46800K .......... .......... .......... .......... .......... 50% 284M 0s 2024-09-12T17:39:45.570 INFO:teuthology.orchestra.run.smithi037.stderr: 46850K .......... .......... .......... .......... .......... 50% 79.3M 0s 2024-09-12T17:39:45.570 INFO:teuthology.orchestra.run.smithi037.stderr: 46900K .......... .......... .......... .......... .......... 50% 304M 0s 2024-09-12T17:39:45.570 INFO:teuthology.orchestra.run.smithi037.stderr: 46950K .......... .......... .......... .......... .......... 50% 297M 0s 2024-09-12T17:39:45.570 INFO:teuthology.orchestra.run.smithi037.stderr: 47000K .......... .......... .......... .......... .......... 50% 214M 0s 2024-09-12T17:39:45.570 INFO:teuthology.orchestra.run.smithi037.stderr: 47050K .......... .......... .......... .......... .......... 50% 315M 0s 2024-09-12T17:39:45.570 INFO:teuthology.orchestra.run.smithi037.stderr: 47100K .......... .......... .......... .......... .......... 50% 304M 0s 2024-09-12T17:39:45.571 INFO:teuthology.orchestra.run.smithi037.stderr: 47150K .......... .......... .......... .......... .......... 50% 244M 0s 2024-09-12T17:39:45.571 INFO:teuthology.orchestra.run.smithi037.stderr: 47200K .......... .......... .......... .......... .......... 50% 317M 0s 2024-09-12T17:39:45.571 INFO:teuthology.orchestra.run.smithi037.stderr: 47250K .......... .......... .......... .......... .......... 50% 320M 0s 2024-09-12T17:39:45.571 INFO:teuthology.orchestra.run.smithi037.stderr: 47300K .......... .......... .......... .......... .......... 50% 323M 0s 2024-09-12T17:39:45.571 INFO:teuthology.orchestra.run.smithi037.stderr: 47350K .......... .......... .......... .......... .......... 51% 281M 0s 2024-09-12T17:39:45.571 INFO:teuthology.orchestra.run.smithi037.stderr: 47400K .......... .......... .......... .......... .......... 51% 313M 0s 2024-09-12T17:39:45.571 INFO:teuthology.orchestra.run.smithi037.stderr: 47450K .......... .......... .......... .......... .......... 51% 297M 0s 2024-09-12T17:39:45.571 INFO:teuthology.orchestra.run.smithi037.stderr: 47500K .......... .......... .......... .......... .......... 51% 320M 0s 2024-09-12T17:39:45.571 INFO:teuthology.orchestra.run.smithi037.stderr: 47550K .......... .......... .......... .......... .......... 51% 139M 0s 2024-09-12T17:39:45.571 INFO:teuthology.orchestra.run.smithi037.stderr: 47600K .......... .......... .......... .......... .......... 51% 296M 0s 2024-09-12T17:39:45.571 INFO:teuthology.orchestra.run.smithi037.stderr: 47650K .......... .......... .......... .......... .......... 51% 374M 0s 2024-09-12T17:39:45.571 INFO:teuthology.orchestra.run.smithi037.stderr: 47700K .......... .......... .......... .......... .......... 51% 231M 0s 2024-09-12T17:39:45.571 INFO:teuthology.orchestra.run.smithi037.stderr: 47750K .......... .......... .......... .......... .......... 51% 183M 0s 2024-09-12T17:39:45.571 INFO:teuthology.orchestra.run.smithi037.stderr: 47800K .......... .......... .......... .......... .......... 51% 309M 0s 2024-09-12T17:39:45.571 INFO:teuthology.orchestra.run.smithi037.stderr: 47850K .......... .......... .......... .......... .......... 51% 306M 0s 2024-09-12T17:39:45.572 INFO:teuthology.orchestra.run.smithi037.stderr: 47900K .......... .......... .......... .......... .......... 51% 301M 0s 2024-09-12T17:39:45.572 INFO:teuthology.orchestra.run.smithi037.stderr: 47950K .......... .......... .......... .......... .......... 51% 265M 0s 2024-09-12T17:39:45.572 INFO:teuthology.orchestra.run.smithi037.stderr: 48000K .......... .......... .......... .......... .......... 51% 115M 0s 2024-09-12T17:39:45.572 INFO:teuthology.orchestra.run.smithi037.stderr: 48050K .......... .......... .......... .......... .......... 51% 324M 0s 2024-09-12T17:39:45.572 INFO:teuthology.orchestra.run.smithi037.stderr: 48100K .......... .......... .......... .......... .......... 51% 342M 0s 2024-09-12T17:39:45.572 INFO:teuthology.orchestra.run.smithi037.stderr: 48150K .......... .......... .......... .......... .......... 51% 266M 0s 2024-09-12T17:39:45.572 INFO:teuthology.orchestra.run.smithi037.stderr: 48200K .......... .......... .......... .......... .......... 51% 288M 0s 2024-09-12T17:39:45.572 INFO:teuthology.orchestra.run.smithi037.stderr: 48250K .......... .......... .......... .......... .......... 51% 359M 0s 2024-09-12T17:39:45.572 INFO:teuthology.orchestra.run.smithi037.stderr: 48300K .......... .......... .......... .......... .......... 52% 316M 0s 2024-09-12T17:39:45.572 INFO:teuthology.orchestra.run.smithi037.stderr: 48350K .......... .......... .......... .......... .......... 52% 227M 0s 2024-09-12T17:39:45.572 INFO:teuthology.orchestra.run.smithi037.stderr: 48400K .......... .......... .......... .......... .......... 52% 303M 0s 2024-09-12T17:39:45.572 INFO:teuthology.orchestra.run.smithi037.stderr: 48450K .......... .......... .......... .......... .......... 52% 304M 0s 2024-09-12T17:39:45.572 INFO:teuthology.orchestra.run.smithi037.stderr: 48500K .......... .......... .......... .......... .......... 52% 280M 0s 2024-09-12T17:39:45.573 INFO:teuthology.orchestra.run.smithi037.stderr: 48550K .......... .......... .......... .......... .......... 52% 262M 0s 2024-09-12T17:39:45.573 INFO:teuthology.orchestra.run.smithi037.stderr: 48600K .......... .......... .......... .......... .......... 52% 252M 0s 2024-09-12T17:39:45.573 INFO:teuthology.orchestra.run.smithi037.stderr: 48650K .......... .......... .......... .......... .......... 52% 344M 0s 2024-09-12T17:39:45.573 INFO:teuthology.orchestra.run.smithi037.stderr: 48700K .......... .......... .......... .......... .......... 52% 307M 0s 2024-09-12T17:39:45.573 INFO:teuthology.orchestra.run.smithi037.stderr: 48750K .......... .......... .......... .......... .......... 52% 57.1M 0s 2024-09-12T17:39:45.573 INFO:teuthology.orchestra.run.smithi037.stderr: 48800K .......... .......... .......... .......... .......... 52% 297M 0s 2024-09-12T17:39:45.573 INFO:teuthology.orchestra.run.smithi037.stderr: 48850K .......... .......... .......... .......... .......... 52% 354M 0s 2024-09-12T17:39:45.573 INFO:teuthology.orchestra.run.smithi037.stderr: 48900K .......... .......... .......... .......... .......... 52% 281M 0s 2024-09-12T17:39:45.573 INFO:teuthology.orchestra.run.smithi037.stderr: 48950K .......... .......... .......... .......... .......... 52% 257M 0s 2024-09-12T17:39:45.573 INFO:teuthology.orchestra.run.smithi037.stderr: 49000K .......... .......... .......... .......... .......... 52% 296M 0s 2024-09-12T17:39:45.573 INFO:teuthology.orchestra.run.smithi037.stderr: 49050K .......... .......... .......... .......... .......... 52% 316M 0s 2024-09-12T17:39:45.573 INFO:teuthology.orchestra.run.smithi037.stderr: 49100K .......... .......... .......... .......... .......... 52% 306M 0s 2024-09-12T17:39:45.573 INFO:teuthology.orchestra.run.smithi037.stderr: 49150K .......... .......... .......... .......... .......... 52% 259M 0s 2024-09-12T17:39:45.573 INFO:teuthology.orchestra.run.smithi037.stderr: 49200K .......... .......... .......... .......... .......... 53% 247M 0s 2024-09-12T17:39:45.574 INFO:teuthology.orchestra.run.smithi037.stderr: 49250K .......... .......... .......... .......... .......... 53% 292M 0s 2024-09-12T17:39:45.574 INFO:teuthology.orchestra.run.smithi037.stderr: 49300K .......... .......... .......... .......... .......... 53% 281M 0s 2024-09-12T17:39:45.574 INFO:teuthology.orchestra.run.smithi037.stderr: 49350K .......... .......... .......... .......... .......... 53% 268M 0s 2024-09-12T17:39:45.574 INFO:teuthology.orchestra.run.smithi037.stderr: 49400K .......... .......... .......... .......... .......... 53% 296M 0s 2024-09-12T17:39:45.574 INFO:teuthology.orchestra.run.smithi037.stderr: 49450K .......... .......... .......... .......... .......... 53% 286M 0s 2024-09-12T17:39:45.574 INFO:teuthology.orchestra.run.smithi037.stderr: 49500K .......... .......... .......... .......... .......... 53% 284M 0s 2024-09-12T17:39:45.574 INFO:teuthology.orchestra.run.smithi037.stderr: 49550K .......... .......... .......... .......... .......... 53% 263M 0s 2024-09-12T17:39:45.574 INFO:teuthology.orchestra.run.smithi037.stderr: 49600K .......... .......... .......... .......... .......... 53% 303M 0s 2024-09-12T17:39:45.574 INFO:teuthology.orchestra.run.smithi037.stderr: 49650K .......... .......... .......... .......... .......... 53% 293M 0s 2024-09-12T17:39:45.574 INFO:teuthology.orchestra.run.smithi037.stderr: 49700K .......... .......... .......... .......... .......... 53% 321M 0s 2024-09-12T17:39:45.574 INFO:teuthology.orchestra.run.smithi037.stderr: 49750K .......... .......... .......... .......... .......... 53% 262M 0s 2024-09-12T17:39:45.574 INFO:teuthology.orchestra.run.smithi037.stderr: 49800K .......... .......... .......... .......... .......... 53% 261M 0s 2024-09-12T17:39:45.574 INFO:teuthology.orchestra.run.smithi037.stderr: 49850K .......... .......... .......... .......... .......... 53% 313M 0s 2024-09-12T17:39:45.574 INFO:teuthology.orchestra.run.smithi037.stderr: 49900K .......... .......... .......... .......... .......... 53% 231M 0s 2024-09-12T17:39:45.574 INFO:teuthology.orchestra.run.smithi037.stderr: 49950K .......... .......... .......... .......... .......... 53% 168M 0s 2024-09-12T17:39:45.575 INFO:teuthology.orchestra.run.smithi037.stderr: 50000K .......... .......... .......... .......... .......... 53% 307M 0s 2024-09-12T17:39:45.575 INFO:teuthology.orchestra.run.smithi037.stderr: 50050K .......... .......... .......... .......... .......... 53% 267M 0s 2024-09-12T17:39:45.575 INFO:teuthology.orchestra.run.smithi037.stderr: 50100K .......... .......... .......... .......... .......... 53% 165M 0s 2024-09-12T17:39:45.575 INFO:teuthology.orchestra.run.smithi037.stderr: 50150K .......... .......... .......... .......... .......... 54% 284M 0s 2024-09-12T17:39:45.575 INFO:teuthology.orchestra.run.smithi037.stderr: 50200K .......... .......... .......... .......... .......... 54% 304M 0s 2024-09-12T17:39:45.575 INFO:teuthology.orchestra.run.smithi037.stderr: 50250K .......... .......... .......... .......... .......... 54% 301M 0s 2024-09-12T17:39:45.575 INFO:teuthology.orchestra.run.smithi037.stderr: 50300K .......... .......... .......... .......... .......... 54% 286M 0s 2024-09-12T17:39:45.575 INFO:teuthology.orchestra.run.smithi037.stderr: 50350K .......... .......... .......... .......... .......... 54% 278M 0s 2024-09-12T17:39:45.575 INFO:teuthology.orchestra.run.smithi037.stderr: 50400K .......... .......... .......... .......... .......... 54% 317M 0s 2024-09-12T17:39:45.575 INFO:teuthology.orchestra.run.smithi037.stderr: 50450K .......... .......... .......... .......... .......... 54% 304M 0s 2024-09-12T17:39:45.575 INFO:teuthology.orchestra.run.smithi037.stderr: 50500K .......... .......... .......... .......... .......... 54% 80.7M 0s 2024-09-12T17:39:45.575 INFO:teuthology.orchestra.run.smithi037.stderr: 50550K .......... .......... .......... .......... .......... 54% 261M 0s 2024-09-12T17:39:45.575 INFO:teuthology.orchestra.run.smithi037.stderr: 50600K .......... .......... .......... .......... .......... 54% 286M 0s 2024-09-12T17:39:45.575 INFO:teuthology.orchestra.run.smithi037.stderr: 50650K .......... .......... .......... .......... .......... 54% 284M 0s 2024-09-12T17:39:45.576 INFO:teuthology.orchestra.run.smithi037.stderr: 50700K .......... .......... .......... .......... .......... 54% 273M 0s 2024-09-12T17:39:45.576 INFO:teuthology.orchestra.run.smithi037.stderr: 50750K .......... .......... .......... .......... .......... 54% 241M 0s 2024-09-12T17:39:45.576 INFO:teuthology.orchestra.run.smithi037.stderr: 50800K .......... .......... .......... .......... .......... 54% 337M 0s 2024-09-12T17:39:45.576 INFO:teuthology.orchestra.run.smithi037.stderr: 50850K .......... .......... .......... .......... .......... 54% 316M 0s 2024-09-12T17:39:45.576 INFO:teuthology.orchestra.run.smithi037.stderr: 50900K .......... .......... .......... .......... .......... 54% 296M 0s 2024-09-12T17:39:45.576 INFO:teuthology.orchestra.run.smithi037.stderr: 50950K .......... .......... .......... .......... .......... 54% 272M 0s 2024-09-12T17:39:45.576 INFO:teuthology.orchestra.run.smithi037.stderr: 51000K .......... .......... .......... .......... .......... 54% 248M 0s 2024-09-12T17:39:45.576 INFO:teuthology.orchestra.run.smithi037.stderr: 51050K .......... .......... .......... .......... .......... 55% 185M 0s 2024-09-12T17:39:45.576 INFO:teuthology.orchestra.run.smithi037.stderr: 51100K .......... .......... .......... .......... .......... 55% 303M 0s 2024-09-12T17:39:45.576 INFO:teuthology.orchestra.run.smithi037.stderr: 51150K .......... .......... .......... .......... .......... 55% 280M 0s 2024-09-12T17:39:45.576 INFO:teuthology.orchestra.run.smithi037.stderr: 51200K .......... .......... .......... .......... .......... 55% 331M 0s 2024-09-12T17:39:45.576 INFO:teuthology.orchestra.run.smithi037.stderr: 51250K .......... .......... .......... .......... .......... 55% 307M 0s 2024-09-12T17:39:45.576 INFO:teuthology.orchestra.run.smithi037.stderr: 51300K .......... .......... .......... .......... .......... 55% 250M 0s 2024-09-12T17:39:45.576 INFO:teuthology.orchestra.run.smithi037.stderr: 51350K .......... .......... .......... .......... .......... 55% 296M 0s 2024-09-12T17:39:45.577 INFO:teuthology.orchestra.run.smithi037.stderr: 51400K .......... .......... .......... .......... .......... 55% 147M 0s 2024-09-12T17:39:45.577 INFO:teuthology.orchestra.run.smithi037.stderr: 51450K .......... .......... .......... .......... .......... 55% 87.6M 0s 2024-09-12T17:39:45.577 INFO:teuthology.orchestra.run.smithi037.stderr: 51500K .......... .......... .......... .......... .......... 55% 251M 0s 2024-09-12T17:39:45.577 INFO:teuthology.orchestra.run.smithi037.stderr: 51550K .......... .......... .......... .......... .......... 55% 297M 0s 2024-09-12T17:39:45.577 INFO:teuthology.orchestra.run.smithi037.stderr: 51600K .......... .......... .......... .......... .......... 55% 304M 0s 2024-09-12T17:39:45.577 INFO:teuthology.orchestra.run.smithi037.stderr: 51650K .......... .......... .......... .......... .......... 55% 293M 0s 2024-09-12T17:39:45.577 INFO:teuthology.orchestra.run.smithi037.stderr: 51700K .......... .......... .......... .......... .......... 55% 263M 0s 2024-09-12T17:39:45.577 INFO:teuthology.orchestra.run.smithi037.stderr: 51750K .......... .......... .......... .......... .......... 55% 186M 0s 2024-09-12T17:39:45.577 INFO:teuthology.orchestra.run.smithi037.stderr: 51800K .......... .......... .......... .......... .......... 55% 298M 0s 2024-09-12T17:39:45.577 INFO:teuthology.orchestra.run.smithi037.stderr: 51850K .......... .......... .......... .......... .......... 55% 310M 0s 2024-09-12T17:39:45.577 INFO:teuthology.orchestra.run.smithi037.stderr: 51900K .......... .......... .......... .......... .......... 55% 71.8M 0s 2024-09-12T17:39:45.577 INFO:teuthology.orchestra.run.smithi037.stderr: 51950K .......... .......... .......... .......... .......... 55% 291M 0s 2024-09-12T17:39:45.577 INFO:teuthology.orchestra.run.smithi037.stderr: 52000K .......... .......... .......... .......... .......... 56% 289M 0s 2024-09-12T17:39:45.577 INFO:teuthology.orchestra.run.smithi037.stderr: 52050K .......... .......... .......... .......... .......... 56% 321M 0s 2024-09-12T17:39:45.578 INFO:teuthology.orchestra.run.smithi037.stderr: 52100K .......... .......... .......... .......... .......... 56% 257M 0s 2024-09-12T17:39:45.578 INFO:teuthology.orchestra.run.smithi037.stderr: 52150K .......... .......... .......... .......... .......... 56% 290M 0s 2024-09-12T17:39:45.578 INFO:teuthology.orchestra.run.smithi037.stderr: 52200K .......... .......... .......... .......... .......... 56% 330M 0s 2024-09-12T17:39:45.578 INFO:teuthology.orchestra.run.smithi037.stderr: 52250K .......... .......... .......... .......... .......... 56% 279M 0s 2024-09-12T17:39:45.578 INFO:teuthology.orchestra.run.smithi037.stderr: 52300K .......... .......... .......... .......... .......... 56% 257M 0s 2024-09-12T17:39:45.578 INFO:teuthology.orchestra.run.smithi037.stderr: 52350K .......... .......... .......... .......... .......... 56% 323M 0s 2024-09-12T17:39:45.578 INFO:teuthology.orchestra.run.smithi037.stderr: 52400K .......... .......... .......... .......... .......... 56% 282M 0s 2024-09-12T17:39:45.578 INFO:teuthology.orchestra.run.smithi037.stderr: 52450K .......... .......... .......... .......... .......... 56% 296M 0s 2024-09-12T17:39:45.578 INFO:teuthology.orchestra.run.smithi037.stderr: 52500K .......... .......... .......... .......... .......... 56% 263M 0s 2024-09-12T17:39:45.578 INFO:teuthology.orchestra.run.smithi037.stderr: 52550K .......... .......... .......... .......... .......... 56% 281M 0s 2024-09-12T17:39:45.578 INFO:teuthology.orchestra.run.smithi037.stderr: 52600K .......... .......... .......... .......... .......... 56% 302M 0s 2024-09-12T17:39:45.578 INFO:teuthology.orchestra.run.smithi037.stderr: 52650K .......... .......... .......... .......... .......... 56% 296M 0s 2024-09-12T17:39:45.578 INFO:teuthology.orchestra.run.smithi037.stderr: 52700K .......... .......... .......... .......... .......... 56% 240M 0s 2024-09-12T17:39:45.578 INFO:teuthology.orchestra.run.smithi037.stderr: 52750K .......... .......... .......... .......... .......... 56% 297M 0s 2024-09-12T17:39:45.578 INFO:teuthology.orchestra.run.smithi037.stderr: 52800K .......... .......... .......... .......... .......... 56% 284M 0s 2024-09-12T17:39:45.579 INFO:teuthology.orchestra.run.smithi037.stderr: 52850K .......... .......... .......... .......... .......... 56% 311M 0s 2024-09-12T17:39:45.579 INFO:teuthology.orchestra.run.smithi037.stderr: 52900K .......... .......... .......... .......... .......... 56% 276M 0s 2024-09-12T17:39:45.579 INFO:teuthology.orchestra.run.smithi037.stderr: 52950K .......... .......... .......... .......... .......... 57% 315M 0s 2024-09-12T17:39:45.579 INFO:teuthology.orchestra.run.smithi037.stderr: 53000K .......... .......... .......... .......... .......... 57% 289M 0s 2024-09-12T17:39:45.579 INFO:teuthology.orchestra.run.smithi037.stderr: 53050K .......... .......... .......... .......... .......... 57% 293M 0s 2024-09-12T17:39:45.579 INFO:teuthology.orchestra.run.smithi037.stderr: 53100K .......... .......... .......... .......... .......... 57% 253M 0s 2024-09-12T17:39:45.579 INFO:teuthology.orchestra.run.smithi037.stderr: 53150K .......... .......... .......... .......... .......... 57% 273M 0s 2024-09-12T17:39:45.579 INFO:teuthology.orchestra.run.smithi037.stderr: 53200K .......... .......... .......... .......... .......... 57% 328M 0s 2024-09-12T17:39:45.579 INFO:teuthology.orchestra.run.smithi037.stderr: 53250K .......... .......... .......... .......... .......... 57% 294M 0s 2024-09-12T17:39:45.579 INFO:teuthology.orchestra.run.smithi037.stderr: 53300K .......... .......... .......... .......... .......... 57% 234M 0s 2024-09-12T17:39:45.579 INFO:teuthology.orchestra.run.smithi037.stderr: 53350K .......... .......... .......... .......... .......... 57% 281M 0s 2024-09-12T17:39:45.579 INFO:teuthology.orchestra.run.smithi037.stderr: 53400K .......... .......... .......... .......... .......... 57% 313M 0s 2024-09-12T17:39:45.579 INFO:teuthology.orchestra.run.smithi037.stderr: 53450K .......... .......... .......... .......... .......... 57% 348M 0s 2024-09-12T17:39:45.579 INFO:teuthology.orchestra.run.smithi037.stderr: 53500K .......... .......... .......... .......... .......... 57% 145M 0s 2024-09-12T17:39:45.580 INFO:teuthology.orchestra.run.smithi037.stderr: 53550K .......... .......... .......... .......... .......... 57% 306M 0s 2024-09-12T17:39:45.580 INFO:teuthology.orchestra.run.smithi037.stderr: 53600K .......... .......... .......... .......... .......... 57% 206M 0s 2024-09-12T17:39:45.580 INFO:teuthology.orchestra.run.smithi037.stderr: 53650K .......... .......... .......... .......... .......... 57% 289M 0s 2024-09-12T17:39:45.580 INFO:teuthology.orchestra.run.smithi037.stderr: 53700K .......... .......... .......... .......... .......... 57% 308M 0s 2024-09-12T17:39:45.580 INFO:teuthology.orchestra.run.smithi037.stderr: 53750K .......... .......... .......... .......... .......... 57% 334M 0s 2024-09-12T17:39:45.580 INFO:teuthology.orchestra.run.smithi037.stderr: 53800K .......... .......... .......... .......... .......... 57% 317M 0s 2024-09-12T17:39:45.580 INFO:teuthology.orchestra.run.smithi037.stderr: 53850K .......... .......... .......... .......... .......... 58% 276M 0s 2024-09-12T17:39:45.580 INFO:teuthology.orchestra.run.smithi037.stderr: 53900K .......... .......... .......... .......... .......... 58% 169M 0s 2024-09-12T17:39:45.580 INFO:teuthology.orchestra.run.smithi037.stderr: 53950K .......... .......... .......... .......... .......... 58% 296M 0s 2024-09-12T17:39:45.580 INFO:teuthology.orchestra.run.smithi037.stderr: 54000K .......... .......... .......... .......... .......... 58% 325M 0s 2024-09-12T17:39:45.580 INFO:teuthology.orchestra.run.smithi037.stderr: 54050K .......... .......... .......... .......... .......... 58% 311M 0s 2024-09-12T17:39:45.580 INFO:teuthology.orchestra.run.smithi037.stderr: 54100K .......... .......... .......... .......... .......... 58% 244M 0s 2024-09-12T17:39:45.580 INFO:teuthology.orchestra.run.smithi037.stderr: 54150K .......... .......... .......... .......... .......... 58% 311M 0s 2024-09-12T17:39:45.581 INFO:teuthology.orchestra.run.smithi037.stderr: 54200K .......... .......... .......... .......... .......... 58% 287M 0s 2024-09-12T17:39:45.581 INFO:teuthology.orchestra.run.smithi037.stderr: 54250K .......... .......... .......... .......... .......... 58% 296M 0s 2024-09-12T17:39:45.581 INFO:teuthology.orchestra.run.smithi037.stderr: 54300K .......... .......... .......... .......... .......... 58% 265M 0s 2024-09-12T17:39:45.581 INFO:teuthology.orchestra.run.smithi037.stderr: 54350K .......... .......... .......... .......... .......... 58% 75.1M 0s 2024-09-12T17:39:45.581 INFO:teuthology.orchestra.run.smithi037.stderr: 54400K .......... .......... .......... .......... .......... 58% 286M 0s 2024-09-12T17:39:45.581 INFO:teuthology.orchestra.run.smithi037.stderr: 54450K .......... .......... .......... .......... .......... 58% 312M 0s 2024-09-12T17:39:45.581 INFO:teuthology.orchestra.run.smithi037.stderr: 54500K .......... .......... .......... .......... .......... 58% 121M 0s 2024-09-12T17:39:45.581 INFO:teuthology.orchestra.run.smithi037.stderr: 54550K .......... .......... .......... .......... .......... 58% 132M 0s 2024-09-12T17:39:45.581 INFO:teuthology.orchestra.run.smithi037.stderr: 54600K .......... .......... .......... .......... .......... 58% 298M 0s 2024-09-12T17:39:45.581 INFO:teuthology.orchestra.run.smithi037.stderr: 54650K .......... .......... .......... .......... .......... 58% 299M 0s 2024-09-12T17:39:45.581 INFO:teuthology.orchestra.run.smithi037.stderr: 54700K .......... .......... .......... .......... .......... 58% 250M 0s 2024-09-12T17:39:45.581 INFO:teuthology.orchestra.run.smithi037.stderr: 54750K .......... .......... .......... .......... .......... 58% 277M 0s 2024-09-12T17:39:45.581 INFO:teuthology.orchestra.run.smithi037.stderr: 54800K .......... .......... .......... .......... .......... 59% 290M 0s 2024-09-12T17:39:45.581 INFO:teuthology.orchestra.run.smithi037.stderr: 54850K .......... .......... .......... .......... .......... 59% 296M 0s 2024-09-12T17:39:45.582 INFO:teuthology.orchestra.run.smithi037.stderr: 54900K .......... .......... .......... .......... .......... 59% 246M 0s 2024-09-12T17:39:45.582 INFO:teuthology.orchestra.run.smithi037.stderr: 54950K .......... .......... .......... .......... .......... 59% 315M 0s 2024-09-12T17:39:45.582 INFO:teuthology.orchestra.run.smithi037.stderr: 55000K .......... .......... .......... .......... .......... 59% 240M 0s 2024-09-12T17:39:45.582 INFO:teuthology.orchestra.run.smithi037.stderr: 55050K .......... .......... .......... .......... .......... 59% 98.3M 0s 2024-09-12T17:39:45.582 INFO:teuthology.orchestra.run.smithi037.stderr: 55100K .......... .......... .......... .......... .......... 59% 234M 0s 2024-09-12T17:39:45.582 INFO:teuthology.orchestra.run.smithi037.stderr: 55150K .......... .......... .......... .......... .......... 59% 305M 0s 2024-09-12T17:39:45.582 INFO:teuthology.orchestra.run.smithi037.stderr: 55200K .......... .......... .......... .......... .......... 59% 290M 0s 2024-09-12T17:39:45.582 INFO:teuthology.orchestra.run.smithi037.stderr: 55250K .......... .......... .......... .......... .......... 59% 266M 0s 2024-09-12T17:39:45.582 INFO:teuthology.orchestra.run.smithi037.stderr: 55300K .......... .......... .......... .......... .......... 59% 270M 0s 2024-09-12T17:39:45.582 INFO:teuthology.orchestra.run.smithi037.stderr: 55350K .......... .......... .......... .......... .......... 59% 314M 0s 2024-09-12T17:39:45.582 INFO:teuthology.orchestra.run.smithi037.stderr: 55400K .......... .......... .......... .......... .......... 59% 305M 0s 2024-09-12T17:39:45.582 INFO:teuthology.orchestra.run.smithi037.stderr: 55450K .......... .......... .......... .......... .......... 59% 305M 0s 2024-09-12T17:39:45.582 INFO:teuthology.orchestra.run.smithi037.stderr: 55500K .......... .......... .......... .......... .......... 59% 238M 0s 2024-09-12T17:39:45.582 INFO:teuthology.orchestra.run.smithi037.stderr: 55550K .......... .......... .......... .......... .......... 59% 324M 0s 2024-09-12T17:39:45.582 INFO:teuthology.orchestra.run.smithi037.stderr: 55600K .......... .......... .......... .......... .......... 59% 306M 0s 2024-09-12T17:39:45.583 INFO:teuthology.orchestra.run.smithi037.stderr: 55650K .......... .......... .......... .......... .......... 59% 299M 0s 2024-09-12T17:39:45.583 INFO:teuthology.orchestra.run.smithi037.stderr: 55700K .......... .......... .......... .......... .......... 60% 284M 0s 2024-09-12T17:39:45.583 INFO:teuthology.orchestra.run.smithi037.stderr: 55750K .......... .......... .......... .......... .......... 60% 317M 0s 2024-09-12T17:39:45.583 INFO:teuthology.orchestra.run.smithi037.stderr: 55800K .......... .......... .......... .......... .......... 60% 276M 0s 2024-09-12T17:39:45.583 INFO:teuthology.orchestra.run.smithi037.stderr: 55850K .......... .......... .......... .......... .......... 60% 314M 0s 2024-09-12T17:39:45.583 INFO:teuthology.orchestra.run.smithi037.stderr: 55900K .......... .......... .......... .......... .......... 60% 258M 0s 2024-09-12T17:39:45.583 INFO:teuthology.orchestra.run.smithi037.stderr: 55950K .......... .......... .......... .......... .......... 60% 302M 0s 2024-09-12T17:39:45.583 INFO:teuthology.orchestra.run.smithi037.stderr: 56000K .......... .......... .......... .......... .......... 60% 267M 0s 2024-09-12T17:39:45.583 INFO:teuthology.orchestra.run.smithi037.stderr: 56050K .......... .......... .......... .......... .......... 60% 312M 0s 2024-09-12T17:39:45.583 INFO:teuthology.orchestra.run.smithi037.stderr: 56100K .......... .......... .......... .......... .......... 60% 270M 0s 2024-09-12T17:39:45.583 INFO:teuthology.orchestra.run.smithi037.stderr: 56150K .......... .......... .......... .......... .......... 60% 289M 0s 2024-09-12T17:39:45.583 INFO:teuthology.orchestra.run.smithi037.stderr: 56200K .......... .......... .......... .......... .......... 60% 236M 0s 2024-09-12T17:39:45.583 INFO:teuthology.orchestra.run.smithi037.stderr: 56250K .......... .......... .......... .......... .......... 60% 297M 0s 2024-09-12T17:39:45.583 INFO:teuthology.orchestra.run.smithi037.stderr: 56300K .......... .......... .......... .......... .......... 60% 298M 0s 2024-09-12T17:39:45.583 INFO:teuthology.orchestra.run.smithi037.stderr: 56350K .......... .......... .......... .......... .......... 60% 332M 0s 2024-09-12T17:39:45.584 INFO:teuthology.orchestra.run.smithi037.stderr: 56400K .......... .......... .......... .......... .......... 60% 264M 0s 2024-09-12T17:39:45.584 INFO:teuthology.orchestra.run.smithi037.stderr: 56450K .......... .......... .......... .......... .......... 60% 287M 0s 2024-09-12T17:39:45.584 INFO:teuthology.orchestra.run.smithi037.stderr: 56500K .......... .......... .......... .......... .......... 60% 307M 0s 2024-09-12T17:39:45.584 INFO:teuthology.orchestra.run.smithi037.stderr: 56550K .......... .......... .......... .......... .......... 60% 287M 0s 2024-09-12T17:39:45.584 INFO:teuthology.orchestra.run.smithi037.stderr: 56600K .......... .......... .......... .......... .......... 60% 262M 0s 2024-09-12T17:39:45.584 INFO:teuthology.orchestra.run.smithi037.stderr: 56650K .......... .......... .......... .......... .......... 61% 108M 0s 2024-09-12T17:39:45.584 INFO:teuthology.orchestra.run.smithi037.stderr: 56700K .......... .......... .......... .......... .......... 61% 276M 0s 2024-09-12T17:39:45.584 INFO:teuthology.orchestra.run.smithi037.stderr: 56750K .......... .......... .......... .......... .......... 61% 332M 0s 2024-09-12T17:39:45.584 INFO:teuthology.orchestra.run.smithi037.stderr: 56800K .......... .......... .......... .......... .......... 61% 263M 0s 2024-09-12T17:39:45.584 INFO:teuthology.orchestra.run.smithi037.stderr: 56850K .......... .......... .......... .......... .......... 61% 316M 0s 2024-09-12T17:39:45.584 INFO:teuthology.orchestra.run.smithi037.stderr: 56900K .......... .......... .......... .......... .......... 61% 275M 0s 2024-09-12T17:39:45.584 INFO:teuthology.orchestra.run.smithi037.stderr: 56950K .......... .......... .......... .......... .......... 61% 325M 0s 2024-09-12T17:39:45.584 INFO:teuthology.orchestra.run.smithi037.stderr: 57000K .......... .......... .......... .......... .......... 61% 253M 0s 2024-09-12T17:39:45.584 INFO:teuthology.orchestra.run.smithi037.stderr: 57050K .......... .......... .......... .......... .......... 61% 319M 0s 2024-09-12T17:39:45.585 INFO:teuthology.orchestra.run.smithi037.stderr: 57100K .......... .......... .......... .......... .......... 61% 282M 0s 2024-09-12T17:39:45.585 INFO:teuthology.orchestra.run.smithi037.stderr: 57150K .......... .......... .......... .......... .......... 61% 302M 0s 2024-09-12T17:39:45.585 INFO:teuthology.orchestra.run.smithi037.stderr: 57200K .......... .......... .......... .......... .......... 61% 281M 0s 2024-09-12T17:39:45.585 INFO:teuthology.orchestra.run.smithi037.stderr: 57250K .......... .......... .......... .......... .......... 61% 252M 0s 2024-09-12T17:39:45.585 INFO:teuthology.orchestra.run.smithi037.stderr: 57300K .......... .......... .......... .......... .......... 61% 273M 0s 2024-09-12T17:39:45.585 INFO:teuthology.orchestra.run.smithi037.stderr: 57350K .......... .......... .......... .......... .......... 61% 113M 0s 2024-09-12T17:39:45.585 INFO:teuthology.orchestra.run.smithi037.stderr: 57400K .......... .......... .......... .......... .......... 61% 291M 0s 2024-09-12T17:39:45.585 INFO:teuthology.orchestra.run.smithi037.stderr: 57450K .......... .......... .......... .......... .......... 61% 254M 0s 2024-09-12T17:39:45.585 INFO:teuthology.orchestra.run.smithi037.stderr: 57500K .......... .......... .......... .......... .......... 61% 262M 0s 2024-09-12T17:39:45.585 INFO:teuthology.orchestra.run.smithi037.stderr: 57550K .......... .......... .......... .......... .......... 62% 305M 0s 2024-09-12T17:39:45.585 INFO:teuthology.orchestra.run.smithi037.stderr: 57600K .......... .......... .......... .......... .......... 62% 107M 0s 2024-09-12T17:39:45.585 INFO:teuthology.orchestra.run.smithi037.stderr: 57650K .......... .......... .......... .......... .......... 62% 152M 0s 2024-09-12T17:39:45.585 INFO:teuthology.orchestra.run.smithi037.stderr: 57700K .......... .......... .......... .......... .......... 62% 245M 0s 2024-09-12T17:39:45.585 INFO:teuthology.orchestra.run.smithi037.stderr: 57750K .......... .......... .......... .......... .......... 62% 310M 0s 2024-09-12T17:39:45.586 INFO:teuthology.orchestra.run.smithi037.stderr: 57800K .......... .......... .......... .......... .......... 62% 79.9M 0s 2024-09-12T17:39:45.586 INFO:teuthology.orchestra.run.smithi037.stderr: 57850K .......... .......... .......... .......... .......... 62% 251M 0s 2024-09-12T17:39:45.586 INFO:teuthology.orchestra.run.smithi037.stderr: 57900K .......... .......... .......... .......... .......... 62% 305M 0s 2024-09-12T17:39:45.586 INFO:teuthology.orchestra.run.smithi037.stderr: 57950K .......... .......... .......... .......... .......... 62% 302M 0s 2024-09-12T17:39:45.586 INFO:teuthology.orchestra.run.smithi037.stderr: 58000K .......... .......... .......... .......... .......... 62% 248M 0s 2024-09-12T17:39:45.586 INFO:teuthology.orchestra.run.smithi037.stderr: 58050K .......... .......... .......... .......... .......... 62% 303M 0s 2024-09-12T17:39:45.586 INFO:teuthology.orchestra.run.smithi037.stderr: 58100K .......... .......... .......... .......... .......... 62% 295M 0s 2024-09-12T17:39:45.586 INFO:teuthology.orchestra.run.smithi037.stderr: 58150K .......... .......... .......... .......... .......... 62% 318M 0s 2024-09-12T17:39:45.586 INFO:teuthology.orchestra.run.smithi037.stderr: 58200K .......... .......... .......... .......... .......... 62% 127M 0s 2024-09-12T17:39:45.586 INFO:teuthology.orchestra.run.smithi037.stderr: 58250K .......... .......... .......... .......... .......... 62% 307M 0s 2024-09-12T17:39:45.586 INFO:teuthology.orchestra.run.smithi037.stderr: 58300K .......... .......... .......... .......... .......... 62% 311M 0s 2024-09-12T17:39:45.586 INFO:teuthology.orchestra.run.smithi037.stderr: 58350K .......... .......... .......... .......... .......... 62% 286M 0s 2024-09-12T17:39:45.586 INFO:teuthology.orchestra.run.smithi037.stderr: 58400K .......... .......... .......... .......... .......... 62% 271M 0s 2024-09-12T17:39:45.586 INFO:teuthology.orchestra.run.smithi037.stderr: 58450K .......... .......... .......... .......... .......... 62% 316M 0s 2024-09-12T17:39:45.586 INFO:teuthology.orchestra.run.smithi037.stderr: 58500K .......... .......... .......... .......... .......... 63% 296M 0s 2024-09-12T17:39:45.587 INFO:teuthology.orchestra.run.smithi037.stderr: 58550K .......... .......... .......... .......... .......... 63% 257M 0s 2024-09-12T17:39:45.587 INFO:teuthology.orchestra.run.smithi037.stderr: 58600K .......... .......... .......... .......... .......... 63% 322M 0s 2024-09-12T17:39:45.587 INFO:teuthology.orchestra.run.smithi037.stderr: 58650K .......... .......... .......... .......... .......... 63% 311M 0s 2024-09-12T17:39:45.587 INFO:teuthology.orchestra.run.smithi037.stderr: 58700K .......... .......... .......... .......... .......... 63% 247M 0s 2024-09-12T17:39:45.587 INFO:teuthology.orchestra.run.smithi037.stderr: 58750K .......... .......... .......... .......... .......... 63% 296M 0s 2024-09-12T17:39:45.587 INFO:teuthology.orchestra.run.smithi037.stderr: 58800K .......... .......... .......... .......... .......... 63% 263M 0s 2024-09-12T17:39:45.587 INFO:teuthology.orchestra.run.smithi037.stderr: 58850K .......... .......... .......... .......... .......... 63% 306M 0s 2024-09-12T17:39:45.587 INFO:teuthology.orchestra.run.smithi037.stderr: 58900K .......... .......... .......... .......... .......... 63% 266M 0s 2024-09-12T17:39:45.587 INFO:teuthology.orchestra.run.smithi037.stderr: 58950K .......... .......... .......... .......... .......... 63% 299M 0s 2024-09-12T17:39:45.587 INFO:teuthology.orchestra.run.smithi037.stderr: 59000K .......... .......... .......... .......... .......... 63% 301M 0s 2024-09-12T17:39:45.587 INFO:teuthology.orchestra.run.smithi037.stderr: 59050K .......... .......... .......... .......... .......... 63% 319M 0s 2024-09-12T17:39:45.587 INFO:teuthology.orchestra.run.smithi037.stderr: 59100K .......... .......... .......... .......... .......... 63% 163M 0s 2024-09-12T17:39:45.587 INFO:teuthology.orchestra.run.smithi037.stderr: 59150K .......... .......... .......... .......... .......... 63% 293M 0s 2024-09-12T17:39:45.587 INFO:teuthology.orchestra.run.smithi037.stderr: 59200K .......... .......... .......... .......... .......... 63% 299M 0s 2024-09-12T17:39:45.587 INFO:teuthology.orchestra.run.smithi037.stderr: 59250K .......... .......... .......... .......... .......... 63% 312M 0s 2024-09-12T17:39:45.588 INFO:teuthology.orchestra.run.smithi037.stderr: 59300K .......... .......... .......... .......... .......... 63% 268M 0s 2024-09-12T17:39:45.588 INFO:teuthology.orchestra.run.smithi037.stderr: 59350K .......... .......... .......... .......... .......... 63% 286M 0s 2024-09-12T17:39:45.588 INFO:teuthology.orchestra.run.smithi037.stderr: 59400K .......... .......... .......... .......... .......... 63% 275M 0s 2024-09-12T17:39:45.588 INFO:teuthology.orchestra.run.smithi037.stderr: 59450K .......... .......... .......... .......... .......... 64% 300M 0s 2024-09-12T17:39:45.588 INFO:teuthology.orchestra.run.smithi037.stderr: 59500K .......... .......... .......... .......... .......... 64% 249M 0s 2024-09-12T17:39:45.588 INFO:teuthology.orchestra.run.smithi037.stderr: 59550K .......... .......... .......... .......... .......... 64% 291M 0s 2024-09-12T17:39:45.588 INFO:teuthology.orchestra.run.smithi037.stderr: 59600K .......... .......... .......... .......... .......... 64% 302M 0s 2024-09-12T17:39:45.588 INFO:teuthology.orchestra.run.smithi037.stderr: 59650K .......... .......... .......... .......... .......... 64% 130M 0s 2024-09-12T17:39:45.588 INFO:teuthology.orchestra.run.smithi037.stderr: 59700K .......... .......... .......... .......... .......... 64% 261M 0s 2024-09-12T17:39:45.588 INFO:teuthology.orchestra.run.smithi037.stderr: 59750K .......... .......... .......... .......... .......... 64% 307M 0s 2024-09-12T17:39:45.588 INFO:teuthology.orchestra.run.smithi037.stderr: 59800K .......... .......... .......... .......... .......... 64% 305M 0s 2024-09-12T17:39:45.588 INFO:teuthology.orchestra.run.smithi037.stderr: 59850K .......... .......... .......... .......... .......... 64% 303M 0s 2024-09-12T17:39:45.588 INFO:teuthology.orchestra.run.smithi037.stderr: 59900K .......... .......... .......... .......... .......... 64% 225M 0s 2024-09-12T17:39:45.589 INFO:teuthology.orchestra.run.smithi037.stderr: 59950K .......... .......... .......... .......... .......... 64% 252M 0s 2024-09-12T17:39:45.589 INFO:teuthology.orchestra.run.smithi037.stderr: 60000K .......... .......... .......... .......... .......... 64% 300M 0s 2024-09-12T17:39:45.589 INFO:teuthology.orchestra.run.smithi037.stderr: 60050K .......... .......... .......... .......... .......... 64% 260M 0s 2024-09-12T17:39:45.589 INFO:teuthology.orchestra.run.smithi037.stderr: 60100K .......... .......... .......... .......... .......... 64% 248M 0s 2024-09-12T17:39:45.589 INFO:teuthology.orchestra.run.smithi037.stderr: 60150K .......... .......... .......... .......... .......... 64% 298M 0s 2024-09-12T17:39:45.589 INFO:teuthology.orchestra.run.smithi037.stderr: 60200K .......... .......... .......... .......... .......... 64% 259M 0s 2024-09-12T17:39:45.589 INFO:teuthology.orchestra.run.smithi037.stderr: 60250K .......... .......... .......... .......... .......... 64% 283M 0s 2024-09-12T17:39:45.589 INFO:teuthology.orchestra.run.smithi037.stderr: 60300K .......... .......... .......... .......... .......... 64% 237M 0s 2024-09-12T17:39:45.589 INFO:teuthology.orchestra.run.smithi037.stderr: 60350K .......... .......... .......... .......... .......... 65% 284M 0s 2024-09-12T17:39:45.589 INFO:teuthology.orchestra.run.smithi037.stderr: 60400K .......... .......... .......... .......... .......... 65% 305M 0s 2024-09-12T17:39:45.589 INFO:teuthology.orchestra.run.smithi037.stderr: 60450K .......... .......... .......... .......... .......... 65% 250M 0s 2024-09-12T17:39:45.589 INFO:teuthology.orchestra.run.smithi037.stderr: 60500K .......... .......... .......... .......... .......... 65% 261M 0s 2024-09-12T17:39:45.589 INFO:teuthology.orchestra.run.smithi037.stderr: 60550K .......... .......... .......... .......... .......... 65% 320M 0s 2024-09-12T17:39:45.589 INFO:teuthology.orchestra.run.smithi037.stderr: 60600K .......... .......... .......... .......... .......... 65% 308M 0s 2024-09-12T17:39:45.589 INFO:teuthology.orchestra.run.smithi037.stderr: 60650K .......... .......... .......... .......... .......... 65% 283M 0s 2024-09-12T17:39:45.590 INFO:teuthology.orchestra.run.smithi037.stderr: 60700K .......... .......... .......... .......... .......... 65% 186M 0s 2024-09-12T17:39:45.590 INFO:teuthology.orchestra.run.smithi037.stderr: 60750K .......... .......... .......... .......... .......... 65% 300M 0s 2024-09-12T17:39:45.590 INFO:teuthology.orchestra.run.smithi037.stderr: 60800K .......... .......... .......... .......... .......... 65% 292M 0s 2024-09-12T17:39:45.590 INFO:teuthology.orchestra.run.smithi037.stderr: 60850K .......... .......... .......... .......... .......... 65% 101M 0s 2024-09-12T17:39:45.590 INFO:teuthology.orchestra.run.smithi037.stderr: 60900K .......... .......... .......... .......... .......... 65% 137M 0s 2024-09-12T17:39:45.590 INFO:teuthology.orchestra.run.smithi037.stderr: 60950K .......... .......... .......... .......... .......... 65% 301M 0s 2024-09-12T17:39:45.590 INFO:teuthology.orchestra.run.smithi037.stderr: 61000K .......... .......... .......... .......... .......... 65% 231M 0s 2024-09-12T17:39:45.590 INFO:teuthology.orchestra.run.smithi037.stderr: 61050K .......... .......... .......... .......... .......... 65% 340M 0s 2024-09-12T17:39:45.590 INFO:teuthology.orchestra.run.smithi037.stderr: 61100K .......... .......... .......... .......... .......... 65% 59.5M 0s 2024-09-12T17:39:45.590 INFO:teuthology.orchestra.run.smithi037.stderr: 61150K .......... .......... .......... .......... .......... 65% 321M 0s 2024-09-12T17:39:45.590 INFO:teuthology.orchestra.run.smithi037.stderr: 61200K .......... .......... .......... .......... .......... 65% 354M 0s 2024-09-12T17:39:45.590 INFO:teuthology.orchestra.run.smithi037.stderr: 61250K .......... .......... .......... .......... .......... 65% 289M 0s 2024-09-12T17:39:45.590 INFO:teuthology.orchestra.run.smithi037.stderr: 61300K .......... .......... .......... .......... .......... 66% 281M 0s 2024-09-12T17:39:45.590 INFO:teuthology.orchestra.run.smithi037.stderr: 61350K .......... .......... .......... .......... .......... 66% 362M 0s 2024-09-12T17:39:45.591 INFO:teuthology.orchestra.run.smithi037.stderr: 61400K .......... .......... .......... .......... .......... 66% 280M 0s 2024-09-12T17:39:45.591 INFO:teuthology.orchestra.run.smithi037.stderr: 61450K .......... .......... .......... .......... .......... 66% 329M 0s 2024-09-12T17:39:45.591 INFO:teuthology.orchestra.run.smithi037.stderr: 61500K .......... .......... .......... .......... .......... 66% 375M 0s 2024-09-12T17:39:45.591 INFO:teuthology.orchestra.run.smithi037.stderr: 61550K .......... .......... .......... .......... .......... 66% 251M 0s 2024-09-12T17:39:45.591 INFO:teuthology.orchestra.run.smithi037.stderr: 61600K .......... .......... .......... .......... .......... 66% 288M 0s 2024-09-12T17:39:45.591 INFO:teuthology.orchestra.run.smithi037.stderr: 61650K .......... .......... .......... .......... .......... 66% 328M 0s 2024-09-12T17:39:45.591 INFO:teuthology.orchestra.run.smithi037.stderr: 61700K .......... .......... .......... .......... .......... 66% 310M 0s 2024-09-12T17:39:45.591 INFO:teuthology.orchestra.run.smithi037.stderr: 61750K .......... .......... .......... .......... .......... 66% 245M 0s 2024-09-12T17:39:45.591 INFO:teuthology.orchestra.run.smithi037.stderr: 61800K .......... .......... .......... .......... .......... 66% 293M 0s 2024-09-12T17:39:45.591 INFO:teuthology.orchestra.run.smithi037.stderr: 61850K .......... .......... .......... .......... .......... 66% 360M 0s 2024-09-12T17:39:45.591 INFO:teuthology.orchestra.run.smithi037.stderr: 61900K .......... .......... .......... .......... .......... 66% 283M 0s 2024-09-12T17:39:45.591 INFO:teuthology.orchestra.run.smithi037.stderr: 61950K .......... .......... .......... .......... .......... 66% 283M 0s 2024-09-12T17:39:45.591 INFO:teuthology.orchestra.run.smithi037.stderr: 62000K .......... .......... .......... .......... .......... 66% 346M 0s 2024-09-12T17:39:45.591 INFO:teuthology.orchestra.run.smithi037.stderr: 62050K .......... .......... .......... .......... .......... 66% 346M 0s 2024-09-12T17:39:45.591 INFO:teuthology.orchestra.run.smithi037.stderr: 62100K .......... .......... .......... .......... .......... 66% 286M 0s 2024-09-12T17:39:45.592 INFO:teuthology.orchestra.run.smithi037.stderr: 62150K .......... .......... .......... .......... .......... 66% 293M 0s 2024-09-12T17:39:45.592 INFO:teuthology.orchestra.run.smithi037.stderr: 62200K .......... .......... .......... .......... .......... 67% 302M 0s 2024-09-12T17:39:45.592 INFO:teuthology.orchestra.run.smithi037.stderr: 62250K .......... .......... .......... .......... .......... 67% 291M 0s 2024-09-12T17:39:45.592 INFO:teuthology.orchestra.run.smithi037.stderr: 62300K .......... .......... .......... .......... .......... 67% 271M 0s 2024-09-12T17:39:45.592 INFO:teuthology.orchestra.run.smithi037.stderr: 62350K .......... .......... .......... .......... .......... 67% 266M 0s 2024-09-12T17:39:45.592 INFO:teuthology.orchestra.run.smithi037.stderr: 62400K .......... .......... .......... .......... .......... 67% 326M 0s 2024-09-12T17:39:45.592 INFO:teuthology.orchestra.run.smithi037.stderr: 62450K .......... .......... .......... .......... .......... 67% 328M 0s 2024-09-12T17:39:45.592 INFO:teuthology.orchestra.run.smithi037.stderr: 62500K .......... .......... .......... .......... .......... 67% 300M 0s 2024-09-12T17:39:45.592 INFO:teuthology.orchestra.run.smithi037.stderr: 62550K .......... .......... .......... .......... .......... 67% 66.7M 0s 2024-09-12T17:39:45.592 INFO:teuthology.orchestra.run.smithi037.stderr: 62600K .......... .......... .......... .......... .......... 67% 304M 0s 2024-09-12T17:39:45.592 INFO:teuthology.orchestra.run.smithi037.stderr: 62650K .......... .......... .......... .......... .......... 67% 284M 0s 2024-09-12T17:39:45.592 INFO:teuthology.orchestra.run.smithi037.stderr: 62700K .......... .......... .......... .......... .......... 67% 308M 0s 2024-09-12T17:39:45.592 INFO:teuthology.orchestra.run.smithi037.stderr: 62750K .......... .......... .......... .......... .......... 67% 235M 0s 2024-09-12T17:39:45.593 INFO:teuthology.orchestra.run.smithi037.stderr: 62800K .......... .......... .......... .......... .......... 67% 296M 0s 2024-09-12T17:39:45.593 INFO:teuthology.orchestra.run.smithi037.stderr: 62850K .......... .......... .......... .......... .......... 67% 294M 0s 2024-09-12T17:39:45.593 INFO:teuthology.orchestra.run.smithi037.stderr: 62900K .......... .......... .......... .......... .......... 67% 271M 0s 2024-09-12T17:39:45.593 INFO:teuthology.orchestra.run.smithi037.stderr: 62950K .......... .......... .......... .......... .......... 67% 265M 0s 2024-09-12T17:39:45.593 INFO:teuthology.orchestra.run.smithi037.stderr: 63000K .......... .......... .......... .......... .......... 67% 291M 0s 2024-09-12T17:39:45.593 INFO:teuthology.orchestra.run.smithi037.stderr: 63050K .......... .......... .......... .......... .......... 67% 301M 0s 2024-09-12T17:39:45.593 INFO:teuthology.orchestra.run.smithi037.stderr: 63100K .......... .......... .......... .......... .......... 67% 283M 0s 2024-09-12T17:39:45.593 INFO:teuthology.orchestra.run.smithi037.stderr: 63150K .......... .......... .......... .......... .......... 68% 265M 0s 2024-09-12T17:39:45.593 INFO:teuthology.orchestra.run.smithi037.stderr: 63200K .......... .......... .......... .......... .......... 68% 277M 0s 2024-09-12T17:39:45.593 INFO:teuthology.orchestra.run.smithi037.stderr: 63250K .......... .......... .......... .......... .......... 68% 294M 0s 2024-09-12T17:39:45.593 INFO:teuthology.orchestra.run.smithi037.stderr: 63300K .......... .......... .......... .......... .......... 68% 326M 0s 2024-09-12T17:39:45.593 INFO:teuthology.orchestra.run.smithi037.stderr: 63350K .......... .......... .......... .......... .......... 68% 277M 0s 2024-09-12T17:39:45.593 INFO:teuthology.orchestra.run.smithi037.stderr: 63400K .......... .......... .......... .......... .......... 68% 338M 0s 2024-09-12T17:39:45.593 INFO:teuthology.orchestra.run.smithi037.stderr: 63450K .......... .......... .......... .......... .......... 68% 316M 0s 2024-09-12T17:39:45.593 INFO:teuthology.orchestra.run.smithi037.stderr: 63500K .......... .......... .......... .......... .......... 68% 341M 0s 2024-09-12T17:39:45.594 INFO:teuthology.orchestra.run.smithi037.stderr: 63550K .......... .......... .......... .......... .......... 68% 261M 0s 2024-09-12T17:39:45.594 INFO:teuthology.orchestra.run.smithi037.stderr: 63600K .......... .......... .......... .......... .......... 68% 197M 0s 2024-09-12T17:39:45.594 INFO:teuthology.orchestra.run.smithi037.stderr: 63650K .......... .......... .......... .......... .......... 68% 323M 0s 2024-09-12T17:39:45.594 INFO:teuthology.orchestra.run.smithi037.stderr: 63700K .......... .......... .......... .......... .......... 68% 384M 0s 2024-09-12T17:39:45.594 INFO:teuthology.orchestra.run.smithi037.stderr: 63750K .......... .......... .......... .......... .......... 68% 278M 0s 2024-09-12T17:39:45.594 INFO:teuthology.orchestra.run.smithi037.stderr: 63800K .......... .......... .......... .......... .......... 68% 264M 0s 2024-09-12T17:39:45.594 INFO:teuthology.orchestra.run.smithi037.stderr: 63850K .......... .......... .......... .......... .......... 68% 323M 0s 2024-09-12T17:39:45.594 INFO:teuthology.orchestra.run.smithi037.stderr: 63900K .......... .......... .......... .......... .......... 68% 119M 0s 2024-09-12T17:39:45.594 INFO:teuthology.orchestra.run.smithi037.stderr: 63950K .......... .......... .......... .......... .......... 68% 215M 0s 2024-09-12T17:39:45.594 INFO:teuthology.orchestra.run.smithi037.stderr: 64000K .......... .......... .......... .......... .......... 68% 289M 0s 2024-09-12T17:39:45.594 INFO:teuthology.orchestra.run.smithi037.stderr: 64050K .......... .......... .......... .......... .......... 68% 312M 0s 2024-09-12T17:39:45.594 INFO:teuthology.orchestra.run.smithi037.stderr: 64100K .......... .......... .......... .......... .......... 69% 164M 0s 2024-09-12T17:39:45.594 INFO:teuthology.orchestra.run.smithi037.stderr: 64150K .......... .......... .......... .......... .......... 69% 71.1M 0s 2024-09-12T17:39:45.594 INFO:teuthology.orchestra.run.smithi037.stderr: 64200K .......... .......... .......... .......... .......... 69% 312M 0s 2024-09-12T17:39:45.594 INFO:teuthology.orchestra.run.smithi037.stderr: 64250K .......... .......... .......... .......... .......... 69% 249M 0s 2024-09-12T17:39:45.595 INFO:teuthology.orchestra.run.smithi037.stderr: 64300K .......... .......... .......... .......... .......... 69% 282M 0s 2024-09-12T17:39:45.595 INFO:teuthology.orchestra.run.smithi037.stderr: 64350K .......... .......... .......... .......... .......... 69% 258M 0s 2024-09-12T17:39:45.595 INFO:teuthology.orchestra.run.smithi037.stderr: 64400K .......... .......... .......... .......... .......... 69% 261M 0s 2024-09-12T17:39:45.595 INFO:teuthology.orchestra.run.smithi037.stderr: 64450K .......... .......... .......... .......... .......... 69% 320M 0s 2024-09-12T17:39:45.595 INFO:teuthology.orchestra.run.smithi037.stderr: 64500K .......... .......... .......... .......... .......... 69% 292M 0s 2024-09-12T17:39:45.595 INFO:teuthology.orchestra.run.smithi037.stderr: 64550K .......... .......... .......... .......... .......... 69% 273M 0s 2024-09-12T17:39:45.595 INFO:teuthology.orchestra.run.smithi037.stderr: 64600K .......... .......... .......... .......... .......... 69% 315M 0s 2024-09-12T17:39:45.595 INFO:teuthology.orchestra.run.smithi037.stderr: 64650K .......... .......... .......... .......... .......... 69% 309M 0s 2024-09-12T17:39:45.595 INFO:teuthology.orchestra.run.smithi037.stderr: 64700K .......... .......... .......... .......... .......... 69% 299M 0s 2024-09-12T17:39:45.595 INFO:teuthology.orchestra.run.smithi037.stderr: 64750K .......... .......... .......... .......... .......... 69% 246M 0s 2024-09-12T17:39:45.595 INFO:teuthology.orchestra.run.smithi037.stderr: 64800K .......... .......... .......... .......... .......... 69% 314M 0s 2024-09-12T17:39:45.595 INFO:teuthology.orchestra.run.smithi037.stderr: 64850K .......... .......... .......... .......... .......... 69% 315M 0s 2024-09-12T17:39:45.595 INFO:teuthology.orchestra.run.smithi037.stderr: 64900K .......... .......... .......... .......... .......... 69% 237M 0s 2024-09-12T17:39:45.595 INFO:teuthology.orchestra.run.smithi037.stderr: 64950K .......... .......... .......... .......... .......... 69% 266M 0s 2024-09-12T17:39:45.595 INFO:teuthology.orchestra.run.smithi037.stderr: 65000K .......... .......... .......... .......... .......... 70% 290M 0s 2024-09-12T17:39:45.596 INFO:teuthology.orchestra.run.smithi037.stderr: 65050K .......... .......... .......... .......... .......... 70% 320M 0s 2024-09-12T17:39:45.596 INFO:teuthology.orchestra.run.smithi037.stderr: 65100K .......... .......... .......... .......... .......... 70% 312M 0s 2024-09-12T17:39:45.596 INFO:teuthology.orchestra.run.smithi037.stderr: 65150K .......... .......... .......... .......... .......... 70% 255M 0s 2024-09-12T17:39:45.596 INFO:teuthology.orchestra.run.smithi037.stderr: 65200K .......... .......... .......... .......... .......... 70% 326M 0s 2024-09-12T17:39:45.596 INFO:teuthology.orchestra.run.smithi037.stderr: 65250K .......... .......... .......... .......... .......... 70% 339M 0s 2024-09-12T17:39:45.596 INFO:teuthology.orchestra.run.smithi037.stderr: 65300K .......... .......... .......... .......... .......... 70% 326M 0s 2024-09-12T17:39:45.596 INFO:teuthology.orchestra.run.smithi037.stderr: 65350K .......... .......... .......... .......... .......... 70% 302M 0s 2024-09-12T17:39:45.596 INFO:teuthology.orchestra.run.smithi037.stderr: 65400K .......... .......... .......... .......... .......... 70% 235M 0s 2024-09-12T17:39:45.596 INFO:teuthology.orchestra.run.smithi037.stderr: 65450K .......... .......... .......... .......... .......... 70% 325M 0s 2024-09-12T17:39:45.596 INFO:teuthology.orchestra.run.smithi037.stderr: 65500K .......... .......... .......... .......... .......... 70% 312M 0s 2024-09-12T17:39:45.596 INFO:teuthology.orchestra.run.smithi037.stderr: 65550K .......... .......... .......... .......... .......... 70% 88.5M 0s 2024-09-12T17:39:45.596 INFO:teuthology.orchestra.run.smithi037.stderr: 65600K .......... .......... .......... .......... .......... 70% 208M 0s 2024-09-12T17:39:45.596 INFO:teuthology.orchestra.run.smithi037.stderr: 65650K .......... .......... .......... .......... .......... 70% 280M 0s 2024-09-12T17:39:45.597 INFO:teuthology.orchestra.run.smithi037.stderr: 65700K .......... .......... .......... .......... .......... 70% 142M 0s 2024-09-12T17:39:45.597 INFO:teuthology.orchestra.run.smithi037.stderr: 65750K .......... .......... .......... .......... .......... 70% 217M 0s 2024-09-12T17:39:45.597 INFO:teuthology.orchestra.run.smithi037.stderr: 65800K .......... .......... .......... .......... .......... 70% 290M 0s 2024-09-12T17:39:45.597 INFO:teuthology.orchestra.run.smithi037.stderr: 65850K .......... .......... .......... .......... .......... 70% 296M 0s 2024-09-12T17:39:45.597 INFO:teuthology.orchestra.run.smithi037.stderr: 65900K .......... .......... .......... .......... .......... 70% 295M 0s 2024-09-12T17:39:45.597 INFO:teuthology.orchestra.run.smithi037.stderr: 65950K .......... .......... .......... .......... .......... 71% 248M 0s 2024-09-12T17:39:45.597 INFO:teuthology.orchestra.run.smithi037.stderr: 66000K .......... .......... .......... .......... .......... 71% 317M 0s 2024-09-12T17:39:45.597 INFO:teuthology.orchestra.run.smithi037.stderr: 66050K .......... .......... .......... .......... .......... 71% 304M 0s 2024-09-12T17:39:45.597 INFO:teuthology.orchestra.run.smithi037.stderr: 66100K .......... .......... .......... .......... .......... 71% 313M 0s 2024-09-12T17:39:45.597 INFO:teuthology.orchestra.run.smithi037.stderr: 66150K .......... .......... .......... .......... .......... 71% 272M 0s 2024-09-12T17:39:45.597 INFO:teuthology.orchestra.run.smithi037.stderr: 66200K .......... .......... .......... .......... .......... 71% 286M 0s 2024-09-12T17:39:45.597 INFO:teuthology.orchestra.run.smithi037.stderr: 66250K .......... .......... .......... .......... .......... 71% 299M 0s 2024-09-12T17:39:45.597 INFO:teuthology.orchestra.run.smithi037.stderr: 66300K .......... .......... .......... .......... .......... 71% 277M 0s 2024-09-12T17:39:45.597 INFO:teuthology.orchestra.run.smithi037.stderr: 66350K .......... .......... .......... .......... .......... 71% 278M 0s 2024-09-12T17:39:45.597 INFO:teuthology.orchestra.run.smithi037.stderr: 66400K .......... .......... .......... .......... .......... 71% 303M 0s 2024-09-12T17:39:45.598 INFO:teuthology.orchestra.run.smithi037.stderr: 66450K .......... .......... .......... .......... .......... 71% 308M 0s 2024-09-12T17:39:45.598 INFO:teuthology.orchestra.run.smithi037.stderr: 66500K .......... .......... .......... .......... .......... 71% 197M 0s 2024-09-12T17:39:45.598 INFO:teuthology.orchestra.run.smithi037.stderr: 66550K .......... .......... .......... .......... .......... 71% 261M 0s 2024-09-12T17:39:45.598 INFO:teuthology.orchestra.run.smithi037.stderr: 66600K .......... .......... .......... .......... .......... 71% 293M 0s 2024-09-12T17:39:45.598 INFO:teuthology.orchestra.run.smithi037.stderr: 66650K .......... .......... .......... .......... .......... 71% 317M 0s 2024-09-12T17:39:45.598 INFO:teuthology.orchestra.run.smithi037.stderr: 66700K .......... .......... .......... .......... .......... 71% 316M 0s 2024-09-12T17:39:45.598 INFO:teuthology.orchestra.run.smithi037.stderr: 66750K .......... .......... .......... .......... .......... 71% 254M 0s 2024-09-12T17:39:45.598 INFO:teuthology.orchestra.run.smithi037.stderr: 66800K .......... .......... .......... .......... .......... 71% 301M 0s 2024-09-12T17:39:45.598 INFO:teuthology.orchestra.run.smithi037.stderr: 66850K .......... .......... .......... .......... .......... 72% 298M 0s 2024-09-12T17:39:45.598 INFO:teuthology.orchestra.run.smithi037.stderr: 66900K .......... .......... .......... .......... .......... 72% 188M 0s 2024-09-12T17:39:45.598 INFO:teuthology.orchestra.run.smithi037.stderr: 66950K .......... .......... .......... .......... .......... 72% 246M 0s 2024-09-12T17:39:45.598 INFO:teuthology.orchestra.run.smithi037.stderr: 67000K .......... .......... .......... .......... .......... 72% 233M 0s 2024-09-12T17:39:45.598 INFO:teuthology.orchestra.run.smithi037.stderr: 67050K .......... .......... .......... .......... .......... 72% 295M 0s 2024-09-12T17:39:45.598 INFO:teuthology.orchestra.run.smithi037.stderr: 67100K .......... .......... .......... .......... .......... 72% 324M 0s 2024-09-12T17:39:45.599 INFO:teuthology.orchestra.run.smithi037.stderr: 67150K .......... .......... .......... .......... .......... 72% 167M 0s 2024-09-12T17:39:45.599 INFO:teuthology.orchestra.run.smithi037.stderr: 67200K .......... .......... .......... .......... .......... 72% 91.6M 0s 2024-09-12T17:39:45.599 INFO:teuthology.orchestra.run.smithi037.stderr: 67250K .......... .......... .......... .......... .......... 72% 327M 0s 2024-09-12T17:39:45.599 INFO:teuthology.orchestra.run.smithi037.stderr: 67300K .......... .......... .......... .......... .......... 72% 308M 0s 2024-09-12T17:39:45.599 INFO:teuthology.orchestra.run.smithi037.stderr: 67350K .......... .......... .......... .......... .......... 72% 69.8M 0s 2024-09-12T17:39:45.599 INFO:teuthology.orchestra.run.smithi037.stderr: 67400K .......... .......... .......... .......... .......... 72% 293M 0s 2024-09-12T17:39:45.599 INFO:teuthology.orchestra.run.smithi037.stderr: 67450K .......... .......... .......... .......... .......... 72% 300M 0s 2024-09-12T17:39:45.599 INFO:teuthology.orchestra.run.smithi037.stderr: 67500K .......... .......... .......... .......... .......... 72% 264M 0s 2024-09-12T17:39:45.599 INFO:teuthology.orchestra.run.smithi037.stderr: 67550K .......... .......... .......... .......... .......... 72% 262M 0s 2024-09-12T17:39:45.599 INFO:teuthology.orchestra.run.smithi037.stderr: 67600K .......... .......... .......... .......... .......... 72% 165M 0s 2024-09-12T17:39:45.599 INFO:teuthology.orchestra.run.smithi037.stderr: 67650K .......... .......... .......... .......... .......... 72% 265M 0s 2024-09-12T17:39:45.599 INFO:teuthology.orchestra.run.smithi037.stderr: 67700K .......... .......... .......... .......... .......... 72% 299M 0s 2024-09-12T17:39:45.599 INFO:teuthology.orchestra.run.smithi037.stderr: 67750K .......... .......... .......... .......... .......... 72% 303M 0s 2024-09-12T17:39:45.599 INFO:teuthology.orchestra.run.smithi037.stderr: 67800K .......... .......... .......... .......... .......... 73% 300M 0s 2024-09-12T17:39:45.600 INFO:teuthology.orchestra.run.smithi037.stderr: 67850K .......... .......... .......... .......... .......... 73% 323M 0s 2024-09-12T17:39:45.600 INFO:teuthology.orchestra.run.smithi037.stderr: 67900K .......... .......... .......... .......... .......... 73% 325M 0s 2024-09-12T17:39:45.600 INFO:teuthology.orchestra.run.smithi037.stderr: 67950K .......... .......... .......... .......... .......... 73% 74.7M 0s 2024-09-12T17:39:45.600 INFO:teuthology.orchestra.run.smithi037.stderr: 68000K .......... .......... .......... .......... .......... 73% 189M 0s 2024-09-12T17:39:45.600 INFO:teuthology.orchestra.run.smithi037.stderr: 68050K .......... .......... .......... .......... .......... 73% 330M 0s 2024-09-12T17:39:45.600 INFO:teuthology.orchestra.run.smithi037.stderr: 68100K .......... .......... .......... .......... .......... 73% 348M 0s 2024-09-12T17:39:45.600 INFO:teuthology.orchestra.run.smithi037.stderr: 68150K .......... .......... .......... .......... .......... 73% 278M 0s 2024-09-12T17:39:45.600 INFO:teuthology.orchestra.run.smithi037.stderr: 68200K .......... .......... .......... .......... .......... 73% 318M 0s 2024-09-12T17:39:45.600 INFO:teuthology.orchestra.run.smithi037.stderr: 68250K .......... .......... .......... .......... .......... 73% 302M 0s 2024-09-12T17:39:45.600 INFO:teuthology.orchestra.run.smithi037.stderr: 68300K .......... .......... .......... .......... .......... 73% 313M 0s 2024-09-12T17:39:45.600 INFO:teuthology.orchestra.run.smithi037.stderr: 68350K .......... .......... .......... .......... .......... 73% 229M 0s 2024-09-12T17:39:45.600 INFO:teuthology.orchestra.run.smithi037.stderr: 68400K .......... .......... .......... .......... .......... 73% 299M 0s 2024-09-12T17:39:45.600 INFO:teuthology.orchestra.run.smithi037.stderr: 68450K .......... .......... .......... .......... .......... 73% 303M 0s 2024-09-12T17:39:45.600 INFO:teuthology.orchestra.run.smithi037.stderr: 68500K .......... .......... .......... .......... .......... 73% 330M 0s 2024-09-12T17:39:45.600 INFO:teuthology.orchestra.run.smithi037.stderr: 68550K .......... .......... .......... .......... .......... 73% 306M 0s 2024-09-12T17:39:45.601 INFO:teuthology.orchestra.run.smithi037.stderr: 68600K .......... .......... .......... .......... .......... 73% 304M 0s 2024-09-12T17:39:45.601 INFO:teuthology.orchestra.run.smithi037.stderr: 68650K .......... .......... .......... .......... .......... 73% 369M 0s 2024-09-12T17:39:45.601 INFO:teuthology.orchestra.run.smithi037.stderr: 68700K .......... .......... .......... .......... .......... 74% 285M 0s 2024-09-12T17:39:45.601 INFO:teuthology.orchestra.run.smithi037.stderr: 68750K .......... .......... .......... .......... .......... 74% 248M 0s 2024-09-12T17:39:45.601 INFO:teuthology.orchestra.run.smithi037.stderr: 68800K .......... .......... .......... .......... .......... 74% 237M 0s 2024-09-12T17:39:45.601 INFO:teuthology.orchestra.run.smithi037.stderr: 68850K .......... .......... .......... .......... .......... 74% 365M 0s 2024-09-12T17:39:45.601 INFO:teuthology.orchestra.run.smithi037.stderr: 68900K .......... .......... .......... .......... .......... 74% 363M 0s 2024-09-12T17:39:45.601 INFO:teuthology.orchestra.run.smithi037.stderr: 68950K .......... .......... .......... .......... .......... 74% 202M 0s 2024-09-12T17:39:45.601 INFO:teuthology.orchestra.run.smithi037.stderr: 69000K .......... .......... .......... .......... .......... 74% 289M 0s 2024-09-12T17:39:45.601 INFO:teuthology.orchestra.run.smithi037.stderr: 69050K .......... .......... .......... .......... .......... 74% 286M 0s 2024-09-12T17:39:45.601 INFO:teuthology.orchestra.run.smithi037.stderr: 69100K .......... .......... .......... .......... .......... 74% 301M 0s 2024-09-12T17:39:45.601 INFO:teuthology.orchestra.run.smithi037.stderr: 69150K .......... .......... .......... .......... .......... 74% 254M 0s 2024-09-12T17:39:45.601 INFO:teuthology.orchestra.run.smithi037.stderr: 69200K .......... .......... .......... .......... .......... 74% 283M 0s 2024-09-12T17:39:45.601 INFO:teuthology.orchestra.run.smithi037.stderr: 69250K .......... .......... .......... .......... .......... 74% 294M 0s 2024-09-12T17:39:45.602 INFO:teuthology.orchestra.run.smithi037.stderr: 69300K .......... .......... .......... .......... .......... 74% 295M 0s 2024-09-12T17:39:45.602 INFO:teuthology.orchestra.run.smithi037.stderr: 69350K .......... .......... .......... .......... .......... 74% 292M 0s 2024-09-12T17:39:45.602 INFO:teuthology.orchestra.run.smithi037.stderr: 69400K .......... .......... .......... .......... .......... 74% 393M 0s 2024-09-12T17:39:45.602 INFO:teuthology.orchestra.run.smithi037.stderr: 69450K .......... .......... .......... .......... .......... 74% 382M 0s 2024-09-12T17:39:45.602 INFO:teuthology.orchestra.run.smithi037.stderr: 69500K .......... .......... .......... .......... .......... 74% 386M 0s 2024-09-12T17:39:45.602 INFO:teuthology.orchestra.run.smithi037.stderr: 69550K .......... .......... .......... .......... .......... 74% 328M 0s 2024-09-12T17:39:45.602 INFO:teuthology.orchestra.run.smithi037.stderr: 69600K .......... .......... .......... .......... .......... 74% 207M 0s 2024-09-12T17:39:45.602 INFO:teuthology.orchestra.run.smithi037.stderr: 69650K .......... .......... .......... .......... .......... 75% 371M 0s 2024-09-12T17:39:45.602 INFO:teuthology.orchestra.run.smithi037.stderr: 69700K .......... .......... .......... .......... .......... 75% 135M 0s 2024-09-12T17:39:45.602 INFO:teuthology.orchestra.run.smithi037.stderr: 69750K .......... .......... .......... .......... .......... 75% 313M 0s 2024-09-12T17:39:45.602 INFO:teuthology.orchestra.run.smithi037.stderr: 69800K .......... .......... .......... .......... .......... 75% 393M 0s 2024-09-12T17:39:45.602 INFO:teuthology.orchestra.run.smithi037.stderr: 69850K .......... .......... .......... .......... .......... 75% 143M 0s 2024-09-12T17:39:45.602 INFO:teuthology.orchestra.run.smithi037.stderr: 69900K .......... .......... .......... .......... .......... 75% 379M 0s 2024-09-12T17:39:45.602 INFO:teuthology.orchestra.run.smithi037.stderr: 69950K .......... .......... .......... .......... .......... 75% 278M 0s 2024-09-12T17:39:45.602 INFO:teuthology.orchestra.run.smithi037.stderr: 70000K .......... .......... .......... .......... .......... 75% 375M 0s 2024-09-12T17:39:45.603 INFO:teuthology.orchestra.run.smithi037.stderr: 70050K .......... .......... .......... .......... .......... 75% 359M 0s 2024-09-12T17:39:45.603 INFO:teuthology.orchestra.run.smithi037.stderr: 70100K .......... .......... .......... .......... .......... 75% 261M 0s 2024-09-12T17:39:45.603 INFO:teuthology.orchestra.run.smithi037.stderr: 70150K .......... .......... .......... .......... .......... 75% 316M 0s 2024-09-12T17:39:45.603 INFO:teuthology.orchestra.run.smithi037.stderr: 70200K .......... .......... .......... .......... .......... 75% 324M 0s 2024-09-12T17:39:45.603 INFO:teuthology.orchestra.run.smithi037.stderr: 70250K .......... .......... .......... .......... .......... 75% 237M 0s 2024-09-12T17:39:45.603 INFO:teuthology.orchestra.run.smithi037.stderr: 70300K .......... .......... .......... .......... .......... 75% 305M 0s 2024-09-12T17:39:45.603 INFO:teuthology.orchestra.run.smithi037.stderr: 70350K .......... .......... .......... .......... .......... 75% 249M 0s 2024-09-12T17:39:45.603 INFO:teuthology.orchestra.run.smithi037.stderr: 70400K .......... .......... .......... .......... .......... 75% 79.7M 0s 2024-09-12T17:39:45.603 INFO:teuthology.orchestra.run.smithi037.stderr: 70450K .......... .......... .......... .......... .......... 75% 138M 0s 2024-09-12T17:39:45.603 INFO:teuthology.orchestra.run.smithi037.stderr: 70500K .......... .......... .......... .......... .......... 75% 354M 0s 2024-09-12T17:39:45.603 INFO:teuthology.orchestra.run.smithi037.stderr: 70550K .......... .......... .......... .......... .......... 75% 345M 0s 2024-09-12T17:39:45.603 INFO:teuthology.orchestra.run.smithi037.stderr: 70600K .......... .......... .......... .......... .......... 76% 154M 0s 2024-09-12T17:39:45.603 INFO:teuthology.orchestra.run.smithi037.stderr: 70650K .......... .......... .......... .......... .......... 76% 355M 0s 2024-09-12T17:39:45.603 INFO:teuthology.orchestra.run.smithi037.stderr: 70700K .......... .......... .......... .......... .......... 76% 154M 0s 2024-09-12T17:39:45.604 INFO:teuthology.orchestra.run.smithi037.stderr: 70750K .......... .......... .......... .......... .......... 76% 278M 0s 2024-09-12T17:39:45.604 INFO:teuthology.orchestra.run.smithi037.stderr: 70800K .......... .......... .......... .......... .......... 76% 328M 0s 2024-09-12T17:39:45.604 INFO:teuthology.orchestra.run.smithi037.stderr: 70850K .......... .......... .......... .......... .......... 76% 365M 0s 2024-09-12T17:39:45.604 INFO:teuthology.orchestra.run.smithi037.stderr: 70900K .......... .......... .......... .......... .......... 76% 157M 0s 2024-09-12T17:39:45.604 INFO:teuthology.orchestra.run.smithi037.stderr: 70950K .......... .......... .......... .......... .......... 76% 336M 0s 2024-09-12T17:39:45.604 INFO:teuthology.orchestra.run.smithi037.stderr: 71000K .......... .......... .......... .......... .......... 76% 378M 0s 2024-09-12T17:39:45.604 INFO:teuthology.orchestra.run.smithi037.stderr: 71050K .......... .......... .......... .......... .......... 76% 121M 0s 2024-09-12T17:39:45.604 INFO:teuthology.orchestra.run.smithi037.stderr: 71100K .......... .......... .......... .......... .......... 76% 135M 0s 2024-09-12T17:39:45.604 INFO:teuthology.orchestra.run.smithi037.stderr: 71150K .......... .......... .......... .......... .......... 76% 279M 0s 2024-09-12T17:39:45.604 INFO:teuthology.orchestra.run.smithi037.stderr: 71200K .......... .......... .......... .......... .......... 76% 371M 0s 2024-09-12T17:39:45.604 INFO:teuthology.orchestra.run.smithi037.stderr: 71250K .......... .......... .......... .......... .......... 76% 284M 0s 2024-09-12T17:39:45.604 INFO:teuthology.orchestra.run.smithi037.stderr: 71300K .......... .......... .......... .......... .......... 76% 164M 0s 2024-09-12T17:39:45.604 INFO:teuthology.orchestra.run.smithi037.stderr: 71350K .......... .......... .......... .......... .......... 76% 336M 0s 2024-09-12T17:39:45.604 INFO:teuthology.orchestra.run.smithi037.stderr: 71400K .......... .......... .......... .......... .......... 76% 389M 0s 2024-09-12T17:39:45.605 INFO:teuthology.orchestra.run.smithi037.stderr: 71450K .......... .......... .......... .......... .......... 76% 375M 0s 2024-09-12T17:39:45.605 INFO:teuthology.orchestra.run.smithi037.stderr: 71500K .......... .......... .......... .......... .......... 77% 392M 0s 2024-09-12T17:39:45.605 INFO:teuthology.orchestra.run.smithi037.stderr: 71550K .......... .......... .......... .......... .......... 77% 311M 0s 2024-09-12T17:39:45.605 INFO:teuthology.orchestra.run.smithi037.stderr: 71600K .......... .......... .......... .......... .......... 77% 385M 0s 2024-09-12T17:39:45.605 INFO:teuthology.orchestra.run.smithi037.stderr: 71650K .......... .......... .......... .......... .......... 77% 242M 0s 2024-09-12T17:39:45.605 INFO:teuthology.orchestra.run.smithi037.stderr: 71700K .......... .......... .......... .......... .......... 77% 365M 0s 2024-09-12T17:39:45.605 INFO:teuthology.orchestra.run.smithi037.stderr: 71750K .......... .......... .......... .......... .......... 77% 339M 0s 2024-09-12T17:39:45.605 INFO:teuthology.orchestra.run.smithi037.stderr: 71800K .......... .......... .......... .......... .......... 77% 169M 0s 2024-09-12T17:39:45.605 INFO:teuthology.orchestra.run.smithi037.stderr: 71850K .......... .......... .......... .......... .......... 77% 330M 0s 2024-09-12T17:39:45.605 INFO:teuthology.orchestra.run.smithi037.stderr: 71900K .......... .......... .......... .......... .......... 77% 252M 0s 2024-09-12T17:39:45.605 INFO:teuthology.orchestra.run.smithi037.stderr: 71950K .......... .......... .......... .......... .......... 77% 378M 0s 2024-09-12T17:39:45.605 INFO:teuthology.orchestra.run.smithi037.stderr: 72000K .......... .......... .......... .......... .......... 77% 269M 0s 2024-09-12T17:39:45.605 INFO:teuthology.orchestra.run.smithi037.stderr: 72050K .......... .......... .......... .......... .......... 77% 368M 0s 2024-09-12T17:39:45.605 INFO:teuthology.orchestra.run.smithi037.stderr: 72100K .......... .......... .......... .......... .......... 77% 234M 0s 2024-09-12T17:39:45.606 INFO:teuthology.orchestra.run.smithi037.stderr: 72150K .......... .......... .......... .......... .......... 77% 358M 0s 2024-09-12T17:39:45.606 INFO:teuthology.orchestra.run.smithi037.stderr: 72200K .......... .......... .......... .......... .......... 77% 135M 0s 2024-09-12T17:39:45.606 INFO:teuthology.orchestra.run.smithi037.stderr: 72250K .......... .......... .......... .......... .......... 77% 382M 0s 2024-09-12T17:39:45.606 INFO:teuthology.orchestra.run.smithi037.stderr: 72300K .......... .......... .......... .......... .......... 77% 109M 0s 2024-09-12T17:39:45.606 INFO:teuthology.orchestra.run.smithi037.stderr: 72350K .......... .......... .......... .......... .......... 77% 271M 0s 2024-09-12T17:39:45.606 INFO:teuthology.orchestra.run.smithi037.stderr: 72400K .......... .......... .......... .......... .......... 77% 375M 0s 2024-09-12T17:39:45.606 INFO:teuthology.orchestra.run.smithi037.stderr: 72450K .......... .......... .......... .......... .......... 78% 342M 0s 2024-09-12T17:39:45.606 INFO:teuthology.orchestra.run.smithi037.stderr: 72500K .......... .......... .......... .......... .......... 78% 341M 0s 2024-09-12T17:39:45.606 INFO:teuthology.orchestra.run.smithi037.stderr: 72550K .......... .......... .......... .......... .......... 78% 385M 0s 2024-09-12T17:39:45.606 INFO:teuthology.orchestra.run.smithi037.stderr: 72600K .......... .......... .......... .......... .......... 78% 372M 0s 2024-09-12T17:39:45.606 INFO:teuthology.orchestra.run.smithi037.stderr: 72650K .......... .......... .......... .......... .......... 78% 392M 0s 2024-09-12T17:39:45.606 INFO:teuthology.orchestra.run.smithi037.stderr: 72700K .......... .......... .......... .......... .......... 78% 242M 0s 2024-09-12T17:39:45.606 INFO:teuthology.orchestra.run.smithi037.stderr: 72750K .......... .......... .......... .......... .......... 78% 275M 0s 2024-09-12T17:39:45.606 INFO:teuthology.orchestra.run.smithi037.stderr: 72800K .......... .......... .......... .......... .......... 78% 303M 0s 2024-09-12T17:39:45.607 INFO:teuthology.orchestra.run.smithi037.stderr: 72850K .......... .......... .......... .......... .......... 78% 206M 0s 2024-09-12T17:39:45.607 INFO:teuthology.orchestra.run.smithi037.stderr: 72900K .......... .......... .......... .......... .......... 78% 166M 0s 2024-09-12T17:39:45.607 INFO:teuthology.orchestra.run.smithi037.stderr: 72950K .......... .......... .......... .......... .......... 78% 172M 0s 2024-09-12T17:39:45.607 INFO:teuthology.orchestra.run.smithi037.stderr: 73000K .......... .......... .......... .......... .......... 78% 198M 0s 2024-09-12T17:39:45.607 INFO:teuthology.orchestra.run.smithi037.stderr: 73050K .......... .......... .......... .......... .......... 78% 198M 0s 2024-09-12T17:39:45.607 INFO:teuthology.orchestra.run.smithi037.stderr: 73100K .......... .......... .......... .......... .......... 78% 167M 0s 2024-09-12T17:39:45.607 INFO:teuthology.orchestra.run.smithi037.stderr: 73150K .......... .......... .......... .......... .......... 78% 202M 0s 2024-09-12T17:39:45.607 INFO:teuthology.orchestra.run.smithi037.stderr: 73200K .......... .......... .......... .......... .......... 78% 184M 0s 2024-09-12T17:39:45.607 INFO:teuthology.orchestra.run.smithi037.stderr: 73250K .......... .......... .......... .......... .......... 78% 200M 0s 2024-09-12T17:39:45.607 INFO:teuthology.orchestra.run.smithi037.stderr: 73300K .......... .......... .......... .......... .......... 78% 184M 0s 2024-09-12T17:39:45.607 INFO:teuthology.orchestra.run.smithi037.stderr: 73350K .......... .......... .......... .......... .......... 79% 194M 0s 2024-09-12T17:39:45.607 INFO:teuthology.orchestra.run.smithi037.stderr: 73400K .......... .......... .......... .......... .......... 79% 210M 0s 2024-09-12T17:39:45.607 INFO:teuthology.orchestra.run.smithi037.stderr: 73450K .......... .......... .......... .......... .......... 79% 196M 0s 2024-09-12T17:39:45.607 INFO:teuthology.orchestra.run.smithi037.stderr: 73500K .......... .......... .......... .......... .......... 79% 169M 0s 2024-09-12T17:39:45.607 INFO:teuthology.orchestra.run.smithi037.stderr: 73550K .......... .......... .......... .......... .......... 79% 198M 0s 2024-09-12T17:39:45.608 INFO:teuthology.orchestra.run.smithi037.stderr: 73600K .......... .......... .......... .......... .......... 79% 200M 0s 2024-09-12T17:39:45.608 INFO:teuthology.orchestra.run.smithi037.stderr: 73650K .......... .......... .......... .......... .......... 79% 198M 0s 2024-09-12T17:39:45.608 INFO:teuthology.orchestra.run.smithi037.stderr: 73700K .......... .......... .......... .......... .......... 79% 185M 0s 2024-09-12T17:39:45.608 INFO:teuthology.orchestra.run.smithi037.stderr: 73750K .......... .......... .......... .......... .......... 79% 193M 0s 2024-09-12T17:39:45.608 INFO:teuthology.orchestra.run.smithi037.stderr: 73800K .......... .......... .......... .......... .......... 79% 211M 0s 2024-09-12T17:39:45.608 INFO:teuthology.orchestra.run.smithi037.stderr: 73850K .......... .......... .......... .......... .......... 79% 184M 0s 2024-09-12T17:39:45.608 INFO:teuthology.orchestra.run.smithi037.stderr: 73900K .......... .......... .......... .......... .......... 79% 156M 0s 2024-09-12T17:39:45.608 INFO:teuthology.orchestra.run.smithi037.stderr: 73950K .......... .......... .......... .......... .......... 79% 194M 0s 2024-09-12T17:39:45.608 INFO:teuthology.orchestra.run.smithi037.stderr: 74000K .......... .......... .......... .......... .......... 79% 202M 0s 2024-09-12T17:39:45.608 INFO:teuthology.orchestra.run.smithi037.stderr: 74050K .......... .......... .......... .......... .......... 79% 199M 0s 2024-09-12T17:39:45.608 INFO:teuthology.orchestra.run.smithi037.stderr: 74100K .......... .......... .......... .......... .......... 79% 180M 0s 2024-09-12T17:39:45.608 INFO:teuthology.orchestra.run.smithi037.stderr: 74150K .......... .......... .......... .......... .......... 79% 206M 0s 2024-09-12T17:39:45.608 INFO:teuthology.orchestra.run.smithi037.stderr: 74200K .......... .......... .......... .......... .......... 79% 194M 0s 2024-09-12T17:39:45.608 INFO:teuthology.orchestra.run.smithi037.stderr: 74250K .......... .......... .......... .......... .......... 79% 203M 0s 2024-09-12T17:39:45.609 INFO:teuthology.orchestra.run.smithi037.stderr: 74300K .......... .......... .......... .......... .......... 80% 150M 0s 2024-09-12T17:39:45.609 INFO:teuthology.orchestra.run.smithi037.stderr: 74350K .......... .......... .......... .......... .......... 80% 216M 0s 2024-09-12T17:39:45.609 INFO:teuthology.orchestra.run.smithi037.stderr: 74400K .......... .......... .......... .......... .......... 80% 206M 0s 2024-09-12T17:39:45.609 INFO:teuthology.orchestra.run.smithi037.stderr: 74450K .......... .......... .......... .......... .......... 80% 191M 0s 2024-09-12T17:39:45.609 INFO:teuthology.orchestra.run.smithi037.stderr: 74500K .......... .......... .......... .......... .......... 80% 187M 0s 2024-09-12T17:39:45.609 INFO:teuthology.orchestra.run.smithi037.stderr: 74550K .......... .......... .......... .......... .......... 80% 202M 0s 2024-09-12T17:39:45.609 INFO:teuthology.orchestra.run.smithi037.stderr: 74600K .......... .......... .......... .......... .......... 80% 190M 0s 2024-09-12T17:39:45.609 INFO:teuthology.orchestra.run.smithi037.stderr: 74650K .......... .......... .......... .......... .......... 80% 199M 0s 2024-09-12T17:39:45.609 INFO:teuthology.orchestra.run.smithi037.stderr: 74700K .......... .......... .......... .......... .......... 80% 175M 0s 2024-09-12T17:39:45.609 INFO:teuthology.orchestra.run.smithi037.stderr: 74750K .......... .......... .......... .......... .......... 80% 205M 0s 2024-09-12T17:39:45.609 INFO:teuthology.orchestra.run.smithi037.stderr: 74800K .......... .......... .......... .......... .......... 80% 168M 0s 2024-09-12T17:39:45.609 INFO:teuthology.orchestra.run.smithi037.stderr: 74850K .......... .......... .......... .......... .......... 80% 184M 0s 2024-09-12T17:39:45.609 INFO:teuthology.orchestra.run.smithi037.stderr: 74900K .......... .......... .......... .......... .......... 80% 204M 0s 2024-09-12T17:39:45.609 INFO:teuthology.orchestra.run.smithi037.stderr: 74950K .......... .......... .......... .......... .......... 80% 196M 0s 2024-09-12T17:39:45.609 INFO:teuthology.orchestra.run.smithi037.stderr: 75000K .......... .......... .......... .......... .......... 80% 173M 0s 2024-09-12T17:39:45.610 INFO:teuthology.orchestra.run.smithi037.stderr: 75050K .......... .......... .......... .......... .......... 80% 204M 0s 2024-09-12T17:39:45.610 INFO:teuthology.orchestra.run.smithi037.stderr: 75100K .......... .......... .......... .......... .......... 80% 210M 0s 2024-09-12T17:39:45.610 INFO:teuthology.orchestra.run.smithi037.stderr: 75150K .......... .......... .......... .......... .......... 80% 205M 0s 2024-09-12T17:39:45.610 INFO:teuthology.orchestra.run.smithi037.stderr: 75200K .......... .......... .......... .......... .......... 81% 157M 0s 2024-09-12T17:39:45.610 INFO:teuthology.orchestra.run.smithi037.stderr: 75250K .......... .......... .......... .......... .......... 81% 199M 0s 2024-09-12T17:39:45.610 INFO:teuthology.orchestra.run.smithi037.stderr: 75300K .......... .......... .......... .......... .......... 81% 195M 0s 2024-09-12T17:39:45.610 INFO:teuthology.orchestra.run.smithi037.stderr: 75350K .......... .......... .......... .......... .......... 81% 216M 0s 2024-09-12T17:39:45.610 INFO:teuthology.orchestra.run.smithi037.stderr: 75400K .......... .......... .......... .......... .......... 81% 181M 0s 2024-09-12T17:39:45.610 INFO:teuthology.orchestra.run.smithi037.stderr: 75450K .......... .......... .......... .......... .......... 81% 204M 0s 2024-09-12T17:39:45.610 INFO:teuthology.orchestra.run.smithi037.stderr: 75500K .......... .......... .......... .......... .......... 81% 214M 0s 2024-09-12T17:39:45.610 INFO:teuthology.orchestra.run.smithi037.stderr: 75550K .......... .......... .......... .......... .......... 81% 200M 0s 2024-09-12T17:39:45.610 INFO:teuthology.orchestra.run.smithi037.stderr: 75600K .......... .......... .......... .......... .......... 81% 164M 0s 2024-09-12T17:39:45.610 INFO:teuthology.orchestra.run.smithi037.stderr: 75650K .......... .......... .......... .......... .......... 81% 194M 0s 2024-09-12T17:39:45.610 INFO:teuthology.orchestra.run.smithi037.stderr: 75700K .......... .......... .......... .......... .......... 81% 213M 0s 2024-09-12T17:39:45.610 INFO:teuthology.orchestra.run.smithi037.stderr: 75750K .......... .......... .......... .......... .......... 81% 208M 0s 2024-09-12T17:39:45.611 INFO:teuthology.orchestra.run.smithi037.stderr: 75800K .......... .......... .......... .......... .......... 81% 193M 0s 2024-09-12T17:39:45.611 INFO:teuthology.orchestra.run.smithi037.stderr: 75850K .......... .......... .......... .......... .......... 81% 197M 0s 2024-09-12T17:39:45.611 INFO:teuthology.orchestra.run.smithi037.stderr: 75900K .......... .......... .......... .......... .......... 81% 196M 0s 2024-09-12T17:39:45.611 INFO:teuthology.orchestra.run.smithi037.stderr: 75950K .......... .......... .......... .......... .......... 81% 202M 0s 2024-09-12T17:39:45.611 INFO:teuthology.orchestra.run.smithi037.stderr: 76000K .......... .......... .......... .......... .......... 81% 176M 0s 2024-09-12T17:39:45.611 INFO:teuthology.orchestra.run.smithi037.stderr: 76050K .......... .......... .......... .......... .......... 81% 191M 0s 2024-09-12T17:39:45.611 INFO:teuthology.orchestra.run.smithi037.stderr: 76100K .......... .......... .......... .......... .......... 81% 210M 0s 2024-09-12T17:39:45.611 INFO:teuthology.orchestra.run.smithi037.stderr: 76150K .......... .......... .......... .......... .......... 82% 212M 0s 2024-09-12T17:39:45.611 INFO:teuthology.orchestra.run.smithi037.stderr: 76200K .......... .......... .......... .......... .......... 82% 177M 0s 2024-09-12T17:39:45.611 INFO:teuthology.orchestra.run.smithi037.stderr: 76250K .......... .......... .......... .......... .......... 82% 201M 0s 2024-09-12T17:39:45.611 INFO:teuthology.orchestra.run.smithi037.stderr: 76300K .......... .......... .......... .......... .......... 82% 192M 0s 2024-09-12T17:39:45.611 INFO:teuthology.orchestra.run.smithi037.stderr: 76350K .......... .......... .......... .......... .......... 82% 201M 0s 2024-09-12T17:39:45.611 INFO:teuthology.orchestra.run.smithi037.stderr: 76400K .......... .......... .......... .......... .......... 82% 174M 0s 2024-09-12T17:39:45.611 INFO:teuthology.orchestra.run.smithi037.stderr: 76450K .......... .......... .......... .......... .......... 82% 205M 0s 2024-09-12T17:39:45.612 INFO:teuthology.orchestra.run.smithi037.stderr: 76500K .......... .......... .......... .......... .......... 82% 182M 0s 2024-09-12T17:39:45.612 INFO:teuthology.orchestra.run.smithi037.stderr: 76550K .......... .......... .......... .......... .......... 82% 204M 0s 2024-09-12T17:39:45.612 INFO:teuthology.orchestra.run.smithi037.stderr: 76600K .......... .......... .......... .......... .......... 82% 189M 0s 2024-09-12T17:39:45.612 INFO:teuthology.orchestra.run.smithi037.stderr: 76650K .......... .......... .......... .......... .......... 82% 193M 0s 2024-09-12T17:39:45.612 INFO:teuthology.orchestra.run.smithi037.stderr: 76700K .......... .......... .......... .......... .......... 82% 206M 0s 2024-09-12T17:39:45.612 INFO:teuthology.orchestra.run.smithi037.stderr: 76750K .......... .......... .......... .......... .......... 82% 198M 0s 2024-09-12T17:39:45.612 INFO:teuthology.orchestra.run.smithi037.stderr: 76800K .......... .......... .......... .......... .......... 82% 166M 0s 2024-09-12T17:39:45.612 INFO:teuthology.orchestra.run.smithi037.stderr: 76850K .......... .......... .......... .......... .......... 82% 201M 0s 2024-09-12T17:39:45.612 INFO:teuthology.orchestra.run.smithi037.stderr: 76900K .......... .......... .......... .......... .......... 82% 197M 0s 2024-09-12T17:39:45.612 INFO:teuthology.orchestra.run.smithi037.stderr: 76950K .......... .......... .......... .......... .......... 82% 204M 0s 2024-09-12T17:39:45.612 INFO:teuthology.orchestra.run.smithi037.stderr: 77000K .......... .......... .......... .......... .......... 82% 188M 0s 2024-09-12T17:39:45.612 INFO:teuthology.orchestra.run.smithi037.stderr: 77050K .......... .......... .......... .......... .......... 82% 196M 0s 2024-09-12T17:39:45.612 INFO:teuthology.orchestra.run.smithi037.stderr: 77100K .......... .......... .......... .......... .......... 83% 200M 0s 2024-09-12T17:39:45.612 INFO:teuthology.orchestra.run.smithi037.stderr: 77150K .......... .......... .......... .......... .......... 83% 207M 0s 2024-09-12T17:39:45.613 INFO:teuthology.orchestra.run.smithi037.stderr: 77200K .......... .......... .......... .......... .......... 83% 171M 0s 2024-09-12T17:39:45.613 INFO:teuthology.orchestra.run.smithi037.stderr: 77250K .......... .......... .......... .......... .......... 83% 213M 0s 2024-09-12T17:39:45.613 INFO:teuthology.orchestra.run.smithi037.stderr: 77300K .......... .......... .......... .......... .......... 83% 362M 0s 2024-09-12T17:39:45.613 INFO:teuthology.orchestra.run.smithi037.stderr: 77350K .......... .......... .......... .......... .......... 83% 367M 0s 2024-09-12T17:39:45.613 INFO:teuthology.orchestra.run.smithi037.stderr: 77400K .......... .......... .......... .......... .......... 83% 332M 0s 2024-09-12T17:39:45.613 INFO:teuthology.orchestra.run.smithi037.stderr: 77450K .......... .......... .......... .......... .......... 83% 352M 0s 2024-09-12T17:39:45.613 INFO:teuthology.orchestra.run.smithi037.stderr: 77500K .......... .......... .......... .......... .......... 83% 377M 0s 2024-09-12T17:39:45.613 INFO:teuthology.orchestra.run.smithi037.stderr: 77550K .......... .......... .......... .......... .......... 83% 327M 0s 2024-09-12T17:39:45.613 INFO:teuthology.orchestra.run.smithi037.stderr: 77600K .......... .......... .......... .......... .......... 83% 186M 0s 2024-09-12T17:39:45.613 INFO:teuthology.orchestra.run.smithi037.stderr: 77650K .......... .......... .......... .......... .......... 83% 359M 0s 2024-09-12T17:39:45.613 INFO:teuthology.orchestra.run.smithi037.stderr: 77700K .......... .......... .......... .......... .......... 83% 356M 0s 2024-09-12T17:39:45.613 INFO:teuthology.orchestra.run.smithi037.stderr: 77750K .......... .......... .......... .......... .......... 83% 376M 0s 2024-09-12T17:39:45.613 INFO:teuthology.orchestra.run.smithi037.stderr: 77800K .......... .......... .......... .......... .......... 83% 331M 0s 2024-09-12T17:39:45.613 INFO:teuthology.orchestra.run.smithi037.stderr: 77850K .......... .......... .......... .......... .......... 83% 346M 0s 2024-09-12T17:39:45.614 INFO:teuthology.orchestra.run.smithi037.stderr: 77900K .......... .......... .......... .......... .......... 83% 354M 0s 2024-09-12T17:39:45.614 INFO:teuthology.orchestra.run.smithi037.stderr: 77950K .......... .......... .......... .......... .......... 83% 376M 0s 2024-09-12T17:39:45.614 INFO:teuthology.orchestra.run.smithi037.stderr: 78000K .......... .......... .......... .......... .......... 84% 308M 0s 2024-09-12T17:39:45.614 INFO:teuthology.orchestra.run.smithi037.stderr: 78050K .......... .......... .......... .......... .......... 84% 383M 0s 2024-09-12T17:39:45.614 INFO:teuthology.orchestra.run.smithi037.stderr: 78100K .......... .......... .......... .......... .......... 84% 356M 0s 2024-09-12T17:39:45.614 INFO:teuthology.orchestra.run.smithi037.stderr: 78150K .......... .......... .......... .......... .......... 84% 365M 0s 2024-09-12T17:39:45.614 INFO:teuthology.orchestra.run.smithi037.stderr: 78200K .......... .......... .......... .......... .......... 84% 334M 0s 2024-09-12T17:39:45.614 INFO:teuthology.orchestra.run.smithi037.stderr: 78250K .......... .......... .......... .......... .......... 84% 355M 0s 2024-09-12T17:39:45.614 INFO:teuthology.orchestra.run.smithi037.stderr: 78300K .......... .......... .......... .......... .......... 84% 376M 0s 2024-09-12T17:39:45.614 INFO:teuthology.orchestra.run.smithi037.stderr: 78350K .......... .......... .......... .......... .......... 84% 376M 0s 2024-09-12T17:39:45.614 INFO:teuthology.orchestra.run.smithi037.stderr: 78400K .......... .......... .......... .......... .......... 84% 278M 0s 2024-09-12T17:39:45.614 INFO:teuthology.orchestra.run.smithi037.stderr: 78450K .......... .......... .......... .......... .......... 84% 369M 0s 2024-09-12T17:39:45.614 INFO:teuthology.orchestra.run.smithi037.stderr: 78500K .......... .......... .......... .......... .......... 84% 382M 0s 2024-09-12T17:39:45.614 INFO:teuthology.orchestra.run.smithi037.stderr: 78550K .......... .......... .......... .......... .......... 84% 366M 0s 2024-09-12T17:39:45.614 INFO:teuthology.orchestra.run.smithi037.stderr: 78600K .......... .......... .......... .......... .......... 84% 314M 0s 2024-09-12T17:39:45.615 INFO:teuthology.orchestra.run.smithi037.stderr: 78650K .......... .......... .......... .......... .......... 84% 373M 0s 2024-09-12T17:39:45.615 INFO:teuthology.orchestra.run.smithi037.stderr: 78700K .......... .......... .......... .......... .......... 84% 391M 0s 2024-09-12T17:39:45.615 INFO:teuthology.orchestra.run.smithi037.stderr: 78750K .......... .......... .......... .......... .......... 84% 380M 0s 2024-09-12T17:39:45.615 INFO:teuthology.orchestra.run.smithi037.stderr: 78800K .......... .......... .......... .......... .......... 84% 318M 0s 2024-09-12T17:39:45.615 INFO:teuthology.orchestra.run.smithi037.stderr: 78850K .......... .......... .......... .......... .......... 84% 384M 0s 2024-09-12T17:39:45.615 INFO:teuthology.orchestra.run.smithi037.stderr: 78900K .......... .......... .......... .......... .......... 84% 327M 0s 2024-09-12T17:39:45.615 INFO:teuthology.orchestra.run.smithi037.stderr: 78950K .......... .......... .......... .......... .......... 85% 364M 0s 2024-09-12T17:39:45.615 INFO:teuthology.orchestra.run.smithi037.stderr: 79000K .......... .......... .......... .......... .......... 85% 316M 0s 2024-09-12T17:39:45.615 INFO:teuthology.orchestra.run.smithi037.stderr: 79050K .......... .......... .......... .......... .......... 85% 369M 0s 2024-09-12T17:39:45.615 INFO:teuthology.orchestra.run.smithi037.stderr: 79100K .......... .......... .......... .......... .......... 85% 382M 0s 2024-09-12T17:39:45.615 INFO:teuthology.orchestra.run.smithi037.stderr: 79150K .......... .......... .......... .......... .......... 85% 386M 0s 2024-09-12T17:39:45.615 INFO:teuthology.orchestra.run.smithi037.stderr: 79200K .......... .......... .......... .......... .......... 85% 322M 0s 2024-09-12T17:39:45.615 INFO:teuthology.orchestra.run.smithi037.stderr: 79250K .......... .......... .......... .......... .......... 85% 382M 0s 2024-09-12T17:39:45.615 INFO:teuthology.orchestra.run.smithi037.stderr: 79300K .......... .......... .......... .......... .......... 85% 103M 0s 2024-09-12T17:39:45.615 INFO:teuthology.orchestra.run.smithi037.stderr: 79350K .......... .......... .......... .......... .......... 85% 364M 0s 2024-09-12T17:39:45.616 INFO:teuthology.orchestra.run.smithi037.stderr: 79400K .......... .......... .......... .......... .......... 85% 329M 0s 2024-09-12T17:39:45.616 INFO:teuthology.orchestra.run.smithi037.stderr: 79450K .......... .......... .......... .......... .......... 85% 379M 0s 2024-09-12T17:39:45.616 INFO:teuthology.orchestra.run.smithi037.stderr: 79500K .......... .......... .......... .......... .......... 85% 383M 0s 2024-09-12T17:39:45.616 INFO:teuthology.orchestra.run.smithi037.stderr: 79550K .......... .......... .......... .......... .......... 85% 318M 0s 2024-09-12T17:39:45.616 INFO:teuthology.orchestra.run.smithi037.stderr: 79600K .......... .......... .......... .......... .......... 85% 66.8M 0s 2024-09-12T17:39:45.616 INFO:teuthology.orchestra.run.smithi037.stderr: 79650K .......... .......... .......... .......... .......... 85% 323M 0s 2024-09-12T17:39:45.616 INFO:teuthology.orchestra.run.smithi037.stderr: 79700K .......... .......... .......... .......... .......... 85% 349M 0s 2024-09-12T17:39:45.616 INFO:teuthology.orchestra.run.smithi037.stderr: 79750K .......... .......... .......... .......... .......... 85% 303M 0s 2024-09-12T17:39:45.616 INFO:teuthology.orchestra.run.smithi037.stderr: 79800K .......... .......... .......... .......... .......... 85% 322M 0s 2024-09-12T17:39:45.616 INFO:teuthology.orchestra.run.smithi037.stderr: 79850K .......... .......... .......... .......... .......... 86% 383M 0s 2024-09-12T17:39:45.616 INFO:teuthology.orchestra.run.smithi037.stderr: 79900K .......... .......... .......... .......... .......... 86% 186M 0s 2024-09-12T17:39:45.616 INFO:teuthology.orchestra.run.smithi037.stderr: 79950K .......... .......... .......... .......... .......... 86% 100M 0s 2024-09-12T17:39:45.616 INFO:teuthology.orchestra.run.smithi037.stderr: 80000K .......... .......... .......... .......... .......... 86% 305M 0s 2024-09-12T17:39:45.616 INFO:teuthology.orchestra.run.smithi037.stderr: 80050K .......... .......... .......... .......... .......... 86% 147M 0s 2024-09-12T17:39:45.617 INFO:teuthology.orchestra.run.smithi037.stderr: 80100K .......... .......... .......... .......... .......... 86% 363M 0s 2024-09-12T17:39:45.617 INFO:teuthology.orchestra.run.smithi037.stderr: 80150K .......... .......... .......... .......... .......... 86% 385M 0s 2024-09-12T17:39:45.617 INFO:teuthology.orchestra.run.smithi037.stderr: 80200K .......... .......... .......... .......... .......... 86% 246M 0s 2024-09-12T17:39:45.617 INFO:teuthology.orchestra.run.smithi037.stderr: 80250K .......... .......... .......... .......... .......... 86% 144M 0s 2024-09-12T17:39:45.617 INFO:teuthology.orchestra.run.smithi037.stderr: 80300K .......... .......... .......... .......... .......... 86% 361M 0s 2024-09-12T17:39:45.617 INFO:teuthology.orchestra.run.smithi037.stderr: 80350K .......... .......... .......... .......... .......... 86% 94.9M 0s 2024-09-12T17:39:45.617 INFO:teuthology.orchestra.run.smithi037.stderr: 80400K .......... .......... .......... .......... .......... 86% 122M 0s 2024-09-12T17:39:45.617 INFO:teuthology.orchestra.run.smithi037.stderr: 80450K .......... .......... .......... .......... .......... 86% 149M 0s 2024-09-12T17:39:45.617 INFO:teuthology.orchestra.run.smithi037.stderr: 80500K .......... .......... .......... .......... .......... 86% 258M 0s 2024-09-12T17:39:45.617 INFO:teuthology.orchestra.run.smithi037.stderr: 80550K .......... .......... .......... .......... .......... 86% 354M 0s 2024-09-12T17:39:45.617 INFO:teuthology.orchestra.run.smithi037.stderr: 80600K .......... .......... .......... .......... .......... 86% 334M 0s 2024-09-12T17:39:45.617 INFO:teuthology.orchestra.run.smithi037.stderr: 80650K .......... .......... .......... .......... .......... 86% 368M 0s 2024-09-12T17:39:45.617 INFO:teuthology.orchestra.run.smithi037.stderr: 80700K .......... .......... .......... .......... .......... 86% 238M 0s 2024-09-12T17:39:45.617 INFO:teuthology.orchestra.run.smithi037.stderr: 80750K .......... .......... .......... .......... .......... 86% 360M 0s 2024-09-12T17:39:45.617 INFO:teuthology.orchestra.run.smithi037.stderr: 80800K .......... .......... .......... .......... .......... 87% 304M 0s 2024-09-12T17:39:45.618 INFO:teuthology.orchestra.run.smithi037.stderr: 80850K .......... .......... .......... .......... .......... 87% 341M 0s 2024-09-12T17:39:45.618 INFO:teuthology.orchestra.run.smithi037.stderr: 80900K .......... .......... .......... .......... .......... 87% 392M 0s 2024-09-12T17:39:45.618 INFO:teuthology.orchestra.run.smithi037.stderr: 80950K .......... .......... .......... .......... .......... 87% 364M 0s 2024-09-12T17:39:45.618 INFO:teuthology.orchestra.run.smithi037.stderr: 81000K .......... .......... .......... .......... .......... 87% 303M 0s 2024-09-12T17:39:45.618 INFO:teuthology.orchestra.run.smithi037.stderr: 81050K .......... .......... .......... .......... .......... 87% 377M 0s 2024-09-12T17:39:45.618 INFO:teuthology.orchestra.run.smithi037.stderr: 81100K .......... .......... .......... .......... .......... 87% 390M 0s 2024-09-12T17:39:45.618 INFO:teuthology.orchestra.run.smithi037.stderr: 81150K .......... .......... .......... .......... .......... 87% 305M 0s 2024-09-12T17:39:45.618 INFO:teuthology.orchestra.run.smithi037.stderr: 81200K .......... .......... .......... .......... .......... 87% 69.7M 0s 2024-09-12T17:39:45.618 INFO:teuthology.orchestra.run.smithi037.stderr: 81250K .......... .......... .......... .......... .......... 87% 236M 0s 2024-09-12T17:39:45.618 INFO:teuthology.orchestra.run.smithi037.stderr: 81300K .......... .......... .......... .......... .......... 87% 225M 0s 2024-09-12T17:39:45.618 INFO:teuthology.orchestra.run.smithi037.stderr: 81350K .......... .......... .......... .......... .......... 87% 238M 0s 2024-09-12T17:39:45.618 INFO:teuthology.orchestra.run.smithi037.stderr: 81400K .......... .......... .......... .......... .......... 87% 208M 0s 2024-09-12T17:39:45.618 INFO:teuthology.orchestra.run.smithi037.stderr: 81450K .......... .......... .......... .......... .......... 87% 229M 0s 2024-09-12T17:39:45.618 INFO:teuthology.orchestra.run.smithi037.stderr: 81500K .......... .......... .......... .......... .......... 87% 256M 0s 2024-09-12T17:39:45.619 INFO:teuthology.orchestra.run.smithi037.stderr: 81550K .......... .......... .......... .......... .......... 87% 337M 0s 2024-09-12T17:39:45.619 INFO:teuthology.orchestra.run.smithi037.stderr: 81600K .......... .......... .......... .......... .......... 87% 306M 0s 2024-09-12T17:39:45.619 INFO:teuthology.orchestra.run.smithi037.stderr: 81650K .......... .......... .......... .......... .......... 87% 358M 0s 2024-09-12T17:39:45.619 INFO:teuthology.orchestra.run.smithi037.stderr: 81700K .......... .......... .......... .......... .......... 87% 358M 0s 2024-09-12T17:39:45.619 INFO:teuthology.orchestra.run.smithi037.stderr: 81750K .......... .......... .......... .......... .......... 88% 363M 0s 2024-09-12T17:39:45.619 INFO:teuthology.orchestra.run.smithi037.stderr: 81800K .......... .......... .......... .......... .......... 88% 336M 0s 2024-09-12T17:39:45.619 INFO:teuthology.orchestra.run.smithi037.stderr: 81850K .......... .......... .......... .......... .......... 88% 376M 0s 2024-09-12T17:39:45.619 INFO:teuthology.orchestra.run.smithi037.stderr: 81900K .......... .......... .......... .......... .......... 88% 363M 0s 2024-09-12T17:39:45.619 INFO:teuthology.orchestra.run.smithi037.stderr: 81950K .......... .......... .......... .......... .......... 88% 321M 0s 2024-09-12T17:39:45.619 INFO:teuthology.orchestra.run.smithi037.stderr: 82000K .......... .......... .......... .......... .......... 88% 374M 0s 2024-09-12T17:39:45.619 INFO:teuthology.orchestra.run.smithi037.stderr: 82050K .......... .......... .......... .......... .......... 88% 392M 0s 2024-09-12T17:39:45.619 INFO:teuthology.orchestra.run.smithi037.stderr: 82100K .......... .......... .......... .......... .......... 88% 395M 0s 2024-09-12T17:39:45.619 INFO:teuthology.orchestra.run.smithi037.stderr: 82150K .......... .......... .......... .......... .......... 88% 346M 0s 2024-09-12T17:39:45.619 INFO:teuthology.orchestra.run.smithi037.stderr: 82200K .......... .......... .......... .......... .......... 88% 396M 0s 2024-09-12T17:39:45.619 INFO:teuthology.orchestra.run.smithi037.stderr: 82250K .......... .......... .......... .......... .......... 88% 404M 0s 2024-09-12T17:39:45.620 INFO:teuthology.orchestra.run.smithi037.stderr: 82300K .......... .......... .......... .......... .......... 88% 367M 0s 2024-09-12T17:39:45.620 INFO:teuthology.orchestra.run.smithi037.stderr: 82350K .......... .......... .......... .......... .......... 88% 312M 0s 2024-09-12T17:39:45.620 INFO:teuthology.orchestra.run.smithi037.stderr: 82400K .......... .......... .......... .......... .......... 88% 341M 0s 2024-09-12T17:39:45.620 INFO:teuthology.orchestra.run.smithi037.stderr: 82450K .......... .......... .......... .......... .......... 88% 379M 0s 2024-09-12T17:39:45.620 INFO:teuthology.orchestra.run.smithi037.stderr: 82500K .......... .......... .......... .......... .......... 88% 292M 0s 2024-09-12T17:39:45.620 INFO:teuthology.orchestra.run.smithi037.stderr: 82550K .......... .......... .......... .......... .......... 88% 346M 0s 2024-09-12T17:39:45.620 INFO:teuthology.orchestra.run.smithi037.stderr: 82600K .......... .......... .......... .......... .......... 88% 385M 0s 2024-09-12T17:39:45.620 INFO:teuthology.orchestra.run.smithi037.stderr: 82650K .......... .......... .......... .......... .......... 89% 275M 0s 2024-09-12T17:39:45.620 INFO:teuthology.orchestra.run.smithi037.stderr: 82700K .......... .......... .......... .......... .......... 89% 211M 0s 2024-09-12T17:39:45.620 INFO:teuthology.orchestra.run.smithi037.stderr: 82750K .......... .......... .......... .......... .......... 89% 142M 0s 2024-09-12T17:39:45.620 INFO:teuthology.orchestra.run.smithi037.stderr: 82800K .......... .......... .......... .......... .......... 89% 382M 0s 2024-09-12T17:39:45.620 INFO:teuthology.orchestra.run.smithi037.stderr: 82850K .......... .......... .......... .......... .......... 89% 370M 0s 2024-09-12T17:39:45.620 INFO:teuthology.orchestra.run.smithi037.stderr: 82900K .......... .......... .......... .......... .......... 89% 359M 0s 2024-09-12T17:39:45.620 INFO:teuthology.orchestra.run.smithi037.stderr: 82950K .......... .......... .......... .......... .......... 89% 337M 0s 2024-09-12T17:39:45.621 INFO:teuthology.orchestra.run.smithi037.stderr: 83000K .......... .......... .......... .......... .......... 89% 91.5M 0s 2024-09-12T17:39:45.621 INFO:teuthology.orchestra.run.smithi037.stderr: 83050K .......... .......... .......... .......... .......... 89% 118M 0s 2024-09-12T17:39:45.621 INFO:teuthology.orchestra.run.smithi037.stderr: 83100K .......... .......... .......... .......... .......... 89% 311M 0s 2024-09-12T17:39:45.621 INFO:teuthology.orchestra.run.smithi037.stderr: 83150K .......... .......... .......... .......... .......... 89% 252M 0s 2024-09-12T17:39:45.621 INFO:teuthology.orchestra.run.smithi037.stderr: 83200K .......... .......... .......... .......... .......... 89% 253M 0s 2024-09-12T17:39:45.621 INFO:teuthology.orchestra.run.smithi037.stderr: 83250K .......... .......... .......... .......... .......... 89% 214M 0s 2024-09-12T17:39:45.621 INFO:teuthology.orchestra.run.smithi037.stderr: 83300K .......... .......... .......... .......... .......... 89% 117M 0s 2024-09-12T17:39:45.621 INFO:teuthology.orchestra.run.smithi037.stderr: 83350K .......... .......... .......... .......... .......... 89% 309M 0s 2024-09-12T17:39:45.621 INFO:teuthology.orchestra.run.smithi037.stderr: 83400K .......... .......... .......... .......... .......... 89% 105M 0s 2024-09-12T17:39:45.621 INFO:teuthology.orchestra.run.smithi037.stderr: 83450K .......... .......... .......... .......... .......... 89% 108M 0s 2024-09-12T17:39:45.621 INFO:teuthology.orchestra.run.smithi037.stderr: 83500K .......... .......... .......... .......... .......... 89% 376M 0s 2024-09-12T17:39:45.621 INFO:teuthology.orchestra.run.smithi037.stderr: 83550K .......... .......... .......... .......... .......... 89% 78.2M 0s 2024-09-12T17:39:45.621 INFO:teuthology.orchestra.run.smithi037.stderr: 83600K .......... .......... .......... .......... .......... 90% 295M 0s 2024-09-12T17:39:45.621 INFO:teuthology.orchestra.run.smithi037.stderr: 83650K .......... .......... .......... .......... .......... 90% 377M 0s 2024-09-12T17:39:45.622 INFO:teuthology.orchestra.run.smithi037.stderr: 83700K .......... .......... .......... .......... .......... 90% 378M 0s 2024-09-12T17:39:45.622 INFO:teuthology.orchestra.run.smithi037.stderr: 83750K .......... .......... .......... .......... .......... 90% 356M 0s 2024-09-12T17:39:45.622 INFO:teuthology.orchestra.run.smithi037.stderr: 83800K .......... .......... .......... .......... .......... 90% 386M 0s 2024-09-12T17:39:45.622 INFO:teuthology.orchestra.run.smithi037.stderr: 83850K .......... .......... .......... .......... .......... 90% 327M 0s 2024-09-12T17:39:45.622 INFO:teuthology.orchestra.run.smithi037.stderr: 83900K .......... .......... .......... .......... .......... 90% 375M 0s 2024-09-12T17:39:45.622 INFO:teuthology.orchestra.run.smithi037.stderr: 83950K .......... .......... .......... .......... .......... 90% 313M 0s 2024-09-12T17:39:45.622 INFO:teuthology.orchestra.run.smithi037.stderr: 84000K .......... .......... .......... .......... .......... 90% 336M 0s 2024-09-12T17:39:45.622 INFO:teuthology.orchestra.run.smithi037.stderr: 84050K .......... .......... .......... .......... .......... 90% 389M 0s 2024-09-12T17:39:45.622 INFO:teuthology.orchestra.run.smithi037.stderr: 84100K .......... .......... .......... .......... .......... 90% 385M 0s 2024-09-12T17:39:45.622 INFO:teuthology.orchestra.run.smithi037.stderr: 84150K .......... .......... .......... .......... .......... 90% 347M 0s 2024-09-12T17:39:45.622 INFO:teuthology.orchestra.run.smithi037.stderr: 84200K .......... .......... .......... .......... .......... 90% 379M 0s 2024-09-12T17:39:45.622 INFO:teuthology.orchestra.run.smithi037.stderr: 84250K .......... .......... .......... .......... .......... 90% 167M 0s 2024-09-12T17:39:45.622 INFO:teuthology.orchestra.run.smithi037.stderr: 84300K .......... .......... .......... .......... .......... 90% 271M 0s 2024-09-12T17:39:45.622 INFO:teuthology.orchestra.run.smithi037.stderr: 84350K .......... .......... .......... .......... .......... 90% 140M 0s 2024-09-12T17:39:45.622 INFO:teuthology.orchestra.run.smithi037.stderr: 84400K .......... .......... .......... .......... .......... 90% 383M 0s 2024-09-12T17:39:45.623 INFO:teuthology.orchestra.run.smithi037.stderr: 84450K .......... .......... .......... .......... .......... 90% 171M 0s 2024-09-12T17:39:45.623 INFO:teuthology.orchestra.run.smithi037.stderr: 84500K .......... .......... .......... .......... .......... 91% 128M 0s 2024-09-12T17:39:45.623 INFO:teuthology.orchestra.run.smithi037.stderr: 84550K .......... .......... .......... .......... .......... 91% 326M 0s 2024-09-12T17:39:45.623 INFO:teuthology.orchestra.run.smithi037.stderr: 84600K .......... .......... .......... .......... .......... 91% 385M 0s 2024-09-12T17:39:45.623 INFO:teuthology.orchestra.run.smithi037.stderr: 84650K .......... .......... .......... .......... .......... 91% 225M 0s 2024-09-12T17:39:45.623 INFO:teuthology.orchestra.run.smithi037.stderr: 84700K .......... .......... .......... .......... .......... 91% 367M 0s 2024-09-12T17:39:45.623 INFO:teuthology.orchestra.run.smithi037.stderr: 84750K .......... .......... .......... .......... .......... 91% 318M 0s 2024-09-12T17:39:45.623 INFO:teuthology.orchestra.run.smithi037.stderr: 84800K .......... .......... .......... .......... .......... 91% 395M 0s 2024-09-12T17:39:45.623 INFO:teuthology.orchestra.run.smithi037.stderr: 84850K .......... .......... .......... .......... .......... 91% 378M 0s 2024-09-12T17:39:45.623 INFO:teuthology.orchestra.run.smithi037.stderr: 84900K .......... .......... .......... .......... .......... 91% 386M 0s 2024-09-12T17:39:45.623 INFO:teuthology.orchestra.run.smithi037.stderr: 84950K .......... .......... .......... .......... .......... 91% 351M 0s 2024-09-12T17:39:45.623 INFO:teuthology.orchestra.run.smithi037.stderr: 85000K .......... .......... .......... .......... .......... 91% 372M 0s 2024-09-12T17:39:45.623 INFO:teuthology.orchestra.run.smithi037.stderr: 85050K .......... .......... .......... .......... .......... 91% 267M 0s 2024-09-12T17:39:45.623 INFO:teuthology.orchestra.run.smithi037.stderr: 85100K .......... .......... .......... .......... .......... 91% 332M 0s 2024-09-12T17:39:45.623 INFO:teuthology.orchestra.run.smithi037.stderr: 85150K .......... .......... .......... .......... .......... 91% 296M 0s 2024-09-12T17:39:45.624 INFO:teuthology.orchestra.run.smithi037.stderr: 85200K .......... .......... .......... .......... .......... 91% 266M 0s 2024-09-12T17:39:45.624 INFO:teuthology.orchestra.run.smithi037.stderr: 85250K .......... .......... .......... .......... .......... 91% 326M 0s 2024-09-12T17:39:45.624 INFO:teuthology.orchestra.run.smithi037.stderr: 85300K .......... .......... .......... .......... .......... 91% 385M 0s 2024-09-12T17:39:45.624 INFO:teuthology.orchestra.run.smithi037.stderr: 85350K .......... .......... .......... .......... .......... 91% 347M 0s 2024-09-12T17:39:45.624 INFO:teuthology.orchestra.run.smithi037.stderr: 85400K .......... .......... .......... .......... .......... 91% 390M 0s 2024-09-12T17:39:45.624 INFO:teuthology.orchestra.run.smithi037.stderr: 85450K .......... .......... .......... .......... .......... 92% 388M 0s 2024-09-12T17:39:45.624 INFO:teuthology.orchestra.run.smithi037.stderr: 85500K .......... .......... .......... .......... .......... 92% 383M 0s 2024-09-12T17:39:45.624 INFO:teuthology.orchestra.run.smithi037.stderr: 85550K .......... .......... .......... .......... .......... 92% 220M 0s 2024-09-12T17:39:45.624 INFO:teuthology.orchestra.run.smithi037.stderr: 85600K .......... .......... .......... .......... .......... 92% 367M 0s 2024-09-12T17:39:45.624 INFO:teuthology.orchestra.run.smithi037.stderr: 85650K .......... .......... .......... .......... .......... 92% 383M 0s 2024-09-12T17:39:45.624 INFO:teuthology.orchestra.run.smithi037.stderr: 85700K .......... .......... .......... .......... .......... 92% 365M 0s 2024-09-12T17:39:45.624 INFO:teuthology.orchestra.run.smithi037.stderr: 85750K .......... .......... .......... .......... .......... 92% 357M 0s 2024-09-12T17:39:45.624 INFO:teuthology.orchestra.run.smithi037.stderr: 85800K .......... .......... .......... .......... .......... 92% 103M 0s 2024-09-12T17:39:45.624 INFO:teuthology.orchestra.run.smithi037.stderr: 85850K .......... .......... .......... .......... .......... 92% 383M 0s 2024-09-12T17:39:45.625 INFO:teuthology.orchestra.run.smithi037.stderr: 85900K .......... .......... .......... .......... .......... 92% 399M 0s 2024-09-12T17:39:45.625 INFO:teuthology.orchestra.run.smithi037.stderr: 85950K .......... .......... .......... .......... .......... 92% 301M 0s 2024-09-12T17:39:45.625 INFO:teuthology.orchestra.run.smithi037.stderr: 86000K .......... .......... .......... .......... .......... 92% 394M 0s 2024-09-12T17:39:45.625 INFO:teuthology.orchestra.run.smithi037.stderr: 86050K .......... .......... .......... .......... .......... 92% 182M 0s 2024-09-12T17:39:45.625 INFO:teuthology.orchestra.run.smithi037.stderr: 86100K .......... .......... .......... .......... .......... 92% 164M 0s 2024-09-12T17:39:45.625 INFO:teuthology.orchestra.run.smithi037.stderr: 86150K .......... .......... .......... .......... .......... 92% 180M 0s 2024-09-12T17:39:45.625 INFO:teuthology.orchestra.run.smithi037.stderr: 86200K .......... .......... .......... .......... .......... 92% 301M 0s 2024-09-12T17:39:45.625 INFO:teuthology.orchestra.run.smithi037.stderr: 86250K .......... .......... .......... .......... .......... 92% 135M 0s 2024-09-12T17:39:45.625 INFO:teuthology.orchestra.run.smithi037.stderr: 86300K .......... .......... .......... .......... .......... 92% 363M 0s 2024-09-12T17:39:45.625 INFO:teuthology.orchestra.run.smithi037.stderr: 86350K .......... .......... .......... .......... .......... 93% 265M 0s 2024-09-12T17:39:45.625 INFO:teuthology.orchestra.run.smithi037.stderr: 86400K .......... .......... .......... .......... .......... 93% 90.0M 0s 2024-09-12T17:39:45.625 INFO:teuthology.orchestra.run.smithi037.stderr: 86450K .......... .......... .......... .......... .......... 93% 322M 0s 2024-09-12T17:39:45.625 INFO:teuthology.orchestra.run.smithi037.stderr: 86500K .......... .......... .......... .......... .......... 93% 122M 0s 2024-09-12T17:39:45.625 INFO:teuthology.orchestra.run.smithi037.stderr: 86550K .......... .......... .......... .......... .......... 93% 110M 0s 2024-09-12T17:39:45.625 INFO:teuthology.orchestra.run.smithi037.stderr: 86600K .......... .......... .......... .......... .......... 93% 139M 0s 2024-09-12T17:39:45.626 INFO:teuthology.orchestra.run.smithi037.stderr: 86650K .......... .......... .......... .......... .......... 93% 375M 0s 2024-09-12T17:39:45.626 INFO:teuthology.orchestra.run.smithi037.stderr: 86700K .......... .......... .......... .......... .......... 93% 201M 0s 2024-09-12T17:39:45.626 INFO:teuthology.orchestra.run.smithi037.stderr: 86750K .......... .......... .......... .......... .......... 93% 315M 0s 2024-09-12T17:39:45.626 INFO:teuthology.orchestra.run.smithi037.stderr: 86800K .......... .......... .......... .......... .......... 93% 373M 0s 2024-09-12T17:39:45.626 INFO:teuthology.orchestra.run.smithi037.stderr: 86850K .......... .......... .......... .......... .......... 93% 245M 0s 2024-09-12T17:39:45.626 INFO:teuthology.orchestra.run.smithi037.stderr: 86900K .......... .......... .......... .......... .......... 93% 326M 0s 2024-09-12T17:39:45.626 INFO:teuthology.orchestra.run.smithi037.stderr: 86950K .......... .......... .......... .......... .......... 93% 315M 0s 2024-09-12T17:39:45.626 INFO:teuthology.orchestra.run.smithi037.stderr: 87000K .......... .......... .......... .......... .......... 93% 341M 0s 2024-09-12T17:39:45.626 INFO:teuthology.orchestra.run.smithi037.stderr: 87050K .......... .......... .......... .......... .......... 93% 105M 0s 2024-09-12T17:39:45.626 INFO:teuthology.orchestra.run.smithi037.stderr: 87100K .......... .......... .......... .......... .......... 93% 373M 0s 2024-09-12T17:39:45.626 INFO:teuthology.orchestra.run.smithi037.stderr: 87150K .......... .......... .......... .......... .......... 93% 362M 0s 2024-09-12T17:39:45.626 INFO:teuthology.orchestra.run.smithi037.stderr: 87200K .......... .......... .......... .......... .......... 93% 359M 0s 2024-09-12T17:39:45.626 INFO:teuthology.orchestra.run.smithi037.stderr: 87250K .......... .......... .......... .......... .......... 93% 316M 0s 2024-09-12T17:39:45.627 INFO:teuthology.orchestra.run.smithi037.stderr: 87300K .......... .......... .......... .......... .......... 94% 309M 0s 2024-09-12T17:39:45.627 INFO:teuthology.orchestra.run.smithi037.stderr: 87350K .......... .......... .......... .......... .......... 94% 351M 0s 2024-09-12T17:39:45.627 INFO:teuthology.orchestra.run.smithi037.stderr: 87400K .......... .......... .......... .......... .......... 94% 363M 0s 2024-09-12T17:39:45.627 INFO:teuthology.orchestra.run.smithi037.stderr: 87450K .......... .......... .......... .......... .......... 94% 287M 0s 2024-09-12T17:39:45.627 INFO:teuthology.orchestra.run.smithi037.stderr: 87500K .......... .......... .......... .......... .......... 94% 373M 0s 2024-09-12T17:39:45.627 INFO:teuthology.orchestra.run.smithi037.stderr: 87550K .......... .......... .......... .......... .......... 94% 84.4M 0s 2024-09-12T17:39:45.627 INFO:teuthology.orchestra.run.smithi037.stderr: 87600K .......... .......... .......... .......... .......... 94% 357M 0s 2024-09-12T17:39:45.627 INFO:teuthology.orchestra.run.smithi037.stderr: 87650K .......... .......... .......... .......... .......... 94% 344M 0s 2024-09-12T17:39:45.627 INFO:teuthology.orchestra.run.smithi037.stderr: 87700K .......... .......... .......... .......... .......... 94% 382M 0s 2024-09-12T17:39:45.627 INFO:teuthology.orchestra.run.smithi037.stderr: 87750K .......... .......... .......... .......... .......... 94% 352M 0s 2024-09-12T17:39:45.627 INFO:teuthology.orchestra.run.smithi037.stderr: 87800K .......... .......... .......... .......... .......... 94% 388M 0s 2024-09-12T17:39:45.627 INFO:teuthology.orchestra.run.smithi037.stderr: 87850K .......... .......... .......... .......... .......... 94% 308M 0s 2024-09-12T17:39:45.627 INFO:teuthology.orchestra.run.smithi037.stderr: 87900K .......... .......... .......... .......... .......... 94% 368M 0s 2024-09-12T17:39:45.627 INFO:teuthology.orchestra.run.smithi037.stderr: 87950K .......... .......... .......... .......... .......... 94% 339M 0s 2024-09-12T17:39:45.628 INFO:teuthology.orchestra.run.smithi037.stderr: 88000K .......... .......... .......... .......... .......... 94% 388M 0s 2024-09-12T17:39:45.628 INFO:teuthology.orchestra.run.smithi037.stderr: 88050K .......... .......... .......... .......... .......... 94% 327M 0s 2024-09-12T17:39:45.628 INFO:teuthology.orchestra.run.smithi037.stderr: 88100K .......... .......... .......... .......... .......... 94% 384M 0s 2024-09-12T17:39:45.628 INFO:teuthology.orchestra.run.smithi037.stderr: 88150K .......... .......... .......... .......... .......... 94% 362M 0s 2024-09-12T17:39:45.628 INFO:teuthology.orchestra.run.smithi037.stderr: 88200K .......... .......... .......... .......... .......... 94% 223M 0s 2024-09-12T17:39:45.628 INFO:teuthology.orchestra.run.smithi037.stderr: 88250K .......... .......... .......... .......... .......... 95% 320M 0s 2024-09-12T17:39:45.628 INFO:teuthology.orchestra.run.smithi037.stderr: 88300K .......... .......... .......... .......... .......... 95% 379M 0s 2024-09-12T17:39:45.628 INFO:teuthology.orchestra.run.smithi037.stderr: 88350K .......... .......... .......... .......... .......... 95% 394M 0s 2024-09-12T17:39:45.628 INFO:teuthology.orchestra.run.smithi037.stderr: 88400K .......... .......... .......... .......... .......... 95% 324M 0s 2024-09-12T17:39:45.628 INFO:teuthology.orchestra.run.smithi037.stderr: 88450K .......... .......... .......... .......... .......... 95% 316M 0s 2024-09-12T17:39:45.628 INFO:teuthology.orchestra.run.smithi037.stderr: 88500K .......... .......... .......... .......... .......... 95% 390M 0s 2024-09-12T17:39:45.628 INFO:teuthology.orchestra.run.smithi037.stderr: 88550K .......... .......... .......... .......... .......... 95% 156M 0s 2024-09-12T17:39:45.628 INFO:teuthology.orchestra.run.smithi037.stderr: 88600K .......... .......... .......... .......... .......... 95% 334M 0s 2024-09-12T17:39:45.628 INFO:teuthology.orchestra.run.smithi037.stderr: 88650K .......... .......... .......... .......... .......... 95% 268M 0s 2024-09-12T17:39:45.629 INFO:teuthology.orchestra.run.smithi037.stderr: 88700K .......... .......... .......... .......... .......... 95% 191M 0s 2024-09-12T17:39:45.629 INFO:teuthology.orchestra.run.smithi037.stderr: 88750K .......... .......... .......... .......... .......... 95% 296M 0s 2024-09-12T17:39:45.629 INFO:teuthology.orchestra.run.smithi037.stderr: 88800K .......... .......... .......... .......... .......... 95% 122M 0s 2024-09-12T17:39:45.629 INFO:teuthology.orchestra.run.smithi037.stderr: 88850K .......... .......... .......... .......... .......... 95% 350M 0s 2024-09-12T17:39:45.629 INFO:teuthology.orchestra.run.smithi037.stderr: 88900K .......... .......... .......... .......... .......... 95% 275M 0s 2024-09-12T17:39:45.629 INFO:teuthology.orchestra.run.smithi037.stderr: 88950K .......... .......... .......... .......... .......... 95% 307M 0s 2024-09-12T17:39:45.629 INFO:teuthology.orchestra.run.smithi037.stderr: 89000K .......... .......... .......... .......... .......... 95% 368M 0s 2024-09-12T17:39:45.629 INFO:teuthology.orchestra.run.smithi037.stderr: 89050K .......... .......... .......... .......... .......... 95% 319M 0s 2024-09-12T17:39:45.629 INFO:teuthology.orchestra.run.smithi037.stderr: 89100K .......... .......... .......... .......... .......... 95% 378M 0s 2024-09-12T17:39:45.629 INFO:teuthology.orchestra.run.smithi037.stderr: 89150K .......... .......... .......... .......... .......... 96% 384M 0s 2024-09-12T17:39:45.629 INFO:teuthology.orchestra.run.smithi037.stderr: 89200K .......... .......... .......... .......... .......... 96% 396M 0s 2024-09-12T17:39:45.629 INFO:teuthology.orchestra.run.smithi037.stderr: 89250K .......... .......... .......... .......... .......... 96% 136M 0s 2024-09-12T17:39:45.629 INFO:teuthology.orchestra.run.smithi037.stderr: 89300K .......... .......... .......... .......... .......... 96% 193M 0s 2024-09-12T17:39:45.629 INFO:teuthology.orchestra.run.smithi037.stderr: 89350K .......... .......... .......... .......... .......... 96% 387M 0s 2024-09-12T17:39:45.629 INFO:teuthology.orchestra.run.smithi037.stderr: 89400K .......... .......... .......... .......... .......... 96% 339M 0s 2024-09-12T17:39:45.630 INFO:teuthology.orchestra.run.smithi037.stderr: 89450K .......... .......... .......... .......... .......... 96% 85.6M 0s 2024-09-12T17:39:45.630 INFO:teuthology.orchestra.run.smithi037.stderr: 89500K .......... .......... .......... .......... .......... 96% 368M 0s 2024-09-12T17:39:45.630 INFO:teuthology.orchestra.run.smithi037.stderr: 89550K .......... .......... .......... .......... .......... 96% 70.9M 0s 2024-09-12T17:39:45.630 INFO:teuthology.orchestra.run.smithi037.stderr: 89600K .......... .......... .......... .......... .......... 96% 107M 0s 2024-09-12T17:39:45.630 INFO:teuthology.orchestra.run.smithi037.stderr: 89650K .......... .......... .......... .......... .......... 96% 189M 0s 2024-09-12T17:39:45.630 INFO:teuthology.orchestra.run.smithi037.stderr: 89700K .......... .......... .......... .......... .......... 96% 375M 0s 2024-09-12T17:39:45.630 INFO:teuthology.orchestra.run.smithi037.stderr: 89750K .......... .......... .......... .......... .......... 96% 298M 0s 2024-09-12T17:39:45.630 INFO:teuthology.orchestra.run.smithi037.stderr: 89800K .......... .......... .......... .......... .......... 96% 295M 0s 2024-09-12T17:39:45.630 INFO:teuthology.orchestra.run.smithi037.stderr: 89850K .......... .......... .......... .......... .......... 96% 279M 0s 2024-09-12T17:39:45.630 INFO:teuthology.orchestra.run.smithi037.stderr: 89900K .......... .......... .......... .......... .......... 96% 80.0M 0s 2024-09-12T17:39:45.630 INFO:teuthology.orchestra.run.smithi037.stderr: 89950K .......... .......... .......... .......... .......... 96% 58.3M 0s 2024-09-12T17:39:45.630 INFO:teuthology.orchestra.run.smithi037.stderr: 90000K .......... .......... .......... .......... .......... 96% 217M 0s 2024-09-12T17:39:45.630 INFO:teuthology.orchestra.run.smithi037.stderr: 90050K .......... .......... .......... .......... .......... 96% 274M 0s 2024-09-12T17:39:45.630 INFO:teuthology.orchestra.run.smithi037.stderr: 90100K .......... .......... .......... .......... .......... 97% 267M 0s 2024-09-12T17:39:45.631 INFO:teuthology.orchestra.run.smithi037.stderr: 90150K .......... .......... .......... .......... .......... 97% 388M 0s 2024-09-12T17:39:45.631 INFO:teuthology.orchestra.run.smithi037.stderr: 90200K .......... .......... .......... .......... .......... 97% 121M 0s 2024-09-12T17:39:45.631 INFO:teuthology.orchestra.run.smithi037.stderr: 90250K .......... .......... .......... .......... .......... 97% 168M 0s 2024-09-12T17:39:45.631 INFO:teuthology.orchestra.run.smithi037.stderr: 90300K .......... .......... .......... .......... .......... 97% 271M 0s 2024-09-12T17:39:45.631 INFO:teuthology.orchestra.run.smithi037.stderr: 90350K .......... .......... .......... .......... .......... 97% 371M 0s 2024-09-12T17:39:45.631 INFO:teuthology.orchestra.run.smithi037.stderr: 90400K .......... .......... .......... .......... .......... 97% 383M 0s 2024-09-12T17:39:45.631 INFO:teuthology.orchestra.run.smithi037.stderr: 90450K .......... .......... .......... .......... .......... 97% 359M 0s 2024-09-12T17:39:45.631 INFO:teuthology.orchestra.run.smithi037.stderr: 90500K .......... .......... .......... .......... .......... 97% 380M 0s 2024-09-12T17:39:45.631 INFO:teuthology.orchestra.run.smithi037.stderr: 90550K .......... .......... .......... .......... .......... 97% 294M 0s 2024-09-12T17:39:45.631 INFO:teuthology.orchestra.run.smithi037.stderr: 90600K .......... .......... .......... .......... .......... 97% 386M 0s 2024-09-12T17:39:45.631 INFO:teuthology.orchestra.run.smithi037.stderr: 90650K .......... .......... .......... .......... .......... 97% 250M 0s 2024-09-12T17:39:45.631 INFO:teuthology.orchestra.run.smithi037.stderr: 90700K .......... .......... .......... .......... .......... 97% 321M 0s 2024-09-12T17:39:45.631 INFO:teuthology.orchestra.run.smithi037.stderr: 90750K .......... .......... .......... .......... .......... 97% 392M 0s 2024-09-12T17:39:45.631 INFO:teuthology.orchestra.run.smithi037.stderr: 90800K .......... .......... .......... .......... .......... 97% 84.8M 0s 2024-09-12T17:39:45.631 INFO:teuthology.orchestra.run.smithi037.stderr: 90850K .......... .......... .......... .......... .......... 97% 297M 0s 2024-09-12T17:39:45.632 INFO:teuthology.orchestra.run.smithi037.stderr: 90900K .......... .......... .......... .......... .......... 97% 347M 0s 2024-09-12T17:39:45.632 INFO:teuthology.orchestra.run.smithi037.stderr: 90950K .......... .......... .......... .......... .......... 97% 283M 0s 2024-09-12T17:39:45.632 INFO:teuthology.orchestra.run.smithi037.stderr: 91000K .......... .......... .......... .......... .......... 98% 264M 0s 2024-09-12T17:39:45.632 INFO:teuthology.orchestra.run.smithi037.stderr: 91050K .......... .......... .......... .......... .......... 98% 147M 0s 2024-09-12T17:39:45.632 INFO:teuthology.orchestra.run.smithi037.stderr: 91100K .......... .......... .......... .......... .......... 98% 202M 0s 2024-09-12T17:39:45.632 INFO:teuthology.orchestra.run.smithi037.stderr: 91150K .......... .......... .......... .......... .......... 98% 163M 0s 2024-09-12T17:39:45.632 INFO:teuthology.orchestra.run.smithi037.stderr: 91200K .......... .......... .......... .......... .......... 98% 381M 0s 2024-09-12T17:39:45.632 INFO:teuthology.orchestra.run.smithi037.stderr: 91250K .......... .......... .......... .......... .......... 98% 331M 0s 2024-09-12T17:39:45.632 INFO:teuthology.orchestra.run.smithi037.stderr: 91300K .......... .......... .......... .......... .......... 98% 297M 0s 2024-09-12T17:39:45.632 INFO:teuthology.orchestra.run.smithi037.stderr: 91350K .......... .......... .......... .......... .......... 98% 271M 0s 2024-09-12T17:39:45.632 INFO:teuthology.orchestra.run.smithi037.stderr: 91400K .......... .......... .......... .......... .......... 98% 383M 0s 2024-09-12T17:39:45.632 INFO:teuthology.orchestra.run.smithi037.stderr: 91450K .......... .......... .......... .......... .......... 98% 320M 0s 2024-09-12T17:39:45.632 INFO:teuthology.orchestra.run.smithi037.stderr: 91500K .......... .......... .......... .......... .......... 98% 138M 0s 2024-09-12T17:39:45.632 INFO:teuthology.orchestra.run.smithi037.stderr: 91550K .......... .......... .......... .......... .......... 98% 382M 0s 2024-09-12T17:39:45.633 INFO:teuthology.orchestra.run.smithi037.stderr: 91600K .......... .......... .......... .......... .......... 98% 393M 0s 2024-09-12T17:39:45.633 INFO:teuthology.orchestra.run.smithi037.stderr: 91650K .......... .......... .......... .......... .......... 98% 252M 0s 2024-09-12T17:39:45.633 INFO:teuthology.orchestra.run.smithi037.stderr: 91700K .......... .......... .......... .......... .......... 98% 318M 0s 2024-09-12T17:39:45.633 INFO:teuthology.orchestra.run.smithi037.stderr: 91750K .......... .......... .......... .......... .......... 98% 371M 0s 2024-09-12T17:39:45.633 INFO:teuthology.orchestra.run.smithi037.stderr: 91800K .......... .......... .......... .......... .......... 98% 391M 0s 2024-09-12T17:39:45.633 INFO:teuthology.orchestra.run.smithi037.stderr: 91850K .......... .......... .......... .......... .......... 98% 280M 0s 2024-09-12T17:39:45.633 INFO:teuthology.orchestra.run.smithi037.stderr: 91900K .......... .......... .......... .......... .......... 98% 214M 0s 2024-09-12T17:39:45.633 INFO:teuthology.orchestra.run.smithi037.stderr: 91950K .......... .......... .......... .......... .......... 99% 294M 0s 2024-09-12T17:39:45.633 INFO:teuthology.orchestra.run.smithi037.stderr: 92000K .......... .......... .......... .......... .......... 99% 366M 0s 2024-09-12T17:39:45.633 INFO:teuthology.orchestra.run.smithi037.stderr: 92050K .......... .......... .......... .......... .......... 99% 113M 0s 2024-09-12T17:39:45.633 INFO:teuthology.orchestra.run.smithi037.stderr: 92100K .......... .......... .......... .......... .......... 99% 374M 0s 2024-09-12T17:39:45.633 INFO:teuthology.orchestra.run.smithi037.stderr: 92150K .......... .......... .......... .......... .......... 99% 384M 0s 2024-09-12T17:39:45.633 INFO:teuthology.orchestra.run.smithi037.stderr: 92200K .......... .......... .......... .......... .......... 99% 352M 0s 2024-09-12T17:39:45.633 INFO:teuthology.orchestra.run.smithi037.stderr: 92250K .......... .......... .......... .......... .......... 99% 381M 0s 2024-09-12T17:39:45.634 INFO:teuthology.orchestra.run.smithi037.stderr: 92300K .......... .......... .......... .......... .......... 99% 399M 0s 2024-09-12T17:39:45.634 INFO:teuthology.orchestra.run.smithi037.stderr: 92350K .......... .......... .......... .......... .......... 99% 314M 0s 2024-09-12T17:39:45.634 INFO:teuthology.orchestra.run.smithi037.stderr: 92400K .......... .......... .......... .......... .......... 99% 368M 0s 2024-09-12T17:39:45.634 INFO:teuthology.orchestra.run.smithi037.stderr: 92450K .......... .......... .......... .......... .......... 99% 309M 0s 2024-09-12T17:39:45.634 INFO:teuthology.orchestra.run.smithi037.stderr: 92500K .......... .......... .......... .......... .......... 99% 366M 0s 2024-09-12T17:39:45.634 INFO:teuthology.orchestra.run.smithi037.stderr: 92550K .......... .......... .......... .......... .......... 99% 331M 0s 2024-09-12T17:39:45.634 INFO:teuthology.orchestra.run.smithi037.stderr: 92600K .......... .......... .......... .......... .......... 99% 95.6M 0s 2024-09-12T17:39:45.634 INFO:teuthology.orchestra.run.smithi037.stderr: 92650K .......... .......... .......... .......... .......... 99% 121M 0s 2024-09-12T17:39:45.634 INFO:teuthology.orchestra.run.smithi037.stderr: 92700K .......... .......... .......... .......... .......... 99% 381M 0s 2024-09-12T17:39:45.634 INFO:teuthology.orchestra.run.smithi037.stderr: 92750K .......... .......... .......... .......... .......... 99% 207M 0s 2024-09-12T17:39:45.634 INFO:teuthology.orchestra.run.smithi037.stderr: 92800K .......... .......... .......... .......... .......... 99% 368M 0s 2024-09-12T17:39:45.634 INFO:teuthology.orchestra.run.smithi037.stderr: 92850K .......... .......... .......... .......... .......... 99% 177M 0s 2024-09-12T17:39:45.634 INFO:teuthology.orchestra.run.smithi037.stderr: 92900K 100% 134G=0.4s 2024-09-12T17:39:45.634 INFO:teuthology.orchestra.run.smithi037.stderr: 2024-09-12T17:39:45.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12 17:39:44 (202 MB/s) - ‘gradle-6.0.1-bin.zip’ saved [95129672/95129672] 2024-09-12T17:39:45.635 INFO:teuthology.orchestra.run.smithi037.stderr: 2024-09-12T17:39:45.673 INFO:teuthology.orchestra.run.smithi037.stdout:Archive: gradle-6.0.1-bin.zip 2024-09-12T17:39:45.673 INFO:teuthology.orchestra.run.smithi037.stdout: creating: /opt/gradle/gradle-6.0.1/ 2024-09-12T17:39:45.673 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/getting-started.html 2024-09-12T17:39:45.673 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/LICENSE 2024-09-12T17:39:45.673 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/NOTICE 2024-09-12T17:39:45.673 INFO:teuthology.orchestra.run.smithi037.stdout: creating: /opt/gradle/gradle-6.0.1/init.d/ 2024-09-12T17:39:45.674 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/init.d/readme.txt 2024-09-12T17:39:45.674 INFO:teuthology.orchestra.run.smithi037.stdout: creating: /opt/gradle/gradle-6.0.1/bin/ 2024-09-12T17:39:45.674 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/bin/gradle 2024-09-12T17:39:45.674 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/bin/gradle.bat 2024-09-12T17:39:45.674 INFO:teuthology.orchestra.run.smithi037.stdout: creating: /opt/gradle/gradle-6.0.1/lib/ 2024-09-12T17:39:45.674 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-api-metadata-6.0.1.jar 2024-09-12T17:39:45.674 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-launcher-6.0.1.jar 2024-09-12T17:39:45.674 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-runtime-api-info-6.0.1.jar 2024-09-12T17:39:45.674 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-kotlin-dsl-6.0.1.jar 2024-09-12T17:39:45.674 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-tooling-api-6.0.1.jar 2024-09-12T17:39:45.674 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-wrapper-6.0.1.jar 2024-09-12T17:39:45.674 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-installation-beacon-6.0.1.jar 2024-09-12T17:39:45.674 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-bootstrap-6.0.1.jar 2024-09-12T17:39:45.674 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-core-6.0.1.jar 2024-09-12T17:39:45.675 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-file-collections-6.0.1.jar 2024-09-12T17:39:45.675 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-model-groovy-6.0.1.jar 2024-09-12T17:39:45.675 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-execution-6.0.1.jar 2024-09-12T17:39:45.675 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-model-core-6.0.1.jar 2024-09-12T17:39:45.675 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-cache-packaging-6.0.1.jar 2024-09-12T17:39:45.675 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-cache-6.0.1.jar 2024-09-12T17:39:45.675 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-core-api-6.0.1.jar 2024-09-12T17:39:45.675 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-persistent-cache-6.0.1.jar 2024-09-12T17:39:45.675 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-worker-processes-6.0.1.jar 2024-09-12T17:39:45.675 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-logging-6.0.1.jar 2024-09-12T17:39:45.675 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-jvm-services-6.0.1.jar 2024-09-12T17:39:45.675 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-process-services-6.0.1.jar 2024-09-12T17:39:45.675 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-resources-6.0.1.jar 2024-09-12T17:39:45.676 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-messaging-6.0.1.jar 2024-09-12T17:39:45.676 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-native-6.0.1.jar 2024-09-12T17:39:45.676 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-base-services-groovy-6.0.1.jar 2024-09-12T17:39:45.676 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-base-services-6.0.1.jar 2024-09-12T17:39:45.676 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-option-6.0.1.jar 2024-09-12T17:39:45.676 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-cli-6.0.1.jar 2024-09-12T17:39:45.676 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-snapshots-6.0.1.jar 2024-09-12T17:39:45.676 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-files-6.0.1.jar 2024-09-12T17:39:45.676 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-kotlin-dsl-tooling-models-6.0.1.jar 2024-09-12T17:39:45.676 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-compiler-embeddable-1.3.50-patched-for-gradle-6.0.1.jar 2024-09-12T17:39:45.676 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-hashing-6.0.1.jar 2024-09-12T17:39:45.676 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-pineapple-6.0.1.jar 2024-09-12T17:39:45.676 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-docs-6.0.1.jar 2024-09-12T17:39:45.676 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/groovy-all-1.3-2.5.8.jar 2024-09-12T17:39:45.677 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jul-to-slf4j-1.7.28.jar 2024-09-12T17:39:45.677 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/log4j-over-slf4j-1.7.28.jar 2024-09-12T17:39:45.677 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jcl-over-slf4j-1.7.28.jar 2024-09-12T17:39:45.677 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/slf4j-api-1.7.28.jar 2024-09-12T17:39:45.677 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/guava-27.1-android.jar 2024-09-12T17:39:45.677 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-io-2.6.jar 2024-09-12T17:39:45.677 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-lang-2.6.jar 2024-09-12T17:39:45.677 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-commons-7.1.jar 2024-09-12T17:39:45.677 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-analysis-7.1.jar 2024-09-12T17:39:45.677 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-tree-7.1.jar 2024-09-12T17:39:45.677 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-7.1.jar 2024-09-12T17:39:45.677 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/ant-1.10.7.jar 2024-09-12T17:39:45.677 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-jdk8-1.3.50.jar 2024-09-12T17:39:45.677 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/javax.inject-1.jar 2024-09-12T17:39:45.678 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-common-1.3.50.jar 2024-09-12T17:39:45.678 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-jvm-1.3.50.jar 2024-09-12T17:39:45.678 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-jvm-host-embeddable-1.3.50.jar 2024-09-12T17:39:45.678 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-compiler-embeddable-1.3.50.jar 2024-09-12T17:39:45.678 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-compiler-impl-embeddable-1.3.50.jar 2024-09-12T17:39:45.678 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-sam-with-receiver-compiler-plugin-1.3.50.jar 2024-09-12T17:39:45.678 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlinx-metadata-jvm-0.1.0.jar 2024-09-12T17:39:45.678 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-compress-1.19.jar 2024-09-12T17:39:45.678 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/fastutil-8.3.0-min.jar 2024-09-12T17:39:45.678 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jansi-1.18.jar 2024-09-12T17:39:45.678 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jsr305-3.0.2.jar 2024-09-12T17:39:45.678 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kryo-2.24.0.jar 2024-09-12T17:39:45.678 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-0.18.jar 2024-09-12T17:39:45.678 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/objenesis-2.6.jar 2024-09-12T17:39:45.679 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/trove4j-1.0.20181211.jar 2024-09-12T17:39:45.679 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/xml-apis-1.4.01.jar 2024-09-12T17:39:45.679 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-reflect-1.3.50.jar 2024-09-12T17:39:45.679 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-jdk7-1.3.50.jar 2024-09-12T17:39:45.679 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-1.3.50.jar 2024-09-12T17:39:45.679 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/annotations-13.0.jar 2024-09-12T17:39:45.679 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/ant-launcher-1.10.7.jar 2024-09-12T17:39:45.679 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/minlog-1.2.jar 2024-09-12T17:39:45.679 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-script-runtime-1.3.50.jar 2024-09-12T17:39:45.679 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-daemon-embeddable-1.3.50.jar 2024-09-12T17:39:45.679 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/failureaccess-1.0.1.jar 2024-09-12T17:39:45.679 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-common-1.3.50.jar 2024-09-12T17:39:45.679 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-amd64-libcpp-0.18.jar 2024-09-12T17:39:45.679 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-amd64-libstdcpp-0.18.jar 2024-09-12T17:39:45.680 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-i386-libcpp-0.18.jar 2024-09-12T17:39:45.680 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-i386-libstdcpp-0.18.jar 2024-09-12T17:39:45.680 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-aarch64-0.18.jar 2024-09-12T17:39:45.680 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-0.18.jar 2024-09-12T17:39:45.680 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-0.18.jar 2024-09-12T17:39:45.680 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-osx-amd64-0.18.jar 2024-09-12T17:39:45.680 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-amd64-0.18.jar 2024-09-12T17:39:45.680 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-amd64-min-0.18.jar 2024-09-12T17:39:45.680 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-i386-0.18.jar 2024-09-12T17:39:45.680 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-i386-min-0.18.jar 2024-09-12T17:39:45.680 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-aarch64-ncurses5-0.18.jar 2024-09-12T17:39:45.680 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-ncurses5-0.18.jar 2024-09-12T17:39:45.680 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-ncurses6-0.18.jar 2024-09-12T17:39:45.680 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-ncurses5-0.18.jar 2024-09-12T17:39:45.681 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-ncurses6-0.18.jar 2024-09-12T17:39:45.681 INFO:teuthology.orchestra.run.smithi037.stdout: creating: /opt/gradle/gradle-6.0.1/lib/plugins/ 2024-09-12T17:39:45.681 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-antlr-6.0.1.jar 2024-09-12T17:39:45.681 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-code-quality-6.0.1.jar 2024-09-12T17:39:45.681 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-signing-6.0.1.jar 2024-09-12T17:39:45.681 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-tooling-native-6.0.1.jar 2024-09-12T17:39:45.681 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-native-6.0.1.jar 2024-09-12T17:39:45.681 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-native-6.0.1.jar 2024-09-12T17:39:45.681 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-native-6.0.1.jar 2024-09-12T17:39:45.681 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-kotlin-dsl-provider-plugins-6.0.1.jar 2024-09-12T17:39:45.681 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugin-development-6.0.1.jar 2024-09-12T17:39:45.681 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-maven-6.0.1.jar 2024-09-12T17:39:45.681 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-play-6.0.1.jar 2024-09-12T17:39:45.681 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-6.0.1.jar 2024-09-12T17:39:45.682 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-scala-6.0.1.jar 2024-09-12T17:39:45.682 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ear-6.0.1.jar 2024-09-12T17:39:45.682 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-play-6.0.1.jar 2024-09-12T17:39:45.682 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-javascript-6.0.1.jar 2024-09-12T17:39:45.682 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ivy-6.0.1.jar 2024-09-12T17:39:45.682 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-jacoco-6.0.1.jar 2024-09-12T17:39:45.682 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-init-6.0.1.jar 2024-09-12T17:39:45.682 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-kotlin-dsl-tooling-builders-6.0.1.jar 2024-09-12T17:39:45.682 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugins-6.0.1.jar 2024-09-12T17:39:45.682 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-test-kit-6.0.1.jar 2024-09-12T17:39:45.682 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-groovy-6.0.1.jar 2024-09-12T17:39:45.682 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-scala-6.0.1.jar 2024-09-12T17:39:45.682 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-junit-platform-6.0.1.jar 2024-09-12T17:39:45.682 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-tooling-api-builders-6.0.1.jar 2024-09-12T17:39:45.683 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-jvm-6.0.1.jar 2024-09-12T17:39:45.683 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-java-6.0.1.jar 2024-09-12T17:39:45.683 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-jvm-6.0.1.jar 2024-09-12T17:39:45.683 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-jvm-6.0.1.jar 2024-09-12T17:39:45.683 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-native-6.0.1.jar 2024-09-12T17:39:45.683 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-diagnostics-6.0.1.jar 2024-09-12T17:39:45.683 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-publish-6.0.1.jar 2024-09-12T17:39:45.683 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-base-6.0.1.jar 2024-09-12T17:39:45.683 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-base-6.0.1.jar 2024-09-12T17:39:45.683 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugin-use-6.0.1.jar 2024-09-12T17:39:45.683 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-instant-execution-6.0.1.jar 2024-09-12T17:39:45.683 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-version-control-6.0.1.jar 2024-09-12T17:39:45.683 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-dependency-management-6.0.1.jar 2024-09-12T17:39:45.683 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-composite-builds-6.0.1.jar 2024-09-12T17:39:45.684 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-reporting-6.0.1.jar 2024-09-12T17:39:45.684 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-s3-6.0.1.jar 2024-09-12T17:39:45.684 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-gcs-6.0.1.jar 2024-09-12T17:39:45.684 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-cache-http-6.0.1.jar 2024-09-12T17:39:45.684 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-http-6.0.1.jar 2024-09-12T17:39:45.684 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-sftp-6.0.1.jar 2024-09-12T17:39:45.684 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-profile-6.0.1.jar 2024-09-12T17:39:45.684 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-workers-6.0.1.jar 2024-09-12T17:39:45.684 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/org.eclipse.jgit-5.5.0.201909110433-r.jar 2024-09-12T17:39:45.684 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-http-3.0.0.jar 2024-09-12T17:39:45.684 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-http-shared-3.0.0.jar 2024-09-12T17:39:45.684 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-api-services-storage-v1-rev136-1.25.0.jar 2024-09-12T17:39:45.684 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-api-client-1.25.0.jar 2024-09-12T17:39:45.685 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/asm-util-7.1.jar 2024-09-12T17:39:45.685 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/ivy-2.3.0.jar 2024-09-12T17:39:45.685 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-compat-3.0.4.jar 2024-09-12T17:39:45.685 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-core-3.0.4.jar 2024-09-12T17:39:45.685 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/pmaven-common-0.8-20100325.jar 2024-09-12T17:39:45.685 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/pmaven-groovy-0.8-20100325.jar 2024-09-12T17:39:45.685 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-file-3.0.0.jar 2024-09-12T17:39:45.685 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-container-default-1.7.1.jar 2024-09-12T17:39:45.685 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-connector-wagon-1.13.1.jar 2024-09-12T17:39:45.685 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcpg-jdk15on-1.63.jar 2024-09-12T17:39:45.685 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/rhino-1.7.10.jar 2024-09-12T17:39:45.685 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gson-2.8.5.jar 2024-09-12T17:39:45.685 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/simple-4.1.21.jar 2024-09-12T17:39:45.685 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jatl-0.2.3.jar 2024-09-12T17:39:45.686 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-plugin-api-3.0.4.jar 2024-09-12T17:39:45.686 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-oauth-client-1.25.0.jar 2024-09-12T17:39:45.686 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-http-client-jackson2-1.25.0.jar 2024-09-12T17:39:45.686 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-http-client-1.25.0.jar 2024-09-12T17:39:45.686 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/testng-6.3.1.jar 2024-09-12T17:39:45.686 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/snakeyaml-1.17.jar 2024-09-12T17:39:45.686 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/dd-plist-1.21.jar 2024-09-12T17:39:45.686 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-4.12.jar 2024-09-12T17:39:45.686 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bsh-2.0b6.jar 2024-09-12T17:39:45.686 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-launcher-1.3.1.jar 2024-09-12T17:39:45.686 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-s3-1.11.633.jar 2024-09-12T17:39:45.686 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-kms-1.11.633.jar 2024-09-12T17:39:45.686 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-core-1.11.633.jar 2024-09-12T17:39:45.686 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/httpclient-4.5.10.jar 2024-09-12T17:39:45.687 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jcifs-1.3.17.jar 2024-09-12T17:39:45.687 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/nekohtml-1.9.22.jar 2024-09-12T17:39:45.687 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/xercesImpl-2.12.0.jar 2024-09-12T17:39:45.687 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jsch-0.1.55.jar 2024-09-12T17:39:45.687 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jaxb-impl-2.3.2.jar 2024-09-12T17:39:45.687 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jmespath-java-1.11.633.jar 2024-09-12T17:39:45.687 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-databind-2.9.10.jar 2024-09-12T17:39:45.687 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-core-2.9.10.jar 2024-09-12T17:39:45.687 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-annotations-2.9.10.jar 2024-09-12T17:39:45.687 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/joda-time-2.10.4.jar 2024-09-12T17:39:45.687 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcpkix-jdk15on-1.61.jar 2024-09-12T17:39:45.687 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcprov-jdk15on-1.63.jar 2024-09-12T17:39:45.687 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/commons-codec-1.13.jar 2024-09-12T17:39:45.687 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-aether-provider-3.0.4.jar 2024-09-12T17:39:45.687 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-impl-1.13.1.jar 2024-09-12T17:39:45.688 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-util-1.13.1.jar 2024-09-12T17:39:45.688 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-spi-1.13.1.jar 2024-09-12T17:39:45.688 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-api-1.13.1.jar 2024-09-12T17:39:45.688 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/hamcrest-core-1.3.jar 2024-09-12T17:39:45.688 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/httpcore-4.4.12.jar 2024-09-12T17:39:45.688 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jcommander-1.72.jar 2024-09-12T17:39:45.688 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jzlib-1.1.3.jar 2024-09-12T17:39:45.688 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-artifact-3.0.4.jar 2024-09-12T17:39:45.688 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-model-builder-3.0.4.jar 2024-09-12T17:39:45.688 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-model-3.0.4.jar 2024-09-12T17:39:45.688 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-repository-metadata-3.0.4.jar 2024-09-12T17:39:45.688 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-settings-builder-3.0.4.jar 2024-09-12T17:39:45.688 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-settings-3.0.4.jar 2024-09-12T17:39:45.689 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-sec-dispatcher-1.3.jar 2024-09-12T17:39:45.689 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-cipher-1.7.jar 2024-09-12T17:39:45.689 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-classworlds-2.5.1.jar 2024-09-12T17:39:45.689 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-component-annotations-1.5.5.jar 2024-09-12T17:39:45.689 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-interpolation-1.14.jar 2024-09-12T17:39:45.689 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-provider-api-3.0.0.jar 2024-09-12T17:39:45.689 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-utils-3.1.0.jar 2024-09-12T17:39:45.689 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/xbean-reflect-3.7.jar 2024-09-12T17:39:45.689 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/ion-java-1.0.2.jar 2024-09-12T17:39:45.689 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-engine-1.3.1.jar 2024-09-12T17:39:45.689 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-commons-1.3.1.jar 2024-09-12T17:39:45.689 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/apiguardian-api-1.0.0.jar 2024-09-12T17:39:45.689 INFO:teuthology.orchestra.run.smithi037.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/opentest4j-1.1.1.jar 2024-09-12T17:39:45.689 INFO:teuthology.orchestra.run.smithi037.stdout:export PATH=/opt/gradle/gradle-6.0.1/bin:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin 2024-09-12T17:39:45.690 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:39:45.690 INFO:teuthology.orchestra.run.smithi037.stdout:Welcome to Gradle 6.0.1! 2024-09-12T17:39:45.690 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:39:45.690 INFO:teuthology.orchestra.run.smithi037.stdout:Here are the highlights of this release: 2024-09-12T17:39:45.690 INFO:teuthology.orchestra.run.smithi037.stdout: - Substantial improvements in dependency management, including 2024-09-12T17:39:45.690 INFO:teuthology.orchestra.run.smithi037.stdout: - Publishing Gradle Module Metadata in addition to pom.xml 2024-09-12T17:39:45.690 INFO:teuthology.orchestra.run.smithi037.stdout: - Advanced control of transitive versions 2024-09-12T17:39:45.690 INFO:teuthology.orchestra.run.smithi037.stdout: - Support for optional features and dependencies 2024-09-12T17:39:45.690 INFO:teuthology.orchestra.run.smithi037.stdout: - Rules to tweak published metadata 2024-09-12T17:39:45.690 INFO:teuthology.orchestra.run.smithi037.stdout: - Support for Java 13 2024-09-12T17:39:45.690 INFO:teuthology.orchestra.run.smithi037.stdout: - Faster incremental Java and Groovy compilation 2024-09-12T17:39:45.690 INFO:teuthology.orchestra.run.smithi037.stdout: - New Zinc compiler for Scala 2024-09-12T17:39:45.690 INFO:teuthology.orchestra.run.smithi037.stdout: - VS2019 support 2024-09-12T17:39:45.690 INFO:teuthology.orchestra.run.smithi037.stdout: - Support for Gradle Enterprise plugin 3.0 2024-09-12T17:39:45.691 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:39:45.691 INFO:teuthology.orchestra.run.smithi037.stdout:For more details see https://docs.gradle.org/6.0.1/release-notes.html 2024-09-12T17:39:45.691 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:39:45.691 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:39:45.691 INFO:teuthology.orchestra.run.smithi037.stdout:------------------------------------------------------------ 2024-09-12T17:39:45.691 INFO:teuthology.orchestra.run.smithi037.stdout:Gradle 6.0.1 2024-09-12T17:39:45.691 INFO:teuthology.orchestra.run.smithi037.stdout:------------------------------------------------------------ 2024-09-12T17:39:45.691 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:39:45.691 INFO:teuthology.orchestra.run.smithi037.stdout:Build time: 2019-11-18 20:25:01 UTC 2024-09-12T17:39:45.691 INFO:teuthology.orchestra.run.smithi037.stdout:Revision: fad121066a68c4701acd362daf4287a7c309a0f5 2024-09-12T17:39:45.691 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:39:45.691 INFO:teuthology.orchestra.run.smithi037.stdout:Kotlin: 1.3.50 2024-09-12T17:39:45.691 INFO:teuthology.orchestra.run.smithi037.stdout:Groovy: 2.5.8 2024-09-12T17:39:45.691 INFO:teuthology.orchestra.run.smithi037.stdout:Ant: Apache Ant(TM) version 1.10.7 compiled on September 1 2019 2024-09-12T17:39:45.692 INFO:teuthology.orchestra.run.smithi037.stdout:JVM: 11.0.20.1 (Red Hat, Inc. 11.0.20.1+1-LTS) 2024-09-12T17:39:45.692 INFO:teuthology.orchestra.run.smithi037.stdout:OS: Linux 5.14.0-505.el9.x86_64 amd64 2024-09-12T17:39:45.692 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:39:45.692 DEBUG:tasks.s3tests_java:S3 Tests Java: BEGIN 2024-09-12T17:39:45.692 DEBUG:tasks.s3tests_java:S3 Tests Java: Cluster config is: ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2024-09-12T17:39:45.692 DEBUG:tasks.s3tests_java:S3 Tests Java: Host is: ubuntu@smithi037.front.sepia.ceph.com 2024-09-12T17:39:45.692 DEBUG:tasks.s3tests_java:S3 Tests Java: Cluster config is: ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-09-12T17:39:45.692 DEBUG:tasks.s3tests_java:S3 Tests Java: Host is: ubuntu@smithi040.front.sepia.ceph.com 2024-09-12T17:39:45.692 INFO:tasks.s3tests_java:S3 Tests Java: Creating S3 users... 2024-09-12T17:39:45.903 DEBUG:tasks.s3tests_java:S3 Tests Java: s3tests_conf is {'bucket_prefix': 'test-', 's3main': {'access_key': None, 'access_secret': None, 'region': 'mexico', 'endpoint': None, 'port': None, 'display_name': None, 'email': None, 'is_secure': None, 'SSE': 'AES256', 's3dir': 'folder', 'dir': '../data'}} 2024-09-12T17:39:45.903 DEBUG:tasks.s3tests_java:S3 Tests Java: Creating user tester.client.0 2024-09-12T17:39:45.903 DEBUG:tasks.s3tests_java:S3 Tests Java: s3tests_conf[s3main] is {'access_key': 'GBZOBVDAAJLMPUPSEHOT', 'access_secret': '4X7sxMJE/MLkMqQ62Q+4iTecN/p8tQ5n7mKTr7KpxIcsLl453AIGzQ==', 'region': 'mexico', 'endpoint': 'smithi037.front.sepia.ceph.com:80', 'port': 80, 'display_name': 'Ms. tester.client.0', 'email': 'tester.client.0_test@test.test', 'is_secure': False, 'SSE': 'AES256', 's3dir': 'folder', 'dir': '../data', 'user_id': 'tester.client.0', 'host': 'smithi037.front.sepia.ceph.com'} 2024-09-12T17:39:45.903 DEBUG:tasks.s3tests_java:S3 Tests Java: Setion, User = s3main, tester.client.0 2024-09-12T17:39:45.903 INFO:tasks.s3tests_java:['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '-n', 'client.0', 'user', 'create', '--uid', 'tester.client.0', '--display-name', 'Ms. tester.client.0', '--access-key', 'GBZOBVDAAJLMPUPSEHOT', '--secret', '4X7sxMJE/MLkMqQ62Q+4iTecN/p8tQ5n7mKTr7KpxIcsLl453AIGzQ==', '--email', 'tester.client.0_test@test.test', '--cluster', 'ceph'] 2024-09-12T17:39:45.904 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid tester.client.0 --display-name 'Ms. tester.client.0' --access-key GBZOBVDAAJLMPUPSEHOT --secret 4X7sxMJE/MLkMqQ62Q+4iTecN/p8tQ5n7mKTr7KpxIcsLl453AIGzQ== --email tester.client.0_test@test.test --cluster ceph 2024-09-12T17:39:45.970 INFO:teuthology.orchestra.run.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:39:45.970 INFO:teuthology.orchestra.run.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:39:46.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.005+0000 7f659212a800 20 rados->read ofs=0 len=0 2024-09-12T17:39:46.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.006+0000 7f659212a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:46.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.006+0000 7f659212a800 20 realm 2024-09-12T17:39:46.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.006+0000 7f659212a800 20 rados->read ofs=0 len=0 2024-09-12T17:39:46.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.007+0000 7f659212a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:46.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.007+0000 7f659212a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:39:46.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.007+0000 7f659212a800 20 rados->read ofs=0 len=0 2024-09-12T17:39:46.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.007+0000 7f659212a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:46.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.007+0000 7f659212a800 20 rados->read ofs=0 len=0 2024-09-12T17:39:46.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.210+0000 7f659212a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:39:46.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.210+0000 7f659212a800 20 rados->read ofs=0 len=0 2024-09-12T17:39:46.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.210+0000 7f659212a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:39:46.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.210+0000 7f659212a800 20 searching for the correct realm 2024-09-12T17:39:46.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.214+0000 7f658e6db640 0 -- 172.21.15.37:0/2696220233 >> [v2:172.21.15.40:6818/1210108009,v1:172.21.15.40:6819/1210108009] conn(0x7f658400b040 msgr2=0x7f658400b420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:39:46.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.218+0000 7f658deda640 0 -- 172.21.15.37:0/2696220233 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7f658404a920 msgr2=0x7f658402e420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:39:46.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.425+0000 7f659212a800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:39:46.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.425+0000 7f659212a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:39:46.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.425+0000 7f659212a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:39:46.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.425+0000 7f659212a800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:39:46.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.425+0000 7f659212a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:39:46.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.425+0000 7f659212a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:39:46.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.425+0000 7f659212a800 20 rados->read ofs=0 len=0 2024-09-12T17:39:46.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.426+0000 7f659212a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:46.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.426+0000 7f659212a800 20 rados->read ofs=0 len=0 2024-09-12T17:39:46.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.426+0000 7f659212a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:39:46.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.426+0000 7f659212a800 20 rados->read ofs=0 len=0 2024-09-12T17:39:46.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.427+0000 7f659212a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:39:46.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.427+0000 7f659212a800 20 zone default found 2024-09-12T17:39:46.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.427+0000 7f659212a800 4 Realm: () 2024-09-12T17:39:46.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.427+0000 7f659212a800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:39:46.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.427+0000 7f659212a800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:39:46.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.427+0000 7f659212a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:39:46.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.427+0000 7f659212a800 20 zonegroup default 2024-09-12T17:39:46.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.427+0000 7f659212a800 20 rados->read ofs=0 len=0 2024-09-12T17:39:46.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.427+0000 7f659212a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:46.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.427+0000 7f659212a800 20 rados->read ofs=0 len=0 2024-09-12T17:39:46.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.427+0000 7f659212a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:46.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.427+0000 7f659212a800 20 rados->read ofs=0 len=0 2024-09-12T17:39:46.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.428+0000 7f659212a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:46.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.428+0000 7f659212a800 20 started sync module instance, tier type = 2024-09-12T17:39:46.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.428+0000 7f659212a800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:39:46.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.439+0000 7f659212a800 20 add_watcher() i=0 2024-09-12T17:39:46.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.439+0000 7f659212a800 20 add_watcher() i=1 2024-09-12T17:39:46.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.439+0000 7f659212a800 20 add_watcher() i=2 2024-09-12T17:39:46.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.439+0000 7f659212a800 20 add_watcher() i=3 2024-09-12T17:39:46.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.439+0000 7f659212a800 20 add_watcher() i=4 2024-09-12T17:39:46.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.439+0000 7f659212a800 20 add_watcher() i=5 2024-09-12T17:39:46.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.440+0000 7f659212a800 20 add_watcher() i=6 2024-09-12T17:39:46.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.440+0000 7f659212a800 20 add_watcher() i=7 2024-09-12T17:39:46.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.440+0000 7f659212a800 2 all 8 watchers are set, enabling cache 2024-09-12T17:39:46.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.442+0000 7f643f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:39:46.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.442+0000 7f659212a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:39:46.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.442+0000 7f659212a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:39:46.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.442+0000 7f659212a800 5 note: GC not initialized 2024-09-12T17:39:46.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.443+0000 7f643e7fc640 20 reqs_thread_entry: start 2024-09-12T17:39:46.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.443+0000 7f659212a800 20 init_complete bucket index max shards: 11 2024-09-12T17:39:46.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.443+0000 7f659212a800 20 Filter name: none 2024-09-12T17:39:46.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.443+0000 7f63affff640 20 reqs_thread_entry: start 2024-09-12T17:39:46.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.443+0000 7f659212a800 10 cache get: name=default.rgw.meta+users.uid+tester.client.0 : miss 2024-09-12T17:39:46.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.443+0000 7f659212a800 20 rados->read ofs=0 len=0 2024-09-12T17:39:46.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.444+0000 7f659212a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:46.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.444+0000 7f659212a800 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x0 2024-09-12T17:39:46.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.444+0000 7f659212a800 10 adding default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-12T17:39:46.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.444+0000 7f659212a800 10 cache get: name=default.rgw.meta+users.email+tester.client.0_test@test.test : miss 2024-09-12T17:39:46.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.444+0000 7f659212a800 20 rados->read ofs=0 len=0 2024-09-12T17:39:46.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.444+0000 7f659212a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:46.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.444+0000 7f659212a800 10 cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x0 2024-09-12T17:39:46.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.444+0000 7f659212a800 10 adding default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-09-12T17:39:46.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.444+0000 7f659212a800 10 cache get: name=default.rgw.meta+users.keys+GBZOBVDAAJLMPUPSEHOT : miss 2024-09-12T17:39:46.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.444+0000 7f659212a800 20 rados->read ofs=0 len=0 2024-09-12T17:39:46.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.444+0000 7f659212a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:46.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.444+0000 7f659212a800 10 cache put: name=default.rgw.meta+users.keys+GBZOBVDAAJLMPUPSEHOT info.flags=0x0 2024-09-12T17:39:46.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.444+0000 7f659212a800 10 adding default.rgw.meta+users.keys+GBZOBVDAAJLMPUPSEHOT to cache LRU end 2024-09-12T17:39:46.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.444+0000 7f659212a800 10 cache get: name=default.rgw.meta+users.keys+GBZOBVDAAJLMPUPSEHOT : hit (negative entry) 2024-09-12T17:39:46.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.444+0000 7f659212a800 10 cache get: name=default.rgw.meta+users.keys+GBZOBVDAAJLMPUPSEHOT : hit (negative entry) 2024-09-12T17:39:46.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.446+0000 7f659212a800 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x17 2024-09-12T17:39:46.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.446+0000 7f659212a800 10 moving default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-12T17:39:46.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.446+0000 7f659212a800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.uid:tester.client.0, ofs0, ns] 2024-09-12T17:39:46.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.446+0000 7f64717fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497014 cookie 94362844165840 notifier 8820 bl.length()=670 2024-09-12T17:39:46.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.446+0000 7f64717fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x17 2024-09-12T17:39:46.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.446+0000 7f64717fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-12T17:39:46.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.449+0000 7f659212a800 10 cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x7 2024-09-12T17:39:46.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.449+0000 7f659212a800 10 moving default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-09-12T17:39:46.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.449+0000 7f659212a800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:tester.client.0_test@test.test, ofs0, ns] 2024-09-12T17:39:46.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.449+0000 7f64717fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496989 cookie 94362844154176 notifier 8820 bl.length()=200 2024-09-12T17:39:46.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.449+0000 7f64717fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x7 2024-09-12T17:39:46.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.449+0000 7f64717fa640 10 rgw watcher librados: moving default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-09-12T17:39:46.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.452+0000 7f659212a800 10 cache put: name=default.rgw.meta+users.keys+GBZOBVDAAJLMPUPSEHOT info.flags=0x7 2024-09-12T17:39:46.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.452+0000 7f659212a800 10 moving default.rgw.meta+users.keys+GBZOBVDAAJLMPUPSEHOT to cache LRU end 2024-09-12T17:39:46.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.452+0000 7f659212a800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.keys:GBZOBVDAAJLMPUPSEHOT, ofs0, ns] 2024-09-12T17:39:46.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.452+0000 7f64717fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497104 cookie 94362844158080 notifier 8820 bl.length()=189 2024-09-12T17:39:46.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.452+0000 7f64717fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+GBZOBVDAAJLMPUPSEHOT info.flags=0x7 2024-09-12T17:39:46.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.452+0000 7f64717fa640 10 rgw watcher librados: moving default.rgw.meta+users.keys+GBZOBVDAAJLMPUPSEHOT to cache LRU end 2024-09-12T17:39:46.454 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-09-12T17:39:46.454 INFO:teuthology.orchestra.run.smithi037.stdout: "user_id": "tester.client.0", 2024-09-12T17:39:46.454 INFO:teuthology.orchestra.run.smithi037.stdout: "display_name": "Ms. tester.client.0", 2024-09-12T17:39:46.454 INFO:teuthology.orchestra.run.smithi037.stdout: "email": "tester.client.0_test@test.test", 2024-09-12T17:39:46.454 INFO:teuthology.orchestra.run.smithi037.stdout: "suspended": 0, 2024-09-12T17:39:46.454 INFO:teuthology.orchestra.run.smithi037.stdout: "max_buckets": 1000, 2024-09-12T17:39:46.454 INFO:teuthology.orchestra.run.smithi037.stdout: "subusers": [], 2024-09-12T17:39:46.455 INFO:teuthology.orchestra.run.smithi037.stdout: "keys": [ 2024-09-12T17:39:46.455 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-12T17:39:46.455 INFO:teuthology.orchestra.run.smithi037.stdout: "user": "tester.client.0", 2024-09-12T17:39:46.455 INFO:teuthology.orchestra.run.smithi037.stdout: "access_key": "GBZOBVDAAJLMPUPSEHOT", 2024-09-12T17:39:46.455 INFO:teuthology.orchestra.run.smithi037.stdout: "secret_key": "4X7sxMJE/MLkMqQ62Q+4iTecN/p8tQ5n7mKTr7KpxIcsLl453AIGzQ==", 2024-09-12T17:39:46.455 INFO:teuthology.orchestra.run.smithi037.stdout: "active": true, 2024-09-12T17:39:46.455 INFO:teuthology.orchestra.run.smithi037.stdout: "create_date": "2024-09-12T17:39:46.445245Z" 2024-09-12T17:39:46.455 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-12T17:39:46.455 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-12T17:39:46.455 INFO:teuthology.orchestra.run.smithi037.stdout: "swift_keys": [], 2024-09-12T17:39:46.455 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": [], 2024-09-12T17:39:46.455 INFO:teuthology.orchestra.run.smithi037.stdout: "op_mask": "read, write, delete", 2024-09-12T17:39:46.455 INFO:teuthology.orchestra.run.smithi037.stdout: "default_placement": "", 2024-09-12T17:39:46.455 INFO:teuthology.orchestra.run.smithi037.stdout: "default_storage_class": "", 2024-09-12T17:39:46.456 INFO:teuthology.orchestra.run.smithi037.stdout: "placement_tags": [], 2024-09-12T17:39:46.456 INFO:teuthology.orchestra.run.smithi037.stdout: "bucket_quota": { 2024-09-12T17:39:46.456 INFO:teuthology.orchestra.run.smithi037.stdout: "enabled": false, 2024-09-12T17:39:46.456 INFO:teuthology.orchestra.run.smithi037.stdout: "check_on_raw": false, 2024-09-12T17:39:46.456 INFO:teuthology.orchestra.run.smithi037.stdout: "max_size": -1, 2024-09-12T17:39:46.456 INFO:teuthology.orchestra.run.smithi037.stdout: "max_size_kb": 0, 2024-09-12T17:39:46.456 INFO:teuthology.orchestra.run.smithi037.stdout: "max_objects": -1 2024-09-12T17:39:46.456 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-12T17:39:46.456 INFO:teuthology.orchestra.run.smithi037.stdout: "user_quota": { 2024-09-12T17:39:46.456 INFO:teuthology.orchestra.run.smithi037.stdout: "enabled": false, 2024-09-12T17:39:46.456 INFO:teuthology.orchestra.run.smithi037.stdout: "check_on_raw": false, 2024-09-12T17:39:46.456 INFO:teuthology.orchestra.run.smithi037.stdout: "max_size": -1, 2024-09-12T17:39:46.456 INFO:teuthology.orchestra.run.smithi037.stdout: "max_size_kb": 0, 2024-09-12T17:39:46.456 INFO:teuthology.orchestra.run.smithi037.stdout: "max_objects": -1 2024-09-12T17:39:46.457 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-12T17:39:46.457 INFO:teuthology.orchestra.run.smithi037.stdout: "temp_url_keys": [], 2024-09-12T17:39:46.457 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "rgw", 2024-09-12T17:39:46.457 INFO:teuthology.orchestra.run.smithi037.stdout: "mfa_ids": [], 2024-09-12T17:39:46.457 INFO:teuthology.orchestra.run.smithi037.stdout: "account_id": "", 2024-09-12T17:39:46.457 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-09-12T17:39:46.457 INFO:teuthology.orchestra.run.smithi037.stdout: "create_date": "2024-09-12T17:39:46.445229Z", 2024-09-12T17:39:46.457 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-12T17:39:46.457 INFO:teuthology.orchestra.run.smithi037.stdout: "group_ids": [] 2024-09-12T17:39:46.457 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-09-12T17:39:46.457 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:39:46.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.454+0000 7f643f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:39:46.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.457+0000 7f659212a800 20 remove_watcher() i=0 2024-09-12T17:39:46.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.457+0000 7f659212a800 2 removed watcher, disabling cache 2024-09-12T17:39:46.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.458+0000 7f659212a800 20 remove_watcher() i=1 2024-09-12T17:39:46.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.459+0000 7f659212a800 20 remove_watcher() i=2 2024-09-12T17:39:46.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.460+0000 7f659212a800 20 remove_watcher() i=3 2024-09-12T17:39:46.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.462+0000 7f659212a800 20 remove_watcher() i=4 2024-09-12T17:39:46.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.463+0000 7f659212a800 20 remove_watcher() i=5 2024-09-12T17:39:46.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.464+0000 7f659212a800 20 remove_watcher() i=6 2024-09-12T17:39:46.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.465+0000 7f659212a800 20 remove_watcher() i=7 2024-09-12T17:39:46.479 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-09-12T17:39:46.479 DEBUG:teuthology.orchestra.run.smithi037:> dd of=/home/ubuntu/cephtest/archive/s3-tests-java.client.0.conf 2024-09-12T17:39:46.512 INFO:tasks.s3tests_java:S3 Tests Java: Running tests... 2024-09-12T17:39:46.512 DEBUG:teuthology.orchestra.run.smithi037:> cp /home/ubuntu/cephtest/archive/s3-tests-java.client.0.conf /home/ubuntu/cephtest/s3-tests-java/config.properties 2024-09-12T17:39:46.580 DEBUG:teuthology.orchestra.run.smithi037:> radosgw-admin gc process --include-all 2024-09-12T17:39:46.673 INFO:teuthology.orchestra.run.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:39:46.673 INFO:teuthology.orchestra.run.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:39:46.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.712+0000 7f9701b32800 20 rados->read ofs=0 len=0 2024-09-12T17:39:46.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.714+0000 7f9701b32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:46.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.714+0000 7f9701b32800 20 realm 2024-09-12T17:39:46.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.714+0000 7f9701b32800 20 rados->read ofs=0 len=0 2024-09-12T17:39:46.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.714+0000 7f9701b32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:46.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.714+0000 7f9701b32800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:39:46.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.714+0000 7f9701b32800 20 rados->read ofs=0 len=0 2024-09-12T17:39:46.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.714+0000 7f9701b32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:46.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.714+0000 7f9701b32800 20 rados->read ofs=0 len=0 2024-09-12T17:39:46.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.715+0000 7f9701b32800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:39:46.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.715+0000 7f9701b32800 20 rados->read ofs=0 len=0 2024-09-12T17:39:46.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.716+0000 7f9701b32800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:39:46.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.716+0000 7f9701b32800 20 searching for the correct realm 2024-09-12T17:39:46.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.719+0000 7f96fdfbd640 0 -- 172.21.15.37:0/2811783457 >> [v2:172.21.15.40:6818/1210108009,v1:172.21.15.40:6819/1210108009] conn(0x7f96f407c8f0 msgr2=0x7f96f407e450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:39:46.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.723+0000 7f96fd7bc640 0 -- 172.21.15.37:0/2811783457 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7f96f407e960 msgr2=0x7f96f4065420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:39:46.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.931+0000 7f9701b32800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:39:46.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.931+0000 7f9701b32800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:39:46.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.931+0000 7f9701b32800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:39:46.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.931+0000 7f9701b32800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:39:46.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.931+0000 7f9701b32800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:39:46.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.931+0000 7f9701b32800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:39:46.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.931+0000 7f9701b32800 20 rados->read ofs=0 len=0 2024-09-12T17:39:46.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.931+0000 7f9701b32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:46.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.931+0000 7f9701b32800 20 rados->read ofs=0 len=0 2024-09-12T17:39:46.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.932+0000 7f9701b32800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:39:46.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.932+0000 7f9701b32800 20 rados->read ofs=0 len=0 2024-09-12T17:39:46.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.932+0000 7f9701b32800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:39:46.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.932+0000 7f9701b32800 20 zone default found 2024-09-12T17:39:46.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.932+0000 7f9701b32800 4 Realm: () 2024-09-12T17:39:46.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.932+0000 7f9701b32800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:39:46.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.932+0000 7f9701b32800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:39:46.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.932+0000 7f9701b32800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:39:46.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.932+0000 7f9701b32800 20 zonegroup default 2024-09-12T17:39:46.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.932+0000 7f9701b32800 20 rados->read ofs=0 len=0 2024-09-12T17:39:46.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.932+0000 7f9701b32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:46.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.932+0000 7f9701b32800 20 rados->read ofs=0 len=0 2024-09-12T17:39:46.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.933+0000 7f9701b32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:46.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.933+0000 7f9701b32800 20 rados->read ofs=0 len=0 2024-09-12T17:39:46.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.933+0000 7f9701b32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:46.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.933+0000 7f9701b32800 20 started sync module instance, tier type = 2024-09-12T17:39:46.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.933+0000 7f9701b32800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:39:46.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.943+0000 7f9701b32800 20 add_watcher() i=0 2024-09-12T17:39:46.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.943+0000 7f9701b32800 20 add_watcher() i=1 2024-09-12T17:39:46.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.943+0000 7f9701b32800 20 add_watcher() i=2 2024-09-12T17:39:46.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.943+0000 7f9701b32800 20 add_watcher() i=3 2024-09-12T17:39:46.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.943+0000 7f9701b32800 20 add_watcher() i=4 2024-09-12T17:39:46.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.943+0000 7f9701b32800 20 add_watcher() i=5 2024-09-12T17:39:46.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.944+0000 7f9701b32800 20 add_watcher() i=6 2024-09-12T17:39:46.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.944+0000 7f9701b32800 20 add_watcher() i=7 2024-09-12T17:39:46.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.944+0000 7f9701b32800 2 all 8 watchers are set, enabling cache 2024-09-12T17:39:46.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.946+0000 7f95b3fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:39:46.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.946+0000 7f9701b32800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:39:46.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.946+0000 7f9701b32800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:39:46.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.985+0000 7f95b2fe5640 20 reqs_thread_entry: start 2024-09-12T17:39:46.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.985+0000 7f9701b32800 20 init_complete bucket index max shards: 11 2024-09-12T17:39:46.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.985+0000 7f9701b32800 20 Filter name: none 2024-09-12T17:39:46.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.985+0000 7f95b0fe1640 20 reqs_thread_entry: start 2024-09-12T17:39:46.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.985+0000 7f9701b32800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T17:39:46.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.987+0000 7f9701b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:46.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.987+0000 7f9701b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:39:46.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.988+0000 7f9701b32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T17:39:46.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.988+0000 7f9701b32800 20 garbage collection: RGWGC::process iterating over entry tag='722b129a-cf7a-4aca-b594-5b9492d130e2.4623.17727107852081077902', time=2024-09-12T19:30:40.261734+0000, chain.objs.size()=3 2024-09-12T17:39:46.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.988+0000 7f9701b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.17__multipart_foo-STANDARD.2~3Fr5vjon4RjiQMVCfPwWSIjK6F0Py6Z.1 2024-09-12T17:39:46.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.988+0000 7f9701b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.17__multipart_foo-STANDARD.2~3Fr5vjon4RjiQMVCfPwWSIjK6F0Py6Z.2 2024-09-12T17:39:46.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.988+0000 7f9701b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.17__multipart_foo-STANDARD.2~3Fr5vjon4RjiQMVCfPwWSIjK6F0Py6Z.3 2024-09-12T17:39:46.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.990+0000 7f9701b32800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:39:46.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.992+0000 7f9701b32800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T17:39:46.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.994+0000 7f9701b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:46.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.994+0000 7f9701b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:39:46.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.995+0000 7f9701b32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T17:39:46.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.995+0000 7f9701b32800 20 garbage collection: RGWGC::process iterating over entry tag='_2Q3dKwA2QeIIJHMUgbU221W1Zo4Ddkd', time=2024-09-12T19:30:40.184214+0000, chain.objs.size()=1 2024-09-12T17:39:46.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.995+0000 7f9701b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.16__shadow_.zBBS-xfih2tMXgyVI-QIODmpu06rokP_0 2024-09-12T17:39:46.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.997+0000 7f9701b32800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:39:47.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:46.999+0000 7f9701b32800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T17:39:47.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.001+0000 7f9701b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:47.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.002+0000 7f9701b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:39:47.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.002+0000 7f9701b32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:47.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.003+0000 7f9701b32800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T17:39:47.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.004+0000 7f9701b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:47.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.005+0000 7f9701b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:39:47.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.005+0000 7f9701b32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:47.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.006+0000 7f9701b32800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T17:39:47.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.007+0000 7f9701b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:47.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.008+0000 7f9701b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:39:47.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.008+0000 7f9701b32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T17:39:47.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.008+0000 7f9701b32800 20 garbage collection: RGWGC::process iterating over entry tag='722b129a-cf7a-4aca-b594-5b9492d130e2.4623.9690149301494369721', time=2024-09-12T19:30:40.147323+0000, chain.objs.size()=4 2024-09-12T17:39:47.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.008+0000 7f9701b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.10__multipart_foo.2~A7rYpum_mslTPuh7xZikOFDMMfCEe3W.1 2024-09-12T17:39:47.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.008+0000 7f9701b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.10__multipart_foo.2~A7rYpum_mslTPuh7xZikOFDMMfCEe3W.2 2024-09-12T17:39:47.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.008+0000 7f9701b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.10__multipart_foo.2~A7rYpum_mslTPuh7xZikOFDMMfCEe3W.3 2024-09-12T17:39:47.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.008+0000 7f9701b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.10__multipart_foo.2~A7rYpum_mslTPuh7xZikOFDMMfCEe3W.4 2024-09-12T17:39:47.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.008+0000 7f9701b32800 20 garbage collection: RGWGC::process iterating over entry tag='722b129a-cf7a-4aca-b594-5b9492d130e2.4623.667413290576992298', time=2024-09-12T19:30:40.270299+0000, chain.objs.size()=3 2024-09-12T17:39:47.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.008+0000 7f9701b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.17__multipart_foo-LUKEWARM.2~3p8F8Dm0U5mVPAce6ztNjQpm3R2wt2_.1 2024-09-12T17:39:47.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.008+0000 7f9701b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.17__multipart_foo-LUKEWARM.2~3p8F8Dm0U5mVPAce6ztNjQpm3R2wt2_.2 2024-09-12T17:39:47.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.008+0000 7f9701b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.17__multipart_foo-LUKEWARM.2~3p8F8Dm0U5mVPAce6ztNjQpm3R2wt2_.3 2024-09-12T17:39:47.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.011+0000 7f9701b32800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:39:47.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.014+0000 7f9701b32800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T17:39:47.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.015+0000 7f9701b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:47.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.015+0000 7f9701b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:39:47.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.016+0000 7f9701b32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T17:39:47.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.016+0000 7f9701b32800 20 garbage collection: RGWGC::process iterating over entry tag='_uDbHyEiuEEaXDJp152EeZN4HBRS4dXk', time=2024-09-12T19:30:40.171062+0000, chain.objs.size()=1 2024-09-12T17:39:47.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.016+0000 7f9701b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.16__shadow_.bYecQG2QRP7cRbdfc67A-DkHjMyQ0SM_0 2024-09-12T17:39:47.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.017+0000 7f9701b32800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:39:47.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.019+0000 7f9701b32800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T17:39:47.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.021+0000 7f9701b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:47.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.021+0000 7f9701b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:39:47.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.021+0000 7f9701b32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:47.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.022+0000 7f9701b32800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T17:39:47.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.024+0000 7f9701b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:47.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.025+0000 7f9701b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:39:47.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.025+0000 7f9701b32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T17:39:47.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.025+0000 7f9701b32800 20 garbage collection: RGWGC::process iterating over entry tag='722b129a-cf7a-4aca-b594-5b9492d130e2.4623.15791433450595715832', time=2024-09-12T19:30:40.121177+0000, chain.objs.size()=4 2024-09-12T17:39:47.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.025+0000 7f9701b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.11__multipart_foo.2~YO5ZQ1zBWEypEpranUXKfRwoI--l1LK.1 2024-09-12T17:39:47.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.025+0000 7f9701b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.11__multipart_foo.2~YO5ZQ1zBWEypEpranUXKfRwoI--l1LK.2 2024-09-12T17:39:47.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.025+0000 7f9701b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.11__multipart_foo.2~YO5ZQ1zBWEypEpranUXKfRwoI--l1LK.3 2024-09-12T17:39:47.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.025+0000 7f9701b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.11__multipart_foo.2~YO5ZQ1zBWEypEpranUXKfRwoI--l1LK.4 2024-09-12T17:39:47.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.027+0000 7f9701b32800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:39:47.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.030+0000 7f9701b32800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T17:39:47.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.032+0000 7f9701b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:47.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.033+0000 7f9701b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:39:47.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.033+0000 7f9701b32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T17:39:47.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.033+0000 7f9701b32800 20 garbage collection: RGWGC::process iterating over entry tag='_JZ6oq8ur3IiN8H-lcvQ5eGr1ONykVzM', time=2024-09-12T19:30:40.175447+0000, chain.objs.size()=1 2024-09-12T17:39:47.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.033+0000 7f9701b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.16__shadow_.7mdexwkuF4BzBnaX0k1wjkwxGHOY4gh_1 2024-09-12T17:39:47.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.035+0000 7f9701b32800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:39:47.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.037+0000 7f9701b32800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T17:39:47.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.038+0000 7f9701b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:47.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.039+0000 7f9701b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:39:47.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.039+0000 7f9701b32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:47.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.040+0000 7f9701b32800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T17:39:47.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.041+0000 7f9701b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:47.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.042+0000 7f9701b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:39:47.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.042+0000 7f9701b32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T17:39:47.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.042+0000 7f9701b32800 20 garbage collection: RGWGC::process iterating over entry tag='722b129a-cf7a-4aca-b594-5b9492d130e2.4623.5697041962364583487', time=2024-09-12T19:30:40.179936+0000, chain.objs.size()=1 2024-09-12T17:39:47.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.042+0000 7f9701b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.16__shadow_.-XG0GEu7c64dGShgFRMwSYQy95RIGXr_0 2024-09-12T17:39:47.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.043+0000 7f9701b32800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:39:47.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.046+0000 7f9701b32800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T17:39:47.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.047+0000 7f9701b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:47.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.047+0000 7f9701b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:39:47.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.047+0000 7f9701b32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:47.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.048+0000 7f9701b32800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T17:39:47.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.050+0000 7f9701b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:47.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.050+0000 7f9701b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:39:47.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.051+0000 7f9701b32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T17:39:47.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.051+0000 7f9701b32800 20 garbage collection: RGWGC::process iterating over entry tag='722b129a-cf7a-4aca-b594-5b9492d130e2.4623.12767497614370164650', time=2024-09-12T19:30:40.287459+0000, chain.objs.size()=3 2024-09-12T17:39:47.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.051+0000 7f9701b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.17__multipart_foo-FROZEN.2~mK5UcGwPkCsgvLpZEsTArO48JetS8zO.1 2024-09-12T17:39:47.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.051+0000 7f9701b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.17__multipart_foo-FROZEN.2~mK5UcGwPkCsgvLpZEsTArO48JetS8zO.2 2024-09-12T17:39:47.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.051+0000 7f9701b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.17__multipart_foo-FROZEN.2~mK5UcGwPkCsgvLpZEsTArO48JetS8zO.3 2024-09-12T17:39:47.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.052+0000 7f9701b32800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:39:47.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.054+0000 7f9701b32800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T17:39:47.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.055+0000 7f9701b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:47.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.056+0000 7f9701b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:39:47.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.056+0000 7f9701b32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:47.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.057+0000 7f9701b32800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T17:39:47.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.058+0000 7f9701b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:47.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.059+0000 7f9701b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:39:47.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.059+0000 7f9701b32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T17:39:47.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.059+0000 7f9701b32800 20 garbage collection: RGWGC::process iterating over entry tag='_ETj8FGt9nOeQCWaWopCGQIgKExdykfz', time=2024-09-12T19:30:40.188784+0000, chain.objs.size()=1 2024-09-12T17:39:47.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.059+0000 7f9701b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.16__shadow_.IRV9NcU_ja0TVgFC6a3zOY2XM20pJ2i_0 2024-09-12T17:39:47.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.059+0000 7f9701b32800 20 garbage collection: RGWGC::process iterating over entry tag='722b129a-cf7a-4aca-b594-5b9492d130e2.4623.1109770148586127526', time=2024-09-12T19:30:40.348957+0000, chain.objs.size()=2 2024-09-12T17:39:47.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.059+0000 7f9701b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.14__shadow_._xhTewaxGpJ2vS6U0lbhH1m3vEiOj9H_0 2024-09-12T17:39:47.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.059+0000 7f9701b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.14__shadow_._xhTewaxGpJ2vS6U0lbhH1m3vEiOj9H_1 2024-09-12T17:39:47.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.062+0000 7f9701b32800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:39:47.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.064+0000 7f9701b32800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T17:39:47.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.065+0000 7f9701b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:47.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.066+0000 7f9701b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:39:47.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.066+0000 7f9701b32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T17:39:47.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.066+0000 7f9701b32800 20 garbage collection: RGWGC::process iterating over entry tag='722b129a-cf7a-4aca-b594-5b9492d130e2.4623.1027369559759265534', time=2024-09-12T19:30:40.068313+0000, chain.objs.size()=4 2024-09-12T17:39:47.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.066+0000 7f9701b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.12__multipart_foo.2~2CZEffOJi5ADSvHbL8PRThRAigkQOWA.1 2024-09-12T17:39:47.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.066+0000 7f9701b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.12__multipart_foo.2~2CZEffOJi5ADSvHbL8PRThRAigkQOWA.2 2024-09-12T17:39:47.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.066+0000 7f9701b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.12__multipart_foo.2~2CZEffOJi5ADSvHbL8PRThRAigkQOWA.3 2024-09-12T17:39:47.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.066+0000 7f9701b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.12__multipart_foo.2~2CZEffOJi5ADSvHbL8PRThRAigkQOWA.4 2024-09-12T17:39:47.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.066+0000 7f9701b32800 20 garbage collection: RGWGC::process iterating over entry tag='722b129a-cf7a-4aca-b594-5b9492d130e2.4623.11052335611803842256', time=2024-09-12T19:30:40.319493+0000, chain.objs.size()=3 2024-09-12T17:39:47.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.066+0000 7f9701b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.15__multipart_foo-LUKEWARM.2~cfK8En_Z4Mxjy1_iPlLAuZWgfLvwKUK.1 2024-09-12T17:39:47.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.066+0000 7f9701b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.15__multipart_foo-LUKEWARM.2~cfK8En_Z4Mxjy1_iPlLAuZWgfLvwKUK.2 2024-09-12T17:39:47.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.066+0000 7f9701b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.15__multipart_foo-LUKEWARM.2~cfK8En_Z4Mxjy1_iPlLAuZWgfLvwKUK.3 2024-09-12T17:39:47.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.070+0000 7f9701b32800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:39:47.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.074+0000 7f9701b32800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T17:39:47.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.075+0000 7f9701b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:47.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.076+0000 7f9701b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:39:47.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.076+0000 7f9701b32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T17:39:47.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.076+0000 7f9701b32800 20 garbage collection: RGWGC::process iterating over entry tag='_RkTD1chARR_IdO6EMK1USvgqhRtSH0L', time=2024-09-12T19:30:40.265832+0000, chain.objs.size()=2 2024-09-12T17:39:47.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.076+0000 7f9701b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.17__shadow_.fiU_0aF7Nxt_bkgOFtUI3jRfScXY77X_1 2024-09-12T17:39:47.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.076+0000 7f9701b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.17__shadow_.fiU_0aF7Nxt_bkgOFtUI3jRfScXY77X_2 2024-09-12T17:39:47.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.078+0000 7f9701b32800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:39:47.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.080+0000 7f9701b32800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T17:39:47.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.081+0000 7f9701b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:47.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.082+0000 7f9701b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:39:47.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.082+0000 7f9701b32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:47.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.083+0000 7f9701b32800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T17:39:47.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.084+0000 7f9701b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:47.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.085+0000 7f9701b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:39:47.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.085+0000 7f9701b32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:47.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.086+0000 7f9701b32800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T17:39:47.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.087+0000 7f9701b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:47.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.088+0000 7f9701b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:39:47.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.088+0000 7f9701b32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:47.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.089+0000 7f9701b32800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T17:39:47.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.091+0000 7f9701b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:47.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.091+0000 7f9701b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:39:47.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.091+0000 7f9701b32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:47.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.092+0000 7f9701b32800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T17:39:47.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.094+0000 7f9701b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:47.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.094+0000 7f9701b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:39:47.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.095+0000 7f9701b32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T17:39:47.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.095+0000 7f9701b32800 20 garbage collection: RGWGC::process iterating over entry tag='722b129a-cf7a-4aca-b594-5b9492d130e2.4623.5239078408954868536', time=2024-09-12T19:30:40.216250+0000, chain.objs.size()=1 2024-09-12T17:39:47.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.095+0000 7f9701b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.16__shadow_.-XG0GEu7c64dGShgFRMwSYQy95RIGXr_0 2024-09-12T17:39:47.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.095+0000 7f9701b32800 20 garbage collection: RGWGC::process iterating over entry tag='_3EtxPyADpbY54J4lqr_EwXFPBkEs4Om', time=2024-09-12T19:30:40.257307+0000, chain.objs.size()=2 2024-09-12T17:39:47.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.095+0000 7f9701b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.17__shadow_.und_oBZwCWd9JFqH9VMBJmHhgwGHykb_0 2024-09-12T17:39:47.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.095+0000 7f9701b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.17__shadow_.und_oBZwCWd9JFqH9VMBJmHhgwGHykb_1 2024-09-12T17:39:47.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.095+0000 7f9701b32800 20 garbage collection: RGWGC::process iterating over entry tag='722b129a-cf7a-4aca-b594-5b9492d130e2.4623.10999708332186763869', time=2024-09-12T19:30:40.341663+0000, chain.objs.size()=2 2024-09-12T17:39:47.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.095+0000 7f9701b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.14__shadow_.co5pdLIRRD6dAyOISnS4RCiP1XNW7T7_0 2024-09-12T17:39:47.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.095+0000 7f9701b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.14__shadow_.co5pdLIRRD6dAyOISnS4RCiP1XNW7T7_1 2024-09-12T17:39:47.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.098+0000 7f9701b32800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:39:47.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.100+0000 7f9701b32800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T17:39:47.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.101+0000 7f9701b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:47.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.102+0000 7f9701b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:39:47.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.102+0000 7f9701b32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T17:39:47.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.102+0000 7f9701b32800 20 garbage collection: RGWGC::process iterating over entry tag='_gUkPIx67kYJYNh6vNp6pS4aC9-JwAL8', time=2024-09-12T19:30:40.196681+0000, chain.objs.size()=1 2024-09-12T17:39:47.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.102+0000 7f9701b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.16__shadow_.446SI8MwxMkPsBOh9AAZXqyZSynH-ce_1 2024-09-12T17:39:47.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.103+0000 7f9701b32800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:39:47.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.105+0000 7f9701b32800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T17:39:47.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.107+0000 7f9701b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:47.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.107+0000 7f9701b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:39:47.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.107+0000 7f9701b32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:47.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.108+0000 7f9701b32800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T17:39:47.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.110+0000 7f9701b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:47.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.110+0000 7f9701b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:39:47.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.110+0000 7f9701b32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T17:39:47.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.110+0000 7f9701b32800 20 garbage collection: RGWGC::process iterating over entry tag='_LIS12q7EBHKBGE5Tg_SnpXNA7Ci5jsU', time=2024-09-12T19:30:40.240365+0000, chain.objs.size()=1 2024-09-12T17:39:47.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.110+0000 7f9701b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.17__shadow_.tnnuHZVJFUYLrVMf9xOLPRYMNAlXYG4_0 2024-09-12T17:39:47.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.112+0000 7f9701b32800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:39:47.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.114+0000 7f9701b32800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T17:39:47.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.116+0000 7f9701b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:47.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.116+0000 7f9701b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:39:47.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.116+0000 7f9701b32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:47.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.117+0000 7f9701b32800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T17:39:47.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.119+0000 7f9701b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:47.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.119+0000 7f9701b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:39:47.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.120+0000 7f9701b32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T17:39:47.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.120+0000 7f9701b32800 20 garbage collection: RGWGC::process iterating over entry tag='722b129a-cf7a-4aca-b594-5b9492d130e2.4623.12961051686328372529', time=2024-09-12T19:30:40.200869+0000, chain.objs.size()=1 2024-09-12T17:39:47.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.120+0000 7f9701b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.16__shadow_.BG55K2HV9ncIKMEVBGeBEZlnA5pSp45_0 2024-09-12T17:39:47.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.120+0000 7f9701b32800 20 garbage collection: RGWGC::process iterating over entry tag='722b129a-cf7a-4aca-b594-5b9492d130e2.4623.15388750536020454649', time=2024-09-12T19:30:40.279149+0000, chain.objs.size()=3 2024-09-12T17:39:47.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.120+0000 7f9701b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.17__multipart_foo-LUKEWARM.2~3p8F8Dm0U5mVPAce6ztNjQpm3R2wt2_.1 2024-09-12T17:39:47.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.120+0000 7f9701b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.17__multipart_foo-LUKEWARM.2~3p8F8Dm0U5mVPAce6ztNjQpm3R2wt2_.2 2024-09-12T17:39:47.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.120+0000 7f9701b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.17__multipart_foo-LUKEWARM.2~3p8F8Dm0U5mVPAce6ztNjQpm3R2wt2_.3 2024-09-12T17:39:47.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.120+0000 7f9701b32800 20 garbage collection: RGWGC::process iterating over entry tag='722b129a-cf7a-4aca-b594-5b9492d130e2.4623.17124026983468503466', time=2024-09-12T19:30:40.315074+0000, chain.objs.size()=3 2024-09-12T17:39:47.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.120+0000 7f9701b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.15__multipart_foo-STANDARD.2~CWUr_0hd_E967talIygMTLP0uGj-zPn.1 2024-09-12T17:39:47.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.120+0000 7f9701b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.15__multipart_foo-STANDARD.2~CWUr_0hd_E967talIygMTLP0uGj-zPn.2 2024-09-12T17:39:47.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.120+0000 7f9701b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.15__multipart_foo-STANDARD.2~CWUr_0hd_E967talIygMTLP0uGj-zPn.3 2024-09-12T17:39:47.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.123+0000 7f9701b32800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:39:47.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.125+0000 7f9701b32800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T17:39:47.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.126+0000 7f9701b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:47.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.126+0000 7f9701b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:39:47.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.127+0000 7f9701b32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T17:39:47.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.127+0000 7f9701b32800 20 garbage collection: RGWGC::process iterating over entry tag='722b129a-cf7a-4aca-b594-5b9492d130e2.4623.17530935367180366311', time=2024-09-12T19:30:40.094126+0000, chain.objs.size()=4 2024-09-12T17:39:47.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.127+0000 7f9701b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.13__multipart_foo.2~pmrxXnnLDFlRri_unqBgipVd2BoalkQ.1 2024-09-12T17:39:47.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.127+0000 7f9701b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.13__multipart_foo.2~pmrxXnnLDFlRri_unqBgipVd2BoalkQ.2 2024-09-12T17:39:47.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.127+0000 7f9701b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.13__multipart_foo.2~pmrxXnnLDFlRri_unqBgipVd2BoalkQ.3 2024-09-12T17:39:47.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.127+0000 7f9701b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.13__multipart_foo.2~pmrxXnnLDFlRri_unqBgipVd2BoalkQ.4 2024-09-12T17:39:47.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.127+0000 7f9701b32800 20 garbage collection: RGWGC::process iterating over entry tag='_fVphe69twCKjI-_MArOoEIT8KRNY_rK', time=2024-09-12T19:30:40.253175+0000, chain.objs.size()=2 2024-09-12T17:39:47.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.127+0000 7f9701b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.17__shadow_.PPPKxYCANCMyIscBEKmV-UhJ5buBkFg_0 2024-09-12T17:39:47.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.127+0000 7f9701b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.17__shadow_.PPPKxYCANCMyIscBEKmV-UhJ5buBkFg_1 2024-09-12T17:39:47.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.127+0000 7f9701b32800 20 garbage collection: RGWGC::process iterating over entry tag='_SGAwRGQuQrIv6zti6O9y2d73GBZtGoq', time=2024-09-12T19:30:40.283085+0000, chain.objs.size()=1 2024-09-12T17:39:47.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.127+0000 7f9701b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.17__shadow_.3HNtbN3Mb0Qh7yE-EnLEEZobut1Y5H6_0 2024-09-12T17:39:47.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.131+0000 7f9701b32800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:39:47.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.133+0000 7f9701b32800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T17:39:47.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.134+0000 7f9701b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:47.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.134+0000 7f9701b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:39:47.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.135+0000 7f9701b32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T17:39:47.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.135+0000 7f9701b32800 20 garbage collection: RGWGC::process iterating over entry tag='722b129a-cf7a-4aca-b594-5b9492d130e2.4623.1074000423253572708', time=2024-09-12T19:30:40.208040+0000, chain.objs.size()=1 2024-09-12T17:39:47.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.135+0000 7f9701b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.16__shadow_.BG55K2HV9ncIKMEVBGeBEZlnA5pSp45_0 2024-09-12T17:39:47.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.135+0000 7f9701b32800 20 garbage collection: RGWGC::process iterating over entry tag='_4_qaRJhhQgymnz3_zS2NvDE9cgRuclR', time=2024-09-12T19:30:40.211985+0000, chain.objs.size()=1 2024-09-12T17:39:47.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.135+0000 7f9701b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.16__shadow_.6Ge4Di8F3Y6unEOTy88bNScQO0eOv6G_0 2024-09-12T17:39:47.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.135+0000 7f9701b32800 20 garbage collection: RGWGC::process iterating over entry tag='_GVhrY9baGZLb7ew-hnDJW0Er0lTLC3-', time=2024-09-12T19:30:40.244512+0000, chain.objs.size()=2 2024-09-12T17:39:47.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.135+0000 7f9701b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.17__shadow_.3GBAFufTEHBJZPvC2hNkyDk4bBWQwES_1 2024-09-12T17:39:47.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.135+0000 7f9701b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.17__shadow_.3GBAFufTEHBJZPvC2hNkyDk4bBWQwES_2 2024-09-12T17:39:47.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.137+0000 7f9701b32800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:39:47.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.139+0000 7f9701b32800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T17:39:47.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.141+0000 7f9701b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:47.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.141+0000 7f9701b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:39:47.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.141+0000 7f9701b32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:47.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.142+0000 7f9701b32800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T17:39:47.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.143+0000 7f9701b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:47.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.144+0000 7f9701b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:39:47.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.144+0000 7f9701b32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T17:39:47.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.144+0000 7f9701b32800 20 garbage collection: RGWGC::process iterating over entry tag='722b129a-cf7a-4aca-b594-5b9492d130e2.4623.9286930177530948550', time=2024-09-12T19:30:40.248818+0000, chain.objs.size()=3 2024-09-12T17:39:47.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.144+0000 7f9701b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.17__multipart_foo-FROZEN.2~mK5UcGwPkCsgvLpZEsTArO48JetS8zO.1 2024-09-12T17:39:47.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.144+0000 7f9701b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.17__multipart_foo-FROZEN.2~mK5UcGwPkCsgvLpZEsTArO48JetS8zO.2 2024-09-12T17:39:47.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.144+0000 7f9701b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.17__multipart_foo-FROZEN.2~mK5UcGwPkCsgvLpZEsTArO48JetS8zO.3 2024-09-12T17:39:47.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.147+0000 7f9701b32800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:39:47.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.149+0000 7f9701b32800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T17:39:47.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.150+0000 7f9701b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:47.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.150+0000 7f9701b32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:39:47.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.151+0000 7f9701b32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T17:39:47.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.151+0000 7f9701b32800 20 garbage collection: RGWGC::process iterating over entry tag='722b129a-cf7a-4aca-b594-5b9492d130e2.4623.11281699694055619586', time=2024-09-12T19:30:40.274791+0000, chain.objs.size()=3 2024-09-12T17:39:47.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.151+0000 7f9701b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.17__multipart_foo-STANDARD.2~3Fr5vjon4RjiQMVCfPwWSIjK6F0Py6Z.1 2024-09-12T17:39:47.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.151+0000 7f9701b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.17__multipart_foo-STANDARD.2~3Fr5vjon4RjiQMVCfPwWSIjK6F0Py6Z.2 2024-09-12T17:39:47.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.151+0000 7f9701b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.17__multipart_foo-STANDARD.2~3Fr5vjon4RjiQMVCfPwWSIjK6F0Py6Z.3 2024-09-12T17:39:47.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.151+0000 7f9701b32800 20 garbage collection: RGWGC::process iterating over entry tag='722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18382905173119541097', time=2024-09-12T19:30:40.310388+0000, chain.objs.size()=3 2024-09-12T17:39:47.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.151+0000 7f9701b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.15__multipart_foo-FROZEN.2~rmgNxRFuLGqWfUx3oAVF7QnjCBP1g7r.1 2024-09-12T17:39:47.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.151+0000 7f9701b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.15__multipart_foo-FROZEN.2~rmgNxRFuLGqWfUx3oAVF7QnjCBP1g7r.2 2024-09-12T17:39:47.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.151+0000 7f9701b32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.15__multipart_foo-FROZEN.2~rmgNxRFuLGqWfUx3oAVF7QnjCBP1g7r.3 2024-09-12T17:39:47.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.155+0000 7f9701b32800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:39:47.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.158+0000 7f95b3fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:39:47.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.160+0000 7f9701b32800 20 remove_watcher() i=0 2024-09-12T17:39:47.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.160+0000 7f9701b32800 2 removed watcher, disabling cache 2024-09-12T17:39:47.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.161+0000 7f9701b32800 20 remove_watcher() i=1 2024-09-12T17:39:47.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.162+0000 7f9701b32800 20 remove_watcher() i=2 2024-09-12T17:39:47.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.163+0000 7f9701b32800 20 remove_watcher() i=3 2024-09-12T17:39:47.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.164+0000 7f9701b32800 20 remove_watcher() i=4 2024-09-12T17:39:47.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.165+0000 7f9701b32800 20 remove_watcher() i=5 2024-09-12T17:39:47.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.166+0000 7f9701b32800 20 remove_watcher() i=6 2024-09-12T17:39:47.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.167+0000 7f9701b32800 20 remove_watcher() i=7 2024-09-12T17:39:47.179 DEBUG:teuthology.orchestra.run.smithi037:> radosgw-admin gc process --include-all 2024-09-12T17:39:47.232 INFO:teuthology.orchestra.run.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:39:47.233 INFO:teuthology.orchestra.run.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:39:47.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.271+0000 7f2bdc546800 20 rados->read ofs=0 len=0 2024-09-12T17:39:47.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.272+0000 7f2bdc546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:47.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.272+0000 7f2bdc546800 20 realm 2024-09-12T17:39:47.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.272+0000 7f2bdc546800 20 rados->read ofs=0 len=0 2024-09-12T17:39:47.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.273+0000 7f2bdc546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:47.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.273+0000 7f2bdc546800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:39:47.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.273+0000 7f2bdc546800 20 rados->read ofs=0 len=0 2024-09-12T17:39:47.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.273+0000 7f2bdc546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:47.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.273+0000 7f2bdc546800 20 rados->read ofs=0 len=0 2024-09-12T17:39:47.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.274+0000 7f2bdc546800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:39:47.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.274+0000 7f2bdc546800 20 rados->read ofs=0 len=0 2024-09-12T17:39:47.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.274+0000 7f2bdc546800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:39:47.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.274+0000 7f2bdc546800 20 searching for the correct realm 2024-09-12T17:39:47.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.277+0000 7f2bda838640 0 -- 172.21.15.37:0/665151605 >> [v2:172.21.15.40:6818/1210108009,v1:172.21.15.40:6819/1210108009] conn(0x7f2bc403a070 msgr2=0x7f2bc402c970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:39:47.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.281+0000 7f2bda037640 0 -- 172.21.15.37:0/665151605 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7f2bc400f3d0 msgr2=0x7f2bc400f850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:39:47.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.285+0000 7f2bdc546800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:39:47.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.285+0000 7f2bdc546800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:39:47.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.285+0000 7f2bdc546800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:39:47.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.285+0000 7f2bdc546800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:39:47.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.285+0000 7f2bdc546800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:39:47.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.285+0000 7f2bdc546800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:39:47.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.285+0000 7f2bdc546800 20 rados->read ofs=0 len=0 2024-09-12T17:39:47.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.285+0000 7f2bdc546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:47.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.285+0000 7f2bdc546800 20 rados->read ofs=0 len=0 2024-09-12T17:39:47.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.286+0000 7f2bdc546800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:39:47.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.286+0000 7f2bdc546800 20 rados->read ofs=0 len=0 2024-09-12T17:39:47.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.286+0000 7f2bdc546800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:39:47.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.286+0000 7f2bdc546800 20 zone default found 2024-09-12T17:39:47.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.286+0000 7f2bdc546800 4 Realm: () 2024-09-12T17:39:47.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.286+0000 7f2bdc546800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:39:47.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.286+0000 7f2bdc546800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:39:47.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.286+0000 7f2bdc546800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:39:47.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.286+0000 7f2bdc546800 20 zonegroup default 2024-09-12T17:39:47.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.286+0000 7f2bdc546800 20 rados->read ofs=0 len=0 2024-09-12T17:39:47.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.286+0000 7f2bdc546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:47.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.286+0000 7f2bdc546800 20 rados->read ofs=0 len=0 2024-09-12T17:39:47.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.287+0000 7f2bdc546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:47.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.287+0000 7f2bdc546800 20 rados->read ofs=0 len=0 2024-09-12T17:39:47.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.287+0000 7f2bdc546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:47.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.287+0000 7f2bdc546800 20 started sync module instance, tier type = 2024-09-12T17:39:47.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.287+0000 7f2bdc546800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:39:47.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.296+0000 7f2bdc546800 20 add_watcher() i=0 2024-09-12T17:39:47.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.296+0000 7f2bdc546800 20 add_watcher() i=1 2024-09-12T17:39:47.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.296+0000 7f2bdc546800 20 add_watcher() i=2 2024-09-12T17:39:47.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.296+0000 7f2bdc546800 20 add_watcher() i=3 2024-09-12T17:39:47.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.296+0000 7f2bdc546800 20 add_watcher() i=4 2024-09-12T17:39:47.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.296+0000 7f2bdc546800 20 add_watcher() i=5 2024-09-12T17:39:47.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.296+0000 7f2bdc546800 20 add_watcher() i=6 2024-09-12T17:39:47.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.297+0000 7f2bdc546800 20 add_watcher() i=7 2024-09-12T17:39:47.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.297+0000 7f2bdc546800 2 all 8 watchers are set, enabling cache 2024-09-12T17:39:47.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.299+0000 7f2a90fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:39:47.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.299+0000 7f2bdc546800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:39:47.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.299+0000 7f2bdc546800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:39:47.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.333+0000 7f2a0b7fe640 20 reqs_thread_entry: start 2024-09-12T17:39:47.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.333+0000 7f2bdc546800 20 init_complete bucket index max shards: 11 2024-09-12T17:39:47.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.333+0000 7f2bdc546800 20 Filter name: none 2024-09-12T17:39:47.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.333+0000 7f2a097fa640 20 reqs_thread_entry: start 2024-09-12T17:39:47.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.333+0000 7f2bdc546800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T17:39:47.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.335+0000 7f2bdc546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:47.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.335+0000 7f2bdc546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:39:47.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.336+0000 7f2bdc546800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:47.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.336+0000 7f2bdc546800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T17:39:47.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.338+0000 7f2bdc546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:47.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.338+0000 7f2bdc546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:39:47.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.338+0000 7f2bdc546800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:47.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.339+0000 7f2bdc546800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T17:39:47.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.340+0000 7f2bdc546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:47.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.341+0000 7f2bdc546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:39:47.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.341+0000 7f2bdc546800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:47.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.342+0000 7f2bdc546800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T17:39:47.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.344+0000 7f2bdc546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:47.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.344+0000 7f2bdc546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:39:47.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.344+0000 7f2bdc546800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:47.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.345+0000 7f2bdc546800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T17:39:47.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.347+0000 7f2bdc546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:47.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.347+0000 7f2bdc546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:39:47.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.347+0000 7f2bdc546800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:47.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.348+0000 7f2bdc546800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T17:39:47.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.349+0000 7f2bdc546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:47.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.350+0000 7f2bdc546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:39:47.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.350+0000 7f2bdc546800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:47.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.351+0000 7f2bdc546800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T17:39:47.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.352+0000 7f2bdc546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:47.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.353+0000 7f2bdc546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:39:47.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.353+0000 7f2bdc546800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:47.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.354+0000 7f2bdc546800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T17:39:47.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.355+0000 7f2bdc546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:47.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.355+0000 7f2bdc546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:39:47.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.356+0000 7f2bdc546800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:47.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.357+0000 7f2bdc546800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T17:39:47.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.358+0000 7f2bdc546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:47.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.359+0000 7f2bdc546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:39:47.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.359+0000 7f2bdc546800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:47.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.360+0000 7f2bdc546800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T17:39:47.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.361+0000 7f2bdc546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:47.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.362+0000 7f2bdc546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:39:47.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.362+0000 7f2bdc546800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:47.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.363+0000 7f2bdc546800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T17:39:47.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.364+0000 7f2bdc546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:47.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.365+0000 7f2bdc546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:39:47.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.365+0000 7f2bdc546800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:47.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.366+0000 7f2bdc546800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T17:39:47.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.367+0000 7f2bdc546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:47.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.367+0000 7f2bdc546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:39:47.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.368+0000 7f2bdc546800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:47.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.369+0000 7f2bdc546800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T17:39:47.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.370+0000 7f2bdc546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:47.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.371+0000 7f2bdc546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:39:47.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.371+0000 7f2bdc546800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:47.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.372+0000 7f2bdc546800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T17:39:47.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.374+0000 7f2bdc546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:47.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.374+0000 7f2bdc546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:39:47.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.374+0000 7f2bdc546800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:47.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.375+0000 7f2bdc546800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T17:39:47.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.377+0000 7f2bdc546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:47.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.377+0000 7f2bdc546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:39:47.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.377+0000 7f2bdc546800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:47.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.378+0000 7f2bdc546800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T17:39:47.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.380+0000 7f2bdc546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:47.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.380+0000 7f2bdc546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:39:47.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.380+0000 7f2bdc546800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:47.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.381+0000 7f2bdc546800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T17:39:47.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.382+0000 7f2bdc546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:47.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.383+0000 7f2bdc546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:39:47.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.383+0000 7f2bdc546800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:47.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.384+0000 7f2bdc546800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T17:39:47.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.386+0000 7f2bdc546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:47.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.386+0000 7f2bdc546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:39:47.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.386+0000 7f2bdc546800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:47.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.387+0000 7f2bdc546800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T17:39:47.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.389+0000 7f2bdc546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:47.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.389+0000 7f2bdc546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:39:47.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.389+0000 7f2bdc546800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:47.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.390+0000 7f2bdc546800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T17:39:47.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.392+0000 7f2bdc546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:47.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.392+0000 7f2bdc546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:39:47.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.392+0000 7f2bdc546800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:47.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.393+0000 7f2bdc546800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T17:39:47.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.395+0000 7f2bdc546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:47.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.395+0000 7f2bdc546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:39:47.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.396+0000 7f2bdc546800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:47.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.397+0000 7f2bdc546800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T17:39:47.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.398+0000 7f2bdc546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:47.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.398+0000 7f2bdc546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:39:47.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.398+0000 7f2bdc546800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:47.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.399+0000 7f2bdc546800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T17:39:47.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.401+0000 7f2bdc546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:47.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.401+0000 7f2bdc546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:39:47.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.401+0000 7f2bdc546800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:47.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.402+0000 7f2bdc546800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T17:39:47.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.404+0000 7f2bdc546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:47.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.404+0000 7f2bdc546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:39:47.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.404+0000 7f2bdc546800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:47.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.405+0000 7f2bdc546800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T17:39:47.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.407+0000 7f2bdc546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:47.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.407+0000 7f2bdc546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:39:47.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.407+0000 7f2bdc546800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:47.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.408+0000 7f2bdc546800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T17:39:47.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.410+0000 7f2bdc546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:47.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.410+0000 7f2bdc546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:39:47.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.410+0000 7f2bdc546800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:47.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.411+0000 7f2bdc546800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T17:39:47.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.413+0000 7f2bdc546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:47.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.413+0000 7f2bdc546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:39:47.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.413+0000 7f2bdc546800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:47.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.414+0000 7f2bdc546800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T17:39:47.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.416+0000 7f2bdc546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:47.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.416+0000 7f2bdc546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:39:47.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.416+0000 7f2bdc546800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:47.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.418+0000 7f2bdc546800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T17:39:47.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.419+0000 7f2bdc546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:47.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.419+0000 7f2bdc546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:39:47.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.419+0000 7f2bdc546800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:47.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.420+0000 7f2bdc546800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T17:39:47.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.422+0000 7f2bdc546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:47.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.422+0000 7f2bdc546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:39:47.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.422+0000 7f2bdc546800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:47.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.423+0000 7f2bdc546800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T17:39:47.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.425+0000 7f2bdc546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:47.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.425+0000 7f2bdc546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:39:47.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.425+0000 7f2bdc546800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:47.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.426+0000 7f2bdc546800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T17:39:47.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.428+0000 7f2bdc546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:47.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.428+0000 7f2bdc546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:39:47.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.429+0000 7f2bdc546800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:39:47.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.431+0000 7f2a90fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:39:47.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.433+0000 7f2bdc546800 20 remove_watcher() i=0 2024-09-12T17:39:47.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.433+0000 7f2bdc546800 2 removed watcher, disabling cache 2024-09-12T17:39:47.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.434+0000 7f2bdc546800 20 remove_watcher() i=1 2024-09-12T17:39:47.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.435+0000 7f2bdc546800 20 remove_watcher() i=2 2024-09-12T17:39:47.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.436+0000 7f2bdc546800 20 remove_watcher() i=3 2024-09-12T17:39:47.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.437+0000 7f2bdc546800 20 remove_watcher() i=4 2024-09-12T17:39:47.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.438+0000 7f2bdc546800 20 remove_watcher() i=5 2024-09-12T17:39:47.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.439+0000 7f2bdc546800 20 remove_watcher() i=6 2024-09-12T17:39:47.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:39:47.440+0000 7f2bdc546800 20 remove_watcher() i=7 2024-09-12T17:39:47.452 DEBUG:teuthology.orchestra.run.smithi037:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests AWS4Test 2024-09-12T17:39:47.953 INFO:teuthology.orchestra.run.smithi037.stdout:Starting a Gradle Daemon (subsequent builds will be faster) 2024-09-12T17:39:51.553 INFO:teuthology.orchestra.run.smithi037.stdout:> Task :clean UP-TO-DATE 2024-09-12T17:40:09.753 INFO:teuthology.orchestra.run.smithi037.stdout:> Task :compileJava 2024-09-12T17:40:09.753 INFO:teuthology.orchestra.run.smithi037.stdout:> Task :processResources 2024-09-12T17:40:09.753 INFO:teuthology.orchestra.run.smithi037.stdout:> Task :classes 2024-09-12T17:40:10.452 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:40:10.452 INFO:teuthology.orchestra.run.smithi037.stdout:> Task :compileTestJava 2024-09-12T17:40:10.453 INFO:teuthology.orchestra.run.smithi037.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-09-12T17:40:10.453 INFO:teuthology.orchestra.run.smithi037.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-09-12T17:40:10.454 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:40:10.454 INFO:teuthology.orchestra.run.smithi037.stdout:> Task :processTestResources NO-SOURCE 2024-09-12T17:40:10.454 INFO:teuthology.orchestra.run.smithi037.stdout:> Task :testClasses 2024-09-12T17:40:16.352 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:40:16.353 INFO:teuthology.orchestra.run.smithi037.stdout:> Task :test 2024-09-12T17:40:16.353 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:40:16.353 INFO:teuthology.orchestra.run.smithi037.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadLLAPIAWS4 STARTED 2024-09-12T17:40:20.652 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:40:20.652 INFO:teuthology.orchestra.run.smithi037.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadLLAPIAWS4 PASSED 2024-09-12T17:40:21.152 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:40:21.152 INFO:teuthology.orchestra.run.smithi037.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadNotFoundLLAPIAWS4 STARTED 2024-09-12T17:40:21.252 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:40:21.252 INFO:teuthology.orchestra.run.smithi037.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadNotFoundLLAPIAWS4 PASSED 2024-09-12T17:40:21.652 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:40:21.652 INFO:teuthology.orchestra.run.smithi037.stdout:suite > AWS4 tests > AWS4Test.testDownloadHLAPIAWS4 STARTED 2024-09-12T17:40:27.152 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:40:27.152 INFO:teuthology.orchestra.run.smithi037.stdout:suite > AWS4 tests > AWS4Test.testDownloadHLAPIAWS4 PASSED 2024-09-12T17:40:27.552 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:40:27.552 INFO:teuthology.orchestra.run.smithi037.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoBucketHLAPIAWS4 STARTED 2024-09-12T17:40:27.552 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:40:27.552 INFO:teuthology.orchestra.run.smithi037.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoBucketHLAPIAWS4 PASSED 2024-09-12T17:40:27.752 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:40:27.752 INFO:teuthology.orchestra.run.smithi037.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoKeyHLAPIAWS4 STARTED 2024-09-12T17:40:27.753 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:40:27.753 INFO:teuthology.orchestra.run.smithi037.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoKeyHLAPIAWS4 PASSED 2024-09-12T17:40:28.152 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:40:28.152 INFO:teuthology.orchestra.run.smithi037.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyHLAPIAWS4 STARTED 2024-09-12T17:40:32.352 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:40:32.352 INFO:teuthology.orchestra.run.smithi037.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyHLAPIAWS4 PASSED 2024-09-12T17:40:33.152 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:40:33.152 INFO:teuthology.orchestra.run.smithi037.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 STARTED 2024-09-12T17:40:33.352 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:40:33.352 INFO:teuthology.orchestra.run.smithi037.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 STANDARD_OUT 2024-09-12T17:40:33.352 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12 17:40:33,294 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-09-12T17:41:03.353 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:41:03.353 INFO:teuthology.orchestra.run.smithi037.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 PASSED 2024-09-12T17:41:04.152 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:41:04.152 INFO:teuthology.orchestra.run.smithi037.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCBucketHLAPIAWS4 STARTED 2024-09-12T17:41:04.152 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:41:04.152 INFO:teuthology.orchestra.run.smithi037.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCBucketHLAPIAWS4 PASSED 2024-09-12T17:41:04.652 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:41:04.652 INFO:teuthology.orchestra.run.smithi037.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCKeyHLAPIAWS4 STARTED 2024-09-12T17:41:04.752 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:41:04.752 INFO:teuthology.orchestra.run.smithi037.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCKeyHLAPIAWS4 PASSED 2024-09-12T17:41:05.452 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:41:05.452 INFO:teuthology.orchestra.run.smithi037.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadHLAPIAWS4 STARTED 2024-09-12T17:41:09.452 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:41:09.452 INFO:teuthology.orchestra.run.smithi037.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadHLAPIAWS4 PASSED 2024-09-12T17:41:09.952 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:41:09.952 INFO:teuthology.orchestra.run.smithi037.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadNoBucketHLAPIAWS4 STARTED 2024-09-12T17:41:09.952 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:41:09.952 INFO:teuthology.orchestra.run.smithi037.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadNoBucketHLAPIAWS4 PASSED 2024-09-12T17:41:10.152 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:41:10.152 INFO:teuthology.orchestra.run.smithi037.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadWithPauseHLAPIAWS4 STARTED 2024-09-12T17:41:25.252 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:41:25.252 INFO:teuthology.orchestra.run.smithi037.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadWithPauseHLAPIAWS4 PASSED 2024-09-12T17:41:25.552 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:41:25.552 INFO:teuthology.orchestra.run.smithi037.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadHLAPIAWS4 STARTED 2024-09-12T17:41:33.852 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:41:33.852 INFO:teuthology.orchestra.run.smithi037.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadHLAPIAWS4 PASSED 2024-09-12T17:41:34.452 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:41:34.453 INFO:teuthology.orchestra.run.smithi037.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadIncorrectMissingPartLLAPIAWS4 STARTED 2024-09-12T17:41:36.652 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:41:36.652 INFO:teuthology.orchestra.run.smithi037.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadIncorrectMissingPartLLAPIAWS4 PASSED 2024-09-12T17:41:37.052 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:41:37.052 INFO:teuthology.orchestra.run.smithi037.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadMultipleSizesLLAPIAWS4 STARTED 2024-09-12T17:43:31.253 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:43:31.253 INFO:teuthology.orchestra.run.smithi037.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadMultipleSizesLLAPIAWS4 PASSED 2024-09-12T17:43:31.652 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:43:31.652 INFO:teuthology.orchestra.run.smithi037.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadOverwriteExistingObjectLLAPIAWS4 STARTED 2024-09-12T17:43:36.352 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:43:36.353 INFO:teuthology.orchestra.run.smithi037.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadOverwriteExistingObjectLLAPIAWS4 PASSED 2024-09-12T17:43:36.752 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:43:36.752 INFO:teuthology.orchestra.run.smithi037.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadSmallLLAPIAWS4 STARTED 2024-09-12T17:43:40.552 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:43:40.552 INFO:teuthology.orchestra.run.smithi037.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadSmallLLAPIAWS4 PASSED 2024-09-12T17:43:40.952 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:43:40.952 INFO:teuthology.orchestra.run.smithi037.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadWithPauseAWS4 STARTED 2024-09-12T17:43:42.352 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:43:42.352 INFO:teuthology.orchestra.run.smithi037.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadWithPauseAWS4 PASSED 2024-09-12T17:43:48.352 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:43:48.352 INFO:teuthology.orchestra.run.smithi037.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateAfterToday4AWS4 STARTED 2024-09-12T17:43:48.452 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:43:48.452 INFO:teuthology.orchestra.run.smithi037.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateAfterToday4AWS4 PASSED 2024-09-12T17:43:48.852 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:43:48.852 INFO:teuthology.orchestra.run.smithi037.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeEpochAWS4 STARTED 2024-09-12T17:43:48.952 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:43:48.952 INFO:teuthology.orchestra.run.smithi037.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeEpochAWS4 PASSED 2024-09-12T17:43:49.352 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:43:49.352 INFO:teuthology.orchestra.run.smithi037.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeToday4AWS4 STARTED 2024-09-12T17:43:49.452 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:43:49.452 INFO:teuthology.orchestra.run.smithi037.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeToday4AWS4 PASSED 2024-09-12T17:43:49.952 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:43:49.952 INFO:teuthology.orchestra.run.smithi037.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateEmptyAWS4 STARTED 2024-09-12T17:43:50.052 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:43:50.052 INFO:teuthology.orchestra.run.smithi037.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateEmptyAWS4 PASSED 2024-09-12T17:43:50.452 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:43:50.452 INFO:teuthology.orchestra.run.smithi037.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateInvalidAWS4 STARTED 2024-09-12T17:43:50.552 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:43:50.552 INFO:teuthology.orchestra.run.smithi037.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateInvalidAWS4 PASSED 2024-09-12T17:43:51.052 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:43:51.052 INFO:teuthology.orchestra.run.smithi037.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateNoneAWS4 STARTED 2024-09-12T17:43:51.052 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:43:51.052 INFO:teuthology.orchestra.run.smithi037.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateNoneAWS4 PASSED 2024-09-12T17:43:51.552 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:43:51.552 INFO:teuthology.orchestra.run.smithi037.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadMd5InvalidGarbageAWS4 STARTED 2024-09-12T17:43:51.652 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:43:51.652 INFO:teuthology.orchestra.run.smithi037.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadMd5InvalidGarbageAWS4 PASSED 2024-09-12T17:43:52.052 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:43:52.052 INFO:teuthology.orchestra.run.smithi037.stdout:suite > AWS4 tests > AWS4Test.testUploadFileHLAPIBigFileAWS4 STARTED 2024-09-12T17:44:21.553 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:44:21.553 INFO:teuthology.orchestra.run.smithi037.stdout:suite > AWS4 tests > AWS4Test.testUploadFileHLAPIBigFileAWS4 PASSED 2024-09-12T17:44:22.052 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:44:22.052 INFO:teuthology.orchestra.run.smithi037.stdout:---------------------------------------------------------------------- 2024-09-12T17:44:22.052 INFO:teuthology.orchestra.run.smithi037.stdout:| Results: SUCCESS (26 tests, 26 successes, 0 failures, 0 skipped) | 2024-09-12T17:44:22.052 INFO:teuthology.orchestra.run.smithi037.stdout:---------------------------------------------------------------------- 2024-09-12T17:44:22.113 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:44:22.113 INFO:teuthology.orchestra.run.smithi037.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-09-12T17:44:22.113 INFO:teuthology.orchestra.run.smithi037.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-09-12T17:44:22.113 INFO:teuthology.orchestra.run.smithi037.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-09-12T17:44:22.113 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:44:22.114 INFO:teuthology.orchestra.run.smithi037.stdout:BUILD SUCCESSFUL in 4m 34s 2024-09-12T17:44:22.114 INFO:teuthology.orchestra.run.smithi037.stdout:5 actionable tasks: 4 executed, 1 up-to-date 2024-09-12T17:44:22.431 DEBUG:teuthology.orchestra.run.smithi037:> radosgw-admin gc process --include-all 2024-09-12T17:44:22.486 INFO:teuthology.orchestra.run.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:44:22.486 INFO:teuthology.orchestra.run.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:44:22.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.524+0000 7efd4431f800 20 rados->read ofs=0 len=0 2024-09-12T17:44:22.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.526+0000 7efd4431f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:22.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.526+0000 7efd4431f800 20 realm 2024-09-12T17:44:22.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.526+0000 7efd4431f800 20 rados->read ofs=0 len=0 2024-09-12T17:44:22.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.526+0000 7efd4431f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:22.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.526+0000 7efd4431f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:44:22.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.526+0000 7efd4431f800 20 rados->read ofs=0 len=0 2024-09-12T17:44:22.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.526+0000 7efd4431f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:22.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.526+0000 7efd4431f800 20 rados->read ofs=0 len=0 2024-09-12T17:44:22.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.528+0000 7efd4431f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:44:22.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.528+0000 7efd4431f800 20 rados->read ofs=0 len=0 2024-09-12T17:44:22.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.528+0000 7efd4431f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:44:22.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.528+0000 7efd4431f800 20 searching for the correct realm 2024-09-12T17:44:22.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.532+0000 7efd408aa640 0 -- 172.21.15.37:0/1819537667 >> [v2:172.21.15.37:6824/3990661154,v1:172.21.15.37:6825/3990661154] conn(0x559d4273b580 msgr2=0x559d4273d970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:44:22.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.536+0000 7efd3f8a8640 0 -- 172.21.15.37:0/1819537667 >> [v2:172.21.15.40:6800/2441293461,v1:172.21.15.40:6801/2441293461] conn(0x7efd30071040 msgr2=0x7efd300b1aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:44:22.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.540+0000 7efd4431f800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:44:22.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.540+0000 7efd4431f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:44:22.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.540+0000 7efd4431f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:44:22.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.540+0000 7efd4431f800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:44:22.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.540+0000 7efd4431f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:44:22.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.540+0000 7efd4431f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:44:22.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.540+0000 7efd4431f800 20 rados->read ofs=0 len=0 2024-09-12T17:44:22.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.540+0000 7efd4431f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:22.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.540+0000 7efd4431f800 20 rados->read ofs=0 len=0 2024-09-12T17:44:22.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.541+0000 7efd4431f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:44:22.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.541+0000 7efd4431f800 20 rados->read ofs=0 len=0 2024-09-12T17:44:22.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.541+0000 7efd4431f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:44:22.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.541+0000 7efd4431f800 20 zone default found 2024-09-12T17:44:22.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.541+0000 7efd4431f800 4 Realm: () 2024-09-12T17:44:22.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.541+0000 7efd4431f800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:44:22.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.541+0000 7efd4431f800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:44:22.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.541+0000 7efd4431f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:44:22.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.541+0000 7efd4431f800 20 zonegroup default 2024-09-12T17:44:22.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.541+0000 7efd4431f800 20 rados->read ofs=0 len=0 2024-09-12T17:44:22.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.541+0000 7efd4431f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:22.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.541+0000 7efd4431f800 20 rados->read ofs=0 len=0 2024-09-12T17:44:22.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.542+0000 7efd4431f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:22.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.542+0000 7efd4431f800 20 rados->read ofs=0 len=0 2024-09-12T17:44:22.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.542+0000 7efd4431f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:22.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.542+0000 7efd4431f800 20 started sync module instance, tier type = 2024-09-12T17:44:22.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.542+0000 7efd4431f800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:44:22.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.552+0000 7efd4431f800 20 add_watcher() i=0 2024-09-12T17:44:22.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.552+0000 7efd4431f800 20 add_watcher() i=1 2024-09-12T17:44:22.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.552+0000 7efd4431f800 20 add_watcher() i=2 2024-09-12T17:44:22.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.552+0000 7efd4431f800 20 add_watcher() i=3 2024-09-12T17:44:22.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.552+0000 7efd4431f800 20 add_watcher() i=4 2024-09-12T17:44:22.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.552+0000 7efd4431f800 20 add_watcher() i=5 2024-09-12T17:44:22.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.552+0000 7efd4431f800 20 add_watcher() i=6 2024-09-12T17:44:22.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.552+0000 7efd4431f800 20 add_watcher() i=7 2024-09-12T17:44:22.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.552+0000 7efd4431f800 2 all 8 watchers are set, enabling cache 2024-09-12T17:44:22.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.555+0000 7efbf6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:44:22.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.555+0000 7efd4431f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:44:22.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.555+0000 7efd4431f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:44:22.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.594+0000 7efbf5fdb640 20 reqs_thread_entry: start 2024-09-12T17:44:22.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.594+0000 7efd4431f800 20 init_complete bucket index max shards: 11 2024-09-12T17:44:22.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.594+0000 7efd4431f800 20 Filter name: none 2024-09-12T17:44:22.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.594+0000 7efb677fe640 20 reqs_thread_entry: start 2024-09-12T17:44:22.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.595+0000 7efd4431f800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T17:44:22.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.596+0000 7efd4431f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:22.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.597+0000 7efd4431f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:22.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.597+0000 7efd4431f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T17:44:22.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.597+0000 7efd4431f800 20 garbage collection: RGWGC::process iterating over entry tag='722b129a-cf7a-4aca-b594-5b9492d130e2.4623.8930115675741593743', time=2024-09-12T19:43:02.168290+0000, chain.objs.size()=11 2024-09-12T17:44:22.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.597+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.56__multipart_key1.2~eDxAD7xMqUVKnxurH0C5-r4X9cmOtp1.1 2024-09-12T17:44:22.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.597+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.56__shadow_key1.2~eDxAD7xMqUVKnxurH0C5-r4X9cmOtp1.1_1 2024-09-12T17:44:22.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.597+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.56__multipart_key1.2~eDxAD7xMqUVKnxurH0C5-r4X9cmOtp1.2 2024-09-12T17:44:22.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.597+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.56__shadow_key1.2~eDxAD7xMqUVKnxurH0C5-r4X9cmOtp1.2_1 2024-09-12T17:44:22.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.597+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.56__multipart_key1.2~eDxAD7xMqUVKnxurH0C5-r4X9cmOtp1.3 2024-09-12T17:44:22.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.597+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.56__shadow_key1.2~eDxAD7xMqUVKnxurH0C5-r4X9cmOtp1.3_1 2024-09-12T17:44:22.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.597+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.56__multipart_key1.2~eDxAD7xMqUVKnxurH0C5-r4X9cmOtp1.4 2024-09-12T17:44:22.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.597+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.56__shadow_key1.2~eDxAD7xMqUVKnxurH0C5-r4X9cmOtp1.4_1 2024-09-12T17:44:22.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.597+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.56__multipart_key1.2~eDxAD7xMqUVKnxurH0C5-r4X9cmOtp1.5 2024-09-12T17:44:22.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.597+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.56__shadow_key1.2~eDxAD7xMqUVKnxurH0C5-r4X9cmOtp1.5_1 2024-09-12T17:44:22.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.597+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.56__multipart_key1.2~eDxAD7xMqUVKnxurH0C5-r4X9cmOtp1.6 2024-09-12T17:44:22.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.603+0000 7efd4431f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:44:22.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.607+0000 7efd4431f800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T17:44:22.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.608+0000 7efd4431f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:22.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.608+0000 7efd4431f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:22.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.608+0000 7efd4431f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:22.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.609+0000 7efd4431f800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T17:44:22.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.611+0000 7efd4431f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:22.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.611+0000 7efd4431f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:22.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.612+0000 7efd4431f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T17:44:22.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.612+0000 7efd4431f800 20 garbage collection: RGWGC::process iterating over entry tag='722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18137410003774033721', time=2024-09-12T19:40:42.967701+0000, chain.objs.size()=5 2024-09-12T17:44:22.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.612+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.48__multipart_key1.2~ykXzKDaLfIUzXFxDeUguKBVIf_dPDHX.1 2024-09-12T17:44:22.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.612+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.48__multipart_key1.2~ykXzKDaLfIUzXFxDeUguKBVIf_dPDHX.2 2024-09-12T17:44:22.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.612+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.48__multipart_key1.2~ykXzKDaLfIUzXFxDeUguKBVIf_dPDHX.3 2024-09-12T17:44:22.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.612+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.48__multipart_key1.2~ykXzKDaLfIUzXFxDeUguKBVIf_dPDHX.4 2024-09-12T17:44:22.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.612+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.48__multipart_key1.2~ykXzKDaLfIUzXFxDeUguKBVIf_dPDHX.5 2024-09-12T17:44:22.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.615+0000 7efd4431f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:44:22.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.617+0000 7efd4431f800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T17:44:22.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.619+0000 7efd4431f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:22.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.619+0000 7efd4431f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:22.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.619+0000 7efd4431f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:22.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.621+0000 7efd4431f800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T17:44:22.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.622+0000 7efd4431f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:22.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.623+0000 7efd4431f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:22.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.623+0000 7efd4431f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:22.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.624+0000 7efd4431f800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T17:44:22.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.626+0000 7efd4431f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:22.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.626+0000 7efd4431f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:22.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.627+0000 7efd4431f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:22.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.628+0000 7efd4431f800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T17:44:22.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.629+0000 7efd4431f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:22.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.630+0000 7efd4431f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:22.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.630+0000 7efd4431f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:22.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.632+0000 7efd4431f800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T17:44:22.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.633+0000 7efd4431f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:22.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.634+0000 7efd4431f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:22.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.634+0000 7efd4431f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T17:44:22.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.634+0000 7efd4431f800 20 garbage collection: RGWGC::process iterating over entry tag='722b129a-cf7a-4aca-b594-5b9492d130e2.4623.13232736209967435144', time=2024-09-12T19:41:09.606530+0000, chain.objs.size()=5 2024-09-12T17:44:22.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.634+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.52__multipart_key1.2~vuyzl6JH2QhhdbeX2vBuOOaCQZfNsoM.1 2024-09-12T17:44:22.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.634+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.52__multipart_key1.2~vuyzl6JH2QhhdbeX2vBuOOaCQZfNsoM.2 2024-09-12T17:44:22.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.634+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.52__multipart_key1.2~vuyzl6JH2QhhdbeX2vBuOOaCQZfNsoM.3 2024-09-12T17:44:22.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.634+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.52__multipart_key1.2~vuyzl6JH2QhhdbeX2vBuOOaCQZfNsoM.4 2024-09-12T17:44:22.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.634+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.52__multipart_key1.2~vuyzl6JH2QhhdbeX2vBuOOaCQZfNsoM.5 2024-09-12T17:44:22.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.638+0000 7efd4431f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:44:22.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.640+0000 7efd4431f800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T17:44:22.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.642+0000 7efd4431f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:22.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.642+0000 7efd4431f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:22.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.642+0000 7efd4431f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T17:44:22.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.642+0000 7efd4431f800 20 garbage collection: RGWGC::process iterating over entry tag='722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2707216383381433255', time=2024-09-12T19:41:56.091345+0000, chain.objs.size()=11 2024-09-12T17:44:22.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.642+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.56__multipart_key1.2~vWRylx2J88gTtItBYDQTY6v1b2UjiPq.1 2024-09-12T17:44:22.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.643+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.56__multipart_key1.2~vWRylx2J88gTtItBYDQTY6v1b2UjiPq.2 2024-09-12T17:44:22.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.643+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.56__multipart_key1.2~vWRylx2J88gTtItBYDQTY6v1b2UjiPq.3 2024-09-12T17:44:22.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.643+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.56__multipart_key1.2~vWRylx2J88gTtItBYDQTY6v1b2UjiPq.4 2024-09-12T17:44:22.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.643+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.56__multipart_key1.2~vWRylx2J88gTtItBYDQTY6v1b2UjiPq.5 2024-09-12T17:44:22.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.643+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.56__multipart_key1.2~vWRylx2J88gTtItBYDQTY6v1b2UjiPq.6 2024-09-12T17:44:22.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.643+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.56__multipart_key1.2~vWRylx2J88gTtItBYDQTY6v1b2UjiPq.7 2024-09-12T17:44:22.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.643+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.56__multipart_key1.2~vWRylx2J88gTtItBYDQTY6v1b2UjiPq.8 2024-09-12T17:44:22.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.643+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.56__multipart_key1.2~vWRylx2J88gTtItBYDQTY6v1b2UjiPq.9 2024-09-12T17:44:22.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.643+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.56__multipart_key1.2~vWRylx2J88gTtItBYDQTY6v1b2UjiPq.10 2024-09-12T17:44:22.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.643+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.56__multipart_key1.2~vWRylx2J88gTtItBYDQTY6v1b2UjiPq.11 2024-09-12T17:44:22.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.643+0000 7efd4431f800 20 garbage collection: RGWGC::process iterating over entry tag='722b129a-cf7a-4aca-b594-5b9492d130e2.4623.11334871395102573427', time=2024-09-12T19:42:33.203118+0000, chain.objs.size()=10 2024-09-12T17:44:22.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.643+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.56__multipart_key1.2~LToLcYiYRsSeozQ5OX13j8AJ6vYOa7x.1 2024-09-12T17:44:22.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.646+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.56__multipart_key1.2~LToLcYiYRsSeozQ5OX13j8AJ6vYOa7x.2 2024-09-12T17:44:22.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.646+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.56__multipart_key1.2~LToLcYiYRsSeozQ5OX13j8AJ6vYOa7x.3 2024-09-12T17:44:22.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.647+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.56__multipart_key1.2~LToLcYiYRsSeozQ5OX13j8AJ6vYOa7x.4 2024-09-12T17:44:22.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.647+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.56__multipart_key1.2~LToLcYiYRsSeozQ5OX13j8AJ6vYOa7x.5 2024-09-12T17:44:22.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.647+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.56__multipart_key1.2~LToLcYiYRsSeozQ5OX13j8AJ6vYOa7x.6 2024-09-12T17:44:22.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.647+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.56__multipart_key1.2~LToLcYiYRsSeozQ5OX13j8AJ6vYOa7x.7 2024-09-12T17:44:22.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.647+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.56__multipart_key1.2~LToLcYiYRsSeozQ5OX13j8AJ6vYOa7x.8 2024-09-12T17:44:22.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.648+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.56__multipart_key1.2~LToLcYiYRsSeozQ5OX13j8AJ6vYOa7x.9 2024-09-12T17:44:22.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.648+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.56__multipart_key1.2~LToLcYiYRsSeozQ5OX13j8AJ6vYOa7x.10 2024-09-12T17:44:22.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.655+0000 7efd4431f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:44:22.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.658+0000 7efd4431f800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T17:44:22.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.659+0000 7efd4431f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:22.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.660+0000 7efd4431f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:22.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.660+0000 7efd4431f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T17:44:22.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.660+0000 7efd4431f800 20 garbage collection: RGWGC::process iterating over entry tag='722b129a-cf7a-4aca-b594-5b9492d130e2.4623.7561234122596887035', time=2024-09-12T19:40:27.228157+0000, chain.objs.size()=5 2024-09-12T17:44:22.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.660+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.43__multipart_key1.2~U1akBj8tLy3p7T84b_os_5rl6lI5pZA.1 2024-09-12T17:44:22.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.660+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.43__multipart_key1.2~U1akBj8tLy3p7T84b_os_5rl6lI5pZA.2 2024-09-12T17:44:22.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.660+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.43__multipart_key1.2~U1akBj8tLy3p7T84b_os_5rl6lI5pZA.3 2024-09-12T17:44:22.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.660+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.43__multipart_key1.2~U1akBj8tLy3p7T84b_os_5rl6lI5pZA.4 2024-09-12T17:44:22.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.660+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.43__multipart_key1.2~U1akBj8tLy3p7T84b_os_5rl6lI5pZA.5 2024-09-12T17:44:22.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.665+0000 7efd4431f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:44:22.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.668+0000 7efd4431f800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T17:44:22.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.669+0000 7efd4431f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:22.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.670+0000 7efd4431f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:22.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.670+0000 7efd4431f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T17:44:22.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.670+0000 7efd4431f800 20 garbage collection: RGWGC::process iterating over entry tag='722b129a-cf7a-4aca-b594-5b9492d130e2.4623.8034124824953785783', time=2024-09-12T19:41:25.280391+0000, chain.objs.size()=5 2024-09-12T17:44:22.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.670+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.53__multipart_key1.2~oNbI3hMJH12bmYlvJsIhIMQXW8m_tSn.1 2024-09-12T17:44:22.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.670+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.53__multipart_key1.2~oNbI3hMJH12bmYlvJsIhIMQXW8m_tSn.2 2024-09-12T17:44:22.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.670+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.53__multipart_key1.2~oNbI3hMJH12bmYlvJsIhIMQXW8m_tSn.3 2024-09-12T17:44:22.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.670+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.53__multipart_key1.2~oNbI3hMJH12bmYlvJsIhIMQXW8m_tSn.4 2024-09-12T17:44:22.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.670+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.53__multipart_key1.2~oNbI3hMJH12bmYlvJsIhIMQXW8m_tSn.5 2024-09-12T17:44:22.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.670+0000 7efd4431f800 20 garbage collection: RGWGC::process iterating over entry tag='2~0yTP2rS5YK96Zdz65w4AWoqJdfzqWjL', time=2024-09-12T19:41:36.861782+0000, chain.objs.size()=3 2024-09-12T17:44:22.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.670+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.55__multipart_key1.2~0yTP2rS5YK96Zdz65w4AWoqJdfzqWjL.7 2024-09-12T17:44:22.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.670+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.55__multipart_key1.2~0yTP2rS5YK96Zdz65w4AWoqJdfzqWjL.10 2024-09-12T17:44:22.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.670+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.55__multipart_key1.2~0yTP2rS5YK96Zdz65w4AWoqJdfzqWjL.13 2024-09-12T17:44:22.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.675+0000 7efd4431f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:44:22.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.678+0000 7efd4431f800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T17:44:22.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.679+0000 7efd4431f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:22.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.679+0000 7efd4431f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:22.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.679+0000 7efd4431f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:22.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.680+0000 7efd4431f800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T17:44:22.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.682+0000 7efd4431f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:22.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.682+0000 7efd4431f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:22.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.682+0000 7efd4431f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:22.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.683+0000 7efd4431f800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T17:44:22.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.685+0000 7efd4431f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:22.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.685+0000 7efd4431f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:22.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.685+0000 7efd4431f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:22.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.686+0000 7efd4431f800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T17:44:22.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.688+0000 7efd4431f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:22.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.688+0000 7efd4431f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:22.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.688+0000 7efd4431f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T17:44:22.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.688+0000 7efd4431f800 20 garbage collection: RGWGC::process iterating over entry tag='722b129a-cf7a-4aca-b594-5b9492d130e2.4623.1481120067322499428', time=2024-09-12T19:41:03.479384+0000, chain.objs.size()=4 2024-09-12T17:44:22.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.688+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.47__shadow_.m_iEaDYQgJJA_fD50Jn4I9-VBQ1doM6_1 2024-09-12T17:44:22.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.688+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.47__shadow_.m_iEaDYQgJJA_fD50Jn4I9-VBQ1doM6_2 2024-09-12T17:44:22.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.688+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.47__shadow_.m_iEaDYQgJJA_fD50Jn4I9-VBQ1doM6_3 2024-09-12T17:44:22.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.688+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.47__shadow_.m_iEaDYQgJJA_fD50Jn4I9-VBQ1doM6_4 2024-09-12T17:44:22.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.688+0000 7efd4431f800 20 garbage collection: RGWGC::process iterating over entry tag='722b129a-cf7a-4aca-b594-5b9492d130e2.4623.10504797662698564643', time=2024-09-12T19:43:31.366246+0000, chain.objs.size()=11 2024-09-12T17:44:22.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.688+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.56__multipart_key1.2~WFImhmhnogr15-n-9YJq5ztXmQQlWol.1 2024-09-12T17:44:22.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.688+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.56__shadow_key1.2~WFImhmhnogr15-n-9YJq5ztXmQQlWol.1_1 2024-09-12T17:44:22.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.688+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.56__multipart_key1.2~WFImhmhnogr15-n-9YJq5ztXmQQlWol.2 2024-09-12T17:44:22.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.688+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.56__shadow_key1.2~WFImhmhnogr15-n-9YJq5ztXmQQlWol.2_1 2024-09-12T17:44:22.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.689+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.56__multipart_key1.2~WFImhmhnogr15-n-9YJq5ztXmQQlWol.3 2024-09-12T17:44:22.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.689+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.56__shadow_key1.2~WFImhmhnogr15-n-9YJq5ztXmQQlWol.3_1 2024-09-12T17:44:22.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.689+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.56__multipart_key1.2~WFImhmhnogr15-n-9YJq5ztXmQQlWol.4 2024-09-12T17:44:22.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.689+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.56__shadow_key1.2~WFImhmhnogr15-n-9YJq5ztXmQQlWol.4_1 2024-09-12T17:44:22.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.692+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.56__multipart_key1.2~WFImhmhnogr15-n-9YJq5ztXmQQlWol.5 2024-09-12T17:44:22.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.693+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.56__shadow_key1.2~WFImhmhnogr15-n-9YJq5ztXmQQlWol.5_1 2024-09-12T17:44:22.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.694+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.56__multipart_key1.2~WFImhmhnogr15-n-9YJq5ztXmQQlWol.6 2024-09-12T17:44:22.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.697+0000 7efd4431f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:44:22.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.700+0000 7efd4431f800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T17:44:22.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.701+0000 7efd4431f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:22.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.702+0000 7efd4431f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:22.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.702+0000 7efd4431f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T17:44:22.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.702+0000 7efd4431f800 20 garbage collection: RGWGC::process iterating over entry tag='722b129a-cf7a-4aca-b594-5b9492d130e2.4623.15069876407924188802', time=2024-09-12T19:40:32.452737+0000, chain.objs.size()=5 2024-09-12T17:44:22.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.702+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.45__multipart_key1.2~1Cu1D6IqRf_7Rdqc72xBkYBKGf265Tv.1 2024-09-12T17:44:22.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.702+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.45__multipart_key1.2~1Cu1D6IqRf_7Rdqc72xBkYBKGf265Tv.2 2024-09-12T17:44:22.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.702+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.45__multipart_key1.2~1Cu1D6IqRf_7Rdqc72xBkYBKGf265Tv.3 2024-09-12T17:44:22.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.702+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.45__multipart_key1.2~1Cu1D6IqRf_7Rdqc72xBkYBKGf265Tv.4 2024-09-12T17:44:22.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.703+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.45__multipart_key1.2~1Cu1D6IqRf_7Rdqc72xBkYBKGf265Tv.5 2024-09-12T17:44:22.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.703+0000 7efd4431f800 20 garbage collection: RGWGC::process iterating over entry tag='722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18340205708639769965', time=2024-09-12T19:41:00.542451+0000, chain.objs.size()=5 2024-09-12T17:44:22.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.703+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.48__multipart_key1.2~wrV_QszOpoAOUAJ_PHbBc8xpDFimZs5.1 2024-09-12T17:44:22.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.703+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.48__shadow_key1.2~wrV_QszOpoAOUAJ_PHbBc8xpDFimZs5.1_1 2024-09-12T17:44:22.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.703+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.48__multipart_key1.2~wrV_QszOpoAOUAJ_PHbBc8xpDFimZs5.2 2024-09-12T17:44:22.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.703+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.48__shadow_key1.2~wrV_QszOpoAOUAJ_PHbBc8xpDFimZs5.2_1 2024-09-12T17:44:22.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.703+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.48__multipart_key1.2~wrV_QszOpoAOUAJ_PHbBc8xpDFimZs5.3 2024-09-12T17:44:22.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.703+0000 7efd4431f800 20 garbage collection: RGWGC::process iterating over entry tag='722b129a-cf7a-4aca-b594-5b9492d130e2.4623.10672312155634811315', time=2024-09-12T19:41:03.257491+0000, chain.objs.size()=5 2024-09-12T17:44:22.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.703+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.48__multipart_key1.2~Dy9n9iDSxdvDTBWFZ98IjpJFZBVXA6O.1 2024-09-12T17:44:22.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.703+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.48__shadow_key1.2~Dy9n9iDSxdvDTBWFZ98IjpJFZBVXA6O.1_1 2024-09-12T17:44:22.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.706+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.48__multipart_key1.2~Dy9n9iDSxdvDTBWFZ98IjpJFZBVXA6O.2 2024-09-12T17:44:22.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.709+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.48__shadow_key1.2~Dy9n9iDSxdvDTBWFZ98IjpJFZBVXA6O.2_1 2024-09-12T17:44:22.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.709+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.48__multipart_key1.2~Dy9n9iDSxdvDTBWFZ98IjpJFZBVXA6O.3 2024-09-12T17:44:22.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.709+0000 7efd4431f800 20 garbage collection: RGWGC::process iterating over entry tag='722b129a-cf7a-4aca-b594-5b9492d130e2.4623.6620471825877120499', time=2024-09-12T19:42:25.273246+0000, chain.objs.size()=11 2024-09-12T17:44:22.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.709+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.56__multipart_key1.2~x6pzsJnRHcdnqzxTO9p_4Zt_aftD17m.1 2024-09-12T17:44:22.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.709+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.56__multipart_key1.2~x6pzsJnRHcdnqzxTO9p_4Zt_aftD17m.2 2024-09-12T17:44:22.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.709+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.56__multipart_key1.2~x6pzsJnRHcdnqzxTO9p_4Zt_aftD17m.3 2024-09-12T17:44:22.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.709+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.56__multipart_key1.2~x6pzsJnRHcdnqzxTO9p_4Zt_aftD17m.4 2024-09-12T17:44:22.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.709+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.56__multipart_key1.2~x6pzsJnRHcdnqzxTO9p_4Zt_aftD17m.5 2024-09-12T17:44:22.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.709+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.56__multipart_key1.2~x6pzsJnRHcdnqzxTO9p_4Zt_aftD17m.6 2024-09-12T17:44:22.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.709+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.56__multipart_key1.2~x6pzsJnRHcdnqzxTO9p_4Zt_aftD17m.7 2024-09-12T17:44:22.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.709+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.56__multipart_key1.2~x6pzsJnRHcdnqzxTO9p_4Zt_aftD17m.8 2024-09-12T17:44:22.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.709+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.56__multipart_key1.2~x6pzsJnRHcdnqzxTO9p_4Zt_aftD17m.9 2024-09-12T17:44:22.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.715+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.56__multipart_key1.2~x6pzsJnRHcdnqzxTO9p_4Zt_aftD17m.10 2024-09-12T17:44:22.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.715+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.56__multipart_key1.2~x6pzsJnRHcdnqzxTO9p_4Zt_aftD17m.11 2024-09-12T17:44:22.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.719+0000 7efd4431f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:44:22.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.722+0000 7efd4431f800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T17:44:22.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.723+0000 7efd4431f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:22.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.724+0000 7efd4431f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:22.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.724+0000 7efd4431f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:22.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.725+0000 7efd4431f800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T17:44:22.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.727+0000 7efd4431f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:22.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.727+0000 7efd4431f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:22.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.727+0000 7efd4431f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:22.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.728+0000 7efd4431f800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T17:44:22.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.730+0000 7efd4431f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:22.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.730+0000 7efd4431f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:22.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.730+0000 7efd4431f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:22.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.732+0000 7efd4431f800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T17:44:22.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.733+0000 7efd4431f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:22.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.733+0000 7efd4431f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:22.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.734+0000 7efd4431f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:22.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.735+0000 7efd4431f800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T17:44:22.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.736+0000 7efd4431f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:22.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.736+0000 7efd4431f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:22.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.737+0000 7efd4431f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T17:44:22.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.737+0000 7efd4431f800 20 garbage collection: RGWGC::process iterating over entry tag='722b129a-cf7a-4aca-b594-5b9492d130e2.4623.9716617455034252491', time=2024-09-12T19:40:32.776893+0000, chain.objs.size()=5 2024-09-12T17:44:22.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.737+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.45__multipart_key1.2~1Cu1D6IqRf_7Rdqc72xBkYBKGf265Tv.1 2024-09-12T17:44:22.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.737+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.45__multipart_key1.2~1Cu1D6IqRf_7Rdqc72xBkYBKGf265Tv.2 2024-09-12T17:44:22.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.737+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.45__multipart_key1.2~1Cu1D6IqRf_7Rdqc72xBkYBKGf265Tv.3 2024-09-12T17:44:22.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.737+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.45__multipart_key1.2~1Cu1D6IqRf_7Rdqc72xBkYBKGf265Tv.4 2024-09-12T17:44:22.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.737+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.45__multipart_key1.2~1Cu1D6IqRf_7Rdqc72xBkYBKGf265Tv.5 2024-09-12T17:44:22.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.737+0000 7efd4431f800 20 garbage collection: RGWGC::process iterating over entry tag='722b129a-cf7a-4aca-b594-5b9492d130e2.4623.10121695064544808852', time=2024-09-12T19:41:03.795199+0000, chain.objs.size()=5 2024-09-12T17:44:22.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.737+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.48__multipart_key1.2~J_Zrn6hkPWbH1Qv-5_cup5qdwdO7egv.1 2024-09-12T17:44:22.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.737+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.48__shadow_key1.2~J_Zrn6hkPWbH1Qv-5_cup5qdwdO7egv.1_1 2024-09-12T17:44:22.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.737+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.48__multipart_key1.2~J_Zrn6hkPWbH1Qv-5_cup5qdwdO7egv.2 2024-09-12T17:44:22.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.737+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.48__shadow_key1.2~J_Zrn6hkPWbH1Qv-5_cup5qdwdO7egv.2_1 2024-09-12T17:44:22.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.737+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.48__multipart_key1.2~J_Zrn6hkPWbH1Qv-5_cup5qdwdO7egv.3 2024-09-12T17:44:22.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.737+0000 7efd4431f800 20 garbage collection: RGWGC::process iterating over entry tag='722b129a-cf7a-4aca-b594-5b9492d130e2.4623.7142992966673767168', time=2024-09-12T19:41:33.951834+0000, chain.objs.size()=5 2024-09-12T17:44:22.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.737+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.54__multipart_file.mpg.2~eTxURC3CnhGe55SD5wii_-VpUZcRuzU.1 2024-09-12T17:44:22.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.737+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.54__multipart_file.mpg.2~eTxURC3CnhGe55SD5wii_-VpUZcRuzU.2 2024-09-12T17:44:22.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.741+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.54__multipart_file.mpg.2~eTxURC3CnhGe55SD5wii_-VpUZcRuzU.3 2024-09-12T17:44:22.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.741+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.54__multipart_file.mpg.2~eTxURC3CnhGe55SD5wii_-VpUZcRuzU.4 2024-09-12T17:44:22.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.741+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.54__multipart_file.mpg.2~eTxURC3CnhGe55SD5wii_-VpUZcRuzU.5 2024-09-12T17:44:22.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.742+0000 7efd4431f800 20 garbage collection: RGWGC::process iterating over entry tag='722b129a-cf7a-4aca-b594-5b9492d130e2.4623.12841318674744214937', time=2024-09-12T19:41:34.026070+0000, chain.objs.size()=5 2024-09-12T17:44:22.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.742+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.54__multipart_file2.mpg.2~_Pl9GVHd_zvAXk8sTVGoy48YubJtmGw.1 2024-09-12T17:44:22.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.742+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.54__multipart_file2.mpg.2~_Pl9GVHd_zvAXk8sTVGoy48YubJtmGw.2 2024-09-12T17:44:22.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.742+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.54__multipart_file2.mpg.2~_Pl9GVHd_zvAXk8sTVGoy48YubJtmGw.3 2024-09-12T17:44:22.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.743+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.54__multipart_file2.mpg.2~_Pl9GVHd_zvAXk8sTVGoy48YubJtmGw.4 2024-09-12T17:44:22.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.743+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.54__multipart_file2.mpg.2~_Pl9GVHd_zvAXk8sTVGoy48YubJtmGw.5 2024-09-12T17:44:22.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.748+0000 7efd4431f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:44:22.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.751+0000 7efd4431f800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T17:44:22.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.753+0000 7efd4431f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:22.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.753+0000 7efd4431f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:22.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.753+0000 7efd4431f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T17:44:22.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.753+0000 7efd4431f800 20 garbage collection: RGWGC::process iterating over entry tag='722b129a-cf7a-4aca-b594-5b9492d130e2.4623.17663890895539526789', time=2024-09-12T19:40:54.958352+0000, chain.objs.size()=5 2024-09-12T17:44:22.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.753+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.48__multipart_key1.2~6EFduHcs4Vgd5xupFfKWSkdTT-Gy2A1.1 2024-09-12T17:44:22.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.753+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.48__multipart_key1.2~6EFduHcs4Vgd5xupFfKWSkdTT-Gy2A1.2 2024-09-12T17:44:22.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.753+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.48__multipart_key1.2~6EFduHcs4Vgd5xupFfKWSkdTT-Gy2A1.3 2024-09-12T17:44:22.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.753+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.48__multipart_key1.2~6EFduHcs4Vgd5xupFfKWSkdTT-Gy2A1.4 2024-09-12T17:44:22.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.753+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.48__multipart_key1.2~6EFduHcs4Vgd5xupFfKWSkdTT-Gy2A1.5 2024-09-12T17:44:22.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.757+0000 7efd4431f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:44:22.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.759+0000 7efd4431f800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T17:44:22.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.761+0000 7efd4431f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:22.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.761+0000 7efd4431f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:22.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.762+0000 7efd4431f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T17:44:22.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.762+0000 7efd4431f800 20 garbage collection: RGWGC::process iterating over entry tag='722b129a-cf7a-4aca-b594-5b9492d130e2.4623.6049919838123282843', time=2024-09-12T19:40:58.078527+0000, chain.objs.size()=5 2024-09-12T17:44:22.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.762+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.48__multipart_key1.2~lJLrpRpOORzboFO9gbZHbbQorR1aoE5.1 2024-09-12T17:44:22.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.762+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.48__multipart_key1.2~lJLrpRpOORzboFO9gbZHbbQorR1aoE5.2 2024-09-12T17:44:22.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.762+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.48__multipart_key1.2~lJLrpRpOORzboFO9gbZHbbQorR1aoE5.3 2024-09-12T17:44:22.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.762+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.48__multipart_key1.2~lJLrpRpOORzboFO9gbZHbbQorR1aoE5.4 2024-09-12T17:44:22.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.762+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.48__multipart_key1.2~lJLrpRpOORzboFO9gbZHbbQorR1aoE5.5 2024-09-12T17:44:22.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.762+0000 7efd4431f800 20 garbage collection: RGWGC::process iterating over entry tag='722b129a-cf7a-4aca-b594-5b9492d130e2.4623.16048395544358295493', time=2024-09-12T19:43:31.142866+0000, chain.objs.size()=11 2024-09-12T17:44:22.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.762+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.56__multipart_key1.2~eCC5-0ynwDXdYD4nFVT0Xgth25E0VkL.1 2024-09-12T17:44:22.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.762+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.56__shadow_key1.2~eCC5-0ynwDXdYD4nFVT0Xgth25E0VkL.1_1 2024-09-12T17:44:22.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.762+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.56__multipart_key1.2~eCC5-0ynwDXdYD4nFVT0Xgth25E0VkL.2 2024-09-12T17:44:22.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.762+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.56__shadow_key1.2~eCC5-0ynwDXdYD4nFVT0Xgth25E0VkL.2_1 2024-09-12T17:44:22.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.762+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.56__multipart_key1.2~eCC5-0ynwDXdYD4nFVT0Xgth25E0VkL.3 2024-09-12T17:44:22.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.762+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.56__shadow_key1.2~eCC5-0ynwDXdYD4nFVT0Xgth25E0VkL.3_1 2024-09-12T17:44:22.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.762+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.56__multipart_key1.2~eCC5-0ynwDXdYD4nFVT0Xgth25E0VkL.4 2024-09-12T17:44:22.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.767+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.56__shadow_key1.2~eCC5-0ynwDXdYD4nFVT0Xgth25E0VkL.4_1 2024-09-12T17:44:22.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.767+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.56__multipart_key1.2~eCC5-0ynwDXdYD4nFVT0Xgth25E0VkL.5 2024-09-12T17:44:22.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.768+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.56__shadow_key1.2~eCC5-0ynwDXdYD4nFVT0Xgth25E0VkL.5_1 2024-09-12T17:44:22.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.768+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.56__multipart_key1.2~eCC5-0ynwDXdYD4nFVT0Xgth25E0VkL.6 2024-09-12T17:44:22.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.768+0000 7efd4431f800 20 garbage collection: RGWGC::process iterating over entry tag='722b129a-cf7a-4aca-b594-5b9492d130e2.4623.5922030312725562292', time=2024-09-12T19:43:40.613917+0000, chain.objs.size()=5 2024-09-12T17:44:22.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.768+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.58__multipart_key1.2~qKGOWLufLBt9Mz0RKIxXDyeJQHLx9eh.1 2024-09-12T17:44:22.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.768+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.58__multipart_key1.2~qKGOWLufLBt9Mz0RKIxXDyeJQHLx9eh.2 2024-09-12T17:44:22.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.768+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.58__multipart_key1.2~qKGOWLufLBt9Mz0RKIxXDyeJQHLx9eh.3 2024-09-12T17:44:22.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.768+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.58__multipart_key1.2~qKGOWLufLBt9Mz0RKIxXDyeJQHLx9eh.4 2024-09-12T17:44:22.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.768+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.58__multipart_key1.2~qKGOWLufLBt9Mz0RKIxXDyeJQHLx9eh.5 2024-09-12T17:44:22.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.773+0000 7efd4431f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:44:22.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.776+0000 7efd4431f800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T17:44:22.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.777+0000 7efd4431f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:22.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.778+0000 7efd4431f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:22.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.779+0000 7efd4431f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T17:44:22.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.779+0000 7efd4431f800 20 garbage collection: RGWGC::process iterating over entry tag='2~X6rArRUqusjXtzqMzn7YsYek0fhL3_w', time=2024-09-12T19:43:47.147149+0000, chain.objs.size()=64 2024-09-12T17:44:22.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.779+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.59__multipart_key1.2~X6rArRUqusjXtzqMzn7YsYek0fhL3_w.1 2024-09-12T17:44:22.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.779+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.59__multipart_key1.2~X6rArRUqusjXtzqMzn7YsYek0fhL3_w.2 2024-09-12T17:44:22.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.779+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.59__multipart_key1.2~X6rArRUqusjXtzqMzn7YsYek0fhL3_w.3 2024-09-12T17:44:22.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.779+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.59__multipart_key1.2~X6rArRUqusjXtzqMzn7YsYek0fhL3_w.4 2024-09-12T17:44:22.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.779+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.59__multipart_key1.2~X6rArRUqusjXtzqMzn7YsYek0fhL3_w.5 2024-09-12T17:44:22.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.779+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.59__multipart_key1.2~X6rArRUqusjXtzqMzn7YsYek0fhL3_w.6 2024-09-12T17:44:22.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.779+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.59__multipart_key1.2~X6rArRUqusjXtzqMzn7YsYek0fhL3_w.7 2024-09-12T17:44:22.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.779+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.59__multipart_key1.2~X6rArRUqusjXtzqMzn7YsYek0fhL3_w.8 2024-09-12T17:44:22.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.779+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.59__multipart_key1.2~X6rArRUqusjXtzqMzn7YsYek0fhL3_w.9 2024-09-12T17:44:22.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.779+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.59__multipart_key1.2~X6rArRUqusjXtzqMzn7YsYek0fhL3_w.10 2024-09-12T17:44:22.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.779+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.59__multipart_key1.2~X6rArRUqusjXtzqMzn7YsYek0fhL3_w.11 2024-09-12T17:44:22.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.779+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.59__multipart_key1.2~X6rArRUqusjXtzqMzn7YsYek0fhL3_w.12 2024-09-12T17:44:22.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.782+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.59__multipart_key1.2~X6rArRUqusjXtzqMzn7YsYek0fhL3_w.13 2024-09-12T17:44:22.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.783+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.59__multipart_key1.2~X6rArRUqusjXtzqMzn7YsYek0fhL3_w.14 2024-09-12T17:44:22.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.784+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.59__multipart_key1.2~X6rArRUqusjXtzqMzn7YsYek0fhL3_w.15 2024-09-12T17:44:22.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.784+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.59__multipart_key1.2~X6rArRUqusjXtzqMzn7YsYek0fhL3_w.16 2024-09-12T17:44:22.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.784+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.59__multipart_key1.2~X6rArRUqusjXtzqMzn7YsYek0fhL3_w.17 2024-09-12T17:44:22.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.784+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.59__multipart_key1.2~X6rArRUqusjXtzqMzn7YsYek0fhL3_w.18 2024-09-12T17:44:22.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.786+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.59__multipart_key1.2~X6rArRUqusjXtzqMzn7YsYek0fhL3_w.19 2024-09-12T17:44:22.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.786+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.59__multipart_key1.2~X6rArRUqusjXtzqMzn7YsYek0fhL3_w.20 2024-09-12T17:44:22.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.786+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.59__multipart_key1.2~X6rArRUqusjXtzqMzn7YsYek0fhL3_w.21 2024-09-12T17:44:22.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.786+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.59__multipart_key1.2~X6rArRUqusjXtzqMzn7YsYek0fhL3_w.22 2024-09-12T17:44:22.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.786+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.59__multipart_key1.2~X6rArRUqusjXtzqMzn7YsYek0fhL3_w.23 2024-09-12T17:44:22.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.786+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.59__multipart_key1.2~X6rArRUqusjXtzqMzn7YsYek0fhL3_w.24 2024-09-12T17:44:22.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.789+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.59__multipart_key1.2~X6rArRUqusjXtzqMzn7YsYek0fhL3_w.25 2024-09-12T17:44:22.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.789+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.59__multipart_key1.2~X6rArRUqusjXtzqMzn7YsYek0fhL3_w.26 2024-09-12T17:44:22.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.789+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.59__multipart_key1.2~X6rArRUqusjXtzqMzn7YsYek0fhL3_w.27 2024-09-12T17:44:22.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.789+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.59__multipart_key1.2~X6rArRUqusjXtzqMzn7YsYek0fhL3_w.28 2024-09-12T17:44:22.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.789+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.59__multipart_key1.2~X6rArRUqusjXtzqMzn7YsYek0fhL3_w.29 2024-09-12T17:44:22.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.790+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.59__multipart_key1.2~X6rArRUqusjXtzqMzn7YsYek0fhL3_w.30 2024-09-12T17:44:22.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.790+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.59__multipart_key1.2~X6rArRUqusjXtzqMzn7YsYek0fhL3_w.31 2024-09-12T17:44:22.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.791+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.59__multipart_key1.2~X6rArRUqusjXtzqMzn7YsYek0fhL3_w.32 2024-09-12T17:44:22.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.792+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.59__multipart_key1.2~X6rArRUqusjXtzqMzn7YsYek0fhL3_w.33 2024-09-12T17:44:22.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.793+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.59__multipart_key1.2~X6rArRUqusjXtzqMzn7YsYek0fhL3_w.34 2024-09-12T17:44:22.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.793+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.59__multipart_key1.2~X6rArRUqusjXtzqMzn7YsYek0fhL3_w.35 2024-09-12T17:44:22.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.794+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.59__multipart_key1.2~X6rArRUqusjXtzqMzn7YsYek0fhL3_w.36 2024-09-12T17:44:22.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.794+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.59__multipart_key1.2~X6rArRUqusjXtzqMzn7YsYek0fhL3_w.37 2024-09-12T17:44:22.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.794+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.59__multipart_key1.2~X6rArRUqusjXtzqMzn7YsYek0fhL3_w.38 2024-09-12T17:44:22.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.794+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.59__multipart_key1.2~X6rArRUqusjXtzqMzn7YsYek0fhL3_w.39 2024-09-12T17:44:22.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.794+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.59__multipart_key1.2~X6rArRUqusjXtzqMzn7YsYek0fhL3_w.40 2024-09-12T17:44:22.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.794+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.59__multipart_key1.2~X6rArRUqusjXtzqMzn7YsYek0fhL3_w.41 2024-09-12T17:44:22.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.796+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.59__multipart_key1.2~X6rArRUqusjXtzqMzn7YsYek0fhL3_w.42 2024-09-12T17:44:22.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.796+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.59__multipart_key1.2~X6rArRUqusjXtzqMzn7YsYek0fhL3_w.43 2024-09-12T17:44:22.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.798+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.59__multipart_key1.2~X6rArRUqusjXtzqMzn7YsYek0fhL3_w.44 2024-09-12T17:44:22.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.799+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.59__multipart_key1.2~X6rArRUqusjXtzqMzn7YsYek0fhL3_w.45 2024-09-12T17:44:22.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.799+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.59__multipart_key1.2~X6rArRUqusjXtzqMzn7YsYek0fhL3_w.46 2024-09-12T17:44:22.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.799+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.59__multipart_key1.2~X6rArRUqusjXtzqMzn7YsYek0fhL3_w.47 2024-09-12T17:44:22.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.799+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.59__multipart_key1.2~X6rArRUqusjXtzqMzn7YsYek0fhL3_w.48 2024-09-12T17:44:22.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.799+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.59__multipart_key1.2~X6rArRUqusjXtzqMzn7YsYek0fhL3_w.49 2024-09-12T17:44:22.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.800+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.59__multipart_key1.2~X6rArRUqusjXtzqMzn7YsYek0fhL3_w.50 2024-09-12T17:44:22.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.800+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.59__multipart_key1.2~X6rArRUqusjXtzqMzn7YsYek0fhL3_w.51 2024-09-12T17:44:22.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.800+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.59__multipart_key1.2~X6rArRUqusjXtzqMzn7YsYek0fhL3_w.52 2024-09-12T17:44:22.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.801+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.59__multipart_key1.2~X6rArRUqusjXtzqMzn7YsYek0fhL3_w.53 2024-09-12T17:44:22.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.801+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.59__multipart_key1.2~X6rArRUqusjXtzqMzn7YsYek0fhL3_w.54 2024-09-12T17:44:22.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.803+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.59__multipart_key1.2~X6rArRUqusjXtzqMzn7YsYek0fhL3_w.55 2024-09-12T17:44:22.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.805+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.59__multipart_key1.2~X6rArRUqusjXtzqMzn7YsYek0fhL3_w.56 2024-09-12T17:44:22.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.805+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.59__multipart_key1.2~X6rArRUqusjXtzqMzn7YsYek0fhL3_w.57 2024-09-12T17:44:22.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.805+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.59__multipart_key1.2~X6rArRUqusjXtzqMzn7YsYek0fhL3_w.58 2024-09-12T17:44:22.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.805+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.59__multipart_key1.2~X6rArRUqusjXtzqMzn7YsYek0fhL3_w.59 2024-09-12T17:44:22.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.805+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.59__multipart_key1.2~X6rArRUqusjXtzqMzn7YsYek0fhL3_w.60 2024-09-12T17:44:22.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.805+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.59__multipart_key1.2~X6rArRUqusjXtzqMzn7YsYek0fhL3_w.61 2024-09-12T17:44:22.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.807+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.59__multipart_key1.2~X6rArRUqusjXtzqMzn7YsYek0fhL3_w.62 2024-09-12T17:44:22.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.807+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.59__multipart_key1.2~X6rArRUqusjXtzqMzn7YsYek0fhL3_w.63 2024-09-12T17:44:22.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.807+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.59__multipart_key1.2~X6rArRUqusjXtzqMzn7YsYek0fhL3_w.64 2024-09-12T17:44:22.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.810+0000 7efd4431f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:44:22.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.813+0000 7efd4431f800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T17:44:22.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.814+0000 7efd4431f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:22.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.815+0000 7efd4431f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:22.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.815+0000 7efd4431f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:22.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.816+0000 7efd4431f800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T17:44:22.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.817+0000 7efd4431f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:22.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.818+0000 7efd4431f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:22.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.818+0000 7efd4431f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T17:44:22.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.818+0000 7efd4431f800 20 garbage collection: RGWGC::process iterating over entry tag='722b129a-cf7a-4aca-b594-5b9492d130e2.4623.3307457994399901559', time=2024-09-12T19:43:36.398068+0000, chain.objs.size()=5 2024-09-12T17:44:22.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.818+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.57__multipart_key1.2~uSW4VSni7IOMAB7I9KwVBvbRAdZraXO.1 2024-09-12T17:44:22.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.818+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.57__multipart_key1.2~uSW4VSni7IOMAB7I9KwVBvbRAdZraXO.2 2024-09-12T17:44:22.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.818+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.57__multipart_key1.2~uSW4VSni7IOMAB7I9KwVBvbRAdZraXO.3 2024-09-12T17:44:22.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.818+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.57__multipart_key1.2~uSW4VSni7IOMAB7I9KwVBvbRAdZraXO.4 2024-09-12T17:44:22.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.818+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.57__multipart_key1.2~uSW4VSni7IOMAB7I9KwVBvbRAdZraXO.5 2024-09-12T17:44:22.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.820+0000 7efd4431f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:44:22.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.823+0000 7efd4431f800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T17:44:22.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.825+0000 7efd4431f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:22.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.825+0000 7efd4431f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:22.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.825+0000 7efd4431f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:22.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.827+0000 7efd4431f800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T17:44:22.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.828+0000 7efd4431f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:22.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.829+0000 7efd4431f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:22.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.829+0000 7efd4431f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T17:44:22.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.829+0000 7efd4431f800 20 garbage collection: RGWGC::process iterating over entry tag='2~9fYUlXvvuwPAm96YzQ4ASrqMhEYvzlX', time=2024-09-12T19:40:20.616763+0000, chain.objs.size()=5 2024-09-12T17:44:22.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.829+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.41__multipart_key1.2~9fYUlXvvuwPAm96YzQ4ASrqMhEYvzlX.1 2024-09-12T17:44:22.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.829+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.41__multipart_key1.2~9fYUlXvvuwPAm96YzQ4ASrqMhEYvzlX.2 2024-09-12T17:44:22.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.829+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.41__multipart_key1.2~9fYUlXvvuwPAm96YzQ4ASrqMhEYvzlX.3 2024-09-12T17:44:22.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.829+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.41__multipart_key1.2~9fYUlXvvuwPAm96YzQ4ASrqMhEYvzlX.4 2024-09-12T17:44:22.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.829+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.41__multipart_key1.2~9fYUlXvvuwPAm96YzQ4ASrqMhEYvzlX.5 2024-09-12T17:44:22.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.832+0000 7efd4431f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:44:22.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.835+0000 7efd4431f800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T17:44:22.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.836+0000 7efd4431f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:22.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.837+0000 7efd4431f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:22.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.837+0000 7efd4431f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:22.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.838+0000 7efd4431f800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T17:44:22.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.839+0000 7efd4431f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:22.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.840+0000 7efd4431f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:22.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.840+0000 7efd4431f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T17:44:22.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.840+0000 7efd4431f800 20 garbage collection: RGWGC::process iterating over entry tag='722b129a-cf7a-4aca-b594-5b9492d130e2.4623.3680218969111526554', time=2024-09-12T19:44:21.715723+0000, chain.objs.size()=11 2024-09-12T17:44:22.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.840+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.67__multipart_key1.2~2pAwS8PsjKcmcwno4Vz4hS6u_wlc9Zs.1 2024-09-12T17:44:22.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.840+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.67__multipart_key1.2~2pAwS8PsjKcmcwno4Vz4hS6u_wlc9Zs.2 2024-09-12T17:44:22.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.840+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.67__multipart_key1.2~2pAwS8PsjKcmcwno4Vz4hS6u_wlc9Zs.3 2024-09-12T17:44:22.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.840+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.67__multipart_key1.2~2pAwS8PsjKcmcwno4Vz4hS6u_wlc9Zs.4 2024-09-12T17:44:22.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.840+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.67__multipart_key1.2~2pAwS8PsjKcmcwno4Vz4hS6u_wlc9Zs.5 2024-09-12T17:44:22.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.840+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.67__multipart_key1.2~2pAwS8PsjKcmcwno4Vz4hS6u_wlc9Zs.6 2024-09-12T17:44:22.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.840+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.67__multipart_key1.2~2pAwS8PsjKcmcwno4Vz4hS6u_wlc9Zs.7 2024-09-12T17:44:22.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.840+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.67__multipart_key1.2~2pAwS8PsjKcmcwno4Vz4hS6u_wlc9Zs.8 2024-09-12T17:44:22.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.840+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.67__multipart_key1.2~2pAwS8PsjKcmcwno4Vz4hS6u_wlc9Zs.9 2024-09-12T17:44:22.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.840+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.67__multipart_key1.2~2pAwS8PsjKcmcwno4Vz4hS6u_wlc9Zs.10 2024-09-12T17:44:22.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.840+0000 7efd4431f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.67__multipart_key1.2~2pAwS8PsjKcmcwno4Vz4hS6u_wlc9Zs.11 2024-09-12T17:44:22.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.847+0000 7efd4431f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:44:22.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.850+0000 7efd4431f800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T17:44:22.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.851+0000 7efd4431f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:22.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.852+0000 7efd4431f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:22.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.852+0000 7efd4431f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:22.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.853+0000 7efd4431f800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T17:44:22.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.854+0000 7efd4431f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:22.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.855+0000 7efd4431f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:22.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.855+0000 7efd4431f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:22.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.857+0000 7efbf6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:44:22.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.859+0000 7efd4431f800 20 remove_watcher() i=0 2024-09-12T17:44:22.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.859+0000 7efd4431f800 2 removed watcher, disabling cache 2024-09-12T17:44:22.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.860+0000 7efd4431f800 20 remove_watcher() i=1 2024-09-12T17:44:22.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.861+0000 7efd4431f800 20 remove_watcher() i=2 2024-09-12T17:44:22.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.863+0000 7efd4431f800 20 remove_watcher() i=3 2024-09-12T17:44:22.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.864+0000 7efd4431f800 20 remove_watcher() i=4 2024-09-12T17:44:22.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.865+0000 7efd4431f800 20 remove_watcher() i=5 2024-09-12T17:44:22.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.866+0000 7efd4431f800 20 remove_watcher() i=6 2024-09-12T17:44:22.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.867+0000 7efd4431f800 20 remove_watcher() i=7 2024-09-12T17:44:22.879 DEBUG:teuthology.orchestra.run.smithi037:> radosgw-admin gc process --include-all 2024-09-12T17:44:22.932 INFO:teuthology.orchestra.run.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:44:22.933 INFO:teuthology.orchestra.run.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:44:22.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.971+0000 7f228c00f800 20 rados->read ofs=0 len=0 2024-09-12T17:44:22.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.973+0000 7f228c00f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:22.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.973+0000 7f228c00f800 20 realm 2024-09-12T17:44:22.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.973+0000 7f228c00f800 20 rados->read ofs=0 len=0 2024-09-12T17:44:22.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.973+0000 7f228c00f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:22.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.973+0000 7f228c00f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:44:22.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.973+0000 7f228c00f800 20 rados->read ofs=0 len=0 2024-09-12T17:44:22.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.973+0000 7f228c00f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:22.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.973+0000 7f228c00f800 20 rados->read ofs=0 len=0 2024-09-12T17:44:22.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.974+0000 7f228c00f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:44:22.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.974+0000 7f228c00f800 20 rados->read ofs=0 len=0 2024-09-12T17:44:22.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.974+0000 7f228c00f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:44:22.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.974+0000 7f228c00f800 20 searching for the correct realm 2024-09-12T17:44:22.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.977+0000 7f22892ff640 0 -- 172.21.15.37:0/4256426894 >> [v2:172.21.15.40:6800/2441293461,v1:172.21.15.40:6801/2441293461] conn(0x7f227c07e070 msgr2=0x7f227c04e030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:44:22.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:22.981+0000 7f2289b00640 0 -- 172.21.15.37:0/4256426894 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7f2280055910 msgr2=0x7f2280008420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:44:23.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.188+0000 7f228c00f800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:44:23.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.188+0000 7f228c00f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:44:23.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.188+0000 7f228c00f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:44:23.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.188+0000 7f228c00f800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:44:23.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.188+0000 7f228c00f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:44:23.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.188+0000 7f228c00f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:44:23.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.188+0000 7f228c00f800 20 rados->read ofs=0 len=0 2024-09-12T17:44:23.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.188+0000 7f228c00f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:23.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.188+0000 7f228c00f800 20 rados->read ofs=0 len=0 2024-09-12T17:44:23.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.188+0000 7f228c00f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:44:23.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.188+0000 7f228c00f800 20 rados->read ofs=0 len=0 2024-09-12T17:44:23.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.189+0000 7f228c00f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:44:23.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.189+0000 7f228c00f800 20 zone default found 2024-09-12T17:44:23.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.189+0000 7f228c00f800 4 Realm: () 2024-09-12T17:44:23.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.189+0000 7f228c00f800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:44:23.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.189+0000 7f228c00f800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:44:23.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.189+0000 7f228c00f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:44:23.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.189+0000 7f228c00f800 20 zonegroup default 2024-09-12T17:44:23.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.189+0000 7f228c00f800 20 rados->read ofs=0 len=0 2024-09-12T17:44:23.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.189+0000 7f228c00f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:23.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.189+0000 7f228c00f800 20 rados->read ofs=0 len=0 2024-09-12T17:44:23.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.189+0000 7f228c00f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:23.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.189+0000 7f228c00f800 20 rados->read ofs=0 len=0 2024-09-12T17:44:23.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.189+0000 7f228c00f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:23.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.190+0000 7f228c00f800 20 started sync module instance, tier type = 2024-09-12T17:44:23.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.190+0000 7f228c00f800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:44:23.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.199+0000 7f228c00f800 20 add_watcher() i=0 2024-09-12T17:44:23.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.199+0000 7f228c00f800 20 add_watcher() i=1 2024-09-12T17:44:23.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.199+0000 7f228c00f800 20 add_watcher() i=2 2024-09-12T17:44:23.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.199+0000 7f228c00f800 20 add_watcher() i=3 2024-09-12T17:44:23.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.199+0000 7f228c00f800 20 add_watcher() i=4 2024-09-12T17:44:23.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.199+0000 7f228c00f800 20 add_watcher() i=5 2024-09-12T17:44:23.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.199+0000 7f228c00f800 20 add_watcher() i=6 2024-09-12T17:44:23.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.200+0000 7f228c00f800 20 add_watcher() i=7 2024-09-12T17:44:23.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.200+0000 7f228c00f800 2 all 8 watchers are set, enabling cache 2024-09-12T17:44:23.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.201+0000 7f213b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:44:23.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.202+0000 7f228c00f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:44:23.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.202+0000 7f228c00f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:44:23.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.240+0000 7f213a7fc640 20 reqs_thread_entry: start 2024-09-12T17:44:23.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.240+0000 7f228c00f800 20 init_complete bucket index max shards: 11 2024-09-12T17:44:23.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.240+0000 7f228c00f800 20 Filter name: none 2024-09-12T17:44:23.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.240+0000 7f20abfff640 20 reqs_thread_entry: start 2024-09-12T17:44:23.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.240+0000 7f228c00f800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T17:44:23.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.241+0000 7f228c00f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:23.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.242+0000 7f228c00f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:23.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.242+0000 7f228c00f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:23.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.243+0000 7f228c00f800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T17:44:23.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.245+0000 7f228c00f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:23.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.245+0000 7f228c00f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:23.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.245+0000 7f228c00f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:23.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.247+0000 7f228c00f800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T17:44:23.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.248+0000 7f228c00f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:23.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.248+0000 7f228c00f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:23.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.249+0000 7f228c00f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:23.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.250+0000 7f228c00f800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T17:44:23.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.251+0000 7f228c00f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:23.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.252+0000 7f228c00f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:23.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.252+0000 7f228c00f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:23.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.253+0000 7f228c00f800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T17:44:23.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.255+0000 7f228c00f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:23.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.255+0000 7f228c00f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:23.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.256+0000 7f228c00f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:23.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.257+0000 7f228c00f800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T17:44:23.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.258+0000 7f228c00f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:23.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.258+0000 7f228c00f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:23.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.259+0000 7f228c00f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:23.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.260+0000 7f228c00f800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T17:44:23.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.261+0000 7f228c00f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:23.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.261+0000 7f228c00f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:23.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.262+0000 7f228c00f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:23.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.263+0000 7f228c00f800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T17:44:23.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.264+0000 7f228c00f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:23.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.264+0000 7f228c00f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:23.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.265+0000 7f228c00f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:23.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.266+0000 7f228c00f800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T17:44:23.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.267+0000 7f228c00f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:23.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.267+0000 7f228c00f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:23.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.268+0000 7f228c00f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:23.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.269+0000 7f228c00f800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T17:44:23.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.270+0000 7f228c00f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:23.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.271+0000 7f228c00f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:23.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.271+0000 7f228c00f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:23.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.272+0000 7f228c00f800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T17:44:23.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.273+0000 7f228c00f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:23.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.274+0000 7f228c00f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:23.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.274+0000 7f228c00f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:23.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.275+0000 7f228c00f800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T17:44:23.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.276+0000 7f228c00f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:23.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.277+0000 7f228c00f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:23.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.277+0000 7f228c00f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:23.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.278+0000 7f228c00f800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T17:44:23.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.280+0000 7f228c00f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:23.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.280+0000 7f228c00f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:23.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.281+0000 7f228c00f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:23.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.282+0000 7f228c00f800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T17:44:23.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.283+0000 7f228c00f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:23.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.284+0000 7f228c00f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:23.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.284+0000 7f228c00f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:23.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.285+0000 7f228c00f800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T17:44:23.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.287+0000 7f228c00f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:23.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.287+0000 7f228c00f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:23.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.288+0000 7f228c00f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:23.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.289+0000 7f228c00f800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T17:44:23.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.290+0000 7f228c00f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:23.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.290+0000 7f228c00f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:23.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.291+0000 7f228c00f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:23.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.291+0000 7f228c00f800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T17:44:23.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.293+0000 7f228c00f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:23.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.294+0000 7f228c00f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:23.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.294+0000 7f228c00f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:23.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.295+0000 7f228c00f800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T17:44:23.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.296+0000 7f228c00f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:23.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.297+0000 7f228c00f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:23.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.297+0000 7f228c00f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:23.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.298+0000 7f228c00f800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T17:44:23.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.300+0000 7f228c00f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:23.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.300+0000 7f228c00f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:23.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.301+0000 7f228c00f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:23.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.302+0000 7f228c00f800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T17:44:23.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.303+0000 7f228c00f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:23.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.304+0000 7f228c00f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:23.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.304+0000 7f228c00f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:23.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.305+0000 7f228c00f800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T17:44:23.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.307+0000 7f228c00f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:23.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.307+0000 7f228c00f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:23.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.308+0000 7f228c00f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:23.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.309+0000 7f228c00f800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T17:44:23.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.310+0000 7f228c00f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:23.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.310+0000 7f228c00f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:23.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.311+0000 7f228c00f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:23.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.311+0000 7f228c00f800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T17:44:23.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.313+0000 7f228c00f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:23.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.313+0000 7f228c00f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:23.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.313+0000 7f228c00f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:23.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.315+0000 7f228c00f800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T17:44:23.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.316+0000 7f228c00f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:23.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.317+0000 7f228c00f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:23.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.317+0000 7f228c00f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:23.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.318+0000 7f228c00f800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T17:44:23.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.320+0000 7f228c00f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:23.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.320+0000 7f228c00f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:23.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.321+0000 7f228c00f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:23.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.322+0000 7f228c00f800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T17:44:23.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.323+0000 7f228c00f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:23.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.323+0000 7f228c00f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:23.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.324+0000 7f228c00f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:23.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.325+0000 7f228c00f800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T17:44:23.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.326+0000 7f228c00f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:23.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.327+0000 7f228c00f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:23.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.327+0000 7f228c00f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:23.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.329+0000 7f228c00f800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T17:44:23.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.330+0000 7f228c00f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:23.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.330+0000 7f228c00f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:23.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.331+0000 7f228c00f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:23.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.332+0000 7f228c00f800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T17:44:23.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.333+0000 7f228c00f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:23.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.334+0000 7f228c00f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:23.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.335+0000 7f228c00f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:23.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.336+0000 7f228c00f800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T17:44:23.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.337+0000 7f228c00f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:23.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.338+0000 7f228c00f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:23.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.338+0000 7f228c00f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:23.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.339+0000 7f228c00f800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T17:44:23.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.342+0000 7f228c00f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:23.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.342+0000 7f228c00f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:23.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.343+0000 7f228c00f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:23.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.343+0000 7f228c00f800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T17:44:23.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.345+0000 7f228c00f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:23.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.345+0000 7f228c00f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:23.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.346+0000 7f228c00f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:23.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.347+0000 7f213b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:44:23.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.350+0000 7f228c00f800 20 remove_watcher() i=0 2024-09-12T17:44:23.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.350+0000 7f228c00f800 2 removed watcher, disabling cache 2024-09-12T17:44:23.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.351+0000 7f228c00f800 20 remove_watcher() i=1 2024-09-12T17:44:23.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.352+0000 7f228c00f800 20 remove_watcher() i=2 2024-09-12T17:44:23.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.352+0000 7f228c00f800 20 remove_watcher() i=3 2024-09-12T17:44:23.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.353+0000 7f228c00f800 20 remove_watcher() i=4 2024-09-12T17:44:23.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.354+0000 7f228c00f800 20 remove_watcher() i=5 2024-09-12T17:44:23.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.355+0000 7f228c00f800 20 remove_watcher() i=6 2024-09-12T17:44:23.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.357+0000 7f228c00f800 20 remove_watcher() i=7 2024-09-12T17:44:23.370 DEBUG:teuthology.orchestra.run.smithi037:> radosgw-admin gc process --include-all 2024-09-12T17:44:23.423 INFO:teuthology.orchestra.run.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:44:23.423 INFO:teuthology.orchestra.run.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:44:23.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.462+0000 7f2c82b2e800 20 rados->read ofs=0 len=0 2024-09-12T17:44:23.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.463+0000 7f2c82b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:23.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.463+0000 7f2c82b2e800 20 realm 2024-09-12T17:44:23.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.463+0000 7f2c82b2e800 20 rados->read ofs=0 len=0 2024-09-12T17:44:23.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.463+0000 7f2c82b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:23.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.463+0000 7f2c82b2e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:44:23.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.463+0000 7f2c82b2e800 20 rados->read ofs=0 len=0 2024-09-12T17:44:23.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.463+0000 7f2c82b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:23.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.463+0000 7f2c82b2e800 20 rados->read ofs=0 len=0 2024-09-12T17:44:23.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.464+0000 7f2c82b2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:44:23.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.464+0000 7f2c82b2e800 20 rados->read ofs=0 len=0 2024-09-12T17:44:23.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.465+0000 7f2c82b2e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:44:23.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.465+0000 7f2c82b2e800 20 searching for the correct realm 2024-09-12T17:44:23.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.468+0000 7f2c760dc640 0 -- 172.21.15.37:0/1804465802 >> [v2:172.21.15.37:6816/2964054205,v1:172.21.15.37:6817/2964054205] conn(0x5610549d1400 msgr2=0x5610549d38c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:44:23.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.472+0000 7f2c7e8dd640 0 -- 172.21.15.37:0/1804465802 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7f2c6806f130 msgr2=0x7f2c68099900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:44:23.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.476+0000 7f2c82b2e800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:44:23.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.476+0000 7f2c82b2e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:44:23.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.476+0000 7f2c82b2e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:44:23.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.476+0000 7f2c82b2e800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:44:23.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.476+0000 7f2c82b2e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:44:23.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.476+0000 7f2c82b2e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:44:23.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.476+0000 7f2c82b2e800 20 rados->read ofs=0 len=0 2024-09-12T17:44:23.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.476+0000 7f2c82b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:23.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.476+0000 7f2c82b2e800 20 rados->read ofs=0 len=0 2024-09-12T17:44:23.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.477+0000 7f2c82b2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:44:23.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.477+0000 7f2c82b2e800 20 rados->read ofs=0 len=0 2024-09-12T17:44:23.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.477+0000 7f2c82b2e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:44:23.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.477+0000 7f2c82b2e800 20 zone default found 2024-09-12T17:44:23.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.477+0000 7f2c82b2e800 4 Realm: () 2024-09-12T17:44:23.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.477+0000 7f2c82b2e800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:44:23.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.477+0000 7f2c82b2e800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:44:23.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.477+0000 7f2c82b2e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:44:23.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.477+0000 7f2c82b2e800 20 zonegroup default 2024-09-12T17:44:23.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.477+0000 7f2c82b2e800 20 rados->read ofs=0 len=0 2024-09-12T17:44:23.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.477+0000 7f2c82b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:23.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.477+0000 7f2c82b2e800 20 rados->read ofs=0 len=0 2024-09-12T17:44:23.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.478+0000 7f2c82b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:23.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.478+0000 7f2c82b2e800 20 rados->read ofs=0 len=0 2024-09-12T17:44:23.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.478+0000 7f2c82b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:23.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.478+0000 7f2c82b2e800 20 started sync module instance, tier type = 2024-09-12T17:44:23.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.478+0000 7f2c82b2e800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:44:23.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.488+0000 7f2c82b2e800 20 add_watcher() i=0 2024-09-12T17:44:23.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.488+0000 7f2c82b2e800 20 add_watcher() i=1 2024-09-12T17:44:23.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.488+0000 7f2c82b2e800 20 add_watcher() i=2 2024-09-12T17:44:23.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.488+0000 7f2c82b2e800 20 add_watcher() i=3 2024-09-12T17:44:23.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.488+0000 7f2c82b2e800 20 add_watcher() i=4 2024-09-12T17:44:23.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.488+0000 7f2c82b2e800 20 add_watcher() i=5 2024-09-12T17:44:23.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.488+0000 7f2c82b2e800 20 add_watcher() i=6 2024-09-12T17:44:23.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.489+0000 7f2c82b2e800 20 add_watcher() i=7 2024-09-12T17:44:23.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.489+0000 7f2c82b2e800 2 all 8 watchers are set, enabling cache 2024-09-12T17:44:23.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.490+0000 7f2b357e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:44:23.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.491+0000 7f2c82b2e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:44:23.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.491+0000 7f2c82b2e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:44:23.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.527+0000 7f2aaffff640 20 reqs_thread_entry: start 2024-09-12T17:44:23.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.527+0000 7f2c82b2e800 20 init_complete bucket index max shards: 11 2024-09-12T17:44:23.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.527+0000 7f2c82b2e800 20 Filter name: none 2024-09-12T17:44:23.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.527+0000 7f2aadffb640 20 reqs_thread_entry: start 2024-09-12T17:44:23.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.527+0000 7f2c82b2e800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T17:44:23.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.529+0000 7f2c82b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:23.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.529+0000 7f2c82b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:23.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.529+0000 7f2c82b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:23.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.530+0000 7f2c82b2e800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T17:44:23.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.531+0000 7f2c82b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:23.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.532+0000 7f2c82b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:23.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.532+0000 7f2c82b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:23.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.533+0000 7f2c82b2e800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T17:44:23.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.535+0000 7f2c82b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:23.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.536+0000 7f2c82b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:23.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.536+0000 7f2c82b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:23.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.537+0000 7f2c82b2e800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T17:44:23.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.538+0000 7f2c82b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:23.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.539+0000 7f2c82b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:23.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.539+0000 7f2c82b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:23.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.540+0000 7f2c82b2e800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T17:44:23.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.542+0000 7f2c82b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:23.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.542+0000 7f2c82b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:23.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.542+0000 7f2c82b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:23.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.543+0000 7f2c82b2e800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T17:44:23.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.544+0000 7f2c82b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:23.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.545+0000 7f2c82b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:23.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.545+0000 7f2c82b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:23.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.546+0000 7f2c82b2e800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T17:44:23.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.547+0000 7f2c82b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:23.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.548+0000 7f2c82b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:23.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.548+0000 7f2c82b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:23.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.549+0000 7f2c82b2e800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T17:44:23.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.550+0000 7f2c82b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:23.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.551+0000 7f2c82b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:23.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.551+0000 7f2c82b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:23.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.552+0000 7f2c82b2e800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T17:44:23.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.553+0000 7f2c82b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:23.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.554+0000 7f2c82b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:23.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.554+0000 7f2c82b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:23.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.555+0000 7f2c82b2e800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T17:44:23.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.557+0000 7f2c82b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:23.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.557+0000 7f2c82b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:23.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.558+0000 7f2c82b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:23.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.559+0000 7f2c82b2e800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T17:44:23.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.560+0000 7f2c82b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:23.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.561+0000 7f2c82b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:23.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.561+0000 7f2c82b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:23.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.562+0000 7f2c82b2e800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T17:44:23.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.563+0000 7f2c82b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:23.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.564+0000 7f2c82b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:23.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.564+0000 7f2c82b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:23.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.565+0000 7f2c82b2e800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T17:44:23.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.567+0000 7f2c82b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:23.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.567+0000 7f2c82b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:23.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.567+0000 7f2c82b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:23.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.569+0000 7f2c82b2e800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T17:44:23.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.570+0000 7f2c82b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:23.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.570+0000 7f2c82b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:23.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.571+0000 7f2c82b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:23.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.572+0000 7f2c82b2e800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T17:44:23.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.574+0000 7f2c82b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:23.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.574+0000 7f2c82b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:23.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.575+0000 7f2c82b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:23.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.576+0000 7f2c82b2e800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T17:44:23.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.577+0000 7f2c82b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:23.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.577+0000 7f2c82b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:23.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.578+0000 7f2c82b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:23.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.579+0000 7f2c82b2e800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T17:44:23.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.580+0000 7f2c82b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:23.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.581+0000 7f2c82b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:23.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.581+0000 7f2c82b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:23.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.582+0000 7f2c82b2e800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T17:44:23.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.583+0000 7f2c82b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:23.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.584+0000 7f2c82b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:23.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.584+0000 7f2c82b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:23.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.585+0000 7f2c82b2e800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T17:44:23.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.587+0000 7f2c82b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:23.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.587+0000 7f2c82b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:23.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.587+0000 7f2c82b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:23.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.588+0000 7f2c82b2e800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T17:44:23.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.589+0000 7f2c82b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:23.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.590+0000 7f2c82b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:23.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.590+0000 7f2c82b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:23.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.591+0000 7f2c82b2e800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T17:44:23.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.592+0000 7f2c82b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:23.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.593+0000 7f2c82b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:23.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.593+0000 7f2c82b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:23.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.594+0000 7f2c82b2e800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T17:44:23.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.596+0000 7f2c82b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:23.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.596+0000 7f2c82b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:23.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.596+0000 7f2c82b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:23.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.597+0000 7f2c82b2e800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T17:44:23.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.599+0000 7f2c82b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:23.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.599+0000 7f2c82b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:23.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.599+0000 7f2c82b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:23.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.601+0000 7f2c82b2e800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T17:44:23.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.602+0000 7f2c82b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:23.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.602+0000 7f2c82b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:23.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.602+0000 7f2c82b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:23.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.603+0000 7f2c82b2e800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T17:44:23.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.605+0000 7f2c82b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:23.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.605+0000 7f2c82b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:23.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.605+0000 7f2c82b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:23.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.606+0000 7f2c82b2e800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T17:44:23.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.609+0000 7f2c82b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:23.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.609+0000 7f2c82b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:23.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.610+0000 7f2c82b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:23.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.611+0000 7f2c82b2e800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T17:44:23.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.612+0000 7f2c82b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:23.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.612+0000 7f2c82b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:23.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.613+0000 7f2c82b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:23.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.614+0000 7f2c82b2e800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T17:44:23.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.615+0000 7f2c82b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:23.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.615+0000 7f2c82b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:23.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.616+0000 7f2c82b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:23.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.617+0000 7f2c82b2e800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T17:44:23.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.618+0000 7f2c82b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:23.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.619+0000 7f2c82b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:23.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.619+0000 7f2c82b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:23.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.620+0000 7f2c82b2e800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T17:44:23.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.621+0000 7f2c82b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:23.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.622+0000 7f2c82b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:23.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.622+0000 7f2c82b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:23.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.623+0000 7f2c82b2e800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T17:44:23.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.625+0000 7f2c82b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:23.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.625+0000 7f2c82b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:23.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.625+0000 7f2c82b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:23.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.627+0000 7f2c82b2e800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T17:44:23.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.628+0000 7f2c82b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:23.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.629+0000 7f2c82b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:23.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.629+0000 7f2c82b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:23.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.631+0000 7f2b357e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:44:23.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.633+0000 7f2c82b2e800 20 remove_watcher() i=0 2024-09-12T17:44:23.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.633+0000 7f2c82b2e800 2 removed watcher, disabling cache 2024-09-12T17:44:23.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.634+0000 7f2c82b2e800 20 remove_watcher() i=1 2024-09-12T17:44:23.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.635+0000 7f2c82b2e800 20 remove_watcher() i=2 2024-09-12T17:44:23.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.636+0000 7f2c82b2e800 20 remove_watcher() i=3 2024-09-12T17:44:23.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.637+0000 7f2c82b2e800 20 remove_watcher() i=4 2024-09-12T17:44:23.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.638+0000 7f2c82b2e800 20 remove_watcher() i=5 2024-09-12T17:44:23.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.639+0000 7f2c82b2e800 20 remove_watcher() i=6 2024-09-12T17:44:23.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.640+0000 7f2c82b2e800 20 remove_watcher() i=7 2024-09-12T17:44:23.653 DEBUG:teuthology.orchestra.run.smithi037:> radosgw-admin gc process --include-all 2024-09-12T17:44:23.710 INFO:teuthology.orchestra.run.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:44:23.710 INFO:teuthology.orchestra.run.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:44:23.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.748+0000 7f2ff4215800 20 rados->read ofs=0 len=0 2024-09-12T17:44:23.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.749+0000 7f2ff4215800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:23.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.749+0000 7f2ff4215800 20 realm 2024-09-12T17:44:23.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.749+0000 7f2ff4215800 20 rados->read ofs=0 len=0 2024-09-12T17:44:23.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.749+0000 7f2ff4215800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:23.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.749+0000 7f2ff4215800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:44:23.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.749+0000 7f2ff4215800 20 rados->read ofs=0 len=0 2024-09-12T17:44:23.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.750+0000 7f2ff4215800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:23.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.750+0000 7f2ff4215800 20 rados->read ofs=0 len=0 2024-09-12T17:44:23.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.750+0000 7f2ff4215800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:44:23.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.750+0000 7f2ff4215800 20 rados->read ofs=0 len=0 2024-09-12T17:44:23.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.751+0000 7f2ff4215800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:44:23.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.751+0000 7f2ff4215800 20 searching for the correct realm 2024-09-12T17:44:23.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.753+0000 7f2fef191640 0 -- 172.21.15.37:0/4283895488 >> [v2:172.21.15.40:6800/2441293461,v1:172.21.15.40:6801/2441293461] conn(0x7f2fe0089040 msgr2=0x7f2fe0013af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:44:23.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.758+0000 7f2fef992640 0 -- 172.21.15.37:0/4283895488 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7f2fe409c940 msgr2=0x7f2fe4061400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:44:23.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.964+0000 7f2ff4215800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:44:23.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.964+0000 7f2ff4215800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:44:23.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.964+0000 7f2ff4215800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:44:23.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.964+0000 7f2ff4215800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:44:23.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.964+0000 7f2ff4215800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:44:23.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.964+0000 7f2ff4215800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:44:23.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.964+0000 7f2ff4215800 20 rados->read ofs=0 len=0 2024-09-12T17:44:23.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.965+0000 7f2ff4215800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:23.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.965+0000 7f2ff4215800 20 rados->read ofs=0 len=0 2024-09-12T17:44:23.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.965+0000 7f2ff4215800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:44:23.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.965+0000 7f2ff4215800 20 rados->read ofs=0 len=0 2024-09-12T17:44:23.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.966+0000 7f2ff4215800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:44:23.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.966+0000 7f2ff4215800 20 zone default found 2024-09-12T17:44:23.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.966+0000 7f2ff4215800 4 Realm: () 2024-09-12T17:44:23.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.966+0000 7f2ff4215800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:44:23.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.966+0000 7f2ff4215800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:44:23.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.966+0000 7f2ff4215800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:44:23.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.966+0000 7f2ff4215800 20 zonegroup default 2024-09-12T17:44:23.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.966+0000 7f2ff4215800 20 rados->read ofs=0 len=0 2024-09-12T17:44:23.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.966+0000 7f2ff4215800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:23.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.966+0000 7f2ff4215800 20 rados->read ofs=0 len=0 2024-09-12T17:44:23.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.966+0000 7f2ff4215800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:23.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.966+0000 7f2ff4215800 20 rados->read ofs=0 len=0 2024-09-12T17:44:23.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.967+0000 7f2ff4215800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:23.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.967+0000 7f2ff4215800 20 started sync module instance, tier type = 2024-09-12T17:44:23.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.967+0000 7f2ff4215800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:44:23.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.976+0000 7f2ff4215800 20 add_watcher() i=0 2024-09-12T17:44:23.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.976+0000 7f2ff4215800 20 add_watcher() i=1 2024-09-12T17:44:23.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.976+0000 7f2ff4215800 20 add_watcher() i=2 2024-09-12T17:44:23.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.976+0000 7f2ff4215800 20 add_watcher() i=3 2024-09-12T17:44:23.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.976+0000 7f2ff4215800 20 add_watcher() i=4 2024-09-12T17:44:23.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.976+0000 7f2ff4215800 20 add_watcher() i=5 2024-09-12T17:44:23.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.976+0000 7f2ff4215800 20 add_watcher() i=6 2024-09-12T17:44:23.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.977+0000 7f2ff4215800 20 add_watcher() i=7 2024-09-12T17:44:23.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.977+0000 7f2ff4215800 2 all 8 watchers are set, enabling cache 2024-09-12T17:44:23.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.979+0000 7f2ea5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:44:23.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.979+0000 7f2ff4215800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:44:23.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:23.979+0000 7f2ff4215800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:44:24.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:24.016+0000 7f2ea4fe1640 20 reqs_thread_entry: start 2024-09-12T17:44:24.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:24.016+0000 7f2ff4215800 20 init_complete bucket index max shards: 11 2024-09-12T17:44:24.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:24.016+0000 7f2ff4215800 20 Filter name: none 2024-09-12T17:44:24.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:24.016+0000 7f2e1e7fc640 20 reqs_thread_entry: start 2024-09-12T17:44:24.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:24.016+0000 7f2ff4215800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T17:44:24.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:24.018+0000 7f2ff4215800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:24.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:24.018+0000 7f2ff4215800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:24.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:24.019+0000 7f2ff4215800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:24.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:24.020+0000 7f2ff4215800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T17:44:24.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:24.021+0000 7f2ff4215800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:24.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:24.021+0000 7f2ff4215800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:24.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:24.022+0000 7f2ff4215800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:24.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:24.023+0000 7f2ff4215800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T17:44:24.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:24.024+0000 7f2ff4215800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:24.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:24.025+0000 7f2ff4215800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:24.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:24.025+0000 7f2ff4215800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:24.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:24.026+0000 7f2ff4215800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T17:44:24.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:24.027+0000 7f2ff4215800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:24.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:24.028+0000 7f2ff4215800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:24.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:24.028+0000 7f2ff4215800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:24.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:24.029+0000 7f2ff4215800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T17:44:24.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:24.030+0000 7f2ff4215800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:24.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:24.031+0000 7f2ff4215800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:24.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:24.031+0000 7f2ff4215800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:24.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:24.032+0000 7f2ff4215800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T17:44:24.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:24.034+0000 7f2ff4215800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:24.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:24.034+0000 7f2ff4215800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:24.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:24.034+0000 7f2ff4215800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:24.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:24.036+0000 7f2ff4215800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T17:44:24.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:24.037+0000 7f2ff4215800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:24.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:24.038+0000 7f2ff4215800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:24.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:24.038+0000 7f2ff4215800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:24.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:24.039+0000 7f2ff4215800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T17:44:24.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:24.040+0000 7f2ff4215800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:24.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:24.041+0000 7f2ff4215800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:24.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:24.041+0000 7f2ff4215800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:24.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:24.042+0000 7f2ff4215800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T17:44:24.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:24.044+0000 7f2ff4215800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:24.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:24.044+0000 7f2ff4215800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:24.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:24.044+0000 7f2ff4215800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:24.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:24.045+0000 7f2ff4215800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T17:44:24.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:24.047+0000 7f2ff4215800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:24.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:24.047+0000 7f2ff4215800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:24.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:24.047+0000 7f2ff4215800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:24.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:24.048+0000 7f2ff4215800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T17:44:24.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:24.050+0000 7f2ff4215800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:24.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:24.050+0000 7f2ff4215800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:24.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:24.050+0000 7f2ff4215800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:24.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:24.051+0000 7f2ff4215800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T17:44:24.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:24.053+0000 7f2ff4215800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:24.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:24.054+0000 7f2ff4215800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:24.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:24.054+0000 7f2ff4215800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:24.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:24.055+0000 7f2ff4215800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T17:44:24.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:24.056+0000 7f2ff4215800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:24.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:24.057+0000 7f2ff4215800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:24.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:24.057+0000 7f2ff4215800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:24.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:24.058+0000 7f2ff4215800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T17:44:24.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:24.060+0000 7f2ff4215800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:24.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:24.060+0000 7f2ff4215800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:24.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:24.060+0000 7f2ff4215800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:24.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:24.061+0000 7f2ff4215800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T17:44:24.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:24.063+0000 7f2ff4215800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:24.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:24.063+0000 7f2ff4215800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:24.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:24.063+0000 7f2ff4215800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:24.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:24.064+0000 7f2ff4215800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T17:44:24.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:24.066+0000 7f2ff4215800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:24.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:24.066+0000 7f2ff4215800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:24.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:24.066+0000 7f2ff4215800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:24.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:24.067+0000 7f2ff4215800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T17:44:24.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:24.069+0000 7f2ff4215800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:24.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:24.069+0000 7f2ff4215800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:24.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:24.069+0000 7f2ff4215800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:24.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:24.070+0000 7f2ff4215800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T17:44:24.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:24.072+0000 7f2ff4215800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:24.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:24.072+0000 7f2ff4215800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:24.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:24.072+0000 7f2ff4215800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:24.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:24.073+0000 7f2ff4215800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T17:44:24.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:24.074+0000 7f2ff4215800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:24.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:24.075+0000 7f2ff4215800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:24.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:24.075+0000 7f2ff4215800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:24.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:24.076+0000 7f2ff4215800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T17:44:24.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:24.078+0000 7f2ff4215800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:24.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:24.078+0000 7f2ff4215800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:24.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:24.078+0000 7f2ff4215800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:24.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:24.079+0000 7f2ff4215800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T17:44:24.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:24.081+0000 7f2ff4215800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:24.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:24.081+0000 7f2ff4215800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:24.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:24.082+0000 7f2ff4215800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:24.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:24.083+0000 7f2ff4215800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T17:44:24.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:24.084+0000 7f2ff4215800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:24.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:24.084+0000 7f2ff4215800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:24.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:24.085+0000 7f2ff4215800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:24.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:24.085+0000 7f2ff4215800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T17:44:24.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:24.087+0000 7f2ff4215800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:24.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:24.087+0000 7f2ff4215800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:24.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:24.088+0000 7f2ff4215800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:24.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:24.089+0000 7f2ff4215800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T17:44:24.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:24.090+0000 7f2ff4215800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:24.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:24.090+0000 7f2ff4215800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:24.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:24.091+0000 7f2ff4215800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:24.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:24.092+0000 7f2ff4215800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T17:44:24.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:24.093+0000 7f2ff4215800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:24.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:24.093+0000 7f2ff4215800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:24.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:24.094+0000 7f2ff4215800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:24.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:24.095+0000 7f2ff4215800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T17:44:24.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:24.096+0000 7f2ff4215800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:24.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:24.097+0000 7f2ff4215800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:24.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:24.097+0000 7f2ff4215800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:24.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:24.098+0000 7f2ff4215800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T17:44:24.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:24.099+0000 7f2ff4215800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:24.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:24.099+0000 7f2ff4215800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:24.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:24.100+0000 7f2ff4215800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:24.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:24.101+0000 7f2ff4215800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T17:44:24.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:24.102+0000 7f2ff4215800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:24.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:24.103+0000 7f2ff4215800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:24.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:24.103+0000 7f2ff4215800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:24.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:24.104+0000 7f2ff4215800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T17:44:24.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:24.105+0000 7f2ff4215800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:24.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:24.106+0000 7f2ff4215800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:24.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:24.106+0000 7f2ff4215800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:24.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:24.107+0000 7f2ff4215800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T17:44:24.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:24.108+0000 7f2ff4215800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:24.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:24.109+0000 7f2ff4215800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:24.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:24.109+0000 7f2ff4215800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:24.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:24.110+0000 7f2ff4215800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T17:44:24.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:24.111+0000 7f2ff4215800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:24.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:24.112+0000 7f2ff4215800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:24.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:24.112+0000 7f2ff4215800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:24.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:24.113+0000 7f2ff4215800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T17:44:24.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:24.114+0000 7f2ff4215800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:24.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:24.115+0000 7f2ff4215800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:24.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:24.115+0000 7f2ff4215800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:24.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:24.117+0000 7f2ea5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:44:24.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:24.119+0000 7f2ff4215800 20 remove_watcher() i=0 2024-09-12T17:44:24.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:24.119+0000 7f2ff4215800 2 removed watcher, disabling cache 2024-09-12T17:44:24.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:24.120+0000 7f2ff4215800 20 remove_watcher() i=1 2024-09-12T17:44:24.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:24.121+0000 7f2ff4215800 20 remove_watcher() i=2 2024-09-12T17:44:24.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:24.122+0000 7f2ff4215800 20 remove_watcher() i=3 2024-09-12T17:44:24.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:24.123+0000 7f2ff4215800 20 remove_watcher() i=4 2024-09-12T17:44:24.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:24.124+0000 7f2ff4215800 20 remove_watcher() i=5 2024-09-12T17:44:24.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:24.125+0000 7f2ff4215800 20 remove_watcher() i=6 2024-09-12T17:44:24.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:24.126+0000 7f2ff4215800 20 remove_watcher() i=7 2024-09-12T17:44:24.139 DEBUG:teuthology.orchestra.run.smithi037:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests BucketTest 2024-09-12T17:44:24.644 INFO:teuthology.orchestra.run.smithi037.stdout:> Task :clean 2024-09-12T17:44:25.540 INFO:teuthology.orchestra.run.smithi037.stdout:> Task :compileJava 2024-09-12T17:44:25.540 INFO:teuthology.orchestra.run.smithi037.stdout:> Task :processResources 2024-09-12T17:44:25.540 INFO:teuthology.orchestra.run.smithi037.stdout:> Task :classes 2024-09-12T17:44:26.140 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:44:26.140 INFO:teuthology.orchestra.run.smithi037.stdout:> Task :compileTestJava 2024-09-12T17:44:26.140 INFO:teuthology.orchestra.run.smithi037.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-09-12T17:44:26.141 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:44:26.141 INFO:teuthology.orchestra.run.smithi037.stdout:> Task :processTestResources NO-SOURCE 2024-09-12T17:44:26.141 INFO:teuthology.orchestra.run.smithi037.stdout:> Task :testClasses 2024-09-12T17:44:26.141 INFO:teuthology.orchestra.run.smithi037.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-09-12T17:44:28.041 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:44:28.041 INFO:teuthology.orchestra.run.smithi037.stdout:> Task :test 2024-09-12T17:44:28.041 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:44:28.041 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Bucket tests STANDARD_OUT 2024-09-12T17:44:28.041 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12 17:44:27,361 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-09-12T17:44:28.041 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:44:28.041 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectEmpty STARTED 2024-09-12T17:44:28.042 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:44:28.042 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectEmpty PASSED 2024-09-12T17:44:28.042 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:44:28.042 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectMismatch STARTED 2024-09-12T17:44:28.042 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:44:28.042 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectMismatch PASSED 2024-09-12T17:44:28.340 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:44:28.340 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectUnreadable STARTED 2024-09-12T17:44:28.340 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:44:28.340 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectUnreadable PASSED 2024-09-12T17:44:28.739 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:44:28.739 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Bucket tests > BucketTest.testBucketCreateReadDelete STARTED 2024-09-12T17:44:28.939 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:44:28.939 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Bucket tests > BucketTest.testBucketCreateReadDelete PASSED 2024-09-12T17:44:29.039 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:44:29.039 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNonEmpty STARTED 2024-09-12T17:44:29.239 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:44:29.240 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNonEmpty PASSED 2024-09-12T17:44:29.640 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:44:29.640 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNotExist STARTED 2024-09-12T17:44:29.640 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:44:29.640 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNotExist PASSED 2024-09-12T17:44:29.739 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:44:29.739 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Bucket tests > BucketTest.testBucketListDistinct STARTED 2024-09-12T17:44:29.939 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:44:29.940 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Bucket tests > BucketTest.testBucketListDistinct PASSED 2024-09-12T17:44:30.639 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:44:30.640 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Bucket tests > BucketTest.testBucketListEmpty STARTED 2024-09-12T17:44:30.739 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:44:30.739 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Bucket tests > BucketTest.testBucketListEmpty PASSED 2024-09-12T17:44:31.039 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:44:31.039 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Bucket tests > BucketTest.testBucketNotExist STARTED 2024-09-12T17:44:31.139 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:44:31.139 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Bucket tests > BucketTest.testBucketNotExist PASSED 2024-09-12T17:44:31.213 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:44:31.213 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------- 2024-09-12T17:44:31.213 INFO:teuthology.orchestra.run.smithi037.stdout:| Results: SUCCESS (9 tests, 9 successes, 0 failures, 0 skipped) | 2024-09-12T17:44:31.213 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------- 2024-09-12T17:44:31.213 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:44:31.213 INFO:teuthology.orchestra.run.smithi037.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-09-12T17:44:31.213 INFO:teuthology.orchestra.run.smithi037.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-09-12T17:44:31.213 INFO:teuthology.orchestra.run.smithi037.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-09-12T17:44:31.214 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:44:31.214 INFO:teuthology.orchestra.run.smithi037.stdout:BUILD SUCCESSFUL in 6s 2024-09-12T17:44:31.214 INFO:teuthology.orchestra.run.smithi037.stdout:5 actionable tasks: 5 executed 2024-09-12T17:44:31.217 DEBUG:teuthology.orchestra.run.smithi037:> radosgw-admin gc process --include-all 2024-09-12T17:44:31.273 INFO:teuthology.orchestra.run.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:44:31.273 INFO:teuthology.orchestra.run.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:44:31.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.317+0000 7f670be98800 20 rados->read ofs=0 len=0 2024-09-12T17:44:31.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.318+0000 7f670be98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:31.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.318+0000 7f670be98800 20 realm 2024-09-12T17:44:31.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.318+0000 7f670be98800 20 rados->read ofs=0 len=0 2024-09-12T17:44:31.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.318+0000 7f670be98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:31.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.318+0000 7f670be98800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:44:31.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.318+0000 7f670be98800 20 rados->read ofs=0 len=0 2024-09-12T17:44:31.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.318+0000 7f670be98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:31.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.318+0000 7f670be98800 20 rados->read ofs=0 len=0 2024-09-12T17:44:31.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.319+0000 7f670be98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:44:31.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.319+0000 7f670be98800 20 rados->read ofs=0 len=0 2024-09-12T17:44:31.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.320+0000 7f670be98800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:44:31.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.320+0000 7f670be98800 20 searching for the correct realm 2024-09-12T17:44:31.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.323+0000 7f6709188640 0 -- 172.21.15.37:0/913113627 >> [v2:172.21.15.40:6800/2441293461,v1:172.21.15.40:6801/2441293461] conn(0x7f66fc06fb90 msgr2=0x7f66fc069a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:44:31.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.327+0000 7f6709989640 0 -- 172.21.15.37:0/913113627 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7f67000b6960 msgr2=0x7f67000873f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:44:31.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.534+0000 7f670be98800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:44:31.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.534+0000 7f670be98800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:44:31.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.534+0000 7f670be98800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:44:31.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.534+0000 7f670be98800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:44:31.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.534+0000 7f670be98800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:44:31.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.534+0000 7f670be98800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:44:31.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.534+0000 7f670be98800 20 rados->read ofs=0 len=0 2024-09-12T17:44:31.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.535+0000 7f670be98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:31.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.535+0000 7f670be98800 20 rados->read ofs=0 len=0 2024-09-12T17:44:31.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.535+0000 7f670be98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:44:31.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.535+0000 7f670be98800 20 rados->read ofs=0 len=0 2024-09-12T17:44:31.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.535+0000 7f670be98800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:44:31.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.535+0000 7f670be98800 20 zone default found 2024-09-12T17:44:31.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.535+0000 7f670be98800 4 Realm: () 2024-09-12T17:44:31.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.535+0000 7f670be98800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:44:31.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.535+0000 7f670be98800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:44:31.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.535+0000 7f670be98800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:44:31.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.535+0000 7f670be98800 20 zonegroup default 2024-09-12T17:44:31.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.535+0000 7f670be98800 20 rados->read ofs=0 len=0 2024-09-12T17:44:31.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.536+0000 7f670be98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:31.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.536+0000 7f670be98800 20 rados->read ofs=0 len=0 2024-09-12T17:44:31.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.536+0000 7f670be98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:31.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.536+0000 7f670be98800 20 rados->read ofs=0 len=0 2024-09-12T17:44:31.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.536+0000 7f670be98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:31.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.536+0000 7f670be98800 20 started sync module instance, tier type = 2024-09-12T17:44:31.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.536+0000 7f670be98800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:44:31.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.546+0000 7f670be98800 20 add_watcher() i=0 2024-09-12T17:44:31.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.546+0000 7f670be98800 20 add_watcher() i=1 2024-09-12T17:44:31.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.546+0000 7f670be98800 20 add_watcher() i=2 2024-09-12T17:44:31.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.546+0000 7f670be98800 20 add_watcher() i=3 2024-09-12T17:44:31.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.546+0000 7f670be98800 20 add_watcher() i=4 2024-09-12T17:44:31.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.546+0000 7f670be98800 20 add_watcher() i=5 2024-09-12T17:44:31.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.546+0000 7f670be98800 20 add_watcher() i=6 2024-09-12T17:44:31.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.547+0000 7f670be98800 20 add_watcher() i=7 2024-09-12T17:44:31.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.547+0000 7f670be98800 2 all 8 watchers are set, enabling cache 2024-09-12T17:44:31.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.549+0000 7f65bb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:44:31.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.549+0000 7f670be98800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:44:31.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.549+0000 7f670be98800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:44:31.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.589+0000 7f65ba7fc640 20 reqs_thread_entry: start 2024-09-12T17:44:31.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.589+0000 7f670be98800 20 init_complete bucket index max shards: 11 2024-09-12T17:44:31.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.589+0000 7f670be98800 20 Filter name: none 2024-09-12T17:44:31.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.589+0000 7f652bfff640 20 reqs_thread_entry: start 2024-09-12T17:44:31.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.589+0000 7f670be98800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T17:44:31.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.591+0000 7f670be98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:31.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.591+0000 7f670be98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:31.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.592+0000 7f670be98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:31.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.593+0000 7f670be98800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T17:44:31.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.594+0000 7f670be98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:31.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.594+0000 7f670be98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:31.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.595+0000 7f670be98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:31.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.596+0000 7f670be98800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T17:44:31.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.598+0000 7f670be98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:31.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.598+0000 7f670be98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:31.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.599+0000 7f670be98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:31.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.600+0000 7f670be98800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T17:44:31.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.602+0000 7f670be98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:31.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.603+0000 7f670be98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:31.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.603+0000 7f670be98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:31.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.604+0000 7f670be98800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T17:44:31.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.606+0000 7f670be98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:31.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.606+0000 7f670be98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:31.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.606+0000 7f670be98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:31.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.607+0000 7f670be98800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T17:44:31.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.609+0000 7f670be98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:31.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.610+0000 7f670be98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:31.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.610+0000 7f670be98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:31.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.611+0000 7f670be98800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T17:44:31.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.613+0000 7f670be98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:31.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.613+0000 7f670be98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:31.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.613+0000 7f670be98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:31.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.614+0000 7f670be98800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T17:44:31.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.616+0000 7f670be98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:31.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.616+0000 7f670be98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:31.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.616+0000 7f670be98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:31.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.617+0000 7f670be98800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T17:44:31.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.619+0000 7f670be98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:31.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.619+0000 7f670be98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:31.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.620+0000 7f670be98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:31.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.621+0000 7f670be98800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T17:44:31.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.622+0000 7f670be98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:31.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.623+0000 7f670be98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:31.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.623+0000 7f670be98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:31.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.624+0000 7f670be98800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T17:44:31.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.626+0000 7f670be98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:31.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.626+0000 7f670be98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:31.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.626+0000 7f670be98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:31.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.627+0000 7f670be98800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T17:44:31.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.629+0000 7f670be98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:31.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.629+0000 7f670be98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:31.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.630+0000 7f670be98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:31.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.631+0000 7f670be98800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T17:44:31.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.632+0000 7f670be98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:31.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.632+0000 7f670be98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:31.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.633+0000 7f670be98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:31.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.634+0000 7f670be98800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T17:44:31.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.635+0000 7f670be98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:31.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.635+0000 7f670be98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:31.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.636+0000 7f670be98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:31.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.638+0000 7f670be98800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T17:44:31.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.639+0000 7f670be98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:31.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.640+0000 7f670be98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:31.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.640+0000 7f670be98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:31.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.641+0000 7f670be98800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T17:44:31.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.643+0000 7f670be98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:31.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.643+0000 7f670be98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:31.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.643+0000 7f670be98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:31.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.644+0000 7f670be98800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T17:44:31.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.646+0000 7f670be98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:31.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.646+0000 7f670be98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:31.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.647+0000 7f670be98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:31.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.648+0000 7f670be98800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T17:44:31.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.649+0000 7f670be98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:31.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.649+0000 7f670be98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:31.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.650+0000 7f670be98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:31.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.651+0000 7f670be98800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T17:44:31.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.653+0000 7f670be98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:31.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.654+0000 7f670be98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:31.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.654+0000 7f670be98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:31.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.655+0000 7f670be98800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T17:44:31.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.656+0000 7f670be98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:31.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.657+0000 7f670be98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:31.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.657+0000 7f670be98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:31.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.658+0000 7f670be98800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T17:44:31.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.660+0000 7f670be98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:31.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.660+0000 7f670be98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:31.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.660+0000 7f670be98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:31.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.662+0000 7f670be98800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T17:44:31.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.663+0000 7f670be98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:31.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.664+0000 7f670be98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:31.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.664+0000 7f670be98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:31.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.665+0000 7f670be98800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T17:44:31.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.667+0000 7f670be98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:31.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.667+0000 7f670be98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:31.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.667+0000 7f670be98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:31.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.668+0000 7f670be98800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T17:44:31.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.670+0000 7f670be98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:31.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.670+0000 7f670be98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:31.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.670+0000 7f670be98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:31.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.671+0000 7f670be98800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T17:44:31.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.673+0000 7f670be98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:31.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.673+0000 7f670be98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:31.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.673+0000 7f670be98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:31.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.674+0000 7f670be98800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T17:44:31.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.676+0000 7f670be98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:31.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.676+0000 7f670be98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:31.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.677+0000 7f670be98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:31.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.678+0000 7f670be98800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T17:44:31.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.679+0000 7f670be98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:31.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.679+0000 7f670be98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:31.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.680+0000 7f670be98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:31.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.680+0000 7f670be98800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T17:44:31.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.682+0000 7f670be98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:31.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.682+0000 7f670be98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:31.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.682+0000 7f670be98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:31.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.683+0000 7f670be98800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T17:44:31.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.685+0000 7f670be98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:31.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.685+0000 7f670be98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:31.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.685+0000 7f670be98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:31.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.687+0000 7f670be98800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T17:44:31.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.689+0000 7f670be98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:31.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.689+0000 7f670be98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:31.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.689+0000 7f670be98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:31.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.690+0000 7f670be98800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T17:44:31.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.692+0000 7f670be98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:31.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.692+0000 7f670be98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:31.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.693+0000 7f670be98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:31.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.694+0000 7f670be98800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T17:44:31.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.695+0000 7f670be98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:31.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.696+0000 7f670be98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:31.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.696+0000 7f670be98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:31.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.698+0000 7f65bb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:44:31.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.701+0000 7f670be98800 20 remove_watcher() i=0 2024-09-12T17:44:31.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.701+0000 7f670be98800 2 removed watcher, disabling cache 2024-09-12T17:44:31.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.702+0000 7f670be98800 20 remove_watcher() i=1 2024-09-12T17:44:31.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.703+0000 7f670be98800 20 remove_watcher() i=2 2024-09-12T17:44:31.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.704+0000 7f670be98800 20 remove_watcher() i=3 2024-09-12T17:44:31.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.705+0000 7f670be98800 20 remove_watcher() i=4 2024-09-12T17:44:31.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.706+0000 7f670be98800 20 remove_watcher() i=5 2024-09-12T17:44:31.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.707+0000 7f670be98800 20 remove_watcher() i=6 2024-09-12T17:44:31.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.708+0000 7f670be98800 20 remove_watcher() i=7 2024-09-12T17:44:31.720 DEBUG:teuthology.orchestra.run.smithi037:> radosgw-admin gc process --include-all 2024-09-12T17:44:31.774 INFO:teuthology.orchestra.run.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:44:31.774 INFO:teuthology.orchestra.run.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:44:31.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.812+0000 7f5b4553d800 20 rados->read ofs=0 len=0 2024-09-12T17:44:31.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.814+0000 7f5b4553d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:31.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.814+0000 7f5b4553d800 20 realm 2024-09-12T17:44:31.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.814+0000 7f5b4553d800 20 rados->read ofs=0 len=0 2024-09-12T17:44:31.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.814+0000 7f5b4553d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:31.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.814+0000 7f5b4553d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:44:31.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.814+0000 7f5b4553d800 20 rados->read ofs=0 len=0 2024-09-12T17:44:31.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.814+0000 7f5b4553d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:31.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.814+0000 7f5b4553d800 20 rados->read ofs=0 len=0 2024-09-12T17:44:31.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.815+0000 7f5b4553d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:44:31.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.815+0000 7f5b4553d800 20 rados->read ofs=0 len=0 2024-09-12T17:44:31.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.815+0000 7f5b4553d800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:44:31.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.815+0000 7f5b4553d800 20 searching for the correct realm 2024-09-12T17:44:31.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.818+0000 7f5b40a29640 0 -- 172.21.15.37:0/2647553581 >> [v2:172.21.15.40:6800/2441293461,v1:172.21.15.40:6801/2441293461] conn(0x7f5b34038070 msgr2=0x7f5b3408c3d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:44:31.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:31.822+0000 7f5b4122a640 0 -- 172.21.15.37:0/2647553581 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7f5b3807a790 msgr2=0x7f5b3808f2a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:44:32.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.029+0000 7f5b4553d800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:44:32.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.029+0000 7f5b4553d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:44:32.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.029+0000 7f5b4553d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:44:32.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.029+0000 7f5b4553d800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:44:32.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.029+0000 7f5b4553d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:44:32.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.029+0000 7f5b4553d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:44:32.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.029+0000 7f5b4553d800 20 rados->read ofs=0 len=0 2024-09-12T17:44:32.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.030+0000 7f5b4553d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:32.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.030+0000 7f5b4553d800 20 rados->read ofs=0 len=0 2024-09-12T17:44:32.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.030+0000 7f5b4553d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:44:32.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.030+0000 7f5b4553d800 20 rados->read ofs=0 len=0 2024-09-12T17:44:32.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.030+0000 7f5b4553d800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:44:32.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.030+0000 7f5b4553d800 20 zone default found 2024-09-12T17:44:32.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.030+0000 7f5b4553d800 4 Realm: () 2024-09-12T17:44:32.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.030+0000 7f5b4553d800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:44:32.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.030+0000 7f5b4553d800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:44:32.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.030+0000 7f5b4553d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:44:32.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.030+0000 7f5b4553d800 20 zonegroup default 2024-09-12T17:44:32.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.030+0000 7f5b4553d800 20 rados->read ofs=0 len=0 2024-09-12T17:44:32.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.031+0000 7f5b4553d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:32.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.031+0000 7f5b4553d800 20 rados->read ofs=0 len=0 2024-09-12T17:44:32.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.031+0000 7f5b4553d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:32.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.031+0000 7f5b4553d800 20 rados->read ofs=0 len=0 2024-09-12T17:44:32.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.031+0000 7f5b4553d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:32.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.031+0000 7f5b4553d800 20 started sync module instance, tier type = 2024-09-12T17:44:32.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.031+0000 7f5b4553d800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:44:32.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.041+0000 7f5b4553d800 20 add_watcher() i=0 2024-09-12T17:44:32.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.041+0000 7f5b4553d800 20 add_watcher() i=1 2024-09-12T17:44:32.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.041+0000 7f5b4553d800 20 add_watcher() i=2 2024-09-12T17:44:32.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.041+0000 7f5b4553d800 20 add_watcher() i=3 2024-09-12T17:44:32.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.041+0000 7f5b4553d800 20 add_watcher() i=4 2024-09-12T17:44:32.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.041+0000 7f5b4553d800 20 add_watcher() i=5 2024-09-12T17:44:32.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.041+0000 7f5b4553d800 20 add_watcher() i=6 2024-09-12T17:44:32.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.042+0000 7f5b4553d800 20 add_watcher() i=7 2024-09-12T17:44:32.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.042+0000 7f5b4553d800 2 all 8 watchers are set, enabling cache 2024-09-12T17:44:32.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.044+0000 7f59f7fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:44:32.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.044+0000 7f5b4553d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:44:32.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.044+0000 7f5b4553d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:44:32.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.080+0000 7f59f6fe5640 20 reqs_thread_entry: start 2024-09-12T17:44:32.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.080+0000 7f5b4553d800 20 init_complete bucket index max shards: 11 2024-09-12T17:44:32.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.080+0000 7f5b4553d800 20 Filter name: none 2024-09-12T17:44:32.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.080+0000 7f59f4fe1640 20 reqs_thread_entry: start 2024-09-12T17:44:32.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.080+0000 7f5b4553d800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T17:44:32.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.082+0000 7f5b4553d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:32.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.082+0000 7f5b4553d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:32.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.082+0000 7f5b4553d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:32.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.083+0000 7f5b4553d800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T17:44:32.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.085+0000 7f5b4553d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:32.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.085+0000 7f5b4553d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:32.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.085+0000 7f5b4553d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:32.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.086+0000 7f5b4553d800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T17:44:32.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.088+0000 7f5b4553d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:32.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.088+0000 7f5b4553d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:32.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.088+0000 7f5b4553d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:32.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.089+0000 7f5b4553d800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T17:44:32.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.090+0000 7f5b4553d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:32.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.091+0000 7f5b4553d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:32.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.091+0000 7f5b4553d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:32.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.092+0000 7f5b4553d800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T17:44:32.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.093+0000 7f5b4553d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:32.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.094+0000 7f5b4553d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:32.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.094+0000 7f5b4553d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:32.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.095+0000 7f5b4553d800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T17:44:32.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.096+0000 7f5b4553d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:32.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.097+0000 7f5b4553d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:32.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.097+0000 7f5b4553d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:32.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.098+0000 7f5b4553d800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T17:44:32.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.101+0000 7f5b4553d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:32.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.102+0000 7f5b4553d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:32.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.102+0000 7f5b4553d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:32.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.103+0000 7f5b4553d800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T17:44:32.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.105+0000 7f5b4553d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:32.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.105+0000 7f5b4553d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:32.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.105+0000 7f5b4553d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:32.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.106+0000 7f5b4553d800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T17:44:32.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.108+0000 7f5b4553d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:32.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.108+0000 7f5b4553d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:32.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.108+0000 7f5b4553d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:32.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.109+0000 7f5b4553d800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T17:44:32.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.111+0000 7f5b4553d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:32.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.111+0000 7f5b4553d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:32.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.111+0000 7f5b4553d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:32.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.112+0000 7f5b4553d800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T17:44:32.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.114+0000 7f5b4553d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:32.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.114+0000 7f5b4553d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:32.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.115+0000 7f5b4553d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:32.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.115+0000 7f5b4553d800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T17:44:32.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.117+0000 7f5b4553d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:32.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.118+0000 7f5b4553d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:32.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.118+0000 7f5b4553d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:32.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.119+0000 7f5b4553d800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T17:44:32.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.120+0000 7f5b4553d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:32.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.121+0000 7f5b4553d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:32.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.121+0000 7f5b4553d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:32.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.122+0000 7f5b4553d800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T17:44:32.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.124+0000 7f5b4553d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:32.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.124+0000 7f5b4553d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:32.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.124+0000 7f5b4553d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:32.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.125+0000 7f5b4553d800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T17:44:32.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.127+0000 7f5b4553d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:32.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.127+0000 7f5b4553d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:32.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.128+0000 7f5b4553d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:32.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.129+0000 7f5b4553d800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T17:44:32.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.130+0000 7f5b4553d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:32.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.130+0000 7f5b4553d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:32.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.131+0000 7f5b4553d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:32.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.132+0000 7f5b4553d800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T17:44:32.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.133+0000 7f5b4553d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:32.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.133+0000 7f5b4553d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:32.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.134+0000 7f5b4553d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:32.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.135+0000 7f5b4553d800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T17:44:32.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.136+0000 7f5b4553d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:32.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.136+0000 7f5b4553d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:32.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.137+0000 7f5b4553d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:32.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.138+0000 7f5b4553d800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T17:44:32.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.139+0000 7f5b4553d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:32.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.140+0000 7f5b4553d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:32.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.140+0000 7f5b4553d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:32.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.141+0000 7f5b4553d800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T17:44:32.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.143+0000 7f5b4553d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:32.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.143+0000 7f5b4553d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:32.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.143+0000 7f5b4553d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:32.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.144+0000 7f5b4553d800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T17:44:32.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.146+0000 7f5b4553d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:32.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.146+0000 7f5b4553d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:32.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.146+0000 7f5b4553d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:32.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.147+0000 7f5b4553d800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T17:44:32.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.149+0000 7f5b4553d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:32.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.149+0000 7f5b4553d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:32.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.150+0000 7f5b4553d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:32.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.151+0000 7f5b4553d800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T17:44:32.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.152+0000 7f5b4553d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:32.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.153+0000 7f5b4553d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:32.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.153+0000 7f5b4553d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:32.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.154+0000 7f5b4553d800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T17:44:32.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.156+0000 7f5b4553d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:32.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.157+0000 7f5b4553d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:32.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.157+0000 7f5b4553d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:32.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.158+0000 7f5b4553d800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T17:44:32.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.159+0000 7f5b4553d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:32.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.159+0000 7f5b4553d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:32.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.160+0000 7f5b4553d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:32.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.161+0000 7f5b4553d800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T17:44:32.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.162+0000 7f5b4553d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:32.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.163+0000 7f5b4553d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:32.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.163+0000 7f5b4553d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:32.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.164+0000 7f5b4553d800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T17:44:32.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.165+0000 7f5b4553d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:32.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.166+0000 7f5b4553d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:32.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.166+0000 7f5b4553d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:32.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.167+0000 7f5b4553d800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T17:44:32.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.168+0000 7f5b4553d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:32.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.169+0000 7f5b4553d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:32.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.169+0000 7f5b4553d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:32.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.170+0000 7f5b4553d800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T17:44:32.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.171+0000 7f5b4553d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:32.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.171+0000 7f5b4553d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:32.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.172+0000 7f5b4553d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:32.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.173+0000 7f5b4553d800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T17:44:32.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.174+0000 7f5b4553d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:32.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.174+0000 7f5b4553d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:32.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.175+0000 7f5b4553d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:32.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.176+0000 7f5b4553d800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T17:44:32.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.177+0000 7f5b4553d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:32.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.177+0000 7f5b4553d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:32.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.178+0000 7f5b4553d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:32.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.179+0000 7f5b4553d800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T17:44:32.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.180+0000 7f5b4553d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:32.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.181+0000 7f5b4553d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:32.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.181+0000 7f5b4553d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:32.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.184+0000 7f59f7fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:44:32.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.186+0000 7f5b4553d800 20 remove_watcher() i=0 2024-09-12T17:44:32.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.186+0000 7f5b4553d800 2 removed watcher, disabling cache 2024-09-12T17:44:32.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.187+0000 7f5b4553d800 20 remove_watcher() i=1 2024-09-12T17:44:32.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.188+0000 7f5b4553d800 20 remove_watcher() i=2 2024-09-12T17:44:32.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.189+0000 7f5b4553d800 20 remove_watcher() i=3 2024-09-12T17:44:32.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.190+0000 7f5b4553d800 20 remove_watcher() i=4 2024-09-12T17:44:32.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.191+0000 7f5b4553d800 20 remove_watcher() i=5 2024-09-12T17:44:32.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.192+0000 7f5b4553d800 20 remove_watcher() i=6 2024-09-12T17:44:32.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.193+0000 7f5b4553d800 20 remove_watcher() i=7 2024-09-12T17:44:32.205 DEBUG:teuthology.orchestra.run.smithi037:> radosgw-admin gc process --include-all 2024-09-12T17:44:32.258 INFO:teuthology.orchestra.run.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:44:32.258 INFO:teuthology.orchestra.run.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:44:32.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.296+0000 7f0dbb515800 20 rados->read ofs=0 len=0 2024-09-12T17:44:32.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.298+0000 7f0dbb515800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:32.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.298+0000 7f0dbb515800 20 realm 2024-09-12T17:44:32.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.298+0000 7f0dbb515800 20 rados->read ofs=0 len=0 2024-09-12T17:44:32.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.298+0000 7f0dbb515800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:32.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.298+0000 7f0dbb515800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:44:32.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.298+0000 7f0dbb515800 20 rados->read ofs=0 len=0 2024-09-12T17:44:32.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.298+0000 7f0dbb515800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:32.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.298+0000 7f0dbb515800 20 rados->read ofs=0 len=0 2024-09-12T17:44:32.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.299+0000 7f0dbb515800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:44:32.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.299+0000 7f0dbb515800 20 rados->read ofs=0 len=0 2024-09-12T17:44:32.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.299+0000 7f0dbb515800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:44:32.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.299+0000 7f0dbb515800 20 searching for the correct realm 2024-09-12T17:44:32.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.302+0000 7f0db87fe640 0 -- 172.21.15.37:0/3498904692 >> [v2:172.21.15.40:6800/2441293461,v1:172.21.15.40:6801/2441293461] conn(0x7f0da8018070 msgr2=0x7f0da807e3b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:44:32.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.306+0000 7f0db8fff640 0 -- 172.21.15.37:0/3498904692 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7f0dac0588b0 msgr2=0x7f0dac0393a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:44:32.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.512+0000 7f0dbb515800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:44:32.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.512+0000 7f0dbb515800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:44:32.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.512+0000 7f0dbb515800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:44:32.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.512+0000 7f0dbb515800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:44:32.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.512+0000 7f0dbb515800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:44:32.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.512+0000 7f0dbb515800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:44:32.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.512+0000 7f0dbb515800 20 rados->read ofs=0 len=0 2024-09-12T17:44:32.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.513+0000 7f0dbb515800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:32.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.513+0000 7f0dbb515800 20 rados->read ofs=0 len=0 2024-09-12T17:44:32.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.513+0000 7f0dbb515800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:44:32.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.513+0000 7f0dbb515800 20 rados->read ofs=0 len=0 2024-09-12T17:44:32.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.513+0000 7f0dbb515800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:44:32.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.513+0000 7f0dbb515800 20 zone default found 2024-09-12T17:44:32.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.513+0000 7f0dbb515800 4 Realm: () 2024-09-12T17:44:32.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.513+0000 7f0dbb515800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:44:32.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.513+0000 7f0dbb515800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:44:32.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.513+0000 7f0dbb515800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:44:32.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.513+0000 7f0dbb515800 20 zonegroup default 2024-09-12T17:44:32.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.513+0000 7f0dbb515800 20 rados->read ofs=0 len=0 2024-09-12T17:44:32.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.514+0000 7f0dbb515800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:32.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.514+0000 7f0dbb515800 20 rados->read ofs=0 len=0 2024-09-12T17:44:32.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.514+0000 7f0dbb515800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:32.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.514+0000 7f0dbb515800 20 rados->read ofs=0 len=0 2024-09-12T17:44:32.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.514+0000 7f0dbb515800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:32.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.514+0000 7f0dbb515800 20 started sync module instance, tier type = 2024-09-12T17:44:32.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.514+0000 7f0dbb515800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:44:32.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.523+0000 7f0dbb515800 20 add_watcher() i=0 2024-09-12T17:44:32.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.524+0000 7f0dbb515800 20 add_watcher() i=1 2024-09-12T17:44:32.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.524+0000 7f0dbb515800 20 add_watcher() i=2 2024-09-12T17:44:32.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.524+0000 7f0dbb515800 20 add_watcher() i=3 2024-09-12T17:44:32.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.524+0000 7f0dbb515800 20 add_watcher() i=4 2024-09-12T17:44:32.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.524+0000 7f0dbb515800 20 add_watcher() i=5 2024-09-12T17:44:32.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.524+0000 7f0dbb515800 20 add_watcher() i=6 2024-09-12T17:44:32.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.525+0000 7f0dbb515800 20 add_watcher() i=7 2024-09-12T17:44:32.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.525+0000 7f0dbb515800 2 all 8 watchers are set, enabling cache 2024-09-12T17:44:32.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.526+0000 7f0c6efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:44:32.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.527+0000 7f0dbb515800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:44:32.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.527+0000 7f0dbb515800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:44:32.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.564+0000 7f0c6dfe3640 20 reqs_thread_entry: start 2024-09-12T17:44:32.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.564+0000 7f0dbb515800 20 init_complete bucket index max shards: 11 2024-09-12T17:44:32.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.564+0000 7f0dbb515800 20 Filter name: none 2024-09-12T17:44:32.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.564+0000 7f0bdf7fe640 20 reqs_thread_entry: start 2024-09-12T17:44:32.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.564+0000 7f0dbb515800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T17:44:32.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.566+0000 7f0dbb515800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:32.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.566+0000 7f0dbb515800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:32.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.566+0000 7f0dbb515800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:32.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.567+0000 7f0dbb515800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T17:44:32.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.569+0000 7f0dbb515800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:32.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.569+0000 7f0dbb515800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:32.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.569+0000 7f0dbb515800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:32.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.570+0000 7f0dbb515800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T17:44:32.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.572+0000 7f0dbb515800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:32.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.572+0000 7f0dbb515800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:32.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.572+0000 7f0dbb515800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:32.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.573+0000 7f0dbb515800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T17:44:32.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.575+0000 7f0dbb515800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:32.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.575+0000 7f0dbb515800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:32.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.575+0000 7f0dbb515800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:32.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.576+0000 7f0dbb515800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T17:44:32.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.578+0000 7f0dbb515800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:32.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.578+0000 7f0dbb515800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:32.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.579+0000 7f0dbb515800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:32.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.580+0000 7f0dbb515800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T17:44:32.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.581+0000 7f0dbb515800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:32.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.582+0000 7f0dbb515800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:32.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.582+0000 7f0dbb515800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:32.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.583+0000 7f0dbb515800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T17:44:32.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.584+0000 7f0dbb515800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:32.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.585+0000 7f0dbb515800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:32.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.585+0000 7f0dbb515800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:32.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.586+0000 7f0dbb515800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T17:44:32.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.588+0000 7f0dbb515800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:32.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.588+0000 7f0dbb515800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:32.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.588+0000 7f0dbb515800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:32.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.589+0000 7f0dbb515800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T17:44:32.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.591+0000 7f0dbb515800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:32.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.591+0000 7f0dbb515800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:32.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.591+0000 7f0dbb515800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:32.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.592+0000 7f0dbb515800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T17:44:32.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.594+0000 7f0dbb515800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:32.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.594+0000 7f0dbb515800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:32.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.594+0000 7f0dbb515800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:32.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.596+0000 7f0dbb515800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T17:44:32.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.597+0000 7f0dbb515800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:32.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.598+0000 7f0dbb515800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:32.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.598+0000 7f0dbb515800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:32.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.599+0000 7f0dbb515800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T17:44:32.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.600+0000 7f0dbb515800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:32.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.601+0000 7f0dbb515800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:32.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.601+0000 7f0dbb515800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:32.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.602+0000 7f0dbb515800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T17:44:32.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.604+0000 7f0dbb515800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:32.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.604+0000 7f0dbb515800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:32.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.605+0000 7f0dbb515800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:32.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.606+0000 7f0dbb515800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T17:44:32.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.607+0000 7f0dbb515800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:32.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.607+0000 7f0dbb515800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:32.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.608+0000 7f0dbb515800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:32.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.609+0000 7f0dbb515800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T17:44:32.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.611+0000 7f0dbb515800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:32.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.611+0000 7f0dbb515800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:32.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.611+0000 7f0dbb515800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:32.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.612+0000 7f0dbb515800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T17:44:32.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.614+0000 7f0dbb515800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:32.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.614+0000 7f0dbb515800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:32.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.614+0000 7f0dbb515800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:32.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.615+0000 7f0dbb515800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T17:44:32.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.617+0000 7f0dbb515800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:32.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.617+0000 7f0dbb515800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:32.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.617+0000 7f0dbb515800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:32.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.619+0000 7f0dbb515800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T17:44:32.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.620+0000 7f0dbb515800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:32.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.620+0000 7f0dbb515800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:32.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.621+0000 7f0dbb515800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:32.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.621+0000 7f0dbb515800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T17:44:32.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.623+0000 7f0dbb515800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:32.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.624+0000 7f0dbb515800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:32.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.624+0000 7f0dbb515800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:32.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.625+0000 7f0dbb515800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T17:44:32.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.626+0000 7f0dbb515800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:32.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.627+0000 7f0dbb515800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:32.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.627+0000 7f0dbb515800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:32.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.628+0000 7f0dbb515800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T17:44:32.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.630+0000 7f0dbb515800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:32.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.630+0000 7f0dbb515800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:32.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.631+0000 7f0dbb515800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:32.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.632+0000 7f0dbb515800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T17:44:32.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.634+0000 7f0dbb515800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:32.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.634+0000 7f0dbb515800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:32.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.634+0000 7f0dbb515800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:32.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.635+0000 7f0dbb515800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T17:44:32.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.636+0000 7f0dbb515800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:32.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.637+0000 7f0dbb515800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:32.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.637+0000 7f0dbb515800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:32.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.638+0000 7f0dbb515800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T17:44:32.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.639+0000 7f0dbb515800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:32.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.640+0000 7f0dbb515800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:32.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.640+0000 7f0dbb515800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:32.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.641+0000 7f0dbb515800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T17:44:32.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.642+0000 7f0dbb515800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:32.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.643+0000 7f0dbb515800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:32.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.643+0000 7f0dbb515800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:32.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.644+0000 7f0dbb515800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T17:44:32.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.645+0000 7f0dbb515800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:32.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.646+0000 7f0dbb515800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:32.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.646+0000 7f0dbb515800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:32.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.647+0000 7f0dbb515800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T17:44:32.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.648+0000 7f0dbb515800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:32.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.649+0000 7f0dbb515800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:32.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.649+0000 7f0dbb515800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:32.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.650+0000 7f0dbb515800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T17:44:32.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.651+0000 7f0dbb515800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:32.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.652+0000 7f0dbb515800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:32.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.652+0000 7f0dbb515800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:32.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.653+0000 7f0dbb515800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T17:44:32.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.654+0000 7f0dbb515800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:32.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.655+0000 7f0dbb515800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:32.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.655+0000 7f0dbb515800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:32.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.656+0000 7f0dbb515800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T17:44:32.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.658+0000 7f0dbb515800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:32.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.658+0000 7f0dbb515800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:32.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.659+0000 7f0dbb515800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:32.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.661+0000 7f0dbb515800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T17:44:32.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.662+0000 7f0dbb515800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:32.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.663+0000 7f0dbb515800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:32.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.663+0000 7f0dbb515800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:32.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.664+0000 7f0dbb515800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T17:44:32.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.665+0000 7f0dbb515800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:32.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.665+0000 7f0dbb515800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:32.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.666+0000 7f0dbb515800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:32.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.668+0000 7f0c6efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:44:32.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.670+0000 7f0dbb515800 20 remove_watcher() i=0 2024-09-12T17:44:32.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.670+0000 7f0dbb515800 2 removed watcher, disabling cache 2024-09-12T17:44:32.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.671+0000 7f0dbb515800 20 remove_watcher() i=1 2024-09-12T17:44:32.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.672+0000 7f0dbb515800 20 remove_watcher() i=2 2024-09-12T17:44:32.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.673+0000 7f0dbb515800 20 remove_watcher() i=3 2024-09-12T17:44:32.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.674+0000 7f0dbb515800 20 remove_watcher() i=4 2024-09-12T17:44:32.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.675+0000 7f0dbb515800 20 remove_watcher() i=5 2024-09-12T17:44:32.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.676+0000 7f0dbb515800 20 remove_watcher() i=6 2024-09-12T17:44:32.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.677+0000 7f0dbb515800 20 remove_watcher() i=7 2024-09-12T17:44:32.689 DEBUG:teuthology.orchestra.run.smithi037:> radosgw-admin gc process --include-all 2024-09-12T17:44:32.743 INFO:teuthology.orchestra.run.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:44:32.743 INFO:teuthology.orchestra.run.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:44:32.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.782+0000 7fbd1f80f800 20 rados->read ofs=0 len=0 2024-09-12T17:44:32.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.783+0000 7fbd1f80f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:32.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.783+0000 7fbd1f80f800 20 realm 2024-09-12T17:44:32.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.783+0000 7fbd1f80f800 20 rados->read ofs=0 len=0 2024-09-12T17:44:32.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.783+0000 7fbd1f80f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:32.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.783+0000 7fbd1f80f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:44:32.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.783+0000 7fbd1f80f800 20 rados->read ofs=0 len=0 2024-09-12T17:44:32.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.783+0000 7fbd1f80f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:32.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.783+0000 7fbd1f80f800 20 rados->read ofs=0 len=0 2024-09-12T17:44:32.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.785+0000 7fbd1f80f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:44:32.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.785+0000 7fbd1f80f800 20 rados->read ofs=0 len=0 2024-09-12T17:44:32.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.785+0000 7fbd1f80f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:44:32.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.785+0000 7fbd1f80f800 20 searching for the correct realm 2024-09-12T17:44:32.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.788+0000 7fbd1b723640 0 -- 172.21.15.37:0/1312111479 >> [v2:172.21.15.40:6818/1210108009,v1:172.21.15.40:6819/1210108009] conn(0x7fbd1007c040 msgr2=0x7fbd1009b920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:44:32.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.792+0000 7fbd1af22640 0 -- 172.21.15.37:0/1312111479 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7fbd100873f0 msgr2=0x7fbd10087850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:44:33.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.998+0000 7fbd1f80f800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:44:33.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.999+0000 7fbd1f80f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:44:33.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.999+0000 7fbd1f80f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:44:33.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.999+0000 7fbd1f80f800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:44:33.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.999+0000 7fbd1f80f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:44:33.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.999+0000 7fbd1f80f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:44:33.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.999+0000 7fbd1f80f800 20 rados->read ofs=0 len=0 2024-09-12T17:44:33.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.999+0000 7fbd1f80f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:33.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.999+0000 7fbd1f80f800 20 rados->read ofs=0 len=0 2024-09-12T17:44:33.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.999+0000 7fbd1f80f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:44:33.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:32.999+0000 7fbd1f80f800 20 rados->read ofs=0 len=0 2024-09-12T17:44:33.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.000+0000 7fbd1f80f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:44:33.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.000+0000 7fbd1f80f800 20 zone default found 2024-09-12T17:44:33.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.000+0000 7fbd1f80f800 4 Realm: () 2024-09-12T17:44:33.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.000+0000 7fbd1f80f800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:44:33.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.000+0000 7fbd1f80f800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:44:33.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.000+0000 7fbd1f80f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:44:33.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.000+0000 7fbd1f80f800 20 zonegroup default 2024-09-12T17:44:33.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.000+0000 7fbd1f80f800 20 rados->read ofs=0 len=0 2024-09-12T17:44:33.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.000+0000 7fbd1f80f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:33.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.000+0000 7fbd1f80f800 20 rados->read ofs=0 len=0 2024-09-12T17:44:33.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.000+0000 7fbd1f80f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:33.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.000+0000 7fbd1f80f800 20 rados->read ofs=0 len=0 2024-09-12T17:44:33.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.001+0000 7fbd1f80f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:44:33.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.001+0000 7fbd1f80f800 20 started sync module instance, tier type = 2024-09-12T17:44:33.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.001+0000 7fbd1f80f800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:44:33.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.010+0000 7fbd1f80f800 20 add_watcher() i=0 2024-09-12T17:44:33.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.010+0000 7fbd1f80f800 20 add_watcher() i=1 2024-09-12T17:44:33.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.010+0000 7fbd1f80f800 20 add_watcher() i=2 2024-09-12T17:44:33.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.010+0000 7fbd1f80f800 20 add_watcher() i=3 2024-09-12T17:44:33.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.010+0000 7fbd1f80f800 20 add_watcher() i=4 2024-09-12T17:44:33.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.010+0000 7fbd1f80f800 20 add_watcher() i=5 2024-09-12T17:44:33.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.010+0000 7fbd1f80f800 20 add_watcher() i=6 2024-09-12T17:44:33.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.011+0000 7fbd1f80f800 20 add_watcher() i=7 2024-09-12T17:44:33.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.011+0000 7fbd1f80f800 2 all 8 watchers are set, enabling cache 2024-09-12T17:44:33.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.013+0000 7fbbd17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:44:33.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.013+0000 7fbd1f80f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:44:33.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.013+0000 7fbd1f80f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:44:33.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.053+0000 7fbb4bfff640 20 reqs_thread_entry: start 2024-09-12T17:44:33.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.053+0000 7fbd1f80f800 20 init_complete bucket index max shards: 11 2024-09-12T17:44:33.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.053+0000 7fbd1f80f800 20 Filter name: none 2024-09-12T17:44:33.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.053+0000 7fbb49ffb640 20 reqs_thread_entry: start 2024-09-12T17:44:33.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.053+0000 7fbd1f80f800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T17:44:33.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.055+0000 7fbd1f80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:33.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.056+0000 7fbd1f80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:33.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.056+0000 7fbd1f80f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:33.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.057+0000 7fbd1f80f800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T17:44:33.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.058+0000 7fbd1f80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:33.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.059+0000 7fbd1f80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:33.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.059+0000 7fbd1f80f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:33.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.060+0000 7fbd1f80f800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T17:44:33.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.061+0000 7fbd1f80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:33.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.062+0000 7fbd1f80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:33.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.063+0000 7fbd1f80f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:33.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.064+0000 7fbd1f80f800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T17:44:33.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.067+0000 7fbd1f80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:33.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.067+0000 7fbd1f80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:33.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.068+0000 7fbd1f80f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:33.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.069+0000 7fbd1f80f800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T17:44:33.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.070+0000 7fbd1f80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:33.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.071+0000 7fbd1f80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:33.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.071+0000 7fbd1f80f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:33.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.072+0000 7fbd1f80f800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T17:44:33.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.073+0000 7fbd1f80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:33.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.074+0000 7fbd1f80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:33.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.074+0000 7fbd1f80f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:33.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.075+0000 7fbd1f80f800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T17:44:33.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.077+0000 7fbd1f80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:33.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.077+0000 7fbd1f80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:33.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.078+0000 7fbd1f80f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:33.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.079+0000 7fbd1f80f800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T17:44:33.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.080+0000 7fbd1f80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:33.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.080+0000 7fbd1f80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:33.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.081+0000 7fbd1f80f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:33.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.082+0000 7fbd1f80f800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T17:44:33.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.083+0000 7fbd1f80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:33.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.083+0000 7fbd1f80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:33.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.084+0000 7fbd1f80f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:33.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.085+0000 7fbd1f80f800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T17:44:33.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.086+0000 7fbd1f80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:33.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.086+0000 7fbd1f80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:33.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.087+0000 7fbd1f80f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:33.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.088+0000 7fbd1f80f800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T17:44:33.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.089+0000 7fbd1f80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:33.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.090+0000 7fbd1f80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:33.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.090+0000 7fbd1f80f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:33.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.091+0000 7fbd1f80f800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T17:44:33.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.092+0000 7fbd1f80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:33.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.093+0000 7fbd1f80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:33.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.093+0000 7fbd1f80f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:33.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.094+0000 7fbd1f80f800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T17:44:33.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.096+0000 7fbd1f80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:33.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.097+0000 7fbd1f80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:33.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.097+0000 7fbd1f80f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:33.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.098+0000 7fbd1f80f800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T17:44:33.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.100+0000 7fbd1f80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:33.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.100+0000 7fbd1f80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:33.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.100+0000 7fbd1f80f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:33.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.101+0000 7fbd1f80f800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T17:44:33.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.103+0000 7fbd1f80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:33.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.103+0000 7fbd1f80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:33.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.104+0000 7fbd1f80f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:33.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.105+0000 7fbd1f80f800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T17:44:33.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.106+0000 7fbd1f80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:33.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.107+0000 7fbd1f80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:33.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.108+0000 7fbd1f80f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:33.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.109+0000 7fbd1f80f800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T17:44:33.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.110+0000 7fbd1f80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:33.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.110+0000 7fbd1f80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:33.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.111+0000 7fbd1f80f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:33.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.111+0000 7fbd1f80f800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T17:44:33.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.113+0000 7fbd1f80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:33.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.114+0000 7fbd1f80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:33.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.114+0000 7fbd1f80f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:33.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.115+0000 7fbd1f80f800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T17:44:33.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.116+0000 7fbd1f80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:33.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.117+0000 7fbd1f80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:33.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.117+0000 7fbd1f80f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:33.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.118+0000 7fbd1f80f800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T17:44:33.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.120+0000 7fbd1f80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:33.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.120+0000 7fbd1f80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:33.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.120+0000 7fbd1f80f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:33.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.121+0000 7fbd1f80f800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T17:44:33.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.123+0000 7fbd1f80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:33.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.123+0000 7fbd1f80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:33.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.124+0000 7fbd1f80f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:33.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.125+0000 7fbd1f80f800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T17:44:33.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.126+0000 7fbd1f80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:33.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.127+0000 7fbd1f80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:33.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.127+0000 7fbd1f80f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:33.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.128+0000 7fbd1f80f800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T17:44:33.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.130+0000 7fbd1f80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:33.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.130+0000 7fbd1f80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:33.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.130+0000 7fbd1f80f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:33.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.131+0000 7fbd1f80f800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T17:44:33.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.132+0000 7fbd1f80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:33.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.133+0000 7fbd1f80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:33.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.133+0000 7fbd1f80f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:33.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.134+0000 7fbd1f80f800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T17:44:33.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.135+0000 7fbd1f80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:33.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.136+0000 7fbd1f80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:33.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.136+0000 7fbd1f80f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:33.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.137+0000 7fbd1f80f800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T17:44:33.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.138+0000 7fbd1f80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:33.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.139+0000 7fbd1f80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:33.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.139+0000 7fbd1f80f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:33.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.140+0000 7fbd1f80f800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T17:44:33.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.142+0000 7fbd1f80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:33.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.142+0000 7fbd1f80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:33.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.143+0000 7fbd1f80f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:33.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.144+0000 7fbd1f80f800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T17:44:33.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.145+0000 7fbd1f80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:33.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.145+0000 7fbd1f80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:33.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.146+0000 7fbd1f80f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:33.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.147+0000 7fbd1f80f800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T17:44:33.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.148+0000 7fbd1f80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:33.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.149+0000 7fbd1f80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:33.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.149+0000 7fbd1f80f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:33.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.150+0000 7fbd1f80f800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T17:44:33.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.151+0000 7fbd1f80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:33.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.152+0000 7fbd1f80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:33.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.152+0000 7fbd1f80f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:33.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.153+0000 7fbd1f80f800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T17:44:33.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.155+0000 7fbd1f80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:33.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.155+0000 7fbd1f80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:33.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.155+0000 7fbd1f80f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:33.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.156+0000 7fbd1f80f800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T17:44:33.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.158+0000 7fbd1f80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:33.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.158+0000 7fbd1f80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:44:33.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.158+0000 7fbd1f80f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:44:33.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.160+0000 7fbbd17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:44:33.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.162+0000 7fbd1f80f800 20 remove_watcher() i=0 2024-09-12T17:44:33.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.162+0000 7fbd1f80f800 2 removed watcher, disabling cache 2024-09-12T17:44:33.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.164+0000 7fbd1f80f800 20 remove_watcher() i=1 2024-09-12T17:44:33.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.164+0000 7fbd1f80f800 20 remove_watcher() i=2 2024-09-12T17:44:33.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.166+0000 7fbd1f80f800 20 remove_watcher() i=3 2024-09-12T17:44:33.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.167+0000 7fbd1f80f800 20 remove_watcher() i=4 2024-09-12T17:44:33.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.168+0000 7fbd1f80f800 20 remove_watcher() i=5 2024-09-12T17:44:33.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.169+0000 7fbd1f80f800 20 remove_watcher() i=6 2024-09-12T17:44:33.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:44:33.170+0000 7fbd1f80f800 20 remove_watcher() i=7 2024-09-12T17:44:33.183 DEBUG:teuthology.orchestra.run.smithi037:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests ObjectTest 2024-09-12T17:44:33.689 INFO:teuthology.orchestra.run.smithi037.stdout:> Task :clean 2024-09-12T17:44:34.385 INFO:teuthology.orchestra.run.smithi037.stdout:> Task :compileJava 2024-09-12T17:44:34.385 INFO:teuthology.orchestra.run.smithi037.stdout:> Task :processResources 2024-09-12T17:44:34.385 INFO:teuthology.orchestra.run.smithi037.stdout:> Task :classes 2024-09-12T17:44:34.885 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:44:34.885 INFO:teuthology.orchestra.run.smithi037.stdout:> Task :compileTestJava 2024-09-12T17:44:34.886 INFO:teuthology.orchestra.run.smithi037.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-09-12T17:44:34.886 INFO:teuthology.orchestra.run.smithi037.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-09-12T17:44:34.887 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:44:34.887 INFO:teuthology.orchestra.run.smithi037.stdout:> Task :processTestResources NO-SOURCE 2024-09-12T17:44:34.887 INFO:teuthology.orchestra.run.smithi037.stdout:> Task :testClasses 2024-09-12T17:44:36.886 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:44:36.886 INFO:teuthology.orchestra.run.smithi037.stdout:> Task :test 2024-09-12T17:44:36.886 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:44:36.886 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Object tests STANDARD_OUT 2024-09-12T17:44:36.886 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12 17:44:36,119 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-09-12T17:44:36.886 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:44:36.886 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Object tests > ObjectTest.TestObjectCopyKeyNotFound STARTED 2024-09-12T17:44:36.886 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:44:36.886 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Object tests > ObjectTest.TestObjectCopyKeyNotFound PASSED 2024-09-12T17:44:37.085 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:44:37.085 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadExpectNone STARTED 2024-09-12T17:44:37.185 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:44:37.185 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadExpectNone PASSED 2024-09-12T17:44:37.585 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:44:37.585 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadMd5Empty STARTED 2024-09-12T17:44:37.685 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:44:37.685 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadMd5Empty PASSED 2024-09-12T17:44:37.985 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:44:37.985 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadLLAPI STARTED 2024-09-12T17:44:40.185 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:44:40.185 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadLLAPI PASSED 2024-09-12T17:44:40.585 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:44:40.585 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadNotFoundLLAPI STARTED 2024-09-12T17:44:40.685 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:44:40.685 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadNotFoundLLAPI PASSED 2024-09-12T17:44:40.985 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:44:40.985 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Object tests > ObjectTest.testDownloadHLAPI STARTED 2024-09-12T17:44:41.185 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:44:41.185 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Object tests > ObjectTest.testDownloadHLAPI PASSED 2024-09-12T17:44:41.585 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:44:41.585 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Object tests > ObjectTest.testDownloadNoBucketHLAPI STARTED 2024-09-12T17:44:41.585 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:44:41.586 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Object tests > ObjectTest.testDownloadNoBucketHLAPI PASSED 2024-09-12T17:44:41.786 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:44:41.786 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Object tests > ObjectTest.testDownloadNoKeyHLAPI STARTED 2024-09-12T17:44:41.786 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:44:41.786 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Object tests > ObjectTest.testDownloadNoKeyHLAPI PASSED 2024-09-12T17:44:42.185 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:44:42.185 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1MB STARTED 2024-09-12T17:44:43.885 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:44:43.885 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1MB PASSED 2024-09-12T17:44:44.285 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:44:44.285 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1b STARTED 2024-09-12T17:44:44.285 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:44:44.285 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1b PASSED 2024-09-12T17:44:44.685 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:44:44.686 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1kb STARTED 2024-09-12T17:44:44.785 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:44:44.785 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1kb PASSED 2024-09-12T17:44:45.185 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:44:45.185 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Object tests > ObjectTest.testEncryptionKeyNoSSEC STARTED 2024-09-12T17:44:45.285 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:44:45.285 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Object tests > ObjectTest.testEncryptionKeyNoSSEC PASSED 2024-09-12T17:44:45.585 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:44:45.585 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECInvalidMd5 STARTED 2024-09-12T17:44:45.685 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:44:45.685 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECInvalidMd5 PASSED 2024-09-12T17:44:46.085 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:44:46.085 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoKey STARTED 2024-09-12T17:44:46.185 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:44:46.185 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoKey PASSED 2024-09-12T17:44:46.585 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:44:46.585 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoMd5 STARTED 2024-09-12T17:44:46.685 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:44:46.685 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoMd5 PASSED 2024-09-12T17:44:46.985 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:44:46.985 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Object tests > ObjectTest.testMultiObjectDelete STARTED 2024-09-12T17:44:47.185 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:44:47.185 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Object tests > ObjectTest.testMultiObjectDelete PASSED 2024-09-12T17:44:47.585 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:44:47.585 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Object tests > ObjectTest.testMultipartCopyHLAPIA STARTED 2024-09-12T17:44:49.885 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:44:49.885 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Object tests > ObjectTest.testMultipartCopyHLAPIA PASSED 2024-09-12T17:44:50.585 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:44:50.585 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Object tests > ObjectTest.testMultipartCopyMultipleSizesLLAPI STARTED 2024-09-12T17:45:33.186 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:45:33.186 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Object tests > ObjectTest.testMultipartCopyMultipleSizesLLAPI PASSED 2024-09-12T17:45:33.885 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:45:33.885 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCBucketHLAPI STARTED 2024-09-12T17:45:33.985 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:45:33.985 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCBucketHLAPI PASSED 2024-09-12T17:45:34.285 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:45:34.285 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCKeyHLAPI STARTED 2024-09-12T17:45:34.385 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:45:34.385 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCKeyHLAPI PASSED 2024-09-12T17:45:34.985 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:45:34.985 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Object tests > ObjectTest.testMultipartDownloadHLAPI STARTED 2024-09-12T17:45:37.185 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:45:37.185 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Object tests > ObjectTest.testMultipartDownloadHLAPI PASSED 2024-09-12T17:45:37.485 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:45:37.485 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Object tests > ObjectTest.testMultipartDownloadNoBucketHLAPI STARTED 2024-09-12T17:45:37.585 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:45:37.585 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Object tests > ObjectTest.testMultipartDownloadNoBucketHLAPI PASSED 2024-09-12T17:45:37.685 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:45:37.685 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Object tests > ObjectTest.testMultipartDownloadWithPauseHLAPI STARTED 2024-09-12T17:45:41.185 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:45:41.185 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Object tests > ObjectTest.testMultipartDownloadWithPauseHLAPI PASSED 2024-09-12T17:45:41.585 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:45:41.585 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Object tests > ObjectTest.testMultipartUploadHLAPIAWS4 STARTED 2024-09-12T17:45:46.285 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:45:46.285 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Object tests > ObjectTest.testMultipartUploadHLAPIAWS4 PASSED 2024-09-12T17:45:46.785 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:45:46.785 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Object tests > ObjectTest.testMultipartUploadIncorrectMissingPartLLAPI STARTED 2024-09-12T17:45:48.985 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:45:48.985 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Object tests > ObjectTest.testMultipartUploadIncorrectMissingPartLLAPI PASSED 2024-09-12T17:45:49.385 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:45:49.385 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Object tests > ObjectTest.testMultipartUploadMultipleSizesLLAPI STARTED 2024-09-12T17:46:10.885 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:46:10.886 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Object tests > ObjectTest.testMultipartUploadMultipleSizesLLAPI PASSED 2024-09-12T17:46:11.285 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:46:11.285 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Object tests > ObjectTest.testMultipartUploadOverwriteExistingObjectLLAPI STARTED 2024-09-12T17:46:14.585 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:46:14.585 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Object tests > ObjectTest.testMultipartUploadOverwriteExistingObjectLLAPI PASSED 2024-09-12T17:46:14.985 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:46:14.985 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Object tests > ObjectTest.testMultipartUploadSmallLLAPI STARTED 2024-09-12T17:46:17.485 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:46:17.485 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Object tests > ObjectTest.testMultipartUploadSmallLLAPI PASSED 2024-09-12T17:46:17.885 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:46:17.885 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Object tests > ObjectTest.testMultipartUploadWithPause STARTED 2024-09-12T17:46:18.985 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:46:18.985 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Object tests > ObjectTest.testMultipartUploadWithPause PASSED 2024-09-12T17:46:24.385 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:46:24.385 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Object tests > ObjectTest.testObjectCopyBucketNotFound STARTED 2024-09-12T17:46:24.485 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:46:24.485 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Object tests > ObjectTest.testObjectCopyBucketNotFound PASSED 2024-09-12T17:46:24.585 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:46:24.585 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Object tests > ObjectTest.testObjectCreateBadExpectMismatch STARTED 2024-09-12T17:46:24.685 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:46:24.685 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Object tests > ObjectTest.testObjectCreateBadExpectMismatch PASSED 2024-09-12T17:46:25.085 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:46:25.085 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5InvalidShort STARTED 2024-09-12T17:46:25.185 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:46:25.185 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5InvalidShort PASSED 2024-09-12T17:46:25.485 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:46:25.485 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Ivalid STARTED 2024-09-12T17:46:25.585 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:46:25.585 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Ivalid PASSED 2024-09-12T17:46:25.985 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:46:25.985 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5None STARTED 2024-09-12T17:46:26.085 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:46:26.085 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5None PASSED 2024-09-12T17:46:26.385 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:46:26.385 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Unreadable STARTED 2024-09-12T17:46:26.485 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:46:26.485 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Unreadable PASSED 2024-09-12T17:46:26.885 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:46:26.885 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Object tests > ObjectTest.testObjectHeadZeroBytes STARTED 2024-09-12T17:46:26.985 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:46:26.985 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Object tests > ObjectTest.testObjectHeadZeroBytes PASSED 2024-09-12T17:46:27.385 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:46:27.385 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterDot STARTED 2024-09-12T17:46:27.585 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:46:27.585 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterDot PASSED 2024-09-12T17:46:27.985 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:46:27.985 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterNotExist STARTED 2024-09-12T17:46:28.285 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:46:28.285 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterNotExist PASSED 2024-09-12T17:46:28.689 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:46:28.689 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterPercentage STARTED 2024-09-12T17:46:28.885 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:46:28.885 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterPercentage PASSED 2024-09-12T17:46:29.385 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:46:29.385 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Object tests > ObjectTest.testObjectListMarkerAfterList STARTED 2024-09-12T17:46:29.585 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:46:29.585 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Object tests > ObjectTest.testObjectListMarkerAfterList PASSED 2024-09-12T17:46:30.085 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:46:30.085 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Object tests > ObjectTest.testObjectListMarkerBeforeList STARTED 2024-09-12T17:46:30.285 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:46:30.285 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Object tests > ObjectTest.testObjectListMarkerBeforeList PASSED 2024-09-12T17:46:30.685 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:46:30.685 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Object tests > ObjectTest.testObjectListMarkerNotInList STARTED 2024-09-12T17:46:30.985 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:46:30.985 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Object tests > ObjectTest.testObjectListMarkerNotInList PASSED 2024-09-12T17:46:31.385 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:46:31.385 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Object tests > ObjectTest.testObjectListMarkerUnreadable STARTED 2024-09-12T17:46:31.585 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:46:31.585 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Object tests > ObjectTest.testObjectListMarkerUnreadable PASSED 2024-09-12T17:46:32.085 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:46:32.085 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNegative STARTED 2024-09-12T17:46:32.285 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:46:32.285 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNegative PASSED 2024-09-12T17:46:32.785 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:46:32.785 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNone STARTED 2024-09-12T17:46:32.985 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:46:32.985 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNone PASSED 2024-09-12T17:46:33.385 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:46:33.385 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysOne STARTED 2024-09-12T17:46:33.585 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:46:33.585 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysOne PASSED 2024-09-12T17:46:34.085 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:46:34.085 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysZero STARTED 2024-09-12T17:46:34.285 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:46:34.285 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysZero PASSED 2024-09-12T17:46:34.785 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:46:34.785 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Object tests > ObjectTest.testObjectListPrefixAlt STARTED 2024-09-12T17:46:34.985 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:46:34.985 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Object tests > ObjectTest.testObjectListPrefixAlt PASSED 2024-09-12T17:46:35.385 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:46:35.385 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Object tests > ObjectTest.testObjectListPrefixBasic STARTED 2024-09-12T17:46:35.585 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:46:35.585 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Object tests > ObjectTest.testObjectListPrefixBasic PASSED 2024-09-12T17:46:35.985 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:46:35.985 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterAlt STARTED 2024-09-12T17:46:36.185 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:46:36.185 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterAlt PASSED 2024-09-12T17:46:36.685 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:46:36.685 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterBasic STARTED 2024-09-12T17:46:36.885 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:46:36.885 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterBasic PASSED 2024-09-12T17:46:37.385 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:46:37.385 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterDelimiterNotExist STARTED 2024-09-12T17:46:37.585 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:46:37.585 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterDelimiterNotExist PASSED 2024-09-12T17:46:38.285 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:46:38.285 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixDelimiterNotExist STARTED 2024-09-12T17:46:38.485 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:46:38.485 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixDelimiterNotExist PASSED 2024-09-12T17:46:38.885 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:46:38.886 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixNotExist STARTED 2024-09-12T17:46:39.185 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:46:39.185 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixNotExist PASSED 2024-09-12T17:46:39.585 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:46:39.585 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Object tests > ObjectTest.testObjectListPrefixEmpty STARTED 2024-09-12T17:46:39.785 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:46:39.785 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Object tests > ObjectTest.testObjectListPrefixEmpty PASSED 2024-09-12T17:46:40.185 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:46:40.185 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNone STARTED 2024-09-12T17:46:40.385 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:46:40.385 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNone PASSED 2024-09-12T17:46:40.885 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:46:40.885 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNotExist STARTED 2024-09-12T17:46:41.085 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:46:41.085 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNotExist PASSED 2024-09-12T17:46:41.485 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:46:41.485 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Object tests > ObjectTest.testObjectListPrefixUnreadable STARTED 2024-09-12T17:46:41.684 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:46:41.685 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Object tests > ObjectTest.testObjectListPrefixUnreadable PASSED 2024-09-12T17:46:42.085 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:46:42.085 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Object tests > ObjectTest.testObjectReadFromNonExistantBucket STARTED 2024-09-12T17:46:42.185 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:46:42.185 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Object tests > ObjectTest.testObjectReadFromNonExistantBucket PASSED 2024-09-12T17:46:42.485 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:46:42.485 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Object tests > ObjectTest.testObjectReadNotExist STARTED 2024-09-12T17:46:42.585 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:46:42.585 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Object tests > ObjectTest.testObjectReadNotExist PASSED 2024-09-12T17:46:42.985 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:46:42.985 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Object tests > ObjectTest.testObjectWriteCacheControl STARTED 2024-09-12T17:46:43.085 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:46:43.085 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Object tests > ObjectTest.testObjectWriteCacheControl PASSED 2024-09-12T17:46:43.385 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:46:43.385 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Object tests > ObjectTest.testObjectWriteCheckEtag STARTED 2024-09-12T17:46:43.485 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:46:43.485 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Object tests > ObjectTest.testObjectWriteCheckEtag PASSED 2024-09-12T17:46:44.085 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:46:44.085 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Object tests > ObjectTest.testObjectWriteReadUpdateReadDelete STARTED 2024-09-12T17:46:44.385 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:46:44.385 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Object tests > ObjectTest.testObjectWriteReadUpdateReadDelete PASSED 2024-09-12T17:46:44.685 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:46:44.685 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Object tests > ObjectTest.testObjectWriteToNonExistantBucket STARTED 2024-09-12T17:46:44.785 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:46:44.785 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Object tests > ObjectTest.testObjectWriteToNonExistantBucket PASSED 2024-09-12T17:46:44.885 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:46:44.885 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Object tests > ObjectTest.testRangedSkipLeadingBytesResponseCode STARTED 2024-09-12T17:46:44.985 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:46:44.985 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Object tests > ObjectTest.testRangedSkipLeadingBytesResponseCode PASSED 2024-09-12T17:46:45.385 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:46:45.385 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Object tests > ObjectTest.testRangedrequestResponseCode STARTED 2024-09-12T17:46:45.485 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:46:45.485 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Object tests > ObjectTest.testRangedrequestResponseCode PASSED 2024-09-12T17:46:45.885 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:46:45.885 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Object tests > ObjectTest.testSSEKMSNoKey STARTED 2024-09-12T17:46:46.085 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:46:46.085 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Object tests > ObjectTest.testSSEKMSNoKey PASSED 2024-09-12T17:46:46.385 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:46:46.385 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Object tests > ObjectTest.testSSEKMSNotDeclared STARTED 2024-09-12T17:46:46.485 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:46:46.485 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Object tests > ObjectTest.testSSEKMSNotDeclared PASSED 2024-09-12T17:46:46.885 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:46:46.885 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Object tests > ObjectTest.testUploadFileHLAPIBigFile STARTED 2024-09-12T17:46:49.485 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:46:49.485 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Object tests > ObjectTest.testUploadFileHLAPIBigFile PASSED 2024-09-12T17:46:49.885 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:46:49.885 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Object tests > ObjectTest.testUploadFileList STARTED 2024-09-12T17:46:52.185 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:46:52.185 INFO:teuthology.orchestra.run.smithi037.stdout:suite > Object tests > ObjectTest.testUploadFileList PASSED 2024-09-12T17:46:52.622 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:46:52.622 INFO:teuthology.orchestra.run.smithi037.stdout:---------------------------------------------------------------------- 2024-09-12T17:46:52.622 INFO:teuthology.orchestra.run.smithi037.stdout:| Results: SUCCESS (70 tests, 70 successes, 0 failures, 0 skipped) | 2024-09-12T17:46:52.622 INFO:teuthology.orchestra.run.smithi037.stdout:---------------------------------------------------------------------- 2024-09-12T17:46:52.622 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:46:52.623 INFO:teuthology.orchestra.run.smithi037.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-09-12T17:46:52.623 INFO:teuthology.orchestra.run.smithi037.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-09-12T17:46:52.623 INFO:teuthology.orchestra.run.smithi037.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-09-12T17:46:52.623 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:46:52.623 INFO:teuthology.orchestra.run.smithi037.stdout:BUILD SUCCESSFUL in 2m 19s 2024-09-12T17:46:52.623 INFO:teuthology.orchestra.run.smithi037.stdout:5 actionable tasks: 5 executed 2024-09-12T17:46:52.638 DEBUG:teuthology.orchestra.run.smithi037:> radosgw-admin gc process --include-all 2024-09-12T17:46:52.692 INFO:teuthology.orchestra.run.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:46:52.693 INFO:teuthology.orchestra.run.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:46:52.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:52.733+0000 7fab55575800 20 rados->read ofs=0 len=0 2024-09-12T17:46:52.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:52.735+0000 7fab55575800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:52.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:52.735+0000 7fab55575800 20 realm 2024-09-12T17:46:52.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:52.735+0000 7fab55575800 20 rados->read ofs=0 len=0 2024-09-12T17:46:52.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:52.735+0000 7fab55575800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:52.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:52.735+0000 7fab55575800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:46:52.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:52.735+0000 7fab55575800 20 rados->read ofs=0 len=0 2024-09-12T17:46:52.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:52.735+0000 7fab55575800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:52.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:52.735+0000 7fab55575800 20 rados->read ofs=0 len=0 2024-09-12T17:46:52.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:52.736+0000 7fab55575800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:46:52.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:52.736+0000 7fab55575800 20 rados->read ofs=0 len=0 2024-09-12T17:46:52.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:52.736+0000 7fab55575800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:46:52.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:52.736+0000 7fab55575800 20 searching for the correct realm 2024-09-12T17:46:52.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:52.739+0000 7fab5285e640 0 -- 172.21.15.37:0/3776797531 >> [v2:172.21.15.40:6800/2441293461,v1:172.21.15.40:6801/2441293461] conn(0x7fab44074070 msgr2=0x7fab4406d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:46:52.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:52.947+0000 7fab5305f640 0 -- 172.21.15.37:0/3776797531 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7fab4806e260 msgr2=0x7fab4802e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:46:53.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.155+0000 7fab55575800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:46:53.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.155+0000 7fab55575800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:46:53.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.155+0000 7fab55575800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:46:53.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.155+0000 7fab55575800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:46:53.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.155+0000 7fab55575800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:46:53.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.155+0000 7fab55575800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:46:53.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.155+0000 7fab55575800 20 rados->read ofs=0 len=0 2024-09-12T17:46:53.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.155+0000 7fab55575800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:53.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.155+0000 7fab55575800 20 rados->read ofs=0 len=0 2024-09-12T17:46:53.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.156+0000 7fab55575800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:46:53.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.156+0000 7fab55575800 20 rados->read ofs=0 len=0 2024-09-12T17:46:53.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.156+0000 7fab55575800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:46:53.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.156+0000 7fab55575800 20 zone default found 2024-09-12T17:46:53.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.156+0000 7fab55575800 4 Realm: () 2024-09-12T17:46:53.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.156+0000 7fab55575800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:46:53.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.156+0000 7fab55575800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:46:53.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.156+0000 7fab55575800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:46:53.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.156+0000 7fab55575800 20 zonegroup default 2024-09-12T17:46:53.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.156+0000 7fab55575800 20 rados->read ofs=0 len=0 2024-09-12T17:46:53.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.156+0000 7fab55575800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:53.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.156+0000 7fab55575800 20 rados->read ofs=0 len=0 2024-09-12T17:46:53.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.157+0000 7fab55575800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:53.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.157+0000 7fab55575800 20 rados->read ofs=0 len=0 2024-09-12T17:46:53.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.157+0000 7fab55575800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:53.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.157+0000 7fab55575800 20 started sync module instance, tier type = 2024-09-12T17:46:53.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.157+0000 7fab55575800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:46:53.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.168+0000 7fab55575800 20 add_watcher() i=0 2024-09-12T17:46:53.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.168+0000 7fab55575800 20 add_watcher() i=1 2024-09-12T17:46:53.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.168+0000 7fab55575800 20 add_watcher() i=2 2024-09-12T17:46:53.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.168+0000 7fab55575800 20 add_watcher() i=3 2024-09-12T17:46:53.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.168+0000 7fab55575800 20 add_watcher() i=4 2024-09-12T17:46:53.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.168+0000 7fab55575800 20 add_watcher() i=5 2024-09-12T17:46:53.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.168+0000 7fab55575800 20 add_watcher() i=6 2024-09-12T17:46:53.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.169+0000 7fab55575800 20 add_watcher() i=7 2024-09-12T17:46:53.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.169+0000 7fab55575800 2 all 8 watchers are set, enabling cache 2024-09-12T17:46:53.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.171+0000 7faa09fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:46:53.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.171+0000 7fab55575800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:46:53.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.171+0000 7fab55575800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:46:53.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.212+0000 7faa08fe1640 20 reqs_thread_entry: start 2024-09-12T17:46:53.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.212+0000 7fab55575800 20 init_complete bucket index max shards: 11 2024-09-12T17:46:53.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.212+0000 7fab55575800 20 Filter name: none 2024-09-12T17:46:53.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.212+0000 7fa9827fc640 20 reqs_thread_entry: start 2024-09-12T17:46:53.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.213+0000 7fab55575800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T17:46:53.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.214+0000 7fab55575800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:46:53.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.214+0000 7fab55575800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:46:53.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.215+0000 7fab55575800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T17:46:53.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.215+0000 7fab55575800 20 garbage collection: RGWGC::process iterating over entry tag='722b129a-cf7a-4aca-b594-5b9492d130e2.4623.3726837566083246192', time=2024-09-12T19:45:46.409300+0000, chain.objs.size()=5 2024-09-12T17:46:53.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.215+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.101__multipart_file.mpg.2~X3sqWiPdJ_jU-63nXblo-wTICXpDKpC.1 2024-09-12T17:46:53.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.215+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.101__multipart_file.mpg.2~X3sqWiPdJ_jU-63nXblo-wTICXpDKpC.2 2024-09-12T17:46:53.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.215+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.101__multipart_file.mpg.2~X3sqWiPdJ_jU-63nXblo-wTICXpDKpC.3 2024-09-12T17:46:53.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.215+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.101__multipart_file.mpg.2~X3sqWiPdJ_jU-63nXblo-wTICXpDKpC.4 2024-09-12T17:46:53.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.215+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.101__multipart_file.mpg.2~X3sqWiPdJ_jU-63nXblo-wTICXpDKpC.5 2024-09-12T17:46:53.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.218+0000 7fab55575800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:46:53.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.221+0000 7fab55575800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T17:46:53.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.222+0000 7fab55575800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:46:53.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.223+0000 7fab55575800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:46:53.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.223+0000 7fab55575800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:46:53.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.224+0000 7fab55575800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T17:46:53.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.226+0000 7fab55575800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:46:53.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.227+0000 7fab55575800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:46:53.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.227+0000 7fab55575800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T17:46:53.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.227+0000 7fab55575800 20 garbage collection: RGWGC::process iterating over entry tag='722b129a-cf7a-4aca-b594-5b9492d130e2.4623.8550656874751706422', time=2024-09-12T19:45:37.231691+0000, chain.objs.size()=5 2024-09-12T17:46:53.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.227+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.99__multipart_key1.2~J7MdkbkqXGXZaGEyl4PwSKqRYYhn7fT.1 2024-09-12T17:46:53.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.227+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.99__multipart_key1.2~J7MdkbkqXGXZaGEyl4PwSKqRYYhn7fT.2 2024-09-12T17:46:53.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.227+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.99__multipart_key1.2~J7MdkbkqXGXZaGEyl4PwSKqRYYhn7fT.3 2024-09-12T17:46:53.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.227+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.99__multipart_key1.2~J7MdkbkqXGXZaGEyl4PwSKqRYYhn7fT.4 2024-09-12T17:46:53.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.227+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.99__multipart_key1.2~J7MdkbkqXGXZaGEyl4PwSKqRYYhn7fT.5 2024-09-12T17:46:53.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.230+0000 7fab55575800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:46:53.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.233+0000 7fab55575800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T17:46:53.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.234+0000 7fab55575800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:46:53.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.235+0000 7fab55575800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:46:53.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.236+0000 7fab55575800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T17:46:53.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.236+0000 7fab55575800 20 garbage collection: RGWGC::process iterating over entry tag='722b129a-cf7a-4aca-b594-5b9492d130e2.4623.843804044988678015', time=2024-09-12T19:45:29.742426+0000, chain.objs.size()=5 2024-09-12T17:46:53.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.236+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.95__multipart_key1.2~aVgJ8jnaUqxh5pFqVYpK28OyfKkNzhQ.1 2024-09-12T17:46:53.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.236+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.95__shadow_key1.2~aVgJ8jnaUqxh5pFqVYpK28OyfKkNzhQ.1_1 2024-09-12T17:46:53.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.236+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.95__multipart_key1.2~aVgJ8jnaUqxh5pFqVYpK28OyfKkNzhQ.2 2024-09-12T17:46:53.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.236+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.95__shadow_key1.2~aVgJ8jnaUqxh5pFqVYpK28OyfKkNzhQ.2_1 2024-09-12T17:46:53.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.236+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.95__multipart_key1.2~aVgJ8jnaUqxh5pFqVYpK28OyfKkNzhQ.3 2024-09-12T17:46:53.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.236+0000 7fab55575800 20 garbage collection: RGWGC::process iterating over entry tag='722b129a-cf7a-4aca-b594-5b9492d130e2.4623.12322817611845827298', time=2024-09-12T19:46:06.791863+0000, chain.objs.size()=5 2024-09-12T17:46:53.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.236+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.103__multipart_key1.2~-YWOGs6AAJAakjTW1_0fSm1Zvhe4-JR.1 2024-09-12T17:46:53.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.236+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.103__multipart_key1.2~-YWOGs6AAJAakjTW1_0fSm1Zvhe4-JR.2 2024-09-12T17:46:53.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.236+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.103__multipart_key1.2~-YWOGs6AAJAakjTW1_0fSm1Zvhe4-JR.3 2024-09-12T17:46:53.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.236+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.103__multipart_key1.2~-YWOGs6AAJAakjTW1_0fSm1Zvhe4-JR.4 2024-09-12T17:46:53.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.236+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.103__multipart_key1.2~-YWOGs6AAJAakjTW1_0fSm1Zvhe4-JR.5 2024-09-12T17:46:53.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.236+0000 7fab55575800 20 garbage collection: RGWGC::process iterating over entry tag='722b129a-cf7a-4aca-b594-5b9492d130e2.4623.17583812815567732833', time=2024-09-12T19:46:08.672914+0000, chain.objs.size()=5 2024-09-12T17:46:53.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.236+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.103__multipart_key1.2~HeyZzA2R4_2-re21y-ZQHZblcsBGS1Z.1 2024-09-12T17:46:53.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.236+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.103__shadow_key1.2~HeyZzA2R4_2-re21y-ZQHZblcsBGS1Z.1_1 2024-09-12T17:46:53.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.241+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.103__multipart_key1.2~HeyZzA2R4_2-re21y-ZQHZblcsBGS1Z.2 2024-09-12T17:46:53.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.242+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.103__shadow_key1.2~HeyZzA2R4_2-re21y-ZQHZblcsBGS1Z.2_1 2024-09-12T17:46:53.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.242+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.103__multipart_key1.2~HeyZzA2R4_2-re21y-ZQHZblcsBGS1Z.3 2024-09-12T17:46:53.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.247+0000 7fab55575800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:46:53.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.250+0000 7fab55575800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T17:46:53.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.251+0000 7fab55575800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:46:53.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.251+0000 7fab55575800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:46:53.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.252+0000 7fab55575800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:46:53.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.253+0000 7fab55575800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T17:46:53.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.254+0000 7fab55575800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:46:53.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.254+0000 7fab55575800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:46:53.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.255+0000 7fab55575800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T17:46:53.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.255+0000 7fab55575800 20 garbage collection: RGWGC::process iterating over entry tag='722b129a-cf7a-4aca-b594-5b9492d130e2.4623.16069227093328840359', time=2024-09-12T19:45:33.113704+0000, chain.objs.size()=5 2024-09-12T17:46:53.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.255+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.95__multipart_key1.2~GD3cNJIrAqNDnm6fiUvZk80_nU9oHQP.1 2024-09-12T17:46:53.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.255+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.95__shadow_key1.2~GD3cNJIrAqNDnm6fiUvZk80_nU9oHQP.1_1 2024-09-12T17:46:53.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.255+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.95__multipart_key1.2~GD3cNJIrAqNDnm6fiUvZk80_nU9oHQP.2 2024-09-12T17:46:53.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.255+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.95__shadow_key1.2~GD3cNJIrAqNDnm6fiUvZk80_nU9oHQP.2_1 2024-09-12T17:46:53.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.255+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.95__multipart_key1.2~GD3cNJIrAqNDnm6fiUvZk80_nU9oHQP.3 2024-09-12T17:46:53.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.258+0000 7fab55575800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:46:53.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.262+0000 7fab55575800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T17:46:53.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.263+0000 7fab55575800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:46:53.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.263+0000 7fab55575800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:46:53.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.264+0000 7fab55575800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:46:53.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.265+0000 7fab55575800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T17:46:53.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.266+0000 7fab55575800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:46:53.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.267+0000 7fab55575800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:46:53.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.267+0000 7fab55575800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:46:53.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.268+0000 7fab55575800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T17:46:53.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.269+0000 7fab55575800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:46:53.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.270+0000 7fab55575800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:46:53.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.270+0000 7fab55575800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:46:53.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.271+0000 7fab55575800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T17:46:53.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.273+0000 7fab55575800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:46:53.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.273+0000 7fab55575800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:46:53.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.273+0000 7fab55575800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:46:53.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.274+0000 7fab55575800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T17:46:53.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.276+0000 7fab55575800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:46:53.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.276+0000 7fab55575800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:46:53.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.277+0000 7fab55575800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T17:46:53.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.277+0000 7fab55575800 20 garbage collection: RGWGC::process iterating over entry tag='722b129a-cf7a-4aca-b594-5b9492d130e2.4623.570569745435100319', time=2024-09-12T19:46:10.948973+0000, chain.objs.size()=5 2024-09-12T17:46:53.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.277+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.103__multipart_key1.2~FFzRGJwmsdpAr-EQTvThsWoZutmvukh.1 2024-09-12T17:46:53.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.277+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.103__shadow_key1.2~FFzRGJwmsdpAr-EQTvThsWoZutmvukh.1_1 2024-09-12T17:46:53.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.277+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.103__multipart_key1.2~FFzRGJwmsdpAr-EQTvThsWoZutmvukh.2 2024-09-12T17:46:53.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.277+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.103__shadow_key1.2~FFzRGJwmsdpAr-EQTvThsWoZutmvukh.2_1 2024-09-12T17:46:53.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.277+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.103__multipart_key1.2~FFzRGJwmsdpAr-EQTvThsWoZutmvukh.3 2024-09-12T17:46:53.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.280+0000 7fab55575800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:46:53.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.283+0000 7fab55575800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T17:46:53.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.284+0000 7fab55575800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:46:53.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.285+0000 7fab55575800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:46:53.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.285+0000 7fab55575800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T17:46:53.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.285+0000 7fab55575800 20 garbage collection: RGWGC::process iterating over entry tag='722b129a-cf7a-4aca-b594-5b9492d130e2.4623.15167631934231007162', time=2024-09-12T19:45:26.274308+0000, chain.objs.size()=5 2024-09-12T17:46:53.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.285+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.95__multipart_key1.2~uYnHIEJx8msAhe9-U1yhnVXwREkCvYN.1 2024-09-12T17:46:53.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.285+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.95__multipart_key1.2~uYnHIEJx8msAhe9-U1yhnVXwREkCvYN.2 2024-09-12T17:46:53.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.285+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.95__multipart_key1.2~uYnHIEJx8msAhe9-U1yhnVXwREkCvYN.3 2024-09-12T17:46:53.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.285+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.95__multipart_key1.2~uYnHIEJx8msAhe9-U1yhnVXwREkCvYN.4 2024-09-12T17:46:53.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.285+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.95__multipart_key1.2~uYnHIEJx8msAhe9-U1yhnVXwREkCvYN.5 2024-09-12T17:46:53.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.285+0000 7fab55575800 20 garbage collection: RGWGC::process iterating over entry tag='722b129a-cf7a-4aca-b594-5b9492d130e2.4623.7510468294225086237', time=2024-09-12T19:46:49.583505+0000, chain.objs.size()=5 2024-09-12T17:46:53.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.285+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.144__multipart_key1.2~qRrrmkss3dyxkx7vXfUGpMDzJWvTSlF.1 2024-09-12T17:46:53.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.285+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.144__multipart_key1.2~qRrrmkss3dyxkx7vXfUGpMDzJWvTSlF.2 2024-09-12T17:46:53.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.285+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.144__multipart_key1.2~qRrrmkss3dyxkx7vXfUGpMDzJWvTSlF.3 2024-09-12T17:46:53.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.285+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.144__multipart_key1.2~qRrrmkss3dyxkx7vXfUGpMDzJWvTSlF.4 2024-09-12T17:46:53.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.285+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.144__multipart_key1.2~qRrrmkss3dyxkx7vXfUGpMDzJWvTSlF.5 2024-09-12T17:46:53.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.291+0000 7fab55575800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:46:53.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.293+0000 7fab55575800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T17:46:53.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.294+0000 7fab55575800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:46:53.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.295+0000 7fab55575800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:46:53.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.295+0000 7fab55575800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T17:46:53.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.295+0000 7fab55575800 20 garbage collection: RGWGC::process iterating over entry tag='722b129a-cf7a-4aca-b594-5b9492d130e2.4623.17287066341012983149', time=2024-09-12T19:45:09.805454+0000, chain.objs.size()=5 2024-09-12T17:46:53.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.295+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.95__multipart_key1.2~S4qfNn89NyGYu8rSmZbpIj6-NIQ93iK.1 2024-09-12T17:46:53.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.295+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.95__multipart_key1.2~S4qfNn89NyGYu8rSmZbpIj6-NIQ93iK.2 2024-09-12T17:46:53.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.295+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.95__multipart_key1.2~S4qfNn89NyGYu8rSmZbpIj6-NIQ93iK.3 2024-09-12T17:46:53.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.295+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.95__multipart_key1.2~S4qfNn89NyGYu8rSmZbpIj6-NIQ93iK.4 2024-09-12T17:46:53.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.295+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.95__multipart_key1.2~S4qfNn89NyGYu8rSmZbpIj6-NIQ93iK.5 2024-09-12T17:46:53.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.295+0000 7fab55575800 20 garbage collection: RGWGC::process iterating over entry tag='722b129a-cf7a-4aca-b594-5b9492d130e2.4623.17562858813973840648', time=2024-09-12T19:46:14.638359+0000, chain.objs.size()=5 2024-09-12T17:46:53.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.295+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.104__multipart_key1.2~ljR6iWMIalavQnYAtztW7wjaWbVrU7a.1 2024-09-12T17:46:53.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.295+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.104__multipart_key1.2~ljR6iWMIalavQnYAtztW7wjaWbVrU7a.2 2024-09-12T17:46:53.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.295+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.104__multipart_key1.2~ljR6iWMIalavQnYAtztW7wjaWbVrU7a.3 2024-09-12T17:46:53.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.295+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.104__multipart_key1.2~ljR6iWMIalavQnYAtztW7wjaWbVrU7a.4 2024-09-12T17:46:53.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.295+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.104__multipart_key1.2~ljR6iWMIalavQnYAtztW7wjaWbVrU7a.5 2024-09-12T17:46:53.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.301+0000 7fab55575800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:46:53.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.304+0000 7fab55575800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T17:46:53.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.305+0000 7fab55575800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:46:53.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.306+0000 7fab55575800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:46:53.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.306+0000 7fab55575800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:46:53.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.307+0000 7fab55575800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T17:46:53.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.309+0000 7fab55575800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:46:53.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.309+0000 7fab55575800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:46:53.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.310+0000 7fab55575800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:46:53.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.311+0000 7fab55575800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T17:46:53.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.312+0000 7fab55575800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:46:53.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.312+0000 7fab55575800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:46:53.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.313+0000 7fab55575800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T17:46:53.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.313+0000 7fab55575800 20 garbage collection: RGWGC::process iterating over entry tag='722b129a-cf7a-4aca-b594-5b9492d130e2.4623.1461332839232313874', time=2024-09-12T19:46:04.707962+0000, chain.objs.size()=5 2024-09-12T17:46:53.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.313+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.103__multipart_key1.2~niCp205DYerI2s3l78Ywg-OuH1HpK86.1 2024-09-12T17:46:53.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.313+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.103__multipart_key1.2~niCp205DYerI2s3l78Ywg-OuH1HpK86.2 2024-09-12T17:46:53.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.313+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.103__multipart_key1.2~niCp205DYerI2s3l78Ywg-OuH1HpK86.3 2024-09-12T17:46:53.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.313+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.103__multipart_key1.2~niCp205DYerI2s3l78Ywg-OuH1HpK86.4 2024-09-12T17:46:53.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.313+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.103__multipart_key1.2~niCp205DYerI2s3l78Ywg-OuH1HpK86.5 2024-09-12T17:46:53.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.315+0000 7fab55575800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:46:53.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.318+0000 7fab55575800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T17:46:53.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.320+0000 7fab55575800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:46:53.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.321+0000 7fab55575800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:46:53.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.321+0000 7fab55575800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T17:46:53.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.321+0000 7fab55575800 20 garbage collection: RGWGC::process iterating over entry tag='2~EhYS3xRlkhHkY-itWTqEe1xPNScq6NR', time=2024-09-12T19:44:40.133867+0000, chain.objs.size()=5 2024-09-12T17:46:53.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.321+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.80__multipart_key1.2~EhYS3xRlkhHkY-itWTqEe1xPNScq6NR.1 2024-09-12T17:46:53.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.321+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.80__multipart_key1.2~EhYS3xRlkhHkY-itWTqEe1xPNScq6NR.2 2024-09-12T17:46:53.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.321+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.80__multipart_key1.2~EhYS3xRlkhHkY-itWTqEe1xPNScq6NR.3 2024-09-12T17:46:53.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.321+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.80__multipart_key1.2~EhYS3xRlkhHkY-itWTqEe1xPNScq6NR.4 2024-09-12T17:46:53.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.321+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.80__multipart_key1.2~EhYS3xRlkhHkY-itWTqEe1xPNScq6NR.5 2024-09-12T17:46:53.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.325+0000 7fab55575800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:46:53.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.328+0000 7fab55575800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T17:46:53.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.329+0000 7fab55575800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:46:53.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.329+0000 7fab55575800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:46:53.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.330+0000 7fab55575800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T17:46:53.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.330+0000 7fab55575800 20 garbage collection: RGWGC::process iterating over entry tag='2~mH7kV8zfGJR-EgT63OanJ1esOlpUltI', time=2024-09-12T19:45:49.169195+0000, chain.objs.size()=5 2024-09-12T17:46:53.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.330+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.102__multipart_key1.2~mH7kV8zfGJR-EgT63OanJ1esOlpUltI.7 2024-09-12T17:46:53.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.330+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.102__multipart_key1.2~mH7kV8zfGJR-EgT63OanJ1esOlpUltI.8 2024-09-12T17:46:53.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.330+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.102__multipart_key1.2~mH7kV8zfGJR-EgT63OanJ1esOlpUltI.9 2024-09-12T17:46:53.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.330+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.102__multipart_key1.2~mH7kV8zfGJR-EgT63OanJ1esOlpUltI.10 2024-09-12T17:46:53.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.330+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.102__multipart_key1.2~mH7kV8zfGJR-EgT63OanJ1esOlpUltI.11 2024-09-12T17:46:53.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.333+0000 7fab55575800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:46:53.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.336+0000 7fab55575800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T17:46:53.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.338+0000 7fab55575800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:46:53.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.338+0000 7fab55575800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:46:53.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.338+0000 7fab55575800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T17:46:53.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.338+0000 7fab55575800 20 garbage collection: RGWGC::process iterating over entry tag='722b129a-cf7a-4aca-b594-5b9492d130e2.4623.3763404510156519071', time=2024-09-12T19:44:43.941434+0000, chain.objs.size()=2 2024-09-12T17:46:53.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.338+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.84__shadow_.rICI9e9wu5WRQBbPaoS_MNMXD_EWJME_1 2024-09-12T17:46:53.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.338+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.84__shadow_.rICI9e9wu5WRQBbPaoS_MNMXD_EWJME_2 2024-09-12T17:46:53.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.340+0000 7fab55575800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:46:53.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.343+0000 7fab55575800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T17:46:53.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.345+0000 7fab55575800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:46:53.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.345+0000 7fab55575800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:46:53.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.345+0000 7fab55575800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T17:46:53.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.345+0000 7fab55575800 20 garbage collection: RGWGC::process iterating over entry tag='722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2681309899995047629', time=2024-09-12T19:45:33.312552+0000, chain.objs.size()=5 2024-09-12T17:46:53.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.345+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.95__multipart_key1.2~zu3cWbpD3Uz8hnEhnAdR64u4Fq7loIM.1 2024-09-12T17:46:53.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.345+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.95__shadow_key1.2~zu3cWbpD3Uz8hnEhnAdR64u4Fq7loIM.1_1 2024-09-12T17:46:53.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.345+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.95__multipart_key1.2~zu3cWbpD3Uz8hnEhnAdR64u4Fq7loIM.2 2024-09-12T17:46:53.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.345+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.95__shadow_key1.2~zu3cWbpD3Uz8hnEhnAdR64u4Fq7loIM.2_1 2024-09-12T17:46:53.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.345+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.95__multipart_key1.2~zu3cWbpD3Uz8hnEhnAdR64u4Fq7loIM.3 2024-09-12T17:46:53.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.349+0000 7fab55575800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:46:53.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.351+0000 7fab55575800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T17:46:53.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.353+0000 7fab55575800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:46:53.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.353+0000 7fab55575800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:46:53.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.353+0000 7fab55575800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:46:53.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.354+0000 7fab55575800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T17:46:53.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.355+0000 7fab55575800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:46:53.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.356+0000 7fab55575800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:46:53.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.356+0000 7fab55575800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T17:46:53.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.356+0000 7fab55575800 20 garbage collection: RGWGC::process iterating over entry tag='722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2457218307168300694', time=2024-09-12T19:44:49.999720+0000, chain.objs.size()=5 2024-09-12T17:46:53.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.356+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.92__multipart_key1.2~3Zu1xsvmkNvBS9AGMMWcFLKFsfv8Cbl.1 2024-09-12T17:46:53.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.356+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.92__multipart_key1.2~3Zu1xsvmkNvBS9AGMMWcFLKFsfv8Cbl.2 2024-09-12T17:46:53.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.356+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.92__multipart_key1.2~3Zu1xsvmkNvBS9AGMMWcFLKFsfv8Cbl.3 2024-09-12T17:46:53.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.356+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.92__multipart_key1.2~3Zu1xsvmkNvBS9AGMMWcFLKFsfv8Cbl.4 2024-09-12T17:46:53.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.356+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.92__multipart_key1.2~3Zu1xsvmkNvBS9AGMMWcFLKFsfv8Cbl.5 2024-09-12T17:46:53.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.356+0000 7fab55575800 20 garbage collection: RGWGC::process iterating over entry tag='722b129a-cf7a-4aca-b594-5b9492d130e2.4623.17444998117839752372', time=2024-09-12T19:46:02.549023+0000, chain.objs.size()=5 2024-09-12T17:46:53.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.356+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.103__multipart_key1.2~qcRqvm3wcDg5kpLUZRpS6cYlNOQIo6V.1 2024-09-12T17:46:53.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.356+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.103__multipart_key1.2~qcRqvm3wcDg5kpLUZRpS6cYlNOQIo6V.2 2024-09-12T17:46:53.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.356+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.103__multipart_key1.2~qcRqvm3wcDg5kpLUZRpS6cYlNOQIo6V.3 2024-09-12T17:46:53.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.356+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.103__multipart_key1.2~qcRqvm3wcDg5kpLUZRpS6cYlNOQIo6V.4 2024-09-12T17:46:53.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.356+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.103__multipart_key1.2~qcRqvm3wcDg5kpLUZRpS6cYlNOQIo6V.5 2024-09-12T17:46:53.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.356+0000 7fab55575800 20 garbage collection: RGWGC::process iterating over entry tag='2~SI3YshlMHhpPpA3ygSp9QGIzjEcRFMR', time=2024-09-12T19:46:22.319633+0000, chain.objs.size()=68 2024-09-12T17:46:53.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.356+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.106__multipart_key1.2~SI3YshlMHhpPpA3ygSp9QGIzjEcRFMR.1 2024-09-12T17:46:53.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.356+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.106__multipart_key1.2~SI3YshlMHhpPpA3ygSp9QGIzjEcRFMR.2 2024-09-12T17:46:53.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.360+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.106__multipart_key1.2~SI3YshlMHhpPpA3ygSp9QGIzjEcRFMR.3 2024-09-12T17:46:53.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.361+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.106__multipart_key1.2~SI3YshlMHhpPpA3ygSp9QGIzjEcRFMR.4 2024-09-12T17:46:53.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.362+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.106__multipart_key1.2~SI3YshlMHhpPpA3ygSp9QGIzjEcRFMR.5 2024-09-12T17:46:53.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.362+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.106__multipart_key1.2~SI3YshlMHhpPpA3ygSp9QGIzjEcRFMR.6 2024-09-12T17:46:53.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.362+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.106__multipart_key1.2~SI3YshlMHhpPpA3ygSp9QGIzjEcRFMR.7 2024-09-12T17:46:53.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.362+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.106__multipart_key1.2~SI3YshlMHhpPpA3ygSp9QGIzjEcRFMR.8 2024-09-12T17:46:53.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.362+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.106__multipart_key1.2~SI3YshlMHhpPpA3ygSp9QGIzjEcRFMR.9 2024-09-12T17:46:53.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.363+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.106__multipart_key1.2~SI3YshlMHhpPpA3ygSp9QGIzjEcRFMR.10 2024-09-12T17:46:53.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.364+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.106__multipart_key1.2~SI3YshlMHhpPpA3ygSp9QGIzjEcRFMR.11 2024-09-12T17:46:53.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.364+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.106__multipart_key1.2~SI3YshlMHhpPpA3ygSp9QGIzjEcRFMR.12 2024-09-12T17:46:53.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.364+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.106__multipart_key1.2~SI3YshlMHhpPpA3ygSp9QGIzjEcRFMR.13 2024-09-12T17:46:53.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.364+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.106__multipart_key1.2~SI3YshlMHhpPpA3ygSp9QGIzjEcRFMR.14 2024-09-12T17:46:53.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.366+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.106__multipart_key1.2~SI3YshlMHhpPpA3ygSp9QGIzjEcRFMR.15 2024-09-12T17:46:53.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.366+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.106__multipart_key1.2~SI3YshlMHhpPpA3ygSp9QGIzjEcRFMR.16 2024-09-12T17:46:53.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.366+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.106__multipart_key1.2~SI3YshlMHhpPpA3ygSp9QGIzjEcRFMR.17 2024-09-12T17:46:53.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.368+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.106__multipart_key1.2~SI3YshlMHhpPpA3ygSp9QGIzjEcRFMR.18 2024-09-12T17:46:53.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.368+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.106__multipart_key1.2~SI3YshlMHhpPpA3ygSp9QGIzjEcRFMR.19 2024-09-12T17:46:53.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.368+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.106__multipart_key1.2~SI3YshlMHhpPpA3ygSp9QGIzjEcRFMR.20 2024-09-12T17:46:53.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.368+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.106__multipart_key1.2~SI3YshlMHhpPpA3ygSp9QGIzjEcRFMR.21 2024-09-12T17:46:53.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.368+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.106__multipart_key1.2~SI3YshlMHhpPpA3ygSp9QGIzjEcRFMR.22 2024-09-12T17:46:53.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.368+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.106__multipart_key1.2~SI3YshlMHhpPpA3ygSp9QGIzjEcRFMR.23 2024-09-12T17:46:53.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.368+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.106__multipart_key1.2~SI3YshlMHhpPpA3ygSp9QGIzjEcRFMR.24 2024-09-12T17:46:53.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.369+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.106__multipart_key1.2~SI3YshlMHhpPpA3ygSp9QGIzjEcRFMR.25 2024-09-12T17:46:53.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.369+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.106__multipart_key1.2~SI3YshlMHhpPpA3ygSp9QGIzjEcRFMR.26 2024-09-12T17:46:53.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.369+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.106__multipart_key1.2~SI3YshlMHhpPpA3ygSp9QGIzjEcRFMR.27 2024-09-12T17:46:53.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.370+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.106__multipart_key1.2~SI3YshlMHhpPpA3ygSp9QGIzjEcRFMR.28 2024-09-12T17:46:53.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.373+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.106__multipart_key1.2~SI3YshlMHhpPpA3ygSp9QGIzjEcRFMR.29 2024-09-12T17:46:53.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.375+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.106__multipart_key1.2~SI3YshlMHhpPpA3ygSp9QGIzjEcRFMR.30 2024-09-12T17:46:53.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.375+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.106__multipart_key1.2~SI3YshlMHhpPpA3ygSp9QGIzjEcRFMR.31 2024-09-12T17:46:53.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.376+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.106__multipart_key1.2~SI3YshlMHhpPpA3ygSp9QGIzjEcRFMR.32 2024-09-12T17:46:53.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.376+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.106__multipart_key1.2~SI3YshlMHhpPpA3ygSp9QGIzjEcRFMR.33 2024-09-12T17:46:53.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.376+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.106__multipart_key1.2~SI3YshlMHhpPpA3ygSp9QGIzjEcRFMR.34 2024-09-12T17:46:53.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.376+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.106__multipart_key1.2~SI3YshlMHhpPpA3ygSp9QGIzjEcRFMR.35 2024-09-12T17:46:53.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.376+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.106__multipart_key1.2~SI3YshlMHhpPpA3ygSp9QGIzjEcRFMR.36 2024-09-12T17:46:53.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.376+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.106__multipart_key1.2~SI3YshlMHhpPpA3ygSp9QGIzjEcRFMR.37 2024-09-12T17:46:53.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.376+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.106__multipart_key1.2~SI3YshlMHhpPpA3ygSp9QGIzjEcRFMR.38 2024-09-12T17:46:53.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.376+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.106__multipart_key1.2~SI3YshlMHhpPpA3ygSp9QGIzjEcRFMR.39 2024-09-12T17:46:53.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.378+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.106__multipart_key1.2~SI3YshlMHhpPpA3ygSp9QGIzjEcRFMR.40 2024-09-12T17:46:53.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.380+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.106__multipart_key1.2~SI3YshlMHhpPpA3ygSp9QGIzjEcRFMR.41 2024-09-12T17:46:53.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.380+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.106__multipart_key1.2~SI3YshlMHhpPpA3ygSp9QGIzjEcRFMR.42 2024-09-12T17:46:53.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.381+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.106__multipart_key1.2~SI3YshlMHhpPpA3ygSp9QGIzjEcRFMR.43 2024-09-12T17:46:53.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.381+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.106__multipart_key1.2~SI3YshlMHhpPpA3ygSp9QGIzjEcRFMR.44 2024-09-12T17:46:53.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.382+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.106__multipart_key1.2~SI3YshlMHhpPpA3ygSp9QGIzjEcRFMR.45 2024-09-12T17:46:53.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.382+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.106__multipart_key1.2~SI3YshlMHhpPpA3ygSp9QGIzjEcRFMR.46 2024-09-12T17:46:53.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.382+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.106__multipart_key1.2~SI3YshlMHhpPpA3ygSp9QGIzjEcRFMR.47 2024-09-12T17:46:53.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.382+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.106__multipart_key1.2~SI3YshlMHhpPpA3ygSp9QGIzjEcRFMR.48 2024-09-12T17:46:53.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.382+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.106__multipart_key1.2~SI3YshlMHhpPpA3ygSp9QGIzjEcRFMR.49 2024-09-12T17:46:53.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.382+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.106__multipart_key1.2~SI3YshlMHhpPpA3ygSp9QGIzjEcRFMR.50 2024-09-12T17:46:53.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.382+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.106__multipart_key1.2~SI3YshlMHhpPpA3ygSp9QGIzjEcRFMR.51 2024-09-12T17:46:53.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.384+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.106__multipart_key1.2~SI3YshlMHhpPpA3ygSp9QGIzjEcRFMR.52 2024-09-12T17:46:53.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.386+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.106__multipart_key1.2~SI3YshlMHhpPpA3ygSp9QGIzjEcRFMR.53 2024-09-12T17:46:53.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.386+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.106__multipart_key1.2~SI3YshlMHhpPpA3ygSp9QGIzjEcRFMR.54 2024-09-12T17:46:53.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.386+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.106__multipart_key1.2~SI3YshlMHhpPpA3ygSp9QGIzjEcRFMR.55 2024-09-12T17:46:53.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.386+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.106__multipart_key1.2~SI3YshlMHhpPpA3ygSp9QGIzjEcRFMR.56 2024-09-12T17:46:53.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.388+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.106__multipart_key1.2~SI3YshlMHhpPpA3ygSp9QGIzjEcRFMR.57 2024-09-12T17:46:53.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.389+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.106__multipart_key1.2~SI3YshlMHhpPpA3ygSp9QGIzjEcRFMR.58 2024-09-12T17:46:53.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.389+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.106__multipart_key1.2~SI3YshlMHhpPpA3ygSp9QGIzjEcRFMR.59 2024-09-12T17:46:53.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.389+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.106__multipart_key1.2~SI3YshlMHhpPpA3ygSp9QGIzjEcRFMR.60 2024-09-12T17:46:53.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.389+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.106__multipart_key1.2~SI3YshlMHhpPpA3ygSp9QGIzjEcRFMR.61 2024-09-12T17:46:53.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.389+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.106__multipart_key1.2~SI3YshlMHhpPpA3ygSp9QGIzjEcRFMR.62 2024-09-12T17:46:53.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.389+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.106__multipart_key1.2~SI3YshlMHhpPpA3ygSp9QGIzjEcRFMR.63 2024-09-12T17:46:53.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.390+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.106__multipart_key1.2~SI3YshlMHhpPpA3ygSp9QGIzjEcRFMR.64 2024-09-12T17:46:53.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.390+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.106__multipart_key1.2~SI3YshlMHhpPpA3ygSp9QGIzjEcRFMR.65 2024-09-12T17:46:53.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.394+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.106__multipart_key1.2~SI3YshlMHhpPpA3ygSp9QGIzjEcRFMR.66 2024-09-12T17:46:53.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.394+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.106__multipart_key1.2~SI3YshlMHhpPpA3ygSp9QGIzjEcRFMR.67 2024-09-12T17:46:53.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.394+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.106__multipart_key1.2~SI3YshlMHhpPpA3ygSp9QGIzjEcRFMR.68 2024-09-12T17:46:53.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.394+0000 7fab55575800 20 garbage collection: RGWGC::process iterating over entry tag='722b129a-cf7a-4aca-b594-5b9492d130e2.4623.3177673031414734241', time=2024-09-12T19:46:52.302776+0000, chain.objs.size()=5 2024-09-12T17:46:53.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.394+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.145__multipart_key1/data/file.mpg.2~ALRb0USBx5JbQXMaA952aO7UORZkaPp.1 2024-09-12T17:46:53.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.394+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.145__multipart_key1/data/file.mpg.2~ALRb0USBx5JbQXMaA952aO7UORZkaPp.2 2024-09-12T17:46:53.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.394+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.145__multipart_key1/data/file.mpg.2~ALRb0USBx5JbQXMaA952aO7UORZkaPp.3 2024-09-12T17:46:53.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.395+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.145__multipart_key1/data/file.mpg.2~ALRb0USBx5JbQXMaA952aO7UORZkaPp.4 2024-09-12T17:46:53.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.395+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.145__multipart_key1/data/file.mpg.2~ALRb0USBx5JbQXMaA952aO7UORZkaPp.5 2024-09-12T17:46:53.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.399+0000 7fab55575800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:46:53.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.403+0000 7fab55575800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T17:46:53.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.404+0000 7fab55575800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:46:53.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.404+0000 7fab55575800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:46:53.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.405+0000 7fab55575800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T17:46:53.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.405+0000 7fab55575800 20 garbage collection: RGWGC::process iterating over entry tag='722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18290050240699253986', time=2024-09-12T19:45:22.828456+0000, chain.objs.size()=5 2024-09-12T17:46:53.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.405+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.95__multipart_key1.2~5_Tci5qb4t_PCgWwnkDf6lIpq4lYwSS.1 2024-09-12T17:46:53.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.405+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.95__multipart_key1.2~5_Tci5qb4t_PCgWwnkDf6lIpq4lYwSS.2 2024-09-12T17:46:53.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.405+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.95__multipart_key1.2~5_Tci5qb4t_PCgWwnkDf6lIpq4lYwSS.3 2024-09-12T17:46:53.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.405+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.95__multipart_key1.2~5_Tci5qb4t_PCgWwnkDf6lIpq4lYwSS.4 2024-09-12T17:46:53.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.405+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.95__multipart_key1.2~5_Tci5qb4t_PCgWwnkDf6lIpq4lYwSS.5 2024-09-12T17:46:53.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.408+0000 7fab55575800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:46:53.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.411+0000 7fab55575800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T17:46:53.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.413+0000 7fab55575800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:46:53.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.413+0000 7fab55575800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:46:53.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.414+0000 7fab55575800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:46:53.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.415+0000 7fab55575800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T17:46:53.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.416+0000 7fab55575800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:46:53.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.416+0000 7fab55575800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:46:53.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.416+0000 7fab55575800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T17:46:53.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.416+0000 7fab55575800 20 garbage collection: RGWGC::process iterating over entry tag='722b129a-cf7a-4aca-b594-5b9492d130e2.4623.12501927709573807274', time=2024-09-12T19:46:10.754410+0000, chain.objs.size()=5 2024-09-12T17:46:53.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.416+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.103__multipart_key1.2~l7f_xU9IDaNOIobhYEO7tZ1USR5nYvb.1 2024-09-12T17:46:53.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.416+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.103__shadow_key1.2~l7f_xU9IDaNOIobhYEO7tZ1USR5nYvb.1_1 2024-09-12T17:46:53.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.417+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.103__multipart_key1.2~l7f_xU9IDaNOIobhYEO7tZ1USR5nYvb.2 2024-09-12T17:46:53.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.417+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.103__shadow_key1.2~l7f_xU9IDaNOIobhYEO7tZ1USR5nYvb.2_1 2024-09-12T17:46:53.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.417+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.103__multipart_key1.2~l7f_xU9IDaNOIobhYEO7tZ1USR5nYvb.3 2024-09-12T17:46:53.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.420+0000 7fab55575800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:46:53.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.422+0000 7fab55575800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T17:46:53.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.424+0000 7fab55575800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:46:53.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.424+0000 7fab55575800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:46:53.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.425+0000 7fab55575800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T17:46:53.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.425+0000 7fab55575800 20 garbage collection: RGWGC::process iterating over entry tag='722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18025108378852928237', time=2024-09-12T19:45:41.310672+0000, chain.objs.size()=5 2024-09-12T17:46:53.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.425+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.100__multipart_key1.2~dd62Oxi-CO9mBdkz8wH84jUiv82QEXc.1 2024-09-12T17:46:53.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.425+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.100__multipart_key1.2~dd62Oxi-CO9mBdkz8wH84jUiv82QEXc.2 2024-09-12T17:46:53.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.425+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.100__multipart_key1.2~dd62Oxi-CO9mBdkz8wH84jUiv82QEXc.3 2024-09-12T17:46:53.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.425+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.100__multipart_key1.2~dd62Oxi-CO9mBdkz8wH84jUiv82QEXc.4 2024-09-12T17:46:53.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.425+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.100__multipart_key1.2~dd62Oxi-CO9mBdkz8wH84jUiv82QEXc.5 2024-09-12T17:46:53.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.428+0000 7fab55575800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:46:53.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.431+0000 7fab55575800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T17:46:53.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.432+0000 7fab55575800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:46:53.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.433+0000 7fab55575800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:46:53.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.433+0000 7fab55575800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:46:53.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.434+0000 7fab55575800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T17:46:53.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.435+0000 7fab55575800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:46:53.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.436+0000 7fab55575800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:46:53.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.436+0000 7fab55575800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T17:46:53.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.436+0000 7fab55575800 20 garbage collection: RGWGC::process iterating over entry tag='722b129a-cf7a-4aca-b594-5b9492d130e2.4623.8992166893874656571', time=2024-09-12T19:46:17.603505+0000, chain.objs.size()=5 2024-09-12T17:46:53.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.436+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.105__multipart_key1.2~PiEGLbIgFRHzY0DG0I71aeNKLIbNhE7.1 2024-09-12T17:46:53.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.436+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.105__multipart_key1.2~PiEGLbIgFRHzY0DG0I71aeNKLIbNhE7.2 2024-09-12T17:46:53.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.436+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.105__multipart_key1.2~PiEGLbIgFRHzY0DG0I71aeNKLIbNhE7.3 2024-09-12T17:46:53.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.436+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.105__multipart_key1.2~PiEGLbIgFRHzY0DG0I71aeNKLIbNhE7.4 2024-09-12T17:46:53.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.436+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.105__multipart_key1.2~PiEGLbIgFRHzY0DG0I71aeNKLIbNhE7.5 2024-09-12T17:46:53.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.439+0000 7fab55575800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:46:53.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.442+0000 7fab55575800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T17:46:53.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.443+0000 7fab55575800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:46:53.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.444+0000 7fab55575800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:46:53.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.444+0000 7fab55575800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T17:46:53.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.444+0000 7fab55575800 20 garbage collection: RGWGC::process iterating over entry tag='722b129a-cf7a-4aca-b594-5b9492d130e2.4623.12285603982371107105', time=2024-09-12T19:45:46.464611+0000, chain.objs.size()=5 2024-09-12T17:46:53.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.444+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.101__multipart_file2.mpg.2~Wt3ayCd3-HMhUDjgNDZ909GEUsqhjzr.1 2024-09-12T17:46:53.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.444+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.101__multipart_file2.mpg.2~Wt3ayCd3-HMhUDjgNDZ909GEUsqhjzr.2 2024-09-12T17:46:53.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.444+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.101__multipart_file2.mpg.2~Wt3ayCd3-HMhUDjgNDZ909GEUsqhjzr.3 2024-09-12T17:46:53.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.444+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.101__multipart_file2.mpg.2~Wt3ayCd3-HMhUDjgNDZ909GEUsqhjzr.4 2024-09-12T17:46:53.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.444+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.101__multipart_file2.mpg.2~Wt3ayCd3-HMhUDjgNDZ909GEUsqhjzr.5 2024-09-12T17:46:53.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.447+0000 7fab55575800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:46:53.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.450+0000 7fab55575800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T17:46:53.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.451+0000 7fab55575800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:46:53.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.451+0000 7fab55575800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:46:53.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.452+0000 7fab55575800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:46:53.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.453+0000 7fab55575800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T17:46:53.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.454+0000 7fab55575800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:46:53.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.455+0000 7fab55575800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:46:53.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.455+0000 7fab55575800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T17:46:53.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.455+0000 7fab55575800 20 garbage collection: RGWGC::process iterating over entry tag='722b129a-cf7a-4aca-b594-5b9492d130e2.4623.10706032465449938813', time=2024-09-12T19:45:33.597899+0000, chain.objs.size()=4 2024-09-12T17:46:53.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.455+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.94__shadow_.AqmljsJ3eXX8SxEo6z5ZFZ7_pcNwpXw_1 2024-09-12T17:46:53.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.455+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.94__shadow_.AqmljsJ3eXX8SxEo6z5ZFZ7_pcNwpXw_2 2024-09-12T17:46:53.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.455+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.94__shadow_.AqmljsJ3eXX8SxEo6z5ZFZ7_pcNwpXw_3 2024-09-12T17:46:53.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.455+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.94__shadow_.AqmljsJ3eXX8SxEo6z5ZFZ7_pcNwpXw_4 2024-09-12T17:46:53.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.457+0000 7fab55575800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:46:53.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.460+0000 7fab55575800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T17:46:53.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.462+0000 7fab55575800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:46:53.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.462+0000 7fab55575800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:46:53.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.463+0000 7fab55575800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T17:46:53.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.463+0000 7fab55575800 20 garbage collection: RGWGC::process iterating over entry tag='722b129a-cf7a-4aca-b594-5b9492d130e2.4623.9895814569480588027', time=2024-09-12T19:44:50.284678+0000, chain.objs.size()=5 2024-09-12T17:46:53.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.463+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.92__multipart_key1.2~3Zu1xsvmkNvBS9AGMMWcFLKFsfv8Cbl.1 2024-09-12T17:46:53.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.463+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.92__multipart_key1.2~3Zu1xsvmkNvBS9AGMMWcFLKFsfv8Cbl.2 2024-09-12T17:46:53.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.463+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.92__multipart_key1.2~3Zu1xsvmkNvBS9AGMMWcFLKFsfv8Cbl.3 2024-09-12T17:46:53.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.463+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.92__multipart_key1.2~3Zu1xsvmkNvBS9AGMMWcFLKFsfv8Cbl.4 2024-09-12T17:46:53.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.463+0000 7fab55575800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.92__multipart_key1.2~3Zu1xsvmkNvBS9AGMMWcFLKFsfv8Cbl.5 2024-09-12T17:46:53.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.466+0000 7fab55575800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:46:53.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.470+0000 7faa09fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:46:53.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.472+0000 7fab55575800 20 remove_watcher() i=0 2024-09-12T17:46:53.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.472+0000 7fab55575800 2 removed watcher, disabling cache 2024-09-12T17:46:53.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.473+0000 7fab55575800 20 remove_watcher() i=1 2024-09-12T17:46:53.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.474+0000 7fab55575800 20 remove_watcher() i=2 2024-09-12T17:46:53.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.475+0000 7fab55575800 20 remove_watcher() i=3 2024-09-12T17:46:53.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.476+0000 7fab55575800 20 remove_watcher() i=4 2024-09-12T17:46:53.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.477+0000 7fab55575800 20 remove_watcher() i=5 2024-09-12T17:46:53.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.478+0000 7fab55575800 20 remove_watcher() i=6 2024-09-12T17:46:53.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.479+0000 7fab55575800 20 remove_watcher() i=7 2024-09-12T17:46:53.492 DEBUG:teuthology.orchestra.run.smithi037:> radosgw-admin gc process --include-all 2024-09-12T17:46:53.545 INFO:teuthology.orchestra.run.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:46:53.545 INFO:teuthology.orchestra.run.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:46:53.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.583+0000 7f4e38220800 20 rados->read ofs=0 len=0 2024-09-12T17:46:53.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.585+0000 7f4e38220800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:53.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.585+0000 7f4e38220800 20 realm 2024-09-12T17:46:53.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.585+0000 7f4e38220800 20 rados->read ofs=0 len=0 2024-09-12T17:46:53.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.585+0000 7f4e38220800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:53.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.585+0000 7f4e38220800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:46:53.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.585+0000 7f4e38220800 20 rados->read ofs=0 len=0 2024-09-12T17:46:53.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.585+0000 7f4e38220800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:53.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.585+0000 7f4e38220800 20 rados->read ofs=0 len=0 2024-09-12T17:46:53.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.586+0000 7f4e38220800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:46:53.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.586+0000 7f4e38220800 20 rados->read ofs=0 len=0 2024-09-12T17:46:53.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.586+0000 7f4e38220800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:46:53.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.586+0000 7f4e38220800 20 searching for the correct realm 2024-09-12T17:46:53.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.589+0000 7f4e35509640 0 -- 172.21.15.37:0/4267495505 >> [v2:172.21.15.40:6800/2441293461,v1:172.21.15.40:6801/2441293461] conn(0x7f4e2807a040 msgr2=0x7f4e2806d930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:46:53.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.593+0000 7f4e35d0a640 0 -- 172.21.15.37:0/4267495505 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7f4e2c083b60 msgr2=0x7f4e2c06ba10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:46:53.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.800+0000 7f4e38220800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:46:53.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.800+0000 7f4e38220800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:46:53.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.800+0000 7f4e38220800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:46:53.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.800+0000 7f4e38220800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:46:53.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.800+0000 7f4e38220800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:46:53.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.800+0000 7f4e38220800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:46:53.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.800+0000 7f4e38220800 20 rados->read ofs=0 len=0 2024-09-12T17:46:53.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.800+0000 7f4e38220800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:53.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.800+0000 7f4e38220800 20 rados->read ofs=0 len=0 2024-09-12T17:46:53.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.801+0000 7f4e38220800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:46:53.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.801+0000 7f4e38220800 20 rados->read ofs=0 len=0 2024-09-12T17:46:53.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.801+0000 7f4e38220800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:46:53.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.801+0000 7f4e38220800 20 zone default found 2024-09-12T17:46:53.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.801+0000 7f4e38220800 4 Realm: () 2024-09-12T17:46:53.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.801+0000 7f4e38220800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:46:53.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.801+0000 7f4e38220800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:46:53.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.801+0000 7f4e38220800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:46:53.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.801+0000 7f4e38220800 20 zonegroup default 2024-09-12T17:46:53.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.801+0000 7f4e38220800 20 rados->read ofs=0 len=0 2024-09-12T17:46:53.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.801+0000 7f4e38220800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:53.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.801+0000 7f4e38220800 20 rados->read ofs=0 len=0 2024-09-12T17:46:53.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.802+0000 7f4e38220800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:53.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.802+0000 7f4e38220800 20 rados->read ofs=0 len=0 2024-09-12T17:46:53.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.802+0000 7f4e38220800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:53.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.802+0000 7f4e38220800 20 started sync module instance, tier type = 2024-09-12T17:46:53.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.802+0000 7f4e38220800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:46:53.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.811+0000 7f4e38220800 20 add_watcher() i=0 2024-09-12T17:46:53.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.811+0000 7f4e38220800 20 add_watcher() i=1 2024-09-12T17:46:53.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.811+0000 7f4e38220800 20 add_watcher() i=2 2024-09-12T17:46:53.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.811+0000 7f4e38220800 20 add_watcher() i=3 2024-09-12T17:46:53.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.811+0000 7f4e38220800 20 add_watcher() i=4 2024-09-12T17:46:53.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.811+0000 7f4e38220800 20 add_watcher() i=5 2024-09-12T17:46:53.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.811+0000 7f4e38220800 20 add_watcher() i=6 2024-09-12T17:46:53.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.812+0000 7f4e38220800 20 add_watcher() i=7 2024-09-12T17:46:53.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.812+0000 7f4e38220800 2 all 8 watchers are set, enabling cache 2024-09-12T17:46:53.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.814+0000 7f4ce77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:46:53.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.814+0000 7f4e38220800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:46:53.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.814+0000 7f4e38220800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:46:53.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.851+0000 7f4ce67fc640 20 reqs_thread_entry: start 2024-09-12T17:46:53.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.851+0000 7f4e38220800 20 init_complete bucket index max shards: 11 2024-09-12T17:46:53.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.851+0000 7f4e38220800 20 Filter name: none 2024-09-12T17:46:53.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.851+0000 7f4c57fff640 20 reqs_thread_entry: start 2024-09-12T17:46:53.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.851+0000 7f4e38220800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T17:46:53.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.853+0000 7f4e38220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:46:53.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.853+0000 7f4e38220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:46:53.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.853+0000 7f4e38220800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:46:53.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.854+0000 7f4e38220800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T17:46:53.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.856+0000 7f4e38220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:46:53.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.856+0000 7f4e38220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:46:53.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.857+0000 7f4e38220800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:46:53.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.858+0000 7f4e38220800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T17:46:53.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.859+0000 7f4e38220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:46:53.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.860+0000 7f4e38220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:46:53.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.860+0000 7f4e38220800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:46:53.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.861+0000 7f4e38220800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T17:46:53.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.862+0000 7f4e38220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:46:53.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.863+0000 7f4e38220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:46:53.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.863+0000 7f4e38220800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:46:53.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.864+0000 7f4e38220800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T17:46:53.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.865+0000 7f4e38220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:46:53.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.866+0000 7f4e38220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:46:53.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.866+0000 7f4e38220800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:46:53.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.867+0000 7f4e38220800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T17:46:53.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.868+0000 7f4e38220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:46:53.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.869+0000 7f4e38220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:46:53.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.869+0000 7f4e38220800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:46:53.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.870+0000 7f4e38220800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T17:46:53.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.871+0000 7f4e38220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:46:53.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.872+0000 7f4e38220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:46:53.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.872+0000 7f4e38220800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:46:53.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.873+0000 7f4e38220800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T17:46:53.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.874+0000 7f4e38220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:46:53.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.875+0000 7f4e38220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:46:53.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.875+0000 7f4e38220800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:46:53.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.876+0000 7f4e38220800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T17:46:53.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.877+0000 7f4e38220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:46:53.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.878+0000 7f4e38220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:46:53.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.878+0000 7f4e38220800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:46:53.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.879+0000 7f4e38220800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T17:46:53.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.880+0000 7f4e38220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:46:53.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.881+0000 7f4e38220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:46:53.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.881+0000 7f4e38220800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:46:53.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.882+0000 7f4e38220800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T17:46:53.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.884+0000 7f4e38220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:46:53.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.884+0000 7f4e38220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:46:53.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.884+0000 7f4e38220800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:46:53.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.886+0000 7f4e38220800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T17:46:53.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.887+0000 7f4e38220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:46:53.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.887+0000 7f4e38220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:46:53.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.888+0000 7f4e38220800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:46:53.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.889+0000 7f4e38220800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T17:46:53.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.890+0000 7f4e38220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:46:53.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.890+0000 7f4e38220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:46:53.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.891+0000 7f4e38220800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:46:53.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.892+0000 7f4e38220800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T17:46:53.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.893+0000 7f4e38220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:46:53.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.893+0000 7f4e38220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:46:53.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.893+0000 7f4e38220800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:46:53.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.895+0000 7f4e38220800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T17:46:53.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.896+0000 7f4e38220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:46:53.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.896+0000 7f4e38220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:46:53.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.897+0000 7f4e38220800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:46:53.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.898+0000 7f4e38220800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T17:46:53.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.899+0000 7f4e38220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:46:53.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.899+0000 7f4e38220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:46:53.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.900+0000 7f4e38220800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:46:53.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.901+0000 7f4e38220800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T17:46:53.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.902+0000 7f4e38220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:46:53.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.903+0000 7f4e38220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:46:53.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.903+0000 7f4e38220800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:46:53.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.904+0000 7f4e38220800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T17:46:53.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.906+0000 7f4e38220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:46:53.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.906+0000 7f4e38220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:46:53.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.907+0000 7f4e38220800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:46:53.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.908+0000 7f4e38220800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T17:46:53.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.909+0000 7f4e38220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:46:53.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.910+0000 7f4e38220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:46:53.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.910+0000 7f4e38220800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:46:53.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.912+0000 7f4e38220800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T17:46:53.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.913+0000 7f4e38220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:46:53.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.914+0000 7f4e38220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:46:53.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.914+0000 7f4e38220800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:46:53.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.915+0000 7f4e38220800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T17:46:53.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.916+0000 7f4e38220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:46:53.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.917+0000 7f4e38220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:46:53.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.917+0000 7f4e38220800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:46:53.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.918+0000 7f4e38220800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T17:46:53.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.919+0000 7f4e38220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:46:53.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.920+0000 7f4e38220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:46:53.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.920+0000 7f4e38220800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:46:53.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.921+0000 7f4e38220800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T17:46:53.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.923+0000 7f4e38220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:46:53.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.923+0000 7f4e38220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:46:53.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.924+0000 7f4e38220800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:46:53.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.925+0000 7f4e38220800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T17:46:53.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.926+0000 7f4e38220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:46:53.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.927+0000 7f4e38220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:46:53.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.927+0000 7f4e38220800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:46:53.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.928+0000 7f4e38220800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T17:46:53.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.930+0000 7f4e38220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:46:53.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.930+0000 7f4e38220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:46:53.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.931+0000 7f4e38220800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:46:53.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.932+0000 7f4e38220800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T17:46:53.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.933+0000 7f4e38220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:46:53.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.933+0000 7f4e38220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:46:53.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.934+0000 7f4e38220800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:46:53.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.935+0000 7f4e38220800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T17:46:53.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.936+0000 7f4e38220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:46:53.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.936+0000 7f4e38220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:46:53.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.937+0000 7f4e38220800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:46:53.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.938+0000 7f4e38220800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T17:46:53.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.939+0000 7f4e38220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:46:53.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.939+0000 7f4e38220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:46:53.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.940+0000 7f4e38220800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:46:53.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.941+0000 7f4e38220800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T17:46:53.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.942+0000 7f4e38220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:46:53.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.942+0000 7f4e38220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:46:53.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.943+0000 7f4e38220800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:46:53.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.944+0000 7f4e38220800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T17:46:53.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.945+0000 7f4e38220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:46:53.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.946+0000 7f4e38220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:46:53.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.946+0000 7f4e38220800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:46:53.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.947+0000 7f4e38220800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T17:46:53.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.949+0000 7f4e38220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:46:53.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.949+0000 7f4e38220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:46:53.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.949+0000 7f4e38220800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:46:53.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.951+0000 7f4e38220800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T17:46:53.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.952+0000 7f4e38220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:46:53.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.953+0000 7f4e38220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:46:53.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.953+0000 7f4e38220800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:46:53.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.955+0000 7f4ce77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:46:53.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.957+0000 7f4e38220800 20 remove_watcher() i=0 2024-09-12T17:46:53.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.957+0000 7f4e38220800 2 removed watcher, disabling cache 2024-09-12T17:46:53.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.958+0000 7f4e38220800 20 remove_watcher() i=1 2024-09-12T17:46:53.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.959+0000 7f4e38220800 20 remove_watcher() i=2 2024-09-12T17:46:53.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.960+0000 7f4e38220800 20 remove_watcher() i=3 2024-09-12T17:46:53.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.961+0000 7f4e38220800 20 remove_watcher() i=4 2024-09-12T17:46:53.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.962+0000 7f4e38220800 20 remove_watcher() i=5 2024-09-12T17:46:53.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.963+0000 7f4e38220800 20 remove_watcher() i=6 2024-09-12T17:46:53.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:53.964+0000 7f4e38220800 20 remove_watcher() i=7 2024-09-12T17:46:53.977 INFO:teuthology.run_tasks:Running task s3tests... 2024-09-12T17:46:54.117 DEBUG:tasks.s3tests:s3tests config is {'client.0': {'rgw_server': 'client.0', 'accounts': {'iam alt root': 'RGW99999999999999999', 'iam root': 'RGW88888888888888888'}, 'force-branch': 'ceph-master', 'slow_backend': True, 'storage classes': 'LUKEWARM, FROZEN'}} 2024-09-12T17:46:54.117 INFO:tasks.s3tests:Downloading s3-tests... 2024-09-12T17:46:54.117 INFO:tasks.s3tests:Using branch 'ceph-master' for s3tests 2024-09-12T17:46:54.117 DEBUG:teuthology.orchestra.run.smithi037:> git clone -b ceph-master https://git.ceph.com/s3-tests.git /home/ubuntu/cephtest/s3-tests-client.0 2024-09-12T17:46:54.149 INFO:teuthology.orchestra.run.smithi037.stderr:Cloning into '/home/ubuntu/cephtest/s3-tests-client.0'... 2024-09-12T17:46:55.146 INFO:tasks.s3tests:Creating rgw users... 2024-09-12T17:46:55.146 DEBUG:tasks.s3tests:Creating user foo.client.0 on client.0 2024-09-12T17:46:55.146 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid foo.client.0 --display-name Mr.foo.client.0 --email foo+test@test.test --access-key SWAQJJDYGGPRYTHMHIXE --secret UDEMjzKoxKYn/BEMsLDUYxQHNvIUcuKYG9addwH3nAXG3ny5tII/sA== --cluster ceph 2024-09-12T17:46:55.251 INFO:teuthology.orchestra.run.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:46:55.251 INFO:teuthology.orchestra.run.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:46:55.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.287+0000 7f647ab1f800 20 rados->read ofs=0 len=0 2024-09-12T17:46:55.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.288+0000 7f647ab1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:55.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.288+0000 7f647ab1f800 20 realm 2024-09-12T17:46:55.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.288+0000 7f647ab1f800 20 rados->read ofs=0 len=0 2024-09-12T17:46:55.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.288+0000 7f647ab1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:55.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.288+0000 7f647ab1f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:46:55.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.288+0000 7f647ab1f800 20 rados->read ofs=0 len=0 2024-09-12T17:46:55.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.288+0000 7f647ab1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:55.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.288+0000 7f647ab1f800 20 rados->read ofs=0 len=0 2024-09-12T17:46:55.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.289+0000 7f647ab1f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:46:55.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.289+0000 7f647ab1f800 20 rados->read ofs=0 len=0 2024-09-12T17:46:55.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.290+0000 7f647ab1f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:46:55.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.290+0000 7f647ab1f800 20 searching for the correct realm 2024-09-12T17:46:55.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.293+0000 7f64760a8640 0 -- 172.21.15.37:0/3306665457 >> [v2:172.21.15.40:6800/2441293461,v1:172.21.15.40:6801/2441293461] conn(0x7f6468048040 msgr2=0x7f646803a960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:46:55.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.297+0000 7f64768a9640 0 -- 172.21.15.37:0/3306665457 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7f646c00dab0 msgr2=0x7f646c07e9a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:46:55.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.504+0000 7f647ab1f800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:46:55.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.504+0000 7f647ab1f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:46:55.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.504+0000 7f647ab1f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:46:55.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.504+0000 7f647ab1f800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:46:55.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.504+0000 7f647ab1f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:46:55.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.504+0000 7f647ab1f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:46:55.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.504+0000 7f647ab1f800 20 rados->read ofs=0 len=0 2024-09-12T17:46:55.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.504+0000 7f647ab1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:55.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.504+0000 7f647ab1f800 20 rados->read ofs=0 len=0 2024-09-12T17:46:55.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.504+0000 7f647ab1f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:46:55.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.504+0000 7f647ab1f800 20 rados->read ofs=0 len=0 2024-09-12T17:46:55.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.505+0000 7f647ab1f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:46:55.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.505+0000 7f647ab1f800 20 zone default found 2024-09-12T17:46:55.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.505+0000 7f647ab1f800 4 Realm: () 2024-09-12T17:46:55.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.505+0000 7f647ab1f800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:46:55.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.505+0000 7f647ab1f800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:46:55.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.505+0000 7f647ab1f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:46:55.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.505+0000 7f647ab1f800 20 zonegroup default 2024-09-12T17:46:55.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.505+0000 7f647ab1f800 20 rados->read ofs=0 len=0 2024-09-12T17:46:55.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.505+0000 7f647ab1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:55.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.505+0000 7f647ab1f800 20 rados->read ofs=0 len=0 2024-09-12T17:46:55.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.505+0000 7f647ab1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:55.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.505+0000 7f647ab1f800 20 rados->read ofs=0 len=0 2024-09-12T17:46:55.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.506+0000 7f647ab1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:55.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.506+0000 7f647ab1f800 20 started sync module instance, tier type = 2024-09-12T17:46:55.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.506+0000 7f647ab1f800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:46:55.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.516+0000 7f647ab1f800 20 add_watcher() i=0 2024-09-12T17:46:55.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.516+0000 7f647ab1f800 20 add_watcher() i=1 2024-09-12T17:46:55.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.516+0000 7f647ab1f800 20 add_watcher() i=2 2024-09-12T17:46:55.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.516+0000 7f647ab1f800 20 add_watcher() i=3 2024-09-12T17:46:55.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.516+0000 7f647ab1f800 20 add_watcher() i=4 2024-09-12T17:46:55.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.516+0000 7f647ab1f800 20 add_watcher() i=5 2024-09-12T17:46:55.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.516+0000 7f647ab1f800 20 add_watcher() i=6 2024-09-12T17:46:55.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.517+0000 7f647ab1f800 20 add_watcher() i=7 2024-09-12T17:46:55.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.517+0000 7f647ab1f800 2 all 8 watchers are set, enabling cache 2024-09-12T17:46:55.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.518+0000 7f632d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:46:55.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.519+0000 7f647ab1f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:46:55.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.519+0000 7f647ab1f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:46:55.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.519+0000 7f647ab1f800 5 note: GC not initialized 2024-09-12T17:46:55.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.519+0000 7f62a7fff640 20 reqs_thread_entry: start 2024-09-12T17:46:55.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.519+0000 7f647ab1f800 20 init_complete bucket index max shards: 11 2024-09-12T17:46:55.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.519+0000 7f647ab1f800 20 Filter name: none 2024-09-12T17:46:55.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.519+0000 7f62a5ffb640 20 reqs_thread_entry: start 2024-09-12T17:46:55.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.519+0000 7f647ab1f800 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : miss 2024-09-12T17:46:55.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.519+0000 7f647ab1f800 20 rados->read ofs=0 len=0 2024-09-12T17:46:55.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.519+0000 7f647ab1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:55.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.520+0000 7f647ab1f800 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x0 2024-09-12T17:46:55.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.520+0000 7f647ab1f800 10 adding default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-12T17:46:55.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.520+0000 7f647ab1f800 10 cache get: name=default.rgw.meta+users.email+foo+test@test.test : miss 2024-09-12T17:46:55.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.520+0000 7f647ab1f800 20 rados->read ofs=0 len=0 2024-09-12T17:46:55.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.520+0000 7f647ab1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:55.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.520+0000 7f647ab1f800 10 cache put: name=default.rgw.meta+users.email+foo+test@test.test info.flags=0x0 2024-09-12T17:46:55.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.520+0000 7f647ab1f800 10 adding default.rgw.meta+users.email+foo+test@test.test to cache LRU end 2024-09-12T17:46:55.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.520+0000 7f647ab1f800 10 cache get: name=default.rgw.meta+users.keys+SWAQJJDYGGPRYTHMHIXE : miss 2024-09-12T17:46:55.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.520+0000 7f647ab1f800 20 rados->read ofs=0 len=0 2024-09-12T17:46:55.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.520+0000 7f647ab1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:55.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.520+0000 7f647ab1f800 10 cache put: name=default.rgw.meta+users.keys+SWAQJJDYGGPRYTHMHIXE info.flags=0x0 2024-09-12T17:46:55.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.520+0000 7f647ab1f800 10 adding default.rgw.meta+users.keys+SWAQJJDYGGPRYTHMHIXE to cache LRU end 2024-09-12T17:46:55.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.520+0000 7f647ab1f800 10 cache get: name=default.rgw.meta+users.keys+SWAQJJDYGGPRYTHMHIXE : hit (negative entry) 2024-09-12T17:46:55.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.520+0000 7f647ab1f800 10 cache get: name=default.rgw.meta+users.keys+SWAQJJDYGGPRYTHMHIXE : hit (negative entry) 2024-09-12T17:46:55.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.521+0000 7f647ab1f800 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-12T17:46:55.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.521+0000 7f647ab1f800 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-12T17:46:55.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.521+0000 7f647ab1f800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.uid:foo.client.0, ofs0, ns] 2024-09-12T17:46:55.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.522+0000 7f635a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497208 cookie 94006834221984 notifier 9066 bl.length()=645 2024-09-12T17:46:55.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.522+0000 7f635a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-12T17:46:55.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.522+0000 7f635a7fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-12T17:46:55.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.525+0000 7f647ab1f800 10 cache put: name=default.rgw.meta+users.email+foo+test@test.test info.flags=0x7 2024-09-12T17:46:55.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.525+0000 7f647ab1f800 10 moving default.rgw.meta+users.email+foo+test@test.test to cache LRU end 2024-09-12T17:46:55.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.525+0000 7f647ab1f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.email:foo+test@test.test, ofs0, ns] 2024-09-12T17:46:55.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.525+0000 7f635a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497209 cookie 94006834235920 notifier 9066 bl.length()=185 2024-09-12T17:46:55.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.525+0000 7f635a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foo+test@test.test info.flags=0x7 2024-09-12T17:46:55.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.525+0000 7f635a7fc640 10 rgw watcher librados: moving default.rgw.meta+users.email+foo+test@test.test to cache LRU end 2024-09-12T17:46:55.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.528+0000 7f647ab1f800 10 cache put: name=default.rgw.meta+users.keys+SWAQJJDYGGPRYTHMHIXE info.flags=0x7 2024-09-12T17:46:55.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.528+0000 7f647ab1f800 10 moving default.rgw.meta+users.keys+SWAQJJDYGGPRYTHMHIXE to cache LRU end 2024-09-12T17:46:55.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.528+0000 7f647ab1f800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.keys:SWAQJJDYGGPRYTHMHIXE, ofs0, ns] 2024-09-12T17:46:55.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.528+0000 7f635a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497210 cookie 94006834221984 notifier 9066 bl.length()=186 2024-09-12T17:46:55.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.528+0000 7f635a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+SWAQJJDYGGPRYTHMHIXE info.flags=0x7 2024-09-12T17:46:55.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.528+0000 7f635a7fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+SWAQJJDYGGPRYTHMHIXE to cache LRU end 2024-09-12T17:46:55.530 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-09-12T17:46:55.530 INFO:teuthology.orchestra.run.smithi037.stdout: "user_id": "foo.client.0", 2024-09-12T17:46:55.530 INFO:teuthology.orchestra.run.smithi037.stdout: "display_name": "Mr.foo.client.0", 2024-09-12T17:46:55.530 INFO:teuthology.orchestra.run.smithi037.stdout: "email": "foo+test@test.test", 2024-09-12T17:46:55.530 INFO:teuthology.orchestra.run.smithi037.stdout: "suspended": 0, 2024-09-12T17:46:55.531 INFO:teuthology.orchestra.run.smithi037.stdout: "max_buckets": 1000, 2024-09-12T17:46:55.531 INFO:teuthology.orchestra.run.smithi037.stdout: "subusers": [], 2024-09-12T17:46:55.531 INFO:teuthology.orchestra.run.smithi037.stdout: "keys": [ 2024-09-12T17:46:55.531 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-12T17:46:55.531 INFO:teuthology.orchestra.run.smithi037.stdout: "user": "foo.client.0", 2024-09-12T17:46:55.531 INFO:teuthology.orchestra.run.smithi037.stdout: "access_key": "SWAQJJDYGGPRYTHMHIXE", 2024-09-12T17:46:55.531 INFO:teuthology.orchestra.run.smithi037.stdout: "secret_key": "UDEMjzKoxKYn/BEMsLDUYxQHNvIUcuKYG9addwH3nAXG3ny5tII/sA==", 2024-09-12T17:46:55.531 INFO:teuthology.orchestra.run.smithi037.stdout: "active": true, 2024-09-12T17:46:55.531 INFO:teuthology.orchestra.run.smithi037.stdout: "create_date": "2024-09-12T17:46:55.521352Z" 2024-09-12T17:46:55.531 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-12T17:46:55.531 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-12T17:46:55.531 INFO:teuthology.orchestra.run.smithi037.stdout: "swift_keys": [], 2024-09-12T17:46:55.531 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": [], 2024-09-12T17:46:55.532 INFO:teuthology.orchestra.run.smithi037.stdout: "op_mask": "read, write, delete", 2024-09-12T17:46:55.532 INFO:teuthology.orchestra.run.smithi037.stdout: "default_placement": "", 2024-09-12T17:46:55.532 INFO:teuthology.orchestra.run.smithi037.stdout: "default_storage_class": "", 2024-09-12T17:46:55.532 INFO:teuthology.orchestra.run.smithi037.stdout: "placement_tags": [], 2024-09-12T17:46:55.532 INFO:teuthology.orchestra.run.smithi037.stdout: "bucket_quota": { 2024-09-12T17:46:55.532 INFO:teuthology.orchestra.run.smithi037.stdout: "enabled": false, 2024-09-12T17:46:55.532 INFO:teuthology.orchestra.run.smithi037.stdout: "check_on_raw": false, 2024-09-12T17:46:55.532 INFO:teuthology.orchestra.run.smithi037.stdout: "max_size": -1, 2024-09-12T17:46:55.532 INFO:teuthology.orchestra.run.smithi037.stdout: "max_size_kb": 0, 2024-09-12T17:46:55.532 INFO:teuthology.orchestra.run.smithi037.stdout: "max_objects": -1 2024-09-12T17:46:55.532 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-12T17:46:55.532 INFO:teuthology.orchestra.run.smithi037.stdout: "user_quota": { 2024-09-12T17:46:55.532 INFO:teuthology.orchestra.run.smithi037.stdout: "enabled": false, 2024-09-12T17:46:55.533 INFO:teuthology.orchestra.run.smithi037.stdout: "check_on_raw": false, 2024-09-12T17:46:55.533 INFO:teuthology.orchestra.run.smithi037.stdout: "max_size": -1, 2024-09-12T17:46:55.533 INFO:teuthology.orchestra.run.smithi037.stdout: "max_size_kb": 0, 2024-09-12T17:46:55.533 INFO:teuthology.orchestra.run.smithi037.stdout: "max_objects": -1 2024-09-12T17:46:55.533 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-12T17:46:55.533 INFO:teuthology.orchestra.run.smithi037.stdout: "temp_url_keys": [], 2024-09-12T17:46:55.533 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "rgw", 2024-09-12T17:46:55.533 INFO:teuthology.orchestra.run.smithi037.stdout: "mfa_ids": [], 2024-09-12T17:46:55.533 INFO:teuthology.orchestra.run.smithi037.stdout: "account_id": "", 2024-09-12T17:46:55.533 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-09-12T17:46:55.533 INFO:teuthology.orchestra.run.smithi037.stdout: "create_date": "2024-09-12T17:46:55.521343Z", 2024-09-12T17:46:55.533 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-12T17:46:55.533 INFO:teuthology.orchestra.run.smithi037.stdout: "group_ids": [] 2024-09-12T17:46:55.533 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-09-12T17:46:55.534 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:46:55.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.530+0000 7f632d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:46:55.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.533+0000 7f647ab1f800 20 remove_watcher() i=0 2024-09-12T17:46:55.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.533+0000 7f647ab1f800 2 removed watcher, disabling cache 2024-09-12T17:46:55.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.534+0000 7f647ab1f800 20 remove_watcher() i=1 2024-09-12T17:46:55.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.535+0000 7f647ab1f800 20 remove_watcher() i=2 2024-09-12T17:46:55.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.536+0000 7f647ab1f800 20 remove_watcher() i=3 2024-09-12T17:46:55.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.537+0000 7f647ab1f800 20 remove_watcher() i=4 2024-09-12T17:46:55.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.538+0000 7f647ab1f800 20 remove_watcher() i=5 2024-09-12T17:46:55.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.539+0000 7f647ab1f800 20 remove_watcher() i=6 2024-09-12T17:46:55.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.541+0000 7f647ab1f800 20 remove_watcher() i=7 2024-09-12T17:46:55.553 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid foo.client.0 --totp-serial 5354204090 --totp-seed RZSQVUG3REN4N2VJD2IESDOF3YD7QFLTKUK53N4Z2WSZXJ25MGPWZWKZELOLIQQ5 --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-12T17:46:55.622 INFO:teuthology.orchestra.run.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:46:55.622 INFO:teuthology.orchestra.run.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:46:55.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.657+0000 7f6c56121800 20 rados->read ofs=0 len=0 2024-09-12T17:46:55.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.658+0000 7f6c56121800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:55.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.658+0000 7f6c56121800 20 realm 2024-09-12T17:46:55.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.658+0000 7f6c56121800 20 rados->read ofs=0 len=0 2024-09-12T17:46:55.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.659+0000 7f6c56121800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:55.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.659+0000 7f6c56121800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:46:55.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.659+0000 7f6c56121800 20 rados->read ofs=0 len=0 2024-09-12T17:46:55.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.659+0000 7f6c56121800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:55.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.659+0000 7f6c56121800 20 rados->read ofs=0 len=0 2024-09-12T17:46:55.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.660+0000 7f6c56121800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:46:55.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.660+0000 7f6c56121800 20 rados->read ofs=0 len=0 2024-09-12T17:46:55.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.660+0000 7f6c56121800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:46:55.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.660+0000 7f6c56121800 20 searching for the correct realm 2024-09-12T17:46:55.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.663+0000 7f6c52557640 0 -- 172.21.15.37:0/746958049 >> [v2:172.21.15.40:6818/1210108009,v1:172.21.15.40:6819/1210108009] conn(0x7f6c4801e060 msgr2=0x7f6c4804b1c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:46:55.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.668+0000 7f6c51d56640 0 -- 172.21.15.37:0/746958049 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7f6c48072670 msgr2=0x7f6c480989c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:46:55.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.875+0000 7f6c56121800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:46:55.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.875+0000 7f6c56121800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:46:55.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.875+0000 7f6c56121800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:46:55.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.875+0000 7f6c56121800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:46:55.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.875+0000 7f6c56121800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:46:55.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.875+0000 7f6c56121800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:46:55.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.875+0000 7f6c56121800 20 rados->read ofs=0 len=0 2024-09-12T17:46:55.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.876+0000 7f6c56121800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:55.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.876+0000 7f6c56121800 20 rados->read ofs=0 len=0 2024-09-12T17:46:55.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.876+0000 7f6c56121800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:46:55.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.876+0000 7f6c56121800 20 rados->read ofs=0 len=0 2024-09-12T17:46:55.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.877+0000 7f6c56121800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:46:55.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.877+0000 7f6c56121800 20 zone default found 2024-09-12T17:46:55.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.877+0000 7f6c56121800 4 Realm: () 2024-09-12T17:46:55.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.877+0000 7f6c56121800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:46:55.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.877+0000 7f6c56121800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:46:55.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.877+0000 7f6c56121800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:46:55.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.877+0000 7f6c56121800 20 zonegroup default 2024-09-12T17:46:55.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.877+0000 7f6c56121800 20 rados->read ofs=0 len=0 2024-09-12T17:46:55.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.877+0000 7f6c56121800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:55.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.877+0000 7f6c56121800 20 rados->read ofs=0 len=0 2024-09-12T17:46:55.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.877+0000 7f6c56121800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:55.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.877+0000 7f6c56121800 20 rados->read ofs=0 len=0 2024-09-12T17:46:55.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.878+0000 7f6c56121800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:55.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.878+0000 7f6c56121800 20 started sync module instance, tier type = 2024-09-12T17:46:55.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.878+0000 7f6c56121800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:46:55.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.888+0000 7f6c56121800 20 add_watcher() i=0 2024-09-12T17:46:55.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.888+0000 7f6c56121800 20 add_watcher() i=1 2024-09-12T17:46:55.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.888+0000 7f6c56121800 20 add_watcher() i=2 2024-09-12T17:46:55.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.888+0000 7f6c56121800 20 add_watcher() i=3 2024-09-12T17:46:55.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.888+0000 7f6c56121800 20 add_watcher() i=4 2024-09-12T17:46:55.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.888+0000 7f6c56121800 20 add_watcher() i=5 2024-09-12T17:46:55.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.888+0000 7f6c56121800 20 add_watcher() i=6 2024-09-12T17:46:55.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.889+0000 7f6c56121800 20 add_watcher() i=7 2024-09-12T17:46:55.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.889+0000 7f6c56121800 2 all 8 watchers are set, enabling cache 2024-09-12T17:46:55.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.891+0000 7f6b07fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:46:55.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.891+0000 7f6c56121800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:46:55.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.891+0000 7f6c56121800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:46:55.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.891+0000 7f6c56121800 5 note: GC not initialized 2024-09-12T17:46:55.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.891+0000 7f6b06fe5640 20 reqs_thread_entry: start 2024-09-12T17:46:55.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.891+0000 7f6c56121800 20 init_complete bucket index max shards: 11 2024-09-12T17:46:55.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.891+0000 7f6c56121800 20 Filter name: none 2024-09-12T17:46:55.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.891+0000 7f6b04fe1640 20 reqs_thread_entry: start 2024-09-12T17:46:55.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.891+0000 7f6c56121800 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : miss 2024-09-12T17:46:55.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.891+0000 7f6c56121800 20 rados->read ofs=0 len=0 2024-09-12T17:46:55.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.892+0000 7f6c56121800 20 rados_obj.operate() r=0 bl.length=460 2024-09-12T17:46:55.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.892+0000 7f6c56121800 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x13 2024-09-12T17:46:55.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.892+0000 7f6c56121800 10 adding default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-12T17:46:55.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:55.892+0000 7f6c56121800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:46:57.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.096+0000 7f6c56121800 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-12T17:46:57.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.096+0000 7f6c56121800 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-12T17:46:57.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.096+0000 7f6c56121800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.uid:foo.client.0, ofs0, ns] 2024-09-12T17:46:57.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.097+0000 7f6b34ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431803 cookie 94786891261888 notifier 9084 bl.length()=659 2024-09-12T17:46:57.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.097+0000 7f6b34ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-12T17:46:57.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.097+0000 7f6b34ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-12T17:46:57.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.100+0000 7f6b07fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:46:57.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.103+0000 7f6c56121800 20 remove_watcher() i=0 2024-09-12T17:46:57.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.103+0000 7f6c56121800 2 removed watcher, disabling cache 2024-09-12T17:46:57.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.104+0000 7f6c56121800 20 remove_watcher() i=1 2024-09-12T17:46:57.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.105+0000 7f6c56121800 20 remove_watcher() i=2 2024-09-12T17:46:57.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.107+0000 7f6c56121800 20 remove_watcher() i=3 2024-09-12T17:46:57.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.108+0000 7f6c56121800 20 remove_watcher() i=4 2024-09-12T17:46:57.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.109+0000 7f6c56121800 20 remove_watcher() i=5 2024-09-12T17:46:57.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.110+0000 7f6c56121800 20 remove_watcher() i=6 2024-09-12T17:46:57.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.112+0000 7f6c56121800 20 remove_watcher() i=7 2024-09-12T17:46:57.126 DEBUG:tasks.s3tests:Creating user bar.client.0 on client.0 2024-09-12T17:46:57.126 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid bar.client.0 --display-name Mr.bar.client.0 --email bar+test@test.test --access-key QMBUDILFFQACWXUYMQWP --secret NMRyoFZOwQi+ggOfqthk6rjZlAEpbHM0BcH35O+FAtCMs55RNVc45Q== --cluster ceph 2024-09-12T17:46:57.195 INFO:teuthology.orchestra.run.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:46:57.196 INFO:teuthology.orchestra.run.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:46:57.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.231+0000 7f2261f35800 20 rados->read ofs=0 len=0 2024-09-12T17:46:57.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.232+0000 7f2261f35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:57.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.232+0000 7f2261f35800 20 realm 2024-09-12T17:46:57.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.232+0000 7f2261f35800 20 rados->read ofs=0 len=0 2024-09-12T17:46:57.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.233+0000 7f2261f35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:57.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.233+0000 7f2261f35800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:46:57.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.233+0000 7f2261f35800 20 rados->read ofs=0 len=0 2024-09-12T17:46:57.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.233+0000 7f2261f35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:57.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.233+0000 7f2261f35800 20 rados->read ofs=0 len=0 2024-09-12T17:46:57.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.234+0000 7f2261f35800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:46:57.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.234+0000 7f2261f35800 20 rados->read ofs=0 len=0 2024-09-12T17:46:57.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.234+0000 7f2261f35800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:46:57.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.234+0000 7f2261f35800 20 searching for the correct realm 2024-09-12T17:46:57.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.238+0000 7f225e422640 0 -- 172.21.15.37:0/2167377700 >> [v2:172.21.15.40:6818/1210108009,v1:172.21.15.40:6819/1210108009] conn(0x7f2254036070 msgr2=0x7f2254019950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:46:57.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.242+0000 7f225dc21640 0 -- 172.21.15.37:0/2167377700 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7f2254060410 msgr2=0x7f2254060890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:46:57.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.449+0000 7f2261f35800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:46:57.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.449+0000 7f2261f35800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:46:57.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.449+0000 7f2261f35800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:46:57.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.449+0000 7f2261f35800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:46:57.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.449+0000 7f2261f35800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:46:57.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.449+0000 7f2261f35800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:46:57.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.449+0000 7f2261f35800 20 rados->read ofs=0 len=0 2024-09-12T17:46:57.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.449+0000 7f2261f35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:57.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.449+0000 7f2261f35800 20 rados->read ofs=0 len=0 2024-09-12T17:46:57.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.450+0000 7f2261f35800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:46:57.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.450+0000 7f2261f35800 20 rados->read ofs=0 len=0 2024-09-12T17:46:57.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.450+0000 7f2261f35800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:46:57.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.450+0000 7f2261f35800 20 zone default found 2024-09-12T17:46:57.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.450+0000 7f2261f35800 4 Realm: () 2024-09-12T17:46:57.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.450+0000 7f2261f35800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:46:57.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.450+0000 7f2261f35800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:46:57.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.450+0000 7f2261f35800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:46:57.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.450+0000 7f2261f35800 20 zonegroup default 2024-09-12T17:46:57.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.450+0000 7f2261f35800 20 rados->read ofs=0 len=0 2024-09-12T17:46:57.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.450+0000 7f2261f35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:57.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.450+0000 7f2261f35800 20 rados->read ofs=0 len=0 2024-09-12T17:46:57.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.451+0000 7f2261f35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:57.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.451+0000 7f2261f35800 20 rados->read ofs=0 len=0 2024-09-12T17:46:57.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.451+0000 7f2261f35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:57.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.451+0000 7f2261f35800 20 started sync module instance, tier type = 2024-09-12T17:46:57.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.451+0000 7f2261f35800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:46:57.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.462+0000 7f2261f35800 20 add_watcher() i=0 2024-09-12T17:46:57.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.462+0000 7f2261f35800 20 add_watcher() i=1 2024-09-12T17:46:57.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.462+0000 7f2261f35800 20 add_watcher() i=2 2024-09-12T17:46:57.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.462+0000 7f2261f35800 20 add_watcher() i=3 2024-09-12T17:46:57.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.462+0000 7f2261f35800 20 add_watcher() i=4 2024-09-12T17:46:57.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.462+0000 7f2261f35800 20 add_watcher() i=5 2024-09-12T17:46:57.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.462+0000 7f2261f35800 20 add_watcher() i=6 2024-09-12T17:46:57.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.463+0000 7f2261f35800 20 add_watcher() i=7 2024-09-12T17:46:57.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.463+0000 7f2261f35800 2 all 8 watchers are set, enabling cache 2024-09-12T17:46:57.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.465+0000 7f210f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:46:57.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.465+0000 7f2261f35800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:46:57.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.465+0000 7f2261f35800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:46:57.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.465+0000 7f2261f35800 5 note: GC not initialized 2024-09-12T17:46:57.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.465+0000 7f210e7fc640 20 reqs_thread_entry: start 2024-09-12T17:46:57.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.465+0000 7f2261f35800 20 init_complete bucket index max shards: 11 2024-09-12T17:46:57.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.465+0000 7f2261f35800 20 Filter name: none 2024-09-12T17:46:57.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.465+0000 7f207ffff640 20 reqs_thread_entry: start 2024-09-12T17:46:57.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.465+0000 7f2261f35800 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : miss 2024-09-12T17:46:57.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.465+0000 7f2261f35800 20 rados->read ofs=0 len=0 2024-09-12T17:46:57.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.466+0000 7f2261f35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:57.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.466+0000 7f2261f35800 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x0 2024-09-12T17:46:57.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.466+0000 7f2261f35800 10 adding default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-12T17:46:57.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.466+0000 7f2261f35800 10 cache get: name=default.rgw.meta+users.email+bar+test@test.test : miss 2024-09-12T17:46:57.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.466+0000 7f2261f35800 20 rados->read ofs=0 len=0 2024-09-12T17:46:57.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.466+0000 7f2261f35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:57.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.466+0000 7f2261f35800 10 cache put: name=default.rgw.meta+users.email+bar+test@test.test info.flags=0x0 2024-09-12T17:46:57.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.466+0000 7f2261f35800 10 adding default.rgw.meta+users.email+bar+test@test.test to cache LRU end 2024-09-12T17:46:57.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.466+0000 7f2261f35800 10 cache get: name=default.rgw.meta+users.keys+QMBUDILFFQACWXUYMQWP : miss 2024-09-12T17:46:57.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.466+0000 7f2261f35800 20 rados->read ofs=0 len=0 2024-09-12T17:46:57.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.466+0000 7f2261f35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:57.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.466+0000 7f2261f35800 10 cache put: name=default.rgw.meta+users.keys+QMBUDILFFQACWXUYMQWP info.flags=0x0 2024-09-12T17:46:57.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.466+0000 7f2261f35800 10 adding default.rgw.meta+users.keys+QMBUDILFFQACWXUYMQWP to cache LRU end 2024-09-12T17:46:57.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.466+0000 7f2261f35800 10 cache get: name=default.rgw.meta+users.keys+QMBUDILFFQACWXUYMQWP : hit (negative entry) 2024-09-12T17:46:57.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.466+0000 7f2261f35800 10 cache get: name=default.rgw.meta+users.keys+QMBUDILFFQACWXUYMQWP : hit (negative entry) 2024-09-12T17:46:57.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.468+0000 7f2261f35800 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-12T17:46:57.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.468+0000 7f2261f35800 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-12T17:46:57.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.468+0000 7f2261f35800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:bar.client.0, ofs0, ns] 2024-09-12T17:46:57.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.468+0000 7f21417fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431696 cookie 94723651039168 notifier 8459 bl.length()=645 2024-09-12T17:46:57.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.468+0000 7f21417fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-12T17:46:57.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.468+0000 7f21417fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-12T17:46:57.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.471+0000 7f2261f35800 10 cache put: name=default.rgw.meta+users.email+bar+test@test.test info.flags=0x7 2024-09-12T17:46:57.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.471+0000 7f2261f35800 10 moving default.rgw.meta+users.email+bar+test@test.test to cache LRU end 2024-09-12T17:46:57.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.471+0000 7f2261f35800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.email:bar+test@test.test, ofs0, ns] 2024-09-12T17:46:57.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.472+0000 7f21417fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431722 cookie 94723651054944 notifier 8459 bl.length()=185 2024-09-12T17:46:57.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.472+0000 7f21417fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+bar+test@test.test info.flags=0x7 2024-09-12T17:46:57.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.472+0000 7f21417fa640 10 rgw watcher librados: moving default.rgw.meta+users.email+bar+test@test.test to cache LRU end 2024-09-12T17:46:57.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.475+0000 7f2261f35800 10 cache put: name=default.rgw.meta+users.keys+QMBUDILFFQACWXUYMQWP info.flags=0x7 2024-09-12T17:46:57.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.475+0000 7f2261f35800 10 moving default.rgw.meta+users.keys+QMBUDILFFQACWXUYMQWP to cache LRU end 2024-09-12T17:46:57.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.475+0000 7f2261f35800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.keys:QMBUDILFFQACWXUYMQWP, ofs0, ns] 2024-09-12T17:46:57.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.475+0000 7f2140ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431630 cookie 94723651052240 notifier 8459 bl.length()=186 2024-09-12T17:46:57.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.475+0000 7f2140ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+QMBUDILFFQACWXUYMQWP info.flags=0x7 2024-09-12T17:46:57.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.475+0000 7f2140ff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+QMBUDILFFQACWXUYMQWP to cache LRU end 2024-09-12T17:46:57.477 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-09-12T17:46:57.477 INFO:teuthology.orchestra.run.smithi037.stdout: "user_id": "bar.client.0", 2024-09-12T17:46:57.477 INFO:teuthology.orchestra.run.smithi037.stdout: "display_name": "Mr.bar.client.0", 2024-09-12T17:46:57.477 INFO:teuthology.orchestra.run.smithi037.stdout: "email": "bar+test@test.test", 2024-09-12T17:46:57.477 INFO:teuthology.orchestra.run.smithi037.stdout: "suspended": 0, 2024-09-12T17:46:57.477 INFO:teuthology.orchestra.run.smithi037.stdout: "max_buckets": 1000, 2024-09-12T17:46:57.477 INFO:teuthology.orchestra.run.smithi037.stdout: "subusers": [], 2024-09-12T17:46:57.478 INFO:teuthology.orchestra.run.smithi037.stdout: "keys": [ 2024-09-12T17:46:57.478 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-12T17:46:57.478 INFO:teuthology.orchestra.run.smithi037.stdout: "user": "bar.client.0", 2024-09-12T17:46:57.478 INFO:teuthology.orchestra.run.smithi037.stdout: "access_key": "QMBUDILFFQACWXUYMQWP", 2024-09-12T17:46:57.478 INFO:teuthology.orchestra.run.smithi037.stdout: "secret_key": "NMRyoFZOwQi+ggOfqthk6rjZlAEpbHM0BcH35O+FAtCMs55RNVc45Q==", 2024-09-12T17:46:57.478 INFO:teuthology.orchestra.run.smithi037.stdout: "active": true, 2024-09-12T17:46:57.478 INFO:teuthology.orchestra.run.smithi037.stdout: "create_date": "2024-09-12T17:46:57.467625Z" 2024-09-12T17:46:57.478 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-12T17:46:57.478 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-12T17:46:57.478 INFO:teuthology.orchestra.run.smithi037.stdout: "swift_keys": [], 2024-09-12T17:46:57.478 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": [], 2024-09-12T17:46:57.478 INFO:teuthology.orchestra.run.smithi037.stdout: "op_mask": "read, write, delete", 2024-09-12T17:46:57.478 INFO:teuthology.orchestra.run.smithi037.stdout: "default_placement": "", 2024-09-12T17:46:57.478 INFO:teuthology.orchestra.run.smithi037.stdout: "default_storage_class": "", 2024-09-12T17:46:57.479 INFO:teuthology.orchestra.run.smithi037.stdout: "placement_tags": [], 2024-09-12T17:46:57.479 INFO:teuthology.orchestra.run.smithi037.stdout: "bucket_quota": { 2024-09-12T17:46:57.479 INFO:teuthology.orchestra.run.smithi037.stdout: "enabled": false, 2024-09-12T17:46:57.479 INFO:teuthology.orchestra.run.smithi037.stdout: "check_on_raw": false, 2024-09-12T17:46:57.479 INFO:teuthology.orchestra.run.smithi037.stdout: "max_size": -1, 2024-09-12T17:46:57.479 INFO:teuthology.orchestra.run.smithi037.stdout: "max_size_kb": 0, 2024-09-12T17:46:57.479 INFO:teuthology.orchestra.run.smithi037.stdout: "max_objects": -1 2024-09-12T17:46:57.479 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-12T17:46:57.479 INFO:teuthology.orchestra.run.smithi037.stdout: "user_quota": { 2024-09-12T17:46:57.479 INFO:teuthology.orchestra.run.smithi037.stdout: "enabled": false, 2024-09-12T17:46:57.480 INFO:teuthology.orchestra.run.smithi037.stdout: "check_on_raw": false, 2024-09-12T17:46:57.480 INFO:teuthology.orchestra.run.smithi037.stdout: "max_size": -1, 2024-09-12T17:46:57.480 INFO:teuthology.orchestra.run.smithi037.stdout: "max_size_kb": 0, 2024-09-12T17:46:57.480 INFO:teuthology.orchestra.run.smithi037.stdout: "max_objects": -1 2024-09-12T17:46:57.480 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-12T17:46:57.480 INFO:teuthology.orchestra.run.smithi037.stdout: "temp_url_keys": [], 2024-09-12T17:46:57.480 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "rgw", 2024-09-12T17:46:57.480 INFO:teuthology.orchestra.run.smithi037.stdout: "mfa_ids": [], 2024-09-12T17:46:57.480 INFO:teuthology.orchestra.run.smithi037.stdout: "account_id": "", 2024-09-12T17:46:57.480 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-09-12T17:46:57.481 INFO:teuthology.orchestra.run.smithi037.stdout: "create_date": "2024-09-12T17:46:57.467615Z", 2024-09-12T17:46:57.481 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-12T17:46:57.481 INFO:teuthology.orchestra.run.smithi037.stdout: "group_ids": [] 2024-09-12T17:46:57.481 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-09-12T17:46:57.481 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:46:57.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.477+0000 7f210f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:46:57.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.480+0000 7f2261f35800 20 remove_watcher() i=0 2024-09-12T17:46:57.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.480+0000 7f2261f35800 2 removed watcher, disabling cache 2024-09-12T17:46:57.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.481+0000 7f2261f35800 20 remove_watcher() i=1 2024-09-12T17:46:57.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.482+0000 7f2261f35800 20 remove_watcher() i=2 2024-09-12T17:46:57.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.483+0000 7f2261f35800 20 remove_watcher() i=3 2024-09-12T17:46:57.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.485+0000 7f2261f35800 20 remove_watcher() i=4 2024-09-12T17:46:57.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.486+0000 7f2261f35800 20 remove_watcher() i=5 2024-09-12T17:46:57.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.487+0000 7f2261f35800 20 remove_watcher() i=6 2024-09-12T17:46:57.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.488+0000 7f2261f35800 20 remove_watcher() i=7 2024-09-12T17:46:57.501 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid bar.client.0 --totp-serial 9710210178 --totp-seed SKCIPWAUN2OMVTQHYCAAVRAUILVLW6SQGHCJS66WFYK62Q4472BL6OCGFUPVA6R3 --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-12T17:46:57.569 INFO:teuthology.orchestra.run.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:46:57.569 INFO:teuthology.orchestra.run.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:46:57.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.604+0000 7f6a8d128800 20 rados->read ofs=0 len=0 2024-09-12T17:46:57.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.605+0000 7f6a8d128800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:57.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.605+0000 7f6a8d128800 20 realm 2024-09-12T17:46:57.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.605+0000 7f6a8d128800 20 rados->read ofs=0 len=0 2024-09-12T17:46:57.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.606+0000 7f6a8d128800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:57.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.606+0000 7f6a8d128800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:46:57.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.606+0000 7f6a8d128800 20 rados->read ofs=0 len=0 2024-09-12T17:46:57.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.606+0000 7f6a8d128800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:57.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.606+0000 7f6a8d128800 20 rados->read ofs=0 len=0 2024-09-12T17:46:57.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.607+0000 7f6a8d128800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:46:57.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.607+0000 7f6a8d128800 20 rados->read ofs=0 len=0 2024-09-12T17:46:57.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.607+0000 7f6a8d128800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:46:57.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.607+0000 7f6a8d128800 20 searching for the correct realm 2024-09-12T17:46:57.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.611+0000 7f6a8864a640 0 -- 172.21.15.37:0/985028167 >> [v2:172.21.15.37:6824/3990661154,v1:172.21.15.37:6825/3990661154] conn(0x562b59d5d380 msgr2=0x562b59d5f840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:46:57.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.614+0000 7f6a88e4b640 0 -- 172.21.15.37:0/985028167 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7f6a7c058960 msgr2=0x7f6a7c0573e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:46:57.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.619+0000 7f6a8d128800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:46:57.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.619+0000 7f6a8d128800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:46:57.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.619+0000 7f6a8d128800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:46:57.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.619+0000 7f6a8d128800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:46:57.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.619+0000 7f6a8d128800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:46:57.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.619+0000 7f6a8d128800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:46:57.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.619+0000 7f6a8d128800 20 rados->read ofs=0 len=0 2024-09-12T17:46:57.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.619+0000 7f6a8d128800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:57.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.619+0000 7f6a8d128800 20 rados->read ofs=0 len=0 2024-09-12T17:46:57.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.619+0000 7f6a8d128800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:46:57.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.619+0000 7f6a8d128800 20 rados->read ofs=0 len=0 2024-09-12T17:46:57.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.620+0000 7f6a8d128800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:46:57.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.620+0000 7f6a8d128800 20 zone default found 2024-09-12T17:46:57.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.620+0000 7f6a8d128800 4 Realm: () 2024-09-12T17:46:57.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.620+0000 7f6a8d128800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:46:57.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.620+0000 7f6a8d128800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:46:57.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.620+0000 7f6a8d128800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:46:57.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.620+0000 7f6a8d128800 20 zonegroup default 2024-09-12T17:46:57.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.620+0000 7f6a8d128800 20 rados->read ofs=0 len=0 2024-09-12T17:46:57.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.620+0000 7f6a8d128800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:57.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.620+0000 7f6a8d128800 20 rados->read ofs=0 len=0 2024-09-12T17:46:57.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.621+0000 7f6a8d128800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:57.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.621+0000 7f6a8d128800 20 rados->read ofs=0 len=0 2024-09-12T17:46:57.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.621+0000 7f6a8d128800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:57.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.621+0000 7f6a8d128800 20 started sync module instance, tier type = 2024-09-12T17:46:57.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.621+0000 7f6a8d128800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:46:57.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.631+0000 7f6a8d128800 20 add_watcher() i=0 2024-09-12T17:46:57.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.631+0000 7f6a8d128800 20 add_watcher() i=1 2024-09-12T17:46:57.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.631+0000 7f6a8d128800 20 add_watcher() i=2 2024-09-12T17:46:57.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.631+0000 7f6a8d128800 20 add_watcher() i=3 2024-09-12T17:46:57.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.631+0000 7f6a8d128800 20 add_watcher() i=4 2024-09-12T17:46:57.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.631+0000 7f6a8d128800 20 add_watcher() i=5 2024-09-12T17:46:57.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.631+0000 7f6a8d128800 20 add_watcher() i=6 2024-09-12T17:46:57.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.632+0000 7f6a8d128800 20 add_watcher() i=7 2024-09-12T17:46:57.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.632+0000 7f6a8d128800 2 all 8 watchers are set, enabling cache 2024-09-12T17:46:57.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.633+0000 7f693efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:46:57.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.633+0000 7f6a8d128800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:46:57.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.633+0000 7f6a8d128800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:46:57.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.633+0000 7f6a8d128800 5 note: GC not initialized 2024-09-12T17:46:57.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.634+0000 7f693dfe3640 20 reqs_thread_entry: start 2024-09-12T17:46:57.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.634+0000 7f6a8d128800 20 init_complete bucket index max shards: 11 2024-09-12T17:46:57.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.634+0000 7f6a8d128800 20 Filter name: none 2024-09-12T17:46:57.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.634+0000 7f68af7fe640 20 reqs_thread_entry: start 2024-09-12T17:46:57.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.634+0000 7f6a8d128800 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : miss 2024-09-12T17:46:57.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.634+0000 7f6a8d128800 20 rados->read ofs=0 len=0 2024-09-12T17:46:57.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.635+0000 7f6a8d128800 20 rados_obj.operate() r=0 bl.length=460 2024-09-12T17:46:57.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.635+0000 7f6a8d128800 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x13 2024-09-12T17:46:57.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.635+0000 7f6a8d128800 10 adding default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-12T17:46:57.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.635+0000 7f6a8d128800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:46:57.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.638+0000 7f6a8d128800 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-12T17:46:57.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.638+0000 7f6a8d128800 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-12T17:46:57.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.638+0000 7f6a8d128800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:bar.client.0, ofs0, ns] 2024-09-12T17:46:57.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.638+0000 7f695ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431697 cookie 94744190818816 notifier 8477 bl.length()=659 2024-09-12T17:46:57.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.638+0000 7f695ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-12T17:46:57.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.638+0000 7f695ffff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-12T17:46:57.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.640+0000 7f693efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:46:57.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.643+0000 7f6a8d128800 20 remove_watcher() i=0 2024-09-12T17:46:57.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.643+0000 7f6a8d128800 2 removed watcher, disabling cache 2024-09-12T17:46:57.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.644+0000 7f6a8d128800 20 remove_watcher() i=1 2024-09-12T17:46:57.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.645+0000 7f6a8d128800 20 remove_watcher() i=2 2024-09-12T17:46:57.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.646+0000 7f6a8d128800 20 remove_watcher() i=3 2024-09-12T17:46:57.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.647+0000 7f6a8d128800 20 remove_watcher() i=4 2024-09-12T17:46:57.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.648+0000 7f6a8d128800 20 remove_watcher() i=5 2024-09-12T17:46:57.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.649+0000 7f6a8d128800 20 remove_watcher() i=6 2024-09-12T17:46:57.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.650+0000 7f6a8d128800 20 remove_watcher() i=7 2024-09-12T17:46:57.662 DEBUG:tasks.s3tests:Creating user testx$tenanteduser.client.0 on client.0 2024-09-12T17:46:57.662 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid 'testx$tenanteduser.client.0' --display-name 'Mr.testx$tenanteduser.client.0' --email 'testx$tenanteduser+test@test.test' --access-key SQZSHYMJRTRFZRQZAVBB --secret lTEzkdGWw4j6Xgf/U7ngybBFaFlN5SttgetZilzJ7mzdfhlgX+fHgA== --cluster ceph 2024-09-12T17:46:57.728 INFO:teuthology.orchestra.run.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:46:57.729 INFO:teuthology.orchestra.run.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:46:57.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.763+0000 7fed3d726800 20 rados->read ofs=0 len=0 2024-09-12T17:46:57.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.765+0000 7fed3d726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:57.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.765+0000 7fed3d726800 20 realm 2024-09-12T17:46:57.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.765+0000 7fed3d726800 20 rados->read ofs=0 len=0 2024-09-12T17:46:57.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.765+0000 7fed3d726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:57.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.765+0000 7fed3d726800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:46:57.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.765+0000 7fed3d726800 20 rados->read ofs=0 len=0 2024-09-12T17:46:57.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.765+0000 7fed3d726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:57.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.765+0000 7fed3d726800 20 rados->read ofs=0 len=0 2024-09-12T17:46:57.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.766+0000 7fed3d726800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:46:57.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.766+0000 7fed3d726800 20 rados->read ofs=0 len=0 2024-09-12T17:46:57.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.766+0000 7fed3d726800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:46:57.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.766+0000 7fed3d726800 20 searching for the correct realm 2024-09-12T17:46:57.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.769+0000 7fed30c6e640 0 -- 172.21.15.37:0/506352868 >> [v2:172.21.15.40:6800/2441293461,v1:172.21.15.40:6801/2441293461] conn(0x7fed2c088060 msgr2=0x7fed2c0569c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:46:57.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.773+0000 7fed3946f640 0 -- 172.21.15.37:0/506352868 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7fed2406f0b0 msgr2=0x7fed2405ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:46:57.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.979+0000 7fed3d726800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:46:57.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.979+0000 7fed3d726800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:46:57.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.979+0000 7fed3d726800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:46:57.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.979+0000 7fed3d726800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:46:57.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.979+0000 7fed3d726800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:46:57.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.979+0000 7fed3d726800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:46:57.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.979+0000 7fed3d726800 20 rados->read ofs=0 len=0 2024-09-12T17:46:57.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.979+0000 7fed3d726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:57.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.979+0000 7fed3d726800 20 rados->read ofs=0 len=0 2024-09-12T17:46:57.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.980+0000 7fed3d726800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:46:57.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.980+0000 7fed3d726800 20 rados->read ofs=0 len=0 2024-09-12T17:46:57.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.980+0000 7fed3d726800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:46:57.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.980+0000 7fed3d726800 20 zone default found 2024-09-12T17:46:57.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.980+0000 7fed3d726800 4 Realm: () 2024-09-12T17:46:57.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.980+0000 7fed3d726800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:46:57.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.980+0000 7fed3d726800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:46:57.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.980+0000 7fed3d726800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:46:57.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.980+0000 7fed3d726800 20 zonegroup default 2024-09-12T17:46:57.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.980+0000 7fed3d726800 20 rados->read ofs=0 len=0 2024-09-12T17:46:57.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.981+0000 7fed3d726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:57.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.981+0000 7fed3d726800 20 rados->read ofs=0 len=0 2024-09-12T17:46:57.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.981+0000 7fed3d726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:57.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.981+0000 7fed3d726800 20 rados->read ofs=0 len=0 2024-09-12T17:46:57.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.981+0000 7fed3d726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:57.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.981+0000 7fed3d726800 20 started sync module instance, tier type = 2024-09-12T17:46:57.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.981+0000 7fed3d726800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:46:57.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.991+0000 7fed3d726800 20 add_watcher() i=0 2024-09-12T17:46:57.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.991+0000 7fed3d726800 20 add_watcher() i=1 2024-09-12T17:46:57.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.991+0000 7fed3d726800 20 add_watcher() i=2 2024-09-12T17:46:57.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.991+0000 7fed3d726800 20 add_watcher() i=3 2024-09-12T17:46:57.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.991+0000 7fed3d726800 20 add_watcher() i=4 2024-09-12T17:46:57.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.991+0000 7fed3d726800 20 add_watcher() i=5 2024-09-12T17:46:57.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.991+0000 7fed3d726800 20 add_watcher() i=6 2024-09-12T17:46:57.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.992+0000 7fed3d726800 20 add_watcher() i=7 2024-09-12T17:46:57.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.992+0000 7fed3d726800 2 all 8 watchers are set, enabling cache 2024-09-12T17:46:57.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.994+0000 7febeffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:46:57.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.994+0000 7fed3d726800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:46:57.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.994+0000 7fed3d726800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:46:57.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.994+0000 7fed3d726800 5 note: GC not initialized 2024-09-12T17:46:57.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.994+0000 7febeefe5640 20 reqs_thread_entry: start 2024-09-12T17:46:57.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.994+0000 7fed3d726800 20 init_complete bucket index max shards: 11 2024-09-12T17:46:57.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.994+0000 7fed3d726800 20 Filter name: none 2024-09-12T17:46:57.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.995+0000 7febecfe1640 20 reqs_thread_entry: start 2024-09-12T17:46:57.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.995+0000 7fed3d726800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : miss 2024-09-12T17:46:57.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.995+0000 7fed3d726800 20 rados->read ofs=0 len=0 2024-09-12T17:46:57.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.995+0000 7fed3d726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:57.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.995+0000 7fed3d726800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x0 2024-09-12T17:46:57.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.995+0000 7fed3d726800 10 adding default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-12T17:46:57.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.995+0000 7fed3d726800 10 cache get: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test : miss 2024-09-12T17:46:57.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.995+0000 7fed3d726800 20 rados->read ofs=0 len=0 2024-09-12T17:46:57.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.995+0000 7fed3d726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:57.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.995+0000 7fed3d726800 10 cache put: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test info.flags=0x0 2024-09-12T17:46:57.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.995+0000 7fed3d726800 10 adding default.rgw.meta+users.email+testx$tenanteduser+test@test.test to cache LRU end 2024-09-12T17:46:57.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.995+0000 7fed3d726800 10 cache get: name=default.rgw.meta+users.keys+SQZSHYMJRTRFZRQZAVBB : miss 2024-09-12T17:46:57.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.995+0000 7fed3d726800 20 rados->read ofs=0 len=0 2024-09-12T17:46:57.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.996+0000 7fed3d726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:57.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.996+0000 7fed3d726800 10 cache put: name=default.rgw.meta+users.keys+SQZSHYMJRTRFZRQZAVBB info.flags=0x0 2024-09-12T17:46:57.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.996+0000 7fed3d726800 10 adding default.rgw.meta+users.keys+SQZSHYMJRTRFZRQZAVBB to cache LRU end 2024-09-12T17:46:57.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.996+0000 7fed3d726800 10 cache get: name=default.rgw.meta+users.keys+SQZSHYMJRTRFZRQZAVBB : hit (negative entry) 2024-09-12T17:46:57.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.996+0000 7fed3d726800 10 cache get: name=default.rgw.meta+users.keys+SQZSHYMJRTRFZRQZAVBB : hit (negative entry) 2024-09-12T17:46:57.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.997+0000 7fed3d726800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-12T17:46:57.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.997+0000 7fed3d726800 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-12T17:46:57.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.997+0000 7fed3d726800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser.client.0, ofs0, ns] 2024-09-12T17:46:57.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.997+0000 7fec1cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431723 cookie 94532648696288 notifier 8495 bl.length()=719 2024-09-12T17:46:57.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.997+0000 7fec1cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-12T17:46:57.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:57.997+0000 7fec1cff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-12T17:46:58.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:58.000+0000 7fed3d726800 10 cache put: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test info.flags=0x7 2024-09-12T17:46:58.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:58.000+0000 7fed3d726800 10 moving default.rgw.meta+users.email+testx$tenanteduser+test@test.test to cache LRU end 2024-09-12T17:46:58.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:58.000+0000 7fed3d726800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.email:testx$tenanteduser+test@test.test, ofs0, ns] 2024-09-12T17:46:58.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:58.001+0000 7fec1cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431666 cookie 94532648704080 notifier 8495 bl.length()=215 2024-09-12T17:46:58.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:58.001+0000 7fec1cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test info.flags=0x7 2024-09-12T17:46:58.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:58.001+0000 7fec1cff9640 10 rgw watcher librados: moving default.rgw.meta+users.email+testx$tenanteduser+test@test.test to cache LRU end 2024-09-12T17:46:58.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:58.003+0000 7fed3d726800 10 cache put: name=default.rgw.meta+users.keys+SQZSHYMJRTRFZRQZAVBB info.flags=0x7 2024-09-12T17:46:58.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:58.003+0000 7fed3d726800 10 moving default.rgw.meta+users.keys+SQZSHYMJRTRFZRQZAVBB to cache LRU end 2024-09-12T17:46:58.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:58.003+0000 7fed3d726800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.keys:SQZSHYMJRTRFZRQZAVBB, ofs0, ns] 2024-09-12T17:46:58.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:58.004+0000 7fec0ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431804 cookie 94532648681696 notifier 8495 bl.length()=201 2024-09-12T17:46:58.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:58.004+0000 7fec0ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+SQZSHYMJRTRFZRQZAVBB info.flags=0x7 2024-09-12T17:46:58.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:58.004+0000 7fec0ffff640 10 rgw watcher librados: moving default.rgw.meta+users.keys+SQZSHYMJRTRFZRQZAVBB to cache LRU end 2024-09-12T17:46:58.006 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-09-12T17:46:58.006 INFO:teuthology.orchestra.run.smithi037.stdout: "user_id": "testx$tenanteduser.client.0", 2024-09-12T17:46:58.006 INFO:teuthology.orchestra.run.smithi037.stdout: "display_name": "Mr.testx$tenanteduser.client.0", 2024-09-12T17:46:58.006 INFO:teuthology.orchestra.run.smithi037.stdout: "email": "testx$tenanteduser+test@test.test", 2024-09-12T17:46:58.006 INFO:teuthology.orchestra.run.smithi037.stdout: "suspended": 0, 2024-09-12T17:46:58.006 INFO:teuthology.orchestra.run.smithi037.stdout: "max_buckets": 1000, 2024-09-12T17:46:58.006 INFO:teuthology.orchestra.run.smithi037.stdout: "subusers": [], 2024-09-12T17:46:58.006 INFO:teuthology.orchestra.run.smithi037.stdout: "keys": [ 2024-09-12T17:46:58.006 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-12T17:46:58.006 INFO:teuthology.orchestra.run.smithi037.stdout: "user": "testx$tenanteduser.client.0", 2024-09-12T17:46:58.007 INFO:teuthology.orchestra.run.smithi037.stdout: "access_key": "SQZSHYMJRTRFZRQZAVBB", 2024-09-12T17:46:58.007 INFO:teuthology.orchestra.run.smithi037.stdout: "secret_key": "lTEzkdGWw4j6Xgf/U7ngybBFaFlN5SttgetZilzJ7mzdfhlgX+fHgA==", 2024-09-12T17:46:58.007 INFO:teuthology.orchestra.run.smithi037.stdout: "active": true, 2024-09-12T17:46:58.007 INFO:teuthology.orchestra.run.smithi037.stdout: "create_date": "2024-09-12T17:46:57.996710Z" 2024-09-12T17:46:58.007 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-12T17:46:58.007 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-12T17:46:58.007 INFO:teuthology.orchestra.run.smithi037.stdout: "swift_keys": [], 2024-09-12T17:46:58.007 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": [], 2024-09-12T17:46:58.007 INFO:teuthology.orchestra.run.smithi037.stdout: "op_mask": "read, write, delete", 2024-09-12T17:46:58.007 INFO:teuthology.orchestra.run.smithi037.stdout: "default_placement": "", 2024-09-12T17:46:58.007 INFO:teuthology.orchestra.run.smithi037.stdout: "default_storage_class": "", 2024-09-12T17:46:58.007 INFO:teuthology.orchestra.run.smithi037.stdout: "placement_tags": [], 2024-09-12T17:46:58.008 INFO:teuthology.orchestra.run.smithi037.stdout: "bucket_quota": { 2024-09-12T17:46:58.008 INFO:teuthology.orchestra.run.smithi037.stdout: "enabled": false, 2024-09-12T17:46:58.008 INFO:teuthology.orchestra.run.smithi037.stdout: "check_on_raw": false, 2024-09-12T17:46:58.008 INFO:teuthology.orchestra.run.smithi037.stdout: "max_size": -1, 2024-09-12T17:46:58.008 INFO:teuthology.orchestra.run.smithi037.stdout: "max_size_kb": 0, 2024-09-12T17:46:58.008 INFO:teuthology.orchestra.run.smithi037.stdout: "max_objects": -1 2024-09-12T17:46:58.008 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-12T17:46:58.008 INFO:teuthology.orchestra.run.smithi037.stdout: "user_quota": { 2024-09-12T17:46:58.009 INFO:teuthology.orchestra.run.smithi037.stdout: "enabled": false, 2024-09-12T17:46:58.009 INFO:teuthology.orchestra.run.smithi037.stdout: "check_on_raw": false, 2024-09-12T17:46:58.009 INFO:teuthology.orchestra.run.smithi037.stdout: "max_size": -1, 2024-09-12T17:46:58.009 INFO:teuthology.orchestra.run.smithi037.stdout: "max_size_kb": 0, 2024-09-12T17:46:58.009 INFO:teuthology.orchestra.run.smithi037.stdout: "max_objects": -1 2024-09-12T17:46:58.009 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-12T17:46:58.009 INFO:teuthology.orchestra.run.smithi037.stdout: "temp_url_keys": [], 2024-09-12T17:46:58.009 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "rgw", 2024-09-12T17:46:58.009 INFO:teuthology.orchestra.run.smithi037.stdout: "mfa_ids": [], 2024-09-12T17:46:58.009 INFO:teuthology.orchestra.run.smithi037.stdout: "account_id": "", 2024-09-12T17:46:58.009 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-09-12T17:46:58.009 INFO:teuthology.orchestra.run.smithi037.stdout: "create_date": "2024-09-12T17:46:57.996700Z", 2024-09-12T17:46:58.010 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-12T17:46:58.010 INFO:teuthology.orchestra.run.smithi037.stdout: "group_ids": [] 2024-09-12T17:46:58.010 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-09-12T17:46:58.010 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:46:58.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:58.006+0000 7febeffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:46:58.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:58.009+0000 7fed3d726800 20 remove_watcher() i=0 2024-09-12T17:46:58.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:58.009+0000 7fed3d726800 2 removed watcher, disabling cache 2024-09-12T17:46:58.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:58.010+0000 7fed3d726800 20 remove_watcher() i=1 2024-09-12T17:46:58.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:58.011+0000 7fed3d726800 20 remove_watcher() i=2 2024-09-12T17:46:58.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:58.013+0000 7fed3d726800 20 remove_watcher() i=3 2024-09-12T17:46:58.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:58.014+0000 7fed3d726800 20 remove_watcher() i=4 2024-09-12T17:46:58.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:58.015+0000 7fed3d726800 20 remove_watcher() i=5 2024-09-12T17:46:58.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:58.016+0000 7fed3d726800 20 remove_watcher() i=6 2024-09-12T17:46:58.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:58.017+0000 7fed3d726800 20 remove_watcher() i=7 2024-09-12T17:46:58.029 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid 'testx$tenanteduser.client.0' --totp-serial 9925244265 --totp-seed RGZIGOR2RQ7CMGKLYT7GXASX6Q2PJMDBFBKXVP2GFORRNLXO4V5STSRSMDUBXKNI --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-12T17:46:58.102 INFO:teuthology.orchestra.run.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:46:58.103 INFO:teuthology.orchestra.run.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:46:58.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:58.540+0000 7f7b906cc640 0 --2- 172.21.15.37:0/1405035149 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f23f38c660 0x55f23f392d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-12T17:46:58.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:58.549+0000 7f7b94814800 20 rados->read ofs=0 len=0 2024-09-12T17:46:58.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:58.551+0000 7f7b94814800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:58.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:58.552+0000 7f7b94814800 20 realm 2024-09-12T17:46:58.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:58.552+0000 7f7b94814800 20 rados->read ofs=0 len=0 2024-09-12T17:46:58.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:58.552+0000 7f7b94814800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:58.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:58.552+0000 7f7b94814800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:46:58.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:58.552+0000 7f7b94814800 20 rados->read ofs=0 len=0 2024-09-12T17:46:58.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:58.553+0000 7f7b94814800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:58.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:58.553+0000 7f7b94814800 20 rados->read ofs=0 len=0 2024-09-12T17:46:58.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:58.557+0000 7f7b94814800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:46:58.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:58.557+0000 7f7b94814800 20 rados->read ofs=0 len=0 2024-09-12T17:46:58.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:58.557+0000 7f7b94814800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:46:58.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:58.557+0000 7f7b94814800 20 searching for the correct realm 2024-09-12T17:46:58.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:58.560+0000 7f7b8fecb640 0 -- 172.21.15.37:0/1180018250 >> [v2:172.21.15.37:6800/1206746176,v1:172.21.15.37:6801/1206746176] conn(0x7f7b88038040 msgr2=0x7f7b88020430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:46:58.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:58.766+0000 7f7b906cc640 0 -- 172.21.15.37:0/1180018250 >> [v2:172.21.15.40:6818/1210108009,v1:172.21.15.40:6819/1210108009] conn(0x7f7b840990b0 msgr2=0x7f7b8405fa60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:46:58.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:58.773+0000 7f7b94814800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:46:58.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:58.773+0000 7f7b94814800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:46:58.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:58.773+0000 7f7b94814800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:46:58.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:58.773+0000 7f7b94814800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:46:58.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:58.773+0000 7f7b94814800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:46:58.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:58.773+0000 7f7b94814800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:46:58.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:58.773+0000 7f7b94814800 20 rados->read ofs=0 len=0 2024-09-12T17:46:58.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:58.773+0000 7f7b94814800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:58.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:58.773+0000 7f7b94814800 20 rados->read ofs=0 len=0 2024-09-12T17:46:58.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:58.773+0000 7f7b94814800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:46:58.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:58.773+0000 7f7b94814800 20 rados->read ofs=0 len=0 2024-09-12T17:46:58.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:58.774+0000 7f7b94814800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:46:58.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:58.774+0000 7f7b94814800 20 zone default found 2024-09-12T17:46:58.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:58.774+0000 7f7b94814800 4 Realm: () 2024-09-12T17:46:58.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:58.774+0000 7f7b94814800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:46:58.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:58.774+0000 7f7b94814800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:46:58.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:58.774+0000 7f7b94814800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:46:58.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:58.774+0000 7f7b94814800 20 zonegroup default 2024-09-12T17:46:58.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:58.774+0000 7f7b94814800 20 rados->read ofs=0 len=0 2024-09-12T17:46:58.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:58.774+0000 7f7b94814800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:58.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:58.774+0000 7f7b94814800 20 rados->read ofs=0 len=0 2024-09-12T17:46:58.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:58.775+0000 7f7b94814800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:58.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:58.775+0000 7f7b94814800 20 rados->read ofs=0 len=0 2024-09-12T17:46:58.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:58.775+0000 7f7b94814800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:58.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:58.775+0000 7f7b94814800 20 started sync module instance, tier type = 2024-09-12T17:46:58.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:58.775+0000 7f7b94814800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:46:58.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:58.786+0000 7f7b94814800 20 add_watcher() i=0 2024-09-12T17:46:58.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:58.786+0000 7f7b94814800 20 add_watcher() i=1 2024-09-12T17:46:58.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:58.786+0000 7f7b94814800 20 add_watcher() i=2 2024-09-12T17:46:58.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:58.786+0000 7f7b94814800 20 add_watcher() i=3 2024-09-12T17:46:58.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:58.786+0000 7f7b94814800 20 add_watcher() i=4 2024-09-12T17:46:58.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:58.786+0000 7f7b94814800 20 add_watcher() i=5 2024-09-12T17:46:58.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:58.786+0000 7f7b94814800 20 add_watcher() i=6 2024-09-12T17:46:58.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:58.787+0000 7f7b94814800 20 add_watcher() i=7 2024-09-12T17:46:58.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:58.787+0000 7f7b94814800 2 all 8 watchers are set, enabling cache 2024-09-12T17:46:58.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:58.789+0000 7f7a45fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:46:58.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:58.789+0000 7f7b94814800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:46:58.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:58.789+0000 7f7b94814800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:46:58.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:58.789+0000 7f7b94814800 5 note: GC not initialized 2024-09-12T17:46:58.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:58.789+0000 7f7a44fe1640 20 reqs_thread_entry: start 2024-09-12T17:46:58.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:58.789+0000 7f7b94814800 20 init_complete bucket index max shards: 11 2024-09-12T17:46:58.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:58.789+0000 7f7b94814800 20 Filter name: none 2024-09-12T17:46:58.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:58.789+0000 7f79be7fc640 20 reqs_thread_entry: start 2024-09-12T17:46:58.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:58.789+0000 7f7b94814800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : miss 2024-09-12T17:46:58.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:58.789+0000 7f7b94814800 20 rados->read ofs=0 len=0 2024-09-12T17:46:58.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:58.790+0000 7f7b94814800 20 rados_obj.operate() r=0 bl.length=519 2024-09-12T17:46:58.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:58.790+0000 7f7b94814800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x13 2024-09-12T17:46:58.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:58.790+0000 7f7b94814800 10 adding default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-12T17:46:58.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:58.790+0000 7f7b94814800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:46:58.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:58.793+0000 7f7b94814800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-12T17:46:58.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:58.793+0000 7f7b94814800 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-12T17:46:58.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:58.793+0000 7f7b94814800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser.client.0, ofs0, ns] 2024-09-12T17:46:58.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:58.793+0000 7f7a6effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399020 cookie 94498931340656 notifier 8513 bl.length()=733 2024-09-12T17:46:58.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:58.793+0000 7f7a6effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-12T17:46:58.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:58.793+0000 7f7a6effd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-12T17:46:58.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:58.796+0000 7f7a45fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:46:58.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:58.798+0000 7f7b94814800 20 remove_watcher() i=0 2024-09-12T17:46:58.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:58.798+0000 7f7b94814800 2 removed watcher, disabling cache 2024-09-12T17:46:58.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:58.800+0000 7f7b94814800 20 remove_watcher() i=1 2024-09-12T17:46:58.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:58.801+0000 7f7b94814800 20 remove_watcher() i=2 2024-09-12T17:46:58.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:58.802+0000 7f7b94814800 20 remove_watcher() i=3 2024-09-12T17:46:58.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:58.803+0000 7f7b94814800 20 remove_watcher() i=4 2024-09-12T17:46:58.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:58.804+0000 7f7b94814800 20 remove_watcher() i=5 2024-09-12T17:46:58.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:58.805+0000 7f7b94814800 20 remove_watcher() i=6 2024-09-12T17:46:58.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:58.806+0000 7f7b94814800 20 remove_watcher() i=7 2024-09-12T17:46:58.820 DEBUG:tasks.s3tests:Creating user foobar.client.0 on client.0 2024-09-12T17:46:58.820 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid foobar.client.0 --display-name Mr.foobar.client.0 --email foobar+test@test.test --access-key DWSFIXIGLPTDTDDYOTHE --secret VNC0bhvd62tLZVn1Br0PvPr/fSfAfzgDW7GLHpchOFNQ+90JrfwXGw== --cluster ceph 2024-09-12T17:46:58.888 INFO:teuthology.orchestra.run.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:46:58.888 INFO:teuthology.orchestra.run.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:46:58.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:58.924+0000 7f8771a14800 20 rados->read ofs=0 len=0 2024-09-12T17:46:58.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:58.926+0000 7f8771a14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:58.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:58.926+0000 7f8771a14800 20 realm 2024-09-12T17:46:58.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:58.926+0000 7f8771a14800 20 rados->read ofs=0 len=0 2024-09-12T17:46:58.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:58.926+0000 7f8771a14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:58.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:58.926+0000 7f8771a14800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:46:58.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:58.926+0000 7f8771a14800 20 rados->read ofs=0 len=0 2024-09-12T17:46:58.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:58.926+0000 7f8771a14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:58.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:58.926+0000 7f8771a14800 20 rados->read ofs=0 len=0 2024-09-12T17:46:58.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:58.927+0000 7f8771a14800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:46:58.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:58.927+0000 7f8771a14800 20 rados->read ofs=0 len=0 2024-09-12T17:46:58.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:58.927+0000 7f8771a14800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:46:58.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:58.927+0000 7f8771a14800 20 searching for the correct realm 2024-09-12T17:46:58.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:58.929+0000 7f876d0cb640 0 -- 172.21.15.37:0/620970150 >> [v2:172.21.15.37:6800/1206746176,v1:172.21.15.37:6801/1206746176] conn(0x560d354e1130 msgr2=0x7f8768007580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:46:59.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.135+0000 7f876d8cc640 0 -- 172.21.15.37:0/620970150 >> [v2:172.21.15.40:6818/1210108009,v1:172.21.15.40:6819/1210108009] conn(0x7f8758041070 msgr2=0x7f875806c4e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:46:59.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.141+0000 7f8771a14800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:46:59.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.141+0000 7f8771a14800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:46:59.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.141+0000 7f8771a14800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:46:59.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.141+0000 7f8771a14800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:46:59.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.141+0000 7f8771a14800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:46:59.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.141+0000 7f8771a14800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:46:59.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.141+0000 7f8771a14800 20 rados->read ofs=0 len=0 2024-09-12T17:46:59.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.141+0000 7f8771a14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:59.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.141+0000 7f8771a14800 20 rados->read ofs=0 len=0 2024-09-12T17:46:59.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.142+0000 7f8771a14800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:46:59.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.142+0000 7f8771a14800 20 rados->read ofs=0 len=0 2024-09-12T17:46:59.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.142+0000 7f8771a14800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:46:59.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.142+0000 7f8771a14800 20 zone default found 2024-09-12T17:46:59.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.142+0000 7f8771a14800 4 Realm: () 2024-09-12T17:46:59.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.142+0000 7f8771a14800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:46:59.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.142+0000 7f8771a14800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:46:59.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.142+0000 7f8771a14800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:46:59.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.142+0000 7f8771a14800 20 zonegroup default 2024-09-12T17:46:59.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.142+0000 7f8771a14800 20 rados->read ofs=0 len=0 2024-09-12T17:46:59.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.143+0000 7f8771a14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:59.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.143+0000 7f8771a14800 20 rados->read ofs=0 len=0 2024-09-12T17:46:59.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.143+0000 7f8771a14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:59.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.143+0000 7f8771a14800 20 rados->read ofs=0 len=0 2024-09-12T17:46:59.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.143+0000 7f8771a14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:59.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.143+0000 7f8771a14800 20 started sync module instance, tier type = 2024-09-12T17:46:59.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.143+0000 7f8771a14800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:46:59.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.153+0000 7f8771a14800 20 add_watcher() i=0 2024-09-12T17:46:59.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.153+0000 7f8771a14800 20 add_watcher() i=1 2024-09-12T17:46:59.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.153+0000 7f8771a14800 20 add_watcher() i=2 2024-09-12T17:46:59.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.153+0000 7f8771a14800 20 add_watcher() i=3 2024-09-12T17:46:59.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.153+0000 7f8771a14800 20 add_watcher() i=4 2024-09-12T17:46:59.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.153+0000 7f8771a14800 20 add_watcher() i=5 2024-09-12T17:46:59.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.153+0000 7f8771a14800 20 add_watcher() i=6 2024-09-12T17:46:59.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.154+0000 7f8771a14800 20 add_watcher() i=7 2024-09-12T17:46:59.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.154+0000 7f8771a14800 2 all 8 watchers are set, enabling cache 2024-09-12T17:46:59.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.156+0000 7f86237e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:46:59.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.156+0000 7f8771a14800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:46:59.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.156+0000 7f8771a14800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:46:59.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.156+0000 7f8771a14800 5 note: GC not initialized 2024-09-12T17:46:59.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.157+0000 7f86227e4640 20 reqs_thread_entry: start 2024-09-12T17:46:59.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.157+0000 7f8771a14800 20 init_complete bucket index max shards: 11 2024-09-12T17:46:59.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.157+0000 7f8771a14800 20 Filter name: none 2024-09-12T17:46:59.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.157+0000 7f8593fff640 20 reqs_thread_entry: start 2024-09-12T17:46:59.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.157+0000 7f8771a14800 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-09-12T17:46:59.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.157+0000 7f8771a14800 20 rados->read ofs=0 len=0 2024-09-12T17:46:59.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.157+0000 7f8771a14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:59.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.157+0000 7f8771a14800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x0 2024-09-12T17:46:59.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.157+0000 7f8771a14800 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T17:46:59.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.157+0000 7f8771a14800 10 cache get: name=default.rgw.meta+users.email+foobar+test@test.test : miss 2024-09-12T17:46:59.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.157+0000 7f8771a14800 20 rados->read ofs=0 len=0 2024-09-12T17:46:59.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.158+0000 7f8771a14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:59.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.158+0000 7f8771a14800 10 cache put: name=default.rgw.meta+users.email+foobar+test@test.test info.flags=0x0 2024-09-12T17:46:59.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.158+0000 7f8771a14800 10 adding default.rgw.meta+users.email+foobar+test@test.test to cache LRU end 2024-09-12T17:46:59.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.158+0000 7f8771a14800 10 cache get: name=default.rgw.meta+users.keys+DWSFIXIGLPTDTDDYOTHE : miss 2024-09-12T17:46:59.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.158+0000 7f8771a14800 20 rados->read ofs=0 len=0 2024-09-12T17:46:59.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.158+0000 7f8771a14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:59.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.158+0000 7f8771a14800 10 cache put: name=default.rgw.meta+users.keys+DWSFIXIGLPTDTDDYOTHE info.flags=0x0 2024-09-12T17:46:59.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.158+0000 7f8771a14800 10 adding default.rgw.meta+users.keys+DWSFIXIGLPTDTDDYOTHE to cache LRU end 2024-09-12T17:46:59.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.158+0000 7f8771a14800 10 cache get: name=default.rgw.meta+users.keys+DWSFIXIGLPTDTDDYOTHE : hit (negative entry) 2024-09-12T17:46:59.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.158+0000 7f8771a14800 10 cache get: name=default.rgw.meta+users.keys+DWSFIXIGLPTDTDDYOTHE : hit (negative entry) 2024-09-12T17:46:59.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.160+0000 7f8771a14800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-12T17:46:59.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.160+0000 7f8771a14800 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T17:46:59.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.160+0000 7f8771a14800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-09-12T17:46:59.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.160+0000 7f8650ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398963 cookie 94614730290944 notifier 8528 bl.length()=660 2024-09-12T17:46:59.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.160+0000 7f8650ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-12T17:46:59.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.160+0000 7f8650ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T17:46:59.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.163+0000 7f8771a14800 10 cache put: name=default.rgw.meta+users.email+foobar+test@test.test info.flags=0x7 2024-09-12T17:46:59.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.163+0000 7f8771a14800 10 moving default.rgw.meta+users.email+foobar+test@test.test to cache LRU end 2024-09-12T17:46:59.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.163+0000 7f8771a14800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.email:foobar+test@test.test, ofs0, ns] 2024-09-12T17:46:59.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.164+0000 7f8650ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398994 cookie 94614730274304 notifier 8528 bl.length()=191 2024-09-12T17:46:59.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.164+0000 7f8650ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foobar+test@test.test info.flags=0x7 2024-09-12T17:46:59.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.164+0000 7f8650ff9640 10 rgw watcher librados: moving default.rgw.meta+users.email+foobar+test@test.test to cache LRU end 2024-09-12T17:46:59.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.167+0000 7f8771a14800 10 cache put: name=default.rgw.meta+users.keys+DWSFIXIGLPTDTDDYOTHE info.flags=0x7 2024-09-12T17:46:59.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.167+0000 7f8771a14800 10 moving default.rgw.meta+users.keys+DWSFIXIGLPTDTDDYOTHE to cache LRU end 2024-09-12T17:46:59.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.167+0000 7f8771a14800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.keys:DWSFIXIGLPTDTDDYOTHE, ofs0, ns] 2024-09-12T17:46:59.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.167+0000 7f8650ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398964 cookie 94614730290944 notifier 8528 bl.length()=189 2024-09-12T17:46:59.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.167+0000 7f8650ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+DWSFIXIGLPTDTDDYOTHE info.flags=0x7 2024-09-12T17:46:59.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.167+0000 7f8650ff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+DWSFIXIGLPTDTDDYOTHE to cache LRU end 2024-09-12T17:46:59.169 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-09-12T17:46:59.170 INFO:teuthology.orchestra.run.smithi037.stdout: "user_id": "foobar.client.0", 2024-09-12T17:46:59.170 INFO:teuthology.orchestra.run.smithi037.stdout: "display_name": "Mr.foobar.client.0", 2024-09-12T17:46:59.170 INFO:teuthology.orchestra.run.smithi037.stdout: "email": "foobar+test@test.test", 2024-09-12T17:46:59.170 INFO:teuthology.orchestra.run.smithi037.stdout: "suspended": 0, 2024-09-12T17:46:59.170 INFO:teuthology.orchestra.run.smithi037.stdout: "max_buckets": 1000, 2024-09-12T17:46:59.170 INFO:teuthology.orchestra.run.smithi037.stdout: "subusers": [], 2024-09-12T17:46:59.170 INFO:teuthology.orchestra.run.smithi037.stdout: "keys": [ 2024-09-12T17:46:59.170 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-12T17:46:59.170 INFO:teuthology.orchestra.run.smithi037.stdout: "user": "foobar.client.0", 2024-09-12T17:46:59.170 INFO:teuthology.orchestra.run.smithi037.stdout: "access_key": "DWSFIXIGLPTDTDDYOTHE", 2024-09-12T17:46:59.170 INFO:teuthology.orchestra.run.smithi037.stdout: "secret_key": "VNC0bhvd62tLZVn1Br0PvPr/fSfAfzgDW7GLHpchOFNQ+90JrfwXGw==", 2024-09-12T17:46:59.171 INFO:teuthology.orchestra.run.smithi037.stdout: "active": true, 2024-09-12T17:46:59.171 INFO:teuthology.orchestra.run.smithi037.stdout: "create_date": "2024-09-12T17:46:59.159660Z" 2024-09-12T17:46:59.171 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-12T17:46:59.171 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-12T17:46:59.171 INFO:teuthology.orchestra.run.smithi037.stdout: "swift_keys": [], 2024-09-12T17:46:59.171 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": [], 2024-09-12T17:46:59.171 INFO:teuthology.orchestra.run.smithi037.stdout: "op_mask": "read, write, delete", 2024-09-12T17:46:59.171 INFO:teuthology.orchestra.run.smithi037.stdout: "default_placement": "", 2024-09-12T17:46:59.171 INFO:teuthology.orchestra.run.smithi037.stdout: "default_storage_class": "", 2024-09-12T17:46:59.171 INFO:teuthology.orchestra.run.smithi037.stdout: "placement_tags": [], 2024-09-12T17:46:59.171 INFO:teuthology.orchestra.run.smithi037.stdout: "bucket_quota": { 2024-09-12T17:46:59.171 INFO:teuthology.orchestra.run.smithi037.stdout: "enabled": false, 2024-09-12T17:46:59.171 INFO:teuthology.orchestra.run.smithi037.stdout: "check_on_raw": false, 2024-09-12T17:46:59.172 INFO:teuthology.orchestra.run.smithi037.stdout: "max_size": -1, 2024-09-12T17:46:59.172 INFO:teuthology.orchestra.run.smithi037.stdout: "max_size_kb": 0, 2024-09-12T17:46:59.172 INFO:teuthology.orchestra.run.smithi037.stdout: "max_objects": -1 2024-09-12T17:46:59.172 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-12T17:46:59.172 INFO:teuthology.orchestra.run.smithi037.stdout: "user_quota": { 2024-09-12T17:46:59.172 INFO:teuthology.orchestra.run.smithi037.stdout: "enabled": false, 2024-09-12T17:46:59.172 INFO:teuthology.orchestra.run.smithi037.stdout: "check_on_raw": false, 2024-09-12T17:46:59.172 INFO:teuthology.orchestra.run.smithi037.stdout: "max_size": -1, 2024-09-12T17:46:59.172 INFO:teuthology.orchestra.run.smithi037.stdout: "max_size_kb": 0, 2024-09-12T17:46:59.172 INFO:teuthology.orchestra.run.smithi037.stdout: "max_objects": -1 2024-09-12T17:46:59.172 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-12T17:46:59.172 INFO:teuthology.orchestra.run.smithi037.stdout: "temp_url_keys": [], 2024-09-12T17:46:59.172 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "rgw", 2024-09-12T17:46:59.173 INFO:teuthology.orchestra.run.smithi037.stdout: "mfa_ids": [], 2024-09-12T17:46:59.173 INFO:teuthology.orchestra.run.smithi037.stdout: "account_id": "", 2024-09-12T17:46:59.173 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-09-12T17:46:59.173 INFO:teuthology.orchestra.run.smithi037.stdout: "create_date": "2024-09-12T17:46:59.159642Z", 2024-09-12T17:46:59.173 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-12T17:46:59.173 INFO:teuthology.orchestra.run.smithi037.stdout: "group_ids": [] 2024-09-12T17:46:59.173 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-09-12T17:46:59.174 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:46:59.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.170+0000 7f86237e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:46:59.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.172+0000 7f8771a14800 20 remove_watcher() i=0 2024-09-12T17:46:59.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.172+0000 7f8771a14800 2 removed watcher, disabling cache 2024-09-12T17:46:59.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.173+0000 7f8771a14800 20 remove_watcher() i=1 2024-09-12T17:46:59.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.175+0000 7f8771a14800 20 remove_watcher() i=2 2024-09-12T17:46:59.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.176+0000 7f8771a14800 20 remove_watcher() i=3 2024-09-12T17:46:59.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.177+0000 7f8771a14800 20 remove_watcher() i=4 2024-09-12T17:46:59.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.178+0000 7f8771a14800 20 remove_watcher() i=5 2024-09-12T17:46:59.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.179+0000 7f8771a14800 20 remove_watcher() i=6 2024-09-12T17:46:59.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.180+0000 7f8771a14800 20 remove_watcher() i=7 2024-09-12T17:46:59.193 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid foobar.client.0 --totp-serial 8032911264 --totp-seed 2LQ4532EH54ZWJFAJEMOKJR6PKZMELVSVWTBUJOVHHR6QKXOMVFGX5I6S2IWDO4C --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-12T17:46:59.260 INFO:teuthology.orchestra.run.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:46:59.260 INFO:teuthology.orchestra.run.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:46:59.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.295+0000 7fb185539800 20 rados->read ofs=0 len=0 2024-09-12T17:46:59.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.296+0000 7fb185539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:59.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.296+0000 7fb185539800 20 realm 2024-09-12T17:46:59.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.296+0000 7fb185539800 20 rados->read ofs=0 len=0 2024-09-12T17:46:59.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.297+0000 7fb185539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:59.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.297+0000 7fb185539800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:46:59.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.297+0000 7fb185539800 20 rados->read ofs=0 len=0 2024-09-12T17:46:59.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.297+0000 7fb185539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:59.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.297+0000 7fb185539800 20 rados->read ofs=0 len=0 2024-09-12T17:46:59.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.298+0000 7fb185539800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:46:59.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.298+0000 7fb185539800 20 rados->read ofs=0 len=0 2024-09-12T17:46:59.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.298+0000 7fb185539800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:46:59.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.298+0000 7fb185539800 20 searching for the correct realm 2024-09-12T17:46:59.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.301+0000 7fb17bfff640 0 -- 172.21.15.37:0/3003856660 >> [v2:172.21.15.37:6816/2964054205,v1:172.21.15.37:6817/2964054205] conn(0x5615b727b770 msgr2=0x5615b727dbe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:46:59.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.306+0000 7fb1811c7640 0 -- 172.21.15.37:0/3003856660 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7fb16c0433f0 msgr2=0x7fb16c043870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:46:59.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.513+0000 7fb185539800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:46:59.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.513+0000 7fb185539800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:46:59.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.513+0000 7fb185539800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:46:59.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.513+0000 7fb185539800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:46:59.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.513+0000 7fb185539800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:46:59.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.513+0000 7fb185539800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:46:59.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.514+0000 7fb185539800 20 rados->read ofs=0 len=0 2024-09-12T17:46:59.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.514+0000 7fb185539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:59.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.514+0000 7fb185539800 20 rados->read ofs=0 len=0 2024-09-12T17:46:59.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.514+0000 7fb185539800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:46:59.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.514+0000 7fb185539800 20 rados->read ofs=0 len=0 2024-09-12T17:46:59.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.515+0000 7fb185539800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:46:59.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.515+0000 7fb185539800 20 zone default found 2024-09-12T17:46:59.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.515+0000 7fb185539800 4 Realm: () 2024-09-12T17:46:59.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.515+0000 7fb185539800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:46:59.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.515+0000 7fb185539800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:46:59.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.515+0000 7fb185539800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:46:59.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.515+0000 7fb185539800 20 zonegroup default 2024-09-12T17:46:59.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.515+0000 7fb185539800 20 rados->read ofs=0 len=0 2024-09-12T17:46:59.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.515+0000 7fb185539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:59.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.515+0000 7fb185539800 20 rados->read ofs=0 len=0 2024-09-12T17:46:59.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.515+0000 7fb185539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:59.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.515+0000 7fb185539800 20 rados->read ofs=0 len=0 2024-09-12T17:46:59.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.516+0000 7fb185539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:59.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.516+0000 7fb185539800 20 started sync module instance, tier type = 2024-09-12T17:46:59.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.516+0000 7fb185539800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:46:59.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.526+0000 7fb185539800 20 add_watcher() i=0 2024-09-12T17:46:59.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.526+0000 7fb185539800 20 add_watcher() i=1 2024-09-12T17:46:59.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.526+0000 7fb185539800 20 add_watcher() i=2 2024-09-12T17:46:59.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.526+0000 7fb185539800 20 add_watcher() i=3 2024-09-12T17:46:59.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.526+0000 7fb185539800 20 add_watcher() i=4 2024-09-12T17:46:59.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.526+0000 7fb185539800 20 add_watcher() i=5 2024-09-12T17:46:59.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.526+0000 7fb185539800 20 add_watcher() i=6 2024-09-12T17:46:59.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.527+0000 7fb185539800 20 add_watcher() i=7 2024-09-12T17:46:59.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.527+0000 7fb185539800 2 all 8 watchers are set, enabling cache 2024-09-12T17:46:59.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.529+0000 7fb037fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:46:59.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.530+0000 7fb185539800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:46:59.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.530+0000 7fb185539800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:46:59.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.530+0000 7fb185539800 5 note: GC not initialized 2024-09-12T17:46:59.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.530+0000 7fb036fe5640 20 reqs_thread_entry: start 2024-09-12T17:46:59.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.530+0000 7fb185539800 20 init_complete bucket index max shards: 11 2024-09-12T17:46:59.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.530+0000 7fb185539800 20 Filter name: none 2024-09-12T17:46:59.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.530+0000 7fb034fe1640 20 reqs_thread_entry: start 2024-09-12T17:46:59.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.530+0000 7fb185539800 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-09-12T17:46:59.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.530+0000 7fb185539800 20 rados->read ofs=0 len=0 2024-09-12T17:46:59.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.531+0000 7fb185539800 20 rados_obj.operate() r=0 bl.length=472 2024-09-12T17:46:59.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.531+0000 7fb185539800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x13 2024-09-12T17:46:59.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.531+0000 7fb185539800 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T17:46:59.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.531+0000 7fb185539800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:46:59.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.534+0000 7fb185539800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-12T17:46:59.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.534+0000 7fb185539800 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T17:46:59.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.534+0000 7fb185539800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-09-12T17:46:59.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.534+0000 7fb064ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398965 cookie 94651267168848 notifier 9198 bl.length()=674 2024-09-12T17:46:59.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.534+0000 7fb064ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-12T17:46:59.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.534+0000 7fb064ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T17:46:59.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.537+0000 7fb037fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:46:59.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.540+0000 7fb185539800 20 remove_watcher() i=0 2024-09-12T17:46:59.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.540+0000 7fb185539800 2 removed watcher, disabling cache 2024-09-12T17:46:59.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.541+0000 7fb185539800 20 remove_watcher() i=1 2024-09-12T17:46:59.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.542+0000 7fb185539800 20 remove_watcher() i=2 2024-09-12T17:46:59.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.543+0000 7fb185539800 20 remove_watcher() i=3 2024-09-12T17:46:59.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.545+0000 7fb185539800 20 remove_watcher() i=4 2024-09-12T17:46:59.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.546+0000 7fb185539800 20 remove_watcher() i=5 2024-09-12T17:46:59.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.547+0000 7fb185539800 20 remove_watcher() i=6 2024-09-12T17:46:59.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.548+0000 7fb185539800 20 remove_watcher() i=7 2024-09-12T17:46:59.561 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 caps add --uid foobar.client.0 --caps 'oidc-provider=*;roles=*;user-policy=*' --cluster ceph 2024-09-12T17:46:59.622 INFO:teuthology.orchestra.run.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:46:59.622 INFO:teuthology.orchestra.run.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:46:59.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.657+0000 7fb4efc0f800 20 rados->read ofs=0 len=0 2024-09-12T17:46:59.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.658+0000 7fb4efc0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:59.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.658+0000 7fb4efc0f800 20 realm 2024-09-12T17:46:59.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.658+0000 7fb4efc0f800 20 rados->read ofs=0 len=0 2024-09-12T17:46:59.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.658+0000 7fb4efc0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:59.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.658+0000 7fb4efc0f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:46:59.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.658+0000 7fb4efc0f800 20 rados->read ofs=0 len=0 2024-09-12T17:46:59.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.659+0000 7fb4efc0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:59.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.659+0000 7fb4efc0f800 20 rados->read ofs=0 len=0 2024-09-12T17:46:59.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.659+0000 7fb4efc0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:46:59.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.659+0000 7fb4efc0f800 20 rados->read ofs=0 len=0 2024-09-12T17:46:59.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.660+0000 7fb4efc0f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:46:59.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.660+0000 7fb4efc0f800 20 searching for the correct realm 2024-09-12T17:46:59.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.663+0000 7fb4e4eff640 0 -- 172.21.15.37:0/2585839021 >> [v2:172.21.15.37:6816/2964054205,v1:172.21.15.37:6817/2964054205] conn(0x5559d8d33710 msgr2=0x5559d8d35bb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:46:59.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.667+0000 7fb4ed700640 0 -- 172.21.15.37:0/2585839021 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7fb4d803a900 msgr2=0x7fb4d8008430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:46:59.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.671+0000 7fb4efc0f800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:46:59.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.671+0000 7fb4efc0f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:46:59.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.671+0000 7fb4efc0f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:46:59.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.671+0000 7fb4efc0f800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:46:59.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.671+0000 7fb4efc0f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:46:59.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.671+0000 7fb4efc0f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:46:59.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.671+0000 7fb4efc0f800 20 rados->read ofs=0 len=0 2024-09-12T17:46:59.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.672+0000 7fb4efc0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:59.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.672+0000 7fb4efc0f800 20 rados->read ofs=0 len=0 2024-09-12T17:46:59.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.672+0000 7fb4efc0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:46:59.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.672+0000 7fb4efc0f800 20 rados->read ofs=0 len=0 2024-09-12T17:46:59.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.673+0000 7fb4efc0f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:46:59.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.673+0000 7fb4efc0f800 20 zone default found 2024-09-12T17:46:59.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.673+0000 7fb4efc0f800 4 Realm: () 2024-09-12T17:46:59.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.673+0000 7fb4efc0f800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:46:59.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.673+0000 7fb4efc0f800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:46:59.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.673+0000 7fb4efc0f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:46:59.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.673+0000 7fb4efc0f800 20 zonegroup default 2024-09-12T17:46:59.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.673+0000 7fb4efc0f800 20 rados->read ofs=0 len=0 2024-09-12T17:46:59.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.673+0000 7fb4efc0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:59.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.673+0000 7fb4efc0f800 20 rados->read ofs=0 len=0 2024-09-12T17:46:59.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.673+0000 7fb4efc0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:59.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.673+0000 7fb4efc0f800 20 rados->read ofs=0 len=0 2024-09-12T17:46:59.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.673+0000 7fb4efc0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:59.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.673+0000 7fb4efc0f800 20 started sync module instance, tier type = 2024-09-12T17:46:59.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.673+0000 7fb4efc0f800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:46:59.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.683+0000 7fb4efc0f800 20 add_watcher() i=0 2024-09-12T17:46:59.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.683+0000 7fb4efc0f800 20 add_watcher() i=1 2024-09-12T17:46:59.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.683+0000 7fb4efc0f800 20 add_watcher() i=2 2024-09-12T17:46:59.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.683+0000 7fb4efc0f800 20 add_watcher() i=3 2024-09-12T17:46:59.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.683+0000 7fb4efc0f800 20 add_watcher() i=4 2024-09-12T17:46:59.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.683+0000 7fb4efc0f800 20 add_watcher() i=5 2024-09-12T17:46:59.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.683+0000 7fb4efc0f800 20 add_watcher() i=6 2024-09-12T17:46:59.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.684+0000 7fb4efc0f800 20 add_watcher() i=7 2024-09-12T17:46:59.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.684+0000 7fb4efc0f800 2 all 8 watchers are set, enabling cache 2024-09-12T17:46:59.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.686+0000 7fb3a3fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:46:59.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.686+0000 7fb4efc0f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:46:59.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.686+0000 7fb4efc0f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:46:59.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.686+0000 7fb4efc0f800 5 note: GC not initialized 2024-09-12T17:46:59.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.686+0000 7fb3a2fe5640 20 reqs_thread_entry: start 2024-09-12T17:46:59.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.686+0000 7fb4efc0f800 20 init_complete bucket index max shards: 11 2024-09-12T17:46:59.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.686+0000 7fb4efc0f800 20 Filter name: none 2024-09-12T17:46:59.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.686+0000 7fb3a0fe1640 20 reqs_thread_entry: start 2024-09-12T17:46:59.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.686+0000 7fb4efc0f800 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-09-12T17:46:59.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.687+0000 7fb4efc0f800 20 rados->read ofs=0 len=0 2024-09-12T17:46:59.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.687+0000 7fb4efc0f800 20 rados_obj.operate() r=0 bl.length=486 2024-09-12T17:46:59.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.687+0000 7fb4efc0f800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x13 2024-09-12T17:46:59.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.687+0000 7fb4efc0f800 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T17:46:59.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.687+0000 7fb4efc0f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:46:59.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.688+0000 7fb4efc0f800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-12T17:46:59.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.688+0000 7fb4efc0f800 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T17:46:59.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.688+0000 7fb4efc0f800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-09-12T17:46:59.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.688+0000 7fb3d0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398966 cookie 93844378203088 notifier 9219 bl.length()=727 2024-09-12T17:46:59.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.688+0000 7fb3d0ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-12T17:46:59.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.688+0000 7fb3d0ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T17:46:59.691 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-09-12T17:46:59.691 INFO:teuthology.orchestra.run.smithi037.stdout: "user_id": "foobar.client.0", 2024-09-12T17:46:59.691 INFO:teuthology.orchestra.run.smithi037.stdout: "display_name": "Mr.foobar.client.0", 2024-09-12T17:46:59.691 INFO:teuthology.orchestra.run.smithi037.stdout: "email": "foobar+test@test.test", 2024-09-12T17:46:59.691 INFO:teuthology.orchestra.run.smithi037.stdout: "suspended": 0, 2024-09-12T17:46:59.691 INFO:teuthology.orchestra.run.smithi037.stdout: "max_buckets": 1000, 2024-09-12T17:46:59.691 INFO:teuthology.orchestra.run.smithi037.stdout: "subusers": [], 2024-09-12T17:46:59.691 INFO:teuthology.orchestra.run.smithi037.stdout: "keys": [ 2024-09-12T17:46:59.691 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-12T17:46:59.691 INFO:teuthology.orchestra.run.smithi037.stdout: "user": "foobar.client.0", 2024-09-12T17:46:59.691 INFO:teuthology.orchestra.run.smithi037.stdout: "access_key": "DWSFIXIGLPTDTDDYOTHE", 2024-09-12T17:46:59.692 INFO:teuthology.orchestra.run.smithi037.stdout: "secret_key": "VNC0bhvd62tLZVn1Br0PvPr/fSfAfzgDW7GLHpchOFNQ+90JrfwXGw==", 2024-09-12T17:46:59.692 INFO:teuthology.orchestra.run.smithi037.stdout: "active": true, 2024-09-12T17:46:59.692 INFO:teuthology.orchestra.run.smithi037.stdout: "create_date": "2024-09-12T17:46:59.159660Z" 2024-09-12T17:46:59.692 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-12T17:46:59.692 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-12T17:46:59.692 INFO:teuthology.orchestra.run.smithi037.stdout: "swift_keys": [], 2024-09-12T17:46:59.692 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": [ 2024-09-12T17:46:59.692 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-12T17:46:59.692 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "oidc-provider", 2024-09-12T17:46:59.692 INFO:teuthology.orchestra.run.smithi037.stdout: "perm": "*" 2024-09-12T17:46:59.692 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-12T17:46:59.692 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-12T17:46:59.692 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "roles", 2024-09-12T17:46:59.692 INFO:teuthology.orchestra.run.smithi037.stdout: "perm": "*" 2024-09-12T17:46:59.693 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-12T17:46:59.693 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-12T17:46:59.693 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "user-policy", 2024-09-12T17:46:59.693 INFO:teuthology.orchestra.run.smithi037.stdout: "perm": "*" 2024-09-12T17:46:59.693 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-12T17:46:59.693 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-12T17:46:59.693 INFO:teuthology.orchestra.run.smithi037.stdout: "op_mask": "read, write, delete", 2024-09-12T17:46:59.693 INFO:teuthology.orchestra.run.smithi037.stdout: "default_placement": "", 2024-09-12T17:46:59.693 INFO:teuthology.orchestra.run.smithi037.stdout: "default_storage_class": "", 2024-09-12T17:46:59.693 INFO:teuthology.orchestra.run.smithi037.stdout: "placement_tags": [], 2024-09-12T17:46:59.693 INFO:teuthology.orchestra.run.smithi037.stdout: "bucket_quota": { 2024-09-12T17:46:59.693 INFO:teuthology.orchestra.run.smithi037.stdout: "enabled": false, 2024-09-12T17:46:59.693 INFO:teuthology.orchestra.run.smithi037.stdout: "check_on_raw": false, 2024-09-12T17:46:59.693 INFO:teuthology.orchestra.run.smithi037.stdout: "max_size": -1, 2024-09-12T17:46:59.694 INFO:teuthology.orchestra.run.smithi037.stdout: "max_size_kb": 0, 2024-09-12T17:46:59.694 INFO:teuthology.orchestra.run.smithi037.stdout: "max_objects": -1 2024-09-12T17:46:59.694 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-12T17:46:59.694 INFO:teuthology.orchestra.run.smithi037.stdout: "user_quota": { 2024-09-12T17:46:59.694 INFO:teuthology.orchestra.run.smithi037.stdout: "enabled": false, 2024-09-12T17:46:59.694 INFO:teuthology.orchestra.run.smithi037.stdout: "check_on_raw": false, 2024-09-12T17:46:59.694 INFO:teuthology.orchestra.run.smithi037.stdout: "max_size": -1, 2024-09-12T17:46:59.694 INFO:teuthology.orchestra.run.smithi037.stdout: "max_size_kb": 0, 2024-09-12T17:46:59.694 INFO:teuthology.orchestra.run.smithi037.stdout: "max_objects": -1 2024-09-12T17:46:59.694 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-12T17:46:59.694 INFO:teuthology.orchestra.run.smithi037.stdout: "temp_url_keys": [], 2024-09-12T17:46:59.694 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "rgw", 2024-09-12T17:46:59.694 INFO:teuthology.orchestra.run.smithi037.stdout: "mfa_ids": [ 2024-09-12T17:46:59.694 INFO:teuthology.orchestra.run.smithi037.stdout: "8032911264" 2024-09-12T17:46:59.694 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-12T17:46:59.695 INFO:teuthology.orchestra.run.smithi037.stdout: "account_id": "", 2024-09-12T17:46:59.695 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-09-12T17:46:59.695 INFO:teuthology.orchestra.run.smithi037.stdout: "create_date": "2024-09-12T17:46:59.159642Z", 2024-09-12T17:46:59.695 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-12T17:46:59.695 INFO:teuthology.orchestra.run.smithi037.stdout: "group_ids": [] 2024-09-12T17:46:59.695 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-09-12T17:46:59.695 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:46:59.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.691+0000 7fb3a3fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:46:59.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.693+0000 7fb4efc0f800 20 remove_watcher() i=0 2024-09-12T17:46:59.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.693+0000 7fb4efc0f800 2 removed watcher, disabling cache 2024-09-12T17:46:59.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.695+0000 7fb4efc0f800 20 remove_watcher() i=1 2024-09-12T17:46:59.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.696+0000 7fb4efc0f800 20 remove_watcher() i=2 2024-09-12T17:46:59.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.697+0000 7fb4efc0f800 20 remove_watcher() i=3 2024-09-12T17:46:59.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.698+0000 7fb4efc0f800 20 remove_watcher() i=4 2024-09-12T17:46:59.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.699+0000 7fb4efc0f800 20 remove_watcher() i=5 2024-09-12T17:46:59.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.700+0000 7fb4efc0f800 20 remove_watcher() i=6 2024-09-12T17:46:59.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.701+0000 7fb4efc0f800 20 remove_watcher() i=7 2024-09-12T17:46:59.713 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph account create --account-id RGW88888888888888888 --account-name Mr.RGW88888888888888888 --email RGW88888888888888888+test@test.test 2024-09-12T17:46:59.776 INFO:teuthology.orchestra.run.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:46:59.776 INFO:teuthology.orchestra.run.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:46:59.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.811+0000 7f0301a98800 20 rados->read ofs=0 len=0 2024-09-12T17:46:59.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.812+0000 7f0301a98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:59.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.812+0000 7f0301a98800 20 realm 2024-09-12T17:46:59.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.812+0000 7f0301a98800 20 rados->read ofs=0 len=0 2024-09-12T17:46:59.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.813+0000 7f0301a98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:59.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.813+0000 7f0301a98800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:46:59.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.813+0000 7f0301a98800 20 rados->read ofs=0 len=0 2024-09-12T17:46:59.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.813+0000 7f0301a98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:46:59.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.813+0000 7f0301a98800 20 rados->read ofs=0 len=0 2024-09-12T17:46:59.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.814+0000 7f0301a98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:46:59.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.814+0000 7f0301a98800 20 rados->read ofs=0 len=0 2024-09-12T17:46:59.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.814+0000 7f0301a98800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:46:59.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.814+0000 7f0301a98800 20 searching for the correct realm 2024-09-12T17:46:59.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.817+0000 7f02fed81640 0 -- 172.21.15.37:0/1941350822 >> [v2:172.21.15.37:6816/2964054205,v1:172.21.15.37:6817/2964054205] conn(0x5652dafcfd00 msgr2=0x5652dafd2190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:46:59.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:46:59.821+0000 7f02ff582640 0 -- 172.21.15.37:0/1941350822 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x5652dafcfd00 msgr2=0x7f01c808c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:47:00.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.030+0000 7f0301a98800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:47:00.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.030+0000 7f0301a98800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:47:00.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.030+0000 7f0301a98800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:47:00.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.030+0000 7f0301a98800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:47:00.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.030+0000 7f0301a98800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:47:00.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.030+0000 7f0301a98800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:47:00.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.030+0000 7f0301a98800 20 rados->read ofs=0 len=0 2024-09-12T17:47:00.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.030+0000 7f0301a98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:00.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.030+0000 7f0301a98800 20 rados->read ofs=0 len=0 2024-09-12T17:47:00.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.030+0000 7f0301a98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:47:00.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.030+0000 7f0301a98800 20 rados->read ofs=0 len=0 2024-09-12T17:47:00.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.031+0000 7f0301a98800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:47:00.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.031+0000 7f0301a98800 20 zone default found 2024-09-12T17:47:00.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.031+0000 7f0301a98800 4 Realm: () 2024-09-12T17:47:00.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.031+0000 7f0301a98800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:47:00.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.031+0000 7f0301a98800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:47:00.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.031+0000 7f0301a98800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:47:00.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.031+0000 7f0301a98800 20 zonegroup default 2024-09-12T17:47:00.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.031+0000 7f0301a98800 20 rados->read ofs=0 len=0 2024-09-12T17:47:00.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.031+0000 7f0301a98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:00.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.031+0000 7f0301a98800 20 rados->read ofs=0 len=0 2024-09-12T17:47:00.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.032+0000 7f0301a98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:00.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.032+0000 7f0301a98800 20 rados->read ofs=0 len=0 2024-09-12T17:47:00.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.032+0000 7f0301a98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:00.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.032+0000 7f0301a98800 20 started sync module instance, tier type = 2024-09-12T17:47:00.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.032+0000 7f0301a98800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:47:00.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.043+0000 7f0301a98800 20 add_watcher() i=0 2024-09-12T17:47:00.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.043+0000 7f0301a98800 20 add_watcher() i=1 2024-09-12T17:47:00.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.043+0000 7f0301a98800 20 add_watcher() i=2 2024-09-12T17:47:00.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.043+0000 7f0301a98800 20 add_watcher() i=3 2024-09-12T17:47:00.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.043+0000 7f0301a98800 20 add_watcher() i=4 2024-09-12T17:47:00.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.043+0000 7f0301a98800 20 add_watcher() i=5 2024-09-12T17:47:00.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.043+0000 7f0301a98800 20 add_watcher() i=6 2024-09-12T17:47:00.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.044+0000 7f0301a98800 20 add_watcher() i=7 2024-09-12T17:47:00.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.044+0000 7f0301a98800 2 all 8 watchers are set, enabling cache 2024-09-12T17:47:00.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.045+0000 7f01b5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:47:00.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.045+0000 7f0301a98800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:47:00.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.045+0000 7f0301a98800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:47:00.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.045+0000 7f0301a98800 5 note: GC not initialized 2024-09-12T17:47:00.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.046+0000 7f01b4fe1640 20 reqs_thread_entry: start 2024-09-12T17:47:00.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.046+0000 7f0301a98800 20 init_complete bucket index max shards: 11 2024-09-12T17:47:00.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.046+0000 7f0301a98800 20 Filter name: none 2024-09-12T17:47:00.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.046+0000 7f012e7fc640 20 reqs_thread_entry: start 2024-09-12T17:47:00.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.046+0000 7f0301a98800 10 cache get: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 : miss 2024-09-12T17:47:00.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.046+0000 7f0301a98800 20 rados->read ofs=0 len=0 2024-09-12T17:47:00.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.046+0000 7f0301a98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:00.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.046+0000 7f0301a98800 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 info.flags=0x0 2024-09-12T17:47:00.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.046+0000 7f0301a98800 10 adding default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 to cache LRU end 2024-09-12T17:47:00.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.046+0000 7f0301a98800 20 failed to read name.$Mr.RGW88888888888888888 with: (2) No such file or directory 2024-09-12T17:47:00.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.046+0000 7f0301a98800 10 cache get: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test : miss 2024-09-12T17:47:00.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.046+0000 7f0301a98800 20 rados->read ofs=0 len=0 2024-09-12T17:47:00.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.047+0000 7f0301a98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:00.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.047+0000 7f0301a98800 10 cache put: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test info.flags=0x0 2024-09-12T17:47:00.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.047+0000 7f0301a98800 10 adding default.rgw.meta+users.email+rgw88888888888888888+test@test.test to cache LRU end 2024-09-12T17:47:00.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.047+0000 7f0301a98800 20 failed to read rgw88888888888888888+test@test.test with: (2) No such file or directory 2024-09-12T17:47:00.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.048+0000 7f0301a98800 10 cache put: name=default.rgw.meta+accounts+account.RGW88888888888888888 info.flags=0x17 2024-09-12T17:47:00.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.048+0000 7f0301a98800 10 adding default.rgw.meta+accounts+account.RGW88888888888888888 to cache LRU end 2024-09-12T17:47:00.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.048+0000 7f0301a98800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:accounts:account.RGW88888888888888888, ofs0, ns] 2024-09-12T17:47:00.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.049+0000 7f01e2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398995 cookie 94913861332528 notifier 9234 bl.length()=384 2024-09-12T17:47:00.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.049+0000 7f01e2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+account.RGW88888888888888888 info.flags=0x17 2024-09-12T17:47:00.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.049+0000 7f01e2ffd640 10 rgw watcher librados: moving default.rgw.meta+accounts+account.RGW88888888888888888 to cache LRU end 2024-09-12T17:47:00.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.052+0000 7f0301a98800 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 info.flags=0x17 2024-09-12T17:47:00.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.052+0000 7f0301a98800 10 moving default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 to cache LRU end 2024-09-12T17:47:00.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.052+0000 7f0301a98800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:accounts:name.$Mr.RGW88888888888888888, ofs0, ns] 2024-09-12T17:47:00.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.053+0000 7f01e2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399101 cookie 94913861342960 notifier 9234 bl.length()=225 2024-09-12T17:47:00.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.053+0000 7f01e2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 info.flags=0x17 2024-09-12T17:47:00.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.053+0000 7f01e2ffd640 10 rgw watcher librados: moving default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 to cache LRU end 2024-09-12T17:47:00.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.055+0000 7f0301a98800 10 cache put: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test info.flags=0x17 2024-09-12T17:47:00.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.055+0000 7f0301a98800 10 moving default.rgw.meta+users.email+rgw88888888888888888+test@test.test to cache LRU end 2024-09-12T17:47:00.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.055+0000 7f0301a98800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:rgw88888888888888888+test@test.test, ofs0, ns] 2024-09-12T17:47:00.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.056+0000 7f01e27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398927 cookie 94913861341904 notifier 9234 bl.length()=234 2024-09-12T17:47:00.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.056+0000 7f01e27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test info.flags=0x17 2024-09-12T17:47:00.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.056+0000 7f01e27fc640 10 rgw watcher librados: moving default.rgw.meta+users.email+rgw88888888888888888+test@test.test to cache LRU end 2024-09-12T17:47:00.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.058+0000 7f01b5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:47:00.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.061+0000 7f0301a98800 20 remove_watcher() i=0 2024-09-12T17:47:00.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.061+0000 7f0301a98800 2 removed watcher, disabling cache 2024-09-12T17:47:00.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.062+0000 7f0301a98800 20 remove_watcher() i=1 2024-09-12T17:47:00.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.063+0000 7f0301a98800 20 remove_watcher() i=2 2024-09-12T17:47:00.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.064+0000 7f0301a98800 20 remove_watcher() i=3 2024-09-12T17:47:00.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.065+0000 7f0301a98800 20 remove_watcher() i=4 2024-09-12T17:47:00.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.066+0000 7f0301a98800 20 remove_watcher() i=5 2024-09-12T17:47:00.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.067+0000 7f0301a98800 20 remove_watcher() i=6 2024-09-12T17:47:00.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.068+0000 7f0301a98800 20 remove_watcher() i=7 2024-09-12T17:47:00.079 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-09-12T17:47:00.079 INFO:teuthology.orchestra.run.smithi037.stdout: "id": "RGW88888888888888888", 2024-09-12T17:47:00.079 INFO:teuthology.orchestra.run.smithi037.stdout: "tenant": "", 2024-09-12T17:47:00.079 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "Mr.RGW88888888888888888", 2024-09-12T17:47:00.079 INFO:teuthology.orchestra.run.smithi037.stdout: "email": "RGW88888888888888888+test@test.test", 2024-09-12T17:47:00.079 INFO:teuthology.orchestra.run.smithi037.stdout: "quota": { 2024-09-12T17:47:00.079 INFO:teuthology.orchestra.run.smithi037.stdout: "enabled": false, 2024-09-12T17:47:00.080 INFO:teuthology.orchestra.run.smithi037.stdout: "check_on_raw": false, 2024-09-12T17:47:00.080 INFO:teuthology.orchestra.run.smithi037.stdout: "max_size": -1, 2024-09-12T17:47:00.080 INFO:teuthology.orchestra.run.smithi037.stdout: "max_size_kb": 0, 2024-09-12T17:47:00.080 INFO:teuthology.orchestra.run.smithi037.stdout: "max_objects": -1 2024-09-12T17:47:00.080 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-12T17:47:00.080 INFO:teuthology.orchestra.run.smithi037.stdout: "bucket_quota": { 2024-09-12T17:47:00.080 INFO:teuthology.orchestra.run.smithi037.stdout: "enabled": false, 2024-09-12T17:47:00.080 INFO:teuthology.orchestra.run.smithi037.stdout: "check_on_raw": false, 2024-09-12T17:47:00.080 INFO:teuthology.orchestra.run.smithi037.stdout: "max_size": -1, 2024-09-12T17:47:00.080 INFO:teuthology.orchestra.run.smithi037.stdout: "max_size_kb": 0, 2024-09-12T17:47:00.080 INFO:teuthology.orchestra.run.smithi037.stdout: "max_objects": -1 2024-09-12T17:47:00.080 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-12T17:47:00.080 INFO:teuthology.orchestra.run.smithi037.stdout: "max_users": 1000, 2024-09-12T17:47:00.080 INFO:teuthology.orchestra.run.smithi037.stdout: "max_roles": 1000, 2024-09-12T17:47:00.080 INFO:teuthology.orchestra.run.smithi037.stdout: "max_groups": 1000, 2024-09-12T17:47:00.081 INFO:teuthology.orchestra.run.smithi037.stdout: "max_buckets": 1000, 2024-09-12T17:47:00.081 INFO:teuthology.orchestra.run.smithi037.stdout: "max_access_keys": 4 2024-09-12T17:47:00.081 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-09-12T17:47:00.082 DEBUG:tasks.s3tests:Creating user RGW88888888888888888 on client.0 2024-09-12T17:47:00.082 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid root1.client.0 --display-name Mr.RGW88888888888888888 --email root1+test@test.test --access-key UTKLYSKKNPLTLJIKNKMD --secret G8iU8p6tqrotizng71WPiLmX7vENabBXZ2JZ8D638sr9qVcKv/XrxA== --cluster ceph --account-id RGW88888888888888888 --account-root 2024-09-12T17:47:00.152 INFO:teuthology.orchestra.run.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:47:00.152 INFO:teuthology.orchestra.run.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:47:00.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.187+0000 7f704ea13800 20 rados->read ofs=0 len=0 2024-09-12T17:47:00.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.189+0000 7f704ea13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:00.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.189+0000 7f704ea13800 20 realm 2024-09-12T17:47:00.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.189+0000 7f704ea13800 20 rados->read ofs=0 len=0 2024-09-12T17:47:00.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.189+0000 7f704ea13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:00.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.189+0000 7f704ea13800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:47:00.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.189+0000 7f704ea13800 20 rados->read ofs=0 len=0 2024-09-12T17:47:00.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.189+0000 7f704ea13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:00.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.189+0000 7f704ea13800 20 rados->read ofs=0 len=0 2024-09-12T17:47:00.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.190+0000 7f704ea13800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:47:00.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.190+0000 7f704ea13800 20 rados->read ofs=0 len=0 2024-09-12T17:47:00.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.191+0000 7f704ea13800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:47:00.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.191+0000 7f704ea13800 20 searching for the correct realm 2024-09-12T17:47:00.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.194+0000 7f704a949640 0 -- 172.21.15.37:0/1011346246 >> [v2:172.21.15.40:6818/1210108009,v1:172.21.15.40:6819/1210108009] conn(0x7f70400ac8d0 msgr2=0x7f70400ad8f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:47:00.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.197+0000 7f704a148640 0 -- 172.21.15.37:0/1011346246 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7f70400b53c0 msgr2=0x7f70400ad8f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:47:00.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.405+0000 7f704ea13800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:47:00.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.405+0000 7f704ea13800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:47:00.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.405+0000 7f704ea13800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:47:00.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.405+0000 7f704ea13800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:47:00.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.405+0000 7f704ea13800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:47:00.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.405+0000 7f704ea13800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:47:00.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.405+0000 7f704ea13800 20 rados->read ofs=0 len=0 2024-09-12T17:47:00.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.405+0000 7f704ea13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:00.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.405+0000 7f704ea13800 20 rados->read ofs=0 len=0 2024-09-12T17:47:00.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.406+0000 7f704ea13800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:47:00.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.406+0000 7f704ea13800 20 rados->read ofs=0 len=0 2024-09-12T17:47:00.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.406+0000 7f704ea13800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:47:00.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.406+0000 7f704ea13800 20 zone default found 2024-09-12T17:47:00.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.406+0000 7f704ea13800 4 Realm: () 2024-09-12T17:47:00.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.406+0000 7f704ea13800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:47:00.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.406+0000 7f704ea13800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:47:00.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.406+0000 7f704ea13800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:47:00.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.406+0000 7f704ea13800 20 zonegroup default 2024-09-12T17:47:00.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.406+0000 7f704ea13800 20 rados->read ofs=0 len=0 2024-09-12T17:47:00.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.406+0000 7f704ea13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:00.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.406+0000 7f704ea13800 20 rados->read ofs=0 len=0 2024-09-12T17:47:00.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.407+0000 7f704ea13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:00.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.407+0000 7f704ea13800 20 rados->read ofs=0 len=0 2024-09-12T17:47:00.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.407+0000 7f704ea13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:00.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.407+0000 7f704ea13800 20 started sync module instance, tier type = 2024-09-12T17:47:00.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.407+0000 7f704ea13800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:47:00.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.418+0000 7f704ea13800 20 add_watcher() i=0 2024-09-12T17:47:00.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.418+0000 7f704ea13800 20 add_watcher() i=1 2024-09-12T17:47:00.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.418+0000 7f704ea13800 20 add_watcher() i=2 2024-09-12T17:47:00.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.418+0000 7f704ea13800 20 add_watcher() i=3 2024-09-12T17:47:00.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.418+0000 7f704ea13800 20 add_watcher() i=4 2024-09-12T17:47:00.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.418+0000 7f704ea13800 20 add_watcher() i=5 2024-09-12T17:47:00.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.418+0000 7f704ea13800 20 add_watcher() i=6 2024-09-12T17:47:00.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.418+0000 7f704ea13800 20 add_watcher() i=7 2024-09-12T17:47:00.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.418+0000 7f704ea13800 2 all 8 watchers are set, enabling cache 2024-09-12T17:47:00.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.420+0000 7f6f00fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:47:00.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.420+0000 7f704ea13800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:47:00.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.420+0000 7f704ea13800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:47:00.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.421+0000 7f704ea13800 5 note: GC not initialized 2024-09-12T17:47:00.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.421+0000 7f6e7b7fe640 20 reqs_thread_entry: start 2024-09-12T17:47:00.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.421+0000 7f704ea13800 20 init_complete bucket index max shards: 11 2024-09-12T17:47:00.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.421+0000 7f704ea13800 20 Filter name: none 2024-09-12T17:47:00.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.421+0000 7f6e797fa640 20 reqs_thread_entry: start 2024-09-12T17:47:00.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.421+0000 7f704ea13800 10 cache get: name=default.rgw.meta+users.uid+root1.client.0 : miss 2024-09-12T17:47:00.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.421+0000 7f704ea13800 20 rados->read ofs=0 len=0 2024-09-12T17:47:00.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.421+0000 7f704ea13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:00.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.421+0000 7f704ea13800 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x0 2024-09-12T17:47:00.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.421+0000 7f704ea13800 10 adding default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-12T17:47:00.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.421+0000 7f704ea13800 10 cache get: name=default.rgw.meta+users.email+root1+test@test.test : miss 2024-09-12T17:47:00.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.421+0000 7f704ea13800 20 rados->read ofs=0 len=0 2024-09-12T17:47:00.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.422+0000 7f704ea13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:00.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.422+0000 7f704ea13800 10 cache put: name=default.rgw.meta+users.email+root1+test@test.test info.flags=0x0 2024-09-12T17:47:00.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.422+0000 7f704ea13800 10 adding default.rgw.meta+users.email+root1+test@test.test to cache LRU end 2024-09-12T17:47:00.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.422+0000 7f704ea13800 10 cache get: name=default.rgw.meta+users.keys+UTKLYSKKNPLTLJIKNKMD : miss 2024-09-12T17:47:00.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.422+0000 7f704ea13800 20 rados->read ofs=0 len=0 2024-09-12T17:47:00.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.422+0000 7f704ea13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:00.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.422+0000 7f704ea13800 10 cache put: name=default.rgw.meta+users.keys+UTKLYSKKNPLTLJIKNKMD info.flags=0x0 2024-09-12T17:47:00.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.422+0000 7f704ea13800 10 adding default.rgw.meta+users.keys+UTKLYSKKNPLTLJIKNKMD to cache LRU end 2024-09-12T17:47:00.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.422+0000 7f704ea13800 10 cache get: name=default.rgw.meta+accounts+account.RGW88888888888888888 : miss 2024-09-12T17:47:00.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.422+0000 7f704ea13800 20 rados->read ofs=0 len=0 2024-09-12T17:47:00.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.423+0000 7f704ea13800 20 rados_obj.operate() r=0 bl.length=184 2024-09-12T17:47:00.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.423+0000 7f704ea13800 10 cache put: name=default.rgw.meta+accounts+account.RGW88888888888888888 info.flags=0x17 2024-09-12T17:47:00.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.423+0000 7f704ea13800 10 adding default.rgw.meta+accounts+account.RGW88888888888888888 to cache LRU end 2024-09-12T17:47:00.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.423+0000 7f704ea13800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:47:00.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.423+0000 7f704ea13800 10 cache get: name=default.rgw.meta+users.keys+UTKLYSKKNPLTLJIKNKMD : hit (negative entry) 2024-09-12T17:47:00.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.423+0000 7f704ea13800 10 cache get: name=default.rgw.meta+users.keys+UTKLYSKKNPLTLJIKNKMD : hit (negative entry) 2024-09-12T17:47:00.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.425+0000 7f704ea13800 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-12T17:47:00.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.425+0000 7f704ea13800 10 moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-12T17:47:00.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.425+0000 7f704ea13800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root1.client.0, ofs0, ns] 2024-09-12T17:47:00.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.425+0000 7f6f2dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398996 cookie 94841095966192 notifier 8597 bl.length()=681 2024-09-12T17:47:00.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.425+0000 7f6f2dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-12T17:47:00.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.425+0000 7f6f2dffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-12T17:47:00.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.428+0000 7f704ea13800 10 cache put: name=default.rgw.meta+users.email+root1+test@test.test info.flags=0x7 2024-09-12T17:47:00.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.428+0000 7f704ea13800 10 moving default.rgw.meta+users.email+root1+test@test.test to cache LRU end 2024-09-12T17:47:00.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.428+0000 7f704ea13800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.email:root1+test@test.test, ofs0, ns] 2024-09-12T17:47:00.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.428+0000 7f6f2dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399021 cookie 94841095976528 notifier 8597 bl.length()=189 2024-09-12T17:47:00.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.428+0000 7f6f2dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+root1+test@test.test info.flags=0x7 2024-09-12T17:47:00.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.428+0000 7f6f2dffb640 10 rgw watcher librados: moving default.rgw.meta+users.email+root1+test@test.test to cache LRU end 2024-09-12T17:47:00.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.431+0000 7f704ea13800 10 cache put: name=default.rgw.meta+users.keys+UTKLYSKKNPLTLJIKNKMD info.flags=0x7 2024-09-12T17:47:00.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.431+0000 7f704ea13800 10 moving default.rgw.meta+users.keys+UTKLYSKKNPLTLJIKNKMD to cache LRU end 2024-09-12T17:47:00.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.431+0000 7f704ea13800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.keys:UTKLYSKKNPLTLJIKNKMD, ofs0, ns] 2024-09-12T17:47:00.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.431+0000 7f6f2d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398928 cookie 94841095970096 notifier 8597 bl.length()=188 2024-09-12T17:47:00.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.431+0000 7f6f2d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+UTKLYSKKNPLTLJIKNKMD info.flags=0x7 2024-09-12T17:47:00.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.431+0000 7f6f2d7fa640 10 rgw watcher librados: moving default.rgw.meta+users.keys+UTKLYSKKNPLTLJIKNKMD to cache LRU end 2024-09-12T17:47:00.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.434+0000 7f704ea13800 20 linked user root1.client.0 to account RGW88888888888888888 2024-09-12T17:47:00.435 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-09-12T17:47:00.435 INFO:teuthology.orchestra.run.smithi037.stdout: "user_id": "root1.client.0", 2024-09-12T17:47:00.435 INFO:teuthology.orchestra.run.smithi037.stdout: "display_name": "Mr.RGW88888888888888888", 2024-09-12T17:47:00.435 INFO:teuthology.orchestra.run.smithi037.stdout: "email": "root1+test@test.test", 2024-09-12T17:47:00.435 INFO:teuthology.orchestra.run.smithi037.stdout: "suspended": 0, 2024-09-12T17:47:00.436 INFO:teuthology.orchestra.run.smithi037.stdout: "max_buckets": 1000, 2024-09-12T17:47:00.436 INFO:teuthology.orchestra.run.smithi037.stdout: "subusers": [], 2024-09-12T17:47:00.436 INFO:teuthology.orchestra.run.smithi037.stdout: "keys": [ 2024-09-12T17:47:00.436 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-12T17:47:00.436 INFO:teuthology.orchestra.run.smithi037.stdout: "user": "root1.client.0", 2024-09-12T17:47:00.436 INFO:teuthology.orchestra.run.smithi037.stdout: "access_key": "UTKLYSKKNPLTLJIKNKMD", 2024-09-12T17:47:00.436 INFO:teuthology.orchestra.run.smithi037.stdout: "secret_key": "G8iU8p6tqrotizng71WPiLmX7vENabBXZ2JZ8D638sr9qVcKv/XrxA==", 2024-09-12T17:47:00.436 INFO:teuthology.orchestra.run.smithi037.stdout: "active": true, 2024-09-12T17:47:00.436 INFO:teuthology.orchestra.run.smithi037.stdout: "create_date": "2024-09-12T17:47:00.424350Z" 2024-09-12T17:47:00.436 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-12T17:47:00.436 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-12T17:47:00.436 INFO:teuthology.orchestra.run.smithi037.stdout: "swift_keys": [], 2024-09-12T17:47:00.437 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": [], 2024-09-12T17:47:00.437 INFO:teuthology.orchestra.run.smithi037.stdout: "op_mask": "read, write, delete", 2024-09-12T17:47:00.437 INFO:teuthology.orchestra.run.smithi037.stdout: "default_placement": "", 2024-09-12T17:47:00.437 INFO:teuthology.orchestra.run.smithi037.stdout: "default_storage_class": "", 2024-09-12T17:47:00.437 INFO:teuthology.orchestra.run.smithi037.stdout: "placement_tags": [], 2024-09-12T17:47:00.437 INFO:teuthology.orchestra.run.smithi037.stdout: "bucket_quota": { 2024-09-12T17:47:00.437 INFO:teuthology.orchestra.run.smithi037.stdout: "enabled": false, 2024-09-12T17:47:00.437 INFO:teuthology.orchestra.run.smithi037.stdout: "check_on_raw": false, 2024-09-12T17:47:00.437 INFO:teuthology.orchestra.run.smithi037.stdout: "max_size": -1, 2024-09-12T17:47:00.437 INFO:teuthology.orchestra.run.smithi037.stdout: "max_size_kb": 0, 2024-09-12T17:47:00.437 INFO:teuthology.orchestra.run.smithi037.stdout: "max_objects": -1 2024-09-12T17:47:00.437 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-12T17:47:00.437 INFO:teuthology.orchestra.run.smithi037.stdout: "user_quota": { 2024-09-12T17:47:00.437 INFO:teuthology.orchestra.run.smithi037.stdout: "enabled": false, 2024-09-12T17:47:00.437 INFO:teuthology.orchestra.run.smithi037.stdout: "check_on_raw": false, 2024-09-12T17:47:00.438 INFO:teuthology.orchestra.run.smithi037.stdout: "max_size": -1, 2024-09-12T17:47:00.438 INFO:teuthology.orchestra.run.smithi037.stdout: "max_size_kb": 0, 2024-09-12T17:47:00.438 INFO:teuthology.orchestra.run.smithi037.stdout: "max_objects": -1 2024-09-12T17:47:00.438 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-12T17:47:00.438 INFO:teuthology.orchestra.run.smithi037.stdout: "temp_url_keys": [], 2024-09-12T17:47:00.438 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "root", 2024-09-12T17:47:00.438 INFO:teuthology.orchestra.run.smithi037.stdout: "mfa_ids": [], 2024-09-12T17:47:00.438 INFO:teuthology.orchestra.run.smithi037.stdout: "account_id": "RGW88888888888888888", 2024-09-12T17:47:00.438 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-09-12T17:47:00.438 INFO:teuthology.orchestra.run.smithi037.stdout: "create_date": "2024-09-12T17:47:00.424320Z", 2024-09-12T17:47:00.438 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-12T17:47:00.438 INFO:teuthology.orchestra.run.smithi037.stdout: "group_ids": [] 2024-09-12T17:47:00.438 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-09-12T17:47:00.438 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:47:00.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.435+0000 7f6f00fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:47:00.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.438+0000 7f704ea13800 20 remove_watcher() i=0 2024-09-12T17:47:00.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.438+0000 7f704ea13800 2 removed watcher, disabling cache 2024-09-12T17:47:00.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.439+0000 7f704ea13800 20 remove_watcher() i=1 2024-09-12T17:47:00.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.440+0000 7f704ea13800 20 remove_watcher() i=2 2024-09-12T17:47:00.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.442+0000 7f704ea13800 20 remove_watcher() i=3 2024-09-12T17:47:00.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.443+0000 7f704ea13800 20 remove_watcher() i=4 2024-09-12T17:47:00.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.444+0000 7f704ea13800 20 remove_watcher() i=5 2024-09-12T17:47:00.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.445+0000 7f704ea13800 20 remove_watcher() i=6 2024-09-12T17:47:00.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.446+0000 7f704ea13800 20 remove_watcher() i=7 2024-09-12T17:47:00.458 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid root1.client.0 --totp-serial 7027173742 --totp-seed KGSRHFPEYLEBLW3XGBVEZJZ65IZESY6DD7DPBPNT7Y3NOUYAZIDTFFILJ7X6IKVL --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-12T17:47:00.526 INFO:teuthology.orchestra.run.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:47:00.526 INFO:teuthology.orchestra.run.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:47:00.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.563+0000 7f11d2d46800 20 rados->read ofs=0 len=0 2024-09-12T17:47:00.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.564+0000 7f11d2d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:00.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.564+0000 7f11d2d46800 20 realm 2024-09-12T17:47:00.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.564+0000 7f11d2d46800 20 rados->read ofs=0 len=0 2024-09-12T17:47:00.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.565+0000 7f11d2d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:00.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.565+0000 7f11d2d46800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:47:00.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.565+0000 7f11d2d46800 20 rados->read ofs=0 len=0 2024-09-12T17:47:00.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.565+0000 7f11d2d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:00.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.565+0000 7f11d2d46800 20 rados->read ofs=0 len=0 2024-09-12T17:47:00.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.566+0000 7f11d2d46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:47:00.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.566+0000 7f11d2d46800 20 rados->read ofs=0 len=0 2024-09-12T17:47:00.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.566+0000 7f11d2d46800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:47:00.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.566+0000 7f11d2d46800 20 searching for the correct realm 2024-09-12T17:47:00.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.569+0000 7f11c8036640 0 -- 172.21.15.37:0/341018558 >> [v2:172.21.15.40:6800/2441293461,v1:172.21.15.40:6801/2441293461] conn(0x7f11c003e060 msgr2=0x7f11c00674d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:47:00.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.777+0000 7f11d0837640 0 -- 172.21.15.37:0/341018558 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7f11b8097500 msgr2=0x7f11b805c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:47:00.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.985+0000 7f11d2d46800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:47:00.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.985+0000 7f11d2d46800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:47:00.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.985+0000 7f11d2d46800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:47:00.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.985+0000 7f11d2d46800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:47:00.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.985+0000 7f11d2d46800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:47:00.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.985+0000 7f11d2d46800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:47:00.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.985+0000 7f11d2d46800 20 rados->read ofs=0 len=0 2024-09-12T17:47:00.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.985+0000 7f11d2d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:00.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.985+0000 7f11d2d46800 20 rados->read ofs=0 len=0 2024-09-12T17:47:00.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.985+0000 7f11d2d46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:47:00.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.985+0000 7f11d2d46800 20 rados->read ofs=0 len=0 2024-09-12T17:47:00.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.986+0000 7f11d2d46800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:47:00.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.986+0000 7f11d2d46800 20 zone default found 2024-09-12T17:47:00.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.986+0000 7f11d2d46800 4 Realm: () 2024-09-12T17:47:00.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.986+0000 7f11d2d46800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:47:00.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.986+0000 7f11d2d46800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:47:00.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.986+0000 7f11d2d46800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:47:00.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.986+0000 7f11d2d46800 20 zonegroup default 2024-09-12T17:47:00.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.986+0000 7f11d2d46800 20 rados->read ofs=0 len=0 2024-09-12T17:47:00.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.986+0000 7f11d2d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:00.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.986+0000 7f11d2d46800 20 rados->read ofs=0 len=0 2024-09-12T17:47:00.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.987+0000 7f11d2d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:00.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.987+0000 7f11d2d46800 20 rados->read ofs=0 len=0 2024-09-12T17:47:00.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.987+0000 7f11d2d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:00.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.987+0000 7f11d2d46800 20 started sync module instance, tier type = 2024-09-12T17:47:00.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.987+0000 7f11d2d46800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:47:01.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.998+0000 7f11d2d46800 20 add_watcher() i=0 2024-09-12T17:47:01.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.998+0000 7f11d2d46800 20 add_watcher() i=1 2024-09-12T17:47:01.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.998+0000 7f11d2d46800 20 add_watcher() i=2 2024-09-12T17:47:01.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.998+0000 7f11d2d46800 20 add_watcher() i=3 2024-09-12T17:47:01.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.998+0000 7f11d2d46800 20 add_watcher() i=4 2024-09-12T17:47:01.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.998+0000 7f11d2d46800 20 add_watcher() i=5 2024-09-12T17:47:01.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.998+0000 7f11d2d46800 20 add_watcher() i=6 2024-09-12T17:47:01.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.999+0000 7f11d2d46800 20 add_watcher() i=7 2024-09-12T17:47:01.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:00.999+0000 7f11d2d46800 2 all 8 watchers are set, enabling cache 2024-09-12T17:47:01.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.001+0000 7f10877e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:47:01.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.001+0000 7f11d2d46800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:47:01.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.001+0000 7f11d2d46800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:47:01.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.001+0000 7f11d2d46800 5 note: GC not initialized 2024-09-12T17:47:01.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.001+0000 7f10867e4640 20 reqs_thread_entry: start 2024-09-12T17:47:01.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.001+0000 7f11d2d46800 20 init_complete bucket index max shards: 11 2024-09-12T17:47:01.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.001+0000 7f11d2d46800 20 Filter name: none 2024-09-12T17:47:01.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.001+0000 7f107f7fe640 20 reqs_thread_entry: start 2024-09-12T17:47:01.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.001+0000 7f11d2d46800 10 cache get: name=default.rgw.meta+users.uid+root1.client.0 : miss 2024-09-12T17:47:01.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.001+0000 7f11d2d46800 20 rados->read ofs=0 len=0 2024-09-12T17:47:01.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.002+0000 7f11d2d46800 20 rados_obj.operate() r=0 bl.length=494 2024-09-12T17:47:01.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.002+0000 7f11d2d46800 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x13 2024-09-12T17:47:01.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.002+0000 7f11d2d46800 10 adding default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-12T17:47:01.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.002+0000 7f11d2d46800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:47:01.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.005+0000 7f11d2d46800 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-12T17:47:01.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.005+0000 7f11d2d46800 10 moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-12T17:47:01.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.005+0000 7f11d2d46800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root1.client.0, ofs0, ns] 2024-09-12T17:47:01.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.005+0000 7f10a7fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398997 cookie 94687064177968 notifier 8615 bl.length()=695 2024-09-12T17:47:01.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.005+0000 7f10a7fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-12T17:47:01.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.005+0000 7f10a7fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-12T17:47:01.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.008+0000 7f10877e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:47:01.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.011+0000 7f11d2d46800 20 remove_watcher() i=0 2024-09-12T17:47:01.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.011+0000 7f11d2d46800 2 removed watcher, disabling cache 2024-09-12T17:47:01.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.012+0000 7f11d2d46800 20 remove_watcher() i=1 2024-09-12T17:47:01.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.013+0000 7f11d2d46800 20 remove_watcher() i=2 2024-09-12T17:47:01.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.014+0000 7f11d2d46800 20 remove_watcher() i=3 2024-09-12T17:47:01.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.015+0000 7f11d2d46800 20 remove_watcher() i=4 2024-09-12T17:47:01.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.016+0000 7f11d2d46800 20 remove_watcher() i=5 2024-09-12T17:47:01.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.018+0000 7f11d2d46800 20 remove_watcher() i=6 2024-09-12T17:47:01.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.019+0000 7f11d2d46800 20 remove_watcher() i=7 2024-09-12T17:47:01.033 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph account create --account-id RGW99999999999999999 --account-name Mr.RGW99999999999999999 --email RGW99999999999999999+test@test.test 2024-09-12T17:47:01.096 INFO:teuthology.orchestra.run.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:47:01.097 INFO:teuthology.orchestra.run.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:47:01.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.131+0000 7f0fc9e98800 20 rados->read ofs=0 len=0 2024-09-12T17:47:01.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.133+0000 7f0fc9e98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:01.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.133+0000 7f0fc9e98800 20 realm 2024-09-12T17:47:01.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.133+0000 7f0fc9e98800 20 rados->read ofs=0 len=0 2024-09-12T17:47:01.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.133+0000 7f0fc9e98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:01.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.133+0000 7f0fc9e98800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:47:01.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.133+0000 7f0fc9e98800 20 rados->read ofs=0 len=0 2024-09-12T17:47:01.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.133+0000 7f0fc9e98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:01.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.133+0000 7f0fc9e98800 20 rados->read ofs=0 len=0 2024-09-12T17:47:01.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.134+0000 7f0fc9e98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:47:01.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.134+0000 7f0fc9e98800 20 rados->read ofs=0 len=0 2024-09-12T17:47:01.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.134+0000 7f0fc9e98800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:47:01.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.134+0000 7f0fc9e98800 20 searching for the correct realm 2024-09-12T17:47:01.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.137+0000 7f0fc7181640 0 -- 172.21.15.37:0/3933346091 >> [v2:172.21.15.40:6800/2441293461,v1:172.21.15.40:6801/2441293461] conn(0x7f0fb8042bb0 msgr2=0x7f0fb8048a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:47:01.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.141+0000 7f0fc7982640 0 -- 172.21.15.37:0/3933346091 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7f0fbc034040 msgr2=0x7f0fbc01c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:47:01.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.349+0000 7f0fc9e98800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:47:01.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.349+0000 7f0fc9e98800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:47:01.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.349+0000 7f0fc9e98800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:47:01.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.349+0000 7f0fc9e98800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:47:01.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.349+0000 7f0fc9e98800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:47:01.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.349+0000 7f0fc9e98800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:47:01.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.349+0000 7f0fc9e98800 20 rados->read ofs=0 len=0 2024-09-12T17:47:01.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.349+0000 7f0fc9e98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:01.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.349+0000 7f0fc9e98800 20 rados->read ofs=0 len=0 2024-09-12T17:47:01.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.349+0000 7f0fc9e98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:47:01.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.349+0000 7f0fc9e98800 20 rados->read ofs=0 len=0 2024-09-12T17:47:01.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.350+0000 7f0fc9e98800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:47:01.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.350+0000 7f0fc9e98800 20 zone default found 2024-09-12T17:47:01.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.350+0000 7f0fc9e98800 4 Realm: () 2024-09-12T17:47:01.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.350+0000 7f0fc9e98800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:47:01.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.350+0000 7f0fc9e98800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:47:01.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.350+0000 7f0fc9e98800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:47:01.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.350+0000 7f0fc9e98800 20 zonegroup default 2024-09-12T17:47:01.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.350+0000 7f0fc9e98800 20 rados->read ofs=0 len=0 2024-09-12T17:47:01.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.350+0000 7f0fc9e98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:01.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.350+0000 7f0fc9e98800 20 rados->read ofs=0 len=0 2024-09-12T17:47:01.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.351+0000 7f0fc9e98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:01.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.351+0000 7f0fc9e98800 20 rados->read ofs=0 len=0 2024-09-12T17:47:01.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.351+0000 7f0fc9e98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:01.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.351+0000 7f0fc9e98800 20 started sync module instance, tier type = 2024-09-12T17:47:01.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.351+0000 7f0fc9e98800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:47:01.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.361+0000 7f0fc9e98800 20 add_watcher() i=0 2024-09-12T17:47:01.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.361+0000 7f0fc9e98800 20 add_watcher() i=1 2024-09-12T17:47:01.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.361+0000 7f0fc9e98800 20 add_watcher() i=2 2024-09-12T17:47:01.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.361+0000 7f0fc9e98800 20 add_watcher() i=3 2024-09-12T17:47:01.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.361+0000 7f0fc9e98800 20 add_watcher() i=4 2024-09-12T17:47:01.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.361+0000 7f0fc9e98800 20 add_watcher() i=5 2024-09-12T17:47:01.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.361+0000 7f0fc9e98800 20 add_watcher() i=6 2024-09-12T17:47:01.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.362+0000 7f0fc9e98800 20 add_watcher() i=7 2024-09-12T17:47:01.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.362+0000 7f0fc9e98800 2 all 8 watchers are set, enabling cache 2024-09-12T17:47:01.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.364+0000 7f0e7dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:47:01.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.364+0000 7f0fc9e98800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:47:01.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.364+0000 7f0fc9e98800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:47:01.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.364+0000 7f0fc9e98800 5 note: GC not initialized 2024-09-12T17:47:01.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.364+0000 7f0e7cfe1640 20 reqs_thread_entry: start 2024-09-12T17:47:01.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.364+0000 7f0fc9e98800 20 init_complete bucket index max shards: 11 2024-09-12T17:47:01.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.364+0000 7f0fc9e98800 20 Filter name: none 2024-09-12T17:47:01.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.364+0000 7f0df67fc640 20 reqs_thread_entry: start 2024-09-12T17:47:01.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.364+0000 7f0fc9e98800 10 cache get: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 : miss 2024-09-12T17:47:01.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.365+0000 7f0fc9e98800 20 rados->read ofs=0 len=0 2024-09-12T17:47:01.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.365+0000 7f0fc9e98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:01.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.365+0000 7f0fc9e98800 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 info.flags=0x0 2024-09-12T17:47:01.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.365+0000 7f0fc9e98800 10 adding default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 to cache LRU end 2024-09-12T17:47:01.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.365+0000 7f0fc9e98800 20 failed to read name.$Mr.RGW99999999999999999 with: (2) No such file or directory 2024-09-12T17:47:01.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.365+0000 7f0fc9e98800 10 cache get: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test : miss 2024-09-12T17:47:01.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.365+0000 7f0fc9e98800 20 rados->read ofs=0 len=0 2024-09-12T17:47:01.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.365+0000 7f0fc9e98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:01.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.365+0000 7f0fc9e98800 10 cache put: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test info.flags=0x0 2024-09-12T17:47:01.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.365+0000 7f0fc9e98800 10 adding default.rgw.meta+users.email+rgw99999999999999999+test@test.test to cache LRU end 2024-09-12T17:47:01.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.365+0000 7f0fc9e98800 20 failed to read rgw99999999999999999+test@test.test with: (2) No such file or directory 2024-09-12T17:47:01.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.367+0000 7f0fc9e98800 10 cache put: name=default.rgw.meta+accounts+account.RGW99999999999999999 info.flags=0x17 2024-09-12T17:47:01.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.367+0000 7f0fc9e98800 10 adding default.rgw.meta+accounts+account.RGW99999999999999999 to cache LRU end 2024-09-12T17:47:01.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.367+0000 7f0fc9e98800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:accounts:account.RGW99999999999999999, ofs0, ns] 2024-09-12T17:47:01.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.367+0000 7f0ea6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398998 cookie 94134785154368 notifier 8630 bl.length()=384 2024-09-12T17:47:01.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.367+0000 7f0ea6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+account.RGW99999999999999999 info.flags=0x17 2024-09-12T17:47:01.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.367+0000 7f0ea6ffd640 10 rgw watcher librados: moving default.rgw.meta+accounts+account.RGW99999999999999999 to cache LRU end 2024-09-12T17:47:01.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.370+0000 7f0fc9e98800 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 info.flags=0x17 2024-09-12T17:47:01.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.370+0000 7f0fc9e98800 10 moving default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 to cache LRU end 2024-09-12T17:47:01.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.370+0000 7f0fc9e98800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:accounts:name.$Mr.RGW99999999999999999, ofs0, ns] 2024-09-12T17:47:01.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.370+0000 7f0ea6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399102 cookie 94134785170576 notifier 8630 bl.length()=225 2024-09-12T17:47:01.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.370+0000 7f0ea6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 info.flags=0x17 2024-09-12T17:47:01.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.370+0000 7f0ea6ffd640 10 rgw watcher librados: moving default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 to cache LRU end 2024-09-12T17:47:01.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.373+0000 7f0fc9e98800 10 cache put: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test info.flags=0x17 2024-09-12T17:47:01.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.373+0000 7f0fc9e98800 10 moving default.rgw.meta+users.email+rgw99999999999999999+test@test.test to cache LRU end 2024-09-12T17:47:01.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.373+0000 7f0fc9e98800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:rgw99999999999999999+test@test.test, ofs0, ns] 2024-09-12T17:47:01.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.374+0000 7f0ea6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398929 cookie 94134785168272 notifier 8630 bl.length()=234 2024-09-12T17:47:01.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.374+0000 7f0ea6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test info.flags=0x17 2024-09-12T17:47:01.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.374+0000 7f0ea6ffd640 10 rgw watcher librados: moving default.rgw.meta+users.email+rgw99999999999999999+test@test.test to cache LRU end 2024-09-12T17:47:01.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.376+0000 7f0e7dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:47:01.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.378+0000 7f0fc9e98800 20 remove_watcher() i=0 2024-09-12T17:47:01.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.378+0000 7f0fc9e98800 2 removed watcher, disabling cache 2024-09-12T17:47:01.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.380+0000 7f0fc9e98800 20 remove_watcher() i=1 2024-09-12T17:47:01.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.381+0000 7f0fc9e98800 20 remove_watcher() i=2 2024-09-12T17:47:01.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.382+0000 7f0fc9e98800 20 remove_watcher() i=3 2024-09-12T17:47:01.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.383+0000 7f0fc9e98800 20 remove_watcher() i=4 2024-09-12T17:47:01.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.384+0000 7f0fc9e98800 20 remove_watcher() i=5 2024-09-12T17:47:01.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.385+0000 7f0fc9e98800 20 remove_watcher() i=6 2024-09-12T17:47:01.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.386+0000 7f0fc9e98800 20 remove_watcher() i=7 2024-09-12T17:47:01.397 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-09-12T17:47:01.397 INFO:teuthology.orchestra.run.smithi037.stdout: "id": "RGW99999999999999999", 2024-09-12T17:47:01.397 INFO:teuthology.orchestra.run.smithi037.stdout: "tenant": "", 2024-09-12T17:47:01.397 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "Mr.RGW99999999999999999", 2024-09-12T17:47:01.397 INFO:teuthology.orchestra.run.smithi037.stdout: "email": "RGW99999999999999999+test@test.test", 2024-09-12T17:47:01.397 INFO:teuthology.orchestra.run.smithi037.stdout: "quota": { 2024-09-12T17:47:01.398 INFO:teuthology.orchestra.run.smithi037.stdout: "enabled": false, 2024-09-12T17:47:01.398 INFO:teuthology.orchestra.run.smithi037.stdout: "check_on_raw": false, 2024-09-12T17:47:01.398 INFO:teuthology.orchestra.run.smithi037.stdout: "max_size": -1, 2024-09-12T17:47:01.398 INFO:teuthology.orchestra.run.smithi037.stdout: "max_size_kb": 0, 2024-09-12T17:47:01.398 INFO:teuthology.orchestra.run.smithi037.stdout: "max_objects": -1 2024-09-12T17:47:01.398 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-12T17:47:01.398 INFO:teuthology.orchestra.run.smithi037.stdout: "bucket_quota": { 2024-09-12T17:47:01.398 INFO:teuthology.orchestra.run.smithi037.stdout: "enabled": false, 2024-09-12T17:47:01.398 INFO:teuthology.orchestra.run.smithi037.stdout: "check_on_raw": false, 2024-09-12T17:47:01.398 INFO:teuthology.orchestra.run.smithi037.stdout: "max_size": -1, 2024-09-12T17:47:01.398 INFO:teuthology.orchestra.run.smithi037.stdout: "max_size_kb": 0, 2024-09-12T17:47:01.398 INFO:teuthology.orchestra.run.smithi037.stdout: "max_objects": -1 2024-09-12T17:47:01.398 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-12T17:47:01.398 INFO:teuthology.orchestra.run.smithi037.stdout: "max_users": 1000, 2024-09-12T17:47:01.399 INFO:teuthology.orchestra.run.smithi037.stdout: "max_roles": 1000, 2024-09-12T17:47:01.399 INFO:teuthology.orchestra.run.smithi037.stdout: "max_groups": 1000, 2024-09-12T17:47:01.399 INFO:teuthology.orchestra.run.smithi037.stdout: "max_buckets": 1000, 2024-09-12T17:47:01.399 INFO:teuthology.orchestra.run.smithi037.stdout: "max_access_keys": 4 2024-09-12T17:47:01.399 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-09-12T17:47:01.400 DEBUG:tasks.s3tests:Creating user RGW99999999999999999 on client.0 2024-09-12T17:47:01.400 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid root2.client.0 --display-name Mr.RGW99999999999999999 --email root2+test@test.test --access-key CFKWTGGCEUYVTOYWZCNF --secret jk1kRmwySwJnCN26hYvjGW4MHzQ6gdPT0q9MRBOVz/3y55HOvbV0RA== --cluster ceph --account-id RGW99999999999999999 --account-root 2024-09-12T17:47:01.471 INFO:teuthology.orchestra.run.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:47:01.471 INFO:teuthology.orchestra.run.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:47:01.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.506+0000 7f3b11735800 20 rados->read ofs=0 len=0 2024-09-12T17:47:01.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.508+0000 7f3b11735800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:01.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.508+0000 7f3b11735800 20 realm 2024-09-12T17:47:01.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.508+0000 7f3b11735800 20 rados->read ofs=0 len=0 2024-09-12T17:47:01.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.508+0000 7f3b11735800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:01.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.508+0000 7f3b11735800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:47:01.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.508+0000 7f3b11735800 20 rados->read ofs=0 len=0 2024-09-12T17:47:01.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.508+0000 7f3b11735800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:01.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.508+0000 7f3b11735800 20 rados->read ofs=0 len=0 2024-09-12T17:47:01.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.509+0000 7f3b11735800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:47:01.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.509+0000 7f3b11735800 20 rados->read ofs=0 len=0 2024-09-12T17:47:01.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.510+0000 7f3b11735800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:47:01.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.510+0000 7f3b11735800 20 searching for the correct realm 2024-09-12T17:47:01.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.513+0000 7f3b0dce5640 0 -- 172.21.15.37:0/779872635 >> [v2:172.21.15.40:6818/1210108009,v1:172.21.15.40:6819/1210108009] conn(0x7f3b040d1c10 msgr2=0x7f3b0405c4e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:47:01.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.517+0000 7f3b0d4e4640 0 -- 172.21.15.37:0/779872635 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7f3b0405abc0 msgr2=0x7f3b040d31d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:47:01.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.724+0000 7f3b11735800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:47:01.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.724+0000 7f3b11735800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:47:01.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.724+0000 7f3b11735800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:47:01.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.724+0000 7f3b11735800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:47:01.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.724+0000 7f3b11735800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:47:01.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.724+0000 7f3b11735800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:47:01.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.724+0000 7f3b11735800 20 rados->read ofs=0 len=0 2024-09-12T17:47:01.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.724+0000 7f3b11735800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:01.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.724+0000 7f3b11735800 20 rados->read ofs=0 len=0 2024-09-12T17:47:01.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.725+0000 7f3b11735800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:47:01.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.725+0000 7f3b11735800 20 rados->read ofs=0 len=0 2024-09-12T17:47:01.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.725+0000 7f3b11735800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:47:01.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.725+0000 7f3b11735800 20 zone default found 2024-09-12T17:47:01.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.725+0000 7f3b11735800 4 Realm: () 2024-09-12T17:47:01.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.725+0000 7f3b11735800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:47:01.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.725+0000 7f3b11735800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:47:01.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.725+0000 7f3b11735800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:47:01.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.725+0000 7f3b11735800 20 zonegroup default 2024-09-12T17:47:01.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.725+0000 7f3b11735800 20 rados->read ofs=0 len=0 2024-09-12T17:47:01.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.726+0000 7f3b11735800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:01.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.726+0000 7f3b11735800 20 rados->read ofs=0 len=0 2024-09-12T17:47:01.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.726+0000 7f3b11735800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:01.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.726+0000 7f3b11735800 20 rados->read ofs=0 len=0 2024-09-12T17:47:01.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.726+0000 7f3b11735800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:01.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.726+0000 7f3b11735800 20 started sync module instance, tier type = 2024-09-12T17:47:01.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.726+0000 7f3b11735800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:47:01.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.736+0000 7f3b11735800 20 add_watcher() i=0 2024-09-12T17:47:01.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.737+0000 7f3b11735800 20 add_watcher() i=1 2024-09-12T17:47:01.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.737+0000 7f3b11735800 20 add_watcher() i=2 2024-09-12T17:47:01.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.737+0000 7f3b11735800 20 add_watcher() i=3 2024-09-12T17:47:01.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.737+0000 7f3b11735800 20 add_watcher() i=4 2024-09-12T17:47:01.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.737+0000 7f3b11735800 20 add_watcher() i=5 2024-09-12T17:47:01.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.737+0000 7f3b11735800 20 add_watcher() i=6 2024-09-12T17:47:01.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.738+0000 7f3b11735800 20 add_watcher() i=7 2024-09-12T17:47:01.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.738+0000 7f3b11735800 2 all 8 watchers are set, enabling cache 2024-09-12T17:47:01.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.739+0000 7f39c37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:47:01.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.739+0000 7f3b11735800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:47:01.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.739+0000 7f3b11735800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:47:01.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.739+0000 7f3b11735800 5 note: GC not initialized 2024-09-12T17:47:01.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.740+0000 7f39c27e4640 20 reqs_thread_entry: start 2024-09-12T17:47:01.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.740+0000 7f3b11735800 20 init_complete bucket index max shards: 11 2024-09-12T17:47:01.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.740+0000 7f3b11735800 20 Filter name: none 2024-09-12T17:47:01.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.740+0000 7f3933fff640 20 reqs_thread_entry: start 2024-09-12T17:47:01.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.740+0000 7f3b11735800 10 cache get: name=default.rgw.meta+users.uid+root2.client.0 : miss 2024-09-12T17:47:01.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.740+0000 7f3b11735800 20 rados->read ofs=0 len=0 2024-09-12T17:47:01.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.740+0000 7f3b11735800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:01.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.740+0000 7f3b11735800 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x0 2024-09-12T17:47:01.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.740+0000 7f3b11735800 10 adding default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-12T17:47:01.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.740+0000 7f3b11735800 10 cache get: name=default.rgw.meta+users.email+root2+test@test.test : miss 2024-09-12T17:47:01.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.740+0000 7f3b11735800 20 rados->read ofs=0 len=0 2024-09-12T17:47:01.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.741+0000 7f3b11735800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:01.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.741+0000 7f3b11735800 10 cache put: name=default.rgw.meta+users.email+root2+test@test.test info.flags=0x0 2024-09-12T17:47:01.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.741+0000 7f3b11735800 10 adding default.rgw.meta+users.email+root2+test@test.test to cache LRU end 2024-09-12T17:47:01.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.741+0000 7f3b11735800 10 cache get: name=default.rgw.meta+users.keys+CFKWTGGCEUYVTOYWZCNF : miss 2024-09-12T17:47:01.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.741+0000 7f3b11735800 20 rados->read ofs=0 len=0 2024-09-12T17:47:01.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.741+0000 7f3b11735800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:01.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.741+0000 7f3b11735800 10 cache put: name=default.rgw.meta+users.keys+CFKWTGGCEUYVTOYWZCNF info.flags=0x0 2024-09-12T17:47:01.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.741+0000 7f3b11735800 10 adding default.rgw.meta+users.keys+CFKWTGGCEUYVTOYWZCNF to cache LRU end 2024-09-12T17:47:01.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.741+0000 7f3b11735800 10 cache get: name=default.rgw.meta+accounts+account.RGW99999999999999999 : miss 2024-09-12T17:47:01.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.741+0000 7f3b11735800 20 rados->read ofs=0 len=0 2024-09-12T17:47:01.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.741+0000 7f3b11735800 20 rados_obj.operate() r=0 bl.length=184 2024-09-12T17:47:01.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.741+0000 7f3b11735800 10 cache put: name=default.rgw.meta+accounts+account.RGW99999999999999999 info.flags=0x17 2024-09-12T17:47:01.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.741+0000 7f3b11735800 10 adding default.rgw.meta+accounts+account.RGW99999999999999999 to cache LRU end 2024-09-12T17:47:01.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.741+0000 7f3b11735800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:47:01.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.742+0000 7f3b11735800 10 cache get: name=default.rgw.meta+users.keys+CFKWTGGCEUYVTOYWZCNF : hit (negative entry) 2024-09-12T17:47:01.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.742+0000 7f3b11735800 10 cache get: name=default.rgw.meta+users.keys+CFKWTGGCEUYVTOYWZCNF : hit (negative entry) 2024-09-12T17:47:01.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.743+0000 7f3b11735800 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-12T17:47:01.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.743+0000 7f3b11735800 10 moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-12T17:47:01.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.743+0000 7f3b11735800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root2.client.0, ofs0, ns] 2024-09-12T17:47:01.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.743+0000 7f39f0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398999 cookie 94215955752464 notifier 8648 bl.length()=681 2024-09-12T17:47:01.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.744+0000 7f39f0ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-12T17:47:01.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.744+0000 7f39f0ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-12T17:47:01.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.747+0000 7f3b11735800 10 cache put: name=default.rgw.meta+users.email+root2+test@test.test info.flags=0x7 2024-09-12T17:47:01.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.747+0000 7f3b11735800 10 moving default.rgw.meta+users.email+root2+test@test.test to cache LRU end 2024-09-12T17:47:01.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.747+0000 7f3b11735800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.email:root2+test@test.test, ofs0, ns] 2024-09-12T17:47:01.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.747+0000 7f39dffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399022 cookie 94215955770288 notifier 8648 bl.length()=189 2024-09-12T17:47:01.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.747+0000 7f39dffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+root2+test@test.test info.flags=0x7 2024-09-12T17:47:01.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.747+0000 7f39dffff640 10 rgw watcher librados: moving default.rgw.meta+users.email+root2+test@test.test to cache LRU end 2024-09-12T17:47:01.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.749+0000 7f3b11735800 10 cache put: name=default.rgw.meta+users.keys+CFKWTGGCEUYVTOYWZCNF info.flags=0x7 2024-09-12T17:47:01.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.749+0000 7f3b11735800 10 moving default.rgw.meta+users.keys+CFKWTGGCEUYVTOYWZCNF to cache LRU end 2024-09-12T17:47:01.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.749+0000 7f3b11735800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.keys:CFKWTGGCEUYVTOYWZCNF, ofs0, ns] 2024-09-12T17:47:01.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.750+0000 7f39dffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399023 cookie 94215955772560 notifier 8648 bl.length()=188 2024-09-12T17:47:01.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.750+0000 7f39dffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+CFKWTGGCEUYVTOYWZCNF info.flags=0x7 2024-09-12T17:47:01.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.750+0000 7f39dffff640 10 rgw watcher librados: moving default.rgw.meta+users.keys+CFKWTGGCEUYVTOYWZCNF to cache LRU end 2024-09-12T17:47:01.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.753+0000 7f3b11735800 20 linked user root2.client.0 to account RGW99999999999999999 2024-09-12T17:47:01.754 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-09-12T17:47:01.754 INFO:teuthology.orchestra.run.smithi037.stdout: "user_id": "root2.client.0", 2024-09-12T17:47:01.754 INFO:teuthology.orchestra.run.smithi037.stdout: "display_name": "Mr.RGW99999999999999999", 2024-09-12T17:47:01.754 INFO:teuthology.orchestra.run.smithi037.stdout: "email": "root2+test@test.test", 2024-09-12T17:47:01.754 INFO:teuthology.orchestra.run.smithi037.stdout: "suspended": 0, 2024-09-12T17:47:01.754 INFO:teuthology.orchestra.run.smithi037.stdout: "max_buckets": 1000, 2024-09-12T17:47:01.754 INFO:teuthology.orchestra.run.smithi037.stdout: "subusers": [], 2024-09-12T17:47:01.754 INFO:teuthology.orchestra.run.smithi037.stdout: "keys": [ 2024-09-12T17:47:01.754 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-12T17:47:01.754 INFO:teuthology.orchestra.run.smithi037.stdout: "user": "root2.client.0", 2024-09-12T17:47:01.754 INFO:teuthology.orchestra.run.smithi037.stdout: "access_key": "CFKWTGGCEUYVTOYWZCNF", 2024-09-12T17:47:01.755 INFO:teuthology.orchestra.run.smithi037.stdout: "secret_key": "jk1kRmwySwJnCN26hYvjGW4MHzQ6gdPT0q9MRBOVz/3y55HOvbV0RA==", 2024-09-12T17:47:01.755 INFO:teuthology.orchestra.run.smithi037.stdout: "active": true, 2024-09-12T17:47:01.755 INFO:teuthology.orchestra.run.smithi037.stdout: "create_date": "2024-09-12T17:47:01.742733Z" 2024-09-12T17:47:01.755 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-12T17:47:01.755 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-12T17:47:01.755 INFO:teuthology.orchestra.run.smithi037.stdout: "swift_keys": [], 2024-09-12T17:47:01.755 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": [], 2024-09-12T17:47:01.755 INFO:teuthology.orchestra.run.smithi037.stdout: "op_mask": "read, write, delete", 2024-09-12T17:47:01.755 INFO:teuthology.orchestra.run.smithi037.stdout: "default_placement": "", 2024-09-12T17:47:01.755 INFO:teuthology.orchestra.run.smithi037.stdout: "default_storage_class": "", 2024-09-12T17:47:01.755 INFO:teuthology.orchestra.run.smithi037.stdout: "placement_tags": [], 2024-09-12T17:47:01.755 INFO:teuthology.orchestra.run.smithi037.stdout: "bucket_quota": { 2024-09-12T17:47:01.755 INFO:teuthology.orchestra.run.smithi037.stdout: "enabled": false, 2024-09-12T17:47:01.755 INFO:teuthology.orchestra.run.smithi037.stdout: "check_on_raw": false, 2024-09-12T17:47:01.756 INFO:teuthology.orchestra.run.smithi037.stdout: "max_size": -1, 2024-09-12T17:47:01.756 INFO:teuthology.orchestra.run.smithi037.stdout: "max_size_kb": 0, 2024-09-12T17:47:01.756 INFO:teuthology.orchestra.run.smithi037.stdout: "max_objects": -1 2024-09-12T17:47:01.756 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-12T17:47:01.756 INFO:teuthology.orchestra.run.smithi037.stdout: "user_quota": { 2024-09-12T17:47:01.756 INFO:teuthology.orchestra.run.smithi037.stdout: "enabled": false, 2024-09-12T17:47:01.756 INFO:teuthology.orchestra.run.smithi037.stdout: "check_on_raw": false, 2024-09-12T17:47:01.756 INFO:teuthology.orchestra.run.smithi037.stdout: "max_size": -1, 2024-09-12T17:47:01.756 INFO:teuthology.orchestra.run.smithi037.stdout: "max_size_kb": 0, 2024-09-12T17:47:01.756 INFO:teuthology.orchestra.run.smithi037.stdout: "max_objects": -1 2024-09-12T17:47:01.756 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-12T17:47:01.756 INFO:teuthology.orchestra.run.smithi037.stdout: "temp_url_keys": [], 2024-09-12T17:47:01.756 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "root", 2024-09-12T17:47:01.756 INFO:teuthology.orchestra.run.smithi037.stdout: "mfa_ids": [], 2024-09-12T17:47:01.756 INFO:teuthology.orchestra.run.smithi037.stdout: "account_id": "RGW99999999999999999", 2024-09-12T17:47:01.757 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-09-12T17:47:01.757 INFO:teuthology.orchestra.run.smithi037.stdout: "create_date": "2024-09-12T17:47:01.742720Z", 2024-09-12T17:47:01.757 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-12T17:47:01.757 INFO:teuthology.orchestra.run.smithi037.stdout: "group_ids": [] 2024-09-12T17:47:01.757 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-09-12T17:47:01.757 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:47:01.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.753+0000 7f39c37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:47:01.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.756+0000 7f3b11735800 20 remove_watcher() i=0 2024-09-12T17:47:01.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.756+0000 7f3b11735800 2 removed watcher, disabling cache 2024-09-12T17:47:01.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.757+0000 7f3b11735800 20 remove_watcher() i=1 2024-09-12T17:47:01.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.758+0000 7f3b11735800 20 remove_watcher() i=2 2024-09-12T17:47:01.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.760+0000 7f3b11735800 20 remove_watcher() i=3 2024-09-12T17:47:01.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.761+0000 7f3b11735800 20 remove_watcher() i=4 2024-09-12T17:47:01.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.762+0000 7f3b11735800 20 remove_watcher() i=5 2024-09-12T17:47:01.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.763+0000 7f3b11735800 20 remove_watcher() i=6 2024-09-12T17:47:01.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.764+0000 7f3b11735800 20 remove_watcher() i=7 2024-09-12T17:47:01.777 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid root2.client.0 --totp-serial 6229387875 --totp-seed B2TFYO3YMNL2T2FKNBRJCECLUTMEERPLLP2JE4ICRXDPHUIYKZQGRRODS376UTDK --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-12T17:47:01.845 INFO:teuthology.orchestra.run.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:47:01.845 INFO:teuthology.orchestra.run.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:47:01.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.880+0000 7f8a6292e800 20 rados->read ofs=0 len=0 2024-09-12T17:47:01.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.882+0000 7f8a6292e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:01.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.882+0000 7f8a6292e800 20 realm 2024-09-12T17:47:01.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.882+0000 7f8a6292e800 20 rados->read ofs=0 len=0 2024-09-12T17:47:01.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.882+0000 7f8a6292e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:01.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.882+0000 7f8a6292e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:47:01.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.882+0000 7f8a6292e800 20 rados->read ofs=0 len=0 2024-09-12T17:47:01.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.882+0000 7f8a6292e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:01.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.882+0000 7f8a6292e800 20 rados->read ofs=0 len=0 2024-09-12T17:47:01.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.883+0000 7f8a6292e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:47:01.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.883+0000 7f8a6292e800 20 rados->read ofs=0 len=0 2024-09-12T17:47:01.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.884+0000 7f8a6292e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:47:01.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.884+0000 7f8a6292e800 20 searching for the correct realm 2024-09-12T17:47:01.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.888+0000 7f8a5eede640 0 -- 172.21.15.37:0/4215035740 >> [v2:172.21.15.40:6818/1210108009,v1:172.21.15.40:6819/1210108009] conn(0x7f8a540b44e0 msgr2=0x7f8a540b4980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:47:01.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.892+0000 7f8a5e6dd640 0 -- 172.21.15.37:0/4215035740 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7f8a540bf2c0 msgr2=0x7f8a540bf820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:47:01.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.896+0000 7f8a6292e800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T17:47:01.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.896+0000 7f8a6292e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:47:01.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.896+0000 7f8a6292e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:47:01.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.896+0000 7f8a6292e800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T17:47:01.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.896+0000 7f8a6292e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:47:01.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.896+0000 7f8a6292e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:47:01.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.896+0000 7f8a6292e800 20 rados->read ofs=0 len=0 2024-09-12T17:47:01.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.897+0000 7f8a6292e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:01.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.897+0000 7f8a6292e800 20 rados->read ofs=0 len=0 2024-09-12T17:47:01.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.897+0000 7f8a6292e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:47:01.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.897+0000 7f8a6292e800 20 rados->read ofs=0 len=0 2024-09-12T17:47:01.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.897+0000 7f8a6292e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:47:01.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.897+0000 7f8a6292e800 20 zone default found 2024-09-12T17:47:01.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.897+0000 7f8a6292e800 4 Realm: () 2024-09-12T17:47:01.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.897+0000 7f8a6292e800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T17:47:01.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.897+0000 7f8a6292e800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T17:47:01.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.897+0000 7f8a6292e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:47:01.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.897+0000 7f8a6292e800 20 zonegroup default 2024-09-12T17:47:01.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.897+0000 7f8a6292e800 20 rados->read ofs=0 len=0 2024-09-12T17:47:01.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.898+0000 7f8a6292e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:01.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.898+0000 7f8a6292e800 20 rados->read ofs=0 len=0 2024-09-12T17:47:01.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.898+0000 7f8a6292e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:01.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.898+0000 7f8a6292e800 20 rados->read ofs=0 len=0 2024-09-12T17:47:01.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.898+0000 7f8a6292e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:47:01.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.898+0000 7f8a6292e800 20 started sync module instance, tier type = 2024-09-12T17:47:01.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.898+0000 7f8a6292e800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T17:47:01.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.908+0000 7f8a6292e800 20 add_watcher() i=0 2024-09-12T17:47:01.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.908+0000 7f8a6292e800 20 add_watcher() i=1 2024-09-12T17:47:01.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.908+0000 7f8a6292e800 20 add_watcher() i=2 2024-09-12T17:47:01.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.908+0000 7f8a6292e800 20 add_watcher() i=3 2024-09-12T17:47:01.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.908+0000 7f8a6292e800 20 add_watcher() i=4 2024-09-12T17:47:01.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.908+0000 7f8a6292e800 20 add_watcher() i=5 2024-09-12T17:47:01.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.908+0000 7f8a6292e800 20 add_watcher() i=6 2024-09-12T17:47:01.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.909+0000 7f8a6292e800 20 add_watcher() i=7 2024-09-12T17:47:01.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.909+0000 7f8a6292e800 2 all 8 watchers are set, enabling cache 2024-09-12T17:47:01.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.911+0000 7f8914fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:47:01.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.911+0000 7f8a6292e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:47:01.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.911+0000 7f8a6292e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:47:01.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.911+0000 7f8a6292e800 5 note: GC not initialized 2024-09-12T17:47:01.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.911+0000 7f888f7fe640 20 reqs_thread_entry: start 2024-09-12T17:47:01.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.911+0000 7f8a6292e800 20 init_complete bucket index max shards: 11 2024-09-12T17:47:01.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.911+0000 7f8a6292e800 20 Filter name: none 2024-09-12T17:47:01.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.911+0000 7f888d7fa640 20 reqs_thread_entry: start 2024-09-12T17:47:01.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.911+0000 7f8a6292e800 10 cache get: name=default.rgw.meta+users.uid+root2.client.0 : miss 2024-09-12T17:47:01.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.911+0000 7f8a6292e800 20 rados->read ofs=0 len=0 2024-09-12T17:47:01.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.912+0000 7f8a6292e800 20 rados_obj.operate() r=0 bl.length=494 2024-09-12T17:47:01.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.912+0000 7f8a6292e800 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x13 2024-09-12T17:47:01.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.912+0000 7f8a6292e800 10 adding default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-12T17:47:01.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.912+0000 7f8a6292e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:47:01.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.914+0000 7f8a6292e800 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-12T17:47:01.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.914+0000 7f8a6292e800 10 moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-12T17:47:01.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.914+0000 7f8a6292e800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root2.client.0, ofs0, ns] 2024-09-12T17:47:01.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.915+0000 7f8941ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399000 cookie 94013218200544 notifier 8666 bl.length()=695 2024-09-12T17:47:01.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.915+0000 7f8941ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-12T17:47:01.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.915+0000 7f8941ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-12T17:47:01.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.917+0000 7f8914fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:47:01.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.920+0000 7f8a6292e800 20 remove_watcher() i=0 2024-09-12T17:47:01.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.920+0000 7f8a6292e800 2 removed watcher, disabling cache 2024-09-12T17:47:01.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.921+0000 7f8a6292e800 20 remove_watcher() i=1 2024-09-12T17:47:01.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.922+0000 7f8a6292e800 20 remove_watcher() i=2 2024-09-12T17:47:01.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.923+0000 7f8a6292e800 20 remove_watcher() i=3 2024-09-12T17:47:01.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.924+0000 7f8a6292e800 20 remove_watcher() i=4 2024-09-12T17:47:01.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.925+0000 7f8a6292e800 20 remove_watcher() i=5 2024-09-12T17:47:01.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.926+0000 7f8a6292e800 20 remove_watcher() i=6 2024-09-12T17:47:01.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T17:47:01.927+0000 7f8a6292e800 20 remove_watcher() i=7 2024-09-12T17:47:01.939 INFO:tasks.s3tests:Configuring s3-tests... 2024-09-12T17:47:01.940 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-09-12T17:47:01.940 DEBUG:teuthology.orchestra.run.smithi037:> dd of=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf 2024-09-12T17:47:01.969 INFO:tasks.s3tests:Configuring boto... 2024-09-12T17:47:01.970 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-09-12T17:47:01.970 DEBUG:teuthology.orchestra.run.smithi037:> dd of=/home/ubuntu/cephtest/boto-client.0.cfg 2024-09-12T17:47:02.040 DEBUG:teuthology.orchestra.run.smithi037:s3 tests against rgw> source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/s3-tests-client.0 && S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto-client.0.cfg REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt tox -- -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3' 2024-09-12T17:47:02.224 INFO:teuthology.orchestra.run.smithi037.stdout:GLOB sdist-make: /home/ubuntu/cephtest/s3-tests-client.0/setup.py 2024-09-12T17:47:02.410 INFO:teuthology.orchestra.run.smithi037.stdout:py create: /home/ubuntu/cephtest/s3-tests-client.0/.tox/py 2024-09-12T17:47:02.687 INFO:teuthology.orchestra.run.smithi037.stdout:py installdeps: -rrequirements.txt 2024-09-12T17:48:49.259 INFO:teuthology.orchestra.run.smithi037.stdout:py inst: /home/ubuntu/cephtest/s3-tests-client.0/.tox/.tmp/package/1/s3tests-0.0.1.zip 2024-09-12T17:48:50.755 INFO:teuthology.orchestra.run.smithi037.stdout:py installed: boto==2.49.0,boto3==1.24.96,botocore==1.27.96,cachetools==5.5.0,certifi==2024.8.30,chardet==5.2.0,charset-normalizer==3.3.2,colorama==0.4.6,distlib==0.3.8,exceptiongroup==1.2.2,filelock==3.16.0,gevent==24.2.1,greenlet==3.1.0,httplib2==0.22.0,idna==3.8,iniconfig==2.0.0,isodate==0.6.1,jmespath==1.0.1,lxml==5.3.0,munch==4.0.0,packaging==24.1,platformdirs==4.3.2,pluggy==1.5.0,pyparsing==3.1.4,pyproject-api==1.7.1,pytest==8.3.3,python-dateutil==2.9.0.post0,pytz==2024.2,PyYAML==6.0.2,requests==2.32.3,s3tests @ file:///home/ubuntu/cephtest/s3-tests-client.0/.tox/.tmp/package/1/s3tests-0.0.1.zip#sha256=8ed7a5f3edb150c5f02ad03c12337a03d004b6eefa27de5ede22d9cebf6a34fa,s3transfer==0.6.2,six==1.16.0,tomli==2.0.1,tox==4.18.1,urllib3==1.26.20,virtualenv==20.26.4,zope.event==5.0,zope.interface==7.0.3 2024-09-12T17:48:50.756 INFO:teuthology.orchestra.run.smithi037.stdout:py run-test-pre: PYTHONHASHSEED='54105844' 2024-09-12T17:48:50.756 INFO:teuthology.orchestra.run.smithi037.stdout:py run-test: commands[0] | pytest -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3' 2024-09-12T17:48:50.896 INFO:teuthology.orchestra.run.smithi037.stdout:============================= test session starts ============================== 2024-09-12T17:48:50.896 INFO:teuthology.orchestra.run.smithi037.stdout:platform linux -- Python 3.9.19, pytest-8.3.3, pluggy-1.5.0 -- /home/ubuntu/cephtest/s3-tests-client.0/.tox/py/bin/python 2024-09-12T17:48:50.896 INFO:teuthology.orchestra.run.smithi037.stdout:cachedir: .tox/py/.pytest_cache 2024-09-12T17:48:50.896 INFO:teuthology.orchestra.run.smithi037.stdout:rootdir: /home/ubuntu/cephtest/s3-tests-client.0 2024-09-12T17:48:50.896 INFO:teuthology.orchestra.run.smithi037.stdout:configfile: pytest.ini 2024-09-12T17:48:52.734 INFO:teuthology.orchestra.run.smithi037.stdout:collecting ... collected 872 items / 126 deselected / 746 selected 2024-09-12T17:48:52.735 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T17:48:53.113 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_none PASSED [ 0%] 2024-09-12T17:48:53.425 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_empty PASSED [ 0%] 2024-09-12T17:48:53.807 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests/functional/test_headers.py::test_object_create_date_and_amz_date PASSED [ 0%] 2024-09-12T17:48:54.189 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests/functional/test_headers.py::test_object_create_amz_date_and_no_date PASSED [ 0%] 2024-09-12T17:48:54.498 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_none PASSED [ 0%] 2024-09-12T17:48:54.847 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests/functional/test_headers.py::test_bucket_create_contentlength_none PASSED [ 0%] 2024-09-12T17:48:55.276 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests/functional/test_headers.py::test_object_acl_create_contentlength_none PASSED [ 0%] 2024-09-12T17:48:55.579 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_contentlength_none PASSED [ 1%] 2024-09-12T17:48:55.701 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_empty PASSED [ 1%] 2024-09-12T17:48:55.822 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_none PASSED [ 1%] 2024-09-12T17:48:56.142 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_mismatch_below_aws2 PASSED [ 1%] 2024-09-12T17:48:56.463 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_incorrect_aws2 PASSED [ 1%] 2024-09-12T17:48:56.775 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_invalid_aws2 PASSED [ 1%] 2024-09-12T17:48:57.093 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_none_aws2 PASSED [ 1%] 2024-09-12T17:48:57.217 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_invalid_aws2 PASSED [ 2%] 2024-09-12T17:48:57.340 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_none_aws2 PASSED [ 2%] 2024-09-12T17:48:57.416 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests/functional/test_headers.py::test_object_create_bad_md5_invalid_garbage_aws4 SKIPPED [ 2%] 2024-09-12T17:48:57.494 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_mismatch_below_aws4 SKIPPED [ 2%] 2024-09-12T17:48:57.570 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_incorrect_aws4 SKIPPED [ 2%] 2024-09-12T17:48:57.647 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_invalid_aws4 SKIPPED [ 2%] 2024-09-12T17:48:57.725 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests/functional/test_headers.py::test_object_create_bad_ua_empty_aws4 SKIPPED [ 2%] 2024-09-12T17:48:57.802 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests/functional/test_headers.py::test_object_create_bad_ua_none_aws4 SKIPPED [ 2%] 2024-09-12T17:48:57.879 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_invalid_aws4 SKIPPED [ 3%] 2024-09-12T17:48:57.954 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_invalid_aws4 SKIPPED [ 3%] 2024-09-12T17:48:58.031 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_empty_aws4 SKIPPED [ 3%] 2024-09-12T17:48:58.108 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_empty_aws4 SKIPPED [ 3%] 2024-09-12T17:48:58.186 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_none_aws4 SKIPPED [ 3%] 2024-09-12T17:48:58.265 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_none_aws4 SKIPPED [ 3%] 2024-09-12T17:48:58.341 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_before_today_aws4 SKIPPED [ 3%] 2024-09-12T17:48:58.418 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_before_today_aws4 SKIPPED [ 4%] 2024-09-12T17:48:58.493 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_after_today_aws4 SKIPPED [ 4%] 2024-09-12T17:48:58.569 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_after_today_aws4 SKIPPED [ 4%] 2024-09-12T17:48:58.646 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_before_epoch_aws4 SKIPPED [ 4%] 2024-09-12T17:48:58.723 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_before_epoch_aws4 SKIPPED [ 4%] 2024-09-12T17:48:58.800 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_after_end_aws4 SKIPPED [ 4%] 2024-09-12T17:48:58.877 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_after_end_aws4 SKIPPED [ 4%] 2024-09-12T17:48:58.954 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests/functional/test_headers.py::test_object_create_missing_signed_custom_header_aws4 SKIPPED [ 4%] 2024-09-12T17:48:59.030 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests/functional/test_headers.py::test_object_create_missing_signed_header_aws4 SKIPPED [ 5%] 2024-09-12T17:48:59.108 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_invalid_aws4 SKIPPED [ 5%] 2024-09-12T17:48:59.184 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_ua_empty_aws4 SKIPPED [ 5%] 2024-09-12T17:48:59.260 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_ua_none_aws4 SKIPPED [ 5%] 2024-09-12T17:48:59.337 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_invalid_aws4 SKIPPED [ 5%] 2024-09-12T17:48:59.412 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_invalid_aws4 SKIPPED [ 5%] 2024-09-12T17:48:59.489 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_empty_aws4 SKIPPED [ 5%] 2024-09-12T17:48:59.566 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_empty_aws4 SKIPPED [ 6%] 2024-09-12T17:48:59.643 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_none_aws4 SKIPPED [ 6%] 2024-09-12T17:48:59.723 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_none_aws4 SKIPPED [ 6%] 2024-09-12T17:48:59.800 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_before_today_aws4 SKIPPED [ 6%] 2024-09-12T17:48:59.877 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_before_today_aws4 SKIPPED [ 6%] 2024-09-12T17:48:59.955 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_after_today_aws4 SKIPPED [ 6%] 2024-09-12T17:49:00.032 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_after_today_aws4 SKIPPED [ 6%] 2024-09-12T17:49:00.110 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_before_epoch_aws4 SKIPPED [ 6%] 2024-09-12T17:49:00.187 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_before_epoch_aws4 SKIPPED [ 7%] 2024-09-12T17:49:00.768 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests/functional/test_s3.py::test_versioning_obj_read_not_exist_null PASSED [ 7%] 2024-09-12T17:49:03.919 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests/functional/test_s3.py::test_object_storage_class PASSED [ 7%] 2024-09-12T17:49:08.849 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests/functional/test_s3.py::test_object_storage_class_multipart PASSED [ 7%] 2024-09-12T17:49:14.230 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests/functional/test_s3.py::test_object_modify_storage_class PASSED [ 7%] 2024-09-12T17:49:22.240 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests/functional/test_s3.py::test_object_modify_storage_class_multipart PASSED [ 7%] 2024-09-12T17:49:25.039 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests/functional/test_s3.py::test_object_storage_class_copy PASSED [ 7%] 2024-09-12T17:49:27.160 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests/functional/test_s3.py::test_object_storage_class_copy_multipart PASSED [ 8%] 2024-09-12T17:49:28.131 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests/functional/test_s3.py::test_atomic_dual_conditional_write_1mb PASSED [ 8%] 2024-09-12T17:49:28.399 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests/functional/test_s3.py::test_atomic_write_bucket_gone PASSED [ 8%] 2024-09-12T17:49:28.799 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests/functional/test_s3.py::test_encryption_sse_c_multipart_invalid_chunks_1 PASSED [ 8%] 2024-09-12T17:49:29.222 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests/functional/test_s3.py::test_encryption_sse_c_multipart_invalid_chunks_2 PASSED [ 8%] 2024-09-12T17:49:29.935 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests/functional/test_s3.py::test_bucket_policy_set_condition_operator_end_with_IfExists PASSED [ 8%] 2024-09-12T17:49:30.350 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests/functional/test_s3.py::test_bucket_policy_put_obj_request_obj_tag PASSED [ 8%] 2024-09-12T17:49:30.607 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests/functional/test_s3_website.py::test_website_nonexistant_bucket_rgw SKIPPED [ 8%] 2024-09-12T17:49:30.608 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_public_index SKIPPED [ 9%] 2024-09-12T17:49:30.609 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_public_index SKIPPED [ 9%] 2024-09-12T17:49:30.610 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty SKIPPED [ 9%] 2024-09-12T17:49:30.611 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty SKIPPED [ 9%] 2024-09-12T17:49:30.612 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index SKIPPED [ 9%] 2024-09-12T17:49:30.613 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index SKIPPED [ 9%] 2024-09-12T17:49:30.614 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_missingerrordoc SKIPPED [ 9%] 2024-09-12T17:49:30.614 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_missingerrordoc SKIPPED [ 10%] 2024-09-12T17:49:30.615 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_missingerrordoc SKIPPED [ 10%] 2024-09-12T17:49:30.616 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_missingerrordoc SKIPPED [ 10%] 2024-09-12T17:49:30.617 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_blockederrordoc SKIPPED [ 10%] 2024-09-12T17:49:30.617 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_pubilc_errordoc SKIPPED [ 10%] 2024-09-12T17:49:30.618 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_blockederrordoc SKIPPED [ 10%] 2024-09-12T17:49:30.619 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_blockederrordoc SKIPPED [ 10%] 2024-09-12T17:49:30.620 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_blockederrordoc SKIPPED [ 10%] 2024-09-12T17:49:30.621 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_gooderrordoc SKIPPED [ 11%] 2024-09-12T17:49:30.622 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_gooderrordoc SKIPPED [ 11%] 2024-09-12T17:49:30.622 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_gooderrordoc SKIPPED [ 11%] 2024-09-12T17:49:30.623 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_gooderrordoc SKIPPED [ 11%] 2024-09-12T17:49:30.624 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_base SKIPPED [ 11%] 2024-09-12T17:49:30.625 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_path SKIPPED [ 11%] 2024-09-12T17:49:30.626 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_path_upgrade SKIPPED [ 11%] 2024-09-12T17:49:30.627 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_nonwebsite SKIPPED [ 12%] 2024-09-12T17:49:30.627 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_public_relative SKIPPED [ 12%] 2024-09-12T17:49:30.628 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_public_abs SKIPPED [ 12%] 2024-09-12T17:49:30.629 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_private_relative SKIPPED [ 12%] 2024-09-12T17:49:30.630 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_private_abs SKIPPED [ 12%] 2024-09-12T17:49:30.718 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests/functional/test_s3_website.py::test_routing_generator XFAIL [ 12%] 2024-09-12T17:49:30.729 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests/functional/test_utils.py::test_generate PASSED [ 12%] 2024-09-12T17:49:31.339 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_invalid_short PASSED [ 13%] 2024-09-12T17:49:40.771 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_bad PASSED [ 13%] 2024-09-12T17:49:41.205 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_empty PASSED [ 13%] 2024-09-12T17:49:41.716 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_none PASSED [ 13%] 2024-09-12T17:49:42.236 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_mismatch PASSED [ 13%] 2024-09-12T17:49:42.755 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_empty PASSED [ 13%] 2024-09-12T17:49:43.266 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_none PASSED [ 13%] 2024-09-12T17:49:43.650 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contentlength_negative PASSED [ 13%] 2024-09-12T17:49:44.211 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_invalid PASSED [ 14%] 2024-09-12T17:49:44.682 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_empty PASSED [ 14%] 2024-09-12T17:49:45.153 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_none PASSED [ 14%] 2024-09-12T17:49:45.544 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_put_bad_canned_acl PASSED [ 14%] 2024-09-12T17:49:45.923 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_expect_mismatch PASSED [ 14%] 2024-09-12T17:49:46.292 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_expect_empty PASSED [ 14%] 2024-09-12T17:49:46.422 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_contentlength_negative PASSED [ 14%] 2024-09-12T17:49:46.848 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_invalid_garbage_aws2 PASSED [ 15%] 2024-09-12T17:49:47.346 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_ua_empty_aws2 PASSED [ 15%] 2024-09-12T17:49:47.873 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_ua_none_aws2 PASSED [ 15%] 2024-09-12T17:49:48.263 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_invalid_aws2 PASSED [ 15%] 2024-09-12T17:49:48.649 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_empty_aws2 PASSED [ 15%] 2024-09-12T17:49:49.047 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_before_today_aws2 PASSED [ 15%] 2024-09-12T17:49:49.435 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_before_epoch_aws2 PASSED [ 15%] 2024-09-12T17:49:49.826 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_after_end_aws2 PASSED [ 15%] 2024-09-12T17:49:50.191 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_ua_empty_aws2 PASSED [ 16%] 2024-09-12T17:49:50.555 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_ua_none_aws2 PASSED [ 16%] 2024-09-12T17:49:50.692 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_invalid_aws2 PASSED [ 16%] 2024-09-12T17:49:50.863 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_empty_aws2 PASSED [ 16%] 2024-09-12T17:49:51.001 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_before_today_aws2 PASSED [ 16%] 2024-09-12T17:49:51.139 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_after_today_aws2 PASSED [ 16%] 2024-09-12T17:49:51.277 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_before_epoch_aws2 PASSED [ 16%] 2024-09-12T17:49:51.648 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy PASSED [ 17%] 2024-09-12T17:49:51.798 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy_invalid_user PASSED [ 17%] 2024-09-12T17:49:51.973 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy_parameter_limit PASSED [ 17%] 2024-09-12T17:49:52.306 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_iam.py::test_put_existing_user_policy PASSED [ 17%] 2024-09-12T17:49:52.615 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_iam.py::test_list_user_policy PASSED [ 17%] 2024-09-12T17:49:52.797 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_iam.py::test_list_user_policy_invalid_user PASSED [ 17%] 2024-09-12T17:49:53.106 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy PASSED [ 17%] 2024-09-12T17:49:53.416 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy_invalid_user PASSED [ 17%] 2024-09-12T17:49:53.884 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy_from_multiple_policies PASSED [ 18%] 2024-09-12T17:49:54.150 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy PASSED [ 18%] 2024-09-12T17:49:54.456 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_invalid_user PASSED [ 18%] 2024-09-12T17:49:54.770 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_invalid_policy_name PASSED [ 18%] 2024-09-12T17:49:55.409 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_from_multiple_policies PASSED [ 18%] 2024-09-12T17:49:55.949 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_iam.py::test_allow_bucket_actions_in_user_policy PASSED [ 18%] 2024-09-12T17:49:56.462 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_iam.py::test_deny_bucket_actions_in_user_policy PASSED [ 18%] 2024-09-12T17:49:57.024 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_iam.py::test_allow_object_actions_in_user_policy PASSED [ 19%] 2024-09-12T17:49:57.746 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_iam.py::test_deny_object_actions_in_user_policy PASSED [ 19%] 2024-09-12T17:49:58.908 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_iam.py::test_allow_multipart_actions_in_user_policy PASSED [ 19%] 2024-09-12T17:50:00.709 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_iam.py::test_deny_multipart_actions_in_user_policy PASSED [ 19%] 2024-09-12T17:50:01.422 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_iam.py::test_allow_tagging_actions_in_user_policy PASSED [ 19%] 2024-09-12T17:50:02.141 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_iam.py::test_deny_tagging_actions_in_user_policy PASSED [ 19%] 2024-09-12T17:50:02.709 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_iam.py::test_verify_conflicting_user_policy_statements PASSED [ 19%] 2024-09-12T17:50:03.417 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_iam.py::test_verify_conflicting_user_policies PASSED [ 19%] 2024-09-12T17:50:03.775 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_iam.py::test_verify_allow_iam_actions PASSED [ 20%] 2024-09-12T17:50:05.027 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_create PASSED [ 20%] 2024-09-12T17:50:05.761 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_case_insensitive_name PASSED [ 20%] 2024-09-12T17:50:06.714 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_delete PASSED [ 20%] 2024-09-12T17:50:08.826 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_list PASSED [ 20%] 2024-09-12T17:50:11.701 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_list_path_prefix PASSED [ 20%] 2024-09-12T17:50:13.234 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_update_name PASSED [ 20%] 2024-09-12T17:50:14.613 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_update_path PASSED [ 21%] 2024-09-12T17:50:15.579 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_create PASSED [ 21%] 2024-09-12T17:50:16.145 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_iam.py::test_account_current_user_access_key_create PASSED [ 21%] 2024-09-12T17:50:17.353 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_update PASSED [ 21%] 2024-09-12T17:50:18.130 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_iam.py::test_account_current_user_access_key_update PASSED [ 21%] 2024-09-12T17:50:19.255 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_delete PASSED [ 21%] 2024-09-12T17:50:19.975 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_iam.py::test_account_current_user_access_key_delete PASSED [ 21%] 2024-09-12T17:50:21.535 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_list PASSED [ 21%] 2024-09-12T17:50:22.684 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_bucket_policy_allow PASSED [ 22%] 2024-09-12T17:50:24.401 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_policy PASSED [ 22%] 2024-09-12T17:50:26.078 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_policy_managed PASSED [ 22%] 2024-09-12T17:50:27.163 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_policy_allow PASSED [ 22%] 2024-09-12T17:50:28.139 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_create PASSED [ 22%] 2024-09-12T17:50:28.880 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_case_insensitive_name PASSED [ 22%] 2024-09-12T17:50:30.985 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_list PASSED [ 22%] 2024-09-12T17:50:32.477 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_update PASSED [ 23%] 2024-09-12T17:50:34.217 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_iam.py::test_account_inline_group_policy PASSED [ 23%] 2024-09-12T17:50:35.828 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_iam.py::test_account_managed_group_policy PASSED [ 23%] 2024-09-12T17:50:37.308 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_iam.py::test_account_inline_group_policy_allow PASSED [ 23%] 2024-09-12T17:50:38.800 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_iam.py::test_account_managed_group_policy_allow PASSED [ 23%] 2024-09-12T17:50:40.019 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_create PASSED [ 23%] 2024-09-12T17:50:40.791 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_case_insensitive_name PASSED [ 23%] 2024-09-12T17:50:41.706 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_delete PASSED [ 23%] 2024-09-12T17:50:43.601 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_list PASSED [ 24%] 2024-09-12T17:50:46.147 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_list_path_prefix PASSED [ 24%] 2024-09-12T17:50:47.086 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_update PASSED [ 24%] 2024-09-12T17:50:48.635 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy PASSED [ 24%] 2024-09-12T17:50:50.210 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_managed PASSED [ 24%] 2024-09-12T17:50:51.624 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_allow PASSED [ 24%] 2024-09-12T17:50:53.085 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_iam.py::test_same_account_role_policy_allow PASSED [ 24%] 2024-09-12T17:50:54.659 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_role_policy_allow PASSED [ 25%] 2024-09-12T17:50:56.093 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_allow_create_bucket PASSED [ 25%] 2024-09-12T17:50:57.489 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_allow_get_role PASSED [ 25%] 2024-09-12T17:50:58.407 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_iam.py::test_account_oidc_provider PASSED [ 25%] 2024-09-12T17:50:59.121 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_iam.py::test_verify_add_new_client_id_to_oidc PASSED [ 25%] 2024-09-12T17:50:59.820 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_iam.py::test_verify_add_existing_client_id_to_oidc PASSED [ 25%] 2024-09-12T17:51:00.579 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_iam.py::test_verify_update_thumbprintlist_of_oidc PASSED [ 25%] 2024-09-12T17:51:01.922 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_user_policy_allow_user_arn PASSED [ 26%] 2024-09-12T17:51:03.334 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_bucket_policy_allow_user_arn PASSED [ 26%] 2024-09-12T17:51:04.743 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_bucket_policy_allow_account_arn PASSED [ 26%] 2024-09-12T17:51:06.093 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_user_policy_allow_account_arn PASSED [ 26%] 2024-09-12T17:51:07.509 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_bucket_policy_allow_account_id PASSED [ 26%] 2024-09-12T17:51:08.896 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_user_policy_allow_account_id PASSED [ 26%] 2024-09-12T17:51:10.261 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_acl_user_policy_grant_user_id PASSED [ 26%] 2024-09-12T17:51:11.679 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_policy_bucket_acl_grant_user_id PASSED [ 26%] 2024-09-12T17:51:13.021 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_acl_user_policy_grant_canonical_id PASSED [ 27%] 2024-09-12T17:51:14.442 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_policy_bucket_acl_grant_canonical_id PASSED [ 27%] 2024-09-12T17:51:15.819 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_acl_user_policy_grant_account_email PASSED [ 27%] 2024-09-12T17:51:17.230 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_policy_bucket_acl_grant_account_email PASSED [ 27%] 2024-09-12T17:51:18.062 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_policy_allow_account_arn PASSED [ 27%] 2024-09-12T17:51:18.895 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_policy_allow_account_id PASSED [ 27%] 2024-09-12T17:51:19.701 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_acl_grant_canonical_id PASSED [ 27%] 2024-09-12T17:51:20.534 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_acl_grant_account_email PASSED [ 28%] 2024-09-12T17:51:21.107 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_empty PASSED [ 28%] 2024-09-12T17:51:21.976 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_distinct PASSED [ 28%] 2024-09-12T17:51:22.648 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_many PASSED [ 28%] 2024-09-12T17:51:23.299 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_many PASSED [ 28%] 2024-09-12T17:51:23.982 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_basic_key_count PASSED [ 28%] 2024-09-12T17:51:24.598 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_basic PASSED [ 28%] 2024-09-12T17:51:25.257 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_basic PASSED [ 28%] 2024-09-12T17:51:25.874 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_encoding_basic PASSED [ 29%] 2024-09-12T17:51:26.491 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_encoding_basic PASSED [ 29%] 2024-09-12T17:51:27.399 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix PASSED [ 29%] 2024-09-12T17:51:28.303 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix PASSED [ 29%] 2024-09-12T17:51:29.024 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix_ends_with_delimiter PASSED [ 29%] 2024-09-12T17:51:29.560 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix_ends_with_delimiter PASSED [ 29%] 2024-09-12T17:51:30.171 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_alt PASSED [ 29%] 2024-09-12T17:51:30.790 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_alt PASSED [ 30%] 2024-09-12T17:51:31.703 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix_underscore PASSED [ 30%] 2024-09-12T17:51:32.621 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix_underscore PASSED [ 30%] 2024-09-12T17:51:33.272 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_percentage PASSED [ 30%] 2024-09-12T17:51:33.881 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_percentage PASSED [ 30%] 2024-09-12T17:51:34.518 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_whitespace PASSED [ 30%] 2024-09-12T17:51:35.130 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_whitespace PASSED [ 30%] 2024-09-12T17:51:35.739 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_dot PASSED [ 30%] 2024-09-12T17:51:36.348 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_dot PASSED [ 31%] 2024-09-12T17:51:36.966 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_unreadable PASSED [ 31%] 2024-09-12T17:51:37.617 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_unreadable PASSED [ 31%] 2024-09-12T17:51:38.222 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_empty PASSED [ 31%] 2024-09-12T17:51:38.840 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_empty PASSED [ 31%] 2024-09-12T17:51:39.497 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_none PASSED [ 31%] 2024-09-12T17:51:40.116 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_none PASSED [ 31%] 2024-09-12T17:51:40.690 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_notempty PASSED [ 32%] 2024-09-12T17:51:41.273 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_defaultempty PASSED [ 32%] 2024-09-12T17:51:41.888 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_empty PASSED [ 32%] 2024-09-12T17:51:42.501 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_not_exist PASSED [ 32%] 2024-09-12T17:51:43.108 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_not_exist PASSED [ 32%] 2024-09-12T17:52:28.949 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_not_skip_special PASSED [ 32%] 2024-09-12T17:52:29.529 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_basic PASSED [ 32%] 2024-09-12T17:52:30.122 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_basic PASSED [ 32%] 2024-09-12T17:52:30.700 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_alt PASSED [ 33%] 2024-09-12T17:52:31.273 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_alt PASSED [ 33%] 2024-09-12T17:52:31.881 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_empty PASSED [ 33%] 2024-09-12T17:52:32.458 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_empty PASSED [ 33%] 2024-09-12T17:52:33.035 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_none PASSED [ 33%] 2024-09-12T17:52:33.612 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_none PASSED [ 33%] 2024-09-12T17:52:34.192 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_not_exist PASSED [ 33%] 2024-09-12T17:52:34.788 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_not_exist PASSED [ 34%] 2024-09-12T17:52:35.364 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_unreadable PASSED [ 34%] 2024-09-12T17:52:35.979 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_unreadable PASSED [ 34%] 2024-09-12T17:52:36.590 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_basic PASSED [ 34%] 2024-09-12T17:52:37.204 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_basic PASSED [ 34%] 2024-09-12T17:52:37.820 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_alt PASSED [ 34%] 2024-09-12T17:52:38.445 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_alt PASSED [ 34%] 2024-09-12T17:52:39.197 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_prefix_not_exist PASSED [ 34%] 2024-09-12T17:52:39.830 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_prefix_not_exist PASSED [ 35%] 2024-09-12T17:52:40.482 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_delimiter_not_exist PASSED [ 35%] 2024-09-12T17:52:41.099 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_delimiter_not_exist PASSED [ 35%] 2024-09-12T17:52:41.706 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_prefix_delimiter_not_exist PASSED [ 35%] 2024-09-12T17:52:42.318 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_prefix_delimiter_not_exist PASSED [ 35%] 2024-09-12T17:52:43.002 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_one PASSED [ 35%] 2024-09-12T17:52:43.687 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_one PASSED [ 35%] 2024-09-12T17:52:44.349 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_zero PASSED [ 36%] 2024-09-12T17:52:44.976 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_zero PASSED [ 36%] 2024-09-12T17:52:45.596 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_none PASSED [ 36%] 2024-09-12T17:52:46.211 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_none PASSED [ 36%] 2024-09-12T17:52:46.380 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_account_usage PASSED [ 36%] 2024-09-12T17:52:46.885 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_head_bucket_usage PASSED [ 36%] 2024-09-12T17:52:48.802 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_unordered PASSED [ 36%] 2024-09-12T17:52:50.696 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_unordered PASSED [ 36%] 2024-09-12T17:52:51.302 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_invalid PASSED [ 37%] 2024-09-12T17:52:51.914 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_none PASSED [ 37%] 2024-09-12T17:52:52.531 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_empty PASSED [ 37%] 2024-09-12T17:52:53.148 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_continuationtoken_empty PASSED [ 37%] 2024-09-12T17:52:53.874 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_continuationtoken PASSED [ 37%] 2024-09-12T17:52:54.579 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_both_continuationtoken_startafter PASSED [ 37%] 2024-09-12T17:52:55.207 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_unreadable PASSED [ 37%] 2024-09-12T17:52:55.828 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_unreadable PASSED [ 38%] 2024-09-12T17:52:56.448 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_not_in_list PASSED [ 38%] 2024-09-12T17:52:57.065 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_not_in_list PASSED [ 38%] 2024-09-12T17:52:57.692 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_after_list PASSED [ 38%] 2024-09-12T17:52:58.335 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_after_list PASSED [ 38%] 2024-09-12T17:52:59.202 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_return_data PASSED [ 38%] 2024-09-12T17:53:00.360 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_return_data_versioning PASSED [ 38%] 2024-09-12T17:53:00.789 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_objects_anonymous PASSED [ 39%] 2024-09-12T17:53:01.228 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_objects_anonymous PASSED [ 39%] 2024-09-12T17:53:01.621 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_objects_anonymous_fail PASSED [ 39%] 2024-09-12T17:53:02.007 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_objects_anonymous_fail PASSED [ 39%] 2024-09-12T17:53:02.191 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_notexist PASSED [ 39%] 2024-09-12T17:53:02.337 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_notexist PASSED [ 39%] 2024-09-12T17:53:02.479 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_delete_notexist PASSED [ 39%] 2024-09-12T17:53:03.209 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_delete_nonempty PASSED [ 39%] 2024-09-12T17:53:04.846 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_concurrent_set_canned_acl PASSED [ 40%] 2024-09-12T17:53:04.993 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_to_nonexist_bucket PASSED [ 40%] 2024-09-12T17:53:05.481 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_with_chunked_transfer_encoding PASSED [ 40%] 2024-09-12T17:53:05.846 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_delete PASSED [ 40%] 2024-09-12T17:53:06.289 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_object_read_not_exist PASSED [ 40%] 2024-09-12T17:53:06.695 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_object_requestid_matches_header_on_error PASSED [ 40%] 2024-09-12T17:53:08.649 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_concurrent_multi_object_delete PASSED [ 40%] 2024-09-12T17:53:09.422 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_multi_object_delete PASSED [ 41%] 2024-09-12T17:53:10.214 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_multi_objectv2_delete PASSED [ 41%] 2024-09-12T17:53:57.194 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_multi_object_delete_key_limit PASSED [ 41%] 2024-09-12T17:54:43.910 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_multi_objectv2_delete_key_limit PASSED [ 41%] 2024-09-12T17:54:44.402 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_object_head_zero_bytes PASSED [ 41%] 2024-09-12T17:54:44.890 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_check_etag PASSED [ 41%] 2024-09-12T17:54:45.425 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_cache_control PASSED [ 41%] 2024-09-12T17:54:45.920 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_expires PASSED [ 41%] 2024-09-12T17:54:46.531 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_read_update_read_delete PASSED [ 42%] 2024-09-12T17:54:47.037 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_none_to_good PASSED [ 42%] 2024-09-12T17:54:47.540 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_none_to_empty PASSED [ 42%] 2024-09-12T17:54:48.112 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_overwrite_to_empty PASSED [ 42%] 2024-09-12T17:54:48.646 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_object_metadata_replaced_on_put PASSED [ 42%] 2024-09-12T17:54:49.180 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_file PASSED [ 42%] 2024-09-12T17:54:49.772 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_anonymous_request PASSED [ 42%] 2024-09-12T17:54:50.391 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_request PASSED [ 43%] 2024-09-12T17:54:50.931 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_no_content_type PASSED [ 43%] 2024-09-12T17:54:51.323 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_request_bad_access_key PASSED [ 43%] 2024-09-12T17:54:51.784 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_success_code PASSED [ 43%] 2024-09-12T17:54:52.252 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_invalid_success_code PASSED [ 43%] 2024-09-12T17:54:53.025 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_larger_than_chunk PASSED [ 43%] 2024-09-12T17:54:53.525 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_key_from_filename PASSED [ 43%] 2024-09-12T17:54:53.996 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_ignored_header PASSED [ 43%] 2024-09-12T17:54:54.500 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_case_insensitive_condition_fields PASSED [ 44%] 2024-09-12T17:54:54.998 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_escaped_field_values PASSED [ 44%] 2024-09-12T17:54:55.576 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_success_redirect_action PASSED [ 44%] 2024-09-12T17:54:55.973 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_signature PASSED [ 44%] 2024-09-12T17:54:56.374 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_access_key PASSED [ 44%] 2024-09-12T17:54:56.767 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_date_format PASSED [ 44%] 2024-09-12T17:54:57.158 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_no_key_specified PASSED [ 44%] 2024-09-12T17:54:57.558 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_signature PASSED [ 45%] 2024-09-12T17:54:57.954 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_policy_condition PASSED [ 45%] 2024-09-12T17:54:58.484 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_user_specified_header PASSED [ 45%] 2024-09-12T17:54:58.883 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_request_missing_policy_specified_field PASSED [ 45%] 2024-09-12T17:54:59.279 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_condition_is_case_sensitive PASSED [ 45%] 2024-09-12T17:54:59.672 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_expires_is_case_sensitive PASSED [ 45%] 2024-09-12T17:55:00.073 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_expired_policy PASSED [ 45%] 2024-09-12T17:55:00.744 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_wrong_bucket PASSED [ 45%] 2024-09-12T17:55:01.137 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_request_field_value PASSED [ 46%] 2024-09-12T17:55:01.536 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_expires_condition PASSED [ 46%] 2024-09-12T17:55:01.927 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_conditions_list PASSED [ 46%] 2024-09-12T17:55:02.364 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_limit_exceeded PASSED [ 46%] 2024-09-12T17:55:02.765 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_content_length_argument PASSED [ 46%] 2024-09-12T17:55:03.166 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_content_length_argument PASSED [ 46%] 2024-09-12T17:55:03.560 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_below_minimum PASSED [ 46%] 2024-09-12T17:55:04.949 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_rgw_chunk_size_bug PASSED [ 47%] 2024-09-12T17:55:05.361 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_empty_conditions PASSED [ 47%] 2024-09-12T17:55:05.905 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmatch_good PASSED [ 47%] 2024-09-12T17:55:06.441 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmatch_failed PASSED [ 47%] 2024-09-12T17:55:06.987 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifnonematch_good PASSED [ 47%] 2024-09-12T17:55:07.534 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifnonematch_failed PASSED [ 47%] 2024-09-12T17:55:08.080 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmodifiedsince_good PASSED [ 47%] 2024-09-12T17:55:09.624 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmodifiedsince_failed PASSED [ 47%] 2024-09-12T17:55:10.172 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifunmodifiedsince_good PASSED [ 48%] 2024-09-12T17:55:10.729 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifunmodifiedsince_failed PASSED [ 48%] 2024-09-12T17:55:11.585 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_good PASSED [ 48%] 2024-09-12T17:55:12.257 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_failed PASSED [ 48%] 2024-09-12T17:55:12.898 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_overwrite_existed_good PASSED [ 48%] 2024-09-12T17:55:13.449 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_nonexisted_failed PASSED [ 48%] 2024-09-12T17:55:14.085 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_good PASSED [ 48%] 2024-09-12T17:55:14.756 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_failed PASSED [ 49%] 2024-09-12T17:55:15.320 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_nonexisted_good PASSED [ 49%] 2024-09-12T17:55:15.991 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_overwrite_existed_failed PASSED [ 49%] 2024-09-12T17:55:16.488 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get PASSED [ 49%] 2024-09-12T17:55:16.879 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_bucket_gone PASSED [ 49%] 2024-09-12T17:55:17.269 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_object_delete_key_bucket_gone PASSED [ 49%] 2024-09-12T17:55:17.769 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_object_gone PASSED [ 49%] 2024-09-12T17:55:18.187 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head PASSED [ 50%] 2024-09-12T17:55:18.332 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head_notexist PASSED [ 50%] 2024-09-12T17:55:19.004 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head_extended PASSED [ 50%] 2024-09-12T17:55:19.490 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_bucket_acl PASSED [ 50%] 2024-09-12T17:55:19.985 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_object_acl PASSED [ 50%] 2024-09-12T17:55:22.967 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_object_put_acl_mtime PASSED [ 50%] 2024-09-12T17:55:23.464 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated PASSED [ 50%] 2024-09-12T17:55:24.003 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_response_headers PASSED [ 50%] 2024-09-12T17:55:24.501 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_bucket_acl PASSED [ 51%] 2024-09-12T17:55:25.015 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_object_acl PASSED [ 51%] 2024-09-12T17:55:25.454 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_bucket_gone PASSED [ 51%] 2024-09-12T17:55:25.965 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_object_gone PASSED [ 51%] 2024-09-12T17:55:26.493 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_not_expired PASSED [ 51%] 2024-09-12T17:55:27.031 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_not_expired_tenant PASSED [ 51%] 2024-09-12T17:55:27.519 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_range_zero PASSED [ 51%] 2024-09-12T17:55:28.041 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_max_range PASSED [ 52%] 2024-09-12T17:55:28.533 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_positive_range PASSED [ 52%] 2024-09-12T17:55:29.023 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_object_anon_put PASSED [ 52%] 2024-09-12T17:55:30.677 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_object_anon_put_write_access PASSED [ 52%] 2024-09-12T17:55:31.153 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_object_put_authenticated PASSED [ 52%] 2024-09-12T17:55:31.663 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_object_presigned_put_object_with_acl PASSED [ 52%] 2024-09-12T17:55:32.165 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_object_presigned_put_object_with_acl_tenant PASSED [ 52%] 2024-09-12T17:55:32.652 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_put_authenticated_expired PASSED [ 52%] 2024-09-12T17:55:32.800 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_starts_nonalpha PASSED [ 53%] 2024-09-12T17:55:32.982 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_short_one PASSED [ 53%] 2024-09-12T17:55:33.127 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_short_two PASSED [ 53%] 2024-09-12T17:55:33.502 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_60 PASSED [ 53%] 2024-09-12T17:55:33.875 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_61 PASSED [ 53%] 2024-09-12T17:55:34.248 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_62 PASSED [ 53%] 2024-09-12T17:55:34.619 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_63 PASSED [ 53%] 2024-09-12T17:55:35.063 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_long_name PASSED [ 54%] 2024-09-12T17:55:35.210 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_ip PASSED [ 54%] 2024-09-12T17:55:35.355 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_underscore PASSED [ 54%] 2024-09-12T17:55:35.767 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_long PASSED [ 54%] 2024-09-12T17:55:35.949 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dash_at_end PASSED [ 54%] 2024-09-12T17:55:36.101 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dot_dot PASSED [ 54%] 2024-09-12T17:55:36.248 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dot_dash PASSED [ 54%] 2024-09-12T17:55:36.395 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dash_dot PASSED [ 54%] 2024-09-12T17:55:36.830 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_exists PASSED [ 55%] 2024-09-12T17:55:37.266 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_get_location PASSED [ 55%] 2024-09-12T17:55:37.665 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_exists_nonowner PASSED [ 55%] 2024-09-12T17:55:38.100 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_overwrite_acl PASSED [ 55%] 2024-09-12T17:55:38.540 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_new_acl PASSED [ 55%] 2024-09-12T17:55:38.972 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_default PASSED [ 55%] 2024-09-12T17:55:39.399 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_during_create PASSED [ 55%] 2024-09-12T17:55:39.916 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned PASSED [ 56%] 2024-09-12T17:55:40.346 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_publicreadwrite PASSED [ 56%] 2024-09-12T17:55:40.798 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_authenticatedread PASSED [ 56%] 2024-09-12T17:55:41.337 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_default PASSED [ 56%] 2024-09-12T17:55:41.873 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_during_create PASSED [ 56%] 2024-09-12T17:55:42.506 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned PASSED [ 56%] 2024-09-12T17:55:43.296 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_publicreadwrite PASSED [ 56%] 2024-09-12T17:55:43.848 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_authenticatedread PASSED [ 56%] 2024-09-12T17:55:44.479 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_bucketownerread PASSED [ 57%] 2024-09-12T17:55:45.087 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_bucketownerfullcontrol PASSED [ 57%] 2024-09-12T17:55:45.719 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_full_control_verify_owner PASSED [ 57%] 2024-09-12T17:55:46.305 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_full_control_verify_attributes PASSED [ 57%] 2024-09-12T17:55:46.719 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_private_to_private PASSED [ 57%] 2024-09-12T17:55:47.362 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl PASSED [ 57%] 2024-09-12T17:55:47.998 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_write PASSED [ 57%] 2024-09-12T17:55:48.632 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_writeacp PASSED [ 58%] 2024-09-12T17:55:49.271 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_read PASSED [ 58%] 2024-09-12T17:55:49.948 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_readacp PASSED [ 58%] 2024-09-12T17:55:50.671 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_fullcontrol PASSED [ 58%] 2024-09-12T17:55:51.273 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_read PASSED [ 58%] 2024-09-12T17:55:51.870 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_readacp PASSED [ 58%] 2024-09-12T17:55:52.529 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_write PASSED [ 58%] 2024-09-12T17:55:53.134 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_writeacp PASSED [ 58%] 2024-09-12T17:55:53.607 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_nonexist_user PASSED [ 59%] 2024-09-12T17:55:54.156 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_object_header_acl_grants PASSED [ 59%] 2024-09-12T17:55:54.722 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_header_acl_grants PASSED [ 59%] 2024-09-12T17:55:55.225 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_email PASSED [ 59%] 2024-09-12T17:55:55.673 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_email_not_exist PASSED [ 59%] 2024-09-12T17:55:56.326 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_revoke_all PASSED [ 59%] 2024-09-12T17:55:57.170 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_private PASSED [ 59%] 2024-09-12T17:55:58.042 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_private PASSED [ 60%] 2024-09-12T17:55:58.875 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_publicread PASSED [ 60%] 2024-09-12T17:55:59.703 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_publicread PASSED [ 60%] 2024-09-12T17:56:00.559 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_publicreadwrite PASSED [ 60%] 2024-09-12T17:56:01.395 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_publicreadwrite PASSED [ 60%] 2024-09-12T17:56:02.304 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_private PASSED [ 60%] 2024-09-12T17:56:03.146 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_publicread PASSED [ 60%] 2024-09-12T17:56:03.987 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_publicreadwrite PASSED [ 60%] 2024-09-12T17:56:04.835 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_private PASSED [ 61%] 2024-09-12T17:56:05.717 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_publicread PASSED [ 61%] 2024-09-12T17:56:06.571 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_publicreadwrite PASSED [ 61%] 2024-09-12T17:56:08.053 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_buckets_create_then_list PASSED [ 61%] 2024-09-12T17:56:09.465 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_buckets_list_ctime PASSED [ 61%] 2024-09-12T17:56:09.599 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_anonymous PASSED [ 61%] 2024-09-12T17:56:09.741 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_invalid_auth PASSED [ 61%] 2024-09-12T17:56:09.892 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_bad_auth PASSED [ 62%] 2024-09-12T17:56:10.314 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_starts_alpha PASSED [ 62%] 2024-09-12T17:56:10.753 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_starts_digit PASSED [ 62%] 2024-09-12T17:56:11.124 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_contains_period PASSED [ 62%] 2024-09-12T17:56:11.492 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_contains_hyphen PASSED [ 62%] 2024-09-12T17:56:12.165 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_not_overriding PASSED [ 62%] 2024-09-12T17:56:14.253 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_special_key_names PASSED [ 62%] 2024-09-12T17:56:14.974 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_special_prefix PASSED [ 63%] 2024-09-12T17:56:15.647 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_zero_size PASSED [ 63%] 2024-09-12T17:56:18.321 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_16m PASSED [ 63%] 2024-09-12T17:56:18.960 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_same_bucket PASSED [ 63%] 2024-09-12T17:56:19.604 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_verify_contenttype PASSED [ 63%] 2024-09-12T17:56:20.215 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_to_itself PASSED [ 63%] 2024-09-12T17:56:20.818 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_to_itself_with_metadata PASSED [ 63%] 2024-09-12T17:56:21.768 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_diff_bucket PASSED [ 63%] 2024-09-12T17:56:22.522 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_not_owned_bucket PASSED [ 64%] 2024-09-12T17:56:23.237 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_not_owned_object_bucket PASSED [ 64%] 2024-09-12T17:56:23.933 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_canned_acl PASSED [ 64%] 2024-09-12T17:56:25.296 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_retaining_metadata PASSED [ 64%] 2024-09-12T17:56:26.518 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_replacing_metadata PASSED [ 64%] 2024-09-12T17:56:26.918 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_bucket_not_found PASSED [ 64%] 2024-09-12T17:56:27.318 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_key_not_found PASSED [ 64%] 2024-09-12T17:56:29.393 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioned_bucket PASSED [ 65%] 2024-09-12T17:56:30.139 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioned_url_encoding PASSED [ 65%] 2024-09-12T17:56:38.018 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioning_multipart_upload PASSED [ 65%] 2024-09-12T17:56:38.465 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_empty PASSED [ 65%] 2024-09-12T17:56:39.114 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_small PASSED [ 65%] 2024-09-12T17:56:41.213 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_small PASSED [ 65%] 2024-09-12T17:56:41.824 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_invalid_range PASSED [ 65%] 2024-09-12T17:56:42.987 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_without_range PASSED [ 65%] 2024-09-12T17:56:49.846 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_special_names PASSED [ 66%] 2024-09-12T17:56:59.030 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload PASSED [ 66%] 2024-09-12T17:57:15.336 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_versioned PASSED [ 66%] 2024-09-12T17:58:06.409 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_resend_part PASSED [ 66%] 2024-09-12T17:58:13.846 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_multiple_sizes PASSED [ 66%] 2024-09-12T17:58:26.668 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_multiple_sizes PASSED [ 66%] 2024-09-12T17:58:27.647 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_size_too_small PASSED [ 66%] 2024-09-12T17:58:31.090 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_contents PASSED [ 67%] 2024-09-12T17:58:34.726 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_overwrite_existing_object PASSED [ 67%] 2024-09-12T17:58:36.721 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_abort_multipart_upload PASSED [ 67%] 2024-09-12T17:58:37.264 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_abort_multipart_upload_not_found PASSED [ 67%] 2024-09-12T17:58:40.118 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_list_multipart_upload PASSED [ 67%] 2024-09-12T17:58:40.822 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_list_multipart_upload_owner PASSED [ 67%] 2024-09-12T17:58:41.374 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_missing_part PASSED [ 67%] 2024-09-12T17:58:41.938 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_incorrect_etag PASSED [ 67%] 2024-09-12T17:58:58.874 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_get_part PASSED [ 68%] 2024-09-12T17:59:01.765 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_single_get_part PASSED [ 68%] 2024-09-12T17:59:02.378 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_non_multipart_get_part PASSED [ 68%] 2024-09-12T17:59:02.804 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_100_continue PASSED [ 68%] 2024-09-12T17:59:03.418 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_set_cors PASSED [ 68%] 2024-09-12T17:59:07.386 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_cors_origin_response PASSED [ 68%] 2024-09-12T17:59:10.896 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_cors_origin_wildcard PASSED [ 68%] 2024-09-12T17:59:14.358 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_cors_header_option PASSED [ 69%] 2024-09-12T17:59:14.898 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_get_object PASSED [ 69%] 2024-09-12T17:59:15.429 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_get_object_tenant PASSED [ 69%] 2024-09-12T17:59:16.028 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object PASSED [ 69%] 2024-09-12T17:59:16.570 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_with_acl PASSED [ 69%] 2024-09-12T17:59:17.104 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_tenant PASSED [ 69%] 2024-09-12T17:59:17.638 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_tenant_with_acl PASSED [ 69%] 2024-09-12T17:59:18.212 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_set_bucket_tagging PASSED [ 69%] 2024-09-12T17:59:19.125 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_1mb PASSED [ 70%] 2024-09-12T17:59:21.139 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_4mb PASSED [ 70%] 2024-09-12T17:59:24.146 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_8mb PASSED [ 70%] 2024-09-12T17:59:25.293 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_1mb PASSED [ 70%] 2024-09-12T17:59:27.361 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_4mb PASSED [ 70%] 2024-09-12T17:59:30.815 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_8mb PASSED [ 70%] 2024-09-12T17:59:32.043 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_1mb PASSED [ 70%] 2024-09-12T17:59:34.773 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_4mb PASSED [ 71%] 2024-09-12T17:59:39.627 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_8mb PASSED [ 71%] 2024-09-12T17:59:40.674 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_conditional_write_1mb PASSED [ 71%] 2024-09-12T17:59:41.388 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_multipart_upload_write PASSED [ 71%] 2024-09-12T17:59:42.373 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_resend_first_finishes_last PASSED [ 71%] 2024-09-12T17:59:42.916 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_response_code PASSED [ 71%] 2024-09-12T17:59:48.726 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_big_request_response_code PASSED [ 71%] 2024-09-12T17:59:49.310 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_skip_leading_bytes_response_code PASSED [ 71%] 2024-09-12T17:59:49.853 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_return_trailing_bytes_response_code PASSED [ 72%] 2024-09-12T17:59:50.392 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_invalid_range PASSED [ 72%] 2024-09-12T17:59:50.932 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_empty_object PASSED [ 72%] 2024-09-12T17:59:51.714 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_create_suspend PASSED [ 72%] 2024-09-12T18:00:02.987 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_read_remove PASSED [ 72%] 2024-09-12T18:00:04.049 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_read_remove_head PASSED [ 72%] 2024-09-12T18:00:04.799 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_removal PASSED [ 72%] 2024-09-12T18:00:05.751 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_overwrite PASSED [ 73%] 2024-09-12T18:00:06.731 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_overwrite_suspended PASSED [ 73%] 2024-09-12T18:00:11.388 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_suspend_versions PASSED [ 73%] 2024-09-12T18:00:12.368 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_suspended_copy PASSED [ 73%] 2024-09-12T18:00:17.960 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_versions_remove_all PASSED [ 73%] 2024-09-12T18:00:39.060 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_versions_remove_special_names PASSED [ 73%] 2024-09-12T18:00:52.407 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_overwrite_multipart PASSED [ 73%] 2024-09-12T18:00:54.610 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_list_marker PASSED [ 73%] 2024-09-12T18:00:56.815 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_copy_obj_version PASSED [ 74%] 2024-09-12T18:00:57.688 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete PASSED [ 74%] 2024-09-12T18:00:58.608 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete_with_marker PASSED [ 74%] 2024-09-12T18:00:59.256 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete_with_marker_create PASSED [ 74%] 2024-09-12T18:01:00.357 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_object_acl PASSED [ 74%] 2024-09-12T18:01:01.269 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_object_acl_no_version_specified PASSED [ 74%] 2024-09-12T18:01:02.960 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_concurrent_object_create_and_remove PASSED [ 74%] 2024-09-12T18:01:03.436 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set PASSED [ 75%] 2024-09-12T18:01:03.929 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_get PASSED [ 75%] 2024-09-12T18:01:04.413 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_get_no_id PASSED [ 75%] 2024-09-12T18:01:04.813 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_id_too_long PASSED [ 75%] 2024-09-12T18:01:05.209 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_same_id PASSED [ 75%] 2024-09-12T18:01:05.726 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_invalid_status PASSED [ 75%] 2024-09-12T18:01:06.151 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_date PASSED [ 75%] 2024-09-12T18:01:06.558 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_invalid_date PASSED [ 76%] 2024-09-12T18:01:07.147 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_noncurrent PASSED [ 76%] 2024-09-12T18:01:07.570 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_deletemarker PASSED [ 76%] 2024-09-12T18:01:08.002 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_filter PASSED [ 76%] 2024-09-12T18:01:08.417 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_empty_filter PASSED [ 76%] 2024-09-12T18:01:08.838 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_multipart PASSED [ 76%] 2024-09-12T18:01:09.252 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_transition_set_invalid_date PASSED [ 76%] 2024-09-12T18:01:09.810 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1b PASSED [ 76%] 2024-09-12T18:01:10.371 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1kb PASSED [ 77%] 2024-09-12T18:01:11.233 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1MB PASSED [ 77%] 2024-09-12T18:01:11.778 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_13b PASSED [ 77%] 2024-09-12T18:01:12.367 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_method_head PASSED [ 77%] 2024-09-12T18:01:12.912 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_present PASSED [ 77%] 2024-09-12T18:01:13.463 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_other_key PASSED [ 77%] 2024-09-12T18:01:13.901 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_invalid_md5 PASSED [ 77%] 2024-09-12T18:01:14.349 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_no_md5 PASSED [ 78%] 2024-09-12T18:01:14.796 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_no_key PASSED [ 78%] 2024-09-12T18:01:15.279 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_key_no_sse_c PASSED [ 78%] 2024-09-12T18:01:44.535 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_multipart_upload PASSED [ 78%] 2024-09-12T18:02:13.507 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_unaligned_multipart_upload PASSED [ 78%] 2024-09-12T18:02:21.347 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_multipart_bad_download PASSED [ 78%] 2024-09-12T18:02:21.862 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_post_object_authenticated_request PASSED [ 78%] 2024-09-12T18:03:23.157 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_enforced_with_bucket_policy PASSED [ 78%] 2024-09-12T18:04:24.359 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_deny_algo_with_bucket_policy PASSED [ 79%] 2024-09-12T18:04:24.945 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_method_head PASSED [ 79%] 2024-09-12T18:04:25.561 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_present PASSED [ 79%] 2024-09-12T18:04:26.008 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_no_key PASSED [ 79%] 2024-09-12T18:04:26.410 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_not_declared PASSED [ 79%] 2024-09-12T18:04:46.461 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_upload PASSED [ 79%] 2024-09-12T18:04:53.249 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_invalid_chunks_1 PASSED [ 79%] 2024-09-12T18:05:00.003 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_invalid_chunks_2 PASSED [ 80%] 2024-09-12T18:05:00.512 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_post_object_authenticated_request PASSED [ 80%] 2024-09-12T18:05:01.059 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1b PASSED [ 80%] 2024-09-12T18:05:01.647 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1kb PASSED [ 80%] 2024-09-12T18:05:02.499 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1MB PASSED [ 80%] 2024-09-12T18:05:03.054 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_13b PASSED [ 80%] 2024-09-12T18:05:03.600 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_read_declare PASSED [ 80%] 2024-09-12T18:05:04.157 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy PASSED [ 80%] 2024-09-12T18:05:04.709 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy PASSED [ 81%] 2024-09-12T18:05:05.333 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_acl PASSED [ 81%] 2024-09-12T18:05:06.001 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy_acl PASSED [ 81%] 2024-09-12T18:05:06.556 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_different_tenant PASSED [ 81%] 2024-09-12T18:05:07.106 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_tenanted_bucket PASSED [ 81%] 2024-09-12T18:05:08.159 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_another_bucket PASSED [ 81%] 2024-09-12T18:05:09.179 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy_another_bucket PASSED [ 81%] 2024-09-12T18:05:10.660 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_get_obj_tagging PASSED [ 82%] 2024-09-12T18:05:12.045 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_get_obj_head_tagging PASSED [ 82%] 2024-09-12T18:05:13.646 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_put_max_tags PASSED [ 82%] 2024-09-12T18:05:15.064 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_tags PASSED [ 82%] 2024-09-12T18:05:16.501 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_put_max_kvsize_tags PASSED [ 82%] 2024-09-12T18:05:17.962 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_key_tags PASSED [ 82%] 2024-09-12T18:05:19.385 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_val_tags PASSED [ 82%] 2024-09-12T18:05:21.451 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_put_modify_tags PASSED [ 82%] 2024-09-12T18:05:23.579 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_put_delete_tags PASSED [ 83%] 2024-09-12T18:05:24.173 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_tags_anonymous_request PASSED [ 83%] 2024-09-12T18:05:24.715 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_tags_authenticated_request PASSED [ 83%] 2024-09-12T18:05:25.385 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_with_tags PASSED [ 83%] 2024-09-12T18:05:26.922 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_get_tags_acl_public PASSED [ 83%] 2024-09-12T18:05:28.400 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_put_tags_acl_public PASSED [ 83%] 2024-09-12T18:05:30.005 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_delete_tags_obj_public PASSED [ 83%] 2024-09-12T18:05:31.447 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_atomic_upload_return_version_id PASSED [ 84%] 2024-09-12T18:05:49.923 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_multipart_upload_return_version_id PASSED [ 84%] 2024-09-12T18:05:50.754 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_existing_tag PASSED [ 84%] 2024-09-12T18:05:51.692 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_tagging_existing_tag PASSED [ 84%] 2024-09-12T18:05:52.582 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_tagging_existing_tag PASSED [ 84%] 2024-09-12T18:05:53.896 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_copy_source PASSED [ 84%] 2024-09-12T18:05:54.988 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_copy_source_meta PASSED [ 84%] 2024-09-12T18:05:55.614 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_acl PASSED [ 84%] 2024-09-12T18:05:56.639 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_grant PASSED [ 85%] 2024-09-12T18:05:57.041 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_c_s3 PASSED [ 85%] 2024-09-12T18:05:57.439 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_c_kms PASSED [ 85%] 2024-09-12T18:05:57.833 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_s3_kms PASSED [ 85%] 2024-09-12T18:05:58.234 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_bad_enc_kms PASSED [ 85%] 2024-09-12T18:05:58.837 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_kms_noenc PASSED [ 85%] 2024-09-12T18:05:59.307 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_kms_s3 PASSED [ 85%] 2024-09-12T18:06:00.281 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_acl_existing_tag PASSED [ 86%] 2024-09-12T18:06:00.788 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock PASSED [ 86%] 2024-09-12T18:06:01.224 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_bucket PASSED [ 86%] 2024-09-12T18:06:01.668 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_with_days_and_years PASSED [ 86%] 2024-09-12T18:06:02.110 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_days PASSED [ 86%] 2024-09-12T18:06:02.549 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_years PASSED [ 86%] 2024-09-12T18:06:03.047 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_mode PASSED [ 86%] 2024-09-12T18:06:03.481 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_status PASSED [ 86%] 2024-09-12T18:06:03.959 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_suspend_versioning PASSED [ 87%] 2024-09-12T18:06:04.466 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_lock PASSED [ 87%] 2024-09-12T18:06:04.902 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_lock_invalid_bucket PASSED [ 87%] 2024-09-12T18:06:05.508 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention PASSED [ 87%] 2024-09-12T18:06:06.049 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_invalid_bucket PASSED [ 87%] 2024-09-12T18:06:06.673 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_invalid_mode PASSED [ 87%] 2024-09-12T18:06:07.259 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention PASSED [ 87%] 2024-09-12T18:06:07.816 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention_iso8601 PASSED [ 88%] 2024-09-12T18:06:08.357 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention_invalid_bucket PASSED [ 88%] 2024-09-12T18:06:09.080 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_versionid PASSED [ 88%] 2024-09-12T18:06:09.701 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_override_default_retention PASSED [ 88%] 2024-09-12T18:06:10.559 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_increase_period PASSED [ 88%] 2024-09-12T18:06:11.149 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_shorten_period PASSED [ 88%] 2024-09-12T18:06:11.789 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_shorten_period_bypass PASSED [ 88%] 2024-09-12T18:06:12.373 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_retention PASSED [ 89%] 2024-09-12T18:06:13.102 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_multipart_object_with_retention PASSED [ 89%] 2024-09-12T18:06:13.867 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_retention_and_marker PASSED [ 89%] 2024-09-12T18:06:14.509 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_multi_delete_object_with_retention PASSED [ 89%] 2024-09-12T18:06:15.083 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold PASSED [ 89%] 2024-09-12T18:06:15.618 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold_invalid_bucket PASSED [ 89%] 2024-09-12T18:06:16.214 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold_invalid_status PASSED [ 89%] 2024-09-12T18:06:16.912 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_legal_hold PASSED [ 89%] 2024-09-12T18:06:17.656 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_legal_hold_invalid_bucket PASSED [ 90%] 2024-09-12T18:06:18.294 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_legal_hold_on PASSED [ 90%] 2024-09-12T18:06:19.099 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_multipart_object_with_legal_hold_on PASSED [ 90%] 2024-09-12T18:06:19.617 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_legal_hold_off PASSED [ 90%] 2024-09-12T18:06:20.249 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_metadata PASSED [ 90%] 2024-09-12T18:06:20.802 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_uploading_obj PASSED [ 90%] 2024-09-12T18:06:31.191 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_governance_with_bypass PASSED [ 90%] 2024-09-12T18:06:31.791 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_governance_without_bypass PASSED [ 91%] 2024-09-12T18:06:41.338 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_compliance PASSED [ 91%] 2024-09-12T18:06:41.961 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_copy_object_ifmatch_good PASSED [ 91%] 2024-09-12T18:06:42.589 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_copy_object_ifnonematch_failed PASSED [ 91%] 2024-09-12T18:06:42.987 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_get_bucket_policy_status PASSED [ 91%] 2024-09-12T18:06:43.456 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_get_public_acl_bucket_policy_status PASSED [ 91%] 2024-09-12T18:06:43.924 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_get_authpublic_acl_bucket_policy_status PASSED [ 91%] 2024-09-12T18:06:44.452 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_get_publicpolicy_acl_bucket_policy_status PASSED [ 91%] 2024-09-12T18:06:44.952 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_get_nonpublicpolicy_acl_bucket_policy_status PASSED [ 92%] 2024-09-12T18:06:45.469 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_get_nonpublicpolicy_principal_bucket_policy_status PASSED [ 92%] 2024-09-12T18:06:45.874 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_allow_notprincipal PASSED [ 92%] 2024-09-12T18:06:46.344 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_get_undefined_public_block PASSED [ 92%] 2024-09-12T18:06:46.914 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_get_public_block_deny_bucket_policy PASSED [ 92%] 2024-09-12T18:06:47.377 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_put_public_block PASSED [ 92%] 2024-09-12T18:06:48.021 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_put_bucket_acls PASSED [ 92%] 2024-09-12T18:06:48.598 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_object_canned_acls PASSED [ 93%] 2024-09-12T18:06:49.112 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_policy PASSED [ 93%] 2024-09-12T18:06:49.556 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_policy_with_principal PASSED [ 93%] 2024-09-12T18:06:50.268 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_ignore_public_acls PASSED [ 93%] 2024-09-12T18:06:57.513 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_on_a_bucket_with_policy PASSED [ 93%] 2024-09-12T18:06:57.940 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_put_bucket_encryption_kms PASSED [ 93%] 2024-09-12T18:06:58.437 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_get_bucket_encryption_kms PASSED [ 93%] 2024-09-12T18:06:58.973 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_delete_bucket_encryption_kms PASSED [ 93%] 2024-09-12T18:06:59.551 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_default_post_object_authenticated_request PASSED [ 94%] 2024-09-12T18:07:00.911 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_torrent PASSED [ 94%] 2024-09-12T18:07:01.499 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_object_checksum_sha256 PASSED [ 94%] 2024-09-12T18:07:02.582 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_checksum_sha256 PASSED [ 94%] 2024-09-12T18:07:06.062 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_checksum_3parts PASSED [ 94%] 2024-09-12T18:07:07.220 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_checksum PASSED [ 94%] 2024-09-12T18:07:11.627 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3select.py::test_generate_where_clause PASSED [ 94%] 2024-09-12T18:07:15.391 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3select.py::test_generate_projection PASSED [ 95%] 2024-09-12T18:07:15.714 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3select.py::test_count_operation PASSED [ 95%] 2024-09-12T18:07:16.225 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3select.py::test_count_json_operation PASSED [ 95%] 2024-09-12T18:07:30.512 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3select.py::test_json_column_sum_min_max PASSED [ 95%] 2024-09-12T18:07:52.816 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3select.py::test_json_nullif_expressions PASSED [ 95%] 2024-09-12T18:07:56.674 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3select.py::test_column_sum_min_max PASSED [ 95%] 2024-09-12T18:07:59.372 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3select.py::test_nullif_expressions PASSED [ 95%] 2024-09-12T18:08:01.042 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3select.py::test_nulliftrue_expressions PASSED [ 95%] 2024-09-12T18:08:02.459 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3select.py::test_is_not_null_expressions PASSED [ 96%] 2024-09-12T18:08:02.832 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3select.py::test_lowerupper_expressions PASSED [ 96%] 2024-09-12T18:08:06.219 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3select.py::test_in_expressions PASSED [ 96%] 2024-09-12T18:08:10.301 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3select.py::test_true_false_in_expressions PASSED [ 96%] 2024-09-12T18:08:26.669 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3select.py::test_like_expressions PASSED [ 96%] 2024-09-12T18:08:28.797 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3select.py::test_truefalselike_expressions PASSED [ 96%] 2024-09-12T18:08:30.385 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3select.py::test_complex_expressions PASSED [ 96%] 2024-09-12T18:08:31.729 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3select.py::test_alias PASSED [ 97%] 2024-09-12T18:08:32.422 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3select.py::test_alias_cyclic_refernce PASSED [ 97%] 2024-09-12T18:08:37.441 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3select.py::test_datetime PASSED [ 97%] 2024-09-12T18:08:40.191 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3select.py::test_true_false_datetime PASSED [ 97%] 2024-09-12T18:08:40.673 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3select.py::test_csv_parser PASSED [ 97%] 2024-09-12T18:08:41.598 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3select.py::test_csv_definition PASSED [ 97%] 2024-09-12T18:08:46.534 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3select.py::test_schema_definition PASSED [ 97%] 2024-09-12T18:08:49.530 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3select.py::test_when_then_else_expressions PASSED [ 97%] 2024-09-12T18:08:53.596 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3select.py::test_coalesce_expressions PASSED [ 98%] 2024-09-12T18:08:55.003 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3select.py::test_cast_expressions PASSED [ 98%] 2024-09-12T18:08:55.169 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3select.py::test_version PASSED [ 98%] 2024-09-12T18:08:58.431 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3select.py::test_trim_expressions PASSED [ 98%] 2024-09-12T18:09:04.025 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3select.py::test_truefalse_trim_expressions PASSED [ 98%] 2024-09-12T18:09:06.172 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3select.py::test_escape_expressions PASSED [ 98%] 2024-09-12T18:09:09.453 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3select.py::test_case_value_expressions PASSED [ 98%] 2024-09-12T18:09:10.924 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3select.py::test_bool_cast_expressions PASSED [ 99%] 2024-09-12T18:09:46.338 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3select.py::test_progress_expressions PASSED [ 99%] 2024-09-12T18:09:46.503 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3select.py::test_output_serial_expressions PASSED [ 99%] 2024-09-12T18:09:47.502 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_sns.py::test_account_topic PASSED [ 99%] 2024-09-12T18:09:48.237 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_sns.py::test_cross_account_topic PASSED [ 99%] 2024-09-12T18:09:49.020 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_sns.py::test_account_topic_publish PASSED [ 99%] 2024-09-12T18:09:49.958 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_sns.py::test_cross_account_topic_publish PASSED [ 99%] 2024-09-12T18:09:49.974 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_utils.py::test_generate PASSED [100%] 2024-09-12T18:09:49.975 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T18:09:49.975 INFO:teuthology.orchestra.run.smithi037.stdout:=============================== warnings summary =============================== 2024-09-12T18:09:49.975 INFO:teuthology.orchestra.run.smithi037.stdout:.tox/py/lib/python3.9/site-packages/boto/plugin.py:40 2024-09-12T18:09:49.975 INFO:teuthology.orchestra.run.smithi037.stdout: /home/ubuntu/cephtest/s3-tests-client.0/.tox/py/lib/python3.9/site-packages/boto/plugin.py:40: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses 2024-09-12T18:09:49.975 INFO:teuthology.orchestra.run.smithi037.stdout: import imp 2024-09-12T18:09:49.975 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T18:09:49.975 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests/functional/test_headers.py:120 2024-09-12T18:09:49.975 INFO:teuthology.orchestra.run.smithi037.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_headers.py:120: SyntaxWarning: "is" with a literal. Did you mean "=="? 2024-09-12T18:09:49.975 INFO:teuthology.orchestra.run.smithi037.stdout: if boto_type is 'S3Connection': 2024-09-12T18:09:49.975 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T18:09:49.975 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests/functional/test_headers.py:124 2024-09-12T18:09:49.976 INFO:teuthology.orchestra.run.smithi037.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_headers.py:124: SyntaxWarning: "is" with a literal. Did you mean "=="? 2024-09-12T18:09:49.976 INFO:teuthology.orchestra.run.smithi037.stdout: elif boto_type is 'HTTPRequest': 2024-09-12T18:09:49.976 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T18:09:49.976 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests/functional/test_s3.py:359 2024-09-12T18:09:49.976 INFO:teuthology.orchestra.run.smithi037.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3.py:359: DeprecationWarning: invalid escape sequence \W 2024-09-12T18:09:49.976 INFO:teuthology.orchestra.run.smithi037.stdout: extra_sc = re.split('\W+', config['main']['storage_classes']) 2024-09-12T18:09:49.976 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T18:09:49.976 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests/functional/test_s3_website.py:176 2024-09-12T18:09:49.976 INFO:teuthology.orchestra.run.smithi037.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3_website.py:176: SyntaxWarning: "is" with a literal. Did you mean "=="? 2024-09-12T18:09:49.976 INFO:teuthology.orchestra.run.smithi037.stdout: if k is 'BucketName': 2024-09-12T18:09:49.976 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T18:09:49.976 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests/functional/test_s3_website.py:253 2024-09-12T18:09:49.977 INFO:teuthology.orchestra.run.smithi037.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3_website.py:253: PytestUnknownMarkWarning: Unknown pytest.mark.timeout - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/stable/how-to/mark.html 2024-09-12T18:09:49.977 INFO:teuthology.orchestra.run.smithi037.stdout: @pytest.mark.timeout(10) 2024-09-12T18:09:49.977 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T18:09:49.977 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests/functional/test_s3_website.py:1077 2024-09-12T18:09:49.977 INFO:teuthology.orchestra.run.smithi037.stdout: s3tests/functional/test_s3_website.py:1077: PytestCollectionWarning: yield tests were removed in pytest 4.0 - test_routing_generator will be ignored 2024-09-12T18:09:49.977 INFO:teuthology.orchestra.run.smithi037.stdout: @pytest.mark.s3website_routing_rules 2024-09-12T18:09:49.977 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T18:09:49.977 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py:2214 2024-09-12T18:09:49.977 INFO:teuthology.orchestra.run.smithi037.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2214: DeprecationWarning: invalid escape sequence \$ 2024-09-12T18:09:49.977 INFO:teuthology.orchestra.run.smithi037.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-12T18:09:49.977 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T18:09:49.977 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py:2229 2024-09-12T18:09:49.978 INFO:teuthology.orchestra.run.smithi037.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2229: DeprecationWarning: invalid escape sequence \$ 2024-09-12T18:09:49.978 INFO:teuthology.orchestra.run.smithi037.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2024-09-12T18:09:49.978 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T18:09:49.978 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py:2235 2024-09-12T18:09:49.978 INFO:teuthology.orchestra.run.smithi037.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2235: DeprecationWarning: invalid escape sequence \$ 2024-09-12T18:09:49.978 INFO:teuthology.orchestra.run.smithi037.stdout: response = client.get_object(Bucket=bucket_name, Key='\$foo.txt') 2024-09-12T18:09:49.978 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T18:09:49.978 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py:2292 2024-09-12T18:09:49.978 INFO:teuthology.orchestra.run.smithi037.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2292: DeprecationWarning: invalid escape sequence \$ 2024-09-12T18:09:49.978 INFO:teuthology.orchestra.run.smithi037.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-12T18:09:49.978 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T18:09:49.978 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py:2307 2024-09-12T18:09:49.978 INFO:teuthology.orchestra.run.smithi037.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2307: DeprecationWarning: invalid escape sequence \$ 2024-09-12T18:09:49.979 INFO:teuthology.orchestra.run.smithi037.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2024-09-12T18:09:49.979 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T18:09:49.979 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py:2325 2024-09-12T18:09:49.979 INFO:teuthology.orchestra.run.smithi037.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2325: DeprecationWarning: invalid escape sequence \$ 2024-09-12T18:09:49.979 INFO:teuthology.orchestra.run.smithi037.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-12T18:09:49.979 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T18:09:49.979 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py:2340 2024-09-12T18:09:49.979 INFO:teuthology.orchestra.run.smithi037.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2340: DeprecationWarning: invalid escape sequence \$ 2024-09-12T18:09:49.979 INFO:teuthology.orchestra.run.smithi037.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id[::-1]),\ 2024-09-12T18:09:49.979 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T18:09:49.979 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py:2358 2024-09-12T18:09:49.979 INFO:teuthology.orchestra.run.smithi037.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2358: DeprecationWarning: invalid escape sequence \$ 2024-09-12T18:09:49.980 INFO:teuthology.orchestra.run.smithi037.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-12T18:09:49.980 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T18:09:49.980 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py:2373 2024-09-12T18:09:49.980 INFO:teuthology.orchestra.run.smithi037.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2373: DeprecationWarning: invalid escape sequence \$ 2024-09-12T18:09:49.980 INFO:teuthology.orchestra.run.smithi037.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2024-09-12T18:09:49.980 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T18:09:49.980 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py:2423 2024-09-12T18:09:49.980 INFO:teuthology.orchestra.run.smithi037.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2423: DeprecationWarning: invalid escape sequence \$ 2024-09-12T18:09:49.980 INFO:teuthology.orchestra.run.smithi037.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-12T18:09:49.980 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T18:09:49.981 INFO:teuthology.orchestra.run.smithi037.stdout:s3tests_boto3/functional/test_s3.py:2455 2024-09-12T18:09:49.981 INFO:teuthology.orchestra.run.smithi037.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2455: DeprecationWarning: invalid escape sequence \$ 2024-09-12T18:09:49.981 INFO:teuthology.orchestra.run.smithi037.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-12T18:09:49.981 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T18:09:49.981 INFO:teuthology.orchestra.run.smithi037.stdout:-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html 2024-09-12T18:09:49.981 INFO:teuthology.orchestra.run.smithi037.stdout:= 680 passed, 65 skipped, 126 deselected, 1 xfailed, 18 warnings in 1259.08s (0:20:59) = 2024-09-12T18:09:50.102 INFO:teuthology.orchestra.run.smithi037.stdout:___________________________________ summary ____________________________________ 2024-09-12T18:09:50.102 INFO:teuthology.orchestra.run.smithi037.stdout: py: commands succeeded 2024-09-12T18:09:50.103 INFO:teuthology.orchestra.run.smithi037.stdout: congratulations :) 2024-09-12T18:09:50.121 DEBUG:tasks.s3tests:Scanning radosgw logs for leaked encryption keys... 2024-09-12T18:09:50.121 DEBUG:teuthology.orchestra.run.smithi037:> grep --binary-files=text pO3upElrwuEXSoFwCfnZPdSsmt/xWeFa0N9KgDijwVs= /var/log/ceph/rgw.ceph.client.0.log 2024-09-12T18:09:50.231 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T18:09:50.231 INFO:tasks.s3tests:Cleaning up boto... 2024-09-12T18:09:50.232 DEBUG:teuthology.orchestra.run.smithi037:> rm /home/ubuntu/cephtest/boto-client.0.cfg 2024-09-12T18:09:50.261 INFO:tasks.s3tests:Removing s3-tests... 2024-09-12T18:09:50.262 DEBUG:teuthology.orchestra.run.smithi037:> rm -rf /home/ubuntu/cephtest/s3-tests-client.0 2024-09-12T18:09:50.466 INFO:teuthology.run_tasks:Running task workunit... 2024-09-12T18:09:50.477 INFO:tasks.workunit:Pulling workunits from ref bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T18:09:50.477 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T18:09:50.477 DEBUG:teuthology.orchestra.run.smithi037:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T18:09:50.507 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T18:09:50.507 INFO:teuthology.orchestra.run.smithi037.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T18:09:50.508 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T18:09:50.577 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-12T18:09:50.578 DEBUG:teuthology.orchestra.run.smithi037:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-12T18:09:50.647 INFO:tasks.workunit:timeout=3h 2024-09-12T18:09:50.647 INFO:tasks.workunit:cleanup=True 2024-09-12T18:09:50.648 DEBUG:teuthology.orchestra.run.smithi037:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T18:09:50.718 INFO:tasks.workunit.client.0.smithi037.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T18:10:51.015 INFO:tasks.workunit.client.0.smithi037.stderr:Updating files: 92% (11692/12697) Updating files: 93% (11809/12697) Updating files: 94% (11936/12697) Updating files: 95% (12063/12697) Updating files: 96% (12190/12697) Updating files: 97% (12317/12697) Updating files: 98% (12444/12697) Updating files: 99% (12571/12697) Updating files: 100% (12697/12697) Updating files: 100% (12697/12697), done. 2024-09-12T18:10:51.342 INFO:tasks.workunit.client.0.smithi037.stderr:Note: switching to 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'. 2024-09-12T18:10:51.342 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T18:10:51.342 INFO:tasks.workunit.client.0.smithi037.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T18:10:51.342 INFO:tasks.workunit.client.0.smithi037.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T18:10:51.342 INFO:tasks.workunit.client.0.smithi037.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T18:10:51.342 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T18:10:51.342 INFO:tasks.workunit.client.0.smithi037.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T18:10:51.342 INFO:tasks.workunit.client.0.smithi037.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T18:10:51.343 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T18:10:51.343 INFO:tasks.workunit.client.0.smithi037.stderr: git switch -c 2024-09-12T18:10:51.343 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T18:10:51.343 INFO:tasks.workunit.client.0.smithi037.stderr:Or undo this operation with: 2024-09-12T18:10:51.343 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T18:10:51.343 INFO:tasks.workunit.client.0.smithi037.stderr: git switch - 2024-09-12T18:10:51.343 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T18:10:51.343 INFO:tasks.workunit.client.0.smithi037.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T18:10:51.343 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T18:10:51.343 INFO:tasks.workunit.client.0.smithi037.stderr:HEAD is now at bad475c18c9 rgw: clear output keys in RGWMetadataLister::get_next() 2024-09-12T18:10:51.347 DEBUG:teuthology.orchestra.run.smithi037:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T18:10:51.417 INFO:tasks.workunit.client.0.smithi037.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T18:10:51.419 INFO:tasks.workunit.client.0.smithi037.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T18:10:51.419 INFO:tasks.workunit.client.0.smithi037.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T18:10:51.469 INFO:tasks.workunit.client.0.smithi037.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T18:10:51.520 INFO:tasks.workunit.client.0.smithi037.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T18:10:51.562 INFO:tasks.workunit.client.0.smithi037.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T18:10:51.563 INFO:tasks.workunit.client.0.smithi037.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T18:10:51.563 INFO:tasks.workunit.client.0.smithi037.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T18:10:51.604 INFO:tasks.workunit.client.0.smithi037.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T18:10:51.607 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-09-12T18:10:51.607 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T18:10:51.679 INFO:tasks.workunit:Running workunits matching rgw/run-versioning.sh on client.0... 2024-09-12T18:10:51.680 INFO:tasks.workunit:Running workunit rgw/run-versioning.sh... 2024-09-12T18:10:51.680 DEBUG:teuthology.orchestra.run.smithi037:workunit test rgw/run-versioning.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-versioning.sh 2024-09-12T18:10:51.753 INFO:tasks.workunit.client.0.smithi037.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-versioning.sh 2024-09-12T18:10:51.754 INFO:tasks.workunit.client.0.smithi037.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T18:10:51.754 INFO:tasks.workunit.client.0.smithi037.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T18:10:54.147 INFO:tasks.workunit.client.0.smithi037.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-09-12T18:10:54.147 INFO:tasks.workunit.client.0.smithi037.stderr:++ deactivate nondestructive 2024-09-12T18:10:54.147 INFO:tasks.workunit.client.0.smithi037.stderr:++ '[' -n '' ']' 2024-09-12T18:10:54.147 INFO:tasks.workunit.client.0.smithi037.stderr:++ '[' -n '' ']' 2024-09-12T18:10:54.148 INFO:tasks.workunit.client.0.smithi037.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T18:10:54.148 INFO:tasks.workunit.client.0.smithi037.stderr:++ hash -r 2024-09-12T18:10:54.148 INFO:tasks.workunit.client.0.smithi037.stderr:++ '[' -n '' ']' 2024-09-12T18:10:54.148 INFO:tasks.workunit.client.0.smithi037.stderr:++ unset VIRTUAL_ENV 2024-09-12T18:10:54.148 INFO:tasks.workunit.client.0.smithi037.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-09-12T18:10:54.148 INFO:tasks.workunit.client.0.smithi037.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T18:10:54.148 INFO:tasks.workunit.client.0.smithi037.stderr:++ export VIRTUAL_ENV 2024-09-12T18:10:54.148 INFO:tasks.workunit.client.0.smithi037.stderr:++ _OLD_VIRTUAL_PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-12T18:10:54.150 INFO:tasks.workunit.client.0.smithi037.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-12T18:10:54.150 INFO:tasks.workunit.client.0.smithi037.stderr:++ export PATH 2024-09-12T18:10:54.150 INFO:tasks.workunit.client.0.smithi037.stderr:++ '[' -n '' ']' 2024-09-12T18:10:54.150 INFO:tasks.workunit.client.0.smithi037.stderr:++ '[' -z '' ']' 2024-09-12T18:10:54.150 INFO:tasks.workunit.client.0.smithi037.stderr:++ _OLD_VIRTUAL_PS1= 2024-09-12T18:10:54.150 INFO:tasks.workunit.client.0.smithi037.stderr:++ PS1='(rgw) ' 2024-09-12T18:10:54.151 INFO:tasks.workunit.client.0.smithi037.stderr:++ export PS1 2024-09-12T18:10:54.151 INFO:tasks.workunit.client.0.smithi037.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T18:10:54.151 INFO:tasks.workunit.client.0.smithi037.stderr:++ hash -r 2024-09-12T18:10:54.151 INFO:tasks.workunit.client.0.smithi037.stderr:+ pip install pip --upgrade 2024-09-12T18:10:54.386 INFO:tasks.workunit.client.0.smithi037.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.9/site-packages (21.3.1) 2024-09-12T18:10:54.576 INFO:tasks.workunit.client.0.smithi037.stdout:Collecting pip 2024-09-12T18:10:54.581 INFO:tasks.workunit.client.0.smithi037.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-12T18:10:54.628 INFO:tasks.workunit.client.0.smithi037.stdout:Installing collected packages: pip 2024-09-12T18:10:54.628 INFO:tasks.workunit.client.0.smithi037.stdout: Attempting uninstall: pip 2024-09-12T18:10:54.628 INFO:tasks.workunit.client.0.smithi037.stdout: Found existing installation: pip 21.3.1 2024-09-12T18:10:54.794 INFO:tasks.workunit.client.0.smithi037.stdout: Uninstalling pip-21.3.1: 2024-09-12T18:10:54.800 INFO:tasks.workunit.client.0.smithi037.stdout: Successfully uninstalled pip-21.3.1 2024-09-12T18:10:55.572 INFO:tasks.workunit.client.0.smithi037.stdout:Successfully installed pip-24.2 2024-09-12T18:10:55.620 INFO:tasks.workunit.client.0.smithi037.stderr:+ pip install boto3 2024-09-12T18:10:56.428 INFO:tasks.workunit.client.0.smithi037.stdout:Collecting boto3 2024-09-12T18:10:56.429 INFO:tasks.workunit.client.0.smithi037.stdout: Using cached boto3-1.35.17-py3-none-any.whl.metadata (6.6 kB) 2024-09-12T18:10:57.051 INFO:tasks.workunit.client.0.smithi037.stdout:Collecting botocore<1.36.0,>=1.35.17 (from boto3) 2024-09-12T18:10:57.053 INFO:tasks.workunit.client.0.smithi037.stdout: Using cached botocore-1.35.17-py3-none-any.whl.metadata (5.7 kB) 2024-09-12T18:10:57.149 INFO:tasks.workunit.client.0.smithi037.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-12T18:10:57.151 INFO:tasks.workunit.client.0.smithi037.stdout: Using cached jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-12T18:10:57.204 INFO:tasks.workunit.client.0.smithi037.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-12T18:10:57.205 INFO:tasks.workunit.client.0.smithi037.stdout: Using cached s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-12T18:10:57.255 INFO:tasks.workunit.client.0.smithi037.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T18:10:57.257 INFO:tasks.workunit.client.0.smithi037.stdout: Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-12T18:10:57.334 INFO:tasks.workunit.client.0.smithi037.stdout:Collecting urllib3<1.27,>=1.25.4 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T18:10:57.335 INFO:tasks.workunit.client.0.smithi037.stdout: Using cached urllib3-1.26.20-py2.py3-none-any.whl.metadata (50 kB) 2024-09-12T18:10:57.544 INFO:tasks.workunit.client.0.smithi037.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T18:10:57.545 INFO:tasks.workunit.client.0.smithi037.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-12T18:10:57.550 INFO:tasks.workunit.client.0.smithi037.stdout:Using cached boto3-1.35.17-py3-none-any.whl (139 kB) 2024-09-12T18:10:57.551 INFO:tasks.workunit.client.0.smithi037.stdout:Using cached botocore-1.35.17-py3-none-any.whl (12.5 MB) 2024-09-12T18:10:57.561 INFO:tasks.workunit.client.0.smithi037.stdout:Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-12T18:10:57.562 INFO:tasks.workunit.client.0.smithi037.stdout:Using cached s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-12T18:10:57.563 INFO:tasks.workunit.client.0.smithi037.stdout:Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-12T18:10:57.565 INFO:tasks.workunit.client.0.smithi037.stdout:Using cached urllib3-1.26.20-py2.py3-none-any.whl (144 kB) 2024-09-12T18:10:57.566 INFO:tasks.workunit.client.0.smithi037.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-12T18:10:57.643 INFO:tasks.workunit.client.0.smithi037.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-12T18:10:58.733 INFO:tasks.workunit.client.0.smithi037.stdout:Successfully installed boto3-1.35.17 botocore-1.35.17 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-1.26.20 2024-09-12T18:10:58.852 INFO:tasks.workunit.client.0.smithi037.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_versioning.py 2024-09-12T18:10:58.980 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin user create --uid versioning-tester --display-name "Versioning Testing" --access-key LTA662PVVDTDWX6M2AB0 --secret pvtchqajgzqx5581t6qbddbkj0bgf3a69qdkjcea 2024-09-12T18:10:59.016 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:10:59.016 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:10:59.056 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.055+0000 7ffbce9af800 20 rados->read ofs=0 len=0 2024-09-12T18:10:59.058 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.057+0000 7ffbce9af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:10:59.058 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.057+0000 7ffbce9af800 20 realm 2024-09-12T18:10:59.058 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.057+0000 7ffbce9af800 20 rados->read ofs=0 len=0 2024-09-12T18:10:59.058 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.057+0000 7ffbce9af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:10:59.058 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.057+0000 7ffbce9af800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:10:59.058 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.057+0000 7ffbce9af800 20 rados->read ofs=0 len=0 2024-09-12T18:10:59.058 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.057+0000 7ffbce9af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:10:59.058 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.057+0000 7ffbce9af800 20 rados->read ofs=0 len=0 2024-09-12T18:10:59.059 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.058+0000 7ffbce9af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:10:59.059 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.058+0000 7ffbce9af800 20 rados->read ofs=0 len=0 2024-09-12T18:10:59.059 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.059+0000 7ffbce9af800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:10:59.059 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.059+0000 7ffbce9af800 20 searching for the correct realm 2024-09-12T18:10:59.064 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.063+0000 7ffbcbc98640 0 -- 172.21.15.37:0/1359462556 >> [v2:172.21.15.40:6800/2441293461,v1:172.21.15.40:6801/2441293461] conn(0x7ffbbc046040 msgr2=0x7ffbbc001030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:10:59.068 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.067+0000 7ffbccc9a640 0 -- 172.21.15.37:0/1359462556 >> [v2:172.21.15.40:6808/2253405131,v1:172.21.15.40:6809/2253405131] conn(0x7ffbc00ac1c0 msgr2=0x7ffbc00b3a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:10:59.072 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.071+0000 7ffbce9af800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T18:10:59.072 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.071+0000 7ffbce9af800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:10:59.072 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.071+0000 7ffbce9af800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:10:59.072 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.071+0000 7ffbce9af800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T18:10:59.072 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.071+0000 7ffbce9af800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:10:59.072 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.071+0000 7ffbce9af800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:10:59.072 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.071+0000 7ffbce9af800 20 rados->read ofs=0 len=0 2024-09-12T18:10:59.072 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.071+0000 7ffbce9af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:10:59.073 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.071+0000 7ffbce9af800 20 rados->read ofs=0 len=0 2024-09-12T18:10:59.074 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.072+0000 7ffbce9af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:10:59.074 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.072+0000 7ffbce9af800 20 rados->read ofs=0 len=0 2024-09-12T18:10:59.074 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.072+0000 7ffbce9af800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:10:59.074 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.072+0000 7ffbce9af800 20 zone default found 2024-09-12T18:10:59.074 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.072+0000 7ffbce9af800 4 Realm: () 2024-09-12T18:10:59.074 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.072+0000 7ffbce9af800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T18:10:59.074 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.072+0000 7ffbce9af800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T18:10:59.074 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.072+0000 7ffbce9af800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:10:59.074 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.072+0000 7ffbce9af800 20 zonegroup default 2024-09-12T18:10:59.075 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.072+0000 7ffbce9af800 20 rados->read ofs=0 len=0 2024-09-12T18:10:59.075 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.072+0000 7ffbce9af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:10:59.075 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.072+0000 7ffbce9af800 20 rados->read ofs=0 len=0 2024-09-12T18:10:59.075 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.073+0000 7ffbce9af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:10:59.075 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.073+0000 7ffbce9af800 20 rados->read ofs=0 len=0 2024-09-12T18:10:59.075 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.073+0000 7ffbce9af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:10:59.075 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.073+0000 7ffbce9af800 20 started sync module instance, tier type = 2024-09-12T18:10:59.075 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.073+0000 7ffbce9af800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T18:10:59.084 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.083+0000 7ffbce9af800 20 add_watcher() i=0 2024-09-12T18:10:59.084 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.083+0000 7ffbce9af800 20 add_watcher() i=1 2024-09-12T18:10:59.084 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.083+0000 7ffbce9af800 20 add_watcher() i=2 2024-09-12T18:10:59.084 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.083+0000 7ffbce9af800 20 add_watcher() i=3 2024-09-12T18:10:59.084 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.083+0000 7ffbce9af800 20 add_watcher() i=4 2024-09-12T18:10:59.084 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.083+0000 7ffbce9af800 20 add_watcher() i=5 2024-09-12T18:10:59.084 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.083+0000 7ffbce9af800 20 add_watcher() i=6 2024-09-12T18:10:59.085 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.084+0000 7ffbce9af800 20 add_watcher() i=7 2024-09-12T18:10:59.085 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.084+0000 7ffbce9af800 2 all 8 watchers are set, enabling cache 2024-09-12T18:10:59.087 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.086+0000 7ffa82fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:10:59.088 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.086+0000 7ffbce9af800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:10:59.088 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.086+0000 7ffbce9af800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:10:59.088 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.087+0000 7ffbce9af800 5 note: GC not initialized 2024-09-12T18:10:59.088 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.087+0000 7ffa81fdb640 20 reqs_thread_entry: start 2024-09-12T18:10:59.088 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.087+0000 7ffbce9af800 20 init_complete bucket index max shards: 11 2024-09-12T18:10:59.088 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.087+0000 7ffbce9af800 20 Filter name: none 2024-09-12T18:10:59.088 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.087+0000 7ff9f37fe640 20 reqs_thread_entry: start 2024-09-12T18:10:59.088 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.087+0000 7ffbce9af800 10 cache get: name=default.rgw.meta+users.uid+versioning-tester : miss 2024-09-12T18:10:59.088 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.087+0000 7ffbce9af800 20 rados->read ofs=0 len=0 2024-09-12T18:10:59.089 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.087+0000 7ffbce9af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:10:59.089 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.087+0000 7ffbce9af800 10 cache put: name=default.rgw.meta+users.uid+versioning-tester info.flags=0x0 2024-09-12T18:10:59.089 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.087+0000 7ffbce9af800 10 adding default.rgw.meta+users.uid+versioning-tester to cache LRU end 2024-09-12T18:10:59.089 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.087+0000 7ffbce9af800 10 cache get: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 : miss 2024-09-12T18:10:59.089 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.087+0000 7ffbce9af800 20 rados->read ofs=0 len=0 2024-09-12T18:10:59.089 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.088+0000 7ffbce9af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:10:59.090 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.088+0000 7ffbce9af800 10 cache put: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 info.flags=0x0 2024-09-12T18:10:59.090 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.088+0000 7ffbce9af800 10 adding default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 to cache LRU end 2024-09-12T18:10:59.090 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.088+0000 7ffbce9af800 10 cache get: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 : hit (negative entry) 2024-09-12T18:10:59.090 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.088+0000 7ffbce9af800 10 cache get: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 : hit (negative entry) 2024-09-12T18:10:59.090 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.089+0000 7ffbce9af800 10 cache put: name=default.rgw.meta+users.uid+versioning-tester info.flags=0x17 2024-09-12T18:10:59.090 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.089+0000 7ffbce9af800 10 moving default.rgw.meta+users.uid+versioning-tester to cache LRU end 2024-09-12T18:10:59.090 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.089+0000 7ffbce9af800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:versioning-tester, ofs0, ns] 2024-09-12T18:10:59.091 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.090+0000 7ffaa37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399164 cookie 94841253398208 notifier 9339 bl.length()=613 2024-09-12T18:10:59.091 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.090+0000 7ffaa37fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+versioning-tester info.flags=0x17 2024-09-12T18:10:59.091 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.090+0000 7ffaa37fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+versioning-tester to cache LRU end 2024-09-12T18:10:59.093 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.092+0000 7ffbce9af800 10 cache put: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 info.flags=0x7 2024-09-12T18:10:59.093 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.092+0000 7ffbce9af800 10 moving default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 to cache LRU end 2024-09-12T18:10:59.094 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.092+0000 7ffbce9af800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.keys:LTA662PVVDTDWX6M2AB0, ofs0, ns] 2024-09-12T18:10:59.094 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.093+0000 7ffaa37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576400209 cookie 94841253411008 notifier 9339 bl.length()=191 2024-09-12T18:10:59.094 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.093+0000 7ffaa37fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 info.flags=0x7 2024-09-12T18:10:59.094 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.093+0000 7ffaa37fe640 10 rgw watcher librados: moving default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 to cache LRU end 2024-09-12T18:10:59.095 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.095+0000 7ffa82fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:10:59.098 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.098+0000 7ffbce9af800 20 remove_watcher() i=0 2024-09-12T18:10:59.098 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.098+0000 7ffbce9af800 2 removed watcher, disabling cache 2024-09-12T18:10:59.099 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.099+0000 7ffbce9af800 20 remove_watcher() i=1 2024-09-12T18:10:59.100 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.100+0000 7ffbce9af800 20 remove_watcher() i=2 2024-09-12T18:10:59.101 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.101+0000 7ffbce9af800 20 remove_watcher() i=3 2024-09-12T18:10:59.102 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.102+0000 7ffbce9af800 20 remove_watcher() i=4 2024-09-12T18:10:59.103 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.103+0000 7ffbce9af800 20 remove_watcher() i=5 2024-09-12T18:10:59.104 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.104+0000 7ffbce9af800 20 remove_watcher() i=6 2024-09-12T18:10:59.105 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.105+0000 7ffbce9af800 20 remove_watcher() i=7 2024-09-12T18:10:59.381 INFO:tasks.workunit.client.0.smithi037.stderr:TEST: verify that index entries and OLH objects are cleaned up after redundant deletes 2024-09-12T18:10:59.381 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T18:10:59.501 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bi list --bucket versioning-bucket 2024-09-12T18:10:59.531 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:10:59.531 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:10:59.570 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.569+0000 7fdb47123800 20 rados->read ofs=0 len=0 2024-09-12T18:10:59.572 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.571+0000 7fdb47123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:10:59.572 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.571+0000 7fdb47123800 20 realm 2024-09-12T18:10:59.572 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.571+0000 7fdb47123800 20 rados->read ofs=0 len=0 2024-09-12T18:10:59.572 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.571+0000 7fdb47123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:10:59.572 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.571+0000 7fdb47123800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:10:59.572 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.571+0000 7fdb47123800 20 rados->read ofs=0 len=0 2024-09-12T18:10:59.572 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.571+0000 7fdb47123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:10:59.573 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.571+0000 7fdb47123800 20 rados->read ofs=0 len=0 2024-09-12T18:10:59.573 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.573+0000 7fdb47123800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:10:59.573 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.573+0000 7fdb47123800 20 rados->read ofs=0 len=0 2024-09-12T18:10:59.574 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.573+0000 7fdb47123800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:10:59.574 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.573+0000 7fdb47123800 20 searching for the correct realm 2024-09-12T18:10:59.577 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.577+0000 7fdb4260b640 0 -- 172.21.15.37:0/2691869455 >> [v2:172.21.15.40:6800/2441293461,v1:172.21.15.40:6801/2441293461] conn(0x7fdb34093060 msgr2=0x7fdb340b9830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:10:59.581 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.581+0000 7fdb4260b640 0 -- 172.21.15.37:0/2691869455 >> [v2:172.21.15.40:6800/2441293461,v1:172.21.15.40:6801/2441293461] conn(0x7fda0c087870 msgr2=0x7fda0c089ca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:10:59.585 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.585+0000 7fdb47123800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T18:10:59.586 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.585+0000 7fdb47123800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:10:59.586 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.585+0000 7fdb47123800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:10:59.586 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.585+0000 7fdb47123800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T18:10:59.586 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.585+0000 7fdb47123800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:10:59.586 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.585+0000 7fdb47123800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:10:59.586 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.585+0000 7fdb47123800 20 rados->read ofs=0 len=0 2024-09-12T18:10:59.586 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.585+0000 7fdb47123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:10:59.586 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.585+0000 7fdb47123800 20 rados->read ofs=0 len=0 2024-09-12T18:10:59.587 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.585+0000 7fdb47123800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:10:59.587 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.585+0000 7fdb47123800 20 rados->read ofs=0 len=0 2024-09-12T18:10:59.588 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.586+0000 7fdb47123800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:10:59.588 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.586+0000 7fdb47123800 20 zone default found 2024-09-12T18:10:59.588 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.586+0000 7fdb47123800 4 Realm: () 2024-09-12T18:10:59.588 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.586+0000 7fdb47123800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T18:10:59.588 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.586+0000 7fdb47123800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T18:10:59.588 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.586+0000 7fdb47123800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:10:59.588 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.586+0000 7fdb47123800 20 zonegroup default 2024-09-12T18:10:59.588 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.586+0000 7fdb47123800 20 rados->read ofs=0 len=0 2024-09-12T18:10:59.588 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.586+0000 7fdb47123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:10:59.588 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.586+0000 7fdb47123800 20 rados->read ofs=0 len=0 2024-09-12T18:10:59.588 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.586+0000 7fdb47123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:10:59.588 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.586+0000 7fdb47123800 20 rados->read ofs=0 len=0 2024-09-12T18:10:59.588 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.587+0000 7fdb47123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:10:59.589 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.587+0000 7fdb47123800 20 started sync module instance, tier type = 2024-09-12T18:10:59.589 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.587+0000 7fdb47123800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T18:10:59.597 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.596+0000 7fdb47123800 20 add_watcher() i=0 2024-09-12T18:10:59.597 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.596+0000 7fdb47123800 20 add_watcher() i=1 2024-09-12T18:10:59.597 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.596+0000 7fdb47123800 20 add_watcher() i=2 2024-09-12T18:10:59.597 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.596+0000 7fdb47123800 20 add_watcher() i=3 2024-09-12T18:10:59.598 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.596+0000 7fdb47123800 20 add_watcher() i=4 2024-09-12T18:10:59.598 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.596+0000 7fdb47123800 20 add_watcher() i=5 2024-09-12T18:10:59.598 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.597+0000 7fdb47123800 20 add_watcher() i=6 2024-09-12T18:10:59.598 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.597+0000 7fdb47123800 20 add_watcher() i=7 2024-09-12T18:10:59.598 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.597+0000 7fdb47123800 2 all 8 watchers are set, enabling cache 2024-09-12T18:10:59.600 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.599+0000 7fd9f9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:10:59.601 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.599+0000 7fdb47123800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:10:59.601 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.599+0000 7fdb47123800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:10:59.601 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.599+0000 7fdb47123800 5 note: GC not initialized 2024-09-12T18:10:59.601 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.600+0000 7fd9f8fe1640 20 reqs_thread_entry: start 2024-09-12T18:10:59.601 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.600+0000 7fdb47123800 20 init_complete bucket index max shards: 11 2024-09-12T18:10:59.601 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.600+0000 7fdb47123800 20 Filter name: none 2024-09-12T18:10:59.601 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.600+0000 7fd9f1ffb640 20 reqs_thread_entry: start 2024-09-12T18:10:59.601 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.600+0000 7fdb47123800 20 rados->read ofs=0 len=0 2024-09-12T18:10:59.602 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.600+0000 7fdb47123800 20 rados_obj.operate() r=0 bl.length=209 2024-09-12T18:10:59.602 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.600+0000 7fdb47123800 20 rados->read ofs=0 len=0 2024-09-12T18:10:59.602 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.601+0000 7fdb47123800 20 rados_obj.operate() r=0 bl.length=431 2024-09-12T18:10:59.602 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.601+0000 7fdb47123800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:10:59.602 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.601+0000 7fdb47123800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T18:10:59.602 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.601+0000 7fdb47123800 20 INFO: main: starting shard=0 2024-09-12T18:10:59.602 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.601+0000 7fdb47123800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.783.0 2024-09-12T18:10:59.603 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.601+0000 7fdb47123800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:10:59.603 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.601+0000 7fdb47123800 20 INFO: main: starting shard=1 2024-09-12T18:10:59.603 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.601+0000 7fdb47123800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.783.1 2024-09-12T18:10:59.603 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.602+0000 7fdb47123800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:10:59.603 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.602+0000 7fdb47123800 20 INFO: main: starting shard=2 2024-09-12T18:10:59.603 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.602+0000 7fdb47123800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.783.2 2024-09-12T18:10:59.603 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.602+0000 7fdb47123800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:10:59.604 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.602+0000 7fdb47123800 20 INFO: main: starting shard=3 2024-09-12T18:10:59.604 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.602+0000 7fdb47123800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.783.3 2024-09-12T18:10:59.604 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.603+0000 7fdb47123800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:10:59.604 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.603+0000 7fdb47123800 20 INFO: main: starting shard=4 2024-09-12T18:10:59.604 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.603+0000 7fdb47123800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.783.4 2024-09-12T18:10:59.604 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.603+0000 7fdb47123800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:10:59.605 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.603+0000 7fdb47123800 20 INFO: main: starting shard=5 2024-09-12T18:10:59.605 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.603+0000 7fdb47123800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.783.5 2024-09-12T18:10:59.605 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.604+0000 7fdb47123800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:10:59.605 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.604+0000 7fdb47123800 20 INFO: main: starting shard=6 2024-09-12T18:10:59.605 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.604+0000 7fdb47123800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.783.6 2024-09-12T18:10:59.606 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.605+0000 7fdb47123800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:10:59.606 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.605+0000 7fdb47123800 20 INFO: main: starting shard=7 2024-09-12T18:10:59.606 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.605+0000 7fdb47123800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.783.7 2024-09-12T18:10:59.606 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.606+0000 7fdb47123800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:10:59.606 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.606+0000 7fdb47123800 20 INFO: main: starting shard=8 2024-09-12T18:10:59.606 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.606+0000 7fdb47123800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.783.8 2024-09-12T18:10:59.607 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.606+0000 7fdb47123800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:10:59.607 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.606+0000 7fdb47123800 20 INFO: main: starting shard=9 2024-09-12T18:10:59.607 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.606+0000 7fdb47123800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.783.9 2024-09-12T18:10:59.607 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.606+0000 7fdb47123800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:10:59.607 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.606+0000 7fdb47123800 20 INFO: main: starting shard=10 2024-09-12T18:10:59.607 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.606+0000 7fdb47123800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.783.10 2024-09-12T18:10:59.608 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.607+0000 7fdb47123800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:10:59.608 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.607+0000 7fdb47123800 20 INFO: main: done 2024-09-12T18:10:59.608 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.608+0000 7fd9f9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:10:59.611 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.610+0000 7fdb47123800 20 remove_watcher() i=0 2024-09-12T18:10:59.611 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.610+0000 7fdb47123800 2 removed watcher, disabling cache 2024-09-12T18:10:59.612 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.612+0000 7fdb47123800 20 remove_watcher() i=1 2024-09-12T18:10:59.613 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.613+0000 7fdb47123800 20 remove_watcher() i=2 2024-09-12T18:10:59.614 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.614+0000 7fdb47123800 20 remove_watcher() i=3 2024-09-12T18:10:59.615 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.615+0000 7fdb47123800 20 remove_watcher() i=4 2024-09-12T18:10:59.616 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.616+0000 7fdb47123800 20 remove_watcher() i=5 2024-09-12T18:10:59.617 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.617+0000 7fdb47123800 20 remove_watcher() i=6 2024-09-12T18:10:59.618 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.617+0000 7fdb47123800 20 remove_watcher() i=7 2024-09-12T18:10:59.631 INFO:tasks.workunit.client.0.smithi037.stderr:rados -p default.rgw.buckets.data ls | grep ec3511e0-4aac-4c07-afcd-ef1aabb0ce3a 2024-09-12T18:10:59.653 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:10:59.654 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:10:59.697 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:10:59.696+0000 7feadc795640 0 -- 172.21.15.37:0/1543939640 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7feac4082470 msgr2=0x7feac40828d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:10:59.703 INFO:tasks.workunit.client.0.smithi037.stderr:TEST: verify that index entries and OLH objects are cleaned up after index linking error 2024-09-12T18:10:59.703 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T18:10:59.704 INFO:tasks.workunit.client.0.smithi037.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-12T18:11:01.167 INFO:tasks.workunit.client.0.smithi037.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-12T18:11:01.589 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bi list --bucket versioning-bucket 2024-09-12T18:11:01.619 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:11:01.619 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:11:01.658 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:01.657+0000 7f1cdc62f800 20 rados->read ofs=0 len=0 2024-09-12T18:11:01.660 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:01.659+0000 7f1cdc62f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:11:01.660 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:01.659+0000 7f1cdc62f800 20 realm 2024-09-12T18:11:01.660 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:01.659+0000 7f1cdc62f800 20 rados->read ofs=0 len=0 2024-09-12T18:11:01.660 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:01.659+0000 7f1cdc62f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:11:01.661 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:01.659+0000 7f1cdc62f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:11:01.661 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:01.659+0000 7f1cdc62f800 20 rados->read ofs=0 len=0 2024-09-12T18:11:01.661 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:01.659+0000 7f1cdc62f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:11:01.661 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:01.659+0000 7f1cdc62f800 20 rados->read ofs=0 len=0 2024-09-12T18:11:01.661 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:01.660+0000 7f1cdc62f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:11:01.662 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:01.660+0000 7f1cdc62f800 20 rados->read ofs=0 len=0 2024-09-12T18:11:01.662 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:01.661+0000 7f1cdc62f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:11:01.662 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:01.661+0000 7f1cdc62f800 20 searching for the correct realm 2024-09-12T18:11:01.666 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:01.665+0000 7f1cd991f640 0 -- 172.21.15.37:0/909517079 >> [v2:172.21.15.40:6800/2441293461,v1:172.21.15.40:6801/2441293461] conn(0x7f1ccc096040 msgr2=0x7f1ccc098940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:11:01.671 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:01.670+0000 7f1cda921640 0 -- 172.21.15.37:0/909517079 >> [v2:172.21.15.40:6808/2253405131,v1:172.21.15.40:6809/2253405131] conn(0x7f1cd000b040 msgr2=0x7f1cd001b2c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:11:01.674 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:01.674+0000 7f1cdc62f800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T18:11:01.675 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:01.674+0000 7f1cdc62f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:11:01.675 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:01.674+0000 7f1cdc62f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:11:01.675 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:01.674+0000 7f1cdc62f800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T18:11:01.675 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:01.674+0000 7f1cdc62f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:11:01.675 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:01.674+0000 7f1cdc62f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:11:01.675 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:01.674+0000 7f1cdc62f800 20 rados->read ofs=0 len=0 2024-09-12T18:11:01.675 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:01.674+0000 7f1cdc62f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:11:01.676 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:01.674+0000 7f1cdc62f800 20 rados->read ofs=0 len=0 2024-09-12T18:11:01.677 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:01.674+0000 7f1cdc62f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:11:01.677 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:01.674+0000 7f1cdc62f800 20 rados->read ofs=0 len=0 2024-09-12T18:11:01.677 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:01.675+0000 7f1cdc62f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:11:01.677 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:01.675+0000 7f1cdc62f800 20 zone default found 2024-09-12T18:11:01.677 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:01.675+0000 7f1cdc62f800 4 Realm: () 2024-09-12T18:11:01.677 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:01.675+0000 7f1cdc62f800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T18:11:01.677 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:01.675+0000 7f1cdc62f800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T18:11:01.677 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:01.675+0000 7f1cdc62f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:11:01.678 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:01.675+0000 7f1cdc62f800 20 zonegroup default 2024-09-12T18:11:01.678 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:01.675+0000 7f1cdc62f800 20 rados->read ofs=0 len=0 2024-09-12T18:11:01.678 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:01.675+0000 7f1cdc62f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:11:01.678 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:01.675+0000 7f1cdc62f800 20 rados->read ofs=0 len=0 2024-09-12T18:11:01.678 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:01.675+0000 7f1cdc62f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:11:01.678 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:01.675+0000 7f1cdc62f800 20 rados->read ofs=0 len=0 2024-09-12T18:11:01.678 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:01.676+0000 7f1cdc62f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:11:01.678 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:01.676+0000 7f1cdc62f800 20 started sync module instance, tier type = 2024-09-12T18:11:01.678 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:01.676+0000 7f1cdc62f800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T18:11:01.687 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:01.686+0000 7f1cdc62f800 20 add_watcher() i=0 2024-09-12T18:11:01.687 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:01.686+0000 7f1cdc62f800 20 add_watcher() i=1 2024-09-12T18:11:01.687 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:01.686+0000 7f1cdc62f800 20 add_watcher() i=2 2024-09-12T18:11:01.687 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:01.686+0000 7f1cdc62f800 20 add_watcher() i=3 2024-09-12T18:11:01.687 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:01.686+0000 7f1cdc62f800 20 add_watcher() i=4 2024-09-12T18:11:01.688 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:01.686+0000 7f1cdc62f800 20 add_watcher() i=5 2024-09-12T18:11:01.688 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:01.686+0000 7f1cdc62f800 20 add_watcher() i=6 2024-09-12T18:11:01.688 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:01.687+0000 7f1cdc62f800 20 add_watcher() i=7 2024-09-12T18:11:01.688 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:01.687+0000 7f1cdc62f800 2 all 8 watchers are set, enabling cache 2024-09-12T18:11:01.689 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:01.689+0000 7f1b90fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:11:01.691 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:01.689+0000 7f1cdc62f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:11:01.691 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:01.689+0000 7f1cdc62f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:11:01.691 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:01.689+0000 7f1cdc62f800 5 note: GC not initialized 2024-09-12T18:11:01.691 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:01.689+0000 7f1b0b7fe640 20 reqs_thread_entry: start 2024-09-12T18:11:01.691 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:01.689+0000 7f1cdc62f800 20 init_complete bucket index max shards: 11 2024-09-12T18:11:01.692 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:01.689+0000 7f1cdc62f800 20 Filter name: none 2024-09-12T18:11:01.692 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:01.689+0000 7f1b097fa640 20 reqs_thread_entry: start 2024-09-12T18:11:01.692 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:01.689+0000 7f1cdc62f800 20 rados->read ofs=0 len=0 2024-09-12T18:11:01.692 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:01.690+0000 7f1cdc62f800 20 rados_obj.operate() r=0 bl.length=209 2024-09-12T18:11:01.692 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:01.690+0000 7f1cdc62f800 20 rados->read ofs=0 len=0 2024-09-12T18:11:01.692 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:01.690+0000 7f1cdc62f800 20 rados_obj.operate() r=0 bl.length=431 2024-09-12T18:11:01.692 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:01.690+0000 7f1cdc62f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:11:01.692 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:01.690+0000 7f1cdc62f800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T18:11:01.693 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:01.690+0000 7f1cdc62f800 20 INFO: main: starting shard=0 2024-09-12T18:11:01.693 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:01.690+0000 7f1cdc62f800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.783.0 2024-09-12T18:11:01.695 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:01.691+0000 7f1cdc62f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:11:01.696 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:01.691+0000 7f1cdc62f800 20 INFO: main: starting shard=1 2024-09-12T18:11:01.696 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:01.691+0000 7f1cdc62f800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.783.1 2024-09-12T18:11:01.696 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:01.692+0000 7f1cdc62f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:11:01.696 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:01.692+0000 7f1cdc62f800 20 INFO: main: starting shard=2 2024-09-12T18:11:01.696 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:01.692+0000 7f1cdc62f800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.783.2 2024-09-12T18:11:01.696 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:01.692+0000 7f1cdc62f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:11:01.696 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:01.692+0000 7f1cdc62f800 20 INFO: main: starting shard=3 2024-09-12T18:11:01.697 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:01.692+0000 7f1cdc62f800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.783.3 2024-09-12T18:11:01.697 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:01.693+0000 7f1cdc62f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:11:01.697 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:01.693+0000 7f1cdc62f800 20 INFO: main: starting shard=4 2024-09-12T18:11:01.697 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:01.693+0000 7f1cdc62f800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.783.4 2024-09-12T18:11:01.697 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:01.693+0000 7f1cdc62f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:11:01.697 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:01.693+0000 7f1cdc62f800 20 INFO: main: starting shard=5 2024-09-12T18:11:01.697 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:01.693+0000 7f1cdc62f800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.783.5 2024-09-12T18:11:01.697 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:01.694+0000 7f1cdc62f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:11:01.698 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:01.694+0000 7f1cdc62f800 20 INFO: main: starting shard=6 2024-09-12T18:11:01.698 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:01.694+0000 7f1cdc62f800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.783.6 2024-09-12T18:11:01.699 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:01.694+0000 7f1cdc62f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:11:01.700 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:01.694+0000 7f1cdc62f800 20 INFO: main: starting shard=7 2024-09-12T18:11:01.700 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:01.694+0000 7f1cdc62f800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.783.7 2024-09-12T18:11:01.700 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:01.695+0000 7f1cdc62f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:11:01.700 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:01.695+0000 7f1cdc62f800 20 INFO: main: starting shard=8 2024-09-12T18:11:01.700 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:01.695+0000 7f1cdc62f800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.783.8 2024-09-12T18:11:01.700 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:01.695+0000 7f1cdc62f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:11:01.700 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:01.695+0000 7f1cdc62f800 20 INFO: main: starting shard=9 2024-09-12T18:11:01.701 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:01.695+0000 7f1cdc62f800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.783.9 2024-09-12T18:11:01.701 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:01.696+0000 7f1cdc62f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:11:01.701 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:01.696+0000 7f1cdc62f800 20 INFO: main: starting shard=10 2024-09-12T18:11:01.701 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:01.696+0000 7f1cdc62f800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.783.10 2024-09-12T18:11:01.701 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:01.696+0000 7f1cdc62f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:11:01.701 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:01.696+0000 7f1cdc62f800 20 INFO: main: done 2024-09-12T18:11:01.701 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:01.697+0000 7f1b90fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:11:01.702 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:01.699+0000 7f1cdc62f800 20 remove_watcher() i=0 2024-09-12T18:11:01.703 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:01.699+0000 7f1cdc62f800 2 removed watcher, disabling cache 2024-09-12T18:11:01.703 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:01.701+0000 7f1cdc62f800 20 remove_watcher() i=1 2024-09-12T18:11:01.703 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:01.702+0000 7f1cdc62f800 20 remove_watcher() i=2 2024-09-12T18:11:01.703 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:01.703+0000 7f1cdc62f800 20 remove_watcher() i=3 2024-09-12T18:11:01.705 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:01.704+0000 7f1cdc62f800 20 remove_watcher() i=4 2024-09-12T18:11:01.705 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:01.705+0000 7f1cdc62f800 20 remove_watcher() i=5 2024-09-12T18:11:01.706 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:01.706+0000 7f1cdc62f800 20 remove_watcher() i=6 2024-09-12T18:11:01.707 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:01.707+0000 7f1cdc62f800 20 remove_watcher() i=7 2024-09-12T18:11:01.721 INFO:tasks.workunit.client.0.smithi037.stderr:rados -p default.rgw.buckets.data ls | grep 6863fb51-9a67-4d12-b4c6-26296af7b593 2024-09-12T18:11:01.744 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:11:01.744 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:11:01.785 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:01.785+0000 7f929abb1640 0 -- 172.21.15.37:0/352880321 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7f9284036b40 msgr2=0x7f9284042980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:11:01.793 INFO:tasks.workunit.client.0.smithi037.stderr:TEST: verify that original null object version is intact after failed olh upgrade 2024-09-12T18:11:01.794 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T18:11:01.909 INFO:tasks.workunit.client.0.smithi037.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-12T18:11:03.415 INFO:tasks.workunit.client.0.smithi037.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T18:11:03.417 INFO:tasks.workunit.client.0.smithi037.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-12T18:11:03.894 INFO:tasks.workunit.client.0.smithi037.stderr:TEST: verify that concurrent delete requests do not leave behind olh entries 2024-09-12T18:11:03.894 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-12T18:11:04.062 INFO:tasks.workunit.client.0.smithi037.stderr:ceph config set client rgw_debug_inject_latency_bi_unlink 2 2024-09-12T18:11:07.562 INFO:tasks.workunit.client.0.smithi037.stderr:ceph config rm client rgw_debug_inject_latency_bi_unlink 2024-09-12T18:11:07.995 INFO:tasks.workunit.client.0.smithi037.stderr:radosgw-admin bucket check olh --bucket versioning-bucket --dump-keys 2024-09-12T18:11:08.027 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:11:08.027 INFO:tasks.workunit.client.0.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:11:08.067 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:08.066+0000 7f84a7e17800 20 rados->read ofs=0 len=0 2024-09-12T18:11:08.069 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:08.067+0000 7f84a7e17800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:11:08.069 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:08.067+0000 7f84a7e17800 20 realm 2024-09-12T18:11:08.069 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:08.067+0000 7f84a7e17800 20 rados->read ofs=0 len=0 2024-09-12T18:11:08.069 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:08.068+0000 7f84a7e17800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:11:08.069 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:08.068+0000 7f84a7e17800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:11:08.069 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:08.068+0000 7f84a7e17800 20 rados->read ofs=0 len=0 2024-09-12T18:11:08.069 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:08.068+0000 7f84a7e17800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:11:08.069 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:08.068+0000 7f84a7e17800 20 rados->read ofs=0 len=0 2024-09-12T18:11:08.070 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:08.069+0000 7f84a7e17800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:11:08.070 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:08.069+0000 7f84a7e17800 20 rados->read ofs=0 len=0 2024-09-12T18:11:08.071 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:08.069+0000 7f84a7e17800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:11:08.071 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:08.069+0000 7f84a7e17800 20 searching for the correct realm 2024-09-12T18:11:08.073 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:08.072+0000 7f849ade6640 0 -- 172.21.15.37:0/1382395073 >> [v2:172.21.15.40:6800/2441293461,v1:172.21.15.40:6801/2441293461] conn(0x7f849407e430 msgr2=0x7f849407e850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:11:08.281 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:08.280+0000 7f84a35e7640 0 -- 172.21.15.37:0/1382395073 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7f848c042b50 msgr2=0x7f848c0823d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:11:08.489 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:08.487+0000 7f84a7e17800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T18:11:08.489 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:08.487+0000 7f84a7e17800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:11:08.489 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:08.487+0000 7f84a7e17800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:11:08.489 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:08.487+0000 7f84a7e17800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T18:11:08.489 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:08.487+0000 7f84a7e17800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:11:08.489 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:08.487+0000 7f84a7e17800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:11:08.489 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:08.487+0000 7f84a7e17800 20 rados->read ofs=0 len=0 2024-09-12T18:11:08.489 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:08.488+0000 7f84a7e17800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:11:08.490 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:08.488+0000 7f84a7e17800 20 rados->read ofs=0 len=0 2024-09-12T18:11:08.490 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:08.488+0000 7f84a7e17800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:11:08.490 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:08.488+0000 7f84a7e17800 20 rados->read ofs=0 len=0 2024-09-12T18:11:08.491 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:08.489+0000 7f84a7e17800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:11:08.491 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:08.489+0000 7f84a7e17800 20 zone default found 2024-09-12T18:11:08.491 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:08.489+0000 7f84a7e17800 4 Realm: () 2024-09-12T18:11:08.491 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:08.489+0000 7f84a7e17800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T18:11:08.491 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:08.489+0000 7f84a7e17800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T18:11:08.491 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:08.489+0000 7f84a7e17800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:11:08.491 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:08.489+0000 7f84a7e17800 20 zonegroup default 2024-09-12T18:11:08.492 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:08.489+0000 7f84a7e17800 20 rados->read ofs=0 len=0 2024-09-12T18:11:08.492 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:08.489+0000 7f84a7e17800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:11:08.492 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:08.489+0000 7f84a7e17800 20 rados->read ofs=0 len=0 2024-09-12T18:11:08.492 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:08.489+0000 7f84a7e17800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:11:08.492 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:08.489+0000 7f84a7e17800 20 rados->read ofs=0 len=0 2024-09-12T18:11:08.492 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:08.490+0000 7f84a7e17800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:11:08.492 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:08.490+0000 7f84a7e17800 20 started sync module instance, tier type = 2024-09-12T18:11:08.492 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:08.490+0000 7f84a7e17800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T18:11:08.501 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:08.501+0000 7f84a7e17800 20 add_watcher() i=0 2024-09-12T18:11:08.501 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:08.501+0000 7f84a7e17800 20 add_watcher() i=1 2024-09-12T18:11:08.502 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:08.501+0000 7f84a7e17800 20 add_watcher() i=2 2024-09-12T18:11:08.502 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:08.501+0000 7f84a7e17800 20 add_watcher() i=3 2024-09-12T18:11:08.502 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:08.501+0000 7f84a7e17800 20 add_watcher() i=4 2024-09-12T18:11:08.502 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:08.501+0000 7f84a7e17800 20 add_watcher() i=5 2024-09-12T18:11:08.502 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:08.501+0000 7f84a7e17800 20 add_watcher() i=6 2024-09-12T18:11:08.502 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:08.502+0000 7f84a7e17800 20 add_watcher() i=7 2024-09-12T18:11:08.502 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:08.502+0000 7f84a7e17800 2 all 8 watchers are set, enabling cache 2024-09-12T18:11:08.504 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:08.503+0000 7f8359fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:11:08.505 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:08.504+0000 7f84a7e17800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:11:08.505 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:08.504+0000 7f84a7e17800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:11:08.505 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:08.504+0000 7f84a7e17800 5 note: GC not initialized 2024-09-12T18:11:08.505 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:08.504+0000 7f8358fe1640 20 reqs_thread_entry: start 2024-09-12T18:11:08.505 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:08.504+0000 7f84a7e17800 20 init_complete bucket index max shards: 11 2024-09-12T18:11:08.505 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:08.504+0000 7f84a7e17800 20 Filter name: none 2024-09-12T18:11:08.505 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:08.504+0000 7f82d27fc640 20 reqs_thread_entry: start 2024-09-12T18:11:08.506 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:08.504+0000 7f84a7e17800 10 cache get: name=default.rgw.meta+root+versioning-bucket : miss 2024-09-12T18:11:08.506 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:08.504+0000 7f84a7e17800 20 rados->read ofs=0 len=0 2024-09-12T18:11:08.507 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:08.505+0000 7f84a7e17800 20 rados_obj.operate() r=0 bl.length=209 2024-09-12T18:11:08.507 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:08.505+0000 7f84a7e17800 10 cache put: name=default.rgw.meta+root+versioning-bucket info.flags=0x11 2024-09-12T18:11:08.507 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:08.505+0000 7f84a7e17800 10 adding default.rgw.meta+root+versioning-bucket to cache LRU end 2024-09-12T18:11:08.507 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:08.505+0000 7f84a7e17800 10 cache get: name=default.rgw.meta+root+.bucket.meta.versioning-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.783 : miss 2024-09-12T18:11:08.507 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:08.505+0000 7f84a7e17800 20 rados->read ofs=0 len=0 2024-09-12T18:11:08.507 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:08.505+0000 7f84a7e17800 20 rados_obj.operate() r=0 bl.length=431 2024-09-12T18:11:08.507 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:08.505+0000 7f84a7e17800 10 cache put: name=default.rgw.meta+root+.bucket.meta.versioning-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.783 info.flags=0x17 2024-09-12T18:11:08.507 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:08.505+0000 7f84a7e17800 10 adding default.rgw.meta+root+.bucket.meta.versioning-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.783 to cache LRU end 2024-09-12T18:11:08.507 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:08.505+0000 7f84a7e17800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:11:08.508 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:08.505+0000 7f84a7e17800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T18:11:08.508 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:08.506+0000 7f84a7e17800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.versioning-bucket:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.783 2024-09-12T18:11:08.508 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:08.506+0000 7f84a7e17800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.783.0 2024-09-12T18:11:08.508 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:08.506+0000 7f84a7e17800 1 NOTICE: finished shard 0 (0 entries found) 2024-09-12T18:11:08.508 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:08.506+0000 7f84a7e17800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.783.1 2024-09-12T18:11:08.508 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:08.507+0000 7f84a7e17800 1 NOTICE: finished shard 1 (0 entries found) 2024-09-12T18:11:08.508 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:08.507+0000 7f84a7e17800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.783.2 2024-09-12T18:11:08.509 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:08.508+0000 7f84a7e17800 1 NOTICE: finished shard 2 (0 entries found) 2024-09-12T18:11:08.509 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:08.508+0000 7f84a7e17800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.783.3 2024-09-12T18:11:08.510 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:08.509+0000 7f84a7e17800 1 NOTICE: finished shard 3 (0 entries found) 2024-09-12T18:11:08.510 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:08.509+0000 7f84a7e17800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.783.4 2024-09-12T18:11:08.510 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:08.509+0000 7f84a7e17800 1 NOTICE: finished shard 4 (0 entries found) 2024-09-12T18:11:08.510 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:08.509+0000 7f84a7e17800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.783.5 2024-09-12T18:11:08.510 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:08.510+0000 7f84a7e17800 1 NOTICE: finished shard 5 (0 entries found) 2024-09-12T18:11:08.510 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:08.510+0000 7f84a7e17800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.783.6 2024-09-12T18:11:08.511 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:08.510+0000 7f84a7e17800 1 NOTICE: finished shard 6 (0 entries found) 2024-09-12T18:11:08.511 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:08.510+0000 7f84a7e17800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.783.7 2024-09-12T18:11:08.511 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:08.511+0000 7f84a7e17800 1 NOTICE: finished shard 7 (0 entries found) 2024-09-12T18:11:08.512 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:08.511+0000 7f84a7e17800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.783.8 2024-09-12T18:11:08.512 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:08.511+0000 7f84a7e17800 1 NOTICE: finished shard 8 (0 entries found) 2024-09-12T18:11:08.512 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:08.511+0000 7f84a7e17800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.783.9 2024-09-12T18:11:08.512 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:08.512+0000 7f84a7e17800 1 NOTICE: finished shard 9 (0 entries found) 2024-09-12T18:11:08.513 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:08.512+0000 7f84a7e17800 20 bucket index object: :.dir.722b129a-cf7a-4aca-b594-5b9492d130e2.4623.783.10 2024-09-12T18:11:08.513 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:08.512+0000 7f84a7e17800 1 NOTICE: finished shard 10 (0 entries found) 2024-09-12T18:11:08.513 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:08.512+0000 7f84a7e17800 1 NOTICE: finished all shards (0 entries found) 2024-09-12T18:11:08.513 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:08.513+0000 7f8359fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:11:08.516 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:08.515+0000 7f84a7e17800 20 remove_watcher() i=0 2024-09-12T18:11:08.516 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:08.515+0000 7f84a7e17800 2 removed watcher, disabling cache 2024-09-12T18:11:08.517 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:08.517+0000 7f84a7e17800 20 remove_watcher() i=1 2024-09-12T18:11:08.518 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:08.518+0000 7f84a7e17800 20 remove_watcher() i=2 2024-09-12T18:11:08.520 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:08.519+0000 7f84a7e17800 20 remove_watcher() i=3 2024-09-12T18:11:08.521 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:08.520+0000 7f84a7e17800 20 remove_watcher() i=4 2024-09-12T18:11:08.522 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:08.521+0000 7f84a7e17800 20 remove_watcher() i=5 2024-09-12T18:11:08.523 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:08.522+0000 7f84a7e17800 20 remove_watcher() i=6 2024-09-12T18:11:08.524 INFO:tasks.workunit.client.0.smithi037.stderr:2024-09-12T18:11:08.523+0000 7f84a7e17800 20 remove_watcher() i=7 2024-09-12T18:11:08.536 INFO:tasks.workunit.client.0.smithi037.stderr:Deleting bucket versioning-bucket 2024-09-12T18:11:08.700 INFO:tasks.workunit.client.0.smithi037.stderr:Completed bucket versioning tests 2024-09-12T18:11:08.701 INFO:tasks.workunit.client.0.smithi037.stdout:connected to http://localhost:80 2024-09-12T18:11:08.762 INFO:tasks.workunit.client.0.smithi037.stderr:+ deactivate 2024-09-12T18:11:08.762 INFO:tasks.workunit.client.0.smithi037.stderr:+ '[' -n /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin ']' 2024-09-12T18:11:08.762 INFO:tasks.workunit.client.0.smithi037.stderr:+ PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-12T18:11:08.762 INFO:tasks.workunit.client.0.smithi037.stderr:+ export PATH 2024-09-12T18:11:08.762 INFO:tasks.workunit.client.0.smithi037.stderr:+ unset _OLD_VIRTUAL_PATH 2024-09-12T18:11:08.762 INFO:tasks.workunit.client.0.smithi037.stderr:+ '[' -n '' ']' 2024-09-12T18:11:08.762 INFO:tasks.workunit.client.0.smithi037.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T18:11:08.762 INFO:tasks.workunit.client.0.smithi037.stderr:+ hash -r 2024-09-12T18:11:08.762 INFO:tasks.workunit.client.0.smithi037.stderr:+ '[' -n '' ']' 2024-09-12T18:11:08.763 INFO:tasks.workunit.client.0.smithi037.stderr:+ unset VIRTUAL_ENV 2024-09-12T18:11:08.763 INFO:tasks.workunit.client.0.smithi037.stderr:+ '[' '!' '' = nondestructive ']' 2024-09-12T18:11:08.763 INFO:tasks.workunit.client.0.smithi037.stderr:+ unset -f deactivate 2024-09-12T18:11:08.763 INFO:tasks.workunit.client.0.smithi037.stderr:+ echo OK. 2024-09-12T18:11:08.764 INFO:tasks.workunit.client.0.smithi037.stdout:OK. 2024-09-12T18:11:08.764 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T18:11:08.764 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T18:11:08.847 INFO:tasks.workunit:Stopping ['rgw/run-versioning.sh'] on client.0... 2024-09-12T18:11:08.847 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T18:11:09.221 DEBUG:teuthology.parallel:result is None 2024-09-12T18:11:09.222 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T18:11:09.262 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T18:11:09.263 DEBUG:teuthology.orchestra.run.smithi037:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T18:11:09.332 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T18:11:09.332 DEBUG:teuthology.run_tasks:Unwinding manager s3tests 2024-09-12T18:11:09.344 DEBUG:teuthology.run_tasks:Unwinding manager s3tests-java 2024-09-12T18:11:09.380 DEBUG:tasks.s3tests_java:S3 Tests Java: END 2024-09-12T18:11:09.380 INFO:tasks.s3tests_java:S3 Tests Java: Cleaning up s3-tests-java... 2024-09-12T18:11:09.380 DEBUG:teuthology.orchestra.run.smithi037:> rm -rf /home/ubuntu/cephtest/s3-tests-java 2024-09-12T18:11:09.445 INFO:tasks.s3tests_java:S3 Tests Java: Deleting S3 users... 2024-09-12T18:11:09.445 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid tester.client.0 --purge-data --cluster ceph 2024-09-12T18:11:09.505 INFO:teuthology.orchestra.run.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:11:09.505 INFO:teuthology.orchestra.run.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:11:09.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:09.541+0000 7f17c3cbb800 20 rados->read ofs=0 len=0 2024-09-12T18:11:09.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:09.542+0000 7f17c3cbb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:11:09.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:09.542+0000 7f17c3cbb800 20 realm 2024-09-12T18:11:09.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:09.542+0000 7f17c3cbb800 20 rados->read ofs=0 len=0 2024-09-12T18:11:09.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:09.542+0000 7f17c3cbb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:11:09.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:09.542+0000 7f17c3cbb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:11:09.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:09.542+0000 7f17c3cbb800 20 rados->read ofs=0 len=0 2024-09-12T18:11:09.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:09.542+0000 7f17c3cbb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:11:09.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:09.542+0000 7f17c3cbb800 20 rados->read ofs=0 len=0 2024-09-12T18:11:09.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:09.543+0000 7f17c3cbb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:11:09.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:09.543+0000 7f17c3cbb800 20 rados->read ofs=0 len=0 2024-09-12T18:11:09.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:09.544+0000 7f17c3cbb800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:11:09.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:09.544+0000 7f17c3cbb800 20 searching for the correct realm 2024-09-12T18:11:09.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:09.547+0000 7f17c1fad640 0 -- 172.21.15.37:0/2885310870 >> [v2:172.21.15.40:6818/1210108009,v1:172.21.15.40:6819/1210108009] conn(0x7f17b807b280 msgr2=0x7f17b80aa900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:11:09.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:09.552+0000 7f17c17ac640 0 -- 172.21.15.37:0/2885310870 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7f17b80a5bb0 msgr2=0x7f17b807b9b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:11:09.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:09.759+0000 7f17c3cbb800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T18:11:09.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:09.759+0000 7f17c3cbb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:11:09.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:09.759+0000 7f17c3cbb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:11:09.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:09.759+0000 7f17c3cbb800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T18:11:09.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:09.759+0000 7f17c3cbb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:11:09.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:09.759+0000 7f17c3cbb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:11:09.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:09.759+0000 7f17c3cbb800 20 rados->read ofs=0 len=0 2024-09-12T18:11:09.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:09.759+0000 7f17c3cbb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:11:09.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:09.759+0000 7f17c3cbb800 20 rados->read ofs=0 len=0 2024-09-12T18:11:09.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:09.760+0000 7f17c3cbb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:11:09.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:09.760+0000 7f17c3cbb800 20 rados->read ofs=0 len=0 2024-09-12T18:11:09.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:09.760+0000 7f17c3cbb800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:11:09.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:09.760+0000 7f17c3cbb800 20 zone default found 2024-09-12T18:11:09.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:09.760+0000 7f17c3cbb800 4 Realm: () 2024-09-12T18:11:09.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:09.760+0000 7f17c3cbb800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T18:11:09.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:09.760+0000 7f17c3cbb800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T18:11:09.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:09.760+0000 7f17c3cbb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:11:09.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:09.760+0000 7f17c3cbb800 20 zonegroup default 2024-09-12T18:11:09.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:09.760+0000 7f17c3cbb800 20 rados->read ofs=0 len=0 2024-09-12T18:11:09.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:09.760+0000 7f17c3cbb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:11:09.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:09.760+0000 7f17c3cbb800 20 rados->read ofs=0 len=0 2024-09-12T18:11:09.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:09.761+0000 7f17c3cbb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:11:09.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:09.761+0000 7f17c3cbb800 20 rados->read ofs=0 len=0 2024-09-12T18:11:09.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:09.761+0000 7f17c3cbb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:11:09.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:09.761+0000 7f17c3cbb800 20 started sync module instance, tier type = 2024-09-12T18:11:09.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:09.761+0000 7f17c3cbb800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T18:11:09.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:09.771+0000 7f17c3cbb800 20 add_watcher() i=0 2024-09-12T18:11:09.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:09.771+0000 7f17c3cbb800 20 add_watcher() i=1 2024-09-12T18:11:09.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:09.771+0000 7f17c3cbb800 20 add_watcher() i=2 2024-09-12T18:11:09.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:09.771+0000 7f17c3cbb800 20 add_watcher() i=3 2024-09-12T18:11:09.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:09.771+0000 7f17c3cbb800 20 add_watcher() i=4 2024-09-12T18:11:09.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:09.771+0000 7f17c3cbb800 20 add_watcher() i=5 2024-09-12T18:11:09.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:09.771+0000 7f17c3cbb800 20 add_watcher() i=6 2024-09-12T18:11:09.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:09.772+0000 7f17c3cbb800 20 add_watcher() i=7 2024-09-12T18:11:09.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:09.772+0000 7f17c3cbb800 2 all 8 watchers are set, enabling cache 2024-09-12T18:11:09.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:09.774+0000 7f16777e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:11:09.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:09.774+0000 7f17c3cbb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:11:09.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:09.774+0000 7f17c3cbb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:11:09.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:09.814+0000 7f16767e4640 20 reqs_thread_entry: start 2024-09-12T18:11:09.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:09.814+0000 7f17c3cbb800 20 init_complete bucket index max shards: 11 2024-09-12T18:11:09.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:09.814+0000 7f17c3cbb800 20 Filter name: none 2024-09-12T18:11:09.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:09.814+0000 7f15e7fff640 20 reqs_thread_entry: start 2024-09-12T18:11:09.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:09.815+0000 7f17c3cbb800 10 cache get: name=default.rgw.meta+users.uid+tester.client.0 : miss 2024-09-12T18:11:09.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:09.815+0000 7f17c3cbb800 20 rados->read ofs=0 len=0 2024-09-12T18:11:09.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:09.815+0000 7f17c3cbb800 20 rados_obj.operate() r=0 bl.length=482 2024-09-12T18:11:09.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:09.815+0000 7f17c3cbb800 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x13 2024-09-12T18:11:09.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:09.815+0000 7f17c3cbb800 10 adding default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-12T18:11:09.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:09.815+0000 7f17c3cbb800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:11:09.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:09.816+0000 7f17c3cbb800 10 removing key index: GBZOBVDAAJLMPUPSEHOT 2024-09-12T18:11:09.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:09.817+0000 7f17c3cbb800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.keys:GBZOBVDAAJLMPUPSEHOT, ofs0, ns] 2024-09-12T18:11:09.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:09.818+0000 7f16a4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399320 cookie 94632096146848 notifier 8783 bl.length()=170 2024-09-12T18:11:09.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:09.820+0000 7f17c3cbb800 10 removing email index: tester.client.0_test@test.test 2024-09-12T18:11:09.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:09.821+0000 7f17c3cbb800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.email:tester.client.0_test@test.test, ofs0, ns] 2024-09-12T18:11:09.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:09.821+0000 7f16a4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399130 cookie 94632096144512 notifier 8783 bl.length()=181 2024-09-12T18:11:09.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:09.822+0000 7f17c3cbb800 10 removing user buckets index 2024-09-12T18:11:09.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:09.824+0000 7f17c3cbb800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:users.uid:tester.client.0.buckets, ofs0, ns] 2024-09-12T18:11:09.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:09.825+0000 7f16a4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399165 cookie 94632096157248 notifier 8783 bl.length()=172 2024-09-12T18:11:09.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:09.826+0000 7f17c3cbb800 10 removing user index: tester.client.0 2024-09-12T18:11:09.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:09.827+0000 7f17c3cbb800 10 removing default.rgw.meta+users.uid+tester.client.0 from cache 2024-09-12T18:11:09.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:09.827+0000 7f17c3cbb800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:tester.client.0, ofs0, ns] 2024-09-12T18:11:09.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:09.828+0000 7f1693fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576400212 cookie 94632096155120 notifier 8783 bl.length()=164 2024-09-12T18:11:09.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:09.830+0000 7f16777e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:11:09.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:09.833+0000 7f17c3cbb800 20 remove_watcher() i=0 2024-09-12T18:11:09.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:09.833+0000 7f17c3cbb800 2 removed watcher, disabling cache 2024-09-12T18:11:09.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:09.834+0000 7f17c3cbb800 20 remove_watcher() i=1 2024-09-12T18:11:09.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:09.835+0000 7f17c3cbb800 20 remove_watcher() i=2 2024-09-12T18:11:09.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:09.836+0000 7f17c3cbb800 20 remove_watcher() i=3 2024-09-12T18:11:09.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:09.837+0000 7f17c3cbb800 20 remove_watcher() i=4 2024-09-12T18:11:09.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:09.838+0000 7f17c3cbb800 20 remove_watcher() i=5 2024-09-12T18:11:09.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:09.839+0000 7f17c3cbb800 20 remove_watcher() i=6 2024-09-12T18:11:09.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:09.840+0000 7f17c3cbb800 20 remove_watcher() i=7 2024-09-12T18:11:09.853 DEBUG:teuthology.run_tasks:Unwinding manager ragweed 2024-09-12T18:11:09.863 DEBUG:teuthology.run_tasks:Unwinding manager tox 2024-09-12T18:11:09.902 DEBUG:teuthology.orchestra.run.smithi037:> rm -rf /home/ubuntu/cephtest/tox-venv 2024-09-12T18:11:09.959 DEBUG:teuthology.run_tasks:Unwinding manager rgw 2024-09-12T18:11:09.972 DEBUG:tasks.rgw.client.0:waiting for process to exit 2024-09-12T18:11:09.972 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T18:11:09.982 INFO:tasks.rgw.client.0.smithi037.stdout:2024-09-12T18:11:09.975+0000 f874640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/ceph.client.0.log --time-stamp=yes --vgdb=yes --tool=memcheck --max-threads=1024 radosgw --rgw-frontends beast port=80 -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground (PID: 44555) UID: 0 2024-09-12T18:11:09.982 INFO:tasks.rgw.client.0.smithi037.stdout:2024-09-12T18:11:09.979+0000 a1be240 -1 shutting down 2024-09-12T18:11:36.088 INFO:tasks.rgw.client.0.smithi037.stderr:==00:01:00:41.054 44559== could not unlink /tmp/vgdb-pipe-from-vgdb-to-44559-by-root-on-??? 2024-09-12T18:11:36.089 INFO:tasks.rgw.client.0.smithi037.stderr:==00:01:00:41.054 44559== could not unlink /tmp/vgdb-pipe-to-vgdb-from-44559-by-root-on-??? 2024-09-12T18:11:36.089 INFO:tasks.rgw.client.0.smithi037.stderr:==00:01:00:41.054 44559== could not unlink /tmp/vgdb-pipe-shared-mem-vgdb-44559-by-root-on-??? 2024-09-12T18:11:40.479 INFO:tasks.rgw.client.0:Stopped 2024-09-12T18:11:40.479 DEBUG:teuthology.orchestra.run.smithi037:> rm -f /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock 2024-09-12T18:11:40.515 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -f /etc/ceph/vault-root-token 2024-09-12T18:11:40.601 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -f /home/ubuntu/cephtest/url_file 2024-09-12T18:11:40.644 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process', '--include-all'] 2024-09-12T18:11:40.645 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process', '--include-all'] 2024-09-12T18:11:40.645 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process --include-all 2024-09-12T18:11:40.745 INFO:teuthology.orchestra.run.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:11:40.745 INFO:teuthology.orchestra.run.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:11:40.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:40.781+0000 7f10f740e800 20 rados->read ofs=0 len=0 2024-09-12T18:11:40.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:40.783+0000 7f10f740e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:11:40.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:40.783+0000 7f10f740e800 20 realm 2024-09-12T18:11:40.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:40.783+0000 7f10f740e800 20 rados->read ofs=0 len=0 2024-09-12T18:11:40.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:40.783+0000 7f10f740e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:11:40.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:40.783+0000 7f10f740e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:11:40.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:40.783+0000 7f10f740e800 20 rados->read ofs=0 len=0 2024-09-12T18:11:40.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:40.783+0000 7f10f740e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:11:40.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:40.783+0000 7f10f740e800 20 rados->read ofs=0 len=0 2024-09-12T18:11:40.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:40.784+0000 7f10f740e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:11:40.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:40.784+0000 7f10f740e800 20 rados->read ofs=0 len=0 2024-09-12T18:11:40.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:40.785+0000 7f10f740e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:11:40.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:40.785+0000 7f10f740e800 20 searching for the correct realm 2024-09-12T18:11:40.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:40.788+0000 7f10f2258640 0 -- 172.21.15.37:0/2768833503 >> [v2:172.21.15.40:6800/2441293461,v1:172.21.15.40:6801/2441293461] conn(0x7f10e4067720 msgr2=0x7f10e4086a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:11:40.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:40.792+0000 7f10f2a59640 0 -- 172.21.15.37:0/2768833503 >> [v2:172.21.15.37:6808/167247030,v1:172.21.15.37:6809/167247030] conn(0x7f10e8064430 msgr2=0x7f10e80648b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:11:41.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.000+0000 7f10f740e800 20 RGWRados::pool_iterate: got zonegroup_info.c97f1a82-236d-4452-9572-13a8414ab2db 2024-09-12T18:11:41.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.000+0000 7f10f740e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:11:41.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.000+0000 7f10f740e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:11:41.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.000+0000 7f10f740e800 20 RGWRados::pool_iterate: got zone_info.722b129a-cf7a-4aca-b594-5b9492d130e2 2024-09-12T18:11:41.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.000+0000 7f10f740e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:11:41.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.000+0000 7f10f740e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:11:41.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.000+0000 7f10f740e800 20 rados->read ofs=0 len=0 2024-09-12T18:11:41.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.001+0000 7f10f740e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:11:41.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.001+0000 7f10f740e800 20 rados->read ofs=0 len=0 2024-09-12T18:11:41.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.001+0000 7f10f740e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:11:41.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.001+0000 7f10f740e800 20 rados->read ofs=0 len=0 2024-09-12T18:11:41.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.001+0000 7f10f740e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:11:41.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.001+0000 7f10f740e800 20 zone default found 2024-09-12T18:11:41.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.001+0000 7f10f740e800 4 Realm: () 2024-09-12T18:11:41.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.001+0000 7f10f740e800 4 ZoneGroup: default (c97f1a82-236d-4452-9572-13a8414ab2db) 2024-09-12T18:11:41.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.001+0000 7f10f740e800 4 Zone: default (722b129a-cf7a-4aca-b594-5b9492d130e2) 2024-09-12T18:11:41.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.001+0000 7f10f740e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:11:41.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.001+0000 7f10f740e800 20 zonegroup default 2024-09-12T18:11:41.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.001+0000 7f10f740e800 20 rados->read ofs=0 len=0 2024-09-12T18:11:41.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.002+0000 7f10f740e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:11:41.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.002+0000 7f10f740e800 20 rados->read ofs=0 len=0 2024-09-12T18:11:41.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.002+0000 7f10f740e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:11:41.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.002+0000 7f10f740e800 20 rados->read ofs=0 len=0 2024-09-12T18:11:41.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.002+0000 7f10f740e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:11:41.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.002+0000 7f10f740e800 20 started sync module instance, tier type = 2024-09-12T18:11:41.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.002+0000 7f10f740e800 20 started zone id=722b129a-cf7a-4aca-b594-5b9492d130e2 (name=default) with tier type = 2024-09-12T18:11:41.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.012+0000 7f10f740e800 20 add_watcher() i=0 2024-09-12T18:11:41.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.012+0000 7f10f740e800 20 add_watcher() i=1 2024-09-12T18:11:41.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.012+0000 7f10f740e800 20 add_watcher() i=2 2024-09-12T18:11:41.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.012+0000 7f10f740e800 20 add_watcher() i=3 2024-09-12T18:11:41.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.012+0000 7f10f740e800 20 add_watcher() i=4 2024-09-12T18:11:41.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.012+0000 7f10f740e800 20 add_watcher() i=5 2024-09-12T18:11:41.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.012+0000 7f10f740e800 20 add_watcher() i=6 2024-09-12T18:11:41.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.014+0000 7f10f740e800 20 add_watcher() i=7 2024-09-12T18:11:41.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.014+0000 7f10f740e800 2 all 8 watchers are set, enabling cache 2024-09-12T18:11:41.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.015+0000 7f0fa97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:11:41.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.015+0000 7f10f740e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:11:41.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.015+0000 7f10f740e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:11:41.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.055+0000 7f0f23fff640 20 reqs_thread_entry: start 2024-09-12T18:11:41.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.055+0000 7f10f740e800 20 init_complete bucket index max shards: 11 2024-09-12T18:11:41.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.055+0000 7f10f740e800 20 Filter name: none 2024-09-12T18:11:41.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.055+0000 7f0f21ffb640 20 reqs_thread_entry: start 2024-09-12T18:11:41.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.055+0000 7f10f740e800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T18:11:41.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.057+0000 7f10f740e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:11:41.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.057+0000 7f10f740e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:11:41.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.058+0000 7f10f740e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-12T18:11:41.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.058+0000 7f10f740e800 20 garbage collection: RGWGC::process iterating over entry tag='722b129a-cf7a-4aca-b594-5b9492d130e2.4623.15512294312928701461', time=2024-09-12T19:49:18.556548+0000, chain.objs.size()=3 2024-09-12T18:11:41.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.058+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.162__multipart_foo-LUKEWARM.2~Ppb9URtmyjPmkt5AyWT9kBm-x1j01F9.1 2024-09-12T18:11:41.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.058+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.162__multipart_foo-LUKEWARM.2~Ppb9URtmyjPmkt5AyWT9kBm-x1j01F9.2 2024-09-12T18:11:41.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.058+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.162__multipart_foo-LUKEWARM.2~Ppb9URtmyjPmkt5AyWT9kBm-x1j01F9.3 2024-09-12T18:11:41.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.058+0000 7f10f740e800 20 garbage collection: RGWGC::process iterating over entry tag='722b129a-cf7a-4aca-b594-5b9492d130e2.4623.11920823989081000949', time=2024-09-12T19:49:26.772483+0000, chain.objs.size()=2 2024-09-12T18:11:41.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.058+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.165__multipart_foo.2~MIezFo_Ymy0rF1YF0pNA95RV5l336g8.1 2024-09-12T18:11:41.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.058+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.165__multipart_foo.2~MIezFo_Ymy0rF1YF0pNA95RV5l336g8.2 2024-09-12T18:11:41.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.058+0000 7f10f740e800 20 garbage collection: RGWGC::process iterating over entry tag='722b129a-cf7a-4aca-b594-5b9492d130e2.4623.8055004385591958370', time=2024-09-12T19:58:13.454156+0000, chain.objs.size()=3 2024-09-12T18:11:41.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.058+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.524__multipart_mymultipart.2~y0PJcsbJs4fSqx5PuM-P3BDOh22EIaH.1 2024-09-12T18:11:41.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.058+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.524__multipart_mymultipart.2~y0PJcsbJs4fSqx5PuM-P3BDOh22EIaH.2 2024-09-12T18:11:41.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.058+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.524__multipart_mymultipart.2~y0PJcsbJs4fSqx5PuM-P3BDOh22EIaH.3 2024-09-12T18:11:41.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.058+0000 7f10f740e800 20 garbage collection: RGWGC::process iterating over entry tag='722b129a-cf7a-4aca-b594-5b9492d130e2.4623.12251741533795979637', time=2024-09-12T20:07:02.300436+0000, chain.objs.size()=1 2024-09-12T18:11:41.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.058+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.743__multipart_mymultipart3.2~V5pkL1Zd-2GfOZz9pCNT7IkdJmhlrF2.1 2024-09-12T18:11:41.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.058+0000 7f10f740e800 20 garbage collection: RGWGC::process iterating over entry tag='2~8scz608HkNK5w_ApgySWHHWjjbyKI-l', time=2024-09-12T20:07:02.420876+0000, chain.objs.size()=1 2024-09-12T18:11:41.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.058+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.743__multipart_mymultipart2.2~8scz608HkNK5w_ApgySWHHWjjbyKI-l.1 2024-09-12T18:11:41.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.063+0000 7f10f740e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:11:41.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.066+0000 7f10f740e800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T18:11:41.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.068+0000 7f10f740e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:11:41.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.069+0000 7f10f740e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:11:41.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.069+0000 7f10f740e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T18:11:41.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.069+0000 7f10f740e800 20 garbage collection: RGWGC::process iterating over entry tag='722b129a-cf7a-4aca-b594-5b9492d130e2.4623.6045071746327809732', time=2024-09-12T19:49:21.109020+0000, chain.objs.size()=3 2024-09-12T18:11:41.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.069+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.162__multipart_foo-FROZEN.2~-V-VjfdAiXvzOBlnVWu1OIRDgV8Ew37.1 2024-09-12T18:11:41.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.069+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.162__multipart_foo-FROZEN.2~-V-VjfdAiXvzOBlnVWu1OIRDgV8Ew37.2 2024-09-12T18:11:41.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.069+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.162__multipart_foo-FROZEN.2~-V-VjfdAiXvzOBlnVWu1OIRDgV8Ew37.3 2024-09-12T18:11:41.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.069+0000 7f10f740e800 20 garbage collection: RGWGC::process iterating over entry tag='_JhNIJaV9s2G0GHKC4yqp5dUTM_vbyBN', time=2024-09-12T19:49:27.007699+0000, chain.objs.size()=1 2024-09-12T18:11:41.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.069+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.166__shadow_.5-imfo11zQ9aEV3f_eBcVxOBBSCdaC__0 2024-09-12T18:11:41.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.069+0000 7f10f740e800 20 garbage collection: RGWGC::process iterating over entry tag='722b129a-cf7a-4aca-b594-5b9492d130e2.4623.6934605971645734967', time=2024-09-12T19:56:49.358074+0000, chain.objs.size()=1 2024-09-12T18:11:41.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.069+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.518__shadow_.vvyLKUgCwIVyiL3fufrF4xwvnFDWeTg_1 2024-09-12T18:11:41.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.069+0000 7f10f740e800 20 garbage collection: RGWGC::process iterating over entry tag='722b129a-cf7a-4aca-b594-5b9492d130e2.4623.12369922319167622081', time=2024-09-12T19:58:26.418840+0000, chain.objs.size()=2 2024-09-12T18:11:41.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.069+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.526__multipart_mymultipart.2~x3ZqnzsKd8YyEW220tp7Z0v6AywEq9I.1 2024-09-12T18:11:41.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.069+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.526__multipart_mymultipart.2~x3ZqnzsKd8YyEW220tp7Z0v6AywEq9I.2 2024-09-12T18:11:41.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.073+0000 7f10f740e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:11:41.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.076+0000 7f10f740e800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T18:11:41.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.077+0000 7f10f740e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:11:41.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.078+0000 7f10f740e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:11:41.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.078+0000 7f10f740e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-12T18:11:41.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.078+0000 7f10f740e800 20 garbage collection: RGWGC::process iterating over entry tag='_rARWqQGdCeZkQRnOHwvQsClVAgROwxQ', time=2024-09-12T19:49:21.651757+0000, chain.objs.size()=2 2024-09-12T18:11:41.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.078+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.162__shadow_.XcPRcUQKFayonxq6ws0XEadflqkoAuA_1 2024-09-12T18:11:41.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.078+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.162__shadow_.XcPRcUQKFayonxq6ws0XEadflqkoAuA_2 2024-09-12T18:11:41.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.078+0000 7f10f740e800 20 garbage collection: RGWGC::process iterating over entry tag='_zjmJdy_QK6ibGI_2o4_pI0_1gnwRaVi', time=2024-09-12T19:49:22.082588+0000, chain.objs.size()=2 2024-09-12T18:11:41.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.078+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.162__shadow_.Y9Va1xjNW--JyMqTsDJIp2lSGtukTOx_0 2024-09-12T18:11:41.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.078+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.162__shadow_.Y9Va1xjNW--JyMqTsDJIp2lSGtukTOx_1 2024-09-12T18:11:41.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.078+0000 7f10f740e800 20 garbage collection: RGWGC::process iterating over entry tag='_-NjRgM0SVxgdeljNFSLcUYQ-5mDBnDs', time=2024-09-12T19:49:24.859855+0000, chain.objs.size()=1 2024-09-12T18:11:41.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.078+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.164__shadow_.lj6o7YCDgnCP-bFECzeBcZwzKS47Szn_0 2024-09-12T18:11:41.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.078+0000 7f10f740e800 20 garbage collection: RGWGC::process iterating over entry tag='722b129a-cf7a-4aca-b594-5b9492d130e2.4623.2269010229280611688', time=2024-09-12T19:57:15.094704+0000, chain.objs.size()=3 2024-09-12T18:11:41.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.078+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.522__multipart_mymultipart.2~6jtwfaSSn45q6QXHOfrrO6r49YogFvc.1 2024-09-12T18:11:41.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.078+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.522__multipart_mymultipart.2~6jtwfaSSn45q6QXHOfrrO6r49YogFvc.2 2024-09-12T18:11:41.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.078+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.522__multipart_mymultipart.2~6jtwfaSSn45q6QXHOfrrO6r49YogFvc.3 2024-09-12T18:11:41.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.078+0000 7f10f740e800 20 garbage collection: RGWGC::process iterating over entry tag='722b129a-cf7a-4aca-b594-5b9492d130e2.4623.6132510377660230397', time=2024-09-12T19:59:23.562112+0000, chain.objs.size()=1 2024-09-12T18:11:41.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.078+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.553__shadow_.UxxxiSYPZWgYsWCIq27Ng8hNSc3eQHF_1 2024-09-12T18:11:41.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.082+0000 7f10f740e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:11:41.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.085+0000 7f10f740e800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T18:11:41.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.086+0000 7f10f740e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:11:41.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.087+0000 7f10f740e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:11:41.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.087+0000 7f10f740e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T18:11:41.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.087+0000 7f10f740e800 20 garbage collection: RGWGC::process iterating over entry tag='722b129a-cf7a-4aca-b594-5b9492d130e2.4623.16858678526771375803', time=2024-09-12T20:05:49.421790+0000, chain.objs.size()=6 2024-09-12T18:11:41.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.087+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.662__multipart_baz.2~uCUgECaVJ_dT65eVZgO04CiRh0bkmDG.1 2024-09-12T18:11:41.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.087+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.662__multipart_baz.2~uCUgECaVJ_dT65eVZgO04CiRh0bkmDG.2 2024-09-12T18:11:41.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.087+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.662__multipart_baz.2~uCUgECaVJ_dT65eVZgO04CiRh0bkmDG.3 2024-09-12T18:11:41.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.087+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.662__multipart_baz.2~uCUgECaVJ_dT65eVZgO04CiRh0bkmDG.4 2024-09-12T18:11:41.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.087+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.662__multipart_baz.2~uCUgECaVJ_dT65eVZgO04CiRh0bkmDG.5 2024-09-12T18:11:41.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.087+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.662__multipart_baz.2~uCUgECaVJ_dT65eVZgO04CiRh0bkmDG.6 2024-09-12T18:11:41.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.091+0000 7f10f740e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:11:41.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.093+0000 7f10f740e800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T18:11:41.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.094+0000 7f10f740e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:11:41.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.095+0000 7f10f740e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:11:41.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.095+0000 7f10f740e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T18:11:41.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.095+0000 7f10f740e800 20 garbage collection: RGWGC::process iterating over entry tag='_sW_mkfHfntgwK2BDKchwMEWicnvs0mN', time=2024-09-12T19:49:24.886672+0000, chain.objs.size()=1 2024-09-12T18:11:41.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.095+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.164__shadow_.9K2in7cpwZI0x6mqPM8zX2udG5CbTAi_0 2024-09-12T18:11:41.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.095+0000 7f10f740e800 20 garbage collection: RGWGC::process iterating over entry tag='722b129a-cf7a-4aca-b594-5b9492d130e2.4623.10994968006259040010', time=2024-09-12T19:56:47.509859+0000, chain.objs.size()=1 2024-09-12T18:11:41.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.095+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.519__multipart_mymultipart.2~ey12bcKPKfq9DHQc-TJUKi_DAfSjQDE.1 2024-09-12T18:11:41.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.097+0000 7f10f740e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:11:41.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.099+0000 7f10f740e800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T18:11:41.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.101+0000 7f10f740e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:11:41.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.101+0000 7f10f740e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:11:41.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.101+0000 7f10f740e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T18:11:41.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.101+0000 7f10f740e800 20 garbage collection: RGWGC::process iterating over entry tag='722b129a-cf7a-4aca-b594-5b9492d130e2.4623.5150079882685815060', time=2024-09-12T19:58:25.457569+0000, chain.objs.size()=3 2024-09-12T18:11:41.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.101+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.526__multipart_mymultipart.2~59uGYq5T8ARj3SRwxrKuOHBKT4x6oxW.1 2024-09-12T18:11:41.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.101+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.526__multipart_mymultipart.2~59uGYq5T8ARj3SRwxrKuOHBKT4x6oxW.2 2024-09-12T18:11:41.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.101+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.526__multipart_mymultipart.2~59uGYq5T8ARj3SRwxrKuOHBKT4x6oxW.3 2024-09-12T18:11:41.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.102+0000 7f10f740e800 20 garbage collection: RGWGC::process iterating over entry tag='722b129a-cf7a-4aca-b594-5b9492d130e2.4623.4873621334541903304', time=2024-09-12T19:58:30.841702+0000, chain.objs.size()=4 2024-09-12T18:11:41.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.102+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.528__multipart_mymultipart.2~bOQQjjSMmoaxGgP2voITMjEfueh-Xf4.1 2024-09-12T18:11:41.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.102+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.528__multipart_mymultipart.2~bOQQjjSMmoaxGgP2voITMjEfueh-Xf4.2 2024-09-12T18:11:41.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.102+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.528__multipart_mymultipart.2~bOQQjjSMmoaxGgP2voITMjEfueh-Xf4.3 2024-09-12T18:11:41.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.102+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.528__multipart_mymultipart.2~bOQQjjSMmoaxGgP2voITMjEfueh-Xf4.4 2024-09-12T18:11:41.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.105+0000 7f10f740e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:11:41.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.108+0000 7f10f740e800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T18:11:41.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.109+0000 7f10f740e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:11:41.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.109+0000 7f10f740e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:11:41.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.110+0000 7f10f740e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=7, truncated=0, next_marker='' 2024-09-12T18:11:41.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.110+0000 7f10f740e800 20 garbage collection: RGWGC::process iterating over entry tag='722b129a-cf7a-4aca-b594-5b9492d130e2.4623.15302798170424152043', time=2024-09-12T19:49:08.666728+0000, chain.objs.size()=3 2024-09-12T18:11:41.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.110+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.160__multipart_mymultipart-LUKEWARM.2~1UmI5XNXwyQf1eLPr0WIWdR8jZlLtBW.1 2024-09-12T18:11:41.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.110+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.160__multipart_mymultipart-LUKEWARM.2~1UmI5XNXwyQf1eLPr0WIWdR8jZlLtBW.2 2024-09-12T18:11:41.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.110+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.160__multipart_mymultipart-LUKEWARM.2~1UmI5XNXwyQf1eLPr0WIWdR8jZlLtBW.3 2024-09-12T18:11:41.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.110+0000 7f10f740e800 20 garbage collection: RGWGC::process iterating over entry tag='722b129a-cf7a-4aca-b594-5b9492d130e2.4623.8767380619011320966', time=2024-09-12T19:56:58.786575+0000, chain.objs.size()=6 2024-09-12T18:11:41.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.110+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.520__multipart_mymultipart.2~Fbra4aANDkECHOvKDrdFq-dxtfYWt2_.1 2024-09-12T18:11:41.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.110+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.520__multipart_mymultipart.2~Fbra4aANDkECHOvKDrdFq-dxtfYWt2_.2 2024-09-12T18:11:41.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.110+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.520__multipart_mymultipart.2~Fbra4aANDkECHOvKDrdFq-dxtfYWt2_.3 2024-09-12T18:11:41.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.110+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.520__multipart_mymultipart.2~Fbra4aANDkECHOvKDrdFq-dxtfYWt2_.4 2024-09-12T18:11:41.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.110+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.520__multipart_mymultipart.2~Fbra4aANDkECHOvKDrdFq-dxtfYWt2_.5 2024-09-12T18:11:41.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.110+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.520__multipart_mymultipart.2~Fbra4aANDkECHOvKDrdFq-dxtfYWt2_.6 2024-09-12T18:11:41.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.110+0000 7f10f740e800 20 garbage collection: RGWGC::process iterating over entry tag='722b129a-cf7a-4aca-b594-5b9492d130e2.4623.6153864666896077229', time=2024-09-12T19:57:13.656739+0000, chain.objs.size()=3 2024-09-12T18:11:41.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.110+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.522__multipart_mymultipart.2~JIV-7oZWFODnm6o_U6WsG31Wr2W2Cro.1 2024-09-12T18:11:41.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.110+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.522__multipart_mymultipart.2~JIV-7oZWFODnm6o_U6WsG31Wr2W2Cro.2 2024-09-12T18:11:41.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.111+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.522__multipart_mymultipart.2~JIV-7oZWFODnm6o_U6WsG31Wr2W2Cro.3 2024-09-12T18:11:41.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.114+0000 7f10f740e800 20 garbage collection: RGWGC::process iterating over entry tag='722b129a-cf7a-4aca-b594-5b9492d130e2.4623.17658143894414384708', time=2024-09-12T19:57:28.291061+0000, chain.objs.size()=6 2024-09-12T18:11:41.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.114+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.523__multipart_mymultipart.bliZDUfMKvF_rnW6AHL7udgTO8AuXMpg.1 2024-09-12T18:11:41.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.117+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.523__multipart_mymultipart.2~5FY_sUgmZ2t7JQrzKstw7t0UIoXyJs_.2 2024-09-12T18:11:41.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.117+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.523__multipart_mymultipart.2~5FY_sUgmZ2t7JQrzKstw7t0UIoXyJs_.3 2024-09-12T18:11:41.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.117+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.523__multipart_mymultipart.2~5FY_sUgmZ2t7JQrzKstw7t0UIoXyJs_.4 2024-09-12T18:11:41.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.117+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.523__multipart_mymultipart.2~5FY_sUgmZ2t7JQrzKstw7t0UIoXyJs_.5 2024-09-12T18:11:41.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.117+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.523__multipart_mymultipart.2~5FY_sUgmZ2t7JQrzKstw7t0UIoXyJs_.6 2024-09-12T18:11:41.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.117+0000 7f10f740e800 20 garbage collection: RGWGC::process iterating over entry tag='2~sFQu7wDVU6u35wh_3jA-GV8ZxfXd1jV', time=2024-09-12T19:58:27.487551+0000, chain.objs.size()=10 2024-09-12T18:11:41.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.117+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.527__multipart_mymultipart.2~sFQu7wDVU6u35wh_3jA-GV8ZxfXd1jV.1 2024-09-12T18:11:41.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.117+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.527__multipart_mymultipart.2~sFQu7wDVU6u35wh_3jA-GV8ZxfXd1jV.2 2024-09-12T18:11:41.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.117+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.527__multipart_mymultipart.2~sFQu7wDVU6u35wh_3jA-GV8ZxfXd1jV.3 2024-09-12T18:11:41.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.117+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.527__multipart_mymultipart.2~sFQu7wDVU6u35wh_3jA-GV8ZxfXd1jV.4 2024-09-12T18:11:41.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.117+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.527__multipart_mymultipart.2~sFQu7wDVU6u35wh_3jA-GV8ZxfXd1jV.5 2024-09-12T18:11:41.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.117+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.527__multipart_mymultipart.2~sFQu7wDVU6u35wh_3jA-GV8ZxfXd1jV.6 2024-09-12T18:11:41.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.120+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.527__multipart_mymultipart.2~sFQu7wDVU6u35wh_3jA-GV8ZxfXd1jV.7 2024-09-12T18:11:41.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.123+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.527__multipart_mymultipart.2~sFQu7wDVU6u35wh_3jA-GV8ZxfXd1jV.8 2024-09-12T18:11:41.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.123+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.527__multipart_mymultipart.2~sFQu7wDVU6u35wh_3jA-GV8ZxfXd1jV.9 2024-09-12T18:11:41.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.123+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.527__multipart_mymultipart.2~sFQu7wDVU6u35wh_3jA-GV8ZxfXd1jV.10 2024-09-12T18:11:41.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.123+0000 7f10f740e800 20 garbage collection: RGWGC::process iterating over entry tag='722b129a-cf7a-4aca-b594-5b9492d130e2.4623.17297411192148294804', time=2024-09-12T19:59:41.636836+0000, chain.objs.size()=1 2024-09-12T18:11:41.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.123+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.562__multipart_mymultipart.2~krRz61n5V69FZnLIvuJv4h1fg1ia6xZ.1 2024-09-12T18:11:41.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.123+0000 7f10f740e800 20 garbage collection: RGWGC::process iterating over entry tag='722b129a-cf7a-4aca-b594-5b9492d130e2.4623.15590735269552571820', time=2024-09-12T20:01:44.280131+0000, chain.objs.size()=6 2024-09-12T18:11:41.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.123+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.614__multipart_multipart_enc.2~dCghHWs1mFcEeEQkjsdQs2ggKWUam88.1 2024-09-12T18:11:41.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.123+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.614__multipart_multipart_enc.2~dCghHWs1mFcEeEQkjsdQs2ggKWUam88.2 2024-09-12T18:11:41.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.123+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.614__multipart_multipart_enc.2~dCghHWs1mFcEeEQkjsdQs2ggKWUam88.3 2024-09-12T18:11:41.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.123+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.614__multipart_multipart_enc.2~dCghHWs1mFcEeEQkjsdQs2ggKWUam88.4 2024-09-12T18:11:41.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.123+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.614__multipart_multipart_enc.2~dCghHWs1mFcEeEQkjsdQs2ggKWUam88.5 2024-09-12T18:11:41.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.123+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.614__multipart_multipart_enc.2~dCghHWs1mFcEeEQkjsdQs2ggKWUam88.6 2024-09-12T18:11:41.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.132+0000 7f10f740e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:11:41.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.134+0000 7f10f740e800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T18:11:41.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.135+0000 7f10f740e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:11:41.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.136+0000 7f10f740e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:11:41.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.136+0000 7f10f740e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T18:11:41.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.136+0000 7f10f740e800 20 garbage collection: RGWGC::process iterating over entry tag='_nxEBUpt0_aTLXGlYb6Nr9mki6N_1BG_', time=2024-09-12T19:49:09.901565+0000, chain.objs.size()=1 2024-09-12T18:11:41.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.136+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.161__shadow_.i9SfC2ru17kkdV-Pxp242cSbsiVb5gZ_0 2024-09-12T18:11:41.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.136+0000 7f10f740e800 20 garbage collection: RGWGC::process iterating over entry tag='722b129a-cf7a-4aca-b594-5b9492d130e2.4623.670901900768108370', time=2024-09-12T19:58:10.428074+0000, chain.objs.size()=2 2024-09-12T18:11:41.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.136+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.524__multipart_mymultipart.2~zNlwmNCTPNuT1xrJnZXILtd9n7M6cRz.1 2024-09-12T18:11:41.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.136+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.524__multipart_mymultipart.2~zNlwmNCTPNuT1xrJnZXILtd9n7M6cRz.2 2024-09-12T18:11:41.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.138+0000 7f10f740e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:11:41.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.140+0000 7f10f740e800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T18:11:41.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.142+0000 7f10f740e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:11:41.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.143+0000 7f10f740e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:11:41.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.143+0000 7f10f740e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T18:11:41.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.143+0000 7f10f740e800 20 garbage collection: RGWGC::process iterating over entry tag='722b129a-cf7a-4aca-b594-5b9492d130e2.4623.16088009546759508596', time=2024-09-12T19:56:37.196241+0000, chain.objs.size()=6 2024-09-12T18:11:41.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.143+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.508__multipart_srcmultipart.2~TWrn3SHL18yC1d0_4aLZUs9GBdDgGU8.1 2024-09-12T18:11:41.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.143+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.508__multipart_srcmultipart.2~TWrn3SHL18yC1d0_4aLZUs9GBdDgGU8.2 2024-09-12T18:11:41.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.143+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.508__multipart_srcmultipart.2~TWrn3SHL18yC1d0_4aLZUs9GBdDgGU8.3 2024-09-12T18:11:41.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.143+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.508__multipart_srcmultipart.2~TWrn3SHL18yC1d0_4aLZUs9GBdDgGU8.4 2024-09-12T18:11:41.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.143+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.508__multipart_srcmultipart.2~TWrn3SHL18yC1d0_4aLZUs9GBdDgGU8.5 2024-09-12T18:11:41.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.143+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.508__multipart_srcmultipart.2~TWrn3SHL18yC1d0_4aLZUs9GBdDgGU8.6 2024-09-12T18:11:41.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.143+0000 7f10f740e800 20 garbage collection: RGWGC::process iterating over entry tag='722b129a-cf7a-4aca-b594-5b9492d130e2.4623.11991842715983750792', time=2024-09-12T19:57:40.139196+0000, chain.objs.size()=6 2024-09-12T18:11:41.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.143+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.523__multipart_mymultipart.2~sQ9dZquY8Ag16AKgSFwATDiXH03dr18.1 2024-09-12T18:11:41.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.143+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.523__multipart_mymultipart.sBgZeI_WCvMtQeyuRwp_UYiavydvLofO.2 2024-09-12T18:11:41.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.143+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.523__multipart_mymultipart.2~sQ9dZquY8Ag16AKgSFwATDiXH03dr18.3 2024-09-12T18:11:41.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.143+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.523__multipart_mymultipart.2~sQ9dZquY8Ag16AKgSFwATDiXH03dr18.4 2024-09-12T18:11:41.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.143+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.523__multipart_mymultipart.2~sQ9dZquY8Ag16AKgSFwATDiXH03dr18.5 2024-09-12T18:11:41.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.143+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.523__multipart_mymultipart.2~sQ9dZquY8Ag16AKgSFwATDiXH03dr18.6 2024-09-12T18:11:41.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.148+0000 7f10f740e800 20 garbage collection: RGWGC::process iterating over entry tag='2~a4A0IfaVR3LSJqTrVw2hMh7l_8KGpUL', time=2024-09-12T20:07:02.406276+0000, chain.objs.size()=1 2024-09-12T18:11:41.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.148+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.743__multipart_mymultipart.2~a4A0IfaVR3LSJqTrVw2hMh7l_8KGpUL.1 2024-09-12T18:11:41.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.151+0000 7f10f740e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:11:41.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.153+0000 7f10f740e800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T18:11:41.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.155+0000 7f10f740e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:11:41.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.155+0000 7f10f740e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:11:41.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.155+0000 7f10f740e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T18:11:41.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.155+0000 7f10f740e800 20 garbage collection: RGWGC::process iterating over entry tag='2~JvXJuLHi7Qr6lJ4sxdTfBr0fg03qmt7', time=2024-09-12T19:58:39.747277+0000, chain.objs.size()=2 2024-09-12T18:11:41.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.155+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.532__multipart_mymultipart.2~JvXJuLHi7Qr6lJ4sxdTfBr0fg03qmt7.1 2024-09-12T18:11:41.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.155+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.532__multipart_mymultipart.2~JvXJuLHi7Qr6lJ4sxdTfBr0fg03qmt7.2 2024-09-12T18:11:41.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.155+0000 7f10f740e800 20 garbage collection: RGWGC::process iterating over entry tag='722b129a-cf7a-4aca-b594-5b9492d130e2.4623.10269016419592729369', time=2024-09-12T19:59:30.572587+0000, chain.objs.size()=1 2024-09-12T18:11:41.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.155+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.556__shadow_.LaPG-_Pom2ffw3tIUhTv9_DRwgav9PP_1 2024-09-12T18:11:41.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.155+0000 7f10f740e800 20 garbage collection: RGWGC::process iterating over entry tag='722b129a-cf7a-4aca-b594-5b9492d130e2.4623.12951932205394128063', time=2024-09-12T20:06:18.820527+0000, chain.objs.size()=1 2024-09-12T18:11:41.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.155+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.712__multipart_file1.2~elZnnRlYBlk9oS4t_OfYbetRoIsF0By.1 2024-09-12T18:11:41.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.158+0000 7f10f740e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:11:41.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.160+0000 7f10f740e800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T18:11:41.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.162+0000 7f10f740e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:11:41.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.162+0000 7f10f740e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:11:41.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.162+0000 7f10f740e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T18:11:41.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.162+0000 7f10f740e800 20 garbage collection: RGWGC::process iterating over entry tag='722b129a-cf7a-4aca-b594-5b9492d130e2.4623.9385791526983599689', time=2024-09-12T19:49:08.694594+0000, chain.objs.size()=3 2024-09-12T18:11:41.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.162+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.160__multipart_mymultipart-STANDARD.2~ZOcdGzvp2I3VD7kYBKTXRSwQrDjGJIO.1 2024-09-12T18:11:41.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.162+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.160__multipart_mymultipart-STANDARD.2~ZOcdGzvp2I3VD7kYBKTXRSwQrDjGJIO.2 2024-09-12T18:11:41.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.162+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.160__multipart_mymultipart-STANDARD.2~ZOcdGzvp2I3VD7kYBKTXRSwQrDjGJIO.3 2024-09-12T18:11:41.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.162+0000 7f10f740e800 20 garbage collection: RGWGC::process iterating over entry tag='722b129a-cf7a-4aca-b594-5b9492d130e2.4623.3744006218020893606', time=2024-09-12T19:56:37.480134+0000, chain.objs.size()=6 2024-09-12T18:11:41.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.162+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.508__multipart_srcmultipart.2~TWrn3SHL18yC1d0_4aLZUs9GBdDgGU8.1 2024-09-12T18:11:41.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.162+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.508__multipart_srcmultipart.2~TWrn3SHL18yC1d0_4aLZUs9GBdDgGU8.2 2024-09-12T18:11:41.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.162+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.508__multipart_srcmultipart.2~TWrn3SHL18yC1d0_4aLZUs9GBdDgGU8.3 2024-09-12T18:11:41.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.162+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.508__multipart_srcmultipart.2~TWrn3SHL18yC1d0_4aLZUs9GBdDgGU8.4 2024-09-12T18:11:41.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.162+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.508__multipart_srcmultipart.2~TWrn3SHL18yC1d0_4aLZUs9GBdDgGU8.5 2024-09-12T18:11:41.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.163+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.508__multipart_srcmultipart.2~TWrn3SHL18yC1d0_4aLZUs9GBdDgGU8.6 2024-09-12T18:11:41.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.163+0000 7f10f740e800 20 garbage collection: RGWGC::process iterating over entry tag='722b129a-cf7a-4aca-b594-5b9492d130e2.4623.7051673353194945542', time=2024-09-12T19:57:51.455888+0000, chain.objs.size()=6 2024-09-12T18:11:41.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.163+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.523__multipart_mymultipart.2~mmxBcvPWLHISI2kDVD3N2IM6NeKyyGG.1 2024-09-12T18:11:41.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.163+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.523__multipart_mymultipart.2~mmxBcvPWLHISI2kDVD3N2IM6NeKyyGG.2 2024-09-12T18:11:41.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.163+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.523__multipart_mymultipart.if4AZd9-sXr7pRnG54NCyACXlX6ryn-t.3 2024-09-12T18:11:41.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.167+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.523__multipart_mymultipart.2~mmxBcvPWLHISI2kDVD3N2IM6NeKyyGG.4 2024-09-12T18:11:41.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.167+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.523__multipart_mymultipart.2~mmxBcvPWLHISI2kDVD3N2IM6NeKyyGG.5 2024-09-12T18:11:41.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.167+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.523__multipart_mymultipart.2~mmxBcvPWLHISI2kDVD3N2IM6NeKyyGG.6 2024-09-12T18:11:41.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.170+0000 7f10f740e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:11:41.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.173+0000 7f10f740e800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T18:11:41.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.174+0000 7f10f740e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:11:41.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.174+0000 7f10f740e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:11:41.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.175+0000 7f10f740e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=7, truncated=0, next_marker='' 2024-09-12T18:11:41.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.175+0000 7f10f740e800 20 garbage collection: RGWGC::process iterating over entry tag='_kWjjfZQJVHI6BRu1H-yYzmn6k0wMynr', time=2024-09-12T19:49:14.020875+0000, chain.objs.size()=2 2024-09-12T18:11:41.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.175+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.161__shadow_.glsgnlzdI3xf8z9CRW7G2vSJ5xfQ_ZE_0 2024-09-12T18:11:41.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.175+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.161__shadow_.glsgnlzdI3xf8z9CRW7G2vSJ5xfQ_ZE_1 2024-09-12T18:11:41.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.175+0000 7f10f740e800 20 garbage collection: RGWGC::process iterating over entry tag='_r1iD0yc3XPKx1sNvrKwJJAwaAqILIR3', time=2024-09-12T19:49:16.542442+0000, chain.objs.size()=2 2024-09-12T18:11:41.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.175+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.162__shadow_.RGoMciDIp_kLHy7VBbqkQ8f1k6uvHV-_0 2024-09-12T18:11:41.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.175+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.162__shadow_.RGoMciDIp_kLHy7VBbqkQ8f1k6uvHV-_1 2024-09-12T18:11:41.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.175+0000 7f10f740e800 20 garbage collection: RGWGC::process iterating over entry tag='722b129a-cf7a-4aca-b594-5b9492d130e2.4623.10786102372035025457', time=2024-09-12T19:56:42.736801+0000, chain.objs.size()=1 2024-09-12T18:11:41.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.175+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.517__multipart_mymultipartcopy.2~Z3nNgkIbDe3ym1NXkNROvdx8o_gHx9m.1 2024-09-12T18:11:41.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.175+0000 7f10f740e800 20 garbage collection: RGWGC::process iterating over entry tag='722b129a-cf7a-4aca-b594-5b9492d130e2.4623.3529202577538928987', time=2024-09-12T19:57:10.994256+0000, chain.objs.size()=3 2024-09-12T18:11:41.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.175+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.522__multipart_mymultipart.2~ziUZhirq9sbXHexE99RZRxt4FbCwYMM.1 2024-09-12T18:11:41.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.175+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.522__multipart_mymultipart.2~ziUZhirq9sbXHexE99RZRxt4FbCwYMM.2 2024-09-12T18:11:41.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.175+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.522__multipart_mymultipart.2~ziUZhirq9sbXHexE99RZRxt4FbCwYMM.3 2024-09-12T18:11:41.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.175+0000 7f10f740e800 20 garbage collection: RGWGC::process iterating over entry tag='2~3ugRERhN9RDyFN9T70gDNysCfrs8Ao-', time=2024-09-12T19:58:44.881482+0000, chain.objs.size()=1 2024-09-12T18:11:41.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.175+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.536__multipart_mymultipart.2~3ugRERhN9RDyFN9T70gDNysCfrs8Ao-.3 2024-09-12T18:11:41.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.175+0000 7f10f740e800 20 garbage collection: RGWGC::process iterating over entry tag='2~Iyx-YyYOqUoJQgaLv82GW2y5D5PLKtV', time=2024-09-12T20:04:59.834651+0000, chain.objs.size()=6 2024-09-12T18:11:41.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.175+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.626__multipart_multipart_enc.2~Iyx-YyYOqUoJQgaLv82GW2y5D5PLKtV.1 2024-09-12T18:11:41.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.175+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.626__multipart_multipart_enc.2~Iyx-YyYOqUoJQgaLv82GW2y5D5PLKtV.2 2024-09-12T18:11:41.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.175+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.626__multipart_multipart_enc.2~Iyx-YyYOqUoJQgaLv82GW2y5D5PLKtV.3 2024-09-12T18:11:41.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.180+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.626__multipart_multipart_enc.2~Iyx-YyYOqUoJQgaLv82GW2y5D5PLKtV.4 2024-09-12T18:11:41.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.180+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.626__multipart_multipart_enc.2~Iyx-YyYOqUoJQgaLv82GW2y5D5PLKtV.5 2024-09-12T18:11:41.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.180+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.626__multipart_multipart_enc.2~Iyx-YyYOqUoJQgaLv82GW2y5D5PLKtV.6 2024-09-12T18:11:41.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.180+0000 7f10f740e800 20 garbage collection: RGWGC::process iterating over entry tag='722b129a-cf7a-4aca-b594-5b9492d130e2.4623.12540722331029627356', time=2024-09-12T20:07:05.814491+0000, chain.objs.size()=3 2024-09-12T18:11:41.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.180+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.744__multipart_mymultipart3.2~hpdCPZ3_Wfk5Sq5KfiAhW7Aj7PQbFWt.1 2024-09-12T18:11:41.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.180+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.744__multipart_mymultipart3.2~hpdCPZ3_Wfk5Sq5KfiAhW7Aj7PQbFWt.2 2024-09-12T18:11:41.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.180+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.744__multipart_mymultipart3.2~hpdCPZ3_Wfk5Sq5KfiAhW7Aj7PQbFWt.3 2024-09-12T18:11:41.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.184+0000 7f10f740e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:11:41.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.187+0000 7f10f740e800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T18:11:41.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.188+0000 7f10f740e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:11:41.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.189+0000 7f10f740e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:11:41.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.189+0000 7f10f740e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=10, truncated=0, next_marker='' 2024-09-12T18:11:41.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.189+0000 7f10f740e800 20 garbage collection: RGWGC::process iterating over entry tag='_dXIASwa3C8YXFTPC6FjEVIXrh2_yk7g', time=2024-09-12T19:49:14.073731+0000, chain.objs.size()=1 2024-09-12T18:11:41.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.189+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.161__shadow_.NErPMUBGYY6NRzXWpP3SmJXhgfps6rO_0 2024-09-12T18:11:41.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.189+0000 7f10f740e800 20 garbage collection: RGWGC::process iterating over entry tag='_OOsCajc9BqgAJ8tuEun5vj8CZLg3Oiw', time=2024-09-12T19:49:19.114944+0000, chain.objs.size()=2 2024-09-12T18:11:41.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.189+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.162__shadow_.L3ZlE8_mSwerIJwbd4lc_x4lbXBYaYw_1 2024-09-12T18:11:41.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.189+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.162__shadow_.L3ZlE8_mSwerIJwbd4lc_x4lbXBYaYw_2 2024-09-12T18:11:41.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.189+0000 7f10f740e800 20 garbage collection: RGWGC::process iterating over entry tag='2~lsgdzcqPPVco-WZhcQS9zOkcmobDSC8', time=2024-09-12T19:58:02.720859+0000, chain.objs.size()=1 2024-09-12T18:11:41.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.189+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.523__multipart_mymultipart.2~lsgdzcqPPVco-WZhcQS9zOkcmobDSC8.1 2024-09-12T18:11:41.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.189+0000 7f10f740e800 20 garbage collection: RGWGC::process iterating over entry tag='2~lsgdzcqPPVco-WZhcQS9zOkcmobDSC8', time=2024-09-12T19:58:02.724268+0000, chain.objs.size()=1 2024-09-12T18:11:41.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.189+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.523__multipart_mymultipart.2~lsgdzcqPPVco-WZhcQS9zOkcmobDSC8.2 2024-09-12T18:11:41.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.189+0000 7f10f740e800 20 garbage collection: RGWGC::process iterating over entry tag='2~lsgdzcqPPVco-WZhcQS9zOkcmobDSC8', time=2024-09-12T19:58:02.727609+0000, chain.objs.size()=1 2024-09-12T18:11:41.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.189+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.523__multipart_mymultipart.2~lsgdzcqPPVco-WZhcQS9zOkcmobDSC8.3 2024-09-12T18:11:41.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.189+0000 7f10f740e800 20 garbage collection: RGWGC::process iterating over entry tag='2~lsgdzcqPPVco-WZhcQS9zOkcmobDSC8', time=2024-09-12T19:58:02.730917+0000, chain.objs.size()=1 2024-09-12T18:11:41.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.189+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.523__multipart_mymultipart.2~lsgdzcqPPVco-WZhcQS9zOkcmobDSC8.4 2024-09-12T18:11:41.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.189+0000 7f10f740e800 20 garbage collection: RGWGC::process iterating over entry tag='2~lsgdzcqPPVco-WZhcQS9zOkcmobDSC8', time=2024-09-12T19:58:02.734156+0000, chain.objs.size()=1 2024-09-12T18:11:41.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.189+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.523__multipart_mymultipart.2~lsgdzcqPPVco-WZhcQS9zOkcmobDSC8.5 2024-09-12T18:11:41.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.189+0000 7f10f740e800 20 garbage collection: RGWGC::process iterating over entry tag='2~lsgdzcqPPVco-WZhcQS9zOkcmobDSC8', time=2024-09-12T19:58:02.737377+0000, chain.objs.size()=1 2024-09-12T18:11:41.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.189+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.523__multipart_mymultipart.2~lsgdzcqPPVco-WZhcQS9zOkcmobDSC8.6 2024-09-12T18:11:41.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.189+0000 7f10f740e800 20 garbage collection: RGWGC::process iterating over entry tag='722b129a-cf7a-4aca-b594-5b9492d130e2.4623.17747732126455382855', time=2024-09-12T19:58:34.440449+0000, chain.objs.size()=2 2024-09-12T18:11:41.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.189+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.529__multipart_mymultipart.2~-bIJXclKLPFie53zZwAVEYeJ3CiXEJY.1 2024-09-12T18:11:41.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.189+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.529__multipart_mymultipart.2~-bIJXclKLPFie53zZwAVEYeJ3CiXEJY.2 2024-09-12T18:11:41.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.189+0000 7f10f740e800 20 garbage collection: RGWGC::process iterating over entry tag='722b129a-cf7a-4aca-b594-5b9492d130e2.4623.15434954944579770565', time=2024-09-12T20:06:57.271479+0000, chain.objs.size()=10 2024-09-12T18:11:41.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.189+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.736__multipart_foo.2~sQNEHGmVGMn_-Rb5eiSx7AwWcIC1fbh.1 2024-09-12T18:11:41.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.192+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.736__multipart_foo.2~sQNEHGmVGMn_-Rb5eiSx7AwWcIC1fbh.2 2024-09-12T18:11:41.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.195+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.736__multipart_foo.2~sQNEHGmVGMn_-Rb5eiSx7AwWcIC1fbh.3 2024-09-12T18:11:41.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.195+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.736__multipart_foo.2~sQNEHGmVGMn_-Rb5eiSx7AwWcIC1fbh.4 2024-09-12T18:11:41.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.195+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.736__multipart_foo.2~sQNEHGmVGMn_-Rb5eiSx7AwWcIC1fbh.5 2024-09-12T18:11:41.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.195+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.736__multipart_foo.2~sQNEHGmVGMn_-Rb5eiSx7AwWcIC1fbh.6 2024-09-12T18:11:41.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.195+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.736__multipart_foo.2~sQNEHGmVGMn_-Rb5eiSx7AwWcIC1fbh.7 2024-09-12T18:11:41.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.195+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.736__multipart_foo.2~sQNEHGmVGMn_-Rb5eiSx7AwWcIC1fbh.8 2024-09-12T18:11:41.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.195+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.736__multipart_foo.2~sQNEHGmVGMn_-Rb5eiSx7AwWcIC1fbh.9 2024-09-12T18:11:41.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.195+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.736__multipart_foo.2~sQNEHGmVGMn_-Rb5eiSx7AwWcIC1fbh.10 2024-09-12T18:11:41.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.200+0000 7f10f740e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:11:41.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.202+0000 7f10f740e800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T18:11:41.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.204+0000 7f10f740e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:11:41.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.204+0000 7f10f740e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:11:41.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.205+0000 7f10f740e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T18:11:41.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.205+0000 7f10f740e800 20 garbage collection: RGWGC::process iterating over entry tag='_mvp0_0xX1sYqK0mGAyIxhXJ-DZ8nn7f', time=2024-09-12T19:49:14.047606+0000, chain.objs.size()=2 2024-09-12T18:11:41.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.205+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.161__shadow_.bCaMbrpV8KSasT1oiPkZ4Hk3Ju_20pN_0 2024-09-12T18:11:41.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.205+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.161__shadow_.bCaMbrpV8KSasT1oiPkZ4Hk3Ju_20pN_1 2024-09-12T18:11:41.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.205+0000 7f10f740e800 20 garbage collection: RGWGC::process iterating over entry tag='2~FuixZj_6w1dUbPLCJ63dLm0-jmhrOZe', time=2024-09-12T19:58:36.305666+0000, chain.objs.size()=2 2024-09-12T18:11:41.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.205+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.530__multipart_mymultipart.2~FuixZj_6w1dUbPLCJ63dLm0-jmhrOZe.1 2024-09-12T18:11:41.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.205+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.530__multipart_mymultipart.2~FuixZj_6w1dUbPLCJ63dLm0-jmhrOZe.2 2024-09-12T18:11:41.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.205+0000 7f10f740e800 20 garbage collection: RGWGC::process iterating over entry tag='722b129a-cf7a-4aca-b594-5b9492d130e2.4623.8099752247673958906', time=2024-09-12T19:59:34.254438+0000, chain.objs.size()=1 2024-09-12T18:11:41.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.205+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.558__shadow_.dKzc8TZ5uVp52A7Qrqra11jkncDJZDR_1 2024-09-12T18:11:41.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.208+0000 7f10f740e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:11:41.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.210+0000 7f10f740e800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T18:11:41.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.211+0000 7f10f740e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:11:41.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.211+0000 7f10f740e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:11:41.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.212+0000 7f10f740e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T18:11:41.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.212+0000 7f10f740e800 20 garbage collection: RGWGC::process iterating over entry tag='722b129a-cf7a-4aca-b594-5b9492d130e2.4623.7848770180310693162', time=2024-09-12T19:49:03.727718+0000, chain.objs.size()=2 2024-09-12T18:11:41.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.212+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.159__shadow_.sSYUnwkRWnYRaEPuaSCkHe9xQfhEfAg_0 2024-09-12T18:11:41.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.212+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.159__shadow_.sSYUnwkRWnYRaEPuaSCkHe9xQfhEfAg_1 2024-09-12T18:11:41.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.212+0000 7f10f740e800 20 garbage collection: RGWGC::process iterating over entry tag='722b129a-cf7a-4aca-b594-5b9492d130e2.4623.11022778618167188888', time=2024-09-12T19:58:23.733041+0000, chain.objs.size()=3 2024-09-12T18:11:41.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.212+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.526__multipart_mymultipart.2~dw8qhelqtdE6fwZsQnrbvUqfWWzSDZN.1 2024-09-12T18:11:41.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.212+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.526__multipart_mymultipart.2~dw8qhelqtdE6fwZsQnrbvUqfWWzSDZN.2 2024-09-12T18:11:41.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.212+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.526__multipart_mymultipart.2~dw8qhelqtdE6fwZsQnrbvUqfWWzSDZN.3 2024-09-12T18:11:41.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.212+0000 7f10f740e800 20 garbage collection: RGWGC::process iterating over entry tag='722b129a-cf7a-4aca-b594-5b9492d130e2.4623.16183232583764465033', time=2024-09-12T19:59:01.472928+0000, chain.objs.size()=1 2024-09-12T18:11:41.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.212+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.537__multipart_mymultipart.2~1hN1lIGCEHPrVy3oRKjL_EEL5_6lpXp.1 2024-09-12T18:11:41.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.215+0000 7f10f740e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:11:41.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.218+0000 7f10f740e800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T18:11:41.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.219+0000 7f10f740e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:11:41.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.219+0000 7f10f740e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:11:41.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.220+0000 7f10f740e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T18:11:41.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.220+0000 7f10f740e800 20 garbage collection: RGWGC::process iterating over entry tag='722b129a-cf7a-4aca-b594-5b9492d130e2.4623.11148042832850967497', time=2024-09-12T19:58:21.770052+0000, chain.objs.size()=2 2024-09-12T18:11:41.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.220+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.526__multipart_mymultipart.2~R25zuHTIaGhXthd6Ecl4OgFL4L7iLot.1 2024-09-12T18:11:41.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.220+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.526__multipart_mymultipart.2~R25zuHTIaGhXthd6Ecl4OgFL4L7iLot.2 2024-09-12T18:11:41.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.220+0000 7f10f740e800 20 garbage collection: RGWGC::process iterating over entry tag='2~XxJ97sLewno_zwiFhg4BHhudRv_NPDC', time=2024-09-12T19:58:39.711018+0000, chain.objs.size()=1 2024-09-12T18:11:41.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.220+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.532__multipart_mymultipart.2~XxJ97sLewno_zwiFhg4BHhudRv_NPDC.1 2024-09-12T18:11:41.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.220+0000 7f10f740e800 20 garbage collection: RGWGC::process iterating over entry tag='2~4UBd1ed7_8bFS-Bt-pWP44_kzvAvNT6', time=2024-09-12T19:58:41.212657+0000, chain.objs.size()=1 2024-09-12T18:11:41.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.220+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.534__multipart_mymultipart.2~4UBd1ed7_8bFS-Bt-pWP44_kzvAvNT6.1 2024-09-12T18:11:41.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.223+0000 7f10f740e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:11:41.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.225+0000 7f10f740e800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T18:11:41.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.226+0000 7f10f740e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:11:41.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.227+0000 7f10f740e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:11:41.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.227+0000 7f10f740e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T18:11:41.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.227+0000 7f10f740e800 20 garbage collection: RGWGC::process iterating over entry tag='722b129a-cf7a-4aca-b594-5b9492d130e2.4623.10883435315350169318', time=2024-09-12T19:56:37.188509+0000, chain.objs.size()=6 2024-09-12T18:11:41.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.227+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.508__multipart_srcmultipart.2~TWrn3SHL18yC1d0_4aLZUs9GBdDgGU8.1 2024-09-12T18:11:41.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.227+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.508__multipart_srcmultipart.2~TWrn3SHL18yC1d0_4aLZUs9GBdDgGU8.2 2024-09-12T18:11:41.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.227+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.508__multipart_srcmultipart.2~TWrn3SHL18yC1d0_4aLZUs9GBdDgGU8.3 2024-09-12T18:11:41.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.227+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.508__multipart_srcmultipart.2~TWrn3SHL18yC1d0_4aLZUs9GBdDgGU8.4 2024-09-12T18:11:41.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.227+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.508__multipart_srcmultipart.2~TWrn3SHL18yC1d0_4aLZUs9GBdDgGU8.5 2024-09-12T18:11:41.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.227+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.508__multipart_srcmultipart.2~TWrn3SHL18yC1d0_4aLZUs9GBdDgGU8.6 2024-09-12T18:11:41.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.227+0000 7f10f740e800 20 garbage collection: RGWGC::process iterating over entry tag='722b129a-cf7a-4aca-b594-5b9492d130e2.4623.849502856203637970', time=2024-09-12T19:56:45.576214+0000, chain.objs.size()=1 2024-09-12T18:11:41.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.227+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.519__multipart_mymultipart.2~lDvh3orSNVgG8iI5yYvRPI2SgXCnIpR.1 2024-09-12T18:11:41.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.231+0000 7f10f740e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:11:41.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.233+0000 7f10f740e800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T18:11:41.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.234+0000 7f10f740e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:11:41.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.235+0000 7f10f740e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:11:41.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.236+0000 7f10f740e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T18:11:41.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.236+0000 7f10f740e800 20 garbage collection: RGWGC::process iterating over entry tag='2~Z-0d2-Ods7ZDTp_7fjoREiiNjAmxBiz', time=2024-09-12T19:50:00.479108+0000, chain.objs.size()=1 2024-09-12T18:11:41.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.236+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.203__multipart_mymultipart.2~Z-0d2-Ods7ZDTp_7fjoREiiNjAmxBiz.1 2024-09-12T18:11:41.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.236+0000 7f10f740e800 20 garbage collection: RGWGC::process iterating over entry tag='722b129a-cf7a-4aca-b594-5b9492d130e2.4623.18096199553830960488', time=2024-09-12T19:56:37.203632+0000, chain.objs.size()=6 2024-09-12T18:11:41.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.236+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.508__multipart_srcmultipart.2~TWrn3SHL18yC1d0_4aLZUs9GBdDgGU8.1 2024-09-12T18:11:41.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.236+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.508__multipart_srcmultipart.2~TWrn3SHL18yC1d0_4aLZUs9GBdDgGU8.2 2024-09-12T18:11:41.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.236+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.508__multipart_srcmultipart.2~TWrn3SHL18yC1d0_4aLZUs9GBdDgGU8.3 2024-09-12T18:11:41.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.236+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.508__multipart_srcmultipart.2~TWrn3SHL18yC1d0_4aLZUs9GBdDgGU8.4 2024-09-12T18:11:41.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.236+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.508__multipart_srcmultipart.2~TWrn3SHL18yC1d0_4aLZUs9GBdDgGU8.5 2024-09-12T18:11:41.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.236+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.508__multipart_srcmultipart.2~TWrn3SHL18yC1d0_4aLZUs9GBdDgGU8.6 2024-09-12T18:11:41.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.236+0000 7f10f740e800 20 garbage collection: RGWGC::process iterating over entry tag='2~dkhiA1Sj1SFzDQXkdPSqnUJWcqNWZug', time=2024-09-12T19:59:41.832233+0000, chain.objs.size()=1 2024-09-12T18:11:41.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.236+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.562__multipart_mymultipart.2~dkhiA1Sj1SFzDQXkdPSqnUJWcqNWZug.1 2024-09-12T18:11:41.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.239+0000 7f10f740e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:11:41.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.242+0000 7f10f740e800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T18:11:41.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.244+0000 7f10f740e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:11:41.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.244+0000 7f10f740e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:11:41.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.244+0000 7f10f740e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T18:11:41.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.244+0000 7f10f740e800 20 garbage collection: RGWGC::process iterating over entry tag='722b129a-cf7a-4aca-b594-5b9492d130e2.4623.12311298642755276558', time=2024-09-12T19:58:12.041448+0000, chain.objs.size()=3 2024-09-12T18:11:41.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.244+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.524__multipart_mymultipart.2~D26GCE9WsjEsNW10JKUfrFTQrv2Hiwg.1 2024-09-12T18:11:41.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.244+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.524__multipart_mymultipart.2~D26GCE9WsjEsNW10JKUfrFTQrv2Hiwg.2 2024-09-12T18:11:41.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.244+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.524__multipart_mymultipart.2~D26GCE9WsjEsNW10JKUfrFTQrv2Hiwg.3 2024-09-12T18:11:41.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.244+0000 7f10f740e800 20 garbage collection: RGWGC::process iterating over entry tag='722b129a-cf7a-4aca-b594-5b9492d130e2.4623.8913778692746914610', time=2024-09-12T19:58:34.030176+0000, chain.objs.size()=1 2024-09-12T18:11:41.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.244+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.529__shadow_.L-jUzlJSMZ76t6DgonqiDg2aHilC4-y_1 2024-09-12T18:11:41.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.244+0000 7f10f740e800 20 garbage collection: RGWGC::process iterating over entry tag='2~V44bSZet1oSw6lDe7HO2K1K_jNLUcLM', time=2024-09-12T19:58:41.769817+0000, chain.objs.size()=1 2024-09-12T18:11:41.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.244+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.535__multipart_mymultipart.2~V44bSZet1oSw6lDe7HO2K1K_jNLUcLM.1 2024-09-12T18:11:41.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.247+0000 7f10f740e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:11:41.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.250+0000 7f10f740e800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T18:11:41.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.251+0000 7f10f740e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:11:41.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.252+0000 7f10f740e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:11:41.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.252+0000 7f10f740e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T18:11:41.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.252+0000 7f10f740e800 20 garbage collection: RGWGC::process iterating over entry tag='722b129a-cf7a-4aca-b594-5b9492d130e2.4623.13160151012481665404', time=2024-09-12T19:49:11.263585+0000, chain.objs.size()=2 2024-09-12T18:11:41.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.252+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.161__shadow_.ISQmlyWx9BZQYxu-ytSKtkXqOXfMP2n_0 2024-09-12T18:11:41.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.252+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.161__shadow_.ISQmlyWx9BZQYxu-ytSKtkXqOXfMP2n_1 2024-09-12T18:11:41.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.252+0000 7f10f740e800 20 garbage collection: RGWGC::process iterating over entry tag='2~kb-4u2eZd1R2TBTQBgG5L8jmBARtoHl', time=2024-09-12T19:57:51.431341+0000, chain.objs.size()=1 2024-09-12T18:11:41.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.252+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.523__multipart_mymultipart.2~kb-4u2eZd1R2TBTQBgG5L8jmBARtoHl.2 2024-09-12T18:11:41.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.252+0000 7f10f740e800 20 garbage collection: RGWGC::process iterating over entry tag='2~kb-4u2eZd1R2TBTQBgG5L8jmBARtoHl', time=2024-09-12T19:57:51.435483+0000, chain.objs.size()=1 2024-09-12T18:11:41.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.252+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.523__multipart_mymultipart.2~kb-4u2eZd1R2TBTQBgG5L8jmBARtoHl.3 2024-09-12T18:11:41.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.252+0000 7f10f740e800 20 garbage collection: RGWGC::process iterating over entry tag='722b129a-cf7a-4aca-b594-5b9492d130e2.4623.11556669345775358358', time=2024-09-12T19:58:08.072021+0000, chain.objs.size()=1 2024-09-12T18:11:41.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.252+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.524__multipart_mymultipart.2~BhPBTh_-D2cG9gQcdCtCB8agulLfxpE.1 2024-09-12T18:11:41.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.255+0000 7f10f740e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:11:41.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.257+0000 7f10f740e800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T18:11:41.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.259+0000 7f10f740e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:11:41.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.259+0000 7f10f740e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:11:41.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.260+0000 7f10f740e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-12T18:11:41.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.260+0000 7f10f740e800 20 garbage collection: RGWGC::process iterating over entry tag='_uwLQkbOvi0UvWgOXNT6YibGIE3D5YOg', time=2024-09-12T19:49:13.694577+0000, chain.objs.size()=1 2024-09-12T18:11:41.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.260+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.161__shadow_.bfgAIJtcRFivmtT7WAS15lqsjqaiBSq_1 2024-09-12T18:11:41.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.260+0000 7f10f740e800 20 garbage collection: RGWGC::process iterating over entry tag='2~mmxBcvPWLHISI2kDVD3N2IM6NeKyyGG', time=2024-09-12T19:57:40.117529+0000, chain.objs.size()=1 2024-09-12T18:11:41.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.260+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.523__multipart_mymultipart.2~mmxBcvPWLHISI2kDVD3N2IM6NeKyyGG.3 2024-09-12T18:11:41.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.260+0000 7f10f740e800 20 garbage collection: RGWGC::process iterating over entry tag='722b129a-cf7a-4aca-b594-5b9492d130e2.4623.687464562437892820', time=2024-09-12T19:58:06.155235+0000, chain.objs.size()=6 2024-09-12T18:11:41.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.260+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.523__multipart_mymultipart.OD9-1mwFPrUbLuPZxgijaKYUEzconHjV.1 2024-09-12T18:11:41.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.260+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.523__multipart_mymultipart.Ej8V_C6L04Ir7_MUSrjr15tdfKcWwu7s.2 2024-09-12T18:11:41.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.260+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.523__multipart_mymultipart.QcKIEwDvHRLPAGDNoOFYe9pI3T2Yt7ld.3 2024-09-12T18:11:41.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.260+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.523__multipart_mymultipart.Q2Igs4ry0HCCS-YVdnkpruTfRiQd-9Xs.4 2024-09-12T18:11:41.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.260+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.523__multipart_mymultipart.lrXsrQN3sDkI99NuI0HIbipsejhIxro2.5 2024-09-12T18:11:41.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.260+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.523__multipart_mymultipart.BTFPA5mlvq4ndvOFO1pGj7DjKxzVOb_x.6 2024-09-12T18:11:41.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.260+0000 7f10f740e800 20 garbage collection: RGWGC::process iterating over entry tag='2~Ps8b4Tw_EjW2mmgaLQ6TupeBHUlojC-', time=2024-09-12T19:58:39.782678+0000, chain.objs.size()=1 2024-09-12T18:11:41.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.260+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.532__multipart_mymultipart2.2~Ps8b4Tw_EjW2mmgaLQ6TupeBHUlojC-.1 2024-09-12T18:11:41.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.260+0000 7f10f740e800 20 garbage collection: RGWGC::process iterating over entry tag='722b129a-cf7a-4aca-b594-5b9492d130e2.4623.1121950214953665663', time=2024-09-12T20:00:52.070893+0000, chain.objs.size()=4 2024-09-12T18:11:41.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.260+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.579__multipart_testobj.2~meEVC_JFrQQPzg4ugm9JlG-pKwUu55D.1 2024-09-12T18:11:41.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.260+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.579__multipart_testobj.2~meEVC_JFrQQPzg4ugm9JlG-pKwUu55D.2 2024-09-12T18:11:41.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.260+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.579__multipart_testobj.2~meEVC_JFrQQPzg4ugm9JlG-pKwUu55D.3 2024-09-12T18:11:41.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.264+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.579__multipart_testobj.2~meEVC_JFrQQPzg4ugm9JlG-pKwUu55D.4 2024-09-12T18:11:41.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.268+0000 7f10f740e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:11:41.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.270+0000 7f10f740e800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T18:11:41.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.272+0000 7f10f740e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:11:41.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.272+0000 7f10f740e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:11:41.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.272+0000 7f10f740e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T18:11:41.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.272+0000 7f10f740e800 20 garbage collection: RGWGC::process iterating over entry tag='722b129a-cf7a-4aca-b594-5b9492d130e2.4623.16421436263216430533', time=2024-09-12T20:05:49.689636+0000, chain.objs.size()=6 2024-09-12T18:11:41.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.272+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.663__multipart_foo.2~QYC3pjMXH-s3ROhijil-y92XljjG8hT.1 2024-09-12T18:11:41.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.272+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.663__multipart_foo.2~QYC3pjMXH-s3ROhijil-y92XljjG8hT.2 2024-09-12T18:11:41.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.272+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.663__multipart_foo.2~QYC3pjMXH-s3ROhijil-y92XljjG8hT.3 2024-09-12T18:11:41.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.272+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.663__multipart_foo.2~QYC3pjMXH-s3ROhijil-y92XljjG8hT.4 2024-09-12T18:11:41.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.272+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.663__multipart_foo.2~QYC3pjMXH-s3ROhijil-y92XljjG8hT.5 2024-09-12T18:11:41.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.273+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.663__multipart_foo.2~QYC3pjMXH-s3ROhijil-y92XljjG8hT.6 2024-09-12T18:11:41.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.276+0000 7f10f740e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:11:41.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.278+0000 7f10f740e800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T18:11:41.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.279+0000 7f10f740e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:11:41.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.280+0000 7f10f740e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:11:41.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.280+0000 7f10f740e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T18:11:41.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.280+0000 7f10f740e800 20 garbage collection: RGWGC::process iterating over entry tag='722b129a-cf7a-4aca-b594-5b9492d130e2.4623.5077497653045654560', time=2024-09-12T19:49:03.700883+0000, chain.objs.size()=2 2024-09-12T18:11:41.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.280+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.159__shadow_.gOLBmcxLTzcQcvQdMv9ACMJTi6JoNal_0 2024-09-12T18:11:41.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.280+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.159__shadow_.gOLBmcxLTzcQcvQdMv9ACMJTi6JoNal_1 2024-09-12T18:11:41.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.281+0000 7f10f740e800 20 garbage collection: RGWGC::process iterating over entry tag='722b129a-cf7a-4aca-b594-5b9492d130e2.4623.12180673629132856094', time=2024-09-12T19:56:48.915195+0000, chain.objs.size()=1 2024-09-12T18:11:41.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.281+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.519__multipart_mymultipart.2~8sMHqB2EyS1sgDbnojMik4CUOqOsd_6.1 2024-09-12T18:11:41.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.281+0000 7f10f740e800 20 garbage collection: RGWGC::process iterating over entry tag='722b129a-cf7a-4aca-b594-5b9492d130e2.4623.17916021379572610114', time=2024-09-12T20:02:21.101972+0000, chain.objs.size()=6 2024-09-12T18:11:41.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.281+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.616__multipart_multipart_enc.2~JQ8mpRsB7dbfJfcYxqr-iHfGgzomxyp.1 2024-09-12T18:11:41.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.281+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.616__multipart_multipart_enc.2~JQ8mpRsB7dbfJfcYxqr-iHfGgzomxyp.2 2024-09-12T18:11:41.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.281+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.616__multipart_multipart_enc.2~JQ8mpRsB7dbfJfcYxqr-iHfGgzomxyp.3 2024-09-12T18:11:41.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.281+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.616__multipart_multipart_enc.2~JQ8mpRsB7dbfJfcYxqr-iHfGgzomxyp.4 2024-09-12T18:11:41.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.281+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.616__multipart_multipart_enc.2~JQ8mpRsB7dbfJfcYxqr-iHfGgzomxyp.5 2024-09-12T18:11:41.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.281+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.616__multipart_multipart_enc.2~JQ8mpRsB7dbfJfcYxqr-iHfGgzomxyp.6 2024-09-12T18:11:41.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.285+0000 7f10f740e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:11:41.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.288+0000 7f10f740e800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T18:11:41.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.289+0000 7f10f740e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:11:41.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.289+0000 7f10f740e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:11:41.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.290+0000 7f10f740e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T18:11:41.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.290+0000 7f10f740e800 20 garbage collection: RGWGC::process iterating over entry tag='2~sQ9dZquY8Ag16AKgSFwATDiXH03dr18', time=2024-09-12T19:57:28.271203+0000, chain.objs.size()=1 2024-09-12T18:11:41.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.290+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.523__multipart_mymultipart.2~sQ9dZquY8Ag16AKgSFwATDiXH03dr18.2 2024-09-12T18:11:41.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.291+0000 7f10f740e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:11:41.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.293+0000 7f10f740e800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T18:11:41.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.295+0000 7f10f740e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:11:41.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.295+0000 7f10f740e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:11:41.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.296+0000 7f10f740e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T18:11:41.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.296+0000 7f10f740e800 20 garbage collection: RGWGC::process iterating over entry tag='_kJkxBFQtmVhXS_YCvJ-8xJCjViI6UTa', time=2024-09-12T19:49:11.774052+0000, chain.objs.size()=1 2024-09-12T18:11:41.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.296+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.161__shadow_.ip_PTOujzsQ3KHL1pogeUVDrprybDyb_1 2024-09-12T18:11:41.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.296+0000 7f10f740e800 20 garbage collection: RGWGC::process iterating over entry tag='722b129a-cf7a-4aca-b594-5b9492d130e2.4623.1893969992078057977', time=2024-09-12T19:56:38.862841+0000, chain.objs.size()=1 2024-09-12T18:11:41.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.296+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.512__multipart_mymultipart.2~lVCEMXJ-hQJt5oIAV6tcjinGchrH2Hi.1 2024-09-12T18:11:41.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.296+0000 7f10f740e800 20 garbage collection: RGWGC::process iterating over entry tag='722b129a-cf7a-4aca-b594-5b9492d130e2.4623.1029403060150835671', time=2024-09-12T19:58:08.935622+0000, chain.objs.size()=2 2024-09-12T18:11:41.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.296+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.524__multipart_mymultipart.2~LZ-eMs-Z-gWzqGFdvf5kANSeit9XqT0.1 2024-09-12T18:11:41.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.296+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.524__multipart_mymultipart.2~LZ-eMs-Z-gWzqGFdvf5kANSeit9XqT0.2 2024-09-12T18:11:41.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.298+0000 7f10f740e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:11:41.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.300+0000 7f10f740e800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T18:11:41.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.302+0000 7f10f740e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:11:41.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.303+0000 7f10f740e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:11:41.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.304+0000 7f10f740e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=8, truncated=0, next_marker='' 2024-09-12T18:11:41.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.304+0000 7f10f740e800 20 garbage collection: RGWGC::process iterating over entry tag='722b129a-cf7a-4aca-b594-5b9492d130e2.4623.949183906579266433', time=2024-09-12T19:49:16.050069+0000, chain.objs.size()=3 2024-09-12T18:11:41.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.304+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.162__multipart_foo-STANDARD.2~ZGFCuecNwy-wuuE_GZIJZdLuWvNNS86.1 2024-09-12T18:11:41.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.304+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.162__multipart_foo-STANDARD.2~ZGFCuecNwy-wuuE_GZIJZdLuWvNNS86.2 2024-09-12T18:11:41.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.304+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.162__multipart_foo-STANDARD.2~ZGFCuecNwy-wuuE_GZIJZdLuWvNNS86.3 2024-09-12T18:11:41.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.304+0000 7f10f740e800 20 garbage collection: RGWGC::process iterating over entry tag='_LmEOY6xdvhAEWOVIg7jol-XFaUtsWBI', time=2024-09-12T19:49:26.981115+0000, chain.objs.size()=1 2024-09-12T18:11:41.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.304+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.166__shadow_.73Qrso3FfP2BZG7Z3_8rf-DYEXqqP-G_0 2024-09-12T18:11:41.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.304+0000 7f10f740e800 20 garbage collection: RGWGC::process iterating over entry tag='722b129a-cf7a-4aca-b594-5b9492d130e2.4623.7005314032542935212', time=2024-09-12T19:56:37.740562+0000, chain.objs.size()=6 2024-09-12T18:11:41.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.304+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.508__multipart_srcmultipart.2~TWrn3SHL18yC1d0_4aLZUs9GBdDgGU8.1 2024-09-12T18:11:41.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.304+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.508__multipart_srcmultipart.2~TWrn3SHL18yC1d0_4aLZUs9GBdDgGU8.2 2024-09-12T18:11:41.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.304+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.508__multipart_srcmultipart.2~TWrn3SHL18yC1d0_4aLZUs9GBdDgGU8.3 2024-09-12T18:11:41.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.304+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.508__multipart_srcmultipart.2~TWrn3SHL18yC1d0_4aLZUs9GBdDgGU8.4 2024-09-12T18:11:41.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.304+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.508__multipart_srcmultipart.2~TWrn3SHL18yC1d0_4aLZUs9GBdDgGU8.5 2024-09-12T18:11:41.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.304+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.508__multipart_srcmultipart.2~TWrn3SHL18yC1d0_4aLZUs9GBdDgGU8.6 2024-09-12T18:11:41.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.304+0000 7f10f740e800 20 garbage collection: RGWGC::process iterating over entry tag='722b129a-cf7a-4aca-b594-5b9492d130e2.4623.40463633038003888', time=2024-09-12T19:58:02.757241+0000, chain.objs.size()=6 2024-09-12T18:11:41.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.304+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.523__multipart_mymultipart.2~kb-4u2eZd1R2TBTQBgG5L8jmBARtoHl.1 2024-09-12T18:11:41.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.304+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.523__multipart_mymultipart.4GG8Ci5vXxIw5j5SG9HLbUXfZH9QbKKU.2 2024-09-12T18:11:41.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.307+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.523__multipart_mymultipart.3xHkq2UrCJW06QZ9dDx-yNx5qk-4AQqg.3 2024-09-12T18:11:41.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.307+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.523__multipart_mymultipart.2~kb-4u2eZd1R2TBTQBgG5L8jmBARtoHl.4 2024-09-12T18:11:41.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.308+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.523__multipart_mymultipart.2~kb-4u2eZd1R2TBTQBgG5L8jmBARtoHl.5 2024-09-12T18:11:41.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.308+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.523__multipart_mymultipart.2~kb-4u2eZd1R2TBTQBgG5L8jmBARtoHl.6 2024-09-12T18:11:41.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.308+0000 7f10f740e800 20 garbage collection: RGWGC::process iterating over entry tag='722b129a-cf7a-4aca-b594-5b9492d130e2.4623.3644431374427685517', time=2024-09-12T20:00:50.333474+0000, chain.objs.size()=4 2024-09-12T18:11:41.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.308+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.579__multipart_testobj.2~NkVP8SYs63hC20JOtrd4s2nQQCL43TP.1 2024-09-12T18:11:41.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.308+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.579__multipart_testobj.2~NkVP8SYs63hC20JOtrd4s2nQQCL43TP.2 2024-09-12T18:11:41.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.308+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.579__multipart_testobj.2~NkVP8SYs63hC20JOtrd4s2nQQCL43TP.3 2024-09-12T18:11:41.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.309+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.579__multipart_testobj.2~NkVP8SYs63hC20JOtrd4s2nQQCL43TP.4 2024-09-12T18:11:41.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.309+0000 7f10f740e800 20 garbage collection: RGWGC::process iterating over entry tag='722b129a-cf7a-4aca-b594-5b9492d130e2.4623.12800165088465636691', time=2024-09-12T20:00:51.448151+0000, chain.objs.size()=4 2024-09-12T18:11:41.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.309+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.579__multipart_testobj.2~hhla-EnMOAWtI5AYu60fReTb-eUbtUJ.1 2024-09-12T18:11:41.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.309+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.579__multipart_testobj.2~hhla-EnMOAWtI5AYu60fReTb-eUbtUJ.2 2024-09-12T18:11:41.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.310+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.579__multipart_testobj.2~hhla-EnMOAWtI5AYu60fReTb-eUbtUJ.3 2024-09-12T18:11:41.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.311+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.579__multipart_testobj.2~hhla-EnMOAWtI5AYu60fReTb-eUbtUJ.4 2024-09-12T18:11:41.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.311+0000 7f10f740e800 20 garbage collection: RGWGC::process iterating over entry tag='2~oR7nwwngBTULTWq8jKn0nY5BSuJNa2i', time=2024-09-12T20:04:53.085985+0000, chain.objs.size()=6 2024-09-12T18:11:41.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.311+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.625__multipart_multipart_enc.2~oR7nwwngBTULTWq8jKn0nY5BSuJNa2i.1 2024-09-12T18:11:41.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.313+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.625__multipart_multipart_enc.2~oR7nwwngBTULTWq8jKn0nY5BSuJNa2i.2 2024-09-12T18:11:41.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.314+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.625__multipart_multipart_enc.2~oR7nwwngBTULTWq8jKn0nY5BSuJNa2i.3 2024-09-12T18:11:41.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.314+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.625__multipart_multipart_enc.2~oR7nwwngBTULTWq8jKn0nY5BSuJNa2i.4 2024-09-12T18:11:41.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.314+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.625__multipart_multipart_enc.2~oR7nwwngBTULTWq8jKn0nY5BSuJNa2i.5 2024-09-12T18:11:41.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.314+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.625__multipart_multipart_enc.2~oR7nwwngBTULTWq8jKn0nY5BSuJNa2i.6 2024-09-12T18:11:41.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.315+0000 7f10f740e800 20 garbage collection: RGWGC::process iterating over entry tag='722b129a-cf7a-4aca-b594-5b9492d130e2.4623.4803143786343344885', time=2024-09-12T20:05:49.171375+0000, chain.objs.size()=6 2024-09-12T18:11:41.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.315+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.661__multipart_bar.2~h2glhy7TeW9XF6UDny_T_NdTQy6N28w.1 2024-09-12T18:11:41.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.315+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.661__multipart_bar.2~h2glhy7TeW9XF6UDny_T_NdTQy6N28w.2 2024-09-12T18:11:41.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.315+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.661__multipart_bar.2~h2glhy7TeW9XF6UDny_T_NdTQy6N28w.3 2024-09-12T18:11:41.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.315+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.661__multipart_bar.2~h2glhy7TeW9XF6UDny_T_NdTQy6N28w.4 2024-09-12T18:11:41.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.315+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.661__multipart_bar.2~h2glhy7TeW9XF6UDny_T_NdTQy6N28w.5 2024-09-12T18:11:41.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.317+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.661__multipart_bar.2~h2glhy7TeW9XF6UDny_T_NdTQy6N28w.6 2024-09-12T18:11:41.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.323+0000 7f10f740e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:11:41.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.326+0000 7f10f740e800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T18:11:41.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.327+0000 7f10f740e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:11:41.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.327+0000 7f10f740e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:11:41.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.328+0000 7f10f740e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:11:41.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.329+0000 7f10f740e800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T18:11:41.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.330+0000 7f10f740e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:11:41.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.330+0000 7f10f740e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:11:41.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.331+0000 7f10f740e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-12T18:11:41.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.331+0000 7f10f740e800 20 garbage collection: RGWGC::process iterating over entry tag='_vKeA9M5L0VomnwMm4TqijN0BgmgRgEa', time=2024-09-12T19:49:22.054790+0000, chain.objs.size()=2 2024-09-12T18:11:41.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.331+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.162__shadow_.L5gWsMGkge-uv1wzDjsy9kztJZV5vrP_0 2024-09-12T18:11:41.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.331+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.162__shadow_.L5gWsMGkge-uv1wzDjsy9kztJZV5vrP_1 2024-09-12T18:11:41.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.331+0000 7f10f740e800 20 garbage collection: RGWGC::process iterating over entry tag='722b129a-cf7a-4aca-b594-5b9492d130e2.4623.1105396854108343156', time=2024-09-12T19:56:40.964554+0000, chain.objs.size()=1 2024-09-12T18:11:41.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.331+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.514__multipart_mymultipart.2~aeQAuNxFqYn7dQeG9YJsXPkKvc7xlm3.1 2024-09-12T18:11:41.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.331+0000 7f10f740e800 20 garbage collection: RGWGC::process iterating over entry tag='722b129a-cf7a-4aca-b594-5b9492d130e2.4623.12582380131087099537', time=2024-09-12T19:58:18.109254+0000, chain.objs.size()=1 2024-09-12T18:11:41.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.331+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.526__multipart_mymultipart.2~hgya0LjuB4-pcSACT7WNvz6Gm3XX_SP.1 2024-09-12T18:11:41.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.331+0000 7f10f740e800 20 garbage collection: RGWGC::process iterating over entry tag='722b129a-cf7a-4aca-b594-5b9492d130e2.4623.1612389481405902020', time=2024-09-12T19:59:42.120904+0000, chain.objs.size()=1 2024-09-12T18:11:41.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.331+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.562__multipart_mymultipart.8jAAwq-0qwwdgwh23ZU_URMWdjEsn2aL.1 2024-09-12T18:11:41.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.331+0000 7f10f740e800 20 garbage collection: RGWGC::process iterating over entry tag='722b129a-cf7a-4aca-b594-5b9492d130e2.4623.15952815831150583933', time=2024-09-12T20:02:13.259594+0000, chain.objs.size()=6 2024-09-12T18:11:41.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.331+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.615__multipart_multipart_enc.2~-KJxC0T2RDcSdtOGGdZ-yUlPuowIzUI.1 2024-09-12T18:11:41.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.331+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.615__multipart_multipart_enc.2~-KJxC0T2RDcSdtOGGdZ-yUlPuowIzUI.2 2024-09-12T18:11:41.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.331+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.615__multipart_multipart_enc.2~-KJxC0T2RDcSdtOGGdZ-yUlPuowIzUI.3 2024-09-12T18:11:41.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.331+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.615__multipart_multipart_enc.2~-KJxC0T2RDcSdtOGGdZ-yUlPuowIzUI.4 2024-09-12T18:11:41.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.331+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.615__multipart_multipart_enc.2~-KJxC0T2RDcSdtOGGdZ-yUlPuowIzUI.5 2024-09-12T18:11:41.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.331+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.615__multipart_multipart_enc.2~-KJxC0T2RDcSdtOGGdZ-yUlPuowIzUI.6 2024-09-12T18:11:41.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.339+0000 7f10f740e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:11:41.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.341+0000 7f10f740e800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T18:11:41.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.343+0000 7f10f740e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:11:41.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.343+0000 7f10f740e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:11:41.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.344+0000 7f10f740e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T18:11:41.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.344+0000 7f10f740e800 20 garbage collection: RGWGC::process iterating over entry tag='722b129a-cf7a-4aca-b594-5b9492d130e2.4623.10667712424414244913', time=2024-09-12T19:49:03.755181+0000, chain.objs.size()=1 2024-09-12T18:11:41.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.344+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.159__shadow_.R64f1WC8kZjouYTCP_OoRGzB5jcH9nQ_1 2024-09-12T18:11:41.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.344+0000 7f10f740e800 20 garbage collection: RGWGC::process iterating over entry tag='722b129a-cf7a-4aca-b594-5b9492d130e2.4623.14833606739462806855', time=2024-09-12T19:56:49.599839+0000, chain.objs.size()=1 2024-09-12T18:11:41.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.344+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.519__multipart_mymultipart.2~yNZVlJb6uQQpvhXhE4jRVrlQzurKXk8.1 2024-09-12T18:11:41.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.344+0000 7f10f740e800 20 garbage collection: RGWGC::process iterating over entry tag='722b129a-cf7a-4aca-b594-5b9492d130e2.4623.8891680217294053358', time=2024-09-12T19:58:19.244168+0000, chain.objs.size()=2 2024-09-12T18:11:41.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.344+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.526__multipart_mymultipart.2~bAxv1Y-5Do8R7Hi8BlfJhVQIuy2Jvcc.1 2024-09-12T18:11:41.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.344+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.526__multipart_mymultipart.2~bAxv1Y-5Do8R7Hi8BlfJhVQIuy2Jvcc.2 2024-09-12T18:11:41.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.347+0000 7f10f740e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:11:41.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.349+0000 7f10f740e800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T18:11:41.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.352+0000 7f10f740e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:11:41.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.352+0000 7f10f740e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:11:41.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.352+0000 7f10f740e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T18:11:41.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.352+0000 7f10f740e800 20 garbage collection: RGWGC::process iterating over entry tag='_I--VusqdxeNh2R_uPBrQhbWjbq1QVi7', time=2024-09-12T19:49:22.027161+0000, chain.objs.size()=2 2024-09-12T18:11:41.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.352+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.162__shadow_.p8G2XqBHPF6vO0db0sn18rPYWzrbNmf_0 2024-09-12T18:11:41.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.352+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.162__shadow_.p8G2XqBHPF6vO0db0sn18rPYWzrbNmf_1 2024-09-12T18:11:41.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.352+0000 7f10f740e800 20 garbage collection: RGWGC::process iterating over entry tag='722b129a-cf7a-4aca-b594-5b9492d130e2.4623.5295897117678851276', time=2024-09-12T20:05:10.414129+0000, chain.objs.size()=1 2024-09-12T18:11:41.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.352+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.643__shadow_.3nASfYqqCaFJAVPunkTSjpRRZ9I5L6E_1 2024-09-12T18:11:41.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.355+0000 7f10f740e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:11:41.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.358+0000 7f10f740e800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T18:11:41.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.359+0000 7f10f740e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:11:41.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.360+0000 7f10f740e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:11:41.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.360+0000 7f10f740e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T18:11:41.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.360+0000 7f10f740e800 20 garbage collection: RGWGC::process iterating over entry tag='722b129a-cf7a-4aca-b594-5b9492d130e2.4623.14482529918646628110', time=2024-09-12T19:56:37.733818+0000, chain.objs.size()=6 2024-09-12T18:11:41.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.360+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.508__multipart_srcmultipart.2~TWrn3SHL18yC1d0_4aLZUs9GBdDgGU8.1 2024-09-12T18:11:41.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.360+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.508__multipart_srcmultipart.2~TWrn3SHL18yC1d0_4aLZUs9GBdDgGU8.2 2024-09-12T18:11:41.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.360+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.508__multipart_srcmultipart.2~TWrn3SHL18yC1d0_4aLZUs9GBdDgGU8.3 2024-09-12T18:11:41.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.360+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.508__multipart_srcmultipart.2~TWrn3SHL18yC1d0_4aLZUs9GBdDgGU8.4 2024-09-12T18:11:41.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.360+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.508__multipart_srcmultipart.2~TWrn3SHL18yC1d0_4aLZUs9GBdDgGU8.5 2024-09-12T18:11:41.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.360+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.508__multipart_srcmultipart.2~TWrn3SHL18yC1d0_4aLZUs9GBdDgGU8.6 2024-09-12T18:11:41.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.360+0000 7f10f740e800 20 garbage collection: RGWGC::process iterating over entry tag='722b129a-cf7a-4aca-b594-5b9492d130e2.4623.1970634164809510725', time=2024-09-12T19:59:48.473449+0000, chain.objs.size()=1 2024-09-12T18:11:41.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.360+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.564__shadow_.xZUgKfj0buVHIy74WCK6Lz-UIFWOaET_1 2024-09-12T18:11:41.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.360+0000 7f10f740e800 20 garbage collection: RGWGC::process iterating over entry tag='722b129a-cf7a-4aca-b594-5b9492d130e2.4623.4325911789412895113', time=2024-09-12T20:06:12.760734+0000, chain.objs.size()=1 2024-09-12T18:11:41.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.360+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.703__multipart_file1.2~miptFg3gO6L7Ta6CFZkMP4bNVRWY-lt.1 2024-09-12T18:11:41.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.364+0000 7f10f740e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:11:41.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.367+0000 7f10f740e800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T18:11:41.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.368+0000 7f10f740e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:11:41.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.369+0000 7f10f740e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:11:41.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.369+0000 7f10f740e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=7, truncated=0, next_marker='' 2024-09-12T18:11:41.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.369+0000 7f10f740e800 20 garbage collection: RGWGC::process iterating over entry tag='722b129a-cf7a-4aca-b594-5b9492d130e2.4623.8189788579306997292', time=2024-09-12T19:49:08.638462+0000, chain.objs.size()=3 2024-09-12T18:11:41.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.369+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.160__multipart_mymultipart-FROZEN.2~6aFwNg-N-4USchjfH19frvd_-sMR0Y5.1 2024-09-12T18:11:41.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.369+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.160__multipart_mymultipart-FROZEN.2~6aFwNg-N-4USchjfH19frvd_-sMR0Y5.2 2024-09-12T18:11:41.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.369+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.160__multipart_mymultipart-FROZEN.2~6aFwNg-N-4USchjfH19frvd_-sMR0Y5.3 2024-09-12T18:11:41.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.369+0000 7f10f740e800 20 garbage collection: RGWGC::process iterating over entry tag='722b129a-cf7a-4aca-b594-5b9492d130e2.4623.14931916542079079486', time=2024-09-12T19:49:13.172163+0000, chain.objs.size()=2 2024-09-12T18:11:41.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.369+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.161__shadow_.gexwRpZzZSYIfPYrj4J7m7h8PIhd4f3_0 2024-09-12T18:11:41.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.369+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.161__shadow_.gexwRpZzZSYIfPYrj4J7m7h8PIhd4f3_1 2024-09-12T18:11:41.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.369+0000 7f10f740e800 20 garbage collection: RGWGC::process iterating over entry tag='2~fSik0W8cjstt-RTPhNlumS7YQnBTcm5', time=2024-09-12T19:49:58.597106+0000, chain.objs.size()=1 2024-09-12T18:11:41.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.369+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.202__multipart_mymultipart.2~fSik0W8cjstt-RTPhNlumS7YQnBTcm5.1 2024-09-12T18:11:41.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.369+0000 7f10f740e800 20 garbage collection: RGWGC::process iterating over entry tag='2~5FY_sUgmZ2t7JQrzKstw7t0UIoXyJs_', time=2024-09-12T19:57:20.059205+0000, chain.objs.size()=1 2024-09-12T18:11:41.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.369+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.523__multipart_mymultipart.2~5FY_sUgmZ2t7JQrzKstw7t0UIoXyJs_.1 2024-09-12T18:11:41.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.369+0000 7f10f740e800 20 garbage collection: RGWGC::process iterating over entry tag='722b129a-cf7a-4aca-b594-5b9492d130e2.4623.9728715997989593842', time=2024-09-12T19:58:13.602213+0000, chain.objs.size()=2 2024-09-12T18:11:41.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.369+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.524__multipart_mymultipart.2~Iy-ORC8barBNb3NBFgYgr6NBY_1944p.1 2024-09-12T18:11:41.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.369+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.524__multipart_mymultipart.2~Iy-ORC8barBNb3NBFgYgr6NBY_1944p.2 2024-09-12T18:11:41.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.369+0000 7f10f740e800 20 garbage collection: RGWGC::process iterating over entry tag='722b129a-cf7a-4aca-b594-5b9492d130e2.4623.12293430863455102764', time=2024-09-12T19:58:58.624123+0000, chain.objs.size()=4 2024-09-12T18:11:41.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.369+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.536__multipart_mymultipart.2~3ugRERhN9RDyFN9T70gDNysCfrs8Ao-.1 2024-09-12T18:11:41.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.369+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.536__multipart_mymultipart.2~3ugRERhN9RDyFN9T70gDNysCfrs8Ao-.2 2024-09-12T18:11:41.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.369+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.536__multipart_mymultipart.QwfLjQsSQSeXwd7SUZKg9nCOSx03De7m.3 2024-09-12T18:11:41.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.374+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.536__multipart_mymultipart.2~3ugRERhN9RDyFN9T70gDNysCfrs8Ao-.4 2024-09-12T18:11:41.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.374+0000 7f10f740e800 20 garbage collection: RGWGC::process iterating over entry tag='722b129a-cf7a-4aca-b594-5b9492d130e2.4623.17273292509331650679', time=2024-09-12T20:04:46.209310+0000, chain.objs.size()=6 2024-09-12T18:11:41.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.374+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.624__multipart_multipart_enc.2~usQY8QCg9rgJoaLeJ5sDje1zG-qrNwz.1 2024-09-12T18:11:41.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.374+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.624__multipart_multipart_enc.2~usQY8QCg9rgJoaLeJ5sDje1zG-qrNwz.2 2024-09-12T18:11:41.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.374+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.624__multipart_multipart_enc.2~usQY8QCg9rgJoaLeJ5sDje1zG-qrNwz.3 2024-09-12T18:11:41.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.374+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.624__multipart_multipart_enc.2~usQY8QCg9rgJoaLeJ5sDje1zG-qrNwz.4 2024-09-12T18:11:41.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.374+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.624__multipart_multipart_enc.2~usQY8QCg9rgJoaLeJ5sDje1zG-qrNwz.5 2024-09-12T18:11:41.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.374+0000 7f10f740e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:722b129a-cf7a-4aca-b594-5b9492d130e2.4623.624__multipart_multipart_enc.2~usQY8QCg9rgJoaLeJ5sDje1zG-qrNwz.6 2024-09-12T18:11:41.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.379+0000 7f10f740e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:11:41.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.383+0000 7f0fa97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:11:41.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.385+0000 7f10f740e800 20 remove_watcher() i=0 2024-09-12T18:11:41.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.385+0000 7f10f740e800 2 removed watcher, disabling cache 2024-09-12T18:11:41.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.386+0000 7f10f740e800 20 remove_watcher() i=1 2024-09-12T18:11:41.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.387+0000 7f10f740e800 20 remove_watcher() i=2 2024-09-12T18:11:41.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.388+0000 7f10f740e800 20 remove_watcher() i=3 2024-09-12T18:11:41.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.389+0000 7f10f740e800 20 remove_watcher() i=4 2024-09-12T18:11:41.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.390+0000 7f10f740e800 20 remove_watcher() i=5 2024-09-12T18:11:41.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.391+0000 7f10f740e800 20 remove_watcher() i=6 2024-09-12T18:11:41.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-12T18:11:41.392+0000 7f10f740e800 20 remove_watcher() i=7 2024-09-12T18:11:41.404 DEBUG:teuthology.run_tasks:Unwinding manager openssl_keys 2024-09-12T18:11:41.415 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-12T18:11:41.458 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T18:11:41.458 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T18:11:41.799 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T18:11:41.811 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-09-12T18:11:41.813 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":2094,"stamp":"2024-09-12T18:11:40.608769+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":601866185,"num_objects":980,"num_object_clones":0,"num_object_copies":2892,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":980,"num_whiteouts":0,"num_read":279306,"num_read_kb":2634055,"num_write":143036,"num_write_kb":2346416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":212,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13609,"ondisk_log_size":13609,"up":914,"acting":914,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":914,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2322944,"kb_used_data":918528,"kb_used_omap":12,"kb_used_meta":1404275,"kb_avail":752651776,"statfs":{"total":773094113280,"available":770715418624,"internally_reserved":0,"allocated":940572672,"data_stored":924603070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":1437978161},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005050"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":22,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:06:59.835776+0000","last_change":"2024-09-12T17:46:57.082723+0000","last_active":"2024-09-12T18:06:59.835776+0000","last_peered":"2024-09-12T18:06:59.835776+0000","last_clean":"2024-09-12T18:06:59.835776+0000","last_became_active":"2024-09-12T17:46:57.082400+0000","last_became_peered":"2024-09-12T17:46:57.082400+0000","last_unstale":"2024-09-12T18:06:59.835776+0000","last_undegraded":"2024-09-12T18:06:59.835776+0000","last_fullsized":"2024-09-12T18:06:59.835776+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:49:21.685677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"0'0","reported_seq":39,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:49.843582+0000","last_change":"2024-09-12T17:30:16.683362+0000","last_active":"2024-09-12T18:07:49.843582+0000","last_peered":"2024-09-12T18:07:49.843582+0000","last_clean":"2024-09-12T18:07:49.843582+0000","last_became_active":"2024-09-12T17:30:16.683077+0000","last_became_peered":"2024-09-12T17:30:16.683077+0000","last_unstale":"2024-09-12T18:07:49.843582+0000","last_undegraded":"2024-09-12T18:07:49.843582+0000","last_fullsized":"2024-09-12T18:07:49.843582+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:50:52.313225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"260'3","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:44.841978+0000","last_change":"2024-09-12T17:30:12.651734+0000","last_active":"2024-09-12T18:07:44.841978+0000","last_peered":"2024-09-12T18:07:44.841978+0000","last_clean":"2024-09-12T18:07:44.841978+0000","last_became_active":"2024-09-12T17:30:12.651461+0000","last_became_peered":"2024-09-12T17:30:12.651461+0000","last_unstale":"2024-09-12T18:07:44.841978+0000","last_undegraded":"2024-09-12T18:07:44.841978+0000","last_fullsized":"2024-09-12T18:07:44.841978+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:51:09.744341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"263'28","reported_seq":134,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:14.837079+0000","last_change":"2024-09-12T17:26:35.669600+0000","last_active":"2024-09-12T18:08:14.837079+0000","last_peered":"2024-09-12T18:08:14.837079+0000","last_clean":"2024-09-12T18:08:14.837079+0000","last_became_active":"2024-09-12T17:26:35.669154+0000","last_became_peered":"2024-09-12T17:26:35.669154+0000","last_unstale":"2024-09-12T18:08:14.837079+0000","last_undegraded":"2024-09-12T18:08:14.837079+0000","last_fullsized":"2024-09-12T18:08:14.837079+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:56:13.407121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":150,"num_read_kb":108,"num_write":46,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":22,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:06:59.822536+0000","last_change":"2024-09-12T17:46:57.096775+0000","last_active":"2024-09-12T18:06:59.822536+0000","last_peered":"2024-09-12T18:06:59.822536+0000","last_clean":"2024-09-12T18:06:59.822536+0000","last_became_active":"2024-09-12T17:46:57.096462+0000","last_became_peered":"2024-09-12T17:46:57.096462+0000","last_unstale":"2024-09-12T18:06:59.822536+0000","last_undegraded":"2024-09-12T18:06:59.822536+0000","last_fullsized":"2024-09-12T18:06:59.822536+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:09:53.229550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"263'8","reported_seq":61,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:49.844250+0000","last_change":"2024-09-12T17:30:16.675262+0000","last_active":"2024-09-12T18:07:49.844250+0000","last_peered":"2024-09-12T18:07:49.844250+0000","last_clean":"2024-09-12T18:07:49.844250+0000","last_became_active":"2024-09-12T17:30:16.674952+0000","last_became_peered":"2024-09-12T17:30:16.674952+0000","last_unstale":"2024-09-12T18:07:49.844250+0000","last_undegraded":"2024-09-12T18:07:49.844250+0000","last_fullsized":"2024-09-12T18:07:49.844250+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:17:48.380471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":30722,"num_write":8,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"263'2","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:45.138583+0000","last_change":"2024-09-12T17:30:12.645927+0000","last_active":"2024-09-12T18:07:45.138583+0000","last_peered":"2024-09-12T18:07:45.138583+0000","last_clean":"2024-09-12T18:07:45.138583+0000","last_became_active":"2024-09-12T17:30:12.645624+0000","last_became_peered":"2024-09-12T17:30:12.645624+0000","last_unstale":"2024-09-12T18:07:45.138583+0000","last_undegraded":"2024-09-12T18:07:45.138583+0000","last_fullsized":"2024-09-12T18:07:45.138583+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:07:42.933168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":10240,"num_write":7,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"263'13","reported_seq":88,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:44.835410+0000","last_change":"2024-09-12T17:26:35.660411+0000","last_active":"2024-09-12T18:08:44.835410+0000","last_peered":"2024-09-12T18:08:44.835410+0000","last_clean":"2024-09-12T18:08:44.835410+0000","last_became_active":"2024-09-12T17:26:35.660132+0000","last_became_peered":"2024-09-12T17:26:35.660132+0000","last_unstale":"2024-09-12T18:08:44.835410+0000","last_undegraded":"2024-09-12T18:08:44.835410+0000","last_fullsized":"2024-09-12T18:08:44.835410+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:16:42.286139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":36,"num_write":29,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:44.871662+0000","last_change":"2024-09-12T17:46:57.076529+0000","last_active":"2024-09-12T18:08:44.871662+0000","last_peered":"2024-09-12T18:08:44.871662+0000","last_clean":"2024-09-12T18:08:44.871662+0000","last_became_active":"2024-09-12T17:46:57.076193+0000","last_became_peered":"2024-09-12T17:46:57.076193+0000","last_unstale":"2024-09-12T18:08:44.871662+0000","last_undegraded":"2024-09-12T18:08:44.871662+0000","last_fullsized":"2024-09-12T18:08:44.871662+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:06:10.868648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"260'3","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:49.834420+0000","last_change":"2024-09-12T17:30:16.671182+0000","last_active":"2024-09-12T18:07:49.834420+0000","last_peered":"2024-09-12T18:07:49.834420+0000","last_clean":"2024-09-12T18:07:49.834420+0000","last_became_active":"2024-09-12T17:30:16.670862+0000","last_became_peered":"2024-09-12T17:30:16.670862+0000","last_unstale":"2024-09-12T18:07:49.834420+0000","last_undegraded":"2024-09-12T18:07:49.834420+0000","last_fullsized":"2024-09-12T18:07:49.834420+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:44:16.981394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"263'4","reported_seq":60,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:24.833227+0000","last_change":"2024-09-12T17:30:12.648635+0000","last_active":"2024-09-12T18:08:24.833227+0000","last_peered":"2024-09-12T18:08:24.833227+0000","last_clean":"2024-09-12T18:08:24.833227+0000","last_became_active":"2024-09-12T17:30:12.648349+0000","last_became_peered":"2024-09-12T17:30:12.648349+0000","last_unstale":"2024-09-12T18:08:24.833227+0000","last_undegraded":"2024-09-12T18:08:24.833227+0000","last_fullsized":"2024-09-12T18:08:24.833227+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:34:54.875445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":18432,"num_write":9,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"263'117","reported_seq":422,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:04.843259+0000","last_change":"2024-09-12T17:26:35.664908+0000","last_active":"2024-09-12T18:09:04.843259+0000","last_peered":"2024-09-12T18:09:04.843259+0000","last_clean":"2024-09-12T18:09:04.843259+0000","last_became_active":"2024-09-12T17:26:35.664247+0000","last_became_peered":"2024-09-12T17:26:35.664247+0000","last_unstale":"2024-09-12T18:09:04.843259+0000","last_undegraded":"2024-09-12T18:09:04.843259+0000","last_fullsized":"2024-09-12T18:09:04.843259+0000","mapping_epoch":250,"log_start":"263'100","ondisk_log_start":"263'100","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:39:07.453840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":722,"num_read_kb":504,"num_write":158,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:49.849229+0000","last_change":"2024-09-12T17:46:57.089742+0000","last_active":"2024-09-12T18:08:49.849229+0000","last_peered":"2024-09-12T18:08:49.849229+0000","last_clean":"2024-09-12T18:08:49.849229+0000","last_became_active":"2024-09-12T17:46:57.089385+0000","last_became_peered":"2024-09-12T17:46:57.089385+0000","last_unstale":"2024-09-12T18:08:49.849229+0000","last_undegraded":"2024-09-12T18:08:49.849229+0000","last_fullsized":"2024-09-12T18:08:49.849229+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:17:02.129348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"263'11","reported_seq":68,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:29.847004+0000","last_change":"2024-09-12T17:30:16.682079+0000","last_active":"2024-09-12T18:08:29.847004+0000","last_peered":"2024-09-12T18:08:29.847004+0000","last_clean":"2024-09-12T18:08:29.847004+0000","last_became_active":"2024-09-12T17:30:16.681766+0000","last_became_peered":"2024-09-12T17:30:16.681766+0000","last_unstale":"2024-09-12T18:08:29.847004+0000","last_undegraded":"2024-09-12T18:08:29.847004+0000","last_fullsized":"2024-09-12T18:08:29.847004+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:31:21.167575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17825792,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":17,"num_read_kb":32770,"num_write":21,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"0'0","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:44.843580+0000","last_change":"2024-09-12T17:30:12.648728+0000","last_active":"2024-09-12T18:07:44.843580+0000","last_peered":"2024-09-12T18:07:44.843580+0000","last_clean":"2024-09-12T18:07:44.843580+0000","last_became_active":"2024-09-12T17:30:12.648369+0000","last_became_peered":"2024-09-12T17:30:12.648369+0000","last_unstale":"2024-09-12T18:07:44.843580+0000","last_undegraded":"2024-09-12T18:07:44.843580+0000","last_fullsized":"2024-09-12T18:07:44.843580+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:12:39.564996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"263'110","reported_seq":439,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:04.851030+0000","last_change":"2024-09-12T17:26:35.666024+0000","last_active":"2024-09-12T18:09:04.851030+0000","last_peered":"2024-09-12T18:09:04.851030+0000","last_clean":"2024-09-12T18:09:04.851030+0000","last_became_active":"2024-09-12T17:26:35.665735+0000","last_became_peered":"2024-09-12T17:26:35.665735+0000","last_unstale":"2024-09-12T18:09:04.851030+0000","last_undegraded":"2024-09-12T18:09:04.851030+0000","last_fullsized":"2024-09-12T18:09:04.851030+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:21:58.014213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":761,"num_read_kb":507,"num_write":140,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:04.851052+0000","last_change":"2024-09-12T17:46:57.090107+0000","last_active":"2024-09-12T18:09:04.851052+0000","last_peered":"2024-09-12T18:09:04.851052+0000","last_clean":"2024-09-12T18:09:04.851052+0000","last_became_active":"2024-09-12T17:46:57.089797+0000","last_became_peered":"2024-09-12T17:46:57.089797+0000","last_unstale":"2024-09-12T18:09:04.851052+0000","last_undegraded":"2024-09-12T18:09:04.851052+0000","last_fullsized":"2024-09-12T18:09:04.851052+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:57:58.129729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"263'4","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:14.855171+0000","last_change":"2024-09-12T17:30:16.686091+0000","last_active":"2024-09-12T18:09:14.855171+0000","last_peered":"2024-09-12T18:09:14.855171+0000","last_clean":"2024-09-12T18:09:14.855171+0000","last_became_active":"2024-09-12T17:30:16.685755+0000","last_became_peered":"2024-09-12T17:30:16.685755+0000","last_unstale":"2024-09-12T18:09:14.855171+0000","last_undegraded":"2024-09-12T18:09:14.855171+0000","last_fullsized":"2024-09-12T18:09:14.855171+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:41:14.032884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":16,"num_write":9,"num_write_kb":5136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"0'0","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:54.841851+0000","last_change":"2024-09-12T17:30:12.641329+0000","last_active":"2024-09-12T18:08:54.841851+0000","last_peered":"2024-09-12T18:08:54.841851+0000","last_clean":"2024-09-12T18:08:54.841851+0000","last_became_active":"2024-09-12T17:30:12.640983+0000","last_became_peered":"2024-09-12T17:30:12.640983+0000","last_unstale":"2024-09-12T18:08:54.841851+0000","last_undegraded":"2024-09-12T18:08:54.841851+0000","last_fullsized":"2024-09-12T18:08:54.841851+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:49:02.041715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"263'13","reported_seq":92,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:04.851003+0000","last_change":"2024-09-12T17:26:35.664850+0000","last_active":"2024-09-12T18:09:04.851003+0000","last_peered":"2024-09-12T18:09:04.851003+0000","last_clean":"2024-09-12T18:09:04.851003+0000","last_became_active":"2024-09-12T17:26:35.664517+0000","last_became_peered":"2024-09-12T17:26:35.664517+0000","last_unstale":"2024-09-12T18:09:04.851003+0000","last_undegraded":"2024-09-12T18:09:04.851003+0000","last_fullsized":"2024-09-12T18:09:04.851003+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:47:34.050940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":54,"num_write":23,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:50.139169+0000","last_change":"2024-09-12T17:46:57.091721+0000","last_active":"2024-09-12T18:07:50.139169+0000","last_peered":"2024-09-12T18:07:50.139169+0000","last_clean":"2024-09-12T18:07:50.139169+0000","last_became_active":"2024-09-12T17:46:57.091147+0000","last_became_peered":"2024-09-12T17:46:57.091147+0000","last_unstale":"2024-09-12T18:07:50.139169+0000","last_undegraded":"2024-09-12T18:07:50.139169+0000","last_fullsized":"2024-09-12T18:07:50.139169+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:38:23.889670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"260'5","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:59.873661+0000","last_change":"2024-09-12T17:30:16.684444+0000","last_active":"2024-09-12T18:08:59.873661+0000","last_peered":"2024-09-12T18:08:59.873661+0000","last_clean":"2024-09-12T18:08:59.873661+0000","last_became_active":"2024-09-12T17:30:16.684200+0000","last_became_peered":"2024-09-12T17:30:16.684200+0000","last_unstale":"2024-09-12T18:08:59.873661+0000","last_undegraded":"2024-09-12T18:08:59.873661+0000","last_fullsized":"2024-09-12T18:08:59.873661+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:52:13.212280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"263'1","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:04.854441+0000","last_change":"2024-09-12T17:30:12.640225+0000","last_active":"2024-09-12T18:09:04.854441+0000","last_peered":"2024-09-12T18:09:04.854441+0000","last_clean":"2024-09-12T18:09:04.854441+0000","last_became_active":"2024-09-12T17:30:12.639953+0000","last_became_peered":"2024-09-12T17:30:12.639953+0000","last_unstale":"2024-09-12T18:09:04.854441+0000","last_undegraded":"2024-09-12T18:09:04.854441+0000","last_fullsized":"2024-09-12T18:09:04.854441+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:40:28.022453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":3072,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"263'28","reported_seq":125,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:04.874467+0000","last_change":"2024-09-12T17:26:35.663645+0000","last_active":"2024-09-12T18:09:04.874467+0000","last_peered":"2024-09-12T18:09:04.874467+0000","last_clean":"2024-09-12T18:09:04.874467+0000","last_became_active":"2024-09-12T17:26:35.663339+0000","last_became_peered":"2024-09-12T17:26:35.663339+0000","last_unstale":"2024-09-12T18:09:04.874467+0000","last_undegraded":"2024-09-12T18:09:04.874467+0000","last_fullsized":"2024-09-12T18:09:04.874467+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:33:26.767790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":134,"num_read_kb":91,"num_write":60,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"263'1","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:06:59.836170+0000","last_change":"2024-09-12T17:46:57.088362+0000","last_active":"2024-09-12T18:06:59.836170+0000","last_peered":"2024-09-12T18:06:59.836170+0000","last_clean":"2024-09-12T18:06:59.836170+0000","last_became_active":"2024-09-12T17:46:57.088039+0000","last_became_peered":"2024-09-12T17:46:57.088039+0000","last_unstale":"2024-09-12T18:06:59.836170+0000","last_undegraded":"2024-09-12T18:06:59.836170+0000","last_fullsized":"2024-09-12T18:06:59.836170+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:17:28.745812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"263'6","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:49.864141+0000","last_change":"2024-09-12T17:30:16.672459+0000","last_active":"2024-09-12T18:07:49.864141+0000","last_peered":"2024-09-12T18:07:49.864141+0000","last_clean":"2024-09-12T18:07:49.864141+0000","last_became_active":"2024-09-12T17:30:16.672167+0000","last_became_peered":"2024-09-12T17:30:16.672167+0000","last_unstale":"2024-09-12T18:07:49.864141+0000","last_undegraded":"2024-09-12T18:07:49.864141+0000","last_fullsized":"2024-09-12T18:07:49.864141+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:34:33.089166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11534336,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":8,"num_read_kb":17408,"num_write":16,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"260'5","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:44.843494+0000","last_change":"2024-09-12T17:30:12.644426+0000","last_active":"2024-09-12T18:07:44.843494+0000","last_peered":"2024-09-12T18:07:44.843494+0000","last_clean":"2024-09-12T18:07:44.843494+0000","last_became_active":"2024-09-12T17:30:12.644125+0000","last_became_peered":"2024-09-12T17:30:12.644125+0000","last_unstale":"2024-09-12T18:07:44.843494+0000","last_undegraded":"2024-09-12T18:07:44.843494+0000","last_fullsized":"2024-09-12T18:07:44.843494+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:29:53.974488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"263'38","reported_seq":158,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:44.833618+0000","last_change":"2024-09-12T17:26:35.659571+0000","last_active":"2024-09-12T18:07:44.833618+0000","last_peered":"2024-09-12T18:07:44.833618+0000","last_clean":"2024-09-12T18:07:44.833618+0000","last_became_active":"2024-09-12T17:26:35.659261+0000","last_became_peered":"2024-09-12T17:26:35.659261+0000","last_unstale":"2024-09-12T18:07:44.833618+0000","last_undegraded":"2024-09-12T18:07:44.833618+0000","last_fullsized":"2024-09-12T18:07:44.833618+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:13:24.323445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":196,"num_read_kb":138,"num_write":78,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":22,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:06:59.836253+0000","last_change":"2024-09-12T17:46:57.088279+0000","last_active":"2024-09-12T18:06:59.836253+0000","last_peered":"2024-09-12T18:06:59.836253+0000","last_clean":"2024-09-12T18:06:59.836253+0000","last_became_active":"2024-09-12T17:46:57.087965+0000","last_became_peered":"2024-09-12T17:46:57.087965+0000","last_unstale":"2024-09-12T18:06:59.836253+0000","last_undegraded":"2024-09-12T18:06:59.836253+0000","last_fullsized":"2024-09-12T18:06:59.836253+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:14:09.667084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"263'7","reported_seq":60,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:49.842504+0000","last_change":"2024-09-12T17:30:16.685365+0000","last_active":"2024-09-12T18:07:49.842504+0000","last_peered":"2024-09-12T18:07:49.842504+0000","last_clean":"2024-09-12T18:07:49.842504+0000","last_became_active":"2024-09-12T17:30:16.685054+0000","last_became_peered":"2024-09-12T17:30:16.685054+0000","last_unstale":"2024-09-12T18:07:49.842504+0000","last_undegraded":"2024-09-12T18:07:49.842504+0000","last_fullsized":"2024-09-12T18:07:49.842504+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:42:01.087864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":17,"num_read_kb":30722,"num_write":12,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"263'7","reported_seq":64,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:44.833659+0000","last_change":"2024-09-12T17:30:12.652060+0000","last_active":"2024-09-12T18:07:44.833659+0000","last_peered":"2024-09-12T18:07:44.833659+0000","last_clean":"2024-09-12T18:07:44.833659+0000","last_became_active":"2024-09-12T17:30:12.651780+0000","last_became_peered":"2024-09-12T17:30:12.651780+0000","last_unstale":"2024-09-12T18:07:44.833659+0000","last_undegraded":"2024-09-12T18:07:44.833659+0000","last_fullsized":"2024-09-12T18:07:44.833659+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:20:56.174919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":22530,"num_write":12,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"263'27","reported_seq":128,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:40.137913+0000","last_change":"2024-09-12T17:26:35.665383+0000","last_active":"2024-09-12T18:07:40.137913+0000","last_peered":"2024-09-12T18:07:40.137913+0000","last_clean":"2024-09-12T18:07:40.137913+0000","last_became_active":"2024-09-12T17:26:35.665076+0000","last_became_peered":"2024-09-12T17:26:35.665076+0000","last_unstale":"2024-09-12T18:07:40.137913+0000","last_undegraded":"2024-09-12T18:07:40.137913+0000","last_fullsized":"2024-09-12T18:07:40.137913+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:51:16.783076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":146,"num_read_kb":106,"num_write":38,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:00.140237+0000","last_change":"2024-09-12T17:46:57.077605+0000","last_active":"2024-09-12T18:08:00.140237+0000","last_peered":"2024-09-12T18:08:00.140237+0000","last_clean":"2024-09-12T18:08:00.140237+0000","last_became_active":"2024-09-12T17:46:57.077265+0000","last_became_peered":"2024-09-12T17:46:57.077265+0000","last_unstale":"2024-09-12T18:08:00.140237+0000","last_undegraded":"2024-09-12T18:08:00.140237+0000","last_fullsized":"2024-09-12T18:08:00.140237+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:54:27.754921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"0'0","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:59.850434+0000","last_change":"2024-09-12T17:30:16.684627+0000","last_active":"2024-09-12T18:08:59.850434+0000","last_peered":"2024-09-12T18:08:59.850434+0000","last_clean":"2024-09-12T18:08:59.850434+0000","last_became_active":"2024-09-12T17:30:16.683963+0000","last_became_peered":"2024-09-12T17:30:16.683963+0000","last_unstale":"2024-09-12T18:08:59.850434+0000","last_undegraded":"2024-09-12T18:08:59.850434+0000","last_fullsized":"2024-09-12T18:08:59.850434+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:56:37.344964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"263'7","reported_seq":65,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:49.843543+0000","last_change":"2024-09-12T17:30:12.643034+0000","last_active":"2024-09-12T18:07:49.843543+0000","last_peered":"2024-09-12T18:07:49.843543+0000","last_clean":"2024-09-12T18:07:49.843543+0000","last_became_active":"2024-09-12T17:30:12.642687+0000","last_became_peered":"2024-09-12T17:30:12.642687+0000","last_unstale":"2024-09-12T18:07:49.843543+0000","last_undegraded":"2024-09-12T18:07:49.843543+0000","last_fullsized":"2024-09-12T18:07:49.843543+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:06:07.203968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":26626,"num_write":12,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"263'39","reported_seq":160,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:39.833155+0000","last_change":"2024-09-12T17:26:35.668713+0000","last_active":"2024-09-12T18:07:39.833155+0000","last_peered":"2024-09-12T18:07:39.833155+0000","last_clean":"2024-09-12T18:07:39.833155+0000","last_became_active":"2024-09-12T17:26:35.668286+0000","last_became_peered":"2024-09-12T17:26:35.668286+0000","last_unstale":"2024-09-12T18:07:39.833155+0000","last_undegraded":"2024-09-12T18:07:39.833155+0000","last_fullsized":"2024-09-12T18:07:39.833155+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:20:43.354325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":202,"num_read_kb":143,"num_write":74,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"263'1","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:59.830606+0000","last_change":"2024-09-12T17:46:57.091097+0000","last_active":"2024-09-12T18:07:59.830606+0000","last_peered":"2024-09-12T18:07:59.830606+0000","last_clean":"2024-09-12T18:07:59.830606+0000","last_became_active":"2024-09-12T17:46:57.088919+0000","last_became_peered":"2024-09-12T17:46:57.088919+0000","last_unstale":"2024-09-12T18:07:59.830606+0000","last_undegraded":"2024-09-12T18:07:59.830606+0000","last_fullsized":"2024-09-12T18:07:59.830606+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:56:55.289350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"0'0","reported_seq":34,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:44.840586+0000","last_change":"2024-09-12T17:31:18.237102+0000","last_active":"2024-09-12T18:08:44.840586+0000","last_peered":"2024-09-12T18:08:44.840586+0000","last_clean":"2024-09-12T18:08:44.840586+0000","last_became_active":"2024-09-12T17:31:18.236640+0000","last_became_peered":"2024-09-12T17:31:18.236640+0000","last_unstale":"2024-09-12T18:08:44.840586+0000","last_undegraded":"2024-09-12T18:08:44.840586+0000","last_fullsized":"2024-09-12T18:08:44.840586+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:10:12.696558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.15","version":"0'0","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:54.853566+0000","last_change":"2024-09-12T17:30:12.649885+0000","last_active":"2024-09-12T18:08:54.853566+0000","last_peered":"2024-09-12T18:08:54.853566+0000","last_clean":"2024-09-12T18:08:54.853566+0000","last_became_active":"2024-09-12T17:30:12.649605+0000","last_became_peered":"2024-09-12T17:30:12.649605+0000","last_unstale":"2024-09-12T18:08:54.853566+0000","last_undegraded":"2024-09-12T18:08:54.853566+0000","last_fullsized":"2024-09-12T18:08:54.853566+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:09:52.512870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"263'53","reported_seq":191,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:39.841430+0000","last_change":"2024-09-12T17:26:35.661633+0000","last_active":"2024-09-12T18:07:39.841430+0000","last_peered":"2024-09-12T18:07:39.841430+0000","last_clean":"2024-09-12T18:07:39.841430+0000","last_became_active":"2024-09-12T17:26:35.658602+0000","last_became_peered":"2024-09-12T17:26:35.658602+0000","last_unstale":"2024-09-12T18:07:39.841430+0000","last_undegraded":"2024-09-12T18:07:39.841430+0000","last_fullsized":"2024-09-12T18:07:39.841430+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:40:06.406484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":262,"num_read_kb":183,"num_write":93,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:59.845745+0000","last_change":"2024-09-12T17:46:57.083830+0000","last_active":"2024-09-12T18:07:59.845745+0000","last_peered":"2024-09-12T18:07:59.845745+0000","last_clean":"2024-09-12T18:07:59.845745+0000","last_became_active":"2024-09-12T17:46:57.081080+0000","last_became_peered":"2024-09-12T17:46:57.081080+0000","last_unstale":"2024-09-12T18:07:59.845745+0000","last_undegraded":"2024-09-12T18:07:59.845745+0000","last_fullsized":"2024-09-12T18:07:59.845745+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:12:11.153281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"263'2","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:59.850467+0000","last_change":"2024-09-12T17:30:16.686003+0000","last_active":"2024-09-12T18:08:59.850467+0000","last_peered":"2024-09-12T18:08:59.850467+0000","last_clean":"2024-09-12T18:08:59.850467+0000","last_became_active":"2024-09-12T17:30:16.685688+0000","last_became_peered":"2024-09-12T17:30:16.685688+0000","last_unstale":"2024-09-12T18:08:59.850467+0000","last_undegraded":"2024-09-12T18:08:59.850467+0000","last_fullsized":"2024-09-12T18:08:59.850467+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:37:31.358403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":10240,"num_write":7,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"0'0","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:54.836524+0000","last_change":"2024-09-12T17:30:12.654638+0000","last_active":"2024-09-12T18:08:54.836524+0000","last_peered":"2024-09-12T18:08:54.836524+0000","last_clean":"2024-09-12T18:08:54.836524+0000","last_became_active":"2024-09-12T17:30:12.654327+0000","last_became_peered":"2024-09-12T17:30:12.654327+0000","last_unstale":"2024-09-12T18:08:54.836524+0000","last_undegraded":"2024-09-12T18:08:54.836524+0000","last_fullsized":"2024-09-12T18:08:54.836524+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:44:33.401300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"263'47","reported_seq":185,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:39.828526+0000","last_change":"2024-09-12T17:26:35.662563+0000","last_active":"2024-09-12T18:07:39.828526+0000","last_peered":"2024-09-12T18:07:39.828526+0000","last_clean":"2024-09-12T18:07:39.828526+0000","last_became_active":"2024-09-12T17:26:35.662284+0000","last_became_peered":"2024-09-12T17:26:35.662284+0000","last_unstale":"2024-09-12T18:07:39.828526+0000","last_undegraded":"2024-09-12T18:07:39.828526+0000","last_fullsized":"2024-09-12T18:07:39.828526+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:52:34.213360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":252,"num_read_kb":176,"num_write":91,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:59.844776+0000","last_change":"2024-09-12T17:46:57.082391+0000","last_active":"2024-09-12T18:07:59.844776+0000","last_peered":"2024-09-12T18:07:59.844776+0000","last_clean":"2024-09-12T18:07:59.844776+0000","last_became_active":"2024-09-12T17:46:57.082082+0000","last_became_peered":"2024-09-12T17:46:57.082082+0000","last_unstale":"2024-09-12T18:07:59.844776+0000","last_undegraded":"2024-09-12T18:07:59.844776+0000","last_fullsized":"2024-09-12T18:07:59.844776+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:16:53.154548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"260'3","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:59.853745+0000","last_change":"2024-09-12T17:30:16.675596+0000","last_active":"2024-09-12T18:08:59.853745+0000","last_peered":"2024-09-12T18:08:59.853745+0000","last_clean":"2024-09-12T18:08:59.853745+0000","last_became_active":"2024-09-12T17:30:16.675278+0000","last_became_peered":"2024-09-12T17:30:16.675278+0000","last_unstale":"2024-09-12T18:08:59.853745+0000","last_undegraded":"2024-09-12T18:08:59.853745+0000","last_fullsized":"2024-09-12T18:08:59.853745+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:04:44.516041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"260'2","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:54.841986+0000","last_change":"2024-09-12T17:30:12.643518+0000","last_active":"2024-09-12T18:08:54.841986+0000","last_peered":"2024-09-12T18:08:54.841986+0000","last_clean":"2024-09-12T18:08:54.841986+0000","last_became_active":"2024-09-12T17:30:12.643203+0000","last_became_peered":"2024-09-12T17:30:12.643203+0000","last_unstale":"2024-09-12T18:08:54.841986+0000","last_undegraded":"2024-09-12T18:08:54.841986+0000","last_fullsized":"2024-09-12T18:08:54.841986+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:42:13.911696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":23,"num_write":2,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"263'29","reported_seq":125,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:39.851532+0000","last_change":"2024-09-12T17:26:35.657351+0000","last_active":"2024-09-12T18:08:39.851532+0000","last_peered":"2024-09-12T18:08:39.851532+0000","last_clean":"2024-09-12T18:08:39.851532+0000","last_became_active":"2024-09-12T17:26:35.657035+0000","last_became_peered":"2024-09-12T17:26:35.657035+0000","last_unstale":"2024-09-12T18:08:39.851532+0000","last_undegraded":"2024-09-12T18:08:39.851532+0000","last_fullsized":"2024-09-12T18:08:39.851532+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:26:04.653231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":129,"num_read_kb":90,"num_write":56,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:44.848747+0000","last_change":"2024-09-12T17:46:57.094601+0000","last_active":"2024-09-12T18:08:44.848747+0000","last_peered":"2024-09-12T18:08:44.848747+0000","last_clean":"2024-09-12T18:08:44.848747+0000","last_became_active":"2024-09-12T17:46:57.094314+0000","last_became_peered":"2024-09-12T17:46:57.094314+0000","last_unstale":"2024-09-12T18:08:44.848747+0000","last_undegraded":"2024-09-12T18:08:44.848747+0000","last_fullsized":"2024-09-12T18:08:44.848747+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:55:53.289948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:40.137931+0000","last_change":"2024-09-12T17:30:16.679537+0000","last_active":"2024-09-12T18:07:40.137931+0000","last_peered":"2024-09-12T18:07:40.137931+0000","last_clean":"2024-09-12T18:07:40.137931+0000","last_became_active":"2024-09-12T17:30:16.679282+0000","last_became_peered":"2024-09-12T17:30:16.679282+0000","last_unstale":"2024-09-12T18:07:40.137931+0000","last_undegraded":"2024-09-12T18:07:40.137931+0000","last_fullsized":"2024-09-12T18:07:40.137931+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:52:39.870256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"260'6","reported_seq":58,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:34.842038+0000","last_change":"2024-09-12T17:30:12.652775+0000","last_active":"2024-09-12T18:07:34.842038+0000","last_peered":"2024-09-12T18:07:34.842038+0000","last_clean":"2024-09-12T18:07:34.842038+0000","last_became_active":"2024-09-12T17:30:12.652426+0000","last_became_peered":"2024-09-12T17:30:12.652426+0000","last_unstale":"2024-09-12T18:07:34.842038+0000","last_undegraded":"2024-09-12T18:07:34.842038+0000","last_fullsized":"2024-09-12T18:07:34.842038+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:55:40.416016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":10240,"num_write":16,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"263'34","reported_seq":148,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:34.850782+0000","last_change":"2024-09-12T17:26:35.664129+0000","last_active":"2024-09-12T18:08:34.850782+0000","last_peered":"2024-09-12T18:08:34.850782+0000","last_clean":"2024-09-12T18:08:34.850782+0000","last_became_active":"2024-09-12T17:26:35.663337+0000","last_became_peered":"2024-09-12T17:26:35.663337+0000","last_unstale":"2024-09-12T18:08:34.850782+0000","last_undegraded":"2024-09-12T18:08:34.850782+0000","last_fullsized":"2024-09-12T18:08:34.850782+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:23:54.136870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":179,"num_read_kb":128,"num_write":55,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:44.840640+0000","last_change":"2024-09-12T17:46:57.093698+0000","last_active":"2024-09-12T18:08:44.840640+0000","last_peered":"2024-09-12T18:08:44.840640+0000","last_clean":"2024-09-12T18:08:44.840640+0000","last_became_active":"2024-09-12T17:46:57.093157+0000","last_became_peered":"2024-09-12T17:46:57.093157+0000","last_unstale":"2024-09-12T18:08:44.840640+0000","last_undegraded":"2024-09-12T18:08:44.840640+0000","last_fullsized":"2024-09-12T18:08:44.840640+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:44:51.633185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"263'1","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:40.137893+0000","last_change":"2024-09-12T17:30:16.679016+0000","last_active":"2024-09-12T18:07:40.137893+0000","last_peered":"2024-09-12T18:07:40.137893+0000","last_clean":"2024-09-12T18:07:40.137893+0000","last_became_active":"2024-09-12T17:30:16.678682+0000","last_became_peered":"2024-09-12T17:30:16.678682+0000","last_unstale":"2024-09-12T18:07:40.137893+0000","last_undegraded":"2024-09-12T18:07:40.137893+0000","last_fullsized":"2024-09-12T18:07:40.137893+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:44:09.408299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3210,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"263'4","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:34.840737+0000","last_change":"2024-09-12T17:30:12.653263+0000","last_active":"2024-09-12T18:07:34.840737+0000","last_peered":"2024-09-12T18:07:34.840737+0000","last_clean":"2024-09-12T18:07:34.840737+0000","last_became_active":"2024-09-12T17:30:12.652916+0000","last_became_peered":"2024-09-12T17:30:12.652916+0000","last_unstale":"2024-09-12T18:07:34.840737+0000","last_undegraded":"2024-09-12T18:07:34.840737+0000","last_fullsized":"2024-09-12T18:07:34.840737+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:25:32.409182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485760,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"263'35","reported_seq":148,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:34.839418+0000","last_change":"2024-09-12T17:26:35.669546+0000","last_active":"2024-09-12T18:08:34.839418+0000","last_peered":"2024-09-12T18:08:34.839418+0000","last_clean":"2024-09-12T18:08:34.839418+0000","last_became_active":"2024-09-12T17:26:35.669256+0000","last_became_peered":"2024-09-12T17:26:35.669256+0000","last_unstale":"2024-09-12T18:08:34.839418+0000","last_undegraded":"2024-09-12T18:08:34.839418+0000","last_fullsized":"2024-09-12T18:08:34.839418+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:05:49.889059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":173,"num_read_kb":119,"num_write":68,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"262'1","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:04.835994+0000","last_change":"2024-09-12T17:46:57.090884+0000","last_active":"2024-09-12T18:08:04.835994+0000","last_peered":"2024-09-12T18:08:04.835994+0000","last_clean":"2024-09-12T18:08:04.835994+0000","last_became_active":"2024-09-12T17:46:57.090587+0000","last_became_peered":"2024-09-12T17:46:57.090587+0000","last_unstale":"2024-09-12T18:08:04.835994+0000","last_undegraded":"2024-09-12T18:08:04.835994+0000","last_fullsized":"2024-09-12T18:08:04.835994+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:06:27.485219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"260'3","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:39.841383+0000","last_change":"2024-09-12T17:30:16.686552+0000","last_active":"2024-09-12T18:07:39.841383+0000","last_peered":"2024-09-12T18:07:39.841383+0000","last_clean":"2024-09-12T18:07:39.841383+0000","last_became_active":"2024-09-12T17:30:16.685830+0000","last_became_peered":"2024-09-12T17:30:16.685830+0000","last_unstale":"2024-09-12T18:07:39.841383+0000","last_undegraded":"2024-09-12T18:07:39.841383+0000","last_fullsized":"2024-09-12T18:07:39.841383+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:26:14.033263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"0'0","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:34.861787+0000","last_change":"2024-09-12T17:30:12.640428+0000","last_active":"2024-09-12T18:07:34.861787+0000","last_peered":"2024-09-12T18:07:34.861787+0000","last_clean":"2024-09-12T18:07:34.861787+0000","last_became_active":"2024-09-12T17:30:12.640139+0000","last_became_peered":"2024-09-12T17:30:12.640139+0000","last_unstale":"2024-09-12T18:07:34.861787+0000","last_undegraded":"2024-09-12T18:07:34.861787+0000","last_fullsized":"2024-09-12T18:07:34.861787+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:09:04.186884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"263'49","reported_seq":189,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:34.850284+0000","last_change":"2024-09-12T17:26:35.659117+0000","last_active":"2024-09-12T18:08:34.850284+0000","last_peered":"2024-09-12T18:08:34.850284+0000","last_clean":"2024-09-12T18:08:34.850284+0000","last_became_active":"2024-09-12T17:26:35.658785+0000","last_became_peered":"2024-09-12T17:26:35.658785+0000","last_unstale":"2024-09-12T18:08:34.850284+0000","last_undegraded":"2024-09-12T18:08:34.850284+0000","last_fullsized":"2024-09-12T18:08:34.850284+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:02.864803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":254,"num_read_kb":176,"num_write":93,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"263'1","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:44.848723+0000","last_change":"2024-09-12T17:46:57.093615+0000","last_active":"2024-09-12T18:08:44.848723+0000","last_peered":"2024-09-12T18:08:44.848723+0000","last_clean":"2024-09-12T18:08:44.848723+0000","last_became_active":"2024-09-12T17:46:57.093267+0000","last_became_peered":"2024-09-12T17:46:57.093267+0000","last_unstale":"2024-09-12T18:08:44.848723+0000","last_undegraded":"2024-09-12T18:08:44.848723+0000","last_fullsized":"2024-09-12T18:08:44.848723+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:52:12.345961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:39.862456+0000","last_change":"2024-09-12T17:30:16.681768+0000","last_active":"2024-09-12T18:07:39.862456+0000","last_peered":"2024-09-12T18:07:39.862456+0000","last_clean":"2024-09-12T18:07:39.862456+0000","last_became_active":"2024-09-12T17:30:16.681418+0000","last_became_peered":"2024-09-12T17:30:16.681418+0000","last_unstale":"2024-09-12T18:07:39.862456+0000","last_undegraded":"2024-09-12T18:07:39.862456+0000","last_fullsized":"2024-09-12T18:07:39.862456+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:08:51.341343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"260'3","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:34.841576+0000","last_change":"2024-09-12T17:30:12.643785+0000","last_active":"2024-09-12T18:07:34.841576+0000","last_peered":"2024-09-12T18:07:34.841576+0000","last_clean":"2024-09-12T18:07:34.841576+0000","last_became_active":"2024-09-12T17:30:12.643484+0000","last_became_peered":"2024-09-12T17:30:12.643484+0000","last_unstale":"2024-09-12T18:07:34.841576+0000","last_undegraded":"2024-09-12T18:07:34.841576+0000","last_fullsized":"2024-09-12T18:07:34.841576+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:51:35.165703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"260'23","reported_seq":119,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:34.847525+0000","last_change":"2024-09-12T17:26:35.666220+0000","last_active":"2024-09-12T18:08:34.847525+0000","last_peered":"2024-09-12T18:08:34.847525+0000","last_clean":"2024-09-12T18:08:34.847525+0000","last_became_active":"2024-09-12T17:26:35.665908+0000","last_became_peered":"2024-09-12T17:26:35.665908+0000","last_unstale":"2024-09-12T18:08:34.847525+0000","last_undegraded":"2024-09-12T18:08:34.847525+0000","last_fullsized":"2024-09-12T18:08:34.847525+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:22:29.733636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":120,"num_read_kb":87,"num_write":41,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:44.835349+0000","last_change":"2024-09-12T17:46:57.083432+0000","last_active":"2024-09-12T18:08:44.835349+0000","last_peered":"2024-09-12T18:08:44.835349+0000","last_clean":"2024-09-12T18:08:44.835349+0000","last_became_active":"2024-09-12T17:46:57.083098+0000","last_became_peered":"2024-09-12T17:46:57.083098+0000","last_unstale":"2024-09-12T18:08:44.835349+0000","last_undegraded":"2024-09-12T18:08:44.835349+0000","last_fullsized":"2024-09-12T18:08:44.835349+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:31:23.853524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:34.847617+0000","last_change":"2024-09-12T17:30:16.684194+0000","last_active":"2024-09-12T18:08:34.847617+0000","last_peered":"2024-09-12T18:08:34.847617+0000","last_clean":"2024-09-12T18:08:34.847617+0000","last_became_active":"2024-09-12T17:30:16.683887+0000","last_became_peered":"2024-09-12T17:30:16.683887+0000","last_unstale":"2024-09-12T18:08:34.847617+0000","last_undegraded":"2024-09-12T18:08:34.847617+0000","last_fullsized":"2024-09-12T18:08:34.847617+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:53:34.319282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"263'2","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:29.850086+0000","last_change":"2024-09-12T17:30:12.653459+0000","last_active":"2024-09-12T18:08:29.850086+0000","last_peered":"2024-09-12T18:08:29.850086+0000","last_clean":"2024-09-12T18:08:29.850086+0000","last_became_active":"2024-09-12T17:30:12.653137+0000","last_became_peered":"2024-09-12T17:30:12.653137+0000","last_unstale":"2024-09-12T18:08:29.850086+0000","last_undegraded":"2024-09-12T18:08:29.850086+0000","last_fullsized":"2024-09-12T18:08:29.850086+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:08:52.465178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3148935,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":6148,"num_write":2,"num_write_kb":3076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"263'50","reported_seq":186,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:14.838552+0000","last_change":"2024-09-12T17:26:35.669293+0000","last_active":"2024-09-12T18:07:14.838552+0000","last_peered":"2024-09-12T18:07:14.838552+0000","last_clean":"2024-09-12T18:07:14.838552+0000","last_became_active":"2024-09-12T17:26:35.668989+0000","last_became_peered":"2024-09-12T17:26:35.668989+0000","last_unstale":"2024-09-12T18:07:14.838552+0000","last_undegraded":"2024-09-12T18:07:14.838552+0000","last_fullsized":"2024-09-12T18:07:14.838552+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:43:19.820670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":250,"num_read_kb":175,"num_write":93,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:14.839032+0000","last_change":"2024-09-12T17:46:57.088291+0000","last_active":"2024-09-12T18:07:14.839032+0000","last_peered":"2024-09-12T18:07:14.839032+0000","last_clean":"2024-09-12T18:07:14.839032+0000","last_became_active":"2024-09-12T17:46:57.087982+0000","last_became_peered":"2024-09-12T17:46:57.087982+0000","last_unstale":"2024-09-12T18:07:14.839032+0000","last_undegraded":"2024-09-12T18:07:14.839032+0000","last_fullsized":"2024-09-12T18:07:14.839032+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:05:50.630405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"263'3","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:34.847595+0000","last_change":"2024-09-12T17:30:16.679996+0000","last_active":"2024-09-12T18:08:34.847595+0000","last_peered":"2024-09-12T18:08:34.847595+0000","last_clean":"2024-09-12T18:08:34.847595+0000","last_became_active":"2024-09-12T17:30:16.679621+0000","last_became_peered":"2024-09-12T17:30:16.679621+0000","last_unstale":"2024-09-12T18:08:34.847595+0000","last_undegraded":"2024-09-12T18:08:34.847595+0000","last_fullsized":"2024-09-12T18:08:34.847595+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:23:53.964330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9437184,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":9216,"num_write":3,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"0'0","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:29.833725+0000","last_change":"2024-09-12T17:30:12.649664+0000","last_active":"2024-09-12T18:08:29.833725+0000","last_peered":"2024-09-12T18:08:29.833725+0000","last_clean":"2024-09-12T18:08:29.833725+0000","last_became_active":"2024-09-12T17:30:12.649010+0000","last_became_peered":"2024-09-12T17:30:12.649010+0000","last_unstale":"2024-09-12T18:08:29.833725+0000","last_undegraded":"2024-09-12T18:08:29.833725+0000","last_fullsized":"2024-09-12T18:08:29.833725+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:23:47.681997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"260'8","reported_seq":76,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:19.855981+0000","last_change":"2024-09-12T17:26:35.663336+0000","last_active":"2024-09-12T18:09:19.855981+0000","last_peered":"2024-09-12T18:09:19.855981+0000","last_clean":"2024-09-12T18:09:19.855981+0000","last_became_active":"2024-09-12T17:26:35.663041+0000","last_became_peered":"2024-09-12T17:26:35.663041+0000","last_unstale":"2024-09-12T18:09:19.855981+0000","last_undegraded":"2024-09-12T18:09:19.855981+0000","last_fullsized":"2024-09-12T18:09:19.855981+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:02:26.294386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":28,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:39.870871+0000","last_change":"2024-09-12T17:46:57.086356+0000","last_active":"2024-09-12T18:08:39.870871+0000","last_peered":"2024-09-12T18:08:39.870871+0000","last_clean":"2024-09-12T18:08:39.870871+0000","last_became_active":"2024-09-12T17:46:57.085908+0000","last_became_peered":"2024-09-12T17:46:57.085908+0000","last_unstale":"2024-09-12T18:08:39.870871+0000","last_undegraded":"2024-09-12T18:08:39.870871+0000","last_fullsized":"2024-09-12T18:08:39.870871+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:01:54.509459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"0'0","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:40.144742+0000","last_change":"2024-09-12T17:30:16.679533+0000","last_active":"2024-09-12T18:08:40.144742+0000","last_peered":"2024-09-12T18:08:40.144742+0000","last_clean":"2024-09-12T18:08:40.144742+0000","last_became_active":"2024-09-12T17:30:16.679193+0000","last_became_peered":"2024-09-12T17:30:16.679193+0000","last_unstale":"2024-09-12T18:08:40.144742+0000","last_undegraded":"2024-09-12T18:08:40.144742+0000","last_fullsized":"2024-09-12T18:08:40.144742+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:21:35.478757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"0'0","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:29.838852+0000","last_change":"2024-09-12T17:30:12.647471+0000","last_active":"2024-09-12T18:08:29.838852+0000","last_peered":"2024-09-12T18:08:29.838852+0000","last_clean":"2024-09-12T18:08:29.838852+0000","last_became_active":"2024-09-12T17:30:12.646945+0000","last_became_peered":"2024-09-12T17:30:12.646945+0000","last_unstale":"2024-09-12T18:08:29.838852+0000","last_undegraded":"2024-09-12T18:08:29.838852+0000","last_fullsized":"2024-09-12T18:08:29.838852+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:42:36.686975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"263'33","reported_seq":143,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:19.876853+0000","last_change":"2024-09-12T17:26:35.665050+0000","last_active":"2024-09-12T18:09:19.876853+0000","last_peered":"2024-09-12T18:09:19.876853+0000","last_clean":"2024-09-12T18:09:19.876853+0000","last_became_active":"2024-09-12T17:26:35.664749+0000","last_became_peered":"2024-09-12T17:26:35.664749+0000","last_unstale":"2024-09-12T18:09:19.876853+0000","last_undegraded":"2024-09-12T18:09:19.876853+0000","last_fullsized":"2024-09-12T18:09:19.876853+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:25:00.758310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":166,"num_read_kb":124,"num_write":50,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:39.851484+0000","last_change":"2024-09-12T17:46:57.084760+0000","last_active":"2024-09-12T18:08:39.851484+0000","last_peered":"2024-09-12T18:08:39.851484+0000","last_clean":"2024-09-12T18:08:39.851484+0000","last_became_active":"2024-09-12T17:46:57.084421+0000","last_became_peered":"2024-09-12T17:46:57.084421+0000","last_unstale":"2024-09-12T18:08:39.851484+0000","last_undegraded":"2024-09-12T18:08:39.851484+0000","last_fullsized":"2024-09-12T18:08:39.851484+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:35:17.085619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"0'0","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:34.847633+0000","last_change":"2024-09-12T17:30:16.682114+0000","last_active":"2024-09-12T18:08:34.847633+0000","last_peered":"2024-09-12T18:08:34.847633+0000","last_clean":"2024-09-12T18:08:34.847633+0000","last_became_active":"2024-09-12T17:30:16.681171+0000","last_became_peered":"2024-09-12T17:30:16.681171+0000","last_unstale":"2024-09-12T18:08:34.847633+0000","last_undegraded":"2024-09-12T18:08:34.847633+0000","last_fullsized":"2024-09-12T18:08:34.847633+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:35:19.241688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"263'4","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:35.144221+0000","last_change":"2024-09-12T17:30:12.641879+0000","last_active":"2024-09-12T18:08:35.144221+0000","last_peered":"2024-09-12T18:08:35.144221+0000","last_clean":"2024-09-12T18:08:35.144221+0000","last_became_active":"2024-09-12T17:30:12.641592+0000","last_became_peered":"2024-09-12T17:30:12.641592+0000","last_unstale":"2024-09-12T18:08:35.144221+0000","last_undegraded":"2024-09-12T18:08:35.144221+0000","last_fullsized":"2024-09-12T18:08:35.144221+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:29:07.666017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11534336,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":11264,"num_write":4,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"263'52","reported_seq":196,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:19.838941+0000","last_change":"2024-09-12T17:26:35.663784+0000","last_active":"2024-09-12T18:09:19.838941+0000","last_peered":"2024-09-12T18:09:19.838941+0000","last_clean":"2024-09-12T18:09:19.838941+0000","last_became_active":"2024-09-12T17:26:35.663472+0000","last_became_peered":"2024-09-12T17:26:35.663472+0000","last_unstale":"2024-09-12T18:09:19.838941+0000","last_undegraded":"2024-09-12T18:09:19.838941+0000","last_fullsized":"2024-09-12T18:09:19.838941+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:48:26.678396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":261,"num_read_kb":192,"num_write":92,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:14.838540+0000","last_change":"2024-09-12T17:46:57.090539+0000","last_active":"2024-09-12T18:07:14.838540+0000","last_peered":"2024-09-12T18:07:14.838540+0000","last_clean":"2024-09-12T18:07:14.838540+0000","last_became_active":"2024-09-12T17:46:57.089601+0000","last_became_peered":"2024-09-12T17:46:57.089601+0000","last_unstale":"2024-09-12T18:07:14.838540+0000","last_undegraded":"2024-09-12T18:07:14.838540+0000","last_fullsized":"2024-09-12T18:07:14.838540+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:13:07.708030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"0'0","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:19.856690+0000","last_change":"2024-09-12T17:30:16.679697+0000","last_active":"2024-09-12T18:09:19.856690+0000","last_peered":"2024-09-12T18:09:19.856690+0000","last_clean":"2024-09-12T18:09:19.856690+0000","last_became_active":"2024-09-12T17:30:16.679308+0000","last_became_peered":"2024-09-12T17:30:16.679308+0000","last_unstale":"2024-09-12T18:09:19.856690+0000","last_undegraded":"2024-09-12T18:09:19.856690+0000","last_fullsized":"2024-09-12T18:09:19.856690+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:06:24.083988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"263'3","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:14.844358+0000","last_change":"2024-09-12T17:30:12.645085+0000","last_active":"2024-09-12T18:09:14.844358+0000","last_peered":"2024-09-12T18:09:14.844358+0000","last_clean":"2024-09-12T18:09:14.844358+0000","last_became_active":"2024-09-12T17:30:12.644792+0000","last_became_peered":"2024-09-12T17:30:12.644792+0000","last_unstale":"2024-09-12T18:09:14.844358+0000","last_undegraded":"2024-09-12T18:09:14.844358+0000","last_fullsized":"2024-09-12T18:09:14.844358+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:25:31.260415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6339869,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":6192,"num_write":3,"num_write_kb":6192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"263'30","reported_seq":142,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:19.845281+0000","last_change":"2024-09-12T17:26:35.667932+0000","last_active":"2024-09-12T18:09:19.845281+0000","last_peered":"2024-09-12T18:09:19.845281+0000","last_clean":"2024-09-12T18:09:19.845281+0000","last_became_active":"2024-09-12T17:26:35.667655+0000","last_became_peered":"2024-09-12T17:26:35.667655+0000","last_unstale":"2024-09-12T18:09:19.845281+0000","last_undegraded":"2024-09-12T18:09:19.845281+0000","last_fullsized":"2024-09-12T18:09:19.845281+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:21:57.489397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":166,"num_read_kb":116,"num_write":53,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:19.839947+0000","last_change":"2024-09-12T17:46:57.090843+0000","last_active":"2024-09-12T18:07:19.839947+0000","last_peered":"2024-09-12T18:07:19.839947+0000","last_clean":"2024-09-12T18:07:19.839947+0000","last_became_active":"2024-09-12T17:46:57.090477+0000","last_became_peered":"2024-09-12T17:46:57.090477+0000","last_unstale":"2024-09-12T18:07:19.839947+0000","last_undegraded":"2024-09-12T18:07:19.839947+0000","last_fullsized":"2024-09-12T18:07:19.839947+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:01:13.812814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"260'8","reported_seq":57,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:19.857045+0000","last_change":"2024-09-12T17:30:16.673290+0000","last_active":"2024-09-12T18:09:19.857045+0000","last_peered":"2024-09-12T18:09:19.857045+0000","last_clean":"2024-09-12T18:09:19.857045+0000","last_became_active":"2024-09-12T17:30:16.672989+0000","last_became_peered":"2024-09-12T17:30:16.672989+0000","last_unstale":"2024-09-12T18:09:19.857045+0000","last_undegraded":"2024-09-12T18:09:19.857045+0000","last_fullsized":"2024-09-12T18:09:19.857045+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:58:17.894413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":6167,"num_write":13,"num_write_kb":6167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"263'2","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:15.148384+0000","last_change":"2024-09-12T17:30:12.642188+0000","last_active":"2024-09-12T18:09:15.148384+0000","last_peered":"2024-09-12T18:09:15.148384+0000","last_clean":"2024-09-12T18:09:15.148384+0000","last_became_active":"2024-09-12T17:30:12.641901+0000","last_became_peered":"2024-09-12T17:30:12.641901+0000","last_unstale":"2024-09-12T18:09:15.148384+0000","last_undegraded":"2024-09-12T18:09:15.148384+0000","last_fullsized":"2024-09-12T18:09:15.148384+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:30:51.212272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":12288,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"263'9","reported_seq":78,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:49.844267+0000","last_change":"2024-09-12T17:26:35.655618+0000","last_active":"2024-09-12T18:07:49.844267+0000","last_peered":"2024-09-12T18:07:49.844267+0000","last_clean":"2024-09-12T18:07:49.844267+0000","last_became_active":"2024-09-12T17:26:35.655307+0000","last_became_peered":"2024-09-12T17:26:35.655307+0000","last_unstale":"2024-09-12T18:07:49.844267+0000","last_undegraded":"2024-09-12T18:07:49.844267+0000","last_fullsized":"2024-09-12T18:07:49.844267+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:34:53.632505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":30,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"263'1","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:14.839069+0000","last_change":"2024-09-12T17:46:57.086405+0000","last_active":"2024-09-12T18:07:14.839069+0000","last_peered":"2024-09-12T18:07:14.839069+0000","last_clean":"2024-09-12T18:07:14.839069+0000","last_became_active":"2024-09-12T17:46:57.086116+0000","last_became_peered":"2024-09-12T17:46:57.086116+0000","last_unstale":"2024-09-12T18:07:14.839069+0000","last_undegraded":"2024-09-12T18:07:14.839069+0000","last_fullsized":"2024-09-12T18:07:14.839069+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:36:48.862604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:35.144176+0000","last_change":"2024-09-12T17:30:16.676645+0000","last_active":"2024-09-12T18:08:35.144176+0000","last_peered":"2024-09-12T18:08:35.144176+0000","last_clean":"2024-09-12T18:08:35.144176+0000","last_became_active":"2024-09-12T17:30:16.675243+0000","last_became_peered":"2024-09-12T17:30:16.675243+0000","last_unstale":"2024-09-12T18:08:35.144176+0000","last_undegraded":"2024-09-12T18:08:35.144176+0000","last_fullsized":"2024-09-12T18:08:35.144176+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:41:53.506076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"263'1","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:19.845247+0000","last_change":"2024-09-12T17:30:12.641067+0000","last_active":"2024-09-12T18:09:19.845247+0000","last_peered":"2024-09-12T18:09:19.845247+0000","last_clean":"2024-09-12T18:09:19.845247+0000","last_became_active":"2024-09-12T17:30:12.640736+0000","last_became_peered":"2024-09-12T17:30:12.640736+0000","last_unstale":"2024-09-12T18:09:19.845247+0000","last_undegraded":"2024-09-12T18:09:19.845247+0000","last_fullsized":"2024-09-12T18:09:19.845247+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:58:18.939586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3210,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"0'0","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:44.841920+0000","last_change":"2024-09-12T17:26:35.656429+0000","last_active":"2024-09-12T18:07:44.841920+0000","last_peered":"2024-09-12T18:07:44.841920+0000","last_clean":"2024-09-12T18:07:44.841920+0000","last_became_active":"2024-09-12T17:26:35.656149+0000","last_became_peered":"2024-09-12T17:26:35.656149+0000","last_unstale":"2024-09-12T18:07:44.841920+0000","last_undegraded":"2024-09-12T18:07:44.841920+0000","last_fullsized":"2024-09-12T18:07:44.841920+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:53:34.940903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:14.830083+0000","last_change":"2024-09-12T17:46:57.096748+0000","last_active":"2024-09-12T18:07:14.830083+0000","last_peered":"2024-09-12T18:07:14.830083+0000","last_clean":"2024-09-12T18:07:14.830083+0000","last_became_active":"2024-09-12T17:46:57.096375+0000","last_became_peered":"2024-09-12T17:46:57.096375+0000","last_unstale":"2024-09-12T18:07:14.830083+0000","last_undegraded":"2024-09-12T18:07:14.830083+0000","last_fullsized":"2024-09-12T18:07:14.830083+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:03:26.698689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"263'1","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:24.857996+0000","last_change":"2024-09-12T17:30:16.686958+0000","last_active":"2024-09-12T18:09:24.857996+0000","last_peered":"2024-09-12T18:09:24.857996+0000","last_clean":"2024-09-12T18:09:24.857996+0000","last_became_active":"2024-09-12T17:30:16.686562+0000","last_became_peered":"2024-09-12T17:30:16.686562+0000","last_unstale":"2024-09-12T18:09:24.857996+0000","last_undegraded":"2024-09-12T18:09:24.857996+0000","last_fullsized":"2024-09-12T18:09:24.857996+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:17:00.235108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3207,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"263'3","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:29.849631+0000","last_change":"2024-09-12T17:30:12.644840+0000","last_active":"2024-09-12T18:08:29.849631+0000","last_peered":"2024-09-12T18:08:29.849631+0000","last_clean":"2024-09-12T18:08:29.849631+0000","last_became_active":"2024-09-12T17:30:12.644490+0000","last_became_peered":"2024-09-12T17:30:12.644490+0000","last_unstale":"2024-09-12T18:08:29.849631+0000","last_undegraded":"2024-09-12T18:08:29.849631+0000","last_fullsized":"2024-09-12T18:08:29.849631+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:52:02.191118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9437184,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":9216,"num_write":3,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"263'23","reported_seq":115,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:44.863265+0000","last_change":"2024-09-12T17:26:35.665188+0000","last_active":"2024-09-12T18:07:44.863265+0000","last_peered":"2024-09-12T18:07:44.863265+0000","last_clean":"2024-09-12T18:07:44.863265+0000","last_became_active":"2024-09-12T17:26:35.664849+0000","last_became_peered":"2024-09-12T17:26:35.664849+0000","last_unstale":"2024-09-12T18:07:44.863265+0000","last_undegraded":"2024-09-12T18:07:44.863265+0000","last_fullsized":"2024-09-12T18:07:44.863265+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:29:49.144321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":79,"num_write":44,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:49.844298+0000","last_change":"2024-09-12T17:46:57.089388+0000","last_active":"2024-09-12T18:07:49.844298+0000","last_peered":"2024-09-12T18:07:49.844298+0000","last_clean":"2024-09-12T18:07:49.844298+0000","last_became_active":"2024-09-12T17:46:57.089081+0000","last_became_peered":"2024-09-12T17:46:57.089081+0000","last_unstale":"2024-09-12T18:07:49.844298+0000","last_undegraded":"2024-09-12T18:07:49.844298+0000","last_fullsized":"2024-09-12T18:07:49.844298+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:14:44.213114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"0'0","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:54.834972+0000","last_change":"2024-09-12T17:30:16.681225+0000","last_active":"2024-09-12T18:07:54.834972+0000","last_peered":"2024-09-12T18:07:54.834972+0000","last_clean":"2024-09-12T18:07:54.834972+0000","last_became_active":"2024-09-12T17:30:16.680901+0000","last_became_peered":"2024-09-12T17:30:16.680901+0000","last_unstale":"2024-09-12T18:07:54.834972+0000","last_undegraded":"2024-09-12T18:07:54.834972+0000","last_fullsized":"2024-09-12T18:07:54.834972+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:32:33.218603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"0'0","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:44.843546+0000","last_change":"2024-09-12T17:30:12.649239+0000","last_active":"2024-09-12T18:07:44.843546+0000","last_peered":"2024-09-12T18:07:44.843546+0000","last_clean":"2024-09-12T18:07:44.843546+0000","last_became_active":"2024-09-12T17:30:12.648875+0000","last_became_peered":"2024-09-12T17:30:12.648875+0000","last_unstale":"2024-09-12T18:07:44.843546+0000","last_undegraded":"2024-09-12T18:07:44.843546+0000","last_fullsized":"2024-09-12T18:07:44.843546+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:46:54.532755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"263'15","reported_seq":92,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:44.833731+0000","last_change":"2024-09-12T17:26:35.668474+0000","last_active":"2024-09-12T18:07:44.833731+0000","last_peered":"2024-09-12T18:07:44.833731+0000","last_clean":"2024-09-12T18:07:44.833731+0000","last_became_active":"2024-09-12T17:26:35.668118+0000","last_became_peered":"2024-09-12T17:26:35.668118+0000","last_unstale":"2024-09-12T18:07:44.833731+0000","last_undegraded":"2024-09-12T18:07:44.833731+0000","last_fullsized":"2024-09-12T18:07:44.833731+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:54:30.960531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":44,"num_write":31,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:49.843508+0000","last_change":"2024-09-12T17:46:57.086214+0000","last_active":"2024-09-12T18:07:49.843508+0000","last_peered":"2024-09-12T18:07:49.843508+0000","last_clean":"2024-09-12T18:07:49.843508+0000","last_became_active":"2024-09-12T17:46:57.085922+0000","last_became_peered":"2024-09-12T17:46:57.085922+0000","last_unstale":"2024-09-12T18:07:49.843508+0000","last_undegraded":"2024-09-12T18:07:49.843508+0000","last_fullsized":"2024-09-12T18:07:49.843508+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:03:09.811603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"263'4","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:49.834326+0000","last_change":"2024-09-12T17:30:16.669329+0000","last_active":"2024-09-12T18:07:49.834326+0000","last_peered":"2024-09-12T18:07:49.834326+0000","last_clean":"2024-09-12T18:07:49.834326+0000","last_became_active":"2024-09-12T17:30:16.668999+0000","last_became_peered":"2024-09-12T17:30:16.668999+0000","last_unstale":"2024-09-12T18:07:49.834326+0000","last_undegraded":"2024-09-12T18:07:49.834326+0000","last_fullsized":"2024-09-12T18:07:49.834326+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:39:23.168458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7340032,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":12288,"num_write":9,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"0'0","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:54.830107+0000","last_change":"2024-09-12T17:30:12.650378+0000","last_active":"2024-09-12T18:07:54.830107+0000","last_peered":"2024-09-12T18:07:54.830107+0000","last_clean":"2024-09-12T18:07:54.830107+0000","last_became_active":"2024-09-12T17:30:12.649350+0000","last_became_peered":"2024-09-12T17:30:12.649350+0000","last_unstale":"2024-09-12T18:07:54.830107+0000","last_undegraded":"2024-09-12T18:07:54.830107+0000","last_fullsized":"2024-09-12T18:07:54.830107+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:58:25.779058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"263'20","reported_seq":115,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:44.863349+0000","last_change":"2024-09-12T17:26:35.667425+0000","last_active":"2024-09-12T18:07:44.863349+0000","last_peered":"2024-09-12T18:07:44.863349+0000","last_clean":"2024-09-12T18:07:44.863349+0000","last_became_active":"2024-09-12T17:26:35.667060+0000","last_became_peered":"2024-09-12T17:26:35.667060+0000","last_unstale":"2024-09-12T18:07:44.863349+0000","last_undegraded":"2024-09-12T18:07:44.863349+0000","last_fullsized":"2024-09-12T18:07:44.863349+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:13:33.511985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":80,"num_write":36,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:00.146690+0000","last_change":"2024-09-12T17:46:57.078643+0000","last_active":"2024-09-12T18:09:00.146690+0000","last_peered":"2024-09-12T18:09:00.146690+0000","last_clean":"2024-09-12T18:09:00.146690+0000","last_became_active":"2024-09-12T17:46:57.076358+0000","last_became_peered":"2024-09-12T17:46:57.076358+0000","last_unstale":"2024-09-12T18:09:00.146690+0000","last_undegraded":"2024-09-12T18:09:00.146690+0000","last_fullsized":"2024-09-12T18:09:00.146690+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:22:38.368544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"260'3","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:19.857246+0000","last_change":"2024-09-12T17:30:16.676537+0000","last_active":"2024-09-12T18:09:19.857246+0000","last_peered":"2024-09-12T18:09:19.857246+0000","last_clean":"2024-09-12T18:09:19.857246+0000","last_became_active":"2024-09-12T17:30:16.676187+0000","last_became_peered":"2024-09-12T17:30:16.676187+0000","last_unstale":"2024-09-12T18:09:19.857246+0000","last_undegraded":"2024-09-12T18:09:19.857246+0000","last_fullsized":"2024-09-12T18:09:19.857246+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:03:12.668403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"263'4","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:14.855285+0000","last_change":"2024-09-12T17:30:12.651492+0000","last_active":"2024-09-12T18:09:14.855285+0000","last_peered":"2024-09-12T18:09:14.855285+0000","last_clean":"2024-09-12T18:09:14.855285+0000","last_became_active":"2024-09-12T17:30:12.651254+0000","last_became_peered":"2024-09-12T17:30:12.651254+0000","last_unstale":"2024-09-12T18:09:14.855285+0000","last_undegraded":"2024-09-12T18:09:14.855285+0000","last_fullsized":"2024-09-12T18:09:14.855285+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:54:45.814379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":16,"num_write":9,"num_write_kb":1040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"263'21","reported_seq":106,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:19.848719+0000","last_change":"2024-09-12T17:26:35.660865+0000","last_active":"2024-09-12T18:08:19.848719+0000","last_peered":"2024-09-12T18:08:19.848719+0000","last_clean":"2024-09-12T18:08:19.848719+0000","last_became_active":"2024-09-12T17:26:35.660521+0000","last_became_peered":"2024-09-12T17:26:35.660521+0000","last_unstale":"2024-09-12T18:08:19.848719+0000","last_undegraded":"2024-09-12T18:08:19.848719+0000","last_fullsized":"2024-09-12T18:08:19.848719+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:36:23.758533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":60,"num_write":47,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:49.844137+0000","last_change":"2024-09-12T17:46:57.076516+0000","last_active":"2024-09-12T18:07:49.844137+0000","last_peered":"2024-09-12T18:07:49.844137+0000","last_clean":"2024-09-12T18:07:49.844137+0000","last_became_active":"2024-09-12T17:46:57.075936+0000","last_became_peered":"2024-09-12T17:46:57.075936+0000","last_unstale":"2024-09-12T18:07:49.844137+0000","last_undegraded":"2024-09-12T18:07:49.844137+0000","last_fullsized":"2024-09-12T18:07:49.844137+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:03:25.092644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"0'0","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:19.856809+0000","last_change":"2024-09-12T17:30:16.671561+0000","last_active":"2024-09-12T18:09:19.856809+0000","last_peered":"2024-09-12T18:09:19.856809+0000","last_clean":"2024-09-12T18:09:19.856809+0000","last_became_active":"2024-09-12T17:30:16.671232+0000","last_became_peered":"2024-09-12T17:30:16.671232+0000","last_unstale":"2024-09-12T18:09:19.856809+0000","last_undegraded":"2024-09-12T18:09:19.856809+0000","last_fullsized":"2024-09-12T18:09:19.856809+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:01:53.261691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"260'3","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:14.856411+0000","last_change":"2024-09-12T17:30:12.652805+0000","last_active":"2024-09-12T18:09:14.856411+0000","last_peered":"2024-09-12T18:09:14.856411+0000","last_clean":"2024-09-12T18:09:14.856411+0000","last_became_active":"2024-09-12T17:30:12.652439+0000","last_became_peered":"2024-09-12T17:30:12.652439+0000","last_unstale":"2024-09-12T18:09:14.856411+0000","last_undegraded":"2024-09-12T18:09:14.856411+0000","last_fullsized":"2024-09-12T18:09:14.856411+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:38:28.870273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"263'34","reported_seq":144,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:15.141873+0000","last_change":"2024-09-12T17:26:35.664662+0000","last_active":"2024-09-12T18:08:15.141873+0000","last_peered":"2024-09-12T18:08:15.141873+0000","last_clean":"2024-09-12T18:08:15.141873+0000","last_became_active":"2024-09-12T17:26:35.664338+0000","last_became_peered":"2024-09-12T17:26:35.664338+0000","last_unstale":"2024-09-12T18:08:15.141873+0000","last_undegraded":"2024-09-12T18:08:15.141873+0000","last_fullsized":"2024-09-12T18:08:15.141873+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:31:50.906050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":161,"num_read_kb":109,"num_write":67,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"262'1","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:39.834842+0000","last_change":"2024-09-12T17:46:57.091123+0000","last_active":"2024-09-12T18:08:39.834842+0000","last_peered":"2024-09-12T18:08:39.834842+0000","last_clean":"2024-09-12T18:08:39.834842+0000","last_became_active":"2024-09-12T17:46:57.090581+0000","last_became_peered":"2024-09-12T17:46:57.090581+0000","last_unstale":"2024-09-12T18:08:39.834842+0000","last_undegraded":"2024-09-12T18:08:39.834842+0000","last_fullsized":"2024-09-12T18:08:39.834842+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:32:17.465596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"260'3","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:50.139110+0000","last_change":"2024-09-12T17:30:16.677712+0000","last_active":"2024-09-12T18:07:50.139110+0000","last_peered":"2024-09-12T18:07:50.139110+0000","last_clean":"2024-09-12T18:07:50.139110+0000","last_became_active":"2024-09-12T17:30:16.677428+0000","last_became_peered":"2024-09-12T17:30:16.677428+0000","last_unstale":"2024-09-12T18:07:50.139110+0000","last_undegraded":"2024-09-12T18:07:50.139110+0000","last_fullsized":"2024-09-12T18:07:50.139110+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:43:08.742548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"263'5","reported_seq":58,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:19.848612+0000","last_change":"2024-09-12T17:30:12.644935+0000","last_active":"2024-09-12T18:08:19.848612+0000","last_peered":"2024-09-12T18:08:19.848612+0000","last_clean":"2024-09-12T18:08:19.848612+0000","last_became_active":"2024-09-12T17:30:12.644600+0000","last_became_peered":"2024-09-12T17:30:12.644600+0000","last_unstale":"2024-09-12T18:08:19.848612+0000","last_undegraded":"2024-09-12T18:08:19.848612+0000","last_fullsized":"2024-09-12T18:08:19.848612+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:08:42.394913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":6144,"num_write":10,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"263'63","reported_seq":232,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:14.846770+0000","last_change":"2024-09-12T17:26:35.658927+0000","last_active":"2024-09-12T18:08:14.846770+0000","last_peered":"2024-09-12T18:08:14.846770+0000","last_clean":"2024-09-12T18:08:14.846770+0000","last_became_active":"2024-09-12T17:26:35.658630+0000","last_became_peered":"2024-09-12T17:26:35.658630+0000","last_unstale":"2024-09-12T18:08:14.846770+0000","last_undegraded":"2024-09-12T18:08:14.846770+0000","last_fullsized":"2024-09-12T18:08:14.846770+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:40:44.086306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":336,"num_read_kb":235,"num_write":105,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:39.840111+0000","last_change":"2024-09-12T17:46:57.093471+0000","last_active":"2024-09-12T18:08:39.840111+0000","last_peered":"2024-09-12T18:08:39.840111+0000","last_clean":"2024-09-12T18:08:39.840111+0000","last_became_active":"2024-09-12T17:46:57.092472+0000","last_became_peered":"2024-09-12T17:46:57.092472+0000","last_unstale":"2024-09-12T18:08:39.840111+0000","last_undegraded":"2024-09-12T18:08:39.840111+0000","last_fullsized":"2024-09-12T18:08:39.840111+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:53:15.268714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"0'0","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:34.849448+0000","last_change":"2024-09-12T17:30:16.675715+0000","last_active":"2024-09-12T18:08:34.849448+0000","last_peered":"2024-09-12T18:08:34.849448+0000","last_clean":"2024-09-12T18:08:34.849448+0000","last_became_active":"2024-09-12T17:30:16.675380+0000","last_became_peered":"2024-09-12T17:30:16.675380+0000","last_unstale":"2024-09-12T18:08:34.849448+0000","last_undegraded":"2024-09-12T18:08:34.849448+0000","last_fullsized":"2024-09-12T18:08:34.849448+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:03:46.402687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"0'0","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:44.843471+0000","last_change":"2024-09-12T17:30:12.652798+0000","last_active":"2024-09-12T18:07:44.843471+0000","last_peered":"2024-09-12T18:07:44.843471+0000","last_clean":"2024-09-12T18:07:44.843471+0000","last_became_active":"2024-09-12T17:30:12.652368+0000","last_became_peered":"2024-09-12T17:30:12.652368+0000","last_unstale":"2024-09-12T18:07:44.843471+0000","last_undegraded":"2024-09-12T18:07:44.843471+0000","last_fullsized":"2024-09-12T18:07:44.843471+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:17:25.947883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"263'14","reported_seq":92,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:14.847538+0000","last_change":"2024-09-12T17:26:35.662321+0000","last_active":"2024-09-12T18:08:14.847538+0000","last_peered":"2024-09-12T18:08:14.847538+0000","last_clean":"2024-09-12T18:08:14.847538+0000","last_became_active":"2024-09-12T17:26:35.662029+0000","last_became_peered":"2024-09-12T17:26:35.662029+0000","last_unstale":"2024-09-12T18:08:14.847538+0000","last_undegraded":"2024-09-12T18:08:14.847538+0000","last_fullsized":"2024-09-12T18:08:14.847538+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:25:20.058995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":47,"num_write":25,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:49.834357+0000","last_change":"2024-09-12T17:46:57.088925+0000","last_active":"2024-09-12T18:07:49.834357+0000","last_peered":"2024-09-12T18:07:49.834357+0000","last_clean":"2024-09-12T18:07:49.834357+0000","last_became_active":"2024-09-12T17:46:57.088577+0000","last_became_peered":"2024-09-12T17:46:57.088577+0000","last_unstale":"2024-09-12T18:07:49.834357+0000","last_undegraded":"2024-09-12T18:07:49.834357+0000","last_fullsized":"2024-09-12T18:07:49.834357+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:13:06.852295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"263'3","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:49.864118+0000","last_change":"2024-09-12T17:30:16.687859+0000","last_active":"2024-09-12T18:07:49.864118+0000","last_peered":"2024-09-12T18:07:49.864118+0000","last_clean":"2024-09-12T18:07:49.864118+0000","last_became_active":"2024-09-12T17:30:16.687560+0000","last_became_peered":"2024-09-12T17:30:16.687560+0000","last_unstale":"2024-09-12T18:07:49.864118+0000","last_undegraded":"2024-09-12T18:07:49.864118+0000","last_fullsized":"2024-09-12T18:07:49.864118+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:18:26.345356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9437184,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":15360,"num_write":3,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"260'5","reported_seq":63,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:45.138528+0000","last_change":"2024-09-12T17:30:12.646334+0000","last_active":"2024-09-12T18:07:45.138528+0000","last_peered":"2024-09-12T18:07:45.138528+0000","last_clean":"2024-09-12T18:07:45.138528+0000","last_became_active":"2024-09-12T17:30:12.646002+0000","last_became_peered":"2024-09-12T17:30:12.646002+0000","last_unstale":"2024-09-12T18:07:45.138528+0000","last_undegraded":"2024-09-12T18:07:45.138528+0000","last_fullsized":"2024-09-12T18:07:45.138528+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:37:55.039202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"263'38","reported_seq":162,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:14.867529+0000","last_change":"2024-09-12T17:26:35.665038+0000","last_active":"2024-09-12T18:08:14.867529+0000","last_peered":"2024-09-12T18:08:14.867529+0000","last_clean":"2024-09-12T18:08:14.867529+0000","last_became_active":"2024-09-12T17:26:35.664653+0000","last_became_peered":"2024-09-12T17:26:35.664653+0000","last_unstale":"2024-09-12T18:08:14.867529+0000","last_undegraded":"2024-09-12T18:08:14.867529+0000","last_fullsized":"2024-09-12T18:08:14.867529+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:25:13.289455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":203,"num_read_kb":159,"num_write":60,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:54.845096+0000","last_change":"2024-09-12T17:46:57.092076+0000","last_active":"2024-09-12T18:07:54.845096+0000","last_peered":"2024-09-12T18:07:54.845096+0000","last_clean":"2024-09-12T18:07:54.845096+0000","last_became_active":"2024-09-12T17:46:57.091489+0000","last_became_peered":"2024-09-12T17:46:57.091489+0000","last_unstale":"2024-09-12T18:07:54.845096+0000","last_undegraded":"2024-09-12T18:07:54.845096+0000","last_fullsized":"2024-09-12T18:07:54.845096+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:45:12.006559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"263'1","reported_seq":44,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:49.844180+0000","last_change":"2024-09-12T17:30:16.671442+0000","last_active":"2024-09-12T18:07:49.844180+0000","last_peered":"2024-09-12T18:07:49.844180+0000","last_clean":"2024-09-12T18:07:49.844180+0000","last_became_active":"2024-09-12T17:30:16.671126+0000","last_became_peered":"2024-09-12T17:30:16.671126+0000","last_unstale":"2024-09-12T18:07:49.844180+0000","last_undegraded":"2024-09-12T18:07:49.844180+0000","last_fullsized":"2024-09-12T18:07:49.844180+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:55:00.165120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":48,"num_write":1,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"260'3","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:44.863319+0000","last_change":"2024-09-12T17:30:12.645438+0000","last_active":"2024-09-12T18:07:44.863319+0000","last_peered":"2024-09-12T18:07:44.863319+0000","last_clean":"2024-09-12T18:07:44.863319+0000","last_became_active":"2024-09-12T17:30:12.645099+0000","last_became_peered":"2024-09-12T17:30:12.645099+0000","last_unstale":"2024-09-12T18:07:44.863319+0000","last_undegraded":"2024-09-12T18:07:44.863319+0000","last_fullsized":"2024-09-12T18:07:44.863319+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:10:18.763902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"263'42","reported_seq":167,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:39.851442+0000","last_change":"2024-09-12T17:26:35.666120+0000","last_active":"2024-09-12T18:08:39.851442+0000","last_peered":"2024-09-12T18:08:39.851442+0000","last_clean":"2024-09-12T18:08:39.851442+0000","last_became_active":"2024-09-12T17:26:35.665804+0000","last_became_peered":"2024-09-12T17:26:35.665804+0000","last_unstale":"2024-09-12T18:08:39.851442+0000","last_undegraded":"2024-09-12T18:08:39.851442+0000","last_fullsized":"2024-09-12T18:08:39.851442+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:39:01.905486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":202,"num_read_kb":139,"num_write":84,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"263'201","reported_seq":804,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:04.855015+0000","last_change":"2024-09-12T17:10:42.526331+0000","last_active":"2024-09-12T18:09:04.855015+0000","last_peered":"2024-09-12T18:09:04.855015+0000","last_clean":"2024-09-12T18:09:04.855015+0000","last_became_active":"2024-09-12T17:10:42.523450+0000","last_became_peered":"2024-09-12T17:10:42.523450+0000","last_unstale":"2024-09-12T18:09:04.855015+0000","last_undegraded":"2024-09-12T18:09:04.855015+0000","last_fullsized":"2024-09-12T18:09:04.855015+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:26:36.695715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12713471,"num_objects":11,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":357,"num_read_kb":12797,"num_write":987,"num_write_kb":38748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0,5],"acting":[7,6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"263'408","reported_seq":1922,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:58.797415+0000","last_change":"2024-09-12T17:10:44.521376+0000","last_active":"2024-09-12T18:08:58.797415+0000","last_peered":"2024-09-12T18:08:58.797415+0000","last_clean":"2024-09-12T18:08:58.797415+0000","last_became_active":"2024-09-12T17:10:44.521072+0000","last_became_peered":"2024-09-12T17:10:44.521072+0000","last_unstale":"2024-09-12T18:08:58.797415+0000","last_undegraded":"2024-09-12T18:08:58.797415+0000","last_fullsized":"2024-09-12T18:08:58.797415+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":300,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:24:54.440783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2237,"num_read_kb":2119,"num_write":474,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"263'156","reported_seq":792,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:05.147352+0000","last_change":"2024-09-12T17:10:42.516137+0000","last_active":"2024-09-12T18:09:05.147352+0000","last_peered":"2024-09-12T18:09:05.147352+0000","last_clean":"2024-09-12T18:09:05.147352+0000","last_became_active":"2024-09-12T17:10:42.515714+0000","last_became_peered":"2024-09-12T17:10:42.515714+0000","last_unstale":"2024-09-12T18:09:05.147352+0000","last_undegraded":"2024-09-12T18:09:05.147352+0000","last_fullsized":"2024-09-12T18:09:05.147352+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:42:36.192689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5349221,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":404,"num_read_kb":24642,"num_write":798,"num_write_kb":5824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6,4],"acting":[1,0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"263'569","reported_seq":2037,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:06.320505+0000","last_change":"2024-09-12T17:10:44.521016+0000","last_active":"2024-09-12T18:09:06.320505+0000","last_peered":"2024-09-12T18:09:06.320505+0000","last_clean":"2024-09-12T18:09:06.320505+0000","last_became_active":"2024-09-12T17:10:44.520662+0000","last_became_peered":"2024-09-12T17:10:44.520662+0000","last_unstale":"2024-09-12T18:09:06.320505+0000","last_undegraded":"2024-09-12T18:09:06.320505+0000","last_fullsized":"2024-09-12T18:09:06.320505+0000","mapping_epoch":26,"log_start":"263'500","ondisk_log_start":"263'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":500,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:26:51.418557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2846,"num_read_kb":2568,"num_write":745,"num_write_kb":247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"263'191","reported_seq":877,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:04.843250+0000","last_change":"2024-09-12T17:10:42.514886+0000","last_active":"2024-09-12T18:09:04.843250+0000","last_peered":"2024-09-12T18:09:04.843250+0000","last_clean":"2024-09-12T18:09:04.843250+0000","last_became_active":"2024-09-12T17:10:42.514502+0000","last_became_peered":"2024-09-12T17:10:42.514502+0000","last_unstale":"2024-09-12T18:09:04.843250+0000","last_undegraded":"2024-09-12T18:09:04.843250+0000","last_fullsized":"2024-09-12T18:09:04.843250+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:38:43.328631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26587481,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":501,"num_read_kb":116995,"num_write":940,"num_write_kb":47431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,7],"acting":[0,2,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"263'510","reported_seq":2192,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:55.344424+0000","last_change":"2024-09-12T17:10:44.515786+0000","last_active":"2024-09-12T18:08:55.344424+0000","last_peered":"2024-09-12T18:08:55.344424+0000","last_clean":"2024-09-12T18:08:55.344424+0000","last_became_active":"2024-09-12T17:10:44.515053+0000","last_became_peered":"2024-09-12T17:10:44.515053+0000","last_unstale":"2024-09-12T18:08:55.344424+0000","last_undegraded":"2024-09-12T18:08:55.344424+0000","last_fullsized":"2024-09-12T18:08:55.344424+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":400,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:16:05.419489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2823,"num_read_kb":2642,"num_write":595,"num_write_kb":151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"263'184","reported_seq":809,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:59.853049+0000","last_change":"2024-09-12T17:10:42.515615+0000","last_active":"2024-09-12T18:08:59.853049+0000","last_peered":"2024-09-12T18:08:59.853049+0000","last_clean":"2024-09-12T18:08:59.853049+0000","last_became_active":"2024-09-12T17:10:42.515202+0000","last_became_peered":"2024-09-12T17:10:42.515202+0000","last_unstale":"2024-09-12T18:08:59.853049+0000","last_undegraded":"2024-09-12T18:08:59.853049+0000","last_fullsized":"2024-09-12T18:08:59.853049+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:18:31.312838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5813069,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":397,"num_read_kb":32737,"num_write":931,"num_write_kb":40819,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7,2],"acting":[5,3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"263'477","reported_seq":2055,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:09.599114+0000","last_change":"2024-09-12T17:10:44.524085+0000","last_active":"2024-09-12T18:09:09.599114+0000","last_peered":"2024-09-12T18:09:09.599114+0000","last_clean":"2024-09-12T18:09:09.599114+0000","last_became_active":"2024-09-12T17:10:44.523767+0000","last_became_peered":"2024-09-12T17:10:44.523767+0000","last_unstale":"2024-09-12T18:09:09.599114+0000","last_undegraded":"2024-09-12T18:09:09.599114+0000","last_fullsized":"2024-09-12T18:09:09.599114+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":400,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:56:19.375833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2572,"num_read_kb":2417,"num_write":590,"num_write_kb":142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"263'156","reported_seq":787,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:14.848042+0000","last_change":"2024-09-12T17:10:42.523893+0000","last_active":"2024-09-12T18:08:14.848042+0000","last_peered":"2024-09-12T18:08:14.848042+0000","last_clean":"2024-09-12T18:08:14.848042+0000","last_became_active":"2024-09-12T17:10:42.523427+0000","last_became_peered":"2024-09-12T17:10:42.523427+0000","last_unstale":"2024-09-12T18:08:14.848042+0000","last_undegraded":"2024-09-12T18:08:14.848042+0000","last_fullsized":"2024-09-12T18:08:14.848042+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:01:12.856714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5245138,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":436,"num_read_kb":36335,"num_write":766,"num_write_kb":30424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3,6],"acting":[7,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"263'475","reported_seq":1959,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:08.656630+0000","last_change":"2024-09-12T17:10:44.511009+0000","last_active":"2024-09-12T18:11:08.656630+0000","last_peered":"2024-09-12T18:11:08.656630+0000","last_clean":"2024-09-12T18:11:08.656630+0000","last_became_active":"2024-09-12T17:10:44.510692+0000","last_became_peered":"2024-09-12T17:10:44.510692+0000","last_unstale":"2024-09-12T18:11:08.656630+0000","last_undegraded":"2024-09-12T18:11:08.656630+0000","last_fullsized":"2024-09-12T18:11:08.656630+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":400,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:18:01.946068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2639,"num_read_kb":2478,"num_write":625,"num_write_kb":223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"263'186","reported_seq":812,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:14.846749+0000","last_change":"2024-09-12T17:10:42.525823+0000","last_active":"2024-09-12T18:08:14.846749+0000","last_peered":"2024-09-12T18:08:14.846749+0000","last_clean":"2024-09-12T18:08:14.846749+0000","last_became_active":"2024-09-12T17:10:42.525363+0000","last_became_peered":"2024-09-12T17:10:42.525363+0000","last_unstale":"2024-09-12T18:08:14.846749+0000","last_undegraded":"2024-09-12T18:08:14.846749+0000","last_fullsized":"2024-09-12T18:08:14.846749+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:02:50.629102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291534,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":407,"num_read_kb":34311,"num_write":949,"num_write_kb":12654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,4,1],"acting":[5,0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"263'875","reported_seq":2655,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:48.689421+0000","last_change":"2024-09-12T17:10:44.514182+0000","last_active":"2024-09-12T18:09:48.689421+0000","last_peered":"2024-09-12T18:09:48.689421+0000","last_clean":"2024-09-12T18:09:48.689421+0000","last_became_active":"2024-09-12T17:10:44.513865+0000","last_became_peered":"2024-09-12T17:10:44.513865+0000","last_unstale":"2024-09-12T18:09:48.689421+0000","last_undegraded":"2024-09-12T18:09:48.689421+0000","last_fullsized":"2024-09-12T18:09:48.689421+0000","mapping_epoch":26,"log_start":"263'800","ondisk_log_start":"263'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":800,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:58:50.879901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4549,"num_read_kb":4126,"num_write":1137,"num_write_kb":421,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"263'186","reported_seq":984,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:14.847986+0000","last_change":"2024-09-12T17:10:42.531846+0000","last_active":"2024-09-12T18:08:14.847986+0000","last_peered":"2024-09-12T18:08:14.847986+0000","last_clean":"2024-09-12T18:08:14.847986+0000","last_became_active":"2024-09-12T17:10:42.531356+0000","last_became_peered":"2024-09-12T17:10:42.531356+0000","last_unstale":"2024-09-12T18:08:14.847986+0000","last_undegraded":"2024-09-12T18:08:14.847986+0000","last_fullsized":"2024-09-12T18:08:14.847986+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:12:38.008206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":298268,"num_objects":11,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":746,"num_read_kb":2366,"num_write":949,"num_write_kb":15239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4,6],"acting":[7,0,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"263'409","reported_seq":1925,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:09.599316+0000","last_change":"2024-09-12T17:10:44.521355+0000","last_active":"2024-09-12T18:09:09.599316+0000","last_peered":"2024-09-12T18:09:09.599316+0000","last_clean":"2024-09-12T18:09:09.599316+0000","last_became_active":"2024-09-12T17:10:44.520609+0000","last_became_peered":"2024-09-12T17:10:44.520609+0000","last_unstale":"2024-09-12T18:09:09.599316+0000","last_undegraded":"2024-09-12T18:09:09.599316+0000","last_fullsized":"2024-09-12T18:09:09.599316+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":300,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:15:20.820552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2177,"num_read_kb":2069,"num_write":470,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"263'203","reported_seq":837,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:14.845186+0000","last_change":"2024-09-12T17:10:42.528380+0000","last_active":"2024-09-12T18:08:14.845186+0000","last_peered":"2024-09-12T18:08:14.845186+0000","last_clean":"2024-09-12T18:08:14.845186+0000","last_became_active":"2024-09-12T17:10:42.527310+0000","last_became_peered":"2024-09-12T17:10:42.527310+0000","last_unstale":"2024-09-12T18:08:14.845186+0000","last_undegraded":"2024-09-12T18:08:14.845186+0000","last_fullsized":"2024-09-12T18:08:14.845186+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:59:02.965611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10670368,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":463,"num_read_kb":11976,"num_write":987,"num_write_kb":39362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0,2],"acting":[3,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"263'803","reported_seq":2469,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:08.689356+0000","last_change":"2024-09-12T17:10:44.518218+0000","last_active":"2024-09-12T18:11:08.689356+0000","last_peered":"2024-09-12T18:11:08.689356+0000","last_clean":"2024-09-12T18:11:08.689356+0000","last_became_active":"2024-09-12T17:10:44.517947+0000","last_became_peered":"2024-09-12T17:10:44.517947+0000","last_unstale":"2024-09-12T18:11:08.689356+0000","last_undegraded":"2024-09-12T18:11:08.689356+0000","last_fullsized":"2024-09-12T18:11:08.689356+0000","mapping_epoch":26,"log_start":"263'700","ondisk_log_start":"263'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":700,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:23:45.311255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3878,"num_read_kb":3536,"num_write":1022,"num_write_kb":342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"263'406","reported_seq":2024,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:04.854401+0000","last_change":"2024-09-12T17:10:44.514809+0000","last_active":"2024-09-12T18:09:04.854401+0000","last_peered":"2024-09-12T18:09:04.854401+0000","last_clean":"2024-09-12T18:09:04.854401+0000","last_became_active":"2024-09-12T17:10:44.514293+0000","last_became_peered":"2024-09-12T17:10:44.514293+0000","last_unstale":"2024-09-12T18:09:04.854401+0000","last_undegraded":"2024-09-12T18:09:04.854401+0000","last_fullsized":"2024-09-12T18:09:04.854401+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":300,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:15:27.841945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2470,"num_read_kb":2366,"num_write":468,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"263'161","reported_seq":774,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:54.853629+0000","last_change":"2024-09-12T17:10:42.522308+0000","last_active":"2024-09-12T18:08:54.853629+0000","last_peered":"2024-09-12T18:08:54.853629+0000","last_clean":"2024-09-12T18:08:54.853629+0000","last_became_active":"2024-09-12T17:10:42.521637+0000","last_became_peered":"2024-09-12T17:10:42.521637+0000","last_unstale":"2024-09-12T18:08:54.853629+0000","last_undegraded":"2024-09-12T18:08:54.853629+0000","last_fullsized":"2024-09-12T18:08:54.853629+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:28:33.771646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5704625,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":443,"num_read_kb":17329,"num_write":803,"num_write_kb":49238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0,1],"acting":[7,5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"263'782","reported_seq":2276,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:04.854884+0000","last_change":"2024-09-12T17:10:44.521355+0000","last_active":"2024-09-12T18:09:04.854884+0000","last_peered":"2024-09-12T18:09:04.854884+0000","last_clean":"2024-09-12T18:09:04.854884+0000","last_became_active":"2024-09-12T17:10:44.521031+0000","last_became_peered":"2024-09-12T17:10:44.521031+0000","last_unstale":"2024-09-12T18:09:04.854884+0000","last_undegraded":"2024-09-12T18:09:04.854884+0000","last_fullsized":"2024-09-12T18:09:04.854884+0000","mapping_epoch":26,"log_start":"263'700","ondisk_log_start":"263'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":700,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:32:54.360404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3604,"num_read_kb":3242,"num_write":1018,"num_write_kb":360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"263'252","reported_seq":945,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:44.871763+0000","last_change":"2024-09-12T17:10:42.526866+0000","last_active":"2024-09-12T18:08:44.871763+0000","last_peered":"2024-09-12T18:08:44.871763+0000","last_clean":"2024-09-12T18:08:44.871763+0000","last_became_active":"2024-09-12T17:10:42.517679+0000","last_became_peered":"2024-09-12T17:10:42.517679+0000","last_unstale":"2024-09-12T18:08:44.871763+0000","last_undegraded":"2024-09-12T18:08:44.871763+0000","last_fullsized":"2024-09-12T18:08:44.871763+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:33:13.890188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1606466,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":848,"num_read_kb":4297,"num_write":1122,"num_write_kb":28670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2,1],"acting":[6,5,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"263'358","reported_seq":1812,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:19.855895+0000","last_change":"2024-09-12T17:10:44.518484+0000","last_active":"2024-09-12T18:09:19.855895+0000","last_peered":"2024-09-12T18:09:19.855895+0000","last_clean":"2024-09-12T18:09:19.855895+0000","last_became_active":"2024-09-12T17:10:44.518183+0000","last_became_peered":"2024-09-12T17:10:44.518183+0000","last_unstale":"2024-09-12T18:09:19.855895+0000","last_undegraded":"2024-09-12T18:09:19.855895+0000","last_fullsized":"2024-09-12T18:09:19.855895+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:51:18.710777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1979,"num_read_kb":1899,"num_write":385,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"263'229","reported_seq":950,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:49.079463+0000","last_change":"2024-09-12T17:10:42.518722+0000","last_active":"2024-09-12T18:08:49.079463+0000","last_peered":"2024-09-12T18:08:49.079463+0000","last_clean":"2024-09-12T18:08:49.079463+0000","last_became_active":"2024-09-12T17:10:42.518345+0000","last_became_peered":"2024-09-12T17:10:42.518345+0000","last_unstale":"2024-09-12T18:08:49.079463+0000","last_undegraded":"2024-09-12T18:08:49.079463+0000","last_fullsized":"2024-09-12T18:08:49.079463+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":200,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:55:42.993471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1440420,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":643,"num_read_kb":98876,"num_write":1051,"num_write_kb":25289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0,3],"acting":[6,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"263'516","reported_seq":2148,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:08.689613+0000","last_change":"2024-09-12T17:10:44.514989+0000","last_active":"2024-09-12T18:11:08.689613+0000","last_peered":"2024-09-12T18:11:08.689613+0000","last_clean":"2024-09-12T18:11:08.689613+0000","last_became_active":"2024-09-12T17:10:44.514645+0000","last_became_peered":"2024-09-12T17:10:44.514645+0000","last_unstale":"2024-09-12T18:11:08.689613+0000","last_undegraded":"2024-09-12T18:11:08.689613+0000","last_fullsized":"2024-09-12T18:11:08.689613+0000","mapping_epoch":26,"log_start":"263'500","ondisk_log_start":"263'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":500,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:07:24.458191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2725,"num_read_kb":2548,"num_write":623,"num_write_kb":175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"263'213","reported_seq":872,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:44.851667+0000","last_change":"2024-09-12T17:10:42.519598+0000","last_active":"2024-09-12T18:08:44.851667+0000","last_peered":"2024-09-12T18:08:44.851667+0000","last_clean":"2024-09-12T18:08:44.851667+0000","last_became_active":"2024-09-12T17:10:42.519000+0000","last_became_peered":"2024-09-12T17:10:42.519000+0000","last_unstale":"2024-09-12T18:08:44.851667+0000","last_undegraded":"2024-09-12T18:08:44.851667+0000","last_fullsized":"2024-09-12T18:08:44.851667+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:16:24.448620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5782027,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":500,"num_read_kb":33700,"num_write":930,"num_write_kb":23229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,0],"acting":[4,3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"263'1583","reported_seq":3109,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:58.601451+0000","last_change":"2024-09-12T17:10:44.515105+0000","last_active":"2024-09-12T18:08:58.601451+0000","last_peered":"2024-09-12T18:08:58.601451+0000","last_clean":"2024-09-12T18:08:58.601451+0000","last_became_active":"2024-09-12T17:10:44.514826+0000","last_became_peered":"2024-09-12T17:10:44.514826+0000","last_unstale":"2024-09-12T18:08:58.601451+0000","last_undegraded":"2024-09-12T18:08:58.601451+0000","last_fullsized":"2024-09-12T18:08:58.601451+0000","mapping_epoch":26,"log_start":"263'1500","ondisk_log_start":"263'1500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":1500,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:30:21.141258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6865,"num_read_kb":5951,"num_write":2206,"num_write_kb":956,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"263'239","reported_seq":895,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:10:59.495004+0000","last_change":"2024-09-12T17:10:42.533422+0000","last_active":"2024-09-12T18:10:59.495004+0000","last_peered":"2024-09-12T18:10:59.495004+0000","last_clean":"2024-09-12T18:10:59.495004+0000","last_became_active":"2024-09-12T17:10:42.532995+0000","last_became_peered":"2024-09-12T17:10:42.532995+0000","last_unstale":"2024-09-12T18:10:59.495004+0000","last_undegraded":"2024-09-12T18:10:59.495004+0000","last_fullsized":"2024-09-12T18:10:59.495004+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":200,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:44:08.027039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11322954,"num_objects":11,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":534,"num_read_kb":13123,"num_write":1222,"num_write_kb":39413,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1,5],"acting":[3,6,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"263'1288","reported_seq":3015,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:48.689829+0000","last_change":"2024-09-12T17:10:44.507748+0000","last_active":"2024-09-12T18:09:48.689829+0000","last_peered":"2024-09-12T18:09:48.689829+0000","last_clean":"2024-09-12T18:09:48.689829+0000","last_became_active":"2024-09-12T17:10:44.507428+0000","last_became_peered":"2024-09-12T17:10:44.507428+0000","last_unstale":"2024-09-12T18:09:48.689829+0000","last_undegraded":"2024-09-12T18:09:48.689829+0000","last_fullsized":"2024-09-12T18:09:48.689829+0000","mapping_epoch":26,"log_start":"263'1200","ondisk_log_start":"263'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":1200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:34:52.540295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5933,"num_read_kb":5245,"num_write":1814,"num_write_kb":777,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"263'185","reported_seq":863,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:14.844412+0000","last_change":"2024-09-12T17:10:42.529986+0000","last_active":"2024-09-12T18:09:14.844412+0000","last_peered":"2024-09-12T18:09:14.844412+0000","last_clean":"2024-09-12T18:09:14.844412+0000","last_became_active":"2024-09-12T17:10:42.529179+0000","last_became_peered":"2024-09-12T17:10:42.529179+0000","last_unstale":"2024-09-12T18:09:14.844412+0000","last_undegraded":"2024-09-12T18:09:14.844412+0000","last_fullsized":"2024-09-12T18:09:14.844412+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:53:33.632179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":576011,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":570,"num_read_kb":13539,"num_write":907,"num_write_kb":25869,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1,5],"acting":[0,4,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"263'159","reported_seq":680,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:49.689301+0000","last_change":"2024-09-12T17:10:52.566398+0000","last_active":"2024-09-12T18:09:49.689301+0000","last_peered":"2024-09-12T18:09:49.689301+0000","last_clean":"2024-09-12T18:09:49.689301+0000","last_became_active":"2024-09-12T17:10:52.566079+0000","last_became_peered":"2024-09-12T17:10:52.566079+0000","last_unstale":"2024-09-12T18:09:49.689301+0000","last_undegraded":"2024-09-12T18:09:49.689301+0000","last_fullsized":"2024-09-12T18:09:49.689301+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":100,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:46:37.549026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":803,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":269,"num_read_kb":255,"num_write":425,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"263'795","reported_seq":2403,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:19.853207+0000","last_change":"2024-09-12T17:10:44.522489+0000","last_active":"2024-09-12T18:09:19.853207+0000","last_peered":"2024-09-12T18:09:19.853207+0000","last_clean":"2024-09-12T18:09:19.853207+0000","last_became_active":"2024-09-12T17:10:44.522193+0000","last_became_peered":"2024-09-12T17:10:44.522193+0000","last_unstale":"2024-09-12T18:09:19.853207+0000","last_undegraded":"2024-09-12T18:09:19.853207+0000","last_fullsized":"2024-09-12T18:09:19.853207+0000","mapping_epoch":26,"log_start":"263'700","ondisk_log_start":"263'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":700,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:23:39.492588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3748,"num_read_kb":3407,"num_write":1044,"num_write_kb":360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"263'199","reported_seq":841,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:04.854920+0000","last_change":"2024-09-12T17:10:42.531990+0000","last_active":"2024-09-12T18:09:04.854920+0000","last_peered":"2024-09-12T18:09:04.854920+0000","last_clean":"2024-09-12T18:09:04.854920+0000","last_became_active":"2024-09-12T17:10:42.528620+0000","last_became_peered":"2024-09-12T17:10:42.528620+0000","last_unstale":"2024-09-12T18:09:04.854920+0000","last_undegraded":"2024-09-12T18:09:04.854920+0000","last_fullsized":"2024-09-12T18:09:04.854920+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:01.518991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11074653,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":493,"num_read_kb":31268,"num_write":1011,"num_write_kb":14227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4,2],"acting":[7,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:49.851570+0000","last_change":"2024-09-12T17:10:46.527973+0000","last_active":"2024-09-12T18:08:49.851570+0000","last_peered":"2024-09-12T18:08:49.851570+0000","last_clean":"2024-09-12T18:08:49.851570+0000","last_became_active":"2024-09-12T17:10:46.527663+0000","last_became_peered":"2024-09-12T17:10:46.527663+0000","last_unstale":"2024-09-12T18:08:49.851570+0000","last_undegraded":"2024-09-12T18:08:49.851570+0000","last_fullsized":"2024-09-12T18:08:49.851570+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_clean_scrub_stamp":"2024-09-12T17:10:45.504515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:21:49.638349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"263'198","reported_seq":801,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:09.798260+0000","last_change":"2024-09-12T17:10:48.545372+0000","last_active":"2024-09-12T18:11:09.798260+0000","last_peered":"2024-09-12T18:11:09.798260+0000","last_clean":"2024-09-12T18:11:09.798260+0000","last_became_active":"2024-09-12T17:10:48.544885+0000","last_became_peered":"2024-09-12T17:10:48.544885+0000","last_unstale":"2024-09-12T18:11:09.798260+0000","last_undegraded":"2024-09-12T18:11:09.798260+0000","last_fullsized":"2024-09-12T18:11:09.798260+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_clean_scrub_stamp":"2024-09-12T17:10:47.516917+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:14:40.858594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8481,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":255,"num_read_kb":299,"num_write":152,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":485,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:49.852931+0000","last_change":"2024-09-12T17:10:50.556467+0000","last_active":"2024-09-12T18:08:49.852931+0000","last_peered":"2024-09-12T18:08:49.852931+0000","last_clean":"2024-09-12T18:08:49.852931+0000","last_became_active":"2024-09-12T17:10:50.556146+0000","last_became_peered":"2024-09-12T17:10:50.556146+0000","last_unstale":"2024-09-12T18:08:49.852931+0000","last_undegraded":"2024-09-12T18:08:49.852931+0000","last_fullsized":"2024-09-12T18:08:49.852931+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_clean_scrub_stamp":"2024-09-12T17:10:49.533772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:46:08.763293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"263'2474","reported_seq":4378,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:49.683677+0000","last_change":"2024-09-12T17:10:52.572598+0000","last_active":"2024-09-12T18:09:49.683677+0000","last_peered":"2024-09-12T18:09:49.683677+0000","last_clean":"2024-09-12T18:09:49.683677+0000","last_became_active":"2024-09-12T17:10:52.572326+0000","last_became_peered":"2024-09-12T17:10:52.572326+0000","last_unstale":"2024-09-12T18:09:49.683677+0000","last_undegraded":"2024-09-12T18:09:49.683677+0000","last_fullsized":"2024-09-12T18:09:49.683677+0000","mapping_epoch":34,"log_start":"263'2400","ondisk_log_start":"263'2400","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":2400,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:07:16.923827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":211,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6220,"num_read_kb":6202,"num_write":4958,"num_write_kb":1813,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"263'423","reported_seq":1877,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:08.688272+0000","last_change":"2024-09-12T17:10:44.513059+0000","last_active":"2024-09-12T18:11:08.688272+0000","last_peered":"2024-09-12T18:11:08.688272+0000","last_clean":"2024-09-12T18:11:08.688272+0000","last_became_active":"2024-09-12T17:10:44.512755+0000","last_became_peered":"2024-09-12T17:10:44.512755+0000","last_unstale":"2024-09-12T18:11:08.688272+0000","last_undegraded":"2024-09-12T18:11:08.688272+0000","last_fullsized":"2024-09-12T18:11:08.688272+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":400,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:13:48.119870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2092,"num_read_kb":1979,"num_write":465,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"263'200","reported_seq":837,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:04.843197+0000","last_change":"2024-09-12T17:10:42.514091+0000","last_active":"2024-09-12T18:09:04.843197+0000","last_peered":"2024-09-12T18:09:04.843197+0000","last_clean":"2024-09-12T18:09:04.843197+0000","last_became_active":"2024-09-12T17:10:42.513658+0000","last_became_peered":"2024-09-12T17:10:42.513658+0000","last_unstale":"2024-09-12T18:09:04.843197+0000","last_undegraded":"2024-09-12T18:09:04.843197+0000","last_fullsized":"2024-09-12T18:09:04.843197+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:37:17.251915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5860566,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":443,"num_read_kb":17694,"num_write":952,"num_write_kb":36760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":495,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:04.837350+0000","last_change":"2024-09-12T17:10:46.528313+0000","last_active":"2024-09-12T18:07:04.837350+0000","last_peered":"2024-09-12T18:07:04.837350+0000","last_clean":"2024-09-12T18:07:04.837350+0000","last_became_active":"2024-09-12T17:10:46.528008+0000","last_became_peered":"2024-09-12T17:10:46.528008+0000","last_unstale":"2024-09-12T18:07:04.837350+0000","last_undegraded":"2024-09-12T18:07:04.837350+0000","last_fullsized":"2024-09-12T18:07:04.837350+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_clean_scrub_stamp":"2024-09-12T17:10:45.504515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:19:49.464976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"263'98","reported_seq":630,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:49.852429+0000","last_change":"2024-09-12T17:10:48.540285+0000","last_active":"2024-09-12T18:08:49.852429+0000","last_peered":"2024-09-12T18:08:49.852429+0000","last_clean":"2024-09-12T18:08:49.852429+0000","last_became_active":"2024-09-12T17:10:48.539249+0000","last_became_peered":"2024-09-12T17:10:48.539249+0000","last_unstale":"2024-09-12T18:08:49.852429+0000","last_undegraded":"2024-09-12T18:08:49.852429+0000","last_fullsized":"2024-09-12T18:08:49.852429+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_clean_scrub_stamp":"2024-09-12T17:10:47.516917+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:10:07.478104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":101,"num_read_kb":97,"num_write":68,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:49.852402+0000","last_change":"2024-09-12T17:10:50.560376+0000","last_active":"2024-09-12T18:08:49.852402+0000","last_peered":"2024-09-12T18:08:49.852402+0000","last_clean":"2024-09-12T18:08:49.852402+0000","last_became_active":"2024-09-12T17:10:50.559882+0000","last_became_peered":"2024-09-12T17:10:50.559882+0000","last_unstale":"2024-09-12T18:08:49.852402+0000","last_undegraded":"2024-09-12T18:08:49.852402+0000","last_fullsized":"2024-09-12T18:08:49.852402+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_clean_scrub_stamp":"2024-09-12T17:10:49.533772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:28:55.022294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"263'90","reported_seq":591,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:40.825979+0000","last_change":"2024-09-12T17:10:52.570423+0000","last_active":"2024-09-12T18:08:40.825979+0000","last_peered":"2024-09-12T18:08:40.825979+0000","last_clean":"2024-09-12T18:08:40.825979+0000","last_became_active":"2024-09-12T17:10:52.570071+0000","last_became_peered":"2024-09-12T17:10:52.570071+0000","last_unstale":"2024-09-12T18:08:40.825979+0000","last_undegraded":"2024-09-12T18:08:40.825979+0000","last_fullsized":"2024-09-12T18:08:40.825979+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:46:23.049710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":117,"num_read_kb":116,"num_write":199,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"263'443","reported_seq":1990,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:04.193040+0000","last_change":"2024-09-12T17:10:44.518158+0000","last_active":"2024-09-12T18:09:04.193040+0000","last_peered":"2024-09-12T18:09:04.193040+0000","last_clean":"2024-09-12T18:09:04.193040+0000","last_became_active":"2024-09-12T17:10:44.517886+0000","last_became_peered":"2024-09-12T17:10:44.517886+0000","last_unstale":"2024-09-12T18:09:04.193040+0000","last_undegraded":"2024-09-12T18:09:04.193040+0000","last_fullsized":"2024-09-12T18:09:04.193040+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":400,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:43:41.541508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2335,"num_read_kb":2201,"num_write":517,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"263'189","reported_seq":813,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:32.299175+0000","last_change":"2024-09-12T17:10:42.531080+0000","last_active":"2024-09-12T18:09:32.299175+0000","last_peered":"2024-09-12T18:09:32.299175+0000","last_clean":"2024-09-12T18:09:32.299175+0000","last_became_active":"2024-09-12T17:10:42.530663+0000","last_became_peered":"2024-09-12T17:10:42.530663+0000","last_unstale":"2024-09-12T18:09:32.299175+0000","last_undegraded":"2024-09-12T18:09:32.299175+0000","last_fullsized":"2024-09-12T18:09:32.299175+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:31:17.343251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6489153,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":433,"num_read_kb":14482,"num_write":957,"num_write_kb":29259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":495,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:49.849323+0000","last_change":"2024-09-12T17:10:46.530775+0000","last_active":"2024-09-12T18:08:49.849323+0000","last_peered":"2024-09-12T18:08:49.849323+0000","last_clean":"2024-09-12T18:08:49.849323+0000","last_became_active":"2024-09-12T17:10:46.530438+0000","last_became_peered":"2024-09-12T17:10:46.530438+0000","last_unstale":"2024-09-12T18:08:49.849323+0000","last_undegraded":"2024-09-12T18:08:49.849323+0000","last_fullsized":"2024-09-12T18:08:49.849323+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_clean_scrub_stamp":"2024-09-12T17:10:45.504515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:06:31.919771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"263'114","reported_seq":649,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:19.838931+0000","last_change":"2024-09-12T17:10:48.540591+0000","last_active":"2024-09-12T18:09:19.838931+0000","last_peered":"2024-09-12T18:09:19.838931+0000","last_clean":"2024-09-12T18:09:19.838931+0000","last_became_active":"2024-09-12T17:10:48.540078+0000","last_became_peered":"2024-09-12T17:10:48.540078+0000","last_unstale":"2024-09-12T18:09:19.838931+0000","last_undegraded":"2024-09-12T18:09:19.838931+0000","last_fullsized":"2024-09-12T18:09:19.838931+0000","mapping_epoch":30,"log_start":"263'100","ondisk_log_start":"263'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_clean_scrub_stamp":"2024-09-12T17:10:47.516917+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:11:14.400403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":134,"num_read_kb":129,"num_write":88,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"263'762","reported_seq":4725,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:13.430655+0000","last_change":"2024-09-12T17:10:50.563321+0000","last_active":"2024-09-12T18:11:13.430655+0000","last_peered":"2024-09-12T18:11:13.430655+0000","last_clean":"2024-09-12T18:11:13.430655+0000","last_became_active":"2024-09-12T17:10:50.562930+0000","last_became_peered":"2024-09-12T17:10:50.562930+0000","last_unstale":"2024-09-12T18:11:13.430655+0000","last_undegraded":"2024-09-12T18:11:13.430655+0000","last_fullsized":"2024-09-12T18:11:13.430655+0000","mapping_epoch":32,"log_start":"263'700","ondisk_log_start":"263'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_clean_scrub_stamp":"2024-09-12T17:10:49.533772+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":700,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:02:44.468859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"263'198","reported_seq":1047,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:49.747543+0000","last_change":"2024-09-12T17:10:52.671398+0000","last_active":"2024-09-12T18:09:49.747543+0000","last_peered":"2024-09-12T18:09:49.747543+0000","last_clean":"2024-09-12T18:09:49.747543+0000","last_became_active":"2024-09-12T17:10:52.671103+0000","last_became_peered":"2024-09-12T17:10:52.671103+0000","last_unstale":"2024-09-12T18:09:49.747543+0000","last_undegraded":"2024-09-12T18:09:49.747543+0000","last_fullsized":"2024-09-12T18:09:49.747543+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:56:47.430468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":719,"num_read_kb":693,"num_write":432,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"263'446","reported_seq":1962,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:48.690267+0000","last_change":"2024-09-12T17:10:44.515015+0000","last_active":"2024-09-12T18:09:48.690267+0000","last_peered":"2024-09-12T18:09:48.690267+0000","last_clean":"2024-09-12T18:09:48.690267+0000","last_became_active":"2024-09-12T17:10:44.514124+0000","last_became_peered":"2024-09-12T17:10:44.514124+0000","last_unstale":"2024-09-12T18:09:48.690267+0000","last_undegraded":"2024-09-12T18:09:48.690267+0000","last_fullsized":"2024-09-12T18:09:48.690267+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":400,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:59:05.101317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2305,"num_read_kb":2168,"num_write":513,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"263'219","reported_seq":875,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:04.874408+0000","last_change":"2024-09-12T17:10:42.526752+0000","last_active":"2024-09-12T18:09:04.874408+0000","last_peered":"2024-09-12T18:09:04.874408+0000","last_clean":"2024-09-12T18:09:04.874408+0000","last_became_active":"2024-09-12T17:10:42.525328+0000","last_became_peered":"2024-09-12T17:10:42.525328+0000","last_unstale":"2024-09-12T18:09:04.874408+0000","last_undegraded":"2024-09-12T18:09:04.874408+0000","last_fullsized":"2024-09-12T18:09:04.874408+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:01:32.510919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9693500,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":545,"num_read_kb":47940,"num_write":1048,"num_write_kb":57690,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,3],"acting":[6,0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:49.851613+0000","last_change":"2024-09-12T17:10:46.527001+0000","last_active":"2024-09-12T18:08:49.851613+0000","last_peered":"2024-09-12T18:08:49.851613+0000","last_clean":"2024-09-12T18:08:49.851613+0000","last_became_active":"2024-09-12T17:10:46.526679+0000","last_became_peered":"2024-09-12T17:10:46.526679+0000","last_unstale":"2024-09-12T18:08:49.851613+0000","last_undegraded":"2024-09-12T18:08:49.851613+0000","last_fullsized":"2024-09-12T18:08:49.851613+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_clean_scrub_stamp":"2024-09-12T17:10:45.504515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:03:41.503120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"263'127","reported_seq":690,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:09.791937+0000","last_change":"2024-09-12T17:10:48.543886+0000","last_active":"2024-09-12T18:11:09.791937+0000","last_peered":"2024-09-12T18:11:09.791937+0000","last_clean":"2024-09-12T18:11:09.791937+0000","last_became_active":"2024-09-12T17:10:48.543573+0000","last_became_peered":"2024-09-12T17:10:48.543573+0000","last_unstale":"2024-09-12T18:11:09.791937+0000","last_undegraded":"2024-09-12T18:11:09.791937+0000","last_fullsized":"2024-09-12T18:11:09.791937+0000","mapping_epoch":30,"log_start":"263'100","ondisk_log_start":"263'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_clean_scrub_stamp":"2024-09-12T17:10:47.516917+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:34:09.400161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15870,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":166,"num_read_kb":231,"num_write":90,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"263'784","reported_seq":2294,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:13.139836+0000","last_change":"2024-09-12T17:10:50.559536+0000","last_active":"2024-09-12T18:11:13.139836+0000","last_peered":"2024-09-12T18:11:13.139836+0000","last_clean":"2024-09-12T18:11:13.139836+0000","last_became_active":"2024-09-12T17:10:50.559216+0000","last_became_peered":"2024-09-12T17:10:50.559216+0000","last_unstale":"2024-09-12T18:11:13.139836+0000","last_undegraded":"2024-09-12T18:11:13.139836+0000","last_fullsized":"2024-09-12T18:11:13.139836+0000","mapping_epoch":32,"log_start":"263'700","ondisk_log_start":"263'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_clean_scrub_stamp":"2024-09-12T17:10:49.533772+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":700,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:25:21.535911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"263'408","reported_seq":1929,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:49.545567+0000","last_change":"2024-09-12T17:10:44.516555+0000","last_active":"2024-09-12T18:09:49.545567+0000","last_peered":"2024-09-12T18:09:49.545567+0000","last_clean":"2024-09-12T18:09:49.545567+0000","last_became_active":"2024-09-12T17:10:44.516266+0000","last_became_peered":"2024-09-12T17:10:44.516266+0000","last_unstale":"2024-09-12T18:09:49.545567+0000","last_undegraded":"2024-09-12T18:09:49.545567+0000","last_fullsized":"2024-09-12T18:09:49.545567+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":300,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:00:21.370421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2231,"num_read_kb":2116,"num_write":471,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"263'312","reported_seq":1079,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:43.800887+0000","last_change":"2024-09-12T17:10:42.532317+0000","last_active":"2024-09-12T18:09:43.800887+0000","last_peered":"2024-09-12T18:09:43.800887+0000","last_clean":"2024-09-12T18:09:43.800887+0000","last_became_active":"2024-09-12T17:10:42.531886+0000","last_became_peered":"2024-09-12T17:10:42.531886+0000","last_unstale":"2024-09-12T18:09:43.800887+0000","last_undegraded":"2024-09-12T18:09:43.800887+0000","last_fullsized":"2024-09-12T18:09:43.800887+0000","mapping_epoch":24,"log_start":"263'300","ondisk_log_start":"263'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:10:32.496140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12869981,"num_objects":13,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":1036,"num_read_kb":35637,"num_write":1309,"num_write_kb":31872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0,1],"acting":[7,4,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:19.857104+0000","last_change":"2024-09-12T17:10:46.519211+0000","last_active":"2024-09-12T18:09:19.857104+0000","last_peered":"2024-09-12T18:09:19.857104+0000","last_clean":"2024-09-12T18:09:19.857104+0000","last_became_active":"2024-09-12T17:10:46.518652+0000","last_became_peered":"2024-09-12T17:10:46.518652+0000","last_unstale":"2024-09-12T18:09:19.857104+0000","last_undegraded":"2024-09-12T18:09:19.857104+0000","last_fullsized":"2024-09-12T18:09:19.857104+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_clean_scrub_stamp":"2024-09-12T17:10:45.504515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:02:38.257135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"263'214","reported_seq":826,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:34.859827+0000","last_change":"2024-09-12T17:10:48.541485+0000","last_active":"2024-09-12T18:09:34.859827+0000","last_peered":"2024-09-12T18:09:34.859827+0000","last_clean":"2024-09-12T18:09:34.859827+0000","last_became_active":"2024-09-12T17:10:48.541178+0000","last_became_peered":"2024-09-12T17:10:48.541178+0000","last_unstale":"2024-09-12T18:09:34.859827+0000","last_undegraded":"2024-09-12T18:09:34.859827+0000","last_fullsized":"2024-09-12T18:09:34.859827+0000","mapping_epoch":30,"log_start":"263'200","ondisk_log_start":"263'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_clean_scrub_stamp":"2024-09-12T17:10:47.516917+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:04:05.483511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8055,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":289,"num_read_kb":328,"num_write":168,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:20.148978+0000","last_change":"2024-09-12T17:10:50.560497+0000","last_active":"2024-09-12T18:09:20.148978+0000","last_peered":"2024-09-12T18:09:20.148978+0000","last_clean":"2024-09-12T18:09:20.148978+0000","last_became_active":"2024-09-12T17:10:50.560193+0000","last_became_peered":"2024-09-12T17:10:50.560193+0000","last_unstale":"2024-09-12T18:09:20.148978+0000","last_undegraded":"2024-09-12T18:09:20.148978+0000","last_fullsized":"2024-09-12T18:09:20.148978+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_clean_scrub_stamp":"2024-09-12T17:10:49.533772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:31:52.880536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"263'555","reported_seq":1366,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:09.825289+0000","last_change":"2024-09-12T17:10:52.573117+0000","last_active":"2024-09-12T18:11:09.825289+0000","last_peered":"2024-09-12T18:11:09.825289+0000","last_clean":"2024-09-12T18:11:09.825289+0000","last_became_active":"2024-09-12T17:10:52.572861+0000","last_became_peered":"2024-09-12T17:10:52.572861+0000","last_unstale":"2024-09-12T18:11:09.825289+0000","last_undegraded":"2024-09-12T18:11:09.825289+0000","last_fullsized":"2024-09-12T18:11:09.825289+0000","mapping_epoch":34,"log_start":"263'500","ondisk_log_start":"263'500","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":500,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:59:24.545564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1102,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1315,"num_read_kb":1312,"num_write":1171,"num_write_kb":396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"263'467","reported_seq":2047,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:08.687983+0000","last_change":"2024-09-12T17:10:44.516107+0000","last_active":"2024-09-12T18:11:08.687983+0000","last_peered":"2024-09-12T18:11:08.687983+0000","last_clean":"2024-09-12T18:11:08.687983+0000","last_became_active":"2024-09-12T17:10:44.515778+0000","last_became_peered":"2024-09-12T17:10:44.515778+0000","last_unstale":"2024-09-12T18:11:08.687983+0000","last_undegraded":"2024-09-12T18:11:08.687983+0000","last_fullsized":"2024-09-12T18:11:08.687983+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":400,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:07:30.510968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2463,"num_read_kb":2310,"num_write":552,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"263'158","reported_seq":764,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:14.856394+0000","last_change":"2024-09-12T17:10:42.526640+0000","last_active":"2024-09-12T18:09:14.856394+0000","last_peered":"2024-09-12T18:09:14.856394+0000","last_clean":"2024-09-12T18:09:14.856394+0000","last_became_active":"2024-09-12T17:10:42.526215+0000","last_became_peered":"2024-09-12T17:10:42.526215+0000","last_unstale":"2024-09-12T18:09:14.856394+0000","last_undegraded":"2024-09-12T18:09:14.856394+0000","last_fullsized":"2024-09-12T18:09:14.856394+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:44:21.141942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":254352,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":393,"num_read_kb":949,"num_write":838,"num_write_kb":19518,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,2],"acting":[7,4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":495,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:19.838876+0000","last_change":"2024-09-12T17:10:46.532883+0000","last_active":"2024-09-12T18:09:19.838876+0000","last_peered":"2024-09-12T18:09:19.838876+0000","last_clean":"2024-09-12T18:09:19.838876+0000","last_became_active":"2024-09-12T17:10:46.532552+0000","last_became_peered":"2024-09-12T17:10:46.532552+0000","last_unstale":"2024-09-12T18:09:19.838876+0000","last_undegraded":"2024-09-12T18:09:19.838876+0000","last_fullsized":"2024-09-12T18:09:19.838876+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_clean_scrub_stamp":"2024-09-12T17:10:45.504515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:25:38.578310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"263'129","reported_seq":696,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:09.778772+0000","last_change":"2024-09-12T17:10:48.543376+0000","last_active":"2024-09-12T18:11:09.778772+0000","last_peered":"2024-09-12T18:11:09.778772+0000","last_clean":"2024-09-12T18:11:09.778772+0000","last_became_active":"2024-09-12T17:10:48.542511+0000","last_became_peered":"2024-09-12T17:10:48.542511+0000","last_unstale":"2024-09-12T18:11:09.778772+0000","last_undegraded":"2024-09-12T18:11:09.778772+0000","last_fullsized":"2024-09-12T18:11:09.778772+0000","mapping_epoch":30,"log_start":"263'100","ondisk_log_start":"263'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_clean_scrub_stamp":"2024-09-12T17:10:47.516917+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:24:43.018761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28999,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":167,"num_read_kb":272,"num_write":90,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":489,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:24.839556+0000","last_change":"2024-09-12T17:10:50.560534+0000","last_active":"2024-09-12T18:07:24.839556+0000","last_peered":"2024-09-12T18:07:24.839556+0000","last_clean":"2024-09-12T18:07:24.839556+0000","last_became_active":"2024-09-12T17:10:50.560194+0000","last_became_peered":"2024-09-12T17:10:50.560194+0000","last_unstale":"2024-09-12T18:07:24.839556+0000","last_undegraded":"2024-09-12T18:07:24.839556+0000","last_fullsized":"2024-09-12T18:07:24.839556+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_clean_scrub_stamp":"2024-09-12T17:10:49.533772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:42:53.755387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"263'128","reported_seq":635,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:10:59.090392+0000","last_change":"2024-09-12T17:10:52.564665+0000","last_active":"2024-09-12T18:10:59.090392+0000","last_peered":"2024-09-12T18:10:59.090392+0000","last_clean":"2024-09-12T18:10:59.090392+0000","last_became_active":"2024-09-12T17:10:52.564350+0000","last_became_peered":"2024-09-12T17:10:52.564350+0000","last_unstale":"2024-09-12T18:10:59.090392+0000","last_undegraded":"2024-09-12T18:10:59.090392+0000","last_fullsized":"2024-09-12T18:10:59.090392+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:43:06.504654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":214,"num_read_kb":196,"num_write":321,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"263'437","reported_seq":1878,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:28.615548+0000","last_change":"2024-09-12T17:11:16.619027+0000","last_active":"2024-09-12T18:09:28.615548+0000","last_peered":"2024-09-12T18:09:28.615548+0000","last_clean":"2024-09-12T18:09:28.615548+0000","last_became_active":"2024-09-12T17:11:16.618699+0000","last_became_peered":"2024-09-12T17:11:16.618699+0000","last_unstale":"2024-09-12T18:09:28.615548+0000","last_undegraded":"2024-09-12T18:09:28.615548+0000","last_fullsized":"2024-09-12T18:09:28.615548+0000","mapping_epoch":37,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":400,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:55:15.584080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2161,"num_read_kb":2024,"num_write":504,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"263'213","reported_seq":841,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:14.856367+0000","last_change":"2024-09-12T17:10:42.526151+0000","last_active":"2024-09-12T18:09:14.856367+0000","last_peered":"2024-09-12T18:09:14.856367+0000","last_clean":"2024-09-12T18:09:14.856367+0000","last_became_active":"2024-09-12T17:10:42.525644+0000","last_became_peered":"2024-09-12T17:10:42.525644+0000","last_unstale":"2024-09-12T18:09:14.856367+0000","last_undegraded":"2024-09-12T18:09:14.856367+0000","last_fullsized":"2024-09-12T18:09:14.856367+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:06:11.915199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1626,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":478,"num_read_kb":1680,"num_write":1064,"num_write_kb":42245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4,6],"acting":[7,5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:19.838915+0000","last_change":"2024-09-12T17:10:46.532305+0000","last_active":"2024-09-12T18:09:19.838915+0000","last_peered":"2024-09-12T18:09:19.838915+0000","last_clean":"2024-09-12T18:09:19.838915+0000","last_became_active":"2024-09-12T17:10:46.531693+0000","last_became_peered":"2024-09-12T17:10:46.531693+0000","last_unstale":"2024-09-12T18:09:19.838915+0000","last_undegraded":"2024-09-12T18:09:19.838915+0000","last_fullsized":"2024-09-12T18:09:19.838915+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_clean_scrub_stamp":"2024-09-12T17:10:45.504515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:12:04.081227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"263'167","reported_seq":751,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:09.805504+0000","last_change":"2024-09-12T17:10:48.546368+0000","last_active":"2024-09-12T18:11:09.805504+0000","last_peered":"2024-09-12T18:11:09.805504+0000","last_clean":"2024-09-12T18:11:09.805504+0000","last_became_active":"2024-09-12T17:10:48.546013+0000","last_became_peered":"2024-09-12T17:10:48.546013+0000","last_unstale":"2024-09-12T18:11:09.805504+0000","last_undegraded":"2024-09-12T18:11:09.805504+0000","last_fullsized":"2024-09-12T18:11:09.805504+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_clean_scrub_stamp":"2024-09-12T17:10:47.516917+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":100,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:18:06.234698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23628,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":220,"num_read_kb":307,"num_write":126,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"263'773","reported_seq":2656,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:13.440534+0000","last_change":"2024-09-12T17:10:50.558001+0000","last_active":"2024-09-12T18:11:13.440534+0000","last_peered":"2024-09-12T18:11:13.440534+0000","last_clean":"2024-09-12T18:11:13.440534+0000","last_became_active":"2024-09-12T17:10:50.557711+0000","last_became_peered":"2024-09-12T17:10:50.557711+0000","last_unstale":"2024-09-12T18:11:13.440534+0000","last_undegraded":"2024-09-12T18:11:13.440534+0000","last_fullsized":"2024-09-12T18:11:13.440534+0000","mapping_epoch":32,"log_start":"263'700","ondisk_log_start":"263'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_clean_scrub_stamp":"2024-09-12T17:10:49.533772+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":700,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:36:55.165115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"263'103","reported_seq":598,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:08.674351+0000","last_change":"2024-09-12T17:10:52.570339+0000","last_active":"2024-09-12T18:11:08.674351+0000","last_peered":"2024-09-12T18:11:08.674351+0000","last_clean":"2024-09-12T18:11:08.674351+0000","last_became_active":"2024-09-12T17:10:52.570034+0000","last_became_peered":"2024-09-12T17:10:52.570034+0000","last_unstale":"2024-09-12T18:11:08.674351+0000","last_undegraded":"2024-09-12T18:11:08.674351+0000","last_fullsized":"2024-09-12T18:11:08.674351+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:58:19.680712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":442,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":109,"num_read_kb":107,"num_write":228,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"263'457","reported_seq":1986,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:20.794887+0000","last_change":"2024-09-12T17:10:44.520428+0000","last_active":"2024-09-12T18:09:20.794887+0000","last_peered":"2024-09-12T18:09:20.794887+0000","last_clean":"2024-09-12T18:09:20.794887+0000","last_became_active":"2024-09-12T17:10:44.520043+0000","last_became_peered":"2024-09-12T17:10:44.520043+0000","last_unstale":"2024-09-12T18:09:20.794887+0000","last_undegraded":"2024-09-12T18:09:20.794887+0000","last_fullsized":"2024-09-12T18:09:20.794887+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":400,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:50:49.324285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2352,"num_read_kb":2214,"num_write":541,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"263'203","reported_seq":846,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:03.355938+0000","last_change":"2024-09-12T17:10:42.518917+0000","last_active":"2024-09-12T18:11:03.355938+0000","last_peered":"2024-09-12T18:11:03.355938+0000","last_clean":"2024-09-12T18:11:03.355938+0000","last_became_active":"2024-09-12T17:10:42.518472+0000","last_became_peered":"2024-09-12T17:10:42.518472+0000","last_unstale":"2024-09-12T18:11:03.355938+0000","last_undegraded":"2024-09-12T18:11:03.355938+0000","last_fullsized":"2024-09-12T18:11:03.355938+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:04:25.809640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16056255,"num_objects":13,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":441,"num_read_kb":52953,"num_write":1070,"num_write_kb":38599,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6,1],"acting":[5,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":495,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:29.840076+0000","last_change":"2024-09-12T17:10:46.532109+0000","last_active":"2024-09-12T18:09:29.840076+0000","last_peered":"2024-09-12T18:09:29.840076+0000","last_clean":"2024-09-12T18:09:29.840076+0000","last_became_active":"2024-09-12T17:10:46.531731+0000","last_became_peered":"2024-09-12T17:10:46.531731+0000","last_unstale":"2024-09-12T18:09:29.840076+0000","last_undegraded":"2024-09-12T18:09:29.840076+0000","last_fullsized":"2024-09-12T18:09:29.840076+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_clean_scrub_stamp":"2024-09-12T17:10:45.504515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:24:44.405982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"263'193","reported_seq":822,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:09.807770+0000","last_change":"2024-09-12T17:10:48.544969+0000","last_active":"2024-09-12T18:11:09.807770+0000","last_peered":"2024-09-12T18:11:09.807770+0000","last_clean":"2024-09-12T18:11:09.807770+0000","last_became_active":"2024-09-12T17:10:48.544653+0000","last_became_peered":"2024-09-12T17:10:48.544653+0000","last_unstale":"2024-09-12T18:11:09.807770+0000","last_undegraded":"2024-09-12T18:11:09.807770+0000","last_fullsized":"2024-09-12T18:11:09.807770+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_clean_scrub_stamp":"2024-09-12T17:10:47.516917+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:21:32.100821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25151,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":268,"num_read_kb":346,"num_write":134,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":487,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:19.838895+0000","last_change":"2024-09-12T17:10:50.555835+0000","last_active":"2024-09-12T18:09:19.838895+0000","last_peered":"2024-09-12T18:09:19.838895+0000","last_clean":"2024-09-12T18:09:19.838895+0000","last_became_active":"2024-09-12T17:10:50.555473+0000","last_became_peered":"2024-09-12T17:10:50.555473+0000","last_unstale":"2024-09-12T18:09:19.838895+0000","last_undegraded":"2024-09-12T18:09:19.838895+0000","last_fullsized":"2024-09-12T18:09:19.838895+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_clean_scrub_stamp":"2024-09-12T17:10:49.533772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:12:27.311695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"263'116","reported_seq":625,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:47.539870+0000","last_change":"2024-09-12T17:10:52.571536+0000","last_active":"2024-09-12T18:09:47.539870+0000","last_peered":"2024-09-12T18:09:47.539870+0000","last_clean":"2024-09-12T18:09:47.539870+0000","last_became_active":"2024-09-12T17:10:52.571225+0000","last_became_peered":"2024-09-12T17:10:52.571225+0000","last_unstale":"2024-09-12T18:09:47.539870+0000","last_undegraded":"2024-09-12T18:09:47.539870+0000","last_fullsized":"2024-09-12T18:09:47.539870+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:45:48.500746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":910,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":137,"num_read_kb":136,"num_write":254,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"263'472","reported_seq":2087,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:14.856043+0000","last_change":"2024-09-12T17:10:44.516642+0000","last_active":"2024-09-12T18:09:14.856043+0000","last_peered":"2024-09-12T18:09:14.856043+0000","last_clean":"2024-09-12T18:09:14.856043+0000","last_became_active":"2024-09-12T17:10:44.516255+0000","last_became_peered":"2024-09-12T17:10:44.516255+0000","last_unstale":"2024-09-12T18:09:14.856043+0000","last_undegraded":"2024-09-12T18:09:14.856043+0000","last_fullsized":"2024-09-12T18:09:14.856043+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":400,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:45:40.739871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2470,"num_read_kb":2330,"num_write":539,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"263'212","reported_seq":832,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:14.852416+0000","last_change":"2024-09-12T17:11:16.863136+0000","last_active":"2024-09-12T18:09:14.852416+0000","last_peered":"2024-09-12T18:09:14.852416+0000","last_clean":"2024-09-12T18:09:14.852416+0000","last_became_active":"2024-09-12T17:11:16.862702+0000","last_became_peered":"2024-09-12T17:11:16.862702+0000","last_unstale":"2024-09-12T18:09:14.852416+0000","last_undegraded":"2024-09-12T18:09:14.852416+0000","last_fullsized":"2024-09-12T18:09:14.852416+0000","mapping_epoch":37,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:54:19.503253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1109560,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":408,"num_read_kb":1752,"num_write":1047,"num_write_kb":46733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,4,7],"acting":[3,2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:19.838954+0000","last_change":"2024-09-12T17:10:46.525024+0000","last_active":"2024-09-12T18:09:19.838954+0000","last_peered":"2024-09-12T18:09:19.838954+0000","last_clean":"2024-09-12T18:09:19.838954+0000","last_became_active":"2024-09-12T17:10:46.524638+0000","last_became_peered":"2024-09-12T17:10:46.524638+0000","last_unstale":"2024-09-12T18:09:19.838954+0000","last_undegraded":"2024-09-12T18:09:19.838954+0000","last_fullsized":"2024-09-12T18:09:19.838954+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_clean_scrub_stamp":"2024-09-12T17:10:45.504515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:56:22.494536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"263'147","reported_seq":727,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:09.784043+0000","last_change":"2024-09-12T17:10:48.538217+0000","last_active":"2024-09-12T18:11:09.784043+0000","last_peered":"2024-09-12T18:11:09.784043+0000","last_clean":"2024-09-12T18:11:09.784043+0000","last_became_active":"2024-09-12T17:10:48.537923+0000","last_became_peered":"2024-09-12T17:10:48.537923+0000","last_unstale":"2024-09-12T18:11:09.784043+0000","last_undegraded":"2024-09-12T18:11:09.784043+0000","last_fullsized":"2024-09-12T18:11:09.784043+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_clean_scrub_stamp":"2024-09-12T17:10:47.516917+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:47:18.538568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9067,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":220,"num_read_kb":274,"num_write":174,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:14.830207+0000","last_change":"2024-09-12T17:10:50.563850+0000","last_active":"2024-09-12T18:07:14.830207+0000","last_peered":"2024-09-12T18:07:14.830207+0000","last_clean":"2024-09-12T18:07:14.830207+0000","last_became_active":"2024-09-12T17:10:50.563507+0000","last_became_peered":"2024-09-12T17:10:50.563507+0000","last_unstale":"2024-09-12T18:07:14.830207+0000","last_undegraded":"2024-09-12T18:07:14.830207+0000","last_fullsized":"2024-09-12T18:07:14.830207+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_clean_scrub_stamp":"2024-09-12T17:10:49.533772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:17:57.223763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"263'126","reported_seq":641,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:10:59.093495+0000","last_change":"2024-09-12T17:10:52.575633+0000","last_active":"2024-09-12T18:10:59.093495+0000","last_peered":"2024-09-12T18:10:59.093495+0000","last_clean":"2024-09-12T18:10:59.093495+0000","last_became_active":"2024-09-12T17:10:52.575293+0000","last_became_peered":"2024-09-12T17:10:52.575293+0000","last_unstale":"2024-09-12T18:10:59.093495+0000","last_undegraded":"2024-09-12T18:10:59.093495+0000","last_fullsized":"2024-09-12T18:10:59.093495+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:49:40.030320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":248,"num_read_kb":220,"num_write":319,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"263'995","reported_seq":2615,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:20.793923+0000","last_change":"2024-09-12T17:10:44.515402+0000","last_active":"2024-09-12T18:09:20.793923+0000","last_peered":"2024-09-12T18:09:20.793923+0000","last_clean":"2024-09-12T18:09:20.793923+0000","last_became_active":"2024-09-12T17:10:44.515098+0000","last_became_peered":"2024-09-12T17:10:44.515098+0000","last_unstale":"2024-09-12T18:09:20.793923+0000","last_undegraded":"2024-09-12T18:09:20.793923+0000","last_fullsized":"2024-09-12T18:09:20.793923+0000","mapping_epoch":26,"log_start":"263'900","ondisk_log_start":"263'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":900,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:51:18.883813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4616,"num_read_kb":4072,"num_write":1360,"num_write_kb":579,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"263'207","reported_seq":848,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:01.160601+0000","last_change":"2024-09-12T17:10:42.516962+0000","last_active":"2024-09-12T18:11:01.160601+0000","last_peered":"2024-09-12T18:11:01.160601+0000","last_clean":"2024-09-12T18:11:01.160601+0000","last_became_active":"2024-09-12T17:10:42.515480+0000","last_became_peered":"2024-09-12T17:10:42.515480+0000","last_unstale":"2024-09-12T18:11:01.160601+0000","last_undegraded":"2024-09-12T18:11:01.160601+0000","last_fullsized":"2024-09-12T18:11:01.160601+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:25:04.587903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9630485,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":505,"num_read_kb":28749,"num_write":1018,"num_write_kb":24822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1,7],"acting":[6,4,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:20.149012+0000","last_change":"2024-09-12T17:10:46.532868+0000","last_active":"2024-09-12T18:09:20.149012+0000","last_peered":"2024-09-12T18:09:20.149012+0000","last_clean":"2024-09-12T18:09:20.149012+0000","last_became_active":"2024-09-12T17:10:46.532552+0000","last_became_peered":"2024-09-12T17:10:46.532552+0000","last_unstale":"2024-09-12T18:09:20.149012+0000","last_undegraded":"2024-09-12T18:09:20.149012+0000","last_fullsized":"2024-09-12T18:09:20.149012+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_clean_scrub_stamp":"2024-09-12T17:10:45.504515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:36:03.282217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"263'169","reported_seq":750,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:29.840156+0000","last_change":"2024-09-12T17:10:48.542688+0000","last_active":"2024-09-12T18:09:29.840156+0000","last_peered":"2024-09-12T18:09:29.840156+0000","last_clean":"2024-09-12T18:09:29.840156+0000","last_became_active":"2024-09-12T17:10:48.542298+0000","last_became_peered":"2024-09-12T17:10:48.542298+0000","last_unstale":"2024-09-12T18:09:29.840156+0000","last_undegraded":"2024-09-12T18:09:29.840156+0000","last_fullsized":"2024-09-12T18:09:29.840156+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_clean_scrub_stamp":"2024-09-12T17:10:47.516917+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":100,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:38:39.389352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11085,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":224,"num_read_kb":293,"num_write":130,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"263'744","reported_seq":2522,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:13.432722+0000","last_change":"2024-09-12T17:10:50.557593+0000","last_active":"2024-09-12T18:11:13.432722+0000","last_peered":"2024-09-12T18:11:13.432722+0000","last_clean":"2024-09-12T18:11:13.432722+0000","last_became_active":"2024-09-12T17:10:50.557305+0000","last_became_peered":"2024-09-12T17:10:50.557305+0000","last_unstale":"2024-09-12T18:11:13.432722+0000","last_undegraded":"2024-09-12T18:11:13.432722+0000","last_fullsized":"2024-09-12T18:11:13.432722+0000","mapping_epoch":32,"log_start":"263'700","ondisk_log_start":"263'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_clean_scrub_stamp":"2024-09-12T17:10:49.533772+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":700,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:44:08.055041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"263'117","reported_seq":624,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:47.542189+0000","last_change":"2024-09-12T17:10:52.571748+0000","last_active":"2024-09-12T18:09:47.542189+0000","last_peered":"2024-09-12T18:09:47.542189+0000","last_clean":"2024-09-12T18:09:47.542189+0000","last_became_active":"2024-09-12T17:10:52.571344+0000","last_became_peered":"2024-09-12T17:10:52.571344+0000","last_unstale":"2024-09-12T18:09:47.542189+0000","last_undegraded":"2024-09-12T18:09:47.542189+0000","last_fullsized":"2024-09-12T18:09:47.542189+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:19:07.103069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1852,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":171,"num_read_kb":161,"num_write":288,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"263'486","reported_seq":2153,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:48.689779+0000","last_change":"2024-09-12T17:10:44.509586+0000","last_active":"2024-09-12T18:09:48.689779+0000","last_peered":"2024-09-12T18:09:48.689779+0000","last_clean":"2024-09-12T18:09:48.689779+0000","last_became_active":"2024-09-12T17:10:44.509293+0000","last_became_peered":"2024-09-12T17:10:44.509293+0000","last_unstale":"2024-09-12T18:09:48.689779+0000","last_undegraded":"2024-09-12T18:09:48.689779+0000","last_fullsized":"2024-09-12T18:09:48.689779+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":400,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:13:03.024067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2823,"num_read_kb":2653,"num_write":584,"num_write_kb":143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"263'175","reported_seq":827,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:14.855892+0000","last_change":"2024-09-12T17:10:42.516188+0000","last_active":"2024-09-12T18:09:14.855892+0000","last_peered":"2024-09-12T18:09:14.855892+0000","last_clean":"2024-09-12T18:09:14.855892+0000","last_became_active":"2024-09-12T17:10:42.515196+0000","last_became_peered":"2024-09-12T17:10:42.515196+0000","last_unstale":"2024-09-12T18:09:14.855892+0000","last_undegraded":"2024-09-12T18:09:14.855892+0000","last_fullsized":"2024-09-12T18:09:14.855892+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:13:54.380139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17064424,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":430,"num_read_kb":72229,"num_write":818,"num_write_kb":40150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7,1],"acting":[4,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"29'2","reported_seq":1443,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:09.544515+0000","last_change":"2024-09-12T17:10:46.531378+0000","last_active":"2024-09-12T18:11:09.544515+0000","last_peered":"2024-09-12T18:11:09.544515+0000","last_clean":"2024-09-12T18:11:09.544515+0000","last_became_active":"2024-09-12T17:10:46.531032+0000","last_became_peered":"2024-09-12T17:10:46.531032+0000","last_unstale":"2024-09-12T18:11:09.544515+0000","last_undegraded":"2024-09-12T18:11:09.544515+0000","last_fullsized":"2024-09-12T18:11:09.544515+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_clean_scrub_stamp":"2024-09-12T17:10:45.504515+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:26:08.381916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":946,"num_read_kb":946,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"263'77","reported_seq":600,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:49.555526+0000","last_change":"2024-09-12T17:10:48.533130+0000","last_active":"2024-09-12T18:09:49.555526+0000","last_peered":"2024-09-12T18:09:49.555526+0000","last_clean":"2024-09-12T18:09:49.555526+0000","last_became_active":"2024-09-12T17:10:48.532817+0000","last_became_peered":"2024-09-12T17:10:48.532817+0000","last_unstale":"2024-09-12T18:09:49.555526+0000","last_undegraded":"2024-09-12T18:09:49.555526+0000","last_fullsized":"2024-09-12T18:09:49.555526+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_clean_scrub_stamp":"2024-09-12T17:10:47.516917+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:42:42.609184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":90,"num_read_kb":85,"num_write":60,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"263'760","reported_seq":2401,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:13.435039+0000","last_change":"2024-09-12T17:10:50.563515+0000","last_active":"2024-09-12T18:11:13.435039+0000","last_peered":"2024-09-12T18:11:13.435039+0000","last_clean":"2024-09-12T18:11:13.435039+0000","last_became_active":"2024-09-12T17:10:50.563002+0000","last_became_peered":"2024-09-12T17:10:50.563002+0000","last_unstale":"2024-09-12T18:11:13.435039+0000","last_undegraded":"2024-09-12T18:11:13.435039+0000","last_fullsized":"2024-09-12T18:11:13.435039+0000","mapping_epoch":32,"log_start":"263'700","ondisk_log_start":"263'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_clean_scrub_stamp":"2024-09-12T17:10:49.533772+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":700,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:11:41.362558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"263'147","reported_seq":647,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:14.855949+0000","last_change":"2024-09-12T17:10:52.571064+0000","last_active":"2024-09-12T18:09:14.855949+0000","last_peered":"2024-09-12T18:09:14.855949+0000","last_clean":"2024-09-12T18:09:14.855949+0000","last_became_active":"2024-09-12T17:10:52.570643+0000","last_became_peered":"2024-09-12T17:10:52.570643+0000","last_unstale":"2024-09-12T18:09:14.855949+0000","last_undegraded":"2024-09-12T18:09:14.855949+0000","last_fullsized":"2024-09-12T18:09:14.855949+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:37:26.966557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":160,"num_read_kb":158,"num_write":329,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"263'804","reported_seq":2283,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:08.688392+0000","last_change":"2024-09-12T17:10:44.518421+0000","last_active":"2024-09-12T18:11:08.688392+0000","last_peered":"2024-09-12T18:11:08.688392+0000","last_clean":"2024-09-12T18:11:08.688392+0000","last_became_active":"2024-09-12T17:10:44.518111+0000","last_became_peered":"2024-09-12T17:10:44.518111+0000","last_unstale":"2024-09-12T18:11:08.688392+0000","last_undegraded":"2024-09-12T18:11:08.688392+0000","last_fullsized":"2024-09-12T18:11:08.688392+0000","mapping_epoch":26,"log_start":"263'700","ondisk_log_start":"263'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":700,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:24:42.388720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3856,"num_read_kb":3439,"num_write":1073,"num_write_kb":406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"263'208","reported_seq":828,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:14.852297+0000","last_change":"2024-09-12T17:10:42.523388+0000","last_active":"2024-09-12T18:09:14.852297+0000","last_peered":"2024-09-12T18:09:14.852297+0000","last_clean":"2024-09-12T18:09:14.852297+0000","last_became_active":"2024-09-12T17:10:42.522669+0000","last_became_peered":"2024-09-12T17:10:42.522669+0000","last_unstale":"2024-09-12T18:09:14.852297+0000","last_undegraded":"2024-09-12T18:09:14.852297+0000","last_fullsized":"2024-09-12T18:09:14.852297+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:12:18.298215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24007,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":433,"num_read_kb":8704,"num_write":948,"num_write_kb":27929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,4],"acting":[3,1,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":504,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:19.856844+0000","last_change":"2024-09-12T17:10:46.533907+0000","last_active":"2024-09-12T18:09:19.856844+0000","last_peered":"2024-09-12T18:09:19.856844+0000","last_clean":"2024-09-12T18:09:19.856844+0000","last_became_active":"2024-09-12T17:10:46.533572+0000","last_became_peered":"2024-09-12T17:10:46.533572+0000","last_unstale":"2024-09-12T18:09:19.856844+0000","last_undegraded":"2024-09-12T18:09:19.856844+0000","last_fullsized":"2024-09-12T18:09:19.856844+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_clean_scrub_stamp":"2024-09-12T17:10:45.504515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:00:02.576654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"263'242","reported_seq":848,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:09.799469+0000","last_change":"2024-09-12T17:10:48.543041+0000","last_active":"2024-09-12T18:11:09.799469+0000","last_peered":"2024-09-12T18:11:09.799469+0000","last_clean":"2024-09-12T18:11:09.799469+0000","last_became_active":"2024-09-12T17:10:48.542616+0000","last_became_peered":"2024-09-12T17:10:48.542616+0000","last_unstale":"2024-09-12T18:11:09.799469+0000","last_undegraded":"2024-09-12T18:11:09.799469+0000","last_fullsized":"2024-09-12T18:11:09.799469+0000","mapping_epoch":30,"log_start":"263'200","ondisk_log_start":"263'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_clean_scrub_stamp":"2024-09-12T17:10:47.516917+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":200,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:45:45.261917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11660,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":924,"num_read_kb":982,"num_write":1452,"num_write_kb":1312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":490,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:19.876828+0000","last_change":"2024-09-12T17:10:50.550499+0000","last_active":"2024-09-12T18:09:19.876828+0000","last_peered":"2024-09-12T18:09:19.876828+0000","last_clean":"2024-09-12T18:09:19.876828+0000","last_became_active":"2024-09-12T17:10:50.550189+0000","last_became_peered":"2024-09-12T17:10:50.550189+0000","last_unstale":"2024-09-12T18:09:19.876828+0000","last_undegraded":"2024-09-12T18:09:19.876828+0000","last_fullsized":"2024-09-12T18:09:19.876828+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_clean_scrub_stamp":"2024-09-12T17:10:49.533772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:28:44.908753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"263'162","reported_seq":671,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:08.680270+0000","last_change":"2024-09-12T17:10:52.572806+0000","last_active":"2024-09-12T18:11:08.680270+0000","last_peered":"2024-09-12T18:11:08.680270+0000","last_clean":"2024-09-12T18:11:08.680270+0000","last_became_active":"2024-09-12T17:10:52.572508+0000","last_became_peered":"2024-09-12T17:10:52.572508+0000","last_unstale":"2024-09-12T18:11:08.680270+0000","last_undegraded":"2024-09-12T18:11:08.680270+0000","last_fullsized":"2024-09-12T18:11:08.680270+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:47:56.176805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":869,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":242,"num_read_kb":227,"num_write":399,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"263'2313","reported_seq":3926,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:14.876101+0000","last_change":"2024-09-12T17:10:44.515810+0000","last_active":"2024-09-12T18:09:14.876101+0000","last_peered":"2024-09-12T18:09:14.876101+0000","last_clean":"2024-09-12T18:09:14.876101+0000","last_became_active":"2024-09-12T17:10:44.515045+0000","last_became_peered":"2024-09-12T17:10:44.515045+0000","last_unstale":"2024-09-12T18:09:14.876101+0000","last_undegraded":"2024-09-12T18:09:14.876101+0000","last_fullsized":"2024-09-12T18:09:14.876101+0000","mapping_epoch":26,"log_start":"263'2300","ondisk_log_start":"263'2300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":2300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:30:23.918147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10108,"num_read_kb":8675,"num_write":3400,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":612,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:39.851461+0000","last_change":"2024-09-12T17:10:26.808302+0000","last_active":"2024-09-12T18:08:39.851461+0000","last_peered":"2024-09-12T18:08:39.851461+0000","last_clean":"2024-09-12T18:08:39.851461+0000","last_became_active":"2024-09-12T17:10:26.807964+0000","last_became_peered":"2024-09-12T17:10:26.807964+0000","last_unstale":"2024-09-12T18:08:39.851461+0000","last_undegraded":"2024-09-12T18:08:39.851461+0000","last_fullsized":"2024-09-12T18:08:39.851461+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:25.795895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:25.795895+0000","last_clean_scrub_stamp":"2024-09-12T17:10:25.795895+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:28:36.202819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":524,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:54.852285+0000","last_change":"2024-09-12T17:10:33.852086+0000","last_active":"2024-09-12T18:08:54.852285+0000","last_peered":"2024-09-12T18:08:54.852285+0000","last_clean":"2024-09-12T18:08:54.852285+0000","last_became_active":"2024-09-12T17:10:31.846572+0000","last_became_peered":"2024-09-12T17:10:31.846572+0000","last_unstale":"2024-09-12T18:08:54.852285+0000","last_undegraded":"2024-09-12T18:08:54.852285+0000","last_fullsized":"2024-09-12T18:08:54.852285+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:30.818274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:30.818274+0000","last_clean_scrub_stamp":"2024-09-12T17:10:30.818274+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:56:58.387797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060306800000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"263'224","reported_seq":845,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:04.850991+0000","last_change":"2024-09-12T17:10:42.527885+0000","last_active":"2024-09-12T18:09:04.850991+0000","last_peered":"2024-09-12T18:09:04.850991+0000","last_clean":"2024-09-12T18:09:04.850991+0000","last_became_active":"2024-09-12T17:10:42.527288+0000","last_became_peered":"2024-09-12T17:10:42.527288+0000","last_unstale":"2024-09-12T18:09:04.850991+0000","last_undegraded":"2024-09-12T18:09:04.850991+0000","last_fullsized":"2024-09-12T18:09:04.850991+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":200,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:57:55.754980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5594817,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":421,"num_read_kb":3487,"num_write":1106,"num_write_kb":42610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6,4],"acting":[3,5,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"36'3","reported_seq":974,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:09.761135+0000","last_change":"2024-09-12T17:10:46.523567+0000","last_active":"2024-09-12T18:11:09.761135+0000","last_peered":"2024-09-12T18:11:09.761135+0000","last_clean":"2024-09-12T18:11:09.761135+0000","last_became_active":"2024-09-12T17:10:46.523069+0000","last_became_peered":"2024-09-12T17:10:46.523069+0000","last_unstale":"2024-09-12T18:11:09.761135+0000","last_undegraded":"2024-09-12T18:11:09.761135+0000","last_fullsized":"2024-09-12T18:11:09.761135+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_clean_scrub_stamp":"2024-09-12T17:10:45.504515+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:25:47.639083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":719,"num_read_kb":717,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"263'307","reported_seq":996,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:09.813067+0000","last_change":"2024-09-12T17:10:48.542799+0000","last_active":"2024-09-12T18:11:09.813067+0000","last_peered":"2024-09-12T18:11:09.813067+0000","last_clean":"2024-09-12T18:11:09.813067+0000","last_became_active":"2024-09-12T17:10:48.542462+0000","last_became_peered":"2024-09-12T17:10:48.542462+0000","last_unstale":"2024-09-12T18:11:09.813067+0000","last_undegraded":"2024-09-12T18:11:09.813067+0000","last_fullsized":"2024-09-12T18:11:09.813067+0000","mapping_epoch":30,"log_start":"260'200","ondisk_log_start":"260'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_clean_scrub_stamp":"2024-09-12T17:10:47.516917+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:44:47.123605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45201,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":584,"num_read_kb":807,"num_write":556,"num_write_kb":431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:19.845378+0000","last_change":"2024-09-12T17:10:50.558413+0000","last_active":"2024-09-12T18:09:19.845378+0000","last_peered":"2024-09-12T18:09:19.845378+0000","last_clean":"2024-09-12T18:09:19.845378+0000","last_became_active":"2024-09-12T17:10:50.558129+0000","last_became_peered":"2024-09-12T17:10:50.558129+0000","last_unstale":"2024-09-12T18:09:19.845378+0000","last_undegraded":"2024-09-12T18:09:19.845378+0000","last_fullsized":"2024-09-12T18:09:19.845378+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_clean_scrub_stamp":"2024-09-12T17:10:49.533772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:10:19.749294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"263'213","reported_seq":930,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:49.576469+0000","last_change":"2024-09-12T17:10:52.574735+0000","last_active":"2024-09-12T18:09:49.576469+0000","last_peered":"2024-09-12T18:09:49.576469+0000","last_clean":"2024-09-12T18:09:49.576469+0000","last_became_active":"2024-09-12T17:10:52.574433+0000","last_became_peered":"2024-09-12T17:10:52.574433+0000","last_unstale":"2024-09-12T18:09:49.576469+0000","last_undegraded":"2024-09-12T18:09:49.576469+0000","last_fullsized":"2024-09-12T18:09:49.576469+0000","mapping_epoch":34,"log_start":"263'200","ondisk_log_start":"263'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:43:52.722409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":852,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":555,"num_read_kb":537,"num_write":455,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"263'582","reported_seq":2168,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:14.844578+0000","last_change":"2024-09-12T17:10:44.520786+0000","last_active":"2024-09-12T18:09:14.844578+0000","last_peered":"2024-09-12T18:09:14.844578+0000","last_clean":"2024-09-12T18:09:14.844578+0000","last_became_active":"2024-09-12T17:10:44.520484+0000","last_became_peered":"2024-09-12T17:10:44.520484+0000","last_unstale":"2024-09-12T18:09:14.844578+0000","last_undegraded":"2024-09-12T18:09:14.844578+0000","last_fullsized":"2024-09-12T18:09:14.844578+0000","mapping_epoch":26,"log_start":"263'500","ondisk_log_start":"263'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":500,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:09:07.335121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3105,"num_read_kb":2836,"num_write":745,"num_write_kb":252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":520,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:44.852139+0000","last_change":"2024-09-12T17:10:33.955353+0000","last_active":"2024-09-12T18:08:44.852139+0000","last_peered":"2024-09-12T18:08:44.852139+0000","last_clean":"2024-09-12T18:08:44.852139+0000","last_became_active":"2024-09-12T17:10:31.848972+0000","last_became_peered":"2024-09-12T17:10:31.848972+0000","last_unstale":"2024-09-12T18:08:44.852139+0000","last_undegraded":"2024-09-12T18:08:44.852139+0000","last_fullsized":"2024-09-12T18:08:44.852139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:30.818274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:30.818274+0000","last_clean_scrub_stamp":"2024-09-12T17:10:30.818274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:42:53.392909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054881099999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"263'244","reported_seq":889,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:04.843177+0000","last_change":"2024-09-12T17:10:42.518587+0000","last_active":"2024-09-12T18:09:04.843177+0000","last_peered":"2024-09-12T18:09:04.843177+0000","last_clean":"2024-09-12T18:09:04.843177+0000","last_became_active":"2024-09-12T17:10:42.518190+0000","last_became_peered":"2024-09-12T17:10:42.518190+0000","last_unstale":"2024-09-12T18:09:04.843177+0000","last_undegraded":"2024-09-12T18:09:04.843177+0000","last_fullsized":"2024-09-12T18:09:04.843177+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":200,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:06:38.991314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10490388,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":519,"num_read_kb":6824,"num_write":1146,"num_write_kb":47378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3,5],"acting":[0,4,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:19.856009+0000","last_change":"2024-09-12T17:10:46.528521+0000","last_active":"2024-09-12T18:09:19.856009+0000","last_peered":"2024-09-12T18:09:19.856009+0000","last_clean":"2024-09-12T18:09:19.856009+0000","last_became_active":"2024-09-12T17:10:46.528192+0000","last_became_peered":"2024-09-12T17:10:46.528192+0000","last_unstale":"2024-09-12T18:09:19.856009+0000","last_undegraded":"2024-09-12T18:09:19.856009+0000","last_fullsized":"2024-09-12T18:09:19.856009+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_clean_scrub_stamp":"2024-09-12T17:10:45.504515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:16:33.943407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"263'863","reported_seq":2511,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:13.396596+0000","last_change":"2024-09-12T17:10:48.545160+0000","last_active":"2024-09-12T18:11:13.396596+0000","last_peered":"2024-09-12T18:11:13.396596+0000","last_clean":"2024-09-12T18:11:13.396596+0000","last_became_active":"2024-09-12T17:10:48.544823+0000","last_became_peered":"2024-09-12T17:10:48.544823+0000","last_unstale":"2024-09-12T18:11:13.396596+0000","last_undegraded":"2024-09-12T18:11:13.396596+0000","last_fullsized":"2024-09-12T18:11:13.396596+0000","mapping_epoch":30,"log_start":"263'800","ondisk_log_start":"263'800","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_clean_scrub_stamp":"2024-09-12T17:10:47.516917+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":800,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:10:40.793586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27599,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1167,"num_read_kb":1295,"num_write":300,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":489,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:19.857221+0000","last_change":"2024-09-12T17:10:50.557996+0000","last_active":"2024-09-12T18:09:19.857221+0000","last_peered":"2024-09-12T18:09:19.857221+0000","last_clean":"2024-09-12T18:09:19.857221+0000","last_became_active":"2024-09-12T17:10:50.557660+0000","last_became_peered":"2024-09-12T17:10:50.557660+0000","last_unstale":"2024-09-12T18:09:19.857221+0000","last_undegraded":"2024-09-12T18:09:19.857221+0000","last_fullsized":"2024-09-12T18:09:19.857221+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_clean_scrub_stamp":"2024-09-12T17:10:49.533772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:34:55.114972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"263'187","reported_seq":753,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:49.249649+0000","last_change":"2024-09-12T17:10:52.671428+0000","last_active":"2024-09-12T18:09:49.249649+0000","last_peered":"2024-09-12T18:09:49.249649+0000","last_clean":"2024-09-12T18:09:49.249649+0000","last_became_active":"2024-09-12T17:10:52.671120+0000","last_became_peered":"2024-09-12T17:10:52.671120+0000","last_unstale":"2024-09-12T18:09:49.249649+0000","last_undegraded":"2024-09-12T18:09:49.249649+0000","last_fullsized":"2024-09-12T18:09:49.249649+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:54:33.827731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":855,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":437,"num_read_kb":369,"num_write":356,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"263'338","reported_seq":1688,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:15.148495+0000","last_change":"2024-09-12T17:10:44.516968+0000","last_active":"2024-09-12T18:09:15.148495+0000","last_peered":"2024-09-12T18:09:15.148495+0000","last_clean":"2024-09-12T18:09:15.148495+0000","last_became_active":"2024-09-12T17:10:44.516640+0000","last_became_peered":"2024-09-12T17:10:44.516640+0000","last_unstale":"2024-09-12T18:09:15.148495+0000","last_undegraded":"2024-09-12T18:09:15.148495+0000","last_fullsized":"2024-09-12T18:09:15.148495+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:49:32.830701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1748,"num_read_kb":1673,"num_write":375,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":519,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:54.836450+0000","last_change":"2024-09-12T17:10:34.162797+0000","last_active":"2024-09-12T18:08:54.836450+0000","last_peered":"2024-09-12T18:08:54.836450+0000","last_clean":"2024-09-12T18:08:54.836450+0000","last_became_active":"2024-09-12T17:10:31.841982+0000","last_became_peered":"2024-09-12T17:10:31.841982+0000","last_unstale":"2024-09-12T18:08:54.836450+0000","last_undegraded":"2024-09-12T18:08:54.836450+0000","last_fullsized":"2024-09-12T18:08:54.836450+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:30.818274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:30.818274+0000","last_clean_scrub_stamp":"2024-09-12T17:10:30.818274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:00:41.985746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00030998799999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"263'164","reported_seq":779,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:50.145702+0000","last_change":"2024-09-12T17:10:42.509801+0000","last_active":"2024-09-12T18:08:50.145702+0000","last_peered":"2024-09-12T18:08:50.145702+0000","last_clean":"2024-09-12T18:08:50.145702+0000","last_became_active":"2024-09-12T17:10:42.509396+0000","last_became_peered":"2024-09-12T17:10:42.509396+0000","last_unstale":"2024-09-12T18:08:50.145702+0000","last_undegraded":"2024-09-12T18:08:50.145702+0000","last_fullsized":"2024-09-12T18:08:50.145702+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":100,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:19:48.419548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5624297,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":375,"num_read_kb":11016,"num_write":841,"num_write_kb":10341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6,5],"acting":[1,2,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"29'1","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:19.838982+0000","last_change":"2024-09-12T17:10:46.529416+0000","last_active":"2024-09-12T18:09:19.838982+0000","last_peered":"2024-09-12T18:09:19.838982+0000","last_clean":"2024-09-12T18:09:19.838982+0000","last_became_active":"2024-09-12T17:10:46.528878+0000","last_became_peered":"2024-09-12T17:10:46.528878+0000","last_unstale":"2024-09-12T18:09:19.838982+0000","last_undegraded":"2024-09-12T18:09:19.838982+0000","last_fullsized":"2024-09-12T18:09:19.838982+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_clean_scrub_stamp":"2024-09-12T17:10:45.504515+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:07:39.857190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"263'250","reported_seq":1512,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:09.987483+0000","last_change":"2024-09-12T17:10:48.544016+0000","last_active":"2024-09-12T18:11:09.987483+0000","last_peered":"2024-09-12T18:11:09.987483+0000","last_clean":"2024-09-12T18:11:09.987483+0000","last_became_active":"2024-09-12T17:10:48.543196+0000","last_became_peered":"2024-09-12T17:10:48.543196+0000","last_unstale":"2024-09-12T18:11:09.987483+0000","last_undegraded":"2024-09-12T18:11:09.987483+0000","last_fullsized":"2024-09-12T18:11:09.987483+0000","mapping_epoch":30,"log_start":"263'200","ondisk_log_start":"263'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_clean_scrub_stamp":"2024-09-12T17:10:47.516917+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":200,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:18:29.037042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":209,"num_read_kb":201,"num_write":185,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":495,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:09.843829+0000","last_change":"2024-09-12T17:10:50.559244+0000","last_active":"2024-09-12T18:09:09.843829+0000","last_peered":"2024-09-12T18:09:09.843829+0000","last_clean":"2024-09-12T18:09:09.843829+0000","last_became_active":"2024-09-12T17:10:50.558980+0000","last_became_peered":"2024-09-12T17:10:50.558980+0000","last_unstale":"2024-09-12T18:09:09.843829+0000","last_undegraded":"2024-09-12T18:09:09.843829+0000","last_fullsized":"2024-09-12T18:09:09.843829+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_clean_scrub_stamp":"2024-09-12T17:10:49.533772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:56:03.520861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"263'256","reported_seq":854,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:49.824162+0000","last_change":"2024-09-12T17:10:52.564338+0000","last_active":"2024-09-12T18:09:49.824162+0000","last_peered":"2024-09-12T18:09:49.824162+0000","last_clean":"2024-09-12T18:09:49.824162+0000","last_became_active":"2024-09-12T17:10:52.563885+0000","last_became_peered":"2024-09-12T17:10:52.563885+0000","last_unstale":"2024-09-12T18:09:49.824162+0000","last_undegraded":"2024-09-12T18:09:49.824162+0000","last_fullsized":"2024-09-12T18:09:49.824162+0000","mapping_epoch":34,"log_start":"263'200","ondisk_log_start":"263'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":200,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:12:03.079469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":520,"num_read_kb":542,"num_write":569,"num_write_kb":161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"263'664","reported_seq":2208,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:05.147309+0000","last_change":"2024-09-12T17:10:44.516073+0000","last_active":"2024-09-12T18:09:05.147309+0000","last_peered":"2024-09-12T18:09:05.147309+0000","last_clean":"2024-09-12T18:09:05.147309+0000","last_became_active":"2024-09-12T17:10:44.515807+0000","last_became_peered":"2024-09-12T17:10:44.515807+0000","last_unstale":"2024-09-12T18:09:05.147309+0000","last_undegraded":"2024-09-12T18:09:05.147309+0000","last_fullsized":"2024-09-12T18:09:05.147309+0000","mapping_epoch":26,"log_start":"263'600","ondisk_log_start":"263'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":600,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:25:36.561047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3415,"num_read_kb":3057,"num_write":984,"num_write_kb":466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":525,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:54.852239+0000","last_change":"2024-09-12T17:10:33.852654+0000","last_active":"2024-09-12T18:08:54.852239+0000","last_peered":"2024-09-12T18:08:54.852239+0000","last_clean":"2024-09-12T18:08:54.852239+0000","last_became_active":"2024-09-12T17:10:31.849085+0000","last_became_peered":"2024-09-12T17:10:31.849085+0000","last_unstale":"2024-09-12T18:08:54.852239+0000","last_undegraded":"2024-09-12T18:08:54.852239+0000","last_fullsized":"2024-09-12T18:08:54.852239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:30.818274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:30.818274+0000","last_clean_scrub_stamp":"2024-09-12T17:10:30.818274+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:06:13.863048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011727,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"263'229","reported_seq":920,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:04.854500+0000","last_change":"2024-09-12T17:10:42.529838+0000","last_active":"2024-09-12T18:09:04.854500+0000","last_peered":"2024-09-12T18:09:04.854500+0000","last_clean":"2024-09-12T18:09:04.854500+0000","last_became_active":"2024-09-12T17:10:42.529499+0000","last_became_peered":"2024-09-12T17:10:42.529499+0000","last_unstale":"2024-09-12T18:09:04.854500+0000","last_undegraded":"2024-09-12T18:09:04.854500+0000","last_fullsized":"2024-09-12T18:09:04.854500+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":200,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:16:13.720843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":310931,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":562,"num_read_kb":10247,"num_write":1097,"num_write_kb":30448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,6],"acting":[4,5,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":503,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:19.845346+0000","last_change":"2024-09-12T17:10:46.526726+0000","last_active":"2024-09-12T18:09:19.845346+0000","last_peered":"2024-09-12T18:09:19.845346+0000","last_clean":"2024-09-12T18:09:19.845346+0000","last_became_active":"2024-09-12T17:10:46.526136+0000","last_became_peered":"2024-09-12T17:10:46.526136+0000","last_unstale":"2024-09-12T18:09:19.845346+0000","last_undegraded":"2024-09-12T18:09:19.845346+0000","last_fullsized":"2024-09-12T18:09:19.845346+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_clean_scrub_stamp":"2024-09-12T17:10:45.504515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:44:29.040188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"263'139","reported_seq":685,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:09.997112+0000","last_change":"2024-09-12T17:10:48.536587+0000","last_active":"2024-09-12T18:11:09.997112+0000","last_peered":"2024-09-12T18:11:09.997112+0000","last_clean":"2024-09-12T18:11:09.997112+0000","last_became_active":"2024-09-12T17:10:48.536247+0000","last_became_peered":"2024-09-12T17:10:48.536247+0000","last_unstale":"2024-09-12T18:11:09.997112+0000","last_undegraded":"2024-09-12T18:11:09.997112+0000","last_fullsized":"2024-09-12T18:11:09.997112+0000","mapping_epoch":30,"log_start":"263'100","ondisk_log_start":"263'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_clean_scrub_stamp":"2024-09-12T17:10:47.516917+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:26:17.588873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":163,"num_read_kb":156,"num_write":120,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":491,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:19.876894+0000","last_change":"2024-09-12T17:10:50.556253+0000","last_active":"2024-09-12T18:09:19.876894+0000","last_peered":"2024-09-12T18:09:19.876894+0000","last_clean":"2024-09-12T18:09:19.876894+0000","last_became_active":"2024-09-12T17:10:50.555747+0000","last_became_peered":"2024-09-12T17:10:50.555747+0000","last_unstale":"2024-09-12T18:09:19.876894+0000","last_undegraded":"2024-09-12T18:09:19.876894+0000","last_fullsized":"2024-09-12T18:09:19.876894+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_clean_scrub_stamp":"2024-09-12T17:10:49.533772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:17:05.525534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"263'122","reported_seq":667,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:24.858258+0000","last_change":"2024-09-12T17:10:52.575248+0000","last_active":"2024-09-12T18:09:24.858258+0000","last_peered":"2024-09-12T18:09:24.858258+0000","last_clean":"2024-09-12T18:09:24.858258+0000","last_became_active":"2024-09-12T17:10:52.574956+0000","last_became_peered":"2024-09-12T17:10:52.574956+0000","last_unstale":"2024-09-12T18:09:24.858258+0000","last_undegraded":"2024-09-12T18:09:24.858258+0000","last_fullsized":"2024-09-12T18:09:24.858258+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:35:51.476345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":427,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":242,"num_read_kb":241,"num_write":285,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"263'471","reported_seq":2077,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:08.688603+0000","last_change":"2024-09-12T17:10:44.516554+0000","last_active":"2024-09-12T18:11:08.688603+0000","last_peered":"2024-09-12T18:11:08.688603+0000","last_clean":"2024-09-12T18:11:08.688603+0000","last_became_active":"2024-09-12T17:10:44.516258+0000","last_became_peered":"2024-09-12T17:10:44.516258+0000","last_unstale":"2024-09-12T18:11:08.688603+0000","last_undegraded":"2024-09-12T18:11:08.688603+0000","last_fullsized":"2024-09-12T18:11:08.688603+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":400,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:22:51.498940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2512,"num_read_kb":2369,"num_write":577,"num_write_kb":149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"263'179","reported_seq":878,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:19.855946+0000","last_change":"2024-09-12T17:10:42.521202+0000","last_active":"2024-09-12T18:09:19.855946+0000","last_peered":"2024-09-12T18:09:19.855946+0000","last_clean":"2024-09-12T18:09:19.855946+0000","last_became_active":"2024-09-12T17:10:42.520777+0000","last_became_peered":"2024-09-12T17:10:42.520777+0000","last_unstale":"2024-09-12T18:09:19.855946+0000","last_undegraded":"2024-09-12T18:09:19.855946+0000","last_fullsized":"2024-09-12T18:09:19.855946+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:17:55.542119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5297338,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":571,"num_read_kb":36969,"num_write":893,"num_write_kb":42705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":529,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:55.146233+0000","last_change":"2024-09-12T17:10:33.854505+0000","last_active":"2024-09-12T18:08:55.146233+0000","last_peered":"2024-09-12T18:08:55.146233+0000","last_clean":"2024-09-12T18:08:55.146233+0000","last_became_active":"2024-09-12T17:10:32.177463+0000","last_became_peered":"2024-09-12T17:10:32.177463+0000","last_unstale":"2024-09-12T18:08:55.146233+0000","last_undegraded":"2024-09-12T18:08:55.146233+0000","last_fullsized":"2024-09-12T18:08:55.146233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:30.818274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:30.818274+0000","last_clean_scrub_stamp":"2024-09-12T17:10:30.818274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:37:29.735097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059857599999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":503,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:09.843813+0000","last_change":"2024-09-12T17:10:46.528815+0000","last_active":"2024-09-12T18:09:09.843813+0000","last_peered":"2024-09-12T18:09:09.843813+0000","last_clean":"2024-09-12T18:09:09.843813+0000","last_became_active":"2024-09-12T17:10:46.528499+0000","last_became_peered":"2024-09-12T17:10:46.528499+0000","last_unstale":"2024-09-12T18:09:09.843813+0000","last_undegraded":"2024-09-12T18:09:09.843813+0000","last_fullsized":"2024-09-12T18:09:09.843813+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_clean_scrub_stamp":"2024-09-12T17:10:45.504515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:46:42.455244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"263'269","reported_seq":933,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:09.793120+0000","last_change":"2024-09-12T17:10:48.540277+0000","last_active":"2024-09-12T18:11:09.793120+0000","last_peered":"2024-09-12T18:11:09.793120+0000","last_clean":"2024-09-12T18:11:09.793120+0000","last_became_active":"2024-09-12T17:10:48.539913+0000","last_became_peered":"2024-09-12T17:10:48.539913+0000","last_unstale":"2024-09-12T18:11:09.793120+0000","last_undegraded":"2024-09-12T18:11:09.793120+0000","last_fullsized":"2024-09-12T18:11:09.793120+0000","mapping_epoch":30,"log_start":"260'200","ondisk_log_start":"260'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_clean_scrub_stamp":"2024-09-12T17:10:47.516917+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:02:55.603063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15979,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":372,"num_read_kb":444,"num_write":214,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":498,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:09.855203+0000","last_change":"2024-09-12T17:10:50.555362+0000","last_active":"2024-09-12T18:09:09.855203+0000","last_peered":"2024-09-12T18:09:09.855203+0000","last_clean":"2024-09-12T18:09:09.855203+0000","last_became_active":"2024-09-12T17:10:50.555068+0000","last_became_peered":"2024-09-12T17:10:50.555068+0000","last_unstale":"2024-09-12T18:09:09.855203+0000","last_undegraded":"2024-09-12T18:09:09.855203+0000","last_fullsized":"2024-09-12T18:09:09.855203+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_clean_scrub_stamp":"2024-09-12T17:10:49.533772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:07:39.703527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"263'153","reported_seq":659,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:46.594011+0000","last_change":"2024-09-12T17:10:52.671530+0000","last_active":"2024-09-12T18:09:46.594011+0000","last_peered":"2024-09-12T18:09:46.594011+0000","last_clean":"2024-09-12T18:09:46.594011+0000","last_became_active":"2024-09-12T17:10:52.671238+0000","last_became_peered":"2024-09-12T17:10:52.671238+0000","last_unstale":"2024-09-12T18:09:46.594011+0000","last_undegraded":"2024-09-12T18:09:46.594011+0000","last_fullsized":"2024-09-12T18:09:46.594011+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:56:27.646939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":925,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":183,"num_read_kb":179,"num_write":356,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"263'539","reported_seq":2231,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:49.548593+0000","last_change":"2024-09-12T17:10:44.513894+0000","last_active":"2024-09-12T18:09:49.548593+0000","last_peered":"2024-09-12T18:09:49.548593+0000","last_clean":"2024-09-12T18:09:49.548593+0000","last_became_active":"2024-09-12T17:10:44.513543+0000","last_became_peered":"2024-09-12T17:10:44.513543+0000","last_unstale":"2024-09-12T18:09:49.548593+0000","last_undegraded":"2024-09-12T18:09:49.548593+0000","last_fullsized":"2024-09-12T18:09:49.548593+0000","mapping_epoch":26,"log_start":"263'500","ondisk_log_start":"263'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":500,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:52:06.056418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3000,"num_read_kb":2785,"num_write":670,"num_write_kb":215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"263'211","reported_seq":890,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:05.147290+0000","last_change":"2024-09-12T17:10:42.524565+0000","last_active":"2024-09-12T18:09:05.147290+0000","last_peered":"2024-09-12T18:09:05.147290+0000","last_clean":"2024-09-12T18:09:05.147290+0000","last_became_active":"2024-09-12T17:10:42.524130+0000","last_became_peered":"2024-09-12T17:10:42.524130+0000","last_unstale":"2024-09-12T18:09:05.147290+0000","last_undegraded":"2024-09-12T18:09:05.147290+0000","last_fullsized":"2024-09-12T18:09:05.147290+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:41:13.724342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12701364,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":583,"num_read_kb":68430,"num_write":1037,"num_write_kb":36992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,5],"acting":[1,2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":519,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:04.854964+0000","last_change":"2024-09-12T17:10:33.955366+0000","last_active":"2024-09-12T18:09:04.854964+0000","last_peered":"2024-09-12T18:09:04.854964+0000","last_clean":"2024-09-12T18:09:04.854964+0000","last_became_active":"2024-09-12T17:10:32.177457+0000","last_became_peered":"2024-09-12T17:10:32.177457+0000","last_unstale":"2024-09-12T18:09:04.854964+0000","last_undegraded":"2024-09-12T18:09:04.854964+0000","last_fullsized":"2024-09-12T18:09:04.854964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:30.818274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:30.818274+0000","last_clean_scrub_stamp":"2024-09-12T17:10:30.818274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:40:39.661808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000468751,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":500,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:09.875290+0000","last_change":"2024-09-12T17:10:46.527702+0000","last_active":"2024-09-12T18:09:09.875290+0000","last_peered":"2024-09-12T18:09:09.875290+0000","last_clean":"2024-09-12T18:09:09.875290+0000","last_became_active":"2024-09-12T17:10:46.527299+0000","last_became_peered":"2024-09-12T17:10:46.527299+0000","last_unstale":"2024-09-12T18:09:09.875290+0000","last_undegraded":"2024-09-12T18:09:09.875290+0000","last_fullsized":"2024-09-12T18:09:09.875290+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_clean_scrub_stamp":"2024-09-12T17:10:45.504515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:20:28.139339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"263'234","reported_seq":808,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:58.608748+0000","last_change":"2024-09-12T17:10:48.539230+0000","last_active":"2024-09-12T18:09:58.608748+0000","last_peered":"2024-09-12T18:09:58.608748+0000","last_clean":"2024-09-12T18:09:58.608748+0000","last_became_active":"2024-09-12T17:10:48.538190+0000","last_became_peered":"2024-09-12T17:10:48.538190+0000","last_unstale":"2024-09-12T18:09:58.608748+0000","last_undegraded":"2024-09-12T18:09:58.608748+0000","last_fullsized":"2024-09-12T18:09:58.608748+0000","mapping_epoch":30,"log_start":"263'200","ondisk_log_start":"263'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_clean_scrub_stamp":"2024-09-12T17:10:47.516917+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":200,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:41:22.031248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":276,"num_read_kb":262,"num_write":250,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"263'776","reported_seq":2749,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:13.140241+0000","last_change":"2024-09-12T17:10:50.562034+0000","last_active":"2024-09-12T18:11:13.140241+0000","last_peered":"2024-09-12T18:11:13.140241+0000","last_clean":"2024-09-12T18:11:13.140241+0000","last_became_active":"2024-09-12T17:10:50.561112+0000","last_became_peered":"2024-09-12T17:10:50.561112+0000","last_unstale":"2024-09-12T18:11:13.140241+0000","last_undegraded":"2024-09-12T18:11:13.140241+0000","last_fullsized":"2024-09-12T18:11:13.140241+0000","mapping_epoch":32,"log_start":"263'700","ondisk_log_start":"263'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_clean_scrub_stamp":"2024-09-12T17:10:49.533772+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":700,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:22:47.285499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"263'97","reported_seq":608,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:39.855795+0000","last_change":"2024-09-12T17:10:52.672259+0000","last_active":"2024-09-12T18:09:39.855795+0000","last_peered":"2024-09-12T18:09:39.855795+0000","last_clean":"2024-09-12T18:09:39.855795+0000","last_became_active":"2024-09-12T17:10:52.671116+0000","last_became_peered":"2024-09-12T17:10:52.671116+0000","last_unstale":"2024-09-12T18:09:39.855795+0000","last_undegraded":"2024-09-12T18:09:39.855795+0000","last_fullsized":"2024-09-12T18:09:39.855795+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:05:09.882357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":505,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":188,"num_read_kb":171,"num_write":234,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"263'777","reported_seq":2421,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:49.547019+0000","last_change":"2024-09-12T17:10:44.512159+0000","last_active":"2024-09-12T18:09:49.547019+0000","last_peered":"2024-09-12T18:09:49.547019+0000","last_clean":"2024-09-12T18:09:49.547019+0000","last_became_active":"2024-09-12T17:10:44.511450+0000","last_became_peered":"2024-09-12T17:10:44.511450+0000","last_unstale":"2024-09-12T18:09:49.547019+0000","last_undegraded":"2024-09-12T18:09:49.547019+0000","last_fullsized":"2024-09-12T18:09:49.547019+0000","mapping_epoch":26,"log_start":"263'700","ondisk_log_start":"263'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":700,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:25:36.561047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3773,"num_read_kb":3378,"num_write":1080,"num_write_kb":423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"263'165","reported_seq":747,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:14.852528+0000","last_change":"2024-09-12T17:10:42.526880+0000","last_active":"2024-09-12T18:09:14.852528+0000","last_peered":"2024-09-12T18:09:14.852528+0000","last_clean":"2024-09-12T18:09:14.852528+0000","last_became_active":"2024-09-12T17:10:42.526472+0000","last_became_peered":"2024-09-12T17:10:42.526472+0000","last_unstale":"2024-09-12T18:09:14.852528+0000","last_undegraded":"2024-09-12T18:09:14.852528+0000","last_fullsized":"2024-09-12T18:09:14.852528+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:45:58.908363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6295552,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":298,"num_read_kb":1418,"num_write":795,"num_write_kb":46804,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,0],"acting":[3,5,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":528,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:05.147338+0000","last_change":"2024-09-12T17:10:33.854523+0000","last_active":"2024-09-12T18:09:05.147338+0000","last_peered":"2024-09-12T18:09:05.147338+0000","last_clean":"2024-09-12T18:09:05.147338+0000","last_became_active":"2024-09-12T17:10:31.845481+0000","last_became_peered":"2024-09-12T17:10:31.845481+0000","last_unstale":"2024-09-12T18:09:05.147338+0000","last_undegraded":"2024-09-12T18:09:05.147338+0000","last_fullsized":"2024-09-12T18:09:05.147338+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:30.818274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:30.818274+0000","last_clean_scrub_stamp":"2024-09-12T17:10:30.818274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:06:13.863048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060466100000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":506,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:09.855182+0000","last_change":"2024-09-12T17:10:46.530614+0000","last_active":"2024-09-12T18:09:09.855182+0000","last_peered":"2024-09-12T18:09:09.855182+0000","last_clean":"2024-09-12T18:09:09.855182+0000","last_became_active":"2024-09-12T17:10:46.530275+0000","last_became_peered":"2024-09-12T17:10:46.530275+0000","last_unstale":"2024-09-12T18:09:09.855182+0000","last_undegraded":"2024-09-12T18:09:09.855182+0000","last_fullsized":"2024-09-12T18:09:09.855182+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_clean_scrub_stamp":"2024-09-12T17:10:45.504515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:08:24.007031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"263'128","reported_seq":676,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:09.855223+0000","last_change":"2024-09-12T17:10:48.542113+0000","last_active":"2024-09-12T18:09:09.855223+0000","last_peered":"2024-09-12T18:09:09.855223+0000","last_clean":"2024-09-12T18:09:09.855223+0000","last_became_active":"2024-09-12T17:10:48.541795+0000","last_became_peered":"2024-09-12T17:10:48.541795+0000","last_unstale":"2024-09-12T18:09:09.855223+0000","last_undegraded":"2024-09-12T18:09:09.855223+0000","last_fullsized":"2024-09-12T18:09:09.855223+0000","mapping_epoch":30,"log_start":"263'100","ondisk_log_start":"263'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_clean_scrub_stamp":"2024-09-12T17:10:47.516917+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:48:37.106733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":142,"num_read_kb":133,"num_write":96,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"263'787","reported_seq":4447,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:13.436826+0000","last_change":"2024-09-12T17:10:50.560337+0000","last_active":"2024-09-12T18:11:13.436826+0000","last_peered":"2024-09-12T18:11:13.436826+0000","last_clean":"2024-09-12T18:11:13.436826+0000","last_became_active":"2024-09-12T17:10:50.559932+0000","last_became_peered":"2024-09-12T17:10:50.559932+0000","last_unstale":"2024-09-12T18:11:13.436826+0000","last_undegraded":"2024-09-12T18:11:13.436826+0000","last_fullsized":"2024-09-12T18:11:13.436826+0000","mapping_epoch":32,"log_start":"263'700","ondisk_log_start":"263'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_clean_scrub_stamp":"2024-09-12T17:10:49.533772+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":700,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:05:17.277375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"263'288","reported_seq":829,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:24.845948+0000","last_change":"2024-09-12T17:10:52.570934+0000","last_active":"2024-09-12T18:09:24.845948+0000","last_peered":"2024-09-12T18:09:24.845948+0000","last_clean":"2024-09-12T18:09:24.845948+0000","last_became_active":"2024-09-12T17:10:52.570545+0000","last_became_peered":"2024-09-12T17:10:52.570545+0000","last_unstale":"2024-09-12T18:09:24.845948+0000","last_undegraded":"2024-09-12T18:09:24.845948+0000","last_fullsized":"2024-09-12T18:09:24.845948+0000","mapping_epoch":34,"log_start":"263'200","ondisk_log_start":"263'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:15:52.985878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":466,"num_read_kb":447,"num_write":645,"num_write_kb":207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"263'471","reported_seq":1901,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:20.793547+0000","last_change":"2024-09-12T17:10:44.517863+0000","last_active":"2024-09-12T18:09:20.793547+0000","last_peered":"2024-09-12T18:09:20.793547+0000","last_clean":"2024-09-12T18:09:20.793547+0000","last_became_active":"2024-09-12T17:10:44.517508+0000","last_became_peered":"2024-09-12T17:10:44.517508+0000","last_unstale":"2024-09-12T18:09:20.793547+0000","last_undegraded":"2024-09-12T18:09:20.793547+0000","last_fullsized":"2024-09-12T18:09:20.793547+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":400,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:38:36.589360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2400,"num_read_kb":2225,"num_write":610,"num_write_kb":202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"263'209","reported_seq":847,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:14.844556+0000","last_change":"2024-09-12T17:10:42.518819+0000","last_active":"2024-09-12T18:09:14.844556+0000","last_peered":"2024-09-12T18:09:14.844556+0000","last_clean":"2024-09-12T18:09:14.844556+0000","last_became_active":"2024-09-12T17:10:42.518404+0000","last_became_peered":"2024-09-12T17:10:42.518404+0000","last_unstale":"2024-09-12T18:09:14.844556+0000","last_undegraded":"2024-09-12T18:09:14.844556+0000","last_fullsized":"2024-09-12T18:09:14.844556+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:42:38.202022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220118,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":502,"num_read_kb":3973,"num_write":1038,"num_write_kb":36643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,7],"acting":[0,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":523,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:04.874518+0000","last_change":"2024-09-12T17:10:33.848505+0000","last_active":"2024-09-12T18:09:04.874518+0000","last_peered":"2024-09-12T18:09:04.874518+0000","last_clean":"2024-09-12T18:09:04.874518+0000","last_became_active":"2024-09-12T17:10:31.846123+0000","last_became_peered":"2024-09-12T17:10:31.846123+0000","last_unstale":"2024-09-12T18:09:04.874518+0000","last_undegraded":"2024-09-12T18:09:04.874518+0000","last_fullsized":"2024-09-12T18:09:04.874518+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:30.818274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:30.818274+0000","last_clean_scrub_stamp":"2024-09-12T17:10:30.818274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:48:25.408756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042024599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":500,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:04.850946+0000","last_change":"2024-09-12T17:10:46.530820+0000","last_active":"2024-09-12T18:09:04.850946+0000","last_peered":"2024-09-12T18:09:04.850946+0000","last_clean":"2024-09-12T18:09:04.850946+0000","last_became_active":"2024-09-12T17:10:46.530457+0000","last_became_peered":"2024-09-12T17:10:46.530457+0000","last_unstale":"2024-09-12T18:09:04.850946+0000","last_undegraded":"2024-09-12T18:09:04.850946+0000","last_fullsized":"2024-09-12T18:09:04.850946+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_clean_scrub_stamp":"2024-09-12T17:10:45.504515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:55:20.257339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"263'301","reported_seq":1008,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:09.796776+0000","last_change":"2024-09-12T17:10:48.543312+0000","last_active":"2024-09-12T18:11:09.796776+0000","last_peered":"2024-09-12T18:11:09.796776+0000","last_clean":"2024-09-12T18:11:09.796776+0000","last_became_active":"2024-09-12T17:10:48.542991+0000","last_became_peered":"2024-09-12T17:10:48.542991+0000","last_unstale":"2024-09-12T18:11:09.796776+0000","last_undegraded":"2024-09-12T18:11:09.796776+0000","last_fullsized":"2024-09-12T18:11:09.796776+0000","mapping_epoch":30,"log_start":"260'200","ondisk_log_start":"260'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_clean_scrub_stamp":"2024-09-12T17:10:47.516917+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:14:45.346536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26702,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":441,"num_read_kb":571,"num_write":222,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":491,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:09.851601+0000","last_change":"2024-09-12T17:10:50.553798+0000","last_active":"2024-09-12T18:09:09.851601+0000","last_peered":"2024-09-12T18:09:09.851601+0000","last_clean":"2024-09-12T18:09:09.851601+0000","last_became_active":"2024-09-12T17:10:50.553469+0000","last_became_peered":"2024-09-12T17:10:50.553469+0000","last_unstale":"2024-09-12T18:09:09.851601+0000","last_undegraded":"2024-09-12T18:09:09.851601+0000","last_fullsized":"2024-09-12T18:09:09.851601+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_clean_scrub_stamp":"2024-09-12T17:10:49.533772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:37:24.951291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"263'114","reported_seq":615,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:24.858341+0000","last_change":"2024-09-12T17:10:52.579037+0000","last_active":"2024-09-12T18:09:24.858341+0000","last_peered":"2024-09-12T18:09:24.858341+0000","last_clean":"2024-09-12T18:09:24.858341+0000","last_became_active":"2024-09-12T17:10:52.578713+0000","last_became_peered":"2024-09-12T17:10:52.578713+0000","last_unstale":"2024-09-12T18:09:24.858341+0000","last_undegraded":"2024-09-12T18:09:24.858341+0000","last_fullsized":"2024-09-12T18:09:24.858341+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:23:43.956550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":176,"num_read_kb":166,"num_write":279,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"263'124","reported_seq":686,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:49.766649+0000","last_change":"2024-09-12T17:10:52.576764+0000","last_active":"2024-09-12T18:09:49.766649+0000","last_peered":"2024-09-12T18:09:49.766649+0000","last_clean":"2024-09-12T18:09:49.766649+0000","last_became_active":"2024-09-12T17:10:52.576481+0000","last_became_peered":"2024-09-12T17:10:52.576481+0000","last_unstale":"2024-09-12T18:09:49.766649+0000","last_undegraded":"2024-09-12T18:09:49.766649+0000","last_fullsized":"2024-09-12T18:09:49.766649+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:22:23.671221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":242,"num_read_kb":237,"num_write":285,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"263'886","reported_seq":2476,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:04.854522+0000","last_change":"2024-09-12T17:10:44.507764+0000","last_active":"2024-09-12T18:09:04.854522+0000","last_peered":"2024-09-12T18:09:04.854522+0000","last_clean":"2024-09-12T18:09:04.854522+0000","last_became_active":"2024-09-12T17:10:44.507455+0000","last_became_peered":"2024-09-12T17:10:44.507455+0000","last_unstale":"2024-09-12T18:09:04.854522+0000","last_undegraded":"2024-09-12T18:09:04.854522+0000","last_fullsized":"2024-09-12T18:09:04.854522+0000","mapping_epoch":26,"log_start":"263'800","ondisk_log_start":"263'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":800,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:27:20.389462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4276,"num_read_kb":3830,"num_write":1165,"num_write_kb":436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"263'207","reported_seq":858,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:14.855999+0000","last_change":"2024-09-12T17:10:42.520147+0000","last_active":"2024-09-12T18:09:14.855999+0000","last_peered":"2024-09-12T18:09:14.855999+0000","last_clean":"2024-09-12T18:09:14.855999+0000","last_became_active":"2024-09-12T17:10:42.519656+0000","last_became_peered":"2024-09-12T17:10:42.519656+0000","last_unstale":"2024-09-12T18:09:14.855999+0000","last_undegraded":"2024-09-12T18:09:14.855999+0000","last_fullsized":"2024-09-12T18:09:14.855999+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:46:04.344482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":893994,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":521,"num_read_kb":10349,"num_write":1060,"num_write_kb":31428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,6],"acting":[4,7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":501,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:10.147893+0000","last_change":"2024-09-12T17:10:46.527971+0000","last_active":"2024-09-12T18:09:10.147893+0000","last_peered":"2024-09-12T18:09:10.147893+0000","last_clean":"2024-09-12T18:09:10.147893+0000","last_became_active":"2024-09-12T17:10:46.527445+0000","last_became_peered":"2024-09-12T17:10:46.527445+0000","last_unstale":"2024-09-12T18:09:10.147893+0000","last_undegraded":"2024-09-12T18:09:10.147893+0000","last_fullsized":"2024-09-12T18:09:10.147893+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_clean_scrub_stamp":"2024-09-12T17:10:45.504515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:06:49.441769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"263'136","reported_seq":709,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:09.804162+0000","last_change":"2024-09-12T17:10:48.536317+0000","last_active":"2024-09-12T18:11:09.804162+0000","last_peered":"2024-09-12T18:11:09.804162+0000","last_clean":"2024-09-12T18:11:09.804162+0000","last_became_active":"2024-09-12T17:10:48.536021+0000","last_became_peered":"2024-09-12T17:10:48.536021+0000","last_unstale":"2024-09-12T18:11:09.804162+0000","last_undegraded":"2024-09-12T18:11:09.804162+0000","last_fullsized":"2024-09-12T18:11:09.804162+0000","mapping_epoch":30,"log_start":"263'100","ondisk_log_start":"263'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_clean_scrub_stamp":"2024-09-12T17:10:47.516917+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:39:55.363038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11184,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":170,"num_read_kb":215,"num_write":88,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:09.851513+0000","last_change":"2024-09-12T17:10:50.555533+0000","last_active":"2024-09-12T18:09:09.851513+0000","last_peered":"2024-09-12T18:09:09.851513+0000","last_clean":"2024-09-12T18:09:09.851513+0000","last_became_active":"2024-09-12T17:10:50.555251+0000","last_became_peered":"2024-09-12T17:10:50.555251+0000","last_unstale":"2024-09-12T18:09:09.851513+0000","last_undegraded":"2024-09-12T18:09:09.851513+0000","last_fullsized":"2024-09-12T18:09:09.851513+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_clean_scrub_stamp":"2024-09-12T17:10:49.533772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:14:47.733536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"263'142","reported_seq":663,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:09.818435+0000","last_change":"2024-09-12T17:10:52.573415+0000","last_active":"2024-09-12T18:11:09.818435+0000","last_peered":"2024-09-12T18:11:09.818435+0000","last_clean":"2024-09-12T18:11:09.818435+0000","last_became_active":"2024-09-12T17:10:52.573040+0000","last_became_peered":"2024-09-12T17:10:52.573040+0000","last_unstale":"2024-09-12T18:11:09.818435+0000","last_undegraded":"2024-09-12T18:11:09.818435+0000","last_fullsized":"2024-09-12T18:11:09.818435+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:17:53.786959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":264,"num_read_kb":238,"num_write":352,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"263'1128","reported_seq":2790,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:05.147244+0000","last_change":"2024-09-12T17:10:44.509438+0000","last_active":"2024-09-12T18:09:05.147244+0000","last_peered":"2024-09-12T18:09:05.147244+0000","last_clean":"2024-09-12T18:09:05.147244+0000","last_became_active":"2024-09-12T17:10:44.509117+0000","last_became_peered":"2024-09-12T17:10:44.509117+0000","last_unstale":"2024-09-12T18:09:05.147244+0000","last_undegraded":"2024-09-12T18:09:05.147244+0000","last_fullsized":"2024-09-12T18:09:05.147244+0000","mapping_epoch":26,"log_start":"263'1100","ondisk_log_start":"263'1100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":1100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:09:30.968234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5331,"num_read_kb":4747,"num_write":1539,"num_write_kb":622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"263'204","reported_seq":812,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:51.027681+0000","last_change":"2024-09-12T17:11:16.617932+0000","last_active":"2024-09-12T18:07:51.027681+0000","last_peered":"2024-09-12T18:07:51.027681+0000","last_clean":"2024-09-12T18:07:51.027681+0000","last_became_active":"2024-09-12T17:11:16.617505+0000","last_became_peered":"2024-09-12T17:11:16.617505+0000","last_unstale":"2024-09-12T18:07:51.027681+0000","last_undegraded":"2024-09-12T18:07:51.027681+0000","last_fullsized":"2024-09-12T18:07:51.027681+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:43:08.879561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2937824,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":493,"num_read_kb":50143,"num_write":993,"num_write_kb":47141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,4],"acting":[2,3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:09.851666+0000","last_change":"2024-09-12T17:10:46.532146+0000","last_active":"2024-09-12T18:09:09.851666+0000","last_peered":"2024-09-12T18:09:09.851666+0000","last_clean":"2024-09-12T18:09:09.851666+0000","last_became_active":"2024-09-12T17:10:46.531835+0000","last_became_peered":"2024-09-12T17:10:46.531835+0000","last_unstale":"2024-09-12T18:09:09.851666+0000","last_undegraded":"2024-09-12T18:09:09.851666+0000","last_fullsized":"2024-09-12T18:09:09.851666+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_clean_scrub_stamp":"2024-09-12T17:10:45.504515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:41:31.662923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"263'46","reported_seq":554,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:09.843750+0000","last_change":"2024-09-12T17:10:48.541273+0000","last_active":"2024-09-12T18:09:09.843750+0000","last_peered":"2024-09-12T18:09:09.843750+0000","last_clean":"2024-09-12T18:09:09.843750+0000","last_became_active":"2024-09-12T17:10:48.540975+0000","last_became_peered":"2024-09-12T17:10:48.540975+0000","last_unstale":"2024-09-12T18:09:09.843750+0000","last_undegraded":"2024-09-12T18:09:09.843750+0000","last_fullsized":"2024-09-12T18:09:09.843750+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_clean_scrub_stamp":"2024-09-12T17:10:47.516917+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:50:54.992489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":38,"num_read_kb":36,"num_write":28,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":486,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:09.855642+0000","last_change":"2024-09-12T17:10:50.553896+0000","last_active":"2024-09-12T18:09:09.855642+0000","last_peered":"2024-09-12T18:09:09.855642+0000","last_clean":"2024-09-12T18:09:09.855642+0000","last_became_active":"2024-09-12T17:10:50.553581+0000","last_became_peered":"2024-09-12T17:10:50.553581+0000","last_unstale":"2024-09-12T18:09:09.855642+0000","last_undegraded":"2024-09-12T18:09:09.855642+0000","last_fullsized":"2024-09-12T18:09:09.855642+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_clean_scrub_stamp":"2024-09-12T17:10:49.533772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:14:49.105003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"263'191","reported_seq":712,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:49.539356+0000","last_change":"2024-09-12T17:10:52.573782+0000","last_active":"2024-09-12T18:09:49.539356+0000","last_peered":"2024-09-12T18:09:49.539356+0000","last_clean":"2024-09-12T18:09:49.539356+0000","last_became_active":"2024-09-12T17:10:52.573306+0000","last_became_peered":"2024-09-12T17:10:52.573306+0000","last_unstale":"2024-09-12T18:09:49.539356+0000","last_undegraded":"2024-09-12T18:09:49.539356+0000","last_fullsized":"2024-09-12T18:09:49.539356+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:39:25.637064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":321,"num_read_kb":317,"num_write":439,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"263'810","reported_seq":2411,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:04.850964+0000","last_change":"2024-09-12T17:10:44.511875+0000","last_active":"2024-09-12T18:09:04.850964+0000","last_peered":"2024-09-12T18:09:04.850964+0000","last_clean":"2024-09-12T18:09:04.850964+0000","last_became_active":"2024-09-12T17:10:44.511481+0000","last_became_peered":"2024-09-12T17:10:44.511481+0000","last_unstale":"2024-09-12T18:09:04.850964+0000","last_undegraded":"2024-09-12T18:09:04.850964+0000","last_fullsized":"2024-09-12T18:09:04.850964+0000","mapping_epoch":26,"log_start":"263'700","ondisk_log_start":"263'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":700,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:10:10.656622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3868,"num_read_kb":3506,"num_write":1048,"num_write_kb":364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"263'168","reported_seq":770,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:04.012455+0000","last_change":"2024-09-12T17:11:16.863311+0000","last_active":"2024-09-12T18:11:04.012455+0000","last_peered":"2024-09-12T18:11:04.012455+0000","last_clean":"2024-09-12T18:11:04.012455+0000","last_became_active":"2024-09-12T17:11:16.862878+0000","last_became_peered":"2024-09-12T17:11:16.862878+0000","last_unstale":"2024-09-12T18:11:04.012455+0000","last_undegraded":"2024-09-12T18:11:04.012455+0000","last_fullsized":"2024-09-12T18:11:04.012455+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:36:57.402157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17896412,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":386,"num_read_kb":53715,"num_write":798,"num_write_kb":39175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,1,3],"acting":[2,7,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:09.855601+0000","last_change":"2024-09-12T17:10:46.530915+0000","last_active":"2024-09-12T18:09:09.855601+0000","last_peered":"2024-09-12T18:09:09.855601+0000","last_clean":"2024-09-12T18:09:09.855601+0000","last_became_active":"2024-09-12T17:10:46.530518+0000","last_became_peered":"2024-09-12T17:10:46.530518+0000","last_unstale":"2024-09-12T18:09:09.855601+0000","last_undegraded":"2024-09-12T18:09:09.855601+0000","last_fullsized":"2024-09-12T18:09:09.855601+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_clean_scrub_stamp":"2024-09-12T17:10:45.504515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:39:55.119594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"263'169","reported_seq":757,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:09.790509+0000","last_change":"2024-09-12T17:10:48.537056+0000","last_active":"2024-09-12T18:11:09.790509+0000","last_peered":"2024-09-12T18:11:09.790509+0000","last_clean":"2024-09-12T18:11:09.790509+0000","last_became_active":"2024-09-12T17:10:48.536654+0000","last_became_peered":"2024-09-12T17:10:48.536654+0000","last_unstale":"2024-09-12T18:11:09.790509+0000","last_undegraded":"2024-09-12T18:11:09.790509+0000","last_fullsized":"2024-09-12T18:11:09.790509+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_clean_scrub_stamp":"2024-09-12T17:10:47.516917+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":100,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:46:23.716742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6412,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":215,"num_read_kb":225,"num_write":118,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":489,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:09.875304+0000","last_change":"2024-09-12T17:10:50.556336+0000","last_active":"2024-09-12T18:09:09.875304+0000","last_peered":"2024-09-12T18:09:09.875304+0000","last_clean":"2024-09-12T18:09:09.875304+0000","last_became_active":"2024-09-12T17:10:50.556039+0000","last_became_peered":"2024-09-12T17:10:50.556039+0000","last_unstale":"2024-09-12T18:09:09.875304+0000","last_undegraded":"2024-09-12T18:09:09.875304+0000","last_fullsized":"2024-09-12T18:09:09.875304+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_clean_scrub_stamp":"2024-09-12T17:10:49.533772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:58:59.200469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"263'113","reported_seq":617,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:24.848069+0000","last_change":"2024-09-12T17:10:52.577104+0000","last_active":"2024-09-12T18:08:24.848069+0000","last_peered":"2024-09-12T18:08:24.848069+0000","last_clean":"2024-09-12T18:08:24.848069+0000","last_became_active":"2024-09-12T17:10:52.576791+0000","last_became_peered":"2024-09-12T17:10:52.576791+0000","last_unstale":"2024-09-12T18:08:24.848069+0000","last_undegraded":"2024-09-12T18:08:24.848069+0000","last_fullsized":"2024-09-12T18:08:24.848069+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:18:40.050173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":159,"num_read_kb":159,"num_write":260,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"263'429","reported_seq":1806,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:04.850927+0000","last_change":"2024-09-12T17:10:44.521723+0000","last_active":"2024-09-12T18:09:04.850927+0000","last_peered":"2024-09-12T18:09:04.850927+0000","last_clean":"2024-09-12T18:09:04.850927+0000","last_became_active":"2024-09-12T17:10:44.520747+0000","last_became_peered":"2024-09-12T17:10:44.520747+0000","last_unstale":"2024-09-12T18:09:04.850927+0000","last_undegraded":"2024-09-12T18:09:04.850927+0000","last_fullsized":"2024-09-12T18:09:04.850927+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":400,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:56:20.477273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2202,"num_read_kb":2035,"num_write":527,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"263'251","reported_seq":940,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:07.551191+0000","last_change":"2024-09-12T17:10:42.529117+0000","last_active":"2024-09-12T18:11:07.551191+0000","last_peered":"2024-09-12T18:11:07.551191+0000","last_clean":"2024-09-12T18:11:07.551191+0000","last_became_active":"2024-09-12T17:10:42.528364+0000","last_became_peered":"2024-09-12T17:10:42.528364+0000","last_unstale":"2024-09-12T18:11:07.551191+0000","last_undegraded":"2024-09-12T18:11:07.551191+0000","last_fullsized":"2024-09-12T18:11:07.551191+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:10:20.252342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5692764,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":609,"num_read_kb":71919,"num_write":1341,"num_write_kb":46951,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6,3],"acting":[0,5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:09.875254+0000","last_change":"2024-09-12T17:10:46.532154+0000","last_active":"2024-09-12T18:09:09.875254+0000","last_peered":"2024-09-12T18:09:09.875254+0000","last_clean":"2024-09-12T18:09:09.875254+0000","last_became_active":"2024-09-12T17:10:46.531830+0000","last_became_peered":"2024-09-12T17:10:46.531830+0000","last_unstale":"2024-09-12T18:09:09.875254+0000","last_undegraded":"2024-09-12T18:09:09.875254+0000","last_fullsized":"2024-09-12T18:09:09.875254+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_clean_scrub_stamp":"2024-09-12T17:10:45.504515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:00:23.387684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"263'123","reported_seq":687,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:09.786960+0000","last_change":"2024-09-12T17:10:48.545933+0000","last_active":"2024-09-12T18:11:09.786960+0000","last_peered":"2024-09-12T18:11:09.786960+0000","last_clean":"2024-09-12T18:11:09.786960+0000","last_became_active":"2024-09-12T17:10:48.545598+0000","last_became_peered":"2024-09-12T17:10:48.545598+0000","last_unstale":"2024-09-12T18:11:09.786960+0000","last_undegraded":"2024-09-12T18:11:09.786960+0000","last_fullsized":"2024-09-12T18:11:09.786960+0000","mapping_epoch":30,"log_start":"263'100","ondisk_log_start":"263'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_clean_scrub_stamp":"2024-09-12T17:10:47.516917+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:53:48.675107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12450,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":157,"num_read_kb":207,"num_write":82,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:09.843797+0000","last_change":"2024-09-12T17:10:50.561238+0000","last_active":"2024-09-12T18:09:09.843797+0000","last_peered":"2024-09-12T18:09:09.843797+0000","last_clean":"2024-09-12T18:09:09.843797+0000","last_became_active":"2024-09-12T17:10:50.560872+0000","last_became_peered":"2024-09-12T17:10:50.560872+0000","last_unstale":"2024-09-12T18:09:09.843797+0000","last_undegraded":"2024-09-12T18:09:09.843797+0000","last_fullsized":"2024-09-12T18:09:09.843797+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_clean_scrub_stamp":"2024-09-12T17:10:49.533772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:11:16.785795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"263'950","reported_seq":2479,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:08.687444+0000","last_change":"2024-09-12T17:10:44.519331+0000","last_active":"2024-09-12T18:11:08.687444+0000","last_peered":"2024-09-12T18:11:08.687444+0000","last_clean":"2024-09-12T18:11:08.687444+0000","last_became_active":"2024-09-12T17:10:44.518992+0000","last_became_peered":"2024-09-12T17:10:44.518992+0000","last_unstale":"2024-09-12T18:11:08.687444+0000","last_undegraded":"2024-09-12T18:11:08.687444+0000","last_fullsized":"2024-09-12T18:11:08.687444+0000","mapping_epoch":26,"log_start":"263'900","ondisk_log_start":"263'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":900,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:58:27.950402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4453,"num_read_kb":3925,"num_write":1322,"num_write_kb":528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"263'311","reported_seq":989,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:44.848614+0000","last_change":"2024-09-12T17:10:42.515186+0000","last_active":"2024-09-12T18:08:44.848614+0000","last_peered":"2024-09-12T18:08:44.848614+0000","last_clean":"2024-09-12T18:08:44.848614+0000","last_became_active":"2024-09-12T17:10:42.514627+0000","last_became_peered":"2024-09-12T17:10:42.514627+0000","last_unstale":"2024-09-12T18:08:44.848614+0000","last_undegraded":"2024-09-12T18:08:44.848614+0000","last_fullsized":"2024-09-12T18:08:44.848614+0000","mapping_epoch":24,"log_start":"263'300","ondisk_log_start":"263'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:27:58.202191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15728847,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":790,"num_read_kb":25839,"num_write":1191,"num_write_kb":43854,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":504,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:59.842677+0000","last_change":"2024-09-12T17:10:46.527010+0000","last_active":"2024-09-12T18:08:59.842677+0000","last_peered":"2024-09-12T18:08:59.842677+0000","last_clean":"2024-09-12T18:08:59.842677+0000","last_became_active":"2024-09-12T17:10:46.526692+0000","last_became_peered":"2024-09-12T17:10:46.526692+0000","last_unstale":"2024-09-12T18:08:59.842677+0000","last_undegraded":"2024-09-12T18:08:59.842677+0000","last_fullsized":"2024-09-12T18:08:59.842677+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_clean_scrub_stamp":"2024-09-12T17:10:45.504515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:02:16.851916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"263'205","reported_seq":830,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:09.785236+0000","last_change":"2024-09-12T17:10:48.545433+0000","last_active":"2024-09-12T18:11:09.785236+0000","last_peered":"2024-09-12T18:11:09.785236+0000","last_clean":"2024-09-12T18:11:09.785236+0000","last_became_active":"2024-09-12T17:10:48.544429+0000","last_became_peered":"2024-09-12T17:10:48.544429+0000","last_unstale":"2024-09-12T18:11:09.785236+0000","last_undegraded":"2024-09-12T18:11:09.785236+0000","last_fullsized":"2024-09-12T18:11:09.785236+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_clean_scrub_stamp":"2024-09-12T17:10:47.516917+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:28:39.813411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19968,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":307,"num_read_kb":447,"num_write":200,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":485,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:19.847436+0000","last_change":"2024-09-12T17:10:50.565947+0000","last_active":"2024-09-12T18:08:19.847436+0000","last_peered":"2024-09-12T18:08:19.847436+0000","last_clean":"2024-09-12T18:08:19.847436+0000","last_became_active":"2024-09-12T17:10:50.565621+0000","last_became_peered":"2024-09-12T17:10:50.565621+0000","last_unstale":"2024-09-12T18:08:19.847436+0000","last_undegraded":"2024-09-12T18:08:19.847436+0000","last_fullsized":"2024-09-12T18:08:19.847436+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_clean_scrub_stamp":"2024-09-12T17:10:49.533772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:49:32.811403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"263'175","reported_seq":681,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:14.852393+0000","last_change":"2024-09-12T17:10:52.672357+0000","last_active":"2024-09-12T18:09:14.852393+0000","last_peered":"2024-09-12T18:09:14.852393+0000","last_clean":"2024-09-12T18:09:14.852393+0000","last_became_active":"2024-09-12T17:10:52.672033+0000","last_became_peered":"2024-09-12T17:10:52.672033+0000","last_unstale":"2024-09-12T18:09:14.852393+0000","last_undegraded":"2024-09-12T18:09:14.852393+0000","last_fullsized":"2024-09-12T18:09:14.852393+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:21:13.578314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":269,"num_read_kb":274,"num_write":411,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"263'545","reported_seq":2055,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:48.687635+0000","last_change":"2024-09-12T17:10:44.510970+0000","last_active":"2024-09-12T18:09:48.687635+0000","last_peered":"2024-09-12T18:09:48.687635+0000","last_clean":"2024-09-12T18:09:48.687635+0000","last_became_active":"2024-09-12T17:10:44.510696+0000","last_became_peered":"2024-09-12T17:10:44.510696+0000","last_unstale":"2024-09-12T18:09:48.687635+0000","last_undegraded":"2024-09-12T18:09:48.687635+0000","last_fullsized":"2024-09-12T18:09:48.687635+0000","mapping_epoch":26,"log_start":"263'500","ondisk_log_start":"263'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":500,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:45:34.728786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2748,"num_read_kb":2501,"num_write":691,"num_write_kb":203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"263'236","reported_seq":903,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:43.766114+0000","last_change":"2024-09-12T17:10:42.520812+0000","last_active":"2024-09-12T18:09:43.766114+0000","last_peered":"2024-09-12T18:09:43.766114+0000","last_clean":"2024-09-12T18:09:43.766114+0000","last_became_active":"2024-09-12T17:10:42.520349+0000","last_became_peered":"2024-09-12T17:10:42.520349+0000","last_unstale":"2024-09-12T18:09:43.766114+0000","last_undegraded":"2024-09-12T18:09:43.766114+0000","last_fullsized":"2024-09-12T18:09:43.766114+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":200,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:40:03.389243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21229654,"num_objects":11,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":539,"num_read_kb":59039,"num_write":1204,"num_write_kb":37561,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,6],"acting":[1,3,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":500,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:09.875361+0000","last_change":"2024-09-12T17:10:46.530884+0000","last_active":"2024-09-12T18:09:09.875361+0000","last_peered":"2024-09-12T18:09:09.875361+0000","last_clean":"2024-09-12T18:09:09.875361+0000","last_became_active":"2024-09-12T17:10:46.530545+0000","last_became_peered":"2024-09-12T17:10:46.530545+0000","last_unstale":"2024-09-12T18:09:09.875361+0000","last_undegraded":"2024-09-12T18:09:09.875361+0000","last_fullsized":"2024-09-12T18:09:09.875361+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_clean_scrub_stamp":"2024-09-12T17:10:45.504515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:01:13.562715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"263'166","reported_seq":746,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:10:49.870892+0000","last_change":"2024-09-12T17:10:48.541568+0000","last_active":"2024-09-12T18:10:49.870892+0000","last_peered":"2024-09-12T18:10:49.870892+0000","last_clean":"2024-09-12T18:10:49.870892+0000","last_became_active":"2024-09-12T17:10:48.541240+0000","last_became_peered":"2024-09-12T17:10:48.541240+0000","last_unstale":"2024-09-12T18:10:49.870892+0000","last_undegraded":"2024-09-12T18:10:49.870892+0000","last_fullsized":"2024-09-12T18:10:49.870892+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_clean_scrub_stamp":"2024-09-12T17:10:47.516917+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:09:34.296718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11199,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":237,"num_read_kb":302,"num_write":156,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":491,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:20.142401+0000","last_change":"2024-09-12T17:10:50.562714+0000","last_active":"2024-09-12T18:08:20.142401+0000","last_peered":"2024-09-12T18:08:20.142401+0000","last_clean":"2024-09-12T18:08:20.142401+0000","last_became_active":"2024-09-12T17:10:50.561983+0000","last_became_peered":"2024-09-12T17:10:50.561983+0000","last_unstale":"2024-09-12T18:08:20.142401+0000","last_undegraded":"2024-09-12T18:08:20.142401+0000","last_fullsized":"2024-09-12T18:08:20.142401+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_clean_scrub_stamp":"2024-09-12T17:10:49.533772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:59:00.374511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"263'244","reported_seq":1112,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:49.532850+0000","last_change":"2024-09-12T17:10:52.573923+0000","last_active":"2024-09-12T18:09:49.532850+0000","last_peered":"2024-09-12T18:09:49.532850+0000","last_clean":"2024-09-12T18:09:49.532850+0000","last_became_active":"2024-09-12T17:10:52.573595+0000","last_became_peered":"2024-09-12T17:10:52.573595+0000","last_unstale":"2024-09-12T18:09:49.532850+0000","last_undegraded":"2024-09-12T18:09:49.532850+0000","last_fullsized":"2024-09-12T18:09:49.532850+0000","mapping_epoch":34,"log_start":"263'200","ondisk_log_start":"263'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":200,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:32:14.573475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1635,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":641,"num_read_kb":637,"num_write":634,"num_write_kb":186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"263'620","reported_seq":2213,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:58.603541+0000","last_change":"2024-09-12T17:10:44.521406+0000","last_active":"2024-09-12T18:08:58.603541+0000","last_peered":"2024-09-12T18:08:58.603541+0000","last_clean":"2024-09-12T18:08:58.603541+0000","last_became_active":"2024-09-12T17:10:44.521041+0000","last_became_peered":"2024-09-12T17:10:44.521041+0000","last_unstale":"2024-09-12T18:08:58.603541+0000","last_undegraded":"2024-09-12T18:08:58.603541+0000","last_fullsized":"2024-09-12T18:08:58.603541+0000","mapping_epoch":26,"log_start":"263'600","ondisk_log_start":"263'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":600,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:02:28.202706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3182,"num_read_kb":2947,"num_write":827,"num_write_kb":261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"263'219","reported_seq":811,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:49.849250+0000","last_change":"2024-09-12T17:11:16.860452+0000","last_active":"2024-09-12T18:08:49.849250+0000","last_peered":"2024-09-12T18:08:49.849250+0000","last_clean":"2024-09-12T18:08:49.849250+0000","last_became_active":"2024-09-12T17:11:16.860070+0000","last_became_peered":"2024-09-12T17:11:16.860070+0000","last_unstale":"2024-09-12T18:08:49.849250+0000","last_undegraded":"2024-09-12T18:08:49.849250+0000","last_fullsized":"2024-09-12T18:08:49.849250+0000","mapping_epoch":37,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:08:44.066630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3266454,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":440,"num_read_kb":10891,"num_write":952,"num_write_kb":36342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":501,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:19.848368+0000","last_change":"2024-09-12T17:10:46.530777+0000","last_active":"2024-09-12T18:08:19.848368+0000","last_peered":"2024-09-12T18:08:19.848368+0000","last_clean":"2024-09-12T18:08:19.848368+0000","last_became_active":"2024-09-12T17:10:46.530452+0000","last_became_peered":"2024-09-12T17:10:46.530452+0000","last_unstale":"2024-09-12T18:08:19.848368+0000","last_undegraded":"2024-09-12T18:08:19.848368+0000","last_fullsized":"2024-09-12T18:08:19.848368+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_clean_scrub_stamp":"2024-09-12T17:10:45.504515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:09:29.711456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"263'138","reported_seq":713,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:09.809315+0000","last_change":"2024-09-12T17:10:48.538046+0000","last_active":"2024-09-12T18:11:09.809315+0000","last_peered":"2024-09-12T18:11:09.809315+0000","last_clean":"2024-09-12T18:11:09.809315+0000","last_became_active":"2024-09-12T17:10:48.537643+0000","last_became_peered":"2024-09-12T17:10:48.537643+0000","last_unstale":"2024-09-12T18:11:09.809315+0000","last_undegraded":"2024-09-12T18:11:09.809315+0000","last_fullsized":"2024-09-12T18:11:09.809315+0000","mapping_epoch":30,"log_start":"263'100","ondisk_log_start":"263'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_clean_scrub_stamp":"2024-09-12T17:10:47.516917+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:09:50.764378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5345,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":171,"num_read_kb":208,"num_write":92,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:55.146261+0000","last_change":"2024-09-12T17:10:50.565961+0000","last_active":"2024-09-12T18:08:55.146261+0000","last_peered":"2024-09-12T18:08:55.146261+0000","last_clean":"2024-09-12T18:08:55.146261+0000","last_became_active":"2024-09-12T17:10:50.565582+0000","last_became_peered":"2024-09-12T17:10:50.565582+0000","last_unstale":"2024-09-12T18:08:55.146261+0000","last_undegraded":"2024-09-12T18:08:55.146261+0000","last_fullsized":"2024-09-12T18:08:55.146261+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_clean_scrub_stamp":"2024-09-12T17:10:49.533772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:00:34.128895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"263'130","reported_seq":617,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:09.828159+0000","last_change":"2024-09-12T17:10:52.576677+0000","last_active":"2024-09-12T18:11:09.828159+0000","last_peered":"2024-09-12T18:11:09.828159+0000","last_clean":"2024-09-12T18:11:09.828159+0000","last_became_active":"2024-09-12T17:10:52.576370+0000","last_became_peered":"2024-09-12T17:10:52.576370+0000","last_unstale":"2024-09-12T18:11:09.828159+0000","last_undegraded":"2024-09-12T18:11:09.828159+0000","last_fullsized":"2024-09-12T18:11:09.828159+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:03:31.842871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1233,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":145,"num_read_kb":142,"num_write":322,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"263'872","reported_seq":2422,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:48.687133+0000","last_change":"2024-09-12T17:10:44.519575+0000","last_active":"2024-09-12T18:09:48.687133+0000","last_peered":"2024-09-12T18:09:48.687133+0000","last_clean":"2024-09-12T18:09:48.687133+0000","last_became_active":"2024-09-12T17:10:44.519318+0000","last_became_peered":"2024-09-12T17:10:44.519318+0000","last_unstale":"2024-09-12T18:09:48.687133+0000","last_undegraded":"2024-09-12T18:09:48.687133+0000","last_fullsized":"2024-09-12T18:09:48.687133+0000","mapping_epoch":26,"log_start":"263'800","ondisk_log_start":"263'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":800,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:45:54.356905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4021,"num_read_kb":3592,"num_write":1141,"num_write_kb":414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"263'185","reported_seq":798,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:14.837007+0000","last_change":"2024-09-12T17:10:42.517205+0000","last_active":"2024-09-12T18:08:14.837007+0000","last_peered":"2024-09-12T18:08:14.837007+0000","last_clean":"2024-09-12T18:08:14.837007+0000","last_became_active":"2024-09-12T17:10:42.516802+0000","last_became_peered":"2024-09-12T17:10:42.516802+0000","last_unstale":"2024-09-12T18:08:14.837007+0000","last_undegraded":"2024-09-12T18:08:14.837007+0000","last_fullsized":"2024-09-12T18:08:14.837007+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:48:25.179651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5530186,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":393,"num_read_kb":13109,"num_write":966,"num_write_kb":28742,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7,1],"acting":[0,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"36'4","reported_seq":975,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:09.531956+0000","last_change":"2024-09-12T17:10:46.530932+0000","last_active":"2024-09-12T18:11:09.531956+0000","last_peered":"2024-09-12T18:11:09.531956+0000","last_clean":"2024-09-12T18:11:09.531956+0000","last_became_active":"2024-09-12T17:10:46.530466+0000","last_became_peered":"2024-09-12T17:10:46.530466+0000","last_unstale":"2024-09-12T18:11:09.531956+0000","last_undegraded":"2024-09-12T18:11:09.531956+0000","last_fullsized":"2024-09-12T18:11:09.531956+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_clean_scrub_stamp":"2024-09-12T17:10:45.504515+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:59:20.697816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":718,"num_read_kb":1182,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"263'90","reported_seq":623,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:59.853778+0000","last_change":"2024-09-12T17:10:48.538034+0000","last_active":"2024-09-12T18:08:59.853778+0000","last_peered":"2024-09-12T18:08:59.853778+0000","last_clean":"2024-09-12T18:08:59.853778+0000","last_became_active":"2024-09-12T17:10:48.537715+0000","last_became_peered":"2024-09-12T17:10:48.537715+0000","last_unstale":"2024-09-12T18:08:59.853778+0000","last_undegraded":"2024-09-12T18:08:59.853778+0000","last_fullsized":"2024-09-12T18:08:59.853778+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_clean_scrub_stamp":"2024-09-12T17:10:47.516917+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:50:02.415975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":103,"num_read_kb":94,"num_write":78,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"263'760","reported_seq":2581,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:13.401557+0000","last_change":"2024-09-12T17:10:50.552759+0000","last_active":"2024-09-12T18:11:13.401557+0000","last_peered":"2024-09-12T18:11:13.401557+0000","last_clean":"2024-09-12T18:11:13.401557+0000","last_became_active":"2024-09-12T17:10:50.552439+0000","last_became_peered":"2024-09-12T17:10:50.552439+0000","last_unstale":"2024-09-12T18:11:13.401557+0000","last_undegraded":"2024-09-12T18:11:13.401557+0000","last_fullsized":"2024-09-12T18:11:13.401557+0000","mapping_epoch":32,"log_start":"263'700","ondisk_log_start":"263'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_clean_scrub_stamp":"2024-09-12T17:10:49.533772+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":700,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:05:46.061876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"263'101","reported_seq":599,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:14.856275+0000","last_change":"2024-09-12T17:10:52.576632+0000","last_active":"2024-09-12T18:09:14.856275+0000","last_peered":"2024-09-12T18:09:14.856275+0000","last_clean":"2024-09-12T18:09:14.856275+0000","last_became_active":"2024-09-12T17:10:52.576354+0000","last_became_peered":"2024-09-12T17:10:52.576354+0000","last_unstale":"2024-09-12T18:09:14.856275+0000","last_undegraded":"2024-09-12T18:09:14.856275+0000","last_fullsized":"2024-09-12T18:09:14.856275+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:31:48.033949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":153,"num_read_kb":145,"num_write":246,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"263'888","reported_seq":2559,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:58.602298+0000","last_change":"2024-09-12T17:10:44.515286+0000","last_active":"2024-09-12T18:08:58.602298+0000","last_peered":"2024-09-12T18:08:58.602298+0000","last_clean":"2024-09-12T18:08:58.602298+0000","last_became_active":"2024-09-12T17:10:44.514263+0000","last_became_peered":"2024-09-12T17:10:44.514263+0000","last_unstale":"2024-09-12T18:08:58.602298+0000","last_undegraded":"2024-09-12T18:08:58.602298+0000","last_fullsized":"2024-09-12T18:08:58.602298+0000","mapping_epoch":26,"log_start":"263'800","ondisk_log_start":"263'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":800,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:36:42.105597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4092,"num_read_kb":3689,"num_write":1154,"num_write_kb":400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"263'210","reported_seq":848,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:07.932614+0000","last_change":"2024-09-12T17:10:42.528032+0000","last_active":"2024-09-12T18:09:07.932614+0000","last_peered":"2024-09-12T18:09:07.932614+0000","last_clean":"2024-09-12T18:09:07.932614+0000","last_became_active":"2024-09-12T17:10:42.527644+0000","last_became_peered":"2024-09-12T17:10:42.527644+0000","last_unstale":"2024-09-12T18:09:07.932614+0000","last_undegraded":"2024-09-12T18:09:07.932614+0000","last_fullsized":"2024-09-12T18:09:07.932614+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:07:37.030800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5886518,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":476,"num_read_kb":29326,"num_write":1034,"num_write_kb":31012,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,6],"acting":[5,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:19.848670+0000","last_change":"2024-09-12T17:10:46.532064+0000","last_active":"2024-09-12T18:08:19.848670+0000","last_peered":"2024-09-12T18:08:19.848670+0000","last_clean":"2024-09-12T18:08:19.848670+0000","last_became_active":"2024-09-12T17:10:46.531759+0000","last_became_peered":"2024-09-12T17:10:46.531759+0000","last_unstale":"2024-09-12T18:08:19.848670+0000","last_undegraded":"2024-09-12T18:08:19.848670+0000","last_fullsized":"2024-09-12T18:08:19.848670+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_clean_scrub_stamp":"2024-09-12T17:10:45.504515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:32:10.706827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"263'196","reported_seq":778,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:09.776476+0000","last_change":"2024-09-12T17:10:48.543431+0000","last_active":"2024-09-12T18:11:09.776476+0000","last_peered":"2024-09-12T18:11:09.776476+0000","last_clean":"2024-09-12T18:11:09.776476+0000","last_became_active":"2024-09-12T17:10:48.543123+0000","last_became_peered":"2024-09-12T17:10:48.543123+0000","last_unstale":"2024-09-12T18:11:09.776476+0000","last_undegraded":"2024-09-12T18:11:09.776476+0000","last_fullsized":"2024-09-12T18:11:09.776476+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_clean_scrub_stamp":"2024-09-12T17:10:47.516917+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:14:40.758351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10631,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":239,"num_read_kb":288,"num_write":152,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":491,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:49.841229+0000","last_change":"2024-09-12T17:10:50.556322+0000","last_active":"2024-09-12T18:08:49.841229+0000","last_peered":"2024-09-12T18:08:49.841229+0000","last_clean":"2024-09-12T18:08:49.841229+0000","last_became_active":"2024-09-12T17:10:50.556040+0000","last_became_peered":"2024-09-12T17:10:50.556040+0000","last_unstale":"2024-09-12T18:08:49.841229+0000","last_undegraded":"2024-09-12T18:08:49.841229+0000","last_fullsized":"2024-09-12T18:08:49.841229+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_clean_scrub_stamp":"2024-09-12T17:10:49.533772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:11:28.653630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"263'132","reported_seq":632,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:46.952145+0000","last_change":"2024-09-12T17:10:52.585108+0000","last_active":"2024-09-12T18:09:46.952145+0000","last_peered":"2024-09-12T18:09:46.952145+0000","last_clean":"2024-09-12T18:09:46.952145+0000","last_became_active":"2024-09-12T17:10:52.584752+0000","last_became_peered":"2024-09-12T17:10:52.584752+0000","last_unstale":"2024-09-12T18:09:46.952145+0000","last_undegraded":"2024-09-12T18:09:46.952145+0000","last_fullsized":"2024-09-12T18:09:46.952145+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:17:54.690247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":200,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":199,"num_read_kb":187,"num_write":331,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"263'455","reported_seq":2246,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:41.749674+0000","last_change":"2024-09-12T17:10:44.516055+0000","last_active":"2024-09-12T18:08:41.749674+0000","last_peered":"2024-09-12T18:08:41.749674+0000","last_clean":"2024-09-12T18:08:41.749674+0000","last_became_active":"2024-09-12T17:10:44.515463+0000","last_became_peered":"2024-09-12T17:10:44.515463+0000","last_unstale":"2024-09-12T18:08:41.749674+0000","last_undegraded":"2024-09-12T18:08:41.749674+0000","last_fullsized":"2024-09-12T18:08:41.749674+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":400,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:48:28.929846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2803,"num_read_kb":2700,"num_write":505,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"263'183","reported_seq":799,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:14.846808+0000","last_change":"2024-09-12T17:10:42.530271+0000","last_active":"2024-09-12T18:08:14.846808+0000","last_peered":"2024-09-12T18:08:14.846808+0000","last_clean":"2024-09-12T18:08:14.846808+0000","last_became_active":"2024-09-12T17:10:42.529547+0000","last_became_peered":"2024-09-12T17:10:42.529547+0000","last_unstale":"2024-09-12T18:08:14.846808+0000","last_undegraded":"2024-09-12T18:08:14.846808+0000","last_fullsized":"2024-09-12T18:08:14.846808+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:44:05.993110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10780645,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":388,"num_read_kb":39415,"num_write":887,"num_write_kb":32700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,6],"acting":[5,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:19.847401+0000","last_change":"2024-09-12T17:10:46.532778+0000","last_active":"2024-09-12T18:08:19.847401+0000","last_peered":"2024-09-12T18:08:19.847401+0000","last_clean":"2024-09-12T18:08:19.847401+0000","last_became_active":"2024-09-12T17:10:46.532418+0000","last_became_peered":"2024-09-12T17:10:46.532418+0000","last_unstale":"2024-09-12T18:08:19.847401+0000","last_undegraded":"2024-09-12T18:08:19.847401+0000","last_fullsized":"2024-09-12T18:08:19.847401+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_clean_scrub_stamp":"2024-09-12T17:10:45.504515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:36:54.346427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"263'128","reported_seq":697,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:09.777573+0000","last_change":"2024-09-12T17:10:48.539329+0000","last_active":"2024-09-12T18:11:09.777573+0000","last_peered":"2024-09-12T18:11:09.777573+0000","last_clean":"2024-09-12T18:11:09.777573+0000","last_became_active":"2024-09-12T17:10:48.539047+0000","last_became_peered":"2024-09-12T17:10:48.539047+0000","last_unstale":"2024-09-12T18:11:09.777573+0000","last_undegraded":"2024-09-12T18:11:09.777573+0000","last_fullsized":"2024-09-12T18:11:09.777573+0000","mapping_epoch":30,"log_start":"263'100","ondisk_log_start":"263'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_clean_scrub_stamp":"2024-09-12T17:10:47.516917+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:16:56.494114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7731,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":158,"num_read_kb":203,"num_write":84,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:59.873702+0000","last_change":"2024-09-12T17:10:50.556644+0000","last_active":"2024-09-12T18:08:59.873702+0000","last_peered":"2024-09-12T18:08:59.873702+0000","last_clean":"2024-09-12T18:08:59.873702+0000","last_became_active":"2024-09-12T17:10:50.555858+0000","last_became_peered":"2024-09-12T17:10:50.555858+0000","last_unstale":"2024-09-12T18:08:59.873702+0000","last_undegraded":"2024-09-12T18:08:59.873702+0000","last_fullsized":"2024-09-12T18:08:59.873702+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_clean_scrub_stamp":"2024-09-12T17:10:49.533772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:24:28.762169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"263'112","reported_seq":626,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:55.349086+0000","last_change":"2024-09-12T17:10:52.671426+0000","last_active":"2024-09-12T18:08:55.349086+0000","last_peered":"2024-09-12T18:08:55.349086+0000","last_clean":"2024-09-12T18:08:55.349086+0000","last_became_active":"2024-09-12T17:10:52.671139+0000","last_became_peered":"2024-09-12T17:10:52.671139+0000","last_unstale":"2024-09-12T18:08:55.349086+0000","last_undegraded":"2024-09-12T18:08:55.349086+0000","last_fullsized":"2024-09-12T18:08:55.349086+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:12:33.369332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":178,"num_read_kb":175,"num_write":256,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"263'784","reported_seq":2334,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:06.317962+0000","last_change":"2024-09-12T17:11:16.619107+0000","last_active":"2024-09-12T18:09:06.317962+0000","last_peered":"2024-09-12T18:09:06.317962+0000","last_clean":"2024-09-12T18:09:06.317962+0000","last_became_active":"2024-09-12T17:11:16.618723+0000","last_became_peered":"2024-09-12T17:11:16.618723+0000","last_unstale":"2024-09-12T18:09:06.317962+0000","last_undegraded":"2024-09-12T18:09:06.317962+0000","last_fullsized":"2024-09-12T18:09:06.317962+0000","mapping_epoch":37,"log_start":"263'700","ondisk_log_start":"263'700","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":700,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:07:15.117121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4039,"num_read_kb":3670,"num_write":1050,"num_write_kb":387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"263'170","reported_seq":831,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:59.850448+0000","last_change":"2024-09-12T17:10:42.534710+0000","last_active":"2024-09-12T18:08:59.850448+0000","last_peered":"2024-09-12T18:08:59.850448+0000","last_clean":"2024-09-12T18:08:59.850448+0000","last_became_active":"2024-09-12T17:10:42.534052+0000","last_became_peered":"2024-09-12T17:10:42.534052+0000","last_unstale":"2024-09-12T18:08:59.850448+0000","last_undegraded":"2024-09-12T18:08:59.850448+0000","last_fullsized":"2024-09-12T18:08:59.850448+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:53:24.707491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5576594,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":424,"num_read_kb":101566,"num_write":824,"num_write_kb":35642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7,2],"acting":[3,6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:49.852279+0000","last_change":"2024-09-12T17:10:46.530515+0000","last_active":"2024-09-12T18:08:49.852279+0000","last_peered":"2024-09-12T18:08:49.852279+0000","last_clean":"2024-09-12T18:08:49.852279+0000","last_became_active":"2024-09-12T17:10:46.530079+0000","last_became_peered":"2024-09-12T17:10:46.530079+0000","last_unstale":"2024-09-12T18:08:49.852279+0000","last_undegraded":"2024-09-12T18:08:49.852279+0000","last_fullsized":"2024-09-12T18:08:49.852279+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_clean_scrub_stamp":"2024-09-12T17:10:45.504515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:40:53.204632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"263'100","reported_seq":652,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:10:49.865142+0000","last_change":"2024-09-12T17:10:48.543215+0000","last_active":"2024-09-12T18:10:49.865142+0000","last_peered":"2024-09-12T18:10:49.865142+0000","last_clean":"2024-09-12T18:10:49.865142+0000","last_became_active":"2024-09-12T17:10:48.542918+0000","last_became_peered":"2024-09-12T17:10:48.542918+0000","last_unstale":"2024-09-12T18:10:49.865142+0000","last_undegraded":"2024-09-12T18:10:49.865142+0000","last_fullsized":"2024-09-12T18:10:49.865142+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_clean_scrub_stamp":"2024-09-12T17:10:47.516917+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:28:39.813411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9136,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":120,"num_read_kb":174,"num_write":56,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:19.848339+0000","last_change":"2024-09-12T17:10:50.558543+0000","last_active":"2024-09-12T18:08:19.848339+0000","last_peered":"2024-09-12T18:08:19.848339+0000","last_clean":"2024-09-12T18:08:19.848339+0000","last_became_active":"2024-09-12T17:10:50.558162+0000","last_became_peered":"2024-09-12T17:10:50.558162+0000","last_unstale":"2024-09-12T18:08:19.848339+0000","last_undegraded":"2024-09-12T18:08:19.848339+0000","last_fullsized":"2024-09-12T18:08:19.848339+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_clean_scrub_stamp":"2024-09-12T17:10:49.533772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:13:27.613750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"263'151","reported_seq":1246,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:46.551935+0000","last_change":"2024-09-12T17:10:52.585025+0000","last_active":"2024-09-12T18:09:46.551935+0000","last_peered":"2024-09-12T18:09:46.551935+0000","last_clean":"2024-09-12T18:09:46.551935+0000","last_became_active":"2024-09-12T17:10:52.584763+0000","last_became_peered":"2024-09-12T17:10:52.584763+0000","last_unstale":"2024-09-12T18:09:46.551935+0000","last_undegraded":"2024-09-12T18:09:46.551935+0000","last_fullsized":"2024-09-12T18:09:46.551935+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:21:47.900231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":215,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":802,"num_read_kb":800,"num_write":350,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"263'1272","reported_seq":2975,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:48.690645+0000","last_change":"2024-09-12T17:10:44.513427+0000","last_active":"2024-09-12T18:09:48.690645+0000","last_peered":"2024-09-12T18:09:48.690645+0000","last_clean":"2024-09-12T18:09:48.690645+0000","last_became_active":"2024-09-12T17:10:44.513047+0000","last_became_peered":"2024-09-12T17:10:44.513047+0000","last_unstale":"2024-09-12T18:09:48.690645+0000","last_undegraded":"2024-09-12T18:09:48.690645+0000","last_fullsized":"2024-09-12T18:09:48.690645+0000","mapping_epoch":26,"log_start":"263'1200","ondisk_log_start":"263'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":1200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:58:01.192821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5916,"num_read_kb":5241,"num_write":1773,"num_write_kb":764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"263'261","reported_seq":929,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:04.843299+0000","last_change":"2024-09-12T17:11:16.863072+0000","last_active":"2024-09-12T18:09:04.843299+0000","last_peered":"2024-09-12T18:09:04.843299+0000","last_clean":"2024-09-12T18:09:04.843299+0000","last_became_active":"2024-09-12T17:11:16.862649+0000","last_became_peered":"2024-09-12T17:11:16.862649+0000","last_unstale":"2024-09-12T18:09:04.843299+0000","last_undegraded":"2024-09-12T18:09:04.843299+0000","last_fullsized":"2024-09-12T18:09:04.843299+0000","mapping_epoch":37,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":200,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:36:29.636546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7373923,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":582,"num_read_kb":13957,"num_write":1191,"num_write_kb":16858,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,7],"acting":[0,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"29'1","reported_seq":501,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:55.146197+0000","last_change":"2024-09-12T17:10:46.527752+0000","last_active":"2024-09-12T18:08:55.146197+0000","last_peered":"2024-09-12T18:08:55.146197+0000","last_clean":"2024-09-12T18:08:55.146197+0000","last_became_active":"2024-09-12T17:10:46.527422+0000","last_became_peered":"2024-09-12T17:10:46.527422+0000","last_unstale":"2024-09-12T18:08:55.146197+0000","last_undegraded":"2024-09-12T18:08:55.146197+0000","last_fullsized":"2024-09-12T18:08:55.146197+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_clean_scrub_stamp":"2024-09-12T17:10:45.504515+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:56:46.571241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"263'161","reported_seq":748,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:10:49.740712+0000","last_change":"2024-09-12T17:10:48.545106+0000","last_active":"2024-09-12T18:10:49.740712+0000","last_peered":"2024-09-12T18:10:49.740712+0000","last_clean":"2024-09-12T18:10:49.740712+0000","last_became_active":"2024-09-12T17:10:48.544572+0000","last_became_peered":"2024-09-12T17:10:48.544572+0000","last_unstale":"2024-09-12T18:10:49.740712+0000","last_undegraded":"2024-09-12T18:10:49.740712+0000","last_fullsized":"2024-09-12T18:10:49.740712+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_clean_scrub_stamp":"2024-09-12T17:10:47.516917+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:11:28.036014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9746,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":207,"num_read_kb":258,"num_write":118,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":490,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:19.837629+0000","last_change":"2024-09-12T17:10:50.560331+0000","last_active":"2024-09-12T18:08:19.837629+0000","last_peered":"2024-09-12T18:08:19.837629+0000","last_clean":"2024-09-12T18:08:19.837629+0000","last_became_active":"2024-09-12T17:10:50.560057+0000","last_became_peered":"2024-09-12T17:10:50.560057+0000","last_unstale":"2024-09-12T18:08:19.837629+0000","last_undegraded":"2024-09-12T18:08:19.837629+0000","last_fullsized":"2024-09-12T18:08:19.837629+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_clean_scrub_stamp":"2024-09-12T17:10:49.533772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:11:03.611393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"263'132","reported_seq":623,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:08.654757+0000","last_change":"2024-09-12T17:10:52.570799+0000","last_active":"2024-09-12T18:11:08.654757+0000","last_peered":"2024-09-12T18:11:08.654757+0000","last_clean":"2024-09-12T18:11:08.654757+0000","last_became_active":"2024-09-12T17:10:52.570480+0000","last_became_peered":"2024-09-12T17:10:52.570480+0000","last_unstale":"2024-09-12T18:11:08.654757+0000","last_undegraded":"2024-09-12T18:11:08.654757+0000","last_fullsized":"2024-09-12T18:11:08.654757+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:15:54.371121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":203,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":138,"num_read_kb":137,"num_write":320,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"263'410","reported_seq":1793,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:15.148505+0000","last_change":"2024-09-12T17:10:44.509800+0000","last_active":"2024-09-12T18:09:15.148505+0000","last_peered":"2024-09-12T18:09:15.148505+0000","last_clean":"2024-09-12T18:09:15.148505+0000","last_became_active":"2024-09-12T17:10:44.509508+0000","last_became_peered":"2024-09-12T17:10:44.509508+0000","last_unstale":"2024-09-12T18:09:15.148505+0000","last_undegraded":"2024-09-12T18:09:15.148505+0000","last_fullsized":"2024-09-12T18:09:15.148505+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":300,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:53:56.436440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2094,"num_read_kb":1953,"num_write":504,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"263'237","reported_seq":881,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:04.874429+0000","last_change":"2024-09-12T17:10:42.526128+0000","last_active":"2024-09-12T18:09:04.874429+0000","last_peered":"2024-09-12T18:09:04.874429+0000","last_clean":"2024-09-12T18:09:04.874429+0000","last_became_active":"2024-09-12T17:10:42.521435+0000","last_became_peered":"2024-09-12T17:10:42.521435+0000","last_unstale":"2024-09-12T18:09:04.874429+0000","last_undegraded":"2024-09-12T18:09:04.874429+0000","last_fullsized":"2024-09-12T18:09:04.874429+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":200,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:05:09.412034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4231758,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":523,"num_read_kb":7759,"num_write":1102,"num_write_kb":27695,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,5],"acting":[6,0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"263'492","reported_seq":2208,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:15.148484+0000","last_change":"2024-09-12T17:10:44.519546+0000","last_active":"2024-09-12T18:09:15.148484+0000","last_peered":"2024-09-12T18:09:15.148484+0000","last_clean":"2024-09-12T18:09:15.148484+0000","last_became_active":"2024-09-12T17:10:44.519236+0000","last_became_peered":"2024-09-12T17:10:44.519236+0000","last_unstale":"2024-09-12T18:09:15.148484+0000","last_undegraded":"2024-09-12T18:09:15.148484+0000","last_fullsized":"2024-09-12T18:09:15.148484+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":400,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:12:02.063964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2628,"num_read_kb":2506,"num_write":587,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"263'252","reported_seq":1016,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:04.837434+0000","last_change":"2024-09-12T17:10:42.519763+0000","last_active":"2024-09-12T18:09:04.837434+0000","last_peered":"2024-09-12T18:09:04.837434+0000","last_clean":"2024-09-12T18:09:04.837434+0000","last_became_active":"2024-09-12T17:10:42.519178+0000","last_became_peered":"2024-09-12T17:10:42.519178+0000","last_unstale":"2024-09-12T18:09:04.837434+0000","last_undegraded":"2024-09-12T18:09:04.837434+0000","last_fullsized":"2024-09-12T18:09:04.837434+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:08:25.057371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":93177,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1047,"num_read_kb":7502,"num_write":1180,"num_write_kb":38848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6,7],"acting":[2,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"263'391","reported_seq":1968,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:08.688478+0000","last_change":"2024-09-12T17:10:44.515755+0000","last_active":"2024-09-12T18:11:08.688478+0000","last_peered":"2024-09-12T18:11:08.688478+0000","last_clean":"2024-09-12T18:11:08.688478+0000","last_became_active":"2024-09-12T17:10:44.515474+0000","last_became_peered":"2024-09-12T17:10:44.515474+0000","last_unstale":"2024-09-12T18:11:08.688478+0000","last_undegraded":"2024-09-12T18:11:08.688478+0000","last_fullsized":"2024-09-12T18:11:08.688478+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":300,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:30:06.533570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2306,"num_read_kb":2212,"num_write":451,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"263'192","reported_seq":810,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:34.828005+0000","last_change":"2024-09-12T17:11:16.618040+0000","last_active":"2024-09-12T18:07:34.828005+0000","last_peered":"2024-09-12T18:07:34.828005+0000","last_clean":"2024-09-12T18:07:34.828005+0000","last_became_active":"2024-09-12T17:11:16.617657+0000","last_became_peered":"2024-09-12T17:11:16.617657+0000","last_unstale":"2024-09-12T18:07:34.828005+0000","last_undegraded":"2024-09-12T18:07:34.828005+0000","last_fullsized":"2024-09-12T18:07:34.828005+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:38:48.774645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7665656,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":497,"num_read_kb":26759,"num_write":945,"num_write_kb":25619,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,6],"acting":[2,3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"263'792","reported_seq":2412,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:48.687914+0000","last_change":"2024-09-12T17:10:44.510114+0000","last_active":"2024-09-12T18:09:48.687914+0000","last_peered":"2024-09-12T18:09:48.687914+0000","last_clean":"2024-09-12T18:09:48.687914+0000","last_became_active":"2024-09-12T17:10:44.509845+0000","last_became_peered":"2024-09-12T17:10:44.509845+0000","last_unstale":"2024-09-12T18:09:48.687914+0000","last_undegraded":"2024-09-12T18:09:48.687914+0000","last_fullsized":"2024-09-12T18:09:48.687914+0000","mapping_epoch":26,"log_start":"263'700","ondisk_log_start":"263'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":700,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:49:56.008647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3882,"num_read_kb":3524,"num_write":1030,"num_write_kb":369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"263'222","reported_seq":853,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:14.844465+0000","last_change":"2024-09-12T17:10:42.519992+0000","last_active":"2024-09-12T18:09:14.844465+0000","last_peered":"2024-09-12T18:09:14.844465+0000","last_clean":"2024-09-12T18:09:14.844465+0000","last_became_active":"2024-09-12T17:10:42.519560+0000","last_became_peered":"2024-09-12T17:10:42.519560+0000","last_unstale":"2024-09-12T18:09:14.844465+0000","last_undegraded":"2024-09-12T18:09:14.844465+0000","last_fullsized":"2024-09-12T18:09:14.844465+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:31:06.232228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":497465,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":415,"num_read_kb":2141,"num_write":1021,"num_write_kb":23963,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,1],"acting":[0,3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"263'769","reported_seq":2442,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:19.853137+0000","last_change":"2024-09-12T17:10:44.512192+0000","last_active":"2024-09-12T18:09:19.853137+0000","last_peered":"2024-09-12T18:09:19.853137+0000","last_clean":"2024-09-12T18:09:19.853137+0000","last_became_active":"2024-09-12T17:10:44.511893+0000","last_became_peered":"2024-09-12T17:10:44.511893+0000","last_unstale":"2024-09-12T18:09:19.853137+0000","last_undegraded":"2024-09-12T18:09:19.853137+0000","last_fullsized":"2024-09-12T18:09:19.853137+0000","mapping_epoch":26,"log_start":"263'700","ondisk_log_start":"263'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":700,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:59:22.759342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":3826,"num_read_kb":3490,"num_write":982,"num_write_kb":336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"263'217","reported_seq":1062,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:32.660243+0000","last_change":"2024-09-12T17:10:42.524423+0000","last_active":"2024-09-12T18:09:32.660243+0000","last_peered":"2024-09-12T18:09:32.660243+0000","last_clean":"2024-09-12T18:09:32.660243+0000","last_became_active":"2024-09-12T17:10:42.524018+0000","last_became_peered":"2024-09-12T17:10:42.524018+0000","last_unstale":"2024-09-12T18:09:32.660243+0000","last_undegraded":"2024-09-12T18:09:32.660243+0000","last_fullsized":"2024-09-12T18:09:32.660243+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:08:56.591768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12496189,"num_objects":13,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":1292,"num_read_kb":150766,"num_write":982,"num_write_kb":42134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0,7],"acting":[3,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"263'524","reported_seq":2019,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:04.854464+0000","last_change":"2024-09-12T17:10:44.509706+0000","last_active":"2024-09-12T18:09:04.854464+0000","last_peered":"2024-09-12T18:09:04.854464+0000","last_clean":"2024-09-12T18:09:04.854464+0000","last_became_active":"2024-09-12T17:10:44.509433+0000","last_became_peered":"2024-09-12T17:10:44.509433+0000","last_unstale":"2024-09-12T18:09:04.854464+0000","last_undegraded":"2024-09-12T18:09:04.854464+0000","last_fullsized":"2024-09-12T18:09:04.854464+0000","mapping_epoch":26,"log_start":"263'500","ondisk_log_start":"263'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":500,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:43:58.521596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2637,"num_read_kb":2409,"num_write":664,"num_write_kb":195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"263'177","reported_seq":837,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:15.148464+0000","last_change":"2024-09-12T17:10:42.515059+0000","last_active":"2024-09-12T18:09:15.148464+0000","last_peered":"2024-09-12T18:09:15.148464+0000","last_clean":"2024-09-12T18:09:15.148464+0000","last_became_active":"2024-09-12T17:10:42.514593+0000","last_became_peered":"2024-09-12T17:10:42.514593+0000","last_unstale":"2024-09-12T18:09:15.148464+0000","last_undegraded":"2024-09-12T18:09:15.148464+0000","last_fullsized":"2024-09-12T18:09:15.148464+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:42:35.824857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5511218,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":481,"num_read_kb":20980,"num_write":840,"num_write_kb":34024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,5],"acting":[1,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"263'1124","reported_seq":2692,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:08.688159+0000","last_change":"2024-09-12T17:10:44.523190+0000","last_active":"2024-09-12T18:11:08.688159+0000","last_peered":"2024-09-12T18:11:08.688159+0000","last_clean":"2024-09-12T18:11:08.688159+0000","last_became_active":"2024-09-12T17:10:44.522911+0000","last_became_peered":"2024-09-12T17:10:44.522911+0000","last_unstale":"2024-09-12T18:11:08.688159+0000","last_undegraded":"2024-09-12T18:11:08.688159+0000","last_fullsized":"2024-09-12T18:11:08.688159+0000","mapping_epoch":26,"log_start":"263'1100","ondisk_log_start":"263'1100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":1100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:09:01.732616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5182,"num_read_kb":4601,"num_write":1539,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"263'192","reported_seq":838,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:14.876120+0000","last_change":"2024-09-12T17:10:42.525103+0000","last_active":"2024-09-12T18:09:14.876120+0000","last_peered":"2024-09-12T18:09:14.876120+0000","last_clean":"2024-09-12T18:09:14.876120+0000","last_became_active":"2024-09-12T17:10:42.520304+0000","last_became_peered":"2024-09-12T17:10:42.520304+0000","last_unstale":"2024-09-12T18:09:14.876120+0000","last_undegraded":"2024-09-12T18:09:14.876120+0000","last_fullsized":"2024-09-12T18:09:14.876120+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:45:02.245757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1376916,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":491,"num_read_kb":8074,"num_write":950,"num_write_kb":20454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4,5],"acting":[6,7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"263'882","reported_seq":2582,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:04.874441+0000","last_change":"2024-09-12T17:10:44.518118+0000","last_active":"2024-09-12T18:09:04.874441+0000","last_peered":"2024-09-12T18:09:04.874441+0000","last_clean":"2024-09-12T18:09:04.874441+0000","last_became_active":"2024-09-12T17:10:44.517530+0000","last_became_peered":"2024-09-12T17:10:44.517530+0000","last_unstale":"2024-09-12T18:09:04.874441+0000","last_undegraded":"2024-09-12T18:09:04.874441+0000","last_fullsized":"2024-09-12T18:09:04.874441+0000","mapping_epoch":26,"log_start":"263'800","ondisk_log_start":"263'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":800,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:43:44.156580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4395,"num_read_kb":3967,"num_write":1219,"num_write_kb":499,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"263'182","reported_seq":803,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:32.300512+0000","last_change":"2024-09-12T17:10:42.529286+0000","last_active":"2024-09-12T18:09:32.300512+0000","last_peered":"2024-09-12T18:09:32.300512+0000","last_clean":"2024-09-12T18:09:32.300512+0000","last_became_active":"2024-09-12T17:10:42.528899+0000","last_became_peered":"2024-09-12T17:10:42.528899+0000","last_unstale":"2024-09-12T18:09:32.300512+0000","last_undegraded":"2024-09-12T18:09:32.300512+0000","last_fullsized":"2024-09-12T18:09:32.300512+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:26:02.984559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12665800,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":384,"num_read_kb":42419,"num_write":864,"num_write_kb":46548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,5],"acting":[3,4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"263'385","reported_seq":1841,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:49.548319+0000","last_change":"2024-09-12T17:10:44.523470+0000","last_active":"2024-09-12T18:09:49.548319+0000","last_peered":"2024-09-12T18:09:49.548319+0000","last_clean":"2024-09-12T18:09:49.548319+0000","last_became_active":"2024-09-12T17:10:44.523173+0000","last_became_peered":"2024-09-12T17:10:44.523173+0000","last_unstale":"2024-09-12T18:09:49.548319+0000","last_undegraded":"2024-09-12T18:09:49.548319+0000","last_fullsized":"2024-09-12T18:09:49.548319+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":300,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:42:05.823212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2006,"num_read_kb":1913,"num_write":441,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"263'147","reported_seq":841,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:29.858956+0000","last_change":"2024-09-12T17:10:42.522274+0000","last_active":"2024-09-12T18:09:29.858956+0000","last_peered":"2024-09-12T18:09:29.858956+0000","last_clean":"2024-09-12T18:09:29.858956+0000","last_became_active":"2024-09-12T17:10:42.521824+0000","last_became_peered":"2024-09-12T17:10:42.521824+0000","last_unstale":"2024-09-12T18:09:29.858956+0000","last_undegraded":"2024-09-12T18:09:29.858956+0000","last_fullsized":"2024-09-12T18:09:29.858956+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:16:48.589688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6314985,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":602,"num_read_kb":135941,"num_write":771,"num_write_kb":15017,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"263'497","reported_seq":2137,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:04.854605+0000","last_change":"2024-09-12T17:10:44.517504+0000","last_active":"2024-09-12T18:09:04.854605+0000","last_peered":"2024-09-12T18:09:04.854605+0000","last_clean":"2024-09-12T18:09:04.854605+0000","last_became_active":"2024-09-12T17:10:44.517175+0000","last_became_peered":"2024-09-12T17:10:44.517175+0000","last_unstale":"2024-09-12T18:09:04.854605+0000","last_undegraded":"2024-09-12T18:09:04.854605+0000","last_fullsized":"2024-09-12T18:09:04.854605+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":400,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:08:58.263083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2646,"num_read_kb":2487,"num_write":582,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"263'171","reported_seq":785,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:14.852332+0000","last_change":"2024-09-12T17:10:42.525302+0000","last_active":"2024-09-12T18:09:14.852332+0000","last_peered":"2024-09-12T18:09:14.852332+0000","last_clean":"2024-09-12T18:09:14.852332+0000","last_became_active":"2024-09-12T17:10:42.524860+0000","last_became_peered":"2024-09-12T17:10:42.524860+0000","last_unstale":"2024-09-12T18:09:14.852332+0000","last_undegraded":"2024-09-12T18:09:14.852332+0000","last_fullsized":"2024-09-12T18:09:14.852332+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":100,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:46:29.731094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":409,"num_read_kb":436,"num_write":844,"num_write_kb":16042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,1],"acting":[3,4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"263'738","reported_seq":2312,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:49.547357+0000","last_change":"2024-09-12T17:10:44.515129+0000","last_active":"2024-09-12T18:09:49.547357+0000","last_peered":"2024-09-12T18:09:49.547357+0000","last_clean":"2024-09-12T18:09:49.547357+0000","last_became_active":"2024-09-12T17:10:44.514847+0000","last_became_peered":"2024-09-12T17:10:44.514847+0000","last_unstale":"2024-09-12T18:09:49.547357+0000","last_undegraded":"2024-09-12T18:09:49.547357+0000","last_fullsized":"2024-09-12T18:09:49.547357+0000","mapping_epoch":26,"log_start":"263'700","ondisk_log_start":"263'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":700,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:19:38.676107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3592,"num_read_kb":3279,"num_write":969,"num_write_kb":334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"263'228","reported_seq":885,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:14.855205+0000","last_change":"2024-09-12T17:10:42.520188+0000","last_active":"2024-09-12T18:09:14.855205+0000","last_peered":"2024-09-12T18:09:14.855205+0000","last_clean":"2024-09-12T18:09:14.855205+0000","last_became_active":"2024-09-12T17:10:42.519789+0000","last_became_peered":"2024-09-12T17:10:42.519789+0000","last_unstale":"2024-09-12T18:09:14.855205+0000","last_undegraded":"2024-09-12T18:09:14.855205+0000","last_fullsized":"2024-09-12T18:09:14.855205+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":200,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:18:08.752971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6373233,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":561,"num_read_kb":21140,"num_write":1102,"num_write_kb":33501,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,3],"acting":[5,7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"263'451","reported_seq":1945,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:49.546842+0000","last_change":"2024-09-12T17:10:44.512379+0000","last_active":"2024-09-12T18:09:49.546842+0000","last_peered":"2024-09-12T18:09:49.546842+0000","last_clean":"2024-09-12T18:09:49.546842+0000","last_became_active":"2024-09-12T17:10:44.510280+0000","last_became_peered":"2024-09-12T17:10:44.510280+0000","last_unstale":"2024-09-12T18:09:49.546842+0000","last_undegraded":"2024-09-12T18:09:49.546842+0000","last_fullsized":"2024-09-12T18:09:49.546842+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":400,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:12:26.413167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2351,"num_read_kb":2195,"num_write":554,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"263'148","reported_seq":746,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:14.844500+0000","last_change":"2024-09-12T17:10:42.521419+0000","last_active":"2024-09-12T18:09:14.844500+0000","last_peered":"2024-09-12T18:09:14.844500+0000","last_clean":"2024-09-12T18:09:14.844500+0000","last_became_active":"2024-09-12T17:10:42.520020+0000","last_became_peered":"2024-09-12T17:10:42.520020+0000","last_unstale":"2024-09-12T18:09:14.844500+0000","last_undegraded":"2024-09-12T18:09:14.844500+0000","last_fullsized":"2024-09-12T18:09:14.844500+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:41:55.197067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5664710,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":326,"num_read_kb":1191,"num_write":745,"num_write_kb":23442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,6],"acting":[0,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"263'357","reported_seq":1770,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:49.547933+0000","last_change":"2024-09-12T17:10:44.516984+0000","last_active":"2024-09-12T18:09:49.547933+0000","last_peered":"2024-09-12T18:09:49.547933+0000","last_clean":"2024-09-12T18:09:49.547933+0000","last_became_active":"2024-09-12T17:10:44.516697+0000","last_became_peered":"2024-09-12T17:10:44.516697+0000","last_unstale":"2024-09-12T18:09:49.547933+0000","last_undegraded":"2024-09-12T18:09:49.547933+0000","last_fullsized":"2024-09-12T18:09:49.547933+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:36:09.173783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1919,"num_read_kb":1833,"num_write":391,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"263'207","reported_seq":867,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:34.828036+0000","last_change":"2024-09-12T17:11:16.863226+0000","last_active":"2024-09-12T18:07:34.828036+0000","last_peered":"2024-09-12T18:07:34.828036+0000","last_clean":"2024-09-12T18:07:34.828036+0000","last_became_active":"2024-09-12T17:11:16.862645+0000","last_became_peered":"2024-09-12T17:11:16.862645+0000","last_unstale":"2024-09-12T18:07:34.828036+0000","last_undegraded":"2024-09-12T18:07:34.828036+0000","last_fullsized":"2024-09-12T18:07:34.828036+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:47:44.135027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5606243,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":575,"num_read_kb":84325,"num_write":973,"num_write_kb":27874,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,0,7],"acting":[2,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"263'818","reported_seq":2282,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:14.844433+0000","last_change":"2024-09-12T17:10:44.519568+0000","last_active":"2024-09-12T18:09:14.844433+0000","last_peered":"2024-09-12T18:09:14.844433+0000","last_clean":"2024-09-12T18:09:14.844433+0000","last_became_active":"2024-09-12T17:10:44.519253+0000","last_became_peered":"2024-09-12T17:10:44.519253+0000","last_unstale":"2024-09-12T18:09:14.844433+0000","last_undegraded":"2024-09-12T18:09:14.844433+0000","last_fullsized":"2024-09-12T18:09:14.844433+0000","mapping_epoch":26,"log_start":"263'800","ondisk_log_start":"263'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":800,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:17:25.711902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3866,"num_read_kb":3440,"num_write":1124,"num_write_kb":450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"263'180","reported_seq":788,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:24.858062+0000","last_change":"2024-09-12T17:10:42.524574+0000","last_active":"2024-09-12T18:09:24.858062+0000","last_peered":"2024-09-12T18:09:24.858062+0000","last_clean":"2024-09-12T18:09:24.858062+0000","last_became_active":"2024-09-12T17:10:42.524098+0000","last_became_peered":"2024-09-12T17:10:42.524098+0000","last_unstale":"2024-09-12T18:09:24.858062+0000","last_undegraded":"2024-09-12T18:09:24.858062+0000","last_fullsized":"2024-09-12T18:09:24.858062+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:13:35.032725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5270092,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":368,"num_read_kb":5543,"num_write":828,"num_write_kb":19602,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6,3],"acting":[7,2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"263'416","reported_seq":2003,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:20.794247+0000","last_change":"2024-09-12T17:10:44.515468+0000","last_active":"2024-09-12T18:09:20.794247+0000","last_peered":"2024-09-12T18:09:20.794247+0000","last_clean":"2024-09-12T18:09:20.794247+0000","last_became_active":"2024-09-12T17:10:44.514154+0000","last_became_peered":"2024-09-12T17:10:44.514154+0000","last_unstale":"2024-09-12T18:09:20.794247+0000","last_undegraded":"2024-09-12T18:09:20.794247+0000","last_fullsized":"2024-09-12T18:09:20.794247+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":400,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:10:07.030810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2340,"num_read_kb":2233,"num_write":478,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"263'219","reported_seq":838,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:05.578638+0000","last_change":"2024-09-12T17:10:42.519764+0000","last_active":"2024-09-12T18:09:05.578638+0000","last_peered":"2024-09-12T18:09:05.578638+0000","last_clean":"2024-09-12T18:09:05.578638+0000","last_became_active":"2024-09-12T17:10:42.519316+0000","last_became_peered":"2024-09-12T17:10:42.519316+0000","last_unstale":"2024-09-12T18:09:05.578638+0000","last_undegraded":"2024-09-12T18:09:05.578638+0000","last_fullsized":"2024-09-12T18:09:05.578638+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:10:02.857764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5965451,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":501,"num_read_kb":7212,"num_write":958,"num_write_kb":24573,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1,7],"acting":[2,6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"263'434","reported_seq":2034,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:08.687986+0000","last_change":"2024-09-12T17:10:44.513885+0000","last_active":"2024-09-12T18:11:08.687986+0000","last_peered":"2024-09-12T18:11:08.687986+0000","last_clean":"2024-09-12T18:11:08.687986+0000","last_became_active":"2024-09-12T17:10:44.513514+0000","last_became_peered":"2024-09-12T17:10:44.513514+0000","last_unstale":"2024-09-12T18:11:08.687986+0000","last_undegraded":"2024-09-12T18:11:08.687986+0000","last_fullsized":"2024-09-12T18:11:08.687986+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":400,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:13:21.567231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2337,"num_read_kb":2234,"num_write":490,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"263'143","reported_seq":759,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:04.853823+0000","last_change":"2024-09-12T17:10:42.527461+0000","last_active":"2024-09-12T18:09:04.853823+0000","last_peered":"2024-09-12T18:09:04.853823+0000","last_clean":"2024-09-12T18:09:04.853823+0000","last_became_active":"2024-09-12T17:10:42.527050+0000","last_became_peered":"2024-09-12T17:10:42.527050+0000","last_unstale":"2024-09-12T18:09:04.853823+0000","last_undegraded":"2024-09-12T18:09:04.853823+0000","last_fullsized":"2024-09-12T18:09:04.853823+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:48:18.827396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7398100,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":318,"num_read_kb":34406,"num_write":729,"num_write_kb":29438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4,6],"acting":[5,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"263'191","reported_seq":828,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:04.853681+0000","last_change":"2024-09-12T17:10:42.524416+0000","last_active":"2024-09-12T18:09:04.853681+0000","last_peered":"2024-09-12T18:09:04.853681+0000","last_clean":"2024-09-12T18:09:04.853681+0000","last_became_active":"2024-09-12T17:10:42.523311+0000","last_became_peered":"2024-09-12T17:10:42.523311+0000","last_unstale":"2024-09-12T18:09:04.853681+0000","last_undegraded":"2024-09-12T18:09:04.853681+0000","last_fullsized":"2024-09-12T18:09:04.853681+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:26:51.477607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9029807,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":463,"num_read_kb":32297,"num_write":952,"num_write_kb":18657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,7],"acting":[5,1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"263'821","reported_seq":2264,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:20.794810+0000","last_change":"2024-09-12T17:10:44.523554+0000","last_active":"2024-09-12T18:09:20.794810+0000","last_peered":"2024-09-12T18:09:20.794810+0000","last_clean":"2024-09-12T18:09:20.794810+0000","last_became_active":"2024-09-12T17:10:44.523243+0000","last_became_peered":"2024-09-12T17:10:44.523243+0000","last_unstale":"2024-09-12T18:09:20.794810+0000","last_undegraded":"2024-09-12T18:09:20.794810+0000","last_fullsized":"2024-09-12T18:09:20.794810+0000","mapping_epoch":26,"log_start":"263'800","ondisk_log_start":"263'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":800,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:20:39.715953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3977,"num_read_kb":3544,"num_write":1118,"num_write_kb":432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"263'231","reported_seq":876,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:05.147204+0000","last_change":"2024-09-12T17:10:42.520724+0000","last_active":"2024-09-12T18:09:05.147204+0000","last_peered":"2024-09-12T18:09:05.147204+0000","last_clean":"2024-09-12T18:09:05.147204+0000","last_became_active":"2024-09-12T17:10:42.519643+0000","last_became_peered":"2024-09-12T17:10:42.519643+0000","last_unstale":"2024-09-12T18:09:05.147204+0000","last_undegraded":"2024-09-12T18:09:05.147204+0000","last_fullsized":"2024-09-12T18:09:05.147204+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:32:38.227259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16870164,"num_objects":11,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":410,"num_read_kb":42701,"num_write":975,"num_write_kb":42419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5,0],"acting":[1,4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"263'612","reported_seq":2303,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:49.548577+0000","last_change":"2024-09-12T17:10:44.512927+0000","last_active":"2024-09-12T18:09:49.548577+0000","last_peered":"2024-09-12T18:09:49.548577+0000","last_clean":"2024-09-12T18:09:49.548577+0000","last_became_active":"2024-09-12T17:10:44.512488+0000","last_became_peered":"2024-09-12T17:10:44.512488+0000","last_unstale":"2024-09-12T18:09:49.548577+0000","last_undegraded":"2024-09-12T18:09:49.548577+0000","last_fullsized":"2024-09-12T18:09:49.548577+0000","mapping_epoch":26,"log_start":"263'600","ondisk_log_start":"263'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":600,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:26:47.580747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3240,"num_read_kb":2966,"num_write":800,"num_write_kb":244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6085,"num_read_kb":4263,"num_write":1964,"num_write_kb":863,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1035,"ondisk_log_size":1035,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15869,"num_objects":86,"num_object_clones":0,"num_object_copies":172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":86,"num_whiteouts":0,"num_read":16199,"num_read_kb":15883,"num_write":16708,"num_write_kb":4876,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":31738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1652,"ondisk_log_size":1652,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":546,"ondisk_log_size":546,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":361433,"num_objects":199,"num_object_clones":0,"num_object_copies":398,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":199,"num_whiteouts":0,"num_read":8534,"num_read_kb":10169,"num_write":5927,"num_write_kb":2764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":679936,"data_stored":186332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1924,"ondisk_log_size":1924,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2383,"num_read_kb":2845,"num_write":20,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":165,"num_object_clones":0,"num_object_copies":330,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":165,"num_whiteouts":0,"num_read":212965,"num_read_kb":194286,"num_write":55441,"num_write_kb":18926,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":165,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4199,"ondisk_log_size":4199,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":451889251,"num_objects":466,"num_object_clones":0,"num_object_copies":1864,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":466,"num_whiteouts":0,"num_read":32822,"num_read_kb":2020284,"num_write":62577,"num_write_kb":2063190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":607125504,"data_stored":607125504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4003,"ondisk_log_size":4003,"up":256,"acting":256,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":74503726,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":122,"num_read_kb":196715,"num_write":139,"num_write_kb":127071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":149012480,"data_stored":149007452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":74503726,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":118,"num_read_kb":189543,"num_write":139,"num_write_kb":127071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":149012480,"data_stored":149007452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575589,"num_pgs":116,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":329772,"kb_used_data":87580,"kb_used_omap":1,"kb_used_meta":242174,"kb_avail":94042068,"statfs":{"total":96636764160,"available":96299077632,"internally_reserved":0,"allocated":89681920,"data_stored":87641193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":247986635},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575587,"num_pgs":107,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":345608,"kb_used_data":111736,"kb_used_omap":1,"kb_used_meta":233854,"kb_avail":94026232,"statfs":{"total":96636764160,"available":96282861568,"internally_reserved":0,"allocated":114417664,"data_stored":112452529,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":239466950},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575592,"num_pgs":113,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":206216,"kb_used_data":98680,"kb_used_omap":1,"kb_used_meta":107518,"kb_avail":94165624,"statfs":{"total":96636764160,"available":96425598976,"internally_reserved":0,"allocated":101048320,"data_stored":98974813,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":110098885},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575587,"num_pgs":113,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":217280,"kb_used_data":105584,"kb_used_omap":1,"kb_used_meta":111678,"kb_avail":94154560,"statfs":{"total":96636764160,"available":96414269440,"internally_reserved":0,"allocated":108118016,"data_stored":106180950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":114358725},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575589,"num_pgs":130,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":383128,"kb_used_data":145096,"kb_used_omap":1,"kb_used_meta":238014,"kb_avail":93988712,"statfs":{"total":96636764160,"available":96244441088,"internally_reserved":0,"allocated":148578304,"data_stored":146564735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":243726791},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575589,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":204752,"kb_used_data":115264,"kb_used_omap":1,"kb_used_meta":89470,"kb_avail":94167088,"statfs":{"total":96636764160,"available":96427098112,"internally_reserved":0,"allocated":118030336,"data_stored":116093919,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":91617733},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575587,"num_pgs":120,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":280016,"kb_used_data":132288,"kb_used_omap":1,"kb_used_meta":147710,"kb_avail":94091824,"statfs":{"total":96636764160,"available":96350027776,"internally_reserved":0,"allocated":135462912,"data_stored":133462601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":151255493},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575587,"num_pgs":116,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":356172,"kb_used_data":122300,"kb_used_omap":1,"kb_used_meta":233854,"kb_avail":94015668,"statfs":{"total":96636764160,"available":96272044032,"internally_reserved":0,"allocated":125235200,"data_stored":123232330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":239466949},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":80457728,"data_stored":80457728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":90275840,"data_stored":90275840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":66637824,"data_stored":66637824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":77160448,"data_stored":77160448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":70307840,"data_stored":70307840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":77750272,"data_stored":77750272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":68227072,"data_stored":68227072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":76308480,"data_stored":76308480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":24849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":25235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":8663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":27561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":5553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":135168,"data_stored":39032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":18055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":139264,"data_stored":37384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":4345,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":5119,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":3919,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":4996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3623,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":3527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":17879040,"data_stored":17877415,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":37748736,"data_stored":37748736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16777216,"data_stored":16777216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":14684160,"data_stored":14683271,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":18874368,"data_stored":18874368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":13680640,"data_stored":13679901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20975616,"data_stored":20974730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8392704,"data_stored":8391815,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":22020096,"data_stored":22020096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":3149824,"data_stored":3148938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":30408704,"data_stored":30408704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":52432896,"data_stored":52432007,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":14733312,"data_stored":14731687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20971520,"data_stored":20971520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":51620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T18:11:41.834 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T18:11:42.185 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T18:11:42.196 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-09-12T18:11:42.199 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":2094,"stamp":"2024-09-12T18:11:40.608769+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":601866185,"num_objects":980,"num_object_clones":0,"num_object_copies":2892,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":980,"num_whiteouts":0,"num_read":279306,"num_read_kb":2634055,"num_write":143036,"num_write_kb":2346416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":212,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13609,"ondisk_log_size":13609,"up":914,"acting":914,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":914,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2322944,"kb_used_data":918528,"kb_used_omap":12,"kb_used_meta":1404275,"kb_avail":752651776,"statfs":{"total":773094113280,"available":770715418624,"internally_reserved":0,"allocated":940572672,"data_stored":924603070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":1437978161},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005050"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":22,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:06:59.835776+0000","last_change":"2024-09-12T17:46:57.082723+0000","last_active":"2024-09-12T18:06:59.835776+0000","last_peered":"2024-09-12T18:06:59.835776+0000","last_clean":"2024-09-12T18:06:59.835776+0000","last_became_active":"2024-09-12T17:46:57.082400+0000","last_became_peered":"2024-09-12T17:46:57.082400+0000","last_unstale":"2024-09-12T18:06:59.835776+0000","last_undegraded":"2024-09-12T18:06:59.835776+0000","last_fullsized":"2024-09-12T18:06:59.835776+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:49:21.685677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"0'0","reported_seq":39,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:49.843582+0000","last_change":"2024-09-12T17:30:16.683362+0000","last_active":"2024-09-12T18:07:49.843582+0000","last_peered":"2024-09-12T18:07:49.843582+0000","last_clean":"2024-09-12T18:07:49.843582+0000","last_became_active":"2024-09-12T17:30:16.683077+0000","last_became_peered":"2024-09-12T17:30:16.683077+0000","last_unstale":"2024-09-12T18:07:49.843582+0000","last_undegraded":"2024-09-12T18:07:49.843582+0000","last_fullsized":"2024-09-12T18:07:49.843582+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:50:52.313225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"260'3","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:44.841978+0000","last_change":"2024-09-12T17:30:12.651734+0000","last_active":"2024-09-12T18:07:44.841978+0000","last_peered":"2024-09-12T18:07:44.841978+0000","last_clean":"2024-09-12T18:07:44.841978+0000","last_became_active":"2024-09-12T17:30:12.651461+0000","last_became_peered":"2024-09-12T17:30:12.651461+0000","last_unstale":"2024-09-12T18:07:44.841978+0000","last_undegraded":"2024-09-12T18:07:44.841978+0000","last_fullsized":"2024-09-12T18:07:44.841978+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:51:09.744341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"263'28","reported_seq":134,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:14.837079+0000","last_change":"2024-09-12T17:26:35.669600+0000","last_active":"2024-09-12T18:08:14.837079+0000","last_peered":"2024-09-12T18:08:14.837079+0000","last_clean":"2024-09-12T18:08:14.837079+0000","last_became_active":"2024-09-12T17:26:35.669154+0000","last_became_peered":"2024-09-12T17:26:35.669154+0000","last_unstale":"2024-09-12T18:08:14.837079+0000","last_undegraded":"2024-09-12T18:08:14.837079+0000","last_fullsized":"2024-09-12T18:08:14.837079+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:56:13.407121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":150,"num_read_kb":108,"num_write":46,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":22,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:06:59.822536+0000","last_change":"2024-09-12T17:46:57.096775+0000","last_active":"2024-09-12T18:06:59.822536+0000","last_peered":"2024-09-12T18:06:59.822536+0000","last_clean":"2024-09-12T18:06:59.822536+0000","last_became_active":"2024-09-12T17:46:57.096462+0000","last_became_peered":"2024-09-12T17:46:57.096462+0000","last_unstale":"2024-09-12T18:06:59.822536+0000","last_undegraded":"2024-09-12T18:06:59.822536+0000","last_fullsized":"2024-09-12T18:06:59.822536+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:09:53.229550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"263'8","reported_seq":61,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:49.844250+0000","last_change":"2024-09-12T17:30:16.675262+0000","last_active":"2024-09-12T18:07:49.844250+0000","last_peered":"2024-09-12T18:07:49.844250+0000","last_clean":"2024-09-12T18:07:49.844250+0000","last_became_active":"2024-09-12T17:30:16.674952+0000","last_became_peered":"2024-09-12T17:30:16.674952+0000","last_unstale":"2024-09-12T18:07:49.844250+0000","last_undegraded":"2024-09-12T18:07:49.844250+0000","last_fullsized":"2024-09-12T18:07:49.844250+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:17:48.380471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":30722,"num_write":8,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"263'2","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:45.138583+0000","last_change":"2024-09-12T17:30:12.645927+0000","last_active":"2024-09-12T18:07:45.138583+0000","last_peered":"2024-09-12T18:07:45.138583+0000","last_clean":"2024-09-12T18:07:45.138583+0000","last_became_active":"2024-09-12T17:30:12.645624+0000","last_became_peered":"2024-09-12T17:30:12.645624+0000","last_unstale":"2024-09-12T18:07:45.138583+0000","last_undegraded":"2024-09-12T18:07:45.138583+0000","last_fullsized":"2024-09-12T18:07:45.138583+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:07:42.933168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":10240,"num_write":7,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"263'13","reported_seq":88,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:44.835410+0000","last_change":"2024-09-12T17:26:35.660411+0000","last_active":"2024-09-12T18:08:44.835410+0000","last_peered":"2024-09-12T18:08:44.835410+0000","last_clean":"2024-09-12T18:08:44.835410+0000","last_became_active":"2024-09-12T17:26:35.660132+0000","last_became_peered":"2024-09-12T17:26:35.660132+0000","last_unstale":"2024-09-12T18:08:44.835410+0000","last_undegraded":"2024-09-12T18:08:44.835410+0000","last_fullsized":"2024-09-12T18:08:44.835410+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:16:42.286139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":36,"num_write":29,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:44.871662+0000","last_change":"2024-09-12T17:46:57.076529+0000","last_active":"2024-09-12T18:08:44.871662+0000","last_peered":"2024-09-12T18:08:44.871662+0000","last_clean":"2024-09-12T18:08:44.871662+0000","last_became_active":"2024-09-12T17:46:57.076193+0000","last_became_peered":"2024-09-12T17:46:57.076193+0000","last_unstale":"2024-09-12T18:08:44.871662+0000","last_undegraded":"2024-09-12T18:08:44.871662+0000","last_fullsized":"2024-09-12T18:08:44.871662+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:06:10.868648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"260'3","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:49.834420+0000","last_change":"2024-09-12T17:30:16.671182+0000","last_active":"2024-09-12T18:07:49.834420+0000","last_peered":"2024-09-12T18:07:49.834420+0000","last_clean":"2024-09-12T18:07:49.834420+0000","last_became_active":"2024-09-12T17:30:16.670862+0000","last_became_peered":"2024-09-12T17:30:16.670862+0000","last_unstale":"2024-09-12T18:07:49.834420+0000","last_undegraded":"2024-09-12T18:07:49.834420+0000","last_fullsized":"2024-09-12T18:07:49.834420+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:44:16.981394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"263'4","reported_seq":60,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:24.833227+0000","last_change":"2024-09-12T17:30:12.648635+0000","last_active":"2024-09-12T18:08:24.833227+0000","last_peered":"2024-09-12T18:08:24.833227+0000","last_clean":"2024-09-12T18:08:24.833227+0000","last_became_active":"2024-09-12T17:30:12.648349+0000","last_became_peered":"2024-09-12T17:30:12.648349+0000","last_unstale":"2024-09-12T18:08:24.833227+0000","last_undegraded":"2024-09-12T18:08:24.833227+0000","last_fullsized":"2024-09-12T18:08:24.833227+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:34:54.875445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":18432,"num_write":9,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"263'117","reported_seq":422,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:04.843259+0000","last_change":"2024-09-12T17:26:35.664908+0000","last_active":"2024-09-12T18:09:04.843259+0000","last_peered":"2024-09-12T18:09:04.843259+0000","last_clean":"2024-09-12T18:09:04.843259+0000","last_became_active":"2024-09-12T17:26:35.664247+0000","last_became_peered":"2024-09-12T17:26:35.664247+0000","last_unstale":"2024-09-12T18:09:04.843259+0000","last_undegraded":"2024-09-12T18:09:04.843259+0000","last_fullsized":"2024-09-12T18:09:04.843259+0000","mapping_epoch":250,"log_start":"263'100","ondisk_log_start":"263'100","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:39:07.453840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":722,"num_read_kb":504,"num_write":158,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:49.849229+0000","last_change":"2024-09-12T17:46:57.089742+0000","last_active":"2024-09-12T18:08:49.849229+0000","last_peered":"2024-09-12T18:08:49.849229+0000","last_clean":"2024-09-12T18:08:49.849229+0000","last_became_active":"2024-09-12T17:46:57.089385+0000","last_became_peered":"2024-09-12T17:46:57.089385+0000","last_unstale":"2024-09-12T18:08:49.849229+0000","last_undegraded":"2024-09-12T18:08:49.849229+0000","last_fullsized":"2024-09-12T18:08:49.849229+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:17:02.129348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"263'11","reported_seq":68,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:29.847004+0000","last_change":"2024-09-12T17:30:16.682079+0000","last_active":"2024-09-12T18:08:29.847004+0000","last_peered":"2024-09-12T18:08:29.847004+0000","last_clean":"2024-09-12T18:08:29.847004+0000","last_became_active":"2024-09-12T17:30:16.681766+0000","last_became_peered":"2024-09-12T17:30:16.681766+0000","last_unstale":"2024-09-12T18:08:29.847004+0000","last_undegraded":"2024-09-12T18:08:29.847004+0000","last_fullsized":"2024-09-12T18:08:29.847004+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:31:21.167575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17825792,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":17,"num_read_kb":32770,"num_write":21,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"0'0","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:44.843580+0000","last_change":"2024-09-12T17:30:12.648728+0000","last_active":"2024-09-12T18:07:44.843580+0000","last_peered":"2024-09-12T18:07:44.843580+0000","last_clean":"2024-09-12T18:07:44.843580+0000","last_became_active":"2024-09-12T17:30:12.648369+0000","last_became_peered":"2024-09-12T17:30:12.648369+0000","last_unstale":"2024-09-12T18:07:44.843580+0000","last_undegraded":"2024-09-12T18:07:44.843580+0000","last_fullsized":"2024-09-12T18:07:44.843580+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:12:39.564996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"263'110","reported_seq":439,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:04.851030+0000","last_change":"2024-09-12T17:26:35.666024+0000","last_active":"2024-09-12T18:09:04.851030+0000","last_peered":"2024-09-12T18:09:04.851030+0000","last_clean":"2024-09-12T18:09:04.851030+0000","last_became_active":"2024-09-12T17:26:35.665735+0000","last_became_peered":"2024-09-12T17:26:35.665735+0000","last_unstale":"2024-09-12T18:09:04.851030+0000","last_undegraded":"2024-09-12T18:09:04.851030+0000","last_fullsized":"2024-09-12T18:09:04.851030+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:21:58.014213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":761,"num_read_kb":507,"num_write":140,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:04.851052+0000","last_change":"2024-09-12T17:46:57.090107+0000","last_active":"2024-09-12T18:09:04.851052+0000","last_peered":"2024-09-12T18:09:04.851052+0000","last_clean":"2024-09-12T18:09:04.851052+0000","last_became_active":"2024-09-12T17:46:57.089797+0000","last_became_peered":"2024-09-12T17:46:57.089797+0000","last_unstale":"2024-09-12T18:09:04.851052+0000","last_undegraded":"2024-09-12T18:09:04.851052+0000","last_fullsized":"2024-09-12T18:09:04.851052+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:57:58.129729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"263'4","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:14.855171+0000","last_change":"2024-09-12T17:30:16.686091+0000","last_active":"2024-09-12T18:09:14.855171+0000","last_peered":"2024-09-12T18:09:14.855171+0000","last_clean":"2024-09-12T18:09:14.855171+0000","last_became_active":"2024-09-12T17:30:16.685755+0000","last_became_peered":"2024-09-12T17:30:16.685755+0000","last_unstale":"2024-09-12T18:09:14.855171+0000","last_undegraded":"2024-09-12T18:09:14.855171+0000","last_fullsized":"2024-09-12T18:09:14.855171+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:41:14.032884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":16,"num_write":9,"num_write_kb":5136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"0'0","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:54.841851+0000","last_change":"2024-09-12T17:30:12.641329+0000","last_active":"2024-09-12T18:08:54.841851+0000","last_peered":"2024-09-12T18:08:54.841851+0000","last_clean":"2024-09-12T18:08:54.841851+0000","last_became_active":"2024-09-12T17:30:12.640983+0000","last_became_peered":"2024-09-12T17:30:12.640983+0000","last_unstale":"2024-09-12T18:08:54.841851+0000","last_undegraded":"2024-09-12T18:08:54.841851+0000","last_fullsized":"2024-09-12T18:08:54.841851+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:49:02.041715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"263'13","reported_seq":92,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:04.851003+0000","last_change":"2024-09-12T17:26:35.664850+0000","last_active":"2024-09-12T18:09:04.851003+0000","last_peered":"2024-09-12T18:09:04.851003+0000","last_clean":"2024-09-12T18:09:04.851003+0000","last_became_active":"2024-09-12T17:26:35.664517+0000","last_became_peered":"2024-09-12T17:26:35.664517+0000","last_unstale":"2024-09-12T18:09:04.851003+0000","last_undegraded":"2024-09-12T18:09:04.851003+0000","last_fullsized":"2024-09-12T18:09:04.851003+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:47:34.050940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":54,"num_write":23,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:50.139169+0000","last_change":"2024-09-12T17:46:57.091721+0000","last_active":"2024-09-12T18:07:50.139169+0000","last_peered":"2024-09-12T18:07:50.139169+0000","last_clean":"2024-09-12T18:07:50.139169+0000","last_became_active":"2024-09-12T17:46:57.091147+0000","last_became_peered":"2024-09-12T17:46:57.091147+0000","last_unstale":"2024-09-12T18:07:50.139169+0000","last_undegraded":"2024-09-12T18:07:50.139169+0000","last_fullsized":"2024-09-12T18:07:50.139169+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:38:23.889670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"260'5","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:59.873661+0000","last_change":"2024-09-12T17:30:16.684444+0000","last_active":"2024-09-12T18:08:59.873661+0000","last_peered":"2024-09-12T18:08:59.873661+0000","last_clean":"2024-09-12T18:08:59.873661+0000","last_became_active":"2024-09-12T17:30:16.684200+0000","last_became_peered":"2024-09-12T17:30:16.684200+0000","last_unstale":"2024-09-12T18:08:59.873661+0000","last_undegraded":"2024-09-12T18:08:59.873661+0000","last_fullsized":"2024-09-12T18:08:59.873661+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:52:13.212280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"263'1","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:04.854441+0000","last_change":"2024-09-12T17:30:12.640225+0000","last_active":"2024-09-12T18:09:04.854441+0000","last_peered":"2024-09-12T18:09:04.854441+0000","last_clean":"2024-09-12T18:09:04.854441+0000","last_became_active":"2024-09-12T17:30:12.639953+0000","last_became_peered":"2024-09-12T17:30:12.639953+0000","last_unstale":"2024-09-12T18:09:04.854441+0000","last_undegraded":"2024-09-12T18:09:04.854441+0000","last_fullsized":"2024-09-12T18:09:04.854441+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:40:28.022453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":3072,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"263'28","reported_seq":125,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:04.874467+0000","last_change":"2024-09-12T17:26:35.663645+0000","last_active":"2024-09-12T18:09:04.874467+0000","last_peered":"2024-09-12T18:09:04.874467+0000","last_clean":"2024-09-12T18:09:04.874467+0000","last_became_active":"2024-09-12T17:26:35.663339+0000","last_became_peered":"2024-09-12T17:26:35.663339+0000","last_unstale":"2024-09-12T18:09:04.874467+0000","last_undegraded":"2024-09-12T18:09:04.874467+0000","last_fullsized":"2024-09-12T18:09:04.874467+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:33:26.767790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":134,"num_read_kb":91,"num_write":60,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"263'1","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:06:59.836170+0000","last_change":"2024-09-12T17:46:57.088362+0000","last_active":"2024-09-12T18:06:59.836170+0000","last_peered":"2024-09-12T18:06:59.836170+0000","last_clean":"2024-09-12T18:06:59.836170+0000","last_became_active":"2024-09-12T17:46:57.088039+0000","last_became_peered":"2024-09-12T17:46:57.088039+0000","last_unstale":"2024-09-12T18:06:59.836170+0000","last_undegraded":"2024-09-12T18:06:59.836170+0000","last_fullsized":"2024-09-12T18:06:59.836170+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:17:28.745812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"263'6","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:49.864141+0000","last_change":"2024-09-12T17:30:16.672459+0000","last_active":"2024-09-12T18:07:49.864141+0000","last_peered":"2024-09-12T18:07:49.864141+0000","last_clean":"2024-09-12T18:07:49.864141+0000","last_became_active":"2024-09-12T17:30:16.672167+0000","last_became_peered":"2024-09-12T17:30:16.672167+0000","last_unstale":"2024-09-12T18:07:49.864141+0000","last_undegraded":"2024-09-12T18:07:49.864141+0000","last_fullsized":"2024-09-12T18:07:49.864141+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:34:33.089166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11534336,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":8,"num_read_kb":17408,"num_write":16,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"260'5","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:44.843494+0000","last_change":"2024-09-12T17:30:12.644426+0000","last_active":"2024-09-12T18:07:44.843494+0000","last_peered":"2024-09-12T18:07:44.843494+0000","last_clean":"2024-09-12T18:07:44.843494+0000","last_became_active":"2024-09-12T17:30:12.644125+0000","last_became_peered":"2024-09-12T17:30:12.644125+0000","last_unstale":"2024-09-12T18:07:44.843494+0000","last_undegraded":"2024-09-12T18:07:44.843494+0000","last_fullsized":"2024-09-12T18:07:44.843494+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:29:53.974488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"263'38","reported_seq":158,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:44.833618+0000","last_change":"2024-09-12T17:26:35.659571+0000","last_active":"2024-09-12T18:07:44.833618+0000","last_peered":"2024-09-12T18:07:44.833618+0000","last_clean":"2024-09-12T18:07:44.833618+0000","last_became_active":"2024-09-12T17:26:35.659261+0000","last_became_peered":"2024-09-12T17:26:35.659261+0000","last_unstale":"2024-09-12T18:07:44.833618+0000","last_undegraded":"2024-09-12T18:07:44.833618+0000","last_fullsized":"2024-09-12T18:07:44.833618+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:13:24.323445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":196,"num_read_kb":138,"num_write":78,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":22,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:06:59.836253+0000","last_change":"2024-09-12T17:46:57.088279+0000","last_active":"2024-09-12T18:06:59.836253+0000","last_peered":"2024-09-12T18:06:59.836253+0000","last_clean":"2024-09-12T18:06:59.836253+0000","last_became_active":"2024-09-12T17:46:57.087965+0000","last_became_peered":"2024-09-12T17:46:57.087965+0000","last_unstale":"2024-09-12T18:06:59.836253+0000","last_undegraded":"2024-09-12T18:06:59.836253+0000","last_fullsized":"2024-09-12T18:06:59.836253+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:14:09.667084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"263'7","reported_seq":60,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:49.842504+0000","last_change":"2024-09-12T17:30:16.685365+0000","last_active":"2024-09-12T18:07:49.842504+0000","last_peered":"2024-09-12T18:07:49.842504+0000","last_clean":"2024-09-12T18:07:49.842504+0000","last_became_active":"2024-09-12T17:30:16.685054+0000","last_became_peered":"2024-09-12T17:30:16.685054+0000","last_unstale":"2024-09-12T18:07:49.842504+0000","last_undegraded":"2024-09-12T18:07:49.842504+0000","last_fullsized":"2024-09-12T18:07:49.842504+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:42:01.087864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":17,"num_read_kb":30722,"num_write":12,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"263'7","reported_seq":64,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:44.833659+0000","last_change":"2024-09-12T17:30:12.652060+0000","last_active":"2024-09-12T18:07:44.833659+0000","last_peered":"2024-09-12T18:07:44.833659+0000","last_clean":"2024-09-12T18:07:44.833659+0000","last_became_active":"2024-09-12T17:30:12.651780+0000","last_became_peered":"2024-09-12T17:30:12.651780+0000","last_unstale":"2024-09-12T18:07:44.833659+0000","last_undegraded":"2024-09-12T18:07:44.833659+0000","last_fullsized":"2024-09-12T18:07:44.833659+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:20:56.174919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":22530,"num_write":12,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"263'27","reported_seq":128,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:40.137913+0000","last_change":"2024-09-12T17:26:35.665383+0000","last_active":"2024-09-12T18:07:40.137913+0000","last_peered":"2024-09-12T18:07:40.137913+0000","last_clean":"2024-09-12T18:07:40.137913+0000","last_became_active":"2024-09-12T17:26:35.665076+0000","last_became_peered":"2024-09-12T17:26:35.665076+0000","last_unstale":"2024-09-12T18:07:40.137913+0000","last_undegraded":"2024-09-12T18:07:40.137913+0000","last_fullsized":"2024-09-12T18:07:40.137913+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:51:16.783076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":146,"num_read_kb":106,"num_write":38,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:00.140237+0000","last_change":"2024-09-12T17:46:57.077605+0000","last_active":"2024-09-12T18:08:00.140237+0000","last_peered":"2024-09-12T18:08:00.140237+0000","last_clean":"2024-09-12T18:08:00.140237+0000","last_became_active":"2024-09-12T17:46:57.077265+0000","last_became_peered":"2024-09-12T17:46:57.077265+0000","last_unstale":"2024-09-12T18:08:00.140237+0000","last_undegraded":"2024-09-12T18:08:00.140237+0000","last_fullsized":"2024-09-12T18:08:00.140237+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:54:27.754921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"0'0","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:59.850434+0000","last_change":"2024-09-12T17:30:16.684627+0000","last_active":"2024-09-12T18:08:59.850434+0000","last_peered":"2024-09-12T18:08:59.850434+0000","last_clean":"2024-09-12T18:08:59.850434+0000","last_became_active":"2024-09-12T17:30:16.683963+0000","last_became_peered":"2024-09-12T17:30:16.683963+0000","last_unstale":"2024-09-12T18:08:59.850434+0000","last_undegraded":"2024-09-12T18:08:59.850434+0000","last_fullsized":"2024-09-12T18:08:59.850434+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:56:37.344964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"263'7","reported_seq":65,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:49.843543+0000","last_change":"2024-09-12T17:30:12.643034+0000","last_active":"2024-09-12T18:07:49.843543+0000","last_peered":"2024-09-12T18:07:49.843543+0000","last_clean":"2024-09-12T18:07:49.843543+0000","last_became_active":"2024-09-12T17:30:12.642687+0000","last_became_peered":"2024-09-12T17:30:12.642687+0000","last_unstale":"2024-09-12T18:07:49.843543+0000","last_undegraded":"2024-09-12T18:07:49.843543+0000","last_fullsized":"2024-09-12T18:07:49.843543+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:06:07.203968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":26626,"num_write":12,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"263'39","reported_seq":160,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:39.833155+0000","last_change":"2024-09-12T17:26:35.668713+0000","last_active":"2024-09-12T18:07:39.833155+0000","last_peered":"2024-09-12T18:07:39.833155+0000","last_clean":"2024-09-12T18:07:39.833155+0000","last_became_active":"2024-09-12T17:26:35.668286+0000","last_became_peered":"2024-09-12T17:26:35.668286+0000","last_unstale":"2024-09-12T18:07:39.833155+0000","last_undegraded":"2024-09-12T18:07:39.833155+0000","last_fullsized":"2024-09-12T18:07:39.833155+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:20:43.354325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":202,"num_read_kb":143,"num_write":74,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"263'1","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:59.830606+0000","last_change":"2024-09-12T17:46:57.091097+0000","last_active":"2024-09-12T18:07:59.830606+0000","last_peered":"2024-09-12T18:07:59.830606+0000","last_clean":"2024-09-12T18:07:59.830606+0000","last_became_active":"2024-09-12T17:46:57.088919+0000","last_became_peered":"2024-09-12T17:46:57.088919+0000","last_unstale":"2024-09-12T18:07:59.830606+0000","last_undegraded":"2024-09-12T18:07:59.830606+0000","last_fullsized":"2024-09-12T18:07:59.830606+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:56:55.289350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"0'0","reported_seq":34,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:44.840586+0000","last_change":"2024-09-12T17:31:18.237102+0000","last_active":"2024-09-12T18:08:44.840586+0000","last_peered":"2024-09-12T18:08:44.840586+0000","last_clean":"2024-09-12T18:08:44.840586+0000","last_became_active":"2024-09-12T17:31:18.236640+0000","last_became_peered":"2024-09-12T17:31:18.236640+0000","last_unstale":"2024-09-12T18:08:44.840586+0000","last_undegraded":"2024-09-12T18:08:44.840586+0000","last_fullsized":"2024-09-12T18:08:44.840586+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:10:12.696558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.15","version":"0'0","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:54.853566+0000","last_change":"2024-09-12T17:30:12.649885+0000","last_active":"2024-09-12T18:08:54.853566+0000","last_peered":"2024-09-12T18:08:54.853566+0000","last_clean":"2024-09-12T18:08:54.853566+0000","last_became_active":"2024-09-12T17:30:12.649605+0000","last_became_peered":"2024-09-12T17:30:12.649605+0000","last_unstale":"2024-09-12T18:08:54.853566+0000","last_undegraded":"2024-09-12T18:08:54.853566+0000","last_fullsized":"2024-09-12T18:08:54.853566+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:09:52.512870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"263'53","reported_seq":191,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:39.841430+0000","last_change":"2024-09-12T17:26:35.661633+0000","last_active":"2024-09-12T18:07:39.841430+0000","last_peered":"2024-09-12T18:07:39.841430+0000","last_clean":"2024-09-12T18:07:39.841430+0000","last_became_active":"2024-09-12T17:26:35.658602+0000","last_became_peered":"2024-09-12T17:26:35.658602+0000","last_unstale":"2024-09-12T18:07:39.841430+0000","last_undegraded":"2024-09-12T18:07:39.841430+0000","last_fullsized":"2024-09-12T18:07:39.841430+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:40:06.406484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":262,"num_read_kb":183,"num_write":93,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:59.845745+0000","last_change":"2024-09-12T17:46:57.083830+0000","last_active":"2024-09-12T18:07:59.845745+0000","last_peered":"2024-09-12T18:07:59.845745+0000","last_clean":"2024-09-12T18:07:59.845745+0000","last_became_active":"2024-09-12T17:46:57.081080+0000","last_became_peered":"2024-09-12T17:46:57.081080+0000","last_unstale":"2024-09-12T18:07:59.845745+0000","last_undegraded":"2024-09-12T18:07:59.845745+0000","last_fullsized":"2024-09-12T18:07:59.845745+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:12:11.153281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"263'2","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:59.850467+0000","last_change":"2024-09-12T17:30:16.686003+0000","last_active":"2024-09-12T18:08:59.850467+0000","last_peered":"2024-09-12T18:08:59.850467+0000","last_clean":"2024-09-12T18:08:59.850467+0000","last_became_active":"2024-09-12T17:30:16.685688+0000","last_became_peered":"2024-09-12T17:30:16.685688+0000","last_unstale":"2024-09-12T18:08:59.850467+0000","last_undegraded":"2024-09-12T18:08:59.850467+0000","last_fullsized":"2024-09-12T18:08:59.850467+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:37:31.358403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":10240,"num_write":7,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"0'0","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:54.836524+0000","last_change":"2024-09-12T17:30:12.654638+0000","last_active":"2024-09-12T18:08:54.836524+0000","last_peered":"2024-09-12T18:08:54.836524+0000","last_clean":"2024-09-12T18:08:54.836524+0000","last_became_active":"2024-09-12T17:30:12.654327+0000","last_became_peered":"2024-09-12T17:30:12.654327+0000","last_unstale":"2024-09-12T18:08:54.836524+0000","last_undegraded":"2024-09-12T18:08:54.836524+0000","last_fullsized":"2024-09-12T18:08:54.836524+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:44:33.401300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"263'47","reported_seq":185,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:39.828526+0000","last_change":"2024-09-12T17:26:35.662563+0000","last_active":"2024-09-12T18:07:39.828526+0000","last_peered":"2024-09-12T18:07:39.828526+0000","last_clean":"2024-09-12T18:07:39.828526+0000","last_became_active":"2024-09-12T17:26:35.662284+0000","last_became_peered":"2024-09-12T17:26:35.662284+0000","last_unstale":"2024-09-12T18:07:39.828526+0000","last_undegraded":"2024-09-12T18:07:39.828526+0000","last_fullsized":"2024-09-12T18:07:39.828526+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:52:34.213360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":252,"num_read_kb":176,"num_write":91,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:59.844776+0000","last_change":"2024-09-12T17:46:57.082391+0000","last_active":"2024-09-12T18:07:59.844776+0000","last_peered":"2024-09-12T18:07:59.844776+0000","last_clean":"2024-09-12T18:07:59.844776+0000","last_became_active":"2024-09-12T17:46:57.082082+0000","last_became_peered":"2024-09-12T17:46:57.082082+0000","last_unstale":"2024-09-12T18:07:59.844776+0000","last_undegraded":"2024-09-12T18:07:59.844776+0000","last_fullsized":"2024-09-12T18:07:59.844776+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:16:53.154548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"260'3","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:59.853745+0000","last_change":"2024-09-12T17:30:16.675596+0000","last_active":"2024-09-12T18:08:59.853745+0000","last_peered":"2024-09-12T18:08:59.853745+0000","last_clean":"2024-09-12T18:08:59.853745+0000","last_became_active":"2024-09-12T17:30:16.675278+0000","last_became_peered":"2024-09-12T17:30:16.675278+0000","last_unstale":"2024-09-12T18:08:59.853745+0000","last_undegraded":"2024-09-12T18:08:59.853745+0000","last_fullsized":"2024-09-12T18:08:59.853745+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:04:44.516041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"260'2","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:54.841986+0000","last_change":"2024-09-12T17:30:12.643518+0000","last_active":"2024-09-12T18:08:54.841986+0000","last_peered":"2024-09-12T18:08:54.841986+0000","last_clean":"2024-09-12T18:08:54.841986+0000","last_became_active":"2024-09-12T17:30:12.643203+0000","last_became_peered":"2024-09-12T17:30:12.643203+0000","last_unstale":"2024-09-12T18:08:54.841986+0000","last_undegraded":"2024-09-12T18:08:54.841986+0000","last_fullsized":"2024-09-12T18:08:54.841986+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:42:13.911696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":23,"num_write":2,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"263'29","reported_seq":125,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:39.851532+0000","last_change":"2024-09-12T17:26:35.657351+0000","last_active":"2024-09-12T18:08:39.851532+0000","last_peered":"2024-09-12T18:08:39.851532+0000","last_clean":"2024-09-12T18:08:39.851532+0000","last_became_active":"2024-09-12T17:26:35.657035+0000","last_became_peered":"2024-09-12T17:26:35.657035+0000","last_unstale":"2024-09-12T18:08:39.851532+0000","last_undegraded":"2024-09-12T18:08:39.851532+0000","last_fullsized":"2024-09-12T18:08:39.851532+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:26:04.653231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":129,"num_read_kb":90,"num_write":56,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:44.848747+0000","last_change":"2024-09-12T17:46:57.094601+0000","last_active":"2024-09-12T18:08:44.848747+0000","last_peered":"2024-09-12T18:08:44.848747+0000","last_clean":"2024-09-12T18:08:44.848747+0000","last_became_active":"2024-09-12T17:46:57.094314+0000","last_became_peered":"2024-09-12T17:46:57.094314+0000","last_unstale":"2024-09-12T18:08:44.848747+0000","last_undegraded":"2024-09-12T18:08:44.848747+0000","last_fullsized":"2024-09-12T18:08:44.848747+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:55:53.289948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:40.137931+0000","last_change":"2024-09-12T17:30:16.679537+0000","last_active":"2024-09-12T18:07:40.137931+0000","last_peered":"2024-09-12T18:07:40.137931+0000","last_clean":"2024-09-12T18:07:40.137931+0000","last_became_active":"2024-09-12T17:30:16.679282+0000","last_became_peered":"2024-09-12T17:30:16.679282+0000","last_unstale":"2024-09-12T18:07:40.137931+0000","last_undegraded":"2024-09-12T18:07:40.137931+0000","last_fullsized":"2024-09-12T18:07:40.137931+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:52:39.870256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"260'6","reported_seq":58,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:34.842038+0000","last_change":"2024-09-12T17:30:12.652775+0000","last_active":"2024-09-12T18:07:34.842038+0000","last_peered":"2024-09-12T18:07:34.842038+0000","last_clean":"2024-09-12T18:07:34.842038+0000","last_became_active":"2024-09-12T17:30:12.652426+0000","last_became_peered":"2024-09-12T17:30:12.652426+0000","last_unstale":"2024-09-12T18:07:34.842038+0000","last_undegraded":"2024-09-12T18:07:34.842038+0000","last_fullsized":"2024-09-12T18:07:34.842038+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:55:40.416016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":10240,"num_write":16,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"263'34","reported_seq":148,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:34.850782+0000","last_change":"2024-09-12T17:26:35.664129+0000","last_active":"2024-09-12T18:08:34.850782+0000","last_peered":"2024-09-12T18:08:34.850782+0000","last_clean":"2024-09-12T18:08:34.850782+0000","last_became_active":"2024-09-12T17:26:35.663337+0000","last_became_peered":"2024-09-12T17:26:35.663337+0000","last_unstale":"2024-09-12T18:08:34.850782+0000","last_undegraded":"2024-09-12T18:08:34.850782+0000","last_fullsized":"2024-09-12T18:08:34.850782+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:23:54.136870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":179,"num_read_kb":128,"num_write":55,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:44.840640+0000","last_change":"2024-09-12T17:46:57.093698+0000","last_active":"2024-09-12T18:08:44.840640+0000","last_peered":"2024-09-12T18:08:44.840640+0000","last_clean":"2024-09-12T18:08:44.840640+0000","last_became_active":"2024-09-12T17:46:57.093157+0000","last_became_peered":"2024-09-12T17:46:57.093157+0000","last_unstale":"2024-09-12T18:08:44.840640+0000","last_undegraded":"2024-09-12T18:08:44.840640+0000","last_fullsized":"2024-09-12T18:08:44.840640+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:44:51.633185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"263'1","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:40.137893+0000","last_change":"2024-09-12T17:30:16.679016+0000","last_active":"2024-09-12T18:07:40.137893+0000","last_peered":"2024-09-12T18:07:40.137893+0000","last_clean":"2024-09-12T18:07:40.137893+0000","last_became_active":"2024-09-12T17:30:16.678682+0000","last_became_peered":"2024-09-12T17:30:16.678682+0000","last_unstale":"2024-09-12T18:07:40.137893+0000","last_undegraded":"2024-09-12T18:07:40.137893+0000","last_fullsized":"2024-09-12T18:07:40.137893+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:44:09.408299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3210,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"263'4","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:34.840737+0000","last_change":"2024-09-12T17:30:12.653263+0000","last_active":"2024-09-12T18:07:34.840737+0000","last_peered":"2024-09-12T18:07:34.840737+0000","last_clean":"2024-09-12T18:07:34.840737+0000","last_became_active":"2024-09-12T17:30:12.652916+0000","last_became_peered":"2024-09-12T17:30:12.652916+0000","last_unstale":"2024-09-12T18:07:34.840737+0000","last_undegraded":"2024-09-12T18:07:34.840737+0000","last_fullsized":"2024-09-12T18:07:34.840737+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:25:32.409182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485760,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"263'35","reported_seq":148,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:34.839418+0000","last_change":"2024-09-12T17:26:35.669546+0000","last_active":"2024-09-12T18:08:34.839418+0000","last_peered":"2024-09-12T18:08:34.839418+0000","last_clean":"2024-09-12T18:08:34.839418+0000","last_became_active":"2024-09-12T17:26:35.669256+0000","last_became_peered":"2024-09-12T17:26:35.669256+0000","last_unstale":"2024-09-12T18:08:34.839418+0000","last_undegraded":"2024-09-12T18:08:34.839418+0000","last_fullsized":"2024-09-12T18:08:34.839418+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:05:49.889059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":173,"num_read_kb":119,"num_write":68,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"262'1","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:04.835994+0000","last_change":"2024-09-12T17:46:57.090884+0000","last_active":"2024-09-12T18:08:04.835994+0000","last_peered":"2024-09-12T18:08:04.835994+0000","last_clean":"2024-09-12T18:08:04.835994+0000","last_became_active":"2024-09-12T17:46:57.090587+0000","last_became_peered":"2024-09-12T17:46:57.090587+0000","last_unstale":"2024-09-12T18:08:04.835994+0000","last_undegraded":"2024-09-12T18:08:04.835994+0000","last_fullsized":"2024-09-12T18:08:04.835994+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:06:27.485219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"260'3","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:39.841383+0000","last_change":"2024-09-12T17:30:16.686552+0000","last_active":"2024-09-12T18:07:39.841383+0000","last_peered":"2024-09-12T18:07:39.841383+0000","last_clean":"2024-09-12T18:07:39.841383+0000","last_became_active":"2024-09-12T17:30:16.685830+0000","last_became_peered":"2024-09-12T17:30:16.685830+0000","last_unstale":"2024-09-12T18:07:39.841383+0000","last_undegraded":"2024-09-12T18:07:39.841383+0000","last_fullsized":"2024-09-12T18:07:39.841383+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:26:14.033263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"0'0","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:34.861787+0000","last_change":"2024-09-12T17:30:12.640428+0000","last_active":"2024-09-12T18:07:34.861787+0000","last_peered":"2024-09-12T18:07:34.861787+0000","last_clean":"2024-09-12T18:07:34.861787+0000","last_became_active":"2024-09-12T17:30:12.640139+0000","last_became_peered":"2024-09-12T17:30:12.640139+0000","last_unstale":"2024-09-12T18:07:34.861787+0000","last_undegraded":"2024-09-12T18:07:34.861787+0000","last_fullsized":"2024-09-12T18:07:34.861787+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:09:04.186884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"263'49","reported_seq":189,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:34.850284+0000","last_change":"2024-09-12T17:26:35.659117+0000","last_active":"2024-09-12T18:08:34.850284+0000","last_peered":"2024-09-12T18:08:34.850284+0000","last_clean":"2024-09-12T18:08:34.850284+0000","last_became_active":"2024-09-12T17:26:35.658785+0000","last_became_peered":"2024-09-12T17:26:35.658785+0000","last_unstale":"2024-09-12T18:08:34.850284+0000","last_undegraded":"2024-09-12T18:08:34.850284+0000","last_fullsized":"2024-09-12T18:08:34.850284+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:02.864803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":254,"num_read_kb":176,"num_write":93,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"263'1","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:44.848723+0000","last_change":"2024-09-12T17:46:57.093615+0000","last_active":"2024-09-12T18:08:44.848723+0000","last_peered":"2024-09-12T18:08:44.848723+0000","last_clean":"2024-09-12T18:08:44.848723+0000","last_became_active":"2024-09-12T17:46:57.093267+0000","last_became_peered":"2024-09-12T17:46:57.093267+0000","last_unstale":"2024-09-12T18:08:44.848723+0000","last_undegraded":"2024-09-12T18:08:44.848723+0000","last_fullsized":"2024-09-12T18:08:44.848723+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:52:12.345961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:39.862456+0000","last_change":"2024-09-12T17:30:16.681768+0000","last_active":"2024-09-12T18:07:39.862456+0000","last_peered":"2024-09-12T18:07:39.862456+0000","last_clean":"2024-09-12T18:07:39.862456+0000","last_became_active":"2024-09-12T17:30:16.681418+0000","last_became_peered":"2024-09-12T17:30:16.681418+0000","last_unstale":"2024-09-12T18:07:39.862456+0000","last_undegraded":"2024-09-12T18:07:39.862456+0000","last_fullsized":"2024-09-12T18:07:39.862456+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:08:51.341343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"260'3","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:34.841576+0000","last_change":"2024-09-12T17:30:12.643785+0000","last_active":"2024-09-12T18:07:34.841576+0000","last_peered":"2024-09-12T18:07:34.841576+0000","last_clean":"2024-09-12T18:07:34.841576+0000","last_became_active":"2024-09-12T17:30:12.643484+0000","last_became_peered":"2024-09-12T17:30:12.643484+0000","last_unstale":"2024-09-12T18:07:34.841576+0000","last_undegraded":"2024-09-12T18:07:34.841576+0000","last_fullsized":"2024-09-12T18:07:34.841576+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:51:35.165703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"260'23","reported_seq":119,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:34.847525+0000","last_change":"2024-09-12T17:26:35.666220+0000","last_active":"2024-09-12T18:08:34.847525+0000","last_peered":"2024-09-12T18:08:34.847525+0000","last_clean":"2024-09-12T18:08:34.847525+0000","last_became_active":"2024-09-12T17:26:35.665908+0000","last_became_peered":"2024-09-12T17:26:35.665908+0000","last_unstale":"2024-09-12T18:08:34.847525+0000","last_undegraded":"2024-09-12T18:08:34.847525+0000","last_fullsized":"2024-09-12T18:08:34.847525+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:22:29.733636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":120,"num_read_kb":87,"num_write":41,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:44.835349+0000","last_change":"2024-09-12T17:46:57.083432+0000","last_active":"2024-09-12T18:08:44.835349+0000","last_peered":"2024-09-12T18:08:44.835349+0000","last_clean":"2024-09-12T18:08:44.835349+0000","last_became_active":"2024-09-12T17:46:57.083098+0000","last_became_peered":"2024-09-12T17:46:57.083098+0000","last_unstale":"2024-09-12T18:08:44.835349+0000","last_undegraded":"2024-09-12T18:08:44.835349+0000","last_fullsized":"2024-09-12T18:08:44.835349+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:31:23.853524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:34.847617+0000","last_change":"2024-09-12T17:30:16.684194+0000","last_active":"2024-09-12T18:08:34.847617+0000","last_peered":"2024-09-12T18:08:34.847617+0000","last_clean":"2024-09-12T18:08:34.847617+0000","last_became_active":"2024-09-12T17:30:16.683887+0000","last_became_peered":"2024-09-12T17:30:16.683887+0000","last_unstale":"2024-09-12T18:08:34.847617+0000","last_undegraded":"2024-09-12T18:08:34.847617+0000","last_fullsized":"2024-09-12T18:08:34.847617+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:53:34.319282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"263'2","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:29.850086+0000","last_change":"2024-09-12T17:30:12.653459+0000","last_active":"2024-09-12T18:08:29.850086+0000","last_peered":"2024-09-12T18:08:29.850086+0000","last_clean":"2024-09-12T18:08:29.850086+0000","last_became_active":"2024-09-12T17:30:12.653137+0000","last_became_peered":"2024-09-12T17:30:12.653137+0000","last_unstale":"2024-09-12T18:08:29.850086+0000","last_undegraded":"2024-09-12T18:08:29.850086+0000","last_fullsized":"2024-09-12T18:08:29.850086+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:08:52.465178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3148935,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":6148,"num_write":2,"num_write_kb":3076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"263'50","reported_seq":186,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:14.838552+0000","last_change":"2024-09-12T17:26:35.669293+0000","last_active":"2024-09-12T18:07:14.838552+0000","last_peered":"2024-09-12T18:07:14.838552+0000","last_clean":"2024-09-12T18:07:14.838552+0000","last_became_active":"2024-09-12T17:26:35.668989+0000","last_became_peered":"2024-09-12T17:26:35.668989+0000","last_unstale":"2024-09-12T18:07:14.838552+0000","last_undegraded":"2024-09-12T18:07:14.838552+0000","last_fullsized":"2024-09-12T18:07:14.838552+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:43:19.820670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":250,"num_read_kb":175,"num_write":93,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:14.839032+0000","last_change":"2024-09-12T17:46:57.088291+0000","last_active":"2024-09-12T18:07:14.839032+0000","last_peered":"2024-09-12T18:07:14.839032+0000","last_clean":"2024-09-12T18:07:14.839032+0000","last_became_active":"2024-09-12T17:46:57.087982+0000","last_became_peered":"2024-09-12T17:46:57.087982+0000","last_unstale":"2024-09-12T18:07:14.839032+0000","last_undegraded":"2024-09-12T18:07:14.839032+0000","last_fullsized":"2024-09-12T18:07:14.839032+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:05:50.630405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"263'3","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:34.847595+0000","last_change":"2024-09-12T17:30:16.679996+0000","last_active":"2024-09-12T18:08:34.847595+0000","last_peered":"2024-09-12T18:08:34.847595+0000","last_clean":"2024-09-12T18:08:34.847595+0000","last_became_active":"2024-09-12T17:30:16.679621+0000","last_became_peered":"2024-09-12T17:30:16.679621+0000","last_unstale":"2024-09-12T18:08:34.847595+0000","last_undegraded":"2024-09-12T18:08:34.847595+0000","last_fullsized":"2024-09-12T18:08:34.847595+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:23:53.964330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9437184,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":9216,"num_write":3,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"0'0","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:29.833725+0000","last_change":"2024-09-12T17:30:12.649664+0000","last_active":"2024-09-12T18:08:29.833725+0000","last_peered":"2024-09-12T18:08:29.833725+0000","last_clean":"2024-09-12T18:08:29.833725+0000","last_became_active":"2024-09-12T17:30:12.649010+0000","last_became_peered":"2024-09-12T17:30:12.649010+0000","last_unstale":"2024-09-12T18:08:29.833725+0000","last_undegraded":"2024-09-12T18:08:29.833725+0000","last_fullsized":"2024-09-12T18:08:29.833725+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:23:47.681997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"260'8","reported_seq":76,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:19.855981+0000","last_change":"2024-09-12T17:26:35.663336+0000","last_active":"2024-09-12T18:09:19.855981+0000","last_peered":"2024-09-12T18:09:19.855981+0000","last_clean":"2024-09-12T18:09:19.855981+0000","last_became_active":"2024-09-12T17:26:35.663041+0000","last_became_peered":"2024-09-12T17:26:35.663041+0000","last_unstale":"2024-09-12T18:09:19.855981+0000","last_undegraded":"2024-09-12T18:09:19.855981+0000","last_fullsized":"2024-09-12T18:09:19.855981+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:02:26.294386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":28,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:39.870871+0000","last_change":"2024-09-12T17:46:57.086356+0000","last_active":"2024-09-12T18:08:39.870871+0000","last_peered":"2024-09-12T18:08:39.870871+0000","last_clean":"2024-09-12T18:08:39.870871+0000","last_became_active":"2024-09-12T17:46:57.085908+0000","last_became_peered":"2024-09-12T17:46:57.085908+0000","last_unstale":"2024-09-12T18:08:39.870871+0000","last_undegraded":"2024-09-12T18:08:39.870871+0000","last_fullsized":"2024-09-12T18:08:39.870871+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:01:54.509459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"0'0","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:40.144742+0000","last_change":"2024-09-12T17:30:16.679533+0000","last_active":"2024-09-12T18:08:40.144742+0000","last_peered":"2024-09-12T18:08:40.144742+0000","last_clean":"2024-09-12T18:08:40.144742+0000","last_became_active":"2024-09-12T17:30:16.679193+0000","last_became_peered":"2024-09-12T17:30:16.679193+0000","last_unstale":"2024-09-12T18:08:40.144742+0000","last_undegraded":"2024-09-12T18:08:40.144742+0000","last_fullsized":"2024-09-12T18:08:40.144742+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:21:35.478757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"0'0","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:29.838852+0000","last_change":"2024-09-12T17:30:12.647471+0000","last_active":"2024-09-12T18:08:29.838852+0000","last_peered":"2024-09-12T18:08:29.838852+0000","last_clean":"2024-09-12T18:08:29.838852+0000","last_became_active":"2024-09-12T17:30:12.646945+0000","last_became_peered":"2024-09-12T17:30:12.646945+0000","last_unstale":"2024-09-12T18:08:29.838852+0000","last_undegraded":"2024-09-12T18:08:29.838852+0000","last_fullsized":"2024-09-12T18:08:29.838852+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:42:36.686975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"263'33","reported_seq":143,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:19.876853+0000","last_change":"2024-09-12T17:26:35.665050+0000","last_active":"2024-09-12T18:09:19.876853+0000","last_peered":"2024-09-12T18:09:19.876853+0000","last_clean":"2024-09-12T18:09:19.876853+0000","last_became_active":"2024-09-12T17:26:35.664749+0000","last_became_peered":"2024-09-12T17:26:35.664749+0000","last_unstale":"2024-09-12T18:09:19.876853+0000","last_undegraded":"2024-09-12T18:09:19.876853+0000","last_fullsized":"2024-09-12T18:09:19.876853+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:25:00.758310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":166,"num_read_kb":124,"num_write":50,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:39.851484+0000","last_change":"2024-09-12T17:46:57.084760+0000","last_active":"2024-09-12T18:08:39.851484+0000","last_peered":"2024-09-12T18:08:39.851484+0000","last_clean":"2024-09-12T18:08:39.851484+0000","last_became_active":"2024-09-12T17:46:57.084421+0000","last_became_peered":"2024-09-12T17:46:57.084421+0000","last_unstale":"2024-09-12T18:08:39.851484+0000","last_undegraded":"2024-09-12T18:08:39.851484+0000","last_fullsized":"2024-09-12T18:08:39.851484+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:35:17.085619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"0'0","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:34.847633+0000","last_change":"2024-09-12T17:30:16.682114+0000","last_active":"2024-09-12T18:08:34.847633+0000","last_peered":"2024-09-12T18:08:34.847633+0000","last_clean":"2024-09-12T18:08:34.847633+0000","last_became_active":"2024-09-12T17:30:16.681171+0000","last_became_peered":"2024-09-12T17:30:16.681171+0000","last_unstale":"2024-09-12T18:08:34.847633+0000","last_undegraded":"2024-09-12T18:08:34.847633+0000","last_fullsized":"2024-09-12T18:08:34.847633+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:35:19.241688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"263'4","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:35.144221+0000","last_change":"2024-09-12T17:30:12.641879+0000","last_active":"2024-09-12T18:08:35.144221+0000","last_peered":"2024-09-12T18:08:35.144221+0000","last_clean":"2024-09-12T18:08:35.144221+0000","last_became_active":"2024-09-12T17:30:12.641592+0000","last_became_peered":"2024-09-12T17:30:12.641592+0000","last_unstale":"2024-09-12T18:08:35.144221+0000","last_undegraded":"2024-09-12T18:08:35.144221+0000","last_fullsized":"2024-09-12T18:08:35.144221+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:29:07.666017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11534336,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":11264,"num_write":4,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"263'52","reported_seq":196,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:19.838941+0000","last_change":"2024-09-12T17:26:35.663784+0000","last_active":"2024-09-12T18:09:19.838941+0000","last_peered":"2024-09-12T18:09:19.838941+0000","last_clean":"2024-09-12T18:09:19.838941+0000","last_became_active":"2024-09-12T17:26:35.663472+0000","last_became_peered":"2024-09-12T17:26:35.663472+0000","last_unstale":"2024-09-12T18:09:19.838941+0000","last_undegraded":"2024-09-12T18:09:19.838941+0000","last_fullsized":"2024-09-12T18:09:19.838941+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:48:26.678396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":261,"num_read_kb":192,"num_write":92,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:14.838540+0000","last_change":"2024-09-12T17:46:57.090539+0000","last_active":"2024-09-12T18:07:14.838540+0000","last_peered":"2024-09-12T18:07:14.838540+0000","last_clean":"2024-09-12T18:07:14.838540+0000","last_became_active":"2024-09-12T17:46:57.089601+0000","last_became_peered":"2024-09-12T17:46:57.089601+0000","last_unstale":"2024-09-12T18:07:14.838540+0000","last_undegraded":"2024-09-12T18:07:14.838540+0000","last_fullsized":"2024-09-12T18:07:14.838540+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:13:07.708030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"0'0","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:19.856690+0000","last_change":"2024-09-12T17:30:16.679697+0000","last_active":"2024-09-12T18:09:19.856690+0000","last_peered":"2024-09-12T18:09:19.856690+0000","last_clean":"2024-09-12T18:09:19.856690+0000","last_became_active":"2024-09-12T17:30:16.679308+0000","last_became_peered":"2024-09-12T17:30:16.679308+0000","last_unstale":"2024-09-12T18:09:19.856690+0000","last_undegraded":"2024-09-12T18:09:19.856690+0000","last_fullsized":"2024-09-12T18:09:19.856690+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:06:24.083988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"263'3","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:14.844358+0000","last_change":"2024-09-12T17:30:12.645085+0000","last_active":"2024-09-12T18:09:14.844358+0000","last_peered":"2024-09-12T18:09:14.844358+0000","last_clean":"2024-09-12T18:09:14.844358+0000","last_became_active":"2024-09-12T17:30:12.644792+0000","last_became_peered":"2024-09-12T17:30:12.644792+0000","last_unstale":"2024-09-12T18:09:14.844358+0000","last_undegraded":"2024-09-12T18:09:14.844358+0000","last_fullsized":"2024-09-12T18:09:14.844358+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:25:31.260415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6339869,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":6192,"num_write":3,"num_write_kb":6192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"263'30","reported_seq":142,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:19.845281+0000","last_change":"2024-09-12T17:26:35.667932+0000","last_active":"2024-09-12T18:09:19.845281+0000","last_peered":"2024-09-12T18:09:19.845281+0000","last_clean":"2024-09-12T18:09:19.845281+0000","last_became_active":"2024-09-12T17:26:35.667655+0000","last_became_peered":"2024-09-12T17:26:35.667655+0000","last_unstale":"2024-09-12T18:09:19.845281+0000","last_undegraded":"2024-09-12T18:09:19.845281+0000","last_fullsized":"2024-09-12T18:09:19.845281+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:21:57.489397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":166,"num_read_kb":116,"num_write":53,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:19.839947+0000","last_change":"2024-09-12T17:46:57.090843+0000","last_active":"2024-09-12T18:07:19.839947+0000","last_peered":"2024-09-12T18:07:19.839947+0000","last_clean":"2024-09-12T18:07:19.839947+0000","last_became_active":"2024-09-12T17:46:57.090477+0000","last_became_peered":"2024-09-12T17:46:57.090477+0000","last_unstale":"2024-09-12T18:07:19.839947+0000","last_undegraded":"2024-09-12T18:07:19.839947+0000","last_fullsized":"2024-09-12T18:07:19.839947+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:01:13.812814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"260'8","reported_seq":57,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:19.857045+0000","last_change":"2024-09-12T17:30:16.673290+0000","last_active":"2024-09-12T18:09:19.857045+0000","last_peered":"2024-09-12T18:09:19.857045+0000","last_clean":"2024-09-12T18:09:19.857045+0000","last_became_active":"2024-09-12T17:30:16.672989+0000","last_became_peered":"2024-09-12T17:30:16.672989+0000","last_unstale":"2024-09-12T18:09:19.857045+0000","last_undegraded":"2024-09-12T18:09:19.857045+0000","last_fullsized":"2024-09-12T18:09:19.857045+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:58:17.894413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":6167,"num_write":13,"num_write_kb":6167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"263'2","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:15.148384+0000","last_change":"2024-09-12T17:30:12.642188+0000","last_active":"2024-09-12T18:09:15.148384+0000","last_peered":"2024-09-12T18:09:15.148384+0000","last_clean":"2024-09-12T18:09:15.148384+0000","last_became_active":"2024-09-12T17:30:12.641901+0000","last_became_peered":"2024-09-12T17:30:12.641901+0000","last_unstale":"2024-09-12T18:09:15.148384+0000","last_undegraded":"2024-09-12T18:09:15.148384+0000","last_fullsized":"2024-09-12T18:09:15.148384+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:30:51.212272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":12288,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"263'9","reported_seq":78,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:49.844267+0000","last_change":"2024-09-12T17:26:35.655618+0000","last_active":"2024-09-12T18:07:49.844267+0000","last_peered":"2024-09-12T18:07:49.844267+0000","last_clean":"2024-09-12T18:07:49.844267+0000","last_became_active":"2024-09-12T17:26:35.655307+0000","last_became_peered":"2024-09-12T17:26:35.655307+0000","last_unstale":"2024-09-12T18:07:49.844267+0000","last_undegraded":"2024-09-12T18:07:49.844267+0000","last_fullsized":"2024-09-12T18:07:49.844267+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:34:53.632505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":30,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"263'1","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:14.839069+0000","last_change":"2024-09-12T17:46:57.086405+0000","last_active":"2024-09-12T18:07:14.839069+0000","last_peered":"2024-09-12T18:07:14.839069+0000","last_clean":"2024-09-12T18:07:14.839069+0000","last_became_active":"2024-09-12T17:46:57.086116+0000","last_became_peered":"2024-09-12T17:46:57.086116+0000","last_unstale":"2024-09-12T18:07:14.839069+0000","last_undegraded":"2024-09-12T18:07:14.839069+0000","last_fullsized":"2024-09-12T18:07:14.839069+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:36:48.862604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:35.144176+0000","last_change":"2024-09-12T17:30:16.676645+0000","last_active":"2024-09-12T18:08:35.144176+0000","last_peered":"2024-09-12T18:08:35.144176+0000","last_clean":"2024-09-12T18:08:35.144176+0000","last_became_active":"2024-09-12T17:30:16.675243+0000","last_became_peered":"2024-09-12T17:30:16.675243+0000","last_unstale":"2024-09-12T18:08:35.144176+0000","last_undegraded":"2024-09-12T18:08:35.144176+0000","last_fullsized":"2024-09-12T18:08:35.144176+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:41:53.506076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"263'1","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:19.845247+0000","last_change":"2024-09-12T17:30:12.641067+0000","last_active":"2024-09-12T18:09:19.845247+0000","last_peered":"2024-09-12T18:09:19.845247+0000","last_clean":"2024-09-12T18:09:19.845247+0000","last_became_active":"2024-09-12T17:30:12.640736+0000","last_became_peered":"2024-09-12T17:30:12.640736+0000","last_unstale":"2024-09-12T18:09:19.845247+0000","last_undegraded":"2024-09-12T18:09:19.845247+0000","last_fullsized":"2024-09-12T18:09:19.845247+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:58:18.939586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3210,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"0'0","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:44.841920+0000","last_change":"2024-09-12T17:26:35.656429+0000","last_active":"2024-09-12T18:07:44.841920+0000","last_peered":"2024-09-12T18:07:44.841920+0000","last_clean":"2024-09-12T18:07:44.841920+0000","last_became_active":"2024-09-12T17:26:35.656149+0000","last_became_peered":"2024-09-12T17:26:35.656149+0000","last_unstale":"2024-09-12T18:07:44.841920+0000","last_undegraded":"2024-09-12T18:07:44.841920+0000","last_fullsized":"2024-09-12T18:07:44.841920+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:53:34.940903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:14.830083+0000","last_change":"2024-09-12T17:46:57.096748+0000","last_active":"2024-09-12T18:07:14.830083+0000","last_peered":"2024-09-12T18:07:14.830083+0000","last_clean":"2024-09-12T18:07:14.830083+0000","last_became_active":"2024-09-12T17:46:57.096375+0000","last_became_peered":"2024-09-12T17:46:57.096375+0000","last_unstale":"2024-09-12T18:07:14.830083+0000","last_undegraded":"2024-09-12T18:07:14.830083+0000","last_fullsized":"2024-09-12T18:07:14.830083+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:03:26.698689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"263'1","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:24.857996+0000","last_change":"2024-09-12T17:30:16.686958+0000","last_active":"2024-09-12T18:09:24.857996+0000","last_peered":"2024-09-12T18:09:24.857996+0000","last_clean":"2024-09-12T18:09:24.857996+0000","last_became_active":"2024-09-12T17:30:16.686562+0000","last_became_peered":"2024-09-12T17:30:16.686562+0000","last_unstale":"2024-09-12T18:09:24.857996+0000","last_undegraded":"2024-09-12T18:09:24.857996+0000","last_fullsized":"2024-09-12T18:09:24.857996+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:17:00.235108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3207,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"263'3","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:29.849631+0000","last_change":"2024-09-12T17:30:12.644840+0000","last_active":"2024-09-12T18:08:29.849631+0000","last_peered":"2024-09-12T18:08:29.849631+0000","last_clean":"2024-09-12T18:08:29.849631+0000","last_became_active":"2024-09-12T17:30:12.644490+0000","last_became_peered":"2024-09-12T17:30:12.644490+0000","last_unstale":"2024-09-12T18:08:29.849631+0000","last_undegraded":"2024-09-12T18:08:29.849631+0000","last_fullsized":"2024-09-12T18:08:29.849631+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:52:02.191118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9437184,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":9216,"num_write":3,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"263'23","reported_seq":115,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:44.863265+0000","last_change":"2024-09-12T17:26:35.665188+0000","last_active":"2024-09-12T18:07:44.863265+0000","last_peered":"2024-09-12T18:07:44.863265+0000","last_clean":"2024-09-12T18:07:44.863265+0000","last_became_active":"2024-09-12T17:26:35.664849+0000","last_became_peered":"2024-09-12T17:26:35.664849+0000","last_unstale":"2024-09-12T18:07:44.863265+0000","last_undegraded":"2024-09-12T18:07:44.863265+0000","last_fullsized":"2024-09-12T18:07:44.863265+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:29:49.144321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":79,"num_write":44,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:49.844298+0000","last_change":"2024-09-12T17:46:57.089388+0000","last_active":"2024-09-12T18:07:49.844298+0000","last_peered":"2024-09-12T18:07:49.844298+0000","last_clean":"2024-09-12T18:07:49.844298+0000","last_became_active":"2024-09-12T17:46:57.089081+0000","last_became_peered":"2024-09-12T17:46:57.089081+0000","last_unstale":"2024-09-12T18:07:49.844298+0000","last_undegraded":"2024-09-12T18:07:49.844298+0000","last_fullsized":"2024-09-12T18:07:49.844298+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:14:44.213114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"0'0","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:54.834972+0000","last_change":"2024-09-12T17:30:16.681225+0000","last_active":"2024-09-12T18:07:54.834972+0000","last_peered":"2024-09-12T18:07:54.834972+0000","last_clean":"2024-09-12T18:07:54.834972+0000","last_became_active":"2024-09-12T17:30:16.680901+0000","last_became_peered":"2024-09-12T17:30:16.680901+0000","last_unstale":"2024-09-12T18:07:54.834972+0000","last_undegraded":"2024-09-12T18:07:54.834972+0000","last_fullsized":"2024-09-12T18:07:54.834972+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:32:33.218603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"0'0","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:44.843546+0000","last_change":"2024-09-12T17:30:12.649239+0000","last_active":"2024-09-12T18:07:44.843546+0000","last_peered":"2024-09-12T18:07:44.843546+0000","last_clean":"2024-09-12T18:07:44.843546+0000","last_became_active":"2024-09-12T17:30:12.648875+0000","last_became_peered":"2024-09-12T17:30:12.648875+0000","last_unstale":"2024-09-12T18:07:44.843546+0000","last_undegraded":"2024-09-12T18:07:44.843546+0000","last_fullsized":"2024-09-12T18:07:44.843546+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:46:54.532755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"263'15","reported_seq":92,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:44.833731+0000","last_change":"2024-09-12T17:26:35.668474+0000","last_active":"2024-09-12T18:07:44.833731+0000","last_peered":"2024-09-12T18:07:44.833731+0000","last_clean":"2024-09-12T18:07:44.833731+0000","last_became_active":"2024-09-12T17:26:35.668118+0000","last_became_peered":"2024-09-12T17:26:35.668118+0000","last_unstale":"2024-09-12T18:07:44.833731+0000","last_undegraded":"2024-09-12T18:07:44.833731+0000","last_fullsized":"2024-09-12T18:07:44.833731+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:54:30.960531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":44,"num_write":31,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:49.843508+0000","last_change":"2024-09-12T17:46:57.086214+0000","last_active":"2024-09-12T18:07:49.843508+0000","last_peered":"2024-09-12T18:07:49.843508+0000","last_clean":"2024-09-12T18:07:49.843508+0000","last_became_active":"2024-09-12T17:46:57.085922+0000","last_became_peered":"2024-09-12T17:46:57.085922+0000","last_unstale":"2024-09-12T18:07:49.843508+0000","last_undegraded":"2024-09-12T18:07:49.843508+0000","last_fullsized":"2024-09-12T18:07:49.843508+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:03:09.811603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"263'4","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:49.834326+0000","last_change":"2024-09-12T17:30:16.669329+0000","last_active":"2024-09-12T18:07:49.834326+0000","last_peered":"2024-09-12T18:07:49.834326+0000","last_clean":"2024-09-12T18:07:49.834326+0000","last_became_active":"2024-09-12T17:30:16.668999+0000","last_became_peered":"2024-09-12T17:30:16.668999+0000","last_unstale":"2024-09-12T18:07:49.834326+0000","last_undegraded":"2024-09-12T18:07:49.834326+0000","last_fullsized":"2024-09-12T18:07:49.834326+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:39:23.168458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7340032,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":12288,"num_write":9,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"0'0","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:54.830107+0000","last_change":"2024-09-12T17:30:12.650378+0000","last_active":"2024-09-12T18:07:54.830107+0000","last_peered":"2024-09-12T18:07:54.830107+0000","last_clean":"2024-09-12T18:07:54.830107+0000","last_became_active":"2024-09-12T17:30:12.649350+0000","last_became_peered":"2024-09-12T17:30:12.649350+0000","last_unstale":"2024-09-12T18:07:54.830107+0000","last_undegraded":"2024-09-12T18:07:54.830107+0000","last_fullsized":"2024-09-12T18:07:54.830107+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:58:25.779058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"263'20","reported_seq":115,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:44.863349+0000","last_change":"2024-09-12T17:26:35.667425+0000","last_active":"2024-09-12T18:07:44.863349+0000","last_peered":"2024-09-12T18:07:44.863349+0000","last_clean":"2024-09-12T18:07:44.863349+0000","last_became_active":"2024-09-12T17:26:35.667060+0000","last_became_peered":"2024-09-12T17:26:35.667060+0000","last_unstale":"2024-09-12T18:07:44.863349+0000","last_undegraded":"2024-09-12T18:07:44.863349+0000","last_fullsized":"2024-09-12T18:07:44.863349+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:13:33.511985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":80,"num_write":36,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:00.146690+0000","last_change":"2024-09-12T17:46:57.078643+0000","last_active":"2024-09-12T18:09:00.146690+0000","last_peered":"2024-09-12T18:09:00.146690+0000","last_clean":"2024-09-12T18:09:00.146690+0000","last_became_active":"2024-09-12T17:46:57.076358+0000","last_became_peered":"2024-09-12T17:46:57.076358+0000","last_unstale":"2024-09-12T18:09:00.146690+0000","last_undegraded":"2024-09-12T18:09:00.146690+0000","last_fullsized":"2024-09-12T18:09:00.146690+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:22:38.368544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"260'3","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:19.857246+0000","last_change":"2024-09-12T17:30:16.676537+0000","last_active":"2024-09-12T18:09:19.857246+0000","last_peered":"2024-09-12T18:09:19.857246+0000","last_clean":"2024-09-12T18:09:19.857246+0000","last_became_active":"2024-09-12T17:30:16.676187+0000","last_became_peered":"2024-09-12T17:30:16.676187+0000","last_unstale":"2024-09-12T18:09:19.857246+0000","last_undegraded":"2024-09-12T18:09:19.857246+0000","last_fullsized":"2024-09-12T18:09:19.857246+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:03:12.668403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"263'4","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:14.855285+0000","last_change":"2024-09-12T17:30:12.651492+0000","last_active":"2024-09-12T18:09:14.855285+0000","last_peered":"2024-09-12T18:09:14.855285+0000","last_clean":"2024-09-12T18:09:14.855285+0000","last_became_active":"2024-09-12T17:30:12.651254+0000","last_became_peered":"2024-09-12T17:30:12.651254+0000","last_unstale":"2024-09-12T18:09:14.855285+0000","last_undegraded":"2024-09-12T18:09:14.855285+0000","last_fullsized":"2024-09-12T18:09:14.855285+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:54:45.814379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":16,"num_write":9,"num_write_kb":1040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"263'21","reported_seq":106,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:19.848719+0000","last_change":"2024-09-12T17:26:35.660865+0000","last_active":"2024-09-12T18:08:19.848719+0000","last_peered":"2024-09-12T18:08:19.848719+0000","last_clean":"2024-09-12T18:08:19.848719+0000","last_became_active":"2024-09-12T17:26:35.660521+0000","last_became_peered":"2024-09-12T17:26:35.660521+0000","last_unstale":"2024-09-12T18:08:19.848719+0000","last_undegraded":"2024-09-12T18:08:19.848719+0000","last_fullsized":"2024-09-12T18:08:19.848719+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:36:23.758533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":60,"num_write":47,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:49.844137+0000","last_change":"2024-09-12T17:46:57.076516+0000","last_active":"2024-09-12T18:07:49.844137+0000","last_peered":"2024-09-12T18:07:49.844137+0000","last_clean":"2024-09-12T18:07:49.844137+0000","last_became_active":"2024-09-12T17:46:57.075936+0000","last_became_peered":"2024-09-12T17:46:57.075936+0000","last_unstale":"2024-09-12T18:07:49.844137+0000","last_undegraded":"2024-09-12T18:07:49.844137+0000","last_fullsized":"2024-09-12T18:07:49.844137+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:03:25.092644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"0'0","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:19.856809+0000","last_change":"2024-09-12T17:30:16.671561+0000","last_active":"2024-09-12T18:09:19.856809+0000","last_peered":"2024-09-12T18:09:19.856809+0000","last_clean":"2024-09-12T18:09:19.856809+0000","last_became_active":"2024-09-12T17:30:16.671232+0000","last_became_peered":"2024-09-12T17:30:16.671232+0000","last_unstale":"2024-09-12T18:09:19.856809+0000","last_undegraded":"2024-09-12T18:09:19.856809+0000","last_fullsized":"2024-09-12T18:09:19.856809+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:01:53.261691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"260'3","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:14.856411+0000","last_change":"2024-09-12T17:30:12.652805+0000","last_active":"2024-09-12T18:09:14.856411+0000","last_peered":"2024-09-12T18:09:14.856411+0000","last_clean":"2024-09-12T18:09:14.856411+0000","last_became_active":"2024-09-12T17:30:12.652439+0000","last_became_peered":"2024-09-12T17:30:12.652439+0000","last_unstale":"2024-09-12T18:09:14.856411+0000","last_undegraded":"2024-09-12T18:09:14.856411+0000","last_fullsized":"2024-09-12T18:09:14.856411+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:38:28.870273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"263'34","reported_seq":144,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:15.141873+0000","last_change":"2024-09-12T17:26:35.664662+0000","last_active":"2024-09-12T18:08:15.141873+0000","last_peered":"2024-09-12T18:08:15.141873+0000","last_clean":"2024-09-12T18:08:15.141873+0000","last_became_active":"2024-09-12T17:26:35.664338+0000","last_became_peered":"2024-09-12T17:26:35.664338+0000","last_unstale":"2024-09-12T18:08:15.141873+0000","last_undegraded":"2024-09-12T18:08:15.141873+0000","last_fullsized":"2024-09-12T18:08:15.141873+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:31:50.906050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":161,"num_read_kb":109,"num_write":67,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"262'1","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:39.834842+0000","last_change":"2024-09-12T17:46:57.091123+0000","last_active":"2024-09-12T18:08:39.834842+0000","last_peered":"2024-09-12T18:08:39.834842+0000","last_clean":"2024-09-12T18:08:39.834842+0000","last_became_active":"2024-09-12T17:46:57.090581+0000","last_became_peered":"2024-09-12T17:46:57.090581+0000","last_unstale":"2024-09-12T18:08:39.834842+0000","last_undegraded":"2024-09-12T18:08:39.834842+0000","last_fullsized":"2024-09-12T18:08:39.834842+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:32:17.465596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"260'3","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:50.139110+0000","last_change":"2024-09-12T17:30:16.677712+0000","last_active":"2024-09-12T18:07:50.139110+0000","last_peered":"2024-09-12T18:07:50.139110+0000","last_clean":"2024-09-12T18:07:50.139110+0000","last_became_active":"2024-09-12T17:30:16.677428+0000","last_became_peered":"2024-09-12T17:30:16.677428+0000","last_unstale":"2024-09-12T18:07:50.139110+0000","last_undegraded":"2024-09-12T18:07:50.139110+0000","last_fullsized":"2024-09-12T18:07:50.139110+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:43:08.742548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"263'5","reported_seq":58,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:19.848612+0000","last_change":"2024-09-12T17:30:12.644935+0000","last_active":"2024-09-12T18:08:19.848612+0000","last_peered":"2024-09-12T18:08:19.848612+0000","last_clean":"2024-09-12T18:08:19.848612+0000","last_became_active":"2024-09-12T17:30:12.644600+0000","last_became_peered":"2024-09-12T17:30:12.644600+0000","last_unstale":"2024-09-12T18:08:19.848612+0000","last_undegraded":"2024-09-12T18:08:19.848612+0000","last_fullsized":"2024-09-12T18:08:19.848612+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:08:42.394913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":6144,"num_write":10,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"263'63","reported_seq":232,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:14.846770+0000","last_change":"2024-09-12T17:26:35.658927+0000","last_active":"2024-09-12T18:08:14.846770+0000","last_peered":"2024-09-12T18:08:14.846770+0000","last_clean":"2024-09-12T18:08:14.846770+0000","last_became_active":"2024-09-12T17:26:35.658630+0000","last_became_peered":"2024-09-12T17:26:35.658630+0000","last_unstale":"2024-09-12T18:08:14.846770+0000","last_undegraded":"2024-09-12T18:08:14.846770+0000","last_fullsized":"2024-09-12T18:08:14.846770+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:40:44.086306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":336,"num_read_kb":235,"num_write":105,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:39.840111+0000","last_change":"2024-09-12T17:46:57.093471+0000","last_active":"2024-09-12T18:08:39.840111+0000","last_peered":"2024-09-12T18:08:39.840111+0000","last_clean":"2024-09-12T18:08:39.840111+0000","last_became_active":"2024-09-12T17:46:57.092472+0000","last_became_peered":"2024-09-12T17:46:57.092472+0000","last_unstale":"2024-09-12T18:08:39.840111+0000","last_undegraded":"2024-09-12T18:08:39.840111+0000","last_fullsized":"2024-09-12T18:08:39.840111+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:53:15.268714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"0'0","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:34.849448+0000","last_change":"2024-09-12T17:30:16.675715+0000","last_active":"2024-09-12T18:08:34.849448+0000","last_peered":"2024-09-12T18:08:34.849448+0000","last_clean":"2024-09-12T18:08:34.849448+0000","last_became_active":"2024-09-12T17:30:16.675380+0000","last_became_peered":"2024-09-12T17:30:16.675380+0000","last_unstale":"2024-09-12T18:08:34.849448+0000","last_undegraded":"2024-09-12T18:08:34.849448+0000","last_fullsized":"2024-09-12T18:08:34.849448+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:03:46.402687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"0'0","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:44.843471+0000","last_change":"2024-09-12T17:30:12.652798+0000","last_active":"2024-09-12T18:07:44.843471+0000","last_peered":"2024-09-12T18:07:44.843471+0000","last_clean":"2024-09-12T18:07:44.843471+0000","last_became_active":"2024-09-12T17:30:12.652368+0000","last_became_peered":"2024-09-12T17:30:12.652368+0000","last_unstale":"2024-09-12T18:07:44.843471+0000","last_undegraded":"2024-09-12T18:07:44.843471+0000","last_fullsized":"2024-09-12T18:07:44.843471+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:17:25.947883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"263'14","reported_seq":92,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:14.847538+0000","last_change":"2024-09-12T17:26:35.662321+0000","last_active":"2024-09-12T18:08:14.847538+0000","last_peered":"2024-09-12T18:08:14.847538+0000","last_clean":"2024-09-12T18:08:14.847538+0000","last_became_active":"2024-09-12T17:26:35.662029+0000","last_became_peered":"2024-09-12T17:26:35.662029+0000","last_unstale":"2024-09-12T18:08:14.847538+0000","last_undegraded":"2024-09-12T18:08:14.847538+0000","last_fullsized":"2024-09-12T18:08:14.847538+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:25:20.058995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":47,"num_write":25,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:49.834357+0000","last_change":"2024-09-12T17:46:57.088925+0000","last_active":"2024-09-12T18:07:49.834357+0000","last_peered":"2024-09-12T18:07:49.834357+0000","last_clean":"2024-09-12T18:07:49.834357+0000","last_became_active":"2024-09-12T17:46:57.088577+0000","last_became_peered":"2024-09-12T17:46:57.088577+0000","last_unstale":"2024-09-12T18:07:49.834357+0000","last_undegraded":"2024-09-12T18:07:49.834357+0000","last_fullsized":"2024-09-12T18:07:49.834357+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:13:06.852295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"263'3","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:49.864118+0000","last_change":"2024-09-12T17:30:16.687859+0000","last_active":"2024-09-12T18:07:49.864118+0000","last_peered":"2024-09-12T18:07:49.864118+0000","last_clean":"2024-09-12T18:07:49.864118+0000","last_became_active":"2024-09-12T17:30:16.687560+0000","last_became_peered":"2024-09-12T17:30:16.687560+0000","last_unstale":"2024-09-12T18:07:49.864118+0000","last_undegraded":"2024-09-12T18:07:49.864118+0000","last_fullsized":"2024-09-12T18:07:49.864118+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:18:26.345356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9437184,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":15360,"num_write":3,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"260'5","reported_seq":63,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:45.138528+0000","last_change":"2024-09-12T17:30:12.646334+0000","last_active":"2024-09-12T18:07:45.138528+0000","last_peered":"2024-09-12T18:07:45.138528+0000","last_clean":"2024-09-12T18:07:45.138528+0000","last_became_active":"2024-09-12T17:30:12.646002+0000","last_became_peered":"2024-09-12T17:30:12.646002+0000","last_unstale":"2024-09-12T18:07:45.138528+0000","last_undegraded":"2024-09-12T18:07:45.138528+0000","last_fullsized":"2024-09-12T18:07:45.138528+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:37:55.039202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"263'38","reported_seq":162,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:14.867529+0000","last_change":"2024-09-12T17:26:35.665038+0000","last_active":"2024-09-12T18:08:14.867529+0000","last_peered":"2024-09-12T18:08:14.867529+0000","last_clean":"2024-09-12T18:08:14.867529+0000","last_became_active":"2024-09-12T17:26:35.664653+0000","last_became_peered":"2024-09-12T17:26:35.664653+0000","last_unstale":"2024-09-12T18:08:14.867529+0000","last_undegraded":"2024-09-12T18:08:14.867529+0000","last_fullsized":"2024-09-12T18:08:14.867529+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:25:13.289455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":203,"num_read_kb":159,"num_write":60,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:54.845096+0000","last_change":"2024-09-12T17:46:57.092076+0000","last_active":"2024-09-12T18:07:54.845096+0000","last_peered":"2024-09-12T18:07:54.845096+0000","last_clean":"2024-09-12T18:07:54.845096+0000","last_became_active":"2024-09-12T17:46:57.091489+0000","last_became_peered":"2024-09-12T17:46:57.091489+0000","last_unstale":"2024-09-12T18:07:54.845096+0000","last_undegraded":"2024-09-12T18:07:54.845096+0000","last_fullsized":"2024-09-12T18:07:54.845096+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:45:12.006559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"263'1","reported_seq":44,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:49.844180+0000","last_change":"2024-09-12T17:30:16.671442+0000","last_active":"2024-09-12T18:07:49.844180+0000","last_peered":"2024-09-12T18:07:49.844180+0000","last_clean":"2024-09-12T18:07:49.844180+0000","last_became_active":"2024-09-12T17:30:16.671126+0000","last_became_peered":"2024-09-12T17:30:16.671126+0000","last_unstale":"2024-09-12T18:07:49.844180+0000","last_undegraded":"2024-09-12T18:07:49.844180+0000","last_fullsized":"2024-09-12T18:07:49.844180+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:55:00.165120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":48,"num_write":1,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"260'3","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:44.863319+0000","last_change":"2024-09-12T17:30:12.645438+0000","last_active":"2024-09-12T18:07:44.863319+0000","last_peered":"2024-09-12T18:07:44.863319+0000","last_clean":"2024-09-12T18:07:44.863319+0000","last_became_active":"2024-09-12T17:30:12.645099+0000","last_became_peered":"2024-09-12T17:30:12.645099+0000","last_unstale":"2024-09-12T18:07:44.863319+0000","last_undegraded":"2024-09-12T18:07:44.863319+0000","last_fullsized":"2024-09-12T18:07:44.863319+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:10:18.763902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"263'42","reported_seq":167,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:39.851442+0000","last_change":"2024-09-12T17:26:35.666120+0000","last_active":"2024-09-12T18:08:39.851442+0000","last_peered":"2024-09-12T18:08:39.851442+0000","last_clean":"2024-09-12T18:08:39.851442+0000","last_became_active":"2024-09-12T17:26:35.665804+0000","last_became_peered":"2024-09-12T17:26:35.665804+0000","last_unstale":"2024-09-12T18:08:39.851442+0000","last_undegraded":"2024-09-12T18:08:39.851442+0000","last_fullsized":"2024-09-12T18:08:39.851442+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:39:01.905486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":202,"num_read_kb":139,"num_write":84,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"263'201","reported_seq":804,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:04.855015+0000","last_change":"2024-09-12T17:10:42.526331+0000","last_active":"2024-09-12T18:09:04.855015+0000","last_peered":"2024-09-12T18:09:04.855015+0000","last_clean":"2024-09-12T18:09:04.855015+0000","last_became_active":"2024-09-12T17:10:42.523450+0000","last_became_peered":"2024-09-12T17:10:42.523450+0000","last_unstale":"2024-09-12T18:09:04.855015+0000","last_undegraded":"2024-09-12T18:09:04.855015+0000","last_fullsized":"2024-09-12T18:09:04.855015+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:26:36.695715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12713471,"num_objects":11,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":357,"num_read_kb":12797,"num_write":987,"num_write_kb":38748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0,5],"acting":[7,6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"263'408","reported_seq":1922,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:58.797415+0000","last_change":"2024-09-12T17:10:44.521376+0000","last_active":"2024-09-12T18:08:58.797415+0000","last_peered":"2024-09-12T18:08:58.797415+0000","last_clean":"2024-09-12T18:08:58.797415+0000","last_became_active":"2024-09-12T17:10:44.521072+0000","last_became_peered":"2024-09-12T17:10:44.521072+0000","last_unstale":"2024-09-12T18:08:58.797415+0000","last_undegraded":"2024-09-12T18:08:58.797415+0000","last_fullsized":"2024-09-12T18:08:58.797415+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":300,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:24:54.440783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2237,"num_read_kb":2119,"num_write":474,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"263'156","reported_seq":792,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:05.147352+0000","last_change":"2024-09-12T17:10:42.516137+0000","last_active":"2024-09-12T18:09:05.147352+0000","last_peered":"2024-09-12T18:09:05.147352+0000","last_clean":"2024-09-12T18:09:05.147352+0000","last_became_active":"2024-09-12T17:10:42.515714+0000","last_became_peered":"2024-09-12T17:10:42.515714+0000","last_unstale":"2024-09-12T18:09:05.147352+0000","last_undegraded":"2024-09-12T18:09:05.147352+0000","last_fullsized":"2024-09-12T18:09:05.147352+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:42:36.192689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5349221,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":404,"num_read_kb":24642,"num_write":798,"num_write_kb":5824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6,4],"acting":[1,0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"263'569","reported_seq":2037,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:06.320505+0000","last_change":"2024-09-12T17:10:44.521016+0000","last_active":"2024-09-12T18:09:06.320505+0000","last_peered":"2024-09-12T18:09:06.320505+0000","last_clean":"2024-09-12T18:09:06.320505+0000","last_became_active":"2024-09-12T17:10:44.520662+0000","last_became_peered":"2024-09-12T17:10:44.520662+0000","last_unstale":"2024-09-12T18:09:06.320505+0000","last_undegraded":"2024-09-12T18:09:06.320505+0000","last_fullsized":"2024-09-12T18:09:06.320505+0000","mapping_epoch":26,"log_start":"263'500","ondisk_log_start":"263'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":500,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:26:51.418557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2846,"num_read_kb":2568,"num_write":745,"num_write_kb":247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"263'191","reported_seq":877,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:04.843250+0000","last_change":"2024-09-12T17:10:42.514886+0000","last_active":"2024-09-12T18:09:04.843250+0000","last_peered":"2024-09-12T18:09:04.843250+0000","last_clean":"2024-09-12T18:09:04.843250+0000","last_became_active":"2024-09-12T17:10:42.514502+0000","last_became_peered":"2024-09-12T17:10:42.514502+0000","last_unstale":"2024-09-12T18:09:04.843250+0000","last_undegraded":"2024-09-12T18:09:04.843250+0000","last_fullsized":"2024-09-12T18:09:04.843250+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:38:43.328631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26587481,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":501,"num_read_kb":116995,"num_write":940,"num_write_kb":47431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,7],"acting":[0,2,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"263'510","reported_seq":2192,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:55.344424+0000","last_change":"2024-09-12T17:10:44.515786+0000","last_active":"2024-09-12T18:08:55.344424+0000","last_peered":"2024-09-12T18:08:55.344424+0000","last_clean":"2024-09-12T18:08:55.344424+0000","last_became_active":"2024-09-12T17:10:44.515053+0000","last_became_peered":"2024-09-12T17:10:44.515053+0000","last_unstale":"2024-09-12T18:08:55.344424+0000","last_undegraded":"2024-09-12T18:08:55.344424+0000","last_fullsized":"2024-09-12T18:08:55.344424+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":400,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:16:05.419489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2823,"num_read_kb":2642,"num_write":595,"num_write_kb":151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"263'184","reported_seq":809,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:59.853049+0000","last_change":"2024-09-12T17:10:42.515615+0000","last_active":"2024-09-12T18:08:59.853049+0000","last_peered":"2024-09-12T18:08:59.853049+0000","last_clean":"2024-09-12T18:08:59.853049+0000","last_became_active":"2024-09-12T17:10:42.515202+0000","last_became_peered":"2024-09-12T17:10:42.515202+0000","last_unstale":"2024-09-12T18:08:59.853049+0000","last_undegraded":"2024-09-12T18:08:59.853049+0000","last_fullsized":"2024-09-12T18:08:59.853049+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:18:31.312838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5813069,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":397,"num_read_kb":32737,"num_write":931,"num_write_kb":40819,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7,2],"acting":[5,3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"263'477","reported_seq":2055,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:09.599114+0000","last_change":"2024-09-12T17:10:44.524085+0000","last_active":"2024-09-12T18:09:09.599114+0000","last_peered":"2024-09-12T18:09:09.599114+0000","last_clean":"2024-09-12T18:09:09.599114+0000","last_became_active":"2024-09-12T17:10:44.523767+0000","last_became_peered":"2024-09-12T17:10:44.523767+0000","last_unstale":"2024-09-12T18:09:09.599114+0000","last_undegraded":"2024-09-12T18:09:09.599114+0000","last_fullsized":"2024-09-12T18:09:09.599114+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":400,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:56:19.375833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2572,"num_read_kb":2417,"num_write":590,"num_write_kb":142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"263'156","reported_seq":787,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:14.848042+0000","last_change":"2024-09-12T17:10:42.523893+0000","last_active":"2024-09-12T18:08:14.848042+0000","last_peered":"2024-09-12T18:08:14.848042+0000","last_clean":"2024-09-12T18:08:14.848042+0000","last_became_active":"2024-09-12T17:10:42.523427+0000","last_became_peered":"2024-09-12T17:10:42.523427+0000","last_unstale":"2024-09-12T18:08:14.848042+0000","last_undegraded":"2024-09-12T18:08:14.848042+0000","last_fullsized":"2024-09-12T18:08:14.848042+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:01:12.856714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5245138,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":436,"num_read_kb":36335,"num_write":766,"num_write_kb":30424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3,6],"acting":[7,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"263'475","reported_seq":1959,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:08.656630+0000","last_change":"2024-09-12T17:10:44.511009+0000","last_active":"2024-09-12T18:11:08.656630+0000","last_peered":"2024-09-12T18:11:08.656630+0000","last_clean":"2024-09-12T18:11:08.656630+0000","last_became_active":"2024-09-12T17:10:44.510692+0000","last_became_peered":"2024-09-12T17:10:44.510692+0000","last_unstale":"2024-09-12T18:11:08.656630+0000","last_undegraded":"2024-09-12T18:11:08.656630+0000","last_fullsized":"2024-09-12T18:11:08.656630+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":400,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:18:01.946068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2639,"num_read_kb":2478,"num_write":625,"num_write_kb":223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"263'186","reported_seq":812,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:14.846749+0000","last_change":"2024-09-12T17:10:42.525823+0000","last_active":"2024-09-12T18:08:14.846749+0000","last_peered":"2024-09-12T18:08:14.846749+0000","last_clean":"2024-09-12T18:08:14.846749+0000","last_became_active":"2024-09-12T17:10:42.525363+0000","last_became_peered":"2024-09-12T17:10:42.525363+0000","last_unstale":"2024-09-12T18:08:14.846749+0000","last_undegraded":"2024-09-12T18:08:14.846749+0000","last_fullsized":"2024-09-12T18:08:14.846749+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:02:50.629102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291534,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":407,"num_read_kb":34311,"num_write":949,"num_write_kb":12654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,4,1],"acting":[5,0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"263'875","reported_seq":2655,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:48.689421+0000","last_change":"2024-09-12T17:10:44.514182+0000","last_active":"2024-09-12T18:09:48.689421+0000","last_peered":"2024-09-12T18:09:48.689421+0000","last_clean":"2024-09-12T18:09:48.689421+0000","last_became_active":"2024-09-12T17:10:44.513865+0000","last_became_peered":"2024-09-12T17:10:44.513865+0000","last_unstale":"2024-09-12T18:09:48.689421+0000","last_undegraded":"2024-09-12T18:09:48.689421+0000","last_fullsized":"2024-09-12T18:09:48.689421+0000","mapping_epoch":26,"log_start":"263'800","ondisk_log_start":"263'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":800,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:58:50.879901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4549,"num_read_kb":4126,"num_write":1137,"num_write_kb":421,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"263'186","reported_seq":984,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:14.847986+0000","last_change":"2024-09-12T17:10:42.531846+0000","last_active":"2024-09-12T18:08:14.847986+0000","last_peered":"2024-09-12T18:08:14.847986+0000","last_clean":"2024-09-12T18:08:14.847986+0000","last_became_active":"2024-09-12T17:10:42.531356+0000","last_became_peered":"2024-09-12T17:10:42.531356+0000","last_unstale":"2024-09-12T18:08:14.847986+0000","last_undegraded":"2024-09-12T18:08:14.847986+0000","last_fullsized":"2024-09-12T18:08:14.847986+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:12:38.008206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":298268,"num_objects":11,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":746,"num_read_kb":2366,"num_write":949,"num_write_kb":15239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4,6],"acting":[7,0,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"263'409","reported_seq":1925,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:09.599316+0000","last_change":"2024-09-12T17:10:44.521355+0000","last_active":"2024-09-12T18:09:09.599316+0000","last_peered":"2024-09-12T18:09:09.599316+0000","last_clean":"2024-09-12T18:09:09.599316+0000","last_became_active":"2024-09-12T17:10:44.520609+0000","last_became_peered":"2024-09-12T17:10:44.520609+0000","last_unstale":"2024-09-12T18:09:09.599316+0000","last_undegraded":"2024-09-12T18:09:09.599316+0000","last_fullsized":"2024-09-12T18:09:09.599316+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":300,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:15:20.820552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2177,"num_read_kb":2069,"num_write":470,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"263'203","reported_seq":837,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:14.845186+0000","last_change":"2024-09-12T17:10:42.528380+0000","last_active":"2024-09-12T18:08:14.845186+0000","last_peered":"2024-09-12T18:08:14.845186+0000","last_clean":"2024-09-12T18:08:14.845186+0000","last_became_active":"2024-09-12T17:10:42.527310+0000","last_became_peered":"2024-09-12T17:10:42.527310+0000","last_unstale":"2024-09-12T18:08:14.845186+0000","last_undegraded":"2024-09-12T18:08:14.845186+0000","last_fullsized":"2024-09-12T18:08:14.845186+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:59:02.965611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10670368,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":463,"num_read_kb":11976,"num_write":987,"num_write_kb":39362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0,2],"acting":[3,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"263'803","reported_seq":2469,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:08.689356+0000","last_change":"2024-09-12T17:10:44.518218+0000","last_active":"2024-09-12T18:11:08.689356+0000","last_peered":"2024-09-12T18:11:08.689356+0000","last_clean":"2024-09-12T18:11:08.689356+0000","last_became_active":"2024-09-12T17:10:44.517947+0000","last_became_peered":"2024-09-12T17:10:44.517947+0000","last_unstale":"2024-09-12T18:11:08.689356+0000","last_undegraded":"2024-09-12T18:11:08.689356+0000","last_fullsized":"2024-09-12T18:11:08.689356+0000","mapping_epoch":26,"log_start":"263'700","ondisk_log_start":"263'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":700,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:23:45.311255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3878,"num_read_kb":3536,"num_write":1022,"num_write_kb":342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"263'406","reported_seq":2024,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:04.854401+0000","last_change":"2024-09-12T17:10:44.514809+0000","last_active":"2024-09-12T18:09:04.854401+0000","last_peered":"2024-09-12T18:09:04.854401+0000","last_clean":"2024-09-12T18:09:04.854401+0000","last_became_active":"2024-09-12T17:10:44.514293+0000","last_became_peered":"2024-09-12T17:10:44.514293+0000","last_unstale":"2024-09-12T18:09:04.854401+0000","last_undegraded":"2024-09-12T18:09:04.854401+0000","last_fullsized":"2024-09-12T18:09:04.854401+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":300,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:15:27.841945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2470,"num_read_kb":2366,"num_write":468,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"263'161","reported_seq":774,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:54.853629+0000","last_change":"2024-09-12T17:10:42.522308+0000","last_active":"2024-09-12T18:08:54.853629+0000","last_peered":"2024-09-12T18:08:54.853629+0000","last_clean":"2024-09-12T18:08:54.853629+0000","last_became_active":"2024-09-12T17:10:42.521637+0000","last_became_peered":"2024-09-12T17:10:42.521637+0000","last_unstale":"2024-09-12T18:08:54.853629+0000","last_undegraded":"2024-09-12T18:08:54.853629+0000","last_fullsized":"2024-09-12T18:08:54.853629+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:28:33.771646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5704625,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":443,"num_read_kb":17329,"num_write":803,"num_write_kb":49238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0,1],"acting":[7,5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"263'782","reported_seq":2276,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:04.854884+0000","last_change":"2024-09-12T17:10:44.521355+0000","last_active":"2024-09-12T18:09:04.854884+0000","last_peered":"2024-09-12T18:09:04.854884+0000","last_clean":"2024-09-12T18:09:04.854884+0000","last_became_active":"2024-09-12T17:10:44.521031+0000","last_became_peered":"2024-09-12T17:10:44.521031+0000","last_unstale":"2024-09-12T18:09:04.854884+0000","last_undegraded":"2024-09-12T18:09:04.854884+0000","last_fullsized":"2024-09-12T18:09:04.854884+0000","mapping_epoch":26,"log_start":"263'700","ondisk_log_start":"263'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":700,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:32:54.360404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3604,"num_read_kb":3242,"num_write":1018,"num_write_kb":360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"263'252","reported_seq":945,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:44.871763+0000","last_change":"2024-09-12T17:10:42.526866+0000","last_active":"2024-09-12T18:08:44.871763+0000","last_peered":"2024-09-12T18:08:44.871763+0000","last_clean":"2024-09-12T18:08:44.871763+0000","last_became_active":"2024-09-12T17:10:42.517679+0000","last_became_peered":"2024-09-12T17:10:42.517679+0000","last_unstale":"2024-09-12T18:08:44.871763+0000","last_undegraded":"2024-09-12T18:08:44.871763+0000","last_fullsized":"2024-09-12T18:08:44.871763+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:33:13.890188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1606466,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":848,"num_read_kb":4297,"num_write":1122,"num_write_kb":28670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2,1],"acting":[6,5,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"263'358","reported_seq":1812,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:19.855895+0000","last_change":"2024-09-12T17:10:44.518484+0000","last_active":"2024-09-12T18:09:19.855895+0000","last_peered":"2024-09-12T18:09:19.855895+0000","last_clean":"2024-09-12T18:09:19.855895+0000","last_became_active":"2024-09-12T17:10:44.518183+0000","last_became_peered":"2024-09-12T17:10:44.518183+0000","last_unstale":"2024-09-12T18:09:19.855895+0000","last_undegraded":"2024-09-12T18:09:19.855895+0000","last_fullsized":"2024-09-12T18:09:19.855895+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:51:18.710777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1979,"num_read_kb":1899,"num_write":385,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"263'229","reported_seq":950,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:49.079463+0000","last_change":"2024-09-12T17:10:42.518722+0000","last_active":"2024-09-12T18:08:49.079463+0000","last_peered":"2024-09-12T18:08:49.079463+0000","last_clean":"2024-09-12T18:08:49.079463+0000","last_became_active":"2024-09-12T17:10:42.518345+0000","last_became_peered":"2024-09-12T17:10:42.518345+0000","last_unstale":"2024-09-12T18:08:49.079463+0000","last_undegraded":"2024-09-12T18:08:49.079463+0000","last_fullsized":"2024-09-12T18:08:49.079463+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":200,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:55:42.993471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1440420,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":643,"num_read_kb":98876,"num_write":1051,"num_write_kb":25289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0,3],"acting":[6,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"263'516","reported_seq":2148,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:08.689613+0000","last_change":"2024-09-12T17:10:44.514989+0000","last_active":"2024-09-12T18:11:08.689613+0000","last_peered":"2024-09-12T18:11:08.689613+0000","last_clean":"2024-09-12T18:11:08.689613+0000","last_became_active":"2024-09-12T17:10:44.514645+0000","last_became_peered":"2024-09-12T17:10:44.514645+0000","last_unstale":"2024-09-12T18:11:08.689613+0000","last_undegraded":"2024-09-12T18:11:08.689613+0000","last_fullsized":"2024-09-12T18:11:08.689613+0000","mapping_epoch":26,"log_start":"263'500","ondisk_log_start":"263'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":500,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:07:24.458191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2725,"num_read_kb":2548,"num_write":623,"num_write_kb":175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"263'213","reported_seq":872,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:44.851667+0000","last_change":"2024-09-12T17:10:42.519598+0000","last_active":"2024-09-12T18:08:44.851667+0000","last_peered":"2024-09-12T18:08:44.851667+0000","last_clean":"2024-09-12T18:08:44.851667+0000","last_became_active":"2024-09-12T17:10:42.519000+0000","last_became_peered":"2024-09-12T17:10:42.519000+0000","last_unstale":"2024-09-12T18:08:44.851667+0000","last_undegraded":"2024-09-12T18:08:44.851667+0000","last_fullsized":"2024-09-12T18:08:44.851667+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:16:24.448620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5782027,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":500,"num_read_kb":33700,"num_write":930,"num_write_kb":23229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,0],"acting":[4,3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"263'1583","reported_seq":3109,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:58.601451+0000","last_change":"2024-09-12T17:10:44.515105+0000","last_active":"2024-09-12T18:08:58.601451+0000","last_peered":"2024-09-12T18:08:58.601451+0000","last_clean":"2024-09-12T18:08:58.601451+0000","last_became_active":"2024-09-12T17:10:44.514826+0000","last_became_peered":"2024-09-12T17:10:44.514826+0000","last_unstale":"2024-09-12T18:08:58.601451+0000","last_undegraded":"2024-09-12T18:08:58.601451+0000","last_fullsized":"2024-09-12T18:08:58.601451+0000","mapping_epoch":26,"log_start":"263'1500","ondisk_log_start":"263'1500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":1500,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:30:21.141258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6865,"num_read_kb":5951,"num_write":2206,"num_write_kb":956,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"263'239","reported_seq":895,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:10:59.495004+0000","last_change":"2024-09-12T17:10:42.533422+0000","last_active":"2024-09-12T18:10:59.495004+0000","last_peered":"2024-09-12T18:10:59.495004+0000","last_clean":"2024-09-12T18:10:59.495004+0000","last_became_active":"2024-09-12T17:10:42.532995+0000","last_became_peered":"2024-09-12T17:10:42.532995+0000","last_unstale":"2024-09-12T18:10:59.495004+0000","last_undegraded":"2024-09-12T18:10:59.495004+0000","last_fullsized":"2024-09-12T18:10:59.495004+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":200,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:44:08.027039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11322954,"num_objects":11,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":534,"num_read_kb":13123,"num_write":1222,"num_write_kb":39413,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1,5],"acting":[3,6,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"263'1288","reported_seq":3015,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:48.689829+0000","last_change":"2024-09-12T17:10:44.507748+0000","last_active":"2024-09-12T18:09:48.689829+0000","last_peered":"2024-09-12T18:09:48.689829+0000","last_clean":"2024-09-12T18:09:48.689829+0000","last_became_active":"2024-09-12T17:10:44.507428+0000","last_became_peered":"2024-09-12T17:10:44.507428+0000","last_unstale":"2024-09-12T18:09:48.689829+0000","last_undegraded":"2024-09-12T18:09:48.689829+0000","last_fullsized":"2024-09-12T18:09:48.689829+0000","mapping_epoch":26,"log_start":"263'1200","ondisk_log_start":"263'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":1200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:34:52.540295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5933,"num_read_kb":5245,"num_write":1814,"num_write_kb":777,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"263'185","reported_seq":863,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:14.844412+0000","last_change":"2024-09-12T17:10:42.529986+0000","last_active":"2024-09-12T18:09:14.844412+0000","last_peered":"2024-09-12T18:09:14.844412+0000","last_clean":"2024-09-12T18:09:14.844412+0000","last_became_active":"2024-09-12T17:10:42.529179+0000","last_became_peered":"2024-09-12T17:10:42.529179+0000","last_unstale":"2024-09-12T18:09:14.844412+0000","last_undegraded":"2024-09-12T18:09:14.844412+0000","last_fullsized":"2024-09-12T18:09:14.844412+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:53:33.632179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":576011,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":570,"num_read_kb":13539,"num_write":907,"num_write_kb":25869,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1,5],"acting":[0,4,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"263'159","reported_seq":680,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:49.689301+0000","last_change":"2024-09-12T17:10:52.566398+0000","last_active":"2024-09-12T18:09:49.689301+0000","last_peered":"2024-09-12T18:09:49.689301+0000","last_clean":"2024-09-12T18:09:49.689301+0000","last_became_active":"2024-09-12T17:10:52.566079+0000","last_became_peered":"2024-09-12T17:10:52.566079+0000","last_unstale":"2024-09-12T18:09:49.689301+0000","last_undegraded":"2024-09-12T18:09:49.689301+0000","last_fullsized":"2024-09-12T18:09:49.689301+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":100,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:46:37.549026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":803,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":269,"num_read_kb":255,"num_write":425,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"263'795","reported_seq":2403,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:19.853207+0000","last_change":"2024-09-12T17:10:44.522489+0000","last_active":"2024-09-12T18:09:19.853207+0000","last_peered":"2024-09-12T18:09:19.853207+0000","last_clean":"2024-09-12T18:09:19.853207+0000","last_became_active":"2024-09-12T17:10:44.522193+0000","last_became_peered":"2024-09-12T17:10:44.522193+0000","last_unstale":"2024-09-12T18:09:19.853207+0000","last_undegraded":"2024-09-12T18:09:19.853207+0000","last_fullsized":"2024-09-12T18:09:19.853207+0000","mapping_epoch":26,"log_start":"263'700","ondisk_log_start":"263'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":700,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:23:39.492588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3748,"num_read_kb":3407,"num_write":1044,"num_write_kb":360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"263'199","reported_seq":841,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:04.854920+0000","last_change":"2024-09-12T17:10:42.531990+0000","last_active":"2024-09-12T18:09:04.854920+0000","last_peered":"2024-09-12T18:09:04.854920+0000","last_clean":"2024-09-12T18:09:04.854920+0000","last_became_active":"2024-09-12T17:10:42.528620+0000","last_became_peered":"2024-09-12T17:10:42.528620+0000","last_unstale":"2024-09-12T18:09:04.854920+0000","last_undegraded":"2024-09-12T18:09:04.854920+0000","last_fullsized":"2024-09-12T18:09:04.854920+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:01.518991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11074653,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":493,"num_read_kb":31268,"num_write":1011,"num_write_kb":14227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4,2],"acting":[7,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:49.851570+0000","last_change":"2024-09-12T17:10:46.527973+0000","last_active":"2024-09-12T18:08:49.851570+0000","last_peered":"2024-09-12T18:08:49.851570+0000","last_clean":"2024-09-12T18:08:49.851570+0000","last_became_active":"2024-09-12T17:10:46.527663+0000","last_became_peered":"2024-09-12T17:10:46.527663+0000","last_unstale":"2024-09-12T18:08:49.851570+0000","last_undegraded":"2024-09-12T18:08:49.851570+0000","last_fullsized":"2024-09-12T18:08:49.851570+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_clean_scrub_stamp":"2024-09-12T17:10:45.504515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:21:49.638349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"263'198","reported_seq":801,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:09.798260+0000","last_change":"2024-09-12T17:10:48.545372+0000","last_active":"2024-09-12T18:11:09.798260+0000","last_peered":"2024-09-12T18:11:09.798260+0000","last_clean":"2024-09-12T18:11:09.798260+0000","last_became_active":"2024-09-12T17:10:48.544885+0000","last_became_peered":"2024-09-12T17:10:48.544885+0000","last_unstale":"2024-09-12T18:11:09.798260+0000","last_undegraded":"2024-09-12T18:11:09.798260+0000","last_fullsized":"2024-09-12T18:11:09.798260+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_clean_scrub_stamp":"2024-09-12T17:10:47.516917+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:14:40.858594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8481,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":255,"num_read_kb":299,"num_write":152,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":485,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:49.852931+0000","last_change":"2024-09-12T17:10:50.556467+0000","last_active":"2024-09-12T18:08:49.852931+0000","last_peered":"2024-09-12T18:08:49.852931+0000","last_clean":"2024-09-12T18:08:49.852931+0000","last_became_active":"2024-09-12T17:10:50.556146+0000","last_became_peered":"2024-09-12T17:10:50.556146+0000","last_unstale":"2024-09-12T18:08:49.852931+0000","last_undegraded":"2024-09-12T18:08:49.852931+0000","last_fullsized":"2024-09-12T18:08:49.852931+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_clean_scrub_stamp":"2024-09-12T17:10:49.533772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:46:08.763293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"263'2474","reported_seq":4378,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:49.683677+0000","last_change":"2024-09-12T17:10:52.572598+0000","last_active":"2024-09-12T18:09:49.683677+0000","last_peered":"2024-09-12T18:09:49.683677+0000","last_clean":"2024-09-12T18:09:49.683677+0000","last_became_active":"2024-09-12T17:10:52.572326+0000","last_became_peered":"2024-09-12T17:10:52.572326+0000","last_unstale":"2024-09-12T18:09:49.683677+0000","last_undegraded":"2024-09-12T18:09:49.683677+0000","last_fullsized":"2024-09-12T18:09:49.683677+0000","mapping_epoch":34,"log_start":"263'2400","ondisk_log_start":"263'2400","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":2400,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:07:16.923827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":211,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6220,"num_read_kb":6202,"num_write":4958,"num_write_kb":1813,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"263'423","reported_seq":1877,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:08.688272+0000","last_change":"2024-09-12T17:10:44.513059+0000","last_active":"2024-09-12T18:11:08.688272+0000","last_peered":"2024-09-12T18:11:08.688272+0000","last_clean":"2024-09-12T18:11:08.688272+0000","last_became_active":"2024-09-12T17:10:44.512755+0000","last_became_peered":"2024-09-12T17:10:44.512755+0000","last_unstale":"2024-09-12T18:11:08.688272+0000","last_undegraded":"2024-09-12T18:11:08.688272+0000","last_fullsized":"2024-09-12T18:11:08.688272+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":400,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:13:48.119870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2092,"num_read_kb":1979,"num_write":465,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"263'200","reported_seq":837,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:04.843197+0000","last_change":"2024-09-12T17:10:42.514091+0000","last_active":"2024-09-12T18:09:04.843197+0000","last_peered":"2024-09-12T18:09:04.843197+0000","last_clean":"2024-09-12T18:09:04.843197+0000","last_became_active":"2024-09-12T17:10:42.513658+0000","last_became_peered":"2024-09-12T17:10:42.513658+0000","last_unstale":"2024-09-12T18:09:04.843197+0000","last_undegraded":"2024-09-12T18:09:04.843197+0000","last_fullsized":"2024-09-12T18:09:04.843197+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:37:17.251915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5860566,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":443,"num_read_kb":17694,"num_write":952,"num_write_kb":36760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":495,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:04.837350+0000","last_change":"2024-09-12T17:10:46.528313+0000","last_active":"2024-09-12T18:07:04.837350+0000","last_peered":"2024-09-12T18:07:04.837350+0000","last_clean":"2024-09-12T18:07:04.837350+0000","last_became_active":"2024-09-12T17:10:46.528008+0000","last_became_peered":"2024-09-12T17:10:46.528008+0000","last_unstale":"2024-09-12T18:07:04.837350+0000","last_undegraded":"2024-09-12T18:07:04.837350+0000","last_fullsized":"2024-09-12T18:07:04.837350+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_clean_scrub_stamp":"2024-09-12T17:10:45.504515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:19:49.464976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"263'98","reported_seq":630,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:49.852429+0000","last_change":"2024-09-12T17:10:48.540285+0000","last_active":"2024-09-12T18:08:49.852429+0000","last_peered":"2024-09-12T18:08:49.852429+0000","last_clean":"2024-09-12T18:08:49.852429+0000","last_became_active":"2024-09-12T17:10:48.539249+0000","last_became_peered":"2024-09-12T17:10:48.539249+0000","last_unstale":"2024-09-12T18:08:49.852429+0000","last_undegraded":"2024-09-12T18:08:49.852429+0000","last_fullsized":"2024-09-12T18:08:49.852429+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_clean_scrub_stamp":"2024-09-12T17:10:47.516917+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:10:07.478104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":101,"num_read_kb":97,"num_write":68,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:49.852402+0000","last_change":"2024-09-12T17:10:50.560376+0000","last_active":"2024-09-12T18:08:49.852402+0000","last_peered":"2024-09-12T18:08:49.852402+0000","last_clean":"2024-09-12T18:08:49.852402+0000","last_became_active":"2024-09-12T17:10:50.559882+0000","last_became_peered":"2024-09-12T17:10:50.559882+0000","last_unstale":"2024-09-12T18:08:49.852402+0000","last_undegraded":"2024-09-12T18:08:49.852402+0000","last_fullsized":"2024-09-12T18:08:49.852402+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_clean_scrub_stamp":"2024-09-12T17:10:49.533772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:28:55.022294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"263'90","reported_seq":591,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:40.825979+0000","last_change":"2024-09-12T17:10:52.570423+0000","last_active":"2024-09-12T18:08:40.825979+0000","last_peered":"2024-09-12T18:08:40.825979+0000","last_clean":"2024-09-12T18:08:40.825979+0000","last_became_active":"2024-09-12T17:10:52.570071+0000","last_became_peered":"2024-09-12T17:10:52.570071+0000","last_unstale":"2024-09-12T18:08:40.825979+0000","last_undegraded":"2024-09-12T18:08:40.825979+0000","last_fullsized":"2024-09-12T18:08:40.825979+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:46:23.049710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":117,"num_read_kb":116,"num_write":199,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"263'443","reported_seq":1990,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:04.193040+0000","last_change":"2024-09-12T17:10:44.518158+0000","last_active":"2024-09-12T18:09:04.193040+0000","last_peered":"2024-09-12T18:09:04.193040+0000","last_clean":"2024-09-12T18:09:04.193040+0000","last_became_active":"2024-09-12T17:10:44.517886+0000","last_became_peered":"2024-09-12T17:10:44.517886+0000","last_unstale":"2024-09-12T18:09:04.193040+0000","last_undegraded":"2024-09-12T18:09:04.193040+0000","last_fullsized":"2024-09-12T18:09:04.193040+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":400,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:43:41.541508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2335,"num_read_kb":2201,"num_write":517,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"263'189","reported_seq":813,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:32.299175+0000","last_change":"2024-09-12T17:10:42.531080+0000","last_active":"2024-09-12T18:09:32.299175+0000","last_peered":"2024-09-12T18:09:32.299175+0000","last_clean":"2024-09-12T18:09:32.299175+0000","last_became_active":"2024-09-12T17:10:42.530663+0000","last_became_peered":"2024-09-12T17:10:42.530663+0000","last_unstale":"2024-09-12T18:09:32.299175+0000","last_undegraded":"2024-09-12T18:09:32.299175+0000","last_fullsized":"2024-09-12T18:09:32.299175+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:31:17.343251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6489153,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":433,"num_read_kb":14482,"num_write":957,"num_write_kb":29259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":495,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:49.849323+0000","last_change":"2024-09-12T17:10:46.530775+0000","last_active":"2024-09-12T18:08:49.849323+0000","last_peered":"2024-09-12T18:08:49.849323+0000","last_clean":"2024-09-12T18:08:49.849323+0000","last_became_active":"2024-09-12T17:10:46.530438+0000","last_became_peered":"2024-09-12T17:10:46.530438+0000","last_unstale":"2024-09-12T18:08:49.849323+0000","last_undegraded":"2024-09-12T18:08:49.849323+0000","last_fullsized":"2024-09-12T18:08:49.849323+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_clean_scrub_stamp":"2024-09-12T17:10:45.504515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:06:31.919771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"263'114","reported_seq":649,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:19.838931+0000","last_change":"2024-09-12T17:10:48.540591+0000","last_active":"2024-09-12T18:09:19.838931+0000","last_peered":"2024-09-12T18:09:19.838931+0000","last_clean":"2024-09-12T18:09:19.838931+0000","last_became_active":"2024-09-12T17:10:48.540078+0000","last_became_peered":"2024-09-12T17:10:48.540078+0000","last_unstale":"2024-09-12T18:09:19.838931+0000","last_undegraded":"2024-09-12T18:09:19.838931+0000","last_fullsized":"2024-09-12T18:09:19.838931+0000","mapping_epoch":30,"log_start":"263'100","ondisk_log_start":"263'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_clean_scrub_stamp":"2024-09-12T17:10:47.516917+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:11:14.400403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":134,"num_read_kb":129,"num_write":88,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"263'762","reported_seq":4725,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:13.430655+0000","last_change":"2024-09-12T17:10:50.563321+0000","last_active":"2024-09-12T18:11:13.430655+0000","last_peered":"2024-09-12T18:11:13.430655+0000","last_clean":"2024-09-12T18:11:13.430655+0000","last_became_active":"2024-09-12T17:10:50.562930+0000","last_became_peered":"2024-09-12T17:10:50.562930+0000","last_unstale":"2024-09-12T18:11:13.430655+0000","last_undegraded":"2024-09-12T18:11:13.430655+0000","last_fullsized":"2024-09-12T18:11:13.430655+0000","mapping_epoch":32,"log_start":"263'700","ondisk_log_start":"263'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_clean_scrub_stamp":"2024-09-12T17:10:49.533772+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":700,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:02:44.468859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"263'198","reported_seq":1047,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:49.747543+0000","last_change":"2024-09-12T17:10:52.671398+0000","last_active":"2024-09-12T18:09:49.747543+0000","last_peered":"2024-09-12T18:09:49.747543+0000","last_clean":"2024-09-12T18:09:49.747543+0000","last_became_active":"2024-09-12T17:10:52.671103+0000","last_became_peered":"2024-09-12T17:10:52.671103+0000","last_unstale":"2024-09-12T18:09:49.747543+0000","last_undegraded":"2024-09-12T18:09:49.747543+0000","last_fullsized":"2024-09-12T18:09:49.747543+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:56:47.430468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":719,"num_read_kb":693,"num_write":432,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"263'446","reported_seq":1962,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:48.690267+0000","last_change":"2024-09-12T17:10:44.515015+0000","last_active":"2024-09-12T18:09:48.690267+0000","last_peered":"2024-09-12T18:09:48.690267+0000","last_clean":"2024-09-12T18:09:48.690267+0000","last_became_active":"2024-09-12T17:10:44.514124+0000","last_became_peered":"2024-09-12T17:10:44.514124+0000","last_unstale":"2024-09-12T18:09:48.690267+0000","last_undegraded":"2024-09-12T18:09:48.690267+0000","last_fullsized":"2024-09-12T18:09:48.690267+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":400,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:59:05.101317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2305,"num_read_kb":2168,"num_write":513,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"263'219","reported_seq":875,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:04.874408+0000","last_change":"2024-09-12T17:10:42.526752+0000","last_active":"2024-09-12T18:09:04.874408+0000","last_peered":"2024-09-12T18:09:04.874408+0000","last_clean":"2024-09-12T18:09:04.874408+0000","last_became_active":"2024-09-12T17:10:42.525328+0000","last_became_peered":"2024-09-12T17:10:42.525328+0000","last_unstale":"2024-09-12T18:09:04.874408+0000","last_undegraded":"2024-09-12T18:09:04.874408+0000","last_fullsized":"2024-09-12T18:09:04.874408+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:01:32.510919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9693500,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":545,"num_read_kb":47940,"num_write":1048,"num_write_kb":57690,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,3],"acting":[6,0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:49.851613+0000","last_change":"2024-09-12T17:10:46.527001+0000","last_active":"2024-09-12T18:08:49.851613+0000","last_peered":"2024-09-12T18:08:49.851613+0000","last_clean":"2024-09-12T18:08:49.851613+0000","last_became_active":"2024-09-12T17:10:46.526679+0000","last_became_peered":"2024-09-12T17:10:46.526679+0000","last_unstale":"2024-09-12T18:08:49.851613+0000","last_undegraded":"2024-09-12T18:08:49.851613+0000","last_fullsized":"2024-09-12T18:08:49.851613+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_clean_scrub_stamp":"2024-09-12T17:10:45.504515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:03:41.503120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"263'127","reported_seq":690,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:09.791937+0000","last_change":"2024-09-12T17:10:48.543886+0000","last_active":"2024-09-12T18:11:09.791937+0000","last_peered":"2024-09-12T18:11:09.791937+0000","last_clean":"2024-09-12T18:11:09.791937+0000","last_became_active":"2024-09-12T17:10:48.543573+0000","last_became_peered":"2024-09-12T17:10:48.543573+0000","last_unstale":"2024-09-12T18:11:09.791937+0000","last_undegraded":"2024-09-12T18:11:09.791937+0000","last_fullsized":"2024-09-12T18:11:09.791937+0000","mapping_epoch":30,"log_start":"263'100","ondisk_log_start":"263'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_clean_scrub_stamp":"2024-09-12T17:10:47.516917+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:34:09.400161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15870,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":166,"num_read_kb":231,"num_write":90,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"263'784","reported_seq":2294,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:13.139836+0000","last_change":"2024-09-12T17:10:50.559536+0000","last_active":"2024-09-12T18:11:13.139836+0000","last_peered":"2024-09-12T18:11:13.139836+0000","last_clean":"2024-09-12T18:11:13.139836+0000","last_became_active":"2024-09-12T17:10:50.559216+0000","last_became_peered":"2024-09-12T17:10:50.559216+0000","last_unstale":"2024-09-12T18:11:13.139836+0000","last_undegraded":"2024-09-12T18:11:13.139836+0000","last_fullsized":"2024-09-12T18:11:13.139836+0000","mapping_epoch":32,"log_start":"263'700","ondisk_log_start":"263'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_clean_scrub_stamp":"2024-09-12T17:10:49.533772+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":700,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:25:21.535911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"263'408","reported_seq":1929,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:49.545567+0000","last_change":"2024-09-12T17:10:44.516555+0000","last_active":"2024-09-12T18:09:49.545567+0000","last_peered":"2024-09-12T18:09:49.545567+0000","last_clean":"2024-09-12T18:09:49.545567+0000","last_became_active":"2024-09-12T17:10:44.516266+0000","last_became_peered":"2024-09-12T17:10:44.516266+0000","last_unstale":"2024-09-12T18:09:49.545567+0000","last_undegraded":"2024-09-12T18:09:49.545567+0000","last_fullsized":"2024-09-12T18:09:49.545567+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":300,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:00:21.370421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2231,"num_read_kb":2116,"num_write":471,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"263'312","reported_seq":1079,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:43.800887+0000","last_change":"2024-09-12T17:10:42.532317+0000","last_active":"2024-09-12T18:09:43.800887+0000","last_peered":"2024-09-12T18:09:43.800887+0000","last_clean":"2024-09-12T18:09:43.800887+0000","last_became_active":"2024-09-12T17:10:42.531886+0000","last_became_peered":"2024-09-12T17:10:42.531886+0000","last_unstale":"2024-09-12T18:09:43.800887+0000","last_undegraded":"2024-09-12T18:09:43.800887+0000","last_fullsized":"2024-09-12T18:09:43.800887+0000","mapping_epoch":24,"log_start":"263'300","ondisk_log_start":"263'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:10:32.496140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12869981,"num_objects":13,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":1036,"num_read_kb":35637,"num_write":1309,"num_write_kb":31872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0,1],"acting":[7,4,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:19.857104+0000","last_change":"2024-09-12T17:10:46.519211+0000","last_active":"2024-09-12T18:09:19.857104+0000","last_peered":"2024-09-12T18:09:19.857104+0000","last_clean":"2024-09-12T18:09:19.857104+0000","last_became_active":"2024-09-12T17:10:46.518652+0000","last_became_peered":"2024-09-12T17:10:46.518652+0000","last_unstale":"2024-09-12T18:09:19.857104+0000","last_undegraded":"2024-09-12T18:09:19.857104+0000","last_fullsized":"2024-09-12T18:09:19.857104+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_clean_scrub_stamp":"2024-09-12T17:10:45.504515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:02:38.257135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"263'214","reported_seq":826,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:34.859827+0000","last_change":"2024-09-12T17:10:48.541485+0000","last_active":"2024-09-12T18:09:34.859827+0000","last_peered":"2024-09-12T18:09:34.859827+0000","last_clean":"2024-09-12T18:09:34.859827+0000","last_became_active":"2024-09-12T17:10:48.541178+0000","last_became_peered":"2024-09-12T17:10:48.541178+0000","last_unstale":"2024-09-12T18:09:34.859827+0000","last_undegraded":"2024-09-12T18:09:34.859827+0000","last_fullsized":"2024-09-12T18:09:34.859827+0000","mapping_epoch":30,"log_start":"263'200","ondisk_log_start":"263'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_clean_scrub_stamp":"2024-09-12T17:10:47.516917+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:04:05.483511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8055,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":289,"num_read_kb":328,"num_write":168,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:20.148978+0000","last_change":"2024-09-12T17:10:50.560497+0000","last_active":"2024-09-12T18:09:20.148978+0000","last_peered":"2024-09-12T18:09:20.148978+0000","last_clean":"2024-09-12T18:09:20.148978+0000","last_became_active":"2024-09-12T17:10:50.560193+0000","last_became_peered":"2024-09-12T17:10:50.560193+0000","last_unstale":"2024-09-12T18:09:20.148978+0000","last_undegraded":"2024-09-12T18:09:20.148978+0000","last_fullsized":"2024-09-12T18:09:20.148978+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_clean_scrub_stamp":"2024-09-12T17:10:49.533772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:31:52.880536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"263'555","reported_seq":1366,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:09.825289+0000","last_change":"2024-09-12T17:10:52.573117+0000","last_active":"2024-09-12T18:11:09.825289+0000","last_peered":"2024-09-12T18:11:09.825289+0000","last_clean":"2024-09-12T18:11:09.825289+0000","last_became_active":"2024-09-12T17:10:52.572861+0000","last_became_peered":"2024-09-12T17:10:52.572861+0000","last_unstale":"2024-09-12T18:11:09.825289+0000","last_undegraded":"2024-09-12T18:11:09.825289+0000","last_fullsized":"2024-09-12T18:11:09.825289+0000","mapping_epoch":34,"log_start":"263'500","ondisk_log_start":"263'500","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":500,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:59:24.545564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1102,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1315,"num_read_kb":1312,"num_write":1171,"num_write_kb":396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"263'467","reported_seq":2047,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:08.687983+0000","last_change":"2024-09-12T17:10:44.516107+0000","last_active":"2024-09-12T18:11:08.687983+0000","last_peered":"2024-09-12T18:11:08.687983+0000","last_clean":"2024-09-12T18:11:08.687983+0000","last_became_active":"2024-09-12T17:10:44.515778+0000","last_became_peered":"2024-09-12T17:10:44.515778+0000","last_unstale":"2024-09-12T18:11:08.687983+0000","last_undegraded":"2024-09-12T18:11:08.687983+0000","last_fullsized":"2024-09-12T18:11:08.687983+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":400,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:07:30.510968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2463,"num_read_kb":2310,"num_write":552,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"263'158","reported_seq":764,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:14.856394+0000","last_change":"2024-09-12T17:10:42.526640+0000","last_active":"2024-09-12T18:09:14.856394+0000","last_peered":"2024-09-12T18:09:14.856394+0000","last_clean":"2024-09-12T18:09:14.856394+0000","last_became_active":"2024-09-12T17:10:42.526215+0000","last_became_peered":"2024-09-12T17:10:42.526215+0000","last_unstale":"2024-09-12T18:09:14.856394+0000","last_undegraded":"2024-09-12T18:09:14.856394+0000","last_fullsized":"2024-09-12T18:09:14.856394+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:44:21.141942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":254352,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":393,"num_read_kb":949,"num_write":838,"num_write_kb":19518,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,2],"acting":[7,4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":495,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:19.838876+0000","last_change":"2024-09-12T17:10:46.532883+0000","last_active":"2024-09-12T18:09:19.838876+0000","last_peered":"2024-09-12T18:09:19.838876+0000","last_clean":"2024-09-12T18:09:19.838876+0000","last_became_active":"2024-09-12T17:10:46.532552+0000","last_became_peered":"2024-09-12T17:10:46.532552+0000","last_unstale":"2024-09-12T18:09:19.838876+0000","last_undegraded":"2024-09-12T18:09:19.838876+0000","last_fullsized":"2024-09-12T18:09:19.838876+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_clean_scrub_stamp":"2024-09-12T17:10:45.504515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:25:38.578310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"263'129","reported_seq":696,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:09.778772+0000","last_change":"2024-09-12T17:10:48.543376+0000","last_active":"2024-09-12T18:11:09.778772+0000","last_peered":"2024-09-12T18:11:09.778772+0000","last_clean":"2024-09-12T18:11:09.778772+0000","last_became_active":"2024-09-12T17:10:48.542511+0000","last_became_peered":"2024-09-12T17:10:48.542511+0000","last_unstale":"2024-09-12T18:11:09.778772+0000","last_undegraded":"2024-09-12T18:11:09.778772+0000","last_fullsized":"2024-09-12T18:11:09.778772+0000","mapping_epoch":30,"log_start":"263'100","ondisk_log_start":"263'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_clean_scrub_stamp":"2024-09-12T17:10:47.516917+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:24:43.018761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28999,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":167,"num_read_kb":272,"num_write":90,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":489,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:24.839556+0000","last_change":"2024-09-12T17:10:50.560534+0000","last_active":"2024-09-12T18:07:24.839556+0000","last_peered":"2024-09-12T18:07:24.839556+0000","last_clean":"2024-09-12T18:07:24.839556+0000","last_became_active":"2024-09-12T17:10:50.560194+0000","last_became_peered":"2024-09-12T17:10:50.560194+0000","last_unstale":"2024-09-12T18:07:24.839556+0000","last_undegraded":"2024-09-12T18:07:24.839556+0000","last_fullsized":"2024-09-12T18:07:24.839556+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_clean_scrub_stamp":"2024-09-12T17:10:49.533772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:42:53.755387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"263'128","reported_seq":635,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:10:59.090392+0000","last_change":"2024-09-12T17:10:52.564665+0000","last_active":"2024-09-12T18:10:59.090392+0000","last_peered":"2024-09-12T18:10:59.090392+0000","last_clean":"2024-09-12T18:10:59.090392+0000","last_became_active":"2024-09-12T17:10:52.564350+0000","last_became_peered":"2024-09-12T17:10:52.564350+0000","last_unstale":"2024-09-12T18:10:59.090392+0000","last_undegraded":"2024-09-12T18:10:59.090392+0000","last_fullsized":"2024-09-12T18:10:59.090392+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:43:06.504654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":214,"num_read_kb":196,"num_write":321,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"263'437","reported_seq":1878,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:28.615548+0000","last_change":"2024-09-12T17:11:16.619027+0000","last_active":"2024-09-12T18:09:28.615548+0000","last_peered":"2024-09-12T18:09:28.615548+0000","last_clean":"2024-09-12T18:09:28.615548+0000","last_became_active":"2024-09-12T17:11:16.618699+0000","last_became_peered":"2024-09-12T17:11:16.618699+0000","last_unstale":"2024-09-12T18:09:28.615548+0000","last_undegraded":"2024-09-12T18:09:28.615548+0000","last_fullsized":"2024-09-12T18:09:28.615548+0000","mapping_epoch":37,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":400,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:55:15.584080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2161,"num_read_kb":2024,"num_write":504,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"263'213","reported_seq":841,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:14.856367+0000","last_change":"2024-09-12T17:10:42.526151+0000","last_active":"2024-09-12T18:09:14.856367+0000","last_peered":"2024-09-12T18:09:14.856367+0000","last_clean":"2024-09-12T18:09:14.856367+0000","last_became_active":"2024-09-12T17:10:42.525644+0000","last_became_peered":"2024-09-12T17:10:42.525644+0000","last_unstale":"2024-09-12T18:09:14.856367+0000","last_undegraded":"2024-09-12T18:09:14.856367+0000","last_fullsized":"2024-09-12T18:09:14.856367+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:06:11.915199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1626,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":478,"num_read_kb":1680,"num_write":1064,"num_write_kb":42245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4,6],"acting":[7,5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:19.838915+0000","last_change":"2024-09-12T17:10:46.532305+0000","last_active":"2024-09-12T18:09:19.838915+0000","last_peered":"2024-09-12T18:09:19.838915+0000","last_clean":"2024-09-12T18:09:19.838915+0000","last_became_active":"2024-09-12T17:10:46.531693+0000","last_became_peered":"2024-09-12T17:10:46.531693+0000","last_unstale":"2024-09-12T18:09:19.838915+0000","last_undegraded":"2024-09-12T18:09:19.838915+0000","last_fullsized":"2024-09-12T18:09:19.838915+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_clean_scrub_stamp":"2024-09-12T17:10:45.504515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:12:04.081227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"263'167","reported_seq":751,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:09.805504+0000","last_change":"2024-09-12T17:10:48.546368+0000","last_active":"2024-09-12T18:11:09.805504+0000","last_peered":"2024-09-12T18:11:09.805504+0000","last_clean":"2024-09-12T18:11:09.805504+0000","last_became_active":"2024-09-12T17:10:48.546013+0000","last_became_peered":"2024-09-12T17:10:48.546013+0000","last_unstale":"2024-09-12T18:11:09.805504+0000","last_undegraded":"2024-09-12T18:11:09.805504+0000","last_fullsized":"2024-09-12T18:11:09.805504+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_clean_scrub_stamp":"2024-09-12T17:10:47.516917+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":100,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:18:06.234698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23628,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":220,"num_read_kb":307,"num_write":126,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"263'773","reported_seq":2656,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:13.440534+0000","last_change":"2024-09-12T17:10:50.558001+0000","last_active":"2024-09-12T18:11:13.440534+0000","last_peered":"2024-09-12T18:11:13.440534+0000","last_clean":"2024-09-12T18:11:13.440534+0000","last_became_active":"2024-09-12T17:10:50.557711+0000","last_became_peered":"2024-09-12T17:10:50.557711+0000","last_unstale":"2024-09-12T18:11:13.440534+0000","last_undegraded":"2024-09-12T18:11:13.440534+0000","last_fullsized":"2024-09-12T18:11:13.440534+0000","mapping_epoch":32,"log_start":"263'700","ondisk_log_start":"263'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_clean_scrub_stamp":"2024-09-12T17:10:49.533772+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":700,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:36:55.165115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"263'103","reported_seq":598,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:08.674351+0000","last_change":"2024-09-12T17:10:52.570339+0000","last_active":"2024-09-12T18:11:08.674351+0000","last_peered":"2024-09-12T18:11:08.674351+0000","last_clean":"2024-09-12T18:11:08.674351+0000","last_became_active":"2024-09-12T17:10:52.570034+0000","last_became_peered":"2024-09-12T17:10:52.570034+0000","last_unstale":"2024-09-12T18:11:08.674351+0000","last_undegraded":"2024-09-12T18:11:08.674351+0000","last_fullsized":"2024-09-12T18:11:08.674351+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:58:19.680712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":442,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":109,"num_read_kb":107,"num_write":228,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"263'457","reported_seq":1986,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:20.794887+0000","last_change":"2024-09-12T17:10:44.520428+0000","last_active":"2024-09-12T18:09:20.794887+0000","last_peered":"2024-09-12T18:09:20.794887+0000","last_clean":"2024-09-12T18:09:20.794887+0000","last_became_active":"2024-09-12T17:10:44.520043+0000","last_became_peered":"2024-09-12T17:10:44.520043+0000","last_unstale":"2024-09-12T18:09:20.794887+0000","last_undegraded":"2024-09-12T18:09:20.794887+0000","last_fullsized":"2024-09-12T18:09:20.794887+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":400,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:50:49.324285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2352,"num_read_kb":2214,"num_write":541,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"263'203","reported_seq":846,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:03.355938+0000","last_change":"2024-09-12T17:10:42.518917+0000","last_active":"2024-09-12T18:11:03.355938+0000","last_peered":"2024-09-12T18:11:03.355938+0000","last_clean":"2024-09-12T18:11:03.355938+0000","last_became_active":"2024-09-12T17:10:42.518472+0000","last_became_peered":"2024-09-12T17:10:42.518472+0000","last_unstale":"2024-09-12T18:11:03.355938+0000","last_undegraded":"2024-09-12T18:11:03.355938+0000","last_fullsized":"2024-09-12T18:11:03.355938+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:04:25.809640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16056255,"num_objects":13,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":441,"num_read_kb":52953,"num_write":1070,"num_write_kb":38599,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6,1],"acting":[5,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":495,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:29.840076+0000","last_change":"2024-09-12T17:10:46.532109+0000","last_active":"2024-09-12T18:09:29.840076+0000","last_peered":"2024-09-12T18:09:29.840076+0000","last_clean":"2024-09-12T18:09:29.840076+0000","last_became_active":"2024-09-12T17:10:46.531731+0000","last_became_peered":"2024-09-12T17:10:46.531731+0000","last_unstale":"2024-09-12T18:09:29.840076+0000","last_undegraded":"2024-09-12T18:09:29.840076+0000","last_fullsized":"2024-09-12T18:09:29.840076+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_clean_scrub_stamp":"2024-09-12T17:10:45.504515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:24:44.405982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"263'193","reported_seq":822,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:09.807770+0000","last_change":"2024-09-12T17:10:48.544969+0000","last_active":"2024-09-12T18:11:09.807770+0000","last_peered":"2024-09-12T18:11:09.807770+0000","last_clean":"2024-09-12T18:11:09.807770+0000","last_became_active":"2024-09-12T17:10:48.544653+0000","last_became_peered":"2024-09-12T17:10:48.544653+0000","last_unstale":"2024-09-12T18:11:09.807770+0000","last_undegraded":"2024-09-12T18:11:09.807770+0000","last_fullsized":"2024-09-12T18:11:09.807770+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_clean_scrub_stamp":"2024-09-12T17:10:47.516917+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:21:32.100821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25151,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":268,"num_read_kb":346,"num_write":134,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":487,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:19.838895+0000","last_change":"2024-09-12T17:10:50.555835+0000","last_active":"2024-09-12T18:09:19.838895+0000","last_peered":"2024-09-12T18:09:19.838895+0000","last_clean":"2024-09-12T18:09:19.838895+0000","last_became_active":"2024-09-12T17:10:50.555473+0000","last_became_peered":"2024-09-12T17:10:50.555473+0000","last_unstale":"2024-09-12T18:09:19.838895+0000","last_undegraded":"2024-09-12T18:09:19.838895+0000","last_fullsized":"2024-09-12T18:09:19.838895+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_clean_scrub_stamp":"2024-09-12T17:10:49.533772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:12:27.311695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"263'116","reported_seq":625,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:47.539870+0000","last_change":"2024-09-12T17:10:52.571536+0000","last_active":"2024-09-12T18:09:47.539870+0000","last_peered":"2024-09-12T18:09:47.539870+0000","last_clean":"2024-09-12T18:09:47.539870+0000","last_became_active":"2024-09-12T17:10:52.571225+0000","last_became_peered":"2024-09-12T17:10:52.571225+0000","last_unstale":"2024-09-12T18:09:47.539870+0000","last_undegraded":"2024-09-12T18:09:47.539870+0000","last_fullsized":"2024-09-12T18:09:47.539870+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:45:48.500746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":910,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":137,"num_read_kb":136,"num_write":254,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"263'472","reported_seq":2087,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:14.856043+0000","last_change":"2024-09-12T17:10:44.516642+0000","last_active":"2024-09-12T18:09:14.856043+0000","last_peered":"2024-09-12T18:09:14.856043+0000","last_clean":"2024-09-12T18:09:14.856043+0000","last_became_active":"2024-09-12T17:10:44.516255+0000","last_became_peered":"2024-09-12T17:10:44.516255+0000","last_unstale":"2024-09-12T18:09:14.856043+0000","last_undegraded":"2024-09-12T18:09:14.856043+0000","last_fullsized":"2024-09-12T18:09:14.856043+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":400,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:45:40.739871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2470,"num_read_kb":2330,"num_write":539,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"263'212","reported_seq":832,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:14.852416+0000","last_change":"2024-09-12T17:11:16.863136+0000","last_active":"2024-09-12T18:09:14.852416+0000","last_peered":"2024-09-12T18:09:14.852416+0000","last_clean":"2024-09-12T18:09:14.852416+0000","last_became_active":"2024-09-12T17:11:16.862702+0000","last_became_peered":"2024-09-12T17:11:16.862702+0000","last_unstale":"2024-09-12T18:09:14.852416+0000","last_undegraded":"2024-09-12T18:09:14.852416+0000","last_fullsized":"2024-09-12T18:09:14.852416+0000","mapping_epoch":37,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:54:19.503253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1109560,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":408,"num_read_kb":1752,"num_write":1047,"num_write_kb":46733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,4,7],"acting":[3,2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:19.838954+0000","last_change":"2024-09-12T17:10:46.525024+0000","last_active":"2024-09-12T18:09:19.838954+0000","last_peered":"2024-09-12T18:09:19.838954+0000","last_clean":"2024-09-12T18:09:19.838954+0000","last_became_active":"2024-09-12T17:10:46.524638+0000","last_became_peered":"2024-09-12T17:10:46.524638+0000","last_unstale":"2024-09-12T18:09:19.838954+0000","last_undegraded":"2024-09-12T18:09:19.838954+0000","last_fullsized":"2024-09-12T18:09:19.838954+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_clean_scrub_stamp":"2024-09-12T17:10:45.504515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:56:22.494536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"263'147","reported_seq":727,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:09.784043+0000","last_change":"2024-09-12T17:10:48.538217+0000","last_active":"2024-09-12T18:11:09.784043+0000","last_peered":"2024-09-12T18:11:09.784043+0000","last_clean":"2024-09-12T18:11:09.784043+0000","last_became_active":"2024-09-12T17:10:48.537923+0000","last_became_peered":"2024-09-12T17:10:48.537923+0000","last_unstale":"2024-09-12T18:11:09.784043+0000","last_undegraded":"2024-09-12T18:11:09.784043+0000","last_fullsized":"2024-09-12T18:11:09.784043+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_clean_scrub_stamp":"2024-09-12T17:10:47.516917+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:47:18.538568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9067,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":220,"num_read_kb":274,"num_write":174,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:14.830207+0000","last_change":"2024-09-12T17:10:50.563850+0000","last_active":"2024-09-12T18:07:14.830207+0000","last_peered":"2024-09-12T18:07:14.830207+0000","last_clean":"2024-09-12T18:07:14.830207+0000","last_became_active":"2024-09-12T17:10:50.563507+0000","last_became_peered":"2024-09-12T17:10:50.563507+0000","last_unstale":"2024-09-12T18:07:14.830207+0000","last_undegraded":"2024-09-12T18:07:14.830207+0000","last_fullsized":"2024-09-12T18:07:14.830207+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_clean_scrub_stamp":"2024-09-12T17:10:49.533772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:17:57.223763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"263'126","reported_seq":641,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:10:59.093495+0000","last_change":"2024-09-12T17:10:52.575633+0000","last_active":"2024-09-12T18:10:59.093495+0000","last_peered":"2024-09-12T18:10:59.093495+0000","last_clean":"2024-09-12T18:10:59.093495+0000","last_became_active":"2024-09-12T17:10:52.575293+0000","last_became_peered":"2024-09-12T17:10:52.575293+0000","last_unstale":"2024-09-12T18:10:59.093495+0000","last_undegraded":"2024-09-12T18:10:59.093495+0000","last_fullsized":"2024-09-12T18:10:59.093495+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:49:40.030320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":248,"num_read_kb":220,"num_write":319,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"263'995","reported_seq":2615,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:20.793923+0000","last_change":"2024-09-12T17:10:44.515402+0000","last_active":"2024-09-12T18:09:20.793923+0000","last_peered":"2024-09-12T18:09:20.793923+0000","last_clean":"2024-09-12T18:09:20.793923+0000","last_became_active":"2024-09-12T17:10:44.515098+0000","last_became_peered":"2024-09-12T17:10:44.515098+0000","last_unstale":"2024-09-12T18:09:20.793923+0000","last_undegraded":"2024-09-12T18:09:20.793923+0000","last_fullsized":"2024-09-12T18:09:20.793923+0000","mapping_epoch":26,"log_start":"263'900","ondisk_log_start":"263'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":900,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:51:18.883813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4616,"num_read_kb":4072,"num_write":1360,"num_write_kb":579,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"263'207","reported_seq":848,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:01.160601+0000","last_change":"2024-09-12T17:10:42.516962+0000","last_active":"2024-09-12T18:11:01.160601+0000","last_peered":"2024-09-12T18:11:01.160601+0000","last_clean":"2024-09-12T18:11:01.160601+0000","last_became_active":"2024-09-12T17:10:42.515480+0000","last_became_peered":"2024-09-12T17:10:42.515480+0000","last_unstale":"2024-09-12T18:11:01.160601+0000","last_undegraded":"2024-09-12T18:11:01.160601+0000","last_fullsized":"2024-09-12T18:11:01.160601+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:25:04.587903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9630485,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":505,"num_read_kb":28749,"num_write":1018,"num_write_kb":24822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1,7],"acting":[6,4,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:20.149012+0000","last_change":"2024-09-12T17:10:46.532868+0000","last_active":"2024-09-12T18:09:20.149012+0000","last_peered":"2024-09-12T18:09:20.149012+0000","last_clean":"2024-09-12T18:09:20.149012+0000","last_became_active":"2024-09-12T17:10:46.532552+0000","last_became_peered":"2024-09-12T17:10:46.532552+0000","last_unstale":"2024-09-12T18:09:20.149012+0000","last_undegraded":"2024-09-12T18:09:20.149012+0000","last_fullsized":"2024-09-12T18:09:20.149012+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_clean_scrub_stamp":"2024-09-12T17:10:45.504515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:36:03.282217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"263'169","reported_seq":750,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:29.840156+0000","last_change":"2024-09-12T17:10:48.542688+0000","last_active":"2024-09-12T18:09:29.840156+0000","last_peered":"2024-09-12T18:09:29.840156+0000","last_clean":"2024-09-12T18:09:29.840156+0000","last_became_active":"2024-09-12T17:10:48.542298+0000","last_became_peered":"2024-09-12T17:10:48.542298+0000","last_unstale":"2024-09-12T18:09:29.840156+0000","last_undegraded":"2024-09-12T18:09:29.840156+0000","last_fullsized":"2024-09-12T18:09:29.840156+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_clean_scrub_stamp":"2024-09-12T17:10:47.516917+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":100,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:38:39.389352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11085,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":224,"num_read_kb":293,"num_write":130,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"263'744","reported_seq":2522,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:13.432722+0000","last_change":"2024-09-12T17:10:50.557593+0000","last_active":"2024-09-12T18:11:13.432722+0000","last_peered":"2024-09-12T18:11:13.432722+0000","last_clean":"2024-09-12T18:11:13.432722+0000","last_became_active":"2024-09-12T17:10:50.557305+0000","last_became_peered":"2024-09-12T17:10:50.557305+0000","last_unstale":"2024-09-12T18:11:13.432722+0000","last_undegraded":"2024-09-12T18:11:13.432722+0000","last_fullsized":"2024-09-12T18:11:13.432722+0000","mapping_epoch":32,"log_start":"263'700","ondisk_log_start":"263'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_clean_scrub_stamp":"2024-09-12T17:10:49.533772+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":700,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:44:08.055041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"263'117","reported_seq":624,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:47.542189+0000","last_change":"2024-09-12T17:10:52.571748+0000","last_active":"2024-09-12T18:09:47.542189+0000","last_peered":"2024-09-12T18:09:47.542189+0000","last_clean":"2024-09-12T18:09:47.542189+0000","last_became_active":"2024-09-12T17:10:52.571344+0000","last_became_peered":"2024-09-12T17:10:52.571344+0000","last_unstale":"2024-09-12T18:09:47.542189+0000","last_undegraded":"2024-09-12T18:09:47.542189+0000","last_fullsized":"2024-09-12T18:09:47.542189+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:19:07.103069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1852,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":171,"num_read_kb":161,"num_write":288,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"263'486","reported_seq":2153,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:48.689779+0000","last_change":"2024-09-12T17:10:44.509586+0000","last_active":"2024-09-12T18:09:48.689779+0000","last_peered":"2024-09-12T18:09:48.689779+0000","last_clean":"2024-09-12T18:09:48.689779+0000","last_became_active":"2024-09-12T17:10:44.509293+0000","last_became_peered":"2024-09-12T17:10:44.509293+0000","last_unstale":"2024-09-12T18:09:48.689779+0000","last_undegraded":"2024-09-12T18:09:48.689779+0000","last_fullsized":"2024-09-12T18:09:48.689779+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":400,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:13:03.024067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2823,"num_read_kb":2653,"num_write":584,"num_write_kb":143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"263'175","reported_seq":827,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:14.855892+0000","last_change":"2024-09-12T17:10:42.516188+0000","last_active":"2024-09-12T18:09:14.855892+0000","last_peered":"2024-09-12T18:09:14.855892+0000","last_clean":"2024-09-12T18:09:14.855892+0000","last_became_active":"2024-09-12T17:10:42.515196+0000","last_became_peered":"2024-09-12T17:10:42.515196+0000","last_unstale":"2024-09-12T18:09:14.855892+0000","last_undegraded":"2024-09-12T18:09:14.855892+0000","last_fullsized":"2024-09-12T18:09:14.855892+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:13:54.380139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17064424,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":430,"num_read_kb":72229,"num_write":818,"num_write_kb":40150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7,1],"acting":[4,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"29'2","reported_seq":1443,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:09.544515+0000","last_change":"2024-09-12T17:10:46.531378+0000","last_active":"2024-09-12T18:11:09.544515+0000","last_peered":"2024-09-12T18:11:09.544515+0000","last_clean":"2024-09-12T18:11:09.544515+0000","last_became_active":"2024-09-12T17:10:46.531032+0000","last_became_peered":"2024-09-12T17:10:46.531032+0000","last_unstale":"2024-09-12T18:11:09.544515+0000","last_undegraded":"2024-09-12T18:11:09.544515+0000","last_fullsized":"2024-09-12T18:11:09.544515+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_clean_scrub_stamp":"2024-09-12T17:10:45.504515+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:26:08.381916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":946,"num_read_kb":946,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"263'77","reported_seq":600,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:49.555526+0000","last_change":"2024-09-12T17:10:48.533130+0000","last_active":"2024-09-12T18:09:49.555526+0000","last_peered":"2024-09-12T18:09:49.555526+0000","last_clean":"2024-09-12T18:09:49.555526+0000","last_became_active":"2024-09-12T17:10:48.532817+0000","last_became_peered":"2024-09-12T17:10:48.532817+0000","last_unstale":"2024-09-12T18:09:49.555526+0000","last_undegraded":"2024-09-12T18:09:49.555526+0000","last_fullsized":"2024-09-12T18:09:49.555526+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_clean_scrub_stamp":"2024-09-12T17:10:47.516917+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:42:42.609184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":90,"num_read_kb":85,"num_write":60,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"263'760","reported_seq":2401,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:13.435039+0000","last_change":"2024-09-12T17:10:50.563515+0000","last_active":"2024-09-12T18:11:13.435039+0000","last_peered":"2024-09-12T18:11:13.435039+0000","last_clean":"2024-09-12T18:11:13.435039+0000","last_became_active":"2024-09-12T17:10:50.563002+0000","last_became_peered":"2024-09-12T17:10:50.563002+0000","last_unstale":"2024-09-12T18:11:13.435039+0000","last_undegraded":"2024-09-12T18:11:13.435039+0000","last_fullsized":"2024-09-12T18:11:13.435039+0000","mapping_epoch":32,"log_start":"263'700","ondisk_log_start":"263'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_clean_scrub_stamp":"2024-09-12T17:10:49.533772+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":700,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:11:41.362558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"263'147","reported_seq":647,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:14.855949+0000","last_change":"2024-09-12T17:10:52.571064+0000","last_active":"2024-09-12T18:09:14.855949+0000","last_peered":"2024-09-12T18:09:14.855949+0000","last_clean":"2024-09-12T18:09:14.855949+0000","last_became_active":"2024-09-12T17:10:52.570643+0000","last_became_peered":"2024-09-12T17:10:52.570643+0000","last_unstale":"2024-09-12T18:09:14.855949+0000","last_undegraded":"2024-09-12T18:09:14.855949+0000","last_fullsized":"2024-09-12T18:09:14.855949+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:37:26.966557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":160,"num_read_kb":158,"num_write":329,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"263'804","reported_seq":2283,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:08.688392+0000","last_change":"2024-09-12T17:10:44.518421+0000","last_active":"2024-09-12T18:11:08.688392+0000","last_peered":"2024-09-12T18:11:08.688392+0000","last_clean":"2024-09-12T18:11:08.688392+0000","last_became_active":"2024-09-12T17:10:44.518111+0000","last_became_peered":"2024-09-12T17:10:44.518111+0000","last_unstale":"2024-09-12T18:11:08.688392+0000","last_undegraded":"2024-09-12T18:11:08.688392+0000","last_fullsized":"2024-09-12T18:11:08.688392+0000","mapping_epoch":26,"log_start":"263'700","ondisk_log_start":"263'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":700,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:24:42.388720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3856,"num_read_kb":3439,"num_write":1073,"num_write_kb":406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"263'208","reported_seq":828,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:14.852297+0000","last_change":"2024-09-12T17:10:42.523388+0000","last_active":"2024-09-12T18:09:14.852297+0000","last_peered":"2024-09-12T18:09:14.852297+0000","last_clean":"2024-09-12T18:09:14.852297+0000","last_became_active":"2024-09-12T17:10:42.522669+0000","last_became_peered":"2024-09-12T17:10:42.522669+0000","last_unstale":"2024-09-12T18:09:14.852297+0000","last_undegraded":"2024-09-12T18:09:14.852297+0000","last_fullsized":"2024-09-12T18:09:14.852297+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:12:18.298215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24007,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":433,"num_read_kb":8704,"num_write":948,"num_write_kb":27929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,4],"acting":[3,1,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":504,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:19.856844+0000","last_change":"2024-09-12T17:10:46.533907+0000","last_active":"2024-09-12T18:09:19.856844+0000","last_peered":"2024-09-12T18:09:19.856844+0000","last_clean":"2024-09-12T18:09:19.856844+0000","last_became_active":"2024-09-12T17:10:46.533572+0000","last_became_peered":"2024-09-12T17:10:46.533572+0000","last_unstale":"2024-09-12T18:09:19.856844+0000","last_undegraded":"2024-09-12T18:09:19.856844+0000","last_fullsized":"2024-09-12T18:09:19.856844+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_clean_scrub_stamp":"2024-09-12T17:10:45.504515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:00:02.576654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"263'242","reported_seq":848,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:09.799469+0000","last_change":"2024-09-12T17:10:48.543041+0000","last_active":"2024-09-12T18:11:09.799469+0000","last_peered":"2024-09-12T18:11:09.799469+0000","last_clean":"2024-09-12T18:11:09.799469+0000","last_became_active":"2024-09-12T17:10:48.542616+0000","last_became_peered":"2024-09-12T17:10:48.542616+0000","last_unstale":"2024-09-12T18:11:09.799469+0000","last_undegraded":"2024-09-12T18:11:09.799469+0000","last_fullsized":"2024-09-12T18:11:09.799469+0000","mapping_epoch":30,"log_start":"263'200","ondisk_log_start":"263'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_clean_scrub_stamp":"2024-09-12T17:10:47.516917+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":200,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:45:45.261917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11660,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":924,"num_read_kb":982,"num_write":1452,"num_write_kb":1312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":490,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:19.876828+0000","last_change":"2024-09-12T17:10:50.550499+0000","last_active":"2024-09-12T18:09:19.876828+0000","last_peered":"2024-09-12T18:09:19.876828+0000","last_clean":"2024-09-12T18:09:19.876828+0000","last_became_active":"2024-09-12T17:10:50.550189+0000","last_became_peered":"2024-09-12T17:10:50.550189+0000","last_unstale":"2024-09-12T18:09:19.876828+0000","last_undegraded":"2024-09-12T18:09:19.876828+0000","last_fullsized":"2024-09-12T18:09:19.876828+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_clean_scrub_stamp":"2024-09-12T17:10:49.533772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:28:44.908753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"263'162","reported_seq":671,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:08.680270+0000","last_change":"2024-09-12T17:10:52.572806+0000","last_active":"2024-09-12T18:11:08.680270+0000","last_peered":"2024-09-12T18:11:08.680270+0000","last_clean":"2024-09-12T18:11:08.680270+0000","last_became_active":"2024-09-12T17:10:52.572508+0000","last_became_peered":"2024-09-12T17:10:52.572508+0000","last_unstale":"2024-09-12T18:11:08.680270+0000","last_undegraded":"2024-09-12T18:11:08.680270+0000","last_fullsized":"2024-09-12T18:11:08.680270+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:47:56.176805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":869,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":242,"num_read_kb":227,"num_write":399,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"263'2313","reported_seq":3926,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:14.876101+0000","last_change":"2024-09-12T17:10:44.515810+0000","last_active":"2024-09-12T18:09:14.876101+0000","last_peered":"2024-09-12T18:09:14.876101+0000","last_clean":"2024-09-12T18:09:14.876101+0000","last_became_active":"2024-09-12T17:10:44.515045+0000","last_became_peered":"2024-09-12T17:10:44.515045+0000","last_unstale":"2024-09-12T18:09:14.876101+0000","last_undegraded":"2024-09-12T18:09:14.876101+0000","last_fullsized":"2024-09-12T18:09:14.876101+0000","mapping_epoch":26,"log_start":"263'2300","ondisk_log_start":"263'2300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":2300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:30:23.918147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10108,"num_read_kb":8675,"num_write":3400,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":612,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:39.851461+0000","last_change":"2024-09-12T17:10:26.808302+0000","last_active":"2024-09-12T18:08:39.851461+0000","last_peered":"2024-09-12T18:08:39.851461+0000","last_clean":"2024-09-12T18:08:39.851461+0000","last_became_active":"2024-09-12T17:10:26.807964+0000","last_became_peered":"2024-09-12T17:10:26.807964+0000","last_unstale":"2024-09-12T18:08:39.851461+0000","last_undegraded":"2024-09-12T18:08:39.851461+0000","last_fullsized":"2024-09-12T18:08:39.851461+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:25.795895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:25.795895+0000","last_clean_scrub_stamp":"2024-09-12T17:10:25.795895+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:28:36.202819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":524,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:54.852285+0000","last_change":"2024-09-12T17:10:33.852086+0000","last_active":"2024-09-12T18:08:54.852285+0000","last_peered":"2024-09-12T18:08:54.852285+0000","last_clean":"2024-09-12T18:08:54.852285+0000","last_became_active":"2024-09-12T17:10:31.846572+0000","last_became_peered":"2024-09-12T17:10:31.846572+0000","last_unstale":"2024-09-12T18:08:54.852285+0000","last_undegraded":"2024-09-12T18:08:54.852285+0000","last_fullsized":"2024-09-12T18:08:54.852285+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:30.818274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:30.818274+0000","last_clean_scrub_stamp":"2024-09-12T17:10:30.818274+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:56:58.387797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060306800000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"263'224","reported_seq":845,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:04.850991+0000","last_change":"2024-09-12T17:10:42.527885+0000","last_active":"2024-09-12T18:09:04.850991+0000","last_peered":"2024-09-12T18:09:04.850991+0000","last_clean":"2024-09-12T18:09:04.850991+0000","last_became_active":"2024-09-12T17:10:42.527288+0000","last_became_peered":"2024-09-12T17:10:42.527288+0000","last_unstale":"2024-09-12T18:09:04.850991+0000","last_undegraded":"2024-09-12T18:09:04.850991+0000","last_fullsized":"2024-09-12T18:09:04.850991+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":200,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:57:55.754980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5594817,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":421,"num_read_kb":3487,"num_write":1106,"num_write_kb":42610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6,4],"acting":[3,5,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"36'3","reported_seq":974,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:09.761135+0000","last_change":"2024-09-12T17:10:46.523567+0000","last_active":"2024-09-12T18:11:09.761135+0000","last_peered":"2024-09-12T18:11:09.761135+0000","last_clean":"2024-09-12T18:11:09.761135+0000","last_became_active":"2024-09-12T17:10:46.523069+0000","last_became_peered":"2024-09-12T17:10:46.523069+0000","last_unstale":"2024-09-12T18:11:09.761135+0000","last_undegraded":"2024-09-12T18:11:09.761135+0000","last_fullsized":"2024-09-12T18:11:09.761135+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_clean_scrub_stamp":"2024-09-12T17:10:45.504515+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:25:47.639083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":719,"num_read_kb":717,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"263'307","reported_seq":996,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:09.813067+0000","last_change":"2024-09-12T17:10:48.542799+0000","last_active":"2024-09-12T18:11:09.813067+0000","last_peered":"2024-09-12T18:11:09.813067+0000","last_clean":"2024-09-12T18:11:09.813067+0000","last_became_active":"2024-09-12T17:10:48.542462+0000","last_became_peered":"2024-09-12T17:10:48.542462+0000","last_unstale":"2024-09-12T18:11:09.813067+0000","last_undegraded":"2024-09-12T18:11:09.813067+0000","last_fullsized":"2024-09-12T18:11:09.813067+0000","mapping_epoch":30,"log_start":"260'200","ondisk_log_start":"260'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_clean_scrub_stamp":"2024-09-12T17:10:47.516917+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:44:47.123605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45201,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":584,"num_read_kb":807,"num_write":556,"num_write_kb":431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:19.845378+0000","last_change":"2024-09-12T17:10:50.558413+0000","last_active":"2024-09-12T18:09:19.845378+0000","last_peered":"2024-09-12T18:09:19.845378+0000","last_clean":"2024-09-12T18:09:19.845378+0000","last_became_active":"2024-09-12T17:10:50.558129+0000","last_became_peered":"2024-09-12T17:10:50.558129+0000","last_unstale":"2024-09-12T18:09:19.845378+0000","last_undegraded":"2024-09-12T18:09:19.845378+0000","last_fullsized":"2024-09-12T18:09:19.845378+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_clean_scrub_stamp":"2024-09-12T17:10:49.533772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:10:19.749294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"263'213","reported_seq":930,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:49.576469+0000","last_change":"2024-09-12T17:10:52.574735+0000","last_active":"2024-09-12T18:09:49.576469+0000","last_peered":"2024-09-12T18:09:49.576469+0000","last_clean":"2024-09-12T18:09:49.576469+0000","last_became_active":"2024-09-12T17:10:52.574433+0000","last_became_peered":"2024-09-12T17:10:52.574433+0000","last_unstale":"2024-09-12T18:09:49.576469+0000","last_undegraded":"2024-09-12T18:09:49.576469+0000","last_fullsized":"2024-09-12T18:09:49.576469+0000","mapping_epoch":34,"log_start":"263'200","ondisk_log_start":"263'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:43:52.722409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":852,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":555,"num_read_kb":537,"num_write":455,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"263'582","reported_seq":2168,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:14.844578+0000","last_change":"2024-09-12T17:10:44.520786+0000","last_active":"2024-09-12T18:09:14.844578+0000","last_peered":"2024-09-12T18:09:14.844578+0000","last_clean":"2024-09-12T18:09:14.844578+0000","last_became_active":"2024-09-12T17:10:44.520484+0000","last_became_peered":"2024-09-12T17:10:44.520484+0000","last_unstale":"2024-09-12T18:09:14.844578+0000","last_undegraded":"2024-09-12T18:09:14.844578+0000","last_fullsized":"2024-09-12T18:09:14.844578+0000","mapping_epoch":26,"log_start":"263'500","ondisk_log_start":"263'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":500,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:09:07.335121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3105,"num_read_kb":2836,"num_write":745,"num_write_kb":252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":520,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:44.852139+0000","last_change":"2024-09-12T17:10:33.955353+0000","last_active":"2024-09-12T18:08:44.852139+0000","last_peered":"2024-09-12T18:08:44.852139+0000","last_clean":"2024-09-12T18:08:44.852139+0000","last_became_active":"2024-09-12T17:10:31.848972+0000","last_became_peered":"2024-09-12T17:10:31.848972+0000","last_unstale":"2024-09-12T18:08:44.852139+0000","last_undegraded":"2024-09-12T18:08:44.852139+0000","last_fullsized":"2024-09-12T18:08:44.852139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:30.818274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:30.818274+0000","last_clean_scrub_stamp":"2024-09-12T17:10:30.818274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:42:53.392909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054881099999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"263'244","reported_seq":889,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:04.843177+0000","last_change":"2024-09-12T17:10:42.518587+0000","last_active":"2024-09-12T18:09:04.843177+0000","last_peered":"2024-09-12T18:09:04.843177+0000","last_clean":"2024-09-12T18:09:04.843177+0000","last_became_active":"2024-09-12T17:10:42.518190+0000","last_became_peered":"2024-09-12T17:10:42.518190+0000","last_unstale":"2024-09-12T18:09:04.843177+0000","last_undegraded":"2024-09-12T18:09:04.843177+0000","last_fullsized":"2024-09-12T18:09:04.843177+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":200,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:06:38.991314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10490388,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":519,"num_read_kb":6824,"num_write":1146,"num_write_kb":47378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3,5],"acting":[0,4,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:19.856009+0000","last_change":"2024-09-12T17:10:46.528521+0000","last_active":"2024-09-12T18:09:19.856009+0000","last_peered":"2024-09-12T18:09:19.856009+0000","last_clean":"2024-09-12T18:09:19.856009+0000","last_became_active":"2024-09-12T17:10:46.528192+0000","last_became_peered":"2024-09-12T17:10:46.528192+0000","last_unstale":"2024-09-12T18:09:19.856009+0000","last_undegraded":"2024-09-12T18:09:19.856009+0000","last_fullsized":"2024-09-12T18:09:19.856009+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_clean_scrub_stamp":"2024-09-12T17:10:45.504515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:16:33.943407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"263'863","reported_seq":2511,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:13.396596+0000","last_change":"2024-09-12T17:10:48.545160+0000","last_active":"2024-09-12T18:11:13.396596+0000","last_peered":"2024-09-12T18:11:13.396596+0000","last_clean":"2024-09-12T18:11:13.396596+0000","last_became_active":"2024-09-12T17:10:48.544823+0000","last_became_peered":"2024-09-12T17:10:48.544823+0000","last_unstale":"2024-09-12T18:11:13.396596+0000","last_undegraded":"2024-09-12T18:11:13.396596+0000","last_fullsized":"2024-09-12T18:11:13.396596+0000","mapping_epoch":30,"log_start":"263'800","ondisk_log_start":"263'800","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_clean_scrub_stamp":"2024-09-12T17:10:47.516917+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":800,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:10:40.793586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27599,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1167,"num_read_kb":1295,"num_write":300,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":489,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:19.857221+0000","last_change":"2024-09-12T17:10:50.557996+0000","last_active":"2024-09-12T18:09:19.857221+0000","last_peered":"2024-09-12T18:09:19.857221+0000","last_clean":"2024-09-12T18:09:19.857221+0000","last_became_active":"2024-09-12T17:10:50.557660+0000","last_became_peered":"2024-09-12T17:10:50.557660+0000","last_unstale":"2024-09-12T18:09:19.857221+0000","last_undegraded":"2024-09-12T18:09:19.857221+0000","last_fullsized":"2024-09-12T18:09:19.857221+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_clean_scrub_stamp":"2024-09-12T17:10:49.533772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:34:55.114972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"263'187","reported_seq":753,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:49.249649+0000","last_change":"2024-09-12T17:10:52.671428+0000","last_active":"2024-09-12T18:09:49.249649+0000","last_peered":"2024-09-12T18:09:49.249649+0000","last_clean":"2024-09-12T18:09:49.249649+0000","last_became_active":"2024-09-12T17:10:52.671120+0000","last_became_peered":"2024-09-12T17:10:52.671120+0000","last_unstale":"2024-09-12T18:09:49.249649+0000","last_undegraded":"2024-09-12T18:09:49.249649+0000","last_fullsized":"2024-09-12T18:09:49.249649+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:54:33.827731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":855,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":437,"num_read_kb":369,"num_write":356,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"263'338","reported_seq":1688,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:15.148495+0000","last_change":"2024-09-12T17:10:44.516968+0000","last_active":"2024-09-12T18:09:15.148495+0000","last_peered":"2024-09-12T18:09:15.148495+0000","last_clean":"2024-09-12T18:09:15.148495+0000","last_became_active":"2024-09-12T17:10:44.516640+0000","last_became_peered":"2024-09-12T17:10:44.516640+0000","last_unstale":"2024-09-12T18:09:15.148495+0000","last_undegraded":"2024-09-12T18:09:15.148495+0000","last_fullsized":"2024-09-12T18:09:15.148495+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:49:32.830701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1748,"num_read_kb":1673,"num_write":375,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":519,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:54.836450+0000","last_change":"2024-09-12T17:10:34.162797+0000","last_active":"2024-09-12T18:08:54.836450+0000","last_peered":"2024-09-12T18:08:54.836450+0000","last_clean":"2024-09-12T18:08:54.836450+0000","last_became_active":"2024-09-12T17:10:31.841982+0000","last_became_peered":"2024-09-12T17:10:31.841982+0000","last_unstale":"2024-09-12T18:08:54.836450+0000","last_undegraded":"2024-09-12T18:08:54.836450+0000","last_fullsized":"2024-09-12T18:08:54.836450+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:30.818274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:30.818274+0000","last_clean_scrub_stamp":"2024-09-12T17:10:30.818274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:00:41.985746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00030998799999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"263'164","reported_seq":779,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:50.145702+0000","last_change":"2024-09-12T17:10:42.509801+0000","last_active":"2024-09-12T18:08:50.145702+0000","last_peered":"2024-09-12T18:08:50.145702+0000","last_clean":"2024-09-12T18:08:50.145702+0000","last_became_active":"2024-09-12T17:10:42.509396+0000","last_became_peered":"2024-09-12T17:10:42.509396+0000","last_unstale":"2024-09-12T18:08:50.145702+0000","last_undegraded":"2024-09-12T18:08:50.145702+0000","last_fullsized":"2024-09-12T18:08:50.145702+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":100,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:19:48.419548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5624297,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":375,"num_read_kb":11016,"num_write":841,"num_write_kb":10341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6,5],"acting":[1,2,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"29'1","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:19.838982+0000","last_change":"2024-09-12T17:10:46.529416+0000","last_active":"2024-09-12T18:09:19.838982+0000","last_peered":"2024-09-12T18:09:19.838982+0000","last_clean":"2024-09-12T18:09:19.838982+0000","last_became_active":"2024-09-12T17:10:46.528878+0000","last_became_peered":"2024-09-12T17:10:46.528878+0000","last_unstale":"2024-09-12T18:09:19.838982+0000","last_undegraded":"2024-09-12T18:09:19.838982+0000","last_fullsized":"2024-09-12T18:09:19.838982+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_clean_scrub_stamp":"2024-09-12T17:10:45.504515+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:07:39.857190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"263'250","reported_seq":1512,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:09.987483+0000","last_change":"2024-09-12T17:10:48.544016+0000","last_active":"2024-09-12T18:11:09.987483+0000","last_peered":"2024-09-12T18:11:09.987483+0000","last_clean":"2024-09-12T18:11:09.987483+0000","last_became_active":"2024-09-12T17:10:48.543196+0000","last_became_peered":"2024-09-12T17:10:48.543196+0000","last_unstale":"2024-09-12T18:11:09.987483+0000","last_undegraded":"2024-09-12T18:11:09.987483+0000","last_fullsized":"2024-09-12T18:11:09.987483+0000","mapping_epoch":30,"log_start":"263'200","ondisk_log_start":"263'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_clean_scrub_stamp":"2024-09-12T17:10:47.516917+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":200,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:18:29.037042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":209,"num_read_kb":201,"num_write":185,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":495,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:09.843829+0000","last_change":"2024-09-12T17:10:50.559244+0000","last_active":"2024-09-12T18:09:09.843829+0000","last_peered":"2024-09-12T18:09:09.843829+0000","last_clean":"2024-09-12T18:09:09.843829+0000","last_became_active":"2024-09-12T17:10:50.558980+0000","last_became_peered":"2024-09-12T17:10:50.558980+0000","last_unstale":"2024-09-12T18:09:09.843829+0000","last_undegraded":"2024-09-12T18:09:09.843829+0000","last_fullsized":"2024-09-12T18:09:09.843829+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_clean_scrub_stamp":"2024-09-12T17:10:49.533772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:56:03.520861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"263'256","reported_seq":854,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:49.824162+0000","last_change":"2024-09-12T17:10:52.564338+0000","last_active":"2024-09-12T18:09:49.824162+0000","last_peered":"2024-09-12T18:09:49.824162+0000","last_clean":"2024-09-12T18:09:49.824162+0000","last_became_active":"2024-09-12T17:10:52.563885+0000","last_became_peered":"2024-09-12T17:10:52.563885+0000","last_unstale":"2024-09-12T18:09:49.824162+0000","last_undegraded":"2024-09-12T18:09:49.824162+0000","last_fullsized":"2024-09-12T18:09:49.824162+0000","mapping_epoch":34,"log_start":"263'200","ondisk_log_start":"263'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":200,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:12:03.079469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":520,"num_read_kb":542,"num_write":569,"num_write_kb":161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"263'664","reported_seq":2208,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:05.147309+0000","last_change":"2024-09-12T17:10:44.516073+0000","last_active":"2024-09-12T18:09:05.147309+0000","last_peered":"2024-09-12T18:09:05.147309+0000","last_clean":"2024-09-12T18:09:05.147309+0000","last_became_active":"2024-09-12T17:10:44.515807+0000","last_became_peered":"2024-09-12T17:10:44.515807+0000","last_unstale":"2024-09-12T18:09:05.147309+0000","last_undegraded":"2024-09-12T18:09:05.147309+0000","last_fullsized":"2024-09-12T18:09:05.147309+0000","mapping_epoch":26,"log_start":"263'600","ondisk_log_start":"263'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":600,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:25:36.561047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3415,"num_read_kb":3057,"num_write":984,"num_write_kb":466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":525,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:54.852239+0000","last_change":"2024-09-12T17:10:33.852654+0000","last_active":"2024-09-12T18:08:54.852239+0000","last_peered":"2024-09-12T18:08:54.852239+0000","last_clean":"2024-09-12T18:08:54.852239+0000","last_became_active":"2024-09-12T17:10:31.849085+0000","last_became_peered":"2024-09-12T17:10:31.849085+0000","last_unstale":"2024-09-12T18:08:54.852239+0000","last_undegraded":"2024-09-12T18:08:54.852239+0000","last_fullsized":"2024-09-12T18:08:54.852239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:30.818274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:30.818274+0000","last_clean_scrub_stamp":"2024-09-12T17:10:30.818274+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:06:13.863048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011727,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"263'229","reported_seq":920,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:04.854500+0000","last_change":"2024-09-12T17:10:42.529838+0000","last_active":"2024-09-12T18:09:04.854500+0000","last_peered":"2024-09-12T18:09:04.854500+0000","last_clean":"2024-09-12T18:09:04.854500+0000","last_became_active":"2024-09-12T17:10:42.529499+0000","last_became_peered":"2024-09-12T17:10:42.529499+0000","last_unstale":"2024-09-12T18:09:04.854500+0000","last_undegraded":"2024-09-12T18:09:04.854500+0000","last_fullsized":"2024-09-12T18:09:04.854500+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":200,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:16:13.720843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":310931,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":562,"num_read_kb":10247,"num_write":1097,"num_write_kb":30448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,6],"acting":[4,5,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":503,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:19.845346+0000","last_change":"2024-09-12T17:10:46.526726+0000","last_active":"2024-09-12T18:09:19.845346+0000","last_peered":"2024-09-12T18:09:19.845346+0000","last_clean":"2024-09-12T18:09:19.845346+0000","last_became_active":"2024-09-12T17:10:46.526136+0000","last_became_peered":"2024-09-12T17:10:46.526136+0000","last_unstale":"2024-09-12T18:09:19.845346+0000","last_undegraded":"2024-09-12T18:09:19.845346+0000","last_fullsized":"2024-09-12T18:09:19.845346+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_clean_scrub_stamp":"2024-09-12T17:10:45.504515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:44:29.040188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"263'139","reported_seq":685,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:09.997112+0000","last_change":"2024-09-12T17:10:48.536587+0000","last_active":"2024-09-12T18:11:09.997112+0000","last_peered":"2024-09-12T18:11:09.997112+0000","last_clean":"2024-09-12T18:11:09.997112+0000","last_became_active":"2024-09-12T17:10:48.536247+0000","last_became_peered":"2024-09-12T17:10:48.536247+0000","last_unstale":"2024-09-12T18:11:09.997112+0000","last_undegraded":"2024-09-12T18:11:09.997112+0000","last_fullsized":"2024-09-12T18:11:09.997112+0000","mapping_epoch":30,"log_start":"263'100","ondisk_log_start":"263'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_clean_scrub_stamp":"2024-09-12T17:10:47.516917+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:26:17.588873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":163,"num_read_kb":156,"num_write":120,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":491,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:19.876894+0000","last_change":"2024-09-12T17:10:50.556253+0000","last_active":"2024-09-12T18:09:19.876894+0000","last_peered":"2024-09-12T18:09:19.876894+0000","last_clean":"2024-09-12T18:09:19.876894+0000","last_became_active":"2024-09-12T17:10:50.555747+0000","last_became_peered":"2024-09-12T17:10:50.555747+0000","last_unstale":"2024-09-12T18:09:19.876894+0000","last_undegraded":"2024-09-12T18:09:19.876894+0000","last_fullsized":"2024-09-12T18:09:19.876894+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_clean_scrub_stamp":"2024-09-12T17:10:49.533772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:17:05.525534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"263'122","reported_seq":667,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:24.858258+0000","last_change":"2024-09-12T17:10:52.575248+0000","last_active":"2024-09-12T18:09:24.858258+0000","last_peered":"2024-09-12T18:09:24.858258+0000","last_clean":"2024-09-12T18:09:24.858258+0000","last_became_active":"2024-09-12T17:10:52.574956+0000","last_became_peered":"2024-09-12T17:10:52.574956+0000","last_unstale":"2024-09-12T18:09:24.858258+0000","last_undegraded":"2024-09-12T18:09:24.858258+0000","last_fullsized":"2024-09-12T18:09:24.858258+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:35:51.476345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":427,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":242,"num_read_kb":241,"num_write":285,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"263'471","reported_seq":2077,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:08.688603+0000","last_change":"2024-09-12T17:10:44.516554+0000","last_active":"2024-09-12T18:11:08.688603+0000","last_peered":"2024-09-12T18:11:08.688603+0000","last_clean":"2024-09-12T18:11:08.688603+0000","last_became_active":"2024-09-12T17:10:44.516258+0000","last_became_peered":"2024-09-12T17:10:44.516258+0000","last_unstale":"2024-09-12T18:11:08.688603+0000","last_undegraded":"2024-09-12T18:11:08.688603+0000","last_fullsized":"2024-09-12T18:11:08.688603+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":400,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:22:51.498940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2512,"num_read_kb":2369,"num_write":577,"num_write_kb":149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"263'179","reported_seq":878,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:19.855946+0000","last_change":"2024-09-12T17:10:42.521202+0000","last_active":"2024-09-12T18:09:19.855946+0000","last_peered":"2024-09-12T18:09:19.855946+0000","last_clean":"2024-09-12T18:09:19.855946+0000","last_became_active":"2024-09-12T17:10:42.520777+0000","last_became_peered":"2024-09-12T17:10:42.520777+0000","last_unstale":"2024-09-12T18:09:19.855946+0000","last_undegraded":"2024-09-12T18:09:19.855946+0000","last_fullsized":"2024-09-12T18:09:19.855946+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:17:55.542119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5297338,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":571,"num_read_kb":36969,"num_write":893,"num_write_kb":42705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":529,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:55.146233+0000","last_change":"2024-09-12T17:10:33.854505+0000","last_active":"2024-09-12T18:08:55.146233+0000","last_peered":"2024-09-12T18:08:55.146233+0000","last_clean":"2024-09-12T18:08:55.146233+0000","last_became_active":"2024-09-12T17:10:32.177463+0000","last_became_peered":"2024-09-12T17:10:32.177463+0000","last_unstale":"2024-09-12T18:08:55.146233+0000","last_undegraded":"2024-09-12T18:08:55.146233+0000","last_fullsized":"2024-09-12T18:08:55.146233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:30.818274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:30.818274+0000","last_clean_scrub_stamp":"2024-09-12T17:10:30.818274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:37:29.735097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059857599999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":503,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:09.843813+0000","last_change":"2024-09-12T17:10:46.528815+0000","last_active":"2024-09-12T18:09:09.843813+0000","last_peered":"2024-09-12T18:09:09.843813+0000","last_clean":"2024-09-12T18:09:09.843813+0000","last_became_active":"2024-09-12T17:10:46.528499+0000","last_became_peered":"2024-09-12T17:10:46.528499+0000","last_unstale":"2024-09-12T18:09:09.843813+0000","last_undegraded":"2024-09-12T18:09:09.843813+0000","last_fullsized":"2024-09-12T18:09:09.843813+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_clean_scrub_stamp":"2024-09-12T17:10:45.504515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:46:42.455244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"263'269","reported_seq":933,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:09.793120+0000","last_change":"2024-09-12T17:10:48.540277+0000","last_active":"2024-09-12T18:11:09.793120+0000","last_peered":"2024-09-12T18:11:09.793120+0000","last_clean":"2024-09-12T18:11:09.793120+0000","last_became_active":"2024-09-12T17:10:48.539913+0000","last_became_peered":"2024-09-12T17:10:48.539913+0000","last_unstale":"2024-09-12T18:11:09.793120+0000","last_undegraded":"2024-09-12T18:11:09.793120+0000","last_fullsized":"2024-09-12T18:11:09.793120+0000","mapping_epoch":30,"log_start":"260'200","ondisk_log_start":"260'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_clean_scrub_stamp":"2024-09-12T17:10:47.516917+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:02:55.603063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15979,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":372,"num_read_kb":444,"num_write":214,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":498,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:09.855203+0000","last_change":"2024-09-12T17:10:50.555362+0000","last_active":"2024-09-12T18:09:09.855203+0000","last_peered":"2024-09-12T18:09:09.855203+0000","last_clean":"2024-09-12T18:09:09.855203+0000","last_became_active":"2024-09-12T17:10:50.555068+0000","last_became_peered":"2024-09-12T17:10:50.555068+0000","last_unstale":"2024-09-12T18:09:09.855203+0000","last_undegraded":"2024-09-12T18:09:09.855203+0000","last_fullsized":"2024-09-12T18:09:09.855203+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_clean_scrub_stamp":"2024-09-12T17:10:49.533772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:07:39.703527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"263'153","reported_seq":659,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:46.594011+0000","last_change":"2024-09-12T17:10:52.671530+0000","last_active":"2024-09-12T18:09:46.594011+0000","last_peered":"2024-09-12T18:09:46.594011+0000","last_clean":"2024-09-12T18:09:46.594011+0000","last_became_active":"2024-09-12T17:10:52.671238+0000","last_became_peered":"2024-09-12T17:10:52.671238+0000","last_unstale":"2024-09-12T18:09:46.594011+0000","last_undegraded":"2024-09-12T18:09:46.594011+0000","last_fullsized":"2024-09-12T18:09:46.594011+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:56:27.646939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":925,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":183,"num_read_kb":179,"num_write":356,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"263'539","reported_seq":2231,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:49.548593+0000","last_change":"2024-09-12T17:10:44.513894+0000","last_active":"2024-09-12T18:09:49.548593+0000","last_peered":"2024-09-12T18:09:49.548593+0000","last_clean":"2024-09-12T18:09:49.548593+0000","last_became_active":"2024-09-12T17:10:44.513543+0000","last_became_peered":"2024-09-12T17:10:44.513543+0000","last_unstale":"2024-09-12T18:09:49.548593+0000","last_undegraded":"2024-09-12T18:09:49.548593+0000","last_fullsized":"2024-09-12T18:09:49.548593+0000","mapping_epoch":26,"log_start":"263'500","ondisk_log_start":"263'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":500,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:52:06.056418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3000,"num_read_kb":2785,"num_write":670,"num_write_kb":215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"263'211","reported_seq":890,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:05.147290+0000","last_change":"2024-09-12T17:10:42.524565+0000","last_active":"2024-09-12T18:09:05.147290+0000","last_peered":"2024-09-12T18:09:05.147290+0000","last_clean":"2024-09-12T18:09:05.147290+0000","last_became_active":"2024-09-12T17:10:42.524130+0000","last_became_peered":"2024-09-12T17:10:42.524130+0000","last_unstale":"2024-09-12T18:09:05.147290+0000","last_undegraded":"2024-09-12T18:09:05.147290+0000","last_fullsized":"2024-09-12T18:09:05.147290+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:41:13.724342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12701364,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":583,"num_read_kb":68430,"num_write":1037,"num_write_kb":36992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,5],"acting":[1,2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":519,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:04.854964+0000","last_change":"2024-09-12T17:10:33.955366+0000","last_active":"2024-09-12T18:09:04.854964+0000","last_peered":"2024-09-12T18:09:04.854964+0000","last_clean":"2024-09-12T18:09:04.854964+0000","last_became_active":"2024-09-12T17:10:32.177457+0000","last_became_peered":"2024-09-12T17:10:32.177457+0000","last_unstale":"2024-09-12T18:09:04.854964+0000","last_undegraded":"2024-09-12T18:09:04.854964+0000","last_fullsized":"2024-09-12T18:09:04.854964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:30.818274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:30.818274+0000","last_clean_scrub_stamp":"2024-09-12T17:10:30.818274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:40:39.661808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000468751,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":500,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:09.875290+0000","last_change":"2024-09-12T17:10:46.527702+0000","last_active":"2024-09-12T18:09:09.875290+0000","last_peered":"2024-09-12T18:09:09.875290+0000","last_clean":"2024-09-12T18:09:09.875290+0000","last_became_active":"2024-09-12T17:10:46.527299+0000","last_became_peered":"2024-09-12T17:10:46.527299+0000","last_unstale":"2024-09-12T18:09:09.875290+0000","last_undegraded":"2024-09-12T18:09:09.875290+0000","last_fullsized":"2024-09-12T18:09:09.875290+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_clean_scrub_stamp":"2024-09-12T17:10:45.504515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:20:28.139339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"263'234","reported_seq":808,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:58.608748+0000","last_change":"2024-09-12T17:10:48.539230+0000","last_active":"2024-09-12T18:09:58.608748+0000","last_peered":"2024-09-12T18:09:58.608748+0000","last_clean":"2024-09-12T18:09:58.608748+0000","last_became_active":"2024-09-12T17:10:48.538190+0000","last_became_peered":"2024-09-12T17:10:48.538190+0000","last_unstale":"2024-09-12T18:09:58.608748+0000","last_undegraded":"2024-09-12T18:09:58.608748+0000","last_fullsized":"2024-09-12T18:09:58.608748+0000","mapping_epoch":30,"log_start":"263'200","ondisk_log_start":"263'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_clean_scrub_stamp":"2024-09-12T17:10:47.516917+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":200,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:41:22.031248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":276,"num_read_kb":262,"num_write":250,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"263'776","reported_seq":2749,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:13.140241+0000","last_change":"2024-09-12T17:10:50.562034+0000","last_active":"2024-09-12T18:11:13.140241+0000","last_peered":"2024-09-12T18:11:13.140241+0000","last_clean":"2024-09-12T18:11:13.140241+0000","last_became_active":"2024-09-12T17:10:50.561112+0000","last_became_peered":"2024-09-12T17:10:50.561112+0000","last_unstale":"2024-09-12T18:11:13.140241+0000","last_undegraded":"2024-09-12T18:11:13.140241+0000","last_fullsized":"2024-09-12T18:11:13.140241+0000","mapping_epoch":32,"log_start":"263'700","ondisk_log_start":"263'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_clean_scrub_stamp":"2024-09-12T17:10:49.533772+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":700,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:22:47.285499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"263'97","reported_seq":608,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:39.855795+0000","last_change":"2024-09-12T17:10:52.672259+0000","last_active":"2024-09-12T18:09:39.855795+0000","last_peered":"2024-09-12T18:09:39.855795+0000","last_clean":"2024-09-12T18:09:39.855795+0000","last_became_active":"2024-09-12T17:10:52.671116+0000","last_became_peered":"2024-09-12T17:10:52.671116+0000","last_unstale":"2024-09-12T18:09:39.855795+0000","last_undegraded":"2024-09-12T18:09:39.855795+0000","last_fullsized":"2024-09-12T18:09:39.855795+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:05:09.882357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":505,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":188,"num_read_kb":171,"num_write":234,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"263'777","reported_seq":2421,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:49.547019+0000","last_change":"2024-09-12T17:10:44.512159+0000","last_active":"2024-09-12T18:09:49.547019+0000","last_peered":"2024-09-12T18:09:49.547019+0000","last_clean":"2024-09-12T18:09:49.547019+0000","last_became_active":"2024-09-12T17:10:44.511450+0000","last_became_peered":"2024-09-12T17:10:44.511450+0000","last_unstale":"2024-09-12T18:09:49.547019+0000","last_undegraded":"2024-09-12T18:09:49.547019+0000","last_fullsized":"2024-09-12T18:09:49.547019+0000","mapping_epoch":26,"log_start":"263'700","ondisk_log_start":"263'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":700,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:25:36.561047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3773,"num_read_kb":3378,"num_write":1080,"num_write_kb":423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"263'165","reported_seq":747,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:14.852528+0000","last_change":"2024-09-12T17:10:42.526880+0000","last_active":"2024-09-12T18:09:14.852528+0000","last_peered":"2024-09-12T18:09:14.852528+0000","last_clean":"2024-09-12T18:09:14.852528+0000","last_became_active":"2024-09-12T17:10:42.526472+0000","last_became_peered":"2024-09-12T17:10:42.526472+0000","last_unstale":"2024-09-12T18:09:14.852528+0000","last_undegraded":"2024-09-12T18:09:14.852528+0000","last_fullsized":"2024-09-12T18:09:14.852528+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:45:58.908363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6295552,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":298,"num_read_kb":1418,"num_write":795,"num_write_kb":46804,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,0],"acting":[3,5,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":528,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:05.147338+0000","last_change":"2024-09-12T17:10:33.854523+0000","last_active":"2024-09-12T18:09:05.147338+0000","last_peered":"2024-09-12T18:09:05.147338+0000","last_clean":"2024-09-12T18:09:05.147338+0000","last_became_active":"2024-09-12T17:10:31.845481+0000","last_became_peered":"2024-09-12T17:10:31.845481+0000","last_unstale":"2024-09-12T18:09:05.147338+0000","last_undegraded":"2024-09-12T18:09:05.147338+0000","last_fullsized":"2024-09-12T18:09:05.147338+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:30.818274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:30.818274+0000","last_clean_scrub_stamp":"2024-09-12T17:10:30.818274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:06:13.863048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060466100000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":506,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:09.855182+0000","last_change":"2024-09-12T17:10:46.530614+0000","last_active":"2024-09-12T18:09:09.855182+0000","last_peered":"2024-09-12T18:09:09.855182+0000","last_clean":"2024-09-12T18:09:09.855182+0000","last_became_active":"2024-09-12T17:10:46.530275+0000","last_became_peered":"2024-09-12T17:10:46.530275+0000","last_unstale":"2024-09-12T18:09:09.855182+0000","last_undegraded":"2024-09-12T18:09:09.855182+0000","last_fullsized":"2024-09-12T18:09:09.855182+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_clean_scrub_stamp":"2024-09-12T17:10:45.504515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:08:24.007031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"263'128","reported_seq":676,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:09.855223+0000","last_change":"2024-09-12T17:10:48.542113+0000","last_active":"2024-09-12T18:09:09.855223+0000","last_peered":"2024-09-12T18:09:09.855223+0000","last_clean":"2024-09-12T18:09:09.855223+0000","last_became_active":"2024-09-12T17:10:48.541795+0000","last_became_peered":"2024-09-12T17:10:48.541795+0000","last_unstale":"2024-09-12T18:09:09.855223+0000","last_undegraded":"2024-09-12T18:09:09.855223+0000","last_fullsized":"2024-09-12T18:09:09.855223+0000","mapping_epoch":30,"log_start":"263'100","ondisk_log_start":"263'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_clean_scrub_stamp":"2024-09-12T17:10:47.516917+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:48:37.106733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":142,"num_read_kb":133,"num_write":96,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"263'787","reported_seq":4447,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:13.436826+0000","last_change":"2024-09-12T17:10:50.560337+0000","last_active":"2024-09-12T18:11:13.436826+0000","last_peered":"2024-09-12T18:11:13.436826+0000","last_clean":"2024-09-12T18:11:13.436826+0000","last_became_active":"2024-09-12T17:10:50.559932+0000","last_became_peered":"2024-09-12T17:10:50.559932+0000","last_unstale":"2024-09-12T18:11:13.436826+0000","last_undegraded":"2024-09-12T18:11:13.436826+0000","last_fullsized":"2024-09-12T18:11:13.436826+0000","mapping_epoch":32,"log_start":"263'700","ondisk_log_start":"263'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_clean_scrub_stamp":"2024-09-12T17:10:49.533772+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":700,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:05:17.277375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"263'288","reported_seq":829,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:24.845948+0000","last_change":"2024-09-12T17:10:52.570934+0000","last_active":"2024-09-12T18:09:24.845948+0000","last_peered":"2024-09-12T18:09:24.845948+0000","last_clean":"2024-09-12T18:09:24.845948+0000","last_became_active":"2024-09-12T17:10:52.570545+0000","last_became_peered":"2024-09-12T17:10:52.570545+0000","last_unstale":"2024-09-12T18:09:24.845948+0000","last_undegraded":"2024-09-12T18:09:24.845948+0000","last_fullsized":"2024-09-12T18:09:24.845948+0000","mapping_epoch":34,"log_start":"263'200","ondisk_log_start":"263'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:15:52.985878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":466,"num_read_kb":447,"num_write":645,"num_write_kb":207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"263'471","reported_seq":1901,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:20.793547+0000","last_change":"2024-09-12T17:10:44.517863+0000","last_active":"2024-09-12T18:09:20.793547+0000","last_peered":"2024-09-12T18:09:20.793547+0000","last_clean":"2024-09-12T18:09:20.793547+0000","last_became_active":"2024-09-12T17:10:44.517508+0000","last_became_peered":"2024-09-12T17:10:44.517508+0000","last_unstale":"2024-09-12T18:09:20.793547+0000","last_undegraded":"2024-09-12T18:09:20.793547+0000","last_fullsized":"2024-09-12T18:09:20.793547+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":400,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:38:36.589360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2400,"num_read_kb":2225,"num_write":610,"num_write_kb":202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"263'209","reported_seq":847,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:14.844556+0000","last_change":"2024-09-12T17:10:42.518819+0000","last_active":"2024-09-12T18:09:14.844556+0000","last_peered":"2024-09-12T18:09:14.844556+0000","last_clean":"2024-09-12T18:09:14.844556+0000","last_became_active":"2024-09-12T17:10:42.518404+0000","last_became_peered":"2024-09-12T17:10:42.518404+0000","last_unstale":"2024-09-12T18:09:14.844556+0000","last_undegraded":"2024-09-12T18:09:14.844556+0000","last_fullsized":"2024-09-12T18:09:14.844556+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:42:38.202022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220118,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":502,"num_read_kb":3973,"num_write":1038,"num_write_kb":36643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,7],"acting":[0,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":523,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:04.874518+0000","last_change":"2024-09-12T17:10:33.848505+0000","last_active":"2024-09-12T18:09:04.874518+0000","last_peered":"2024-09-12T18:09:04.874518+0000","last_clean":"2024-09-12T18:09:04.874518+0000","last_became_active":"2024-09-12T17:10:31.846123+0000","last_became_peered":"2024-09-12T17:10:31.846123+0000","last_unstale":"2024-09-12T18:09:04.874518+0000","last_undegraded":"2024-09-12T18:09:04.874518+0000","last_fullsized":"2024-09-12T18:09:04.874518+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:30.818274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:30.818274+0000","last_clean_scrub_stamp":"2024-09-12T17:10:30.818274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:48:25.408756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042024599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":500,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:04.850946+0000","last_change":"2024-09-12T17:10:46.530820+0000","last_active":"2024-09-12T18:09:04.850946+0000","last_peered":"2024-09-12T18:09:04.850946+0000","last_clean":"2024-09-12T18:09:04.850946+0000","last_became_active":"2024-09-12T17:10:46.530457+0000","last_became_peered":"2024-09-12T17:10:46.530457+0000","last_unstale":"2024-09-12T18:09:04.850946+0000","last_undegraded":"2024-09-12T18:09:04.850946+0000","last_fullsized":"2024-09-12T18:09:04.850946+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_clean_scrub_stamp":"2024-09-12T17:10:45.504515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:55:20.257339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"263'301","reported_seq":1008,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:09.796776+0000","last_change":"2024-09-12T17:10:48.543312+0000","last_active":"2024-09-12T18:11:09.796776+0000","last_peered":"2024-09-12T18:11:09.796776+0000","last_clean":"2024-09-12T18:11:09.796776+0000","last_became_active":"2024-09-12T17:10:48.542991+0000","last_became_peered":"2024-09-12T17:10:48.542991+0000","last_unstale":"2024-09-12T18:11:09.796776+0000","last_undegraded":"2024-09-12T18:11:09.796776+0000","last_fullsized":"2024-09-12T18:11:09.796776+0000","mapping_epoch":30,"log_start":"260'200","ondisk_log_start":"260'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_clean_scrub_stamp":"2024-09-12T17:10:47.516917+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:14:45.346536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26702,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":441,"num_read_kb":571,"num_write":222,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":491,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:09.851601+0000","last_change":"2024-09-12T17:10:50.553798+0000","last_active":"2024-09-12T18:09:09.851601+0000","last_peered":"2024-09-12T18:09:09.851601+0000","last_clean":"2024-09-12T18:09:09.851601+0000","last_became_active":"2024-09-12T17:10:50.553469+0000","last_became_peered":"2024-09-12T17:10:50.553469+0000","last_unstale":"2024-09-12T18:09:09.851601+0000","last_undegraded":"2024-09-12T18:09:09.851601+0000","last_fullsized":"2024-09-12T18:09:09.851601+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_clean_scrub_stamp":"2024-09-12T17:10:49.533772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:37:24.951291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"263'114","reported_seq":615,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:24.858341+0000","last_change":"2024-09-12T17:10:52.579037+0000","last_active":"2024-09-12T18:09:24.858341+0000","last_peered":"2024-09-12T18:09:24.858341+0000","last_clean":"2024-09-12T18:09:24.858341+0000","last_became_active":"2024-09-12T17:10:52.578713+0000","last_became_peered":"2024-09-12T17:10:52.578713+0000","last_unstale":"2024-09-12T18:09:24.858341+0000","last_undegraded":"2024-09-12T18:09:24.858341+0000","last_fullsized":"2024-09-12T18:09:24.858341+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:23:43.956550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":176,"num_read_kb":166,"num_write":279,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"263'124","reported_seq":686,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:49.766649+0000","last_change":"2024-09-12T17:10:52.576764+0000","last_active":"2024-09-12T18:09:49.766649+0000","last_peered":"2024-09-12T18:09:49.766649+0000","last_clean":"2024-09-12T18:09:49.766649+0000","last_became_active":"2024-09-12T17:10:52.576481+0000","last_became_peered":"2024-09-12T17:10:52.576481+0000","last_unstale":"2024-09-12T18:09:49.766649+0000","last_undegraded":"2024-09-12T18:09:49.766649+0000","last_fullsized":"2024-09-12T18:09:49.766649+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:22:23.671221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":242,"num_read_kb":237,"num_write":285,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"263'886","reported_seq":2476,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:04.854522+0000","last_change":"2024-09-12T17:10:44.507764+0000","last_active":"2024-09-12T18:09:04.854522+0000","last_peered":"2024-09-12T18:09:04.854522+0000","last_clean":"2024-09-12T18:09:04.854522+0000","last_became_active":"2024-09-12T17:10:44.507455+0000","last_became_peered":"2024-09-12T17:10:44.507455+0000","last_unstale":"2024-09-12T18:09:04.854522+0000","last_undegraded":"2024-09-12T18:09:04.854522+0000","last_fullsized":"2024-09-12T18:09:04.854522+0000","mapping_epoch":26,"log_start":"263'800","ondisk_log_start":"263'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":800,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:27:20.389462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4276,"num_read_kb":3830,"num_write":1165,"num_write_kb":436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"263'207","reported_seq":858,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:14.855999+0000","last_change":"2024-09-12T17:10:42.520147+0000","last_active":"2024-09-12T18:09:14.855999+0000","last_peered":"2024-09-12T18:09:14.855999+0000","last_clean":"2024-09-12T18:09:14.855999+0000","last_became_active":"2024-09-12T17:10:42.519656+0000","last_became_peered":"2024-09-12T17:10:42.519656+0000","last_unstale":"2024-09-12T18:09:14.855999+0000","last_undegraded":"2024-09-12T18:09:14.855999+0000","last_fullsized":"2024-09-12T18:09:14.855999+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:46:04.344482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":893994,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":521,"num_read_kb":10349,"num_write":1060,"num_write_kb":31428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,6],"acting":[4,7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":501,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:10.147893+0000","last_change":"2024-09-12T17:10:46.527971+0000","last_active":"2024-09-12T18:09:10.147893+0000","last_peered":"2024-09-12T18:09:10.147893+0000","last_clean":"2024-09-12T18:09:10.147893+0000","last_became_active":"2024-09-12T17:10:46.527445+0000","last_became_peered":"2024-09-12T17:10:46.527445+0000","last_unstale":"2024-09-12T18:09:10.147893+0000","last_undegraded":"2024-09-12T18:09:10.147893+0000","last_fullsized":"2024-09-12T18:09:10.147893+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_clean_scrub_stamp":"2024-09-12T17:10:45.504515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:06:49.441769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"263'136","reported_seq":709,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:09.804162+0000","last_change":"2024-09-12T17:10:48.536317+0000","last_active":"2024-09-12T18:11:09.804162+0000","last_peered":"2024-09-12T18:11:09.804162+0000","last_clean":"2024-09-12T18:11:09.804162+0000","last_became_active":"2024-09-12T17:10:48.536021+0000","last_became_peered":"2024-09-12T17:10:48.536021+0000","last_unstale":"2024-09-12T18:11:09.804162+0000","last_undegraded":"2024-09-12T18:11:09.804162+0000","last_fullsized":"2024-09-12T18:11:09.804162+0000","mapping_epoch":30,"log_start":"263'100","ondisk_log_start":"263'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_clean_scrub_stamp":"2024-09-12T17:10:47.516917+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:39:55.363038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11184,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":170,"num_read_kb":215,"num_write":88,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:09.851513+0000","last_change":"2024-09-12T17:10:50.555533+0000","last_active":"2024-09-12T18:09:09.851513+0000","last_peered":"2024-09-12T18:09:09.851513+0000","last_clean":"2024-09-12T18:09:09.851513+0000","last_became_active":"2024-09-12T17:10:50.555251+0000","last_became_peered":"2024-09-12T17:10:50.555251+0000","last_unstale":"2024-09-12T18:09:09.851513+0000","last_undegraded":"2024-09-12T18:09:09.851513+0000","last_fullsized":"2024-09-12T18:09:09.851513+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_clean_scrub_stamp":"2024-09-12T17:10:49.533772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:14:47.733536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"263'142","reported_seq":663,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:09.818435+0000","last_change":"2024-09-12T17:10:52.573415+0000","last_active":"2024-09-12T18:11:09.818435+0000","last_peered":"2024-09-12T18:11:09.818435+0000","last_clean":"2024-09-12T18:11:09.818435+0000","last_became_active":"2024-09-12T17:10:52.573040+0000","last_became_peered":"2024-09-12T17:10:52.573040+0000","last_unstale":"2024-09-12T18:11:09.818435+0000","last_undegraded":"2024-09-12T18:11:09.818435+0000","last_fullsized":"2024-09-12T18:11:09.818435+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:17:53.786959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":264,"num_read_kb":238,"num_write":352,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"263'1128","reported_seq":2790,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:05.147244+0000","last_change":"2024-09-12T17:10:44.509438+0000","last_active":"2024-09-12T18:09:05.147244+0000","last_peered":"2024-09-12T18:09:05.147244+0000","last_clean":"2024-09-12T18:09:05.147244+0000","last_became_active":"2024-09-12T17:10:44.509117+0000","last_became_peered":"2024-09-12T17:10:44.509117+0000","last_unstale":"2024-09-12T18:09:05.147244+0000","last_undegraded":"2024-09-12T18:09:05.147244+0000","last_fullsized":"2024-09-12T18:09:05.147244+0000","mapping_epoch":26,"log_start":"263'1100","ondisk_log_start":"263'1100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":1100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:09:30.968234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5331,"num_read_kb":4747,"num_write":1539,"num_write_kb":622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"263'204","reported_seq":812,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:51.027681+0000","last_change":"2024-09-12T17:11:16.617932+0000","last_active":"2024-09-12T18:07:51.027681+0000","last_peered":"2024-09-12T18:07:51.027681+0000","last_clean":"2024-09-12T18:07:51.027681+0000","last_became_active":"2024-09-12T17:11:16.617505+0000","last_became_peered":"2024-09-12T17:11:16.617505+0000","last_unstale":"2024-09-12T18:07:51.027681+0000","last_undegraded":"2024-09-12T18:07:51.027681+0000","last_fullsized":"2024-09-12T18:07:51.027681+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:43:08.879561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2937824,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":493,"num_read_kb":50143,"num_write":993,"num_write_kb":47141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,4],"acting":[2,3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:09.851666+0000","last_change":"2024-09-12T17:10:46.532146+0000","last_active":"2024-09-12T18:09:09.851666+0000","last_peered":"2024-09-12T18:09:09.851666+0000","last_clean":"2024-09-12T18:09:09.851666+0000","last_became_active":"2024-09-12T17:10:46.531835+0000","last_became_peered":"2024-09-12T17:10:46.531835+0000","last_unstale":"2024-09-12T18:09:09.851666+0000","last_undegraded":"2024-09-12T18:09:09.851666+0000","last_fullsized":"2024-09-12T18:09:09.851666+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_clean_scrub_stamp":"2024-09-12T17:10:45.504515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:41:31.662923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"263'46","reported_seq":554,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:09.843750+0000","last_change":"2024-09-12T17:10:48.541273+0000","last_active":"2024-09-12T18:09:09.843750+0000","last_peered":"2024-09-12T18:09:09.843750+0000","last_clean":"2024-09-12T18:09:09.843750+0000","last_became_active":"2024-09-12T17:10:48.540975+0000","last_became_peered":"2024-09-12T17:10:48.540975+0000","last_unstale":"2024-09-12T18:09:09.843750+0000","last_undegraded":"2024-09-12T18:09:09.843750+0000","last_fullsized":"2024-09-12T18:09:09.843750+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_clean_scrub_stamp":"2024-09-12T17:10:47.516917+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:50:54.992489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":38,"num_read_kb":36,"num_write":28,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":486,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:09.855642+0000","last_change":"2024-09-12T17:10:50.553896+0000","last_active":"2024-09-12T18:09:09.855642+0000","last_peered":"2024-09-12T18:09:09.855642+0000","last_clean":"2024-09-12T18:09:09.855642+0000","last_became_active":"2024-09-12T17:10:50.553581+0000","last_became_peered":"2024-09-12T17:10:50.553581+0000","last_unstale":"2024-09-12T18:09:09.855642+0000","last_undegraded":"2024-09-12T18:09:09.855642+0000","last_fullsized":"2024-09-12T18:09:09.855642+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_clean_scrub_stamp":"2024-09-12T17:10:49.533772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:14:49.105003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"263'191","reported_seq":712,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:49.539356+0000","last_change":"2024-09-12T17:10:52.573782+0000","last_active":"2024-09-12T18:09:49.539356+0000","last_peered":"2024-09-12T18:09:49.539356+0000","last_clean":"2024-09-12T18:09:49.539356+0000","last_became_active":"2024-09-12T17:10:52.573306+0000","last_became_peered":"2024-09-12T17:10:52.573306+0000","last_unstale":"2024-09-12T18:09:49.539356+0000","last_undegraded":"2024-09-12T18:09:49.539356+0000","last_fullsized":"2024-09-12T18:09:49.539356+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:39:25.637064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":321,"num_read_kb":317,"num_write":439,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"263'810","reported_seq":2411,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:04.850964+0000","last_change":"2024-09-12T17:10:44.511875+0000","last_active":"2024-09-12T18:09:04.850964+0000","last_peered":"2024-09-12T18:09:04.850964+0000","last_clean":"2024-09-12T18:09:04.850964+0000","last_became_active":"2024-09-12T17:10:44.511481+0000","last_became_peered":"2024-09-12T17:10:44.511481+0000","last_unstale":"2024-09-12T18:09:04.850964+0000","last_undegraded":"2024-09-12T18:09:04.850964+0000","last_fullsized":"2024-09-12T18:09:04.850964+0000","mapping_epoch":26,"log_start":"263'700","ondisk_log_start":"263'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":700,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:10:10.656622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3868,"num_read_kb":3506,"num_write":1048,"num_write_kb":364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"263'168","reported_seq":770,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:04.012455+0000","last_change":"2024-09-12T17:11:16.863311+0000","last_active":"2024-09-12T18:11:04.012455+0000","last_peered":"2024-09-12T18:11:04.012455+0000","last_clean":"2024-09-12T18:11:04.012455+0000","last_became_active":"2024-09-12T17:11:16.862878+0000","last_became_peered":"2024-09-12T17:11:16.862878+0000","last_unstale":"2024-09-12T18:11:04.012455+0000","last_undegraded":"2024-09-12T18:11:04.012455+0000","last_fullsized":"2024-09-12T18:11:04.012455+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:36:57.402157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17896412,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":386,"num_read_kb":53715,"num_write":798,"num_write_kb":39175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,1,3],"acting":[2,7,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:09.855601+0000","last_change":"2024-09-12T17:10:46.530915+0000","last_active":"2024-09-12T18:09:09.855601+0000","last_peered":"2024-09-12T18:09:09.855601+0000","last_clean":"2024-09-12T18:09:09.855601+0000","last_became_active":"2024-09-12T17:10:46.530518+0000","last_became_peered":"2024-09-12T17:10:46.530518+0000","last_unstale":"2024-09-12T18:09:09.855601+0000","last_undegraded":"2024-09-12T18:09:09.855601+0000","last_fullsized":"2024-09-12T18:09:09.855601+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_clean_scrub_stamp":"2024-09-12T17:10:45.504515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:39:55.119594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"263'169","reported_seq":757,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:09.790509+0000","last_change":"2024-09-12T17:10:48.537056+0000","last_active":"2024-09-12T18:11:09.790509+0000","last_peered":"2024-09-12T18:11:09.790509+0000","last_clean":"2024-09-12T18:11:09.790509+0000","last_became_active":"2024-09-12T17:10:48.536654+0000","last_became_peered":"2024-09-12T17:10:48.536654+0000","last_unstale":"2024-09-12T18:11:09.790509+0000","last_undegraded":"2024-09-12T18:11:09.790509+0000","last_fullsized":"2024-09-12T18:11:09.790509+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_clean_scrub_stamp":"2024-09-12T17:10:47.516917+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":100,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:46:23.716742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6412,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":215,"num_read_kb":225,"num_write":118,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":489,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:09.875304+0000","last_change":"2024-09-12T17:10:50.556336+0000","last_active":"2024-09-12T18:09:09.875304+0000","last_peered":"2024-09-12T18:09:09.875304+0000","last_clean":"2024-09-12T18:09:09.875304+0000","last_became_active":"2024-09-12T17:10:50.556039+0000","last_became_peered":"2024-09-12T17:10:50.556039+0000","last_unstale":"2024-09-12T18:09:09.875304+0000","last_undegraded":"2024-09-12T18:09:09.875304+0000","last_fullsized":"2024-09-12T18:09:09.875304+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_clean_scrub_stamp":"2024-09-12T17:10:49.533772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:58:59.200469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"263'113","reported_seq":617,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:24.848069+0000","last_change":"2024-09-12T17:10:52.577104+0000","last_active":"2024-09-12T18:08:24.848069+0000","last_peered":"2024-09-12T18:08:24.848069+0000","last_clean":"2024-09-12T18:08:24.848069+0000","last_became_active":"2024-09-12T17:10:52.576791+0000","last_became_peered":"2024-09-12T17:10:52.576791+0000","last_unstale":"2024-09-12T18:08:24.848069+0000","last_undegraded":"2024-09-12T18:08:24.848069+0000","last_fullsized":"2024-09-12T18:08:24.848069+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:18:40.050173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":159,"num_read_kb":159,"num_write":260,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"263'429","reported_seq":1806,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:04.850927+0000","last_change":"2024-09-12T17:10:44.521723+0000","last_active":"2024-09-12T18:09:04.850927+0000","last_peered":"2024-09-12T18:09:04.850927+0000","last_clean":"2024-09-12T18:09:04.850927+0000","last_became_active":"2024-09-12T17:10:44.520747+0000","last_became_peered":"2024-09-12T17:10:44.520747+0000","last_unstale":"2024-09-12T18:09:04.850927+0000","last_undegraded":"2024-09-12T18:09:04.850927+0000","last_fullsized":"2024-09-12T18:09:04.850927+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":400,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:56:20.477273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2202,"num_read_kb":2035,"num_write":527,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"263'251","reported_seq":940,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:07.551191+0000","last_change":"2024-09-12T17:10:42.529117+0000","last_active":"2024-09-12T18:11:07.551191+0000","last_peered":"2024-09-12T18:11:07.551191+0000","last_clean":"2024-09-12T18:11:07.551191+0000","last_became_active":"2024-09-12T17:10:42.528364+0000","last_became_peered":"2024-09-12T17:10:42.528364+0000","last_unstale":"2024-09-12T18:11:07.551191+0000","last_undegraded":"2024-09-12T18:11:07.551191+0000","last_fullsized":"2024-09-12T18:11:07.551191+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:10:20.252342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5692764,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":609,"num_read_kb":71919,"num_write":1341,"num_write_kb":46951,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6,3],"acting":[0,5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:09.875254+0000","last_change":"2024-09-12T17:10:46.532154+0000","last_active":"2024-09-12T18:09:09.875254+0000","last_peered":"2024-09-12T18:09:09.875254+0000","last_clean":"2024-09-12T18:09:09.875254+0000","last_became_active":"2024-09-12T17:10:46.531830+0000","last_became_peered":"2024-09-12T17:10:46.531830+0000","last_unstale":"2024-09-12T18:09:09.875254+0000","last_undegraded":"2024-09-12T18:09:09.875254+0000","last_fullsized":"2024-09-12T18:09:09.875254+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_clean_scrub_stamp":"2024-09-12T17:10:45.504515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:00:23.387684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"263'123","reported_seq":687,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:09.786960+0000","last_change":"2024-09-12T17:10:48.545933+0000","last_active":"2024-09-12T18:11:09.786960+0000","last_peered":"2024-09-12T18:11:09.786960+0000","last_clean":"2024-09-12T18:11:09.786960+0000","last_became_active":"2024-09-12T17:10:48.545598+0000","last_became_peered":"2024-09-12T17:10:48.545598+0000","last_unstale":"2024-09-12T18:11:09.786960+0000","last_undegraded":"2024-09-12T18:11:09.786960+0000","last_fullsized":"2024-09-12T18:11:09.786960+0000","mapping_epoch":30,"log_start":"263'100","ondisk_log_start":"263'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_clean_scrub_stamp":"2024-09-12T17:10:47.516917+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:53:48.675107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12450,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":157,"num_read_kb":207,"num_write":82,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:09.843797+0000","last_change":"2024-09-12T17:10:50.561238+0000","last_active":"2024-09-12T18:09:09.843797+0000","last_peered":"2024-09-12T18:09:09.843797+0000","last_clean":"2024-09-12T18:09:09.843797+0000","last_became_active":"2024-09-12T17:10:50.560872+0000","last_became_peered":"2024-09-12T17:10:50.560872+0000","last_unstale":"2024-09-12T18:09:09.843797+0000","last_undegraded":"2024-09-12T18:09:09.843797+0000","last_fullsized":"2024-09-12T18:09:09.843797+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_clean_scrub_stamp":"2024-09-12T17:10:49.533772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:11:16.785795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"263'950","reported_seq":2479,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:08.687444+0000","last_change":"2024-09-12T17:10:44.519331+0000","last_active":"2024-09-12T18:11:08.687444+0000","last_peered":"2024-09-12T18:11:08.687444+0000","last_clean":"2024-09-12T18:11:08.687444+0000","last_became_active":"2024-09-12T17:10:44.518992+0000","last_became_peered":"2024-09-12T17:10:44.518992+0000","last_unstale":"2024-09-12T18:11:08.687444+0000","last_undegraded":"2024-09-12T18:11:08.687444+0000","last_fullsized":"2024-09-12T18:11:08.687444+0000","mapping_epoch":26,"log_start":"263'900","ondisk_log_start":"263'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":900,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:58:27.950402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4453,"num_read_kb":3925,"num_write":1322,"num_write_kb":528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"263'311","reported_seq":989,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:44.848614+0000","last_change":"2024-09-12T17:10:42.515186+0000","last_active":"2024-09-12T18:08:44.848614+0000","last_peered":"2024-09-12T18:08:44.848614+0000","last_clean":"2024-09-12T18:08:44.848614+0000","last_became_active":"2024-09-12T17:10:42.514627+0000","last_became_peered":"2024-09-12T17:10:42.514627+0000","last_unstale":"2024-09-12T18:08:44.848614+0000","last_undegraded":"2024-09-12T18:08:44.848614+0000","last_fullsized":"2024-09-12T18:08:44.848614+0000","mapping_epoch":24,"log_start":"263'300","ondisk_log_start":"263'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:27:58.202191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15728847,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":790,"num_read_kb":25839,"num_write":1191,"num_write_kb":43854,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":504,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:59.842677+0000","last_change":"2024-09-12T17:10:46.527010+0000","last_active":"2024-09-12T18:08:59.842677+0000","last_peered":"2024-09-12T18:08:59.842677+0000","last_clean":"2024-09-12T18:08:59.842677+0000","last_became_active":"2024-09-12T17:10:46.526692+0000","last_became_peered":"2024-09-12T17:10:46.526692+0000","last_unstale":"2024-09-12T18:08:59.842677+0000","last_undegraded":"2024-09-12T18:08:59.842677+0000","last_fullsized":"2024-09-12T18:08:59.842677+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_clean_scrub_stamp":"2024-09-12T17:10:45.504515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:02:16.851916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"263'205","reported_seq":830,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:09.785236+0000","last_change":"2024-09-12T17:10:48.545433+0000","last_active":"2024-09-12T18:11:09.785236+0000","last_peered":"2024-09-12T18:11:09.785236+0000","last_clean":"2024-09-12T18:11:09.785236+0000","last_became_active":"2024-09-12T17:10:48.544429+0000","last_became_peered":"2024-09-12T17:10:48.544429+0000","last_unstale":"2024-09-12T18:11:09.785236+0000","last_undegraded":"2024-09-12T18:11:09.785236+0000","last_fullsized":"2024-09-12T18:11:09.785236+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_clean_scrub_stamp":"2024-09-12T17:10:47.516917+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:28:39.813411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19968,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":307,"num_read_kb":447,"num_write":200,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":485,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:19.847436+0000","last_change":"2024-09-12T17:10:50.565947+0000","last_active":"2024-09-12T18:08:19.847436+0000","last_peered":"2024-09-12T18:08:19.847436+0000","last_clean":"2024-09-12T18:08:19.847436+0000","last_became_active":"2024-09-12T17:10:50.565621+0000","last_became_peered":"2024-09-12T17:10:50.565621+0000","last_unstale":"2024-09-12T18:08:19.847436+0000","last_undegraded":"2024-09-12T18:08:19.847436+0000","last_fullsized":"2024-09-12T18:08:19.847436+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_clean_scrub_stamp":"2024-09-12T17:10:49.533772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:49:32.811403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"263'175","reported_seq":681,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:14.852393+0000","last_change":"2024-09-12T17:10:52.672357+0000","last_active":"2024-09-12T18:09:14.852393+0000","last_peered":"2024-09-12T18:09:14.852393+0000","last_clean":"2024-09-12T18:09:14.852393+0000","last_became_active":"2024-09-12T17:10:52.672033+0000","last_became_peered":"2024-09-12T17:10:52.672033+0000","last_unstale":"2024-09-12T18:09:14.852393+0000","last_undegraded":"2024-09-12T18:09:14.852393+0000","last_fullsized":"2024-09-12T18:09:14.852393+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:21:13.578314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":269,"num_read_kb":274,"num_write":411,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"263'545","reported_seq":2055,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:48.687635+0000","last_change":"2024-09-12T17:10:44.510970+0000","last_active":"2024-09-12T18:09:48.687635+0000","last_peered":"2024-09-12T18:09:48.687635+0000","last_clean":"2024-09-12T18:09:48.687635+0000","last_became_active":"2024-09-12T17:10:44.510696+0000","last_became_peered":"2024-09-12T17:10:44.510696+0000","last_unstale":"2024-09-12T18:09:48.687635+0000","last_undegraded":"2024-09-12T18:09:48.687635+0000","last_fullsized":"2024-09-12T18:09:48.687635+0000","mapping_epoch":26,"log_start":"263'500","ondisk_log_start":"263'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":500,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:45:34.728786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2748,"num_read_kb":2501,"num_write":691,"num_write_kb":203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"263'236","reported_seq":903,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:43.766114+0000","last_change":"2024-09-12T17:10:42.520812+0000","last_active":"2024-09-12T18:09:43.766114+0000","last_peered":"2024-09-12T18:09:43.766114+0000","last_clean":"2024-09-12T18:09:43.766114+0000","last_became_active":"2024-09-12T17:10:42.520349+0000","last_became_peered":"2024-09-12T17:10:42.520349+0000","last_unstale":"2024-09-12T18:09:43.766114+0000","last_undegraded":"2024-09-12T18:09:43.766114+0000","last_fullsized":"2024-09-12T18:09:43.766114+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":200,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:40:03.389243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21229654,"num_objects":11,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":539,"num_read_kb":59039,"num_write":1204,"num_write_kb":37561,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,6],"acting":[1,3,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":500,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:09.875361+0000","last_change":"2024-09-12T17:10:46.530884+0000","last_active":"2024-09-12T18:09:09.875361+0000","last_peered":"2024-09-12T18:09:09.875361+0000","last_clean":"2024-09-12T18:09:09.875361+0000","last_became_active":"2024-09-12T17:10:46.530545+0000","last_became_peered":"2024-09-12T17:10:46.530545+0000","last_unstale":"2024-09-12T18:09:09.875361+0000","last_undegraded":"2024-09-12T18:09:09.875361+0000","last_fullsized":"2024-09-12T18:09:09.875361+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_clean_scrub_stamp":"2024-09-12T17:10:45.504515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:01:13.562715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"263'166","reported_seq":746,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:10:49.870892+0000","last_change":"2024-09-12T17:10:48.541568+0000","last_active":"2024-09-12T18:10:49.870892+0000","last_peered":"2024-09-12T18:10:49.870892+0000","last_clean":"2024-09-12T18:10:49.870892+0000","last_became_active":"2024-09-12T17:10:48.541240+0000","last_became_peered":"2024-09-12T17:10:48.541240+0000","last_unstale":"2024-09-12T18:10:49.870892+0000","last_undegraded":"2024-09-12T18:10:49.870892+0000","last_fullsized":"2024-09-12T18:10:49.870892+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_clean_scrub_stamp":"2024-09-12T17:10:47.516917+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:09:34.296718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11199,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":237,"num_read_kb":302,"num_write":156,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":491,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:20.142401+0000","last_change":"2024-09-12T17:10:50.562714+0000","last_active":"2024-09-12T18:08:20.142401+0000","last_peered":"2024-09-12T18:08:20.142401+0000","last_clean":"2024-09-12T18:08:20.142401+0000","last_became_active":"2024-09-12T17:10:50.561983+0000","last_became_peered":"2024-09-12T17:10:50.561983+0000","last_unstale":"2024-09-12T18:08:20.142401+0000","last_undegraded":"2024-09-12T18:08:20.142401+0000","last_fullsized":"2024-09-12T18:08:20.142401+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_clean_scrub_stamp":"2024-09-12T17:10:49.533772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:59:00.374511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"263'244","reported_seq":1112,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:49.532850+0000","last_change":"2024-09-12T17:10:52.573923+0000","last_active":"2024-09-12T18:09:49.532850+0000","last_peered":"2024-09-12T18:09:49.532850+0000","last_clean":"2024-09-12T18:09:49.532850+0000","last_became_active":"2024-09-12T17:10:52.573595+0000","last_became_peered":"2024-09-12T17:10:52.573595+0000","last_unstale":"2024-09-12T18:09:49.532850+0000","last_undegraded":"2024-09-12T18:09:49.532850+0000","last_fullsized":"2024-09-12T18:09:49.532850+0000","mapping_epoch":34,"log_start":"263'200","ondisk_log_start":"263'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":200,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:32:14.573475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1635,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":641,"num_read_kb":637,"num_write":634,"num_write_kb":186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"263'620","reported_seq":2213,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:58.603541+0000","last_change":"2024-09-12T17:10:44.521406+0000","last_active":"2024-09-12T18:08:58.603541+0000","last_peered":"2024-09-12T18:08:58.603541+0000","last_clean":"2024-09-12T18:08:58.603541+0000","last_became_active":"2024-09-12T17:10:44.521041+0000","last_became_peered":"2024-09-12T17:10:44.521041+0000","last_unstale":"2024-09-12T18:08:58.603541+0000","last_undegraded":"2024-09-12T18:08:58.603541+0000","last_fullsized":"2024-09-12T18:08:58.603541+0000","mapping_epoch":26,"log_start":"263'600","ondisk_log_start":"263'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":600,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:02:28.202706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3182,"num_read_kb":2947,"num_write":827,"num_write_kb":261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"263'219","reported_seq":811,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:49.849250+0000","last_change":"2024-09-12T17:11:16.860452+0000","last_active":"2024-09-12T18:08:49.849250+0000","last_peered":"2024-09-12T18:08:49.849250+0000","last_clean":"2024-09-12T18:08:49.849250+0000","last_became_active":"2024-09-12T17:11:16.860070+0000","last_became_peered":"2024-09-12T17:11:16.860070+0000","last_unstale":"2024-09-12T18:08:49.849250+0000","last_undegraded":"2024-09-12T18:08:49.849250+0000","last_fullsized":"2024-09-12T18:08:49.849250+0000","mapping_epoch":37,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:08:44.066630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3266454,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":440,"num_read_kb":10891,"num_write":952,"num_write_kb":36342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":501,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:19.848368+0000","last_change":"2024-09-12T17:10:46.530777+0000","last_active":"2024-09-12T18:08:19.848368+0000","last_peered":"2024-09-12T18:08:19.848368+0000","last_clean":"2024-09-12T18:08:19.848368+0000","last_became_active":"2024-09-12T17:10:46.530452+0000","last_became_peered":"2024-09-12T17:10:46.530452+0000","last_unstale":"2024-09-12T18:08:19.848368+0000","last_undegraded":"2024-09-12T18:08:19.848368+0000","last_fullsized":"2024-09-12T18:08:19.848368+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_clean_scrub_stamp":"2024-09-12T17:10:45.504515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:09:29.711456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"263'138","reported_seq":713,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:09.809315+0000","last_change":"2024-09-12T17:10:48.538046+0000","last_active":"2024-09-12T18:11:09.809315+0000","last_peered":"2024-09-12T18:11:09.809315+0000","last_clean":"2024-09-12T18:11:09.809315+0000","last_became_active":"2024-09-12T17:10:48.537643+0000","last_became_peered":"2024-09-12T17:10:48.537643+0000","last_unstale":"2024-09-12T18:11:09.809315+0000","last_undegraded":"2024-09-12T18:11:09.809315+0000","last_fullsized":"2024-09-12T18:11:09.809315+0000","mapping_epoch":30,"log_start":"263'100","ondisk_log_start":"263'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_clean_scrub_stamp":"2024-09-12T17:10:47.516917+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:09:50.764378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5345,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":171,"num_read_kb":208,"num_write":92,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:55.146261+0000","last_change":"2024-09-12T17:10:50.565961+0000","last_active":"2024-09-12T18:08:55.146261+0000","last_peered":"2024-09-12T18:08:55.146261+0000","last_clean":"2024-09-12T18:08:55.146261+0000","last_became_active":"2024-09-12T17:10:50.565582+0000","last_became_peered":"2024-09-12T17:10:50.565582+0000","last_unstale":"2024-09-12T18:08:55.146261+0000","last_undegraded":"2024-09-12T18:08:55.146261+0000","last_fullsized":"2024-09-12T18:08:55.146261+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_clean_scrub_stamp":"2024-09-12T17:10:49.533772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:00:34.128895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"263'130","reported_seq":617,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:09.828159+0000","last_change":"2024-09-12T17:10:52.576677+0000","last_active":"2024-09-12T18:11:09.828159+0000","last_peered":"2024-09-12T18:11:09.828159+0000","last_clean":"2024-09-12T18:11:09.828159+0000","last_became_active":"2024-09-12T17:10:52.576370+0000","last_became_peered":"2024-09-12T17:10:52.576370+0000","last_unstale":"2024-09-12T18:11:09.828159+0000","last_undegraded":"2024-09-12T18:11:09.828159+0000","last_fullsized":"2024-09-12T18:11:09.828159+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:03:31.842871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1233,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":145,"num_read_kb":142,"num_write":322,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"263'872","reported_seq":2422,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:48.687133+0000","last_change":"2024-09-12T17:10:44.519575+0000","last_active":"2024-09-12T18:09:48.687133+0000","last_peered":"2024-09-12T18:09:48.687133+0000","last_clean":"2024-09-12T18:09:48.687133+0000","last_became_active":"2024-09-12T17:10:44.519318+0000","last_became_peered":"2024-09-12T17:10:44.519318+0000","last_unstale":"2024-09-12T18:09:48.687133+0000","last_undegraded":"2024-09-12T18:09:48.687133+0000","last_fullsized":"2024-09-12T18:09:48.687133+0000","mapping_epoch":26,"log_start":"263'800","ondisk_log_start":"263'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":800,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:45:54.356905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4021,"num_read_kb":3592,"num_write":1141,"num_write_kb":414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"263'185","reported_seq":798,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:14.837007+0000","last_change":"2024-09-12T17:10:42.517205+0000","last_active":"2024-09-12T18:08:14.837007+0000","last_peered":"2024-09-12T18:08:14.837007+0000","last_clean":"2024-09-12T18:08:14.837007+0000","last_became_active":"2024-09-12T17:10:42.516802+0000","last_became_peered":"2024-09-12T17:10:42.516802+0000","last_unstale":"2024-09-12T18:08:14.837007+0000","last_undegraded":"2024-09-12T18:08:14.837007+0000","last_fullsized":"2024-09-12T18:08:14.837007+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:48:25.179651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5530186,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":393,"num_read_kb":13109,"num_write":966,"num_write_kb":28742,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7,1],"acting":[0,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"36'4","reported_seq":975,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:09.531956+0000","last_change":"2024-09-12T17:10:46.530932+0000","last_active":"2024-09-12T18:11:09.531956+0000","last_peered":"2024-09-12T18:11:09.531956+0000","last_clean":"2024-09-12T18:11:09.531956+0000","last_became_active":"2024-09-12T17:10:46.530466+0000","last_became_peered":"2024-09-12T17:10:46.530466+0000","last_unstale":"2024-09-12T18:11:09.531956+0000","last_undegraded":"2024-09-12T18:11:09.531956+0000","last_fullsized":"2024-09-12T18:11:09.531956+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_clean_scrub_stamp":"2024-09-12T17:10:45.504515+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:59:20.697816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":718,"num_read_kb":1182,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"263'90","reported_seq":623,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:59.853778+0000","last_change":"2024-09-12T17:10:48.538034+0000","last_active":"2024-09-12T18:08:59.853778+0000","last_peered":"2024-09-12T18:08:59.853778+0000","last_clean":"2024-09-12T18:08:59.853778+0000","last_became_active":"2024-09-12T17:10:48.537715+0000","last_became_peered":"2024-09-12T17:10:48.537715+0000","last_unstale":"2024-09-12T18:08:59.853778+0000","last_undegraded":"2024-09-12T18:08:59.853778+0000","last_fullsized":"2024-09-12T18:08:59.853778+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_clean_scrub_stamp":"2024-09-12T17:10:47.516917+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:50:02.415975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":103,"num_read_kb":94,"num_write":78,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"263'760","reported_seq":2581,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:13.401557+0000","last_change":"2024-09-12T17:10:50.552759+0000","last_active":"2024-09-12T18:11:13.401557+0000","last_peered":"2024-09-12T18:11:13.401557+0000","last_clean":"2024-09-12T18:11:13.401557+0000","last_became_active":"2024-09-12T17:10:50.552439+0000","last_became_peered":"2024-09-12T17:10:50.552439+0000","last_unstale":"2024-09-12T18:11:13.401557+0000","last_undegraded":"2024-09-12T18:11:13.401557+0000","last_fullsized":"2024-09-12T18:11:13.401557+0000","mapping_epoch":32,"log_start":"263'700","ondisk_log_start":"263'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_clean_scrub_stamp":"2024-09-12T17:10:49.533772+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":700,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:05:46.061876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"263'101","reported_seq":599,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:14.856275+0000","last_change":"2024-09-12T17:10:52.576632+0000","last_active":"2024-09-12T18:09:14.856275+0000","last_peered":"2024-09-12T18:09:14.856275+0000","last_clean":"2024-09-12T18:09:14.856275+0000","last_became_active":"2024-09-12T17:10:52.576354+0000","last_became_peered":"2024-09-12T17:10:52.576354+0000","last_unstale":"2024-09-12T18:09:14.856275+0000","last_undegraded":"2024-09-12T18:09:14.856275+0000","last_fullsized":"2024-09-12T18:09:14.856275+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:31:48.033949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":153,"num_read_kb":145,"num_write":246,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"263'888","reported_seq":2559,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:58.602298+0000","last_change":"2024-09-12T17:10:44.515286+0000","last_active":"2024-09-12T18:08:58.602298+0000","last_peered":"2024-09-12T18:08:58.602298+0000","last_clean":"2024-09-12T18:08:58.602298+0000","last_became_active":"2024-09-12T17:10:44.514263+0000","last_became_peered":"2024-09-12T17:10:44.514263+0000","last_unstale":"2024-09-12T18:08:58.602298+0000","last_undegraded":"2024-09-12T18:08:58.602298+0000","last_fullsized":"2024-09-12T18:08:58.602298+0000","mapping_epoch":26,"log_start":"263'800","ondisk_log_start":"263'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":800,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:36:42.105597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4092,"num_read_kb":3689,"num_write":1154,"num_write_kb":400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"263'210","reported_seq":848,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:07.932614+0000","last_change":"2024-09-12T17:10:42.528032+0000","last_active":"2024-09-12T18:09:07.932614+0000","last_peered":"2024-09-12T18:09:07.932614+0000","last_clean":"2024-09-12T18:09:07.932614+0000","last_became_active":"2024-09-12T17:10:42.527644+0000","last_became_peered":"2024-09-12T17:10:42.527644+0000","last_unstale":"2024-09-12T18:09:07.932614+0000","last_undegraded":"2024-09-12T18:09:07.932614+0000","last_fullsized":"2024-09-12T18:09:07.932614+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:07:37.030800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5886518,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":476,"num_read_kb":29326,"num_write":1034,"num_write_kb":31012,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,6],"acting":[5,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:19.848670+0000","last_change":"2024-09-12T17:10:46.532064+0000","last_active":"2024-09-12T18:08:19.848670+0000","last_peered":"2024-09-12T18:08:19.848670+0000","last_clean":"2024-09-12T18:08:19.848670+0000","last_became_active":"2024-09-12T17:10:46.531759+0000","last_became_peered":"2024-09-12T17:10:46.531759+0000","last_unstale":"2024-09-12T18:08:19.848670+0000","last_undegraded":"2024-09-12T18:08:19.848670+0000","last_fullsized":"2024-09-12T18:08:19.848670+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_clean_scrub_stamp":"2024-09-12T17:10:45.504515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:32:10.706827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"263'196","reported_seq":778,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:09.776476+0000","last_change":"2024-09-12T17:10:48.543431+0000","last_active":"2024-09-12T18:11:09.776476+0000","last_peered":"2024-09-12T18:11:09.776476+0000","last_clean":"2024-09-12T18:11:09.776476+0000","last_became_active":"2024-09-12T17:10:48.543123+0000","last_became_peered":"2024-09-12T17:10:48.543123+0000","last_unstale":"2024-09-12T18:11:09.776476+0000","last_undegraded":"2024-09-12T18:11:09.776476+0000","last_fullsized":"2024-09-12T18:11:09.776476+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_clean_scrub_stamp":"2024-09-12T17:10:47.516917+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:14:40.758351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10631,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":239,"num_read_kb":288,"num_write":152,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":491,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:49.841229+0000","last_change":"2024-09-12T17:10:50.556322+0000","last_active":"2024-09-12T18:08:49.841229+0000","last_peered":"2024-09-12T18:08:49.841229+0000","last_clean":"2024-09-12T18:08:49.841229+0000","last_became_active":"2024-09-12T17:10:50.556040+0000","last_became_peered":"2024-09-12T17:10:50.556040+0000","last_unstale":"2024-09-12T18:08:49.841229+0000","last_undegraded":"2024-09-12T18:08:49.841229+0000","last_fullsized":"2024-09-12T18:08:49.841229+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_clean_scrub_stamp":"2024-09-12T17:10:49.533772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:11:28.653630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"263'132","reported_seq":632,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:46.952145+0000","last_change":"2024-09-12T17:10:52.585108+0000","last_active":"2024-09-12T18:09:46.952145+0000","last_peered":"2024-09-12T18:09:46.952145+0000","last_clean":"2024-09-12T18:09:46.952145+0000","last_became_active":"2024-09-12T17:10:52.584752+0000","last_became_peered":"2024-09-12T17:10:52.584752+0000","last_unstale":"2024-09-12T18:09:46.952145+0000","last_undegraded":"2024-09-12T18:09:46.952145+0000","last_fullsized":"2024-09-12T18:09:46.952145+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:17:54.690247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":200,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":199,"num_read_kb":187,"num_write":331,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"263'455","reported_seq":2246,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:41.749674+0000","last_change":"2024-09-12T17:10:44.516055+0000","last_active":"2024-09-12T18:08:41.749674+0000","last_peered":"2024-09-12T18:08:41.749674+0000","last_clean":"2024-09-12T18:08:41.749674+0000","last_became_active":"2024-09-12T17:10:44.515463+0000","last_became_peered":"2024-09-12T17:10:44.515463+0000","last_unstale":"2024-09-12T18:08:41.749674+0000","last_undegraded":"2024-09-12T18:08:41.749674+0000","last_fullsized":"2024-09-12T18:08:41.749674+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":400,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:48:28.929846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2803,"num_read_kb":2700,"num_write":505,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"263'183","reported_seq":799,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:14.846808+0000","last_change":"2024-09-12T17:10:42.530271+0000","last_active":"2024-09-12T18:08:14.846808+0000","last_peered":"2024-09-12T18:08:14.846808+0000","last_clean":"2024-09-12T18:08:14.846808+0000","last_became_active":"2024-09-12T17:10:42.529547+0000","last_became_peered":"2024-09-12T17:10:42.529547+0000","last_unstale":"2024-09-12T18:08:14.846808+0000","last_undegraded":"2024-09-12T18:08:14.846808+0000","last_fullsized":"2024-09-12T18:08:14.846808+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:44:05.993110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10780645,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":388,"num_read_kb":39415,"num_write":887,"num_write_kb":32700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,6],"acting":[5,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:19.847401+0000","last_change":"2024-09-12T17:10:46.532778+0000","last_active":"2024-09-12T18:08:19.847401+0000","last_peered":"2024-09-12T18:08:19.847401+0000","last_clean":"2024-09-12T18:08:19.847401+0000","last_became_active":"2024-09-12T17:10:46.532418+0000","last_became_peered":"2024-09-12T17:10:46.532418+0000","last_unstale":"2024-09-12T18:08:19.847401+0000","last_undegraded":"2024-09-12T18:08:19.847401+0000","last_fullsized":"2024-09-12T18:08:19.847401+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_clean_scrub_stamp":"2024-09-12T17:10:45.504515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:36:54.346427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"263'128","reported_seq":697,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:09.777573+0000","last_change":"2024-09-12T17:10:48.539329+0000","last_active":"2024-09-12T18:11:09.777573+0000","last_peered":"2024-09-12T18:11:09.777573+0000","last_clean":"2024-09-12T18:11:09.777573+0000","last_became_active":"2024-09-12T17:10:48.539047+0000","last_became_peered":"2024-09-12T17:10:48.539047+0000","last_unstale":"2024-09-12T18:11:09.777573+0000","last_undegraded":"2024-09-12T18:11:09.777573+0000","last_fullsized":"2024-09-12T18:11:09.777573+0000","mapping_epoch":30,"log_start":"263'100","ondisk_log_start":"263'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_clean_scrub_stamp":"2024-09-12T17:10:47.516917+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:16:56.494114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7731,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":158,"num_read_kb":203,"num_write":84,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:59.873702+0000","last_change":"2024-09-12T17:10:50.556644+0000","last_active":"2024-09-12T18:08:59.873702+0000","last_peered":"2024-09-12T18:08:59.873702+0000","last_clean":"2024-09-12T18:08:59.873702+0000","last_became_active":"2024-09-12T17:10:50.555858+0000","last_became_peered":"2024-09-12T17:10:50.555858+0000","last_unstale":"2024-09-12T18:08:59.873702+0000","last_undegraded":"2024-09-12T18:08:59.873702+0000","last_fullsized":"2024-09-12T18:08:59.873702+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_clean_scrub_stamp":"2024-09-12T17:10:49.533772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:24:28.762169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"263'112","reported_seq":626,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:55.349086+0000","last_change":"2024-09-12T17:10:52.671426+0000","last_active":"2024-09-12T18:08:55.349086+0000","last_peered":"2024-09-12T18:08:55.349086+0000","last_clean":"2024-09-12T18:08:55.349086+0000","last_became_active":"2024-09-12T17:10:52.671139+0000","last_became_peered":"2024-09-12T17:10:52.671139+0000","last_unstale":"2024-09-12T18:08:55.349086+0000","last_undegraded":"2024-09-12T18:08:55.349086+0000","last_fullsized":"2024-09-12T18:08:55.349086+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:12:33.369332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":178,"num_read_kb":175,"num_write":256,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"263'784","reported_seq":2334,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:06.317962+0000","last_change":"2024-09-12T17:11:16.619107+0000","last_active":"2024-09-12T18:09:06.317962+0000","last_peered":"2024-09-12T18:09:06.317962+0000","last_clean":"2024-09-12T18:09:06.317962+0000","last_became_active":"2024-09-12T17:11:16.618723+0000","last_became_peered":"2024-09-12T17:11:16.618723+0000","last_unstale":"2024-09-12T18:09:06.317962+0000","last_undegraded":"2024-09-12T18:09:06.317962+0000","last_fullsized":"2024-09-12T18:09:06.317962+0000","mapping_epoch":37,"log_start":"263'700","ondisk_log_start":"263'700","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":700,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:07:15.117121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4039,"num_read_kb":3670,"num_write":1050,"num_write_kb":387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"263'170","reported_seq":831,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:59.850448+0000","last_change":"2024-09-12T17:10:42.534710+0000","last_active":"2024-09-12T18:08:59.850448+0000","last_peered":"2024-09-12T18:08:59.850448+0000","last_clean":"2024-09-12T18:08:59.850448+0000","last_became_active":"2024-09-12T17:10:42.534052+0000","last_became_peered":"2024-09-12T17:10:42.534052+0000","last_unstale":"2024-09-12T18:08:59.850448+0000","last_undegraded":"2024-09-12T18:08:59.850448+0000","last_fullsized":"2024-09-12T18:08:59.850448+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:53:24.707491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5576594,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":424,"num_read_kb":101566,"num_write":824,"num_write_kb":35642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7,2],"acting":[3,6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:49.852279+0000","last_change":"2024-09-12T17:10:46.530515+0000","last_active":"2024-09-12T18:08:49.852279+0000","last_peered":"2024-09-12T18:08:49.852279+0000","last_clean":"2024-09-12T18:08:49.852279+0000","last_became_active":"2024-09-12T17:10:46.530079+0000","last_became_peered":"2024-09-12T17:10:46.530079+0000","last_unstale":"2024-09-12T18:08:49.852279+0000","last_undegraded":"2024-09-12T18:08:49.852279+0000","last_fullsized":"2024-09-12T18:08:49.852279+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_clean_scrub_stamp":"2024-09-12T17:10:45.504515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:40:53.204632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"263'100","reported_seq":652,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:10:49.865142+0000","last_change":"2024-09-12T17:10:48.543215+0000","last_active":"2024-09-12T18:10:49.865142+0000","last_peered":"2024-09-12T18:10:49.865142+0000","last_clean":"2024-09-12T18:10:49.865142+0000","last_became_active":"2024-09-12T17:10:48.542918+0000","last_became_peered":"2024-09-12T17:10:48.542918+0000","last_unstale":"2024-09-12T18:10:49.865142+0000","last_undegraded":"2024-09-12T18:10:49.865142+0000","last_fullsized":"2024-09-12T18:10:49.865142+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_clean_scrub_stamp":"2024-09-12T17:10:47.516917+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:28:39.813411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9136,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":120,"num_read_kb":174,"num_write":56,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:19.848339+0000","last_change":"2024-09-12T17:10:50.558543+0000","last_active":"2024-09-12T18:08:19.848339+0000","last_peered":"2024-09-12T18:08:19.848339+0000","last_clean":"2024-09-12T18:08:19.848339+0000","last_became_active":"2024-09-12T17:10:50.558162+0000","last_became_peered":"2024-09-12T17:10:50.558162+0000","last_unstale":"2024-09-12T18:08:19.848339+0000","last_undegraded":"2024-09-12T18:08:19.848339+0000","last_fullsized":"2024-09-12T18:08:19.848339+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_clean_scrub_stamp":"2024-09-12T17:10:49.533772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:13:27.613750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"263'151","reported_seq":1246,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:46.551935+0000","last_change":"2024-09-12T17:10:52.585025+0000","last_active":"2024-09-12T18:09:46.551935+0000","last_peered":"2024-09-12T18:09:46.551935+0000","last_clean":"2024-09-12T18:09:46.551935+0000","last_became_active":"2024-09-12T17:10:52.584763+0000","last_became_peered":"2024-09-12T17:10:52.584763+0000","last_unstale":"2024-09-12T18:09:46.551935+0000","last_undegraded":"2024-09-12T18:09:46.551935+0000","last_fullsized":"2024-09-12T18:09:46.551935+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:21:47.900231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":215,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":802,"num_read_kb":800,"num_write":350,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"263'1272","reported_seq":2975,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:48.690645+0000","last_change":"2024-09-12T17:10:44.513427+0000","last_active":"2024-09-12T18:09:48.690645+0000","last_peered":"2024-09-12T18:09:48.690645+0000","last_clean":"2024-09-12T18:09:48.690645+0000","last_became_active":"2024-09-12T17:10:44.513047+0000","last_became_peered":"2024-09-12T17:10:44.513047+0000","last_unstale":"2024-09-12T18:09:48.690645+0000","last_undegraded":"2024-09-12T18:09:48.690645+0000","last_fullsized":"2024-09-12T18:09:48.690645+0000","mapping_epoch":26,"log_start":"263'1200","ondisk_log_start":"263'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":1200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:58:01.192821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5916,"num_read_kb":5241,"num_write":1773,"num_write_kb":764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"263'261","reported_seq":929,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:04.843299+0000","last_change":"2024-09-12T17:11:16.863072+0000","last_active":"2024-09-12T18:09:04.843299+0000","last_peered":"2024-09-12T18:09:04.843299+0000","last_clean":"2024-09-12T18:09:04.843299+0000","last_became_active":"2024-09-12T17:11:16.862649+0000","last_became_peered":"2024-09-12T17:11:16.862649+0000","last_unstale":"2024-09-12T18:09:04.843299+0000","last_undegraded":"2024-09-12T18:09:04.843299+0000","last_fullsized":"2024-09-12T18:09:04.843299+0000","mapping_epoch":37,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":200,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:36:29.636546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7373923,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":582,"num_read_kb":13957,"num_write":1191,"num_write_kb":16858,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,7],"acting":[0,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"29'1","reported_seq":501,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:55.146197+0000","last_change":"2024-09-12T17:10:46.527752+0000","last_active":"2024-09-12T18:08:55.146197+0000","last_peered":"2024-09-12T18:08:55.146197+0000","last_clean":"2024-09-12T18:08:55.146197+0000","last_became_active":"2024-09-12T17:10:46.527422+0000","last_became_peered":"2024-09-12T17:10:46.527422+0000","last_unstale":"2024-09-12T18:08:55.146197+0000","last_undegraded":"2024-09-12T18:08:55.146197+0000","last_fullsized":"2024-09-12T18:08:55.146197+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_clean_scrub_stamp":"2024-09-12T17:10:45.504515+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:56:46.571241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"263'161","reported_seq":748,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:10:49.740712+0000","last_change":"2024-09-12T17:10:48.545106+0000","last_active":"2024-09-12T18:10:49.740712+0000","last_peered":"2024-09-12T18:10:49.740712+0000","last_clean":"2024-09-12T18:10:49.740712+0000","last_became_active":"2024-09-12T17:10:48.544572+0000","last_became_peered":"2024-09-12T17:10:48.544572+0000","last_unstale":"2024-09-12T18:10:49.740712+0000","last_undegraded":"2024-09-12T18:10:49.740712+0000","last_fullsized":"2024-09-12T18:10:49.740712+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_clean_scrub_stamp":"2024-09-12T17:10:47.516917+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:11:28.036014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9746,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":207,"num_read_kb":258,"num_write":118,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":490,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:19.837629+0000","last_change":"2024-09-12T17:10:50.560331+0000","last_active":"2024-09-12T18:08:19.837629+0000","last_peered":"2024-09-12T18:08:19.837629+0000","last_clean":"2024-09-12T18:08:19.837629+0000","last_became_active":"2024-09-12T17:10:50.560057+0000","last_became_peered":"2024-09-12T17:10:50.560057+0000","last_unstale":"2024-09-12T18:08:19.837629+0000","last_undegraded":"2024-09-12T18:08:19.837629+0000","last_fullsized":"2024-09-12T18:08:19.837629+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_clean_scrub_stamp":"2024-09-12T17:10:49.533772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:11:03.611393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"263'132","reported_seq":623,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:08.654757+0000","last_change":"2024-09-12T17:10:52.570799+0000","last_active":"2024-09-12T18:11:08.654757+0000","last_peered":"2024-09-12T18:11:08.654757+0000","last_clean":"2024-09-12T18:11:08.654757+0000","last_became_active":"2024-09-12T17:10:52.570480+0000","last_became_peered":"2024-09-12T17:10:52.570480+0000","last_unstale":"2024-09-12T18:11:08.654757+0000","last_undegraded":"2024-09-12T18:11:08.654757+0000","last_fullsized":"2024-09-12T18:11:08.654757+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:15:54.371121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":203,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":138,"num_read_kb":137,"num_write":320,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"263'410","reported_seq":1793,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:15.148505+0000","last_change":"2024-09-12T17:10:44.509800+0000","last_active":"2024-09-12T18:09:15.148505+0000","last_peered":"2024-09-12T18:09:15.148505+0000","last_clean":"2024-09-12T18:09:15.148505+0000","last_became_active":"2024-09-12T17:10:44.509508+0000","last_became_peered":"2024-09-12T17:10:44.509508+0000","last_unstale":"2024-09-12T18:09:15.148505+0000","last_undegraded":"2024-09-12T18:09:15.148505+0000","last_fullsized":"2024-09-12T18:09:15.148505+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":300,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:53:56.436440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2094,"num_read_kb":1953,"num_write":504,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"263'237","reported_seq":881,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:04.874429+0000","last_change":"2024-09-12T17:10:42.526128+0000","last_active":"2024-09-12T18:09:04.874429+0000","last_peered":"2024-09-12T18:09:04.874429+0000","last_clean":"2024-09-12T18:09:04.874429+0000","last_became_active":"2024-09-12T17:10:42.521435+0000","last_became_peered":"2024-09-12T17:10:42.521435+0000","last_unstale":"2024-09-12T18:09:04.874429+0000","last_undegraded":"2024-09-12T18:09:04.874429+0000","last_fullsized":"2024-09-12T18:09:04.874429+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":200,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:05:09.412034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4231758,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":523,"num_read_kb":7759,"num_write":1102,"num_write_kb":27695,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,5],"acting":[6,0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"263'492","reported_seq":2208,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:15.148484+0000","last_change":"2024-09-12T17:10:44.519546+0000","last_active":"2024-09-12T18:09:15.148484+0000","last_peered":"2024-09-12T18:09:15.148484+0000","last_clean":"2024-09-12T18:09:15.148484+0000","last_became_active":"2024-09-12T17:10:44.519236+0000","last_became_peered":"2024-09-12T17:10:44.519236+0000","last_unstale":"2024-09-12T18:09:15.148484+0000","last_undegraded":"2024-09-12T18:09:15.148484+0000","last_fullsized":"2024-09-12T18:09:15.148484+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":400,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:12:02.063964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2628,"num_read_kb":2506,"num_write":587,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"263'252","reported_seq":1016,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:04.837434+0000","last_change":"2024-09-12T17:10:42.519763+0000","last_active":"2024-09-12T18:09:04.837434+0000","last_peered":"2024-09-12T18:09:04.837434+0000","last_clean":"2024-09-12T18:09:04.837434+0000","last_became_active":"2024-09-12T17:10:42.519178+0000","last_became_peered":"2024-09-12T17:10:42.519178+0000","last_unstale":"2024-09-12T18:09:04.837434+0000","last_undegraded":"2024-09-12T18:09:04.837434+0000","last_fullsized":"2024-09-12T18:09:04.837434+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:08:25.057371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":93177,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1047,"num_read_kb":7502,"num_write":1180,"num_write_kb":38848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6,7],"acting":[2,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"263'391","reported_seq":1968,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:08.688478+0000","last_change":"2024-09-12T17:10:44.515755+0000","last_active":"2024-09-12T18:11:08.688478+0000","last_peered":"2024-09-12T18:11:08.688478+0000","last_clean":"2024-09-12T18:11:08.688478+0000","last_became_active":"2024-09-12T17:10:44.515474+0000","last_became_peered":"2024-09-12T17:10:44.515474+0000","last_unstale":"2024-09-12T18:11:08.688478+0000","last_undegraded":"2024-09-12T18:11:08.688478+0000","last_fullsized":"2024-09-12T18:11:08.688478+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":300,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:30:06.533570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2306,"num_read_kb":2212,"num_write":451,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"263'192","reported_seq":810,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:34.828005+0000","last_change":"2024-09-12T17:11:16.618040+0000","last_active":"2024-09-12T18:07:34.828005+0000","last_peered":"2024-09-12T18:07:34.828005+0000","last_clean":"2024-09-12T18:07:34.828005+0000","last_became_active":"2024-09-12T17:11:16.617657+0000","last_became_peered":"2024-09-12T17:11:16.617657+0000","last_unstale":"2024-09-12T18:07:34.828005+0000","last_undegraded":"2024-09-12T18:07:34.828005+0000","last_fullsized":"2024-09-12T18:07:34.828005+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:38:48.774645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7665656,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":497,"num_read_kb":26759,"num_write":945,"num_write_kb":25619,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,6],"acting":[2,3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"263'792","reported_seq":2412,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:48.687914+0000","last_change":"2024-09-12T17:10:44.510114+0000","last_active":"2024-09-12T18:09:48.687914+0000","last_peered":"2024-09-12T18:09:48.687914+0000","last_clean":"2024-09-12T18:09:48.687914+0000","last_became_active":"2024-09-12T17:10:44.509845+0000","last_became_peered":"2024-09-12T17:10:44.509845+0000","last_unstale":"2024-09-12T18:09:48.687914+0000","last_undegraded":"2024-09-12T18:09:48.687914+0000","last_fullsized":"2024-09-12T18:09:48.687914+0000","mapping_epoch":26,"log_start":"263'700","ondisk_log_start":"263'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":700,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:49:56.008647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3882,"num_read_kb":3524,"num_write":1030,"num_write_kb":369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"263'222","reported_seq":853,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:14.844465+0000","last_change":"2024-09-12T17:10:42.519992+0000","last_active":"2024-09-12T18:09:14.844465+0000","last_peered":"2024-09-12T18:09:14.844465+0000","last_clean":"2024-09-12T18:09:14.844465+0000","last_became_active":"2024-09-12T17:10:42.519560+0000","last_became_peered":"2024-09-12T17:10:42.519560+0000","last_unstale":"2024-09-12T18:09:14.844465+0000","last_undegraded":"2024-09-12T18:09:14.844465+0000","last_fullsized":"2024-09-12T18:09:14.844465+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:31:06.232228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":497465,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":415,"num_read_kb":2141,"num_write":1021,"num_write_kb":23963,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,1],"acting":[0,3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"263'769","reported_seq":2442,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:19.853137+0000","last_change":"2024-09-12T17:10:44.512192+0000","last_active":"2024-09-12T18:09:19.853137+0000","last_peered":"2024-09-12T18:09:19.853137+0000","last_clean":"2024-09-12T18:09:19.853137+0000","last_became_active":"2024-09-12T17:10:44.511893+0000","last_became_peered":"2024-09-12T17:10:44.511893+0000","last_unstale":"2024-09-12T18:09:19.853137+0000","last_undegraded":"2024-09-12T18:09:19.853137+0000","last_fullsized":"2024-09-12T18:09:19.853137+0000","mapping_epoch":26,"log_start":"263'700","ondisk_log_start":"263'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":700,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:59:22.759342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":3826,"num_read_kb":3490,"num_write":982,"num_write_kb":336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"263'217","reported_seq":1062,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:32.660243+0000","last_change":"2024-09-12T17:10:42.524423+0000","last_active":"2024-09-12T18:09:32.660243+0000","last_peered":"2024-09-12T18:09:32.660243+0000","last_clean":"2024-09-12T18:09:32.660243+0000","last_became_active":"2024-09-12T17:10:42.524018+0000","last_became_peered":"2024-09-12T17:10:42.524018+0000","last_unstale":"2024-09-12T18:09:32.660243+0000","last_undegraded":"2024-09-12T18:09:32.660243+0000","last_fullsized":"2024-09-12T18:09:32.660243+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:08:56.591768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12496189,"num_objects":13,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":1292,"num_read_kb":150766,"num_write":982,"num_write_kb":42134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0,7],"acting":[3,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"263'524","reported_seq":2019,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:04.854464+0000","last_change":"2024-09-12T17:10:44.509706+0000","last_active":"2024-09-12T18:09:04.854464+0000","last_peered":"2024-09-12T18:09:04.854464+0000","last_clean":"2024-09-12T18:09:04.854464+0000","last_became_active":"2024-09-12T17:10:44.509433+0000","last_became_peered":"2024-09-12T17:10:44.509433+0000","last_unstale":"2024-09-12T18:09:04.854464+0000","last_undegraded":"2024-09-12T18:09:04.854464+0000","last_fullsized":"2024-09-12T18:09:04.854464+0000","mapping_epoch":26,"log_start":"263'500","ondisk_log_start":"263'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":500,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:43:58.521596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2637,"num_read_kb":2409,"num_write":664,"num_write_kb":195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"263'177","reported_seq":837,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:15.148464+0000","last_change":"2024-09-12T17:10:42.515059+0000","last_active":"2024-09-12T18:09:15.148464+0000","last_peered":"2024-09-12T18:09:15.148464+0000","last_clean":"2024-09-12T18:09:15.148464+0000","last_became_active":"2024-09-12T17:10:42.514593+0000","last_became_peered":"2024-09-12T17:10:42.514593+0000","last_unstale":"2024-09-12T18:09:15.148464+0000","last_undegraded":"2024-09-12T18:09:15.148464+0000","last_fullsized":"2024-09-12T18:09:15.148464+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:42:35.824857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5511218,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":481,"num_read_kb":20980,"num_write":840,"num_write_kb":34024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,5],"acting":[1,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"263'1124","reported_seq":2692,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:08.688159+0000","last_change":"2024-09-12T17:10:44.523190+0000","last_active":"2024-09-12T18:11:08.688159+0000","last_peered":"2024-09-12T18:11:08.688159+0000","last_clean":"2024-09-12T18:11:08.688159+0000","last_became_active":"2024-09-12T17:10:44.522911+0000","last_became_peered":"2024-09-12T17:10:44.522911+0000","last_unstale":"2024-09-12T18:11:08.688159+0000","last_undegraded":"2024-09-12T18:11:08.688159+0000","last_fullsized":"2024-09-12T18:11:08.688159+0000","mapping_epoch":26,"log_start":"263'1100","ondisk_log_start":"263'1100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":1100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:09:01.732616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5182,"num_read_kb":4601,"num_write":1539,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"263'192","reported_seq":838,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:14.876120+0000","last_change":"2024-09-12T17:10:42.525103+0000","last_active":"2024-09-12T18:09:14.876120+0000","last_peered":"2024-09-12T18:09:14.876120+0000","last_clean":"2024-09-12T18:09:14.876120+0000","last_became_active":"2024-09-12T17:10:42.520304+0000","last_became_peered":"2024-09-12T17:10:42.520304+0000","last_unstale":"2024-09-12T18:09:14.876120+0000","last_undegraded":"2024-09-12T18:09:14.876120+0000","last_fullsized":"2024-09-12T18:09:14.876120+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:45:02.245757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1376916,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":491,"num_read_kb":8074,"num_write":950,"num_write_kb":20454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4,5],"acting":[6,7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"263'882","reported_seq":2582,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:04.874441+0000","last_change":"2024-09-12T17:10:44.518118+0000","last_active":"2024-09-12T18:09:04.874441+0000","last_peered":"2024-09-12T18:09:04.874441+0000","last_clean":"2024-09-12T18:09:04.874441+0000","last_became_active":"2024-09-12T17:10:44.517530+0000","last_became_peered":"2024-09-12T17:10:44.517530+0000","last_unstale":"2024-09-12T18:09:04.874441+0000","last_undegraded":"2024-09-12T18:09:04.874441+0000","last_fullsized":"2024-09-12T18:09:04.874441+0000","mapping_epoch":26,"log_start":"263'800","ondisk_log_start":"263'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":800,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:43:44.156580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4395,"num_read_kb":3967,"num_write":1219,"num_write_kb":499,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"263'182","reported_seq":803,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:32.300512+0000","last_change":"2024-09-12T17:10:42.529286+0000","last_active":"2024-09-12T18:09:32.300512+0000","last_peered":"2024-09-12T18:09:32.300512+0000","last_clean":"2024-09-12T18:09:32.300512+0000","last_became_active":"2024-09-12T17:10:42.528899+0000","last_became_peered":"2024-09-12T17:10:42.528899+0000","last_unstale":"2024-09-12T18:09:32.300512+0000","last_undegraded":"2024-09-12T18:09:32.300512+0000","last_fullsized":"2024-09-12T18:09:32.300512+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:26:02.984559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12665800,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":384,"num_read_kb":42419,"num_write":864,"num_write_kb":46548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,5],"acting":[3,4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"263'385","reported_seq":1841,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:49.548319+0000","last_change":"2024-09-12T17:10:44.523470+0000","last_active":"2024-09-12T18:09:49.548319+0000","last_peered":"2024-09-12T18:09:49.548319+0000","last_clean":"2024-09-12T18:09:49.548319+0000","last_became_active":"2024-09-12T17:10:44.523173+0000","last_became_peered":"2024-09-12T17:10:44.523173+0000","last_unstale":"2024-09-12T18:09:49.548319+0000","last_undegraded":"2024-09-12T18:09:49.548319+0000","last_fullsized":"2024-09-12T18:09:49.548319+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":300,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:42:05.823212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2006,"num_read_kb":1913,"num_write":441,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"263'147","reported_seq":841,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:29.858956+0000","last_change":"2024-09-12T17:10:42.522274+0000","last_active":"2024-09-12T18:09:29.858956+0000","last_peered":"2024-09-12T18:09:29.858956+0000","last_clean":"2024-09-12T18:09:29.858956+0000","last_became_active":"2024-09-12T17:10:42.521824+0000","last_became_peered":"2024-09-12T17:10:42.521824+0000","last_unstale":"2024-09-12T18:09:29.858956+0000","last_undegraded":"2024-09-12T18:09:29.858956+0000","last_fullsized":"2024-09-12T18:09:29.858956+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:16:48.589688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6314985,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":602,"num_read_kb":135941,"num_write":771,"num_write_kb":15017,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"263'497","reported_seq":2137,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:04.854605+0000","last_change":"2024-09-12T17:10:44.517504+0000","last_active":"2024-09-12T18:09:04.854605+0000","last_peered":"2024-09-12T18:09:04.854605+0000","last_clean":"2024-09-12T18:09:04.854605+0000","last_became_active":"2024-09-12T17:10:44.517175+0000","last_became_peered":"2024-09-12T17:10:44.517175+0000","last_unstale":"2024-09-12T18:09:04.854605+0000","last_undegraded":"2024-09-12T18:09:04.854605+0000","last_fullsized":"2024-09-12T18:09:04.854605+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":400,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:08:58.263083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2646,"num_read_kb":2487,"num_write":582,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"263'171","reported_seq":785,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:14.852332+0000","last_change":"2024-09-12T17:10:42.525302+0000","last_active":"2024-09-12T18:09:14.852332+0000","last_peered":"2024-09-12T18:09:14.852332+0000","last_clean":"2024-09-12T18:09:14.852332+0000","last_became_active":"2024-09-12T17:10:42.524860+0000","last_became_peered":"2024-09-12T17:10:42.524860+0000","last_unstale":"2024-09-12T18:09:14.852332+0000","last_undegraded":"2024-09-12T18:09:14.852332+0000","last_fullsized":"2024-09-12T18:09:14.852332+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":100,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:46:29.731094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":409,"num_read_kb":436,"num_write":844,"num_write_kb":16042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,1],"acting":[3,4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"263'738","reported_seq":2312,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:49.547357+0000","last_change":"2024-09-12T17:10:44.515129+0000","last_active":"2024-09-12T18:09:49.547357+0000","last_peered":"2024-09-12T18:09:49.547357+0000","last_clean":"2024-09-12T18:09:49.547357+0000","last_became_active":"2024-09-12T17:10:44.514847+0000","last_became_peered":"2024-09-12T17:10:44.514847+0000","last_unstale":"2024-09-12T18:09:49.547357+0000","last_undegraded":"2024-09-12T18:09:49.547357+0000","last_fullsized":"2024-09-12T18:09:49.547357+0000","mapping_epoch":26,"log_start":"263'700","ondisk_log_start":"263'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":700,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:19:38.676107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3592,"num_read_kb":3279,"num_write":969,"num_write_kb":334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"263'228","reported_seq":885,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:14.855205+0000","last_change":"2024-09-12T17:10:42.520188+0000","last_active":"2024-09-12T18:09:14.855205+0000","last_peered":"2024-09-12T18:09:14.855205+0000","last_clean":"2024-09-12T18:09:14.855205+0000","last_became_active":"2024-09-12T17:10:42.519789+0000","last_became_peered":"2024-09-12T17:10:42.519789+0000","last_unstale":"2024-09-12T18:09:14.855205+0000","last_undegraded":"2024-09-12T18:09:14.855205+0000","last_fullsized":"2024-09-12T18:09:14.855205+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":200,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:18:08.752971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6373233,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":561,"num_read_kb":21140,"num_write":1102,"num_write_kb":33501,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,3],"acting":[5,7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"263'451","reported_seq":1945,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:49.546842+0000","last_change":"2024-09-12T17:10:44.512379+0000","last_active":"2024-09-12T18:09:49.546842+0000","last_peered":"2024-09-12T18:09:49.546842+0000","last_clean":"2024-09-12T18:09:49.546842+0000","last_became_active":"2024-09-12T17:10:44.510280+0000","last_became_peered":"2024-09-12T17:10:44.510280+0000","last_unstale":"2024-09-12T18:09:49.546842+0000","last_undegraded":"2024-09-12T18:09:49.546842+0000","last_fullsized":"2024-09-12T18:09:49.546842+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":400,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:12:26.413167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2351,"num_read_kb":2195,"num_write":554,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"263'148","reported_seq":746,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:14.844500+0000","last_change":"2024-09-12T17:10:42.521419+0000","last_active":"2024-09-12T18:09:14.844500+0000","last_peered":"2024-09-12T18:09:14.844500+0000","last_clean":"2024-09-12T18:09:14.844500+0000","last_became_active":"2024-09-12T17:10:42.520020+0000","last_became_peered":"2024-09-12T17:10:42.520020+0000","last_unstale":"2024-09-12T18:09:14.844500+0000","last_undegraded":"2024-09-12T18:09:14.844500+0000","last_fullsized":"2024-09-12T18:09:14.844500+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:41:55.197067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5664710,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":326,"num_read_kb":1191,"num_write":745,"num_write_kb":23442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,6],"acting":[0,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"263'357","reported_seq":1770,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:49.547933+0000","last_change":"2024-09-12T17:10:44.516984+0000","last_active":"2024-09-12T18:09:49.547933+0000","last_peered":"2024-09-12T18:09:49.547933+0000","last_clean":"2024-09-12T18:09:49.547933+0000","last_became_active":"2024-09-12T17:10:44.516697+0000","last_became_peered":"2024-09-12T17:10:44.516697+0000","last_unstale":"2024-09-12T18:09:49.547933+0000","last_undegraded":"2024-09-12T18:09:49.547933+0000","last_fullsized":"2024-09-12T18:09:49.547933+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:36:09.173783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1919,"num_read_kb":1833,"num_write":391,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"263'207","reported_seq":867,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:34.828036+0000","last_change":"2024-09-12T17:11:16.863226+0000","last_active":"2024-09-12T18:07:34.828036+0000","last_peered":"2024-09-12T18:07:34.828036+0000","last_clean":"2024-09-12T18:07:34.828036+0000","last_became_active":"2024-09-12T17:11:16.862645+0000","last_became_peered":"2024-09-12T17:11:16.862645+0000","last_unstale":"2024-09-12T18:07:34.828036+0000","last_undegraded":"2024-09-12T18:07:34.828036+0000","last_fullsized":"2024-09-12T18:07:34.828036+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:47:44.135027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5606243,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":575,"num_read_kb":84325,"num_write":973,"num_write_kb":27874,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,0,7],"acting":[2,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"263'818","reported_seq":2282,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:14.844433+0000","last_change":"2024-09-12T17:10:44.519568+0000","last_active":"2024-09-12T18:09:14.844433+0000","last_peered":"2024-09-12T18:09:14.844433+0000","last_clean":"2024-09-12T18:09:14.844433+0000","last_became_active":"2024-09-12T17:10:44.519253+0000","last_became_peered":"2024-09-12T17:10:44.519253+0000","last_unstale":"2024-09-12T18:09:14.844433+0000","last_undegraded":"2024-09-12T18:09:14.844433+0000","last_fullsized":"2024-09-12T18:09:14.844433+0000","mapping_epoch":26,"log_start":"263'800","ondisk_log_start":"263'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":800,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:17:25.711902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3866,"num_read_kb":3440,"num_write":1124,"num_write_kb":450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"263'180","reported_seq":788,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:24.858062+0000","last_change":"2024-09-12T17:10:42.524574+0000","last_active":"2024-09-12T18:09:24.858062+0000","last_peered":"2024-09-12T18:09:24.858062+0000","last_clean":"2024-09-12T18:09:24.858062+0000","last_became_active":"2024-09-12T17:10:42.524098+0000","last_became_peered":"2024-09-12T17:10:42.524098+0000","last_unstale":"2024-09-12T18:09:24.858062+0000","last_undegraded":"2024-09-12T18:09:24.858062+0000","last_fullsized":"2024-09-12T18:09:24.858062+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:13:35.032725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5270092,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":368,"num_read_kb":5543,"num_write":828,"num_write_kb":19602,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6,3],"acting":[7,2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"263'416","reported_seq":2003,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:20.794247+0000","last_change":"2024-09-12T17:10:44.515468+0000","last_active":"2024-09-12T18:09:20.794247+0000","last_peered":"2024-09-12T18:09:20.794247+0000","last_clean":"2024-09-12T18:09:20.794247+0000","last_became_active":"2024-09-12T17:10:44.514154+0000","last_became_peered":"2024-09-12T17:10:44.514154+0000","last_unstale":"2024-09-12T18:09:20.794247+0000","last_undegraded":"2024-09-12T18:09:20.794247+0000","last_fullsized":"2024-09-12T18:09:20.794247+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":400,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:10:07.030810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2340,"num_read_kb":2233,"num_write":478,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"263'219","reported_seq":838,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:05.578638+0000","last_change":"2024-09-12T17:10:42.519764+0000","last_active":"2024-09-12T18:09:05.578638+0000","last_peered":"2024-09-12T18:09:05.578638+0000","last_clean":"2024-09-12T18:09:05.578638+0000","last_became_active":"2024-09-12T17:10:42.519316+0000","last_became_peered":"2024-09-12T17:10:42.519316+0000","last_unstale":"2024-09-12T18:09:05.578638+0000","last_undegraded":"2024-09-12T18:09:05.578638+0000","last_fullsized":"2024-09-12T18:09:05.578638+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:10:02.857764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5965451,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":501,"num_read_kb":7212,"num_write":958,"num_write_kb":24573,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1,7],"acting":[2,6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"263'434","reported_seq":2034,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:08.687986+0000","last_change":"2024-09-12T17:10:44.513885+0000","last_active":"2024-09-12T18:11:08.687986+0000","last_peered":"2024-09-12T18:11:08.687986+0000","last_clean":"2024-09-12T18:11:08.687986+0000","last_became_active":"2024-09-12T17:10:44.513514+0000","last_became_peered":"2024-09-12T17:10:44.513514+0000","last_unstale":"2024-09-12T18:11:08.687986+0000","last_undegraded":"2024-09-12T18:11:08.687986+0000","last_fullsized":"2024-09-12T18:11:08.687986+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":400,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:13:21.567231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2337,"num_read_kb":2234,"num_write":490,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"263'143","reported_seq":759,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:04.853823+0000","last_change":"2024-09-12T17:10:42.527461+0000","last_active":"2024-09-12T18:09:04.853823+0000","last_peered":"2024-09-12T18:09:04.853823+0000","last_clean":"2024-09-12T18:09:04.853823+0000","last_became_active":"2024-09-12T17:10:42.527050+0000","last_became_peered":"2024-09-12T17:10:42.527050+0000","last_unstale":"2024-09-12T18:09:04.853823+0000","last_undegraded":"2024-09-12T18:09:04.853823+0000","last_fullsized":"2024-09-12T18:09:04.853823+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:48:18.827396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7398100,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":318,"num_read_kb":34406,"num_write":729,"num_write_kb":29438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4,6],"acting":[5,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"263'191","reported_seq":828,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:04.853681+0000","last_change":"2024-09-12T17:10:42.524416+0000","last_active":"2024-09-12T18:09:04.853681+0000","last_peered":"2024-09-12T18:09:04.853681+0000","last_clean":"2024-09-12T18:09:04.853681+0000","last_became_active":"2024-09-12T17:10:42.523311+0000","last_became_peered":"2024-09-12T17:10:42.523311+0000","last_unstale":"2024-09-12T18:09:04.853681+0000","last_undegraded":"2024-09-12T18:09:04.853681+0000","last_fullsized":"2024-09-12T18:09:04.853681+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:26:51.477607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9029807,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":463,"num_read_kb":32297,"num_write":952,"num_write_kb":18657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,7],"acting":[5,1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"263'821","reported_seq":2264,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:20.794810+0000","last_change":"2024-09-12T17:10:44.523554+0000","last_active":"2024-09-12T18:09:20.794810+0000","last_peered":"2024-09-12T18:09:20.794810+0000","last_clean":"2024-09-12T18:09:20.794810+0000","last_became_active":"2024-09-12T17:10:44.523243+0000","last_became_peered":"2024-09-12T17:10:44.523243+0000","last_unstale":"2024-09-12T18:09:20.794810+0000","last_undegraded":"2024-09-12T18:09:20.794810+0000","last_fullsized":"2024-09-12T18:09:20.794810+0000","mapping_epoch":26,"log_start":"263'800","ondisk_log_start":"263'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":800,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:20:39.715953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3977,"num_read_kb":3544,"num_write":1118,"num_write_kb":432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"263'231","reported_seq":876,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:05.147204+0000","last_change":"2024-09-12T17:10:42.520724+0000","last_active":"2024-09-12T18:09:05.147204+0000","last_peered":"2024-09-12T18:09:05.147204+0000","last_clean":"2024-09-12T18:09:05.147204+0000","last_became_active":"2024-09-12T17:10:42.519643+0000","last_became_peered":"2024-09-12T17:10:42.519643+0000","last_unstale":"2024-09-12T18:09:05.147204+0000","last_undegraded":"2024-09-12T18:09:05.147204+0000","last_fullsized":"2024-09-12T18:09:05.147204+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:32:38.227259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16870164,"num_objects":11,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":410,"num_read_kb":42701,"num_write":975,"num_write_kb":42419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5,0],"acting":[1,4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"263'612","reported_seq":2303,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:49.548577+0000","last_change":"2024-09-12T17:10:44.512927+0000","last_active":"2024-09-12T18:09:49.548577+0000","last_peered":"2024-09-12T18:09:49.548577+0000","last_clean":"2024-09-12T18:09:49.548577+0000","last_became_active":"2024-09-12T17:10:44.512488+0000","last_became_peered":"2024-09-12T17:10:44.512488+0000","last_unstale":"2024-09-12T18:09:49.548577+0000","last_undegraded":"2024-09-12T18:09:49.548577+0000","last_fullsized":"2024-09-12T18:09:49.548577+0000","mapping_epoch":26,"log_start":"263'600","ondisk_log_start":"263'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":600,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:26:47.580747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3240,"num_read_kb":2966,"num_write":800,"num_write_kb":244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6085,"num_read_kb":4263,"num_write":1964,"num_write_kb":863,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1035,"ondisk_log_size":1035,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15869,"num_objects":86,"num_object_clones":0,"num_object_copies":172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":86,"num_whiteouts":0,"num_read":16199,"num_read_kb":15883,"num_write":16708,"num_write_kb":4876,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":31738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1652,"ondisk_log_size":1652,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":546,"ondisk_log_size":546,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":361433,"num_objects":199,"num_object_clones":0,"num_object_copies":398,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":199,"num_whiteouts":0,"num_read":8534,"num_read_kb":10169,"num_write":5927,"num_write_kb":2764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":679936,"data_stored":186332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1924,"ondisk_log_size":1924,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2383,"num_read_kb":2845,"num_write":20,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":165,"num_object_clones":0,"num_object_copies":330,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":165,"num_whiteouts":0,"num_read":212965,"num_read_kb":194286,"num_write":55441,"num_write_kb":18926,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":165,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4199,"ondisk_log_size":4199,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":451889251,"num_objects":466,"num_object_clones":0,"num_object_copies":1864,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":466,"num_whiteouts":0,"num_read":32822,"num_read_kb":2020284,"num_write":62577,"num_write_kb":2063190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":607125504,"data_stored":607125504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4003,"ondisk_log_size":4003,"up":256,"acting":256,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":74503726,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":122,"num_read_kb":196715,"num_write":139,"num_write_kb":127071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":149012480,"data_stored":149007452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":74503726,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":118,"num_read_kb":189543,"num_write":139,"num_write_kb":127071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":149012480,"data_stored":149007452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575589,"num_pgs":116,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":329772,"kb_used_data":87580,"kb_used_omap":1,"kb_used_meta":242174,"kb_avail":94042068,"statfs":{"total":96636764160,"available":96299077632,"internally_reserved":0,"allocated":89681920,"data_stored":87641193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":247986635},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575587,"num_pgs":107,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":345608,"kb_used_data":111736,"kb_used_omap":1,"kb_used_meta":233854,"kb_avail":94026232,"statfs":{"total":96636764160,"available":96282861568,"internally_reserved":0,"allocated":114417664,"data_stored":112452529,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":239466950},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575592,"num_pgs":113,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":206216,"kb_used_data":98680,"kb_used_omap":1,"kb_used_meta":107518,"kb_avail":94165624,"statfs":{"total":96636764160,"available":96425598976,"internally_reserved":0,"allocated":101048320,"data_stored":98974813,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":110098885},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575587,"num_pgs":113,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":217280,"kb_used_data":105584,"kb_used_omap":1,"kb_used_meta":111678,"kb_avail":94154560,"statfs":{"total":96636764160,"available":96414269440,"internally_reserved":0,"allocated":108118016,"data_stored":106180950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":114358725},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575589,"num_pgs":130,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":383128,"kb_used_data":145096,"kb_used_omap":1,"kb_used_meta":238014,"kb_avail":93988712,"statfs":{"total":96636764160,"available":96244441088,"internally_reserved":0,"allocated":148578304,"data_stored":146564735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":243726791},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575589,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":204752,"kb_used_data":115264,"kb_used_omap":1,"kb_used_meta":89470,"kb_avail":94167088,"statfs":{"total":96636764160,"available":96427098112,"internally_reserved":0,"allocated":118030336,"data_stored":116093919,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":91617733},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575587,"num_pgs":120,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":280016,"kb_used_data":132288,"kb_used_omap":1,"kb_used_meta":147710,"kb_avail":94091824,"statfs":{"total":96636764160,"available":96350027776,"internally_reserved":0,"allocated":135462912,"data_stored":133462601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":151255493},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575587,"num_pgs":116,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":356172,"kb_used_data":122300,"kb_used_omap":1,"kb_used_meta":233854,"kb_avail":94015668,"statfs":{"total":96636764160,"available":96272044032,"internally_reserved":0,"allocated":125235200,"data_stored":123232330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":239466949},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":80457728,"data_stored":80457728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":90275840,"data_stored":90275840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":66637824,"data_stored":66637824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":77160448,"data_stored":77160448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":70307840,"data_stored":70307840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":77750272,"data_stored":77750272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":68227072,"data_stored":68227072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":76308480,"data_stored":76308480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":24849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":25235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":8663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":27561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":5553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":135168,"data_stored":39032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":18055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":139264,"data_stored":37384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":4345,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":5119,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":3919,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":4996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3623,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":3527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":17879040,"data_stored":17877415,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":37748736,"data_stored":37748736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16777216,"data_stored":16777216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":14684160,"data_stored":14683271,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":18874368,"data_stored":18874368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":13680640,"data_stored":13679901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20975616,"data_stored":20974730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8392704,"data_stored":8391815,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":22020096,"data_stored":22020096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":3149824,"data_stored":3148938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":30408704,"data_stored":30408704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":52432896,"data_stored":52432007,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":14733312,"data_stored":14731687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20971520,"data_stored":20971520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":51620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T18:11:42.216 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T18:11:42.216 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T18:11:42.568 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T18:11:42.580 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-09-12T18:11:42.582 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":2094,"stamp":"2024-09-12T18:11:40.608769+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":601866185,"num_objects":980,"num_object_clones":0,"num_object_copies":2892,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":980,"num_whiteouts":0,"num_read":279306,"num_read_kb":2634055,"num_write":143036,"num_write_kb":2346416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":212,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13609,"ondisk_log_size":13609,"up":914,"acting":914,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":914,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2322944,"kb_used_data":918528,"kb_used_omap":12,"kb_used_meta":1404275,"kb_avail":752651776,"statfs":{"total":773094113280,"available":770715418624,"internally_reserved":0,"allocated":940572672,"data_stored":924603070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":1437978161},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005050"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":22,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:06:59.835776+0000","last_change":"2024-09-12T17:46:57.082723+0000","last_active":"2024-09-12T18:06:59.835776+0000","last_peered":"2024-09-12T18:06:59.835776+0000","last_clean":"2024-09-12T18:06:59.835776+0000","last_became_active":"2024-09-12T17:46:57.082400+0000","last_became_peered":"2024-09-12T17:46:57.082400+0000","last_unstale":"2024-09-12T18:06:59.835776+0000","last_undegraded":"2024-09-12T18:06:59.835776+0000","last_fullsized":"2024-09-12T18:06:59.835776+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:49:21.685677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"0'0","reported_seq":39,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:49.843582+0000","last_change":"2024-09-12T17:30:16.683362+0000","last_active":"2024-09-12T18:07:49.843582+0000","last_peered":"2024-09-12T18:07:49.843582+0000","last_clean":"2024-09-12T18:07:49.843582+0000","last_became_active":"2024-09-12T17:30:16.683077+0000","last_became_peered":"2024-09-12T17:30:16.683077+0000","last_unstale":"2024-09-12T18:07:49.843582+0000","last_undegraded":"2024-09-12T18:07:49.843582+0000","last_fullsized":"2024-09-12T18:07:49.843582+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:50:52.313225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"260'3","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:44.841978+0000","last_change":"2024-09-12T17:30:12.651734+0000","last_active":"2024-09-12T18:07:44.841978+0000","last_peered":"2024-09-12T18:07:44.841978+0000","last_clean":"2024-09-12T18:07:44.841978+0000","last_became_active":"2024-09-12T17:30:12.651461+0000","last_became_peered":"2024-09-12T17:30:12.651461+0000","last_unstale":"2024-09-12T18:07:44.841978+0000","last_undegraded":"2024-09-12T18:07:44.841978+0000","last_fullsized":"2024-09-12T18:07:44.841978+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:51:09.744341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"263'28","reported_seq":134,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:14.837079+0000","last_change":"2024-09-12T17:26:35.669600+0000","last_active":"2024-09-12T18:08:14.837079+0000","last_peered":"2024-09-12T18:08:14.837079+0000","last_clean":"2024-09-12T18:08:14.837079+0000","last_became_active":"2024-09-12T17:26:35.669154+0000","last_became_peered":"2024-09-12T17:26:35.669154+0000","last_unstale":"2024-09-12T18:08:14.837079+0000","last_undegraded":"2024-09-12T18:08:14.837079+0000","last_fullsized":"2024-09-12T18:08:14.837079+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:56:13.407121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":150,"num_read_kb":108,"num_write":46,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":22,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:06:59.822536+0000","last_change":"2024-09-12T17:46:57.096775+0000","last_active":"2024-09-12T18:06:59.822536+0000","last_peered":"2024-09-12T18:06:59.822536+0000","last_clean":"2024-09-12T18:06:59.822536+0000","last_became_active":"2024-09-12T17:46:57.096462+0000","last_became_peered":"2024-09-12T17:46:57.096462+0000","last_unstale":"2024-09-12T18:06:59.822536+0000","last_undegraded":"2024-09-12T18:06:59.822536+0000","last_fullsized":"2024-09-12T18:06:59.822536+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:09:53.229550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"263'8","reported_seq":61,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:49.844250+0000","last_change":"2024-09-12T17:30:16.675262+0000","last_active":"2024-09-12T18:07:49.844250+0000","last_peered":"2024-09-12T18:07:49.844250+0000","last_clean":"2024-09-12T18:07:49.844250+0000","last_became_active":"2024-09-12T17:30:16.674952+0000","last_became_peered":"2024-09-12T17:30:16.674952+0000","last_unstale":"2024-09-12T18:07:49.844250+0000","last_undegraded":"2024-09-12T18:07:49.844250+0000","last_fullsized":"2024-09-12T18:07:49.844250+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:17:48.380471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":30722,"num_write":8,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"263'2","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:45.138583+0000","last_change":"2024-09-12T17:30:12.645927+0000","last_active":"2024-09-12T18:07:45.138583+0000","last_peered":"2024-09-12T18:07:45.138583+0000","last_clean":"2024-09-12T18:07:45.138583+0000","last_became_active":"2024-09-12T17:30:12.645624+0000","last_became_peered":"2024-09-12T17:30:12.645624+0000","last_unstale":"2024-09-12T18:07:45.138583+0000","last_undegraded":"2024-09-12T18:07:45.138583+0000","last_fullsized":"2024-09-12T18:07:45.138583+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:07:42.933168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":10240,"num_write":7,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"263'13","reported_seq":88,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:44.835410+0000","last_change":"2024-09-12T17:26:35.660411+0000","last_active":"2024-09-12T18:08:44.835410+0000","last_peered":"2024-09-12T18:08:44.835410+0000","last_clean":"2024-09-12T18:08:44.835410+0000","last_became_active":"2024-09-12T17:26:35.660132+0000","last_became_peered":"2024-09-12T17:26:35.660132+0000","last_unstale":"2024-09-12T18:08:44.835410+0000","last_undegraded":"2024-09-12T18:08:44.835410+0000","last_fullsized":"2024-09-12T18:08:44.835410+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:16:42.286139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":36,"num_write":29,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:44.871662+0000","last_change":"2024-09-12T17:46:57.076529+0000","last_active":"2024-09-12T18:08:44.871662+0000","last_peered":"2024-09-12T18:08:44.871662+0000","last_clean":"2024-09-12T18:08:44.871662+0000","last_became_active":"2024-09-12T17:46:57.076193+0000","last_became_peered":"2024-09-12T17:46:57.076193+0000","last_unstale":"2024-09-12T18:08:44.871662+0000","last_undegraded":"2024-09-12T18:08:44.871662+0000","last_fullsized":"2024-09-12T18:08:44.871662+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:06:10.868648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"260'3","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:49.834420+0000","last_change":"2024-09-12T17:30:16.671182+0000","last_active":"2024-09-12T18:07:49.834420+0000","last_peered":"2024-09-12T18:07:49.834420+0000","last_clean":"2024-09-12T18:07:49.834420+0000","last_became_active":"2024-09-12T17:30:16.670862+0000","last_became_peered":"2024-09-12T17:30:16.670862+0000","last_unstale":"2024-09-12T18:07:49.834420+0000","last_undegraded":"2024-09-12T18:07:49.834420+0000","last_fullsized":"2024-09-12T18:07:49.834420+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:44:16.981394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"263'4","reported_seq":60,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:24.833227+0000","last_change":"2024-09-12T17:30:12.648635+0000","last_active":"2024-09-12T18:08:24.833227+0000","last_peered":"2024-09-12T18:08:24.833227+0000","last_clean":"2024-09-12T18:08:24.833227+0000","last_became_active":"2024-09-12T17:30:12.648349+0000","last_became_peered":"2024-09-12T17:30:12.648349+0000","last_unstale":"2024-09-12T18:08:24.833227+0000","last_undegraded":"2024-09-12T18:08:24.833227+0000","last_fullsized":"2024-09-12T18:08:24.833227+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:34:54.875445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":18432,"num_write":9,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"263'117","reported_seq":422,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:04.843259+0000","last_change":"2024-09-12T17:26:35.664908+0000","last_active":"2024-09-12T18:09:04.843259+0000","last_peered":"2024-09-12T18:09:04.843259+0000","last_clean":"2024-09-12T18:09:04.843259+0000","last_became_active":"2024-09-12T17:26:35.664247+0000","last_became_peered":"2024-09-12T17:26:35.664247+0000","last_unstale":"2024-09-12T18:09:04.843259+0000","last_undegraded":"2024-09-12T18:09:04.843259+0000","last_fullsized":"2024-09-12T18:09:04.843259+0000","mapping_epoch":250,"log_start":"263'100","ondisk_log_start":"263'100","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:39:07.453840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":722,"num_read_kb":504,"num_write":158,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:49.849229+0000","last_change":"2024-09-12T17:46:57.089742+0000","last_active":"2024-09-12T18:08:49.849229+0000","last_peered":"2024-09-12T18:08:49.849229+0000","last_clean":"2024-09-12T18:08:49.849229+0000","last_became_active":"2024-09-12T17:46:57.089385+0000","last_became_peered":"2024-09-12T17:46:57.089385+0000","last_unstale":"2024-09-12T18:08:49.849229+0000","last_undegraded":"2024-09-12T18:08:49.849229+0000","last_fullsized":"2024-09-12T18:08:49.849229+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:17:02.129348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"263'11","reported_seq":68,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:29.847004+0000","last_change":"2024-09-12T17:30:16.682079+0000","last_active":"2024-09-12T18:08:29.847004+0000","last_peered":"2024-09-12T18:08:29.847004+0000","last_clean":"2024-09-12T18:08:29.847004+0000","last_became_active":"2024-09-12T17:30:16.681766+0000","last_became_peered":"2024-09-12T17:30:16.681766+0000","last_unstale":"2024-09-12T18:08:29.847004+0000","last_undegraded":"2024-09-12T18:08:29.847004+0000","last_fullsized":"2024-09-12T18:08:29.847004+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:31:21.167575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17825792,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":17,"num_read_kb":32770,"num_write":21,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"0'0","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:44.843580+0000","last_change":"2024-09-12T17:30:12.648728+0000","last_active":"2024-09-12T18:07:44.843580+0000","last_peered":"2024-09-12T18:07:44.843580+0000","last_clean":"2024-09-12T18:07:44.843580+0000","last_became_active":"2024-09-12T17:30:12.648369+0000","last_became_peered":"2024-09-12T17:30:12.648369+0000","last_unstale":"2024-09-12T18:07:44.843580+0000","last_undegraded":"2024-09-12T18:07:44.843580+0000","last_fullsized":"2024-09-12T18:07:44.843580+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:12:39.564996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"263'110","reported_seq":439,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:04.851030+0000","last_change":"2024-09-12T17:26:35.666024+0000","last_active":"2024-09-12T18:09:04.851030+0000","last_peered":"2024-09-12T18:09:04.851030+0000","last_clean":"2024-09-12T18:09:04.851030+0000","last_became_active":"2024-09-12T17:26:35.665735+0000","last_became_peered":"2024-09-12T17:26:35.665735+0000","last_unstale":"2024-09-12T18:09:04.851030+0000","last_undegraded":"2024-09-12T18:09:04.851030+0000","last_fullsized":"2024-09-12T18:09:04.851030+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:21:58.014213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":761,"num_read_kb":507,"num_write":140,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:04.851052+0000","last_change":"2024-09-12T17:46:57.090107+0000","last_active":"2024-09-12T18:09:04.851052+0000","last_peered":"2024-09-12T18:09:04.851052+0000","last_clean":"2024-09-12T18:09:04.851052+0000","last_became_active":"2024-09-12T17:46:57.089797+0000","last_became_peered":"2024-09-12T17:46:57.089797+0000","last_unstale":"2024-09-12T18:09:04.851052+0000","last_undegraded":"2024-09-12T18:09:04.851052+0000","last_fullsized":"2024-09-12T18:09:04.851052+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:57:58.129729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"263'4","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:14.855171+0000","last_change":"2024-09-12T17:30:16.686091+0000","last_active":"2024-09-12T18:09:14.855171+0000","last_peered":"2024-09-12T18:09:14.855171+0000","last_clean":"2024-09-12T18:09:14.855171+0000","last_became_active":"2024-09-12T17:30:16.685755+0000","last_became_peered":"2024-09-12T17:30:16.685755+0000","last_unstale":"2024-09-12T18:09:14.855171+0000","last_undegraded":"2024-09-12T18:09:14.855171+0000","last_fullsized":"2024-09-12T18:09:14.855171+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:41:14.032884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":16,"num_write":9,"num_write_kb":5136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"0'0","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:54.841851+0000","last_change":"2024-09-12T17:30:12.641329+0000","last_active":"2024-09-12T18:08:54.841851+0000","last_peered":"2024-09-12T18:08:54.841851+0000","last_clean":"2024-09-12T18:08:54.841851+0000","last_became_active":"2024-09-12T17:30:12.640983+0000","last_became_peered":"2024-09-12T17:30:12.640983+0000","last_unstale":"2024-09-12T18:08:54.841851+0000","last_undegraded":"2024-09-12T18:08:54.841851+0000","last_fullsized":"2024-09-12T18:08:54.841851+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:49:02.041715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"263'13","reported_seq":92,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:04.851003+0000","last_change":"2024-09-12T17:26:35.664850+0000","last_active":"2024-09-12T18:09:04.851003+0000","last_peered":"2024-09-12T18:09:04.851003+0000","last_clean":"2024-09-12T18:09:04.851003+0000","last_became_active":"2024-09-12T17:26:35.664517+0000","last_became_peered":"2024-09-12T17:26:35.664517+0000","last_unstale":"2024-09-12T18:09:04.851003+0000","last_undegraded":"2024-09-12T18:09:04.851003+0000","last_fullsized":"2024-09-12T18:09:04.851003+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:47:34.050940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":54,"num_write":23,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:50.139169+0000","last_change":"2024-09-12T17:46:57.091721+0000","last_active":"2024-09-12T18:07:50.139169+0000","last_peered":"2024-09-12T18:07:50.139169+0000","last_clean":"2024-09-12T18:07:50.139169+0000","last_became_active":"2024-09-12T17:46:57.091147+0000","last_became_peered":"2024-09-12T17:46:57.091147+0000","last_unstale":"2024-09-12T18:07:50.139169+0000","last_undegraded":"2024-09-12T18:07:50.139169+0000","last_fullsized":"2024-09-12T18:07:50.139169+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:38:23.889670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"260'5","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:59.873661+0000","last_change":"2024-09-12T17:30:16.684444+0000","last_active":"2024-09-12T18:08:59.873661+0000","last_peered":"2024-09-12T18:08:59.873661+0000","last_clean":"2024-09-12T18:08:59.873661+0000","last_became_active":"2024-09-12T17:30:16.684200+0000","last_became_peered":"2024-09-12T17:30:16.684200+0000","last_unstale":"2024-09-12T18:08:59.873661+0000","last_undegraded":"2024-09-12T18:08:59.873661+0000","last_fullsized":"2024-09-12T18:08:59.873661+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:52:13.212280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"263'1","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:04.854441+0000","last_change":"2024-09-12T17:30:12.640225+0000","last_active":"2024-09-12T18:09:04.854441+0000","last_peered":"2024-09-12T18:09:04.854441+0000","last_clean":"2024-09-12T18:09:04.854441+0000","last_became_active":"2024-09-12T17:30:12.639953+0000","last_became_peered":"2024-09-12T17:30:12.639953+0000","last_unstale":"2024-09-12T18:09:04.854441+0000","last_undegraded":"2024-09-12T18:09:04.854441+0000","last_fullsized":"2024-09-12T18:09:04.854441+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:40:28.022453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":3072,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"263'28","reported_seq":125,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:04.874467+0000","last_change":"2024-09-12T17:26:35.663645+0000","last_active":"2024-09-12T18:09:04.874467+0000","last_peered":"2024-09-12T18:09:04.874467+0000","last_clean":"2024-09-12T18:09:04.874467+0000","last_became_active":"2024-09-12T17:26:35.663339+0000","last_became_peered":"2024-09-12T17:26:35.663339+0000","last_unstale":"2024-09-12T18:09:04.874467+0000","last_undegraded":"2024-09-12T18:09:04.874467+0000","last_fullsized":"2024-09-12T18:09:04.874467+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:33:26.767790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":134,"num_read_kb":91,"num_write":60,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"263'1","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:06:59.836170+0000","last_change":"2024-09-12T17:46:57.088362+0000","last_active":"2024-09-12T18:06:59.836170+0000","last_peered":"2024-09-12T18:06:59.836170+0000","last_clean":"2024-09-12T18:06:59.836170+0000","last_became_active":"2024-09-12T17:46:57.088039+0000","last_became_peered":"2024-09-12T17:46:57.088039+0000","last_unstale":"2024-09-12T18:06:59.836170+0000","last_undegraded":"2024-09-12T18:06:59.836170+0000","last_fullsized":"2024-09-12T18:06:59.836170+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:17:28.745812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"263'6","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:49.864141+0000","last_change":"2024-09-12T17:30:16.672459+0000","last_active":"2024-09-12T18:07:49.864141+0000","last_peered":"2024-09-12T18:07:49.864141+0000","last_clean":"2024-09-12T18:07:49.864141+0000","last_became_active":"2024-09-12T17:30:16.672167+0000","last_became_peered":"2024-09-12T17:30:16.672167+0000","last_unstale":"2024-09-12T18:07:49.864141+0000","last_undegraded":"2024-09-12T18:07:49.864141+0000","last_fullsized":"2024-09-12T18:07:49.864141+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:34:33.089166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11534336,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":8,"num_read_kb":17408,"num_write":16,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"260'5","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:44.843494+0000","last_change":"2024-09-12T17:30:12.644426+0000","last_active":"2024-09-12T18:07:44.843494+0000","last_peered":"2024-09-12T18:07:44.843494+0000","last_clean":"2024-09-12T18:07:44.843494+0000","last_became_active":"2024-09-12T17:30:12.644125+0000","last_became_peered":"2024-09-12T17:30:12.644125+0000","last_unstale":"2024-09-12T18:07:44.843494+0000","last_undegraded":"2024-09-12T18:07:44.843494+0000","last_fullsized":"2024-09-12T18:07:44.843494+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:29:53.974488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"263'38","reported_seq":158,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:44.833618+0000","last_change":"2024-09-12T17:26:35.659571+0000","last_active":"2024-09-12T18:07:44.833618+0000","last_peered":"2024-09-12T18:07:44.833618+0000","last_clean":"2024-09-12T18:07:44.833618+0000","last_became_active":"2024-09-12T17:26:35.659261+0000","last_became_peered":"2024-09-12T17:26:35.659261+0000","last_unstale":"2024-09-12T18:07:44.833618+0000","last_undegraded":"2024-09-12T18:07:44.833618+0000","last_fullsized":"2024-09-12T18:07:44.833618+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:13:24.323445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":196,"num_read_kb":138,"num_write":78,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":22,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:06:59.836253+0000","last_change":"2024-09-12T17:46:57.088279+0000","last_active":"2024-09-12T18:06:59.836253+0000","last_peered":"2024-09-12T18:06:59.836253+0000","last_clean":"2024-09-12T18:06:59.836253+0000","last_became_active":"2024-09-12T17:46:57.087965+0000","last_became_peered":"2024-09-12T17:46:57.087965+0000","last_unstale":"2024-09-12T18:06:59.836253+0000","last_undegraded":"2024-09-12T18:06:59.836253+0000","last_fullsized":"2024-09-12T18:06:59.836253+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:14:09.667084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"263'7","reported_seq":60,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:49.842504+0000","last_change":"2024-09-12T17:30:16.685365+0000","last_active":"2024-09-12T18:07:49.842504+0000","last_peered":"2024-09-12T18:07:49.842504+0000","last_clean":"2024-09-12T18:07:49.842504+0000","last_became_active":"2024-09-12T17:30:16.685054+0000","last_became_peered":"2024-09-12T17:30:16.685054+0000","last_unstale":"2024-09-12T18:07:49.842504+0000","last_undegraded":"2024-09-12T18:07:49.842504+0000","last_fullsized":"2024-09-12T18:07:49.842504+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:42:01.087864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":17,"num_read_kb":30722,"num_write":12,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"263'7","reported_seq":64,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:44.833659+0000","last_change":"2024-09-12T17:30:12.652060+0000","last_active":"2024-09-12T18:07:44.833659+0000","last_peered":"2024-09-12T18:07:44.833659+0000","last_clean":"2024-09-12T18:07:44.833659+0000","last_became_active":"2024-09-12T17:30:12.651780+0000","last_became_peered":"2024-09-12T17:30:12.651780+0000","last_unstale":"2024-09-12T18:07:44.833659+0000","last_undegraded":"2024-09-12T18:07:44.833659+0000","last_fullsized":"2024-09-12T18:07:44.833659+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:20:56.174919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":22530,"num_write":12,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"263'27","reported_seq":128,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:40.137913+0000","last_change":"2024-09-12T17:26:35.665383+0000","last_active":"2024-09-12T18:07:40.137913+0000","last_peered":"2024-09-12T18:07:40.137913+0000","last_clean":"2024-09-12T18:07:40.137913+0000","last_became_active":"2024-09-12T17:26:35.665076+0000","last_became_peered":"2024-09-12T17:26:35.665076+0000","last_unstale":"2024-09-12T18:07:40.137913+0000","last_undegraded":"2024-09-12T18:07:40.137913+0000","last_fullsized":"2024-09-12T18:07:40.137913+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:51:16.783076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":146,"num_read_kb":106,"num_write":38,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:00.140237+0000","last_change":"2024-09-12T17:46:57.077605+0000","last_active":"2024-09-12T18:08:00.140237+0000","last_peered":"2024-09-12T18:08:00.140237+0000","last_clean":"2024-09-12T18:08:00.140237+0000","last_became_active":"2024-09-12T17:46:57.077265+0000","last_became_peered":"2024-09-12T17:46:57.077265+0000","last_unstale":"2024-09-12T18:08:00.140237+0000","last_undegraded":"2024-09-12T18:08:00.140237+0000","last_fullsized":"2024-09-12T18:08:00.140237+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:54:27.754921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"0'0","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:59.850434+0000","last_change":"2024-09-12T17:30:16.684627+0000","last_active":"2024-09-12T18:08:59.850434+0000","last_peered":"2024-09-12T18:08:59.850434+0000","last_clean":"2024-09-12T18:08:59.850434+0000","last_became_active":"2024-09-12T17:30:16.683963+0000","last_became_peered":"2024-09-12T17:30:16.683963+0000","last_unstale":"2024-09-12T18:08:59.850434+0000","last_undegraded":"2024-09-12T18:08:59.850434+0000","last_fullsized":"2024-09-12T18:08:59.850434+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:56:37.344964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"263'7","reported_seq":65,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:49.843543+0000","last_change":"2024-09-12T17:30:12.643034+0000","last_active":"2024-09-12T18:07:49.843543+0000","last_peered":"2024-09-12T18:07:49.843543+0000","last_clean":"2024-09-12T18:07:49.843543+0000","last_became_active":"2024-09-12T17:30:12.642687+0000","last_became_peered":"2024-09-12T17:30:12.642687+0000","last_unstale":"2024-09-12T18:07:49.843543+0000","last_undegraded":"2024-09-12T18:07:49.843543+0000","last_fullsized":"2024-09-12T18:07:49.843543+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:06:07.203968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":26626,"num_write":12,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"263'39","reported_seq":160,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:39.833155+0000","last_change":"2024-09-12T17:26:35.668713+0000","last_active":"2024-09-12T18:07:39.833155+0000","last_peered":"2024-09-12T18:07:39.833155+0000","last_clean":"2024-09-12T18:07:39.833155+0000","last_became_active":"2024-09-12T17:26:35.668286+0000","last_became_peered":"2024-09-12T17:26:35.668286+0000","last_unstale":"2024-09-12T18:07:39.833155+0000","last_undegraded":"2024-09-12T18:07:39.833155+0000","last_fullsized":"2024-09-12T18:07:39.833155+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:20:43.354325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":202,"num_read_kb":143,"num_write":74,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"263'1","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:59.830606+0000","last_change":"2024-09-12T17:46:57.091097+0000","last_active":"2024-09-12T18:07:59.830606+0000","last_peered":"2024-09-12T18:07:59.830606+0000","last_clean":"2024-09-12T18:07:59.830606+0000","last_became_active":"2024-09-12T17:46:57.088919+0000","last_became_peered":"2024-09-12T17:46:57.088919+0000","last_unstale":"2024-09-12T18:07:59.830606+0000","last_undegraded":"2024-09-12T18:07:59.830606+0000","last_fullsized":"2024-09-12T18:07:59.830606+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:56:55.289350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"0'0","reported_seq":34,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:44.840586+0000","last_change":"2024-09-12T17:31:18.237102+0000","last_active":"2024-09-12T18:08:44.840586+0000","last_peered":"2024-09-12T18:08:44.840586+0000","last_clean":"2024-09-12T18:08:44.840586+0000","last_became_active":"2024-09-12T17:31:18.236640+0000","last_became_peered":"2024-09-12T17:31:18.236640+0000","last_unstale":"2024-09-12T18:08:44.840586+0000","last_undegraded":"2024-09-12T18:08:44.840586+0000","last_fullsized":"2024-09-12T18:08:44.840586+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:10:12.696558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.15","version":"0'0","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:54.853566+0000","last_change":"2024-09-12T17:30:12.649885+0000","last_active":"2024-09-12T18:08:54.853566+0000","last_peered":"2024-09-12T18:08:54.853566+0000","last_clean":"2024-09-12T18:08:54.853566+0000","last_became_active":"2024-09-12T17:30:12.649605+0000","last_became_peered":"2024-09-12T17:30:12.649605+0000","last_unstale":"2024-09-12T18:08:54.853566+0000","last_undegraded":"2024-09-12T18:08:54.853566+0000","last_fullsized":"2024-09-12T18:08:54.853566+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:09:52.512870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"263'53","reported_seq":191,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:39.841430+0000","last_change":"2024-09-12T17:26:35.661633+0000","last_active":"2024-09-12T18:07:39.841430+0000","last_peered":"2024-09-12T18:07:39.841430+0000","last_clean":"2024-09-12T18:07:39.841430+0000","last_became_active":"2024-09-12T17:26:35.658602+0000","last_became_peered":"2024-09-12T17:26:35.658602+0000","last_unstale":"2024-09-12T18:07:39.841430+0000","last_undegraded":"2024-09-12T18:07:39.841430+0000","last_fullsized":"2024-09-12T18:07:39.841430+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:40:06.406484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":262,"num_read_kb":183,"num_write":93,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:59.845745+0000","last_change":"2024-09-12T17:46:57.083830+0000","last_active":"2024-09-12T18:07:59.845745+0000","last_peered":"2024-09-12T18:07:59.845745+0000","last_clean":"2024-09-12T18:07:59.845745+0000","last_became_active":"2024-09-12T17:46:57.081080+0000","last_became_peered":"2024-09-12T17:46:57.081080+0000","last_unstale":"2024-09-12T18:07:59.845745+0000","last_undegraded":"2024-09-12T18:07:59.845745+0000","last_fullsized":"2024-09-12T18:07:59.845745+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:12:11.153281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"263'2","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:59.850467+0000","last_change":"2024-09-12T17:30:16.686003+0000","last_active":"2024-09-12T18:08:59.850467+0000","last_peered":"2024-09-12T18:08:59.850467+0000","last_clean":"2024-09-12T18:08:59.850467+0000","last_became_active":"2024-09-12T17:30:16.685688+0000","last_became_peered":"2024-09-12T17:30:16.685688+0000","last_unstale":"2024-09-12T18:08:59.850467+0000","last_undegraded":"2024-09-12T18:08:59.850467+0000","last_fullsized":"2024-09-12T18:08:59.850467+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:37:31.358403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":10240,"num_write":7,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"0'0","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:54.836524+0000","last_change":"2024-09-12T17:30:12.654638+0000","last_active":"2024-09-12T18:08:54.836524+0000","last_peered":"2024-09-12T18:08:54.836524+0000","last_clean":"2024-09-12T18:08:54.836524+0000","last_became_active":"2024-09-12T17:30:12.654327+0000","last_became_peered":"2024-09-12T17:30:12.654327+0000","last_unstale":"2024-09-12T18:08:54.836524+0000","last_undegraded":"2024-09-12T18:08:54.836524+0000","last_fullsized":"2024-09-12T18:08:54.836524+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:44:33.401300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"263'47","reported_seq":185,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:39.828526+0000","last_change":"2024-09-12T17:26:35.662563+0000","last_active":"2024-09-12T18:07:39.828526+0000","last_peered":"2024-09-12T18:07:39.828526+0000","last_clean":"2024-09-12T18:07:39.828526+0000","last_became_active":"2024-09-12T17:26:35.662284+0000","last_became_peered":"2024-09-12T17:26:35.662284+0000","last_unstale":"2024-09-12T18:07:39.828526+0000","last_undegraded":"2024-09-12T18:07:39.828526+0000","last_fullsized":"2024-09-12T18:07:39.828526+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:52:34.213360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":252,"num_read_kb":176,"num_write":91,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:59.844776+0000","last_change":"2024-09-12T17:46:57.082391+0000","last_active":"2024-09-12T18:07:59.844776+0000","last_peered":"2024-09-12T18:07:59.844776+0000","last_clean":"2024-09-12T18:07:59.844776+0000","last_became_active":"2024-09-12T17:46:57.082082+0000","last_became_peered":"2024-09-12T17:46:57.082082+0000","last_unstale":"2024-09-12T18:07:59.844776+0000","last_undegraded":"2024-09-12T18:07:59.844776+0000","last_fullsized":"2024-09-12T18:07:59.844776+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:16:53.154548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"260'3","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:59.853745+0000","last_change":"2024-09-12T17:30:16.675596+0000","last_active":"2024-09-12T18:08:59.853745+0000","last_peered":"2024-09-12T18:08:59.853745+0000","last_clean":"2024-09-12T18:08:59.853745+0000","last_became_active":"2024-09-12T17:30:16.675278+0000","last_became_peered":"2024-09-12T17:30:16.675278+0000","last_unstale":"2024-09-12T18:08:59.853745+0000","last_undegraded":"2024-09-12T18:08:59.853745+0000","last_fullsized":"2024-09-12T18:08:59.853745+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:04:44.516041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"260'2","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:54.841986+0000","last_change":"2024-09-12T17:30:12.643518+0000","last_active":"2024-09-12T18:08:54.841986+0000","last_peered":"2024-09-12T18:08:54.841986+0000","last_clean":"2024-09-12T18:08:54.841986+0000","last_became_active":"2024-09-12T17:30:12.643203+0000","last_became_peered":"2024-09-12T17:30:12.643203+0000","last_unstale":"2024-09-12T18:08:54.841986+0000","last_undegraded":"2024-09-12T18:08:54.841986+0000","last_fullsized":"2024-09-12T18:08:54.841986+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:42:13.911696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":23,"num_write":2,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"263'29","reported_seq":125,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:39.851532+0000","last_change":"2024-09-12T17:26:35.657351+0000","last_active":"2024-09-12T18:08:39.851532+0000","last_peered":"2024-09-12T18:08:39.851532+0000","last_clean":"2024-09-12T18:08:39.851532+0000","last_became_active":"2024-09-12T17:26:35.657035+0000","last_became_peered":"2024-09-12T17:26:35.657035+0000","last_unstale":"2024-09-12T18:08:39.851532+0000","last_undegraded":"2024-09-12T18:08:39.851532+0000","last_fullsized":"2024-09-12T18:08:39.851532+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:26:04.653231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":129,"num_read_kb":90,"num_write":56,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:44.848747+0000","last_change":"2024-09-12T17:46:57.094601+0000","last_active":"2024-09-12T18:08:44.848747+0000","last_peered":"2024-09-12T18:08:44.848747+0000","last_clean":"2024-09-12T18:08:44.848747+0000","last_became_active":"2024-09-12T17:46:57.094314+0000","last_became_peered":"2024-09-12T17:46:57.094314+0000","last_unstale":"2024-09-12T18:08:44.848747+0000","last_undegraded":"2024-09-12T18:08:44.848747+0000","last_fullsized":"2024-09-12T18:08:44.848747+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:55:53.289948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:40.137931+0000","last_change":"2024-09-12T17:30:16.679537+0000","last_active":"2024-09-12T18:07:40.137931+0000","last_peered":"2024-09-12T18:07:40.137931+0000","last_clean":"2024-09-12T18:07:40.137931+0000","last_became_active":"2024-09-12T17:30:16.679282+0000","last_became_peered":"2024-09-12T17:30:16.679282+0000","last_unstale":"2024-09-12T18:07:40.137931+0000","last_undegraded":"2024-09-12T18:07:40.137931+0000","last_fullsized":"2024-09-12T18:07:40.137931+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:52:39.870256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"260'6","reported_seq":58,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:34.842038+0000","last_change":"2024-09-12T17:30:12.652775+0000","last_active":"2024-09-12T18:07:34.842038+0000","last_peered":"2024-09-12T18:07:34.842038+0000","last_clean":"2024-09-12T18:07:34.842038+0000","last_became_active":"2024-09-12T17:30:12.652426+0000","last_became_peered":"2024-09-12T17:30:12.652426+0000","last_unstale":"2024-09-12T18:07:34.842038+0000","last_undegraded":"2024-09-12T18:07:34.842038+0000","last_fullsized":"2024-09-12T18:07:34.842038+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:55:40.416016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":10240,"num_write":16,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"263'34","reported_seq":148,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:34.850782+0000","last_change":"2024-09-12T17:26:35.664129+0000","last_active":"2024-09-12T18:08:34.850782+0000","last_peered":"2024-09-12T18:08:34.850782+0000","last_clean":"2024-09-12T18:08:34.850782+0000","last_became_active":"2024-09-12T17:26:35.663337+0000","last_became_peered":"2024-09-12T17:26:35.663337+0000","last_unstale":"2024-09-12T18:08:34.850782+0000","last_undegraded":"2024-09-12T18:08:34.850782+0000","last_fullsized":"2024-09-12T18:08:34.850782+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:23:54.136870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":179,"num_read_kb":128,"num_write":55,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:44.840640+0000","last_change":"2024-09-12T17:46:57.093698+0000","last_active":"2024-09-12T18:08:44.840640+0000","last_peered":"2024-09-12T18:08:44.840640+0000","last_clean":"2024-09-12T18:08:44.840640+0000","last_became_active":"2024-09-12T17:46:57.093157+0000","last_became_peered":"2024-09-12T17:46:57.093157+0000","last_unstale":"2024-09-12T18:08:44.840640+0000","last_undegraded":"2024-09-12T18:08:44.840640+0000","last_fullsized":"2024-09-12T18:08:44.840640+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:44:51.633185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"263'1","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:40.137893+0000","last_change":"2024-09-12T17:30:16.679016+0000","last_active":"2024-09-12T18:07:40.137893+0000","last_peered":"2024-09-12T18:07:40.137893+0000","last_clean":"2024-09-12T18:07:40.137893+0000","last_became_active":"2024-09-12T17:30:16.678682+0000","last_became_peered":"2024-09-12T17:30:16.678682+0000","last_unstale":"2024-09-12T18:07:40.137893+0000","last_undegraded":"2024-09-12T18:07:40.137893+0000","last_fullsized":"2024-09-12T18:07:40.137893+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:44:09.408299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3210,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"263'4","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:34.840737+0000","last_change":"2024-09-12T17:30:12.653263+0000","last_active":"2024-09-12T18:07:34.840737+0000","last_peered":"2024-09-12T18:07:34.840737+0000","last_clean":"2024-09-12T18:07:34.840737+0000","last_became_active":"2024-09-12T17:30:12.652916+0000","last_became_peered":"2024-09-12T17:30:12.652916+0000","last_unstale":"2024-09-12T18:07:34.840737+0000","last_undegraded":"2024-09-12T18:07:34.840737+0000","last_fullsized":"2024-09-12T18:07:34.840737+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:25:32.409182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485760,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"263'35","reported_seq":148,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:34.839418+0000","last_change":"2024-09-12T17:26:35.669546+0000","last_active":"2024-09-12T18:08:34.839418+0000","last_peered":"2024-09-12T18:08:34.839418+0000","last_clean":"2024-09-12T18:08:34.839418+0000","last_became_active":"2024-09-12T17:26:35.669256+0000","last_became_peered":"2024-09-12T17:26:35.669256+0000","last_unstale":"2024-09-12T18:08:34.839418+0000","last_undegraded":"2024-09-12T18:08:34.839418+0000","last_fullsized":"2024-09-12T18:08:34.839418+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:05:49.889059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":173,"num_read_kb":119,"num_write":68,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"262'1","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:04.835994+0000","last_change":"2024-09-12T17:46:57.090884+0000","last_active":"2024-09-12T18:08:04.835994+0000","last_peered":"2024-09-12T18:08:04.835994+0000","last_clean":"2024-09-12T18:08:04.835994+0000","last_became_active":"2024-09-12T17:46:57.090587+0000","last_became_peered":"2024-09-12T17:46:57.090587+0000","last_unstale":"2024-09-12T18:08:04.835994+0000","last_undegraded":"2024-09-12T18:08:04.835994+0000","last_fullsized":"2024-09-12T18:08:04.835994+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:06:27.485219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"260'3","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:39.841383+0000","last_change":"2024-09-12T17:30:16.686552+0000","last_active":"2024-09-12T18:07:39.841383+0000","last_peered":"2024-09-12T18:07:39.841383+0000","last_clean":"2024-09-12T18:07:39.841383+0000","last_became_active":"2024-09-12T17:30:16.685830+0000","last_became_peered":"2024-09-12T17:30:16.685830+0000","last_unstale":"2024-09-12T18:07:39.841383+0000","last_undegraded":"2024-09-12T18:07:39.841383+0000","last_fullsized":"2024-09-12T18:07:39.841383+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:26:14.033263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"0'0","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:34.861787+0000","last_change":"2024-09-12T17:30:12.640428+0000","last_active":"2024-09-12T18:07:34.861787+0000","last_peered":"2024-09-12T18:07:34.861787+0000","last_clean":"2024-09-12T18:07:34.861787+0000","last_became_active":"2024-09-12T17:30:12.640139+0000","last_became_peered":"2024-09-12T17:30:12.640139+0000","last_unstale":"2024-09-12T18:07:34.861787+0000","last_undegraded":"2024-09-12T18:07:34.861787+0000","last_fullsized":"2024-09-12T18:07:34.861787+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:09:04.186884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"263'49","reported_seq":189,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:34.850284+0000","last_change":"2024-09-12T17:26:35.659117+0000","last_active":"2024-09-12T18:08:34.850284+0000","last_peered":"2024-09-12T18:08:34.850284+0000","last_clean":"2024-09-12T18:08:34.850284+0000","last_became_active":"2024-09-12T17:26:35.658785+0000","last_became_peered":"2024-09-12T17:26:35.658785+0000","last_unstale":"2024-09-12T18:08:34.850284+0000","last_undegraded":"2024-09-12T18:08:34.850284+0000","last_fullsized":"2024-09-12T18:08:34.850284+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:02.864803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":254,"num_read_kb":176,"num_write":93,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"263'1","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:44.848723+0000","last_change":"2024-09-12T17:46:57.093615+0000","last_active":"2024-09-12T18:08:44.848723+0000","last_peered":"2024-09-12T18:08:44.848723+0000","last_clean":"2024-09-12T18:08:44.848723+0000","last_became_active":"2024-09-12T17:46:57.093267+0000","last_became_peered":"2024-09-12T17:46:57.093267+0000","last_unstale":"2024-09-12T18:08:44.848723+0000","last_undegraded":"2024-09-12T18:08:44.848723+0000","last_fullsized":"2024-09-12T18:08:44.848723+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:52:12.345961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:39.862456+0000","last_change":"2024-09-12T17:30:16.681768+0000","last_active":"2024-09-12T18:07:39.862456+0000","last_peered":"2024-09-12T18:07:39.862456+0000","last_clean":"2024-09-12T18:07:39.862456+0000","last_became_active":"2024-09-12T17:30:16.681418+0000","last_became_peered":"2024-09-12T17:30:16.681418+0000","last_unstale":"2024-09-12T18:07:39.862456+0000","last_undegraded":"2024-09-12T18:07:39.862456+0000","last_fullsized":"2024-09-12T18:07:39.862456+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:08:51.341343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"260'3","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:34.841576+0000","last_change":"2024-09-12T17:30:12.643785+0000","last_active":"2024-09-12T18:07:34.841576+0000","last_peered":"2024-09-12T18:07:34.841576+0000","last_clean":"2024-09-12T18:07:34.841576+0000","last_became_active":"2024-09-12T17:30:12.643484+0000","last_became_peered":"2024-09-12T17:30:12.643484+0000","last_unstale":"2024-09-12T18:07:34.841576+0000","last_undegraded":"2024-09-12T18:07:34.841576+0000","last_fullsized":"2024-09-12T18:07:34.841576+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:51:35.165703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"260'23","reported_seq":119,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:34.847525+0000","last_change":"2024-09-12T17:26:35.666220+0000","last_active":"2024-09-12T18:08:34.847525+0000","last_peered":"2024-09-12T18:08:34.847525+0000","last_clean":"2024-09-12T18:08:34.847525+0000","last_became_active":"2024-09-12T17:26:35.665908+0000","last_became_peered":"2024-09-12T17:26:35.665908+0000","last_unstale":"2024-09-12T18:08:34.847525+0000","last_undegraded":"2024-09-12T18:08:34.847525+0000","last_fullsized":"2024-09-12T18:08:34.847525+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:22:29.733636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":120,"num_read_kb":87,"num_write":41,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:44.835349+0000","last_change":"2024-09-12T17:46:57.083432+0000","last_active":"2024-09-12T18:08:44.835349+0000","last_peered":"2024-09-12T18:08:44.835349+0000","last_clean":"2024-09-12T18:08:44.835349+0000","last_became_active":"2024-09-12T17:46:57.083098+0000","last_became_peered":"2024-09-12T17:46:57.083098+0000","last_unstale":"2024-09-12T18:08:44.835349+0000","last_undegraded":"2024-09-12T18:08:44.835349+0000","last_fullsized":"2024-09-12T18:08:44.835349+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:31:23.853524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:34.847617+0000","last_change":"2024-09-12T17:30:16.684194+0000","last_active":"2024-09-12T18:08:34.847617+0000","last_peered":"2024-09-12T18:08:34.847617+0000","last_clean":"2024-09-12T18:08:34.847617+0000","last_became_active":"2024-09-12T17:30:16.683887+0000","last_became_peered":"2024-09-12T17:30:16.683887+0000","last_unstale":"2024-09-12T18:08:34.847617+0000","last_undegraded":"2024-09-12T18:08:34.847617+0000","last_fullsized":"2024-09-12T18:08:34.847617+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:53:34.319282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"263'2","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:29.850086+0000","last_change":"2024-09-12T17:30:12.653459+0000","last_active":"2024-09-12T18:08:29.850086+0000","last_peered":"2024-09-12T18:08:29.850086+0000","last_clean":"2024-09-12T18:08:29.850086+0000","last_became_active":"2024-09-12T17:30:12.653137+0000","last_became_peered":"2024-09-12T17:30:12.653137+0000","last_unstale":"2024-09-12T18:08:29.850086+0000","last_undegraded":"2024-09-12T18:08:29.850086+0000","last_fullsized":"2024-09-12T18:08:29.850086+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:08:52.465178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3148935,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":6148,"num_write":2,"num_write_kb":3076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"263'50","reported_seq":186,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:14.838552+0000","last_change":"2024-09-12T17:26:35.669293+0000","last_active":"2024-09-12T18:07:14.838552+0000","last_peered":"2024-09-12T18:07:14.838552+0000","last_clean":"2024-09-12T18:07:14.838552+0000","last_became_active":"2024-09-12T17:26:35.668989+0000","last_became_peered":"2024-09-12T17:26:35.668989+0000","last_unstale":"2024-09-12T18:07:14.838552+0000","last_undegraded":"2024-09-12T18:07:14.838552+0000","last_fullsized":"2024-09-12T18:07:14.838552+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:43:19.820670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":250,"num_read_kb":175,"num_write":93,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:14.839032+0000","last_change":"2024-09-12T17:46:57.088291+0000","last_active":"2024-09-12T18:07:14.839032+0000","last_peered":"2024-09-12T18:07:14.839032+0000","last_clean":"2024-09-12T18:07:14.839032+0000","last_became_active":"2024-09-12T17:46:57.087982+0000","last_became_peered":"2024-09-12T17:46:57.087982+0000","last_unstale":"2024-09-12T18:07:14.839032+0000","last_undegraded":"2024-09-12T18:07:14.839032+0000","last_fullsized":"2024-09-12T18:07:14.839032+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:05:50.630405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"263'3","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:34.847595+0000","last_change":"2024-09-12T17:30:16.679996+0000","last_active":"2024-09-12T18:08:34.847595+0000","last_peered":"2024-09-12T18:08:34.847595+0000","last_clean":"2024-09-12T18:08:34.847595+0000","last_became_active":"2024-09-12T17:30:16.679621+0000","last_became_peered":"2024-09-12T17:30:16.679621+0000","last_unstale":"2024-09-12T18:08:34.847595+0000","last_undegraded":"2024-09-12T18:08:34.847595+0000","last_fullsized":"2024-09-12T18:08:34.847595+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:23:53.964330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9437184,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":9216,"num_write":3,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"0'0","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:29.833725+0000","last_change":"2024-09-12T17:30:12.649664+0000","last_active":"2024-09-12T18:08:29.833725+0000","last_peered":"2024-09-12T18:08:29.833725+0000","last_clean":"2024-09-12T18:08:29.833725+0000","last_became_active":"2024-09-12T17:30:12.649010+0000","last_became_peered":"2024-09-12T17:30:12.649010+0000","last_unstale":"2024-09-12T18:08:29.833725+0000","last_undegraded":"2024-09-12T18:08:29.833725+0000","last_fullsized":"2024-09-12T18:08:29.833725+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:23:47.681997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"260'8","reported_seq":76,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:19.855981+0000","last_change":"2024-09-12T17:26:35.663336+0000","last_active":"2024-09-12T18:09:19.855981+0000","last_peered":"2024-09-12T18:09:19.855981+0000","last_clean":"2024-09-12T18:09:19.855981+0000","last_became_active":"2024-09-12T17:26:35.663041+0000","last_became_peered":"2024-09-12T17:26:35.663041+0000","last_unstale":"2024-09-12T18:09:19.855981+0000","last_undegraded":"2024-09-12T18:09:19.855981+0000","last_fullsized":"2024-09-12T18:09:19.855981+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:02:26.294386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":28,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:39.870871+0000","last_change":"2024-09-12T17:46:57.086356+0000","last_active":"2024-09-12T18:08:39.870871+0000","last_peered":"2024-09-12T18:08:39.870871+0000","last_clean":"2024-09-12T18:08:39.870871+0000","last_became_active":"2024-09-12T17:46:57.085908+0000","last_became_peered":"2024-09-12T17:46:57.085908+0000","last_unstale":"2024-09-12T18:08:39.870871+0000","last_undegraded":"2024-09-12T18:08:39.870871+0000","last_fullsized":"2024-09-12T18:08:39.870871+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:01:54.509459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"0'0","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:40.144742+0000","last_change":"2024-09-12T17:30:16.679533+0000","last_active":"2024-09-12T18:08:40.144742+0000","last_peered":"2024-09-12T18:08:40.144742+0000","last_clean":"2024-09-12T18:08:40.144742+0000","last_became_active":"2024-09-12T17:30:16.679193+0000","last_became_peered":"2024-09-12T17:30:16.679193+0000","last_unstale":"2024-09-12T18:08:40.144742+0000","last_undegraded":"2024-09-12T18:08:40.144742+0000","last_fullsized":"2024-09-12T18:08:40.144742+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:21:35.478757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"0'0","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:29.838852+0000","last_change":"2024-09-12T17:30:12.647471+0000","last_active":"2024-09-12T18:08:29.838852+0000","last_peered":"2024-09-12T18:08:29.838852+0000","last_clean":"2024-09-12T18:08:29.838852+0000","last_became_active":"2024-09-12T17:30:12.646945+0000","last_became_peered":"2024-09-12T17:30:12.646945+0000","last_unstale":"2024-09-12T18:08:29.838852+0000","last_undegraded":"2024-09-12T18:08:29.838852+0000","last_fullsized":"2024-09-12T18:08:29.838852+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:42:36.686975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"263'33","reported_seq":143,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:19.876853+0000","last_change":"2024-09-12T17:26:35.665050+0000","last_active":"2024-09-12T18:09:19.876853+0000","last_peered":"2024-09-12T18:09:19.876853+0000","last_clean":"2024-09-12T18:09:19.876853+0000","last_became_active":"2024-09-12T17:26:35.664749+0000","last_became_peered":"2024-09-12T17:26:35.664749+0000","last_unstale":"2024-09-12T18:09:19.876853+0000","last_undegraded":"2024-09-12T18:09:19.876853+0000","last_fullsized":"2024-09-12T18:09:19.876853+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:25:00.758310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":166,"num_read_kb":124,"num_write":50,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:39.851484+0000","last_change":"2024-09-12T17:46:57.084760+0000","last_active":"2024-09-12T18:08:39.851484+0000","last_peered":"2024-09-12T18:08:39.851484+0000","last_clean":"2024-09-12T18:08:39.851484+0000","last_became_active":"2024-09-12T17:46:57.084421+0000","last_became_peered":"2024-09-12T17:46:57.084421+0000","last_unstale":"2024-09-12T18:08:39.851484+0000","last_undegraded":"2024-09-12T18:08:39.851484+0000","last_fullsized":"2024-09-12T18:08:39.851484+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:35:17.085619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"0'0","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:34.847633+0000","last_change":"2024-09-12T17:30:16.682114+0000","last_active":"2024-09-12T18:08:34.847633+0000","last_peered":"2024-09-12T18:08:34.847633+0000","last_clean":"2024-09-12T18:08:34.847633+0000","last_became_active":"2024-09-12T17:30:16.681171+0000","last_became_peered":"2024-09-12T17:30:16.681171+0000","last_unstale":"2024-09-12T18:08:34.847633+0000","last_undegraded":"2024-09-12T18:08:34.847633+0000","last_fullsized":"2024-09-12T18:08:34.847633+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:35:19.241688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"263'4","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:35.144221+0000","last_change":"2024-09-12T17:30:12.641879+0000","last_active":"2024-09-12T18:08:35.144221+0000","last_peered":"2024-09-12T18:08:35.144221+0000","last_clean":"2024-09-12T18:08:35.144221+0000","last_became_active":"2024-09-12T17:30:12.641592+0000","last_became_peered":"2024-09-12T17:30:12.641592+0000","last_unstale":"2024-09-12T18:08:35.144221+0000","last_undegraded":"2024-09-12T18:08:35.144221+0000","last_fullsized":"2024-09-12T18:08:35.144221+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:29:07.666017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11534336,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":11264,"num_write":4,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"263'52","reported_seq":196,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:19.838941+0000","last_change":"2024-09-12T17:26:35.663784+0000","last_active":"2024-09-12T18:09:19.838941+0000","last_peered":"2024-09-12T18:09:19.838941+0000","last_clean":"2024-09-12T18:09:19.838941+0000","last_became_active":"2024-09-12T17:26:35.663472+0000","last_became_peered":"2024-09-12T17:26:35.663472+0000","last_unstale":"2024-09-12T18:09:19.838941+0000","last_undegraded":"2024-09-12T18:09:19.838941+0000","last_fullsized":"2024-09-12T18:09:19.838941+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:48:26.678396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":261,"num_read_kb":192,"num_write":92,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:14.838540+0000","last_change":"2024-09-12T17:46:57.090539+0000","last_active":"2024-09-12T18:07:14.838540+0000","last_peered":"2024-09-12T18:07:14.838540+0000","last_clean":"2024-09-12T18:07:14.838540+0000","last_became_active":"2024-09-12T17:46:57.089601+0000","last_became_peered":"2024-09-12T17:46:57.089601+0000","last_unstale":"2024-09-12T18:07:14.838540+0000","last_undegraded":"2024-09-12T18:07:14.838540+0000","last_fullsized":"2024-09-12T18:07:14.838540+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:13:07.708030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"0'0","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:19.856690+0000","last_change":"2024-09-12T17:30:16.679697+0000","last_active":"2024-09-12T18:09:19.856690+0000","last_peered":"2024-09-12T18:09:19.856690+0000","last_clean":"2024-09-12T18:09:19.856690+0000","last_became_active":"2024-09-12T17:30:16.679308+0000","last_became_peered":"2024-09-12T17:30:16.679308+0000","last_unstale":"2024-09-12T18:09:19.856690+0000","last_undegraded":"2024-09-12T18:09:19.856690+0000","last_fullsized":"2024-09-12T18:09:19.856690+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:06:24.083988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"263'3","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:14.844358+0000","last_change":"2024-09-12T17:30:12.645085+0000","last_active":"2024-09-12T18:09:14.844358+0000","last_peered":"2024-09-12T18:09:14.844358+0000","last_clean":"2024-09-12T18:09:14.844358+0000","last_became_active":"2024-09-12T17:30:12.644792+0000","last_became_peered":"2024-09-12T17:30:12.644792+0000","last_unstale":"2024-09-12T18:09:14.844358+0000","last_undegraded":"2024-09-12T18:09:14.844358+0000","last_fullsized":"2024-09-12T18:09:14.844358+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:25:31.260415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6339869,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":6192,"num_write":3,"num_write_kb":6192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"263'30","reported_seq":142,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:19.845281+0000","last_change":"2024-09-12T17:26:35.667932+0000","last_active":"2024-09-12T18:09:19.845281+0000","last_peered":"2024-09-12T18:09:19.845281+0000","last_clean":"2024-09-12T18:09:19.845281+0000","last_became_active":"2024-09-12T17:26:35.667655+0000","last_became_peered":"2024-09-12T17:26:35.667655+0000","last_unstale":"2024-09-12T18:09:19.845281+0000","last_undegraded":"2024-09-12T18:09:19.845281+0000","last_fullsized":"2024-09-12T18:09:19.845281+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:21:57.489397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":166,"num_read_kb":116,"num_write":53,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:19.839947+0000","last_change":"2024-09-12T17:46:57.090843+0000","last_active":"2024-09-12T18:07:19.839947+0000","last_peered":"2024-09-12T18:07:19.839947+0000","last_clean":"2024-09-12T18:07:19.839947+0000","last_became_active":"2024-09-12T17:46:57.090477+0000","last_became_peered":"2024-09-12T17:46:57.090477+0000","last_unstale":"2024-09-12T18:07:19.839947+0000","last_undegraded":"2024-09-12T18:07:19.839947+0000","last_fullsized":"2024-09-12T18:07:19.839947+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:01:13.812814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"260'8","reported_seq":57,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:19.857045+0000","last_change":"2024-09-12T17:30:16.673290+0000","last_active":"2024-09-12T18:09:19.857045+0000","last_peered":"2024-09-12T18:09:19.857045+0000","last_clean":"2024-09-12T18:09:19.857045+0000","last_became_active":"2024-09-12T17:30:16.672989+0000","last_became_peered":"2024-09-12T17:30:16.672989+0000","last_unstale":"2024-09-12T18:09:19.857045+0000","last_undegraded":"2024-09-12T18:09:19.857045+0000","last_fullsized":"2024-09-12T18:09:19.857045+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:58:17.894413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":6167,"num_write":13,"num_write_kb":6167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"263'2","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:15.148384+0000","last_change":"2024-09-12T17:30:12.642188+0000","last_active":"2024-09-12T18:09:15.148384+0000","last_peered":"2024-09-12T18:09:15.148384+0000","last_clean":"2024-09-12T18:09:15.148384+0000","last_became_active":"2024-09-12T17:30:12.641901+0000","last_became_peered":"2024-09-12T17:30:12.641901+0000","last_unstale":"2024-09-12T18:09:15.148384+0000","last_undegraded":"2024-09-12T18:09:15.148384+0000","last_fullsized":"2024-09-12T18:09:15.148384+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:30:51.212272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":12288,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"263'9","reported_seq":78,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:49.844267+0000","last_change":"2024-09-12T17:26:35.655618+0000","last_active":"2024-09-12T18:07:49.844267+0000","last_peered":"2024-09-12T18:07:49.844267+0000","last_clean":"2024-09-12T18:07:49.844267+0000","last_became_active":"2024-09-12T17:26:35.655307+0000","last_became_peered":"2024-09-12T17:26:35.655307+0000","last_unstale":"2024-09-12T18:07:49.844267+0000","last_undegraded":"2024-09-12T18:07:49.844267+0000","last_fullsized":"2024-09-12T18:07:49.844267+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:34:53.632505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":30,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"263'1","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:14.839069+0000","last_change":"2024-09-12T17:46:57.086405+0000","last_active":"2024-09-12T18:07:14.839069+0000","last_peered":"2024-09-12T18:07:14.839069+0000","last_clean":"2024-09-12T18:07:14.839069+0000","last_became_active":"2024-09-12T17:46:57.086116+0000","last_became_peered":"2024-09-12T17:46:57.086116+0000","last_unstale":"2024-09-12T18:07:14.839069+0000","last_undegraded":"2024-09-12T18:07:14.839069+0000","last_fullsized":"2024-09-12T18:07:14.839069+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:36:48.862604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:35.144176+0000","last_change":"2024-09-12T17:30:16.676645+0000","last_active":"2024-09-12T18:08:35.144176+0000","last_peered":"2024-09-12T18:08:35.144176+0000","last_clean":"2024-09-12T18:08:35.144176+0000","last_became_active":"2024-09-12T17:30:16.675243+0000","last_became_peered":"2024-09-12T17:30:16.675243+0000","last_unstale":"2024-09-12T18:08:35.144176+0000","last_undegraded":"2024-09-12T18:08:35.144176+0000","last_fullsized":"2024-09-12T18:08:35.144176+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:41:53.506076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"263'1","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:19.845247+0000","last_change":"2024-09-12T17:30:12.641067+0000","last_active":"2024-09-12T18:09:19.845247+0000","last_peered":"2024-09-12T18:09:19.845247+0000","last_clean":"2024-09-12T18:09:19.845247+0000","last_became_active":"2024-09-12T17:30:12.640736+0000","last_became_peered":"2024-09-12T17:30:12.640736+0000","last_unstale":"2024-09-12T18:09:19.845247+0000","last_undegraded":"2024-09-12T18:09:19.845247+0000","last_fullsized":"2024-09-12T18:09:19.845247+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:58:18.939586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3210,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"0'0","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:44.841920+0000","last_change":"2024-09-12T17:26:35.656429+0000","last_active":"2024-09-12T18:07:44.841920+0000","last_peered":"2024-09-12T18:07:44.841920+0000","last_clean":"2024-09-12T18:07:44.841920+0000","last_became_active":"2024-09-12T17:26:35.656149+0000","last_became_peered":"2024-09-12T17:26:35.656149+0000","last_unstale":"2024-09-12T18:07:44.841920+0000","last_undegraded":"2024-09-12T18:07:44.841920+0000","last_fullsized":"2024-09-12T18:07:44.841920+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:53:34.940903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:14.830083+0000","last_change":"2024-09-12T17:46:57.096748+0000","last_active":"2024-09-12T18:07:14.830083+0000","last_peered":"2024-09-12T18:07:14.830083+0000","last_clean":"2024-09-12T18:07:14.830083+0000","last_became_active":"2024-09-12T17:46:57.096375+0000","last_became_peered":"2024-09-12T17:46:57.096375+0000","last_unstale":"2024-09-12T18:07:14.830083+0000","last_undegraded":"2024-09-12T18:07:14.830083+0000","last_fullsized":"2024-09-12T18:07:14.830083+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:03:26.698689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"263'1","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:24.857996+0000","last_change":"2024-09-12T17:30:16.686958+0000","last_active":"2024-09-12T18:09:24.857996+0000","last_peered":"2024-09-12T18:09:24.857996+0000","last_clean":"2024-09-12T18:09:24.857996+0000","last_became_active":"2024-09-12T17:30:16.686562+0000","last_became_peered":"2024-09-12T17:30:16.686562+0000","last_unstale":"2024-09-12T18:09:24.857996+0000","last_undegraded":"2024-09-12T18:09:24.857996+0000","last_fullsized":"2024-09-12T18:09:24.857996+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:17:00.235108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3207,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"263'3","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:29.849631+0000","last_change":"2024-09-12T17:30:12.644840+0000","last_active":"2024-09-12T18:08:29.849631+0000","last_peered":"2024-09-12T18:08:29.849631+0000","last_clean":"2024-09-12T18:08:29.849631+0000","last_became_active":"2024-09-12T17:30:12.644490+0000","last_became_peered":"2024-09-12T17:30:12.644490+0000","last_unstale":"2024-09-12T18:08:29.849631+0000","last_undegraded":"2024-09-12T18:08:29.849631+0000","last_fullsized":"2024-09-12T18:08:29.849631+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:52:02.191118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9437184,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":9216,"num_write":3,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"263'23","reported_seq":115,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:44.863265+0000","last_change":"2024-09-12T17:26:35.665188+0000","last_active":"2024-09-12T18:07:44.863265+0000","last_peered":"2024-09-12T18:07:44.863265+0000","last_clean":"2024-09-12T18:07:44.863265+0000","last_became_active":"2024-09-12T17:26:35.664849+0000","last_became_peered":"2024-09-12T17:26:35.664849+0000","last_unstale":"2024-09-12T18:07:44.863265+0000","last_undegraded":"2024-09-12T18:07:44.863265+0000","last_fullsized":"2024-09-12T18:07:44.863265+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:29:49.144321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":79,"num_write":44,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:49.844298+0000","last_change":"2024-09-12T17:46:57.089388+0000","last_active":"2024-09-12T18:07:49.844298+0000","last_peered":"2024-09-12T18:07:49.844298+0000","last_clean":"2024-09-12T18:07:49.844298+0000","last_became_active":"2024-09-12T17:46:57.089081+0000","last_became_peered":"2024-09-12T17:46:57.089081+0000","last_unstale":"2024-09-12T18:07:49.844298+0000","last_undegraded":"2024-09-12T18:07:49.844298+0000","last_fullsized":"2024-09-12T18:07:49.844298+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:14:44.213114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"0'0","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:54.834972+0000","last_change":"2024-09-12T17:30:16.681225+0000","last_active":"2024-09-12T18:07:54.834972+0000","last_peered":"2024-09-12T18:07:54.834972+0000","last_clean":"2024-09-12T18:07:54.834972+0000","last_became_active":"2024-09-12T17:30:16.680901+0000","last_became_peered":"2024-09-12T17:30:16.680901+0000","last_unstale":"2024-09-12T18:07:54.834972+0000","last_undegraded":"2024-09-12T18:07:54.834972+0000","last_fullsized":"2024-09-12T18:07:54.834972+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:32:33.218603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"0'0","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:44.843546+0000","last_change":"2024-09-12T17:30:12.649239+0000","last_active":"2024-09-12T18:07:44.843546+0000","last_peered":"2024-09-12T18:07:44.843546+0000","last_clean":"2024-09-12T18:07:44.843546+0000","last_became_active":"2024-09-12T17:30:12.648875+0000","last_became_peered":"2024-09-12T17:30:12.648875+0000","last_unstale":"2024-09-12T18:07:44.843546+0000","last_undegraded":"2024-09-12T18:07:44.843546+0000","last_fullsized":"2024-09-12T18:07:44.843546+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:46:54.532755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"263'15","reported_seq":92,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:44.833731+0000","last_change":"2024-09-12T17:26:35.668474+0000","last_active":"2024-09-12T18:07:44.833731+0000","last_peered":"2024-09-12T18:07:44.833731+0000","last_clean":"2024-09-12T18:07:44.833731+0000","last_became_active":"2024-09-12T17:26:35.668118+0000","last_became_peered":"2024-09-12T17:26:35.668118+0000","last_unstale":"2024-09-12T18:07:44.833731+0000","last_undegraded":"2024-09-12T18:07:44.833731+0000","last_fullsized":"2024-09-12T18:07:44.833731+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:54:30.960531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":44,"num_write":31,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:49.843508+0000","last_change":"2024-09-12T17:46:57.086214+0000","last_active":"2024-09-12T18:07:49.843508+0000","last_peered":"2024-09-12T18:07:49.843508+0000","last_clean":"2024-09-12T18:07:49.843508+0000","last_became_active":"2024-09-12T17:46:57.085922+0000","last_became_peered":"2024-09-12T17:46:57.085922+0000","last_unstale":"2024-09-12T18:07:49.843508+0000","last_undegraded":"2024-09-12T18:07:49.843508+0000","last_fullsized":"2024-09-12T18:07:49.843508+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:03:09.811603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"263'4","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:49.834326+0000","last_change":"2024-09-12T17:30:16.669329+0000","last_active":"2024-09-12T18:07:49.834326+0000","last_peered":"2024-09-12T18:07:49.834326+0000","last_clean":"2024-09-12T18:07:49.834326+0000","last_became_active":"2024-09-12T17:30:16.668999+0000","last_became_peered":"2024-09-12T17:30:16.668999+0000","last_unstale":"2024-09-12T18:07:49.834326+0000","last_undegraded":"2024-09-12T18:07:49.834326+0000","last_fullsized":"2024-09-12T18:07:49.834326+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:39:23.168458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7340032,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":12288,"num_write":9,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"0'0","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:54.830107+0000","last_change":"2024-09-12T17:30:12.650378+0000","last_active":"2024-09-12T18:07:54.830107+0000","last_peered":"2024-09-12T18:07:54.830107+0000","last_clean":"2024-09-12T18:07:54.830107+0000","last_became_active":"2024-09-12T17:30:12.649350+0000","last_became_peered":"2024-09-12T17:30:12.649350+0000","last_unstale":"2024-09-12T18:07:54.830107+0000","last_undegraded":"2024-09-12T18:07:54.830107+0000","last_fullsized":"2024-09-12T18:07:54.830107+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:58:25.779058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"263'20","reported_seq":115,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:44.863349+0000","last_change":"2024-09-12T17:26:35.667425+0000","last_active":"2024-09-12T18:07:44.863349+0000","last_peered":"2024-09-12T18:07:44.863349+0000","last_clean":"2024-09-12T18:07:44.863349+0000","last_became_active":"2024-09-12T17:26:35.667060+0000","last_became_peered":"2024-09-12T17:26:35.667060+0000","last_unstale":"2024-09-12T18:07:44.863349+0000","last_undegraded":"2024-09-12T18:07:44.863349+0000","last_fullsized":"2024-09-12T18:07:44.863349+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:13:33.511985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":80,"num_write":36,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:00.146690+0000","last_change":"2024-09-12T17:46:57.078643+0000","last_active":"2024-09-12T18:09:00.146690+0000","last_peered":"2024-09-12T18:09:00.146690+0000","last_clean":"2024-09-12T18:09:00.146690+0000","last_became_active":"2024-09-12T17:46:57.076358+0000","last_became_peered":"2024-09-12T17:46:57.076358+0000","last_unstale":"2024-09-12T18:09:00.146690+0000","last_undegraded":"2024-09-12T18:09:00.146690+0000","last_fullsized":"2024-09-12T18:09:00.146690+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:22:38.368544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"260'3","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:19.857246+0000","last_change":"2024-09-12T17:30:16.676537+0000","last_active":"2024-09-12T18:09:19.857246+0000","last_peered":"2024-09-12T18:09:19.857246+0000","last_clean":"2024-09-12T18:09:19.857246+0000","last_became_active":"2024-09-12T17:30:16.676187+0000","last_became_peered":"2024-09-12T17:30:16.676187+0000","last_unstale":"2024-09-12T18:09:19.857246+0000","last_undegraded":"2024-09-12T18:09:19.857246+0000","last_fullsized":"2024-09-12T18:09:19.857246+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:03:12.668403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"263'4","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:14.855285+0000","last_change":"2024-09-12T17:30:12.651492+0000","last_active":"2024-09-12T18:09:14.855285+0000","last_peered":"2024-09-12T18:09:14.855285+0000","last_clean":"2024-09-12T18:09:14.855285+0000","last_became_active":"2024-09-12T17:30:12.651254+0000","last_became_peered":"2024-09-12T17:30:12.651254+0000","last_unstale":"2024-09-12T18:09:14.855285+0000","last_undegraded":"2024-09-12T18:09:14.855285+0000","last_fullsized":"2024-09-12T18:09:14.855285+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:54:45.814379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":16,"num_write":9,"num_write_kb":1040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"263'21","reported_seq":106,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:19.848719+0000","last_change":"2024-09-12T17:26:35.660865+0000","last_active":"2024-09-12T18:08:19.848719+0000","last_peered":"2024-09-12T18:08:19.848719+0000","last_clean":"2024-09-12T18:08:19.848719+0000","last_became_active":"2024-09-12T17:26:35.660521+0000","last_became_peered":"2024-09-12T17:26:35.660521+0000","last_unstale":"2024-09-12T18:08:19.848719+0000","last_undegraded":"2024-09-12T18:08:19.848719+0000","last_fullsized":"2024-09-12T18:08:19.848719+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:36:23.758533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":60,"num_write":47,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:49.844137+0000","last_change":"2024-09-12T17:46:57.076516+0000","last_active":"2024-09-12T18:07:49.844137+0000","last_peered":"2024-09-12T18:07:49.844137+0000","last_clean":"2024-09-12T18:07:49.844137+0000","last_became_active":"2024-09-12T17:46:57.075936+0000","last_became_peered":"2024-09-12T17:46:57.075936+0000","last_unstale":"2024-09-12T18:07:49.844137+0000","last_undegraded":"2024-09-12T18:07:49.844137+0000","last_fullsized":"2024-09-12T18:07:49.844137+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:03:25.092644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"0'0","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:19.856809+0000","last_change":"2024-09-12T17:30:16.671561+0000","last_active":"2024-09-12T18:09:19.856809+0000","last_peered":"2024-09-12T18:09:19.856809+0000","last_clean":"2024-09-12T18:09:19.856809+0000","last_became_active":"2024-09-12T17:30:16.671232+0000","last_became_peered":"2024-09-12T17:30:16.671232+0000","last_unstale":"2024-09-12T18:09:19.856809+0000","last_undegraded":"2024-09-12T18:09:19.856809+0000","last_fullsized":"2024-09-12T18:09:19.856809+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:01:53.261691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"260'3","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:14.856411+0000","last_change":"2024-09-12T17:30:12.652805+0000","last_active":"2024-09-12T18:09:14.856411+0000","last_peered":"2024-09-12T18:09:14.856411+0000","last_clean":"2024-09-12T18:09:14.856411+0000","last_became_active":"2024-09-12T17:30:12.652439+0000","last_became_peered":"2024-09-12T17:30:12.652439+0000","last_unstale":"2024-09-12T18:09:14.856411+0000","last_undegraded":"2024-09-12T18:09:14.856411+0000","last_fullsized":"2024-09-12T18:09:14.856411+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:38:28.870273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"263'34","reported_seq":144,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:15.141873+0000","last_change":"2024-09-12T17:26:35.664662+0000","last_active":"2024-09-12T18:08:15.141873+0000","last_peered":"2024-09-12T18:08:15.141873+0000","last_clean":"2024-09-12T18:08:15.141873+0000","last_became_active":"2024-09-12T17:26:35.664338+0000","last_became_peered":"2024-09-12T17:26:35.664338+0000","last_unstale":"2024-09-12T18:08:15.141873+0000","last_undegraded":"2024-09-12T18:08:15.141873+0000","last_fullsized":"2024-09-12T18:08:15.141873+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:31:50.906050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":161,"num_read_kb":109,"num_write":67,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"262'1","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:39.834842+0000","last_change":"2024-09-12T17:46:57.091123+0000","last_active":"2024-09-12T18:08:39.834842+0000","last_peered":"2024-09-12T18:08:39.834842+0000","last_clean":"2024-09-12T18:08:39.834842+0000","last_became_active":"2024-09-12T17:46:57.090581+0000","last_became_peered":"2024-09-12T17:46:57.090581+0000","last_unstale":"2024-09-12T18:08:39.834842+0000","last_undegraded":"2024-09-12T18:08:39.834842+0000","last_fullsized":"2024-09-12T18:08:39.834842+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:32:17.465596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"260'3","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:50.139110+0000","last_change":"2024-09-12T17:30:16.677712+0000","last_active":"2024-09-12T18:07:50.139110+0000","last_peered":"2024-09-12T18:07:50.139110+0000","last_clean":"2024-09-12T18:07:50.139110+0000","last_became_active":"2024-09-12T17:30:16.677428+0000","last_became_peered":"2024-09-12T17:30:16.677428+0000","last_unstale":"2024-09-12T18:07:50.139110+0000","last_undegraded":"2024-09-12T18:07:50.139110+0000","last_fullsized":"2024-09-12T18:07:50.139110+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:43:08.742548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"263'5","reported_seq":58,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:19.848612+0000","last_change":"2024-09-12T17:30:12.644935+0000","last_active":"2024-09-12T18:08:19.848612+0000","last_peered":"2024-09-12T18:08:19.848612+0000","last_clean":"2024-09-12T18:08:19.848612+0000","last_became_active":"2024-09-12T17:30:12.644600+0000","last_became_peered":"2024-09-12T17:30:12.644600+0000","last_unstale":"2024-09-12T18:08:19.848612+0000","last_undegraded":"2024-09-12T18:08:19.848612+0000","last_fullsized":"2024-09-12T18:08:19.848612+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:08:42.394913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":6144,"num_write":10,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"263'63","reported_seq":232,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:14.846770+0000","last_change":"2024-09-12T17:26:35.658927+0000","last_active":"2024-09-12T18:08:14.846770+0000","last_peered":"2024-09-12T18:08:14.846770+0000","last_clean":"2024-09-12T18:08:14.846770+0000","last_became_active":"2024-09-12T17:26:35.658630+0000","last_became_peered":"2024-09-12T17:26:35.658630+0000","last_unstale":"2024-09-12T18:08:14.846770+0000","last_undegraded":"2024-09-12T18:08:14.846770+0000","last_fullsized":"2024-09-12T18:08:14.846770+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:40:44.086306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":336,"num_read_kb":235,"num_write":105,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:39.840111+0000","last_change":"2024-09-12T17:46:57.093471+0000","last_active":"2024-09-12T18:08:39.840111+0000","last_peered":"2024-09-12T18:08:39.840111+0000","last_clean":"2024-09-12T18:08:39.840111+0000","last_became_active":"2024-09-12T17:46:57.092472+0000","last_became_peered":"2024-09-12T17:46:57.092472+0000","last_unstale":"2024-09-12T18:08:39.840111+0000","last_undegraded":"2024-09-12T18:08:39.840111+0000","last_fullsized":"2024-09-12T18:08:39.840111+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:53:15.268714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"0'0","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:34.849448+0000","last_change":"2024-09-12T17:30:16.675715+0000","last_active":"2024-09-12T18:08:34.849448+0000","last_peered":"2024-09-12T18:08:34.849448+0000","last_clean":"2024-09-12T18:08:34.849448+0000","last_became_active":"2024-09-12T17:30:16.675380+0000","last_became_peered":"2024-09-12T17:30:16.675380+0000","last_unstale":"2024-09-12T18:08:34.849448+0000","last_undegraded":"2024-09-12T18:08:34.849448+0000","last_fullsized":"2024-09-12T18:08:34.849448+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:03:46.402687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"0'0","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:44.843471+0000","last_change":"2024-09-12T17:30:12.652798+0000","last_active":"2024-09-12T18:07:44.843471+0000","last_peered":"2024-09-12T18:07:44.843471+0000","last_clean":"2024-09-12T18:07:44.843471+0000","last_became_active":"2024-09-12T17:30:12.652368+0000","last_became_peered":"2024-09-12T17:30:12.652368+0000","last_unstale":"2024-09-12T18:07:44.843471+0000","last_undegraded":"2024-09-12T18:07:44.843471+0000","last_fullsized":"2024-09-12T18:07:44.843471+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:17:25.947883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"263'14","reported_seq":92,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:14.847538+0000","last_change":"2024-09-12T17:26:35.662321+0000","last_active":"2024-09-12T18:08:14.847538+0000","last_peered":"2024-09-12T18:08:14.847538+0000","last_clean":"2024-09-12T18:08:14.847538+0000","last_became_active":"2024-09-12T17:26:35.662029+0000","last_became_peered":"2024-09-12T17:26:35.662029+0000","last_unstale":"2024-09-12T18:08:14.847538+0000","last_undegraded":"2024-09-12T18:08:14.847538+0000","last_fullsized":"2024-09-12T18:08:14.847538+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:25:20.058995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":47,"num_write":25,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:49.834357+0000","last_change":"2024-09-12T17:46:57.088925+0000","last_active":"2024-09-12T18:07:49.834357+0000","last_peered":"2024-09-12T18:07:49.834357+0000","last_clean":"2024-09-12T18:07:49.834357+0000","last_became_active":"2024-09-12T17:46:57.088577+0000","last_became_peered":"2024-09-12T17:46:57.088577+0000","last_unstale":"2024-09-12T18:07:49.834357+0000","last_undegraded":"2024-09-12T18:07:49.834357+0000","last_fullsized":"2024-09-12T18:07:49.834357+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:13:06.852295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"263'3","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:49.864118+0000","last_change":"2024-09-12T17:30:16.687859+0000","last_active":"2024-09-12T18:07:49.864118+0000","last_peered":"2024-09-12T18:07:49.864118+0000","last_clean":"2024-09-12T18:07:49.864118+0000","last_became_active":"2024-09-12T17:30:16.687560+0000","last_became_peered":"2024-09-12T17:30:16.687560+0000","last_unstale":"2024-09-12T18:07:49.864118+0000","last_undegraded":"2024-09-12T18:07:49.864118+0000","last_fullsized":"2024-09-12T18:07:49.864118+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:18:26.345356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9437184,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":15360,"num_write":3,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"260'5","reported_seq":63,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:45.138528+0000","last_change":"2024-09-12T17:30:12.646334+0000","last_active":"2024-09-12T18:07:45.138528+0000","last_peered":"2024-09-12T18:07:45.138528+0000","last_clean":"2024-09-12T18:07:45.138528+0000","last_became_active":"2024-09-12T17:30:12.646002+0000","last_became_peered":"2024-09-12T17:30:12.646002+0000","last_unstale":"2024-09-12T18:07:45.138528+0000","last_undegraded":"2024-09-12T18:07:45.138528+0000","last_fullsized":"2024-09-12T18:07:45.138528+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:37:55.039202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"263'38","reported_seq":162,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:14.867529+0000","last_change":"2024-09-12T17:26:35.665038+0000","last_active":"2024-09-12T18:08:14.867529+0000","last_peered":"2024-09-12T18:08:14.867529+0000","last_clean":"2024-09-12T18:08:14.867529+0000","last_became_active":"2024-09-12T17:26:35.664653+0000","last_became_peered":"2024-09-12T17:26:35.664653+0000","last_unstale":"2024-09-12T18:08:14.867529+0000","last_undegraded":"2024-09-12T18:08:14.867529+0000","last_fullsized":"2024-09-12T18:08:14.867529+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:25:13.289455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":203,"num_read_kb":159,"num_write":60,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:54.845096+0000","last_change":"2024-09-12T17:46:57.092076+0000","last_active":"2024-09-12T18:07:54.845096+0000","last_peered":"2024-09-12T18:07:54.845096+0000","last_clean":"2024-09-12T18:07:54.845096+0000","last_became_active":"2024-09-12T17:46:57.091489+0000","last_became_peered":"2024-09-12T17:46:57.091489+0000","last_unstale":"2024-09-12T18:07:54.845096+0000","last_undegraded":"2024-09-12T18:07:54.845096+0000","last_fullsized":"2024-09-12T18:07:54.845096+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:45:12.006559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"263'1","reported_seq":44,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:49.844180+0000","last_change":"2024-09-12T17:30:16.671442+0000","last_active":"2024-09-12T18:07:49.844180+0000","last_peered":"2024-09-12T18:07:49.844180+0000","last_clean":"2024-09-12T18:07:49.844180+0000","last_became_active":"2024-09-12T17:30:16.671126+0000","last_became_peered":"2024-09-12T17:30:16.671126+0000","last_unstale":"2024-09-12T18:07:49.844180+0000","last_undegraded":"2024-09-12T18:07:49.844180+0000","last_fullsized":"2024-09-12T18:07:49.844180+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:55:00.165120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":48,"num_write":1,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"260'3","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:44.863319+0000","last_change":"2024-09-12T17:30:12.645438+0000","last_active":"2024-09-12T18:07:44.863319+0000","last_peered":"2024-09-12T18:07:44.863319+0000","last_clean":"2024-09-12T18:07:44.863319+0000","last_became_active":"2024-09-12T17:30:12.645099+0000","last_became_peered":"2024-09-12T17:30:12.645099+0000","last_unstale":"2024-09-12T18:07:44.863319+0000","last_undegraded":"2024-09-12T18:07:44.863319+0000","last_fullsized":"2024-09-12T18:07:44.863319+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:10:18.763902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"263'42","reported_seq":167,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:39.851442+0000","last_change":"2024-09-12T17:26:35.666120+0000","last_active":"2024-09-12T18:08:39.851442+0000","last_peered":"2024-09-12T18:08:39.851442+0000","last_clean":"2024-09-12T18:08:39.851442+0000","last_became_active":"2024-09-12T17:26:35.665804+0000","last_became_peered":"2024-09-12T17:26:35.665804+0000","last_unstale":"2024-09-12T18:08:39.851442+0000","last_undegraded":"2024-09-12T18:08:39.851442+0000","last_fullsized":"2024-09-12T18:08:39.851442+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:39:01.905486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":202,"num_read_kb":139,"num_write":84,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"263'201","reported_seq":804,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:04.855015+0000","last_change":"2024-09-12T17:10:42.526331+0000","last_active":"2024-09-12T18:09:04.855015+0000","last_peered":"2024-09-12T18:09:04.855015+0000","last_clean":"2024-09-12T18:09:04.855015+0000","last_became_active":"2024-09-12T17:10:42.523450+0000","last_became_peered":"2024-09-12T17:10:42.523450+0000","last_unstale":"2024-09-12T18:09:04.855015+0000","last_undegraded":"2024-09-12T18:09:04.855015+0000","last_fullsized":"2024-09-12T18:09:04.855015+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:26:36.695715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12713471,"num_objects":11,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":357,"num_read_kb":12797,"num_write":987,"num_write_kb":38748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0,5],"acting":[7,6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"263'408","reported_seq":1922,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:58.797415+0000","last_change":"2024-09-12T17:10:44.521376+0000","last_active":"2024-09-12T18:08:58.797415+0000","last_peered":"2024-09-12T18:08:58.797415+0000","last_clean":"2024-09-12T18:08:58.797415+0000","last_became_active":"2024-09-12T17:10:44.521072+0000","last_became_peered":"2024-09-12T17:10:44.521072+0000","last_unstale":"2024-09-12T18:08:58.797415+0000","last_undegraded":"2024-09-12T18:08:58.797415+0000","last_fullsized":"2024-09-12T18:08:58.797415+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":300,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:24:54.440783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2237,"num_read_kb":2119,"num_write":474,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"263'156","reported_seq":792,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:05.147352+0000","last_change":"2024-09-12T17:10:42.516137+0000","last_active":"2024-09-12T18:09:05.147352+0000","last_peered":"2024-09-12T18:09:05.147352+0000","last_clean":"2024-09-12T18:09:05.147352+0000","last_became_active":"2024-09-12T17:10:42.515714+0000","last_became_peered":"2024-09-12T17:10:42.515714+0000","last_unstale":"2024-09-12T18:09:05.147352+0000","last_undegraded":"2024-09-12T18:09:05.147352+0000","last_fullsized":"2024-09-12T18:09:05.147352+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:42:36.192689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5349221,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":404,"num_read_kb":24642,"num_write":798,"num_write_kb":5824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6,4],"acting":[1,0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"263'569","reported_seq":2037,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:06.320505+0000","last_change":"2024-09-12T17:10:44.521016+0000","last_active":"2024-09-12T18:09:06.320505+0000","last_peered":"2024-09-12T18:09:06.320505+0000","last_clean":"2024-09-12T18:09:06.320505+0000","last_became_active":"2024-09-12T17:10:44.520662+0000","last_became_peered":"2024-09-12T17:10:44.520662+0000","last_unstale":"2024-09-12T18:09:06.320505+0000","last_undegraded":"2024-09-12T18:09:06.320505+0000","last_fullsized":"2024-09-12T18:09:06.320505+0000","mapping_epoch":26,"log_start":"263'500","ondisk_log_start":"263'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":500,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:26:51.418557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2846,"num_read_kb":2568,"num_write":745,"num_write_kb":247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"263'191","reported_seq":877,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:04.843250+0000","last_change":"2024-09-12T17:10:42.514886+0000","last_active":"2024-09-12T18:09:04.843250+0000","last_peered":"2024-09-12T18:09:04.843250+0000","last_clean":"2024-09-12T18:09:04.843250+0000","last_became_active":"2024-09-12T17:10:42.514502+0000","last_became_peered":"2024-09-12T17:10:42.514502+0000","last_unstale":"2024-09-12T18:09:04.843250+0000","last_undegraded":"2024-09-12T18:09:04.843250+0000","last_fullsized":"2024-09-12T18:09:04.843250+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:38:43.328631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26587481,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":501,"num_read_kb":116995,"num_write":940,"num_write_kb":47431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,7],"acting":[0,2,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"263'510","reported_seq":2192,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:55.344424+0000","last_change":"2024-09-12T17:10:44.515786+0000","last_active":"2024-09-12T18:08:55.344424+0000","last_peered":"2024-09-12T18:08:55.344424+0000","last_clean":"2024-09-12T18:08:55.344424+0000","last_became_active":"2024-09-12T17:10:44.515053+0000","last_became_peered":"2024-09-12T17:10:44.515053+0000","last_unstale":"2024-09-12T18:08:55.344424+0000","last_undegraded":"2024-09-12T18:08:55.344424+0000","last_fullsized":"2024-09-12T18:08:55.344424+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":400,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:16:05.419489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2823,"num_read_kb":2642,"num_write":595,"num_write_kb":151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"263'184","reported_seq":809,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:59.853049+0000","last_change":"2024-09-12T17:10:42.515615+0000","last_active":"2024-09-12T18:08:59.853049+0000","last_peered":"2024-09-12T18:08:59.853049+0000","last_clean":"2024-09-12T18:08:59.853049+0000","last_became_active":"2024-09-12T17:10:42.515202+0000","last_became_peered":"2024-09-12T17:10:42.515202+0000","last_unstale":"2024-09-12T18:08:59.853049+0000","last_undegraded":"2024-09-12T18:08:59.853049+0000","last_fullsized":"2024-09-12T18:08:59.853049+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:18:31.312838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5813069,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":397,"num_read_kb":32737,"num_write":931,"num_write_kb":40819,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7,2],"acting":[5,3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"263'477","reported_seq":2055,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:09.599114+0000","last_change":"2024-09-12T17:10:44.524085+0000","last_active":"2024-09-12T18:09:09.599114+0000","last_peered":"2024-09-12T18:09:09.599114+0000","last_clean":"2024-09-12T18:09:09.599114+0000","last_became_active":"2024-09-12T17:10:44.523767+0000","last_became_peered":"2024-09-12T17:10:44.523767+0000","last_unstale":"2024-09-12T18:09:09.599114+0000","last_undegraded":"2024-09-12T18:09:09.599114+0000","last_fullsized":"2024-09-12T18:09:09.599114+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":400,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:56:19.375833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2572,"num_read_kb":2417,"num_write":590,"num_write_kb":142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"263'156","reported_seq":787,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:14.848042+0000","last_change":"2024-09-12T17:10:42.523893+0000","last_active":"2024-09-12T18:08:14.848042+0000","last_peered":"2024-09-12T18:08:14.848042+0000","last_clean":"2024-09-12T18:08:14.848042+0000","last_became_active":"2024-09-12T17:10:42.523427+0000","last_became_peered":"2024-09-12T17:10:42.523427+0000","last_unstale":"2024-09-12T18:08:14.848042+0000","last_undegraded":"2024-09-12T18:08:14.848042+0000","last_fullsized":"2024-09-12T18:08:14.848042+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:01:12.856714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5245138,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":436,"num_read_kb":36335,"num_write":766,"num_write_kb":30424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3,6],"acting":[7,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"263'475","reported_seq":1959,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:08.656630+0000","last_change":"2024-09-12T17:10:44.511009+0000","last_active":"2024-09-12T18:11:08.656630+0000","last_peered":"2024-09-12T18:11:08.656630+0000","last_clean":"2024-09-12T18:11:08.656630+0000","last_became_active":"2024-09-12T17:10:44.510692+0000","last_became_peered":"2024-09-12T17:10:44.510692+0000","last_unstale":"2024-09-12T18:11:08.656630+0000","last_undegraded":"2024-09-12T18:11:08.656630+0000","last_fullsized":"2024-09-12T18:11:08.656630+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":400,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:18:01.946068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2639,"num_read_kb":2478,"num_write":625,"num_write_kb":223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"263'186","reported_seq":812,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:14.846749+0000","last_change":"2024-09-12T17:10:42.525823+0000","last_active":"2024-09-12T18:08:14.846749+0000","last_peered":"2024-09-12T18:08:14.846749+0000","last_clean":"2024-09-12T18:08:14.846749+0000","last_became_active":"2024-09-12T17:10:42.525363+0000","last_became_peered":"2024-09-12T17:10:42.525363+0000","last_unstale":"2024-09-12T18:08:14.846749+0000","last_undegraded":"2024-09-12T18:08:14.846749+0000","last_fullsized":"2024-09-12T18:08:14.846749+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:02:50.629102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291534,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":407,"num_read_kb":34311,"num_write":949,"num_write_kb":12654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,4,1],"acting":[5,0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"263'875","reported_seq":2655,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:48.689421+0000","last_change":"2024-09-12T17:10:44.514182+0000","last_active":"2024-09-12T18:09:48.689421+0000","last_peered":"2024-09-12T18:09:48.689421+0000","last_clean":"2024-09-12T18:09:48.689421+0000","last_became_active":"2024-09-12T17:10:44.513865+0000","last_became_peered":"2024-09-12T17:10:44.513865+0000","last_unstale":"2024-09-12T18:09:48.689421+0000","last_undegraded":"2024-09-12T18:09:48.689421+0000","last_fullsized":"2024-09-12T18:09:48.689421+0000","mapping_epoch":26,"log_start":"263'800","ondisk_log_start":"263'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":800,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:58:50.879901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4549,"num_read_kb":4126,"num_write":1137,"num_write_kb":421,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"263'186","reported_seq":984,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:14.847986+0000","last_change":"2024-09-12T17:10:42.531846+0000","last_active":"2024-09-12T18:08:14.847986+0000","last_peered":"2024-09-12T18:08:14.847986+0000","last_clean":"2024-09-12T18:08:14.847986+0000","last_became_active":"2024-09-12T17:10:42.531356+0000","last_became_peered":"2024-09-12T17:10:42.531356+0000","last_unstale":"2024-09-12T18:08:14.847986+0000","last_undegraded":"2024-09-12T18:08:14.847986+0000","last_fullsized":"2024-09-12T18:08:14.847986+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:12:38.008206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":298268,"num_objects":11,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":746,"num_read_kb":2366,"num_write":949,"num_write_kb":15239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4,6],"acting":[7,0,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"263'409","reported_seq":1925,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:09.599316+0000","last_change":"2024-09-12T17:10:44.521355+0000","last_active":"2024-09-12T18:09:09.599316+0000","last_peered":"2024-09-12T18:09:09.599316+0000","last_clean":"2024-09-12T18:09:09.599316+0000","last_became_active":"2024-09-12T17:10:44.520609+0000","last_became_peered":"2024-09-12T17:10:44.520609+0000","last_unstale":"2024-09-12T18:09:09.599316+0000","last_undegraded":"2024-09-12T18:09:09.599316+0000","last_fullsized":"2024-09-12T18:09:09.599316+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":300,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:15:20.820552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2177,"num_read_kb":2069,"num_write":470,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"263'203","reported_seq":837,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:14.845186+0000","last_change":"2024-09-12T17:10:42.528380+0000","last_active":"2024-09-12T18:08:14.845186+0000","last_peered":"2024-09-12T18:08:14.845186+0000","last_clean":"2024-09-12T18:08:14.845186+0000","last_became_active":"2024-09-12T17:10:42.527310+0000","last_became_peered":"2024-09-12T17:10:42.527310+0000","last_unstale":"2024-09-12T18:08:14.845186+0000","last_undegraded":"2024-09-12T18:08:14.845186+0000","last_fullsized":"2024-09-12T18:08:14.845186+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:59:02.965611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10670368,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":463,"num_read_kb":11976,"num_write":987,"num_write_kb":39362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0,2],"acting":[3,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"263'803","reported_seq":2469,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:08.689356+0000","last_change":"2024-09-12T17:10:44.518218+0000","last_active":"2024-09-12T18:11:08.689356+0000","last_peered":"2024-09-12T18:11:08.689356+0000","last_clean":"2024-09-12T18:11:08.689356+0000","last_became_active":"2024-09-12T17:10:44.517947+0000","last_became_peered":"2024-09-12T17:10:44.517947+0000","last_unstale":"2024-09-12T18:11:08.689356+0000","last_undegraded":"2024-09-12T18:11:08.689356+0000","last_fullsized":"2024-09-12T18:11:08.689356+0000","mapping_epoch":26,"log_start":"263'700","ondisk_log_start":"263'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":700,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:23:45.311255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3878,"num_read_kb":3536,"num_write":1022,"num_write_kb":342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"263'406","reported_seq":2024,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:04.854401+0000","last_change":"2024-09-12T17:10:44.514809+0000","last_active":"2024-09-12T18:09:04.854401+0000","last_peered":"2024-09-12T18:09:04.854401+0000","last_clean":"2024-09-12T18:09:04.854401+0000","last_became_active":"2024-09-12T17:10:44.514293+0000","last_became_peered":"2024-09-12T17:10:44.514293+0000","last_unstale":"2024-09-12T18:09:04.854401+0000","last_undegraded":"2024-09-12T18:09:04.854401+0000","last_fullsized":"2024-09-12T18:09:04.854401+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":300,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:15:27.841945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2470,"num_read_kb":2366,"num_write":468,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"263'161","reported_seq":774,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:54.853629+0000","last_change":"2024-09-12T17:10:42.522308+0000","last_active":"2024-09-12T18:08:54.853629+0000","last_peered":"2024-09-12T18:08:54.853629+0000","last_clean":"2024-09-12T18:08:54.853629+0000","last_became_active":"2024-09-12T17:10:42.521637+0000","last_became_peered":"2024-09-12T17:10:42.521637+0000","last_unstale":"2024-09-12T18:08:54.853629+0000","last_undegraded":"2024-09-12T18:08:54.853629+0000","last_fullsized":"2024-09-12T18:08:54.853629+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:28:33.771646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5704625,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":443,"num_read_kb":17329,"num_write":803,"num_write_kb":49238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0,1],"acting":[7,5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"263'782","reported_seq":2276,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:04.854884+0000","last_change":"2024-09-12T17:10:44.521355+0000","last_active":"2024-09-12T18:09:04.854884+0000","last_peered":"2024-09-12T18:09:04.854884+0000","last_clean":"2024-09-12T18:09:04.854884+0000","last_became_active":"2024-09-12T17:10:44.521031+0000","last_became_peered":"2024-09-12T17:10:44.521031+0000","last_unstale":"2024-09-12T18:09:04.854884+0000","last_undegraded":"2024-09-12T18:09:04.854884+0000","last_fullsized":"2024-09-12T18:09:04.854884+0000","mapping_epoch":26,"log_start":"263'700","ondisk_log_start":"263'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":700,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:32:54.360404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3604,"num_read_kb":3242,"num_write":1018,"num_write_kb":360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"263'252","reported_seq":945,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:44.871763+0000","last_change":"2024-09-12T17:10:42.526866+0000","last_active":"2024-09-12T18:08:44.871763+0000","last_peered":"2024-09-12T18:08:44.871763+0000","last_clean":"2024-09-12T18:08:44.871763+0000","last_became_active":"2024-09-12T17:10:42.517679+0000","last_became_peered":"2024-09-12T17:10:42.517679+0000","last_unstale":"2024-09-12T18:08:44.871763+0000","last_undegraded":"2024-09-12T18:08:44.871763+0000","last_fullsized":"2024-09-12T18:08:44.871763+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:33:13.890188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1606466,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":848,"num_read_kb":4297,"num_write":1122,"num_write_kb":28670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2,1],"acting":[6,5,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"263'358","reported_seq":1812,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:19.855895+0000","last_change":"2024-09-12T17:10:44.518484+0000","last_active":"2024-09-12T18:09:19.855895+0000","last_peered":"2024-09-12T18:09:19.855895+0000","last_clean":"2024-09-12T18:09:19.855895+0000","last_became_active":"2024-09-12T17:10:44.518183+0000","last_became_peered":"2024-09-12T17:10:44.518183+0000","last_unstale":"2024-09-12T18:09:19.855895+0000","last_undegraded":"2024-09-12T18:09:19.855895+0000","last_fullsized":"2024-09-12T18:09:19.855895+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:51:18.710777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1979,"num_read_kb":1899,"num_write":385,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"263'229","reported_seq":950,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:49.079463+0000","last_change":"2024-09-12T17:10:42.518722+0000","last_active":"2024-09-12T18:08:49.079463+0000","last_peered":"2024-09-12T18:08:49.079463+0000","last_clean":"2024-09-12T18:08:49.079463+0000","last_became_active":"2024-09-12T17:10:42.518345+0000","last_became_peered":"2024-09-12T17:10:42.518345+0000","last_unstale":"2024-09-12T18:08:49.079463+0000","last_undegraded":"2024-09-12T18:08:49.079463+0000","last_fullsized":"2024-09-12T18:08:49.079463+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":200,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:55:42.993471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1440420,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":643,"num_read_kb":98876,"num_write":1051,"num_write_kb":25289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0,3],"acting":[6,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"263'516","reported_seq":2148,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:08.689613+0000","last_change":"2024-09-12T17:10:44.514989+0000","last_active":"2024-09-12T18:11:08.689613+0000","last_peered":"2024-09-12T18:11:08.689613+0000","last_clean":"2024-09-12T18:11:08.689613+0000","last_became_active":"2024-09-12T17:10:44.514645+0000","last_became_peered":"2024-09-12T17:10:44.514645+0000","last_unstale":"2024-09-12T18:11:08.689613+0000","last_undegraded":"2024-09-12T18:11:08.689613+0000","last_fullsized":"2024-09-12T18:11:08.689613+0000","mapping_epoch":26,"log_start":"263'500","ondisk_log_start":"263'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":500,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:07:24.458191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2725,"num_read_kb":2548,"num_write":623,"num_write_kb":175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"263'213","reported_seq":872,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:44.851667+0000","last_change":"2024-09-12T17:10:42.519598+0000","last_active":"2024-09-12T18:08:44.851667+0000","last_peered":"2024-09-12T18:08:44.851667+0000","last_clean":"2024-09-12T18:08:44.851667+0000","last_became_active":"2024-09-12T17:10:42.519000+0000","last_became_peered":"2024-09-12T17:10:42.519000+0000","last_unstale":"2024-09-12T18:08:44.851667+0000","last_undegraded":"2024-09-12T18:08:44.851667+0000","last_fullsized":"2024-09-12T18:08:44.851667+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:16:24.448620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5782027,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":500,"num_read_kb":33700,"num_write":930,"num_write_kb":23229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,0],"acting":[4,3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"263'1583","reported_seq":3109,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:58.601451+0000","last_change":"2024-09-12T17:10:44.515105+0000","last_active":"2024-09-12T18:08:58.601451+0000","last_peered":"2024-09-12T18:08:58.601451+0000","last_clean":"2024-09-12T18:08:58.601451+0000","last_became_active":"2024-09-12T17:10:44.514826+0000","last_became_peered":"2024-09-12T17:10:44.514826+0000","last_unstale":"2024-09-12T18:08:58.601451+0000","last_undegraded":"2024-09-12T18:08:58.601451+0000","last_fullsized":"2024-09-12T18:08:58.601451+0000","mapping_epoch":26,"log_start":"263'1500","ondisk_log_start":"263'1500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":1500,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:30:21.141258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6865,"num_read_kb":5951,"num_write":2206,"num_write_kb":956,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"263'239","reported_seq":895,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:10:59.495004+0000","last_change":"2024-09-12T17:10:42.533422+0000","last_active":"2024-09-12T18:10:59.495004+0000","last_peered":"2024-09-12T18:10:59.495004+0000","last_clean":"2024-09-12T18:10:59.495004+0000","last_became_active":"2024-09-12T17:10:42.532995+0000","last_became_peered":"2024-09-12T17:10:42.532995+0000","last_unstale":"2024-09-12T18:10:59.495004+0000","last_undegraded":"2024-09-12T18:10:59.495004+0000","last_fullsized":"2024-09-12T18:10:59.495004+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":200,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:44:08.027039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11322954,"num_objects":11,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":534,"num_read_kb":13123,"num_write":1222,"num_write_kb":39413,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1,5],"acting":[3,6,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"263'1288","reported_seq":3015,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:48.689829+0000","last_change":"2024-09-12T17:10:44.507748+0000","last_active":"2024-09-12T18:09:48.689829+0000","last_peered":"2024-09-12T18:09:48.689829+0000","last_clean":"2024-09-12T18:09:48.689829+0000","last_became_active":"2024-09-12T17:10:44.507428+0000","last_became_peered":"2024-09-12T17:10:44.507428+0000","last_unstale":"2024-09-12T18:09:48.689829+0000","last_undegraded":"2024-09-12T18:09:48.689829+0000","last_fullsized":"2024-09-12T18:09:48.689829+0000","mapping_epoch":26,"log_start":"263'1200","ondisk_log_start":"263'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":1200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:34:52.540295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5933,"num_read_kb":5245,"num_write":1814,"num_write_kb":777,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"263'185","reported_seq":863,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:14.844412+0000","last_change":"2024-09-12T17:10:42.529986+0000","last_active":"2024-09-12T18:09:14.844412+0000","last_peered":"2024-09-12T18:09:14.844412+0000","last_clean":"2024-09-12T18:09:14.844412+0000","last_became_active":"2024-09-12T17:10:42.529179+0000","last_became_peered":"2024-09-12T17:10:42.529179+0000","last_unstale":"2024-09-12T18:09:14.844412+0000","last_undegraded":"2024-09-12T18:09:14.844412+0000","last_fullsized":"2024-09-12T18:09:14.844412+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:53:33.632179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":576011,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":570,"num_read_kb":13539,"num_write":907,"num_write_kb":25869,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1,5],"acting":[0,4,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"263'159","reported_seq":680,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:49.689301+0000","last_change":"2024-09-12T17:10:52.566398+0000","last_active":"2024-09-12T18:09:49.689301+0000","last_peered":"2024-09-12T18:09:49.689301+0000","last_clean":"2024-09-12T18:09:49.689301+0000","last_became_active":"2024-09-12T17:10:52.566079+0000","last_became_peered":"2024-09-12T17:10:52.566079+0000","last_unstale":"2024-09-12T18:09:49.689301+0000","last_undegraded":"2024-09-12T18:09:49.689301+0000","last_fullsized":"2024-09-12T18:09:49.689301+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":100,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:46:37.549026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":803,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":269,"num_read_kb":255,"num_write":425,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"263'795","reported_seq":2403,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:19.853207+0000","last_change":"2024-09-12T17:10:44.522489+0000","last_active":"2024-09-12T18:09:19.853207+0000","last_peered":"2024-09-12T18:09:19.853207+0000","last_clean":"2024-09-12T18:09:19.853207+0000","last_became_active":"2024-09-12T17:10:44.522193+0000","last_became_peered":"2024-09-12T17:10:44.522193+0000","last_unstale":"2024-09-12T18:09:19.853207+0000","last_undegraded":"2024-09-12T18:09:19.853207+0000","last_fullsized":"2024-09-12T18:09:19.853207+0000","mapping_epoch":26,"log_start":"263'700","ondisk_log_start":"263'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":700,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:23:39.492588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3748,"num_read_kb":3407,"num_write":1044,"num_write_kb":360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"263'199","reported_seq":841,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:04.854920+0000","last_change":"2024-09-12T17:10:42.531990+0000","last_active":"2024-09-12T18:09:04.854920+0000","last_peered":"2024-09-12T18:09:04.854920+0000","last_clean":"2024-09-12T18:09:04.854920+0000","last_became_active":"2024-09-12T17:10:42.528620+0000","last_became_peered":"2024-09-12T17:10:42.528620+0000","last_unstale":"2024-09-12T18:09:04.854920+0000","last_undegraded":"2024-09-12T18:09:04.854920+0000","last_fullsized":"2024-09-12T18:09:04.854920+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:01.518991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11074653,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":493,"num_read_kb":31268,"num_write":1011,"num_write_kb":14227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4,2],"acting":[7,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:49.851570+0000","last_change":"2024-09-12T17:10:46.527973+0000","last_active":"2024-09-12T18:08:49.851570+0000","last_peered":"2024-09-12T18:08:49.851570+0000","last_clean":"2024-09-12T18:08:49.851570+0000","last_became_active":"2024-09-12T17:10:46.527663+0000","last_became_peered":"2024-09-12T17:10:46.527663+0000","last_unstale":"2024-09-12T18:08:49.851570+0000","last_undegraded":"2024-09-12T18:08:49.851570+0000","last_fullsized":"2024-09-12T18:08:49.851570+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_clean_scrub_stamp":"2024-09-12T17:10:45.504515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:21:49.638349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"263'198","reported_seq":801,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:09.798260+0000","last_change":"2024-09-12T17:10:48.545372+0000","last_active":"2024-09-12T18:11:09.798260+0000","last_peered":"2024-09-12T18:11:09.798260+0000","last_clean":"2024-09-12T18:11:09.798260+0000","last_became_active":"2024-09-12T17:10:48.544885+0000","last_became_peered":"2024-09-12T17:10:48.544885+0000","last_unstale":"2024-09-12T18:11:09.798260+0000","last_undegraded":"2024-09-12T18:11:09.798260+0000","last_fullsized":"2024-09-12T18:11:09.798260+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_clean_scrub_stamp":"2024-09-12T17:10:47.516917+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:14:40.858594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8481,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":255,"num_read_kb":299,"num_write":152,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":485,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:49.852931+0000","last_change":"2024-09-12T17:10:50.556467+0000","last_active":"2024-09-12T18:08:49.852931+0000","last_peered":"2024-09-12T18:08:49.852931+0000","last_clean":"2024-09-12T18:08:49.852931+0000","last_became_active":"2024-09-12T17:10:50.556146+0000","last_became_peered":"2024-09-12T17:10:50.556146+0000","last_unstale":"2024-09-12T18:08:49.852931+0000","last_undegraded":"2024-09-12T18:08:49.852931+0000","last_fullsized":"2024-09-12T18:08:49.852931+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_clean_scrub_stamp":"2024-09-12T17:10:49.533772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:46:08.763293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"263'2474","reported_seq":4378,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:49.683677+0000","last_change":"2024-09-12T17:10:52.572598+0000","last_active":"2024-09-12T18:09:49.683677+0000","last_peered":"2024-09-12T18:09:49.683677+0000","last_clean":"2024-09-12T18:09:49.683677+0000","last_became_active":"2024-09-12T17:10:52.572326+0000","last_became_peered":"2024-09-12T17:10:52.572326+0000","last_unstale":"2024-09-12T18:09:49.683677+0000","last_undegraded":"2024-09-12T18:09:49.683677+0000","last_fullsized":"2024-09-12T18:09:49.683677+0000","mapping_epoch":34,"log_start":"263'2400","ondisk_log_start":"263'2400","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":2400,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:07:16.923827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":211,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6220,"num_read_kb":6202,"num_write":4958,"num_write_kb":1813,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"263'423","reported_seq":1877,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:08.688272+0000","last_change":"2024-09-12T17:10:44.513059+0000","last_active":"2024-09-12T18:11:08.688272+0000","last_peered":"2024-09-12T18:11:08.688272+0000","last_clean":"2024-09-12T18:11:08.688272+0000","last_became_active":"2024-09-12T17:10:44.512755+0000","last_became_peered":"2024-09-12T17:10:44.512755+0000","last_unstale":"2024-09-12T18:11:08.688272+0000","last_undegraded":"2024-09-12T18:11:08.688272+0000","last_fullsized":"2024-09-12T18:11:08.688272+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":400,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:13:48.119870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2092,"num_read_kb":1979,"num_write":465,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"263'200","reported_seq":837,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:04.843197+0000","last_change":"2024-09-12T17:10:42.514091+0000","last_active":"2024-09-12T18:09:04.843197+0000","last_peered":"2024-09-12T18:09:04.843197+0000","last_clean":"2024-09-12T18:09:04.843197+0000","last_became_active":"2024-09-12T17:10:42.513658+0000","last_became_peered":"2024-09-12T17:10:42.513658+0000","last_unstale":"2024-09-12T18:09:04.843197+0000","last_undegraded":"2024-09-12T18:09:04.843197+0000","last_fullsized":"2024-09-12T18:09:04.843197+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:37:17.251915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5860566,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":443,"num_read_kb":17694,"num_write":952,"num_write_kb":36760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":495,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:04.837350+0000","last_change":"2024-09-12T17:10:46.528313+0000","last_active":"2024-09-12T18:07:04.837350+0000","last_peered":"2024-09-12T18:07:04.837350+0000","last_clean":"2024-09-12T18:07:04.837350+0000","last_became_active":"2024-09-12T17:10:46.528008+0000","last_became_peered":"2024-09-12T17:10:46.528008+0000","last_unstale":"2024-09-12T18:07:04.837350+0000","last_undegraded":"2024-09-12T18:07:04.837350+0000","last_fullsized":"2024-09-12T18:07:04.837350+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_clean_scrub_stamp":"2024-09-12T17:10:45.504515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:19:49.464976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"263'98","reported_seq":630,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:49.852429+0000","last_change":"2024-09-12T17:10:48.540285+0000","last_active":"2024-09-12T18:08:49.852429+0000","last_peered":"2024-09-12T18:08:49.852429+0000","last_clean":"2024-09-12T18:08:49.852429+0000","last_became_active":"2024-09-12T17:10:48.539249+0000","last_became_peered":"2024-09-12T17:10:48.539249+0000","last_unstale":"2024-09-12T18:08:49.852429+0000","last_undegraded":"2024-09-12T18:08:49.852429+0000","last_fullsized":"2024-09-12T18:08:49.852429+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_clean_scrub_stamp":"2024-09-12T17:10:47.516917+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:10:07.478104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":101,"num_read_kb":97,"num_write":68,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:49.852402+0000","last_change":"2024-09-12T17:10:50.560376+0000","last_active":"2024-09-12T18:08:49.852402+0000","last_peered":"2024-09-12T18:08:49.852402+0000","last_clean":"2024-09-12T18:08:49.852402+0000","last_became_active":"2024-09-12T17:10:50.559882+0000","last_became_peered":"2024-09-12T17:10:50.559882+0000","last_unstale":"2024-09-12T18:08:49.852402+0000","last_undegraded":"2024-09-12T18:08:49.852402+0000","last_fullsized":"2024-09-12T18:08:49.852402+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_clean_scrub_stamp":"2024-09-12T17:10:49.533772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:28:55.022294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"263'90","reported_seq":591,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:40.825979+0000","last_change":"2024-09-12T17:10:52.570423+0000","last_active":"2024-09-12T18:08:40.825979+0000","last_peered":"2024-09-12T18:08:40.825979+0000","last_clean":"2024-09-12T18:08:40.825979+0000","last_became_active":"2024-09-12T17:10:52.570071+0000","last_became_peered":"2024-09-12T17:10:52.570071+0000","last_unstale":"2024-09-12T18:08:40.825979+0000","last_undegraded":"2024-09-12T18:08:40.825979+0000","last_fullsized":"2024-09-12T18:08:40.825979+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:46:23.049710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":117,"num_read_kb":116,"num_write":199,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"263'443","reported_seq":1990,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:04.193040+0000","last_change":"2024-09-12T17:10:44.518158+0000","last_active":"2024-09-12T18:09:04.193040+0000","last_peered":"2024-09-12T18:09:04.193040+0000","last_clean":"2024-09-12T18:09:04.193040+0000","last_became_active":"2024-09-12T17:10:44.517886+0000","last_became_peered":"2024-09-12T17:10:44.517886+0000","last_unstale":"2024-09-12T18:09:04.193040+0000","last_undegraded":"2024-09-12T18:09:04.193040+0000","last_fullsized":"2024-09-12T18:09:04.193040+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":400,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:43:41.541508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2335,"num_read_kb":2201,"num_write":517,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"263'189","reported_seq":813,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:32.299175+0000","last_change":"2024-09-12T17:10:42.531080+0000","last_active":"2024-09-12T18:09:32.299175+0000","last_peered":"2024-09-12T18:09:32.299175+0000","last_clean":"2024-09-12T18:09:32.299175+0000","last_became_active":"2024-09-12T17:10:42.530663+0000","last_became_peered":"2024-09-12T17:10:42.530663+0000","last_unstale":"2024-09-12T18:09:32.299175+0000","last_undegraded":"2024-09-12T18:09:32.299175+0000","last_fullsized":"2024-09-12T18:09:32.299175+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:31:17.343251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6489153,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":433,"num_read_kb":14482,"num_write":957,"num_write_kb":29259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":495,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:49.849323+0000","last_change":"2024-09-12T17:10:46.530775+0000","last_active":"2024-09-12T18:08:49.849323+0000","last_peered":"2024-09-12T18:08:49.849323+0000","last_clean":"2024-09-12T18:08:49.849323+0000","last_became_active":"2024-09-12T17:10:46.530438+0000","last_became_peered":"2024-09-12T17:10:46.530438+0000","last_unstale":"2024-09-12T18:08:49.849323+0000","last_undegraded":"2024-09-12T18:08:49.849323+0000","last_fullsized":"2024-09-12T18:08:49.849323+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_clean_scrub_stamp":"2024-09-12T17:10:45.504515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:06:31.919771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"263'114","reported_seq":649,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:19.838931+0000","last_change":"2024-09-12T17:10:48.540591+0000","last_active":"2024-09-12T18:09:19.838931+0000","last_peered":"2024-09-12T18:09:19.838931+0000","last_clean":"2024-09-12T18:09:19.838931+0000","last_became_active":"2024-09-12T17:10:48.540078+0000","last_became_peered":"2024-09-12T17:10:48.540078+0000","last_unstale":"2024-09-12T18:09:19.838931+0000","last_undegraded":"2024-09-12T18:09:19.838931+0000","last_fullsized":"2024-09-12T18:09:19.838931+0000","mapping_epoch":30,"log_start":"263'100","ondisk_log_start":"263'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_clean_scrub_stamp":"2024-09-12T17:10:47.516917+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:11:14.400403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":134,"num_read_kb":129,"num_write":88,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"263'762","reported_seq":4725,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:13.430655+0000","last_change":"2024-09-12T17:10:50.563321+0000","last_active":"2024-09-12T18:11:13.430655+0000","last_peered":"2024-09-12T18:11:13.430655+0000","last_clean":"2024-09-12T18:11:13.430655+0000","last_became_active":"2024-09-12T17:10:50.562930+0000","last_became_peered":"2024-09-12T17:10:50.562930+0000","last_unstale":"2024-09-12T18:11:13.430655+0000","last_undegraded":"2024-09-12T18:11:13.430655+0000","last_fullsized":"2024-09-12T18:11:13.430655+0000","mapping_epoch":32,"log_start":"263'700","ondisk_log_start":"263'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_clean_scrub_stamp":"2024-09-12T17:10:49.533772+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":700,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:02:44.468859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"263'198","reported_seq":1047,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:49.747543+0000","last_change":"2024-09-12T17:10:52.671398+0000","last_active":"2024-09-12T18:09:49.747543+0000","last_peered":"2024-09-12T18:09:49.747543+0000","last_clean":"2024-09-12T18:09:49.747543+0000","last_became_active":"2024-09-12T17:10:52.671103+0000","last_became_peered":"2024-09-12T17:10:52.671103+0000","last_unstale":"2024-09-12T18:09:49.747543+0000","last_undegraded":"2024-09-12T18:09:49.747543+0000","last_fullsized":"2024-09-12T18:09:49.747543+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:56:47.430468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":719,"num_read_kb":693,"num_write":432,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"263'446","reported_seq":1962,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:48.690267+0000","last_change":"2024-09-12T17:10:44.515015+0000","last_active":"2024-09-12T18:09:48.690267+0000","last_peered":"2024-09-12T18:09:48.690267+0000","last_clean":"2024-09-12T18:09:48.690267+0000","last_became_active":"2024-09-12T17:10:44.514124+0000","last_became_peered":"2024-09-12T17:10:44.514124+0000","last_unstale":"2024-09-12T18:09:48.690267+0000","last_undegraded":"2024-09-12T18:09:48.690267+0000","last_fullsized":"2024-09-12T18:09:48.690267+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":400,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:59:05.101317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2305,"num_read_kb":2168,"num_write":513,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"263'219","reported_seq":875,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:04.874408+0000","last_change":"2024-09-12T17:10:42.526752+0000","last_active":"2024-09-12T18:09:04.874408+0000","last_peered":"2024-09-12T18:09:04.874408+0000","last_clean":"2024-09-12T18:09:04.874408+0000","last_became_active":"2024-09-12T17:10:42.525328+0000","last_became_peered":"2024-09-12T17:10:42.525328+0000","last_unstale":"2024-09-12T18:09:04.874408+0000","last_undegraded":"2024-09-12T18:09:04.874408+0000","last_fullsized":"2024-09-12T18:09:04.874408+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:01:32.510919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9693500,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":545,"num_read_kb":47940,"num_write":1048,"num_write_kb":57690,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,3],"acting":[6,0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:49.851613+0000","last_change":"2024-09-12T17:10:46.527001+0000","last_active":"2024-09-12T18:08:49.851613+0000","last_peered":"2024-09-12T18:08:49.851613+0000","last_clean":"2024-09-12T18:08:49.851613+0000","last_became_active":"2024-09-12T17:10:46.526679+0000","last_became_peered":"2024-09-12T17:10:46.526679+0000","last_unstale":"2024-09-12T18:08:49.851613+0000","last_undegraded":"2024-09-12T18:08:49.851613+0000","last_fullsized":"2024-09-12T18:08:49.851613+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_clean_scrub_stamp":"2024-09-12T17:10:45.504515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:03:41.503120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"263'127","reported_seq":690,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:09.791937+0000","last_change":"2024-09-12T17:10:48.543886+0000","last_active":"2024-09-12T18:11:09.791937+0000","last_peered":"2024-09-12T18:11:09.791937+0000","last_clean":"2024-09-12T18:11:09.791937+0000","last_became_active":"2024-09-12T17:10:48.543573+0000","last_became_peered":"2024-09-12T17:10:48.543573+0000","last_unstale":"2024-09-12T18:11:09.791937+0000","last_undegraded":"2024-09-12T18:11:09.791937+0000","last_fullsized":"2024-09-12T18:11:09.791937+0000","mapping_epoch":30,"log_start":"263'100","ondisk_log_start":"263'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_clean_scrub_stamp":"2024-09-12T17:10:47.516917+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:34:09.400161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15870,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":166,"num_read_kb":231,"num_write":90,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"263'784","reported_seq":2294,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:13.139836+0000","last_change":"2024-09-12T17:10:50.559536+0000","last_active":"2024-09-12T18:11:13.139836+0000","last_peered":"2024-09-12T18:11:13.139836+0000","last_clean":"2024-09-12T18:11:13.139836+0000","last_became_active":"2024-09-12T17:10:50.559216+0000","last_became_peered":"2024-09-12T17:10:50.559216+0000","last_unstale":"2024-09-12T18:11:13.139836+0000","last_undegraded":"2024-09-12T18:11:13.139836+0000","last_fullsized":"2024-09-12T18:11:13.139836+0000","mapping_epoch":32,"log_start":"263'700","ondisk_log_start":"263'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_clean_scrub_stamp":"2024-09-12T17:10:49.533772+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":700,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:25:21.535911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"263'408","reported_seq":1929,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:49.545567+0000","last_change":"2024-09-12T17:10:44.516555+0000","last_active":"2024-09-12T18:09:49.545567+0000","last_peered":"2024-09-12T18:09:49.545567+0000","last_clean":"2024-09-12T18:09:49.545567+0000","last_became_active":"2024-09-12T17:10:44.516266+0000","last_became_peered":"2024-09-12T17:10:44.516266+0000","last_unstale":"2024-09-12T18:09:49.545567+0000","last_undegraded":"2024-09-12T18:09:49.545567+0000","last_fullsized":"2024-09-12T18:09:49.545567+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":300,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:00:21.370421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2231,"num_read_kb":2116,"num_write":471,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"263'312","reported_seq":1079,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:43.800887+0000","last_change":"2024-09-12T17:10:42.532317+0000","last_active":"2024-09-12T18:09:43.800887+0000","last_peered":"2024-09-12T18:09:43.800887+0000","last_clean":"2024-09-12T18:09:43.800887+0000","last_became_active":"2024-09-12T17:10:42.531886+0000","last_became_peered":"2024-09-12T17:10:42.531886+0000","last_unstale":"2024-09-12T18:09:43.800887+0000","last_undegraded":"2024-09-12T18:09:43.800887+0000","last_fullsized":"2024-09-12T18:09:43.800887+0000","mapping_epoch":24,"log_start":"263'300","ondisk_log_start":"263'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:10:32.496140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12869981,"num_objects":13,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":1036,"num_read_kb":35637,"num_write":1309,"num_write_kb":31872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0,1],"acting":[7,4,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:19.857104+0000","last_change":"2024-09-12T17:10:46.519211+0000","last_active":"2024-09-12T18:09:19.857104+0000","last_peered":"2024-09-12T18:09:19.857104+0000","last_clean":"2024-09-12T18:09:19.857104+0000","last_became_active":"2024-09-12T17:10:46.518652+0000","last_became_peered":"2024-09-12T17:10:46.518652+0000","last_unstale":"2024-09-12T18:09:19.857104+0000","last_undegraded":"2024-09-12T18:09:19.857104+0000","last_fullsized":"2024-09-12T18:09:19.857104+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_clean_scrub_stamp":"2024-09-12T17:10:45.504515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:02:38.257135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"263'214","reported_seq":826,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:34.859827+0000","last_change":"2024-09-12T17:10:48.541485+0000","last_active":"2024-09-12T18:09:34.859827+0000","last_peered":"2024-09-12T18:09:34.859827+0000","last_clean":"2024-09-12T18:09:34.859827+0000","last_became_active":"2024-09-12T17:10:48.541178+0000","last_became_peered":"2024-09-12T17:10:48.541178+0000","last_unstale":"2024-09-12T18:09:34.859827+0000","last_undegraded":"2024-09-12T18:09:34.859827+0000","last_fullsized":"2024-09-12T18:09:34.859827+0000","mapping_epoch":30,"log_start":"263'200","ondisk_log_start":"263'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_clean_scrub_stamp":"2024-09-12T17:10:47.516917+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:04:05.483511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8055,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":289,"num_read_kb":328,"num_write":168,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:20.148978+0000","last_change":"2024-09-12T17:10:50.560497+0000","last_active":"2024-09-12T18:09:20.148978+0000","last_peered":"2024-09-12T18:09:20.148978+0000","last_clean":"2024-09-12T18:09:20.148978+0000","last_became_active":"2024-09-12T17:10:50.560193+0000","last_became_peered":"2024-09-12T17:10:50.560193+0000","last_unstale":"2024-09-12T18:09:20.148978+0000","last_undegraded":"2024-09-12T18:09:20.148978+0000","last_fullsized":"2024-09-12T18:09:20.148978+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_clean_scrub_stamp":"2024-09-12T17:10:49.533772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:31:52.880536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"263'555","reported_seq":1366,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:09.825289+0000","last_change":"2024-09-12T17:10:52.573117+0000","last_active":"2024-09-12T18:11:09.825289+0000","last_peered":"2024-09-12T18:11:09.825289+0000","last_clean":"2024-09-12T18:11:09.825289+0000","last_became_active":"2024-09-12T17:10:52.572861+0000","last_became_peered":"2024-09-12T17:10:52.572861+0000","last_unstale":"2024-09-12T18:11:09.825289+0000","last_undegraded":"2024-09-12T18:11:09.825289+0000","last_fullsized":"2024-09-12T18:11:09.825289+0000","mapping_epoch":34,"log_start":"263'500","ondisk_log_start":"263'500","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":500,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:59:24.545564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1102,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1315,"num_read_kb":1312,"num_write":1171,"num_write_kb":396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"263'467","reported_seq":2047,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:08.687983+0000","last_change":"2024-09-12T17:10:44.516107+0000","last_active":"2024-09-12T18:11:08.687983+0000","last_peered":"2024-09-12T18:11:08.687983+0000","last_clean":"2024-09-12T18:11:08.687983+0000","last_became_active":"2024-09-12T17:10:44.515778+0000","last_became_peered":"2024-09-12T17:10:44.515778+0000","last_unstale":"2024-09-12T18:11:08.687983+0000","last_undegraded":"2024-09-12T18:11:08.687983+0000","last_fullsized":"2024-09-12T18:11:08.687983+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":400,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:07:30.510968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2463,"num_read_kb":2310,"num_write":552,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"263'158","reported_seq":764,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:14.856394+0000","last_change":"2024-09-12T17:10:42.526640+0000","last_active":"2024-09-12T18:09:14.856394+0000","last_peered":"2024-09-12T18:09:14.856394+0000","last_clean":"2024-09-12T18:09:14.856394+0000","last_became_active":"2024-09-12T17:10:42.526215+0000","last_became_peered":"2024-09-12T17:10:42.526215+0000","last_unstale":"2024-09-12T18:09:14.856394+0000","last_undegraded":"2024-09-12T18:09:14.856394+0000","last_fullsized":"2024-09-12T18:09:14.856394+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:44:21.141942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":254352,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":393,"num_read_kb":949,"num_write":838,"num_write_kb":19518,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,2],"acting":[7,4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":495,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:19.838876+0000","last_change":"2024-09-12T17:10:46.532883+0000","last_active":"2024-09-12T18:09:19.838876+0000","last_peered":"2024-09-12T18:09:19.838876+0000","last_clean":"2024-09-12T18:09:19.838876+0000","last_became_active":"2024-09-12T17:10:46.532552+0000","last_became_peered":"2024-09-12T17:10:46.532552+0000","last_unstale":"2024-09-12T18:09:19.838876+0000","last_undegraded":"2024-09-12T18:09:19.838876+0000","last_fullsized":"2024-09-12T18:09:19.838876+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_clean_scrub_stamp":"2024-09-12T17:10:45.504515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:25:38.578310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"263'129","reported_seq":696,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:09.778772+0000","last_change":"2024-09-12T17:10:48.543376+0000","last_active":"2024-09-12T18:11:09.778772+0000","last_peered":"2024-09-12T18:11:09.778772+0000","last_clean":"2024-09-12T18:11:09.778772+0000","last_became_active":"2024-09-12T17:10:48.542511+0000","last_became_peered":"2024-09-12T17:10:48.542511+0000","last_unstale":"2024-09-12T18:11:09.778772+0000","last_undegraded":"2024-09-12T18:11:09.778772+0000","last_fullsized":"2024-09-12T18:11:09.778772+0000","mapping_epoch":30,"log_start":"263'100","ondisk_log_start":"263'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_clean_scrub_stamp":"2024-09-12T17:10:47.516917+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:24:43.018761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28999,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":167,"num_read_kb":272,"num_write":90,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":489,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:24.839556+0000","last_change":"2024-09-12T17:10:50.560534+0000","last_active":"2024-09-12T18:07:24.839556+0000","last_peered":"2024-09-12T18:07:24.839556+0000","last_clean":"2024-09-12T18:07:24.839556+0000","last_became_active":"2024-09-12T17:10:50.560194+0000","last_became_peered":"2024-09-12T17:10:50.560194+0000","last_unstale":"2024-09-12T18:07:24.839556+0000","last_undegraded":"2024-09-12T18:07:24.839556+0000","last_fullsized":"2024-09-12T18:07:24.839556+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_clean_scrub_stamp":"2024-09-12T17:10:49.533772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:42:53.755387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"263'128","reported_seq":635,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:10:59.090392+0000","last_change":"2024-09-12T17:10:52.564665+0000","last_active":"2024-09-12T18:10:59.090392+0000","last_peered":"2024-09-12T18:10:59.090392+0000","last_clean":"2024-09-12T18:10:59.090392+0000","last_became_active":"2024-09-12T17:10:52.564350+0000","last_became_peered":"2024-09-12T17:10:52.564350+0000","last_unstale":"2024-09-12T18:10:59.090392+0000","last_undegraded":"2024-09-12T18:10:59.090392+0000","last_fullsized":"2024-09-12T18:10:59.090392+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:43:06.504654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":214,"num_read_kb":196,"num_write":321,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"263'437","reported_seq":1878,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:28.615548+0000","last_change":"2024-09-12T17:11:16.619027+0000","last_active":"2024-09-12T18:09:28.615548+0000","last_peered":"2024-09-12T18:09:28.615548+0000","last_clean":"2024-09-12T18:09:28.615548+0000","last_became_active":"2024-09-12T17:11:16.618699+0000","last_became_peered":"2024-09-12T17:11:16.618699+0000","last_unstale":"2024-09-12T18:09:28.615548+0000","last_undegraded":"2024-09-12T18:09:28.615548+0000","last_fullsized":"2024-09-12T18:09:28.615548+0000","mapping_epoch":37,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":400,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:55:15.584080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2161,"num_read_kb":2024,"num_write":504,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"263'213","reported_seq":841,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:14.856367+0000","last_change":"2024-09-12T17:10:42.526151+0000","last_active":"2024-09-12T18:09:14.856367+0000","last_peered":"2024-09-12T18:09:14.856367+0000","last_clean":"2024-09-12T18:09:14.856367+0000","last_became_active":"2024-09-12T17:10:42.525644+0000","last_became_peered":"2024-09-12T17:10:42.525644+0000","last_unstale":"2024-09-12T18:09:14.856367+0000","last_undegraded":"2024-09-12T18:09:14.856367+0000","last_fullsized":"2024-09-12T18:09:14.856367+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:06:11.915199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1626,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":478,"num_read_kb":1680,"num_write":1064,"num_write_kb":42245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4,6],"acting":[7,5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:19.838915+0000","last_change":"2024-09-12T17:10:46.532305+0000","last_active":"2024-09-12T18:09:19.838915+0000","last_peered":"2024-09-12T18:09:19.838915+0000","last_clean":"2024-09-12T18:09:19.838915+0000","last_became_active":"2024-09-12T17:10:46.531693+0000","last_became_peered":"2024-09-12T17:10:46.531693+0000","last_unstale":"2024-09-12T18:09:19.838915+0000","last_undegraded":"2024-09-12T18:09:19.838915+0000","last_fullsized":"2024-09-12T18:09:19.838915+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_clean_scrub_stamp":"2024-09-12T17:10:45.504515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:12:04.081227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"263'167","reported_seq":751,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:09.805504+0000","last_change":"2024-09-12T17:10:48.546368+0000","last_active":"2024-09-12T18:11:09.805504+0000","last_peered":"2024-09-12T18:11:09.805504+0000","last_clean":"2024-09-12T18:11:09.805504+0000","last_became_active":"2024-09-12T17:10:48.546013+0000","last_became_peered":"2024-09-12T17:10:48.546013+0000","last_unstale":"2024-09-12T18:11:09.805504+0000","last_undegraded":"2024-09-12T18:11:09.805504+0000","last_fullsized":"2024-09-12T18:11:09.805504+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_clean_scrub_stamp":"2024-09-12T17:10:47.516917+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":100,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:18:06.234698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23628,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":220,"num_read_kb":307,"num_write":126,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"263'773","reported_seq":2656,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:13.440534+0000","last_change":"2024-09-12T17:10:50.558001+0000","last_active":"2024-09-12T18:11:13.440534+0000","last_peered":"2024-09-12T18:11:13.440534+0000","last_clean":"2024-09-12T18:11:13.440534+0000","last_became_active":"2024-09-12T17:10:50.557711+0000","last_became_peered":"2024-09-12T17:10:50.557711+0000","last_unstale":"2024-09-12T18:11:13.440534+0000","last_undegraded":"2024-09-12T18:11:13.440534+0000","last_fullsized":"2024-09-12T18:11:13.440534+0000","mapping_epoch":32,"log_start":"263'700","ondisk_log_start":"263'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_clean_scrub_stamp":"2024-09-12T17:10:49.533772+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":700,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:36:55.165115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"263'103","reported_seq":598,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:08.674351+0000","last_change":"2024-09-12T17:10:52.570339+0000","last_active":"2024-09-12T18:11:08.674351+0000","last_peered":"2024-09-12T18:11:08.674351+0000","last_clean":"2024-09-12T18:11:08.674351+0000","last_became_active":"2024-09-12T17:10:52.570034+0000","last_became_peered":"2024-09-12T17:10:52.570034+0000","last_unstale":"2024-09-12T18:11:08.674351+0000","last_undegraded":"2024-09-12T18:11:08.674351+0000","last_fullsized":"2024-09-12T18:11:08.674351+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:58:19.680712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":442,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":109,"num_read_kb":107,"num_write":228,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"263'457","reported_seq":1986,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:20.794887+0000","last_change":"2024-09-12T17:10:44.520428+0000","last_active":"2024-09-12T18:09:20.794887+0000","last_peered":"2024-09-12T18:09:20.794887+0000","last_clean":"2024-09-12T18:09:20.794887+0000","last_became_active":"2024-09-12T17:10:44.520043+0000","last_became_peered":"2024-09-12T17:10:44.520043+0000","last_unstale":"2024-09-12T18:09:20.794887+0000","last_undegraded":"2024-09-12T18:09:20.794887+0000","last_fullsized":"2024-09-12T18:09:20.794887+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":400,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:50:49.324285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2352,"num_read_kb":2214,"num_write":541,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"263'203","reported_seq":846,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:03.355938+0000","last_change":"2024-09-12T17:10:42.518917+0000","last_active":"2024-09-12T18:11:03.355938+0000","last_peered":"2024-09-12T18:11:03.355938+0000","last_clean":"2024-09-12T18:11:03.355938+0000","last_became_active":"2024-09-12T17:10:42.518472+0000","last_became_peered":"2024-09-12T17:10:42.518472+0000","last_unstale":"2024-09-12T18:11:03.355938+0000","last_undegraded":"2024-09-12T18:11:03.355938+0000","last_fullsized":"2024-09-12T18:11:03.355938+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:04:25.809640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16056255,"num_objects":13,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":441,"num_read_kb":52953,"num_write":1070,"num_write_kb":38599,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6,1],"acting":[5,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":495,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:29.840076+0000","last_change":"2024-09-12T17:10:46.532109+0000","last_active":"2024-09-12T18:09:29.840076+0000","last_peered":"2024-09-12T18:09:29.840076+0000","last_clean":"2024-09-12T18:09:29.840076+0000","last_became_active":"2024-09-12T17:10:46.531731+0000","last_became_peered":"2024-09-12T17:10:46.531731+0000","last_unstale":"2024-09-12T18:09:29.840076+0000","last_undegraded":"2024-09-12T18:09:29.840076+0000","last_fullsized":"2024-09-12T18:09:29.840076+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_clean_scrub_stamp":"2024-09-12T17:10:45.504515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:24:44.405982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"263'193","reported_seq":822,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:09.807770+0000","last_change":"2024-09-12T17:10:48.544969+0000","last_active":"2024-09-12T18:11:09.807770+0000","last_peered":"2024-09-12T18:11:09.807770+0000","last_clean":"2024-09-12T18:11:09.807770+0000","last_became_active":"2024-09-12T17:10:48.544653+0000","last_became_peered":"2024-09-12T17:10:48.544653+0000","last_unstale":"2024-09-12T18:11:09.807770+0000","last_undegraded":"2024-09-12T18:11:09.807770+0000","last_fullsized":"2024-09-12T18:11:09.807770+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_clean_scrub_stamp":"2024-09-12T17:10:47.516917+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:21:32.100821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25151,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":268,"num_read_kb":346,"num_write":134,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":487,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:19.838895+0000","last_change":"2024-09-12T17:10:50.555835+0000","last_active":"2024-09-12T18:09:19.838895+0000","last_peered":"2024-09-12T18:09:19.838895+0000","last_clean":"2024-09-12T18:09:19.838895+0000","last_became_active":"2024-09-12T17:10:50.555473+0000","last_became_peered":"2024-09-12T17:10:50.555473+0000","last_unstale":"2024-09-12T18:09:19.838895+0000","last_undegraded":"2024-09-12T18:09:19.838895+0000","last_fullsized":"2024-09-12T18:09:19.838895+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_clean_scrub_stamp":"2024-09-12T17:10:49.533772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:12:27.311695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"263'116","reported_seq":625,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:47.539870+0000","last_change":"2024-09-12T17:10:52.571536+0000","last_active":"2024-09-12T18:09:47.539870+0000","last_peered":"2024-09-12T18:09:47.539870+0000","last_clean":"2024-09-12T18:09:47.539870+0000","last_became_active":"2024-09-12T17:10:52.571225+0000","last_became_peered":"2024-09-12T17:10:52.571225+0000","last_unstale":"2024-09-12T18:09:47.539870+0000","last_undegraded":"2024-09-12T18:09:47.539870+0000","last_fullsized":"2024-09-12T18:09:47.539870+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:45:48.500746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":910,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":137,"num_read_kb":136,"num_write":254,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"263'472","reported_seq":2087,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:14.856043+0000","last_change":"2024-09-12T17:10:44.516642+0000","last_active":"2024-09-12T18:09:14.856043+0000","last_peered":"2024-09-12T18:09:14.856043+0000","last_clean":"2024-09-12T18:09:14.856043+0000","last_became_active":"2024-09-12T17:10:44.516255+0000","last_became_peered":"2024-09-12T17:10:44.516255+0000","last_unstale":"2024-09-12T18:09:14.856043+0000","last_undegraded":"2024-09-12T18:09:14.856043+0000","last_fullsized":"2024-09-12T18:09:14.856043+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":400,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:45:40.739871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2470,"num_read_kb":2330,"num_write":539,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"263'212","reported_seq":832,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:14.852416+0000","last_change":"2024-09-12T17:11:16.863136+0000","last_active":"2024-09-12T18:09:14.852416+0000","last_peered":"2024-09-12T18:09:14.852416+0000","last_clean":"2024-09-12T18:09:14.852416+0000","last_became_active":"2024-09-12T17:11:16.862702+0000","last_became_peered":"2024-09-12T17:11:16.862702+0000","last_unstale":"2024-09-12T18:09:14.852416+0000","last_undegraded":"2024-09-12T18:09:14.852416+0000","last_fullsized":"2024-09-12T18:09:14.852416+0000","mapping_epoch":37,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:54:19.503253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1109560,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":408,"num_read_kb":1752,"num_write":1047,"num_write_kb":46733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,4,7],"acting":[3,2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:19.838954+0000","last_change":"2024-09-12T17:10:46.525024+0000","last_active":"2024-09-12T18:09:19.838954+0000","last_peered":"2024-09-12T18:09:19.838954+0000","last_clean":"2024-09-12T18:09:19.838954+0000","last_became_active":"2024-09-12T17:10:46.524638+0000","last_became_peered":"2024-09-12T17:10:46.524638+0000","last_unstale":"2024-09-12T18:09:19.838954+0000","last_undegraded":"2024-09-12T18:09:19.838954+0000","last_fullsized":"2024-09-12T18:09:19.838954+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_clean_scrub_stamp":"2024-09-12T17:10:45.504515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:56:22.494536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"263'147","reported_seq":727,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:09.784043+0000","last_change":"2024-09-12T17:10:48.538217+0000","last_active":"2024-09-12T18:11:09.784043+0000","last_peered":"2024-09-12T18:11:09.784043+0000","last_clean":"2024-09-12T18:11:09.784043+0000","last_became_active":"2024-09-12T17:10:48.537923+0000","last_became_peered":"2024-09-12T17:10:48.537923+0000","last_unstale":"2024-09-12T18:11:09.784043+0000","last_undegraded":"2024-09-12T18:11:09.784043+0000","last_fullsized":"2024-09-12T18:11:09.784043+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_clean_scrub_stamp":"2024-09-12T17:10:47.516917+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:47:18.538568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9067,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":220,"num_read_kb":274,"num_write":174,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:14.830207+0000","last_change":"2024-09-12T17:10:50.563850+0000","last_active":"2024-09-12T18:07:14.830207+0000","last_peered":"2024-09-12T18:07:14.830207+0000","last_clean":"2024-09-12T18:07:14.830207+0000","last_became_active":"2024-09-12T17:10:50.563507+0000","last_became_peered":"2024-09-12T17:10:50.563507+0000","last_unstale":"2024-09-12T18:07:14.830207+0000","last_undegraded":"2024-09-12T18:07:14.830207+0000","last_fullsized":"2024-09-12T18:07:14.830207+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_clean_scrub_stamp":"2024-09-12T17:10:49.533772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:17:57.223763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"263'126","reported_seq":641,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:10:59.093495+0000","last_change":"2024-09-12T17:10:52.575633+0000","last_active":"2024-09-12T18:10:59.093495+0000","last_peered":"2024-09-12T18:10:59.093495+0000","last_clean":"2024-09-12T18:10:59.093495+0000","last_became_active":"2024-09-12T17:10:52.575293+0000","last_became_peered":"2024-09-12T17:10:52.575293+0000","last_unstale":"2024-09-12T18:10:59.093495+0000","last_undegraded":"2024-09-12T18:10:59.093495+0000","last_fullsized":"2024-09-12T18:10:59.093495+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:49:40.030320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":248,"num_read_kb":220,"num_write":319,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"263'995","reported_seq":2615,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:20.793923+0000","last_change":"2024-09-12T17:10:44.515402+0000","last_active":"2024-09-12T18:09:20.793923+0000","last_peered":"2024-09-12T18:09:20.793923+0000","last_clean":"2024-09-12T18:09:20.793923+0000","last_became_active":"2024-09-12T17:10:44.515098+0000","last_became_peered":"2024-09-12T17:10:44.515098+0000","last_unstale":"2024-09-12T18:09:20.793923+0000","last_undegraded":"2024-09-12T18:09:20.793923+0000","last_fullsized":"2024-09-12T18:09:20.793923+0000","mapping_epoch":26,"log_start":"263'900","ondisk_log_start":"263'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":900,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:51:18.883813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4616,"num_read_kb":4072,"num_write":1360,"num_write_kb":579,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"263'207","reported_seq":848,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:01.160601+0000","last_change":"2024-09-12T17:10:42.516962+0000","last_active":"2024-09-12T18:11:01.160601+0000","last_peered":"2024-09-12T18:11:01.160601+0000","last_clean":"2024-09-12T18:11:01.160601+0000","last_became_active":"2024-09-12T17:10:42.515480+0000","last_became_peered":"2024-09-12T17:10:42.515480+0000","last_unstale":"2024-09-12T18:11:01.160601+0000","last_undegraded":"2024-09-12T18:11:01.160601+0000","last_fullsized":"2024-09-12T18:11:01.160601+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:25:04.587903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9630485,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":505,"num_read_kb":28749,"num_write":1018,"num_write_kb":24822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1,7],"acting":[6,4,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:20.149012+0000","last_change":"2024-09-12T17:10:46.532868+0000","last_active":"2024-09-12T18:09:20.149012+0000","last_peered":"2024-09-12T18:09:20.149012+0000","last_clean":"2024-09-12T18:09:20.149012+0000","last_became_active":"2024-09-12T17:10:46.532552+0000","last_became_peered":"2024-09-12T17:10:46.532552+0000","last_unstale":"2024-09-12T18:09:20.149012+0000","last_undegraded":"2024-09-12T18:09:20.149012+0000","last_fullsized":"2024-09-12T18:09:20.149012+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_clean_scrub_stamp":"2024-09-12T17:10:45.504515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:36:03.282217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"263'169","reported_seq":750,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:29.840156+0000","last_change":"2024-09-12T17:10:48.542688+0000","last_active":"2024-09-12T18:09:29.840156+0000","last_peered":"2024-09-12T18:09:29.840156+0000","last_clean":"2024-09-12T18:09:29.840156+0000","last_became_active":"2024-09-12T17:10:48.542298+0000","last_became_peered":"2024-09-12T17:10:48.542298+0000","last_unstale":"2024-09-12T18:09:29.840156+0000","last_undegraded":"2024-09-12T18:09:29.840156+0000","last_fullsized":"2024-09-12T18:09:29.840156+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_clean_scrub_stamp":"2024-09-12T17:10:47.516917+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":100,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:38:39.389352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11085,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":224,"num_read_kb":293,"num_write":130,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"263'744","reported_seq":2522,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:13.432722+0000","last_change":"2024-09-12T17:10:50.557593+0000","last_active":"2024-09-12T18:11:13.432722+0000","last_peered":"2024-09-12T18:11:13.432722+0000","last_clean":"2024-09-12T18:11:13.432722+0000","last_became_active":"2024-09-12T17:10:50.557305+0000","last_became_peered":"2024-09-12T17:10:50.557305+0000","last_unstale":"2024-09-12T18:11:13.432722+0000","last_undegraded":"2024-09-12T18:11:13.432722+0000","last_fullsized":"2024-09-12T18:11:13.432722+0000","mapping_epoch":32,"log_start":"263'700","ondisk_log_start":"263'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_clean_scrub_stamp":"2024-09-12T17:10:49.533772+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":700,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:44:08.055041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"263'117","reported_seq":624,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:47.542189+0000","last_change":"2024-09-12T17:10:52.571748+0000","last_active":"2024-09-12T18:09:47.542189+0000","last_peered":"2024-09-12T18:09:47.542189+0000","last_clean":"2024-09-12T18:09:47.542189+0000","last_became_active":"2024-09-12T17:10:52.571344+0000","last_became_peered":"2024-09-12T17:10:52.571344+0000","last_unstale":"2024-09-12T18:09:47.542189+0000","last_undegraded":"2024-09-12T18:09:47.542189+0000","last_fullsized":"2024-09-12T18:09:47.542189+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:19:07.103069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1852,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":171,"num_read_kb":161,"num_write":288,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"263'486","reported_seq":2153,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:48.689779+0000","last_change":"2024-09-12T17:10:44.509586+0000","last_active":"2024-09-12T18:09:48.689779+0000","last_peered":"2024-09-12T18:09:48.689779+0000","last_clean":"2024-09-12T18:09:48.689779+0000","last_became_active":"2024-09-12T17:10:44.509293+0000","last_became_peered":"2024-09-12T17:10:44.509293+0000","last_unstale":"2024-09-12T18:09:48.689779+0000","last_undegraded":"2024-09-12T18:09:48.689779+0000","last_fullsized":"2024-09-12T18:09:48.689779+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":400,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:13:03.024067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2823,"num_read_kb":2653,"num_write":584,"num_write_kb":143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"263'175","reported_seq":827,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:14.855892+0000","last_change":"2024-09-12T17:10:42.516188+0000","last_active":"2024-09-12T18:09:14.855892+0000","last_peered":"2024-09-12T18:09:14.855892+0000","last_clean":"2024-09-12T18:09:14.855892+0000","last_became_active":"2024-09-12T17:10:42.515196+0000","last_became_peered":"2024-09-12T17:10:42.515196+0000","last_unstale":"2024-09-12T18:09:14.855892+0000","last_undegraded":"2024-09-12T18:09:14.855892+0000","last_fullsized":"2024-09-12T18:09:14.855892+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:13:54.380139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17064424,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":430,"num_read_kb":72229,"num_write":818,"num_write_kb":40150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7,1],"acting":[4,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"29'2","reported_seq":1443,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:09.544515+0000","last_change":"2024-09-12T17:10:46.531378+0000","last_active":"2024-09-12T18:11:09.544515+0000","last_peered":"2024-09-12T18:11:09.544515+0000","last_clean":"2024-09-12T18:11:09.544515+0000","last_became_active":"2024-09-12T17:10:46.531032+0000","last_became_peered":"2024-09-12T17:10:46.531032+0000","last_unstale":"2024-09-12T18:11:09.544515+0000","last_undegraded":"2024-09-12T18:11:09.544515+0000","last_fullsized":"2024-09-12T18:11:09.544515+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_clean_scrub_stamp":"2024-09-12T17:10:45.504515+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:26:08.381916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":946,"num_read_kb":946,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"263'77","reported_seq":600,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:49.555526+0000","last_change":"2024-09-12T17:10:48.533130+0000","last_active":"2024-09-12T18:09:49.555526+0000","last_peered":"2024-09-12T18:09:49.555526+0000","last_clean":"2024-09-12T18:09:49.555526+0000","last_became_active":"2024-09-12T17:10:48.532817+0000","last_became_peered":"2024-09-12T17:10:48.532817+0000","last_unstale":"2024-09-12T18:09:49.555526+0000","last_undegraded":"2024-09-12T18:09:49.555526+0000","last_fullsized":"2024-09-12T18:09:49.555526+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_clean_scrub_stamp":"2024-09-12T17:10:47.516917+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:42:42.609184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":90,"num_read_kb":85,"num_write":60,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"263'760","reported_seq":2401,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:13.435039+0000","last_change":"2024-09-12T17:10:50.563515+0000","last_active":"2024-09-12T18:11:13.435039+0000","last_peered":"2024-09-12T18:11:13.435039+0000","last_clean":"2024-09-12T18:11:13.435039+0000","last_became_active":"2024-09-12T17:10:50.563002+0000","last_became_peered":"2024-09-12T17:10:50.563002+0000","last_unstale":"2024-09-12T18:11:13.435039+0000","last_undegraded":"2024-09-12T18:11:13.435039+0000","last_fullsized":"2024-09-12T18:11:13.435039+0000","mapping_epoch":32,"log_start":"263'700","ondisk_log_start":"263'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_clean_scrub_stamp":"2024-09-12T17:10:49.533772+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":700,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:11:41.362558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"263'147","reported_seq":647,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:14.855949+0000","last_change":"2024-09-12T17:10:52.571064+0000","last_active":"2024-09-12T18:09:14.855949+0000","last_peered":"2024-09-12T18:09:14.855949+0000","last_clean":"2024-09-12T18:09:14.855949+0000","last_became_active":"2024-09-12T17:10:52.570643+0000","last_became_peered":"2024-09-12T17:10:52.570643+0000","last_unstale":"2024-09-12T18:09:14.855949+0000","last_undegraded":"2024-09-12T18:09:14.855949+0000","last_fullsized":"2024-09-12T18:09:14.855949+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:37:26.966557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":160,"num_read_kb":158,"num_write":329,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"263'804","reported_seq":2283,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:08.688392+0000","last_change":"2024-09-12T17:10:44.518421+0000","last_active":"2024-09-12T18:11:08.688392+0000","last_peered":"2024-09-12T18:11:08.688392+0000","last_clean":"2024-09-12T18:11:08.688392+0000","last_became_active":"2024-09-12T17:10:44.518111+0000","last_became_peered":"2024-09-12T17:10:44.518111+0000","last_unstale":"2024-09-12T18:11:08.688392+0000","last_undegraded":"2024-09-12T18:11:08.688392+0000","last_fullsized":"2024-09-12T18:11:08.688392+0000","mapping_epoch":26,"log_start":"263'700","ondisk_log_start":"263'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":700,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:24:42.388720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3856,"num_read_kb":3439,"num_write":1073,"num_write_kb":406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"263'208","reported_seq":828,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:14.852297+0000","last_change":"2024-09-12T17:10:42.523388+0000","last_active":"2024-09-12T18:09:14.852297+0000","last_peered":"2024-09-12T18:09:14.852297+0000","last_clean":"2024-09-12T18:09:14.852297+0000","last_became_active":"2024-09-12T17:10:42.522669+0000","last_became_peered":"2024-09-12T17:10:42.522669+0000","last_unstale":"2024-09-12T18:09:14.852297+0000","last_undegraded":"2024-09-12T18:09:14.852297+0000","last_fullsized":"2024-09-12T18:09:14.852297+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:12:18.298215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24007,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":433,"num_read_kb":8704,"num_write":948,"num_write_kb":27929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,4],"acting":[3,1,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":504,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:19.856844+0000","last_change":"2024-09-12T17:10:46.533907+0000","last_active":"2024-09-12T18:09:19.856844+0000","last_peered":"2024-09-12T18:09:19.856844+0000","last_clean":"2024-09-12T18:09:19.856844+0000","last_became_active":"2024-09-12T17:10:46.533572+0000","last_became_peered":"2024-09-12T17:10:46.533572+0000","last_unstale":"2024-09-12T18:09:19.856844+0000","last_undegraded":"2024-09-12T18:09:19.856844+0000","last_fullsized":"2024-09-12T18:09:19.856844+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_clean_scrub_stamp":"2024-09-12T17:10:45.504515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:00:02.576654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"263'242","reported_seq":848,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:09.799469+0000","last_change":"2024-09-12T17:10:48.543041+0000","last_active":"2024-09-12T18:11:09.799469+0000","last_peered":"2024-09-12T18:11:09.799469+0000","last_clean":"2024-09-12T18:11:09.799469+0000","last_became_active":"2024-09-12T17:10:48.542616+0000","last_became_peered":"2024-09-12T17:10:48.542616+0000","last_unstale":"2024-09-12T18:11:09.799469+0000","last_undegraded":"2024-09-12T18:11:09.799469+0000","last_fullsized":"2024-09-12T18:11:09.799469+0000","mapping_epoch":30,"log_start":"263'200","ondisk_log_start":"263'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_clean_scrub_stamp":"2024-09-12T17:10:47.516917+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":200,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:45:45.261917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11660,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":924,"num_read_kb":982,"num_write":1452,"num_write_kb":1312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":490,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:19.876828+0000","last_change":"2024-09-12T17:10:50.550499+0000","last_active":"2024-09-12T18:09:19.876828+0000","last_peered":"2024-09-12T18:09:19.876828+0000","last_clean":"2024-09-12T18:09:19.876828+0000","last_became_active":"2024-09-12T17:10:50.550189+0000","last_became_peered":"2024-09-12T17:10:50.550189+0000","last_unstale":"2024-09-12T18:09:19.876828+0000","last_undegraded":"2024-09-12T18:09:19.876828+0000","last_fullsized":"2024-09-12T18:09:19.876828+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_clean_scrub_stamp":"2024-09-12T17:10:49.533772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:28:44.908753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"263'162","reported_seq":671,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:08.680270+0000","last_change":"2024-09-12T17:10:52.572806+0000","last_active":"2024-09-12T18:11:08.680270+0000","last_peered":"2024-09-12T18:11:08.680270+0000","last_clean":"2024-09-12T18:11:08.680270+0000","last_became_active":"2024-09-12T17:10:52.572508+0000","last_became_peered":"2024-09-12T17:10:52.572508+0000","last_unstale":"2024-09-12T18:11:08.680270+0000","last_undegraded":"2024-09-12T18:11:08.680270+0000","last_fullsized":"2024-09-12T18:11:08.680270+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:47:56.176805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":869,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":242,"num_read_kb":227,"num_write":399,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"263'2313","reported_seq":3926,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:14.876101+0000","last_change":"2024-09-12T17:10:44.515810+0000","last_active":"2024-09-12T18:09:14.876101+0000","last_peered":"2024-09-12T18:09:14.876101+0000","last_clean":"2024-09-12T18:09:14.876101+0000","last_became_active":"2024-09-12T17:10:44.515045+0000","last_became_peered":"2024-09-12T17:10:44.515045+0000","last_unstale":"2024-09-12T18:09:14.876101+0000","last_undegraded":"2024-09-12T18:09:14.876101+0000","last_fullsized":"2024-09-12T18:09:14.876101+0000","mapping_epoch":26,"log_start":"263'2300","ondisk_log_start":"263'2300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":2300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:30:23.918147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10108,"num_read_kb":8675,"num_write":3400,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":612,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:39.851461+0000","last_change":"2024-09-12T17:10:26.808302+0000","last_active":"2024-09-12T18:08:39.851461+0000","last_peered":"2024-09-12T18:08:39.851461+0000","last_clean":"2024-09-12T18:08:39.851461+0000","last_became_active":"2024-09-12T17:10:26.807964+0000","last_became_peered":"2024-09-12T17:10:26.807964+0000","last_unstale":"2024-09-12T18:08:39.851461+0000","last_undegraded":"2024-09-12T18:08:39.851461+0000","last_fullsized":"2024-09-12T18:08:39.851461+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:25.795895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:25.795895+0000","last_clean_scrub_stamp":"2024-09-12T17:10:25.795895+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:28:36.202819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":524,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:54.852285+0000","last_change":"2024-09-12T17:10:33.852086+0000","last_active":"2024-09-12T18:08:54.852285+0000","last_peered":"2024-09-12T18:08:54.852285+0000","last_clean":"2024-09-12T18:08:54.852285+0000","last_became_active":"2024-09-12T17:10:31.846572+0000","last_became_peered":"2024-09-12T17:10:31.846572+0000","last_unstale":"2024-09-12T18:08:54.852285+0000","last_undegraded":"2024-09-12T18:08:54.852285+0000","last_fullsized":"2024-09-12T18:08:54.852285+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:30.818274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:30.818274+0000","last_clean_scrub_stamp":"2024-09-12T17:10:30.818274+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:56:58.387797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060306800000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"263'224","reported_seq":845,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:04.850991+0000","last_change":"2024-09-12T17:10:42.527885+0000","last_active":"2024-09-12T18:09:04.850991+0000","last_peered":"2024-09-12T18:09:04.850991+0000","last_clean":"2024-09-12T18:09:04.850991+0000","last_became_active":"2024-09-12T17:10:42.527288+0000","last_became_peered":"2024-09-12T17:10:42.527288+0000","last_unstale":"2024-09-12T18:09:04.850991+0000","last_undegraded":"2024-09-12T18:09:04.850991+0000","last_fullsized":"2024-09-12T18:09:04.850991+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":200,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:57:55.754980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5594817,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":421,"num_read_kb":3487,"num_write":1106,"num_write_kb":42610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6,4],"acting":[3,5,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"36'3","reported_seq":974,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:09.761135+0000","last_change":"2024-09-12T17:10:46.523567+0000","last_active":"2024-09-12T18:11:09.761135+0000","last_peered":"2024-09-12T18:11:09.761135+0000","last_clean":"2024-09-12T18:11:09.761135+0000","last_became_active":"2024-09-12T17:10:46.523069+0000","last_became_peered":"2024-09-12T17:10:46.523069+0000","last_unstale":"2024-09-12T18:11:09.761135+0000","last_undegraded":"2024-09-12T18:11:09.761135+0000","last_fullsized":"2024-09-12T18:11:09.761135+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_clean_scrub_stamp":"2024-09-12T17:10:45.504515+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:25:47.639083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":719,"num_read_kb":717,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"263'307","reported_seq":996,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:09.813067+0000","last_change":"2024-09-12T17:10:48.542799+0000","last_active":"2024-09-12T18:11:09.813067+0000","last_peered":"2024-09-12T18:11:09.813067+0000","last_clean":"2024-09-12T18:11:09.813067+0000","last_became_active":"2024-09-12T17:10:48.542462+0000","last_became_peered":"2024-09-12T17:10:48.542462+0000","last_unstale":"2024-09-12T18:11:09.813067+0000","last_undegraded":"2024-09-12T18:11:09.813067+0000","last_fullsized":"2024-09-12T18:11:09.813067+0000","mapping_epoch":30,"log_start":"260'200","ondisk_log_start":"260'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_clean_scrub_stamp":"2024-09-12T17:10:47.516917+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:44:47.123605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45201,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":584,"num_read_kb":807,"num_write":556,"num_write_kb":431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:19.845378+0000","last_change":"2024-09-12T17:10:50.558413+0000","last_active":"2024-09-12T18:09:19.845378+0000","last_peered":"2024-09-12T18:09:19.845378+0000","last_clean":"2024-09-12T18:09:19.845378+0000","last_became_active":"2024-09-12T17:10:50.558129+0000","last_became_peered":"2024-09-12T17:10:50.558129+0000","last_unstale":"2024-09-12T18:09:19.845378+0000","last_undegraded":"2024-09-12T18:09:19.845378+0000","last_fullsized":"2024-09-12T18:09:19.845378+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_clean_scrub_stamp":"2024-09-12T17:10:49.533772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:10:19.749294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"263'213","reported_seq":930,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:49.576469+0000","last_change":"2024-09-12T17:10:52.574735+0000","last_active":"2024-09-12T18:09:49.576469+0000","last_peered":"2024-09-12T18:09:49.576469+0000","last_clean":"2024-09-12T18:09:49.576469+0000","last_became_active":"2024-09-12T17:10:52.574433+0000","last_became_peered":"2024-09-12T17:10:52.574433+0000","last_unstale":"2024-09-12T18:09:49.576469+0000","last_undegraded":"2024-09-12T18:09:49.576469+0000","last_fullsized":"2024-09-12T18:09:49.576469+0000","mapping_epoch":34,"log_start":"263'200","ondisk_log_start":"263'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:43:52.722409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":852,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":555,"num_read_kb":537,"num_write":455,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"263'582","reported_seq":2168,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:14.844578+0000","last_change":"2024-09-12T17:10:44.520786+0000","last_active":"2024-09-12T18:09:14.844578+0000","last_peered":"2024-09-12T18:09:14.844578+0000","last_clean":"2024-09-12T18:09:14.844578+0000","last_became_active":"2024-09-12T17:10:44.520484+0000","last_became_peered":"2024-09-12T17:10:44.520484+0000","last_unstale":"2024-09-12T18:09:14.844578+0000","last_undegraded":"2024-09-12T18:09:14.844578+0000","last_fullsized":"2024-09-12T18:09:14.844578+0000","mapping_epoch":26,"log_start":"263'500","ondisk_log_start":"263'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":500,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:09:07.335121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3105,"num_read_kb":2836,"num_write":745,"num_write_kb":252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":520,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:44.852139+0000","last_change":"2024-09-12T17:10:33.955353+0000","last_active":"2024-09-12T18:08:44.852139+0000","last_peered":"2024-09-12T18:08:44.852139+0000","last_clean":"2024-09-12T18:08:44.852139+0000","last_became_active":"2024-09-12T17:10:31.848972+0000","last_became_peered":"2024-09-12T17:10:31.848972+0000","last_unstale":"2024-09-12T18:08:44.852139+0000","last_undegraded":"2024-09-12T18:08:44.852139+0000","last_fullsized":"2024-09-12T18:08:44.852139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:30.818274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:30.818274+0000","last_clean_scrub_stamp":"2024-09-12T17:10:30.818274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:42:53.392909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054881099999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"263'244","reported_seq":889,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:04.843177+0000","last_change":"2024-09-12T17:10:42.518587+0000","last_active":"2024-09-12T18:09:04.843177+0000","last_peered":"2024-09-12T18:09:04.843177+0000","last_clean":"2024-09-12T18:09:04.843177+0000","last_became_active":"2024-09-12T17:10:42.518190+0000","last_became_peered":"2024-09-12T17:10:42.518190+0000","last_unstale":"2024-09-12T18:09:04.843177+0000","last_undegraded":"2024-09-12T18:09:04.843177+0000","last_fullsized":"2024-09-12T18:09:04.843177+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":200,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:06:38.991314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10490388,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":519,"num_read_kb":6824,"num_write":1146,"num_write_kb":47378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3,5],"acting":[0,4,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:19.856009+0000","last_change":"2024-09-12T17:10:46.528521+0000","last_active":"2024-09-12T18:09:19.856009+0000","last_peered":"2024-09-12T18:09:19.856009+0000","last_clean":"2024-09-12T18:09:19.856009+0000","last_became_active":"2024-09-12T17:10:46.528192+0000","last_became_peered":"2024-09-12T17:10:46.528192+0000","last_unstale":"2024-09-12T18:09:19.856009+0000","last_undegraded":"2024-09-12T18:09:19.856009+0000","last_fullsized":"2024-09-12T18:09:19.856009+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_clean_scrub_stamp":"2024-09-12T17:10:45.504515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:16:33.943407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"263'863","reported_seq":2511,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:13.396596+0000","last_change":"2024-09-12T17:10:48.545160+0000","last_active":"2024-09-12T18:11:13.396596+0000","last_peered":"2024-09-12T18:11:13.396596+0000","last_clean":"2024-09-12T18:11:13.396596+0000","last_became_active":"2024-09-12T17:10:48.544823+0000","last_became_peered":"2024-09-12T17:10:48.544823+0000","last_unstale":"2024-09-12T18:11:13.396596+0000","last_undegraded":"2024-09-12T18:11:13.396596+0000","last_fullsized":"2024-09-12T18:11:13.396596+0000","mapping_epoch":30,"log_start":"263'800","ondisk_log_start":"263'800","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_clean_scrub_stamp":"2024-09-12T17:10:47.516917+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":800,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:10:40.793586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27599,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1167,"num_read_kb":1295,"num_write":300,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":489,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:19.857221+0000","last_change":"2024-09-12T17:10:50.557996+0000","last_active":"2024-09-12T18:09:19.857221+0000","last_peered":"2024-09-12T18:09:19.857221+0000","last_clean":"2024-09-12T18:09:19.857221+0000","last_became_active":"2024-09-12T17:10:50.557660+0000","last_became_peered":"2024-09-12T17:10:50.557660+0000","last_unstale":"2024-09-12T18:09:19.857221+0000","last_undegraded":"2024-09-12T18:09:19.857221+0000","last_fullsized":"2024-09-12T18:09:19.857221+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_clean_scrub_stamp":"2024-09-12T17:10:49.533772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:34:55.114972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"263'187","reported_seq":753,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:49.249649+0000","last_change":"2024-09-12T17:10:52.671428+0000","last_active":"2024-09-12T18:09:49.249649+0000","last_peered":"2024-09-12T18:09:49.249649+0000","last_clean":"2024-09-12T18:09:49.249649+0000","last_became_active":"2024-09-12T17:10:52.671120+0000","last_became_peered":"2024-09-12T17:10:52.671120+0000","last_unstale":"2024-09-12T18:09:49.249649+0000","last_undegraded":"2024-09-12T18:09:49.249649+0000","last_fullsized":"2024-09-12T18:09:49.249649+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:54:33.827731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":855,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":437,"num_read_kb":369,"num_write":356,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"263'338","reported_seq":1688,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:15.148495+0000","last_change":"2024-09-12T17:10:44.516968+0000","last_active":"2024-09-12T18:09:15.148495+0000","last_peered":"2024-09-12T18:09:15.148495+0000","last_clean":"2024-09-12T18:09:15.148495+0000","last_became_active":"2024-09-12T17:10:44.516640+0000","last_became_peered":"2024-09-12T17:10:44.516640+0000","last_unstale":"2024-09-12T18:09:15.148495+0000","last_undegraded":"2024-09-12T18:09:15.148495+0000","last_fullsized":"2024-09-12T18:09:15.148495+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:49:32.830701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1748,"num_read_kb":1673,"num_write":375,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":519,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:54.836450+0000","last_change":"2024-09-12T17:10:34.162797+0000","last_active":"2024-09-12T18:08:54.836450+0000","last_peered":"2024-09-12T18:08:54.836450+0000","last_clean":"2024-09-12T18:08:54.836450+0000","last_became_active":"2024-09-12T17:10:31.841982+0000","last_became_peered":"2024-09-12T17:10:31.841982+0000","last_unstale":"2024-09-12T18:08:54.836450+0000","last_undegraded":"2024-09-12T18:08:54.836450+0000","last_fullsized":"2024-09-12T18:08:54.836450+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:30.818274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:30.818274+0000","last_clean_scrub_stamp":"2024-09-12T17:10:30.818274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:00:41.985746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00030998799999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"263'164","reported_seq":779,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:50.145702+0000","last_change":"2024-09-12T17:10:42.509801+0000","last_active":"2024-09-12T18:08:50.145702+0000","last_peered":"2024-09-12T18:08:50.145702+0000","last_clean":"2024-09-12T18:08:50.145702+0000","last_became_active":"2024-09-12T17:10:42.509396+0000","last_became_peered":"2024-09-12T17:10:42.509396+0000","last_unstale":"2024-09-12T18:08:50.145702+0000","last_undegraded":"2024-09-12T18:08:50.145702+0000","last_fullsized":"2024-09-12T18:08:50.145702+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":100,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:19:48.419548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5624297,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":375,"num_read_kb":11016,"num_write":841,"num_write_kb":10341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6,5],"acting":[1,2,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"29'1","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:19.838982+0000","last_change":"2024-09-12T17:10:46.529416+0000","last_active":"2024-09-12T18:09:19.838982+0000","last_peered":"2024-09-12T18:09:19.838982+0000","last_clean":"2024-09-12T18:09:19.838982+0000","last_became_active":"2024-09-12T17:10:46.528878+0000","last_became_peered":"2024-09-12T17:10:46.528878+0000","last_unstale":"2024-09-12T18:09:19.838982+0000","last_undegraded":"2024-09-12T18:09:19.838982+0000","last_fullsized":"2024-09-12T18:09:19.838982+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_clean_scrub_stamp":"2024-09-12T17:10:45.504515+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:07:39.857190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"263'250","reported_seq":1512,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:09.987483+0000","last_change":"2024-09-12T17:10:48.544016+0000","last_active":"2024-09-12T18:11:09.987483+0000","last_peered":"2024-09-12T18:11:09.987483+0000","last_clean":"2024-09-12T18:11:09.987483+0000","last_became_active":"2024-09-12T17:10:48.543196+0000","last_became_peered":"2024-09-12T17:10:48.543196+0000","last_unstale":"2024-09-12T18:11:09.987483+0000","last_undegraded":"2024-09-12T18:11:09.987483+0000","last_fullsized":"2024-09-12T18:11:09.987483+0000","mapping_epoch":30,"log_start":"263'200","ondisk_log_start":"263'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_clean_scrub_stamp":"2024-09-12T17:10:47.516917+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":200,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:18:29.037042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":209,"num_read_kb":201,"num_write":185,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":495,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:09.843829+0000","last_change":"2024-09-12T17:10:50.559244+0000","last_active":"2024-09-12T18:09:09.843829+0000","last_peered":"2024-09-12T18:09:09.843829+0000","last_clean":"2024-09-12T18:09:09.843829+0000","last_became_active":"2024-09-12T17:10:50.558980+0000","last_became_peered":"2024-09-12T17:10:50.558980+0000","last_unstale":"2024-09-12T18:09:09.843829+0000","last_undegraded":"2024-09-12T18:09:09.843829+0000","last_fullsized":"2024-09-12T18:09:09.843829+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_clean_scrub_stamp":"2024-09-12T17:10:49.533772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:56:03.520861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"263'256","reported_seq":854,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:49.824162+0000","last_change":"2024-09-12T17:10:52.564338+0000","last_active":"2024-09-12T18:09:49.824162+0000","last_peered":"2024-09-12T18:09:49.824162+0000","last_clean":"2024-09-12T18:09:49.824162+0000","last_became_active":"2024-09-12T17:10:52.563885+0000","last_became_peered":"2024-09-12T17:10:52.563885+0000","last_unstale":"2024-09-12T18:09:49.824162+0000","last_undegraded":"2024-09-12T18:09:49.824162+0000","last_fullsized":"2024-09-12T18:09:49.824162+0000","mapping_epoch":34,"log_start":"263'200","ondisk_log_start":"263'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":200,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:12:03.079469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":520,"num_read_kb":542,"num_write":569,"num_write_kb":161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"263'664","reported_seq":2208,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:05.147309+0000","last_change":"2024-09-12T17:10:44.516073+0000","last_active":"2024-09-12T18:09:05.147309+0000","last_peered":"2024-09-12T18:09:05.147309+0000","last_clean":"2024-09-12T18:09:05.147309+0000","last_became_active":"2024-09-12T17:10:44.515807+0000","last_became_peered":"2024-09-12T17:10:44.515807+0000","last_unstale":"2024-09-12T18:09:05.147309+0000","last_undegraded":"2024-09-12T18:09:05.147309+0000","last_fullsized":"2024-09-12T18:09:05.147309+0000","mapping_epoch":26,"log_start":"263'600","ondisk_log_start":"263'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":600,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:25:36.561047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3415,"num_read_kb":3057,"num_write":984,"num_write_kb":466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":525,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:54.852239+0000","last_change":"2024-09-12T17:10:33.852654+0000","last_active":"2024-09-12T18:08:54.852239+0000","last_peered":"2024-09-12T18:08:54.852239+0000","last_clean":"2024-09-12T18:08:54.852239+0000","last_became_active":"2024-09-12T17:10:31.849085+0000","last_became_peered":"2024-09-12T17:10:31.849085+0000","last_unstale":"2024-09-12T18:08:54.852239+0000","last_undegraded":"2024-09-12T18:08:54.852239+0000","last_fullsized":"2024-09-12T18:08:54.852239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:30.818274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:30.818274+0000","last_clean_scrub_stamp":"2024-09-12T17:10:30.818274+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:06:13.863048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011727,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"263'229","reported_seq":920,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:04.854500+0000","last_change":"2024-09-12T17:10:42.529838+0000","last_active":"2024-09-12T18:09:04.854500+0000","last_peered":"2024-09-12T18:09:04.854500+0000","last_clean":"2024-09-12T18:09:04.854500+0000","last_became_active":"2024-09-12T17:10:42.529499+0000","last_became_peered":"2024-09-12T17:10:42.529499+0000","last_unstale":"2024-09-12T18:09:04.854500+0000","last_undegraded":"2024-09-12T18:09:04.854500+0000","last_fullsized":"2024-09-12T18:09:04.854500+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":200,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:16:13.720843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":310931,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":562,"num_read_kb":10247,"num_write":1097,"num_write_kb":30448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,6],"acting":[4,5,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":503,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:19.845346+0000","last_change":"2024-09-12T17:10:46.526726+0000","last_active":"2024-09-12T18:09:19.845346+0000","last_peered":"2024-09-12T18:09:19.845346+0000","last_clean":"2024-09-12T18:09:19.845346+0000","last_became_active":"2024-09-12T17:10:46.526136+0000","last_became_peered":"2024-09-12T17:10:46.526136+0000","last_unstale":"2024-09-12T18:09:19.845346+0000","last_undegraded":"2024-09-12T18:09:19.845346+0000","last_fullsized":"2024-09-12T18:09:19.845346+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_clean_scrub_stamp":"2024-09-12T17:10:45.504515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:44:29.040188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"263'139","reported_seq":685,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:09.997112+0000","last_change":"2024-09-12T17:10:48.536587+0000","last_active":"2024-09-12T18:11:09.997112+0000","last_peered":"2024-09-12T18:11:09.997112+0000","last_clean":"2024-09-12T18:11:09.997112+0000","last_became_active":"2024-09-12T17:10:48.536247+0000","last_became_peered":"2024-09-12T17:10:48.536247+0000","last_unstale":"2024-09-12T18:11:09.997112+0000","last_undegraded":"2024-09-12T18:11:09.997112+0000","last_fullsized":"2024-09-12T18:11:09.997112+0000","mapping_epoch":30,"log_start":"263'100","ondisk_log_start":"263'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_clean_scrub_stamp":"2024-09-12T17:10:47.516917+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:26:17.588873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":163,"num_read_kb":156,"num_write":120,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":491,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:19.876894+0000","last_change":"2024-09-12T17:10:50.556253+0000","last_active":"2024-09-12T18:09:19.876894+0000","last_peered":"2024-09-12T18:09:19.876894+0000","last_clean":"2024-09-12T18:09:19.876894+0000","last_became_active":"2024-09-12T17:10:50.555747+0000","last_became_peered":"2024-09-12T17:10:50.555747+0000","last_unstale":"2024-09-12T18:09:19.876894+0000","last_undegraded":"2024-09-12T18:09:19.876894+0000","last_fullsized":"2024-09-12T18:09:19.876894+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_clean_scrub_stamp":"2024-09-12T17:10:49.533772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:17:05.525534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"263'122","reported_seq":667,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:24.858258+0000","last_change":"2024-09-12T17:10:52.575248+0000","last_active":"2024-09-12T18:09:24.858258+0000","last_peered":"2024-09-12T18:09:24.858258+0000","last_clean":"2024-09-12T18:09:24.858258+0000","last_became_active":"2024-09-12T17:10:52.574956+0000","last_became_peered":"2024-09-12T17:10:52.574956+0000","last_unstale":"2024-09-12T18:09:24.858258+0000","last_undegraded":"2024-09-12T18:09:24.858258+0000","last_fullsized":"2024-09-12T18:09:24.858258+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:35:51.476345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":427,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":242,"num_read_kb":241,"num_write":285,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"263'471","reported_seq":2077,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:08.688603+0000","last_change":"2024-09-12T17:10:44.516554+0000","last_active":"2024-09-12T18:11:08.688603+0000","last_peered":"2024-09-12T18:11:08.688603+0000","last_clean":"2024-09-12T18:11:08.688603+0000","last_became_active":"2024-09-12T17:10:44.516258+0000","last_became_peered":"2024-09-12T17:10:44.516258+0000","last_unstale":"2024-09-12T18:11:08.688603+0000","last_undegraded":"2024-09-12T18:11:08.688603+0000","last_fullsized":"2024-09-12T18:11:08.688603+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":400,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:22:51.498940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2512,"num_read_kb":2369,"num_write":577,"num_write_kb":149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"263'179","reported_seq":878,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:19.855946+0000","last_change":"2024-09-12T17:10:42.521202+0000","last_active":"2024-09-12T18:09:19.855946+0000","last_peered":"2024-09-12T18:09:19.855946+0000","last_clean":"2024-09-12T18:09:19.855946+0000","last_became_active":"2024-09-12T17:10:42.520777+0000","last_became_peered":"2024-09-12T17:10:42.520777+0000","last_unstale":"2024-09-12T18:09:19.855946+0000","last_undegraded":"2024-09-12T18:09:19.855946+0000","last_fullsized":"2024-09-12T18:09:19.855946+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:17:55.542119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5297338,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":571,"num_read_kb":36969,"num_write":893,"num_write_kb":42705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":529,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:55.146233+0000","last_change":"2024-09-12T17:10:33.854505+0000","last_active":"2024-09-12T18:08:55.146233+0000","last_peered":"2024-09-12T18:08:55.146233+0000","last_clean":"2024-09-12T18:08:55.146233+0000","last_became_active":"2024-09-12T17:10:32.177463+0000","last_became_peered":"2024-09-12T17:10:32.177463+0000","last_unstale":"2024-09-12T18:08:55.146233+0000","last_undegraded":"2024-09-12T18:08:55.146233+0000","last_fullsized":"2024-09-12T18:08:55.146233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:30.818274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:30.818274+0000","last_clean_scrub_stamp":"2024-09-12T17:10:30.818274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:37:29.735097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059857599999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":503,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:09.843813+0000","last_change":"2024-09-12T17:10:46.528815+0000","last_active":"2024-09-12T18:09:09.843813+0000","last_peered":"2024-09-12T18:09:09.843813+0000","last_clean":"2024-09-12T18:09:09.843813+0000","last_became_active":"2024-09-12T17:10:46.528499+0000","last_became_peered":"2024-09-12T17:10:46.528499+0000","last_unstale":"2024-09-12T18:09:09.843813+0000","last_undegraded":"2024-09-12T18:09:09.843813+0000","last_fullsized":"2024-09-12T18:09:09.843813+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_clean_scrub_stamp":"2024-09-12T17:10:45.504515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:46:42.455244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"263'269","reported_seq":933,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:09.793120+0000","last_change":"2024-09-12T17:10:48.540277+0000","last_active":"2024-09-12T18:11:09.793120+0000","last_peered":"2024-09-12T18:11:09.793120+0000","last_clean":"2024-09-12T18:11:09.793120+0000","last_became_active":"2024-09-12T17:10:48.539913+0000","last_became_peered":"2024-09-12T17:10:48.539913+0000","last_unstale":"2024-09-12T18:11:09.793120+0000","last_undegraded":"2024-09-12T18:11:09.793120+0000","last_fullsized":"2024-09-12T18:11:09.793120+0000","mapping_epoch":30,"log_start":"260'200","ondisk_log_start":"260'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_clean_scrub_stamp":"2024-09-12T17:10:47.516917+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:02:55.603063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15979,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":372,"num_read_kb":444,"num_write":214,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":498,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:09.855203+0000","last_change":"2024-09-12T17:10:50.555362+0000","last_active":"2024-09-12T18:09:09.855203+0000","last_peered":"2024-09-12T18:09:09.855203+0000","last_clean":"2024-09-12T18:09:09.855203+0000","last_became_active":"2024-09-12T17:10:50.555068+0000","last_became_peered":"2024-09-12T17:10:50.555068+0000","last_unstale":"2024-09-12T18:09:09.855203+0000","last_undegraded":"2024-09-12T18:09:09.855203+0000","last_fullsized":"2024-09-12T18:09:09.855203+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_clean_scrub_stamp":"2024-09-12T17:10:49.533772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:07:39.703527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"263'153","reported_seq":659,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:46.594011+0000","last_change":"2024-09-12T17:10:52.671530+0000","last_active":"2024-09-12T18:09:46.594011+0000","last_peered":"2024-09-12T18:09:46.594011+0000","last_clean":"2024-09-12T18:09:46.594011+0000","last_became_active":"2024-09-12T17:10:52.671238+0000","last_became_peered":"2024-09-12T17:10:52.671238+0000","last_unstale":"2024-09-12T18:09:46.594011+0000","last_undegraded":"2024-09-12T18:09:46.594011+0000","last_fullsized":"2024-09-12T18:09:46.594011+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:56:27.646939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":925,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":183,"num_read_kb":179,"num_write":356,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"263'539","reported_seq":2231,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:49.548593+0000","last_change":"2024-09-12T17:10:44.513894+0000","last_active":"2024-09-12T18:09:49.548593+0000","last_peered":"2024-09-12T18:09:49.548593+0000","last_clean":"2024-09-12T18:09:49.548593+0000","last_became_active":"2024-09-12T17:10:44.513543+0000","last_became_peered":"2024-09-12T17:10:44.513543+0000","last_unstale":"2024-09-12T18:09:49.548593+0000","last_undegraded":"2024-09-12T18:09:49.548593+0000","last_fullsized":"2024-09-12T18:09:49.548593+0000","mapping_epoch":26,"log_start":"263'500","ondisk_log_start":"263'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":500,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:52:06.056418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3000,"num_read_kb":2785,"num_write":670,"num_write_kb":215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"263'211","reported_seq":890,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:05.147290+0000","last_change":"2024-09-12T17:10:42.524565+0000","last_active":"2024-09-12T18:09:05.147290+0000","last_peered":"2024-09-12T18:09:05.147290+0000","last_clean":"2024-09-12T18:09:05.147290+0000","last_became_active":"2024-09-12T17:10:42.524130+0000","last_became_peered":"2024-09-12T17:10:42.524130+0000","last_unstale":"2024-09-12T18:09:05.147290+0000","last_undegraded":"2024-09-12T18:09:05.147290+0000","last_fullsized":"2024-09-12T18:09:05.147290+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:41:13.724342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12701364,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":583,"num_read_kb":68430,"num_write":1037,"num_write_kb":36992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,5],"acting":[1,2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":519,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:04.854964+0000","last_change":"2024-09-12T17:10:33.955366+0000","last_active":"2024-09-12T18:09:04.854964+0000","last_peered":"2024-09-12T18:09:04.854964+0000","last_clean":"2024-09-12T18:09:04.854964+0000","last_became_active":"2024-09-12T17:10:32.177457+0000","last_became_peered":"2024-09-12T17:10:32.177457+0000","last_unstale":"2024-09-12T18:09:04.854964+0000","last_undegraded":"2024-09-12T18:09:04.854964+0000","last_fullsized":"2024-09-12T18:09:04.854964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:30.818274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:30.818274+0000","last_clean_scrub_stamp":"2024-09-12T17:10:30.818274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:40:39.661808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000468751,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":500,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:09.875290+0000","last_change":"2024-09-12T17:10:46.527702+0000","last_active":"2024-09-12T18:09:09.875290+0000","last_peered":"2024-09-12T18:09:09.875290+0000","last_clean":"2024-09-12T18:09:09.875290+0000","last_became_active":"2024-09-12T17:10:46.527299+0000","last_became_peered":"2024-09-12T17:10:46.527299+0000","last_unstale":"2024-09-12T18:09:09.875290+0000","last_undegraded":"2024-09-12T18:09:09.875290+0000","last_fullsized":"2024-09-12T18:09:09.875290+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_clean_scrub_stamp":"2024-09-12T17:10:45.504515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:20:28.139339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"263'234","reported_seq":808,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:58.608748+0000","last_change":"2024-09-12T17:10:48.539230+0000","last_active":"2024-09-12T18:09:58.608748+0000","last_peered":"2024-09-12T18:09:58.608748+0000","last_clean":"2024-09-12T18:09:58.608748+0000","last_became_active":"2024-09-12T17:10:48.538190+0000","last_became_peered":"2024-09-12T17:10:48.538190+0000","last_unstale":"2024-09-12T18:09:58.608748+0000","last_undegraded":"2024-09-12T18:09:58.608748+0000","last_fullsized":"2024-09-12T18:09:58.608748+0000","mapping_epoch":30,"log_start":"263'200","ondisk_log_start":"263'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_clean_scrub_stamp":"2024-09-12T17:10:47.516917+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":200,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:41:22.031248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":276,"num_read_kb":262,"num_write":250,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"263'776","reported_seq":2749,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:13.140241+0000","last_change":"2024-09-12T17:10:50.562034+0000","last_active":"2024-09-12T18:11:13.140241+0000","last_peered":"2024-09-12T18:11:13.140241+0000","last_clean":"2024-09-12T18:11:13.140241+0000","last_became_active":"2024-09-12T17:10:50.561112+0000","last_became_peered":"2024-09-12T17:10:50.561112+0000","last_unstale":"2024-09-12T18:11:13.140241+0000","last_undegraded":"2024-09-12T18:11:13.140241+0000","last_fullsized":"2024-09-12T18:11:13.140241+0000","mapping_epoch":32,"log_start":"263'700","ondisk_log_start":"263'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_clean_scrub_stamp":"2024-09-12T17:10:49.533772+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":700,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:22:47.285499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"263'97","reported_seq":608,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:39.855795+0000","last_change":"2024-09-12T17:10:52.672259+0000","last_active":"2024-09-12T18:09:39.855795+0000","last_peered":"2024-09-12T18:09:39.855795+0000","last_clean":"2024-09-12T18:09:39.855795+0000","last_became_active":"2024-09-12T17:10:52.671116+0000","last_became_peered":"2024-09-12T17:10:52.671116+0000","last_unstale":"2024-09-12T18:09:39.855795+0000","last_undegraded":"2024-09-12T18:09:39.855795+0000","last_fullsized":"2024-09-12T18:09:39.855795+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:05:09.882357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":505,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":188,"num_read_kb":171,"num_write":234,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"263'777","reported_seq":2421,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:49.547019+0000","last_change":"2024-09-12T17:10:44.512159+0000","last_active":"2024-09-12T18:09:49.547019+0000","last_peered":"2024-09-12T18:09:49.547019+0000","last_clean":"2024-09-12T18:09:49.547019+0000","last_became_active":"2024-09-12T17:10:44.511450+0000","last_became_peered":"2024-09-12T17:10:44.511450+0000","last_unstale":"2024-09-12T18:09:49.547019+0000","last_undegraded":"2024-09-12T18:09:49.547019+0000","last_fullsized":"2024-09-12T18:09:49.547019+0000","mapping_epoch":26,"log_start":"263'700","ondisk_log_start":"263'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":700,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:25:36.561047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3773,"num_read_kb":3378,"num_write":1080,"num_write_kb":423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"263'165","reported_seq":747,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:14.852528+0000","last_change":"2024-09-12T17:10:42.526880+0000","last_active":"2024-09-12T18:09:14.852528+0000","last_peered":"2024-09-12T18:09:14.852528+0000","last_clean":"2024-09-12T18:09:14.852528+0000","last_became_active":"2024-09-12T17:10:42.526472+0000","last_became_peered":"2024-09-12T17:10:42.526472+0000","last_unstale":"2024-09-12T18:09:14.852528+0000","last_undegraded":"2024-09-12T18:09:14.852528+0000","last_fullsized":"2024-09-12T18:09:14.852528+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:45:58.908363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6295552,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":298,"num_read_kb":1418,"num_write":795,"num_write_kb":46804,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,0],"acting":[3,5,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":528,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:05.147338+0000","last_change":"2024-09-12T17:10:33.854523+0000","last_active":"2024-09-12T18:09:05.147338+0000","last_peered":"2024-09-12T18:09:05.147338+0000","last_clean":"2024-09-12T18:09:05.147338+0000","last_became_active":"2024-09-12T17:10:31.845481+0000","last_became_peered":"2024-09-12T17:10:31.845481+0000","last_unstale":"2024-09-12T18:09:05.147338+0000","last_undegraded":"2024-09-12T18:09:05.147338+0000","last_fullsized":"2024-09-12T18:09:05.147338+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:30.818274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:30.818274+0000","last_clean_scrub_stamp":"2024-09-12T17:10:30.818274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:06:13.863048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060466100000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":506,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:09.855182+0000","last_change":"2024-09-12T17:10:46.530614+0000","last_active":"2024-09-12T18:09:09.855182+0000","last_peered":"2024-09-12T18:09:09.855182+0000","last_clean":"2024-09-12T18:09:09.855182+0000","last_became_active":"2024-09-12T17:10:46.530275+0000","last_became_peered":"2024-09-12T17:10:46.530275+0000","last_unstale":"2024-09-12T18:09:09.855182+0000","last_undegraded":"2024-09-12T18:09:09.855182+0000","last_fullsized":"2024-09-12T18:09:09.855182+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_clean_scrub_stamp":"2024-09-12T17:10:45.504515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:08:24.007031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"263'128","reported_seq":676,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:09.855223+0000","last_change":"2024-09-12T17:10:48.542113+0000","last_active":"2024-09-12T18:09:09.855223+0000","last_peered":"2024-09-12T18:09:09.855223+0000","last_clean":"2024-09-12T18:09:09.855223+0000","last_became_active":"2024-09-12T17:10:48.541795+0000","last_became_peered":"2024-09-12T17:10:48.541795+0000","last_unstale":"2024-09-12T18:09:09.855223+0000","last_undegraded":"2024-09-12T18:09:09.855223+0000","last_fullsized":"2024-09-12T18:09:09.855223+0000","mapping_epoch":30,"log_start":"263'100","ondisk_log_start":"263'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_clean_scrub_stamp":"2024-09-12T17:10:47.516917+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:48:37.106733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":142,"num_read_kb":133,"num_write":96,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"263'787","reported_seq":4447,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:13.436826+0000","last_change":"2024-09-12T17:10:50.560337+0000","last_active":"2024-09-12T18:11:13.436826+0000","last_peered":"2024-09-12T18:11:13.436826+0000","last_clean":"2024-09-12T18:11:13.436826+0000","last_became_active":"2024-09-12T17:10:50.559932+0000","last_became_peered":"2024-09-12T17:10:50.559932+0000","last_unstale":"2024-09-12T18:11:13.436826+0000","last_undegraded":"2024-09-12T18:11:13.436826+0000","last_fullsized":"2024-09-12T18:11:13.436826+0000","mapping_epoch":32,"log_start":"263'700","ondisk_log_start":"263'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_clean_scrub_stamp":"2024-09-12T17:10:49.533772+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":700,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:05:17.277375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"263'288","reported_seq":829,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:24.845948+0000","last_change":"2024-09-12T17:10:52.570934+0000","last_active":"2024-09-12T18:09:24.845948+0000","last_peered":"2024-09-12T18:09:24.845948+0000","last_clean":"2024-09-12T18:09:24.845948+0000","last_became_active":"2024-09-12T17:10:52.570545+0000","last_became_peered":"2024-09-12T17:10:52.570545+0000","last_unstale":"2024-09-12T18:09:24.845948+0000","last_undegraded":"2024-09-12T18:09:24.845948+0000","last_fullsized":"2024-09-12T18:09:24.845948+0000","mapping_epoch":34,"log_start":"263'200","ondisk_log_start":"263'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:15:52.985878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":466,"num_read_kb":447,"num_write":645,"num_write_kb":207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"263'471","reported_seq":1901,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:20.793547+0000","last_change":"2024-09-12T17:10:44.517863+0000","last_active":"2024-09-12T18:09:20.793547+0000","last_peered":"2024-09-12T18:09:20.793547+0000","last_clean":"2024-09-12T18:09:20.793547+0000","last_became_active":"2024-09-12T17:10:44.517508+0000","last_became_peered":"2024-09-12T17:10:44.517508+0000","last_unstale":"2024-09-12T18:09:20.793547+0000","last_undegraded":"2024-09-12T18:09:20.793547+0000","last_fullsized":"2024-09-12T18:09:20.793547+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":400,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:38:36.589360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2400,"num_read_kb":2225,"num_write":610,"num_write_kb":202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"263'209","reported_seq":847,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:14.844556+0000","last_change":"2024-09-12T17:10:42.518819+0000","last_active":"2024-09-12T18:09:14.844556+0000","last_peered":"2024-09-12T18:09:14.844556+0000","last_clean":"2024-09-12T18:09:14.844556+0000","last_became_active":"2024-09-12T17:10:42.518404+0000","last_became_peered":"2024-09-12T17:10:42.518404+0000","last_unstale":"2024-09-12T18:09:14.844556+0000","last_undegraded":"2024-09-12T18:09:14.844556+0000","last_fullsized":"2024-09-12T18:09:14.844556+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:42:38.202022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220118,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":502,"num_read_kb":3973,"num_write":1038,"num_write_kb":36643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,7],"acting":[0,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":523,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:04.874518+0000","last_change":"2024-09-12T17:10:33.848505+0000","last_active":"2024-09-12T18:09:04.874518+0000","last_peered":"2024-09-12T18:09:04.874518+0000","last_clean":"2024-09-12T18:09:04.874518+0000","last_became_active":"2024-09-12T17:10:31.846123+0000","last_became_peered":"2024-09-12T17:10:31.846123+0000","last_unstale":"2024-09-12T18:09:04.874518+0000","last_undegraded":"2024-09-12T18:09:04.874518+0000","last_fullsized":"2024-09-12T18:09:04.874518+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:30.818274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:30.818274+0000","last_clean_scrub_stamp":"2024-09-12T17:10:30.818274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:48:25.408756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042024599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":500,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:04.850946+0000","last_change":"2024-09-12T17:10:46.530820+0000","last_active":"2024-09-12T18:09:04.850946+0000","last_peered":"2024-09-12T18:09:04.850946+0000","last_clean":"2024-09-12T18:09:04.850946+0000","last_became_active":"2024-09-12T17:10:46.530457+0000","last_became_peered":"2024-09-12T17:10:46.530457+0000","last_unstale":"2024-09-12T18:09:04.850946+0000","last_undegraded":"2024-09-12T18:09:04.850946+0000","last_fullsized":"2024-09-12T18:09:04.850946+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_clean_scrub_stamp":"2024-09-12T17:10:45.504515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:55:20.257339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"263'301","reported_seq":1008,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:09.796776+0000","last_change":"2024-09-12T17:10:48.543312+0000","last_active":"2024-09-12T18:11:09.796776+0000","last_peered":"2024-09-12T18:11:09.796776+0000","last_clean":"2024-09-12T18:11:09.796776+0000","last_became_active":"2024-09-12T17:10:48.542991+0000","last_became_peered":"2024-09-12T17:10:48.542991+0000","last_unstale":"2024-09-12T18:11:09.796776+0000","last_undegraded":"2024-09-12T18:11:09.796776+0000","last_fullsized":"2024-09-12T18:11:09.796776+0000","mapping_epoch":30,"log_start":"260'200","ondisk_log_start":"260'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_clean_scrub_stamp":"2024-09-12T17:10:47.516917+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:14:45.346536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26702,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":441,"num_read_kb":571,"num_write":222,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":491,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:09.851601+0000","last_change":"2024-09-12T17:10:50.553798+0000","last_active":"2024-09-12T18:09:09.851601+0000","last_peered":"2024-09-12T18:09:09.851601+0000","last_clean":"2024-09-12T18:09:09.851601+0000","last_became_active":"2024-09-12T17:10:50.553469+0000","last_became_peered":"2024-09-12T17:10:50.553469+0000","last_unstale":"2024-09-12T18:09:09.851601+0000","last_undegraded":"2024-09-12T18:09:09.851601+0000","last_fullsized":"2024-09-12T18:09:09.851601+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_clean_scrub_stamp":"2024-09-12T17:10:49.533772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:37:24.951291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"263'114","reported_seq":615,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:24.858341+0000","last_change":"2024-09-12T17:10:52.579037+0000","last_active":"2024-09-12T18:09:24.858341+0000","last_peered":"2024-09-12T18:09:24.858341+0000","last_clean":"2024-09-12T18:09:24.858341+0000","last_became_active":"2024-09-12T17:10:52.578713+0000","last_became_peered":"2024-09-12T17:10:52.578713+0000","last_unstale":"2024-09-12T18:09:24.858341+0000","last_undegraded":"2024-09-12T18:09:24.858341+0000","last_fullsized":"2024-09-12T18:09:24.858341+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:23:43.956550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":176,"num_read_kb":166,"num_write":279,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"263'124","reported_seq":686,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:49.766649+0000","last_change":"2024-09-12T17:10:52.576764+0000","last_active":"2024-09-12T18:09:49.766649+0000","last_peered":"2024-09-12T18:09:49.766649+0000","last_clean":"2024-09-12T18:09:49.766649+0000","last_became_active":"2024-09-12T17:10:52.576481+0000","last_became_peered":"2024-09-12T17:10:52.576481+0000","last_unstale":"2024-09-12T18:09:49.766649+0000","last_undegraded":"2024-09-12T18:09:49.766649+0000","last_fullsized":"2024-09-12T18:09:49.766649+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:22:23.671221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":242,"num_read_kb":237,"num_write":285,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"263'886","reported_seq":2476,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:04.854522+0000","last_change":"2024-09-12T17:10:44.507764+0000","last_active":"2024-09-12T18:09:04.854522+0000","last_peered":"2024-09-12T18:09:04.854522+0000","last_clean":"2024-09-12T18:09:04.854522+0000","last_became_active":"2024-09-12T17:10:44.507455+0000","last_became_peered":"2024-09-12T17:10:44.507455+0000","last_unstale":"2024-09-12T18:09:04.854522+0000","last_undegraded":"2024-09-12T18:09:04.854522+0000","last_fullsized":"2024-09-12T18:09:04.854522+0000","mapping_epoch":26,"log_start":"263'800","ondisk_log_start":"263'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":800,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:27:20.389462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4276,"num_read_kb":3830,"num_write":1165,"num_write_kb":436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"263'207","reported_seq":858,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:14.855999+0000","last_change":"2024-09-12T17:10:42.520147+0000","last_active":"2024-09-12T18:09:14.855999+0000","last_peered":"2024-09-12T18:09:14.855999+0000","last_clean":"2024-09-12T18:09:14.855999+0000","last_became_active":"2024-09-12T17:10:42.519656+0000","last_became_peered":"2024-09-12T17:10:42.519656+0000","last_unstale":"2024-09-12T18:09:14.855999+0000","last_undegraded":"2024-09-12T18:09:14.855999+0000","last_fullsized":"2024-09-12T18:09:14.855999+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:46:04.344482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":893994,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":521,"num_read_kb":10349,"num_write":1060,"num_write_kb":31428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,6],"acting":[4,7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":501,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:10.147893+0000","last_change":"2024-09-12T17:10:46.527971+0000","last_active":"2024-09-12T18:09:10.147893+0000","last_peered":"2024-09-12T18:09:10.147893+0000","last_clean":"2024-09-12T18:09:10.147893+0000","last_became_active":"2024-09-12T17:10:46.527445+0000","last_became_peered":"2024-09-12T17:10:46.527445+0000","last_unstale":"2024-09-12T18:09:10.147893+0000","last_undegraded":"2024-09-12T18:09:10.147893+0000","last_fullsized":"2024-09-12T18:09:10.147893+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_clean_scrub_stamp":"2024-09-12T17:10:45.504515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:06:49.441769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"263'136","reported_seq":709,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:09.804162+0000","last_change":"2024-09-12T17:10:48.536317+0000","last_active":"2024-09-12T18:11:09.804162+0000","last_peered":"2024-09-12T18:11:09.804162+0000","last_clean":"2024-09-12T18:11:09.804162+0000","last_became_active":"2024-09-12T17:10:48.536021+0000","last_became_peered":"2024-09-12T17:10:48.536021+0000","last_unstale":"2024-09-12T18:11:09.804162+0000","last_undegraded":"2024-09-12T18:11:09.804162+0000","last_fullsized":"2024-09-12T18:11:09.804162+0000","mapping_epoch":30,"log_start":"263'100","ondisk_log_start":"263'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_clean_scrub_stamp":"2024-09-12T17:10:47.516917+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:39:55.363038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11184,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":170,"num_read_kb":215,"num_write":88,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:09.851513+0000","last_change":"2024-09-12T17:10:50.555533+0000","last_active":"2024-09-12T18:09:09.851513+0000","last_peered":"2024-09-12T18:09:09.851513+0000","last_clean":"2024-09-12T18:09:09.851513+0000","last_became_active":"2024-09-12T17:10:50.555251+0000","last_became_peered":"2024-09-12T17:10:50.555251+0000","last_unstale":"2024-09-12T18:09:09.851513+0000","last_undegraded":"2024-09-12T18:09:09.851513+0000","last_fullsized":"2024-09-12T18:09:09.851513+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_clean_scrub_stamp":"2024-09-12T17:10:49.533772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:14:47.733536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"263'142","reported_seq":663,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:09.818435+0000","last_change":"2024-09-12T17:10:52.573415+0000","last_active":"2024-09-12T18:11:09.818435+0000","last_peered":"2024-09-12T18:11:09.818435+0000","last_clean":"2024-09-12T18:11:09.818435+0000","last_became_active":"2024-09-12T17:10:52.573040+0000","last_became_peered":"2024-09-12T17:10:52.573040+0000","last_unstale":"2024-09-12T18:11:09.818435+0000","last_undegraded":"2024-09-12T18:11:09.818435+0000","last_fullsized":"2024-09-12T18:11:09.818435+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:17:53.786959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":264,"num_read_kb":238,"num_write":352,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"263'1128","reported_seq":2790,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:05.147244+0000","last_change":"2024-09-12T17:10:44.509438+0000","last_active":"2024-09-12T18:09:05.147244+0000","last_peered":"2024-09-12T18:09:05.147244+0000","last_clean":"2024-09-12T18:09:05.147244+0000","last_became_active":"2024-09-12T17:10:44.509117+0000","last_became_peered":"2024-09-12T17:10:44.509117+0000","last_unstale":"2024-09-12T18:09:05.147244+0000","last_undegraded":"2024-09-12T18:09:05.147244+0000","last_fullsized":"2024-09-12T18:09:05.147244+0000","mapping_epoch":26,"log_start":"263'1100","ondisk_log_start":"263'1100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":1100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:09:30.968234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5331,"num_read_kb":4747,"num_write":1539,"num_write_kb":622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"263'204","reported_seq":812,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:51.027681+0000","last_change":"2024-09-12T17:11:16.617932+0000","last_active":"2024-09-12T18:07:51.027681+0000","last_peered":"2024-09-12T18:07:51.027681+0000","last_clean":"2024-09-12T18:07:51.027681+0000","last_became_active":"2024-09-12T17:11:16.617505+0000","last_became_peered":"2024-09-12T17:11:16.617505+0000","last_unstale":"2024-09-12T18:07:51.027681+0000","last_undegraded":"2024-09-12T18:07:51.027681+0000","last_fullsized":"2024-09-12T18:07:51.027681+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:43:08.879561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2937824,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":493,"num_read_kb":50143,"num_write":993,"num_write_kb":47141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,4],"acting":[2,3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:09.851666+0000","last_change":"2024-09-12T17:10:46.532146+0000","last_active":"2024-09-12T18:09:09.851666+0000","last_peered":"2024-09-12T18:09:09.851666+0000","last_clean":"2024-09-12T18:09:09.851666+0000","last_became_active":"2024-09-12T17:10:46.531835+0000","last_became_peered":"2024-09-12T17:10:46.531835+0000","last_unstale":"2024-09-12T18:09:09.851666+0000","last_undegraded":"2024-09-12T18:09:09.851666+0000","last_fullsized":"2024-09-12T18:09:09.851666+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_clean_scrub_stamp":"2024-09-12T17:10:45.504515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:41:31.662923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"263'46","reported_seq":554,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:09.843750+0000","last_change":"2024-09-12T17:10:48.541273+0000","last_active":"2024-09-12T18:09:09.843750+0000","last_peered":"2024-09-12T18:09:09.843750+0000","last_clean":"2024-09-12T18:09:09.843750+0000","last_became_active":"2024-09-12T17:10:48.540975+0000","last_became_peered":"2024-09-12T17:10:48.540975+0000","last_unstale":"2024-09-12T18:09:09.843750+0000","last_undegraded":"2024-09-12T18:09:09.843750+0000","last_fullsized":"2024-09-12T18:09:09.843750+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_clean_scrub_stamp":"2024-09-12T17:10:47.516917+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:50:54.992489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":38,"num_read_kb":36,"num_write":28,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":486,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:09.855642+0000","last_change":"2024-09-12T17:10:50.553896+0000","last_active":"2024-09-12T18:09:09.855642+0000","last_peered":"2024-09-12T18:09:09.855642+0000","last_clean":"2024-09-12T18:09:09.855642+0000","last_became_active":"2024-09-12T17:10:50.553581+0000","last_became_peered":"2024-09-12T17:10:50.553581+0000","last_unstale":"2024-09-12T18:09:09.855642+0000","last_undegraded":"2024-09-12T18:09:09.855642+0000","last_fullsized":"2024-09-12T18:09:09.855642+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_clean_scrub_stamp":"2024-09-12T17:10:49.533772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:14:49.105003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"263'191","reported_seq":712,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:49.539356+0000","last_change":"2024-09-12T17:10:52.573782+0000","last_active":"2024-09-12T18:09:49.539356+0000","last_peered":"2024-09-12T18:09:49.539356+0000","last_clean":"2024-09-12T18:09:49.539356+0000","last_became_active":"2024-09-12T17:10:52.573306+0000","last_became_peered":"2024-09-12T17:10:52.573306+0000","last_unstale":"2024-09-12T18:09:49.539356+0000","last_undegraded":"2024-09-12T18:09:49.539356+0000","last_fullsized":"2024-09-12T18:09:49.539356+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:39:25.637064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":321,"num_read_kb":317,"num_write":439,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"263'810","reported_seq":2411,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:04.850964+0000","last_change":"2024-09-12T17:10:44.511875+0000","last_active":"2024-09-12T18:09:04.850964+0000","last_peered":"2024-09-12T18:09:04.850964+0000","last_clean":"2024-09-12T18:09:04.850964+0000","last_became_active":"2024-09-12T17:10:44.511481+0000","last_became_peered":"2024-09-12T17:10:44.511481+0000","last_unstale":"2024-09-12T18:09:04.850964+0000","last_undegraded":"2024-09-12T18:09:04.850964+0000","last_fullsized":"2024-09-12T18:09:04.850964+0000","mapping_epoch":26,"log_start":"263'700","ondisk_log_start":"263'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":700,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:10:10.656622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3868,"num_read_kb":3506,"num_write":1048,"num_write_kb":364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"263'168","reported_seq":770,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:04.012455+0000","last_change":"2024-09-12T17:11:16.863311+0000","last_active":"2024-09-12T18:11:04.012455+0000","last_peered":"2024-09-12T18:11:04.012455+0000","last_clean":"2024-09-12T18:11:04.012455+0000","last_became_active":"2024-09-12T17:11:16.862878+0000","last_became_peered":"2024-09-12T17:11:16.862878+0000","last_unstale":"2024-09-12T18:11:04.012455+0000","last_undegraded":"2024-09-12T18:11:04.012455+0000","last_fullsized":"2024-09-12T18:11:04.012455+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:36:57.402157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17896412,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":386,"num_read_kb":53715,"num_write":798,"num_write_kb":39175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,1,3],"acting":[2,7,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:09.855601+0000","last_change":"2024-09-12T17:10:46.530915+0000","last_active":"2024-09-12T18:09:09.855601+0000","last_peered":"2024-09-12T18:09:09.855601+0000","last_clean":"2024-09-12T18:09:09.855601+0000","last_became_active":"2024-09-12T17:10:46.530518+0000","last_became_peered":"2024-09-12T17:10:46.530518+0000","last_unstale":"2024-09-12T18:09:09.855601+0000","last_undegraded":"2024-09-12T18:09:09.855601+0000","last_fullsized":"2024-09-12T18:09:09.855601+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_clean_scrub_stamp":"2024-09-12T17:10:45.504515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:39:55.119594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"263'169","reported_seq":757,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:09.790509+0000","last_change":"2024-09-12T17:10:48.537056+0000","last_active":"2024-09-12T18:11:09.790509+0000","last_peered":"2024-09-12T18:11:09.790509+0000","last_clean":"2024-09-12T18:11:09.790509+0000","last_became_active":"2024-09-12T17:10:48.536654+0000","last_became_peered":"2024-09-12T17:10:48.536654+0000","last_unstale":"2024-09-12T18:11:09.790509+0000","last_undegraded":"2024-09-12T18:11:09.790509+0000","last_fullsized":"2024-09-12T18:11:09.790509+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_clean_scrub_stamp":"2024-09-12T17:10:47.516917+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":100,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:46:23.716742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6412,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":215,"num_read_kb":225,"num_write":118,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":489,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:09.875304+0000","last_change":"2024-09-12T17:10:50.556336+0000","last_active":"2024-09-12T18:09:09.875304+0000","last_peered":"2024-09-12T18:09:09.875304+0000","last_clean":"2024-09-12T18:09:09.875304+0000","last_became_active":"2024-09-12T17:10:50.556039+0000","last_became_peered":"2024-09-12T17:10:50.556039+0000","last_unstale":"2024-09-12T18:09:09.875304+0000","last_undegraded":"2024-09-12T18:09:09.875304+0000","last_fullsized":"2024-09-12T18:09:09.875304+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_clean_scrub_stamp":"2024-09-12T17:10:49.533772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:58:59.200469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"263'113","reported_seq":617,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:24.848069+0000","last_change":"2024-09-12T17:10:52.577104+0000","last_active":"2024-09-12T18:08:24.848069+0000","last_peered":"2024-09-12T18:08:24.848069+0000","last_clean":"2024-09-12T18:08:24.848069+0000","last_became_active":"2024-09-12T17:10:52.576791+0000","last_became_peered":"2024-09-12T17:10:52.576791+0000","last_unstale":"2024-09-12T18:08:24.848069+0000","last_undegraded":"2024-09-12T18:08:24.848069+0000","last_fullsized":"2024-09-12T18:08:24.848069+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:18:40.050173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":159,"num_read_kb":159,"num_write":260,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"263'429","reported_seq":1806,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:04.850927+0000","last_change":"2024-09-12T17:10:44.521723+0000","last_active":"2024-09-12T18:09:04.850927+0000","last_peered":"2024-09-12T18:09:04.850927+0000","last_clean":"2024-09-12T18:09:04.850927+0000","last_became_active":"2024-09-12T17:10:44.520747+0000","last_became_peered":"2024-09-12T17:10:44.520747+0000","last_unstale":"2024-09-12T18:09:04.850927+0000","last_undegraded":"2024-09-12T18:09:04.850927+0000","last_fullsized":"2024-09-12T18:09:04.850927+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":400,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:56:20.477273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2202,"num_read_kb":2035,"num_write":527,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"263'251","reported_seq":940,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:07.551191+0000","last_change":"2024-09-12T17:10:42.529117+0000","last_active":"2024-09-12T18:11:07.551191+0000","last_peered":"2024-09-12T18:11:07.551191+0000","last_clean":"2024-09-12T18:11:07.551191+0000","last_became_active":"2024-09-12T17:10:42.528364+0000","last_became_peered":"2024-09-12T17:10:42.528364+0000","last_unstale":"2024-09-12T18:11:07.551191+0000","last_undegraded":"2024-09-12T18:11:07.551191+0000","last_fullsized":"2024-09-12T18:11:07.551191+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:10:20.252342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5692764,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":609,"num_read_kb":71919,"num_write":1341,"num_write_kb":46951,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6,3],"acting":[0,5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:09.875254+0000","last_change":"2024-09-12T17:10:46.532154+0000","last_active":"2024-09-12T18:09:09.875254+0000","last_peered":"2024-09-12T18:09:09.875254+0000","last_clean":"2024-09-12T18:09:09.875254+0000","last_became_active":"2024-09-12T17:10:46.531830+0000","last_became_peered":"2024-09-12T17:10:46.531830+0000","last_unstale":"2024-09-12T18:09:09.875254+0000","last_undegraded":"2024-09-12T18:09:09.875254+0000","last_fullsized":"2024-09-12T18:09:09.875254+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_clean_scrub_stamp":"2024-09-12T17:10:45.504515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:00:23.387684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"263'123","reported_seq":687,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:09.786960+0000","last_change":"2024-09-12T17:10:48.545933+0000","last_active":"2024-09-12T18:11:09.786960+0000","last_peered":"2024-09-12T18:11:09.786960+0000","last_clean":"2024-09-12T18:11:09.786960+0000","last_became_active":"2024-09-12T17:10:48.545598+0000","last_became_peered":"2024-09-12T17:10:48.545598+0000","last_unstale":"2024-09-12T18:11:09.786960+0000","last_undegraded":"2024-09-12T18:11:09.786960+0000","last_fullsized":"2024-09-12T18:11:09.786960+0000","mapping_epoch":30,"log_start":"263'100","ondisk_log_start":"263'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_clean_scrub_stamp":"2024-09-12T17:10:47.516917+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:53:48.675107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12450,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":157,"num_read_kb":207,"num_write":82,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:09.843797+0000","last_change":"2024-09-12T17:10:50.561238+0000","last_active":"2024-09-12T18:09:09.843797+0000","last_peered":"2024-09-12T18:09:09.843797+0000","last_clean":"2024-09-12T18:09:09.843797+0000","last_became_active":"2024-09-12T17:10:50.560872+0000","last_became_peered":"2024-09-12T17:10:50.560872+0000","last_unstale":"2024-09-12T18:09:09.843797+0000","last_undegraded":"2024-09-12T18:09:09.843797+0000","last_fullsized":"2024-09-12T18:09:09.843797+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_clean_scrub_stamp":"2024-09-12T17:10:49.533772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:11:16.785795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"263'950","reported_seq":2479,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:08.687444+0000","last_change":"2024-09-12T17:10:44.519331+0000","last_active":"2024-09-12T18:11:08.687444+0000","last_peered":"2024-09-12T18:11:08.687444+0000","last_clean":"2024-09-12T18:11:08.687444+0000","last_became_active":"2024-09-12T17:10:44.518992+0000","last_became_peered":"2024-09-12T17:10:44.518992+0000","last_unstale":"2024-09-12T18:11:08.687444+0000","last_undegraded":"2024-09-12T18:11:08.687444+0000","last_fullsized":"2024-09-12T18:11:08.687444+0000","mapping_epoch":26,"log_start":"263'900","ondisk_log_start":"263'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":900,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:58:27.950402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4453,"num_read_kb":3925,"num_write":1322,"num_write_kb":528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"263'311","reported_seq":989,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:44.848614+0000","last_change":"2024-09-12T17:10:42.515186+0000","last_active":"2024-09-12T18:08:44.848614+0000","last_peered":"2024-09-12T18:08:44.848614+0000","last_clean":"2024-09-12T18:08:44.848614+0000","last_became_active":"2024-09-12T17:10:42.514627+0000","last_became_peered":"2024-09-12T17:10:42.514627+0000","last_unstale":"2024-09-12T18:08:44.848614+0000","last_undegraded":"2024-09-12T18:08:44.848614+0000","last_fullsized":"2024-09-12T18:08:44.848614+0000","mapping_epoch":24,"log_start":"263'300","ondisk_log_start":"263'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:27:58.202191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15728847,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":790,"num_read_kb":25839,"num_write":1191,"num_write_kb":43854,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":504,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:59.842677+0000","last_change":"2024-09-12T17:10:46.527010+0000","last_active":"2024-09-12T18:08:59.842677+0000","last_peered":"2024-09-12T18:08:59.842677+0000","last_clean":"2024-09-12T18:08:59.842677+0000","last_became_active":"2024-09-12T17:10:46.526692+0000","last_became_peered":"2024-09-12T17:10:46.526692+0000","last_unstale":"2024-09-12T18:08:59.842677+0000","last_undegraded":"2024-09-12T18:08:59.842677+0000","last_fullsized":"2024-09-12T18:08:59.842677+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_clean_scrub_stamp":"2024-09-12T17:10:45.504515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:02:16.851916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"263'205","reported_seq":830,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:09.785236+0000","last_change":"2024-09-12T17:10:48.545433+0000","last_active":"2024-09-12T18:11:09.785236+0000","last_peered":"2024-09-12T18:11:09.785236+0000","last_clean":"2024-09-12T18:11:09.785236+0000","last_became_active":"2024-09-12T17:10:48.544429+0000","last_became_peered":"2024-09-12T17:10:48.544429+0000","last_unstale":"2024-09-12T18:11:09.785236+0000","last_undegraded":"2024-09-12T18:11:09.785236+0000","last_fullsized":"2024-09-12T18:11:09.785236+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_clean_scrub_stamp":"2024-09-12T17:10:47.516917+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:28:39.813411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19968,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":307,"num_read_kb":447,"num_write":200,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":485,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:19.847436+0000","last_change":"2024-09-12T17:10:50.565947+0000","last_active":"2024-09-12T18:08:19.847436+0000","last_peered":"2024-09-12T18:08:19.847436+0000","last_clean":"2024-09-12T18:08:19.847436+0000","last_became_active":"2024-09-12T17:10:50.565621+0000","last_became_peered":"2024-09-12T17:10:50.565621+0000","last_unstale":"2024-09-12T18:08:19.847436+0000","last_undegraded":"2024-09-12T18:08:19.847436+0000","last_fullsized":"2024-09-12T18:08:19.847436+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_clean_scrub_stamp":"2024-09-12T17:10:49.533772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:49:32.811403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"263'175","reported_seq":681,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:14.852393+0000","last_change":"2024-09-12T17:10:52.672357+0000","last_active":"2024-09-12T18:09:14.852393+0000","last_peered":"2024-09-12T18:09:14.852393+0000","last_clean":"2024-09-12T18:09:14.852393+0000","last_became_active":"2024-09-12T17:10:52.672033+0000","last_became_peered":"2024-09-12T17:10:52.672033+0000","last_unstale":"2024-09-12T18:09:14.852393+0000","last_undegraded":"2024-09-12T18:09:14.852393+0000","last_fullsized":"2024-09-12T18:09:14.852393+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:21:13.578314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":269,"num_read_kb":274,"num_write":411,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"263'545","reported_seq":2055,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:48.687635+0000","last_change":"2024-09-12T17:10:44.510970+0000","last_active":"2024-09-12T18:09:48.687635+0000","last_peered":"2024-09-12T18:09:48.687635+0000","last_clean":"2024-09-12T18:09:48.687635+0000","last_became_active":"2024-09-12T17:10:44.510696+0000","last_became_peered":"2024-09-12T17:10:44.510696+0000","last_unstale":"2024-09-12T18:09:48.687635+0000","last_undegraded":"2024-09-12T18:09:48.687635+0000","last_fullsized":"2024-09-12T18:09:48.687635+0000","mapping_epoch":26,"log_start":"263'500","ondisk_log_start":"263'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":500,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:45:34.728786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2748,"num_read_kb":2501,"num_write":691,"num_write_kb":203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"263'236","reported_seq":903,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:43.766114+0000","last_change":"2024-09-12T17:10:42.520812+0000","last_active":"2024-09-12T18:09:43.766114+0000","last_peered":"2024-09-12T18:09:43.766114+0000","last_clean":"2024-09-12T18:09:43.766114+0000","last_became_active":"2024-09-12T17:10:42.520349+0000","last_became_peered":"2024-09-12T17:10:42.520349+0000","last_unstale":"2024-09-12T18:09:43.766114+0000","last_undegraded":"2024-09-12T18:09:43.766114+0000","last_fullsized":"2024-09-12T18:09:43.766114+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":200,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:40:03.389243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21229654,"num_objects":11,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":539,"num_read_kb":59039,"num_write":1204,"num_write_kb":37561,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,6],"acting":[1,3,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":500,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:09.875361+0000","last_change":"2024-09-12T17:10:46.530884+0000","last_active":"2024-09-12T18:09:09.875361+0000","last_peered":"2024-09-12T18:09:09.875361+0000","last_clean":"2024-09-12T18:09:09.875361+0000","last_became_active":"2024-09-12T17:10:46.530545+0000","last_became_peered":"2024-09-12T17:10:46.530545+0000","last_unstale":"2024-09-12T18:09:09.875361+0000","last_undegraded":"2024-09-12T18:09:09.875361+0000","last_fullsized":"2024-09-12T18:09:09.875361+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_clean_scrub_stamp":"2024-09-12T17:10:45.504515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:01:13.562715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"263'166","reported_seq":746,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:10:49.870892+0000","last_change":"2024-09-12T17:10:48.541568+0000","last_active":"2024-09-12T18:10:49.870892+0000","last_peered":"2024-09-12T18:10:49.870892+0000","last_clean":"2024-09-12T18:10:49.870892+0000","last_became_active":"2024-09-12T17:10:48.541240+0000","last_became_peered":"2024-09-12T17:10:48.541240+0000","last_unstale":"2024-09-12T18:10:49.870892+0000","last_undegraded":"2024-09-12T18:10:49.870892+0000","last_fullsized":"2024-09-12T18:10:49.870892+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_clean_scrub_stamp":"2024-09-12T17:10:47.516917+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:09:34.296718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11199,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":237,"num_read_kb":302,"num_write":156,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":491,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:20.142401+0000","last_change":"2024-09-12T17:10:50.562714+0000","last_active":"2024-09-12T18:08:20.142401+0000","last_peered":"2024-09-12T18:08:20.142401+0000","last_clean":"2024-09-12T18:08:20.142401+0000","last_became_active":"2024-09-12T17:10:50.561983+0000","last_became_peered":"2024-09-12T17:10:50.561983+0000","last_unstale":"2024-09-12T18:08:20.142401+0000","last_undegraded":"2024-09-12T18:08:20.142401+0000","last_fullsized":"2024-09-12T18:08:20.142401+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_clean_scrub_stamp":"2024-09-12T17:10:49.533772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:59:00.374511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"263'244","reported_seq":1112,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:49.532850+0000","last_change":"2024-09-12T17:10:52.573923+0000","last_active":"2024-09-12T18:09:49.532850+0000","last_peered":"2024-09-12T18:09:49.532850+0000","last_clean":"2024-09-12T18:09:49.532850+0000","last_became_active":"2024-09-12T17:10:52.573595+0000","last_became_peered":"2024-09-12T17:10:52.573595+0000","last_unstale":"2024-09-12T18:09:49.532850+0000","last_undegraded":"2024-09-12T18:09:49.532850+0000","last_fullsized":"2024-09-12T18:09:49.532850+0000","mapping_epoch":34,"log_start":"263'200","ondisk_log_start":"263'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":200,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:32:14.573475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1635,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":641,"num_read_kb":637,"num_write":634,"num_write_kb":186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"263'620","reported_seq":2213,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:58.603541+0000","last_change":"2024-09-12T17:10:44.521406+0000","last_active":"2024-09-12T18:08:58.603541+0000","last_peered":"2024-09-12T18:08:58.603541+0000","last_clean":"2024-09-12T18:08:58.603541+0000","last_became_active":"2024-09-12T17:10:44.521041+0000","last_became_peered":"2024-09-12T17:10:44.521041+0000","last_unstale":"2024-09-12T18:08:58.603541+0000","last_undegraded":"2024-09-12T18:08:58.603541+0000","last_fullsized":"2024-09-12T18:08:58.603541+0000","mapping_epoch":26,"log_start":"263'600","ondisk_log_start":"263'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":600,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:02:28.202706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3182,"num_read_kb":2947,"num_write":827,"num_write_kb":261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"263'219","reported_seq":811,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:49.849250+0000","last_change":"2024-09-12T17:11:16.860452+0000","last_active":"2024-09-12T18:08:49.849250+0000","last_peered":"2024-09-12T18:08:49.849250+0000","last_clean":"2024-09-12T18:08:49.849250+0000","last_became_active":"2024-09-12T17:11:16.860070+0000","last_became_peered":"2024-09-12T17:11:16.860070+0000","last_unstale":"2024-09-12T18:08:49.849250+0000","last_undegraded":"2024-09-12T18:08:49.849250+0000","last_fullsized":"2024-09-12T18:08:49.849250+0000","mapping_epoch":37,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:08:44.066630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3266454,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":440,"num_read_kb":10891,"num_write":952,"num_write_kb":36342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":501,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:19.848368+0000","last_change":"2024-09-12T17:10:46.530777+0000","last_active":"2024-09-12T18:08:19.848368+0000","last_peered":"2024-09-12T18:08:19.848368+0000","last_clean":"2024-09-12T18:08:19.848368+0000","last_became_active":"2024-09-12T17:10:46.530452+0000","last_became_peered":"2024-09-12T17:10:46.530452+0000","last_unstale":"2024-09-12T18:08:19.848368+0000","last_undegraded":"2024-09-12T18:08:19.848368+0000","last_fullsized":"2024-09-12T18:08:19.848368+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_clean_scrub_stamp":"2024-09-12T17:10:45.504515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:09:29.711456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"263'138","reported_seq":713,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:09.809315+0000","last_change":"2024-09-12T17:10:48.538046+0000","last_active":"2024-09-12T18:11:09.809315+0000","last_peered":"2024-09-12T18:11:09.809315+0000","last_clean":"2024-09-12T18:11:09.809315+0000","last_became_active":"2024-09-12T17:10:48.537643+0000","last_became_peered":"2024-09-12T17:10:48.537643+0000","last_unstale":"2024-09-12T18:11:09.809315+0000","last_undegraded":"2024-09-12T18:11:09.809315+0000","last_fullsized":"2024-09-12T18:11:09.809315+0000","mapping_epoch":30,"log_start":"263'100","ondisk_log_start":"263'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_clean_scrub_stamp":"2024-09-12T17:10:47.516917+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:09:50.764378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5345,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":171,"num_read_kb":208,"num_write":92,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:55.146261+0000","last_change":"2024-09-12T17:10:50.565961+0000","last_active":"2024-09-12T18:08:55.146261+0000","last_peered":"2024-09-12T18:08:55.146261+0000","last_clean":"2024-09-12T18:08:55.146261+0000","last_became_active":"2024-09-12T17:10:50.565582+0000","last_became_peered":"2024-09-12T17:10:50.565582+0000","last_unstale":"2024-09-12T18:08:55.146261+0000","last_undegraded":"2024-09-12T18:08:55.146261+0000","last_fullsized":"2024-09-12T18:08:55.146261+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_clean_scrub_stamp":"2024-09-12T17:10:49.533772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:00:34.128895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"263'130","reported_seq":617,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:09.828159+0000","last_change":"2024-09-12T17:10:52.576677+0000","last_active":"2024-09-12T18:11:09.828159+0000","last_peered":"2024-09-12T18:11:09.828159+0000","last_clean":"2024-09-12T18:11:09.828159+0000","last_became_active":"2024-09-12T17:10:52.576370+0000","last_became_peered":"2024-09-12T17:10:52.576370+0000","last_unstale":"2024-09-12T18:11:09.828159+0000","last_undegraded":"2024-09-12T18:11:09.828159+0000","last_fullsized":"2024-09-12T18:11:09.828159+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:03:31.842871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1233,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":145,"num_read_kb":142,"num_write":322,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"263'872","reported_seq":2422,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:48.687133+0000","last_change":"2024-09-12T17:10:44.519575+0000","last_active":"2024-09-12T18:09:48.687133+0000","last_peered":"2024-09-12T18:09:48.687133+0000","last_clean":"2024-09-12T18:09:48.687133+0000","last_became_active":"2024-09-12T17:10:44.519318+0000","last_became_peered":"2024-09-12T17:10:44.519318+0000","last_unstale":"2024-09-12T18:09:48.687133+0000","last_undegraded":"2024-09-12T18:09:48.687133+0000","last_fullsized":"2024-09-12T18:09:48.687133+0000","mapping_epoch":26,"log_start":"263'800","ondisk_log_start":"263'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":800,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:45:54.356905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4021,"num_read_kb":3592,"num_write":1141,"num_write_kb":414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"263'185","reported_seq":798,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:14.837007+0000","last_change":"2024-09-12T17:10:42.517205+0000","last_active":"2024-09-12T18:08:14.837007+0000","last_peered":"2024-09-12T18:08:14.837007+0000","last_clean":"2024-09-12T18:08:14.837007+0000","last_became_active":"2024-09-12T17:10:42.516802+0000","last_became_peered":"2024-09-12T17:10:42.516802+0000","last_unstale":"2024-09-12T18:08:14.837007+0000","last_undegraded":"2024-09-12T18:08:14.837007+0000","last_fullsized":"2024-09-12T18:08:14.837007+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:48:25.179651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5530186,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":393,"num_read_kb":13109,"num_write":966,"num_write_kb":28742,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7,1],"acting":[0,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"36'4","reported_seq":975,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:09.531956+0000","last_change":"2024-09-12T17:10:46.530932+0000","last_active":"2024-09-12T18:11:09.531956+0000","last_peered":"2024-09-12T18:11:09.531956+0000","last_clean":"2024-09-12T18:11:09.531956+0000","last_became_active":"2024-09-12T17:10:46.530466+0000","last_became_peered":"2024-09-12T17:10:46.530466+0000","last_unstale":"2024-09-12T18:11:09.531956+0000","last_undegraded":"2024-09-12T18:11:09.531956+0000","last_fullsized":"2024-09-12T18:11:09.531956+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_clean_scrub_stamp":"2024-09-12T17:10:45.504515+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:59:20.697816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":718,"num_read_kb":1182,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"263'90","reported_seq":623,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:59.853778+0000","last_change":"2024-09-12T17:10:48.538034+0000","last_active":"2024-09-12T18:08:59.853778+0000","last_peered":"2024-09-12T18:08:59.853778+0000","last_clean":"2024-09-12T18:08:59.853778+0000","last_became_active":"2024-09-12T17:10:48.537715+0000","last_became_peered":"2024-09-12T17:10:48.537715+0000","last_unstale":"2024-09-12T18:08:59.853778+0000","last_undegraded":"2024-09-12T18:08:59.853778+0000","last_fullsized":"2024-09-12T18:08:59.853778+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_clean_scrub_stamp":"2024-09-12T17:10:47.516917+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:50:02.415975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":103,"num_read_kb":94,"num_write":78,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"263'760","reported_seq":2581,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:13.401557+0000","last_change":"2024-09-12T17:10:50.552759+0000","last_active":"2024-09-12T18:11:13.401557+0000","last_peered":"2024-09-12T18:11:13.401557+0000","last_clean":"2024-09-12T18:11:13.401557+0000","last_became_active":"2024-09-12T17:10:50.552439+0000","last_became_peered":"2024-09-12T17:10:50.552439+0000","last_unstale":"2024-09-12T18:11:13.401557+0000","last_undegraded":"2024-09-12T18:11:13.401557+0000","last_fullsized":"2024-09-12T18:11:13.401557+0000","mapping_epoch":32,"log_start":"263'700","ondisk_log_start":"263'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_clean_scrub_stamp":"2024-09-12T17:10:49.533772+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":700,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:05:46.061876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"263'101","reported_seq":599,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:14.856275+0000","last_change":"2024-09-12T17:10:52.576632+0000","last_active":"2024-09-12T18:09:14.856275+0000","last_peered":"2024-09-12T18:09:14.856275+0000","last_clean":"2024-09-12T18:09:14.856275+0000","last_became_active":"2024-09-12T17:10:52.576354+0000","last_became_peered":"2024-09-12T17:10:52.576354+0000","last_unstale":"2024-09-12T18:09:14.856275+0000","last_undegraded":"2024-09-12T18:09:14.856275+0000","last_fullsized":"2024-09-12T18:09:14.856275+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:31:48.033949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":153,"num_read_kb":145,"num_write":246,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"263'888","reported_seq":2559,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:58.602298+0000","last_change":"2024-09-12T17:10:44.515286+0000","last_active":"2024-09-12T18:08:58.602298+0000","last_peered":"2024-09-12T18:08:58.602298+0000","last_clean":"2024-09-12T18:08:58.602298+0000","last_became_active":"2024-09-12T17:10:44.514263+0000","last_became_peered":"2024-09-12T17:10:44.514263+0000","last_unstale":"2024-09-12T18:08:58.602298+0000","last_undegraded":"2024-09-12T18:08:58.602298+0000","last_fullsized":"2024-09-12T18:08:58.602298+0000","mapping_epoch":26,"log_start":"263'800","ondisk_log_start":"263'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":800,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:36:42.105597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4092,"num_read_kb":3689,"num_write":1154,"num_write_kb":400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"263'210","reported_seq":848,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:07.932614+0000","last_change":"2024-09-12T17:10:42.528032+0000","last_active":"2024-09-12T18:09:07.932614+0000","last_peered":"2024-09-12T18:09:07.932614+0000","last_clean":"2024-09-12T18:09:07.932614+0000","last_became_active":"2024-09-12T17:10:42.527644+0000","last_became_peered":"2024-09-12T17:10:42.527644+0000","last_unstale":"2024-09-12T18:09:07.932614+0000","last_undegraded":"2024-09-12T18:09:07.932614+0000","last_fullsized":"2024-09-12T18:09:07.932614+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:07:37.030800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5886518,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":476,"num_read_kb":29326,"num_write":1034,"num_write_kb":31012,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,6],"acting":[5,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:19.848670+0000","last_change":"2024-09-12T17:10:46.532064+0000","last_active":"2024-09-12T18:08:19.848670+0000","last_peered":"2024-09-12T18:08:19.848670+0000","last_clean":"2024-09-12T18:08:19.848670+0000","last_became_active":"2024-09-12T17:10:46.531759+0000","last_became_peered":"2024-09-12T17:10:46.531759+0000","last_unstale":"2024-09-12T18:08:19.848670+0000","last_undegraded":"2024-09-12T18:08:19.848670+0000","last_fullsized":"2024-09-12T18:08:19.848670+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_clean_scrub_stamp":"2024-09-12T17:10:45.504515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:32:10.706827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"263'196","reported_seq":778,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:09.776476+0000","last_change":"2024-09-12T17:10:48.543431+0000","last_active":"2024-09-12T18:11:09.776476+0000","last_peered":"2024-09-12T18:11:09.776476+0000","last_clean":"2024-09-12T18:11:09.776476+0000","last_became_active":"2024-09-12T17:10:48.543123+0000","last_became_peered":"2024-09-12T17:10:48.543123+0000","last_unstale":"2024-09-12T18:11:09.776476+0000","last_undegraded":"2024-09-12T18:11:09.776476+0000","last_fullsized":"2024-09-12T18:11:09.776476+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_clean_scrub_stamp":"2024-09-12T17:10:47.516917+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:14:40.758351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10631,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":239,"num_read_kb":288,"num_write":152,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":491,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:49.841229+0000","last_change":"2024-09-12T17:10:50.556322+0000","last_active":"2024-09-12T18:08:49.841229+0000","last_peered":"2024-09-12T18:08:49.841229+0000","last_clean":"2024-09-12T18:08:49.841229+0000","last_became_active":"2024-09-12T17:10:50.556040+0000","last_became_peered":"2024-09-12T17:10:50.556040+0000","last_unstale":"2024-09-12T18:08:49.841229+0000","last_undegraded":"2024-09-12T18:08:49.841229+0000","last_fullsized":"2024-09-12T18:08:49.841229+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_clean_scrub_stamp":"2024-09-12T17:10:49.533772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:11:28.653630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"263'132","reported_seq":632,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:46.952145+0000","last_change":"2024-09-12T17:10:52.585108+0000","last_active":"2024-09-12T18:09:46.952145+0000","last_peered":"2024-09-12T18:09:46.952145+0000","last_clean":"2024-09-12T18:09:46.952145+0000","last_became_active":"2024-09-12T17:10:52.584752+0000","last_became_peered":"2024-09-12T17:10:52.584752+0000","last_unstale":"2024-09-12T18:09:46.952145+0000","last_undegraded":"2024-09-12T18:09:46.952145+0000","last_fullsized":"2024-09-12T18:09:46.952145+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:17:54.690247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":200,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":199,"num_read_kb":187,"num_write":331,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"263'455","reported_seq":2246,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:41.749674+0000","last_change":"2024-09-12T17:10:44.516055+0000","last_active":"2024-09-12T18:08:41.749674+0000","last_peered":"2024-09-12T18:08:41.749674+0000","last_clean":"2024-09-12T18:08:41.749674+0000","last_became_active":"2024-09-12T17:10:44.515463+0000","last_became_peered":"2024-09-12T17:10:44.515463+0000","last_unstale":"2024-09-12T18:08:41.749674+0000","last_undegraded":"2024-09-12T18:08:41.749674+0000","last_fullsized":"2024-09-12T18:08:41.749674+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":400,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:48:28.929846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2803,"num_read_kb":2700,"num_write":505,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"263'183","reported_seq":799,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:14.846808+0000","last_change":"2024-09-12T17:10:42.530271+0000","last_active":"2024-09-12T18:08:14.846808+0000","last_peered":"2024-09-12T18:08:14.846808+0000","last_clean":"2024-09-12T18:08:14.846808+0000","last_became_active":"2024-09-12T17:10:42.529547+0000","last_became_peered":"2024-09-12T17:10:42.529547+0000","last_unstale":"2024-09-12T18:08:14.846808+0000","last_undegraded":"2024-09-12T18:08:14.846808+0000","last_fullsized":"2024-09-12T18:08:14.846808+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:44:05.993110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10780645,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":388,"num_read_kb":39415,"num_write":887,"num_write_kb":32700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,6],"acting":[5,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:19.847401+0000","last_change":"2024-09-12T17:10:46.532778+0000","last_active":"2024-09-12T18:08:19.847401+0000","last_peered":"2024-09-12T18:08:19.847401+0000","last_clean":"2024-09-12T18:08:19.847401+0000","last_became_active":"2024-09-12T17:10:46.532418+0000","last_became_peered":"2024-09-12T17:10:46.532418+0000","last_unstale":"2024-09-12T18:08:19.847401+0000","last_undegraded":"2024-09-12T18:08:19.847401+0000","last_fullsized":"2024-09-12T18:08:19.847401+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_clean_scrub_stamp":"2024-09-12T17:10:45.504515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:36:54.346427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"263'128","reported_seq":697,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:09.777573+0000","last_change":"2024-09-12T17:10:48.539329+0000","last_active":"2024-09-12T18:11:09.777573+0000","last_peered":"2024-09-12T18:11:09.777573+0000","last_clean":"2024-09-12T18:11:09.777573+0000","last_became_active":"2024-09-12T17:10:48.539047+0000","last_became_peered":"2024-09-12T17:10:48.539047+0000","last_unstale":"2024-09-12T18:11:09.777573+0000","last_undegraded":"2024-09-12T18:11:09.777573+0000","last_fullsized":"2024-09-12T18:11:09.777573+0000","mapping_epoch":30,"log_start":"263'100","ondisk_log_start":"263'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_clean_scrub_stamp":"2024-09-12T17:10:47.516917+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:16:56.494114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7731,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":158,"num_read_kb":203,"num_write":84,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:59.873702+0000","last_change":"2024-09-12T17:10:50.556644+0000","last_active":"2024-09-12T18:08:59.873702+0000","last_peered":"2024-09-12T18:08:59.873702+0000","last_clean":"2024-09-12T18:08:59.873702+0000","last_became_active":"2024-09-12T17:10:50.555858+0000","last_became_peered":"2024-09-12T17:10:50.555858+0000","last_unstale":"2024-09-12T18:08:59.873702+0000","last_undegraded":"2024-09-12T18:08:59.873702+0000","last_fullsized":"2024-09-12T18:08:59.873702+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_clean_scrub_stamp":"2024-09-12T17:10:49.533772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:24:28.762169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"263'112","reported_seq":626,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:55.349086+0000","last_change":"2024-09-12T17:10:52.671426+0000","last_active":"2024-09-12T18:08:55.349086+0000","last_peered":"2024-09-12T18:08:55.349086+0000","last_clean":"2024-09-12T18:08:55.349086+0000","last_became_active":"2024-09-12T17:10:52.671139+0000","last_became_peered":"2024-09-12T17:10:52.671139+0000","last_unstale":"2024-09-12T18:08:55.349086+0000","last_undegraded":"2024-09-12T18:08:55.349086+0000","last_fullsized":"2024-09-12T18:08:55.349086+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:12:33.369332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":178,"num_read_kb":175,"num_write":256,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"263'784","reported_seq":2334,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:06.317962+0000","last_change":"2024-09-12T17:11:16.619107+0000","last_active":"2024-09-12T18:09:06.317962+0000","last_peered":"2024-09-12T18:09:06.317962+0000","last_clean":"2024-09-12T18:09:06.317962+0000","last_became_active":"2024-09-12T17:11:16.618723+0000","last_became_peered":"2024-09-12T17:11:16.618723+0000","last_unstale":"2024-09-12T18:09:06.317962+0000","last_undegraded":"2024-09-12T18:09:06.317962+0000","last_fullsized":"2024-09-12T18:09:06.317962+0000","mapping_epoch":37,"log_start":"263'700","ondisk_log_start":"263'700","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":700,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:07:15.117121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4039,"num_read_kb":3670,"num_write":1050,"num_write_kb":387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"263'170","reported_seq":831,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:59.850448+0000","last_change":"2024-09-12T17:10:42.534710+0000","last_active":"2024-09-12T18:08:59.850448+0000","last_peered":"2024-09-12T18:08:59.850448+0000","last_clean":"2024-09-12T18:08:59.850448+0000","last_became_active":"2024-09-12T17:10:42.534052+0000","last_became_peered":"2024-09-12T17:10:42.534052+0000","last_unstale":"2024-09-12T18:08:59.850448+0000","last_undegraded":"2024-09-12T18:08:59.850448+0000","last_fullsized":"2024-09-12T18:08:59.850448+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:53:24.707491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5576594,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":424,"num_read_kb":101566,"num_write":824,"num_write_kb":35642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7,2],"acting":[3,6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:49.852279+0000","last_change":"2024-09-12T17:10:46.530515+0000","last_active":"2024-09-12T18:08:49.852279+0000","last_peered":"2024-09-12T18:08:49.852279+0000","last_clean":"2024-09-12T18:08:49.852279+0000","last_became_active":"2024-09-12T17:10:46.530079+0000","last_became_peered":"2024-09-12T17:10:46.530079+0000","last_unstale":"2024-09-12T18:08:49.852279+0000","last_undegraded":"2024-09-12T18:08:49.852279+0000","last_fullsized":"2024-09-12T18:08:49.852279+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_clean_scrub_stamp":"2024-09-12T17:10:45.504515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:40:53.204632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"263'100","reported_seq":652,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:10:49.865142+0000","last_change":"2024-09-12T17:10:48.543215+0000","last_active":"2024-09-12T18:10:49.865142+0000","last_peered":"2024-09-12T18:10:49.865142+0000","last_clean":"2024-09-12T18:10:49.865142+0000","last_became_active":"2024-09-12T17:10:48.542918+0000","last_became_peered":"2024-09-12T17:10:48.542918+0000","last_unstale":"2024-09-12T18:10:49.865142+0000","last_undegraded":"2024-09-12T18:10:49.865142+0000","last_fullsized":"2024-09-12T18:10:49.865142+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_clean_scrub_stamp":"2024-09-12T17:10:47.516917+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:28:39.813411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9136,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":120,"num_read_kb":174,"num_write":56,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:19.848339+0000","last_change":"2024-09-12T17:10:50.558543+0000","last_active":"2024-09-12T18:08:19.848339+0000","last_peered":"2024-09-12T18:08:19.848339+0000","last_clean":"2024-09-12T18:08:19.848339+0000","last_became_active":"2024-09-12T17:10:50.558162+0000","last_became_peered":"2024-09-12T17:10:50.558162+0000","last_unstale":"2024-09-12T18:08:19.848339+0000","last_undegraded":"2024-09-12T18:08:19.848339+0000","last_fullsized":"2024-09-12T18:08:19.848339+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_clean_scrub_stamp":"2024-09-12T17:10:49.533772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:13:27.613750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"263'151","reported_seq":1246,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:46.551935+0000","last_change":"2024-09-12T17:10:52.585025+0000","last_active":"2024-09-12T18:09:46.551935+0000","last_peered":"2024-09-12T18:09:46.551935+0000","last_clean":"2024-09-12T18:09:46.551935+0000","last_became_active":"2024-09-12T17:10:52.584763+0000","last_became_peered":"2024-09-12T17:10:52.584763+0000","last_unstale":"2024-09-12T18:09:46.551935+0000","last_undegraded":"2024-09-12T18:09:46.551935+0000","last_fullsized":"2024-09-12T18:09:46.551935+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:21:47.900231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":215,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":802,"num_read_kb":800,"num_write":350,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"263'1272","reported_seq":2975,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:48.690645+0000","last_change":"2024-09-12T17:10:44.513427+0000","last_active":"2024-09-12T18:09:48.690645+0000","last_peered":"2024-09-12T18:09:48.690645+0000","last_clean":"2024-09-12T18:09:48.690645+0000","last_became_active":"2024-09-12T17:10:44.513047+0000","last_became_peered":"2024-09-12T17:10:44.513047+0000","last_unstale":"2024-09-12T18:09:48.690645+0000","last_undegraded":"2024-09-12T18:09:48.690645+0000","last_fullsized":"2024-09-12T18:09:48.690645+0000","mapping_epoch":26,"log_start":"263'1200","ondisk_log_start":"263'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":1200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:58:01.192821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5916,"num_read_kb":5241,"num_write":1773,"num_write_kb":764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"263'261","reported_seq":929,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:04.843299+0000","last_change":"2024-09-12T17:11:16.863072+0000","last_active":"2024-09-12T18:09:04.843299+0000","last_peered":"2024-09-12T18:09:04.843299+0000","last_clean":"2024-09-12T18:09:04.843299+0000","last_became_active":"2024-09-12T17:11:16.862649+0000","last_became_peered":"2024-09-12T17:11:16.862649+0000","last_unstale":"2024-09-12T18:09:04.843299+0000","last_undegraded":"2024-09-12T18:09:04.843299+0000","last_fullsized":"2024-09-12T18:09:04.843299+0000","mapping_epoch":37,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":200,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:36:29.636546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7373923,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":582,"num_read_kb":13957,"num_write":1191,"num_write_kb":16858,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,7],"acting":[0,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"29'1","reported_seq":501,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:55.146197+0000","last_change":"2024-09-12T17:10:46.527752+0000","last_active":"2024-09-12T18:08:55.146197+0000","last_peered":"2024-09-12T18:08:55.146197+0000","last_clean":"2024-09-12T18:08:55.146197+0000","last_became_active":"2024-09-12T17:10:46.527422+0000","last_became_peered":"2024-09-12T17:10:46.527422+0000","last_unstale":"2024-09-12T18:08:55.146197+0000","last_undegraded":"2024-09-12T18:08:55.146197+0000","last_fullsized":"2024-09-12T18:08:55.146197+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_clean_scrub_stamp":"2024-09-12T17:10:45.504515+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:56:46.571241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"263'161","reported_seq":748,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:10:49.740712+0000","last_change":"2024-09-12T17:10:48.545106+0000","last_active":"2024-09-12T18:10:49.740712+0000","last_peered":"2024-09-12T18:10:49.740712+0000","last_clean":"2024-09-12T18:10:49.740712+0000","last_became_active":"2024-09-12T17:10:48.544572+0000","last_became_peered":"2024-09-12T17:10:48.544572+0000","last_unstale":"2024-09-12T18:10:49.740712+0000","last_undegraded":"2024-09-12T18:10:49.740712+0000","last_fullsized":"2024-09-12T18:10:49.740712+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_clean_scrub_stamp":"2024-09-12T17:10:47.516917+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:11:28.036014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9746,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":207,"num_read_kb":258,"num_write":118,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":490,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:19.837629+0000","last_change":"2024-09-12T17:10:50.560331+0000","last_active":"2024-09-12T18:08:19.837629+0000","last_peered":"2024-09-12T18:08:19.837629+0000","last_clean":"2024-09-12T18:08:19.837629+0000","last_became_active":"2024-09-12T17:10:50.560057+0000","last_became_peered":"2024-09-12T17:10:50.560057+0000","last_unstale":"2024-09-12T18:08:19.837629+0000","last_undegraded":"2024-09-12T18:08:19.837629+0000","last_fullsized":"2024-09-12T18:08:19.837629+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_clean_scrub_stamp":"2024-09-12T17:10:49.533772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:11:03.611393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"263'132","reported_seq":623,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:08.654757+0000","last_change":"2024-09-12T17:10:52.570799+0000","last_active":"2024-09-12T18:11:08.654757+0000","last_peered":"2024-09-12T18:11:08.654757+0000","last_clean":"2024-09-12T18:11:08.654757+0000","last_became_active":"2024-09-12T17:10:52.570480+0000","last_became_peered":"2024-09-12T17:10:52.570480+0000","last_unstale":"2024-09-12T18:11:08.654757+0000","last_undegraded":"2024-09-12T18:11:08.654757+0000","last_fullsized":"2024-09-12T18:11:08.654757+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:15:54.371121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":203,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":138,"num_read_kb":137,"num_write":320,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"263'410","reported_seq":1793,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:15.148505+0000","last_change":"2024-09-12T17:10:44.509800+0000","last_active":"2024-09-12T18:09:15.148505+0000","last_peered":"2024-09-12T18:09:15.148505+0000","last_clean":"2024-09-12T18:09:15.148505+0000","last_became_active":"2024-09-12T17:10:44.509508+0000","last_became_peered":"2024-09-12T17:10:44.509508+0000","last_unstale":"2024-09-12T18:09:15.148505+0000","last_undegraded":"2024-09-12T18:09:15.148505+0000","last_fullsized":"2024-09-12T18:09:15.148505+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":300,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:53:56.436440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2094,"num_read_kb":1953,"num_write":504,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"263'237","reported_seq":881,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:04.874429+0000","last_change":"2024-09-12T17:10:42.526128+0000","last_active":"2024-09-12T18:09:04.874429+0000","last_peered":"2024-09-12T18:09:04.874429+0000","last_clean":"2024-09-12T18:09:04.874429+0000","last_became_active":"2024-09-12T17:10:42.521435+0000","last_became_peered":"2024-09-12T17:10:42.521435+0000","last_unstale":"2024-09-12T18:09:04.874429+0000","last_undegraded":"2024-09-12T18:09:04.874429+0000","last_fullsized":"2024-09-12T18:09:04.874429+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":200,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:05:09.412034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4231758,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":523,"num_read_kb":7759,"num_write":1102,"num_write_kb":27695,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,5],"acting":[6,0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"263'492","reported_seq":2208,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:15.148484+0000","last_change":"2024-09-12T17:10:44.519546+0000","last_active":"2024-09-12T18:09:15.148484+0000","last_peered":"2024-09-12T18:09:15.148484+0000","last_clean":"2024-09-12T18:09:15.148484+0000","last_became_active":"2024-09-12T17:10:44.519236+0000","last_became_peered":"2024-09-12T17:10:44.519236+0000","last_unstale":"2024-09-12T18:09:15.148484+0000","last_undegraded":"2024-09-12T18:09:15.148484+0000","last_fullsized":"2024-09-12T18:09:15.148484+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":400,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:12:02.063964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2628,"num_read_kb":2506,"num_write":587,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"263'252","reported_seq":1016,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:04.837434+0000","last_change":"2024-09-12T17:10:42.519763+0000","last_active":"2024-09-12T18:09:04.837434+0000","last_peered":"2024-09-12T18:09:04.837434+0000","last_clean":"2024-09-12T18:09:04.837434+0000","last_became_active":"2024-09-12T17:10:42.519178+0000","last_became_peered":"2024-09-12T17:10:42.519178+0000","last_unstale":"2024-09-12T18:09:04.837434+0000","last_undegraded":"2024-09-12T18:09:04.837434+0000","last_fullsized":"2024-09-12T18:09:04.837434+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:08:25.057371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":93177,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1047,"num_read_kb":7502,"num_write":1180,"num_write_kb":38848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6,7],"acting":[2,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"263'391","reported_seq":1968,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:08.688478+0000","last_change":"2024-09-12T17:10:44.515755+0000","last_active":"2024-09-12T18:11:08.688478+0000","last_peered":"2024-09-12T18:11:08.688478+0000","last_clean":"2024-09-12T18:11:08.688478+0000","last_became_active":"2024-09-12T17:10:44.515474+0000","last_became_peered":"2024-09-12T17:10:44.515474+0000","last_unstale":"2024-09-12T18:11:08.688478+0000","last_undegraded":"2024-09-12T18:11:08.688478+0000","last_fullsized":"2024-09-12T18:11:08.688478+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":300,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:30:06.533570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2306,"num_read_kb":2212,"num_write":451,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"263'192","reported_seq":810,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:34.828005+0000","last_change":"2024-09-12T17:11:16.618040+0000","last_active":"2024-09-12T18:07:34.828005+0000","last_peered":"2024-09-12T18:07:34.828005+0000","last_clean":"2024-09-12T18:07:34.828005+0000","last_became_active":"2024-09-12T17:11:16.617657+0000","last_became_peered":"2024-09-12T17:11:16.617657+0000","last_unstale":"2024-09-12T18:07:34.828005+0000","last_undegraded":"2024-09-12T18:07:34.828005+0000","last_fullsized":"2024-09-12T18:07:34.828005+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:38:48.774645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7665656,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":497,"num_read_kb":26759,"num_write":945,"num_write_kb":25619,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,6],"acting":[2,3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"263'792","reported_seq":2412,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:48.687914+0000","last_change":"2024-09-12T17:10:44.510114+0000","last_active":"2024-09-12T18:09:48.687914+0000","last_peered":"2024-09-12T18:09:48.687914+0000","last_clean":"2024-09-12T18:09:48.687914+0000","last_became_active":"2024-09-12T17:10:44.509845+0000","last_became_peered":"2024-09-12T17:10:44.509845+0000","last_unstale":"2024-09-12T18:09:48.687914+0000","last_undegraded":"2024-09-12T18:09:48.687914+0000","last_fullsized":"2024-09-12T18:09:48.687914+0000","mapping_epoch":26,"log_start":"263'700","ondisk_log_start":"263'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":700,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:49:56.008647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3882,"num_read_kb":3524,"num_write":1030,"num_write_kb":369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"263'222","reported_seq":853,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:14.844465+0000","last_change":"2024-09-12T17:10:42.519992+0000","last_active":"2024-09-12T18:09:14.844465+0000","last_peered":"2024-09-12T18:09:14.844465+0000","last_clean":"2024-09-12T18:09:14.844465+0000","last_became_active":"2024-09-12T17:10:42.519560+0000","last_became_peered":"2024-09-12T17:10:42.519560+0000","last_unstale":"2024-09-12T18:09:14.844465+0000","last_undegraded":"2024-09-12T18:09:14.844465+0000","last_fullsized":"2024-09-12T18:09:14.844465+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:31:06.232228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":497465,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":415,"num_read_kb":2141,"num_write":1021,"num_write_kb":23963,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,1],"acting":[0,3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"263'769","reported_seq":2442,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:19.853137+0000","last_change":"2024-09-12T17:10:44.512192+0000","last_active":"2024-09-12T18:09:19.853137+0000","last_peered":"2024-09-12T18:09:19.853137+0000","last_clean":"2024-09-12T18:09:19.853137+0000","last_became_active":"2024-09-12T17:10:44.511893+0000","last_became_peered":"2024-09-12T17:10:44.511893+0000","last_unstale":"2024-09-12T18:09:19.853137+0000","last_undegraded":"2024-09-12T18:09:19.853137+0000","last_fullsized":"2024-09-12T18:09:19.853137+0000","mapping_epoch":26,"log_start":"263'700","ondisk_log_start":"263'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":700,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:59:22.759342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":3826,"num_read_kb":3490,"num_write":982,"num_write_kb":336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"263'217","reported_seq":1062,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:32.660243+0000","last_change":"2024-09-12T17:10:42.524423+0000","last_active":"2024-09-12T18:09:32.660243+0000","last_peered":"2024-09-12T18:09:32.660243+0000","last_clean":"2024-09-12T18:09:32.660243+0000","last_became_active":"2024-09-12T17:10:42.524018+0000","last_became_peered":"2024-09-12T17:10:42.524018+0000","last_unstale":"2024-09-12T18:09:32.660243+0000","last_undegraded":"2024-09-12T18:09:32.660243+0000","last_fullsized":"2024-09-12T18:09:32.660243+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:08:56.591768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12496189,"num_objects":13,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":1292,"num_read_kb":150766,"num_write":982,"num_write_kb":42134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0,7],"acting":[3,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"263'524","reported_seq":2019,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:04.854464+0000","last_change":"2024-09-12T17:10:44.509706+0000","last_active":"2024-09-12T18:09:04.854464+0000","last_peered":"2024-09-12T18:09:04.854464+0000","last_clean":"2024-09-12T18:09:04.854464+0000","last_became_active":"2024-09-12T17:10:44.509433+0000","last_became_peered":"2024-09-12T17:10:44.509433+0000","last_unstale":"2024-09-12T18:09:04.854464+0000","last_undegraded":"2024-09-12T18:09:04.854464+0000","last_fullsized":"2024-09-12T18:09:04.854464+0000","mapping_epoch":26,"log_start":"263'500","ondisk_log_start":"263'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":500,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:43:58.521596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2637,"num_read_kb":2409,"num_write":664,"num_write_kb":195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"263'177","reported_seq":837,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:15.148464+0000","last_change":"2024-09-12T17:10:42.515059+0000","last_active":"2024-09-12T18:09:15.148464+0000","last_peered":"2024-09-12T18:09:15.148464+0000","last_clean":"2024-09-12T18:09:15.148464+0000","last_became_active":"2024-09-12T17:10:42.514593+0000","last_became_peered":"2024-09-12T17:10:42.514593+0000","last_unstale":"2024-09-12T18:09:15.148464+0000","last_undegraded":"2024-09-12T18:09:15.148464+0000","last_fullsized":"2024-09-12T18:09:15.148464+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:42:35.824857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5511218,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":481,"num_read_kb":20980,"num_write":840,"num_write_kb":34024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,5],"acting":[1,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"263'1124","reported_seq":2692,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:08.688159+0000","last_change":"2024-09-12T17:10:44.523190+0000","last_active":"2024-09-12T18:11:08.688159+0000","last_peered":"2024-09-12T18:11:08.688159+0000","last_clean":"2024-09-12T18:11:08.688159+0000","last_became_active":"2024-09-12T17:10:44.522911+0000","last_became_peered":"2024-09-12T17:10:44.522911+0000","last_unstale":"2024-09-12T18:11:08.688159+0000","last_undegraded":"2024-09-12T18:11:08.688159+0000","last_fullsized":"2024-09-12T18:11:08.688159+0000","mapping_epoch":26,"log_start":"263'1100","ondisk_log_start":"263'1100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":1100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:09:01.732616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5182,"num_read_kb":4601,"num_write":1539,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"263'192","reported_seq":838,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:14.876120+0000","last_change":"2024-09-12T17:10:42.525103+0000","last_active":"2024-09-12T18:09:14.876120+0000","last_peered":"2024-09-12T18:09:14.876120+0000","last_clean":"2024-09-12T18:09:14.876120+0000","last_became_active":"2024-09-12T17:10:42.520304+0000","last_became_peered":"2024-09-12T17:10:42.520304+0000","last_unstale":"2024-09-12T18:09:14.876120+0000","last_undegraded":"2024-09-12T18:09:14.876120+0000","last_fullsized":"2024-09-12T18:09:14.876120+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:45:02.245757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1376916,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":491,"num_read_kb":8074,"num_write":950,"num_write_kb":20454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4,5],"acting":[6,7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"263'882","reported_seq":2582,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:04.874441+0000","last_change":"2024-09-12T17:10:44.518118+0000","last_active":"2024-09-12T18:09:04.874441+0000","last_peered":"2024-09-12T18:09:04.874441+0000","last_clean":"2024-09-12T18:09:04.874441+0000","last_became_active":"2024-09-12T17:10:44.517530+0000","last_became_peered":"2024-09-12T17:10:44.517530+0000","last_unstale":"2024-09-12T18:09:04.874441+0000","last_undegraded":"2024-09-12T18:09:04.874441+0000","last_fullsized":"2024-09-12T18:09:04.874441+0000","mapping_epoch":26,"log_start":"263'800","ondisk_log_start":"263'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":800,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:43:44.156580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4395,"num_read_kb":3967,"num_write":1219,"num_write_kb":499,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"263'182","reported_seq":803,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:32.300512+0000","last_change":"2024-09-12T17:10:42.529286+0000","last_active":"2024-09-12T18:09:32.300512+0000","last_peered":"2024-09-12T18:09:32.300512+0000","last_clean":"2024-09-12T18:09:32.300512+0000","last_became_active":"2024-09-12T17:10:42.528899+0000","last_became_peered":"2024-09-12T17:10:42.528899+0000","last_unstale":"2024-09-12T18:09:32.300512+0000","last_undegraded":"2024-09-12T18:09:32.300512+0000","last_fullsized":"2024-09-12T18:09:32.300512+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:26:02.984559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12665800,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":384,"num_read_kb":42419,"num_write":864,"num_write_kb":46548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,5],"acting":[3,4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"263'385","reported_seq":1841,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:49.548319+0000","last_change":"2024-09-12T17:10:44.523470+0000","last_active":"2024-09-12T18:09:49.548319+0000","last_peered":"2024-09-12T18:09:49.548319+0000","last_clean":"2024-09-12T18:09:49.548319+0000","last_became_active":"2024-09-12T17:10:44.523173+0000","last_became_peered":"2024-09-12T17:10:44.523173+0000","last_unstale":"2024-09-12T18:09:49.548319+0000","last_undegraded":"2024-09-12T18:09:49.548319+0000","last_fullsized":"2024-09-12T18:09:49.548319+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":300,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:42:05.823212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2006,"num_read_kb":1913,"num_write":441,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"263'147","reported_seq":841,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:29.858956+0000","last_change":"2024-09-12T17:10:42.522274+0000","last_active":"2024-09-12T18:09:29.858956+0000","last_peered":"2024-09-12T18:09:29.858956+0000","last_clean":"2024-09-12T18:09:29.858956+0000","last_became_active":"2024-09-12T17:10:42.521824+0000","last_became_peered":"2024-09-12T17:10:42.521824+0000","last_unstale":"2024-09-12T18:09:29.858956+0000","last_undegraded":"2024-09-12T18:09:29.858956+0000","last_fullsized":"2024-09-12T18:09:29.858956+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:16:48.589688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6314985,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":602,"num_read_kb":135941,"num_write":771,"num_write_kb":15017,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"263'497","reported_seq":2137,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:04.854605+0000","last_change":"2024-09-12T17:10:44.517504+0000","last_active":"2024-09-12T18:09:04.854605+0000","last_peered":"2024-09-12T18:09:04.854605+0000","last_clean":"2024-09-12T18:09:04.854605+0000","last_became_active":"2024-09-12T17:10:44.517175+0000","last_became_peered":"2024-09-12T17:10:44.517175+0000","last_unstale":"2024-09-12T18:09:04.854605+0000","last_undegraded":"2024-09-12T18:09:04.854605+0000","last_fullsized":"2024-09-12T18:09:04.854605+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":400,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:08:58.263083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2646,"num_read_kb":2487,"num_write":582,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"263'171","reported_seq":785,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:14.852332+0000","last_change":"2024-09-12T17:10:42.525302+0000","last_active":"2024-09-12T18:09:14.852332+0000","last_peered":"2024-09-12T18:09:14.852332+0000","last_clean":"2024-09-12T18:09:14.852332+0000","last_became_active":"2024-09-12T17:10:42.524860+0000","last_became_peered":"2024-09-12T17:10:42.524860+0000","last_unstale":"2024-09-12T18:09:14.852332+0000","last_undegraded":"2024-09-12T18:09:14.852332+0000","last_fullsized":"2024-09-12T18:09:14.852332+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":100,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:46:29.731094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":409,"num_read_kb":436,"num_write":844,"num_write_kb":16042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,1],"acting":[3,4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"263'738","reported_seq":2312,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:49.547357+0000","last_change":"2024-09-12T17:10:44.515129+0000","last_active":"2024-09-12T18:09:49.547357+0000","last_peered":"2024-09-12T18:09:49.547357+0000","last_clean":"2024-09-12T18:09:49.547357+0000","last_became_active":"2024-09-12T17:10:44.514847+0000","last_became_peered":"2024-09-12T17:10:44.514847+0000","last_unstale":"2024-09-12T18:09:49.547357+0000","last_undegraded":"2024-09-12T18:09:49.547357+0000","last_fullsized":"2024-09-12T18:09:49.547357+0000","mapping_epoch":26,"log_start":"263'700","ondisk_log_start":"263'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":700,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:19:38.676107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3592,"num_read_kb":3279,"num_write":969,"num_write_kb":334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"263'228","reported_seq":885,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:14.855205+0000","last_change":"2024-09-12T17:10:42.520188+0000","last_active":"2024-09-12T18:09:14.855205+0000","last_peered":"2024-09-12T18:09:14.855205+0000","last_clean":"2024-09-12T18:09:14.855205+0000","last_became_active":"2024-09-12T17:10:42.519789+0000","last_became_peered":"2024-09-12T17:10:42.519789+0000","last_unstale":"2024-09-12T18:09:14.855205+0000","last_undegraded":"2024-09-12T18:09:14.855205+0000","last_fullsized":"2024-09-12T18:09:14.855205+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":200,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:18:08.752971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6373233,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":561,"num_read_kb":21140,"num_write":1102,"num_write_kb":33501,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,3],"acting":[5,7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"263'451","reported_seq":1945,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:49.546842+0000","last_change":"2024-09-12T17:10:44.512379+0000","last_active":"2024-09-12T18:09:49.546842+0000","last_peered":"2024-09-12T18:09:49.546842+0000","last_clean":"2024-09-12T18:09:49.546842+0000","last_became_active":"2024-09-12T17:10:44.510280+0000","last_became_peered":"2024-09-12T17:10:44.510280+0000","last_unstale":"2024-09-12T18:09:49.546842+0000","last_undegraded":"2024-09-12T18:09:49.546842+0000","last_fullsized":"2024-09-12T18:09:49.546842+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":400,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:12:26.413167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2351,"num_read_kb":2195,"num_write":554,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"263'148","reported_seq":746,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:14.844500+0000","last_change":"2024-09-12T17:10:42.521419+0000","last_active":"2024-09-12T18:09:14.844500+0000","last_peered":"2024-09-12T18:09:14.844500+0000","last_clean":"2024-09-12T18:09:14.844500+0000","last_became_active":"2024-09-12T17:10:42.520020+0000","last_became_peered":"2024-09-12T17:10:42.520020+0000","last_unstale":"2024-09-12T18:09:14.844500+0000","last_undegraded":"2024-09-12T18:09:14.844500+0000","last_fullsized":"2024-09-12T18:09:14.844500+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:41:55.197067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5664710,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":326,"num_read_kb":1191,"num_write":745,"num_write_kb":23442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,6],"acting":[0,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"263'357","reported_seq":1770,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:49.547933+0000","last_change":"2024-09-12T17:10:44.516984+0000","last_active":"2024-09-12T18:09:49.547933+0000","last_peered":"2024-09-12T18:09:49.547933+0000","last_clean":"2024-09-12T18:09:49.547933+0000","last_became_active":"2024-09-12T17:10:44.516697+0000","last_became_peered":"2024-09-12T17:10:44.516697+0000","last_unstale":"2024-09-12T18:09:49.547933+0000","last_undegraded":"2024-09-12T18:09:49.547933+0000","last_fullsized":"2024-09-12T18:09:49.547933+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:36:09.173783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1919,"num_read_kb":1833,"num_write":391,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"263'207","reported_seq":867,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:34.828036+0000","last_change":"2024-09-12T17:11:16.863226+0000","last_active":"2024-09-12T18:07:34.828036+0000","last_peered":"2024-09-12T18:07:34.828036+0000","last_clean":"2024-09-12T18:07:34.828036+0000","last_became_active":"2024-09-12T17:11:16.862645+0000","last_became_peered":"2024-09-12T17:11:16.862645+0000","last_unstale":"2024-09-12T18:07:34.828036+0000","last_undegraded":"2024-09-12T18:07:34.828036+0000","last_fullsized":"2024-09-12T18:07:34.828036+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:47:44.135027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5606243,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":575,"num_read_kb":84325,"num_write":973,"num_write_kb":27874,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,0,7],"acting":[2,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"263'818","reported_seq":2282,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:14.844433+0000","last_change":"2024-09-12T17:10:44.519568+0000","last_active":"2024-09-12T18:09:14.844433+0000","last_peered":"2024-09-12T18:09:14.844433+0000","last_clean":"2024-09-12T18:09:14.844433+0000","last_became_active":"2024-09-12T17:10:44.519253+0000","last_became_peered":"2024-09-12T17:10:44.519253+0000","last_unstale":"2024-09-12T18:09:14.844433+0000","last_undegraded":"2024-09-12T18:09:14.844433+0000","last_fullsized":"2024-09-12T18:09:14.844433+0000","mapping_epoch":26,"log_start":"263'800","ondisk_log_start":"263'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":800,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:17:25.711902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3866,"num_read_kb":3440,"num_write":1124,"num_write_kb":450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"263'180","reported_seq":788,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:24.858062+0000","last_change":"2024-09-12T17:10:42.524574+0000","last_active":"2024-09-12T18:09:24.858062+0000","last_peered":"2024-09-12T18:09:24.858062+0000","last_clean":"2024-09-12T18:09:24.858062+0000","last_became_active":"2024-09-12T17:10:42.524098+0000","last_became_peered":"2024-09-12T17:10:42.524098+0000","last_unstale":"2024-09-12T18:09:24.858062+0000","last_undegraded":"2024-09-12T18:09:24.858062+0000","last_fullsized":"2024-09-12T18:09:24.858062+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:13:35.032725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5270092,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":368,"num_read_kb":5543,"num_write":828,"num_write_kb":19602,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6,3],"acting":[7,2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"263'416","reported_seq":2003,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:20.794247+0000","last_change":"2024-09-12T17:10:44.515468+0000","last_active":"2024-09-12T18:09:20.794247+0000","last_peered":"2024-09-12T18:09:20.794247+0000","last_clean":"2024-09-12T18:09:20.794247+0000","last_became_active":"2024-09-12T17:10:44.514154+0000","last_became_peered":"2024-09-12T17:10:44.514154+0000","last_unstale":"2024-09-12T18:09:20.794247+0000","last_undegraded":"2024-09-12T18:09:20.794247+0000","last_fullsized":"2024-09-12T18:09:20.794247+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":400,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:10:07.030810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2340,"num_read_kb":2233,"num_write":478,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"263'219","reported_seq":838,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:05.578638+0000","last_change":"2024-09-12T17:10:42.519764+0000","last_active":"2024-09-12T18:09:05.578638+0000","last_peered":"2024-09-12T18:09:05.578638+0000","last_clean":"2024-09-12T18:09:05.578638+0000","last_became_active":"2024-09-12T17:10:42.519316+0000","last_became_peered":"2024-09-12T17:10:42.519316+0000","last_unstale":"2024-09-12T18:09:05.578638+0000","last_undegraded":"2024-09-12T18:09:05.578638+0000","last_fullsized":"2024-09-12T18:09:05.578638+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:10:02.857764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5965451,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":501,"num_read_kb":7212,"num_write":958,"num_write_kb":24573,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1,7],"acting":[2,6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"263'434","reported_seq":2034,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:08.687986+0000","last_change":"2024-09-12T17:10:44.513885+0000","last_active":"2024-09-12T18:11:08.687986+0000","last_peered":"2024-09-12T18:11:08.687986+0000","last_clean":"2024-09-12T18:11:08.687986+0000","last_became_active":"2024-09-12T17:10:44.513514+0000","last_became_peered":"2024-09-12T17:10:44.513514+0000","last_unstale":"2024-09-12T18:11:08.687986+0000","last_undegraded":"2024-09-12T18:11:08.687986+0000","last_fullsized":"2024-09-12T18:11:08.687986+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":400,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:13:21.567231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2337,"num_read_kb":2234,"num_write":490,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"263'143","reported_seq":759,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:04.853823+0000","last_change":"2024-09-12T17:10:42.527461+0000","last_active":"2024-09-12T18:09:04.853823+0000","last_peered":"2024-09-12T18:09:04.853823+0000","last_clean":"2024-09-12T18:09:04.853823+0000","last_became_active":"2024-09-12T17:10:42.527050+0000","last_became_peered":"2024-09-12T17:10:42.527050+0000","last_unstale":"2024-09-12T18:09:04.853823+0000","last_undegraded":"2024-09-12T18:09:04.853823+0000","last_fullsized":"2024-09-12T18:09:04.853823+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:48:18.827396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7398100,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":318,"num_read_kb":34406,"num_write":729,"num_write_kb":29438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4,6],"acting":[5,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"263'191","reported_seq":828,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:04.853681+0000","last_change":"2024-09-12T17:10:42.524416+0000","last_active":"2024-09-12T18:09:04.853681+0000","last_peered":"2024-09-12T18:09:04.853681+0000","last_clean":"2024-09-12T18:09:04.853681+0000","last_became_active":"2024-09-12T17:10:42.523311+0000","last_became_peered":"2024-09-12T17:10:42.523311+0000","last_unstale":"2024-09-12T18:09:04.853681+0000","last_undegraded":"2024-09-12T18:09:04.853681+0000","last_fullsized":"2024-09-12T18:09:04.853681+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:26:51.477607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9029807,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":463,"num_read_kb":32297,"num_write":952,"num_write_kb":18657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,7],"acting":[5,1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"263'821","reported_seq":2264,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:20.794810+0000","last_change":"2024-09-12T17:10:44.523554+0000","last_active":"2024-09-12T18:09:20.794810+0000","last_peered":"2024-09-12T18:09:20.794810+0000","last_clean":"2024-09-12T18:09:20.794810+0000","last_became_active":"2024-09-12T17:10:44.523243+0000","last_became_peered":"2024-09-12T17:10:44.523243+0000","last_unstale":"2024-09-12T18:09:20.794810+0000","last_undegraded":"2024-09-12T18:09:20.794810+0000","last_fullsized":"2024-09-12T18:09:20.794810+0000","mapping_epoch":26,"log_start":"263'800","ondisk_log_start":"263'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":800,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:20:39.715953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3977,"num_read_kb":3544,"num_write":1118,"num_write_kb":432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"263'231","reported_seq":876,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:05.147204+0000","last_change":"2024-09-12T17:10:42.520724+0000","last_active":"2024-09-12T18:09:05.147204+0000","last_peered":"2024-09-12T18:09:05.147204+0000","last_clean":"2024-09-12T18:09:05.147204+0000","last_became_active":"2024-09-12T17:10:42.519643+0000","last_became_peered":"2024-09-12T17:10:42.519643+0000","last_unstale":"2024-09-12T18:09:05.147204+0000","last_undegraded":"2024-09-12T18:09:05.147204+0000","last_fullsized":"2024-09-12T18:09:05.147204+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:32:38.227259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16870164,"num_objects":11,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":410,"num_read_kb":42701,"num_write":975,"num_write_kb":42419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5,0],"acting":[1,4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"263'612","reported_seq":2303,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:49.548577+0000","last_change":"2024-09-12T17:10:44.512927+0000","last_active":"2024-09-12T18:09:49.548577+0000","last_peered":"2024-09-12T18:09:49.548577+0000","last_clean":"2024-09-12T18:09:49.548577+0000","last_became_active":"2024-09-12T17:10:44.512488+0000","last_became_peered":"2024-09-12T17:10:44.512488+0000","last_unstale":"2024-09-12T18:09:49.548577+0000","last_undegraded":"2024-09-12T18:09:49.548577+0000","last_fullsized":"2024-09-12T18:09:49.548577+0000","mapping_epoch":26,"log_start":"263'600","ondisk_log_start":"263'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":600,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:26:47.580747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3240,"num_read_kb":2966,"num_write":800,"num_write_kb":244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6085,"num_read_kb":4263,"num_write":1964,"num_write_kb":863,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1035,"ondisk_log_size":1035,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15869,"num_objects":86,"num_object_clones":0,"num_object_copies":172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":86,"num_whiteouts":0,"num_read":16199,"num_read_kb":15883,"num_write":16708,"num_write_kb":4876,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":31738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1652,"ondisk_log_size":1652,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":546,"ondisk_log_size":546,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":361433,"num_objects":199,"num_object_clones":0,"num_object_copies":398,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":199,"num_whiteouts":0,"num_read":8534,"num_read_kb":10169,"num_write":5927,"num_write_kb":2764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":679936,"data_stored":186332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1924,"ondisk_log_size":1924,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2383,"num_read_kb":2845,"num_write":20,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":165,"num_object_clones":0,"num_object_copies":330,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":165,"num_whiteouts":0,"num_read":212965,"num_read_kb":194286,"num_write":55441,"num_write_kb":18926,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":165,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4199,"ondisk_log_size":4199,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":451889251,"num_objects":466,"num_object_clones":0,"num_object_copies":1864,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":466,"num_whiteouts":0,"num_read":32822,"num_read_kb":2020284,"num_write":62577,"num_write_kb":2063190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":607125504,"data_stored":607125504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4003,"ondisk_log_size":4003,"up":256,"acting":256,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":74503726,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":122,"num_read_kb":196715,"num_write":139,"num_write_kb":127071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":149012480,"data_stored":149007452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":74503726,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":118,"num_read_kb":189543,"num_write":139,"num_write_kb":127071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":149012480,"data_stored":149007452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575589,"num_pgs":116,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":329772,"kb_used_data":87580,"kb_used_omap":1,"kb_used_meta":242174,"kb_avail":94042068,"statfs":{"total":96636764160,"available":96299077632,"internally_reserved":0,"allocated":89681920,"data_stored":87641193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":247986635},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575587,"num_pgs":107,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":345608,"kb_used_data":111736,"kb_used_omap":1,"kb_used_meta":233854,"kb_avail":94026232,"statfs":{"total":96636764160,"available":96282861568,"internally_reserved":0,"allocated":114417664,"data_stored":112452529,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":239466950},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575592,"num_pgs":113,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":206216,"kb_used_data":98680,"kb_used_omap":1,"kb_used_meta":107518,"kb_avail":94165624,"statfs":{"total":96636764160,"available":96425598976,"internally_reserved":0,"allocated":101048320,"data_stored":98974813,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":110098885},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575587,"num_pgs":113,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":217280,"kb_used_data":105584,"kb_used_omap":1,"kb_used_meta":111678,"kb_avail":94154560,"statfs":{"total":96636764160,"available":96414269440,"internally_reserved":0,"allocated":108118016,"data_stored":106180950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":114358725},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575589,"num_pgs":130,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":383128,"kb_used_data":145096,"kb_used_omap":1,"kb_used_meta":238014,"kb_avail":93988712,"statfs":{"total":96636764160,"available":96244441088,"internally_reserved":0,"allocated":148578304,"data_stored":146564735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":243726791},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575589,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":204752,"kb_used_data":115264,"kb_used_omap":1,"kb_used_meta":89470,"kb_avail":94167088,"statfs":{"total":96636764160,"available":96427098112,"internally_reserved":0,"allocated":118030336,"data_stored":116093919,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":91617733},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575587,"num_pgs":120,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":280016,"kb_used_data":132288,"kb_used_omap":1,"kb_used_meta":147710,"kb_avail":94091824,"statfs":{"total":96636764160,"available":96350027776,"internally_reserved":0,"allocated":135462912,"data_stored":133462601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":151255493},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575587,"num_pgs":116,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":356172,"kb_used_data":122300,"kb_used_omap":1,"kb_used_meta":233854,"kb_avail":94015668,"statfs":{"total":96636764160,"available":96272044032,"internally_reserved":0,"allocated":125235200,"data_stored":123232330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":239466949},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":80457728,"data_stored":80457728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":90275840,"data_stored":90275840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":66637824,"data_stored":66637824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":77160448,"data_stored":77160448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":70307840,"data_stored":70307840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":77750272,"data_stored":77750272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":68227072,"data_stored":68227072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":76308480,"data_stored":76308480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":24849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":25235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":8663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":27561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":5553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":135168,"data_stored":39032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":18055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":139264,"data_stored":37384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":4345,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":5119,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":3919,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":4996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3623,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":3527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":17879040,"data_stored":17877415,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":37748736,"data_stored":37748736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16777216,"data_stored":16777216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":14684160,"data_stored":14683271,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":18874368,"data_stored":18874368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":13680640,"data_stored":13679901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20975616,"data_stored":20974730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8392704,"data_stored":8391815,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":22020096,"data_stored":22020096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":3149824,"data_stored":3148938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":30408704,"data_stored":30408704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":52432896,"data_stored":52432007,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":14733312,"data_stored":14731687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20971520,"data_stored":20971520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":51620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T18:11:42.596 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T18:11:42.933 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T18:11:42.933 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":263,"fsid":"46ca2ab5-4447-4511-b6c4-0ec801120127","created":"2024-09-12T17:10:10.692676+0000","modified":"2024-09-12T17:46:58.064987+0000","last_up_change":"2024-09-12T17:10:23.790424+0000","last_in_change":"2024-09-12T17:10:13.936520+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":15,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":68,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T17:10:25.183922+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T17:10:30.069092+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":21,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-09-12T17:10:40.477513+0000","flags":1,"flags_names":"hashpspool","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"client.0","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":12288,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-09-12T17:10:42.850885+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-09-12T17:10:44.673473+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-09-12T17:10:46.795419+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-09-12T17:10:48.545664+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-09-12T17:10:50.628286+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":65,"pool_name":"default.rgw.buckets.non-ec","create_time":"2024-09-12T17:26:34.622911+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"252","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":66,"pool_name":"default.rgw.buckets.data.frozen","create_time":"2024-09-12T17:30:11.414021+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"255","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":67,"pool_name":"default.rgw.buckets.data.lukewarm","create_time":"2024-09-12T17:30:15.160185+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"258","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":68,"pool_name":"default.rgw.otp","create_time":"2024-09-12T17:46:55.893407+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"263","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"85173859-eaf8-4da6-b3f3-7e633fa9dff4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":261,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":167247030},{"type":"v1","addr":"172.21.15.37:6809","nonce":167247030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":167247030},{"type":"v1","addr":"172.21.15.37:6811","nonce":167247030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":167247030},{"type":"v1","addr":"172.21.15.37:6815","nonce":167247030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":167247030},{"type":"v1","addr":"172.21.15.37:6813","nonce":167247030}]},"public_addr":"172.21.15.37:6809/167247030","cluster_addr":"172.21.15.37:6811/167247030","heartbeat_back_addr":"172.21.15.37:6815/167247030","heartbeat_front_addr":"172.21.15.37:6813/167247030","state":["exists","up"]},{"osd":1,"uuid":"9d40d17a-300b-457e-8324-34516d02eff7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":261,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":3990661154},{"type":"v1","addr":"172.21.15.37:6825","nonce":3990661154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":3990661154},{"type":"v1","addr":"172.21.15.37:6827","nonce":3990661154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":3990661154},{"type":"v1","addr":"172.21.15.37:6831","nonce":3990661154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":3990661154},{"type":"v1","addr":"172.21.15.37:6829","nonce":3990661154}]},"public_addr":"172.21.15.37:6825/3990661154","cluster_addr":"172.21.15.37:6827/3990661154","heartbeat_back_addr":"172.21.15.37:6831/3990661154","heartbeat_front_addr":"172.21.15.37:6829/3990661154","state":["exists","up"]},{"osd":2,"uuid":"684d7179-44ff-4207-99d6-83d95d5db0bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":261,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1206746176},{"type":"v1","addr":"172.21.15.37:6801","nonce":1206746176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1206746176},{"type":"v1","addr":"172.21.15.37:6803","nonce":1206746176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1206746176},{"type":"v1","addr":"172.21.15.37:6807","nonce":1206746176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1206746176},{"type":"v1","addr":"172.21.15.37:6805","nonce":1206746176}]},"public_addr":"172.21.15.37:6801/1206746176","cluster_addr":"172.21.15.37:6803/1206746176","heartbeat_back_addr":"172.21.15.37:6807/1206746176","heartbeat_front_addr":"172.21.15.37:6805/1206746176","state":["exists","up"]},{"osd":3,"uuid":"4e13403e-0956-4353-87cf-374da1cd2935","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":261,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":2964054205},{"type":"v1","addr":"172.21.15.37:6817","nonce":2964054205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":2964054205},{"type":"v1","addr":"172.21.15.37:6819","nonce":2964054205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":2964054205},{"type":"v1","addr":"172.21.15.37:6823","nonce":2964054205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":2964054205},{"type":"v1","addr":"172.21.15.37:6821","nonce":2964054205}]},"public_addr":"172.21.15.37:6817/2964054205","cluster_addr":"172.21.15.37:6819/2964054205","heartbeat_back_addr":"172.21.15.37:6823/2964054205","heartbeat_front_addr":"172.21.15.37:6821/2964054205","state":["exists","up"]},{"osd":4,"uuid":"2b281492-b877-4995-a762-c5568301e966","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":261,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":2441293461},{"type":"v1","addr":"172.21.15.40:6801","nonce":2441293461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":2441293461},{"type":"v1","addr":"172.21.15.40:6803","nonce":2441293461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":2441293461},{"type":"v1","addr":"172.21.15.40:6807","nonce":2441293461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":2441293461},{"type":"v1","addr":"172.21.15.40:6805","nonce":2441293461}]},"public_addr":"172.21.15.40:6801/2441293461","cluster_addr":"172.21.15.40:6803/2441293461","heartbeat_back_addr":"172.21.15.40:6807/2441293461","heartbeat_front_addr":"172.21.15.40:6805/2441293461","state":["exists","up"]},{"osd":5,"uuid":"5f576703-45a0-4ba6-9bbe-eb19b2734279","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":261,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":4130399962},{"type":"v1","addr":"172.21.15.40:6827","nonce":4130399962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":4130399962},{"type":"v1","addr":"172.21.15.40:6829","nonce":4130399962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":4130399962},{"type":"v1","addr":"172.21.15.40:6833","nonce":4130399962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":4130399962},{"type":"v1","addr":"172.21.15.40:6831","nonce":4130399962}]},"public_addr":"172.21.15.40:6827/4130399962","cluster_addr":"172.21.15.40:6829/4130399962","heartbeat_back_addr":"172.21.15.40:6833/4130399962","heartbeat_front_addr":"172.21.15.40:6831/4130399962","state":["exists","up"]},{"osd":6,"uuid":"4f8ab3f8-603e-4c9d-a1ec-7ad004f0df28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":261,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":2253405131},{"type":"v1","addr":"172.21.15.40:6809","nonce":2253405131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":2253405131},{"type":"v1","addr":"172.21.15.40:6811","nonce":2253405131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":2253405131},{"type":"v1","addr":"172.21.15.40:6815","nonce":2253405131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":2253405131},{"type":"v1","addr":"172.21.15.40:6813","nonce":2253405131}]},"public_addr":"172.21.15.40:6809/2253405131","cluster_addr":"172.21.15.40:6811/2253405131","heartbeat_back_addr":"172.21.15.40:6815/2253405131","heartbeat_front_addr":"172.21.15.40:6813/2253405131","state":["exists","up"]},{"osd":7,"uuid":"62b270ee-ab06-4020-a5f1-9b01ec22a5ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":261,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":1210108009},{"type":"v1","addr":"172.21.15.40:6819","nonce":1210108009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":1210108009},{"type":"v1","addr":"172.21.15.40:6821","nonce":1210108009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":1210108009},{"type":"v1","addr":"172.21.15.40:6825","nonce":1210108009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":1210108009},{"type":"v1","addr":"172.21.15.40:6823","nonce":1210108009}]},"public_addr":"172.21.15.40:6819/1210108009","cluster_addr":"172.21.15.40:6821/1210108009","heartbeat_back_addr":"172.21.15.40:6825/1210108009","heartbeat_front_addr":"172.21.15.40:6823/1210108009","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:10:20.324419+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:10:20.548440+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:10:20.046599+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:10:20.703116+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:10:19.792341+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:10:20.456210+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:10:19.803964+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:10:19.932197+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.b","mappings":[{"from":0,"to":2}]},{"pgid":"3.15","mappings":[{"from":7,"to":2}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.1a","mappings":[{"from":4,"to":3}]},{"pgid":"3.1f","mappings":[{"from":5,"to":1}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.2c","mappings":[{"from":6,"to":2}]},{"pgid":"4.a","mappings":[{"from":1,"to":2}]},{"pgid":"4.19","mappings":[{"from":3,"to":5}]},{"pgid":"67.14","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"client.0":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"3","m":"1","name":"testprofile","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":26,"snaps":[{"begin":1,"length":2}]},{"pool":31,"snaps":[{"begin":1,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T18:11:43.948 INFO:tasks.ceph:Scrubbing osd.0 2024-09-12T18:11:43.948 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-12T18:11:44.104 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-09-12T18:11:44.105 INFO:teuthology.orchestra.run.smithi037.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T18:11:44.105 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-09-12T18:11:44.116 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-12T18:11:44.432 INFO:teuthology.orchestra.run.smithi037.stderr:instructed osd(s) 0 to deep-scrub 2024-09-12T18:11:44.445 INFO:tasks.ceph:Scrubbing osd.1 2024-09-12T18:11:44.445 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-12T18:11:44.587 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-09-12T18:11:44.587 INFO:teuthology.orchestra.run.smithi037.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T18:11:44.587 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-09-12T18:11:44.598 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-12T18:11:44.913 INFO:teuthology.orchestra.run.smithi037.stderr:instructed osd(s) 1 to deep-scrub 2024-09-12T18:11:44.927 INFO:tasks.ceph:Scrubbing osd.2 2024-09-12T18:11:44.928 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-12T18:11:45.069 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-09-12T18:11:45.069 INFO:teuthology.orchestra.run.smithi037.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T18:11:45.069 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-09-12T18:11:45.080 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-12T18:11:45.394 INFO:teuthology.orchestra.run.smithi037.stderr:instructed osd(s) 2 to deep-scrub 2024-09-12T18:11:45.409 INFO:tasks.ceph:Scrubbing osd.3 2024-09-12T18:11:45.409 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-12T18:11:45.551 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-09-12T18:11:45.551 INFO:teuthology.orchestra.run.smithi037.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T18:11:45.551 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-09-12T18:11:45.562 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-12T18:11:45.879 INFO:teuthology.orchestra.run.smithi037.stderr:instructed osd(s) 3 to deep-scrub 2024-09-12T18:11:45.893 INFO:tasks.ceph:Scrubbing osd.4 2024-09-12T18:11:45.893 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-12T18:11:46.037 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-09-12T18:11:46.037 INFO:teuthology.orchestra.run.smithi037.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T18:11:46.037 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-09-12T18:11:46.047 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-12T18:11:46.360 INFO:teuthology.orchestra.run.smithi037.stderr:instructed osd(s) 4 to deep-scrub 2024-09-12T18:11:46.373 INFO:tasks.ceph:Scrubbing osd.5 2024-09-12T18:11:46.373 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-12T18:11:46.516 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-09-12T18:11:46.516 INFO:teuthology.orchestra.run.smithi037.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T18:11:46.516 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-09-12T18:11:46.527 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-12T18:11:46.845 INFO:teuthology.orchestra.run.smithi037.stderr:instructed osd(s) 5 to deep-scrub 2024-09-12T18:11:46.858 INFO:tasks.ceph:Scrubbing osd.6 2024-09-12T18:11:46.858 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-12T18:11:47.002 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-09-12T18:11:47.002 INFO:teuthology.orchestra.run.smithi037.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T18:11:47.002 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-09-12T18:11:47.013 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-12T18:11:47.328 INFO:teuthology.orchestra.run.smithi037.stderr:instructed osd(s) 6 to deep-scrub 2024-09-12T18:11:47.342 INFO:tasks.ceph:Scrubbing osd.7 2024-09-12T18:11:47.342 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-12T18:11:47.485 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-09-12T18:11:47.485 INFO:teuthology.orchestra.run.smithi037.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T18:11:47.485 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-09-12T18:11:47.496 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-12T18:11:47.812 INFO:teuthology.orchestra.run.smithi037.stderr:instructed osd(s) 7 to deep-scrub 2024-09-12T18:11:47.825 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T18:11:48.167 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T18:11:48.179 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-09-12T18:11:48.181 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":2097,"stamp":"2024-09-12T18:11:46.611223+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":75296923,"num_objects":706,"num_object_clones":0,"num_object_copies":1872,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":706,"num_whiteouts":0,"num_read":279908,"num_read_kb":2634724,"num_write":143466,"num_write_kb":2346447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":212,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13366,"ondisk_log_size":13366,"up":914,"acting":914,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":914,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1557712,"kb_used_data":133448,"kb_used_omap":12,"kb_used_meta":1423731,"kb_avail":753417008,"statfs":{"total":773094113280,"available":771499016192,"internally_reserved":0,"allocated":136650752,"data_stored":120913686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":1457901105},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,3],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-526569262,"num_objects":-274,"num_object_clones":0,"num_object_copies":-1020,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-274,"num_whiteouts":0,"num_read":602,"num_read_kb":669,"num_write":430,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004831"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":22,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:06:59.835776+0000","last_change":"2024-09-12T17:46:57.082723+0000","last_active":"2024-09-12T18:06:59.835776+0000","last_peered":"2024-09-12T18:06:59.835776+0000","last_clean":"2024-09-12T18:06:59.835776+0000","last_became_active":"2024-09-12T17:46:57.082400+0000","last_became_peered":"2024-09-12T17:46:57.082400+0000","last_unstale":"2024-09-12T18:06:59.835776+0000","last_undegraded":"2024-09-12T18:06:59.835776+0000","last_fullsized":"2024-09-12T18:06:59.835776+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:49:21.685677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"0'0","reported_seq":39,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:49.843582+0000","last_change":"2024-09-12T17:30:16.683362+0000","last_active":"2024-09-12T18:07:49.843582+0000","last_peered":"2024-09-12T18:07:49.843582+0000","last_clean":"2024-09-12T18:07:49.843582+0000","last_became_active":"2024-09-12T17:30:16.683077+0000","last_became_peered":"2024-09-12T17:30:16.683077+0000","last_unstale":"2024-09-12T18:07:49.843582+0000","last_undegraded":"2024-09-12T18:07:49.843582+0000","last_fullsized":"2024-09-12T18:07:49.843582+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:50:52.313225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"260'3","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:44.841978+0000","last_change":"2024-09-12T17:30:12.651734+0000","last_active":"2024-09-12T18:07:44.841978+0000","last_peered":"2024-09-12T18:07:44.841978+0000","last_clean":"2024-09-12T18:07:44.841978+0000","last_became_active":"2024-09-12T17:30:12.651461+0000","last_became_peered":"2024-09-12T17:30:12.651461+0000","last_unstale":"2024-09-12T18:07:44.841978+0000","last_undegraded":"2024-09-12T18:07:44.841978+0000","last_fullsized":"2024-09-12T18:07:44.841978+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:51:09.744341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"263'28","reported_seq":134,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:14.837079+0000","last_change":"2024-09-12T17:26:35.669600+0000","last_active":"2024-09-12T18:08:14.837079+0000","last_peered":"2024-09-12T18:08:14.837079+0000","last_clean":"2024-09-12T18:08:14.837079+0000","last_became_active":"2024-09-12T17:26:35.669154+0000","last_became_peered":"2024-09-12T17:26:35.669154+0000","last_unstale":"2024-09-12T18:08:14.837079+0000","last_undegraded":"2024-09-12T18:08:14.837079+0000","last_fullsized":"2024-09-12T18:08:14.837079+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:56:13.407121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":150,"num_read_kb":108,"num_write":46,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":22,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:06:59.822536+0000","last_change":"2024-09-12T17:46:57.096775+0000","last_active":"2024-09-12T18:06:59.822536+0000","last_peered":"2024-09-12T18:06:59.822536+0000","last_clean":"2024-09-12T18:06:59.822536+0000","last_became_active":"2024-09-12T17:46:57.096462+0000","last_became_peered":"2024-09-12T17:46:57.096462+0000","last_unstale":"2024-09-12T18:06:59.822536+0000","last_undegraded":"2024-09-12T18:06:59.822536+0000","last_fullsized":"2024-09-12T18:06:59.822536+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:09:53.229550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"263'9","reported_seq":62,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:10:19.865991+0000","last_change":"2024-09-12T17:30:16.675262+0000","last_active":"2024-09-12T18:10:19.865991+0000","last_peered":"2024-09-12T18:10:19.865991+0000","last_clean":"2024-09-12T18:10:19.865991+0000","last_became_active":"2024-09-12T17:30:16.674952+0000","last_became_peered":"2024-09-12T17:30:16.674952+0000","last_unstale":"2024-09-12T18:10:19.865991+0000","last_undegraded":"2024-09-12T18:10:19.865991+0000","last_fullsized":"2024-09-12T18:10:19.865991+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:17:48.380471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":30722,"num_write":9,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"263'3","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:10:15.155542+0000","last_change":"2024-09-12T17:30:12.645927+0000","last_active":"2024-09-12T18:10:15.155542+0000","last_peered":"2024-09-12T18:10:15.155542+0000","last_clean":"2024-09-12T18:10:15.155542+0000","last_became_active":"2024-09-12T17:30:12.645624+0000","last_became_peered":"2024-09-12T17:30:12.645624+0000","last_unstale":"2024-09-12T18:10:15.155542+0000","last_undegraded":"2024-09-12T18:10:15.155542+0000","last_fullsized":"2024-09-12T18:10:15.155542+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:07:42.933168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"263'13","reported_seq":88,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:44.835410+0000","last_change":"2024-09-12T17:26:35.660411+0000","last_active":"2024-09-12T18:08:44.835410+0000","last_peered":"2024-09-12T18:08:44.835410+0000","last_clean":"2024-09-12T18:08:44.835410+0000","last_became_active":"2024-09-12T17:26:35.660132+0000","last_became_peered":"2024-09-12T17:26:35.660132+0000","last_unstale":"2024-09-12T18:08:44.835410+0000","last_undegraded":"2024-09-12T18:08:44.835410+0000","last_fullsized":"2024-09-12T18:08:44.835410+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:16:42.286139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":36,"num_write":29,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:44.871662+0000","last_change":"2024-09-12T17:46:57.076529+0000","last_active":"2024-09-12T18:08:44.871662+0000","last_peered":"2024-09-12T18:08:44.871662+0000","last_clean":"2024-09-12T18:08:44.871662+0000","last_became_active":"2024-09-12T17:46:57.076193+0000","last_became_peered":"2024-09-12T17:46:57.076193+0000","last_unstale":"2024-09-12T18:08:44.871662+0000","last_undegraded":"2024-09-12T18:08:44.871662+0000","last_fullsized":"2024-09-12T18:08:44.871662+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:06:10.868648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"260'3","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:49.834420+0000","last_change":"2024-09-12T17:30:16.671182+0000","last_active":"2024-09-12T18:07:49.834420+0000","last_peered":"2024-09-12T18:07:49.834420+0000","last_clean":"2024-09-12T18:07:49.834420+0000","last_became_active":"2024-09-12T17:30:16.670862+0000","last_became_peered":"2024-09-12T17:30:16.670862+0000","last_unstale":"2024-09-12T18:07:49.834420+0000","last_undegraded":"2024-09-12T18:07:49.834420+0000","last_fullsized":"2024-09-12T18:07:49.834420+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:44:16.981394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"263'5","reported_seq":61,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:10:24.846422+0000","last_change":"2024-09-12T17:30:12.648635+0000","last_active":"2024-09-12T18:10:24.846422+0000","last_peered":"2024-09-12T18:10:24.846422+0000","last_clean":"2024-09-12T18:10:24.846422+0000","last_became_active":"2024-09-12T17:30:12.648349+0000","last_became_peered":"2024-09-12T17:30:12.648349+0000","last_unstale":"2024-09-12T18:10:24.846422+0000","last_undegraded":"2024-09-12T18:10:24.846422+0000","last_fullsized":"2024-09-12T18:10:24.846422+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:34:54.875445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":18432,"num_write":10,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"263'117","reported_seq":422,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:04.843259+0000","last_change":"2024-09-12T17:26:35.664908+0000","last_active":"2024-09-12T18:09:04.843259+0000","last_peered":"2024-09-12T18:09:04.843259+0000","last_clean":"2024-09-12T18:09:04.843259+0000","last_became_active":"2024-09-12T17:26:35.664247+0000","last_became_peered":"2024-09-12T17:26:35.664247+0000","last_unstale":"2024-09-12T18:09:04.843259+0000","last_undegraded":"2024-09-12T18:09:04.843259+0000","last_fullsized":"2024-09-12T18:09:04.843259+0000","mapping_epoch":250,"log_start":"263'100","ondisk_log_start":"263'100","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:39:07.453840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":722,"num_read_kb":504,"num_write":158,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:49.849229+0000","last_change":"2024-09-12T17:46:57.089742+0000","last_active":"2024-09-12T18:08:49.849229+0000","last_peered":"2024-09-12T18:08:49.849229+0000","last_clean":"2024-09-12T18:08:49.849229+0000","last_became_active":"2024-09-12T17:46:57.089385+0000","last_became_peered":"2024-09-12T17:46:57.089385+0000","last_unstale":"2024-09-12T18:08:49.849229+0000","last_undegraded":"2024-09-12T18:08:49.849229+0000","last_fullsized":"2024-09-12T18:08:49.849229+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:17:02.129348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"263'14","reported_seq":71,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:41.215577+0000","last_change":"2024-09-12T17:30:16.682079+0000","last_active":"2024-09-12T18:11:41.215577+0000","last_peered":"2024-09-12T18:11:41.215577+0000","last_clean":"2024-09-12T18:11:41.215577+0000","last_became_active":"2024-09-12T17:30:16.681766+0000","last_became_peered":"2024-09-12T17:30:16.681766+0000","last_unstale":"2024-09-12T18:11:41.215577+0000","last_undegraded":"2024-09-12T18:11:41.215577+0000","last_fullsized":"2024-09-12T18:11:41.215577+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:31:21.167575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":32770,"num_write":24,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"0'0","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:44.843580+0000","last_change":"2024-09-12T17:30:12.648728+0000","last_active":"2024-09-12T18:07:44.843580+0000","last_peered":"2024-09-12T18:07:44.843580+0000","last_clean":"2024-09-12T18:07:44.843580+0000","last_became_active":"2024-09-12T17:30:12.648369+0000","last_became_peered":"2024-09-12T17:30:12.648369+0000","last_unstale":"2024-09-12T18:07:44.843580+0000","last_undegraded":"2024-09-12T18:07:44.843580+0000","last_fullsized":"2024-09-12T18:07:44.843580+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:12:39.564996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"263'110","reported_seq":439,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:04.851030+0000","last_change":"2024-09-12T17:26:35.666024+0000","last_active":"2024-09-12T18:09:04.851030+0000","last_peered":"2024-09-12T18:09:04.851030+0000","last_clean":"2024-09-12T18:09:04.851030+0000","last_became_active":"2024-09-12T17:26:35.665735+0000","last_became_peered":"2024-09-12T17:26:35.665735+0000","last_unstale":"2024-09-12T18:09:04.851030+0000","last_undegraded":"2024-09-12T18:09:04.851030+0000","last_fullsized":"2024-09-12T18:09:04.851030+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:21:58.014213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":761,"num_read_kb":507,"num_write":140,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:04.851052+0000","last_change":"2024-09-12T17:46:57.090107+0000","last_active":"2024-09-12T18:09:04.851052+0000","last_peered":"2024-09-12T18:09:04.851052+0000","last_clean":"2024-09-12T18:09:04.851052+0000","last_became_active":"2024-09-12T17:46:57.089797+0000","last_became_peered":"2024-09-12T17:46:57.089797+0000","last_unstale":"2024-09-12T18:09:04.851052+0000","last_undegraded":"2024-09-12T18:09:04.851052+0000","last_fullsized":"2024-09-12T18:09:04.851052+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:57:58.129729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"263'5","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:39.877726+0000","last_change":"2024-09-12T17:30:16.686091+0000","last_active":"2024-09-12T18:11:39.877726+0000","last_peered":"2024-09-12T18:11:39.877726+0000","last_clean":"2024-09-12T18:11:39.877726+0000","last_became_active":"2024-09-12T17:30:16.685755+0000","last_became_peered":"2024-09-12T17:30:16.685755+0000","last_unstale":"2024-09-12T18:11:39.877726+0000","last_undegraded":"2024-09-12T18:11:39.877726+0000","last_fullsized":"2024-09-12T18:11:39.877726+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:41:14.032884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":16,"num_write":10,"num_write_kb":5136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"0'0","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:54.841851+0000","last_change":"2024-09-12T17:30:12.641329+0000","last_active":"2024-09-12T18:08:54.841851+0000","last_peered":"2024-09-12T18:08:54.841851+0000","last_clean":"2024-09-12T18:08:54.841851+0000","last_became_active":"2024-09-12T17:30:12.640983+0000","last_became_peered":"2024-09-12T17:30:12.640983+0000","last_unstale":"2024-09-12T18:08:54.841851+0000","last_undegraded":"2024-09-12T18:08:54.841851+0000","last_fullsized":"2024-09-12T18:08:54.841851+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:49:02.041715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"263'13","reported_seq":92,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:04.851003+0000","last_change":"2024-09-12T17:26:35.664850+0000","last_active":"2024-09-12T18:09:04.851003+0000","last_peered":"2024-09-12T18:09:04.851003+0000","last_clean":"2024-09-12T18:09:04.851003+0000","last_became_active":"2024-09-12T17:26:35.664517+0000","last_became_peered":"2024-09-12T17:26:35.664517+0000","last_unstale":"2024-09-12T18:09:04.851003+0000","last_undegraded":"2024-09-12T18:09:04.851003+0000","last_fullsized":"2024-09-12T18:09:04.851003+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:47:34.050940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":54,"num_write":23,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:50.139169+0000","last_change":"2024-09-12T17:46:57.091721+0000","last_active":"2024-09-12T18:07:50.139169+0000","last_peered":"2024-09-12T18:07:50.139169+0000","last_clean":"2024-09-12T18:07:50.139169+0000","last_became_active":"2024-09-12T17:46:57.091147+0000","last_became_peered":"2024-09-12T17:46:57.091147+0000","last_unstale":"2024-09-12T18:07:50.139169+0000","last_undegraded":"2024-09-12T18:07:50.139169+0000","last_fullsized":"2024-09-12T18:07:50.139169+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:38:23.889670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"260'5","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:59.873661+0000","last_change":"2024-09-12T17:30:16.684444+0000","last_active":"2024-09-12T18:08:59.873661+0000","last_peered":"2024-09-12T18:08:59.873661+0000","last_clean":"2024-09-12T18:08:59.873661+0000","last_became_active":"2024-09-12T17:30:16.684200+0000","last_became_peered":"2024-09-12T17:30:16.684200+0000","last_unstale":"2024-09-12T18:08:59.873661+0000","last_undegraded":"2024-09-12T18:08:59.873661+0000","last_fullsized":"2024-09-12T18:08:59.873661+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:52:13.212280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"263'2","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:34.747957+0000","last_change":"2024-09-12T17:30:12.640225+0000","last_active":"2024-09-12T18:11:34.747957+0000","last_peered":"2024-09-12T18:11:34.747957+0000","last_clean":"2024-09-12T18:11:34.747957+0000","last_became_active":"2024-09-12T17:30:12.639953+0000","last_became_peered":"2024-09-12T17:30:12.639953+0000","last_unstale":"2024-09-12T18:11:34.747957+0000","last_undegraded":"2024-09-12T18:11:34.747957+0000","last_fullsized":"2024-09-12T18:11:34.747957+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:40:28.022453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"263'28","reported_seq":125,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:04.874467+0000","last_change":"2024-09-12T17:26:35.663645+0000","last_active":"2024-09-12T18:09:04.874467+0000","last_peered":"2024-09-12T18:09:04.874467+0000","last_clean":"2024-09-12T18:09:04.874467+0000","last_became_active":"2024-09-12T17:26:35.663339+0000","last_became_peered":"2024-09-12T17:26:35.663339+0000","last_unstale":"2024-09-12T18:09:04.874467+0000","last_undegraded":"2024-09-12T18:09:04.874467+0000","last_fullsized":"2024-09-12T18:09:04.874467+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:33:26.767790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":134,"num_read_kb":91,"num_write":60,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"263'1","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:06:59.836170+0000","last_change":"2024-09-12T17:46:57.088362+0000","last_active":"2024-09-12T18:06:59.836170+0000","last_peered":"2024-09-12T18:06:59.836170+0000","last_clean":"2024-09-12T18:06:59.836170+0000","last_became_active":"2024-09-12T17:46:57.088039+0000","last_became_peered":"2024-09-12T17:46:57.088039+0000","last_unstale":"2024-09-12T18:06:59.836170+0000","last_undegraded":"2024-09-12T18:06:59.836170+0000","last_fullsized":"2024-09-12T18:06:59.836170+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:17:28.745812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"263'9","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:41.063889+0000","last_change":"2024-09-12T17:30:16.672459+0000","last_active":"2024-09-12T18:11:41.063889+0000","last_peered":"2024-09-12T18:11:41.063889+0000","last_clean":"2024-09-12T18:11:41.063889+0000","last_became_active":"2024-09-12T17:30:16.672167+0000","last_became_peered":"2024-09-12T17:30:16.672167+0000","last_unstale":"2024-09-12T18:11:41.063889+0000","last_undegraded":"2024-09-12T18:11:41.063889+0000","last_fullsized":"2024-09-12T18:11:41.063889+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:34:33.089166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":17408,"num_write":19,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"260'5","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:44.843494+0000","last_change":"2024-09-12T17:30:12.644426+0000","last_active":"2024-09-12T18:07:44.843494+0000","last_peered":"2024-09-12T18:07:44.843494+0000","last_clean":"2024-09-12T18:07:44.843494+0000","last_became_active":"2024-09-12T17:30:12.644125+0000","last_became_peered":"2024-09-12T17:30:12.644125+0000","last_unstale":"2024-09-12T18:07:44.843494+0000","last_undegraded":"2024-09-12T18:07:44.843494+0000","last_fullsized":"2024-09-12T18:07:44.843494+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:29:53.974488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"263'38","reported_seq":158,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:44.833618+0000","last_change":"2024-09-12T17:26:35.659571+0000","last_active":"2024-09-12T18:07:44.833618+0000","last_peered":"2024-09-12T18:07:44.833618+0000","last_clean":"2024-09-12T18:07:44.833618+0000","last_became_active":"2024-09-12T17:26:35.659261+0000","last_became_peered":"2024-09-12T17:26:35.659261+0000","last_unstale":"2024-09-12T18:07:44.833618+0000","last_undegraded":"2024-09-12T18:07:44.833618+0000","last_fullsized":"2024-09-12T18:07:44.833618+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:13:24.323445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":196,"num_read_kb":138,"num_write":78,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":22,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:06:59.836253+0000","last_change":"2024-09-12T17:46:57.088279+0000","last_active":"2024-09-12T18:06:59.836253+0000","last_peered":"2024-09-12T18:06:59.836253+0000","last_clean":"2024-09-12T18:06:59.836253+0000","last_became_active":"2024-09-12T17:46:57.087965+0000","last_became_peered":"2024-09-12T17:46:57.087965+0000","last_unstale":"2024-09-12T18:06:59.836253+0000","last_undegraded":"2024-09-12T18:06:59.836253+0000","last_fullsized":"2024-09-12T18:06:59.836253+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:14:09.667084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"263'8","reported_seq":61,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:10:19.861008+0000","last_change":"2024-09-12T17:30:16.685365+0000","last_active":"2024-09-12T18:10:19.861008+0000","last_peered":"2024-09-12T18:10:19.861008+0000","last_clean":"2024-09-12T18:10:19.861008+0000","last_became_active":"2024-09-12T17:30:16.685054+0000","last_became_peered":"2024-09-12T17:30:16.685054+0000","last_unstale":"2024-09-12T18:10:19.861008+0000","last_undegraded":"2024-09-12T18:10:19.861008+0000","last_fullsized":"2024-09-12T18:10:19.861008+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:42:01.087864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":30722,"num_write":13,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"263'8","reported_seq":65,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:10:14.852155+0000","last_change":"2024-09-12T17:30:12.652060+0000","last_active":"2024-09-12T18:10:14.852155+0000","last_peered":"2024-09-12T18:10:14.852155+0000","last_clean":"2024-09-12T18:10:14.852155+0000","last_became_active":"2024-09-12T17:30:12.651780+0000","last_became_peered":"2024-09-12T17:30:12.651780+0000","last_unstale":"2024-09-12T18:10:14.852155+0000","last_undegraded":"2024-09-12T18:10:14.852155+0000","last_fullsized":"2024-09-12T18:10:14.852155+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:20:56.174919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":22530,"num_write":13,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"263'27","reported_seq":128,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:40.137913+0000","last_change":"2024-09-12T17:26:35.665383+0000","last_active":"2024-09-12T18:07:40.137913+0000","last_peered":"2024-09-12T18:07:40.137913+0000","last_clean":"2024-09-12T18:07:40.137913+0000","last_became_active":"2024-09-12T17:26:35.665076+0000","last_became_peered":"2024-09-12T17:26:35.665076+0000","last_unstale":"2024-09-12T18:07:40.137913+0000","last_undegraded":"2024-09-12T18:07:40.137913+0000","last_fullsized":"2024-09-12T18:07:40.137913+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:51:16.783076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":146,"num_read_kb":106,"num_write":38,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:00.140237+0000","last_change":"2024-09-12T17:46:57.077605+0000","last_active":"2024-09-12T18:08:00.140237+0000","last_peered":"2024-09-12T18:08:00.140237+0000","last_clean":"2024-09-12T18:08:00.140237+0000","last_became_active":"2024-09-12T17:46:57.077265+0000","last_became_peered":"2024-09-12T17:46:57.077265+0000","last_unstale":"2024-09-12T18:08:00.140237+0000","last_undegraded":"2024-09-12T18:08:00.140237+0000","last_fullsized":"2024-09-12T18:08:00.140237+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:54:27.754921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"0'0","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:59.850434+0000","last_change":"2024-09-12T17:30:16.684627+0000","last_active":"2024-09-12T18:08:59.850434+0000","last_peered":"2024-09-12T18:08:59.850434+0000","last_clean":"2024-09-12T18:08:59.850434+0000","last_became_active":"2024-09-12T17:30:16.683963+0000","last_became_peered":"2024-09-12T17:30:16.683963+0000","last_unstale":"2024-09-12T18:08:59.850434+0000","last_undegraded":"2024-09-12T18:08:59.850434+0000","last_fullsized":"2024-09-12T18:08:59.850434+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:56:37.344964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"263'8","reported_seq":66,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:10:09.864676+0000","last_change":"2024-09-12T17:30:12.643034+0000","last_active":"2024-09-12T18:10:09.864676+0000","last_peered":"2024-09-12T18:10:09.864676+0000","last_clean":"2024-09-12T18:10:09.864676+0000","last_became_active":"2024-09-12T17:30:12.642687+0000","last_became_peered":"2024-09-12T17:30:12.642687+0000","last_unstale":"2024-09-12T18:10:09.864676+0000","last_undegraded":"2024-09-12T18:10:09.864676+0000","last_fullsized":"2024-09-12T18:10:09.864676+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:06:07.203968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":26626,"num_write":13,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"263'39","reported_seq":160,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:39.833155+0000","last_change":"2024-09-12T17:26:35.668713+0000","last_active":"2024-09-12T18:07:39.833155+0000","last_peered":"2024-09-12T18:07:39.833155+0000","last_clean":"2024-09-12T18:07:39.833155+0000","last_became_active":"2024-09-12T17:26:35.668286+0000","last_became_peered":"2024-09-12T17:26:35.668286+0000","last_unstale":"2024-09-12T18:07:39.833155+0000","last_undegraded":"2024-09-12T18:07:39.833155+0000","last_fullsized":"2024-09-12T18:07:39.833155+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:20:43.354325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":202,"num_read_kb":143,"num_write":74,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"263'1","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:59.830606+0000","last_change":"2024-09-12T17:46:57.091097+0000","last_active":"2024-09-12T18:07:59.830606+0000","last_peered":"2024-09-12T18:07:59.830606+0000","last_clean":"2024-09-12T18:07:59.830606+0000","last_became_active":"2024-09-12T17:46:57.088919+0000","last_became_peered":"2024-09-12T17:46:57.088919+0000","last_unstale":"2024-09-12T18:07:59.830606+0000","last_undegraded":"2024-09-12T18:07:59.830606+0000","last_fullsized":"2024-09-12T18:07:59.830606+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:56:55.289350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"0'0","reported_seq":34,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:44.840586+0000","last_change":"2024-09-12T17:31:18.237102+0000","last_active":"2024-09-12T18:08:44.840586+0000","last_peered":"2024-09-12T18:08:44.840586+0000","last_clean":"2024-09-12T18:08:44.840586+0000","last_became_active":"2024-09-12T17:31:18.236640+0000","last_became_peered":"2024-09-12T17:31:18.236640+0000","last_unstale":"2024-09-12T18:08:44.840586+0000","last_undegraded":"2024-09-12T18:08:44.840586+0000","last_fullsized":"2024-09-12T18:08:44.840586+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:10:12.696558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.15","version":"0'0","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:54.853566+0000","last_change":"2024-09-12T17:30:12.649885+0000","last_active":"2024-09-12T18:08:54.853566+0000","last_peered":"2024-09-12T18:08:54.853566+0000","last_clean":"2024-09-12T18:08:54.853566+0000","last_became_active":"2024-09-12T17:30:12.649605+0000","last_became_peered":"2024-09-12T17:30:12.649605+0000","last_unstale":"2024-09-12T18:08:54.853566+0000","last_undegraded":"2024-09-12T18:08:54.853566+0000","last_fullsized":"2024-09-12T18:08:54.853566+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:09:52.512870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"263'53","reported_seq":191,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:39.841430+0000","last_change":"2024-09-12T17:26:35.661633+0000","last_active":"2024-09-12T18:07:39.841430+0000","last_peered":"2024-09-12T18:07:39.841430+0000","last_clean":"2024-09-12T18:07:39.841430+0000","last_became_active":"2024-09-12T17:26:35.658602+0000","last_became_peered":"2024-09-12T17:26:35.658602+0000","last_unstale":"2024-09-12T18:07:39.841430+0000","last_undegraded":"2024-09-12T18:07:39.841430+0000","last_fullsized":"2024-09-12T18:07:39.841430+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:40:06.406484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":262,"num_read_kb":183,"num_write":93,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:59.845745+0000","last_change":"2024-09-12T17:46:57.083830+0000","last_active":"2024-09-12T18:07:59.845745+0000","last_peered":"2024-09-12T18:07:59.845745+0000","last_clean":"2024-09-12T18:07:59.845745+0000","last_became_active":"2024-09-12T17:46:57.081080+0000","last_became_peered":"2024-09-12T17:46:57.081080+0000","last_unstale":"2024-09-12T18:07:59.845745+0000","last_undegraded":"2024-09-12T18:07:59.845745+0000","last_fullsized":"2024-09-12T18:07:59.845745+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:12:11.153281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"263'3","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:24.870221+0000","last_change":"2024-09-12T17:30:16.686003+0000","last_active":"2024-09-12T18:11:24.870221+0000","last_peered":"2024-09-12T18:11:24.870221+0000","last_clean":"2024-09-12T18:11:24.870221+0000","last_became_active":"2024-09-12T17:30:16.685688+0000","last_became_peered":"2024-09-12T17:30:16.685688+0000","last_unstale":"2024-09-12T18:11:24.870221+0000","last_undegraded":"2024-09-12T18:11:24.870221+0000","last_fullsized":"2024-09-12T18:11:24.870221+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:37:31.358403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"0'0","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:54.836524+0000","last_change":"2024-09-12T17:30:12.654638+0000","last_active":"2024-09-12T18:08:54.836524+0000","last_peered":"2024-09-12T18:08:54.836524+0000","last_clean":"2024-09-12T18:08:54.836524+0000","last_became_active":"2024-09-12T17:30:12.654327+0000","last_became_peered":"2024-09-12T17:30:12.654327+0000","last_unstale":"2024-09-12T18:08:54.836524+0000","last_undegraded":"2024-09-12T18:08:54.836524+0000","last_fullsized":"2024-09-12T18:08:54.836524+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:44:33.401300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"263'47","reported_seq":185,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:39.828526+0000","last_change":"2024-09-12T17:26:35.662563+0000","last_active":"2024-09-12T18:07:39.828526+0000","last_peered":"2024-09-12T18:07:39.828526+0000","last_clean":"2024-09-12T18:07:39.828526+0000","last_became_active":"2024-09-12T17:26:35.662284+0000","last_became_peered":"2024-09-12T17:26:35.662284+0000","last_unstale":"2024-09-12T18:07:39.828526+0000","last_undegraded":"2024-09-12T18:07:39.828526+0000","last_fullsized":"2024-09-12T18:07:39.828526+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:52:34.213360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":252,"num_read_kb":176,"num_write":91,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:59.844776+0000","last_change":"2024-09-12T17:46:57.082391+0000","last_active":"2024-09-12T18:07:59.844776+0000","last_peered":"2024-09-12T18:07:59.844776+0000","last_clean":"2024-09-12T18:07:59.844776+0000","last_became_active":"2024-09-12T17:46:57.082082+0000","last_became_peered":"2024-09-12T17:46:57.082082+0000","last_unstale":"2024-09-12T18:07:59.844776+0000","last_undegraded":"2024-09-12T18:07:59.844776+0000","last_fullsized":"2024-09-12T18:07:59.844776+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:16:53.154548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"260'3","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:59.853745+0000","last_change":"2024-09-12T17:30:16.675596+0000","last_active":"2024-09-12T18:08:59.853745+0000","last_peered":"2024-09-12T18:08:59.853745+0000","last_clean":"2024-09-12T18:08:59.853745+0000","last_became_active":"2024-09-12T17:30:16.675278+0000","last_became_peered":"2024-09-12T17:30:16.675278+0000","last_unstale":"2024-09-12T18:08:59.853745+0000","last_undegraded":"2024-09-12T18:08:59.853745+0000","last_fullsized":"2024-09-12T18:08:59.853745+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:04:44.516041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"260'2","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:54.841986+0000","last_change":"2024-09-12T17:30:12.643518+0000","last_active":"2024-09-12T18:08:54.841986+0000","last_peered":"2024-09-12T18:08:54.841986+0000","last_clean":"2024-09-12T18:08:54.841986+0000","last_became_active":"2024-09-12T17:30:12.643203+0000","last_became_peered":"2024-09-12T17:30:12.643203+0000","last_unstale":"2024-09-12T18:08:54.841986+0000","last_undegraded":"2024-09-12T18:08:54.841986+0000","last_fullsized":"2024-09-12T18:08:54.841986+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:42:13.911696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":23,"num_write":2,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"263'29","reported_seq":125,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:39.851532+0000","last_change":"2024-09-12T17:26:35.657351+0000","last_active":"2024-09-12T18:08:39.851532+0000","last_peered":"2024-09-12T18:08:39.851532+0000","last_clean":"2024-09-12T18:08:39.851532+0000","last_became_active":"2024-09-12T17:26:35.657035+0000","last_became_peered":"2024-09-12T17:26:35.657035+0000","last_unstale":"2024-09-12T18:08:39.851532+0000","last_undegraded":"2024-09-12T18:08:39.851532+0000","last_fullsized":"2024-09-12T18:08:39.851532+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:26:04.653231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":129,"num_read_kb":90,"num_write":56,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:44.848747+0000","last_change":"2024-09-12T17:46:57.094601+0000","last_active":"2024-09-12T18:08:44.848747+0000","last_peered":"2024-09-12T18:08:44.848747+0000","last_clean":"2024-09-12T18:08:44.848747+0000","last_became_active":"2024-09-12T17:46:57.094314+0000","last_became_peered":"2024-09-12T17:46:57.094314+0000","last_unstale":"2024-09-12T18:08:44.848747+0000","last_undegraded":"2024-09-12T18:08:44.848747+0000","last_fullsized":"2024-09-12T18:08:44.848747+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:55:53.289948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:40.137931+0000","last_change":"2024-09-12T17:30:16.679537+0000","last_active":"2024-09-12T18:07:40.137931+0000","last_peered":"2024-09-12T18:07:40.137931+0000","last_clean":"2024-09-12T18:07:40.137931+0000","last_became_active":"2024-09-12T17:30:16.679282+0000","last_became_peered":"2024-09-12T17:30:16.679282+0000","last_unstale":"2024-09-12T18:07:40.137931+0000","last_undegraded":"2024-09-12T18:07:40.137931+0000","last_fullsized":"2024-09-12T18:07:40.137931+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:52:39.870256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"260'6","reported_seq":58,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:34.842038+0000","last_change":"2024-09-12T17:30:12.652775+0000","last_active":"2024-09-12T18:07:34.842038+0000","last_peered":"2024-09-12T18:07:34.842038+0000","last_clean":"2024-09-12T18:07:34.842038+0000","last_became_active":"2024-09-12T17:30:12.652426+0000","last_became_peered":"2024-09-12T17:30:12.652426+0000","last_unstale":"2024-09-12T18:07:34.842038+0000","last_undegraded":"2024-09-12T18:07:34.842038+0000","last_fullsized":"2024-09-12T18:07:34.842038+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:55:40.416016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":10240,"num_write":16,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"263'34","reported_seq":148,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:34.850782+0000","last_change":"2024-09-12T17:26:35.664129+0000","last_active":"2024-09-12T18:08:34.850782+0000","last_peered":"2024-09-12T18:08:34.850782+0000","last_clean":"2024-09-12T18:08:34.850782+0000","last_became_active":"2024-09-12T17:26:35.663337+0000","last_became_peered":"2024-09-12T17:26:35.663337+0000","last_unstale":"2024-09-12T18:08:34.850782+0000","last_undegraded":"2024-09-12T18:08:34.850782+0000","last_fullsized":"2024-09-12T18:08:34.850782+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:23:54.136870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":179,"num_read_kb":128,"num_write":55,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:44.840640+0000","last_change":"2024-09-12T17:46:57.093698+0000","last_active":"2024-09-12T18:08:44.840640+0000","last_peered":"2024-09-12T18:08:44.840640+0000","last_clean":"2024-09-12T18:08:44.840640+0000","last_became_active":"2024-09-12T17:46:57.093157+0000","last_became_peered":"2024-09-12T17:46:57.093157+0000","last_unstale":"2024-09-12T18:08:44.840640+0000","last_undegraded":"2024-09-12T18:08:44.840640+0000","last_fullsized":"2024-09-12T18:08:44.840640+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:44:51.633185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"263'2","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:10:00.153759+0000","last_change":"2024-09-12T17:30:16.679016+0000","last_active":"2024-09-12T18:10:00.153759+0000","last_peered":"2024-09-12T18:10:00.153759+0000","last_clean":"2024-09-12T18:10:00.153759+0000","last_became_active":"2024-09-12T17:30:16.678682+0000","last_became_peered":"2024-09-12T17:30:16.678682+0000","last_unstale":"2024-09-12T18:10:00.153759+0000","last_undegraded":"2024-09-12T18:10:00.153759+0000","last_fullsized":"2024-09-12T18:10:00.153759+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:44:09.408299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"263'6","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:41.374823+0000","last_change":"2024-09-12T17:30:12.653263+0000","last_active":"2024-09-12T18:11:41.374823+0000","last_peered":"2024-09-12T18:11:41.374823+0000","last_clean":"2024-09-12T18:11:41.374823+0000","last_became_active":"2024-09-12T17:30:12.652916+0000","last_became_peered":"2024-09-12T17:30:12.652916+0000","last_unstale":"2024-09-12T18:11:41.374823+0000","last_undegraded":"2024-09-12T18:11:41.374823+0000","last_fullsized":"2024-09-12T18:11:41.374823+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:25:32.409182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":16,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"263'35","reported_seq":148,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:34.839418+0000","last_change":"2024-09-12T17:26:35.669546+0000","last_active":"2024-09-12T18:08:34.839418+0000","last_peered":"2024-09-12T18:08:34.839418+0000","last_clean":"2024-09-12T18:08:34.839418+0000","last_became_active":"2024-09-12T17:26:35.669256+0000","last_became_peered":"2024-09-12T17:26:35.669256+0000","last_unstale":"2024-09-12T18:08:34.839418+0000","last_undegraded":"2024-09-12T18:08:34.839418+0000","last_fullsized":"2024-09-12T18:08:34.839418+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:05:49.889059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":173,"num_read_kb":119,"num_write":68,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"262'1","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:04.835994+0000","last_change":"2024-09-12T17:46:57.090884+0000","last_active":"2024-09-12T18:08:04.835994+0000","last_peered":"2024-09-12T18:08:04.835994+0000","last_clean":"2024-09-12T18:08:04.835994+0000","last_became_active":"2024-09-12T17:46:57.090587+0000","last_became_peered":"2024-09-12T17:46:57.090587+0000","last_unstale":"2024-09-12T18:08:04.835994+0000","last_undegraded":"2024-09-12T18:08:04.835994+0000","last_fullsized":"2024-09-12T18:08:04.835994+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:06:27.485219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"260'3","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:39.841383+0000","last_change":"2024-09-12T17:30:16.686552+0000","last_active":"2024-09-12T18:07:39.841383+0000","last_peered":"2024-09-12T18:07:39.841383+0000","last_clean":"2024-09-12T18:07:39.841383+0000","last_became_active":"2024-09-12T17:30:16.685830+0000","last_became_peered":"2024-09-12T17:30:16.685830+0000","last_unstale":"2024-09-12T18:07:39.841383+0000","last_undegraded":"2024-09-12T18:07:39.841383+0000","last_fullsized":"2024-09-12T18:07:39.841383+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:26:14.033263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"0'0","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:34.861787+0000","last_change":"2024-09-12T17:30:12.640428+0000","last_active":"2024-09-12T18:07:34.861787+0000","last_peered":"2024-09-12T18:07:34.861787+0000","last_clean":"2024-09-12T18:07:34.861787+0000","last_became_active":"2024-09-12T17:30:12.640139+0000","last_became_peered":"2024-09-12T17:30:12.640139+0000","last_unstale":"2024-09-12T18:07:34.861787+0000","last_undegraded":"2024-09-12T18:07:34.861787+0000","last_fullsized":"2024-09-12T18:07:34.861787+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:09:04.186884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"263'49","reported_seq":189,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:34.850284+0000","last_change":"2024-09-12T17:26:35.659117+0000","last_active":"2024-09-12T18:08:34.850284+0000","last_peered":"2024-09-12T18:08:34.850284+0000","last_clean":"2024-09-12T18:08:34.850284+0000","last_became_active":"2024-09-12T17:26:35.658785+0000","last_became_peered":"2024-09-12T17:26:35.658785+0000","last_unstale":"2024-09-12T18:08:34.850284+0000","last_undegraded":"2024-09-12T18:08:34.850284+0000","last_fullsized":"2024-09-12T18:08:34.850284+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:02.864803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":254,"num_read_kb":176,"num_write":93,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"263'1","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:44.848723+0000","last_change":"2024-09-12T17:46:57.093615+0000","last_active":"2024-09-12T18:08:44.848723+0000","last_peered":"2024-09-12T18:08:44.848723+0000","last_clean":"2024-09-12T18:08:44.848723+0000","last_became_active":"2024-09-12T17:46:57.093267+0000","last_became_peered":"2024-09-12T17:46:57.093267+0000","last_unstale":"2024-09-12T18:08:44.848723+0000","last_undegraded":"2024-09-12T18:08:44.848723+0000","last_fullsized":"2024-09-12T18:08:44.848723+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:52:12.345961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:39.862456+0000","last_change":"2024-09-12T17:30:16.681768+0000","last_active":"2024-09-12T18:07:39.862456+0000","last_peered":"2024-09-12T18:07:39.862456+0000","last_clean":"2024-09-12T18:07:39.862456+0000","last_became_active":"2024-09-12T17:30:16.681418+0000","last_became_peered":"2024-09-12T17:30:16.681418+0000","last_unstale":"2024-09-12T18:07:39.862456+0000","last_undegraded":"2024-09-12T18:07:39.862456+0000","last_fullsized":"2024-09-12T18:07:39.862456+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:08:51.341343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"260'3","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:34.841576+0000","last_change":"2024-09-12T17:30:12.643785+0000","last_active":"2024-09-12T18:07:34.841576+0000","last_peered":"2024-09-12T18:07:34.841576+0000","last_clean":"2024-09-12T18:07:34.841576+0000","last_became_active":"2024-09-12T17:30:12.643484+0000","last_became_peered":"2024-09-12T17:30:12.643484+0000","last_unstale":"2024-09-12T18:07:34.841576+0000","last_undegraded":"2024-09-12T18:07:34.841576+0000","last_fullsized":"2024-09-12T18:07:34.841576+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:51:35.165703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"260'23","reported_seq":119,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:34.847525+0000","last_change":"2024-09-12T17:26:35.666220+0000","last_active":"2024-09-12T18:08:34.847525+0000","last_peered":"2024-09-12T18:08:34.847525+0000","last_clean":"2024-09-12T18:08:34.847525+0000","last_became_active":"2024-09-12T17:26:35.665908+0000","last_became_peered":"2024-09-12T17:26:35.665908+0000","last_unstale":"2024-09-12T18:08:34.847525+0000","last_undegraded":"2024-09-12T18:08:34.847525+0000","last_fullsized":"2024-09-12T18:08:34.847525+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:22:29.733636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":120,"num_read_kb":87,"num_write":41,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:44.835349+0000","last_change":"2024-09-12T17:46:57.083432+0000","last_active":"2024-09-12T18:08:44.835349+0000","last_peered":"2024-09-12T18:08:44.835349+0000","last_clean":"2024-09-12T18:08:44.835349+0000","last_became_active":"2024-09-12T17:46:57.083098+0000","last_became_peered":"2024-09-12T17:46:57.083098+0000","last_unstale":"2024-09-12T18:08:44.835349+0000","last_undegraded":"2024-09-12T18:08:44.835349+0000","last_fullsized":"2024-09-12T18:08:44.835349+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:31:23.853524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:34.847617+0000","last_change":"2024-09-12T17:30:16.684194+0000","last_active":"2024-09-12T18:08:34.847617+0000","last_peered":"2024-09-12T18:08:34.847617+0000","last_clean":"2024-09-12T18:08:34.847617+0000","last_became_active":"2024-09-12T17:30:16.683887+0000","last_became_peered":"2024-09-12T17:30:16.683887+0000","last_unstale":"2024-09-12T18:08:34.847617+0000","last_undegraded":"2024-09-12T18:08:34.847617+0000","last_fullsized":"2024-09-12T18:08:34.847617+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:53:34.319282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"263'4","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:41.193054+0000","last_change":"2024-09-12T17:30:12.653459+0000","last_active":"2024-09-12T18:11:41.193054+0000","last_peered":"2024-09-12T18:11:41.193054+0000","last_clean":"2024-09-12T18:11:41.193054+0000","last_became_active":"2024-09-12T17:30:12.653137+0000","last_became_peered":"2024-09-12T17:30:12.653137+0000","last_unstale":"2024-09-12T18:11:41.193054+0000","last_undegraded":"2024-09-12T18:11:41.193054+0000","last_fullsized":"2024-09-12T18:11:41.193054+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:08:52.465178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6148,"num_write":4,"num_write_kb":3076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"263'50","reported_seq":187,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:29.854471+0000","last_change":"2024-09-12T17:26:35.669293+0000","last_active":"2024-09-12T18:09:29.854471+0000","last_peered":"2024-09-12T18:09:29.854471+0000","last_clean":"2024-09-12T18:09:29.854471+0000","last_became_active":"2024-09-12T17:26:35.668989+0000","last_became_peered":"2024-09-12T17:26:35.668989+0000","last_unstale":"2024-09-12T18:09:29.854471+0000","last_undegraded":"2024-09-12T18:09:29.854471+0000","last_fullsized":"2024-09-12T18:09:29.854471+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:43:19.820670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":250,"num_read_kb":175,"num_write":93,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:29.858796+0000","last_change":"2024-09-12T17:46:57.088291+0000","last_active":"2024-09-12T18:09:29.858796+0000","last_peered":"2024-09-12T18:09:29.858796+0000","last_clean":"2024-09-12T18:09:29.858796+0000","last_became_active":"2024-09-12T17:46:57.087982+0000","last_became_peered":"2024-09-12T17:46:57.087982+0000","last_unstale":"2024-09-12T18:09:29.858796+0000","last_undegraded":"2024-09-12T18:09:29.858796+0000","last_fullsized":"2024-09-12T18:09:29.858796+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:05:50.630405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"263'5","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:41.180718+0000","last_change":"2024-09-12T17:30:16.679996+0000","last_active":"2024-09-12T18:11:41.180718+0000","last_peered":"2024-09-12T18:11:41.180718+0000","last_clean":"2024-09-12T18:11:41.180718+0000","last_became_active":"2024-09-12T17:30:16.679621+0000","last_became_peered":"2024-09-12T17:30:16.679621+0000","last_unstale":"2024-09-12T18:11:41.180718+0000","last_undegraded":"2024-09-12T18:11:41.180718+0000","last_fullsized":"2024-09-12T18:11:41.180718+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:23:53.964330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":9216,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"0'0","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:29.833725+0000","last_change":"2024-09-12T17:30:12.649664+0000","last_active":"2024-09-12T18:08:29.833725+0000","last_peered":"2024-09-12T18:08:29.833725+0000","last_clean":"2024-09-12T18:08:29.833725+0000","last_became_active":"2024-09-12T17:30:12.649010+0000","last_became_peered":"2024-09-12T17:30:12.649010+0000","last_unstale":"2024-09-12T18:08:29.833725+0000","last_undegraded":"2024-09-12T18:08:29.833725+0000","last_fullsized":"2024-09-12T18:08:29.833725+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:23:47.681997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"260'8","reported_seq":76,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:19.855981+0000","last_change":"2024-09-12T17:26:35.663336+0000","last_active":"2024-09-12T18:09:19.855981+0000","last_peered":"2024-09-12T18:09:19.855981+0000","last_clean":"2024-09-12T18:09:19.855981+0000","last_became_active":"2024-09-12T17:26:35.663041+0000","last_became_peered":"2024-09-12T17:26:35.663041+0000","last_unstale":"2024-09-12T18:09:19.855981+0000","last_undegraded":"2024-09-12T18:09:19.855981+0000","last_fullsized":"2024-09-12T18:09:19.855981+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:02:26.294386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":28,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:39.870871+0000","last_change":"2024-09-12T17:46:57.086356+0000","last_active":"2024-09-12T18:08:39.870871+0000","last_peered":"2024-09-12T18:08:39.870871+0000","last_clean":"2024-09-12T18:08:39.870871+0000","last_became_active":"2024-09-12T17:46:57.085908+0000","last_became_peered":"2024-09-12T17:46:57.085908+0000","last_unstale":"2024-09-12T18:08:39.870871+0000","last_undegraded":"2024-09-12T18:08:39.870871+0000","last_fullsized":"2024-09-12T18:08:39.870871+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:01:54.509459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"0'0","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:40.144742+0000","last_change":"2024-09-12T17:30:16.679533+0000","last_active":"2024-09-12T18:08:40.144742+0000","last_peered":"2024-09-12T18:08:40.144742+0000","last_clean":"2024-09-12T18:08:40.144742+0000","last_became_active":"2024-09-12T17:30:16.679193+0000","last_became_peered":"2024-09-12T17:30:16.679193+0000","last_unstale":"2024-09-12T18:08:40.144742+0000","last_undegraded":"2024-09-12T18:08:40.144742+0000","last_fullsized":"2024-09-12T18:08:40.144742+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:21:35.478757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"0'0","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:29.838852+0000","last_change":"2024-09-12T17:30:12.647471+0000","last_active":"2024-09-12T18:08:29.838852+0000","last_peered":"2024-09-12T18:08:29.838852+0000","last_clean":"2024-09-12T18:08:29.838852+0000","last_became_active":"2024-09-12T17:30:12.646945+0000","last_became_peered":"2024-09-12T17:30:12.646945+0000","last_unstale":"2024-09-12T18:08:29.838852+0000","last_undegraded":"2024-09-12T18:08:29.838852+0000","last_fullsized":"2024-09-12T18:08:29.838852+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:42:36.686975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"263'33","reported_seq":143,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:19.876853+0000","last_change":"2024-09-12T17:26:35.665050+0000","last_active":"2024-09-12T18:09:19.876853+0000","last_peered":"2024-09-12T18:09:19.876853+0000","last_clean":"2024-09-12T18:09:19.876853+0000","last_became_active":"2024-09-12T17:26:35.664749+0000","last_became_peered":"2024-09-12T17:26:35.664749+0000","last_unstale":"2024-09-12T18:09:19.876853+0000","last_undegraded":"2024-09-12T18:09:19.876853+0000","last_fullsized":"2024-09-12T18:09:19.876853+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:25:00.758310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":166,"num_read_kb":124,"num_write":50,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:39.851484+0000","last_change":"2024-09-12T17:46:57.084760+0000","last_active":"2024-09-12T18:08:39.851484+0000","last_peered":"2024-09-12T18:08:39.851484+0000","last_clean":"2024-09-12T18:08:39.851484+0000","last_became_active":"2024-09-12T17:46:57.084421+0000","last_became_peered":"2024-09-12T17:46:57.084421+0000","last_unstale":"2024-09-12T18:08:39.851484+0000","last_undegraded":"2024-09-12T18:08:39.851484+0000","last_fullsized":"2024-09-12T18:08:39.851484+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:35:17.085619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"0'0","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:34.847633+0000","last_change":"2024-09-12T17:30:16.682114+0000","last_active":"2024-09-12T18:08:34.847633+0000","last_peered":"2024-09-12T18:08:34.847633+0000","last_clean":"2024-09-12T18:08:34.847633+0000","last_became_active":"2024-09-12T17:30:16.681171+0000","last_became_peered":"2024-09-12T17:30:16.681171+0000","last_unstale":"2024-09-12T18:08:34.847633+0000","last_undegraded":"2024-09-12T18:08:34.847633+0000","last_fullsized":"2024-09-12T18:08:34.847633+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:35:19.241688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"263'6","reported_seq":57,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:41.083390+0000","last_change":"2024-09-12T17:30:12.641879+0000","last_active":"2024-09-12T18:11:41.083390+0000","last_peered":"2024-09-12T18:11:41.083390+0000","last_clean":"2024-09-12T18:11:41.083390+0000","last_became_active":"2024-09-12T17:30:12.641592+0000","last_became_peered":"2024-09-12T17:30:12.641592+0000","last_unstale":"2024-09-12T18:11:41.083390+0000","last_undegraded":"2024-09-12T18:11:41.083390+0000","last_fullsized":"2024-09-12T18:11:41.083390+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:29:07.666017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":11264,"num_write":6,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"263'52","reported_seq":196,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:19.838941+0000","last_change":"2024-09-12T17:26:35.663784+0000","last_active":"2024-09-12T18:09:19.838941+0000","last_peered":"2024-09-12T18:09:19.838941+0000","last_clean":"2024-09-12T18:09:19.838941+0000","last_became_active":"2024-09-12T17:26:35.663472+0000","last_became_peered":"2024-09-12T17:26:35.663472+0000","last_unstale":"2024-09-12T18:09:19.838941+0000","last_undegraded":"2024-09-12T18:09:19.838941+0000","last_fullsized":"2024-09-12T18:09:19.838941+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:48:26.678396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":261,"num_read_kb":192,"num_write":92,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:29.854446+0000","last_change":"2024-09-12T17:46:57.090539+0000","last_active":"2024-09-12T18:09:29.854446+0000","last_peered":"2024-09-12T18:09:29.854446+0000","last_clean":"2024-09-12T18:09:29.854446+0000","last_became_active":"2024-09-12T17:46:57.089601+0000","last_became_peered":"2024-09-12T17:46:57.089601+0000","last_unstale":"2024-09-12T18:09:29.854446+0000","last_undegraded":"2024-09-12T18:09:29.854446+0000","last_fullsized":"2024-09-12T18:09:29.854446+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:13:07.708030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"0'0","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:19.856690+0000","last_change":"2024-09-12T17:30:16.679697+0000","last_active":"2024-09-12T18:09:19.856690+0000","last_peered":"2024-09-12T18:09:19.856690+0000","last_clean":"2024-09-12T18:09:19.856690+0000","last_became_active":"2024-09-12T17:30:16.679308+0000","last_became_peered":"2024-09-12T17:30:16.679308+0000","last_unstale":"2024-09-12T18:09:19.856690+0000","last_undegraded":"2024-09-12T18:09:19.856690+0000","last_fullsized":"2024-09-12T18:09:19.856690+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:06:24.083988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"263'5","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:41.081740+0000","last_change":"2024-09-12T17:30:12.645085+0000","last_active":"2024-09-12T18:11:41.081740+0000","last_peered":"2024-09-12T18:11:41.081740+0000","last_clean":"2024-09-12T18:11:41.081740+0000","last_became_active":"2024-09-12T17:30:12.644792+0000","last_became_peered":"2024-09-12T17:30:12.644792+0000","last_unstale":"2024-09-12T18:11:41.081740+0000","last_undegraded":"2024-09-12T18:11:41.081740+0000","last_fullsized":"2024-09-12T18:11:41.081740+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:25:31.260415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6192,"num_write":5,"num_write_kb":6192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"263'30","reported_seq":142,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:19.845281+0000","last_change":"2024-09-12T17:26:35.667932+0000","last_active":"2024-09-12T18:09:19.845281+0000","last_peered":"2024-09-12T18:09:19.845281+0000","last_clean":"2024-09-12T18:09:19.845281+0000","last_became_active":"2024-09-12T17:26:35.667655+0000","last_became_peered":"2024-09-12T17:26:35.667655+0000","last_unstale":"2024-09-12T18:09:19.845281+0000","last_undegraded":"2024-09-12T18:09:19.845281+0000","last_fullsized":"2024-09-12T18:09:19.845281+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:21:57.489397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":166,"num_read_kb":116,"num_write":53,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:19.839947+0000","last_change":"2024-09-12T17:46:57.090843+0000","last_active":"2024-09-12T18:07:19.839947+0000","last_peered":"2024-09-12T18:07:19.839947+0000","last_clean":"2024-09-12T18:07:19.839947+0000","last_became_active":"2024-09-12T17:46:57.090477+0000","last_became_peered":"2024-09-12T17:46:57.090477+0000","last_unstale":"2024-09-12T18:07:19.839947+0000","last_undegraded":"2024-09-12T18:07:19.839947+0000","last_fullsized":"2024-09-12T18:07:19.839947+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:01:13.812814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"260'8","reported_seq":57,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:19.857045+0000","last_change":"2024-09-12T17:30:16.673290+0000","last_active":"2024-09-12T18:09:19.857045+0000","last_peered":"2024-09-12T18:09:19.857045+0000","last_clean":"2024-09-12T18:09:19.857045+0000","last_became_active":"2024-09-12T17:30:16.672989+0000","last_became_peered":"2024-09-12T17:30:16.672989+0000","last_unstale":"2024-09-12T18:09:19.857045+0000","last_undegraded":"2024-09-12T18:09:19.857045+0000","last_fullsized":"2024-09-12T18:09:19.857045+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:58:17.894413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":6167,"num_write":13,"num_write_kb":6167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"263'3","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:24.954765+0000","last_change":"2024-09-12T17:30:12.642188+0000","last_active":"2024-09-12T18:11:24.954765+0000","last_peered":"2024-09-12T18:11:24.954765+0000","last_clean":"2024-09-12T18:11:24.954765+0000","last_became_active":"2024-09-12T17:30:12.641901+0000","last_became_peered":"2024-09-12T17:30:12.641901+0000","last_unstale":"2024-09-12T18:11:24.954765+0000","last_undegraded":"2024-09-12T18:11:24.954765+0000","last_fullsized":"2024-09-12T18:11:24.954765+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:30:51.212272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"263'9","reported_seq":78,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:49.844267+0000","last_change":"2024-09-12T17:26:35.655618+0000","last_active":"2024-09-12T18:07:49.844267+0000","last_peered":"2024-09-12T18:07:49.844267+0000","last_clean":"2024-09-12T18:07:49.844267+0000","last_became_active":"2024-09-12T17:26:35.655307+0000","last_became_peered":"2024-09-12T17:26:35.655307+0000","last_unstale":"2024-09-12T18:07:49.844267+0000","last_undegraded":"2024-09-12T18:07:49.844267+0000","last_fullsized":"2024-09-12T18:07:49.844267+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:34:53.632505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":30,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"263'1","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:29.858857+0000","last_change":"2024-09-12T17:46:57.086405+0000","last_active":"2024-09-12T18:09:29.858857+0000","last_peered":"2024-09-12T18:09:29.858857+0000","last_clean":"2024-09-12T18:09:29.858857+0000","last_became_active":"2024-09-12T17:46:57.086116+0000","last_became_peered":"2024-09-12T17:46:57.086116+0000","last_unstale":"2024-09-12T18:09:29.858857+0000","last_undegraded":"2024-09-12T18:09:29.858857+0000","last_fullsized":"2024-09-12T18:09:29.858857+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:36:48.862604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:35.144176+0000","last_change":"2024-09-12T17:30:16.676645+0000","last_active":"2024-09-12T18:08:35.144176+0000","last_peered":"2024-09-12T18:08:35.144176+0000","last_clean":"2024-09-12T18:08:35.144176+0000","last_became_active":"2024-09-12T17:30:16.675243+0000","last_became_peered":"2024-09-12T17:30:16.675243+0000","last_unstale":"2024-09-12T18:08:35.144176+0000","last_undegraded":"2024-09-12T18:08:35.144176+0000","last_fullsized":"2024-09-12T18:08:35.144176+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:41:53.506076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"263'2","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:34.752954+0000","last_change":"2024-09-12T17:30:12.641067+0000","last_active":"2024-09-12T18:11:34.752954+0000","last_peered":"2024-09-12T18:11:34.752954+0000","last_clean":"2024-09-12T18:11:34.752954+0000","last_became_active":"2024-09-12T17:30:12.640736+0000","last_became_peered":"2024-09-12T17:30:12.640736+0000","last_unstale":"2024-09-12T18:11:34.752954+0000","last_undegraded":"2024-09-12T18:11:34.752954+0000","last_fullsized":"2024-09-12T18:11:34.752954+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:58:18.939586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"0'0","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:44.841920+0000","last_change":"2024-09-12T17:26:35.656429+0000","last_active":"2024-09-12T18:07:44.841920+0000","last_peered":"2024-09-12T18:07:44.841920+0000","last_clean":"2024-09-12T18:07:44.841920+0000","last_became_active":"2024-09-12T17:26:35.656149+0000","last_became_peered":"2024-09-12T17:26:35.656149+0000","last_unstale":"2024-09-12T18:07:44.841920+0000","last_undegraded":"2024-09-12T18:07:44.841920+0000","last_fullsized":"2024-09-12T18:07:44.841920+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:53:34.940903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:29.846502+0000","last_change":"2024-09-12T17:46:57.096748+0000","last_active":"2024-09-12T18:09:29.846502+0000","last_peered":"2024-09-12T18:09:29.846502+0000","last_clean":"2024-09-12T18:09:29.846502+0000","last_became_active":"2024-09-12T17:46:57.096375+0000","last_became_peered":"2024-09-12T17:46:57.096375+0000","last_unstale":"2024-09-12T18:09:29.846502+0000","last_undegraded":"2024-09-12T18:09:29.846502+0000","last_fullsized":"2024-09-12T18:09:29.846502+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"263'2","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:34.877246+0000","last_change":"2024-09-12T17:30:16.686958+0000","last_active":"2024-09-12T18:11:34.877246+0000","last_peered":"2024-09-12T18:11:34.877246+0000","last_clean":"2024-09-12T18:11:34.877246+0000","last_became_active":"2024-09-12T17:30:16.686562+0000","last_became_peered":"2024-09-12T17:30:16.686562+0000","last_unstale":"2024-09-12T18:11:34.877246+0000","last_undegraded":"2024-09-12T18:11:34.877246+0000","last_fullsized":"2024-09-12T18:11:34.877246+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:17:00.235108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"263'5","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:41.207715+0000","last_change":"2024-09-12T17:30:12.644840+0000","last_active":"2024-09-12T18:11:41.207715+0000","last_peered":"2024-09-12T18:11:41.207715+0000","last_clean":"2024-09-12T18:11:41.207715+0000","last_became_active":"2024-09-12T17:30:12.644490+0000","last_became_peered":"2024-09-12T17:30:12.644490+0000","last_unstale":"2024-09-12T18:11:41.207715+0000","last_undegraded":"2024-09-12T18:11:41.207715+0000","last_fullsized":"2024-09-12T18:11:41.207715+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:52:02.191118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":9216,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"263'23","reported_seq":115,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:44.863265+0000","last_change":"2024-09-12T17:26:35.665188+0000","last_active":"2024-09-12T18:07:44.863265+0000","last_peered":"2024-09-12T18:07:44.863265+0000","last_clean":"2024-09-12T18:07:44.863265+0000","last_became_active":"2024-09-12T17:26:35.664849+0000","last_became_peered":"2024-09-12T17:26:35.664849+0000","last_unstale":"2024-09-12T18:07:44.863265+0000","last_undegraded":"2024-09-12T18:07:44.863265+0000","last_fullsized":"2024-09-12T18:07:44.863265+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:29:49.144321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":79,"num_write":44,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:49.844298+0000","last_change":"2024-09-12T17:46:57.089388+0000","last_active":"2024-09-12T18:07:49.844298+0000","last_peered":"2024-09-12T18:07:49.844298+0000","last_clean":"2024-09-12T18:07:49.844298+0000","last_became_active":"2024-09-12T17:46:57.089081+0000","last_became_peered":"2024-09-12T17:46:57.089081+0000","last_unstale":"2024-09-12T18:07:49.844298+0000","last_undegraded":"2024-09-12T18:07:49.844298+0000","last_fullsized":"2024-09-12T18:07:49.844298+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:14:44.213114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"0'0","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:54.834972+0000","last_change":"2024-09-12T17:30:16.681225+0000","last_active":"2024-09-12T18:07:54.834972+0000","last_peered":"2024-09-12T18:07:54.834972+0000","last_clean":"2024-09-12T18:07:54.834972+0000","last_became_active":"2024-09-12T17:30:16.680901+0000","last_became_peered":"2024-09-12T17:30:16.680901+0000","last_unstale":"2024-09-12T18:07:54.834972+0000","last_undegraded":"2024-09-12T18:07:54.834972+0000","last_fullsized":"2024-09-12T18:07:54.834972+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:32:33.218603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"0'0","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:44.843546+0000","last_change":"2024-09-12T17:30:12.649239+0000","last_active":"2024-09-12T18:07:44.843546+0000","last_peered":"2024-09-12T18:07:44.843546+0000","last_clean":"2024-09-12T18:07:44.843546+0000","last_became_active":"2024-09-12T17:30:12.648875+0000","last_became_peered":"2024-09-12T17:30:12.648875+0000","last_unstale":"2024-09-12T18:07:44.843546+0000","last_undegraded":"2024-09-12T18:07:44.843546+0000","last_fullsized":"2024-09-12T18:07:44.843546+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:46:54.532755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"263'15","reported_seq":92,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:44.833731+0000","last_change":"2024-09-12T17:26:35.668474+0000","last_active":"2024-09-12T18:07:44.833731+0000","last_peered":"2024-09-12T18:07:44.833731+0000","last_clean":"2024-09-12T18:07:44.833731+0000","last_became_active":"2024-09-12T17:26:35.668118+0000","last_became_peered":"2024-09-12T17:26:35.668118+0000","last_unstale":"2024-09-12T18:07:44.833731+0000","last_undegraded":"2024-09-12T18:07:44.833731+0000","last_fullsized":"2024-09-12T18:07:44.833731+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:54:30.960531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":44,"num_write":31,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:49.843508+0000","last_change":"2024-09-12T17:46:57.086214+0000","last_active":"2024-09-12T18:07:49.843508+0000","last_peered":"2024-09-12T18:07:49.843508+0000","last_clean":"2024-09-12T18:07:49.843508+0000","last_became_active":"2024-09-12T17:46:57.085922+0000","last_became_peered":"2024-09-12T17:46:57.085922+0000","last_unstale":"2024-09-12T18:07:49.843508+0000","last_undegraded":"2024-09-12T18:07:49.843508+0000","last_fullsized":"2024-09-12T18:07:49.843508+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:03:09.811603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"263'6","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:41.113554+0000","last_change":"2024-09-12T17:30:16.669329+0000","last_active":"2024-09-12T18:11:41.113554+0000","last_peered":"2024-09-12T18:11:41.113554+0000","last_clean":"2024-09-12T18:11:41.113554+0000","last_became_active":"2024-09-12T17:30:16.668999+0000","last_became_peered":"2024-09-12T17:30:16.668999+0000","last_unstale":"2024-09-12T18:11:41.113554+0000","last_undegraded":"2024-09-12T18:11:41.113554+0000","last_fullsized":"2024-09-12T18:11:41.113554+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:39:23.168458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":12288,"num_write":11,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"0'0","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:54.830107+0000","last_change":"2024-09-12T17:30:12.650378+0000","last_active":"2024-09-12T18:07:54.830107+0000","last_peered":"2024-09-12T18:07:54.830107+0000","last_clean":"2024-09-12T18:07:54.830107+0000","last_became_active":"2024-09-12T17:30:12.649350+0000","last_became_peered":"2024-09-12T17:30:12.649350+0000","last_unstale":"2024-09-12T18:07:54.830107+0000","last_undegraded":"2024-09-12T18:07:54.830107+0000","last_fullsized":"2024-09-12T18:07:54.830107+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:58:25.779058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"263'20","reported_seq":115,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:44.863349+0000","last_change":"2024-09-12T17:26:35.667425+0000","last_active":"2024-09-12T18:07:44.863349+0000","last_peered":"2024-09-12T18:07:44.863349+0000","last_clean":"2024-09-12T18:07:44.863349+0000","last_became_active":"2024-09-12T17:26:35.667060+0000","last_became_peered":"2024-09-12T17:26:35.667060+0000","last_unstale":"2024-09-12T18:07:44.863349+0000","last_undegraded":"2024-09-12T18:07:44.863349+0000","last_fullsized":"2024-09-12T18:07:44.863349+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:13:33.511985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":80,"num_write":36,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:00.146690+0000","last_change":"2024-09-12T17:46:57.078643+0000","last_active":"2024-09-12T18:09:00.146690+0000","last_peered":"2024-09-12T18:09:00.146690+0000","last_clean":"2024-09-12T18:09:00.146690+0000","last_became_active":"2024-09-12T17:46:57.076358+0000","last_became_peered":"2024-09-12T17:46:57.076358+0000","last_unstale":"2024-09-12T18:09:00.146690+0000","last_undegraded":"2024-09-12T18:09:00.146690+0000","last_fullsized":"2024-09-12T18:09:00.146690+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:22:38.368544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"260'3","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:19.857246+0000","last_change":"2024-09-12T17:30:16.676537+0000","last_active":"2024-09-12T18:09:19.857246+0000","last_peered":"2024-09-12T18:09:19.857246+0000","last_clean":"2024-09-12T18:09:19.857246+0000","last_became_active":"2024-09-12T17:30:16.676187+0000","last_became_peered":"2024-09-12T17:30:16.676187+0000","last_unstale":"2024-09-12T18:09:19.857246+0000","last_undegraded":"2024-09-12T18:09:19.857246+0000","last_fullsized":"2024-09-12T18:09:19.857246+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:03:12.668403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"263'5","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:24.875282+0000","last_change":"2024-09-12T17:30:12.651492+0000","last_active":"2024-09-12T18:11:24.875282+0000","last_peered":"2024-09-12T18:11:24.875282+0000","last_clean":"2024-09-12T18:11:24.875282+0000","last_became_active":"2024-09-12T17:30:12.651254+0000","last_became_peered":"2024-09-12T17:30:12.651254+0000","last_unstale":"2024-09-12T18:11:24.875282+0000","last_undegraded":"2024-09-12T18:11:24.875282+0000","last_fullsized":"2024-09-12T18:11:24.875282+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:54:45.814379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":16,"num_write":10,"num_write_kb":1040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"263'21","reported_seq":106,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:19.848719+0000","last_change":"2024-09-12T17:26:35.660865+0000","last_active":"2024-09-12T18:08:19.848719+0000","last_peered":"2024-09-12T18:08:19.848719+0000","last_clean":"2024-09-12T18:08:19.848719+0000","last_became_active":"2024-09-12T17:26:35.660521+0000","last_became_peered":"2024-09-12T17:26:35.660521+0000","last_unstale":"2024-09-12T18:08:19.848719+0000","last_undegraded":"2024-09-12T18:08:19.848719+0000","last_fullsized":"2024-09-12T18:08:19.848719+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:36:23.758533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":60,"num_write":47,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:49.844137+0000","last_change":"2024-09-12T17:46:57.076516+0000","last_active":"2024-09-12T18:07:49.844137+0000","last_peered":"2024-09-12T18:07:49.844137+0000","last_clean":"2024-09-12T18:07:49.844137+0000","last_became_active":"2024-09-12T17:46:57.075936+0000","last_became_peered":"2024-09-12T17:46:57.075936+0000","last_unstale":"2024-09-12T18:07:49.844137+0000","last_undegraded":"2024-09-12T18:07:49.844137+0000","last_fullsized":"2024-09-12T18:07:49.844137+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:03:25.092644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"0'0","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:19.856809+0000","last_change":"2024-09-12T17:30:16.671561+0000","last_active":"2024-09-12T18:09:19.856809+0000","last_peered":"2024-09-12T18:09:19.856809+0000","last_clean":"2024-09-12T18:09:19.856809+0000","last_became_active":"2024-09-12T17:30:16.671232+0000","last_became_peered":"2024-09-12T17:30:16.671232+0000","last_unstale":"2024-09-12T18:09:19.856809+0000","last_undegraded":"2024-09-12T18:09:19.856809+0000","last_fullsized":"2024-09-12T18:09:19.856809+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:01:53.261691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"260'3","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:14.856411+0000","last_change":"2024-09-12T17:30:12.652805+0000","last_active":"2024-09-12T18:09:14.856411+0000","last_peered":"2024-09-12T18:09:14.856411+0000","last_clean":"2024-09-12T18:09:14.856411+0000","last_became_active":"2024-09-12T17:30:12.652439+0000","last_became_peered":"2024-09-12T17:30:12.652439+0000","last_unstale":"2024-09-12T18:09:14.856411+0000","last_undegraded":"2024-09-12T18:09:14.856411+0000","last_fullsized":"2024-09-12T18:09:14.856411+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:38:28.870273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"263'34","reported_seq":144,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:15.141873+0000","last_change":"2024-09-12T17:26:35.664662+0000","last_active":"2024-09-12T18:08:15.141873+0000","last_peered":"2024-09-12T18:08:15.141873+0000","last_clean":"2024-09-12T18:08:15.141873+0000","last_became_active":"2024-09-12T17:26:35.664338+0000","last_became_peered":"2024-09-12T17:26:35.664338+0000","last_unstale":"2024-09-12T18:08:15.141873+0000","last_undegraded":"2024-09-12T18:08:15.141873+0000","last_fullsized":"2024-09-12T18:08:15.141873+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:31:50.906050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":161,"num_read_kb":109,"num_write":67,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"262'1","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:39.834842+0000","last_change":"2024-09-12T17:46:57.091123+0000","last_active":"2024-09-12T18:08:39.834842+0000","last_peered":"2024-09-12T18:08:39.834842+0000","last_clean":"2024-09-12T18:08:39.834842+0000","last_became_active":"2024-09-12T17:46:57.090581+0000","last_became_peered":"2024-09-12T17:46:57.090581+0000","last_unstale":"2024-09-12T18:08:39.834842+0000","last_undegraded":"2024-09-12T18:08:39.834842+0000","last_fullsized":"2024-09-12T18:08:39.834842+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:32:17.465596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"260'3","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:50.139110+0000","last_change":"2024-09-12T17:30:16.677712+0000","last_active":"2024-09-12T18:07:50.139110+0000","last_peered":"2024-09-12T18:07:50.139110+0000","last_clean":"2024-09-12T18:07:50.139110+0000","last_became_active":"2024-09-12T17:30:16.677428+0000","last_became_peered":"2024-09-12T17:30:16.677428+0000","last_unstale":"2024-09-12T18:07:50.139110+0000","last_undegraded":"2024-09-12T18:07:50.139110+0000","last_fullsized":"2024-09-12T18:07:50.139110+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:43:08.742548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"263'6","reported_seq":59,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:10:19.866940+0000","last_change":"2024-09-12T17:30:12.644935+0000","last_active":"2024-09-12T18:10:19.866940+0000","last_peered":"2024-09-12T18:10:19.866940+0000","last_clean":"2024-09-12T18:10:19.866940+0000","last_became_active":"2024-09-12T17:30:12.644600+0000","last_became_peered":"2024-09-12T17:30:12.644600+0000","last_unstale":"2024-09-12T18:10:19.866940+0000","last_undegraded":"2024-09-12T18:10:19.866940+0000","last_fullsized":"2024-09-12T18:10:19.866940+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:08:42.394913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6144,"num_write":11,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"263'63","reported_seq":232,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:14.846770+0000","last_change":"2024-09-12T17:26:35.658927+0000","last_active":"2024-09-12T18:08:14.846770+0000","last_peered":"2024-09-12T18:08:14.846770+0000","last_clean":"2024-09-12T18:08:14.846770+0000","last_became_active":"2024-09-12T17:26:35.658630+0000","last_became_peered":"2024-09-12T17:26:35.658630+0000","last_unstale":"2024-09-12T18:08:14.846770+0000","last_undegraded":"2024-09-12T18:08:14.846770+0000","last_fullsized":"2024-09-12T18:08:14.846770+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:40:44.086306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":336,"num_read_kb":235,"num_write":105,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:39.840111+0000","last_change":"2024-09-12T17:46:57.093471+0000","last_active":"2024-09-12T18:08:39.840111+0000","last_peered":"2024-09-12T18:08:39.840111+0000","last_clean":"2024-09-12T18:08:39.840111+0000","last_became_active":"2024-09-12T17:46:57.092472+0000","last_became_peered":"2024-09-12T17:46:57.092472+0000","last_unstale":"2024-09-12T18:08:39.840111+0000","last_undegraded":"2024-09-12T18:08:39.840111+0000","last_fullsized":"2024-09-12T18:08:39.840111+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:53:15.268714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"0'0","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:34.849448+0000","last_change":"2024-09-12T17:30:16.675715+0000","last_active":"2024-09-12T18:08:34.849448+0000","last_peered":"2024-09-12T18:08:34.849448+0000","last_clean":"2024-09-12T18:08:34.849448+0000","last_became_active":"2024-09-12T17:30:16.675380+0000","last_became_peered":"2024-09-12T17:30:16.675380+0000","last_unstale":"2024-09-12T18:08:34.849448+0000","last_undegraded":"2024-09-12T18:08:34.849448+0000","last_fullsized":"2024-09-12T18:08:34.849448+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:03:46.402687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"0'0","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:44.843471+0000","last_change":"2024-09-12T17:30:12.652798+0000","last_active":"2024-09-12T18:07:44.843471+0000","last_peered":"2024-09-12T18:07:44.843471+0000","last_clean":"2024-09-12T18:07:44.843471+0000","last_became_active":"2024-09-12T17:30:12.652368+0000","last_became_peered":"2024-09-12T17:30:12.652368+0000","last_unstale":"2024-09-12T18:07:44.843471+0000","last_undegraded":"2024-09-12T18:07:44.843471+0000","last_fullsized":"2024-09-12T18:07:44.843471+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:17:25.947883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"263'14","reported_seq":92,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:14.847538+0000","last_change":"2024-09-12T17:26:35.662321+0000","last_active":"2024-09-12T18:08:14.847538+0000","last_peered":"2024-09-12T18:08:14.847538+0000","last_clean":"2024-09-12T18:08:14.847538+0000","last_became_active":"2024-09-12T17:26:35.662029+0000","last_became_peered":"2024-09-12T17:26:35.662029+0000","last_unstale":"2024-09-12T18:08:14.847538+0000","last_undegraded":"2024-09-12T18:08:14.847538+0000","last_fullsized":"2024-09-12T18:08:14.847538+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:25:20.058995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":47,"num_write":25,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:49.834357+0000","last_change":"2024-09-12T17:46:57.088925+0000","last_active":"2024-09-12T18:07:49.834357+0000","last_peered":"2024-09-12T18:07:49.834357+0000","last_clean":"2024-09-12T18:07:49.834357+0000","last_became_active":"2024-09-12T17:46:57.088577+0000","last_became_peered":"2024-09-12T17:46:57.088577+0000","last_unstale":"2024-09-12T18:07:49.834357+0000","last_undegraded":"2024-09-12T18:07:49.834357+0000","last_fullsized":"2024-09-12T18:07:49.834357+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:13:06.852295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"263'5","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:41.180308+0000","last_change":"2024-09-12T17:30:16.687859+0000","last_active":"2024-09-12T18:11:41.180308+0000","last_peered":"2024-09-12T18:11:41.180308+0000","last_clean":"2024-09-12T18:11:41.180308+0000","last_became_active":"2024-09-12T17:30:16.687560+0000","last_became_peered":"2024-09-12T17:30:16.687560+0000","last_unstale":"2024-09-12T18:11:41.180308+0000","last_undegraded":"2024-09-12T18:11:41.180308+0000","last_fullsized":"2024-09-12T18:11:41.180308+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:18:26.345356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":15360,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"260'5","reported_seq":63,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:45.138528+0000","last_change":"2024-09-12T17:30:12.646334+0000","last_active":"2024-09-12T18:07:45.138528+0000","last_peered":"2024-09-12T18:07:45.138528+0000","last_clean":"2024-09-12T18:07:45.138528+0000","last_became_active":"2024-09-12T17:30:12.646002+0000","last_became_peered":"2024-09-12T17:30:12.646002+0000","last_unstale":"2024-09-12T18:07:45.138528+0000","last_undegraded":"2024-09-12T18:07:45.138528+0000","last_fullsized":"2024-09-12T18:07:45.138528+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:37:55.039202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"263'38","reported_seq":162,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:14.867529+0000","last_change":"2024-09-12T17:26:35.665038+0000","last_active":"2024-09-12T18:08:14.867529+0000","last_peered":"2024-09-12T18:08:14.867529+0000","last_clean":"2024-09-12T18:08:14.867529+0000","last_became_active":"2024-09-12T17:26:35.664653+0000","last_became_peered":"2024-09-12T17:26:35.664653+0000","last_unstale":"2024-09-12T18:08:14.867529+0000","last_undegraded":"2024-09-12T18:08:14.867529+0000","last_fullsized":"2024-09-12T18:08:14.867529+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:25:13.289455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":203,"num_read_kb":159,"num_write":60,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:54.845096+0000","last_change":"2024-09-12T17:46:57.092076+0000","last_active":"2024-09-12T18:07:54.845096+0000","last_peered":"2024-09-12T18:07:54.845096+0000","last_clean":"2024-09-12T18:07:54.845096+0000","last_became_active":"2024-09-12T17:46:57.091489+0000","last_became_peered":"2024-09-12T17:46:57.091489+0000","last_unstale":"2024-09-12T18:07:54.845096+0000","last_undegraded":"2024-09-12T18:07:54.845096+0000","last_fullsized":"2024-09-12T18:07:54.845096+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:45:12.006559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"263'2","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:54.862243+0000","last_change":"2024-09-12T17:30:16.671442+0000","last_active":"2024-09-12T18:09:54.862243+0000","last_peered":"2024-09-12T18:09:54.862243+0000","last_clean":"2024-09-12T18:09:54.862243+0000","last_became_active":"2024-09-12T17:30:16.671126+0000","last_became_peered":"2024-09-12T17:30:16.671126+0000","last_unstale":"2024-09-12T18:09:54.862243+0000","last_undegraded":"2024-09-12T18:09:54.862243+0000","last_fullsized":"2024-09-12T18:09:54.862243+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:55:00.165120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":48,"num_write":2,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"260'3","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:44.863319+0000","last_change":"2024-09-12T17:30:12.645438+0000","last_active":"2024-09-12T18:07:44.863319+0000","last_peered":"2024-09-12T18:07:44.863319+0000","last_clean":"2024-09-12T18:07:44.863319+0000","last_became_active":"2024-09-12T17:30:12.645099+0000","last_became_peered":"2024-09-12T17:30:12.645099+0000","last_unstale":"2024-09-12T18:07:44.863319+0000","last_undegraded":"2024-09-12T18:07:44.863319+0000","last_fullsized":"2024-09-12T18:07:44.863319+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:10:18.763902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"263'42","reported_seq":167,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:39.851442+0000","last_change":"2024-09-12T17:26:35.666120+0000","last_active":"2024-09-12T18:08:39.851442+0000","last_peered":"2024-09-12T18:08:39.851442+0000","last_clean":"2024-09-12T18:08:39.851442+0000","last_became_active":"2024-09-12T17:26:35.665804+0000","last_became_peered":"2024-09-12T17:26:35.665804+0000","last_unstale":"2024-09-12T18:08:39.851442+0000","last_undegraded":"2024-09-12T18:08:39.851442+0000","last_fullsized":"2024-09-12T18:08:39.851442+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:39:01.905486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":202,"num_read_kb":139,"num_write":84,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"263'208","reported_seq":811,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:41.314478+0000","last_change":"2024-09-12T17:10:42.526331+0000","last_active":"2024-09-12T18:11:41.314478+0000","last_peered":"2024-09-12T18:11:41.314478+0000","last_clean":"2024-09-12T18:11:41.314478+0000","last_became_active":"2024-09-12T17:10:42.523450+0000","last_became_peered":"2024-09-12T17:10:42.523450+0000","last_unstale":"2024-09-12T18:11:41.314478+0000","last_undegraded":"2024-09-12T18:11:41.314478+0000","last_fullsized":"2024-09-12T18:11:41.314478+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:26:36.695715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2159819,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":364,"num_read_kb":12797,"num_write":994,"num_write_kb":38748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0,5],"acting":[7,6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"263'408","reported_seq":1922,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:58.797415+0000","last_change":"2024-09-12T17:10:44.521376+0000","last_active":"2024-09-12T18:08:58.797415+0000","last_peered":"2024-09-12T18:08:58.797415+0000","last_clean":"2024-09-12T18:08:58.797415+0000","last_became_active":"2024-09-12T17:10:44.521072+0000","last_became_peered":"2024-09-12T17:10:44.521072+0000","last_unstale":"2024-09-12T18:08:58.797415+0000","last_undegraded":"2024-09-12T18:08:58.797415+0000","last_fullsized":"2024-09-12T18:08:58.797415+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":300,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:24:54.440783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2237,"num_read_kb":2119,"num_write":474,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"263'162","reported_seq":798,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:41.313757+0000","last_change":"2024-09-12T17:10:42.516137+0000","last_active":"2024-09-12T18:11:41.313757+0000","last_peered":"2024-09-12T18:11:41.313757+0000","last_clean":"2024-09-12T18:11:41.313757+0000","last_became_active":"2024-09-12T17:10:42.515714+0000","last_became_peered":"2024-09-12T17:10:42.515714+0000","last_unstale":"2024-09-12T18:11:41.313757+0000","last_undegraded":"2024-09-12T18:11:41.313757+0000","last_fullsized":"2024-09-12T18:11:41.313757+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:42:36.192689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32998,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":410,"num_read_kb":24642,"num_write":804,"num_write_kb":5824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6,4],"acting":[1,0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"263'569","reported_seq":2037,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:06.320505+0000","last_change":"2024-09-12T17:10:44.521016+0000","last_active":"2024-09-12T18:09:06.320505+0000","last_peered":"2024-09-12T18:09:06.320505+0000","last_clean":"2024-09-12T18:09:06.320505+0000","last_became_active":"2024-09-12T17:10:44.520662+0000","last_became_peered":"2024-09-12T17:10:44.520662+0000","last_unstale":"2024-09-12T18:09:06.320505+0000","last_undegraded":"2024-09-12T18:09:06.320505+0000","last_fullsized":"2024-09-12T18:09:06.320505+0000","mapping_epoch":26,"log_start":"263'500","ondisk_log_start":"263'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":500,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:26:51.418557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2846,"num_read_kb":2568,"num_write":745,"num_write_kb":247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"263'196","reported_seq":882,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:41.147076+0000","last_change":"2024-09-12T17:10:42.514886+0000","last_active":"2024-09-12T18:11:41.147076+0000","last_peered":"2024-09-12T18:11:41.147076+0000","last_clean":"2024-09-12T18:11:41.147076+0000","last_became_active":"2024-09-12T17:10:42.514502+0000","last_became_peered":"2024-09-12T17:10:42.514502+0000","last_unstale":"2024-09-12T18:11:41.147076+0000","last_undegraded":"2024-09-12T18:11:41.147076+0000","last_fullsized":"2024-09-12T18:11:41.147076+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:38:43.328631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":373080,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":506,"num_read_kb":116995,"num_write":945,"num_write_kb":47431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,7],"acting":[0,2,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"263'510","reported_seq":2192,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:55.344424+0000","last_change":"2024-09-12T17:10:44.515786+0000","last_active":"2024-09-12T18:08:55.344424+0000","last_peered":"2024-09-12T18:08:55.344424+0000","last_clean":"2024-09-12T18:08:55.344424+0000","last_became_active":"2024-09-12T17:10:44.515053+0000","last_became_peered":"2024-09-12T17:10:44.515053+0000","last_unstale":"2024-09-12T18:08:55.344424+0000","last_undegraded":"2024-09-12T18:08:55.344424+0000","last_fullsized":"2024-09-12T18:08:55.344424+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":400,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:16:05.419489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2823,"num_read_kb":2642,"num_write":595,"num_write_kb":151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"263'186","reported_seq":811,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:41.319658+0000","last_change":"2024-09-12T17:10:42.515615+0000","last_active":"2024-09-12T18:11:41.319658+0000","last_peered":"2024-09-12T18:11:41.319658+0000","last_clean":"2024-09-12T18:11:41.319658+0000","last_became_active":"2024-09-12T17:10:42.515202+0000","last_became_peered":"2024-09-12T17:10:42.515202+0000","last_unstale":"2024-09-12T18:11:41.319658+0000","last_undegraded":"2024-09-12T18:11:41.319658+0000","last_fullsized":"2024-09-12T18:11:41.319658+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:18:31.312838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":568149,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":399,"num_read_kb":32737,"num_write":933,"num_write_kb":40819,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7,2],"acting":[5,3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"263'477","reported_seq":2055,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:09.599114+0000","last_change":"2024-09-12T17:10:44.524085+0000","last_active":"2024-09-12T18:09:09.599114+0000","last_peered":"2024-09-12T18:09:09.599114+0000","last_clean":"2024-09-12T18:09:09.599114+0000","last_became_active":"2024-09-12T17:10:44.523767+0000","last_became_peered":"2024-09-12T17:10:44.523767+0000","last_unstale":"2024-09-12T18:09:09.599114+0000","last_undegraded":"2024-09-12T18:09:09.599114+0000","last_fullsized":"2024-09-12T18:09:09.599114+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":400,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:56:19.375833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2572,"num_read_kb":2417,"num_write":590,"num_write_kb":142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"263'159","reported_seq":790,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:41.199336+0000","last_change":"2024-09-12T17:10:42.523893+0000","last_active":"2024-09-12T18:11:41.199336+0000","last_peered":"2024-09-12T18:11:41.199336+0000","last_clean":"2024-09-12T18:11:41.199336+0000","last_became_active":"2024-09-12T17:10:42.523427+0000","last_became_peered":"2024-09-12T17:10:42.523427+0000","last_unstale":"2024-09-12T18:11:41.199336+0000","last_undegraded":"2024-09-12T18:11:41.199336+0000","last_fullsized":"2024-09-12T18:11:41.199336+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":100,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:01:12.856714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":439,"num_read_kb":36335,"num_write":769,"num_write_kb":30424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3,6],"acting":[7,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"263'475","reported_seq":1959,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:08.656630+0000","last_change":"2024-09-12T17:10:44.511009+0000","last_active":"2024-09-12T18:11:08.656630+0000","last_peered":"2024-09-12T18:11:08.656630+0000","last_clean":"2024-09-12T18:11:08.656630+0000","last_became_active":"2024-09-12T17:10:44.510692+0000","last_became_peered":"2024-09-12T17:10:44.510692+0000","last_unstale":"2024-09-12T18:11:08.656630+0000","last_undegraded":"2024-09-12T18:11:08.656630+0000","last_fullsized":"2024-09-12T18:11:08.656630+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":400,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:18:01.946068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2639,"num_read_kb":2478,"num_write":625,"num_write_kb":223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"263'191","reported_seq":817,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:41.158341+0000","last_change":"2024-09-12T17:10:42.525823+0000","last_active":"2024-09-12T18:11:41.158341+0000","last_peered":"2024-09-12T18:11:41.158341+0000","last_clean":"2024-09-12T18:11:41.158341+0000","last_became_active":"2024-09-12T17:10:42.525363+0000","last_became_peered":"2024-09-12T17:10:42.525363+0000","last_unstale":"2024-09-12T18:11:41.158341+0000","last_undegraded":"2024-09-12T18:11:41.158341+0000","last_fullsized":"2024-09-12T18:11:41.158341+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:02:50.629102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":412,"num_read_kb":34311,"num_write":954,"num_write_kb":12654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,4,1],"acting":[5,0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"263'875","reported_seq":2655,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:48.689421+0000","last_change":"2024-09-12T17:10:44.514182+0000","last_active":"2024-09-12T18:09:48.689421+0000","last_peered":"2024-09-12T18:09:48.689421+0000","last_clean":"2024-09-12T18:09:48.689421+0000","last_became_active":"2024-09-12T17:10:44.513865+0000","last_became_peered":"2024-09-12T17:10:44.513865+0000","last_unstale":"2024-09-12T18:09:48.689421+0000","last_undegraded":"2024-09-12T18:09:48.689421+0000","last_fullsized":"2024-09-12T18:09:48.689421+0000","mapping_epoch":26,"log_start":"263'800","ondisk_log_start":"263'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":800,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:58:50.879901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4549,"num_read_kb":4126,"num_write":1137,"num_write_kb":421,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"263'191","reported_seq":989,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:41.266291+0000","last_change":"2024-09-12T17:10:42.531846+0000","last_active":"2024-09-12T18:11:41.266291+0000","last_peered":"2024-09-12T18:11:41.266291+0000","last_clean":"2024-09-12T18:11:41.266291+0000","last_became_active":"2024-09-12T17:10:42.531356+0000","last_became_peered":"2024-09-12T17:10:42.531356+0000","last_unstale":"2024-09-12T18:11:41.266291+0000","last_undegraded":"2024-09-12T18:11:41.266291+0000","last_fullsized":"2024-09-12T18:11:41.266291+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:12:38.008206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":115,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":751,"num_read_kb":2366,"num_write":954,"num_write_kb":15239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4,6],"acting":[7,0,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"263'409","reported_seq":1925,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:09.599316+0000","last_change":"2024-09-12T17:10:44.521355+0000","last_active":"2024-09-12T18:09:09.599316+0000","last_peered":"2024-09-12T18:09:09.599316+0000","last_clean":"2024-09-12T18:09:09.599316+0000","last_became_active":"2024-09-12T17:10:44.520609+0000","last_became_peered":"2024-09-12T17:10:44.520609+0000","last_unstale":"2024-09-12T18:09:09.599316+0000","last_undegraded":"2024-09-12T18:09:09.599316+0000","last_fullsized":"2024-09-12T18:09:09.599316+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":300,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:15:20.820552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2177,"num_read_kb":2069,"num_write":470,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"263'212","reported_seq":846,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:41.316402+0000","last_change":"2024-09-12T17:10:42.528380+0000","last_active":"2024-09-12T18:11:41.316402+0000","last_peered":"2024-09-12T18:11:41.316402+0000","last_clean":"2024-09-12T18:11:41.316402+0000","last_became_active":"2024-09-12T17:10:42.527310+0000","last_became_peered":"2024-09-12T17:10:42.527310+0000","last_unstale":"2024-09-12T18:11:41.316402+0000","last_undegraded":"2024-09-12T18:11:41.316402+0000","last_fullsized":"2024-09-12T18:11:41.316402+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:59:02.965611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174892,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":472,"num_read_kb":11982,"num_write":996,"num_write_kb":39362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0,2],"acting":[3,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"263'803","reported_seq":2469,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:08.689356+0000","last_change":"2024-09-12T17:10:44.518218+0000","last_active":"2024-09-12T18:11:08.689356+0000","last_peered":"2024-09-12T18:11:08.689356+0000","last_clean":"2024-09-12T18:11:08.689356+0000","last_became_active":"2024-09-12T17:10:44.517947+0000","last_became_peered":"2024-09-12T17:10:44.517947+0000","last_unstale":"2024-09-12T18:11:08.689356+0000","last_undegraded":"2024-09-12T18:11:08.689356+0000","last_fullsized":"2024-09-12T18:11:08.689356+0000","mapping_epoch":26,"log_start":"263'700","ondisk_log_start":"263'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":700,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:23:45.311255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3878,"num_read_kb":3536,"num_write":1022,"num_write_kb":342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"263'406","reported_seq":2024,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:04.854401+0000","last_change":"2024-09-12T17:10:44.514809+0000","last_active":"2024-09-12T18:09:04.854401+0000","last_peered":"2024-09-12T18:09:04.854401+0000","last_clean":"2024-09-12T18:09:04.854401+0000","last_became_active":"2024-09-12T17:10:44.514293+0000","last_became_peered":"2024-09-12T17:10:44.514293+0000","last_unstale":"2024-09-12T18:09:04.854401+0000","last_undegraded":"2024-09-12T18:09:04.854401+0000","last_fullsized":"2024-09-12T18:09:04.854401+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":300,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:15:27.841945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2470,"num_read_kb":2366,"num_write":468,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"263'164","reported_seq":777,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:41.247243+0000","last_change":"2024-09-12T17:10:42.522308+0000","last_active":"2024-09-12T18:11:41.247243+0000","last_peered":"2024-09-12T18:11:41.247243+0000","last_clean":"2024-09-12T18:11:41.247243+0000","last_became_active":"2024-09-12T17:10:42.521637+0000","last_became_peered":"2024-09-12T17:10:42.521637+0000","last_unstale":"2024-09-12T18:11:41.247243+0000","last_undegraded":"2024-09-12T18:11:41.247243+0000","last_fullsized":"2024-09-12T18:11:41.247243+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":100,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:28:33.771646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":432508,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":446,"num_read_kb":17329,"num_write":806,"num_write_kb":49238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0,1],"acting":[7,5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"263'782","reported_seq":2276,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:04.854884+0000","last_change":"2024-09-12T17:10:44.521355+0000","last_active":"2024-09-12T18:09:04.854884+0000","last_peered":"2024-09-12T18:09:04.854884+0000","last_clean":"2024-09-12T18:09:04.854884+0000","last_became_active":"2024-09-12T17:10:44.521031+0000","last_became_peered":"2024-09-12T17:10:44.521031+0000","last_unstale":"2024-09-12T18:09:04.854884+0000","last_undegraded":"2024-09-12T18:09:04.854884+0000","last_fullsized":"2024-09-12T18:09:04.854884+0000","mapping_epoch":26,"log_start":"263'700","ondisk_log_start":"263'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":700,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:32:54.360404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3604,"num_read_kb":3242,"num_write":1018,"num_write_kb":360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"263'259","reported_seq":952,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:41.307663+0000","last_change":"2024-09-12T17:10:42.526866+0000","last_active":"2024-09-12T18:11:41.307663+0000","last_peered":"2024-09-12T18:11:41.307663+0000","last_clean":"2024-09-12T18:11:41.307663+0000","last_became_active":"2024-09-12T17:10:42.517679+0000","last_became_peered":"2024-09-12T17:10:42.517679+0000","last_unstale":"2024-09-12T18:11:41.307663+0000","last_undegraded":"2024-09-12T18:11:41.307663+0000","last_fullsized":"2024-09-12T18:11:41.307663+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":200,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:33:13.890188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1604218,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":855,"num_read_kb":4303,"num_write":1129,"num_write_kb":28670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2,1],"acting":[6,5,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"263'358","reported_seq":1812,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:19.855895+0000","last_change":"2024-09-12T17:10:44.518484+0000","last_active":"2024-09-12T18:09:19.855895+0000","last_peered":"2024-09-12T18:09:19.855895+0000","last_clean":"2024-09-12T18:09:19.855895+0000","last_became_active":"2024-09-12T17:10:44.518183+0000","last_became_peered":"2024-09-12T17:10:44.518183+0000","last_unstale":"2024-09-12T18:09:19.855895+0000","last_undegraded":"2024-09-12T18:09:19.855895+0000","last_fullsized":"2024-09-12T18:09:19.855895+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:51:18.710777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1979,"num_read_kb":1899,"num_write":385,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"263'232","reported_seq":953,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:41.215581+0000","last_change":"2024-09-12T17:10:42.518722+0000","last_active":"2024-09-12T18:11:41.215581+0000","last_peered":"2024-09-12T18:11:41.215581+0000","last_clean":"2024-09-12T18:11:41.215581+0000","last_became_active":"2024-09-12T17:10:42.518345+0000","last_became_peered":"2024-09-12T17:10:42.518345+0000","last_unstale":"2024-09-12T18:11:41.215581+0000","last_undegraded":"2024-09-12T18:11:41.215581+0000","last_fullsized":"2024-09-12T18:11:41.215581+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":200,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:55:42.993471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1367925,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":646,"num_read_kb":98876,"num_write":1054,"num_write_kb":25289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0,3],"acting":[6,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"263'516","reported_seq":2148,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:08.689613+0000","last_change":"2024-09-12T17:10:44.514989+0000","last_active":"2024-09-12T18:11:08.689613+0000","last_peered":"2024-09-12T18:11:08.689613+0000","last_clean":"2024-09-12T18:11:08.689613+0000","last_became_active":"2024-09-12T17:10:44.514645+0000","last_became_peered":"2024-09-12T17:10:44.514645+0000","last_unstale":"2024-09-12T18:11:08.689613+0000","last_undegraded":"2024-09-12T18:11:08.689613+0000","last_fullsized":"2024-09-12T18:11:08.689613+0000","mapping_epoch":26,"log_start":"263'500","ondisk_log_start":"263'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":500,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:07:24.458191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2725,"num_read_kb":2548,"num_write":623,"num_write_kb":175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"263'215","reported_seq":874,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:41.127120+0000","last_change":"2024-09-12T17:10:42.519598+0000","last_active":"2024-09-12T18:11:41.127120+0000","last_peered":"2024-09-12T18:11:41.127120+0000","last_clean":"2024-09-12T18:11:41.127120+0000","last_became_active":"2024-09-12T17:10:42.519000+0000","last_became_peered":"2024-09-12T17:10:42.519000+0000","last_unstale":"2024-09-12T18:11:41.127120+0000","last_undegraded":"2024-09-12T18:11:41.127120+0000","last_fullsized":"2024-09-12T18:11:41.127120+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":200,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:16:24.448620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":516496,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":502,"num_read_kb":33700,"num_write":932,"num_write_kb":23229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,0],"acting":[4,3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"263'1583","reported_seq":3109,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:58.601451+0000","last_change":"2024-09-12T17:10:44.515105+0000","last_active":"2024-09-12T18:08:58.601451+0000","last_peered":"2024-09-12T18:08:58.601451+0000","last_clean":"2024-09-12T18:08:58.601451+0000","last_became_active":"2024-09-12T17:10:44.514826+0000","last_became_peered":"2024-09-12T17:10:44.514826+0000","last_unstale":"2024-09-12T18:08:58.601451+0000","last_undegraded":"2024-09-12T18:08:58.601451+0000","last_fullsized":"2024-09-12T18:08:58.601451+0000","mapping_epoch":26,"log_start":"263'1500","ondisk_log_start":"263'1500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":1500,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:30:21.141258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6865,"num_read_kb":5951,"num_write":2206,"num_write_kb":956,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"263'244","reported_seq":900,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:41.284728+0000","last_change":"2024-09-12T17:10:42.533422+0000","last_active":"2024-09-12T18:11:41.284728+0000","last_peered":"2024-09-12T18:11:41.284728+0000","last_clean":"2024-09-12T18:11:41.284728+0000","last_became_active":"2024-09-12T17:10:42.532995+0000","last_became_peered":"2024-09-12T17:10:42.532995+0000","last_unstale":"2024-09-12T18:11:41.284728+0000","last_undegraded":"2024-09-12T18:11:41.284728+0000","last_fullsized":"2024-09-12T18:11:41.284728+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":200,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:44:08.027039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":786501,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":539,"num_read_kb":13123,"num_write":1227,"num_write_kb":39413,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1,5],"acting":[3,6,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"263'1288","reported_seq":3015,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:48.689829+0000","last_change":"2024-09-12T17:10:44.507748+0000","last_active":"2024-09-12T18:09:48.689829+0000","last_peered":"2024-09-12T18:09:48.689829+0000","last_clean":"2024-09-12T18:09:48.689829+0000","last_became_active":"2024-09-12T17:10:44.507428+0000","last_became_peered":"2024-09-12T17:10:44.507428+0000","last_unstale":"2024-09-12T18:09:48.689829+0000","last_undegraded":"2024-09-12T18:09:48.689829+0000","last_fullsized":"2024-09-12T18:09:48.689829+0000","mapping_epoch":26,"log_start":"263'1200","ondisk_log_start":"263'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":1200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:34:52.540295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5933,"num_read_kb":5245,"num_write":1814,"num_write_kb":777,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"263'185","reported_seq":863,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:14.844412+0000","last_change":"2024-09-12T17:10:42.529986+0000","last_active":"2024-09-12T18:09:14.844412+0000","last_peered":"2024-09-12T18:09:14.844412+0000","last_clean":"2024-09-12T18:09:14.844412+0000","last_became_active":"2024-09-12T17:10:42.529179+0000","last_became_peered":"2024-09-12T17:10:42.529179+0000","last_unstale":"2024-09-12T18:09:14.844412+0000","last_undegraded":"2024-09-12T18:09:14.844412+0000","last_fullsized":"2024-09-12T18:09:14.844412+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:53:33.632179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":576011,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":570,"num_read_kb":13539,"num_write":907,"num_write_kb":25869,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1,5],"acting":[0,4,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"263'159","reported_seq":680,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:49.689301+0000","last_change":"2024-09-12T17:10:52.566398+0000","last_active":"2024-09-12T18:09:49.689301+0000","last_peered":"2024-09-12T18:09:49.689301+0000","last_clean":"2024-09-12T18:09:49.689301+0000","last_became_active":"2024-09-12T17:10:52.566079+0000","last_became_peered":"2024-09-12T17:10:52.566079+0000","last_unstale":"2024-09-12T18:09:49.689301+0000","last_undegraded":"2024-09-12T18:09:49.689301+0000","last_fullsized":"2024-09-12T18:09:49.689301+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":100,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:46:37.549026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":803,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":269,"num_read_kb":255,"num_write":425,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"263'795","reported_seq":2403,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:19.853207+0000","last_change":"2024-09-12T17:10:44.522489+0000","last_active":"2024-09-12T18:09:19.853207+0000","last_peered":"2024-09-12T18:09:19.853207+0000","last_clean":"2024-09-12T18:09:19.853207+0000","last_became_active":"2024-09-12T17:10:44.522193+0000","last_became_peered":"2024-09-12T17:10:44.522193+0000","last_unstale":"2024-09-12T18:09:19.853207+0000","last_undegraded":"2024-09-12T18:09:19.853207+0000","last_fullsized":"2024-09-12T18:09:19.853207+0000","mapping_epoch":26,"log_start":"263'700","ondisk_log_start":"263'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":700,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:23:39.492588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3748,"num_read_kb":3407,"num_write":1044,"num_write_kb":360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"263'203","reported_seq":845,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:41.254891+0000","last_change":"2024-09-12T17:10:42.531990+0000","last_active":"2024-09-12T18:11:41.254891+0000","last_peered":"2024-09-12T18:11:41.254891+0000","last_clean":"2024-09-12T18:11:41.254891+0000","last_became_active":"2024-09-12T17:10:42.528620+0000","last_became_peered":"2024-09-12T17:10:42.528620+0000","last_unstale":"2024-09-12T18:11:41.254891+0000","last_undegraded":"2024-09-12T18:11:41.254891+0000","last_fullsized":"2024-09-12T18:11:41.254891+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:01.518991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262203,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":497,"num_read_kb":31268,"num_write":1015,"num_write_kb":14227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4,2],"acting":[7,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:49.851570+0000","last_change":"2024-09-12T17:10:46.527973+0000","last_active":"2024-09-12T18:08:49.851570+0000","last_peered":"2024-09-12T18:08:49.851570+0000","last_clean":"2024-09-12T18:08:49.851570+0000","last_became_active":"2024-09-12T17:10:46.527663+0000","last_became_peered":"2024-09-12T17:10:46.527663+0000","last_unstale":"2024-09-12T18:08:49.851570+0000","last_undegraded":"2024-09-12T18:08:49.851570+0000","last_fullsized":"2024-09-12T18:08:49.851570+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_clean_scrub_stamp":"2024-09-12T17:10:45.504515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:21:49.638349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"263'202","reported_seq":809,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:41.367008+0000","last_change":"2024-09-12T17:10:48.545372+0000","last_active":"2024-09-12T18:11:41.367008+0000","last_peered":"2024-09-12T18:11:41.367008+0000","last_clean":"2024-09-12T18:11:41.367008+0000","last_became_active":"2024-09-12T17:10:48.544885+0000","last_became_peered":"2024-09-12T17:10:48.544885+0000","last_unstale":"2024-09-12T18:11:41.367008+0000","last_undegraded":"2024-09-12T18:11:41.367008+0000","last_fullsized":"2024-09-12T18:11:41.367008+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_clean_scrub_stamp":"2024-09-12T17:10:47.516917+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":100,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:14:40.858594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6100,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":264,"num_read_kb":318,"num_write":156,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":485,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:49.852931+0000","last_change":"2024-09-12T17:10:50.556467+0000","last_active":"2024-09-12T18:08:49.852931+0000","last_peered":"2024-09-12T18:08:49.852931+0000","last_clean":"2024-09-12T18:08:49.852931+0000","last_became_active":"2024-09-12T17:10:50.556146+0000","last_became_peered":"2024-09-12T17:10:50.556146+0000","last_unstale":"2024-09-12T18:08:49.852931+0000","last_undegraded":"2024-09-12T18:08:49.852931+0000","last_fullsized":"2024-09-12T18:08:49.852931+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_clean_scrub_stamp":"2024-09-12T17:10:49.533772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:46:08.763293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"263'2474","reported_seq":4378,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:49.683677+0000","last_change":"2024-09-12T17:10:52.572598+0000","last_active":"2024-09-12T18:09:49.683677+0000","last_peered":"2024-09-12T18:09:49.683677+0000","last_clean":"2024-09-12T18:09:49.683677+0000","last_became_active":"2024-09-12T17:10:52.572326+0000","last_became_peered":"2024-09-12T17:10:52.572326+0000","last_unstale":"2024-09-12T18:09:49.683677+0000","last_undegraded":"2024-09-12T18:09:49.683677+0000","last_fullsized":"2024-09-12T18:09:49.683677+0000","mapping_epoch":34,"log_start":"263'2400","ondisk_log_start":"263'2400","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":2400,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:07:16.923827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":211,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6220,"num_read_kb":6202,"num_write":4958,"num_write_kb":1813,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"263'423","reported_seq":1877,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:08.688272+0000","last_change":"2024-09-12T17:10:44.513059+0000","last_active":"2024-09-12T18:11:08.688272+0000","last_peered":"2024-09-12T18:11:08.688272+0000","last_clean":"2024-09-12T18:11:08.688272+0000","last_became_active":"2024-09-12T17:10:44.512755+0000","last_became_peered":"2024-09-12T17:10:44.512755+0000","last_unstale":"2024-09-12T18:11:08.688272+0000","last_undegraded":"2024-09-12T18:11:08.688272+0000","last_fullsized":"2024-09-12T18:11:08.688272+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":400,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:13:48.119870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2092,"num_read_kb":1979,"num_write":465,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"263'205","reported_seq":842,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:41.264885+0000","last_change":"2024-09-12T17:10:42.514091+0000","last_active":"2024-09-12T18:11:41.264885+0000","last_peered":"2024-09-12T18:11:41.264885+0000","last_clean":"2024-09-12T18:11:41.264885+0000","last_became_active":"2024-09-12T17:10:42.513658+0000","last_became_peered":"2024-09-12T17:10:42.513658+0000","last_unstale":"2024-09-12T18:11:41.264885+0000","last_undegraded":"2024-09-12T18:11:41.264885+0000","last_fullsized":"2024-09-12T18:11:41.264885+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:37:17.251915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262204,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":448,"num_read_kb":17694,"num_write":957,"num_write_kb":36760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:24.853870+0000","last_change":"2024-09-12T17:10:46.528313+0000","last_active":"2024-09-12T18:09:24.853870+0000","last_peered":"2024-09-12T18:09:24.853870+0000","last_clean":"2024-09-12T18:09:24.853870+0000","last_became_active":"2024-09-12T17:10:46.528008+0000","last_became_peered":"2024-09-12T17:10:46.528008+0000","last_unstale":"2024-09-12T18:09:24.853870+0000","last_undegraded":"2024-09-12T18:09:24.853870+0000","last_fullsized":"2024-09-12T18:09:24.853870+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_clean_scrub_stamp":"2024-09-12T17:10:45.504515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:19:49.464976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"263'98","reported_seq":630,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:49.852429+0000","last_change":"2024-09-12T17:10:48.540285+0000","last_active":"2024-09-12T18:08:49.852429+0000","last_peered":"2024-09-12T18:08:49.852429+0000","last_clean":"2024-09-12T18:08:49.852429+0000","last_became_active":"2024-09-12T17:10:48.539249+0000","last_became_peered":"2024-09-12T17:10:48.539249+0000","last_unstale":"2024-09-12T18:08:49.852429+0000","last_undegraded":"2024-09-12T18:08:49.852429+0000","last_fullsized":"2024-09-12T18:08:49.852429+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_clean_scrub_stamp":"2024-09-12T17:10:47.516917+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:10:07.478104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":101,"num_read_kb":97,"num_write":68,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:49.852402+0000","last_change":"2024-09-12T17:10:50.560376+0000","last_active":"2024-09-12T18:08:49.852402+0000","last_peered":"2024-09-12T18:08:49.852402+0000","last_clean":"2024-09-12T18:08:49.852402+0000","last_became_active":"2024-09-12T17:10:50.559882+0000","last_became_peered":"2024-09-12T17:10:50.559882+0000","last_unstale":"2024-09-12T18:08:49.852402+0000","last_undegraded":"2024-09-12T18:08:49.852402+0000","last_fullsized":"2024-09-12T18:08:49.852402+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_clean_scrub_stamp":"2024-09-12T17:10:49.533772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:28:55.022294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"263'90","reported_seq":591,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:40.825979+0000","last_change":"2024-09-12T17:10:52.570423+0000","last_active":"2024-09-12T18:08:40.825979+0000","last_peered":"2024-09-12T18:08:40.825979+0000","last_clean":"2024-09-12T18:08:40.825979+0000","last_became_active":"2024-09-12T17:10:52.570071+0000","last_became_peered":"2024-09-12T17:10:52.570071+0000","last_unstale":"2024-09-12T18:08:40.825979+0000","last_undegraded":"2024-09-12T18:08:40.825979+0000","last_fullsized":"2024-09-12T18:08:40.825979+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:46:23.049710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":117,"num_read_kb":116,"num_write":199,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"263'443","reported_seq":1990,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:04.193040+0000","last_change":"2024-09-12T17:10:44.518158+0000","last_active":"2024-09-12T18:09:04.193040+0000","last_peered":"2024-09-12T18:09:04.193040+0000","last_clean":"2024-09-12T18:09:04.193040+0000","last_became_active":"2024-09-12T17:10:44.517886+0000","last_became_peered":"2024-09-12T17:10:44.517886+0000","last_unstale":"2024-09-12T18:09:04.193040+0000","last_undegraded":"2024-09-12T18:09:04.193040+0000","last_fullsized":"2024-09-12T18:09:04.193040+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":400,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:43:41.541508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2335,"num_read_kb":2201,"num_write":517,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"263'192","reported_seq":816,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:41.239558+0000","last_change":"2024-09-12T17:10:42.531080+0000","last_active":"2024-09-12T18:11:41.239558+0000","last_peered":"2024-09-12T18:11:41.239558+0000","last_clean":"2024-09-12T18:11:41.239558+0000","last_became_active":"2024-09-12T17:10:42.530663+0000","last_became_peered":"2024-09-12T17:10:42.530663+0000","last_unstale":"2024-09-12T18:11:41.239558+0000","last_undegraded":"2024-09-12T18:11:41.239558+0000","last_fullsized":"2024-09-12T18:11:41.239558+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:31:17.343251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6466288,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":436,"num_read_kb":14482,"num_write":960,"num_write_kb":29259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":495,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:49.849323+0000","last_change":"2024-09-12T17:10:46.530775+0000","last_active":"2024-09-12T18:08:49.849323+0000","last_peered":"2024-09-12T18:08:49.849323+0000","last_clean":"2024-09-12T18:08:49.849323+0000","last_became_active":"2024-09-12T17:10:46.530438+0000","last_became_peered":"2024-09-12T17:10:46.530438+0000","last_unstale":"2024-09-12T18:08:49.849323+0000","last_undegraded":"2024-09-12T18:08:49.849323+0000","last_fullsized":"2024-09-12T18:08:49.849323+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_clean_scrub_stamp":"2024-09-12T17:10:45.504515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:06:31.919771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"263'114","reported_seq":649,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:19.838931+0000","last_change":"2024-09-12T17:10:48.540591+0000","last_active":"2024-09-12T18:09:19.838931+0000","last_peered":"2024-09-12T18:09:19.838931+0000","last_clean":"2024-09-12T18:09:19.838931+0000","last_became_active":"2024-09-12T17:10:48.540078+0000","last_became_peered":"2024-09-12T17:10:48.540078+0000","last_unstale":"2024-09-12T18:09:19.838931+0000","last_undegraded":"2024-09-12T18:09:19.838931+0000","last_fullsized":"2024-09-12T18:09:19.838931+0000","mapping_epoch":30,"log_start":"263'100","ondisk_log_start":"263'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_clean_scrub_stamp":"2024-09-12T17:10:47.516917+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:11:14.400403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":134,"num_read_kb":129,"num_write":88,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"263'765","reported_seq":4728,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:41.009018+0000","last_change":"2024-09-12T17:10:50.563321+0000","last_active":"2024-09-12T18:11:41.009018+0000","last_peered":"2024-09-12T18:11:41.009018+0000","last_clean":"2024-09-12T18:11:41.009018+0000","last_became_active":"2024-09-12T17:10:50.562930+0000","last_became_peered":"2024-09-12T17:10:50.562930+0000","last_unstale":"2024-09-12T18:11:41.009018+0000","last_undegraded":"2024-09-12T18:11:41.009018+0000","last_fullsized":"2024-09-12T18:11:41.009018+0000","mapping_epoch":32,"log_start":"263'700","ondisk_log_start":"263'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_clean_scrub_stamp":"2024-09-12T17:10:49.533772+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":700,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:02:44.468859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"263'198","reported_seq":1047,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:49.747543+0000","last_change":"2024-09-12T17:10:52.671398+0000","last_active":"2024-09-12T18:09:49.747543+0000","last_peered":"2024-09-12T18:09:49.747543+0000","last_clean":"2024-09-12T18:09:49.747543+0000","last_became_active":"2024-09-12T17:10:52.671103+0000","last_became_peered":"2024-09-12T17:10:52.671103+0000","last_unstale":"2024-09-12T18:09:49.747543+0000","last_undegraded":"2024-09-12T18:09:49.747543+0000","last_fullsized":"2024-09-12T18:09:49.747543+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:56:47.430468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":719,"num_read_kb":693,"num_write":432,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"263'446","reported_seq":1962,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:48.690267+0000","last_change":"2024-09-12T17:10:44.515015+0000","last_active":"2024-09-12T18:09:48.690267+0000","last_peered":"2024-09-12T18:09:48.690267+0000","last_clean":"2024-09-12T18:09:48.690267+0000","last_became_active":"2024-09-12T17:10:44.514124+0000","last_became_peered":"2024-09-12T17:10:44.514124+0000","last_unstale":"2024-09-12T18:09:48.690267+0000","last_undegraded":"2024-09-12T18:09:48.690267+0000","last_fullsized":"2024-09-12T18:09:48.690267+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":400,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:59:05.101317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2305,"num_read_kb":2168,"num_write":513,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"263'223","reported_seq":879,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:41.147454+0000","last_change":"2024-09-12T17:10:42.526752+0000","last_active":"2024-09-12T18:11:41.147454+0000","last_peered":"2024-09-12T18:11:41.147454+0000","last_clean":"2024-09-12T18:11:41.147454+0000","last_became_active":"2024-09-12T17:10:42.525328+0000","last_became_peered":"2024-09-12T17:10:42.525328+0000","last_unstale":"2024-09-12T18:11:41.147454+0000","last_undegraded":"2024-09-12T18:11:41.147454+0000","last_fullsized":"2024-09-12T18:11:41.147454+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":200,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:01:32.510919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":549,"num_read_kb":47940,"num_write":1052,"num_write_kb":57690,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,3],"acting":[6,0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:49.851613+0000","last_change":"2024-09-12T17:10:46.527001+0000","last_active":"2024-09-12T18:08:49.851613+0000","last_peered":"2024-09-12T18:08:49.851613+0000","last_clean":"2024-09-12T18:08:49.851613+0000","last_became_active":"2024-09-12T17:10:46.526679+0000","last_became_peered":"2024-09-12T17:10:46.526679+0000","last_unstale":"2024-09-12T18:08:49.851613+0000","last_undegraded":"2024-09-12T18:08:49.851613+0000","last_fullsized":"2024-09-12T18:08:49.851613+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_clean_scrub_stamp":"2024-09-12T17:10:45.504515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:03:41.503120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"263'131","reported_seq":698,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:41.325827+0000","last_change":"2024-09-12T17:10:48.543886+0000","last_active":"2024-09-12T18:11:41.325827+0000","last_peered":"2024-09-12T18:11:41.325827+0000","last_clean":"2024-09-12T18:11:41.325827+0000","last_became_active":"2024-09-12T17:10:48.543573+0000","last_became_peered":"2024-09-12T17:10:48.543573+0000","last_unstale":"2024-09-12T18:11:41.325827+0000","last_undegraded":"2024-09-12T18:11:41.325827+0000","last_fullsized":"2024-09-12T18:11:41.325827+0000","mapping_epoch":30,"log_start":"263'100","ondisk_log_start":"263'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_clean_scrub_stamp":"2024-09-12T17:10:47.516917+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:34:09.400161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5773,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":175,"num_read_kb":264,"num_write":94,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"263'787","reported_seq":2298,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:41.392380+0000","last_change":"2024-09-12T17:10:50.559536+0000","last_active":"2024-09-12T18:11:41.392380+0000","last_peered":"2024-09-12T18:11:41.392380+0000","last_clean":"2024-09-12T18:11:41.392380+0000","last_became_active":"2024-09-12T17:10:50.559216+0000","last_became_peered":"2024-09-12T17:10:50.559216+0000","last_unstale":"2024-09-12T18:11:41.392380+0000","last_undegraded":"2024-09-12T18:11:41.392380+0000","last_fullsized":"2024-09-12T18:11:41.392380+0000","mapping_epoch":32,"log_start":"263'700","ondisk_log_start":"263'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_clean_scrub_stamp":"2024-09-12T17:10:49.533772+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":700,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:25:21.535911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"263'408","reported_seq":1929,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:49.545567+0000","last_change":"2024-09-12T17:10:44.516555+0000","last_active":"2024-09-12T18:09:49.545567+0000","last_peered":"2024-09-12T18:09:49.545567+0000","last_clean":"2024-09-12T18:09:49.545567+0000","last_became_active":"2024-09-12T17:10:44.516266+0000","last_became_peered":"2024-09-12T17:10:44.516266+0000","last_unstale":"2024-09-12T18:09:49.545567+0000","last_undegraded":"2024-09-12T18:09:49.545567+0000","last_fullsized":"2024-09-12T18:09:49.545567+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":300,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:00:21.370421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2231,"num_read_kb":2116,"num_write":471,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"263'319","reported_seq":1086,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:41.313629+0000","last_change":"2024-09-12T17:10:42.532317+0000","last_active":"2024-09-12T18:11:41.313629+0000","last_peered":"2024-09-12T18:11:41.313629+0000","last_clean":"2024-09-12T18:11:41.313629+0000","last_became_active":"2024-09-12T17:10:42.531886+0000","last_became_peered":"2024-09-12T17:10:42.531886+0000","last_unstale":"2024-09-12T18:11:41.313629+0000","last_undegraded":"2024-09-12T18:11:41.313629+0000","last_fullsized":"2024-09-12T18:11:41.313629+0000","mapping_epoch":24,"log_start":"263'300","ondisk_log_start":"263'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:10:32.496140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2276857,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1043,"num_read_kb":35637,"num_write":1316,"num_write_kb":31872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0,1],"acting":[7,4,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:19.857104+0000","last_change":"2024-09-12T17:10:46.519211+0000","last_active":"2024-09-12T18:09:19.857104+0000","last_peered":"2024-09-12T18:09:19.857104+0000","last_clean":"2024-09-12T18:09:19.857104+0000","last_became_active":"2024-09-12T17:10:46.518652+0000","last_became_peered":"2024-09-12T17:10:46.518652+0000","last_unstale":"2024-09-12T18:09:19.857104+0000","last_undegraded":"2024-09-12T18:09:19.857104+0000","last_fullsized":"2024-09-12T18:09:19.857104+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_clean_scrub_stamp":"2024-09-12T17:10:45.504515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:02:38.257135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"263'218","reported_seq":835,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:41.086379+0000","last_change":"2024-09-12T17:10:48.541485+0000","last_active":"2024-09-12T18:11:41.086379+0000","last_peered":"2024-09-12T18:11:41.086379+0000","last_clean":"2024-09-12T18:11:41.086379+0000","last_became_active":"2024-09-12T17:10:48.541178+0000","last_became_peered":"2024-09-12T17:10:48.541178+0000","last_unstale":"2024-09-12T18:11:41.086379+0000","last_undegraded":"2024-09-12T18:11:41.086379+0000","last_fullsized":"2024-09-12T18:11:41.086379+0000","mapping_epoch":30,"log_start":"263'200","ondisk_log_start":"263'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_clean_scrub_stamp":"2024-09-12T17:10:47.516917+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:04:05.483511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5437,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":298,"num_read_kb":347,"num_write":172,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:20.148978+0000","last_change":"2024-09-12T17:10:50.560497+0000","last_active":"2024-09-12T18:09:20.148978+0000","last_peered":"2024-09-12T18:09:20.148978+0000","last_clean":"2024-09-12T18:09:20.148978+0000","last_became_active":"2024-09-12T17:10:50.560193+0000","last_became_peered":"2024-09-12T17:10:50.560193+0000","last_unstale":"2024-09-12T18:09:20.148978+0000","last_undegraded":"2024-09-12T18:09:20.148978+0000","last_fullsized":"2024-09-12T18:09:20.148978+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_clean_scrub_stamp":"2024-09-12T17:10:49.533772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:31:52.880536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"263'555","reported_seq":1366,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:09.825289+0000","last_change":"2024-09-12T17:10:52.573117+0000","last_active":"2024-09-12T18:11:09.825289+0000","last_peered":"2024-09-12T18:11:09.825289+0000","last_clean":"2024-09-12T18:11:09.825289+0000","last_became_active":"2024-09-12T17:10:52.572861+0000","last_became_peered":"2024-09-12T17:10:52.572861+0000","last_unstale":"2024-09-12T18:11:09.825289+0000","last_undegraded":"2024-09-12T18:11:09.825289+0000","last_fullsized":"2024-09-12T18:11:09.825289+0000","mapping_epoch":34,"log_start":"263'500","ondisk_log_start":"263'500","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":500,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:59:24.545564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1102,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1315,"num_read_kb":1312,"num_write":1171,"num_write_kb":396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"263'467","reported_seq":2047,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:08.687983+0000","last_change":"2024-09-12T17:10:44.516107+0000","last_active":"2024-09-12T18:11:08.687983+0000","last_peered":"2024-09-12T18:11:08.687983+0000","last_clean":"2024-09-12T18:11:08.687983+0000","last_became_active":"2024-09-12T17:10:44.515778+0000","last_became_peered":"2024-09-12T17:10:44.515778+0000","last_unstale":"2024-09-12T18:11:08.687983+0000","last_undegraded":"2024-09-12T18:11:08.687983+0000","last_fullsized":"2024-09-12T18:11:08.687983+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":400,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:07:30.510968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2463,"num_read_kb":2310,"num_write":552,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"263'158","reported_seq":764,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:14.856394+0000","last_change":"2024-09-12T17:10:42.526640+0000","last_active":"2024-09-12T18:09:14.856394+0000","last_peered":"2024-09-12T18:09:14.856394+0000","last_clean":"2024-09-12T18:09:14.856394+0000","last_became_active":"2024-09-12T17:10:42.526215+0000","last_became_peered":"2024-09-12T17:10:42.526215+0000","last_unstale":"2024-09-12T18:09:14.856394+0000","last_undegraded":"2024-09-12T18:09:14.856394+0000","last_fullsized":"2024-09-12T18:09:14.856394+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:44:21.141942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":254352,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":393,"num_read_kb":949,"num_write":838,"num_write_kb":19518,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,2],"acting":[7,4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":495,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:19.838876+0000","last_change":"2024-09-12T17:10:46.532883+0000","last_active":"2024-09-12T18:09:19.838876+0000","last_peered":"2024-09-12T18:09:19.838876+0000","last_clean":"2024-09-12T18:09:19.838876+0000","last_became_active":"2024-09-12T17:10:46.532552+0000","last_became_peered":"2024-09-12T17:10:46.532552+0000","last_unstale":"2024-09-12T18:09:19.838876+0000","last_undegraded":"2024-09-12T18:09:19.838876+0000","last_fullsized":"2024-09-12T18:09:19.838876+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_clean_scrub_stamp":"2024-09-12T17:10:45.504515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:25:38.578310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"263'133","reported_seq":704,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:41.225053+0000","last_change":"2024-09-12T17:10:48.543376+0000","last_active":"2024-09-12T18:11:41.225053+0000","last_peered":"2024-09-12T18:11:41.225053+0000","last_clean":"2024-09-12T18:11:41.225053+0000","last_became_active":"2024-09-12T17:10:48.542511+0000","last_became_peered":"2024-09-12T17:10:48.542511+0000","last_unstale":"2024-09-12T18:11:41.225053+0000","last_undegraded":"2024-09-12T18:11:41.225053+0000","last_fullsized":"2024-09-12T18:11:41.225053+0000","mapping_epoch":30,"log_start":"263'100","ondisk_log_start":"263'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_clean_scrub_stamp":"2024-09-12T17:10:47.516917+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:24:43.018761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27700,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":176,"num_read_kb":289,"num_write":94,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":490,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:34.855017+0000","last_change":"2024-09-12T17:10:50.560534+0000","last_active":"2024-09-12T18:09:34.855017+0000","last_peered":"2024-09-12T18:09:34.855017+0000","last_clean":"2024-09-12T18:09:34.855017+0000","last_became_active":"2024-09-12T17:10:50.560194+0000","last_became_peered":"2024-09-12T17:10:50.560194+0000","last_unstale":"2024-09-12T18:09:34.855017+0000","last_undegraded":"2024-09-12T18:09:34.855017+0000","last_fullsized":"2024-09-12T18:09:34.855017+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_clean_scrub_stamp":"2024-09-12T17:10:49.533772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:42:53.755387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"263'128","reported_seq":635,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:10:59.090392+0000","last_change":"2024-09-12T17:10:52.564665+0000","last_active":"2024-09-12T18:10:59.090392+0000","last_peered":"2024-09-12T18:10:59.090392+0000","last_clean":"2024-09-12T18:10:59.090392+0000","last_became_active":"2024-09-12T17:10:52.564350+0000","last_became_peered":"2024-09-12T17:10:52.564350+0000","last_unstale":"2024-09-12T18:10:59.090392+0000","last_undegraded":"2024-09-12T18:10:59.090392+0000","last_fullsized":"2024-09-12T18:10:59.090392+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:43:06.504654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":214,"num_read_kb":196,"num_write":321,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"263'437","reported_seq":1878,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:28.615548+0000","last_change":"2024-09-12T17:11:16.619027+0000","last_active":"2024-09-12T18:09:28.615548+0000","last_peered":"2024-09-12T18:09:28.615548+0000","last_clean":"2024-09-12T18:09:28.615548+0000","last_became_active":"2024-09-12T17:11:16.618699+0000","last_became_peered":"2024-09-12T17:11:16.618699+0000","last_unstale":"2024-09-12T18:09:28.615548+0000","last_undegraded":"2024-09-12T18:09:28.615548+0000","last_fullsized":"2024-09-12T18:09:28.615548+0000","mapping_epoch":37,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":400,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:55:15.584080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2161,"num_read_kb":2024,"num_write":504,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"263'215","reported_seq":843,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:41.121741+0000","last_change":"2024-09-12T17:10:42.526151+0000","last_active":"2024-09-12T18:11:41.121741+0000","last_peered":"2024-09-12T18:11:41.121741+0000","last_clean":"2024-09-12T18:11:41.121741+0000","last_became_active":"2024-09-12T17:10:42.525644+0000","last_became_peered":"2024-09-12T17:10:42.525644+0000","last_unstale":"2024-09-12T18:11:41.121741+0000","last_undegraded":"2024-09-12T18:11:41.121741+0000","last_fullsized":"2024-09-12T18:11:41.121741+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":200,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:06:11.915199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":480,"num_read_kb":1680,"num_write":1066,"num_write_kb":42245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4,6],"acting":[7,5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:19.838915+0000","last_change":"2024-09-12T17:10:46.532305+0000","last_active":"2024-09-12T18:09:19.838915+0000","last_peered":"2024-09-12T18:09:19.838915+0000","last_clean":"2024-09-12T18:09:19.838915+0000","last_became_active":"2024-09-12T17:10:46.531693+0000","last_became_peered":"2024-09-12T17:10:46.531693+0000","last_unstale":"2024-09-12T18:09:19.838915+0000","last_undegraded":"2024-09-12T18:09:19.838915+0000","last_fullsized":"2024-09-12T18:09:19.838915+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_clean_scrub_stamp":"2024-09-12T17:10:45.504515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:12:04.081227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"263'171","reported_seq":759,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:41.099368+0000","last_change":"2024-09-12T17:10:48.546368+0000","last_active":"2024-09-12T18:11:41.099368+0000","last_peered":"2024-09-12T18:11:41.099368+0000","last_clean":"2024-09-12T18:11:41.099368+0000","last_became_active":"2024-09-12T17:10:48.546013+0000","last_became_peered":"2024-09-12T17:10:48.546013+0000","last_unstale":"2024-09-12T18:11:41.099368+0000","last_undegraded":"2024-09-12T18:11:41.099368+0000","last_fullsized":"2024-09-12T18:11:41.099368+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_clean_scrub_stamp":"2024-09-12T17:10:47.516917+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":100,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:18:06.234698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22951,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":229,"num_read_kb":322,"num_write":130,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"263'776","reported_seq":2659,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:41.014652+0000","last_change":"2024-09-12T17:10:50.558001+0000","last_active":"2024-09-12T18:11:41.014652+0000","last_peered":"2024-09-12T18:11:41.014652+0000","last_clean":"2024-09-12T18:11:41.014652+0000","last_became_active":"2024-09-12T17:10:50.557711+0000","last_became_peered":"2024-09-12T17:10:50.557711+0000","last_unstale":"2024-09-12T18:11:41.014652+0000","last_undegraded":"2024-09-12T18:11:41.014652+0000","last_fullsized":"2024-09-12T18:11:41.014652+0000","mapping_epoch":32,"log_start":"263'700","ondisk_log_start":"263'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_clean_scrub_stamp":"2024-09-12T17:10:49.533772+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":700,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:36:55.165115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"263'103","reported_seq":598,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:08.674351+0000","last_change":"2024-09-12T17:10:52.570339+0000","last_active":"2024-09-12T18:11:08.674351+0000","last_peered":"2024-09-12T18:11:08.674351+0000","last_clean":"2024-09-12T18:11:08.674351+0000","last_became_active":"2024-09-12T17:10:52.570034+0000","last_became_peered":"2024-09-12T17:10:52.570034+0000","last_unstale":"2024-09-12T18:11:08.674351+0000","last_undegraded":"2024-09-12T18:11:08.674351+0000","last_fullsized":"2024-09-12T18:11:08.674351+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:58:19.680712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":442,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":109,"num_read_kb":107,"num_write":228,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"263'457","reported_seq":1986,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:20.794887+0000","last_change":"2024-09-12T17:10:44.520428+0000","last_active":"2024-09-12T18:09:20.794887+0000","last_peered":"2024-09-12T18:09:20.794887+0000","last_clean":"2024-09-12T18:09:20.794887+0000","last_became_active":"2024-09-12T17:10:44.520043+0000","last_became_peered":"2024-09-12T17:10:44.520043+0000","last_unstale":"2024-09-12T18:09:20.794887+0000","last_undegraded":"2024-09-12T18:09:20.794887+0000","last_fullsized":"2024-09-12T18:09:20.794887+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":400,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:50:49.324285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2352,"num_read_kb":2214,"num_write":541,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"263'209","reported_seq":852,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:41.320252+0000","last_change":"2024-09-12T17:10:42.518917+0000","last_active":"2024-09-12T18:11:41.320252+0000","last_peered":"2024-09-12T18:11:41.320252+0000","last_clean":"2024-09-12T18:11:41.320252+0000","last_became_active":"2024-09-12T17:10:42.518472+0000","last_became_peered":"2024-09-12T17:10:42.518472+0000","last_unstale":"2024-09-12T18:11:41.320252+0000","last_undegraded":"2024-09-12T18:11:41.320252+0000","last_fullsized":"2024-09-12T18:11:41.320252+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:04:25.809640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":91,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":447,"num_read_kb":52953,"num_write":1076,"num_write_kb":38599,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6,1],"acting":[5,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":495,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:29.840076+0000","last_change":"2024-09-12T17:10:46.532109+0000","last_active":"2024-09-12T18:09:29.840076+0000","last_peered":"2024-09-12T18:09:29.840076+0000","last_clean":"2024-09-12T18:09:29.840076+0000","last_became_active":"2024-09-12T17:10:46.531731+0000","last_became_peered":"2024-09-12T17:10:46.531731+0000","last_unstale":"2024-09-12T18:09:29.840076+0000","last_undegraded":"2024-09-12T18:09:29.840076+0000","last_fullsized":"2024-09-12T18:09:29.840076+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_clean_scrub_stamp":"2024-09-12T17:10:45.504515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:24:44.405982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"263'201","reported_seq":838,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:41.249923+0000","last_change":"2024-09-12T17:10:48.544969+0000","last_active":"2024-09-12T18:11:41.249923+0000","last_peered":"2024-09-12T18:11:41.249923+0000","last_clean":"2024-09-12T18:11:41.249923+0000","last_became_active":"2024-09-12T17:10:48.544653+0000","last_became_peered":"2024-09-12T17:10:48.544653+0000","last_unstale":"2024-09-12T18:11:41.249923+0000","last_undegraded":"2024-09-12T18:11:41.249923+0000","last_fullsized":"2024-09-12T18:11:41.249923+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_clean_scrub_stamp":"2024-09-12T17:10:47.516917+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:21:32.100821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13571,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":286,"num_read_kb":396,"num_write":142,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":487,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:19.838895+0000","last_change":"2024-09-12T17:10:50.555835+0000","last_active":"2024-09-12T18:09:19.838895+0000","last_peered":"2024-09-12T18:09:19.838895+0000","last_clean":"2024-09-12T18:09:19.838895+0000","last_became_active":"2024-09-12T17:10:50.555473+0000","last_became_peered":"2024-09-12T17:10:50.555473+0000","last_unstale":"2024-09-12T18:09:19.838895+0000","last_undegraded":"2024-09-12T18:09:19.838895+0000","last_fullsized":"2024-09-12T18:09:19.838895+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_clean_scrub_stamp":"2024-09-12T17:10:49.533772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:12:27.311695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"263'116","reported_seq":625,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:47.539870+0000","last_change":"2024-09-12T17:10:52.571536+0000","last_active":"2024-09-12T18:09:47.539870+0000","last_peered":"2024-09-12T18:09:47.539870+0000","last_clean":"2024-09-12T18:09:47.539870+0000","last_became_active":"2024-09-12T17:10:52.571225+0000","last_became_peered":"2024-09-12T17:10:52.571225+0000","last_unstale":"2024-09-12T18:09:47.539870+0000","last_undegraded":"2024-09-12T18:09:47.539870+0000","last_fullsized":"2024-09-12T18:09:47.539870+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:45:48.500746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":910,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":137,"num_read_kb":136,"num_write":254,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"263'472","reported_seq":2087,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:14.856043+0000","last_change":"2024-09-12T17:10:44.516642+0000","last_active":"2024-09-12T18:09:14.856043+0000","last_peered":"2024-09-12T18:09:14.856043+0000","last_clean":"2024-09-12T18:09:14.856043+0000","last_became_active":"2024-09-12T17:10:44.516255+0000","last_became_peered":"2024-09-12T17:10:44.516255+0000","last_unstale":"2024-09-12T18:09:14.856043+0000","last_undegraded":"2024-09-12T18:09:14.856043+0000","last_fullsized":"2024-09-12T18:09:14.856043+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":400,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:45:40.739871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2470,"num_read_kb":2330,"num_write":539,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"263'218","reported_seq":838,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:41.222325+0000","last_change":"2024-09-12T17:11:16.863136+0000","last_active":"2024-09-12T18:11:41.222325+0000","last_peered":"2024-09-12T18:11:41.222325+0000","last_clean":"2024-09-12T18:11:41.222325+0000","last_became_active":"2024-09-12T17:11:16.862702+0000","last_became_peered":"2024-09-12T17:11:16.862702+0000","last_unstale":"2024-09-12T18:11:41.222325+0000","last_undegraded":"2024-09-12T18:11:41.222325+0000","last_fullsized":"2024-09-12T18:11:41.222325+0000","mapping_epoch":37,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:54:19.503253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079942,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":414,"num_read_kb":1752,"num_write":1053,"num_write_kb":46733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,4,7],"acting":[3,2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:19.838954+0000","last_change":"2024-09-12T17:10:46.525024+0000","last_active":"2024-09-12T18:09:19.838954+0000","last_peered":"2024-09-12T18:09:19.838954+0000","last_clean":"2024-09-12T18:09:19.838954+0000","last_became_active":"2024-09-12T17:10:46.524638+0000","last_became_peered":"2024-09-12T17:10:46.524638+0000","last_unstale":"2024-09-12T18:09:19.838954+0000","last_undegraded":"2024-09-12T18:09:19.838954+0000","last_fullsized":"2024-09-12T18:09:19.838954+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_clean_scrub_stamp":"2024-09-12T17:10:45.504515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:56:22.494536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"263'151","reported_seq":735,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:41.257183+0000","last_change":"2024-09-12T17:10:48.538217+0000","last_active":"2024-09-12T18:11:41.257183+0000","last_peered":"2024-09-12T18:11:41.257183+0000","last_clean":"2024-09-12T18:11:41.257183+0000","last_became_active":"2024-09-12T17:10:48.537923+0000","last_became_peered":"2024-09-12T17:10:48.537923+0000","last_unstale":"2024-09-12T18:11:41.257183+0000","last_undegraded":"2024-09-12T18:11:41.257183+0000","last_fullsized":"2024-09-12T18:11:41.257183+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_clean_scrub_stamp":"2024-09-12T17:10:47.516917+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:47:18.538568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7449,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":229,"num_read_kb":291,"num_write":178,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:14.830207+0000","last_change":"2024-09-12T17:10:50.563850+0000","last_active":"2024-09-12T18:07:14.830207+0000","last_peered":"2024-09-12T18:07:14.830207+0000","last_clean":"2024-09-12T18:07:14.830207+0000","last_became_active":"2024-09-12T17:10:50.563507+0000","last_became_peered":"2024-09-12T17:10:50.563507+0000","last_unstale":"2024-09-12T18:07:14.830207+0000","last_undegraded":"2024-09-12T18:07:14.830207+0000","last_fullsized":"2024-09-12T18:07:14.830207+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_clean_scrub_stamp":"2024-09-12T17:10:49.533772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:17:57.223763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"263'126","reported_seq":641,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:10:59.093495+0000","last_change":"2024-09-12T17:10:52.575633+0000","last_active":"2024-09-12T18:10:59.093495+0000","last_peered":"2024-09-12T18:10:59.093495+0000","last_clean":"2024-09-12T18:10:59.093495+0000","last_became_active":"2024-09-12T17:10:52.575293+0000","last_became_peered":"2024-09-12T17:10:52.575293+0000","last_unstale":"2024-09-12T18:10:59.093495+0000","last_undegraded":"2024-09-12T18:10:59.093495+0000","last_fullsized":"2024-09-12T18:10:59.093495+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:49:40.030320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":248,"num_read_kb":220,"num_write":319,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"263'995","reported_seq":2615,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:20.793923+0000","last_change":"2024-09-12T17:10:44.515402+0000","last_active":"2024-09-12T18:09:20.793923+0000","last_peered":"2024-09-12T18:09:20.793923+0000","last_clean":"2024-09-12T18:09:20.793923+0000","last_became_active":"2024-09-12T17:10:44.515098+0000","last_became_peered":"2024-09-12T17:10:44.515098+0000","last_unstale":"2024-09-12T18:09:20.793923+0000","last_undegraded":"2024-09-12T18:09:20.793923+0000","last_fullsized":"2024-09-12T18:09:20.793923+0000","mapping_epoch":26,"log_start":"263'900","ondisk_log_start":"263'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":900,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:51:18.883813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4616,"num_read_kb":4072,"num_write":1360,"num_write_kb":579,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"263'209","reported_seq":850,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:41.149147+0000","last_change":"2024-09-12T17:10:42.516962+0000","last_active":"2024-09-12T18:11:41.149147+0000","last_peered":"2024-09-12T18:11:41.149147+0000","last_clean":"2024-09-12T18:11:41.149147+0000","last_became_active":"2024-09-12T17:10:42.515480+0000","last_became_peered":"2024-09-12T17:10:42.515480+0000","last_unstale":"2024-09-12T18:11:41.149147+0000","last_undegraded":"2024-09-12T18:11:41.149147+0000","last_fullsized":"2024-09-12T18:11:41.149147+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:25:04.587903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4364954,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":507,"num_read_kb":28749,"num_write":1020,"num_write_kb":24822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1,7],"acting":[6,4,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:20.149012+0000","last_change":"2024-09-12T17:10:46.532868+0000","last_active":"2024-09-12T18:09:20.149012+0000","last_peered":"2024-09-12T18:09:20.149012+0000","last_clean":"2024-09-12T18:09:20.149012+0000","last_became_active":"2024-09-12T17:10:46.532552+0000","last_became_peered":"2024-09-12T17:10:46.532552+0000","last_unstale":"2024-09-12T18:09:20.149012+0000","last_undegraded":"2024-09-12T18:09:20.149012+0000","last_fullsized":"2024-09-12T18:09:20.149012+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_clean_scrub_stamp":"2024-09-12T17:10:45.504515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:36:03.282217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"263'173","reported_seq":759,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:41.203525+0000","last_change":"2024-09-12T17:10:48.542688+0000","last_active":"2024-09-12T18:11:41.203525+0000","last_peered":"2024-09-12T18:11:41.203525+0000","last_clean":"2024-09-12T18:11:41.203525+0000","last_became_active":"2024-09-12T17:10:48.542298+0000","last_became_peered":"2024-09-12T17:10:48.542298+0000","last_unstale":"2024-09-12T18:11:41.203525+0000","last_undegraded":"2024-09-12T18:11:41.203525+0000","last_fullsized":"2024-09-12T18:11:41.203525+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_clean_scrub_stamp":"2024-09-12T17:10:47.516917+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:38:39.389352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5018,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":233,"num_read_kb":318,"num_write":134,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"263'747","reported_seq":2525,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:41.010195+0000","last_change":"2024-09-12T17:10:50.557593+0000","last_active":"2024-09-12T18:11:41.010195+0000","last_peered":"2024-09-12T18:11:41.010195+0000","last_clean":"2024-09-12T18:11:41.010195+0000","last_became_active":"2024-09-12T17:10:50.557305+0000","last_became_peered":"2024-09-12T17:10:50.557305+0000","last_unstale":"2024-09-12T18:11:41.010195+0000","last_undegraded":"2024-09-12T18:11:41.010195+0000","last_fullsized":"2024-09-12T18:11:41.010195+0000","mapping_epoch":32,"log_start":"263'700","ondisk_log_start":"263'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_clean_scrub_stamp":"2024-09-12T17:10:49.533772+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":700,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:44:08.055041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"263'117","reported_seq":624,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:47.542189+0000","last_change":"2024-09-12T17:10:52.571748+0000","last_active":"2024-09-12T18:09:47.542189+0000","last_peered":"2024-09-12T18:09:47.542189+0000","last_clean":"2024-09-12T18:09:47.542189+0000","last_became_active":"2024-09-12T17:10:52.571344+0000","last_became_peered":"2024-09-12T17:10:52.571344+0000","last_unstale":"2024-09-12T18:09:47.542189+0000","last_undegraded":"2024-09-12T18:09:47.542189+0000","last_fullsized":"2024-09-12T18:09:47.542189+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:19:07.103069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1852,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":171,"num_read_kb":161,"num_write":288,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"263'486","reported_seq":2153,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:48.689779+0000","last_change":"2024-09-12T17:10:44.509586+0000","last_active":"2024-09-12T18:09:48.689779+0000","last_peered":"2024-09-12T18:09:48.689779+0000","last_clean":"2024-09-12T18:09:48.689779+0000","last_became_active":"2024-09-12T17:10:44.509293+0000","last_became_peered":"2024-09-12T17:10:44.509293+0000","last_unstale":"2024-09-12T18:09:48.689779+0000","last_undegraded":"2024-09-12T18:09:48.689779+0000","last_fullsized":"2024-09-12T18:09:48.689779+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":400,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:13:03.024067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2823,"num_read_kb":2653,"num_write":584,"num_write_kb":143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"263'186","reported_seq":838,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:41.308493+0000","last_change":"2024-09-12T17:10:42.516188+0000","last_active":"2024-09-12T18:11:41.308493+0000","last_peered":"2024-09-12T18:11:41.308493+0000","last_clean":"2024-09-12T18:11:41.308493+0000","last_became_active":"2024-09-12T17:10:42.515196+0000","last_became_peered":"2024-09-12T17:10:42.515196+0000","last_unstale":"2024-09-12T18:11:41.308493+0000","last_undegraded":"2024-09-12T18:11:41.308493+0000","last_fullsized":"2024-09-12T18:11:41.308493+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:13:54.380139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262519,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":441,"num_read_kb":72235,"num_write":829,"num_write_kb":40150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7,1],"acting":[4,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"29'2","reported_seq":1447,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:40.785326+0000","last_change":"2024-09-12T17:10:46.531378+0000","last_active":"2024-09-12T18:11:40.785326+0000","last_peered":"2024-09-12T18:11:40.785326+0000","last_clean":"2024-09-12T18:11:40.785326+0000","last_became_active":"2024-09-12T17:10:46.531032+0000","last_became_peered":"2024-09-12T17:10:46.531032+0000","last_unstale":"2024-09-12T18:11:40.785326+0000","last_undegraded":"2024-09-12T18:11:40.785326+0000","last_fullsized":"2024-09-12T18:11:40.785326+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_clean_scrub_stamp":"2024-09-12T17:10:45.504515+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:26:08.381916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":950,"num_read_kb":950,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"263'77","reported_seq":600,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:49.555526+0000","last_change":"2024-09-12T17:10:48.533130+0000","last_active":"2024-09-12T18:09:49.555526+0000","last_peered":"2024-09-12T18:09:49.555526+0000","last_clean":"2024-09-12T18:09:49.555526+0000","last_became_active":"2024-09-12T17:10:48.532817+0000","last_became_peered":"2024-09-12T17:10:48.532817+0000","last_unstale":"2024-09-12T18:09:49.555526+0000","last_undegraded":"2024-09-12T18:09:49.555526+0000","last_fullsized":"2024-09-12T18:09:49.555526+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_clean_scrub_stamp":"2024-09-12T17:10:47.516917+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:42:42.609184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":90,"num_read_kb":85,"num_write":60,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"263'763","reported_seq":2404,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:41.011429+0000","last_change":"2024-09-12T17:10:50.563515+0000","last_active":"2024-09-12T18:11:41.011429+0000","last_peered":"2024-09-12T18:11:41.011429+0000","last_clean":"2024-09-12T18:11:41.011429+0000","last_became_active":"2024-09-12T17:10:50.563002+0000","last_became_peered":"2024-09-12T17:10:50.563002+0000","last_unstale":"2024-09-12T18:11:41.011429+0000","last_undegraded":"2024-09-12T18:11:41.011429+0000","last_fullsized":"2024-09-12T18:11:41.011429+0000","mapping_epoch":32,"log_start":"263'700","ondisk_log_start":"263'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_clean_scrub_stamp":"2024-09-12T17:10:49.533772+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":700,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:11:41.362558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"263'147","reported_seq":647,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:14.855949+0000","last_change":"2024-09-12T17:10:52.571064+0000","last_active":"2024-09-12T18:09:14.855949+0000","last_peered":"2024-09-12T18:09:14.855949+0000","last_clean":"2024-09-12T18:09:14.855949+0000","last_became_active":"2024-09-12T17:10:52.570643+0000","last_became_peered":"2024-09-12T17:10:52.570643+0000","last_unstale":"2024-09-12T18:09:14.855949+0000","last_undegraded":"2024-09-12T18:09:14.855949+0000","last_fullsized":"2024-09-12T18:09:14.855949+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:37:26.966557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":160,"num_read_kb":158,"num_write":329,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"263'804","reported_seq":2283,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:08.688392+0000","last_change":"2024-09-12T17:10:44.518421+0000","last_active":"2024-09-12T18:11:08.688392+0000","last_peered":"2024-09-12T18:11:08.688392+0000","last_clean":"2024-09-12T18:11:08.688392+0000","last_became_active":"2024-09-12T17:10:44.518111+0000","last_became_peered":"2024-09-12T17:10:44.518111+0000","last_unstale":"2024-09-12T18:11:08.688392+0000","last_undegraded":"2024-09-12T18:11:08.688392+0000","last_fullsized":"2024-09-12T18:11:08.688392+0000","mapping_epoch":26,"log_start":"263'700","ondisk_log_start":"263'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":700,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:24:42.388720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3856,"num_read_kb":3439,"num_write":1073,"num_write_kb":406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"263'210","reported_seq":830,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:41.104811+0000","last_change":"2024-09-12T17:10:42.523388+0000","last_active":"2024-09-12T18:11:41.104811+0000","last_peered":"2024-09-12T18:11:41.104811+0000","last_clean":"2024-09-12T18:11:41.104811+0000","last_became_active":"2024-09-12T17:10:42.522669+0000","last_became_peered":"2024-09-12T17:10:42.522669+0000","last_unstale":"2024-09-12T18:11:41.104811+0000","last_undegraded":"2024-09-12T18:11:41.104811+0000","last_fullsized":"2024-09-12T18:11:41.104811+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:12:18.298215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":435,"num_read_kb":8704,"num_write":950,"num_write_kb":27929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,4],"acting":[3,1,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":504,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:19.856844+0000","last_change":"2024-09-12T17:10:46.533907+0000","last_active":"2024-09-12T18:09:19.856844+0000","last_peered":"2024-09-12T18:09:19.856844+0000","last_clean":"2024-09-12T18:09:19.856844+0000","last_became_active":"2024-09-12T17:10:46.533572+0000","last_became_peered":"2024-09-12T17:10:46.533572+0000","last_unstale":"2024-09-12T18:09:19.856844+0000","last_undegraded":"2024-09-12T18:09:19.856844+0000","last_fullsized":"2024-09-12T18:09:19.856844+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_clean_scrub_stamp":"2024-09-12T17:10:45.504515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:00:02.576654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"263'246","reported_seq":856,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:41.382015+0000","last_change":"2024-09-12T17:10:48.543041+0000","last_active":"2024-09-12T18:11:41.382015+0000","last_peered":"2024-09-12T18:11:41.382015+0000","last_clean":"2024-09-12T18:11:41.382015+0000","last_became_active":"2024-09-12T17:10:48.542616+0000","last_became_peered":"2024-09-12T17:10:48.542616+0000","last_unstale":"2024-09-12T18:11:41.382015+0000","last_undegraded":"2024-09-12T18:11:41.382015+0000","last_fullsized":"2024-09-12T18:11:41.382015+0000","mapping_epoch":30,"log_start":"263'200","ondisk_log_start":"263'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_clean_scrub_stamp":"2024-09-12T17:10:47.516917+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":200,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:45:45.261917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5964,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":933,"num_read_kb":1007,"num_write":1456,"num_write_kb":1313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":490,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:19.876828+0000","last_change":"2024-09-12T17:10:50.550499+0000","last_active":"2024-09-12T18:09:19.876828+0000","last_peered":"2024-09-12T18:09:19.876828+0000","last_clean":"2024-09-12T18:09:19.876828+0000","last_became_active":"2024-09-12T17:10:50.550189+0000","last_became_peered":"2024-09-12T17:10:50.550189+0000","last_unstale":"2024-09-12T18:09:19.876828+0000","last_undegraded":"2024-09-12T18:09:19.876828+0000","last_fullsized":"2024-09-12T18:09:19.876828+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_clean_scrub_stamp":"2024-09-12T17:10:49.533772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:28:44.908753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"263'162","reported_seq":671,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:08.680270+0000","last_change":"2024-09-12T17:10:52.572806+0000","last_active":"2024-09-12T18:11:08.680270+0000","last_peered":"2024-09-12T18:11:08.680270+0000","last_clean":"2024-09-12T18:11:08.680270+0000","last_became_active":"2024-09-12T17:10:52.572508+0000","last_became_peered":"2024-09-12T17:10:52.572508+0000","last_unstale":"2024-09-12T18:11:08.680270+0000","last_undegraded":"2024-09-12T18:11:08.680270+0000","last_fullsized":"2024-09-12T18:11:08.680270+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:47:56.176805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":869,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":242,"num_read_kb":227,"num_write":399,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"263'2313","reported_seq":3926,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:14.876101+0000","last_change":"2024-09-12T17:10:44.515810+0000","last_active":"2024-09-12T18:09:14.876101+0000","last_peered":"2024-09-12T18:09:14.876101+0000","last_clean":"2024-09-12T18:09:14.876101+0000","last_became_active":"2024-09-12T17:10:44.515045+0000","last_became_peered":"2024-09-12T17:10:44.515045+0000","last_unstale":"2024-09-12T18:09:14.876101+0000","last_undegraded":"2024-09-12T18:09:14.876101+0000","last_fullsized":"2024-09-12T18:09:14.876101+0000","mapping_epoch":26,"log_start":"263'2300","ondisk_log_start":"263'2300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":2300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:30:23.918147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10108,"num_read_kb":8675,"num_write":3400,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":612,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:39.851461+0000","last_change":"2024-09-12T17:10:26.808302+0000","last_active":"2024-09-12T18:08:39.851461+0000","last_peered":"2024-09-12T18:08:39.851461+0000","last_clean":"2024-09-12T18:08:39.851461+0000","last_became_active":"2024-09-12T17:10:26.807964+0000","last_became_peered":"2024-09-12T17:10:26.807964+0000","last_unstale":"2024-09-12T18:08:39.851461+0000","last_undegraded":"2024-09-12T18:08:39.851461+0000","last_fullsized":"2024-09-12T18:08:39.851461+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:25.795895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:25.795895+0000","last_clean_scrub_stamp":"2024-09-12T17:10:25.795895+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:28:36.202819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":524,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:54.852285+0000","last_change":"2024-09-12T17:10:33.852086+0000","last_active":"2024-09-12T18:08:54.852285+0000","last_peered":"2024-09-12T18:08:54.852285+0000","last_clean":"2024-09-12T18:08:54.852285+0000","last_became_active":"2024-09-12T17:10:31.846572+0000","last_became_peered":"2024-09-12T17:10:31.846572+0000","last_unstale":"2024-09-12T18:08:54.852285+0000","last_undegraded":"2024-09-12T18:08:54.852285+0000","last_fullsized":"2024-09-12T18:08:54.852285+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:30.818274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:30.818274+0000","last_clean_scrub_stamp":"2024-09-12T17:10:30.818274+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:56:58.387797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060306800000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"263'227","reported_seq":848,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:41.208002+0000","last_change":"2024-09-12T17:10:42.527885+0000","last_active":"2024-09-12T18:11:41.208002+0000","last_peered":"2024-09-12T18:11:41.208002+0000","last_clean":"2024-09-12T18:11:41.208002+0000","last_became_active":"2024-09-12T17:10:42.527288+0000","last_became_peered":"2024-09-12T17:10:42.527288+0000","last_unstale":"2024-09-12T18:11:41.208002+0000","last_undegraded":"2024-09-12T18:11:41.208002+0000","last_fullsized":"2024-09-12T18:11:41.208002+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:57:55.754980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":95,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":424,"num_read_kb":3487,"num_write":1109,"num_write_kb":42610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6,4],"acting":[3,5,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"36'3","reported_seq":976,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:40.774008+0000","last_change":"2024-09-12T17:10:46.523567+0000","last_active":"2024-09-12T18:11:40.774008+0000","last_peered":"2024-09-12T18:11:40.774008+0000","last_clean":"2024-09-12T18:11:40.774008+0000","last_became_active":"2024-09-12T17:10:46.523069+0000","last_became_peered":"2024-09-12T17:10:46.523069+0000","last_unstale":"2024-09-12T18:11:40.774008+0000","last_undegraded":"2024-09-12T18:11:40.774008+0000","last_fullsized":"2024-09-12T18:11:40.774008+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_clean_scrub_stamp":"2024-09-12T17:10:45.504515+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:25:47.639083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":722,"num_read_kb":720,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"263'319","reported_seq":1020,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:41.349518+0000","last_change":"2024-09-12T17:10:48.542799+0000","last_active":"2024-09-12T18:11:41.349518+0000","last_peered":"2024-09-12T18:11:41.349518+0000","last_clean":"2024-09-12T18:11:41.349518+0000","last_became_active":"2024-09-12T17:10:48.542462+0000","last_became_peered":"2024-09-12T17:10:48.542462+0000","last_unstale":"2024-09-12T18:11:41.349518+0000","last_undegraded":"2024-09-12T18:11:41.349518+0000","last_fullsized":"2024-09-12T18:11:41.349518+0000","mapping_epoch":30,"log_start":"263'300","ondisk_log_start":"263'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_clean_scrub_stamp":"2024-09-12T17:10:47.516917+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:44:47.123605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37371,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":611,"num_read_kb":866,"num_write":568,"num_write_kb":434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:19.845378+0000","last_change":"2024-09-12T17:10:50.558413+0000","last_active":"2024-09-12T18:09:19.845378+0000","last_peered":"2024-09-12T18:09:19.845378+0000","last_clean":"2024-09-12T18:09:19.845378+0000","last_became_active":"2024-09-12T17:10:50.558129+0000","last_became_peered":"2024-09-12T17:10:50.558129+0000","last_unstale":"2024-09-12T18:09:19.845378+0000","last_undegraded":"2024-09-12T18:09:19.845378+0000","last_fullsized":"2024-09-12T18:09:19.845378+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_clean_scrub_stamp":"2024-09-12T17:10:49.533772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:10:19.749294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"263'213","reported_seq":930,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:49.576469+0000","last_change":"2024-09-12T17:10:52.574735+0000","last_active":"2024-09-12T18:09:49.576469+0000","last_peered":"2024-09-12T18:09:49.576469+0000","last_clean":"2024-09-12T18:09:49.576469+0000","last_became_active":"2024-09-12T17:10:52.574433+0000","last_became_peered":"2024-09-12T17:10:52.574433+0000","last_unstale":"2024-09-12T18:09:49.576469+0000","last_undegraded":"2024-09-12T18:09:49.576469+0000","last_fullsized":"2024-09-12T18:09:49.576469+0000","mapping_epoch":34,"log_start":"263'200","ondisk_log_start":"263'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:43:52.722409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":852,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":555,"num_read_kb":537,"num_write":455,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"263'582","reported_seq":2168,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:14.844578+0000","last_change":"2024-09-12T17:10:44.520786+0000","last_active":"2024-09-12T18:09:14.844578+0000","last_peered":"2024-09-12T18:09:14.844578+0000","last_clean":"2024-09-12T18:09:14.844578+0000","last_became_active":"2024-09-12T17:10:44.520484+0000","last_became_peered":"2024-09-12T17:10:44.520484+0000","last_unstale":"2024-09-12T18:09:14.844578+0000","last_undegraded":"2024-09-12T18:09:14.844578+0000","last_fullsized":"2024-09-12T18:09:14.844578+0000","mapping_epoch":26,"log_start":"263'500","ondisk_log_start":"263'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":500,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:09:07.335121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3105,"num_read_kb":2836,"num_write":745,"num_write_kb":252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":520,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:44.852139+0000","last_change":"2024-09-12T17:10:33.955353+0000","last_active":"2024-09-12T18:08:44.852139+0000","last_peered":"2024-09-12T18:08:44.852139+0000","last_clean":"2024-09-12T18:08:44.852139+0000","last_became_active":"2024-09-12T17:10:31.848972+0000","last_became_peered":"2024-09-12T17:10:31.848972+0000","last_unstale":"2024-09-12T18:08:44.852139+0000","last_undegraded":"2024-09-12T18:08:44.852139+0000","last_fullsized":"2024-09-12T18:08:44.852139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:30.818274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:30.818274+0000","last_clean_scrub_stamp":"2024-09-12T17:10:30.818274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:42:53.392909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054881099999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"263'247","reported_seq":900,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:44.672013+0000","last_change":"2024-09-12T18:11:44.672013+0000","last_active":"2024-09-12T18:11:44.672013+0000","last_peered":"2024-09-12T18:11:44.672013+0000","last_clean":"2024-09-12T18:11:44.672013+0000","last_became_active":"2024-09-12T17:10:42.518190+0000","last_became_peered":"2024-09-12T17:10:42.518190+0000","last_unstale":"2024-09-12T18:11:44.672013+0000","last_undegraded":"2024-09-12T18:11:44.672013+0000","last_fullsized":"2024-09-12T18:11:44.672013+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'247","last_scrub_stamp":"2024-09-12T18:11:44.671868+0000","last_deep_scrub":"263'247","last_deep_scrub_stamp":"2024-09-12T18:11:44.671868+0000","last_clean_scrub_stamp":"2024-09-12T18:11:44.671868+0000","objects_scrubbed":3,"log_size":47,"log_dups_size":200,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:21:51.032960+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":522,"num_read_kb":6824,"num_write":1149,"num_write_kb":47378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3,5],"acting":[0,4,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:19.856009+0000","last_change":"2024-09-12T17:10:46.528521+0000","last_active":"2024-09-12T18:09:19.856009+0000","last_peered":"2024-09-12T18:09:19.856009+0000","last_clean":"2024-09-12T18:09:19.856009+0000","last_became_active":"2024-09-12T17:10:46.528192+0000","last_became_peered":"2024-09-12T17:10:46.528192+0000","last_unstale":"2024-09-12T18:09:19.856009+0000","last_undegraded":"2024-09-12T18:09:19.856009+0000","last_fullsized":"2024-09-12T18:09:19.856009+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_clean_scrub_stamp":"2024-09-12T17:10:45.504515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:16:33.943407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"263'877","reported_seq":2538,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:41.342454+0000","last_change":"2024-09-12T17:10:48.545160+0000","last_active":"2024-09-12T18:11:41.342454+0000","last_peered":"2024-09-12T18:11:41.342454+0000","last_clean":"2024-09-12T18:11:41.342454+0000","last_became_active":"2024-09-12T17:10:48.544823+0000","last_became_peered":"2024-09-12T17:10:48.544823+0000","last_unstale":"2024-09-12T18:11:41.342454+0000","last_undegraded":"2024-09-12T18:11:41.342454+0000","last_fullsized":"2024-09-12T18:11:41.342454+0000","mapping_epoch":30,"log_start":"263'800","ondisk_log_start":"263'800","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_clean_scrub_stamp":"2024-09-12T17:10:47.516917+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":800,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:10:40.793586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19071,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1197,"num_read_kb":1359,"num_write":312,"num_write_kb":143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":489,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:19.857221+0000","last_change":"2024-09-12T17:10:50.557996+0000","last_active":"2024-09-12T18:09:19.857221+0000","last_peered":"2024-09-12T18:09:19.857221+0000","last_clean":"2024-09-12T18:09:19.857221+0000","last_became_active":"2024-09-12T17:10:50.557660+0000","last_became_peered":"2024-09-12T17:10:50.557660+0000","last_unstale":"2024-09-12T18:09:19.857221+0000","last_undegraded":"2024-09-12T18:09:19.857221+0000","last_fullsized":"2024-09-12T18:09:19.857221+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_clean_scrub_stamp":"2024-09-12T17:10:49.533772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:34:55.114972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"263'187","reported_seq":754,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:49.677139+0000","last_change":"2024-09-12T17:10:52.671428+0000","last_active":"2024-09-12T18:09:49.677139+0000","last_peered":"2024-09-12T18:09:49.677139+0000","last_clean":"2024-09-12T18:09:49.677139+0000","last_became_active":"2024-09-12T17:10:52.671120+0000","last_became_peered":"2024-09-12T17:10:52.671120+0000","last_unstale":"2024-09-12T18:09:49.677139+0000","last_undegraded":"2024-09-12T18:09:49.677139+0000","last_fullsized":"2024-09-12T18:09:49.677139+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":855,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":437,"num_read_kb":369,"num_write":356,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"263'338","reported_seq":1688,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:15.148495+0000","last_change":"2024-09-12T17:10:44.516968+0000","last_active":"2024-09-12T18:09:15.148495+0000","last_peered":"2024-09-12T18:09:15.148495+0000","last_clean":"2024-09-12T18:09:15.148495+0000","last_became_active":"2024-09-12T17:10:44.516640+0000","last_became_peered":"2024-09-12T17:10:44.516640+0000","last_unstale":"2024-09-12T18:09:15.148495+0000","last_undegraded":"2024-09-12T18:09:15.148495+0000","last_fullsized":"2024-09-12T18:09:15.148495+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:49:32.830701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1748,"num_read_kb":1673,"num_write":375,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":519,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:54.836450+0000","last_change":"2024-09-12T17:10:34.162797+0000","last_active":"2024-09-12T18:08:54.836450+0000","last_peered":"2024-09-12T18:08:54.836450+0000","last_clean":"2024-09-12T18:08:54.836450+0000","last_became_active":"2024-09-12T17:10:31.841982+0000","last_became_peered":"2024-09-12T17:10:31.841982+0000","last_unstale":"2024-09-12T18:08:54.836450+0000","last_undegraded":"2024-09-12T18:08:54.836450+0000","last_fullsized":"2024-09-12T18:08:54.836450+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:30.818274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:30.818274+0000","last_clean_scrub_stamp":"2024-09-12T17:10:30.818274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:00:41.985746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00030998799999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"263'168","reported_seq":783,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:41.198667+0000","last_change":"2024-09-12T17:10:42.509801+0000","last_active":"2024-09-12T18:11:41.198667+0000","last_peered":"2024-09-12T18:11:41.198667+0000","last_clean":"2024-09-12T18:11:41.198667+0000","last_became_active":"2024-09-12T17:10:42.509396+0000","last_became_peered":"2024-09-12T17:10:42.509396+0000","last_unstale":"2024-09-12T18:11:41.198667+0000","last_undegraded":"2024-09-12T18:11:41.198667+0000","last_fullsized":"2024-09-12T18:11:41.198667+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:19:48.419548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":350137,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":379,"num_read_kb":11016,"num_write":845,"num_write_kb":10341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6,5],"acting":[1,2,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"29'1","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:19.838982+0000","last_change":"2024-09-12T17:10:46.529416+0000","last_active":"2024-09-12T18:09:19.838982+0000","last_peered":"2024-09-12T18:09:19.838982+0000","last_clean":"2024-09-12T18:09:19.838982+0000","last_became_active":"2024-09-12T17:10:46.528878+0000","last_became_peered":"2024-09-12T17:10:46.528878+0000","last_unstale":"2024-09-12T18:09:19.838982+0000","last_undegraded":"2024-09-12T18:09:19.838982+0000","last_fullsized":"2024-09-12T18:09:19.838982+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_clean_scrub_stamp":"2024-09-12T17:10:45.504515+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:07:39.857190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"263'250","reported_seq":1512,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:09.987483+0000","last_change":"2024-09-12T17:10:48.544016+0000","last_active":"2024-09-12T18:11:09.987483+0000","last_peered":"2024-09-12T18:11:09.987483+0000","last_clean":"2024-09-12T18:11:09.987483+0000","last_became_active":"2024-09-12T17:10:48.543196+0000","last_became_peered":"2024-09-12T17:10:48.543196+0000","last_unstale":"2024-09-12T18:11:09.987483+0000","last_undegraded":"2024-09-12T18:11:09.987483+0000","last_fullsized":"2024-09-12T18:11:09.987483+0000","mapping_epoch":30,"log_start":"263'200","ondisk_log_start":"263'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_clean_scrub_stamp":"2024-09-12T17:10:47.516917+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":200,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:18:29.037042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":209,"num_read_kb":201,"num_write":185,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":495,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:09.843829+0000","last_change":"2024-09-12T17:10:50.559244+0000","last_active":"2024-09-12T18:09:09.843829+0000","last_peered":"2024-09-12T18:09:09.843829+0000","last_clean":"2024-09-12T18:09:09.843829+0000","last_became_active":"2024-09-12T17:10:50.558980+0000","last_became_peered":"2024-09-12T17:10:50.558980+0000","last_unstale":"2024-09-12T18:09:09.843829+0000","last_undegraded":"2024-09-12T18:09:09.843829+0000","last_fullsized":"2024-09-12T18:09:09.843829+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_clean_scrub_stamp":"2024-09-12T17:10:49.533772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:56:03.520861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"263'256","reported_seq":854,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:49.824162+0000","last_change":"2024-09-12T17:10:52.564338+0000","last_active":"2024-09-12T18:09:49.824162+0000","last_peered":"2024-09-12T18:09:49.824162+0000","last_clean":"2024-09-12T18:09:49.824162+0000","last_became_active":"2024-09-12T17:10:52.563885+0000","last_became_peered":"2024-09-12T17:10:52.563885+0000","last_unstale":"2024-09-12T18:09:49.824162+0000","last_undegraded":"2024-09-12T18:09:49.824162+0000","last_fullsized":"2024-09-12T18:09:49.824162+0000","mapping_epoch":34,"log_start":"263'200","ondisk_log_start":"263'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":200,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:12:03.079469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":520,"num_read_kb":542,"num_write":569,"num_write_kb":161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"263'664","reported_seq":2208,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:05.147309+0000","last_change":"2024-09-12T17:10:44.516073+0000","last_active":"2024-09-12T18:09:05.147309+0000","last_peered":"2024-09-12T18:09:05.147309+0000","last_clean":"2024-09-12T18:09:05.147309+0000","last_became_active":"2024-09-12T17:10:44.515807+0000","last_became_peered":"2024-09-12T17:10:44.515807+0000","last_unstale":"2024-09-12T18:09:05.147309+0000","last_undegraded":"2024-09-12T18:09:05.147309+0000","last_fullsized":"2024-09-12T18:09:05.147309+0000","mapping_epoch":26,"log_start":"263'600","ondisk_log_start":"263'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":600,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:25:36.561047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3415,"num_read_kb":3057,"num_write":984,"num_write_kb":466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":525,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:54.852239+0000","last_change":"2024-09-12T17:10:33.852654+0000","last_active":"2024-09-12T18:08:54.852239+0000","last_peered":"2024-09-12T18:08:54.852239+0000","last_clean":"2024-09-12T18:08:54.852239+0000","last_became_active":"2024-09-12T17:10:31.849085+0000","last_became_peered":"2024-09-12T17:10:31.849085+0000","last_unstale":"2024-09-12T18:08:54.852239+0000","last_undegraded":"2024-09-12T18:08:54.852239+0000","last_fullsized":"2024-09-12T18:08:54.852239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:30.818274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:30.818274+0000","last_clean_scrub_stamp":"2024-09-12T17:10:30.818274+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:06:13.863048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011727,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"263'232","reported_seq":923,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:41.264856+0000","last_change":"2024-09-12T17:10:42.529838+0000","last_active":"2024-09-12T18:11:41.264856+0000","last_peered":"2024-09-12T18:11:41.264856+0000","last_clean":"2024-09-12T18:11:41.264856+0000","last_became_active":"2024-09-12T17:10:42.529499+0000","last_became_peered":"2024-09-12T17:10:42.529499+0000","last_unstale":"2024-09-12T18:11:41.264856+0000","last_undegraded":"2024-09-12T18:11:41.264856+0000","last_fullsized":"2024-09-12T18:11:41.264856+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":200,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:16:13.720843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262174,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":565,"num_read_kb":10247,"num_write":1100,"num_write_kb":30448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,6],"acting":[4,5,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":503,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:19.845346+0000","last_change":"2024-09-12T17:10:46.526726+0000","last_active":"2024-09-12T18:09:19.845346+0000","last_peered":"2024-09-12T18:09:19.845346+0000","last_clean":"2024-09-12T18:09:19.845346+0000","last_became_active":"2024-09-12T17:10:46.526136+0000","last_became_peered":"2024-09-12T17:10:46.526136+0000","last_unstale":"2024-09-12T18:09:19.845346+0000","last_undegraded":"2024-09-12T18:09:19.845346+0000","last_fullsized":"2024-09-12T18:09:19.845346+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_clean_scrub_stamp":"2024-09-12T17:10:45.504515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:44:29.040188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"263'139","reported_seq":685,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:09.997112+0000","last_change":"2024-09-12T17:10:48.536587+0000","last_active":"2024-09-12T18:11:09.997112+0000","last_peered":"2024-09-12T18:11:09.997112+0000","last_clean":"2024-09-12T18:11:09.997112+0000","last_became_active":"2024-09-12T17:10:48.536247+0000","last_became_peered":"2024-09-12T17:10:48.536247+0000","last_unstale":"2024-09-12T18:11:09.997112+0000","last_undegraded":"2024-09-12T18:11:09.997112+0000","last_fullsized":"2024-09-12T18:11:09.997112+0000","mapping_epoch":30,"log_start":"263'100","ondisk_log_start":"263'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_clean_scrub_stamp":"2024-09-12T17:10:47.516917+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:26:17.588873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":163,"num_read_kb":156,"num_write":120,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":491,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:19.876894+0000","last_change":"2024-09-12T17:10:50.556253+0000","last_active":"2024-09-12T18:09:19.876894+0000","last_peered":"2024-09-12T18:09:19.876894+0000","last_clean":"2024-09-12T18:09:19.876894+0000","last_became_active":"2024-09-12T17:10:50.555747+0000","last_became_peered":"2024-09-12T17:10:50.555747+0000","last_unstale":"2024-09-12T18:09:19.876894+0000","last_undegraded":"2024-09-12T18:09:19.876894+0000","last_fullsized":"2024-09-12T18:09:19.876894+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_clean_scrub_stamp":"2024-09-12T17:10:49.533772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:17:05.525534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"263'122","reported_seq":667,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:24.858258+0000","last_change":"2024-09-12T17:10:52.575248+0000","last_active":"2024-09-12T18:09:24.858258+0000","last_peered":"2024-09-12T18:09:24.858258+0000","last_clean":"2024-09-12T18:09:24.858258+0000","last_became_active":"2024-09-12T17:10:52.574956+0000","last_became_peered":"2024-09-12T17:10:52.574956+0000","last_unstale":"2024-09-12T18:09:24.858258+0000","last_undegraded":"2024-09-12T18:09:24.858258+0000","last_fullsized":"2024-09-12T18:09:24.858258+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:35:51.476345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":427,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":242,"num_read_kb":241,"num_write":285,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"263'471","reported_seq":2077,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:08.688603+0000","last_change":"2024-09-12T17:10:44.516554+0000","last_active":"2024-09-12T18:11:08.688603+0000","last_peered":"2024-09-12T18:11:08.688603+0000","last_clean":"2024-09-12T18:11:08.688603+0000","last_became_active":"2024-09-12T17:10:44.516258+0000","last_became_peered":"2024-09-12T17:10:44.516258+0000","last_unstale":"2024-09-12T18:11:08.688603+0000","last_undegraded":"2024-09-12T18:11:08.688603+0000","last_fullsized":"2024-09-12T18:11:08.688603+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":400,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:22:51.498940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2512,"num_read_kb":2369,"num_write":577,"num_write_kb":149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"263'182","reported_seq":881,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:41.130846+0000","last_change":"2024-09-12T17:10:42.521202+0000","last_active":"2024-09-12T18:11:41.130846+0000","last_peered":"2024-09-12T18:11:41.130846+0000","last_clean":"2024-09-12T18:11:41.130846+0000","last_became_active":"2024-09-12T17:10:42.520777+0000","last_became_peered":"2024-09-12T17:10:42.520777+0000","last_unstale":"2024-09-12T18:11:41.130846+0000","last_undegraded":"2024-09-12T18:11:41.130846+0000","last_fullsized":"2024-09-12T18:11:41.130846+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:17:55.542119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":574,"num_read_kb":36969,"num_write":896,"num_write_kb":42705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":529,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:55.146233+0000","last_change":"2024-09-12T17:10:33.854505+0000","last_active":"2024-09-12T18:08:55.146233+0000","last_peered":"2024-09-12T18:08:55.146233+0000","last_clean":"2024-09-12T18:08:55.146233+0000","last_became_active":"2024-09-12T17:10:32.177463+0000","last_became_peered":"2024-09-12T17:10:32.177463+0000","last_unstale":"2024-09-12T18:08:55.146233+0000","last_undegraded":"2024-09-12T18:08:55.146233+0000","last_fullsized":"2024-09-12T18:08:55.146233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:30.818274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:30.818274+0000","last_clean_scrub_stamp":"2024-09-12T17:10:30.818274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:37:29.735097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059857599999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":503,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:09.843813+0000","last_change":"2024-09-12T17:10:46.528815+0000","last_active":"2024-09-12T18:09:09.843813+0000","last_peered":"2024-09-12T18:09:09.843813+0000","last_clean":"2024-09-12T18:09:09.843813+0000","last_became_active":"2024-09-12T17:10:46.528499+0000","last_became_peered":"2024-09-12T17:10:46.528499+0000","last_unstale":"2024-09-12T18:09:09.843813+0000","last_undegraded":"2024-09-12T18:09:09.843813+0000","last_fullsized":"2024-09-12T18:09:09.843813+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_clean_scrub_stamp":"2024-09-12T17:10:45.504515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:46:42.455244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"263'276","reported_seq":948,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:41.328725+0000","last_change":"2024-09-12T17:10:48.540277+0000","last_active":"2024-09-12T18:11:41.328725+0000","last_peered":"2024-09-12T18:11:41.328725+0000","last_clean":"2024-09-12T18:11:41.328725+0000","last_became_active":"2024-09-12T17:10:48.539913+0000","last_became_peered":"2024-09-12T17:10:48.539913+0000","last_unstale":"2024-09-12T18:11:41.328725+0000","last_undegraded":"2024-09-12T18:11:41.328725+0000","last_fullsized":"2024-09-12T18:11:41.328725+0000","mapping_epoch":30,"log_start":"260'200","ondisk_log_start":"260'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_clean_scrub_stamp":"2024-09-12T17:10:47.516917+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:02:55.603063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10695,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":387,"num_read_kb":478,"num_write":220,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":498,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:09.855203+0000","last_change":"2024-09-12T17:10:50.555362+0000","last_active":"2024-09-12T18:09:09.855203+0000","last_peered":"2024-09-12T18:09:09.855203+0000","last_clean":"2024-09-12T18:09:09.855203+0000","last_became_active":"2024-09-12T17:10:50.555068+0000","last_became_peered":"2024-09-12T17:10:50.555068+0000","last_unstale":"2024-09-12T18:09:09.855203+0000","last_undegraded":"2024-09-12T18:09:09.855203+0000","last_fullsized":"2024-09-12T18:09:09.855203+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_clean_scrub_stamp":"2024-09-12T17:10:49.533772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:07:39.703527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"263'153","reported_seq":659,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:46.594011+0000","last_change":"2024-09-12T17:10:52.671530+0000","last_active":"2024-09-12T18:09:46.594011+0000","last_peered":"2024-09-12T18:09:46.594011+0000","last_clean":"2024-09-12T18:09:46.594011+0000","last_became_active":"2024-09-12T17:10:52.671238+0000","last_became_peered":"2024-09-12T17:10:52.671238+0000","last_unstale":"2024-09-12T18:09:46.594011+0000","last_undegraded":"2024-09-12T18:09:46.594011+0000","last_fullsized":"2024-09-12T18:09:46.594011+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:56:27.646939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":925,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":183,"num_read_kb":179,"num_write":356,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"263'539","reported_seq":2231,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:49.548593+0000","last_change":"2024-09-12T17:10:44.513894+0000","last_active":"2024-09-12T18:09:49.548593+0000","last_peered":"2024-09-12T18:09:49.548593+0000","last_clean":"2024-09-12T18:09:49.548593+0000","last_became_active":"2024-09-12T17:10:44.513543+0000","last_became_peered":"2024-09-12T17:10:44.513543+0000","last_unstale":"2024-09-12T18:09:49.548593+0000","last_undegraded":"2024-09-12T18:09:49.548593+0000","last_fullsized":"2024-09-12T18:09:49.548593+0000","mapping_epoch":26,"log_start":"263'500","ondisk_log_start":"263'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":500,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:52:06.056418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3000,"num_read_kb":2785,"num_write":670,"num_write_kb":215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"263'214","reported_seq":893,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:41.104725+0000","last_change":"2024-09-12T17:10:42.524565+0000","last_active":"2024-09-12T18:11:41.104725+0000","last_peered":"2024-09-12T18:11:41.104725+0000","last_clean":"2024-09-12T18:11:41.104725+0000","last_became_active":"2024-09-12T17:10:42.524130+0000","last_became_peered":"2024-09-12T17:10:42.524130+0000","last_unstale":"2024-09-12T18:11:41.104725+0000","last_undegraded":"2024-09-12T18:11:41.104725+0000","last_fullsized":"2024-09-12T18:11:41.104725+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:41:13.724342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2067952,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":586,"num_read_kb":68430,"num_write":1040,"num_write_kb":36992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,5],"acting":[1,2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":519,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:04.854964+0000","last_change":"2024-09-12T17:10:33.955366+0000","last_active":"2024-09-12T18:09:04.854964+0000","last_peered":"2024-09-12T18:09:04.854964+0000","last_clean":"2024-09-12T18:09:04.854964+0000","last_became_active":"2024-09-12T17:10:32.177457+0000","last_became_peered":"2024-09-12T17:10:32.177457+0000","last_unstale":"2024-09-12T18:09:04.854964+0000","last_undegraded":"2024-09-12T18:09:04.854964+0000","last_fullsized":"2024-09-12T18:09:04.854964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:30.818274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:30.818274+0000","last_clean_scrub_stamp":"2024-09-12T17:10:30.818274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:40:39.661808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000468751,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":500,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:09.875290+0000","last_change":"2024-09-12T17:10:46.527702+0000","last_active":"2024-09-12T18:09:09.875290+0000","last_peered":"2024-09-12T18:09:09.875290+0000","last_clean":"2024-09-12T18:09:09.875290+0000","last_became_active":"2024-09-12T17:10:46.527299+0000","last_became_peered":"2024-09-12T17:10:46.527299+0000","last_unstale":"2024-09-12T18:09:09.875290+0000","last_undegraded":"2024-09-12T18:09:09.875290+0000","last_fullsized":"2024-09-12T18:09:09.875290+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_clean_scrub_stamp":"2024-09-12T17:10:45.504515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:20:28.139339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"263'234","reported_seq":808,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:58.608748+0000","last_change":"2024-09-12T17:10:48.539230+0000","last_active":"2024-09-12T18:09:58.608748+0000","last_peered":"2024-09-12T18:09:58.608748+0000","last_clean":"2024-09-12T18:09:58.608748+0000","last_became_active":"2024-09-12T17:10:48.538190+0000","last_became_peered":"2024-09-12T17:10:48.538190+0000","last_unstale":"2024-09-12T18:09:58.608748+0000","last_undegraded":"2024-09-12T18:09:58.608748+0000","last_fullsized":"2024-09-12T18:09:58.608748+0000","mapping_epoch":30,"log_start":"263'200","ondisk_log_start":"263'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_clean_scrub_stamp":"2024-09-12T17:10:47.516917+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":200,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:41:22.031248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":276,"num_read_kb":262,"num_write":250,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"263'779","reported_seq":2752,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:41.007736+0000","last_change":"2024-09-12T17:10:50.562034+0000","last_active":"2024-09-12T18:11:41.007736+0000","last_peered":"2024-09-12T18:11:41.007736+0000","last_clean":"2024-09-12T18:11:41.007736+0000","last_became_active":"2024-09-12T17:10:50.561112+0000","last_became_peered":"2024-09-12T17:10:50.561112+0000","last_unstale":"2024-09-12T18:11:41.007736+0000","last_undegraded":"2024-09-12T18:11:41.007736+0000","last_fullsized":"2024-09-12T18:11:41.007736+0000","mapping_epoch":32,"log_start":"263'700","ondisk_log_start":"263'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_clean_scrub_stamp":"2024-09-12T17:10:49.533772+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":700,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:22:47.285499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"263'97","reported_seq":608,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:39.855795+0000","last_change":"2024-09-12T17:10:52.672259+0000","last_active":"2024-09-12T18:09:39.855795+0000","last_peered":"2024-09-12T18:09:39.855795+0000","last_clean":"2024-09-12T18:09:39.855795+0000","last_became_active":"2024-09-12T17:10:52.671116+0000","last_became_peered":"2024-09-12T17:10:52.671116+0000","last_unstale":"2024-09-12T18:09:39.855795+0000","last_undegraded":"2024-09-12T18:09:39.855795+0000","last_fullsized":"2024-09-12T18:09:39.855795+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:05:09.882357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":505,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":188,"num_read_kb":171,"num_write":234,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"263'777","reported_seq":2421,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:49.547019+0000","last_change":"2024-09-12T17:10:44.512159+0000","last_active":"2024-09-12T18:09:49.547019+0000","last_peered":"2024-09-12T18:09:49.547019+0000","last_clean":"2024-09-12T18:09:49.547019+0000","last_became_active":"2024-09-12T17:10:44.511450+0000","last_became_peered":"2024-09-12T17:10:44.511450+0000","last_unstale":"2024-09-12T18:09:49.547019+0000","last_undegraded":"2024-09-12T18:09:49.547019+0000","last_fullsized":"2024-09-12T18:09:49.547019+0000","mapping_epoch":26,"log_start":"263'700","ondisk_log_start":"263'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":700,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:25:36.561047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3773,"num_read_kb":3378,"num_write":1080,"num_write_kb":423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"263'167","reported_seq":749,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:41.247853+0000","last_change":"2024-09-12T17:10:42.526880+0000","last_active":"2024-09-12T18:11:41.247853+0000","last_peered":"2024-09-12T18:11:41.247853+0000","last_clean":"2024-09-12T18:11:41.247853+0000","last_became_active":"2024-09-12T17:10:42.526472+0000","last_became_peered":"2024-09-12T17:10:42.526472+0000","last_unstale":"2024-09-12T18:11:41.247853+0000","last_undegraded":"2024-09-12T18:11:41.247853+0000","last_fullsized":"2024-09-12T18:11:41.247853+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":100,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:45:58.908363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":300,"num_read_kb":1418,"num_write":797,"num_write_kb":46804,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,0],"acting":[3,5,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":528,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:05.147338+0000","last_change":"2024-09-12T17:10:33.854523+0000","last_active":"2024-09-12T18:09:05.147338+0000","last_peered":"2024-09-12T18:09:05.147338+0000","last_clean":"2024-09-12T18:09:05.147338+0000","last_became_active":"2024-09-12T17:10:31.845481+0000","last_became_peered":"2024-09-12T17:10:31.845481+0000","last_unstale":"2024-09-12T18:09:05.147338+0000","last_undegraded":"2024-09-12T18:09:05.147338+0000","last_fullsized":"2024-09-12T18:09:05.147338+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:30.818274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:30.818274+0000","last_clean_scrub_stamp":"2024-09-12T17:10:30.818274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:06:13.863048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060466100000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":506,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:09.855182+0000","last_change":"2024-09-12T17:10:46.530614+0000","last_active":"2024-09-12T18:09:09.855182+0000","last_peered":"2024-09-12T18:09:09.855182+0000","last_clean":"2024-09-12T18:09:09.855182+0000","last_became_active":"2024-09-12T17:10:46.530275+0000","last_became_peered":"2024-09-12T17:10:46.530275+0000","last_unstale":"2024-09-12T18:09:09.855182+0000","last_undegraded":"2024-09-12T18:09:09.855182+0000","last_fullsized":"2024-09-12T18:09:09.855182+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_clean_scrub_stamp":"2024-09-12T17:10:45.504515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:08:24.007031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"263'128","reported_seq":676,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:09.855223+0000","last_change":"2024-09-12T17:10:48.542113+0000","last_active":"2024-09-12T18:09:09.855223+0000","last_peered":"2024-09-12T18:09:09.855223+0000","last_clean":"2024-09-12T18:09:09.855223+0000","last_became_active":"2024-09-12T17:10:48.541795+0000","last_became_peered":"2024-09-12T17:10:48.541795+0000","last_unstale":"2024-09-12T18:09:09.855223+0000","last_undegraded":"2024-09-12T18:09:09.855223+0000","last_fullsized":"2024-09-12T18:09:09.855223+0000","mapping_epoch":30,"log_start":"263'100","ondisk_log_start":"263'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_clean_scrub_stamp":"2024-09-12T17:10:47.516917+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:48:37.106733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":142,"num_read_kb":133,"num_write":96,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"263'790","reported_seq":4450,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:41.012381+0000","last_change":"2024-09-12T17:10:50.560337+0000","last_active":"2024-09-12T18:11:41.012381+0000","last_peered":"2024-09-12T18:11:41.012381+0000","last_clean":"2024-09-12T18:11:41.012381+0000","last_became_active":"2024-09-12T17:10:50.559932+0000","last_became_peered":"2024-09-12T17:10:50.559932+0000","last_unstale":"2024-09-12T18:11:41.012381+0000","last_undegraded":"2024-09-12T18:11:41.012381+0000","last_fullsized":"2024-09-12T18:11:41.012381+0000","mapping_epoch":32,"log_start":"263'700","ondisk_log_start":"263'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_clean_scrub_stamp":"2024-09-12T17:10:49.533772+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":700,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:05:17.277375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"263'288","reported_seq":829,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:24.845948+0000","last_change":"2024-09-12T17:10:52.570934+0000","last_active":"2024-09-12T18:09:24.845948+0000","last_peered":"2024-09-12T18:09:24.845948+0000","last_clean":"2024-09-12T18:09:24.845948+0000","last_became_active":"2024-09-12T17:10:52.570545+0000","last_became_peered":"2024-09-12T17:10:52.570545+0000","last_unstale":"2024-09-12T18:09:24.845948+0000","last_undegraded":"2024-09-12T18:09:24.845948+0000","last_fullsized":"2024-09-12T18:09:24.845948+0000","mapping_epoch":34,"log_start":"263'200","ondisk_log_start":"263'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:15:52.985878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":466,"num_read_kb":447,"num_write":645,"num_write_kb":207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"263'471","reported_seq":1901,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:20.793547+0000","last_change":"2024-09-12T17:10:44.517863+0000","last_active":"2024-09-12T18:09:20.793547+0000","last_peered":"2024-09-12T18:09:20.793547+0000","last_clean":"2024-09-12T18:09:20.793547+0000","last_became_active":"2024-09-12T17:10:44.517508+0000","last_became_peered":"2024-09-12T17:10:44.517508+0000","last_unstale":"2024-09-12T18:09:20.793547+0000","last_undegraded":"2024-09-12T18:09:20.793547+0000","last_fullsized":"2024-09-12T18:09:20.793547+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":400,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:38:36.589360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2400,"num_read_kb":2225,"num_write":610,"num_write_kb":202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"263'211","reported_seq":849,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:41.167664+0000","last_change":"2024-09-12T17:10:42.518819+0000","last_active":"2024-09-12T18:11:41.167664+0000","last_peered":"2024-09-12T18:11:41.167664+0000","last_clean":"2024-09-12T18:11:41.167664+0000","last_became_active":"2024-09-12T17:10:42.518404+0000","last_became_peered":"2024-09-12T17:10:42.518404+0000","last_unstale":"2024-09-12T18:11:41.167664+0000","last_undegraded":"2024-09-12T18:11:41.167664+0000","last_fullsized":"2024-09-12T18:11:41.167664+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:42:38.202022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170264,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":504,"num_read_kb":3973,"num_write":1040,"num_write_kb":36643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,7],"acting":[0,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":523,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:04.874518+0000","last_change":"2024-09-12T17:10:33.848505+0000","last_active":"2024-09-12T18:09:04.874518+0000","last_peered":"2024-09-12T18:09:04.874518+0000","last_clean":"2024-09-12T18:09:04.874518+0000","last_became_active":"2024-09-12T17:10:31.846123+0000","last_became_peered":"2024-09-12T17:10:31.846123+0000","last_unstale":"2024-09-12T18:09:04.874518+0000","last_undegraded":"2024-09-12T18:09:04.874518+0000","last_fullsized":"2024-09-12T18:09:04.874518+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:30.818274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:30.818274+0000","last_clean_scrub_stamp":"2024-09-12T17:10:30.818274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:48:25.408756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042024599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":500,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:04.850946+0000","last_change":"2024-09-12T17:10:46.530820+0000","last_active":"2024-09-12T18:09:04.850946+0000","last_peered":"2024-09-12T18:09:04.850946+0000","last_clean":"2024-09-12T18:09:04.850946+0000","last_became_active":"2024-09-12T17:10:46.530457+0000","last_became_peered":"2024-09-12T17:10:46.530457+0000","last_unstale":"2024-09-12T18:09:04.850946+0000","last_undegraded":"2024-09-12T18:09:04.850946+0000","last_fullsized":"2024-09-12T18:09:04.850946+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_clean_scrub_stamp":"2024-09-12T17:10:45.504515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:55:20.257339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"263'313","reported_seq":1032,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:41.357851+0000","last_change":"2024-09-12T17:10:48.543312+0000","last_active":"2024-09-12T18:11:41.357851+0000","last_peered":"2024-09-12T18:11:41.357851+0000","last_clean":"2024-09-12T18:11:41.357851+0000","last_became_active":"2024-09-12T17:10:48.542991+0000","last_became_peered":"2024-09-12T17:10:48.542991+0000","last_unstale":"2024-09-12T18:11:41.357851+0000","last_undegraded":"2024-09-12T18:11:41.357851+0000","last_fullsized":"2024-09-12T18:11:41.357851+0000","mapping_epoch":30,"log_start":"263'300","ondisk_log_start":"263'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_clean_scrub_stamp":"2024-09-12T17:10:47.516917+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:14:45.346536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23115,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":468,"num_read_kb":620,"num_write":234,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":491,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:09.851601+0000","last_change":"2024-09-12T17:10:50.553798+0000","last_active":"2024-09-12T18:09:09.851601+0000","last_peered":"2024-09-12T18:09:09.851601+0000","last_clean":"2024-09-12T18:09:09.851601+0000","last_became_active":"2024-09-12T17:10:50.553469+0000","last_became_peered":"2024-09-12T17:10:50.553469+0000","last_unstale":"2024-09-12T18:09:09.851601+0000","last_undegraded":"2024-09-12T18:09:09.851601+0000","last_fullsized":"2024-09-12T18:09:09.851601+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_clean_scrub_stamp":"2024-09-12T17:10:49.533772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:37:24.951291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"263'114","reported_seq":615,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:24.858341+0000","last_change":"2024-09-12T17:10:52.579037+0000","last_active":"2024-09-12T18:09:24.858341+0000","last_peered":"2024-09-12T18:09:24.858341+0000","last_clean":"2024-09-12T18:09:24.858341+0000","last_became_active":"2024-09-12T17:10:52.578713+0000","last_became_peered":"2024-09-12T17:10:52.578713+0000","last_unstale":"2024-09-12T18:09:24.858341+0000","last_undegraded":"2024-09-12T18:09:24.858341+0000","last_fullsized":"2024-09-12T18:09:24.858341+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:23:43.956550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":176,"num_read_kb":166,"num_write":279,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"263'124","reported_seq":686,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:49.766649+0000","last_change":"2024-09-12T17:10:52.576764+0000","last_active":"2024-09-12T18:09:49.766649+0000","last_peered":"2024-09-12T18:09:49.766649+0000","last_clean":"2024-09-12T18:09:49.766649+0000","last_became_active":"2024-09-12T17:10:52.576481+0000","last_became_peered":"2024-09-12T17:10:52.576481+0000","last_unstale":"2024-09-12T18:09:49.766649+0000","last_undegraded":"2024-09-12T18:09:49.766649+0000","last_fullsized":"2024-09-12T18:09:49.766649+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:22:23.671221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":242,"num_read_kb":237,"num_write":285,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"263'886","reported_seq":2476,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:04.854522+0000","last_change":"2024-09-12T17:10:44.507764+0000","last_active":"2024-09-12T18:09:04.854522+0000","last_peered":"2024-09-12T18:09:04.854522+0000","last_clean":"2024-09-12T18:09:04.854522+0000","last_became_active":"2024-09-12T17:10:44.507455+0000","last_became_peered":"2024-09-12T17:10:44.507455+0000","last_unstale":"2024-09-12T18:09:04.854522+0000","last_undegraded":"2024-09-12T18:09:04.854522+0000","last_fullsized":"2024-09-12T18:09:04.854522+0000","mapping_epoch":26,"log_start":"263'800","ondisk_log_start":"263'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":800,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:27:20.389462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4276,"num_read_kb":3830,"num_write":1165,"num_write_kb":436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"263'212","reported_seq":863,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:41.322157+0000","last_change":"2024-09-12T17:10:42.520147+0000","last_active":"2024-09-12T18:11:41.322157+0000","last_peered":"2024-09-12T18:11:41.322157+0000","last_clean":"2024-09-12T18:11:41.322157+0000","last_became_active":"2024-09-12T17:10:42.519656+0000","last_became_peered":"2024-09-12T17:10:42.519656+0000","last_unstale":"2024-09-12T18:11:41.322157+0000","last_undegraded":"2024-09-12T18:11:41.322157+0000","last_fullsized":"2024-09-12T18:11:41.322157+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:46:04.344482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":812867,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":526,"num_read_kb":10349,"num_write":1065,"num_write_kb":31428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,6],"acting":[4,7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":501,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:10.147893+0000","last_change":"2024-09-12T17:10:46.527971+0000","last_active":"2024-09-12T18:09:10.147893+0000","last_peered":"2024-09-12T18:09:10.147893+0000","last_clean":"2024-09-12T18:09:10.147893+0000","last_became_active":"2024-09-12T17:10:46.527445+0000","last_became_peered":"2024-09-12T17:10:46.527445+0000","last_unstale":"2024-09-12T18:09:10.147893+0000","last_undegraded":"2024-09-12T18:09:10.147893+0000","last_fullsized":"2024-09-12T18:09:10.147893+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_clean_scrub_stamp":"2024-09-12T17:10:45.504515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:06:49.441769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"263'140","reported_seq":717,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:41.093253+0000","last_change":"2024-09-12T17:10:48.536317+0000","last_active":"2024-09-12T18:11:41.093253+0000","last_peered":"2024-09-12T18:11:41.093253+0000","last_clean":"2024-09-12T18:11:41.093253+0000","last_became_active":"2024-09-12T17:10:48.536021+0000","last_became_peered":"2024-09-12T17:10:48.536021+0000","last_unstale":"2024-09-12T18:11:41.093253+0000","last_undegraded":"2024-09-12T18:11:41.093253+0000","last_fullsized":"2024-09-12T18:11:41.093253+0000","mapping_epoch":30,"log_start":"263'100","ondisk_log_start":"263'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_clean_scrub_stamp":"2024-09-12T17:10:47.516917+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:39:55.363038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9595,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":179,"num_read_kb":232,"num_write":92,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:09.851513+0000","last_change":"2024-09-12T17:10:50.555533+0000","last_active":"2024-09-12T18:09:09.851513+0000","last_peered":"2024-09-12T18:09:09.851513+0000","last_clean":"2024-09-12T18:09:09.851513+0000","last_became_active":"2024-09-12T17:10:50.555251+0000","last_became_peered":"2024-09-12T17:10:50.555251+0000","last_unstale":"2024-09-12T18:09:09.851513+0000","last_undegraded":"2024-09-12T18:09:09.851513+0000","last_fullsized":"2024-09-12T18:09:09.851513+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_clean_scrub_stamp":"2024-09-12T17:10:49.533772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:14:47.733536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"263'142","reported_seq":663,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:09.818435+0000","last_change":"2024-09-12T17:10:52.573415+0000","last_active":"2024-09-12T18:11:09.818435+0000","last_peered":"2024-09-12T18:11:09.818435+0000","last_clean":"2024-09-12T18:11:09.818435+0000","last_became_active":"2024-09-12T17:10:52.573040+0000","last_became_peered":"2024-09-12T17:10:52.573040+0000","last_unstale":"2024-09-12T18:11:09.818435+0000","last_undegraded":"2024-09-12T18:11:09.818435+0000","last_fullsized":"2024-09-12T18:11:09.818435+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:17:53.786959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":264,"num_read_kb":238,"num_write":352,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"263'1128","reported_seq":2790,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:05.147244+0000","last_change":"2024-09-12T17:10:44.509438+0000","last_active":"2024-09-12T18:09:05.147244+0000","last_peered":"2024-09-12T18:09:05.147244+0000","last_clean":"2024-09-12T18:09:05.147244+0000","last_became_active":"2024-09-12T17:10:44.509117+0000","last_became_peered":"2024-09-12T17:10:44.509117+0000","last_unstale":"2024-09-12T18:09:05.147244+0000","last_undegraded":"2024-09-12T18:09:05.147244+0000","last_fullsized":"2024-09-12T18:09:05.147244+0000","mapping_epoch":26,"log_start":"263'1100","ondisk_log_start":"263'1100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":1100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:09:30.968234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5331,"num_read_kb":4747,"num_write":1539,"num_write_kb":622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"263'206","reported_seq":815,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:41.247651+0000","last_change":"2024-09-12T17:11:16.617932+0000","last_active":"2024-09-12T18:11:41.247651+0000","last_peered":"2024-09-12T18:11:41.247651+0000","last_clean":"2024-09-12T18:11:41.247651+0000","last_became_active":"2024-09-12T17:11:16.617505+0000","last_became_peered":"2024-09-12T17:11:16.617505+0000","last_unstale":"2024-09-12T18:11:41.247651+0000","last_undegraded":"2024-09-12T18:11:41.247651+0000","last_fullsized":"2024-09-12T18:11:41.247651+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:43:08.879561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2936797,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":495,"num_read_kb":50143,"num_write":995,"num_write_kb":47141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,4],"acting":[2,3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:09.851666+0000","last_change":"2024-09-12T17:10:46.532146+0000","last_active":"2024-09-12T18:09:09.851666+0000","last_peered":"2024-09-12T18:09:09.851666+0000","last_clean":"2024-09-12T18:09:09.851666+0000","last_became_active":"2024-09-12T17:10:46.531835+0000","last_became_peered":"2024-09-12T17:10:46.531835+0000","last_unstale":"2024-09-12T18:09:09.851666+0000","last_undegraded":"2024-09-12T18:09:09.851666+0000","last_fullsized":"2024-09-12T18:09:09.851666+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_clean_scrub_stamp":"2024-09-12T17:10:45.504515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:41:31.662923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"263'46","reported_seq":554,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:09.843750+0000","last_change":"2024-09-12T17:10:48.541273+0000","last_active":"2024-09-12T18:09:09.843750+0000","last_peered":"2024-09-12T18:09:09.843750+0000","last_clean":"2024-09-12T18:09:09.843750+0000","last_became_active":"2024-09-12T17:10:48.540975+0000","last_became_peered":"2024-09-12T17:10:48.540975+0000","last_unstale":"2024-09-12T18:09:09.843750+0000","last_undegraded":"2024-09-12T18:09:09.843750+0000","last_fullsized":"2024-09-12T18:09:09.843750+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_clean_scrub_stamp":"2024-09-12T17:10:47.516917+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:50:54.992489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":38,"num_read_kb":36,"num_write":28,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":486,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:09.855642+0000","last_change":"2024-09-12T17:10:50.553896+0000","last_active":"2024-09-12T18:09:09.855642+0000","last_peered":"2024-09-12T18:09:09.855642+0000","last_clean":"2024-09-12T18:09:09.855642+0000","last_became_active":"2024-09-12T17:10:50.553581+0000","last_became_peered":"2024-09-12T17:10:50.553581+0000","last_unstale":"2024-09-12T18:09:09.855642+0000","last_undegraded":"2024-09-12T18:09:09.855642+0000","last_fullsized":"2024-09-12T18:09:09.855642+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_clean_scrub_stamp":"2024-09-12T17:10:49.533772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:14:49.105003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"263'191","reported_seq":712,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:49.539356+0000","last_change":"2024-09-12T17:10:52.573782+0000","last_active":"2024-09-12T18:09:49.539356+0000","last_peered":"2024-09-12T18:09:49.539356+0000","last_clean":"2024-09-12T18:09:49.539356+0000","last_became_active":"2024-09-12T17:10:52.573306+0000","last_became_peered":"2024-09-12T17:10:52.573306+0000","last_unstale":"2024-09-12T18:09:49.539356+0000","last_undegraded":"2024-09-12T18:09:49.539356+0000","last_fullsized":"2024-09-12T18:09:49.539356+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:39:25.637064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":321,"num_read_kb":317,"num_write":439,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"263'810","reported_seq":2411,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:04.850964+0000","last_change":"2024-09-12T17:10:44.511875+0000","last_active":"2024-09-12T18:09:04.850964+0000","last_peered":"2024-09-12T18:09:04.850964+0000","last_clean":"2024-09-12T18:09:04.850964+0000","last_became_active":"2024-09-12T17:10:44.511481+0000","last_became_peered":"2024-09-12T17:10:44.511481+0000","last_unstale":"2024-09-12T18:09:04.850964+0000","last_undegraded":"2024-09-12T18:09:04.850964+0000","last_fullsized":"2024-09-12T18:09:04.850964+0000","mapping_epoch":26,"log_start":"263'700","ondisk_log_start":"263'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":700,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:10:10.656622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3868,"num_read_kb":3506,"num_write":1048,"num_write_kb":364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"263'181","reported_seq":784,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:41.377788+0000","last_change":"2024-09-12T17:11:16.863311+0000","last_active":"2024-09-12T18:11:41.377788+0000","last_peered":"2024-09-12T18:11:41.377788+0000","last_clean":"2024-09-12T18:11:41.377788+0000","last_became_active":"2024-09-12T17:11:16.862878+0000","last_became_peered":"2024-09-12T17:11:16.862878+0000","last_unstale":"2024-09-12T18:11:41.377788+0000","last_undegraded":"2024-09-12T18:11:41.377788+0000","last_fullsized":"2024-09-12T18:11:41.377788+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:36:57.402157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3178636,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":399,"num_read_kb":53721,"num_write":811,"num_write_kb":39175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,1,3],"acting":[2,7,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:09.855601+0000","last_change":"2024-09-12T17:10:46.530915+0000","last_active":"2024-09-12T18:09:09.855601+0000","last_peered":"2024-09-12T18:09:09.855601+0000","last_clean":"2024-09-12T18:09:09.855601+0000","last_became_active":"2024-09-12T17:10:46.530518+0000","last_became_peered":"2024-09-12T17:10:46.530518+0000","last_unstale":"2024-09-12T18:09:09.855601+0000","last_undegraded":"2024-09-12T18:09:09.855601+0000","last_fullsized":"2024-09-12T18:09:09.855601+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_clean_scrub_stamp":"2024-09-12T17:10:45.504515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:39:55.119594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"263'173","reported_seq":765,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:41.300575+0000","last_change":"2024-09-12T17:10:48.537056+0000","last_active":"2024-09-12T18:11:41.300575+0000","last_peered":"2024-09-12T18:11:41.300575+0000","last_clean":"2024-09-12T18:11:41.300575+0000","last_became_active":"2024-09-12T17:10:48.536654+0000","last_became_peered":"2024-09-12T17:10:48.536654+0000","last_unstale":"2024-09-12T18:11:41.300575+0000","last_undegraded":"2024-09-12T18:11:41.300575+0000","last_fullsized":"2024-09-12T18:11:41.300575+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_clean_scrub_stamp":"2024-09-12T17:10:47.516917+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:46:23.716742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5117,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":224,"num_read_kb":242,"num_write":122,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":489,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:09.875304+0000","last_change":"2024-09-12T17:10:50.556336+0000","last_active":"2024-09-12T18:09:09.875304+0000","last_peered":"2024-09-12T18:09:09.875304+0000","last_clean":"2024-09-12T18:09:09.875304+0000","last_became_active":"2024-09-12T17:10:50.556039+0000","last_became_peered":"2024-09-12T17:10:50.556039+0000","last_unstale":"2024-09-12T18:09:09.875304+0000","last_undegraded":"2024-09-12T18:09:09.875304+0000","last_fullsized":"2024-09-12T18:09:09.875304+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_clean_scrub_stamp":"2024-09-12T17:10:49.533772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:58:59.200469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"263'113","reported_seq":617,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:24.848069+0000","last_change":"2024-09-12T17:10:52.577104+0000","last_active":"2024-09-12T18:08:24.848069+0000","last_peered":"2024-09-12T18:08:24.848069+0000","last_clean":"2024-09-12T18:08:24.848069+0000","last_became_active":"2024-09-12T17:10:52.576791+0000","last_became_peered":"2024-09-12T17:10:52.576791+0000","last_unstale":"2024-09-12T18:08:24.848069+0000","last_undegraded":"2024-09-12T18:08:24.848069+0000","last_fullsized":"2024-09-12T18:08:24.848069+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:18:40.050173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":159,"num_read_kb":159,"num_write":260,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"263'429","reported_seq":1806,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:04.850927+0000","last_change":"2024-09-12T17:10:44.521723+0000","last_active":"2024-09-12T18:09:04.850927+0000","last_peered":"2024-09-12T18:09:04.850927+0000","last_clean":"2024-09-12T18:09:04.850927+0000","last_became_active":"2024-09-12T17:10:44.520747+0000","last_became_peered":"2024-09-12T17:10:44.520747+0000","last_unstale":"2024-09-12T18:09:04.850927+0000","last_undegraded":"2024-09-12T18:09:04.850927+0000","last_fullsized":"2024-09-12T18:09:04.850927+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":400,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:56:20.477273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2202,"num_read_kb":2035,"num_write":527,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"263'255","reported_seq":944,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:41.185068+0000","last_change":"2024-09-12T17:10:42.529117+0000","last_active":"2024-09-12T18:11:41.185068+0000","last_peered":"2024-09-12T18:11:41.185068+0000","last_clean":"2024-09-12T18:11:41.185068+0000","last_became_active":"2024-09-12T17:10:42.528364+0000","last_became_peered":"2024-09-12T17:10:42.528364+0000","last_unstale":"2024-09-12T18:11:41.185068+0000","last_undegraded":"2024-09-12T18:11:41.185068+0000","last_fullsized":"2024-09-12T18:11:41.185068+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":200,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:10:20.252342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399205,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":613,"num_read_kb":71919,"num_write":1345,"num_write_kb":46951,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6,3],"acting":[0,5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:09.875254+0000","last_change":"2024-09-12T17:10:46.532154+0000","last_active":"2024-09-12T18:09:09.875254+0000","last_peered":"2024-09-12T18:09:09.875254+0000","last_clean":"2024-09-12T18:09:09.875254+0000","last_became_active":"2024-09-12T17:10:46.531830+0000","last_became_peered":"2024-09-12T17:10:46.531830+0000","last_unstale":"2024-09-12T18:09:09.875254+0000","last_undegraded":"2024-09-12T18:09:09.875254+0000","last_fullsized":"2024-09-12T18:09:09.875254+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_clean_scrub_stamp":"2024-09-12T17:10:45.504515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:00:23.387684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"263'127","reported_seq":695,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:41.278355+0000","last_change":"2024-09-12T17:10:48.545933+0000","last_active":"2024-09-12T18:11:41.278355+0000","last_peered":"2024-09-12T18:11:41.278355+0000","last_clean":"2024-09-12T18:11:41.278355+0000","last_became_active":"2024-09-12T17:10:48.545598+0000","last_became_peered":"2024-09-12T17:10:48.545598+0000","last_unstale":"2024-09-12T18:11:41.278355+0000","last_undegraded":"2024-09-12T18:11:41.278355+0000","last_fullsized":"2024-09-12T18:11:41.278355+0000","mapping_epoch":30,"log_start":"263'100","ondisk_log_start":"263'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_clean_scrub_stamp":"2024-09-12T17:10:47.516917+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:53:48.675107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10861,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":166,"num_read_kb":224,"num_write":86,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:09.843797+0000","last_change":"2024-09-12T17:10:50.561238+0000","last_active":"2024-09-12T18:09:09.843797+0000","last_peered":"2024-09-12T18:09:09.843797+0000","last_clean":"2024-09-12T18:09:09.843797+0000","last_became_active":"2024-09-12T17:10:50.560872+0000","last_became_peered":"2024-09-12T17:10:50.560872+0000","last_unstale":"2024-09-12T18:09:09.843797+0000","last_undegraded":"2024-09-12T18:09:09.843797+0000","last_fullsized":"2024-09-12T18:09:09.843797+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_clean_scrub_stamp":"2024-09-12T17:10:49.533772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:11:16.785795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"263'950","reported_seq":2479,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:08.687444+0000","last_change":"2024-09-12T17:10:44.519331+0000","last_active":"2024-09-12T18:11:08.687444+0000","last_peered":"2024-09-12T18:11:08.687444+0000","last_clean":"2024-09-12T18:11:08.687444+0000","last_became_active":"2024-09-12T17:10:44.518992+0000","last_became_peered":"2024-09-12T17:10:44.518992+0000","last_unstale":"2024-09-12T18:11:08.687444+0000","last_undegraded":"2024-09-12T18:11:08.687444+0000","last_fullsized":"2024-09-12T18:11:08.687444+0000","mapping_epoch":26,"log_start":"263'900","ondisk_log_start":"263'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":900,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:58:27.950402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4453,"num_read_kb":3925,"num_write":1322,"num_write_kb":528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"263'316","reported_seq":994,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:41.286274+0000","last_change":"2024-09-12T17:10:42.515186+0000","last_active":"2024-09-12T18:11:41.286274+0000","last_peered":"2024-09-12T18:11:41.286274+0000","last_clean":"2024-09-12T18:11:41.286274+0000","last_became_active":"2024-09-12T17:10:42.514627+0000","last_became_peered":"2024-09-12T17:10:42.514627+0000","last_unstale":"2024-09-12T18:11:41.286274+0000","last_undegraded":"2024-09-12T18:11:41.286274+0000","last_fullsized":"2024-09-12T18:11:41.286274+0000","mapping_epoch":24,"log_start":"263'300","ondisk_log_start":"263'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:27:58.202191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":188,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":795,"num_read_kb":25839,"num_write":1196,"num_write_kb":43854,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":504,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:59.842677+0000","last_change":"2024-09-12T17:10:46.527010+0000","last_active":"2024-09-12T18:08:59.842677+0000","last_peered":"2024-09-12T18:08:59.842677+0000","last_clean":"2024-09-12T18:08:59.842677+0000","last_became_active":"2024-09-12T17:10:46.526692+0000","last_became_peered":"2024-09-12T17:10:46.526692+0000","last_unstale":"2024-09-12T18:08:59.842677+0000","last_undegraded":"2024-09-12T18:08:59.842677+0000","last_fullsized":"2024-09-12T18:08:59.842677+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_clean_scrub_stamp":"2024-09-12T17:10:45.504515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:02:16.851916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"263'213","reported_seq":846,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:41.270549+0000","last_change":"2024-09-12T17:10:48.545433+0000","last_active":"2024-09-12T18:11:41.270549+0000","last_peered":"2024-09-12T18:11:41.270549+0000","last_clean":"2024-09-12T18:11:41.270549+0000","last_became_active":"2024-09-12T17:10:48.544429+0000","last_became_peered":"2024-09-12T17:10:48.544429+0000","last_unstale":"2024-09-12T18:11:41.270549+0000","last_undegraded":"2024-09-12T18:11:41.270549+0000","last_fullsized":"2024-09-12T18:11:41.270549+0000","mapping_epoch":30,"log_start":"263'200","ondisk_log_start":"263'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_clean_scrub_stamp":"2024-09-12T17:10:47.516917+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:28:39.813411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14913,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":325,"num_read_kb":485,"num_write":208,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":485,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:19.847436+0000","last_change":"2024-09-12T17:10:50.565947+0000","last_active":"2024-09-12T18:08:19.847436+0000","last_peered":"2024-09-12T18:08:19.847436+0000","last_clean":"2024-09-12T18:08:19.847436+0000","last_became_active":"2024-09-12T17:10:50.565621+0000","last_became_peered":"2024-09-12T17:10:50.565621+0000","last_unstale":"2024-09-12T18:08:19.847436+0000","last_undegraded":"2024-09-12T18:08:19.847436+0000","last_fullsized":"2024-09-12T18:08:19.847436+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_clean_scrub_stamp":"2024-09-12T17:10:49.533772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:49:32.811403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"263'175","reported_seq":681,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:14.852393+0000","last_change":"2024-09-12T17:10:52.672357+0000","last_active":"2024-09-12T18:09:14.852393+0000","last_peered":"2024-09-12T18:09:14.852393+0000","last_clean":"2024-09-12T18:09:14.852393+0000","last_became_active":"2024-09-12T17:10:52.672033+0000","last_became_peered":"2024-09-12T17:10:52.672033+0000","last_unstale":"2024-09-12T18:09:14.852393+0000","last_undegraded":"2024-09-12T18:09:14.852393+0000","last_fullsized":"2024-09-12T18:09:14.852393+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:21:13.578314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":269,"num_read_kb":274,"num_write":411,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"263'545","reported_seq":2055,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:48.687635+0000","last_change":"2024-09-12T17:10:44.510970+0000","last_active":"2024-09-12T18:09:48.687635+0000","last_peered":"2024-09-12T18:09:48.687635+0000","last_clean":"2024-09-12T18:09:48.687635+0000","last_became_active":"2024-09-12T17:10:44.510696+0000","last_became_peered":"2024-09-12T17:10:44.510696+0000","last_unstale":"2024-09-12T18:09:48.687635+0000","last_undegraded":"2024-09-12T18:09:48.687635+0000","last_fullsized":"2024-09-12T18:09:48.687635+0000","mapping_epoch":26,"log_start":"263'500","ondisk_log_start":"263'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":500,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:45:34.728786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2748,"num_read_kb":2501,"num_write":691,"num_write_kb":203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"263'238","reported_seq":905,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:41.215677+0000","last_change":"2024-09-12T17:10:42.520812+0000","last_active":"2024-09-12T18:11:41.215677+0000","last_peered":"2024-09-12T18:11:41.215677+0000","last_clean":"2024-09-12T18:11:41.215677+0000","last_became_active":"2024-09-12T17:10:42.520349+0000","last_became_peered":"2024-09-12T17:10:42.520349+0000","last_unstale":"2024-09-12T18:11:41.215677+0000","last_undegraded":"2024-09-12T18:11:41.215677+0000","last_fullsized":"2024-09-12T18:11:41.215677+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":200,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:40:03.389243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10743893,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":541,"num_read_kb":59039,"num_write":1206,"num_write_kb":37561,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,6],"acting":[1,3,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":500,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:09.875361+0000","last_change":"2024-09-12T17:10:46.530884+0000","last_active":"2024-09-12T18:09:09.875361+0000","last_peered":"2024-09-12T18:09:09.875361+0000","last_clean":"2024-09-12T18:09:09.875361+0000","last_became_active":"2024-09-12T17:10:46.530545+0000","last_became_peered":"2024-09-12T17:10:46.530545+0000","last_unstale":"2024-09-12T18:09:09.875361+0000","last_undegraded":"2024-09-12T18:09:09.875361+0000","last_fullsized":"2024-09-12T18:09:09.875361+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_clean_scrub_stamp":"2024-09-12T17:10:45.504515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:01:13.562715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"263'170","reported_seq":754,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:41.287911+0000","last_change":"2024-09-12T17:10:48.541568+0000","last_active":"2024-09-12T18:11:41.287911+0000","last_peered":"2024-09-12T18:11:41.287911+0000","last_clean":"2024-09-12T18:11:41.287911+0000","last_became_active":"2024-09-12T17:10:48.541240+0000","last_became_peered":"2024-09-12T17:10:48.541240+0000","last_unstale":"2024-09-12T18:11:41.287911+0000","last_undegraded":"2024-09-12T18:11:41.287911+0000","last_fullsized":"2024-09-12T18:11:41.287911+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_clean_scrub_stamp":"2024-09-12T17:10:47.516917+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:09:34.296718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8547,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":246,"num_read_kb":321,"num_write":160,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":491,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:20.142401+0000","last_change":"2024-09-12T17:10:50.562714+0000","last_active":"2024-09-12T18:08:20.142401+0000","last_peered":"2024-09-12T18:08:20.142401+0000","last_clean":"2024-09-12T18:08:20.142401+0000","last_became_active":"2024-09-12T17:10:50.561983+0000","last_became_peered":"2024-09-12T17:10:50.561983+0000","last_unstale":"2024-09-12T18:08:20.142401+0000","last_undegraded":"2024-09-12T18:08:20.142401+0000","last_fullsized":"2024-09-12T18:08:20.142401+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_clean_scrub_stamp":"2024-09-12T17:10:49.533772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:59:00.374511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"263'244","reported_seq":1112,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:49.532850+0000","last_change":"2024-09-12T17:10:52.573923+0000","last_active":"2024-09-12T18:09:49.532850+0000","last_peered":"2024-09-12T18:09:49.532850+0000","last_clean":"2024-09-12T18:09:49.532850+0000","last_became_active":"2024-09-12T17:10:52.573595+0000","last_became_peered":"2024-09-12T17:10:52.573595+0000","last_unstale":"2024-09-12T18:09:49.532850+0000","last_undegraded":"2024-09-12T18:09:49.532850+0000","last_fullsized":"2024-09-12T18:09:49.532850+0000","mapping_epoch":34,"log_start":"263'200","ondisk_log_start":"263'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":200,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:32:14.573475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1635,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":641,"num_read_kb":637,"num_write":634,"num_write_kb":186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"263'620","reported_seq":2213,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:58.603541+0000","last_change":"2024-09-12T17:10:44.521406+0000","last_active":"2024-09-12T18:08:58.603541+0000","last_peered":"2024-09-12T18:08:58.603541+0000","last_clean":"2024-09-12T18:08:58.603541+0000","last_became_active":"2024-09-12T17:10:44.521041+0000","last_became_peered":"2024-09-12T17:10:44.521041+0000","last_unstale":"2024-09-12T18:08:58.603541+0000","last_undegraded":"2024-09-12T18:08:58.603541+0000","last_fullsized":"2024-09-12T18:08:58.603541+0000","mapping_epoch":26,"log_start":"263'600","ondisk_log_start":"263'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":600,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:02:28.202706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3182,"num_read_kb":2947,"num_write":827,"num_write_kb":261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"263'222","reported_seq":814,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:41.198368+0000","last_change":"2024-09-12T17:11:16.860452+0000","last_active":"2024-09-12T18:11:41.198368+0000","last_peered":"2024-09-12T18:11:41.198368+0000","last_clean":"2024-09-12T18:11:41.198368+0000","last_became_active":"2024-09-12T17:11:16.860070+0000","last_became_peered":"2024-09-12T17:11:16.860070+0000","last_unstale":"2024-09-12T18:11:41.198368+0000","last_undegraded":"2024-09-12T18:11:41.198368+0000","last_fullsized":"2024-09-12T18:11:41.198368+0000","mapping_epoch":37,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:08:44.066630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3239711,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":443,"num_read_kb":10891,"num_write":955,"num_write_kb":36342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":501,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:19.848368+0000","last_change":"2024-09-12T17:10:46.530777+0000","last_active":"2024-09-12T18:08:19.848368+0000","last_peered":"2024-09-12T18:08:19.848368+0000","last_clean":"2024-09-12T18:08:19.848368+0000","last_became_active":"2024-09-12T17:10:46.530452+0000","last_became_peered":"2024-09-12T17:10:46.530452+0000","last_unstale":"2024-09-12T18:08:19.848368+0000","last_undegraded":"2024-09-12T18:08:19.848368+0000","last_fullsized":"2024-09-12T18:08:19.848368+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_clean_scrub_stamp":"2024-09-12T17:10:45.504515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:09:29.711456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"263'142","reported_seq":721,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:41.140332+0000","last_change":"2024-09-12T17:10:48.538046+0000","last_active":"2024-09-12T18:11:41.140332+0000","last_peered":"2024-09-12T18:11:41.140332+0000","last_clean":"2024-09-12T18:11:41.140332+0000","last_became_active":"2024-09-12T17:10:48.537643+0000","last_became_peered":"2024-09-12T17:10:48.537643+0000","last_unstale":"2024-09-12T18:11:41.140332+0000","last_undegraded":"2024-09-12T18:11:41.140332+0000","last_fullsized":"2024-09-12T18:11:41.140332+0000","mapping_epoch":30,"log_start":"263'100","ondisk_log_start":"263'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_clean_scrub_stamp":"2024-09-12T17:10:47.516917+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:09:50.764378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4406,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":180,"num_read_kb":223,"num_write":96,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:55.146261+0000","last_change":"2024-09-12T17:10:50.565961+0000","last_active":"2024-09-12T18:08:55.146261+0000","last_peered":"2024-09-12T18:08:55.146261+0000","last_clean":"2024-09-12T18:08:55.146261+0000","last_became_active":"2024-09-12T17:10:50.565582+0000","last_became_peered":"2024-09-12T17:10:50.565582+0000","last_unstale":"2024-09-12T18:08:55.146261+0000","last_undegraded":"2024-09-12T18:08:55.146261+0000","last_fullsized":"2024-09-12T18:08:55.146261+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_clean_scrub_stamp":"2024-09-12T17:10:49.533772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:00:34.128895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"263'130","reported_seq":617,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:09.828159+0000","last_change":"2024-09-12T17:10:52.576677+0000","last_active":"2024-09-12T18:11:09.828159+0000","last_peered":"2024-09-12T18:11:09.828159+0000","last_clean":"2024-09-12T18:11:09.828159+0000","last_became_active":"2024-09-12T17:10:52.576370+0000","last_became_peered":"2024-09-12T17:10:52.576370+0000","last_unstale":"2024-09-12T18:11:09.828159+0000","last_undegraded":"2024-09-12T18:11:09.828159+0000","last_fullsized":"2024-09-12T18:11:09.828159+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:03:31.842871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1233,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":145,"num_read_kb":142,"num_write":322,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"263'872","reported_seq":2422,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:48.687133+0000","last_change":"2024-09-12T17:10:44.519575+0000","last_active":"2024-09-12T18:09:48.687133+0000","last_peered":"2024-09-12T18:09:48.687133+0000","last_clean":"2024-09-12T18:09:48.687133+0000","last_became_active":"2024-09-12T17:10:44.519318+0000","last_became_peered":"2024-09-12T17:10:44.519318+0000","last_unstale":"2024-09-12T18:09:48.687133+0000","last_undegraded":"2024-09-12T18:09:48.687133+0000","last_fullsized":"2024-09-12T18:09:48.687133+0000","mapping_epoch":26,"log_start":"263'800","ondisk_log_start":"263'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":800,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:45:54.356905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4021,"num_read_kb":3592,"num_write":1141,"num_write_kb":414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"263'186","reported_seq":799,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:10:44.745737+0000","last_change":"2024-09-12T17:10:42.517205+0000","last_active":"2024-09-12T18:10:44.745737+0000","last_peered":"2024-09-12T18:10:44.745737+0000","last_clean":"2024-09-12T18:10:44.745737+0000","last_became_active":"2024-09-12T17:10:42.516802+0000","last_became_peered":"2024-09-12T17:10:42.516802+0000","last_unstale":"2024-09-12T18:10:44.745737+0000","last_undegraded":"2024-09-12T18:10:44.745737+0000","last_fullsized":"2024-09-12T18:10:44.745737+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:48:25.179651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":287306,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":394,"num_read_kb":13109,"num_write":967,"num_write_kb":28742,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7,1],"acting":[0,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"36'4","reported_seq":977,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:40.772548+0000","last_change":"2024-09-12T17:10:46.530932+0000","last_active":"2024-09-12T18:11:40.772548+0000","last_peered":"2024-09-12T18:11:40.772548+0000","last_clean":"2024-09-12T18:11:40.772548+0000","last_became_active":"2024-09-12T17:10:46.530466+0000","last_became_peered":"2024-09-12T17:10:46.530466+0000","last_unstale":"2024-09-12T18:11:40.772548+0000","last_undegraded":"2024-09-12T18:11:40.772548+0000","last_fullsized":"2024-09-12T18:11:40.772548+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_clean_scrub_stamp":"2024-09-12T17:10:45.504515+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:59:20.697816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":721,"num_read_kb":1187,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"263'90","reported_seq":623,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:59.853778+0000","last_change":"2024-09-12T17:10:48.538034+0000","last_active":"2024-09-12T18:08:59.853778+0000","last_peered":"2024-09-12T18:08:59.853778+0000","last_clean":"2024-09-12T18:08:59.853778+0000","last_became_active":"2024-09-12T17:10:48.537715+0000","last_became_peered":"2024-09-12T17:10:48.537715+0000","last_unstale":"2024-09-12T18:08:59.853778+0000","last_undegraded":"2024-09-12T18:08:59.853778+0000","last_fullsized":"2024-09-12T18:08:59.853778+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_clean_scrub_stamp":"2024-09-12T17:10:47.516917+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:50:02.415975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":103,"num_read_kb":94,"num_write":78,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"263'763","reported_seq":2584,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:41.006379+0000","last_change":"2024-09-12T17:10:50.552759+0000","last_active":"2024-09-12T18:11:41.006379+0000","last_peered":"2024-09-12T18:11:41.006379+0000","last_clean":"2024-09-12T18:11:41.006379+0000","last_became_active":"2024-09-12T17:10:50.552439+0000","last_became_peered":"2024-09-12T17:10:50.552439+0000","last_unstale":"2024-09-12T18:11:41.006379+0000","last_undegraded":"2024-09-12T18:11:41.006379+0000","last_fullsized":"2024-09-12T18:11:41.006379+0000","mapping_epoch":32,"log_start":"263'700","ondisk_log_start":"263'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_clean_scrub_stamp":"2024-09-12T17:10:49.533772+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":700,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:05:46.061876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"263'101","reported_seq":599,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:14.856275+0000","last_change":"2024-09-12T17:10:52.576632+0000","last_active":"2024-09-12T18:09:14.856275+0000","last_peered":"2024-09-12T18:09:14.856275+0000","last_clean":"2024-09-12T18:09:14.856275+0000","last_became_active":"2024-09-12T17:10:52.576354+0000","last_became_peered":"2024-09-12T17:10:52.576354+0000","last_unstale":"2024-09-12T18:09:14.856275+0000","last_undegraded":"2024-09-12T18:09:14.856275+0000","last_fullsized":"2024-09-12T18:09:14.856275+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:31:48.033949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":153,"num_read_kb":145,"num_write":246,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"263'888","reported_seq":2559,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:58.602298+0000","last_change":"2024-09-12T17:10:44.515286+0000","last_active":"2024-09-12T18:08:58.602298+0000","last_peered":"2024-09-12T18:08:58.602298+0000","last_clean":"2024-09-12T18:08:58.602298+0000","last_became_active":"2024-09-12T17:10:44.514263+0000","last_became_peered":"2024-09-12T17:10:44.514263+0000","last_unstale":"2024-09-12T18:08:58.602298+0000","last_undegraded":"2024-09-12T18:08:58.602298+0000","last_fullsized":"2024-09-12T18:08:58.602298+0000","mapping_epoch":26,"log_start":"263'800","ondisk_log_start":"263'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":800,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:36:42.105597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4092,"num_read_kb":3689,"num_write":1154,"num_write_kb":400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"263'220","reported_seq":858,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:41.309376+0000","last_change":"2024-09-12T17:10:42.528032+0000","last_active":"2024-09-12T18:11:41.309376+0000","last_peered":"2024-09-12T18:11:41.309376+0000","last_clean":"2024-09-12T18:11:41.309376+0000","last_became_active":"2024-09-12T17:10:42.527644+0000","last_became_peered":"2024-09-12T17:10:42.527644+0000","last_unstale":"2024-09-12T18:11:41.309376+0000","last_undegraded":"2024-09-12T18:11:41.309376+0000","last_fullsized":"2024-09-12T18:11:41.309376+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:07:37.030800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":569092,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":486,"num_read_kb":29332,"num_write":1044,"num_write_kb":31012,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,6],"acting":[5,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:19.848670+0000","last_change":"2024-09-12T17:10:46.532064+0000","last_active":"2024-09-12T18:08:19.848670+0000","last_peered":"2024-09-12T18:08:19.848670+0000","last_clean":"2024-09-12T18:08:19.848670+0000","last_became_active":"2024-09-12T17:10:46.531759+0000","last_became_peered":"2024-09-12T17:10:46.531759+0000","last_unstale":"2024-09-12T18:08:19.848670+0000","last_undegraded":"2024-09-12T18:08:19.848670+0000","last_fullsized":"2024-09-12T18:08:19.848670+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_clean_scrub_stamp":"2024-09-12T17:10:45.504515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:32:10.706827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"263'200","reported_seq":786,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:41.210065+0000","last_change":"2024-09-12T17:10:48.543431+0000","last_active":"2024-09-12T18:11:41.210065+0000","last_peered":"2024-09-12T18:11:41.210065+0000","last_clean":"2024-09-12T18:11:41.210065+0000","last_became_active":"2024-09-12T17:10:48.543123+0000","last_became_peered":"2024-09-12T17:10:48.543123+0000","last_unstale":"2024-09-12T18:11:41.210065+0000","last_undegraded":"2024-09-12T18:11:41.210065+0000","last_fullsized":"2024-09-12T18:11:41.210065+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_clean_scrub_stamp":"2024-09-12T17:10:47.516917+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:14:40.758351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9151,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":248,"num_read_kb":305,"num_write":156,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":491,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:49.841229+0000","last_change":"2024-09-12T17:10:50.556322+0000","last_active":"2024-09-12T18:08:49.841229+0000","last_peered":"2024-09-12T18:08:49.841229+0000","last_clean":"2024-09-12T18:08:49.841229+0000","last_became_active":"2024-09-12T17:10:50.556040+0000","last_became_peered":"2024-09-12T17:10:50.556040+0000","last_unstale":"2024-09-12T18:08:49.841229+0000","last_undegraded":"2024-09-12T18:08:49.841229+0000","last_fullsized":"2024-09-12T18:08:49.841229+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_clean_scrub_stamp":"2024-09-12T17:10:49.533772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:11:28.653630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"263'132","reported_seq":632,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:46.952145+0000","last_change":"2024-09-12T17:10:52.585108+0000","last_active":"2024-09-12T18:09:46.952145+0000","last_peered":"2024-09-12T18:09:46.952145+0000","last_clean":"2024-09-12T18:09:46.952145+0000","last_became_active":"2024-09-12T17:10:52.584752+0000","last_became_peered":"2024-09-12T17:10:52.584752+0000","last_unstale":"2024-09-12T18:09:46.952145+0000","last_undegraded":"2024-09-12T18:09:46.952145+0000","last_fullsized":"2024-09-12T18:09:46.952145+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:17:54.690247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":200,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":199,"num_read_kb":187,"num_write":331,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"263'455","reported_seq":2246,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:41.749674+0000","last_change":"2024-09-12T17:10:44.516055+0000","last_active":"2024-09-12T18:08:41.749674+0000","last_peered":"2024-09-12T18:08:41.749674+0000","last_clean":"2024-09-12T18:08:41.749674+0000","last_became_active":"2024-09-12T17:10:44.515463+0000","last_became_peered":"2024-09-12T17:10:44.515463+0000","last_unstale":"2024-09-12T18:08:41.749674+0000","last_undegraded":"2024-09-12T18:08:41.749674+0000","last_fullsized":"2024-09-12T18:08:41.749674+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":400,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:48:28.929846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2803,"num_read_kb":2700,"num_write":505,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"263'189","reported_seq":805,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:41.298405+0000","last_change":"2024-09-12T17:10:42.530271+0000","last_active":"2024-09-12T18:11:41.298405+0000","last_peered":"2024-09-12T18:11:41.298405+0000","last_clean":"2024-09-12T18:11:41.298405+0000","last_became_active":"2024-09-12T17:10:42.529547+0000","last_became_peered":"2024-09-12T17:10:42.529547+0000","last_unstale":"2024-09-12T18:11:41.298405+0000","last_undegraded":"2024-09-12T18:11:41.298405+0000","last_fullsized":"2024-09-12T18:11:41.298405+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:44:05.993110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262159,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":394,"num_read_kb":39415,"num_write":893,"num_write_kb":32700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,6],"acting":[5,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:19.847401+0000","last_change":"2024-09-12T17:10:46.532778+0000","last_active":"2024-09-12T18:08:19.847401+0000","last_peered":"2024-09-12T18:08:19.847401+0000","last_clean":"2024-09-12T18:08:19.847401+0000","last_became_active":"2024-09-12T17:10:46.532418+0000","last_became_peered":"2024-09-12T17:10:46.532418+0000","last_unstale":"2024-09-12T18:08:19.847401+0000","last_undegraded":"2024-09-12T18:08:19.847401+0000","last_fullsized":"2024-09-12T18:08:19.847401+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_clean_scrub_stamp":"2024-09-12T17:10:45.504515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:36:54.346427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"263'132","reported_seq":705,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:41.217909+0000","last_change":"2024-09-12T17:10:48.539329+0000","last_active":"2024-09-12T18:11:41.217909+0000","last_peered":"2024-09-12T18:11:41.217909+0000","last_clean":"2024-09-12T18:11:41.217909+0000","last_became_active":"2024-09-12T17:10:48.539047+0000","last_became_peered":"2024-09-12T17:10:48.539047+0000","last_unstale":"2024-09-12T18:11:41.217909+0000","last_undegraded":"2024-09-12T18:11:41.217909+0000","last_fullsized":"2024-09-12T18:11:41.217909+0000","mapping_epoch":30,"log_start":"263'100","ondisk_log_start":"263'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_clean_scrub_stamp":"2024-09-12T17:10:47.516917+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:16:56.494114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5891,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":167,"num_read_kb":220,"num_write":88,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:59.873702+0000","last_change":"2024-09-12T17:10:50.556644+0000","last_active":"2024-09-12T18:08:59.873702+0000","last_peered":"2024-09-12T18:08:59.873702+0000","last_clean":"2024-09-12T18:08:59.873702+0000","last_became_active":"2024-09-12T17:10:50.555858+0000","last_became_peered":"2024-09-12T17:10:50.555858+0000","last_unstale":"2024-09-12T18:08:59.873702+0000","last_undegraded":"2024-09-12T18:08:59.873702+0000","last_fullsized":"2024-09-12T18:08:59.873702+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_clean_scrub_stamp":"2024-09-12T17:10:49.533772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:24:28.762169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"263'112","reported_seq":626,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:55.349086+0000","last_change":"2024-09-12T17:10:52.671426+0000","last_active":"2024-09-12T18:08:55.349086+0000","last_peered":"2024-09-12T18:08:55.349086+0000","last_clean":"2024-09-12T18:08:55.349086+0000","last_became_active":"2024-09-12T17:10:52.671139+0000","last_became_peered":"2024-09-12T17:10:52.671139+0000","last_unstale":"2024-09-12T18:08:55.349086+0000","last_undegraded":"2024-09-12T18:08:55.349086+0000","last_fullsized":"2024-09-12T18:08:55.349086+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:12:33.369332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":178,"num_read_kb":175,"num_write":256,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"263'784","reported_seq":2334,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:06.317962+0000","last_change":"2024-09-12T17:11:16.619107+0000","last_active":"2024-09-12T18:09:06.317962+0000","last_peered":"2024-09-12T18:09:06.317962+0000","last_clean":"2024-09-12T18:09:06.317962+0000","last_became_active":"2024-09-12T17:11:16.618723+0000","last_became_peered":"2024-09-12T17:11:16.618723+0000","last_unstale":"2024-09-12T18:09:06.317962+0000","last_undegraded":"2024-09-12T18:09:06.317962+0000","last_fullsized":"2024-09-12T18:09:06.317962+0000","mapping_epoch":37,"log_start":"263'700","ondisk_log_start":"263'700","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":700,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:07:15.117121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4039,"num_read_kb":3670,"num_write":1050,"num_write_kb":387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"263'172","reported_seq":833,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:41.116482+0000","last_change":"2024-09-12T17:10:42.534710+0000","last_active":"2024-09-12T18:11:41.116482+0000","last_peered":"2024-09-12T18:11:41.116482+0000","last_clean":"2024-09-12T18:11:41.116482+0000","last_became_active":"2024-09-12T17:10:42.534052+0000","last_became_peered":"2024-09-12T17:10:42.534052+0000","last_unstale":"2024-09-12T18:11:41.116482+0000","last_undegraded":"2024-09-12T18:11:41.116482+0000","last_fullsized":"2024-09-12T18:11:41.116482+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:53:24.707491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":311063,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":426,"num_read_kb":101566,"num_write":826,"num_write_kb":35642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7,2],"acting":[3,6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:49.852279+0000","last_change":"2024-09-12T17:10:46.530515+0000","last_active":"2024-09-12T18:08:49.852279+0000","last_peered":"2024-09-12T18:08:49.852279+0000","last_clean":"2024-09-12T18:08:49.852279+0000","last_became_active":"2024-09-12T17:10:46.530079+0000","last_became_peered":"2024-09-12T17:10:46.530079+0000","last_unstale":"2024-09-12T18:08:49.852279+0000","last_undegraded":"2024-09-12T18:08:49.852279+0000","last_fullsized":"2024-09-12T18:08:49.852279+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_clean_scrub_stamp":"2024-09-12T17:10:45.504515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:40:53.204632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"263'104","reported_seq":660,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:41.107797+0000","last_change":"2024-09-12T17:10:48.543215+0000","last_active":"2024-09-12T18:11:41.107797+0000","last_peered":"2024-09-12T18:11:41.107797+0000","last_clean":"2024-09-12T18:11:41.107797+0000","last_became_active":"2024-09-12T17:10:48.542918+0000","last_became_peered":"2024-09-12T17:10:48.542918+0000","last_unstale":"2024-09-12T18:11:41.107797+0000","last_undegraded":"2024-09-12T18:11:41.107797+0000","last_fullsized":"2024-09-12T18:11:41.107797+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_clean_scrub_stamp":"2024-09-12T17:10:47.516917+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:28:39.813411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7088,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":129,"num_read_kb":191,"num_write":60,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:19.848339+0000","last_change":"2024-09-12T17:10:50.558543+0000","last_active":"2024-09-12T18:08:19.848339+0000","last_peered":"2024-09-12T18:08:19.848339+0000","last_clean":"2024-09-12T18:08:19.848339+0000","last_became_active":"2024-09-12T17:10:50.558162+0000","last_became_peered":"2024-09-12T17:10:50.558162+0000","last_unstale":"2024-09-12T18:08:19.848339+0000","last_undegraded":"2024-09-12T18:08:19.848339+0000","last_fullsized":"2024-09-12T18:08:19.848339+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_clean_scrub_stamp":"2024-09-12T17:10:49.533772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:13:27.613750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"263'151","reported_seq":1246,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:46.551935+0000","last_change":"2024-09-12T17:10:52.585025+0000","last_active":"2024-09-12T18:09:46.551935+0000","last_peered":"2024-09-12T18:09:46.551935+0000","last_clean":"2024-09-12T18:09:46.551935+0000","last_became_active":"2024-09-12T17:10:52.584763+0000","last_became_peered":"2024-09-12T17:10:52.584763+0000","last_unstale":"2024-09-12T18:09:46.551935+0000","last_undegraded":"2024-09-12T18:09:46.551935+0000","last_fullsized":"2024-09-12T18:09:46.551935+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:21:47.900231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":215,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":802,"num_read_kb":800,"num_write":350,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"263'1272","reported_seq":2975,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:48.690645+0000","last_change":"2024-09-12T17:10:44.513427+0000","last_active":"2024-09-12T18:09:48.690645+0000","last_peered":"2024-09-12T18:09:48.690645+0000","last_clean":"2024-09-12T18:09:48.690645+0000","last_became_active":"2024-09-12T17:10:44.513047+0000","last_became_peered":"2024-09-12T17:10:44.513047+0000","last_unstale":"2024-09-12T18:09:48.690645+0000","last_undegraded":"2024-09-12T18:09:48.690645+0000","last_fullsized":"2024-09-12T18:09:48.690645+0000","mapping_epoch":26,"log_start":"263'1200","ondisk_log_start":"263'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":1200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:58:01.192821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5916,"num_read_kb":5241,"num_write":1773,"num_write_kb":764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"263'270","reported_seq":938,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:41.338431+0000","last_change":"2024-09-12T17:11:16.863072+0000","last_active":"2024-09-12T18:11:41.338431+0000","last_peered":"2024-09-12T18:11:41.338431+0000","last_clean":"2024-09-12T18:11:41.338431+0000","last_became_active":"2024-09-12T17:11:16.862649+0000","last_became_peered":"2024-09-12T17:11:16.862649+0000","last_unstale":"2024-09-12T18:11:41.338431+0000","last_undegraded":"2024-09-12T18:11:41.338431+0000","last_fullsized":"2024-09-12T18:11:41.338431+0000","mapping_epoch":37,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":200,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:36:29.636546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079905,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":591,"num_read_kb":13963,"num_write":1200,"num_write_kb":16858,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,7],"acting":[0,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"29'1","reported_seq":501,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:55.146197+0000","last_change":"2024-09-12T17:10:46.527752+0000","last_active":"2024-09-12T18:08:55.146197+0000","last_peered":"2024-09-12T18:08:55.146197+0000","last_clean":"2024-09-12T18:08:55.146197+0000","last_became_active":"2024-09-12T17:10:46.527422+0000","last_became_peered":"2024-09-12T17:10:46.527422+0000","last_unstale":"2024-09-12T18:08:55.146197+0000","last_undegraded":"2024-09-12T18:08:55.146197+0000","last_fullsized":"2024-09-12T18:08:55.146197+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_clean_scrub_stamp":"2024-09-12T17:10:45.504515+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:56:46.571241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"263'165","reported_seq":756,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:41.153421+0000","last_change":"2024-09-12T17:10:48.545106+0000","last_active":"2024-09-12T18:11:41.153421+0000","last_peered":"2024-09-12T18:11:41.153421+0000","last_clean":"2024-09-12T18:11:41.153421+0000","last_became_active":"2024-09-12T17:10:48.544572+0000","last_became_peered":"2024-09-12T17:10:48.544572+0000","last_unstale":"2024-09-12T18:11:41.153421+0000","last_undegraded":"2024-09-12T18:11:41.153421+0000","last_fullsized":"2024-09-12T18:11:41.153421+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_clean_scrub_stamp":"2024-09-12T17:10:47.516917+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:11:28.036014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6031,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":216,"num_read_kb":279,"num_write":122,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":490,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:19.837629+0000","last_change":"2024-09-12T17:10:50.560331+0000","last_active":"2024-09-12T18:08:19.837629+0000","last_peered":"2024-09-12T18:08:19.837629+0000","last_clean":"2024-09-12T18:08:19.837629+0000","last_became_active":"2024-09-12T17:10:50.560057+0000","last_became_peered":"2024-09-12T17:10:50.560057+0000","last_unstale":"2024-09-12T18:08:19.837629+0000","last_undegraded":"2024-09-12T18:08:19.837629+0000","last_fullsized":"2024-09-12T18:08:19.837629+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_clean_scrub_stamp":"2024-09-12T17:10:49.533772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:11:03.611393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"263'132","reported_seq":623,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:08.654757+0000","last_change":"2024-09-12T17:10:52.570799+0000","last_active":"2024-09-12T18:11:08.654757+0000","last_peered":"2024-09-12T18:11:08.654757+0000","last_clean":"2024-09-12T18:11:08.654757+0000","last_became_active":"2024-09-12T17:10:52.570480+0000","last_became_peered":"2024-09-12T17:10:52.570480+0000","last_unstale":"2024-09-12T18:11:08.654757+0000","last_undegraded":"2024-09-12T18:11:08.654757+0000","last_fullsized":"2024-09-12T18:11:08.654757+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:15:54.371121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":203,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":138,"num_read_kb":137,"num_write":320,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"263'410","reported_seq":1793,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:15.148505+0000","last_change":"2024-09-12T17:10:44.509800+0000","last_active":"2024-09-12T18:09:15.148505+0000","last_peered":"2024-09-12T18:09:15.148505+0000","last_clean":"2024-09-12T18:09:15.148505+0000","last_became_active":"2024-09-12T17:10:44.509508+0000","last_became_peered":"2024-09-12T17:10:44.509508+0000","last_unstale":"2024-09-12T18:09:15.148505+0000","last_undegraded":"2024-09-12T18:09:15.148505+0000","last_fullsized":"2024-09-12T18:09:15.148505+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":300,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:53:56.436440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2094,"num_read_kb":1953,"num_write":504,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"263'239","reported_seq":883,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:41.063767+0000","last_change":"2024-09-12T17:10:42.526128+0000","last_active":"2024-09-12T18:11:41.063767+0000","last_peered":"2024-09-12T18:11:41.063767+0000","last_clean":"2024-09-12T18:11:41.063767+0000","last_became_active":"2024-09-12T17:10:42.521435+0000","last_became_peered":"2024-09-12T17:10:42.521435+0000","last_unstale":"2024-09-12T18:11:41.063767+0000","last_undegraded":"2024-09-12T18:11:41.063767+0000","last_fullsized":"2024-09-12T18:11:41.063767+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":200,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:05:09.412034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079890,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":525,"num_read_kb":7759,"num_write":1104,"num_write_kb":27695,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,5],"acting":[6,0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"263'492","reported_seq":2208,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:15.148484+0000","last_change":"2024-09-12T17:10:44.519546+0000","last_active":"2024-09-12T18:09:15.148484+0000","last_peered":"2024-09-12T18:09:15.148484+0000","last_clean":"2024-09-12T18:09:15.148484+0000","last_became_active":"2024-09-12T17:10:44.519236+0000","last_became_peered":"2024-09-12T17:10:44.519236+0000","last_unstale":"2024-09-12T18:09:15.148484+0000","last_undegraded":"2024-09-12T18:09:15.148484+0000","last_fullsized":"2024-09-12T18:09:15.148484+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":400,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:12:02.063964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2628,"num_read_kb":2506,"num_write":587,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"263'256","reported_seq":1020,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:41.315443+0000","last_change":"2024-09-12T17:10:42.519763+0000","last_active":"2024-09-12T18:11:41.315443+0000","last_peered":"2024-09-12T18:11:41.315443+0000","last_clean":"2024-09-12T18:11:41.315443+0000","last_became_active":"2024-09-12T17:10:42.519178+0000","last_became_peered":"2024-09-12T17:10:42.519178+0000","last_unstale":"2024-09-12T18:11:41.315443+0000","last_undegraded":"2024-09-12T18:11:41.315443+0000","last_fullsized":"2024-09-12T18:11:41.315443+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":200,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:08:25.057371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1051,"num_read_kb":7502,"num_write":1184,"num_write_kb":38848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6,7],"acting":[2,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"263'391","reported_seq":1968,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:08.688478+0000","last_change":"2024-09-12T17:10:44.515755+0000","last_active":"2024-09-12T18:11:08.688478+0000","last_peered":"2024-09-12T18:11:08.688478+0000","last_clean":"2024-09-12T18:11:08.688478+0000","last_became_active":"2024-09-12T17:10:44.515474+0000","last_became_peered":"2024-09-12T17:10:44.515474+0000","last_unstale":"2024-09-12T18:11:08.688478+0000","last_undegraded":"2024-09-12T18:11:08.688478+0000","last_fullsized":"2024-09-12T18:11:08.688478+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":300,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:30:06.533570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2306,"num_read_kb":2212,"num_write":451,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"263'194","reported_seq":813,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:41.151749+0000","last_change":"2024-09-12T17:11:16.618040+0000","last_active":"2024-09-12T18:11:41.151749+0000","last_peered":"2024-09-12T18:11:41.151749+0000","last_clean":"2024-09-12T18:11:41.151749+0000","last_became_active":"2024-09-12T17:11:16.617657+0000","last_became_peered":"2024-09-12T17:11:16.617657+0000","last_unstale":"2024-09-12T18:11:41.151749+0000","last_undegraded":"2024-09-12T18:11:41.151749+0000","last_fullsized":"2024-09-12T18:11:41.151749+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:38:48.774645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2421940,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":499,"num_read_kb":26759,"num_write":947,"num_write_kb":25619,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,6],"acting":[2,3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"263'792","reported_seq":2412,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:48.687914+0000","last_change":"2024-09-12T17:10:44.510114+0000","last_active":"2024-09-12T18:09:48.687914+0000","last_peered":"2024-09-12T18:09:48.687914+0000","last_clean":"2024-09-12T18:09:48.687914+0000","last_became_active":"2024-09-12T17:10:44.509845+0000","last_became_peered":"2024-09-12T17:10:44.509845+0000","last_unstale":"2024-09-12T18:09:48.687914+0000","last_undegraded":"2024-09-12T18:09:48.687914+0000","last_fullsized":"2024-09-12T18:09:48.687914+0000","mapping_epoch":26,"log_start":"263'700","ondisk_log_start":"263'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":700,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:49:56.008647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3882,"num_read_kb":3524,"num_write":1030,"num_write_kb":369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"263'227","reported_seq":858,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:41.317883+0000","last_change":"2024-09-12T17:10:42.519992+0000","last_active":"2024-09-12T18:11:41.317883+0000","last_peered":"2024-09-12T18:11:41.317883+0000","last_clean":"2024-09-12T18:11:41.317883+0000","last_became_active":"2024-09-12T17:10:42.519560+0000","last_became_peered":"2024-09-12T17:10:42.519560+0000","last_unstale":"2024-09-12T18:11:41.317883+0000","last_undegraded":"2024-09-12T18:11:41.317883+0000","last_fullsized":"2024-09-12T18:11:41.317883+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:31:06.232228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436858,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":420,"num_read_kb":2141,"num_write":1026,"num_write_kb":23963,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,1],"acting":[0,3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"263'769","reported_seq":2442,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:19.853137+0000","last_change":"2024-09-12T17:10:44.512192+0000","last_active":"2024-09-12T18:09:19.853137+0000","last_peered":"2024-09-12T18:09:19.853137+0000","last_clean":"2024-09-12T18:09:19.853137+0000","last_became_active":"2024-09-12T17:10:44.511893+0000","last_became_peered":"2024-09-12T17:10:44.511893+0000","last_unstale":"2024-09-12T18:09:19.853137+0000","last_undegraded":"2024-09-12T18:09:19.853137+0000","last_fullsized":"2024-09-12T18:09:19.853137+0000","mapping_epoch":26,"log_start":"263'700","ondisk_log_start":"263'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":700,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:59:22.759342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":3826,"num_read_kb":3490,"num_write":982,"num_write_kb":336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"263'223","reported_seq":1068,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:41.363812+0000","last_change":"2024-09-12T17:10:42.524423+0000","last_active":"2024-09-12T18:11:41.363812+0000","last_peered":"2024-09-12T18:11:41.363812+0000","last_clean":"2024-09-12T18:11:41.363812+0000","last_became_active":"2024-09-12T17:10:42.524018+0000","last_became_peered":"2024-09-12T17:10:42.524018+0000","last_unstale":"2024-09-12T18:11:41.363812+0000","last_undegraded":"2024-09-12T18:11:41.363812+0000","last_fullsized":"2024-09-12T18:11:41.363812+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":200,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:08:56.591768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6860809,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1298,"num_read_kb":150766,"num_write":988,"num_write_kb":42134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0,7],"acting":[3,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"263'524","reported_seq":2019,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:04.854464+0000","last_change":"2024-09-12T17:10:44.509706+0000","last_active":"2024-09-12T18:09:04.854464+0000","last_peered":"2024-09-12T18:09:04.854464+0000","last_clean":"2024-09-12T18:09:04.854464+0000","last_became_active":"2024-09-12T17:10:44.509433+0000","last_became_peered":"2024-09-12T17:10:44.509433+0000","last_unstale":"2024-09-12T18:09:04.854464+0000","last_undegraded":"2024-09-12T18:09:04.854464+0000","last_fullsized":"2024-09-12T18:09:04.854464+0000","mapping_epoch":26,"log_start":"263'500","ondisk_log_start":"263'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":500,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:43:58.521596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2637,"num_read_kb":2409,"num_write":664,"num_write_kb":195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"263'180","reported_seq":840,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:41.320515+0000","last_change":"2024-09-12T17:10:42.515059+0000","last_active":"2024-09-12T18:11:41.320515+0000","last_peered":"2024-09-12T18:11:41.320515+0000","last_clean":"2024-09-12T18:11:41.320515+0000","last_became_active":"2024-09-12T17:10:42.514593+0000","last_became_peered":"2024-09-12T17:10:42.514593+0000","last_unstale":"2024-09-12T18:11:41.320515+0000","last_undegraded":"2024-09-12T18:11:41.320515+0000","last_fullsized":"2024-09-12T18:11:41.320515+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:42:35.824857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262186,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":484,"num_read_kb":20980,"num_write":843,"num_write_kb":34024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,5],"acting":[1,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"263'1124","reported_seq":2692,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:08.688159+0000","last_change":"2024-09-12T17:10:44.523190+0000","last_active":"2024-09-12T18:11:08.688159+0000","last_peered":"2024-09-12T18:11:08.688159+0000","last_clean":"2024-09-12T18:11:08.688159+0000","last_became_active":"2024-09-12T17:10:44.522911+0000","last_became_peered":"2024-09-12T17:10:44.522911+0000","last_unstale":"2024-09-12T18:11:08.688159+0000","last_undegraded":"2024-09-12T18:11:08.688159+0000","last_fullsized":"2024-09-12T18:11:08.688159+0000","mapping_epoch":26,"log_start":"263'1100","ondisk_log_start":"263'1100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":1100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:09:01.732616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5182,"num_read_kb":4601,"num_write":1539,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"263'194","reported_seq":840,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:41.170961+0000","last_change":"2024-09-12T17:10:42.525103+0000","last_active":"2024-09-12T18:11:41.170961+0000","last_peered":"2024-09-12T18:11:41.170961+0000","last_clean":"2024-09-12T18:11:41.170961+0000","last_became_active":"2024-09-12T17:10:42.520304+0000","last_became_peered":"2024-09-12T17:10:42.520304+0000","last_unstale":"2024-09-12T18:11:41.170961+0000","last_undegraded":"2024-09-12T18:11:41.170961+0000","last_fullsized":"2024-09-12T18:11:41.170961+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:45:02.245757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1342049,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":493,"num_read_kb":8074,"num_write":952,"num_write_kb":20454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4,5],"acting":[6,7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"263'882","reported_seq":2582,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:04.874441+0000","last_change":"2024-09-12T17:10:44.518118+0000","last_active":"2024-09-12T18:09:04.874441+0000","last_peered":"2024-09-12T18:09:04.874441+0000","last_clean":"2024-09-12T18:09:04.874441+0000","last_became_active":"2024-09-12T17:10:44.517530+0000","last_became_peered":"2024-09-12T17:10:44.517530+0000","last_unstale":"2024-09-12T18:09:04.874441+0000","last_undegraded":"2024-09-12T18:09:04.874441+0000","last_fullsized":"2024-09-12T18:09:04.874441+0000","mapping_epoch":26,"log_start":"263'800","ondisk_log_start":"263'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":800,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:43:44.156580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4395,"num_read_kb":3967,"num_write":1219,"num_write_kb":499,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"263'187","reported_seq":808,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:41.255341+0000","last_change":"2024-09-12T17:10:42.529286+0000","last_active":"2024-09-12T18:11:41.255341+0000","last_peered":"2024-09-12T18:11:41.255341+0000","last_clean":"2024-09-12T18:11:41.255341+0000","last_became_active":"2024-09-12T17:10:42.528899+0000","last_became_peered":"2024-09-12T17:10:42.528899+0000","last_unstale":"2024-09-12T18:11:41.255341+0000","last_undegraded":"2024-09-12T18:11:41.255341+0000","last_fullsized":"2024-09-12T18:11:41.255341+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:26:02.984559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7371399,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":389,"num_read_kb":42419,"num_write":869,"num_write_kb":46548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,5],"acting":[3,4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"263'385","reported_seq":1841,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:49.548319+0000","last_change":"2024-09-12T17:10:44.523470+0000","last_active":"2024-09-12T18:09:49.548319+0000","last_peered":"2024-09-12T18:09:49.548319+0000","last_clean":"2024-09-12T18:09:49.548319+0000","last_became_active":"2024-09-12T17:10:44.523173+0000","last_became_peered":"2024-09-12T17:10:44.523173+0000","last_unstale":"2024-09-12T18:09:49.548319+0000","last_undegraded":"2024-09-12T18:09:49.548319+0000","last_fullsized":"2024-09-12T18:09:49.548319+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":300,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:42:05.823212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2006,"num_read_kb":1913,"num_write":441,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"263'150","reported_seq":844,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:41.223681+0000","last_change":"2024-09-12T17:10:42.522274+0000","last_active":"2024-09-12T18:11:41.223681+0000","last_peered":"2024-09-12T18:11:41.223681+0000","last_clean":"2024-09-12T18:11:41.223681+0000","last_became_active":"2024-09-12T17:10:42.521824+0000","last_became_peered":"2024-09-12T17:10:42.521824+0000","last_unstale":"2024-09-12T18:11:41.223681+0000","last_undegraded":"2024-09-12T18:11:41.223681+0000","last_fullsized":"2024-09-12T18:11:41.223681+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:16:48.589688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":605,"num_read_kb":135941,"num_write":774,"num_write_kb":15017,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"263'497","reported_seq":2137,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:04.854605+0000","last_change":"2024-09-12T17:10:44.517504+0000","last_active":"2024-09-12T18:09:04.854605+0000","last_peered":"2024-09-12T18:09:04.854605+0000","last_clean":"2024-09-12T18:09:04.854605+0000","last_became_active":"2024-09-12T17:10:44.517175+0000","last_became_peered":"2024-09-12T17:10:44.517175+0000","last_unstale":"2024-09-12T18:09:04.854605+0000","last_undegraded":"2024-09-12T18:09:04.854605+0000","last_fullsized":"2024-09-12T18:09:04.854605+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":400,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:08:58.263083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2646,"num_read_kb":2487,"num_write":582,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"263'171","reported_seq":785,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:14.852332+0000","last_change":"2024-09-12T17:10:42.525302+0000","last_active":"2024-09-12T18:09:14.852332+0000","last_peered":"2024-09-12T18:09:14.852332+0000","last_clean":"2024-09-12T18:09:14.852332+0000","last_became_active":"2024-09-12T17:10:42.524860+0000","last_became_peered":"2024-09-12T17:10:42.524860+0000","last_unstale":"2024-09-12T18:09:14.852332+0000","last_undegraded":"2024-09-12T18:09:14.852332+0000","last_fullsized":"2024-09-12T18:09:14.852332+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":100,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:46:29.731094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":409,"num_read_kb":436,"num_write":844,"num_write_kb":16042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,1],"acting":[3,4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"263'738","reported_seq":2312,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:49.547357+0000","last_change":"2024-09-12T17:10:44.515129+0000","last_active":"2024-09-12T18:09:49.547357+0000","last_peered":"2024-09-12T18:09:49.547357+0000","last_clean":"2024-09-12T18:09:49.547357+0000","last_became_active":"2024-09-12T17:10:44.514847+0000","last_became_peered":"2024-09-12T17:10:44.514847+0000","last_unstale":"2024-09-12T18:09:49.547357+0000","last_undegraded":"2024-09-12T18:09:49.547357+0000","last_fullsized":"2024-09-12T18:09:49.547357+0000","mapping_epoch":26,"log_start":"263'700","ondisk_log_start":"263'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":700,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:19:38.676107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3592,"num_read_kb":3279,"num_write":969,"num_write_kb":334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"263'232","reported_seq":889,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:41.338579+0000","last_change":"2024-09-12T17:10:42.520188+0000","last_active":"2024-09-12T18:11:41.338579+0000","last_peered":"2024-09-12T18:11:41.338579+0000","last_clean":"2024-09-12T18:11:41.338579+0000","last_became_active":"2024-09-12T17:10:42.519789+0000","last_became_peered":"2024-09-12T17:10:42.519789+0000","last_unstale":"2024-09-12T18:11:41.338579+0000","last_undegraded":"2024-09-12T18:11:41.338579+0000","last_fullsized":"2024-09-12T18:11:41.338579+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":200,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:18:08.752971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079985,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":565,"num_read_kb":21140,"num_write":1106,"num_write_kb":33501,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,3],"acting":[5,7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"263'451","reported_seq":1945,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:49.546842+0000","last_change":"2024-09-12T17:10:44.512379+0000","last_active":"2024-09-12T18:09:49.546842+0000","last_peered":"2024-09-12T18:09:49.546842+0000","last_clean":"2024-09-12T18:09:49.546842+0000","last_became_active":"2024-09-12T17:10:44.510280+0000","last_became_peered":"2024-09-12T17:10:44.510280+0000","last_unstale":"2024-09-12T18:09:49.546842+0000","last_undegraded":"2024-09-12T18:09:49.546842+0000","last_fullsized":"2024-09-12T18:09:49.546842+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":400,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:12:26.413167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2351,"num_read_kb":2195,"num_write":554,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"263'151","reported_seq":749,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:41.248031+0000","last_change":"2024-09-12T17:10:42.521419+0000","last_active":"2024-09-12T18:11:41.248031+0000","last_peered":"2024-09-12T18:11:41.248031+0000","last_clean":"2024-09-12T18:11:41.248031+0000","last_became_active":"2024-09-12T17:10:42.520020+0000","last_became_peered":"2024-09-12T17:10:42.520020+0000","last_unstale":"2024-09-12T18:11:41.248031+0000","last_undegraded":"2024-09-12T18:11:41.248031+0000","last_fullsized":"2024-09-12T18:11:41.248031+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:41:55.197067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399173,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":329,"num_read_kb":1191,"num_write":748,"num_write_kb":23442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,6],"acting":[0,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"263'357","reported_seq":1770,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:49.547933+0000","last_change":"2024-09-12T17:10:44.516984+0000","last_active":"2024-09-12T18:09:49.547933+0000","last_peered":"2024-09-12T18:09:49.547933+0000","last_clean":"2024-09-12T18:09:49.547933+0000","last_became_active":"2024-09-12T17:10:44.516697+0000","last_became_peered":"2024-09-12T17:10:44.516697+0000","last_unstale":"2024-09-12T18:09:49.547933+0000","last_undegraded":"2024-09-12T18:09:49.547933+0000","last_fullsized":"2024-09-12T18:09:49.547933+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:36:09.173783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1919,"num_read_kb":1833,"num_write":391,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"263'209","reported_seq":869,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:41.082305+0000","last_change":"2024-09-12T17:11:16.863226+0000","last_active":"2024-09-12T18:11:41.082305+0000","last_peered":"2024-09-12T18:11:41.082305+0000","last_clean":"2024-09-12T18:11:41.082305+0000","last_became_active":"2024-09-12T17:11:16.862645+0000","last_became_peered":"2024-09-12T17:11:16.862645+0000","last_unstale":"2024-09-12T18:11:41.082305+0000","last_undegraded":"2024-09-12T18:11:41.082305+0000","last_fullsized":"2024-09-12T18:11:41.082305+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:47:44.135027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38716,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":577,"num_read_kb":84325,"num_write":975,"num_write_kb":27874,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,0,7],"acting":[2,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"263'818","reported_seq":2282,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:14.844433+0000","last_change":"2024-09-12T17:10:44.519568+0000","last_active":"2024-09-12T18:09:14.844433+0000","last_peered":"2024-09-12T18:09:14.844433+0000","last_clean":"2024-09-12T18:09:14.844433+0000","last_became_active":"2024-09-12T17:10:44.519253+0000","last_became_peered":"2024-09-12T17:10:44.519253+0000","last_unstale":"2024-09-12T18:09:14.844433+0000","last_undegraded":"2024-09-12T18:09:14.844433+0000","last_fullsized":"2024-09-12T18:09:14.844433+0000","mapping_epoch":26,"log_start":"263'800","ondisk_log_start":"263'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":800,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:17:25.711902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3866,"num_read_kb":3440,"num_write":1124,"num_write_kb":450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"263'183","reported_seq":791,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:41.240551+0000","last_change":"2024-09-12T17:10:42.524574+0000","last_active":"2024-09-12T18:11:41.240551+0000","last_peered":"2024-09-12T18:11:41.240551+0000","last_clean":"2024-09-12T18:11:41.240551+0000","last_became_active":"2024-09-12T17:10:42.524098+0000","last_became_peered":"2024-09-12T17:10:42.524098+0000","last_unstale":"2024-09-12T18:11:41.240551+0000","last_undegraded":"2024-09-12T18:11:41.240551+0000","last_fullsized":"2024-09-12T18:11:41.240551+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:13:35.032725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":371,"num_read_kb":5543,"num_write":831,"num_write_kb":19602,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6,3],"acting":[7,2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"263'416","reported_seq":2003,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:20.794247+0000","last_change":"2024-09-12T17:10:44.515468+0000","last_active":"2024-09-12T18:09:20.794247+0000","last_peered":"2024-09-12T18:09:20.794247+0000","last_clean":"2024-09-12T18:09:20.794247+0000","last_became_active":"2024-09-12T17:10:44.514154+0000","last_became_peered":"2024-09-12T17:10:44.514154+0000","last_unstale":"2024-09-12T18:09:20.794247+0000","last_undegraded":"2024-09-12T18:09:20.794247+0000","last_fullsized":"2024-09-12T18:09:20.794247+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":400,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:10:07.030810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2340,"num_read_kb":2233,"num_write":478,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"263'226","reported_seq":845,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:41.337835+0000","last_change":"2024-09-12T17:10:42.519764+0000","last_active":"2024-09-12T18:11:41.337835+0000","last_peered":"2024-09-12T18:11:41.337835+0000","last_clean":"2024-09-12T18:11:41.337835+0000","last_became_active":"2024-09-12T17:10:42.519316+0000","last_became_peered":"2024-09-12T17:10:42.519316+0000","last_unstale":"2024-09-12T18:11:41.337835+0000","last_undegraded":"2024-09-12T18:11:41.337835+0000","last_fullsized":"2024-09-12T18:11:41.337835+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:10:02.857764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470224,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":508,"num_read_kb":7212,"num_write":965,"num_write_kb":24573,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1,7],"acting":[2,6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"263'434","reported_seq":2034,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:08.687986+0000","last_change":"2024-09-12T17:10:44.513885+0000","last_active":"2024-09-12T18:11:08.687986+0000","last_peered":"2024-09-12T18:11:08.687986+0000","last_clean":"2024-09-12T18:11:08.687986+0000","last_became_active":"2024-09-12T17:10:44.513514+0000","last_became_peered":"2024-09-12T17:10:44.513514+0000","last_unstale":"2024-09-12T18:11:08.687986+0000","last_undegraded":"2024-09-12T18:11:08.687986+0000","last_fullsized":"2024-09-12T18:11:08.687986+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":400,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:13:21.567231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2337,"num_read_kb":2234,"num_write":490,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"263'146","reported_seq":762,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:41.123138+0000","last_change":"2024-09-12T17:10:42.527461+0000","last_active":"2024-09-12T18:11:41.123138+0000","last_peered":"2024-09-12T18:11:41.123138+0000","last_clean":"2024-09-12T18:11:41.123138+0000","last_became_active":"2024-09-12T17:10:42.527050+0000","last_became_peered":"2024-09-12T17:10:42.527050+0000","last_unstale":"2024-09-12T18:11:41.123138+0000","last_undegraded":"2024-09-12T18:11:41.123138+0000","last_fullsized":"2024-09-12T18:11:41.123138+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:48:18.827396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079896,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":321,"num_read_kb":34406,"num_write":732,"num_write_kb":29438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4,6],"acting":[5,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"263'196","reported_seq":833,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:41.194558+0000","last_change":"2024-09-12T17:10:42.524416+0000","last_active":"2024-09-12T18:11:41.194558+0000","last_peered":"2024-09-12T18:11:41.194558+0000","last_clean":"2024-09-12T18:11:41.194558+0000","last_became_active":"2024-09-12T17:10:42.523311+0000","last_became_peered":"2024-09-12T17:10:42.523311+0000","last_unstale":"2024-09-12T18:11:41.194558+0000","last_undegraded":"2024-09-12T18:11:41.194558+0000","last_fullsized":"2024-09-12T18:11:41.194558+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:26:51.477607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":468,"num_read_kb":32297,"num_write":957,"num_write_kb":18657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,7],"acting":[5,1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"263'821","reported_seq":2264,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:20.794810+0000","last_change":"2024-09-12T17:10:44.523554+0000","last_active":"2024-09-12T18:09:20.794810+0000","last_peered":"2024-09-12T18:09:20.794810+0000","last_clean":"2024-09-12T18:09:20.794810+0000","last_became_active":"2024-09-12T17:10:44.523243+0000","last_became_peered":"2024-09-12T17:10:44.523243+0000","last_unstale":"2024-09-12T18:09:20.794810+0000","last_undegraded":"2024-09-12T18:09:20.794810+0000","last_fullsized":"2024-09-12T18:09:20.794810+0000","mapping_epoch":26,"log_start":"263'800","ondisk_log_start":"263'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":800,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:20:39.715953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3977,"num_read_kb":3544,"num_write":1118,"num_write_kb":432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"263'239","reported_seq":884,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:41.292118+0000","last_change":"2024-09-12T17:10:42.520724+0000","last_active":"2024-09-12T18:11:41.292118+0000","last_peered":"2024-09-12T18:11:41.292118+0000","last_clean":"2024-09-12T18:11:41.292118+0000","last_became_active":"2024-09-12T17:10:42.519643+0000","last_became_peered":"2024-09-12T17:10:42.519643+0000","last_unstale":"2024-09-12T18:11:41.292118+0000","last_undegraded":"2024-09-12T18:11:41.292118+0000","last_fullsized":"2024-09-12T18:11:41.292118+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":200,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:32:38.227259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079919,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":418,"num_read_kb":42701,"num_write":983,"num_write_kb":42419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5,0],"acting":[1,4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"263'612","reported_seq":2303,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:49.548577+0000","last_change":"2024-09-12T17:10:44.512927+0000","last_active":"2024-09-12T18:09:49.548577+0000","last_peered":"2024-09-12T18:09:49.548577+0000","last_clean":"2024-09-12T18:09:49.548577+0000","last_became_active":"2024-09-12T17:10:44.512488+0000","last_became_peered":"2024-09-12T17:10:44.512488+0000","last_unstale":"2024-09-12T18:09:49.548577+0000","last_undegraded":"2024-09-12T18:09:49.548577+0000","last_fullsized":"2024-09-12T18:09:49.548577+0000","mapping_epoch":26,"log_start":"263'600","ondisk_log_start":"263'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":600,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:26:47.580747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3240,"num_read_kb":2966,"num_write":800,"num_write_kb":244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6085,"num_read_kb":4263,"num_write":1964,"num_write_kb":863,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1035,"ondisk_log_size":1035,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15869,"num_objects":86,"num_object_clones":0,"num_object_copies":172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":86,"num_whiteouts":0,"num_read":16199,"num_read_kb":15883,"num_write":16708,"num_write_kb":4876,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":31738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1652,"ondisk_log_size":1652,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":570,"ondisk_log_size":570,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":271969,"num_objects":199,"num_object_clones":0,"num_object_copies":398,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":199,"num_whiteouts":0,"num_read":8822,"num_read_kb":10790,"num_write":6053,"num_write_kb":2795,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1753,"ondisk_log_size":1753,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2393,"num_read_kb":2857,"num_write":20,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":165,"num_object_clones":0,"num_object_copies":330,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":165,"num_whiteouts":0,"num_read":212965,"num_read_kb":194286,"num_write":55441,"num_write_kb":18926,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":165,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4199,"ondisk_log_size":4199,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":74416905,"num_objects":230,"num_object_clones":0,"num_object_copies":920,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":230,"num_whiteouts":0,"num_read":33088,"num_read_kb":2020320,"num_write":62843,"num_write_kb":2063190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":101629952,"data_stored":101629952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3869,"ondisk_log_size":3869,"up":256,"acting":256,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":141,"num_read_kb":196715,"num_write":158,"num_write_kb":127071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":137,"num_read_kb":189543,"num_write":158,"num_write_kb":127071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575590,"num_pgs":116,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":261456,"kb_used_data":17772,"kb_used_omap":1,"kb_used_meta":243582,"kb_avail":94110384,"statfs":{"total":96636764160,"available":96369033216,"internally_reserved":0,"allocated":18198528,"data_stored":16210424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":249428427},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575588,"num_pgs":107,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":273192,"kb_used_data":17080,"kb_used_omap":1,"kb_used_meta":256062,"kb_avail":94098648,"statfs":{"total":96636764160,"available":96357015552,"internally_reserved":0,"allocated":17489920,"data_stored":15541198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":262207942},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,3],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575593,"num_pgs":113,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":120288,"kb_used_data":12676,"kb_used_omap":1,"kb_used_meta":107518,"kb_avail":94251552,"statfs":{"total":96636764160,"available":96513589248,"internally_reserved":0,"allocated":12980224,"data_stored":10947706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":110098885},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575588,"num_pgs":113,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":133180,"kb_used_data":21468,"kb_used_omap":1,"kb_used_meta":111678,"kb_avail":94238660,"statfs":{"total":96636764160,"available":96500387840,"internally_reserved":0,"allocated":21983232,"data_stored":20058842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":114358725},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575590,"num_pgs":130,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":244368,"kb_used_data":18748,"kb_used_omap":1,"kb_used_meta":225534,"kb_avail":94127472,"statfs":{"total":96636764160,"available":96386531328,"internally_reserved":0,"allocated":19197952,"data_stored":17229442,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":230947271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575590,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":102972,"kb_used_data":13464,"kb_used_omap":1,"kb_used_meta":89470,"kb_avail":94268868,"statfs":{"total":96636764160,"available":96531320832,"internally_reserved":0,"allocated":13787136,"data_stored":11862866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":91617733},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575588,"num_pgs":120,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":168052,"kb_used_data":16116,"kb_used_omap":1,"kb_used_meta":151870,"kb_avail":94203788,"statfs":{"total":96636764160,"available":96464678912,"internally_reserved":0,"allocated":16502784,"data_stored":14528294,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":155515333},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575588,"num_pgs":116,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":254204,"kb_used_data":16124,"kb_used_omap":1,"kb_used_meta":238014,"kb_avail":94117636,"statfs":{"total":96636764160,"available":96376459264,"internally_reserved":0,"allocated":16510976,"data_stored":14534914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":243726789},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":11681792,"data_stored":11681792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12263424,"data_stored":12263424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":9601024,"data_stored":9601024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":14966784,"data_stored":14966784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":17797120,"data_stored":17797120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8683520,"data_stored":8683520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":13279232,"data_stored":13279232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":13357056,"data_stored":13357056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":4345,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":5119,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":3919,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":4996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3623,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":3527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T18:11:48.200 INFO:tasks.ceph:pgid 68.1a last_scrub_stamp 2024-09-12T17:46:56.058809+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.200 INFO:tasks.ceph:pgid 67.1d last_scrub_stamp 2024-09-12T17:30:15.649995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.200 INFO:tasks.ceph:pgid 66.1c last_scrub_stamp 2024-09-12T17:30:11.622113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.200 INFO:tasks.ceph:pgid 65.1f last_scrub_stamp 2024-09-12T17:26:34.641203+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=26, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.200 INFO:tasks.ceph:pgid 68.1b last_scrub_stamp 2024-09-12T17:46:56.058809+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.200 INFO:tasks.ceph:pgid 67.1c last_scrub_stamp 2024-09-12T17:30:15.649995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.200 INFO:tasks.ceph:pgid 66.1d last_scrub_stamp 2024-09-12T17:30:11.622113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.200 INFO:tasks.ceph:pgid 65.1e last_scrub_stamp 2024-09-12T17:26:34.641203+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=26, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.201 INFO:tasks.ceph:pgid 68.18 last_scrub_stamp 2024-09-12T17:46:56.058809+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.201 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-09-12T17:30:15.649995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.201 INFO:tasks.ceph:pgid 66.1e last_scrub_stamp 2024-09-12T17:30:11.622113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.201 INFO:tasks.ceph:pgid 65.1d last_scrub_stamp 2024-09-12T17:26:34.641203+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=26, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.201 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-09-12T17:46:56.058809+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.201 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-09-12T17:30:15.649995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.201 INFO:tasks.ceph:pgid 66.1f last_scrub_stamp 2024-09-12T17:30:11.622113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.201 INFO:tasks.ceph:pgid 65.1c last_scrub_stamp 2024-09-12T17:26:34.641203+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=26, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.202 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-09-12T17:46:56.058809+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.202 INFO:tasks.ceph:pgid 67.19 last_scrub_stamp 2024-09-12T17:30:15.649995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.202 INFO:tasks.ceph:pgid 66.18 last_scrub_stamp 2024-09-12T17:30:11.622113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.202 INFO:tasks.ceph:pgid 65.1b last_scrub_stamp 2024-09-12T17:26:34.641203+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=26, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.202 INFO:tasks.ceph:pgid 68.1f last_scrub_stamp 2024-09-12T17:46:56.058809+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.202 INFO:tasks.ceph:pgid 67.18 last_scrub_stamp 2024-09-12T17:30:15.649995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.202 INFO:tasks.ceph:pgid 66.19 last_scrub_stamp 2024-09-12T17:30:11.622113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.202 INFO:tasks.ceph:pgid 65.1a last_scrub_stamp 2024-09-12T17:26:34.641203+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=26, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.202 INFO:tasks.ceph:pgid 68.1c last_scrub_stamp 2024-09-12T17:46:56.058809+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.203 INFO:tasks.ceph:pgid 67.1b last_scrub_stamp 2024-09-12T17:30:15.649995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.203 INFO:tasks.ceph:pgid 66.1a last_scrub_stamp 2024-09-12T17:30:11.622113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.203 INFO:tasks.ceph:pgid 65.19 last_scrub_stamp 2024-09-12T17:26:34.641203+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=26, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.203 INFO:tasks.ceph:pgid 68.1d last_scrub_stamp 2024-09-12T17:46:56.058809+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.203 INFO:tasks.ceph:pgid 67.1a last_scrub_stamp 2024-09-12T17:30:15.649995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.203 INFO:tasks.ceph:pgid 66.1b last_scrub_stamp 2024-09-12T17:30:11.622113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.203 INFO:tasks.ceph:pgid 65.18 last_scrub_stamp 2024-09-12T17:26:34.641203+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=26, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.203 INFO:tasks.ceph:pgid 68.12 last_scrub_stamp 2024-09-12T17:46:56.058809+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.203 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-09-12T17:30:15.649995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.204 INFO:tasks.ceph:pgid 66.14 last_scrub_stamp 2024-09-12T17:30:11.622113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.204 INFO:tasks.ceph:pgid 65.17 last_scrub_stamp 2024-09-12T17:26:34.641203+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=26, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.204 INFO:tasks.ceph:pgid 68.13 last_scrub_stamp 2024-09-12T17:46:56.058809+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.204 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-09-12T17:30:15.649995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.204 INFO:tasks.ceph:pgid 66.15 last_scrub_stamp 2024-09-12T17:30:11.622113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.204 INFO:tasks.ceph:pgid 65.16 last_scrub_stamp 2024-09-12T17:26:34.641203+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=26, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.204 INFO:tasks.ceph:pgid 68.10 last_scrub_stamp 2024-09-12T17:46:56.058809+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.204 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-09-12T17:30:15.649995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.204 INFO:tasks.ceph:pgid 66.16 last_scrub_stamp 2024-09-12T17:30:11.622113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.205 INFO:tasks.ceph:pgid 65.15 last_scrub_stamp 2024-09-12T17:26:34.641203+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=26, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.205 INFO:tasks.ceph:pgid 68.11 last_scrub_stamp 2024-09-12T17:46:56.058809+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.205 INFO:tasks.ceph:pgid 67.16 last_scrub_stamp 2024-09-12T17:30:15.649995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.205 INFO:tasks.ceph:pgid 66.17 last_scrub_stamp 2024-09-12T17:30:11.622113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.205 INFO:tasks.ceph:pgid 65.14 last_scrub_stamp 2024-09-12T17:26:34.641203+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=26, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.205 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-09-12T17:46:56.058809+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.205 INFO:tasks.ceph:pgid 67.11 last_scrub_stamp 2024-09-12T17:30:15.649995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.205 INFO:tasks.ceph:pgid 66.10 last_scrub_stamp 2024-09-12T17:30:11.622113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.205 INFO:tasks.ceph:pgid 65.13 last_scrub_stamp 2024-09-12T17:26:34.641203+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=26, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.206 INFO:tasks.ceph:pgid 68.17 last_scrub_stamp 2024-09-12T17:46:56.058809+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.206 INFO:tasks.ceph:pgid 67.10 last_scrub_stamp 2024-09-12T17:30:15.649995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.206 INFO:tasks.ceph:pgid 66.11 last_scrub_stamp 2024-09-12T17:30:11.622113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.206 INFO:tasks.ceph:pgid 65.12 last_scrub_stamp 2024-09-12T17:26:34.641203+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=26, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.206 INFO:tasks.ceph:pgid 68.14 last_scrub_stamp 2024-09-12T17:46:56.058809+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.206 INFO:tasks.ceph:pgid 67.13 last_scrub_stamp 2024-09-12T17:30:15.649995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.206 INFO:tasks.ceph:pgid 66.12 last_scrub_stamp 2024-09-12T17:30:11.622113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.206 INFO:tasks.ceph:pgid 65.11 last_scrub_stamp 2024-09-12T17:26:34.641203+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=26, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.206 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-09-12T17:46:56.058809+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.207 INFO:tasks.ceph:pgid 67.12 last_scrub_stamp 2024-09-12T17:30:15.649995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.207 INFO:tasks.ceph:pgid 66.13 last_scrub_stamp 2024-09-12T17:30:11.622113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.207 INFO:tasks.ceph:pgid 65.10 last_scrub_stamp 2024-09-12T17:26:34.641203+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=26, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.207 INFO:tasks.ceph:pgid 68.a last_scrub_stamp 2024-09-12T17:46:56.058809+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.207 INFO:tasks.ceph:pgid 67.d last_scrub_stamp 2024-09-12T17:30:15.649995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.207 INFO:tasks.ceph:pgid 66.c last_scrub_stamp 2024-09-12T17:30:11.622113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.207 INFO:tasks.ceph:pgid 65.f last_scrub_stamp 2024-09-12T17:26:34.641203+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=26, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.207 INFO:tasks.ceph:pgid 68.b last_scrub_stamp 2024-09-12T17:46:56.058809+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.207 INFO:tasks.ceph:pgid 67.c last_scrub_stamp 2024-09-12T17:30:15.649995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.208 INFO:tasks.ceph:pgid 66.d last_scrub_stamp 2024-09-12T17:30:11.622113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.208 INFO:tasks.ceph:pgid 65.e last_scrub_stamp 2024-09-12T17:26:34.641203+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=26, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.208 INFO:tasks.ceph:pgid 68.8 last_scrub_stamp 2024-09-12T17:46:56.058809+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.208 INFO:tasks.ceph:pgid 67.f last_scrub_stamp 2024-09-12T17:30:15.649995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.208 INFO:tasks.ceph:pgid 66.e last_scrub_stamp 2024-09-12T17:30:11.622113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.208 INFO:tasks.ceph:pgid 65.d last_scrub_stamp 2024-09-12T17:26:34.641203+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=26, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.208 INFO:tasks.ceph:pgid 68.9 last_scrub_stamp 2024-09-12T17:46:56.058809+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.208 INFO:tasks.ceph:pgid 67.e last_scrub_stamp 2024-09-12T17:30:15.649995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.209 INFO:tasks.ceph:pgid 66.f last_scrub_stamp 2024-09-12T17:30:11.622113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.209 INFO:tasks.ceph:pgid 65.c last_scrub_stamp 2024-09-12T17:26:34.641203+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=26, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.209 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-09-12T17:46:56.058809+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.209 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-09-12T17:30:15.649995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.209 INFO:tasks.ceph:pgid 66.8 last_scrub_stamp 2024-09-12T17:30:11.622113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.209 INFO:tasks.ceph:pgid 65.b last_scrub_stamp 2024-09-12T17:26:34.641203+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=26, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.209 INFO:tasks.ceph:pgid 68.f last_scrub_stamp 2024-09-12T17:46:56.058809+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.209 INFO:tasks.ceph:pgid 67.8 last_scrub_stamp 2024-09-12T17:30:15.649995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.209 INFO:tasks.ceph:pgid 66.9 last_scrub_stamp 2024-09-12T17:30:11.622113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.210 INFO:tasks.ceph:pgid 65.a last_scrub_stamp 2024-09-12T17:26:34.641203+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=26, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.210 INFO:tasks.ceph:pgid 68.c last_scrub_stamp 2024-09-12T17:46:56.058809+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.210 INFO:tasks.ceph:pgid 67.b last_scrub_stamp 2024-09-12T17:30:15.649995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.210 INFO:tasks.ceph:pgid 66.a last_scrub_stamp 2024-09-12T17:30:11.622113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.210 INFO:tasks.ceph:pgid 65.9 last_scrub_stamp 2024-09-12T17:26:34.641203+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=26, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.210 INFO:tasks.ceph:pgid 68.d last_scrub_stamp 2024-09-12T17:46:56.058809+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.210 INFO:tasks.ceph:pgid 67.a last_scrub_stamp 2024-09-12T17:30:15.649995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.210 INFO:tasks.ceph:pgid 66.b last_scrub_stamp 2024-09-12T17:30:11.622113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.210 INFO:tasks.ceph:pgid 65.8 last_scrub_stamp 2024-09-12T17:26:34.641203+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=26, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.211 INFO:tasks.ceph:pgid 68.2 last_scrub_stamp 2024-09-12T17:46:56.058809+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.211 INFO:tasks.ceph:pgid 67.5 last_scrub_stamp 2024-09-12T17:30:15.649995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.211 INFO:tasks.ceph:pgid 66.4 last_scrub_stamp 2024-09-12T17:30:11.622113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.211 INFO:tasks.ceph:pgid 65.7 last_scrub_stamp 2024-09-12T17:26:34.641203+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=26, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.211 INFO:tasks.ceph:pgid 68.3 last_scrub_stamp 2024-09-12T17:46:56.058809+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.211 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-09-12T17:30:15.649995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.211 INFO:tasks.ceph:pgid 66.5 last_scrub_stamp 2024-09-12T17:30:11.622113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.211 INFO:tasks.ceph:pgid 65.6 last_scrub_stamp 2024-09-12T17:26:34.641203+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=26, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.212 INFO:tasks.ceph:pgid 68.0 last_scrub_stamp 2024-09-12T17:46:56.058809+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.212 INFO:tasks.ceph:pgid 67.7 last_scrub_stamp 2024-09-12T17:30:15.649995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.212 INFO:tasks.ceph:pgid 66.6 last_scrub_stamp 2024-09-12T17:30:11.622113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.212 INFO:tasks.ceph:pgid 65.5 last_scrub_stamp 2024-09-12T17:26:34.641203+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=26, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.212 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-09-12T17:46:56.058809+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.212 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-09-12T17:30:15.649995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.212 INFO:tasks.ceph:pgid 66.7 last_scrub_stamp 2024-09-12T17:30:11.622113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.212 INFO:tasks.ceph:pgid 65.4 last_scrub_stamp 2024-09-12T17:26:34.641203+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=26, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.212 INFO:tasks.ceph:pgid 68.6 last_scrub_stamp 2024-09-12T17:46:56.058809+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.213 INFO:tasks.ceph:pgid 67.1 last_scrub_stamp 2024-09-12T17:30:15.649995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.213 INFO:tasks.ceph:pgid 66.0 last_scrub_stamp 2024-09-12T17:30:11.622113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.213 INFO:tasks.ceph:pgid 65.3 last_scrub_stamp 2024-09-12T17:26:34.641203+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=26, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.213 INFO:tasks.ceph:pgid 68.7 last_scrub_stamp 2024-09-12T17:46:56.058809+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.213 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-09-12T17:30:15.649995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.213 INFO:tasks.ceph:pgid 66.1 last_scrub_stamp 2024-09-12T17:30:11.622113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.213 INFO:tasks.ceph:pgid 65.2 last_scrub_stamp 2024-09-12T17:26:34.641203+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=26, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.213 INFO:tasks.ceph:pgid 68.4 last_scrub_stamp 2024-09-12T17:46:56.058809+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.213 INFO:tasks.ceph:pgid 67.3 last_scrub_stamp 2024-09-12T17:30:15.649995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.214 INFO:tasks.ceph:pgid 66.2 last_scrub_stamp 2024-09-12T17:30:11.622113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.214 INFO:tasks.ceph:pgid 65.1 last_scrub_stamp 2024-09-12T17:26:34.641203+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=26, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.214 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-09-12T17:46:56.058809+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.214 INFO:tasks.ceph:pgid 67.2 last_scrub_stamp 2024-09-12T17:30:15.649995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.214 INFO:tasks.ceph:pgid 66.3 last_scrub_stamp 2024-09-12T17:30:11.622113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.214 INFO:tasks.ceph:pgid 65.0 last_scrub_stamp 2024-09-12T17:26:34.641203+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=26, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.214 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-09-12T17:10:41.475151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.214 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-09-12T17:10:43.487253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.214 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-09-12T17:10:41.475151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.215 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-12T17:10:43.487253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.215 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-12T17:10:41.475151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.215 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-12T17:10:43.487253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.215 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-09-12T17:10:41.475151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.215 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-09-12T17:10:43.487253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.215 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-12T17:10:41.475151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.215 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-09-12T17:10:43.487253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.215 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-09-12T17:10:41.475151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.215 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-12T17:10:43.487253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.216 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-12T17:10:41.475151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.216 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-09-12T17:10:43.487253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.216 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-09-12T17:10:41.475151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.216 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-09-12T17:10:43.487253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.216 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-12T17:10:43.487253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.216 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-09-12T17:10:41.475151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.216 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-09-12T17:10:43.487253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.216 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-09-12T17:10:41.475151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.216 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-09-12T17:10:43.487253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.217 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-09-12T17:10:41.475151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.217 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-09-12T17:10:43.487253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.217 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-09-12T17:10:41.475151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.217 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-09-12T17:10:43.487253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.217 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-09-12T17:10:41.475151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.217 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-09-12T17:10:43.487253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.217 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-09-12T17:10:41.475151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.217 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-12T17:10:51.549038+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.217 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-12T17:10:43.487253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.218 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-12T17:10:41.475151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.218 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-12T17:10:45.504515+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.218 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-12T17:10:47.516917+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.218 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-12T17:10:49.533772+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.218 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-12T17:10:51.549038+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.218 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-12T17:10:43.487253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.218 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-12T17:10:41.475151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.218 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-12T17:10:45.504515+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.218 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-09-12T17:10:47.516917+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.219 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-12T17:10:49.533772+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.219 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-12T17:10:51.549038+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.219 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-12T17:10:43.487253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.219 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-12T17:10:41.475151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.219 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-09-12T17:10:45.504515+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.219 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-09-12T17:10:47.516917+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.219 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-12T17:10:49.533772+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.219 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-12T17:10:51.549038+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.219 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-12T17:10:43.487253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.219 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-12T17:10:41.475151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.220 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-12T17:10:45.504515+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.220 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-09-12T17:10:47.516917+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.220 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-12T17:10:49.533772+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.220 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-12T17:10:43.487253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.220 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-12T17:10:41.475151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.220 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-09-12T17:10:45.504515+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.220 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-09-12T17:10:47.516917+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.220 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-09-12T17:10:49.533772+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.221 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-12T17:10:51.549038+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.221 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-09-12T17:10:43.487253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.221 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-12T17:10:41.475151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.221 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-09-12T17:10:45.504515+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.221 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-12T17:10:47.516917+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.221 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-12T17:10:49.533772+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.221 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-12T17:10:51.549038+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.221 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-09-12T17:10:43.487253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.221 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-12T17:10:41.475151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.221 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-09-12T17:10:45.504515+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.222 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-12T17:10:47.516917+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.222 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-09-12T17:10:49.533772+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.222 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-12T17:10:51.549038+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.222 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-09-12T17:10:43.487253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.222 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-12T17:10:41.475151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.222 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-09-12T17:10:45.504515+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.222 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-12T17:10:47.516917+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.222 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-09-12T17:10:49.533772+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.222 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-12T17:10:51.549038+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.223 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-09-12T17:10:43.487253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.223 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-12T17:10:41.475151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.223 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-09-12T17:10:45.504515+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.223 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-09-12T17:10:47.516917+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.223 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-12T17:10:49.533772+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.223 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-12T17:10:51.549038+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.223 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-12T17:10:43.487253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.223 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-12T17:10:41.475151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.224 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-09-12T17:10:45.504515+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.224 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-09-12T17:10:47.516917+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.224 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-09-12T17:10:49.533772+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.224 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-12T17:10:51.549038+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.224 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-09-12T17:10:43.487253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.224 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-12T17:10:41.475151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.224 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-09-12T17:10:45.504515+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.224 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-12T17:10:47.516917+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.224 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-09-12T17:10:49.533772+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.225 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-12T17:10:51.549038+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.225 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-09-12T17:10:43.487253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.225 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-12T17:10:41.475151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.225 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-12T17:10:45.504515+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.225 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-09-12T17:10:47.516917+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.225 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-09-12T17:10:49.533772+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.225 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-12T17:10:51.549038+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.225 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-09-12T17:10:43.487253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.225 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-12T17:10:25.795895+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.226 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-12T17:10:30.818274+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.226 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-12T17:10:41.475151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.226 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-09-12T17:10:45.504515+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.226 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-12T17:10:47.516917+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.226 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-12T17:10:49.533772+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.226 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-12T17:10:51.549038+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.226 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-09-12T17:10:43.487253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.226 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-12T17:10:30.818274+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.226 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-12T17:10:45.504515+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.227 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-09-12T17:10:47.516917+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.227 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-12T17:10:49.533772+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.227 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-12T17:10:51.549038+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.227 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-09-12T17:10:43.487253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.227 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-12T17:10:30.818274+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.227 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-12T17:10:41.475151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.227 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-09-12T17:10:45.504515+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.227 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-09-12T17:10:47.516917+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.227 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-09-12T17:10:49.533772+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.228 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-12T17:10:51.549038+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.228 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-09-12T17:10:43.487253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.228 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-12T17:10:30.818274+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.228 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-12T17:10:41.475151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.228 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-09-12T17:10:45.504515+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.228 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-12T17:10:47.516917+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.228 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-12T17:10:49.533772+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.228 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-12T17:10:51.549038+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.229 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-09-12T17:10:43.487253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.229 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-12T17:10:41.475151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.229 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-12T17:10:30.818274+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.229 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-09-12T17:10:45.504515+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.229 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-09-12T17:10:47.516917+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.229 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-09-12T17:10:49.533772+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.229 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-12T17:10:51.549038+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.229 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-09-12T17:10:43.487253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.229 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-12T17:10:41.475151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.230 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-12T17:10:30.818274+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.230 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-09-12T17:10:45.504515+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.230 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-09-12T17:10:47.516917+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.230 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-09-12T17:10:49.533772+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.230 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-12T17:10:51.549038+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.230 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-09-12T17:10:43.487253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.230 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-12T17:10:41.475151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.230 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-12T17:10:30.818274+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.230 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-12T17:10:45.504515+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.231 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-12T17:10:47.516917+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.231 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-12T17:10:49.533772+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.231 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-12T17:10:51.549038+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.231 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-09-12T17:10:43.487253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.231 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-09-12T17:10:41.475151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.231 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-12T17:10:30.818274+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=30, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.231 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-09-12T17:10:45.504515+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.231 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-09-12T17:10:47.516917+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.231 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-12T17:10:49.533772+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.232 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-12T17:10:51.549038+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.232 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-12T17:10:51.549038+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.232 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-09-12T17:10:43.487253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.232 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-12T17:10:41.475151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.232 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-09-12T17:10:45.504515+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.232 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-12T17:10:47.516917+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.232 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-12T17:10:49.533772+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.232 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-12T17:10:51.549038+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.232 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-09-12T17:10:43.487253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.233 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-12T17:10:41.475151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.233 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-09-12T17:10:45.504515+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.233 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-09-12T17:10:47.516917+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.233 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-09-12T17:10:49.533772+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.233 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-12T17:10:51.549038+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.233 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-12T17:10:43.487253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.233 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-12T17:10:41.475151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.233 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-09-12T17:10:45.504515+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.234 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-09-12T17:10:47.516917+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.234 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-09-12T17:10:49.533772+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.234 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-12T17:10:51.549038+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.234 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-12T17:10:43.487253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.234 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-12T17:10:41.475151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.234 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-09-12T17:10:45.504515+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.234 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-09-12T17:10:47.516917+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.234 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-09-12T17:10:49.533772+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.234 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-12T17:10:43.487253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.235 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-12T17:10:41.475151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.235 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-09-12T17:10:45.504515+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.235 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-09-12T17:10:47.516917+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.235 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-09-12T17:10:49.533772+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.235 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-12T17:10:51.549038+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.235 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-12T17:10:43.487253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.235 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-12T17:10:41.475151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.235 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-09-12T17:10:45.504515+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.235 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-12T17:10:47.516917+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.236 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-12T17:10:49.533772+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.236 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-12T17:10:51.549038+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.236 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-12T17:10:43.487253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.236 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-12T17:10:41.475151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.236 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-09-12T17:10:45.504515+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.236 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-09-12T17:10:47.516917+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.236 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-12T17:10:49.533772+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.236 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-12T17:10:51.549038+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.237 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-09-12T17:10:43.487253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.237 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-12T17:10:41.475151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.237 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-09-12T17:10:45.504515+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.237 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-12T17:10:47.516917+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.237 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-12T17:10:49.533772+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.237 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-12T17:10:51.549038+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.237 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-09-12T17:10:43.487253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.237 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-12T17:10:41.475151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.237 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-09-12T17:10:45.504515+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.238 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-09-12T17:10:47.516917+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.238 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-12T17:10:49.533772+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.238 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-12T17:10:51.549038+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.238 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-09-12T17:10:43.487253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.238 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-12T17:10:41.475151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.238 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-09-12T17:10:45.504515+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.238 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-09-12T17:10:47.516917+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.238 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-12T17:10:49.533772+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.238 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-12T17:10:51.549038+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.239 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-12T17:10:43.487253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.239 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-12T17:10:41.475151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.239 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-09-12T17:10:45.504515+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.239 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-12T17:10:47.516917+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.239 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-12T17:10:49.533772+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.239 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-12T17:10:51.549038+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.239 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-09-12T17:10:43.487253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.239 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-12T17:10:41.475151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.239 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-09-12T17:10:45.504515+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.240 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-12T17:10:47.516917+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.240 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-12T17:10:49.533772+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.240 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-12T17:10:51.549038+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.240 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-09-12T17:10:43.487253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.240 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-09-12T17:10:41.475151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.240 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-09-12T17:10:43.487253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.240 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-09-12T17:10:41.475151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.240 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-12T17:10:43.487253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.240 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-09-12T17:10:41.475151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.241 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-09-12T17:10:43.487253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.241 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-09-12T17:10:41.475151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.241 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-09-12T17:10:43.487253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.241 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-09-12T17:10:41.475151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.241 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-09-12T17:10:43.487253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.241 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-09-12T17:10:41.475151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.241 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-09-12T17:10:43.487253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.241 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-09-12T17:10:41.475151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.241 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-09-12T17:10:43.487253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.242 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-09-12T17:10:41.475151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.242 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-09-12T17:10:43.487253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.242 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-09-12T17:10:41.475151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.242 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-09-12T17:10:43.487253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.242 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-09-12T17:10:41.475151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.242 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-09-12T17:10:43.487253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.242 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-09-12T17:10:41.475151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.242 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-09-12T17:10:43.487253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.242 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-09-12T17:10:41.475151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.243 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-09-12T17:10:43.487253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.243 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-09-12T17:10:41.475151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.243 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-09-12T17:10:43.487253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.243 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-12T17:10:41.475151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.243 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-12T17:10:43.487253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.243 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-09-12T17:10:41.475151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.243 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-09-12T17:10:43.487253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.243 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-12T17:10:41.475151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.244 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-12T17:10:41.475151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.244 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-09-12T17:10:43.487253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.244 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-09-12T17:10:41.475151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.244 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-09-12T17:10:43.487253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:11:48.244 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T18:12:08.245 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T18:12:08.598 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T18:12:08.609 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-09-12T18:12:08.611 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":2107,"stamp":"2024-09-12T18:12:06.620088+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":75296923,"num_objects":706,"num_object_clones":0,"num_object_copies":1872,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":706,"num_whiteouts":0,"num_read":279908,"num_read_kb":2634724,"num_write":143466,"num_write_kb":2346447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":212,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":37502,"num_omap_keys":153,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13129,"ondisk_log_size":13129,"up":914,"acting":914,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":914,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1544840,"kb_used_data":133448,"kb_used_omap":12,"kb_used_meta":1411251,"kb_avail":753429880,"statfs":{"total":773094113280,"available":771512197120,"internally_reserved":0,"allocated":136650752,"data_stored":120913686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":1445121585},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":37502,"num_omap_keys":153,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005066"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:29.859011+0000","last_change":"2024-09-12T17:46:57.082723+0000","last_active":"2024-09-12T18:09:29.859011+0000","last_peered":"2024-09-12T18:09:29.859011+0000","last_clean":"2024-09-12T18:09:29.859011+0000","last_became_active":"2024-09-12T17:46:57.082400+0000","last_became_peered":"2024-09-12T17:46:57.082400+0000","last_unstale":"2024-09-12T18:09:29.859011+0000","last_undegraded":"2024-09-12T18:09:29.859011+0000","last_fullsized":"2024-09-12T18:09:29.859011+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"0'0","reported_seq":39,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:49.843582+0000","last_change":"2024-09-12T17:30:16.683362+0000","last_active":"2024-09-12T18:07:49.843582+0000","last_peered":"2024-09-12T18:07:49.843582+0000","last_clean":"2024-09-12T18:07:49.843582+0000","last_became_active":"2024-09-12T17:30:16.683077+0000","last_became_peered":"2024-09-12T17:30:16.683077+0000","last_unstale":"2024-09-12T18:07:49.843582+0000","last_undegraded":"2024-09-12T18:07:49.843582+0000","last_fullsized":"2024-09-12T18:07:49.843582+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:50:52.313225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"260'3","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:44.841978+0000","last_change":"2024-09-12T17:30:12.651734+0000","last_active":"2024-09-12T18:07:44.841978+0000","last_peered":"2024-09-12T18:07:44.841978+0000","last_clean":"2024-09-12T18:07:44.841978+0000","last_became_active":"2024-09-12T17:30:12.651461+0000","last_became_peered":"2024-09-12T17:30:12.651461+0000","last_unstale":"2024-09-12T18:07:44.841978+0000","last_undegraded":"2024-09-12T18:07:44.841978+0000","last_fullsized":"2024-09-12T18:07:44.841978+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:51:09.744341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"263'28","reported_seq":134,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:14.837079+0000","last_change":"2024-09-12T17:26:35.669600+0000","last_active":"2024-09-12T18:08:14.837079+0000","last_peered":"2024-09-12T18:08:14.837079+0000","last_clean":"2024-09-12T18:08:14.837079+0000","last_became_active":"2024-09-12T17:26:35.669154+0000","last_became_peered":"2024-09-12T17:26:35.669154+0000","last_unstale":"2024-09-12T18:08:14.837079+0000","last_undegraded":"2024-09-12T18:08:14.837079+0000","last_fullsized":"2024-09-12T18:08:14.837079+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:56:13.407121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":150,"num_read_kb":108,"num_write":46,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:29.840101+0000","last_change":"2024-09-12T17:46:57.096775+0000","last_active":"2024-09-12T18:09:29.840101+0000","last_peered":"2024-09-12T18:09:29.840101+0000","last_clean":"2024-09-12T18:09:29.840101+0000","last_became_active":"2024-09-12T17:46:57.096462+0000","last_became_peered":"2024-09-12T17:46:57.096462+0000","last_unstale":"2024-09-12T18:09:29.840101+0000","last_undegraded":"2024-09-12T18:09:29.840101+0000","last_fullsized":"2024-09-12T18:09:29.840101+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"263'9","reported_seq":62,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:10:19.865991+0000","last_change":"2024-09-12T17:30:16.675262+0000","last_active":"2024-09-12T18:10:19.865991+0000","last_peered":"2024-09-12T18:10:19.865991+0000","last_clean":"2024-09-12T18:10:19.865991+0000","last_became_active":"2024-09-12T17:30:16.674952+0000","last_became_peered":"2024-09-12T17:30:16.674952+0000","last_unstale":"2024-09-12T18:10:19.865991+0000","last_undegraded":"2024-09-12T18:10:19.865991+0000","last_fullsized":"2024-09-12T18:10:19.865991+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:17:48.380471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":30722,"num_write":9,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"263'3","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:10:15.155542+0000","last_change":"2024-09-12T17:30:12.645927+0000","last_active":"2024-09-12T18:10:15.155542+0000","last_peered":"2024-09-12T18:10:15.155542+0000","last_clean":"2024-09-12T18:10:15.155542+0000","last_became_active":"2024-09-12T17:30:12.645624+0000","last_became_peered":"2024-09-12T17:30:12.645624+0000","last_unstale":"2024-09-12T18:10:15.155542+0000","last_undegraded":"2024-09-12T18:10:15.155542+0000","last_fullsized":"2024-09-12T18:10:15.155542+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:07:42.933168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"263'13","reported_seq":88,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:44.835410+0000","last_change":"2024-09-12T17:26:35.660411+0000","last_active":"2024-09-12T18:08:44.835410+0000","last_peered":"2024-09-12T18:08:44.835410+0000","last_clean":"2024-09-12T18:08:44.835410+0000","last_became_active":"2024-09-12T17:26:35.660132+0000","last_became_peered":"2024-09-12T17:26:35.660132+0000","last_unstale":"2024-09-12T18:08:44.835410+0000","last_undegraded":"2024-09-12T18:08:44.835410+0000","last_fullsized":"2024-09-12T18:08:44.835410+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:16:42.286139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":36,"num_write":29,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:44.871662+0000","last_change":"2024-09-12T17:46:57.076529+0000","last_active":"2024-09-12T18:08:44.871662+0000","last_peered":"2024-09-12T18:08:44.871662+0000","last_clean":"2024-09-12T18:08:44.871662+0000","last_became_active":"2024-09-12T17:46:57.076193+0000","last_became_peered":"2024-09-12T17:46:57.076193+0000","last_unstale":"2024-09-12T18:08:44.871662+0000","last_undegraded":"2024-09-12T18:08:44.871662+0000","last_fullsized":"2024-09-12T18:08:44.871662+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:06:10.868648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"260'3","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:54.849532+0000","last_change":"2024-09-12T17:30:16.671182+0000","last_active":"2024-09-12T18:09:54.849532+0000","last_peered":"2024-09-12T18:09:54.849532+0000","last_clean":"2024-09-12T18:09:54.849532+0000","last_became_active":"2024-09-12T17:30:16.670862+0000","last_became_peered":"2024-09-12T17:30:16.670862+0000","last_unstale":"2024-09-12T18:09:54.849532+0000","last_undegraded":"2024-09-12T18:09:54.849532+0000","last_fullsized":"2024-09-12T18:09:54.849532+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"263'5","reported_seq":61,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:10:24.846422+0000","last_change":"2024-09-12T17:30:12.648635+0000","last_active":"2024-09-12T18:10:24.846422+0000","last_peered":"2024-09-12T18:10:24.846422+0000","last_clean":"2024-09-12T18:10:24.846422+0000","last_became_active":"2024-09-12T17:30:12.648349+0000","last_became_peered":"2024-09-12T17:30:12.648349+0000","last_unstale":"2024-09-12T18:10:24.846422+0000","last_undegraded":"2024-09-12T18:10:24.846422+0000","last_fullsized":"2024-09-12T18:10:24.846422+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:34:54.875445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":18432,"num_write":10,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"263'117","reported_seq":422,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:04.843259+0000","last_change":"2024-09-12T17:26:35.664908+0000","last_active":"2024-09-12T18:09:04.843259+0000","last_peered":"2024-09-12T18:09:04.843259+0000","last_clean":"2024-09-12T18:09:04.843259+0000","last_became_active":"2024-09-12T17:26:35.664247+0000","last_became_peered":"2024-09-12T17:26:35.664247+0000","last_unstale":"2024-09-12T18:09:04.843259+0000","last_undegraded":"2024-09-12T18:09:04.843259+0000","last_fullsized":"2024-09-12T18:09:04.843259+0000","mapping_epoch":250,"log_start":"263'100","ondisk_log_start":"263'100","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:39:07.453840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":722,"num_read_kb":504,"num_write":158,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:49.849229+0000","last_change":"2024-09-12T17:46:57.089742+0000","last_active":"2024-09-12T18:08:49.849229+0000","last_peered":"2024-09-12T18:08:49.849229+0000","last_clean":"2024-09-12T18:08:49.849229+0000","last_became_active":"2024-09-12T17:46:57.089385+0000","last_became_peered":"2024-09-12T17:46:57.089385+0000","last_unstale":"2024-09-12T18:08:49.849229+0000","last_undegraded":"2024-09-12T18:08:49.849229+0000","last_fullsized":"2024-09-12T18:08:49.849229+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:17:02.129348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"263'14","reported_seq":71,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:41.215577+0000","last_change":"2024-09-12T17:30:16.682079+0000","last_active":"2024-09-12T18:11:41.215577+0000","last_peered":"2024-09-12T18:11:41.215577+0000","last_clean":"2024-09-12T18:11:41.215577+0000","last_became_active":"2024-09-12T17:30:16.681766+0000","last_became_peered":"2024-09-12T17:30:16.681766+0000","last_unstale":"2024-09-12T18:11:41.215577+0000","last_undegraded":"2024-09-12T18:11:41.215577+0000","last_fullsized":"2024-09-12T18:11:41.215577+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:31:21.167575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":32770,"num_write":24,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"0'0","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:49.861483+0000","last_change":"2024-09-12T17:30:12.648728+0000","last_active":"2024-09-12T18:09:49.861483+0000","last_peered":"2024-09-12T18:09:49.861483+0000","last_clean":"2024-09-12T18:09:49.861483+0000","last_became_active":"2024-09-12T17:30:12.648369+0000","last_became_peered":"2024-09-12T17:30:12.648369+0000","last_unstale":"2024-09-12T18:09:49.861483+0000","last_undegraded":"2024-09-12T18:09:49.861483+0000","last_fullsized":"2024-09-12T18:09:49.861483+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"263'110","reported_seq":439,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:04.851030+0000","last_change":"2024-09-12T17:26:35.666024+0000","last_active":"2024-09-12T18:09:04.851030+0000","last_peered":"2024-09-12T18:09:04.851030+0000","last_clean":"2024-09-12T18:09:04.851030+0000","last_became_active":"2024-09-12T17:26:35.665735+0000","last_became_peered":"2024-09-12T17:26:35.665735+0000","last_unstale":"2024-09-12T18:09:04.851030+0000","last_undegraded":"2024-09-12T18:09:04.851030+0000","last_fullsized":"2024-09-12T18:09:04.851030+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:21:58.014213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":761,"num_read_kb":507,"num_write":140,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:04.851052+0000","last_change":"2024-09-12T17:46:57.090107+0000","last_active":"2024-09-12T18:09:04.851052+0000","last_peered":"2024-09-12T18:09:04.851052+0000","last_clean":"2024-09-12T18:09:04.851052+0000","last_became_active":"2024-09-12T17:46:57.089797+0000","last_became_peered":"2024-09-12T17:46:57.089797+0000","last_unstale":"2024-09-12T18:09:04.851052+0000","last_undegraded":"2024-09-12T18:09:04.851052+0000","last_fullsized":"2024-09-12T18:09:04.851052+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:57:58.129729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"263'5","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:39.877726+0000","last_change":"2024-09-12T17:30:16.686091+0000","last_active":"2024-09-12T18:11:39.877726+0000","last_peered":"2024-09-12T18:11:39.877726+0000","last_clean":"2024-09-12T18:11:39.877726+0000","last_became_active":"2024-09-12T17:30:16.685755+0000","last_became_peered":"2024-09-12T17:30:16.685755+0000","last_unstale":"2024-09-12T18:11:39.877726+0000","last_undegraded":"2024-09-12T18:11:39.877726+0000","last_fullsized":"2024-09-12T18:11:39.877726+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:41:14.032884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":16,"num_write":10,"num_write_kb":5136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"0'0","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:54.841851+0000","last_change":"2024-09-12T17:30:12.641329+0000","last_active":"2024-09-12T18:08:54.841851+0000","last_peered":"2024-09-12T18:08:54.841851+0000","last_clean":"2024-09-12T18:08:54.841851+0000","last_became_active":"2024-09-12T17:30:12.640983+0000","last_became_peered":"2024-09-12T17:30:12.640983+0000","last_unstale":"2024-09-12T18:08:54.841851+0000","last_undegraded":"2024-09-12T18:08:54.841851+0000","last_fullsized":"2024-09-12T18:08:54.841851+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:49:02.041715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"263'13","reported_seq":92,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:04.851003+0000","last_change":"2024-09-12T17:26:35.664850+0000","last_active":"2024-09-12T18:09:04.851003+0000","last_peered":"2024-09-12T18:09:04.851003+0000","last_clean":"2024-09-12T18:09:04.851003+0000","last_became_active":"2024-09-12T17:26:35.664517+0000","last_became_peered":"2024-09-12T17:26:35.664517+0000","last_unstale":"2024-09-12T18:09:04.851003+0000","last_undegraded":"2024-09-12T18:09:04.851003+0000","last_fullsized":"2024-09-12T18:09:04.851003+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:47:34.050940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":54,"num_write":23,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:55.153138+0000","last_change":"2024-09-12T17:46:57.091721+0000","last_active":"2024-09-12T18:09:55.153138+0000","last_peered":"2024-09-12T18:09:55.153138+0000","last_clean":"2024-09-12T18:09:55.153138+0000","last_became_active":"2024-09-12T17:46:57.091147+0000","last_became_peered":"2024-09-12T17:46:57.091147+0000","last_unstale":"2024-09-12T18:09:55.153138+0000","last_undegraded":"2024-09-12T18:09:55.153138+0000","last_fullsized":"2024-09-12T18:09:55.153138+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"260'5","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:59.873661+0000","last_change":"2024-09-12T17:30:16.684444+0000","last_active":"2024-09-12T18:08:59.873661+0000","last_peered":"2024-09-12T18:08:59.873661+0000","last_clean":"2024-09-12T18:08:59.873661+0000","last_became_active":"2024-09-12T17:30:16.684200+0000","last_became_peered":"2024-09-12T17:30:16.684200+0000","last_unstale":"2024-09-12T18:08:59.873661+0000","last_undegraded":"2024-09-12T18:08:59.873661+0000","last_fullsized":"2024-09-12T18:08:59.873661+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:52:13.212280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"263'2","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:34.747957+0000","last_change":"2024-09-12T17:30:12.640225+0000","last_active":"2024-09-12T18:11:34.747957+0000","last_peered":"2024-09-12T18:11:34.747957+0000","last_clean":"2024-09-12T18:11:34.747957+0000","last_became_active":"2024-09-12T17:30:12.639953+0000","last_became_peered":"2024-09-12T17:30:12.639953+0000","last_unstale":"2024-09-12T18:11:34.747957+0000","last_undegraded":"2024-09-12T18:11:34.747957+0000","last_fullsized":"2024-09-12T18:11:34.747957+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:40:28.022453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"263'28","reported_seq":125,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:04.874467+0000","last_change":"2024-09-12T17:26:35.663645+0000","last_active":"2024-09-12T18:09:04.874467+0000","last_peered":"2024-09-12T18:09:04.874467+0000","last_clean":"2024-09-12T18:09:04.874467+0000","last_became_active":"2024-09-12T17:26:35.663339+0000","last_became_peered":"2024-09-12T17:26:35.663339+0000","last_unstale":"2024-09-12T18:09:04.874467+0000","last_undegraded":"2024-09-12T18:09:04.874467+0000","last_fullsized":"2024-09-12T18:09:04.874467+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:33:26.767790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":134,"num_read_kb":91,"num_write":60,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"263'1","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:29.858886+0000","last_change":"2024-09-12T17:46:57.088362+0000","last_active":"2024-09-12T18:09:29.858886+0000","last_peered":"2024-09-12T18:09:29.858886+0000","last_clean":"2024-09-12T18:09:29.858886+0000","last_became_active":"2024-09-12T17:46:57.088039+0000","last_became_peered":"2024-09-12T17:46:57.088039+0000","last_unstale":"2024-09-12T18:09:29.858886+0000","last_undegraded":"2024-09-12T18:09:29.858886+0000","last_fullsized":"2024-09-12T18:09:29.858886+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"263'9","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:41.063889+0000","last_change":"2024-09-12T17:30:16.672459+0000","last_active":"2024-09-12T18:11:41.063889+0000","last_peered":"2024-09-12T18:11:41.063889+0000","last_clean":"2024-09-12T18:11:41.063889+0000","last_became_active":"2024-09-12T17:30:16.672167+0000","last_became_peered":"2024-09-12T17:30:16.672167+0000","last_unstale":"2024-09-12T18:11:41.063889+0000","last_undegraded":"2024-09-12T18:11:41.063889+0000","last_fullsized":"2024-09-12T18:11:41.063889+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:34:33.089166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":17408,"num_write":19,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"260'5","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:44.843494+0000","last_change":"2024-09-12T17:30:12.644426+0000","last_active":"2024-09-12T18:07:44.843494+0000","last_peered":"2024-09-12T18:07:44.843494+0000","last_clean":"2024-09-12T18:07:44.843494+0000","last_became_active":"2024-09-12T17:30:12.644125+0000","last_became_peered":"2024-09-12T17:30:12.644125+0000","last_unstale":"2024-09-12T18:07:44.843494+0000","last_undegraded":"2024-09-12T18:07:44.843494+0000","last_fullsized":"2024-09-12T18:07:44.843494+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:29:53.974488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"263'38","reported_seq":158,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:44.833618+0000","last_change":"2024-09-12T17:26:35.659571+0000","last_active":"2024-09-12T18:07:44.833618+0000","last_peered":"2024-09-12T18:07:44.833618+0000","last_clean":"2024-09-12T18:07:44.833618+0000","last_became_active":"2024-09-12T17:26:35.659261+0000","last_became_peered":"2024-09-12T17:26:35.659261+0000","last_unstale":"2024-09-12T18:07:44.833618+0000","last_undegraded":"2024-09-12T18:07:44.833618+0000","last_fullsized":"2024-09-12T18:07:44.833618+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:13:24.323445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":196,"num_read_kb":138,"num_write":78,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:29.858926+0000","last_change":"2024-09-12T17:46:57.088279+0000","last_active":"2024-09-12T18:09:29.858926+0000","last_peered":"2024-09-12T18:09:29.858926+0000","last_clean":"2024-09-12T18:09:29.858926+0000","last_became_active":"2024-09-12T17:46:57.087965+0000","last_became_peered":"2024-09-12T17:46:57.087965+0000","last_unstale":"2024-09-12T18:09:29.858926+0000","last_undegraded":"2024-09-12T18:09:29.858926+0000","last_fullsized":"2024-09-12T18:09:29.858926+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"263'8","reported_seq":61,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:10:19.861008+0000","last_change":"2024-09-12T17:30:16.685365+0000","last_active":"2024-09-12T18:10:19.861008+0000","last_peered":"2024-09-12T18:10:19.861008+0000","last_clean":"2024-09-12T18:10:19.861008+0000","last_became_active":"2024-09-12T17:30:16.685054+0000","last_became_peered":"2024-09-12T17:30:16.685054+0000","last_unstale":"2024-09-12T18:10:19.861008+0000","last_undegraded":"2024-09-12T18:10:19.861008+0000","last_fullsized":"2024-09-12T18:10:19.861008+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:42:01.087864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":30722,"num_write":13,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"263'8","reported_seq":65,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:10:14.852155+0000","last_change":"2024-09-12T17:30:12.652060+0000","last_active":"2024-09-12T18:10:14.852155+0000","last_peered":"2024-09-12T18:10:14.852155+0000","last_clean":"2024-09-12T18:10:14.852155+0000","last_became_active":"2024-09-12T17:30:12.651780+0000","last_became_peered":"2024-09-12T17:30:12.651780+0000","last_unstale":"2024-09-12T18:10:14.852155+0000","last_undegraded":"2024-09-12T18:10:14.852155+0000","last_fullsized":"2024-09-12T18:10:14.852155+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:20:56.174919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":22530,"num_write":13,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"263'27","reported_seq":128,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:40.137913+0000","last_change":"2024-09-12T17:26:35.665383+0000","last_active":"2024-09-12T18:07:40.137913+0000","last_peered":"2024-09-12T18:07:40.137913+0000","last_clean":"2024-09-12T18:07:40.137913+0000","last_became_active":"2024-09-12T17:26:35.665076+0000","last_became_peered":"2024-09-12T17:26:35.665076+0000","last_unstale":"2024-09-12T18:07:40.137913+0000","last_undegraded":"2024-09-12T18:07:40.137913+0000","last_fullsized":"2024-09-12T18:07:40.137913+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:51:16.783076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":146,"num_read_kb":106,"num_write":38,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:00.140237+0000","last_change":"2024-09-12T17:46:57.077605+0000","last_active":"2024-09-12T18:08:00.140237+0000","last_peered":"2024-09-12T18:08:00.140237+0000","last_clean":"2024-09-12T18:08:00.140237+0000","last_became_active":"2024-09-12T17:46:57.077265+0000","last_became_peered":"2024-09-12T17:46:57.077265+0000","last_unstale":"2024-09-12T18:08:00.140237+0000","last_undegraded":"2024-09-12T18:08:00.140237+0000","last_fullsized":"2024-09-12T18:08:00.140237+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:54:27.754921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"0'0","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:59.850434+0000","last_change":"2024-09-12T17:30:16.684627+0000","last_active":"2024-09-12T18:08:59.850434+0000","last_peered":"2024-09-12T18:08:59.850434+0000","last_clean":"2024-09-12T18:08:59.850434+0000","last_became_active":"2024-09-12T17:30:16.683963+0000","last_became_peered":"2024-09-12T17:30:16.683963+0000","last_unstale":"2024-09-12T18:08:59.850434+0000","last_undegraded":"2024-09-12T18:08:59.850434+0000","last_fullsized":"2024-09-12T18:08:59.850434+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:56:37.344964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"263'8","reported_seq":66,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:10:09.864676+0000","last_change":"2024-09-12T17:30:12.643034+0000","last_active":"2024-09-12T18:10:09.864676+0000","last_peered":"2024-09-12T18:10:09.864676+0000","last_clean":"2024-09-12T18:10:09.864676+0000","last_became_active":"2024-09-12T17:30:12.642687+0000","last_became_peered":"2024-09-12T17:30:12.642687+0000","last_unstale":"2024-09-12T18:10:09.864676+0000","last_undegraded":"2024-09-12T18:10:09.864676+0000","last_fullsized":"2024-09-12T18:10:09.864676+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:06:07.203968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":26626,"num_write":13,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"263'39","reported_seq":160,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:39.833155+0000","last_change":"2024-09-12T17:26:35.668713+0000","last_active":"2024-09-12T18:07:39.833155+0000","last_peered":"2024-09-12T18:07:39.833155+0000","last_clean":"2024-09-12T18:07:39.833155+0000","last_became_active":"2024-09-12T17:26:35.668286+0000","last_became_peered":"2024-09-12T17:26:35.668286+0000","last_unstale":"2024-09-12T18:07:39.833155+0000","last_undegraded":"2024-09-12T18:07:39.833155+0000","last_fullsized":"2024-09-12T18:07:39.833155+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:20:43.354325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":202,"num_read_kb":143,"num_write":74,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"263'1","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:59.830606+0000","last_change":"2024-09-12T17:46:57.091097+0000","last_active":"2024-09-12T18:07:59.830606+0000","last_peered":"2024-09-12T18:07:59.830606+0000","last_clean":"2024-09-12T18:07:59.830606+0000","last_became_active":"2024-09-12T17:46:57.088919+0000","last_became_peered":"2024-09-12T17:46:57.088919+0000","last_unstale":"2024-09-12T18:07:59.830606+0000","last_undegraded":"2024-09-12T18:07:59.830606+0000","last_fullsized":"2024-09-12T18:07:59.830606+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:56:55.289350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"0'0","reported_seq":34,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:44.840586+0000","last_change":"2024-09-12T17:31:18.237102+0000","last_active":"2024-09-12T18:08:44.840586+0000","last_peered":"2024-09-12T18:08:44.840586+0000","last_clean":"2024-09-12T18:08:44.840586+0000","last_became_active":"2024-09-12T17:31:18.236640+0000","last_became_peered":"2024-09-12T17:31:18.236640+0000","last_unstale":"2024-09-12T18:08:44.840586+0000","last_undegraded":"2024-09-12T18:08:44.840586+0000","last_fullsized":"2024-09-12T18:08:44.840586+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:10:12.696558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.15","version":"0'0","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:54.853566+0000","last_change":"2024-09-12T17:30:12.649885+0000","last_active":"2024-09-12T18:08:54.853566+0000","last_peered":"2024-09-12T18:08:54.853566+0000","last_clean":"2024-09-12T18:08:54.853566+0000","last_became_active":"2024-09-12T17:30:12.649605+0000","last_became_peered":"2024-09-12T17:30:12.649605+0000","last_unstale":"2024-09-12T18:08:54.853566+0000","last_undegraded":"2024-09-12T18:08:54.853566+0000","last_fullsized":"2024-09-12T18:08:54.853566+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:09:52.512870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"263'53","reported_seq":191,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:39.841430+0000","last_change":"2024-09-12T17:26:35.661633+0000","last_active":"2024-09-12T18:07:39.841430+0000","last_peered":"2024-09-12T18:07:39.841430+0000","last_clean":"2024-09-12T18:07:39.841430+0000","last_became_active":"2024-09-12T17:26:35.658602+0000","last_became_peered":"2024-09-12T17:26:35.658602+0000","last_unstale":"2024-09-12T18:07:39.841430+0000","last_undegraded":"2024-09-12T18:07:39.841430+0000","last_fullsized":"2024-09-12T18:07:39.841430+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:40:06.406484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":262,"num_read_kb":183,"num_write":93,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:59.845745+0000","last_change":"2024-09-12T17:46:57.083830+0000","last_active":"2024-09-12T18:07:59.845745+0000","last_peered":"2024-09-12T18:07:59.845745+0000","last_clean":"2024-09-12T18:07:59.845745+0000","last_became_active":"2024-09-12T17:46:57.081080+0000","last_became_peered":"2024-09-12T17:46:57.081080+0000","last_unstale":"2024-09-12T18:07:59.845745+0000","last_undegraded":"2024-09-12T18:07:59.845745+0000","last_fullsized":"2024-09-12T18:07:59.845745+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:12:11.153281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"263'3","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:24.870221+0000","last_change":"2024-09-12T17:30:16.686003+0000","last_active":"2024-09-12T18:11:24.870221+0000","last_peered":"2024-09-12T18:11:24.870221+0000","last_clean":"2024-09-12T18:11:24.870221+0000","last_became_active":"2024-09-12T17:30:16.685688+0000","last_became_peered":"2024-09-12T17:30:16.685688+0000","last_unstale":"2024-09-12T18:11:24.870221+0000","last_undegraded":"2024-09-12T18:11:24.870221+0000","last_fullsized":"2024-09-12T18:11:24.870221+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:37:31.358403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"0'0","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:54.836524+0000","last_change":"2024-09-12T17:30:12.654638+0000","last_active":"2024-09-12T18:08:54.836524+0000","last_peered":"2024-09-12T18:08:54.836524+0000","last_clean":"2024-09-12T18:08:54.836524+0000","last_became_active":"2024-09-12T17:30:12.654327+0000","last_became_peered":"2024-09-12T17:30:12.654327+0000","last_unstale":"2024-09-12T18:08:54.836524+0000","last_undegraded":"2024-09-12T18:08:54.836524+0000","last_fullsized":"2024-09-12T18:08:54.836524+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:44:33.401300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"263'47","reported_seq":185,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:39.828526+0000","last_change":"2024-09-12T17:26:35.662563+0000","last_active":"2024-09-12T18:07:39.828526+0000","last_peered":"2024-09-12T18:07:39.828526+0000","last_clean":"2024-09-12T18:07:39.828526+0000","last_became_active":"2024-09-12T17:26:35.662284+0000","last_became_peered":"2024-09-12T17:26:35.662284+0000","last_unstale":"2024-09-12T18:07:39.828526+0000","last_undegraded":"2024-09-12T18:07:39.828526+0000","last_fullsized":"2024-09-12T18:07:39.828526+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:52:34.213360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":252,"num_read_kb":176,"num_write":91,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:59.844776+0000","last_change":"2024-09-12T17:46:57.082391+0000","last_active":"2024-09-12T18:07:59.844776+0000","last_peered":"2024-09-12T18:07:59.844776+0000","last_clean":"2024-09-12T18:07:59.844776+0000","last_became_active":"2024-09-12T17:46:57.082082+0000","last_became_peered":"2024-09-12T17:46:57.082082+0000","last_unstale":"2024-09-12T18:07:59.844776+0000","last_undegraded":"2024-09-12T18:07:59.844776+0000","last_fullsized":"2024-09-12T18:07:59.844776+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:16:53.154548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"260'3","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:59.853745+0000","last_change":"2024-09-12T17:30:16.675596+0000","last_active":"2024-09-12T18:08:59.853745+0000","last_peered":"2024-09-12T18:08:59.853745+0000","last_clean":"2024-09-12T18:08:59.853745+0000","last_became_active":"2024-09-12T17:30:16.675278+0000","last_became_peered":"2024-09-12T17:30:16.675278+0000","last_unstale":"2024-09-12T18:08:59.853745+0000","last_undegraded":"2024-09-12T18:08:59.853745+0000","last_fullsized":"2024-09-12T18:08:59.853745+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:04:44.516041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"260'2","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:54.841986+0000","last_change":"2024-09-12T17:30:12.643518+0000","last_active":"2024-09-12T18:08:54.841986+0000","last_peered":"2024-09-12T18:08:54.841986+0000","last_clean":"2024-09-12T18:08:54.841986+0000","last_became_active":"2024-09-12T17:30:12.643203+0000","last_became_peered":"2024-09-12T17:30:12.643203+0000","last_unstale":"2024-09-12T18:08:54.841986+0000","last_undegraded":"2024-09-12T18:08:54.841986+0000","last_fullsized":"2024-09-12T18:08:54.841986+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:42:13.911696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":23,"num_write":2,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"263'29","reported_seq":125,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:39.851532+0000","last_change":"2024-09-12T17:26:35.657351+0000","last_active":"2024-09-12T18:08:39.851532+0000","last_peered":"2024-09-12T18:08:39.851532+0000","last_clean":"2024-09-12T18:08:39.851532+0000","last_became_active":"2024-09-12T17:26:35.657035+0000","last_became_peered":"2024-09-12T17:26:35.657035+0000","last_unstale":"2024-09-12T18:08:39.851532+0000","last_undegraded":"2024-09-12T18:08:39.851532+0000","last_fullsized":"2024-09-12T18:08:39.851532+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:26:04.653231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":129,"num_read_kb":90,"num_write":56,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:44.848747+0000","last_change":"2024-09-12T17:46:57.094601+0000","last_active":"2024-09-12T18:08:44.848747+0000","last_peered":"2024-09-12T18:08:44.848747+0000","last_clean":"2024-09-12T18:08:44.848747+0000","last_became_active":"2024-09-12T17:46:57.094314+0000","last_became_peered":"2024-09-12T17:46:57.094314+0000","last_unstale":"2024-09-12T18:08:44.848747+0000","last_undegraded":"2024-09-12T18:08:44.848747+0000","last_fullsized":"2024-09-12T18:08:44.848747+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:55:53.289948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:40.137931+0000","last_change":"2024-09-12T17:30:16.679537+0000","last_active":"2024-09-12T18:07:40.137931+0000","last_peered":"2024-09-12T18:07:40.137931+0000","last_clean":"2024-09-12T18:07:40.137931+0000","last_became_active":"2024-09-12T17:30:16.679282+0000","last_became_peered":"2024-09-12T17:30:16.679282+0000","last_unstale":"2024-09-12T18:07:40.137931+0000","last_undegraded":"2024-09-12T18:07:40.137931+0000","last_fullsized":"2024-09-12T18:07:40.137931+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:52:39.870256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"260'6","reported_seq":58,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:34.842038+0000","last_change":"2024-09-12T17:30:12.652775+0000","last_active":"2024-09-12T18:07:34.842038+0000","last_peered":"2024-09-12T18:07:34.842038+0000","last_clean":"2024-09-12T18:07:34.842038+0000","last_became_active":"2024-09-12T17:30:12.652426+0000","last_became_peered":"2024-09-12T17:30:12.652426+0000","last_unstale":"2024-09-12T18:07:34.842038+0000","last_undegraded":"2024-09-12T18:07:34.842038+0000","last_fullsized":"2024-09-12T18:07:34.842038+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:55:40.416016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":10240,"num_write":16,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"263'34","reported_seq":148,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:34.850782+0000","last_change":"2024-09-12T17:26:35.664129+0000","last_active":"2024-09-12T18:08:34.850782+0000","last_peered":"2024-09-12T18:08:34.850782+0000","last_clean":"2024-09-12T18:08:34.850782+0000","last_became_active":"2024-09-12T17:26:35.663337+0000","last_became_peered":"2024-09-12T17:26:35.663337+0000","last_unstale":"2024-09-12T18:08:34.850782+0000","last_undegraded":"2024-09-12T18:08:34.850782+0000","last_fullsized":"2024-09-12T18:08:34.850782+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:23:54.136870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":179,"num_read_kb":128,"num_write":55,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:44.840640+0000","last_change":"2024-09-12T17:46:57.093698+0000","last_active":"2024-09-12T18:08:44.840640+0000","last_peered":"2024-09-12T18:08:44.840640+0000","last_clean":"2024-09-12T18:08:44.840640+0000","last_became_active":"2024-09-12T17:46:57.093157+0000","last_became_peered":"2024-09-12T17:46:57.093157+0000","last_unstale":"2024-09-12T18:08:44.840640+0000","last_undegraded":"2024-09-12T18:08:44.840640+0000","last_fullsized":"2024-09-12T18:08:44.840640+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:44:51.633185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"263'2","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:10:00.153759+0000","last_change":"2024-09-12T17:30:16.679016+0000","last_active":"2024-09-12T18:10:00.153759+0000","last_peered":"2024-09-12T18:10:00.153759+0000","last_clean":"2024-09-12T18:10:00.153759+0000","last_became_active":"2024-09-12T17:30:16.678682+0000","last_became_peered":"2024-09-12T17:30:16.678682+0000","last_unstale":"2024-09-12T18:10:00.153759+0000","last_undegraded":"2024-09-12T18:10:00.153759+0000","last_fullsized":"2024-09-12T18:10:00.153759+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:44:09.408299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"263'6","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:41.374823+0000","last_change":"2024-09-12T17:30:12.653263+0000","last_active":"2024-09-12T18:11:41.374823+0000","last_peered":"2024-09-12T18:11:41.374823+0000","last_clean":"2024-09-12T18:11:41.374823+0000","last_became_active":"2024-09-12T17:30:12.652916+0000","last_became_peered":"2024-09-12T17:30:12.652916+0000","last_unstale":"2024-09-12T18:11:41.374823+0000","last_undegraded":"2024-09-12T18:11:41.374823+0000","last_fullsized":"2024-09-12T18:11:41.374823+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:25:32.409182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":16,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"263'35","reported_seq":148,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:34.839418+0000","last_change":"2024-09-12T17:26:35.669546+0000","last_active":"2024-09-12T18:08:34.839418+0000","last_peered":"2024-09-12T18:08:34.839418+0000","last_clean":"2024-09-12T18:08:34.839418+0000","last_became_active":"2024-09-12T17:26:35.669256+0000","last_became_peered":"2024-09-12T17:26:35.669256+0000","last_unstale":"2024-09-12T18:08:34.839418+0000","last_undegraded":"2024-09-12T18:08:34.839418+0000","last_fullsized":"2024-09-12T18:08:34.839418+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:05:49.889059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":173,"num_read_kb":119,"num_write":68,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"262'1","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:04.835994+0000","last_change":"2024-09-12T17:46:57.090884+0000","last_active":"2024-09-12T18:08:04.835994+0000","last_peered":"2024-09-12T18:08:04.835994+0000","last_clean":"2024-09-12T18:08:04.835994+0000","last_became_active":"2024-09-12T17:46:57.090587+0000","last_became_peered":"2024-09-12T17:46:57.090587+0000","last_unstale":"2024-09-12T18:08:04.835994+0000","last_undegraded":"2024-09-12T18:08:04.835994+0000","last_fullsized":"2024-09-12T18:08:04.835994+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:06:27.485219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"260'3","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:39.841383+0000","last_change":"2024-09-12T17:30:16.686552+0000","last_active":"2024-09-12T18:07:39.841383+0000","last_peered":"2024-09-12T18:07:39.841383+0000","last_clean":"2024-09-12T18:07:39.841383+0000","last_became_active":"2024-09-12T17:30:16.685830+0000","last_became_peered":"2024-09-12T17:30:16.685830+0000","last_unstale":"2024-09-12T18:07:39.841383+0000","last_undegraded":"2024-09-12T18:07:39.841383+0000","last_fullsized":"2024-09-12T18:07:39.841383+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:26:14.033263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"0'0","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:34.861787+0000","last_change":"2024-09-12T17:30:12.640428+0000","last_active":"2024-09-12T18:07:34.861787+0000","last_peered":"2024-09-12T18:07:34.861787+0000","last_clean":"2024-09-12T18:07:34.861787+0000","last_became_active":"2024-09-12T17:30:12.640139+0000","last_became_peered":"2024-09-12T17:30:12.640139+0000","last_unstale":"2024-09-12T18:07:34.861787+0000","last_undegraded":"2024-09-12T18:07:34.861787+0000","last_fullsized":"2024-09-12T18:07:34.861787+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:09:04.186884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"263'49","reported_seq":189,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:34.850284+0000","last_change":"2024-09-12T17:26:35.659117+0000","last_active":"2024-09-12T18:08:34.850284+0000","last_peered":"2024-09-12T18:08:34.850284+0000","last_clean":"2024-09-12T18:08:34.850284+0000","last_became_active":"2024-09-12T17:26:35.658785+0000","last_became_peered":"2024-09-12T17:26:35.658785+0000","last_unstale":"2024-09-12T18:08:34.850284+0000","last_undegraded":"2024-09-12T18:08:34.850284+0000","last_fullsized":"2024-09-12T18:08:34.850284+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:02.864803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":254,"num_read_kb":176,"num_write":93,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"263'1","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:44.848723+0000","last_change":"2024-09-12T17:46:57.093615+0000","last_active":"2024-09-12T18:08:44.848723+0000","last_peered":"2024-09-12T18:08:44.848723+0000","last_clean":"2024-09-12T18:08:44.848723+0000","last_became_active":"2024-09-12T17:46:57.093267+0000","last_became_peered":"2024-09-12T17:46:57.093267+0000","last_unstale":"2024-09-12T18:08:44.848723+0000","last_undegraded":"2024-09-12T18:08:44.848723+0000","last_fullsized":"2024-09-12T18:08:44.848723+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:52:12.345961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:39.862456+0000","last_change":"2024-09-12T17:30:16.681768+0000","last_active":"2024-09-12T18:07:39.862456+0000","last_peered":"2024-09-12T18:07:39.862456+0000","last_clean":"2024-09-12T18:07:39.862456+0000","last_became_active":"2024-09-12T17:30:16.681418+0000","last_became_peered":"2024-09-12T17:30:16.681418+0000","last_unstale":"2024-09-12T18:07:39.862456+0000","last_undegraded":"2024-09-12T18:07:39.862456+0000","last_fullsized":"2024-09-12T18:07:39.862456+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:08:51.341343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"260'3","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:34.841576+0000","last_change":"2024-09-12T17:30:12.643785+0000","last_active":"2024-09-12T18:07:34.841576+0000","last_peered":"2024-09-12T18:07:34.841576+0000","last_clean":"2024-09-12T18:07:34.841576+0000","last_became_active":"2024-09-12T17:30:12.643484+0000","last_became_peered":"2024-09-12T17:30:12.643484+0000","last_unstale":"2024-09-12T18:07:34.841576+0000","last_undegraded":"2024-09-12T18:07:34.841576+0000","last_fullsized":"2024-09-12T18:07:34.841576+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:51:35.165703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"260'23","reported_seq":119,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:34.847525+0000","last_change":"2024-09-12T17:26:35.666220+0000","last_active":"2024-09-12T18:08:34.847525+0000","last_peered":"2024-09-12T18:08:34.847525+0000","last_clean":"2024-09-12T18:08:34.847525+0000","last_became_active":"2024-09-12T17:26:35.665908+0000","last_became_peered":"2024-09-12T17:26:35.665908+0000","last_unstale":"2024-09-12T18:08:34.847525+0000","last_undegraded":"2024-09-12T18:08:34.847525+0000","last_fullsized":"2024-09-12T18:08:34.847525+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:22:29.733636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":120,"num_read_kb":87,"num_write":41,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:44.835349+0000","last_change":"2024-09-12T17:46:57.083432+0000","last_active":"2024-09-12T18:08:44.835349+0000","last_peered":"2024-09-12T18:08:44.835349+0000","last_clean":"2024-09-12T18:08:44.835349+0000","last_became_active":"2024-09-12T17:46:57.083098+0000","last_became_peered":"2024-09-12T17:46:57.083098+0000","last_unstale":"2024-09-12T18:08:44.835349+0000","last_undegraded":"2024-09-12T18:08:44.835349+0000","last_fullsized":"2024-09-12T18:08:44.835349+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:31:23.853524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:34.847617+0000","last_change":"2024-09-12T17:30:16.684194+0000","last_active":"2024-09-12T18:08:34.847617+0000","last_peered":"2024-09-12T18:08:34.847617+0000","last_clean":"2024-09-12T18:08:34.847617+0000","last_became_active":"2024-09-12T17:30:16.683887+0000","last_became_peered":"2024-09-12T17:30:16.683887+0000","last_unstale":"2024-09-12T18:08:34.847617+0000","last_undegraded":"2024-09-12T18:08:34.847617+0000","last_fullsized":"2024-09-12T18:08:34.847617+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:53:34.319282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"263'4","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:41.193054+0000","last_change":"2024-09-12T17:30:12.653459+0000","last_active":"2024-09-12T18:11:41.193054+0000","last_peered":"2024-09-12T18:11:41.193054+0000","last_clean":"2024-09-12T18:11:41.193054+0000","last_became_active":"2024-09-12T17:30:12.653137+0000","last_became_peered":"2024-09-12T17:30:12.653137+0000","last_unstale":"2024-09-12T18:11:41.193054+0000","last_undegraded":"2024-09-12T18:11:41.193054+0000","last_fullsized":"2024-09-12T18:11:41.193054+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:08:52.465178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6148,"num_write":4,"num_write_kb":3076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"263'50","reported_seq":187,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:29.854471+0000","last_change":"2024-09-12T17:26:35.669293+0000","last_active":"2024-09-12T18:09:29.854471+0000","last_peered":"2024-09-12T18:09:29.854471+0000","last_clean":"2024-09-12T18:09:29.854471+0000","last_became_active":"2024-09-12T17:26:35.668989+0000","last_became_peered":"2024-09-12T17:26:35.668989+0000","last_unstale":"2024-09-12T18:09:29.854471+0000","last_undegraded":"2024-09-12T18:09:29.854471+0000","last_fullsized":"2024-09-12T18:09:29.854471+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:43:19.820670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":250,"num_read_kb":175,"num_write":93,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:29.858796+0000","last_change":"2024-09-12T17:46:57.088291+0000","last_active":"2024-09-12T18:09:29.858796+0000","last_peered":"2024-09-12T18:09:29.858796+0000","last_clean":"2024-09-12T18:09:29.858796+0000","last_became_active":"2024-09-12T17:46:57.087982+0000","last_became_peered":"2024-09-12T17:46:57.087982+0000","last_unstale":"2024-09-12T18:09:29.858796+0000","last_undegraded":"2024-09-12T18:09:29.858796+0000","last_fullsized":"2024-09-12T18:09:29.858796+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:05:50.630405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"263'5","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:41.180718+0000","last_change":"2024-09-12T17:30:16.679996+0000","last_active":"2024-09-12T18:11:41.180718+0000","last_peered":"2024-09-12T18:11:41.180718+0000","last_clean":"2024-09-12T18:11:41.180718+0000","last_became_active":"2024-09-12T17:30:16.679621+0000","last_became_peered":"2024-09-12T17:30:16.679621+0000","last_unstale":"2024-09-12T18:11:41.180718+0000","last_undegraded":"2024-09-12T18:11:41.180718+0000","last_fullsized":"2024-09-12T18:11:41.180718+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:23:53.964330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":9216,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"0'0","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:29.833725+0000","last_change":"2024-09-12T17:30:12.649664+0000","last_active":"2024-09-12T18:08:29.833725+0000","last_peered":"2024-09-12T18:08:29.833725+0000","last_clean":"2024-09-12T18:08:29.833725+0000","last_became_active":"2024-09-12T17:30:12.649010+0000","last_became_peered":"2024-09-12T17:30:12.649010+0000","last_unstale":"2024-09-12T18:08:29.833725+0000","last_undegraded":"2024-09-12T18:08:29.833725+0000","last_fullsized":"2024-09-12T18:08:29.833725+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:23:47.681997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"260'8","reported_seq":76,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:19.855981+0000","last_change":"2024-09-12T17:26:35.663336+0000","last_active":"2024-09-12T18:09:19.855981+0000","last_peered":"2024-09-12T18:09:19.855981+0000","last_clean":"2024-09-12T18:09:19.855981+0000","last_became_active":"2024-09-12T17:26:35.663041+0000","last_became_peered":"2024-09-12T17:26:35.663041+0000","last_unstale":"2024-09-12T18:09:19.855981+0000","last_undegraded":"2024-09-12T18:09:19.855981+0000","last_fullsized":"2024-09-12T18:09:19.855981+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:02:26.294386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":28,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:39.870871+0000","last_change":"2024-09-12T17:46:57.086356+0000","last_active":"2024-09-12T18:08:39.870871+0000","last_peered":"2024-09-12T18:08:39.870871+0000","last_clean":"2024-09-12T18:08:39.870871+0000","last_became_active":"2024-09-12T17:46:57.085908+0000","last_became_peered":"2024-09-12T17:46:57.085908+0000","last_unstale":"2024-09-12T18:08:39.870871+0000","last_undegraded":"2024-09-12T18:08:39.870871+0000","last_fullsized":"2024-09-12T18:08:39.870871+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:01:54.509459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"0'0","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:40.144742+0000","last_change":"2024-09-12T17:30:16.679533+0000","last_active":"2024-09-12T18:08:40.144742+0000","last_peered":"2024-09-12T18:08:40.144742+0000","last_clean":"2024-09-12T18:08:40.144742+0000","last_became_active":"2024-09-12T17:30:16.679193+0000","last_became_peered":"2024-09-12T17:30:16.679193+0000","last_unstale":"2024-09-12T18:08:40.144742+0000","last_undegraded":"2024-09-12T18:08:40.144742+0000","last_fullsized":"2024-09-12T18:08:40.144742+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:21:35.478757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"0'0","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:29.838852+0000","last_change":"2024-09-12T17:30:12.647471+0000","last_active":"2024-09-12T18:08:29.838852+0000","last_peered":"2024-09-12T18:08:29.838852+0000","last_clean":"2024-09-12T18:08:29.838852+0000","last_became_active":"2024-09-12T17:30:12.646945+0000","last_became_peered":"2024-09-12T17:30:12.646945+0000","last_unstale":"2024-09-12T18:08:29.838852+0000","last_undegraded":"2024-09-12T18:08:29.838852+0000","last_fullsized":"2024-09-12T18:08:29.838852+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:42:36.686975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"263'33","reported_seq":143,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:19.876853+0000","last_change":"2024-09-12T17:26:35.665050+0000","last_active":"2024-09-12T18:09:19.876853+0000","last_peered":"2024-09-12T18:09:19.876853+0000","last_clean":"2024-09-12T18:09:19.876853+0000","last_became_active":"2024-09-12T17:26:35.664749+0000","last_became_peered":"2024-09-12T17:26:35.664749+0000","last_unstale":"2024-09-12T18:09:19.876853+0000","last_undegraded":"2024-09-12T18:09:19.876853+0000","last_fullsized":"2024-09-12T18:09:19.876853+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:25:00.758310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":166,"num_read_kb":124,"num_write":50,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:39.851484+0000","last_change":"2024-09-12T17:46:57.084760+0000","last_active":"2024-09-12T18:08:39.851484+0000","last_peered":"2024-09-12T18:08:39.851484+0000","last_clean":"2024-09-12T18:08:39.851484+0000","last_became_active":"2024-09-12T17:46:57.084421+0000","last_became_peered":"2024-09-12T17:46:57.084421+0000","last_unstale":"2024-09-12T18:08:39.851484+0000","last_undegraded":"2024-09-12T18:08:39.851484+0000","last_fullsized":"2024-09-12T18:08:39.851484+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:35:17.085619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"0'0","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:34.847633+0000","last_change":"2024-09-12T17:30:16.682114+0000","last_active":"2024-09-12T18:08:34.847633+0000","last_peered":"2024-09-12T18:08:34.847633+0000","last_clean":"2024-09-12T18:08:34.847633+0000","last_became_active":"2024-09-12T17:30:16.681171+0000","last_became_peered":"2024-09-12T17:30:16.681171+0000","last_unstale":"2024-09-12T18:08:34.847633+0000","last_undegraded":"2024-09-12T18:08:34.847633+0000","last_fullsized":"2024-09-12T18:08:34.847633+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:35:19.241688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"263'6","reported_seq":57,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:41.083390+0000","last_change":"2024-09-12T17:30:12.641879+0000","last_active":"2024-09-12T18:11:41.083390+0000","last_peered":"2024-09-12T18:11:41.083390+0000","last_clean":"2024-09-12T18:11:41.083390+0000","last_became_active":"2024-09-12T17:30:12.641592+0000","last_became_peered":"2024-09-12T17:30:12.641592+0000","last_unstale":"2024-09-12T18:11:41.083390+0000","last_undegraded":"2024-09-12T18:11:41.083390+0000","last_fullsized":"2024-09-12T18:11:41.083390+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:29:07.666017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":11264,"num_write":6,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"263'52","reported_seq":196,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:19.838941+0000","last_change":"2024-09-12T17:26:35.663784+0000","last_active":"2024-09-12T18:09:19.838941+0000","last_peered":"2024-09-12T18:09:19.838941+0000","last_clean":"2024-09-12T18:09:19.838941+0000","last_became_active":"2024-09-12T17:26:35.663472+0000","last_became_peered":"2024-09-12T17:26:35.663472+0000","last_unstale":"2024-09-12T18:09:19.838941+0000","last_undegraded":"2024-09-12T18:09:19.838941+0000","last_fullsized":"2024-09-12T18:09:19.838941+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:48:26.678396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":261,"num_read_kb":192,"num_write":92,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:29.854446+0000","last_change":"2024-09-12T17:46:57.090539+0000","last_active":"2024-09-12T18:09:29.854446+0000","last_peered":"2024-09-12T18:09:29.854446+0000","last_clean":"2024-09-12T18:09:29.854446+0000","last_became_active":"2024-09-12T17:46:57.089601+0000","last_became_peered":"2024-09-12T17:46:57.089601+0000","last_unstale":"2024-09-12T18:09:29.854446+0000","last_undegraded":"2024-09-12T18:09:29.854446+0000","last_fullsized":"2024-09-12T18:09:29.854446+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:13:07.708030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"0'0","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:19.856690+0000","last_change":"2024-09-12T17:30:16.679697+0000","last_active":"2024-09-12T18:09:19.856690+0000","last_peered":"2024-09-12T18:09:19.856690+0000","last_clean":"2024-09-12T18:09:19.856690+0000","last_became_active":"2024-09-12T17:30:16.679308+0000","last_became_peered":"2024-09-12T17:30:16.679308+0000","last_unstale":"2024-09-12T18:09:19.856690+0000","last_undegraded":"2024-09-12T18:09:19.856690+0000","last_fullsized":"2024-09-12T18:09:19.856690+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:06:24.083988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"263'5","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:41.081740+0000","last_change":"2024-09-12T17:30:12.645085+0000","last_active":"2024-09-12T18:11:41.081740+0000","last_peered":"2024-09-12T18:11:41.081740+0000","last_clean":"2024-09-12T18:11:41.081740+0000","last_became_active":"2024-09-12T17:30:12.644792+0000","last_became_peered":"2024-09-12T17:30:12.644792+0000","last_unstale":"2024-09-12T18:11:41.081740+0000","last_undegraded":"2024-09-12T18:11:41.081740+0000","last_fullsized":"2024-09-12T18:11:41.081740+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:25:31.260415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6192,"num_write":5,"num_write_kb":6192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"263'30","reported_seq":142,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:19.845281+0000","last_change":"2024-09-12T17:26:35.667932+0000","last_active":"2024-09-12T18:09:19.845281+0000","last_peered":"2024-09-12T18:09:19.845281+0000","last_clean":"2024-09-12T18:09:19.845281+0000","last_became_active":"2024-09-12T17:26:35.667655+0000","last_became_peered":"2024-09-12T17:26:35.667655+0000","last_unstale":"2024-09-12T18:09:19.845281+0000","last_undegraded":"2024-09-12T18:09:19.845281+0000","last_fullsized":"2024-09-12T18:09:19.845281+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:21:57.489397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":166,"num_read_kb":116,"num_write":53,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:34.859718+0000","last_change":"2024-09-12T17:46:57.090843+0000","last_active":"2024-09-12T18:09:34.859718+0000","last_peered":"2024-09-12T18:09:34.859718+0000","last_clean":"2024-09-12T18:09:34.859718+0000","last_became_active":"2024-09-12T17:46:57.090477+0000","last_became_peered":"2024-09-12T17:46:57.090477+0000","last_unstale":"2024-09-12T18:09:34.859718+0000","last_undegraded":"2024-09-12T18:09:34.859718+0000","last_fullsized":"2024-09-12T18:09:34.859718+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"260'8","reported_seq":57,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:19.857045+0000","last_change":"2024-09-12T17:30:16.673290+0000","last_active":"2024-09-12T18:09:19.857045+0000","last_peered":"2024-09-12T18:09:19.857045+0000","last_clean":"2024-09-12T18:09:19.857045+0000","last_became_active":"2024-09-12T17:30:16.672989+0000","last_became_peered":"2024-09-12T17:30:16.672989+0000","last_unstale":"2024-09-12T18:09:19.857045+0000","last_undegraded":"2024-09-12T18:09:19.857045+0000","last_fullsized":"2024-09-12T18:09:19.857045+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:58:17.894413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":6167,"num_write":13,"num_write_kb":6167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"263'3","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:24.954765+0000","last_change":"2024-09-12T17:30:12.642188+0000","last_active":"2024-09-12T18:11:24.954765+0000","last_peered":"2024-09-12T18:11:24.954765+0000","last_clean":"2024-09-12T18:11:24.954765+0000","last_became_active":"2024-09-12T17:30:12.641901+0000","last_became_peered":"2024-09-12T17:30:12.641901+0000","last_unstale":"2024-09-12T18:11:24.954765+0000","last_undegraded":"2024-09-12T18:11:24.954765+0000","last_fullsized":"2024-09-12T18:11:24.954765+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:30:51.212272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"263'9","reported_seq":78,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:49.844267+0000","last_change":"2024-09-12T17:26:35.655618+0000","last_active":"2024-09-12T18:07:49.844267+0000","last_peered":"2024-09-12T18:07:49.844267+0000","last_clean":"2024-09-12T18:07:49.844267+0000","last_became_active":"2024-09-12T17:26:35.655307+0000","last_became_peered":"2024-09-12T17:26:35.655307+0000","last_unstale":"2024-09-12T18:07:49.844267+0000","last_undegraded":"2024-09-12T18:07:49.844267+0000","last_fullsized":"2024-09-12T18:07:49.844267+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:34:53.632505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":30,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"263'1","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:29.858857+0000","last_change":"2024-09-12T17:46:57.086405+0000","last_active":"2024-09-12T18:09:29.858857+0000","last_peered":"2024-09-12T18:09:29.858857+0000","last_clean":"2024-09-12T18:09:29.858857+0000","last_became_active":"2024-09-12T17:46:57.086116+0000","last_became_peered":"2024-09-12T17:46:57.086116+0000","last_unstale":"2024-09-12T18:09:29.858857+0000","last_undegraded":"2024-09-12T18:09:29.858857+0000","last_fullsized":"2024-09-12T18:09:29.858857+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:36:48.862604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:35.144176+0000","last_change":"2024-09-12T17:30:16.676645+0000","last_active":"2024-09-12T18:08:35.144176+0000","last_peered":"2024-09-12T18:08:35.144176+0000","last_clean":"2024-09-12T18:08:35.144176+0000","last_became_active":"2024-09-12T17:30:16.675243+0000","last_became_peered":"2024-09-12T17:30:16.675243+0000","last_unstale":"2024-09-12T18:08:35.144176+0000","last_undegraded":"2024-09-12T18:08:35.144176+0000","last_fullsized":"2024-09-12T18:08:35.144176+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:41:53.506076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"263'2","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:34.752954+0000","last_change":"2024-09-12T17:30:12.641067+0000","last_active":"2024-09-12T18:11:34.752954+0000","last_peered":"2024-09-12T18:11:34.752954+0000","last_clean":"2024-09-12T18:11:34.752954+0000","last_became_active":"2024-09-12T17:30:12.640736+0000","last_became_peered":"2024-09-12T17:30:12.640736+0000","last_unstale":"2024-09-12T18:11:34.752954+0000","last_undegraded":"2024-09-12T18:11:34.752954+0000","last_fullsized":"2024-09-12T18:11:34.752954+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:58:18.939586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"0'0","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:54.857716+0000","last_change":"2024-09-12T17:26:35.656429+0000","last_active":"2024-09-12T18:09:54.857716+0000","last_peered":"2024-09-12T18:09:54.857716+0000","last_clean":"2024-09-12T18:09:54.857716+0000","last_became_active":"2024-09-12T17:26:35.656149+0000","last_became_peered":"2024-09-12T17:26:35.656149+0000","last_unstale":"2024-09-12T18:09:54.857716+0000","last_undegraded":"2024-09-12T18:09:54.857716+0000","last_fullsized":"2024-09-12T18:09:54.857716+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:29.846502+0000","last_change":"2024-09-12T17:46:57.096748+0000","last_active":"2024-09-12T18:09:29.846502+0000","last_peered":"2024-09-12T18:09:29.846502+0000","last_clean":"2024-09-12T18:09:29.846502+0000","last_became_active":"2024-09-12T17:46:57.096375+0000","last_became_peered":"2024-09-12T17:46:57.096375+0000","last_unstale":"2024-09-12T18:09:29.846502+0000","last_undegraded":"2024-09-12T18:09:29.846502+0000","last_fullsized":"2024-09-12T18:09:29.846502+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"263'2","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:34.877246+0000","last_change":"2024-09-12T17:30:16.686958+0000","last_active":"2024-09-12T18:11:34.877246+0000","last_peered":"2024-09-12T18:11:34.877246+0000","last_clean":"2024-09-12T18:11:34.877246+0000","last_became_active":"2024-09-12T17:30:16.686562+0000","last_became_peered":"2024-09-12T17:30:16.686562+0000","last_unstale":"2024-09-12T18:11:34.877246+0000","last_undegraded":"2024-09-12T18:11:34.877246+0000","last_fullsized":"2024-09-12T18:11:34.877246+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:17:00.235108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"263'5","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:41.207715+0000","last_change":"2024-09-12T17:30:12.644840+0000","last_active":"2024-09-12T18:11:41.207715+0000","last_peered":"2024-09-12T18:11:41.207715+0000","last_clean":"2024-09-12T18:11:41.207715+0000","last_became_active":"2024-09-12T17:30:12.644490+0000","last_became_peered":"2024-09-12T17:30:12.644490+0000","last_unstale":"2024-09-12T18:11:41.207715+0000","last_undegraded":"2024-09-12T18:11:41.207715+0000","last_fullsized":"2024-09-12T18:11:41.207715+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:52:02.191118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":9216,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"263'23","reported_seq":116,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:54.882083+0000","last_change":"2024-09-12T17:26:35.665188+0000","last_active":"2024-09-12T18:09:54.882083+0000","last_peered":"2024-09-12T18:09:54.882083+0000","last_clean":"2024-09-12T18:09:54.882083+0000","last_became_active":"2024-09-12T17:26:35.664849+0000","last_became_peered":"2024-09-12T17:26:35.664849+0000","last_unstale":"2024-09-12T18:09:54.882083+0000","last_undegraded":"2024-09-12T18:09:54.882083+0000","last_fullsized":"2024-09-12T18:09:54.882083+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":79,"num_write":44,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:54.863875+0000","last_change":"2024-09-12T17:46:57.089388+0000","last_active":"2024-09-12T18:09:54.863875+0000","last_peered":"2024-09-12T18:09:54.863875+0000","last_clean":"2024-09-12T18:09:54.863875+0000","last_became_active":"2024-09-12T17:46:57.089081+0000","last_became_peered":"2024-09-12T17:46:57.089081+0000","last_unstale":"2024-09-12T18:09:54.863875+0000","last_undegraded":"2024-09-12T18:09:54.863875+0000","last_fullsized":"2024-09-12T18:09:54.863875+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"0'0","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:54.834972+0000","last_change":"2024-09-12T17:30:16.681225+0000","last_active":"2024-09-12T18:07:54.834972+0000","last_peered":"2024-09-12T18:07:54.834972+0000","last_clean":"2024-09-12T18:07:54.834972+0000","last_became_active":"2024-09-12T17:30:16.680901+0000","last_became_peered":"2024-09-12T17:30:16.680901+0000","last_unstale":"2024-09-12T18:07:54.834972+0000","last_undegraded":"2024-09-12T18:07:54.834972+0000","last_fullsized":"2024-09-12T18:07:54.834972+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:32:33.218603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"0'0","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:49.863301+0000","last_change":"2024-09-12T17:30:12.649239+0000","last_active":"2024-09-12T18:09:49.863301+0000","last_peered":"2024-09-12T18:09:49.863301+0000","last_clean":"2024-09-12T18:09:49.863301+0000","last_became_active":"2024-09-12T17:30:12.648875+0000","last_became_peered":"2024-09-12T17:30:12.648875+0000","last_unstale":"2024-09-12T18:09:49.863301+0000","last_undegraded":"2024-09-12T18:09:49.863301+0000","last_fullsized":"2024-09-12T18:09:49.863301+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"263'15","reported_seq":93,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:54.849551+0000","last_change":"2024-09-12T17:26:35.668474+0000","last_active":"2024-09-12T18:09:54.849551+0000","last_peered":"2024-09-12T18:09:54.849551+0000","last_clean":"2024-09-12T18:09:54.849551+0000","last_became_active":"2024-09-12T17:26:35.668118+0000","last_became_peered":"2024-09-12T17:26:35.668118+0000","last_unstale":"2024-09-12T18:09:54.849551+0000","last_undegraded":"2024-09-12T18:09:54.849551+0000","last_fullsized":"2024-09-12T18:09:54.849551+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":44,"num_write":31,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:54.862677+0000","last_change":"2024-09-12T17:46:57.086214+0000","last_active":"2024-09-12T18:09:54.862677+0000","last_peered":"2024-09-12T18:09:54.862677+0000","last_clean":"2024-09-12T18:09:54.862677+0000","last_became_active":"2024-09-12T17:46:57.085922+0000","last_became_peered":"2024-09-12T17:46:57.085922+0000","last_unstale":"2024-09-12T18:09:54.862677+0000","last_undegraded":"2024-09-12T18:09:54.862677+0000","last_fullsized":"2024-09-12T18:09:54.862677+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"263'6","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:41.255837+0000","last_change":"2024-09-12T17:30:16.669329+0000","last_active":"2024-09-12T18:11:41.255837+0000","last_peered":"2024-09-12T18:11:41.255837+0000","last_clean":"2024-09-12T18:11:41.255837+0000","last_became_active":"2024-09-12T17:30:16.668999+0000","last_became_peered":"2024-09-12T17:30:16.668999+0000","last_unstale":"2024-09-12T18:11:41.255837+0000","last_undegraded":"2024-09-12T18:11:41.255837+0000","last_fullsized":"2024-09-12T18:11:41.255837+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":12288,"num_write":11,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"0'0","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:59.843576+0000","last_change":"2024-09-12T17:30:12.650378+0000","last_active":"2024-09-12T18:09:59.843576+0000","last_peered":"2024-09-12T18:09:59.843576+0000","last_clean":"2024-09-12T18:09:59.843576+0000","last_became_active":"2024-09-12T17:30:12.649350+0000","last_became_peered":"2024-09-12T17:30:12.649350+0000","last_unstale":"2024-09-12T18:09:59.843576+0000","last_undegraded":"2024-09-12T18:09:59.843576+0000","last_fullsized":"2024-09-12T18:09:59.843576+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"263'20","reported_seq":116,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:54.882176+0000","last_change":"2024-09-12T17:26:35.667425+0000","last_active":"2024-09-12T18:09:54.882176+0000","last_peered":"2024-09-12T18:09:54.882176+0000","last_clean":"2024-09-12T18:09:54.882176+0000","last_became_active":"2024-09-12T17:26:35.667060+0000","last_became_peered":"2024-09-12T17:26:35.667060+0000","last_unstale":"2024-09-12T18:09:54.882176+0000","last_undegraded":"2024-09-12T18:09:54.882176+0000","last_fullsized":"2024-09-12T18:09:54.882176+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":80,"num_write":36,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:00.146690+0000","last_change":"2024-09-12T17:46:57.078643+0000","last_active":"2024-09-12T18:09:00.146690+0000","last_peered":"2024-09-12T18:09:00.146690+0000","last_clean":"2024-09-12T18:09:00.146690+0000","last_became_active":"2024-09-12T17:46:57.076358+0000","last_became_peered":"2024-09-12T17:46:57.076358+0000","last_unstale":"2024-09-12T18:09:00.146690+0000","last_undegraded":"2024-09-12T18:09:00.146690+0000","last_fullsized":"2024-09-12T18:09:00.146690+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:22:38.368544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"260'3","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:19.857246+0000","last_change":"2024-09-12T17:30:16.676537+0000","last_active":"2024-09-12T18:09:19.857246+0000","last_peered":"2024-09-12T18:09:19.857246+0000","last_clean":"2024-09-12T18:09:19.857246+0000","last_became_active":"2024-09-12T17:30:16.676187+0000","last_became_peered":"2024-09-12T17:30:16.676187+0000","last_unstale":"2024-09-12T18:09:19.857246+0000","last_undegraded":"2024-09-12T18:09:19.857246+0000","last_fullsized":"2024-09-12T18:09:19.857246+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:03:12.668403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"263'5","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:24.875282+0000","last_change":"2024-09-12T17:30:12.651492+0000","last_active":"2024-09-12T18:11:24.875282+0000","last_peered":"2024-09-12T18:11:24.875282+0000","last_clean":"2024-09-12T18:11:24.875282+0000","last_became_active":"2024-09-12T17:30:12.651254+0000","last_became_peered":"2024-09-12T17:30:12.651254+0000","last_unstale":"2024-09-12T18:11:24.875282+0000","last_undegraded":"2024-09-12T18:11:24.875282+0000","last_fullsized":"2024-09-12T18:11:24.875282+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:54:45.814379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":16,"num_write":10,"num_write_kb":1040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"263'21","reported_seq":106,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:19.848719+0000","last_change":"2024-09-12T17:26:35.660865+0000","last_active":"2024-09-12T18:08:19.848719+0000","last_peered":"2024-09-12T18:08:19.848719+0000","last_clean":"2024-09-12T18:08:19.848719+0000","last_became_active":"2024-09-12T17:26:35.660521+0000","last_became_peered":"2024-09-12T17:26:35.660521+0000","last_unstale":"2024-09-12T18:08:19.848719+0000","last_undegraded":"2024-09-12T18:08:19.848719+0000","last_fullsized":"2024-09-12T18:08:19.848719+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:36:23.758533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":60,"num_write":47,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:54.862197+0000","last_change":"2024-09-12T17:46:57.076516+0000","last_active":"2024-09-12T18:09:54.862197+0000","last_peered":"2024-09-12T18:09:54.862197+0000","last_clean":"2024-09-12T18:09:54.862197+0000","last_became_active":"2024-09-12T17:46:57.075936+0000","last_became_peered":"2024-09-12T17:46:57.075936+0000","last_unstale":"2024-09-12T18:09:54.862197+0000","last_undegraded":"2024-09-12T18:09:54.862197+0000","last_fullsized":"2024-09-12T18:09:54.862197+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"0'0","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:19.856809+0000","last_change":"2024-09-12T17:30:16.671561+0000","last_active":"2024-09-12T18:09:19.856809+0000","last_peered":"2024-09-12T18:09:19.856809+0000","last_clean":"2024-09-12T18:09:19.856809+0000","last_became_active":"2024-09-12T17:30:16.671232+0000","last_became_peered":"2024-09-12T17:30:16.671232+0000","last_unstale":"2024-09-12T18:09:19.856809+0000","last_undegraded":"2024-09-12T18:09:19.856809+0000","last_fullsized":"2024-09-12T18:09:19.856809+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:01:53.261691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"260'3","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:14.856411+0000","last_change":"2024-09-12T17:30:12.652805+0000","last_active":"2024-09-12T18:09:14.856411+0000","last_peered":"2024-09-12T18:09:14.856411+0000","last_clean":"2024-09-12T18:09:14.856411+0000","last_became_active":"2024-09-12T17:30:12.652439+0000","last_became_peered":"2024-09-12T17:30:12.652439+0000","last_unstale":"2024-09-12T18:09:14.856411+0000","last_undegraded":"2024-09-12T18:09:14.856411+0000","last_fullsized":"2024-09-12T18:09:14.856411+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:38:28.870273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"263'34","reported_seq":144,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:15.141873+0000","last_change":"2024-09-12T17:26:35.664662+0000","last_active":"2024-09-12T18:08:15.141873+0000","last_peered":"2024-09-12T18:08:15.141873+0000","last_clean":"2024-09-12T18:08:15.141873+0000","last_became_active":"2024-09-12T17:26:35.664338+0000","last_became_peered":"2024-09-12T17:26:35.664338+0000","last_unstale":"2024-09-12T18:08:15.141873+0000","last_undegraded":"2024-09-12T18:08:15.141873+0000","last_fullsized":"2024-09-12T18:08:15.141873+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:31:50.906050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":161,"num_read_kb":109,"num_write":67,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"262'1","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:39.834842+0000","last_change":"2024-09-12T17:46:57.091123+0000","last_active":"2024-09-12T18:08:39.834842+0000","last_peered":"2024-09-12T18:08:39.834842+0000","last_clean":"2024-09-12T18:08:39.834842+0000","last_became_active":"2024-09-12T17:46:57.090581+0000","last_became_peered":"2024-09-12T17:46:57.090581+0000","last_unstale":"2024-09-12T18:08:39.834842+0000","last_undegraded":"2024-09-12T18:08:39.834842+0000","last_fullsized":"2024-09-12T18:08:39.834842+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:32:17.465596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"260'3","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:55.153057+0000","last_change":"2024-09-12T17:30:16.677712+0000","last_active":"2024-09-12T18:09:55.153057+0000","last_peered":"2024-09-12T18:09:55.153057+0000","last_clean":"2024-09-12T18:09:55.153057+0000","last_became_active":"2024-09-12T17:30:16.677428+0000","last_became_peered":"2024-09-12T17:30:16.677428+0000","last_unstale":"2024-09-12T18:09:55.153057+0000","last_undegraded":"2024-09-12T18:09:55.153057+0000","last_fullsized":"2024-09-12T18:09:55.153057+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"263'6","reported_seq":59,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:10:19.866940+0000","last_change":"2024-09-12T17:30:12.644935+0000","last_active":"2024-09-12T18:10:19.866940+0000","last_peered":"2024-09-12T18:10:19.866940+0000","last_clean":"2024-09-12T18:10:19.866940+0000","last_became_active":"2024-09-12T17:30:12.644600+0000","last_became_peered":"2024-09-12T17:30:12.644600+0000","last_unstale":"2024-09-12T18:10:19.866940+0000","last_undegraded":"2024-09-12T18:10:19.866940+0000","last_fullsized":"2024-09-12T18:10:19.866940+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:08:42.394913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6144,"num_write":11,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"263'63","reported_seq":232,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:14.846770+0000","last_change":"2024-09-12T17:26:35.658927+0000","last_active":"2024-09-12T18:08:14.846770+0000","last_peered":"2024-09-12T18:08:14.846770+0000","last_clean":"2024-09-12T18:08:14.846770+0000","last_became_active":"2024-09-12T17:26:35.658630+0000","last_became_peered":"2024-09-12T17:26:35.658630+0000","last_unstale":"2024-09-12T18:08:14.846770+0000","last_undegraded":"2024-09-12T18:08:14.846770+0000","last_fullsized":"2024-09-12T18:08:14.846770+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:40:44.086306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":336,"num_read_kb":235,"num_write":105,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:39.840111+0000","last_change":"2024-09-12T17:46:57.093471+0000","last_active":"2024-09-12T18:08:39.840111+0000","last_peered":"2024-09-12T18:08:39.840111+0000","last_clean":"2024-09-12T18:08:39.840111+0000","last_became_active":"2024-09-12T17:46:57.092472+0000","last_became_peered":"2024-09-12T17:46:57.092472+0000","last_unstale":"2024-09-12T18:08:39.840111+0000","last_undegraded":"2024-09-12T18:08:39.840111+0000","last_fullsized":"2024-09-12T18:08:39.840111+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:53:15.268714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"0'0","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:34.849448+0000","last_change":"2024-09-12T17:30:16.675715+0000","last_active":"2024-09-12T18:08:34.849448+0000","last_peered":"2024-09-12T18:08:34.849448+0000","last_clean":"2024-09-12T18:08:34.849448+0000","last_became_active":"2024-09-12T17:30:16.675380+0000","last_became_peered":"2024-09-12T17:30:16.675380+0000","last_unstale":"2024-09-12T18:08:34.849448+0000","last_undegraded":"2024-09-12T18:08:34.849448+0000","last_fullsized":"2024-09-12T18:08:34.849448+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:03:46.402687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"0'0","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:49.863251+0000","last_change":"2024-09-12T17:30:12.652798+0000","last_active":"2024-09-12T18:09:49.863251+0000","last_peered":"2024-09-12T18:09:49.863251+0000","last_clean":"2024-09-12T18:09:49.863251+0000","last_became_active":"2024-09-12T17:30:12.652368+0000","last_became_peered":"2024-09-12T17:30:12.652368+0000","last_unstale":"2024-09-12T18:09:49.863251+0000","last_undegraded":"2024-09-12T18:09:49.863251+0000","last_fullsized":"2024-09-12T18:09:49.863251+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"263'14","reported_seq":92,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:14.847538+0000","last_change":"2024-09-12T17:26:35.662321+0000","last_active":"2024-09-12T18:08:14.847538+0000","last_peered":"2024-09-12T18:08:14.847538+0000","last_clean":"2024-09-12T18:08:14.847538+0000","last_became_active":"2024-09-12T17:26:35.662029+0000","last_became_peered":"2024-09-12T17:26:35.662029+0000","last_unstale":"2024-09-12T18:08:14.847538+0000","last_undegraded":"2024-09-12T18:08:14.847538+0000","last_fullsized":"2024-09-12T18:08:14.847538+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:25:20.058995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":47,"num_write":25,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:54.849471+0000","last_change":"2024-09-12T17:46:57.088925+0000","last_active":"2024-09-12T18:09:54.849471+0000","last_peered":"2024-09-12T18:09:54.849471+0000","last_clean":"2024-09-12T18:09:54.849471+0000","last_became_active":"2024-09-12T17:46:57.088577+0000","last_became_peered":"2024-09-12T17:46:57.088577+0000","last_unstale":"2024-09-12T18:09:54.849471+0000","last_undegraded":"2024-09-12T18:09:54.849471+0000","last_fullsized":"2024-09-12T18:09:54.849471+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"263'5","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:41.180884+0000","last_change":"2024-09-12T17:30:16.687859+0000","last_active":"2024-09-12T18:11:41.180884+0000","last_peered":"2024-09-12T18:11:41.180884+0000","last_clean":"2024-09-12T18:11:41.180884+0000","last_became_active":"2024-09-12T17:30:16.687560+0000","last_became_peered":"2024-09-12T17:30:16.687560+0000","last_unstale":"2024-09-12T18:11:41.180884+0000","last_undegraded":"2024-09-12T18:11:41.180884+0000","last_fullsized":"2024-09-12T18:11:41.180884+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":15360,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"260'5","reported_seq":64,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:50.152238+0000","last_change":"2024-09-12T17:30:12.646334+0000","last_active":"2024-09-12T18:09:50.152238+0000","last_peered":"2024-09-12T18:09:50.152238+0000","last_clean":"2024-09-12T18:09:50.152238+0000","last_became_active":"2024-09-12T17:30:12.646002+0000","last_became_peered":"2024-09-12T17:30:12.646002+0000","last_unstale":"2024-09-12T18:09:50.152238+0000","last_undegraded":"2024-09-12T18:09:50.152238+0000","last_fullsized":"2024-09-12T18:09:50.152238+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"263'38","reported_seq":162,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:14.867529+0000","last_change":"2024-09-12T17:26:35.665038+0000","last_active":"2024-09-12T18:08:14.867529+0000","last_peered":"2024-09-12T18:08:14.867529+0000","last_clean":"2024-09-12T18:08:14.867529+0000","last_became_active":"2024-09-12T17:26:35.664653+0000","last_became_peered":"2024-09-12T17:26:35.664653+0000","last_unstale":"2024-09-12T18:08:14.867529+0000","last_undegraded":"2024-09-12T18:08:14.867529+0000","last_fullsized":"2024-09-12T18:08:14.867529+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:25:13.289455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":203,"num_read_kb":159,"num_write":60,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:59.864521+0000","last_change":"2024-09-12T17:46:57.092076+0000","last_active":"2024-09-12T18:09:59.864521+0000","last_peered":"2024-09-12T18:09:59.864521+0000","last_clean":"2024-09-12T18:09:59.864521+0000","last_became_active":"2024-09-12T17:46:57.091489+0000","last_became_peered":"2024-09-12T17:46:57.091489+0000","last_unstale":"2024-09-12T18:09:59.864521+0000","last_undegraded":"2024-09-12T18:09:59.864521+0000","last_fullsized":"2024-09-12T18:09:59.864521+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"263'2","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:41.097801+0000","last_change":"2024-09-12T17:30:16.671442+0000","last_active":"2024-09-12T18:11:41.097801+0000","last_peered":"2024-09-12T18:11:41.097801+0000","last_clean":"2024-09-12T18:11:41.097801+0000","last_became_active":"2024-09-12T17:30:16.671126+0000","last_became_peered":"2024-09-12T17:30:16.671126+0000","last_unstale":"2024-09-12T18:11:41.097801+0000","last_undegraded":"2024-09-12T18:11:41.097801+0000","last_fullsized":"2024-09-12T18:11:41.097801+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":48,"num_write":2,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"260'3","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:49.881238+0000","last_change":"2024-09-12T17:30:12.645438+0000","last_active":"2024-09-12T18:09:49.881238+0000","last_peered":"2024-09-12T18:09:49.881238+0000","last_clean":"2024-09-12T18:09:49.881238+0000","last_became_active":"2024-09-12T17:30:12.645099+0000","last_became_peered":"2024-09-12T17:30:12.645099+0000","last_unstale":"2024-09-12T18:09:49.881238+0000","last_undegraded":"2024-09-12T18:09:49.881238+0000","last_fullsized":"2024-09-12T18:09:49.881238+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"263'42","reported_seq":167,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:39.851442+0000","last_change":"2024-09-12T17:26:35.666120+0000","last_active":"2024-09-12T18:08:39.851442+0000","last_peered":"2024-09-12T18:08:39.851442+0000","last_clean":"2024-09-12T18:08:39.851442+0000","last_became_active":"2024-09-12T17:26:35.665804+0000","last_became_peered":"2024-09-12T17:26:35.665804+0000","last_unstale":"2024-09-12T18:08:39.851442+0000","last_undegraded":"2024-09-12T18:08:39.851442+0000","last_fullsized":"2024-09-12T18:08:39.851442+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:39:01.905486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":202,"num_read_kb":139,"num_write":84,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"263'208","reported_seq":819,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:00.542681+0000","last_change":"2024-09-12T18:12:00.542681+0000","last_active":"2024-09-12T18:12:00.542681+0000","last_peered":"2024-09-12T18:12:00.542681+0000","last_clean":"2024-09-12T18:12:00.542681+0000","last_became_active":"2024-09-12T17:10:42.523450+0000","last_became_peered":"2024-09-12T17:10:42.523450+0000","last_unstale":"2024-09-12T18:12:00.542681+0000","last_undegraded":"2024-09-12T18:12:00.542681+0000","last_fullsized":"2024-09-12T18:12:00.542681+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'208","last_scrub_stamp":"2024-09-12T18:12:00.542555+0000","last_deep_scrub":"263'208","last_deep_scrub_stamp":"2024-09-12T18:12:00.542555+0000","last_clean_scrub_stamp":"2024-09-12T18:12:00.542555+0000","objects_scrubbed":4,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:08:21.396379+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2159819,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":364,"num_read_kb":12797,"num_write":994,"num_write_kb":38748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0,5],"acting":[7,6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"263'415","reported_seq":1937,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:58.360923+0000","last_change":"2024-09-12T18:11:58.360923+0000","last_active":"2024-09-12T18:11:58.360923+0000","last_peered":"2024-09-12T18:11:58.360923+0000","last_clean":"2024-09-12T18:11:58.360923+0000","last_became_active":"2024-09-12T17:10:44.521072+0000","last_became_peered":"2024-09-12T17:10:44.521072+0000","last_unstale":"2024-09-12T18:11:58.360923+0000","last_undegraded":"2024-09-12T18:11:58.360923+0000","last_fullsized":"2024-09-12T18:11:58.360923+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'415","last_scrub_stamp":"2024-09-12T18:11:58.360809+0000","last_deep_scrub":"263'415","last_deep_scrub_stamp":"2024-09-12T18:11:58.360809+0000","last_clean_scrub_stamp":"2024-09-12T18:11:58.360809+0000","objects_scrubbed":7,"log_size":15,"log_dups_size":400,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:24:00.846126+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2237,"num_read_kb":2119,"num_write":474,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1856,"num_omap_keys":8,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"263'162","reported_seq":806,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:51.665824+0000","last_change":"2024-09-12T18:11:51.665824+0000","last_active":"2024-09-12T18:11:51.665824+0000","last_peered":"2024-09-12T18:11:51.665824+0000","last_clean":"2024-09-12T18:11:51.665824+0000","last_became_active":"2024-09-12T17:10:42.515714+0000","last_became_peered":"2024-09-12T17:10:42.515714+0000","last_unstale":"2024-09-12T18:11:51.665824+0000","last_undegraded":"2024-09-12T18:11:51.665824+0000","last_fullsized":"2024-09-12T18:11:51.665824+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'162","last_scrub_stamp":"2024-09-12T18:11:51.665727+0000","last_deep_scrub":"263'162","last_deep_scrub_stamp":"2024-09-12T18:11:51.665727+0000","last_clean_scrub_stamp":"2024-09-12T18:11:51.665727+0000","objects_scrubbed":1,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:41:53.425835+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32998,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":410,"num_read_kb":24642,"num_write":804,"num_write_kb":5824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6,4],"acting":[1,0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"263'569","reported_seq":2045,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:04.589219+0000","last_change":"2024-09-12T18:12:04.589219+0000","last_active":"2024-09-12T18:12:04.589219+0000","last_peered":"2024-09-12T18:12:04.589219+0000","last_clean":"2024-09-12T18:12:04.589219+0000","last_became_active":"2024-09-12T17:10:44.520662+0000","last_became_peered":"2024-09-12T17:10:44.520662+0000","last_unstale":"2024-09-12T18:12:04.589219+0000","last_undegraded":"2024-09-12T18:12:04.589219+0000","last_fullsized":"2024-09-12T18:12:04.589219+0000","mapping_epoch":26,"log_start":"263'500","ondisk_log_start":"263'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'569","last_scrub_stamp":"2024-09-12T18:12:04.589126+0000","last_deep_scrub":"263'569","last_deep_scrub_stamp":"2024-09-12T18:12:04.589126+0000","last_clean_scrub_stamp":"2024-09-12T18:12:04.589126+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":500,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:21:58.586995+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2846,"num_read_kb":2568,"num_write":745,"num_write_kb":247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"263'196","reported_seq":890,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:52.688218+0000","last_change":"2024-09-12T18:11:52.688218+0000","last_active":"2024-09-12T18:11:52.688218+0000","last_peered":"2024-09-12T18:11:52.688218+0000","last_clean":"2024-09-12T18:11:52.688218+0000","last_became_active":"2024-09-12T17:10:42.514502+0000","last_became_peered":"2024-09-12T17:10:42.514502+0000","last_unstale":"2024-09-12T18:11:52.688218+0000","last_undegraded":"2024-09-12T18:11:52.688218+0000","last_fullsized":"2024-09-12T18:11:52.688218+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'196","last_scrub_stamp":"2024-09-12T18:11:52.688106+0000","last_deep_scrub":"263'196","last_deep_scrub_stamp":"2024-09-12T18:11:52.688106+0000","last_clean_scrub_stamp":"2024-09-12T18:11:52.688106+0000","objects_scrubbed":4,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:28:08.638670+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":373080,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":506,"num_read_kb":116995,"num_write":945,"num_write_kb":47431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,7],"acting":[0,2,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"263'513","reported_seq":2203,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:03.347220+0000","last_change":"2024-09-12T18:12:03.347220+0000","last_active":"2024-09-12T18:12:03.347220+0000","last_peered":"2024-09-12T18:12:03.347220+0000","last_clean":"2024-09-12T18:12:03.347220+0000","last_became_active":"2024-09-12T17:10:44.515053+0000","last_became_peered":"2024-09-12T17:10:44.515053+0000","last_unstale":"2024-09-12T18:12:03.347220+0000","last_undegraded":"2024-09-12T18:12:03.347220+0000","last_fullsized":"2024-09-12T18:12:03.347220+0000","mapping_epoch":26,"log_start":"263'501","ondisk_log_start":"263'501","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'513","last_scrub_stamp":"2024-09-12T18:12:03.347112+0000","last_deep_scrub":"263'513","last_deep_scrub_stamp":"2024-09-12T18:12:03.347112+0000","last_clean_scrub_stamp":"2024-09-12T18:12:03.347112+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":501,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:41:45.556810+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2823,"num_read_kb":2642,"num_write":595,"num_write_kb":151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2296,"num_omap_keys":9,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"263'186","reported_seq":819,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:59.404105+0000","last_change":"2024-09-12T18:11:59.404105+0000","last_active":"2024-09-12T18:11:59.404105+0000","last_peered":"2024-09-12T18:11:59.404105+0000","last_clean":"2024-09-12T18:11:59.404105+0000","last_became_active":"2024-09-12T17:10:42.515202+0000","last_became_peered":"2024-09-12T17:10:42.515202+0000","last_unstale":"2024-09-12T18:11:59.404105+0000","last_undegraded":"2024-09-12T18:11:59.404105+0000","last_fullsized":"2024-09-12T18:11:59.404105+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'186","last_scrub_stamp":"2024-09-12T18:11:59.403938+0000","last_deep_scrub":"263'186","last_deep_scrub_stamp":"2024-09-12T18:11:59.403938+0000","last_clean_scrub_stamp":"2024-09-12T18:11:59.403938+0000","objects_scrubbed":4,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:01:41.301225+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":568149,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":399,"num_read_kb":32737,"num_write":933,"num_write_kb":40819,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7,2],"acting":[5,3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"263'479","reported_seq":2065,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:01.687961+0000","last_change":"2024-09-12T18:12:01.687961+0000","last_active":"2024-09-12T18:12:01.687961+0000","last_peered":"2024-09-12T18:12:01.687961+0000","last_clean":"2024-09-12T18:12:01.687961+0000","last_became_active":"2024-09-12T17:10:44.523767+0000","last_became_peered":"2024-09-12T17:10:44.523767+0000","last_unstale":"2024-09-12T18:12:01.687961+0000","last_undegraded":"2024-09-12T18:12:01.687961+0000","last_fullsized":"2024-09-12T18:12:01.687961+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'479","last_scrub_stamp":"2024-09-12T18:12:01.687869+0000","last_deep_scrub":"263'479","last_deep_scrub_stamp":"2024-09-12T18:12:01.687869+0000","last_clean_scrub_stamp":"2024-09-12T18:12:01.687869+0000","objects_scrubbed":2,"log_size":79,"log_dups_size":400,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:06:43.686298+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2572,"num_read_kb":2417,"num_write":590,"num_write_kb":142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":254,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"263'159","reported_seq":798,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:59.549642+0000","last_change":"2024-09-12T18:11:59.549642+0000","last_active":"2024-09-12T18:11:59.549642+0000","last_peered":"2024-09-12T18:11:59.549642+0000","last_clean":"2024-09-12T18:11:59.549642+0000","last_became_active":"2024-09-12T17:10:42.523427+0000","last_became_peered":"2024-09-12T17:10:42.523427+0000","last_unstale":"2024-09-12T18:11:59.549642+0000","last_undegraded":"2024-09-12T18:11:59.549642+0000","last_fullsized":"2024-09-12T18:11:59.549642+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'159","last_scrub_stamp":"2024-09-12T18:11:59.549547+0000","last_deep_scrub":"263'159","last_deep_scrub_stamp":"2024-09-12T18:11:59.549547+0000","last_clean_scrub_stamp":"2024-09-12T18:11:59.549547+0000","objects_scrubbed":1,"log_size":59,"log_dups_size":100,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:28:15.459977+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":439,"num_read_kb":36335,"num_write":769,"num_write_kb":30424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3,6],"acting":[7,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"263'478","reported_seq":1970,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:58.695565+0000","last_change":"2024-09-12T18:11:58.695565+0000","last_active":"2024-09-12T18:11:58.695565+0000","last_peered":"2024-09-12T18:11:58.695565+0000","last_clean":"2024-09-12T18:11:58.695565+0000","last_became_active":"2024-09-12T17:10:44.510692+0000","last_became_peered":"2024-09-12T17:10:44.510692+0000","last_unstale":"2024-09-12T18:11:58.695565+0000","last_undegraded":"2024-09-12T18:11:58.695565+0000","last_fullsized":"2024-09-12T18:11:58.695565+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'478","last_scrub_stamp":"2024-09-12T18:11:58.695474+0000","last_deep_scrub":"263'478","last_deep_scrub_stamp":"2024-09-12T18:11:58.695474+0000","last_clean_scrub_stamp":"2024-09-12T18:11:58.695474+0000","objects_scrubbed":3,"log_size":78,"log_dups_size":400,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:52:06.977144+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2639,"num_read_kb":2478,"num_write":625,"num_write_kb":223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"263'191","reported_seq":817,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:41.158341+0000","last_change":"2024-09-12T17:10:42.525823+0000","last_active":"2024-09-12T18:11:41.158341+0000","last_peered":"2024-09-12T18:11:41.158341+0000","last_clean":"2024-09-12T18:11:41.158341+0000","last_became_active":"2024-09-12T17:10:42.525363+0000","last_became_peered":"2024-09-12T17:10:42.525363+0000","last_unstale":"2024-09-12T18:11:41.158341+0000","last_undegraded":"2024-09-12T18:11:41.158341+0000","last_fullsized":"2024-09-12T18:11:41.158341+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:41.475151+0000","last_clean_scrub_stamp":"2024-09-12T17:10:41.475151+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:02:50.629102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":412,"num_read_kb":34311,"num_write":954,"num_write_kb":12654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,4,1],"acting":[5,0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"263'875","reported_seq":2655,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:48.689421+0000","last_change":"2024-09-12T17:10:44.514182+0000","last_active":"2024-09-12T18:09:48.689421+0000","last_peered":"2024-09-12T18:09:48.689421+0000","last_clean":"2024-09-12T18:09:48.689421+0000","last_became_active":"2024-09-12T17:10:44.513865+0000","last_became_peered":"2024-09-12T17:10:44.513865+0000","last_unstale":"2024-09-12T18:09:48.689421+0000","last_undegraded":"2024-09-12T18:09:48.689421+0000","last_fullsized":"2024-09-12T18:09:48.689421+0000","mapping_epoch":26,"log_start":"263'800","ondisk_log_start":"263'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":800,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:58:50.879901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4549,"num_read_kb":4126,"num_write":1137,"num_write_kb":421,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"263'191","reported_seq":997,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:57.497338+0000","last_change":"2024-09-12T18:11:57.497338+0000","last_active":"2024-09-12T18:11:57.497338+0000","last_peered":"2024-09-12T18:11:57.497338+0000","last_clean":"2024-09-12T18:11:57.497338+0000","last_became_active":"2024-09-12T17:10:42.531356+0000","last_became_peered":"2024-09-12T17:10:42.531356+0000","last_unstale":"2024-09-12T18:11:57.497338+0000","last_undegraded":"2024-09-12T18:11:57.497338+0000","last_fullsized":"2024-09-12T18:11:57.497338+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'191","last_scrub_stamp":"2024-09-12T18:11:57.497214+0000","last_deep_scrub":"263'191","last_deep_scrub_stamp":"2024-09-12T18:11:57.497214+0000","last_clean_scrub_stamp":"2024-09-12T18:11:57.497214+0000","objects_scrubbed":6,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:44:43.318908+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":115,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":751,"num_read_kb":2366,"num_write":954,"num_write_kb":15239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4,6],"acting":[7,0,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"263'409","reported_seq":1925,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:09.599316+0000","last_change":"2024-09-12T17:10:44.521355+0000","last_active":"2024-09-12T18:09:09.599316+0000","last_peered":"2024-09-12T18:09:09.599316+0000","last_clean":"2024-09-12T18:09:09.599316+0000","last_became_active":"2024-09-12T17:10:44.520609+0000","last_became_peered":"2024-09-12T17:10:44.520609+0000","last_unstale":"2024-09-12T18:09:09.599316+0000","last_undegraded":"2024-09-12T18:09:09.599316+0000","last_fullsized":"2024-09-12T18:09:09.599316+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":300,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:15:20.820552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2177,"num_read_kb":2069,"num_write":470,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"263'212","reported_seq":854,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:00.692167+0000","last_change":"2024-09-12T18:12:00.692167+0000","last_active":"2024-09-12T18:12:00.692167+0000","last_peered":"2024-09-12T18:12:00.692167+0000","last_clean":"2024-09-12T18:12:00.692167+0000","last_became_active":"2024-09-12T17:10:42.527310+0000","last_became_peered":"2024-09-12T17:10:42.527310+0000","last_unstale":"2024-09-12T18:12:00.692167+0000","last_undegraded":"2024-09-12T18:12:00.692167+0000","last_fullsized":"2024-09-12T18:12:00.692167+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'212","last_scrub_stamp":"2024-09-12T18:12:00.692062+0000","last_deep_scrub":"263'212","last_deep_scrub_stamp":"2024-09-12T18:12:00.692062+0000","last_clean_scrub_stamp":"2024-09-12T18:12:00.692062+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:26:48.984760+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174892,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":472,"num_read_kb":11982,"num_write":996,"num_write_kb":39362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0,2],"acting":[3,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"263'806","reported_seq":2480,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:54.804326+0000","last_change":"2024-09-12T18:11:54.804326+0000","last_active":"2024-09-12T18:11:54.804326+0000","last_peered":"2024-09-12T18:11:54.804326+0000","last_clean":"2024-09-12T18:11:54.804326+0000","last_became_active":"2024-09-12T17:10:44.517947+0000","last_became_peered":"2024-09-12T17:10:44.517947+0000","last_unstale":"2024-09-12T18:11:54.804326+0000","last_undegraded":"2024-09-12T18:11:54.804326+0000","last_fullsized":"2024-09-12T18:11:54.804326+0000","mapping_epoch":26,"log_start":"263'700","ondisk_log_start":"263'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'806","last_scrub_stamp":"2024-09-12T18:11:54.804222+0000","last_deep_scrub":"263'806","last_deep_scrub_stamp":"2024-09-12T18:11:54.804222+0000","last_clean_scrub_stamp":"2024-09-12T18:11:54.804222+0000","objects_scrubbed":3,"log_size":106,"log_dups_size":700,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:45:37.385194+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3878,"num_read_kb":3536,"num_write":1022,"num_write_kb":342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"263'408","reported_seq":2034,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:02.306451+0000","last_change":"2024-09-12T18:12:02.306451+0000","last_active":"2024-09-12T18:12:02.306451+0000","last_peered":"2024-09-12T18:12:02.306451+0000","last_clean":"2024-09-12T18:12:02.306451+0000","last_became_active":"2024-09-12T17:10:44.514293+0000","last_became_peered":"2024-09-12T17:10:44.514293+0000","last_unstale":"2024-09-12T18:12:02.306451+0000","last_undegraded":"2024-09-12T18:12:02.306451+0000","last_fullsized":"2024-09-12T18:12:02.306451+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'408","last_scrub_stamp":"2024-09-12T18:12:02.306349+0000","last_deep_scrub":"263'408","last_deep_scrub_stamp":"2024-09-12T18:12:02.306349+0000","last_clean_scrub_stamp":"2024-09-12T18:12:02.306349+0000","objects_scrubbed":2,"log_size":108,"log_dups_size":300,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:44:20.245957+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2470,"num_read_kb":2366,"num_write":468,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":694,"num_omap_keys":3,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"263'164","reported_seq":785,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:56.470083+0000","last_change":"2024-09-12T18:11:56.470083+0000","last_active":"2024-09-12T18:11:56.470083+0000","last_peered":"2024-09-12T18:11:56.470083+0000","last_clean":"2024-09-12T18:11:56.470083+0000","last_became_active":"2024-09-12T17:10:42.521637+0000","last_became_peered":"2024-09-12T17:10:42.521637+0000","last_unstale":"2024-09-12T18:11:56.470083+0000","last_undegraded":"2024-09-12T18:11:56.470083+0000","last_fullsized":"2024-09-12T18:11:56.470083+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'164","last_scrub_stamp":"2024-09-12T18:11:56.469937+0000","last_deep_scrub":"263'164","last_deep_scrub_stamp":"2024-09-12T18:11:56.469937+0000","last_clean_scrub_stamp":"2024-09-12T18:11:56.469937+0000","objects_scrubbed":5,"log_size":64,"log_dups_size":100,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:47:38.556900+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":432508,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":446,"num_read_kb":17329,"num_write":806,"num_write_kb":49238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0,1],"acting":[7,5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"263'785","reported_seq":2287,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:03.615335+0000","last_change":"2024-09-12T18:12:03.615335+0000","last_active":"2024-09-12T18:12:03.615335+0000","last_peered":"2024-09-12T18:12:03.615335+0000","last_clean":"2024-09-12T18:12:03.615335+0000","last_became_active":"2024-09-12T17:10:44.521031+0000","last_became_peered":"2024-09-12T17:10:44.521031+0000","last_unstale":"2024-09-12T18:12:03.615335+0000","last_undegraded":"2024-09-12T18:12:03.615335+0000","last_fullsized":"2024-09-12T18:12:03.615335+0000","mapping_epoch":26,"log_start":"263'700","ondisk_log_start":"263'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'785","last_scrub_stamp":"2024-09-12T18:12:03.615200+0000","last_deep_scrub":"263'785","last_deep_scrub_stamp":"2024-09-12T18:12:03.615200+0000","last_clean_scrub_stamp":"2024-09-12T18:12:03.615200+0000","objects_scrubbed":3,"log_size":85,"log_dups_size":700,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:57:53.084717+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3604,"num_read_kb":3242,"num_write":1018,"num_write_kb":360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"263'259","reported_seq":960,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:53.798419+0000","last_change":"2024-09-12T18:11:53.798419+0000","last_active":"2024-09-12T18:11:53.798419+0000","last_peered":"2024-09-12T18:11:53.798419+0000","last_clean":"2024-09-12T18:11:53.798419+0000","last_became_active":"2024-09-12T17:10:42.517679+0000","last_became_peered":"2024-09-12T17:10:42.517679+0000","last_unstale":"2024-09-12T18:11:53.798419+0000","last_undegraded":"2024-09-12T18:11:53.798419+0000","last_fullsized":"2024-09-12T18:11:53.798419+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'259","last_scrub_stamp":"2024-09-12T18:11:53.798287+0000","last_deep_scrub":"263'259","last_deep_scrub_stamp":"2024-09-12T18:11:53.798287+0000","last_clean_scrub_stamp":"2024-09-12T18:11:53.798287+0000","objects_scrubbed":4,"log_size":59,"log_dups_size":200,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:05.021160+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1604218,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":855,"num_read_kb":4303,"num_write":1129,"num_write_kb":28670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2,1],"acting":[6,5,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"263'359","reported_seq":1821,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:01.415160+0000","last_change":"2024-09-12T18:12:01.415160+0000","last_active":"2024-09-12T18:12:01.415160+0000","last_peered":"2024-09-12T18:12:01.415160+0000","last_clean":"2024-09-12T18:12:01.415160+0000","last_became_active":"2024-09-12T17:10:44.518183+0000","last_became_peered":"2024-09-12T17:10:44.518183+0000","last_unstale":"2024-09-12T18:12:01.415160+0000","last_undegraded":"2024-09-12T18:12:01.415160+0000","last_fullsized":"2024-09-12T18:12:01.415160+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'359","last_scrub_stamp":"2024-09-12T18:12:01.415072+0000","last_deep_scrub":"263'359","last_deep_scrub_stamp":"2024-09-12T18:12:01.415072+0000","last_clean_scrub_stamp":"2024-09-12T18:12:01.415072+0000","objects_scrubbed":1,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:05:01.730803+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1979,"num_read_kb":1899,"num_write":385,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"263'232","reported_seq":961,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:52.832302+0000","last_change":"2024-09-12T18:11:52.832302+0000","last_active":"2024-09-12T18:11:52.832302+0000","last_peered":"2024-09-12T18:11:52.832302+0000","last_clean":"2024-09-12T18:11:52.832302+0000","last_became_active":"2024-09-12T17:10:42.518345+0000","last_became_peered":"2024-09-12T17:10:42.518345+0000","last_unstale":"2024-09-12T18:11:52.832302+0000","last_undegraded":"2024-09-12T18:11:52.832302+0000","last_fullsized":"2024-09-12T18:11:52.832302+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'232","last_scrub_stamp":"2024-09-12T18:11:52.832185+0000","last_deep_scrub":"263'232","last_deep_scrub_stamp":"2024-09-12T18:11:52.832185+0000","last_clean_scrub_stamp":"2024-09-12T18:11:52.832185+0000","objects_scrubbed":5,"log_size":32,"log_dups_size":200,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:43:54.965686+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1367925,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":646,"num_read_kb":98876,"num_write":1054,"num_write_kb":25289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0,3],"acting":[6,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"263'518","reported_seq":2158,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:57.757617+0000","last_change":"2024-09-12T18:11:57.757617+0000","last_active":"2024-09-12T18:11:57.757617+0000","last_peered":"2024-09-12T18:11:57.757617+0000","last_clean":"2024-09-12T18:11:57.757617+0000","last_became_active":"2024-09-12T17:10:44.514645+0000","last_became_peered":"2024-09-12T17:10:44.514645+0000","last_unstale":"2024-09-12T18:11:57.757617+0000","last_undegraded":"2024-09-12T18:11:57.757617+0000","last_fullsized":"2024-09-12T18:11:57.757617+0000","mapping_epoch":26,"log_start":"263'500","ondisk_log_start":"263'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'518","last_scrub_stamp":"2024-09-12T18:11:57.757537+0000","last_deep_scrub":"263'518","last_deep_scrub_stamp":"2024-09-12T18:11:57.757537+0000","last_clean_scrub_stamp":"2024-09-12T18:11:57.757537+0000","objects_scrubbed":2,"log_size":18,"log_dups_size":500,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:17:09.508445+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2725,"num_read_kb":2548,"num_write":623,"num_write_kb":175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":640,"num_omap_keys":3,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"263'215","reported_seq":882,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:50.441705+0000","last_change":"2024-09-12T18:11:50.441705+0000","last_active":"2024-09-12T18:11:50.441705+0000","last_peered":"2024-09-12T18:11:50.441705+0000","last_clean":"2024-09-12T18:11:50.441705+0000","last_became_active":"2024-09-12T17:10:42.519000+0000","last_became_peered":"2024-09-12T17:10:42.519000+0000","last_unstale":"2024-09-12T18:11:50.441705+0000","last_undegraded":"2024-09-12T18:11:50.441705+0000","last_fullsized":"2024-09-12T18:11:50.441705+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'215","last_scrub_stamp":"2024-09-12T18:11:50.441568+0000","last_deep_scrub":"263'215","last_deep_scrub_stamp":"2024-09-12T18:11:50.441568+0000","last_clean_scrub_stamp":"2024-09-12T18:11:50.441568+0000","objects_scrubbed":4,"log_size":15,"log_dups_size":200,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:10:24.946801+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":516496,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":502,"num_read_kb":33700,"num_write":932,"num_write_kb":23229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,0],"acting":[4,3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"263'1586","reported_seq":3120,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:58.740833+0000","last_change":"2024-09-12T18:11:58.740833+0000","last_active":"2024-09-12T18:11:58.740833+0000","last_peered":"2024-09-12T18:11:58.740833+0000","last_clean":"2024-09-12T18:11:58.740833+0000","last_became_active":"2024-09-12T17:10:44.514826+0000","last_became_peered":"2024-09-12T17:10:44.514826+0000","last_unstale":"2024-09-12T18:11:58.740833+0000","last_undegraded":"2024-09-12T18:11:58.740833+0000","last_fullsized":"2024-09-12T18:11:58.740833+0000","mapping_epoch":26,"log_start":"263'1500","ondisk_log_start":"263'1500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1586","last_scrub_stamp":"2024-09-12T18:11:58.740747+0000","last_deep_scrub":"263'1586","last_deep_scrub_stamp":"2024-09-12T18:11:58.740747+0000","last_clean_scrub_stamp":"2024-09-12T18:11:58.740747+0000","objects_scrubbed":3,"log_size":86,"log_dups_size":1500,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:47:04.467281+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6865,"num_read_kb":5951,"num_write":2206,"num_write_kb":956,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":946,"num_omap_keys":4,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"263'244","reported_seq":908,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:55.609090+0000","last_change":"2024-09-12T18:11:55.609090+0000","last_active":"2024-09-12T18:11:55.609090+0000","last_peered":"2024-09-12T18:11:55.609090+0000","last_clean":"2024-09-12T18:11:55.609090+0000","last_became_active":"2024-09-12T17:10:42.532995+0000","last_became_peered":"2024-09-12T17:10:42.532995+0000","last_unstale":"2024-09-12T18:11:55.609090+0000","last_undegraded":"2024-09-12T18:11:55.609090+0000","last_fullsized":"2024-09-12T18:11:55.609090+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'244","last_scrub_stamp":"2024-09-12T18:11:55.608942+0000","last_deep_scrub":"263'244","last_deep_scrub_stamp":"2024-09-12T18:11:55.608942+0000","last_clean_scrub_stamp":"2024-09-12T18:11:55.608942+0000","objects_scrubbed":6,"log_size":44,"log_dups_size":200,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:30:38.928542+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":786501,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":539,"num_read_kb":13123,"num_write":1227,"num_write_kb":39413,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1,5],"acting":[3,6,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"263'1290","reported_seq":3025,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:04.359170+0000","last_change":"2024-09-12T18:12:04.359170+0000","last_active":"2024-09-12T18:12:04.359170+0000","last_peered":"2024-09-12T18:12:04.359170+0000","last_clean":"2024-09-12T18:12:04.359170+0000","last_became_active":"2024-09-12T17:10:44.507428+0000","last_became_peered":"2024-09-12T17:10:44.507428+0000","last_unstale":"2024-09-12T18:12:04.359170+0000","last_undegraded":"2024-09-12T18:12:04.359170+0000","last_fullsized":"2024-09-12T18:12:04.359170+0000","mapping_epoch":26,"log_start":"263'1200","ondisk_log_start":"263'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1290","last_scrub_stamp":"2024-09-12T18:12:04.359076+0000","last_deep_scrub":"263'1290","last_deep_scrub_stamp":"2024-09-12T18:12:04.359076+0000","last_clean_scrub_stamp":"2024-09-12T18:12:04.359076+0000","objects_scrubbed":2,"log_size":90,"log_dups_size":1200,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:25:36.918661+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5933,"num_read_kb":5245,"num_write":1814,"num_write_kb":777,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"263'185","reported_seq":871,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:53.698211+0000","last_change":"2024-09-12T18:11:53.698211+0000","last_active":"2024-09-12T18:11:53.698211+0000","last_peered":"2024-09-12T18:11:53.698211+0000","last_clean":"2024-09-12T18:11:53.698211+0000","last_became_active":"2024-09-12T17:10:42.529179+0000","last_became_peered":"2024-09-12T17:10:42.529179+0000","last_unstale":"2024-09-12T18:11:53.698211+0000","last_undegraded":"2024-09-12T18:11:53.698211+0000","last_fullsized":"2024-09-12T18:11:53.698211+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'185","last_scrub_stamp":"2024-09-12T18:11:53.698095+0000","last_deep_scrub":"263'185","last_deep_scrub_stamp":"2024-09-12T18:11:53.698095+0000","last_clean_scrub_stamp":"2024-09-12T18:11:53.698095+0000","objects_scrubbed":5,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:03:54.556628+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":576011,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":570,"num_read_kb":13539,"num_write":907,"num_write_kb":25869,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1,5],"acting":[0,4,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"263'159","reported_seq":680,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:49.689301+0000","last_change":"2024-09-12T17:10:52.566398+0000","last_active":"2024-09-12T18:09:49.689301+0000","last_peered":"2024-09-12T18:09:49.689301+0000","last_clean":"2024-09-12T18:09:49.689301+0000","last_became_active":"2024-09-12T17:10:52.566079+0000","last_became_peered":"2024-09-12T17:10:52.566079+0000","last_unstale":"2024-09-12T18:09:49.689301+0000","last_undegraded":"2024-09-12T18:09:49.689301+0000","last_fullsized":"2024-09-12T18:09:49.689301+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":100,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:46:37.549026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":803,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":269,"num_read_kb":255,"num_write":425,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"263'796","reported_seq":2412,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:56.605309+0000","last_change":"2024-09-12T18:11:56.605309+0000","last_active":"2024-09-12T18:11:56.605309+0000","last_peered":"2024-09-12T18:11:56.605309+0000","last_clean":"2024-09-12T18:11:56.605309+0000","last_became_active":"2024-09-12T17:10:44.522193+0000","last_became_peered":"2024-09-12T17:10:44.522193+0000","last_unstale":"2024-09-12T18:11:56.605309+0000","last_undegraded":"2024-09-12T18:11:56.605309+0000","last_fullsized":"2024-09-12T18:11:56.605309+0000","mapping_epoch":26,"log_start":"263'700","ondisk_log_start":"263'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'796","last_scrub_stamp":"2024-09-12T18:11:56.605227+0000","last_deep_scrub":"263'796","last_deep_scrub_stamp":"2024-09-12T18:11:56.605227+0000","last_clean_scrub_stamp":"2024-09-12T18:11:56.605227+0000","objects_scrubbed":1,"log_size":96,"log_dups_size":700,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:30:29.129454+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3748,"num_read_kb":3407,"num_write":1044,"num_write_kb":360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"263'203","reported_seq":853,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:55.485587+0000","last_change":"2024-09-12T18:11:55.485587+0000","last_active":"2024-09-12T18:11:55.485587+0000","last_peered":"2024-09-12T18:11:55.485587+0000","last_clean":"2024-09-12T18:11:55.485587+0000","last_became_active":"2024-09-12T17:10:42.528620+0000","last_became_peered":"2024-09-12T17:10:42.528620+0000","last_unstale":"2024-09-12T18:11:55.485587+0000","last_undegraded":"2024-09-12T18:11:55.485587+0000","last_fullsized":"2024-09-12T18:11:55.485587+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'203","last_scrub_stamp":"2024-09-12T18:11:55.485439+0000","last_deep_scrub":"263'203","last_deep_scrub_stamp":"2024-09-12T18:11:55.485439+0000","last_clean_scrub_stamp":"2024-09-12T18:11:55.485439+0000","objects_scrubbed":4,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:14:56.174736+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262203,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":497,"num_read_kb":31268,"num_write":1015,"num_write_kb":14227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4,2],"acting":[7,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:49.851570+0000","last_change":"2024-09-12T17:10:46.527973+0000","last_active":"2024-09-12T18:08:49.851570+0000","last_peered":"2024-09-12T18:08:49.851570+0000","last_clean":"2024-09-12T18:08:49.851570+0000","last_became_active":"2024-09-12T17:10:46.527663+0000","last_became_peered":"2024-09-12T17:10:46.527663+0000","last_unstale":"2024-09-12T18:08:49.851570+0000","last_undegraded":"2024-09-12T18:08:49.851570+0000","last_fullsized":"2024-09-12T18:08:49.851570+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_clean_scrub_stamp":"2024-09-12T17:10:45.504515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:21:49.638349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"263'202","reported_seq":809,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:41.367008+0000","last_change":"2024-09-12T17:10:48.545372+0000","last_active":"2024-09-12T18:11:41.367008+0000","last_peered":"2024-09-12T18:11:41.367008+0000","last_clean":"2024-09-12T18:11:41.367008+0000","last_became_active":"2024-09-12T17:10:48.544885+0000","last_became_peered":"2024-09-12T17:10:48.544885+0000","last_unstale":"2024-09-12T18:11:41.367008+0000","last_undegraded":"2024-09-12T18:11:41.367008+0000","last_fullsized":"2024-09-12T18:11:41.367008+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_clean_scrub_stamp":"2024-09-12T17:10:47.516917+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":100,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:14:40.858594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6100,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":264,"num_read_kb":318,"num_write":156,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":485,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:49.852931+0000","last_change":"2024-09-12T17:10:50.556467+0000","last_active":"2024-09-12T18:08:49.852931+0000","last_peered":"2024-09-12T18:08:49.852931+0000","last_clean":"2024-09-12T18:08:49.852931+0000","last_became_active":"2024-09-12T17:10:50.556146+0000","last_became_peered":"2024-09-12T17:10:50.556146+0000","last_unstale":"2024-09-12T18:08:49.852931+0000","last_undegraded":"2024-09-12T18:08:49.852931+0000","last_fullsized":"2024-09-12T18:08:49.852931+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_clean_scrub_stamp":"2024-09-12T17:10:49.533772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:46:08.763293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"263'2474","reported_seq":4378,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:49.683677+0000","last_change":"2024-09-12T17:10:52.572598+0000","last_active":"2024-09-12T18:09:49.683677+0000","last_peered":"2024-09-12T18:09:49.683677+0000","last_clean":"2024-09-12T18:09:49.683677+0000","last_became_active":"2024-09-12T17:10:52.572326+0000","last_became_peered":"2024-09-12T17:10:52.572326+0000","last_unstale":"2024-09-12T18:09:49.683677+0000","last_undegraded":"2024-09-12T18:09:49.683677+0000","last_fullsized":"2024-09-12T18:09:49.683677+0000","mapping_epoch":34,"log_start":"263'2400","ondisk_log_start":"263'2400","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":2400,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:07:16.923827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":211,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6220,"num_read_kb":6202,"num_write":4958,"num_write_kb":1813,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"263'424","reported_seq":1886,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:56.315526+0000","last_change":"2024-09-12T18:11:56.315526+0000","last_active":"2024-09-12T18:11:56.315526+0000","last_peered":"2024-09-12T18:11:56.315526+0000","last_clean":"2024-09-12T18:11:56.315526+0000","last_became_active":"2024-09-12T17:10:44.512755+0000","last_became_peered":"2024-09-12T17:10:44.512755+0000","last_unstale":"2024-09-12T18:11:56.315526+0000","last_undegraded":"2024-09-12T18:11:56.315526+0000","last_fullsized":"2024-09-12T18:11:56.315526+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'424","last_scrub_stamp":"2024-09-12T18:11:56.315433+0000","last_deep_scrub":"263'424","last_deep_scrub_stamp":"2024-09-12T18:11:56.315433+0000","last_clean_scrub_stamp":"2024-09-12T18:11:56.315433+0000","objects_scrubbed":1,"log_size":24,"log_dups_size":400,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:17:36.929085+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2092,"num_read_kb":1979,"num_write":465,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"263'205","reported_seq":850,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:50.670378+0000","last_change":"2024-09-12T18:11:50.670378+0000","last_active":"2024-09-12T18:11:50.670378+0000","last_peered":"2024-09-12T18:11:50.670378+0000","last_clean":"2024-09-12T18:11:50.670378+0000","last_became_active":"2024-09-12T17:10:42.513658+0000","last_became_peered":"2024-09-12T17:10:42.513658+0000","last_unstale":"2024-09-12T18:11:50.670378+0000","last_undegraded":"2024-09-12T18:11:50.670378+0000","last_fullsized":"2024-09-12T18:11:50.670378+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'205","last_scrub_stamp":"2024-09-12T18:11:50.670245+0000","last_deep_scrub":"263'205","last_deep_scrub_stamp":"2024-09-12T18:11:50.670245+0000","last_clean_scrub_stamp":"2024-09-12T18:11:50.670245+0000","objects_scrubbed":3,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:56:06.408091+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262204,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":448,"num_read_kb":17694,"num_write":957,"num_write_kb":36760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:24.853870+0000","last_change":"2024-09-12T17:10:46.528313+0000","last_active":"2024-09-12T18:09:24.853870+0000","last_peered":"2024-09-12T18:09:24.853870+0000","last_clean":"2024-09-12T18:09:24.853870+0000","last_became_active":"2024-09-12T17:10:46.528008+0000","last_became_peered":"2024-09-12T17:10:46.528008+0000","last_unstale":"2024-09-12T18:09:24.853870+0000","last_undegraded":"2024-09-12T18:09:24.853870+0000","last_fullsized":"2024-09-12T18:09:24.853870+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_clean_scrub_stamp":"2024-09-12T17:10:45.504515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:19:49.464976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"263'98","reported_seq":630,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:49.852429+0000","last_change":"2024-09-12T17:10:48.540285+0000","last_active":"2024-09-12T18:08:49.852429+0000","last_peered":"2024-09-12T18:08:49.852429+0000","last_clean":"2024-09-12T18:08:49.852429+0000","last_became_active":"2024-09-12T17:10:48.539249+0000","last_became_peered":"2024-09-12T17:10:48.539249+0000","last_unstale":"2024-09-12T18:08:49.852429+0000","last_undegraded":"2024-09-12T18:08:49.852429+0000","last_fullsized":"2024-09-12T18:08:49.852429+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_clean_scrub_stamp":"2024-09-12T17:10:47.516917+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:10:07.478104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":101,"num_read_kb":97,"num_write":68,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:49.852402+0000","last_change":"2024-09-12T17:10:50.560376+0000","last_active":"2024-09-12T18:08:49.852402+0000","last_peered":"2024-09-12T18:08:49.852402+0000","last_clean":"2024-09-12T18:08:49.852402+0000","last_became_active":"2024-09-12T17:10:50.559882+0000","last_became_peered":"2024-09-12T17:10:50.559882+0000","last_unstale":"2024-09-12T18:08:49.852402+0000","last_undegraded":"2024-09-12T18:08:49.852402+0000","last_fullsized":"2024-09-12T18:08:49.852402+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_clean_scrub_stamp":"2024-09-12T17:10:49.533772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:28:55.022294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"263'90","reported_seq":591,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:40.825979+0000","last_change":"2024-09-12T17:10:52.570423+0000","last_active":"2024-09-12T18:08:40.825979+0000","last_peered":"2024-09-12T18:08:40.825979+0000","last_clean":"2024-09-12T18:08:40.825979+0000","last_became_active":"2024-09-12T17:10:52.570071+0000","last_became_peered":"2024-09-12T17:10:52.570071+0000","last_unstale":"2024-09-12T18:08:40.825979+0000","last_undegraded":"2024-09-12T18:08:40.825979+0000","last_fullsized":"2024-09-12T18:08:40.825979+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:46:23.049710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":117,"num_read_kb":116,"num_write":199,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"263'446","reported_seq":2001,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:57.732062+0000","last_change":"2024-09-12T18:11:57.732062+0000","last_active":"2024-09-12T18:11:57.732062+0000","last_peered":"2024-09-12T18:11:57.732062+0000","last_clean":"2024-09-12T18:11:57.732062+0000","last_became_active":"2024-09-12T17:10:44.517886+0000","last_became_peered":"2024-09-12T17:10:44.517886+0000","last_unstale":"2024-09-12T18:11:57.732062+0000","last_undegraded":"2024-09-12T18:11:57.732062+0000","last_fullsized":"2024-09-12T18:11:57.732062+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'446","last_scrub_stamp":"2024-09-12T18:11:57.731969+0000","last_deep_scrub":"263'446","last_deep_scrub_stamp":"2024-09-12T18:11:57.731969+0000","last_clean_scrub_stamp":"2024-09-12T18:11:57.731969+0000","objects_scrubbed":3,"log_size":46,"log_dups_size":400,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:14:03.007633+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2335,"num_read_kb":2201,"num_write":517,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"263'192","reported_seq":824,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:53.493308+0000","last_change":"2024-09-12T18:11:53.493308+0000","last_active":"2024-09-12T18:11:53.493308+0000","last_peered":"2024-09-12T18:11:53.493308+0000","last_clean":"2024-09-12T18:11:53.493308+0000","last_became_active":"2024-09-12T17:10:42.530663+0000","last_became_peered":"2024-09-12T17:10:42.530663+0000","last_unstale":"2024-09-12T18:11:53.493308+0000","last_undegraded":"2024-09-12T18:11:53.493308+0000","last_fullsized":"2024-09-12T18:11:53.493308+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'192","last_scrub_stamp":"2024-09-12T18:11:53.493160+0000","last_deep_scrub":"263'192","last_deep_scrub_stamp":"2024-09-12T18:11:53.493160+0000","last_clean_scrub_stamp":"2024-09-12T18:11:53.493160+0000","objects_scrubbed":4,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:43:13.520826+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6466288,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":436,"num_read_kb":14482,"num_write":960,"num_write_kb":29259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":495,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:49.849323+0000","last_change":"2024-09-12T17:10:46.530775+0000","last_active":"2024-09-12T18:08:49.849323+0000","last_peered":"2024-09-12T18:08:49.849323+0000","last_clean":"2024-09-12T18:08:49.849323+0000","last_became_active":"2024-09-12T17:10:46.530438+0000","last_became_peered":"2024-09-12T17:10:46.530438+0000","last_unstale":"2024-09-12T18:08:49.849323+0000","last_undegraded":"2024-09-12T18:08:49.849323+0000","last_fullsized":"2024-09-12T18:08:49.849323+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_clean_scrub_stamp":"2024-09-12T17:10:45.504515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:06:31.919771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"263'114","reported_seq":649,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:19.838931+0000","last_change":"2024-09-12T17:10:48.540591+0000","last_active":"2024-09-12T18:09:19.838931+0000","last_peered":"2024-09-12T18:09:19.838931+0000","last_clean":"2024-09-12T18:09:19.838931+0000","last_became_active":"2024-09-12T17:10:48.540078+0000","last_became_peered":"2024-09-12T17:10:48.540078+0000","last_unstale":"2024-09-12T18:09:19.838931+0000","last_undegraded":"2024-09-12T18:09:19.838931+0000","last_fullsized":"2024-09-12T18:09:19.838931+0000","mapping_epoch":30,"log_start":"263'100","ondisk_log_start":"263'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_clean_scrub_stamp":"2024-09-12T17:10:47.516917+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:11:14.400403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":134,"num_read_kb":129,"num_write":88,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"263'765","reported_seq":4728,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:41.009018+0000","last_change":"2024-09-12T17:10:50.563321+0000","last_active":"2024-09-12T18:11:41.009018+0000","last_peered":"2024-09-12T18:11:41.009018+0000","last_clean":"2024-09-12T18:11:41.009018+0000","last_became_active":"2024-09-12T17:10:50.562930+0000","last_became_peered":"2024-09-12T17:10:50.562930+0000","last_unstale":"2024-09-12T18:11:41.009018+0000","last_undegraded":"2024-09-12T18:11:41.009018+0000","last_fullsized":"2024-09-12T18:11:41.009018+0000","mapping_epoch":32,"log_start":"263'700","ondisk_log_start":"263'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_clean_scrub_stamp":"2024-09-12T17:10:49.533772+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":700,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:02:44.468859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"263'198","reported_seq":1047,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:49.747543+0000","last_change":"2024-09-12T17:10:52.671398+0000","last_active":"2024-09-12T18:09:49.747543+0000","last_peered":"2024-09-12T18:09:49.747543+0000","last_clean":"2024-09-12T18:09:49.747543+0000","last_became_active":"2024-09-12T17:10:52.671103+0000","last_became_peered":"2024-09-12T17:10:52.671103+0000","last_unstale":"2024-09-12T18:09:49.747543+0000","last_undegraded":"2024-09-12T18:09:49.747543+0000","last_fullsized":"2024-09-12T18:09:49.747543+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:56:47.430468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":719,"num_read_kb":693,"num_write":432,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"263'446","reported_seq":1962,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:48.690267+0000","last_change":"2024-09-12T17:10:44.515015+0000","last_active":"2024-09-12T18:09:48.690267+0000","last_peered":"2024-09-12T18:09:48.690267+0000","last_clean":"2024-09-12T18:09:48.690267+0000","last_became_active":"2024-09-12T17:10:44.514124+0000","last_became_peered":"2024-09-12T17:10:44.514124+0000","last_unstale":"2024-09-12T18:09:48.690267+0000","last_undegraded":"2024-09-12T18:09:48.690267+0000","last_fullsized":"2024-09-12T18:09:48.690267+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":400,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:59:05.101317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2305,"num_read_kb":2168,"num_write":513,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"263'223","reported_seq":887,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:49.784779+0000","last_change":"2024-09-12T18:11:49.784779+0000","last_active":"2024-09-12T18:11:49.784779+0000","last_peered":"2024-09-12T18:11:49.784779+0000","last_clean":"2024-09-12T18:11:49.784779+0000","last_became_active":"2024-09-12T17:10:42.525328+0000","last_became_peered":"2024-09-12T17:10:42.525328+0000","last_unstale":"2024-09-12T18:11:49.784779+0000","last_undegraded":"2024-09-12T18:11:49.784779+0000","last_fullsized":"2024-09-12T18:11:49.784779+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'223","last_scrub_stamp":"2024-09-12T18:11:49.784671+0000","last_deep_scrub":"263'223","last_deep_scrub_stamp":"2024-09-12T18:11:49.784671+0000","last_clean_scrub_stamp":"2024-09-12T18:11:49.784671+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":200,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:16:42.260914+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":549,"num_read_kb":47940,"num_write":1052,"num_write_kb":57690,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,3],"acting":[6,0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:49.851613+0000","last_change":"2024-09-12T17:10:46.527001+0000","last_active":"2024-09-12T18:08:49.851613+0000","last_peered":"2024-09-12T18:08:49.851613+0000","last_clean":"2024-09-12T18:08:49.851613+0000","last_became_active":"2024-09-12T17:10:46.526679+0000","last_became_peered":"2024-09-12T17:10:46.526679+0000","last_unstale":"2024-09-12T18:08:49.851613+0000","last_undegraded":"2024-09-12T18:08:49.851613+0000","last_fullsized":"2024-09-12T18:08:49.851613+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_clean_scrub_stamp":"2024-09-12T17:10:45.504515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:03:41.503120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"263'131","reported_seq":698,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:41.325827+0000","last_change":"2024-09-12T17:10:48.543886+0000","last_active":"2024-09-12T18:11:41.325827+0000","last_peered":"2024-09-12T18:11:41.325827+0000","last_clean":"2024-09-12T18:11:41.325827+0000","last_became_active":"2024-09-12T17:10:48.543573+0000","last_became_peered":"2024-09-12T17:10:48.543573+0000","last_unstale":"2024-09-12T18:11:41.325827+0000","last_undegraded":"2024-09-12T18:11:41.325827+0000","last_fullsized":"2024-09-12T18:11:41.325827+0000","mapping_epoch":30,"log_start":"263'100","ondisk_log_start":"263'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_clean_scrub_stamp":"2024-09-12T17:10:47.516917+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:34:09.400161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5773,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":175,"num_read_kb":264,"num_write":94,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"263'787","reported_seq":2298,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:41.392380+0000","last_change":"2024-09-12T17:10:50.559536+0000","last_active":"2024-09-12T18:11:41.392380+0000","last_peered":"2024-09-12T18:11:41.392380+0000","last_clean":"2024-09-12T18:11:41.392380+0000","last_became_active":"2024-09-12T17:10:50.559216+0000","last_became_peered":"2024-09-12T17:10:50.559216+0000","last_unstale":"2024-09-12T18:11:41.392380+0000","last_undegraded":"2024-09-12T18:11:41.392380+0000","last_fullsized":"2024-09-12T18:11:41.392380+0000","mapping_epoch":32,"log_start":"263'700","ondisk_log_start":"263'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_clean_scrub_stamp":"2024-09-12T17:10:49.533772+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":700,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:25:21.535911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"263'411","reported_seq":1940,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:55.295320+0000","last_change":"2024-09-12T18:11:55.295320+0000","last_active":"2024-09-12T18:11:55.295320+0000","last_peered":"2024-09-12T18:11:55.295320+0000","last_clean":"2024-09-12T18:11:55.295320+0000","last_became_active":"2024-09-12T17:10:44.516266+0000","last_became_peered":"2024-09-12T17:10:44.516266+0000","last_unstale":"2024-09-12T18:11:55.295320+0000","last_undegraded":"2024-09-12T18:11:55.295320+0000","last_fullsized":"2024-09-12T18:11:55.295320+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'411","last_scrub_stamp":"2024-09-12T18:11:55.295178+0000","last_deep_scrub":"263'411","last_deep_scrub_stamp":"2024-09-12T18:11:55.295178+0000","last_clean_scrub_stamp":"2024-09-12T18:11:55.295178+0000","objects_scrubbed":3,"log_size":11,"log_dups_size":400,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:17:07.193677+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2231,"num_read_kb":2116,"num_write":471,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":467,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"263'319","reported_seq":1094,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:52.463181+0000","last_change":"2024-09-12T18:11:52.463181+0000","last_active":"2024-09-12T18:11:52.463181+0000","last_peered":"2024-09-12T18:11:52.463181+0000","last_clean":"2024-09-12T18:11:52.463181+0000","last_became_active":"2024-09-12T17:10:42.531886+0000","last_became_peered":"2024-09-12T17:10:42.531886+0000","last_unstale":"2024-09-12T18:11:52.463181+0000","last_undegraded":"2024-09-12T18:11:52.463181+0000","last_fullsized":"2024-09-12T18:11:52.463181+0000","mapping_epoch":24,"log_start":"263'300","ondisk_log_start":"263'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'319","last_scrub_stamp":"2024-09-12T18:11:52.463034+0000","last_deep_scrub":"263'319","last_deep_scrub_stamp":"2024-09-12T18:11:52.463034+0000","last_clean_scrub_stamp":"2024-09-12T18:11:52.463034+0000","objects_scrubbed":6,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:11:16.067545+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2276857,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1043,"num_read_kb":35637,"num_write":1316,"num_write_kb":31872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0,1],"acting":[7,4,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:19.857104+0000","last_change":"2024-09-12T17:10:46.519211+0000","last_active":"2024-09-12T18:09:19.857104+0000","last_peered":"2024-09-12T18:09:19.857104+0000","last_clean":"2024-09-12T18:09:19.857104+0000","last_became_active":"2024-09-12T17:10:46.518652+0000","last_became_peered":"2024-09-12T17:10:46.518652+0000","last_unstale":"2024-09-12T18:09:19.857104+0000","last_undegraded":"2024-09-12T18:09:19.857104+0000","last_fullsized":"2024-09-12T18:09:19.857104+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_clean_scrub_stamp":"2024-09-12T17:10:45.504515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:02:38.257135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"263'218","reported_seq":835,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:41.086379+0000","last_change":"2024-09-12T17:10:48.541485+0000","last_active":"2024-09-12T18:11:41.086379+0000","last_peered":"2024-09-12T18:11:41.086379+0000","last_clean":"2024-09-12T18:11:41.086379+0000","last_became_active":"2024-09-12T17:10:48.541178+0000","last_became_peered":"2024-09-12T17:10:48.541178+0000","last_unstale":"2024-09-12T18:11:41.086379+0000","last_undegraded":"2024-09-12T18:11:41.086379+0000","last_fullsized":"2024-09-12T18:11:41.086379+0000","mapping_epoch":30,"log_start":"263'200","ondisk_log_start":"263'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_clean_scrub_stamp":"2024-09-12T17:10:47.516917+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:04:05.483511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5437,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":298,"num_read_kb":347,"num_write":172,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:20.148978+0000","last_change":"2024-09-12T17:10:50.560497+0000","last_active":"2024-09-12T18:09:20.148978+0000","last_peered":"2024-09-12T18:09:20.148978+0000","last_clean":"2024-09-12T18:09:20.148978+0000","last_became_active":"2024-09-12T17:10:50.560193+0000","last_became_peered":"2024-09-12T17:10:50.560193+0000","last_unstale":"2024-09-12T18:09:20.148978+0000","last_undegraded":"2024-09-12T18:09:20.148978+0000","last_fullsized":"2024-09-12T18:09:20.148978+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_clean_scrub_stamp":"2024-09-12T17:10:49.533772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:31:52.880536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"263'555","reported_seq":1366,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:09.825289+0000","last_change":"2024-09-12T17:10:52.573117+0000","last_active":"2024-09-12T18:11:09.825289+0000","last_peered":"2024-09-12T18:11:09.825289+0000","last_clean":"2024-09-12T18:11:09.825289+0000","last_became_active":"2024-09-12T17:10:52.572861+0000","last_became_peered":"2024-09-12T17:10:52.572861+0000","last_unstale":"2024-09-12T18:11:09.825289+0000","last_undegraded":"2024-09-12T18:11:09.825289+0000","last_fullsized":"2024-09-12T18:11:09.825289+0000","mapping_epoch":34,"log_start":"263'500","ondisk_log_start":"263'500","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":500,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:59:24.545564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1102,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1315,"num_read_kb":1312,"num_write":1171,"num_write_kb":396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"263'469","reported_seq":2057,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:51.400026+0000","last_change":"2024-09-12T18:11:51.400026+0000","last_active":"2024-09-12T18:11:51.400026+0000","last_peered":"2024-09-12T18:11:51.400026+0000","last_clean":"2024-09-12T18:11:51.400026+0000","last_became_active":"2024-09-12T17:10:44.515778+0000","last_became_peered":"2024-09-12T17:10:44.515778+0000","last_unstale":"2024-09-12T18:11:51.400026+0000","last_undegraded":"2024-09-12T18:11:51.400026+0000","last_fullsized":"2024-09-12T18:11:51.400026+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'469","last_scrub_stamp":"2024-09-12T18:11:51.399935+0000","last_deep_scrub":"263'469","last_deep_scrub_stamp":"2024-09-12T18:11:51.399935+0000","last_clean_scrub_stamp":"2024-09-12T18:11:51.399935+0000","objects_scrubbed":2,"log_size":69,"log_dups_size":400,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:32:57.047086+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2463,"num_read_kb":2310,"num_write":552,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"263'158","reported_seq":772,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:50.465220+0000","last_change":"2024-09-12T18:11:50.465220+0000","last_active":"2024-09-12T18:11:50.465220+0000","last_peered":"2024-09-12T18:11:50.465220+0000","last_clean":"2024-09-12T18:11:50.465220+0000","last_became_active":"2024-09-12T17:10:42.526215+0000","last_became_peered":"2024-09-12T17:10:42.526215+0000","last_unstale":"2024-09-12T18:11:50.465220+0000","last_undegraded":"2024-09-12T18:11:50.465220+0000","last_fullsized":"2024-09-12T18:11:50.465220+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'158","last_scrub_stamp":"2024-09-12T18:11:50.465100+0000","last_deep_scrub":"263'158","last_deep_scrub_stamp":"2024-09-12T18:11:50.465100+0000","last_clean_scrub_stamp":"2024-09-12T18:11:50.465100+0000","objects_scrubbed":2,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:53:30.108739+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":254352,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":393,"num_read_kb":949,"num_write":838,"num_write_kb":19518,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,2],"acting":[7,4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":503,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:55.787582+0000","last_change":"2024-09-12T18:11:55.787582+0000","last_active":"2024-09-12T18:11:55.787582+0000","last_peered":"2024-09-12T18:11:55.787582+0000","last_clean":"2024-09-12T18:11:55.787582+0000","last_became_active":"2024-09-12T17:10:46.532552+0000","last_became_peered":"2024-09-12T17:10:46.532552+0000","last_unstale":"2024-09-12T18:11:55.787582+0000","last_undegraded":"2024-09-12T18:11:55.787582+0000","last_fullsized":"2024-09-12T18:11:55.787582+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:11:55.787495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:11:55.787495+0000","last_clean_scrub_stamp":"2024-09-12T18:11:55.787495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:34:05.224619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"263'133","reported_seq":704,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:41.225053+0000","last_change":"2024-09-12T17:10:48.543376+0000","last_active":"2024-09-12T18:11:41.225053+0000","last_peered":"2024-09-12T18:11:41.225053+0000","last_clean":"2024-09-12T18:11:41.225053+0000","last_became_active":"2024-09-12T17:10:48.542511+0000","last_became_peered":"2024-09-12T17:10:48.542511+0000","last_unstale":"2024-09-12T18:11:41.225053+0000","last_undegraded":"2024-09-12T18:11:41.225053+0000","last_fullsized":"2024-09-12T18:11:41.225053+0000","mapping_epoch":30,"log_start":"263'100","ondisk_log_start":"263'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_clean_scrub_stamp":"2024-09-12T17:10:47.516917+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:24:43.018761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27700,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":176,"num_read_kb":289,"num_write":94,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":490,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:34.855017+0000","last_change":"2024-09-12T17:10:50.560534+0000","last_active":"2024-09-12T18:09:34.855017+0000","last_peered":"2024-09-12T18:09:34.855017+0000","last_clean":"2024-09-12T18:09:34.855017+0000","last_became_active":"2024-09-12T17:10:50.560194+0000","last_became_peered":"2024-09-12T17:10:50.560194+0000","last_unstale":"2024-09-12T18:09:34.855017+0000","last_undegraded":"2024-09-12T18:09:34.855017+0000","last_fullsized":"2024-09-12T18:09:34.855017+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_clean_scrub_stamp":"2024-09-12T17:10:49.533772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:42:53.755387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"263'128","reported_seq":635,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:10:59.090392+0000","last_change":"2024-09-12T17:10:52.564665+0000","last_active":"2024-09-12T18:10:59.090392+0000","last_peered":"2024-09-12T18:10:59.090392+0000","last_clean":"2024-09-12T18:10:59.090392+0000","last_became_active":"2024-09-12T17:10:52.564350+0000","last_became_peered":"2024-09-12T17:10:52.564350+0000","last_unstale":"2024-09-12T18:10:59.090392+0000","last_undegraded":"2024-09-12T18:10:59.090392+0000","last_fullsized":"2024-09-12T18:10:59.090392+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:43:06.504654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":214,"num_read_kb":196,"num_write":321,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"263'439","reported_seq":1888,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:55.718980+0000","last_change":"2024-09-12T18:11:55.718980+0000","last_active":"2024-09-12T18:11:55.718980+0000","last_peered":"2024-09-12T18:11:55.718980+0000","last_clean":"2024-09-12T18:11:55.718980+0000","last_became_active":"2024-09-12T17:11:16.618699+0000","last_became_peered":"2024-09-12T17:11:16.618699+0000","last_unstale":"2024-09-12T18:11:55.718980+0000","last_undegraded":"2024-09-12T18:11:55.718980+0000","last_fullsized":"2024-09-12T18:11:55.718980+0000","mapping_epoch":37,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'439","last_scrub_stamp":"2024-09-12T18:11:55.718895+0000","last_deep_scrub":"263'439","last_deep_scrub_stamp":"2024-09-12T18:11:55.718895+0000","last_clean_scrub_stamp":"2024-09-12T18:11:55.718895+0000","objects_scrubbed":2,"log_size":39,"log_dups_size":400,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:35:23.822201+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2161,"num_read_kb":2024,"num_write":504,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1429,"num_omap_keys":6,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"263'215","reported_seq":851,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:58.516620+0000","last_change":"2024-09-12T18:11:58.516620+0000","last_active":"2024-09-12T18:11:58.516620+0000","last_peered":"2024-09-12T18:11:58.516620+0000","last_clean":"2024-09-12T18:11:58.516620+0000","last_became_active":"2024-09-12T17:10:42.525644+0000","last_became_peered":"2024-09-12T17:10:42.525644+0000","last_unstale":"2024-09-12T18:11:58.516620+0000","last_undegraded":"2024-09-12T18:11:58.516620+0000","last_fullsized":"2024-09-12T18:11:58.516620+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'215","last_scrub_stamp":"2024-09-12T18:11:58.516489+0000","last_deep_scrub":"263'215","last_deep_scrub_stamp":"2024-09-12T18:11:58.516489+0000","last_clean_scrub_stamp":"2024-09-12T18:11:58.516489+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":200,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:52:28.223065+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":480,"num_read_kb":1680,"num_write":1066,"num_write_kb":42245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4,6],"acting":[7,5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:59.753999+0000","last_change":"2024-09-12T18:11:59.753999+0000","last_active":"2024-09-12T18:11:59.753999+0000","last_peered":"2024-09-12T18:11:59.753999+0000","last_clean":"2024-09-12T18:11:59.753999+0000","last_became_active":"2024-09-12T17:10:46.531693+0000","last_became_peered":"2024-09-12T17:10:46.531693+0000","last_unstale":"2024-09-12T18:11:59.753999+0000","last_undegraded":"2024-09-12T18:11:59.753999+0000","last_fullsized":"2024-09-12T18:11:59.753999+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:11:59.753897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:11:59.753897+0000","last_clean_scrub_stamp":"2024-09-12T18:11:59.753897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:56:46.955405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"263'171","reported_seq":759,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:41.099368+0000","last_change":"2024-09-12T17:10:48.546368+0000","last_active":"2024-09-12T18:11:41.099368+0000","last_peered":"2024-09-12T18:11:41.099368+0000","last_clean":"2024-09-12T18:11:41.099368+0000","last_became_active":"2024-09-12T17:10:48.546013+0000","last_became_peered":"2024-09-12T17:10:48.546013+0000","last_unstale":"2024-09-12T18:11:41.099368+0000","last_undegraded":"2024-09-12T18:11:41.099368+0000","last_fullsized":"2024-09-12T18:11:41.099368+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_clean_scrub_stamp":"2024-09-12T17:10:47.516917+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":100,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:18:06.234698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22951,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":229,"num_read_kb":322,"num_write":130,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"263'776","reported_seq":2659,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:41.014652+0000","last_change":"2024-09-12T17:10:50.558001+0000","last_active":"2024-09-12T18:11:41.014652+0000","last_peered":"2024-09-12T18:11:41.014652+0000","last_clean":"2024-09-12T18:11:41.014652+0000","last_became_active":"2024-09-12T17:10:50.557711+0000","last_became_peered":"2024-09-12T17:10:50.557711+0000","last_unstale":"2024-09-12T18:11:41.014652+0000","last_undegraded":"2024-09-12T18:11:41.014652+0000","last_fullsized":"2024-09-12T18:11:41.014652+0000","mapping_epoch":32,"log_start":"263'700","ondisk_log_start":"263'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_clean_scrub_stamp":"2024-09-12T17:10:49.533772+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":700,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:36:55.165115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"263'103","reported_seq":598,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:08.674351+0000","last_change":"2024-09-12T17:10:52.570339+0000","last_active":"2024-09-12T18:11:08.674351+0000","last_peered":"2024-09-12T18:11:08.674351+0000","last_clean":"2024-09-12T18:11:08.674351+0000","last_became_active":"2024-09-12T17:10:52.570034+0000","last_became_peered":"2024-09-12T17:10:52.570034+0000","last_unstale":"2024-09-12T18:11:08.674351+0000","last_undegraded":"2024-09-12T18:11:08.674351+0000","last_fullsized":"2024-09-12T18:11:08.674351+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:58:19.680712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":442,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":109,"num_read_kb":107,"num_write":228,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"263'459","reported_seq":1996,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:56.689795+0000","last_change":"2024-09-12T18:11:56.689795+0000","last_active":"2024-09-12T18:11:56.689795+0000","last_peered":"2024-09-12T18:11:56.689795+0000","last_clean":"2024-09-12T18:11:56.689795+0000","last_became_active":"2024-09-12T17:10:44.520043+0000","last_became_peered":"2024-09-12T17:10:44.520043+0000","last_unstale":"2024-09-12T18:11:56.689795+0000","last_undegraded":"2024-09-12T18:11:56.689795+0000","last_fullsized":"2024-09-12T18:11:56.689795+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'459","last_scrub_stamp":"2024-09-12T18:11:56.689705+0000","last_deep_scrub":"263'459","last_deep_scrub_stamp":"2024-09-12T18:11:56.689705+0000","last_clean_scrub_stamp":"2024-09-12T18:11:56.689705+0000","objects_scrubbed":2,"log_size":59,"log_dups_size":400,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:12:24.353664+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2352,"num_read_kb":2214,"num_write":541,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":217,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"263'209","reported_seq":860,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:48.213383+0000","last_change":"2024-09-12T18:11:48.213383+0000","last_active":"2024-09-12T18:11:48.213383+0000","last_peered":"2024-09-12T18:11:48.213383+0000","last_clean":"2024-09-12T18:11:48.213383+0000","last_became_active":"2024-09-12T17:10:42.518472+0000","last_became_peered":"2024-09-12T17:10:42.518472+0000","last_unstale":"2024-09-12T18:11:48.213383+0000","last_undegraded":"2024-09-12T18:11:48.213383+0000","last_fullsized":"2024-09-12T18:11:48.213383+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'209","last_scrub_stamp":"2024-09-12T18:11:48.213203+0000","last_deep_scrub":"263'209","last_deep_scrub_stamp":"2024-09-12T18:11:48.213203+0000","last_clean_scrub_stamp":"2024-09-12T18:11:48.213203+0000","objects_scrubbed":7,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:56:57.310254+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":91,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":447,"num_read_kb":52953,"num_write":1076,"num_write_kb":38599,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6,1],"acting":[5,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":503,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:56.759826+0000","last_change":"2024-09-12T18:11:56.759826+0000","last_active":"2024-09-12T18:11:56.759826+0000","last_peered":"2024-09-12T18:11:56.759826+0000","last_clean":"2024-09-12T18:11:56.759826+0000","last_became_active":"2024-09-12T17:10:46.531731+0000","last_became_peered":"2024-09-12T17:10:46.531731+0000","last_unstale":"2024-09-12T18:11:56.759826+0000","last_undegraded":"2024-09-12T18:11:56.759826+0000","last_fullsized":"2024-09-12T18:11:56.759826+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:11:56.759684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:11:56.759684+0000","last_clean_scrub_stamp":"2024-09-12T18:11:56.759684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:53:36.303626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"263'201","reported_seq":838,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:41.249923+0000","last_change":"2024-09-12T17:10:48.544969+0000","last_active":"2024-09-12T18:11:41.249923+0000","last_peered":"2024-09-12T18:11:41.249923+0000","last_clean":"2024-09-12T18:11:41.249923+0000","last_became_active":"2024-09-12T17:10:48.544653+0000","last_became_peered":"2024-09-12T17:10:48.544653+0000","last_unstale":"2024-09-12T18:11:41.249923+0000","last_undegraded":"2024-09-12T18:11:41.249923+0000","last_fullsized":"2024-09-12T18:11:41.249923+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_clean_scrub_stamp":"2024-09-12T17:10:47.516917+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:21:32.100821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13571,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":286,"num_read_kb":396,"num_write":142,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":495,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:04.752859+0000","last_change":"2024-09-12T18:12:04.752859+0000","last_active":"2024-09-12T18:12:04.752859+0000","last_peered":"2024-09-12T18:12:04.752859+0000","last_clean":"2024-09-12T18:12:04.752859+0000","last_became_active":"2024-09-12T17:10:50.555473+0000","last_became_peered":"2024-09-12T17:10:50.555473+0000","last_unstale":"2024-09-12T18:12:04.752859+0000","last_undegraded":"2024-09-12T18:12:04.752859+0000","last_fullsized":"2024-09-12T18:12:04.752859+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:04.752774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:04.752774+0000","last_clean_scrub_stamp":"2024-09-12T18:12:04.752774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:02:14.647232+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"263'116","reported_seq":625,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:47.539870+0000","last_change":"2024-09-12T17:10:52.571536+0000","last_active":"2024-09-12T18:09:47.539870+0000","last_peered":"2024-09-12T18:09:47.539870+0000","last_clean":"2024-09-12T18:09:47.539870+0000","last_became_active":"2024-09-12T17:10:52.571225+0000","last_became_peered":"2024-09-12T17:10:52.571225+0000","last_unstale":"2024-09-12T18:09:47.539870+0000","last_undegraded":"2024-09-12T18:09:47.539870+0000","last_fullsized":"2024-09-12T18:09:47.539870+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:45:48.500746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":910,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":137,"num_read_kb":136,"num_write":254,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"263'475","reported_seq":2098,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:53.403989+0000","last_change":"2024-09-12T18:11:53.403989+0000","last_active":"2024-09-12T18:11:53.403989+0000","last_peered":"2024-09-12T18:11:53.403989+0000","last_clean":"2024-09-12T18:11:53.403989+0000","last_became_active":"2024-09-12T17:10:44.516255+0000","last_became_peered":"2024-09-12T17:10:44.516255+0000","last_unstale":"2024-09-12T18:11:53.403989+0000","last_undegraded":"2024-09-12T18:11:53.403989+0000","last_fullsized":"2024-09-12T18:11:53.403989+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'475","last_scrub_stamp":"2024-09-12T18:11:53.403890+0000","last_deep_scrub":"263'475","last_deep_scrub_stamp":"2024-09-12T18:11:53.403890+0000","last_clean_scrub_stamp":"2024-09-12T18:11:53.403890+0000","objects_scrubbed":3,"log_size":75,"log_dups_size":400,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:52:22.138939+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2470,"num_read_kb":2330,"num_write":539,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":225,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"263'218","reported_seq":846,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:49.555656+0000","last_change":"2024-09-12T18:11:49.555656+0000","last_active":"2024-09-12T18:11:49.555656+0000","last_peered":"2024-09-12T18:11:49.555656+0000","last_clean":"2024-09-12T18:11:49.555656+0000","last_became_active":"2024-09-12T17:11:16.862702+0000","last_became_peered":"2024-09-12T17:11:16.862702+0000","last_unstale":"2024-09-12T18:11:49.555656+0000","last_undegraded":"2024-09-12T18:11:49.555656+0000","last_fullsized":"2024-09-12T18:11:49.555656+0000","mapping_epoch":37,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'218","last_scrub_stamp":"2024-09-12T18:11:49.555539+0000","last_deep_scrub":"263'218","last_deep_scrub_stamp":"2024-09-12T18:11:49.555539+0000","last_clean_scrub_stamp":"2024-09-12T18:11:49.555539+0000","objects_scrubbed":3,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:28:46.491751+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079942,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":414,"num_read_kb":1752,"num_write":1053,"num_write_kb":46733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,4,7],"acting":[3,2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:00.757095+0000","last_change":"2024-09-12T18:12:00.757095+0000","last_active":"2024-09-12T18:12:00.757095+0000","last_peered":"2024-09-12T18:12:00.757095+0000","last_clean":"2024-09-12T18:12:00.757095+0000","last_became_active":"2024-09-12T17:10:46.524638+0000","last_became_peered":"2024-09-12T17:10:46.524638+0000","last_unstale":"2024-09-12T18:12:00.757095+0000","last_undegraded":"2024-09-12T18:12:00.757095+0000","last_fullsized":"2024-09-12T18:12:00.757095+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:00.756978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:00.756978+0000","last_clean_scrub_stamp":"2024-09-12T18:12:00.756978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:05:19.943694+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"263'151","reported_seq":735,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:41.257183+0000","last_change":"2024-09-12T17:10:48.538217+0000","last_active":"2024-09-12T18:11:41.257183+0000","last_peered":"2024-09-12T18:11:41.257183+0000","last_clean":"2024-09-12T18:11:41.257183+0000","last_became_active":"2024-09-12T17:10:48.537923+0000","last_became_peered":"2024-09-12T17:10:48.537923+0000","last_unstale":"2024-09-12T18:11:41.257183+0000","last_undegraded":"2024-09-12T18:11:41.257183+0000","last_fullsized":"2024-09-12T18:11:41.257183+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_clean_scrub_stamp":"2024-09-12T17:10:47.516917+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:47:18.538568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7449,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":229,"num_read_kb":291,"num_write":178,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:29.846565+0000","last_change":"2024-09-12T17:10:50.563850+0000","last_active":"2024-09-12T18:09:29.846565+0000","last_peered":"2024-09-12T18:09:29.846565+0000","last_clean":"2024-09-12T18:09:29.846565+0000","last_became_active":"2024-09-12T17:10:50.563507+0000","last_became_peered":"2024-09-12T17:10:50.563507+0000","last_unstale":"2024-09-12T18:09:29.846565+0000","last_undegraded":"2024-09-12T18:09:29.846565+0000","last_fullsized":"2024-09-12T18:09:29.846565+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_clean_scrub_stamp":"2024-09-12T17:10:49.533772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"263'126","reported_seq":641,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:10:59.093495+0000","last_change":"2024-09-12T17:10:52.575633+0000","last_active":"2024-09-12T18:10:59.093495+0000","last_peered":"2024-09-12T18:10:59.093495+0000","last_clean":"2024-09-12T18:10:59.093495+0000","last_became_active":"2024-09-12T17:10:52.575293+0000","last_became_peered":"2024-09-12T17:10:52.575293+0000","last_unstale":"2024-09-12T18:10:59.093495+0000","last_undegraded":"2024-09-12T18:10:59.093495+0000","last_fullsized":"2024-09-12T18:10:59.093495+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:49:40.030320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":248,"num_read_kb":220,"num_write":319,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"263'998","reported_seq":2626,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:54.382075+0000","last_change":"2024-09-12T18:11:54.382075+0000","last_active":"2024-09-12T18:11:54.382075+0000","last_peered":"2024-09-12T18:11:54.382075+0000","last_clean":"2024-09-12T18:11:54.382075+0000","last_became_active":"2024-09-12T17:10:44.515098+0000","last_became_peered":"2024-09-12T17:10:44.515098+0000","last_unstale":"2024-09-12T18:11:54.382075+0000","last_undegraded":"2024-09-12T18:11:54.382075+0000","last_fullsized":"2024-09-12T18:11:54.382075+0000","mapping_epoch":26,"log_start":"263'900","ondisk_log_start":"263'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'998","last_scrub_stamp":"2024-09-12T18:11:54.381986+0000","last_deep_scrub":"263'998","last_deep_scrub_stamp":"2024-09-12T18:11:54.381986+0000","last_clean_scrub_stamp":"2024-09-12T18:11:54.381986+0000","objects_scrubbed":3,"log_size":98,"log_dups_size":900,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:57:33.212113+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4616,"num_read_kb":4072,"num_write":1360,"num_write_kb":579,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"263'209","reported_seq":858,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:48.820208+0000","last_change":"2024-09-12T18:11:48.820208+0000","last_active":"2024-09-12T18:11:48.820208+0000","last_peered":"2024-09-12T18:11:48.820208+0000","last_clean":"2024-09-12T18:11:48.820208+0000","last_became_active":"2024-09-12T17:10:42.515480+0000","last_became_peered":"2024-09-12T17:10:42.515480+0000","last_unstale":"2024-09-12T18:11:48.820208+0000","last_undegraded":"2024-09-12T18:11:48.820208+0000","last_fullsized":"2024-09-12T18:11:48.820208+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'209","last_scrub_stamp":"2024-09-12T18:11:48.820082+0000","last_deep_scrub":"263'209","last_deep_scrub_stamp":"2024-09-12T18:11:48.820082+0000","last_clean_scrub_stamp":"2024-09-12T18:11:48.820082+0000","objects_scrubbed":5,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:31:06.353554+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4364954,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":507,"num_read_kb":28749,"num_write":1020,"num_write_kb":24822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1,7],"acting":[6,4,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":510,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:00.573603+0000","last_change":"2024-09-12T18:12:00.573603+0000","last_active":"2024-09-12T18:12:00.573603+0000","last_peered":"2024-09-12T18:12:00.573603+0000","last_clean":"2024-09-12T18:12:00.573603+0000","last_became_active":"2024-09-12T17:10:46.532552+0000","last_became_peered":"2024-09-12T17:10:46.532552+0000","last_unstale":"2024-09-12T18:12:00.573603+0000","last_undegraded":"2024-09-12T18:12:00.573603+0000","last_fullsized":"2024-09-12T18:12:00.573603+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:00.573517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:00.573517+0000","last_clean_scrub_stamp":"2024-09-12T18:12:00.573517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:33:18.527965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"263'179","reported_seq":773,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:03.736258+0000","last_change":"2024-09-12T18:12:03.736258+0000","last_active":"2024-09-12T18:12:03.736258+0000","last_peered":"2024-09-12T18:12:03.736258+0000","last_clean":"2024-09-12T18:12:03.736258+0000","last_became_active":"2024-09-12T17:10:48.542298+0000","last_became_peered":"2024-09-12T17:10:48.542298+0000","last_unstale":"2024-09-12T18:12:03.736258+0000","last_undegraded":"2024-09-12T18:12:03.736258+0000","last_fullsized":"2024-09-12T18:12:03.736258+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'179","last_scrub_stamp":"2024-09-12T18:12:03.736151+0000","last_deep_scrub":"263'179","last_deep_scrub_stamp":"2024-09-12T18:12:03.736151+0000","last_clean_scrub_stamp":"2024-09-12T18:12:03.736151+0000","objects_scrubbed":7,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:35:13.912374+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5018,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":233,"num_read_kb":318,"num_write":134,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"263'747","reported_seq":2533,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:02.775270+0000","last_change":"2024-09-12T18:12:02.775270+0000","last_active":"2024-09-12T18:12:02.775270+0000","last_peered":"2024-09-12T18:12:02.775270+0000","last_clean":"2024-09-12T18:12:02.775270+0000","last_became_active":"2024-09-12T17:10:50.557305+0000","last_became_peered":"2024-09-12T17:10:50.557305+0000","last_unstale":"2024-09-12T18:12:02.775270+0000","last_undegraded":"2024-09-12T18:12:02.775270+0000","last_fullsized":"2024-09-12T18:12:02.775270+0000","mapping_epoch":32,"log_start":"263'700","ondisk_log_start":"263'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'747","last_scrub_stamp":"2024-09-12T18:12:02.775178+0000","last_deep_scrub":"263'747","last_deep_scrub_stamp":"2024-09-12T18:12:02.775178+0000","last_clean_scrub_stamp":"2024-09-12T18:12:02.775178+0000","objects_scrubbed":1,"log_size":47,"log_dups_size":700,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:35.079087+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"263'117","reported_seq":624,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:47.542189+0000","last_change":"2024-09-12T17:10:52.571748+0000","last_active":"2024-09-12T18:09:47.542189+0000","last_peered":"2024-09-12T18:09:47.542189+0000","last_clean":"2024-09-12T18:09:47.542189+0000","last_became_active":"2024-09-12T17:10:52.571344+0000","last_became_peered":"2024-09-12T17:10:52.571344+0000","last_unstale":"2024-09-12T18:09:47.542189+0000","last_undegraded":"2024-09-12T18:09:47.542189+0000","last_fullsized":"2024-09-12T18:09:47.542189+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:19:07.103069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1852,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":171,"num_read_kb":161,"num_write":288,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"263'490","reported_seq":2165,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:52.356454+0000","last_change":"2024-09-12T18:11:52.356454+0000","last_active":"2024-09-12T18:11:52.356454+0000","last_peered":"2024-09-12T18:11:52.356454+0000","last_clean":"2024-09-12T18:11:52.356454+0000","last_became_active":"2024-09-12T17:10:44.509293+0000","last_became_peered":"2024-09-12T17:10:44.509293+0000","last_unstale":"2024-09-12T18:11:52.356454+0000","last_undegraded":"2024-09-12T18:11:52.356454+0000","last_fullsized":"2024-09-12T18:11:52.356454+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'490","last_scrub_stamp":"2024-09-12T18:11:52.356345+0000","last_deep_scrub":"263'490","last_deep_scrub_stamp":"2024-09-12T18:11:52.356345+0000","last_clean_scrub_stamp":"2024-09-12T18:11:52.356345+0000","objects_scrubbed":4,"log_size":90,"log_dups_size":400,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:17:42.560325+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2823,"num_read_kb":2653,"num_write":584,"num_write_kb":143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1419,"num_omap_keys":6,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"263'186","reported_seq":846,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:47.544051+0000","last_change":"2024-09-12T18:11:47.544051+0000","last_active":"2024-09-12T18:11:47.544051+0000","last_peered":"2024-09-12T18:11:47.544051+0000","last_clean":"2024-09-12T18:11:47.544051+0000","last_became_active":"2024-09-12T17:10:42.515196+0000","last_became_peered":"2024-09-12T17:10:42.515196+0000","last_unstale":"2024-09-12T18:11:47.544051+0000","last_undegraded":"2024-09-12T18:11:47.544051+0000","last_fullsized":"2024-09-12T18:11:47.544051+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'186","last_scrub_stamp":"2024-09-12T18:11:47.543937+0000","last_deep_scrub":"263'186","last_deep_scrub_stamp":"2024-09-12T18:11:47.543937+0000","last_clean_scrub_stamp":"2024-09-12T18:11:47.543937+0000","objects_scrubbed":4,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:47:46.850299+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262519,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":441,"num_read_kb":72235,"num_write":829,"num_write_kb":40150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7,1],"acting":[4,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"29'2","reported_seq":1448,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:41.002228+0000","last_change":"2024-09-12T17:10:46.531378+0000","last_active":"2024-09-12T18:11:41.002228+0000","last_peered":"2024-09-12T18:11:41.002228+0000","last_clean":"2024-09-12T18:11:41.002228+0000","last_became_active":"2024-09-12T17:10:46.531032+0000","last_became_peered":"2024-09-12T17:10:46.531032+0000","last_unstale":"2024-09-12T18:11:41.002228+0000","last_undegraded":"2024-09-12T18:11:41.002228+0000","last_fullsized":"2024-09-12T18:11:41.002228+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_clean_scrub_stamp":"2024-09-12T17:10:45.504515+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":950,"num_read_kb":950,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"263'77","reported_seq":600,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:49.555526+0000","last_change":"2024-09-12T17:10:48.533130+0000","last_active":"2024-09-12T18:09:49.555526+0000","last_peered":"2024-09-12T18:09:49.555526+0000","last_clean":"2024-09-12T18:09:49.555526+0000","last_became_active":"2024-09-12T17:10:48.532817+0000","last_became_peered":"2024-09-12T17:10:48.532817+0000","last_unstale":"2024-09-12T18:09:49.555526+0000","last_undegraded":"2024-09-12T18:09:49.555526+0000","last_fullsized":"2024-09-12T18:09:49.555526+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_clean_scrub_stamp":"2024-09-12T17:10:47.516917+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:42:42.609184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":90,"num_read_kb":85,"num_write":60,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"263'763","reported_seq":2404,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:41.011429+0000","last_change":"2024-09-12T17:10:50.563515+0000","last_active":"2024-09-12T18:11:41.011429+0000","last_peered":"2024-09-12T18:11:41.011429+0000","last_clean":"2024-09-12T18:11:41.011429+0000","last_became_active":"2024-09-12T17:10:50.563002+0000","last_became_peered":"2024-09-12T17:10:50.563002+0000","last_unstale":"2024-09-12T18:11:41.011429+0000","last_undegraded":"2024-09-12T18:11:41.011429+0000","last_fullsized":"2024-09-12T18:11:41.011429+0000","mapping_epoch":32,"log_start":"263'700","ondisk_log_start":"263'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_clean_scrub_stamp":"2024-09-12T17:10:49.533772+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":700,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:11:41.362558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"263'147","reported_seq":647,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:14.855949+0000","last_change":"2024-09-12T17:10:52.571064+0000","last_active":"2024-09-12T18:09:14.855949+0000","last_peered":"2024-09-12T18:09:14.855949+0000","last_clean":"2024-09-12T18:09:14.855949+0000","last_became_active":"2024-09-12T17:10:52.570643+0000","last_became_peered":"2024-09-12T17:10:52.570643+0000","last_unstale":"2024-09-12T18:09:14.855949+0000","last_undegraded":"2024-09-12T18:09:14.855949+0000","last_fullsized":"2024-09-12T18:09:14.855949+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:37:26.966557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":160,"num_read_kb":158,"num_write":329,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"263'806","reported_seq":2293,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:57.545434+0000","last_change":"2024-09-12T18:11:57.545434+0000","last_active":"2024-09-12T18:11:57.545434+0000","last_peered":"2024-09-12T18:11:57.545434+0000","last_clean":"2024-09-12T18:11:57.545434+0000","last_became_active":"2024-09-12T17:10:44.518111+0000","last_became_peered":"2024-09-12T17:10:44.518111+0000","last_unstale":"2024-09-12T18:11:57.545434+0000","last_undegraded":"2024-09-12T18:11:57.545434+0000","last_fullsized":"2024-09-12T18:11:57.545434+0000","mapping_epoch":26,"log_start":"263'700","ondisk_log_start":"263'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'806","last_scrub_stamp":"2024-09-12T18:11:57.545339+0000","last_deep_scrub":"263'806","last_deep_scrub_stamp":"2024-09-12T18:11:57.545339+0000","last_clean_scrub_stamp":"2024-09-12T18:11:57.545339+0000","objects_scrubbed":2,"log_size":106,"log_dups_size":700,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:34:03.644456+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3856,"num_read_kb":3439,"num_write":1073,"num_write_kb":406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"263'210","reported_seq":838,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:48.517973+0000","last_change":"2024-09-12T18:11:48.517973+0000","last_active":"2024-09-12T18:11:48.517973+0000","last_peered":"2024-09-12T18:11:48.517973+0000","last_clean":"2024-09-12T18:11:48.517973+0000","last_became_active":"2024-09-12T17:10:42.522669+0000","last_became_peered":"2024-09-12T17:10:42.522669+0000","last_unstale":"2024-09-12T18:11:48.517973+0000","last_undegraded":"2024-09-12T18:11:48.517973+0000","last_fullsized":"2024-09-12T18:11:48.517973+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'210","last_scrub_stamp":"2024-09-12T18:11:48.517865+0000","last_deep_scrub":"263'210","last_deep_scrub_stamp":"2024-09-12T18:11:48.517865+0000","last_clean_scrub_stamp":"2024-09-12T18:11:48.517865+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:15:40.427265+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":435,"num_read_kb":8704,"num_write":950,"num_write_kb":27929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,4],"acting":[3,1,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":504,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:19.856844+0000","last_change":"2024-09-12T17:10:46.533907+0000","last_active":"2024-09-12T18:09:19.856844+0000","last_peered":"2024-09-12T18:09:19.856844+0000","last_clean":"2024-09-12T18:09:19.856844+0000","last_became_active":"2024-09-12T17:10:46.533572+0000","last_became_peered":"2024-09-12T17:10:46.533572+0000","last_unstale":"2024-09-12T18:09:19.856844+0000","last_undegraded":"2024-09-12T18:09:19.856844+0000","last_fullsized":"2024-09-12T18:09:19.856844+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_clean_scrub_stamp":"2024-09-12T17:10:45.504515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:00:02.576654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"263'246","reported_seq":856,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:41.382015+0000","last_change":"2024-09-12T17:10:48.543041+0000","last_active":"2024-09-12T18:11:41.382015+0000","last_peered":"2024-09-12T18:11:41.382015+0000","last_clean":"2024-09-12T18:11:41.382015+0000","last_became_active":"2024-09-12T17:10:48.542616+0000","last_became_peered":"2024-09-12T17:10:48.542616+0000","last_unstale":"2024-09-12T18:11:41.382015+0000","last_undegraded":"2024-09-12T18:11:41.382015+0000","last_fullsized":"2024-09-12T18:11:41.382015+0000","mapping_epoch":30,"log_start":"263'200","ondisk_log_start":"263'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_clean_scrub_stamp":"2024-09-12T17:10:47.516917+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":200,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:45:45.261917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5964,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":933,"num_read_kb":1007,"num_write":1456,"num_write_kb":1313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":498,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:03.738357+0000","last_change":"2024-09-12T18:12:03.738357+0000","last_active":"2024-09-12T18:12:03.738357+0000","last_peered":"2024-09-12T18:12:03.738357+0000","last_clean":"2024-09-12T18:12:03.738357+0000","last_became_active":"2024-09-12T17:10:50.550189+0000","last_became_peered":"2024-09-12T17:10:50.550189+0000","last_unstale":"2024-09-12T18:12:03.738357+0000","last_undegraded":"2024-09-12T18:12:03.738357+0000","last_fullsized":"2024-09-12T18:12:03.738357+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:03.738233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:03.738233+0000","last_clean_scrub_stamp":"2024-09-12T18:12:03.738233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:20:01.107417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"263'162","reported_seq":671,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:08.680270+0000","last_change":"2024-09-12T17:10:52.572806+0000","last_active":"2024-09-12T18:11:08.680270+0000","last_peered":"2024-09-12T18:11:08.680270+0000","last_clean":"2024-09-12T18:11:08.680270+0000","last_became_active":"2024-09-12T17:10:52.572508+0000","last_became_peered":"2024-09-12T17:10:52.572508+0000","last_unstale":"2024-09-12T18:11:08.680270+0000","last_undegraded":"2024-09-12T18:11:08.680270+0000","last_fullsized":"2024-09-12T18:11:08.680270+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:47:56.176805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":869,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":242,"num_read_kb":227,"num_write":399,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"263'2315","reported_seq":3936,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:54.768516+0000","last_change":"2024-09-12T18:11:54.768516+0000","last_active":"2024-09-12T18:11:54.768516+0000","last_peered":"2024-09-12T18:11:54.768516+0000","last_clean":"2024-09-12T18:11:54.768516+0000","last_became_active":"2024-09-12T17:10:44.515045+0000","last_became_peered":"2024-09-12T17:10:44.515045+0000","last_unstale":"2024-09-12T18:11:54.768516+0000","last_undegraded":"2024-09-12T18:11:54.768516+0000","last_fullsized":"2024-09-12T18:11:54.768516+0000","mapping_epoch":26,"log_start":"263'2300","ondisk_log_start":"263'2300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2315","last_scrub_stamp":"2024-09-12T18:11:54.768411+0000","last_deep_scrub":"263'2315","last_deep_scrub_stamp":"2024-09-12T18:11:54.768411+0000","last_clean_scrub_stamp":"2024-09-12T18:11:54.768411+0000","objects_scrubbed":2,"log_size":15,"log_dups_size":2300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:01:21.144459+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10108,"num_read_kb":8675,"num_write":3400,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"263'74","reported_seq":622,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:48.454645+0000","last_change":"2024-09-12T18:11:48.454645+0000","last_active":"2024-09-12T18:11:48.454645+0000","last_peered":"2024-09-12T18:11:48.454645+0000","last_clean":"2024-09-12T18:11:48.454645+0000","last_became_active":"2024-09-12T17:10:26.807964+0000","last_became_peered":"2024-09-12T17:10:26.807964+0000","last_unstale":"2024-09-12T18:11:48.454645+0000","last_undegraded":"2024-09-12T18:11:48.454645+0000","last_fullsized":"2024-09-12T18:11:48.454645+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'74","last_scrub_stamp":"2024-09-12T18:11:48.454546+0000","last_deep_scrub":"263'74","last_deep_scrub_stamp":"2024-09-12T18:11:48.454546+0000","last_clean_scrub_stamp":"2024-09-12T18:11:48.454546+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:42:01.929137+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"263'2","reported_seq":533,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:53.320142+0000","last_change":"2024-09-12T18:11:53.320142+0000","last_active":"2024-09-12T18:11:53.320142+0000","last_peered":"2024-09-12T18:11:53.320142+0000","last_clean":"2024-09-12T18:11:53.320142+0000","last_became_active":"2024-09-12T17:10:31.846572+0000","last_became_peered":"2024-09-12T17:10:31.846572+0000","last_unstale":"2024-09-12T18:11:53.320142+0000","last_undegraded":"2024-09-12T18:11:53.320142+0000","last_fullsized":"2024-09-12T18:11:53.320142+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T18:11:53.320051+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T18:11:53.320051+0000","last_clean_scrub_stamp":"2024-09-12T18:11:53.320051+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:30:24.755502+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.00060306800000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"263'227","reported_seq":856,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:46.512390+0000","last_change":"2024-09-12T18:11:46.512390+0000","last_active":"2024-09-12T18:11:46.512390+0000","last_peered":"2024-09-12T18:11:46.512390+0000","last_clean":"2024-09-12T18:11:46.512390+0000","last_became_active":"2024-09-12T17:10:42.527288+0000","last_became_peered":"2024-09-12T17:10:42.527288+0000","last_unstale":"2024-09-12T18:11:46.512390+0000","last_undegraded":"2024-09-12T18:11:46.512390+0000","last_fullsized":"2024-09-12T18:11:46.512390+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'227","last_scrub_stamp":"2024-09-12T18:11:46.512298+0000","last_deep_scrub":"263'227","last_deep_scrub_stamp":"2024-09-12T18:11:46.512298+0000","last_clean_scrub_stamp":"2024-09-12T18:11:46.512298+0000","objects_scrubbed":3,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:55:14.060256+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":95,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":424,"num_read_kb":3487,"num_write":1109,"num_write_kb":42610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6,4],"acting":[3,5,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"36'3","reported_seq":976,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:40.774008+0000","last_change":"2024-09-12T17:10:46.523567+0000","last_active":"2024-09-12T18:11:40.774008+0000","last_peered":"2024-09-12T18:11:40.774008+0000","last_clean":"2024-09-12T18:11:40.774008+0000","last_became_active":"2024-09-12T17:10:46.523069+0000","last_became_peered":"2024-09-12T17:10:46.523069+0000","last_unstale":"2024-09-12T18:11:40.774008+0000","last_undegraded":"2024-09-12T18:11:40.774008+0000","last_fullsized":"2024-09-12T18:11:40.774008+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_clean_scrub_stamp":"2024-09-12T17:10:45.504515+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:25:47.639083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":722,"num_read_kb":720,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"263'319","reported_seq":1020,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:41.349518+0000","last_change":"2024-09-12T17:10:48.542799+0000","last_active":"2024-09-12T18:11:41.349518+0000","last_peered":"2024-09-12T18:11:41.349518+0000","last_clean":"2024-09-12T18:11:41.349518+0000","last_became_active":"2024-09-12T17:10:48.542462+0000","last_became_peered":"2024-09-12T17:10:48.542462+0000","last_unstale":"2024-09-12T18:11:41.349518+0000","last_undegraded":"2024-09-12T18:11:41.349518+0000","last_fullsized":"2024-09-12T18:11:41.349518+0000","mapping_epoch":30,"log_start":"263'300","ondisk_log_start":"263'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_clean_scrub_stamp":"2024-09-12T17:10:47.516917+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:44:47.123605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37371,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":611,"num_read_kb":866,"num_write":568,"num_write_kb":434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:19.845378+0000","last_change":"2024-09-12T17:10:50.558413+0000","last_active":"2024-09-12T18:09:19.845378+0000","last_peered":"2024-09-12T18:09:19.845378+0000","last_clean":"2024-09-12T18:09:19.845378+0000","last_became_active":"2024-09-12T17:10:50.558129+0000","last_became_peered":"2024-09-12T17:10:50.558129+0000","last_unstale":"2024-09-12T18:09:19.845378+0000","last_undegraded":"2024-09-12T18:09:19.845378+0000","last_fullsized":"2024-09-12T18:09:19.845378+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_clean_scrub_stamp":"2024-09-12T17:10:49.533772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:10:19.749294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"263'213","reported_seq":930,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:49.576469+0000","last_change":"2024-09-12T17:10:52.574735+0000","last_active":"2024-09-12T18:09:49.576469+0000","last_peered":"2024-09-12T18:09:49.576469+0000","last_clean":"2024-09-12T18:09:49.576469+0000","last_became_active":"2024-09-12T17:10:52.574433+0000","last_became_peered":"2024-09-12T17:10:52.574433+0000","last_unstale":"2024-09-12T18:09:49.576469+0000","last_undegraded":"2024-09-12T18:09:49.576469+0000","last_fullsized":"2024-09-12T18:09:49.576469+0000","mapping_epoch":34,"log_start":"263'200","ondisk_log_start":"263'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:43:52.722409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":852,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":555,"num_read_kb":537,"num_write":455,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"263'583","reported_seq":2177,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:55.730687+0000","last_change":"2024-09-12T18:11:55.730687+0000","last_active":"2024-09-12T18:11:55.730687+0000","last_peered":"2024-09-12T18:11:55.730687+0000","last_clean":"2024-09-12T18:11:55.730687+0000","last_became_active":"2024-09-12T17:10:44.520484+0000","last_became_peered":"2024-09-12T17:10:44.520484+0000","last_unstale":"2024-09-12T18:11:55.730687+0000","last_undegraded":"2024-09-12T18:11:55.730687+0000","last_fullsized":"2024-09-12T18:11:55.730687+0000","mapping_epoch":26,"log_start":"263'500","ondisk_log_start":"263'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'583","last_scrub_stamp":"2024-09-12T18:11:55.730573+0000","last_deep_scrub":"263'583","last_deep_scrub_stamp":"2024-09-12T18:11:55.730573+0000","last_clean_scrub_stamp":"2024-09-12T18:11:55.730573+0000","objects_scrubbed":1,"log_size":83,"log_dups_size":500,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:47:46.532008+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3105,"num_read_kb":2836,"num_write":745,"num_write_kb":252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":528,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:49.492585+0000","last_change":"2024-09-12T18:11:49.492585+0000","last_active":"2024-09-12T18:11:49.492585+0000","last_peered":"2024-09-12T18:11:49.492585+0000","last_clean":"2024-09-12T18:11:49.492585+0000","last_became_active":"2024-09-12T17:10:31.848972+0000","last_became_peered":"2024-09-12T17:10:31.848972+0000","last_unstale":"2024-09-12T18:11:49.492585+0000","last_undegraded":"2024-09-12T18:11:49.492585+0000","last_fullsized":"2024-09-12T18:11:49.492585+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:11:49.492494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:11:49.492494+0000","last_clean_scrub_stamp":"2024-09-12T18:11:49.492494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:54:40.685079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054881099999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"263'247","reported_seq":900,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:44.672013+0000","last_change":"2024-09-12T18:11:44.672013+0000","last_active":"2024-09-12T18:11:44.672013+0000","last_peered":"2024-09-12T18:11:44.672013+0000","last_clean":"2024-09-12T18:11:44.672013+0000","last_became_active":"2024-09-12T17:10:42.518190+0000","last_became_peered":"2024-09-12T17:10:42.518190+0000","last_unstale":"2024-09-12T18:11:44.672013+0000","last_undegraded":"2024-09-12T18:11:44.672013+0000","last_fullsized":"2024-09-12T18:11:44.672013+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'247","last_scrub_stamp":"2024-09-12T18:11:44.671868+0000","last_deep_scrub":"263'247","last_deep_scrub_stamp":"2024-09-12T18:11:44.671868+0000","last_clean_scrub_stamp":"2024-09-12T18:11:44.671868+0000","objects_scrubbed":3,"log_size":47,"log_dups_size":200,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:21:51.032960+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":522,"num_read_kb":6824,"num_write":1149,"num_write_kb":47378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3,5],"acting":[0,4,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:19.856009+0000","last_change":"2024-09-12T17:10:46.528521+0000","last_active":"2024-09-12T18:09:19.856009+0000","last_peered":"2024-09-12T18:09:19.856009+0000","last_clean":"2024-09-12T18:09:19.856009+0000","last_became_active":"2024-09-12T17:10:46.528192+0000","last_became_peered":"2024-09-12T17:10:46.528192+0000","last_unstale":"2024-09-12T18:09:19.856009+0000","last_undegraded":"2024-09-12T18:09:19.856009+0000","last_fullsized":"2024-09-12T18:09:19.856009+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_clean_scrub_stamp":"2024-09-12T17:10:45.504515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:16:33.943407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"263'877","reported_seq":2538,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:41.342454+0000","last_change":"2024-09-12T17:10:48.545160+0000","last_active":"2024-09-12T18:11:41.342454+0000","last_peered":"2024-09-12T18:11:41.342454+0000","last_clean":"2024-09-12T18:11:41.342454+0000","last_became_active":"2024-09-12T17:10:48.544823+0000","last_became_peered":"2024-09-12T17:10:48.544823+0000","last_unstale":"2024-09-12T18:11:41.342454+0000","last_undegraded":"2024-09-12T18:11:41.342454+0000","last_fullsized":"2024-09-12T18:11:41.342454+0000","mapping_epoch":30,"log_start":"263'800","ondisk_log_start":"263'800","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_clean_scrub_stamp":"2024-09-12T17:10:47.516917+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":800,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:10:40.793586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19071,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1197,"num_read_kb":1359,"num_write":312,"num_write_kb":143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":489,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:19.857221+0000","last_change":"2024-09-12T17:10:50.557996+0000","last_active":"2024-09-12T18:09:19.857221+0000","last_peered":"2024-09-12T18:09:19.857221+0000","last_clean":"2024-09-12T18:09:19.857221+0000","last_became_active":"2024-09-12T17:10:50.557660+0000","last_became_peered":"2024-09-12T17:10:50.557660+0000","last_unstale":"2024-09-12T18:09:19.857221+0000","last_undegraded":"2024-09-12T18:09:19.857221+0000","last_fullsized":"2024-09-12T18:09:19.857221+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_clean_scrub_stamp":"2024-09-12T17:10:49.533772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:34:55.114972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"263'187","reported_seq":754,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:49.677139+0000","last_change":"2024-09-12T17:10:52.671428+0000","last_active":"2024-09-12T18:09:49.677139+0000","last_peered":"2024-09-12T18:09:49.677139+0000","last_clean":"2024-09-12T18:09:49.677139+0000","last_became_active":"2024-09-12T17:10:52.671120+0000","last_became_peered":"2024-09-12T17:10:52.671120+0000","last_unstale":"2024-09-12T18:09:49.677139+0000","last_undegraded":"2024-09-12T18:09:49.677139+0000","last_fullsized":"2024-09-12T18:09:49.677139+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":855,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":437,"num_read_kb":369,"num_write":356,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"263'341","reported_seq":1699,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:54.594576+0000","last_change":"2024-09-12T18:11:54.594576+0000","last_active":"2024-09-12T18:11:54.594576+0000","last_peered":"2024-09-12T18:11:54.594576+0000","last_clean":"2024-09-12T18:11:54.594576+0000","last_became_active":"2024-09-12T17:10:44.516640+0000","last_became_peered":"2024-09-12T17:10:44.516640+0000","last_unstale":"2024-09-12T18:11:54.594576+0000","last_undegraded":"2024-09-12T18:11:54.594576+0000","last_fullsized":"2024-09-12T18:11:54.594576+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'341","last_scrub_stamp":"2024-09-12T18:11:54.594493+0000","last_deep_scrub":"263'341","last_deep_scrub_stamp":"2024-09-12T18:11:54.594493+0000","last_clean_scrub_stamp":"2024-09-12T18:11:54.594493+0000","objects_scrubbed":3,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:23:17.401626+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1748,"num_read_kb":1673,"num_write":375,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":527,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:45.850440+0000","last_change":"2024-09-12T18:11:45.850440+0000","last_active":"2024-09-12T18:11:45.850440+0000","last_peered":"2024-09-12T18:11:45.850440+0000","last_clean":"2024-09-12T18:11:45.850440+0000","last_became_active":"2024-09-12T17:10:31.841982+0000","last_became_peered":"2024-09-12T17:10:31.841982+0000","last_unstale":"2024-09-12T18:11:45.850440+0000","last_undegraded":"2024-09-12T18:11:45.850440+0000","last_fullsized":"2024-09-12T18:11:45.850440+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:11:45.850369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:11:45.850369+0000","last_clean_scrub_stamp":"2024-09-12T18:11:45.850369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:50:52.981654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00030998799999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"263'168","reported_seq":791,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:47.720241+0000","last_change":"2024-09-12T18:11:47.720241+0000","last_active":"2024-09-12T18:11:47.720241+0000","last_peered":"2024-09-12T18:11:47.720241+0000","last_clean":"2024-09-12T18:11:47.720241+0000","last_became_active":"2024-09-12T17:10:42.509396+0000","last_became_peered":"2024-09-12T17:10:42.509396+0000","last_unstale":"2024-09-12T18:11:47.720241+0000","last_undegraded":"2024-09-12T18:11:47.720241+0000","last_fullsized":"2024-09-12T18:11:47.720241+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'168","last_scrub_stamp":"2024-09-12T18:11:47.720156+0000","last_deep_scrub":"263'168","last_deep_scrub_stamp":"2024-09-12T18:11:47.720156+0000","last_clean_scrub_stamp":"2024-09-12T18:11:47.720156+0000","objects_scrubbed":3,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:45:50.082004+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":350137,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":379,"num_read_kb":11016,"num_write":845,"num_write_kb":10341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6,5],"acting":[1,2,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"263'2","reported_seq":505,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:01.753020+0000","last_change":"2024-09-12T18:12:01.753020+0000","last_active":"2024-09-12T18:12:01.753020+0000","last_peered":"2024-09-12T18:12:01.753020+0000","last_clean":"2024-09-12T18:12:01.753020+0000","last_became_active":"2024-09-12T17:10:46.528878+0000","last_became_peered":"2024-09-12T17:10:46.528878+0000","last_unstale":"2024-09-12T18:12:01.753020+0000","last_undegraded":"2024-09-12T18:12:01.753020+0000","last_fullsized":"2024-09-12T18:12:01.753020+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T18:12:01.752936+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T18:12:01.752936+0000","last_clean_scrub_stamp":"2024-09-12T18:12:01.752936+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:05:28.456818+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"263'250","reported_seq":1512,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:09.987483+0000","last_change":"2024-09-12T17:10:48.544016+0000","last_active":"2024-09-12T18:11:09.987483+0000","last_peered":"2024-09-12T18:11:09.987483+0000","last_clean":"2024-09-12T18:11:09.987483+0000","last_became_active":"2024-09-12T17:10:48.543196+0000","last_became_peered":"2024-09-12T17:10:48.543196+0000","last_unstale":"2024-09-12T18:11:09.987483+0000","last_undegraded":"2024-09-12T18:11:09.987483+0000","last_fullsized":"2024-09-12T18:11:09.987483+0000","mapping_epoch":30,"log_start":"263'200","ondisk_log_start":"263'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_clean_scrub_stamp":"2024-09-12T17:10:47.516917+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":200,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:18:29.037042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":209,"num_read_kb":201,"num_write":185,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":495,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:09.843829+0000","last_change":"2024-09-12T17:10:50.559244+0000","last_active":"2024-09-12T18:09:09.843829+0000","last_peered":"2024-09-12T18:09:09.843829+0000","last_clean":"2024-09-12T18:09:09.843829+0000","last_became_active":"2024-09-12T17:10:50.558980+0000","last_became_peered":"2024-09-12T17:10:50.558980+0000","last_unstale":"2024-09-12T18:09:09.843829+0000","last_undegraded":"2024-09-12T18:09:09.843829+0000","last_fullsized":"2024-09-12T18:09:09.843829+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_clean_scrub_stamp":"2024-09-12T17:10:49.533772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:56:03.520861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"263'256","reported_seq":854,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:49.824162+0000","last_change":"2024-09-12T17:10:52.564338+0000","last_active":"2024-09-12T18:09:49.824162+0000","last_peered":"2024-09-12T18:09:49.824162+0000","last_clean":"2024-09-12T18:09:49.824162+0000","last_became_active":"2024-09-12T17:10:52.563885+0000","last_became_peered":"2024-09-12T17:10:52.563885+0000","last_unstale":"2024-09-12T18:09:49.824162+0000","last_undegraded":"2024-09-12T18:09:49.824162+0000","last_fullsized":"2024-09-12T18:09:49.824162+0000","mapping_epoch":34,"log_start":"263'200","ondisk_log_start":"263'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":200,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:12:03.079469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":520,"num_read_kb":542,"num_write":569,"num_write_kb":161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"263'669","reported_seq":2221,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:55.553257+0000","last_change":"2024-09-12T18:11:55.553257+0000","last_active":"2024-09-12T18:11:55.553257+0000","last_peered":"2024-09-12T18:11:55.553257+0000","last_clean":"2024-09-12T18:11:55.553257+0000","last_became_active":"2024-09-12T17:10:44.515807+0000","last_became_peered":"2024-09-12T17:10:44.515807+0000","last_unstale":"2024-09-12T18:11:55.553257+0000","last_undegraded":"2024-09-12T18:11:55.553257+0000","last_fullsized":"2024-09-12T18:11:55.553257+0000","mapping_epoch":26,"log_start":"263'600","ondisk_log_start":"263'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'669","last_scrub_stamp":"2024-09-12T18:11:55.553162+0000","last_deep_scrub":"263'669","last_deep_scrub_stamp":"2024-09-12T18:11:55.553162+0000","last_clean_scrub_stamp":"2024-09-12T18:11:55.553162+0000","objects_scrubbed":5,"log_size":69,"log_dups_size":600,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:56:28.156022+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3415,"num_read_kb":3057,"num_write":984,"num_write_kb":466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":477,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"263'3","reported_seq":534,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:47.214677+0000","last_change":"2024-09-12T18:11:47.214677+0000","last_active":"2024-09-12T18:11:47.214677+0000","last_peered":"2024-09-12T18:11:47.214677+0000","last_clean":"2024-09-12T18:11:47.214677+0000","last_became_active":"2024-09-12T17:10:31.849085+0000","last_became_peered":"2024-09-12T17:10:31.849085+0000","last_unstale":"2024-09-12T18:11:47.214677+0000","last_undegraded":"2024-09-12T18:11:47.214677+0000","last_fullsized":"2024-09-12T18:11:47.214677+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'3","last_scrub_stamp":"2024-09-12T18:11:47.214591+0000","last_deep_scrub":"263'3","last_deep_scrub_stamp":"2024-09-12T18:11:47.214591+0000","last_clean_scrub_stamp":"2024-09-12T18:11:47.214591+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:31:02.245023+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.0011727,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"263'232","reported_seq":931,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:46.498359+0000","last_change":"2024-09-12T18:11:46.498359+0000","last_active":"2024-09-12T18:11:46.498359+0000","last_peered":"2024-09-12T18:11:46.498359+0000","last_clean":"2024-09-12T18:11:46.498359+0000","last_became_active":"2024-09-12T17:10:42.529499+0000","last_became_peered":"2024-09-12T17:10:42.529499+0000","last_unstale":"2024-09-12T18:11:46.498359+0000","last_undegraded":"2024-09-12T18:11:46.498359+0000","last_fullsized":"2024-09-12T18:11:46.498359+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'232","last_scrub_stamp":"2024-09-12T18:11:46.498219+0000","last_deep_scrub":"263'232","last_deep_scrub_stamp":"2024-09-12T18:11:46.498219+0000","last_clean_scrub_stamp":"2024-09-12T18:11:46.498219+0000","objects_scrubbed":2,"log_size":32,"log_dups_size":200,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:52:39.137136+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262174,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":565,"num_read_kb":10247,"num_write":1100,"num_write_kb":30448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,6],"acting":[4,5,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":511,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:04.687350+0000","last_change":"2024-09-12T18:12:04.687350+0000","last_active":"2024-09-12T18:12:04.687350+0000","last_peered":"2024-09-12T18:12:04.687350+0000","last_clean":"2024-09-12T18:12:04.687350+0000","last_became_active":"2024-09-12T17:10:46.526136+0000","last_became_peered":"2024-09-12T17:10:46.526136+0000","last_unstale":"2024-09-12T18:12:04.687350+0000","last_undegraded":"2024-09-12T18:12:04.687350+0000","last_fullsized":"2024-09-12T18:12:04.687350+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:04.687264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:04.687264+0000","last_clean_scrub_stamp":"2024-09-12T18:12:04.687264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:47:47.732114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"263'139","reported_seq":685,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:09.997112+0000","last_change":"2024-09-12T17:10:48.536587+0000","last_active":"2024-09-12T18:11:09.997112+0000","last_peered":"2024-09-12T18:11:09.997112+0000","last_clean":"2024-09-12T18:11:09.997112+0000","last_became_active":"2024-09-12T17:10:48.536247+0000","last_became_peered":"2024-09-12T17:10:48.536247+0000","last_unstale":"2024-09-12T18:11:09.997112+0000","last_undegraded":"2024-09-12T18:11:09.997112+0000","last_fullsized":"2024-09-12T18:11:09.997112+0000","mapping_epoch":30,"log_start":"263'100","ondisk_log_start":"263'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_clean_scrub_stamp":"2024-09-12T17:10:47.516917+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:26:17.588873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":163,"num_read_kb":156,"num_write":120,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:02.727739+0000","last_change":"2024-09-12T18:12:02.727739+0000","last_active":"2024-09-12T18:12:02.727739+0000","last_peered":"2024-09-12T18:12:02.727739+0000","last_clean":"2024-09-12T18:12:02.727739+0000","last_became_active":"2024-09-12T17:10:50.555747+0000","last_became_peered":"2024-09-12T17:10:50.555747+0000","last_unstale":"2024-09-12T18:12:02.727739+0000","last_undegraded":"2024-09-12T18:12:02.727739+0000","last_fullsized":"2024-09-12T18:12:02.727739+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:02.727650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:02.727650+0000","last_clean_scrub_stamp":"2024-09-12T18:12:02.727650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:59:58.866824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"263'122","reported_seq":667,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:24.858258+0000","last_change":"2024-09-12T17:10:52.575248+0000","last_active":"2024-09-12T18:09:24.858258+0000","last_peered":"2024-09-12T18:09:24.858258+0000","last_clean":"2024-09-12T18:09:24.858258+0000","last_became_active":"2024-09-12T17:10:52.574956+0000","last_became_peered":"2024-09-12T17:10:52.574956+0000","last_unstale":"2024-09-12T18:09:24.858258+0000","last_undegraded":"2024-09-12T18:09:24.858258+0000","last_fullsized":"2024-09-12T18:09:24.858258+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:35:51.476345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":427,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":242,"num_read_kb":241,"num_write":285,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"263'473","reported_seq":2087,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:53.613963+0000","last_change":"2024-09-12T18:11:53.613963+0000","last_active":"2024-09-12T18:11:53.613963+0000","last_peered":"2024-09-12T18:11:53.613963+0000","last_clean":"2024-09-12T18:11:53.613963+0000","last_became_active":"2024-09-12T17:10:44.516258+0000","last_became_peered":"2024-09-12T17:10:44.516258+0000","last_unstale":"2024-09-12T18:11:53.613963+0000","last_undegraded":"2024-09-12T18:11:53.613963+0000","last_fullsized":"2024-09-12T18:11:53.613963+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'473","last_scrub_stamp":"2024-09-12T18:11:53.613870+0000","last_deep_scrub":"263'473","last_deep_scrub_stamp":"2024-09-12T18:11:53.613870+0000","last_clean_scrub_stamp":"2024-09-12T18:11:53.613870+0000","objects_scrubbed":2,"log_size":73,"log_dups_size":400,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:01:14.309219+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2512,"num_read_kb":2369,"num_write":577,"num_write_kb":149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"263'182","reported_seq":889,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:57.349904+0000","last_change":"2024-09-12T18:11:57.349904+0000","last_active":"2024-09-12T18:11:57.349904+0000","last_peered":"2024-09-12T18:11:57.349904+0000","last_clean":"2024-09-12T18:11:57.349904+0000","last_became_active":"2024-09-12T17:10:42.520777+0000","last_became_peered":"2024-09-12T17:10:42.520777+0000","last_unstale":"2024-09-12T18:11:57.349904+0000","last_undegraded":"2024-09-12T18:11:57.349904+0000","last_fullsized":"2024-09-12T18:11:57.349904+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'182","last_scrub_stamp":"2024-09-12T18:11:57.349756+0000","last_deep_scrub":"263'182","last_deep_scrub_stamp":"2024-09-12T18:11:57.349756+0000","last_clean_scrub_stamp":"2024-09-12T18:11:57.349756+0000","objects_scrubbed":4,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:09:50.642477+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":574,"num_read_kb":36969,"num_write":896,"num_write_kb":42705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":537,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:45.674428+0000","last_change":"2024-09-12T18:11:45.674428+0000","last_active":"2024-09-12T18:11:45.674428+0000","last_peered":"2024-09-12T18:11:45.674428+0000","last_clean":"2024-09-12T18:11:45.674428+0000","last_became_active":"2024-09-12T17:10:32.177463+0000","last_became_peered":"2024-09-12T17:10:32.177463+0000","last_unstale":"2024-09-12T18:11:45.674428+0000","last_undegraded":"2024-09-12T18:11:45.674428+0000","last_fullsized":"2024-09-12T18:11:45.674428+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:11:45.674357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:11:45.674357+0000","last_clean_scrub_stamp":"2024-09-12T18:11:45.674357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:46:59.598150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059857599999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":511,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:03.662959+0000","last_change":"2024-09-12T18:12:03.662959+0000","last_active":"2024-09-12T18:12:03.662959+0000","last_peered":"2024-09-12T18:12:03.662959+0000","last_clean":"2024-09-12T18:12:03.662959+0000","last_became_active":"2024-09-12T17:10:46.528499+0000","last_became_peered":"2024-09-12T17:10:46.528499+0000","last_unstale":"2024-09-12T18:12:03.662959+0000","last_undegraded":"2024-09-12T18:12:03.662959+0000","last_fullsized":"2024-09-12T18:12:03.662959+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:03.662874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:03.662874+0000","last_clean_scrub_stamp":"2024-09-12T18:12:03.662874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:25:39.425009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"263'276","reported_seq":948,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:41.328725+0000","last_change":"2024-09-12T17:10:48.540277+0000","last_active":"2024-09-12T18:11:41.328725+0000","last_peered":"2024-09-12T18:11:41.328725+0000","last_clean":"2024-09-12T18:11:41.328725+0000","last_became_active":"2024-09-12T17:10:48.539913+0000","last_became_peered":"2024-09-12T17:10:48.539913+0000","last_unstale":"2024-09-12T18:11:41.328725+0000","last_undegraded":"2024-09-12T18:11:41.328725+0000","last_fullsized":"2024-09-12T18:11:41.328725+0000","mapping_epoch":30,"log_start":"260'200","ondisk_log_start":"260'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_clean_scrub_stamp":"2024-09-12T17:10:47.516917+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:02:55.603063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10695,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":387,"num_read_kb":478,"num_write":220,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":498,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:09.855203+0000","last_change":"2024-09-12T17:10:50.555362+0000","last_active":"2024-09-12T18:09:09.855203+0000","last_peered":"2024-09-12T18:09:09.855203+0000","last_clean":"2024-09-12T18:09:09.855203+0000","last_became_active":"2024-09-12T17:10:50.555068+0000","last_became_peered":"2024-09-12T17:10:50.555068+0000","last_unstale":"2024-09-12T18:09:09.855203+0000","last_undegraded":"2024-09-12T18:09:09.855203+0000","last_fullsized":"2024-09-12T18:09:09.855203+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_clean_scrub_stamp":"2024-09-12T17:10:49.533772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:07:39.703527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"263'153","reported_seq":659,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:46.594011+0000","last_change":"2024-09-12T17:10:52.671530+0000","last_active":"2024-09-12T18:09:46.594011+0000","last_peered":"2024-09-12T18:09:46.594011+0000","last_clean":"2024-09-12T18:09:46.594011+0000","last_became_active":"2024-09-12T17:10:52.671238+0000","last_became_peered":"2024-09-12T17:10:52.671238+0000","last_unstale":"2024-09-12T18:09:46.594011+0000","last_undegraded":"2024-09-12T18:09:46.594011+0000","last_fullsized":"2024-09-12T18:09:46.594011+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:56:27.646939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":925,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":183,"num_read_kb":179,"num_write":356,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"263'542","reported_seq":2242,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:54.729977+0000","last_change":"2024-09-12T18:11:54.729977+0000","last_active":"2024-09-12T18:11:54.729977+0000","last_peered":"2024-09-12T18:11:54.729977+0000","last_clean":"2024-09-12T18:11:54.729977+0000","last_became_active":"2024-09-12T17:10:44.513543+0000","last_became_peered":"2024-09-12T17:10:44.513543+0000","last_unstale":"2024-09-12T18:11:54.729977+0000","last_undegraded":"2024-09-12T18:11:54.729977+0000","last_fullsized":"2024-09-12T18:11:54.729977+0000","mapping_epoch":26,"log_start":"263'500","ondisk_log_start":"263'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'542","last_scrub_stamp":"2024-09-12T18:11:54.729880+0000","last_deep_scrub":"263'542","last_deep_scrub_stamp":"2024-09-12T18:11:54.729880+0000","last_clean_scrub_stamp":"2024-09-12T18:11:54.729880+0000","objects_scrubbed":3,"log_size":42,"log_dups_size":500,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:17.102641+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3000,"num_read_kb":2785,"num_write":670,"num_write_kb":215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2809,"num_omap_keys":11,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"263'214","reported_seq":901,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:48.710948+0000","last_change":"2024-09-12T18:11:48.710948+0000","last_active":"2024-09-12T18:11:48.710948+0000","last_peered":"2024-09-12T18:11:48.710948+0000","last_clean":"2024-09-12T18:11:48.710948+0000","last_became_active":"2024-09-12T17:10:42.524130+0000","last_became_peered":"2024-09-12T17:10:42.524130+0000","last_unstale":"2024-09-12T18:11:48.710948+0000","last_undegraded":"2024-09-12T18:11:48.710948+0000","last_fullsized":"2024-09-12T18:11:48.710948+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'214","last_scrub_stamp":"2024-09-12T18:11:48.710850+0000","last_deep_scrub":"263'214","last_deep_scrub_stamp":"2024-09-12T18:11:48.710850+0000","last_clean_scrub_stamp":"2024-09-12T18:11:48.710850+0000","objects_scrubbed":4,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:31:10.663400+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2067952,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":586,"num_read_kb":68430,"num_write":1040,"num_write_kb":36992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,5],"acting":[1,2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":527,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:51.437825+0000","last_change":"2024-09-12T18:11:51.437825+0000","last_active":"2024-09-12T18:11:51.437825+0000","last_peered":"2024-09-12T18:11:51.437825+0000","last_clean":"2024-09-12T18:11:51.437825+0000","last_became_active":"2024-09-12T17:10:32.177457+0000","last_became_peered":"2024-09-12T17:10:32.177457+0000","last_unstale":"2024-09-12T18:11:51.437825+0000","last_undegraded":"2024-09-12T18:11:51.437825+0000","last_fullsized":"2024-09-12T18:11:51.437825+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:11:51.437714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:11:51.437714+0000","last_clean_scrub_stamp":"2024-09-12T18:11:51.437714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:34:58.844283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000468751,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":508,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:59.691132+0000","last_change":"2024-09-12T18:11:59.691132+0000","last_active":"2024-09-12T18:11:59.691132+0000","last_peered":"2024-09-12T18:11:59.691132+0000","last_clean":"2024-09-12T18:11:59.691132+0000","last_became_active":"2024-09-12T17:10:46.527299+0000","last_became_peered":"2024-09-12T17:10:46.527299+0000","last_unstale":"2024-09-12T18:11:59.691132+0000","last_undegraded":"2024-09-12T18:11:59.691132+0000","last_fullsized":"2024-09-12T18:11:59.691132+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:11:59.691048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:11:59.691048+0000","last_clean_scrub_stamp":"2024-09-12T18:11:59.691048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:17:03.709838+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"263'234","reported_seq":808,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:58.608748+0000","last_change":"2024-09-12T17:10:48.539230+0000","last_active":"2024-09-12T18:09:58.608748+0000","last_peered":"2024-09-12T18:09:58.608748+0000","last_clean":"2024-09-12T18:09:58.608748+0000","last_became_active":"2024-09-12T17:10:48.538190+0000","last_became_peered":"2024-09-12T17:10:48.538190+0000","last_unstale":"2024-09-12T18:09:58.608748+0000","last_undegraded":"2024-09-12T18:09:58.608748+0000","last_fullsized":"2024-09-12T18:09:58.608748+0000","mapping_epoch":30,"log_start":"263'200","ondisk_log_start":"263'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_clean_scrub_stamp":"2024-09-12T17:10:47.516917+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":200,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:41:22.031248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":276,"num_read_kb":262,"num_write":250,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"263'779","reported_seq":2752,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:41.007736+0000","last_change":"2024-09-12T17:10:50.562034+0000","last_active":"2024-09-12T18:11:41.007736+0000","last_peered":"2024-09-12T18:11:41.007736+0000","last_clean":"2024-09-12T18:11:41.007736+0000","last_became_active":"2024-09-12T17:10:50.561112+0000","last_became_peered":"2024-09-12T17:10:50.561112+0000","last_unstale":"2024-09-12T18:11:41.007736+0000","last_undegraded":"2024-09-12T18:11:41.007736+0000","last_fullsized":"2024-09-12T18:11:41.007736+0000","mapping_epoch":32,"log_start":"263'700","ondisk_log_start":"263'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_clean_scrub_stamp":"2024-09-12T17:10:49.533772+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":700,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:22:47.285499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"263'97","reported_seq":609,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:09.821979+0000","last_change":"2024-09-12T17:10:52.672259+0000","last_active":"2024-09-12T18:11:09.821979+0000","last_peered":"2024-09-12T18:11:09.821979+0000","last_clean":"2024-09-12T18:11:09.821979+0000","last_became_active":"2024-09-12T17:10:52.671116+0000","last_became_peered":"2024-09-12T17:10:52.671116+0000","last_unstale":"2024-09-12T18:11:09.821979+0000","last_undegraded":"2024-09-12T18:11:09.821979+0000","last_fullsized":"2024-09-12T18:11:09.821979+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":505,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":188,"num_read_kb":171,"num_write":234,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"263'780","reported_seq":2432,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:01.710175+0000","last_change":"2024-09-12T18:12:01.710175+0000","last_active":"2024-09-12T18:12:01.710175+0000","last_peered":"2024-09-12T18:12:01.710175+0000","last_clean":"2024-09-12T18:12:01.710175+0000","last_became_active":"2024-09-12T17:10:44.511450+0000","last_became_peered":"2024-09-12T17:10:44.511450+0000","last_unstale":"2024-09-12T18:12:01.710175+0000","last_undegraded":"2024-09-12T18:12:01.710175+0000","last_fullsized":"2024-09-12T18:12:01.710175+0000","mapping_epoch":26,"log_start":"263'700","ondisk_log_start":"263'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'780","last_scrub_stamp":"2024-09-12T18:12:01.710085+0000","last_deep_scrub":"263'780","last_deep_scrub_stamp":"2024-09-12T18:12:01.710085+0000","last_clean_scrub_stamp":"2024-09-12T18:12:01.710085+0000","objects_scrubbed":3,"log_size":80,"log_dups_size":700,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:44:55.441743+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3773,"num_read_kb":3378,"num_write":1080,"num_write_kb":423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":268,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"263'167","reported_seq":757,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:47.536255+0000","last_change":"2024-09-12T18:11:47.536255+0000","last_active":"2024-09-12T18:11:47.536255+0000","last_peered":"2024-09-12T18:11:47.536255+0000","last_clean":"2024-09-12T18:11:47.536255+0000","last_became_active":"2024-09-12T17:10:42.526472+0000","last_became_peered":"2024-09-12T17:10:42.526472+0000","last_unstale":"2024-09-12T18:11:47.536255+0000","last_undegraded":"2024-09-12T18:11:47.536255+0000","last_fullsized":"2024-09-12T18:11:47.536255+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'167","last_scrub_stamp":"2024-09-12T18:11:47.536135+0000","last_deep_scrub":"263'167","last_deep_scrub_stamp":"2024-09-12T18:11:47.536135+0000","last_clean_scrub_stamp":"2024-09-12T18:11:47.536135+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":100,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:57:32.050771+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":300,"num_read_kb":1418,"num_write":797,"num_write_kb":46804,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,0],"acting":[3,5,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":536,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:46.672452+0000","last_change":"2024-09-12T18:11:46.672452+0000","last_active":"2024-09-12T18:11:46.672452+0000","last_peered":"2024-09-12T18:11:46.672452+0000","last_clean":"2024-09-12T18:11:46.672452+0000","last_became_active":"2024-09-12T17:10:31.845481+0000","last_became_peered":"2024-09-12T17:10:31.845481+0000","last_unstale":"2024-09-12T18:11:46.672452+0000","last_undegraded":"2024-09-12T18:11:46.672452+0000","last_fullsized":"2024-09-12T18:11:46.672452+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:11:46.672379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:11:46.672379+0000","last_clean_scrub_stamp":"2024-09-12T18:11:46.672379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:35:09.073477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060466100000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":506,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:09.855182+0000","last_change":"2024-09-12T17:10:46.530614+0000","last_active":"2024-09-12T18:09:09.855182+0000","last_peered":"2024-09-12T18:09:09.855182+0000","last_clean":"2024-09-12T18:09:09.855182+0000","last_became_active":"2024-09-12T17:10:46.530275+0000","last_became_peered":"2024-09-12T17:10:46.530275+0000","last_unstale":"2024-09-12T18:09:09.855182+0000","last_undegraded":"2024-09-12T18:09:09.855182+0000","last_fullsized":"2024-09-12T18:09:09.855182+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_clean_scrub_stamp":"2024-09-12T17:10:45.504515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:08:24.007031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"263'128","reported_seq":676,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:09.855223+0000","last_change":"2024-09-12T17:10:48.542113+0000","last_active":"2024-09-12T18:09:09.855223+0000","last_peered":"2024-09-12T18:09:09.855223+0000","last_clean":"2024-09-12T18:09:09.855223+0000","last_became_active":"2024-09-12T17:10:48.541795+0000","last_became_peered":"2024-09-12T17:10:48.541795+0000","last_unstale":"2024-09-12T18:09:09.855223+0000","last_undegraded":"2024-09-12T18:09:09.855223+0000","last_fullsized":"2024-09-12T18:09:09.855223+0000","mapping_epoch":30,"log_start":"263'100","ondisk_log_start":"263'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_clean_scrub_stamp":"2024-09-12T17:10:47.516917+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:48:37.106733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":142,"num_read_kb":133,"num_write":96,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"263'790","reported_seq":4450,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:41.012381+0000","last_change":"2024-09-12T17:10:50.560337+0000","last_active":"2024-09-12T18:11:41.012381+0000","last_peered":"2024-09-12T18:11:41.012381+0000","last_clean":"2024-09-12T18:11:41.012381+0000","last_became_active":"2024-09-12T17:10:50.559932+0000","last_became_peered":"2024-09-12T17:10:50.559932+0000","last_unstale":"2024-09-12T18:11:41.012381+0000","last_undegraded":"2024-09-12T18:11:41.012381+0000","last_fullsized":"2024-09-12T18:11:41.012381+0000","mapping_epoch":32,"log_start":"263'700","ondisk_log_start":"263'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_clean_scrub_stamp":"2024-09-12T17:10:49.533772+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":700,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:05:17.277375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"263'288","reported_seq":829,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:24.845948+0000","last_change":"2024-09-12T17:10:52.570934+0000","last_active":"2024-09-12T18:09:24.845948+0000","last_peered":"2024-09-12T18:09:24.845948+0000","last_clean":"2024-09-12T18:09:24.845948+0000","last_became_active":"2024-09-12T17:10:52.570545+0000","last_became_peered":"2024-09-12T17:10:52.570545+0000","last_unstale":"2024-09-12T18:09:24.845948+0000","last_undegraded":"2024-09-12T18:09:24.845948+0000","last_fullsized":"2024-09-12T18:09:24.845948+0000","mapping_epoch":34,"log_start":"263'200","ondisk_log_start":"263'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:15:52.985878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":466,"num_read_kb":447,"num_write":645,"num_write_kb":207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"263'473","reported_seq":1911,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:49.479082+0000","last_change":"2024-09-12T18:11:49.479082+0000","last_active":"2024-09-12T18:11:49.479082+0000","last_peered":"2024-09-12T18:11:49.479082+0000","last_clean":"2024-09-12T18:11:49.479082+0000","last_became_active":"2024-09-12T17:10:44.517508+0000","last_became_peered":"2024-09-12T17:10:44.517508+0000","last_unstale":"2024-09-12T18:11:49.479082+0000","last_undegraded":"2024-09-12T18:11:49.479082+0000","last_fullsized":"2024-09-12T18:11:49.479082+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'473","last_scrub_stamp":"2024-09-12T18:11:49.478985+0000","last_deep_scrub":"263'473","last_deep_scrub_stamp":"2024-09-12T18:11:49.478985+0000","last_clean_scrub_stamp":"2024-09-12T18:11:49.478985+0000","objects_scrubbed":2,"log_size":73,"log_dups_size":400,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:50:01.319281+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2400,"num_read_kb":2225,"num_write":610,"num_write_kb":202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"263'211","reported_seq":857,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:45.628205+0000","last_change":"2024-09-12T18:11:45.628205+0000","last_active":"2024-09-12T18:11:45.628205+0000","last_peered":"2024-09-12T18:11:45.628205+0000","last_clean":"2024-09-12T18:11:45.628205+0000","last_became_active":"2024-09-12T17:10:42.518404+0000","last_became_peered":"2024-09-12T17:10:42.518404+0000","last_unstale":"2024-09-12T18:11:45.628205+0000","last_undegraded":"2024-09-12T18:11:45.628205+0000","last_fullsized":"2024-09-12T18:11:45.628205+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'211","last_scrub_stamp":"2024-09-12T18:11:45.628122+0000","last_deep_scrub":"263'211","last_deep_scrub_stamp":"2024-09-12T18:11:45.628122+0000","last_clean_scrub_stamp":"2024-09-12T18:11:45.628122+0000","objects_scrubbed":1,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:54:21.121479+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170264,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":504,"num_read_kb":3973,"num_write":1040,"num_write_kb":36643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,7],"acting":[0,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":531,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:47.857743+0000","last_change":"2024-09-12T18:11:47.857743+0000","last_active":"2024-09-12T18:11:47.857743+0000","last_peered":"2024-09-12T18:11:47.857743+0000","last_clean":"2024-09-12T18:11:47.857743+0000","last_became_active":"2024-09-12T17:10:31.846123+0000","last_became_peered":"2024-09-12T17:10:31.846123+0000","last_unstale":"2024-09-12T18:11:47.857743+0000","last_undegraded":"2024-09-12T18:11:47.857743+0000","last_fullsized":"2024-09-12T18:11:47.857743+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:11:47.857651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:11:47.857651+0000","last_clean_scrub_stamp":"2024-09-12T18:11:47.857651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:48:18.963656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042024599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":500,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:04.850946+0000","last_change":"2024-09-12T17:10:46.530820+0000","last_active":"2024-09-12T18:09:04.850946+0000","last_peered":"2024-09-12T18:09:04.850946+0000","last_clean":"2024-09-12T18:09:04.850946+0000","last_became_active":"2024-09-12T17:10:46.530457+0000","last_became_peered":"2024-09-12T17:10:46.530457+0000","last_unstale":"2024-09-12T18:09:04.850946+0000","last_undegraded":"2024-09-12T18:09:04.850946+0000","last_fullsized":"2024-09-12T18:09:04.850946+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_clean_scrub_stamp":"2024-09-12T17:10:45.504515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:55:20.257339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"263'313","reported_seq":1032,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:41.357851+0000","last_change":"2024-09-12T17:10:48.543312+0000","last_active":"2024-09-12T18:11:41.357851+0000","last_peered":"2024-09-12T18:11:41.357851+0000","last_clean":"2024-09-12T18:11:41.357851+0000","last_became_active":"2024-09-12T17:10:48.542991+0000","last_became_peered":"2024-09-12T17:10:48.542991+0000","last_unstale":"2024-09-12T18:11:41.357851+0000","last_undegraded":"2024-09-12T18:11:41.357851+0000","last_fullsized":"2024-09-12T18:11:41.357851+0000","mapping_epoch":30,"log_start":"263'300","ondisk_log_start":"263'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_clean_scrub_stamp":"2024-09-12T17:10:47.516917+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:14:45.346536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23115,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":468,"num_read_kb":620,"num_write":234,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":491,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:09.851601+0000","last_change":"2024-09-12T17:10:50.553798+0000","last_active":"2024-09-12T18:09:09.851601+0000","last_peered":"2024-09-12T18:09:09.851601+0000","last_clean":"2024-09-12T18:09:09.851601+0000","last_became_active":"2024-09-12T17:10:50.553469+0000","last_became_peered":"2024-09-12T17:10:50.553469+0000","last_unstale":"2024-09-12T18:09:09.851601+0000","last_undegraded":"2024-09-12T18:09:09.851601+0000","last_fullsized":"2024-09-12T18:09:09.851601+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_clean_scrub_stamp":"2024-09-12T17:10:49.533772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:37:24.951291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"263'114","reported_seq":615,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:24.858341+0000","last_change":"2024-09-12T17:10:52.579037+0000","last_active":"2024-09-12T18:09:24.858341+0000","last_peered":"2024-09-12T18:09:24.858341+0000","last_clean":"2024-09-12T18:09:24.858341+0000","last_became_active":"2024-09-12T17:10:52.578713+0000","last_became_peered":"2024-09-12T17:10:52.578713+0000","last_unstale":"2024-09-12T18:09:24.858341+0000","last_undegraded":"2024-09-12T18:09:24.858341+0000","last_fullsized":"2024-09-12T18:09:24.858341+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:23:43.956550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":176,"num_read_kb":166,"num_write":279,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"263'124","reported_seq":686,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:49.766649+0000","last_change":"2024-09-12T17:10:52.576764+0000","last_active":"2024-09-12T18:09:49.766649+0000","last_peered":"2024-09-12T18:09:49.766649+0000","last_clean":"2024-09-12T18:09:49.766649+0000","last_became_active":"2024-09-12T17:10:52.576481+0000","last_became_peered":"2024-09-12T17:10:52.576481+0000","last_unstale":"2024-09-12T18:09:49.766649+0000","last_undegraded":"2024-09-12T18:09:49.766649+0000","last_fullsized":"2024-09-12T18:09:49.766649+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:22:23.671221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":242,"num_read_kb":237,"num_write":285,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"263'890","reported_seq":2488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:57.379777+0000","last_change":"2024-09-12T18:11:57.379777+0000","last_active":"2024-09-12T18:11:57.379777+0000","last_peered":"2024-09-12T18:11:57.379777+0000","last_clean":"2024-09-12T18:11:57.379777+0000","last_became_active":"2024-09-12T17:10:44.507455+0000","last_became_peered":"2024-09-12T17:10:44.507455+0000","last_unstale":"2024-09-12T18:11:57.379777+0000","last_undegraded":"2024-09-12T18:11:57.379777+0000","last_fullsized":"2024-09-12T18:11:57.379777+0000","mapping_epoch":26,"log_start":"263'800","ondisk_log_start":"263'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'890","last_scrub_stamp":"2024-09-12T18:11:57.379681+0000","last_deep_scrub":"263'890","last_deep_scrub_stamp":"2024-09-12T18:11:57.379681+0000","last_clean_scrub_stamp":"2024-09-12T18:11:57.379681+0000","objects_scrubbed":4,"log_size":90,"log_dups_size":800,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:11:27.008068+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4276,"num_read_kb":3830,"num_write":1165,"num_write_kb":436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2297,"num_omap_keys":9,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"263'212","reported_seq":871,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:48.500179+0000","last_change":"2024-09-12T18:11:48.500179+0000","last_active":"2024-09-12T18:11:48.500179+0000","last_peered":"2024-09-12T18:11:48.500179+0000","last_clean":"2024-09-12T18:11:48.500179+0000","last_became_active":"2024-09-12T17:10:42.519656+0000","last_became_peered":"2024-09-12T17:10:42.519656+0000","last_unstale":"2024-09-12T18:11:48.500179+0000","last_undegraded":"2024-09-12T18:11:48.500179+0000","last_fullsized":"2024-09-12T18:11:48.500179+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'212","last_scrub_stamp":"2024-09-12T18:11:48.500025+0000","last_deep_scrub":"263'212","last_deep_scrub_stamp":"2024-09-12T18:11:48.500025+0000","last_clean_scrub_stamp":"2024-09-12T18:11:48.500025+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:50:20.130407+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":812867,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":526,"num_read_kb":10349,"num_write":1065,"num_write_kb":31428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,6],"acting":[4,7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":509,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:02.561683+0000","last_change":"2024-09-12T18:12:02.561683+0000","last_active":"2024-09-12T18:12:02.561683+0000","last_peered":"2024-09-12T18:12:02.561683+0000","last_clean":"2024-09-12T18:12:02.561683+0000","last_became_active":"2024-09-12T17:10:46.527445+0000","last_became_peered":"2024-09-12T17:10:46.527445+0000","last_unstale":"2024-09-12T18:12:02.561683+0000","last_undegraded":"2024-09-12T18:12:02.561683+0000","last_fullsized":"2024-09-12T18:12:02.561683+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:02.561588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:02.561588+0000","last_clean_scrub_stamp":"2024-09-12T18:12:02.561588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:10:49.689079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"263'140","reported_seq":717,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:41.093253+0000","last_change":"2024-09-12T17:10:48.536317+0000","last_active":"2024-09-12T18:11:41.093253+0000","last_peered":"2024-09-12T18:11:41.093253+0000","last_clean":"2024-09-12T18:11:41.093253+0000","last_became_active":"2024-09-12T17:10:48.536021+0000","last_became_peered":"2024-09-12T17:10:48.536021+0000","last_unstale":"2024-09-12T18:11:41.093253+0000","last_undegraded":"2024-09-12T18:11:41.093253+0000","last_fullsized":"2024-09-12T18:11:41.093253+0000","mapping_epoch":30,"log_start":"263'100","ondisk_log_start":"263'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_clean_scrub_stamp":"2024-09-12T17:10:47.516917+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:39:55.363038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9595,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":179,"num_read_kb":232,"num_write":92,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:09.851513+0000","last_change":"2024-09-12T17:10:50.555533+0000","last_active":"2024-09-12T18:09:09.851513+0000","last_peered":"2024-09-12T18:09:09.851513+0000","last_clean":"2024-09-12T18:09:09.851513+0000","last_became_active":"2024-09-12T17:10:50.555251+0000","last_became_peered":"2024-09-12T17:10:50.555251+0000","last_unstale":"2024-09-12T18:09:09.851513+0000","last_undegraded":"2024-09-12T18:09:09.851513+0000","last_fullsized":"2024-09-12T18:09:09.851513+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_clean_scrub_stamp":"2024-09-12T17:10:49.533772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:14:47.733536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"263'142","reported_seq":663,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:09.818435+0000","last_change":"2024-09-12T17:10:52.573415+0000","last_active":"2024-09-12T18:11:09.818435+0000","last_peered":"2024-09-12T18:11:09.818435+0000","last_clean":"2024-09-12T18:11:09.818435+0000","last_became_active":"2024-09-12T17:10:52.573040+0000","last_became_peered":"2024-09-12T17:10:52.573040+0000","last_unstale":"2024-09-12T18:11:09.818435+0000","last_undegraded":"2024-09-12T18:11:09.818435+0000","last_fullsized":"2024-09-12T18:11:09.818435+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:17:53.786959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":264,"num_read_kb":238,"num_write":352,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"263'1131","reported_seq":2801,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:56.527202+0000","last_change":"2024-09-12T18:11:56.527202+0000","last_active":"2024-09-12T18:11:56.527202+0000","last_peered":"2024-09-12T18:11:56.527202+0000","last_clean":"2024-09-12T18:11:56.527202+0000","last_became_active":"2024-09-12T17:10:44.509117+0000","last_became_peered":"2024-09-12T17:10:44.509117+0000","last_unstale":"2024-09-12T18:11:56.527202+0000","last_undegraded":"2024-09-12T18:11:56.527202+0000","last_fullsized":"2024-09-12T18:11:56.527202+0000","mapping_epoch":26,"log_start":"263'1100","ondisk_log_start":"263'1100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1131","last_scrub_stamp":"2024-09-12T18:11:56.527108+0000","last_deep_scrub":"263'1131","last_deep_scrub_stamp":"2024-09-12T18:11:56.527108+0000","last_clean_scrub_stamp":"2024-09-12T18:11:56.527108+0000","objects_scrubbed":3,"log_size":31,"log_dups_size":1100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:31:43.564901+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5331,"num_read_kb":4747,"num_write":1539,"num_write_kb":622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2500,"num_omap_keys":10,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"263'206","reported_seq":823,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:47.843275+0000","last_change":"2024-09-12T18:11:47.843275+0000","last_active":"2024-09-12T18:11:47.843275+0000","last_peered":"2024-09-12T18:11:47.843275+0000","last_clean":"2024-09-12T18:11:47.843275+0000","last_became_active":"2024-09-12T17:11:16.617505+0000","last_became_peered":"2024-09-12T17:11:16.617505+0000","last_unstale":"2024-09-12T18:11:47.843275+0000","last_undegraded":"2024-09-12T18:11:47.843275+0000","last_fullsized":"2024-09-12T18:11:47.843275+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'206","last_scrub_stamp":"2024-09-12T18:11:47.843156+0000","last_deep_scrub":"263'206","last_deep_scrub_stamp":"2024-09-12T18:11:47.843156+0000","last_clean_scrub_stamp":"2024-09-12T18:11:47.843156+0000","objects_scrubbed":5,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:01:44.908699+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2936797,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":495,"num_read_kb":50143,"num_write":995,"num_write_kb":47141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,4],"acting":[2,3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:09.851666+0000","last_change":"2024-09-12T17:10:46.532146+0000","last_active":"2024-09-12T18:09:09.851666+0000","last_peered":"2024-09-12T18:09:09.851666+0000","last_clean":"2024-09-12T18:09:09.851666+0000","last_became_active":"2024-09-12T17:10:46.531835+0000","last_became_peered":"2024-09-12T17:10:46.531835+0000","last_unstale":"2024-09-12T18:09:09.851666+0000","last_undegraded":"2024-09-12T18:09:09.851666+0000","last_fullsized":"2024-09-12T18:09:09.851666+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_clean_scrub_stamp":"2024-09-12T17:10:45.504515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:41:31.662923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"263'46","reported_seq":554,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:09.843750+0000","last_change":"2024-09-12T17:10:48.541273+0000","last_active":"2024-09-12T18:09:09.843750+0000","last_peered":"2024-09-12T18:09:09.843750+0000","last_clean":"2024-09-12T18:09:09.843750+0000","last_became_active":"2024-09-12T17:10:48.540975+0000","last_became_peered":"2024-09-12T17:10:48.540975+0000","last_unstale":"2024-09-12T18:09:09.843750+0000","last_undegraded":"2024-09-12T18:09:09.843750+0000","last_fullsized":"2024-09-12T18:09:09.843750+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_clean_scrub_stamp":"2024-09-12T17:10:47.516917+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:50:54.992489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":38,"num_read_kb":36,"num_write":28,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":486,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:09.855642+0000","last_change":"2024-09-12T17:10:50.553896+0000","last_active":"2024-09-12T18:09:09.855642+0000","last_peered":"2024-09-12T18:09:09.855642+0000","last_clean":"2024-09-12T18:09:09.855642+0000","last_became_active":"2024-09-12T17:10:50.553581+0000","last_became_peered":"2024-09-12T17:10:50.553581+0000","last_unstale":"2024-09-12T18:09:09.855642+0000","last_undegraded":"2024-09-12T18:09:09.855642+0000","last_fullsized":"2024-09-12T18:09:09.855642+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_clean_scrub_stamp":"2024-09-12T17:10:49.533772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:14:49.105003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"263'191","reported_seq":712,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:49.539356+0000","last_change":"2024-09-12T17:10:52.573782+0000","last_active":"2024-09-12T18:09:49.539356+0000","last_peered":"2024-09-12T18:09:49.539356+0000","last_clean":"2024-09-12T18:09:49.539356+0000","last_became_active":"2024-09-12T17:10:52.573306+0000","last_became_peered":"2024-09-12T17:10:52.573306+0000","last_unstale":"2024-09-12T18:09:49.539356+0000","last_undegraded":"2024-09-12T18:09:49.539356+0000","last_fullsized":"2024-09-12T18:09:49.539356+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:39:25.637064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":321,"num_read_kb":317,"num_write":439,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"263'811","reported_seq":2420,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:57.606541+0000","last_change":"2024-09-12T18:11:57.606541+0000","last_active":"2024-09-12T18:11:57.606541+0000","last_peered":"2024-09-12T18:11:57.606541+0000","last_clean":"2024-09-12T18:11:57.606541+0000","last_became_active":"2024-09-12T17:10:44.511481+0000","last_became_peered":"2024-09-12T17:10:44.511481+0000","last_unstale":"2024-09-12T18:11:57.606541+0000","last_undegraded":"2024-09-12T18:11:57.606541+0000","last_fullsized":"2024-09-12T18:11:57.606541+0000","mapping_epoch":26,"log_start":"263'700","ondisk_log_start":"263'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'811","last_scrub_stamp":"2024-09-12T18:11:57.606442+0000","last_deep_scrub":"263'811","last_deep_scrub_stamp":"2024-09-12T18:11:57.606442+0000","last_clean_scrub_stamp":"2024-09-12T18:11:57.606442+0000","objects_scrubbed":1,"log_size":111,"log_dups_size":700,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:48:35.686566+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3868,"num_read_kb":3506,"num_write":1048,"num_write_kb":364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"263'181","reported_seq":792,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:48.827289+0000","last_change":"2024-09-12T18:11:48.827289+0000","last_active":"2024-09-12T18:11:48.827289+0000","last_peered":"2024-09-12T18:11:48.827289+0000","last_clean":"2024-09-12T18:11:48.827289+0000","last_became_active":"2024-09-12T17:11:16.862878+0000","last_became_peered":"2024-09-12T17:11:16.862878+0000","last_unstale":"2024-09-12T18:11:48.827289+0000","last_undegraded":"2024-09-12T18:11:48.827289+0000","last_fullsized":"2024-09-12T18:11:48.827289+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'181","last_scrub_stamp":"2024-09-12T18:11:48.827197+0000","last_deep_scrub":"263'181","last_deep_scrub_stamp":"2024-09-12T18:11:48.827197+0000","last_clean_scrub_stamp":"2024-09-12T18:11:48.827197+0000","objects_scrubbed":2,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:07:19.314634+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3178636,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":399,"num_read_kb":53721,"num_write":811,"num_write_kb":39175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,1,3],"acting":[2,7,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:09.855601+0000","last_change":"2024-09-12T17:10:46.530915+0000","last_active":"2024-09-12T18:09:09.855601+0000","last_peered":"2024-09-12T18:09:09.855601+0000","last_clean":"2024-09-12T18:09:09.855601+0000","last_became_active":"2024-09-12T17:10:46.530518+0000","last_became_peered":"2024-09-12T17:10:46.530518+0000","last_unstale":"2024-09-12T18:09:09.855601+0000","last_undegraded":"2024-09-12T18:09:09.855601+0000","last_fullsized":"2024-09-12T18:09:09.855601+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_clean_scrub_stamp":"2024-09-12T17:10:45.504515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:39:55.119594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"263'173","reported_seq":765,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:41.300575+0000","last_change":"2024-09-12T17:10:48.537056+0000","last_active":"2024-09-12T18:11:41.300575+0000","last_peered":"2024-09-12T18:11:41.300575+0000","last_clean":"2024-09-12T18:11:41.300575+0000","last_became_active":"2024-09-12T17:10:48.536654+0000","last_became_peered":"2024-09-12T17:10:48.536654+0000","last_unstale":"2024-09-12T18:11:41.300575+0000","last_undegraded":"2024-09-12T18:11:41.300575+0000","last_fullsized":"2024-09-12T18:11:41.300575+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_clean_scrub_stamp":"2024-09-12T17:10:47.516917+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:46:23.716742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5117,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":224,"num_read_kb":242,"num_write":122,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:04.709251+0000","last_change":"2024-09-12T18:12:04.709251+0000","last_active":"2024-09-12T18:12:04.709251+0000","last_peered":"2024-09-12T18:12:04.709251+0000","last_clean":"2024-09-12T18:12:04.709251+0000","last_became_active":"2024-09-12T17:10:50.556039+0000","last_became_peered":"2024-09-12T17:10:50.556039+0000","last_unstale":"2024-09-12T18:12:04.709251+0000","last_undegraded":"2024-09-12T18:12:04.709251+0000","last_fullsized":"2024-09-12T18:12:04.709251+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:04.709167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:04.709167+0000","last_clean_scrub_stamp":"2024-09-12T18:12:04.709167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:32:19.318577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"263'113","reported_seq":617,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:24.848069+0000","last_change":"2024-09-12T17:10:52.577104+0000","last_active":"2024-09-12T18:08:24.848069+0000","last_peered":"2024-09-12T18:08:24.848069+0000","last_clean":"2024-09-12T18:08:24.848069+0000","last_became_active":"2024-09-12T17:10:52.576791+0000","last_became_peered":"2024-09-12T17:10:52.576791+0000","last_unstale":"2024-09-12T18:08:24.848069+0000","last_undegraded":"2024-09-12T18:08:24.848069+0000","last_fullsized":"2024-09-12T18:08:24.848069+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:18:40.050173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":159,"num_read_kb":159,"num_write":260,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"263'431","reported_seq":1816,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:03.644995+0000","last_change":"2024-09-12T18:12:03.644995+0000","last_active":"2024-09-12T18:12:03.644995+0000","last_peered":"2024-09-12T18:12:03.644995+0000","last_clean":"2024-09-12T18:12:03.644995+0000","last_became_active":"2024-09-12T17:10:44.520747+0000","last_became_peered":"2024-09-12T17:10:44.520747+0000","last_unstale":"2024-09-12T18:12:03.644995+0000","last_undegraded":"2024-09-12T18:12:03.644995+0000","last_fullsized":"2024-09-12T18:12:03.644995+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'431","last_scrub_stamp":"2024-09-12T18:12:03.644906+0000","last_deep_scrub":"263'431","last_deep_scrub_stamp":"2024-09-12T18:12:03.644906+0000","last_clean_scrub_stamp":"2024-09-12T18:12:03.644906+0000","objects_scrubbed":2,"log_size":31,"log_dups_size":400,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:51:22.884668+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2202,"num_read_kb":2035,"num_write":527,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":718,"num_omap_keys":3,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"263'255","reported_seq":952,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:47.656945+0000","last_change":"2024-09-12T18:11:47.656945+0000","last_active":"2024-09-12T18:11:47.656945+0000","last_peered":"2024-09-12T18:11:47.656945+0000","last_clean":"2024-09-12T18:11:47.656945+0000","last_became_active":"2024-09-12T17:10:42.528364+0000","last_became_peered":"2024-09-12T17:10:42.528364+0000","last_unstale":"2024-09-12T18:11:47.656945+0000","last_undegraded":"2024-09-12T18:11:47.656945+0000","last_fullsized":"2024-09-12T18:11:47.656945+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'255","last_scrub_stamp":"2024-09-12T18:11:47.656812+0000","last_deep_scrub":"263'255","last_deep_scrub_stamp":"2024-09-12T18:11:47.656812+0000","last_clean_scrub_stamp":"2024-09-12T18:11:47.656812+0000","objects_scrubbed":5,"log_size":55,"log_dups_size":200,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:23:37.965725+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399205,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":613,"num_read_kb":71919,"num_write":1345,"num_write_kb":46951,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6,3],"acting":[0,5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":505,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:00.677176+0000","last_change":"2024-09-12T18:12:00.677176+0000","last_active":"2024-09-12T18:12:00.677176+0000","last_peered":"2024-09-12T18:12:00.677176+0000","last_clean":"2024-09-12T18:12:00.677176+0000","last_became_active":"2024-09-12T17:10:46.531830+0000","last_became_peered":"2024-09-12T17:10:46.531830+0000","last_unstale":"2024-09-12T18:12:00.677176+0000","last_undegraded":"2024-09-12T18:12:00.677176+0000","last_fullsized":"2024-09-12T18:12:00.677176+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:00.677087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:00.677087+0000","last_clean_scrub_stamp":"2024-09-12T18:12:00.677087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:04:35.333713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"263'127","reported_seq":695,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:41.278355+0000","last_change":"2024-09-12T17:10:48.545933+0000","last_active":"2024-09-12T18:11:41.278355+0000","last_peered":"2024-09-12T18:11:41.278355+0000","last_clean":"2024-09-12T18:11:41.278355+0000","last_became_active":"2024-09-12T17:10:48.545598+0000","last_became_peered":"2024-09-12T17:10:48.545598+0000","last_unstale":"2024-09-12T18:11:41.278355+0000","last_undegraded":"2024-09-12T18:11:41.278355+0000","last_fullsized":"2024-09-12T18:11:41.278355+0000","mapping_epoch":30,"log_start":"263'100","ondisk_log_start":"263'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_clean_scrub_stamp":"2024-09-12T17:10:47.516917+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:53:48.675107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10861,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":166,"num_read_kb":224,"num_write":86,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:09.843797+0000","last_change":"2024-09-12T17:10:50.561238+0000","last_active":"2024-09-12T18:09:09.843797+0000","last_peered":"2024-09-12T18:09:09.843797+0000","last_clean":"2024-09-12T18:09:09.843797+0000","last_became_active":"2024-09-12T17:10:50.560872+0000","last_became_peered":"2024-09-12T17:10:50.560872+0000","last_unstale":"2024-09-12T18:09:09.843797+0000","last_undegraded":"2024-09-12T18:09:09.843797+0000","last_fullsized":"2024-09-12T18:09:09.843797+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_clean_scrub_stamp":"2024-09-12T17:10:49.533772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:11:16.785795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"263'951","reported_seq":2488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:56.707695+0000","last_change":"2024-09-12T18:11:56.707695+0000","last_active":"2024-09-12T18:11:56.707695+0000","last_peered":"2024-09-12T18:11:56.707695+0000","last_clean":"2024-09-12T18:11:56.707695+0000","last_became_active":"2024-09-12T17:10:44.518992+0000","last_became_peered":"2024-09-12T17:10:44.518992+0000","last_unstale":"2024-09-12T18:11:56.707695+0000","last_undegraded":"2024-09-12T18:11:56.707695+0000","last_fullsized":"2024-09-12T18:11:56.707695+0000","mapping_epoch":26,"log_start":"263'900","ondisk_log_start":"263'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'951","last_scrub_stamp":"2024-09-12T18:11:56.707618+0000","last_deep_scrub":"263'951","last_deep_scrub_stamp":"2024-09-12T18:11:56.707618+0000","last_clean_scrub_stamp":"2024-09-12T18:11:56.707618+0000","objects_scrubbed":1,"log_size":51,"log_dups_size":900,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:54:44.984408+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4453,"num_read_kb":3925,"num_write":1322,"num_write_kb":528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1892,"num_omap_keys":8,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"263'316","reported_seq":1002,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:50.550646+0000","last_change":"2024-09-12T18:11:50.550646+0000","last_active":"2024-09-12T18:11:50.550646+0000","last_peered":"2024-09-12T18:11:50.550646+0000","last_clean":"2024-09-12T18:11:50.550646+0000","last_became_active":"2024-09-12T17:10:42.514627+0000","last_became_peered":"2024-09-12T17:10:42.514627+0000","last_unstale":"2024-09-12T18:11:50.550646+0000","last_undegraded":"2024-09-12T18:11:50.550646+0000","last_fullsized":"2024-09-12T18:11:50.550646+0000","mapping_epoch":24,"log_start":"263'300","ondisk_log_start":"263'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'316","last_scrub_stamp":"2024-09-12T18:11:50.550499+0000","last_deep_scrub":"263'316","last_deep_scrub_stamp":"2024-09-12T18:11:50.550499+0000","last_clean_scrub_stamp":"2024-09-12T18:11:50.550499+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:01:57.030372+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":188,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":795,"num_read_kb":25839,"num_write":1196,"num_write_kb":43854,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":504,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:59.842677+0000","last_change":"2024-09-12T17:10:46.527010+0000","last_active":"2024-09-12T18:08:59.842677+0000","last_peered":"2024-09-12T18:08:59.842677+0000","last_clean":"2024-09-12T18:08:59.842677+0000","last_became_active":"2024-09-12T17:10:46.526692+0000","last_became_peered":"2024-09-12T17:10:46.526692+0000","last_unstale":"2024-09-12T18:08:59.842677+0000","last_undegraded":"2024-09-12T18:08:59.842677+0000","last_fullsized":"2024-09-12T18:08:59.842677+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_clean_scrub_stamp":"2024-09-12T17:10:45.504515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:02:16.851916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"263'213","reported_seq":846,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:41.270549+0000","last_change":"2024-09-12T17:10:48.545433+0000","last_active":"2024-09-12T18:11:41.270549+0000","last_peered":"2024-09-12T18:11:41.270549+0000","last_clean":"2024-09-12T18:11:41.270549+0000","last_became_active":"2024-09-12T17:10:48.544429+0000","last_became_peered":"2024-09-12T17:10:48.544429+0000","last_unstale":"2024-09-12T18:11:41.270549+0000","last_undegraded":"2024-09-12T18:11:41.270549+0000","last_fullsized":"2024-09-12T18:11:41.270549+0000","mapping_epoch":30,"log_start":"263'200","ondisk_log_start":"263'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_clean_scrub_stamp":"2024-09-12T17:10:47.516917+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:28:39.813411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14913,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":325,"num_read_kb":485,"num_write":208,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":485,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:19.847436+0000","last_change":"2024-09-12T17:10:50.565947+0000","last_active":"2024-09-12T18:08:19.847436+0000","last_peered":"2024-09-12T18:08:19.847436+0000","last_clean":"2024-09-12T18:08:19.847436+0000","last_became_active":"2024-09-12T17:10:50.565621+0000","last_became_peered":"2024-09-12T17:10:50.565621+0000","last_unstale":"2024-09-12T18:08:19.847436+0000","last_undegraded":"2024-09-12T18:08:19.847436+0000","last_fullsized":"2024-09-12T18:08:19.847436+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_clean_scrub_stamp":"2024-09-12T17:10:49.533772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:49:32.811403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"263'175","reported_seq":681,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:14.852393+0000","last_change":"2024-09-12T17:10:52.672357+0000","last_active":"2024-09-12T18:09:14.852393+0000","last_peered":"2024-09-12T18:09:14.852393+0000","last_clean":"2024-09-12T18:09:14.852393+0000","last_became_active":"2024-09-12T17:10:52.672033+0000","last_became_peered":"2024-09-12T17:10:52.672033+0000","last_unstale":"2024-09-12T18:09:14.852393+0000","last_undegraded":"2024-09-12T18:09:14.852393+0000","last_fullsized":"2024-09-12T18:09:14.852393+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:21:13.578314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":269,"num_read_kb":274,"num_write":411,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"263'548","reported_seq":2066,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:58.711194+0000","last_change":"2024-09-12T18:11:58.711194+0000","last_active":"2024-09-12T18:11:58.711194+0000","last_peered":"2024-09-12T18:11:58.711194+0000","last_clean":"2024-09-12T18:11:58.711194+0000","last_became_active":"2024-09-12T17:10:44.510696+0000","last_became_peered":"2024-09-12T17:10:44.510696+0000","last_unstale":"2024-09-12T18:11:58.711194+0000","last_undegraded":"2024-09-12T18:11:58.711194+0000","last_fullsized":"2024-09-12T18:11:58.711194+0000","mapping_epoch":26,"log_start":"263'500","ondisk_log_start":"263'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'548","last_scrub_stamp":"2024-09-12T18:11:58.711116+0000","last_deep_scrub":"263'548","last_deep_scrub_stamp":"2024-09-12T18:11:58.711116+0000","last_clean_scrub_stamp":"2024-09-12T18:11:58.711116+0000","objects_scrubbed":3,"log_size":48,"log_dups_size":500,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:00:54.289369+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2748,"num_read_kb":2501,"num_write":691,"num_write_kb":203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":946,"num_omap_keys":4,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"263'238","reported_seq":913,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:50.716191+0000","last_change":"2024-09-12T18:11:50.716191+0000","last_active":"2024-09-12T18:11:50.716191+0000","last_peered":"2024-09-12T18:11:50.716191+0000","last_clean":"2024-09-12T18:11:50.716191+0000","last_became_active":"2024-09-12T17:10:42.520349+0000","last_became_peered":"2024-09-12T17:10:42.520349+0000","last_unstale":"2024-09-12T18:11:50.716191+0000","last_undegraded":"2024-09-12T18:11:50.716191+0000","last_fullsized":"2024-09-12T18:11:50.716191+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'238","last_scrub_stamp":"2024-09-12T18:11:50.716063+0000","last_deep_scrub":"263'238","last_deep_scrub_stamp":"2024-09-12T18:11:50.716063+0000","last_clean_scrub_stamp":"2024-09-12T18:11:50.716063+0000","objects_scrubbed":9,"log_size":38,"log_dups_size":200,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:42:45.248398+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10743893,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":541,"num_read_kb":59039,"num_write":1206,"num_write_kb":37561,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,6],"acting":[1,3,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":508,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:01.699154+0000","last_change":"2024-09-12T18:12:01.699154+0000","last_active":"2024-09-12T18:12:01.699154+0000","last_peered":"2024-09-12T18:12:01.699154+0000","last_clean":"2024-09-12T18:12:01.699154+0000","last_became_active":"2024-09-12T17:10:46.530545+0000","last_became_peered":"2024-09-12T17:10:46.530545+0000","last_unstale":"2024-09-12T18:12:01.699154+0000","last_undegraded":"2024-09-12T18:12:01.699154+0000","last_fullsized":"2024-09-12T18:12:01.699154+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:01.699042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:01.699042+0000","last_clean_scrub_stamp":"2024-09-12T18:12:01.699042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:06:02.900923+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"263'170","reported_seq":754,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:41.287911+0000","last_change":"2024-09-12T17:10:48.541568+0000","last_active":"2024-09-12T18:11:41.287911+0000","last_peered":"2024-09-12T18:11:41.287911+0000","last_clean":"2024-09-12T18:11:41.287911+0000","last_became_active":"2024-09-12T17:10:48.541240+0000","last_became_peered":"2024-09-12T17:10:48.541240+0000","last_unstale":"2024-09-12T18:11:41.287911+0000","last_undegraded":"2024-09-12T18:11:41.287911+0000","last_fullsized":"2024-09-12T18:11:41.287911+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_clean_scrub_stamp":"2024-09-12T17:10:47.516917+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:09:34.296718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8547,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":246,"num_read_kb":321,"num_write":160,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":491,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:20.142401+0000","last_change":"2024-09-12T17:10:50.562714+0000","last_active":"2024-09-12T18:08:20.142401+0000","last_peered":"2024-09-12T18:08:20.142401+0000","last_clean":"2024-09-12T18:08:20.142401+0000","last_became_active":"2024-09-12T17:10:50.561983+0000","last_became_peered":"2024-09-12T17:10:50.561983+0000","last_unstale":"2024-09-12T18:08:20.142401+0000","last_undegraded":"2024-09-12T18:08:20.142401+0000","last_fullsized":"2024-09-12T18:08:20.142401+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_clean_scrub_stamp":"2024-09-12T17:10:49.533772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:59:00.374511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"263'244","reported_seq":1112,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:49.532850+0000","last_change":"2024-09-12T17:10:52.573923+0000","last_active":"2024-09-12T18:09:49.532850+0000","last_peered":"2024-09-12T18:09:49.532850+0000","last_clean":"2024-09-12T18:09:49.532850+0000","last_became_active":"2024-09-12T17:10:52.573595+0000","last_became_peered":"2024-09-12T17:10:52.573595+0000","last_unstale":"2024-09-12T18:09:49.532850+0000","last_undegraded":"2024-09-12T18:09:49.532850+0000","last_fullsized":"2024-09-12T18:09:49.532850+0000","mapping_epoch":34,"log_start":"263'200","ondisk_log_start":"263'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":200,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:32:14.573475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1635,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":641,"num_read_kb":637,"num_write":634,"num_write_kb":186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"263'622","reported_seq":2223,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:58.640774+0000","last_change":"2024-09-12T18:11:58.640774+0000","last_active":"2024-09-12T18:11:58.640774+0000","last_peered":"2024-09-12T18:11:58.640774+0000","last_clean":"2024-09-12T18:11:58.640774+0000","last_became_active":"2024-09-12T17:10:44.521041+0000","last_became_peered":"2024-09-12T17:10:44.521041+0000","last_unstale":"2024-09-12T18:11:58.640774+0000","last_undegraded":"2024-09-12T18:11:58.640774+0000","last_fullsized":"2024-09-12T18:11:58.640774+0000","mapping_epoch":26,"log_start":"263'600","ondisk_log_start":"263'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'622","last_scrub_stamp":"2024-09-12T18:11:58.640669+0000","last_deep_scrub":"263'622","last_deep_scrub_stamp":"2024-09-12T18:11:58.640669+0000","last_clean_scrub_stamp":"2024-09-12T18:11:58.640669+0000","objects_scrubbed":2,"log_size":22,"log_dups_size":600,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:27:58.198720+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3182,"num_read_kb":2947,"num_write":827,"num_write_kb":261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":247,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"263'222","reported_seq":822,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:54.585656+0000","last_change":"2024-09-12T18:11:54.585656+0000","last_active":"2024-09-12T18:11:54.585656+0000","last_peered":"2024-09-12T18:11:54.585656+0000","last_clean":"2024-09-12T18:11:54.585656+0000","last_became_active":"2024-09-12T17:11:16.860070+0000","last_became_peered":"2024-09-12T17:11:16.860070+0000","last_unstale":"2024-09-12T18:11:54.585656+0000","last_undegraded":"2024-09-12T18:11:54.585656+0000","last_fullsized":"2024-09-12T18:11:54.585656+0000","mapping_epoch":37,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'222","last_scrub_stamp":"2024-09-12T18:11:54.585507+0000","last_deep_scrub":"263'222","last_deep_scrub_stamp":"2024-09-12T18:11:54.585507+0000","last_clean_scrub_stamp":"2024-09-12T18:11:54.585507+0000","objects_scrubbed":5,"log_size":22,"log_dups_size":200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:11:02.947543+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3239711,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":443,"num_read_kb":10891,"num_write":955,"num_write_kb":36342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":501,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:19.848368+0000","last_change":"2024-09-12T17:10:46.530777+0000","last_active":"2024-09-12T18:08:19.848368+0000","last_peered":"2024-09-12T18:08:19.848368+0000","last_clean":"2024-09-12T18:08:19.848368+0000","last_became_active":"2024-09-12T17:10:46.530452+0000","last_became_peered":"2024-09-12T17:10:46.530452+0000","last_unstale":"2024-09-12T18:08:19.848368+0000","last_undegraded":"2024-09-12T18:08:19.848368+0000","last_fullsized":"2024-09-12T18:08:19.848368+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_clean_scrub_stamp":"2024-09-12T17:10:45.504515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:09:29.711456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"263'142","reported_seq":721,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:41.140332+0000","last_change":"2024-09-12T17:10:48.538046+0000","last_active":"2024-09-12T18:11:41.140332+0000","last_peered":"2024-09-12T18:11:41.140332+0000","last_clean":"2024-09-12T18:11:41.140332+0000","last_became_active":"2024-09-12T17:10:48.537643+0000","last_became_peered":"2024-09-12T17:10:48.537643+0000","last_unstale":"2024-09-12T18:11:41.140332+0000","last_undegraded":"2024-09-12T18:11:41.140332+0000","last_fullsized":"2024-09-12T18:11:41.140332+0000","mapping_epoch":30,"log_start":"263'100","ondisk_log_start":"263'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_clean_scrub_stamp":"2024-09-12T17:10:47.516917+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:09:50.764378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4406,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":180,"num_read_kb":223,"num_write":96,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:55.146261+0000","last_change":"2024-09-12T17:10:50.565961+0000","last_active":"2024-09-12T18:08:55.146261+0000","last_peered":"2024-09-12T18:08:55.146261+0000","last_clean":"2024-09-12T18:08:55.146261+0000","last_became_active":"2024-09-12T17:10:50.565582+0000","last_became_peered":"2024-09-12T17:10:50.565582+0000","last_unstale":"2024-09-12T18:08:55.146261+0000","last_undegraded":"2024-09-12T18:08:55.146261+0000","last_fullsized":"2024-09-12T18:08:55.146261+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_clean_scrub_stamp":"2024-09-12T17:10:49.533772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:00:34.128895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"263'130","reported_seq":617,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:09.828159+0000","last_change":"2024-09-12T17:10:52.576677+0000","last_active":"2024-09-12T18:11:09.828159+0000","last_peered":"2024-09-12T18:11:09.828159+0000","last_clean":"2024-09-12T18:11:09.828159+0000","last_became_active":"2024-09-12T17:10:52.576370+0000","last_became_peered":"2024-09-12T17:10:52.576370+0000","last_unstale":"2024-09-12T18:11:09.828159+0000","last_undegraded":"2024-09-12T18:11:09.828159+0000","last_fullsized":"2024-09-12T18:11:09.828159+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:03:31.842871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1233,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":145,"num_read_kb":142,"num_write":322,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"263'875","reported_seq":2433,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:52.838814+0000","last_change":"2024-09-12T18:11:52.838814+0000","last_active":"2024-09-12T18:11:52.838814+0000","last_peered":"2024-09-12T18:11:52.838814+0000","last_clean":"2024-09-12T18:11:52.838814+0000","last_became_active":"2024-09-12T17:10:44.519318+0000","last_became_peered":"2024-09-12T17:10:44.519318+0000","last_unstale":"2024-09-12T18:11:52.838814+0000","last_undegraded":"2024-09-12T18:11:52.838814+0000","last_fullsized":"2024-09-12T18:11:52.838814+0000","mapping_epoch":26,"log_start":"263'800","ondisk_log_start":"263'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'875","last_scrub_stamp":"2024-09-12T18:11:52.838719+0000","last_deep_scrub":"263'875","last_deep_scrub_stamp":"2024-09-12T18:11:52.838719+0000","last_clean_scrub_stamp":"2024-09-12T18:11:52.838719+0000","objects_scrubbed":3,"log_size":75,"log_dups_size":800,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:40:19.551440+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4021,"num_read_kb":3592,"num_write":1141,"num_write_kb":414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"263'186","reported_seq":807,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:46.616198+0000","last_change":"2024-09-12T18:11:46.616198+0000","last_active":"2024-09-12T18:11:46.616198+0000","last_peered":"2024-09-12T18:11:46.616198+0000","last_clean":"2024-09-12T18:11:46.616198+0000","last_became_active":"2024-09-12T17:10:42.516802+0000","last_became_peered":"2024-09-12T17:10:42.516802+0000","last_unstale":"2024-09-12T18:11:46.616198+0000","last_undegraded":"2024-09-12T18:11:46.616198+0000","last_fullsized":"2024-09-12T18:11:46.616198+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'186","last_scrub_stamp":"2024-09-12T18:11:46.616065+0000","last_deep_scrub":"263'186","last_deep_scrub_stamp":"2024-09-12T18:11:46.616065+0000","last_clean_scrub_stamp":"2024-09-12T18:11:46.616065+0000","objects_scrubbed":5,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:50:13.105798+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":287306,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":394,"num_read_kb":13109,"num_write":967,"num_write_kb":28742,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7,1],"acting":[0,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"263'5","reported_seq":986,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:04.504714+0000","last_change":"2024-09-12T18:12:04.504714+0000","last_active":"2024-09-12T18:12:04.504714+0000","last_peered":"2024-09-12T18:12:04.504714+0000","last_clean":"2024-09-12T18:12:04.504714+0000","last_became_active":"2024-09-12T17:10:46.530466+0000","last_became_peered":"2024-09-12T17:10:46.530466+0000","last_unstale":"2024-09-12T18:12:04.504714+0000","last_undegraded":"2024-09-12T18:12:04.504714+0000","last_fullsized":"2024-09-12T18:12:04.504714+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'5","last_scrub_stamp":"2024-09-12T18:12:04.504622+0000","last_deep_scrub":"263'5","last_deep_scrub_stamp":"2024-09-12T18:12:04.504622+0000","last_clean_scrub_stamp":"2024-09-12T18:12:04.504622+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:57:02.945885+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":721,"num_read_kb":1187,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"263'90","reported_seq":623,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:59.853778+0000","last_change":"2024-09-12T17:10:48.538034+0000","last_active":"2024-09-12T18:08:59.853778+0000","last_peered":"2024-09-12T18:08:59.853778+0000","last_clean":"2024-09-12T18:08:59.853778+0000","last_became_active":"2024-09-12T17:10:48.537715+0000","last_became_peered":"2024-09-12T17:10:48.537715+0000","last_unstale":"2024-09-12T18:08:59.853778+0000","last_undegraded":"2024-09-12T18:08:59.853778+0000","last_fullsized":"2024-09-12T18:08:59.853778+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_clean_scrub_stamp":"2024-09-12T17:10:47.516917+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:50:02.415975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":103,"num_read_kb":94,"num_write":78,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"263'763","reported_seq":2584,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:41.006379+0000","last_change":"2024-09-12T17:10:50.552759+0000","last_active":"2024-09-12T18:11:41.006379+0000","last_peered":"2024-09-12T18:11:41.006379+0000","last_clean":"2024-09-12T18:11:41.006379+0000","last_became_active":"2024-09-12T17:10:50.552439+0000","last_became_peered":"2024-09-12T17:10:50.552439+0000","last_unstale":"2024-09-12T18:11:41.006379+0000","last_undegraded":"2024-09-12T18:11:41.006379+0000","last_fullsized":"2024-09-12T18:11:41.006379+0000","mapping_epoch":32,"log_start":"263'700","ondisk_log_start":"263'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_clean_scrub_stamp":"2024-09-12T17:10:49.533772+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":700,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:05:46.061876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"263'101","reported_seq":599,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:14.856275+0000","last_change":"2024-09-12T17:10:52.576632+0000","last_active":"2024-09-12T18:09:14.856275+0000","last_peered":"2024-09-12T18:09:14.856275+0000","last_clean":"2024-09-12T18:09:14.856275+0000","last_became_active":"2024-09-12T17:10:52.576354+0000","last_became_peered":"2024-09-12T17:10:52.576354+0000","last_unstale":"2024-09-12T18:09:14.856275+0000","last_undegraded":"2024-09-12T18:09:14.856275+0000","last_fullsized":"2024-09-12T18:09:14.856275+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:31:48.033949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":153,"num_read_kb":145,"num_write":246,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"263'891","reported_seq":2570,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:58.382145+0000","last_change":"2024-09-12T18:11:58.382145+0000","last_active":"2024-09-12T18:11:58.382145+0000","last_peered":"2024-09-12T18:11:58.382145+0000","last_clean":"2024-09-12T18:11:58.382145+0000","last_became_active":"2024-09-12T17:10:44.514263+0000","last_became_peered":"2024-09-12T17:10:44.514263+0000","last_unstale":"2024-09-12T18:11:58.382145+0000","last_undegraded":"2024-09-12T18:11:58.382145+0000","last_fullsized":"2024-09-12T18:11:58.382145+0000","mapping_epoch":26,"log_start":"263'800","ondisk_log_start":"263'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'891","last_scrub_stamp":"2024-09-12T18:11:58.382053+0000","last_deep_scrub":"263'891","last_deep_scrub_stamp":"2024-09-12T18:11:58.382053+0000","last_clean_scrub_stamp":"2024-09-12T18:11:58.382053+0000","objects_scrubbed":3,"log_size":91,"log_dups_size":800,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:24:30.850739+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4092,"num_read_kb":3689,"num_write":1154,"num_write_kb":400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"263'220","reported_seq":866,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:49.222867+0000","last_change":"2024-09-12T18:11:49.222867+0000","last_active":"2024-09-12T18:11:49.222867+0000","last_peered":"2024-09-12T18:11:49.222867+0000","last_clean":"2024-09-12T18:11:49.222867+0000","last_became_active":"2024-09-12T17:10:42.527644+0000","last_became_peered":"2024-09-12T17:10:42.527644+0000","last_unstale":"2024-09-12T18:11:49.222867+0000","last_undegraded":"2024-09-12T18:11:49.222867+0000","last_fullsized":"2024-09-12T18:11:49.222867+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'220","last_scrub_stamp":"2024-09-12T18:11:49.222706+0000","last_deep_scrub":"263'220","last_deep_scrub_stamp":"2024-09-12T18:11:49.222706+0000","last_clean_scrub_stamp":"2024-09-12T18:11:49.222706+0000","objects_scrubbed":5,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:22:56.036981+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":569092,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":486,"num_read_kb":29332,"num_write":1044,"num_write_kb":31012,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,6],"acting":[5,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:19.848670+0000","last_change":"2024-09-12T17:10:46.532064+0000","last_active":"2024-09-12T18:08:19.848670+0000","last_peered":"2024-09-12T18:08:19.848670+0000","last_clean":"2024-09-12T18:08:19.848670+0000","last_became_active":"2024-09-12T17:10:46.531759+0000","last_became_peered":"2024-09-12T17:10:46.531759+0000","last_unstale":"2024-09-12T18:08:19.848670+0000","last_undegraded":"2024-09-12T18:08:19.848670+0000","last_fullsized":"2024-09-12T18:08:19.848670+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_clean_scrub_stamp":"2024-09-12T17:10:45.504515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:32:10.706827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"263'200","reported_seq":786,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:41.210065+0000","last_change":"2024-09-12T17:10:48.543431+0000","last_active":"2024-09-12T18:11:41.210065+0000","last_peered":"2024-09-12T18:11:41.210065+0000","last_clean":"2024-09-12T18:11:41.210065+0000","last_became_active":"2024-09-12T17:10:48.543123+0000","last_became_peered":"2024-09-12T17:10:48.543123+0000","last_unstale":"2024-09-12T18:11:41.210065+0000","last_undegraded":"2024-09-12T18:11:41.210065+0000","last_fullsized":"2024-09-12T18:11:41.210065+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_clean_scrub_stamp":"2024-09-12T17:10:47.516917+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:14:40.758351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9151,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":248,"num_read_kb":305,"num_write":156,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":491,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:49.841229+0000","last_change":"2024-09-12T17:10:50.556322+0000","last_active":"2024-09-12T18:08:49.841229+0000","last_peered":"2024-09-12T18:08:49.841229+0000","last_clean":"2024-09-12T18:08:49.841229+0000","last_became_active":"2024-09-12T17:10:50.556040+0000","last_became_peered":"2024-09-12T17:10:50.556040+0000","last_unstale":"2024-09-12T18:08:49.841229+0000","last_undegraded":"2024-09-12T18:08:49.841229+0000","last_fullsized":"2024-09-12T18:08:49.841229+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_clean_scrub_stamp":"2024-09-12T17:10:49.533772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:11:28.653630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"263'132","reported_seq":632,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:46.952145+0000","last_change":"2024-09-12T17:10:52.585108+0000","last_active":"2024-09-12T18:09:46.952145+0000","last_peered":"2024-09-12T18:09:46.952145+0000","last_clean":"2024-09-12T18:09:46.952145+0000","last_became_active":"2024-09-12T17:10:52.584752+0000","last_became_peered":"2024-09-12T17:10:52.584752+0000","last_unstale":"2024-09-12T18:09:46.952145+0000","last_undegraded":"2024-09-12T18:09:46.952145+0000","last_fullsized":"2024-09-12T18:09:46.952145+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:17:54.690247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":200,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":199,"num_read_kb":187,"num_write":331,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"263'458","reported_seq":2257,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:56.346868+0000","last_change":"2024-09-12T18:11:56.346868+0000","last_active":"2024-09-12T18:11:56.346868+0000","last_peered":"2024-09-12T18:11:56.346868+0000","last_clean":"2024-09-12T18:11:56.346868+0000","last_became_active":"2024-09-12T17:10:44.515463+0000","last_became_peered":"2024-09-12T17:10:44.515463+0000","last_unstale":"2024-09-12T18:11:56.346868+0000","last_undegraded":"2024-09-12T18:11:56.346868+0000","last_fullsized":"2024-09-12T18:11:56.346868+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'458","last_scrub_stamp":"2024-09-12T18:11:56.346672+0000","last_deep_scrub":"263'458","last_deep_scrub_stamp":"2024-09-12T18:11:56.346672+0000","last_clean_scrub_stamp":"2024-09-12T18:11:56.346672+0000","objects_scrubbed":3,"log_size":58,"log_dups_size":400,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:31:31.404176+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2803,"num_read_kb":2700,"num_write":505,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2296,"num_omap_keys":9,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"263'189","reported_seq":813,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:52.278519+0000","last_change":"2024-09-12T18:11:52.278519+0000","last_active":"2024-09-12T18:11:52.278519+0000","last_peered":"2024-09-12T18:11:52.278519+0000","last_clean":"2024-09-12T18:11:52.278519+0000","last_became_active":"2024-09-12T17:10:42.529547+0000","last_became_peered":"2024-09-12T17:10:42.529547+0000","last_unstale":"2024-09-12T18:11:52.278519+0000","last_undegraded":"2024-09-12T18:11:52.278519+0000","last_fullsized":"2024-09-12T18:11:52.278519+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'189","last_scrub_stamp":"2024-09-12T18:11:52.278416+0000","last_deep_scrub":"263'189","last_deep_scrub_stamp":"2024-09-12T18:11:52.278416+0000","last_clean_scrub_stamp":"2024-09-12T18:11:52.278416+0000","objects_scrubbed":1,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:18:56.517970+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262159,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":394,"num_read_kb":39415,"num_write":893,"num_write_kb":32700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,6],"acting":[5,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:19.847401+0000","last_change":"2024-09-12T17:10:46.532778+0000","last_active":"2024-09-12T18:08:19.847401+0000","last_peered":"2024-09-12T18:08:19.847401+0000","last_clean":"2024-09-12T18:08:19.847401+0000","last_became_active":"2024-09-12T17:10:46.532418+0000","last_became_peered":"2024-09-12T17:10:46.532418+0000","last_unstale":"2024-09-12T18:08:19.847401+0000","last_undegraded":"2024-09-12T18:08:19.847401+0000","last_fullsized":"2024-09-12T18:08:19.847401+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_clean_scrub_stamp":"2024-09-12T17:10:45.504515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:36:54.346427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"263'132","reported_seq":705,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:41.217909+0000","last_change":"2024-09-12T17:10:48.539329+0000","last_active":"2024-09-12T18:11:41.217909+0000","last_peered":"2024-09-12T18:11:41.217909+0000","last_clean":"2024-09-12T18:11:41.217909+0000","last_became_active":"2024-09-12T17:10:48.539047+0000","last_became_peered":"2024-09-12T17:10:48.539047+0000","last_unstale":"2024-09-12T18:11:41.217909+0000","last_undegraded":"2024-09-12T18:11:41.217909+0000","last_fullsized":"2024-09-12T18:11:41.217909+0000","mapping_epoch":30,"log_start":"263'100","ondisk_log_start":"263'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_clean_scrub_stamp":"2024-09-12T17:10:47.516917+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:16:56.494114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5891,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":167,"num_read_kb":220,"num_write":88,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:59.873702+0000","last_change":"2024-09-12T17:10:50.556644+0000","last_active":"2024-09-12T18:08:59.873702+0000","last_peered":"2024-09-12T18:08:59.873702+0000","last_clean":"2024-09-12T18:08:59.873702+0000","last_became_active":"2024-09-12T17:10:50.555858+0000","last_became_peered":"2024-09-12T17:10:50.555858+0000","last_unstale":"2024-09-12T18:08:59.873702+0000","last_undegraded":"2024-09-12T18:08:59.873702+0000","last_fullsized":"2024-09-12T18:08:59.873702+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_clean_scrub_stamp":"2024-09-12T17:10:49.533772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:24:28.762169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"263'112","reported_seq":626,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:55.349086+0000","last_change":"2024-09-12T17:10:52.671426+0000","last_active":"2024-09-12T18:08:55.349086+0000","last_peered":"2024-09-12T18:08:55.349086+0000","last_clean":"2024-09-12T18:08:55.349086+0000","last_became_active":"2024-09-12T17:10:52.671139+0000","last_became_peered":"2024-09-12T17:10:52.671139+0000","last_unstale":"2024-09-12T18:08:55.349086+0000","last_undegraded":"2024-09-12T18:08:55.349086+0000","last_fullsized":"2024-09-12T18:08:55.349086+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:12:33.369332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":178,"num_read_kb":175,"num_write":256,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"263'787","reported_seq":2346,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:02.451406+0000","last_change":"2024-09-12T18:12:02.451406+0000","last_active":"2024-09-12T18:12:02.451406+0000","last_peered":"2024-09-12T18:12:02.451406+0000","last_clean":"2024-09-12T18:12:02.451406+0000","last_became_active":"2024-09-12T17:11:16.618723+0000","last_became_peered":"2024-09-12T17:11:16.618723+0000","last_unstale":"2024-09-12T18:12:02.451406+0000","last_undegraded":"2024-09-12T18:12:02.451406+0000","last_fullsized":"2024-09-12T18:12:02.451406+0000","mapping_epoch":37,"log_start":"263'700","ondisk_log_start":"263'700","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'787","last_scrub_stamp":"2024-09-12T18:12:02.451316+0000","last_deep_scrub":"263'787","last_deep_scrub_stamp":"2024-09-12T18:12:02.451316+0000","last_clean_scrub_stamp":"2024-09-12T18:12:02.451316+0000","objects_scrubbed":3,"log_size":87,"log_dups_size":700,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:25:44.064178+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4039,"num_read_kb":3670,"num_write":1050,"num_write_kb":387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":721,"num_omap_keys":3,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"263'172","reported_seq":841,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:51.566718+0000","last_change":"2024-09-12T18:11:51.566718+0000","last_active":"2024-09-12T18:11:51.566718+0000","last_peered":"2024-09-12T18:11:51.566718+0000","last_clean":"2024-09-12T18:11:51.566718+0000","last_became_active":"2024-09-12T17:10:42.534052+0000","last_became_peered":"2024-09-12T17:10:42.534052+0000","last_unstale":"2024-09-12T18:11:51.566718+0000","last_undegraded":"2024-09-12T18:11:51.566718+0000","last_fullsized":"2024-09-12T18:11:51.566718+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'172","last_scrub_stamp":"2024-09-12T18:11:51.566522+0000","last_deep_scrub":"263'172","last_deep_scrub_stamp":"2024-09-12T18:11:51.566522+0000","last_clean_scrub_stamp":"2024-09-12T18:11:51.566522+0000","objects_scrubbed":4,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:00:03.267177+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":311063,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":426,"num_read_kb":101566,"num_write":826,"num_write_kb":35642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7,2],"acting":[3,6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:49.852279+0000","last_change":"2024-09-12T17:10:46.530515+0000","last_active":"2024-09-12T18:08:49.852279+0000","last_peered":"2024-09-12T18:08:49.852279+0000","last_clean":"2024-09-12T18:08:49.852279+0000","last_became_active":"2024-09-12T17:10:46.530079+0000","last_became_peered":"2024-09-12T17:10:46.530079+0000","last_unstale":"2024-09-12T18:08:49.852279+0000","last_undegraded":"2024-09-12T18:08:49.852279+0000","last_fullsized":"2024-09-12T18:08:49.852279+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:45.504515+0000","last_clean_scrub_stamp":"2024-09-12T17:10:45.504515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:40:53.204632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"263'104","reported_seq":660,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:41.107797+0000","last_change":"2024-09-12T17:10:48.543215+0000","last_active":"2024-09-12T18:11:41.107797+0000","last_peered":"2024-09-12T18:11:41.107797+0000","last_clean":"2024-09-12T18:11:41.107797+0000","last_became_active":"2024-09-12T17:10:48.542918+0000","last_became_peered":"2024-09-12T17:10:48.542918+0000","last_unstale":"2024-09-12T18:11:41.107797+0000","last_undegraded":"2024-09-12T18:11:41.107797+0000","last_fullsized":"2024-09-12T18:11:41.107797+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_clean_scrub_stamp":"2024-09-12T17:10:47.516917+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:28:39.813411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7088,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":129,"num_read_kb":191,"num_write":60,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:19.848339+0000","last_change":"2024-09-12T17:10:50.558543+0000","last_active":"2024-09-12T18:08:19.848339+0000","last_peered":"2024-09-12T18:08:19.848339+0000","last_clean":"2024-09-12T18:08:19.848339+0000","last_became_active":"2024-09-12T17:10:50.558162+0000","last_became_peered":"2024-09-12T17:10:50.558162+0000","last_unstale":"2024-09-12T18:08:19.848339+0000","last_undegraded":"2024-09-12T18:08:19.848339+0000","last_fullsized":"2024-09-12T18:08:19.848339+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_clean_scrub_stamp":"2024-09-12T17:10:49.533772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:13:27.613750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"263'151","reported_seq":1246,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:46.551935+0000","last_change":"2024-09-12T17:10:52.585025+0000","last_active":"2024-09-12T18:09:46.551935+0000","last_peered":"2024-09-12T18:09:46.551935+0000","last_clean":"2024-09-12T18:09:46.551935+0000","last_became_active":"2024-09-12T17:10:52.584763+0000","last_became_peered":"2024-09-12T17:10:52.584763+0000","last_unstale":"2024-09-12T18:09:46.551935+0000","last_undegraded":"2024-09-12T18:09:46.551935+0000","last_fullsized":"2024-09-12T18:09:46.551935+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:21:47.900231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":215,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":802,"num_read_kb":800,"num_write":350,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"263'1274","reported_seq":2985,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:55.368952+0000","last_change":"2024-09-12T18:11:55.368952+0000","last_active":"2024-09-12T18:11:55.368952+0000","last_peered":"2024-09-12T18:11:55.368952+0000","last_clean":"2024-09-12T18:11:55.368952+0000","last_became_active":"2024-09-12T17:10:44.513047+0000","last_became_peered":"2024-09-12T17:10:44.513047+0000","last_unstale":"2024-09-12T18:11:55.368952+0000","last_undegraded":"2024-09-12T18:11:55.368952+0000","last_fullsized":"2024-09-12T18:11:55.368952+0000","mapping_epoch":26,"log_start":"263'1200","ondisk_log_start":"263'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1274","last_scrub_stamp":"2024-09-12T18:11:55.368862+0000","last_deep_scrub":"263'1274","last_deep_scrub_stamp":"2024-09-12T18:11:55.368862+0000","last_clean_scrub_stamp":"2024-09-12T18:11:55.368862+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":1200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:24:50.641775+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5916,"num_read_kb":5241,"num_write":1773,"num_write_kb":764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"263'270","reported_seq":946,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:49.700632+0000","last_change":"2024-09-12T18:11:49.700632+0000","last_active":"2024-09-12T18:11:49.700632+0000","last_peered":"2024-09-12T18:11:49.700632+0000","last_clean":"2024-09-12T18:11:49.700632+0000","last_became_active":"2024-09-12T17:11:16.862649+0000","last_became_peered":"2024-09-12T17:11:16.862649+0000","last_unstale":"2024-09-12T18:11:49.700632+0000","last_undegraded":"2024-09-12T18:11:49.700632+0000","last_fullsized":"2024-09-12T18:11:49.700632+0000","mapping_epoch":37,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'270","last_scrub_stamp":"2024-09-12T18:11:49.700437+0000","last_deep_scrub":"263'270","last_deep_scrub_stamp":"2024-09-12T18:11:49.700437+0000","last_clean_scrub_stamp":"2024-09-12T18:11:49.700437+0000","objects_scrubbed":5,"log_size":70,"log_dups_size":200,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:58:14.954108+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079905,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":591,"num_read_kb":13963,"num_write":1200,"num_write_kb":16858,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,7],"acting":[0,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"263'2","reported_seq":510,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:03.517735+0000","last_change":"2024-09-12T18:12:03.517735+0000","last_active":"2024-09-12T18:12:03.517735+0000","last_peered":"2024-09-12T18:12:03.517735+0000","last_clean":"2024-09-12T18:12:03.517735+0000","last_became_active":"2024-09-12T17:10:46.527422+0000","last_became_peered":"2024-09-12T17:10:46.527422+0000","last_unstale":"2024-09-12T18:12:03.517735+0000","last_undegraded":"2024-09-12T18:12:03.517735+0000","last_fullsized":"2024-09-12T18:12:03.517735+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T18:12:03.517615+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T18:12:03.517615+0000","last_clean_scrub_stamp":"2024-09-12T18:12:03.517615+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:57.076736+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"263'165","reported_seq":756,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:41.153421+0000","last_change":"2024-09-12T17:10:48.545106+0000","last_active":"2024-09-12T18:11:41.153421+0000","last_peered":"2024-09-12T18:11:41.153421+0000","last_clean":"2024-09-12T18:11:41.153421+0000","last_became_active":"2024-09-12T17:10:48.544572+0000","last_became_peered":"2024-09-12T17:10:48.544572+0000","last_unstale":"2024-09-12T18:11:41.153421+0000","last_undegraded":"2024-09-12T18:11:41.153421+0000","last_fullsized":"2024-09-12T18:11:41.153421+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:47.516917+0000","last_clean_scrub_stamp":"2024-09-12T17:10:47.516917+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:11:28.036014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6031,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":216,"num_read_kb":279,"num_write":122,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":490,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:19.837629+0000","last_change":"2024-09-12T17:10:50.560331+0000","last_active":"2024-09-12T18:08:19.837629+0000","last_peered":"2024-09-12T18:08:19.837629+0000","last_clean":"2024-09-12T18:08:19.837629+0000","last_became_active":"2024-09-12T17:10:50.560057+0000","last_became_peered":"2024-09-12T17:10:50.560057+0000","last_unstale":"2024-09-12T18:08:19.837629+0000","last_undegraded":"2024-09-12T18:08:19.837629+0000","last_fullsized":"2024-09-12T18:08:19.837629+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:49.533772+0000","last_clean_scrub_stamp":"2024-09-12T17:10:49.533772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:11:03.611393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"263'132","reported_seq":624,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:08.698258+0000","last_change":"2024-09-12T17:10:52.570799+0000","last_active":"2024-09-12T18:11:08.698258+0000","last_peered":"2024-09-12T18:11:08.698258+0000","last_clean":"2024-09-12T18:11:08.698258+0000","last_became_active":"2024-09-12T17:10:52.570480+0000","last_became_peered":"2024-09-12T17:10:52.570480+0000","last_unstale":"2024-09-12T18:11:08.698258+0000","last_undegraded":"2024-09-12T18:11:08.698258+0000","last_fullsized":"2024-09-12T18:11:08.698258+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":203,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":138,"num_read_kb":137,"num_write":320,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"263'412","reported_seq":1803,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:01.560956+0000","last_change":"2024-09-12T18:12:01.560956+0000","last_active":"2024-09-12T18:12:01.560956+0000","last_peered":"2024-09-12T18:12:01.560956+0000","last_clean":"2024-09-12T18:12:01.560956+0000","last_became_active":"2024-09-12T17:10:44.509508+0000","last_became_peered":"2024-09-12T17:10:44.509508+0000","last_unstale":"2024-09-12T18:12:01.560956+0000","last_undegraded":"2024-09-12T18:12:01.560956+0000","last_fullsized":"2024-09-12T18:12:01.560956+0000","mapping_epoch":26,"log_start":"263'401","ondisk_log_start":"263'401","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'412","last_scrub_stamp":"2024-09-12T18:12:01.560858+0000","last_deep_scrub":"263'412","last_deep_scrub_stamp":"2024-09-12T18:12:01.560858+0000","last_clean_scrub_stamp":"2024-09-12T18:12:01.560858+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":401,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:20:20.291813+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2094,"num_read_kb":1953,"num_write":504,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"263'239","reported_seq":891,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:50.835781+0000","last_change":"2024-09-12T18:11:50.835781+0000","last_active":"2024-09-12T18:11:50.835781+0000","last_peered":"2024-09-12T18:11:50.835781+0000","last_clean":"2024-09-12T18:11:50.835781+0000","last_became_active":"2024-09-12T17:10:42.521435+0000","last_became_peered":"2024-09-12T17:10:42.521435+0000","last_unstale":"2024-09-12T18:11:50.835781+0000","last_undegraded":"2024-09-12T18:11:50.835781+0000","last_fullsized":"2024-09-12T18:11:50.835781+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'239","last_scrub_stamp":"2024-09-12T18:11:50.835643+0000","last_deep_scrub":"263'239","last_deep_scrub_stamp":"2024-09-12T18:11:50.835643+0000","last_clean_scrub_stamp":"2024-09-12T18:11:50.835643+0000","objects_scrubbed":2,"log_size":39,"log_dups_size":200,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:10:01.459513+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079890,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":525,"num_read_kb":7759,"num_write":1104,"num_write_kb":27695,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,5],"acting":[6,0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"263'496","reported_seq":2220,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:59.616995+0000","last_change":"2024-09-12T18:11:59.616995+0000","last_active":"2024-09-12T18:11:59.616995+0000","last_peered":"2024-09-12T18:11:59.616995+0000","last_clean":"2024-09-12T18:11:59.616995+0000","last_became_active":"2024-09-12T17:10:44.519236+0000","last_became_peered":"2024-09-12T17:10:44.519236+0000","last_unstale":"2024-09-12T18:11:59.616995+0000","last_undegraded":"2024-09-12T18:11:59.616995+0000","last_fullsized":"2024-09-12T18:11:59.616995+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'496","last_scrub_stamp":"2024-09-12T18:11:59.616900+0000","last_deep_scrub":"263'496","last_deep_scrub_stamp":"2024-09-12T18:11:59.616900+0000","last_clean_scrub_stamp":"2024-09-12T18:11:59.616900+0000","objects_scrubbed":4,"log_size":96,"log_dups_size":400,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:18:26.390822+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2628,"num_read_kb":2506,"num_write":587,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":959,"num_omap_keys":4,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"263'256","reported_seq":1028,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:46.841303+0000","last_change":"2024-09-12T18:11:46.841303+0000","last_active":"2024-09-12T18:11:46.841303+0000","last_peered":"2024-09-12T18:11:46.841303+0000","last_clean":"2024-09-12T18:11:46.841303+0000","last_became_active":"2024-09-12T17:10:42.519178+0000","last_became_peered":"2024-09-12T17:10:42.519178+0000","last_unstale":"2024-09-12T18:11:46.841303+0000","last_undegraded":"2024-09-12T18:11:46.841303+0000","last_fullsized":"2024-09-12T18:11:46.841303+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'256","last_scrub_stamp":"2024-09-12T18:11:46.841193+0000","last_deep_scrub":"263'256","last_deep_scrub_stamp":"2024-09-12T18:11:46.841193+0000","last_clean_scrub_stamp":"2024-09-12T18:11:46.841193+0000","objects_scrubbed":4,"log_size":56,"log_dups_size":200,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:18:03.918052+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1051,"num_read_kb":7502,"num_write":1184,"num_write_kb":38848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6,7],"acting":[2,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"263'393","reported_seq":1978,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:03.464560+0000","last_change":"2024-09-12T18:12:03.464560+0000","last_active":"2024-09-12T18:12:03.464560+0000","last_peered":"2024-09-12T18:12:03.464560+0000","last_clean":"2024-09-12T18:12:03.464560+0000","last_became_active":"2024-09-12T17:10:44.515474+0000","last_became_peered":"2024-09-12T17:10:44.515474+0000","last_unstale":"2024-09-12T18:12:03.464560+0000","last_undegraded":"2024-09-12T18:12:03.464560+0000","last_fullsized":"2024-09-12T18:12:03.464560+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'393","last_scrub_stamp":"2024-09-12T18:12:03.464469+0000","last_deep_scrub":"263'393","last_deep_scrub_stamp":"2024-09-12T18:12:03.464469+0000","last_clean_scrub_stamp":"2024-09-12T18:12:03.464469+0000","objects_scrubbed":2,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:20:00.913328+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2306,"num_read_kb":2212,"num_write":451,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2811,"num_omap_keys":11,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"263'194","reported_seq":821,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:49.831325+0000","last_change":"2024-09-12T18:11:49.831325+0000","last_active":"2024-09-12T18:11:49.831325+0000","last_peered":"2024-09-12T18:11:49.831325+0000","last_clean":"2024-09-12T18:11:49.831325+0000","last_became_active":"2024-09-12T17:11:16.617657+0000","last_became_peered":"2024-09-12T17:11:16.617657+0000","last_unstale":"2024-09-12T18:11:49.831325+0000","last_undegraded":"2024-09-12T18:11:49.831325+0000","last_fullsized":"2024-09-12T18:11:49.831325+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'194","last_scrub_stamp":"2024-09-12T18:11:49.831132+0000","last_deep_scrub":"263'194","last_deep_scrub_stamp":"2024-09-12T18:11:49.831132+0000","last_clean_scrub_stamp":"2024-09-12T18:11:49.831132+0000","objects_scrubbed":4,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:50:28.703505+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2421940,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":499,"num_read_kb":26759,"num_write":947,"num_write_kb":25619,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,6],"acting":[2,3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"263'796","reported_seq":2424,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:58.588172+0000","last_change":"2024-09-12T18:11:58.588172+0000","last_active":"2024-09-12T18:11:58.588172+0000","last_peered":"2024-09-12T18:11:58.588172+0000","last_clean":"2024-09-12T18:11:58.588172+0000","last_became_active":"2024-09-12T17:10:44.509845+0000","last_became_peered":"2024-09-12T17:10:44.509845+0000","last_unstale":"2024-09-12T18:11:58.588172+0000","last_undegraded":"2024-09-12T18:11:58.588172+0000","last_fullsized":"2024-09-12T18:11:58.588172+0000","mapping_epoch":26,"log_start":"263'700","ondisk_log_start":"263'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'796","last_scrub_stamp":"2024-09-12T18:11:58.588066+0000","last_deep_scrub":"263'796","last_deep_scrub_stamp":"2024-09-12T18:11:58.588066+0000","last_clean_scrub_stamp":"2024-09-12T18:11:58.588066+0000","objects_scrubbed":4,"log_size":96,"log_dups_size":700,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:21:17.530150+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3882,"num_read_kb":3524,"num_write":1030,"num_write_kb":369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1767,"num_omap_keys":7,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"263'227","reported_seq":866,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:48.683516+0000","last_change":"2024-09-12T18:11:48.683516+0000","last_active":"2024-09-12T18:11:48.683516+0000","last_peered":"2024-09-12T18:11:48.683516+0000","last_clean":"2024-09-12T18:11:48.683516+0000","last_became_active":"2024-09-12T17:10:42.519560+0000","last_became_peered":"2024-09-12T17:10:42.519560+0000","last_unstale":"2024-09-12T18:11:48.683516+0000","last_undegraded":"2024-09-12T18:11:48.683516+0000","last_fullsized":"2024-09-12T18:11:48.683516+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'227","last_scrub_stamp":"2024-09-12T18:11:48.683332+0000","last_deep_scrub":"263'227","last_deep_scrub_stamp":"2024-09-12T18:11:48.683332+0000","last_clean_scrub_stamp":"2024-09-12T18:11:48.683332+0000","objects_scrubbed":4,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:30:14.775998+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436858,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":420,"num_read_kb":2141,"num_write":1026,"num_write_kb":23963,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,1],"acting":[0,3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"263'775","reported_seq":2456,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:02.695598+0000","last_change":"2024-09-12T18:12:02.695598+0000","last_active":"2024-09-12T18:12:02.695598+0000","last_peered":"2024-09-12T18:12:02.695598+0000","last_clean":"2024-09-12T18:12:02.695598+0000","last_became_active":"2024-09-12T17:10:44.511893+0000","last_became_peered":"2024-09-12T17:10:44.511893+0000","last_unstale":"2024-09-12T18:12:02.695598+0000","last_undegraded":"2024-09-12T18:12:02.695598+0000","last_fullsized":"2024-09-12T18:12:02.695598+0000","mapping_epoch":26,"log_start":"263'700","ondisk_log_start":"263'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'775","last_scrub_stamp":"2024-09-12T18:12:02.695496+0000","last_deep_scrub":"263'775","last_deep_scrub_stamp":"2024-09-12T18:12:02.695496+0000","last_clean_scrub_stamp":"2024-09-12T18:12:02.695496+0000","objects_scrubbed":6,"log_size":75,"log_dups_size":700,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:46:44.854411+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":3826,"num_read_kb":3490,"num_write":982,"num_write_kb":336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":873,"num_omap_keys":4,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"263'223","reported_seq":1076,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:52.597345+0000","last_change":"2024-09-12T18:11:52.597345+0000","last_active":"2024-09-12T18:11:52.597345+0000","last_peered":"2024-09-12T18:11:52.597345+0000","last_clean":"2024-09-12T18:11:52.597345+0000","last_became_active":"2024-09-12T17:10:42.524018+0000","last_became_peered":"2024-09-12T17:10:42.524018+0000","last_unstale":"2024-09-12T18:11:52.597345+0000","last_undegraded":"2024-09-12T18:11:52.597345+0000","last_fullsized":"2024-09-12T18:11:52.597345+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'223","last_scrub_stamp":"2024-09-12T18:11:52.597221+0000","last_deep_scrub":"263'223","last_deep_scrub_stamp":"2024-09-12T18:11:52.597221+0000","last_clean_scrub_stamp":"2024-09-12T18:11:52.597221+0000","objects_scrubbed":7,"log_size":23,"log_dups_size":200,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:24:31.501834+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6860809,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1298,"num_read_kb":150766,"num_write":988,"num_write_kb":42134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0,7],"acting":[3,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"263'525","reported_seq":2028,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:00.344852+0000","last_change":"2024-09-12T18:12:00.344852+0000","last_active":"2024-09-12T18:12:00.344852+0000","last_peered":"2024-09-12T18:12:00.344852+0000","last_clean":"2024-09-12T18:12:00.344852+0000","last_became_active":"2024-09-12T17:10:44.509433+0000","last_became_peered":"2024-09-12T17:10:44.509433+0000","last_unstale":"2024-09-12T18:12:00.344852+0000","last_undegraded":"2024-09-12T18:12:00.344852+0000","last_fullsized":"2024-09-12T18:12:00.344852+0000","mapping_epoch":26,"log_start":"263'500","ondisk_log_start":"263'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'525","last_scrub_stamp":"2024-09-12T18:12:00.344754+0000","last_deep_scrub":"263'525","last_deep_scrub_stamp":"2024-09-12T18:12:00.344754+0000","last_clean_scrub_stamp":"2024-09-12T18:12:00.344754+0000","objects_scrubbed":1,"log_size":25,"log_dups_size":500,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:26:19.066537+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2637,"num_read_kb":2409,"num_write":664,"num_write_kb":195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"263'180","reported_seq":848,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:49.669048+0000","last_change":"2024-09-12T18:11:49.669048+0000","last_active":"2024-09-12T18:11:49.669048+0000","last_peered":"2024-09-12T18:11:49.669048+0000","last_clean":"2024-09-12T18:11:49.669048+0000","last_became_active":"2024-09-12T17:10:42.514593+0000","last_became_peered":"2024-09-12T17:10:42.514593+0000","last_unstale":"2024-09-12T18:11:49.669048+0000","last_undegraded":"2024-09-12T18:11:49.669048+0000","last_fullsized":"2024-09-12T18:11:49.669048+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'180","last_scrub_stamp":"2024-09-12T18:11:49.668940+0000","last_deep_scrub":"263'180","last_deep_scrub_stamp":"2024-09-12T18:11:49.668940+0000","last_clean_scrub_stamp":"2024-09-12T18:11:49.668940+0000","objects_scrubbed":3,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:25:30.505868+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262186,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":484,"num_read_kb":20980,"num_write":843,"num_write_kb":34024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,5],"acting":[1,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"263'1126","reported_seq":2702,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:59.649341+0000","last_change":"2024-09-12T18:11:59.649341+0000","last_active":"2024-09-12T18:11:59.649341+0000","last_peered":"2024-09-12T18:11:59.649341+0000","last_clean":"2024-09-12T18:11:59.649341+0000","last_became_active":"2024-09-12T17:10:44.522911+0000","last_became_peered":"2024-09-12T17:10:44.522911+0000","last_unstale":"2024-09-12T18:11:59.649341+0000","last_undegraded":"2024-09-12T18:11:59.649341+0000","last_fullsized":"2024-09-12T18:11:59.649341+0000","mapping_epoch":26,"log_start":"263'1100","ondisk_log_start":"263'1100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1126","last_scrub_stamp":"2024-09-12T18:11:59.649236+0000","last_deep_scrub":"263'1126","last_deep_scrub_stamp":"2024-09-12T18:11:59.649236+0000","last_clean_scrub_stamp":"2024-09-12T18:11:59.649236+0000","objects_scrubbed":2,"log_size":26,"log_dups_size":1100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:23:15.875406+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5182,"num_read_kb":4601,"num_write":1539,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"263'194","reported_seq":848,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:51.815496+0000","last_change":"2024-09-12T18:11:51.815496+0000","last_active":"2024-09-12T18:11:51.815496+0000","last_peered":"2024-09-12T18:11:51.815496+0000","last_clean":"2024-09-12T18:11:51.815496+0000","last_became_active":"2024-09-12T17:10:42.520304+0000","last_became_peered":"2024-09-12T17:10:42.520304+0000","last_unstale":"2024-09-12T18:11:51.815496+0000","last_undegraded":"2024-09-12T18:11:51.815496+0000","last_fullsized":"2024-09-12T18:11:51.815496+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'194","last_scrub_stamp":"2024-09-12T18:11:51.815318+0000","last_deep_scrub":"263'194","last_deep_scrub_stamp":"2024-09-12T18:11:51.815318+0000","last_clean_scrub_stamp":"2024-09-12T18:11:51.815318+0000","objects_scrubbed":2,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:18:33.880648+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1342049,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":493,"num_read_kb":8074,"num_write":952,"num_write_kb":20454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4,5],"acting":[6,7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"263'882","reported_seq":2590,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:57.696628+0000","last_change":"2024-09-12T18:11:57.696628+0000","last_active":"2024-09-12T18:11:57.696628+0000","last_peered":"2024-09-12T18:11:57.696628+0000","last_clean":"2024-09-12T18:11:57.696628+0000","last_became_active":"2024-09-12T17:10:44.517530+0000","last_became_peered":"2024-09-12T17:10:44.517530+0000","last_unstale":"2024-09-12T18:11:57.696628+0000","last_undegraded":"2024-09-12T18:11:57.696628+0000","last_fullsized":"2024-09-12T18:11:57.696628+0000","mapping_epoch":26,"log_start":"263'800","ondisk_log_start":"263'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'882","last_scrub_stamp":"2024-09-12T18:11:57.696541+0000","last_deep_scrub":"263'882","last_deep_scrub_stamp":"2024-09-12T18:11:57.696541+0000","last_clean_scrub_stamp":"2024-09-12T18:11:57.696541+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":800,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:06:13.761379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4395,"num_read_kb":3967,"num_write":1219,"num_write_kb":499,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"263'187","reported_seq":816,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:04.607590+0000","last_change":"2024-09-12T18:12:04.607590+0000","last_active":"2024-09-12T18:12:04.607590+0000","last_peered":"2024-09-12T18:12:04.607590+0000","last_clean":"2024-09-12T18:12:04.607590+0000","last_became_active":"2024-09-12T17:10:42.528899+0000","last_became_peered":"2024-09-12T17:10:42.528899+0000","last_unstale":"2024-09-12T18:12:04.607590+0000","last_undegraded":"2024-09-12T18:12:04.607590+0000","last_fullsized":"2024-09-12T18:12:04.607590+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'187","last_scrub_stamp":"2024-09-12T18:12:04.607432+0000","last_deep_scrub":"263'187","last_deep_scrub_stamp":"2024-09-12T18:12:04.607432+0000","last_clean_scrub_stamp":"2024-09-12T18:12:04.607432+0000","objects_scrubbed":5,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:45:28.481287+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7371399,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":389,"num_read_kb":42419,"num_write":869,"num_write_kb":46548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,5],"acting":[3,4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"263'388","reported_seq":1852,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:00.729788+0000","last_change":"2024-09-12T18:12:00.729788+0000","last_active":"2024-09-12T18:12:00.729788+0000","last_peered":"2024-09-12T18:12:00.729788+0000","last_clean":"2024-09-12T18:12:00.729788+0000","last_became_active":"2024-09-12T17:10:44.523173+0000","last_became_peered":"2024-09-12T17:10:44.523173+0000","last_unstale":"2024-09-12T18:12:00.729788+0000","last_undegraded":"2024-09-12T18:12:00.729788+0000","last_fullsized":"2024-09-12T18:12:00.729788+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'388","last_scrub_stamp":"2024-09-12T18:12:00.729701+0000","last_deep_scrub":"263'388","last_deep_scrub_stamp":"2024-09-12T18:12:00.729701+0000","last_clean_scrub_stamp":"2024-09-12T18:12:00.729701+0000","objects_scrubbed":3,"log_size":88,"log_dups_size":300,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:17:09.750351+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2006,"num_read_kb":1913,"num_write":441,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":236,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"263'150","reported_seq":852,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:50.263634+0000","last_change":"2024-09-12T18:11:50.263634+0000","last_active":"2024-09-12T18:11:50.263634+0000","last_peered":"2024-09-12T18:11:50.263634+0000","last_clean":"2024-09-12T18:11:50.263634+0000","last_became_active":"2024-09-12T17:10:42.521824+0000","last_became_peered":"2024-09-12T17:10:42.521824+0000","last_unstale":"2024-09-12T18:11:50.263634+0000","last_undegraded":"2024-09-12T18:11:50.263634+0000","last_fullsized":"2024-09-12T18:11:50.263634+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'150","last_scrub_stamp":"2024-09-12T18:11:50.263511+0000","last_deep_scrub":"263'150","last_deep_scrub_stamp":"2024-09-12T18:11:50.263511+0000","last_clean_scrub_stamp":"2024-09-12T18:11:50.263511+0000","objects_scrubbed":4,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:14:36.257295+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":605,"num_read_kb":135941,"num_write":774,"num_write_kb":15017,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"263'498","reported_seq":2146,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:01.300891+0000","last_change":"2024-09-12T18:12:01.300891+0000","last_active":"2024-09-12T18:12:01.300891+0000","last_peered":"2024-09-12T18:12:01.300891+0000","last_clean":"2024-09-12T18:12:01.300891+0000","last_became_active":"2024-09-12T17:10:44.517175+0000","last_became_peered":"2024-09-12T17:10:44.517175+0000","last_unstale":"2024-09-12T18:12:01.300891+0000","last_undegraded":"2024-09-12T18:12:01.300891+0000","last_fullsized":"2024-09-12T18:12:01.300891+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'498","last_scrub_stamp":"2024-09-12T18:12:01.300799+0000","last_deep_scrub":"263'498","last_deep_scrub_stamp":"2024-09-12T18:12:01.300799+0000","last_clean_scrub_stamp":"2024-09-12T18:12:01.300799+0000","objects_scrubbed":1,"log_size":98,"log_dups_size":400,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:10:17.438378+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2646,"num_read_kb":2487,"num_write":582,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2551,"num_omap_keys":10,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"263'171","reported_seq":793,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:53.554829+0000","last_change":"2024-09-12T18:11:53.554829+0000","last_active":"2024-09-12T18:11:53.554829+0000","last_peered":"2024-09-12T18:11:53.554829+0000","last_clean":"2024-09-12T18:11:53.554829+0000","last_became_active":"2024-09-12T17:10:42.524860+0000","last_became_peered":"2024-09-12T17:10:42.524860+0000","last_unstale":"2024-09-12T18:11:53.554829+0000","last_undegraded":"2024-09-12T18:11:53.554829+0000","last_fullsized":"2024-09-12T18:11:53.554829+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'171","last_scrub_stamp":"2024-09-12T18:11:53.554696+0000","last_deep_scrub":"263'171","last_deep_scrub_stamp":"2024-09-12T18:11:53.554696+0000","last_clean_scrub_stamp":"2024-09-12T18:11:53.554696+0000","objects_scrubbed":3,"log_size":71,"log_dups_size":100,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:32:08.383982+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":409,"num_read_kb":436,"num_write":844,"num_write_kb":16042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,1],"acting":[3,4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"263'740","reported_seq":2322,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:53.804065+0000","last_change":"2024-09-12T18:11:53.804065+0000","last_active":"2024-09-12T18:11:53.804065+0000","last_peered":"2024-09-12T18:11:53.804065+0000","last_clean":"2024-09-12T18:11:53.804065+0000","last_became_active":"2024-09-12T17:10:44.514847+0000","last_became_peered":"2024-09-12T17:10:44.514847+0000","last_unstale":"2024-09-12T18:11:53.804065+0000","last_undegraded":"2024-09-12T18:11:53.804065+0000","last_fullsized":"2024-09-12T18:11:53.804065+0000","mapping_epoch":26,"log_start":"263'700","ondisk_log_start":"263'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'740","last_scrub_stamp":"2024-09-12T18:11:53.803969+0000","last_deep_scrub":"263'740","last_deep_scrub_stamp":"2024-09-12T18:11:53.803969+0000","last_clean_scrub_stamp":"2024-09-12T18:11:53.803969+0000","objects_scrubbed":2,"log_size":40,"log_dups_size":700,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:10:16.440746+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3592,"num_read_kb":3279,"num_write":969,"num_write_kb":334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":432,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"263'232","reported_seq":897,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:51.259031+0000","last_change":"2024-09-12T18:11:51.259031+0000","last_active":"2024-09-12T18:11:51.259031+0000","last_peered":"2024-09-12T18:11:51.259031+0000","last_clean":"2024-09-12T18:11:51.259031+0000","last_became_active":"2024-09-12T17:10:42.519789+0000","last_became_peered":"2024-09-12T17:10:42.519789+0000","last_unstale":"2024-09-12T18:11:51.259031+0000","last_undegraded":"2024-09-12T18:11:51.259031+0000","last_fullsized":"2024-09-12T18:11:51.259031+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'232","last_scrub_stamp":"2024-09-12T18:11:51.258820+0000","last_deep_scrub":"263'232","last_deep_scrub_stamp":"2024-09-12T18:11:51.258820+0000","last_clean_scrub_stamp":"2024-09-12T18:11:51.258820+0000","objects_scrubbed":6,"log_size":32,"log_dups_size":200,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:06:47.531898+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079985,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":565,"num_read_kb":21140,"num_write":1106,"num_write_kb":33501,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,3],"acting":[5,7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"263'453","reported_seq":1955,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:59.367729+0000","last_change":"2024-09-12T18:11:59.367729+0000","last_active":"2024-09-12T18:11:59.367729+0000","last_peered":"2024-09-12T18:11:59.367729+0000","last_clean":"2024-09-12T18:11:59.367729+0000","last_became_active":"2024-09-12T17:10:44.510280+0000","last_became_peered":"2024-09-12T17:10:44.510280+0000","last_unstale":"2024-09-12T18:11:59.367729+0000","last_undegraded":"2024-09-12T18:11:59.367729+0000","last_fullsized":"2024-09-12T18:11:59.367729+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'453","last_scrub_stamp":"2024-09-12T18:11:59.367623+0000","last_deep_scrub":"263'453","last_deep_scrub_stamp":"2024-09-12T18:11:59.367623+0000","last_clean_scrub_stamp":"2024-09-12T18:11:59.367623+0000","objects_scrubbed":2,"log_size":53,"log_dups_size":400,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:42:33.011282+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2351,"num_read_kb":2195,"num_write":554,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"263'151","reported_seq":757,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:51.719192+0000","last_change":"2024-09-12T18:11:51.719192+0000","last_active":"2024-09-12T18:11:51.719192+0000","last_peered":"2024-09-12T18:11:51.719192+0000","last_clean":"2024-09-12T18:11:51.719192+0000","last_became_active":"2024-09-12T17:10:42.520020+0000","last_became_peered":"2024-09-12T17:10:42.520020+0000","last_unstale":"2024-09-12T18:11:51.719192+0000","last_undegraded":"2024-09-12T18:11:51.719192+0000","last_fullsized":"2024-09-12T18:11:51.719192+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'151","last_scrub_stamp":"2024-09-12T18:11:51.719074+0000","last_deep_scrub":"263'151","last_deep_scrub_stamp":"2024-09-12T18:11:51.719074+0000","last_clean_scrub_stamp":"2024-09-12T18:11:51.719074+0000","objects_scrubbed":5,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:00:04.688300+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399173,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":329,"num_read_kb":1191,"num_write":748,"num_write_kb":23442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,6],"acting":[0,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"263'360","reported_seq":1781,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:02.582515+0000","last_change":"2024-09-12T18:12:02.582515+0000","last_active":"2024-09-12T18:12:02.582515+0000","last_peered":"2024-09-12T18:12:02.582515+0000","last_clean":"2024-09-12T18:12:02.582515+0000","last_became_active":"2024-09-12T17:10:44.516697+0000","last_became_peered":"2024-09-12T17:10:44.516697+0000","last_unstale":"2024-09-12T18:12:02.582515+0000","last_undegraded":"2024-09-12T18:12:02.582515+0000","last_fullsized":"2024-09-12T18:12:02.582515+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'360","last_scrub_stamp":"2024-09-12T18:12:02.582325+0000","last_deep_scrub":"263'360","last_deep_scrub_stamp":"2024-09-12T18:12:02.582325+0000","last_clean_scrub_stamp":"2024-09-12T18:12:02.582325+0000","objects_scrubbed":3,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:42:49.327952+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1919,"num_read_kb":1833,"num_write":391,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"263'209","reported_seq":878,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:50.859980+0000","last_change":"2024-09-12T18:11:50.859917+0000","last_active":"2024-09-12T18:11:50.859980+0000","last_peered":"2024-09-12T18:11:50.859980+0000","last_clean":"2024-09-12T18:11:50.859980+0000","last_became_active":"2024-09-12T17:11:16.862645+0000","last_became_peered":"2024-09-12T17:11:16.862645+0000","last_unstale":"2024-09-12T18:11:50.859980+0000","last_undegraded":"2024-09-12T18:11:50.859980+0000","last_fullsized":"2024-09-12T18:11:50.859980+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'209","last_scrub_stamp":"2024-09-12T18:11:50.859772+0000","last_deep_scrub":"263'209","last_deep_scrub_stamp":"2024-09-12T18:11:50.859772+0000","last_clean_scrub_stamp":"2024-09-12T18:11:50.859772+0000","objects_scrubbed":5,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:34:01.980997+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38716,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":577,"num_read_kb":84325,"num_write":975,"num_write_kb":27874,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,0,7],"acting":[2,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"263'820","reported_seq":2292,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:59.723232+0000","last_change":"2024-09-12T18:11:59.723232+0000","last_active":"2024-09-12T18:11:59.723232+0000","last_peered":"2024-09-12T18:11:59.723232+0000","last_clean":"2024-09-12T18:11:59.723232+0000","last_became_active":"2024-09-12T17:10:44.519253+0000","last_became_peered":"2024-09-12T17:10:44.519253+0000","last_unstale":"2024-09-12T18:11:59.723232+0000","last_undegraded":"2024-09-12T18:11:59.723232+0000","last_fullsized":"2024-09-12T18:11:59.723232+0000","mapping_epoch":26,"log_start":"263'800","ondisk_log_start":"263'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'820","last_scrub_stamp":"2024-09-12T18:11:59.723131+0000","last_deep_scrub":"263'820","last_deep_scrub_stamp":"2024-09-12T18:11:59.723131+0000","last_clean_scrub_stamp":"2024-09-12T18:11:59.723131+0000","objects_scrubbed":2,"log_size":20,"log_dups_size":800,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:31:46.831616+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3866,"num_read_kb":3440,"num_write":1124,"num_write_kb":450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"263'183","reported_seq":799,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:54.498363+0000","last_change":"2024-09-12T18:11:54.498363+0000","last_active":"2024-09-12T18:11:54.498363+0000","last_peered":"2024-09-12T18:11:54.498363+0000","last_clean":"2024-09-12T18:11:54.498363+0000","last_became_active":"2024-09-12T17:10:42.524098+0000","last_became_peered":"2024-09-12T17:10:42.524098+0000","last_unstale":"2024-09-12T18:11:54.498363+0000","last_undegraded":"2024-09-12T18:11:54.498363+0000","last_fullsized":"2024-09-12T18:11:54.498363+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'183","last_scrub_stamp":"2024-09-12T18:11:54.498278+0000","last_deep_scrub":"263'183","last_deep_scrub_stamp":"2024-09-12T18:11:54.498278+0000","last_clean_scrub_stamp":"2024-09-12T18:11:54.498278+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:41:02.476962+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":371,"num_read_kb":5543,"num_write":831,"num_write_kb":19602,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6,3],"acting":[7,2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"263'416","reported_seq":2003,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:20.794247+0000","last_change":"2024-09-12T17:10:44.515468+0000","last_active":"2024-09-12T18:09:20.794247+0000","last_peered":"2024-09-12T18:09:20.794247+0000","last_clean":"2024-09-12T18:09:20.794247+0000","last_became_active":"2024-09-12T17:10:44.514154+0000","last_became_peered":"2024-09-12T17:10:44.514154+0000","last_unstale":"2024-09-12T18:09:20.794247+0000","last_undegraded":"2024-09-12T18:09:20.794247+0000","last_fullsized":"2024-09-12T18:09:20.794247+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:43.487253+0000","last_clean_scrub_stamp":"2024-09-12T17:10:43.487253+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":400,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:10:07.030810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2340,"num_read_kb":2233,"num_write":478,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"263'226","reported_seq":853,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:51.851968+0000","last_change":"2024-09-12T18:11:51.851968+0000","last_active":"2024-09-12T18:11:51.851968+0000","last_peered":"2024-09-12T18:11:51.851968+0000","last_clean":"2024-09-12T18:11:51.851968+0000","last_became_active":"2024-09-12T17:10:42.519316+0000","last_became_peered":"2024-09-12T17:10:42.519316+0000","last_unstale":"2024-09-12T18:11:51.851968+0000","last_undegraded":"2024-09-12T18:11:51.851968+0000","last_fullsized":"2024-09-12T18:11:51.851968+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'226","last_scrub_stamp":"2024-09-12T18:11:51.851860+0000","last_deep_scrub":"263'226","last_deep_scrub_stamp":"2024-09-12T18:11:51.851860+0000","last_clean_scrub_stamp":"2024-09-12T18:11:51.851860+0000","objects_scrubbed":3,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:35:21.884135+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470224,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":508,"num_read_kb":7212,"num_write":965,"num_write_kb":24573,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1,7],"acting":[2,6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"263'437","reported_seq":2045,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:01.592262+0000","last_change":"2024-09-12T18:12:01.592262+0000","last_active":"2024-09-12T18:12:01.592262+0000","last_peered":"2024-09-12T18:12:01.592262+0000","last_clean":"2024-09-12T18:12:01.592262+0000","last_became_active":"2024-09-12T17:10:44.513514+0000","last_became_peered":"2024-09-12T17:10:44.513514+0000","last_unstale":"2024-09-12T18:12:01.592262+0000","last_undegraded":"2024-09-12T18:12:01.592262+0000","last_fullsized":"2024-09-12T18:12:01.592262+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'437","last_scrub_stamp":"2024-09-12T18:12:01.592155+0000","last_deep_scrub":"263'437","last_deep_scrub_stamp":"2024-09-12T18:12:01.592155+0000","last_clean_scrub_stamp":"2024-09-12T18:12:01.592155+0000","objects_scrubbed":3,"log_size":37,"log_dups_size":400,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:14:07.719792+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2337,"num_read_kb":2234,"num_write":490,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"263'146","reported_seq":770,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:00.383167+0000","last_change":"2024-09-12T18:12:00.383167+0000","last_active":"2024-09-12T18:12:00.383167+0000","last_peered":"2024-09-12T18:12:00.383167+0000","last_clean":"2024-09-12T18:12:00.383167+0000","last_became_active":"2024-09-12T17:10:42.527050+0000","last_became_peered":"2024-09-12T17:10:42.527050+0000","last_unstale":"2024-09-12T18:12:00.383167+0000","last_undegraded":"2024-09-12T18:12:00.383167+0000","last_fullsized":"2024-09-12T18:12:00.383167+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'146","last_scrub_stamp":"2024-09-12T18:12:00.383024+0000","last_deep_scrub":"263'146","last_deep_scrub_stamp":"2024-09-12T18:12:00.383024+0000","last_clean_scrub_stamp":"2024-09-12T18:12:00.383024+0000","objects_scrubbed":4,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:22:31.915728+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079896,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":321,"num_read_kb":34406,"num_write":732,"num_write_kb":29438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4,6],"acting":[5,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"263'196","reported_seq":841,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:54.283254+0000","last_change":"2024-09-12T18:11:54.283254+0000","last_active":"2024-09-12T18:11:54.283254+0000","last_peered":"2024-09-12T18:11:54.283254+0000","last_clean":"2024-09-12T18:11:54.283254+0000","last_became_active":"2024-09-12T17:10:42.523311+0000","last_became_peered":"2024-09-12T17:10:42.523311+0000","last_unstale":"2024-09-12T18:11:54.283254+0000","last_undegraded":"2024-09-12T18:11:54.283254+0000","last_fullsized":"2024-09-12T18:11:54.283254+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'196","last_scrub_stamp":"2024-09-12T18:11:54.283131+0000","last_deep_scrub":"263'196","last_deep_scrub_stamp":"2024-09-12T18:11:54.283131+0000","last_clean_scrub_stamp":"2024-09-12T18:11:54.283131+0000","objects_scrubbed":2,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:27:10.864086+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":468,"num_read_kb":32297,"num_write":957,"num_write_kb":18657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,7],"acting":[5,1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"263'823","reported_seq":2274,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:02.655360+0000","last_change":"2024-09-12T18:12:02.655360+0000","last_active":"2024-09-12T18:12:02.655360+0000","last_peered":"2024-09-12T18:12:02.655360+0000","last_clean":"2024-09-12T18:12:02.655360+0000","last_became_active":"2024-09-12T17:10:44.523243+0000","last_became_peered":"2024-09-12T17:10:44.523243+0000","last_unstale":"2024-09-12T18:12:02.655360+0000","last_undegraded":"2024-09-12T18:12:02.655360+0000","last_fullsized":"2024-09-12T18:12:02.655360+0000","mapping_epoch":26,"log_start":"263'800","ondisk_log_start":"263'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'823","last_scrub_stamp":"2024-09-12T18:12:02.655272+0000","last_deep_scrub":"263'823","last_deep_scrub_stamp":"2024-09-12T18:12:02.655272+0000","last_clean_scrub_stamp":"2024-09-12T18:12:02.655272+0000","objects_scrubbed":2,"log_size":23,"log_dups_size":800,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:46:36.986649+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3977,"num_read_kb":3544,"num_write":1118,"num_write_kb":432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":220,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"263'239","reported_seq":892,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:52.620009+0000","last_change":"2024-09-12T18:11:52.620009+0000","last_active":"2024-09-12T18:11:52.620009+0000","last_peered":"2024-09-12T18:11:52.620009+0000","last_clean":"2024-09-12T18:11:52.620009+0000","last_became_active":"2024-09-12T17:10:42.519643+0000","last_became_peered":"2024-09-12T17:10:42.519643+0000","last_unstale":"2024-09-12T18:11:52.620009+0000","last_undegraded":"2024-09-12T18:11:52.620009+0000","last_fullsized":"2024-09-12T18:11:52.620009+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'239","last_scrub_stamp":"2024-09-12T18:11:52.619898+0000","last_deep_scrub":"263'239","last_deep_scrub_stamp":"2024-09-12T18:11:52.619898+0000","last_clean_scrub_stamp":"2024-09-12T18:11:52.619898+0000","objects_scrubbed":3,"log_size":39,"log_dups_size":200,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:17:44.502362+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079919,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":418,"num_read_kb":42701,"num_write":983,"num_write_kb":42419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5,0],"acting":[1,4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"263'617","reported_seq":2316,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:04.482840+0000","last_change":"2024-09-12T18:12:04.482840+0000","last_active":"2024-09-12T18:12:04.482840+0000","last_peered":"2024-09-12T18:12:04.482840+0000","last_clean":"2024-09-12T18:12:04.482840+0000","last_became_active":"2024-09-12T17:10:44.512488+0000","last_became_peered":"2024-09-12T17:10:44.512488+0000","last_unstale":"2024-09-12T18:12:04.482840+0000","last_undegraded":"2024-09-12T18:12:04.482840+0000","last_fullsized":"2024-09-12T18:12:04.482840+0000","mapping_epoch":26,"log_start":"263'600","ondisk_log_start":"263'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'617","last_scrub_stamp":"2024-09-12T18:12:04.482707+0000","last_deep_scrub":"263'617","last_deep_scrub_stamp":"2024-09-12T18:12:04.482707+0000","last_clean_scrub_stamp":"2024-09-12T18:12:04.482707+0000","objects_scrubbed":5,"log_size":17,"log_dups_size":600,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:05:09.251938+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3240,"num_read_kb":2966,"num_write":800,"num_write_kb":244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2039,"num_omap_keys":8,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6085,"num_read_kb":4263,"num_write":1964,"num_write_kb":863,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1035,"ondisk_log_size":1035,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15869,"num_objects":86,"num_object_clones":0,"num_object_copies":172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":86,"num_whiteouts":0,"num_read":16199,"num_read_kb":15883,"num_write":16708,"num_write_kb":4876,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":31738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1652,"ondisk_log_size":1652,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":570,"ondisk_log_size":570,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":271969,"num_objects":199,"num_object_clones":0,"num_object_copies":398,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":199,"num_whiteouts":0,"num_read":8822,"num_read_kb":10790,"num_write":6053,"num_write_kb":2795,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1759,"ondisk_log_size":1759,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2393,"num_read_kb":2857,"num_write":20,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14,"ondisk_log_size":14,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":165,"num_object_clones":0,"num_object_copies":330,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":165,"num_whiteouts":0,"num_read":212965,"num_read_kb":194286,"num_write":55441,"num_write_kb":18926,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":165,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":37502,"num_omap_keys":153,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3949,"ondisk_log_size":3949,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":74416905,"num_objects":230,"num_object_clones":0,"num_object_copies":920,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":230,"num_whiteouts":0,"num_read":33088,"num_read_kb":2020320,"num_write":62843,"num_write_kb":2063190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":101629952,"data_stored":101629952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3869,"ondisk_log_size":3869,"up":256,"acting":256,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":141,"num_read_kb":196715,"num_write":158,"num_write_kb":127071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":137,"num_read_kb":189543,"num_write":158,"num_write_kb":127071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575594,"num_pgs":116,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":261372,"kb_used_data":17772,"kb_used_omap":1,"kb_used_meta":243582,"kb_avail":94110468,"statfs":{"total":96636764160,"available":96369119232,"internally_reserved":0,"allocated":18198528,"data_stored":16210424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":249428427},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575592,"num_pgs":107,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":273160,"kb_used_data":17080,"kb_used_omap":1,"kb_used_meta":256062,"kb_avail":94098680,"statfs":{"total":96636764160,"available":96357048320,"internally_reserved":0,"allocated":17489920,"data_stored":15541198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":262207942},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575597,"num_pgs":113,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":120212,"kb_used_data":12676,"kb_used_omap":1,"kb_used_meta":107518,"kb_avail":94251628,"statfs":{"total":96636764160,"available":96513667072,"internally_reserved":0,"allocated":12980224,"data_stored":10947706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":110098885},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575592,"num_pgs":113,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":133164,"kb_used_data":21468,"kb_used_omap":1,"kb_used_meta":111678,"kb_avail":94238676,"statfs":{"total":96636764160,"available":96500404224,"internally_reserved":0,"allocated":21983232,"data_stored":20058842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":114358725},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575594,"num_pgs":130,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":244300,"kb_used_data":18748,"kb_used_omap":1,"kb_used_meta":225534,"kb_avail":94127540,"statfs":{"total":96636764160,"available":96386600960,"internally_reserved":0,"allocated":19197952,"data_stored":17229442,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":230947271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575594,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":107112,"kb_used_data":13464,"kb_used_omap":1,"kb_used_meta":93630,"kb_avail":94264728,"statfs":{"total":96636764160,"available":96527081472,"internally_reserved":0,"allocated":13787136,"data_stored":11862866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":95877573},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575592,"num_pgs":120,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":151364,"kb_used_data":16116,"kb_used_omap":1,"kb_used_meta":135230,"kb_avail":94220476,"statfs":{"total":96636764160,"available":96481767424,"internally_reserved":0,"allocated":16502784,"data_stored":14528294,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":138475973},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575593,"num_pgs":116,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":254156,"kb_used_data":16124,"kb_used_omap":1,"kb_used_meta":238014,"kb_avail":94117684,"statfs":{"total":96636764160,"available":96376508416,"internally_reserved":0,"allocated":16510976,"data_stored":14534914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":243726789},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":11681792,"data_stored":11681792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12263424,"data_stored":12263424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":9601024,"data_stored":9601024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":14966784,"data_stored":14966784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":17797120,"data_stored":17797120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8683520,"data_stored":8683520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":13279232,"data_stored":13279232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":13357056,"data_stored":13357056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":4345,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":5119,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":3919,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":4996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3623,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":3527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T18:12:08.703 INFO:tasks.ceph:pgid 68.1a last_scrub_stamp 2024-09-12T17:46:56.058809+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.703 INFO:tasks.ceph:pgid 67.1d last_scrub_stamp 2024-09-12T17:30:15.649995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.703 INFO:tasks.ceph:pgid 66.1c last_scrub_stamp 2024-09-12T17:30:11.622113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.703 INFO:tasks.ceph:pgid 65.1f last_scrub_stamp 2024-09-12T17:26:34.641203+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=26, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.703 INFO:tasks.ceph:pgid 68.1b last_scrub_stamp 2024-09-12T17:46:56.058809+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.703 INFO:tasks.ceph:pgid 67.1c last_scrub_stamp 2024-09-12T17:30:15.649995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.703 INFO:tasks.ceph:pgid 66.1d last_scrub_stamp 2024-09-12T17:30:11.622113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.704 INFO:tasks.ceph:pgid 65.1e last_scrub_stamp 2024-09-12T17:26:34.641203+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=26, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.704 INFO:tasks.ceph:pgid 68.18 last_scrub_stamp 2024-09-12T17:46:56.058809+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.704 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-09-12T17:30:15.649995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.704 INFO:tasks.ceph:pgid 66.1e last_scrub_stamp 2024-09-12T17:30:11.622113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.704 INFO:tasks.ceph:pgid 65.1d last_scrub_stamp 2024-09-12T17:26:34.641203+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=26, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.704 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-09-12T17:46:56.058809+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.704 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-09-12T17:30:15.649995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.704 INFO:tasks.ceph:pgid 66.1f last_scrub_stamp 2024-09-12T17:30:11.622113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.704 INFO:tasks.ceph:pgid 65.1c last_scrub_stamp 2024-09-12T17:26:34.641203+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=26, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.705 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-09-12T17:46:56.058809+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.705 INFO:tasks.ceph:pgid 67.19 last_scrub_stamp 2024-09-12T17:30:15.649995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.705 INFO:tasks.ceph:pgid 66.18 last_scrub_stamp 2024-09-12T17:30:11.622113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.705 INFO:tasks.ceph:pgid 65.1b last_scrub_stamp 2024-09-12T17:26:34.641203+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=26, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.705 INFO:tasks.ceph:pgid 68.1f last_scrub_stamp 2024-09-12T17:46:56.058809+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.705 INFO:tasks.ceph:pgid 67.18 last_scrub_stamp 2024-09-12T17:30:15.649995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.705 INFO:tasks.ceph:pgid 66.19 last_scrub_stamp 2024-09-12T17:30:11.622113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.705 INFO:tasks.ceph:pgid 65.1a last_scrub_stamp 2024-09-12T17:26:34.641203+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=26, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.706 INFO:tasks.ceph:pgid 68.1c last_scrub_stamp 2024-09-12T17:46:56.058809+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.706 INFO:tasks.ceph:pgid 67.1b last_scrub_stamp 2024-09-12T17:30:15.649995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.706 INFO:tasks.ceph:pgid 66.1a last_scrub_stamp 2024-09-12T17:30:11.622113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.706 INFO:tasks.ceph:pgid 65.19 last_scrub_stamp 2024-09-12T17:26:34.641203+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=26, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.706 INFO:tasks.ceph:pgid 68.1d last_scrub_stamp 2024-09-12T17:46:56.058809+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.706 INFO:tasks.ceph:pgid 67.1a last_scrub_stamp 2024-09-12T17:30:15.649995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.707 INFO:tasks.ceph:pgid 66.1b last_scrub_stamp 2024-09-12T17:30:11.622113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.707 INFO:tasks.ceph:pgid 65.18 last_scrub_stamp 2024-09-12T17:26:34.641203+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=26, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.707 INFO:tasks.ceph:pgid 68.12 last_scrub_stamp 2024-09-12T17:46:56.058809+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.707 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-09-12T17:30:15.649995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.707 INFO:tasks.ceph:pgid 66.14 last_scrub_stamp 2024-09-12T17:30:11.622113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.707 INFO:tasks.ceph:pgid 65.17 last_scrub_stamp 2024-09-12T17:26:34.641203+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=26, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.707 INFO:tasks.ceph:pgid 68.13 last_scrub_stamp 2024-09-12T17:46:56.058809+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.707 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-09-12T17:30:15.649995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.708 INFO:tasks.ceph:pgid 66.15 last_scrub_stamp 2024-09-12T17:30:11.622113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.708 INFO:tasks.ceph:pgid 65.16 last_scrub_stamp 2024-09-12T17:26:34.641203+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=26, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.708 INFO:tasks.ceph:pgid 68.10 last_scrub_stamp 2024-09-12T17:46:56.058809+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.708 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-09-12T17:30:15.649995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.708 INFO:tasks.ceph:pgid 66.16 last_scrub_stamp 2024-09-12T17:30:11.622113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.708 INFO:tasks.ceph:pgid 65.15 last_scrub_stamp 2024-09-12T17:26:34.641203+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=26, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.708 INFO:tasks.ceph:pgid 68.11 last_scrub_stamp 2024-09-12T17:46:56.058809+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.708 INFO:tasks.ceph:pgid 67.16 last_scrub_stamp 2024-09-12T17:30:15.649995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.709 INFO:tasks.ceph:pgid 66.17 last_scrub_stamp 2024-09-12T17:30:11.622113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.709 INFO:tasks.ceph:pgid 65.14 last_scrub_stamp 2024-09-12T17:26:34.641203+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=26, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.709 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-09-12T17:46:56.058809+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.709 INFO:tasks.ceph:pgid 67.11 last_scrub_stamp 2024-09-12T17:30:15.649995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.709 INFO:tasks.ceph:pgid 66.10 last_scrub_stamp 2024-09-12T17:30:11.622113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.709 INFO:tasks.ceph:pgid 65.13 last_scrub_stamp 2024-09-12T17:26:34.641203+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=26, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.709 INFO:tasks.ceph:pgid 68.17 last_scrub_stamp 2024-09-12T17:46:56.058809+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.709 INFO:tasks.ceph:pgid 67.10 last_scrub_stamp 2024-09-12T17:30:15.649995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.709 INFO:tasks.ceph:pgid 66.11 last_scrub_stamp 2024-09-12T17:30:11.622113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.710 INFO:tasks.ceph:pgid 65.12 last_scrub_stamp 2024-09-12T17:26:34.641203+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=26, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.710 INFO:tasks.ceph:pgid 68.14 last_scrub_stamp 2024-09-12T17:46:56.058809+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.710 INFO:tasks.ceph:pgid 67.13 last_scrub_stamp 2024-09-12T17:30:15.649995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.710 INFO:tasks.ceph:pgid 66.12 last_scrub_stamp 2024-09-12T17:30:11.622113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.710 INFO:tasks.ceph:pgid 65.11 last_scrub_stamp 2024-09-12T17:26:34.641203+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=26, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.710 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-09-12T17:46:56.058809+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.710 INFO:tasks.ceph:pgid 67.12 last_scrub_stamp 2024-09-12T17:30:15.649995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.710 INFO:tasks.ceph:pgid 66.13 last_scrub_stamp 2024-09-12T17:30:11.622113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.710 INFO:tasks.ceph:pgid 65.10 last_scrub_stamp 2024-09-12T17:26:34.641203+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=26, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.711 INFO:tasks.ceph:pgid 68.a last_scrub_stamp 2024-09-12T17:46:56.058809+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.711 INFO:tasks.ceph:pgid 67.d last_scrub_stamp 2024-09-12T17:30:15.649995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.711 INFO:tasks.ceph:pgid 66.c last_scrub_stamp 2024-09-12T17:30:11.622113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.711 INFO:tasks.ceph:pgid 65.f last_scrub_stamp 2024-09-12T17:26:34.641203+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=26, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.711 INFO:tasks.ceph:pgid 68.b last_scrub_stamp 2024-09-12T17:46:56.058809+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.711 INFO:tasks.ceph:pgid 67.c last_scrub_stamp 2024-09-12T17:30:15.649995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.711 INFO:tasks.ceph:pgid 66.d last_scrub_stamp 2024-09-12T17:30:11.622113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.711 INFO:tasks.ceph:pgid 65.e last_scrub_stamp 2024-09-12T17:26:34.641203+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=26, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.711 INFO:tasks.ceph:pgid 68.8 last_scrub_stamp 2024-09-12T17:46:56.058809+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.711 INFO:tasks.ceph:pgid 67.f last_scrub_stamp 2024-09-12T17:30:15.649995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.712 INFO:tasks.ceph:pgid 66.e last_scrub_stamp 2024-09-12T17:30:11.622113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.712 INFO:tasks.ceph:pgid 65.d last_scrub_stamp 2024-09-12T17:26:34.641203+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=26, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.712 INFO:tasks.ceph:pgid 68.9 last_scrub_stamp 2024-09-12T17:46:56.058809+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.712 INFO:tasks.ceph:pgid 67.e last_scrub_stamp 2024-09-12T17:30:15.649995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.712 INFO:tasks.ceph:pgid 66.f last_scrub_stamp 2024-09-12T17:30:11.622113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.712 INFO:tasks.ceph:pgid 65.c last_scrub_stamp 2024-09-12T17:26:34.641203+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=26, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.712 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-09-12T17:46:56.058809+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.712 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-09-12T17:30:15.649995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.712 INFO:tasks.ceph:pgid 66.8 last_scrub_stamp 2024-09-12T17:30:11.622113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.713 INFO:tasks.ceph:pgid 65.b last_scrub_stamp 2024-09-12T17:26:34.641203+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=26, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.713 INFO:tasks.ceph:pgid 68.f last_scrub_stamp 2024-09-12T17:46:56.058809+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.713 INFO:tasks.ceph:pgid 67.8 last_scrub_stamp 2024-09-12T17:30:15.649995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.713 INFO:tasks.ceph:pgid 66.9 last_scrub_stamp 2024-09-12T17:30:11.622113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.713 INFO:tasks.ceph:pgid 65.a last_scrub_stamp 2024-09-12T17:26:34.641203+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=26, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.713 INFO:tasks.ceph:pgid 68.c last_scrub_stamp 2024-09-12T17:46:56.058809+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.713 INFO:tasks.ceph:pgid 67.b last_scrub_stamp 2024-09-12T17:30:15.649995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.713 INFO:tasks.ceph:pgid 66.a last_scrub_stamp 2024-09-12T17:30:11.622113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.713 INFO:tasks.ceph:pgid 65.9 last_scrub_stamp 2024-09-12T17:26:34.641203+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=26, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.714 INFO:tasks.ceph:pgid 68.d last_scrub_stamp 2024-09-12T17:46:56.058809+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.714 INFO:tasks.ceph:pgid 67.a last_scrub_stamp 2024-09-12T17:30:15.649995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.714 INFO:tasks.ceph:pgid 66.b last_scrub_stamp 2024-09-12T17:30:11.622113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.714 INFO:tasks.ceph:pgid 65.8 last_scrub_stamp 2024-09-12T17:26:34.641203+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=26, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.714 INFO:tasks.ceph:pgid 68.2 last_scrub_stamp 2024-09-12T17:46:56.058809+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.714 INFO:tasks.ceph:pgid 67.5 last_scrub_stamp 2024-09-12T17:30:15.649995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.714 INFO:tasks.ceph:pgid 66.4 last_scrub_stamp 2024-09-12T17:30:11.622113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.714 INFO:tasks.ceph:pgid 65.7 last_scrub_stamp 2024-09-12T17:26:34.641203+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=26, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.714 INFO:tasks.ceph:pgid 68.3 last_scrub_stamp 2024-09-12T17:46:56.058809+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.715 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-09-12T17:30:15.649995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.715 INFO:tasks.ceph:pgid 66.5 last_scrub_stamp 2024-09-12T17:30:11.622113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.715 INFO:tasks.ceph:pgid 65.6 last_scrub_stamp 2024-09-12T17:26:34.641203+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=26, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.715 INFO:tasks.ceph:pgid 68.0 last_scrub_stamp 2024-09-12T17:46:56.058809+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.715 INFO:tasks.ceph:pgid 67.7 last_scrub_stamp 2024-09-12T17:30:15.649995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.715 INFO:tasks.ceph:pgid 66.6 last_scrub_stamp 2024-09-12T17:30:11.622113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.715 INFO:tasks.ceph:pgid 65.5 last_scrub_stamp 2024-09-12T17:26:34.641203+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=26, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.715 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-09-12T17:46:56.058809+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.715 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-09-12T17:30:15.649995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.716 INFO:tasks.ceph:pgid 66.7 last_scrub_stamp 2024-09-12T17:30:11.622113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.716 INFO:tasks.ceph:pgid 65.4 last_scrub_stamp 2024-09-12T17:26:34.641203+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=26, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.716 INFO:tasks.ceph:pgid 68.6 last_scrub_stamp 2024-09-12T17:46:56.058809+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.716 INFO:tasks.ceph:pgid 67.1 last_scrub_stamp 2024-09-12T17:30:15.649995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.716 INFO:tasks.ceph:pgid 66.0 last_scrub_stamp 2024-09-12T17:30:11.622113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.716 INFO:tasks.ceph:pgid 65.3 last_scrub_stamp 2024-09-12T17:26:34.641203+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=26, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.716 INFO:tasks.ceph:pgid 68.7 last_scrub_stamp 2024-09-12T17:46:56.058809+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.716 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-09-12T17:30:15.649995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.716 INFO:tasks.ceph:pgid 66.1 last_scrub_stamp 2024-09-12T17:30:11.622113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.717 INFO:tasks.ceph:pgid 65.2 last_scrub_stamp 2024-09-12T17:26:34.641203+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=26, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.717 INFO:tasks.ceph:pgid 68.4 last_scrub_stamp 2024-09-12T17:46:56.058809+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.717 INFO:tasks.ceph:pgid 67.3 last_scrub_stamp 2024-09-12T17:30:15.649995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.717 INFO:tasks.ceph:pgid 66.2 last_scrub_stamp 2024-09-12T17:30:11.622113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.717 INFO:tasks.ceph:pgid 65.1 last_scrub_stamp 2024-09-12T17:26:34.641203+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=26, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.717 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-09-12T17:46:56.058809+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.717 INFO:tasks.ceph:pgid 67.2 last_scrub_stamp 2024-09-12T17:30:15.649995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.717 INFO:tasks.ceph:pgid 66.3 last_scrub_stamp 2024-09-12T17:30:11.622113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.717 INFO:tasks.ceph:pgid 65.0 last_scrub_stamp 2024-09-12T17:26:34.641203+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=26, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.718 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-09-12T17:10:41.475151+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.718 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-12T17:10:43.487253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.718 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-09-12T17:10:43.487253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.718 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-12T17:10:51.549038+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.718 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-12T17:10:45.504515+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.718 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-12T17:10:47.516917+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.718 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-12T17:10:49.533772+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.719 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-12T17:10:51.549038+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.719 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-12T17:10:45.504515+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.719 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-09-12T17:10:47.516917+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.719 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-12T17:10:49.533772+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.719 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-12T17:10:51.549038+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.719 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-09-12T17:10:45.504515+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.719 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-09-12T17:10:47.516917+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.719 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-12T17:10:49.533772+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.719 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-12T17:10:51.549038+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.720 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-12T17:10:43.487253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.720 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-12T17:10:45.504515+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.720 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-09-12T17:10:47.516917+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.720 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-12T17:10:49.533772+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.720 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-09-12T17:10:45.504515+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.720 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-09-12T17:10:47.516917+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.720 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-09-12T17:10:49.533772+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.720 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-12T17:10:51.549038+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.721 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-12T17:10:47.516917+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.721 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-12T17:10:49.533772+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.721 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-12T17:10:51.549038+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.721 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-12T17:10:47.516917+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.721 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-09-12T17:10:49.533772+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.721 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-12T17:10:51.549038+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.721 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-12T17:10:47.516917+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.721 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-12T17:10:51.549038+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.722 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-09-12T17:10:47.516917+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.722 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-12T17:10:49.533772+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.722 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-12T17:10:51.549038+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.722 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-12T17:10:51.549038+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.722 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-09-12T17:10:45.504515+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.722 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-12T17:10:47.516917+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.722 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-09-12T17:10:49.533772+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.722 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-12T17:10:51.549038+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.723 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-12T17:10:45.504515+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.723 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-09-12T17:10:47.516917+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.723 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-12T17:10:51.549038+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.723 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-09-12T17:10:45.504515+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.723 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-12T17:10:47.516917+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.723 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-12T17:10:49.533772+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.723 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-12T17:10:51.549038+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.723 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-12T17:10:45.504515+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.723 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-09-12T17:10:47.516917+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.724 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-12T17:10:49.533772+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.724 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-12T17:10:51.549038+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.724 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-09-12T17:10:47.516917+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.724 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-09-12T17:10:49.533772+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.724 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-12T17:10:51.549038+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.724 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-12T17:10:47.516917+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.724 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-12T17:10:51.549038+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.725 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-09-12T17:10:47.516917+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.725 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-09-12T17:10:49.533772+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.725 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-12T17:10:51.549038+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.725 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-09-12T17:10:47.516917+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.725 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-09-12T17:10:49.533772+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.725 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-12T17:10:51.549038+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.725 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-12T17:10:45.504515+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.725 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-12T17:10:47.516917+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.725 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-12T17:10:49.533772+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.726 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-12T17:10:51.549038+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.726 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-09-12T17:10:45.504515+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.726 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-09-12T17:10:47.516917+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.726 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-12T17:10:49.533772+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.726 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-12T17:10:51.549038+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.726 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-12T17:10:51.549038+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.726 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-12T17:10:47.516917+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.726 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-12T17:10:49.533772+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.727 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-12T17:10:51.549038+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.727 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-09-12T17:10:45.504515+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.727 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-09-12T17:10:47.516917+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.727 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-09-12T17:10:49.533772+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.727 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-12T17:10:51.549038+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.727 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-09-12T17:10:45.504515+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.727 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-09-12T17:10:47.516917+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.727 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-12T17:10:51.549038+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.727 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-09-12T17:10:47.516917+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.728 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-09-12T17:10:49.533772+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.728 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-09-12T17:10:45.504515+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.728 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-09-12T17:10:47.516917+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.728 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-09-12T17:10:49.533772+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.728 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-12T17:10:51.549038+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.728 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-12T17:10:47.516917+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.728 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-12T17:10:49.533772+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.728 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-12T17:10:51.549038+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.729 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-09-12T17:10:45.504515+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.729 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-09-12T17:10:47.516917+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.729 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-12T17:10:49.533772+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.729 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-12T17:10:51.549038+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.729 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-12T17:10:47.516917+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.729 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-12T17:10:49.533772+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.729 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-12T17:10:51.549038+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.729 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-09-12T17:10:45.504515+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.729 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-09-12T17:10:47.516917+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.730 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-12T17:10:49.533772+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.730 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-12T17:10:51.549038+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.730 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-09-12T17:10:45.504515+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.730 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-09-12T17:10:47.516917+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.730 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-12T17:10:49.533772+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.730 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-12T17:10:51.549038+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.730 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-09-12T17:10:45.504515+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.730 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-12T17:10:47.516917+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.730 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-12T17:10:49.533772+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.731 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-12T17:10:51.549038+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.731 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-12T17:10:47.516917+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.731 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-12T17:10:49.533772+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.731 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-12T17:10:51.549038+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.731 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-12T17:10:43.487253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:08.732 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T18:12:28.733 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T18:12:29.088 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T18:12:29.101 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-09-12T18:12:29.104 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":2118,"stamp":"2024-09-12T18:12:28.630182+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":75296923,"num_objects":706,"num_object_clones":0,"num_object_copies":1872,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":706,"num_whiteouts":0,"num_read":279908,"num_read_kb":2634724,"num_write":143466,"num_write_kb":2346447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":212,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":723101,"num_omap_keys":1769,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13208,"ondisk_log_size":13208,"up":914,"acting":914,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":914,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1549000,"kb_used_data":133448,"kb_used_omap":12,"kb_used_meta":1415411,"kb_avail":753425720,"statfs":{"total":773094113280,"available":771507937280,"internally_reserved":0,"allocated":136650752,"data_stored":120913686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":1449381425},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2919,"num_omap_keys":18,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005693"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:29.859011+0000","last_change":"2024-09-12T17:46:57.082723+0000","last_active":"2024-09-12T18:09:29.859011+0000","last_peered":"2024-09-12T18:09:29.859011+0000","last_clean":"2024-09-12T18:09:29.859011+0000","last_became_active":"2024-09-12T17:46:57.082400+0000","last_became_peered":"2024-09-12T17:46:57.082400+0000","last_unstale":"2024-09-12T18:09:29.859011+0000","last_undegraded":"2024-09-12T18:09:29.859011+0000","last_fullsized":"2024-09-12T18:09:29.859011+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"0'0","reported_seq":39,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:49.843582+0000","last_change":"2024-09-12T17:30:16.683362+0000","last_active":"2024-09-12T18:07:49.843582+0000","last_peered":"2024-09-12T18:07:49.843582+0000","last_clean":"2024-09-12T18:07:49.843582+0000","last_became_active":"2024-09-12T17:30:16.683077+0000","last_became_peered":"2024-09-12T17:30:16.683077+0000","last_unstale":"2024-09-12T18:07:49.843582+0000","last_undegraded":"2024-09-12T18:07:49.843582+0000","last_fullsized":"2024-09-12T18:07:49.843582+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:50:52.313225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"260'3","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:44.841978+0000","last_change":"2024-09-12T17:30:12.651734+0000","last_active":"2024-09-12T18:07:44.841978+0000","last_peered":"2024-09-12T18:07:44.841978+0000","last_clean":"2024-09-12T18:07:44.841978+0000","last_became_active":"2024-09-12T17:30:12.651461+0000","last_became_peered":"2024-09-12T17:30:12.651461+0000","last_unstale":"2024-09-12T18:07:44.841978+0000","last_undegraded":"2024-09-12T18:07:44.841978+0000","last_fullsized":"2024-09-12T18:07:44.841978+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:51:09.744341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"263'28","reported_seq":135,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:10:19.852806+0000","last_change":"2024-09-12T17:26:35.669600+0000","last_active":"2024-09-12T18:10:19.852806+0000","last_peered":"2024-09-12T18:10:19.852806+0000","last_clean":"2024-09-12T18:10:19.852806+0000","last_became_active":"2024-09-12T17:26:35.669154+0000","last_became_peered":"2024-09-12T17:26:35.669154+0000","last_unstale":"2024-09-12T18:10:19.852806+0000","last_undegraded":"2024-09-12T18:10:19.852806+0000","last_fullsized":"2024-09-12T18:10:19.852806+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":150,"num_read_kb":108,"num_write":46,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":31,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:16.733731+0000","last_change":"2024-09-12T18:12:16.733731+0000","last_active":"2024-09-12T18:12:16.733731+0000","last_peered":"2024-09-12T18:12:16.733731+0000","last_clean":"2024-09-12T18:12:16.733731+0000","last_became_active":"2024-09-12T17:46:57.096462+0000","last_became_peered":"2024-09-12T17:46:57.096462+0000","last_unstale":"2024-09-12T18:12:16.733731+0000","last_undegraded":"2024-09-12T18:12:16.733731+0000","last_fullsized":"2024-09-12T18:12:16.733731+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:16.733634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:16.733634+0000","last_clean_scrub_stamp":"2024-09-12T18:12:16.733634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:55.337675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"263'9","reported_seq":62,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:10:19.865991+0000","last_change":"2024-09-12T17:30:16.675262+0000","last_active":"2024-09-12T18:10:19.865991+0000","last_peered":"2024-09-12T18:10:19.865991+0000","last_clean":"2024-09-12T18:10:19.865991+0000","last_became_active":"2024-09-12T17:30:16.674952+0000","last_became_peered":"2024-09-12T17:30:16.674952+0000","last_unstale":"2024-09-12T18:10:19.865991+0000","last_undegraded":"2024-09-12T18:10:19.865991+0000","last_fullsized":"2024-09-12T18:10:19.865991+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:17:48.380471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":30722,"num_write":9,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"263'3","reported_seq":60,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:19.465891+0000","last_change":"2024-09-12T18:12:19.465891+0000","last_active":"2024-09-12T18:12:19.465891+0000","last_peered":"2024-09-12T18:12:19.465891+0000","last_clean":"2024-09-12T18:12:19.465891+0000","last_became_active":"2024-09-12T17:30:12.645624+0000","last_became_peered":"2024-09-12T17:30:12.645624+0000","last_unstale":"2024-09-12T18:12:19.465891+0000","last_undegraded":"2024-09-12T18:12:19.465891+0000","last_fullsized":"2024-09-12T18:12:19.465891+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'3","last_scrub_stamp":"2024-09-12T18:12:19.465801+0000","last_deep_scrub":"263'3","last_deep_scrub_stamp":"2024-09-12T18:12:19.465801+0000","last_clean_scrub_stamp":"2024-09-12T18:12:19.465801+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:57:25.728318+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"263'13","reported_seq":96,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:07.786114+0000","last_change":"2024-09-12T18:12:07.786114+0000","last_active":"2024-09-12T18:12:07.786114+0000","last_peered":"2024-09-12T18:12:07.786114+0000","last_clean":"2024-09-12T18:12:07.786114+0000","last_became_active":"2024-09-12T17:26:35.660132+0000","last_became_peered":"2024-09-12T17:26:35.660132+0000","last_unstale":"2024-09-12T18:12:07.786114+0000","last_undegraded":"2024-09-12T18:12:07.786114+0000","last_fullsized":"2024-09-12T18:12:07.786114+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'13","last_scrub_stamp":"2024-09-12T18:12:07.786029+0000","last_deep_scrub":"263'13","last_deep_scrub_stamp":"2024-09-12T18:12:07.786029+0000","last_clean_scrub_stamp":"2024-09-12T18:12:07.786029+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:31:53.611285+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":36,"num_write":29,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":31,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:23.597314+0000","last_change":"2024-09-12T18:12:23.597314+0000","last_active":"2024-09-12T18:12:23.597314+0000","last_peered":"2024-09-12T18:12:23.597314+0000","last_clean":"2024-09-12T18:12:23.597314+0000","last_became_active":"2024-09-12T17:46:57.076193+0000","last_became_peered":"2024-09-12T17:46:57.076193+0000","last_unstale":"2024-09-12T18:12:23.597314+0000","last_undegraded":"2024-09-12T18:12:23.597314+0000","last_fullsized":"2024-09-12T18:12:23.597314+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:23.597226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:23.597226+0000","last_clean_scrub_stamp":"2024-09-12T18:12:23.597226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:37:52.469297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"260'3","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:54.849532+0000","last_change":"2024-09-12T17:30:16.671182+0000","last_active":"2024-09-12T18:09:54.849532+0000","last_peered":"2024-09-12T18:09:54.849532+0000","last_clean":"2024-09-12T18:09:54.849532+0000","last_became_active":"2024-09-12T17:30:16.670862+0000","last_became_peered":"2024-09-12T17:30:16.670862+0000","last_unstale":"2024-09-12T18:09:54.849532+0000","last_undegraded":"2024-09-12T18:09:54.849532+0000","last_fullsized":"2024-09-12T18:09:54.849532+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"263'5","reported_seq":70,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:12.711425+0000","last_change":"2024-09-12T18:12:12.711357+0000","last_active":"2024-09-12T18:12:12.711425+0000","last_peered":"2024-09-12T18:12:12.711425+0000","last_clean":"2024-09-12T18:12:12.711425+0000","last_became_active":"2024-09-12T17:30:12.648349+0000","last_became_peered":"2024-09-12T17:30:12.648349+0000","last_unstale":"2024-09-12T18:12:12.711425+0000","last_undegraded":"2024-09-12T18:12:12.711425+0000","last_fullsized":"2024-09-12T18:12:12.711425+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'5","last_scrub_stamp":"2024-09-12T18:12:12.711275+0000","last_deep_scrub":"263'5","last_deep_scrub_stamp":"2024-09-12T18:12:12.711275+0000","last_clean_scrub_stamp":"2024-09-12T18:12:12.711275+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:53:45.650869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":18432,"num_write":10,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"263'117","reported_seq":422,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:04.843259+0000","last_change":"2024-09-12T17:26:35.664908+0000","last_active":"2024-09-12T18:09:04.843259+0000","last_peered":"2024-09-12T18:09:04.843259+0000","last_clean":"2024-09-12T18:09:04.843259+0000","last_became_active":"2024-09-12T17:26:35.664247+0000","last_became_peered":"2024-09-12T17:26:35.664247+0000","last_unstale":"2024-09-12T18:09:04.843259+0000","last_undegraded":"2024-09-12T18:09:04.843259+0000","last_fullsized":"2024-09-12T18:09:04.843259+0000","mapping_epoch":250,"log_start":"263'100","ondisk_log_start":"263'100","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:39:07.453840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":722,"num_read_kb":504,"num_write":158,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:49.849229+0000","last_change":"2024-09-12T17:46:57.089742+0000","last_active":"2024-09-12T18:08:49.849229+0000","last_peered":"2024-09-12T18:08:49.849229+0000","last_clean":"2024-09-12T18:08:49.849229+0000","last_became_active":"2024-09-12T17:46:57.089385+0000","last_became_peered":"2024-09-12T17:46:57.089385+0000","last_unstale":"2024-09-12T18:08:49.849229+0000","last_undegraded":"2024-09-12T18:08:49.849229+0000","last_fullsized":"2024-09-12T18:08:49.849229+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:17:02.129348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"263'14","reported_seq":71,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:41.215577+0000","last_change":"2024-09-12T17:30:16.682079+0000","last_active":"2024-09-12T18:11:41.215577+0000","last_peered":"2024-09-12T18:11:41.215577+0000","last_clean":"2024-09-12T18:11:41.215577+0000","last_became_active":"2024-09-12T17:30:16.681766+0000","last_became_peered":"2024-09-12T17:30:16.681766+0000","last_unstale":"2024-09-12T18:11:41.215577+0000","last_undegraded":"2024-09-12T18:11:41.215577+0000","last_fullsized":"2024-09-12T18:11:41.215577+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:31:21.167575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":32770,"num_write":24,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"0'0","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:49.861483+0000","last_change":"2024-09-12T17:30:12.648728+0000","last_active":"2024-09-12T18:09:49.861483+0000","last_peered":"2024-09-12T18:09:49.861483+0000","last_clean":"2024-09-12T18:09:49.861483+0000","last_became_active":"2024-09-12T17:30:12.648369+0000","last_became_peered":"2024-09-12T17:30:12.648369+0000","last_unstale":"2024-09-12T18:09:49.861483+0000","last_undegraded":"2024-09-12T18:09:49.861483+0000","last_fullsized":"2024-09-12T18:09:49.861483+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"263'110","reported_seq":439,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:04.851030+0000","last_change":"2024-09-12T17:26:35.666024+0000","last_active":"2024-09-12T18:09:04.851030+0000","last_peered":"2024-09-12T18:09:04.851030+0000","last_clean":"2024-09-12T18:09:04.851030+0000","last_became_active":"2024-09-12T17:26:35.665735+0000","last_became_peered":"2024-09-12T17:26:35.665735+0000","last_unstale":"2024-09-12T18:09:04.851030+0000","last_undegraded":"2024-09-12T18:09:04.851030+0000","last_fullsized":"2024-09-12T18:09:04.851030+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:21:58.014213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":761,"num_read_kb":507,"num_write":140,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:04.851052+0000","last_change":"2024-09-12T17:46:57.090107+0000","last_active":"2024-09-12T18:09:04.851052+0000","last_peered":"2024-09-12T18:09:04.851052+0000","last_clean":"2024-09-12T18:09:04.851052+0000","last_became_active":"2024-09-12T17:46:57.089797+0000","last_became_peered":"2024-09-12T17:46:57.089797+0000","last_unstale":"2024-09-12T18:09:04.851052+0000","last_undegraded":"2024-09-12T18:09:04.851052+0000","last_fullsized":"2024-09-12T18:09:04.851052+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:57:58.129729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"263'5","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:39.877726+0000","last_change":"2024-09-12T17:30:16.686091+0000","last_active":"2024-09-12T18:11:39.877726+0000","last_peered":"2024-09-12T18:11:39.877726+0000","last_clean":"2024-09-12T18:11:39.877726+0000","last_became_active":"2024-09-12T17:30:16.685755+0000","last_became_peered":"2024-09-12T17:30:16.685755+0000","last_unstale":"2024-09-12T18:11:39.877726+0000","last_undegraded":"2024-09-12T18:11:39.877726+0000","last_fullsized":"2024-09-12T18:11:39.877726+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:41:14.032884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":16,"num_write":10,"num_write_kb":5136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"0'0","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:54.841851+0000","last_change":"2024-09-12T17:30:12.641329+0000","last_active":"2024-09-12T18:08:54.841851+0000","last_peered":"2024-09-12T18:08:54.841851+0000","last_clean":"2024-09-12T18:08:54.841851+0000","last_became_active":"2024-09-12T17:30:12.640983+0000","last_became_peered":"2024-09-12T17:30:12.640983+0000","last_unstale":"2024-09-12T18:08:54.841851+0000","last_undegraded":"2024-09-12T18:08:54.841851+0000","last_fullsized":"2024-09-12T18:08:54.841851+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:49:02.041715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"263'13","reported_seq":92,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:04.851003+0000","last_change":"2024-09-12T17:26:35.664850+0000","last_active":"2024-09-12T18:09:04.851003+0000","last_peered":"2024-09-12T18:09:04.851003+0000","last_clean":"2024-09-12T18:09:04.851003+0000","last_became_active":"2024-09-12T17:26:35.664517+0000","last_became_peered":"2024-09-12T17:26:35.664517+0000","last_unstale":"2024-09-12T18:09:04.851003+0000","last_undegraded":"2024-09-12T18:09:04.851003+0000","last_fullsized":"2024-09-12T18:09:04.851003+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:47:34.050940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":54,"num_write":23,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:55.153138+0000","last_change":"2024-09-12T17:46:57.091721+0000","last_active":"2024-09-12T18:09:55.153138+0000","last_peered":"2024-09-12T18:09:55.153138+0000","last_clean":"2024-09-12T18:09:55.153138+0000","last_became_active":"2024-09-12T17:46:57.091147+0000","last_became_peered":"2024-09-12T17:46:57.091147+0000","last_unstale":"2024-09-12T18:09:55.153138+0000","last_undegraded":"2024-09-12T18:09:55.153138+0000","last_fullsized":"2024-09-12T18:09:55.153138+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"260'5","reported_seq":59,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:20.578358+0000","last_change":"2024-09-12T18:12:20.578358+0000","last_active":"2024-09-12T18:12:20.578358+0000","last_peered":"2024-09-12T18:12:20.578358+0000","last_clean":"2024-09-12T18:12:20.578358+0000","last_became_active":"2024-09-12T17:30:16.684200+0000","last_became_peered":"2024-09-12T17:30:16.684200+0000","last_unstale":"2024-09-12T18:12:20.578358+0000","last_undegraded":"2024-09-12T18:12:20.578358+0000","last_fullsized":"2024-09-12T18:12:20.578358+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'5","last_scrub_stamp":"2024-09-12T18:12:20.578267+0000","last_deep_scrub":"260'5","last_deep_scrub_stamp":"2024-09-12T18:12:20.578267+0000","last_clean_scrub_stamp":"2024-09-12T18:12:20.578267+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:25:55.109570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"263'2","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:34.747957+0000","last_change":"2024-09-12T17:30:12.640225+0000","last_active":"2024-09-12T18:11:34.747957+0000","last_peered":"2024-09-12T18:11:34.747957+0000","last_clean":"2024-09-12T18:11:34.747957+0000","last_became_active":"2024-09-12T17:30:12.639953+0000","last_became_peered":"2024-09-12T17:30:12.639953+0000","last_unstale":"2024-09-12T18:11:34.747957+0000","last_undegraded":"2024-09-12T18:11:34.747957+0000","last_fullsized":"2024-09-12T18:11:34.747957+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:40:28.022453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"263'28","reported_seq":133,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:15.595792+0000","last_change":"2024-09-12T18:12:15.595792+0000","last_active":"2024-09-12T18:12:15.595792+0000","last_peered":"2024-09-12T18:12:15.595792+0000","last_clean":"2024-09-12T18:12:15.595792+0000","last_became_active":"2024-09-12T17:26:35.663339+0000","last_became_peered":"2024-09-12T17:26:35.663339+0000","last_unstale":"2024-09-12T18:12:15.595792+0000","last_undegraded":"2024-09-12T18:12:15.595792+0000","last_fullsized":"2024-09-12T18:12:15.595792+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'28","last_scrub_stamp":"2024-09-12T18:12:15.595694+0000","last_deep_scrub":"263'28","last_deep_scrub_stamp":"2024-09-12T18:12:15.595694+0000","last_clean_scrub_stamp":"2024-09-12T18:12:15.595694+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:07:07.625379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":134,"num_read_kb":91,"num_write":60,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"263'1","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:29.858886+0000","last_change":"2024-09-12T17:46:57.088362+0000","last_active":"2024-09-12T18:09:29.858886+0000","last_peered":"2024-09-12T18:09:29.858886+0000","last_clean":"2024-09-12T18:09:29.858886+0000","last_became_active":"2024-09-12T17:46:57.088039+0000","last_became_peered":"2024-09-12T17:46:57.088039+0000","last_unstale":"2024-09-12T18:09:29.858886+0000","last_undegraded":"2024-09-12T18:09:29.858886+0000","last_fullsized":"2024-09-12T18:09:29.858886+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"263'9","reported_seq":64,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:21.621741+0000","last_change":"2024-09-12T18:12:21.621741+0000","last_active":"2024-09-12T18:12:21.621741+0000","last_peered":"2024-09-12T18:12:21.621741+0000","last_clean":"2024-09-12T18:12:21.621741+0000","last_became_active":"2024-09-12T17:30:16.672167+0000","last_became_peered":"2024-09-12T17:30:16.672167+0000","last_unstale":"2024-09-12T18:12:21.621741+0000","last_undegraded":"2024-09-12T18:12:21.621741+0000","last_fullsized":"2024-09-12T18:12:21.621741+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'9","last_scrub_stamp":"2024-09-12T18:12:21.621640+0000","last_deep_scrub":"263'9","last_deep_scrub_stamp":"2024-09-12T18:12:21.621640+0000","last_clean_scrub_stamp":"2024-09-12T18:12:21.621640+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:29:04.525875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":17408,"num_write":19,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"260'5","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:44.843494+0000","last_change":"2024-09-12T17:30:12.644426+0000","last_active":"2024-09-12T18:07:44.843494+0000","last_peered":"2024-09-12T18:07:44.843494+0000","last_clean":"2024-09-12T18:07:44.843494+0000","last_became_active":"2024-09-12T17:30:12.644125+0000","last_became_peered":"2024-09-12T17:30:12.644125+0000","last_unstale":"2024-09-12T18:07:44.843494+0000","last_undegraded":"2024-09-12T18:07:44.843494+0000","last_fullsized":"2024-09-12T18:07:44.843494+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:29:53.974488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"263'38","reported_seq":158,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:44.833618+0000","last_change":"2024-09-12T17:26:35.659571+0000","last_active":"2024-09-12T18:07:44.833618+0000","last_peered":"2024-09-12T18:07:44.833618+0000","last_clean":"2024-09-12T18:07:44.833618+0000","last_became_active":"2024-09-12T17:26:35.659261+0000","last_became_peered":"2024-09-12T17:26:35.659261+0000","last_unstale":"2024-09-12T18:07:44.833618+0000","last_undegraded":"2024-09-12T18:07:44.833618+0000","last_fullsized":"2024-09-12T18:07:44.833618+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:13:24.323445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":196,"num_read_kb":138,"num_write":78,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:29.858926+0000","last_change":"2024-09-12T17:46:57.088279+0000","last_active":"2024-09-12T18:09:29.858926+0000","last_peered":"2024-09-12T18:09:29.858926+0000","last_clean":"2024-09-12T18:09:29.858926+0000","last_became_active":"2024-09-12T17:46:57.087965+0000","last_became_peered":"2024-09-12T17:46:57.087965+0000","last_unstale":"2024-09-12T18:09:29.858926+0000","last_undegraded":"2024-09-12T18:09:29.858926+0000","last_fullsized":"2024-09-12T18:09:29.858926+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"263'8","reported_seq":61,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:10:19.861008+0000","last_change":"2024-09-12T17:30:16.685365+0000","last_active":"2024-09-12T18:10:19.861008+0000","last_peered":"2024-09-12T18:10:19.861008+0000","last_clean":"2024-09-12T18:10:19.861008+0000","last_became_active":"2024-09-12T17:30:16.685054+0000","last_became_peered":"2024-09-12T17:30:16.685054+0000","last_unstale":"2024-09-12T18:10:19.861008+0000","last_undegraded":"2024-09-12T18:10:19.861008+0000","last_fullsized":"2024-09-12T18:10:19.861008+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:42:01.087864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":30722,"num_write":13,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"263'8","reported_seq":65,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:10:14.852155+0000","last_change":"2024-09-12T17:30:12.652060+0000","last_active":"2024-09-12T18:10:14.852155+0000","last_peered":"2024-09-12T18:10:14.852155+0000","last_clean":"2024-09-12T18:10:14.852155+0000","last_became_active":"2024-09-12T17:30:12.651780+0000","last_became_peered":"2024-09-12T17:30:12.651780+0000","last_unstale":"2024-09-12T18:10:14.852155+0000","last_undegraded":"2024-09-12T18:10:14.852155+0000","last_fullsized":"2024-09-12T18:10:14.852155+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:20:56.174919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":22530,"num_write":13,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"263'27","reported_seq":136,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:16.514946+0000","last_change":"2024-09-12T18:12:16.514946+0000","last_active":"2024-09-12T18:12:16.514946+0000","last_peered":"2024-09-12T18:12:16.514946+0000","last_clean":"2024-09-12T18:12:16.514946+0000","last_became_active":"2024-09-12T17:26:35.665076+0000","last_became_peered":"2024-09-12T17:26:35.665076+0000","last_unstale":"2024-09-12T18:12:16.514946+0000","last_undegraded":"2024-09-12T18:12:16.514946+0000","last_fullsized":"2024-09-12T18:12:16.514946+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'27","last_scrub_stamp":"2024-09-12T18:12:16.514848+0000","last_deep_scrub":"263'27","last_deep_scrub_stamp":"2024-09-12T18:12:16.514848+0000","last_clean_scrub_stamp":"2024-09-12T18:12:16.514848+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:14:35.753947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":146,"num_read_kb":106,"num_write":38,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:00.140237+0000","last_change":"2024-09-12T17:46:57.077605+0000","last_active":"2024-09-12T18:08:00.140237+0000","last_peered":"2024-09-12T18:08:00.140237+0000","last_clean":"2024-09-12T18:08:00.140237+0000","last_became_active":"2024-09-12T17:46:57.077265+0000","last_became_peered":"2024-09-12T17:46:57.077265+0000","last_unstale":"2024-09-12T18:08:00.140237+0000","last_undegraded":"2024-09-12T18:08:00.140237+0000","last_fullsized":"2024-09-12T18:08:00.140237+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:54:27.754921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"0'0","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:59.850434+0000","last_change":"2024-09-12T17:30:16.684627+0000","last_active":"2024-09-12T18:08:59.850434+0000","last_peered":"2024-09-12T18:08:59.850434+0000","last_clean":"2024-09-12T18:08:59.850434+0000","last_became_active":"2024-09-12T17:30:16.683963+0000","last_became_peered":"2024-09-12T17:30:16.683963+0000","last_unstale":"2024-09-12T18:08:59.850434+0000","last_undegraded":"2024-09-12T18:08:59.850434+0000","last_fullsized":"2024-09-12T18:08:59.850434+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:56:37.344964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"263'8","reported_seq":66,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:10:09.864676+0000","last_change":"2024-09-12T17:30:12.643034+0000","last_active":"2024-09-12T18:10:09.864676+0000","last_peered":"2024-09-12T18:10:09.864676+0000","last_clean":"2024-09-12T18:10:09.864676+0000","last_became_active":"2024-09-12T17:30:12.642687+0000","last_became_peered":"2024-09-12T17:30:12.642687+0000","last_unstale":"2024-09-12T18:10:09.864676+0000","last_undegraded":"2024-09-12T18:10:09.864676+0000","last_fullsized":"2024-09-12T18:10:09.864676+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:06:07.203968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":26626,"num_write":13,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"263'39","reported_seq":160,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:39.833155+0000","last_change":"2024-09-12T17:26:35.668713+0000","last_active":"2024-09-12T18:07:39.833155+0000","last_peered":"2024-09-12T18:07:39.833155+0000","last_clean":"2024-09-12T18:07:39.833155+0000","last_became_active":"2024-09-12T17:26:35.668286+0000","last_became_peered":"2024-09-12T17:26:35.668286+0000","last_unstale":"2024-09-12T18:07:39.833155+0000","last_undegraded":"2024-09-12T18:07:39.833155+0000","last_fullsized":"2024-09-12T18:07:39.833155+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:20:43.354325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":202,"num_read_kb":143,"num_write":74,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"263'2","reported_seq":33,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:14.710122+0000","last_change":"2024-09-12T18:12:14.710122+0000","last_active":"2024-09-12T18:12:14.710122+0000","last_peered":"2024-09-12T18:12:14.710122+0000","last_clean":"2024-09-12T18:12:14.710122+0000","last_became_active":"2024-09-12T17:46:57.088919+0000","last_became_peered":"2024-09-12T17:46:57.088919+0000","last_unstale":"2024-09-12T18:12:14.710122+0000","last_undegraded":"2024-09-12T18:12:14.710122+0000","last_fullsized":"2024-09-12T18:12:14.710122+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T18:12:14.710049+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T18:12:14.710049+0000","last_clean_scrub_stamp":"2024-09-12T18:12:14.710049+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:41:35.181583+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"0'0","reported_seq":34,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:44.840586+0000","last_change":"2024-09-12T17:31:18.237102+0000","last_active":"2024-09-12T18:08:44.840586+0000","last_peered":"2024-09-12T18:08:44.840586+0000","last_clean":"2024-09-12T18:08:44.840586+0000","last_became_active":"2024-09-12T17:31:18.236640+0000","last_became_peered":"2024-09-12T17:31:18.236640+0000","last_unstale":"2024-09-12T18:08:44.840586+0000","last_undegraded":"2024-09-12T18:08:44.840586+0000","last_fullsized":"2024-09-12T18:08:44.840586+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:10:12.696558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.15","version":"0'0","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:54.853566+0000","last_change":"2024-09-12T17:30:12.649885+0000","last_active":"2024-09-12T18:08:54.853566+0000","last_peered":"2024-09-12T18:08:54.853566+0000","last_clean":"2024-09-12T18:08:54.853566+0000","last_became_active":"2024-09-12T17:30:12.649605+0000","last_became_peered":"2024-09-12T17:30:12.649605+0000","last_unstale":"2024-09-12T18:08:54.853566+0000","last_undegraded":"2024-09-12T18:08:54.853566+0000","last_fullsized":"2024-09-12T18:08:54.853566+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:09:52.512870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"263'53","reported_seq":191,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:39.841430+0000","last_change":"2024-09-12T17:26:35.661633+0000","last_active":"2024-09-12T18:07:39.841430+0000","last_peered":"2024-09-12T18:07:39.841430+0000","last_clean":"2024-09-12T18:07:39.841430+0000","last_became_active":"2024-09-12T17:26:35.658602+0000","last_became_peered":"2024-09-12T17:26:35.658602+0000","last_unstale":"2024-09-12T18:07:39.841430+0000","last_undegraded":"2024-09-12T18:07:39.841430+0000","last_fullsized":"2024-09-12T18:07:39.841430+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:40:06.406484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":262,"num_read_kb":183,"num_write":93,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:59.845745+0000","last_change":"2024-09-12T17:46:57.083830+0000","last_active":"2024-09-12T18:07:59.845745+0000","last_peered":"2024-09-12T18:07:59.845745+0000","last_clean":"2024-09-12T18:07:59.845745+0000","last_became_active":"2024-09-12T17:46:57.081080+0000","last_became_peered":"2024-09-12T17:46:57.081080+0000","last_unstale":"2024-09-12T18:07:59.845745+0000","last_undegraded":"2024-09-12T18:07:59.845745+0000","last_fullsized":"2024-09-12T18:07:59.845745+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:12:11.153281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"263'3","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:24.870221+0000","last_change":"2024-09-12T17:30:16.686003+0000","last_active":"2024-09-12T18:11:24.870221+0000","last_peered":"2024-09-12T18:11:24.870221+0000","last_clean":"2024-09-12T18:11:24.870221+0000","last_became_active":"2024-09-12T17:30:16.685688+0000","last_became_peered":"2024-09-12T17:30:16.685688+0000","last_unstale":"2024-09-12T18:11:24.870221+0000","last_undegraded":"2024-09-12T18:11:24.870221+0000","last_fullsized":"2024-09-12T18:11:24.870221+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:37:31.358403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"0'0","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:10.681131+0000","last_change":"2024-09-12T18:12:10.681131+0000","last_active":"2024-09-12T18:12:10.681131+0000","last_peered":"2024-09-12T18:12:10.681131+0000","last_clean":"2024-09-12T18:12:10.681131+0000","last_became_active":"2024-09-12T17:30:12.654327+0000","last_became_peered":"2024-09-12T17:30:12.654327+0000","last_unstale":"2024-09-12T18:12:10.681131+0000","last_undegraded":"2024-09-12T18:12:10.681131+0000","last_fullsized":"2024-09-12T18:12:10.681131+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:10.681027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:10.681027+0000","last_clean_scrub_stamp":"2024-09-12T18:12:10.681027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:06:34.876167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"263'47","reported_seq":193,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:06.752989+0000","last_change":"2024-09-12T18:12:06.752989+0000","last_active":"2024-09-12T18:12:06.752989+0000","last_peered":"2024-09-12T18:12:06.752989+0000","last_clean":"2024-09-12T18:12:06.752989+0000","last_became_active":"2024-09-12T17:26:35.662284+0000","last_became_peered":"2024-09-12T17:26:35.662284+0000","last_unstale":"2024-09-12T18:12:06.752989+0000","last_undegraded":"2024-09-12T18:12:06.752989+0000","last_fullsized":"2024-09-12T18:12:06.752989+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'47","last_scrub_stamp":"2024-09-12T18:12:06.752901+0000","last_deep_scrub":"263'47","last_deep_scrub_stamp":"2024-09-12T18:12:06.752901+0000","last_clean_scrub_stamp":"2024-09-12T18:12:06.752901+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:42:41.000414+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":252,"num_read_kb":176,"num_write":91,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:07:59.844776+0000","last_change":"2024-09-12T17:46:57.082391+0000","last_active":"2024-09-12T18:07:59.844776+0000","last_peered":"2024-09-12T18:07:59.844776+0000","last_clean":"2024-09-12T18:07:59.844776+0000","last_became_active":"2024-09-12T17:46:57.082082+0000","last_became_peered":"2024-09-12T17:46:57.082082+0000","last_unstale":"2024-09-12T18:07:59.844776+0000","last_undegraded":"2024-09-12T18:07:59.844776+0000","last_fullsized":"2024-09-12T18:07:59.844776+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:16:53.154548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"260'3","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:59.853745+0000","last_change":"2024-09-12T17:30:16.675596+0000","last_active":"2024-09-12T18:08:59.853745+0000","last_peered":"2024-09-12T18:08:59.853745+0000","last_clean":"2024-09-12T18:08:59.853745+0000","last_became_active":"2024-09-12T17:30:16.675278+0000","last_became_peered":"2024-09-12T17:30:16.675278+0000","last_unstale":"2024-09-12T18:08:59.853745+0000","last_undegraded":"2024-09-12T18:08:59.853745+0000","last_fullsized":"2024-09-12T18:08:59.853745+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:04:44.516041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"260'2","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:54.841986+0000","last_change":"2024-09-12T17:30:12.643518+0000","last_active":"2024-09-12T18:08:54.841986+0000","last_peered":"2024-09-12T18:08:54.841986+0000","last_clean":"2024-09-12T18:08:54.841986+0000","last_became_active":"2024-09-12T17:30:12.643203+0000","last_became_peered":"2024-09-12T17:30:12.643203+0000","last_unstale":"2024-09-12T18:08:54.841986+0000","last_undegraded":"2024-09-12T18:08:54.841986+0000","last_fullsized":"2024-09-12T18:08:54.841986+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:42:13.911696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":23,"num_write":2,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"263'29","reported_seq":125,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:39.851532+0000","last_change":"2024-09-12T17:26:35.657351+0000","last_active":"2024-09-12T18:08:39.851532+0000","last_peered":"2024-09-12T18:08:39.851532+0000","last_clean":"2024-09-12T18:08:39.851532+0000","last_became_active":"2024-09-12T17:26:35.657035+0000","last_became_peered":"2024-09-12T17:26:35.657035+0000","last_unstale":"2024-09-12T18:08:39.851532+0000","last_undegraded":"2024-09-12T18:08:39.851532+0000","last_fullsized":"2024-09-12T18:08:39.851532+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:26:04.653231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":129,"num_read_kb":90,"num_write":56,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:44.848747+0000","last_change":"2024-09-12T17:46:57.094601+0000","last_active":"2024-09-12T18:08:44.848747+0000","last_peered":"2024-09-12T18:08:44.848747+0000","last_clean":"2024-09-12T18:08:44.848747+0000","last_became_active":"2024-09-12T17:46:57.094314+0000","last_became_peered":"2024-09-12T17:46:57.094314+0000","last_unstale":"2024-09-12T18:08:44.848747+0000","last_undegraded":"2024-09-12T18:08:44.848747+0000","last_fullsized":"2024-09-12T18:08:44.848747+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:55:53.289948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:10:00.153797+0000","last_change":"2024-09-12T17:30:16.679537+0000","last_active":"2024-09-12T18:10:00.153797+0000","last_peered":"2024-09-12T18:10:00.153797+0000","last_clean":"2024-09-12T18:10:00.153797+0000","last_became_active":"2024-09-12T17:30:16.679282+0000","last_became_peered":"2024-09-12T17:30:16.679282+0000","last_unstale":"2024-09-12T18:10:00.153797+0000","last_undegraded":"2024-09-12T18:10:00.153797+0000","last_fullsized":"2024-09-12T18:10:00.153797+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"260'6","reported_seq":67,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:24.336704+0000","last_change":"2024-09-12T18:12:24.336704+0000","last_active":"2024-09-12T18:12:24.336704+0000","last_peered":"2024-09-12T18:12:24.336704+0000","last_clean":"2024-09-12T18:12:24.336704+0000","last_became_active":"2024-09-12T17:30:12.652426+0000","last_became_peered":"2024-09-12T17:30:12.652426+0000","last_unstale":"2024-09-12T18:12:24.336704+0000","last_undegraded":"2024-09-12T18:12:24.336704+0000","last_fullsized":"2024-09-12T18:12:24.336704+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'6","last_scrub_stamp":"2024-09-12T18:12:24.336606+0000","last_deep_scrub":"260'6","last_deep_scrub_stamp":"2024-09-12T18:12:24.336606+0000","last_clean_scrub_stamp":"2024-09-12T18:12:24.336606+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:14:36.587843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":10240,"num_write":16,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"263'34","reported_seq":156,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:24.498834+0000","last_change":"2024-09-12T18:12:24.498834+0000","last_active":"2024-09-12T18:12:24.498834+0000","last_peered":"2024-09-12T18:12:24.498834+0000","last_clean":"2024-09-12T18:12:24.498834+0000","last_became_active":"2024-09-12T17:26:35.663337+0000","last_became_peered":"2024-09-12T17:26:35.663337+0000","last_unstale":"2024-09-12T18:12:24.498834+0000","last_undegraded":"2024-09-12T18:12:24.498834+0000","last_fullsized":"2024-09-12T18:12:24.498834+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'34","last_scrub_stamp":"2024-09-12T18:12:24.498734+0000","last_deep_scrub":"263'34","last_deep_scrub_stamp":"2024-09-12T18:12:24.498734+0000","last_clean_scrub_stamp":"2024-09-12T18:12:24.498734+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:16:59.364876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":179,"num_read_kb":128,"num_write":55,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:44.840640+0000","last_change":"2024-09-12T17:46:57.093698+0000","last_active":"2024-09-12T18:08:44.840640+0000","last_peered":"2024-09-12T18:08:44.840640+0000","last_clean":"2024-09-12T18:08:44.840640+0000","last_became_active":"2024-09-12T17:46:57.093157+0000","last_became_peered":"2024-09-12T17:46:57.093157+0000","last_unstale":"2024-09-12T18:08:44.840640+0000","last_undegraded":"2024-09-12T18:08:44.840640+0000","last_fullsized":"2024-09-12T18:08:44.840640+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:44:51.633185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"263'2","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:24.515982+0000","last_change":"2024-09-12T18:12:24.515982+0000","last_active":"2024-09-12T18:12:24.515982+0000","last_peered":"2024-09-12T18:12:24.515982+0000","last_clean":"2024-09-12T18:12:24.515982+0000","last_became_active":"2024-09-12T17:30:16.678682+0000","last_became_peered":"2024-09-12T17:30:16.678682+0000","last_unstale":"2024-09-12T18:12:24.515982+0000","last_undegraded":"2024-09-12T18:12:24.515982+0000","last_fullsized":"2024-09-12T18:12:24.515982+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T18:12:24.515881+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T18:12:24.515881+0000","last_clean_scrub_stamp":"2024-09-12T18:12:24.515881+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:06:29.104906+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"263'6","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:41.375156+0000","last_change":"2024-09-12T17:30:12.653263+0000","last_active":"2024-09-12T18:11:41.375156+0000","last_peered":"2024-09-12T18:11:41.375156+0000","last_clean":"2024-09-12T18:11:41.375156+0000","last_became_active":"2024-09-12T17:30:12.652916+0000","last_became_peered":"2024-09-12T17:30:12.652916+0000","last_unstale":"2024-09-12T18:11:41.375156+0000","last_undegraded":"2024-09-12T18:11:41.375156+0000","last_fullsized":"2024-09-12T18:11:41.375156+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":16,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"263'35","reported_seq":148,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:34.839418+0000","last_change":"2024-09-12T17:26:35.669546+0000","last_active":"2024-09-12T18:08:34.839418+0000","last_peered":"2024-09-12T18:08:34.839418+0000","last_clean":"2024-09-12T18:08:34.839418+0000","last_became_active":"2024-09-12T17:26:35.669256+0000","last_became_peered":"2024-09-12T17:26:35.669256+0000","last_unstale":"2024-09-12T18:08:34.839418+0000","last_undegraded":"2024-09-12T18:08:34.839418+0000","last_fullsized":"2024-09-12T18:08:34.839418+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:05:49.889059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":173,"num_read_kb":119,"num_write":68,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"262'1","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:04.835994+0000","last_change":"2024-09-12T17:46:57.090884+0000","last_active":"2024-09-12T18:08:04.835994+0000","last_peered":"2024-09-12T18:08:04.835994+0000","last_clean":"2024-09-12T18:08:04.835994+0000","last_became_active":"2024-09-12T17:46:57.090587+0000","last_became_peered":"2024-09-12T17:46:57.090587+0000","last_unstale":"2024-09-12T18:08:04.835994+0000","last_undegraded":"2024-09-12T18:08:04.835994+0000","last_fullsized":"2024-09-12T18:08:04.835994+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:06:27.485219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"260'3","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:59.858476+0000","last_change":"2024-09-12T17:30:16.686552+0000","last_active":"2024-09-12T18:09:59.858476+0000","last_peered":"2024-09-12T18:09:59.858476+0000","last_clean":"2024-09-12T18:09:59.858476+0000","last_became_active":"2024-09-12T17:30:16.685830+0000","last_became_peered":"2024-09-12T17:30:16.685830+0000","last_unstale":"2024-09-12T18:09:59.858476+0000","last_undegraded":"2024-09-12T18:09:59.858476+0000","last_fullsized":"2024-09-12T18:09:59.858476+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"0'0","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:17.643769+0000","last_change":"2024-09-12T18:12:17.643769+0000","last_active":"2024-09-12T18:12:17.643769+0000","last_peered":"2024-09-12T18:12:17.643769+0000","last_clean":"2024-09-12T18:12:17.643769+0000","last_became_active":"2024-09-12T17:30:12.640139+0000","last_became_peered":"2024-09-12T17:30:12.640139+0000","last_unstale":"2024-09-12T18:12:17.643769+0000","last_undegraded":"2024-09-12T18:12:17.643769+0000","last_fullsized":"2024-09-12T18:12:17.643769+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:17.643681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:17.643681+0000","last_clean_scrub_stamp":"2024-09-12T18:12:17.643681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:03:03.826784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"263'49","reported_seq":189,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:34.850284+0000","last_change":"2024-09-12T17:26:35.659117+0000","last_active":"2024-09-12T18:08:34.850284+0000","last_peered":"2024-09-12T18:08:34.850284+0000","last_clean":"2024-09-12T18:08:34.850284+0000","last_became_active":"2024-09-12T17:26:35.658785+0000","last_became_peered":"2024-09-12T17:26:35.658785+0000","last_unstale":"2024-09-12T18:08:34.850284+0000","last_undegraded":"2024-09-12T18:08:34.850284+0000","last_fullsized":"2024-09-12T18:08:34.850284+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:02.864803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":254,"num_read_kb":176,"num_write":93,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"263'1","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:44.848723+0000","last_change":"2024-09-12T17:46:57.093615+0000","last_active":"2024-09-12T18:08:44.848723+0000","last_peered":"2024-09-12T18:08:44.848723+0000","last_clean":"2024-09-12T18:08:44.848723+0000","last_became_active":"2024-09-12T17:46:57.093267+0000","last_became_peered":"2024-09-12T17:46:57.093267+0000","last_unstale":"2024-09-12T18:08:44.848723+0000","last_undegraded":"2024-09-12T18:08:44.848723+0000","last_fullsized":"2024-09-12T18:08:44.848723+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:52:12.345961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:19.615413+0000","last_change":"2024-09-12T18:12:19.615343+0000","last_active":"2024-09-12T18:12:19.615413+0000","last_peered":"2024-09-12T18:12:19.615413+0000","last_clean":"2024-09-12T18:12:19.615413+0000","last_became_active":"2024-09-12T17:30:16.681418+0000","last_became_peered":"2024-09-12T17:30:16.681418+0000","last_unstale":"2024-09-12T18:12:19.615413+0000","last_undegraded":"2024-09-12T18:12:19.615413+0000","last_fullsized":"2024-09-12T18:12:19.615413+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:19.615255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:19.615255+0000","last_clean_scrub_stamp":"2024-09-12T18:12:19.615255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:53:23.299709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"260'3","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:54.862713+0000","last_change":"2024-09-12T17:30:12.643785+0000","last_active":"2024-09-12T18:09:54.862713+0000","last_peered":"2024-09-12T18:09:54.862713+0000","last_clean":"2024-09-12T18:09:54.862713+0000","last_became_active":"2024-09-12T17:30:12.643484+0000","last_became_peered":"2024-09-12T17:30:12.643484+0000","last_unstale":"2024-09-12T18:09:54.862713+0000","last_undegraded":"2024-09-12T18:09:54.862713+0000","last_fullsized":"2024-09-12T18:09:54.862713+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"260'23","reported_seq":119,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:34.847525+0000","last_change":"2024-09-12T17:26:35.666220+0000","last_active":"2024-09-12T18:08:34.847525+0000","last_peered":"2024-09-12T18:08:34.847525+0000","last_clean":"2024-09-12T18:08:34.847525+0000","last_became_active":"2024-09-12T17:26:35.665908+0000","last_became_peered":"2024-09-12T17:26:35.665908+0000","last_unstale":"2024-09-12T18:08:34.847525+0000","last_undegraded":"2024-09-12T18:08:34.847525+0000","last_fullsized":"2024-09-12T18:08:34.847525+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:22:29.733636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":120,"num_read_kb":87,"num_write":41,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":32,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:13.703880+0000","last_change":"2024-09-12T18:12:13.703880+0000","last_active":"2024-09-12T18:12:13.703880+0000","last_peered":"2024-09-12T18:12:13.703880+0000","last_clean":"2024-09-12T18:12:13.703880+0000","last_became_active":"2024-09-12T17:46:57.083098+0000","last_became_peered":"2024-09-12T17:46:57.083098+0000","last_unstale":"2024-09-12T18:12:13.703880+0000","last_undegraded":"2024-09-12T18:12:13.703880+0000","last_fullsized":"2024-09-12T18:12:13.703880+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:13.703785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:13.703785+0000","last_clean_scrub_stamp":"2024-09-12T18:12:13.703785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:58:44.733305+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:34.847617+0000","last_change":"2024-09-12T17:30:16.684194+0000","last_active":"2024-09-12T18:08:34.847617+0000","last_peered":"2024-09-12T18:08:34.847617+0000","last_clean":"2024-09-12T18:08:34.847617+0000","last_became_active":"2024-09-12T17:30:16.683887+0000","last_became_peered":"2024-09-12T17:30:16.683887+0000","last_unstale":"2024-09-12T18:08:34.847617+0000","last_undegraded":"2024-09-12T18:08:34.847617+0000","last_fullsized":"2024-09-12T18:08:34.847617+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:53:34.319282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"263'4","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:41.193054+0000","last_change":"2024-09-12T17:30:12.653459+0000","last_active":"2024-09-12T18:11:41.193054+0000","last_peered":"2024-09-12T18:11:41.193054+0000","last_clean":"2024-09-12T18:11:41.193054+0000","last_became_active":"2024-09-12T17:30:12.653137+0000","last_became_peered":"2024-09-12T17:30:12.653137+0000","last_unstale":"2024-09-12T18:11:41.193054+0000","last_undegraded":"2024-09-12T18:11:41.193054+0000","last_fullsized":"2024-09-12T18:11:41.193054+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:08:52.465178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6148,"num_write":4,"num_write_kb":3076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"263'50","reported_seq":187,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:29.854471+0000","last_change":"2024-09-12T17:26:35.669293+0000","last_active":"2024-09-12T18:09:29.854471+0000","last_peered":"2024-09-12T18:09:29.854471+0000","last_clean":"2024-09-12T18:09:29.854471+0000","last_became_active":"2024-09-12T17:26:35.668989+0000","last_became_peered":"2024-09-12T17:26:35.668989+0000","last_unstale":"2024-09-12T18:09:29.854471+0000","last_undegraded":"2024-09-12T18:09:29.854471+0000","last_fullsized":"2024-09-12T18:09:29.854471+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:43:19.820670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":250,"num_read_kb":175,"num_write":93,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:29.858796+0000","last_change":"2024-09-12T17:46:57.088291+0000","last_active":"2024-09-12T18:09:29.858796+0000","last_peered":"2024-09-12T18:09:29.858796+0000","last_clean":"2024-09-12T18:09:29.858796+0000","last_became_active":"2024-09-12T17:46:57.087982+0000","last_became_peered":"2024-09-12T17:46:57.087982+0000","last_unstale":"2024-09-12T18:09:29.858796+0000","last_undegraded":"2024-09-12T18:09:29.858796+0000","last_fullsized":"2024-09-12T18:09:29.858796+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:05:50.630405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"263'5","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:41.180718+0000","last_change":"2024-09-12T17:30:16.679996+0000","last_active":"2024-09-12T18:11:41.180718+0000","last_peered":"2024-09-12T18:11:41.180718+0000","last_clean":"2024-09-12T18:11:41.180718+0000","last_became_active":"2024-09-12T17:30:16.679621+0000","last_became_peered":"2024-09-12T17:30:16.679621+0000","last_unstale":"2024-09-12T18:11:41.180718+0000","last_undegraded":"2024-09-12T18:11:41.180718+0000","last_fullsized":"2024-09-12T18:11:41.180718+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:23:53.964330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":9216,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"0'0","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:11.722350+0000","last_change":"2024-09-12T18:12:11.722350+0000","last_active":"2024-09-12T18:12:11.722350+0000","last_peered":"2024-09-12T18:12:11.722350+0000","last_clean":"2024-09-12T18:12:11.722350+0000","last_became_active":"2024-09-12T17:30:12.649010+0000","last_became_peered":"2024-09-12T17:30:12.649010+0000","last_unstale":"2024-09-12T18:12:11.722350+0000","last_undegraded":"2024-09-12T18:12:11.722350+0000","last_fullsized":"2024-09-12T18:12:11.722350+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:11.722264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:11.722264+0000","last_clean_scrub_stamp":"2024-09-12T18:12:11.722264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:57:34.831899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"260'8","reported_seq":76,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:19.855981+0000","last_change":"2024-09-12T17:26:35.663336+0000","last_active":"2024-09-12T18:09:19.855981+0000","last_peered":"2024-09-12T18:09:19.855981+0000","last_clean":"2024-09-12T18:09:19.855981+0000","last_became_active":"2024-09-12T17:26:35.663041+0000","last_became_peered":"2024-09-12T17:26:35.663041+0000","last_unstale":"2024-09-12T18:09:19.855981+0000","last_undegraded":"2024-09-12T18:09:19.855981+0000","last_fullsized":"2024-09-12T18:09:19.855981+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:02:26.294386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":28,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":32,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:22.599821+0000","last_change":"2024-09-12T18:12:22.599821+0000","last_active":"2024-09-12T18:12:22.599821+0000","last_peered":"2024-09-12T18:12:22.599821+0000","last_clean":"2024-09-12T18:12:22.599821+0000","last_became_active":"2024-09-12T17:46:57.085908+0000","last_became_peered":"2024-09-12T17:46:57.085908+0000","last_unstale":"2024-09-12T18:12:22.599821+0000","last_undegraded":"2024-09-12T18:12:22.599821+0000","last_fullsized":"2024-09-12T18:12:22.599821+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:22.599729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:22.599729+0000","last_clean_scrub_stamp":"2024-09-12T18:12:22.599729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:22:37.203634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"0'0","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:23.528470+0000","last_change":"2024-09-12T18:12:23.528470+0000","last_active":"2024-09-12T18:12:23.528470+0000","last_peered":"2024-09-12T18:12:23.528470+0000","last_clean":"2024-09-12T18:12:23.528470+0000","last_became_active":"2024-09-12T17:30:16.679193+0000","last_became_peered":"2024-09-12T17:30:16.679193+0000","last_unstale":"2024-09-12T18:12:23.528470+0000","last_undegraded":"2024-09-12T18:12:23.528470+0000","last_fullsized":"2024-09-12T18:12:23.528470+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:23.528383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:23.528383+0000","last_clean_scrub_stamp":"2024-09-12T18:12:23.528383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:50:26.406700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"0'0","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:29.838852+0000","last_change":"2024-09-12T17:30:12.647471+0000","last_active":"2024-09-12T18:08:29.838852+0000","last_peered":"2024-09-12T18:08:29.838852+0000","last_clean":"2024-09-12T18:08:29.838852+0000","last_became_active":"2024-09-12T17:30:12.646945+0000","last_became_peered":"2024-09-12T17:30:12.646945+0000","last_unstale":"2024-09-12T18:08:29.838852+0000","last_undegraded":"2024-09-12T18:08:29.838852+0000","last_fullsized":"2024-09-12T18:08:29.838852+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:42:36.686975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"263'33","reported_seq":151,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:14.554571+0000","last_change":"2024-09-12T18:12:14.554571+0000","last_active":"2024-09-12T18:12:14.554571+0000","last_peered":"2024-09-12T18:12:14.554571+0000","last_clean":"2024-09-12T18:12:14.554571+0000","last_became_active":"2024-09-12T17:26:35.664749+0000","last_became_peered":"2024-09-12T17:26:35.664749+0000","last_unstale":"2024-09-12T18:12:14.554571+0000","last_undegraded":"2024-09-12T18:12:14.554571+0000","last_fullsized":"2024-09-12T18:12:14.554571+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'33","last_scrub_stamp":"2024-09-12T18:12:14.554482+0000","last_deep_scrub":"263'33","last_deep_scrub_stamp":"2024-09-12T18:12:14.554482+0000","last_clean_scrub_stamp":"2024-09-12T18:12:14.554482+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:42:43.539362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":166,"num_read_kb":124,"num_write":50,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:39.851484+0000","last_change":"2024-09-12T17:46:57.084760+0000","last_active":"2024-09-12T18:08:39.851484+0000","last_peered":"2024-09-12T18:08:39.851484+0000","last_clean":"2024-09-12T18:08:39.851484+0000","last_became_active":"2024-09-12T17:46:57.084421+0000","last_became_peered":"2024-09-12T17:46:57.084421+0000","last_unstale":"2024-09-12T18:08:39.851484+0000","last_undegraded":"2024-09-12T18:08:39.851484+0000","last_fullsized":"2024-09-12T18:08:39.851484+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:35:17.085619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"0'0","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:34.847633+0000","last_change":"2024-09-12T17:30:16.682114+0000","last_active":"2024-09-12T18:08:34.847633+0000","last_peered":"2024-09-12T18:08:34.847633+0000","last_clean":"2024-09-12T18:08:34.847633+0000","last_became_active":"2024-09-12T17:30:16.681171+0000","last_became_peered":"2024-09-12T17:30:16.681171+0000","last_unstale":"2024-09-12T18:08:34.847633+0000","last_undegraded":"2024-09-12T18:08:34.847633+0000","last_fullsized":"2024-09-12T18:08:34.847633+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:35:19.241688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"263'6","reported_seq":65,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:22.520661+0000","last_change":"2024-09-12T18:12:22.520661+0000","last_active":"2024-09-12T18:12:22.520661+0000","last_peered":"2024-09-12T18:12:22.520661+0000","last_clean":"2024-09-12T18:12:22.520661+0000","last_became_active":"2024-09-12T17:30:12.641592+0000","last_became_peered":"2024-09-12T17:30:12.641592+0000","last_unstale":"2024-09-12T18:12:22.520661+0000","last_undegraded":"2024-09-12T18:12:22.520661+0000","last_fullsized":"2024-09-12T18:12:22.520661+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'6","last_scrub_stamp":"2024-09-12T18:12:22.520568+0000","last_deep_scrub":"263'6","last_deep_scrub_stamp":"2024-09-12T18:12:22.520568+0000","last_clean_scrub_stamp":"2024-09-12T18:12:22.520568+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:49:55.907430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":11264,"num_write":6,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"263'52","reported_seq":204,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:08.755498+0000","last_change":"2024-09-12T18:12:08.755498+0000","last_active":"2024-09-12T18:12:08.755498+0000","last_peered":"2024-09-12T18:12:08.755498+0000","last_clean":"2024-09-12T18:12:08.755498+0000","last_became_active":"2024-09-12T17:26:35.663472+0000","last_became_peered":"2024-09-12T17:26:35.663472+0000","last_unstale":"2024-09-12T18:12:08.755498+0000","last_undegraded":"2024-09-12T18:12:08.755498+0000","last_fullsized":"2024-09-12T18:12:08.755498+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'52","last_scrub_stamp":"2024-09-12T18:12:08.755421+0000","last_deep_scrub":"263'52","last_deep_scrub_stamp":"2024-09-12T18:12:08.755421+0000","last_clean_scrub_stamp":"2024-09-12T18:12:08.755421+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:24:53.221772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":261,"num_read_kb":192,"num_write":92,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:29.854446+0000","last_change":"2024-09-12T17:46:57.090539+0000","last_active":"2024-09-12T18:09:29.854446+0000","last_peered":"2024-09-12T18:09:29.854446+0000","last_clean":"2024-09-12T18:09:29.854446+0000","last_became_active":"2024-09-12T17:46:57.089601+0000","last_became_peered":"2024-09-12T17:46:57.089601+0000","last_unstale":"2024-09-12T18:09:29.854446+0000","last_undegraded":"2024-09-12T18:09:29.854446+0000","last_fullsized":"2024-09-12T18:09:29.854446+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:13:07.708030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"0'0","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:19.856690+0000","last_change":"2024-09-12T17:30:16.679697+0000","last_active":"2024-09-12T18:09:19.856690+0000","last_peered":"2024-09-12T18:09:19.856690+0000","last_clean":"2024-09-12T18:09:19.856690+0000","last_became_active":"2024-09-12T17:30:16.679308+0000","last_became_peered":"2024-09-12T17:30:16.679308+0000","last_unstale":"2024-09-12T18:09:19.856690+0000","last_undegraded":"2024-09-12T18:09:19.856690+0000","last_fullsized":"2024-09-12T18:09:19.856690+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:06:24.083988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"263'5","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:41.081740+0000","last_change":"2024-09-12T17:30:12.645085+0000","last_active":"2024-09-12T18:11:41.081740+0000","last_peered":"2024-09-12T18:11:41.081740+0000","last_clean":"2024-09-12T18:11:41.081740+0000","last_became_active":"2024-09-12T17:30:12.644792+0000","last_became_peered":"2024-09-12T17:30:12.644792+0000","last_unstale":"2024-09-12T18:11:41.081740+0000","last_undegraded":"2024-09-12T18:11:41.081740+0000","last_fullsized":"2024-09-12T18:11:41.081740+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:25:31.260415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6192,"num_write":5,"num_write_kb":6192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"263'30","reported_seq":150,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:24.657406+0000","last_change":"2024-09-12T18:12:24.657406+0000","last_active":"2024-09-12T18:12:24.657406+0000","last_peered":"2024-09-12T18:12:24.657406+0000","last_clean":"2024-09-12T18:12:24.657406+0000","last_became_active":"2024-09-12T17:26:35.667655+0000","last_became_peered":"2024-09-12T17:26:35.667655+0000","last_unstale":"2024-09-12T18:12:24.657406+0000","last_undegraded":"2024-09-12T18:12:24.657406+0000","last_fullsized":"2024-09-12T18:12:24.657406+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'30","last_scrub_stamp":"2024-09-12T18:12:24.657320+0000","last_deep_scrub":"263'30","last_deep_scrub_stamp":"2024-09-12T18:12:24.657320+0000","last_clean_scrub_stamp":"2024-09-12T18:12:24.657320+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:14:21.792764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":166,"num_read_kb":116,"num_write":53,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:34.859718+0000","last_change":"2024-09-12T17:46:57.090843+0000","last_active":"2024-09-12T18:09:34.859718+0000","last_peered":"2024-09-12T18:09:34.859718+0000","last_clean":"2024-09-12T18:09:34.859718+0000","last_became_active":"2024-09-12T17:46:57.090477+0000","last_became_peered":"2024-09-12T17:46:57.090477+0000","last_unstale":"2024-09-12T18:09:34.859718+0000","last_undegraded":"2024-09-12T18:09:34.859718+0000","last_fullsized":"2024-09-12T18:09:34.859718+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"260'8","reported_seq":57,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:19.857045+0000","last_change":"2024-09-12T17:30:16.673290+0000","last_active":"2024-09-12T18:09:19.857045+0000","last_peered":"2024-09-12T18:09:19.857045+0000","last_clean":"2024-09-12T18:09:19.857045+0000","last_became_active":"2024-09-12T17:30:16.672989+0000","last_became_peered":"2024-09-12T17:30:16.672989+0000","last_unstale":"2024-09-12T18:09:19.857045+0000","last_undegraded":"2024-09-12T18:09:19.857045+0000","last_fullsized":"2024-09-12T18:09:19.857045+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:58:17.894413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":6167,"num_write":13,"num_write_kb":6167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"263'3","reported_seq":63,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:18.515681+0000","last_change":"2024-09-12T18:12:18.515681+0000","last_active":"2024-09-12T18:12:18.515681+0000","last_peered":"2024-09-12T18:12:18.515681+0000","last_clean":"2024-09-12T18:12:18.515681+0000","last_became_active":"2024-09-12T17:30:12.641901+0000","last_became_peered":"2024-09-12T17:30:12.641901+0000","last_unstale":"2024-09-12T18:12:18.515681+0000","last_undegraded":"2024-09-12T18:12:18.515681+0000","last_fullsized":"2024-09-12T18:12:18.515681+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'3","last_scrub_stamp":"2024-09-12T18:12:18.515600+0000","last_deep_scrub":"263'3","last_deep_scrub_stamp":"2024-09-12T18:12:18.515600+0000","last_clean_scrub_stamp":"2024-09-12T18:12:18.515600+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:31:33.540827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"263'9","reported_seq":87,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:23.490308+0000","last_change":"2024-09-12T18:12:23.490308+0000","last_active":"2024-09-12T18:12:23.490308+0000","last_peered":"2024-09-12T18:12:23.490308+0000","last_clean":"2024-09-12T18:12:23.490308+0000","last_became_active":"2024-09-12T17:26:35.655307+0000","last_became_peered":"2024-09-12T17:26:35.655307+0000","last_unstale":"2024-09-12T18:12:23.490308+0000","last_undegraded":"2024-09-12T18:12:23.490308+0000","last_fullsized":"2024-09-12T18:12:23.490308+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'9","last_scrub_stamp":"2024-09-12T18:12:23.490216+0000","last_deep_scrub":"263'9","last_deep_scrub_stamp":"2024-09-12T18:12:23.490216+0000","last_clean_scrub_stamp":"2024-09-12T18:12:23.490216+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:14:25.755383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":30,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"263'1","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:29.858857+0000","last_change":"2024-09-12T17:46:57.086405+0000","last_active":"2024-09-12T18:09:29.858857+0000","last_peered":"2024-09-12T18:09:29.858857+0000","last_clean":"2024-09-12T18:09:29.858857+0000","last_became_active":"2024-09-12T17:46:57.086116+0000","last_became_peered":"2024-09-12T17:46:57.086116+0000","last_unstale":"2024-09-12T18:09:29.858857+0000","last_undegraded":"2024-09-12T18:09:29.858857+0000","last_fullsized":"2024-09-12T18:09:29.858857+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:36:48.862604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:20.506619+0000","last_change":"2024-09-12T18:12:20.506619+0000","last_active":"2024-09-12T18:12:20.506619+0000","last_peered":"2024-09-12T18:12:20.506619+0000","last_clean":"2024-09-12T18:12:20.506619+0000","last_became_active":"2024-09-12T17:30:16.675243+0000","last_became_peered":"2024-09-12T17:30:16.675243+0000","last_unstale":"2024-09-12T18:12:20.506619+0000","last_undegraded":"2024-09-12T18:12:20.506619+0000","last_fullsized":"2024-09-12T18:12:20.506619+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:20.506497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:20.506497+0000","last_clean_scrub_stamp":"2024-09-12T18:12:20.506497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:52:49.404441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"263'2","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:34.752954+0000","last_change":"2024-09-12T17:30:12.641067+0000","last_active":"2024-09-12T18:11:34.752954+0000","last_peered":"2024-09-12T18:11:34.752954+0000","last_clean":"2024-09-12T18:11:34.752954+0000","last_became_active":"2024-09-12T17:30:12.640736+0000","last_became_peered":"2024-09-12T17:30:12.640736+0000","last_unstale":"2024-09-12T18:11:34.752954+0000","last_undegraded":"2024-09-12T18:11:34.752954+0000","last_fullsized":"2024-09-12T18:11:34.752954+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:58:18.939586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"0'0","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:54.857716+0000","last_change":"2024-09-12T17:26:35.656429+0000","last_active":"2024-09-12T18:09:54.857716+0000","last_peered":"2024-09-12T18:09:54.857716+0000","last_clean":"2024-09-12T18:09:54.857716+0000","last_became_active":"2024-09-12T17:26:35.656149+0000","last_became_peered":"2024-09-12T17:26:35.656149+0000","last_unstale":"2024-09-12T18:09:54.857716+0000","last_undegraded":"2024-09-12T18:09:54.857716+0000","last_fullsized":"2024-09-12T18:09:54.857716+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:29.846502+0000","last_change":"2024-09-12T17:46:57.096748+0000","last_active":"2024-09-12T18:09:29.846502+0000","last_peered":"2024-09-12T18:09:29.846502+0000","last_clean":"2024-09-12T18:09:29.846502+0000","last_became_active":"2024-09-12T17:46:57.096375+0000","last_became_peered":"2024-09-12T17:46:57.096375+0000","last_unstale":"2024-09-12T18:09:29.846502+0000","last_undegraded":"2024-09-12T18:09:29.846502+0000","last_fullsized":"2024-09-12T18:09:29.846502+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"263'2","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:34.877246+0000","last_change":"2024-09-12T17:30:16.686958+0000","last_active":"2024-09-12T18:11:34.877246+0000","last_peered":"2024-09-12T18:11:34.877246+0000","last_clean":"2024-09-12T18:11:34.877246+0000","last_became_active":"2024-09-12T17:30:16.686562+0000","last_became_peered":"2024-09-12T17:30:16.686562+0000","last_unstale":"2024-09-12T18:11:34.877246+0000","last_undegraded":"2024-09-12T18:11:34.877246+0000","last_fullsized":"2024-09-12T18:11:34.877246+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:17:00.235108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"263'5","reported_seq":63,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:23.372119+0000","last_change":"2024-09-12T18:12:23.372119+0000","last_active":"2024-09-12T18:12:23.372119+0000","last_peered":"2024-09-12T18:12:23.372119+0000","last_clean":"2024-09-12T18:12:23.372119+0000","last_became_active":"2024-09-12T17:30:12.644490+0000","last_became_peered":"2024-09-12T17:30:12.644490+0000","last_unstale":"2024-09-12T18:12:23.372119+0000","last_undegraded":"2024-09-12T18:12:23.372119+0000","last_fullsized":"2024-09-12T18:12:23.372119+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'5","last_scrub_stamp":"2024-09-12T18:12:23.372029+0000","last_deep_scrub":"263'5","last_deep_scrub_stamp":"2024-09-12T18:12:23.372029+0000","last_clean_scrub_stamp":"2024-09-12T18:12:23.372029+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:38:33.548751+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":9216,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"263'23","reported_seq":124,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:13.553880+0000","last_change":"2024-09-12T18:12:13.553880+0000","last_active":"2024-09-12T18:12:13.553880+0000","last_peered":"2024-09-12T18:12:13.553880+0000","last_clean":"2024-09-12T18:12:13.553880+0000","last_became_active":"2024-09-12T17:26:35.664849+0000","last_became_peered":"2024-09-12T17:26:35.664849+0000","last_unstale":"2024-09-12T18:12:13.553880+0000","last_undegraded":"2024-09-12T18:12:13.553880+0000","last_fullsized":"2024-09-12T18:12:13.553880+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'23","last_scrub_stamp":"2024-09-12T18:12:13.553786+0000","last_deep_scrub":"263'23","last_deep_scrub_stamp":"2024-09-12T18:12:13.553786+0000","last_clean_scrub_stamp":"2024-09-12T18:12:13.553786+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:38:52.170139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":79,"num_write":44,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:54.863875+0000","last_change":"2024-09-12T17:46:57.089388+0000","last_active":"2024-09-12T18:09:54.863875+0000","last_peered":"2024-09-12T18:09:54.863875+0000","last_clean":"2024-09-12T18:09:54.863875+0000","last_became_active":"2024-09-12T17:46:57.089081+0000","last_became_peered":"2024-09-12T17:46:57.089081+0000","last_unstale":"2024-09-12T18:09:54.863875+0000","last_undegraded":"2024-09-12T18:09:54.863875+0000","last_fullsized":"2024-09-12T18:09:54.863875+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"0'0","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:59.850292+0000","last_change":"2024-09-12T17:30:16.681225+0000","last_active":"2024-09-12T18:09:59.850292+0000","last_peered":"2024-09-12T18:09:59.850292+0000","last_clean":"2024-09-12T18:09:59.850292+0000","last_became_active":"2024-09-12T17:30:16.680901+0000","last_became_peered":"2024-09-12T17:30:16.680901+0000","last_unstale":"2024-09-12T18:09:59.850292+0000","last_undegraded":"2024-09-12T18:09:59.850292+0000","last_fullsized":"2024-09-12T18:09:59.850292+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"0'0","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:49.863301+0000","last_change":"2024-09-12T17:30:12.649239+0000","last_active":"2024-09-12T18:09:49.863301+0000","last_peered":"2024-09-12T18:09:49.863301+0000","last_clean":"2024-09-12T18:09:49.863301+0000","last_became_active":"2024-09-12T17:30:12.648875+0000","last_became_peered":"2024-09-12T17:30:12.648875+0000","last_unstale":"2024-09-12T18:09:49.863301+0000","last_undegraded":"2024-09-12T18:09:49.863301+0000","last_fullsized":"2024-09-12T18:09:49.863301+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"263'15","reported_seq":93,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:54.849551+0000","last_change":"2024-09-12T17:26:35.668474+0000","last_active":"2024-09-12T18:09:54.849551+0000","last_peered":"2024-09-12T18:09:54.849551+0000","last_clean":"2024-09-12T18:09:54.849551+0000","last_became_active":"2024-09-12T17:26:35.668118+0000","last_became_peered":"2024-09-12T17:26:35.668118+0000","last_unstale":"2024-09-12T18:09:54.849551+0000","last_undegraded":"2024-09-12T18:09:54.849551+0000","last_fullsized":"2024-09-12T18:09:54.849551+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:26:34.641203+0000","last_clean_scrub_stamp":"2024-09-12T17:26:34.641203+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":44,"num_write":31,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:54.862677+0000","last_change":"2024-09-12T17:46:57.086214+0000","last_active":"2024-09-12T18:09:54.862677+0000","last_peered":"2024-09-12T18:09:54.862677+0000","last_clean":"2024-09-12T18:09:54.862677+0000","last_became_active":"2024-09-12T17:46:57.085922+0000","last_became_peered":"2024-09-12T17:46:57.085922+0000","last_unstale":"2024-09-12T18:09:54.862677+0000","last_undegraded":"2024-09-12T18:09:54.862677+0000","last_fullsized":"2024-09-12T18:09:54.862677+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"263'6","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:41.255837+0000","last_change":"2024-09-12T17:30:16.669329+0000","last_active":"2024-09-12T18:11:41.255837+0000","last_peered":"2024-09-12T18:11:41.255837+0000","last_clean":"2024-09-12T18:11:41.255837+0000","last_became_active":"2024-09-12T17:30:16.668999+0000","last_became_peered":"2024-09-12T17:30:16.668999+0000","last_unstale":"2024-09-12T18:11:41.255837+0000","last_undegraded":"2024-09-12T18:11:41.255837+0000","last_fullsized":"2024-09-12T18:11:41.255837+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":12288,"num_write":11,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"0'0","reported_seq":57,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:09.725063+0000","last_change":"2024-09-12T18:12:09.725063+0000","last_active":"2024-09-12T18:12:09.725063+0000","last_peered":"2024-09-12T18:12:09.725063+0000","last_clean":"2024-09-12T18:12:09.725063+0000","last_became_active":"2024-09-12T17:30:12.649350+0000","last_became_peered":"2024-09-12T17:30:12.649350+0000","last_unstale":"2024-09-12T18:12:09.725063+0000","last_undegraded":"2024-09-12T18:12:09.725063+0000","last_fullsized":"2024-09-12T18:12:09.725063+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:09.724971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:09.724971+0000","last_clean_scrub_stamp":"2024-09-12T18:12:09.724971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:05:18.085102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"263'20","reported_seq":124,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:12.583591+0000","last_change":"2024-09-12T18:12:12.583591+0000","last_active":"2024-09-12T18:12:12.583591+0000","last_peered":"2024-09-12T18:12:12.583591+0000","last_clean":"2024-09-12T18:12:12.583591+0000","last_became_active":"2024-09-12T17:26:35.667060+0000","last_became_peered":"2024-09-12T17:26:35.667060+0000","last_unstale":"2024-09-12T18:12:12.583591+0000","last_undegraded":"2024-09-12T18:12:12.583591+0000","last_fullsized":"2024-09-12T18:12:12.583591+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'20","last_scrub_stamp":"2024-09-12T18:12:12.583489+0000","last_deep_scrub":"263'20","last_deep_scrub_stamp":"2024-09-12T18:12:12.583489+0000","last_clean_scrub_stamp":"2024-09-12T18:12:12.583489+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:09:58.254956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":80,"num_write":36,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:00.146690+0000","last_change":"2024-09-12T17:46:57.078643+0000","last_active":"2024-09-12T18:09:00.146690+0000","last_peered":"2024-09-12T18:09:00.146690+0000","last_clean":"2024-09-12T18:09:00.146690+0000","last_became_active":"2024-09-12T17:46:57.076358+0000","last_became_peered":"2024-09-12T17:46:57.076358+0000","last_unstale":"2024-09-12T18:09:00.146690+0000","last_undegraded":"2024-09-12T18:09:00.146690+0000","last_fullsized":"2024-09-12T18:09:00.146690+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:22:38.368544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"260'3","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:19.857246+0000","last_change":"2024-09-12T17:30:16.676537+0000","last_active":"2024-09-12T18:09:19.857246+0000","last_peered":"2024-09-12T18:09:19.857246+0000","last_clean":"2024-09-12T18:09:19.857246+0000","last_became_active":"2024-09-12T17:30:16.676187+0000","last_became_peered":"2024-09-12T17:30:16.676187+0000","last_unstale":"2024-09-12T18:09:19.857246+0000","last_undegraded":"2024-09-12T18:09:19.857246+0000","last_fullsized":"2024-09-12T18:09:19.857246+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:03:12.668403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"263'5","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:24.875282+0000","last_change":"2024-09-12T17:30:12.651492+0000","last_active":"2024-09-12T18:11:24.875282+0000","last_peered":"2024-09-12T18:11:24.875282+0000","last_clean":"2024-09-12T18:11:24.875282+0000","last_became_active":"2024-09-12T17:30:12.651254+0000","last_became_peered":"2024-09-12T17:30:12.651254+0000","last_unstale":"2024-09-12T18:11:24.875282+0000","last_undegraded":"2024-09-12T18:11:24.875282+0000","last_fullsized":"2024-09-12T18:11:24.875282+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:54:45.814379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":16,"num_write":10,"num_write_kb":1040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"263'21","reported_seq":114,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:22.507599+0000","last_change":"2024-09-12T18:12:22.507599+0000","last_active":"2024-09-12T18:12:22.507599+0000","last_peered":"2024-09-12T18:12:22.507599+0000","last_clean":"2024-09-12T18:12:22.507599+0000","last_became_active":"2024-09-12T17:26:35.660521+0000","last_became_peered":"2024-09-12T17:26:35.660521+0000","last_unstale":"2024-09-12T18:12:22.507599+0000","last_undegraded":"2024-09-12T18:12:22.507599+0000","last_fullsized":"2024-09-12T18:12:22.507599+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'21","last_scrub_stamp":"2024-09-12T18:12:22.507515+0000","last_deep_scrub":"263'21","last_deep_scrub_stamp":"2024-09-12T18:12:22.507515+0000","last_clean_scrub_stamp":"2024-09-12T18:12:22.507515+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:47:17.016996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":60,"num_write":47,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:54.862197+0000","last_change":"2024-09-12T17:46:57.076516+0000","last_active":"2024-09-12T18:09:54.862197+0000","last_peered":"2024-09-12T18:09:54.862197+0000","last_clean":"2024-09-12T18:09:54.862197+0000","last_became_active":"2024-09-12T17:46:57.075936+0000","last_became_peered":"2024-09-12T17:46:57.075936+0000","last_unstale":"2024-09-12T18:09:54.862197+0000","last_undegraded":"2024-09-12T18:09:54.862197+0000","last_fullsized":"2024-09-12T18:09:54.862197+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"0'0","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:19.856809+0000","last_change":"2024-09-12T17:30:16.671561+0000","last_active":"2024-09-12T18:09:19.856809+0000","last_peered":"2024-09-12T18:09:19.856809+0000","last_clean":"2024-09-12T18:09:19.856809+0000","last_became_active":"2024-09-12T17:30:16.671232+0000","last_became_peered":"2024-09-12T17:30:16.671232+0000","last_unstale":"2024-09-12T18:09:19.856809+0000","last_undegraded":"2024-09-12T18:09:19.856809+0000","last_fullsized":"2024-09-12T18:09:19.856809+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:01:53.261691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"260'3","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:14.856411+0000","last_change":"2024-09-12T17:30:12.652805+0000","last_active":"2024-09-12T18:09:14.856411+0000","last_peered":"2024-09-12T18:09:14.856411+0000","last_clean":"2024-09-12T18:09:14.856411+0000","last_became_active":"2024-09-12T17:30:12.652439+0000","last_became_peered":"2024-09-12T17:30:12.652439+0000","last_unstale":"2024-09-12T18:09:14.856411+0000","last_undegraded":"2024-09-12T18:09:14.856411+0000","last_fullsized":"2024-09-12T18:09:14.856411+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:38:28.870273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"263'34","reported_seq":153,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:15.511548+0000","last_change":"2024-09-12T18:12:15.511485+0000","last_active":"2024-09-12T18:12:15.511548+0000","last_peered":"2024-09-12T18:12:15.511548+0000","last_clean":"2024-09-12T18:12:15.511548+0000","last_became_active":"2024-09-12T17:26:35.664338+0000","last_became_peered":"2024-09-12T17:26:35.664338+0000","last_unstale":"2024-09-12T18:12:15.511548+0000","last_undegraded":"2024-09-12T18:12:15.511548+0000","last_fullsized":"2024-09-12T18:12:15.511548+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'34","last_scrub_stamp":"2024-09-12T18:12:15.511396+0000","last_deep_scrub":"263'34","last_deep_scrub_stamp":"2024-09-12T18:12:15.511396+0000","last_clean_scrub_stamp":"2024-09-12T18:12:15.511396+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:16:09.172708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":161,"num_read_kb":109,"num_write":67,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"263'2","reported_seq":34,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:15.758583+0000","last_change":"2024-09-12T18:12:15.758583+0000","last_active":"2024-09-12T18:12:15.758583+0000","last_peered":"2024-09-12T18:12:15.758583+0000","last_clean":"2024-09-12T18:12:15.758583+0000","last_became_active":"2024-09-12T17:46:57.090581+0000","last_became_peered":"2024-09-12T17:46:57.090581+0000","last_unstale":"2024-09-12T18:12:15.758583+0000","last_undegraded":"2024-09-12T18:12:15.758583+0000","last_fullsized":"2024-09-12T18:12:15.758583+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T18:12:15.758494+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T18:12:15.758494+0000","last_clean_scrub_stamp":"2024-09-12T18:12:15.758494+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:09:12.754977+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"260'3","reported_seq":57,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:21.525649+0000","last_change":"2024-09-12T18:12:21.525649+0000","last_active":"2024-09-12T18:12:21.525649+0000","last_peered":"2024-09-12T18:12:21.525649+0000","last_clean":"2024-09-12T18:12:21.525649+0000","last_became_active":"2024-09-12T17:30:16.677428+0000","last_became_peered":"2024-09-12T17:30:16.677428+0000","last_unstale":"2024-09-12T18:12:21.525649+0000","last_undegraded":"2024-09-12T18:12:21.525649+0000","last_fullsized":"2024-09-12T18:12:21.525649+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'3","last_scrub_stamp":"2024-09-12T18:12:21.525552+0000","last_deep_scrub":"260'3","last_deep_scrub_stamp":"2024-09-12T18:12:21.525552+0000","last_clean_scrub_stamp":"2024-09-12T18:12:21.525552+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:59:26.387358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"263'6","reported_seq":60,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:41.338518+0000","last_change":"2024-09-12T17:30:12.644935+0000","last_active":"2024-09-12T18:11:41.338518+0000","last_peered":"2024-09-12T18:11:41.338518+0000","last_clean":"2024-09-12T18:11:41.338518+0000","last_became_active":"2024-09-12T17:30:12.644600+0000","last_became_peered":"2024-09-12T17:30:12.644600+0000","last_unstale":"2024-09-12T18:11:41.338518+0000","last_undegraded":"2024-09-12T18:11:41.338518+0000","last_fullsized":"2024-09-12T18:11:41.338518+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6144,"num_write":11,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"263'63","reported_seq":241,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:24.411880+0000","last_change":"2024-09-12T18:12:24.411785+0000","last_active":"2024-09-12T18:12:24.411880+0000","last_peered":"2024-09-12T18:12:24.411880+0000","last_clean":"2024-09-12T18:12:24.411880+0000","last_became_active":"2024-09-12T17:26:35.658630+0000","last_became_peered":"2024-09-12T17:26:35.658630+0000","last_unstale":"2024-09-12T18:12:24.411880+0000","last_undegraded":"2024-09-12T18:12:24.411880+0000","last_fullsized":"2024-09-12T18:12:24.411880+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'63","last_scrub_stamp":"2024-09-12T18:12:24.411691+0000","last_deep_scrub":"263'63","last_deep_scrub_stamp":"2024-09-12T18:12:24.411691+0000","last_clean_scrub_stamp":"2024-09-12T18:12:24.411691+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:24:29.577243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":336,"num_read_kb":235,"num_write":105,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:39.840111+0000","last_change":"2024-09-12T17:46:57.093471+0000","last_active":"2024-09-12T18:08:39.840111+0000","last_peered":"2024-09-12T18:08:39.840111+0000","last_clean":"2024-09-12T18:08:39.840111+0000","last_became_active":"2024-09-12T17:46:57.092472+0000","last_became_peered":"2024-09-12T17:46:57.092472+0000","last_unstale":"2024-09-12T18:08:39.840111+0000","last_undegraded":"2024-09-12T18:08:39.840111+0000","last_fullsized":"2024-09-12T18:08:39.840111+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:53:15.268714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"0'0","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:34.849448+0000","last_change":"2024-09-12T17:30:16.675715+0000","last_active":"2024-09-12T18:08:34.849448+0000","last_peered":"2024-09-12T18:08:34.849448+0000","last_clean":"2024-09-12T18:08:34.849448+0000","last_became_active":"2024-09-12T17:30:16.675380+0000","last_became_peered":"2024-09-12T17:30:16.675380+0000","last_unstale":"2024-09-12T18:08:34.849448+0000","last_undegraded":"2024-09-12T18:08:34.849448+0000","last_fullsized":"2024-09-12T18:08:34.849448+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:03:46.402687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"0'0","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:49.863251+0000","last_change":"2024-09-12T17:30:12.652798+0000","last_active":"2024-09-12T18:09:49.863251+0000","last_peered":"2024-09-12T18:09:49.863251+0000","last_clean":"2024-09-12T18:09:49.863251+0000","last_became_active":"2024-09-12T17:30:12.652368+0000","last_became_peered":"2024-09-12T17:30:12.652368+0000","last_unstale":"2024-09-12T18:09:49.863251+0000","last_undegraded":"2024-09-12T18:09:49.863251+0000","last_fullsized":"2024-09-12T18:09:49.863251+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:11.622113+0000","last_clean_scrub_stamp":"2024-09-12T17:30:11.622113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"263'14","reported_seq":101,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:22.323445+0000","last_change":"2024-09-12T18:12:22.323379+0000","last_active":"2024-09-12T18:12:22.323445+0000","last_peered":"2024-09-12T18:12:22.323445+0000","last_clean":"2024-09-12T18:12:22.323445+0000","last_became_active":"2024-09-12T17:26:35.662029+0000","last_became_peered":"2024-09-12T17:26:35.662029+0000","last_unstale":"2024-09-12T18:12:22.323445+0000","last_undegraded":"2024-09-12T18:12:22.323445+0000","last_fullsized":"2024-09-12T18:12:22.323445+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'14","last_scrub_stamp":"2024-09-12T18:12:22.323289+0000","last_deep_scrub":"263'14","last_deep_scrub_stamp":"2024-09-12T18:12:22.323289+0000","last_clean_scrub_stamp":"2024-09-12T18:12:22.323289+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:47:18.514415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":47,"num_write":25,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:54.849471+0000","last_change":"2024-09-12T17:46:57.088925+0000","last_active":"2024-09-12T18:09:54.849471+0000","last_peered":"2024-09-12T18:09:54.849471+0000","last_clean":"2024-09-12T18:09:54.849471+0000","last_became_active":"2024-09-12T17:46:57.088577+0000","last_became_peered":"2024-09-12T17:46:57.088577+0000","last_unstale":"2024-09-12T18:09:54.849471+0000","last_undegraded":"2024-09-12T18:09:54.849471+0000","last_fullsized":"2024-09-12T18:09:54.849471+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"263'5","reported_seq":61,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:18.654230+0000","last_change":"2024-09-12T18:12:18.654230+0000","last_active":"2024-09-12T18:12:18.654230+0000","last_peered":"2024-09-12T18:12:18.654230+0000","last_clean":"2024-09-12T18:12:18.654230+0000","last_became_active":"2024-09-12T17:30:16.687560+0000","last_became_peered":"2024-09-12T17:30:16.687560+0000","last_unstale":"2024-09-12T18:12:18.654230+0000","last_undegraded":"2024-09-12T18:12:18.654230+0000","last_fullsized":"2024-09-12T18:12:18.654230+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'5","last_scrub_stamp":"2024-09-12T18:12:18.654153+0000","last_deep_scrub":"263'5","last_deep_scrub_stamp":"2024-09-12T18:12:18.654153+0000","last_clean_scrub_stamp":"2024-09-12T18:12:18.654153+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:46:55.281106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":15360,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"260'5","reported_seq":72,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:17.476656+0000","last_change":"2024-09-12T18:12:17.476656+0000","last_active":"2024-09-12T18:12:17.476656+0000","last_peered":"2024-09-12T18:12:17.476656+0000","last_clean":"2024-09-12T18:12:17.476656+0000","last_became_active":"2024-09-12T17:30:12.646002+0000","last_became_peered":"2024-09-12T17:30:12.646002+0000","last_unstale":"2024-09-12T18:12:17.476656+0000","last_undegraded":"2024-09-12T18:12:17.476656+0000","last_fullsized":"2024-09-12T18:12:17.476656+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'5","last_scrub_stamp":"2024-09-12T18:12:17.476540+0000","last_deep_scrub":"260'5","last_deep_scrub_stamp":"2024-09-12T18:12:17.476540+0000","last_clean_scrub_stamp":"2024-09-12T18:12:17.476540+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:48:06.819743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"263'38","reported_seq":171,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:11.616871+0000","last_change":"2024-09-12T18:12:11.616755+0000","last_active":"2024-09-12T18:12:11.616871+0000","last_peered":"2024-09-12T18:12:11.616871+0000","last_clean":"2024-09-12T18:12:11.616871+0000","last_became_active":"2024-09-12T17:26:35.664653+0000","last_became_peered":"2024-09-12T17:26:35.664653+0000","last_unstale":"2024-09-12T18:12:11.616871+0000","last_undegraded":"2024-09-12T18:12:11.616871+0000","last_fullsized":"2024-09-12T18:12:11.616871+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'38","last_scrub_stamp":"2024-09-12T18:12:11.616608+0000","last_deep_scrub":"263'38","last_deep_scrub_stamp":"2024-09-12T18:12:11.616608+0000","last_clean_scrub_stamp":"2024-09-12T18:12:11.616608+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:41:05.918325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":203,"num_read_kb":159,"num_write":60,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:59.864521+0000","last_change":"2024-09-12T17:46:57.092076+0000","last_active":"2024-09-12T18:09:59.864521+0000","last_peered":"2024-09-12T18:09:59.864521+0000","last_clean":"2024-09-12T18:09:59.864521+0000","last_became_active":"2024-09-12T17:46:57.091489+0000","last_became_peered":"2024-09-12T17:46:57.091489+0000","last_unstale":"2024-09-12T18:09:59.864521+0000","last_undegraded":"2024-09-12T18:09:59.864521+0000","last_fullsized":"2024-09-12T18:09:59.864521+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"263'2","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:41.097801+0000","last_change":"2024-09-12T17:30:16.671442+0000","last_active":"2024-09-12T18:11:41.097801+0000","last_peered":"2024-09-12T18:11:41.097801+0000","last_clean":"2024-09-12T18:11:41.097801+0000","last_became_active":"2024-09-12T17:30:16.671126+0000","last_became_peered":"2024-09-12T17:30:16.671126+0000","last_unstale":"2024-09-12T18:11:41.097801+0000","last_undegraded":"2024-09-12T18:11:41.097801+0000","last_fullsized":"2024-09-12T18:11:41.097801+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:15.649995+0000","last_clean_scrub_stamp":"2024-09-12T17:30:15.649995+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":48,"num_write":2,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"260'3","reported_seq":63,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:16.609368+0000","last_change":"2024-09-12T18:12:16.609368+0000","last_active":"2024-09-12T18:12:16.609368+0000","last_peered":"2024-09-12T18:12:16.609368+0000","last_clean":"2024-09-12T18:12:16.609368+0000","last_became_active":"2024-09-12T17:30:12.645099+0000","last_became_peered":"2024-09-12T17:30:12.645099+0000","last_unstale":"2024-09-12T18:12:16.609368+0000","last_undegraded":"2024-09-12T18:12:16.609368+0000","last_fullsized":"2024-09-12T18:12:16.609368+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'3","last_scrub_stamp":"2024-09-12T18:12:16.609282+0000","last_deep_scrub":"260'3","last_deep_scrub_stamp":"2024-09-12T18:12:16.609282+0000","last_clean_scrub_stamp":"2024-09-12T18:12:16.609282+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:11:33.924154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"263'42","reported_seq":175,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:21.512736+0000","last_change":"2024-09-12T18:12:21.512736+0000","last_active":"2024-09-12T18:12:21.512736+0000","last_peered":"2024-09-12T18:12:21.512736+0000","last_clean":"2024-09-12T18:12:21.512736+0000","last_became_active":"2024-09-12T17:26:35.665804+0000","last_became_peered":"2024-09-12T17:26:35.665804+0000","last_unstale":"2024-09-12T18:12:21.512736+0000","last_undegraded":"2024-09-12T18:12:21.512736+0000","last_fullsized":"2024-09-12T18:12:21.512736+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'42","last_scrub_stamp":"2024-09-12T18:12:21.512648+0000","last_deep_scrub":"263'42","last_deep_scrub_stamp":"2024-09-12T18:12:21.512648+0000","last_clean_scrub_stamp":"2024-09-12T18:12:21.512648+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:22:38.597683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":202,"num_read_kb":139,"num_write":84,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"263'208","reported_seq":819,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:00.542681+0000","last_change":"2024-09-12T18:12:00.542681+0000","last_active":"2024-09-12T18:12:00.542681+0000","last_peered":"2024-09-12T18:12:00.542681+0000","last_clean":"2024-09-12T18:12:00.542681+0000","last_became_active":"2024-09-12T17:10:42.523450+0000","last_became_peered":"2024-09-12T17:10:42.523450+0000","last_unstale":"2024-09-12T18:12:00.542681+0000","last_undegraded":"2024-09-12T18:12:00.542681+0000","last_fullsized":"2024-09-12T18:12:00.542681+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'208","last_scrub_stamp":"2024-09-12T18:12:00.542555+0000","last_deep_scrub":"263'208","last_deep_scrub_stamp":"2024-09-12T18:12:00.542555+0000","last_clean_scrub_stamp":"2024-09-12T18:12:00.542555+0000","objects_scrubbed":4,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:08:21.396379+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2159819,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":364,"num_read_kb":12797,"num_write":994,"num_write_kb":38748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0,5],"acting":[7,6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"263'415","reported_seq":1937,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:58.360923+0000","last_change":"2024-09-12T18:11:58.360923+0000","last_active":"2024-09-12T18:11:58.360923+0000","last_peered":"2024-09-12T18:11:58.360923+0000","last_clean":"2024-09-12T18:11:58.360923+0000","last_became_active":"2024-09-12T17:10:44.521072+0000","last_became_peered":"2024-09-12T17:10:44.521072+0000","last_unstale":"2024-09-12T18:11:58.360923+0000","last_undegraded":"2024-09-12T18:11:58.360923+0000","last_fullsized":"2024-09-12T18:11:58.360923+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'415","last_scrub_stamp":"2024-09-12T18:11:58.360809+0000","last_deep_scrub":"263'415","last_deep_scrub_stamp":"2024-09-12T18:11:58.360809+0000","last_clean_scrub_stamp":"2024-09-12T18:11:58.360809+0000","objects_scrubbed":7,"log_size":15,"log_dups_size":400,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:24:00.846126+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2237,"num_read_kb":2119,"num_write":474,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1856,"num_omap_keys":8,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"263'162","reported_seq":806,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:51.665824+0000","last_change":"2024-09-12T18:11:51.665824+0000","last_active":"2024-09-12T18:11:51.665824+0000","last_peered":"2024-09-12T18:11:51.665824+0000","last_clean":"2024-09-12T18:11:51.665824+0000","last_became_active":"2024-09-12T17:10:42.515714+0000","last_became_peered":"2024-09-12T17:10:42.515714+0000","last_unstale":"2024-09-12T18:11:51.665824+0000","last_undegraded":"2024-09-12T18:11:51.665824+0000","last_fullsized":"2024-09-12T18:11:51.665824+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'162","last_scrub_stamp":"2024-09-12T18:11:51.665727+0000","last_deep_scrub":"263'162","last_deep_scrub_stamp":"2024-09-12T18:11:51.665727+0000","last_clean_scrub_stamp":"2024-09-12T18:11:51.665727+0000","objects_scrubbed":1,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:41:53.425835+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32998,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":410,"num_read_kb":24642,"num_write":804,"num_write_kb":5824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6,4],"acting":[1,0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"263'569","reported_seq":2045,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:04.589219+0000","last_change":"2024-09-12T18:12:04.589219+0000","last_active":"2024-09-12T18:12:04.589219+0000","last_peered":"2024-09-12T18:12:04.589219+0000","last_clean":"2024-09-12T18:12:04.589219+0000","last_became_active":"2024-09-12T17:10:44.520662+0000","last_became_peered":"2024-09-12T17:10:44.520662+0000","last_unstale":"2024-09-12T18:12:04.589219+0000","last_undegraded":"2024-09-12T18:12:04.589219+0000","last_fullsized":"2024-09-12T18:12:04.589219+0000","mapping_epoch":26,"log_start":"263'500","ondisk_log_start":"263'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'569","last_scrub_stamp":"2024-09-12T18:12:04.589126+0000","last_deep_scrub":"263'569","last_deep_scrub_stamp":"2024-09-12T18:12:04.589126+0000","last_clean_scrub_stamp":"2024-09-12T18:12:04.589126+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":500,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:21:58.586995+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2846,"num_read_kb":2568,"num_write":745,"num_write_kb":247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"263'196","reported_seq":890,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:52.688218+0000","last_change":"2024-09-12T18:11:52.688218+0000","last_active":"2024-09-12T18:11:52.688218+0000","last_peered":"2024-09-12T18:11:52.688218+0000","last_clean":"2024-09-12T18:11:52.688218+0000","last_became_active":"2024-09-12T17:10:42.514502+0000","last_became_peered":"2024-09-12T17:10:42.514502+0000","last_unstale":"2024-09-12T18:11:52.688218+0000","last_undegraded":"2024-09-12T18:11:52.688218+0000","last_fullsized":"2024-09-12T18:11:52.688218+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'196","last_scrub_stamp":"2024-09-12T18:11:52.688106+0000","last_deep_scrub":"263'196","last_deep_scrub_stamp":"2024-09-12T18:11:52.688106+0000","last_clean_scrub_stamp":"2024-09-12T18:11:52.688106+0000","objects_scrubbed":4,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:28:08.638670+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":373080,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":506,"num_read_kb":116995,"num_write":945,"num_write_kb":47431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,7],"acting":[0,2,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"263'513","reported_seq":2203,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:03.347220+0000","last_change":"2024-09-12T18:12:03.347220+0000","last_active":"2024-09-12T18:12:03.347220+0000","last_peered":"2024-09-12T18:12:03.347220+0000","last_clean":"2024-09-12T18:12:03.347220+0000","last_became_active":"2024-09-12T17:10:44.515053+0000","last_became_peered":"2024-09-12T17:10:44.515053+0000","last_unstale":"2024-09-12T18:12:03.347220+0000","last_undegraded":"2024-09-12T18:12:03.347220+0000","last_fullsized":"2024-09-12T18:12:03.347220+0000","mapping_epoch":26,"log_start":"263'501","ondisk_log_start":"263'501","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'513","last_scrub_stamp":"2024-09-12T18:12:03.347112+0000","last_deep_scrub":"263'513","last_deep_scrub_stamp":"2024-09-12T18:12:03.347112+0000","last_clean_scrub_stamp":"2024-09-12T18:12:03.347112+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":501,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:41:45.556810+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2823,"num_read_kb":2642,"num_write":595,"num_write_kb":151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2296,"num_omap_keys":9,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"263'186","reported_seq":819,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:59.404105+0000","last_change":"2024-09-12T18:11:59.404105+0000","last_active":"2024-09-12T18:11:59.404105+0000","last_peered":"2024-09-12T18:11:59.404105+0000","last_clean":"2024-09-12T18:11:59.404105+0000","last_became_active":"2024-09-12T17:10:42.515202+0000","last_became_peered":"2024-09-12T17:10:42.515202+0000","last_unstale":"2024-09-12T18:11:59.404105+0000","last_undegraded":"2024-09-12T18:11:59.404105+0000","last_fullsized":"2024-09-12T18:11:59.404105+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'186","last_scrub_stamp":"2024-09-12T18:11:59.403938+0000","last_deep_scrub":"263'186","last_deep_scrub_stamp":"2024-09-12T18:11:59.403938+0000","last_clean_scrub_stamp":"2024-09-12T18:11:59.403938+0000","objects_scrubbed":4,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:01:41.301225+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":568149,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":399,"num_read_kb":32737,"num_write":933,"num_write_kb":40819,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7,2],"acting":[5,3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"263'479","reported_seq":2065,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:01.687961+0000","last_change":"2024-09-12T18:12:01.687961+0000","last_active":"2024-09-12T18:12:01.687961+0000","last_peered":"2024-09-12T18:12:01.687961+0000","last_clean":"2024-09-12T18:12:01.687961+0000","last_became_active":"2024-09-12T17:10:44.523767+0000","last_became_peered":"2024-09-12T17:10:44.523767+0000","last_unstale":"2024-09-12T18:12:01.687961+0000","last_undegraded":"2024-09-12T18:12:01.687961+0000","last_fullsized":"2024-09-12T18:12:01.687961+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'479","last_scrub_stamp":"2024-09-12T18:12:01.687869+0000","last_deep_scrub":"263'479","last_deep_scrub_stamp":"2024-09-12T18:12:01.687869+0000","last_clean_scrub_stamp":"2024-09-12T18:12:01.687869+0000","objects_scrubbed":2,"log_size":79,"log_dups_size":400,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:06:43.686298+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2572,"num_read_kb":2417,"num_write":590,"num_write_kb":142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":254,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"263'159","reported_seq":798,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:59.549642+0000","last_change":"2024-09-12T18:11:59.549642+0000","last_active":"2024-09-12T18:11:59.549642+0000","last_peered":"2024-09-12T18:11:59.549642+0000","last_clean":"2024-09-12T18:11:59.549642+0000","last_became_active":"2024-09-12T17:10:42.523427+0000","last_became_peered":"2024-09-12T17:10:42.523427+0000","last_unstale":"2024-09-12T18:11:59.549642+0000","last_undegraded":"2024-09-12T18:11:59.549642+0000","last_fullsized":"2024-09-12T18:11:59.549642+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'159","last_scrub_stamp":"2024-09-12T18:11:59.549547+0000","last_deep_scrub":"263'159","last_deep_scrub_stamp":"2024-09-12T18:11:59.549547+0000","last_clean_scrub_stamp":"2024-09-12T18:11:59.549547+0000","objects_scrubbed":1,"log_size":59,"log_dups_size":100,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:28:15.459977+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":439,"num_read_kb":36335,"num_write":769,"num_write_kb":30424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3,6],"acting":[7,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"263'478","reported_seq":1970,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:58.695565+0000","last_change":"2024-09-12T18:11:58.695565+0000","last_active":"2024-09-12T18:11:58.695565+0000","last_peered":"2024-09-12T18:11:58.695565+0000","last_clean":"2024-09-12T18:11:58.695565+0000","last_became_active":"2024-09-12T17:10:44.510692+0000","last_became_peered":"2024-09-12T17:10:44.510692+0000","last_unstale":"2024-09-12T18:11:58.695565+0000","last_undegraded":"2024-09-12T18:11:58.695565+0000","last_fullsized":"2024-09-12T18:11:58.695565+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'478","last_scrub_stamp":"2024-09-12T18:11:58.695474+0000","last_deep_scrub":"263'478","last_deep_scrub_stamp":"2024-09-12T18:11:58.695474+0000","last_clean_scrub_stamp":"2024-09-12T18:11:58.695474+0000","objects_scrubbed":3,"log_size":78,"log_dups_size":400,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:52:06.977144+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2639,"num_read_kb":2478,"num_write":625,"num_write_kb":223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"263'191","reported_seq":825,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:05.484339+0000","last_change":"2024-09-12T18:12:05.484339+0000","last_active":"2024-09-12T18:12:05.484339+0000","last_peered":"2024-09-12T18:12:05.484339+0000","last_clean":"2024-09-12T18:12:05.484339+0000","last_became_active":"2024-09-12T17:10:42.525363+0000","last_became_peered":"2024-09-12T17:10:42.525363+0000","last_unstale":"2024-09-12T18:12:05.484339+0000","last_undegraded":"2024-09-12T18:12:05.484339+0000","last_fullsized":"2024-09-12T18:12:05.484339+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'191","last_scrub_stamp":"2024-09-12T18:12:05.484216+0000","last_deep_scrub":"263'191","last_deep_scrub_stamp":"2024-09-12T18:12:05.484216+0000","last_clean_scrub_stamp":"2024-09-12T18:12:05.484216+0000","objects_scrubbed":2,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:44:31.631500+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":412,"num_read_kb":34311,"num_write":954,"num_write_kb":12654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,4,1],"acting":[5,0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"263'881","reported_seq":2669,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:05.371197+0000","last_change":"2024-09-12T18:12:05.371197+0000","last_active":"2024-09-12T18:12:05.371197+0000","last_peered":"2024-09-12T18:12:05.371197+0000","last_clean":"2024-09-12T18:12:05.371197+0000","last_became_active":"2024-09-12T17:10:44.513865+0000","last_became_peered":"2024-09-12T17:10:44.513865+0000","last_unstale":"2024-09-12T18:12:05.371197+0000","last_undegraded":"2024-09-12T18:12:05.371197+0000","last_fullsized":"2024-09-12T18:12:05.371197+0000","mapping_epoch":26,"log_start":"263'800","ondisk_log_start":"263'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'881","last_scrub_stamp":"2024-09-12T18:12:05.371101+0000","last_deep_scrub":"263'881","last_deep_scrub_stamp":"2024-09-12T18:12:05.371101+0000","last_clean_scrub_stamp":"2024-09-12T18:12:05.371101+0000","objects_scrubbed":6,"log_size":81,"log_dups_size":800,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:17:06.281251+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4549,"num_read_kb":4126,"num_write":1137,"num_write_kb":421,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4852,"num_omap_keys":19,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"263'191","reported_seq":997,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:57.497338+0000","last_change":"2024-09-12T18:11:57.497338+0000","last_active":"2024-09-12T18:11:57.497338+0000","last_peered":"2024-09-12T18:11:57.497338+0000","last_clean":"2024-09-12T18:11:57.497338+0000","last_became_active":"2024-09-12T17:10:42.531356+0000","last_became_peered":"2024-09-12T17:10:42.531356+0000","last_unstale":"2024-09-12T18:11:57.497338+0000","last_undegraded":"2024-09-12T18:11:57.497338+0000","last_fullsized":"2024-09-12T18:11:57.497338+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'191","last_scrub_stamp":"2024-09-12T18:11:57.497214+0000","last_deep_scrub":"263'191","last_deep_scrub_stamp":"2024-09-12T18:11:57.497214+0000","last_clean_scrub_stamp":"2024-09-12T18:11:57.497214+0000","objects_scrubbed":6,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:44:43.318908+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":115,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":751,"num_read_kb":2366,"num_write":954,"num_write_kb":15239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4,6],"acting":[7,0,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"263'411","reported_seq":1935,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:06.455513+0000","last_change":"2024-09-12T18:12:06.455513+0000","last_active":"2024-09-12T18:12:06.455513+0000","last_peered":"2024-09-12T18:12:06.455513+0000","last_clean":"2024-09-12T18:12:06.455513+0000","last_became_active":"2024-09-12T17:10:44.520609+0000","last_became_peered":"2024-09-12T17:10:44.520609+0000","last_unstale":"2024-09-12T18:12:06.455513+0000","last_undegraded":"2024-09-12T18:12:06.455513+0000","last_fullsized":"2024-09-12T18:12:06.455513+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'411","last_scrub_stamp":"2024-09-12T18:12:06.455433+0000","last_deep_scrub":"263'411","last_deep_scrub_stamp":"2024-09-12T18:12:06.455433+0000","last_clean_scrub_stamp":"2024-09-12T18:12:06.455433+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":400,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:56:48.523620+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2177,"num_read_kb":2069,"num_write":470,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"263'212","reported_seq":854,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:00.692167+0000","last_change":"2024-09-12T18:12:00.692167+0000","last_active":"2024-09-12T18:12:00.692167+0000","last_peered":"2024-09-12T18:12:00.692167+0000","last_clean":"2024-09-12T18:12:00.692167+0000","last_became_active":"2024-09-12T17:10:42.527310+0000","last_became_peered":"2024-09-12T17:10:42.527310+0000","last_unstale":"2024-09-12T18:12:00.692167+0000","last_undegraded":"2024-09-12T18:12:00.692167+0000","last_fullsized":"2024-09-12T18:12:00.692167+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'212","last_scrub_stamp":"2024-09-12T18:12:00.692062+0000","last_deep_scrub":"263'212","last_deep_scrub_stamp":"2024-09-12T18:12:00.692062+0000","last_clean_scrub_stamp":"2024-09-12T18:12:00.692062+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:26:48.984760+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174892,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":472,"num_read_kb":11982,"num_write":996,"num_write_kb":39362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0,2],"acting":[3,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"263'806","reported_seq":2480,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:54.804326+0000","last_change":"2024-09-12T18:11:54.804326+0000","last_active":"2024-09-12T18:11:54.804326+0000","last_peered":"2024-09-12T18:11:54.804326+0000","last_clean":"2024-09-12T18:11:54.804326+0000","last_became_active":"2024-09-12T17:10:44.517947+0000","last_became_peered":"2024-09-12T17:10:44.517947+0000","last_unstale":"2024-09-12T18:11:54.804326+0000","last_undegraded":"2024-09-12T18:11:54.804326+0000","last_fullsized":"2024-09-12T18:11:54.804326+0000","mapping_epoch":26,"log_start":"263'700","ondisk_log_start":"263'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'806","last_scrub_stamp":"2024-09-12T18:11:54.804222+0000","last_deep_scrub":"263'806","last_deep_scrub_stamp":"2024-09-12T18:11:54.804222+0000","last_clean_scrub_stamp":"2024-09-12T18:11:54.804222+0000","objects_scrubbed":3,"log_size":106,"log_dups_size":700,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:45:37.385194+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3878,"num_read_kb":3536,"num_write":1022,"num_write_kb":342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"263'408","reported_seq":2034,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:02.306451+0000","last_change":"2024-09-12T18:12:02.306451+0000","last_active":"2024-09-12T18:12:02.306451+0000","last_peered":"2024-09-12T18:12:02.306451+0000","last_clean":"2024-09-12T18:12:02.306451+0000","last_became_active":"2024-09-12T17:10:44.514293+0000","last_became_peered":"2024-09-12T17:10:44.514293+0000","last_unstale":"2024-09-12T18:12:02.306451+0000","last_undegraded":"2024-09-12T18:12:02.306451+0000","last_fullsized":"2024-09-12T18:12:02.306451+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'408","last_scrub_stamp":"2024-09-12T18:12:02.306349+0000","last_deep_scrub":"263'408","last_deep_scrub_stamp":"2024-09-12T18:12:02.306349+0000","last_clean_scrub_stamp":"2024-09-12T18:12:02.306349+0000","objects_scrubbed":2,"log_size":108,"log_dups_size":300,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:44:20.245957+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2470,"num_read_kb":2366,"num_write":468,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":694,"num_omap_keys":3,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"263'164","reported_seq":785,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:56.470083+0000","last_change":"2024-09-12T18:11:56.470083+0000","last_active":"2024-09-12T18:11:56.470083+0000","last_peered":"2024-09-12T18:11:56.470083+0000","last_clean":"2024-09-12T18:11:56.470083+0000","last_became_active":"2024-09-12T17:10:42.521637+0000","last_became_peered":"2024-09-12T17:10:42.521637+0000","last_unstale":"2024-09-12T18:11:56.470083+0000","last_undegraded":"2024-09-12T18:11:56.470083+0000","last_fullsized":"2024-09-12T18:11:56.470083+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'164","last_scrub_stamp":"2024-09-12T18:11:56.469937+0000","last_deep_scrub":"263'164","last_deep_scrub_stamp":"2024-09-12T18:11:56.469937+0000","last_clean_scrub_stamp":"2024-09-12T18:11:56.469937+0000","objects_scrubbed":5,"log_size":64,"log_dups_size":100,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:47:38.556900+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":432508,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":446,"num_read_kb":17329,"num_write":806,"num_write_kb":49238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0,1],"acting":[7,5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"263'785","reported_seq":2287,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:03.615335+0000","last_change":"2024-09-12T18:12:03.615335+0000","last_active":"2024-09-12T18:12:03.615335+0000","last_peered":"2024-09-12T18:12:03.615335+0000","last_clean":"2024-09-12T18:12:03.615335+0000","last_became_active":"2024-09-12T17:10:44.521031+0000","last_became_peered":"2024-09-12T17:10:44.521031+0000","last_unstale":"2024-09-12T18:12:03.615335+0000","last_undegraded":"2024-09-12T18:12:03.615335+0000","last_fullsized":"2024-09-12T18:12:03.615335+0000","mapping_epoch":26,"log_start":"263'700","ondisk_log_start":"263'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'785","last_scrub_stamp":"2024-09-12T18:12:03.615200+0000","last_deep_scrub":"263'785","last_deep_scrub_stamp":"2024-09-12T18:12:03.615200+0000","last_clean_scrub_stamp":"2024-09-12T18:12:03.615200+0000","objects_scrubbed":3,"log_size":85,"log_dups_size":700,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:57:53.084717+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3604,"num_read_kb":3242,"num_write":1018,"num_write_kb":360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"263'259","reported_seq":960,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:53.798419+0000","last_change":"2024-09-12T18:11:53.798419+0000","last_active":"2024-09-12T18:11:53.798419+0000","last_peered":"2024-09-12T18:11:53.798419+0000","last_clean":"2024-09-12T18:11:53.798419+0000","last_became_active":"2024-09-12T17:10:42.517679+0000","last_became_peered":"2024-09-12T17:10:42.517679+0000","last_unstale":"2024-09-12T18:11:53.798419+0000","last_undegraded":"2024-09-12T18:11:53.798419+0000","last_fullsized":"2024-09-12T18:11:53.798419+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'259","last_scrub_stamp":"2024-09-12T18:11:53.798287+0000","last_deep_scrub":"263'259","last_deep_scrub_stamp":"2024-09-12T18:11:53.798287+0000","last_clean_scrub_stamp":"2024-09-12T18:11:53.798287+0000","objects_scrubbed":4,"log_size":59,"log_dups_size":200,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:05.021160+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1604218,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":855,"num_read_kb":4303,"num_write":1129,"num_write_kb":28670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2,1],"acting":[6,5,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"263'359","reported_seq":1821,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:01.415160+0000","last_change":"2024-09-12T18:12:01.415160+0000","last_active":"2024-09-12T18:12:01.415160+0000","last_peered":"2024-09-12T18:12:01.415160+0000","last_clean":"2024-09-12T18:12:01.415160+0000","last_became_active":"2024-09-12T17:10:44.518183+0000","last_became_peered":"2024-09-12T17:10:44.518183+0000","last_unstale":"2024-09-12T18:12:01.415160+0000","last_undegraded":"2024-09-12T18:12:01.415160+0000","last_fullsized":"2024-09-12T18:12:01.415160+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'359","last_scrub_stamp":"2024-09-12T18:12:01.415072+0000","last_deep_scrub":"263'359","last_deep_scrub_stamp":"2024-09-12T18:12:01.415072+0000","last_clean_scrub_stamp":"2024-09-12T18:12:01.415072+0000","objects_scrubbed":1,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:05:01.730803+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1979,"num_read_kb":1899,"num_write":385,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"263'232","reported_seq":961,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:52.832302+0000","last_change":"2024-09-12T18:11:52.832302+0000","last_active":"2024-09-12T18:11:52.832302+0000","last_peered":"2024-09-12T18:11:52.832302+0000","last_clean":"2024-09-12T18:11:52.832302+0000","last_became_active":"2024-09-12T17:10:42.518345+0000","last_became_peered":"2024-09-12T17:10:42.518345+0000","last_unstale":"2024-09-12T18:11:52.832302+0000","last_undegraded":"2024-09-12T18:11:52.832302+0000","last_fullsized":"2024-09-12T18:11:52.832302+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'232","last_scrub_stamp":"2024-09-12T18:11:52.832185+0000","last_deep_scrub":"263'232","last_deep_scrub_stamp":"2024-09-12T18:11:52.832185+0000","last_clean_scrub_stamp":"2024-09-12T18:11:52.832185+0000","objects_scrubbed":5,"log_size":32,"log_dups_size":200,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:43:54.965686+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1367925,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":646,"num_read_kb":98876,"num_write":1054,"num_write_kb":25289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0,3],"acting":[6,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"263'518","reported_seq":2158,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:57.757617+0000","last_change":"2024-09-12T18:11:57.757617+0000","last_active":"2024-09-12T18:11:57.757617+0000","last_peered":"2024-09-12T18:11:57.757617+0000","last_clean":"2024-09-12T18:11:57.757617+0000","last_became_active":"2024-09-12T17:10:44.514645+0000","last_became_peered":"2024-09-12T17:10:44.514645+0000","last_unstale":"2024-09-12T18:11:57.757617+0000","last_undegraded":"2024-09-12T18:11:57.757617+0000","last_fullsized":"2024-09-12T18:11:57.757617+0000","mapping_epoch":26,"log_start":"263'500","ondisk_log_start":"263'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'518","last_scrub_stamp":"2024-09-12T18:11:57.757537+0000","last_deep_scrub":"263'518","last_deep_scrub_stamp":"2024-09-12T18:11:57.757537+0000","last_clean_scrub_stamp":"2024-09-12T18:11:57.757537+0000","objects_scrubbed":2,"log_size":18,"log_dups_size":500,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:17:09.508445+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2725,"num_read_kb":2548,"num_write":623,"num_write_kb":175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":640,"num_omap_keys":3,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"263'215","reported_seq":882,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:50.441705+0000","last_change":"2024-09-12T18:11:50.441705+0000","last_active":"2024-09-12T18:11:50.441705+0000","last_peered":"2024-09-12T18:11:50.441705+0000","last_clean":"2024-09-12T18:11:50.441705+0000","last_became_active":"2024-09-12T17:10:42.519000+0000","last_became_peered":"2024-09-12T17:10:42.519000+0000","last_unstale":"2024-09-12T18:11:50.441705+0000","last_undegraded":"2024-09-12T18:11:50.441705+0000","last_fullsized":"2024-09-12T18:11:50.441705+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'215","last_scrub_stamp":"2024-09-12T18:11:50.441568+0000","last_deep_scrub":"263'215","last_deep_scrub_stamp":"2024-09-12T18:11:50.441568+0000","last_clean_scrub_stamp":"2024-09-12T18:11:50.441568+0000","objects_scrubbed":4,"log_size":15,"log_dups_size":200,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:10:24.946801+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":516496,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":502,"num_read_kb":33700,"num_write":932,"num_write_kb":23229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,0],"acting":[4,3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"263'1586","reported_seq":3120,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:58.740833+0000","last_change":"2024-09-12T18:11:58.740833+0000","last_active":"2024-09-12T18:11:58.740833+0000","last_peered":"2024-09-12T18:11:58.740833+0000","last_clean":"2024-09-12T18:11:58.740833+0000","last_became_active":"2024-09-12T17:10:44.514826+0000","last_became_peered":"2024-09-12T17:10:44.514826+0000","last_unstale":"2024-09-12T18:11:58.740833+0000","last_undegraded":"2024-09-12T18:11:58.740833+0000","last_fullsized":"2024-09-12T18:11:58.740833+0000","mapping_epoch":26,"log_start":"263'1500","ondisk_log_start":"263'1500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1586","last_scrub_stamp":"2024-09-12T18:11:58.740747+0000","last_deep_scrub":"263'1586","last_deep_scrub_stamp":"2024-09-12T18:11:58.740747+0000","last_clean_scrub_stamp":"2024-09-12T18:11:58.740747+0000","objects_scrubbed":3,"log_size":86,"log_dups_size":1500,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:47:04.467281+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6865,"num_read_kb":5951,"num_write":2206,"num_write_kb":956,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":946,"num_omap_keys":4,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"263'244","reported_seq":908,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:55.609090+0000","last_change":"2024-09-12T18:11:55.609090+0000","last_active":"2024-09-12T18:11:55.609090+0000","last_peered":"2024-09-12T18:11:55.609090+0000","last_clean":"2024-09-12T18:11:55.609090+0000","last_became_active":"2024-09-12T17:10:42.532995+0000","last_became_peered":"2024-09-12T17:10:42.532995+0000","last_unstale":"2024-09-12T18:11:55.609090+0000","last_undegraded":"2024-09-12T18:11:55.609090+0000","last_fullsized":"2024-09-12T18:11:55.609090+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'244","last_scrub_stamp":"2024-09-12T18:11:55.608942+0000","last_deep_scrub":"263'244","last_deep_scrub_stamp":"2024-09-12T18:11:55.608942+0000","last_clean_scrub_stamp":"2024-09-12T18:11:55.608942+0000","objects_scrubbed":6,"log_size":44,"log_dups_size":200,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:30:38.928542+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":786501,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":539,"num_read_kb":13123,"num_write":1227,"num_write_kb":39413,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1,5],"acting":[3,6,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"263'1290","reported_seq":3025,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:04.359170+0000","last_change":"2024-09-12T18:12:04.359170+0000","last_active":"2024-09-12T18:12:04.359170+0000","last_peered":"2024-09-12T18:12:04.359170+0000","last_clean":"2024-09-12T18:12:04.359170+0000","last_became_active":"2024-09-12T17:10:44.507428+0000","last_became_peered":"2024-09-12T17:10:44.507428+0000","last_unstale":"2024-09-12T18:12:04.359170+0000","last_undegraded":"2024-09-12T18:12:04.359170+0000","last_fullsized":"2024-09-12T18:12:04.359170+0000","mapping_epoch":26,"log_start":"263'1200","ondisk_log_start":"263'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1290","last_scrub_stamp":"2024-09-12T18:12:04.359076+0000","last_deep_scrub":"263'1290","last_deep_scrub_stamp":"2024-09-12T18:12:04.359076+0000","last_clean_scrub_stamp":"2024-09-12T18:12:04.359076+0000","objects_scrubbed":2,"log_size":90,"log_dups_size":1200,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:25:36.918661+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5933,"num_read_kb":5245,"num_write":1814,"num_write_kb":777,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"263'185","reported_seq":871,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:53.698211+0000","last_change":"2024-09-12T18:11:53.698211+0000","last_active":"2024-09-12T18:11:53.698211+0000","last_peered":"2024-09-12T18:11:53.698211+0000","last_clean":"2024-09-12T18:11:53.698211+0000","last_became_active":"2024-09-12T17:10:42.529179+0000","last_became_peered":"2024-09-12T17:10:42.529179+0000","last_unstale":"2024-09-12T18:11:53.698211+0000","last_undegraded":"2024-09-12T18:11:53.698211+0000","last_fullsized":"2024-09-12T18:11:53.698211+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'185","last_scrub_stamp":"2024-09-12T18:11:53.698095+0000","last_deep_scrub":"263'185","last_deep_scrub_stamp":"2024-09-12T18:11:53.698095+0000","last_clean_scrub_stamp":"2024-09-12T18:11:53.698095+0000","objects_scrubbed":5,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:03:54.556628+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":576011,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":570,"num_read_kb":13539,"num_write":907,"num_write_kb":25869,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1,5],"acting":[0,4,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"263'163","reported_seq":692,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:20.320264+0000","last_change":"2024-09-12T18:12:20.320264+0000","last_active":"2024-09-12T18:12:20.320264+0000","last_peered":"2024-09-12T18:12:20.320264+0000","last_clean":"2024-09-12T18:12:20.320264+0000","last_became_active":"2024-09-12T17:10:52.566079+0000","last_became_peered":"2024-09-12T17:10:52.566079+0000","last_unstale":"2024-09-12T18:12:20.320264+0000","last_undegraded":"2024-09-12T18:12:20.320264+0000","last_fullsized":"2024-09-12T18:12:20.320264+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'163","last_scrub_stamp":"2024-09-12T18:12:20.320167+0000","last_deep_scrub":"263'163","last_deep_scrub_stamp":"2024-09-12T18:12:20.320167+0000","last_clean_scrub_stamp":"2024-09-12T18:12:20.320167+0000","objects_scrubbed":4,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:08:43.569628+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":803,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":269,"num_read_kb":255,"num_write":425,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"263'796","reported_seq":2412,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:56.605309+0000","last_change":"2024-09-12T18:11:56.605309+0000","last_active":"2024-09-12T18:11:56.605309+0000","last_peered":"2024-09-12T18:11:56.605309+0000","last_clean":"2024-09-12T18:11:56.605309+0000","last_became_active":"2024-09-12T17:10:44.522193+0000","last_became_peered":"2024-09-12T17:10:44.522193+0000","last_unstale":"2024-09-12T18:11:56.605309+0000","last_undegraded":"2024-09-12T18:11:56.605309+0000","last_fullsized":"2024-09-12T18:11:56.605309+0000","mapping_epoch":26,"log_start":"263'700","ondisk_log_start":"263'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'796","last_scrub_stamp":"2024-09-12T18:11:56.605227+0000","last_deep_scrub":"263'796","last_deep_scrub_stamp":"2024-09-12T18:11:56.605227+0000","last_clean_scrub_stamp":"2024-09-12T18:11:56.605227+0000","objects_scrubbed":1,"log_size":96,"log_dups_size":700,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:30:29.129454+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3748,"num_read_kb":3407,"num_write":1044,"num_write_kb":360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"263'203","reported_seq":853,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:55.485587+0000","last_change":"2024-09-12T18:11:55.485587+0000","last_active":"2024-09-12T18:11:55.485587+0000","last_peered":"2024-09-12T18:11:55.485587+0000","last_clean":"2024-09-12T18:11:55.485587+0000","last_became_active":"2024-09-12T17:10:42.528620+0000","last_became_peered":"2024-09-12T17:10:42.528620+0000","last_unstale":"2024-09-12T18:11:55.485587+0000","last_undegraded":"2024-09-12T18:11:55.485587+0000","last_fullsized":"2024-09-12T18:11:55.485587+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'203","last_scrub_stamp":"2024-09-12T18:11:55.485439+0000","last_deep_scrub":"263'203","last_deep_scrub_stamp":"2024-09-12T18:11:55.485439+0000","last_clean_scrub_stamp":"2024-09-12T18:11:55.485439+0000","objects_scrubbed":4,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:14:56.174736+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262203,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":497,"num_read_kb":31268,"num_write":1015,"num_write_kb":14227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4,2],"acting":[7,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:07.454862+0000","last_change":"2024-09-12T18:12:07.454862+0000","last_active":"2024-09-12T18:12:07.454862+0000","last_peered":"2024-09-12T18:12:07.454862+0000","last_clean":"2024-09-12T18:12:07.454862+0000","last_became_active":"2024-09-12T17:10:46.527663+0000","last_became_peered":"2024-09-12T17:10:46.527663+0000","last_unstale":"2024-09-12T18:12:07.454862+0000","last_undegraded":"2024-09-12T18:12:07.454862+0000","last_fullsized":"2024-09-12T18:12:07.454862+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:07.454758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:07.454758+0000","last_clean_scrub_stamp":"2024-09-12T18:12:07.454758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:22:34.911521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"263'206","reported_seq":821,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:08.768194+0000","last_change":"2024-09-12T18:12:08.768194+0000","last_active":"2024-09-12T18:12:08.768194+0000","last_peered":"2024-09-12T18:12:08.768194+0000","last_clean":"2024-09-12T18:12:08.768194+0000","last_became_active":"2024-09-12T17:10:48.544885+0000","last_became_peered":"2024-09-12T17:10:48.544885+0000","last_unstale":"2024-09-12T18:12:08.768194+0000","last_undegraded":"2024-09-12T18:12:08.768194+0000","last_fullsized":"2024-09-12T18:12:08.768194+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'206","last_scrub_stamp":"2024-09-12T18:12:08.768105+0000","last_deep_scrub":"263'206","last_deep_scrub_stamp":"2024-09-12T18:12:08.768105+0000","last_clean_scrub_stamp":"2024-09-12T18:12:08.768105+0000","objects_scrubbed":5,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:55:57.620335+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6100,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":264,"num_read_kb":318,"num_write":156,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:15.608747+0000","last_change":"2024-09-12T18:12:15.608747+0000","last_active":"2024-09-12T18:12:15.608747+0000","last_peered":"2024-09-12T18:12:15.608747+0000","last_clean":"2024-09-12T18:12:15.608747+0000","last_became_active":"2024-09-12T17:10:50.556146+0000","last_became_peered":"2024-09-12T17:10:50.556146+0000","last_unstale":"2024-09-12T18:12:15.608747+0000","last_undegraded":"2024-09-12T18:12:15.608747+0000","last_fullsized":"2024-09-12T18:12:15.608747+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:15.608646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:15.608646+0000","last_clean_scrub_stamp":"2024-09-12T18:12:15.608646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:38:59.653407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"263'2477","reported_seq":4389,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:22.452371+0000","last_change":"2024-09-12T18:12:22.452371+0000","last_active":"2024-09-12T18:12:22.452371+0000","last_peered":"2024-09-12T18:12:22.452371+0000","last_clean":"2024-09-12T18:12:22.452371+0000","last_became_active":"2024-09-12T17:10:52.572326+0000","last_became_peered":"2024-09-12T17:10:52.572326+0000","last_unstale":"2024-09-12T18:12:22.452371+0000","last_undegraded":"2024-09-12T18:12:22.452371+0000","last_fullsized":"2024-09-12T18:12:22.452371+0000","mapping_epoch":34,"log_start":"263'2400","ondisk_log_start":"263'2400","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2477","last_scrub_stamp":"2024-09-12T18:12:22.452271+0000","last_deep_scrub":"263'2477","last_deep_scrub_stamp":"2024-09-12T18:12:22.452271+0000","last_clean_scrub_stamp":"2024-09-12T18:12:22.452271+0000","objects_scrubbed":3,"log_size":77,"log_dups_size":2400,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:21:06.027327+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":211,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6220,"num_read_kb":6202,"num_write":4958,"num_write_kb":1813,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":347,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"263'424","reported_seq":1886,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:56.315526+0000","last_change":"2024-09-12T18:11:56.315526+0000","last_active":"2024-09-12T18:11:56.315526+0000","last_peered":"2024-09-12T18:11:56.315526+0000","last_clean":"2024-09-12T18:11:56.315526+0000","last_became_active":"2024-09-12T17:10:44.512755+0000","last_became_peered":"2024-09-12T17:10:44.512755+0000","last_unstale":"2024-09-12T18:11:56.315526+0000","last_undegraded":"2024-09-12T18:11:56.315526+0000","last_fullsized":"2024-09-12T18:11:56.315526+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'424","last_scrub_stamp":"2024-09-12T18:11:56.315433+0000","last_deep_scrub":"263'424","last_deep_scrub_stamp":"2024-09-12T18:11:56.315433+0000","last_clean_scrub_stamp":"2024-09-12T18:11:56.315433+0000","objects_scrubbed":1,"log_size":24,"log_dups_size":400,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:17:36.929085+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2092,"num_read_kb":1979,"num_write":465,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"263'205","reported_seq":850,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:50.670378+0000","last_change":"2024-09-12T18:11:50.670378+0000","last_active":"2024-09-12T18:11:50.670378+0000","last_peered":"2024-09-12T18:11:50.670378+0000","last_clean":"2024-09-12T18:11:50.670378+0000","last_became_active":"2024-09-12T17:10:42.513658+0000","last_became_peered":"2024-09-12T17:10:42.513658+0000","last_unstale":"2024-09-12T18:11:50.670378+0000","last_undegraded":"2024-09-12T18:11:50.670378+0000","last_fullsized":"2024-09-12T18:11:50.670378+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'205","last_scrub_stamp":"2024-09-12T18:11:50.670245+0000","last_deep_scrub":"263'205","last_deep_scrub_stamp":"2024-09-12T18:11:50.670245+0000","last_clean_scrub_stamp":"2024-09-12T18:11:50.670245+0000","objects_scrubbed":3,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:56:06.408091+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262204,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":448,"num_read_kb":17694,"num_write":957,"num_write_kb":36760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":504,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:09.675177+0000","last_change":"2024-09-12T18:12:09.675177+0000","last_active":"2024-09-12T18:12:09.675177+0000","last_peered":"2024-09-12T18:12:09.675177+0000","last_clean":"2024-09-12T18:12:09.675177+0000","last_became_active":"2024-09-12T17:10:46.528008+0000","last_became_peered":"2024-09-12T17:10:46.528008+0000","last_unstale":"2024-09-12T18:12:09.675177+0000","last_undegraded":"2024-09-12T18:12:09.675177+0000","last_fullsized":"2024-09-12T18:12:09.675177+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:09.675082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:09.675082+0000","last_clean_scrub_stamp":"2024-09-12T18:12:09.675082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:32:12.149143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"263'101","reported_seq":641,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:11.289249+0000","last_change":"2024-09-12T18:12:11.289249+0000","last_active":"2024-09-12T18:12:11.289249+0000","last_peered":"2024-09-12T18:12:11.289249+0000","last_clean":"2024-09-12T18:12:11.289249+0000","last_became_active":"2024-09-12T17:10:48.539249+0000","last_became_peered":"2024-09-12T17:10:48.539249+0000","last_unstale":"2024-09-12T18:12:11.289249+0000","last_undegraded":"2024-09-12T18:12:11.289249+0000","last_fullsized":"2024-09-12T18:12:11.289249+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'101","last_scrub_stamp":"2024-09-12T18:12:11.289154+0000","last_deep_scrub":"263'101","last_deep_scrub_stamp":"2024-09-12T18:12:11.289154+0000","last_clean_scrub_stamp":"2024-09-12T18:12:11.289154+0000","objects_scrubbed":3,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:49:48.920473+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":101,"num_read_kb":97,"num_write":68,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:16.302946+0000","last_change":"2024-09-12T18:12:16.302946+0000","last_active":"2024-09-12T18:12:16.302946+0000","last_peered":"2024-09-12T18:12:16.302946+0000","last_clean":"2024-09-12T18:12:16.302946+0000","last_became_active":"2024-09-12T17:10:50.559882+0000","last_became_peered":"2024-09-12T17:10:50.559882+0000","last_unstale":"2024-09-12T18:12:16.302946+0000","last_undegraded":"2024-09-12T18:12:16.302946+0000","last_fullsized":"2024-09-12T18:12:16.302946+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:16.302835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:16.302835+0000","last_clean_scrub_stamp":"2024-09-12T18:12:16.302835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:28:03.221974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"263'94","reported_seq":603,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:21.627457+0000","last_change":"2024-09-12T18:12:21.627457+0000","last_active":"2024-09-12T18:12:21.627457+0000","last_peered":"2024-09-12T18:12:21.627457+0000","last_clean":"2024-09-12T18:12:21.627457+0000","last_became_active":"2024-09-12T17:10:52.570071+0000","last_became_peered":"2024-09-12T17:10:52.570071+0000","last_unstale":"2024-09-12T18:12:21.627457+0000","last_undegraded":"2024-09-12T18:12:21.627457+0000","last_fullsized":"2024-09-12T18:12:21.627457+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'94","last_scrub_stamp":"2024-09-12T18:12:21.627369+0000","last_deep_scrub":"263'94","last_deep_scrub_stamp":"2024-09-12T18:12:21.627369+0000","last_clean_scrub_stamp":"2024-09-12T18:12:21.627369+0000","objects_scrubbed":4,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:31:19.525124+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":117,"num_read_kb":116,"num_write":199,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"263'446","reported_seq":2001,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:57.732062+0000","last_change":"2024-09-12T18:11:57.732062+0000","last_active":"2024-09-12T18:11:57.732062+0000","last_peered":"2024-09-12T18:11:57.732062+0000","last_clean":"2024-09-12T18:11:57.732062+0000","last_became_active":"2024-09-12T17:10:44.517886+0000","last_became_peered":"2024-09-12T17:10:44.517886+0000","last_unstale":"2024-09-12T18:11:57.732062+0000","last_undegraded":"2024-09-12T18:11:57.732062+0000","last_fullsized":"2024-09-12T18:11:57.732062+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'446","last_scrub_stamp":"2024-09-12T18:11:57.731969+0000","last_deep_scrub":"263'446","last_deep_scrub_stamp":"2024-09-12T18:11:57.731969+0000","last_clean_scrub_stamp":"2024-09-12T18:11:57.731969+0000","objects_scrubbed":3,"log_size":46,"log_dups_size":400,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:14:03.007633+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2335,"num_read_kb":2201,"num_write":517,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"263'192","reported_seq":824,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:53.493308+0000","last_change":"2024-09-12T18:11:53.493308+0000","last_active":"2024-09-12T18:11:53.493308+0000","last_peered":"2024-09-12T18:11:53.493308+0000","last_clean":"2024-09-12T18:11:53.493308+0000","last_became_active":"2024-09-12T17:10:42.530663+0000","last_became_peered":"2024-09-12T17:10:42.530663+0000","last_unstale":"2024-09-12T18:11:53.493308+0000","last_undegraded":"2024-09-12T18:11:53.493308+0000","last_fullsized":"2024-09-12T18:11:53.493308+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'192","last_scrub_stamp":"2024-09-12T18:11:53.493160+0000","last_deep_scrub":"263'192","last_deep_scrub_stamp":"2024-09-12T18:11:53.493160+0000","last_clean_scrub_stamp":"2024-09-12T18:11:53.493160+0000","objects_scrubbed":4,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:43:13.520826+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6466288,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":436,"num_read_kb":14482,"num_write":960,"num_write_kb":29259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":503,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:10.652342+0000","last_change":"2024-09-12T18:12:10.652342+0000","last_active":"2024-09-12T18:12:10.652342+0000","last_peered":"2024-09-12T18:12:10.652342+0000","last_clean":"2024-09-12T18:12:10.652342+0000","last_became_active":"2024-09-12T17:10:46.530438+0000","last_became_peered":"2024-09-12T17:10:46.530438+0000","last_unstale":"2024-09-12T18:12:10.652342+0000","last_undegraded":"2024-09-12T18:12:10.652342+0000","last_fullsized":"2024-09-12T18:12:10.652342+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:10.652252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:10.652252+0000","last_clean_scrub_stamp":"2024-09-12T18:12:10.652252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:55:25.036608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"263'119","reported_seq":662,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:05.711738+0000","last_change":"2024-09-12T18:12:05.711738+0000","last_active":"2024-09-12T18:12:05.711738+0000","last_peered":"2024-09-12T18:12:05.711738+0000","last_clean":"2024-09-12T18:12:05.711738+0000","last_became_active":"2024-09-12T17:10:48.540078+0000","last_became_peered":"2024-09-12T17:10:48.540078+0000","last_unstale":"2024-09-12T18:12:05.711738+0000","last_undegraded":"2024-09-12T18:12:05.711738+0000","last_fullsized":"2024-09-12T18:12:05.711738+0000","mapping_epoch":30,"log_start":"263'100","ondisk_log_start":"263'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'119","last_scrub_stamp":"2024-09-12T18:12:05.711619+0000","last_deep_scrub":"263'119","last_deep_scrub_stamp":"2024-09-12T18:12:05.711619+0000","last_clean_scrub_stamp":"2024-09-12T18:12:05.711619+0000","objects_scrubbed":5,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:27:16.614673+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":134,"num_read_kb":129,"num_write":88,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"263'766","reported_seq":4737,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:18.558845+0000","last_change":"2024-09-12T18:12:18.558845+0000","last_active":"2024-09-12T18:12:18.558845+0000","last_peered":"2024-09-12T18:12:18.558845+0000","last_clean":"2024-09-12T18:12:18.558845+0000","last_became_active":"2024-09-12T17:10:50.562930+0000","last_became_peered":"2024-09-12T17:10:50.562930+0000","last_unstale":"2024-09-12T18:12:18.558845+0000","last_undegraded":"2024-09-12T18:12:18.558845+0000","last_fullsized":"2024-09-12T18:12:18.558845+0000","mapping_epoch":32,"log_start":"263'700","ondisk_log_start":"263'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'766","last_scrub_stamp":"2024-09-12T18:12:18.558728+0000","last_deep_scrub":"263'766","last_deep_scrub_stamp":"2024-09-12T18:12:18.558728+0000","last_clean_scrub_stamp":"2024-09-12T18:12:18.558728+0000","objects_scrubbed":1,"log_size":66,"log_dups_size":700,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:48:16.936137+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"263'200","reported_seq":1057,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:21.305244+0000","last_change":"2024-09-12T18:12:21.305244+0000","last_active":"2024-09-12T18:12:21.305244+0000","last_peered":"2024-09-12T18:12:21.305244+0000","last_clean":"2024-09-12T18:12:21.305244+0000","last_became_active":"2024-09-12T17:10:52.671103+0000","last_became_peered":"2024-09-12T17:10:52.671103+0000","last_unstale":"2024-09-12T18:12:21.305244+0000","last_undegraded":"2024-09-12T18:12:21.305244+0000","last_fullsized":"2024-09-12T18:12:21.305244+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'200","last_scrub_stamp":"2024-09-12T18:12:21.305151+0000","last_deep_scrub":"263'200","last_deep_scrub_stamp":"2024-09-12T18:12:21.305151+0000","last_clean_scrub_stamp":"2024-09-12T18:12:21.305151+0000","objects_scrubbed":2,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:51:37.835794+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":719,"num_read_kb":693,"num_write":432,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"263'449","reported_seq":1973,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:05.648946+0000","last_change":"2024-09-12T18:12:05.648946+0000","last_active":"2024-09-12T18:12:05.648946+0000","last_peered":"2024-09-12T18:12:05.648946+0000","last_clean":"2024-09-12T18:12:05.648946+0000","last_became_active":"2024-09-12T17:10:44.514124+0000","last_became_peered":"2024-09-12T17:10:44.514124+0000","last_unstale":"2024-09-12T18:12:05.648946+0000","last_undegraded":"2024-09-12T18:12:05.648946+0000","last_fullsized":"2024-09-12T18:12:05.648946+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'449","last_scrub_stamp":"2024-09-12T18:12:05.648849+0000","last_deep_scrub":"263'449","last_deep_scrub_stamp":"2024-09-12T18:12:05.648849+0000","last_clean_scrub_stamp":"2024-09-12T18:12:05.648849+0000","objects_scrubbed":3,"log_size":49,"log_dups_size":400,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:51:39.265549+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2305,"num_read_kb":2168,"num_write":513,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":715,"num_omap_keys":3,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"263'223","reported_seq":887,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:49.784779+0000","last_change":"2024-09-12T18:11:49.784779+0000","last_active":"2024-09-12T18:11:49.784779+0000","last_peered":"2024-09-12T18:11:49.784779+0000","last_clean":"2024-09-12T18:11:49.784779+0000","last_became_active":"2024-09-12T17:10:42.525328+0000","last_became_peered":"2024-09-12T17:10:42.525328+0000","last_unstale":"2024-09-12T18:11:49.784779+0000","last_undegraded":"2024-09-12T18:11:49.784779+0000","last_fullsized":"2024-09-12T18:11:49.784779+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'223","last_scrub_stamp":"2024-09-12T18:11:49.784671+0000","last_deep_scrub":"263'223","last_deep_scrub_stamp":"2024-09-12T18:11:49.784671+0000","last_clean_scrub_stamp":"2024-09-12T18:11:49.784671+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":200,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:16:42.260914+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":549,"num_read_kb":47940,"num_write":1052,"num_write_kb":57690,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,3],"acting":[6,0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:09.453009+0000","last_change":"2024-09-12T18:12:09.453009+0000","last_active":"2024-09-12T18:12:09.453009+0000","last_peered":"2024-09-12T18:12:09.453009+0000","last_clean":"2024-09-12T18:12:09.453009+0000","last_became_active":"2024-09-12T17:10:46.526679+0000","last_became_peered":"2024-09-12T17:10:46.526679+0000","last_unstale":"2024-09-12T18:12:09.453009+0000","last_undegraded":"2024-09-12T18:12:09.453009+0000","last_fullsized":"2024-09-12T18:12:09.453009+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:09.452906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:09.452906+0000","last_clean_scrub_stamp":"2024-09-12T18:12:09.452906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:12:39.798370+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"263'135","reported_seq":710,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:14.576462+0000","last_change":"2024-09-12T18:12:14.576462+0000","last_active":"2024-09-12T18:12:14.576462+0000","last_peered":"2024-09-12T18:12:14.576462+0000","last_clean":"2024-09-12T18:12:14.576462+0000","last_became_active":"2024-09-12T17:10:48.543573+0000","last_became_peered":"2024-09-12T17:10:48.543573+0000","last_unstale":"2024-09-12T18:12:14.576462+0000","last_undegraded":"2024-09-12T18:12:14.576462+0000","last_fullsized":"2024-09-12T18:12:14.576462+0000","mapping_epoch":30,"log_start":"263'100","ondisk_log_start":"263'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'135","last_scrub_stamp":"2024-09-12T18:12:14.576373+0000","last_deep_scrub":"263'135","last_deep_scrub_stamp":"2024-09-12T18:12:14.576373+0000","last_clean_scrub_stamp":"2024-09-12T18:12:14.576373+0000","objects_scrubbed":4,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:56:34.775535+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5773,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":175,"num_read_kb":264,"num_write":94,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"263'788","reported_seq":2307,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:22.665547+0000","last_change":"2024-09-12T18:12:22.665547+0000","last_active":"2024-09-12T18:12:22.665547+0000","last_peered":"2024-09-12T18:12:22.665547+0000","last_clean":"2024-09-12T18:12:22.665547+0000","last_became_active":"2024-09-12T17:10:50.559216+0000","last_became_peered":"2024-09-12T17:10:50.559216+0000","last_unstale":"2024-09-12T18:12:22.665547+0000","last_undegraded":"2024-09-12T18:12:22.665547+0000","last_fullsized":"2024-09-12T18:12:22.665547+0000","mapping_epoch":32,"log_start":"263'700","ondisk_log_start":"263'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'788","last_scrub_stamp":"2024-09-12T18:12:22.665463+0000","last_deep_scrub":"263'788","last_deep_scrub_stamp":"2024-09-12T18:12:22.665463+0000","last_clean_scrub_stamp":"2024-09-12T18:12:22.665463+0000","objects_scrubbed":1,"log_size":88,"log_dups_size":700,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:00:59.116160+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"263'411","reported_seq":1940,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:55.295320+0000","last_change":"2024-09-12T18:11:55.295320+0000","last_active":"2024-09-12T18:11:55.295320+0000","last_peered":"2024-09-12T18:11:55.295320+0000","last_clean":"2024-09-12T18:11:55.295320+0000","last_became_active":"2024-09-12T17:10:44.516266+0000","last_became_peered":"2024-09-12T17:10:44.516266+0000","last_unstale":"2024-09-12T18:11:55.295320+0000","last_undegraded":"2024-09-12T18:11:55.295320+0000","last_fullsized":"2024-09-12T18:11:55.295320+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'411","last_scrub_stamp":"2024-09-12T18:11:55.295178+0000","last_deep_scrub":"263'411","last_deep_scrub_stamp":"2024-09-12T18:11:55.295178+0000","last_clean_scrub_stamp":"2024-09-12T18:11:55.295178+0000","objects_scrubbed":3,"log_size":11,"log_dups_size":400,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:17:07.193677+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2231,"num_read_kb":2116,"num_write":471,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":467,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"263'319","reported_seq":1094,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:52.463181+0000","last_change":"2024-09-12T18:11:52.463181+0000","last_active":"2024-09-12T18:11:52.463181+0000","last_peered":"2024-09-12T18:11:52.463181+0000","last_clean":"2024-09-12T18:11:52.463181+0000","last_became_active":"2024-09-12T17:10:42.531886+0000","last_became_peered":"2024-09-12T17:10:42.531886+0000","last_unstale":"2024-09-12T18:11:52.463181+0000","last_undegraded":"2024-09-12T18:11:52.463181+0000","last_fullsized":"2024-09-12T18:11:52.463181+0000","mapping_epoch":24,"log_start":"263'300","ondisk_log_start":"263'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'319","last_scrub_stamp":"2024-09-12T18:11:52.463034+0000","last_deep_scrub":"263'319","last_deep_scrub_stamp":"2024-09-12T18:11:52.463034+0000","last_clean_scrub_stamp":"2024-09-12T18:11:52.463034+0000","objects_scrubbed":6,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:11:16.067545+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2276857,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1043,"num_read_kb":35637,"num_write":1316,"num_write_kb":31872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0,1],"acting":[7,4,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":504,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:05.608637+0000","last_change":"2024-09-12T18:12:05.608637+0000","last_active":"2024-09-12T18:12:05.608637+0000","last_peered":"2024-09-12T18:12:05.608637+0000","last_clean":"2024-09-12T18:12:05.608637+0000","last_became_active":"2024-09-12T17:10:46.518652+0000","last_became_peered":"2024-09-12T17:10:46.518652+0000","last_unstale":"2024-09-12T18:12:05.608637+0000","last_undegraded":"2024-09-12T18:12:05.608637+0000","last_fullsized":"2024-09-12T18:12:05.608637+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:05.608543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:05.608543+0000","last_clean_scrub_stamp":"2024-09-12T18:12:05.608543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:09:06.191572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"263'227","reported_seq":852,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:13.404939+0000","last_change":"2024-09-12T18:12:13.404939+0000","last_active":"2024-09-12T18:12:13.404939+0000","last_peered":"2024-09-12T18:12:13.404939+0000","last_clean":"2024-09-12T18:12:13.404939+0000","last_became_active":"2024-09-12T17:10:48.541178+0000","last_became_peered":"2024-09-12T17:10:48.541178+0000","last_unstale":"2024-09-12T18:12:13.404939+0000","last_undegraded":"2024-09-12T18:12:13.404939+0000","last_fullsized":"2024-09-12T18:12:13.404939+0000","mapping_epoch":30,"log_start":"263'200","ondisk_log_start":"263'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'227","last_scrub_stamp":"2024-09-12T18:12:13.404809+0000","last_deep_scrub":"263'227","last_deep_scrub_stamp":"2024-09-12T18:12:13.404809+0000","last_clean_scrub_stamp":"2024-09-12T18:12:13.404809+0000","objects_scrubbed":9,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:17:32.802279+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5437,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":298,"num_read_kb":347,"num_write":172,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:08.498712+0000","last_change":"2024-09-12T18:12:08.498712+0000","last_active":"2024-09-12T18:12:08.498712+0000","last_peered":"2024-09-12T18:12:08.498712+0000","last_clean":"2024-09-12T18:12:08.498712+0000","last_became_active":"2024-09-12T17:10:50.560193+0000","last_became_peered":"2024-09-12T17:10:50.560193+0000","last_unstale":"2024-09-12T18:12:08.498712+0000","last_undegraded":"2024-09-12T18:12:08.498712+0000","last_fullsized":"2024-09-12T18:12:08.498712+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:08.498624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:08.498624+0000","last_clean_scrub_stamp":"2024-09-12T18:12:08.498624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:43:57.992395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"263'562","reported_seq":1381,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:18.548972+0000","last_change":"2024-09-12T18:12:18.548972+0000","last_active":"2024-09-12T18:12:18.548972+0000","last_peered":"2024-09-12T18:12:18.548972+0000","last_clean":"2024-09-12T18:12:18.548972+0000","last_became_active":"2024-09-12T17:10:52.572861+0000","last_became_peered":"2024-09-12T17:10:52.572861+0000","last_unstale":"2024-09-12T18:12:18.548972+0000","last_undegraded":"2024-09-12T18:12:18.548972+0000","last_fullsized":"2024-09-12T18:12:18.548972+0000","mapping_epoch":34,"log_start":"263'500","ondisk_log_start":"263'500","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'562","last_scrub_stamp":"2024-09-12T18:12:18.548872+0000","last_deep_scrub":"263'562","last_deep_scrub_stamp":"2024-09-12T18:12:18.548872+0000","last_clean_scrub_stamp":"2024-09-12T18:12:18.548872+0000","objects_scrubbed":7,"log_size":62,"log_dups_size":500,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:19:47.637516+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1102,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1315,"num_read_kb":1312,"num_write":1171,"num_write_kb":396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":381,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"263'469","reported_seq":2057,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:51.400026+0000","last_change":"2024-09-12T18:11:51.400026+0000","last_active":"2024-09-12T18:11:51.400026+0000","last_peered":"2024-09-12T18:11:51.400026+0000","last_clean":"2024-09-12T18:11:51.400026+0000","last_became_active":"2024-09-12T17:10:44.515778+0000","last_became_peered":"2024-09-12T17:10:44.515778+0000","last_unstale":"2024-09-12T18:11:51.400026+0000","last_undegraded":"2024-09-12T18:11:51.400026+0000","last_fullsized":"2024-09-12T18:11:51.400026+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'469","last_scrub_stamp":"2024-09-12T18:11:51.399935+0000","last_deep_scrub":"263'469","last_deep_scrub_stamp":"2024-09-12T18:11:51.399935+0000","last_clean_scrub_stamp":"2024-09-12T18:11:51.399935+0000","objects_scrubbed":2,"log_size":69,"log_dups_size":400,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:32:57.047086+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2463,"num_read_kb":2310,"num_write":552,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"263'158","reported_seq":772,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:50.465220+0000","last_change":"2024-09-12T18:11:50.465220+0000","last_active":"2024-09-12T18:11:50.465220+0000","last_peered":"2024-09-12T18:11:50.465220+0000","last_clean":"2024-09-12T18:11:50.465220+0000","last_became_active":"2024-09-12T17:10:42.526215+0000","last_became_peered":"2024-09-12T17:10:42.526215+0000","last_unstale":"2024-09-12T18:11:50.465220+0000","last_undegraded":"2024-09-12T18:11:50.465220+0000","last_fullsized":"2024-09-12T18:11:50.465220+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'158","last_scrub_stamp":"2024-09-12T18:11:50.465100+0000","last_deep_scrub":"263'158","last_deep_scrub_stamp":"2024-09-12T18:11:50.465100+0000","last_clean_scrub_stamp":"2024-09-12T18:11:50.465100+0000","objects_scrubbed":2,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:53:30.108739+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":254352,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":393,"num_read_kb":949,"num_write":838,"num_write_kb":19518,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,2],"acting":[7,4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":503,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:55.787582+0000","last_change":"2024-09-12T18:11:55.787582+0000","last_active":"2024-09-12T18:11:55.787582+0000","last_peered":"2024-09-12T18:11:55.787582+0000","last_clean":"2024-09-12T18:11:55.787582+0000","last_became_active":"2024-09-12T17:10:46.532552+0000","last_became_peered":"2024-09-12T17:10:46.532552+0000","last_unstale":"2024-09-12T18:11:55.787582+0000","last_undegraded":"2024-09-12T18:11:55.787582+0000","last_fullsized":"2024-09-12T18:11:55.787582+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:11:55.787495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:11:55.787495+0000","last_clean_scrub_stamp":"2024-09-12T18:11:55.787495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:34:05.224619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"263'137","reported_seq":716,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:11.617615+0000","last_change":"2024-09-12T18:12:11.617615+0000","last_active":"2024-09-12T18:12:11.617615+0000","last_peered":"2024-09-12T18:12:11.617615+0000","last_clean":"2024-09-12T18:12:11.617615+0000","last_became_active":"2024-09-12T17:10:48.542511+0000","last_became_peered":"2024-09-12T17:10:48.542511+0000","last_unstale":"2024-09-12T18:12:11.617615+0000","last_undegraded":"2024-09-12T18:12:11.617615+0000","last_fullsized":"2024-09-12T18:12:11.617615+0000","mapping_epoch":30,"log_start":"263'100","ondisk_log_start":"263'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'137","last_scrub_stamp":"2024-09-12T18:12:11.617522+0000","last_deep_scrub":"263'137","last_deep_scrub_stamp":"2024-09-12T18:12:11.617522+0000","last_clean_scrub_stamp":"2024-09-12T18:12:11.617522+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:39:49.866042+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27700,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":176,"num_read_kb":289,"num_write":94,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":498,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:20.690070+0000","last_change":"2024-09-12T18:12:20.690070+0000","last_active":"2024-09-12T18:12:20.690070+0000","last_peered":"2024-09-12T18:12:20.690070+0000","last_clean":"2024-09-12T18:12:20.690070+0000","last_became_active":"2024-09-12T17:10:50.560194+0000","last_became_peered":"2024-09-12T17:10:50.560194+0000","last_unstale":"2024-09-12T18:12:20.690070+0000","last_undegraded":"2024-09-12T18:12:20.690070+0000","last_fullsized":"2024-09-12T18:12:20.690070+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:20.689979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:20.689979+0000","last_clean_scrub_stamp":"2024-09-12T18:12:20.689979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:11:29.579461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"263'129","reported_seq":644,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:08.698991+0000","last_change":"2024-09-12T18:12:08.698991+0000","last_active":"2024-09-12T18:12:08.698991+0000","last_peered":"2024-09-12T18:12:08.698991+0000","last_clean":"2024-09-12T18:12:08.698991+0000","last_became_active":"2024-09-12T17:10:52.564350+0000","last_became_peered":"2024-09-12T17:10:52.564350+0000","last_unstale":"2024-09-12T18:12:08.698991+0000","last_undegraded":"2024-09-12T18:12:08.698991+0000","last_fullsized":"2024-09-12T18:12:08.698991+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'129","last_scrub_stamp":"2024-09-12T18:12:08.698906+0000","last_deep_scrub":"263'129","last_deep_scrub_stamp":"2024-09-12T18:12:08.698906+0000","last_clean_scrub_stamp":"2024-09-12T18:12:08.698906+0000","objects_scrubbed":1,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:13:26.478753+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":214,"num_read_kb":196,"num_write":321,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"263'439","reported_seq":1888,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:55.718980+0000","last_change":"2024-09-12T18:11:55.718980+0000","last_active":"2024-09-12T18:11:55.718980+0000","last_peered":"2024-09-12T18:11:55.718980+0000","last_clean":"2024-09-12T18:11:55.718980+0000","last_became_active":"2024-09-12T17:11:16.618699+0000","last_became_peered":"2024-09-12T17:11:16.618699+0000","last_unstale":"2024-09-12T18:11:55.718980+0000","last_undegraded":"2024-09-12T18:11:55.718980+0000","last_fullsized":"2024-09-12T18:11:55.718980+0000","mapping_epoch":37,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'439","last_scrub_stamp":"2024-09-12T18:11:55.718895+0000","last_deep_scrub":"263'439","last_deep_scrub_stamp":"2024-09-12T18:11:55.718895+0000","last_clean_scrub_stamp":"2024-09-12T18:11:55.718895+0000","objects_scrubbed":2,"log_size":39,"log_dups_size":400,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:35:23.822201+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2161,"num_read_kb":2024,"num_write":504,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1429,"num_omap_keys":6,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"263'215","reported_seq":851,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:58.516620+0000","last_change":"2024-09-12T18:11:58.516620+0000","last_active":"2024-09-12T18:11:58.516620+0000","last_peered":"2024-09-12T18:11:58.516620+0000","last_clean":"2024-09-12T18:11:58.516620+0000","last_became_active":"2024-09-12T17:10:42.525644+0000","last_became_peered":"2024-09-12T17:10:42.525644+0000","last_unstale":"2024-09-12T18:11:58.516620+0000","last_undegraded":"2024-09-12T18:11:58.516620+0000","last_fullsized":"2024-09-12T18:11:58.516620+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'215","last_scrub_stamp":"2024-09-12T18:11:58.516489+0000","last_deep_scrub":"263'215","last_deep_scrub_stamp":"2024-09-12T18:11:58.516489+0000","last_clean_scrub_stamp":"2024-09-12T18:11:58.516489+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":200,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:52:28.223065+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":480,"num_read_kb":1680,"num_write":1066,"num_write_kb":42245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4,6],"acting":[7,5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:59.753999+0000","last_change":"2024-09-12T18:11:59.753999+0000","last_active":"2024-09-12T18:11:59.753999+0000","last_peered":"2024-09-12T18:11:59.753999+0000","last_clean":"2024-09-12T18:11:59.753999+0000","last_became_active":"2024-09-12T17:10:46.531693+0000","last_became_peered":"2024-09-12T17:10:46.531693+0000","last_unstale":"2024-09-12T18:11:59.753999+0000","last_undegraded":"2024-09-12T18:11:59.753999+0000","last_fullsized":"2024-09-12T18:11:59.753999+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:11:59.753897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:11:59.753897+0000","last_clean_scrub_stamp":"2024-09-12T18:11:59.753897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:56:46.955405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"263'178","reported_seq":774,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:11.589646+0000","last_change":"2024-09-12T18:12:11.589646+0000","last_active":"2024-09-12T18:12:11.589646+0000","last_peered":"2024-09-12T18:12:11.589646+0000","last_clean":"2024-09-12T18:12:11.589646+0000","last_became_active":"2024-09-12T17:10:48.546013+0000","last_became_peered":"2024-09-12T17:10:48.546013+0000","last_unstale":"2024-09-12T18:12:11.589646+0000","last_undegraded":"2024-09-12T18:12:11.589646+0000","last_fullsized":"2024-09-12T18:12:11.589646+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'178","last_scrub_stamp":"2024-09-12T18:12:11.589555+0000","last_deep_scrub":"263'178","last_deep_scrub_stamp":"2024-09-12T18:12:11.589555+0000","last_clean_scrub_stamp":"2024-09-12T18:12:11.589555+0000","objects_scrubbed":7,"log_size":78,"log_dups_size":100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:51:13.452284+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22951,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":229,"num_read_kb":322,"num_write":130,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"263'777","reported_seq":2668,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:13.721455+0000","last_change":"2024-09-12T18:12:13.721455+0000","last_active":"2024-09-12T18:12:13.721455+0000","last_peered":"2024-09-12T18:12:13.721455+0000","last_clean":"2024-09-12T18:12:13.721455+0000","last_became_active":"2024-09-12T17:10:50.557711+0000","last_became_peered":"2024-09-12T17:10:50.557711+0000","last_unstale":"2024-09-12T18:12:13.721455+0000","last_undegraded":"2024-09-12T18:12:13.721455+0000","last_fullsized":"2024-09-12T18:12:13.721455+0000","mapping_epoch":32,"log_start":"263'700","ondisk_log_start":"263'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'777","last_scrub_stamp":"2024-09-12T18:12:13.721361+0000","last_deep_scrub":"263'777","last_deep_scrub_stamp":"2024-09-12T18:12:13.721361+0000","last_clean_scrub_stamp":"2024-09-12T18:12:13.721361+0000","objects_scrubbed":1,"log_size":77,"log_dups_size":700,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:36:39.426338+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"263'105","reported_seq":608,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:18.692520+0000","last_change":"2024-09-12T18:12:18.692520+0000","last_active":"2024-09-12T18:12:18.692520+0000","last_peered":"2024-09-12T18:12:18.692520+0000","last_clean":"2024-09-12T18:12:18.692520+0000","last_became_active":"2024-09-12T17:10:52.570034+0000","last_became_peered":"2024-09-12T17:10:52.570034+0000","last_unstale":"2024-09-12T18:12:18.692520+0000","last_undegraded":"2024-09-12T18:12:18.692520+0000","last_fullsized":"2024-09-12T18:12:18.692520+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'105","last_scrub_stamp":"2024-09-12T18:12:18.692437+0000","last_deep_scrub":"263'105","last_deep_scrub_stamp":"2024-09-12T18:12:18.692437+0000","last_clean_scrub_stamp":"2024-09-12T18:12:18.692437+0000","objects_scrubbed":2,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:12:56.220943+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":442,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":109,"num_read_kb":107,"num_write":228,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"263'459","reported_seq":1996,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:56.689795+0000","last_change":"2024-09-12T18:11:56.689795+0000","last_active":"2024-09-12T18:11:56.689795+0000","last_peered":"2024-09-12T18:11:56.689795+0000","last_clean":"2024-09-12T18:11:56.689795+0000","last_became_active":"2024-09-12T17:10:44.520043+0000","last_became_peered":"2024-09-12T17:10:44.520043+0000","last_unstale":"2024-09-12T18:11:56.689795+0000","last_undegraded":"2024-09-12T18:11:56.689795+0000","last_fullsized":"2024-09-12T18:11:56.689795+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'459","last_scrub_stamp":"2024-09-12T18:11:56.689705+0000","last_deep_scrub":"263'459","last_deep_scrub_stamp":"2024-09-12T18:11:56.689705+0000","last_clean_scrub_stamp":"2024-09-12T18:11:56.689705+0000","objects_scrubbed":2,"log_size":59,"log_dups_size":400,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:12:24.353664+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2352,"num_read_kb":2214,"num_write":541,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":217,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"263'209","reported_seq":860,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:48.213383+0000","last_change":"2024-09-12T18:11:48.213383+0000","last_active":"2024-09-12T18:11:48.213383+0000","last_peered":"2024-09-12T18:11:48.213383+0000","last_clean":"2024-09-12T18:11:48.213383+0000","last_became_active":"2024-09-12T17:10:42.518472+0000","last_became_peered":"2024-09-12T17:10:42.518472+0000","last_unstale":"2024-09-12T18:11:48.213383+0000","last_undegraded":"2024-09-12T18:11:48.213383+0000","last_fullsized":"2024-09-12T18:11:48.213383+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'209","last_scrub_stamp":"2024-09-12T18:11:48.213203+0000","last_deep_scrub":"263'209","last_deep_scrub_stamp":"2024-09-12T18:11:48.213203+0000","last_clean_scrub_stamp":"2024-09-12T18:11:48.213203+0000","objects_scrubbed":7,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:56:57.310254+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":91,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":447,"num_read_kb":52953,"num_write":1076,"num_write_kb":38599,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6,1],"acting":[5,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":503,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:56.759826+0000","last_change":"2024-09-12T18:11:56.759826+0000","last_active":"2024-09-12T18:11:56.759826+0000","last_peered":"2024-09-12T18:11:56.759826+0000","last_clean":"2024-09-12T18:11:56.759826+0000","last_became_active":"2024-09-12T17:10:46.531731+0000","last_became_peered":"2024-09-12T17:10:46.531731+0000","last_unstale":"2024-09-12T18:11:56.759826+0000","last_undegraded":"2024-09-12T18:11:56.759826+0000","last_fullsized":"2024-09-12T18:11:56.759826+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:11:56.759684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:11:56.759684+0000","last_clean_scrub_stamp":"2024-09-12T18:11:56.759684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:53:36.303626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"263'204","reported_seq":849,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:07.754573+0000","last_change":"2024-09-12T18:12:07.754573+0000","last_active":"2024-09-12T18:12:07.754573+0000","last_peered":"2024-09-12T18:12:07.754573+0000","last_clean":"2024-09-12T18:12:07.754573+0000","last_became_active":"2024-09-12T17:10:48.544653+0000","last_became_peered":"2024-09-12T17:10:48.544653+0000","last_unstale":"2024-09-12T18:12:07.754573+0000","last_undegraded":"2024-09-12T18:12:07.754573+0000","last_fullsized":"2024-09-12T18:12:07.754573+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'204","last_scrub_stamp":"2024-09-12T18:12:07.754451+0000","last_deep_scrub":"263'204","last_deep_scrub_stamp":"2024-09-12T18:12:07.754451+0000","last_clean_scrub_stamp":"2024-09-12T18:12:07.754451+0000","objects_scrubbed":5,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:02:06.311539+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13571,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":286,"num_read_kb":396,"num_write":142,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":495,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:04.752859+0000","last_change":"2024-09-12T18:12:04.752859+0000","last_active":"2024-09-12T18:12:04.752859+0000","last_peered":"2024-09-12T18:12:04.752859+0000","last_clean":"2024-09-12T18:12:04.752859+0000","last_became_active":"2024-09-12T17:10:50.555473+0000","last_became_peered":"2024-09-12T17:10:50.555473+0000","last_unstale":"2024-09-12T18:12:04.752859+0000","last_undegraded":"2024-09-12T18:12:04.752859+0000","last_fullsized":"2024-09-12T18:12:04.752859+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:04.752774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:04.752774+0000","last_clean_scrub_stamp":"2024-09-12T18:12:04.752774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:02:14.647232+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"263'119","reported_seq":636,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:13.496114+0000","last_change":"2024-09-12T18:12:13.496114+0000","last_active":"2024-09-12T18:12:13.496114+0000","last_peered":"2024-09-12T18:12:13.496114+0000","last_clean":"2024-09-12T18:12:13.496114+0000","last_became_active":"2024-09-12T17:10:52.571225+0000","last_became_peered":"2024-09-12T17:10:52.571225+0000","last_unstale":"2024-09-12T18:12:13.496114+0000","last_undegraded":"2024-09-12T18:12:13.496114+0000","last_fullsized":"2024-09-12T18:12:13.496114+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'119","last_scrub_stamp":"2024-09-12T18:12:13.496017+0000","last_deep_scrub":"263'119","last_deep_scrub_stamp":"2024-09-12T18:12:13.496017+0000","last_clean_scrub_stamp":"2024-09-12T18:12:13.496017+0000","objects_scrubbed":3,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:05:01.416556+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":910,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":137,"num_read_kb":136,"num_write":254,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"263'475","reported_seq":2098,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:53.403989+0000","last_change":"2024-09-12T18:11:53.403989+0000","last_active":"2024-09-12T18:11:53.403989+0000","last_peered":"2024-09-12T18:11:53.403989+0000","last_clean":"2024-09-12T18:11:53.403989+0000","last_became_active":"2024-09-12T17:10:44.516255+0000","last_became_peered":"2024-09-12T17:10:44.516255+0000","last_unstale":"2024-09-12T18:11:53.403989+0000","last_undegraded":"2024-09-12T18:11:53.403989+0000","last_fullsized":"2024-09-12T18:11:53.403989+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'475","last_scrub_stamp":"2024-09-12T18:11:53.403890+0000","last_deep_scrub":"263'475","last_deep_scrub_stamp":"2024-09-12T18:11:53.403890+0000","last_clean_scrub_stamp":"2024-09-12T18:11:53.403890+0000","objects_scrubbed":3,"log_size":75,"log_dups_size":400,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:52:22.138939+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2470,"num_read_kb":2330,"num_write":539,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":225,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"263'218","reported_seq":846,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:49.555656+0000","last_change":"2024-09-12T18:11:49.555656+0000","last_active":"2024-09-12T18:11:49.555656+0000","last_peered":"2024-09-12T18:11:49.555656+0000","last_clean":"2024-09-12T18:11:49.555656+0000","last_became_active":"2024-09-12T17:11:16.862702+0000","last_became_peered":"2024-09-12T17:11:16.862702+0000","last_unstale":"2024-09-12T18:11:49.555656+0000","last_undegraded":"2024-09-12T18:11:49.555656+0000","last_fullsized":"2024-09-12T18:11:49.555656+0000","mapping_epoch":37,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'218","last_scrub_stamp":"2024-09-12T18:11:49.555539+0000","last_deep_scrub":"263'218","last_deep_scrub_stamp":"2024-09-12T18:11:49.555539+0000","last_clean_scrub_stamp":"2024-09-12T18:11:49.555539+0000","objects_scrubbed":3,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:28:46.491751+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079942,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":414,"num_read_kb":1752,"num_write":1053,"num_write_kb":46733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,4,7],"acting":[3,2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:00.757095+0000","last_change":"2024-09-12T18:12:00.757095+0000","last_active":"2024-09-12T18:12:00.757095+0000","last_peered":"2024-09-12T18:12:00.757095+0000","last_clean":"2024-09-12T18:12:00.757095+0000","last_became_active":"2024-09-12T17:10:46.524638+0000","last_became_peered":"2024-09-12T17:10:46.524638+0000","last_unstale":"2024-09-12T18:12:00.757095+0000","last_undegraded":"2024-09-12T18:12:00.757095+0000","last_fullsized":"2024-09-12T18:12:00.757095+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:00.756978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:00.756978+0000","last_clean_scrub_stamp":"2024-09-12T18:12:00.756978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:05:19.943694+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"263'157","reported_seq":749,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:13.374169+0000","last_change":"2024-09-12T18:12:13.374169+0000","last_active":"2024-09-12T18:12:13.374169+0000","last_peered":"2024-09-12T18:12:13.374169+0000","last_clean":"2024-09-12T18:12:13.374169+0000","last_became_active":"2024-09-12T17:10:48.537923+0000","last_became_peered":"2024-09-12T17:10:48.537923+0000","last_unstale":"2024-09-12T18:12:13.374169+0000","last_undegraded":"2024-09-12T18:12:13.374169+0000","last_fullsized":"2024-09-12T18:12:13.374169+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'157","last_scrub_stamp":"2024-09-12T18:12:13.374068+0000","last_deep_scrub":"263'157","last_deep_scrub_stamp":"2024-09-12T18:12:13.374068+0000","last_clean_scrub_stamp":"2024-09-12T18:12:13.374068+0000","objects_scrubbed":6,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:25:49.577753+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7449,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":229,"num_read_kb":291,"num_write":178,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15964,"num_omap_keys":38,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":501,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:14.682641+0000","last_change":"2024-09-12T18:12:14.682641+0000","last_active":"2024-09-12T18:12:14.682641+0000","last_peered":"2024-09-12T18:12:14.682641+0000","last_clean":"2024-09-12T18:12:14.682641+0000","last_became_active":"2024-09-12T17:10:50.563507+0000","last_became_peered":"2024-09-12T17:10:50.563507+0000","last_unstale":"2024-09-12T18:12:14.682641+0000","last_undegraded":"2024-09-12T18:12:14.682641+0000","last_fullsized":"2024-09-12T18:12:14.682641+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:14.682537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:14.682537+0000","last_clean_scrub_stamp":"2024-09-12T18:12:14.682537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:59:17.113966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"263'129","reported_seq":652,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:23.662315+0000","last_change":"2024-09-12T18:12:23.662315+0000","last_active":"2024-09-12T18:12:23.662315+0000","last_peered":"2024-09-12T18:12:23.662315+0000","last_clean":"2024-09-12T18:12:23.662315+0000","last_became_active":"2024-09-12T17:10:52.575293+0000","last_became_peered":"2024-09-12T17:10:52.575293+0000","last_unstale":"2024-09-12T18:12:23.662315+0000","last_undegraded":"2024-09-12T18:12:23.662315+0000","last_fullsized":"2024-09-12T18:12:23.662315+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'129","last_scrub_stamp":"2024-09-12T18:12:23.662227+0000","last_deep_scrub":"263'129","last_deep_scrub_stamp":"2024-09-12T18:12:23.662227+0000","last_clean_scrub_stamp":"2024-09-12T18:12:23.662227+0000","objects_scrubbed":3,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:40:00.640502+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":248,"num_read_kb":220,"num_write":319,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"263'998","reported_seq":2626,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:54.382075+0000","last_change":"2024-09-12T18:11:54.382075+0000","last_active":"2024-09-12T18:11:54.382075+0000","last_peered":"2024-09-12T18:11:54.382075+0000","last_clean":"2024-09-12T18:11:54.382075+0000","last_became_active":"2024-09-12T17:10:44.515098+0000","last_became_peered":"2024-09-12T17:10:44.515098+0000","last_unstale":"2024-09-12T18:11:54.382075+0000","last_undegraded":"2024-09-12T18:11:54.382075+0000","last_fullsized":"2024-09-12T18:11:54.382075+0000","mapping_epoch":26,"log_start":"263'900","ondisk_log_start":"263'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'998","last_scrub_stamp":"2024-09-12T18:11:54.381986+0000","last_deep_scrub":"263'998","last_deep_scrub_stamp":"2024-09-12T18:11:54.381986+0000","last_clean_scrub_stamp":"2024-09-12T18:11:54.381986+0000","objects_scrubbed":3,"log_size":98,"log_dups_size":900,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:57:33.212113+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4616,"num_read_kb":4072,"num_write":1360,"num_write_kb":579,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"263'209","reported_seq":858,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:48.820208+0000","last_change":"2024-09-12T18:11:48.820208+0000","last_active":"2024-09-12T18:11:48.820208+0000","last_peered":"2024-09-12T18:11:48.820208+0000","last_clean":"2024-09-12T18:11:48.820208+0000","last_became_active":"2024-09-12T17:10:42.515480+0000","last_became_peered":"2024-09-12T17:10:42.515480+0000","last_unstale":"2024-09-12T18:11:48.820208+0000","last_undegraded":"2024-09-12T18:11:48.820208+0000","last_fullsized":"2024-09-12T18:11:48.820208+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'209","last_scrub_stamp":"2024-09-12T18:11:48.820082+0000","last_deep_scrub":"263'209","last_deep_scrub_stamp":"2024-09-12T18:11:48.820082+0000","last_clean_scrub_stamp":"2024-09-12T18:11:48.820082+0000","objects_scrubbed":5,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:31:06.353554+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4364954,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":507,"num_read_kb":28749,"num_write":1020,"num_write_kb":24822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1,7],"acting":[6,4,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":510,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:00.573603+0000","last_change":"2024-09-12T18:12:00.573603+0000","last_active":"2024-09-12T18:12:00.573603+0000","last_peered":"2024-09-12T18:12:00.573603+0000","last_clean":"2024-09-12T18:12:00.573603+0000","last_became_active":"2024-09-12T17:10:46.532552+0000","last_became_peered":"2024-09-12T17:10:46.532552+0000","last_unstale":"2024-09-12T18:12:00.573603+0000","last_undegraded":"2024-09-12T18:12:00.573603+0000","last_fullsized":"2024-09-12T18:12:00.573603+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:00.573517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:00.573517+0000","last_clean_scrub_stamp":"2024-09-12T18:12:00.573517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:33:18.527965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"263'179","reported_seq":773,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:03.736258+0000","last_change":"2024-09-12T18:12:03.736258+0000","last_active":"2024-09-12T18:12:03.736258+0000","last_peered":"2024-09-12T18:12:03.736258+0000","last_clean":"2024-09-12T18:12:03.736258+0000","last_became_active":"2024-09-12T17:10:48.542298+0000","last_became_peered":"2024-09-12T17:10:48.542298+0000","last_unstale":"2024-09-12T18:12:03.736258+0000","last_undegraded":"2024-09-12T18:12:03.736258+0000","last_fullsized":"2024-09-12T18:12:03.736258+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'179","last_scrub_stamp":"2024-09-12T18:12:03.736151+0000","last_deep_scrub":"263'179","last_deep_scrub_stamp":"2024-09-12T18:12:03.736151+0000","last_clean_scrub_stamp":"2024-09-12T18:12:03.736151+0000","objects_scrubbed":7,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:35:13.912374+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5018,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":233,"num_read_kb":318,"num_write":134,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"263'747","reported_seq":2533,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:02.775270+0000","last_change":"2024-09-12T18:12:02.775270+0000","last_active":"2024-09-12T18:12:02.775270+0000","last_peered":"2024-09-12T18:12:02.775270+0000","last_clean":"2024-09-12T18:12:02.775270+0000","last_became_active":"2024-09-12T17:10:50.557305+0000","last_became_peered":"2024-09-12T17:10:50.557305+0000","last_unstale":"2024-09-12T18:12:02.775270+0000","last_undegraded":"2024-09-12T18:12:02.775270+0000","last_fullsized":"2024-09-12T18:12:02.775270+0000","mapping_epoch":32,"log_start":"263'700","ondisk_log_start":"263'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'747","last_scrub_stamp":"2024-09-12T18:12:02.775178+0000","last_deep_scrub":"263'747","last_deep_scrub_stamp":"2024-09-12T18:12:02.775178+0000","last_clean_scrub_stamp":"2024-09-12T18:12:02.775178+0000","objects_scrubbed":1,"log_size":47,"log_dups_size":700,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:35.079087+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"263'122","reported_seq":637,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:11.455948+0000","last_change":"2024-09-12T18:12:11.455948+0000","last_active":"2024-09-12T18:12:11.455948+0000","last_peered":"2024-09-12T18:12:11.455948+0000","last_clean":"2024-09-12T18:12:11.455948+0000","last_became_active":"2024-09-12T17:10:52.571344+0000","last_became_peered":"2024-09-12T17:10:52.571344+0000","last_unstale":"2024-09-12T18:12:11.455948+0000","last_undegraded":"2024-09-12T18:12:11.455948+0000","last_fullsized":"2024-09-12T18:12:11.455948+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'122","last_scrub_stamp":"2024-09-12T18:12:11.455861+0000","last_deep_scrub":"263'122","last_deep_scrub_stamp":"2024-09-12T18:12:11.455861+0000","last_clean_scrub_stamp":"2024-09-12T18:12:11.455861+0000","objects_scrubbed":5,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:51:03.082932+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1852,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":171,"num_read_kb":161,"num_write":288,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"263'490","reported_seq":2165,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:52.356454+0000","last_change":"2024-09-12T18:11:52.356454+0000","last_active":"2024-09-12T18:11:52.356454+0000","last_peered":"2024-09-12T18:11:52.356454+0000","last_clean":"2024-09-12T18:11:52.356454+0000","last_became_active":"2024-09-12T17:10:44.509293+0000","last_became_peered":"2024-09-12T17:10:44.509293+0000","last_unstale":"2024-09-12T18:11:52.356454+0000","last_undegraded":"2024-09-12T18:11:52.356454+0000","last_fullsized":"2024-09-12T18:11:52.356454+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'490","last_scrub_stamp":"2024-09-12T18:11:52.356345+0000","last_deep_scrub":"263'490","last_deep_scrub_stamp":"2024-09-12T18:11:52.356345+0000","last_clean_scrub_stamp":"2024-09-12T18:11:52.356345+0000","objects_scrubbed":4,"log_size":90,"log_dups_size":400,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:17:42.560325+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2823,"num_read_kb":2653,"num_write":584,"num_write_kb":143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1419,"num_omap_keys":6,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"263'186","reported_seq":846,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:47.544051+0000","last_change":"2024-09-12T18:11:47.544051+0000","last_active":"2024-09-12T18:11:47.544051+0000","last_peered":"2024-09-12T18:11:47.544051+0000","last_clean":"2024-09-12T18:11:47.544051+0000","last_became_active":"2024-09-12T17:10:42.515196+0000","last_became_peered":"2024-09-12T17:10:42.515196+0000","last_unstale":"2024-09-12T18:11:47.544051+0000","last_undegraded":"2024-09-12T18:11:47.544051+0000","last_fullsized":"2024-09-12T18:11:47.544051+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'186","last_scrub_stamp":"2024-09-12T18:11:47.543937+0000","last_deep_scrub":"263'186","last_deep_scrub_stamp":"2024-09-12T18:11:47.543937+0000","last_clean_scrub_stamp":"2024-09-12T18:11:47.543937+0000","objects_scrubbed":4,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:47:46.850299+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262519,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":441,"num_read_kb":72235,"num_write":829,"num_write_kb":40150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7,1],"acting":[4,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"263'4","reported_seq":1458,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:11.409697+0000","last_change":"2024-09-12T18:12:11.409697+0000","last_active":"2024-09-12T18:12:11.409697+0000","last_peered":"2024-09-12T18:12:11.409697+0000","last_clean":"2024-09-12T18:12:11.409697+0000","last_became_active":"2024-09-12T17:10:46.531032+0000","last_became_peered":"2024-09-12T17:10:46.531032+0000","last_unstale":"2024-09-12T18:12:11.409697+0000","last_undegraded":"2024-09-12T18:12:11.409697+0000","last_fullsized":"2024-09-12T18:12:11.409697+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-09-12T18:12:11.409610+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-09-12T18:12:11.409610+0000","last_clean_scrub_stamp":"2024-09-12T18:12:11.409610+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:24:08.839096+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":950,"num_read_kb":950,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"263'82","reported_seq":613,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:14.675990+0000","last_change":"2024-09-12T18:12:14.675990+0000","last_active":"2024-09-12T18:12:14.675990+0000","last_peered":"2024-09-12T18:12:14.675990+0000","last_clean":"2024-09-12T18:12:14.675990+0000","last_became_active":"2024-09-12T17:10:48.532817+0000","last_became_peered":"2024-09-12T17:10:48.532817+0000","last_unstale":"2024-09-12T18:12:14.675990+0000","last_undegraded":"2024-09-12T18:12:14.675990+0000","last_fullsized":"2024-09-12T18:12:14.675990+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'82","last_scrub_stamp":"2024-09-12T18:12:14.675899+0000","last_deep_scrub":"263'82","last_deep_scrub_stamp":"2024-09-12T18:12:14.675899+0000","last_clean_scrub_stamp":"2024-09-12T18:12:14.675899+0000","objects_scrubbed":5,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:42:48.311031+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":90,"num_read_kb":85,"num_write":60,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"263'763","reported_seq":2412,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:05.704731+0000","last_change":"2024-09-12T18:12:05.704731+0000","last_active":"2024-09-12T18:12:05.704731+0000","last_peered":"2024-09-12T18:12:05.704731+0000","last_clean":"2024-09-12T18:12:05.704731+0000","last_became_active":"2024-09-12T17:10:50.563002+0000","last_became_peered":"2024-09-12T17:10:50.563002+0000","last_unstale":"2024-09-12T18:12:05.704731+0000","last_undegraded":"2024-09-12T18:12:05.704731+0000","last_fullsized":"2024-09-12T18:12:05.704731+0000","mapping_epoch":32,"log_start":"263'700","ondisk_log_start":"263'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'763","last_scrub_stamp":"2024-09-12T18:12:05.704624+0000","last_deep_scrub":"263'763","last_deep_scrub_stamp":"2024-09-12T18:12:05.704624+0000","last_clean_scrub_stamp":"2024-09-12T18:12:05.704624+0000","objects_scrubbed":1,"log_size":63,"log_dups_size":700,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:44:52.539626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"263'147","reported_seq":655,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:18.340470+0000","last_change":"2024-09-12T18:12:18.340470+0000","last_active":"2024-09-12T18:12:18.340470+0000","last_peered":"2024-09-12T18:12:18.340470+0000","last_clean":"2024-09-12T18:12:18.340470+0000","last_became_active":"2024-09-12T17:10:52.570643+0000","last_became_peered":"2024-09-12T17:10:52.570643+0000","last_unstale":"2024-09-12T18:12:18.340470+0000","last_undegraded":"2024-09-12T18:12:18.340470+0000","last_fullsized":"2024-09-12T18:12:18.340470+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'147","last_scrub_stamp":"2024-09-12T18:12:18.340367+0000","last_deep_scrub":"263'147","last_deep_scrub_stamp":"2024-09-12T18:12:18.340367+0000","last_clean_scrub_stamp":"2024-09-12T18:12:18.340367+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:28:45.461673+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":160,"num_read_kb":158,"num_write":329,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"263'806","reported_seq":2293,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:57.545434+0000","last_change":"2024-09-12T18:11:57.545434+0000","last_active":"2024-09-12T18:11:57.545434+0000","last_peered":"2024-09-12T18:11:57.545434+0000","last_clean":"2024-09-12T18:11:57.545434+0000","last_became_active":"2024-09-12T17:10:44.518111+0000","last_became_peered":"2024-09-12T17:10:44.518111+0000","last_unstale":"2024-09-12T18:11:57.545434+0000","last_undegraded":"2024-09-12T18:11:57.545434+0000","last_fullsized":"2024-09-12T18:11:57.545434+0000","mapping_epoch":26,"log_start":"263'700","ondisk_log_start":"263'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'806","last_scrub_stamp":"2024-09-12T18:11:57.545339+0000","last_deep_scrub":"263'806","last_deep_scrub_stamp":"2024-09-12T18:11:57.545339+0000","last_clean_scrub_stamp":"2024-09-12T18:11:57.545339+0000","objects_scrubbed":2,"log_size":106,"log_dups_size":700,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:34:03.644456+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3856,"num_read_kb":3439,"num_write":1073,"num_write_kb":406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"263'210","reported_seq":838,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:48.517973+0000","last_change":"2024-09-12T18:11:48.517973+0000","last_active":"2024-09-12T18:11:48.517973+0000","last_peered":"2024-09-12T18:11:48.517973+0000","last_clean":"2024-09-12T18:11:48.517973+0000","last_became_active":"2024-09-12T17:10:42.522669+0000","last_became_peered":"2024-09-12T17:10:42.522669+0000","last_unstale":"2024-09-12T18:11:48.517973+0000","last_undegraded":"2024-09-12T18:11:48.517973+0000","last_fullsized":"2024-09-12T18:11:48.517973+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'210","last_scrub_stamp":"2024-09-12T18:11:48.517865+0000","last_deep_scrub":"263'210","last_deep_scrub_stamp":"2024-09-12T18:11:48.517865+0000","last_clean_scrub_stamp":"2024-09-12T18:11:48.517865+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:15:40.427265+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":435,"num_read_kb":8704,"num_write":950,"num_write_kb":27929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,4],"acting":[3,1,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":512,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:06.336266+0000","last_change":"2024-09-12T18:12:06.336266+0000","last_active":"2024-09-12T18:12:06.336266+0000","last_peered":"2024-09-12T18:12:06.336266+0000","last_clean":"2024-09-12T18:12:06.336266+0000","last_became_active":"2024-09-12T17:10:46.533572+0000","last_became_peered":"2024-09-12T17:10:46.533572+0000","last_unstale":"2024-09-12T18:12:06.336266+0000","last_undegraded":"2024-09-12T18:12:06.336266+0000","last_fullsized":"2024-09-12T18:12:06.336266+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:06.336175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:06.336175+0000","last_clean_scrub_stamp":"2024-09-12T18:12:06.336175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:37:00.694932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"263'255","reported_seq":873,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:12.386853+0000","last_change":"2024-09-12T18:12:12.386853+0000","last_active":"2024-09-12T18:12:12.386853+0000","last_peered":"2024-09-12T18:12:12.386853+0000","last_clean":"2024-09-12T18:12:12.386853+0000","last_became_active":"2024-09-12T17:10:48.542616+0000","last_became_peered":"2024-09-12T17:10:48.542616+0000","last_unstale":"2024-09-12T18:12:12.386853+0000","last_undegraded":"2024-09-12T18:12:12.386853+0000","last_fullsized":"2024-09-12T18:12:12.386853+0000","mapping_epoch":30,"log_start":"263'200","ondisk_log_start":"263'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'255","last_scrub_stamp":"2024-09-12T18:12:12.386728+0000","last_deep_scrub":"263'255","last_deep_scrub_stamp":"2024-09-12T18:12:12.386728+0000","last_clean_scrub_stamp":"2024-09-12T18:12:12.386728+0000","objects_scrubbed":9,"log_size":55,"log_dups_size":200,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:10:23.253010+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5964,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":933,"num_read_kb":1007,"num_write":1456,"num_write_kb":1313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":489246,"num_omap_keys":1130,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":498,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:03.738357+0000","last_change":"2024-09-12T18:12:03.738357+0000","last_active":"2024-09-12T18:12:03.738357+0000","last_peered":"2024-09-12T18:12:03.738357+0000","last_clean":"2024-09-12T18:12:03.738357+0000","last_became_active":"2024-09-12T17:10:50.550189+0000","last_became_peered":"2024-09-12T17:10:50.550189+0000","last_unstale":"2024-09-12T18:12:03.738357+0000","last_undegraded":"2024-09-12T18:12:03.738357+0000","last_fullsized":"2024-09-12T18:12:03.738357+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:03.738233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:03.738233+0000","last_clean_scrub_stamp":"2024-09-12T18:12:03.738233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:20:01.107417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"263'166","reported_seq":683,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:12.478687+0000","last_change":"2024-09-12T18:12:12.478687+0000","last_active":"2024-09-12T18:12:12.478687+0000","last_peered":"2024-09-12T18:12:12.478687+0000","last_clean":"2024-09-12T18:12:12.478687+0000","last_became_active":"2024-09-12T17:10:52.572508+0000","last_became_peered":"2024-09-12T17:10:52.572508+0000","last_unstale":"2024-09-12T18:12:12.478687+0000","last_undegraded":"2024-09-12T18:12:12.478687+0000","last_fullsized":"2024-09-12T18:12:12.478687+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'166","last_scrub_stamp":"2024-09-12T18:12:12.478578+0000","last_deep_scrub":"263'166","last_deep_scrub_stamp":"2024-09-12T18:12:12.478578+0000","last_clean_scrub_stamp":"2024-09-12T18:12:12.478578+0000","objects_scrubbed":4,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:48:01.094220+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":869,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":242,"num_read_kb":227,"num_write":399,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"263'2315","reported_seq":3936,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:54.768516+0000","last_change":"2024-09-12T18:11:54.768516+0000","last_active":"2024-09-12T18:11:54.768516+0000","last_peered":"2024-09-12T18:11:54.768516+0000","last_clean":"2024-09-12T18:11:54.768516+0000","last_became_active":"2024-09-12T17:10:44.515045+0000","last_became_peered":"2024-09-12T17:10:44.515045+0000","last_unstale":"2024-09-12T18:11:54.768516+0000","last_undegraded":"2024-09-12T18:11:54.768516+0000","last_fullsized":"2024-09-12T18:11:54.768516+0000","mapping_epoch":26,"log_start":"263'2300","ondisk_log_start":"263'2300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2315","last_scrub_stamp":"2024-09-12T18:11:54.768411+0000","last_deep_scrub":"263'2315","last_deep_scrub_stamp":"2024-09-12T18:11:54.768411+0000","last_clean_scrub_stamp":"2024-09-12T18:11:54.768411+0000","objects_scrubbed":2,"log_size":15,"log_dups_size":2300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:01:21.144459+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10108,"num_read_kb":8675,"num_write":3400,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"263'74","reported_seq":622,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:48.454645+0000","last_change":"2024-09-12T18:11:48.454645+0000","last_active":"2024-09-12T18:11:48.454645+0000","last_peered":"2024-09-12T18:11:48.454645+0000","last_clean":"2024-09-12T18:11:48.454645+0000","last_became_active":"2024-09-12T17:10:26.807964+0000","last_became_peered":"2024-09-12T17:10:26.807964+0000","last_unstale":"2024-09-12T18:11:48.454645+0000","last_undegraded":"2024-09-12T18:11:48.454645+0000","last_fullsized":"2024-09-12T18:11:48.454645+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'74","last_scrub_stamp":"2024-09-12T18:11:48.454546+0000","last_deep_scrub":"263'74","last_deep_scrub_stamp":"2024-09-12T18:11:48.454546+0000","last_clean_scrub_stamp":"2024-09-12T18:11:48.454546+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:42:01.929137+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"263'2","reported_seq":533,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:53.320142+0000","last_change":"2024-09-12T18:11:53.320142+0000","last_active":"2024-09-12T18:11:53.320142+0000","last_peered":"2024-09-12T18:11:53.320142+0000","last_clean":"2024-09-12T18:11:53.320142+0000","last_became_active":"2024-09-12T17:10:31.846572+0000","last_became_peered":"2024-09-12T17:10:31.846572+0000","last_unstale":"2024-09-12T18:11:53.320142+0000","last_undegraded":"2024-09-12T18:11:53.320142+0000","last_fullsized":"2024-09-12T18:11:53.320142+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T18:11:53.320051+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T18:11:53.320051+0000","last_clean_scrub_stamp":"2024-09-12T18:11:53.320051+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:30:24.755502+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.00060306800000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"263'227","reported_seq":856,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:46.512390+0000","last_change":"2024-09-12T18:11:46.512390+0000","last_active":"2024-09-12T18:11:46.512390+0000","last_peered":"2024-09-12T18:11:46.512390+0000","last_clean":"2024-09-12T18:11:46.512390+0000","last_became_active":"2024-09-12T17:10:42.527288+0000","last_became_peered":"2024-09-12T17:10:42.527288+0000","last_unstale":"2024-09-12T18:11:46.512390+0000","last_undegraded":"2024-09-12T18:11:46.512390+0000","last_fullsized":"2024-09-12T18:11:46.512390+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'227","last_scrub_stamp":"2024-09-12T18:11:46.512298+0000","last_deep_scrub":"263'227","last_deep_scrub_stamp":"2024-09-12T18:11:46.512298+0000","last_clean_scrub_stamp":"2024-09-12T18:11:46.512298+0000","objects_scrubbed":3,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:55:14.060256+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":95,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":424,"num_read_kb":3487,"num_write":1109,"num_write_kb":42610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6,4],"acting":[3,5,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"263'4","reported_seq":985,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:06.580020+0000","last_change":"2024-09-12T18:12:06.580020+0000","last_active":"2024-09-12T18:12:06.580020+0000","last_peered":"2024-09-12T18:12:06.580020+0000","last_clean":"2024-09-12T18:12:06.580020+0000","last_became_active":"2024-09-12T17:10:46.523069+0000","last_became_peered":"2024-09-12T17:10:46.523069+0000","last_unstale":"2024-09-12T18:12:06.580020+0000","last_undegraded":"2024-09-12T18:12:06.580020+0000","last_fullsized":"2024-09-12T18:12:06.580020+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-09-12T18:12:06.579875+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-09-12T18:12:06.579875+0000","last_clean_scrub_stamp":"2024-09-12T18:12:06.579875+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:55:16.328100+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":722,"num_read_kb":720,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"263'325","reported_seq":1034,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:14.453279+0000","last_change":"2024-09-12T18:12:14.453279+0000","last_active":"2024-09-12T18:12:14.453279+0000","last_peered":"2024-09-12T18:12:14.453279+0000","last_clean":"2024-09-12T18:12:14.453279+0000","last_became_active":"2024-09-12T17:10:48.542462+0000","last_became_peered":"2024-09-12T17:10:48.542462+0000","last_unstale":"2024-09-12T18:12:14.453279+0000","last_undegraded":"2024-09-12T18:12:14.453279+0000","last_fullsized":"2024-09-12T18:12:14.453279+0000","mapping_epoch":30,"log_start":"263'300","ondisk_log_start":"263'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'325","last_scrub_stamp":"2024-09-12T18:12:14.453164+0000","last_deep_scrub":"263'325","last_deep_scrub_stamp":"2024-09-12T18:12:14.453164+0000","last_clean_scrub_stamp":"2024-09-12T18:12:14.453164+0000","objects_scrubbed":6,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:09:40.928743+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37371,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":611,"num_read_kb":866,"num_write":568,"num_write_kb":434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":106660,"num_omap_keys":256,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:12.674548+0000","last_change":"2024-09-12T18:12:12.674548+0000","last_active":"2024-09-12T18:12:12.674548+0000","last_peered":"2024-09-12T18:12:12.674548+0000","last_clean":"2024-09-12T18:12:12.674548+0000","last_became_active":"2024-09-12T17:10:50.558129+0000","last_became_peered":"2024-09-12T17:10:50.558129+0000","last_unstale":"2024-09-12T18:12:12.674548+0000","last_undegraded":"2024-09-12T18:12:12.674548+0000","last_fullsized":"2024-09-12T18:12:12.674548+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:12.674459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:12.674459+0000","last_clean_scrub_stamp":"2024-09-12T18:12:12.674459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:23:39.886250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"263'217","reported_seq":942,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:09.712447+0000","last_change":"2024-09-12T18:12:09.712447+0000","last_active":"2024-09-12T18:12:09.712447+0000","last_peered":"2024-09-12T18:12:09.712447+0000","last_clean":"2024-09-12T18:12:09.712447+0000","last_became_active":"2024-09-12T17:10:52.574433+0000","last_became_peered":"2024-09-12T17:10:52.574433+0000","last_unstale":"2024-09-12T18:12:09.712447+0000","last_undegraded":"2024-09-12T18:12:09.712447+0000","last_fullsized":"2024-09-12T18:12:09.712447+0000","mapping_epoch":34,"log_start":"263'200","ondisk_log_start":"263'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'217","last_scrub_stamp":"2024-09-12T18:12:09.712350+0000","last_deep_scrub":"263'217","last_deep_scrub_stamp":"2024-09-12T18:12:09.712350+0000","last_clean_scrub_stamp":"2024-09-12T18:12:09.712350+0000","objects_scrubbed":4,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:24:37.061346+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":852,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":555,"num_read_kb":537,"num_write":455,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":66,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"263'583","reported_seq":2177,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:55.730687+0000","last_change":"2024-09-12T18:11:55.730687+0000","last_active":"2024-09-12T18:11:55.730687+0000","last_peered":"2024-09-12T18:11:55.730687+0000","last_clean":"2024-09-12T18:11:55.730687+0000","last_became_active":"2024-09-12T17:10:44.520484+0000","last_became_peered":"2024-09-12T17:10:44.520484+0000","last_unstale":"2024-09-12T18:11:55.730687+0000","last_undegraded":"2024-09-12T18:11:55.730687+0000","last_fullsized":"2024-09-12T18:11:55.730687+0000","mapping_epoch":26,"log_start":"263'500","ondisk_log_start":"263'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'583","last_scrub_stamp":"2024-09-12T18:11:55.730573+0000","last_deep_scrub":"263'583","last_deep_scrub_stamp":"2024-09-12T18:11:55.730573+0000","last_clean_scrub_stamp":"2024-09-12T18:11:55.730573+0000","objects_scrubbed":1,"log_size":83,"log_dups_size":500,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:47:46.532008+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3105,"num_read_kb":2836,"num_write":745,"num_write_kb":252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":528,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:49.492585+0000","last_change":"2024-09-12T18:11:49.492585+0000","last_active":"2024-09-12T18:11:49.492585+0000","last_peered":"2024-09-12T18:11:49.492585+0000","last_clean":"2024-09-12T18:11:49.492585+0000","last_became_active":"2024-09-12T17:10:31.848972+0000","last_became_peered":"2024-09-12T17:10:31.848972+0000","last_unstale":"2024-09-12T18:11:49.492585+0000","last_undegraded":"2024-09-12T18:11:49.492585+0000","last_fullsized":"2024-09-12T18:11:49.492585+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:11:49.492494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:11:49.492494+0000","last_clean_scrub_stamp":"2024-09-12T18:11:49.492494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:54:40.685079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054881099999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"263'247","reported_seq":900,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:44.672013+0000","last_change":"2024-09-12T18:11:44.672013+0000","last_active":"2024-09-12T18:11:44.672013+0000","last_peered":"2024-09-12T18:11:44.672013+0000","last_clean":"2024-09-12T18:11:44.672013+0000","last_became_active":"2024-09-12T17:10:42.518190+0000","last_became_peered":"2024-09-12T17:10:42.518190+0000","last_unstale":"2024-09-12T18:11:44.672013+0000","last_undegraded":"2024-09-12T18:11:44.672013+0000","last_fullsized":"2024-09-12T18:11:44.672013+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'247","last_scrub_stamp":"2024-09-12T18:11:44.671868+0000","last_deep_scrub":"263'247","last_deep_scrub_stamp":"2024-09-12T18:11:44.671868+0000","last_clean_scrub_stamp":"2024-09-12T18:11:44.671868+0000","objects_scrubbed":3,"log_size":47,"log_dups_size":200,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:21:51.032960+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":522,"num_read_kb":6824,"num_write":1149,"num_write_kb":47378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3,5],"acting":[0,4,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":505,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:08.487418+0000","last_change":"2024-09-12T18:12:08.487418+0000","last_active":"2024-09-12T18:12:08.487418+0000","last_peered":"2024-09-12T18:12:08.487418+0000","last_clean":"2024-09-12T18:12:08.487418+0000","last_became_active":"2024-09-12T17:10:46.528192+0000","last_became_peered":"2024-09-12T17:10:46.528192+0000","last_unstale":"2024-09-12T18:12:08.487418+0000","last_undegraded":"2024-09-12T18:12:08.487418+0000","last_fullsized":"2024-09-12T18:12:08.487418+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:08.487317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:08.487317+0000","last_clean_scrub_stamp":"2024-09-12T18:12:08.487317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:16:35.101051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"263'884","reported_seq":2553,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:07.517456+0000","last_change":"2024-09-12T18:12:07.517456+0000","last_active":"2024-09-12T18:12:07.517456+0000","last_peered":"2024-09-12T18:12:07.517456+0000","last_clean":"2024-09-12T18:12:07.517456+0000","last_became_active":"2024-09-12T17:10:48.544823+0000","last_became_peered":"2024-09-12T17:10:48.544823+0000","last_unstale":"2024-09-12T18:12:07.517456+0000","last_undegraded":"2024-09-12T18:12:07.517456+0000","last_fullsized":"2024-09-12T18:12:07.517456+0000","mapping_epoch":30,"log_start":"263'800","ondisk_log_start":"263'800","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'884","last_scrub_stamp":"2024-09-12T18:12:07.517337+0000","last_deep_scrub":"263'884","last_deep_scrub_stamp":"2024-09-12T18:12:07.517337+0000","last_clean_scrub_stamp":"2024-09-12T18:12:07.517337+0000","objects_scrubbed":11,"log_size":84,"log_dups_size":800,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:11:07.692251+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19071,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1197,"num_read_kb":1359,"num_write":312,"num_write_kb":143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6238,"num_omap_keys":18,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:16.624404+0000","last_change":"2024-09-12T18:12:16.624404+0000","last_active":"2024-09-12T18:12:16.624404+0000","last_peered":"2024-09-12T18:12:16.624404+0000","last_clean":"2024-09-12T18:12:16.624404+0000","last_became_active":"2024-09-12T17:10:50.557660+0000","last_became_peered":"2024-09-12T17:10:50.557660+0000","last_unstale":"2024-09-12T18:12:16.624404+0000","last_undegraded":"2024-09-12T18:12:16.624404+0000","last_fullsized":"2024-09-12T18:12:16.624404+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:16.624312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:16.624312+0000","last_clean_scrub_stamp":"2024-09-12T18:12:16.624312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:46:22.828612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"263'190","reported_seq":765,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:14.477632+0000","last_change":"2024-09-12T18:12:14.477632+0000","last_active":"2024-09-12T18:12:14.477632+0000","last_peered":"2024-09-12T18:12:14.477632+0000","last_clean":"2024-09-12T18:12:14.477632+0000","last_became_active":"2024-09-12T17:10:52.671120+0000","last_became_peered":"2024-09-12T17:10:52.671120+0000","last_unstale":"2024-09-12T18:12:14.477632+0000","last_undegraded":"2024-09-12T18:12:14.477632+0000","last_fullsized":"2024-09-12T18:12:14.477632+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'190","last_scrub_stamp":"2024-09-12T18:12:14.477532+0000","last_deep_scrub":"263'190","last_deep_scrub_stamp":"2024-09-12T18:12:14.477532+0000","last_clean_scrub_stamp":"2024-09-12T18:12:14.477532+0000","objects_scrubbed":3,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:51:56.384984+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":855,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":437,"num_read_kb":369,"num_write":356,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"263'341","reported_seq":1699,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:54.594576+0000","last_change":"2024-09-12T18:11:54.594576+0000","last_active":"2024-09-12T18:11:54.594576+0000","last_peered":"2024-09-12T18:11:54.594576+0000","last_clean":"2024-09-12T18:11:54.594576+0000","last_became_active":"2024-09-12T17:10:44.516640+0000","last_became_peered":"2024-09-12T17:10:44.516640+0000","last_unstale":"2024-09-12T18:11:54.594576+0000","last_undegraded":"2024-09-12T18:11:54.594576+0000","last_fullsized":"2024-09-12T18:11:54.594576+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'341","last_scrub_stamp":"2024-09-12T18:11:54.594493+0000","last_deep_scrub":"263'341","last_deep_scrub_stamp":"2024-09-12T18:11:54.594493+0000","last_clean_scrub_stamp":"2024-09-12T18:11:54.594493+0000","objects_scrubbed":3,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:23:17.401626+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1748,"num_read_kb":1673,"num_write":375,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":527,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:45.850440+0000","last_change":"2024-09-12T18:11:45.850440+0000","last_active":"2024-09-12T18:11:45.850440+0000","last_peered":"2024-09-12T18:11:45.850440+0000","last_clean":"2024-09-12T18:11:45.850440+0000","last_became_active":"2024-09-12T17:10:31.841982+0000","last_became_peered":"2024-09-12T17:10:31.841982+0000","last_unstale":"2024-09-12T18:11:45.850440+0000","last_undegraded":"2024-09-12T18:11:45.850440+0000","last_fullsized":"2024-09-12T18:11:45.850440+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:11:45.850369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:11:45.850369+0000","last_clean_scrub_stamp":"2024-09-12T18:11:45.850369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:50:52.981654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00030998799999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"263'168","reported_seq":791,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:47.720241+0000","last_change":"2024-09-12T18:11:47.720241+0000","last_active":"2024-09-12T18:11:47.720241+0000","last_peered":"2024-09-12T18:11:47.720241+0000","last_clean":"2024-09-12T18:11:47.720241+0000","last_became_active":"2024-09-12T17:10:42.509396+0000","last_became_peered":"2024-09-12T17:10:42.509396+0000","last_unstale":"2024-09-12T18:11:47.720241+0000","last_undegraded":"2024-09-12T18:11:47.720241+0000","last_fullsized":"2024-09-12T18:11:47.720241+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'168","last_scrub_stamp":"2024-09-12T18:11:47.720156+0000","last_deep_scrub":"263'168","last_deep_scrub_stamp":"2024-09-12T18:11:47.720156+0000","last_clean_scrub_stamp":"2024-09-12T18:11:47.720156+0000","objects_scrubbed":3,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:45:50.082004+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":350137,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":379,"num_read_kb":11016,"num_write":845,"num_write_kb":10341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6,5],"acting":[1,2,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"263'2","reported_seq":505,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:01.753020+0000","last_change":"2024-09-12T18:12:01.753020+0000","last_active":"2024-09-12T18:12:01.753020+0000","last_peered":"2024-09-12T18:12:01.753020+0000","last_clean":"2024-09-12T18:12:01.753020+0000","last_became_active":"2024-09-12T17:10:46.528878+0000","last_became_peered":"2024-09-12T17:10:46.528878+0000","last_unstale":"2024-09-12T18:12:01.753020+0000","last_undegraded":"2024-09-12T18:12:01.753020+0000","last_fullsized":"2024-09-12T18:12:01.753020+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T18:12:01.752936+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T18:12:01.752936+0000","last_clean_scrub_stamp":"2024-09-12T18:12:01.752936+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:05:28.456818+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"263'259","reported_seq":1529,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:10.570833+0000","last_change":"2024-09-12T18:12:10.570833+0000","last_active":"2024-09-12T18:12:10.570833+0000","last_peered":"2024-09-12T18:12:10.570833+0000","last_clean":"2024-09-12T18:12:10.570833+0000","last_became_active":"2024-09-12T17:10:48.543196+0000","last_became_peered":"2024-09-12T17:10:48.543196+0000","last_unstale":"2024-09-12T18:12:10.570833+0000","last_undegraded":"2024-09-12T18:12:10.570833+0000","last_fullsized":"2024-09-12T18:12:10.570833+0000","mapping_epoch":30,"log_start":"263'200","ondisk_log_start":"263'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'259","last_scrub_stamp":"2024-09-12T18:12:10.570716+0000","last_deep_scrub":"263'259","last_deep_scrub_stamp":"2024-09-12T18:12:10.570716+0000","last_clean_scrub_stamp":"2024-09-12T18:12:10.570716+0000","objects_scrubbed":9,"log_size":59,"log_dups_size":200,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:18:05.341247+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":209,"num_read_kb":201,"num_write":185,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5582,"num_omap_keys":14,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":503,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:11.670935+0000","last_change":"2024-09-12T18:12:11.670935+0000","last_active":"2024-09-12T18:12:11.670935+0000","last_peered":"2024-09-12T18:12:11.670935+0000","last_clean":"2024-09-12T18:12:11.670935+0000","last_became_active":"2024-09-12T17:10:50.558980+0000","last_became_peered":"2024-09-12T17:10:50.558980+0000","last_unstale":"2024-09-12T18:12:11.670935+0000","last_undegraded":"2024-09-12T18:12:11.670935+0000","last_fullsized":"2024-09-12T18:12:11.670935+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:11.670829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:11.670829+0000","last_clean_scrub_stamp":"2024-09-12T18:12:11.670829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:54:18.253183+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"263'258","reported_seq":864,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:24.683507+0000","last_change":"2024-09-12T18:12:24.683507+0000","last_active":"2024-09-12T18:12:24.683507+0000","last_peered":"2024-09-12T18:12:24.683507+0000","last_clean":"2024-09-12T18:12:24.683507+0000","last_became_active":"2024-09-12T17:10:52.563885+0000","last_became_peered":"2024-09-12T17:10:52.563885+0000","last_unstale":"2024-09-12T18:12:24.683507+0000","last_undegraded":"2024-09-12T18:12:24.683507+0000","last_fullsized":"2024-09-12T18:12:24.683507+0000","mapping_epoch":34,"log_start":"263'200","ondisk_log_start":"263'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'258","last_scrub_stamp":"2024-09-12T18:12:24.683417+0000","last_deep_scrub":"263'258","last_deep_scrub_stamp":"2024-09-12T18:12:24.683417+0000","last_clean_scrub_stamp":"2024-09-12T18:12:24.683417+0000","objects_scrubbed":2,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:16:31.315453+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":520,"num_read_kb":542,"num_write":569,"num_write_kb":161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1193,"num_omap_keys":7,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"263'669","reported_seq":2221,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:55.553257+0000","last_change":"2024-09-12T18:11:55.553257+0000","last_active":"2024-09-12T18:11:55.553257+0000","last_peered":"2024-09-12T18:11:55.553257+0000","last_clean":"2024-09-12T18:11:55.553257+0000","last_became_active":"2024-09-12T17:10:44.515807+0000","last_became_peered":"2024-09-12T17:10:44.515807+0000","last_unstale":"2024-09-12T18:11:55.553257+0000","last_undegraded":"2024-09-12T18:11:55.553257+0000","last_fullsized":"2024-09-12T18:11:55.553257+0000","mapping_epoch":26,"log_start":"263'600","ondisk_log_start":"263'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'669","last_scrub_stamp":"2024-09-12T18:11:55.553162+0000","last_deep_scrub":"263'669","last_deep_scrub_stamp":"2024-09-12T18:11:55.553162+0000","last_clean_scrub_stamp":"2024-09-12T18:11:55.553162+0000","objects_scrubbed":5,"log_size":69,"log_dups_size":600,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:56:28.156022+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3415,"num_read_kb":3057,"num_write":984,"num_write_kb":466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":477,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"263'3","reported_seq":534,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:47.214677+0000","last_change":"2024-09-12T18:11:47.214677+0000","last_active":"2024-09-12T18:11:47.214677+0000","last_peered":"2024-09-12T18:11:47.214677+0000","last_clean":"2024-09-12T18:11:47.214677+0000","last_became_active":"2024-09-12T17:10:31.849085+0000","last_became_peered":"2024-09-12T17:10:31.849085+0000","last_unstale":"2024-09-12T18:11:47.214677+0000","last_undegraded":"2024-09-12T18:11:47.214677+0000","last_fullsized":"2024-09-12T18:11:47.214677+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'3","last_scrub_stamp":"2024-09-12T18:11:47.214591+0000","last_deep_scrub":"263'3","last_deep_scrub_stamp":"2024-09-12T18:11:47.214591+0000","last_clean_scrub_stamp":"2024-09-12T18:11:47.214591+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:31:02.245023+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.0011727,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"263'232","reported_seq":931,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:46.498359+0000","last_change":"2024-09-12T18:11:46.498359+0000","last_active":"2024-09-12T18:11:46.498359+0000","last_peered":"2024-09-12T18:11:46.498359+0000","last_clean":"2024-09-12T18:11:46.498359+0000","last_became_active":"2024-09-12T17:10:42.529499+0000","last_became_peered":"2024-09-12T17:10:42.529499+0000","last_unstale":"2024-09-12T18:11:46.498359+0000","last_undegraded":"2024-09-12T18:11:46.498359+0000","last_fullsized":"2024-09-12T18:11:46.498359+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'232","last_scrub_stamp":"2024-09-12T18:11:46.498219+0000","last_deep_scrub":"263'232","last_deep_scrub_stamp":"2024-09-12T18:11:46.498219+0000","last_clean_scrub_stamp":"2024-09-12T18:11:46.498219+0000","objects_scrubbed":2,"log_size":32,"log_dups_size":200,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:52:39.137136+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262174,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":565,"num_read_kb":10247,"num_write":1100,"num_write_kb":30448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,6],"acting":[4,5,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":511,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:04.687350+0000","last_change":"2024-09-12T18:12:04.687350+0000","last_active":"2024-09-12T18:12:04.687350+0000","last_peered":"2024-09-12T18:12:04.687350+0000","last_clean":"2024-09-12T18:12:04.687350+0000","last_became_active":"2024-09-12T17:10:46.526136+0000","last_became_peered":"2024-09-12T17:10:46.526136+0000","last_unstale":"2024-09-12T18:12:04.687350+0000","last_undegraded":"2024-09-12T18:12:04.687350+0000","last_fullsized":"2024-09-12T18:12:04.687350+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:04.687264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:04.687264+0000","last_clean_scrub_stamp":"2024-09-12T18:12:04.687264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:47:47.732114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"263'146","reported_seq":700,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:12.632726+0000","last_change":"2024-09-12T18:12:12.632726+0000","last_active":"2024-09-12T18:12:12.632726+0000","last_peered":"2024-09-12T18:12:12.632726+0000","last_clean":"2024-09-12T18:12:12.632726+0000","last_became_active":"2024-09-12T17:10:48.536247+0000","last_became_peered":"2024-09-12T17:10:48.536247+0000","last_unstale":"2024-09-12T18:12:12.632726+0000","last_undegraded":"2024-09-12T18:12:12.632726+0000","last_fullsized":"2024-09-12T18:12:12.632726+0000","mapping_epoch":30,"log_start":"263'100","ondisk_log_start":"263'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'146","last_scrub_stamp":"2024-09-12T18:12:12.632618+0000","last_deep_scrub":"263'146","last_deep_scrub_stamp":"2024-09-12T18:12:12.632618+0000","last_clean_scrub_stamp":"2024-09-12T18:12:12.632618+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:49:46.275446+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":163,"num_read_kb":156,"num_write":120,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3226,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:02.727739+0000","last_change":"2024-09-12T18:12:02.727739+0000","last_active":"2024-09-12T18:12:02.727739+0000","last_peered":"2024-09-12T18:12:02.727739+0000","last_clean":"2024-09-12T18:12:02.727739+0000","last_became_active":"2024-09-12T17:10:50.555747+0000","last_became_peered":"2024-09-12T17:10:50.555747+0000","last_unstale":"2024-09-12T18:12:02.727739+0000","last_undegraded":"2024-09-12T18:12:02.727739+0000","last_fullsized":"2024-09-12T18:12:02.727739+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:02.727650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:02.727650+0000","last_clean_scrub_stamp":"2024-09-12T18:12:02.727650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:59:58.866824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"263'123","reported_seq":676,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:19.515646+0000","last_change":"2024-09-12T18:12:19.515646+0000","last_active":"2024-09-12T18:12:19.515646+0000","last_peered":"2024-09-12T18:12:19.515646+0000","last_clean":"2024-09-12T18:12:19.515646+0000","last_became_active":"2024-09-12T17:10:52.574956+0000","last_became_peered":"2024-09-12T17:10:52.574956+0000","last_unstale":"2024-09-12T18:12:19.515646+0000","last_undegraded":"2024-09-12T18:12:19.515646+0000","last_fullsized":"2024-09-12T18:12:19.515646+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'123","last_scrub_stamp":"2024-09-12T18:12:19.515561+0000","last_deep_scrub":"263'123","last_deep_scrub_stamp":"2024-09-12T18:12:19.515561+0000","last_clean_scrub_stamp":"2024-09-12T18:12:19.515561+0000","objects_scrubbed":1,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:43:22.393991+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":427,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":242,"num_read_kb":241,"num_write":285,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"263'473","reported_seq":2087,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:53.613963+0000","last_change":"2024-09-12T18:11:53.613963+0000","last_active":"2024-09-12T18:11:53.613963+0000","last_peered":"2024-09-12T18:11:53.613963+0000","last_clean":"2024-09-12T18:11:53.613963+0000","last_became_active":"2024-09-12T17:10:44.516258+0000","last_became_peered":"2024-09-12T17:10:44.516258+0000","last_unstale":"2024-09-12T18:11:53.613963+0000","last_undegraded":"2024-09-12T18:11:53.613963+0000","last_fullsized":"2024-09-12T18:11:53.613963+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'473","last_scrub_stamp":"2024-09-12T18:11:53.613870+0000","last_deep_scrub":"263'473","last_deep_scrub_stamp":"2024-09-12T18:11:53.613870+0000","last_clean_scrub_stamp":"2024-09-12T18:11:53.613870+0000","objects_scrubbed":2,"log_size":73,"log_dups_size":400,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:01:14.309219+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2512,"num_read_kb":2369,"num_write":577,"num_write_kb":149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"263'182","reported_seq":889,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:57.349904+0000","last_change":"2024-09-12T18:11:57.349904+0000","last_active":"2024-09-12T18:11:57.349904+0000","last_peered":"2024-09-12T18:11:57.349904+0000","last_clean":"2024-09-12T18:11:57.349904+0000","last_became_active":"2024-09-12T17:10:42.520777+0000","last_became_peered":"2024-09-12T17:10:42.520777+0000","last_unstale":"2024-09-12T18:11:57.349904+0000","last_undegraded":"2024-09-12T18:11:57.349904+0000","last_fullsized":"2024-09-12T18:11:57.349904+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'182","last_scrub_stamp":"2024-09-12T18:11:57.349756+0000","last_deep_scrub":"263'182","last_deep_scrub_stamp":"2024-09-12T18:11:57.349756+0000","last_clean_scrub_stamp":"2024-09-12T18:11:57.349756+0000","objects_scrubbed":4,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:09:50.642477+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":574,"num_read_kb":36969,"num_write":896,"num_write_kb":42705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":537,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:45.674428+0000","last_change":"2024-09-12T18:11:45.674428+0000","last_active":"2024-09-12T18:11:45.674428+0000","last_peered":"2024-09-12T18:11:45.674428+0000","last_clean":"2024-09-12T18:11:45.674428+0000","last_became_active":"2024-09-12T17:10:32.177463+0000","last_became_peered":"2024-09-12T17:10:32.177463+0000","last_unstale":"2024-09-12T18:11:45.674428+0000","last_undegraded":"2024-09-12T18:11:45.674428+0000","last_fullsized":"2024-09-12T18:11:45.674428+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:11:45.674357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:11:45.674357+0000","last_clean_scrub_stamp":"2024-09-12T18:11:45.674357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:46:59.598150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059857599999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":511,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:03.662959+0000","last_change":"2024-09-12T18:12:03.662959+0000","last_active":"2024-09-12T18:12:03.662959+0000","last_peered":"2024-09-12T18:12:03.662959+0000","last_clean":"2024-09-12T18:12:03.662959+0000","last_became_active":"2024-09-12T17:10:46.528499+0000","last_became_peered":"2024-09-12T17:10:46.528499+0000","last_unstale":"2024-09-12T18:12:03.662959+0000","last_undegraded":"2024-09-12T18:12:03.662959+0000","last_fullsized":"2024-09-12T18:12:03.662959+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:03.662874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:03.662874+0000","last_clean_scrub_stamp":"2024-09-12T18:12:03.662874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:25:39.425009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"263'284","reported_seq":964,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:06.718101+0000","last_change":"2024-09-12T18:12:06.718101+0000","last_active":"2024-09-12T18:12:06.718101+0000","last_peered":"2024-09-12T18:12:06.718101+0000","last_clean":"2024-09-12T18:12:06.718101+0000","last_became_active":"2024-09-12T17:10:48.539913+0000","last_became_peered":"2024-09-12T17:10:48.539913+0000","last_unstale":"2024-09-12T18:12:06.718101+0000","last_undegraded":"2024-09-12T18:12:06.718101+0000","last_fullsized":"2024-09-12T18:12:06.718101+0000","mapping_epoch":30,"log_start":"260'200","ondisk_log_start":"260'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'284","last_scrub_stamp":"2024-09-12T18:12:06.717998+0000","last_deep_scrub":"263'284","last_deep_scrub_stamp":"2024-09-12T18:12:06.717998+0000","last_clean_scrub_stamp":"2024-09-12T18:12:06.717998+0000","objects_scrubbed":10,"log_size":84,"log_dups_size":200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:18:50.263181+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10695,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":387,"num_read_kb":478,"num_write":220,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4334,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":506,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:15.327262+0000","last_change":"2024-09-12T18:12:15.327262+0000","last_active":"2024-09-12T18:12:15.327262+0000","last_peered":"2024-09-12T18:12:15.327262+0000","last_clean":"2024-09-12T18:12:15.327262+0000","last_became_active":"2024-09-12T17:10:50.555068+0000","last_became_peered":"2024-09-12T17:10:50.555068+0000","last_unstale":"2024-09-12T18:12:15.327262+0000","last_undegraded":"2024-09-12T18:12:15.327262+0000","last_fullsized":"2024-09-12T18:12:15.327262+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:15.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:15.327146+0000","last_clean_scrub_stamp":"2024-09-12T18:12:15.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:35:28.660361+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"263'157","reported_seq":671,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:20.655030+0000","last_change":"2024-09-12T18:12:20.655030+0000","last_active":"2024-09-12T18:12:20.655030+0000","last_peered":"2024-09-12T18:12:20.655030+0000","last_clean":"2024-09-12T18:12:20.655030+0000","last_became_active":"2024-09-12T17:10:52.671238+0000","last_became_peered":"2024-09-12T17:10:52.671238+0000","last_unstale":"2024-09-12T18:12:20.655030+0000","last_undegraded":"2024-09-12T18:12:20.655030+0000","last_fullsized":"2024-09-12T18:12:20.655030+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'157","last_scrub_stamp":"2024-09-12T18:12:20.654938+0000","last_deep_scrub":"263'157","last_deep_scrub_stamp":"2024-09-12T18:12:20.654938+0000","last_clean_scrub_stamp":"2024-09-12T18:12:20.654938+0000","objects_scrubbed":4,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:56:04.155999+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":925,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":183,"num_read_kb":179,"num_write":356,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"263'542","reported_seq":2242,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:54.729977+0000","last_change":"2024-09-12T18:11:54.729977+0000","last_active":"2024-09-12T18:11:54.729977+0000","last_peered":"2024-09-12T18:11:54.729977+0000","last_clean":"2024-09-12T18:11:54.729977+0000","last_became_active":"2024-09-12T17:10:44.513543+0000","last_became_peered":"2024-09-12T17:10:44.513543+0000","last_unstale":"2024-09-12T18:11:54.729977+0000","last_undegraded":"2024-09-12T18:11:54.729977+0000","last_fullsized":"2024-09-12T18:11:54.729977+0000","mapping_epoch":26,"log_start":"263'500","ondisk_log_start":"263'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'542","last_scrub_stamp":"2024-09-12T18:11:54.729880+0000","last_deep_scrub":"263'542","last_deep_scrub_stamp":"2024-09-12T18:11:54.729880+0000","last_clean_scrub_stamp":"2024-09-12T18:11:54.729880+0000","objects_scrubbed":3,"log_size":42,"log_dups_size":500,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:17.102641+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3000,"num_read_kb":2785,"num_write":670,"num_write_kb":215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2809,"num_omap_keys":11,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"263'214","reported_seq":901,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:48.710948+0000","last_change":"2024-09-12T18:11:48.710948+0000","last_active":"2024-09-12T18:11:48.710948+0000","last_peered":"2024-09-12T18:11:48.710948+0000","last_clean":"2024-09-12T18:11:48.710948+0000","last_became_active":"2024-09-12T17:10:42.524130+0000","last_became_peered":"2024-09-12T17:10:42.524130+0000","last_unstale":"2024-09-12T18:11:48.710948+0000","last_undegraded":"2024-09-12T18:11:48.710948+0000","last_fullsized":"2024-09-12T18:11:48.710948+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'214","last_scrub_stamp":"2024-09-12T18:11:48.710850+0000","last_deep_scrub":"263'214","last_deep_scrub_stamp":"2024-09-12T18:11:48.710850+0000","last_clean_scrub_stamp":"2024-09-12T18:11:48.710850+0000","objects_scrubbed":4,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:31:10.663400+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2067952,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":586,"num_read_kb":68430,"num_write":1040,"num_write_kb":36992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,5],"acting":[1,2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":527,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:51.437825+0000","last_change":"2024-09-12T18:11:51.437825+0000","last_active":"2024-09-12T18:11:51.437825+0000","last_peered":"2024-09-12T18:11:51.437825+0000","last_clean":"2024-09-12T18:11:51.437825+0000","last_became_active":"2024-09-12T17:10:32.177457+0000","last_became_peered":"2024-09-12T17:10:32.177457+0000","last_unstale":"2024-09-12T18:11:51.437825+0000","last_undegraded":"2024-09-12T18:11:51.437825+0000","last_fullsized":"2024-09-12T18:11:51.437825+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:11:51.437714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:11:51.437714+0000","last_clean_scrub_stamp":"2024-09-12T18:11:51.437714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:34:58.844283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000468751,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":508,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:59.691132+0000","last_change":"2024-09-12T18:11:59.691132+0000","last_active":"2024-09-12T18:11:59.691132+0000","last_peered":"2024-09-12T18:11:59.691132+0000","last_clean":"2024-09-12T18:11:59.691132+0000","last_became_active":"2024-09-12T17:10:46.527299+0000","last_became_peered":"2024-09-12T17:10:46.527299+0000","last_unstale":"2024-09-12T18:11:59.691132+0000","last_undegraded":"2024-09-12T18:11:59.691132+0000","last_fullsized":"2024-09-12T18:11:59.691132+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:11:59.691048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:11:59.691048+0000","last_clean_scrub_stamp":"2024-09-12T18:11:59.691048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:17:03.709838+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"263'242","reported_seq":824,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:06.501164+0000","last_change":"2024-09-12T18:12:06.501164+0000","last_active":"2024-09-12T18:12:06.501164+0000","last_peered":"2024-09-12T18:12:06.501164+0000","last_clean":"2024-09-12T18:12:06.501164+0000","last_became_active":"2024-09-12T17:10:48.538190+0000","last_became_peered":"2024-09-12T17:10:48.538190+0000","last_unstale":"2024-09-12T18:12:06.501164+0000","last_undegraded":"2024-09-12T18:12:06.501164+0000","last_fullsized":"2024-09-12T18:12:06.501164+0000","mapping_epoch":30,"log_start":"263'200","ondisk_log_start":"263'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'242","last_scrub_stamp":"2024-09-12T18:12:06.501075+0000","last_deep_scrub":"263'242","last_deep_scrub_stamp":"2024-09-12T18:12:06.501075+0000","last_clean_scrub_stamp":"2024-09-12T18:12:06.501075+0000","objects_scrubbed":8,"log_size":42,"log_dups_size":200,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:33:45.536325+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":276,"num_read_kb":262,"num_write":250,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6602,"num_omap_keys":16,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"263'780","reported_seq":2761,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:15.471440+0000","last_change":"2024-09-12T18:12:15.471440+0000","last_active":"2024-09-12T18:12:15.471440+0000","last_peered":"2024-09-12T18:12:15.471440+0000","last_clean":"2024-09-12T18:12:15.471440+0000","last_became_active":"2024-09-12T17:10:50.561112+0000","last_became_peered":"2024-09-12T17:10:50.561112+0000","last_unstale":"2024-09-12T18:12:15.471440+0000","last_undegraded":"2024-09-12T18:12:15.471440+0000","last_fullsized":"2024-09-12T18:12:15.471440+0000","mapping_epoch":32,"log_start":"263'700","ondisk_log_start":"263'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'780","last_scrub_stamp":"2024-09-12T18:12:15.471350+0000","last_deep_scrub":"263'780","last_deep_scrub_stamp":"2024-09-12T18:12:15.471350+0000","last_clean_scrub_stamp":"2024-09-12T18:12:15.471350+0000","objects_scrubbed":1,"log_size":80,"log_dups_size":700,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:20:09.955680+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"263'97","reported_seq":609,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:09.821979+0000","last_change":"2024-09-12T17:10:52.672259+0000","last_active":"2024-09-12T18:11:09.821979+0000","last_peered":"2024-09-12T18:11:09.821979+0000","last_clean":"2024-09-12T18:11:09.821979+0000","last_became_active":"2024-09-12T17:10:52.671116+0000","last_became_peered":"2024-09-12T17:10:52.671116+0000","last_unstale":"2024-09-12T18:11:09.821979+0000","last_undegraded":"2024-09-12T18:11:09.821979+0000","last_fullsized":"2024-09-12T18:11:09.821979+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":505,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":188,"num_read_kb":171,"num_write":234,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"263'780","reported_seq":2432,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:01.710175+0000","last_change":"2024-09-12T18:12:01.710175+0000","last_active":"2024-09-12T18:12:01.710175+0000","last_peered":"2024-09-12T18:12:01.710175+0000","last_clean":"2024-09-12T18:12:01.710175+0000","last_became_active":"2024-09-12T17:10:44.511450+0000","last_became_peered":"2024-09-12T17:10:44.511450+0000","last_unstale":"2024-09-12T18:12:01.710175+0000","last_undegraded":"2024-09-12T18:12:01.710175+0000","last_fullsized":"2024-09-12T18:12:01.710175+0000","mapping_epoch":26,"log_start":"263'700","ondisk_log_start":"263'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'780","last_scrub_stamp":"2024-09-12T18:12:01.710085+0000","last_deep_scrub":"263'780","last_deep_scrub_stamp":"2024-09-12T18:12:01.710085+0000","last_clean_scrub_stamp":"2024-09-12T18:12:01.710085+0000","objects_scrubbed":3,"log_size":80,"log_dups_size":700,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:44:55.441743+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3773,"num_read_kb":3378,"num_write":1080,"num_write_kb":423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":268,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"263'167","reported_seq":757,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:47.536255+0000","last_change":"2024-09-12T18:11:47.536255+0000","last_active":"2024-09-12T18:11:47.536255+0000","last_peered":"2024-09-12T18:11:47.536255+0000","last_clean":"2024-09-12T18:11:47.536255+0000","last_became_active":"2024-09-12T17:10:42.526472+0000","last_became_peered":"2024-09-12T17:10:42.526472+0000","last_unstale":"2024-09-12T18:11:47.536255+0000","last_undegraded":"2024-09-12T18:11:47.536255+0000","last_fullsized":"2024-09-12T18:11:47.536255+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'167","last_scrub_stamp":"2024-09-12T18:11:47.536135+0000","last_deep_scrub":"263'167","last_deep_scrub_stamp":"2024-09-12T18:11:47.536135+0000","last_clean_scrub_stamp":"2024-09-12T18:11:47.536135+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":100,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:57:32.050771+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":300,"num_read_kb":1418,"num_write":797,"num_write_kb":46804,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,0],"acting":[3,5,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":536,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:46.672452+0000","last_change":"2024-09-12T18:11:46.672452+0000","last_active":"2024-09-12T18:11:46.672452+0000","last_peered":"2024-09-12T18:11:46.672452+0000","last_clean":"2024-09-12T18:11:46.672452+0000","last_became_active":"2024-09-12T17:10:31.845481+0000","last_became_peered":"2024-09-12T17:10:31.845481+0000","last_unstale":"2024-09-12T18:11:46.672452+0000","last_undegraded":"2024-09-12T18:11:46.672452+0000","last_fullsized":"2024-09-12T18:11:46.672452+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:11:46.672379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:11:46.672379+0000","last_clean_scrub_stamp":"2024-09-12T18:11:46.672379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:35:09.073477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060466100000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":514,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:09.320609+0000","last_change":"2024-09-12T18:12:09.320609+0000","last_active":"2024-09-12T18:12:09.320609+0000","last_peered":"2024-09-12T18:12:09.320609+0000","last_clean":"2024-09-12T18:12:09.320609+0000","last_became_active":"2024-09-12T17:10:46.530275+0000","last_became_peered":"2024-09-12T17:10:46.530275+0000","last_unstale":"2024-09-12T18:12:09.320609+0000","last_undegraded":"2024-09-12T18:12:09.320609+0000","last_fullsized":"2024-09-12T18:12:09.320609+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:09.320512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:09.320512+0000","last_clean_scrub_stamp":"2024-09-12T18:12:09.320512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:40:01.605587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"263'133","reported_seq":689,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:08.358290+0000","last_change":"2024-09-12T18:12:08.358290+0000","last_active":"2024-09-12T18:12:08.358290+0000","last_peered":"2024-09-12T18:12:08.358290+0000","last_clean":"2024-09-12T18:12:08.358290+0000","last_became_active":"2024-09-12T17:10:48.541795+0000","last_became_peered":"2024-09-12T17:10:48.541795+0000","last_unstale":"2024-09-12T18:12:08.358290+0000","last_undegraded":"2024-09-12T18:12:08.358290+0000","last_fullsized":"2024-09-12T18:12:08.358290+0000","mapping_epoch":30,"log_start":"263'100","ondisk_log_start":"263'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'133","last_scrub_stamp":"2024-09-12T18:12:08.358159+0000","last_deep_scrub":"263'133","last_deep_scrub_stamp":"2024-09-12T18:12:08.358159+0000","last_clean_scrub_stamp":"2024-09-12T18:12:08.358159+0000","objects_scrubbed":5,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:21:15.600207+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":142,"num_read_kb":133,"num_write":96,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"263'791","reported_seq":4459,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:19.661322+0000","last_change":"2024-09-12T18:12:19.661322+0000","last_active":"2024-09-12T18:12:19.661322+0000","last_peered":"2024-09-12T18:12:19.661322+0000","last_clean":"2024-09-12T18:12:19.661322+0000","last_became_active":"2024-09-12T17:10:50.559932+0000","last_became_peered":"2024-09-12T17:10:50.559932+0000","last_unstale":"2024-09-12T18:12:19.661322+0000","last_undegraded":"2024-09-12T18:12:19.661322+0000","last_fullsized":"2024-09-12T18:12:19.661322+0000","mapping_epoch":32,"log_start":"263'700","ondisk_log_start":"263'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'791","last_scrub_stamp":"2024-09-12T18:12:19.661251+0000","last_deep_scrub":"263'791","last_deep_scrub_stamp":"2024-09-12T18:12:19.661251+0000","last_clean_scrub_stamp":"2024-09-12T18:12:19.661251+0000","objects_scrubbed":1,"log_size":91,"log_dups_size":700,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:02:46.335094+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"263'291","reported_seq":840,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:19.674577+0000","last_change":"2024-09-12T18:12:19.674577+0000","last_active":"2024-09-12T18:12:19.674577+0000","last_peered":"2024-09-12T18:12:19.674577+0000","last_clean":"2024-09-12T18:12:19.674577+0000","last_became_active":"2024-09-12T17:10:52.570545+0000","last_became_peered":"2024-09-12T17:10:52.570545+0000","last_unstale":"2024-09-12T18:12:19.674577+0000","last_undegraded":"2024-09-12T18:12:19.674577+0000","last_fullsized":"2024-09-12T18:12:19.674577+0000","mapping_epoch":34,"log_start":"263'200","ondisk_log_start":"263'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'291","last_scrub_stamp":"2024-09-12T18:12:19.674475+0000","last_deep_scrub":"263'291","last_deep_scrub_stamp":"2024-09-12T18:12:19.674475+0000","last_clean_scrub_stamp":"2024-09-12T18:12:19.674475+0000","objects_scrubbed":3,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:10:18.881598+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":466,"num_read_kb":447,"num_write":645,"num_write_kb":207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":178,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"263'473","reported_seq":1911,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:49.479082+0000","last_change":"2024-09-12T18:11:49.479082+0000","last_active":"2024-09-12T18:11:49.479082+0000","last_peered":"2024-09-12T18:11:49.479082+0000","last_clean":"2024-09-12T18:11:49.479082+0000","last_became_active":"2024-09-12T17:10:44.517508+0000","last_became_peered":"2024-09-12T17:10:44.517508+0000","last_unstale":"2024-09-12T18:11:49.479082+0000","last_undegraded":"2024-09-12T18:11:49.479082+0000","last_fullsized":"2024-09-12T18:11:49.479082+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'473","last_scrub_stamp":"2024-09-12T18:11:49.478985+0000","last_deep_scrub":"263'473","last_deep_scrub_stamp":"2024-09-12T18:11:49.478985+0000","last_clean_scrub_stamp":"2024-09-12T18:11:49.478985+0000","objects_scrubbed":2,"log_size":73,"log_dups_size":400,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:50:01.319281+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2400,"num_read_kb":2225,"num_write":610,"num_write_kb":202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"263'211","reported_seq":857,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:45.628205+0000","last_change":"2024-09-12T18:11:45.628205+0000","last_active":"2024-09-12T18:11:45.628205+0000","last_peered":"2024-09-12T18:11:45.628205+0000","last_clean":"2024-09-12T18:11:45.628205+0000","last_became_active":"2024-09-12T17:10:42.518404+0000","last_became_peered":"2024-09-12T17:10:42.518404+0000","last_unstale":"2024-09-12T18:11:45.628205+0000","last_undegraded":"2024-09-12T18:11:45.628205+0000","last_fullsized":"2024-09-12T18:11:45.628205+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'211","last_scrub_stamp":"2024-09-12T18:11:45.628122+0000","last_deep_scrub":"263'211","last_deep_scrub_stamp":"2024-09-12T18:11:45.628122+0000","last_clean_scrub_stamp":"2024-09-12T18:11:45.628122+0000","objects_scrubbed":1,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:54:21.121479+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170264,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":504,"num_read_kb":3973,"num_write":1040,"num_write_kb":36643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,7],"acting":[0,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":531,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:47.857743+0000","last_change":"2024-09-12T18:11:47.857743+0000","last_active":"2024-09-12T18:11:47.857743+0000","last_peered":"2024-09-12T18:11:47.857743+0000","last_clean":"2024-09-12T18:11:47.857743+0000","last_became_active":"2024-09-12T17:10:31.846123+0000","last_became_peered":"2024-09-12T17:10:31.846123+0000","last_unstale":"2024-09-12T18:11:47.857743+0000","last_undegraded":"2024-09-12T18:11:47.857743+0000","last_fullsized":"2024-09-12T18:11:47.857743+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:11:47.857651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:11:47.857651+0000","last_clean_scrub_stamp":"2024-09-12T18:11:47.857651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:48:18.963656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042024599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":508,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:07.594888+0000","last_change":"2024-09-12T18:12:07.594888+0000","last_active":"2024-09-12T18:12:07.594888+0000","last_peered":"2024-09-12T18:12:07.594888+0000","last_clean":"2024-09-12T18:12:07.594888+0000","last_became_active":"2024-09-12T17:10:46.530457+0000","last_became_peered":"2024-09-12T17:10:46.530457+0000","last_unstale":"2024-09-12T18:12:07.594888+0000","last_undegraded":"2024-09-12T18:12:07.594888+0000","last_fullsized":"2024-09-12T18:12:07.594888+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:07.594799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:07.594799+0000","last_clean_scrub_stamp":"2024-09-12T18:12:07.594799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:51:45.714432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"263'318","reported_seq":1045,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:09.558913+0000","last_change":"2024-09-12T18:12:09.558913+0000","last_active":"2024-09-12T18:12:09.558913+0000","last_peered":"2024-09-12T18:12:09.558913+0000","last_clean":"2024-09-12T18:12:09.558913+0000","last_became_active":"2024-09-12T17:10:48.542991+0000","last_became_peered":"2024-09-12T17:10:48.542991+0000","last_unstale":"2024-09-12T18:12:09.558913+0000","last_undegraded":"2024-09-12T18:12:09.558913+0000","last_fullsized":"2024-09-12T18:12:09.558913+0000","mapping_epoch":30,"log_start":"263'300","ondisk_log_start":"263'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'318","last_scrub_stamp":"2024-09-12T18:12:09.558796+0000","last_deep_scrub":"263'318","last_deep_scrub_stamp":"2024-09-12T18:12:09.558796+0000","last_clean_scrub_stamp":"2024-09-12T18:12:09.558796+0000","objects_scrubbed":8,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:34:34.474636+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23115,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":468,"num_read_kb":620,"num_write":234,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:16.626285+0000","last_change":"2024-09-12T18:12:16.626285+0000","last_active":"2024-09-12T18:12:16.626285+0000","last_peered":"2024-09-12T18:12:16.626285+0000","last_clean":"2024-09-12T18:12:16.626285+0000","last_became_active":"2024-09-12T17:10:50.553469+0000","last_became_peered":"2024-09-12T17:10:50.553469+0000","last_unstale":"2024-09-12T18:12:16.626285+0000","last_undegraded":"2024-09-12T18:12:16.626285+0000","last_fullsized":"2024-09-12T18:12:16.626285+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:16.626189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:16.626189+0000","last_clean_scrub_stamp":"2024-09-12T18:12:16.626189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:33:19.529386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"263'116","reported_seq":625,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:20.477405+0000","last_change":"2024-09-12T18:12:20.477405+0000","last_active":"2024-09-12T18:12:20.477405+0000","last_peered":"2024-09-12T18:12:20.477405+0000","last_clean":"2024-09-12T18:12:20.477405+0000","last_became_active":"2024-09-12T17:10:52.578713+0000","last_became_peered":"2024-09-12T17:10:52.578713+0000","last_unstale":"2024-09-12T18:12:20.477405+0000","last_undegraded":"2024-09-12T18:12:20.477405+0000","last_fullsized":"2024-09-12T18:12:20.477405+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'116","last_scrub_stamp":"2024-09-12T18:12:20.477311+0000","last_deep_scrub":"263'116","last_deep_scrub_stamp":"2024-09-12T18:12:20.477311+0000","last_clean_scrub_stamp":"2024-09-12T18:12:20.477311+0000","objects_scrubbed":2,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:33:41.317355+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":176,"num_read_kb":166,"num_write":279,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"263'125","reported_seq":695,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:23.612017+0000","last_change":"2024-09-12T18:12:23.612017+0000","last_active":"2024-09-12T18:12:23.612017+0000","last_peered":"2024-09-12T18:12:23.612017+0000","last_clean":"2024-09-12T18:12:23.612017+0000","last_became_active":"2024-09-12T17:10:52.576481+0000","last_became_peered":"2024-09-12T17:10:52.576481+0000","last_unstale":"2024-09-12T18:12:23.612017+0000","last_undegraded":"2024-09-12T18:12:23.612017+0000","last_fullsized":"2024-09-12T18:12:23.612017+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'125","last_scrub_stamp":"2024-09-12T18:12:23.611923+0000","last_deep_scrub":"263'125","last_deep_scrub_stamp":"2024-09-12T18:12:23.611923+0000","last_clean_scrub_stamp":"2024-09-12T18:12:23.611923+0000","objects_scrubbed":1,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:46:16.808557+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":242,"num_read_kb":237,"num_write":285,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"263'890","reported_seq":2488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:57.379777+0000","last_change":"2024-09-12T18:11:57.379777+0000","last_active":"2024-09-12T18:11:57.379777+0000","last_peered":"2024-09-12T18:11:57.379777+0000","last_clean":"2024-09-12T18:11:57.379777+0000","last_became_active":"2024-09-12T17:10:44.507455+0000","last_became_peered":"2024-09-12T17:10:44.507455+0000","last_unstale":"2024-09-12T18:11:57.379777+0000","last_undegraded":"2024-09-12T18:11:57.379777+0000","last_fullsized":"2024-09-12T18:11:57.379777+0000","mapping_epoch":26,"log_start":"263'800","ondisk_log_start":"263'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'890","last_scrub_stamp":"2024-09-12T18:11:57.379681+0000","last_deep_scrub":"263'890","last_deep_scrub_stamp":"2024-09-12T18:11:57.379681+0000","last_clean_scrub_stamp":"2024-09-12T18:11:57.379681+0000","objects_scrubbed":4,"log_size":90,"log_dups_size":800,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:11:27.008068+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4276,"num_read_kb":3830,"num_write":1165,"num_write_kb":436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2297,"num_omap_keys":9,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"263'212","reported_seq":871,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:48.500179+0000","last_change":"2024-09-12T18:11:48.500179+0000","last_active":"2024-09-12T18:11:48.500179+0000","last_peered":"2024-09-12T18:11:48.500179+0000","last_clean":"2024-09-12T18:11:48.500179+0000","last_became_active":"2024-09-12T17:10:42.519656+0000","last_became_peered":"2024-09-12T17:10:42.519656+0000","last_unstale":"2024-09-12T18:11:48.500179+0000","last_undegraded":"2024-09-12T18:11:48.500179+0000","last_fullsized":"2024-09-12T18:11:48.500179+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'212","last_scrub_stamp":"2024-09-12T18:11:48.500025+0000","last_deep_scrub":"263'212","last_deep_scrub_stamp":"2024-09-12T18:11:48.500025+0000","last_clean_scrub_stamp":"2024-09-12T18:11:48.500025+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:50:20.130407+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":812867,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":526,"num_read_kb":10349,"num_write":1065,"num_write_kb":31428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,6],"acting":[4,7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":509,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:02.561683+0000","last_change":"2024-09-12T18:12:02.561683+0000","last_active":"2024-09-12T18:12:02.561683+0000","last_peered":"2024-09-12T18:12:02.561683+0000","last_clean":"2024-09-12T18:12:02.561683+0000","last_became_active":"2024-09-12T17:10:46.527445+0000","last_became_peered":"2024-09-12T17:10:46.527445+0000","last_unstale":"2024-09-12T18:12:02.561683+0000","last_undegraded":"2024-09-12T18:12:02.561683+0000","last_fullsized":"2024-09-12T18:12:02.561683+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:02.561588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:02.561588+0000","last_clean_scrub_stamp":"2024-09-12T18:12:02.561588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:10:49.689079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"263'145","reported_seq":730,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:13.656453+0000","last_change":"2024-09-12T18:12:13.656453+0000","last_active":"2024-09-12T18:12:13.656453+0000","last_peered":"2024-09-12T18:12:13.656453+0000","last_clean":"2024-09-12T18:12:13.656453+0000","last_became_active":"2024-09-12T17:10:48.536021+0000","last_became_peered":"2024-09-12T17:10:48.536021+0000","last_unstale":"2024-09-12T18:12:13.656453+0000","last_undegraded":"2024-09-12T18:12:13.656453+0000","last_fullsized":"2024-09-12T18:12:13.656453+0000","mapping_epoch":30,"log_start":"263'100","ondisk_log_start":"263'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'145","last_scrub_stamp":"2024-09-12T18:12:13.656340+0000","last_deep_scrub":"263'145","last_deep_scrub_stamp":"2024-09-12T18:12:13.656340+0000","last_clean_scrub_stamp":"2024-09-12T18:12:13.656340+0000","objects_scrubbed":5,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:23:59.661931+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9595,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":179,"num_read_kb":232,"num_write":92,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:21.686871+0000","last_change":"2024-09-12T18:12:21.686871+0000","last_active":"2024-09-12T18:12:21.686871+0000","last_peered":"2024-09-12T18:12:21.686871+0000","last_clean":"2024-09-12T18:12:21.686871+0000","last_became_active":"2024-09-12T17:10:50.555251+0000","last_became_peered":"2024-09-12T17:10:50.555251+0000","last_unstale":"2024-09-12T18:12:21.686871+0000","last_undegraded":"2024-09-12T18:12:21.686871+0000","last_fullsized":"2024-09-12T18:12:21.686871+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:21.686780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:21.686780+0000","last_clean_scrub_stamp":"2024-09-12T18:12:21.686780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:25:01.260932+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"263'142","reported_seq":663,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:09.818435+0000","last_change":"2024-09-12T17:10:52.573415+0000","last_active":"2024-09-12T18:11:09.818435+0000","last_peered":"2024-09-12T18:11:09.818435+0000","last_clean":"2024-09-12T18:11:09.818435+0000","last_became_active":"2024-09-12T17:10:52.573040+0000","last_became_peered":"2024-09-12T17:10:52.573040+0000","last_unstale":"2024-09-12T18:11:09.818435+0000","last_undegraded":"2024-09-12T18:11:09.818435+0000","last_fullsized":"2024-09-12T18:11:09.818435+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:17:53.786959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":264,"num_read_kb":238,"num_write":352,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"263'1131","reported_seq":2801,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:56.527202+0000","last_change":"2024-09-12T18:11:56.527202+0000","last_active":"2024-09-12T18:11:56.527202+0000","last_peered":"2024-09-12T18:11:56.527202+0000","last_clean":"2024-09-12T18:11:56.527202+0000","last_became_active":"2024-09-12T17:10:44.509117+0000","last_became_peered":"2024-09-12T17:10:44.509117+0000","last_unstale":"2024-09-12T18:11:56.527202+0000","last_undegraded":"2024-09-12T18:11:56.527202+0000","last_fullsized":"2024-09-12T18:11:56.527202+0000","mapping_epoch":26,"log_start":"263'1100","ondisk_log_start":"263'1100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1131","last_scrub_stamp":"2024-09-12T18:11:56.527108+0000","last_deep_scrub":"263'1131","last_deep_scrub_stamp":"2024-09-12T18:11:56.527108+0000","last_clean_scrub_stamp":"2024-09-12T18:11:56.527108+0000","objects_scrubbed":3,"log_size":31,"log_dups_size":1100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:31:43.564901+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5331,"num_read_kb":4747,"num_write":1539,"num_write_kb":622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2500,"num_omap_keys":10,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"263'206","reported_seq":823,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:47.843275+0000","last_change":"2024-09-12T18:11:47.843275+0000","last_active":"2024-09-12T18:11:47.843275+0000","last_peered":"2024-09-12T18:11:47.843275+0000","last_clean":"2024-09-12T18:11:47.843275+0000","last_became_active":"2024-09-12T17:11:16.617505+0000","last_became_peered":"2024-09-12T17:11:16.617505+0000","last_unstale":"2024-09-12T18:11:47.843275+0000","last_undegraded":"2024-09-12T18:11:47.843275+0000","last_fullsized":"2024-09-12T18:11:47.843275+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'206","last_scrub_stamp":"2024-09-12T18:11:47.843156+0000","last_deep_scrub":"263'206","last_deep_scrub_stamp":"2024-09-12T18:11:47.843156+0000","last_clean_scrub_stamp":"2024-09-12T18:11:47.843156+0000","objects_scrubbed":5,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:01:44.908699+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2936797,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":495,"num_read_kb":50143,"num_write":995,"num_write_kb":47141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,4],"acting":[2,3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":504,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:08.639895+0000","last_change":"2024-09-12T18:12:08.639895+0000","last_active":"2024-09-12T18:12:08.639895+0000","last_peered":"2024-09-12T18:12:08.639895+0000","last_clean":"2024-09-12T18:12:08.639895+0000","last_became_active":"2024-09-12T17:10:46.531835+0000","last_became_peered":"2024-09-12T17:10:46.531835+0000","last_unstale":"2024-09-12T18:12:08.639895+0000","last_undegraded":"2024-09-12T18:12:08.639895+0000","last_fullsized":"2024-09-12T18:12:08.639895+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:08.639821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:08.639821+0000","last_clean_scrub_stamp":"2024-09-12T18:12:08.639821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:23:37.446484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"263'49","reported_seq":565,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:09.719777+0000","last_change":"2024-09-12T18:12:09.719777+0000","last_active":"2024-09-12T18:12:09.719777+0000","last_peered":"2024-09-12T18:12:09.719777+0000","last_clean":"2024-09-12T18:12:09.719777+0000","last_became_active":"2024-09-12T17:10:48.540975+0000","last_became_peered":"2024-09-12T17:10:48.540975+0000","last_unstale":"2024-09-12T18:12:09.719777+0000","last_undegraded":"2024-09-12T18:12:09.719777+0000","last_fullsized":"2024-09-12T18:12:09.719777+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'49","last_scrub_stamp":"2024-09-12T18:12:09.719655+0000","last_deep_scrub":"263'49","last_deep_scrub_stamp":"2024-09-12T18:12:09.719655+0000","last_clean_scrub_stamp":"2024-09-12T18:12:09.719655+0000","objects_scrubbed":3,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:00:37.550586+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":38,"num_read_kb":36,"num_write":28,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:17.604666+0000","last_change":"2024-09-12T18:12:17.604666+0000","last_active":"2024-09-12T18:12:17.604666+0000","last_peered":"2024-09-12T18:12:17.604666+0000","last_clean":"2024-09-12T18:12:17.604666+0000","last_became_active":"2024-09-12T17:10:50.553581+0000","last_became_peered":"2024-09-12T17:10:50.553581+0000","last_unstale":"2024-09-12T18:12:17.604666+0000","last_undegraded":"2024-09-12T18:12:17.604666+0000","last_fullsized":"2024-09-12T18:12:17.604666+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:17.604578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:17.604578+0000","last_clean_scrub_stamp":"2024-09-12T18:12:17.604578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:22:57.955149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"263'193","reported_seq":722,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:22.604718+0000","last_change":"2024-09-12T18:12:22.604718+0000","last_active":"2024-09-12T18:12:22.604718+0000","last_peered":"2024-09-12T18:12:22.604718+0000","last_clean":"2024-09-12T18:12:22.604718+0000","last_became_active":"2024-09-12T17:10:52.573306+0000","last_became_peered":"2024-09-12T17:10:52.573306+0000","last_unstale":"2024-09-12T18:12:22.604718+0000","last_undegraded":"2024-09-12T18:12:22.604718+0000","last_fullsized":"2024-09-12T18:12:22.604718+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'193","last_scrub_stamp":"2024-09-12T18:12:22.604613+0000","last_deep_scrub":"263'193","last_deep_scrub_stamp":"2024-09-12T18:12:22.604613+0000","last_clean_scrub_stamp":"2024-09-12T18:12:22.604613+0000","objects_scrubbed":2,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:24:50.370491+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":321,"num_read_kb":317,"num_write":439,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":398,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"263'811","reported_seq":2420,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:57.606541+0000","last_change":"2024-09-12T18:11:57.606541+0000","last_active":"2024-09-12T18:11:57.606541+0000","last_peered":"2024-09-12T18:11:57.606541+0000","last_clean":"2024-09-12T18:11:57.606541+0000","last_became_active":"2024-09-12T17:10:44.511481+0000","last_became_peered":"2024-09-12T17:10:44.511481+0000","last_unstale":"2024-09-12T18:11:57.606541+0000","last_undegraded":"2024-09-12T18:11:57.606541+0000","last_fullsized":"2024-09-12T18:11:57.606541+0000","mapping_epoch":26,"log_start":"263'700","ondisk_log_start":"263'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'811","last_scrub_stamp":"2024-09-12T18:11:57.606442+0000","last_deep_scrub":"263'811","last_deep_scrub_stamp":"2024-09-12T18:11:57.606442+0000","last_clean_scrub_stamp":"2024-09-12T18:11:57.606442+0000","objects_scrubbed":1,"log_size":111,"log_dups_size":700,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:48:35.686566+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3868,"num_read_kb":3506,"num_write":1048,"num_write_kb":364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"263'181","reported_seq":792,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:48.827289+0000","last_change":"2024-09-12T18:11:48.827289+0000","last_active":"2024-09-12T18:11:48.827289+0000","last_peered":"2024-09-12T18:11:48.827289+0000","last_clean":"2024-09-12T18:11:48.827289+0000","last_became_active":"2024-09-12T17:11:16.862878+0000","last_became_peered":"2024-09-12T17:11:16.862878+0000","last_unstale":"2024-09-12T18:11:48.827289+0000","last_undegraded":"2024-09-12T18:11:48.827289+0000","last_fullsized":"2024-09-12T18:11:48.827289+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'181","last_scrub_stamp":"2024-09-12T18:11:48.827197+0000","last_deep_scrub":"263'181","last_deep_scrub_stamp":"2024-09-12T18:11:48.827197+0000","last_clean_scrub_stamp":"2024-09-12T18:11:48.827197+0000","objects_scrubbed":2,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:07:19.314634+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3178636,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":399,"num_read_kb":53721,"num_write":811,"num_write_kb":39175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,1,3],"acting":[2,7,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:07.542540+0000","last_change":"2024-09-12T18:12:07.542540+0000","last_active":"2024-09-12T18:12:07.542540+0000","last_peered":"2024-09-12T18:12:07.542540+0000","last_clean":"2024-09-12T18:12:07.542540+0000","last_became_active":"2024-09-12T17:10:46.530518+0000","last_became_peered":"2024-09-12T17:10:46.530518+0000","last_unstale":"2024-09-12T18:12:07.542540+0000","last_undegraded":"2024-09-12T18:12:07.542540+0000","last_fullsized":"2024-09-12T18:12:07.542540+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:07.542450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:07.542450+0000","last_clean_scrub_stamp":"2024-09-12T18:12:07.542450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:58:05.691586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"263'178","reported_seq":778,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:15.677130+0000","last_change":"2024-09-12T18:12:15.677130+0000","last_active":"2024-09-12T18:12:15.677130+0000","last_peered":"2024-09-12T18:12:15.677130+0000","last_clean":"2024-09-12T18:12:15.677130+0000","last_became_active":"2024-09-12T17:10:48.536654+0000","last_became_peered":"2024-09-12T17:10:48.536654+0000","last_unstale":"2024-09-12T18:12:15.677130+0000","last_undegraded":"2024-09-12T18:12:15.677130+0000","last_fullsized":"2024-09-12T18:12:15.677130+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'178","last_scrub_stamp":"2024-09-12T18:12:15.677036+0000","last_deep_scrub":"263'178","last_deep_scrub_stamp":"2024-09-12T18:12:15.677036+0000","last_clean_scrub_stamp":"2024-09-12T18:12:15.677036+0000","objects_scrubbed":5,"log_size":78,"log_dups_size":100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:37:46.838981+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5117,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":224,"num_read_kb":242,"num_write":122,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:04.709251+0000","last_change":"2024-09-12T18:12:04.709251+0000","last_active":"2024-09-12T18:12:04.709251+0000","last_peered":"2024-09-12T18:12:04.709251+0000","last_clean":"2024-09-12T18:12:04.709251+0000","last_became_active":"2024-09-12T17:10:50.556039+0000","last_became_peered":"2024-09-12T17:10:50.556039+0000","last_unstale":"2024-09-12T18:12:04.709251+0000","last_undegraded":"2024-09-12T18:12:04.709251+0000","last_fullsized":"2024-09-12T18:12:04.709251+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:04.709167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:04.709167+0000","last_clean_scrub_stamp":"2024-09-12T18:12:04.709167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:32:19.318577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"263'114","reported_seq":626,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:23.438911+0000","last_change":"2024-09-12T18:12:23.438911+0000","last_active":"2024-09-12T18:12:23.438911+0000","last_peered":"2024-09-12T18:12:23.438911+0000","last_clean":"2024-09-12T18:12:23.438911+0000","last_became_active":"2024-09-12T17:10:52.576791+0000","last_became_peered":"2024-09-12T17:10:52.576791+0000","last_unstale":"2024-09-12T18:12:23.438911+0000","last_undegraded":"2024-09-12T18:12:23.438911+0000","last_fullsized":"2024-09-12T18:12:23.438911+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'114","last_scrub_stamp":"2024-09-12T18:12:23.438808+0000","last_deep_scrub":"263'114","last_deep_scrub_stamp":"2024-09-12T18:12:23.438808+0000","last_clean_scrub_stamp":"2024-09-12T18:12:23.438808+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:40:57.508125+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":159,"num_read_kb":159,"num_write":260,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"263'431","reported_seq":1816,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:03.644995+0000","last_change":"2024-09-12T18:12:03.644995+0000","last_active":"2024-09-12T18:12:03.644995+0000","last_peered":"2024-09-12T18:12:03.644995+0000","last_clean":"2024-09-12T18:12:03.644995+0000","last_became_active":"2024-09-12T17:10:44.520747+0000","last_became_peered":"2024-09-12T17:10:44.520747+0000","last_unstale":"2024-09-12T18:12:03.644995+0000","last_undegraded":"2024-09-12T18:12:03.644995+0000","last_fullsized":"2024-09-12T18:12:03.644995+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'431","last_scrub_stamp":"2024-09-12T18:12:03.644906+0000","last_deep_scrub":"263'431","last_deep_scrub_stamp":"2024-09-12T18:12:03.644906+0000","last_clean_scrub_stamp":"2024-09-12T18:12:03.644906+0000","objects_scrubbed":2,"log_size":31,"log_dups_size":400,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:51:22.884668+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2202,"num_read_kb":2035,"num_write":527,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":718,"num_omap_keys":3,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"263'255","reported_seq":952,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:47.656945+0000","last_change":"2024-09-12T18:11:47.656945+0000","last_active":"2024-09-12T18:11:47.656945+0000","last_peered":"2024-09-12T18:11:47.656945+0000","last_clean":"2024-09-12T18:11:47.656945+0000","last_became_active":"2024-09-12T17:10:42.528364+0000","last_became_peered":"2024-09-12T17:10:42.528364+0000","last_unstale":"2024-09-12T18:11:47.656945+0000","last_undegraded":"2024-09-12T18:11:47.656945+0000","last_fullsized":"2024-09-12T18:11:47.656945+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'255","last_scrub_stamp":"2024-09-12T18:11:47.656812+0000","last_deep_scrub":"263'255","last_deep_scrub_stamp":"2024-09-12T18:11:47.656812+0000","last_clean_scrub_stamp":"2024-09-12T18:11:47.656812+0000","objects_scrubbed":5,"log_size":55,"log_dups_size":200,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:23:37.965725+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399205,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":613,"num_read_kb":71919,"num_write":1345,"num_write_kb":46951,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6,3],"acting":[0,5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":505,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:00.677176+0000","last_change":"2024-09-12T18:12:00.677176+0000","last_active":"2024-09-12T18:12:00.677176+0000","last_peered":"2024-09-12T18:12:00.677176+0000","last_clean":"2024-09-12T18:12:00.677176+0000","last_became_active":"2024-09-12T17:10:46.531830+0000","last_became_peered":"2024-09-12T17:10:46.531830+0000","last_unstale":"2024-09-12T18:12:00.677176+0000","last_undegraded":"2024-09-12T18:12:00.677176+0000","last_fullsized":"2024-09-12T18:12:00.677176+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:00.677087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:00.677087+0000","last_clean_scrub_stamp":"2024-09-12T18:12:00.677087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:04:35.333713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"263'131","reported_seq":707,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:12.623041+0000","last_change":"2024-09-12T18:12:12.623041+0000","last_active":"2024-09-12T18:12:12.623041+0000","last_peered":"2024-09-12T18:12:12.623041+0000","last_clean":"2024-09-12T18:12:12.623041+0000","last_became_active":"2024-09-12T17:10:48.545598+0000","last_became_peered":"2024-09-12T17:10:48.545598+0000","last_unstale":"2024-09-12T18:12:12.623041+0000","last_undegraded":"2024-09-12T18:12:12.623041+0000","last_fullsized":"2024-09-12T18:12:12.623041+0000","mapping_epoch":30,"log_start":"263'100","ondisk_log_start":"263'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'131","last_scrub_stamp":"2024-09-12T18:12:12.622936+0000","last_deep_scrub":"263'131","last_deep_scrub_stamp":"2024-09-12T18:12:12.622936+0000","last_clean_scrub_stamp":"2024-09-12T18:12:12.622936+0000","objects_scrubbed":4,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:24:03.277611+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10861,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":166,"num_read_kb":224,"num_write":86,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":500,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:15.694219+0000","last_change":"2024-09-12T18:12:15.694219+0000","last_active":"2024-09-12T18:12:15.694219+0000","last_peered":"2024-09-12T18:12:15.694219+0000","last_clean":"2024-09-12T18:12:15.694219+0000","last_became_active":"2024-09-12T17:10:50.560872+0000","last_became_peered":"2024-09-12T17:10:50.560872+0000","last_unstale":"2024-09-12T18:12:15.694219+0000","last_undegraded":"2024-09-12T18:12:15.694219+0000","last_fullsized":"2024-09-12T18:12:15.694219+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:15.694138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:15.694138+0000","last_clean_scrub_stamp":"2024-09-12T18:12:15.694138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:19:51.674706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"263'951","reported_seq":2488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:56.707695+0000","last_change":"2024-09-12T18:11:56.707695+0000","last_active":"2024-09-12T18:11:56.707695+0000","last_peered":"2024-09-12T18:11:56.707695+0000","last_clean":"2024-09-12T18:11:56.707695+0000","last_became_active":"2024-09-12T17:10:44.518992+0000","last_became_peered":"2024-09-12T17:10:44.518992+0000","last_unstale":"2024-09-12T18:11:56.707695+0000","last_undegraded":"2024-09-12T18:11:56.707695+0000","last_fullsized":"2024-09-12T18:11:56.707695+0000","mapping_epoch":26,"log_start":"263'900","ondisk_log_start":"263'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'951","last_scrub_stamp":"2024-09-12T18:11:56.707618+0000","last_deep_scrub":"263'951","last_deep_scrub_stamp":"2024-09-12T18:11:56.707618+0000","last_clean_scrub_stamp":"2024-09-12T18:11:56.707618+0000","objects_scrubbed":1,"log_size":51,"log_dups_size":900,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:54:44.984408+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4453,"num_read_kb":3925,"num_write":1322,"num_write_kb":528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1892,"num_omap_keys":8,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"263'316","reported_seq":1002,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:50.550646+0000","last_change":"2024-09-12T18:11:50.550646+0000","last_active":"2024-09-12T18:11:50.550646+0000","last_peered":"2024-09-12T18:11:50.550646+0000","last_clean":"2024-09-12T18:11:50.550646+0000","last_became_active":"2024-09-12T17:10:42.514627+0000","last_became_peered":"2024-09-12T17:10:42.514627+0000","last_unstale":"2024-09-12T18:11:50.550646+0000","last_undegraded":"2024-09-12T18:11:50.550646+0000","last_fullsized":"2024-09-12T18:11:50.550646+0000","mapping_epoch":24,"log_start":"263'300","ondisk_log_start":"263'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'316","last_scrub_stamp":"2024-09-12T18:11:50.550499+0000","last_deep_scrub":"263'316","last_deep_scrub_stamp":"2024-09-12T18:11:50.550499+0000","last_clean_scrub_stamp":"2024-09-12T18:11:50.550499+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:01:57.030372+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":188,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":795,"num_read_kb":25839,"num_write":1196,"num_write_kb":43854,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":512,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:05.731801+0000","last_change":"2024-09-12T18:12:05.731801+0000","last_active":"2024-09-12T18:12:05.731801+0000","last_peered":"2024-09-12T18:12:05.731801+0000","last_clean":"2024-09-12T18:12:05.731801+0000","last_became_active":"2024-09-12T17:10:46.526692+0000","last_became_peered":"2024-09-12T17:10:46.526692+0000","last_unstale":"2024-09-12T18:12:05.731801+0000","last_undegraded":"2024-09-12T18:12:05.731801+0000","last_fullsized":"2024-09-12T18:12:05.731801+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:05.731716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:05.731716+0000","last_clean_scrub_stamp":"2024-09-12T18:12:05.731716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:11:54.160730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"263'217","reported_seq":858,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:05.509292+0000","last_change":"2024-09-12T18:12:05.509292+0000","last_active":"2024-09-12T18:12:05.509292+0000","last_peered":"2024-09-12T18:12:05.509292+0000","last_clean":"2024-09-12T18:12:05.509292+0000","last_became_active":"2024-09-12T17:10:48.544429+0000","last_became_peered":"2024-09-12T17:10:48.544429+0000","last_unstale":"2024-09-12T18:12:05.509292+0000","last_undegraded":"2024-09-12T18:12:05.509292+0000","last_fullsized":"2024-09-12T18:12:05.509292+0000","mapping_epoch":30,"log_start":"263'200","ondisk_log_start":"263'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'217","last_scrub_stamp":"2024-09-12T18:12:05.509198+0000","last_deep_scrub":"263'217","last_deep_scrub_stamp":"2024-09-12T18:12:05.509198+0000","last_clean_scrub_stamp":"2024-09-12T18:12:05.509198+0000","objects_scrubbed":6,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:15:27.086960+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14913,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":325,"num_read_kb":485,"num_write":208,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25256,"num_omap_keys":48,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:17.499584+0000","last_change":"2024-09-12T18:12:17.499584+0000","last_active":"2024-09-12T18:12:17.499584+0000","last_peered":"2024-09-12T18:12:17.499584+0000","last_clean":"2024-09-12T18:12:17.499584+0000","last_became_active":"2024-09-12T17:10:50.565621+0000","last_became_peered":"2024-09-12T17:10:50.565621+0000","last_unstale":"2024-09-12T18:12:17.499584+0000","last_undegraded":"2024-09-12T18:12:17.499584+0000","last_fullsized":"2024-09-12T18:12:17.499584+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:17.499501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:17.499501+0000","last_clean_scrub_stamp":"2024-09-12T18:12:17.499501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:59:26.331971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"263'175","reported_seq":681,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:14.852393+0000","last_change":"2024-09-12T17:10:52.672357+0000","last_active":"2024-09-12T18:09:14.852393+0000","last_peered":"2024-09-12T18:09:14.852393+0000","last_clean":"2024-09-12T18:09:14.852393+0000","last_became_active":"2024-09-12T17:10:52.672033+0000","last_became_peered":"2024-09-12T17:10:52.672033+0000","last_unstale":"2024-09-12T18:09:14.852393+0000","last_undegraded":"2024-09-12T18:09:14.852393+0000","last_fullsized":"2024-09-12T18:09:14.852393+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:21:13.578314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":269,"num_read_kb":274,"num_write":411,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"263'548","reported_seq":2066,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:58.711194+0000","last_change":"2024-09-12T18:11:58.711194+0000","last_active":"2024-09-12T18:11:58.711194+0000","last_peered":"2024-09-12T18:11:58.711194+0000","last_clean":"2024-09-12T18:11:58.711194+0000","last_became_active":"2024-09-12T17:10:44.510696+0000","last_became_peered":"2024-09-12T17:10:44.510696+0000","last_unstale":"2024-09-12T18:11:58.711194+0000","last_undegraded":"2024-09-12T18:11:58.711194+0000","last_fullsized":"2024-09-12T18:11:58.711194+0000","mapping_epoch":26,"log_start":"263'500","ondisk_log_start":"263'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'548","last_scrub_stamp":"2024-09-12T18:11:58.711116+0000","last_deep_scrub":"263'548","last_deep_scrub_stamp":"2024-09-12T18:11:58.711116+0000","last_clean_scrub_stamp":"2024-09-12T18:11:58.711116+0000","objects_scrubbed":3,"log_size":48,"log_dups_size":500,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:00:54.289369+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2748,"num_read_kb":2501,"num_write":691,"num_write_kb":203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":946,"num_omap_keys":4,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"263'238","reported_seq":913,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:50.716191+0000","last_change":"2024-09-12T18:11:50.716191+0000","last_active":"2024-09-12T18:11:50.716191+0000","last_peered":"2024-09-12T18:11:50.716191+0000","last_clean":"2024-09-12T18:11:50.716191+0000","last_became_active":"2024-09-12T17:10:42.520349+0000","last_became_peered":"2024-09-12T17:10:42.520349+0000","last_unstale":"2024-09-12T18:11:50.716191+0000","last_undegraded":"2024-09-12T18:11:50.716191+0000","last_fullsized":"2024-09-12T18:11:50.716191+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'238","last_scrub_stamp":"2024-09-12T18:11:50.716063+0000","last_deep_scrub":"263'238","last_deep_scrub_stamp":"2024-09-12T18:11:50.716063+0000","last_clean_scrub_stamp":"2024-09-12T18:11:50.716063+0000","objects_scrubbed":9,"log_size":38,"log_dups_size":200,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:42:45.248398+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10743893,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":541,"num_read_kb":59039,"num_write":1206,"num_write_kb":37561,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,6],"acting":[1,3,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":508,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:01.699154+0000","last_change":"2024-09-12T18:12:01.699154+0000","last_active":"2024-09-12T18:12:01.699154+0000","last_peered":"2024-09-12T18:12:01.699154+0000","last_clean":"2024-09-12T18:12:01.699154+0000","last_became_active":"2024-09-12T17:10:46.530545+0000","last_became_peered":"2024-09-12T17:10:46.530545+0000","last_unstale":"2024-09-12T18:12:01.699154+0000","last_undegraded":"2024-09-12T18:12:01.699154+0000","last_fullsized":"2024-09-12T18:12:01.699154+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:01.699042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:01.699042+0000","last_clean_scrub_stamp":"2024-09-12T18:12:01.699042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:06:02.900923+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"263'178","reported_seq":770,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:13.575202+0000","last_change":"2024-09-12T18:12:13.575202+0000","last_active":"2024-09-12T18:12:13.575202+0000","last_peered":"2024-09-12T18:12:13.575202+0000","last_clean":"2024-09-12T18:12:13.575202+0000","last_became_active":"2024-09-12T17:10:48.541240+0000","last_became_peered":"2024-09-12T17:10:48.541240+0000","last_unstale":"2024-09-12T18:12:13.575202+0000","last_undegraded":"2024-09-12T18:12:13.575202+0000","last_fullsized":"2024-09-12T18:12:13.575202+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'178","last_scrub_stamp":"2024-09-12T18:12:13.575102+0000","last_deep_scrub":"263'178","last_deep_scrub_stamp":"2024-09-12T18:12:13.575102+0000","last_clean_scrub_stamp":"2024-09-12T18:12:13.575102+0000","objects_scrubbed":8,"log_size":78,"log_dups_size":100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:50:14.366078+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8547,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":246,"num_read_kb":321,"num_write":160,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11460,"num_omap_keys":24,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:09.489302+0000","last_change":"2024-09-12T18:12:09.489302+0000","last_active":"2024-09-12T18:12:09.489302+0000","last_peered":"2024-09-12T18:12:09.489302+0000","last_clean":"2024-09-12T18:12:09.489302+0000","last_became_active":"2024-09-12T17:10:50.561983+0000","last_became_peered":"2024-09-12T17:10:50.561983+0000","last_unstale":"2024-09-12T18:12:09.489302+0000","last_undegraded":"2024-09-12T18:12:09.489302+0000","last_fullsized":"2024-09-12T18:12:09.489302+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:09.489199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:09.489199+0000","last_clean_scrub_stamp":"2024-09-12T18:12:09.489199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:04:42.874499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"263'251","reported_seq":1127,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:10.668035+0000","last_change":"2024-09-12T18:12:10.668035+0000","last_active":"2024-09-12T18:12:10.668035+0000","last_peered":"2024-09-12T18:12:10.668035+0000","last_clean":"2024-09-12T18:12:10.668035+0000","last_became_active":"2024-09-12T17:10:52.573595+0000","last_became_peered":"2024-09-12T17:10:52.573595+0000","last_unstale":"2024-09-12T18:12:10.668035+0000","last_undegraded":"2024-09-12T18:12:10.668035+0000","last_fullsized":"2024-09-12T18:12:10.668035+0000","mapping_epoch":34,"log_start":"263'200","ondisk_log_start":"263'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'251","last_scrub_stamp":"2024-09-12T18:12:10.667936+0000","last_deep_scrub":"263'251","last_deep_scrub_stamp":"2024-09-12T18:12:10.667936+0000","last_clean_scrub_stamp":"2024-09-12T18:12:10.667936+0000","objects_scrubbed":7,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:03:04.342423+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1635,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":641,"num_read_kb":637,"num_write":634,"num_write_kb":186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"263'622","reported_seq":2223,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:58.640774+0000","last_change":"2024-09-12T18:11:58.640774+0000","last_active":"2024-09-12T18:11:58.640774+0000","last_peered":"2024-09-12T18:11:58.640774+0000","last_clean":"2024-09-12T18:11:58.640774+0000","last_became_active":"2024-09-12T17:10:44.521041+0000","last_became_peered":"2024-09-12T17:10:44.521041+0000","last_unstale":"2024-09-12T18:11:58.640774+0000","last_undegraded":"2024-09-12T18:11:58.640774+0000","last_fullsized":"2024-09-12T18:11:58.640774+0000","mapping_epoch":26,"log_start":"263'600","ondisk_log_start":"263'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'622","last_scrub_stamp":"2024-09-12T18:11:58.640669+0000","last_deep_scrub":"263'622","last_deep_scrub_stamp":"2024-09-12T18:11:58.640669+0000","last_clean_scrub_stamp":"2024-09-12T18:11:58.640669+0000","objects_scrubbed":2,"log_size":22,"log_dups_size":600,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:27:58.198720+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3182,"num_read_kb":2947,"num_write":827,"num_write_kb":261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":247,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"263'222","reported_seq":822,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:54.585656+0000","last_change":"2024-09-12T18:11:54.585656+0000","last_active":"2024-09-12T18:11:54.585656+0000","last_peered":"2024-09-12T18:11:54.585656+0000","last_clean":"2024-09-12T18:11:54.585656+0000","last_became_active":"2024-09-12T17:11:16.860070+0000","last_became_peered":"2024-09-12T17:11:16.860070+0000","last_unstale":"2024-09-12T18:11:54.585656+0000","last_undegraded":"2024-09-12T18:11:54.585656+0000","last_fullsized":"2024-09-12T18:11:54.585656+0000","mapping_epoch":37,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'222","last_scrub_stamp":"2024-09-12T18:11:54.585507+0000","last_deep_scrub":"263'222","last_deep_scrub_stamp":"2024-09-12T18:11:54.585507+0000","last_clean_scrub_stamp":"2024-09-12T18:11:54.585507+0000","objects_scrubbed":5,"log_size":22,"log_dups_size":200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:11:02.947543+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3239711,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":443,"num_read_kb":10891,"num_write":955,"num_write_kb":36342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":509,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:10.308784+0000","last_change":"2024-09-12T18:12:10.308784+0000","last_active":"2024-09-12T18:12:10.308784+0000","last_peered":"2024-09-12T18:12:10.308784+0000","last_clean":"2024-09-12T18:12:10.308784+0000","last_became_active":"2024-09-12T17:10:46.530452+0000","last_became_peered":"2024-09-12T17:10:46.530452+0000","last_unstale":"2024-09-12T18:12:10.308784+0000","last_undegraded":"2024-09-12T18:12:10.308784+0000","last_fullsized":"2024-09-12T18:12:10.308784+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:10.308679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:10.308679+0000","last_clean_scrub_stamp":"2024-09-12T18:12:10.308679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:39:55.785385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"263'148","reported_seq":735,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:17.650880+0000","last_change":"2024-09-12T18:12:17.650880+0000","last_active":"2024-09-12T18:12:17.650880+0000","last_peered":"2024-09-12T18:12:17.650880+0000","last_clean":"2024-09-12T18:12:17.650880+0000","last_became_active":"2024-09-12T17:10:48.537643+0000","last_became_peered":"2024-09-12T17:10:48.537643+0000","last_unstale":"2024-09-12T18:12:17.650880+0000","last_undegraded":"2024-09-12T18:12:17.650880+0000","last_fullsized":"2024-09-12T18:12:17.650880+0000","mapping_epoch":30,"log_start":"263'100","ondisk_log_start":"263'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'148","last_scrub_stamp":"2024-09-12T18:12:17.650791+0000","last_deep_scrub":"263'148","last_deep_scrub_stamp":"2024-09-12T18:12:17.650791+0000","last_clean_scrub_stamp":"2024-09-12T18:12:17.650791+0000","objects_scrubbed":6,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:09:51.365078+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4406,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":180,"num_read_kb":223,"num_write":96,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":505,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:10.456918+0000","last_change":"2024-09-12T18:12:10.456918+0000","last_active":"2024-09-12T18:12:10.456918+0000","last_peered":"2024-09-12T18:12:10.456918+0000","last_clean":"2024-09-12T18:12:10.456918+0000","last_became_active":"2024-09-12T17:10:50.565582+0000","last_became_peered":"2024-09-12T17:10:50.565582+0000","last_unstale":"2024-09-12T18:12:10.456918+0000","last_undegraded":"2024-09-12T18:12:10.456918+0000","last_fullsized":"2024-09-12T18:12:10.456918+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:10.456809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:10.456809+0000","last_clean_scrub_stamp":"2024-09-12T18:12:10.456809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:47:45.308848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"263'135","reported_seq":630,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:21.472980+0000","last_change":"2024-09-12T18:12:21.472980+0000","last_active":"2024-09-12T18:12:21.472980+0000","last_peered":"2024-09-12T18:12:21.472980+0000","last_clean":"2024-09-12T18:12:21.472980+0000","last_became_active":"2024-09-12T17:10:52.576370+0000","last_became_peered":"2024-09-12T17:10:52.576370+0000","last_unstale":"2024-09-12T18:12:21.472980+0000","last_undegraded":"2024-09-12T18:12:21.472980+0000","last_fullsized":"2024-09-12T18:12:21.472980+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'135","last_scrub_stamp":"2024-09-12T18:12:21.472872+0000","last_deep_scrub":"263'135","last_deep_scrub_stamp":"2024-09-12T18:12:21.472872+0000","last_clean_scrub_stamp":"2024-09-12T18:12:21.472872+0000","objects_scrubbed":5,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:25:02.852252+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1233,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":145,"num_read_kb":142,"num_write":322,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"263'875","reported_seq":2433,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:52.838814+0000","last_change":"2024-09-12T18:11:52.838814+0000","last_active":"2024-09-12T18:11:52.838814+0000","last_peered":"2024-09-12T18:11:52.838814+0000","last_clean":"2024-09-12T18:11:52.838814+0000","last_became_active":"2024-09-12T17:10:44.519318+0000","last_became_peered":"2024-09-12T17:10:44.519318+0000","last_unstale":"2024-09-12T18:11:52.838814+0000","last_undegraded":"2024-09-12T18:11:52.838814+0000","last_fullsized":"2024-09-12T18:11:52.838814+0000","mapping_epoch":26,"log_start":"263'800","ondisk_log_start":"263'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'875","last_scrub_stamp":"2024-09-12T18:11:52.838719+0000","last_deep_scrub":"263'875","last_deep_scrub_stamp":"2024-09-12T18:11:52.838719+0000","last_clean_scrub_stamp":"2024-09-12T18:11:52.838719+0000","objects_scrubbed":3,"log_size":75,"log_dups_size":800,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:40:19.551440+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4021,"num_read_kb":3592,"num_write":1141,"num_write_kb":414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"263'186","reported_seq":807,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:46.616198+0000","last_change":"2024-09-12T18:11:46.616198+0000","last_active":"2024-09-12T18:11:46.616198+0000","last_peered":"2024-09-12T18:11:46.616198+0000","last_clean":"2024-09-12T18:11:46.616198+0000","last_became_active":"2024-09-12T17:10:42.516802+0000","last_became_peered":"2024-09-12T17:10:42.516802+0000","last_unstale":"2024-09-12T18:11:46.616198+0000","last_undegraded":"2024-09-12T18:11:46.616198+0000","last_fullsized":"2024-09-12T18:11:46.616198+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'186","last_scrub_stamp":"2024-09-12T18:11:46.616065+0000","last_deep_scrub":"263'186","last_deep_scrub_stamp":"2024-09-12T18:11:46.616065+0000","last_clean_scrub_stamp":"2024-09-12T18:11:46.616065+0000","objects_scrubbed":5,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:50:13.105798+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":287306,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":394,"num_read_kb":13109,"num_write":967,"num_write_kb":28742,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7,1],"acting":[0,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"263'5","reported_seq":986,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:04.504714+0000","last_change":"2024-09-12T18:12:04.504714+0000","last_active":"2024-09-12T18:12:04.504714+0000","last_peered":"2024-09-12T18:12:04.504714+0000","last_clean":"2024-09-12T18:12:04.504714+0000","last_became_active":"2024-09-12T17:10:46.530466+0000","last_became_peered":"2024-09-12T17:10:46.530466+0000","last_unstale":"2024-09-12T18:12:04.504714+0000","last_undegraded":"2024-09-12T18:12:04.504714+0000","last_fullsized":"2024-09-12T18:12:04.504714+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'5","last_scrub_stamp":"2024-09-12T18:12:04.504622+0000","last_deep_scrub":"263'5","last_deep_scrub_stamp":"2024-09-12T18:12:04.504622+0000","last_clean_scrub_stamp":"2024-09-12T18:12:04.504622+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:57:02.945885+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":721,"num_read_kb":1187,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"263'97","reported_seq":638,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:14.360207+0000","last_change":"2024-09-12T18:12:14.360207+0000","last_active":"2024-09-12T18:12:14.360207+0000","last_peered":"2024-09-12T18:12:14.360207+0000","last_clean":"2024-09-12T18:12:14.360207+0000","last_became_active":"2024-09-12T17:10:48.537715+0000","last_became_peered":"2024-09-12T17:10:48.537715+0000","last_unstale":"2024-09-12T18:12:14.360207+0000","last_undegraded":"2024-09-12T18:12:14.360207+0000","last_fullsized":"2024-09-12T18:12:14.360207+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'97","last_scrub_stamp":"2024-09-12T18:12:14.360075+0000","last_deep_scrub":"263'97","last_deep_scrub_stamp":"2024-09-12T18:12:14.360075+0000","last_clean_scrub_stamp":"2024-09-12T18:12:14.360075+0000","objects_scrubbed":7,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:06:43.774112+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":103,"num_read_kb":94,"num_write":78,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1780,"num_omap_keys":6,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"263'763","reported_seq":2592,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:07.647873+0000","last_change":"2024-09-12T18:12:07.647873+0000","last_active":"2024-09-12T18:12:07.647873+0000","last_peered":"2024-09-12T18:12:07.647873+0000","last_clean":"2024-09-12T18:12:07.647873+0000","last_became_active":"2024-09-12T17:10:50.552439+0000","last_became_peered":"2024-09-12T17:10:50.552439+0000","last_unstale":"2024-09-12T18:12:07.647873+0000","last_undegraded":"2024-09-12T18:12:07.647873+0000","last_fullsized":"2024-09-12T18:12:07.647873+0000","mapping_epoch":32,"log_start":"263'700","ondisk_log_start":"263'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'763","last_scrub_stamp":"2024-09-12T18:12:07.647769+0000","last_deep_scrub":"263'763","last_deep_scrub_stamp":"2024-09-12T18:12:07.647769+0000","last_clean_scrub_stamp":"2024-09-12T18:12:07.647769+0000","objects_scrubbed":1,"log_size":63,"log_dups_size":700,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:23:23.514750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"263'102","reported_seq":608,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:19.510425+0000","last_change":"2024-09-12T18:12:19.510425+0000","last_active":"2024-09-12T18:12:19.510425+0000","last_peered":"2024-09-12T18:12:19.510425+0000","last_clean":"2024-09-12T18:12:19.510425+0000","last_became_active":"2024-09-12T17:10:52.576354+0000","last_became_peered":"2024-09-12T17:10:52.576354+0000","last_unstale":"2024-09-12T18:12:19.510425+0000","last_undegraded":"2024-09-12T18:12:19.510425+0000","last_fullsized":"2024-09-12T18:12:19.510425+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'102","last_scrub_stamp":"2024-09-12T18:12:19.510338+0000","last_deep_scrub":"263'102","last_deep_scrub_stamp":"2024-09-12T18:12:19.510338+0000","last_clean_scrub_stamp":"2024-09-12T18:12:19.510338+0000","objects_scrubbed":1,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:25:40.401986+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":153,"num_read_kb":145,"num_write":246,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"263'891","reported_seq":2570,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:58.382145+0000","last_change":"2024-09-12T18:11:58.382145+0000","last_active":"2024-09-12T18:11:58.382145+0000","last_peered":"2024-09-12T18:11:58.382145+0000","last_clean":"2024-09-12T18:11:58.382145+0000","last_became_active":"2024-09-12T17:10:44.514263+0000","last_became_peered":"2024-09-12T17:10:44.514263+0000","last_unstale":"2024-09-12T18:11:58.382145+0000","last_undegraded":"2024-09-12T18:11:58.382145+0000","last_fullsized":"2024-09-12T18:11:58.382145+0000","mapping_epoch":26,"log_start":"263'800","ondisk_log_start":"263'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'891","last_scrub_stamp":"2024-09-12T18:11:58.382053+0000","last_deep_scrub":"263'891","last_deep_scrub_stamp":"2024-09-12T18:11:58.382053+0000","last_clean_scrub_stamp":"2024-09-12T18:11:58.382053+0000","objects_scrubbed":3,"log_size":91,"log_dups_size":800,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:24:30.850739+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4092,"num_read_kb":3689,"num_write":1154,"num_write_kb":400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"263'220","reported_seq":866,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:49.222867+0000","last_change":"2024-09-12T18:11:49.222867+0000","last_active":"2024-09-12T18:11:49.222867+0000","last_peered":"2024-09-12T18:11:49.222867+0000","last_clean":"2024-09-12T18:11:49.222867+0000","last_became_active":"2024-09-12T17:10:42.527644+0000","last_became_peered":"2024-09-12T17:10:42.527644+0000","last_unstale":"2024-09-12T18:11:49.222867+0000","last_undegraded":"2024-09-12T18:11:49.222867+0000","last_fullsized":"2024-09-12T18:11:49.222867+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'220","last_scrub_stamp":"2024-09-12T18:11:49.222706+0000","last_deep_scrub":"263'220","last_deep_scrub_stamp":"2024-09-12T18:11:49.222706+0000","last_clean_scrub_stamp":"2024-09-12T18:11:49.222706+0000","objects_scrubbed":5,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:22:56.036981+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":569092,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":486,"num_read_kb":29332,"num_write":1044,"num_write_kb":31012,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,6],"acting":[5,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":500,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:08.571171+0000","last_change":"2024-09-12T18:12:08.571171+0000","last_active":"2024-09-12T18:12:08.571171+0000","last_peered":"2024-09-12T18:12:08.571171+0000","last_clean":"2024-09-12T18:12:08.571171+0000","last_became_active":"2024-09-12T17:10:46.531759+0000","last_became_peered":"2024-09-12T17:10:46.531759+0000","last_unstale":"2024-09-12T18:12:08.571171+0000","last_undegraded":"2024-09-12T18:12:08.571171+0000","last_fullsized":"2024-09-12T18:12:08.571171+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:08.571082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:08.571082+0000","last_clean_scrub_stamp":"2024-09-12T18:12:08.571082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:30:07.942782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"263'211","reported_seq":805,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:16.500087+0000","last_change":"2024-09-12T18:12:16.500087+0000","last_active":"2024-09-12T18:12:16.500087+0000","last_peered":"2024-09-12T18:12:16.500087+0000","last_clean":"2024-09-12T18:12:16.500087+0000","last_became_active":"2024-09-12T17:10:48.543123+0000","last_became_peered":"2024-09-12T17:10:48.543123+0000","last_unstale":"2024-09-12T18:12:16.500087+0000","last_undegraded":"2024-09-12T18:12:16.500087+0000","last_fullsized":"2024-09-12T18:12:16.500087+0000","mapping_epoch":30,"log_start":"263'200","ondisk_log_start":"263'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'211","last_scrub_stamp":"2024-09-12T18:12:16.499980+0000","last_deep_scrub":"263'211","last_deep_scrub_stamp":"2024-09-12T18:12:16.499980+0000","last_clean_scrub_stamp":"2024-09-12T18:12:16.499980+0000","objects_scrubbed":11,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:06:58.866518+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9151,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":248,"num_read_kb":305,"num_write":156,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:16.650045+0000","last_change":"2024-09-12T18:12:16.650045+0000","last_active":"2024-09-12T18:12:16.650045+0000","last_peered":"2024-09-12T18:12:16.650045+0000","last_clean":"2024-09-12T18:12:16.650045+0000","last_became_active":"2024-09-12T17:10:50.556040+0000","last_became_peered":"2024-09-12T17:10:50.556040+0000","last_unstale":"2024-09-12T18:12:16.650045+0000","last_undegraded":"2024-09-12T18:12:16.650045+0000","last_fullsized":"2024-09-12T18:12:16.650045+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:16.649958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:16.649958+0000","last_clean_scrub_stamp":"2024-09-12T18:12:16.649958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:14:49.148713+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"263'132","reported_seq":632,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:46.952145+0000","last_change":"2024-09-12T17:10:52.585108+0000","last_active":"2024-09-12T18:09:46.952145+0000","last_peered":"2024-09-12T18:09:46.952145+0000","last_clean":"2024-09-12T18:09:46.952145+0000","last_became_active":"2024-09-12T17:10:52.584752+0000","last_became_peered":"2024-09-12T17:10:52.584752+0000","last_unstale":"2024-09-12T18:09:46.952145+0000","last_undegraded":"2024-09-12T18:09:46.952145+0000","last_fullsized":"2024-09-12T18:09:46.952145+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:17:54.690247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":200,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":199,"num_read_kb":187,"num_write":331,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"263'458","reported_seq":2257,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:56.346868+0000","last_change":"2024-09-12T18:11:56.346868+0000","last_active":"2024-09-12T18:11:56.346868+0000","last_peered":"2024-09-12T18:11:56.346868+0000","last_clean":"2024-09-12T18:11:56.346868+0000","last_became_active":"2024-09-12T17:10:44.515463+0000","last_became_peered":"2024-09-12T17:10:44.515463+0000","last_unstale":"2024-09-12T18:11:56.346868+0000","last_undegraded":"2024-09-12T18:11:56.346868+0000","last_fullsized":"2024-09-12T18:11:56.346868+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'458","last_scrub_stamp":"2024-09-12T18:11:56.346672+0000","last_deep_scrub":"263'458","last_deep_scrub_stamp":"2024-09-12T18:11:56.346672+0000","last_clean_scrub_stamp":"2024-09-12T18:11:56.346672+0000","objects_scrubbed":3,"log_size":58,"log_dups_size":400,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:31:31.404176+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2803,"num_read_kb":2700,"num_write":505,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2296,"num_omap_keys":9,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"263'189","reported_seq":813,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:52.278519+0000","last_change":"2024-09-12T18:11:52.278519+0000","last_active":"2024-09-12T18:11:52.278519+0000","last_peered":"2024-09-12T18:11:52.278519+0000","last_clean":"2024-09-12T18:11:52.278519+0000","last_became_active":"2024-09-12T17:10:42.529547+0000","last_became_peered":"2024-09-12T17:10:42.529547+0000","last_unstale":"2024-09-12T18:11:52.278519+0000","last_undegraded":"2024-09-12T18:11:52.278519+0000","last_fullsized":"2024-09-12T18:11:52.278519+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'189","last_scrub_stamp":"2024-09-12T18:11:52.278416+0000","last_deep_scrub":"263'189","last_deep_scrub_stamp":"2024-09-12T18:11:52.278416+0000","last_clean_scrub_stamp":"2024-09-12T18:11:52.278416+0000","objects_scrubbed":1,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:18:56.517970+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262159,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":394,"num_read_kb":39415,"num_write":893,"num_write_kb":32700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,6],"acting":[5,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":501,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:10.426744+0000","last_change":"2024-09-12T18:12:10.426744+0000","last_active":"2024-09-12T18:12:10.426744+0000","last_peered":"2024-09-12T18:12:10.426744+0000","last_clean":"2024-09-12T18:12:10.426744+0000","last_became_active":"2024-09-12T17:10:46.532418+0000","last_became_peered":"2024-09-12T17:10:46.532418+0000","last_unstale":"2024-09-12T18:12:10.426744+0000","last_undegraded":"2024-09-12T18:12:10.426744+0000","last_fullsized":"2024-09-12T18:12:10.426744+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:10.426654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:10.426654+0000","last_clean_scrub_stamp":"2024-09-12T18:12:10.426654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:46:06.300212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"263'135","reported_seq":716,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:10.720683+0000","last_change":"2024-09-12T18:12:10.720683+0000","last_active":"2024-09-12T18:12:10.720683+0000","last_peered":"2024-09-12T18:12:10.720683+0000","last_clean":"2024-09-12T18:12:10.720683+0000","last_became_active":"2024-09-12T17:10:48.539047+0000","last_became_peered":"2024-09-12T17:10:48.539047+0000","last_unstale":"2024-09-12T18:12:10.720683+0000","last_undegraded":"2024-09-12T18:12:10.720683+0000","last_fullsized":"2024-09-12T18:12:10.720683+0000","mapping_epoch":30,"log_start":"263'100","ondisk_log_start":"263'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'135","last_scrub_stamp":"2024-09-12T18:12:10.720566+0000","last_deep_scrub":"263'135","last_deep_scrub_stamp":"2024-09-12T18:12:10.720566+0000","last_clean_scrub_stamp":"2024-09-12T18:12:10.720566+0000","objects_scrubbed":4,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:38:55.106793+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5891,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":167,"num_read_kb":220,"num_write":88,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:06.695452+0000","last_change":"2024-09-12T18:12:06.695452+0000","last_active":"2024-09-12T18:12:06.695452+0000","last_peered":"2024-09-12T18:12:06.695452+0000","last_clean":"2024-09-12T18:12:06.695452+0000","last_became_active":"2024-09-12T17:10:50.555858+0000","last_became_peered":"2024-09-12T17:10:50.555858+0000","last_unstale":"2024-09-12T18:12:06.695452+0000","last_undegraded":"2024-09-12T18:12:06.695452+0000","last_fullsized":"2024-09-12T18:12:06.695452+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:06.695331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:06.695331+0000","last_clean_scrub_stamp":"2024-09-12T18:12:06.695331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:53:28.220067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"263'112","reported_seq":626,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:55.349086+0000","last_change":"2024-09-12T17:10:52.671426+0000","last_active":"2024-09-12T18:08:55.349086+0000","last_peered":"2024-09-12T18:08:55.349086+0000","last_clean":"2024-09-12T18:08:55.349086+0000","last_became_active":"2024-09-12T17:10:52.671139+0000","last_became_peered":"2024-09-12T17:10:52.671139+0000","last_unstale":"2024-09-12T18:08:55.349086+0000","last_undegraded":"2024-09-12T18:08:55.349086+0000","last_fullsized":"2024-09-12T18:08:55.349086+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:51.549038+0000","last_clean_scrub_stamp":"2024-09-12T17:10:51.549038+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:12:33.369332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":178,"num_read_kb":175,"num_write":256,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"263'787","reported_seq":2346,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:02.451406+0000","last_change":"2024-09-12T18:12:02.451406+0000","last_active":"2024-09-12T18:12:02.451406+0000","last_peered":"2024-09-12T18:12:02.451406+0000","last_clean":"2024-09-12T18:12:02.451406+0000","last_became_active":"2024-09-12T17:11:16.618723+0000","last_became_peered":"2024-09-12T17:11:16.618723+0000","last_unstale":"2024-09-12T18:12:02.451406+0000","last_undegraded":"2024-09-12T18:12:02.451406+0000","last_fullsized":"2024-09-12T18:12:02.451406+0000","mapping_epoch":37,"log_start":"263'700","ondisk_log_start":"263'700","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'787","last_scrub_stamp":"2024-09-12T18:12:02.451316+0000","last_deep_scrub":"263'787","last_deep_scrub_stamp":"2024-09-12T18:12:02.451316+0000","last_clean_scrub_stamp":"2024-09-12T18:12:02.451316+0000","objects_scrubbed":3,"log_size":87,"log_dups_size":700,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:25:44.064178+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4039,"num_read_kb":3670,"num_write":1050,"num_write_kb":387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":721,"num_omap_keys":3,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"263'172","reported_seq":841,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:51.566718+0000","last_change":"2024-09-12T18:11:51.566718+0000","last_active":"2024-09-12T18:11:51.566718+0000","last_peered":"2024-09-12T18:11:51.566718+0000","last_clean":"2024-09-12T18:11:51.566718+0000","last_became_active":"2024-09-12T17:10:42.534052+0000","last_became_peered":"2024-09-12T17:10:42.534052+0000","last_unstale":"2024-09-12T18:11:51.566718+0000","last_undegraded":"2024-09-12T18:11:51.566718+0000","last_fullsized":"2024-09-12T18:11:51.566718+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'172","last_scrub_stamp":"2024-09-12T18:11:51.566522+0000","last_deep_scrub":"263'172","last_deep_scrub_stamp":"2024-09-12T18:11:51.566522+0000","last_clean_scrub_stamp":"2024-09-12T18:11:51.566522+0000","objects_scrubbed":4,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:00:03.267177+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":311063,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":426,"num_read_kb":101566,"num_write":826,"num_write_kb":35642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7,2],"acting":[3,6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":510,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:07.339407+0000","last_change":"2024-09-12T18:12:07.339407+0000","last_active":"2024-09-12T18:12:07.339407+0000","last_peered":"2024-09-12T18:12:07.339407+0000","last_clean":"2024-09-12T18:12:07.339407+0000","last_became_active":"2024-09-12T17:10:46.530079+0000","last_became_peered":"2024-09-12T17:10:46.530079+0000","last_unstale":"2024-09-12T18:12:07.339407+0000","last_undegraded":"2024-09-12T18:12:07.339407+0000","last_fullsized":"2024-09-12T18:12:07.339407+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:07.339316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:07.339316+0000","last_clean_scrub_stamp":"2024-09-12T18:12:07.339316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:50:36.646747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"263'106","reported_seq":670,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:18.615653+0000","last_change":"2024-09-12T18:12:18.615653+0000","last_active":"2024-09-12T18:12:18.615653+0000","last_peered":"2024-09-12T18:12:18.615653+0000","last_clean":"2024-09-12T18:12:18.615653+0000","last_became_active":"2024-09-12T17:10:48.542918+0000","last_became_peered":"2024-09-12T17:10:48.542918+0000","last_unstale":"2024-09-12T18:12:18.615653+0000","last_undegraded":"2024-09-12T18:12:18.615653+0000","last_fullsized":"2024-09-12T18:12:18.615653+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'106","last_scrub_stamp":"2024-09-12T18:12:18.615561+0000","last_deep_scrub":"263'106","last_deep_scrub_stamp":"2024-09-12T18:12:18.615561+0000","last_clean_scrub_stamp":"2024-09-12T18:12:18.615561+0000","objects_scrubbed":2,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:13:33.347662+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7088,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":129,"num_read_kb":191,"num_write":60,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":501,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:17.332759+0000","last_change":"2024-09-12T18:12:17.332759+0000","last_active":"2024-09-12T18:12:17.332759+0000","last_peered":"2024-09-12T18:12:17.332759+0000","last_clean":"2024-09-12T18:12:17.332759+0000","last_became_active":"2024-09-12T17:10:50.558162+0000","last_became_peered":"2024-09-12T17:10:50.558162+0000","last_unstale":"2024-09-12T18:12:17.332759+0000","last_undegraded":"2024-09-12T18:12:17.332759+0000","last_fullsized":"2024-09-12T18:12:17.332759+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:17.332674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:17.332674+0000","last_clean_scrub_stamp":"2024-09-12T18:12:17.332674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:35:12.355855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"263'154","reported_seq":1257,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:20.511456+0000","last_change":"2024-09-12T18:12:20.511456+0000","last_active":"2024-09-12T18:12:20.511456+0000","last_peered":"2024-09-12T18:12:20.511456+0000","last_clean":"2024-09-12T18:12:20.511456+0000","last_became_active":"2024-09-12T17:10:52.584763+0000","last_became_peered":"2024-09-12T17:10:52.584763+0000","last_unstale":"2024-09-12T18:12:20.511456+0000","last_undegraded":"2024-09-12T18:12:20.511456+0000","last_fullsized":"2024-09-12T18:12:20.511456+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'154","last_scrub_stamp":"2024-09-12T18:12:20.511367+0000","last_deep_scrub":"263'154","last_deep_scrub_stamp":"2024-09-12T18:12:20.511367+0000","last_clean_scrub_stamp":"2024-09-12T18:12:20.511367+0000","objects_scrubbed":3,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:48:36.131028+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":215,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":802,"num_read_kb":800,"num_write":350,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"263'1274","reported_seq":2985,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:55.368952+0000","last_change":"2024-09-12T18:11:55.368952+0000","last_active":"2024-09-12T18:11:55.368952+0000","last_peered":"2024-09-12T18:11:55.368952+0000","last_clean":"2024-09-12T18:11:55.368952+0000","last_became_active":"2024-09-12T17:10:44.513047+0000","last_became_peered":"2024-09-12T17:10:44.513047+0000","last_unstale":"2024-09-12T18:11:55.368952+0000","last_undegraded":"2024-09-12T18:11:55.368952+0000","last_fullsized":"2024-09-12T18:11:55.368952+0000","mapping_epoch":26,"log_start":"263'1200","ondisk_log_start":"263'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1274","last_scrub_stamp":"2024-09-12T18:11:55.368862+0000","last_deep_scrub":"263'1274","last_deep_scrub_stamp":"2024-09-12T18:11:55.368862+0000","last_clean_scrub_stamp":"2024-09-12T18:11:55.368862+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":1200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:24:50.641775+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5916,"num_read_kb":5241,"num_write":1773,"num_write_kb":764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"263'270","reported_seq":946,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:49.700632+0000","last_change":"2024-09-12T18:11:49.700632+0000","last_active":"2024-09-12T18:11:49.700632+0000","last_peered":"2024-09-12T18:11:49.700632+0000","last_clean":"2024-09-12T18:11:49.700632+0000","last_became_active":"2024-09-12T17:11:16.862649+0000","last_became_peered":"2024-09-12T17:11:16.862649+0000","last_unstale":"2024-09-12T18:11:49.700632+0000","last_undegraded":"2024-09-12T18:11:49.700632+0000","last_fullsized":"2024-09-12T18:11:49.700632+0000","mapping_epoch":37,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'270","last_scrub_stamp":"2024-09-12T18:11:49.700437+0000","last_deep_scrub":"263'270","last_deep_scrub_stamp":"2024-09-12T18:11:49.700437+0000","last_clean_scrub_stamp":"2024-09-12T18:11:49.700437+0000","objects_scrubbed":5,"log_size":70,"log_dups_size":200,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:58:14.954108+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079905,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":591,"num_read_kb":13963,"num_write":1200,"num_write_kb":16858,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,7],"acting":[0,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"263'2","reported_seq":510,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:03.517735+0000","last_change":"2024-09-12T18:12:03.517735+0000","last_active":"2024-09-12T18:12:03.517735+0000","last_peered":"2024-09-12T18:12:03.517735+0000","last_clean":"2024-09-12T18:12:03.517735+0000","last_became_active":"2024-09-12T17:10:46.527422+0000","last_became_peered":"2024-09-12T17:10:46.527422+0000","last_unstale":"2024-09-12T18:12:03.517735+0000","last_undegraded":"2024-09-12T18:12:03.517735+0000","last_fullsized":"2024-09-12T18:12:03.517735+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T18:12:03.517615+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T18:12:03.517615+0000","last_clean_scrub_stamp":"2024-09-12T18:12:03.517615+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:57.076736+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"263'170","reported_seq":769,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:12.322398+0000","last_change":"2024-09-12T18:12:12.322398+0000","last_active":"2024-09-12T18:12:12.322398+0000","last_peered":"2024-09-12T18:12:12.322398+0000","last_clean":"2024-09-12T18:12:12.322398+0000","last_became_active":"2024-09-12T17:10:48.544572+0000","last_became_peered":"2024-09-12T17:10:48.544572+0000","last_unstale":"2024-09-12T18:12:12.322398+0000","last_undegraded":"2024-09-12T18:12:12.322398+0000","last_fullsized":"2024-09-12T18:12:12.322398+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'170","last_scrub_stamp":"2024-09-12T18:12:12.322280+0000","last_deep_scrub":"263'170","last_deep_scrub_stamp":"2024-09-12T18:12:12.322280+0000","last_clean_scrub_stamp":"2024-09-12T18:12:12.322280+0000","objects_scrubbed":5,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:27:13.540812+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6031,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":216,"num_read_kb":279,"num_write":122,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":498,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:17.660362+0000","last_change":"2024-09-12T18:12:17.660362+0000","last_active":"2024-09-12T18:12:17.660362+0000","last_peered":"2024-09-12T18:12:17.660362+0000","last_clean":"2024-09-12T18:12:17.660362+0000","last_became_active":"2024-09-12T17:10:50.560057+0000","last_became_peered":"2024-09-12T17:10:50.560057+0000","last_unstale":"2024-09-12T18:12:17.660362+0000","last_undegraded":"2024-09-12T18:12:17.660362+0000","last_fullsized":"2024-09-12T18:12:17.660362+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:17.660267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:17.660267+0000","last_clean_scrub_stamp":"2024-09-12T18:12:17.660267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:54:00.890287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"263'134","reported_seq":634,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:19.333865+0000","last_change":"2024-09-12T18:12:19.333865+0000","last_active":"2024-09-12T18:12:19.333865+0000","last_peered":"2024-09-12T18:12:19.333865+0000","last_clean":"2024-09-12T18:12:19.333865+0000","last_became_active":"2024-09-12T17:10:52.570480+0000","last_became_peered":"2024-09-12T17:10:52.570480+0000","last_unstale":"2024-09-12T18:12:19.333865+0000","last_undegraded":"2024-09-12T18:12:19.333865+0000","last_fullsized":"2024-09-12T18:12:19.333865+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'134","last_scrub_stamp":"2024-09-12T18:12:19.333752+0000","last_deep_scrub":"263'134","last_deep_scrub_stamp":"2024-09-12T18:12:19.333752+0000","last_clean_scrub_stamp":"2024-09-12T18:12:19.333752+0000","objects_scrubbed":2,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:45:19.407409+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":203,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":138,"num_read_kb":137,"num_write":320,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"263'412","reported_seq":1803,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:01.560956+0000","last_change":"2024-09-12T18:12:01.560956+0000","last_active":"2024-09-12T18:12:01.560956+0000","last_peered":"2024-09-12T18:12:01.560956+0000","last_clean":"2024-09-12T18:12:01.560956+0000","last_became_active":"2024-09-12T17:10:44.509508+0000","last_became_peered":"2024-09-12T17:10:44.509508+0000","last_unstale":"2024-09-12T18:12:01.560956+0000","last_undegraded":"2024-09-12T18:12:01.560956+0000","last_fullsized":"2024-09-12T18:12:01.560956+0000","mapping_epoch":26,"log_start":"263'401","ondisk_log_start":"263'401","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'412","last_scrub_stamp":"2024-09-12T18:12:01.560858+0000","last_deep_scrub":"263'412","last_deep_scrub_stamp":"2024-09-12T18:12:01.560858+0000","last_clean_scrub_stamp":"2024-09-12T18:12:01.560858+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":401,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:20:20.291813+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2094,"num_read_kb":1953,"num_write":504,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"263'239","reported_seq":891,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:50.835781+0000","last_change":"2024-09-12T18:11:50.835781+0000","last_active":"2024-09-12T18:11:50.835781+0000","last_peered":"2024-09-12T18:11:50.835781+0000","last_clean":"2024-09-12T18:11:50.835781+0000","last_became_active":"2024-09-12T17:10:42.521435+0000","last_became_peered":"2024-09-12T17:10:42.521435+0000","last_unstale":"2024-09-12T18:11:50.835781+0000","last_undegraded":"2024-09-12T18:11:50.835781+0000","last_fullsized":"2024-09-12T18:11:50.835781+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'239","last_scrub_stamp":"2024-09-12T18:11:50.835643+0000","last_deep_scrub":"263'239","last_deep_scrub_stamp":"2024-09-12T18:11:50.835643+0000","last_clean_scrub_stamp":"2024-09-12T18:11:50.835643+0000","objects_scrubbed":2,"log_size":39,"log_dups_size":200,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:10:01.459513+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079890,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":525,"num_read_kb":7759,"num_write":1104,"num_write_kb":27695,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,5],"acting":[6,0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"263'496","reported_seq":2220,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:59.616995+0000","last_change":"2024-09-12T18:11:59.616995+0000","last_active":"2024-09-12T18:11:59.616995+0000","last_peered":"2024-09-12T18:11:59.616995+0000","last_clean":"2024-09-12T18:11:59.616995+0000","last_became_active":"2024-09-12T17:10:44.519236+0000","last_became_peered":"2024-09-12T17:10:44.519236+0000","last_unstale":"2024-09-12T18:11:59.616995+0000","last_undegraded":"2024-09-12T18:11:59.616995+0000","last_fullsized":"2024-09-12T18:11:59.616995+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'496","last_scrub_stamp":"2024-09-12T18:11:59.616900+0000","last_deep_scrub":"263'496","last_deep_scrub_stamp":"2024-09-12T18:11:59.616900+0000","last_clean_scrub_stamp":"2024-09-12T18:11:59.616900+0000","objects_scrubbed":4,"log_size":96,"log_dups_size":400,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:18:26.390822+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2628,"num_read_kb":2506,"num_write":587,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":959,"num_omap_keys":4,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"263'256","reported_seq":1028,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:46.841303+0000","last_change":"2024-09-12T18:11:46.841303+0000","last_active":"2024-09-12T18:11:46.841303+0000","last_peered":"2024-09-12T18:11:46.841303+0000","last_clean":"2024-09-12T18:11:46.841303+0000","last_became_active":"2024-09-12T17:10:42.519178+0000","last_became_peered":"2024-09-12T17:10:42.519178+0000","last_unstale":"2024-09-12T18:11:46.841303+0000","last_undegraded":"2024-09-12T18:11:46.841303+0000","last_fullsized":"2024-09-12T18:11:46.841303+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'256","last_scrub_stamp":"2024-09-12T18:11:46.841193+0000","last_deep_scrub":"263'256","last_deep_scrub_stamp":"2024-09-12T18:11:46.841193+0000","last_clean_scrub_stamp":"2024-09-12T18:11:46.841193+0000","objects_scrubbed":4,"log_size":56,"log_dups_size":200,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:18:03.918052+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1051,"num_read_kb":7502,"num_write":1184,"num_write_kb":38848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6,7],"acting":[2,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"263'393","reported_seq":1978,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:03.464560+0000","last_change":"2024-09-12T18:12:03.464560+0000","last_active":"2024-09-12T18:12:03.464560+0000","last_peered":"2024-09-12T18:12:03.464560+0000","last_clean":"2024-09-12T18:12:03.464560+0000","last_became_active":"2024-09-12T17:10:44.515474+0000","last_became_peered":"2024-09-12T17:10:44.515474+0000","last_unstale":"2024-09-12T18:12:03.464560+0000","last_undegraded":"2024-09-12T18:12:03.464560+0000","last_fullsized":"2024-09-12T18:12:03.464560+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'393","last_scrub_stamp":"2024-09-12T18:12:03.464469+0000","last_deep_scrub":"263'393","last_deep_scrub_stamp":"2024-09-12T18:12:03.464469+0000","last_clean_scrub_stamp":"2024-09-12T18:12:03.464469+0000","objects_scrubbed":2,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:20:00.913328+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2306,"num_read_kb":2212,"num_write":451,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2811,"num_omap_keys":11,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"263'194","reported_seq":821,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:49.831325+0000","last_change":"2024-09-12T18:11:49.831325+0000","last_active":"2024-09-12T18:11:49.831325+0000","last_peered":"2024-09-12T18:11:49.831325+0000","last_clean":"2024-09-12T18:11:49.831325+0000","last_became_active":"2024-09-12T17:11:16.617657+0000","last_became_peered":"2024-09-12T17:11:16.617657+0000","last_unstale":"2024-09-12T18:11:49.831325+0000","last_undegraded":"2024-09-12T18:11:49.831325+0000","last_fullsized":"2024-09-12T18:11:49.831325+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'194","last_scrub_stamp":"2024-09-12T18:11:49.831132+0000","last_deep_scrub":"263'194","last_deep_scrub_stamp":"2024-09-12T18:11:49.831132+0000","last_clean_scrub_stamp":"2024-09-12T18:11:49.831132+0000","objects_scrubbed":4,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:50:28.703505+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2421940,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":499,"num_read_kb":26759,"num_write":947,"num_write_kb":25619,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,6],"acting":[2,3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"263'796","reported_seq":2424,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:58.588172+0000","last_change":"2024-09-12T18:11:58.588172+0000","last_active":"2024-09-12T18:11:58.588172+0000","last_peered":"2024-09-12T18:11:58.588172+0000","last_clean":"2024-09-12T18:11:58.588172+0000","last_became_active":"2024-09-12T17:10:44.509845+0000","last_became_peered":"2024-09-12T17:10:44.509845+0000","last_unstale":"2024-09-12T18:11:58.588172+0000","last_undegraded":"2024-09-12T18:11:58.588172+0000","last_fullsized":"2024-09-12T18:11:58.588172+0000","mapping_epoch":26,"log_start":"263'700","ondisk_log_start":"263'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'796","last_scrub_stamp":"2024-09-12T18:11:58.588066+0000","last_deep_scrub":"263'796","last_deep_scrub_stamp":"2024-09-12T18:11:58.588066+0000","last_clean_scrub_stamp":"2024-09-12T18:11:58.588066+0000","objects_scrubbed":4,"log_size":96,"log_dups_size":700,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:21:17.530150+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3882,"num_read_kb":3524,"num_write":1030,"num_write_kb":369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1767,"num_omap_keys":7,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"263'227","reported_seq":866,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:48.683516+0000","last_change":"2024-09-12T18:11:48.683516+0000","last_active":"2024-09-12T18:11:48.683516+0000","last_peered":"2024-09-12T18:11:48.683516+0000","last_clean":"2024-09-12T18:11:48.683516+0000","last_became_active":"2024-09-12T17:10:42.519560+0000","last_became_peered":"2024-09-12T17:10:42.519560+0000","last_unstale":"2024-09-12T18:11:48.683516+0000","last_undegraded":"2024-09-12T18:11:48.683516+0000","last_fullsized":"2024-09-12T18:11:48.683516+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'227","last_scrub_stamp":"2024-09-12T18:11:48.683332+0000","last_deep_scrub":"263'227","last_deep_scrub_stamp":"2024-09-12T18:11:48.683332+0000","last_clean_scrub_stamp":"2024-09-12T18:11:48.683332+0000","objects_scrubbed":4,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:30:14.775998+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436858,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":420,"num_read_kb":2141,"num_write":1026,"num_write_kb":23963,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,1],"acting":[0,3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"263'775","reported_seq":2456,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:02.695598+0000","last_change":"2024-09-12T18:12:02.695598+0000","last_active":"2024-09-12T18:12:02.695598+0000","last_peered":"2024-09-12T18:12:02.695598+0000","last_clean":"2024-09-12T18:12:02.695598+0000","last_became_active":"2024-09-12T17:10:44.511893+0000","last_became_peered":"2024-09-12T17:10:44.511893+0000","last_unstale":"2024-09-12T18:12:02.695598+0000","last_undegraded":"2024-09-12T18:12:02.695598+0000","last_fullsized":"2024-09-12T18:12:02.695598+0000","mapping_epoch":26,"log_start":"263'700","ondisk_log_start":"263'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'775","last_scrub_stamp":"2024-09-12T18:12:02.695496+0000","last_deep_scrub":"263'775","last_deep_scrub_stamp":"2024-09-12T18:12:02.695496+0000","last_clean_scrub_stamp":"2024-09-12T18:12:02.695496+0000","objects_scrubbed":6,"log_size":75,"log_dups_size":700,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:46:44.854411+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":3826,"num_read_kb":3490,"num_write":982,"num_write_kb":336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":873,"num_omap_keys":4,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"263'223","reported_seq":1076,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:52.597345+0000","last_change":"2024-09-12T18:11:52.597345+0000","last_active":"2024-09-12T18:11:52.597345+0000","last_peered":"2024-09-12T18:11:52.597345+0000","last_clean":"2024-09-12T18:11:52.597345+0000","last_became_active":"2024-09-12T17:10:42.524018+0000","last_became_peered":"2024-09-12T17:10:42.524018+0000","last_unstale":"2024-09-12T18:11:52.597345+0000","last_undegraded":"2024-09-12T18:11:52.597345+0000","last_fullsized":"2024-09-12T18:11:52.597345+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'223","last_scrub_stamp":"2024-09-12T18:11:52.597221+0000","last_deep_scrub":"263'223","last_deep_scrub_stamp":"2024-09-12T18:11:52.597221+0000","last_clean_scrub_stamp":"2024-09-12T18:11:52.597221+0000","objects_scrubbed":7,"log_size":23,"log_dups_size":200,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:24:31.501834+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6860809,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1298,"num_read_kb":150766,"num_write":988,"num_write_kb":42134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0,7],"acting":[3,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"263'525","reported_seq":2028,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:00.344852+0000","last_change":"2024-09-12T18:12:00.344852+0000","last_active":"2024-09-12T18:12:00.344852+0000","last_peered":"2024-09-12T18:12:00.344852+0000","last_clean":"2024-09-12T18:12:00.344852+0000","last_became_active":"2024-09-12T17:10:44.509433+0000","last_became_peered":"2024-09-12T17:10:44.509433+0000","last_unstale":"2024-09-12T18:12:00.344852+0000","last_undegraded":"2024-09-12T18:12:00.344852+0000","last_fullsized":"2024-09-12T18:12:00.344852+0000","mapping_epoch":26,"log_start":"263'500","ondisk_log_start":"263'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'525","last_scrub_stamp":"2024-09-12T18:12:00.344754+0000","last_deep_scrub":"263'525","last_deep_scrub_stamp":"2024-09-12T18:12:00.344754+0000","last_clean_scrub_stamp":"2024-09-12T18:12:00.344754+0000","objects_scrubbed":1,"log_size":25,"log_dups_size":500,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:26:19.066537+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2637,"num_read_kb":2409,"num_write":664,"num_write_kb":195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"263'180","reported_seq":848,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:49.669048+0000","last_change":"2024-09-12T18:11:49.669048+0000","last_active":"2024-09-12T18:11:49.669048+0000","last_peered":"2024-09-12T18:11:49.669048+0000","last_clean":"2024-09-12T18:11:49.669048+0000","last_became_active":"2024-09-12T17:10:42.514593+0000","last_became_peered":"2024-09-12T17:10:42.514593+0000","last_unstale":"2024-09-12T18:11:49.669048+0000","last_undegraded":"2024-09-12T18:11:49.669048+0000","last_fullsized":"2024-09-12T18:11:49.669048+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'180","last_scrub_stamp":"2024-09-12T18:11:49.668940+0000","last_deep_scrub":"263'180","last_deep_scrub_stamp":"2024-09-12T18:11:49.668940+0000","last_clean_scrub_stamp":"2024-09-12T18:11:49.668940+0000","objects_scrubbed":3,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:25:30.505868+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262186,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":484,"num_read_kb":20980,"num_write":843,"num_write_kb":34024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,5],"acting":[1,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"263'1126","reported_seq":2702,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:59.649341+0000","last_change":"2024-09-12T18:11:59.649341+0000","last_active":"2024-09-12T18:11:59.649341+0000","last_peered":"2024-09-12T18:11:59.649341+0000","last_clean":"2024-09-12T18:11:59.649341+0000","last_became_active":"2024-09-12T17:10:44.522911+0000","last_became_peered":"2024-09-12T17:10:44.522911+0000","last_unstale":"2024-09-12T18:11:59.649341+0000","last_undegraded":"2024-09-12T18:11:59.649341+0000","last_fullsized":"2024-09-12T18:11:59.649341+0000","mapping_epoch":26,"log_start":"263'1100","ondisk_log_start":"263'1100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1126","last_scrub_stamp":"2024-09-12T18:11:59.649236+0000","last_deep_scrub":"263'1126","last_deep_scrub_stamp":"2024-09-12T18:11:59.649236+0000","last_clean_scrub_stamp":"2024-09-12T18:11:59.649236+0000","objects_scrubbed":2,"log_size":26,"log_dups_size":1100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:23:15.875406+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5182,"num_read_kb":4601,"num_write":1539,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"263'194","reported_seq":848,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:51.815496+0000","last_change":"2024-09-12T18:11:51.815496+0000","last_active":"2024-09-12T18:11:51.815496+0000","last_peered":"2024-09-12T18:11:51.815496+0000","last_clean":"2024-09-12T18:11:51.815496+0000","last_became_active":"2024-09-12T17:10:42.520304+0000","last_became_peered":"2024-09-12T17:10:42.520304+0000","last_unstale":"2024-09-12T18:11:51.815496+0000","last_undegraded":"2024-09-12T18:11:51.815496+0000","last_fullsized":"2024-09-12T18:11:51.815496+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'194","last_scrub_stamp":"2024-09-12T18:11:51.815318+0000","last_deep_scrub":"263'194","last_deep_scrub_stamp":"2024-09-12T18:11:51.815318+0000","last_clean_scrub_stamp":"2024-09-12T18:11:51.815318+0000","objects_scrubbed":2,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:18:33.880648+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1342049,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":493,"num_read_kb":8074,"num_write":952,"num_write_kb":20454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4,5],"acting":[6,7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"263'882","reported_seq":2590,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:57.696628+0000","last_change":"2024-09-12T18:11:57.696628+0000","last_active":"2024-09-12T18:11:57.696628+0000","last_peered":"2024-09-12T18:11:57.696628+0000","last_clean":"2024-09-12T18:11:57.696628+0000","last_became_active":"2024-09-12T17:10:44.517530+0000","last_became_peered":"2024-09-12T17:10:44.517530+0000","last_unstale":"2024-09-12T18:11:57.696628+0000","last_undegraded":"2024-09-12T18:11:57.696628+0000","last_fullsized":"2024-09-12T18:11:57.696628+0000","mapping_epoch":26,"log_start":"263'800","ondisk_log_start":"263'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'882","last_scrub_stamp":"2024-09-12T18:11:57.696541+0000","last_deep_scrub":"263'882","last_deep_scrub_stamp":"2024-09-12T18:11:57.696541+0000","last_clean_scrub_stamp":"2024-09-12T18:11:57.696541+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":800,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:06:13.761379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4395,"num_read_kb":3967,"num_write":1219,"num_write_kb":499,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"263'187","reported_seq":816,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:04.607590+0000","last_change":"2024-09-12T18:12:04.607590+0000","last_active":"2024-09-12T18:12:04.607590+0000","last_peered":"2024-09-12T18:12:04.607590+0000","last_clean":"2024-09-12T18:12:04.607590+0000","last_became_active":"2024-09-12T17:10:42.528899+0000","last_became_peered":"2024-09-12T17:10:42.528899+0000","last_unstale":"2024-09-12T18:12:04.607590+0000","last_undegraded":"2024-09-12T18:12:04.607590+0000","last_fullsized":"2024-09-12T18:12:04.607590+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'187","last_scrub_stamp":"2024-09-12T18:12:04.607432+0000","last_deep_scrub":"263'187","last_deep_scrub_stamp":"2024-09-12T18:12:04.607432+0000","last_clean_scrub_stamp":"2024-09-12T18:12:04.607432+0000","objects_scrubbed":5,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:45:28.481287+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7371399,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":389,"num_read_kb":42419,"num_write":869,"num_write_kb":46548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,5],"acting":[3,4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"263'388","reported_seq":1852,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:00.729788+0000","last_change":"2024-09-12T18:12:00.729788+0000","last_active":"2024-09-12T18:12:00.729788+0000","last_peered":"2024-09-12T18:12:00.729788+0000","last_clean":"2024-09-12T18:12:00.729788+0000","last_became_active":"2024-09-12T17:10:44.523173+0000","last_became_peered":"2024-09-12T17:10:44.523173+0000","last_unstale":"2024-09-12T18:12:00.729788+0000","last_undegraded":"2024-09-12T18:12:00.729788+0000","last_fullsized":"2024-09-12T18:12:00.729788+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'388","last_scrub_stamp":"2024-09-12T18:12:00.729701+0000","last_deep_scrub":"263'388","last_deep_scrub_stamp":"2024-09-12T18:12:00.729701+0000","last_clean_scrub_stamp":"2024-09-12T18:12:00.729701+0000","objects_scrubbed":3,"log_size":88,"log_dups_size":300,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:17:09.750351+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2006,"num_read_kb":1913,"num_write":441,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":236,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"263'150","reported_seq":852,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:50.263634+0000","last_change":"2024-09-12T18:11:50.263634+0000","last_active":"2024-09-12T18:11:50.263634+0000","last_peered":"2024-09-12T18:11:50.263634+0000","last_clean":"2024-09-12T18:11:50.263634+0000","last_became_active":"2024-09-12T17:10:42.521824+0000","last_became_peered":"2024-09-12T17:10:42.521824+0000","last_unstale":"2024-09-12T18:11:50.263634+0000","last_undegraded":"2024-09-12T18:11:50.263634+0000","last_fullsized":"2024-09-12T18:11:50.263634+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'150","last_scrub_stamp":"2024-09-12T18:11:50.263511+0000","last_deep_scrub":"263'150","last_deep_scrub_stamp":"2024-09-12T18:11:50.263511+0000","last_clean_scrub_stamp":"2024-09-12T18:11:50.263511+0000","objects_scrubbed":4,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:14:36.257295+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":605,"num_read_kb":135941,"num_write":774,"num_write_kb":15017,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"263'498","reported_seq":2146,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:01.300891+0000","last_change":"2024-09-12T18:12:01.300891+0000","last_active":"2024-09-12T18:12:01.300891+0000","last_peered":"2024-09-12T18:12:01.300891+0000","last_clean":"2024-09-12T18:12:01.300891+0000","last_became_active":"2024-09-12T17:10:44.517175+0000","last_became_peered":"2024-09-12T17:10:44.517175+0000","last_unstale":"2024-09-12T18:12:01.300891+0000","last_undegraded":"2024-09-12T18:12:01.300891+0000","last_fullsized":"2024-09-12T18:12:01.300891+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'498","last_scrub_stamp":"2024-09-12T18:12:01.300799+0000","last_deep_scrub":"263'498","last_deep_scrub_stamp":"2024-09-12T18:12:01.300799+0000","last_clean_scrub_stamp":"2024-09-12T18:12:01.300799+0000","objects_scrubbed":1,"log_size":98,"log_dups_size":400,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:10:17.438378+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2646,"num_read_kb":2487,"num_write":582,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2551,"num_omap_keys":10,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"263'171","reported_seq":793,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:53.554829+0000","last_change":"2024-09-12T18:11:53.554829+0000","last_active":"2024-09-12T18:11:53.554829+0000","last_peered":"2024-09-12T18:11:53.554829+0000","last_clean":"2024-09-12T18:11:53.554829+0000","last_became_active":"2024-09-12T17:10:42.524860+0000","last_became_peered":"2024-09-12T17:10:42.524860+0000","last_unstale":"2024-09-12T18:11:53.554829+0000","last_undegraded":"2024-09-12T18:11:53.554829+0000","last_fullsized":"2024-09-12T18:11:53.554829+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'171","last_scrub_stamp":"2024-09-12T18:11:53.554696+0000","last_deep_scrub":"263'171","last_deep_scrub_stamp":"2024-09-12T18:11:53.554696+0000","last_clean_scrub_stamp":"2024-09-12T18:11:53.554696+0000","objects_scrubbed":3,"log_size":71,"log_dups_size":100,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:32:08.383982+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":409,"num_read_kb":436,"num_write":844,"num_write_kb":16042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,1],"acting":[3,4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"263'740","reported_seq":2322,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:53.804065+0000","last_change":"2024-09-12T18:11:53.804065+0000","last_active":"2024-09-12T18:11:53.804065+0000","last_peered":"2024-09-12T18:11:53.804065+0000","last_clean":"2024-09-12T18:11:53.804065+0000","last_became_active":"2024-09-12T17:10:44.514847+0000","last_became_peered":"2024-09-12T17:10:44.514847+0000","last_unstale":"2024-09-12T18:11:53.804065+0000","last_undegraded":"2024-09-12T18:11:53.804065+0000","last_fullsized":"2024-09-12T18:11:53.804065+0000","mapping_epoch":26,"log_start":"263'700","ondisk_log_start":"263'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'740","last_scrub_stamp":"2024-09-12T18:11:53.803969+0000","last_deep_scrub":"263'740","last_deep_scrub_stamp":"2024-09-12T18:11:53.803969+0000","last_clean_scrub_stamp":"2024-09-12T18:11:53.803969+0000","objects_scrubbed":2,"log_size":40,"log_dups_size":700,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:10:16.440746+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3592,"num_read_kb":3279,"num_write":969,"num_write_kb":334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":432,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"263'232","reported_seq":897,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:51.259031+0000","last_change":"2024-09-12T18:11:51.259031+0000","last_active":"2024-09-12T18:11:51.259031+0000","last_peered":"2024-09-12T18:11:51.259031+0000","last_clean":"2024-09-12T18:11:51.259031+0000","last_became_active":"2024-09-12T17:10:42.519789+0000","last_became_peered":"2024-09-12T17:10:42.519789+0000","last_unstale":"2024-09-12T18:11:51.259031+0000","last_undegraded":"2024-09-12T18:11:51.259031+0000","last_fullsized":"2024-09-12T18:11:51.259031+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'232","last_scrub_stamp":"2024-09-12T18:11:51.258820+0000","last_deep_scrub":"263'232","last_deep_scrub_stamp":"2024-09-12T18:11:51.258820+0000","last_clean_scrub_stamp":"2024-09-12T18:11:51.258820+0000","objects_scrubbed":6,"log_size":32,"log_dups_size":200,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:06:47.531898+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079985,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":565,"num_read_kb":21140,"num_write":1106,"num_write_kb":33501,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,3],"acting":[5,7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"263'453","reported_seq":1955,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:59.367729+0000","last_change":"2024-09-12T18:11:59.367729+0000","last_active":"2024-09-12T18:11:59.367729+0000","last_peered":"2024-09-12T18:11:59.367729+0000","last_clean":"2024-09-12T18:11:59.367729+0000","last_became_active":"2024-09-12T17:10:44.510280+0000","last_became_peered":"2024-09-12T17:10:44.510280+0000","last_unstale":"2024-09-12T18:11:59.367729+0000","last_undegraded":"2024-09-12T18:11:59.367729+0000","last_fullsized":"2024-09-12T18:11:59.367729+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'453","last_scrub_stamp":"2024-09-12T18:11:59.367623+0000","last_deep_scrub":"263'453","last_deep_scrub_stamp":"2024-09-12T18:11:59.367623+0000","last_clean_scrub_stamp":"2024-09-12T18:11:59.367623+0000","objects_scrubbed":2,"log_size":53,"log_dups_size":400,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:42:33.011282+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2351,"num_read_kb":2195,"num_write":554,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"263'151","reported_seq":757,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:51.719192+0000","last_change":"2024-09-12T18:11:51.719192+0000","last_active":"2024-09-12T18:11:51.719192+0000","last_peered":"2024-09-12T18:11:51.719192+0000","last_clean":"2024-09-12T18:11:51.719192+0000","last_became_active":"2024-09-12T17:10:42.520020+0000","last_became_peered":"2024-09-12T17:10:42.520020+0000","last_unstale":"2024-09-12T18:11:51.719192+0000","last_undegraded":"2024-09-12T18:11:51.719192+0000","last_fullsized":"2024-09-12T18:11:51.719192+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'151","last_scrub_stamp":"2024-09-12T18:11:51.719074+0000","last_deep_scrub":"263'151","last_deep_scrub_stamp":"2024-09-12T18:11:51.719074+0000","last_clean_scrub_stamp":"2024-09-12T18:11:51.719074+0000","objects_scrubbed":5,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:00:04.688300+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399173,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":329,"num_read_kb":1191,"num_write":748,"num_write_kb":23442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,6],"acting":[0,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"263'360","reported_seq":1781,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:02.582515+0000","last_change":"2024-09-12T18:12:02.582515+0000","last_active":"2024-09-12T18:12:02.582515+0000","last_peered":"2024-09-12T18:12:02.582515+0000","last_clean":"2024-09-12T18:12:02.582515+0000","last_became_active":"2024-09-12T17:10:44.516697+0000","last_became_peered":"2024-09-12T17:10:44.516697+0000","last_unstale":"2024-09-12T18:12:02.582515+0000","last_undegraded":"2024-09-12T18:12:02.582515+0000","last_fullsized":"2024-09-12T18:12:02.582515+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'360","last_scrub_stamp":"2024-09-12T18:12:02.582325+0000","last_deep_scrub":"263'360","last_deep_scrub_stamp":"2024-09-12T18:12:02.582325+0000","last_clean_scrub_stamp":"2024-09-12T18:12:02.582325+0000","objects_scrubbed":3,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:42:49.327952+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1919,"num_read_kb":1833,"num_write":391,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"263'209","reported_seq":878,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:50.859980+0000","last_change":"2024-09-12T18:11:50.859917+0000","last_active":"2024-09-12T18:11:50.859980+0000","last_peered":"2024-09-12T18:11:50.859980+0000","last_clean":"2024-09-12T18:11:50.859980+0000","last_became_active":"2024-09-12T17:11:16.862645+0000","last_became_peered":"2024-09-12T17:11:16.862645+0000","last_unstale":"2024-09-12T18:11:50.859980+0000","last_undegraded":"2024-09-12T18:11:50.859980+0000","last_fullsized":"2024-09-12T18:11:50.859980+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'209","last_scrub_stamp":"2024-09-12T18:11:50.859772+0000","last_deep_scrub":"263'209","last_deep_scrub_stamp":"2024-09-12T18:11:50.859772+0000","last_clean_scrub_stamp":"2024-09-12T18:11:50.859772+0000","objects_scrubbed":5,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:34:01.980997+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38716,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":577,"num_read_kb":84325,"num_write":975,"num_write_kb":27874,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,0,7],"acting":[2,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"263'820","reported_seq":2292,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:59.723232+0000","last_change":"2024-09-12T18:11:59.723232+0000","last_active":"2024-09-12T18:11:59.723232+0000","last_peered":"2024-09-12T18:11:59.723232+0000","last_clean":"2024-09-12T18:11:59.723232+0000","last_became_active":"2024-09-12T17:10:44.519253+0000","last_became_peered":"2024-09-12T17:10:44.519253+0000","last_unstale":"2024-09-12T18:11:59.723232+0000","last_undegraded":"2024-09-12T18:11:59.723232+0000","last_fullsized":"2024-09-12T18:11:59.723232+0000","mapping_epoch":26,"log_start":"263'800","ondisk_log_start":"263'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'820","last_scrub_stamp":"2024-09-12T18:11:59.723131+0000","last_deep_scrub":"263'820","last_deep_scrub_stamp":"2024-09-12T18:11:59.723131+0000","last_clean_scrub_stamp":"2024-09-12T18:11:59.723131+0000","objects_scrubbed":2,"log_size":20,"log_dups_size":800,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:31:46.831616+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3866,"num_read_kb":3440,"num_write":1124,"num_write_kb":450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"263'183","reported_seq":799,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:54.498363+0000","last_change":"2024-09-12T18:11:54.498363+0000","last_active":"2024-09-12T18:11:54.498363+0000","last_peered":"2024-09-12T18:11:54.498363+0000","last_clean":"2024-09-12T18:11:54.498363+0000","last_became_active":"2024-09-12T17:10:42.524098+0000","last_became_peered":"2024-09-12T17:10:42.524098+0000","last_unstale":"2024-09-12T18:11:54.498363+0000","last_undegraded":"2024-09-12T18:11:54.498363+0000","last_fullsized":"2024-09-12T18:11:54.498363+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'183","last_scrub_stamp":"2024-09-12T18:11:54.498278+0000","last_deep_scrub":"263'183","last_deep_scrub_stamp":"2024-09-12T18:11:54.498278+0000","last_clean_scrub_stamp":"2024-09-12T18:11:54.498278+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:41:02.476962+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":371,"num_read_kb":5543,"num_write":831,"num_write_kb":19602,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6,3],"acting":[7,2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"263'418","reported_seq":2013,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:06.626096+0000","last_change":"2024-09-12T18:12:06.626096+0000","last_active":"2024-09-12T18:12:06.626096+0000","last_peered":"2024-09-12T18:12:06.626096+0000","last_clean":"2024-09-12T18:12:06.626096+0000","last_became_active":"2024-09-12T17:10:44.514154+0000","last_became_peered":"2024-09-12T17:10:44.514154+0000","last_unstale":"2024-09-12T18:12:06.626096+0000","last_undegraded":"2024-09-12T18:12:06.626096+0000","last_fullsized":"2024-09-12T18:12:06.626096+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'418","last_scrub_stamp":"2024-09-12T18:12:06.625996+0000","last_deep_scrub":"263'418","last_deep_scrub_stamp":"2024-09-12T18:12:06.625996+0000","last_clean_scrub_stamp":"2024-09-12T18:12:06.625996+0000","objects_scrubbed":2,"log_size":18,"log_dups_size":400,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:51:07.252603+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2340,"num_read_kb":2233,"num_write":478,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":217,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"263'226","reported_seq":853,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:51.851968+0000","last_change":"2024-09-12T18:11:51.851968+0000","last_active":"2024-09-12T18:11:51.851968+0000","last_peered":"2024-09-12T18:11:51.851968+0000","last_clean":"2024-09-12T18:11:51.851968+0000","last_became_active":"2024-09-12T17:10:42.519316+0000","last_became_peered":"2024-09-12T17:10:42.519316+0000","last_unstale":"2024-09-12T18:11:51.851968+0000","last_undegraded":"2024-09-12T18:11:51.851968+0000","last_fullsized":"2024-09-12T18:11:51.851968+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'226","last_scrub_stamp":"2024-09-12T18:11:51.851860+0000","last_deep_scrub":"263'226","last_deep_scrub_stamp":"2024-09-12T18:11:51.851860+0000","last_clean_scrub_stamp":"2024-09-12T18:11:51.851860+0000","objects_scrubbed":3,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:35:21.884135+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470224,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":508,"num_read_kb":7212,"num_write":965,"num_write_kb":24573,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1,7],"acting":[2,6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"263'437","reported_seq":2045,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:01.592262+0000","last_change":"2024-09-12T18:12:01.592262+0000","last_active":"2024-09-12T18:12:01.592262+0000","last_peered":"2024-09-12T18:12:01.592262+0000","last_clean":"2024-09-12T18:12:01.592262+0000","last_became_active":"2024-09-12T17:10:44.513514+0000","last_became_peered":"2024-09-12T17:10:44.513514+0000","last_unstale":"2024-09-12T18:12:01.592262+0000","last_undegraded":"2024-09-12T18:12:01.592262+0000","last_fullsized":"2024-09-12T18:12:01.592262+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'437","last_scrub_stamp":"2024-09-12T18:12:01.592155+0000","last_deep_scrub":"263'437","last_deep_scrub_stamp":"2024-09-12T18:12:01.592155+0000","last_clean_scrub_stamp":"2024-09-12T18:12:01.592155+0000","objects_scrubbed":3,"log_size":37,"log_dups_size":400,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:14:07.719792+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2337,"num_read_kb":2234,"num_write":490,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"263'146","reported_seq":770,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:00.383167+0000","last_change":"2024-09-12T18:12:00.383167+0000","last_active":"2024-09-12T18:12:00.383167+0000","last_peered":"2024-09-12T18:12:00.383167+0000","last_clean":"2024-09-12T18:12:00.383167+0000","last_became_active":"2024-09-12T17:10:42.527050+0000","last_became_peered":"2024-09-12T17:10:42.527050+0000","last_unstale":"2024-09-12T18:12:00.383167+0000","last_undegraded":"2024-09-12T18:12:00.383167+0000","last_fullsized":"2024-09-12T18:12:00.383167+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'146","last_scrub_stamp":"2024-09-12T18:12:00.383024+0000","last_deep_scrub":"263'146","last_deep_scrub_stamp":"2024-09-12T18:12:00.383024+0000","last_clean_scrub_stamp":"2024-09-12T18:12:00.383024+0000","objects_scrubbed":4,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:22:31.915728+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079896,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":321,"num_read_kb":34406,"num_write":732,"num_write_kb":29438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4,6],"acting":[5,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"263'196","reported_seq":841,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:54.283254+0000","last_change":"2024-09-12T18:11:54.283254+0000","last_active":"2024-09-12T18:11:54.283254+0000","last_peered":"2024-09-12T18:11:54.283254+0000","last_clean":"2024-09-12T18:11:54.283254+0000","last_became_active":"2024-09-12T17:10:42.523311+0000","last_became_peered":"2024-09-12T17:10:42.523311+0000","last_unstale":"2024-09-12T18:11:54.283254+0000","last_undegraded":"2024-09-12T18:11:54.283254+0000","last_fullsized":"2024-09-12T18:11:54.283254+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'196","last_scrub_stamp":"2024-09-12T18:11:54.283131+0000","last_deep_scrub":"263'196","last_deep_scrub_stamp":"2024-09-12T18:11:54.283131+0000","last_clean_scrub_stamp":"2024-09-12T18:11:54.283131+0000","objects_scrubbed":2,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:27:10.864086+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":468,"num_read_kb":32297,"num_write":957,"num_write_kb":18657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,7],"acting":[5,1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"263'823","reported_seq":2274,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:02.655360+0000","last_change":"2024-09-12T18:12:02.655360+0000","last_active":"2024-09-12T18:12:02.655360+0000","last_peered":"2024-09-12T18:12:02.655360+0000","last_clean":"2024-09-12T18:12:02.655360+0000","last_became_active":"2024-09-12T17:10:44.523243+0000","last_became_peered":"2024-09-12T17:10:44.523243+0000","last_unstale":"2024-09-12T18:12:02.655360+0000","last_undegraded":"2024-09-12T18:12:02.655360+0000","last_fullsized":"2024-09-12T18:12:02.655360+0000","mapping_epoch":26,"log_start":"263'800","ondisk_log_start":"263'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'823","last_scrub_stamp":"2024-09-12T18:12:02.655272+0000","last_deep_scrub":"263'823","last_deep_scrub_stamp":"2024-09-12T18:12:02.655272+0000","last_clean_scrub_stamp":"2024-09-12T18:12:02.655272+0000","objects_scrubbed":2,"log_size":23,"log_dups_size":800,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:46:36.986649+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3977,"num_read_kb":3544,"num_write":1118,"num_write_kb":432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":220,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"263'239","reported_seq":892,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:52.620009+0000","last_change":"2024-09-12T18:11:52.620009+0000","last_active":"2024-09-12T18:11:52.620009+0000","last_peered":"2024-09-12T18:11:52.620009+0000","last_clean":"2024-09-12T18:11:52.620009+0000","last_became_active":"2024-09-12T17:10:42.519643+0000","last_became_peered":"2024-09-12T17:10:42.519643+0000","last_unstale":"2024-09-12T18:11:52.620009+0000","last_undegraded":"2024-09-12T18:11:52.620009+0000","last_fullsized":"2024-09-12T18:11:52.620009+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'239","last_scrub_stamp":"2024-09-12T18:11:52.619898+0000","last_deep_scrub":"263'239","last_deep_scrub_stamp":"2024-09-12T18:11:52.619898+0000","last_clean_scrub_stamp":"2024-09-12T18:11:52.619898+0000","objects_scrubbed":3,"log_size":39,"log_dups_size":200,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:17:44.502362+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079919,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":418,"num_read_kb":42701,"num_write":983,"num_write_kb":42419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5,0],"acting":[1,4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"263'617","reported_seq":2316,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:04.482840+0000","last_change":"2024-09-12T18:12:04.482840+0000","last_active":"2024-09-12T18:12:04.482840+0000","last_peered":"2024-09-12T18:12:04.482840+0000","last_clean":"2024-09-12T18:12:04.482840+0000","last_became_active":"2024-09-12T17:10:44.512488+0000","last_became_peered":"2024-09-12T17:10:44.512488+0000","last_unstale":"2024-09-12T18:12:04.482840+0000","last_undegraded":"2024-09-12T18:12:04.482840+0000","last_fullsized":"2024-09-12T18:12:04.482840+0000","mapping_epoch":26,"log_start":"263'600","ondisk_log_start":"263'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'617","last_scrub_stamp":"2024-09-12T18:12:04.482707+0000","last_deep_scrub":"263'617","last_deep_scrub_stamp":"2024-09-12T18:12:04.482707+0000","last_clean_scrub_stamp":"2024-09-12T18:12:04.482707+0000","objects_scrubbed":5,"log_size":17,"log_dups_size":600,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:05:09.251938+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3240,"num_read_kb":2966,"num_write":800,"num_write_kb":244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2039,"num_omap_keys":8,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6085,"num_read_kb":4263,"num_write":1964,"num_write_kb":863,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1035,"ondisk_log_size":1035,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15869,"num_objects":86,"num_object_clones":0,"num_object_copies":172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":86,"num_whiteouts":0,"num_read":16199,"num_read_kb":15883,"num_write":16708,"num_write_kb":4876,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2797,"num_omap_keys":17,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":31738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1731,"ondisk_log_size":1731,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":575,"ondisk_log_size":575,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":271969,"num_objects":199,"num_object_clones":0,"num_object_copies":398,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":199,"num_whiteouts":0,"num_read":8822,"num_read_kb":10790,"num_write":6053,"num_write_kb":2795,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":676642,"num_omap_keys":1572,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1836,"ondisk_log_size":1836,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2393,"num_read_kb":2857,"num_write":20,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":165,"num_object_clones":0,"num_object_copies":330,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":165,"num_whiteouts":0,"num_read":212965,"num_read_kb":194286,"num_write":55441,"num_write_kb":18926,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":165,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":43286,"num_omap_keys":176,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3862,"ondisk_log_size":3862,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":376,"num_omap_keys":4,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8,"ondisk_log_size":8,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":74416905,"num_objects":230,"num_object_clones":0,"num_object_copies":920,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":230,"num_whiteouts":0,"num_read":33088,"num_read_kb":2020320,"num_write":62843,"num_write_kb":2063190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":101629952,"data_stored":101629952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3869,"ondisk_log_size":3869,"up":256,"acting":256,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":141,"num_read_kb":196715,"num_write":158,"num_write_kb":127071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":137,"num_read_kb":189543,"num_write":158,"num_write_kb":127071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575598,"num_pgs":116,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":261372,"kb_used_data":17772,"kb_used_omap":1,"kb_used_meta":243582,"kb_avail":94110468,"statfs":{"total":96636764160,"available":96369119232,"internally_reserved":0,"allocated":18198528,"data_stored":16210424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":249428427},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575596,"num_pgs":107,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":273160,"kb_used_data":17080,"kb_used_omap":1,"kb_used_meta":256062,"kb_avail":94098680,"statfs":{"total":96636764160,"available":96357048320,"internally_reserved":0,"allocated":17489920,"data_stored":15541198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":262207942},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575601,"num_pgs":113,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":124372,"kb_used_data":12676,"kb_used_omap":1,"kb_used_meta":111678,"kb_avail":94247468,"statfs":{"total":96636764160,"available":96509407232,"internally_reserved":0,"allocated":12980224,"data_stored":10947706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":114358725},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575596,"num_pgs":113,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":133164,"kb_used_data":21468,"kb_used_omap":1,"kb_used_meta":111678,"kb_avail":94238676,"statfs":{"total":96636764160,"available":96500404224,"internally_reserved":0,"allocated":21983232,"data_stored":20058842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":114358725},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575598,"num_pgs":130,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":244300,"kb_used_data":18748,"kb_used_omap":1,"kb_used_meta":225534,"kb_avail":94127540,"statfs":{"total":96636764160,"available":96386600960,"internally_reserved":0,"allocated":19197952,"data_stored":17229442,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":230947271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575598,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":107112,"kb_used_data":13464,"kb_used_omap":1,"kb_used_meta":93630,"kb_avail":94264728,"statfs":{"total":96636764160,"available":96527081472,"internally_reserved":0,"allocated":13787136,"data_stored":11862866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":95877573},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575596,"num_pgs":120,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":151364,"kb_used_data":16116,"kb_used_omap":1,"kb_used_meta":135230,"kb_avail":94220476,"statfs":{"total":96636764160,"available":96481767424,"internally_reserved":0,"allocated":16502784,"data_stored":14528294,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":138475973},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575597,"num_pgs":116,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":254156,"kb_used_data":16124,"kb_used_omap":1,"kb_used_meta":238014,"kb_avail":94117684,"statfs":{"total":96636764160,"available":96376508416,"internally_reserved":0,"allocated":16510976,"data_stored":14534914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":243726789},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":11681792,"data_stored":11681792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12263424,"data_stored":12263424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":9601024,"data_stored":9601024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":14966784,"data_stored":14966784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":17797120,"data_stored":17797120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8683520,"data_stored":8683520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":13279232,"data_stored":13279232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":13357056,"data_stored":13357056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":4345,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":5119,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":3919,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":4996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3623,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":3527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T18:12:29.120 INFO:tasks.ceph:pgid 68.1a last_scrub_stamp 2024-09-12T17:46:56.058809+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:29.120 INFO:tasks.ceph:pgid 67.1d last_scrub_stamp 2024-09-12T17:30:15.649995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:29.120 INFO:tasks.ceph:pgid 66.1c last_scrub_stamp 2024-09-12T17:30:11.622113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:29.120 INFO:tasks.ceph:pgid 65.1f last_scrub_stamp 2024-09-12T17:26:34.641203+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=26, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:29.121 INFO:tasks.ceph:pgid 67.1c last_scrub_stamp 2024-09-12T17:30:15.649995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:29.121 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-09-12T17:30:15.649995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:29.121 INFO:tasks.ceph:pgid 65.1d last_scrub_stamp 2024-09-12T17:26:34.641203+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=26, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:29.121 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-09-12T17:46:56.058809+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:29.121 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-09-12T17:30:15.649995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:29.121 INFO:tasks.ceph:pgid 66.1f last_scrub_stamp 2024-09-12T17:30:11.622113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:29.121 INFO:tasks.ceph:pgid 65.1c last_scrub_stamp 2024-09-12T17:26:34.641203+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=26, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:29.121 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-09-12T17:46:56.058809+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:29.122 INFO:tasks.ceph:pgid 67.19 last_scrub_stamp 2024-09-12T17:30:15.649995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:29.122 INFO:tasks.ceph:pgid 66.18 last_scrub_stamp 2024-09-12T17:30:11.622113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:29.122 INFO:tasks.ceph:pgid 65.1b last_scrub_stamp 2024-09-12T17:26:34.641203+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=26, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:29.122 INFO:tasks.ceph:pgid 68.1f last_scrub_stamp 2024-09-12T17:46:56.058809+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:29.122 INFO:tasks.ceph:pgid 66.19 last_scrub_stamp 2024-09-12T17:30:11.622113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:29.122 INFO:tasks.ceph:pgid 68.1c last_scrub_stamp 2024-09-12T17:46:56.058809+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:29.122 INFO:tasks.ceph:pgid 66.1a last_scrub_stamp 2024-09-12T17:30:11.622113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:29.122 INFO:tasks.ceph:pgid 65.19 last_scrub_stamp 2024-09-12T17:26:34.641203+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=26, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:29.122 INFO:tasks.ceph:pgid 68.1d last_scrub_stamp 2024-09-12T17:46:56.058809+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:29.123 INFO:tasks.ceph:pgid 67.1a last_scrub_stamp 2024-09-12T17:30:15.649995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:29.123 INFO:tasks.ceph:pgid 66.1b last_scrub_stamp 2024-09-12T17:30:11.622113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:29.123 INFO:tasks.ceph:pgid 68.12 last_scrub_stamp 2024-09-12T17:46:56.058809+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:29.123 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-09-12T17:30:15.649995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:29.123 INFO:tasks.ceph:pgid 66.14 last_scrub_stamp 2024-09-12T17:30:11.622113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:29.123 INFO:tasks.ceph:pgid 65.17 last_scrub_stamp 2024-09-12T17:26:34.641203+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=26, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:29.123 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-09-12T17:30:15.649995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:29.123 INFO:tasks.ceph:pgid 66.15 last_scrub_stamp 2024-09-12T17:30:11.622113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:29.123 INFO:tasks.ceph:pgid 65.16 last_scrub_stamp 2024-09-12T17:26:34.641203+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=26, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:29.124 INFO:tasks.ceph:pgid 68.10 last_scrub_stamp 2024-09-12T17:46:56.058809+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:29.124 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-09-12T17:30:15.649995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:29.124 INFO:tasks.ceph:pgid 68.11 last_scrub_stamp 2024-09-12T17:46:56.058809+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:29.124 INFO:tasks.ceph:pgid 67.16 last_scrub_stamp 2024-09-12T17:30:15.649995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:29.124 INFO:tasks.ceph:pgid 66.17 last_scrub_stamp 2024-09-12T17:30:11.622113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:29.124 INFO:tasks.ceph:pgid 65.14 last_scrub_stamp 2024-09-12T17:26:34.641203+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=26, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:29.124 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-09-12T17:46:56.058809+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:29.125 INFO:tasks.ceph:pgid 67.11 last_scrub_stamp 2024-09-12T17:30:15.649995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:29.125 INFO:tasks.ceph:pgid 68.17 last_scrub_stamp 2024-09-12T17:46:56.058809+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:29.125 INFO:tasks.ceph:pgid 66.11 last_scrub_stamp 2024-09-12T17:30:11.622113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:29.125 INFO:tasks.ceph:pgid 65.12 last_scrub_stamp 2024-09-12T17:26:34.641203+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=26, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:29.125 INFO:tasks.ceph:pgid 68.14 last_scrub_stamp 2024-09-12T17:46:56.058809+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:29.125 INFO:tasks.ceph:pgid 67.13 last_scrub_stamp 2024-09-12T17:30:15.649995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:29.125 INFO:tasks.ceph:pgid 65.11 last_scrub_stamp 2024-09-12T17:26:34.641203+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=26, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:29.128 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-09-12T17:46:56.058809+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:29.129 INFO:tasks.ceph:pgid 66.13 last_scrub_stamp 2024-09-12T17:30:11.622113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:29.129 INFO:tasks.ceph:pgid 65.10 last_scrub_stamp 2024-09-12T17:26:34.641203+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=26, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:29.129 INFO:tasks.ceph:pgid 67.d last_scrub_stamp 2024-09-12T17:30:15.649995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:29.129 INFO:tasks.ceph:pgid 66.c last_scrub_stamp 2024-09-12T17:30:11.622113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:29.129 INFO:tasks.ceph:pgid 65.f last_scrub_stamp 2024-09-12T17:26:34.641203+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=26, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:29.129 INFO:tasks.ceph:pgid 68.b last_scrub_stamp 2024-09-12T17:46:56.058809+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:29.129 INFO:tasks.ceph:pgid 67.c last_scrub_stamp 2024-09-12T17:30:15.649995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:29.130 INFO:tasks.ceph:pgid 65.e last_scrub_stamp 2024-09-12T17:26:34.641203+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=26, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:29.130 INFO:tasks.ceph:pgid 66.e last_scrub_stamp 2024-09-12T17:30:11.622113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:29.130 INFO:tasks.ceph:pgid 68.9 last_scrub_stamp 2024-09-12T17:46:56.058809+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:29.130 INFO:tasks.ceph:pgid 67.e last_scrub_stamp 2024-09-12T17:30:15.649995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:29.130 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-09-12T17:46:56.058809+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:29.130 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-09-12T17:30:15.649995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:29.130 INFO:tasks.ceph:pgid 66.8 last_scrub_stamp 2024-09-12T17:30:11.622113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:29.130 INFO:tasks.ceph:pgid 68.f last_scrub_stamp 2024-09-12T17:46:56.058809+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:29.131 INFO:tasks.ceph:pgid 67.8 last_scrub_stamp 2024-09-12T17:30:15.649995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:29.131 INFO:tasks.ceph:pgid 68.c last_scrub_stamp 2024-09-12T17:46:56.058809+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:29.131 INFO:tasks.ceph:pgid 66.a last_scrub_stamp 2024-09-12T17:30:11.622113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:29.131 INFO:tasks.ceph:pgid 65.9 last_scrub_stamp 2024-09-12T17:26:34.641203+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=26, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:29.131 INFO:tasks.ceph:pgid 68.d last_scrub_stamp 2024-09-12T17:46:56.058809+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:29.131 INFO:tasks.ceph:pgid 67.a last_scrub_stamp 2024-09-12T17:30:15.649995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:29.131 INFO:tasks.ceph:pgid 68.2 last_scrub_stamp 2024-09-12T17:46:56.058809+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:29.131 INFO:tasks.ceph:pgid 67.5 last_scrub_stamp 2024-09-12T17:30:15.649995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:29.132 INFO:tasks.ceph:pgid 66.4 last_scrub_stamp 2024-09-12T17:30:11.622113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:29.132 INFO:tasks.ceph:pgid 65.7 last_scrub_stamp 2024-09-12T17:26:34.641203+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=26, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:29.132 INFO:tasks.ceph:pgid 68.3 last_scrub_stamp 2024-09-12T17:46:56.058809+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:29.132 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-09-12T17:30:15.649995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:29.132 INFO:tasks.ceph:pgid 68.0 last_scrub_stamp 2024-09-12T17:46:56.058809+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:29.132 INFO:tasks.ceph:pgid 67.7 last_scrub_stamp 2024-09-12T17:30:15.649995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:29.132 INFO:tasks.ceph:pgid 66.6 last_scrub_stamp 2024-09-12T17:30:11.622113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:29.132 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-09-12T17:46:56.058809+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:29.132 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-09-12T17:30:15.649995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:29.133 INFO:tasks.ceph:pgid 66.7 last_scrub_stamp 2024-09-12T17:30:11.622113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:29.133 INFO:tasks.ceph:pgid 66.0 last_scrub_stamp 2024-09-12T17:30:11.622113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:29.133 INFO:tasks.ceph:pgid 68.7 last_scrub_stamp 2024-09-12T17:46:56.058809+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:29.133 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-09-12T17:30:15.649995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:29.133 INFO:tasks.ceph:pgid 66.1 last_scrub_stamp 2024-09-12T17:30:11.622113+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:29.133 INFO:tasks.ceph:pgid 68.4 last_scrub_stamp 2024-09-12T17:46:56.058809+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:29.133 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-09-12T17:46:56.058809+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:29.133 INFO:tasks.ceph:pgid 67.2 last_scrub_stamp 2024-09-12T17:30:15.649995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=15, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:29.135 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-12T17:10:51.549038+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:29.136 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-12T17:10:51.549038+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:29.136 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-12T17:10:51.549038+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:29.137 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-12T17:10:51.549038+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:29.137 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-12T17:10:51.549038+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:29.137 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T18:12:49.138 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T18:12:49.492 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T18:12:49.504 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-09-12T18:12:49.507 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":2128,"stamp":"2024-09-12T18:12:48.639079+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":75296923,"num_objects":706,"num_object_clones":0,"num_object_copies":1872,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":706,"num_whiteouts":0,"num_read":279908,"num_read_kb":2634724,"num_write":143466,"num_write_kb":2346447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":212,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":730239,"num_omap_keys":1787,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13219,"ondisk_log_size":13219,"up":914,"acting":914,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":914,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1549000,"kb_used_data":133448,"kb_used_omap":12,"kb_used_meta":1415411,"kb_avail":753425720,"statfs":{"total":773094113280,"available":771507937280,"internally_reserved":0,"allocated":136650752,"data_stored":120913686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":1449381425},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":376,"num_omap_keys":4,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005844"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":31,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:33.396504+0000","last_change":"2024-09-12T18:12:33.396504+0000","last_active":"2024-09-12T18:12:33.396504+0000","last_peered":"2024-09-12T18:12:33.396504+0000","last_clean":"2024-09-12T18:12:33.396504+0000","last_became_active":"2024-09-12T17:46:57.082400+0000","last_became_peered":"2024-09-12T17:46:57.082400+0000","last_unstale":"2024-09-12T18:12:33.396504+0000","last_undegraded":"2024-09-12T18:12:33.396504+0000","last_fullsized":"2024-09-12T18:12:33.396504+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:33.396413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:33.396413+0000","last_clean_scrub_stamp":"2024-09-12T18:12:33.396413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:47:57.073719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"0'0","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:31.350332+0000","last_change":"2024-09-12T18:12:31.350332+0000","last_active":"2024-09-12T18:12:31.350332+0000","last_peered":"2024-09-12T18:12:31.350332+0000","last_clean":"2024-09-12T18:12:31.350332+0000","last_became_active":"2024-09-12T17:30:16.683077+0000","last_became_peered":"2024-09-12T17:30:16.683077+0000","last_unstale":"2024-09-12T18:12:31.350332+0000","last_undegraded":"2024-09-12T18:12:31.350332+0000","last_fullsized":"2024-09-12T18:12:31.350332+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:31.350235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:31.350235+0000","last_clean_scrub_stamp":"2024-09-12T18:12:31.350235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:59:20.856550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"260'3","reported_seq":60,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:36.684373+0000","last_change":"2024-09-12T18:12:36.684310+0000","last_active":"2024-09-12T18:12:36.684373+0000","last_peered":"2024-09-12T18:12:36.684373+0000","last_clean":"2024-09-12T18:12:36.684373+0000","last_became_active":"2024-09-12T17:30:12.651461+0000","last_became_peered":"2024-09-12T17:30:12.651461+0000","last_unstale":"2024-09-12T18:12:36.684373+0000","last_undegraded":"2024-09-12T18:12:36.684373+0000","last_fullsized":"2024-09-12T18:12:36.684373+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'3","last_scrub_stamp":"2024-09-12T18:12:36.684216+0000","last_deep_scrub":"260'3","last_deep_scrub_stamp":"2024-09-12T18:12:36.684216+0000","last_clean_scrub_stamp":"2024-09-12T18:12:36.684216+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:00:05.576052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"263'28","reported_seq":143,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:30.682278+0000","last_change":"2024-09-12T18:12:30.682278+0000","last_active":"2024-09-12T18:12:30.682278+0000","last_peered":"2024-09-12T18:12:30.682278+0000","last_clean":"2024-09-12T18:12:30.682278+0000","last_became_active":"2024-09-12T17:26:35.669154+0000","last_became_peered":"2024-09-12T17:26:35.669154+0000","last_unstale":"2024-09-12T18:12:30.682278+0000","last_undegraded":"2024-09-12T18:12:30.682278+0000","last_fullsized":"2024-09-12T18:12:30.682278+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'28","last_scrub_stamp":"2024-09-12T18:12:30.682196+0000","last_deep_scrub":"263'28","last_deep_scrub_stamp":"2024-09-12T18:12:30.682196+0000","last_clean_scrub_stamp":"2024-09-12T18:12:30.682196+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:03:35.934621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":150,"num_read_kb":108,"num_write":46,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":31,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:16.733731+0000","last_change":"2024-09-12T18:12:16.733731+0000","last_active":"2024-09-12T18:12:16.733731+0000","last_peered":"2024-09-12T18:12:16.733731+0000","last_clean":"2024-09-12T18:12:16.733731+0000","last_became_active":"2024-09-12T17:46:57.096462+0000","last_became_peered":"2024-09-12T17:46:57.096462+0000","last_unstale":"2024-09-12T18:12:16.733731+0000","last_undegraded":"2024-09-12T18:12:16.733731+0000","last_fullsized":"2024-09-12T18:12:16.733731+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:16.733634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:16.733634+0000","last_clean_scrub_stamp":"2024-09-12T18:12:16.733634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:55.337675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"263'9","reported_seq":70,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:32.312743+0000","last_change":"2024-09-12T18:12:32.312743+0000","last_active":"2024-09-12T18:12:32.312743+0000","last_peered":"2024-09-12T18:12:32.312743+0000","last_clean":"2024-09-12T18:12:32.312743+0000","last_became_active":"2024-09-12T17:30:16.674952+0000","last_became_peered":"2024-09-12T17:30:16.674952+0000","last_unstale":"2024-09-12T18:12:32.312743+0000","last_undegraded":"2024-09-12T18:12:32.312743+0000","last_fullsized":"2024-09-12T18:12:32.312743+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'9","last_scrub_stamp":"2024-09-12T18:12:32.312652+0000","last_deep_scrub":"263'9","last_deep_scrub_stamp":"2024-09-12T18:12:32.312652+0000","last_clean_scrub_stamp":"2024-09-12T18:12:32.312652+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:52:07.518326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":30722,"num_write":9,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"263'3","reported_seq":61,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:19.465952+0000","last_change":"2024-09-12T18:12:19.465891+0000","last_active":"2024-09-12T18:12:19.465952+0000","last_peered":"2024-09-12T18:12:19.465952+0000","last_clean":"2024-09-12T18:12:19.465952+0000","last_became_active":"2024-09-12T17:30:12.645624+0000","last_became_peered":"2024-09-12T17:30:12.645624+0000","last_unstale":"2024-09-12T18:12:19.465952+0000","last_undegraded":"2024-09-12T18:12:19.465952+0000","last_fullsized":"2024-09-12T18:12:19.465952+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'3","last_scrub_stamp":"2024-09-12T18:12:19.465801+0000","last_deep_scrub":"263'3","last_deep_scrub_stamp":"2024-09-12T18:12:19.465801+0000","last_clean_scrub_stamp":"2024-09-12T18:12:19.465801+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:57:25.728318+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"263'13","reported_seq":97,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:07.786167+0000","last_change":"2024-09-12T18:12:07.786114+0000","last_active":"2024-09-12T18:12:07.786167+0000","last_peered":"2024-09-12T18:12:07.786167+0000","last_clean":"2024-09-12T18:12:07.786167+0000","last_became_active":"2024-09-12T17:26:35.660132+0000","last_became_peered":"2024-09-12T17:26:35.660132+0000","last_unstale":"2024-09-12T18:12:07.786167+0000","last_undegraded":"2024-09-12T18:12:07.786167+0000","last_fullsized":"2024-09-12T18:12:07.786167+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'13","last_scrub_stamp":"2024-09-12T18:12:07.786029+0000","last_deep_scrub":"263'13","last_deep_scrub_stamp":"2024-09-12T18:12:07.786029+0000","last_clean_scrub_stamp":"2024-09-12T18:12:07.786029+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:31:53.611285+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":36,"num_write":29,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":31,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:23.597314+0000","last_change":"2024-09-12T18:12:23.597314+0000","last_active":"2024-09-12T18:12:23.597314+0000","last_peered":"2024-09-12T18:12:23.597314+0000","last_clean":"2024-09-12T18:12:23.597314+0000","last_became_active":"2024-09-12T17:46:57.076193+0000","last_became_peered":"2024-09-12T17:46:57.076193+0000","last_unstale":"2024-09-12T18:12:23.597314+0000","last_undegraded":"2024-09-12T18:12:23.597314+0000","last_fullsized":"2024-09-12T18:12:23.597314+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:23.597226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:23.597226+0000","last_clean_scrub_stamp":"2024-09-12T18:12:23.597226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:37:52.469297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"260'3","reported_seq":57,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:39.849040+0000","last_change":"2024-09-12T18:12:39.849040+0000","last_active":"2024-09-12T18:12:39.849040+0000","last_peered":"2024-09-12T18:12:39.849040+0000","last_clean":"2024-09-12T18:12:39.849040+0000","last_became_active":"2024-09-12T17:30:16.670862+0000","last_became_peered":"2024-09-12T17:30:16.670862+0000","last_unstale":"2024-09-12T18:12:39.849040+0000","last_undegraded":"2024-09-12T18:12:39.849040+0000","last_fullsized":"2024-09-12T18:12:39.849040+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'3","last_scrub_stamp":"2024-09-12T18:12:39.848950+0000","last_deep_scrub":"260'3","last_deep_scrub_stamp":"2024-09-12T18:12:39.848950+0000","last_clean_scrub_stamp":"2024-09-12T18:12:39.848950+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:04:45.100130+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"263'5","reported_seq":70,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:12.711425+0000","last_change":"2024-09-12T18:12:12.711357+0000","last_active":"2024-09-12T18:12:12.711425+0000","last_peered":"2024-09-12T18:12:12.711425+0000","last_clean":"2024-09-12T18:12:12.711425+0000","last_became_active":"2024-09-12T17:30:12.648349+0000","last_became_peered":"2024-09-12T17:30:12.648349+0000","last_unstale":"2024-09-12T18:12:12.711425+0000","last_undegraded":"2024-09-12T18:12:12.711425+0000","last_fullsized":"2024-09-12T18:12:12.711425+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'5","last_scrub_stamp":"2024-09-12T18:12:12.711275+0000","last_deep_scrub":"263'5","last_deep_scrub_stamp":"2024-09-12T18:12:12.711275+0000","last_clean_scrub_stamp":"2024-09-12T18:12:12.711275+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:53:45.650869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":18432,"num_write":10,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"263'118","reported_seq":431,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:29.723514+0000","last_change":"2024-09-12T18:12:29.723514+0000","last_active":"2024-09-12T18:12:29.723514+0000","last_peered":"2024-09-12T18:12:29.723514+0000","last_clean":"2024-09-12T18:12:29.723514+0000","last_became_active":"2024-09-12T17:26:35.664247+0000","last_became_peered":"2024-09-12T17:26:35.664247+0000","last_unstale":"2024-09-12T18:12:29.723514+0000","last_undegraded":"2024-09-12T18:12:29.723514+0000","last_fullsized":"2024-09-12T18:12:29.723514+0000","mapping_epoch":250,"log_start":"263'100","ondisk_log_start":"263'100","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'118","last_scrub_stamp":"2024-09-12T18:12:29.723421+0000","last_deep_scrub":"263'118","last_deep_scrub_stamp":"2024-09-12T18:12:29.723421+0000","last_clean_scrub_stamp":"2024-09-12T18:12:29.723421+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:06:59.267365+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":722,"num_read_kb":504,"num_write":158,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3262,"num_omap_keys":7,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:49.849229+0000","last_change":"2024-09-12T17:46:57.089742+0000","last_active":"2024-09-12T18:08:49.849229+0000","last_peered":"2024-09-12T18:08:49.849229+0000","last_clean":"2024-09-12T18:08:49.849229+0000","last_became_active":"2024-09-12T17:46:57.089385+0000","last_became_peered":"2024-09-12T17:46:57.089385+0000","last_unstale":"2024-09-12T18:08:49.849229+0000","last_undegraded":"2024-09-12T18:08:49.849229+0000","last_fullsized":"2024-09-12T18:08:49.849229+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:17:02.129348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"263'14","reported_seq":80,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:44.647548+0000","last_change":"2024-09-12T18:12:44.647548+0000","last_active":"2024-09-12T18:12:44.647548+0000","last_peered":"2024-09-12T18:12:44.647548+0000","last_clean":"2024-09-12T18:12:44.647548+0000","last_became_active":"2024-09-12T17:30:16.681766+0000","last_became_peered":"2024-09-12T17:30:16.681766+0000","last_unstale":"2024-09-12T18:12:44.647548+0000","last_undegraded":"2024-09-12T18:12:44.647548+0000","last_fullsized":"2024-09-12T18:12:44.647548+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'14","last_scrub_stamp":"2024-09-12T18:12:44.647461+0000","last_deep_scrub":"263'14","last_deep_scrub_stamp":"2024-09-12T18:12:44.647461+0000","last_clean_scrub_stamp":"2024-09-12T18:12:44.647461+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:55:58.576253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":32770,"num_write":24,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"0'0","reported_seq":57,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:27.358127+0000","last_change":"2024-09-12T18:12:27.358127+0000","last_active":"2024-09-12T18:12:27.358127+0000","last_peered":"2024-09-12T18:12:27.358127+0000","last_clean":"2024-09-12T18:12:27.358127+0000","last_became_active":"2024-09-12T17:30:12.648369+0000","last_became_peered":"2024-09-12T17:30:12.648369+0000","last_unstale":"2024-09-12T18:12:27.358127+0000","last_undegraded":"2024-09-12T18:12:27.358127+0000","last_fullsized":"2024-09-12T18:12:27.358127+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:27.357978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:27.357978+0000","last_clean_scrub_stamp":"2024-09-12T18:12:27.357978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:04:22.390356+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"263'111","reported_seq":448,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:34.721432+0000","last_change":"2024-09-12T18:12:34.721432+0000","last_active":"2024-09-12T18:12:34.721432+0000","last_peered":"2024-09-12T18:12:34.721432+0000","last_clean":"2024-09-12T18:12:34.721432+0000","last_became_active":"2024-09-12T17:26:35.665735+0000","last_became_peered":"2024-09-12T17:26:35.665735+0000","last_unstale":"2024-09-12T18:12:34.721432+0000","last_undegraded":"2024-09-12T18:12:34.721432+0000","last_fullsized":"2024-09-12T18:12:34.721432+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'111","last_scrub_stamp":"2024-09-12T18:12:34.721340+0000","last_deep_scrub":"263'111","last_deep_scrub_stamp":"2024-09-12T18:12:34.721340+0000","last_clean_scrub_stamp":"2024-09-12T18:12:34.721340+0000","objects_scrubbed":1,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:47:38.687925+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":761,"num_read_kb":507,"num_write":140,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3500,"num_omap_keys":7,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:04.851052+0000","last_change":"2024-09-12T17:46:57.090107+0000","last_active":"2024-09-12T18:09:04.851052+0000","last_peered":"2024-09-12T18:09:04.851052+0000","last_clean":"2024-09-12T18:09:04.851052+0000","last_became_active":"2024-09-12T17:46:57.089797+0000","last_became_peered":"2024-09-12T17:46:57.089797+0000","last_unstale":"2024-09-12T18:09:04.851052+0000","last_undegraded":"2024-09-12T18:09:04.851052+0000","last_fullsized":"2024-09-12T18:09:04.851052+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:57:58.129729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"263'5","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:30.376007+0000","last_change":"2024-09-12T18:12:30.376007+0000","last_active":"2024-09-12T18:12:30.376007+0000","last_peered":"2024-09-12T18:12:30.376007+0000","last_clean":"2024-09-12T18:12:30.376007+0000","last_became_active":"2024-09-12T17:30:16.685755+0000","last_became_peered":"2024-09-12T17:30:16.685755+0000","last_unstale":"2024-09-12T18:12:30.376007+0000","last_undegraded":"2024-09-12T18:12:30.376007+0000","last_fullsized":"2024-09-12T18:12:30.376007+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'5","last_scrub_stamp":"2024-09-12T18:12:30.375919+0000","last_deep_scrub":"263'5","last_deep_scrub_stamp":"2024-09-12T18:12:30.375919+0000","last_clean_scrub_stamp":"2024-09-12T18:12:30.375919+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:59:28.231926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":16,"num_write":10,"num_write_kb":5136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"0'0","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:35.790038+0000","last_change":"2024-09-12T18:12:35.790038+0000","last_active":"2024-09-12T18:12:35.790038+0000","last_peered":"2024-09-12T18:12:35.790038+0000","last_clean":"2024-09-12T18:12:35.790038+0000","last_became_active":"2024-09-12T17:30:12.640983+0000","last_became_peered":"2024-09-12T17:30:12.640983+0000","last_unstale":"2024-09-12T18:12:35.790038+0000","last_undegraded":"2024-09-12T18:12:35.790038+0000","last_fullsized":"2024-09-12T18:12:35.790038+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:35.789941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:35.789941+0000","last_clean_scrub_stamp":"2024-09-12T18:12:35.789941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:40:19.983097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"263'13","reported_seq":100,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:33.747457+0000","last_change":"2024-09-12T18:12:33.747457+0000","last_active":"2024-09-12T18:12:33.747457+0000","last_peered":"2024-09-12T18:12:33.747457+0000","last_clean":"2024-09-12T18:12:33.747457+0000","last_became_active":"2024-09-12T17:26:35.664517+0000","last_became_peered":"2024-09-12T17:26:35.664517+0000","last_unstale":"2024-09-12T18:12:33.747457+0000","last_undegraded":"2024-09-12T18:12:33.747457+0000","last_fullsized":"2024-09-12T18:12:33.747457+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'13","last_scrub_stamp":"2024-09-12T18:12:33.747367+0000","last_deep_scrub":"263'13","last_deep_scrub_stamp":"2024-09-12T18:12:33.747367+0000","last_clean_scrub_stamp":"2024-09-12T18:12:33.747367+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:50:16.447468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":54,"num_write":23,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":33,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:28.487165+0000","last_change":"2024-09-12T18:12:28.487165+0000","last_active":"2024-09-12T18:12:28.487165+0000","last_peered":"2024-09-12T18:12:28.487165+0000","last_clean":"2024-09-12T18:12:28.487165+0000","last_became_active":"2024-09-12T17:46:57.091147+0000","last_became_peered":"2024-09-12T17:46:57.091147+0000","last_unstale":"2024-09-12T18:12:28.487165+0000","last_undegraded":"2024-09-12T18:12:28.487165+0000","last_fullsized":"2024-09-12T18:12:28.487165+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:28.487075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:28.487075+0000","last_clean_scrub_stamp":"2024-09-12T18:12:28.487075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:58:14.311885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"260'5","reported_seq":59,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:20.578358+0000","last_change":"2024-09-12T18:12:20.578358+0000","last_active":"2024-09-12T18:12:20.578358+0000","last_peered":"2024-09-12T18:12:20.578358+0000","last_clean":"2024-09-12T18:12:20.578358+0000","last_became_active":"2024-09-12T17:30:16.684200+0000","last_became_peered":"2024-09-12T17:30:16.684200+0000","last_unstale":"2024-09-12T18:12:20.578358+0000","last_undegraded":"2024-09-12T18:12:20.578358+0000","last_fullsized":"2024-09-12T18:12:20.578358+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'5","last_scrub_stamp":"2024-09-12T18:12:20.578267+0000","last_deep_scrub":"260'5","last_deep_scrub_stamp":"2024-09-12T18:12:20.578267+0000","last_clean_scrub_stamp":"2024-09-12T18:12:20.578267+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:25:55.109570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"263'2","reported_seq":57,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:26.378959+0000","last_change":"2024-09-12T18:12:26.378959+0000","last_active":"2024-09-12T18:12:26.378959+0000","last_peered":"2024-09-12T18:12:26.378959+0000","last_clean":"2024-09-12T18:12:26.378959+0000","last_became_active":"2024-09-12T17:30:12.639953+0000","last_became_peered":"2024-09-12T17:30:12.639953+0000","last_unstale":"2024-09-12T18:12:26.378959+0000","last_undegraded":"2024-09-12T18:12:26.378959+0000","last_fullsized":"2024-09-12T18:12:26.378959+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T18:12:26.378865+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T18:12:26.378865+0000","last_clean_scrub_stamp":"2024-09-12T18:12:26.378865+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:24:59.856238+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"263'28","reported_seq":133,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:15.595792+0000","last_change":"2024-09-12T18:12:15.595792+0000","last_active":"2024-09-12T18:12:15.595792+0000","last_peered":"2024-09-12T18:12:15.595792+0000","last_clean":"2024-09-12T18:12:15.595792+0000","last_became_active":"2024-09-12T17:26:35.663339+0000","last_became_peered":"2024-09-12T17:26:35.663339+0000","last_unstale":"2024-09-12T18:12:15.595792+0000","last_undegraded":"2024-09-12T18:12:15.595792+0000","last_fullsized":"2024-09-12T18:12:15.595792+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'28","last_scrub_stamp":"2024-09-12T18:12:15.595694+0000","last_deep_scrub":"263'28","last_deep_scrub_stamp":"2024-09-12T18:12:15.595694+0000","last_clean_scrub_stamp":"2024-09-12T18:12:15.595694+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:07:07.625379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":134,"num_read_kb":91,"num_write":60,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"263'2","reported_seq":33,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:42.489853+0000","last_change":"2024-09-12T18:12:42.489853+0000","last_active":"2024-09-12T18:12:42.489853+0000","last_peered":"2024-09-12T18:12:42.489853+0000","last_clean":"2024-09-12T18:12:42.489853+0000","last_became_active":"2024-09-12T17:46:57.088039+0000","last_became_peered":"2024-09-12T17:46:57.088039+0000","last_unstale":"2024-09-12T18:12:42.489853+0000","last_undegraded":"2024-09-12T18:12:42.489853+0000","last_fullsized":"2024-09-12T18:12:42.489853+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T18:12:42.489719+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T18:12:42.489719+0000","last_clean_scrub_stamp":"2024-09-12T18:12:42.489719+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:52:10.651915+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"263'9","reported_seq":64,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:21.621741+0000","last_change":"2024-09-12T18:12:21.621741+0000","last_active":"2024-09-12T18:12:21.621741+0000","last_peered":"2024-09-12T18:12:21.621741+0000","last_clean":"2024-09-12T18:12:21.621741+0000","last_became_active":"2024-09-12T17:30:16.672167+0000","last_became_peered":"2024-09-12T17:30:16.672167+0000","last_unstale":"2024-09-12T18:12:21.621741+0000","last_undegraded":"2024-09-12T18:12:21.621741+0000","last_fullsized":"2024-09-12T18:12:21.621741+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'9","last_scrub_stamp":"2024-09-12T18:12:21.621640+0000","last_deep_scrub":"263'9","last_deep_scrub_stamp":"2024-09-12T18:12:21.621640+0000","last_clean_scrub_stamp":"2024-09-12T18:12:21.621640+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:29:04.525875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":17408,"num_write":19,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"260'5","reported_seq":65,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:28.377547+0000","last_change":"2024-09-12T18:12:28.377484+0000","last_active":"2024-09-12T18:12:28.377547+0000","last_peered":"2024-09-12T18:12:28.377547+0000","last_clean":"2024-09-12T18:12:28.377547+0000","last_became_active":"2024-09-12T17:30:12.644125+0000","last_became_peered":"2024-09-12T17:30:12.644125+0000","last_unstale":"2024-09-12T18:12:28.377547+0000","last_undegraded":"2024-09-12T18:12:28.377547+0000","last_fullsized":"2024-09-12T18:12:28.377547+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'5","last_scrub_stamp":"2024-09-12T18:12:28.377393+0000","last_deep_scrub":"260'5","last_deep_scrub_stamp":"2024-09-12T18:12:28.377393+0000","last_clean_scrub_stamp":"2024-09-12T18:12:28.377393+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:54:05.770360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"263'38","reported_seq":167,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:28.743899+0000","last_change":"2024-09-12T18:12:28.743793+0000","last_active":"2024-09-12T18:12:28.743899+0000","last_peered":"2024-09-12T18:12:28.743899+0000","last_clean":"2024-09-12T18:12:28.743899+0000","last_became_active":"2024-09-12T17:26:35.659261+0000","last_became_peered":"2024-09-12T17:26:35.659261+0000","last_unstale":"2024-09-12T18:12:28.743899+0000","last_undegraded":"2024-09-12T18:12:28.743899+0000","last_fullsized":"2024-09-12T18:12:28.743899+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'38","last_scrub_stamp":"2024-09-12T18:12:28.743653+0000","last_deep_scrub":"263'38","last_deep_scrub_stamp":"2024-09-12T18:12:28.743653+0000","last_clean_scrub_stamp":"2024-09-12T18:12:28.743653+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:52:26.238294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":196,"num_read_kb":138,"num_write":78,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":31,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:44.556742+0000","last_change":"2024-09-12T18:12:44.556742+0000","last_active":"2024-09-12T18:12:44.556742+0000","last_peered":"2024-09-12T18:12:44.556742+0000","last_clean":"2024-09-12T18:12:44.556742+0000","last_became_active":"2024-09-12T17:46:57.087965+0000","last_became_peered":"2024-09-12T17:46:57.087965+0000","last_unstale":"2024-09-12T18:12:44.556742+0000","last_undegraded":"2024-09-12T18:12:44.556742+0000","last_fullsized":"2024-09-12T18:12:44.556742+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:44.556650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:44.556650+0000","last_clean_scrub_stamp":"2024-09-12T18:12:44.556650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:11:00.591111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"263'8","reported_seq":69,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:43.668079+0000","last_change":"2024-09-12T18:12:43.668079+0000","last_active":"2024-09-12T18:12:43.668079+0000","last_peered":"2024-09-12T18:12:43.668079+0000","last_clean":"2024-09-12T18:12:43.668079+0000","last_became_active":"2024-09-12T17:30:16.685054+0000","last_became_peered":"2024-09-12T17:30:16.685054+0000","last_unstale":"2024-09-12T18:12:43.668079+0000","last_undegraded":"2024-09-12T18:12:43.668079+0000","last_fullsized":"2024-09-12T18:12:43.668079+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'8","last_scrub_stamp":"2024-09-12T18:12:43.667978+0000","last_deep_scrub":"263'8","last_deep_scrub_stamp":"2024-09-12T18:12:43.667978+0000","last_clean_scrub_stamp":"2024-09-12T18:12:43.667978+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:36:05.401045+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":30722,"num_write":13,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"263'8","reported_seq":74,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:36.817015+0000","last_change":"2024-09-12T18:12:36.816959+0000","last_active":"2024-09-12T18:12:36.817015+0000","last_peered":"2024-09-12T18:12:36.817015+0000","last_clean":"2024-09-12T18:12:36.817015+0000","last_became_active":"2024-09-12T17:30:12.651780+0000","last_became_peered":"2024-09-12T17:30:12.651780+0000","last_unstale":"2024-09-12T18:12:36.817015+0000","last_undegraded":"2024-09-12T18:12:36.817015+0000","last_fullsized":"2024-09-12T18:12:36.817015+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'8","last_scrub_stamp":"2024-09-12T18:12:36.816868+0000","last_deep_scrub":"263'8","last_deep_scrub_stamp":"2024-09-12T18:12:36.816868+0000","last_clean_scrub_stamp":"2024-09-12T18:12:36.816868+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:38:17.392496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":22530,"num_write":13,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"263'27","reported_seq":137,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:16.515061+0000","last_change":"2024-09-12T18:12:16.514946+0000","last_active":"2024-09-12T18:12:16.515061+0000","last_peered":"2024-09-12T18:12:16.515061+0000","last_clean":"2024-09-12T18:12:16.515061+0000","last_became_active":"2024-09-12T17:26:35.665076+0000","last_became_peered":"2024-09-12T17:26:35.665076+0000","last_unstale":"2024-09-12T18:12:16.515061+0000","last_undegraded":"2024-09-12T18:12:16.515061+0000","last_fullsized":"2024-09-12T18:12:16.515061+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'27","last_scrub_stamp":"2024-09-12T18:12:16.514848+0000","last_deep_scrub":"263'27","last_deep_scrub_stamp":"2024-09-12T18:12:16.514848+0000","last_clean_scrub_stamp":"2024-09-12T18:12:16.514848+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:14:35.753947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":146,"num_read_kb":106,"num_write":38,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":32,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:27.501214+0000","last_change":"2024-09-12T18:12:27.501138+0000","last_active":"2024-09-12T18:12:27.501214+0000","last_peered":"2024-09-12T18:12:27.501214+0000","last_clean":"2024-09-12T18:12:27.501214+0000","last_became_active":"2024-09-12T17:46:57.077265+0000","last_became_peered":"2024-09-12T17:46:57.077265+0000","last_unstale":"2024-09-12T18:12:27.501214+0000","last_undegraded":"2024-09-12T18:12:27.501214+0000","last_fullsized":"2024-09-12T18:12:27.501214+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:27.501042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:27.501042+0000","last_clean_scrub_stamp":"2024-09-12T18:12:27.501042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:40:38.711253+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"0'0","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:41.638491+0000","last_change":"2024-09-12T18:12:41.638491+0000","last_active":"2024-09-12T18:12:41.638491+0000","last_peered":"2024-09-12T18:12:41.638491+0000","last_clean":"2024-09-12T18:12:41.638491+0000","last_became_active":"2024-09-12T17:30:16.683963+0000","last_became_peered":"2024-09-12T17:30:16.683963+0000","last_unstale":"2024-09-12T18:12:41.638491+0000","last_undegraded":"2024-09-12T18:12:41.638491+0000","last_fullsized":"2024-09-12T18:12:41.638491+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:41.638387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:41.638387+0000","last_clean_scrub_stamp":"2024-09-12T18:12:41.638387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:37:07.401689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"263'8","reported_seq":75,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:28.458329+0000","last_change":"2024-09-12T18:12:28.458273+0000","last_active":"2024-09-12T18:12:28.458329+0000","last_peered":"2024-09-12T18:12:28.458329+0000","last_clean":"2024-09-12T18:12:28.458329+0000","last_became_active":"2024-09-12T17:30:12.642687+0000","last_became_peered":"2024-09-12T17:30:12.642687+0000","last_unstale":"2024-09-12T18:12:28.458329+0000","last_undegraded":"2024-09-12T18:12:28.458329+0000","last_fullsized":"2024-09-12T18:12:28.458329+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'8","last_scrub_stamp":"2024-09-12T18:12:28.458184+0000","last_deep_scrub":"263'8","last_deep_scrub_stamp":"2024-09-12T18:12:28.458184+0000","last_clean_scrub_stamp":"2024-09-12T18:12:28.458184+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:11:54.846474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":26626,"num_write":13,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"263'39","reported_seq":169,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:27.715452+0000","last_change":"2024-09-12T18:12:27.715382+0000","last_active":"2024-09-12T18:12:27.715452+0000","last_peered":"2024-09-12T18:12:27.715452+0000","last_clean":"2024-09-12T18:12:27.715452+0000","last_became_active":"2024-09-12T17:26:35.668286+0000","last_became_peered":"2024-09-12T17:26:35.668286+0000","last_unstale":"2024-09-12T18:12:27.715452+0000","last_undegraded":"2024-09-12T18:12:27.715452+0000","last_fullsized":"2024-09-12T18:12:27.715452+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'39","last_scrub_stamp":"2024-09-12T18:12:27.715293+0000","last_deep_scrub":"263'39","last_deep_scrub_stamp":"2024-09-12T18:12:27.715293+0000","last_clean_scrub_stamp":"2024-09-12T18:12:27.715293+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:53:21.522059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":202,"num_read_kb":143,"num_write":74,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"263'2","reported_seq":34,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:14.710186+0000","last_change":"2024-09-12T18:12:14.710122+0000","last_active":"2024-09-12T18:12:14.710186+0000","last_peered":"2024-09-12T18:12:14.710186+0000","last_clean":"2024-09-12T18:12:14.710186+0000","last_became_active":"2024-09-12T17:46:57.088919+0000","last_became_peered":"2024-09-12T17:46:57.088919+0000","last_unstale":"2024-09-12T18:12:14.710186+0000","last_undegraded":"2024-09-12T18:12:14.710186+0000","last_fullsized":"2024-09-12T18:12:14.710186+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T18:12:14.710049+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T18:12:14.710049+0000","last_clean_scrub_stamp":"2024-09-12T18:12:14.710049+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:41:35.181583+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"0'0","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:40.852278+0000","last_change":"2024-09-12T18:12:40.852278+0000","last_active":"2024-09-12T18:12:40.852278+0000","last_peered":"2024-09-12T18:12:40.852278+0000","last_clean":"2024-09-12T18:12:40.852278+0000","last_became_active":"2024-09-12T17:31:18.236640+0000","last_became_peered":"2024-09-12T17:31:18.236640+0000","last_unstale":"2024-09-12T18:12:40.852278+0000","last_undegraded":"2024-09-12T18:12:40.852278+0000","last_fullsized":"2024-09-12T18:12:40.852278+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:40.852191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:40.852191+0000","last_clean_scrub_stamp":"2024-09-12T18:12:40.852191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:36:01.435903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.15","version":"0'0","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:31.556332+0000","last_change":"2024-09-12T18:12:31.556332+0000","last_active":"2024-09-12T18:12:31.556332+0000","last_peered":"2024-09-12T18:12:31.556332+0000","last_clean":"2024-09-12T18:12:31.556332+0000","last_became_active":"2024-09-12T17:30:12.649605+0000","last_became_peered":"2024-09-12T17:30:12.649605+0000","last_unstale":"2024-09-12T18:12:31.556332+0000","last_undegraded":"2024-09-12T18:12:31.556332+0000","last_fullsized":"2024-09-12T18:12:31.556332+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:31.556233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:31.556233+0000","last_clean_scrub_stamp":"2024-09-12T18:12:31.556233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:14:54.561876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"263'53","reported_seq":200,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:32.726697+0000","last_change":"2024-09-12T18:12:32.726697+0000","last_active":"2024-09-12T18:12:32.726697+0000","last_peered":"2024-09-12T18:12:32.726697+0000","last_clean":"2024-09-12T18:12:32.726697+0000","last_became_active":"2024-09-12T17:26:35.658602+0000","last_became_peered":"2024-09-12T17:26:35.658602+0000","last_unstale":"2024-09-12T18:12:32.726697+0000","last_undegraded":"2024-09-12T18:12:32.726697+0000","last_fullsized":"2024-09-12T18:12:32.726697+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'53","last_scrub_stamp":"2024-09-12T18:12:32.726601+0000","last_deep_scrub":"263'53","last_deep_scrub_stamp":"2024-09-12T18:12:32.726601+0000","last_clean_scrub_stamp":"2024-09-12T18:12:32.726601+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:06:45.249100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":262,"num_read_kb":183,"num_write":93,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":32,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:41.506846+0000","last_change":"2024-09-12T18:12:41.506846+0000","last_active":"2024-09-12T18:12:41.506846+0000","last_peered":"2024-09-12T18:12:41.506846+0000","last_clean":"2024-09-12T18:12:41.506846+0000","last_became_active":"2024-09-12T17:46:57.081080+0000","last_became_peered":"2024-09-12T17:46:57.081080+0000","last_unstale":"2024-09-12T18:12:41.506846+0000","last_undegraded":"2024-09-12T18:12:41.506846+0000","last_fullsized":"2024-09-12T18:12:41.506846+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:41.506737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:41.506737+0000","last_clean_scrub_stamp":"2024-09-12T18:12:41.506737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:37:12.456062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"263'3","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:42.673015+0000","last_change":"2024-09-12T18:12:42.673015+0000","last_active":"2024-09-12T18:12:42.673015+0000","last_peered":"2024-09-12T18:12:42.673015+0000","last_clean":"2024-09-12T18:12:42.673015+0000","last_became_active":"2024-09-12T17:30:16.685688+0000","last_became_peered":"2024-09-12T17:30:16.685688+0000","last_unstale":"2024-09-12T18:12:42.673015+0000","last_undegraded":"2024-09-12T18:12:42.673015+0000","last_fullsized":"2024-09-12T18:12:42.673015+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'3","last_scrub_stamp":"2024-09-12T18:12:42.672919+0000","last_deep_scrub":"263'3","last_deep_scrub_stamp":"2024-09-12T18:12:42.672919+0000","last_clean_scrub_stamp":"2024-09-12T18:12:42.672919+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:39:36.235626+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"0'0","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:10.681131+0000","last_change":"2024-09-12T18:12:10.681131+0000","last_active":"2024-09-12T18:12:10.681131+0000","last_peered":"2024-09-12T18:12:10.681131+0000","last_clean":"2024-09-12T18:12:10.681131+0000","last_became_active":"2024-09-12T17:30:12.654327+0000","last_became_peered":"2024-09-12T17:30:12.654327+0000","last_unstale":"2024-09-12T18:12:10.681131+0000","last_undegraded":"2024-09-12T18:12:10.681131+0000","last_fullsized":"2024-09-12T18:12:10.681131+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:10.681027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:10.681027+0000","last_clean_scrub_stamp":"2024-09-12T18:12:10.681027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:06:34.876167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"263'47","reported_seq":194,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:06.753049+0000","last_change":"2024-09-12T18:12:06.752989+0000","last_active":"2024-09-12T18:12:06.753049+0000","last_peered":"2024-09-12T18:12:06.753049+0000","last_clean":"2024-09-12T18:12:06.753049+0000","last_became_active":"2024-09-12T17:26:35.662284+0000","last_became_peered":"2024-09-12T17:26:35.662284+0000","last_unstale":"2024-09-12T18:12:06.753049+0000","last_undegraded":"2024-09-12T18:12:06.753049+0000","last_fullsized":"2024-09-12T18:12:06.753049+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'47","last_scrub_stamp":"2024-09-12T18:12:06.752901+0000","last_deep_scrub":"263'47","last_deep_scrub_stamp":"2024-09-12T18:12:06.752901+0000","last_clean_scrub_stamp":"2024-09-12T18:12:06.752901+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:42:41.000414+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":252,"num_read_kb":176,"num_write":91,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":32,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:34.371336+0000","last_change":"2024-09-12T18:12:34.371273+0000","last_active":"2024-09-12T18:12:34.371336+0000","last_peered":"2024-09-12T18:12:34.371336+0000","last_clean":"2024-09-12T18:12:34.371336+0000","last_became_active":"2024-09-12T17:46:57.082082+0000","last_became_peered":"2024-09-12T17:46:57.082082+0000","last_unstale":"2024-09-12T18:12:34.371336+0000","last_undegraded":"2024-09-12T18:12:34.371336+0000","last_fullsized":"2024-09-12T18:12:34.371336+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:34.371182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:34.371182+0000","last_clean_scrub_stamp":"2024-09-12T18:12:34.371182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:03:38.349938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"260'3","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:31.294397+0000","last_change":"2024-09-12T18:12:31.294397+0000","last_active":"2024-09-12T18:12:31.294397+0000","last_peered":"2024-09-12T18:12:31.294397+0000","last_clean":"2024-09-12T18:12:31.294397+0000","last_became_active":"2024-09-12T17:30:16.675278+0000","last_became_peered":"2024-09-12T17:30:16.675278+0000","last_unstale":"2024-09-12T18:12:31.294397+0000","last_undegraded":"2024-09-12T18:12:31.294397+0000","last_fullsized":"2024-09-12T18:12:31.294397+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'3","last_scrub_stamp":"2024-09-12T18:12:31.294300+0000","last_deep_scrub":"260'3","last_deep_scrub_stamp":"2024-09-12T18:12:31.294300+0000","last_clean_scrub_stamp":"2024-09-12T18:12:31.294300+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:27:39.709354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"260'2","reported_seq":58,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:34.773390+0000","last_change":"2024-09-12T18:12:34.773390+0000","last_active":"2024-09-12T18:12:34.773390+0000","last_peered":"2024-09-12T18:12:34.773390+0000","last_clean":"2024-09-12T18:12:34.773390+0000","last_became_active":"2024-09-12T17:30:12.643203+0000","last_became_peered":"2024-09-12T17:30:12.643203+0000","last_unstale":"2024-09-12T18:12:34.773390+0000","last_undegraded":"2024-09-12T18:12:34.773390+0000","last_fullsized":"2024-09-12T18:12:34.773390+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-09-12T18:12:34.773296+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-09-12T18:12:34.773296+0000","last_clean_scrub_stamp":"2024-09-12T18:12:34.773296+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:04:26.951267+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":23,"num_write":2,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"263'29","reported_seq":133,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:29.526265+0000","last_change":"2024-09-12T18:12:29.526265+0000","last_active":"2024-09-12T18:12:29.526265+0000","last_peered":"2024-09-12T18:12:29.526265+0000","last_clean":"2024-09-12T18:12:29.526265+0000","last_became_active":"2024-09-12T17:26:35.657035+0000","last_became_peered":"2024-09-12T17:26:35.657035+0000","last_unstale":"2024-09-12T18:12:29.526265+0000","last_undegraded":"2024-09-12T18:12:29.526265+0000","last_fullsized":"2024-09-12T18:12:29.526265+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'29","last_scrub_stamp":"2024-09-12T18:12:29.526178+0000","last_deep_scrub":"263'29","last_deep_scrub_stamp":"2024-09-12T18:12:29.526178+0000","last_clean_scrub_stamp":"2024-09-12T18:12:29.526178+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:27:18.798425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":129,"num_read_kb":90,"num_write":56,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:44.848747+0000","last_change":"2024-09-12T17:46:57.094601+0000","last_active":"2024-09-12T18:08:44.848747+0000","last_peered":"2024-09-12T18:08:44.848747+0000","last_clean":"2024-09-12T18:08:44.848747+0000","last_became_active":"2024-09-12T17:46:57.094314+0000","last_became_peered":"2024-09-12T17:46:57.094314+0000","last_unstale":"2024-09-12T18:08:44.848747+0000","last_undegraded":"2024-09-12T18:08:44.848747+0000","last_fullsized":"2024-09-12T18:08:44.848747+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:55:53.289948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:25.546047+0000","last_change":"2024-09-12T18:12:25.546047+0000","last_active":"2024-09-12T18:12:25.546047+0000","last_peered":"2024-09-12T18:12:25.546047+0000","last_clean":"2024-09-12T18:12:25.546047+0000","last_became_active":"2024-09-12T17:30:16.679282+0000","last_became_peered":"2024-09-12T17:30:16.679282+0000","last_unstale":"2024-09-12T18:12:25.546047+0000","last_undegraded":"2024-09-12T18:12:25.546047+0000","last_fullsized":"2024-09-12T18:12:25.546047+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:25.545958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:25.545958+0000","last_clean_scrub_stamp":"2024-09-12T18:12:25.545958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:12:26.317340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"260'6","reported_seq":67,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:24.336704+0000","last_change":"2024-09-12T18:12:24.336704+0000","last_active":"2024-09-12T18:12:24.336704+0000","last_peered":"2024-09-12T18:12:24.336704+0000","last_clean":"2024-09-12T18:12:24.336704+0000","last_became_active":"2024-09-12T17:30:12.652426+0000","last_became_peered":"2024-09-12T17:30:12.652426+0000","last_unstale":"2024-09-12T18:12:24.336704+0000","last_undegraded":"2024-09-12T18:12:24.336704+0000","last_fullsized":"2024-09-12T18:12:24.336704+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'6","last_scrub_stamp":"2024-09-12T18:12:24.336606+0000","last_deep_scrub":"260'6","last_deep_scrub_stamp":"2024-09-12T18:12:24.336606+0000","last_clean_scrub_stamp":"2024-09-12T18:12:24.336606+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:14:36.587843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":10240,"num_write":16,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"263'34","reported_seq":156,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:24.498834+0000","last_change":"2024-09-12T18:12:24.498834+0000","last_active":"2024-09-12T18:12:24.498834+0000","last_peered":"2024-09-12T18:12:24.498834+0000","last_clean":"2024-09-12T18:12:24.498834+0000","last_became_active":"2024-09-12T17:26:35.663337+0000","last_became_peered":"2024-09-12T17:26:35.663337+0000","last_unstale":"2024-09-12T18:12:24.498834+0000","last_undegraded":"2024-09-12T18:12:24.498834+0000","last_fullsized":"2024-09-12T18:12:24.498834+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'34","last_scrub_stamp":"2024-09-12T18:12:24.498734+0000","last_deep_scrub":"263'34","last_deep_scrub_stamp":"2024-09-12T18:12:24.498734+0000","last_clean_scrub_stamp":"2024-09-12T18:12:24.498734+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:16:59.364876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":179,"num_read_kb":128,"num_write":55,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:44.840640+0000","last_change":"2024-09-12T17:46:57.093698+0000","last_active":"2024-09-12T18:08:44.840640+0000","last_peered":"2024-09-12T18:08:44.840640+0000","last_clean":"2024-09-12T18:08:44.840640+0000","last_became_active":"2024-09-12T17:46:57.093157+0000","last_became_peered":"2024-09-12T17:46:57.093157+0000","last_unstale":"2024-09-12T18:08:44.840640+0000","last_undegraded":"2024-09-12T18:08:44.840640+0000","last_fullsized":"2024-09-12T18:08:44.840640+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:44:51.633185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"263'2","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:24.515982+0000","last_change":"2024-09-12T18:12:24.515982+0000","last_active":"2024-09-12T18:12:24.515982+0000","last_peered":"2024-09-12T18:12:24.515982+0000","last_clean":"2024-09-12T18:12:24.515982+0000","last_became_active":"2024-09-12T17:30:16.678682+0000","last_became_peered":"2024-09-12T17:30:16.678682+0000","last_unstale":"2024-09-12T18:12:24.515982+0000","last_undegraded":"2024-09-12T18:12:24.515982+0000","last_fullsized":"2024-09-12T18:12:24.515982+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T18:12:24.515881+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T18:12:24.515881+0000","last_clean_scrub_stamp":"2024-09-12T18:12:24.515881+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:06:29.104906+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"263'6","reported_seq":61,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:35.700045+0000","last_change":"2024-09-12T18:12:35.700045+0000","last_active":"2024-09-12T18:12:35.700045+0000","last_peered":"2024-09-12T18:12:35.700045+0000","last_clean":"2024-09-12T18:12:35.700045+0000","last_became_active":"2024-09-12T17:30:12.652916+0000","last_became_peered":"2024-09-12T17:30:12.652916+0000","last_unstale":"2024-09-12T18:12:35.700045+0000","last_undegraded":"2024-09-12T18:12:35.700045+0000","last_fullsized":"2024-09-12T18:12:35.700045+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'6","last_scrub_stamp":"2024-09-12T18:12:35.699925+0000","last_deep_scrub":"263'6","last_deep_scrub_stamp":"2024-09-12T18:12:35.699925+0000","last_clean_scrub_stamp":"2024-09-12T18:12:35.699925+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:52:51.571101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":16,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"263'35","reported_seq":156,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:25.654543+0000","last_change":"2024-09-12T18:12:25.654543+0000","last_active":"2024-09-12T18:12:25.654543+0000","last_peered":"2024-09-12T18:12:25.654543+0000","last_clean":"2024-09-12T18:12:25.654543+0000","last_became_active":"2024-09-12T17:26:35.669256+0000","last_became_peered":"2024-09-12T17:26:35.669256+0000","last_unstale":"2024-09-12T18:12:25.654543+0000","last_undegraded":"2024-09-12T18:12:25.654543+0000","last_fullsized":"2024-09-12T18:12:25.654543+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'35","last_scrub_stamp":"2024-09-12T18:12:25.654452+0000","last_deep_scrub":"263'35","last_deep_scrub_stamp":"2024-09-12T18:12:25.654452+0000","last_clean_scrub_stamp":"2024-09-12T18:12:25.654452+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:47:17.573085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":173,"num_read_kb":119,"num_write":68,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"262'1","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:04.835994+0000","last_change":"2024-09-12T17:46:57.090884+0000","last_active":"2024-09-12T18:08:04.835994+0000","last_peered":"2024-09-12T18:08:04.835994+0000","last_clean":"2024-09-12T18:08:04.835994+0000","last_became_active":"2024-09-12T17:46:57.090587+0000","last_became_peered":"2024-09-12T17:46:57.090587+0000","last_unstale":"2024-09-12T18:08:04.835994+0000","last_undegraded":"2024-09-12T18:08:04.835994+0000","last_fullsized":"2024-09-12T18:08:04.835994+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:06:27.485219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"260'3","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:40.602189+0000","last_change":"2024-09-12T18:12:40.602189+0000","last_active":"2024-09-12T18:12:40.602189+0000","last_peered":"2024-09-12T18:12:40.602189+0000","last_clean":"2024-09-12T18:12:40.602189+0000","last_became_active":"2024-09-12T17:30:16.685830+0000","last_became_peered":"2024-09-12T17:30:16.685830+0000","last_unstale":"2024-09-12T18:12:40.602189+0000","last_undegraded":"2024-09-12T18:12:40.602189+0000","last_fullsized":"2024-09-12T18:12:40.602189+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'3","last_scrub_stamp":"2024-09-12T18:12:40.602088+0000","last_deep_scrub":"260'3","last_deep_scrub_stamp":"2024-09-12T18:12:40.602088+0000","last_clean_scrub_stamp":"2024-09-12T18:12:40.602088+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:08:04.177908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"0'0","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:17.643769+0000","last_change":"2024-09-12T18:12:17.643769+0000","last_active":"2024-09-12T18:12:17.643769+0000","last_peered":"2024-09-12T18:12:17.643769+0000","last_clean":"2024-09-12T18:12:17.643769+0000","last_became_active":"2024-09-12T17:30:12.640139+0000","last_became_peered":"2024-09-12T17:30:12.640139+0000","last_unstale":"2024-09-12T18:12:17.643769+0000","last_undegraded":"2024-09-12T18:12:17.643769+0000","last_fullsized":"2024-09-12T18:12:17.643769+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:17.643681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:17.643681+0000","last_clean_scrub_stamp":"2024-09-12T18:12:17.643681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:03:03.826784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"263'49","reported_seq":197,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:25.333514+0000","last_change":"2024-09-12T18:12:25.333514+0000","last_active":"2024-09-12T18:12:25.333514+0000","last_peered":"2024-09-12T18:12:25.333514+0000","last_clean":"2024-09-12T18:12:25.333514+0000","last_became_active":"2024-09-12T17:26:35.658785+0000","last_became_peered":"2024-09-12T17:26:35.658785+0000","last_unstale":"2024-09-12T18:12:25.333514+0000","last_undegraded":"2024-09-12T18:12:25.333514+0000","last_fullsized":"2024-09-12T18:12:25.333514+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'49","last_scrub_stamp":"2024-09-12T18:12:25.333414+0000","last_deep_scrub":"263'49","last_deep_scrub_stamp":"2024-09-12T18:12:25.333414+0000","last_clean_scrub_stamp":"2024-09-12T18:12:25.333414+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:55:51.168024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":254,"num_read_kb":176,"num_write":93,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"263'1","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:08:44.848723+0000","last_change":"2024-09-12T17:46:57.093615+0000","last_active":"2024-09-12T18:08:44.848723+0000","last_peered":"2024-09-12T18:08:44.848723+0000","last_clean":"2024-09-12T18:08:44.848723+0000","last_became_active":"2024-09-12T17:46:57.093267+0000","last_became_peered":"2024-09-12T17:46:57.093267+0000","last_unstale":"2024-09-12T18:08:44.848723+0000","last_undegraded":"2024-09-12T18:08:44.848723+0000","last_fullsized":"2024-09-12T18:08:44.848723+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:52:12.345961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:19.615413+0000","last_change":"2024-09-12T18:12:19.615343+0000","last_active":"2024-09-12T18:12:19.615413+0000","last_peered":"2024-09-12T18:12:19.615413+0000","last_clean":"2024-09-12T18:12:19.615413+0000","last_became_active":"2024-09-12T17:30:16.681418+0000","last_became_peered":"2024-09-12T17:30:16.681418+0000","last_unstale":"2024-09-12T18:12:19.615413+0000","last_undegraded":"2024-09-12T18:12:19.615413+0000","last_fullsized":"2024-09-12T18:12:19.615413+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:19.615255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:19.615255+0000","last_clean_scrub_stamp":"2024-09-12T18:12:19.615255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:53:23.299709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"260'3","reported_seq":61,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:27.495190+0000","last_change":"2024-09-12T18:12:27.495190+0000","last_active":"2024-09-12T18:12:27.495190+0000","last_peered":"2024-09-12T18:12:27.495190+0000","last_clean":"2024-09-12T18:12:27.495190+0000","last_became_active":"2024-09-12T17:30:12.643484+0000","last_became_peered":"2024-09-12T17:30:12.643484+0000","last_unstale":"2024-09-12T18:12:27.495190+0000","last_undegraded":"2024-09-12T18:12:27.495190+0000","last_fullsized":"2024-09-12T18:12:27.495190+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'3","last_scrub_stamp":"2024-09-12T18:12:27.495104+0000","last_deep_scrub":"260'3","last_deep_scrub_stamp":"2024-09-12T18:12:27.495104+0000","last_clean_scrub_stamp":"2024-09-12T18:12:27.495104+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:34:55.885967+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"260'23","reported_seq":127,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:31.699646+0000","last_change":"2024-09-12T18:12:31.699646+0000","last_active":"2024-09-12T18:12:31.699646+0000","last_peered":"2024-09-12T18:12:31.699646+0000","last_clean":"2024-09-12T18:12:31.699646+0000","last_became_active":"2024-09-12T17:26:35.665908+0000","last_became_peered":"2024-09-12T17:26:35.665908+0000","last_unstale":"2024-09-12T18:12:31.699646+0000","last_undegraded":"2024-09-12T18:12:31.699646+0000","last_fullsized":"2024-09-12T18:12:31.699646+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'23","last_scrub_stamp":"2024-09-12T18:12:31.699547+0000","last_deep_scrub":"260'23","last_deep_scrub_stamp":"2024-09-12T18:12:31.699547+0000","last_clean_scrub_stamp":"2024-09-12T18:12:31.699547+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:26:25.142810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":120,"num_read_kb":87,"num_write":41,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":32,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:13.703880+0000","last_change":"2024-09-12T18:12:13.703880+0000","last_active":"2024-09-12T18:12:13.703880+0000","last_peered":"2024-09-12T18:12:13.703880+0000","last_clean":"2024-09-12T18:12:13.703880+0000","last_became_active":"2024-09-12T17:46:57.083098+0000","last_became_peered":"2024-09-12T17:46:57.083098+0000","last_unstale":"2024-09-12T18:12:13.703880+0000","last_undegraded":"2024-09-12T18:12:13.703880+0000","last_fullsized":"2024-09-12T18:12:13.703880+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:13.703785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:13.703785+0000","last_clean_scrub_stamp":"2024-09-12T18:12:13.703785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:58:44.733305+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:38.639932+0000","last_change":"2024-09-12T18:12:38.639932+0000","last_active":"2024-09-12T18:12:38.639932+0000","last_peered":"2024-09-12T18:12:38.639932+0000","last_clean":"2024-09-12T18:12:38.639932+0000","last_became_active":"2024-09-12T17:30:16.683887+0000","last_became_peered":"2024-09-12T17:30:16.683887+0000","last_unstale":"2024-09-12T18:12:38.639932+0000","last_undegraded":"2024-09-12T18:12:38.639932+0000","last_fullsized":"2024-09-12T18:12:38.639932+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:38.639801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:38.639801+0000","last_clean_scrub_stamp":"2024-09-12T18:12:38.639801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:19:50.984866+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"263'4","reported_seq":62,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:34.564503+0000","last_change":"2024-09-12T18:12:34.564503+0000","last_active":"2024-09-12T18:12:34.564503+0000","last_peered":"2024-09-12T18:12:34.564503+0000","last_clean":"2024-09-12T18:12:34.564503+0000","last_became_active":"2024-09-12T17:30:12.653137+0000","last_became_peered":"2024-09-12T17:30:12.653137+0000","last_unstale":"2024-09-12T18:12:34.564503+0000","last_undegraded":"2024-09-12T18:12:34.564503+0000","last_fullsized":"2024-09-12T18:12:34.564503+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-09-12T18:12:34.564417+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-09-12T18:12:34.564417+0000","last_clean_scrub_stamp":"2024-09-12T18:12:34.564417+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:49:36.854631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6148,"num_write":4,"num_write_kb":3076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"263'50","reported_seq":195,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:30.674050+0000","last_change":"2024-09-12T18:12:30.674050+0000","last_active":"2024-09-12T18:12:30.674050+0000","last_peered":"2024-09-12T18:12:30.674050+0000","last_clean":"2024-09-12T18:12:30.674050+0000","last_became_active":"2024-09-12T17:26:35.668989+0000","last_became_peered":"2024-09-12T17:26:35.668989+0000","last_unstale":"2024-09-12T18:12:30.674050+0000","last_undegraded":"2024-09-12T18:12:30.674050+0000","last_fullsized":"2024-09-12T18:12:30.674050+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'50","last_scrub_stamp":"2024-09-12T18:12:30.673958+0000","last_deep_scrub":"263'50","last_deep_scrub_stamp":"2024-09-12T18:12:30.673958+0000","last_clean_scrub_stamp":"2024-09-12T18:12:30.673958+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:49:54.457434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":250,"num_read_kb":175,"num_write":93,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":32,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:39.469968+0000","last_change":"2024-09-12T18:12:39.469968+0000","last_active":"2024-09-12T18:12:39.469968+0000","last_peered":"2024-09-12T18:12:39.469968+0000","last_clean":"2024-09-12T18:12:39.469968+0000","last_became_active":"2024-09-12T17:46:57.087982+0000","last_became_peered":"2024-09-12T17:46:57.087982+0000","last_unstale":"2024-09-12T18:12:39.469968+0000","last_undegraded":"2024-09-12T18:12:39.469968+0000","last_fullsized":"2024-09-12T18:12:39.469968+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:39.469872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:39.469872+0000","last_clean_scrub_stamp":"2024-09-12T18:12:39.469872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:16:13.071735+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"263'5","reported_seq":57,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:37.650137+0000","last_change":"2024-09-12T18:12:37.650137+0000","last_active":"2024-09-12T18:12:37.650137+0000","last_peered":"2024-09-12T18:12:37.650137+0000","last_clean":"2024-09-12T18:12:37.650137+0000","last_became_active":"2024-09-12T17:30:16.679621+0000","last_became_peered":"2024-09-12T17:30:16.679621+0000","last_unstale":"2024-09-12T18:12:37.650137+0000","last_undegraded":"2024-09-12T18:12:37.650137+0000","last_fullsized":"2024-09-12T18:12:37.650137+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'5","last_scrub_stamp":"2024-09-12T18:12:37.650044+0000","last_deep_scrub":"263'5","last_deep_scrub_stamp":"2024-09-12T18:12:37.650044+0000","last_clean_scrub_stamp":"2024-09-12T18:12:37.650044+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:21:16.129452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":9216,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"0'0","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:11.722350+0000","last_change":"2024-09-12T18:12:11.722350+0000","last_active":"2024-09-12T18:12:11.722350+0000","last_peered":"2024-09-12T18:12:11.722350+0000","last_clean":"2024-09-12T18:12:11.722350+0000","last_became_active":"2024-09-12T17:30:12.649010+0000","last_became_peered":"2024-09-12T17:30:12.649010+0000","last_unstale":"2024-09-12T18:12:11.722350+0000","last_undegraded":"2024-09-12T18:12:11.722350+0000","last_fullsized":"2024-09-12T18:12:11.722350+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:11.722264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:11.722264+0000","last_clean_scrub_stamp":"2024-09-12T18:12:11.722264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:57:34.831899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"260'8","reported_seq":84,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:25.450522+0000","last_change":"2024-09-12T18:12:25.450522+0000","last_active":"2024-09-12T18:12:25.450522+0000","last_peered":"2024-09-12T18:12:25.450522+0000","last_clean":"2024-09-12T18:12:25.450522+0000","last_became_active":"2024-09-12T17:26:35.663041+0000","last_became_peered":"2024-09-12T17:26:35.663041+0000","last_unstale":"2024-09-12T18:12:25.450522+0000","last_undegraded":"2024-09-12T18:12:25.450522+0000","last_fullsized":"2024-09-12T18:12:25.450522+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'8","last_scrub_stamp":"2024-09-12T18:12:25.450393+0000","last_deep_scrub":"260'8","last_deep_scrub_stamp":"2024-09-12T18:12:25.450393+0000","last_clean_scrub_stamp":"2024-09-12T18:12:25.450393+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:09:36.252938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":28,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":32,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:22.599821+0000","last_change":"2024-09-12T18:12:22.599821+0000","last_active":"2024-09-12T18:12:22.599821+0000","last_peered":"2024-09-12T18:12:22.599821+0000","last_clean":"2024-09-12T18:12:22.599821+0000","last_became_active":"2024-09-12T17:46:57.085908+0000","last_became_peered":"2024-09-12T17:46:57.085908+0000","last_unstale":"2024-09-12T18:12:22.599821+0000","last_undegraded":"2024-09-12T18:12:22.599821+0000","last_fullsized":"2024-09-12T18:12:22.599821+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:22.599729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:22.599729+0000","last_clean_scrub_stamp":"2024-09-12T18:12:22.599729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:22:37.203634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"0'0","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:23.528470+0000","last_change":"2024-09-12T18:12:23.528470+0000","last_active":"2024-09-12T18:12:23.528470+0000","last_peered":"2024-09-12T18:12:23.528470+0000","last_clean":"2024-09-12T18:12:23.528470+0000","last_became_active":"2024-09-12T17:30:16.679193+0000","last_became_peered":"2024-09-12T17:30:16.679193+0000","last_unstale":"2024-09-12T18:12:23.528470+0000","last_undegraded":"2024-09-12T18:12:23.528470+0000","last_fullsized":"2024-09-12T18:12:23.528470+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:23.528383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:23.528383+0000","last_clean_scrub_stamp":"2024-09-12T18:12:23.528383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:50:26.406700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"0'0","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:33.762235+0000","last_change":"2024-09-12T18:12:33.762235+0000","last_active":"2024-09-12T18:12:33.762235+0000","last_peered":"2024-09-12T18:12:33.762235+0000","last_clean":"2024-09-12T18:12:33.762235+0000","last_became_active":"2024-09-12T17:30:12.646945+0000","last_became_peered":"2024-09-12T17:30:12.646945+0000","last_unstale":"2024-09-12T18:12:33.762235+0000","last_undegraded":"2024-09-12T18:12:33.762235+0000","last_fullsized":"2024-09-12T18:12:33.762235+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:33.762150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:33.762150+0000","last_clean_scrub_stamp":"2024-09-12T18:12:33.762150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:41:23.369152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"263'33","reported_seq":151,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:14.554571+0000","last_change":"2024-09-12T18:12:14.554571+0000","last_active":"2024-09-12T18:12:14.554571+0000","last_peered":"2024-09-12T18:12:14.554571+0000","last_clean":"2024-09-12T18:12:14.554571+0000","last_became_active":"2024-09-12T17:26:35.664749+0000","last_became_peered":"2024-09-12T17:26:35.664749+0000","last_unstale":"2024-09-12T18:12:14.554571+0000","last_undegraded":"2024-09-12T18:12:14.554571+0000","last_fullsized":"2024-09-12T18:12:14.554571+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'33","last_scrub_stamp":"2024-09-12T18:12:14.554482+0000","last_deep_scrub":"263'33","last_deep_scrub_stamp":"2024-09-12T18:12:14.554482+0000","last_clean_scrub_stamp":"2024-09-12T18:12:14.554482+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:42:43.539362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":166,"num_read_kb":124,"num_write":50,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":32,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:38.471314+0000","last_change":"2024-09-12T18:12:38.471314+0000","last_active":"2024-09-12T18:12:38.471314+0000","last_peered":"2024-09-12T18:12:38.471314+0000","last_clean":"2024-09-12T18:12:38.471314+0000","last_became_active":"2024-09-12T17:46:57.084421+0000","last_became_peered":"2024-09-12T17:46:57.084421+0000","last_unstale":"2024-09-12T18:12:38.471314+0000","last_undegraded":"2024-09-12T18:12:38.471314+0000","last_fullsized":"2024-09-12T18:12:38.471314+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:38.471210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:38.471210+0000","last_clean_scrub_stamp":"2024-09-12T18:12:38.471210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:54:23.999871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"0'0","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:39.630066+0000","last_change":"2024-09-12T18:12:39.630066+0000","last_active":"2024-09-12T18:12:39.630066+0000","last_peered":"2024-09-12T18:12:39.630066+0000","last_clean":"2024-09-12T18:12:39.630066+0000","last_became_active":"2024-09-12T17:30:16.681171+0000","last_became_peered":"2024-09-12T17:30:16.681171+0000","last_unstale":"2024-09-12T18:12:39.630066+0000","last_undegraded":"2024-09-12T18:12:39.630066+0000","last_fullsized":"2024-09-12T18:12:39.630066+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:39.629971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:39.629971+0000","last_clean_scrub_stamp":"2024-09-12T18:12:39.629971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:02:02.885356+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"263'6","reported_seq":65,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:22.520661+0000","last_change":"2024-09-12T18:12:22.520661+0000","last_active":"2024-09-12T18:12:22.520661+0000","last_peered":"2024-09-12T18:12:22.520661+0000","last_clean":"2024-09-12T18:12:22.520661+0000","last_became_active":"2024-09-12T17:30:12.641592+0000","last_became_peered":"2024-09-12T17:30:12.641592+0000","last_unstale":"2024-09-12T18:12:22.520661+0000","last_undegraded":"2024-09-12T18:12:22.520661+0000","last_fullsized":"2024-09-12T18:12:22.520661+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'6","last_scrub_stamp":"2024-09-12T18:12:22.520568+0000","last_deep_scrub":"263'6","last_deep_scrub_stamp":"2024-09-12T18:12:22.520568+0000","last_clean_scrub_stamp":"2024-09-12T18:12:22.520568+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:49:55.907430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":11264,"num_write":6,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"263'52","reported_seq":204,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:08.755498+0000","last_change":"2024-09-12T18:12:08.755498+0000","last_active":"2024-09-12T18:12:08.755498+0000","last_peered":"2024-09-12T18:12:08.755498+0000","last_clean":"2024-09-12T18:12:08.755498+0000","last_became_active":"2024-09-12T17:26:35.663472+0000","last_became_peered":"2024-09-12T17:26:35.663472+0000","last_unstale":"2024-09-12T18:12:08.755498+0000","last_undegraded":"2024-09-12T18:12:08.755498+0000","last_fullsized":"2024-09-12T18:12:08.755498+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'52","last_scrub_stamp":"2024-09-12T18:12:08.755421+0000","last_deep_scrub":"263'52","last_deep_scrub_stamp":"2024-09-12T18:12:08.755421+0000","last_clean_scrub_stamp":"2024-09-12T18:12:08.755421+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:24:53.221772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":261,"num_read_kb":192,"num_write":92,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:09:29.854446+0000","last_change":"2024-09-12T17:46:57.090539+0000","last_active":"2024-09-12T18:09:29.854446+0000","last_peered":"2024-09-12T18:09:29.854446+0000","last_clean":"2024-09-12T18:09:29.854446+0000","last_became_active":"2024-09-12T17:46:57.089601+0000","last_became_peered":"2024-09-12T17:46:57.089601+0000","last_unstale":"2024-09-12T18:09:29.854446+0000","last_undegraded":"2024-09-12T18:09:29.854446+0000","last_fullsized":"2024-09-12T18:09:29.854446+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:46:56.058809+0000","last_clean_scrub_stamp":"2024-09-12T17:46:56.058809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:13:07.708030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"0'0","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:33.290702+0000","last_change":"2024-09-12T18:12:33.290702+0000","last_active":"2024-09-12T18:12:33.290702+0000","last_peered":"2024-09-12T18:12:33.290702+0000","last_clean":"2024-09-12T18:12:33.290702+0000","last_became_active":"2024-09-12T17:30:16.679308+0000","last_became_peered":"2024-09-12T17:30:16.679308+0000","last_unstale":"2024-09-12T18:12:33.290702+0000","last_undegraded":"2024-09-12T18:12:33.290702+0000","last_fullsized":"2024-09-12T18:12:33.290702+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:33.290598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:33.290598+0000","last_clean_scrub_stamp":"2024-09-12T18:12:33.290598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:23:49.567295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"263'5","reported_seq":64,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:31.697940+0000","last_change":"2024-09-12T18:12:31.697940+0000","last_active":"2024-09-12T18:12:31.697940+0000","last_peered":"2024-09-12T18:12:31.697940+0000","last_clean":"2024-09-12T18:12:31.697940+0000","last_became_active":"2024-09-12T17:30:12.644792+0000","last_became_peered":"2024-09-12T17:30:12.644792+0000","last_unstale":"2024-09-12T18:12:31.697940+0000","last_undegraded":"2024-09-12T18:12:31.697940+0000","last_fullsized":"2024-09-12T18:12:31.697940+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'5","last_scrub_stamp":"2024-09-12T18:12:31.697844+0000","last_deep_scrub":"263'5","last_deep_scrub_stamp":"2024-09-12T18:12:31.697844+0000","last_clean_scrub_stamp":"2024-09-12T18:12:31.697844+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:52:52.564311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6192,"num_write":5,"num_write_kb":6192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"263'30","reported_seq":150,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:24.657406+0000","last_change":"2024-09-12T18:12:24.657406+0000","last_active":"2024-09-12T18:12:24.657406+0000","last_peered":"2024-09-12T18:12:24.657406+0000","last_clean":"2024-09-12T18:12:24.657406+0000","last_became_active":"2024-09-12T17:26:35.667655+0000","last_became_peered":"2024-09-12T17:26:35.667655+0000","last_unstale":"2024-09-12T18:12:24.657406+0000","last_undegraded":"2024-09-12T18:12:24.657406+0000","last_fullsized":"2024-09-12T18:12:24.657406+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'30","last_scrub_stamp":"2024-09-12T18:12:24.657320+0000","last_deep_scrub":"263'30","last_deep_scrub_stamp":"2024-09-12T18:12:24.657320+0000","last_clean_scrub_stamp":"2024-09-12T18:12:24.657320+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:14:21.792764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":166,"num_read_kb":116,"num_write":53,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":32,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:43.525663+0000","last_change":"2024-09-12T18:12:43.525663+0000","last_active":"2024-09-12T18:12:43.525663+0000","last_peered":"2024-09-12T18:12:43.525663+0000","last_clean":"2024-09-12T18:12:43.525663+0000","last_became_active":"2024-09-12T17:46:57.090477+0000","last_became_peered":"2024-09-12T17:46:57.090477+0000","last_unstale":"2024-09-12T18:12:43.525663+0000","last_undegraded":"2024-09-12T18:12:43.525663+0000","last_fullsized":"2024-09-12T18:12:43.525663+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:43.525568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:43.525568+0000","last_clean_scrub_stamp":"2024-09-12T18:12:43.525568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:43:53.818940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"260'8","reported_seq":65,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:33.515495+0000","last_change":"2024-09-12T18:12:33.515495+0000","last_active":"2024-09-12T18:12:33.515495+0000","last_peered":"2024-09-12T18:12:33.515495+0000","last_clean":"2024-09-12T18:12:33.515495+0000","last_became_active":"2024-09-12T17:30:16.672989+0000","last_became_peered":"2024-09-12T17:30:16.672989+0000","last_unstale":"2024-09-12T18:12:33.515495+0000","last_undegraded":"2024-09-12T18:12:33.515495+0000","last_fullsized":"2024-09-12T18:12:33.515495+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'8","last_scrub_stamp":"2024-09-12T18:12:33.515407+0000","last_deep_scrub":"260'8","last_deep_scrub_stamp":"2024-09-12T18:12:33.515407+0000","last_clean_scrub_stamp":"2024-09-12T18:12:33.515407+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:34:22.751560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":6167,"num_write":13,"num_write_kb":6167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"263'3","reported_seq":63,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:18.515681+0000","last_change":"2024-09-12T18:12:18.515681+0000","last_active":"2024-09-12T18:12:18.515681+0000","last_peered":"2024-09-12T18:12:18.515681+0000","last_clean":"2024-09-12T18:12:18.515681+0000","last_became_active":"2024-09-12T17:30:12.641901+0000","last_became_peered":"2024-09-12T17:30:12.641901+0000","last_unstale":"2024-09-12T18:12:18.515681+0000","last_undegraded":"2024-09-12T18:12:18.515681+0000","last_fullsized":"2024-09-12T18:12:18.515681+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'3","last_scrub_stamp":"2024-09-12T18:12:18.515600+0000","last_deep_scrub":"263'3","last_deep_scrub_stamp":"2024-09-12T18:12:18.515600+0000","last_clean_scrub_stamp":"2024-09-12T18:12:18.515600+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:31:33.540827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"263'9","reported_seq":87,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:23.490308+0000","last_change":"2024-09-12T18:12:23.490308+0000","last_active":"2024-09-12T18:12:23.490308+0000","last_peered":"2024-09-12T18:12:23.490308+0000","last_clean":"2024-09-12T18:12:23.490308+0000","last_became_active":"2024-09-12T17:26:35.655307+0000","last_became_peered":"2024-09-12T17:26:35.655307+0000","last_unstale":"2024-09-12T18:12:23.490308+0000","last_undegraded":"2024-09-12T18:12:23.490308+0000","last_fullsized":"2024-09-12T18:12:23.490308+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'9","last_scrub_stamp":"2024-09-12T18:12:23.490216+0000","last_deep_scrub":"263'9","last_deep_scrub_stamp":"2024-09-12T18:12:23.490216+0000","last_clean_scrub_stamp":"2024-09-12T18:12:23.490216+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:14:25.755383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":30,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"263'2","reported_seq":34,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:40.467227+0000","last_change":"2024-09-12T18:12:40.467227+0000","last_active":"2024-09-12T18:12:40.467227+0000","last_peered":"2024-09-12T18:12:40.467227+0000","last_clean":"2024-09-12T18:12:40.467227+0000","last_became_active":"2024-09-12T17:46:57.086116+0000","last_became_peered":"2024-09-12T17:46:57.086116+0000","last_unstale":"2024-09-12T18:12:40.467227+0000","last_undegraded":"2024-09-12T18:12:40.467227+0000","last_fullsized":"2024-09-12T18:12:40.467227+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T18:12:40.467141+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T18:12:40.467141+0000","last_clean_scrub_stamp":"2024-09-12T18:12:40.467141+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:37:13.536113+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:20.506619+0000","last_change":"2024-09-12T18:12:20.506619+0000","last_active":"2024-09-12T18:12:20.506619+0000","last_peered":"2024-09-12T18:12:20.506619+0000","last_clean":"2024-09-12T18:12:20.506619+0000","last_became_active":"2024-09-12T17:30:16.675243+0000","last_became_peered":"2024-09-12T17:30:16.675243+0000","last_unstale":"2024-09-12T18:12:20.506619+0000","last_undegraded":"2024-09-12T18:12:20.506619+0000","last_fullsized":"2024-09-12T18:12:20.506619+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:20.506497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:20.506497+0000","last_clean_scrub_stamp":"2024-09-12T18:12:20.506497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:52:49.404441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"263'2","reported_seq":59,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:32.721440+0000","last_change":"2024-09-12T18:12:32.721440+0000","last_active":"2024-09-12T18:12:32.721440+0000","last_peered":"2024-09-12T18:12:32.721440+0000","last_clean":"2024-09-12T18:12:32.721440+0000","last_became_active":"2024-09-12T17:30:12.640736+0000","last_became_peered":"2024-09-12T17:30:12.640736+0000","last_unstale":"2024-09-12T18:12:32.721440+0000","last_undegraded":"2024-09-12T18:12:32.721440+0000","last_fullsized":"2024-09-12T18:12:32.721440+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T18:12:32.721349+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T18:12:32.721349+0000","last_clean_scrub_stamp":"2024-09-12T18:12:32.721349+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:35:18.786941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"0'0","reported_seq":64,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:29.690203+0000","last_change":"2024-09-12T18:12:29.690203+0000","last_active":"2024-09-12T18:12:29.690203+0000","last_peered":"2024-09-12T18:12:29.690203+0000","last_clean":"2024-09-12T18:12:29.690203+0000","last_became_active":"2024-09-12T17:26:35.656149+0000","last_became_peered":"2024-09-12T17:26:35.656149+0000","last_unstale":"2024-09-12T18:12:29.690203+0000","last_undegraded":"2024-09-12T18:12:29.690203+0000","last_fullsized":"2024-09-12T18:12:29.690203+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:29.690097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:29.690097+0000","last_clean_scrub_stamp":"2024-09-12T18:12:29.690097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:03:11.925252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":32,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:43.913203+0000","last_change":"2024-09-12T18:12:43.913203+0000","last_active":"2024-09-12T18:12:43.913203+0000","last_peered":"2024-09-12T18:12:43.913203+0000","last_clean":"2024-09-12T18:12:43.913203+0000","last_became_active":"2024-09-12T17:46:57.096375+0000","last_became_peered":"2024-09-12T17:46:57.096375+0000","last_unstale":"2024-09-12T18:12:43.913203+0000","last_undegraded":"2024-09-12T18:12:43.913203+0000","last_fullsized":"2024-09-12T18:12:43.913203+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:43.913107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:43.913107+0000","last_clean_scrub_stamp":"2024-09-12T18:12:43.913107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:38:21.126385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"263'2","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:35.520758+0000","last_change":"2024-09-12T18:12:35.520758+0000","last_active":"2024-09-12T18:12:35.520758+0000","last_peered":"2024-09-12T18:12:35.520758+0000","last_clean":"2024-09-12T18:12:35.520758+0000","last_became_active":"2024-09-12T17:30:16.686562+0000","last_became_peered":"2024-09-12T17:30:16.686562+0000","last_unstale":"2024-09-12T18:12:35.520758+0000","last_undegraded":"2024-09-12T18:12:35.520758+0000","last_fullsized":"2024-09-12T18:12:35.520758+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T18:12:35.520665+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T18:12:35.520665+0000","last_clean_scrub_stamp":"2024-09-12T18:12:35.520665+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:54:02.180539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"263'5","reported_seq":63,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:23.372119+0000","last_change":"2024-09-12T18:12:23.372119+0000","last_active":"2024-09-12T18:12:23.372119+0000","last_peered":"2024-09-12T18:12:23.372119+0000","last_clean":"2024-09-12T18:12:23.372119+0000","last_became_active":"2024-09-12T17:30:12.644490+0000","last_became_peered":"2024-09-12T17:30:12.644490+0000","last_unstale":"2024-09-12T18:12:23.372119+0000","last_undegraded":"2024-09-12T18:12:23.372119+0000","last_fullsized":"2024-09-12T18:12:23.372119+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'5","last_scrub_stamp":"2024-09-12T18:12:23.372029+0000","last_deep_scrub":"263'5","last_deep_scrub_stamp":"2024-09-12T18:12:23.372029+0000","last_clean_scrub_stamp":"2024-09-12T18:12:23.372029+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:38:33.548751+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":9216,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"263'23","reported_seq":124,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:13.553880+0000","last_change":"2024-09-12T18:12:13.553880+0000","last_active":"2024-09-12T18:12:13.553880+0000","last_peered":"2024-09-12T18:12:13.553880+0000","last_clean":"2024-09-12T18:12:13.553880+0000","last_became_active":"2024-09-12T17:26:35.664849+0000","last_became_peered":"2024-09-12T17:26:35.664849+0000","last_unstale":"2024-09-12T18:12:13.553880+0000","last_undegraded":"2024-09-12T18:12:13.553880+0000","last_fullsized":"2024-09-12T18:12:13.553880+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'23","last_scrub_stamp":"2024-09-12T18:12:13.553786+0000","last_deep_scrub":"263'23","last_deep_scrub_stamp":"2024-09-12T18:12:13.553786+0000","last_clean_scrub_stamp":"2024-09-12T18:12:13.553786+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:38:52.170139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":79,"num_write":44,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":33,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:36.483889+0000","last_change":"2024-09-12T18:12:36.483889+0000","last_active":"2024-09-12T18:12:36.483889+0000","last_peered":"2024-09-12T18:12:36.483889+0000","last_clean":"2024-09-12T18:12:36.483889+0000","last_became_active":"2024-09-12T17:46:57.089081+0000","last_became_peered":"2024-09-12T17:46:57.089081+0000","last_unstale":"2024-09-12T18:12:36.483889+0000","last_undegraded":"2024-09-12T18:12:36.483889+0000","last_fullsized":"2024-09-12T18:12:36.483889+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:36.483770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:36.483770+0000","last_clean_scrub_stamp":"2024-09-12T18:12:36.483770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:53:19.930026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"0'0","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:37.797393+0000","last_change":"2024-09-12T18:12:37.797393+0000","last_active":"2024-09-12T18:12:37.797393+0000","last_peered":"2024-09-12T18:12:37.797393+0000","last_clean":"2024-09-12T18:12:37.797393+0000","last_became_active":"2024-09-12T17:30:16.680901+0000","last_became_peered":"2024-09-12T17:30:16.680901+0000","last_unstale":"2024-09-12T18:12:37.797393+0000","last_undegraded":"2024-09-12T18:12:37.797393+0000","last_fullsized":"2024-09-12T18:12:37.797393+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:37.797304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:37.797304+0000","last_clean_scrub_stamp":"2024-09-12T18:12:37.797304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:07:01.249373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"0'0","reported_seq":57,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:28.519123+0000","last_change":"2024-09-12T18:12:28.519123+0000","last_active":"2024-09-12T18:12:28.519123+0000","last_peered":"2024-09-12T18:12:28.519123+0000","last_clean":"2024-09-12T18:12:28.519123+0000","last_became_active":"2024-09-12T17:30:12.648875+0000","last_became_peered":"2024-09-12T17:30:12.648875+0000","last_unstale":"2024-09-12T18:12:28.519123+0000","last_undegraded":"2024-09-12T18:12:28.519123+0000","last_fullsized":"2024-09-12T18:12:28.519123+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:28.519034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:28.519034+0000","last_clean_scrub_stamp":"2024-09-12T18:12:28.519034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:06:37.065827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"263'15","reported_seq":101,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:26.693654+0000","last_change":"2024-09-12T18:12:26.693654+0000","last_active":"2024-09-12T18:12:26.693654+0000","last_peered":"2024-09-12T18:12:26.693654+0000","last_clean":"2024-09-12T18:12:26.693654+0000","last_became_active":"2024-09-12T17:26:35.668118+0000","last_became_peered":"2024-09-12T17:26:35.668118+0000","last_unstale":"2024-09-12T18:12:26.693654+0000","last_undegraded":"2024-09-12T18:12:26.693654+0000","last_fullsized":"2024-09-12T18:12:26.693654+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'15","last_scrub_stamp":"2024-09-12T18:12:26.693556+0000","last_deep_scrub":"263'15","last_deep_scrub_stamp":"2024-09-12T18:12:26.693556+0000","last_clean_scrub_stamp":"2024-09-12T18:12:26.693556+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:18:32.336188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":44,"num_write":31,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":33,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:32.382910+0000","last_change":"2024-09-12T18:12:32.382910+0000","last_active":"2024-09-12T18:12:32.382910+0000","last_peered":"2024-09-12T18:12:32.382910+0000","last_clean":"2024-09-12T18:12:32.382910+0000","last_became_active":"2024-09-12T17:46:57.085922+0000","last_became_peered":"2024-09-12T17:46:57.085922+0000","last_unstale":"2024-09-12T18:12:32.382910+0000","last_undegraded":"2024-09-12T18:12:32.382910+0000","last_fullsized":"2024-09-12T18:12:32.382910+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:32.382795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:32.382795+0000","last_clean_scrub_stamp":"2024-09-12T18:12:32.382795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:49:02.907483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"263'6","reported_seq":61,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:38.842048+0000","last_change":"2024-09-12T18:12:38.842048+0000","last_active":"2024-09-12T18:12:38.842048+0000","last_peered":"2024-09-12T18:12:38.842048+0000","last_clean":"2024-09-12T18:12:38.842048+0000","last_became_active":"2024-09-12T17:30:16.668999+0000","last_became_peered":"2024-09-12T17:30:16.668999+0000","last_unstale":"2024-09-12T18:12:38.842048+0000","last_undegraded":"2024-09-12T18:12:38.842048+0000","last_fullsized":"2024-09-12T18:12:38.842048+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'6","last_scrub_stamp":"2024-09-12T18:12:38.841956+0000","last_deep_scrub":"263'6","last_deep_scrub_stamp":"2024-09-12T18:12:38.841956+0000","last_clean_scrub_stamp":"2024-09-12T18:12:38.841956+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:31:51.252659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":12288,"num_write":11,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"0'0","reported_seq":57,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:09.725063+0000","last_change":"2024-09-12T18:12:09.725063+0000","last_active":"2024-09-12T18:12:09.725063+0000","last_peered":"2024-09-12T18:12:09.725063+0000","last_clean":"2024-09-12T18:12:09.725063+0000","last_became_active":"2024-09-12T17:30:12.649350+0000","last_became_peered":"2024-09-12T17:30:12.649350+0000","last_unstale":"2024-09-12T18:12:09.725063+0000","last_undegraded":"2024-09-12T18:12:09.725063+0000","last_fullsized":"2024-09-12T18:12:09.725063+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:09.724971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:09.724971+0000","last_clean_scrub_stamp":"2024-09-12T18:12:09.724971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:05:18.085102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"263'20","reported_seq":124,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:12.583591+0000","last_change":"2024-09-12T18:12:12.583591+0000","last_active":"2024-09-12T18:12:12.583591+0000","last_peered":"2024-09-12T18:12:12.583591+0000","last_clean":"2024-09-12T18:12:12.583591+0000","last_became_active":"2024-09-12T17:26:35.667060+0000","last_became_peered":"2024-09-12T17:26:35.667060+0000","last_unstale":"2024-09-12T18:12:12.583591+0000","last_undegraded":"2024-09-12T18:12:12.583591+0000","last_fullsized":"2024-09-12T18:12:12.583591+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'20","last_scrub_stamp":"2024-09-12T18:12:12.583489+0000","last_deep_scrub":"263'20","last_deep_scrub_stamp":"2024-09-12T18:12:12.583489+0000","last_clean_scrub_stamp":"2024-09-12T18:12:12.583489+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:09:58.254956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":80,"num_write":36,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":33,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:26.517828+0000","last_change":"2024-09-12T18:12:26.517828+0000","last_active":"2024-09-12T18:12:26.517828+0000","last_peered":"2024-09-12T18:12:26.517828+0000","last_clean":"2024-09-12T18:12:26.517828+0000","last_became_active":"2024-09-12T17:46:57.076358+0000","last_became_peered":"2024-09-12T17:46:57.076358+0000","last_unstale":"2024-09-12T18:12:26.517828+0000","last_undegraded":"2024-09-12T18:12:26.517828+0000","last_fullsized":"2024-09-12T18:12:26.517828+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:26.517736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:26.517736+0000","last_clean_scrub_stamp":"2024-09-12T18:12:26.517736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:52.936894+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"260'3","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:32.554983+0000","last_change":"2024-09-12T18:12:32.554983+0000","last_active":"2024-09-12T18:12:32.554983+0000","last_peered":"2024-09-12T18:12:32.554983+0000","last_clean":"2024-09-12T18:12:32.554983+0000","last_became_active":"2024-09-12T17:30:16.676187+0000","last_became_peered":"2024-09-12T17:30:16.676187+0000","last_unstale":"2024-09-12T18:12:32.554983+0000","last_undegraded":"2024-09-12T18:12:32.554983+0000","last_fullsized":"2024-09-12T18:12:32.554983+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'3","last_scrub_stamp":"2024-09-12T18:12:32.554809+0000","last_deep_scrub":"260'3","last_deep_scrub_stamp":"2024-09-12T18:12:32.554809+0000","last_clean_scrub_stamp":"2024-09-12T18:12:32.554809+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:16:15.966568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"263'5","reported_seq":63,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:26.467226+0000","last_change":"2024-09-12T18:12:26.467226+0000","last_active":"2024-09-12T18:12:26.467226+0000","last_peered":"2024-09-12T18:12:26.467226+0000","last_clean":"2024-09-12T18:12:26.467226+0000","last_became_active":"2024-09-12T17:30:12.651254+0000","last_became_peered":"2024-09-12T17:30:12.651254+0000","last_unstale":"2024-09-12T18:12:26.467226+0000","last_undegraded":"2024-09-12T18:12:26.467226+0000","last_fullsized":"2024-09-12T18:12:26.467226+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'5","last_scrub_stamp":"2024-09-12T18:12:26.467111+0000","last_deep_scrub":"263'5","last_deep_scrub_stamp":"2024-09-12T18:12:26.467111+0000","last_clean_scrub_stamp":"2024-09-12T18:12:26.467111+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:13:46.275560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":16,"num_write":10,"num_write_kb":1040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"263'21","reported_seq":115,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:22.507667+0000","last_change":"2024-09-12T18:12:22.507599+0000","last_active":"2024-09-12T18:12:22.507667+0000","last_peered":"2024-09-12T18:12:22.507667+0000","last_clean":"2024-09-12T18:12:22.507667+0000","last_became_active":"2024-09-12T17:26:35.660521+0000","last_became_peered":"2024-09-12T17:26:35.660521+0000","last_unstale":"2024-09-12T18:12:22.507667+0000","last_undegraded":"2024-09-12T18:12:22.507667+0000","last_fullsized":"2024-09-12T18:12:22.507667+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'21","last_scrub_stamp":"2024-09-12T18:12:22.507515+0000","last_deep_scrub":"263'21","last_deep_scrub_stamp":"2024-09-12T18:12:22.507515+0000","last_clean_scrub_stamp":"2024-09-12T18:12:22.507515+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:47:17.016996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":60,"num_write":47,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":33,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:34.317822+0000","last_change":"2024-09-12T18:12:34.317822+0000","last_active":"2024-09-12T18:12:34.317822+0000","last_peered":"2024-09-12T18:12:34.317822+0000","last_clean":"2024-09-12T18:12:34.317822+0000","last_became_active":"2024-09-12T17:46:57.075936+0000","last_became_peered":"2024-09-12T17:46:57.075936+0000","last_unstale":"2024-09-12T18:12:34.317822+0000","last_undegraded":"2024-09-12T18:12:34.317822+0000","last_fullsized":"2024-09-12T18:12:34.317822+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:34.317721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:34.317721+0000","last_clean_scrub_stamp":"2024-09-12T18:12:34.317721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:11:46.146750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"0'0","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:30.339076+0000","last_change":"2024-09-12T18:12:30.339076+0000","last_active":"2024-09-12T18:12:30.339076+0000","last_peered":"2024-09-12T18:12:30.339076+0000","last_clean":"2024-09-12T18:12:30.339076+0000","last_became_active":"2024-09-12T17:30:16.671232+0000","last_became_peered":"2024-09-12T17:30:16.671232+0000","last_unstale":"2024-09-12T18:12:30.339076+0000","last_undegraded":"2024-09-12T18:12:30.339076+0000","last_fullsized":"2024-09-12T18:12:30.339076+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:30.338974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:30.338974+0000","last_clean_scrub_stamp":"2024-09-12T18:12:30.338974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:15:44.163389+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"260'3","reported_seq":62,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:27.496798+0000","last_change":"2024-09-12T18:12:27.496798+0000","last_active":"2024-09-12T18:12:27.496798+0000","last_peered":"2024-09-12T18:12:27.496798+0000","last_clean":"2024-09-12T18:12:27.496798+0000","last_became_active":"2024-09-12T17:30:12.652439+0000","last_became_peered":"2024-09-12T17:30:12.652439+0000","last_unstale":"2024-09-12T18:12:27.496798+0000","last_undegraded":"2024-09-12T18:12:27.496798+0000","last_fullsized":"2024-09-12T18:12:27.496798+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'3","last_scrub_stamp":"2024-09-12T18:12:27.496698+0000","last_deep_scrub":"260'3","last_deep_scrub_stamp":"2024-09-12T18:12:27.496698+0000","last_clean_scrub_stamp":"2024-09-12T18:12:27.496698+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:52:03.044665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"263'34","reported_seq":153,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:15.511548+0000","last_change":"2024-09-12T18:12:15.511485+0000","last_active":"2024-09-12T18:12:15.511548+0000","last_peered":"2024-09-12T18:12:15.511548+0000","last_clean":"2024-09-12T18:12:15.511548+0000","last_became_active":"2024-09-12T17:26:35.664338+0000","last_became_peered":"2024-09-12T17:26:35.664338+0000","last_unstale":"2024-09-12T18:12:15.511548+0000","last_undegraded":"2024-09-12T18:12:15.511548+0000","last_fullsized":"2024-09-12T18:12:15.511548+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'34","last_scrub_stamp":"2024-09-12T18:12:15.511396+0000","last_deep_scrub":"263'34","last_deep_scrub_stamp":"2024-09-12T18:12:15.511396+0000","last_clean_scrub_stamp":"2024-09-12T18:12:15.511396+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:16:09.172708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":161,"num_read_kb":109,"num_write":67,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"263'2","reported_seq":34,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:15.758583+0000","last_change":"2024-09-12T18:12:15.758583+0000","last_active":"2024-09-12T18:12:15.758583+0000","last_peered":"2024-09-12T18:12:15.758583+0000","last_clean":"2024-09-12T18:12:15.758583+0000","last_became_active":"2024-09-12T17:46:57.090581+0000","last_became_peered":"2024-09-12T17:46:57.090581+0000","last_unstale":"2024-09-12T18:12:15.758583+0000","last_undegraded":"2024-09-12T18:12:15.758583+0000","last_fullsized":"2024-09-12T18:12:15.758583+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T18:12:15.758494+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T18:12:15.758494+0000","last_clean_scrub_stamp":"2024-09-12T18:12:15.758494+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:09:12.754977+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"260'3","reported_seq":57,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:21.525649+0000","last_change":"2024-09-12T18:12:21.525649+0000","last_active":"2024-09-12T18:12:21.525649+0000","last_peered":"2024-09-12T18:12:21.525649+0000","last_clean":"2024-09-12T18:12:21.525649+0000","last_became_active":"2024-09-12T17:30:16.677428+0000","last_became_peered":"2024-09-12T17:30:16.677428+0000","last_unstale":"2024-09-12T18:12:21.525649+0000","last_undegraded":"2024-09-12T18:12:21.525649+0000","last_fullsized":"2024-09-12T18:12:21.525649+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'3","last_scrub_stamp":"2024-09-12T18:12:21.525552+0000","last_deep_scrub":"260'3","last_deep_scrub_stamp":"2024-09-12T18:12:21.525552+0000","last_clean_scrub_stamp":"2024-09-12T18:12:21.525552+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:59:26.387358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"263'6","reported_seq":68,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:25.484988+0000","last_change":"2024-09-12T18:12:25.484988+0000","last_active":"2024-09-12T18:12:25.484988+0000","last_peered":"2024-09-12T18:12:25.484988+0000","last_clean":"2024-09-12T18:12:25.484988+0000","last_became_active":"2024-09-12T17:30:12.644600+0000","last_became_peered":"2024-09-12T17:30:12.644600+0000","last_unstale":"2024-09-12T18:12:25.484988+0000","last_undegraded":"2024-09-12T18:12:25.484988+0000","last_fullsized":"2024-09-12T18:12:25.484988+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'6","last_scrub_stamp":"2024-09-12T18:12:25.484902+0000","last_deep_scrub":"263'6","last_deep_scrub_stamp":"2024-09-12T18:12:25.484902+0000","last_clean_scrub_stamp":"2024-09-12T18:12:25.484902+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:53:26.323510+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6144,"num_write":11,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"263'63","reported_seq":241,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:24.411880+0000","last_change":"2024-09-12T18:12:24.411785+0000","last_active":"2024-09-12T18:12:24.411880+0000","last_peered":"2024-09-12T18:12:24.411880+0000","last_clean":"2024-09-12T18:12:24.411880+0000","last_became_active":"2024-09-12T17:26:35.658630+0000","last_became_peered":"2024-09-12T17:26:35.658630+0000","last_unstale":"2024-09-12T18:12:24.411880+0000","last_undegraded":"2024-09-12T18:12:24.411880+0000","last_fullsized":"2024-09-12T18:12:24.411880+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'63","last_scrub_stamp":"2024-09-12T18:12:24.411691+0000","last_deep_scrub":"263'63","last_deep_scrub_stamp":"2024-09-12T18:12:24.411691+0000","last_clean_scrub_stamp":"2024-09-12T18:12:24.411691+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:24:29.577243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":336,"num_read_kb":235,"num_write":105,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":32,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:41.853221+0000","last_change":"2024-09-12T18:12:41.853221+0000","last_active":"2024-09-12T18:12:41.853221+0000","last_peered":"2024-09-12T18:12:41.853221+0000","last_clean":"2024-09-12T18:12:41.853221+0000","last_became_active":"2024-09-12T17:46:57.092472+0000","last_became_peered":"2024-09-12T17:46:57.092472+0000","last_unstale":"2024-09-12T18:12:41.853221+0000","last_undegraded":"2024-09-12T18:12:41.853221+0000","last_fullsized":"2024-09-12T18:12:41.853221+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:41.853124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:41.853124+0000","last_clean_scrub_stamp":"2024-09-12T18:12:41.853124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:12:24.119919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"0'0","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:29.421303+0000","last_change":"2024-09-12T18:12:29.421247+0000","last_active":"2024-09-12T18:12:29.421303+0000","last_peered":"2024-09-12T18:12:29.421303+0000","last_clean":"2024-09-12T18:12:29.421303+0000","last_became_active":"2024-09-12T17:30:16.675380+0000","last_became_peered":"2024-09-12T17:30:16.675380+0000","last_unstale":"2024-09-12T18:12:29.421303+0000","last_undegraded":"2024-09-12T18:12:29.421303+0000","last_fullsized":"2024-09-12T18:12:29.421303+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:29.421158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:29.421158+0000","last_clean_scrub_stamp":"2024-09-12T18:12:29.421158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:25:59.499092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"0'0","reported_seq":57,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:26.481990+0000","last_change":"2024-09-12T18:12:26.481990+0000","last_active":"2024-09-12T18:12:26.481990+0000","last_peered":"2024-09-12T18:12:26.481990+0000","last_clean":"2024-09-12T18:12:26.481990+0000","last_became_active":"2024-09-12T17:30:12.652368+0000","last_became_peered":"2024-09-12T17:30:12.652368+0000","last_unstale":"2024-09-12T18:12:26.481990+0000","last_undegraded":"2024-09-12T18:12:26.481990+0000","last_fullsized":"2024-09-12T18:12:26.481990+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:26.481900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:26.481900+0000","last_clean_scrub_stamp":"2024-09-12T18:12:26.481900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:51:44.532135+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"263'14","reported_seq":101,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:22.323445+0000","last_change":"2024-09-12T18:12:22.323379+0000","last_active":"2024-09-12T18:12:22.323445+0000","last_peered":"2024-09-12T18:12:22.323445+0000","last_clean":"2024-09-12T18:12:22.323445+0000","last_became_active":"2024-09-12T17:26:35.662029+0000","last_became_peered":"2024-09-12T17:26:35.662029+0000","last_unstale":"2024-09-12T18:12:22.323445+0000","last_undegraded":"2024-09-12T18:12:22.323445+0000","last_fullsized":"2024-09-12T18:12:22.323445+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'14","last_scrub_stamp":"2024-09-12T18:12:22.323289+0000","last_deep_scrub":"263'14","last_deep_scrub_stamp":"2024-09-12T18:12:22.323289+0000","last_clean_scrub_stamp":"2024-09-12T18:12:22.323289+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:47:18.514415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":47,"num_write":25,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":33,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:42.903067+0000","last_change":"2024-09-12T18:12:42.903067+0000","last_active":"2024-09-12T18:12:42.903067+0000","last_peered":"2024-09-12T18:12:42.903067+0000","last_clean":"2024-09-12T18:12:42.903067+0000","last_became_active":"2024-09-12T17:46:57.088577+0000","last_became_peered":"2024-09-12T17:46:57.088577+0000","last_unstale":"2024-09-12T18:12:42.903067+0000","last_undegraded":"2024-09-12T18:12:42.903067+0000","last_fullsized":"2024-09-12T18:12:42.903067+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:42.902976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:42.902976+0000","last_clean_scrub_stamp":"2024-09-12T18:12:42.902976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:15:41.252575+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"263'5","reported_seq":61,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:18.654230+0000","last_change":"2024-09-12T18:12:18.654230+0000","last_active":"2024-09-12T18:12:18.654230+0000","last_peered":"2024-09-12T18:12:18.654230+0000","last_clean":"2024-09-12T18:12:18.654230+0000","last_became_active":"2024-09-12T17:30:16.687560+0000","last_became_peered":"2024-09-12T17:30:16.687560+0000","last_unstale":"2024-09-12T18:12:18.654230+0000","last_undegraded":"2024-09-12T18:12:18.654230+0000","last_fullsized":"2024-09-12T18:12:18.654230+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'5","last_scrub_stamp":"2024-09-12T18:12:18.654153+0000","last_deep_scrub":"263'5","last_deep_scrub_stamp":"2024-09-12T18:12:18.654153+0000","last_clean_scrub_stamp":"2024-09-12T18:12:18.654153+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:46:55.281106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":15360,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"260'5","reported_seq":72,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:17.476656+0000","last_change":"2024-09-12T18:12:17.476656+0000","last_active":"2024-09-12T18:12:17.476656+0000","last_peered":"2024-09-12T18:12:17.476656+0000","last_clean":"2024-09-12T18:12:17.476656+0000","last_became_active":"2024-09-12T17:30:12.646002+0000","last_became_peered":"2024-09-12T17:30:12.646002+0000","last_unstale":"2024-09-12T18:12:17.476656+0000","last_undegraded":"2024-09-12T18:12:17.476656+0000","last_fullsized":"2024-09-12T18:12:17.476656+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'5","last_scrub_stamp":"2024-09-12T18:12:17.476540+0000","last_deep_scrub":"260'5","last_deep_scrub_stamp":"2024-09-12T18:12:17.476540+0000","last_clean_scrub_stamp":"2024-09-12T18:12:17.476540+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:48:06.819743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"263'38","reported_seq":171,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:11.616871+0000","last_change":"2024-09-12T18:12:11.616755+0000","last_active":"2024-09-12T18:12:11.616871+0000","last_peered":"2024-09-12T18:12:11.616871+0000","last_clean":"2024-09-12T18:12:11.616871+0000","last_became_active":"2024-09-12T17:26:35.664653+0000","last_became_peered":"2024-09-12T17:26:35.664653+0000","last_unstale":"2024-09-12T18:12:11.616871+0000","last_undegraded":"2024-09-12T18:12:11.616871+0000","last_fullsized":"2024-09-12T18:12:11.616871+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'38","last_scrub_stamp":"2024-09-12T18:12:11.616608+0000","last_deep_scrub":"263'38","last_deep_scrub_stamp":"2024-09-12T18:12:11.616608+0000","last_clean_scrub_stamp":"2024-09-12T18:12:11.616608+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:41:05.918325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":203,"num_read_kb":159,"num_write":60,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":33,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:37.436361+0000","last_change":"2024-09-12T18:12:37.436361+0000","last_active":"2024-09-12T18:12:37.436361+0000","last_peered":"2024-09-12T18:12:37.436361+0000","last_clean":"2024-09-12T18:12:37.436361+0000","last_became_active":"2024-09-12T17:46:57.091489+0000","last_became_peered":"2024-09-12T17:46:57.091489+0000","last_unstale":"2024-09-12T18:12:37.436361+0000","last_undegraded":"2024-09-12T18:12:37.436361+0000","last_fullsized":"2024-09-12T18:12:37.436361+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:37.436249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:37.436249+0000","last_clean_scrub_stamp":"2024-09-12T18:12:37.436249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:04:14.746893+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"263'2","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:29.360574+0000","last_change":"2024-09-12T18:12:29.360574+0000","last_active":"2024-09-12T18:12:29.360574+0000","last_peered":"2024-09-12T18:12:29.360574+0000","last_clean":"2024-09-12T18:12:29.360574+0000","last_became_active":"2024-09-12T17:30:16.671126+0000","last_became_peered":"2024-09-12T17:30:16.671126+0000","last_unstale":"2024-09-12T18:12:29.360574+0000","last_undegraded":"2024-09-12T18:12:29.360574+0000","last_fullsized":"2024-09-12T18:12:29.360574+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T18:12:29.360472+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T18:12:29.360472+0000","last_clean_scrub_stamp":"2024-09-12T18:12:29.360472+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:17:20.676962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":48,"num_write":2,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"260'3","reported_seq":63,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:16.609368+0000","last_change":"2024-09-12T18:12:16.609368+0000","last_active":"2024-09-12T18:12:16.609368+0000","last_peered":"2024-09-12T18:12:16.609368+0000","last_clean":"2024-09-12T18:12:16.609368+0000","last_became_active":"2024-09-12T17:30:12.645099+0000","last_became_peered":"2024-09-12T17:30:12.645099+0000","last_unstale":"2024-09-12T18:12:16.609368+0000","last_undegraded":"2024-09-12T18:12:16.609368+0000","last_fullsized":"2024-09-12T18:12:16.609368+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'3","last_scrub_stamp":"2024-09-12T18:12:16.609282+0000","last_deep_scrub":"260'3","last_deep_scrub_stamp":"2024-09-12T18:12:16.609282+0000","last_clean_scrub_stamp":"2024-09-12T18:12:16.609282+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:11:33.924154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"263'42","reported_seq":176,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:21.512810+0000","last_change":"2024-09-12T18:12:21.512736+0000","last_active":"2024-09-12T18:12:21.512810+0000","last_peered":"2024-09-12T18:12:21.512810+0000","last_clean":"2024-09-12T18:12:21.512810+0000","last_became_active":"2024-09-12T17:26:35.665804+0000","last_became_peered":"2024-09-12T17:26:35.665804+0000","last_unstale":"2024-09-12T18:12:21.512810+0000","last_undegraded":"2024-09-12T18:12:21.512810+0000","last_fullsized":"2024-09-12T18:12:21.512810+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'42","last_scrub_stamp":"2024-09-12T18:12:21.512648+0000","last_deep_scrub":"263'42","last_deep_scrub_stamp":"2024-09-12T18:12:21.512648+0000","last_clean_scrub_stamp":"2024-09-12T18:12:21.512648+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:22:38.597683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":202,"num_read_kb":139,"num_write":84,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"263'208","reported_seq":819,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:00.542681+0000","last_change":"2024-09-12T18:12:00.542681+0000","last_active":"2024-09-12T18:12:00.542681+0000","last_peered":"2024-09-12T18:12:00.542681+0000","last_clean":"2024-09-12T18:12:00.542681+0000","last_became_active":"2024-09-12T17:10:42.523450+0000","last_became_peered":"2024-09-12T17:10:42.523450+0000","last_unstale":"2024-09-12T18:12:00.542681+0000","last_undegraded":"2024-09-12T18:12:00.542681+0000","last_fullsized":"2024-09-12T18:12:00.542681+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'208","last_scrub_stamp":"2024-09-12T18:12:00.542555+0000","last_deep_scrub":"263'208","last_deep_scrub_stamp":"2024-09-12T18:12:00.542555+0000","last_clean_scrub_stamp":"2024-09-12T18:12:00.542555+0000","objects_scrubbed":4,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:08:21.396379+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2159819,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":364,"num_read_kb":12797,"num_write":994,"num_write_kb":38748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0,5],"acting":[7,6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"263'415","reported_seq":1937,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:58.360923+0000","last_change":"2024-09-12T18:11:58.360923+0000","last_active":"2024-09-12T18:11:58.360923+0000","last_peered":"2024-09-12T18:11:58.360923+0000","last_clean":"2024-09-12T18:11:58.360923+0000","last_became_active":"2024-09-12T17:10:44.521072+0000","last_became_peered":"2024-09-12T17:10:44.521072+0000","last_unstale":"2024-09-12T18:11:58.360923+0000","last_undegraded":"2024-09-12T18:11:58.360923+0000","last_fullsized":"2024-09-12T18:11:58.360923+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'415","last_scrub_stamp":"2024-09-12T18:11:58.360809+0000","last_deep_scrub":"263'415","last_deep_scrub_stamp":"2024-09-12T18:11:58.360809+0000","last_clean_scrub_stamp":"2024-09-12T18:11:58.360809+0000","objects_scrubbed":7,"log_size":15,"log_dups_size":400,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:24:00.846126+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2237,"num_read_kb":2119,"num_write":474,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1856,"num_omap_keys":8,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"263'162","reported_seq":806,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:51.665824+0000","last_change":"2024-09-12T18:11:51.665824+0000","last_active":"2024-09-12T18:11:51.665824+0000","last_peered":"2024-09-12T18:11:51.665824+0000","last_clean":"2024-09-12T18:11:51.665824+0000","last_became_active":"2024-09-12T17:10:42.515714+0000","last_became_peered":"2024-09-12T17:10:42.515714+0000","last_unstale":"2024-09-12T18:11:51.665824+0000","last_undegraded":"2024-09-12T18:11:51.665824+0000","last_fullsized":"2024-09-12T18:11:51.665824+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'162","last_scrub_stamp":"2024-09-12T18:11:51.665727+0000","last_deep_scrub":"263'162","last_deep_scrub_stamp":"2024-09-12T18:11:51.665727+0000","last_clean_scrub_stamp":"2024-09-12T18:11:51.665727+0000","objects_scrubbed":1,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:41:53.425835+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32998,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":410,"num_read_kb":24642,"num_write":804,"num_write_kb":5824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6,4],"acting":[1,0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"263'569","reported_seq":2045,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:04.589219+0000","last_change":"2024-09-12T18:12:04.589219+0000","last_active":"2024-09-12T18:12:04.589219+0000","last_peered":"2024-09-12T18:12:04.589219+0000","last_clean":"2024-09-12T18:12:04.589219+0000","last_became_active":"2024-09-12T17:10:44.520662+0000","last_became_peered":"2024-09-12T17:10:44.520662+0000","last_unstale":"2024-09-12T18:12:04.589219+0000","last_undegraded":"2024-09-12T18:12:04.589219+0000","last_fullsized":"2024-09-12T18:12:04.589219+0000","mapping_epoch":26,"log_start":"263'500","ondisk_log_start":"263'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'569","last_scrub_stamp":"2024-09-12T18:12:04.589126+0000","last_deep_scrub":"263'569","last_deep_scrub_stamp":"2024-09-12T18:12:04.589126+0000","last_clean_scrub_stamp":"2024-09-12T18:12:04.589126+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":500,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:21:58.586995+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2846,"num_read_kb":2568,"num_write":745,"num_write_kb":247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"263'196","reported_seq":890,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:52.688218+0000","last_change":"2024-09-12T18:11:52.688218+0000","last_active":"2024-09-12T18:11:52.688218+0000","last_peered":"2024-09-12T18:11:52.688218+0000","last_clean":"2024-09-12T18:11:52.688218+0000","last_became_active":"2024-09-12T17:10:42.514502+0000","last_became_peered":"2024-09-12T17:10:42.514502+0000","last_unstale":"2024-09-12T18:11:52.688218+0000","last_undegraded":"2024-09-12T18:11:52.688218+0000","last_fullsized":"2024-09-12T18:11:52.688218+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'196","last_scrub_stamp":"2024-09-12T18:11:52.688106+0000","last_deep_scrub":"263'196","last_deep_scrub_stamp":"2024-09-12T18:11:52.688106+0000","last_clean_scrub_stamp":"2024-09-12T18:11:52.688106+0000","objects_scrubbed":4,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:28:08.638670+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":373080,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":506,"num_read_kb":116995,"num_write":945,"num_write_kb":47431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,7],"acting":[0,2,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"263'513","reported_seq":2203,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:03.347220+0000","last_change":"2024-09-12T18:12:03.347220+0000","last_active":"2024-09-12T18:12:03.347220+0000","last_peered":"2024-09-12T18:12:03.347220+0000","last_clean":"2024-09-12T18:12:03.347220+0000","last_became_active":"2024-09-12T17:10:44.515053+0000","last_became_peered":"2024-09-12T17:10:44.515053+0000","last_unstale":"2024-09-12T18:12:03.347220+0000","last_undegraded":"2024-09-12T18:12:03.347220+0000","last_fullsized":"2024-09-12T18:12:03.347220+0000","mapping_epoch":26,"log_start":"263'501","ondisk_log_start":"263'501","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'513","last_scrub_stamp":"2024-09-12T18:12:03.347112+0000","last_deep_scrub":"263'513","last_deep_scrub_stamp":"2024-09-12T18:12:03.347112+0000","last_clean_scrub_stamp":"2024-09-12T18:12:03.347112+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":501,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:41:45.556810+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2823,"num_read_kb":2642,"num_write":595,"num_write_kb":151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2296,"num_omap_keys":9,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"263'186","reported_seq":819,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:59.404105+0000","last_change":"2024-09-12T18:11:59.404105+0000","last_active":"2024-09-12T18:11:59.404105+0000","last_peered":"2024-09-12T18:11:59.404105+0000","last_clean":"2024-09-12T18:11:59.404105+0000","last_became_active":"2024-09-12T17:10:42.515202+0000","last_became_peered":"2024-09-12T17:10:42.515202+0000","last_unstale":"2024-09-12T18:11:59.404105+0000","last_undegraded":"2024-09-12T18:11:59.404105+0000","last_fullsized":"2024-09-12T18:11:59.404105+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'186","last_scrub_stamp":"2024-09-12T18:11:59.403938+0000","last_deep_scrub":"263'186","last_deep_scrub_stamp":"2024-09-12T18:11:59.403938+0000","last_clean_scrub_stamp":"2024-09-12T18:11:59.403938+0000","objects_scrubbed":4,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:01:41.301225+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":568149,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":399,"num_read_kb":32737,"num_write":933,"num_write_kb":40819,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7,2],"acting":[5,3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"263'479","reported_seq":2065,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:01.687961+0000","last_change":"2024-09-12T18:12:01.687961+0000","last_active":"2024-09-12T18:12:01.687961+0000","last_peered":"2024-09-12T18:12:01.687961+0000","last_clean":"2024-09-12T18:12:01.687961+0000","last_became_active":"2024-09-12T17:10:44.523767+0000","last_became_peered":"2024-09-12T17:10:44.523767+0000","last_unstale":"2024-09-12T18:12:01.687961+0000","last_undegraded":"2024-09-12T18:12:01.687961+0000","last_fullsized":"2024-09-12T18:12:01.687961+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'479","last_scrub_stamp":"2024-09-12T18:12:01.687869+0000","last_deep_scrub":"263'479","last_deep_scrub_stamp":"2024-09-12T18:12:01.687869+0000","last_clean_scrub_stamp":"2024-09-12T18:12:01.687869+0000","objects_scrubbed":2,"log_size":79,"log_dups_size":400,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:06:43.686298+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2572,"num_read_kb":2417,"num_write":590,"num_write_kb":142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":254,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"263'159","reported_seq":798,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:59.549642+0000","last_change":"2024-09-12T18:11:59.549642+0000","last_active":"2024-09-12T18:11:59.549642+0000","last_peered":"2024-09-12T18:11:59.549642+0000","last_clean":"2024-09-12T18:11:59.549642+0000","last_became_active":"2024-09-12T17:10:42.523427+0000","last_became_peered":"2024-09-12T17:10:42.523427+0000","last_unstale":"2024-09-12T18:11:59.549642+0000","last_undegraded":"2024-09-12T18:11:59.549642+0000","last_fullsized":"2024-09-12T18:11:59.549642+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'159","last_scrub_stamp":"2024-09-12T18:11:59.549547+0000","last_deep_scrub":"263'159","last_deep_scrub_stamp":"2024-09-12T18:11:59.549547+0000","last_clean_scrub_stamp":"2024-09-12T18:11:59.549547+0000","objects_scrubbed":1,"log_size":59,"log_dups_size":100,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:28:15.459977+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":439,"num_read_kb":36335,"num_write":769,"num_write_kb":30424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3,6],"acting":[7,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"263'478","reported_seq":1970,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:58.695565+0000","last_change":"2024-09-12T18:11:58.695565+0000","last_active":"2024-09-12T18:11:58.695565+0000","last_peered":"2024-09-12T18:11:58.695565+0000","last_clean":"2024-09-12T18:11:58.695565+0000","last_became_active":"2024-09-12T17:10:44.510692+0000","last_became_peered":"2024-09-12T17:10:44.510692+0000","last_unstale":"2024-09-12T18:11:58.695565+0000","last_undegraded":"2024-09-12T18:11:58.695565+0000","last_fullsized":"2024-09-12T18:11:58.695565+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'478","last_scrub_stamp":"2024-09-12T18:11:58.695474+0000","last_deep_scrub":"263'478","last_deep_scrub_stamp":"2024-09-12T18:11:58.695474+0000","last_clean_scrub_stamp":"2024-09-12T18:11:58.695474+0000","objects_scrubbed":3,"log_size":78,"log_dups_size":400,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:52:06.977144+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2639,"num_read_kb":2478,"num_write":625,"num_write_kb":223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"263'191","reported_seq":825,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:05.484339+0000","last_change":"2024-09-12T18:12:05.484339+0000","last_active":"2024-09-12T18:12:05.484339+0000","last_peered":"2024-09-12T18:12:05.484339+0000","last_clean":"2024-09-12T18:12:05.484339+0000","last_became_active":"2024-09-12T17:10:42.525363+0000","last_became_peered":"2024-09-12T17:10:42.525363+0000","last_unstale":"2024-09-12T18:12:05.484339+0000","last_undegraded":"2024-09-12T18:12:05.484339+0000","last_fullsized":"2024-09-12T18:12:05.484339+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'191","last_scrub_stamp":"2024-09-12T18:12:05.484216+0000","last_deep_scrub":"263'191","last_deep_scrub_stamp":"2024-09-12T18:12:05.484216+0000","last_clean_scrub_stamp":"2024-09-12T18:12:05.484216+0000","objects_scrubbed":2,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:44:31.631500+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":412,"num_read_kb":34311,"num_write":954,"num_write_kb":12654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,4,1],"acting":[5,0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"263'881","reported_seq":2669,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:05.371197+0000","last_change":"2024-09-12T18:12:05.371197+0000","last_active":"2024-09-12T18:12:05.371197+0000","last_peered":"2024-09-12T18:12:05.371197+0000","last_clean":"2024-09-12T18:12:05.371197+0000","last_became_active":"2024-09-12T17:10:44.513865+0000","last_became_peered":"2024-09-12T17:10:44.513865+0000","last_unstale":"2024-09-12T18:12:05.371197+0000","last_undegraded":"2024-09-12T18:12:05.371197+0000","last_fullsized":"2024-09-12T18:12:05.371197+0000","mapping_epoch":26,"log_start":"263'800","ondisk_log_start":"263'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'881","last_scrub_stamp":"2024-09-12T18:12:05.371101+0000","last_deep_scrub":"263'881","last_deep_scrub_stamp":"2024-09-12T18:12:05.371101+0000","last_clean_scrub_stamp":"2024-09-12T18:12:05.371101+0000","objects_scrubbed":6,"log_size":81,"log_dups_size":800,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:17:06.281251+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4549,"num_read_kb":4126,"num_write":1137,"num_write_kb":421,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4852,"num_omap_keys":19,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"263'191","reported_seq":997,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:57.497338+0000","last_change":"2024-09-12T18:11:57.497338+0000","last_active":"2024-09-12T18:11:57.497338+0000","last_peered":"2024-09-12T18:11:57.497338+0000","last_clean":"2024-09-12T18:11:57.497338+0000","last_became_active":"2024-09-12T17:10:42.531356+0000","last_became_peered":"2024-09-12T17:10:42.531356+0000","last_unstale":"2024-09-12T18:11:57.497338+0000","last_undegraded":"2024-09-12T18:11:57.497338+0000","last_fullsized":"2024-09-12T18:11:57.497338+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'191","last_scrub_stamp":"2024-09-12T18:11:57.497214+0000","last_deep_scrub":"263'191","last_deep_scrub_stamp":"2024-09-12T18:11:57.497214+0000","last_clean_scrub_stamp":"2024-09-12T18:11:57.497214+0000","objects_scrubbed":6,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:44:43.318908+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":115,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":751,"num_read_kb":2366,"num_write":954,"num_write_kb":15239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4,6],"acting":[7,0,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"263'411","reported_seq":1935,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:06.455513+0000","last_change":"2024-09-12T18:12:06.455513+0000","last_active":"2024-09-12T18:12:06.455513+0000","last_peered":"2024-09-12T18:12:06.455513+0000","last_clean":"2024-09-12T18:12:06.455513+0000","last_became_active":"2024-09-12T17:10:44.520609+0000","last_became_peered":"2024-09-12T17:10:44.520609+0000","last_unstale":"2024-09-12T18:12:06.455513+0000","last_undegraded":"2024-09-12T18:12:06.455513+0000","last_fullsized":"2024-09-12T18:12:06.455513+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'411","last_scrub_stamp":"2024-09-12T18:12:06.455433+0000","last_deep_scrub":"263'411","last_deep_scrub_stamp":"2024-09-12T18:12:06.455433+0000","last_clean_scrub_stamp":"2024-09-12T18:12:06.455433+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":400,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:56:48.523620+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2177,"num_read_kb":2069,"num_write":470,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"263'212","reported_seq":854,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:00.692167+0000","last_change":"2024-09-12T18:12:00.692167+0000","last_active":"2024-09-12T18:12:00.692167+0000","last_peered":"2024-09-12T18:12:00.692167+0000","last_clean":"2024-09-12T18:12:00.692167+0000","last_became_active":"2024-09-12T17:10:42.527310+0000","last_became_peered":"2024-09-12T17:10:42.527310+0000","last_unstale":"2024-09-12T18:12:00.692167+0000","last_undegraded":"2024-09-12T18:12:00.692167+0000","last_fullsized":"2024-09-12T18:12:00.692167+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'212","last_scrub_stamp":"2024-09-12T18:12:00.692062+0000","last_deep_scrub":"263'212","last_deep_scrub_stamp":"2024-09-12T18:12:00.692062+0000","last_clean_scrub_stamp":"2024-09-12T18:12:00.692062+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:26:48.984760+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174892,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":472,"num_read_kb":11982,"num_write":996,"num_write_kb":39362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0,2],"acting":[3,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"263'806","reported_seq":2480,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:54.804326+0000","last_change":"2024-09-12T18:11:54.804326+0000","last_active":"2024-09-12T18:11:54.804326+0000","last_peered":"2024-09-12T18:11:54.804326+0000","last_clean":"2024-09-12T18:11:54.804326+0000","last_became_active":"2024-09-12T17:10:44.517947+0000","last_became_peered":"2024-09-12T17:10:44.517947+0000","last_unstale":"2024-09-12T18:11:54.804326+0000","last_undegraded":"2024-09-12T18:11:54.804326+0000","last_fullsized":"2024-09-12T18:11:54.804326+0000","mapping_epoch":26,"log_start":"263'700","ondisk_log_start":"263'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'806","last_scrub_stamp":"2024-09-12T18:11:54.804222+0000","last_deep_scrub":"263'806","last_deep_scrub_stamp":"2024-09-12T18:11:54.804222+0000","last_clean_scrub_stamp":"2024-09-12T18:11:54.804222+0000","objects_scrubbed":3,"log_size":106,"log_dups_size":700,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:45:37.385194+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3878,"num_read_kb":3536,"num_write":1022,"num_write_kb":342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"263'408","reported_seq":2034,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:02.306451+0000","last_change":"2024-09-12T18:12:02.306451+0000","last_active":"2024-09-12T18:12:02.306451+0000","last_peered":"2024-09-12T18:12:02.306451+0000","last_clean":"2024-09-12T18:12:02.306451+0000","last_became_active":"2024-09-12T17:10:44.514293+0000","last_became_peered":"2024-09-12T17:10:44.514293+0000","last_unstale":"2024-09-12T18:12:02.306451+0000","last_undegraded":"2024-09-12T18:12:02.306451+0000","last_fullsized":"2024-09-12T18:12:02.306451+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'408","last_scrub_stamp":"2024-09-12T18:12:02.306349+0000","last_deep_scrub":"263'408","last_deep_scrub_stamp":"2024-09-12T18:12:02.306349+0000","last_clean_scrub_stamp":"2024-09-12T18:12:02.306349+0000","objects_scrubbed":2,"log_size":108,"log_dups_size":300,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:44:20.245957+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2470,"num_read_kb":2366,"num_write":468,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":694,"num_omap_keys":3,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"263'164","reported_seq":785,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:56.470083+0000","last_change":"2024-09-12T18:11:56.470083+0000","last_active":"2024-09-12T18:11:56.470083+0000","last_peered":"2024-09-12T18:11:56.470083+0000","last_clean":"2024-09-12T18:11:56.470083+0000","last_became_active":"2024-09-12T17:10:42.521637+0000","last_became_peered":"2024-09-12T17:10:42.521637+0000","last_unstale":"2024-09-12T18:11:56.470083+0000","last_undegraded":"2024-09-12T18:11:56.470083+0000","last_fullsized":"2024-09-12T18:11:56.470083+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'164","last_scrub_stamp":"2024-09-12T18:11:56.469937+0000","last_deep_scrub":"263'164","last_deep_scrub_stamp":"2024-09-12T18:11:56.469937+0000","last_clean_scrub_stamp":"2024-09-12T18:11:56.469937+0000","objects_scrubbed":5,"log_size":64,"log_dups_size":100,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:47:38.556900+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":432508,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":446,"num_read_kb":17329,"num_write":806,"num_write_kb":49238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0,1],"acting":[7,5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"263'785","reported_seq":2287,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:03.615335+0000","last_change":"2024-09-12T18:12:03.615335+0000","last_active":"2024-09-12T18:12:03.615335+0000","last_peered":"2024-09-12T18:12:03.615335+0000","last_clean":"2024-09-12T18:12:03.615335+0000","last_became_active":"2024-09-12T17:10:44.521031+0000","last_became_peered":"2024-09-12T17:10:44.521031+0000","last_unstale":"2024-09-12T18:12:03.615335+0000","last_undegraded":"2024-09-12T18:12:03.615335+0000","last_fullsized":"2024-09-12T18:12:03.615335+0000","mapping_epoch":26,"log_start":"263'700","ondisk_log_start":"263'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'785","last_scrub_stamp":"2024-09-12T18:12:03.615200+0000","last_deep_scrub":"263'785","last_deep_scrub_stamp":"2024-09-12T18:12:03.615200+0000","last_clean_scrub_stamp":"2024-09-12T18:12:03.615200+0000","objects_scrubbed":3,"log_size":85,"log_dups_size":700,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:57:53.084717+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3604,"num_read_kb":3242,"num_write":1018,"num_write_kb":360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"263'259","reported_seq":960,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:53.798419+0000","last_change":"2024-09-12T18:11:53.798419+0000","last_active":"2024-09-12T18:11:53.798419+0000","last_peered":"2024-09-12T18:11:53.798419+0000","last_clean":"2024-09-12T18:11:53.798419+0000","last_became_active":"2024-09-12T17:10:42.517679+0000","last_became_peered":"2024-09-12T17:10:42.517679+0000","last_unstale":"2024-09-12T18:11:53.798419+0000","last_undegraded":"2024-09-12T18:11:53.798419+0000","last_fullsized":"2024-09-12T18:11:53.798419+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'259","last_scrub_stamp":"2024-09-12T18:11:53.798287+0000","last_deep_scrub":"263'259","last_deep_scrub_stamp":"2024-09-12T18:11:53.798287+0000","last_clean_scrub_stamp":"2024-09-12T18:11:53.798287+0000","objects_scrubbed":4,"log_size":59,"log_dups_size":200,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:05.021160+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1604218,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":855,"num_read_kb":4303,"num_write":1129,"num_write_kb":28670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2,1],"acting":[6,5,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"263'359","reported_seq":1821,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:01.415160+0000","last_change":"2024-09-12T18:12:01.415160+0000","last_active":"2024-09-12T18:12:01.415160+0000","last_peered":"2024-09-12T18:12:01.415160+0000","last_clean":"2024-09-12T18:12:01.415160+0000","last_became_active":"2024-09-12T17:10:44.518183+0000","last_became_peered":"2024-09-12T17:10:44.518183+0000","last_unstale":"2024-09-12T18:12:01.415160+0000","last_undegraded":"2024-09-12T18:12:01.415160+0000","last_fullsized":"2024-09-12T18:12:01.415160+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'359","last_scrub_stamp":"2024-09-12T18:12:01.415072+0000","last_deep_scrub":"263'359","last_deep_scrub_stamp":"2024-09-12T18:12:01.415072+0000","last_clean_scrub_stamp":"2024-09-12T18:12:01.415072+0000","objects_scrubbed":1,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:05:01.730803+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1979,"num_read_kb":1899,"num_write":385,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"263'232","reported_seq":961,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:52.832302+0000","last_change":"2024-09-12T18:11:52.832302+0000","last_active":"2024-09-12T18:11:52.832302+0000","last_peered":"2024-09-12T18:11:52.832302+0000","last_clean":"2024-09-12T18:11:52.832302+0000","last_became_active":"2024-09-12T17:10:42.518345+0000","last_became_peered":"2024-09-12T17:10:42.518345+0000","last_unstale":"2024-09-12T18:11:52.832302+0000","last_undegraded":"2024-09-12T18:11:52.832302+0000","last_fullsized":"2024-09-12T18:11:52.832302+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'232","last_scrub_stamp":"2024-09-12T18:11:52.832185+0000","last_deep_scrub":"263'232","last_deep_scrub_stamp":"2024-09-12T18:11:52.832185+0000","last_clean_scrub_stamp":"2024-09-12T18:11:52.832185+0000","objects_scrubbed":5,"log_size":32,"log_dups_size":200,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:43:54.965686+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1367925,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":646,"num_read_kb":98876,"num_write":1054,"num_write_kb":25289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0,3],"acting":[6,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"263'518","reported_seq":2158,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:57.757617+0000","last_change":"2024-09-12T18:11:57.757617+0000","last_active":"2024-09-12T18:11:57.757617+0000","last_peered":"2024-09-12T18:11:57.757617+0000","last_clean":"2024-09-12T18:11:57.757617+0000","last_became_active":"2024-09-12T17:10:44.514645+0000","last_became_peered":"2024-09-12T17:10:44.514645+0000","last_unstale":"2024-09-12T18:11:57.757617+0000","last_undegraded":"2024-09-12T18:11:57.757617+0000","last_fullsized":"2024-09-12T18:11:57.757617+0000","mapping_epoch":26,"log_start":"263'500","ondisk_log_start":"263'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'518","last_scrub_stamp":"2024-09-12T18:11:57.757537+0000","last_deep_scrub":"263'518","last_deep_scrub_stamp":"2024-09-12T18:11:57.757537+0000","last_clean_scrub_stamp":"2024-09-12T18:11:57.757537+0000","objects_scrubbed":2,"log_size":18,"log_dups_size":500,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:17:09.508445+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2725,"num_read_kb":2548,"num_write":623,"num_write_kb":175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":640,"num_omap_keys":3,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"263'215","reported_seq":882,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:50.441705+0000","last_change":"2024-09-12T18:11:50.441705+0000","last_active":"2024-09-12T18:11:50.441705+0000","last_peered":"2024-09-12T18:11:50.441705+0000","last_clean":"2024-09-12T18:11:50.441705+0000","last_became_active":"2024-09-12T17:10:42.519000+0000","last_became_peered":"2024-09-12T17:10:42.519000+0000","last_unstale":"2024-09-12T18:11:50.441705+0000","last_undegraded":"2024-09-12T18:11:50.441705+0000","last_fullsized":"2024-09-12T18:11:50.441705+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'215","last_scrub_stamp":"2024-09-12T18:11:50.441568+0000","last_deep_scrub":"263'215","last_deep_scrub_stamp":"2024-09-12T18:11:50.441568+0000","last_clean_scrub_stamp":"2024-09-12T18:11:50.441568+0000","objects_scrubbed":4,"log_size":15,"log_dups_size":200,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:10:24.946801+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":516496,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":502,"num_read_kb":33700,"num_write":932,"num_write_kb":23229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,0],"acting":[4,3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"263'1586","reported_seq":3120,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:58.740833+0000","last_change":"2024-09-12T18:11:58.740833+0000","last_active":"2024-09-12T18:11:58.740833+0000","last_peered":"2024-09-12T18:11:58.740833+0000","last_clean":"2024-09-12T18:11:58.740833+0000","last_became_active":"2024-09-12T17:10:44.514826+0000","last_became_peered":"2024-09-12T17:10:44.514826+0000","last_unstale":"2024-09-12T18:11:58.740833+0000","last_undegraded":"2024-09-12T18:11:58.740833+0000","last_fullsized":"2024-09-12T18:11:58.740833+0000","mapping_epoch":26,"log_start":"263'1500","ondisk_log_start":"263'1500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1586","last_scrub_stamp":"2024-09-12T18:11:58.740747+0000","last_deep_scrub":"263'1586","last_deep_scrub_stamp":"2024-09-12T18:11:58.740747+0000","last_clean_scrub_stamp":"2024-09-12T18:11:58.740747+0000","objects_scrubbed":3,"log_size":86,"log_dups_size":1500,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:47:04.467281+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6865,"num_read_kb":5951,"num_write":2206,"num_write_kb":956,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":946,"num_omap_keys":4,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"263'244","reported_seq":908,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:55.609090+0000","last_change":"2024-09-12T18:11:55.609090+0000","last_active":"2024-09-12T18:11:55.609090+0000","last_peered":"2024-09-12T18:11:55.609090+0000","last_clean":"2024-09-12T18:11:55.609090+0000","last_became_active":"2024-09-12T17:10:42.532995+0000","last_became_peered":"2024-09-12T17:10:42.532995+0000","last_unstale":"2024-09-12T18:11:55.609090+0000","last_undegraded":"2024-09-12T18:11:55.609090+0000","last_fullsized":"2024-09-12T18:11:55.609090+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'244","last_scrub_stamp":"2024-09-12T18:11:55.608942+0000","last_deep_scrub":"263'244","last_deep_scrub_stamp":"2024-09-12T18:11:55.608942+0000","last_clean_scrub_stamp":"2024-09-12T18:11:55.608942+0000","objects_scrubbed":6,"log_size":44,"log_dups_size":200,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:30:38.928542+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":786501,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":539,"num_read_kb":13123,"num_write":1227,"num_write_kb":39413,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1,5],"acting":[3,6,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"263'1290","reported_seq":3025,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:04.359170+0000","last_change":"2024-09-12T18:12:04.359170+0000","last_active":"2024-09-12T18:12:04.359170+0000","last_peered":"2024-09-12T18:12:04.359170+0000","last_clean":"2024-09-12T18:12:04.359170+0000","last_became_active":"2024-09-12T17:10:44.507428+0000","last_became_peered":"2024-09-12T17:10:44.507428+0000","last_unstale":"2024-09-12T18:12:04.359170+0000","last_undegraded":"2024-09-12T18:12:04.359170+0000","last_fullsized":"2024-09-12T18:12:04.359170+0000","mapping_epoch":26,"log_start":"263'1200","ondisk_log_start":"263'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1290","last_scrub_stamp":"2024-09-12T18:12:04.359076+0000","last_deep_scrub":"263'1290","last_deep_scrub_stamp":"2024-09-12T18:12:04.359076+0000","last_clean_scrub_stamp":"2024-09-12T18:12:04.359076+0000","objects_scrubbed":2,"log_size":90,"log_dups_size":1200,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:25:36.918661+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5933,"num_read_kb":5245,"num_write":1814,"num_write_kb":777,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"263'185","reported_seq":871,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:53.698211+0000","last_change":"2024-09-12T18:11:53.698211+0000","last_active":"2024-09-12T18:11:53.698211+0000","last_peered":"2024-09-12T18:11:53.698211+0000","last_clean":"2024-09-12T18:11:53.698211+0000","last_became_active":"2024-09-12T17:10:42.529179+0000","last_became_peered":"2024-09-12T17:10:42.529179+0000","last_unstale":"2024-09-12T18:11:53.698211+0000","last_undegraded":"2024-09-12T18:11:53.698211+0000","last_fullsized":"2024-09-12T18:11:53.698211+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'185","last_scrub_stamp":"2024-09-12T18:11:53.698095+0000","last_deep_scrub":"263'185","last_deep_scrub_stamp":"2024-09-12T18:11:53.698095+0000","last_clean_scrub_stamp":"2024-09-12T18:11:53.698095+0000","objects_scrubbed":5,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:03:54.556628+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":576011,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":570,"num_read_kb":13539,"num_write":907,"num_write_kb":25869,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1,5],"acting":[0,4,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"263'163","reported_seq":692,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:20.320264+0000","last_change":"2024-09-12T18:12:20.320264+0000","last_active":"2024-09-12T18:12:20.320264+0000","last_peered":"2024-09-12T18:12:20.320264+0000","last_clean":"2024-09-12T18:12:20.320264+0000","last_became_active":"2024-09-12T17:10:52.566079+0000","last_became_peered":"2024-09-12T17:10:52.566079+0000","last_unstale":"2024-09-12T18:12:20.320264+0000","last_undegraded":"2024-09-12T18:12:20.320264+0000","last_fullsized":"2024-09-12T18:12:20.320264+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'163","last_scrub_stamp":"2024-09-12T18:12:20.320167+0000","last_deep_scrub":"263'163","last_deep_scrub_stamp":"2024-09-12T18:12:20.320167+0000","last_clean_scrub_stamp":"2024-09-12T18:12:20.320167+0000","objects_scrubbed":4,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:08:43.569628+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":803,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":269,"num_read_kb":255,"num_write":425,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"263'796","reported_seq":2412,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:56.605309+0000","last_change":"2024-09-12T18:11:56.605309+0000","last_active":"2024-09-12T18:11:56.605309+0000","last_peered":"2024-09-12T18:11:56.605309+0000","last_clean":"2024-09-12T18:11:56.605309+0000","last_became_active":"2024-09-12T17:10:44.522193+0000","last_became_peered":"2024-09-12T17:10:44.522193+0000","last_unstale":"2024-09-12T18:11:56.605309+0000","last_undegraded":"2024-09-12T18:11:56.605309+0000","last_fullsized":"2024-09-12T18:11:56.605309+0000","mapping_epoch":26,"log_start":"263'700","ondisk_log_start":"263'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'796","last_scrub_stamp":"2024-09-12T18:11:56.605227+0000","last_deep_scrub":"263'796","last_deep_scrub_stamp":"2024-09-12T18:11:56.605227+0000","last_clean_scrub_stamp":"2024-09-12T18:11:56.605227+0000","objects_scrubbed":1,"log_size":96,"log_dups_size":700,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:30:29.129454+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3748,"num_read_kb":3407,"num_write":1044,"num_write_kb":360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"263'203","reported_seq":853,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:55.485587+0000","last_change":"2024-09-12T18:11:55.485587+0000","last_active":"2024-09-12T18:11:55.485587+0000","last_peered":"2024-09-12T18:11:55.485587+0000","last_clean":"2024-09-12T18:11:55.485587+0000","last_became_active":"2024-09-12T17:10:42.528620+0000","last_became_peered":"2024-09-12T17:10:42.528620+0000","last_unstale":"2024-09-12T18:11:55.485587+0000","last_undegraded":"2024-09-12T18:11:55.485587+0000","last_fullsized":"2024-09-12T18:11:55.485587+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'203","last_scrub_stamp":"2024-09-12T18:11:55.485439+0000","last_deep_scrub":"263'203","last_deep_scrub_stamp":"2024-09-12T18:11:55.485439+0000","last_clean_scrub_stamp":"2024-09-12T18:11:55.485439+0000","objects_scrubbed":4,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:14:56.174736+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262203,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":497,"num_read_kb":31268,"num_write":1015,"num_write_kb":14227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4,2],"acting":[7,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:07.454862+0000","last_change":"2024-09-12T18:12:07.454862+0000","last_active":"2024-09-12T18:12:07.454862+0000","last_peered":"2024-09-12T18:12:07.454862+0000","last_clean":"2024-09-12T18:12:07.454862+0000","last_became_active":"2024-09-12T17:10:46.527663+0000","last_became_peered":"2024-09-12T17:10:46.527663+0000","last_unstale":"2024-09-12T18:12:07.454862+0000","last_undegraded":"2024-09-12T18:12:07.454862+0000","last_fullsized":"2024-09-12T18:12:07.454862+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:07.454758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:07.454758+0000","last_clean_scrub_stamp":"2024-09-12T18:12:07.454758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:22:34.911521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"263'206","reported_seq":821,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:08.768194+0000","last_change":"2024-09-12T18:12:08.768194+0000","last_active":"2024-09-12T18:12:08.768194+0000","last_peered":"2024-09-12T18:12:08.768194+0000","last_clean":"2024-09-12T18:12:08.768194+0000","last_became_active":"2024-09-12T17:10:48.544885+0000","last_became_peered":"2024-09-12T17:10:48.544885+0000","last_unstale":"2024-09-12T18:12:08.768194+0000","last_undegraded":"2024-09-12T18:12:08.768194+0000","last_fullsized":"2024-09-12T18:12:08.768194+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'206","last_scrub_stamp":"2024-09-12T18:12:08.768105+0000","last_deep_scrub":"263'206","last_deep_scrub_stamp":"2024-09-12T18:12:08.768105+0000","last_clean_scrub_stamp":"2024-09-12T18:12:08.768105+0000","objects_scrubbed":5,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:55:57.620335+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6100,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":264,"num_read_kb":318,"num_write":156,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:15.608747+0000","last_change":"2024-09-12T18:12:15.608747+0000","last_active":"2024-09-12T18:12:15.608747+0000","last_peered":"2024-09-12T18:12:15.608747+0000","last_clean":"2024-09-12T18:12:15.608747+0000","last_became_active":"2024-09-12T17:10:50.556146+0000","last_became_peered":"2024-09-12T17:10:50.556146+0000","last_unstale":"2024-09-12T18:12:15.608747+0000","last_undegraded":"2024-09-12T18:12:15.608747+0000","last_fullsized":"2024-09-12T18:12:15.608747+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:15.608646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:15.608646+0000","last_clean_scrub_stamp":"2024-09-12T18:12:15.608646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:38:59.653407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"263'2477","reported_seq":4389,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:22.452371+0000","last_change":"2024-09-12T18:12:22.452371+0000","last_active":"2024-09-12T18:12:22.452371+0000","last_peered":"2024-09-12T18:12:22.452371+0000","last_clean":"2024-09-12T18:12:22.452371+0000","last_became_active":"2024-09-12T17:10:52.572326+0000","last_became_peered":"2024-09-12T17:10:52.572326+0000","last_unstale":"2024-09-12T18:12:22.452371+0000","last_undegraded":"2024-09-12T18:12:22.452371+0000","last_fullsized":"2024-09-12T18:12:22.452371+0000","mapping_epoch":34,"log_start":"263'2400","ondisk_log_start":"263'2400","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2477","last_scrub_stamp":"2024-09-12T18:12:22.452271+0000","last_deep_scrub":"263'2477","last_deep_scrub_stamp":"2024-09-12T18:12:22.452271+0000","last_clean_scrub_stamp":"2024-09-12T18:12:22.452271+0000","objects_scrubbed":3,"log_size":77,"log_dups_size":2400,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:21:06.027327+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":211,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6220,"num_read_kb":6202,"num_write":4958,"num_write_kb":1813,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":347,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"263'424","reported_seq":1886,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:56.315526+0000","last_change":"2024-09-12T18:11:56.315526+0000","last_active":"2024-09-12T18:11:56.315526+0000","last_peered":"2024-09-12T18:11:56.315526+0000","last_clean":"2024-09-12T18:11:56.315526+0000","last_became_active":"2024-09-12T17:10:44.512755+0000","last_became_peered":"2024-09-12T17:10:44.512755+0000","last_unstale":"2024-09-12T18:11:56.315526+0000","last_undegraded":"2024-09-12T18:11:56.315526+0000","last_fullsized":"2024-09-12T18:11:56.315526+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'424","last_scrub_stamp":"2024-09-12T18:11:56.315433+0000","last_deep_scrub":"263'424","last_deep_scrub_stamp":"2024-09-12T18:11:56.315433+0000","last_clean_scrub_stamp":"2024-09-12T18:11:56.315433+0000","objects_scrubbed":1,"log_size":24,"log_dups_size":400,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:17:36.929085+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2092,"num_read_kb":1979,"num_write":465,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"263'205","reported_seq":850,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:50.670378+0000","last_change":"2024-09-12T18:11:50.670378+0000","last_active":"2024-09-12T18:11:50.670378+0000","last_peered":"2024-09-12T18:11:50.670378+0000","last_clean":"2024-09-12T18:11:50.670378+0000","last_became_active":"2024-09-12T17:10:42.513658+0000","last_became_peered":"2024-09-12T17:10:42.513658+0000","last_unstale":"2024-09-12T18:11:50.670378+0000","last_undegraded":"2024-09-12T18:11:50.670378+0000","last_fullsized":"2024-09-12T18:11:50.670378+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'205","last_scrub_stamp":"2024-09-12T18:11:50.670245+0000","last_deep_scrub":"263'205","last_deep_scrub_stamp":"2024-09-12T18:11:50.670245+0000","last_clean_scrub_stamp":"2024-09-12T18:11:50.670245+0000","objects_scrubbed":3,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:56:06.408091+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262204,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":448,"num_read_kb":17694,"num_write":957,"num_write_kb":36760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":504,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:09.675177+0000","last_change":"2024-09-12T18:12:09.675177+0000","last_active":"2024-09-12T18:12:09.675177+0000","last_peered":"2024-09-12T18:12:09.675177+0000","last_clean":"2024-09-12T18:12:09.675177+0000","last_became_active":"2024-09-12T17:10:46.528008+0000","last_became_peered":"2024-09-12T17:10:46.528008+0000","last_unstale":"2024-09-12T18:12:09.675177+0000","last_undegraded":"2024-09-12T18:12:09.675177+0000","last_fullsized":"2024-09-12T18:12:09.675177+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:09.675082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:09.675082+0000","last_clean_scrub_stamp":"2024-09-12T18:12:09.675082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:32:12.149143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"263'101","reported_seq":641,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:11.289249+0000","last_change":"2024-09-12T18:12:11.289249+0000","last_active":"2024-09-12T18:12:11.289249+0000","last_peered":"2024-09-12T18:12:11.289249+0000","last_clean":"2024-09-12T18:12:11.289249+0000","last_became_active":"2024-09-12T17:10:48.539249+0000","last_became_peered":"2024-09-12T17:10:48.539249+0000","last_unstale":"2024-09-12T18:12:11.289249+0000","last_undegraded":"2024-09-12T18:12:11.289249+0000","last_fullsized":"2024-09-12T18:12:11.289249+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'101","last_scrub_stamp":"2024-09-12T18:12:11.289154+0000","last_deep_scrub":"263'101","last_deep_scrub_stamp":"2024-09-12T18:12:11.289154+0000","last_clean_scrub_stamp":"2024-09-12T18:12:11.289154+0000","objects_scrubbed":3,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:49:48.920473+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":101,"num_read_kb":97,"num_write":68,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:16.302946+0000","last_change":"2024-09-12T18:12:16.302946+0000","last_active":"2024-09-12T18:12:16.302946+0000","last_peered":"2024-09-12T18:12:16.302946+0000","last_clean":"2024-09-12T18:12:16.302946+0000","last_became_active":"2024-09-12T17:10:50.559882+0000","last_became_peered":"2024-09-12T17:10:50.559882+0000","last_unstale":"2024-09-12T18:12:16.302946+0000","last_undegraded":"2024-09-12T18:12:16.302946+0000","last_fullsized":"2024-09-12T18:12:16.302946+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:16.302835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:16.302835+0000","last_clean_scrub_stamp":"2024-09-12T18:12:16.302835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:28:03.221974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"263'94","reported_seq":603,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:21.627457+0000","last_change":"2024-09-12T18:12:21.627457+0000","last_active":"2024-09-12T18:12:21.627457+0000","last_peered":"2024-09-12T18:12:21.627457+0000","last_clean":"2024-09-12T18:12:21.627457+0000","last_became_active":"2024-09-12T17:10:52.570071+0000","last_became_peered":"2024-09-12T17:10:52.570071+0000","last_unstale":"2024-09-12T18:12:21.627457+0000","last_undegraded":"2024-09-12T18:12:21.627457+0000","last_fullsized":"2024-09-12T18:12:21.627457+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'94","last_scrub_stamp":"2024-09-12T18:12:21.627369+0000","last_deep_scrub":"263'94","last_deep_scrub_stamp":"2024-09-12T18:12:21.627369+0000","last_clean_scrub_stamp":"2024-09-12T18:12:21.627369+0000","objects_scrubbed":4,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:31:19.525124+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":117,"num_read_kb":116,"num_write":199,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"263'446","reported_seq":2001,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:57.732062+0000","last_change":"2024-09-12T18:11:57.732062+0000","last_active":"2024-09-12T18:11:57.732062+0000","last_peered":"2024-09-12T18:11:57.732062+0000","last_clean":"2024-09-12T18:11:57.732062+0000","last_became_active":"2024-09-12T17:10:44.517886+0000","last_became_peered":"2024-09-12T17:10:44.517886+0000","last_unstale":"2024-09-12T18:11:57.732062+0000","last_undegraded":"2024-09-12T18:11:57.732062+0000","last_fullsized":"2024-09-12T18:11:57.732062+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'446","last_scrub_stamp":"2024-09-12T18:11:57.731969+0000","last_deep_scrub":"263'446","last_deep_scrub_stamp":"2024-09-12T18:11:57.731969+0000","last_clean_scrub_stamp":"2024-09-12T18:11:57.731969+0000","objects_scrubbed":3,"log_size":46,"log_dups_size":400,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:14:03.007633+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2335,"num_read_kb":2201,"num_write":517,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"263'192","reported_seq":824,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:53.493308+0000","last_change":"2024-09-12T18:11:53.493308+0000","last_active":"2024-09-12T18:11:53.493308+0000","last_peered":"2024-09-12T18:11:53.493308+0000","last_clean":"2024-09-12T18:11:53.493308+0000","last_became_active":"2024-09-12T17:10:42.530663+0000","last_became_peered":"2024-09-12T17:10:42.530663+0000","last_unstale":"2024-09-12T18:11:53.493308+0000","last_undegraded":"2024-09-12T18:11:53.493308+0000","last_fullsized":"2024-09-12T18:11:53.493308+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'192","last_scrub_stamp":"2024-09-12T18:11:53.493160+0000","last_deep_scrub":"263'192","last_deep_scrub_stamp":"2024-09-12T18:11:53.493160+0000","last_clean_scrub_stamp":"2024-09-12T18:11:53.493160+0000","objects_scrubbed":4,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:43:13.520826+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6466288,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":436,"num_read_kb":14482,"num_write":960,"num_write_kb":29259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":503,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:10.652342+0000","last_change":"2024-09-12T18:12:10.652342+0000","last_active":"2024-09-12T18:12:10.652342+0000","last_peered":"2024-09-12T18:12:10.652342+0000","last_clean":"2024-09-12T18:12:10.652342+0000","last_became_active":"2024-09-12T17:10:46.530438+0000","last_became_peered":"2024-09-12T17:10:46.530438+0000","last_unstale":"2024-09-12T18:12:10.652342+0000","last_undegraded":"2024-09-12T18:12:10.652342+0000","last_fullsized":"2024-09-12T18:12:10.652342+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:10.652252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:10.652252+0000","last_clean_scrub_stamp":"2024-09-12T18:12:10.652252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:55:25.036608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"263'119","reported_seq":662,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:05.711738+0000","last_change":"2024-09-12T18:12:05.711738+0000","last_active":"2024-09-12T18:12:05.711738+0000","last_peered":"2024-09-12T18:12:05.711738+0000","last_clean":"2024-09-12T18:12:05.711738+0000","last_became_active":"2024-09-12T17:10:48.540078+0000","last_became_peered":"2024-09-12T17:10:48.540078+0000","last_unstale":"2024-09-12T18:12:05.711738+0000","last_undegraded":"2024-09-12T18:12:05.711738+0000","last_fullsized":"2024-09-12T18:12:05.711738+0000","mapping_epoch":30,"log_start":"263'100","ondisk_log_start":"263'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'119","last_scrub_stamp":"2024-09-12T18:12:05.711619+0000","last_deep_scrub":"263'119","last_deep_scrub_stamp":"2024-09-12T18:12:05.711619+0000","last_clean_scrub_stamp":"2024-09-12T18:12:05.711619+0000","objects_scrubbed":5,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:27:16.614673+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":134,"num_read_kb":129,"num_write":88,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"263'766","reported_seq":4737,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:18.558845+0000","last_change":"2024-09-12T18:12:18.558845+0000","last_active":"2024-09-12T18:12:18.558845+0000","last_peered":"2024-09-12T18:12:18.558845+0000","last_clean":"2024-09-12T18:12:18.558845+0000","last_became_active":"2024-09-12T17:10:50.562930+0000","last_became_peered":"2024-09-12T17:10:50.562930+0000","last_unstale":"2024-09-12T18:12:18.558845+0000","last_undegraded":"2024-09-12T18:12:18.558845+0000","last_fullsized":"2024-09-12T18:12:18.558845+0000","mapping_epoch":32,"log_start":"263'700","ondisk_log_start":"263'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'766","last_scrub_stamp":"2024-09-12T18:12:18.558728+0000","last_deep_scrub":"263'766","last_deep_scrub_stamp":"2024-09-12T18:12:18.558728+0000","last_clean_scrub_stamp":"2024-09-12T18:12:18.558728+0000","objects_scrubbed":1,"log_size":66,"log_dups_size":700,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:48:16.936137+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"263'200","reported_seq":1057,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:21.305244+0000","last_change":"2024-09-12T18:12:21.305244+0000","last_active":"2024-09-12T18:12:21.305244+0000","last_peered":"2024-09-12T18:12:21.305244+0000","last_clean":"2024-09-12T18:12:21.305244+0000","last_became_active":"2024-09-12T17:10:52.671103+0000","last_became_peered":"2024-09-12T17:10:52.671103+0000","last_unstale":"2024-09-12T18:12:21.305244+0000","last_undegraded":"2024-09-12T18:12:21.305244+0000","last_fullsized":"2024-09-12T18:12:21.305244+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'200","last_scrub_stamp":"2024-09-12T18:12:21.305151+0000","last_deep_scrub":"263'200","last_deep_scrub_stamp":"2024-09-12T18:12:21.305151+0000","last_clean_scrub_stamp":"2024-09-12T18:12:21.305151+0000","objects_scrubbed":2,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:51:37.835794+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":719,"num_read_kb":693,"num_write":432,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"263'449","reported_seq":1973,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:05.648946+0000","last_change":"2024-09-12T18:12:05.648946+0000","last_active":"2024-09-12T18:12:05.648946+0000","last_peered":"2024-09-12T18:12:05.648946+0000","last_clean":"2024-09-12T18:12:05.648946+0000","last_became_active":"2024-09-12T17:10:44.514124+0000","last_became_peered":"2024-09-12T17:10:44.514124+0000","last_unstale":"2024-09-12T18:12:05.648946+0000","last_undegraded":"2024-09-12T18:12:05.648946+0000","last_fullsized":"2024-09-12T18:12:05.648946+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'449","last_scrub_stamp":"2024-09-12T18:12:05.648849+0000","last_deep_scrub":"263'449","last_deep_scrub_stamp":"2024-09-12T18:12:05.648849+0000","last_clean_scrub_stamp":"2024-09-12T18:12:05.648849+0000","objects_scrubbed":3,"log_size":49,"log_dups_size":400,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:51:39.265549+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2305,"num_read_kb":2168,"num_write":513,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":715,"num_omap_keys":3,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"263'223","reported_seq":887,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:49.784779+0000","last_change":"2024-09-12T18:11:49.784779+0000","last_active":"2024-09-12T18:11:49.784779+0000","last_peered":"2024-09-12T18:11:49.784779+0000","last_clean":"2024-09-12T18:11:49.784779+0000","last_became_active":"2024-09-12T17:10:42.525328+0000","last_became_peered":"2024-09-12T17:10:42.525328+0000","last_unstale":"2024-09-12T18:11:49.784779+0000","last_undegraded":"2024-09-12T18:11:49.784779+0000","last_fullsized":"2024-09-12T18:11:49.784779+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'223","last_scrub_stamp":"2024-09-12T18:11:49.784671+0000","last_deep_scrub":"263'223","last_deep_scrub_stamp":"2024-09-12T18:11:49.784671+0000","last_clean_scrub_stamp":"2024-09-12T18:11:49.784671+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":200,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:16:42.260914+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":549,"num_read_kb":47940,"num_write":1052,"num_write_kb":57690,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,3],"acting":[6,0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:09.453009+0000","last_change":"2024-09-12T18:12:09.453009+0000","last_active":"2024-09-12T18:12:09.453009+0000","last_peered":"2024-09-12T18:12:09.453009+0000","last_clean":"2024-09-12T18:12:09.453009+0000","last_became_active":"2024-09-12T17:10:46.526679+0000","last_became_peered":"2024-09-12T17:10:46.526679+0000","last_unstale":"2024-09-12T18:12:09.453009+0000","last_undegraded":"2024-09-12T18:12:09.453009+0000","last_fullsized":"2024-09-12T18:12:09.453009+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:09.452906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:09.452906+0000","last_clean_scrub_stamp":"2024-09-12T18:12:09.452906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:12:39.798370+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"263'135","reported_seq":710,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:14.576462+0000","last_change":"2024-09-12T18:12:14.576462+0000","last_active":"2024-09-12T18:12:14.576462+0000","last_peered":"2024-09-12T18:12:14.576462+0000","last_clean":"2024-09-12T18:12:14.576462+0000","last_became_active":"2024-09-12T17:10:48.543573+0000","last_became_peered":"2024-09-12T17:10:48.543573+0000","last_unstale":"2024-09-12T18:12:14.576462+0000","last_undegraded":"2024-09-12T18:12:14.576462+0000","last_fullsized":"2024-09-12T18:12:14.576462+0000","mapping_epoch":30,"log_start":"263'100","ondisk_log_start":"263'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'135","last_scrub_stamp":"2024-09-12T18:12:14.576373+0000","last_deep_scrub":"263'135","last_deep_scrub_stamp":"2024-09-12T18:12:14.576373+0000","last_clean_scrub_stamp":"2024-09-12T18:12:14.576373+0000","objects_scrubbed":4,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:56:34.775535+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5773,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":175,"num_read_kb":264,"num_write":94,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"263'788","reported_seq":2307,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:22.665547+0000","last_change":"2024-09-12T18:12:22.665547+0000","last_active":"2024-09-12T18:12:22.665547+0000","last_peered":"2024-09-12T18:12:22.665547+0000","last_clean":"2024-09-12T18:12:22.665547+0000","last_became_active":"2024-09-12T17:10:50.559216+0000","last_became_peered":"2024-09-12T17:10:50.559216+0000","last_unstale":"2024-09-12T18:12:22.665547+0000","last_undegraded":"2024-09-12T18:12:22.665547+0000","last_fullsized":"2024-09-12T18:12:22.665547+0000","mapping_epoch":32,"log_start":"263'700","ondisk_log_start":"263'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'788","last_scrub_stamp":"2024-09-12T18:12:22.665463+0000","last_deep_scrub":"263'788","last_deep_scrub_stamp":"2024-09-12T18:12:22.665463+0000","last_clean_scrub_stamp":"2024-09-12T18:12:22.665463+0000","objects_scrubbed":1,"log_size":88,"log_dups_size":700,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:00:59.116160+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"263'411","reported_seq":1940,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:55.295320+0000","last_change":"2024-09-12T18:11:55.295320+0000","last_active":"2024-09-12T18:11:55.295320+0000","last_peered":"2024-09-12T18:11:55.295320+0000","last_clean":"2024-09-12T18:11:55.295320+0000","last_became_active":"2024-09-12T17:10:44.516266+0000","last_became_peered":"2024-09-12T17:10:44.516266+0000","last_unstale":"2024-09-12T18:11:55.295320+0000","last_undegraded":"2024-09-12T18:11:55.295320+0000","last_fullsized":"2024-09-12T18:11:55.295320+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'411","last_scrub_stamp":"2024-09-12T18:11:55.295178+0000","last_deep_scrub":"263'411","last_deep_scrub_stamp":"2024-09-12T18:11:55.295178+0000","last_clean_scrub_stamp":"2024-09-12T18:11:55.295178+0000","objects_scrubbed":3,"log_size":11,"log_dups_size":400,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:17:07.193677+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2231,"num_read_kb":2116,"num_write":471,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":467,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"263'319","reported_seq":1094,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:52.463181+0000","last_change":"2024-09-12T18:11:52.463181+0000","last_active":"2024-09-12T18:11:52.463181+0000","last_peered":"2024-09-12T18:11:52.463181+0000","last_clean":"2024-09-12T18:11:52.463181+0000","last_became_active":"2024-09-12T17:10:42.531886+0000","last_became_peered":"2024-09-12T17:10:42.531886+0000","last_unstale":"2024-09-12T18:11:52.463181+0000","last_undegraded":"2024-09-12T18:11:52.463181+0000","last_fullsized":"2024-09-12T18:11:52.463181+0000","mapping_epoch":24,"log_start":"263'300","ondisk_log_start":"263'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'319","last_scrub_stamp":"2024-09-12T18:11:52.463034+0000","last_deep_scrub":"263'319","last_deep_scrub_stamp":"2024-09-12T18:11:52.463034+0000","last_clean_scrub_stamp":"2024-09-12T18:11:52.463034+0000","objects_scrubbed":6,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:11:16.067545+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2276857,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1043,"num_read_kb":35637,"num_write":1316,"num_write_kb":31872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0,1],"acting":[7,4,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":504,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:05.608637+0000","last_change":"2024-09-12T18:12:05.608637+0000","last_active":"2024-09-12T18:12:05.608637+0000","last_peered":"2024-09-12T18:12:05.608637+0000","last_clean":"2024-09-12T18:12:05.608637+0000","last_became_active":"2024-09-12T17:10:46.518652+0000","last_became_peered":"2024-09-12T17:10:46.518652+0000","last_unstale":"2024-09-12T18:12:05.608637+0000","last_undegraded":"2024-09-12T18:12:05.608637+0000","last_fullsized":"2024-09-12T18:12:05.608637+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:05.608543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:05.608543+0000","last_clean_scrub_stamp":"2024-09-12T18:12:05.608543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:09:06.191572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"263'227","reported_seq":852,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:13.404939+0000","last_change":"2024-09-12T18:12:13.404939+0000","last_active":"2024-09-12T18:12:13.404939+0000","last_peered":"2024-09-12T18:12:13.404939+0000","last_clean":"2024-09-12T18:12:13.404939+0000","last_became_active":"2024-09-12T17:10:48.541178+0000","last_became_peered":"2024-09-12T17:10:48.541178+0000","last_unstale":"2024-09-12T18:12:13.404939+0000","last_undegraded":"2024-09-12T18:12:13.404939+0000","last_fullsized":"2024-09-12T18:12:13.404939+0000","mapping_epoch":30,"log_start":"263'200","ondisk_log_start":"263'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'227","last_scrub_stamp":"2024-09-12T18:12:13.404809+0000","last_deep_scrub":"263'227","last_deep_scrub_stamp":"2024-09-12T18:12:13.404809+0000","last_clean_scrub_stamp":"2024-09-12T18:12:13.404809+0000","objects_scrubbed":9,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:17:32.802279+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5437,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":298,"num_read_kb":347,"num_write":172,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:08.498712+0000","last_change":"2024-09-12T18:12:08.498712+0000","last_active":"2024-09-12T18:12:08.498712+0000","last_peered":"2024-09-12T18:12:08.498712+0000","last_clean":"2024-09-12T18:12:08.498712+0000","last_became_active":"2024-09-12T17:10:50.560193+0000","last_became_peered":"2024-09-12T17:10:50.560193+0000","last_unstale":"2024-09-12T18:12:08.498712+0000","last_undegraded":"2024-09-12T18:12:08.498712+0000","last_fullsized":"2024-09-12T18:12:08.498712+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:08.498624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:08.498624+0000","last_clean_scrub_stamp":"2024-09-12T18:12:08.498624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:43:57.992395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"263'562","reported_seq":1381,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:18.548972+0000","last_change":"2024-09-12T18:12:18.548972+0000","last_active":"2024-09-12T18:12:18.548972+0000","last_peered":"2024-09-12T18:12:18.548972+0000","last_clean":"2024-09-12T18:12:18.548972+0000","last_became_active":"2024-09-12T17:10:52.572861+0000","last_became_peered":"2024-09-12T17:10:52.572861+0000","last_unstale":"2024-09-12T18:12:18.548972+0000","last_undegraded":"2024-09-12T18:12:18.548972+0000","last_fullsized":"2024-09-12T18:12:18.548972+0000","mapping_epoch":34,"log_start":"263'500","ondisk_log_start":"263'500","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'562","last_scrub_stamp":"2024-09-12T18:12:18.548872+0000","last_deep_scrub":"263'562","last_deep_scrub_stamp":"2024-09-12T18:12:18.548872+0000","last_clean_scrub_stamp":"2024-09-12T18:12:18.548872+0000","objects_scrubbed":7,"log_size":62,"log_dups_size":500,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:19:47.637516+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1102,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1315,"num_read_kb":1312,"num_write":1171,"num_write_kb":396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":381,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"263'469","reported_seq":2057,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:51.400026+0000","last_change":"2024-09-12T18:11:51.400026+0000","last_active":"2024-09-12T18:11:51.400026+0000","last_peered":"2024-09-12T18:11:51.400026+0000","last_clean":"2024-09-12T18:11:51.400026+0000","last_became_active":"2024-09-12T17:10:44.515778+0000","last_became_peered":"2024-09-12T17:10:44.515778+0000","last_unstale":"2024-09-12T18:11:51.400026+0000","last_undegraded":"2024-09-12T18:11:51.400026+0000","last_fullsized":"2024-09-12T18:11:51.400026+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'469","last_scrub_stamp":"2024-09-12T18:11:51.399935+0000","last_deep_scrub":"263'469","last_deep_scrub_stamp":"2024-09-12T18:11:51.399935+0000","last_clean_scrub_stamp":"2024-09-12T18:11:51.399935+0000","objects_scrubbed":2,"log_size":69,"log_dups_size":400,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:32:57.047086+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2463,"num_read_kb":2310,"num_write":552,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"263'158","reported_seq":772,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:50.465220+0000","last_change":"2024-09-12T18:11:50.465220+0000","last_active":"2024-09-12T18:11:50.465220+0000","last_peered":"2024-09-12T18:11:50.465220+0000","last_clean":"2024-09-12T18:11:50.465220+0000","last_became_active":"2024-09-12T17:10:42.526215+0000","last_became_peered":"2024-09-12T17:10:42.526215+0000","last_unstale":"2024-09-12T18:11:50.465220+0000","last_undegraded":"2024-09-12T18:11:50.465220+0000","last_fullsized":"2024-09-12T18:11:50.465220+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'158","last_scrub_stamp":"2024-09-12T18:11:50.465100+0000","last_deep_scrub":"263'158","last_deep_scrub_stamp":"2024-09-12T18:11:50.465100+0000","last_clean_scrub_stamp":"2024-09-12T18:11:50.465100+0000","objects_scrubbed":2,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:53:30.108739+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":254352,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":393,"num_read_kb":949,"num_write":838,"num_write_kb":19518,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,2],"acting":[7,4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":503,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:55.787582+0000","last_change":"2024-09-12T18:11:55.787582+0000","last_active":"2024-09-12T18:11:55.787582+0000","last_peered":"2024-09-12T18:11:55.787582+0000","last_clean":"2024-09-12T18:11:55.787582+0000","last_became_active":"2024-09-12T17:10:46.532552+0000","last_became_peered":"2024-09-12T17:10:46.532552+0000","last_unstale":"2024-09-12T18:11:55.787582+0000","last_undegraded":"2024-09-12T18:11:55.787582+0000","last_fullsized":"2024-09-12T18:11:55.787582+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:11:55.787495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:11:55.787495+0000","last_clean_scrub_stamp":"2024-09-12T18:11:55.787495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:34:05.224619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"263'137","reported_seq":716,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:11.617615+0000","last_change":"2024-09-12T18:12:11.617615+0000","last_active":"2024-09-12T18:12:11.617615+0000","last_peered":"2024-09-12T18:12:11.617615+0000","last_clean":"2024-09-12T18:12:11.617615+0000","last_became_active":"2024-09-12T17:10:48.542511+0000","last_became_peered":"2024-09-12T17:10:48.542511+0000","last_unstale":"2024-09-12T18:12:11.617615+0000","last_undegraded":"2024-09-12T18:12:11.617615+0000","last_fullsized":"2024-09-12T18:12:11.617615+0000","mapping_epoch":30,"log_start":"263'100","ondisk_log_start":"263'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'137","last_scrub_stamp":"2024-09-12T18:12:11.617522+0000","last_deep_scrub":"263'137","last_deep_scrub_stamp":"2024-09-12T18:12:11.617522+0000","last_clean_scrub_stamp":"2024-09-12T18:12:11.617522+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:39:49.866042+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27700,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":176,"num_read_kb":289,"num_write":94,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":498,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:20.690070+0000","last_change":"2024-09-12T18:12:20.690070+0000","last_active":"2024-09-12T18:12:20.690070+0000","last_peered":"2024-09-12T18:12:20.690070+0000","last_clean":"2024-09-12T18:12:20.690070+0000","last_became_active":"2024-09-12T17:10:50.560194+0000","last_became_peered":"2024-09-12T17:10:50.560194+0000","last_unstale":"2024-09-12T18:12:20.690070+0000","last_undegraded":"2024-09-12T18:12:20.690070+0000","last_fullsized":"2024-09-12T18:12:20.690070+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:20.689979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:20.689979+0000","last_clean_scrub_stamp":"2024-09-12T18:12:20.689979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:11:29.579461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"263'129","reported_seq":644,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:08.698991+0000","last_change":"2024-09-12T18:12:08.698991+0000","last_active":"2024-09-12T18:12:08.698991+0000","last_peered":"2024-09-12T18:12:08.698991+0000","last_clean":"2024-09-12T18:12:08.698991+0000","last_became_active":"2024-09-12T17:10:52.564350+0000","last_became_peered":"2024-09-12T17:10:52.564350+0000","last_unstale":"2024-09-12T18:12:08.698991+0000","last_undegraded":"2024-09-12T18:12:08.698991+0000","last_fullsized":"2024-09-12T18:12:08.698991+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'129","last_scrub_stamp":"2024-09-12T18:12:08.698906+0000","last_deep_scrub":"263'129","last_deep_scrub_stamp":"2024-09-12T18:12:08.698906+0000","last_clean_scrub_stamp":"2024-09-12T18:12:08.698906+0000","objects_scrubbed":1,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:13:26.478753+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":214,"num_read_kb":196,"num_write":321,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"263'439","reported_seq":1888,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:55.718980+0000","last_change":"2024-09-12T18:11:55.718980+0000","last_active":"2024-09-12T18:11:55.718980+0000","last_peered":"2024-09-12T18:11:55.718980+0000","last_clean":"2024-09-12T18:11:55.718980+0000","last_became_active":"2024-09-12T17:11:16.618699+0000","last_became_peered":"2024-09-12T17:11:16.618699+0000","last_unstale":"2024-09-12T18:11:55.718980+0000","last_undegraded":"2024-09-12T18:11:55.718980+0000","last_fullsized":"2024-09-12T18:11:55.718980+0000","mapping_epoch":37,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'439","last_scrub_stamp":"2024-09-12T18:11:55.718895+0000","last_deep_scrub":"263'439","last_deep_scrub_stamp":"2024-09-12T18:11:55.718895+0000","last_clean_scrub_stamp":"2024-09-12T18:11:55.718895+0000","objects_scrubbed":2,"log_size":39,"log_dups_size":400,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:35:23.822201+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2161,"num_read_kb":2024,"num_write":504,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1429,"num_omap_keys":6,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"263'215","reported_seq":851,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:58.516620+0000","last_change":"2024-09-12T18:11:58.516620+0000","last_active":"2024-09-12T18:11:58.516620+0000","last_peered":"2024-09-12T18:11:58.516620+0000","last_clean":"2024-09-12T18:11:58.516620+0000","last_became_active":"2024-09-12T17:10:42.525644+0000","last_became_peered":"2024-09-12T17:10:42.525644+0000","last_unstale":"2024-09-12T18:11:58.516620+0000","last_undegraded":"2024-09-12T18:11:58.516620+0000","last_fullsized":"2024-09-12T18:11:58.516620+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'215","last_scrub_stamp":"2024-09-12T18:11:58.516489+0000","last_deep_scrub":"263'215","last_deep_scrub_stamp":"2024-09-12T18:11:58.516489+0000","last_clean_scrub_stamp":"2024-09-12T18:11:58.516489+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":200,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:52:28.223065+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":480,"num_read_kb":1680,"num_write":1066,"num_write_kb":42245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4,6],"acting":[7,5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:59.753999+0000","last_change":"2024-09-12T18:11:59.753999+0000","last_active":"2024-09-12T18:11:59.753999+0000","last_peered":"2024-09-12T18:11:59.753999+0000","last_clean":"2024-09-12T18:11:59.753999+0000","last_became_active":"2024-09-12T17:10:46.531693+0000","last_became_peered":"2024-09-12T17:10:46.531693+0000","last_unstale":"2024-09-12T18:11:59.753999+0000","last_undegraded":"2024-09-12T18:11:59.753999+0000","last_fullsized":"2024-09-12T18:11:59.753999+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:11:59.753897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:11:59.753897+0000","last_clean_scrub_stamp":"2024-09-12T18:11:59.753897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:56:46.955405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"263'178","reported_seq":774,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:11.589646+0000","last_change":"2024-09-12T18:12:11.589646+0000","last_active":"2024-09-12T18:12:11.589646+0000","last_peered":"2024-09-12T18:12:11.589646+0000","last_clean":"2024-09-12T18:12:11.589646+0000","last_became_active":"2024-09-12T17:10:48.546013+0000","last_became_peered":"2024-09-12T17:10:48.546013+0000","last_unstale":"2024-09-12T18:12:11.589646+0000","last_undegraded":"2024-09-12T18:12:11.589646+0000","last_fullsized":"2024-09-12T18:12:11.589646+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'178","last_scrub_stamp":"2024-09-12T18:12:11.589555+0000","last_deep_scrub":"263'178","last_deep_scrub_stamp":"2024-09-12T18:12:11.589555+0000","last_clean_scrub_stamp":"2024-09-12T18:12:11.589555+0000","objects_scrubbed":7,"log_size":78,"log_dups_size":100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:51:13.452284+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22951,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":229,"num_read_kb":322,"num_write":130,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"263'777","reported_seq":2668,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:13.721455+0000","last_change":"2024-09-12T18:12:13.721455+0000","last_active":"2024-09-12T18:12:13.721455+0000","last_peered":"2024-09-12T18:12:13.721455+0000","last_clean":"2024-09-12T18:12:13.721455+0000","last_became_active":"2024-09-12T17:10:50.557711+0000","last_became_peered":"2024-09-12T17:10:50.557711+0000","last_unstale":"2024-09-12T18:12:13.721455+0000","last_undegraded":"2024-09-12T18:12:13.721455+0000","last_fullsized":"2024-09-12T18:12:13.721455+0000","mapping_epoch":32,"log_start":"263'700","ondisk_log_start":"263'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'777","last_scrub_stamp":"2024-09-12T18:12:13.721361+0000","last_deep_scrub":"263'777","last_deep_scrub_stamp":"2024-09-12T18:12:13.721361+0000","last_clean_scrub_stamp":"2024-09-12T18:12:13.721361+0000","objects_scrubbed":1,"log_size":77,"log_dups_size":700,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:36:39.426338+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"263'105","reported_seq":608,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:18.692520+0000","last_change":"2024-09-12T18:12:18.692520+0000","last_active":"2024-09-12T18:12:18.692520+0000","last_peered":"2024-09-12T18:12:18.692520+0000","last_clean":"2024-09-12T18:12:18.692520+0000","last_became_active":"2024-09-12T17:10:52.570034+0000","last_became_peered":"2024-09-12T17:10:52.570034+0000","last_unstale":"2024-09-12T18:12:18.692520+0000","last_undegraded":"2024-09-12T18:12:18.692520+0000","last_fullsized":"2024-09-12T18:12:18.692520+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'105","last_scrub_stamp":"2024-09-12T18:12:18.692437+0000","last_deep_scrub":"263'105","last_deep_scrub_stamp":"2024-09-12T18:12:18.692437+0000","last_clean_scrub_stamp":"2024-09-12T18:12:18.692437+0000","objects_scrubbed":2,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:12:56.220943+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":442,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":109,"num_read_kb":107,"num_write":228,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"263'459","reported_seq":1996,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:56.689795+0000","last_change":"2024-09-12T18:11:56.689795+0000","last_active":"2024-09-12T18:11:56.689795+0000","last_peered":"2024-09-12T18:11:56.689795+0000","last_clean":"2024-09-12T18:11:56.689795+0000","last_became_active":"2024-09-12T17:10:44.520043+0000","last_became_peered":"2024-09-12T17:10:44.520043+0000","last_unstale":"2024-09-12T18:11:56.689795+0000","last_undegraded":"2024-09-12T18:11:56.689795+0000","last_fullsized":"2024-09-12T18:11:56.689795+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'459","last_scrub_stamp":"2024-09-12T18:11:56.689705+0000","last_deep_scrub":"263'459","last_deep_scrub_stamp":"2024-09-12T18:11:56.689705+0000","last_clean_scrub_stamp":"2024-09-12T18:11:56.689705+0000","objects_scrubbed":2,"log_size":59,"log_dups_size":400,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:12:24.353664+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2352,"num_read_kb":2214,"num_write":541,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":217,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"263'209","reported_seq":860,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:48.213383+0000","last_change":"2024-09-12T18:11:48.213383+0000","last_active":"2024-09-12T18:11:48.213383+0000","last_peered":"2024-09-12T18:11:48.213383+0000","last_clean":"2024-09-12T18:11:48.213383+0000","last_became_active":"2024-09-12T17:10:42.518472+0000","last_became_peered":"2024-09-12T17:10:42.518472+0000","last_unstale":"2024-09-12T18:11:48.213383+0000","last_undegraded":"2024-09-12T18:11:48.213383+0000","last_fullsized":"2024-09-12T18:11:48.213383+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'209","last_scrub_stamp":"2024-09-12T18:11:48.213203+0000","last_deep_scrub":"263'209","last_deep_scrub_stamp":"2024-09-12T18:11:48.213203+0000","last_clean_scrub_stamp":"2024-09-12T18:11:48.213203+0000","objects_scrubbed":7,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:56:57.310254+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":91,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":447,"num_read_kb":52953,"num_write":1076,"num_write_kb":38599,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6,1],"acting":[5,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":503,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:56.759826+0000","last_change":"2024-09-12T18:11:56.759826+0000","last_active":"2024-09-12T18:11:56.759826+0000","last_peered":"2024-09-12T18:11:56.759826+0000","last_clean":"2024-09-12T18:11:56.759826+0000","last_became_active":"2024-09-12T17:10:46.531731+0000","last_became_peered":"2024-09-12T17:10:46.531731+0000","last_unstale":"2024-09-12T18:11:56.759826+0000","last_undegraded":"2024-09-12T18:11:56.759826+0000","last_fullsized":"2024-09-12T18:11:56.759826+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:11:56.759684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:11:56.759684+0000","last_clean_scrub_stamp":"2024-09-12T18:11:56.759684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:53:36.303626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"263'204","reported_seq":849,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:07.754573+0000","last_change":"2024-09-12T18:12:07.754573+0000","last_active":"2024-09-12T18:12:07.754573+0000","last_peered":"2024-09-12T18:12:07.754573+0000","last_clean":"2024-09-12T18:12:07.754573+0000","last_became_active":"2024-09-12T17:10:48.544653+0000","last_became_peered":"2024-09-12T17:10:48.544653+0000","last_unstale":"2024-09-12T18:12:07.754573+0000","last_undegraded":"2024-09-12T18:12:07.754573+0000","last_fullsized":"2024-09-12T18:12:07.754573+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'204","last_scrub_stamp":"2024-09-12T18:12:07.754451+0000","last_deep_scrub":"263'204","last_deep_scrub_stamp":"2024-09-12T18:12:07.754451+0000","last_clean_scrub_stamp":"2024-09-12T18:12:07.754451+0000","objects_scrubbed":5,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:02:06.311539+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13571,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":286,"num_read_kb":396,"num_write":142,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":495,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:04.752859+0000","last_change":"2024-09-12T18:12:04.752859+0000","last_active":"2024-09-12T18:12:04.752859+0000","last_peered":"2024-09-12T18:12:04.752859+0000","last_clean":"2024-09-12T18:12:04.752859+0000","last_became_active":"2024-09-12T17:10:50.555473+0000","last_became_peered":"2024-09-12T17:10:50.555473+0000","last_unstale":"2024-09-12T18:12:04.752859+0000","last_undegraded":"2024-09-12T18:12:04.752859+0000","last_fullsized":"2024-09-12T18:12:04.752859+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:04.752774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:04.752774+0000","last_clean_scrub_stamp":"2024-09-12T18:12:04.752774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:02:14.647232+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"263'119","reported_seq":636,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:13.496114+0000","last_change":"2024-09-12T18:12:13.496114+0000","last_active":"2024-09-12T18:12:13.496114+0000","last_peered":"2024-09-12T18:12:13.496114+0000","last_clean":"2024-09-12T18:12:13.496114+0000","last_became_active":"2024-09-12T17:10:52.571225+0000","last_became_peered":"2024-09-12T17:10:52.571225+0000","last_unstale":"2024-09-12T18:12:13.496114+0000","last_undegraded":"2024-09-12T18:12:13.496114+0000","last_fullsized":"2024-09-12T18:12:13.496114+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'119","last_scrub_stamp":"2024-09-12T18:12:13.496017+0000","last_deep_scrub":"263'119","last_deep_scrub_stamp":"2024-09-12T18:12:13.496017+0000","last_clean_scrub_stamp":"2024-09-12T18:12:13.496017+0000","objects_scrubbed":3,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:05:01.416556+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":910,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":137,"num_read_kb":136,"num_write":254,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"263'475","reported_seq":2098,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:53.403989+0000","last_change":"2024-09-12T18:11:53.403989+0000","last_active":"2024-09-12T18:11:53.403989+0000","last_peered":"2024-09-12T18:11:53.403989+0000","last_clean":"2024-09-12T18:11:53.403989+0000","last_became_active":"2024-09-12T17:10:44.516255+0000","last_became_peered":"2024-09-12T17:10:44.516255+0000","last_unstale":"2024-09-12T18:11:53.403989+0000","last_undegraded":"2024-09-12T18:11:53.403989+0000","last_fullsized":"2024-09-12T18:11:53.403989+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'475","last_scrub_stamp":"2024-09-12T18:11:53.403890+0000","last_deep_scrub":"263'475","last_deep_scrub_stamp":"2024-09-12T18:11:53.403890+0000","last_clean_scrub_stamp":"2024-09-12T18:11:53.403890+0000","objects_scrubbed":3,"log_size":75,"log_dups_size":400,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:52:22.138939+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2470,"num_read_kb":2330,"num_write":539,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":225,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"263'218","reported_seq":846,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:49.555656+0000","last_change":"2024-09-12T18:11:49.555656+0000","last_active":"2024-09-12T18:11:49.555656+0000","last_peered":"2024-09-12T18:11:49.555656+0000","last_clean":"2024-09-12T18:11:49.555656+0000","last_became_active":"2024-09-12T17:11:16.862702+0000","last_became_peered":"2024-09-12T17:11:16.862702+0000","last_unstale":"2024-09-12T18:11:49.555656+0000","last_undegraded":"2024-09-12T18:11:49.555656+0000","last_fullsized":"2024-09-12T18:11:49.555656+0000","mapping_epoch":37,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'218","last_scrub_stamp":"2024-09-12T18:11:49.555539+0000","last_deep_scrub":"263'218","last_deep_scrub_stamp":"2024-09-12T18:11:49.555539+0000","last_clean_scrub_stamp":"2024-09-12T18:11:49.555539+0000","objects_scrubbed":3,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:28:46.491751+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079942,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":414,"num_read_kb":1752,"num_write":1053,"num_write_kb":46733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,4,7],"acting":[3,2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:00.757095+0000","last_change":"2024-09-12T18:12:00.757095+0000","last_active":"2024-09-12T18:12:00.757095+0000","last_peered":"2024-09-12T18:12:00.757095+0000","last_clean":"2024-09-12T18:12:00.757095+0000","last_became_active":"2024-09-12T17:10:46.524638+0000","last_became_peered":"2024-09-12T17:10:46.524638+0000","last_unstale":"2024-09-12T18:12:00.757095+0000","last_undegraded":"2024-09-12T18:12:00.757095+0000","last_fullsized":"2024-09-12T18:12:00.757095+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:00.756978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:00.756978+0000","last_clean_scrub_stamp":"2024-09-12T18:12:00.756978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:05:19.943694+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"263'157","reported_seq":749,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:13.374169+0000","last_change":"2024-09-12T18:12:13.374169+0000","last_active":"2024-09-12T18:12:13.374169+0000","last_peered":"2024-09-12T18:12:13.374169+0000","last_clean":"2024-09-12T18:12:13.374169+0000","last_became_active":"2024-09-12T17:10:48.537923+0000","last_became_peered":"2024-09-12T17:10:48.537923+0000","last_unstale":"2024-09-12T18:12:13.374169+0000","last_undegraded":"2024-09-12T18:12:13.374169+0000","last_fullsized":"2024-09-12T18:12:13.374169+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'157","last_scrub_stamp":"2024-09-12T18:12:13.374068+0000","last_deep_scrub":"263'157","last_deep_scrub_stamp":"2024-09-12T18:12:13.374068+0000","last_clean_scrub_stamp":"2024-09-12T18:12:13.374068+0000","objects_scrubbed":6,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:25:49.577753+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7449,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":229,"num_read_kb":291,"num_write":178,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15964,"num_omap_keys":38,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":501,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:14.682641+0000","last_change":"2024-09-12T18:12:14.682641+0000","last_active":"2024-09-12T18:12:14.682641+0000","last_peered":"2024-09-12T18:12:14.682641+0000","last_clean":"2024-09-12T18:12:14.682641+0000","last_became_active":"2024-09-12T17:10:50.563507+0000","last_became_peered":"2024-09-12T17:10:50.563507+0000","last_unstale":"2024-09-12T18:12:14.682641+0000","last_undegraded":"2024-09-12T18:12:14.682641+0000","last_fullsized":"2024-09-12T18:12:14.682641+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:14.682537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:14.682537+0000","last_clean_scrub_stamp":"2024-09-12T18:12:14.682537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:59:17.113966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"263'129","reported_seq":652,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:23.662315+0000","last_change":"2024-09-12T18:12:23.662315+0000","last_active":"2024-09-12T18:12:23.662315+0000","last_peered":"2024-09-12T18:12:23.662315+0000","last_clean":"2024-09-12T18:12:23.662315+0000","last_became_active":"2024-09-12T17:10:52.575293+0000","last_became_peered":"2024-09-12T17:10:52.575293+0000","last_unstale":"2024-09-12T18:12:23.662315+0000","last_undegraded":"2024-09-12T18:12:23.662315+0000","last_fullsized":"2024-09-12T18:12:23.662315+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'129","last_scrub_stamp":"2024-09-12T18:12:23.662227+0000","last_deep_scrub":"263'129","last_deep_scrub_stamp":"2024-09-12T18:12:23.662227+0000","last_clean_scrub_stamp":"2024-09-12T18:12:23.662227+0000","objects_scrubbed":3,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:40:00.640502+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":248,"num_read_kb":220,"num_write":319,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"263'998","reported_seq":2626,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:54.382075+0000","last_change":"2024-09-12T18:11:54.382075+0000","last_active":"2024-09-12T18:11:54.382075+0000","last_peered":"2024-09-12T18:11:54.382075+0000","last_clean":"2024-09-12T18:11:54.382075+0000","last_became_active":"2024-09-12T17:10:44.515098+0000","last_became_peered":"2024-09-12T17:10:44.515098+0000","last_unstale":"2024-09-12T18:11:54.382075+0000","last_undegraded":"2024-09-12T18:11:54.382075+0000","last_fullsized":"2024-09-12T18:11:54.382075+0000","mapping_epoch":26,"log_start":"263'900","ondisk_log_start":"263'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'998","last_scrub_stamp":"2024-09-12T18:11:54.381986+0000","last_deep_scrub":"263'998","last_deep_scrub_stamp":"2024-09-12T18:11:54.381986+0000","last_clean_scrub_stamp":"2024-09-12T18:11:54.381986+0000","objects_scrubbed":3,"log_size":98,"log_dups_size":900,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:57:33.212113+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4616,"num_read_kb":4072,"num_write":1360,"num_write_kb":579,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"263'209","reported_seq":858,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:48.820208+0000","last_change":"2024-09-12T18:11:48.820208+0000","last_active":"2024-09-12T18:11:48.820208+0000","last_peered":"2024-09-12T18:11:48.820208+0000","last_clean":"2024-09-12T18:11:48.820208+0000","last_became_active":"2024-09-12T17:10:42.515480+0000","last_became_peered":"2024-09-12T17:10:42.515480+0000","last_unstale":"2024-09-12T18:11:48.820208+0000","last_undegraded":"2024-09-12T18:11:48.820208+0000","last_fullsized":"2024-09-12T18:11:48.820208+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'209","last_scrub_stamp":"2024-09-12T18:11:48.820082+0000","last_deep_scrub":"263'209","last_deep_scrub_stamp":"2024-09-12T18:11:48.820082+0000","last_clean_scrub_stamp":"2024-09-12T18:11:48.820082+0000","objects_scrubbed":5,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:31:06.353554+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4364954,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":507,"num_read_kb":28749,"num_write":1020,"num_write_kb":24822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1,7],"acting":[6,4,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":510,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:00.573603+0000","last_change":"2024-09-12T18:12:00.573603+0000","last_active":"2024-09-12T18:12:00.573603+0000","last_peered":"2024-09-12T18:12:00.573603+0000","last_clean":"2024-09-12T18:12:00.573603+0000","last_became_active":"2024-09-12T17:10:46.532552+0000","last_became_peered":"2024-09-12T17:10:46.532552+0000","last_unstale":"2024-09-12T18:12:00.573603+0000","last_undegraded":"2024-09-12T18:12:00.573603+0000","last_fullsized":"2024-09-12T18:12:00.573603+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:00.573517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:00.573517+0000","last_clean_scrub_stamp":"2024-09-12T18:12:00.573517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:33:18.527965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"263'179","reported_seq":773,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:03.736258+0000","last_change":"2024-09-12T18:12:03.736258+0000","last_active":"2024-09-12T18:12:03.736258+0000","last_peered":"2024-09-12T18:12:03.736258+0000","last_clean":"2024-09-12T18:12:03.736258+0000","last_became_active":"2024-09-12T17:10:48.542298+0000","last_became_peered":"2024-09-12T17:10:48.542298+0000","last_unstale":"2024-09-12T18:12:03.736258+0000","last_undegraded":"2024-09-12T18:12:03.736258+0000","last_fullsized":"2024-09-12T18:12:03.736258+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'179","last_scrub_stamp":"2024-09-12T18:12:03.736151+0000","last_deep_scrub":"263'179","last_deep_scrub_stamp":"2024-09-12T18:12:03.736151+0000","last_clean_scrub_stamp":"2024-09-12T18:12:03.736151+0000","objects_scrubbed":7,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:35:13.912374+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5018,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":233,"num_read_kb":318,"num_write":134,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"263'747","reported_seq":2533,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:02.775270+0000","last_change":"2024-09-12T18:12:02.775270+0000","last_active":"2024-09-12T18:12:02.775270+0000","last_peered":"2024-09-12T18:12:02.775270+0000","last_clean":"2024-09-12T18:12:02.775270+0000","last_became_active":"2024-09-12T17:10:50.557305+0000","last_became_peered":"2024-09-12T17:10:50.557305+0000","last_unstale":"2024-09-12T18:12:02.775270+0000","last_undegraded":"2024-09-12T18:12:02.775270+0000","last_fullsized":"2024-09-12T18:12:02.775270+0000","mapping_epoch":32,"log_start":"263'700","ondisk_log_start":"263'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'747","last_scrub_stamp":"2024-09-12T18:12:02.775178+0000","last_deep_scrub":"263'747","last_deep_scrub_stamp":"2024-09-12T18:12:02.775178+0000","last_clean_scrub_stamp":"2024-09-12T18:12:02.775178+0000","objects_scrubbed":1,"log_size":47,"log_dups_size":700,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:35.079087+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"263'122","reported_seq":637,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:11.455948+0000","last_change":"2024-09-12T18:12:11.455948+0000","last_active":"2024-09-12T18:12:11.455948+0000","last_peered":"2024-09-12T18:12:11.455948+0000","last_clean":"2024-09-12T18:12:11.455948+0000","last_became_active":"2024-09-12T17:10:52.571344+0000","last_became_peered":"2024-09-12T17:10:52.571344+0000","last_unstale":"2024-09-12T18:12:11.455948+0000","last_undegraded":"2024-09-12T18:12:11.455948+0000","last_fullsized":"2024-09-12T18:12:11.455948+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'122","last_scrub_stamp":"2024-09-12T18:12:11.455861+0000","last_deep_scrub":"263'122","last_deep_scrub_stamp":"2024-09-12T18:12:11.455861+0000","last_clean_scrub_stamp":"2024-09-12T18:12:11.455861+0000","objects_scrubbed":5,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:51:03.082932+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1852,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":171,"num_read_kb":161,"num_write":288,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"263'490","reported_seq":2165,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:52.356454+0000","last_change":"2024-09-12T18:11:52.356454+0000","last_active":"2024-09-12T18:11:52.356454+0000","last_peered":"2024-09-12T18:11:52.356454+0000","last_clean":"2024-09-12T18:11:52.356454+0000","last_became_active":"2024-09-12T17:10:44.509293+0000","last_became_peered":"2024-09-12T17:10:44.509293+0000","last_unstale":"2024-09-12T18:11:52.356454+0000","last_undegraded":"2024-09-12T18:11:52.356454+0000","last_fullsized":"2024-09-12T18:11:52.356454+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'490","last_scrub_stamp":"2024-09-12T18:11:52.356345+0000","last_deep_scrub":"263'490","last_deep_scrub_stamp":"2024-09-12T18:11:52.356345+0000","last_clean_scrub_stamp":"2024-09-12T18:11:52.356345+0000","objects_scrubbed":4,"log_size":90,"log_dups_size":400,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:17:42.560325+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2823,"num_read_kb":2653,"num_write":584,"num_write_kb":143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1419,"num_omap_keys":6,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"263'186","reported_seq":846,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:47.544051+0000","last_change":"2024-09-12T18:11:47.544051+0000","last_active":"2024-09-12T18:11:47.544051+0000","last_peered":"2024-09-12T18:11:47.544051+0000","last_clean":"2024-09-12T18:11:47.544051+0000","last_became_active":"2024-09-12T17:10:42.515196+0000","last_became_peered":"2024-09-12T17:10:42.515196+0000","last_unstale":"2024-09-12T18:11:47.544051+0000","last_undegraded":"2024-09-12T18:11:47.544051+0000","last_fullsized":"2024-09-12T18:11:47.544051+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'186","last_scrub_stamp":"2024-09-12T18:11:47.543937+0000","last_deep_scrub":"263'186","last_deep_scrub_stamp":"2024-09-12T18:11:47.543937+0000","last_clean_scrub_stamp":"2024-09-12T18:11:47.543937+0000","objects_scrubbed":4,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:47:46.850299+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262519,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":441,"num_read_kb":72235,"num_write":829,"num_write_kb":40150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7,1],"acting":[4,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"263'4","reported_seq":1458,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:11.409697+0000","last_change":"2024-09-12T18:12:11.409697+0000","last_active":"2024-09-12T18:12:11.409697+0000","last_peered":"2024-09-12T18:12:11.409697+0000","last_clean":"2024-09-12T18:12:11.409697+0000","last_became_active":"2024-09-12T17:10:46.531032+0000","last_became_peered":"2024-09-12T17:10:46.531032+0000","last_unstale":"2024-09-12T18:12:11.409697+0000","last_undegraded":"2024-09-12T18:12:11.409697+0000","last_fullsized":"2024-09-12T18:12:11.409697+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-09-12T18:12:11.409610+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-09-12T18:12:11.409610+0000","last_clean_scrub_stamp":"2024-09-12T18:12:11.409610+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:24:08.839096+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":950,"num_read_kb":950,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"263'82","reported_seq":613,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:14.675990+0000","last_change":"2024-09-12T18:12:14.675990+0000","last_active":"2024-09-12T18:12:14.675990+0000","last_peered":"2024-09-12T18:12:14.675990+0000","last_clean":"2024-09-12T18:12:14.675990+0000","last_became_active":"2024-09-12T17:10:48.532817+0000","last_became_peered":"2024-09-12T17:10:48.532817+0000","last_unstale":"2024-09-12T18:12:14.675990+0000","last_undegraded":"2024-09-12T18:12:14.675990+0000","last_fullsized":"2024-09-12T18:12:14.675990+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'82","last_scrub_stamp":"2024-09-12T18:12:14.675899+0000","last_deep_scrub":"263'82","last_deep_scrub_stamp":"2024-09-12T18:12:14.675899+0000","last_clean_scrub_stamp":"2024-09-12T18:12:14.675899+0000","objects_scrubbed":5,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:42:48.311031+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":90,"num_read_kb":85,"num_write":60,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"263'763","reported_seq":2412,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:05.704731+0000","last_change":"2024-09-12T18:12:05.704731+0000","last_active":"2024-09-12T18:12:05.704731+0000","last_peered":"2024-09-12T18:12:05.704731+0000","last_clean":"2024-09-12T18:12:05.704731+0000","last_became_active":"2024-09-12T17:10:50.563002+0000","last_became_peered":"2024-09-12T17:10:50.563002+0000","last_unstale":"2024-09-12T18:12:05.704731+0000","last_undegraded":"2024-09-12T18:12:05.704731+0000","last_fullsized":"2024-09-12T18:12:05.704731+0000","mapping_epoch":32,"log_start":"263'700","ondisk_log_start":"263'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'763","last_scrub_stamp":"2024-09-12T18:12:05.704624+0000","last_deep_scrub":"263'763","last_deep_scrub_stamp":"2024-09-12T18:12:05.704624+0000","last_clean_scrub_stamp":"2024-09-12T18:12:05.704624+0000","objects_scrubbed":1,"log_size":63,"log_dups_size":700,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:44:52.539626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"263'147","reported_seq":655,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:18.340470+0000","last_change":"2024-09-12T18:12:18.340470+0000","last_active":"2024-09-12T18:12:18.340470+0000","last_peered":"2024-09-12T18:12:18.340470+0000","last_clean":"2024-09-12T18:12:18.340470+0000","last_became_active":"2024-09-12T17:10:52.570643+0000","last_became_peered":"2024-09-12T17:10:52.570643+0000","last_unstale":"2024-09-12T18:12:18.340470+0000","last_undegraded":"2024-09-12T18:12:18.340470+0000","last_fullsized":"2024-09-12T18:12:18.340470+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'147","last_scrub_stamp":"2024-09-12T18:12:18.340367+0000","last_deep_scrub":"263'147","last_deep_scrub_stamp":"2024-09-12T18:12:18.340367+0000","last_clean_scrub_stamp":"2024-09-12T18:12:18.340367+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:28:45.461673+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":160,"num_read_kb":158,"num_write":329,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"263'806","reported_seq":2293,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:57.545434+0000","last_change":"2024-09-12T18:11:57.545434+0000","last_active":"2024-09-12T18:11:57.545434+0000","last_peered":"2024-09-12T18:11:57.545434+0000","last_clean":"2024-09-12T18:11:57.545434+0000","last_became_active":"2024-09-12T17:10:44.518111+0000","last_became_peered":"2024-09-12T17:10:44.518111+0000","last_unstale":"2024-09-12T18:11:57.545434+0000","last_undegraded":"2024-09-12T18:11:57.545434+0000","last_fullsized":"2024-09-12T18:11:57.545434+0000","mapping_epoch":26,"log_start":"263'700","ondisk_log_start":"263'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'806","last_scrub_stamp":"2024-09-12T18:11:57.545339+0000","last_deep_scrub":"263'806","last_deep_scrub_stamp":"2024-09-12T18:11:57.545339+0000","last_clean_scrub_stamp":"2024-09-12T18:11:57.545339+0000","objects_scrubbed":2,"log_size":106,"log_dups_size":700,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:34:03.644456+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3856,"num_read_kb":3439,"num_write":1073,"num_write_kb":406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"263'210","reported_seq":838,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:48.517973+0000","last_change":"2024-09-12T18:11:48.517973+0000","last_active":"2024-09-12T18:11:48.517973+0000","last_peered":"2024-09-12T18:11:48.517973+0000","last_clean":"2024-09-12T18:11:48.517973+0000","last_became_active":"2024-09-12T17:10:42.522669+0000","last_became_peered":"2024-09-12T17:10:42.522669+0000","last_unstale":"2024-09-12T18:11:48.517973+0000","last_undegraded":"2024-09-12T18:11:48.517973+0000","last_fullsized":"2024-09-12T18:11:48.517973+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'210","last_scrub_stamp":"2024-09-12T18:11:48.517865+0000","last_deep_scrub":"263'210","last_deep_scrub_stamp":"2024-09-12T18:11:48.517865+0000","last_clean_scrub_stamp":"2024-09-12T18:11:48.517865+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:15:40.427265+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":435,"num_read_kb":8704,"num_write":950,"num_write_kb":27929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,4],"acting":[3,1,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":512,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:06.336266+0000","last_change":"2024-09-12T18:12:06.336266+0000","last_active":"2024-09-12T18:12:06.336266+0000","last_peered":"2024-09-12T18:12:06.336266+0000","last_clean":"2024-09-12T18:12:06.336266+0000","last_became_active":"2024-09-12T17:10:46.533572+0000","last_became_peered":"2024-09-12T17:10:46.533572+0000","last_unstale":"2024-09-12T18:12:06.336266+0000","last_undegraded":"2024-09-12T18:12:06.336266+0000","last_fullsized":"2024-09-12T18:12:06.336266+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:06.336175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:06.336175+0000","last_clean_scrub_stamp":"2024-09-12T18:12:06.336175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:37:00.694932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"263'255","reported_seq":873,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:12.386853+0000","last_change":"2024-09-12T18:12:12.386853+0000","last_active":"2024-09-12T18:12:12.386853+0000","last_peered":"2024-09-12T18:12:12.386853+0000","last_clean":"2024-09-12T18:12:12.386853+0000","last_became_active":"2024-09-12T17:10:48.542616+0000","last_became_peered":"2024-09-12T17:10:48.542616+0000","last_unstale":"2024-09-12T18:12:12.386853+0000","last_undegraded":"2024-09-12T18:12:12.386853+0000","last_fullsized":"2024-09-12T18:12:12.386853+0000","mapping_epoch":30,"log_start":"263'200","ondisk_log_start":"263'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'255","last_scrub_stamp":"2024-09-12T18:12:12.386728+0000","last_deep_scrub":"263'255","last_deep_scrub_stamp":"2024-09-12T18:12:12.386728+0000","last_clean_scrub_stamp":"2024-09-12T18:12:12.386728+0000","objects_scrubbed":9,"log_size":55,"log_dups_size":200,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:10:23.253010+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5964,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":933,"num_read_kb":1007,"num_write":1456,"num_write_kb":1313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":489246,"num_omap_keys":1130,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":498,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:03.738357+0000","last_change":"2024-09-12T18:12:03.738357+0000","last_active":"2024-09-12T18:12:03.738357+0000","last_peered":"2024-09-12T18:12:03.738357+0000","last_clean":"2024-09-12T18:12:03.738357+0000","last_became_active":"2024-09-12T17:10:50.550189+0000","last_became_peered":"2024-09-12T17:10:50.550189+0000","last_unstale":"2024-09-12T18:12:03.738357+0000","last_undegraded":"2024-09-12T18:12:03.738357+0000","last_fullsized":"2024-09-12T18:12:03.738357+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:03.738233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:03.738233+0000","last_clean_scrub_stamp":"2024-09-12T18:12:03.738233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:20:01.107417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"263'166","reported_seq":683,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:12.478687+0000","last_change":"2024-09-12T18:12:12.478687+0000","last_active":"2024-09-12T18:12:12.478687+0000","last_peered":"2024-09-12T18:12:12.478687+0000","last_clean":"2024-09-12T18:12:12.478687+0000","last_became_active":"2024-09-12T17:10:52.572508+0000","last_became_peered":"2024-09-12T17:10:52.572508+0000","last_unstale":"2024-09-12T18:12:12.478687+0000","last_undegraded":"2024-09-12T18:12:12.478687+0000","last_fullsized":"2024-09-12T18:12:12.478687+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'166","last_scrub_stamp":"2024-09-12T18:12:12.478578+0000","last_deep_scrub":"263'166","last_deep_scrub_stamp":"2024-09-12T18:12:12.478578+0000","last_clean_scrub_stamp":"2024-09-12T18:12:12.478578+0000","objects_scrubbed":4,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:48:01.094220+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":869,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":242,"num_read_kb":227,"num_write":399,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"263'2315","reported_seq":3936,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:54.768516+0000","last_change":"2024-09-12T18:11:54.768516+0000","last_active":"2024-09-12T18:11:54.768516+0000","last_peered":"2024-09-12T18:11:54.768516+0000","last_clean":"2024-09-12T18:11:54.768516+0000","last_became_active":"2024-09-12T17:10:44.515045+0000","last_became_peered":"2024-09-12T17:10:44.515045+0000","last_unstale":"2024-09-12T18:11:54.768516+0000","last_undegraded":"2024-09-12T18:11:54.768516+0000","last_fullsized":"2024-09-12T18:11:54.768516+0000","mapping_epoch":26,"log_start":"263'2300","ondisk_log_start":"263'2300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2315","last_scrub_stamp":"2024-09-12T18:11:54.768411+0000","last_deep_scrub":"263'2315","last_deep_scrub_stamp":"2024-09-12T18:11:54.768411+0000","last_clean_scrub_stamp":"2024-09-12T18:11:54.768411+0000","objects_scrubbed":2,"log_size":15,"log_dups_size":2300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:01:21.144459+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10108,"num_read_kb":8675,"num_write":3400,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"263'74","reported_seq":623,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:48.454708+0000","last_change":"2024-09-12T18:11:48.454645+0000","last_active":"2024-09-12T18:11:48.454708+0000","last_peered":"2024-09-12T18:11:48.454708+0000","last_clean":"2024-09-12T18:11:48.454708+0000","last_became_active":"2024-09-12T17:10:26.807964+0000","last_became_peered":"2024-09-12T17:10:26.807964+0000","last_unstale":"2024-09-12T18:11:48.454708+0000","last_undegraded":"2024-09-12T18:11:48.454708+0000","last_fullsized":"2024-09-12T18:11:48.454708+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'74","last_scrub_stamp":"2024-09-12T18:11:48.454546+0000","last_deep_scrub":"263'74","last_deep_scrub_stamp":"2024-09-12T18:11:48.454546+0000","last_clean_scrub_stamp":"2024-09-12T18:11:48.454546+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:42:01.929137+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"263'2","reported_seq":533,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:53.320142+0000","last_change":"2024-09-12T18:11:53.320142+0000","last_active":"2024-09-12T18:11:53.320142+0000","last_peered":"2024-09-12T18:11:53.320142+0000","last_clean":"2024-09-12T18:11:53.320142+0000","last_became_active":"2024-09-12T17:10:31.846572+0000","last_became_peered":"2024-09-12T17:10:31.846572+0000","last_unstale":"2024-09-12T18:11:53.320142+0000","last_undegraded":"2024-09-12T18:11:53.320142+0000","last_fullsized":"2024-09-12T18:11:53.320142+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T18:11:53.320051+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T18:11:53.320051+0000","last_clean_scrub_stamp":"2024-09-12T18:11:53.320051+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:30:24.755502+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.00060306800000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"263'227","reported_seq":856,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:46.512390+0000","last_change":"2024-09-12T18:11:46.512390+0000","last_active":"2024-09-12T18:11:46.512390+0000","last_peered":"2024-09-12T18:11:46.512390+0000","last_clean":"2024-09-12T18:11:46.512390+0000","last_became_active":"2024-09-12T17:10:42.527288+0000","last_became_peered":"2024-09-12T17:10:42.527288+0000","last_unstale":"2024-09-12T18:11:46.512390+0000","last_undegraded":"2024-09-12T18:11:46.512390+0000","last_fullsized":"2024-09-12T18:11:46.512390+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'227","last_scrub_stamp":"2024-09-12T18:11:46.512298+0000","last_deep_scrub":"263'227","last_deep_scrub_stamp":"2024-09-12T18:11:46.512298+0000","last_clean_scrub_stamp":"2024-09-12T18:11:46.512298+0000","objects_scrubbed":3,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:55:14.060256+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":95,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":424,"num_read_kb":3487,"num_write":1109,"num_write_kb":42610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6,4],"acting":[3,5,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"263'4","reported_seq":985,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:06.580020+0000","last_change":"2024-09-12T18:12:06.580020+0000","last_active":"2024-09-12T18:12:06.580020+0000","last_peered":"2024-09-12T18:12:06.580020+0000","last_clean":"2024-09-12T18:12:06.580020+0000","last_became_active":"2024-09-12T17:10:46.523069+0000","last_became_peered":"2024-09-12T17:10:46.523069+0000","last_unstale":"2024-09-12T18:12:06.580020+0000","last_undegraded":"2024-09-12T18:12:06.580020+0000","last_fullsized":"2024-09-12T18:12:06.580020+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-09-12T18:12:06.579875+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-09-12T18:12:06.579875+0000","last_clean_scrub_stamp":"2024-09-12T18:12:06.579875+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:55:16.328100+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":722,"num_read_kb":720,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"263'325","reported_seq":1034,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:14.453279+0000","last_change":"2024-09-12T18:12:14.453279+0000","last_active":"2024-09-12T18:12:14.453279+0000","last_peered":"2024-09-12T18:12:14.453279+0000","last_clean":"2024-09-12T18:12:14.453279+0000","last_became_active":"2024-09-12T17:10:48.542462+0000","last_became_peered":"2024-09-12T17:10:48.542462+0000","last_unstale":"2024-09-12T18:12:14.453279+0000","last_undegraded":"2024-09-12T18:12:14.453279+0000","last_fullsized":"2024-09-12T18:12:14.453279+0000","mapping_epoch":30,"log_start":"263'300","ondisk_log_start":"263'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'325","last_scrub_stamp":"2024-09-12T18:12:14.453164+0000","last_deep_scrub":"263'325","last_deep_scrub_stamp":"2024-09-12T18:12:14.453164+0000","last_clean_scrub_stamp":"2024-09-12T18:12:14.453164+0000","objects_scrubbed":6,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:09:40.928743+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37371,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":611,"num_read_kb":866,"num_write":568,"num_write_kb":434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":106660,"num_omap_keys":256,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:12.674548+0000","last_change":"2024-09-12T18:12:12.674548+0000","last_active":"2024-09-12T18:12:12.674548+0000","last_peered":"2024-09-12T18:12:12.674548+0000","last_clean":"2024-09-12T18:12:12.674548+0000","last_became_active":"2024-09-12T17:10:50.558129+0000","last_became_peered":"2024-09-12T17:10:50.558129+0000","last_unstale":"2024-09-12T18:12:12.674548+0000","last_undegraded":"2024-09-12T18:12:12.674548+0000","last_fullsized":"2024-09-12T18:12:12.674548+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:12.674459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:12.674459+0000","last_clean_scrub_stamp":"2024-09-12T18:12:12.674459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:23:39.886250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"263'217","reported_seq":942,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:09.712447+0000","last_change":"2024-09-12T18:12:09.712447+0000","last_active":"2024-09-12T18:12:09.712447+0000","last_peered":"2024-09-12T18:12:09.712447+0000","last_clean":"2024-09-12T18:12:09.712447+0000","last_became_active":"2024-09-12T17:10:52.574433+0000","last_became_peered":"2024-09-12T17:10:52.574433+0000","last_unstale":"2024-09-12T18:12:09.712447+0000","last_undegraded":"2024-09-12T18:12:09.712447+0000","last_fullsized":"2024-09-12T18:12:09.712447+0000","mapping_epoch":34,"log_start":"263'200","ondisk_log_start":"263'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'217","last_scrub_stamp":"2024-09-12T18:12:09.712350+0000","last_deep_scrub":"263'217","last_deep_scrub_stamp":"2024-09-12T18:12:09.712350+0000","last_clean_scrub_stamp":"2024-09-12T18:12:09.712350+0000","objects_scrubbed":4,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:24:37.061346+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":852,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":555,"num_read_kb":537,"num_write":455,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":66,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"263'583","reported_seq":2177,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:55.730687+0000","last_change":"2024-09-12T18:11:55.730687+0000","last_active":"2024-09-12T18:11:55.730687+0000","last_peered":"2024-09-12T18:11:55.730687+0000","last_clean":"2024-09-12T18:11:55.730687+0000","last_became_active":"2024-09-12T17:10:44.520484+0000","last_became_peered":"2024-09-12T17:10:44.520484+0000","last_unstale":"2024-09-12T18:11:55.730687+0000","last_undegraded":"2024-09-12T18:11:55.730687+0000","last_fullsized":"2024-09-12T18:11:55.730687+0000","mapping_epoch":26,"log_start":"263'500","ondisk_log_start":"263'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'583","last_scrub_stamp":"2024-09-12T18:11:55.730573+0000","last_deep_scrub":"263'583","last_deep_scrub_stamp":"2024-09-12T18:11:55.730573+0000","last_clean_scrub_stamp":"2024-09-12T18:11:55.730573+0000","objects_scrubbed":1,"log_size":83,"log_dups_size":500,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:47:46.532008+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3105,"num_read_kb":2836,"num_write":745,"num_write_kb":252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":529,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:49.492647+0000","last_change":"2024-09-12T18:11:49.492585+0000","last_active":"2024-09-12T18:11:49.492647+0000","last_peered":"2024-09-12T18:11:49.492647+0000","last_clean":"2024-09-12T18:11:49.492647+0000","last_became_active":"2024-09-12T17:10:31.848972+0000","last_became_peered":"2024-09-12T17:10:31.848972+0000","last_unstale":"2024-09-12T18:11:49.492647+0000","last_undegraded":"2024-09-12T18:11:49.492647+0000","last_fullsized":"2024-09-12T18:11:49.492647+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:11:49.492494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:11:49.492494+0000","last_clean_scrub_stamp":"2024-09-12T18:11:49.492494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:54:40.685079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054881099999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"263'247","reported_seq":900,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:44.672013+0000","last_change":"2024-09-12T18:11:44.672013+0000","last_active":"2024-09-12T18:11:44.672013+0000","last_peered":"2024-09-12T18:11:44.672013+0000","last_clean":"2024-09-12T18:11:44.672013+0000","last_became_active":"2024-09-12T17:10:42.518190+0000","last_became_peered":"2024-09-12T17:10:42.518190+0000","last_unstale":"2024-09-12T18:11:44.672013+0000","last_undegraded":"2024-09-12T18:11:44.672013+0000","last_fullsized":"2024-09-12T18:11:44.672013+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'247","last_scrub_stamp":"2024-09-12T18:11:44.671868+0000","last_deep_scrub":"263'247","last_deep_scrub_stamp":"2024-09-12T18:11:44.671868+0000","last_clean_scrub_stamp":"2024-09-12T18:11:44.671868+0000","objects_scrubbed":3,"log_size":47,"log_dups_size":200,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:21:51.032960+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":522,"num_read_kb":6824,"num_write":1149,"num_write_kb":47378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3,5],"acting":[0,4,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":505,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:08.487418+0000","last_change":"2024-09-12T18:12:08.487418+0000","last_active":"2024-09-12T18:12:08.487418+0000","last_peered":"2024-09-12T18:12:08.487418+0000","last_clean":"2024-09-12T18:12:08.487418+0000","last_became_active":"2024-09-12T17:10:46.528192+0000","last_became_peered":"2024-09-12T17:10:46.528192+0000","last_unstale":"2024-09-12T18:12:08.487418+0000","last_undegraded":"2024-09-12T18:12:08.487418+0000","last_fullsized":"2024-09-12T18:12:08.487418+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:08.487317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:08.487317+0000","last_clean_scrub_stamp":"2024-09-12T18:12:08.487317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:16:35.101051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"263'884","reported_seq":2553,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:07.517456+0000","last_change":"2024-09-12T18:12:07.517456+0000","last_active":"2024-09-12T18:12:07.517456+0000","last_peered":"2024-09-12T18:12:07.517456+0000","last_clean":"2024-09-12T18:12:07.517456+0000","last_became_active":"2024-09-12T17:10:48.544823+0000","last_became_peered":"2024-09-12T17:10:48.544823+0000","last_unstale":"2024-09-12T18:12:07.517456+0000","last_undegraded":"2024-09-12T18:12:07.517456+0000","last_fullsized":"2024-09-12T18:12:07.517456+0000","mapping_epoch":30,"log_start":"263'800","ondisk_log_start":"263'800","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'884","last_scrub_stamp":"2024-09-12T18:12:07.517337+0000","last_deep_scrub":"263'884","last_deep_scrub_stamp":"2024-09-12T18:12:07.517337+0000","last_clean_scrub_stamp":"2024-09-12T18:12:07.517337+0000","objects_scrubbed":11,"log_size":84,"log_dups_size":800,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:11:07.692251+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19071,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1197,"num_read_kb":1359,"num_write":312,"num_write_kb":143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6238,"num_omap_keys":18,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:16.624404+0000","last_change":"2024-09-12T18:12:16.624404+0000","last_active":"2024-09-12T18:12:16.624404+0000","last_peered":"2024-09-12T18:12:16.624404+0000","last_clean":"2024-09-12T18:12:16.624404+0000","last_became_active":"2024-09-12T17:10:50.557660+0000","last_became_peered":"2024-09-12T17:10:50.557660+0000","last_unstale":"2024-09-12T18:12:16.624404+0000","last_undegraded":"2024-09-12T18:12:16.624404+0000","last_fullsized":"2024-09-12T18:12:16.624404+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:16.624312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:16.624312+0000","last_clean_scrub_stamp":"2024-09-12T18:12:16.624312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:46:22.828612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"263'190","reported_seq":765,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:14.477632+0000","last_change":"2024-09-12T18:12:14.477632+0000","last_active":"2024-09-12T18:12:14.477632+0000","last_peered":"2024-09-12T18:12:14.477632+0000","last_clean":"2024-09-12T18:12:14.477632+0000","last_became_active":"2024-09-12T17:10:52.671120+0000","last_became_peered":"2024-09-12T17:10:52.671120+0000","last_unstale":"2024-09-12T18:12:14.477632+0000","last_undegraded":"2024-09-12T18:12:14.477632+0000","last_fullsized":"2024-09-12T18:12:14.477632+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'190","last_scrub_stamp":"2024-09-12T18:12:14.477532+0000","last_deep_scrub":"263'190","last_deep_scrub_stamp":"2024-09-12T18:12:14.477532+0000","last_clean_scrub_stamp":"2024-09-12T18:12:14.477532+0000","objects_scrubbed":3,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:51:56.384984+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":855,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":437,"num_read_kb":369,"num_write":356,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"263'341","reported_seq":1699,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:54.594576+0000","last_change":"2024-09-12T18:11:54.594576+0000","last_active":"2024-09-12T18:11:54.594576+0000","last_peered":"2024-09-12T18:11:54.594576+0000","last_clean":"2024-09-12T18:11:54.594576+0000","last_became_active":"2024-09-12T17:10:44.516640+0000","last_became_peered":"2024-09-12T17:10:44.516640+0000","last_unstale":"2024-09-12T18:11:54.594576+0000","last_undegraded":"2024-09-12T18:11:54.594576+0000","last_fullsized":"2024-09-12T18:11:54.594576+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'341","last_scrub_stamp":"2024-09-12T18:11:54.594493+0000","last_deep_scrub":"263'341","last_deep_scrub_stamp":"2024-09-12T18:11:54.594493+0000","last_clean_scrub_stamp":"2024-09-12T18:11:54.594493+0000","objects_scrubbed":3,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:23:17.401626+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1748,"num_read_kb":1673,"num_write":375,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":527,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:45.850440+0000","last_change":"2024-09-12T18:11:45.850440+0000","last_active":"2024-09-12T18:11:45.850440+0000","last_peered":"2024-09-12T18:11:45.850440+0000","last_clean":"2024-09-12T18:11:45.850440+0000","last_became_active":"2024-09-12T17:10:31.841982+0000","last_became_peered":"2024-09-12T17:10:31.841982+0000","last_unstale":"2024-09-12T18:11:45.850440+0000","last_undegraded":"2024-09-12T18:11:45.850440+0000","last_fullsized":"2024-09-12T18:11:45.850440+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:11:45.850369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:11:45.850369+0000","last_clean_scrub_stamp":"2024-09-12T18:11:45.850369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:50:52.981654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00030998799999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"263'168","reported_seq":791,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:47.720241+0000","last_change":"2024-09-12T18:11:47.720241+0000","last_active":"2024-09-12T18:11:47.720241+0000","last_peered":"2024-09-12T18:11:47.720241+0000","last_clean":"2024-09-12T18:11:47.720241+0000","last_became_active":"2024-09-12T17:10:42.509396+0000","last_became_peered":"2024-09-12T17:10:42.509396+0000","last_unstale":"2024-09-12T18:11:47.720241+0000","last_undegraded":"2024-09-12T18:11:47.720241+0000","last_fullsized":"2024-09-12T18:11:47.720241+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'168","last_scrub_stamp":"2024-09-12T18:11:47.720156+0000","last_deep_scrub":"263'168","last_deep_scrub_stamp":"2024-09-12T18:11:47.720156+0000","last_clean_scrub_stamp":"2024-09-12T18:11:47.720156+0000","objects_scrubbed":3,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:45:50.082004+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":350137,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":379,"num_read_kb":11016,"num_write":845,"num_write_kb":10341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6,5],"acting":[1,2,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"263'2","reported_seq":505,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:01.753020+0000","last_change":"2024-09-12T18:12:01.753020+0000","last_active":"2024-09-12T18:12:01.753020+0000","last_peered":"2024-09-12T18:12:01.753020+0000","last_clean":"2024-09-12T18:12:01.753020+0000","last_became_active":"2024-09-12T17:10:46.528878+0000","last_became_peered":"2024-09-12T17:10:46.528878+0000","last_unstale":"2024-09-12T18:12:01.753020+0000","last_undegraded":"2024-09-12T18:12:01.753020+0000","last_fullsized":"2024-09-12T18:12:01.753020+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T18:12:01.752936+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T18:12:01.752936+0000","last_clean_scrub_stamp":"2024-09-12T18:12:01.752936+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:05:28.456818+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"263'259","reported_seq":1529,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:10.570833+0000","last_change":"2024-09-12T18:12:10.570833+0000","last_active":"2024-09-12T18:12:10.570833+0000","last_peered":"2024-09-12T18:12:10.570833+0000","last_clean":"2024-09-12T18:12:10.570833+0000","last_became_active":"2024-09-12T17:10:48.543196+0000","last_became_peered":"2024-09-12T17:10:48.543196+0000","last_unstale":"2024-09-12T18:12:10.570833+0000","last_undegraded":"2024-09-12T18:12:10.570833+0000","last_fullsized":"2024-09-12T18:12:10.570833+0000","mapping_epoch":30,"log_start":"263'200","ondisk_log_start":"263'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'259","last_scrub_stamp":"2024-09-12T18:12:10.570716+0000","last_deep_scrub":"263'259","last_deep_scrub_stamp":"2024-09-12T18:12:10.570716+0000","last_clean_scrub_stamp":"2024-09-12T18:12:10.570716+0000","objects_scrubbed":9,"log_size":59,"log_dups_size":200,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:18:05.341247+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":209,"num_read_kb":201,"num_write":185,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5582,"num_omap_keys":14,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":503,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:11.670935+0000","last_change":"2024-09-12T18:12:11.670935+0000","last_active":"2024-09-12T18:12:11.670935+0000","last_peered":"2024-09-12T18:12:11.670935+0000","last_clean":"2024-09-12T18:12:11.670935+0000","last_became_active":"2024-09-12T17:10:50.558980+0000","last_became_peered":"2024-09-12T17:10:50.558980+0000","last_unstale":"2024-09-12T18:12:11.670935+0000","last_undegraded":"2024-09-12T18:12:11.670935+0000","last_fullsized":"2024-09-12T18:12:11.670935+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:11.670829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:11.670829+0000","last_clean_scrub_stamp":"2024-09-12T18:12:11.670829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:54:18.253183+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"263'258","reported_seq":864,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:24.683507+0000","last_change":"2024-09-12T18:12:24.683507+0000","last_active":"2024-09-12T18:12:24.683507+0000","last_peered":"2024-09-12T18:12:24.683507+0000","last_clean":"2024-09-12T18:12:24.683507+0000","last_became_active":"2024-09-12T17:10:52.563885+0000","last_became_peered":"2024-09-12T17:10:52.563885+0000","last_unstale":"2024-09-12T18:12:24.683507+0000","last_undegraded":"2024-09-12T18:12:24.683507+0000","last_fullsized":"2024-09-12T18:12:24.683507+0000","mapping_epoch":34,"log_start":"263'200","ondisk_log_start":"263'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'258","last_scrub_stamp":"2024-09-12T18:12:24.683417+0000","last_deep_scrub":"263'258","last_deep_scrub_stamp":"2024-09-12T18:12:24.683417+0000","last_clean_scrub_stamp":"2024-09-12T18:12:24.683417+0000","objects_scrubbed":2,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:16:31.315453+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":520,"num_read_kb":542,"num_write":569,"num_write_kb":161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1193,"num_omap_keys":7,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"263'669","reported_seq":2221,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:55.553257+0000","last_change":"2024-09-12T18:11:55.553257+0000","last_active":"2024-09-12T18:11:55.553257+0000","last_peered":"2024-09-12T18:11:55.553257+0000","last_clean":"2024-09-12T18:11:55.553257+0000","last_became_active":"2024-09-12T17:10:44.515807+0000","last_became_peered":"2024-09-12T17:10:44.515807+0000","last_unstale":"2024-09-12T18:11:55.553257+0000","last_undegraded":"2024-09-12T18:11:55.553257+0000","last_fullsized":"2024-09-12T18:11:55.553257+0000","mapping_epoch":26,"log_start":"263'600","ondisk_log_start":"263'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'669","last_scrub_stamp":"2024-09-12T18:11:55.553162+0000","last_deep_scrub":"263'669","last_deep_scrub_stamp":"2024-09-12T18:11:55.553162+0000","last_clean_scrub_stamp":"2024-09-12T18:11:55.553162+0000","objects_scrubbed":5,"log_size":69,"log_dups_size":600,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:56:28.156022+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3415,"num_read_kb":3057,"num_write":984,"num_write_kb":466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":477,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"263'3","reported_seq":534,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:47.214677+0000","last_change":"2024-09-12T18:11:47.214677+0000","last_active":"2024-09-12T18:11:47.214677+0000","last_peered":"2024-09-12T18:11:47.214677+0000","last_clean":"2024-09-12T18:11:47.214677+0000","last_became_active":"2024-09-12T17:10:31.849085+0000","last_became_peered":"2024-09-12T17:10:31.849085+0000","last_unstale":"2024-09-12T18:11:47.214677+0000","last_undegraded":"2024-09-12T18:11:47.214677+0000","last_fullsized":"2024-09-12T18:11:47.214677+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'3","last_scrub_stamp":"2024-09-12T18:11:47.214591+0000","last_deep_scrub":"263'3","last_deep_scrub_stamp":"2024-09-12T18:11:47.214591+0000","last_clean_scrub_stamp":"2024-09-12T18:11:47.214591+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:31:02.245023+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.0011727,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"263'232","reported_seq":931,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:46.498359+0000","last_change":"2024-09-12T18:11:46.498359+0000","last_active":"2024-09-12T18:11:46.498359+0000","last_peered":"2024-09-12T18:11:46.498359+0000","last_clean":"2024-09-12T18:11:46.498359+0000","last_became_active":"2024-09-12T17:10:42.529499+0000","last_became_peered":"2024-09-12T17:10:42.529499+0000","last_unstale":"2024-09-12T18:11:46.498359+0000","last_undegraded":"2024-09-12T18:11:46.498359+0000","last_fullsized":"2024-09-12T18:11:46.498359+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'232","last_scrub_stamp":"2024-09-12T18:11:46.498219+0000","last_deep_scrub":"263'232","last_deep_scrub_stamp":"2024-09-12T18:11:46.498219+0000","last_clean_scrub_stamp":"2024-09-12T18:11:46.498219+0000","objects_scrubbed":2,"log_size":32,"log_dups_size":200,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:52:39.137136+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262174,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":565,"num_read_kb":10247,"num_write":1100,"num_write_kb":30448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,6],"acting":[4,5,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":511,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:04.687350+0000","last_change":"2024-09-12T18:12:04.687350+0000","last_active":"2024-09-12T18:12:04.687350+0000","last_peered":"2024-09-12T18:12:04.687350+0000","last_clean":"2024-09-12T18:12:04.687350+0000","last_became_active":"2024-09-12T17:10:46.526136+0000","last_became_peered":"2024-09-12T17:10:46.526136+0000","last_unstale":"2024-09-12T18:12:04.687350+0000","last_undegraded":"2024-09-12T18:12:04.687350+0000","last_fullsized":"2024-09-12T18:12:04.687350+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:04.687264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:04.687264+0000","last_clean_scrub_stamp":"2024-09-12T18:12:04.687264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:47:47.732114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"263'146","reported_seq":700,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:12.632726+0000","last_change":"2024-09-12T18:12:12.632726+0000","last_active":"2024-09-12T18:12:12.632726+0000","last_peered":"2024-09-12T18:12:12.632726+0000","last_clean":"2024-09-12T18:12:12.632726+0000","last_became_active":"2024-09-12T17:10:48.536247+0000","last_became_peered":"2024-09-12T17:10:48.536247+0000","last_unstale":"2024-09-12T18:12:12.632726+0000","last_undegraded":"2024-09-12T18:12:12.632726+0000","last_fullsized":"2024-09-12T18:12:12.632726+0000","mapping_epoch":30,"log_start":"263'100","ondisk_log_start":"263'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'146","last_scrub_stamp":"2024-09-12T18:12:12.632618+0000","last_deep_scrub":"263'146","last_deep_scrub_stamp":"2024-09-12T18:12:12.632618+0000","last_clean_scrub_stamp":"2024-09-12T18:12:12.632618+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:49:46.275446+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":163,"num_read_kb":156,"num_write":120,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3226,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:02.727739+0000","last_change":"2024-09-12T18:12:02.727739+0000","last_active":"2024-09-12T18:12:02.727739+0000","last_peered":"2024-09-12T18:12:02.727739+0000","last_clean":"2024-09-12T18:12:02.727739+0000","last_became_active":"2024-09-12T17:10:50.555747+0000","last_became_peered":"2024-09-12T17:10:50.555747+0000","last_unstale":"2024-09-12T18:12:02.727739+0000","last_undegraded":"2024-09-12T18:12:02.727739+0000","last_fullsized":"2024-09-12T18:12:02.727739+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:02.727650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:02.727650+0000","last_clean_scrub_stamp":"2024-09-12T18:12:02.727650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:59:58.866824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"263'123","reported_seq":676,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:19.515646+0000","last_change":"2024-09-12T18:12:19.515646+0000","last_active":"2024-09-12T18:12:19.515646+0000","last_peered":"2024-09-12T18:12:19.515646+0000","last_clean":"2024-09-12T18:12:19.515646+0000","last_became_active":"2024-09-12T17:10:52.574956+0000","last_became_peered":"2024-09-12T17:10:52.574956+0000","last_unstale":"2024-09-12T18:12:19.515646+0000","last_undegraded":"2024-09-12T18:12:19.515646+0000","last_fullsized":"2024-09-12T18:12:19.515646+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'123","last_scrub_stamp":"2024-09-12T18:12:19.515561+0000","last_deep_scrub":"263'123","last_deep_scrub_stamp":"2024-09-12T18:12:19.515561+0000","last_clean_scrub_stamp":"2024-09-12T18:12:19.515561+0000","objects_scrubbed":1,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:43:22.393991+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":427,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":242,"num_read_kb":241,"num_write":285,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"263'473","reported_seq":2087,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:53.613963+0000","last_change":"2024-09-12T18:11:53.613963+0000","last_active":"2024-09-12T18:11:53.613963+0000","last_peered":"2024-09-12T18:11:53.613963+0000","last_clean":"2024-09-12T18:11:53.613963+0000","last_became_active":"2024-09-12T17:10:44.516258+0000","last_became_peered":"2024-09-12T17:10:44.516258+0000","last_unstale":"2024-09-12T18:11:53.613963+0000","last_undegraded":"2024-09-12T18:11:53.613963+0000","last_fullsized":"2024-09-12T18:11:53.613963+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'473","last_scrub_stamp":"2024-09-12T18:11:53.613870+0000","last_deep_scrub":"263'473","last_deep_scrub_stamp":"2024-09-12T18:11:53.613870+0000","last_clean_scrub_stamp":"2024-09-12T18:11:53.613870+0000","objects_scrubbed":2,"log_size":73,"log_dups_size":400,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:01:14.309219+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2512,"num_read_kb":2369,"num_write":577,"num_write_kb":149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"263'182","reported_seq":889,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:57.349904+0000","last_change":"2024-09-12T18:11:57.349904+0000","last_active":"2024-09-12T18:11:57.349904+0000","last_peered":"2024-09-12T18:11:57.349904+0000","last_clean":"2024-09-12T18:11:57.349904+0000","last_became_active":"2024-09-12T17:10:42.520777+0000","last_became_peered":"2024-09-12T17:10:42.520777+0000","last_unstale":"2024-09-12T18:11:57.349904+0000","last_undegraded":"2024-09-12T18:11:57.349904+0000","last_fullsized":"2024-09-12T18:11:57.349904+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'182","last_scrub_stamp":"2024-09-12T18:11:57.349756+0000","last_deep_scrub":"263'182","last_deep_scrub_stamp":"2024-09-12T18:11:57.349756+0000","last_clean_scrub_stamp":"2024-09-12T18:11:57.349756+0000","objects_scrubbed":4,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:09:50.642477+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":574,"num_read_kb":36969,"num_write":896,"num_write_kb":42705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":537,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:45.674428+0000","last_change":"2024-09-12T18:11:45.674428+0000","last_active":"2024-09-12T18:11:45.674428+0000","last_peered":"2024-09-12T18:11:45.674428+0000","last_clean":"2024-09-12T18:11:45.674428+0000","last_became_active":"2024-09-12T17:10:32.177463+0000","last_became_peered":"2024-09-12T17:10:32.177463+0000","last_unstale":"2024-09-12T18:11:45.674428+0000","last_undegraded":"2024-09-12T18:11:45.674428+0000","last_fullsized":"2024-09-12T18:11:45.674428+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:11:45.674357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:11:45.674357+0000","last_clean_scrub_stamp":"2024-09-12T18:11:45.674357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:46:59.598150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059857599999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":511,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:03.662959+0000","last_change":"2024-09-12T18:12:03.662959+0000","last_active":"2024-09-12T18:12:03.662959+0000","last_peered":"2024-09-12T18:12:03.662959+0000","last_clean":"2024-09-12T18:12:03.662959+0000","last_became_active":"2024-09-12T17:10:46.528499+0000","last_became_peered":"2024-09-12T17:10:46.528499+0000","last_unstale":"2024-09-12T18:12:03.662959+0000","last_undegraded":"2024-09-12T18:12:03.662959+0000","last_fullsized":"2024-09-12T18:12:03.662959+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:03.662874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:03.662874+0000","last_clean_scrub_stamp":"2024-09-12T18:12:03.662874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:25:39.425009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"263'284","reported_seq":964,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:06.718101+0000","last_change":"2024-09-12T18:12:06.718101+0000","last_active":"2024-09-12T18:12:06.718101+0000","last_peered":"2024-09-12T18:12:06.718101+0000","last_clean":"2024-09-12T18:12:06.718101+0000","last_became_active":"2024-09-12T17:10:48.539913+0000","last_became_peered":"2024-09-12T17:10:48.539913+0000","last_unstale":"2024-09-12T18:12:06.718101+0000","last_undegraded":"2024-09-12T18:12:06.718101+0000","last_fullsized":"2024-09-12T18:12:06.718101+0000","mapping_epoch":30,"log_start":"260'200","ondisk_log_start":"260'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'284","last_scrub_stamp":"2024-09-12T18:12:06.717998+0000","last_deep_scrub":"263'284","last_deep_scrub_stamp":"2024-09-12T18:12:06.717998+0000","last_clean_scrub_stamp":"2024-09-12T18:12:06.717998+0000","objects_scrubbed":10,"log_size":84,"log_dups_size":200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:18:50.263181+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10695,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":387,"num_read_kb":478,"num_write":220,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4334,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":506,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:15.327262+0000","last_change":"2024-09-12T18:12:15.327262+0000","last_active":"2024-09-12T18:12:15.327262+0000","last_peered":"2024-09-12T18:12:15.327262+0000","last_clean":"2024-09-12T18:12:15.327262+0000","last_became_active":"2024-09-12T17:10:50.555068+0000","last_became_peered":"2024-09-12T17:10:50.555068+0000","last_unstale":"2024-09-12T18:12:15.327262+0000","last_undegraded":"2024-09-12T18:12:15.327262+0000","last_fullsized":"2024-09-12T18:12:15.327262+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:15.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:15.327146+0000","last_clean_scrub_stamp":"2024-09-12T18:12:15.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:35:28.660361+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"263'157","reported_seq":671,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:20.655030+0000","last_change":"2024-09-12T18:12:20.655030+0000","last_active":"2024-09-12T18:12:20.655030+0000","last_peered":"2024-09-12T18:12:20.655030+0000","last_clean":"2024-09-12T18:12:20.655030+0000","last_became_active":"2024-09-12T17:10:52.671238+0000","last_became_peered":"2024-09-12T17:10:52.671238+0000","last_unstale":"2024-09-12T18:12:20.655030+0000","last_undegraded":"2024-09-12T18:12:20.655030+0000","last_fullsized":"2024-09-12T18:12:20.655030+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'157","last_scrub_stamp":"2024-09-12T18:12:20.654938+0000","last_deep_scrub":"263'157","last_deep_scrub_stamp":"2024-09-12T18:12:20.654938+0000","last_clean_scrub_stamp":"2024-09-12T18:12:20.654938+0000","objects_scrubbed":4,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:56:04.155999+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":925,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":183,"num_read_kb":179,"num_write":356,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"263'542","reported_seq":2242,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:54.729977+0000","last_change":"2024-09-12T18:11:54.729977+0000","last_active":"2024-09-12T18:11:54.729977+0000","last_peered":"2024-09-12T18:11:54.729977+0000","last_clean":"2024-09-12T18:11:54.729977+0000","last_became_active":"2024-09-12T17:10:44.513543+0000","last_became_peered":"2024-09-12T17:10:44.513543+0000","last_unstale":"2024-09-12T18:11:54.729977+0000","last_undegraded":"2024-09-12T18:11:54.729977+0000","last_fullsized":"2024-09-12T18:11:54.729977+0000","mapping_epoch":26,"log_start":"263'500","ondisk_log_start":"263'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'542","last_scrub_stamp":"2024-09-12T18:11:54.729880+0000","last_deep_scrub":"263'542","last_deep_scrub_stamp":"2024-09-12T18:11:54.729880+0000","last_clean_scrub_stamp":"2024-09-12T18:11:54.729880+0000","objects_scrubbed":3,"log_size":42,"log_dups_size":500,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:17.102641+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3000,"num_read_kb":2785,"num_write":670,"num_write_kb":215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2809,"num_omap_keys":11,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"263'214","reported_seq":901,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:48.710948+0000","last_change":"2024-09-12T18:11:48.710948+0000","last_active":"2024-09-12T18:11:48.710948+0000","last_peered":"2024-09-12T18:11:48.710948+0000","last_clean":"2024-09-12T18:11:48.710948+0000","last_became_active":"2024-09-12T17:10:42.524130+0000","last_became_peered":"2024-09-12T17:10:42.524130+0000","last_unstale":"2024-09-12T18:11:48.710948+0000","last_undegraded":"2024-09-12T18:11:48.710948+0000","last_fullsized":"2024-09-12T18:11:48.710948+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'214","last_scrub_stamp":"2024-09-12T18:11:48.710850+0000","last_deep_scrub":"263'214","last_deep_scrub_stamp":"2024-09-12T18:11:48.710850+0000","last_clean_scrub_stamp":"2024-09-12T18:11:48.710850+0000","objects_scrubbed":4,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:31:10.663400+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2067952,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":586,"num_read_kb":68430,"num_write":1040,"num_write_kb":36992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,5],"acting":[1,2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":527,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:51.437825+0000","last_change":"2024-09-12T18:11:51.437825+0000","last_active":"2024-09-12T18:11:51.437825+0000","last_peered":"2024-09-12T18:11:51.437825+0000","last_clean":"2024-09-12T18:11:51.437825+0000","last_became_active":"2024-09-12T17:10:32.177457+0000","last_became_peered":"2024-09-12T17:10:32.177457+0000","last_unstale":"2024-09-12T18:11:51.437825+0000","last_undegraded":"2024-09-12T18:11:51.437825+0000","last_fullsized":"2024-09-12T18:11:51.437825+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:11:51.437714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:11:51.437714+0000","last_clean_scrub_stamp":"2024-09-12T18:11:51.437714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:34:58.844283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000468751,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":508,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:59.691132+0000","last_change":"2024-09-12T18:11:59.691132+0000","last_active":"2024-09-12T18:11:59.691132+0000","last_peered":"2024-09-12T18:11:59.691132+0000","last_clean":"2024-09-12T18:11:59.691132+0000","last_became_active":"2024-09-12T17:10:46.527299+0000","last_became_peered":"2024-09-12T17:10:46.527299+0000","last_unstale":"2024-09-12T18:11:59.691132+0000","last_undegraded":"2024-09-12T18:11:59.691132+0000","last_fullsized":"2024-09-12T18:11:59.691132+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:11:59.691048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:11:59.691048+0000","last_clean_scrub_stamp":"2024-09-12T18:11:59.691048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:17:03.709838+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"263'242","reported_seq":824,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:06.501164+0000","last_change":"2024-09-12T18:12:06.501164+0000","last_active":"2024-09-12T18:12:06.501164+0000","last_peered":"2024-09-12T18:12:06.501164+0000","last_clean":"2024-09-12T18:12:06.501164+0000","last_became_active":"2024-09-12T17:10:48.538190+0000","last_became_peered":"2024-09-12T17:10:48.538190+0000","last_unstale":"2024-09-12T18:12:06.501164+0000","last_undegraded":"2024-09-12T18:12:06.501164+0000","last_fullsized":"2024-09-12T18:12:06.501164+0000","mapping_epoch":30,"log_start":"263'200","ondisk_log_start":"263'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'242","last_scrub_stamp":"2024-09-12T18:12:06.501075+0000","last_deep_scrub":"263'242","last_deep_scrub_stamp":"2024-09-12T18:12:06.501075+0000","last_clean_scrub_stamp":"2024-09-12T18:12:06.501075+0000","objects_scrubbed":8,"log_size":42,"log_dups_size":200,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:33:45.536325+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":276,"num_read_kb":262,"num_write":250,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6602,"num_omap_keys":16,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"263'780","reported_seq":2761,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:15.471440+0000","last_change":"2024-09-12T18:12:15.471440+0000","last_active":"2024-09-12T18:12:15.471440+0000","last_peered":"2024-09-12T18:12:15.471440+0000","last_clean":"2024-09-12T18:12:15.471440+0000","last_became_active":"2024-09-12T17:10:50.561112+0000","last_became_peered":"2024-09-12T17:10:50.561112+0000","last_unstale":"2024-09-12T18:12:15.471440+0000","last_undegraded":"2024-09-12T18:12:15.471440+0000","last_fullsized":"2024-09-12T18:12:15.471440+0000","mapping_epoch":32,"log_start":"263'700","ondisk_log_start":"263'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'780","last_scrub_stamp":"2024-09-12T18:12:15.471350+0000","last_deep_scrub":"263'780","last_deep_scrub_stamp":"2024-09-12T18:12:15.471350+0000","last_clean_scrub_stamp":"2024-09-12T18:12:15.471350+0000","objects_scrubbed":1,"log_size":80,"log_dups_size":700,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:20:09.955680+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"263'99","reported_seq":619,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:25.696235+0000","last_change":"2024-09-12T18:12:25.696235+0000","last_active":"2024-09-12T18:12:25.696235+0000","last_peered":"2024-09-12T18:12:25.696235+0000","last_clean":"2024-09-12T18:12:25.696235+0000","last_became_active":"2024-09-12T17:10:52.671116+0000","last_became_peered":"2024-09-12T17:10:52.671116+0000","last_unstale":"2024-09-12T18:12:25.696235+0000","last_undegraded":"2024-09-12T18:12:25.696235+0000","last_fullsized":"2024-09-12T18:12:25.696235+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'99","last_scrub_stamp":"2024-09-12T18:12:25.696143+0000","last_deep_scrub":"263'99","last_deep_scrub_stamp":"2024-09-12T18:12:25.696143+0000","last_clean_scrub_stamp":"2024-09-12T18:12:25.696143+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:30:48.103909+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":505,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":188,"num_read_kb":171,"num_write":234,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"263'780","reported_seq":2432,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:01.710175+0000","last_change":"2024-09-12T18:12:01.710175+0000","last_active":"2024-09-12T18:12:01.710175+0000","last_peered":"2024-09-12T18:12:01.710175+0000","last_clean":"2024-09-12T18:12:01.710175+0000","last_became_active":"2024-09-12T17:10:44.511450+0000","last_became_peered":"2024-09-12T17:10:44.511450+0000","last_unstale":"2024-09-12T18:12:01.710175+0000","last_undegraded":"2024-09-12T18:12:01.710175+0000","last_fullsized":"2024-09-12T18:12:01.710175+0000","mapping_epoch":26,"log_start":"263'700","ondisk_log_start":"263'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'780","last_scrub_stamp":"2024-09-12T18:12:01.710085+0000","last_deep_scrub":"263'780","last_deep_scrub_stamp":"2024-09-12T18:12:01.710085+0000","last_clean_scrub_stamp":"2024-09-12T18:12:01.710085+0000","objects_scrubbed":3,"log_size":80,"log_dups_size":700,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:44:55.441743+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3773,"num_read_kb":3378,"num_write":1080,"num_write_kb":423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":268,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"263'167","reported_seq":757,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:47.536255+0000","last_change":"2024-09-12T18:11:47.536255+0000","last_active":"2024-09-12T18:11:47.536255+0000","last_peered":"2024-09-12T18:11:47.536255+0000","last_clean":"2024-09-12T18:11:47.536255+0000","last_became_active":"2024-09-12T17:10:42.526472+0000","last_became_peered":"2024-09-12T17:10:42.526472+0000","last_unstale":"2024-09-12T18:11:47.536255+0000","last_undegraded":"2024-09-12T18:11:47.536255+0000","last_fullsized":"2024-09-12T18:11:47.536255+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'167","last_scrub_stamp":"2024-09-12T18:11:47.536135+0000","last_deep_scrub":"263'167","last_deep_scrub_stamp":"2024-09-12T18:11:47.536135+0000","last_clean_scrub_stamp":"2024-09-12T18:11:47.536135+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":100,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:57:32.050771+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":300,"num_read_kb":1418,"num_write":797,"num_write_kb":46804,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,0],"acting":[3,5,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":536,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:46.672452+0000","last_change":"2024-09-12T18:11:46.672452+0000","last_active":"2024-09-12T18:11:46.672452+0000","last_peered":"2024-09-12T18:11:46.672452+0000","last_clean":"2024-09-12T18:11:46.672452+0000","last_became_active":"2024-09-12T17:10:31.845481+0000","last_became_peered":"2024-09-12T17:10:31.845481+0000","last_unstale":"2024-09-12T18:11:46.672452+0000","last_undegraded":"2024-09-12T18:11:46.672452+0000","last_fullsized":"2024-09-12T18:11:46.672452+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:11:46.672379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:11:46.672379+0000","last_clean_scrub_stamp":"2024-09-12T18:11:46.672379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:35:09.073477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060466100000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":514,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:09.320609+0000","last_change":"2024-09-12T18:12:09.320609+0000","last_active":"2024-09-12T18:12:09.320609+0000","last_peered":"2024-09-12T18:12:09.320609+0000","last_clean":"2024-09-12T18:12:09.320609+0000","last_became_active":"2024-09-12T17:10:46.530275+0000","last_became_peered":"2024-09-12T17:10:46.530275+0000","last_unstale":"2024-09-12T18:12:09.320609+0000","last_undegraded":"2024-09-12T18:12:09.320609+0000","last_fullsized":"2024-09-12T18:12:09.320609+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:09.320512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:09.320512+0000","last_clean_scrub_stamp":"2024-09-12T18:12:09.320512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:40:01.605587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"263'133","reported_seq":689,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:08.358290+0000","last_change":"2024-09-12T18:12:08.358290+0000","last_active":"2024-09-12T18:12:08.358290+0000","last_peered":"2024-09-12T18:12:08.358290+0000","last_clean":"2024-09-12T18:12:08.358290+0000","last_became_active":"2024-09-12T17:10:48.541795+0000","last_became_peered":"2024-09-12T17:10:48.541795+0000","last_unstale":"2024-09-12T18:12:08.358290+0000","last_undegraded":"2024-09-12T18:12:08.358290+0000","last_fullsized":"2024-09-12T18:12:08.358290+0000","mapping_epoch":30,"log_start":"263'100","ondisk_log_start":"263'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'133","last_scrub_stamp":"2024-09-12T18:12:08.358159+0000","last_deep_scrub":"263'133","last_deep_scrub_stamp":"2024-09-12T18:12:08.358159+0000","last_clean_scrub_stamp":"2024-09-12T18:12:08.358159+0000","objects_scrubbed":5,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:21:15.600207+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":142,"num_read_kb":133,"num_write":96,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"263'791","reported_seq":4459,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:19.661322+0000","last_change":"2024-09-12T18:12:19.661322+0000","last_active":"2024-09-12T18:12:19.661322+0000","last_peered":"2024-09-12T18:12:19.661322+0000","last_clean":"2024-09-12T18:12:19.661322+0000","last_became_active":"2024-09-12T17:10:50.559932+0000","last_became_peered":"2024-09-12T17:10:50.559932+0000","last_unstale":"2024-09-12T18:12:19.661322+0000","last_undegraded":"2024-09-12T18:12:19.661322+0000","last_fullsized":"2024-09-12T18:12:19.661322+0000","mapping_epoch":32,"log_start":"263'700","ondisk_log_start":"263'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'791","last_scrub_stamp":"2024-09-12T18:12:19.661251+0000","last_deep_scrub":"263'791","last_deep_scrub_stamp":"2024-09-12T18:12:19.661251+0000","last_clean_scrub_stamp":"2024-09-12T18:12:19.661251+0000","objects_scrubbed":1,"log_size":91,"log_dups_size":700,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:02:46.335094+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"263'291","reported_seq":840,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:19.674577+0000","last_change":"2024-09-12T18:12:19.674577+0000","last_active":"2024-09-12T18:12:19.674577+0000","last_peered":"2024-09-12T18:12:19.674577+0000","last_clean":"2024-09-12T18:12:19.674577+0000","last_became_active":"2024-09-12T17:10:52.570545+0000","last_became_peered":"2024-09-12T17:10:52.570545+0000","last_unstale":"2024-09-12T18:12:19.674577+0000","last_undegraded":"2024-09-12T18:12:19.674577+0000","last_fullsized":"2024-09-12T18:12:19.674577+0000","mapping_epoch":34,"log_start":"263'200","ondisk_log_start":"263'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'291","last_scrub_stamp":"2024-09-12T18:12:19.674475+0000","last_deep_scrub":"263'291","last_deep_scrub_stamp":"2024-09-12T18:12:19.674475+0000","last_clean_scrub_stamp":"2024-09-12T18:12:19.674475+0000","objects_scrubbed":3,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:10:18.881598+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":466,"num_read_kb":447,"num_write":645,"num_write_kb":207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":178,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"263'473","reported_seq":1911,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:49.479082+0000","last_change":"2024-09-12T18:11:49.479082+0000","last_active":"2024-09-12T18:11:49.479082+0000","last_peered":"2024-09-12T18:11:49.479082+0000","last_clean":"2024-09-12T18:11:49.479082+0000","last_became_active":"2024-09-12T17:10:44.517508+0000","last_became_peered":"2024-09-12T17:10:44.517508+0000","last_unstale":"2024-09-12T18:11:49.479082+0000","last_undegraded":"2024-09-12T18:11:49.479082+0000","last_fullsized":"2024-09-12T18:11:49.479082+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'473","last_scrub_stamp":"2024-09-12T18:11:49.478985+0000","last_deep_scrub":"263'473","last_deep_scrub_stamp":"2024-09-12T18:11:49.478985+0000","last_clean_scrub_stamp":"2024-09-12T18:11:49.478985+0000","objects_scrubbed":2,"log_size":73,"log_dups_size":400,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:50:01.319281+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2400,"num_read_kb":2225,"num_write":610,"num_write_kb":202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"263'211","reported_seq":857,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:45.628205+0000","last_change":"2024-09-12T18:11:45.628205+0000","last_active":"2024-09-12T18:11:45.628205+0000","last_peered":"2024-09-12T18:11:45.628205+0000","last_clean":"2024-09-12T18:11:45.628205+0000","last_became_active":"2024-09-12T17:10:42.518404+0000","last_became_peered":"2024-09-12T17:10:42.518404+0000","last_unstale":"2024-09-12T18:11:45.628205+0000","last_undegraded":"2024-09-12T18:11:45.628205+0000","last_fullsized":"2024-09-12T18:11:45.628205+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'211","last_scrub_stamp":"2024-09-12T18:11:45.628122+0000","last_deep_scrub":"263'211","last_deep_scrub_stamp":"2024-09-12T18:11:45.628122+0000","last_clean_scrub_stamp":"2024-09-12T18:11:45.628122+0000","objects_scrubbed":1,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:54:21.121479+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170264,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":504,"num_read_kb":3973,"num_write":1040,"num_write_kb":36643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,7],"acting":[0,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":531,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:47.857743+0000","last_change":"2024-09-12T18:11:47.857743+0000","last_active":"2024-09-12T18:11:47.857743+0000","last_peered":"2024-09-12T18:11:47.857743+0000","last_clean":"2024-09-12T18:11:47.857743+0000","last_became_active":"2024-09-12T17:10:31.846123+0000","last_became_peered":"2024-09-12T17:10:31.846123+0000","last_unstale":"2024-09-12T18:11:47.857743+0000","last_undegraded":"2024-09-12T18:11:47.857743+0000","last_fullsized":"2024-09-12T18:11:47.857743+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:11:47.857651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:11:47.857651+0000","last_clean_scrub_stamp":"2024-09-12T18:11:47.857651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:48:18.963656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042024599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":508,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:07.594888+0000","last_change":"2024-09-12T18:12:07.594888+0000","last_active":"2024-09-12T18:12:07.594888+0000","last_peered":"2024-09-12T18:12:07.594888+0000","last_clean":"2024-09-12T18:12:07.594888+0000","last_became_active":"2024-09-12T17:10:46.530457+0000","last_became_peered":"2024-09-12T17:10:46.530457+0000","last_unstale":"2024-09-12T18:12:07.594888+0000","last_undegraded":"2024-09-12T18:12:07.594888+0000","last_fullsized":"2024-09-12T18:12:07.594888+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:07.594799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:07.594799+0000","last_clean_scrub_stamp":"2024-09-12T18:12:07.594799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:51:45.714432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"263'318","reported_seq":1045,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:09.558913+0000","last_change":"2024-09-12T18:12:09.558913+0000","last_active":"2024-09-12T18:12:09.558913+0000","last_peered":"2024-09-12T18:12:09.558913+0000","last_clean":"2024-09-12T18:12:09.558913+0000","last_became_active":"2024-09-12T17:10:48.542991+0000","last_became_peered":"2024-09-12T17:10:48.542991+0000","last_unstale":"2024-09-12T18:12:09.558913+0000","last_undegraded":"2024-09-12T18:12:09.558913+0000","last_fullsized":"2024-09-12T18:12:09.558913+0000","mapping_epoch":30,"log_start":"263'300","ondisk_log_start":"263'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'318","last_scrub_stamp":"2024-09-12T18:12:09.558796+0000","last_deep_scrub":"263'318","last_deep_scrub_stamp":"2024-09-12T18:12:09.558796+0000","last_clean_scrub_stamp":"2024-09-12T18:12:09.558796+0000","objects_scrubbed":8,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:34:34.474636+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23115,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":468,"num_read_kb":620,"num_write":234,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:16.626285+0000","last_change":"2024-09-12T18:12:16.626285+0000","last_active":"2024-09-12T18:12:16.626285+0000","last_peered":"2024-09-12T18:12:16.626285+0000","last_clean":"2024-09-12T18:12:16.626285+0000","last_became_active":"2024-09-12T17:10:50.553469+0000","last_became_peered":"2024-09-12T17:10:50.553469+0000","last_unstale":"2024-09-12T18:12:16.626285+0000","last_undegraded":"2024-09-12T18:12:16.626285+0000","last_fullsized":"2024-09-12T18:12:16.626285+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:16.626189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:16.626189+0000","last_clean_scrub_stamp":"2024-09-12T18:12:16.626189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:33:19.529386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"263'116","reported_seq":625,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:20.477405+0000","last_change":"2024-09-12T18:12:20.477405+0000","last_active":"2024-09-12T18:12:20.477405+0000","last_peered":"2024-09-12T18:12:20.477405+0000","last_clean":"2024-09-12T18:12:20.477405+0000","last_became_active":"2024-09-12T17:10:52.578713+0000","last_became_peered":"2024-09-12T17:10:52.578713+0000","last_unstale":"2024-09-12T18:12:20.477405+0000","last_undegraded":"2024-09-12T18:12:20.477405+0000","last_fullsized":"2024-09-12T18:12:20.477405+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'116","last_scrub_stamp":"2024-09-12T18:12:20.477311+0000","last_deep_scrub":"263'116","last_deep_scrub_stamp":"2024-09-12T18:12:20.477311+0000","last_clean_scrub_stamp":"2024-09-12T18:12:20.477311+0000","objects_scrubbed":2,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:33:41.317355+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":176,"num_read_kb":166,"num_write":279,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"263'125","reported_seq":695,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:23.612017+0000","last_change":"2024-09-12T18:12:23.612017+0000","last_active":"2024-09-12T18:12:23.612017+0000","last_peered":"2024-09-12T18:12:23.612017+0000","last_clean":"2024-09-12T18:12:23.612017+0000","last_became_active":"2024-09-12T17:10:52.576481+0000","last_became_peered":"2024-09-12T17:10:52.576481+0000","last_unstale":"2024-09-12T18:12:23.612017+0000","last_undegraded":"2024-09-12T18:12:23.612017+0000","last_fullsized":"2024-09-12T18:12:23.612017+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'125","last_scrub_stamp":"2024-09-12T18:12:23.611923+0000","last_deep_scrub":"263'125","last_deep_scrub_stamp":"2024-09-12T18:12:23.611923+0000","last_clean_scrub_stamp":"2024-09-12T18:12:23.611923+0000","objects_scrubbed":1,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:46:16.808557+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":242,"num_read_kb":237,"num_write":285,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"263'890","reported_seq":2488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:57.379777+0000","last_change":"2024-09-12T18:11:57.379777+0000","last_active":"2024-09-12T18:11:57.379777+0000","last_peered":"2024-09-12T18:11:57.379777+0000","last_clean":"2024-09-12T18:11:57.379777+0000","last_became_active":"2024-09-12T17:10:44.507455+0000","last_became_peered":"2024-09-12T17:10:44.507455+0000","last_unstale":"2024-09-12T18:11:57.379777+0000","last_undegraded":"2024-09-12T18:11:57.379777+0000","last_fullsized":"2024-09-12T18:11:57.379777+0000","mapping_epoch":26,"log_start":"263'800","ondisk_log_start":"263'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'890","last_scrub_stamp":"2024-09-12T18:11:57.379681+0000","last_deep_scrub":"263'890","last_deep_scrub_stamp":"2024-09-12T18:11:57.379681+0000","last_clean_scrub_stamp":"2024-09-12T18:11:57.379681+0000","objects_scrubbed":4,"log_size":90,"log_dups_size":800,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:11:27.008068+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4276,"num_read_kb":3830,"num_write":1165,"num_write_kb":436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2297,"num_omap_keys":9,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"263'212","reported_seq":871,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:48.500179+0000","last_change":"2024-09-12T18:11:48.500179+0000","last_active":"2024-09-12T18:11:48.500179+0000","last_peered":"2024-09-12T18:11:48.500179+0000","last_clean":"2024-09-12T18:11:48.500179+0000","last_became_active":"2024-09-12T17:10:42.519656+0000","last_became_peered":"2024-09-12T17:10:42.519656+0000","last_unstale":"2024-09-12T18:11:48.500179+0000","last_undegraded":"2024-09-12T18:11:48.500179+0000","last_fullsized":"2024-09-12T18:11:48.500179+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'212","last_scrub_stamp":"2024-09-12T18:11:48.500025+0000","last_deep_scrub":"263'212","last_deep_scrub_stamp":"2024-09-12T18:11:48.500025+0000","last_clean_scrub_stamp":"2024-09-12T18:11:48.500025+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:50:20.130407+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":812867,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":526,"num_read_kb":10349,"num_write":1065,"num_write_kb":31428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,6],"acting":[4,7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":509,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:02.561683+0000","last_change":"2024-09-12T18:12:02.561683+0000","last_active":"2024-09-12T18:12:02.561683+0000","last_peered":"2024-09-12T18:12:02.561683+0000","last_clean":"2024-09-12T18:12:02.561683+0000","last_became_active":"2024-09-12T17:10:46.527445+0000","last_became_peered":"2024-09-12T17:10:46.527445+0000","last_unstale":"2024-09-12T18:12:02.561683+0000","last_undegraded":"2024-09-12T18:12:02.561683+0000","last_fullsized":"2024-09-12T18:12:02.561683+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:02.561588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:02.561588+0000","last_clean_scrub_stamp":"2024-09-12T18:12:02.561588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:10:49.689079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"263'145","reported_seq":730,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:13.656453+0000","last_change":"2024-09-12T18:12:13.656453+0000","last_active":"2024-09-12T18:12:13.656453+0000","last_peered":"2024-09-12T18:12:13.656453+0000","last_clean":"2024-09-12T18:12:13.656453+0000","last_became_active":"2024-09-12T17:10:48.536021+0000","last_became_peered":"2024-09-12T17:10:48.536021+0000","last_unstale":"2024-09-12T18:12:13.656453+0000","last_undegraded":"2024-09-12T18:12:13.656453+0000","last_fullsized":"2024-09-12T18:12:13.656453+0000","mapping_epoch":30,"log_start":"263'100","ondisk_log_start":"263'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'145","last_scrub_stamp":"2024-09-12T18:12:13.656340+0000","last_deep_scrub":"263'145","last_deep_scrub_stamp":"2024-09-12T18:12:13.656340+0000","last_clean_scrub_stamp":"2024-09-12T18:12:13.656340+0000","objects_scrubbed":5,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:23:59.661931+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9595,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":179,"num_read_kb":232,"num_write":92,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:21.686871+0000","last_change":"2024-09-12T18:12:21.686871+0000","last_active":"2024-09-12T18:12:21.686871+0000","last_peered":"2024-09-12T18:12:21.686871+0000","last_clean":"2024-09-12T18:12:21.686871+0000","last_became_active":"2024-09-12T17:10:50.555251+0000","last_became_peered":"2024-09-12T17:10:50.555251+0000","last_unstale":"2024-09-12T18:12:21.686871+0000","last_undegraded":"2024-09-12T18:12:21.686871+0000","last_fullsized":"2024-09-12T18:12:21.686871+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:21.686780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:21.686780+0000","last_clean_scrub_stamp":"2024-09-12T18:12:21.686780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:25:01.260932+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"263'142","reported_seq":671,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:28.644089+0000","last_change":"2024-09-12T18:12:28.644089+0000","last_active":"2024-09-12T18:12:28.644089+0000","last_peered":"2024-09-12T18:12:28.644089+0000","last_clean":"2024-09-12T18:12:28.644089+0000","last_became_active":"2024-09-12T17:10:52.573040+0000","last_became_peered":"2024-09-12T17:10:52.573040+0000","last_unstale":"2024-09-12T18:12:28.644089+0000","last_undegraded":"2024-09-12T18:12:28.644089+0000","last_fullsized":"2024-09-12T18:12:28.644089+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'142","last_scrub_stamp":"2024-09-12T18:12:28.643982+0000","last_deep_scrub":"263'142","last_deep_scrub_stamp":"2024-09-12T18:12:28.643982+0000","last_clean_scrub_stamp":"2024-09-12T18:12:28.643982+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:19:01.380924+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":264,"num_read_kb":238,"num_write":352,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"263'1131","reported_seq":2801,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:56.527202+0000","last_change":"2024-09-12T18:11:56.527202+0000","last_active":"2024-09-12T18:11:56.527202+0000","last_peered":"2024-09-12T18:11:56.527202+0000","last_clean":"2024-09-12T18:11:56.527202+0000","last_became_active":"2024-09-12T17:10:44.509117+0000","last_became_peered":"2024-09-12T17:10:44.509117+0000","last_unstale":"2024-09-12T18:11:56.527202+0000","last_undegraded":"2024-09-12T18:11:56.527202+0000","last_fullsized":"2024-09-12T18:11:56.527202+0000","mapping_epoch":26,"log_start":"263'1100","ondisk_log_start":"263'1100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1131","last_scrub_stamp":"2024-09-12T18:11:56.527108+0000","last_deep_scrub":"263'1131","last_deep_scrub_stamp":"2024-09-12T18:11:56.527108+0000","last_clean_scrub_stamp":"2024-09-12T18:11:56.527108+0000","objects_scrubbed":3,"log_size":31,"log_dups_size":1100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:31:43.564901+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5331,"num_read_kb":4747,"num_write":1539,"num_write_kb":622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2500,"num_omap_keys":10,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"263'206","reported_seq":823,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:47.843275+0000","last_change":"2024-09-12T18:11:47.843275+0000","last_active":"2024-09-12T18:11:47.843275+0000","last_peered":"2024-09-12T18:11:47.843275+0000","last_clean":"2024-09-12T18:11:47.843275+0000","last_became_active":"2024-09-12T17:11:16.617505+0000","last_became_peered":"2024-09-12T17:11:16.617505+0000","last_unstale":"2024-09-12T18:11:47.843275+0000","last_undegraded":"2024-09-12T18:11:47.843275+0000","last_fullsized":"2024-09-12T18:11:47.843275+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'206","last_scrub_stamp":"2024-09-12T18:11:47.843156+0000","last_deep_scrub":"263'206","last_deep_scrub_stamp":"2024-09-12T18:11:47.843156+0000","last_clean_scrub_stamp":"2024-09-12T18:11:47.843156+0000","objects_scrubbed":5,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:01:44.908699+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2936797,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":495,"num_read_kb":50143,"num_write":995,"num_write_kb":47141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,4],"acting":[2,3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":504,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:08.639895+0000","last_change":"2024-09-12T18:12:08.639895+0000","last_active":"2024-09-12T18:12:08.639895+0000","last_peered":"2024-09-12T18:12:08.639895+0000","last_clean":"2024-09-12T18:12:08.639895+0000","last_became_active":"2024-09-12T17:10:46.531835+0000","last_became_peered":"2024-09-12T17:10:46.531835+0000","last_unstale":"2024-09-12T18:12:08.639895+0000","last_undegraded":"2024-09-12T18:12:08.639895+0000","last_fullsized":"2024-09-12T18:12:08.639895+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:08.639821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:08.639821+0000","last_clean_scrub_stamp":"2024-09-12T18:12:08.639821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:23:37.446484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"263'49","reported_seq":565,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:09.719777+0000","last_change":"2024-09-12T18:12:09.719777+0000","last_active":"2024-09-12T18:12:09.719777+0000","last_peered":"2024-09-12T18:12:09.719777+0000","last_clean":"2024-09-12T18:12:09.719777+0000","last_became_active":"2024-09-12T17:10:48.540975+0000","last_became_peered":"2024-09-12T17:10:48.540975+0000","last_unstale":"2024-09-12T18:12:09.719777+0000","last_undegraded":"2024-09-12T18:12:09.719777+0000","last_fullsized":"2024-09-12T18:12:09.719777+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'49","last_scrub_stamp":"2024-09-12T18:12:09.719655+0000","last_deep_scrub":"263'49","last_deep_scrub_stamp":"2024-09-12T18:12:09.719655+0000","last_clean_scrub_stamp":"2024-09-12T18:12:09.719655+0000","objects_scrubbed":3,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:00:37.550586+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":38,"num_read_kb":36,"num_write":28,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:17.604666+0000","last_change":"2024-09-12T18:12:17.604666+0000","last_active":"2024-09-12T18:12:17.604666+0000","last_peered":"2024-09-12T18:12:17.604666+0000","last_clean":"2024-09-12T18:12:17.604666+0000","last_became_active":"2024-09-12T17:10:50.553581+0000","last_became_peered":"2024-09-12T17:10:50.553581+0000","last_unstale":"2024-09-12T18:12:17.604666+0000","last_undegraded":"2024-09-12T18:12:17.604666+0000","last_fullsized":"2024-09-12T18:12:17.604666+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:17.604578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:17.604578+0000","last_clean_scrub_stamp":"2024-09-12T18:12:17.604578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:22:57.955149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"263'193","reported_seq":722,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:22.604718+0000","last_change":"2024-09-12T18:12:22.604718+0000","last_active":"2024-09-12T18:12:22.604718+0000","last_peered":"2024-09-12T18:12:22.604718+0000","last_clean":"2024-09-12T18:12:22.604718+0000","last_became_active":"2024-09-12T17:10:52.573306+0000","last_became_peered":"2024-09-12T17:10:52.573306+0000","last_unstale":"2024-09-12T18:12:22.604718+0000","last_undegraded":"2024-09-12T18:12:22.604718+0000","last_fullsized":"2024-09-12T18:12:22.604718+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'193","last_scrub_stamp":"2024-09-12T18:12:22.604613+0000","last_deep_scrub":"263'193","last_deep_scrub_stamp":"2024-09-12T18:12:22.604613+0000","last_clean_scrub_stamp":"2024-09-12T18:12:22.604613+0000","objects_scrubbed":2,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:24:50.370491+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":321,"num_read_kb":317,"num_write":439,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":398,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"263'811","reported_seq":2420,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:57.606541+0000","last_change":"2024-09-12T18:11:57.606541+0000","last_active":"2024-09-12T18:11:57.606541+0000","last_peered":"2024-09-12T18:11:57.606541+0000","last_clean":"2024-09-12T18:11:57.606541+0000","last_became_active":"2024-09-12T17:10:44.511481+0000","last_became_peered":"2024-09-12T17:10:44.511481+0000","last_unstale":"2024-09-12T18:11:57.606541+0000","last_undegraded":"2024-09-12T18:11:57.606541+0000","last_fullsized":"2024-09-12T18:11:57.606541+0000","mapping_epoch":26,"log_start":"263'700","ondisk_log_start":"263'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'811","last_scrub_stamp":"2024-09-12T18:11:57.606442+0000","last_deep_scrub":"263'811","last_deep_scrub_stamp":"2024-09-12T18:11:57.606442+0000","last_clean_scrub_stamp":"2024-09-12T18:11:57.606442+0000","objects_scrubbed":1,"log_size":111,"log_dups_size":700,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:48:35.686566+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3868,"num_read_kb":3506,"num_write":1048,"num_write_kb":364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"263'181","reported_seq":792,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:48.827289+0000","last_change":"2024-09-12T18:11:48.827289+0000","last_active":"2024-09-12T18:11:48.827289+0000","last_peered":"2024-09-12T18:11:48.827289+0000","last_clean":"2024-09-12T18:11:48.827289+0000","last_became_active":"2024-09-12T17:11:16.862878+0000","last_became_peered":"2024-09-12T17:11:16.862878+0000","last_unstale":"2024-09-12T18:11:48.827289+0000","last_undegraded":"2024-09-12T18:11:48.827289+0000","last_fullsized":"2024-09-12T18:11:48.827289+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'181","last_scrub_stamp":"2024-09-12T18:11:48.827197+0000","last_deep_scrub":"263'181","last_deep_scrub_stamp":"2024-09-12T18:11:48.827197+0000","last_clean_scrub_stamp":"2024-09-12T18:11:48.827197+0000","objects_scrubbed":2,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:07:19.314634+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3178636,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":399,"num_read_kb":53721,"num_write":811,"num_write_kb":39175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,1,3],"acting":[2,7,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:07.542540+0000","last_change":"2024-09-12T18:12:07.542540+0000","last_active":"2024-09-12T18:12:07.542540+0000","last_peered":"2024-09-12T18:12:07.542540+0000","last_clean":"2024-09-12T18:12:07.542540+0000","last_became_active":"2024-09-12T17:10:46.530518+0000","last_became_peered":"2024-09-12T17:10:46.530518+0000","last_unstale":"2024-09-12T18:12:07.542540+0000","last_undegraded":"2024-09-12T18:12:07.542540+0000","last_fullsized":"2024-09-12T18:12:07.542540+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:07.542450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:07.542450+0000","last_clean_scrub_stamp":"2024-09-12T18:12:07.542450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:58:05.691586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"263'178","reported_seq":778,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:15.677130+0000","last_change":"2024-09-12T18:12:15.677130+0000","last_active":"2024-09-12T18:12:15.677130+0000","last_peered":"2024-09-12T18:12:15.677130+0000","last_clean":"2024-09-12T18:12:15.677130+0000","last_became_active":"2024-09-12T17:10:48.536654+0000","last_became_peered":"2024-09-12T17:10:48.536654+0000","last_unstale":"2024-09-12T18:12:15.677130+0000","last_undegraded":"2024-09-12T18:12:15.677130+0000","last_fullsized":"2024-09-12T18:12:15.677130+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'178","last_scrub_stamp":"2024-09-12T18:12:15.677036+0000","last_deep_scrub":"263'178","last_deep_scrub_stamp":"2024-09-12T18:12:15.677036+0000","last_clean_scrub_stamp":"2024-09-12T18:12:15.677036+0000","objects_scrubbed":5,"log_size":78,"log_dups_size":100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:37:46.838981+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5117,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":224,"num_read_kb":242,"num_write":122,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:04.709251+0000","last_change":"2024-09-12T18:12:04.709251+0000","last_active":"2024-09-12T18:12:04.709251+0000","last_peered":"2024-09-12T18:12:04.709251+0000","last_clean":"2024-09-12T18:12:04.709251+0000","last_became_active":"2024-09-12T17:10:50.556039+0000","last_became_peered":"2024-09-12T17:10:50.556039+0000","last_unstale":"2024-09-12T18:12:04.709251+0000","last_undegraded":"2024-09-12T18:12:04.709251+0000","last_fullsized":"2024-09-12T18:12:04.709251+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:04.709167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:04.709167+0000","last_clean_scrub_stamp":"2024-09-12T18:12:04.709167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:32:19.318577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"263'114","reported_seq":626,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:23.438911+0000","last_change":"2024-09-12T18:12:23.438911+0000","last_active":"2024-09-12T18:12:23.438911+0000","last_peered":"2024-09-12T18:12:23.438911+0000","last_clean":"2024-09-12T18:12:23.438911+0000","last_became_active":"2024-09-12T17:10:52.576791+0000","last_became_peered":"2024-09-12T17:10:52.576791+0000","last_unstale":"2024-09-12T18:12:23.438911+0000","last_undegraded":"2024-09-12T18:12:23.438911+0000","last_fullsized":"2024-09-12T18:12:23.438911+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'114","last_scrub_stamp":"2024-09-12T18:12:23.438808+0000","last_deep_scrub":"263'114","last_deep_scrub_stamp":"2024-09-12T18:12:23.438808+0000","last_clean_scrub_stamp":"2024-09-12T18:12:23.438808+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:40:57.508125+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":159,"num_read_kb":159,"num_write":260,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"263'431","reported_seq":1816,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:03.644995+0000","last_change":"2024-09-12T18:12:03.644995+0000","last_active":"2024-09-12T18:12:03.644995+0000","last_peered":"2024-09-12T18:12:03.644995+0000","last_clean":"2024-09-12T18:12:03.644995+0000","last_became_active":"2024-09-12T17:10:44.520747+0000","last_became_peered":"2024-09-12T17:10:44.520747+0000","last_unstale":"2024-09-12T18:12:03.644995+0000","last_undegraded":"2024-09-12T18:12:03.644995+0000","last_fullsized":"2024-09-12T18:12:03.644995+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'431","last_scrub_stamp":"2024-09-12T18:12:03.644906+0000","last_deep_scrub":"263'431","last_deep_scrub_stamp":"2024-09-12T18:12:03.644906+0000","last_clean_scrub_stamp":"2024-09-12T18:12:03.644906+0000","objects_scrubbed":2,"log_size":31,"log_dups_size":400,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:51:22.884668+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2202,"num_read_kb":2035,"num_write":527,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":718,"num_omap_keys":3,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"263'255","reported_seq":952,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:47.656945+0000","last_change":"2024-09-12T18:11:47.656945+0000","last_active":"2024-09-12T18:11:47.656945+0000","last_peered":"2024-09-12T18:11:47.656945+0000","last_clean":"2024-09-12T18:11:47.656945+0000","last_became_active":"2024-09-12T17:10:42.528364+0000","last_became_peered":"2024-09-12T17:10:42.528364+0000","last_unstale":"2024-09-12T18:11:47.656945+0000","last_undegraded":"2024-09-12T18:11:47.656945+0000","last_fullsized":"2024-09-12T18:11:47.656945+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'255","last_scrub_stamp":"2024-09-12T18:11:47.656812+0000","last_deep_scrub":"263'255","last_deep_scrub_stamp":"2024-09-12T18:11:47.656812+0000","last_clean_scrub_stamp":"2024-09-12T18:11:47.656812+0000","objects_scrubbed":5,"log_size":55,"log_dups_size":200,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:23:37.965725+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399205,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":613,"num_read_kb":71919,"num_write":1345,"num_write_kb":46951,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6,3],"acting":[0,5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":505,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:00.677176+0000","last_change":"2024-09-12T18:12:00.677176+0000","last_active":"2024-09-12T18:12:00.677176+0000","last_peered":"2024-09-12T18:12:00.677176+0000","last_clean":"2024-09-12T18:12:00.677176+0000","last_became_active":"2024-09-12T17:10:46.531830+0000","last_became_peered":"2024-09-12T17:10:46.531830+0000","last_unstale":"2024-09-12T18:12:00.677176+0000","last_undegraded":"2024-09-12T18:12:00.677176+0000","last_fullsized":"2024-09-12T18:12:00.677176+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:00.677087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:00.677087+0000","last_clean_scrub_stamp":"2024-09-12T18:12:00.677087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:04:35.333713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"263'131","reported_seq":707,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:12.623041+0000","last_change":"2024-09-12T18:12:12.623041+0000","last_active":"2024-09-12T18:12:12.623041+0000","last_peered":"2024-09-12T18:12:12.623041+0000","last_clean":"2024-09-12T18:12:12.623041+0000","last_became_active":"2024-09-12T17:10:48.545598+0000","last_became_peered":"2024-09-12T17:10:48.545598+0000","last_unstale":"2024-09-12T18:12:12.623041+0000","last_undegraded":"2024-09-12T18:12:12.623041+0000","last_fullsized":"2024-09-12T18:12:12.623041+0000","mapping_epoch":30,"log_start":"263'100","ondisk_log_start":"263'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'131","last_scrub_stamp":"2024-09-12T18:12:12.622936+0000","last_deep_scrub":"263'131","last_deep_scrub_stamp":"2024-09-12T18:12:12.622936+0000","last_clean_scrub_stamp":"2024-09-12T18:12:12.622936+0000","objects_scrubbed":4,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:24:03.277611+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10861,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":166,"num_read_kb":224,"num_write":86,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":500,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:15.694219+0000","last_change":"2024-09-12T18:12:15.694219+0000","last_active":"2024-09-12T18:12:15.694219+0000","last_peered":"2024-09-12T18:12:15.694219+0000","last_clean":"2024-09-12T18:12:15.694219+0000","last_became_active":"2024-09-12T17:10:50.560872+0000","last_became_peered":"2024-09-12T17:10:50.560872+0000","last_unstale":"2024-09-12T18:12:15.694219+0000","last_undegraded":"2024-09-12T18:12:15.694219+0000","last_fullsized":"2024-09-12T18:12:15.694219+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:15.694138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:15.694138+0000","last_clean_scrub_stamp":"2024-09-12T18:12:15.694138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:19:51.674706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"263'951","reported_seq":2488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:56.707695+0000","last_change":"2024-09-12T18:11:56.707695+0000","last_active":"2024-09-12T18:11:56.707695+0000","last_peered":"2024-09-12T18:11:56.707695+0000","last_clean":"2024-09-12T18:11:56.707695+0000","last_became_active":"2024-09-12T17:10:44.518992+0000","last_became_peered":"2024-09-12T17:10:44.518992+0000","last_unstale":"2024-09-12T18:11:56.707695+0000","last_undegraded":"2024-09-12T18:11:56.707695+0000","last_fullsized":"2024-09-12T18:11:56.707695+0000","mapping_epoch":26,"log_start":"263'900","ondisk_log_start":"263'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'951","last_scrub_stamp":"2024-09-12T18:11:56.707618+0000","last_deep_scrub":"263'951","last_deep_scrub_stamp":"2024-09-12T18:11:56.707618+0000","last_clean_scrub_stamp":"2024-09-12T18:11:56.707618+0000","objects_scrubbed":1,"log_size":51,"log_dups_size":900,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:54:44.984408+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4453,"num_read_kb":3925,"num_write":1322,"num_write_kb":528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1892,"num_omap_keys":8,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"263'316","reported_seq":1002,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:50.550646+0000","last_change":"2024-09-12T18:11:50.550646+0000","last_active":"2024-09-12T18:11:50.550646+0000","last_peered":"2024-09-12T18:11:50.550646+0000","last_clean":"2024-09-12T18:11:50.550646+0000","last_became_active":"2024-09-12T17:10:42.514627+0000","last_became_peered":"2024-09-12T17:10:42.514627+0000","last_unstale":"2024-09-12T18:11:50.550646+0000","last_undegraded":"2024-09-12T18:11:50.550646+0000","last_fullsized":"2024-09-12T18:11:50.550646+0000","mapping_epoch":24,"log_start":"263'300","ondisk_log_start":"263'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'316","last_scrub_stamp":"2024-09-12T18:11:50.550499+0000","last_deep_scrub":"263'316","last_deep_scrub_stamp":"2024-09-12T18:11:50.550499+0000","last_clean_scrub_stamp":"2024-09-12T18:11:50.550499+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:01:57.030372+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":188,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":795,"num_read_kb":25839,"num_write":1196,"num_write_kb":43854,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":512,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:05.731801+0000","last_change":"2024-09-12T18:12:05.731801+0000","last_active":"2024-09-12T18:12:05.731801+0000","last_peered":"2024-09-12T18:12:05.731801+0000","last_clean":"2024-09-12T18:12:05.731801+0000","last_became_active":"2024-09-12T17:10:46.526692+0000","last_became_peered":"2024-09-12T17:10:46.526692+0000","last_unstale":"2024-09-12T18:12:05.731801+0000","last_undegraded":"2024-09-12T18:12:05.731801+0000","last_fullsized":"2024-09-12T18:12:05.731801+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:05.731716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:05.731716+0000","last_clean_scrub_stamp":"2024-09-12T18:12:05.731716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:11:54.160730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"263'217","reported_seq":858,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:05.509292+0000","last_change":"2024-09-12T18:12:05.509292+0000","last_active":"2024-09-12T18:12:05.509292+0000","last_peered":"2024-09-12T18:12:05.509292+0000","last_clean":"2024-09-12T18:12:05.509292+0000","last_became_active":"2024-09-12T17:10:48.544429+0000","last_became_peered":"2024-09-12T17:10:48.544429+0000","last_unstale":"2024-09-12T18:12:05.509292+0000","last_undegraded":"2024-09-12T18:12:05.509292+0000","last_fullsized":"2024-09-12T18:12:05.509292+0000","mapping_epoch":30,"log_start":"263'200","ondisk_log_start":"263'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'217","last_scrub_stamp":"2024-09-12T18:12:05.509198+0000","last_deep_scrub":"263'217","last_deep_scrub_stamp":"2024-09-12T18:12:05.509198+0000","last_clean_scrub_stamp":"2024-09-12T18:12:05.509198+0000","objects_scrubbed":6,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:15:27.086960+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14913,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":325,"num_read_kb":485,"num_write":208,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25256,"num_omap_keys":48,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:17.499584+0000","last_change":"2024-09-12T18:12:17.499584+0000","last_active":"2024-09-12T18:12:17.499584+0000","last_peered":"2024-09-12T18:12:17.499584+0000","last_clean":"2024-09-12T18:12:17.499584+0000","last_became_active":"2024-09-12T17:10:50.565621+0000","last_became_peered":"2024-09-12T17:10:50.565621+0000","last_unstale":"2024-09-12T18:12:17.499584+0000","last_undegraded":"2024-09-12T18:12:17.499584+0000","last_fullsized":"2024-09-12T18:12:17.499584+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:17.499501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:17.499501+0000","last_clean_scrub_stamp":"2024-09-12T18:12:17.499501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:59:26.331971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"263'177","reported_seq":691,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:26.648044+0000","last_change":"2024-09-12T18:12:26.648044+0000","last_active":"2024-09-12T18:12:26.648044+0000","last_peered":"2024-09-12T18:12:26.648044+0000","last_clean":"2024-09-12T18:12:26.648044+0000","last_became_active":"2024-09-12T17:10:52.672033+0000","last_became_peered":"2024-09-12T17:10:52.672033+0000","last_unstale":"2024-09-12T18:12:26.648044+0000","last_undegraded":"2024-09-12T18:12:26.648044+0000","last_fullsized":"2024-09-12T18:12:26.648044+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'177","last_scrub_stamp":"2024-09-12T18:12:26.647956+0000","last_deep_scrub":"263'177","last_deep_scrub_stamp":"2024-09-12T18:12:26.647956+0000","last_clean_scrub_stamp":"2024-09-12T18:12:26.647956+0000","objects_scrubbed":2,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:08:25.327330+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":269,"num_read_kb":274,"num_write":411,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"263'548","reported_seq":2066,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:58.711194+0000","last_change":"2024-09-12T18:11:58.711194+0000","last_active":"2024-09-12T18:11:58.711194+0000","last_peered":"2024-09-12T18:11:58.711194+0000","last_clean":"2024-09-12T18:11:58.711194+0000","last_became_active":"2024-09-12T17:10:44.510696+0000","last_became_peered":"2024-09-12T17:10:44.510696+0000","last_unstale":"2024-09-12T18:11:58.711194+0000","last_undegraded":"2024-09-12T18:11:58.711194+0000","last_fullsized":"2024-09-12T18:11:58.711194+0000","mapping_epoch":26,"log_start":"263'500","ondisk_log_start":"263'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'548","last_scrub_stamp":"2024-09-12T18:11:58.711116+0000","last_deep_scrub":"263'548","last_deep_scrub_stamp":"2024-09-12T18:11:58.711116+0000","last_clean_scrub_stamp":"2024-09-12T18:11:58.711116+0000","objects_scrubbed":3,"log_size":48,"log_dups_size":500,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:00:54.289369+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2748,"num_read_kb":2501,"num_write":691,"num_write_kb":203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":946,"num_omap_keys":4,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"263'238","reported_seq":913,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:50.716191+0000","last_change":"2024-09-12T18:11:50.716191+0000","last_active":"2024-09-12T18:11:50.716191+0000","last_peered":"2024-09-12T18:11:50.716191+0000","last_clean":"2024-09-12T18:11:50.716191+0000","last_became_active":"2024-09-12T17:10:42.520349+0000","last_became_peered":"2024-09-12T17:10:42.520349+0000","last_unstale":"2024-09-12T18:11:50.716191+0000","last_undegraded":"2024-09-12T18:11:50.716191+0000","last_fullsized":"2024-09-12T18:11:50.716191+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'238","last_scrub_stamp":"2024-09-12T18:11:50.716063+0000","last_deep_scrub":"263'238","last_deep_scrub_stamp":"2024-09-12T18:11:50.716063+0000","last_clean_scrub_stamp":"2024-09-12T18:11:50.716063+0000","objects_scrubbed":9,"log_size":38,"log_dups_size":200,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:42:45.248398+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10743893,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":541,"num_read_kb":59039,"num_write":1206,"num_write_kb":37561,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,6],"acting":[1,3,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":508,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:01.699154+0000","last_change":"2024-09-12T18:12:01.699154+0000","last_active":"2024-09-12T18:12:01.699154+0000","last_peered":"2024-09-12T18:12:01.699154+0000","last_clean":"2024-09-12T18:12:01.699154+0000","last_became_active":"2024-09-12T17:10:46.530545+0000","last_became_peered":"2024-09-12T17:10:46.530545+0000","last_unstale":"2024-09-12T18:12:01.699154+0000","last_undegraded":"2024-09-12T18:12:01.699154+0000","last_fullsized":"2024-09-12T18:12:01.699154+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:01.699042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:01.699042+0000","last_clean_scrub_stamp":"2024-09-12T18:12:01.699042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:06:02.900923+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"263'178","reported_seq":770,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:13.575202+0000","last_change":"2024-09-12T18:12:13.575202+0000","last_active":"2024-09-12T18:12:13.575202+0000","last_peered":"2024-09-12T18:12:13.575202+0000","last_clean":"2024-09-12T18:12:13.575202+0000","last_became_active":"2024-09-12T17:10:48.541240+0000","last_became_peered":"2024-09-12T17:10:48.541240+0000","last_unstale":"2024-09-12T18:12:13.575202+0000","last_undegraded":"2024-09-12T18:12:13.575202+0000","last_fullsized":"2024-09-12T18:12:13.575202+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'178","last_scrub_stamp":"2024-09-12T18:12:13.575102+0000","last_deep_scrub":"263'178","last_deep_scrub_stamp":"2024-09-12T18:12:13.575102+0000","last_clean_scrub_stamp":"2024-09-12T18:12:13.575102+0000","objects_scrubbed":8,"log_size":78,"log_dups_size":100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:50:14.366078+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8547,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":246,"num_read_kb":321,"num_write":160,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11460,"num_omap_keys":24,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:09.489302+0000","last_change":"2024-09-12T18:12:09.489302+0000","last_active":"2024-09-12T18:12:09.489302+0000","last_peered":"2024-09-12T18:12:09.489302+0000","last_clean":"2024-09-12T18:12:09.489302+0000","last_became_active":"2024-09-12T17:10:50.561983+0000","last_became_peered":"2024-09-12T17:10:50.561983+0000","last_unstale":"2024-09-12T18:12:09.489302+0000","last_undegraded":"2024-09-12T18:12:09.489302+0000","last_fullsized":"2024-09-12T18:12:09.489302+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:09.489199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:09.489199+0000","last_clean_scrub_stamp":"2024-09-12T18:12:09.489199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:04:42.874499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"263'251","reported_seq":1127,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:10.668035+0000","last_change":"2024-09-12T18:12:10.668035+0000","last_active":"2024-09-12T18:12:10.668035+0000","last_peered":"2024-09-12T18:12:10.668035+0000","last_clean":"2024-09-12T18:12:10.668035+0000","last_became_active":"2024-09-12T17:10:52.573595+0000","last_became_peered":"2024-09-12T17:10:52.573595+0000","last_unstale":"2024-09-12T18:12:10.668035+0000","last_undegraded":"2024-09-12T18:12:10.668035+0000","last_fullsized":"2024-09-12T18:12:10.668035+0000","mapping_epoch":34,"log_start":"263'200","ondisk_log_start":"263'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'251","last_scrub_stamp":"2024-09-12T18:12:10.667936+0000","last_deep_scrub":"263'251","last_deep_scrub_stamp":"2024-09-12T18:12:10.667936+0000","last_clean_scrub_stamp":"2024-09-12T18:12:10.667936+0000","objects_scrubbed":7,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:03:04.342423+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1635,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":641,"num_read_kb":637,"num_write":634,"num_write_kb":186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"263'622","reported_seq":2223,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:58.640774+0000","last_change":"2024-09-12T18:11:58.640774+0000","last_active":"2024-09-12T18:11:58.640774+0000","last_peered":"2024-09-12T18:11:58.640774+0000","last_clean":"2024-09-12T18:11:58.640774+0000","last_became_active":"2024-09-12T17:10:44.521041+0000","last_became_peered":"2024-09-12T17:10:44.521041+0000","last_unstale":"2024-09-12T18:11:58.640774+0000","last_undegraded":"2024-09-12T18:11:58.640774+0000","last_fullsized":"2024-09-12T18:11:58.640774+0000","mapping_epoch":26,"log_start":"263'600","ondisk_log_start":"263'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'622","last_scrub_stamp":"2024-09-12T18:11:58.640669+0000","last_deep_scrub":"263'622","last_deep_scrub_stamp":"2024-09-12T18:11:58.640669+0000","last_clean_scrub_stamp":"2024-09-12T18:11:58.640669+0000","objects_scrubbed":2,"log_size":22,"log_dups_size":600,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:27:58.198720+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3182,"num_read_kb":2947,"num_write":827,"num_write_kb":261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":247,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"263'222","reported_seq":822,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:54.585656+0000","last_change":"2024-09-12T18:11:54.585656+0000","last_active":"2024-09-12T18:11:54.585656+0000","last_peered":"2024-09-12T18:11:54.585656+0000","last_clean":"2024-09-12T18:11:54.585656+0000","last_became_active":"2024-09-12T17:11:16.860070+0000","last_became_peered":"2024-09-12T17:11:16.860070+0000","last_unstale":"2024-09-12T18:11:54.585656+0000","last_undegraded":"2024-09-12T18:11:54.585656+0000","last_fullsized":"2024-09-12T18:11:54.585656+0000","mapping_epoch":37,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'222","last_scrub_stamp":"2024-09-12T18:11:54.585507+0000","last_deep_scrub":"263'222","last_deep_scrub_stamp":"2024-09-12T18:11:54.585507+0000","last_clean_scrub_stamp":"2024-09-12T18:11:54.585507+0000","objects_scrubbed":5,"log_size":22,"log_dups_size":200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:11:02.947543+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3239711,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":443,"num_read_kb":10891,"num_write":955,"num_write_kb":36342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":509,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:10.308784+0000","last_change":"2024-09-12T18:12:10.308784+0000","last_active":"2024-09-12T18:12:10.308784+0000","last_peered":"2024-09-12T18:12:10.308784+0000","last_clean":"2024-09-12T18:12:10.308784+0000","last_became_active":"2024-09-12T17:10:46.530452+0000","last_became_peered":"2024-09-12T17:10:46.530452+0000","last_unstale":"2024-09-12T18:12:10.308784+0000","last_undegraded":"2024-09-12T18:12:10.308784+0000","last_fullsized":"2024-09-12T18:12:10.308784+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:10.308679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:10.308679+0000","last_clean_scrub_stamp":"2024-09-12T18:12:10.308679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:39:55.785385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"263'148","reported_seq":735,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:17.650880+0000","last_change":"2024-09-12T18:12:17.650880+0000","last_active":"2024-09-12T18:12:17.650880+0000","last_peered":"2024-09-12T18:12:17.650880+0000","last_clean":"2024-09-12T18:12:17.650880+0000","last_became_active":"2024-09-12T17:10:48.537643+0000","last_became_peered":"2024-09-12T17:10:48.537643+0000","last_unstale":"2024-09-12T18:12:17.650880+0000","last_undegraded":"2024-09-12T18:12:17.650880+0000","last_fullsized":"2024-09-12T18:12:17.650880+0000","mapping_epoch":30,"log_start":"263'100","ondisk_log_start":"263'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'148","last_scrub_stamp":"2024-09-12T18:12:17.650791+0000","last_deep_scrub":"263'148","last_deep_scrub_stamp":"2024-09-12T18:12:17.650791+0000","last_clean_scrub_stamp":"2024-09-12T18:12:17.650791+0000","objects_scrubbed":6,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:09:51.365078+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4406,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":180,"num_read_kb":223,"num_write":96,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":505,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:10.456918+0000","last_change":"2024-09-12T18:12:10.456918+0000","last_active":"2024-09-12T18:12:10.456918+0000","last_peered":"2024-09-12T18:12:10.456918+0000","last_clean":"2024-09-12T18:12:10.456918+0000","last_became_active":"2024-09-12T17:10:50.565582+0000","last_became_peered":"2024-09-12T17:10:50.565582+0000","last_unstale":"2024-09-12T18:12:10.456918+0000","last_undegraded":"2024-09-12T18:12:10.456918+0000","last_fullsized":"2024-09-12T18:12:10.456918+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:10.456809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:10.456809+0000","last_clean_scrub_stamp":"2024-09-12T18:12:10.456809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:47:45.308848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"263'135","reported_seq":630,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:21.472980+0000","last_change":"2024-09-12T18:12:21.472980+0000","last_active":"2024-09-12T18:12:21.472980+0000","last_peered":"2024-09-12T18:12:21.472980+0000","last_clean":"2024-09-12T18:12:21.472980+0000","last_became_active":"2024-09-12T17:10:52.576370+0000","last_became_peered":"2024-09-12T17:10:52.576370+0000","last_unstale":"2024-09-12T18:12:21.472980+0000","last_undegraded":"2024-09-12T18:12:21.472980+0000","last_fullsized":"2024-09-12T18:12:21.472980+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'135","last_scrub_stamp":"2024-09-12T18:12:21.472872+0000","last_deep_scrub":"263'135","last_deep_scrub_stamp":"2024-09-12T18:12:21.472872+0000","last_clean_scrub_stamp":"2024-09-12T18:12:21.472872+0000","objects_scrubbed":5,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:25:02.852252+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1233,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":145,"num_read_kb":142,"num_write":322,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"263'875","reported_seq":2433,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:52.838814+0000","last_change":"2024-09-12T18:11:52.838814+0000","last_active":"2024-09-12T18:11:52.838814+0000","last_peered":"2024-09-12T18:11:52.838814+0000","last_clean":"2024-09-12T18:11:52.838814+0000","last_became_active":"2024-09-12T17:10:44.519318+0000","last_became_peered":"2024-09-12T17:10:44.519318+0000","last_unstale":"2024-09-12T18:11:52.838814+0000","last_undegraded":"2024-09-12T18:11:52.838814+0000","last_fullsized":"2024-09-12T18:11:52.838814+0000","mapping_epoch":26,"log_start":"263'800","ondisk_log_start":"263'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'875","last_scrub_stamp":"2024-09-12T18:11:52.838719+0000","last_deep_scrub":"263'875","last_deep_scrub_stamp":"2024-09-12T18:11:52.838719+0000","last_clean_scrub_stamp":"2024-09-12T18:11:52.838719+0000","objects_scrubbed":3,"log_size":75,"log_dups_size":800,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:40:19.551440+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4021,"num_read_kb":3592,"num_write":1141,"num_write_kb":414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"263'186","reported_seq":807,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:46.616198+0000","last_change":"2024-09-12T18:11:46.616198+0000","last_active":"2024-09-12T18:11:46.616198+0000","last_peered":"2024-09-12T18:11:46.616198+0000","last_clean":"2024-09-12T18:11:46.616198+0000","last_became_active":"2024-09-12T17:10:42.516802+0000","last_became_peered":"2024-09-12T17:10:42.516802+0000","last_unstale":"2024-09-12T18:11:46.616198+0000","last_undegraded":"2024-09-12T18:11:46.616198+0000","last_fullsized":"2024-09-12T18:11:46.616198+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'186","last_scrub_stamp":"2024-09-12T18:11:46.616065+0000","last_deep_scrub":"263'186","last_deep_scrub_stamp":"2024-09-12T18:11:46.616065+0000","last_clean_scrub_stamp":"2024-09-12T18:11:46.616065+0000","objects_scrubbed":5,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:50:13.105798+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":287306,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":394,"num_read_kb":13109,"num_write":967,"num_write_kb":28742,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7,1],"acting":[0,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"263'5","reported_seq":986,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:04.504714+0000","last_change":"2024-09-12T18:12:04.504714+0000","last_active":"2024-09-12T18:12:04.504714+0000","last_peered":"2024-09-12T18:12:04.504714+0000","last_clean":"2024-09-12T18:12:04.504714+0000","last_became_active":"2024-09-12T17:10:46.530466+0000","last_became_peered":"2024-09-12T17:10:46.530466+0000","last_unstale":"2024-09-12T18:12:04.504714+0000","last_undegraded":"2024-09-12T18:12:04.504714+0000","last_fullsized":"2024-09-12T18:12:04.504714+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'5","last_scrub_stamp":"2024-09-12T18:12:04.504622+0000","last_deep_scrub":"263'5","last_deep_scrub_stamp":"2024-09-12T18:12:04.504622+0000","last_clean_scrub_stamp":"2024-09-12T18:12:04.504622+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:57:02.945885+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":721,"num_read_kb":1187,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"263'97","reported_seq":638,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:14.360207+0000","last_change":"2024-09-12T18:12:14.360207+0000","last_active":"2024-09-12T18:12:14.360207+0000","last_peered":"2024-09-12T18:12:14.360207+0000","last_clean":"2024-09-12T18:12:14.360207+0000","last_became_active":"2024-09-12T17:10:48.537715+0000","last_became_peered":"2024-09-12T17:10:48.537715+0000","last_unstale":"2024-09-12T18:12:14.360207+0000","last_undegraded":"2024-09-12T18:12:14.360207+0000","last_fullsized":"2024-09-12T18:12:14.360207+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'97","last_scrub_stamp":"2024-09-12T18:12:14.360075+0000","last_deep_scrub":"263'97","last_deep_scrub_stamp":"2024-09-12T18:12:14.360075+0000","last_clean_scrub_stamp":"2024-09-12T18:12:14.360075+0000","objects_scrubbed":7,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:06:43.774112+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":103,"num_read_kb":94,"num_write":78,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1780,"num_omap_keys":6,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"263'763","reported_seq":2592,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:07.647873+0000","last_change":"2024-09-12T18:12:07.647873+0000","last_active":"2024-09-12T18:12:07.647873+0000","last_peered":"2024-09-12T18:12:07.647873+0000","last_clean":"2024-09-12T18:12:07.647873+0000","last_became_active":"2024-09-12T17:10:50.552439+0000","last_became_peered":"2024-09-12T17:10:50.552439+0000","last_unstale":"2024-09-12T18:12:07.647873+0000","last_undegraded":"2024-09-12T18:12:07.647873+0000","last_fullsized":"2024-09-12T18:12:07.647873+0000","mapping_epoch":32,"log_start":"263'700","ondisk_log_start":"263'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'763","last_scrub_stamp":"2024-09-12T18:12:07.647769+0000","last_deep_scrub":"263'763","last_deep_scrub_stamp":"2024-09-12T18:12:07.647769+0000","last_clean_scrub_stamp":"2024-09-12T18:12:07.647769+0000","objects_scrubbed":1,"log_size":63,"log_dups_size":700,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:23:23.514750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"263'102","reported_seq":608,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:19.510425+0000","last_change":"2024-09-12T18:12:19.510425+0000","last_active":"2024-09-12T18:12:19.510425+0000","last_peered":"2024-09-12T18:12:19.510425+0000","last_clean":"2024-09-12T18:12:19.510425+0000","last_became_active":"2024-09-12T17:10:52.576354+0000","last_became_peered":"2024-09-12T17:10:52.576354+0000","last_unstale":"2024-09-12T18:12:19.510425+0000","last_undegraded":"2024-09-12T18:12:19.510425+0000","last_fullsized":"2024-09-12T18:12:19.510425+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'102","last_scrub_stamp":"2024-09-12T18:12:19.510338+0000","last_deep_scrub":"263'102","last_deep_scrub_stamp":"2024-09-12T18:12:19.510338+0000","last_clean_scrub_stamp":"2024-09-12T18:12:19.510338+0000","objects_scrubbed":1,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:25:40.401986+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":153,"num_read_kb":145,"num_write":246,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"263'891","reported_seq":2570,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:58.382145+0000","last_change":"2024-09-12T18:11:58.382145+0000","last_active":"2024-09-12T18:11:58.382145+0000","last_peered":"2024-09-12T18:11:58.382145+0000","last_clean":"2024-09-12T18:11:58.382145+0000","last_became_active":"2024-09-12T17:10:44.514263+0000","last_became_peered":"2024-09-12T17:10:44.514263+0000","last_unstale":"2024-09-12T18:11:58.382145+0000","last_undegraded":"2024-09-12T18:11:58.382145+0000","last_fullsized":"2024-09-12T18:11:58.382145+0000","mapping_epoch":26,"log_start":"263'800","ondisk_log_start":"263'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'891","last_scrub_stamp":"2024-09-12T18:11:58.382053+0000","last_deep_scrub":"263'891","last_deep_scrub_stamp":"2024-09-12T18:11:58.382053+0000","last_clean_scrub_stamp":"2024-09-12T18:11:58.382053+0000","objects_scrubbed":3,"log_size":91,"log_dups_size":800,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:24:30.850739+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4092,"num_read_kb":3689,"num_write":1154,"num_write_kb":400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"263'220","reported_seq":866,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:49.222867+0000","last_change":"2024-09-12T18:11:49.222867+0000","last_active":"2024-09-12T18:11:49.222867+0000","last_peered":"2024-09-12T18:11:49.222867+0000","last_clean":"2024-09-12T18:11:49.222867+0000","last_became_active":"2024-09-12T17:10:42.527644+0000","last_became_peered":"2024-09-12T17:10:42.527644+0000","last_unstale":"2024-09-12T18:11:49.222867+0000","last_undegraded":"2024-09-12T18:11:49.222867+0000","last_fullsized":"2024-09-12T18:11:49.222867+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'220","last_scrub_stamp":"2024-09-12T18:11:49.222706+0000","last_deep_scrub":"263'220","last_deep_scrub_stamp":"2024-09-12T18:11:49.222706+0000","last_clean_scrub_stamp":"2024-09-12T18:11:49.222706+0000","objects_scrubbed":5,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:22:56.036981+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":569092,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":486,"num_read_kb":29332,"num_write":1044,"num_write_kb":31012,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,6],"acting":[5,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":500,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:08.571171+0000","last_change":"2024-09-12T18:12:08.571171+0000","last_active":"2024-09-12T18:12:08.571171+0000","last_peered":"2024-09-12T18:12:08.571171+0000","last_clean":"2024-09-12T18:12:08.571171+0000","last_became_active":"2024-09-12T17:10:46.531759+0000","last_became_peered":"2024-09-12T17:10:46.531759+0000","last_unstale":"2024-09-12T18:12:08.571171+0000","last_undegraded":"2024-09-12T18:12:08.571171+0000","last_fullsized":"2024-09-12T18:12:08.571171+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:08.571082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:08.571082+0000","last_clean_scrub_stamp":"2024-09-12T18:12:08.571082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:30:07.942782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"263'211","reported_seq":805,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:16.500087+0000","last_change":"2024-09-12T18:12:16.500087+0000","last_active":"2024-09-12T18:12:16.500087+0000","last_peered":"2024-09-12T18:12:16.500087+0000","last_clean":"2024-09-12T18:12:16.500087+0000","last_became_active":"2024-09-12T17:10:48.543123+0000","last_became_peered":"2024-09-12T17:10:48.543123+0000","last_unstale":"2024-09-12T18:12:16.500087+0000","last_undegraded":"2024-09-12T18:12:16.500087+0000","last_fullsized":"2024-09-12T18:12:16.500087+0000","mapping_epoch":30,"log_start":"263'200","ondisk_log_start":"263'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'211","last_scrub_stamp":"2024-09-12T18:12:16.499980+0000","last_deep_scrub":"263'211","last_deep_scrub_stamp":"2024-09-12T18:12:16.499980+0000","last_clean_scrub_stamp":"2024-09-12T18:12:16.499980+0000","objects_scrubbed":11,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:06:58.866518+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9151,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":248,"num_read_kb":305,"num_write":156,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:16.650045+0000","last_change":"2024-09-12T18:12:16.650045+0000","last_active":"2024-09-12T18:12:16.650045+0000","last_peered":"2024-09-12T18:12:16.650045+0000","last_clean":"2024-09-12T18:12:16.650045+0000","last_became_active":"2024-09-12T17:10:50.556040+0000","last_became_peered":"2024-09-12T17:10:50.556040+0000","last_unstale":"2024-09-12T18:12:16.650045+0000","last_undegraded":"2024-09-12T18:12:16.650045+0000","last_fullsized":"2024-09-12T18:12:16.650045+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:16.649958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:16.649958+0000","last_clean_scrub_stamp":"2024-09-12T18:12:16.649958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:14:49.148713+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"263'134","reported_seq":642,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:30.539641+0000","last_change":"2024-09-12T18:12:30.539641+0000","last_active":"2024-09-12T18:12:30.539641+0000","last_peered":"2024-09-12T18:12:30.539641+0000","last_clean":"2024-09-12T18:12:30.539641+0000","last_became_active":"2024-09-12T17:10:52.584752+0000","last_became_peered":"2024-09-12T17:10:52.584752+0000","last_unstale":"2024-09-12T18:12:30.539641+0000","last_undegraded":"2024-09-12T18:12:30.539641+0000","last_fullsized":"2024-09-12T18:12:30.539641+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'134","last_scrub_stamp":"2024-09-12T18:12:30.539556+0000","last_deep_scrub":"263'134","last_deep_scrub_stamp":"2024-09-12T18:12:30.539556+0000","last_clean_scrub_stamp":"2024-09-12T18:12:30.539556+0000","objects_scrubbed":2,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:04:43.237354+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":200,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":199,"num_read_kb":187,"num_write":331,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"263'458","reported_seq":2257,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:56.346868+0000","last_change":"2024-09-12T18:11:56.346868+0000","last_active":"2024-09-12T18:11:56.346868+0000","last_peered":"2024-09-12T18:11:56.346868+0000","last_clean":"2024-09-12T18:11:56.346868+0000","last_became_active":"2024-09-12T17:10:44.515463+0000","last_became_peered":"2024-09-12T17:10:44.515463+0000","last_unstale":"2024-09-12T18:11:56.346868+0000","last_undegraded":"2024-09-12T18:11:56.346868+0000","last_fullsized":"2024-09-12T18:11:56.346868+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'458","last_scrub_stamp":"2024-09-12T18:11:56.346672+0000","last_deep_scrub":"263'458","last_deep_scrub_stamp":"2024-09-12T18:11:56.346672+0000","last_clean_scrub_stamp":"2024-09-12T18:11:56.346672+0000","objects_scrubbed":3,"log_size":58,"log_dups_size":400,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:31:31.404176+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2803,"num_read_kb":2700,"num_write":505,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2296,"num_omap_keys":9,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"263'189","reported_seq":813,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:52.278519+0000","last_change":"2024-09-12T18:11:52.278519+0000","last_active":"2024-09-12T18:11:52.278519+0000","last_peered":"2024-09-12T18:11:52.278519+0000","last_clean":"2024-09-12T18:11:52.278519+0000","last_became_active":"2024-09-12T17:10:42.529547+0000","last_became_peered":"2024-09-12T17:10:42.529547+0000","last_unstale":"2024-09-12T18:11:52.278519+0000","last_undegraded":"2024-09-12T18:11:52.278519+0000","last_fullsized":"2024-09-12T18:11:52.278519+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'189","last_scrub_stamp":"2024-09-12T18:11:52.278416+0000","last_deep_scrub":"263'189","last_deep_scrub_stamp":"2024-09-12T18:11:52.278416+0000","last_clean_scrub_stamp":"2024-09-12T18:11:52.278416+0000","objects_scrubbed":1,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:18:56.517970+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262159,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":394,"num_read_kb":39415,"num_write":893,"num_write_kb":32700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,6],"acting":[5,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":501,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:10.426744+0000","last_change":"2024-09-12T18:12:10.426744+0000","last_active":"2024-09-12T18:12:10.426744+0000","last_peered":"2024-09-12T18:12:10.426744+0000","last_clean":"2024-09-12T18:12:10.426744+0000","last_became_active":"2024-09-12T17:10:46.532418+0000","last_became_peered":"2024-09-12T17:10:46.532418+0000","last_unstale":"2024-09-12T18:12:10.426744+0000","last_undegraded":"2024-09-12T18:12:10.426744+0000","last_fullsized":"2024-09-12T18:12:10.426744+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:10.426654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:10.426654+0000","last_clean_scrub_stamp":"2024-09-12T18:12:10.426654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:46:06.300212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"263'135","reported_seq":716,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:10.720683+0000","last_change":"2024-09-12T18:12:10.720683+0000","last_active":"2024-09-12T18:12:10.720683+0000","last_peered":"2024-09-12T18:12:10.720683+0000","last_clean":"2024-09-12T18:12:10.720683+0000","last_became_active":"2024-09-12T17:10:48.539047+0000","last_became_peered":"2024-09-12T17:10:48.539047+0000","last_unstale":"2024-09-12T18:12:10.720683+0000","last_undegraded":"2024-09-12T18:12:10.720683+0000","last_fullsized":"2024-09-12T18:12:10.720683+0000","mapping_epoch":30,"log_start":"263'100","ondisk_log_start":"263'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'135","last_scrub_stamp":"2024-09-12T18:12:10.720566+0000","last_deep_scrub":"263'135","last_deep_scrub_stamp":"2024-09-12T18:12:10.720566+0000","last_clean_scrub_stamp":"2024-09-12T18:12:10.720566+0000","objects_scrubbed":4,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:38:55.106793+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5891,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":167,"num_read_kb":220,"num_write":88,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:06.695452+0000","last_change":"2024-09-12T18:12:06.695452+0000","last_active":"2024-09-12T18:12:06.695452+0000","last_peered":"2024-09-12T18:12:06.695452+0000","last_clean":"2024-09-12T18:12:06.695452+0000","last_became_active":"2024-09-12T17:10:50.555858+0000","last_became_peered":"2024-09-12T17:10:50.555858+0000","last_unstale":"2024-09-12T18:12:06.695452+0000","last_undegraded":"2024-09-12T18:12:06.695452+0000","last_fullsized":"2024-09-12T18:12:06.695452+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:06.695331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:06.695331+0000","last_clean_scrub_stamp":"2024-09-12T18:12:06.695331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:53:28.220067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"263'113","reported_seq":635,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:27.601203+0000","last_change":"2024-09-12T18:12:27.601203+0000","last_active":"2024-09-12T18:12:27.601203+0000","last_peered":"2024-09-12T18:12:27.601203+0000","last_clean":"2024-09-12T18:12:27.601203+0000","last_became_active":"2024-09-12T17:10:52.671139+0000","last_became_peered":"2024-09-12T17:10:52.671139+0000","last_unstale":"2024-09-12T18:12:27.601203+0000","last_undegraded":"2024-09-12T18:12:27.601203+0000","last_fullsized":"2024-09-12T18:12:27.601203+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'113","last_scrub_stamp":"2024-09-12T18:12:27.601114+0000","last_deep_scrub":"263'113","last_deep_scrub_stamp":"2024-09-12T18:12:27.601114+0000","last_clean_scrub_stamp":"2024-09-12T18:12:27.601114+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:04:28.884400+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":178,"num_read_kb":175,"num_write":256,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"263'787","reported_seq":2346,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:02.451406+0000","last_change":"2024-09-12T18:12:02.451406+0000","last_active":"2024-09-12T18:12:02.451406+0000","last_peered":"2024-09-12T18:12:02.451406+0000","last_clean":"2024-09-12T18:12:02.451406+0000","last_became_active":"2024-09-12T17:11:16.618723+0000","last_became_peered":"2024-09-12T17:11:16.618723+0000","last_unstale":"2024-09-12T18:12:02.451406+0000","last_undegraded":"2024-09-12T18:12:02.451406+0000","last_fullsized":"2024-09-12T18:12:02.451406+0000","mapping_epoch":37,"log_start":"263'700","ondisk_log_start":"263'700","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'787","last_scrub_stamp":"2024-09-12T18:12:02.451316+0000","last_deep_scrub":"263'787","last_deep_scrub_stamp":"2024-09-12T18:12:02.451316+0000","last_clean_scrub_stamp":"2024-09-12T18:12:02.451316+0000","objects_scrubbed":3,"log_size":87,"log_dups_size":700,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:25:44.064178+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4039,"num_read_kb":3670,"num_write":1050,"num_write_kb":387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":721,"num_omap_keys":3,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"263'172","reported_seq":841,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:51.566718+0000","last_change":"2024-09-12T18:11:51.566718+0000","last_active":"2024-09-12T18:11:51.566718+0000","last_peered":"2024-09-12T18:11:51.566718+0000","last_clean":"2024-09-12T18:11:51.566718+0000","last_became_active":"2024-09-12T17:10:42.534052+0000","last_became_peered":"2024-09-12T17:10:42.534052+0000","last_unstale":"2024-09-12T18:11:51.566718+0000","last_undegraded":"2024-09-12T18:11:51.566718+0000","last_fullsized":"2024-09-12T18:11:51.566718+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'172","last_scrub_stamp":"2024-09-12T18:11:51.566522+0000","last_deep_scrub":"263'172","last_deep_scrub_stamp":"2024-09-12T18:11:51.566522+0000","last_clean_scrub_stamp":"2024-09-12T18:11:51.566522+0000","objects_scrubbed":4,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:00:03.267177+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":311063,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":426,"num_read_kb":101566,"num_write":826,"num_write_kb":35642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7,2],"acting":[3,6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":510,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:07.339407+0000","last_change":"2024-09-12T18:12:07.339407+0000","last_active":"2024-09-12T18:12:07.339407+0000","last_peered":"2024-09-12T18:12:07.339407+0000","last_clean":"2024-09-12T18:12:07.339407+0000","last_became_active":"2024-09-12T17:10:46.530079+0000","last_became_peered":"2024-09-12T17:10:46.530079+0000","last_unstale":"2024-09-12T18:12:07.339407+0000","last_undegraded":"2024-09-12T18:12:07.339407+0000","last_fullsized":"2024-09-12T18:12:07.339407+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:07.339316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:07.339316+0000","last_clean_scrub_stamp":"2024-09-12T18:12:07.339316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:50:36.646747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"263'106","reported_seq":670,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:18.615653+0000","last_change":"2024-09-12T18:12:18.615653+0000","last_active":"2024-09-12T18:12:18.615653+0000","last_peered":"2024-09-12T18:12:18.615653+0000","last_clean":"2024-09-12T18:12:18.615653+0000","last_became_active":"2024-09-12T17:10:48.542918+0000","last_became_peered":"2024-09-12T17:10:48.542918+0000","last_unstale":"2024-09-12T18:12:18.615653+0000","last_undegraded":"2024-09-12T18:12:18.615653+0000","last_fullsized":"2024-09-12T18:12:18.615653+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'106","last_scrub_stamp":"2024-09-12T18:12:18.615561+0000","last_deep_scrub":"263'106","last_deep_scrub_stamp":"2024-09-12T18:12:18.615561+0000","last_clean_scrub_stamp":"2024-09-12T18:12:18.615561+0000","objects_scrubbed":2,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:13:33.347662+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7088,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":129,"num_read_kb":191,"num_write":60,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":501,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:17.332759+0000","last_change":"2024-09-12T18:12:17.332759+0000","last_active":"2024-09-12T18:12:17.332759+0000","last_peered":"2024-09-12T18:12:17.332759+0000","last_clean":"2024-09-12T18:12:17.332759+0000","last_became_active":"2024-09-12T17:10:50.558162+0000","last_became_peered":"2024-09-12T17:10:50.558162+0000","last_unstale":"2024-09-12T18:12:17.332759+0000","last_undegraded":"2024-09-12T18:12:17.332759+0000","last_fullsized":"2024-09-12T18:12:17.332759+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:17.332674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:17.332674+0000","last_clean_scrub_stamp":"2024-09-12T18:12:17.332674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:35:12.355855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"263'154","reported_seq":1257,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:20.511456+0000","last_change":"2024-09-12T18:12:20.511456+0000","last_active":"2024-09-12T18:12:20.511456+0000","last_peered":"2024-09-12T18:12:20.511456+0000","last_clean":"2024-09-12T18:12:20.511456+0000","last_became_active":"2024-09-12T17:10:52.584763+0000","last_became_peered":"2024-09-12T17:10:52.584763+0000","last_unstale":"2024-09-12T18:12:20.511456+0000","last_undegraded":"2024-09-12T18:12:20.511456+0000","last_fullsized":"2024-09-12T18:12:20.511456+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'154","last_scrub_stamp":"2024-09-12T18:12:20.511367+0000","last_deep_scrub":"263'154","last_deep_scrub_stamp":"2024-09-12T18:12:20.511367+0000","last_clean_scrub_stamp":"2024-09-12T18:12:20.511367+0000","objects_scrubbed":3,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:48:36.131028+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":215,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":802,"num_read_kb":800,"num_write":350,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"263'1274","reported_seq":2985,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:55.368952+0000","last_change":"2024-09-12T18:11:55.368952+0000","last_active":"2024-09-12T18:11:55.368952+0000","last_peered":"2024-09-12T18:11:55.368952+0000","last_clean":"2024-09-12T18:11:55.368952+0000","last_became_active":"2024-09-12T17:10:44.513047+0000","last_became_peered":"2024-09-12T17:10:44.513047+0000","last_unstale":"2024-09-12T18:11:55.368952+0000","last_undegraded":"2024-09-12T18:11:55.368952+0000","last_fullsized":"2024-09-12T18:11:55.368952+0000","mapping_epoch":26,"log_start":"263'1200","ondisk_log_start":"263'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1274","last_scrub_stamp":"2024-09-12T18:11:55.368862+0000","last_deep_scrub":"263'1274","last_deep_scrub_stamp":"2024-09-12T18:11:55.368862+0000","last_clean_scrub_stamp":"2024-09-12T18:11:55.368862+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":1200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:24:50.641775+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5916,"num_read_kb":5241,"num_write":1773,"num_write_kb":764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"263'270","reported_seq":946,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:49.700632+0000","last_change":"2024-09-12T18:11:49.700632+0000","last_active":"2024-09-12T18:11:49.700632+0000","last_peered":"2024-09-12T18:11:49.700632+0000","last_clean":"2024-09-12T18:11:49.700632+0000","last_became_active":"2024-09-12T17:11:16.862649+0000","last_became_peered":"2024-09-12T17:11:16.862649+0000","last_unstale":"2024-09-12T18:11:49.700632+0000","last_undegraded":"2024-09-12T18:11:49.700632+0000","last_fullsized":"2024-09-12T18:11:49.700632+0000","mapping_epoch":37,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'270","last_scrub_stamp":"2024-09-12T18:11:49.700437+0000","last_deep_scrub":"263'270","last_deep_scrub_stamp":"2024-09-12T18:11:49.700437+0000","last_clean_scrub_stamp":"2024-09-12T18:11:49.700437+0000","objects_scrubbed":5,"log_size":70,"log_dups_size":200,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:58:14.954108+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079905,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":591,"num_read_kb":13963,"num_write":1200,"num_write_kb":16858,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,7],"acting":[0,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"263'2","reported_seq":510,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:03.517735+0000","last_change":"2024-09-12T18:12:03.517735+0000","last_active":"2024-09-12T18:12:03.517735+0000","last_peered":"2024-09-12T18:12:03.517735+0000","last_clean":"2024-09-12T18:12:03.517735+0000","last_became_active":"2024-09-12T17:10:46.527422+0000","last_became_peered":"2024-09-12T17:10:46.527422+0000","last_unstale":"2024-09-12T18:12:03.517735+0000","last_undegraded":"2024-09-12T18:12:03.517735+0000","last_fullsized":"2024-09-12T18:12:03.517735+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T18:12:03.517615+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T18:12:03.517615+0000","last_clean_scrub_stamp":"2024-09-12T18:12:03.517615+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:57.076736+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"263'170","reported_seq":769,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:12.322398+0000","last_change":"2024-09-12T18:12:12.322398+0000","last_active":"2024-09-12T18:12:12.322398+0000","last_peered":"2024-09-12T18:12:12.322398+0000","last_clean":"2024-09-12T18:12:12.322398+0000","last_became_active":"2024-09-12T17:10:48.544572+0000","last_became_peered":"2024-09-12T17:10:48.544572+0000","last_unstale":"2024-09-12T18:12:12.322398+0000","last_undegraded":"2024-09-12T18:12:12.322398+0000","last_fullsized":"2024-09-12T18:12:12.322398+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'170","last_scrub_stamp":"2024-09-12T18:12:12.322280+0000","last_deep_scrub":"263'170","last_deep_scrub_stamp":"2024-09-12T18:12:12.322280+0000","last_clean_scrub_stamp":"2024-09-12T18:12:12.322280+0000","objects_scrubbed":5,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:27:13.540812+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6031,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":216,"num_read_kb":279,"num_write":122,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":498,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:17.660362+0000","last_change":"2024-09-12T18:12:17.660362+0000","last_active":"2024-09-12T18:12:17.660362+0000","last_peered":"2024-09-12T18:12:17.660362+0000","last_clean":"2024-09-12T18:12:17.660362+0000","last_became_active":"2024-09-12T17:10:50.560057+0000","last_became_peered":"2024-09-12T17:10:50.560057+0000","last_unstale":"2024-09-12T18:12:17.660362+0000","last_undegraded":"2024-09-12T18:12:17.660362+0000","last_fullsized":"2024-09-12T18:12:17.660362+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:17.660267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:17.660267+0000","last_clean_scrub_stamp":"2024-09-12T18:12:17.660267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:54:00.890287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"263'134","reported_seq":634,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:19.333865+0000","last_change":"2024-09-12T18:12:19.333865+0000","last_active":"2024-09-12T18:12:19.333865+0000","last_peered":"2024-09-12T18:12:19.333865+0000","last_clean":"2024-09-12T18:12:19.333865+0000","last_became_active":"2024-09-12T17:10:52.570480+0000","last_became_peered":"2024-09-12T17:10:52.570480+0000","last_unstale":"2024-09-12T18:12:19.333865+0000","last_undegraded":"2024-09-12T18:12:19.333865+0000","last_fullsized":"2024-09-12T18:12:19.333865+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'134","last_scrub_stamp":"2024-09-12T18:12:19.333752+0000","last_deep_scrub":"263'134","last_deep_scrub_stamp":"2024-09-12T18:12:19.333752+0000","last_clean_scrub_stamp":"2024-09-12T18:12:19.333752+0000","objects_scrubbed":2,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:45:19.407409+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":203,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":138,"num_read_kb":137,"num_write":320,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"263'412","reported_seq":1803,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:01.560956+0000","last_change":"2024-09-12T18:12:01.560956+0000","last_active":"2024-09-12T18:12:01.560956+0000","last_peered":"2024-09-12T18:12:01.560956+0000","last_clean":"2024-09-12T18:12:01.560956+0000","last_became_active":"2024-09-12T17:10:44.509508+0000","last_became_peered":"2024-09-12T17:10:44.509508+0000","last_unstale":"2024-09-12T18:12:01.560956+0000","last_undegraded":"2024-09-12T18:12:01.560956+0000","last_fullsized":"2024-09-12T18:12:01.560956+0000","mapping_epoch":26,"log_start":"263'401","ondisk_log_start":"263'401","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'412","last_scrub_stamp":"2024-09-12T18:12:01.560858+0000","last_deep_scrub":"263'412","last_deep_scrub_stamp":"2024-09-12T18:12:01.560858+0000","last_clean_scrub_stamp":"2024-09-12T18:12:01.560858+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":401,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:20:20.291813+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2094,"num_read_kb":1953,"num_write":504,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"263'239","reported_seq":891,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:50.835781+0000","last_change":"2024-09-12T18:11:50.835781+0000","last_active":"2024-09-12T18:11:50.835781+0000","last_peered":"2024-09-12T18:11:50.835781+0000","last_clean":"2024-09-12T18:11:50.835781+0000","last_became_active":"2024-09-12T17:10:42.521435+0000","last_became_peered":"2024-09-12T17:10:42.521435+0000","last_unstale":"2024-09-12T18:11:50.835781+0000","last_undegraded":"2024-09-12T18:11:50.835781+0000","last_fullsized":"2024-09-12T18:11:50.835781+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'239","last_scrub_stamp":"2024-09-12T18:11:50.835643+0000","last_deep_scrub":"263'239","last_deep_scrub_stamp":"2024-09-12T18:11:50.835643+0000","last_clean_scrub_stamp":"2024-09-12T18:11:50.835643+0000","objects_scrubbed":2,"log_size":39,"log_dups_size":200,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:10:01.459513+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079890,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":525,"num_read_kb":7759,"num_write":1104,"num_write_kb":27695,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,5],"acting":[6,0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"263'496","reported_seq":2220,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:59.616995+0000","last_change":"2024-09-12T18:11:59.616995+0000","last_active":"2024-09-12T18:11:59.616995+0000","last_peered":"2024-09-12T18:11:59.616995+0000","last_clean":"2024-09-12T18:11:59.616995+0000","last_became_active":"2024-09-12T17:10:44.519236+0000","last_became_peered":"2024-09-12T17:10:44.519236+0000","last_unstale":"2024-09-12T18:11:59.616995+0000","last_undegraded":"2024-09-12T18:11:59.616995+0000","last_fullsized":"2024-09-12T18:11:59.616995+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'496","last_scrub_stamp":"2024-09-12T18:11:59.616900+0000","last_deep_scrub":"263'496","last_deep_scrub_stamp":"2024-09-12T18:11:59.616900+0000","last_clean_scrub_stamp":"2024-09-12T18:11:59.616900+0000","objects_scrubbed":4,"log_size":96,"log_dups_size":400,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:18:26.390822+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2628,"num_read_kb":2506,"num_write":587,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":959,"num_omap_keys":4,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"263'256","reported_seq":1028,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:46.841303+0000","last_change":"2024-09-12T18:11:46.841303+0000","last_active":"2024-09-12T18:11:46.841303+0000","last_peered":"2024-09-12T18:11:46.841303+0000","last_clean":"2024-09-12T18:11:46.841303+0000","last_became_active":"2024-09-12T17:10:42.519178+0000","last_became_peered":"2024-09-12T17:10:42.519178+0000","last_unstale":"2024-09-12T18:11:46.841303+0000","last_undegraded":"2024-09-12T18:11:46.841303+0000","last_fullsized":"2024-09-12T18:11:46.841303+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'256","last_scrub_stamp":"2024-09-12T18:11:46.841193+0000","last_deep_scrub":"263'256","last_deep_scrub_stamp":"2024-09-12T18:11:46.841193+0000","last_clean_scrub_stamp":"2024-09-12T18:11:46.841193+0000","objects_scrubbed":4,"log_size":56,"log_dups_size":200,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:18:03.918052+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1051,"num_read_kb":7502,"num_write":1184,"num_write_kb":38848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6,7],"acting":[2,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"263'393","reported_seq":1978,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:03.464560+0000","last_change":"2024-09-12T18:12:03.464560+0000","last_active":"2024-09-12T18:12:03.464560+0000","last_peered":"2024-09-12T18:12:03.464560+0000","last_clean":"2024-09-12T18:12:03.464560+0000","last_became_active":"2024-09-12T17:10:44.515474+0000","last_became_peered":"2024-09-12T17:10:44.515474+0000","last_unstale":"2024-09-12T18:12:03.464560+0000","last_undegraded":"2024-09-12T18:12:03.464560+0000","last_fullsized":"2024-09-12T18:12:03.464560+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'393","last_scrub_stamp":"2024-09-12T18:12:03.464469+0000","last_deep_scrub":"263'393","last_deep_scrub_stamp":"2024-09-12T18:12:03.464469+0000","last_clean_scrub_stamp":"2024-09-12T18:12:03.464469+0000","objects_scrubbed":2,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:20:00.913328+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2306,"num_read_kb":2212,"num_write":451,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2811,"num_omap_keys":11,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"263'194","reported_seq":821,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:49.831325+0000","last_change":"2024-09-12T18:11:49.831325+0000","last_active":"2024-09-12T18:11:49.831325+0000","last_peered":"2024-09-12T18:11:49.831325+0000","last_clean":"2024-09-12T18:11:49.831325+0000","last_became_active":"2024-09-12T17:11:16.617657+0000","last_became_peered":"2024-09-12T17:11:16.617657+0000","last_unstale":"2024-09-12T18:11:49.831325+0000","last_undegraded":"2024-09-12T18:11:49.831325+0000","last_fullsized":"2024-09-12T18:11:49.831325+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'194","last_scrub_stamp":"2024-09-12T18:11:49.831132+0000","last_deep_scrub":"263'194","last_deep_scrub_stamp":"2024-09-12T18:11:49.831132+0000","last_clean_scrub_stamp":"2024-09-12T18:11:49.831132+0000","objects_scrubbed":4,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:50:28.703505+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2421940,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":499,"num_read_kb":26759,"num_write":947,"num_write_kb":25619,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,6],"acting":[2,3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"263'796","reported_seq":2424,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:58.588172+0000","last_change":"2024-09-12T18:11:58.588172+0000","last_active":"2024-09-12T18:11:58.588172+0000","last_peered":"2024-09-12T18:11:58.588172+0000","last_clean":"2024-09-12T18:11:58.588172+0000","last_became_active":"2024-09-12T17:10:44.509845+0000","last_became_peered":"2024-09-12T17:10:44.509845+0000","last_unstale":"2024-09-12T18:11:58.588172+0000","last_undegraded":"2024-09-12T18:11:58.588172+0000","last_fullsized":"2024-09-12T18:11:58.588172+0000","mapping_epoch":26,"log_start":"263'700","ondisk_log_start":"263'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'796","last_scrub_stamp":"2024-09-12T18:11:58.588066+0000","last_deep_scrub":"263'796","last_deep_scrub_stamp":"2024-09-12T18:11:58.588066+0000","last_clean_scrub_stamp":"2024-09-12T18:11:58.588066+0000","objects_scrubbed":4,"log_size":96,"log_dups_size":700,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:21:17.530150+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3882,"num_read_kb":3524,"num_write":1030,"num_write_kb":369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1767,"num_omap_keys":7,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"263'227","reported_seq":866,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:48.683516+0000","last_change":"2024-09-12T18:11:48.683516+0000","last_active":"2024-09-12T18:11:48.683516+0000","last_peered":"2024-09-12T18:11:48.683516+0000","last_clean":"2024-09-12T18:11:48.683516+0000","last_became_active":"2024-09-12T17:10:42.519560+0000","last_became_peered":"2024-09-12T17:10:42.519560+0000","last_unstale":"2024-09-12T18:11:48.683516+0000","last_undegraded":"2024-09-12T18:11:48.683516+0000","last_fullsized":"2024-09-12T18:11:48.683516+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'227","last_scrub_stamp":"2024-09-12T18:11:48.683332+0000","last_deep_scrub":"263'227","last_deep_scrub_stamp":"2024-09-12T18:11:48.683332+0000","last_clean_scrub_stamp":"2024-09-12T18:11:48.683332+0000","objects_scrubbed":4,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:30:14.775998+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436858,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":420,"num_read_kb":2141,"num_write":1026,"num_write_kb":23963,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,1],"acting":[0,3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"263'775","reported_seq":2456,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:02.695598+0000","last_change":"2024-09-12T18:12:02.695598+0000","last_active":"2024-09-12T18:12:02.695598+0000","last_peered":"2024-09-12T18:12:02.695598+0000","last_clean":"2024-09-12T18:12:02.695598+0000","last_became_active":"2024-09-12T17:10:44.511893+0000","last_became_peered":"2024-09-12T17:10:44.511893+0000","last_unstale":"2024-09-12T18:12:02.695598+0000","last_undegraded":"2024-09-12T18:12:02.695598+0000","last_fullsized":"2024-09-12T18:12:02.695598+0000","mapping_epoch":26,"log_start":"263'700","ondisk_log_start":"263'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'775","last_scrub_stamp":"2024-09-12T18:12:02.695496+0000","last_deep_scrub":"263'775","last_deep_scrub_stamp":"2024-09-12T18:12:02.695496+0000","last_clean_scrub_stamp":"2024-09-12T18:12:02.695496+0000","objects_scrubbed":6,"log_size":75,"log_dups_size":700,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:46:44.854411+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":3826,"num_read_kb":3490,"num_write":982,"num_write_kb":336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":873,"num_omap_keys":4,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"263'223","reported_seq":1076,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:52.597345+0000","last_change":"2024-09-12T18:11:52.597345+0000","last_active":"2024-09-12T18:11:52.597345+0000","last_peered":"2024-09-12T18:11:52.597345+0000","last_clean":"2024-09-12T18:11:52.597345+0000","last_became_active":"2024-09-12T17:10:42.524018+0000","last_became_peered":"2024-09-12T17:10:42.524018+0000","last_unstale":"2024-09-12T18:11:52.597345+0000","last_undegraded":"2024-09-12T18:11:52.597345+0000","last_fullsized":"2024-09-12T18:11:52.597345+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'223","last_scrub_stamp":"2024-09-12T18:11:52.597221+0000","last_deep_scrub":"263'223","last_deep_scrub_stamp":"2024-09-12T18:11:52.597221+0000","last_clean_scrub_stamp":"2024-09-12T18:11:52.597221+0000","objects_scrubbed":7,"log_size":23,"log_dups_size":200,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:24:31.501834+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6860809,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1298,"num_read_kb":150766,"num_write":988,"num_write_kb":42134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0,7],"acting":[3,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"263'525","reported_seq":2028,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:00.344852+0000","last_change":"2024-09-12T18:12:00.344852+0000","last_active":"2024-09-12T18:12:00.344852+0000","last_peered":"2024-09-12T18:12:00.344852+0000","last_clean":"2024-09-12T18:12:00.344852+0000","last_became_active":"2024-09-12T17:10:44.509433+0000","last_became_peered":"2024-09-12T17:10:44.509433+0000","last_unstale":"2024-09-12T18:12:00.344852+0000","last_undegraded":"2024-09-12T18:12:00.344852+0000","last_fullsized":"2024-09-12T18:12:00.344852+0000","mapping_epoch":26,"log_start":"263'500","ondisk_log_start":"263'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'525","last_scrub_stamp":"2024-09-12T18:12:00.344754+0000","last_deep_scrub":"263'525","last_deep_scrub_stamp":"2024-09-12T18:12:00.344754+0000","last_clean_scrub_stamp":"2024-09-12T18:12:00.344754+0000","objects_scrubbed":1,"log_size":25,"log_dups_size":500,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:26:19.066537+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2637,"num_read_kb":2409,"num_write":664,"num_write_kb":195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"263'180","reported_seq":848,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:49.669048+0000","last_change":"2024-09-12T18:11:49.669048+0000","last_active":"2024-09-12T18:11:49.669048+0000","last_peered":"2024-09-12T18:11:49.669048+0000","last_clean":"2024-09-12T18:11:49.669048+0000","last_became_active":"2024-09-12T17:10:42.514593+0000","last_became_peered":"2024-09-12T17:10:42.514593+0000","last_unstale":"2024-09-12T18:11:49.669048+0000","last_undegraded":"2024-09-12T18:11:49.669048+0000","last_fullsized":"2024-09-12T18:11:49.669048+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'180","last_scrub_stamp":"2024-09-12T18:11:49.668940+0000","last_deep_scrub":"263'180","last_deep_scrub_stamp":"2024-09-12T18:11:49.668940+0000","last_clean_scrub_stamp":"2024-09-12T18:11:49.668940+0000","objects_scrubbed":3,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:25:30.505868+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262186,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":484,"num_read_kb":20980,"num_write":843,"num_write_kb":34024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,5],"acting":[1,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"263'1126","reported_seq":2702,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:59.649341+0000","last_change":"2024-09-12T18:11:59.649341+0000","last_active":"2024-09-12T18:11:59.649341+0000","last_peered":"2024-09-12T18:11:59.649341+0000","last_clean":"2024-09-12T18:11:59.649341+0000","last_became_active":"2024-09-12T17:10:44.522911+0000","last_became_peered":"2024-09-12T17:10:44.522911+0000","last_unstale":"2024-09-12T18:11:59.649341+0000","last_undegraded":"2024-09-12T18:11:59.649341+0000","last_fullsized":"2024-09-12T18:11:59.649341+0000","mapping_epoch":26,"log_start":"263'1100","ondisk_log_start":"263'1100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1126","last_scrub_stamp":"2024-09-12T18:11:59.649236+0000","last_deep_scrub":"263'1126","last_deep_scrub_stamp":"2024-09-12T18:11:59.649236+0000","last_clean_scrub_stamp":"2024-09-12T18:11:59.649236+0000","objects_scrubbed":2,"log_size":26,"log_dups_size":1100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:23:15.875406+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5182,"num_read_kb":4601,"num_write":1539,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"263'194","reported_seq":848,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:51.815496+0000","last_change":"2024-09-12T18:11:51.815496+0000","last_active":"2024-09-12T18:11:51.815496+0000","last_peered":"2024-09-12T18:11:51.815496+0000","last_clean":"2024-09-12T18:11:51.815496+0000","last_became_active":"2024-09-12T17:10:42.520304+0000","last_became_peered":"2024-09-12T17:10:42.520304+0000","last_unstale":"2024-09-12T18:11:51.815496+0000","last_undegraded":"2024-09-12T18:11:51.815496+0000","last_fullsized":"2024-09-12T18:11:51.815496+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'194","last_scrub_stamp":"2024-09-12T18:11:51.815318+0000","last_deep_scrub":"263'194","last_deep_scrub_stamp":"2024-09-12T18:11:51.815318+0000","last_clean_scrub_stamp":"2024-09-12T18:11:51.815318+0000","objects_scrubbed":2,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:18:33.880648+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1342049,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":493,"num_read_kb":8074,"num_write":952,"num_write_kb":20454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4,5],"acting":[6,7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"263'882","reported_seq":2590,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:57.696628+0000","last_change":"2024-09-12T18:11:57.696628+0000","last_active":"2024-09-12T18:11:57.696628+0000","last_peered":"2024-09-12T18:11:57.696628+0000","last_clean":"2024-09-12T18:11:57.696628+0000","last_became_active":"2024-09-12T17:10:44.517530+0000","last_became_peered":"2024-09-12T17:10:44.517530+0000","last_unstale":"2024-09-12T18:11:57.696628+0000","last_undegraded":"2024-09-12T18:11:57.696628+0000","last_fullsized":"2024-09-12T18:11:57.696628+0000","mapping_epoch":26,"log_start":"263'800","ondisk_log_start":"263'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'882","last_scrub_stamp":"2024-09-12T18:11:57.696541+0000","last_deep_scrub":"263'882","last_deep_scrub_stamp":"2024-09-12T18:11:57.696541+0000","last_clean_scrub_stamp":"2024-09-12T18:11:57.696541+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":800,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:06:13.761379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4395,"num_read_kb":3967,"num_write":1219,"num_write_kb":499,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"263'187","reported_seq":816,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:04.607590+0000","last_change":"2024-09-12T18:12:04.607590+0000","last_active":"2024-09-12T18:12:04.607590+0000","last_peered":"2024-09-12T18:12:04.607590+0000","last_clean":"2024-09-12T18:12:04.607590+0000","last_became_active":"2024-09-12T17:10:42.528899+0000","last_became_peered":"2024-09-12T17:10:42.528899+0000","last_unstale":"2024-09-12T18:12:04.607590+0000","last_undegraded":"2024-09-12T18:12:04.607590+0000","last_fullsized":"2024-09-12T18:12:04.607590+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'187","last_scrub_stamp":"2024-09-12T18:12:04.607432+0000","last_deep_scrub":"263'187","last_deep_scrub_stamp":"2024-09-12T18:12:04.607432+0000","last_clean_scrub_stamp":"2024-09-12T18:12:04.607432+0000","objects_scrubbed":5,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:45:28.481287+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7371399,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":389,"num_read_kb":42419,"num_write":869,"num_write_kb":46548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,5],"acting":[3,4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"263'388","reported_seq":1852,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:00.729788+0000","last_change":"2024-09-12T18:12:00.729788+0000","last_active":"2024-09-12T18:12:00.729788+0000","last_peered":"2024-09-12T18:12:00.729788+0000","last_clean":"2024-09-12T18:12:00.729788+0000","last_became_active":"2024-09-12T17:10:44.523173+0000","last_became_peered":"2024-09-12T17:10:44.523173+0000","last_unstale":"2024-09-12T18:12:00.729788+0000","last_undegraded":"2024-09-12T18:12:00.729788+0000","last_fullsized":"2024-09-12T18:12:00.729788+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'388","last_scrub_stamp":"2024-09-12T18:12:00.729701+0000","last_deep_scrub":"263'388","last_deep_scrub_stamp":"2024-09-12T18:12:00.729701+0000","last_clean_scrub_stamp":"2024-09-12T18:12:00.729701+0000","objects_scrubbed":3,"log_size":88,"log_dups_size":300,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:17:09.750351+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2006,"num_read_kb":1913,"num_write":441,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":236,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"263'150","reported_seq":852,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:50.263634+0000","last_change":"2024-09-12T18:11:50.263634+0000","last_active":"2024-09-12T18:11:50.263634+0000","last_peered":"2024-09-12T18:11:50.263634+0000","last_clean":"2024-09-12T18:11:50.263634+0000","last_became_active":"2024-09-12T17:10:42.521824+0000","last_became_peered":"2024-09-12T17:10:42.521824+0000","last_unstale":"2024-09-12T18:11:50.263634+0000","last_undegraded":"2024-09-12T18:11:50.263634+0000","last_fullsized":"2024-09-12T18:11:50.263634+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'150","last_scrub_stamp":"2024-09-12T18:11:50.263511+0000","last_deep_scrub":"263'150","last_deep_scrub_stamp":"2024-09-12T18:11:50.263511+0000","last_clean_scrub_stamp":"2024-09-12T18:11:50.263511+0000","objects_scrubbed":4,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:14:36.257295+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":605,"num_read_kb":135941,"num_write":774,"num_write_kb":15017,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"263'498","reported_seq":2146,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:01.300891+0000","last_change":"2024-09-12T18:12:01.300891+0000","last_active":"2024-09-12T18:12:01.300891+0000","last_peered":"2024-09-12T18:12:01.300891+0000","last_clean":"2024-09-12T18:12:01.300891+0000","last_became_active":"2024-09-12T17:10:44.517175+0000","last_became_peered":"2024-09-12T17:10:44.517175+0000","last_unstale":"2024-09-12T18:12:01.300891+0000","last_undegraded":"2024-09-12T18:12:01.300891+0000","last_fullsized":"2024-09-12T18:12:01.300891+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'498","last_scrub_stamp":"2024-09-12T18:12:01.300799+0000","last_deep_scrub":"263'498","last_deep_scrub_stamp":"2024-09-12T18:12:01.300799+0000","last_clean_scrub_stamp":"2024-09-12T18:12:01.300799+0000","objects_scrubbed":1,"log_size":98,"log_dups_size":400,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:10:17.438378+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2646,"num_read_kb":2487,"num_write":582,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2551,"num_omap_keys":10,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"263'171","reported_seq":793,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:53.554829+0000","last_change":"2024-09-12T18:11:53.554829+0000","last_active":"2024-09-12T18:11:53.554829+0000","last_peered":"2024-09-12T18:11:53.554829+0000","last_clean":"2024-09-12T18:11:53.554829+0000","last_became_active":"2024-09-12T17:10:42.524860+0000","last_became_peered":"2024-09-12T17:10:42.524860+0000","last_unstale":"2024-09-12T18:11:53.554829+0000","last_undegraded":"2024-09-12T18:11:53.554829+0000","last_fullsized":"2024-09-12T18:11:53.554829+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'171","last_scrub_stamp":"2024-09-12T18:11:53.554696+0000","last_deep_scrub":"263'171","last_deep_scrub_stamp":"2024-09-12T18:11:53.554696+0000","last_clean_scrub_stamp":"2024-09-12T18:11:53.554696+0000","objects_scrubbed":3,"log_size":71,"log_dups_size":100,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:32:08.383982+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":409,"num_read_kb":436,"num_write":844,"num_write_kb":16042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,1],"acting":[3,4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"263'740","reported_seq":2322,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:53.804065+0000","last_change":"2024-09-12T18:11:53.804065+0000","last_active":"2024-09-12T18:11:53.804065+0000","last_peered":"2024-09-12T18:11:53.804065+0000","last_clean":"2024-09-12T18:11:53.804065+0000","last_became_active":"2024-09-12T17:10:44.514847+0000","last_became_peered":"2024-09-12T17:10:44.514847+0000","last_unstale":"2024-09-12T18:11:53.804065+0000","last_undegraded":"2024-09-12T18:11:53.804065+0000","last_fullsized":"2024-09-12T18:11:53.804065+0000","mapping_epoch":26,"log_start":"263'700","ondisk_log_start":"263'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'740","last_scrub_stamp":"2024-09-12T18:11:53.803969+0000","last_deep_scrub":"263'740","last_deep_scrub_stamp":"2024-09-12T18:11:53.803969+0000","last_clean_scrub_stamp":"2024-09-12T18:11:53.803969+0000","objects_scrubbed":2,"log_size":40,"log_dups_size":700,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:10:16.440746+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3592,"num_read_kb":3279,"num_write":969,"num_write_kb":334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":432,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"263'232","reported_seq":897,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:51.259031+0000","last_change":"2024-09-12T18:11:51.259031+0000","last_active":"2024-09-12T18:11:51.259031+0000","last_peered":"2024-09-12T18:11:51.259031+0000","last_clean":"2024-09-12T18:11:51.259031+0000","last_became_active":"2024-09-12T17:10:42.519789+0000","last_became_peered":"2024-09-12T17:10:42.519789+0000","last_unstale":"2024-09-12T18:11:51.259031+0000","last_undegraded":"2024-09-12T18:11:51.259031+0000","last_fullsized":"2024-09-12T18:11:51.259031+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'232","last_scrub_stamp":"2024-09-12T18:11:51.258820+0000","last_deep_scrub":"263'232","last_deep_scrub_stamp":"2024-09-12T18:11:51.258820+0000","last_clean_scrub_stamp":"2024-09-12T18:11:51.258820+0000","objects_scrubbed":6,"log_size":32,"log_dups_size":200,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:06:47.531898+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079985,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":565,"num_read_kb":21140,"num_write":1106,"num_write_kb":33501,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,3],"acting":[5,7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"263'453","reported_seq":1955,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:59.367729+0000","last_change":"2024-09-12T18:11:59.367729+0000","last_active":"2024-09-12T18:11:59.367729+0000","last_peered":"2024-09-12T18:11:59.367729+0000","last_clean":"2024-09-12T18:11:59.367729+0000","last_became_active":"2024-09-12T17:10:44.510280+0000","last_became_peered":"2024-09-12T17:10:44.510280+0000","last_unstale":"2024-09-12T18:11:59.367729+0000","last_undegraded":"2024-09-12T18:11:59.367729+0000","last_fullsized":"2024-09-12T18:11:59.367729+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'453","last_scrub_stamp":"2024-09-12T18:11:59.367623+0000","last_deep_scrub":"263'453","last_deep_scrub_stamp":"2024-09-12T18:11:59.367623+0000","last_clean_scrub_stamp":"2024-09-12T18:11:59.367623+0000","objects_scrubbed":2,"log_size":53,"log_dups_size":400,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:42:33.011282+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2351,"num_read_kb":2195,"num_write":554,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"263'151","reported_seq":757,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:51.719192+0000","last_change":"2024-09-12T18:11:51.719192+0000","last_active":"2024-09-12T18:11:51.719192+0000","last_peered":"2024-09-12T18:11:51.719192+0000","last_clean":"2024-09-12T18:11:51.719192+0000","last_became_active":"2024-09-12T17:10:42.520020+0000","last_became_peered":"2024-09-12T17:10:42.520020+0000","last_unstale":"2024-09-12T18:11:51.719192+0000","last_undegraded":"2024-09-12T18:11:51.719192+0000","last_fullsized":"2024-09-12T18:11:51.719192+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'151","last_scrub_stamp":"2024-09-12T18:11:51.719074+0000","last_deep_scrub":"263'151","last_deep_scrub_stamp":"2024-09-12T18:11:51.719074+0000","last_clean_scrub_stamp":"2024-09-12T18:11:51.719074+0000","objects_scrubbed":5,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:00:04.688300+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399173,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":329,"num_read_kb":1191,"num_write":748,"num_write_kb":23442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,6],"acting":[0,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"263'360","reported_seq":1781,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:02.582515+0000","last_change":"2024-09-12T18:12:02.582515+0000","last_active":"2024-09-12T18:12:02.582515+0000","last_peered":"2024-09-12T18:12:02.582515+0000","last_clean":"2024-09-12T18:12:02.582515+0000","last_became_active":"2024-09-12T17:10:44.516697+0000","last_became_peered":"2024-09-12T17:10:44.516697+0000","last_unstale":"2024-09-12T18:12:02.582515+0000","last_undegraded":"2024-09-12T18:12:02.582515+0000","last_fullsized":"2024-09-12T18:12:02.582515+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'360","last_scrub_stamp":"2024-09-12T18:12:02.582325+0000","last_deep_scrub":"263'360","last_deep_scrub_stamp":"2024-09-12T18:12:02.582325+0000","last_clean_scrub_stamp":"2024-09-12T18:12:02.582325+0000","objects_scrubbed":3,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:42:49.327952+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1919,"num_read_kb":1833,"num_write":391,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"263'209","reported_seq":878,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:50.859980+0000","last_change":"2024-09-12T18:11:50.859917+0000","last_active":"2024-09-12T18:11:50.859980+0000","last_peered":"2024-09-12T18:11:50.859980+0000","last_clean":"2024-09-12T18:11:50.859980+0000","last_became_active":"2024-09-12T17:11:16.862645+0000","last_became_peered":"2024-09-12T17:11:16.862645+0000","last_unstale":"2024-09-12T18:11:50.859980+0000","last_undegraded":"2024-09-12T18:11:50.859980+0000","last_fullsized":"2024-09-12T18:11:50.859980+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'209","last_scrub_stamp":"2024-09-12T18:11:50.859772+0000","last_deep_scrub":"263'209","last_deep_scrub_stamp":"2024-09-12T18:11:50.859772+0000","last_clean_scrub_stamp":"2024-09-12T18:11:50.859772+0000","objects_scrubbed":5,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:34:01.980997+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38716,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":577,"num_read_kb":84325,"num_write":975,"num_write_kb":27874,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,0,7],"acting":[2,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"263'820","reported_seq":2292,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:59.723232+0000","last_change":"2024-09-12T18:11:59.723232+0000","last_active":"2024-09-12T18:11:59.723232+0000","last_peered":"2024-09-12T18:11:59.723232+0000","last_clean":"2024-09-12T18:11:59.723232+0000","last_became_active":"2024-09-12T17:10:44.519253+0000","last_became_peered":"2024-09-12T17:10:44.519253+0000","last_unstale":"2024-09-12T18:11:59.723232+0000","last_undegraded":"2024-09-12T18:11:59.723232+0000","last_fullsized":"2024-09-12T18:11:59.723232+0000","mapping_epoch":26,"log_start":"263'800","ondisk_log_start":"263'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'820","last_scrub_stamp":"2024-09-12T18:11:59.723131+0000","last_deep_scrub":"263'820","last_deep_scrub_stamp":"2024-09-12T18:11:59.723131+0000","last_clean_scrub_stamp":"2024-09-12T18:11:59.723131+0000","objects_scrubbed":2,"log_size":20,"log_dups_size":800,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:31:46.831616+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3866,"num_read_kb":3440,"num_write":1124,"num_write_kb":450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"263'183","reported_seq":799,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:54.498363+0000","last_change":"2024-09-12T18:11:54.498363+0000","last_active":"2024-09-12T18:11:54.498363+0000","last_peered":"2024-09-12T18:11:54.498363+0000","last_clean":"2024-09-12T18:11:54.498363+0000","last_became_active":"2024-09-12T17:10:42.524098+0000","last_became_peered":"2024-09-12T17:10:42.524098+0000","last_unstale":"2024-09-12T18:11:54.498363+0000","last_undegraded":"2024-09-12T18:11:54.498363+0000","last_fullsized":"2024-09-12T18:11:54.498363+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'183","last_scrub_stamp":"2024-09-12T18:11:54.498278+0000","last_deep_scrub":"263'183","last_deep_scrub_stamp":"2024-09-12T18:11:54.498278+0000","last_clean_scrub_stamp":"2024-09-12T18:11:54.498278+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:41:02.476962+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":371,"num_read_kb":5543,"num_write":831,"num_write_kb":19602,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6,3],"acting":[7,2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"263'418","reported_seq":2013,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:06.626096+0000","last_change":"2024-09-12T18:12:06.626096+0000","last_active":"2024-09-12T18:12:06.626096+0000","last_peered":"2024-09-12T18:12:06.626096+0000","last_clean":"2024-09-12T18:12:06.626096+0000","last_became_active":"2024-09-12T17:10:44.514154+0000","last_became_peered":"2024-09-12T17:10:44.514154+0000","last_unstale":"2024-09-12T18:12:06.626096+0000","last_undegraded":"2024-09-12T18:12:06.626096+0000","last_fullsized":"2024-09-12T18:12:06.626096+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'418","last_scrub_stamp":"2024-09-12T18:12:06.625996+0000","last_deep_scrub":"263'418","last_deep_scrub_stamp":"2024-09-12T18:12:06.625996+0000","last_clean_scrub_stamp":"2024-09-12T18:12:06.625996+0000","objects_scrubbed":2,"log_size":18,"log_dups_size":400,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:51:07.252603+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2340,"num_read_kb":2233,"num_write":478,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":217,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"263'226","reported_seq":853,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:51.851968+0000","last_change":"2024-09-12T18:11:51.851968+0000","last_active":"2024-09-12T18:11:51.851968+0000","last_peered":"2024-09-12T18:11:51.851968+0000","last_clean":"2024-09-12T18:11:51.851968+0000","last_became_active":"2024-09-12T17:10:42.519316+0000","last_became_peered":"2024-09-12T17:10:42.519316+0000","last_unstale":"2024-09-12T18:11:51.851968+0000","last_undegraded":"2024-09-12T18:11:51.851968+0000","last_fullsized":"2024-09-12T18:11:51.851968+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'226","last_scrub_stamp":"2024-09-12T18:11:51.851860+0000","last_deep_scrub":"263'226","last_deep_scrub_stamp":"2024-09-12T18:11:51.851860+0000","last_clean_scrub_stamp":"2024-09-12T18:11:51.851860+0000","objects_scrubbed":3,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:35:21.884135+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470224,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":508,"num_read_kb":7212,"num_write":965,"num_write_kb":24573,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1,7],"acting":[2,6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"263'437","reported_seq":2045,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:01.592262+0000","last_change":"2024-09-12T18:12:01.592262+0000","last_active":"2024-09-12T18:12:01.592262+0000","last_peered":"2024-09-12T18:12:01.592262+0000","last_clean":"2024-09-12T18:12:01.592262+0000","last_became_active":"2024-09-12T17:10:44.513514+0000","last_became_peered":"2024-09-12T17:10:44.513514+0000","last_unstale":"2024-09-12T18:12:01.592262+0000","last_undegraded":"2024-09-12T18:12:01.592262+0000","last_fullsized":"2024-09-12T18:12:01.592262+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'437","last_scrub_stamp":"2024-09-12T18:12:01.592155+0000","last_deep_scrub":"263'437","last_deep_scrub_stamp":"2024-09-12T18:12:01.592155+0000","last_clean_scrub_stamp":"2024-09-12T18:12:01.592155+0000","objects_scrubbed":3,"log_size":37,"log_dups_size":400,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:14:07.719792+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2337,"num_read_kb":2234,"num_write":490,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"263'146","reported_seq":770,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:00.383167+0000","last_change":"2024-09-12T18:12:00.383167+0000","last_active":"2024-09-12T18:12:00.383167+0000","last_peered":"2024-09-12T18:12:00.383167+0000","last_clean":"2024-09-12T18:12:00.383167+0000","last_became_active":"2024-09-12T17:10:42.527050+0000","last_became_peered":"2024-09-12T17:10:42.527050+0000","last_unstale":"2024-09-12T18:12:00.383167+0000","last_undegraded":"2024-09-12T18:12:00.383167+0000","last_fullsized":"2024-09-12T18:12:00.383167+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'146","last_scrub_stamp":"2024-09-12T18:12:00.383024+0000","last_deep_scrub":"263'146","last_deep_scrub_stamp":"2024-09-12T18:12:00.383024+0000","last_clean_scrub_stamp":"2024-09-12T18:12:00.383024+0000","objects_scrubbed":4,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:22:31.915728+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079896,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":321,"num_read_kb":34406,"num_write":732,"num_write_kb":29438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4,6],"acting":[5,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"263'196","reported_seq":841,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:54.283254+0000","last_change":"2024-09-12T18:11:54.283254+0000","last_active":"2024-09-12T18:11:54.283254+0000","last_peered":"2024-09-12T18:11:54.283254+0000","last_clean":"2024-09-12T18:11:54.283254+0000","last_became_active":"2024-09-12T17:10:42.523311+0000","last_became_peered":"2024-09-12T17:10:42.523311+0000","last_unstale":"2024-09-12T18:11:54.283254+0000","last_undegraded":"2024-09-12T18:11:54.283254+0000","last_fullsized":"2024-09-12T18:11:54.283254+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'196","last_scrub_stamp":"2024-09-12T18:11:54.283131+0000","last_deep_scrub":"263'196","last_deep_scrub_stamp":"2024-09-12T18:11:54.283131+0000","last_clean_scrub_stamp":"2024-09-12T18:11:54.283131+0000","objects_scrubbed":2,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:27:10.864086+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":468,"num_read_kb":32297,"num_write":957,"num_write_kb":18657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,7],"acting":[5,1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"263'823","reported_seq":2274,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:02.655360+0000","last_change":"2024-09-12T18:12:02.655360+0000","last_active":"2024-09-12T18:12:02.655360+0000","last_peered":"2024-09-12T18:12:02.655360+0000","last_clean":"2024-09-12T18:12:02.655360+0000","last_became_active":"2024-09-12T17:10:44.523243+0000","last_became_peered":"2024-09-12T17:10:44.523243+0000","last_unstale":"2024-09-12T18:12:02.655360+0000","last_undegraded":"2024-09-12T18:12:02.655360+0000","last_fullsized":"2024-09-12T18:12:02.655360+0000","mapping_epoch":26,"log_start":"263'800","ondisk_log_start":"263'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'823","last_scrub_stamp":"2024-09-12T18:12:02.655272+0000","last_deep_scrub":"263'823","last_deep_scrub_stamp":"2024-09-12T18:12:02.655272+0000","last_clean_scrub_stamp":"2024-09-12T18:12:02.655272+0000","objects_scrubbed":2,"log_size":23,"log_dups_size":800,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:46:36.986649+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3977,"num_read_kb":3544,"num_write":1118,"num_write_kb":432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":220,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"263'239","reported_seq":892,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:52.620009+0000","last_change":"2024-09-12T18:11:52.620009+0000","last_active":"2024-09-12T18:11:52.620009+0000","last_peered":"2024-09-12T18:11:52.620009+0000","last_clean":"2024-09-12T18:11:52.620009+0000","last_became_active":"2024-09-12T17:10:42.519643+0000","last_became_peered":"2024-09-12T17:10:42.519643+0000","last_unstale":"2024-09-12T18:11:52.620009+0000","last_undegraded":"2024-09-12T18:11:52.620009+0000","last_fullsized":"2024-09-12T18:11:52.620009+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'239","last_scrub_stamp":"2024-09-12T18:11:52.619898+0000","last_deep_scrub":"263'239","last_deep_scrub_stamp":"2024-09-12T18:11:52.619898+0000","last_clean_scrub_stamp":"2024-09-12T18:11:52.619898+0000","objects_scrubbed":3,"log_size":39,"log_dups_size":200,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:17:44.502362+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079919,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":418,"num_read_kb":42701,"num_write":983,"num_write_kb":42419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5,0],"acting":[1,4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"263'617","reported_seq":2316,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:04.482840+0000","last_change":"2024-09-12T18:12:04.482840+0000","last_active":"2024-09-12T18:12:04.482840+0000","last_peered":"2024-09-12T18:12:04.482840+0000","last_clean":"2024-09-12T18:12:04.482840+0000","last_became_active":"2024-09-12T17:10:44.512488+0000","last_became_peered":"2024-09-12T17:10:44.512488+0000","last_unstale":"2024-09-12T18:12:04.482840+0000","last_undegraded":"2024-09-12T18:12:04.482840+0000","last_fullsized":"2024-09-12T18:12:04.482840+0000","mapping_epoch":26,"log_start":"263'600","ondisk_log_start":"263'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'617","last_scrub_stamp":"2024-09-12T18:12:04.482707+0000","last_deep_scrub":"263'617","last_deep_scrub_stamp":"2024-09-12T18:12:04.482707+0000","last_clean_scrub_stamp":"2024-09-12T18:12:04.482707+0000","objects_scrubbed":5,"log_size":17,"log_dups_size":600,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:05:09.251938+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3240,"num_read_kb":2966,"num_write":800,"num_write_kb":244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2039,"num_omap_keys":8,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6085,"num_read_kb":4263,"num_write":1964,"num_write_kb":863,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6762,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1037,"ondisk_log_size":1037,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15869,"num_objects":86,"num_object_clones":0,"num_object_copies":172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":86,"num_whiteouts":0,"num_read":16199,"num_read_kb":15883,"num_write":16708,"num_write_kb":4876,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2797,"num_omap_keys":17,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":31738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1738,"ondisk_log_size":1738,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":575,"ondisk_log_size":575,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":271969,"num_objects":199,"num_object_clones":0,"num_object_copies":398,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":199,"num_whiteouts":0,"num_read":8822,"num_read_kb":10790,"num_write":6053,"num_write_kb":2795,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":676642,"num_omap_keys":1572,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1836,"ondisk_log_size":1836,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2393,"num_read_kb":2857,"num_write":20,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":165,"num_object_clones":0,"num_object_copies":330,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":165,"num_whiteouts":0,"num_read":212965,"num_read_kb":194286,"num_write":55441,"num_write_kb":18926,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":165,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":43286,"num_omap_keys":176,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3862,"ondisk_log_size":3862,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":752,"num_omap_keys":8,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10,"ondisk_log_size":10,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":74416905,"num_objects":230,"num_object_clones":0,"num_object_copies":920,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":230,"num_whiteouts":0,"num_read":33088,"num_read_kb":2020320,"num_write":62843,"num_write_kb":2063190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":101629952,"data_stored":101629952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3869,"ondisk_log_size":3869,"up":256,"acting":256,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":141,"num_read_kb":196715,"num_write":158,"num_write_kb":127071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":137,"num_read_kb":189543,"num_write":158,"num_write_kb":127071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575602,"num_pgs":116,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":261372,"kb_used_data":17772,"kb_used_omap":1,"kb_used_meta":243582,"kb_avail":94110468,"statfs":{"total":96636764160,"available":96369119232,"internally_reserved":0,"allocated":18198528,"data_stored":16210424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":249428427},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575600,"num_pgs":107,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":273160,"kb_used_data":17080,"kb_used_omap":1,"kb_used_meta":256062,"kb_avail":94098680,"statfs":{"total":96636764160,"available":96357048320,"internally_reserved":0,"allocated":17489920,"data_stored":15541198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":262207942},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575605,"num_pgs":113,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":124372,"kb_used_data":12676,"kb_used_omap":1,"kb_used_meta":111678,"kb_avail":94247468,"statfs":{"total":96636764160,"available":96509407232,"internally_reserved":0,"allocated":12980224,"data_stored":10947706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":114358725},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575600,"num_pgs":113,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":133164,"kb_used_data":21468,"kb_used_omap":1,"kb_used_meta":111678,"kb_avail":94238676,"statfs":{"total":96636764160,"available":96500404224,"internally_reserved":0,"allocated":21983232,"data_stored":20058842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":114358725},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575602,"num_pgs":130,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":244300,"kb_used_data":18748,"kb_used_omap":1,"kb_used_meta":225534,"kb_avail":94127540,"statfs":{"total":96636764160,"available":96386600960,"internally_reserved":0,"allocated":19197952,"data_stored":17229442,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":230947271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575602,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":107112,"kb_used_data":13464,"kb_used_omap":1,"kb_used_meta":93630,"kb_avail":94264728,"statfs":{"total":96636764160,"available":96527081472,"internally_reserved":0,"allocated":13787136,"data_stored":11862866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":95877573},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575600,"num_pgs":120,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":151364,"kb_used_data":16116,"kb_used_omap":1,"kb_used_meta":135230,"kb_avail":94220476,"statfs":{"total":96636764160,"available":96481767424,"internally_reserved":0,"allocated":16502784,"data_stored":14528294,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":138475973},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575601,"num_pgs":116,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":254156,"kb_used_data":16124,"kb_used_omap":1,"kb_used_meta":238014,"kb_avail":94117684,"statfs":{"total":96636764160,"available":96376508416,"internally_reserved":0,"allocated":16510976,"data_stored":14534914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":243726789},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":11681792,"data_stored":11681792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12263424,"data_stored":12263424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":9601024,"data_stored":9601024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":14966784,"data_stored":14966784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":17797120,"data_stored":17797120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8683520,"data_stored":8683520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":13279232,"data_stored":13279232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":13357056,"data_stored":13357056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":4345,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":5119,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":3919,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":4996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3623,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":3527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T18:12:49.523 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-09-12T17:46:56.058809+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:49.523 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-09-12T17:46:56.058809+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:49.524 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-09-12T17:46:56.058809+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:49.524 INFO:tasks.ceph:pgid 68.17 last_scrub_stamp 2024-09-12T17:46:56.058809+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:49.524 INFO:tasks.ceph:pgid 68.14 last_scrub_stamp 2024-09-12T17:46:56.058809+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:49.525 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-09-12T17:46:56.058809+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:49.525 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-09-12T17:46:56.058809+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=46, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=11, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:12:49.528 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T18:13:09.529 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T18:13:09.883 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-12T18:13:09.894 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-09-12T18:13:09.897 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":2138,"stamp":"2024-09-12T18:13:08.647916+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":75296923,"num_objects":706,"num_object_clones":0,"num_object_copies":1872,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":706,"num_whiteouts":0,"num_read":279908,"num_read_kb":2634724,"num_write":143466,"num_write_kb":2346447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":212,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":730615,"num_omap_keys":1791,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13221,"ondisk_log_size":13221,"up":914,"acting":914,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":914,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1549000,"kb_used_data":133448,"kb_used_omap":12,"kb_used_meta":1415411,"kb_avail":753425720,"statfs":{"total":773094113280,"available":771507937280,"internally_reserved":0,"allocated":136650752,"data_stored":120913686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":1449381425},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005810"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":31,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:33.396504+0000","last_change":"2024-09-12T18:12:33.396504+0000","last_active":"2024-09-12T18:12:33.396504+0000","last_peered":"2024-09-12T18:12:33.396504+0000","last_clean":"2024-09-12T18:12:33.396504+0000","last_became_active":"2024-09-12T17:46:57.082400+0000","last_became_peered":"2024-09-12T17:46:57.082400+0000","last_unstale":"2024-09-12T18:12:33.396504+0000","last_undegraded":"2024-09-12T18:12:33.396504+0000","last_fullsized":"2024-09-12T18:12:33.396504+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:33.396413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:33.396413+0000","last_clean_scrub_stamp":"2024-09-12T18:12:33.396413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:47:57.073719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"0'0","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:31.350440+0000","last_change":"2024-09-12T18:12:31.350332+0000","last_active":"2024-09-12T18:12:31.350440+0000","last_peered":"2024-09-12T18:12:31.350440+0000","last_clean":"2024-09-12T18:12:31.350440+0000","last_became_active":"2024-09-12T17:30:16.683077+0000","last_became_peered":"2024-09-12T17:30:16.683077+0000","last_unstale":"2024-09-12T18:12:31.350440+0000","last_undegraded":"2024-09-12T18:12:31.350440+0000","last_fullsized":"2024-09-12T18:12:31.350440+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:31.350235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:31.350235+0000","last_clean_scrub_stamp":"2024-09-12T18:12:31.350235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:59:20.856550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"260'3","reported_seq":60,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:36.684373+0000","last_change":"2024-09-12T18:12:36.684310+0000","last_active":"2024-09-12T18:12:36.684373+0000","last_peered":"2024-09-12T18:12:36.684373+0000","last_clean":"2024-09-12T18:12:36.684373+0000","last_became_active":"2024-09-12T17:30:12.651461+0000","last_became_peered":"2024-09-12T17:30:12.651461+0000","last_unstale":"2024-09-12T18:12:36.684373+0000","last_undegraded":"2024-09-12T18:12:36.684373+0000","last_fullsized":"2024-09-12T18:12:36.684373+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'3","last_scrub_stamp":"2024-09-12T18:12:36.684216+0000","last_deep_scrub":"260'3","last_deep_scrub_stamp":"2024-09-12T18:12:36.684216+0000","last_clean_scrub_stamp":"2024-09-12T18:12:36.684216+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:00:05.576052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"263'28","reported_seq":143,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:30.682278+0000","last_change":"2024-09-12T18:12:30.682278+0000","last_active":"2024-09-12T18:12:30.682278+0000","last_peered":"2024-09-12T18:12:30.682278+0000","last_clean":"2024-09-12T18:12:30.682278+0000","last_became_active":"2024-09-12T17:26:35.669154+0000","last_became_peered":"2024-09-12T17:26:35.669154+0000","last_unstale":"2024-09-12T18:12:30.682278+0000","last_undegraded":"2024-09-12T18:12:30.682278+0000","last_fullsized":"2024-09-12T18:12:30.682278+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'28","last_scrub_stamp":"2024-09-12T18:12:30.682196+0000","last_deep_scrub":"263'28","last_deep_scrub_stamp":"2024-09-12T18:12:30.682196+0000","last_clean_scrub_stamp":"2024-09-12T18:12:30.682196+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:03:35.934621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":150,"num_read_kb":108,"num_write":46,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":31,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:16.733731+0000","last_change":"2024-09-12T18:12:16.733731+0000","last_active":"2024-09-12T18:12:16.733731+0000","last_peered":"2024-09-12T18:12:16.733731+0000","last_clean":"2024-09-12T18:12:16.733731+0000","last_became_active":"2024-09-12T17:46:57.096462+0000","last_became_peered":"2024-09-12T17:46:57.096462+0000","last_unstale":"2024-09-12T18:12:16.733731+0000","last_undegraded":"2024-09-12T18:12:16.733731+0000","last_fullsized":"2024-09-12T18:12:16.733731+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:16.733634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:16.733634+0000","last_clean_scrub_stamp":"2024-09-12T18:12:16.733634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:55.337675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"263'9","reported_seq":71,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:32.312808+0000","last_change":"2024-09-12T18:12:32.312743+0000","last_active":"2024-09-12T18:12:32.312808+0000","last_peered":"2024-09-12T18:12:32.312808+0000","last_clean":"2024-09-12T18:12:32.312808+0000","last_became_active":"2024-09-12T17:30:16.674952+0000","last_became_peered":"2024-09-12T17:30:16.674952+0000","last_unstale":"2024-09-12T18:12:32.312808+0000","last_undegraded":"2024-09-12T18:12:32.312808+0000","last_fullsized":"2024-09-12T18:12:32.312808+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'9","last_scrub_stamp":"2024-09-12T18:12:32.312652+0000","last_deep_scrub":"263'9","last_deep_scrub_stamp":"2024-09-12T18:12:32.312652+0000","last_clean_scrub_stamp":"2024-09-12T18:12:32.312652+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:52:07.518326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":30722,"num_write":9,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"263'3","reported_seq":61,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:19.465952+0000","last_change":"2024-09-12T18:12:19.465891+0000","last_active":"2024-09-12T18:12:19.465952+0000","last_peered":"2024-09-12T18:12:19.465952+0000","last_clean":"2024-09-12T18:12:19.465952+0000","last_became_active":"2024-09-12T17:30:12.645624+0000","last_became_peered":"2024-09-12T17:30:12.645624+0000","last_unstale":"2024-09-12T18:12:19.465952+0000","last_undegraded":"2024-09-12T18:12:19.465952+0000","last_fullsized":"2024-09-12T18:12:19.465952+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'3","last_scrub_stamp":"2024-09-12T18:12:19.465801+0000","last_deep_scrub":"263'3","last_deep_scrub_stamp":"2024-09-12T18:12:19.465801+0000","last_clean_scrub_stamp":"2024-09-12T18:12:19.465801+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:57:25.728318+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"263'13","reported_seq":97,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:07.786167+0000","last_change":"2024-09-12T18:12:07.786114+0000","last_active":"2024-09-12T18:12:07.786167+0000","last_peered":"2024-09-12T18:12:07.786167+0000","last_clean":"2024-09-12T18:12:07.786167+0000","last_became_active":"2024-09-12T17:26:35.660132+0000","last_became_peered":"2024-09-12T17:26:35.660132+0000","last_unstale":"2024-09-12T18:12:07.786167+0000","last_undegraded":"2024-09-12T18:12:07.786167+0000","last_fullsized":"2024-09-12T18:12:07.786167+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'13","last_scrub_stamp":"2024-09-12T18:12:07.786029+0000","last_deep_scrub":"263'13","last_deep_scrub_stamp":"2024-09-12T18:12:07.786029+0000","last_clean_scrub_stamp":"2024-09-12T18:12:07.786029+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:31:53.611285+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":36,"num_write":29,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":31,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:23.597314+0000","last_change":"2024-09-12T18:12:23.597314+0000","last_active":"2024-09-12T18:12:23.597314+0000","last_peered":"2024-09-12T18:12:23.597314+0000","last_clean":"2024-09-12T18:12:23.597314+0000","last_became_active":"2024-09-12T17:46:57.076193+0000","last_became_peered":"2024-09-12T17:46:57.076193+0000","last_unstale":"2024-09-12T18:12:23.597314+0000","last_undegraded":"2024-09-12T18:12:23.597314+0000","last_fullsized":"2024-09-12T18:12:23.597314+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:23.597226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:23.597226+0000","last_clean_scrub_stamp":"2024-09-12T18:12:23.597226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:37:52.469297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"260'3","reported_seq":57,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:39.849040+0000","last_change":"2024-09-12T18:12:39.849040+0000","last_active":"2024-09-12T18:12:39.849040+0000","last_peered":"2024-09-12T18:12:39.849040+0000","last_clean":"2024-09-12T18:12:39.849040+0000","last_became_active":"2024-09-12T17:30:16.670862+0000","last_became_peered":"2024-09-12T17:30:16.670862+0000","last_unstale":"2024-09-12T18:12:39.849040+0000","last_undegraded":"2024-09-12T18:12:39.849040+0000","last_fullsized":"2024-09-12T18:12:39.849040+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'3","last_scrub_stamp":"2024-09-12T18:12:39.848950+0000","last_deep_scrub":"260'3","last_deep_scrub_stamp":"2024-09-12T18:12:39.848950+0000","last_clean_scrub_stamp":"2024-09-12T18:12:39.848950+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:04:45.100130+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"263'5","reported_seq":70,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:12.711425+0000","last_change":"2024-09-12T18:12:12.711357+0000","last_active":"2024-09-12T18:12:12.711425+0000","last_peered":"2024-09-12T18:12:12.711425+0000","last_clean":"2024-09-12T18:12:12.711425+0000","last_became_active":"2024-09-12T17:30:12.648349+0000","last_became_peered":"2024-09-12T17:30:12.648349+0000","last_unstale":"2024-09-12T18:12:12.711425+0000","last_undegraded":"2024-09-12T18:12:12.711425+0000","last_fullsized":"2024-09-12T18:12:12.711425+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'5","last_scrub_stamp":"2024-09-12T18:12:12.711275+0000","last_deep_scrub":"263'5","last_deep_scrub_stamp":"2024-09-12T18:12:12.711275+0000","last_clean_scrub_stamp":"2024-09-12T18:12:12.711275+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:53:45.650869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":18432,"num_write":10,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"263'118","reported_seq":431,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:29.723514+0000","last_change":"2024-09-12T18:12:29.723514+0000","last_active":"2024-09-12T18:12:29.723514+0000","last_peered":"2024-09-12T18:12:29.723514+0000","last_clean":"2024-09-12T18:12:29.723514+0000","last_became_active":"2024-09-12T17:26:35.664247+0000","last_became_peered":"2024-09-12T17:26:35.664247+0000","last_unstale":"2024-09-12T18:12:29.723514+0000","last_undegraded":"2024-09-12T18:12:29.723514+0000","last_fullsized":"2024-09-12T18:12:29.723514+0000","mapping_epoch":250,"log_start":"263'100","ondisk_log_start":"263'100","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'118","last_scrub_stamp":"2024-09-12T18:12:29.723421+0000","last_deep_scrub":"263'118","last_deep_scrub_stamp":"2024-09-12T18:12:29.723421+0000","last_clean_scrub_stamp":"2024-09-12T18:12:29.723421+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:06:59.267365+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":722,"num_read_kb":504,"num_write":158,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3262,"num_omap_keys":7,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":31,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:47.604130+0000","last_change":"2024-09-12T18:12:47.604130+0000","last_active":"2024-09-12T18:12:47.604130+0000","last_peered":"2024-09-12T18:12:47.604130+0000","last_clean":"2024-09-12T18:12:47.604130+0000","last_became_active":"2024-09-12T17:46:57.089385+0000","last_became_peered":"2024-09-12T17:46:57.089385+0000","last_unstale":"2024-09-12T18:12:47.604130+0000","last_undegraded":"2024-09-12T18:12:47.604130+0000","last_fullsized":"2024-09-12T18:12:47.604130+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:47.604022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:47.604022+0000","last_clean_scrub_stamp":"2024-09-12T18:12:47.604022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:20:33.074704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"263'14","reported_seq":80,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:44.647548+0000","last_change":"2024-09-12T18:12:44.647548+0000","last_active":"2024-09-12T18:12:44.647548+0000","last_peered":"2024-09-12T18:12:44.647548+0000","last_clean":"2024-09-12T18:12:44.647548+0000","last_became_active":"2024-09-12T17:30:16.681766+0000","last_became_peered":"2024-09-12T17:30:16.681766+0000","last_unstale":"2024-09-12T18:12:44.647548+0000","last_undegraded":"2024-09-12T18:12:44.647548+0000","last_fullsized":"2024-09-12T18:12:44.647548+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'14","last_scrub_stamp":"2024-09-12T18:12:44.647461+0000","last_deep_scrub":"263'14","last_deep_scrub_stamp":"2024-09-12T18:12:44.647461+0000","last_clean_scrub_stamp":"2024-09-12T18:12:44.647461+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:55:58.576253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":32770,"num_write":24,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"0'0","reported_seq":57,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:27.358127+0000","last_change":"2024-09-12T18:12:27.358127+0000","last_active":"2024-09-12T18:12:27.358127+0000","last_peered":"2024-09-12T18:12:27.358127+0000","last_clean":"2024-09-12T18:12:27.358127+0000","last_became_active":"2024-09-12T17:30:12.648369+0000","last_became_peered":"2024-09-12T17:30:12.648369+0000","last_unstale":"2024-09-12T18:12:27.358127+0000","last_undegraded":"2024-09-12T18:12:27.358127+0000","last_fullsized":"2024-09-12T18:12:27.358127+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:27.357978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:27.357978+0000","last_clean_scrub_stamp":"2024-09-12T18:12:27.357978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:04:22.390356+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"263'111","reported_seq":448,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:34.721432+0000","last_change":"2024-09-12T18:12:34.721432+0000","last_active":"2024-09-12T18:12:34.721432+0000","last_peered":"2024-09-12T18:12:34.721432+0000","last_clean":"2024-09-12T18:12:34.721432+0000","last_became_active":"2024-09-12T17:26:35.665735+0000","last_became_peered":"2024-09-12T17:26:35.665735+0000","last_unstale":"2024-09-12T18:12:34.721432+0000","last_undegraded":"2024-09-12T18:12:34.721432+0000","last_fullsized":"2024-09-12T18:12:34.721432+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'111","last_scrub_stamp":"2024-09-12T18:12:34.721340+0000","last_deep_scrub":"263'111","last_deep_scrub_stamp":"2024-09-12T18:12:34.721340+0000","last_clean_scrub_stamp":"2024-09-12T18:12:34.721340+0000","objects_scrubbed":1,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:47:38.687925+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":761,"num_read_kb":507,"num_write":140,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3500,"num_omap_keys":7,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":34,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:49.576701+0000","last_change":"2024-09-12T18:12:49.576603+0000","last_active":"2024-09-12T18:12:49.576701+0000","last_peered":"2024-09-12T18:12:49.576701+0000","last_clean":"2024-09-12T18:12:49.576701+0000","last_became_active":"2024-09-12T17:46:57.089797+0000","last_became_peered":"2024-09-12T17:46:57.089797+0000","last_unstale":"2024-09-12T18:12:49.576701+0000","last_undegraded":"2024-09-12T18:12:49.576701+0000","last_fullsized":"2024-09-12T18:12:49.576701+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:49.576516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:49.576516+0000","last_clean_scrub_stamp":"2024-09-12T18:12:49.576516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:52:37.213033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"263'5","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:30.376007+0000","last_change":"2024-09-12T18:12:30.376007+0000","last_active":"2024-09-12T18:12:30.376007+0000","last_peered":"2024-09-12T18:12:30.376007+0000","last_clean":"2024-09-12T18:12:30.376007+0000","last_became_active":"2024-09-12T17:30:16.685755+0000","last_became_peered":"2024-09-12T17:30:16.685755+0000","last_unstale":"2024-09-12T18:12:30.376007+0000","last_undegraded":"2024-09-12T18:12:30.376007+0000","last_fullsized":"2024-09-12T18:12:30.376007+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'5","last_scrub_stamp":"2024-09-12T18:12:30.375919+0000","last_deep_scrub":"263'5","last_deep_scrub_stamp":"2024-09-12T18:12:30.375919+0000","last_clean_scrub_stamp":"2024-09-12T18:12:30.375919+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:59:28.231926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":16,"num_write":10,"num_write_kb":5136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"0'0","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:35.790038+0000","last_change":"2024-09-12T18:12:35.790038+0000","last_active":"2024-09-12T18:12:35.790038+0000","last_peered":"2024-09-12T18:12:35.790038+0000","last_clean":"2024-09-12T18:12:35.790038+0000","last_became_active":"2024-09-12T17:30:12.640983+0000","last_became_peered":"2024-09-12T17:30:12.640983+0000","last_unstale":"2024-09-12T18:12:35.790038+0000","last_undegraded":"2024-09-12T18:12:35.790038+0000","last_fullsized":"2024-09-12T18:12:35.790038+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:35.789941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:35.789941+0000","last_clean_scrub_stamp":"2024-09-12T18:12:35.789941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:40:19.983097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"263'13","reported_seq":100,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:33.747457+0000","last_change":"2024-09-12T18:12:33.747457+0000","last_active":"2024-09-12T18:12:33.747457+0000","last_peered":"2024-09-12T18:12:33.747457+0000","last_clean":"2024-09-12T18:12:33.747457+0000","last_became_active":"2024-09-12T17:26:35.664517+0000","last_became_peered":"2024-09-12T17:26:35.664517+0000","last_unstale":"2024-09-12T18:12:33.747457+0000","last_undegraded":"2024-09-12T18:12:33.747457+0000","last_fullsized":"2024-09-12T18:12:33.747457+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'13","last_scrub_stamp":"2024-09-12T18:12:33.747367+0000","last_deep_scrub":"263'13","last_deep_scrub_stamp":"2024-09-12T18:12:33.747367+0000","last_clean_scrub_stamp":"2024-09-12T18:12:33.747367+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:50:16.447468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":54,"num_write":23,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":33,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:28.487165+0000","last_change":"2024-09-12T18:12:28.487165+0000","last_active":"2024-09-12T18:12:28.487165+0000","last_peered":"2024-09-12T18:12:28.487165+0000","last_clean":"2024-09-12T18:12:28.487165+0000","last_became_active":"2024-09-12T17:46:57.091147+0000","last_became_peered":"2024-09-12T17:46:57.091147+0000","last_unstale":"2024-09-12T18:12:28.487165+0000","last_undegraded":"2024-09-12T18:12:28.487165+0000","last_fullsized":"2024-09-12T18:12:28.487165+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:28.487075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:28.487075+0000","last_clean_scrub_stamp":"2024-09-12T18:12:28.487075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:58:14.311885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"260'5","reported_seq":59,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:20.578358+0000","last_change":"2024-09-12T18:12:20.578358+0000","last_active":"2024-09-12T18:12:20.578358+0000","last_peered":"2024-09-12T18:12:20.578358+0000","last_clean":"2024-09-12T18:12:20.578358+0000","last_became_active":"2024-09-12T17:30:16.684200+0000","last_became_peered":"2024-09-12T17:30:16.684200+0000","last_unstale":"2024-09-12T18:12:20.578358+0000","last_undegraded":"2024-09-12T18:12:20.578358+0000","last_fullsized":"2024-09-12T18:12:20.578358+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'5","last_scrub_stamp":"2024-09-12T18:12:20.578267+0000","last_deep_scrub":"260'5","last_deep_scrub_stamp":"2024-09-12T18:12:20.578267+0000","last_clean_scrub_stamp":"2024-09-12T18:12:20.578267+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:25:55.109570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"263'2","reported_seq":57,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:26.378959+0000","last_change":"2024-09-12T18:12:26.378959+0000","last_active":"2024-09-12T18:12:26.378959+0000","last_peered":"2024-09-12T18:12:26.378959+0000","last_clean":"2024-09-12T18:12:26.378959+0000","last_became_active":"2024-09-12T17:30:12.639953+0000","last_became_peered":"2024-09-12T17:30:12.639953+0000","last_unstale":"2024-09-12T18:12:26.378959+0000","last_undegraded":"2024-09-12T18:12:26.378959+0000","last_fullsized":"2024-09-12T18:12:26.378959+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T18:12:26.378865+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T18:12:26.378865+0000","last_clean_scrub_stamp":"2024-09-12T18:12:26.378865+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:24:59.856238+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"263'28","reported_seq":133,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:15.595792+0000","last_change":"2024-09-12T18:12:15.595792+0000","last_active":"2024-09-12T18:12:15.595792+0000","last_peered":"2024-09-12T18:12:15.595792+0000","last_clean":"2024-09-12T18:12:15.595792+0000","last_became_active":"2024-09-12T17:26:35.663339+0000","last_became_peered":"2024-09-12T17:26:35.663339+0000","last_unstale":"2024-09-12T18:12:15.595792+0000","last_undegraded":"2024-09-12T18:12:15.595792+0000","last_fullsized":"2024-09-12T18:12:15.595792+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'28","last_scrub_stamp":"2024-09-12T18:12:15.595694+0000","last_deep_scrub":"263'28","last_deep_scrub_stamp":"2024-09-12T18:12:15.595694+0000","last_clean_scrub_stamp":"2024-09-12T18:12:15.595694+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:07:07.625379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":134,"num_read_kb":91,"num_write":60,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"263'2","reported_seq":33,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:42.489853+0000","last_change":"2024-09-12T18:12:42.489853+0000","last_active":"2024-09-12T18:12:42.489853+0000","last_peered":"2024-09-12T18:12:42.489853+0000","last_clean":"2024-09-12T18:12:42.489853+0000","last_became_active":"2024-09-12T17:46:57.088039+0000","last_became_peered":"2024-09-12T17:46:57.088039+0000","last_unstale":"2024-09-12T18:12:42.489853+0000","last_undegraded":"2024-09-12T18:12:42.489853+0000","last_fullsized":"2024-09-12T18:12:42.489853+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T18:12:42.489719+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T18:12:42.489719+0000","last_clean_scrub_stamp":"2024-09-12T18:12:42.489719+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:52:10.651915+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"263'9","reported_seq":65,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:21.621864+0000","last_change":"2024-09-12T18:12:21.621741+0000","last_active":"2024-09-12T18:12:21.621864+0000","last_peered":"2024-09-12T18:12:21.621864+0000","last_clean":"2024-09-12T18:12:21.621864+0000","last_became_active":"2024-09-12T17:30:16.672167+0000","last_became_peered":"2024-09-12T17:30:16.672167+0000","last_unstale":"2024-09-12T18:12:21.621864+0000","last_undegraded":"2024-09-12T18:12:21.621864+0000","last_fullsized":"2024-09-12T18:12:21.621864+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'9","last_scrub_stamp":"2024-09-12T18:12:21.621640+0000","last_deep_scrub":"263'9","last_deep_scrub_stamp":"2024-09-12T18:12:21.621640+0000","last_clean_scrub_stamp":"2024-09-12T18:12:21.621640+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:29:04.525875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":17408,"num_write":19,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"260'5","reported_seq":65,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:28.377547+0000","last_change":"2024-09-12T18:12:28.377484+0000","last_active":"2024-09-12T18:12:28.377547+0000","last_peered":"2024-09-12T18:12:28.377547+0000","last_clean":"2024-09-12T18:12:28.377547+0000","last_became_active":"2024-09-12T17:30:12.644125+0000","last_became_peered":"2024-09-12T17:30:12.644125+0000","last_unstale":"2024-09-12T18:12:28.377547+0000","last_undegraded":"2024-09-12T18:12:28.377547+0000","last_fullsized":"2024-09-12T18:12:28.377547+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'5","last_scrub_stamp":"2024-09-12T18:12:28.377393+0000","last_deep_scrub":"260'5","last_deep_scrub_stamp":"2024-09-12T18:12:28.377393+0000","last_clean_scrub_stamp":"2024-09-12T18:12:28.377393+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:54:05.770360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"263'38","reported_seq":167,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:28.743899+0000","last_change":"2024-09-12T18:12:28.743793+0000","last_active":"2024-09-12T18:12:28.743899+0000","last_peered":"2024-09-12T18:12:28.743899+0000","last_clean":"2024-09-12T18:12:28.743899+0000","last_became_active":"2024-09-12T17:26:35.659261+0000","last_became_peered":"2024-09-12T17:26:35.659261+0000","last_unstale":"2024-09-12T18:12:28.743899+0000","last_undegraded":"2024-09-12T18:12:28.743899+0000","last_fullsized":"2024-09-12T18:12:28.743899+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'38","last_scrub_stamp":"2024-09-12T18:12:28.743653+0000","last_deep_scrub":"263'38","last_deep_scrub_stamp":"2024-09-12T18:12:28.743653+0000","last_clean_scrub_stamp":"2024-09-12T18:12:28.743653+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:52:26.238294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":196,"num_read_kb":138,"num_write":78,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":31,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:44.556742+0000","last_change":"2024-09-12T18:12:44.556742+0000","last_active":"2024-09-12T18:12:44.556742+0000","last_peered":"2024-09-12T18:12:44.556742+0000","last_clean":"2024-09-12T18:12:44.556742+0000","last_became_active":"2024-09-12T17:46:57.087965+0000","last_became_peered":"2024-09-12T17:46:57.087965+0000","last_unstale":"2024-09-12T18:12:44.556742+0000","last_undegraded":"2024-09-12T18:12:44.556742+0000","last_fullsized":"2024-09-12T18:12:44.556742+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:44.556650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:44.556650+0000","last_clean_scrub_stamp":"2024-09-12T18:12:44.556650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:11:00.591111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"263'8","reported_seq":70,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:43.668149+0000","last_change":"2024-09-12T18:12:43.668079+0000","last_active":"2024-09-12T18:12:43.668149+0000","last_peered":"2024-09-12T18:12:43.668149+0000","last_clean":"2024-09-12T18:12:43.668149+0000","last_became_active":"2024-09-12T17:30:16.685054+0000","last_became_peered":"2024-09-12T17:30:16.685054+0000","last_unstale":"2024-09-12T18:12:43.668149+0000","last_undegraded":"2024-09-12T18:12:43.668149+0000","last_fullsized":"2024-09-12T18:12:43.668149+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'8","last_scrub_stamp":"2024-09-12T18:12:43.667978+0000","last_deep_scrub":"263'8","last_deep_scrub_stamp":"2024-09-12T18:12:43.667978+0000","last_clean_scrub_stamp":"2024-09-12T18:12:43.667978+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:36:05.401045+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":30722,"num_write":13,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"263'8","reported_seq":74,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:36.817015+0000","last_change":"2024-09-12T18:12:36.816959+0000","last_active":"2024-09-12T18:12:36.817015+0000","last_peered":"2024-09-12T18:12:36.817015+0000","last_clean":"2024-09-12T18:12:36.817015+0000","last_became_active":"2024-09-12T17:30:12.651780+0000","last_became_peered":"2024-09-12T17:30:12.651780+0000","last_unstale":"2024-09-12T18:12:36.817015+0000","last_undegraded":"2024-09-12T18:12:36.817015+0000","last_fullsized":"2024-09-12T18:12:36.817015+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'8","last_scrub_stamp":"2024-09-12T18:12:36.816868+0000","last_deep_scrub":"263'8","last_deep_scrub_stamp":"2024-09-12T18:12:36.816868+0000","last_clean_scrub_stamp":"2024-09-12T18:12:36.816868+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:38:17.392496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":22530,"num_write":13,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"263'27","reported_seq":137,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:16.515061+0000","last_change":"2024-09-12T18:12:16.514946+0000","last_active":"2024-09-12T18:12:16.515061+0000","last_peered":"2024-09-12T18:12:16.515061+0000","last_clean":"2024-09-12T18:12:16.515061+0000","last_became_active":"2024-09-12T17:26:35.665076+0000","last_became_peered":"2024-09-12T17:26:35.665076+0000","last_unstale":"2024-09-12T18:12:16.515061+0000","last_undegraded":"2024-09-12T18:12:16.515061+0000","last_fullsized":"2024-09-12T18:12:16.515061+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'27","last_scrub_stamp":"2024-09-12T18:12:16.514848+0000","last_deep_scrub":"263'27","last_deep_scrub_stamp":"2024-09-12T18:12:16.514848+0000","last_clean_scrub_stamp":"2024-09-12T18:12:16.514848+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:14:35.753947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":146,"num_read_kb":106,"num_write":38,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":32,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:27.501214+0000","last_change":"2024-09-12T18:12:27.501138+0000","last_active":"2024-09-12T18:12:27.501214+0000","last_peered":"2024-09-12T18:12:27.501214+0000","last_clean":"2024-09-12T18:12:27.501214+0000","last_became_active":"2024-09-12T17:46:57.077265+0000","last_became_peered":"2024-09-12T17:46:57.077265+0000","last_unstale":"2024-09-12T18:12:27.501214+0000","last_undegraded":"2024-09-12T18:12:27.501214+0000","last_fullsized":"2024-09-12T18:12:27.501214+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:27.501042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:27.501042+0000","last_clean_scrub_stamp":"2024-09-12T18:12:27.501042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:40:38.711253+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"0'0","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:41.638491+0000","last_change":"2024-09-12T18:12:41.638491+0000","last_active":"2024-09-12T18:12:41.638491+0000","last_peered":"2024-09-12T18:12:41.638491+0000","last_clean":"2024-09-12T18:12:41.638491+0000","last_became_active":"2024-09-12T17:30:16.683963+0000","last_became_peered":"2024-09-12T17:30:16.683963+0000","last_unstale":"2024-09-12T18:12:41.638491+0000","last_undegraded":"2024-09-12T18:12:41.638491+0000","last_fullsized":"2024-09-12T18:12:41.638491+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:41.638387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:41.638387+0000","last_clean_scrub_stamp":"2024-09-12T18:12:41.638387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:37:07.401689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"263'8","reported_seq":75,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:28.458329+0000","last_change":"2024-09-12T18:12:28.458273+0000","last_active":"2024-09-12T18:12:28.458329+0000","last_peered":"2024-09-12T18:12:28.458329+0000","last_clean":"2024-09-12T18:12:28.458329+0000","last_became_active":"2024-09-12T17:30:12.642687+0000","last_became_peered":"2024-09-12T17:30:12.642687+0000","last_unstale":"2024-09-12T18:12:28.458329+0000","last_undegraded":"2024-09-12T18:12:28.458329+0000","last_fullsized":"2024-09-12T18:12:28.458329+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'8","last_scrub_stamp":"2024-09-12T18:12:28.458184+0000","last_deep_scrub":"263'8","last_deep_scrub_stamp":"2024-09-12T18:12:28.458184+0000","last_clean_scrub_stamp":"2024-09-12T18:12:28.458184+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:11:54.846474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":26626,"num_write":13,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"263'39","reported_seq":169,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:27.715452+0000","last_change":"2024-09-12T18:12:27.715382+0000","last_active":"2024-09-12T18:12:27.715452+0000","last_peered":"2024-09-12T18:12:27.715452+0000","last_clean":"2024-09-12T18:12:27.715452+0000","last_became_active":"2024-09-12T17:26:35.668286+0000","last_became_peered":"2024-09-12T17:26:35.668286+0000","last_unstale":"2024-09-12T18:12:27.715452+0000","last_undegraded":"2024-09-12T18:12:27.715452+0000","last_fullsized":"2024-09-12T18:12:27.715452+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'39","last_scrub_stamp":"2024-09-12T18:12:27.715293+0000","last_deep_scrub":"263'39","last_deep_scrub_stamp":"2024-09-12T18:12:27.715293+0000","last_clean_scrub_stamp":"2024-09-12T18:12:27.715293+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:53:21.522059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":202,"num_read_kb":143,"num_write":74,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"263'2","reported_seq":34,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:14.710186+0000","last_change":"2024-09-12T18:12:14.710122+0000","last_active":"2024-09-12T18:12:14.710186+0000","last_peered":"2024-09-12T18:12:14.710186+0000","last_clean":"2024-09-12T18:12:14.710186+0000","last_became_active":"2024-09-12T17:46:57.088919+0000","last_became_peered":"2024-09-12T17:46:57.088919+0000","last_unstale":"2024-09-12T18:12:14.710186+0000","last_undegraded":"2024-09-12T18:12:14.710186+0000","last_fullsized":"2024-09-12T18:12:14.710186+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T18:12:14.710049+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T18:12:14.710049+0000","last_clean_scrub_stamp":"2024-09-12T18:12:14.710049+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:41:35.181583+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"0'0","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:40.852278+0000","last_change":"2024-09-12T18:12:40.852278+0000","last_active":"2024-09-12T18:12:40.852278+0000","last_peered":"2024-09-12T18:12:40.852278+0000","last_clean":"2024-09-12T18:12:40.852278+0000","last_became_active":"2024-09-12T17:31:18.236640+0000","last_became_peered":"2024-09-12T17:31:18.236640+0000","last_unstale":"2024-09-12T18:12:40.852278+0000","last_undegraded":"2024-09-12T18:12:40.852278+0000","last_fullsized":"2024-09-12T18:12:40.852278+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:40.852191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:40.852191+0000","last_clean_scrub_stamp":"2024-09-12T18:12:40.852191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:36:01.435903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.15","version":"0'0","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:31.556332+0000","last_change":"2024-09-12T18:12:31.556332+0000","last_active":"2024-09-12T18:12:31.556332+0000","last_peered":"2024-09-12T18:12:31.556332+0000","last_clean":"2024-09-12T18:12:31.556332+0000","last_became_active":"2024-09-12T17:30:12.649605+0000","last_became_peered":"2024-09-12T17:30:12.649605+0000","last_unstale":"2024-09-12T18:12:31.556332+0000","last_undegraded":"2024-09-12T18:12:31.556332+0000","last_fullsized":"2024-09-12T18:12:31.556332+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:31.556233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:31.556233+0000","last_clean_scrub_stamp":"2024-09-12T18:12:31.556233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:14:54.561876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"263'53","reported_seq":200,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:32.726697+0000","last_change":"2024-09-12T18:12:32.726697+0000","last_active":"2024-09-12T18:12:32.726697+0000","last_peered":"2024-09-12T18:12:32.726697+0000","last_clean":"2024-09-12T18:12:32.726697+0000","last_became_active":"2024-09-12T17:26:35.658602+0000","last_became_peered":"2024-09-12T17:26:35.658602+0000","last_unstale":"2024-09-12T18:12:32.726697+0000","last_undegraded":"2024-09-12T18:12:32.726697+0000","last_fullsized":"2024-09-12T18:12:32.726697+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'53","last_scrub_stamp":"2024-09-12T18:12:32.726601+0000","last_deep_scrub":"263'53","last_deep_scrub_stamp":"2024-09-12T18:12:32.726601+0000","last_clean_scrub_stamp":"2024-09-12T18:12:32.726601+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:06:45.249100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":262,"num_read_kb":183,"num_write":93,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":32,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:41.506846+0000","last_change":"2024-09-12T18:12:41.506846+0000","last_active":"2024-09-12T18:12:41.506846+0000","last_peered":"2024-09-12T18:12:41.506846+0000","last_clean":"2024-09-12T18:12:41.506846+0000","last_became_active":"2024-09-12T17:46:57.081080+0000","last_became_peered":"2024-09-12T17:46:57.081080+0000","last_unstale":"2024-09-12T18:12:41.506846+0000","last_undegraded":"2024-09-12T18:12:41.506846+0000","last_fullsized":"2024-09-12T18:12:41.506846+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:41.506737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:41.506737+0000","last_clean_scrub_stamp":"2024-09-12T18:12:41.506737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:37:12.456062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"263'3","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:42.673015+0000","last_change":"2024-09-12T18:12:42.673015+0000","last_active":"2024-09-12T18:12:42.673015+0000","last_peered":"2024-09-12T18:12:42.673015+0000","last_clean":"2024-09-12T18:12:42.673015+0000","last_became_active":"2024-09-12T17:30:16.685688+0000","last_became_peered":"2024-09-12T17:30:16.685688+0000","last_unstale":"2024-09-12T18:12:42.673015+0000","last_undegraded":"2024-09-12T18:12:42.673015+0000","last_fullsized":"2024-09-12T18:12:42.673015+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'3","last_scrub_stamp":"2024-09-12T18:12:42.672919+0000","last_deep_scrub":"263'3","last_deep_scrub_stamp":"2024-09-12T18:12:42.672919+0000","last_clean_scrub_stamp":"2024-09-12T18:12:42.672919+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:39:36.235626+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"0'0","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:10.681131+0000","last_change":"2024-09-12T18:12:10.681131+0000","last_active":"2024-09-12T18:12:10.681131+0000","last_peered":"2024-09-12T18:12:10.681131+0000","last_clean":"2024-09-12T18:12:10.681131+0000","last_became_active":"2024-09-12T17:30:12.654327+0000","last_became_peered":"2024-09-12T17:30:12.654327+0000","last_unstale":"2024-09-12T18:12:10.681131+0000","last_undegraded":"2024-09-12T18:12:10.681131+0000","last_fullsized":"2024-09-12T18:12:10.681131+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:10.681027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:10.681027+0000","last_clean_scrub_stamp":"2024-09-12T18:12:10.681027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:06:34.876167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"263'47","reported_seq":194,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:06.753049+0000","last_change":"2024-09-12T18:12:06.752989+0000","last_active":"2024-09-12T18:12:06.753049+0000","last_peered":"2024-09-12T18:12:06.753049+0000","last_clean":"2024-09-12T18:12:06.753049+0000","last_became_active":"2024-09-12T17:26:35.662284+0000","last_became_peered":"2024-09-12T17:26:35.662284+0000","last_unstale":"2024-09-12T18:12:06.753049+0000","last_undegraded":"2024-09-12T18:12:06.753049+0000","last_fullsized":"2024-09-12T18:12:06.753049+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'47","last_scrub_stamp":"2024-09-12T18:12:06.752901+0000","last_deep_scrub":"263'47","last_deep_scrub_stamp":"2024-09-12T18:12:06.752901+0000","last_clean_scrub_stamp":"2024-09-12T18:12:06.752901+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:42:41.000414+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":252,"num_read_kb":176,"num_write":91,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":32,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:34.371336+0000","last_change":"2024-09-12T18:12:34.371273+0000","last_active":"2024-09-12T18:12:34.371336+0000","last_peered":"2024-09-12T18:12:34.371336+0000","last_clean":"2024-09-12T18:12:34.371336+0000","last_became_active":"2024-09-12T17:46:57.082082+0000","last_became_peered":"2024-09-12T17:46:57.082082+0000","last_unstale":"2024-09-12T18:12:34.371336+0000","last_undegraded":"2024-09-12T18:12:34.371336+0000","last_fullsized":"2024-09-12T18:12:34.371336+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:34.371182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:34.371182+0000","last_clean_scrub_stamp":"2024-09-12T18:12:34.371182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:03:38.349938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"260'3","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:31.294397+0000","last_change":"2024-09-12T18:12:31.294397+0000","last_active":"2024-09-12T18:12:31.294397+0000","last_peered":"2024-09-12T18:12:31.294397+0000","last_clean":"2024-09-12T18:12:31.294397+0000","last_became_active":"2024-09-12T17:30:16.675278+0000","last_became_peered":"2024-09-12T17:30:16.675278+0000","last_unstale":"2024-09-12T18:12:31.294397+0000","last_undegraded":"2024-09-12T18:12:31.294397+0000","last_fullsized":"2024-09-12T18:12:31.294397+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'3","last_scrub_stamp":"2024-09-12T18:12:31.294300+0000","last_deep_scrub":"260'3","last_deep_scrub_stamp":"2024-09-12T18:12:31.294300+0000","last_clean_scrub_stamp":"2024-09-12T18:12:31.294300+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:27:39.709354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"260'2","reported_seq":58,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:34.773390+0000","last_change":"2024-09-12T18:12:34.773390+0000","last_active":"2024-09-12T18:12:34.773390+0000","last_peered":"2024-09-12T18:12:34.773390+0000","last_clean":"2024-09-12T18:12:34.773390+0000","last_became_active":"2024-09-12T17:30:12.643203+0000","last_became_peered":"2024-09-12T17:30:12.643203+0000","last_unstale":"2024-09-12T18:12:34.773390+0000","last_undegraded":"2024-09-12T18:12:34.773390+0000","last_fullsized":"2024-09-12T18:12:34.773390+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-09-12T18:12:34.773296+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-09-12T18:12:34.773296+0000","last_clean_scrub_stamp":"2024-09-12T18:12:34.773296+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:04:26.951267+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":23,"num_write":2,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"263'29","reported_seq":133,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:29.526265+0000","last_change":"2024-09-12T18:12:29.526265+0000","last_active":"2024-09-12T18:12:29.526265+0000","last_peered":"2024-09-12T18:12:29.526265+0000","last_clean":"2024-09-12T18:12:29.526265+0000","last_became_active":"2024-09-12T17:26:35.657035+0000","last_became_peered":"2024-09-12T17:26:35.657035+0000","last_unstale":"2024-09-12T18:12:29.526265+0000","last_undegraded":"2024-09-12T18:12:29.526265+0000","last_fullsized":"2024-09-12T18:12:29.526265+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'29","last_scrub_stamp":"2024-09-12T18:12:29.526178+0000","last_deep_scrub":"263'29","last_deep_scrub_stamp":"2024-09-12T18:12:29.526178+0000","last_clean_scrub_stamp":"2024-09-12T18:12:29.526178+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:27:18.798425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":129,"num_read_kb":90,"num_write":56,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":31,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:48.589702+0000","last_change":"2024-09-12T18:12:48.589702+0000","last_active":"2024-09-12T18:12:48.589702+0000","last_peered":"2024-09-12T18:12:48.589702+0000","last_clean":"2024-09-12T18:12:48.589702+0000","last_became_active":"2024-09-12T17:46:57.094314+0000","last_became_peered":"2024-09-12T17:46:57.094314+0000","last_unstale":"2024-09-12T18:12:48.589702+0000","last_undegraded":"2024-09-12T18:12:48.589702+0000","last_fullsized":"2024-09-12T18:12:48.589702+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:48.589588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:48.589588+0000","last_clean_scrub_stamp":"2024-09-12T18:12:48.589588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:10:25.273101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:25.546047+0000","last_change":"2024-09-12T18:12:25.546047+0000","last_active":"2024-09-12T18:12:25.546047+0000","last_peered":"2024-09-12T18:12:25.546047+0000","last_clean":"2024-09-12T18:12:25.546047+0000","last_became_active":"2024-09-12T17:30:16.679282+0000","last_became_peered":"2024-09-12T17:30:16.679282+0000","last_unstale":"2024-09-12T18:12:25.546047+0000","last_undegraded":"2024-09-12T18:12:25.546047+0000","last_fullsized":"2024-09-12T18:12:25.546047+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:25.545958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:25.545958+0000","last_clean_scrub_stamp":"2024-09-12T18:12:25.545958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:12:26.317340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"260'6","reported_seq":67,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:24.336704+0000","last_change":"2024-09-12T18:12:24.336704+0000","last_active":"2024-09-12T18:12:24.336704+0000","last_peered":"2024-09-12T18:12:24.336704+0000","last_clean":"2024-09-12T18:12:24.336704+0000","last_became_active":"2024-09-12T17:30:12.652426+0000","last_became_peered":"2024-09-12T17:30:12.652426+0000","last_unstale":"2024-09-12T18:12:24.336704+0000","last_undegraded":"2024-09-12T18:12:24.336704+0000","last_fullsized":"2024-09-12T18:12:24.336704+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'6","last_scrub_stamp":"2024-09-12T18:12:24.336606+0000","last_deep_scrub":"260'6","last_deep_scrub_stamp":"2024-09-12T18:12:24.336606+0000","last_clean_scrub_stamp":"2024-09-12T18:12:24.336606+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:14:36.587843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":10240,"num_write":16,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"263'34","reported_seq":156,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:24.498834+0000","last_change":"2024-09-12T18:12:24.498834+0000","last_active":"2024-09-12T18:12:24.498834+0000","last_peered":"2024-09-12T18:12:24.498834+0000","last_clean":"2024-09-12T18:12:24.498834+0000","last_became_active":"2024-09-12T17:26:35.663337+0000","last_became_peered":"2024-09-12T17:26:35.663337+0000","last_unstale":"2024-09-12T18:12:24.498834+0000","last_undegraded":"2024-09-12T18:12:24.498834+0000","last_fullsized":"2024-09-12T18:12:24.498834+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'34","last_scrub_stamp":"2024-09-12T18:12:24.498734+0000","last_deep_scrub":"263'34","last_deep_scrub_stamp":"2024-09-12T18:12:24.498734+0000","last_clean_scrub_stamp":"2024-09-12T18:12:24.498734+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:16:59.364876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":179,"num_read_kb":128,"num_write":55,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":31,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:45.842946+0000","last_change":"2024-09-12T18:12:45.842946+0000","last_active":"2024-09-12T18:12:45.842946+0000","last_peered":"2024-09-12T18:12:45.842946+0000","last_clean":"2024-09-12T18:12:45.842946+0000","last_became_active":"2024-09-12T17:46:57.093157+0000","last_became_peered":"2024-09-12T17:46:57.093157+0000","last_unstale":"2024-09-12T18:12:45.842946+0000","last_undegraded":"2024-09-12T18:12:45.842946+0000","last_fullsized":"2024-09-12T18:12:45.842946+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:45.842861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:45.842861+0000","last_clean_scrub_stamp":"2024-09-12T18:12:45.842861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:34:06.382762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"263'2","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:24.515982+0000","last_change":"2024-09-12T18:12:24.515982+0000","last_active":"2024-09-12T18:12:24.515982+0000","last_peered":"2024-09-12T18:12:24.515982+0000","last_clean":"2024-09-12T18:12:24.515982+0000","last_became_active":"2024-09-12T17:30:16.678682+0000","last_became_peered":"2024-09-12T17:30:16.678682+0000","last_unstale":"2024-09-12T18:12:24.515982+0000","last_undegraded":"2024-09-12T18:12:24.515982+0000","last_fullsized":"2024-09-12T18:12:24.515982+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T18:12:24.515881+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T18:12:24.515881+0000","last_clean_scrub_stamp":"2024-09-12T18:12:24.515881+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:06:29.104906+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"263'6","reported_seq":61,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:35.700045+0000","last_change":"2024-09-12T18:12:35.700045+0000","last_active":"2024-09-12T18:12:35.700045+0000","last_peered":"2024-09-12T18:12:35.700045+0000","last_clean":"2024-09-12T18:12:35.700045+0000","last_became_active":"2024-09-12T17:30:12.652916+0000","last_became_peered":"2024-09-12T17:30:12.652916+0000","last_unstale":"2024-09-12T18:12:35.700045+0000","last_undegraded":"2024-09-12T18:12:35.700045+0000","last_fullsized":"2024-09-12T18:12:35.700045+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'6","last_scrub_stamp":"2024-09-12T18:12:35.699925+0000","last_deep_scrub":"263'6","last_deep_scrub_stamp":"2024-09-12T18:12:35.699925+0000","last_clean_scrub_stamp":"2024-09-12T18:12:35.699925+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:52:51.571101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":16,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"263'35","reported_seq":156,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:25.654543+0000","last_change":"2024-09-12T18:12:25.654543+0000","last_active":"2024-09-12T18:12:25.654543+0000","last_peered":"2024-09-12T18:12:25.654543+0000","last_clean":"2024-09-12T18:12:25.654543+0000","last_became_active":"2024-09-12T17:26:35.669256+0000","last_became_peered":"2024-09-12T17:26:35.669256+0000","last_unstale":"2024-09-12T18:12:25.654543+0000","last_undegraded":"2024-09-12T18:12:25.654543+0000","last_fullsized":"2024-09-12T18:12:25.654543+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'35","last_scrub_stamp":"2024-09-12T18:12:25.654452+0000","last_deep_scrub":"263'35","last_deep_scrub_stamp":"2024-09-12T18:12:25.654452+0000","last_clean_scrub_stamp":"2024-09-12T18:12:25.654452+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:47:17.573085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":173,"num_read_kb":119,"num_write":68,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"263'2","reported_seq":34,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:44.892523+0000","last_change":"2024-09-12T18:12:44.892463+0000","last_active":"2024-09-12T18:12:44.892523+0000","last_peered":"2024-09-12T18:12:44.892523+0000","last_clean":"2024-09-12T18:12:44.892523+0000","last_became_active":"2024-09-12T17:46:57.090587+0000","last_became_peered":"2024-09-12T17:46:57.090587+0000","last_unstale":"2024-09-12T18:12:44.892523+0000","last_undegraded":"2024-09-12T18:12:44.892523+0000","last_fullsized":"2024-09-12T18:12:44.892523+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T18:12:44.892376+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T18:12:44.892376+0000","last_clean_scrub_stamp":"2024-09-12T18:12:44.892376+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:44:43.304125+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"260'3","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:40.602189+0000","last_change":"2024-09-12T18:12:40.602189+0000","last_active":"2024-09-12T18:12:40.602189+0000","last_peered":"2024-09-12T18:12:40.602189+0000","last_clean":"2024-09-12T18:12:40.602189+0000","last_became_active":"2024-09-12T17:30:16.685830+0000","last_became_peered":"2024-09-12T17:30:16.685830+0000","last_unstale":"2024-09-12T18:12:40.602189+0000","last_undegraded":"2024-09-12T18:12:40.602189+0000","last_fullsized":"2024-09-12T18:12:40.602189+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'3","last_scrub_stamp":"2024-09-12T18:12:40.602088+0000","last_deep_scrub":"260'3","last_deep_scrub_stamp":"2024-09-12T18:12:40.602088+0000","last_clean_scrub_stamp":"2024-09-12T18:12:40.602088+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:08:04.177908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"0'0","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:17.643769+0000","last_change":"2024-09-12T18:12:17.643769+0000","last_active":"2024-09-12T18:12:17.643769+0000","last_peered":"2024-09-12T18:12:17.643769+0000","last_clean":"2024-09-12T18:12:17.643769+0000","last_became_active":"2024-09-12T17:30:12.640139+0000","last_became_peered":"2024-09-12T17:30:12.640139+0000","last_unstale":"2024-09-12T18:12:17.643769+0000","last_undegraded":"2024-09-12T18:12:17.643769+0000","last_fullsized":"2024-09-12T18:12:17.643769+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:17.643681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:17.643681+0000","last_clean_scrub_stamp":"2024-09-12T18:12:17.643681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:03:03.826784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"263'49","reported_seq":197,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:25.333514+0000","last_change":"2024-09-12T18:12:25.333514+0000","last_active":"2024-09-12T18:12:25.333514+0000","last_peered":"2024-09-12T18:12:25.333514+0000","last_clean":"2024-09-12T18:12:25.333514+0000","last_became_active":"2024-09-12T17:26:35.658785+0000","last_became_peered":"2024-09-12T17:26:35.658785+0000","last_unstale":"2024-09-12T18:12:25.333514+0000","last_undegraded":"2024-09-12T18:12:25.333514+0000","last_fullsized":"2024-09-12T18:12:25.333514+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'49","last_scrub_stamp":"2024-09-12T18:12:25.333414+0000","last_deep_scrub":"263'49","last_deep_scrub_stamp":"2024-09-12T18:12:25.333414+0000","last_clean_scrub_stamp":"2024-09-12T18:12:25.333414+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:55:51.168024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":254,"num_read_kb":176,"num_write":93,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"263'2","reported_seq":33,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:45.603465+0000","last_change":"2024-09-12T18:12:45.603465+0000","last_active":"2024-09-12T18:12:45.603465+0000","last_peered":"2024-09-12T18:12:45.603465+0000","last_clean":"2024-09-12T18:12:45.603465+0000","last_became_active":"2024-09-12T17:46:57.093267+0000","last_became_peered":"2024-09-12T17:46:57.093267+0000","last_unstale":"2024-09-12T18:12:45.603465+0000","last_undegraded":"2024-09-12T18:12:45.603465+0000","last_fullsized":"2024-09-12T18:12:45.603465+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T18:12:45.603374+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T18:12:45.603374+0000","last_clean_scrub_stamp":"2024-09-12T18:12:45.603374+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:22:28.073719+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:19.615413+0000","last_change":"2024-09-12T18:12:19.615343+0000","last_active":"2024-09-12T18:12:19.615413+0000","last_peered":"2024-09-12T18:12:19.615413+0000","last_clean":"2024-09-12T18:12:19.615413+0000","last_became_active":"2024-09-12T17:30:16.681418+0000","last_became_peered":"2024-09-12T17:30:16.681418+0000","last_unstale":"2024-09-12T18:12:19.615413+0000","last_undegraded":"2024-09-12T18:12:19.615413+0000","last_fullsized":"2024-09-12T18:12:19.615413+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:19.615255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:19.615255+0000","last_clean_scrub_stamp":"2024-09-12T18:12:19.615255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:53:23.299709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"260'3","reported_seq":61,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:27.495190+0000","last_change":"2024-09-12T18:12:27.495190+0000","last_active":"2024-09-12T18:12:27.495190+0000","last_peered":"2024-09-12T18:12:27.495190+0000","last_clean":"2024-09-12T18:12:27.495190+0000","last_became_active":"2024-09-12T17:30:12.643484+0000","last_became_peered":"2024-09-12T17:30:12.643484+0000","last_unstale":"2024-09-12T18:12:27.495190+0000","last_undegraded":"2024-09-12T18:12:27.495190+0000","last_fullsized":"2024-09-12T18:12:27.495190+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'3","last_scrub_stamp":"2024-09-12T18:12:27.495104+0000","last_deep_scrub":"260'3","last_deep_scrub_stamp":"2024-09-12T18:12:27.495104+0000","last_clean_scrub_stamp":"2024-09-12T18:12:27.495104+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:34:55.885967+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"260'23","reported_seq":127,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:31.699646+0000","last_change":"2024-09-12T18:12:31.699646+0000","last_active":"2024-09-12T18:12:31.699646+0000","last_peered":"2024-09-12T18:12:31.699646+0000","last_clean":"2024-09-12T18:12:31.699646+0000","last_became_active":"2024-09-12T17:26:35.665908+0000","last_became_peered":"2024-09-12T17:26:35.665908+0000","last_unstale":"2024-09-12T18:12:31.699646+0000","last_undegraded":"2024-09-12T18:12:31.699646+0000","last_fullsized":"2024-09-12T18:12:31.699646+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'23","last_scrub_stamp":"2024-09-12T18:12:31.699547+0000","last_deep_scrub":"260'23","last_deep_scrub_stamp":"2024-09-12T18:12:31.699547+0000","last_clean_scrub_stamp":"2024-09-12T18:12:31.699547+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:26:25.142810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":120,"num_read_kb":87,"num_write":41,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":33,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:13.703941+0000","last_change":"2024-09-12T18:12:13.703880+0000","last_active":"2024-09-12T18:12:13.703941+0000","last_peered":"2024-09-12T18:12:13.703941+0000","last_clean":"2024-09-12T18:12:13.703941+0000","last_became_active":"2024-09-12T17:46:57.083098+0000","last_became_peered":"2024-09-12T17:46:57.083098+0000","last_unstale":"2024-09-12T18:12:13.703941+0000","last_undegraded":"2024-09-12T18:12:13.703941+0000","last_fullsized":"2024-09-12T18:12:13.703941+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:13.703785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:13.703785+0000","last_clean_scrub_stamp":"2024-09-12T18:12:13.703785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:58:44.733305+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:38.640030+0000","last_change":"2024-09-12T18:12:38.639932+0000","last_active":"2024-09-12T18:12:38.640030+0000","last_peered":"2024-09-12T18:12:38.640030+0000","last_clean":"2024-09-12T18:12:38.640030+0000","last_became_active":"2024-09-12T17:30:16.683887+0000","last_became_peered":"2024-09-12T17:30:16.683887+0000","last_unstale":"2024-09-12T18:12:38.640030+0000","last_undegraded":"2024-09-12T18:12:38.640030+0000","last_fullsized":"2024-09-12T18:12:38.640030+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:38.639801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:38.639801+0000","last_clean_scrub_stamp":"2024-09-12T18:12:38.639801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:19:50.984866+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"263'4","reported_seq":63,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:34.564561+0000","last_change":"2024-09-12T18:12:34.564503+0000","last_active":"2024-09-12T18:12:34.564561+0000","last_peered":"2024-09-12T18:12:34.564561+0000","last_clean":"2024-09-12T18:12:34.564561+0000","last_became_active":"2024-09-12T17:30:12.653137+0000","last_became_peered":"2024-09-12T17:30:12.653137+0000","last_unstale":"2024-09-12T18:12:34.564561+0000","last_undegraded":"2024-09-12T18:12:34.564561+0000","last_fullsized":"2024-09-12T18:12:34.564561+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-09-12T18:12:34.564417+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-09-12T18:12:34.564417+0000","last_clean_scrub_stamp":"2024-09-12T18:12:34.564417+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:49:36.854631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6148,"num_write":4,"num_write_kb":3076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"263'50","reported_seq":195,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:30.674050+0000","last_change":"2024-09-12T18:12:30.674050+0000","last_active":"2024-09-12T18:12:30.674050+0000","last_peered":"2024-09-12T18:12:30.674050+0000","last_clean":"2024-09-12T18:12:30.674050+0000","last_became_active":"2024-09-12T17:26:35.668989+0000","last_became_peered":"2024-09-12T17:26:35.668989+0000","last_unstale":"2024-09-12T18:12:30.674050+0000","last_undegraded":"2024-09-12T18:12:30.674050+0000","last_fullsized":"2024-09-12T18:12:30.674050+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'50","last_scrub_stamp":"2024-09-12T18:12:30.673958+0000","last_deep_scrub":"263'50","last_deep_scrub_stamp":"2024-09-12T18:12:30.673958+0000","last_clean_scrub_stamp":"2024-09-12T18:12:30.673958+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:49:54.457434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":250,"num_read_kb":175,"num_write":93,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":32,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:39.469968+0000","last_change":"2024-09-12T18:12:39.469968+0000","last_active":"2024-09-12T18:12:39.469968+0000","last_peered":"2024-09-12T18:12:39.469968+0000","last_clean":"2024-09-12T18:12:39.469968+0000","last_became_active":"2024-09-12T17:46:57.087982+0000","last_became_peered":"2024-09-12T17:46:57.087982+0000","last_unstale":"2024-09-12T18:12:39.469968+0000","last_undegraded":"2024-09-12T18:12:39.469968+0000","last_fullsized":"2024-09-12T18:12:39.469968+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:39.469872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:39.469872+0000","last_clean_scrub_stamp":"2024-09-12T18:12:39.469872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:16:13.071735+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"263'5","reported_seq":58,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:37.650203+0000","last_change":"2024-09-12T18:12:37.650137+0000","last_active":"2024-09-12T18:12:37.650203+0000","last_peered":"2024-09-12T18:12:37.650203+0000","last_clean":"2024-09-12T18:12:37.650203+0000","last_became_active":"2024-09-12T17:30:16.679621+0000","last_became_peered":"2024-09-12T17:30:16.679621+0000","last_unstale":"2024-09-12T18:12:37.650203+0000","last_undegraded":"2024-09-12T18:12:37.650203+0000","last_fullsized":"2024-09-12T18:12:37.650203+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'5","last_scrub_stamp":"2024-09-12T18:12:37.650044+0000","last_deep_scrub":"263'5","last_deep_scrub_stamp":"2024-09-12T18:12:37.650044+0000","last_clean_scrub_stamp":"2024-09-12T18:12:37.650044+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:21:16.129452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":9216,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"0'0","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:11.722419+0000","last_change":"2024-09-12T18:12:11.722350+0000","last_active":"2024-09-12T18:12:11.722419+0000","last_peered":"2024-09-12T18:12:11.722419+0000","last_clean":"2024-09-12T18:12:11.722419+0000","last_became_active":"2024-09-12T17:30:12.649010+0000","last_became_peered":"2024-09-12T17:30:12.649010+0000","last_unstale":"2024-09-12T18:12:11.722419+0000","last_undegraded":"2024-09-12T18:12:11.722419+0000","last_fullsized":"2024-09-12T18:12:11.722419+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:11.722264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:11.722264+0000","last_clean_scrub_stamp":"2024-09-12T18:12:11.722264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:57:34.831899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"260'8","reported_seq":84,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:25.450522+0000","last_change":"2024-09-12T18:12:25.450522+0000","last_active":"2024-09-12T18:12:25.450522+0000","last_peered":"2024-09-12T18:12:25.450522+0000","last_clean":"2024-09-12T18:12:25.450522+0000","last_became_active":"2024-09-12T17:26:35.663041+0000","last_became_peered":"2024-09-12T17:26:35.663041+0000","last_unstale":"2024-09-12T18:12:25.450522+0000","last_undegraded":"2024-09-12T18:12:25.450522+0000","last_fullsized":"2024-09-12T18:12:25.450522+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'8","last_scrub_stamp":"2024-09-12T18:12:25.450393+0000","last_deep_scrub":"260'8","last_deep_scrub_stamp":"2024-09-12T18:12:25.450393+0000","last_clean_scrub_stamp":"2024-09-12T18:12:25.450393+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:09:36.252938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":28,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":33,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:22.599884+0000","last_change":"2024-09-12T18:12:22.599821+0000","last_active":"2024-09-12T18:12:22.599884+0000","last_peered":"2024-09-12T18:12:22.599884+0000","last_clean":"2024-09-12T18:12:22.599884+0000","last_became_active":"2024-09-12T17:46:57.085908+0000","last_became_peered":"2024-09-12T17:46:57.085908+0000","last_unstale":"2024-09-12T18:12:22.599884+0000","last_undegraded":"2024-09-12T18:12:22.599884+0000","last_fullsized":"2024-09-12T18:12:22.599884+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:22.599729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:22.599729+0000","last_clean_scrub_stamp":"2024-09-12T18:12:22.599729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:22:37.203634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"0'0","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:23.528470+0000","last_change":"2024-09-12T18:12:23.528470+0000","last_active":"2024-09-12T18:12:23.528470+0000","last_peered":"2024-09-12T18:12:23.528470+0000","last_clean":"2024-09-12T18:12:23.528470+0000","last_became_active":"2024-09-12T17:30:16.679193+0000","last_became_peered":"2024-09-12T17:30:16.679193+0000","last_unstale":"2024-09-12T18:12:23.528470+0000","last_undegraded":"2024-09-12T18:12:23.528470+0000","last_fullsized":"2024-09-12T18:12:23.528470+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:23.528383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:23.528383+0000","last_clean_scrub_stamp":"2024-09-12T18:12:23.528383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:50:26.406700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"0'0","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:33.762287+0000","last_change":"2024-09-12T18:12:33.762235+0000","last_active":"2024-09-12T18:12:33.762287+0000","last_peered":"2024-09-12T18:12:33.762287+0000","last_clean":"2024-09-12T18:12:33.762287+0000","last_became_active":"2024-09-12T17:30:12.646945+0000","last_became_peered":"2024-09-12T17:30:12.646945+0000","last_unstale":"2024-09-12T18:12:33.762287+0000","last_undegraded":"2024-09-12T18:12:33.762287+0000","last_fullsized":"2024-09-12T18:12:33.762287+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:33.762150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:33.762150+0000","last_clean_scrub_stamp":"2024-09-12T18:12:33.762150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:41:23.369152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"263'33","reported_seq":151,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:14.554571+0000","last_change":"2024-09-12T18:12:14.554571+0000","last_active":"2024-09-12T18:12:14.554571+0000","last_peered":"2024-09-12T18:12:14.554571+0000","last_clean":"2024-09-12T18:12:14.554571+0000","last_became_active":"2024-09-12T17:26:35.664749+0000","last_became_peered":"2024-09-12T17:26:35.664749+0000","last_unstale":"2024-09-12T18:12:14.554571+0000","last_undegraded":"2024-09-12T18:12:14.554571+0000","last_fullsized":"2024-09-12T18:12:14.554571+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'33","last_scrub_stamp":"2024-09-12T18:12:14.554482+0000","last_deep_scrub":"263'33","last_deep_scrub_stamp":"2024-09-12T18:12:14.554482+0000","last_clean_scrub_stamp":"2024-09-12T18:12:14.554482+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:42:43.539362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":166,"num_read_kb":124,"num_write":50,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":33,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:38.471430+0000","last_change":"2024-09-12T18:12:38.471314+0000","last_active":"2024-09-12T18:12:38.471430+0000","last_peered":"2024-09-12T18:12:38.471430+0000","last_clean":"2024-09-12T18:12:38.471430+0000","last_became_active":"2024-09-12T17:46:57.084421+0000","last_became_peered":"2024-09-12T17:46:57.084421+0000","last_unstale":"2024-09-12T18:12:38.471430+0000","last_undegraded":"2024-09-12T18:12:38.471430+0000","last_fullsized":"2024-09-12T18:12:38.471430+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:38.471210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:38.471210+0000","last_clean_scrub_stamp":"2024-09-12T18:12:38.471210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:54:23.999871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"0'0","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:39.630138+0000","last_change":"2024-09-12T18:12:39.630066+0000","last_active":"2024-09-12T18:12:39.630138+0000","last_peered":"2024-09-12T18:12:39.630138+0000","last_clean":"2024-09-12T18:12:39.630138+0000","last_became_active":"2024-09-12T17:30:16.681171+0000","last_became_peered":"2024-09-12T17:30:16.681171+0000","last_unstale":"2024-09-12T18:12:39.630138+0000","last_undegraded":"2024-09-12T18:12:39.630138+0000","last_fullsized":"2024-09-12T18:12:39.630138+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:39.629971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:39.629971+0000","last_clean_scrub_stamp":"2024-09-12T18:12:39.629971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:02:02.885356+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"263'6","reported_seq":65,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:22.520661+0000","last_change":"2024-09-12T18:12:22.520661+0000","last_active":"2024-09-12T18:12:22.520661+0000","last_peered":"2024-09-12T18:12:22.520661+0000","last_clean":"2024-09-12T18:12:22.520661+0000","last_became_active":"2024-09-12T17:30:12.641592+0000","last_became_peered":"2024-09-12T17:30:12.641592+0000","last_unstale":"2024-09-12T18:12:22.520661+0000","last_undegraded":"2024-09-12T18:12:22.520661+0000","last_fullsized":"2024-09-12T18:12:22.520661+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'6","last_scrub_stamp":"2024-09-12T18:12:22.520568+0000","last_deep_scrub":"263'6","last_deep_scrub_stamp":"2024-09-12T18:12:22.520568+0000","last_clean_scrub_stamp":"2024-09-12T18:12:22.520568+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:49:55.907430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":11264,"num_write":6,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"263'52","reported_seq":204,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:08.755498+0000","last_change":"2024-09-12T18:12:08.755498+0000","last_active":"2024-09-12T18:12:08.755498+0000","last_peered":"2024-09-12T18:12:08.755498+0000","last_clean":"2024-09-12T18:12:08.755498+0000","last_became_active":"2024-09-12T17:26:35.663472+0000","last_became_peered":"2024-09-12T17:26:35.663472+0000","last_unstale":"2024-09-12T18:12:08.755498+0000","last_undegraded":"2024-09-12T18:12:08.755498+0000","last_fullsized":"2024-09-12T18:12:08.755498+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'52","last_scrub_stamp":"2024-09-12T18:12:08.755421+0000","last_deep_scrub":"263'52","last_deep_scrub_stamp":"2024-09-12T18:12:08.755421+0000","last_clean_scrub_stamp":"2024-09-12T18:12:08.755421+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:24:53.221772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":261,"num_read_kb":192,"num_write":92,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":32,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:46.624033+0000","last_change":"2024-09-12T18:12:46.624033+0000","last_active":"2024-09-12T18:12:46.624033+0000","last_peered":"2024-09-12T18:12:46.624033+0000","last_clean":"2024-09-12T18:12:46.624033+0000","last_became_active":"2024-09-12T17:46:57.089601+0000","last_became_peered":"2024-09-12T17:46:57.089601+0000","last_unstale":"2024-09-12T18:12:46.624033+0000","last_undegraded":"2024-09-12T18:12:46.624033+0000","last_fullsized":"2024-09-12T18:12:46.624033+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:46.623926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:46.623926+0000","last_clean_scrub_stamp":"2024-09-12T18:12:46.623926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:29:10.208340+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"0'0","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:33.290702+0000","last_change":"2024-09-12T18:12:33.290702+0000","last_active":"2024-09-12T18:12:33.290702+0000","last_peered":"2024-09-12T18:12:33.290702+0000","last_clean":"2024-09-12T18:12:33.290702+0000","last_became_active":"2024-09-12T17:30:16.679308+0000","last_became_peered":"2024-09-12T17:30:16.679308+0000","last_unstale":"2024-09-12T18:12:33.290702+0000","last_undegraded":"2024-09-12T18:12:33.290702+0000","last_fullsized":"2024-09-12T18:12:33.290702+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:33.290598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:33.290598+0000","last_clean_scrub_stamp":"2024-09-12T18:12:33.290598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:23:49.567295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"263'5","reported_seq":64,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:31.697940+0000","last_change":"2024-09-12T18:12:31.697940+0000","last_active":"2024-09-12T18:12:31.697940+0000","last_peered":"2024-09-12T18:12:31.697940+0000","last_clean":"2024-09-12T18:12:31.697940+0000","last_became_active":"2024-09-12T17:30:12.644792+0000","last_became_peered":"2024-09-12T17:30:12.644792+0000","last_unstale":"2024-09-12T18:12:31.697940+0000","last_undegraded":"2024-09-12T18:12:31.697940+0000","last_fullsized":"2024-09-12T18:12:31.697940+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'5","last_scrub_stamp":"2024-09-12T18:12:31.697844+0000","last_deep_scrub":"263'5","last_deep_scrub_stamp":"2024-09-12T18:12:31.697844+0000","last_clean_scrub_stamp":"2024-09-12T18:12:31.697844+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:52:52.564311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6192,"num_write":5,"num_write_kb":6192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"263'30","reported_seq":150,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:24.657406+0000","last_change":"2024-09-12T18:12:24.657406+0000","last_active":"2024-09-12T18:12:24.657406+0000","last_peered":"2024-09-12T18:12:24.657406+0000","last_clean":"2024-09-12T18:12:24.657406+0000","last_became_active":"2024-09-12T17:26:35.667655+0000","last_became_peered":"2024-09-12T17:26:35.667655+0000","last_unstale":"2024-09-12T18:12:24.657406+0000","last_undegraded":"2024-09-12T18:12:24.657406+0000","last_fullsized":"2024-09-12T18:12:24.657406+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'30","last_scrub_stamp":"2024-09-12T18:12:24.657320+0000","last_deep_scrub":"263'30","last_deep_scrub_stamp":"2024-09-12T18:12:24.657320+0000","last_clean_scrub_stamp":"2024-09-12T18:12:24.657320+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:14:21.792764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":166,"num_read_kb":116,"num_write":53,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":32,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:43.525663+0000","last_change":"2024-09-12T18:12:43.525663+0000","last_active":"2024-09-12T18:12:43.525663+0000","last_peered":"2024-09-12T18:12:43.525663+0000","last_clean":"2024-09-12T18:12:43.525663+0000","last_became_active":"2024-09-12T17:46:57.090477+0000","last_became_peered":"2024-09-12T17:46:57.090477+0000","last_unstale":"2024-09-12T18:12:43.525663+0000","last_undegraded":"2024-09-12T18:12:43.525663+0000","last_fullsized":"2024-09-12T18:12:43.525663+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:43.525568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:43.525568+0000","last_clean_scrub_stamp":"2024-09-12T18:12:43.525568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:43:53.818940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"260'8","reported_seq":65,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:33.515495+0000","last_change":"2024-09-12T18:12:33.515495+0000","last_active":"2024-09-12T18:12:33.515495+0000","last_peered":"2024-09-12T18:12:33.515495+0000","last_clean":"2024-09-12T18:12:33.515495+0000","last_became_active":"2024-09-12T17:30:16.672989+0000","last_became_peered":"2024-09-12T17:30:16.672989+0000","last_unstale":"2024-09-12T18:12:33.515495+0000","last_undegraded":"2024-09-12T18:12:33.515495+0000","last_fullsized":"2024-09-12T18:12:33.515495+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'8","last_scrub_stamp":"2024-09-12T18:12:33.515407+0000","last_deep_scrub":"260'8","last_deep_scrub_stamp":"2024-09-12T18:12:33.515407+0000","last_clean_scrub_stamp":"2024-09-12T18:12:33.515407+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:34:22.751560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":6167,"num_write":13,"num_write_kb":6167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"263'3","reported_seq":63,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:18.515681+0000","last_change":"2024-09-12T18:12:18.515681+0000","last_active":"2024-09-12T18:12:18.515681+0000","last_peered":"2024-09-12T18:12:18.515681+0000","last_clean":"2024-09-12T18:12:18.515681+0000","last_became_active":"2024-09-12T17:30:12.641901+0000","last_became_peered":"2024-09-12T17:30:12.641901+0000","last_unstale":"2024-09-12T18:12:18.515681+0000","last_undegraded":"2024-09-12T18:12:18.515681+0000","last_fullsized":"2024-09-12T18:12:18.515681+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'3","last_scrub_stamp":"2024-09-12T18:12:18.515600+0000","last_deep_scrub":"263'3","last_deep_scrub_stamp":"2024-09-12T18:12:18.515600+0000","last_clean_scrub_stamp":"2024-09-12T18:12:18.515600+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:31:33.540827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"263'9","reported_seq":87,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:23.490308+0000","last_change":"2024-09-12T18:12:23.490308+0000","last_active":"2024-09-12T18:12:23.490308+0000","last_peered":"2024-09-12T18:12:23.490308+0000","last_clean":"2024-09-12T18:12:23.490308+0000","last_became_active":"2024-09-12T17:26:35.655307+0000","last_became_peered":"2024-09-12T17:26:35.655307+0000","last_unstale":"2024-09-12T18:12:23.490308+0000","last_undegraded":"2024-09-12T18:12:23.490308+0000","last_fullsized":"2024-09-12T18:12:23.490308+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'9","last_scrub_stamp":"2024-09-12T18:12:23.490216+0000","last_deep_scrub":"263'9","last_deep_scrub_stamp":"2024-09-12T18:12:23.490216+0000","last_clean_scrub_stamp":"2024-09-12T18:12:23.490216+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:14:25.755383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":30,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"263'2","reported_seq":34,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:40.467227+0000","last_change":"2024-09-12T18:12:40.467227+0000","last_active":"2024-09-12T18:12:40.467227+0000","last_peered":"2024-09-12T18:12:40.467227+0000","last_clean":"2024-09-12T18:12:40.467227+0000","last_became_active":"2024-09-12T17:46:57.086116+0000","last_became_peered":"2024-09-12T17:46:57.086116+0000","last_unstale":"2024-09-12T18:12:40.467227+0000","last_undegraded":"2024-09-12T18:12:40.467227+0000","last_fullsized":"2024-09-12T18:12:40.467227+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T18:12:40.467141+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T18:12:40.467141+0000","last_clean_scrub_stamp":"2024-09-12T18:12:40.467141+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:37:13.536113+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:20.506732+0000","last_change":"2024-09-12T18:12:20.506619+0000","last_active":"2024-09-12T18:12:20.506732+0000","last_peered":"2024-09-12T18:12:20.506732+0000","last_clean":"2024-09-12T18:12:20.506732+0000","last_became_active":"2024-09-12T17:30:16.675243+0000","last_became_peered":"2024-09-12T17:30:16.675243+0000","last_unstale":"2024-09-12T18:12:20.506732+0000","last_undegraded":"2024-09-12T18:12:20.506732+0000","last_fullsized":"2024-09-12T18:12:20.506732+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:20.506497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:20.506497+0000","last_clean_scrub_stamp":"2024-09-12T18:12:20.506497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:52:49.404441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"263'2","reported_seq":59,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:32.721440+0000","last_change":"2024-09-12T18:12:32.721440+0000","last_active":"2024-09-12T18:12:32.721440+0000","last_peered":"2024-09-12T18:12:32.721440+0000","last_clean":"2024-09-12T18:12:32.721440+0000","last_became_active":"2024-09-12T17:30:12.640736+0000","last_became_peered":"2024-09-12T17:30:12.640736+0000","last_unstale":"2024-09-12T18:12:32.721440+0000","last_undegraded":"2024-09-12T18:12:32.721440+0000","last_fullsized":"2024-09-12T18:12:32.721440+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T18:12:32.721349+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T18:12:32.721349+0000","last_clean_scrub_stamp":"2024-09-12T18:12:32.721349+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:35:18.786941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"0'0","reported_seq":64,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:29.690203+0000","last_change":"2024-09-12T18:12:29.690203+0000","last_active":"2024-09-12T18:12:29.690203+0000","last_peered":"2024-09-12T18:12:29.690203+0000","last_clean":"2024-09-12T18:12:29.690203+0000","last_became_active":"2024-09-12T17:26:35.656149+0000","last_became_peered":"2024-09-12T17:26:35.656149+0000","last_unstale":"2024-09-12T18:12:29.690203+0000","last_undegraded":"2024-09-12T18:12:29.690203+0000","last_fullsized":"2024-09-12T18:12:29.690203+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:29.690097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:29.690097+0000","last_clean_scrub_stamp":"2024-09-12T18:12:29.690097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:03:11.925252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":32,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:43.913203+0000","last_change":"2024-09-12T18:12:43.913203+0000","last_active":"2024-09-12T18:12:43.913203+0000","last_peered":"2024-09-12T18:12:43.913203+0000","last_clean":"2024-09-12T18:12:43.913203+0000","last_became_active":"2024-09-12T17:46:57.096375+0000","last_became_peered":"2024-09-12T17:46:57.096375+0000","last_unstale":"2024-09-12T18:12:43.913203+0000","last_undegraded":"2024-09-12T18:12:43.913203+0000","last_fullsized":"2024-09-12T18:12:43.913203+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:43.913107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:43.913107+0000","last_clean_scrub_stamp":"2024-09-12T18:12:43.913107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:38:21.126385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"263'2","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:35.520758+0000","last_change":"2024-09-12T18:12:35.520758+0000","last_active":"2024-09-12T18:12:35.520758+0000","last_peered":"2024-09-12T18:12:35.520758+0000","last_clean":"2024-09-12T18:12:35.520758+0000","last_became_active":"2024-09-12T17:30:16.686562+0000","last_became_peered":"2024-09-12T17:30:16.686562+0000","last_unstale":"2024-09-12T18:12:35.520758+0000","last_undegraded":"2024-09-12T18:12:35.520758+0000","last_fullsized":"2024-09-12T18:12:35.520758+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T18:12:35.520665+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T18:12:35.520665+0000","last_clean_scrub_stamp":"2024-09-12T18:12:35.520665+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:54:02.180539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"263'5","reported_seq":64,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:23.372187+0000","last_change":"2024-09-12T18:12:23.372119+0000","last_active":"2024-09-12T18:12:23.372187+0000","last_peered":"2024-09-12T18:12:23.372187+0000","last_clean":"2024-09-12T18:12:23.372187+0000","last_became_active":"2024-09-12T17:30:12.644490+0000","last_became_peered":"2024-09-12T17:30:12.644490+0000","last_unstale":"2024-09-12T18:12:23.372187+0000","last_undegraded":"2024-09-12T18:12:23.372187+0000","last_fullsized":"2024-09-12T18:12:23.372187+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'5","last_scrub_stamp":"2024-09-12T18:12:23.372029+0000","last_deep_scrub":"263'5","last_deep_scrub_stamp":"2024-09-12T18:12:23.372029+0000","last_clean_scrub_stamp":"2024-09-12T18:12:23.372029+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:38:33.548751+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":9216,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"263'23","reported_seq":124,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:13.553880+0000","last_change":"2024-09-12T18:12:13.553880+0000","last_active":"2024-09-12T18:12:13.553880+0000","last_peered":"2024-09-12T18:12:13.553880+0000","last_clean":"2024-09-12T18:12:13.553880+0000","last_became_active":"2024-09-12T17:26:35.664849+0000","last_became_peered":"2024-09-12T17:26:35.664849+0000","last_unstale":"2024-09-12T18:12:13.553880+0000","last_undegraded":"2024-09-12T18:12:13.553880+0000","last_fullsized":"2024-09-12T18:12:13.553880+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'23","last_scrub_stamp":"2024-09-12T18:12:13.553786+0000","last_deep_scrub":"263'23","last_deep_scrub_stamp":"2024-09-12T18:12:13.553786+0000","last_clean_scrub_stamp":"2024-09-12T18:12:13.553786+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:38:52.170139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":79,"num_write":44,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":33,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:36.483889+0000","last_change":"2024-09-12T18:12:36.483889+0000","last_active":"2024-09-12T18:12:36.483889+0000","last_peered":"2024-09-12T18:12:36.483889+0000","last_clean":"2024-09-12T18:12:36.483889+0000","last_became_active":"2024-09-12T17:46:57.089081+0000","last_became_peered":"2024-09-12T17:46:57.089081+0000","last_unstale":"2024-09-12T18:12:36.483889+0000","last_undegraded":"2024-09-12T18:12:36.483889+0000","last_fullsized":"2024-09-12T18:12:36.483889+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:36.483770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:36.483770+0000","last_clean_scrub_stamp":"2024-09-12T18:12:36.483770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:53:19.930026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"0'0","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:37.797393+0000","last_change":"2024-09-12T18:12:37.797393+0000","last_active":"2024-09-12T18:12:37.797393+0000","last_peered":"2024-09-12T18:12:37.797393+0000","last_clean":"2024-09-12T18:12:37.797393+0000","last_became_active":"2024-09-12T17:30:16.680901+0000","last_became_peered":"2024-09-12T17:30:16.680901+0000","last_unstale":"2024-09-12T18:12:37.797393+0000","last_undegraded":"2024-09-12T18:12:37.797393+0000","last_fullsized":"2024-09-12T18:12:37.797393+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:37.797304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:37.797304+0000","last_clean_scrub_stamp":"2024-09-12T18:12:37.797304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:07:01.249373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"0'0","reported_seq":57,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:28.519123+0000","last_change":"2024-09-12T18:12:28.519123+0000","last_active":"2024-09-12T18:12:28.519123+0000","last_peered":"2024-09-12T18:12:28.519123+0000","last_clean":"2024-09-12T18:12:28.519123+0000","last_became_active":"2024-09-12T17:30:12.648875+0000","last_became_peered":"2024-09-12T17:30:12.648875+0000","last_unstale":"2024-09-12T18:12:28.519123+0000","last_undegraded":"2024-09-12T18:12:28.519123+0000","last_fullsized":"2024-09-12T18:12:28.519123+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:28.519034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:28.519034+0000","last_clean_scrub_stamp":"2024-09-12T18:12:28.519034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:06:37.065827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"263'15","reported_seq":101,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:26.693654+0000","last_change":"2024-09-12T18:12:26.693654+0000","last_active":"2024-09-12T18:12:26.693654+0000","last_peered":"2024-09-12T18:12:26.693654+0000","last_clean":"2024-09-12T18:12:26.693654+0000","last_became_active":"2024-09-12T17:26:35.668118+0000","last_became_peered":"2024-09-12T17:26:35.668118+0000","last_unstale":"2024-09-12T18:12:26.693654+0000","last_undegraded":"2024-09-12T18:12:26.693654+0000","last_fullsized":"2024-09-12T18:12:26.693654+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'15","last_scrub_stamp":"2024-09-12T18:12:26.693556+0000","last_deep_scrub":"263'15","last_deep_scrub_stamp":"2024-09-12T18:12:26.693556+0000","last_clean_scrub_stamp":"2024-09-12T18:12:26.693556+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:18:32.336188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":44,"num_write":31,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":33,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:32.382910+0000","last_change":"2024-09-12T18:12:32.382910+0000","last_active":"2024-09-12T18:12:32.382910+0000","last_peered":"2024-09-12T18:12:32.382910+0000","last_clean":"2024-09-12T18:12:32.382910+0000","last_became_active":"2024-09-12T17:46:57.085922+0000","last_became_peered":"2024-09-12T17:46:57.085922+0000","last_unstale":"2024-09-12T18:12:32.382910+0000","last_undegraded":"2024-09-12T18:12:32.382910+0000","last_fullsized":"2024-09-12T18:12:32.382910+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:32.382795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:32.382795+0000","last_clean_scrub_stamp":"2024-09-12T18:12:32.382795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:49:02.907483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"263'6","reported_seq":61,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:38.842048+0000","last_change":"2024-09-12T18:12:38.842048+0000","last_active":"2024-09-12T18:12:38.842048+0000","last_peered":"2024-09-12T18:12:38.842048+0000","last_clean":"2024-09-12T18:12:38.842048+0000","last_became_active":"2024-09-12T17:30:16.668999+0000","last_became_peered":"2024-09-12T17:30:16.668999+0000","last_unstale":"2024-09-12T18:12:38.842048+0000","last_undegraded":"2024-09-12T18:12:38.842048+0000","last_fullsized":"2024-09-12T18:12:38.842048+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'6","last_scrub_stamp":"2024-09-12T18:12:38.841956+0000","last_deep_scrub":"263'6","last_deep_scrub_stamp":"2024-09-12T18:12:38.841956+0000","last_clean_scrub_stamp":"2024-09-12T18:12:38.841956+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:31:51.252659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":12288,"num_write":11,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"0'0","reported_seq":57,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:09.725063+0000","last_change":"2024-09-12T18:12:09.725063+0000","last_active":"2024-09-12T18:12:09.725063+0000","last_peered":"2024-09-12T18:12:09.725063+0000","last_clean":"2024-09-12T18:12:09.725063+0000","last_became_active":"2024-09-12T17:30:12.649350+0000","last_became_peered":"2024-09-12T17:30:12.649350+0000","last_unstale":"2024-09-12T18:12:09.725063+0000","last_undegraded":"2024-09-12T18:12:09.725063+0000","last_fullsized":"2024-09-12T18:12:09.725063+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:09.724971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:09.724971+0000","last_clean_scrub_stamp":"2024-09-12T18:12:09.724971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:05:18.085102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"263'20","reported_seq":124,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:12.583591+0000","last_change":"2024-09-12T18:12:12.583591+0000","last_active":"2024-09-12T18:12:12.583591+0000","last_peered":"2024-09-12T18:12:12.583591+0000","last_clean":"2024-09-12T18:12:12.583591+0000","last_became_active":"2024-09-12T17:26:35.667060+0000","last_became_peered":"2024-09-12T17:26:35.667060+0000","last_unstale":"2024-09-12T18:12:12.583591+0000","last_undegraded":"2024-09-12T18:12:12.583591+0000","last_fullsized":"2024-09-12T18:12:12.583591+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'20","last_scrub_stamp":"2024-09-12T18:12:12.583489+0000","last_deep_scrub":"263'20","last_deep_scrub_stamp":"2024-09-12T18:12:12.583489+0000","last_clean_scrub_stamp":"2024-09-12T18:12:12.583489+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:09:58.254956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":80,"num_write":36,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":34,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:26.517887+0000","last_change":"2024-09-12T18:12:26.517828+0000","last_active":"2024-09-12T18:12:26.517887+0000","last_peered":"2024-09-12T18:12:26.517887+0000","last_clean":"2024-09-12T18:12:26.517887+0000","last_became_active":"2024-09-12T17:46:57.076358+0000","last_became_peered":"2024-09-12T17:46:57.076358+0000","last_unstale":"2024-09-12T18:12:26.517887+0000","last_undegraded":"2024-09-12T18:12:26.517887+0000","last_fullsized":"2024-09-12T18:12:26.517887+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:26.517736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:26.517736+0000","last_clean_scrub_stamp":"2024-09-12T18:12:26.517736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:52.936894+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"260'3","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:32.554983+0000","last_change":"2024-09-12T18:12:32.554983+0000","last_active":"2024-09-12T18:12:32.554983+0000","last_peered":"2024-09-12T18:12:32.554983+0000","last_clean":"2024-09-12T18:12:32.554983+0000","last_became_active":"2024-09-12T17:30:16.676187+0000","last_became_peered":"2024-09-12T17:30:16.676187+0000","last_unstale":"2024-09-12T18:12:32.554983+0000","last_undegraded":"2024-09-12T18:12:32.554983+0000","last_fullsized":"2024-09-12T18:12:32.554983+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'3","last_scrub_stamp":"2024-09-12T18:12:32.554809+0000","last_deep_scrub":"260'3","last_deep_scrub_stamp":"2024-09-12T18:12:32.554809+0000","last_clean_scrub_stamp":"2024-09-12T18:12:32.554809+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:16:15.966568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"263'5","reported_seq":63,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:26.467226+0000","last_change":"2024-09-12T18:12:26.467226+0000","last_active":"2024-09-12T18:12:26.467226+0000","last_peered":"2024-09-12T18:12:26.467226+0000","last_clean":"2024-09-12T18:12:26.467226+0000","last_became_active":"2024-09-12T17:30:12.651254+0000","last_became_peered":"2024-09-12T17:30:12.651254+0000","last_unstale":"2024-09-12T18:12:26.467226+0000","last_undegraded":"2024-09-12T18:12:26.467226+0000","last_fullsized":"2024-09-12T18:12:26.467226+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'5","last_scrub_stamp":"2024-09-12T18:12:26.467111+0000","last_deep_scrub":"263'5","last_deep_scrub_stamp":"2024-09-12T18:12:26.467111+0000","last_clean_scrub_stamp":"2024-09-12T18:12:26.467111+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:13:46.275560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":16,"num_write":10,"num_write_kb":1040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"263'21","reported_seq":115,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:22.507667+0000","last_change":"2024-09-12T18:12:22.507599+0000","last_active":"2024-09-12T18:12:22.507667+0000","last_peered":"2024-09-12T18:12:22.507667+0000","last_clean":"2024-09-12T18:12:22.507667+0000","last_became_active":"2024-09-12T17:26:35.660521+0000","last_became_peered":"2024-09-12T17:26:35.660521+0000","last_unstale":"2024-09-12T18:12:22.507667+0000","last_undegraded":"2024-09-12T18:12:22.507667+0000","last_fullsized":"2024-09-12T18:12:22.507667+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'21","last_scrub_stamp":"2024-09-12T18:12:22.507515+0000","last_deep_scrub":"263'21","last_deep_scrub_stamp":"2024-09-12T18:12:22.507515+0000","last_clean_scrub_stamp":"2024-09-12T18:12:22.507515+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:47:17.016996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":60,"num_write":47,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":33,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:34.317822+0000","last_change":"2024-09-12T18:12:34.317822+0000","last_active":"2024-09-12T18:12:34.317822+0000","last_peered":"2024-09-12T18:12:34.317822+0000","last_clean":"2024-09-12T18:12:34.317822+0000","last_became_active":"2024-09-12T17:46:57.075936+0000","last_became_peered":"2024-09-12T17:46:57.075936+0000","last_unstale":"2024-09-12T18:12:34.317822+0000","last_undegraded":"2024-09-12T18:12:34.317822+0000","last_fullsized":"2024-09-12T18:12:34.317822+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:34.317721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:34.317721+0000","last_clean_scrub_stamp":"2024-09-12T18:12:34.317721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:11:46.146750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"0'0","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:30.339076+0000","last_change":"2024-09-12T18:12:30.339076+0000","last_active":"2024-09-12T18:12:30.339076+0000","last_peered":"2024-09-12T18:12:30.339076+0000","last_clean":"2024-09-12T18:12:30.339076+0000","last_became_active":"2024-09-12T17:30:16.671232+0000","last_became_peered":"2024-09-12T17:30:16.671232+0000","last_unstale":"2024-09-12T18:12:30.339076+0000","last_undegraded":"2024-09-12T18:12:30.339076+0000","last_fullsized":"2024-09-12T18:12:30.339076+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:30.338974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:30.338974+0000","last_clean_scrub_stamp":"2024-09-12T18:12:30.338974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:15:44.163389+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"260'3","reported_seq":62,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:27.496798+0000","last_change":"2024-09-12T18:12:27.496798+0000","last_active":"2024-09-12T18:12:27.496798+0000","last_peered":"2024-09-12T18:12:27.496798+0000","last_clean":"2024-09-12T18:12:27.496798+0000","last_became_active":"2024-09-12T17:30:12.652439+0000","last_became_peered":"2024-09-12T17:30:12.652439+0000","last_unstale":"2024-09-12T18:12:27.496798+0000","last_undegraded":"2024-09-12T18:12:27.496798+0000","last_fullsized":"2024-09-12T18:12:27.496798+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'3","last_scrub_stamp":"2024-09-12T18:12:27.496698+0000","last_deep_scrub":"260'3","last_deep_scrub_stamp":"2024-09-12T18:12:27.496698+0000","last_clean_scrub_stamp":"2024-09-12T18:12:27.496698+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:52:03.044665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"263'34","reported_seq":153,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:15.511548+0000","last_change":"2024-09-12T18:12:15.511485+0000","last_active":"2024-09-12T18:12:15.511548+0000","last_peered":"2024-09-12T18:12:15.511548+0000","last_clean":"2024-09-12T18:12:15.511548+0000","last_became_active":"2024-09-12T17:26:35.664338+0000","last_became_peered":"2024-09-12T17:26:35.664338+0000","last_unstale":"2024-09-12T18:12:15.511548+0000","last_undegraded":"2024-09-12T18:12:15.511548+0000","last_fullsized":"2024-09-12T18:12:15.511548+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'34","last_scrub_stamp":"2024-09-12T18:12:15.511396+0000","last_deep_scrub":"263'34","last_deep_scrub_stamp":"2024-09-12T18:12:15.511396+0000","last_clean_scrub_stamp":"2024-09-12T18:12:15.511396+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:16:09.172708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":161,"num_read_kb":109,"num_write":67,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"263'2","reported_seq":35,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:15.758643+0000","last_change":"2024-09-12T18:12:15.758583+0000","last_active":"2024-09-12T18:12:15.758643+0000","last_peered":"2024-09-12T18:12:15.758643+0000","last_clean":"2024-09-12T18:12:15.758643+0000","last_became_active":"2024-09-12T17:46:57.090581+0000","last_became_peered":"2024-09-12T17:46:57.090581+0000","last_unstale":"2024-09-12T18:12:15.758643+0000","last_undegraded":"2024-09-12T18:12:15.758643+0000","last_fullsized":"2024-09-12T18:12:15.758643+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T18:12:15.758494+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T18:12:15.758494+0000","last_clean_scrub_stamp":"2024-09-12T18:12:15.758494+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:09:12.754977+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"260'3","reported_seq":57,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:21.525649+0000","last_change":"2024-09-12T18:12:21.525649+0000","last_active":"2024-09-12T18:12:21.525649+0000","last_peered":"2024-09-12T18:12:21.525649+0000","last_clean":"2024-09-12T18:12:21.525649+0000","last_became_active":"2024-09-12T17:30:16.677428+0000","last_became_peered":"2024-09-12T17:30:16.677428+0000","last_unstale":"2024-09-12T18:12:21.525649+0000","last_undegraded":"2024-09-12T18:12:21.525649+0000","last_fullsized":"2024-09-12T18:12:21.525649+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'3","last_scrub_stamp":"2024-09-12T18:12:21.525552+0000","last_deep_scrub":"260'3","last_deep_scrub_stamp":"2024-09-12T18:12:21.525552+0000","last_clean_scrub_stamp":"2024-09-12T18:12:21.525552+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:59:26.387358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"263'6","reported_seq":68,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:25.484988+0000","last_change":"2024-09-12T18:12:25.484988+0000","last_active":"2024-09-12T18:12:25.484988+0000","last_peered":"2024-09-12T18:12:25.484988+0000","last_clean":"2024-09-12T18:12:25.484988+0000","last_became_active":"2024-09-12T17:30:12.644600+0000","last_became_peered":"2024-09-12T17:30:12.644600+0000","last_unstale":"2024-09-12T18:12:25.484988+0000","last_undegraded":"2024-09-12T18:12:25.484988+0000","last_fullsized":"2024-09-12T18:12:25.484988+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'6","last_scrub_stamp":"2024-09-12T18:12:25.484902+0000","last_deep_scrub":"263'6","last_deep_scrub_stamp":"2024-09-12T18:12:25.484902+0000","last_clean_scrub_stamp":"2024-09-12T18:12:25.484902+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:53:26.323510+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6144,"num_write":11,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"263'63","reported_seq":241,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:24.411880+0000","last_change":"2024-09-12T18:12:24.411785+0000","last_active":"2024-09-12T18:12:24.411880+0000","last_peered":"2024-09-12T18:12:24.411880+0000","last_clean":"2024-09-12T18:12:24.411880+0000","last_became_active":"2024-09-12T17:26:35.658630+0000","last_became_peered":"2024-09-12T17:26:35.658630+0000","last_unstale":"2024-09-12T18:12:24.411880+0000","last_undegraded":"2024-09-12T18:12:24.411880+0000","last_fullsized":"2024-09-12T18:12:24.411880+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'63","last_scrub_stamp":"2024-09-12T18:12:24.411691+0000","last_deep_scrub":"263'63","last_deep_scrub_stamp":"2024-09-12T18:12:24.411691+0000","last_clean_scrub_stamp":"2024-09-12T18:12:24.411691+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:24:29.577243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":336,"num_read_kb":235,"num_write":105,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":33,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:41.853275+0000","last_change":"2024-09-12T18:12:41.853221+0000","last_active":"2024-09-12T18:12:41.853275+0000","last_peered":"2024-09-12T18:12:41.853275+0000","last_clean":"2024-09-12T18:12:41.853275+0000","last_became_active":"2024-09-12T17:46:57.092472+0000","last_became_peered":"2024-09-12T17:46:57.092472+0000","last_unstale":"2024-09-12T18:12:41.853275+0000","last_undegraded":"2024-09-12T18:12:41.853275+0000","last_fullsized":"2024-09-12T18:12:41.853275+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:41.853124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:41.853124+0000","last_clean_scrub_stamp":"2024-09-12T18:12:41.853124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:12:24.119919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"0'0","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:29.421303+0000","last_change":"2024-09-12T18:12:29.421247+0000","last_active":"2024-09-12T18:12:29.421303+0000","last_peered":"2024-09-12T18:12:29.421303+0000","last_clean":"2024-09-12T18:12:29.421303+0000","last_became_active":"2024-09-12T17:30:16.675380+0000","last_became_peered":"2024-09-12T17:30:16.675380+0000","last_unstale":"2024-09-12T18:12:29.421303+0000","last_undegraded":"2024-09-12T18:12:29.421303+0000","last_fullsized":"2024-09-12T18:12:29.421303+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:29.421158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:29.421158+0000","last_clean_scrub_stamp":"2024-09-12T18:12:29.421158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:25:59.499092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"0'0","reported_seq":57,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:26.481990+0000","last_change":"2024-09-12T18:12:26.481990+0000","last_active":"2024-09-12T18:12:26.481990+0000","last_peered":"2024-09-12T18:12:26.481990+0000","last_clean":"2024-09-12T18:12:26.481990+0000","last_became_active":"2024-09-12T17:30:12.652368+0000","last_became_peered":"2024-09-12T17:30:12.652368+0000","last_unstale":"2024-09-12T18:12:26.481990+0000","last_undegraded":"2024-09-12T18:12:26.481990+0000","last_fullsized":"2024-09-12T18:12:26.481990+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:26.481900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:26.481900+0000","last_clean_scrub_stamp":"2024-09-12T18:12:26.481900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:51:44.532135+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"263'14","reported_seq":101,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:22.323445+0000","last_change":"2024-09-12T18:12:22.323379+0000","last_active":"2024-09-12T18:12:22.323445+0000","last_peered":"2024-09-12T18:12:22.323445+0000","last_clean":"2024-09-12T18:12:22.323445+0000","last_became_active":"2024-09-12T17:26:35.662029+0000","last_became_peered":"2024-09-12T17:26:35.662029+0000","last_unstale":"2024-09-12T18:12:22.323445+0000","last_undegraded":"2024-09-12T18:12:22.323445+0000","last_fullsized":"2024-09-12T18:12:22.323445+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'14","last_scrub_stamp":"2024-09-12T18:12:22.323289+0000","last_deep_scrub":"263'14","last_deep_scrub_stamp":"2024-09-12T18:12:22.323289+0000","last_clean_scrub_stamp":"2024-09-12T18:12:22.323289+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:47:18.514415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":47,"num_write":25,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":33,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:42.903067+0000","last_change":"2024-09-12T18:12:42.903067+0000","last_active":"2024-09-12T18:12:42.903067+0000","last_peered":"2024-09-12T18:12:42.903067+0000","last_clean":"2024-09-12T18:12:42.903067+0000","last_became_active":"2024-09-12T17:46:57.088577+0000","last_became_peered":"2024-09-12T17:46:57.088577+0000","last_unstale":"2024-09-12T18:12:42.903067+0000","last_undegraded":"2024-09-12T18:12:42.903067+0000","last_fullsized":"2024-09-12T18:12:42.903067+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:42.902976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:42.902976+0000","last_clean_scrub_stamp":"2024-09-12T18:12:42.902976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:15:41.252575+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"263'5","reported_seq":61,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:18.654230+0000","last_change":"2024-09-12T18:12:18.654230+0000","last_active":"2024-09-12T18:12:18.654230+0000","last_peered":"2024-09-12T18:12:18.654230+0000","last_clean":"2024-09-12T18:12:18.654230+0000","last_became_active":"2024-09-12T17:30:16.687560+0000","last_became_peered":"2024-09-12T17:30:16.687560+0000","last_unstale":"2024-09-12T18:12:18.654230+0000","last_undegraded":"2024-09-12T18:12:18.654230+0000","last_fullsized":"2024-09-12T18:12:18.654230+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'5","last_scrub_stamp":"2024-09-12T18:12:18.654153+0000","last_deep_scrub":"263'5","last_deep_scrub_stamp":"2024-09-12T18:12:18.654153+0000","last_clean_scrub_stamp":"2024-09-12T18:12:18.654153+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:46:55.281106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":15360,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"260'5","reported_seq":72,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:17.476656+0000","last_change":"2024-09-12T18:12:17.476656+0000","last_active":"2024-09-12T18:12:17.476656+0000","last_peered":"2024-09-12T18:12:17.476656+0000","last_clean":"2024-09-12T18:12:17.476656+0000","last_became_active":"2024-09-12T17:30:12.646002+0000","last_became_peered":"2024-09-12T17:30:12.646002+0000","last_unstale":"2024-09-12T18:12:17.476656+0000","last_undegraded":"2024-09-12T18:12:17.476656+0000","last_fullsized":"2024-09-12T18:12:17.476656+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'5","last_scrub_stamp":"2024-09-12T18:12:17.476540+0000","last_deep_scrub":"260'5","last_deep_scrub_stamp":"2024-09-12T18:12:17.476540+0000","last_clean_scrub_stamp":"2024-09-12T18:12:17.476540+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:48:06.819743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"263'38","reported_seq":171,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:11.616871+0000","last_change":"2024-09-12T18:12:11.616755+0000","last_active":"2024-09-12T18:12:11.616871+0000","last_peered":"2024-09-12T18:12:11.616871+0000","last_clean":"2024-09-12T18:12:11.616871+0000","last_became_active":"2024-09-12T17:26:35.664653+0000","last_became_peered":"2024-09-12T17:26:35.664653+0000","last_unstale":"2024-09-12T18:12:11.616871+0000","last_undegraded":"2024-09-12T18:12:11.616871+0000","last_fullsized":"2024-09-12T18:12:11.616871+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'38","last_scrub_stamp":"2024-09-12T18:12:11.616608+0000","last_deep_scrub":"263'38","last_deep_scrub_stamp":"2024-09-12T18:12:11.616608+0000","last_clean_scrub_stamp":"2024-09-12T18:12:11.616608+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:41:05.918325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":203,"num_read_kb":159,"num_write":60,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":33,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:37.436361+0000","last_change":"2024-09-12T18:12:37.436361+0000","last_active":"2024-09-12T18:12:37.436361+0000","last_peered":"2024-09-12T18:12:37.436361+0000","last_clean":"2024-09-12T18:12:37.436361+0000","last_became_active":"2024-09-12T17:46:57.091489+0000","last_became_peered":"2024-09-12T17:46:57.091489+0000","last_unstale":"2024-09-12T18:12:37.436361+0000","last_undegraded":"2024-09-12T18:12:37.436361+0000","last_fullsized":"2024-09-12T18:12:37.436361+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:37.436249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:37.436249+0000","last_clean_scrub_stamp":"2024-09-12T18:12:37.436249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:04:14.746893+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"263'2","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:29.360574+0000","last_change":"2024-09-12T18:12:29.360574+0000","last_active":"2024-09-12T18:12:29.360574+0000","last_peered":"2024-09-12T18:12:29.360574+0000","last_clean":"2024-09-12T18:12:29.360574+0000","last_became_active":"2024-09-12T17:30:16.671126+0000","last_became_peered":"2024-09-12T17:30:16.671126+0000","last_unstale":"2024-09-12T18:12:29.360574+0000","last_undegraded":"2024-09-12T18:12:29.360574+0000","last_fullsized":"2024-09-12T18:12:29.360574+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T18:12:29.360472+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T18:12:29.360472+0000","last_clean_scrub_stamp":"2024-09-12T18:12:29.360472+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:17:20.676962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":48,"num_write":2,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"260'3","reported_seq":63,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:16.609368+0000","last_change":"2024-09-12T18:12:16.609368+0000","last_active":"2024-09-12T18:12:16.609368+0000","last_peered":"2024-09-12T18:12:16.609368+0000","last_clean":"2024-09-12T18:12:16.609368+0000","last_became_active":"2024-09-12T17:30:12.645099+0000","last_became_peered":"2024-09-12T17:30:12.645099+0000","last_unstale":"2024-09-12T18:12:16.609368+0000","last_undegraded":"2024-09-12T18:12:16.609368+0000","last_fullsized":"2024-09-12T18:12:16.609368+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'3","last_scrub_stamp":"2024-09-12T18:12:16.609282+0000","last_deep_scrub":"260'3","last_deep_scrub_stamp":"2024-09-12T18:12:16.609282+0000","last_clean_scrub_stamp":"2024-09-12T18:12:16.609282+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:11:33.924154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"263'42","reported_seq":176,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:21.512810+0000","last_change":"2024-09-12T18:12:21.512736+0000","last_active":"2024-09-12T18:12:21.512810+0000","last_peered":"2024-09-12T18:12:21.512810+0000","last_clean":"2024-09-12T18:12:21.512810+0000","last_became_active":"2024-09-12T17:26:35.665804+0000","last_became_peered":"2024-09-12T17:26:35.665804+0000","last_unstale":"2024-09-12T18:12:21.512810+0000","last_undegraded":"2024-09-12T18:12:21.512810+0000","last_fullsized":"2024-09-12T18:12:21.512810+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'42","last_scrub_stamp":"2024-09-12T18:12:21.512648+0000","last_deep_scrub":"263'42","last_deep_scrub_stamp":"2024-09-12T18:12:21.512648+0000","last_clean_scrub_stamp":"2024-09-12T18:12:21.512648+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:22:38.597683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":202,"num_read_kb":139,"num_write":84,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"263'208","reported_seq":819,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:00.542681+0000","last_change":"2024-09-12T18:12:00.542681+0000","last_active":"2024-09-12T18:12:00.542681+0000","last_peered":"2024-09-12T18:12:00.542681+0000","last_clean":"2024-09-12T18:12:00.542681+0000","last_became_active":"2024-09-12T17:10:42.523450+0000","last_became_peered":"2024-09-12T17:10:42.523450+0000","last_unstale":"2024-09-12T18:12:00.542681+0000","last_undegraded":"2024-09-12T18:12:00.542681+0000","last_fullsized":"2024-09-12T18:12:00.542681+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'208","last_scrub_stamp":"2024-09-12T18:12:00.542555+0000","last_deep_scrub":"263'208","last_deep_scrub_stamp":"2024-09-12T18:12:00.542555+0000","last_clean_scrub_stamp":"2024-09-12T18:12:00.542555+0000","objects_scrubbed":4,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:08:21.396379+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2159819,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":364,"num_read_kb":12797,"num_write":994,"num_write_kb":38748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0,5],"acting":[7,6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"263'415","reported_seq":1937,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:58.360923+0000","last_change":"2024-09-12T18:11:58.360923+0000","last_active":"2024-09-12T18:11:58.360923+0000","last_peered":"2024-09-12T18:11:58.360923+0000","last_clean":"2024-09-12T18:11:58.360923+0000","last_became_active":"2024-09-12T17:10:44.521072+0000","last_became_peered":"2024-09-12T17:10:44.521072+0000","last_unstale":"2024-09-12T18:11:58.360923+0000","last_undegraded":"2024-09-12T18:11:58.360923+0000","last_fullsized":"2024-09-12T18:11:58.360923+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'415","last_scrub_stamp":"2024-09-12T18:11:58.360809+0000","last_deep_scrub":"263'415","last_deep_scrub_stamp":"2024-09-12T18:11:58.360809+0000","last_clean_scrub_stamp":"2024-09-12T18:11:58.360809+0000","objects_scrubbed":7,"log_size":15,"log_dups_size":400,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:24:00.846126+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2237,"num_read_kb":2119,"num_write":474,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1856,"num_omap_keys":8,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"263'162","reported_seq":806,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:51.665824+0000","last_change":"2024-09-12T18:11:51.665824+0000","last_active":"2024-09-12T18:11:51.665824+0000","last_peered":"2024-09-12T18:11:51.665824+0000","last_clean":"2024-09-12T18:11:51.665824+0000","last_became_active":"2024-09-12T17:10:42.515714+0000","last_became_peered":"2024-09-12T17:10:42.515714+0000","last_unstale":"2024-09-12T18:11:51.665824+0000","last_undegraded":"2024-09-12T18:11:51.665824+0000","last_fullsized":"2024-09-12T18:11:51.665824+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'162","last_scrub_stamp":"2024-09-12T18:11:51.665727+0000","last_deep_scrub":"263'162","last_deep_scrub_stamp":"2024-09-12T18:11:51.665727+0000","last_clean_scrub_stamp":"2024-09-12T18:11:51.665727+0000","objects_scrubbed":1,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:41:53.425835+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32998,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":410,"num_read_kb":24642,"num_write":804,"num_write_kb":5824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6,4],"acting":[1,0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"263'569","reported_seq":2045,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:04.589219+0000","last_change":"2024-09-12T18:12:04.589219+0000","last_active":"2024-09-12T18:12:04.589219+0000","last_peered":"2024-09-12T18:12:04.589219+0000","last_clean":"2024-09-12T18:12:04.589219+0000","last_became_active":"2024-09-12T17:10:44.520662+0000","last_became_peered":"2024-09-12T17:10:44.520662+0000","last_unstale":"2024-09-12T18:12:04.589219+0000","last_undegraded":"2024-09-12T18:12:04.589219+0000","last_fullsized":"2024-09-12T18:12:04.589219+0000","mapping_epoch":26,"log_start":"263'500","ondisk_log_start":"263'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'569","last_scrub_stamp":"2024-09-12T18:12:04.589126+0000","last_deep_scrub":"263'569","last_deep_scrub_stamp":"2024-09-12T18:12:04.589126+0000","last_clean_scrub_stamp":"2024-09-12T18:12:04.589126+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":500,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:21:58.586995+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2846,"num_read_kb":2568,"num_write":745,"num_write_kb":247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"263'196","reported_seq":890,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:52.688218+0000","last_change":"2024-09-12T18:11:52.688218+0000","last_active":"2024-09-12T18:11:52.688218+0000","last_peered":"2024-09-12T18:11:52.688218+0000","last_clean":"2024-09-12T18:11:52.688218+0000","last_became_active":"2024-09-12T17:10:42.514502+0000","last_became_peered":"2024-09-12T17:10:42.514502+0000","last_unstale":"2024-09-12T18:11:52.688218+0000","last_undegraded":"2024-09-12T18:11:52.688218+0000","last_fullsized":"2024-09-12T18:11:52.688218+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'196","last_scrub_stamp":"2024-09-12T18:11:52.688106+0000","last_deep_scrub":"263'196","last_deep_scrub_stamp":"2024-09-12T18:11:52.688106+0000","last_clean_scrub_stamp":"2024-09-12T18:11:52.688106+0000","objects_scrubbed":4,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:28:08.638670+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":373080,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":506,"num_read_kb":116995,"num_write":945,"num_write_kb":47431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,7],"acting":[0,2,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"263'513","reported_seq":2203,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:03.347220+0000","last_change":"2024-09-12T18:12:03.347220+0000","last_active":"2024-09-12T18:12:03.347220+0000","last_peered":"2024-09-12T18:12:03.347220+0000","last_clean":"2024-09-12T18:12:03.347220+0000","last_became_active":"2024-09-12T17:10:44.515053+0000","last_became_peered":"2024-09-12T17:10:44.515053+0000","last_unstale":"2024-09-12T18:12:03.347220+0000","last_undegraded":"2024-09-12T18:12:03.347220+0000","last_fullsized":"2024-09-12T18:12:03.347220+0000","mapping_epoch":26,"log_start":"263'501","ondisk_log_start":"263'501","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'513","last_scrub_stamp":"2024-09-12T18:12:03.347112+0000","last_deep_scrub":"263'513","last_deep_scrub_stamp":"2024-09-12T18:12:03.347112+0000","last_clean_scrub_stamp":"2024-09-12T18:12:03.347112+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":501,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:41:45.556810+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2823,"num_read_kb":2642,"num_write":595,"num_write_kb":151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2296,"num_omap_keys":9,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"263'186","reported_seq":820,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:59.404178+0000","last_change":"2024-09-12T18:11:59.404105+0000","last_active":"2024-09-12T18:11:59.404178+0000","last_peered":"2024-09-12T18:11:59.404178+0000","last_clean":"2024-09-12T18:11:59.404178+0000","last_became_active":"2024-09-12T17:10:42.515202+0000","last_became_peered":"2024-09-12T17:10:42.515202+0000","last_unstale":"2024-09-12T18:11:59.404178+0000","last_undegraded":"2024-09-12T18:11:59.404178+0000","last_fullsized":"2024-09-12T18:11:59.404178+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'186","last_scrub_stamp":"2024-09-12T18:11:59.403938+0000","last_deep_scrub":"263'186","last_deep_scrub_stamp":"2024-09-12T18:11:59.403938+0000","last_clean_scrub_stamp":"2024-09-12T18:11:59.403938+0000","objects_scrubbed":4,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:01:41.301225+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":568149,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":399,"num_read_kb":32737,"num_write":933,"num_write_kb":40819,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7,2],"acting":[5,3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"263'479","reported_seq":2065,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:01.687961+0000","last_change":"2024-09-12T18:12:01.687961+0000","last_active":"2024-09-12T18:12:01.687961+0000","last_peered":"2024-09-12T18:12:01.687961+0000","last_clean":"2024-09-12T18:12:01.687961+0000","last_became_active":"2024-09-12T17:10:44.523767+0000","last_became_peered":"2024-09-12T17:10:44.523767+0000","last_unstale":"2024-09-12T18:12:01.687961+0000","last_undegraded":"2024-09-12T18:12:01.687961+0000","last_fullsized":"2024-09-12T18:12:01.687961+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'479","last_scrub_stamp":"2024-09-12T18:12:01.687869+0000","last_deep_scrub":"263'479","last_deep_scrub_stamp":"2024-09-12T18:12:01.687869+0000","last_clean_scrub_stamp":"2024-09-12T18:12:01.687869+0000","objects_scrubbed":2,"log_size":79,"log_dups_size":400,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:06:43.686298+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2572,"num_read_kb":2417,"num_write":590,"num_write_kb":142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":254,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"263'159","reported_seq":798,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:59.549642+0000","last_change":"2024-09-12T18:11:59.549642+0000","last_active":"2024-09-12T18:11:59.549642+0000","last_peered":"2024-09-12T18:11:59.549642+0000","last_clean":"2024-09-12T18:11:59.549642+0000","last_became_active":"2024-09-12T17:10:42.523427+0000","last_became_peered":"2024-09-12T17:10:42.523427+0000","last_unstale":"2024-09-12T18:11:59.549642+0000","last_undegraded":"2024-09-12T18:11:59.549642+0000","last_fullsized":"2024-09-12T18:11:59.549642+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'159","last_scrub_stamp":"2024-09-12T18:11:59.549547+0000","last_deep_scrub":"263'159","last_deep_scrub_stamp":"2024-09-12T18:11:59.549547+0000","last_clean_scrub_stamp":"2024-09-12T18:11:59.549547+0000","objects_scrubbed":1,"log_size":59,"log_dups_size":100,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:28:15.459977+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":439,"num_read_kb":36335,"num_write":769,"num_write_kb":30424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3,6],"acting":[7,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"263'478","reported_seq":1971,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:58.695660+0000","last_change":"2024-09-12T18:11:58.695565+0000","last_active":"2024-09-12T18:11:58.695660+0000","last_peered":"2024-09-12T18:11:58.695660+0000","last_clean":"2024-09-12T18:11:58.695660+0000","last_became_active":"2024-09-12T17:10:44.510692+0000","last_became_peered":"2024-09-12T17:10:44.510692+0000","last_unstale":"2024-09-12T18:11:58.695660+0000","last_undegraded":"2024-09-12T18:11:58.695660+0000","last_fullsized":"2024-09-12T18:11:58.695660+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'478","last_scrub_stamp":"2024-09-12T18:11:58.695474+0000","last_deep_scrub":"263'478","last_deep_scrub_stamp":"2024-09-12T18:11:58.695474+0000","last_clean_scrub_stamp":"2024-09-12T18:11:58.695474+0000","objects_scrubbed":3,"log_size":78,"log_dups_size":400,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:52:06.977144+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2639,"num_read_kb":2478,"num_write":625,"num_write_kb":223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"263'191","reported_seq":825,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:05.484339+0000","last_change":"2024-09-12T18:12:05.484339+0000","last_active":"2024-09-12T18:12:05.484339+0000","last_peered":"2024-09-12T18:12:05.484339+0000","last_clean":"2024-09-12T18:12:05.484339+0000","last_became_active":"2024-09-12T17:10:42.525363+0000","last_became_peered":"2024-09-12T17:10:42.525363+0000","last_unstale":"2024-09-12T18:12:05.484339+0000","last_undegraded":"2024-09-12T18:12:05.484339+0000","last_fullsized":"2024-09-12T18:12:05.484339+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'191","last_scrub_stamp":"2024-09-12T18:12:05.484216+0000","last_deep_scrub":"263'191","last_deep_scrub_stamp":"2024-09-12T18:12:05.484216+0000","last_clean_scrub_stamp":"2024-09-12T18:12:05.484216+0000","objects_scrubbed":2,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:44:31.631500+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":412,"num_read_kb":34311,"num_write":954,"num_write_kb":12654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,4,1],"acting":[5,0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"263'881","reported_seq":2669,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:05.371197+0000","last_change":"2024-09-12T18:12:05.371197+0000","last_active":"2024-09-12T18:12:05.371197+0000","last_peered":"2024-09-12T18:12:05.371197+0000","last_clean":"2024-09-12T18:12:05.371197+0000","last_became_active":"2024-09-12T17:10:44.513865+0000","last_became_peered":"2024-09-12T17:10:44.513865+0000","last_unstale":"2024-09-12T18:12:05.371197+0000","last_undegraded":"2024-09-12T18:12:05.371197+0000","last_fullsized":"2024-09-12T18:12:05.371197+0000","mapping_epoch":26,"log_start":"263'800","ondisk_log_start":"263'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'881","last_scrub_stamp":"2024-09-12T18:12:05.371101+0000","last_deep_scrub":"263'881","last_deep_scrub_stamp":"2024-09-12T18:12:05.371101+0000","last_clean_scrub_stamp":"2024-09-12T18:12:05.371101+0000","objects_scrubbed":6,"log_size":81,"log_dups_size":800,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:17:06.281251+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4549,"num_read_kb":4126,"num_write":1137,"num_write_kb":421,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4852,"num_omap_keys":19,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"263'191","reported_seq":997,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:57.497338+0000","last_change":"2024-09-12T18:11:57.497338+0000","last_active":"2024-09-12T18:11:57.497338+0000","last_peered":"2024-09-12T18:11:57.497338+0000","last_clean":"2024-09-12T18:11:57.497338+0000","last_became_active":"2024-09-12T17:10:42.531356+0000","last_became_peered":"2024-09-12T17:10:42.531356+0000","last_unstale":"2024-09-12T18:11:57.497338+0000","last_undegraded":"2024-09-12T18:11:57.497338+0000","last_fullsized":"2024-09-12T18:11:57.497338+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'191","last_scrub_stamp":"2024-09-12T18:11:57.497214+0000","last_deep_scrub":"263'191","last_deep_scrub_stamp":"2024-09-12T18:11:57.497214+0000","last_clean_scrub_stamp":"2024-09-12T18:11:57.497214+0000","objects_scrubbed":6,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:44:43.318908+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":115,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":751,"num_read_kb":2366,"num_write":954,"num_write_kb":15239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4,6],"acting":[7,0,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"263'411","reported_seq":1935,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:06.455513+0000","last_change":"2024-09-12T18:12:06.455513+0000","last_active":"2024-09-12T18:12:06.455513+0000","last_peered":"2024-09-12T18:12:06.455513+0000","last_clean":"2024-09-12T18:12:06.455513+0000","last_became_active":"2024-09-12T17:10:44.520609+0000","last_became_peered":"2024-09-12T17:10:44.520609+0000","last_unstale":"2024-09-12T18:12:06.455513+0000","last_undegraded":"2024-09-12T18:12:06.455513+0000","last_fullsized":"2024-09-12T18:12:06.455513+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'411","last_scrub_stamp":"2024-09-12T18:12:06.455433+0000","last_deep_scrub":"263'411","last_deep_scrub_stamp":"2024-09-12T18:12:06.455433+0000","last_clean_scrub_stamp":"2024-09-12T18:12:06.455433+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":400,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:56:48.523620+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2177,"num_read_kb":2069,"num_write":470,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"263'212","reported_seq":854,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:00.692167+0000","last_change":"2024-09-12T18:12:00.692167+0000","last_active":"2024-09-12T18:12:00.692167+0000","last_peered":"2024-09-12T18:12:00.692167+0000","last_clean":"2024-09-12T18:12:00.692167+0000","last_became_active":"2024-09-12T17:10:42.527310+0000","last_became_peered":"2024-09-12T17:10:42.527310+0000","last_unstale":"2024-09-12T18:12:00.692167+0000","last_undegraded":"2024-09-12T18:12:00.692167+0000","last_fullsized":"2024-09-12T18:12:00.692167+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'212","last_scrub_stamp":"2024-09-12T18:12:00.692062+0000","last_deep_scrub":"263'212","last_deep_scrub_stamp":"2024-09-12T18:12:00.692062+0000","last_clean_scrub_stamp":"2024-09-12T18:12:00.692062+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:26:48.984760+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174892,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":472,"num_read_kb":11982,"num_write":996,"num_write_kb":39362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0,2],"acting":[3,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"263'806","reported_seq":2480,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:54.804326+0000","last_change":"2024-09-12T18:11:54.804326+0000","last_active":"2024-09-12T18:11:54.804326+0000","last_peered":"2024-09-12T18:11:54.804326+0000","last_clean":"2024-09-12T18:11:54.804326+0000","last_became_active":"2024-09-12T17:10:44.517947+0000","last_became_peered":"2024-09-12T17:10:44.517947+0000","last_unstale":"2024-09-12T18:11:54.804326+0000","last_undegraded":"2024-09-12T18:11:54.804326+0000","last_fullsized":"2024-09-12T18:11:54.804326+0000","mapping_epoch":26,"log_start":"263'700","ondisk_log_start":"263'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'806","last_scrub_stamp":"2024-09-12T18:11:54.804222+0000","last_deep_scrub":"263'806","last_deep_scrub_stamp":"2024-09-12T18:11:54.804222+0000","last_clean_scrub_stamp":"2024-09-12T18:11:54.804222+0000","objects_scrubbed":3,"log_size":106,"log_dups_size":700,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:45:37.385194+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3878,"num_read_kb":3536,"num_write":1022,"num_write_kb":342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"263'408","reported_seq":2034,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:02.306451+0000","last_change":"2024-09-12T18:12:02.306451+0000","last_active":"2024-09-12T18:12:02.306451+0000","last_peered":"2024-09-12T18:12:02.306451+0000","last_clean":"2024-09-12T18:12:02.306451+0000","last_became_active":"2024-09-12T17:10:44.514293+0000","last_became_peered":"2024-09-12T17:10:44.514293+0000","last_unstale":"2024-09-12T18:12:02.306451+0000","last_undegraded":"2024-09-12T18:12:02.306451+0000","last_fullsized":"2024-09-12T18:12:02.306451+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'408","last_scrub_stamp":"2024-09-12T18:12:02.306349+0000","last_deep_scrub":"263'408","last_deep_scrub_stamp":"2024-09-12T18:12:02.306349+0000","last_clean_scrub_stamp":"2024-09-12T18:12:02.306349+0000","objects_scrubbed":2,"log_size":108,"log_dups_size":300,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:44:20.245957+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2470,"num_read_kb":2366,"num_write":468,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":694,"num_omap_keys":3,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"263'164","reported_seq":785,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:56.470083+0000","last_change":"2024-09-12T18:11:56.470083+0000","last_active":"2024-09-12T18:11:56.470083+0000","last_peered":"2024-09-12T18:11:56.470083+0000","last_clean":"2024-09-12T18:11:56.470083+0000","last_became_active":"2024-09-12T17:10:42.521637+0000","last_became_peered":"2024-09-12T17:10:42.521637+0000","last_unstale":"2024-09-12T18:11:56.470083+0000","last_undegraded":"2024-09-12T18:11:56.470083+0000","last_fullsized":"2024-09-12T18:11:56.470083+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'164","last_scrub_stamp":"2024-09-12T18:11:56.469937+0000","last_deep_scrub":"263'164","last_deep_scrub_stamp":"2024-09-12T18:11:56.469937+0000","last_clean_scrub_stamp":"2024-09-12T18:11:56.469937+0000","objects_scrubbed":5,"log_size":64,"log_dups_size":100,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:47:38.556900+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":432508,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":446,"num_read_kb":17329,"num_write":806,"num_write_kb":49238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0,1],"acting":[7,5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"263'785","reported_seq":2287,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:03.615335+0000","last_change":"2024-09-12T18:12:03.615335+0000","last_active":"2024-09-12T18:12:03.615335+0000","last_peered":"2024-09-12T18:12:03.615335+0000","last_clean":"2024-09-12T18:12:03.615335+0000","last_became_active":"2024-09-12T17:10:44.521031+0000","last_became_peered":"2024-09-12T17:10:44.521031+0000","last_unstale":"2024-09-12T18:12:03.615335+0000","last_undegraded":"2024-09-12T18:12:03.615335+0000","last_fullsized":"2024-09-12T18:12:03.615335+0000","mapping_epoch":26,"log_start":"263'700","ondisk_log_start":"263'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'785","last_scrub_stamp":"2024-09-12T18:12:03.615200+0000","last_deep_scrub":"263'785","last_deep_scrub_stamp":"2024-09-12T18:12:03.615200+0000","last_clean_scrub_stamp":"2024-09-12T18:12:03.615200+0000","objects_scrubbed":3,"log_size":85,"log_dups_size":700,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:57:53.084717+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3604,"num_read_kb":3242,"num_write":1018,"num_write_kb":360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"263'259","reported_seq":960,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:53.798419+0000","last_change":"2024-09-12T18:11:53.798419+0000","last_active":"2024-09-12T18:11:53.798419+0000","last_peered":"2024-09-12T18:11:53.798419+0000","last_clean":"2024-09-12T18:11:53.798419+0000","last_became_active":"2024-09-12T17:10:42.517679+0000","last_became_peered":"2024-09-12T17:10:42.517679+0000","last_unstale":"2024-09-12T18:11:53.798419+0000","last_undegraded":"2024-09-12T18:11:53.798419+0000","last_fullsized":"2024-09-12T18:11:53.798419+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'259","last_scrub_stamp":"2024-09-12T18:11:53.798287+0000","last_deep_scrub":"263'259","last_deep_scrub_stamp":"2024-09-12T18:11:53.798287+0000","last_clean_scrub_stamp":"2024-09-12T18:11:53.798287+0000","objects_scrubbed":4,"log_size":59,"log_dups_size":200,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:05.021160+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1604218,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":855,"num_read_kb":4303,"num_write":1129,"num_write_kb":28670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2,1],"acting":[6,5,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"263'359","reported_seq":1821,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:01.415160+0000","last_change":"2024-09-12T18:12:01.415160+0000","last_active":"2024-09-12T18:12:01.415160+0000","last_peered":"2024-09-12T18:12:01.415160+0000","last_clean":"2024-09-12T18:12:01.415160+0000","last_became_active":"2024-09-12T17:10:44.518183+0000","last_became_peered":"2024-09-12T17:10:44.518183+0000","last_unstale":"2024-09-12T18:12:01.415160+0000","last_undegraded":"2024-09-12T18:12:01.415160+0000","last_fullsized":"2024-09-12T18:12:01.415160+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'359","last_scrub_stamp":"2024-09-12T18:12:01.415072+0000","last_deep_scrub":"263'359","last_deep_scrub_stamp":"2024-09-12T18:12:01.415072+0000","last_clean_scrub_stamp":"2024-09-12T18:12:01.415072+0000","objects_scrubbed":1,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:05:01.730803+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1979,"num_read_kb":1899,"num_write":385,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"263'232","reported_seq":961,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:52.832302+0000","last_change":"2024-09-12T18:11:52.832302+0000","last_active":"2024-09-12T18:11:52.832302+0000","last_peered":"2024-09-12T18:11:52.832302+0000","last_clean":"2024-09-12T18:11:52.832302+0000","last_became_active":"2024-09-12T17:10:42.518345+0000","last_became_peered":"2024-09-12T17:10:42.518345+0000","last_unstale":"2024-09-12T18:11:52.832302+0000","last_undegraded":"2024-09-12T18:11:52.832302+0000","last_fullsized":"2024-09-12T18:11:52.832302+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'232","last_scrub_stamp":"2024-09-12T18:11:52.832185+0000","last_deep_scrub":"263'232","last_deep_scrub_stamp":"2024-09-12T18:11:52.832185+0000","last_clean_scrub_stamp":"2024-09-12T18:11:52.832185+0000","objects_scrubbed":5,"log_size":32,"log_dups_size":200,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:43:54.965686+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1367925,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":646,"num_read_kb":98876,"num_write":1054,"num_write_kb":25289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0,3],"acting":[6,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"263'518","reported_seq":2158,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:57.757617+0000","last_change":"2024-09-12T18:11:57.757617+0000","last_active":"2024-09-12T18:11:57.757617+0000","last_peered":"2024-09-12T18:11:57.757617+0000","last_clean":"2024-09-12T18:11:57.757617+0000","last_became_active":"2024-09-12T17:10:44.514645+0000","last_became_peered":"2024-09-12T17:10:44.514645+0000","last_unstale":"2024-09-12T18:11:57.757617+0000","last_undegraded":"2024-09-12T18:11:57.757617+0000","last_fullsized":"2024-09-12T18:11:57.757617+0000","mapping_epoch":26,"log_start":"263'500","ondisk_log_start":"263'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'518","last_scrub_stamp":"2024-09-12T18:11:57.757537+0000","last_deep_scrub":"263'518","last_deep_scrub_stamp":"2024-09-12T18:11:57.757537+0000","last_clean_scrub_stamp":"2024-09-12T18:11:57.757537+0000","objects_scrubbed":2,"log_size":18,"log_dups_size":500,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:17:09.508445+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2725,"num_read_kb":2548,"num_write":623,"num_write_kb":175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":640,"num_omap_keys":3,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"263'215","reported_seq":882,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:50.441705+0000","last_change":"2024-09-12T18:11:50.441705+0000","last_active":"2024-09-12T18:11:50.441705+0000","last_peered":"2024-09-12T18:11:50.441705+0000","last_clean":"2024-09-12T18:11:50.441705+0000","last_became_active":"2024-09-12T17:10:42.519000+0000","last_became_peered":"2024-09-12T17:10:42.519000+0000","last_unstale":"2024-09-12T18:11:50.441705+0000","last_undegraded":"2024-09-12T18:11:50.441705+0000","last_fullsized":"2024-09-12T18:11:50.441705+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'215","last_scrub_stamp":"2024-09-12T18:11:50.441568+0000","last_deep_scrub":"263'215","last_deep_scrub_stamp":"2024-09-12T18:11:50.441568+0000","last_clean_scrub_stamp":"2024-09-12T18:11:50.441568+0000","objects_scrubbed":4,"log_size":15,"log_dups_size":200,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:10:24.946801+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":516496,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":502,"num_read_kb":33700,"num_write":932,"num_write_kb":23229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,0],"acting":[4,3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"263'1586","reported_seq":3120,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:58.740833+0000","last_change":"2024-09-12T18:11:58.740833+0000","last_active":"2024-09-12T18:11:58.740833+0000","last_peered":"2024-09-12T18:11:58.740833+0000","last_clean":"2024-09-12T18:11:58.740833+0000","last_became_active":"2024-09-12T17:10:44.514826+0000","last_became_peered":"2024-09-12T17:10:44.514826+0000","last_unstale":"2024-09-12T18:11:58.740833+0000","last_undegraded":"2024-09-12T18:11:58.740833+0000","last_fullsized":"2024-09-12T18:11:58.740833+0000","mapping_epoch":26,"log_start":"263'1500","ondisk_log_start":"263'1500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1586","last_scrub_stamp":"2024-09-12T18:11:58.740747+0000","last_deep_scrub":"263'1586","last_deep_scrub_stamp":"2024-09-12T18:11:58.740747+0000","last_clean_scrub_stamp":"2024-09-12T18:11:58.740747+0000","objects_scrubbed":3,"log_size":86,"log_dups_size":1500,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:47:04.467281+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6865,"num_read_kb":5951,"num_write":2206,"num_write_kb":956,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":946,"num_omap_keys":4,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"263'244","reported_seq":908,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:55.609090+0000","last_change":"2024-09-12T18:11:55.609090+0000","last_active":"2024-09-12T18:11:55.609090+0000","last_peered":"2024-09-12T18:11:55.609090+0000","last_clean":"2024-09-12T18:11:55.609090+0000","last_became_active":"2024-09-12T17:10:42.532995+0000","last_became_peered":"2024-09-12T17:10:42.532995+0000","last_unstale":"2024-09-12T18:11:55.609090+0000","last_undegraded":"2024-09-12T18:11:55.609090+0000","last_fullsized":"2024-09-12T18:11:55.609090+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'244","last_scrub_stamp":"2024-09-12T18:11:55.608942+0000","last_deep_scrub":"263'244","last_deep_scrub_stamp":"2024-09-12T18:11:55.608942+0000","last_clean_scrub_stamp":"2024-09-12T18:11:55.608942+0000","objects_scrubbed":6,"log_size":44,"log_dups_size":200,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:30:38.928542+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":786501,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":539,"num_read_kb":13123,"num_write":1227,"num_write_kb":39413,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1,5],"acting":[3,6,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"263'1290","reported_seq":3025,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:04.359170+0000","last_change":"2024-09-12T18:12:04.359170+0000","last_active":"2024-09-12T18:12:04.359170+0000","last_peered":"2024-09-12T18:12:04.359170+0000","last_clean":"2024-09-12T18:12:04.359170+0000","last_became_active":"2024-09-12T17:10:44.507428+0000","last_became_peered":"2024-09-12T17:10:44.507428+0000","last_unstale":"2024-09-12T18:12:04.359170+0000","last_undegraded":"2024-09-12T18:12:04.359170+0000","last_fullsized":"2024-09-12T18:12:04.359170+0000","mapping_epoch":26,"log_start":"263'1200","ondisk_log_start":"263'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1290","last_scrub_stamp":"2024-09-12T18:12:04.359076+0000","last_deep_scrub":"263'1290","last_deep_scrub_stamp":"2024-09-12T18:12:04.359076+0000","last_clean_scrub_stamp":"2024-09-12T18:12:04.359076+0000","objects_scrubbed":2,"log_size":90,"log_dups_size":1200,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:25:36.918661+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5933,"num_read_kb":5245,"num_write":1814,"num_write_kb":777,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"263'185","reported_seq":871,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:53.698211+0000","last_change":"2024-09-12T18:11:53.698211+0000","last_active":"2024-09-12T18:11:53.698211+0000","last_peered":"2024-09-12T18:11:53.698211+0000","last_clean":"2024-09-12T18:11:53.698211+0000","last_became_active":"2024-09-12T17:10:42.529179+0000","last_became_peered":"2024-09-12T17:10:42.529179+0000","last_unstale":"2024-09-12T18:11:53.698211+0000","last_undegraded":"2024-09-12T18:11:53.698211+0000","last_fullsized":"2024-09-12T18:11:53.698211+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'185","last_scrub_stamp":"2024-09-12T18:11:53.698095+0000","last_deep_scrub":"263'185","last_deep_scrub_stamp":"2024-09-12T18:11:53.698095+0000","last_clean_scrub_stamp":"2024-09-12T18:11:53.698095+0000","objects_scrubbed":5,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:03:54.556628+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":576011,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":570,"num_read_kb":13539,"num_write":907,"num_write_kb":25869,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1,5],"acting":[0,4,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"263'163","reported_seq":692,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:20.320264+0000","last_change":"2024-09-12T18:12:20.320264+0000","last_active":"2024-09-12T18:12:20.320264+0000","last_peered":"2024-09-12T18:12:20.320264+0000","last_clean":"2024-09-12T18:12:20.320264+0000","last_became_active":"2024-09-12T17:10:52.566079+0000","last_became_peered":"2024-09-12T17:10:52.566079+0000","last_unstale":"2024-09-12T18:12:20.320264+0000","last_undegraded":"2024-09-12T18:12:20.320264+0000","last_fullsized":"2024-09-12T18:12:20.320264+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'163","last_scrub_stamp":"2024-09-12T18:12:20.320167+0000","last_deep_scrub":"263'163","last_deep_scrub_stamp":"2024-09-12T18:12:20.320167+0000","last_clean_scrub_stamp":"2024-09-12T18:12:20.320167+0000","objects_scrubbed":4,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:08:43.569628+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":803,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":269,"num_read_kb":255,"num_write":425,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"263'796","reported_seq":2412,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:56.605309+0000","last_change":"2024-09-12T18:11:56.605309+0000","last_active":"2024-09-12T18:11:56.605309+0000","last_peered":"2024-09-12T18:11:56.605309+0000","last_clean":"2024-09-12T18:11:56.605309+0000","last_became_active":"2024-09-12T17:10:44.522193+0000","last_became_peered":"2024-09-12T17:10:44.522193+0000","last_unstale":"2024-09-12T18:11:56.605309+0000","last_undegraded":"2024-09-12T18:11:56.605309+0000","last_fullsized":"2024-09-12T18:11:56.605309+0000","mapping_epoch":26,"log_start":"263'700","ondisk_log_start":"263'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'796","last_scrub_stamp":"2024-09-12T18:11:56.605227+0000","last_deep_scrub":"263'796","last_deep_scrub_stamp":"2024-09-12T18:11:56.605227+0000","last_clean_scrub_stamp":"2024-09-12T18:11:56.605227+0000","objects_scrubbed":1,"log_size":96,"log_dups_size":700,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:30:29.129454+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3748,"num_read_kb":3407,"num_write":1044,"num_write_kb":360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"263'203","reported_seq":853,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:55.485587+0000","last_change":"2024-09-12T18:11:55.485587+0000","last_active":"2024-09-12T18:11:55.485587+0000","last_peered":"2024-09-12T18:11:55.485587+0000","last_clean":"2024-09-12T18:11:55.485587+0000","last_became_active":"2024-09-12T17:10:42.528620+0000","last_became_peered":"2024-09-12T17:10:42.528620+0000","last_unstale":"2024-09-12T18:11:55.485587+0000","last_undegraded":"2024-09-12T18:11:55.485587+0000","last_fullsized":"2024-09-12T18:11:55.485587+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'203","last_scrub_stamp":"2024-09-12T18:11:55.485439+0000","last_deep_scrub":"263'203","last_deep_scrub_stamp":"2024-09-12T18:11:55.485439+0000","last_clean_scrub_stamp":"2024-09-12T18:11:55.485439+0000","objects_scrubbed":4,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:14:56.174736+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262203,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":497,"num_read_kb":31268,"num_write":1015,"num_write_kb":14227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4,2],"acting":[7,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:07.454862+0000","last_change":"2024-09-12T18:12:07.454862+0000","last_active":"2024-09-12T18:12:07.454862+0000","last_peered":"2024-09-12T18:12:07.454862+0000","last_clean":"2024-09-12T18:12:07.454862+0000","last_became_active":"2024-09-12T17:10:46.527663+0000","last_became_peered":"2024-09-12T17:10:46.527663+0000","last_unstale":"2024-09-12T18:12:07.454862+0000","last_undegraded":"2024-09-12T18:12:07.454862+0000","last_fullsized":"2024-09-12T18:12:07.454862+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:07.454758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:07.454758+0000","last_clean_scrub_stamp":"2024-09-12T18:12:07.454758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:22:34.911521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"263'206","reported_seq":821,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:08.768194+0000","last_change":"2024-09-12T18:12:08.768194+0000","last_active":"2024-09-12T18:12:08.768194+0000","last_peered":"2024-09-12T18:12:08.768194+0000","last_clean":"2024-09-12T18:12:08.768194+0000","last_became_active":"2024-09-12T17:10:48.544885+0000","last_became_peered":"2024-09-12T17:10:48.544885+0000","last_unstale":"2024-09-12T18:12:08.768194+0000","last_undegraded":"2024-09-12T18:12:08.768194+0000","last_fullsized":"2024-09-12T18:12:08.768194+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'206","last_scrub_stamp":"2024-09-12T18:12:08.768105+0000","last_deep_scrub":"263'206","last_deep_scrub_stamp":"2024-09-12T18:12:08.768105+0000","last_clean_scrub_stamp":"2024-09-12T18:12:08.768105+0000","objects_scrubbed":5,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:55:57.620335+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6100,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":264,"num_read_kb":318,"num_write":156,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:15.608747+0000","last_change":"2024-09-12T18:12:15.608747+0000","last_active":"2024-09-12T18:12:15.608747+0000","last_peered":"2024-09-12T18:12:15.608747+0000","last_clean":"2024-09-12T18:12:15.608747+0000","last_became_active":"2024-09-12T17:10:50.556146+0000","last_became_peered":"2024-09-12T17:10:50.556146+0000","last_unstale":"2024-09-12T18:12:15.608747+0000","last_undegraded":"2024-09-12T18:12:15.608747+0000","last_fullsized":"2024-09-12T18:12:15.608747+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:15.608646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:15.608646+0000","last_clean_scrub_stamp":"2024-09-12T18:12:15.608646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:38:59.653407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"263'2477","reported_seq":4389,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:22.452371+0000","last_change":"2024-09-12T18:12:22.452371+0000","last_active":"2024-09-12T18:12:22.452371+0000","last_peered":"2024-09-12T18:12:22.452371+0000","last_clean":"2024-09-12T18:12:22.452371+0000","last_became_active":"2024-09-12T17:10:52.572326+0000","last_became_peered":"2024-09-12T17:10:52.572326+0000","last_unstale":"2024-09-12T18:12:22.452371+0000","last_undegraded":"2024-09-12T18:12:22.452371+0000","last_fullsized":"2024-09-12T18:12:22.452371+0000","mapping_epoch":34,"log_start":"263'2400","ondisk_log_start":"263'2400","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2477","last_scrub_stamp":"2024-09-12T18:12:22.452271+0000","last_deep_scrub":"263'2477","last_deep_scrub_stamp":"2024-09-12T18:12:22.452271+0000","last_clean_scrub_stamp":"2024-09-12T18:12:22.452271+0000","objects_scrubbed":3,"log_size":77,"log_dups_size":2400,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:21:06.027327+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":211,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6220,"num_read_kb":6202,"num_write":4958,"num_write_kb":1813,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":347,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"263'424","reported_seq":1886,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:56.315526+0000","last_change":"2024-09-12T18:11:56.315526+0000","last_active":"2024-09-12T18:11:56.315526+0000","last_peered":"2024-09-12T18:11:56.315526+0000","last_clean":"2024-09-12T18:11:56.315526+0000","last_became_active":"2024-09-12T17:10:44.512755+0000","last_became_peered":"2024-09-12T17:10:44.512755+0000","last_unstale":"2024-09-12T18:11:56.315526+0000","last_undegraded":"2024-09-12T18:11:56.315526+0000","last_fullsized":"2024-09-12T18:11:56.315526+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'424","last_scrub_stamp":"2024-09-12T18:11:56.315433+0000","last_deep_scrub":"263'424","last_deep_scrub_stamp":"2024-09-12T18:11:56.315433+0000","last_clean_scrub_stamp":"2024-09-12T18:11:56.315433+0000","objects_scrubbed":1,"log_size":24,"log_dups_size":400,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:17:36.929085+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2092,"num_read_kb":1979,"num_write":465,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"263'205","reported_seq":850,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:50.670378+0000","last_change":"2024-09-12T18:11:50.670378+0000","last_active":"2024-09-12T18:11:50.670378+0000","last_peered":"2024-09-12T18:11:50.670378+0000","last_clean":"2024-09-12T18:11:50.670378+0000","last_became_active":"2024-09-12T17:10:42.513658+0000","last_became_peered":"2024-09-12T17:10:42.513658+0000","last_unstale":"2024-09-12T18:11:50.670378+0000","last_undegraded":"2024-09-12T18:11:50.670378+0000","last_fullsized":"2024-09-12T18:11:50.670378+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'205","last_scrub_stamp":"2024-09-12T18:11:50.670245+0000","last_deep_scrub":"263'205","last_deep_scrub_stamp":"2024-09-12T18:11:50.670245+0000","last_clean_scrub_stamp":"2024-09-12T18:11:50.670245+0000","objects_scrubbed":3,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:56:06.408091+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262204,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":448,"num_read_kb":17694,"num_write":957,"num_write_kb":36760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":504,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:09.675177+0000","last_change":"2024-09-12T18:12:09.675177+0000","last_active":"2024-09-12T18:12:09.675177+0000","last_peered":"2024-09-12T18:12:09.675177+0000","last_clean":"2024-09-12T18:12:09.675177+0000","last_became_active":"2024-09-12T17:10:46.528008+0000","last_became_peered":"2024-09-12T17:10:46.528008+0000","last_unstale":"2024-09-12T18:12:09.675177+0000","last_undegraded":"2024-09-12T18:12:09.675177+0000","last_fullsized":"2024-09-12T18:12:09.675177+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:09.675082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:09.675082+0000","last_clean_scrub_stamp":"2024-09-12T18:12:09.675082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:32:12.149143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"263'101","reported_seq":641,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:11.289249+0000","last_change":"2024-09-12T18:12:11.289249+0000","last_active":"2024-09-12T18:12:11.289249+0000","last_peered":"2024-09-12T18:12:11.289249+0000","last_clean":"2024-09-12T18:12:11.289249+0000","last_became_active":"2024-09-12T17:10:48.539249+0000","last_became_peered":"2024-09-12T17:10:48.539249+0000","last_unstale":"2024-09-12T18:12:11.289249+0000","last_undegraded":"2024-09-12T18:12:11.289249+0000","last_fullsized":"2024-09-12T18:12:11.289249+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'101","last_scrub_stamp":"2024-09-12T18:12:11.289154+0000","last_deep_scrub":"263'101","last_deep_scrub_stamp":"2024-09-12T18:12:11.289154+0000","last_clean_scrub_stamp":"2024-09-12T18:12:11.289154+0000","objects_scrubbed":3,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:49:48.920473+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":101,"num_read_kb":97,"num_write":68,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:16.302946+0000","last_change":"2024-09-12T18:12:16.302946+0000","last_active":"2024-09-12T18:12:16.302946+0000","last_peered":"2024-09-12T18:12:16.302946+0000","last_clean":"2024-09-12T18:12:16.302946+0000","last_became_active":"2024-09-12T17:10:50.559882+0000","last_became_peered":"2024-09-12T17:10:50.559882+0000","last_unstale":"2024-09-12T18:12:16.302946+0000","last_undegraded":"2024-09-12T18:12:16.302946+0000","last_fullsized":"2024-09-12T18:12:16.302946+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:16.302835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:16.302835+0000","last_clean_scrub_stamp":"2024-09-12T18:12:16.302835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:28:03.221974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"263'94","reported_seq":603,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:21.627457+0000","last_change":"2024-09-12T18:12:21.627457+0000","last_active":"2024-09-12T18:12:21.627457+0000","last_peered":"2024-09-12T18:12:21.627457+0000","last_clean":"2024-09-12T18:12:21.627457+0000","last_became_active":"2024-09-12T17:10:52.570071+0000","last_became_peered":"2024-09-12T17:10:52.570071+0000","last_unstale":"2024-09-12T18:12:21.627457+0000","last_undegraded":"2024-09-12T18:12:21.627457+0000","last_fullsized":"2024-09-12T18:12:21.627457+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'94","last_scrub_stamp":"2024-09-12T18:12:21.627369+0000","last_deep_scrub":"263'94","last_deep_scrub_stamp":"2024-09-12T18:12:21.627369+0000","last_clean_scrub_stamp":"2024-09-12T18:12:21.627369+0000","objects_scrubbed":4,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:31:19.525124+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":117,"num_read_kb":116,"num_write":199,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"263'446","reported_seq":2001,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:57.732062+0000","last_change":"2024-09-12T18:11:57.732062+0000","last_active":"2024-09-12T18:11:57.732062+0000","last_peered":"2024-09-12T18:11:57.732062+0000","last_clean":"2024-09-12T18:11:57.732062+0000","last_became_active":"2024-09-12T17:10:44.517886+0000","last_became_peered":"2024-09-12T17:10:44.517886+0000","last_unstale":"2024-09-12T18:11:57.732062+0000","last_undegraded":"2024-09-12T18:11:57.732062+0000","last_fullsized":"2024-09-12T18:11:57.732062+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'446","last_scrub_stamp":"2024-09-12T18:11:57.731969+0000","last_deep_scrub":"263'446","last_deep_scrub_stamp":"2024-09-12T18:11:57.731969+0000","last_clean_scrub_stamp":"2024-09-12T18:11:57.731969+0000","objects_scrubbed":3,"log_size":46,"log_dups_size":400,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:14:03.007633+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2335,"num_read_kb":2201,"num_write":517,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"263'192","reported_seq":824,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:53.493308+0000","last_change":"2024-09-12T18:11:53.493308+0000","last_active":"2024-09-12T18:11:53.493308+0000","last_peered":"2024-09-12T18:11:53.493308+0000","last_clean":"2024-09-12T18:11:53.493308+0000","last_became_active":"2024-09-12T17:10:42.530663+0000","last_became_peered":"2024-09-12T17:10:42.530663+0000","last_unstale":"2024-09-12T18:11:53.493308+0000","last_undegraded":"2024-09-12T18:11:53.493308+0000","last_fullsized":"2024-09-12T18:11:53.493308+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'192","last_scrub_stamp":"2024-09-12T18:11:53.493160+0000","last_deep_scrub":"263'192","last_deep_scrub_stamp":"2024-09-12T18:11:53.493160+0000","last_clean_scrub_stamp":"2024-09-12T18:11:53.493160+0000","objects_scrubbed":4,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:43:13.520826+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6466288,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":436,"num_read_kb":14482,"num_write":960,"num_write_kb":29259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":503,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:10.652342+0000","last_change":"2024-09-12T18:12:10.652342+0000","last_active":"2024-09-12T18:12:10.652342+0000","last_peered":"2024-09-12T18:12:10.652342+0000","last_clean":"2024-09-12T18:12:10.652342+0000","last_became_active":"2024-09-12T17:10:46.530438+0000","last_became_peered":"2024-09-12T17:10:46.530438+0000","last_unstale":"2024-09-12T18:12:10.652342+0000","last_undegraded":"2024-09-12T18:12:10.652342+0000","last_fullsized":"2024-09-12T18:12:10.652342+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:10.652252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:10.652252+0000","last_clean_scrub_stamp":"2024-09-12T18:12:10.652252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:55:25.036608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"263'119","reported_seq":662,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:05.711738+0000","last_change":"2024-09-12T18:12:05.711738+0000","last_active":"2024-09-12T18:12:05.711738+0000","last_peered":"2024-09-12T18:12:05.711738+0000","last_clean":"2024-09-12T18:12:05.711738+0000","last_became_active":"2024-09-12T17:10:48.540078+0000","last_became_peered":"2024-09-12T17:10:48.540078+0000","last_unstale":"2024-09-12T18:12:05.711738+0000","last_undegraded":"2024-09-12T18:12:05.711738+0000","last_fullsized":"2024-09-12T18:12:05.711738+0000","mapping_epoch":30,"log_start":"263'100","ondisk_log_start":"263'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'119","last_scrub_stamp":"2024-09-12T18:12:05.711619+0000","last_deep_scrub":"263'119","last_deep_scrub_stamp":"2024-09-12T18:12:05.711619+0000","last_clean_scrub_stamp":"2024-09-12T18:12:05.711619+0000","objects_scrubbed":5,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:27:16.614673+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":134,"num_read_kb":129,"num_write":88,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"263'766","reported_seq":4737,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:18.558845+0000","last_change":"2024-09-12T18:12:18.558845+0000","last_active":"2024-09-12T18:12:18.558845+0000","last_peered":"2024-09-12T18:12:18.558845+0000","last_clean":"2024-09-12T18:12:18.558845+0000","last_became_active":"2024-09-12T17:10:50.562930+0000","last_became_peered":"2024-09-12T17:10:50.562930+0000","last_unstale":"2024-09-12T18:12:18.558845+0000","last_undegraded":"2024-09-12T18:12:18.558845+0000","last_fullsized":"2024-09-12T18:12:18.558845+0000","mapping_epoch":32,"log_start":"263'700","ondisk_log_start":"263'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'766","last_scrub_stamp":"2024-09-12T18:12:18.558728+0000","last_deep_scrub":"263'766","last_deep_scrub_stamp":"2024-09-12T18:12:18.558728+0000","last_clean_scrub_stamp":"2024-09-12T18:12:18.558728+0000","objects_scrubbed":1,"log_size":66,"log_dups_size":700,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:48:16.936137+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"263'200","reported_seq":1057,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:21.305244+0000","last_change":"2024-09-12T18:12:21.305244+0000","last_active":"2024-09-12T18:12:21.305244+0000","last_peered":"2024-09-12T18:12:21.305244+0000","last_clean":"2024-09-12T18:12:21.305244+0000","last_became_active":"2024-09-12T17:10:52.671103+0000","last_became_peered":"2024-09-12T17:10:52.671103+0000","last_unstale":"2024-09-12T18:12:21.305244+0000","last_undegraded":"2024-09-12T18:12:21.305244+0000","last_fullsized":"2024-09-12T18:12:21.305244+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'200","last_scrub_stamp":"2024-09-12T18:12:21.305151+0000","last_deep_scrub":"263'200","last_deep_scrub_stamp":"2024-09-12T18:12:21.305151+0000","last_clean_scrub_stamp":"2024-09-12T18:12:21.305151+0000","objects_scrubbed":2,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:51:37.835794+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":719,"num_read_kb":693,"num_write":432,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"263'449","reported_seq":1973,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:05.648946+0000","last_change":"2024-09-12T18:12:05.648946+0000","last_active":"2024-09-12T18:12:05.648946+0000","last_peered":"2024-09-12T18:12:05.648946+0000","last_clean":"2024-09-12T18:12:05.648946+0000","last_became_active":"2024-09-12T17:10:44.514124+0000","last_became_peered":"2024-09-12T17:10:44.514124+0000","last_unstale":"2024-09-12T18:12:05.648946+0000","last_undegraded":"2024-09-12T18:12:05.648946+0000","last_fullsized":"2024-09-12T18:12:05.648946+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'449","last_scrub_stamp":"2024-09-12T18:12:05.648849+0000","last_deep_scrub":"263'449","last_deep_scrub_stamp":"2024-09-12T18:12:05.648849+0000","last_clean_scrub_stamp":"2024-09-12T18:12:05.648849+0000","objects_scrubbed":3,"log_size":49,"log_dups_size":400,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:51:39.265549+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2305,"num_read_kb":2168,"num_write":513,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":715,"num_omap_keys":3,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"263'223","reported_seq":887,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:49.784779+0000","last_change":"2024-09-12T18:11:49.784779+0000","last_active":"2024-09-12T18:11:49.784779+0000","last_peered":"2024-09-12T18:11:49.784779+0000","last_clean":"2024-09-12T18:11:49.784779+0000","last_became_active":"2024-09-12T17:10:42.525328+0000","last_became_peered":"2024-09-12T17:10:42.525328+0000","last_unstale":"2024-09-12T18:11:49.784779+0000","last_undegraded":"2024-09-12T18:11:49.784779+0000","last_fullsized":"2024-09-12T18:11:49.784779+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'223","last_scrub_stamp":"2024-09-12T18:11:49.784671+0000","last_deep_scrub":"263'223","last_deep_scrub_stamp":"2024-09-12T18:11:49.784671+0000","last_clean_scrub_stamp":"2024-09-12T18:11:49.784671+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":200,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:16:42.260914+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":549,"num_read_kb":47940,"num_write":1052,"num_write_kb":57690,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,3],"acting":[6,0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:09.453009+0000","last_change":"2024-09-12T18:12:09.453009+0000","last_active":"2024-09-12T18:12:09.453009+0000","last_peered":"2024-09-12T18:12:09.453009+0000","last_clean":"2024-09-12T18:12:09.453009+0000","last_became_active":"2024-09-12T17:10:46.526679+0000","last_became_peered":"2024-09-12T17:10:46.526679+0000","last_unstale":"2024-09-12T18:12:09.453009+0000","last_undegraded":"2024-09-12T18:12:09.453009+0000","last_fullsized":"2024-09-12T18:12:09.453009+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:09.452906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:09.452906+0000","last_clean_scrub_stamp":"2024-09-12T18:12:09.452906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:12:39.798370+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"263'135","reported_seq":710,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:14.576462+0000","last_change":"2024-09-12T18:12:14.576462+0000","last_active":"2024-09-12T18:12:14.576462+0000","last_peered":"2024-09-12T18:12:14.576462+0000","last_clean":"2024-09-12T18:12:14.576462+0000","last_became_active":"2024-09-12T17:10:48.543573+0000","last_became_peered":"2024-09-12T17:10:48.543573+0000","last_unstale":"2024-09-12T18:12:14.576462+0000","last_undegraded":"2024-09-12T18:12:14.576462+0000","last_fullsized":"2024-09-12T18:12:14.576462+0000","mapping_epoch":30,"log_start":"263'100","ondisk_log_start":"263'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'135","last_scrub_stamp":"2024-09-12T18:12:14.576373+0000","last_deep_scrub":"263'135","last_deep_scrub_stamp":"2024-09-12T18:12:14.576373+0000","last_clean_scrub_stamp":"2024-09-12T18:12:14.576373+0000","objects_scrubbed":4,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:56:34.775535+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5773,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":175,"num_read_kb":264,"num_write":94,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"263'788","reported_seq":2307,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:22.665547+0000","last_change":"2024-09-12T18:12:22.665547+0000","last_active":"2024-09-12T18:12:22.665547+0000","last_peered":"2024-09-12T18:12:22.665547+0000","last_clean":"2024-09-12T18:12:22.665547+0000","last_became_active":"2024-09-12T17:10:50.559216+0000","last_became_peered":"2024-09-12T17:10:50.559216+0000","last_unstale":"2024-09-12T18:12:22.665547+0000","last_undegraded":"2024-09-12T18:12:22.665547+0000","last_fullsized":"2024-09-12T18:12:22.665547+0000","mapping_epoch":32,"log_start":"263'700","ondisk_log_start":"263'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'788","last_scrub_stamp":"2024-09-12T18:12:22.665463+0000","last_deep_scrub":"263'788","last_deep_scrub_stamp":"2024-09-12T18:12:22.665463+0000","last_clean_scrub_stamp":"2024-09-12T18:12:22.665463+0000","objects_scrubbed":1,"log_size":88,"log_dups_size":700,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:00:59.116160+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"263'411","reported_seq":1940,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:55.295320+0000","last_change":"2024-09-12T18:11:55.295320+0000","last_active":"2024-09-12T18:11:55.295320+0000","last_peered":"2024-09-12T18:11:55.295320+0000","last_clean":"2024-09-12T18:11:55.295320+0000","last_became_active":"2024-09-12T17:10:44.516266+0000","last_became_peered":"2024-09-12T17:10:44.516266+0000","last_unstale":"2024-09-12T18:11:55.295320+0000","last_undegraded":"2024-09-12T18:11:55.295320+0000","last_fullsized":"2024-09-12T18:11:55.295320+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'411","last_scrub_stamp":"2024-09-12T18:11:55.295178+0000","last_deep_scrub":"263'411","last_deep_scrub_stamp":"2024-09-12T18:11:55.295178+0000","last_clean_scrub_stamp":"2024-09-12T18:11:55.295178+0000","objects_scrubbed":3,"log_size":11,"log_dups_size":400,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:17:07.193677+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2231,"num_read_kb":2116,"num_write":471,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":467,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"263'319","reported_seq":1094,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:52.463181+0000","last_change":"2024-09-12T18:11:52.463181+0000","last_active":"2024-09-12T18:11:52.463181+0000","last_peered":"2024-09-12T18:11:52.463181+0000","last_clean":"2024-09-12T18:11:52.463181+0000","last_became_active":"2024-09-12T17:10:42.531886+0000","last_became_peered":"2024-09-12T17:10:42.531886+0000","last_unstale":"2024-09-12T18:11:52.463181+0000","last_undegraded":"2024-09-12T18:11:52.463181+0000","last_fullsized":"2024-09-12T18:11:52.463181+0000","mapping_epoch":24,"log_start":"263'300","ondisk_log_start":"263'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'319","last_scrub_stamp":"2024-09-12T18:11:52.463034+0000","last_deep_scrub":"263'319","last_deep_scrub_stamp":"2024-09-12T18:11:52.463034+0000","last_clean_scrub_stamp":"2024-09-12T18:11:52.463034+0000","objects_scrubbed":6,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:11:16.067545+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2276857,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1043,"num_read_kb":35637,"num_write":1316,"num_write_kb":31872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0,1],"acting":[7,4,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":504,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:05.608637+0000","last_change":"2024-09-12T18:12:05.608637+0000","last_active":"2024-09-12T18:12:05.608637+0000","last_peered":"2024-09-12T18:12:05.608637+0000","last_clean":"2024-09-12T18:12:05.608637+0000","last_became_active":"2024-09-12T17:10:46.518652+0000","last_became_peered":"2024-09-12T17:10:46.518652+0000","last_unstale":"2024-09-12T18:12:05.608637+0000","last_undegraded":"2024-09-12T18:12:05.608637+0000","last_fullsized":"2024-09-12T18:12:05.608637+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:05.608543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:05.608543+0000","last_clean_scrub_stamp":"2024-09-12T18:12:05.608543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:09:06.191572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"263'227","reported_seq":852,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:13.404939+0000","last_change":"2024-09-12T18:12:13.404939+0000","last_active":"2024-09-12T18:12:13.404939+0000","last_peered":"2024-09-12T18:12:13.404939+0000","last_clean":"2024-09-12T18:12:13.404939+0000","last_became_active":"2024-09-12T17:10:48.541178+0000","last_became_peered":"2024-09-12T17:10:48.541178+0000","last_unstale":"2024-09-12T18:12:13.404939+0000","last_undegraded":"2024-09-12T18:12:13.404939+0000","last_fullsized":"2024-09-12T18:12:13.404939+0000","mapping_epoch":30,"log_start":"263'200","ondisk_log_start":"263'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'227","last_scrub_stamp":"2024-09-12T18:12:13.404809+0000","last_deep_scrub":"263'227","last_deep_scrub_stamp":"2024-09-12T18:12:13.404809+0000","last_clean_scrub_stamp":"2024-09-12T18:12:13.404809+0000","objects_scrubbed":9,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:17:32.802279+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5437,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":298,"num_read_kb":347,"num_write":172,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:08.498712+0000","last_change":"2024-09-12T18:12:08.498712+0000","last_active":"2024-09-12T18:12:08.498712+0000","last_peered":"2024-09-12T18:12:08.498712+0000","last_clean":"2024-09-12T18:12:08.498712+0000","last_became_active":"2024-09-12T17:10:50.560193+0000","last_became_peered":"2024-09-12T17:10:50.560193+0000","last_unstale":"2024-09-12T18:12:08.498712+0000","last_undegraded":"2024-09-12T18:12:08.498712+0000","last_fullsized":"2024-09-12T18:12:08.498712+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:08.498624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:08.498624+0000","last_clean_scrub_stamp":"2024-09-12T18:12:08.498624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:43:57.992395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"263'562","reported_seq":1381,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:18.548972+0000","last_change":"2024-09-12T18:12:18.548972+0000","last_active":"2024-09-12T18:12:18.548972+0000","last_peered":"2024-09-12T18:12:18.548972+0000","last_clean":"2024-09-12T18:12:18.548972+0000","last_became_active":"2024-09-12T17:10:52.572861+0000","last_became_peered":"2024-09-12T17:10:52.572861+0000","last_unstale":"2024-09-12T18:12:18.548972+0000","last_undegraded":"2024-09-12T18:12:18.548972+0000","last_fullsized":"2024-09-12T18:12:18.548972+0000","mapping_epoch":34,"log_start":"263'500","ondisk_log_start":"263'500","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'562","last_scrub_stamp":"2024-09-12T18:12:18.548872+0000","last_deep_scrub":"263'562","last_deep_scrub_stamp":"2024-09-12T18:12:18.548872+0000","last_clean_scrub_stamp":"2024-09-12T18:12:18.548872+0000","objects_scrubbed":7,"log_size":62,"log_dups_size":500,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:19:47.637516+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1102,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1315,"num_read_kb":1312,"num_write":1171,"num_write_kb":396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":381,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"263'469","reported_seq":2057,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:51.400026+0000","last_change":"2024-09-12T18:11:51.400026+0000","last_active":"2024-09-12T18:11:51.400026+0000","last_peered":"2024-09-12T18:11:51.400026+0000","last_clean":"2024-09-12T18:11:51.400026+0000","last_became_active":"2024-09-12T17:10:44.515778+0000","last_became_peered":"2024-09-12T17:10:44.515778+0000","last_unstale":"2024-09-12T18:11:51.400026+0000","last_undegraded":"2024-09-12T18:11:51.400026+0000","last_fullsized":"2024-09-12T18:11:51.400026+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'469","last_scrub_stamp":"2024-09-12T18:11:51.399935+0000","last_deep_scrub":"263'469","last_deep_scrub_stamp":"2024-09-12T18:11:51.399935+0000","last_clean_scrub_stamp":"2024-09-12T18:11:51.399935+0000","objects_scrubbed":2,"log_size":69,"log_dups_size":400,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:32:57.047086+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2463,"num_read_kb":2310,"num_write":552,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"263'158","reported_seq":772,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:50.465220+0000","last_change":"2024-09-12T18:11:50.465220+0000","last_active":"2024-09-12T18:11:50.465220+0000","last_peered":"2024-09-12T18:11:50.465220+0000","last_clean":"2024-09-12T18:11:50.465220+0000","last_became_active":"2024-09-12T17:10:42.526215+0000","last_became_peered":"2024-09-12T17:10:42.526215+0000","last_unstale":"2024-09-12T18:11:50.465220+0000","last_undegraded":"2024-09-12T18:11:50.465220+0000","last_fullsized":"2024-09-12T18:11:50.465220+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'158","last_scrub_stamp":"2024-09-12T18:11:50.465100+0000","last_deep_scrub":"263'158","last_deep_scrub_stamp":"2024-09-12T18:11:50.465100+0000","last_clean_scrub_stamp":"2024-09-12T18:11:50.465100+0000","objects_scrubbed":2,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:53:30.108739+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":254352,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":393,"num_read_kb":949,"num_write":838,"num_write_kb":19518,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,2],"acting":[7,4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":503,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:55.787582+0000","last_change":"2024-09-12T18:11:55.787582+0000","last_active":"2024-09-12T18:11:55.787582+0000","last_peered":"2024-09-12T18:11:55.787582+0000","last_clean":"2024-09-12T18:11:55.787582+0000","last_became_active":"2024-09-12T17:10:46.532552+0000","last_became_peered":"2024-09-12T17:10:46.532552+0000","last_unstale":"2024-09-12T18:11:55.787582+0000","last_undegraded":"2024-09-12T18:11:55.787582+0000","last_fullsized":"2024-09-12T18:11:55.787582+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:11:55.787495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:11:55.787495+0000","last_clean_scrub_stamp":"2024-09-12T18:11:55.787495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:34:05.224619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"263'137","reported_seq":716,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:11.617615+0000","last_change":"2024-09-12T18:12:11.617615+0000","last_active":"2024-09-12T18:12:11.617615+0000","last_peered":"2024-09-12T18:12:11.617615+0000","last_clean":"2024-09-12T18:12:11.617615+0000","last_became_active":"2024-09-12T17:10:48.542511+0000","last_became_peered":"2024-09-12T17:10:48.542511+0000","last_unstale":"2024-09-12T18:12:11.617615+0000","last_undegraded":"2024-09-12T18:12:11.617615+0000","last_fullsized":"2024-09-12T18:12:11.617615+0000","mapping_epoch":30,"log_start":"263'100","ondisk_log_start":"263'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'137","last_scrub_stamp":"2024-09-12T18:12:11.617522+0000","last_deep_scrub":"263'137","last_deep_scrub_stamp":"2024-09-12T18:12:11.617522+0000","last_clean_scrub_stamp":"2024-09-12T18:12:11.617522+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:39:49.866042+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27700,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":176,"num_read_kb":289,"num_write":94,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":498,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:20.690070+0000","last_change":"2024-09-12T18:12:20.690070+0000","last_active":"2024-09-12T18:12:20.690070+0000","last_peered":"2024-09-12T18:12:20.690070+0000","last_clean":"2024-09-12T18:12:20.690070+0000","last_became_active":"2024-09-12T17:10:50.560194+0000","last_became_peered":"2024-09-12T17:10:50.560194+0000","last_unstale":"2024-09-12T18:12:20.690070+0000","last_undegraded":"2024-09-12T18:12:20.690070+0000","last_fullsized":"2024-09-12T18:12:20.690070+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:20.689979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:20.689979+0000","last_clean_scrub_stamp":"2024-09-12T18:12:20.689979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:11:29.579461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"263'129","reported_seq":644,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:08.698991+0000","last_change":"2024-09-12T18:12:08.698991+0000","last_active":"2024-09-12T18:12:08.698991+0000","last_peered":"2024-09-12T18:12:08.698991+0000","last_clean":"2024-09-12T18:12:08.698991+0000","last_became_active":"2024-09-12T17:10:52.564350+0000","last_became_peered":"2024-09-12T17:10:52.564350+0000","last_unstale":"2024-09-12T18:12:08.698991+0000","last_undegraded":"2024-09-12T18:12:08.698991+0000","last_fullsized":"2024-09-12T18:12:08.698991+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'129","last_scrub_stamp":"2024-09-12T18:12:08.698906+0000","last_deep_scrub":"263'129","last_deep_scrub_stamp":"2024-09-12T18:12:08.698906+0000","last_clean_scrub_stamp":"2024-09-12T18:12:08.698906+0000","objects_scrubbed":1,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:13:26.478753+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":214,"num_read_kb":196,"num_write":321,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"263'439","reported_seq":1888,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:55.718980+0000","last_change":"2024-09-12T18:11:55.718980+0000","last_active":"2024-09-12T18:11:55.718980+0000","last_peered":"2024-09-12T18:11:55.718980+0000","last_clean":"2024-09-12T18:11:55.718980+0000","last_became_active":"2024-09-12T17:11:16.618699+0000","last_became_peered":"2024-09-12T17:11:16.618699+0000","last_unstale":"2024-09-12T18:11:55.718980+0000","last_undegraded":"2024-09-12T18:11:55.718980+0000","last_fullsized":"2024-09-12T18:11:55.718980+0000","mapping_epoch":37,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'439","last_scrub_stamp":"2024-09-12T18:11:55.718895+0000","last_deep_scrub":"263'439","last_deep_scrub_stamp":"2024-09-12T18:11:55.718895+0000","last_clean_scrub_stamp":"2024-09-12T18:11:55.718895+0000","objects_scrubbed":2,"log_size":39,"log_dups_size":400,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:35:23.822201+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2161,"num_read_kb":2024,"num_write":504,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1429,"num_omap_keys":6,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"263'215","reported_seq":851,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:58.516620+0000","last_change":"2024-09-12T18:11:58.516620+0000","last_active":"2024-09-12T18:11:58.516620+0000","last_peered":"2024-09-12T18:11:58.516620+0000","last_clean":"2024-09-12T18:11:58.516620+0000","last_became_active":"2024-09-12T17:10:42.525644+0000","last_became_peered":"2024-09-12T17:10:42.525644+0000","last_unstale":"2024-09-12T18:11:58.516620+0000","last_undegraded":"2024-09-12T18:11:58.516620+0000","last_fullsized":"2024-09-12T18:11:58.516620+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'215","last_scrub_stamp":"2024-09-12T18:11:58.516489+0000","last_deep_scrub":"263'215","last_deep_scrub_stamp":"2024-09-12T18:11:58.516489+0000","last_clean_scrub_stamp":"2024-09-12T18:11:58.516489+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":200,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:52:28.223065+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":480,"num_read_kb":1680,"num_write":1066,"num_write_kb":42245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4,6],"acting":[7,5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:59.753999+0000","last_change":"2024-09-12T18:11:59.753999+0000","last_active":"2024-09-12T18:11:59.753999+0000","last_peered":"2024-09-12T18:11:59.753999+0000","last_clean":"2024-09-12T18:11:59.753999+0000","last_became_active":"2024-09-12T17:10:46.531693+0000","last_became_peered":"2024-09-12T17:10:46.531693+0000","last_unstale":"2024-09-12T18:11:59.753999+0000","last_undegraded":"2024-09-12T18:11:59.753999+0000","last_fullsized":"2024-09-12T18:11:59.753999+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:11:59.753897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:11:59.753897+0000","last_clean_scrub_stamp":"2024-09-12T18:11:59.753897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:56:46.955405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"263'178","reported_seq":774,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:11.589646+0000","last_change":"2024-09-12T18:12:11.589646+0000","last_active":"2024-09-12T18:12:11.589646+0000","last_peered":"2024-09-12T18:12:11.589646+0000","last_clean":"2024-09-12T18:12:11.589646+0000","last_became_active":"2024-09-12T17:10:48.546013+0000","last_became_peered":"2024-09-12T17:10:48.546013+0000","last_unstale":"2024-09-12T18:12:11.589646+0000","last_undegraded":"2024-09-12T18:12:11.589646+0000","last_fullsized":"2024-09-12T18:12:11.589646+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'178","last_scrub_stamp":"2024-09-12T18:12:11.589555+0000","last_deep_scrub":"263'178","last_deep_scrub_stamp":"2024-09-12T18:12:11.589555+0000","last_clean_scrub_stamp":"2024-09-12T18:12:11.589555+0000","objects_scrubbed":7,"log_size":78,"log_dups_size":100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:51:13.452284+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22951,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":229,"num_read_kb":322,"num_write":130,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"263'777","reported_seq":2668,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:13.721455+0000","last_change":"2024-09-12T18:12:13.721455+0000","last_active":"2024-09-12T18:12:13.721455+0000","last_peered":"2024-09-12T18:12:13.721455+0000","last_clean":"2024-09-12T18:12:13.721455+0000","last_became_active":"2024-09-12T17:10:50.557711+0000","last_became_peered":"2024-09-12T17:10:50.557711+0000","last_unstale":"2024-09-12T18:12:13.721455+0000","last_undegraded":"2024-09-12T18:12:13.721455+0000","last_fullsized":"2024-09-12T18:12:13.721455+0000","mapping_epoch":32,"log_start":"263'700","ondisk_log_start":"263'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'777","last_scrub_stamp":"2024-09-12T18:12:13.721361+0000","last_deep_scrub":"263'777","last_deep_scrub_stamp":"2024-09-12T18:12:13.721361+0000","last_clean_scrub_stamp":"2024-09-12T18:12:13.721361+0000","objects_scrubbed":1,"log_size":77,"log_dups_size":700,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:36:39.426338+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"263'105","reported_seq":608,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:18.692520+0000","last_change":"2024-09-12T18:12:18.692520+0000","last_active":"2024-09-12T18:12:18.692520+0000","last_peered":"2024-09-12T18:12:18.692520+0000","last_clean":"2024-09-12T18:12:18.692520+0000","last_became_active":"2024-09-12T17:10:52.570034+0000","last_became_peered":"2024-09-12T17:10:52.570034+0000","last_unstale":"2024-09-12T18:12:18.692520+0000","last_undegraded":"2024-09-12T18:12:18.692520+0000","last_fullsized":"2024-09-12T18:12:18.692520+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'105","last_scrub_stamp":"2024-09-12T18:12:18.692437+0000","last_deep_scrub":"263'105","last_deep_scrub_stamp":"2024-09-12T18:12:18.692437+0000","last_clean_scrub_stamp":"2024-09-12T18:12:18.692437+0000","objects_scrubbed":2,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:12:56.220943+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":442,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":109,"num_read_kb":107,"num_write":228,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"263'459","reported_seq":1996,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:56.689795+0000","last_change":"2024-09-12T18:11:56.689795+0000","last_active":"2024-09-12T18:11:56.689795+0000","last_peered":"2024-09-12T18:11:56.689795+0000","last_clean":"2024-09-12T18:11:56.689795+0000","last_became_active":"2024-09-12T17:10:44.520043+0000","last_became_peered":"2024-09-12T17:10:44.520043+0000","last_unstale":"2024-09-12T18:11:56.689795+0000","last_undegraded":"2024-09-12T18:11:56.689795+0000","last_fullsized":"2024-09-12T18:11:56.689795+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'459","last_scrub_stamp":"2024-09-12T18:11:56.689705+0000","last_deep_scrub":"263'459","last_deep_scrub_stamp":"2024-09-12T18:11:56.689705+0000","last_clean_scrub_stamp":"2024-09-12T18:11:56.689705+0000","objects_scrubbed":2,"log_size":59,"log_dups_size":400,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:12:24.353664+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2352,"num_read_kb":2214,"num_write":541,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":217,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"263'209","reported_seq":860,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:48.213383+0000","last_change":"2024-09-12T18:11:48.213383+0000","last_active":"2024-09-12T18:11:48.213383+0000","last_peered":"2024-09-12T18:11:48.213383+0000","last_clean":"2024-09-12T18:11:48.213383+0000","last_became_active":"2024-09-12T17:10:42.518472+0000","last_became_peered":"2024-09-12T17:10:42.518472+0000","last_unstale":"2024-09-12T18:11:48.213383+0000","last_undegraded":"2024-09-12T18:11:48.213383+0000","last_fullsized":"2024-09-12T18:11:48.213383+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'209","last_scrub_stamp":"2024-09-12T18:11:48.213203+0000","last_deep_scrub":"263'209","last_deep_scrub_stamp":"2024-09-12T18:11:48.213203+0000","last_clean_scrub_stamp":"2024-09-12T18:11:48.213203+0000","objects_scrubbed":7,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:56:57.310254+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":91,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":447,"num_read_kb":52953,"num_write":1076,"num_write_kb":38599,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6,1],"acting":[5,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":503,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:56.759826+0000","last_change":"2024-09-12T18:11:56.759826+0000","last_active":"2024-09-12T18:11:56.759826+0000","last_peered":"2024-09-12T18:11:56.759826+0000","last_clean":"2024-09-12T18:11:56.759826+0000","last_became_active":"2024-09-12T17:10:46.531731+0000","last_became_peered":"2024-09-12T17:10:46.531731+0000","last_unstale":"2024-09-12T18:11:56.759826+0000","last_undegraded":"2024-09-12T18:11:56.759826+0000","last_fullsized":"2024-09-12T18:11:56.759826+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:11:56.759684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:11:56.759684+0000","last_clean_scrub_stamp":"2024-09-12T18:11:56.759684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:53:36.303626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"263'204","reported_seq":849,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:07.754573+0000","last_change":"2024-09-12T18:12:07.754573+0000","last_active":"2024-09-12T18:12:07.754573+0000","last_peered":"2024-09-12T18:12:07.754573+0000","last_clean":"2024-09-12T18:12:07.754573+0000","last_became_active":"2024-09-12T17:10:48.544653+0000","last_became_peered":"2024-09-12T17:10:48.544653+0000","last_unstale":"2024-09-12T18:12:07.754573+0000","last_undegraded":"2024-09-12T18:12:07.754573+0000","last_fullsized":"2024-09-12T18:12:07.754573+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'204","last_scrub_stamp":"2024-09-12T18:12:07.754451+0000","last_deep_scrub":"263'204","last_deep_scrub_stamp":"2024-09-12T18:12:07.754451+0000","last_clean_scrub_stamp":"2024-09-12T18:12:07.754451+0000","objects_scrubbed":5,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:02:06.311539+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13571,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":286,"num_read_kb":396,"num_write":142,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":495,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:04.752859+0000","last_change":"2024-09-12T18:12:04.752859+0000","last_active":"2024-09-12T18:12:04.752859+0000","last_peered":"2024-09-12T18:12:04.752859+0000","last_clean":"2024-09-12T18:12:04.752859+0000","last_became_active":"2024-09-12T17:10:50.555473+0000","last_became_peered":"2024-09-12T17:10:50.555473+0000","last_unstale":"2024-09-12T18:12:04.752859+0000","last_undegraded":"2024-09-12T18:12:04.752859+0000","last_fullsized":"2024-09-12T18:12:04.752859+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:04.752774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:04.752774+0000","last_clean_scrub_stamp":"2024-09-12T18:12:04.752774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:02:14.647232+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"263'119","reported_seq":636,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:13.496114+0000","last_change":"2024-09-12T18:12:13.496114+0000","last_active":"2024-09-12T18:12:13.496114+0000","last_peered":"2024-09-12T18:12:13.496114+0000","last_clean":"2024-09-12T18:12:13.496114+0000","last_became_active":"2024-09-12T17:10:52.571225+0000","last_became_peered":"2024-09-12T17:10:52.571225+0000","last_unstale":"2024-09-12T18:12:13.496114+0000","last_undegraded":"2024-09-12T18:12:13.496114+0000","last_fullsized":"2024-09-12T18:12:13.496114+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'119","last_scrub_stamp":"2024-09-12T18:12:13.496017+0000","last_deep_scrub":"263'119","last_deep_scrub_stamp":"2024-09-12T18:12:13.496017+0000","last_clean_scrub_stamp":"2024-09-12T18:12:13.496017+0000","objects_scrubbed":3,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:05:01.416556+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":910,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":137,"num_read_kb":136,"num_write":254,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"263'475","reported_seq":2098,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:53.403989+0000","last_change":"2024-09-12T18:11:53.403989+0000","last_active":"2024-09-12T18:11:53.403989+0000","last_peered":"2024-09-12T18:11:53.403989+0000","last_clean":"2024-09-12T18:11:53.403989+0000","last_became_active":"2024-09-12T17:10:44.516255+0000","last_became_peered":"2024-09-12T17:10:44.516255+0000","last_unstale":"2024-09-12T18:11:53.403989+0000","last_undegraded":"2024-09-12T18:11:53.403989+0000","last_fullsized":"2024-09-12T18:11:53.403989+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'475","last_scrub_stamp":"2024-09-12T18:11:53.403890+0000","last_deep_scrub":"263'475","last_deep_scrub_stamp":"2024-09-12T18:11:53.403890+0000","last_clean_scrub_stamp":"2024-09-12T18:11:53.403890+0000","objects_scrubbed":3,"log_size":75,"log_dups_size":400,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:52:22.138939+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2470,"num_read_kb":2330,"num_write":539,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":225,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"263'218","reported_seq":846,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:49.555656+0000","last_change":"2024-09-12T18:11:49.555656+0000","last_active":"2024-09-12T18:11:49.555656+0000","last_peered":"2024-09-12T18:11:49.555656+0000","last_clean":"2024-09-12T18:11:49.555656+0000","last_became_active":"2024-09-12T17:11:16.862702+0000","last_became_peered":"2024-09-12T17:11:16.862702+0000","last_unstale":"2024-09-12T18:11:49.555656+0000","last_undegraded":"2024-09-12T18:11:49.555656+0000","last_fullsized":"2024-09-12T18:11:49.555656+0000","mapping_epoch":37,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'218","last_scrub_stamp":"2024-09-12T18:11:49.555539+0000","last_deep_scrub":"263'218","last_deep_scrub_stamp":"2024-09-12T18:11:49.555539+0000","last_clean_scrub_stamp":"2024-09-12T18:11:49.555539+0000","objects_scrubbed":3,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:28:46.491751+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079942,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":414,"num_read_kb":1752,"num_write":1053,"num_write_kb":46733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,4,7],"acting":[3,2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:00.757095+0000","last_change":"2024-09-12T18:12:00.757095+0000","last_active":"2024-09-12T18:12:00.757095+0000","last_peered":"2024-09-12T18:12:00.757095+0000","last_clean":"2024-09-12T18:12:00.757095+0000","last_became_active":"2024-09-12T17:10:46.524638+0000","last_became_peered":"2024-09-12T17:10:46.524638+0000","last_unstale":"2024-09-12T18:12:00.757095+0000","last_undegraded":"2024-09-12T18:12:00.757095+0000","last_fullsized":"2024-09-12T18:12:00.757095+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:00.756978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:00.756978+0000","last_clean_scrub_stamp":"2024-09-12T18:12:00.756978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:05:19.943694+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"263'157","reported_seq":749,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:13.374169+0000","last_change":"2024-09-12T18:12:13.374169+0000","last_active":"2024-09-12T18:12:13.374169+0000","last_peered":"2024-09-12T18:12:13.374169+0000","last_clean":"2024-09-12T18:12:13.374169+0000","last_became_active":"2024-09-12T17:10:48.537923+0000","last_became_peered":"2024-09-12T17:10:48.537923+0000","last_unstale":"2024-09-12T18:12:13.374169+0000","last_undegraded":"2024-09-12T18:12:13.374169+0000","last_fullsized":"2024-09-12T18:12:13.374169+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'157","last_scrub_stamp":"2024-09-12T18:12:13.374068+0000","last_deep_scrub":"263'157","last_deep_scrub_stamp":"2024-09-12T18:12:13.374068+0000","last_clean_scrub_stamp":"2024-09-12T18:12:13.374068+0000","objects_scrubbed":6,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:25:49.577753+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7449,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":229,"num_read_kb":291,"num_write":178,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15964,"num_omap_keys":38,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":501,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:14.682641+0000","last_change":"2024-09-12T18:12:14.682641+0000","last_active":"2024-09-12T18:12:14.682641+0000","last_peered":"2024-09-12T18:12:14.682641+0000","last_clean":"2024-09-12T18:12:14.682641+0000","last_became_active":"2024-09-12T17:10:50.563507+0000","last_became_peered":"2024-09-12T17:10:50.563507+0000","last_unstale":"2024-09-12T18:12:14.682641+0000","last_undegraded":"2024-09-12T18:12:14.682641+0000","last_fullsized":"2024-09-12T18:12:14.682641+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:14.682537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:14.682537+0000","last_clean_scrub_stamp":"2024-09-12T18:12:14.682537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:59:17.113966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"263'129","reported_seq":652,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:23.662315+0000","last_change":"2024-09-12T18:12:23.662315+0000","last_active":"2024-09-12T18:12:23.662315+0000","last_peered":"2024-09-12T18:12:23.662315+0000","last_clean":"2024-09-12T18:12:23.662315+0000","last_became_active":"2024-09-12T17:10:52.575293+0000","last_became_peered":"2024-09-12T17:10:52.575293+0000","last_unstale":"2024-09-12T18:12:23.662315+0000","last_undegraded":"2024-09-12T18:12:23.662315+0000","last_fullsized":"2024-09-12T18:12:23.662315+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'129","last_scrub_stamp":"2024-09-12T18:12:23.662227+0000","last_deep_scrub":"263'129","last_deep_scrub_stamp":"2024-09-12T18:12:23.662227+0000","last_clean_scrub_stamp":"2024-09-12T18:12:23.662227+0000","objects_scrubbed":3,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:40:00.640502+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":248,"num_read_kb":220,"num_write":319,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"263'998","reported_seq":2626,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:54.382075+0000","last_change":"2024-09-12T18:11:54.382075+0000","last_active":"2024-09-12T18:11:54.382075+0000","last_peered":"2024-09-12T18:11:54.382075+0000","last_clean":"2024-09-12T18:11:54.382075+0000","last_became_active":"2024-09-12T17:10:44.515098+0000","last_became_peered":"2024-09-12T17:10:44.515098+0000","last_unstale":"2024-09-12T18:11:54.382075+0000","last_undegraded":"2024-09-12T18:11:54.382075+0000","last_fullsized":"2024-09-12T18:11:54.382075+0000","mapping_epoch":26,"log_start":"263'900","ondisk_log_start":"263'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'998","last_scrub_stamp":"2024-09-12T18:11:54.381986+0000","last_deep_scrub":"263'998","last_deep_scrub_stamp":"2024-09-12T18:11:54.381986+0000","last_clean_scrub_stamp":"2024-09-12T18:11:54.381986+0000","objects_scrubbed":3,"log_size":98,"log_dups_size":900,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:57:33.212113+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4616,"num_read_kb":4072,"num_write":1360,"num_write_kb":579,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"263'209","reported_seq":858,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:48.820208+0000","last_change":"2024-09-12T18:11:48.820208+0000","last_active":"2024-09-12T18:11:48.820208+0000","last_peered":"2024-09-12T18:11:48.820208+0000","last_clean":"2024-09-12T18:11:48.820208+0000","last_became_active":"2024-09-12T17:10:42.515480+0000","last_became_peered":"2024-09-12T17:10:42.515480+0000","last_unstale":"2024-09-12T18:11:48.820208+0000","last_undegraded":"2024-09-12T18:11:48.820208+0000","last_fullsized":"2024-09-12T18:11:48.820208+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'209","last_scrub_stamp":"2024-09-12T18:11:48.820082+0000","last_deep_scrub":"263'209","last_deep_scrub_stamp":"2024-09-12T18:11:48.820082+0000","last_clean_scrub_stamp":"2024-09-12T18:11:48.820082+0000","objects_scrubbed":5,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:31:06.353554+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4364954,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":507,"num_read_kb":28749,"num_write":1020,"num_write_kb":24822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1,7],"acting":[6,4,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":510,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:00.573603+0000","last_change":"2024-09-12T18:12:00.573603+0000","last_active":"2024-09-12T18:12:00.573603+0000","last_peered":"2024-09-12T18:12:00.573603+0000","last_clean":"2024-09-12T18:12:00.573603+0000","last_became_active":"2024-09-12T17:10:46.532552+0000","last_became_peered":"2024-09-12T17:10:46.532552+0000","last_unstale":"2024-09-12T18:12:00.573603+0000","last_undegraded":"2024-09-12T18:12:00.573603+0000","last_fullsized":"2024-09-12T18:12:00.573603+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:00.573517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:00.573517+0000","last_clean_scrub_stamp":"2024-09-12T18:12:00.573517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:33:18.527965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"263'179","reported_seq":773,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:03.736258+0000","last_change":"2024-09-12T18:12:03.736258+0000","last_active":"2024-09-12T18:12:03.736258+0000","last_peered":"2024-09-12T18:12:03.736258+0000","last_clean":"2024-09-12T18:12:03.736258+0000","last_became_active":"2024-09-12T17:10:48.542298+0000","last_became_peered":"2024-09-12T17:10:48.542298+0000","last_unstale":"2024-09-12T18:12:03.736258+0000","last_undegraded":"2024-09-12T18:12:03.736258+0000","last_fullsized":"2024-09-12T18:12:03.736258+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'179","last_scrub_stamp":"2024-09-12T18:12:03.736151+0000","last_deep_scrub":"263'179","last_deep_scrub_stamp":"2024-09-12T18:12:03.736151+0000","last_clean_scrub_stamp":"2024-09-12T18:12:03.736151+0000","objects_scrubbed":7,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:35:13.912374+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5018,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":233,"num_read_kb":318,"num_write":134,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"263'747","reported_seq":2533,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:02.775270+0000","last_change":"2024-09-12T18:12:02.775270+0000","last_active":"2024-09-12T18:12:02.775270+0000","last_peered":"2024-09-12T18:12:02.775270+0000","last_clean":"2024-09-12T18:12:02.775270+0000","last_became_active":"2024-09-12T17:10:50.557305+0000","last_became_peered":"2024-09-12T17:10:50.557305+0000","last_unstale":"2024-09-12T18:12:02.775270+0000","last_undegraded":"2024-09-12T18:12:02.775270+0000","last_fullsized":"2024-09-12T18:12:02.775270+0000","mapping_epoch":32,"log_start":"263'700","ondisk_log_start":"263'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'747","last_scrub_stamp":"2024-09-12T18:12:02.775178+0000","last_deep_scrub":"263'747","last_deep_scrub_stamp":"2024-09-12T18:12:02.775178+0000","last_clean_scrub_stamp":"2024-09-12T18:12:02.775178+0000","objects_scrubbed":1,"log_size":47,"log_dups_size":700,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:35.079087+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"263'122","reported_seq":637,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:11.455948+0000","last_change":"2024-09-12T18:12:11.455948+0000","last_active":"2024-09-12T18:12:11.455948+0000","last_peered":"2024-09-12T18:12:11.455948+0000","last_clean":"2024-09-12T18:12:11.455948+0000","last_became_active":"2024-09-12T17:10:52.571344+0000","last_became_peered":"2024-09-12T17:10:52.571344+0000","last_unstale":"2024-09-12T18:12:11.455948+0000","last_undegraded":"2024-09-12T18:12:11.455948+0000","last_fullsized":"2024-09-12T18:12:11.455948+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'122","last_scrub_stamp":"2024-09-12T18:12:11.455861+0000","last_deep_scrub":"263'122","last_deep_scrub_stamp":"2024-09-12T18:12:11.455861+0000","last_clean_scrub_stamp":"2024-09-12T18:12:11.455861+0000","objects_scrubbed":5,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:51:03.082932+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1852,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":171,"num_read_kb":161,"num_write":288,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"263'490","reported_seq":2165,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:52.356454+0000","last_change":"2024-09-12T18:11:52.356454+0000","last_active":"2024-09-12T18:11:52.356454+0000","last_peered":"2024-09-12T18:11:52.356454+0000","last_clean":"2024-09-12T18:11:52.356454+0000","last_became_active":"2024-09-12T17:10:44.509293+0000","last_became_peered":"2024-09-12T17:10:44.509293+0000","last_unstale":"2024-09-12T18:11:52.356454+0000","last_undegraded":"2024-09-12T18:11:52.356454+0000","last_fullsized":"2024-09-12T18:11:52.356454+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'490","last_scrub_stamp":"2024-09-12T18:11:52.356345+0000","last_deep_scrub":"263'490","last_deep_scrub_stamp":"2024-09-12T18:11:52.356345+0000","last_clean_scrub_stamp":"2024-09-12T18:11:52.356345+0000","objects_scrubbed":4,"log_size":90,"log_dups_size":400,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:17:42.560325+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2823,"num_read_kb":2653,"num_write":584,"num_write_kb":143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1419,"num_omap_keys":6,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"263'186","reported_seq":846,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:47.544051+0000","last_change":"2024-09-12T18:11:47.544051+0000","last_active":"2024-09-12T18:11:47.544051+0000","last_peered":"2024-09-12T18:11:47.544051+0000","last_clean":"2024-09-12T18:11:47.544051+0000","last_became_active":"2024-09-12T17:10:42.515196+0000","last_became_peered":"2024-09-12T17:10:42.515196+0000","last_unstale":"2024-09-12T18:11:47.544051+0000","last_undegraded":"2024-09-12T18:11:47.544051+0000","last_fullsized":"2024-09-12T18:11:47.544051+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'186","last_scrub_stamp":"2024-09-12T18:11:47.543937+0000","last_deep_scrub":"263'186","last_deep_scrub_stamp":"2024-09-12T18:11:47.543937+0000","last_clean_scrub_stamp":"2024-09-12T18:11:47.543937+0000","objects_scrubbed":4,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:47:46.850299+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262519,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":441,"num_read_kb":72235,"num_write":829,"num_write_kb":40150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7,1],"acting":[4,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"263'4","reported_seq":1458,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:11.409697+0000","last_change":"2024-09-12T18:12:11.409697+0000","last_active":"2024-09-12T18:12:11.409697+0000","last_peered":"2024-09-12T18:12:11.409697+0000","last_clean":"2024-09-12T18:12:11.409697+0000","last_became_active":"2024-09-12T17:10:46.531032+0000","last_became_peered":"2024-09-12T17:10:46.531032+0000","last_unstale":"2024-09-12T18:12:11.409697+0000","last_undegraded":"2024-09-12T18:12:11.409697+0000","last_fullsized":"2024-09-12T18:12:11.409697+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-09-12T18:12:11.409610+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-09-12T18:12:11.409610+0000","last_clean_scrub_stamp":"2024-09-12T18:12:11.409610+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:24:08.839096+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":950,"num_read_kb":950,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"263'82","reported_seq":613,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:14.675990+0000","last_change":"2024-09-12T18:12:14.675990+0000","last_active":"2024-09-12T18:12:14.675990+0000","last_peered":"2024-09-12T18:12:14.675990+0000","last_clean":"2024-09-12T18:12:14.675990+0000","last_became_active":"2024-09-12T17:10:48.532817+0000","last_became_peered":"2024-09-12T17:10:48.532817+0000","last_unstale":"2024-09-12T18:12:14.675990+0000","last_undegraded":"2024-09-12T18:12:14.675990+0000","last_fullsized":"2024-09-12T18:12:14.675990+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'82","last_scrub_stamp":"2024-09-12T18:12:14.675899+0000","last_deep_scrub":"263'82","last_deep_scrub_stamp":"2024-09-12T18:12:14.675899+0000","last_clean_scrub_stamp":"2024-09-12T18:12:14.675899+0000","objects_scrubbed":5,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:42:48.311031+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":90,"num_read_kb":85,"num_write":60,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"263'763","reported_seq":2412,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:05.704731+0000","last_change":"2024-09-12T18:12:05.704731+0000","last_active":"2024-09-12T18:12:05.704731+0000","last_peered":"2024-09-12T18:12:05.704731+0000","last_clean":"2024-09-12T18:12:05.704731+0000","last_became_active":"2024-09-12T17:10:50.563002+0000","last_became_peered":"2024-09-12T17:10:50.563002+0000","last_unstale":"2024-09-12T18:12:05.704731+0000","last_undegraded":"2024-09-12T18:12:05.704731+0000","last_fullsized":"2024-09-12T18:12:05.704731+0000","mapping_epoch":32,"log_start":"263'700","ondisk_log_start":"263'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'763","last_scrub_stamp":"2024-09-12T18:12:05.704624+0000","last_deep_scrub":"263'763","last_deep_scrub_stamp":"2024-09-12T18:12:05.704624+0000","last_clean_scrub_stamp":"2024-09-12T18:12:05.704624+0000","objects_scrubbed":1,"log_size":63,"log_dups_size":700,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:44:52.539626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"263'147","reported_seq":655,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:18.340470+0000","last_change":"2024-09-12T18:12:18.340470+0000","last_active":"2024-09-12T18:12:18.340470+0000","last_peered":"2024-09-12T18:12:18.340470+0000","last_clean":"2024-09-12T18:12:18.340470+0000","last_became_active":"2024-09-12T17:10:52.570643+0000","last_became_peered":"2024-09-12T17:10:52.570643+0000","last_unstale":"2024-09-12T18:12:18.340470+0000","last_undegraded":"2024-09-12T18:12:18.340470+0000","last_fullsized":"2024-09-12T18:12:18.340470+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'147","last_scrub_stamp":"2024-09-12T18:12:18.340367+0000","last_deep_scrub":"263'147","last_deep_scrub_stamp":"2024-09-12T18:12:18.340367+0000","last_clean_scrub_stamp":"2024-09-12T18:12:18.340367+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:28:45.461673+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":160,"num_read_kb":158,"num_write":329,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"263'806","reported_seq":2293,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:57.545434+0000","last_change":"2024-09-12T18:11:57.545434+0000","last_active":"2024-09-12T18:11:57.545434+0000","last_peered":"2024-09-12T18:11:57.545434+0000","last_clean":"2024-09-12T18:11:57.545434+0000","last_became_active":"2024-09-12T17:10:44.518111+0000","last_became_peered":"2024-09-12T17:10:44.518111+0000","last_unstale":"2024-09-12T18:11:57.545434+0000","last_undegraded":"2024-09-12T18:11:57.545434+0000","last_fullsized":"2024-09-12T18:11:57.545434+0000","mapping_epoch":26,"log_start":"263'700","ondisk_log_start":"263'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'806","last_scrub_stamp":"2024-09-12T18:11:57.545339+0000","last_deep_scrub":"263'806","last_deep_scrub_stamp":"2024-09-12T18:11:57.545339+0000","last_clean_scrub_stamp":"2024-09-12T18:11:57.545339+0000","objects_scrubbed":2,"log_size":106,"log_dups_size":700,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:34:03.644456+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3856,"num_read_kb":3439,"num_write":1073,"num_write_kb":406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"263'210","reported_seq":838,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:48.517973+0000","last_change":"2024-09-12T18:11:48.517973+0000","last_active":"2024-09-12T18:11:48.517973+0000","last_peered":"2024-09-12T18:11:48.517973+0000","last_clean":"2024-09-12T18:11:48.517973+0000","last_became_active":"2024-09-12T17:10:42.522669+0000","last_became_peered":"2024-09-12T17:10:42.522669+0000","last_unstale":"2024-09-12T18:11:48.517973+0000","last_undegraded":"2024-09-12T18:11:48.517973+0000","last_fullsized":"2024-09-12T18:11:48.517973+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'210","last_scrub_stamp":"2024-09-12T18:11:48.517865+0000","last_deep_scrub":"263'210","last_deep_scrub_stamp":"2024-09-12T18:11:48.517865+0000","last_clean_scrub_stamp":"2024-09-12T18:11:48.517865+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:15:40.427265+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":435,"num_read_kb":8704,"num_write":950,"num_write_kb":27929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,4],"acting":[3,1,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":512,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:06.336266+0000","last_change":"2024-09-12T18:12:06.336266+0000","last_active":"2024-09-12T18:12:06.336266+0000","last_peered":"2024-09-12T18:12:06.336266+0000","last_clean":"2024-09-12T18:12:06.336266+0000","last_became_active":"2024-09-12T17:10:46.533572+0000","last_became_peered":"2024-09-12T17:10:46.533572+0000","last_unstale":"2024-09-12T18:12:06.336266+0000","last_undegraded":"2024-09-12T18:12:06.336266+0000","last_fullsized":"2024-09-12T18:12:06.336266+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:06.336175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:06.336175+0000","last_clean_scrub_stamp":"2024-09-12T18:12:06.336175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:37:00.694932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"263'255","reported_seq":873,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:12.386853+0000","last_change":"2024-09-12T18:12:12.386853+0000","last_active":"2024-09-12T18:12:12.386853+0000","last_peered":"2024-09-12T18:12:12.386853+0000","last_clean":"2024-09-12T18:12:12.386853+0000","last_became_active":"2024-09-12T17:10:48.542616+0000","last_became_peered":"2024-09-12T17:10:48.542616+0000","last_unstale":"2024-09-12T18:12:12.386853+0000","last_undegraded":"2024-09-12T18:12:12.386853+0000","last_fullsized":"2024-09-12T18:12:12.386853+0000","mapping_epoch":30,"log_start":"263'200","ondisk_log_start":"263'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'255","last_scrub_stamp":"2024-09-12T18:12:12.386728+0000","last_deep_scrub":"263'255","last_deep_scrub_stamp":"2024-09-12T18:12:12.386728+0000","last_clean_scrub_stamp":"2024-09-12T18:12:12.386728+0000","objects_scrubbed":9,"log_size":55,"log_dups_size":200,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:10:23.253010+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5964,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":933,"num_read_kb":1007,"num_write":1456,"num_write_kb":1313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":489246,"num_omap_keys":1130,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":498,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:03.738357+0000","last_change":"2024-09-12T18:12:03.738357+0000","last_active":"2024-09-12T18:12:03.738357+0000","last_peered":"2024-09-12T18:12:03.738357+0000","last_clean":"2024-09-12T18:12:03.738357+0000","last_became_active":"2024-09-12T17:10:50.550189+0000","last_became_peered":"2024-09-12T17:10:50.550189+0000","last_unstale":"2024-09-12T18:12:03.738357+0000","last_undegraded":"2024-09-12T18:12:03.738357+0000","last_fullsized":"2024-09-12T18:12:03.738357+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:03.738233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:03.738233+0000","last_clean_scrub_stamp":"2024-09-12T18:12:03.738233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:20:01.107417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"263'166","reported_seq":683,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:12.478687+0000","last_change":"2024-09-12T18:12:12.478687+0000","last_active":"2024-09-12T18:12:12.478687+0000","last_peered":"2024-09-12T18:12:12.478687+0000","last_clean":"2024-09-12T18:12:12.478687+0000","last_became_active":"2024-09-12T17:10:52.572508+0000","last_became_peered":"2024-09-12T17:10:52.572508+0000","last_unstale":"2024-09-12T18:12:12.478687+0000","last_undegraded":"2024-09-12T18:12:12.478687+0000","last_fullsized":"2024-09-12T18:12:12.478687+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'166","last_scrub_stamp":"2024-09-12T18:12:12.478578+0000","last_deep_scrub":"263'166","last_deep_scrub_stamp":"2024-09-12T18:12:12.478578+0000","last_clean_scrub_stamp":"2024-09-12T18:12:12.478578+0000","objects_scrubbed":4,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:48:01.094220+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":869,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":242,"num_read_kb":227,"num_write":399,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"263'2315","reported_seq":3936,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:54.768516+0000","last_change":"2024-09-12T18:11:54.768516+0000","last_active":"2024-09-12T18:11:54.768516+0000","last_peered":"2024-09-12T18:11:54.768516+0000","last_clean":"2024-09-12T18:11:54.768516+0000","last_became_active":"2024-09-12T17:10:44.515045+0000","last_became_peered":"2024-09-12T17:10:44.515045+0000","last_unstale":"2024-09-12T18:11:54.768516+0000","last_undegraded":"2024-09-12T18:11:54.768516+0000","last_fullsized":"2024-09-12T18:11:54.768516+0000","mapping_epoch":26,"log_start":"263'2300","ondisk_log_start":"263'2300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2315","last_scrub_stamp":"2024-09-12T18:11:54.768411+0000","last_deep_scrub":"263'2315","last_deep_scrub_stamp":"2024-09-12T18:11:54.768411+0000","last_clean_scrub_stamp":"2024-09-12T18:11:54.768411+0000","objects_scrubbed":2,"log_size":15,"log_dups_size":2300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:01:21.144459+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10108,"num_read_kb":8675,"num_write":3400,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"263'74","reported_seq":623,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:48.454708+0000","last_change":"2024-09-12T18:11:48.454645+0000","last_active":"2024-09-12T18:11:48.454708+0000","last_peered":"2024-09-12T18:11:48.454708+0000","last_clean":"2024-09-12T18:11:48.454708+0000","last_became_active":"2024-09-12T17:10:26.807964+0000","last_became_peered":"2024-09-12T17:10:26.807964+0000","last_unstale":"2024-09-12T18:11:48.454708+0000","last_undegraded":"2024-09-12T18:11:48.454708+0000","last_fullsized":"2024-09-12T18:11:48.454708+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'74","last_scrub_stamp":"2024-09-12T18:11:48.454546+0000","last_deep_scrub":"263'74","last_deep_scrub_stamp":"2024-09-12T18:11:48.454546+0000","last_clean_scrub_stamp":"2024-09-12T18:11:48.454546+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:42:01.929137+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"263'2","reported_seq":534,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:53.320213+0000","last_change":"2024-09-12T18:11:53.320142+0000","last_active":"2024-09-12T18:11:53.320213+0000","last_peered":"2024-09-12T18:11:53.320213+0000","last_clean":"2024-09-12T18:11:53.320213+0000","last_became_active":"2024-09-12T17:10:31.846572+0000","last_became_peered":"2024-09-12T17:10:31.846572+0000","last_unstale":"2024-09-12T18:11:53.320213+0000","last_undegraded":"2024-09-12T18:11:53.320213+0000","last_fullsized":"2024-09-12T18:11:53.320213+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T18:11:53.320051+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T18:11:53.320051+0000","last_clean_scrub_stamp":"2024-09-12T18:11:53.320051+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:30:24.755502+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.00060306800000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"263'227","reported_seq":856,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:46.512390+0000","last_change":"2024-09-12T18:11:46.512390+0000","last_active":"2024-09-12T18:11:46.512390+0000","last_peered":"2024-09-12T18:11:46.512390+0000","last_clean":"2024-09-12T18:11:46.512390+0000","last_became_active":"2024-09-12T17:10:42.527288+0000","last_became_peered":"2024-09-12T17:10:42.527288+0000","last_unstale":"2024-09-12T18:11:46.512390+0000","last_undegraded":"2024-09-12T18:11:46.512390+0000","last_fullsized":"2024-09-12T18:11:46.512390+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'227","last_scrub_stamp":"2024-09-12T18:11:46.512298+0000","last_deep_scrub":"263'227","last_deep_scrub_stamp":"2024-09-12T18:11:46.512298+0000","last_clean_scrub_stamp":"2024-09-12T18:11:46.512298+0000","objects_scrubbed":3,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:55:14.060256+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":95,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":424,"num_read_kb":3487,"num_write":1109,"num_write_kb":42610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6,4],"acting":[3,5,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"263'4","reported_seq":985,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:06.580020+0000","last_change":"2024-09-12T18:12:06.580020+0000","last_active":"2024-09-12T18:12:06.580020+0000","last_peered":"2024-09-12T18:12:06.580020+0000","last_clean":"2024-09-12T18:12:06.580020+0000","last_became_active":"2024-09-12T17:10:46.523069+0000","last_became_peered":"2024-09-12T17:10:46.523069+0000","last_unstale":"2024-09-12T18:12:06.580020+0000","last_undegraded":"2024-09-12T18:12:06.580020+0000","last_fullsized":"2024-09-12T18:12:06.580020+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-09-12T18:12:06.579875+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-09-12T18:12:06.579875+0000","last_clean_scrub_stamp":"2024-09-12T18:12:06.579875+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:55:16.328100+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":722,"num_read_kb":720,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"263'325","reported_seq":1034,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:14.453279+0000","last_change":"2024-09-12T18:12:14.453279+0000","last_active":"2024-09-12T18:12:14.453279+0000","last_peered":"2024-09-12T18:12:14.453279+0000","last_clean":"2024-09-12T18:12:14.453279+0000","last_became_active":"2024-09-12T17:10:48.542462+0000","last_became_peered":"2024-09-12T17:10:48.542462+0000","last_unstale":"2024-09-12T18:12:14.453279+0000","last_undegraded":"2024-09-12T18:12:14.453279+0000","last_fullsized":"2024-09-12T18:12:14.453279+0000","mapping_epoch":30,"log_start":"263'300","ondisk_log_start":"263'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'325","last_scrub_stamp":"2024-09-12T18:12:14.453164+0000","last_deep_scrub":"263'325","last_deep_scrub_stamp":"2024-09-12T18:12:14.453164+0000","last_clean_scrub_stamp":"2024-09-12T18:12:14.453164+0000","objects_scrubbed":6,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:09:40.928743+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37371,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":611,"num_read_kb":866,"num_write":568,"num_write_kb":434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":106660,"num_omap_keys":256,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:12.674548+0000","last_change":"2024-09-12T18:12:12.674548+0000","last_active":"2024-09-12T18:12:12.674548+0000","last_peered":"2024-09-12T18:12:12.674548+0000","last_clean":"2024-09-12T18:12:12.674548+0000","last_became_active":"2024-09-12T17:10:50.558129+0000","last_became_peered":"2024-09-12T17:10:50.558129+0000","last_unstale":"2024-09-12T18:12:12.674548+0000","last_undegraded":"2024-09-12T18:12:12.674548+0000","last_fullsized":"2024-09-12T18:12:12.674548+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:12.674459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:12.674459+0000","last_clean_scrub_stamp":"2024-09-12T18:12:12.674459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:23:39.886250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"263'217","reported_seq":942,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:09.712447+0000","last_change":"2024-09-12T18:12:09.712447+0000","last_active":"2024-09-12T18:12:09.712447+0000","last_peered":"2024-09-12T18:12:09.712447+0000","last_clean":"2024-09-12T18:12:09.712447+0000","last_became_active":"2024-09-12T17:10:52.574433+0000","last_became_peered":"2024-09-12T17:10:52.574433+0000","last_unstale":"2024-09-12T18:12:09.712447+0000","last_undegraded":"2024-09-12T18:12:09.712447+0000","last_fullsized":"2024-09-12T18:12:09.712447+0000","mapping_epoch":34,"log_start":"263'200","ondisk_log_start":"263'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'217","last_scrub_stamp":"2024-09-12T18:12:09.712350+0000","last_deep_scrub":"263'217","last_deep_scrub_stamp":"2024-09-12T18:12:09.712350+0000","last_clean_scrub_stamp":"2024-09-12T18:12:09.712350+0000","objects_scrubbed":4,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:24:37.061346+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":852,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":555,"num_read_kb":537,"num_write":455,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":66,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"263'583","reported_seq":2177,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:55.730687+0000","last_change":"2024-09-12T18:11:55.730687+0000","last_active":"2024-09-12T18:11:55.730687+0000","last_peered":"2024-09-12T18:11:55.730687+0000","last_clean":"2024-09-12T18:11:55.730687+0000","last_became_active":"2024-09-12T17:10:44.520484+0000","last_became_peered":"2024-09-12T17:10:44.520484+0000","last_unstale":"2024-09-12T18:11:55.730687+0000","last_undegraded":"2024-09-12T18:11:55.730687+0000","last_fullsized":"2024-09-12T18:11:55.730687+0000","mapping_epoch":26,"log_start":"263'500","ondisk_log_start":"263'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'583","last_scrub_stamp":"2024-09-12T18:11:55.730573+0000","last_deep_scrub":"263'583","last_deep_scrub_stamp":"2024-09-12T18:11:55.730573+0000","last_clean_scrub_stamp":"2024-09-12T18:11:55.730573+0000","objects_scrubbed":1,"log_size":83,"log_dups_size":500,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:47:46.532008+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3105,"num_read_kb":2836,"num_write":745,"num_write_kb":252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":529,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:49.492647+0000","last_change":"2024-09-12T18:11:49.492585+0000","last_active":"2024-09-12T18:11:49.492647+0000","last_peered":"2024-09-12T18:11:49.492647+0000","last_clean":"2024-09-12T18:11:49.492647+0000","last_became_active":"2024-09-12T17:10:31.848972+0000","last_became_peered":"2024-09-12T17:10:31.848972+0000","last_unstale":"2024-09-12T18:11:49.492647+0000","last_undegraded":"2024-09-12T18:11:49.492647+0000","last_fullsized":"2024-09-12T18:11:49.492647+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:11:49.492494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:11:49.492494+0000","last_clean_scrub_stamp":"2024-09-12T18:11:49.492494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:54:40.685079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054881099999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"263'247","reported_seq":900,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:44.672013+0000","last_change":"2024-09-12T18:11:44.672013+0000","last_active":"2024-09-12T18:11:44.672013+0000","last_peered":"2024-09-12T18:11:44.672013+0000","last_clean":"2024-09-12T18:11:44.672013+0000","last_became_active":"2024-09-12T17:10:42.518190+0000","last_became_peered":"2024-09-12T17:10:42.518190+0000","last_unstale":"2024-09-12T18:11:44.672013+0000","last_undegraded":"2024-09-12T18:11:44.672013+0000","last_fullsized":"2024-09-12T18:11:44.672013+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'247","last_scrub_stamp":"2024-09-12T18:11:44.671868+0000","last_deep_scrub":"263'247","last_deep_scrub_stamp":"2024-09-12T18:11:44.671868+0000","last_clean_scrub_stamp":"2024-09-12T18:11:44.671868+0000","objects_scrubbed":3,"log_size":47,"log_dups_size":200,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:21:51.032960+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":522,"num_read_kb":6824,"num_write":1149,"num_write_kb":47378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3,5],"acting":[0,4,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":505,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:08.487418+0000","last_change":"2024-09-12T18:12:08.487418+0000","last_active":"2024-09-12T18:12:08.487418+0000","last_peered":"2024-09-12T18:12:08.487418+0000","last_clean":"2024-09-12T18:12:08.487418+0000","last_became_active":"2024-09-12T17:10:46.528192+0000","last_became_peered":"2024-09-12T17:10:46.528192+0000","last_unstale":"2024-09-12T18:12:08.487418+0000","last_undegraded":"2024-09-12T18:12:08.487418+0000","last_fullsized":"2024-09-12T18:12:08.487418+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:08.487317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:08.487317+0000","last_clean_scrub_stamp":"2024-09-12T18:12:08.487317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:16:35.101051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"263'884","reported_seq":2553,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:07.517456+0000","last_change":"2024-09-12T18:12:07.517456+0000","last_active":"2024-09-12T18:12:07.517456+0000","last_peered":"2024-09-12T18:12:07.517456+0000","last_clean":"2024-09-12T18:12:07.517456+0000","last_became_active":"2024-09-12T17:10:48.544823+0000","last_became_peered":"2024-09-12T17:10:48.544823+0000","last_unstale":"2024-09-12T18:12:07.517456+0000","last_undegraded":"2024-09-12T18:12:07.517456+0000","last_fullsized":"2024-09-12T18:12:07.517456+0000","mapping_epoch":30,"log_start":"263'800","ondisk_log_start":"263'800","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'884","last_scrub_stamp":"2024-09-12T18:12:07.517337+0000","last_deep_scrub":"263'884","last_deep_scrub_stamp":"2024-09-12T18:12:07.517337+0000","last_clean_scrub_stamp":"2024-09-12T18:12:07.517337+0000","objects_scrubbed":11,"log_size":84,"log_dups_size":800,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:11:07.692251+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19071,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1197,"num_read_kb":1359,"num_write":312,"num_write_kb":143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6238,"num_omap_keys":18,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:16.624404+0000","last_change":"2024-09-12T18:12:16.624404+0000","last_active":"2024-09-12T18:12:16.624404+0000","last_peered":"2024-09-12T18:12:16.624404+0000","last_clean":"2024-09-12T18:12:16.624404+0000","last_became_active":"2024-09-12T17:10:50.557660+0000","last_became_peered":"2024-09-12T17:10:50.557660+0000","last_unstale":"2024-09-12T18:12:16.624404+0000","last_undegraded":"2024-09-12T18:12:16.624404+0000","last_fullsized":"2024-09-12T18:12:16.624404+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:16.624312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:16.624312+0000","last_clean_scrub_stamp":"2024-09-12T18:12:16.624312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:46:22.828612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"263'190","reported_seq":765,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:14.477632+0000","last_change":"2024-09-12T18:12:14.477632+0000","last_active":"2024-09-12T18:12:14.477632+0000","last_peered":"2024-09-12T18:12:14.477632+0000","last_clean":"2024-09-12T18:12:14.477632+0000","last_became_active":"2024-09-12T17:10:52.671120+0000","last_became_peered":"2024-09-12T17:10:52.671120+0000","last_unstale":"2024-09-12T18:12:14.477632+0000","last_undegraded":"2024-09-12T18:12:14.477632+0000","last_fullsized":"2024-09-12T18:12:14.477632+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'190","last_scrub_stamp":"2024-09-12T18:12:14.477532+0000","last_deep_scrub":"263'190","last_deep_scrub_stamp":"2024-09-12T18:12:14.477532+0000","last_clean_scrub_stamp":"2024-09-12T18:12:14.477532+0000","objects_scrubbed":3,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:51:56.384984+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":855,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":437,"num_read_kb":369,"num_write":356,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"263'341","reported_seq":1699,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:54.594576+0000","last_change":"2024-09-12T18:11:54.594576+0000","last_active":"2024-09-12T18:11:54.594576+0000","last_peered":"2024-09-12T18:11:54.594576+0000","last_clean":"2024-09-12T18:11:54.594576+0000","last_became_active":"2024-09-12T17:10:44.516640+0000","last_became_peered":"2024-09-12T17:10:44.516640+0000","last_unstale":"2024-09-12T18:11:54.594576+0000","last_undegraded":"2024-09-12T18:11:54.594576+0000","last_fullsized":"2024-09-12T18:11:54.594576+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'341","last_scrub_stamp":"2024-09-12T18:11:54.594493+0000","last_deep_scrub":"263'341","last_deep_scrub_stamp":"2024-09-12T18:11:54.594493+0000","last_clean_scrub_stamp":"2024-09-12T18:11:54.594493+0000","objects_scrubbed":3,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:23:17.401626+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1748,"num_read_kb":1673,"num_write":375,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":528,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:45.850489+0000","last_change":"2024-09-12T18:11:45.850440+0000","last_active":"2024-09-12T18:11:45.850489+0000","last_peered":"2024-09-12T18:11:45.850489+0000","last_clean":"2024-09-12T18:11:45.850489+0000","last_became_active":"2024-09-12T17:10:31.841982+0000","last_became_peered":"2024-09-12T17:10:31.841982+0000","last_unstale":"2024-09-12T18:11:45.850489+0000","last_undegraded":"2024-09-12T18:11:45.850489+0000","last_fullsized":"2024-09-12T18:11:45.850489+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:11:45.850369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:11:45.850369+0000","last_clean_scrub_stamp":"2024-09-12T18:11:45.850369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:50:52.981654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00030998799999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"263'168","reported_seq":792,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:47.720294+0000","last_change":"2024-09-12T18:11:47.720241+0000","last_active":"2024-09-12T18:11:47.720294+0000","last_peered":"2024-09-12T18:11:47.720294+0000","last_clean":"2024-09-12T18:11:47.720294+0000","last_became_active":"2024-09-12T17:10:42.509396+0000","last_became_peered":"2024-09-12T17:10:42.509396+0000","last_unstale":"2024-09-12T18:11:47.720294+0000","last_undegraded":"2024-09-12T18:11:47.720294+0000","last_fullsized":"2024-09-12T18:11:47.720294+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'168","last_scrub_stamp":"2024-09-12T18:11:47.720156+0000","last_deep_scrub":"263'168","last_deep_scrub_stamp":"2024-09-12T18:11:47.720156+0000","last_clean_scrub_stamp":"2024-09-12T18:11:47.720156+0000","objects_scrubbed":3,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:45:50.082004+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":350137,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":379,"num_read_kb":11016,"num_write":845,"num_write_kb":10341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6,5],"acting":[1,2,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"263'2","reported_seq":505,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:01.753020+0000","last_change":"2024-09-12T18:12:01.753020+0000","last_active":"2024-09-12T18:12:01.753020+0000","last_peered":"2024-09-12T18:12:01.753020+0000","last_clean":"2024-09-12T18:12:01.753020+0000","last_became_active":"2024-09-12T17:10:46.528878+0000","last_became_peered":"2024-09-12T17:10:46.528878+0000","last_unstale":"2024-09-12T18:12:01.753020+0000","last_undegraded":"2024-09-12T18:12:01.753020+0000","last_fullsized":"2024-09-12T18:12:01.753020+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T18:12:01.752936+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T18:12:01.752936+0000","last_clean_scrub_stamp":"2024-09-12T18:12:01.752936+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:05:28.456818+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"263'259","reported_seq":1529,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:10.570833+0000","last_change":"2024-09-12T18:12:10.570833+0000","last_active":"2024-09-12T18:12:10.570833+0000","last_peered":"2024-09-12T18:12:10.570833+0000","last_clean":"2024-09-12T18:12:10.570833+0000","last_became_active":"2024-09-12T17:10:48.543196+0000","last_became_peered":"2024-09-12T17:10:48.543196+0000","last_unstale":"2024-09-12T18:12:10.570833+0000","last_undegraded":"2024-09-12T18:12:10.570833+0000","last_fullsized":"2024-09-12T18:12:10.570833+0000","mapping_epoch":30,"log_start":"263'200","ondisk_log_start":"263'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'259","last_scrub_stamp":"2024-09-12T18:12:10.570716+0000","last_deep_scrub":"263'259","last_deep_scrub_stamp":"2024-09-12T18:12:10.570716+0000","last_clean_scrub_stamp":"2024-09-12T18:12:10.570716+0000","objects_scrubbed":9,"log_size":59,"log_dups_size":200,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:18:05.341247+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":209,"num_read_kb":201,"num_write":185,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5582,"num_omap_keys":14,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":503,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:11.670935+0000","last_change":"2024-09-12T18:12:11.670935+0000","last_active":"2024-09-12T18:12:11.670935+0000","last_peered":"2024-09-12T18:12:11.670935+0000","last_clean":"2024-09-12T18:12:11.670935+0000","last_became_active":"2024-09-12T17:10:50.558980+0000","last_became_peered":"2024-09-12T17:10:50.558980+0000","last_unstale":"2024-09-12T18:12:11.670935+0000","last_undegraded":"2024-09-12T18:12:11.670935+0000","last_fullsized":"2024-09-12T18:12:11.670935+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:11.670829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:11.670829+0000","last_clean_scrub_stamp":"2024-09-12T18:12:11.670829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:54:18.253183+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"263'258","reported_seq":864,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:24.683507+0000","last_change":"2024-09-12T18:12:24.683507+0000","last_active":"2024-09-12T18:12:24.683507+0000","last_peered":"2024-09-12T18:12:24.683507+0000","last_clean":"2024-09-12T18:12:24.683507+0000","last_became_active":"2024-09-12T17:10:52.563885+0000","last_became_peered":"2024-09-12T17:10:52.563885+0000","last_unstale":"2024-09-12T18:12:24.683507+0000","last_undegraded":"2024-09-12T18:12:24.683507+0000","last_fullsized":"2024-09-12T18:12:24.683507+0000","mapping_epoch":34,"log_start":"263'200","ondisk_log_start":"263'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'258","last_scrub_stamp":"2024-09-12T18:12:24.683417+0000","last_deep_scrub":"263'258","last_deep_scrub_stamp":"2024-09-12T18:12:24.683417+0000","last_clean_scrub_stamp":"2024-09-12T18:12:24.683417+0000","objects_scrubbed":2,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:16:31.315453+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":520,"num_read_kb":542,"num_write":569,"num_write_kb":161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1193,"num_omap_keys":7,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"263'669","reported_seq":2221,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:55.553257+0000","last_change":"2024-09-12T18:11:55.553257+0000","last_active":"2024-09-12T18:11:55.553257+0000","last_peered":"2024-09-12T18:11:55.553257+0000","last_clean":"2024-09-12T18:11:55.553257+0000","last_became_active":"2024-09-12T17:10:44.515807+0000","last_became_peered":"2024-09-12T17:10:44.515807+0000","last_unstale":"2024-09-12T18:11:55.553257+0000","last_undegraded":"2024-09-12T18:11:55.553257+0000","last_fullsized":"2024-09-12T18:11:55.553257+0000","mapping_epoch":26,"log_start":"263'600","ondisk_log_start":"263'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'669","last_scrub_stamp":"2024-09-12T18:11:55.553162+0000","last_deep_scrub":"263'669","last_deep_scrub_stamp":"2024-09-12T18:11:55.553162+0000","last_clean_scrub_stamp":"2024-09-12T18:11:55.553162+0000","objects_scrubbed":5,"log_size":69,"log_dups_size":600,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:56:28.156022+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3415,"num_read_kb":3057,"num_write":984,"num_write_kb":466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":477,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"263'3","reported_seq":535,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:47.214744+0000","last_change":"2024-09-12T18:11:47.214677+0000","last_active":"2024-09-12T18:11:47.214744+0000","last_peered":"2024-09-12T18:11:47.214744+0000","last_clean":"2024-09-12T18:11:47.214744+0000","last_became_active":"2024-09-12T17:10:31.849085+0000","last_became_peered":"2024-09-12T17:10:31.849085+0000","last_unstale":"2024-09-12T18:11:47.214744+0000","last_undegraded":"2024-09-12T18:11:47.214744+0000","last_fullsized":"2024-09-12T18:11:47.214744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'3","last_scrub_stamp":"2024-09-12T18:11:47.214591+0000","last_deep_scrub":"263'3","last_deep_scrub_stamp":"2024-09-12T18:11:47.214591+0000","last_clean_scrub_stamp":"2024-09-12T18:11:47.214591+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:31:02.245023+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.0011727,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"263'232","reported_seq":931,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:46.498359+0000","last_change":"2024-09-12T18:11:46.498359+0000","last_active":"2024-09-12T18:11:46.498359+0000","last_peered":"2024-09-12T18:11:46.498359+0000","last_clean":"2024-09-12T18:11:46.498359+0000","last_became_active":"2024-09-12T17:10:42.529499+0000","last_became_peered":"2024-09-12T17:10:42.529499+0000","last_unstale":"2024-09-12T18:11:46.498359+0000","last_undegraded":"2024-09-12T18:11:46.498359+0000","last_fullsized":"2024-09-12T18:11:46.498359+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'232","last_scrub_stamp":"2024-09-12T18:11:46.498219+0000","last_deep_scrub":"263'232","last_deep_scrub_stamp":"2024-09-12T18:11:46.498219+0000","last_clean_scrub_stamp":"2024-09-12T18:11:46.498219+0000","objects_scrubbed":2,"log_size":32,"log_dups_size":200,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:52:39.137136+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262174,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":565,"num_read_kb":10247,"num_write":1100,"num_write_kb":30448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,6],"acting":[4,5,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":511,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:04.687350+0000","last_change":"2024-09-12T18:12:04.687350+0000","last_active":"2024-09-12T18:12:04.687350+0000","last_peered":"2024-09-12T18:12:04.687350+0000","last_clean":"2024-09-12T18:12:04.687350+0000","last_became_active":"2024-09-12T17:10:46.526136+0000","last_became_peered":"2024-09-12T17:10:46.526136+0000","last_unstale":"2024-09-12T18:12:04.687350+0000","last_undegraded":"2024-09-12T18:12:04.687350+0000","last_fullsized":"2024-09-12T18:12:04.687350+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:04.687264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:04.687264+0000","last_clean_scrub_stamp":"2024-09-12T18:12:04.687264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:47:47.732114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"263'146","reported_seq":700,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:12.632726+0000","last_change":"2024-09-12T18:12:12.632726+0000","last_active":"2024-09-12T18:12:12.632726+0000","last_peered":"2024-09-12T18:12:12.632726+0000","last_clean":"2024-09-12T18:12:12.632726+0000","last_became_active":"2024-09-12T17:10:48.536247+0000","last_became_peered":"2024-09-12T17:10:48.536247+0000","last_unstale":"2024-09-12T18:12:12.632726+0000","last_undegraded":"2024-09-12T18:12:12.632726+0000","last_fullsized":"2024-09-12T18:12:12.632726+0000","mapping_epoch":30,"log_start":"263'100","ondisk_log_start":"263'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'146","last_scrub_stamp":"2024-09-12T18:12:12.632618+0000","last_deep_scrub":"263'146","last_deep_scrub_stamp":"2024-09-12T18:12:12.632618+0000","last_clean_scrub_stamp":"2024-09-12T18:12:12.632618+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:49:46.275446+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":163,"num_read_kb":156,"num_write":120,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3226,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:02.727739+0000","last_change":"2024-09-12T18:12:02.727739+0000","last_active":"2024-09-12T18:12:02.727739+0000","last_peered":"2024-09-12T18:12:02.727739+0000","last_clean":"2024-09-12T18:12:02.727739+0000","last_became_active":"2024-09-12T17:10:50.555747+0000","last_became_peered":"2024-09-12T17:10:50.555747+0000","last_unstale":"2024-09-12T18:12:02.727739+0000","last_undegraded":"2024-09-12T18:12:02.727739+0000","last_fullsized":"2024-09-12T18:12:02.727739+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:02.727650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:02.727650+0000","last_clean_scrub_stamp":"2024-09-12T18:12:02.727650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:59:58.866824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"263'123","reported_seq":676,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:19.515646+0000","last_change":"2024-09-12T18:12:19.515646+0000","last_active":"2024-09-12T18:12:19.515646+0000","last_peered":"2024-09-12T18:12:19.515646+0000","last_clean":"2024-09-12T18:12:19.515646+0000","last_became_active":"2024-09-12T17:10:52.574956+0000","last_became_peered":"2024-09-12T17:10:52.574956+0000","last_unstale":"2024-09-12T18:12:19.515646+0000","last_undegraded":"2024-09-12T18:12:19.515646+0000","last_fullsized":"2024-09-12T18:12:19.515646+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'123","last_scrub_stamp":"2024-09-12T18:12:19.515561+0000","last_deep_scrub":"263'123","last_deep_scrub_stamp":"2024-09-12T18:12:19.515561+0000","last_clean_scrub_stamp":"2024-09-12T18:12:19.515561+0000","objects_scrubbed":1,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:43:22.393991+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":427,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":242,"num_read_kb":241,"num_write":285,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"263'473","reported_seq":2087,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:53.613963+0000","last_change":"2024-09-12T18:11:53.613963+0000","last_active":"2024-09-12T18:11:53.613963+0000","last_peered":"2024-09-12T18:11:53.613963+0000","last_clean":"2024-09-12T18:11:53.613963+0000","last_became_active":"2024-09-12T17:10:44.516258+0000","last_became_peered":"2024-09-12T17:10:44.516258+0000","last_unstale":"2024-09-12T18:11:53.613963+0000","last_undegraded":"2024-09-12T18:11:53.613963+0000","last_fullsized":"2024-09-12T18:11:53.613963+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'473","last_scrub_stamp":"2024-09-12T18:11:53.613870+0000","last_deep_scrub":"263'473","last_deep_scrub_stamp":"2024-09-12T18:11:53.613870+0000","last_clean_scrub_stamp":"2024-09-12T18:11:53.613870+0000","objects_scrubbed":2,"log_size":73,"log_dups_size":400,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:01:14.309219+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2512,"num_read_kb":2369,"num_write":577,"num_write_kb":149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"263'182","reported_seq":889,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:57.349904+0000","last_change":"2024-09-12T18:11:57.349904+0000","last_active":"2024-09-12T18:11:57.349904+0000","last_peered":"2024-09-12T18:11:57.349904+0000","last_clean":"2024-09-12T18:11:57.349904+0000","last_became_active":"2024-09-12T17:10:42.520777+0000","last_became_peered":"2024-09-12T17:10:42.520777+0000","last_unstale":"2024-09-12T18:11:57.349904+0000","last_undegraded":"2024-09-12T18:11:57.349904+0000","last_fullsized":"2024-09-12T18:11:57.349904+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'182","last_scrub_stamp":"2024-09-12T18:11:57.349756+0000","last_deep_scrub":"263'182","last_deep_scrub_stamp":"2024-09-12T18:11:57.349756+0000","last_clean_scrub_stamp":"2024-09-12T18:11:57.349756+0000","objects_scrubbed":4,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:09:50.642477+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":574,"num_read_kb":36969,"num_write":896,"num_write_kb":42705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":538,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:45.674489+0000","last_change":"2024-09-12T18:11:45.674428+0000","last_active":"2024-09-12T18:11:45.674489+0000","last_peered":"2024-09-12T18:11:45.674489+0000","last_clean":"2024-09-12T18:11:45.674489+0000","last_became_active":"2024-09-12T17:10:32.177463+0000","last_became_peered":"2024-09-12T17:10:32.177463+0000","last_unstale":"2024-09-12T18:11:45.674489+0000","last_undegraded":"2024-09-12T18:11:45.674489+0000","last_fullsized":"2024-09-12T18:11:45.674489+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:11:45.674357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:11:45.674357+0000","last_clean_scrub_stamp":"2024-09-12T18:11:45.674357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:46:59.598150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059857599999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":511,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:03.662959+0000","last_change":"2024-09-12T18:12:03.662959+0000","last_active":"2024-09-12T18:12:03.662959+0000","last_peered":"2024-09-12T18:12:03.662959+0000","last_clean":"2024-09-12T18:12:03.662959+0000","last_became_active":"2024-09-12T17:10:46.528499+0000","last_became_peered":"2024-09-12T17:10:46.528499+0000","last_unstale":"2024-09-12T18:12:03.662959+0000","last_undegraded":"2024-09-12T18:12:03.662959+0000","last_fullsized":"2024-09-12T18:12:03.662959+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:03.662874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:03.662874+0000","last_clean_scrub_stamp":"2024-09-12T18:12:03.662874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:25:39.425009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"263'284","reported_seq":965,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:06.718160+0000","last_change":"2024-09-12T18:12:06.718101+0000","last_active":"2024-09-12T18:12:06.718160+0000","last_peered":"2024-09-12T18:12:06.718160+0000","last_clean":"2024-09-12T18:12:06.718160+0000","last_became_active":"2024-09-12T17:10:48.539913+0000","last_became_peered":"2024-09-12T17:10:48.539913+0000","last_unstale":"2024-09-12T18:12:06.718160+0000","last_undegraded":"2024-09-12T18:12:06.718160+0000","last_fullsized":"2024-09-12T18:12:06.718160+0000","mapping_epoch":30,"log_start":"260'200","ondisk_log_start":"260'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'284","last_scrub_stamp":"2024-09-12T18:12:06.717998+0000","last_deep_scrub":"263'284","last_deep_scrub_stamp":"2024-09-12T18:12:06.717998+0000","last_clean_scrub_stamp":"2024-09-12T18:12:06.717998+0000","objects_scrubbed":10,"log_size":84,"log_dups_size":200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:18:50.263181+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10695,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":387,"num_read_kb":478,"num_write":220,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4334,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":506,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:15.327262+0000","last_change":"2024-09-12T18:12:15.327262+0000","last_active":"2024-09-12T18:12:15.327262+0000","last_peered":"2024-09-12T18:12:15.327262+0000","last_clean":"2024-09-12T18:12:15.327262+0000","last_became_active":"2024-09-12T17:10:50.555068+0000","last_became_peered":"2024-09-12T17:10:50.555068+0000","last_unstale":"2024-09-12T18:12:15.327262+0000","last_undegraded":"2024-09-12T18:12:15.327262+0000","last_fullsized":"2024-09-12T18:12:15.327262+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:15.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:15.327146+0000","last_clean_scrub_stamp":"2024-09-12T18:12:15.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:35:28.660361+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"263'157","reported_seq":671,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:20.655030+0000","last_change":"2024-09-12T18:12:20.655030+0000","last_active":"2024-09-12T18:12:20.655030+0000","last_peered":"2024-09-12T18:12:20.655030+0000","last_clean":"2024-09-12T18:12:20.655030+0000","last_became_active":"2024-09-12T17:10:52.671238+0000","last_became_peered":"2024-09-12T17:10:52.671238+0000","last_unstale":"2024-09-12T18:12:20.655030+0000","last_undegraded":"2024-09-12T18:12:20.655030+0000","last_fullsized":"2024-09-12T18:12:20.655030+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'157","last_scrub_stamp":"2024-09-12T18:12:20.654938+0000","last_deep_scrub":"263'157","last_deep_scrub_stamp":"2024-09-12T18:12:20.654938+0000","last_clean_scrub_stamp":"2024-09-12T18:12:20.654938+0000","objects_scrubbed":4,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:56:04.155999+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":925,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":183,"num_read_kb":179,"num_write":356,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"263'542","reported_seq":2242,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:54.729977+0000","last_change":"2024-09-12T18:11:54.729977+0000","last_active":"2024-09-12T18:11:54.729977+0000","last_peered":"2024-09-12T18:11:54.729977+0000","last_clean":"2024-09-12T18:11:54.729977+0000","last_became_active":"2024-09-12T17:10:44.513543+0000","last_became_peered":"2024-09-12T17:10:44.513543+0000","last_unstale":"2024-09-12T18:11:54.729977+0000","last_undegraded":"2024-09-12T18:11:54.729977+0000","last_fullsized":"2024-09-12T18:11:54.729977+0000","mapping_epoch":26,"log_start":"263'500","ondisk_log_start":"263'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'542","last_scrub_stamp":"2024-09-12T18:11:54.729880+0000","last_deep_scrub":"263'542","last_deep_scrub_stamp":"2024-09-12T18:11:54.729880+0000","last_clean_scrub_stamp":"2024-09-12T18:11:54.729880+0000","objects_scrubbed":3,"log_size":42,"log_dups_size":500,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:17.102641+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3000,"num_read_kb":2785,"num_write":670,"num_write_kb":215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2809,"num_omap_keys":11,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"263'214","reported_seq":901,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:48.710948+0000","last_change":"2024-09-12T18:11:48.710948+0000","last_active":"2024-09-12T18:11:48.710948+0000","last_peered":"2024-09-12T18:11:48.710948+0000","last_clean":"2024-09-12T18:11:48.710948+0000","last_became_active":"2024-09-12T17:10:42.524130+0000","last_became_peered":"2024-09-12T17:10:42.524130+0000","last_unstale":"2024-09-12T18:11:48.710948+0000","last_undegraded":"2024-09-12T18:11:48.710948+0000","last_fullsized":"2024-09-12T18:11:48.710948+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'214","last_scrub_stamp":"2024-09-12T18:11:48.710850+0000","last_deep_scrub":"263'214","last_deep_scrub_stamp":"2024-09-12T18:11:48.710850+0000","last_clean_scrub_stamp":"2024-09-12T18:11:48.710850+0000","objects_scrubbed":4,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:31:10.663400+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2067952,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":586,"num_read_kb":68430,"num_write":1040,"num_write_kb":36992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,5],"acting":[1,2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":527,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:51.437825+0000","last_change":"2024-09-12T18:11:51.437825+0000","last_active":"2024-09-12T18:11:51.437825+0000","last_peered":"2024-09-12T18:11:51.437825+0000","last_clean":"2024-09-12T18:11:51.437825+0000","last_became_active":"2024-09-12T17:10:32.177457+0000","last_became_peered":"2024-09-12T17:10:32.177457+0000","last_unstale":"2024-09-12T18:11:51.437825+0000","last_undegraded":"2024-09-12T18:11:51.437825+0000","last_fullsized":"2024-09-12T18:11:51.437825+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:11:51.437714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:11:51.437714+0000","last_clean_scrub_stamp":"2024-09-12T18:11:51.437714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:34:58.844283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000468751,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":508,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:59.691132+0000","last_change":"2024-09-12T18:11:59.691132+0000","last_active":"2024-09-12T18:11:59.691132+0000","last_peered":"2024-09-12T18:11:59.691132+0000","last_clean":"2024-09-12T18:11:59.691132+0000","last_became_active":"2024-09-12T17:10:46.527299+0000","last_became_peered":"2024-09-12T17:10:46.527299+0000","last_unstale":"2024-09-12T18:11:59.691132+0000","last_undegraded":"2024-09-12T18:11:59.691132+0000","last_fullsized":"2024-09-12T18:11:59.691132+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:11:59.691048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:11:59.691048+0000","last_clean_scrub_stamp":"2024-09-12T18:11:59.691048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:17:03.709838+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"263'242","reported_seq":824,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:06.501164+0000","last_change":"2024-09-12T18:12:06.501164+0000","last_active":"2024-09-12T18:12:06.501164+0000","last_peered":"2024-09-12T18:12:06.501164+0000","last_clean":"2024-09-12T18:12:06.501164+0000","last_became_active":"2024-09-12T17:10:48.538190+0000","last_became_peered":"2024-09-12T17:10:48.538190+0000","last_unstale":"2024-09-12T18:12:06.501164+0000","last_undegraded":"2024-09-12T18:12:06.501164+0000","last_fullsized":"2024-09-12T18:12:06.501164+0000","mapping_epoch":30,"log_start":"263'200","ondisk_log_start":"263'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'242","last_scrub_stamp":"2024-09-12T18:12:06.501075+0000","last_deep_scrub":"263'242","last_deep_scrub_stamp":"2024-09-12T18:12:06.501075+0000","last_clean_scrub_stamp":"2024-09-12T18:12:06.501075+0000","objects_scrubbed":8,"log_size":42,"log_dups_size":200,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:33:45.536325+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":276,"num_read_kb":262,"num_write":250,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6602,"num_omap_keys":16,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"263'780","reported_seq":2762,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:15.471517+0000","last_change":"2024-09-12T18:12:15.471440+0000","last_active":"2024-09-12T18:12:15.471517+0000","last_peered":"2024-09-12T18:12:15.471517+0000","last_clean":"2024-09-12T18:12:15.471517+0000","last_became_active":"2024-09-12T17:10:50.561112+0000","last_became_peered":"2024-09-12T17:10:50.561112+0000","last_unstale":"2024-09-12T18:12:15.471517+0000","last_undegraded":"2024-09-12T18:12:15.471517+0000","last_fullsized":"2024-09-12T18:12:15.471517+0000","mapping_epoch":32,"log_start":"263'700","ondisk_log_start":"263'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'780","last_scrub_stamp":"2024-09-12T18:12:15.471350+0000","last_deep_scrub":"263'780","last_deep_scrub_stamp":"2024-09-12T18:12:15.471350+0000","last_clean_scrub_stamp":"2024-09-12T18:12:15.471350+0000","objects_scrubbed":1,"log_size":80,"log_dups_size":700,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:20:09.955680+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"263'99","reported_seq":619,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:25.696235+0000","last_change":"2024-09-12T18:12:25.696235+0000","last_active":"2024-09-12T18:12:25.696235+0000","last_peered":"2024-09-12T18:12:25.696235+0000","last_clean":"2024-09-12T18:12:25.696235+0000","last_became_active":"2024-09-12T17:10:52.671116+0000","last_became_peered":"2024-09-12T17:10:52.671116+0000","last_unstale":"2024-09-12T18:12:25.696235+0000","last_undegraded":"2024-09-12T18:12:25.696235+0000","last_fullsized":"2024-09-12T18:12:25.696235+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'99","last_scrub_stamp":"2024-09-12T18:12:25.696143+0000","last_deep_scrub":"263'99","last_deep_scrub_stamp":"2024-09-12T18:12:25.696143+0000","last_clean_scrub_stamp":"2024-09-12T18:12:25.696143+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:30:48.103909+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":505,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":188,"num_read_kb":171,"num_write":234,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"263'780","reported_seq":2433,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:01.710244+0000","last_change":"2024-09-12T18:12:01.710175+0000","last_active":"2024-09-12T18:12:01.710244+0000","last_peered":"2024-09-12T18:12:01.710244+0000","last_clean":"2024-09-12T18:12:01.710244+0000","last_became_active":"2024-09-12T17:10:44.511450+0000","last_became_peered":"2024-09-12T17:10:44.511450+0000","last_unstale":"2024-09-12T18:12:01.710244+0000","last_undegraded":"2024-09-12T18:12:01.710244+0000","last_fullsized":"2024-09-12T18:12:01.710244+0000","mapping_epoch":26,"log_start":"263'700","ondisk_log_start":"263'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'780","last_scrub_stamp":"2024-09-12T18:12:01.710085+0000","last_deep_scrub":"263'780","last_deep_scrub_stamp":"2024-09-12T18:12:01.710085+0000","last_clean_scrub_stamp":"2024-09-12T18:12:01.710085+0000","objects_scrubbed":3,"log_size":80,"log_dups_size":700,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:44:55.441743+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3773,"num_read_kb":3378,"num_write":1080,"num_write_kb":423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":268,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"263'167","reported_seq":757,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:47.536255+0000","last_change":"2024-09-12T18:11:47.536255+0000","last_active":"2024-09-12T18:11:47.536255+0000","last_peered":"2024-09-12T18:11:47.536255+0000","last_clean":"2024-09-12T18:11:47.536255+0000","last_became_active":"2024-09-12T17:10:42.526472+0000","last_became_peered":"2024-09-12T17:10:42.526472+0000","last_unstale":"2024-09-12T18:11:47.536255+0000","last_undegraded":"2024-09-12T18:11:47.536255+0000","last_fullsized":"2024-09-12T18:11:47.536255+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'167","last_scrub_stamp":"2024-09-12T18:11:47.536135+0000","last_deep_scrub":"263'167","last_deep_scrub_stamp":"2024-09-12T18:11:47.536135+0000","last_clean_scrub_stamp":"2024-09-12T18:11:47.536135+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":100,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:57:32.050771+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":300,"num_read_kb":1418,"num_write":797,"num_write_kb":46804,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,0],"acting":[3,5,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":536,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:46.672452+0000","last_change":"2024-09-12T18:11:46.672452+0000","last_active":"2024-09-12T18:11:46.672452+0000","last_peered":"2024-09-12T18:11:46.672452+0000","last_clean":"2024-09-12T18:11:46.672452+0000","last_became_active":"2024-09-12T17:10:31.845481+0000","last_became_peered":"2024-09-12T17:10:31.845481+0000","last_unstale":"2024-09-12T18:11:46.672452+0000","last_undegraded":"2024-09-12T18:11:46.672452+0000","last_fullsized":"2024-09-12T18:11:46.672452+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:11:46.672379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:11:46.672379+0000","last_clean_scrub_stamp":"2024-09-12T18:11:46.672379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:35:09.073477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060466100000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":514,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:09.320609+0000","last_change":"2024-09-12T18:12:09.320609+0000","last_active":"2024-09-12T18:12:09.320609+0000","last_peered":"2024-09-12T18:12:09.320609+0000","last_clean":"2024-09-12T18:12:09.320609+0000","last_became_active":"2024-09-12T17:10:46.530275+0000","last_became_peered":"2024-09-12T17:10:46.530275+0000","last_unstale":"2024-09-12T18:12:09.320609+0000","last_undegraded":"2024-09-12T18:12:09.320609+0000","last_fullsized":"2024-09-12T18:12:09.320609+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:09.320512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:09.320512+0000","last_clean_scrub_stamp":"2024-09-12T18:12:09.320512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:40:01.605587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"263'133","reported_seq":689,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:08.358290+0000","last_change":"2024-09-12T18:12:08.358290+0000","last_active":"2024-09-12T18:12:08.358290+0000","last_peered":"2024-09-12T18:12:08.358290+0000","last_clean":"2024-09-12T18:12:08.358290+0000","last_became_active":"2024-09-12T17:10:48.541795+0000","last_became_peered":"2024-09-12T17:10:48.541795+0000","last_unstale":"2024-09-12T18:12:08.358290+0000","last_undegraded":"2024-09-12T18:12:08.358290+0000","last_fullsized":"2024-09-12T18:12:08.358290+0000","mapping_epoch":30,"log_start":"263'100","ondisk_log_start":"263'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'133","last_scrub_stamp":"2024-09-12T18:12:08.358159+0000","last_deep_scrub":"263'133","last_deep_scrub_stamp":"2024-09-12T18:12:08.358159+0000","last_clean_scrub_stamp":"2024-09-12T18:12:08.358159+0000","objects_scrubbed":5,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:21:15.600207+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":142,"num_read_kb":133,"num_write":96,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"263'791","reported_seq":4459,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:19.661322+0000","last_change":"2024-09-12T18:12:19.661322+0000","last_active":"2024-09-12T18:12:19.661322+0000","last_peered":"2024-09-12T18:12:19.661322+0000","last_clean":"2024-09-12T18:12:19.661322+0000","last_became_active":"2024-09-12T17:10:50.559932+0000","last_became_peered":"2024-09-12T17:10:50.559932+0000","last_unstale":"2024-09-12T18:12:19.661322+0000","last_undegraded":"2024-09-12T18:12:19.661322+0000","last_fullsized":"2024-09-12T18:12:19.661322+0000","mapping_epoch":32,"log_start":"263'700","ondisk_log_start":"263'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'791","last_scrub_stamp":"2024-09-12T18:12:19.661251+0000","last_deep_scrub":"263'791","last_deep_scrub_stamp":"2024-09-12T18:12:19.661251+0000","last_clean_scrub_stamp":"2024-09-12T18:12:19.661251+0000","objects_scrubbed":1,"log_size":91,"log_dups_size":700,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:02:46.335094+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"263'291","reported_seq":840,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:19.674577+0000","last_change":"2024-09-12T18:12:19.674577+0000","last_active":"2024-09-12T18:12:19.674577+0000","last_peered":"2024-09-12T18:12:19.674577+0000","last_clean":"2024-09-12T18:12:19.674577+0000","last_became_active":"2024-09-12T17:10:52.570545+0000","last_became_peered":"2024-09-12T17:10:52.570545+0000","last_unstale":"2024-09-12T18:12:19.674577+0000","last_undegraded":"2024-09-12T18:12:19.674577+0000","last_fullsized":"2024-09-12T18:12:19.674577+0000","mapping_epoch":34,"log_start":"263'200","ondisk_log_start":"263'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'291","last_scrub_stamp":"2024-09-12T18:12:19.674475+0000","last_deep_scrub":"263'291","last_deep_scrub_stamp":"2024-09-12T18:12:19.674475+0000","last_clean_scrub_stamp":"2024-09-12T18:12:19.674475+0000","objects_scrubbed":3,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:10:18.881598+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":466,"num_read_kb":447,"num_write":645,"num_write_kb":207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":178,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"263'473","reported_seq":1911,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:49.479082+0000","last_change":"2024-09-12T18:11:49.479082+0000","last_active":"2024-09-12T18:11:49.479082+0000","last_peered":"2024-09-12T18:11:49.479082+0000","last_clean":"2024-09-12T18:11:49.479082+0000","last_became_active":"2024-09-12T17:10:44.517508+0000","last_became_peered":"2024-09-12T17:10:44.517508+0000","last_unstale":"2024-09-12T18:11:49.479082+0000","last_undegraded":"2024-09-12T18:11:49.479082+0000","last_fullsized":"2024-09-12T18:11:49.479082+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'473","last_scrub_stamp":"2024-09-12T18:11:49.478985+0000","last_deep_scrub":"263'473","last_deep_scrub_stamp":"2024-09-12T18:11:49.478985+0000","last_clean_scrub_stamp":"2024-09-12T18:11:49.478985+0000","objects_scrubbed":2,"log_size":73,"log_dups_size":400,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:50:01.319281+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2400,"num_read_kb":2225,"num_write":610,"num_write_kb":202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"263'211","reported_seq":857,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:45.628205+0000","last_change":"2024-09-12T18:11:45.628205+0000","last_active":"2024-09-12T18:11:45.628205+0000","last_peered":"2024-09-12T18:11:45.628205+0000","last_clean":"2024-09-12T18:11:45.628205+0000","last_became_active":"2024-09-12T17:10:42.518404+0000","last_became_peered":"2024-09-12T17:10:42.518404+0000","last_unstale":"2024-09-12T18:11:45.628205+0000","last_undegraded":"2024-09-12T18:11:45.628205+0000","last_fullsized":"2024-09-12T18:11:45.628205+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'211","last_scrub_stamp":"2024-09-12T18:11:45.628122+0000","last_deep_scrub":"263'211","last_deep_scrub_stamp":"2024-09-12T18:11:45.628122+0000","last_clean_scrub_stamp":"2024-09-12T18:11:45.628122+0000","objects_scrubbed":1,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:54:21.121479+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170264,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":504,"num_read_kb":3973,"num_write":1040,"num_write_kb":36643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,7],"acting":[0,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":531,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:47.857743+0000","last_change":"2024-09-12T18:11:47.857743+0000","last_active":"2024-09-12T18:11:47.857743+0000","last_peered":"2024-09-12T18:11:47.857743+0000","last_clean":"2024-09-12T18:11:47.857743+0000","last_became_active":"2024-09-12T17:10:31.846123+0000","last_became_peered":"2024-09-12T17:10:31.846123+0000","last_unstale":"2024-09-12T18:11:47.857743+0000","last_undegraded":"2024-09-12T18:11:47.857743+0000","last_fullsized":"2024-09-12T18:11:47.857743+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:11:47.857651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:11:47.857651+0000","last_clean_scrub_stamp":"2024-09-12T18:11:47.857651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:48:18.963656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042024599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":509,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:07.594958+0000","last_change":"2024-09-12T18:12:07.594888+0000","last_active":"2024-09-12T18:12:07.594958+0000","last_peered":"2024-09-12T18:12:07.594958+0000","last_clean":"2024-09-12T18:12:07.594958+0000","last_became_active":"2024-09-12T17:10:46.530457+0000","last_became_peered":"2024-09-12T17:10:46.530457+0000","last_unstale":"2024-09-12T18:12:07.594958+0000","last_undegraded":"2024-09-12T18:12:07.594958+0000","last_fullsized":"2024-09-12T18:12:07.594958+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:07.594799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:07.594799+0000","last_clean_scrub_stamp":"2024-09-12T18:12:07.594799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:51:45.714432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"263'318","reported_seq":1045,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:09.558913+0000","last_change":"2024-09-12T18:12:09.558913+0000","last_active":"2024-09-12T18:12:09.558913+0000","last_peered":"2024-09-12T18:12:09.558913+0000","last_clean":"2024-09-12T18:12:09.558913+0000","last_became_active":"2024-09-12T17:10:48.542991+0000","last_became_peered":"2024-09-12T17:10:48.542991+0000","last_unstale":"2024-09-12T18:12:09.558913+0000","last_undegraded":"2024-09-12T18:12:09.558913+0000","last_fullsized":"2024-09-12T18:12:09.558913+0000","mapping_epoch":30,"log_start":"263'300","ondisk_log_start":"263'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'318","last_scrub_stamp":"2024-09-12T18:12:09.558796+0000","last_deep_scrub":"263'318","last_deep_scrub_stamp":"2024-09-12T18:12:09.558796+0000","last_clean_scrub_stamp":"2024-09-12T18:12:09.558796+0000","objects_scrubbed":8,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:34:34.474636+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23115,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":468,"num_read_kb":620,"num_write":234,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:16.626285+0000","last_change":"2024-09-12T18:12:16.626285+0000","last_active":"2024-09-12T18:12:16.626285+0000","last_peered":"2024-09-12T18:12:16.626285+0000","last_clean":"2024-09-12T18:12:16.626285+0000","last_became_active":"2024-09-12T17:10:50.553469+0000","last_became_peered":"2024-09-12T17:10:50.553469+0000","last_unstale":"2024-09-12T18:12:16.626285+0000","last_undegraded":"2024-09-12T18:12:16.626285+0000","last_fullsized":"2024-09-12T18:12:16.626285+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:16.626189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:16.626189+0000","last_clean_scrub_stamp":"2024-09-12T18:12:16.626189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:33:19.529386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"263'116","reported_seq":625,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:20.477405+0000","last_change":"2024-09-12T18:12:20.477405+0000","last_active":"2024-09-12T18:12:20.477405+0000","last_peered":"2024-09-12T18:12:20.477405+0000","last_clean":"2024-09-12T18:12:20.477405+0000","last_became_active":"2024-09-12T17:10:52.578713+0000","last_became_peered":"2024-09-12T17:10:52.578713+0000","last_unstale":"2024-09-12T18:12:20.477405+0000","last_undegraded":"2024-09-12T18:12:20.477405+0000","last_fullsized":"2024-09-12T18:12:20.477405+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'116","last_scrub_stamp":"2024-09-12T18:12:20.477311+0000","last_deep_scrub":"263'116","last_deep_scrub_stamp":"2024-09-12T18:12:20.477311+0000","last_clean_scrub_stamp":"2024-09-12T18:12:20.477311+0000","objects_scrubbed":2,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:33:41.317355+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":176,"num_read_kb":166,"num_write":279,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"263'125","reported_seq":695,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:23.612017+0000","last_change":"2024-09-12T18:12:23.612017+0000","last_active":"2024-09-12T18:12:23.612017+0000","last_peered":"2024-09-12T18:12:23.612017+0000","last_clean":"2024-09-12T18:12:23.612017+0000","last_became_active":"2024-09-12T17:10:52.576481+0000","last_became_peered":"2024-09-12T17:10:52.576481+0000","last_unstale":"2024-09-12T18:12:23.612017+0000","last_undegraded":"2024-09-12T18:12:23.612017+0000","last_fullsized":"2024-09-12T18:12:23.612017+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'125","last_scrub_stamp":"2024-09-12T18:12:23.611923+0000","last_deep_scrub":"263'125","last_deep_scrub_stamp":"2024-09-12T18:12:23.611923+0000","last_clean_scrub_stamp":"2024-09-12T18:12:23.611923+0000","objects_scrubbed":1,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:46:16.808557+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":242,"num_read_kb":237,"num_write":285,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"263'890","reported_seq":2488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:57.379777+0000","last_change":"2024-09-12T18:11:57.379777+0000","last_active":"2024-09-12T18:11:57.379777+0000","last_peered":"2024-09-12T18:11:57.379777+0000","last_clean":"2024-09-12T18:11:57.379777+0000","last_became_active":"2024-09-12T17:10:44.507455+0000","last_became_peered":"2024-09-12T17:10:44.507455+0000","last_unstale":"2024-09-12T18:11:57.379777+0000","last_undegraded":"2024-09-12T18:11:57.379777+0000","last_fullsized":"2024-09-12T18:11:57.379777+0000","mapping_epoch":26,"log_start":"263'800","ondisk_log_start":"263'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'890","last_scrub_stamp":"2024-09-12T18:11:57.379681+0000","last_deep_scrub":"263'890","last_deep_scrub_stamp":"2024-09-12T18:11:57.379681+0000","last_clean_scrub_stamp":"2024-09-12T18:11:57.379681+0000","objects_scrubbed":4,"log_size":90,"log_dups_size":800,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:11:27.008068+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4276,"num_read_kb":3830,"num_write":1165,"num_write_kb":436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2297,"num_omap_keys":9,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"263'212","reported_seq":871,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:48.500179+0000","last_change":"2024-09-12T18:11:48.500179+0000","last_active":"2024-09-12T18:11:48.500179+0000","last_peered":"2024-09-12T18:11:48.500179+0000","last_clean":"2024-09-12T18:11:48.500179+0000","last_became_active":"2024-09-12T17:10:42.519656+0000","last_became_peered":"2024-09-12T17:10:42.519656+0000","last_unstale":"2024-09-12T18:11:48.500179+0000","last_undegraded":"2024-09-12T18:11:48.500179+0000","last_fullsized":"2024-09-12T18:11:48.500179+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'212","last_scrub_stamp":"2024-09-12T18:11:48.500025+0000","last_deep_scrub":"263'212","last_deep_scrub_stamp":"2024-09-12T18:11:48.500025+0000","last_clean_scrub_stamp":"2024-09-12T18:11:48.500025+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:50:20.130407+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":812867,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":526,"num_read_kb":10349,"num_write":1065,"num_write_kb":31428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,6],"acting":[4,7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":509,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:02.561683+0000","last_change":"2024-09-12T18:12:02.561683+0000","last_active":"2024-09-12T18:12:02.561683+0000","last_peered":"2024-09-12T18:12:02.561683+0000","last_clean":"2024-09-12T18:12:02.561683+0000","last_became_active":"2024-09-12T17:10:46.527445+0000","last_became_peered":"2024-09-12T17:10:46.527445+0000","last_unstale":"2024-09-12T18:12:02.561683+0000","last_undegraded":"2024-09-12T18:12:02.561683+0000","last_fullsized":"2024-09-12T18:12:02.561683+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:02.561588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:02.561588+0000","last_clean_scrub_stamp":"2024-09-12T18:12:02.561588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:10:49.689079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"263'145","reported_seq":730,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:13.656453+0000","last_change":"2024-09-12T18:12:13.656453+0000","last_active":"2024-09-12T18:12:13.656453+0000","last_peered":"2024-09-12T18:12:13.656453+0000","last_clean":"2024-09-12T18:12:13.656453+0000","last_became_active":"2024-09-12T17:10:48.536021+0000","last_became_peered":"2024-09-12T17:10:48.536021+0000","last_unstale":"2024-09-12T18:12:13.656453+0000","last_undegraded":"2024-09-12T18:12:13.656453+0000","last_fullsized":"2024-09-12T18:12:13.656453+0000","mapping_epoch":30,"log_start":"263'100","ondisk_log_start":"263'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'145","last_scrub_stamp":"2024-09-12T18:12:13.656340+0000","last_deep_scrub":"263'145","last_deep_scrub_stamp":"2024-09-12T18:12:13.656340+0000","last_clean_scrub_stamp":"2024-09-12T18:12:13.656340+0000","objects_scrubbed":5,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:23:59.661931+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9595,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":179,"num_read_kb":232,"num_write":92,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:21.686871+0000","last_change":"2024-09-12T18:12:21.686871+0000","last_active":"2024-09-12T18:12:21.686871+0000","last_peered":"2024-09-12T18:12:21.686871+0000","last_clean":"2024-09-12T18:12:21.686871+0000","last_became_active":"2024-09-12T17:10:50.555251+0000","last_became_peered":"2024-09-12T17:10:50.555251+0000","last_unstale":"2024-09-12T18:12:21.686871+0000","last_undegraded":"2024-09-12T18:12:21.686871+0000","last_fullsized":"2024-09-12T18:12:21.686871+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:21.686780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:21.686780+0000","last_clean_scrub_stamp":"2024-09-12T18:12:21.686780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:25:01.260932+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"263'142","reported_seq":671,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:28.644089+0000","last_change":"2024-09-12T18:12:28.644089+0000","last_active":"2024-09-12T18:12:28.644089+0000","last_peered":"2024-09-12T18:12:28.644089+0000","last_clean":"2024-09-12T18:12:28.644089+0000","last_became_active":"2024-09-12T17:10:52.573040+0000","last_became_peered":"2024-09-12T17:10:52.573040+0000","last_unstale":"2024-09-12T18:12:28.644089+0000","last_undegraded":"2024-09-12T18:12:28.644089+0000","last_fullsized":"2024-09-12T18:12:28.644089+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'142","last_scrub_stamp":"2024-09-12T18:12:28.643982+0000","last_deep_scrub":"263'142","last_deep_scrub_stamp":"2024-09-12T18:12:28.643982+0000","last_clean_scrub_stamp":"2024-09-12T18:12:28.643982+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:19:01.380924+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":264,"num_read_kb":238,"num_write":352,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"263'1131","reported_seq":2801,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:56.527202+0000","last_change":"2024-09-12T18:11:56.527202+0000","last_active":"2024-09-12T18:11:56.527202+0000","last_peered":"2024-09-12T18:11:56.527202+0000","last_clean":"2024-09-12T18:11:56.527202+0000","last_became_active":"2024-09-12T17:10:44.509117+0000","last_became_peered":"2024-09-12T17:10:44.509117+0000","last_unstale":"2024-09-12T18:11:56.527202+0000","last_undegraded":"2024-09-12T18:11:56.527202+0000","last_fullsized":"2024-09-12T18:11:56.527202+0000","mapping_epoch":26,"log_start":"263'1100","ondisk_log_start":"263'1100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1131","last_scrub_stamp":"2024-09-12T18:11:56.527108+0000","last_deep_scrub":"263'1131","last_deep_scrub_stamp":"2024-09-12T18:11:56.527108+0000","last_clean_scrub_stamp":"2024-09-12T18:11:56.527108+0000","objects_scrubbed":3,"log_size":31,"log_dups_size":1100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:31:43.564901+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5331,"num_read_kb":4747,"num_write":1539,"num_write_kb":622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2500,"num_omap_keys":10,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"263'206","reported_seq":823,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:47.843275+0000","last_change":"2024-09-12T18:11:47.843275+0000","last_active":"2024-09-12T18:11:47.843275+0000","last_peered":"2024-09-12T18:11:47.843275+0000","last_clean":"2024-09-12T18:11:47.843275+0000","last_became_active":"2024-09-12T17:11:16.617505+0000","last_became_peered":"2024-09-12T17:11:16.617505+0000","last_unstale":"2024-09-12T18:11:47.843275+0000","last_undegraded":"2024-09-12T18:11:47.843275+0000","last_fullsized":"2024-09-12T18:11:47.843275+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'206","last_scrub_stamp":"2024-09-12T18:11:47.843156+0000","last_deep_scrub":"263'206","last_deep_scrub_stamp":"2024-09-12T18:11:47.843156+0000","last_clean_scrub_stamp":"2024-09-12T18:11:47.843156+0000","objects_scrubbed":5,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:01:44.908699+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2936797,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":495,"num_read_kb":50143,"num_write":995,"num_write_kb":47141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,4],"acting":[2,3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":504,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:08.639895+0000","last_change":"2024-09-12T18:12:08.639895+0000","last_active":"2024-09-12T18:12:08.639895+0000","last_peered":"2024-09-12T18:12:08.639895+0000","last_clean":"2024-09-12T18:12:08.639895+0000","last_became_active":"2024-09-12T17:10:46.531835+0000","last_became_peered":"2024-09-12T17:10:46.531835+0000","last_unstale":"2024-09-12T18:12:08.639895+0000","last_undegraded":"2024-09-12T18:12:08.639895+0000","last_fullsized":"2024-09-12T18:12:08.639895+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:08.639821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:08.639821+0000","last_clean_scrub_stamp":"2024-09-12T18:12:08.639821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:23:37.446484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"263'49","reported_seq":565,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:09.719777+0000","last_change":"2024-09-12T18:12:09.719777+0000","last_active":"2024-09-12T18:12:09.719777+0000","last_peered":"2024-09-12T18:12:09.719777+0000","last_clean":"2024-09-12T18:12:09.719777+0000","last_became_active":"2024-09-12T17:10:48.540975+0000","last_became_peered":"2024-09-12T17:10:48.540975+0000","last_unstale":"2024-09-12T18:12:09.719777+0000","last_undegraded":"2024-09-12T18:12:09.719777+0000","last_fullsized":"2024-09-12T18:12:09.719777+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'49","last_scrub_stamp":"2024-09-12T18:12:09.719655+0000","last_deep_scrub":"263'49","last_deep_scrub_stamp":"2024-09-12T18:12:09.719655+0000","last_clean_scrub_stamp":"2024-09-12T18:12:09.719655+0000","objects_scrubbed":3,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:00:37.550586+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":38,"num_read_kb":36,"num_write":28,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:17.604666+0000","last_change":"2024-09-12T18:12:17.604666+0000","last_active":"2024-09-12T18:12:17.604666+0000","last_peered":"2024-09-12T18:12:17.604666+0000","last_clean":"2024-09-12T18:12:17.604666+0000","last_became_active":"2024-09-12T17:10:50.553581+0000","last_became_peered":"2024-09-12T17:10:50.553581+0000","last_unstale":"2024-09-12T18:12:17.604666+0000","last_undegraded":"2024-09-12T18:12:17.604666+0000","last_fullsized":"2024-09-12T18:12:17.604666+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:17.604578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:17.604578+0000","last_clean_scrub_stamp":"2024-09-12T18:12:17.604578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:22:57.955149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"263'193","reported_seq":722,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:22.604718+0000","last_change":"2024-09-12T18:12:22.604718+0000","last_active":"2024-09-12T18:12:22.604718+0000","last_peered":"2024-09-12T18:12:22.604718+0000","last_clean":"2024-09-12T18:12:22.604718+0000","last_became_active":"2024-09-12T17:10:52.573306+0000","last_became_peered":"2024-09-12T17:10:52.573306+0000","last_unstale":"2024-09-12T18:12:22.604718+0000","last_undegraded":"2024-09-12T18:12:22.604718+0000","last_fullsized":"2024-09-12T18:12:22.604718+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'193","last_scrub_stamp":"2024-09-12T18:12:22.604613+0000","last_deep_scrub":"263'193","last_deep_scrub_stamp":"2024-09-12T18:12:22.604613+0000","last_clean_scrub_stamp":"2024-09-12T18:12:22.604613+0000","objects_scrubbed":2,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:24:50.370491+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":321,"num_read_kb":317,"num_write":439,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":398,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"263'811","reported_seq":2420,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:57.606541+0000","last_change":"2024-09-12T18:11:57.606541+0000","last_active":"2024-09-12T18:11:57.606541+0000","last_peered":"2024-09-12T18:11:57.606541+0000","last_clean":"2024-09-12T18:11:57.606541+0000","last_became_active":"2024-09-12T17:10:44.511481+0000","last_became_peered":"2024-09-12T17:10:44.511481+0000","last_unstale":"2024-09-12T18:11:57.606541+0000","last_undegraded":"2024-09-12T18:11:57.606541+0000","last_fullsized":"2024-09-12T18:11:57.606541+0000","mapping_epoch":26,"log_start":"263'700","ondisk_log_start":"263'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'811","last_scrub_stamp":"2024-09-12T18:11:57.606442+0000","last_deep_scrub":"263'811","last_deep_scrub_stamp":"2024-09-12T18:11:57.606442+0000","last_clean_scrub_stamp":"2024-09-12T18:11:57.606442+0000","objects_scrubbed":1,"log_size":111,"log_dups_size":700,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:48:35.686566+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3868,"num_read_kb":3506,"num_write":1048,"num_write_kb":364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"263'181","reported_seq":792,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:48.827289+0000","last_change":"2024-09-12T18:11:48.827289+0000","last_active":"2024-09-12T18:11:48.827289+0000","last_peered":"2024-09-12T18:11:48.827289+0000","last_clean":"2024-09-12T18:11:48.827289+0000","last_became_active":"2024-09-12T17:11:16.862878+0000","last_became_peered":"2024-09-12T17:11:16.862878+0000","last_unstale":"2024-09-12T18:11:48.827289+0000","last_undegraded":"2024-09-12T18:11:48.827289+0000","last_fullsized":"2024-09-12T18:11:48.827289+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'181","last_scrub_stamp":"2024-09-12T18:11:48.827197+0000","last_deep_scrub":"263'181","last_deep_scrub_stamp":"2024-09-12T18:11:48.827197+0000","last_clean_scrub_stamp":"2024-09-12T18:11:48.827197+0000","objects_scrubbed":2,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:07:19.314634+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3178636,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":399,"num_read_kb":53721,"num_write":811,"num_write_kb":39175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,1,3],"acting":[2,7,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:07.542540+0000","last_change":"2024-09-12T18:12:07.542540+0000","last_active":"2024-09-12T18:12:07.542540+0000","last_peered":"2024-09-12T18:12:07.542540+0000","last_clean":"2024-09-12T18:12:07.542540+0000","last_became_active":"2024-09-12T17:10:46.530518+0000","last_became_peered":"2024-09-12T17:10:46.530518+0000","last_unstale":"2024-09-12T18:12:07.542540+0000","last_undegraded":"2024-09-12T18:12:07.542540+0000","last_fullsized":"2024-09-12T18:12:07.542540+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:07.542450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:07.542450+0000","last_clean_scrub_stamp":"2024-09-12T18:12:07.542450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:58:05.691586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"263'178","reported_seq":778,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:15.677130+0000","last_change":"2024-09-12T18:12:15.677130+0000","last_active":"2024-09-12T18:12:15.677130+0000","last_peered":"2024-09-12T18:12:15.677130+0000","last_clean":"2024-09-12T18:12:15.677130+0000","last_became_active":"2024-09-12T17:10:48.536654+0000","last_became_peered":"2024-09-12T17:10:48.536654+0000","last_unstale":"2024-09-12T18:12:15.677130+0000","last_undegraded":"2024-09-12T18:12:15.677130+0000","last_fullsized":"2024-09-12T18:12:15.677130+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'178","last_scrub_stamp":"2024-09-12T18:12:15.677036+0000","last_deep_scrub":"263'178","last_deep_scrub_stamp":"2024-09-12T18:12:15.677036+0000","last_clean_scrub_stamp":"2024-09-12T18:12:15.677036+0000","objects_scrubbed":5,"log_size":78,"log_dups_size":100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:37:46.838981+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5117,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":224,"num_read_kb":242,"num_write":122,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:04.709251+0000","last_change":"2024-09-12T18:12:04.709251+0000","last_active":"2024-09-12T18:12:04.709251+0000","last_peered":"2024-09-12T18:12:04.709251+0000","last_clean":"2024-09-12T18:12:04.709251+0000","last_became_active":"2024-09-12T17:10:50.556039+0000","last_became_peered":"2024-09-12T17:10:50.556039+0000","last_unstale":"2024-09-12T18:12:04.709251+0000","last_undegraded":"2024-09-12T18:12:04.709251+0000","last_fullsized":"2024-09-12T18:12:04.709251+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:04.709167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:04.709167+0000","last_clean_scrub_stamp":"2024-09-12T18:12:04.709167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:32:19.318577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"263'114","reported_seq":626,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:23.438911+0000","last_change":"2024-09-12T18:12:23.438911+0000","last_active":"2024-09-12T18:12:23.438911+0000","last_peered":"2024-09-12T18:12:23.438911+0000","last_clean":"2024-09-12T18:12:23.438911+0000","last_became_active":"2024-09-12T17:10:52.576791+0000","last_became_peered":"2024-09-12T17:10:52.576791+0000","last_unstale":"2024-09-12T18:12:23.438911+0000","last_undegraded":"2024-09-12T18:12:23.438911+0000","last_fullsized":"2024-09-12T18:12:23.438911+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'114","last_scrub_stamp":"2024-09-12T18:12:23.438808+0000","last_deep_scrub":"263'114","last_deep_scrub_stamp":"2024-09-12T18:12:23.438808+0000","last_clean_scrub_stamp":"2024-09-12T18:12:23.438808+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:40:57.508125+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":159,"num_read_kb":159,"num_write":260,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"263'431","reported_seq":1816,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:03.644995+0000","last_change":"2024-09-12T18:12:03.644995+0000","last_active":"2024-09-12T18:12:03.644995+0000","last_peered":"2024-09-12T18:12:03.644995+0000","last_clean":"2024-09-12T18:12:03.644995+0000","last_became_active":"2024-09-12T17:10:44.520747+0000","last_became_peered":"2024-09-12T17:10:44.520747+0000","last_unstale":"2024-09-12T18:12:03.644995+0000","last_undegraded":"2024-09-12T18:12:03.644995+0000","last_fullsized":"2024-09-12T18:12:03.644995+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'431","last_scrub_stamp":"2024-09-12T18:12:03.644906+0000","last_deep_scrub":"263'431","last_deep_scrub_stamp":"2024-09-12T18:12:03.644906+0000","last_clean_scrub_stamp":"2024-09-12T18:12:03.644906+0000","objects_scrubbed":2,"log_size":31,"log_dups_size":400,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:51:22.884668+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2202,"num_read_kb":2035,"num_write":527,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":718,"num_omap_keys":3,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"263'255","reported_seq":952,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:47.656945+0000","last_change":"2024-09-12T18:11:47.656945+0000","last_active":"2024-09-12T18:11:47.656945+0000","last_peered":"2024-09-12T18:11:47.656945+0000","last_clean":"2024-09-12T18:11:47.656945+0000","last_became_active":"2024-09-12T17:10:42.528364+0000","last_became_peered":"2024-09-12T17:10:42.528364+0000","last_unstale":"2024-09-12T18:11:47.656945+0000","last_undegraded":"2024-09-12T18:11:47.656945+0000","last_fullsized":"2024-09-12T18:11:47.656945+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'255","last_scrub_stamp":"2024-09-12T18:11:47.656812+0000","last_deep_scrub":"263'255","last_deep_scrub_stamp":"2024-09-12T18:11:47.656812+0000","last_clean_scrub_stamp":"2024-09-12T18:11:47.656812+0000","objects_scrubbed":5,"log_size":55,"log_dups_size":200,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:23:37.965725+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399205,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":613,"num_read_kb":71919,"num_write":1345,"num_write_kb":46951,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6,3],"acting":[0,5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":505,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:00.677176+0000","last_change":"2024-09-12T18:12:00.677176+0000","last_active":"2024-09-12T18:12:00.677176+0000","last_peered":"2024-09-12T18:12:00.677176+0000","last_clean":"2024-09-12T18:12:00.677176+0000","last_became_active":"2024-09-12T17:10:46.531830+0000","last_became_peered":"2024-09-12T17:10:46.531830+0000","last_unstale":"2024-09-12T18:12:00.677176+0000","last_undegraded":"2024-09-12T18:12:00.677176+0000","last_fullsized":"2024-09-12T18:12:00.677176+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:00.677087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:00.677087+0000","last_clean_scrub_stamp":"2024-09-12T18:12:00.677087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:04:35.333713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"263'131","reported_seq":707,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:12.623041+0000","last_change":"2024-09-12T18:12:12.623041+0000","last_active":"2024-09-12T18:12:12.623041+0000","last_peered":"2024-09-12T18:12:12.623041+0000","last_clean":"2024-09-12T18:12:12.623041+0000","last_became_active":"2024-09-12T17:10:48.545598+0000","last_became_peered":"2024-09-12T17:10:48.545598+0000","last_unstale":"2024-09-12T18:12:12.623041+0000","last_undegraded":"2024-09-12T18:12:12.623041+0000","last_fullsized":"2024-09-12T18:12:12.623041+0000","mapping_epoch":30,"log_start":"263'100","ondisk_log_start":"263'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'131","last_scrub_stamp":"2024-09-12T18:12:12.622936+0000","last_deep_scrub":"263'131","last_deep_scrub_stamp":"2024-09-12T18:12:12.622936+0000","last_clean_scrub_stamp":"2024-09-12T18:12:12.622936+0000","objects_scrubbed":4,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:24:03.277611+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10861,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":166,"num_read_kb":224,"num_write":86,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":500,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:15.694219+0000","last_change":"2024-09-12T18:12:15.694219+0000","last_active":"2024-09-12T18:12:15.694219+0000","last_peered":"2024-09-12T18:12:15.694219+0000","last_clean":"2024-09-12T18:12:15.694219+0000","last_became_active":"2024-09-12T17:10:50.560872+0000","last_became_peered":"2024-09-12T17:10:50.560872+0000","last_unstale":"2024-09-12T18:12:15.694219+0000","last_undegraded":"2024-09-12T18:12:15.694219+0000","last_fullsized":"2024-09-12T18:12:15.694219+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:15.694138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:15.694138+0000","last_clean_scrub_stamp":"2024-09-12T18:12:15.694138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:19:51.674706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"263'951","reported_seq":2488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:56.707695+0000","last_change":"2024-09-12T18:11:56.707695+0000","last_active":"2024-09-12T18:11:56.707695+0000","last_peered":"2024-09-12T18:11:56.707695+0000","last_clean":"2024-09-12T18:11:56.707695+0000","last_became_active":"2024-09-12T17:10:44.518992+0000","last_became_peered":"2024-09-12T17:10:44.518992+0000","last_unstale":"2024-09-12T18:11:56.707695+0000","last_undegraded":"2024-09-12T18:11:56.707695+0000","last_fullsized":"2024-09-12T18:11:56.707695+0000","mapping_epoch":26,"log_start":"263'900","ondisk_log_start":"263'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'951","last_scrub_stamp":"2024-09-12T18:11:56.707618+0000","last_deep_scrub":"263'951","last_deep_scrub_stamp":"2024-09-12T18:11:56.707618+0000","last_clean_scrub_stamp":"2024-09-12T18:11:56.707618+0000","objects_scrubbed":1,"log_size":51,"log_dups_size":900,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:54:44.984408+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4453,"num_read_kb":3925,"num_write":1322,"num_write_kb":528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1892,"num_omap_keys":8,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"263'316","reported_seq":1002,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:50.550646+0000","last_change":"2024-09-12T18:11:50.550646+0000","last_active":"2024-09-12T18:11:50.550646+0000","last_peered":"2024-09-12T18:11:50.550646+0000","last_clean":"2024-09-12T18:11:50.550646+0000","last_became_active":"2024-09-12T17:10:42.514627+0000","last_became_peered":"2024-09-12T17:10:42.514627+0000","last_unstale":"2024-09-12T18:11:50.550646+0000","last_undegraded":"2024-09-12T18:11:50.550646+0000","last_fullsized":"2024-09-12T18:11:50.550646+0000","mapping_epoch":24,"log_start":"263'300","ondisk_log_start":"263'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'316","last_scrub_stamp":"2024-09-12T18:11:50.550499+0000","last_deep_scrub":"263'316","last_deep_scrub_stamp":"2024-09-12T18:11:50.550499+0000","last_clean_scrub_stamp":"2024-09-12T18:11:50.550499+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:01:57.030372+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":188,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":795,"num_read_kb":25839,"num_write":1196,"num_write_kb":43854,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":513,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:05.731858+0000","last_change":"2024-09-12T18:12:05.731801+0000","last_active":"2024-09-12T18:12:05.731858+0000","last_peered":"2024-09-12T18:12:05.731858+0000","last_clean":"2024-09-12T18:12:05.731858+0000","last_became_active":"2024-09-12T17:10:46.526692+0000","last_became_peered":"2024-09-12T17:10:46.526692+0000","last_unstale":"2024-09-12T18:12:05.731858+0000","last_undegraded":"2024-09-12T18:12:05.731858+0000","last_fullsized":"2024-09-12T18:12:05.731858+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:05.731716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:05.731716+0000","last_clean_scrub_stamp":"2024-09-12T18:12:05.731716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:11:54.160730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"263'217","reported_seq":858,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:05.509292+0000","last_change":"2024-09-12T18:12:05.509292+0000","last_active":"2024-09-12T18:12:05.509292+0000","last_peered":"2024-09-12T18:12:05.509292+0000","last_clean":"2024-09-12T18:12:05.509292+0000","last_became_active":"2024-09-12T17:10:48.544429+0000","last_became_peered":"2024-09-12T17:10:48.544429+0000","last_unstale":"2024-09-12T18:12:05.509292+0000","last_undegraded":"2024-09-12T18:12:05.509292+0000","last_fullsized":"2024-09-12T18:12:05.509292+0000","mapping_epoch":30,"log_start":"263'200","ondisk_log_start":"263'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'217","last_scrub_stamp":"2024-09-12T18:12:05.509198+0000","last_deep_scrub":"263'217","last_deep_scrub_stamp":"2024-09-12T18:12:05.509198+0000","last_clean_scrub_stamp":"2024-09-12T18:12:05.509198+0000","objects_scrubbed":6,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:15:27.086960+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14913,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":325,"num_read_kb":485,"num_write":208,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25256,"num_omap_keys":48,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:17.499584+0000","last_change":"2024-09-12T18:12:17.499584+0000","last_active":"2024-09-12T18:12:17.499584+0000","last_peered":"2024-09-12T18:12:17.499584+0000","last_clean":"2024-09-12T18:12:17.499584+0000","last_became_active":"2024-09-12T17:10:50.565621+0000","last_became_peered":"2024-09-12T17:10:50.565621+0000","last_unstale":"2024-09-12T18:12:17.499584+0000","last_undegraded":"2024-09-12T18:12:17.499584+0000","last_fullsized":"2024-09-12T18:12:17.499584+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:17.499501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:17.499501+0000","last_clean_scrub_stamp":"2024-09-12T18:12:17.499501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:59:26.331971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"263'177","reported_seq":691,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:26.648044+0000","last_change":"2024-09-12T18:12:26.648044+0000","last_active":"2024-09-12T18:12:26.648044+0000","last_peered":"2024-09-12T18:12:26.648044+0000","last_clean":"2024-09-12T18:12:26.648044+0000","last_became_active":"2024-09-12T17:10:52.672033+0000","last_became_peered":"2024-09-12T17:10:52.672033+0000","last_unstale":"2024-09-12T18:12:26.648044+0000","last_undegraded":"2024-09-12T18:12:26.648044+0000","last_fullsized":"2024-09-12T18:12:26.648044+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'177","last_scrub_stamp":"2024-09-12T18:12:26.647956+0000","last_deep_scrub":"263'177","last_deep_scrub_stamp":"2024-09-12T18:12:26.647956+0000","last_clean_scrub_stamp":"2024-09-12T18:12:26.647956+0000","objects_scrubbed":2,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:08:25.327330+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":269,"num_read_kb":274,"num_write":411,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"263'548","reported_seq":2067,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:58.711253+0000","last_change":"2024-09-12T18:11:58.711194+0000","last_active":"2024-09-12T18:11:58.711253+0000","last_peered":"2024-09-12T18:11:58.711253+0000","last_clean":"2024-09-12T18:11:58.711253+0000","last_became_active":"2024-09-12T17:10:44.510696+0000","last_became_peered":"2024-09-12T17:10:44.510696+0000","last_unstale":"2024-09-12T18:11:58.711253+0000","last_undegraded":"2024-09-12T18:11:58.711253+0000","last_fullsized":"2024-09-12T18:11:58.711253+0000","mapping_epoch":26,"log_start":"263'500","ondisk_log_start":"263'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'548","last_scrub_stamp":"2024-09-12T18:11:58.711116+0000","last_deep_scrub":"263'548","last_deep_scrub_stamp":"2024-09-12T18:11:58.711116+0000","last_clean_scrub_stamp":"2024-09-12T18:11:58.711116+0000","objects_scrubbed":3,"log_size":48,"log_dups_size":500,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:00:54.289369+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2748,"num_read_kb":2501,"num_write":691,"num_write_kb":203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":946,"num_omap_keys":4,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"263'238","reported_seq":913,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:50.716191+0000","last_change":"2024-09-12T18:11:50.716191+0000","last_active":"2024-09-12T18:11:50.716191+0000","last_peered":"2024-09-12T18:11:50.716191+0000","last_clean":"2024-09-12T18:11:50.716191+0000","last_became_active":"2024-09-12T17:10:42.520349+0000","last_became_peered":"2024-09-12T17:10:42.520349+0000","last_unstale":"2024-09-12T18:11:50.716191+0000","last_undegraded":"2024-09-12T18:11:50.716191+0000","last_fullsized":"2024-09-12T18:11:50.716191+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'238","last_scrub_stamp":"2024-09-12T18:11:50.716063+0000","last_deep_scrub":"263'238","last_deep_scrub_stamp":"2024-09-12T18:11:50.716063+0000","last_clean_scrub_stamp":"2024-09-12T18:11:50.716063+0000","objects_scrubbed":9,"log_size":38,"log_dups_size":200,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:42:45.248398+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10743893,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":541,"num_read_kb":59039,"num_write":1206,"num_write_kb":37561,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,6],"acting":[1,3,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":508,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:01.699154+0000","last_change":"2024-09-12T18:12:01.699154+0000","last_active":"2024-09-12T18:12:01.699154+0000","last_peered":"2024-09-12T18:12:01.699154+0000","last_clean":"2024-09-12T18:12:01.699154+0000","last_became_active":"2024-09-12T17:10:46.530545+0000","last_became_peered":"2024-09-12T17:10:46.530545+0000","last_unstale":"2024-09-12T18:12:01.699154+0000","last_undegraded":"2024-09-12T18:12:01.699154+0000","last_fullsized":"2024-09-12T18:12:01.699154+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:01.699042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:01.699042+0000","last_clean_scrub_stamp":"2024-09-12T18:12:01.699042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:06:02.900923+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"263'178","reported_seq":770,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:13.575202+0000","last_change":"2024-09-12T18:12:13.575202+0000","last_active":"2024-09-12T18:12:13.575202+0000","last_peered":"2024-09-12T18:12:13.575202+0000","last_clean":"2024-09-12T18:12:13.575202+0000","last_became_active":"2024-09-12T17:10:48.541240+0000","last_became_peered":"2024-09-12T17:10:48.541240+0000","last_unstale":"2024-09-12T18:12:13.575202+0000","last_undegraded":"2024-09-12T18:12:13.575202+0000","last_fullsized":"2024-09-12T18:12:13.575202+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'178","last_scrub_stamp":"2024-09-12T18:12:13.575102+0000","last_deep_scrub":"263'178","last_deep_scrub_stamp":"2024-09-12T18:12:13.575102+0000","last_clean_scrub_stamp":"2024-09-12T18:12:13.575102+0000","objects_scrubbed":8,"log_size":78,"log_dups_size":100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:50:14.366078+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8547,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":246,"num_read_kb":321,"num_write":160,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11460,"num_omap_keys":24,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:09.489302+0000","last_change":"2024-09-12T18:12:09.489302+0000","last_active":"2024-09-12T18:12:09.489302+0000","last_peered":"2024-09-12T18:12:09.489302+0000","last_clean":"2024-09-12T18:12:09.489302+0000","last_became_active":"2024-09-12T17:10:50.561983+0000","last_became_peered":"2024-09-12T17:10:50.561983+0000","last_unstale":"2024-09-12T18:12:09.489302+0000","last_undegraded":"2024-09-12T18:12:09.489302+0000","last_fullsized":"2024-09-12T18:12:09.489302+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:09.489199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:09.489199+0000","last_clean_scrub_stamp":"2024-09-12T18:12:09.489199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:04:42.874499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"263'251","reported_seq":1127,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:10.668035+0000","last_change":"2024-09-12T18:12:10.668035+0000","last_active":"2024-09-12T18:12:10.668035+0000","last_peered":"2024-09-12T18:12:10.668035+0000","last_clean":"2024-09-12T18:12:10.668035+0000","last_became_active":"2024-09-12T17:10:52.573595+0000","last_became_peered":"2024-09-12T17:10:52.573595+0000","last_unstale":"2024-09-12T18:12:10.668035+0000","last_undegraded":"2024-09-12T18:12:10.668035+0000","last_fullsized":"2024-09-12T18:12:10.668035+0000","mapping_epoch":34,"log_start":"263'200","ondisk_log_start":"263'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'251","last_scrub_stamp":"2024-09-12T18:12:10.667936+0000","last_deep_scrub":"263'251","last_deep_scrub_stamp":"2024-09-12T18:12:10.667936+0000","last_clean_scrub_stamp":"2024-09-12T18:12:10.667936+0000","objects_scrubbed":7,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:03:04.342423+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1635,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":641,"num_read_kb":637,"num_write":634,"num_write_kb":186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"263'622","reported_seq":2223,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:58.640774+0000","last_change":"2024-09-12T18:11:58.640774+0000","last_active":"2024-09-12T18:11:58.640774+0000","last_peered":"2024-09-12T18:11:58.640774+0000","last_clean":"2024-09-12T18:11:58.640774+0000","last_became_active":"2024-09-12T17:10:44.521041+0000","last_became_peered":"2024-09-12T17:10:44.521041+0000","last_unstale":"2024-09-12T18:11:58.640774+0000","last_undegraded":"2024-09-12T18:11:58.640774+0000","last_fullsized":"2024-09-12T18:11:58.640774+0000","mapping_epoch":26,"log_start":"263'600","ondisk_log_start":"263'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'622","last_scrub_stamp":"2024-09-12T18:11:58.640669+0000","last_deep_scrub":"263'622","last_deep_scrub_stamp":"2024-09-12T18:11:58.640669+0000","last_clean_scrub_stamp":"2024-09-12T18:11:58.640669+0000","objects_scrubbed":2,"log_size":22,"log_dups_size":600,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:27:58.198720+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3182,"num_read_kb":2947,"num_write":827,"num_write_kb":261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":247,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"263'222","reported_seq":822,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:54.585656+0000","last_change":"2024-09-12T18:11:54.585656+0000","last_active":"2024-09-12T18:11:54.585656+0000","last_peered":"2024-09-12T18:11:54.585656+0000","last_clean":"2024-09-12T18:11:54.585656+0000","last_became_active":"2024-09-12T17:11:16.860070+0000","last_became_peered":"2024-09-12T17:11:16.860070+0000","last_unstale":"2024-09-12T18:11:54.585656+0000","last_undegraded":"2024-09-12T18:11:54.585656+0000","last_fullsized":"2024-09-12T18:11:54.585656+0000","mapping_epoch":37,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'222","last_scrub_stamp":"2024-09-12T18:11:54.585507+0000","last_deep_scrub":"263'222","last_deep_scrub_stamp":"2024-09-12T18:11:54.585507+0000","last_clean_scrub_stamp":"2024-09-12T18:11:54.585507+0000","objects_scrubbed":5,"log_size":22,"log_dups_size":200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:11:02.947543+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3239711,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":443,"num_read_kb":10891,"num_write":955,"num_write_kb":36342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":509,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:10.308784+0000","last_change":"2024-09-12T18:12:10.308784+0000","last_active":"2024-09-12T18:12:10.308784+0000","last_peered":"2024-09-12T18:12:10.308784+0000","last_clean":"2024-09-12T18:12:10.308784+0000","last_became_active":"2024-09-12T17:10:46.530452+0000","last_became_peered":"2024-09-12T17:10:46.530452+0000","last_unstale":"2024-09-12T18:12:10.308784+0000","last_undegraded":"2024-09-12T18:12:10.308784+0000","last_fullsized":"2024-09-12T18:12:10.308784+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:10.308679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:10.308679+0000","last_clean_scrub_stamp":"2024-09-12T18:12:10.308679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:39:55.785385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"263'148","reported_seq":735,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:17.650880+0000","last_change":"2024-09-12T18:12:17.650880+0000","last_active":"2024-09-12T18:12:17.650880+0000","last_peered":"2024-09-12T18:12:17.650880+0000","last_clean":"2024-09-12T18:12:17.650880+0000","last_became_active":"2024-09-12T17:10:48.537643+0000","last_became_peered":"2024-09-12T17:10:48.537643+0000","last_unstale":"2024-09-12T18:12:17.650880+0000","last_undegraded":"2024-09-12T18:12:17.650880+0000","last_fullsized":"2024-09-12T18:12:17.650880+0000","mapping_epoch":30,"log_start":"263'100","ondisk_log_start":"263'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'148","last_scrub_stamp":"2024-09-12T18:12:17.650791+0000","last_deep_scrub":"263'148","last_deep_scrub_stamp":"2024-09-12T18:12:17.650791+0000","last_clean_scrub_stamp":"2024-09-12T18:12:17.650791+0000","objects_scrubbed":6,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:09:51.365078+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4406,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":180,"num_read_kb":223,"num_write":96,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":506,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:10.456980+0000","last_change":"2024-09-12T18:12:10.456918+0000","last_active":"2024-09-12T18:12:10.456980+0000","last_peered":"2024-09-12T18:12:10.456980+0000","last_clean":"2024-09-12T18:12:10.456980+0000","last_became_active":"2024-09-12T17:10:50.565582+0000","last_became_peered":"2024-09-12T17:10:50.565582+0000","last_unstale":"2024-09-12T18:12:10.456980+0000","last_undegraded":"2024-09-12T18:12:10.456980+0000","last_fullsized":"2024-09-12T18:12:10.456980+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:10.456809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:10.456809+0000","last_clean_scrub_stamp":"2024-09-12T18:12:10.456809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:47:45.308848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"263'135","reported_seq":630,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:21.472980+0000","last_change":"2024-09-12T18:12:21.472980+0000","last_active":"2024-09-12T18:12:21.472980+0000","last_peered":"2024-09-12T18:12:21.472980+0000","last_clean":"2024-09-12T18:12:21.472980+0000","last_became_active":"2024-09-12T17:10:52.576370+0000","last_became_peered":"2024-09-12T17:10:52.576370+0000","last_unstale":"2024-09-12T18:12:21.472980+0000","last_undegraded":"2024-09-12T18:12:21.472980+0000","last_fullsized":"2024-09-12T18:12:21.472980+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'135","last_scrub_stamp":"2024-09-12T18:12:21.472872+0000","last_deep_scrub":"263'135","last_deep_scrub_stamp":"2024-09-12T18:12:21.472872+0000","last_clean_scrub_stamp":"2024-09-12T18:12:21.472872+0000","objects_scrubbed":5,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:25:02.852252+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1233,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":145,"num_read_kb":142,"num_write":322,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"263'875","reported_seq":2433,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:52.838814+0000","last_change":"2024-09-12T18:11:52.838814+0000","last_active":"2024-09-12T18:11:52.838814+0000","last_peered":"2024-09-12T18:11:52.838814+0000","last_clean":"2024-09-12T18:11:52.838814+0000","last_became_active":"2024-09-12T17:10:44.519318+0000","last_became_peered":"2024-09-12T17:10:44.519318+0000","last_unstale":"2024-09-12T18:11:52.838814+0000","last_undegraded":"2024-09-12T18:11:52.838814+0000","last_fullsized":"2024-09-12T18:11:52.838814+0000","mapping_epoch":26,"log_start":"263'800","ondisk_log_start":"263'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'875","last_scrub_stamp":"2024-09-12T18:11:52.838719+0000","last_deep_scrub":"263'875","last_deep_scrub_stamp":"2024-09-12T18:11:52.838719+0000","last_clean_scrub_stamp":"2024-09-12T18:11:52.838719+0000","objects_scrubbed":3,"log_size":75,"log_dups_size":800,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:40:19.551440+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4021,"num_read_kb":3592,"num_write":1141,"num_write_kb":414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"263'186","reported_seq":807,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:46.616198+0000","last_change":"2024-09-12T18:11:46.616198+0000","last_active":"2024-09-12T18:11:46.616198+0000","last_peered":"2024-09-12T18:11:46.616198+0000","last_clean":"2024-09-12T18:11:46.616198+0000","last_became_active":"2024-09-12T17:10:42.516802+0000","last_became_peered":"2024-09-12T17:10:42.516802+0000","last_unstale":"2024-09-12T18:11:46.616198+0000","last_undegraded":"2024-09-12T18:11:46.616198+0000","last_fullsized":"2024-09-12T18:11:46.616198+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'186","last_scrub_stamp":"2024-09-12T18:11:46.616065+0000","last_deep_scrub":"263'186","last_deep_scrub_stamp":"2024-09-12T18:11:46.616065+0000","last_clean_scrub_stamp":"2024-09-12T18:11:46.616065+0000","objects_scrubbed":5,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:50:13.105798+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":287306,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":394,"num_read_kb":13109,"num_write":967,"num_write_kb":28742,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7,1],"acting":[0,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"263'5","reported_seq":986,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:04.504714+0000","last_change":"2024-09-12T18:12:04.504714+0000","last_active":"2024-09-12T18:12:04.504714+0000","last_peered":"2024-09-12T18:12:04.504714+0000","last_clean":"2024-09-12T18:12:04.504714+0000","last_became_active":"2024-09-12T17:10:46.530466+0000","last_became_peered":"2024-09-12T17:10:46.530466+0000","last_unstale":"2024-09-12T18:12:04.504714+0000","last_undegraded":"2024-09-12T18:12:04.504714+0000","last_fullsized":"2024-09-12T18:12:04.504714+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'5","last_scrub_stamp":"2024-09-12T18:12:04.504622+0000","last_deep_scrub":"263'5","last_deep_scrub_stamp":"2024-09-12T18:12:04.504622+0000","last_clean_scrub_stamp":"2024-09-12T18:12:04.504622+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:57:02.945885+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":721,"num_read_kb":1187,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"263'97","reported_seq":639,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:14.360274+0000","last_change":"2024-09-12T18:12:14.360207+0000","last_active":"2024-09-12T18:12:14.360274+0000","last_peered":"2024-09-12T18:12:14.360274+0000","last_clean":"2024-09-12T18:12:14.360274+0000","last_became_active":"2024-09-12T17:10:48.537715+0000","last_became_peered":"2024-09-12T17:10:48.537715+0000","last_unstale":"2024-09-12T18:12:14.360274+0000","last_undegraded":"2024-09-12T18:12:14.360274+0000","last_fullsized":"2024-09-12T18:12:14.360274+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'97","last_scrub_stamp":"2024-09-12T18:12:14.360075+0000","last_deep_scrub":"263'97","last_deep_scrub_stamp":"2024-09-12T18:12:14.360075+0000","last_clean_scrub_stamp":"2024-09-12T18:12:14.360075+0000","objects_scrubbed":7,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:06:43.774112+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":103,"num_read_kb":94,"num_write":78,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1780,"num_omap_keys":6,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"263'763","reported_seq":2592,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:07.647873+0000","last_change":"2024-09-12T18:12:07.647873+0000","last_active":"2024-09-12T18:12:07.647873+0000","last_peered":"2024-09-12T18:12:07.647873+0000","last_clean":"2024-09-12T18:12:07.647873+0000","last_became_active":"2024-09-12T17:10:50.552439+0000","last_became_peered":"2024-09-12T17:10:50.552439+0000","last_unstale":"2024-09-12T18:12:07.647873+0000","last_undegraded":"2024-09-12T18:12:07.647873+0000","last_fullsized":"2024-09-12T18:12:07.647873+0000","mapping_epoch":32,"log_start":"263'700","ondisk_log_start":"263'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'763","last_scrub_stamp":"2024-09-12T18:12:07.647769+0000","last_deep_scrub":"263'763","last_deep_scrub_stamp":"2024-09-12T18:12:07.647769+0000","last_clean_scrub_stamp":"2024-09-12T18:12:07.647769+0000","objects_scrubbed":1,"log_size":63,"log_dups_size":700,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:23:23.514750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"263'102","reported_seq":608,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:19.510425+0000","last_change":"2024-09-12T18:12:19.510425+0000","last_active":"2024-09-12T18:12:19.510425+0000","last_peered":"2024-09-12T18:12:19.510425+0000","last_clean":"2024-09-12T18:12:19.510425+0000","last_became_active":"2024-09-12T17:10:52.576354+0000","last_became_peered":"2024-09-12T17:10:52.576354+0000","last_unstale":"2024-09-12T18:12:19.510425+0000","last_undegraded":"2024-09-12T18:12:19.510425+0000","last_fullsized":"2024-09-12T18:12:19.510425+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'102","last_scrub_stamp":"2024-09-12T18:12:19.510338+0000","last_deep_scrub":"263'102","last_deep_scrub_stamp":"2024-09-12T18:12:19.510338+0000","last_clean_scrub_stamp":"2024-09-12T18:12:19.510338+0000","objects_scrubbed":1,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:25:40.401986+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":153,"num_read_kb":145,"num_write":246,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"263'891","reported_seq":2570,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:58.382145+0000","last_change":"2024-09-12T18:11:58.382145+0000","last_active":"2024-09-12T18:11:58.382145+0000","last_peered":"2024-09-12T18:11:58.382145+0000","last_clean":"2024-09-12T18:11:58.382145+0000","last_became_active":"2024-09-12T17:10:44.514263+0000","last_became_peered":"2024-09-12T17:10:44.514263+0000","last_unstale":"2024-09-12T18:11:58.382145+0000","last_undegraded":"2024-09-12T18:11:58.382145+0000","last_fullsized":"2024-09-12T18:11:58.382145+0000","mapping_epoch":26,"log_start":"263'800","ondisk_log_start":"263'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'891","last_scrub_stamp":"2024-09-12T18:11:58.382053+0000","last_deep_scrub":"263'891","last_deep_scrub_stamp":"2024-09-12T18:11:58.382053+0000","last_clean_scrub_stamp":"2024-09-12T18:11:58.382053+0000","objects_scrubbed":3,"log_size":91,"log_dups_size":800,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:24:30.850739+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4092,"num_read_kb":3689,"num_write":1154,"num_write_kb":400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"263'220","reported_seq":866,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:49.222867+0000","last_change":"2024-09-12T18:11:49.222867+0000","last_active":"2024-09-12T18:11:49.222867+0000","last_peered":"2024-09-12T18:11:49.222867+0000","last_clean":"2024-09-12T18:11:49.222867+0000","last_became_active":"2024-09-12T17:10:42.527644+0000","last_became_peered":"2024-09-12T17:10:42.527644+0000","last_unstale":"2024-09-12T18:11:49.222867+0000","last_undegraded":"2024-09-12T18:11:49.222867+0000","last_fullsized":"2024-09-12T18:11:49.222867+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'220","last_scrub_stamp":"2024-09-12T18:11:49.222706+0000","last_deep_scrub":"263'220","last_deep_scrub_stamp":"2024-09-12T18:11:49.222706+0000","last_clean_scrub_stamp":"2024-09-12T18:11:49.222706+0000","objects_scrubbed":5,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:22:56.036981+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":569092,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":486,"num_read_kb":29332,"num_write":1044,"num_write_kb":31012,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,6],"acting":[5,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":500,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:08.571171+0000","last_change":"2024-09-12T18:12:08.571171+0000","last_active":"2024-09-12T18:12:08.571171+0000","last_peered":"2024-09-12T18:12:08.571171+0000","last_clean":"2024-09-12T18:12:08.571171+0000","last_became_active":"2024-09-12T17:10:46.531759+0000","last_became_peered":"2024-09-12T17:10:46.531759+0000","last_unstale":"2024-09-12T18:12:08.571171+0000","last_undegraded":"2024-09-12T18:12:08.571171+0000","last_fullsized":"2024-09-12T18:12:08.571171+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:08.571082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:08.571082+0000","last_clean_scrub_stamp":"2024-09-12T18:12:08.571082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:30:07.942782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"263'211","reported_seq":805,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:16.500087+0000","last_change":"2024-09-12T18:12:16.500087+0000","last_active":"2024-09-12T18:12:16.500087+0000","last_peered":"2024-09-12T18:12:16.500087+0000","last_clean":"2024-09-12T18:12:16.500087+0000","last_became_active":"2024-09-12T17:10:48.543123+0000","last_became_peered":"2024-09-12T17:10:48.543123+0000","last_unstale":"2024-09-12T18:12:16.500087+0000","last_undegraded":"2024-09-12T18:12:16.500087+0000","last_fullsized":"2024-09-12T18:12:16.500087+0000","mapping_epoch":30,"log_start":"263'200","ondisk_log_start":"263'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'211","last_scrub_stamp":"2024-09-12T18:12:16.499980+0000","last_deep_scrub":"263'211","last_deep_scrub_stamp":"2024-09-12T18:12:16.499980+0000","last_clean_scrub_stamp":"2024-09-12T18:12:16.499980+0000","objects_scrubbed":11,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:06:58.866518+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9151,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":248,"num_read_kb":305,"num_write":156,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:16.650045+0000","last_change":"2024-09-12T18:12:16.650045+0000","last_active":"2024-09-12T18:12:16.650045+0000","last_peered":"2024-09-12T18:12:16.650045+0000","last_clean":"2024-09-12T18:12:16.650045+0000","last_became_active":"2024-09-12T17:10:50.556040+0000","last_became_peered":"2024-09-12T17:10:50.556040+0000","last_unstale":"2024-09-12T18:12:16.650045+0000","last_undegraded":"2024-09-12T18:12:16.650045+0000","last_fullsized":"2024-09-12T18:12:16.650045+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:16.649958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:16.649958+0000","last_clean_scrub_stamp":"2024-09-12T18:12:16.649958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:14:49.148713+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"263'134","reported_seq":642,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:30.539641+0000","last_change":"2024-09-12T18:12:30.539641+0000","last_active":"2024-09-12T18:12:30.539641+0000","last_peered":"2024-09-12T18:12:30.539641+0000","last_clean":"2024-09-12T18:12:30.539641+0000","last_became_active":"2024-09-12T17:10:52.584752+0000","last_became_peered":"2024-09-12T17:10:52.584752+0000","last_unstale":"2024-09-12T18:12:30.539641+0000","last_undegraded":"2024-09-12T18:12:30.539641+0000","last_fullsized":"2024-09-12T18:12:30.539641+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'134","last_scrub_stamp":"2024-09-12T18:12:30.539556+0000","last_deep_scrub":"263'134","last_deep_scrub_stamp":"2024-09-12T18:12:30.539556+0000","last_clean_scrub_stamp":"2024-09-12T18:12:30.539556+0000","objects_scrubbed":2,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:04:43.237354+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":200,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":199,"num_read_kb":187,"num_write":331,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"263'458","reported_seq":2257,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:56.346868+0000","last_change":"2024-09-12T18:11:56.346868+0000","last_active":"2024-09-12T18:11:56.346868+0000","last_peered":"2024-09-12T18:11:56.346868+0000","last_clean":"2024-09-12T18:11:56.346868+0000","last_became_active":"2024-09-12T17:10:44.515463+0000","last_became_peered":"2024-09-12T17:10:44.515463+0000","last_unstale":"2024-09-12T18:11:56.346868+0000","last_undegraded":"2024-09-12T18:11:56.346868+0000","last_fullsized":"2024-09-12T18:11:56.346868+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'458","last_scrub_stamp":"2024-09-12T18:11:56.346672+0000","last_deep_scrub":"263'458","last_deep_scrub_stamp":"2024-09-12T18:11:56.346672+0000","last_clean_scrub_stamp":"2024-09-12T18:11:56.346672+0000","objects_scrubbed":3,"log_size":58,"log_dups_size":400,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:31:31.404176+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2803,"num_read_kb":2700,"num_write":505,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2296,"num_omap_keys":9,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"263'189","reported_seq":813,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:52.278519+0000","last_change":"2024-09-12T18:11:52.278519+0000","last_active":"2024-09-12T18:11:52.278519+0000","last_peered":"2024-09-12T18:11:52.278519+0000","last_clean":"2024-09-12T18:11:52.278519+0000","last_became_active":"2024-09-12T17:10:42.529547+0000","last_became_peered":"2024-09-12T17:10:42.529547+0000","last_unstale":"2024-09-12T18:11:52.278519+0000","last_undegraded":"2024-09-12T18:11:52.278519+0000","last_fullsized":"2024-09-12T18:11:52.278519+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'189","last_scrub_stamp":"2024-09-12T18:11:52.278416+0000","last_deep_scrub":"263'189","last_deep_scrub_stamp":"2024-09-12T18:11:52.278416+0000","last_clean_scrub_stamp":"2024-09-12T18:11:52.278416+0000","objects_scrubbed":1,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:18:56.517970+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262159,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":394,"num_read_kb":39415,"num_write":893,"num_write_kb":32700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,6],"acting":[5,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":501,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:10.426744+0000","last_change":"2024-09-12T18:12:10.426744+0000","last_active":"2024-09-12T18:12:10.426744+0000","last_peered":"2024-09-12T18:12:10.426744+0000","last_clean":"2024-09-12T18:12:10.426744+0000","last_became_active":"2024-09-12T17:10:46.532418+0000","last_became_peered":"2024-09-12T17:10:46.532418+0000","last_unstale":"2024-09-12T18:12:10.426744+0000","last_undegraded":"2024-09-12T18:12:10.426744+0000","last_fullsized":"2024-09-12T18:12:10.426744+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:10.426654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:10.426654+0000","last_clean_scrub_stamp":"2024-09-12T18:12:10.426654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:46:06.300212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"263'135","reported_seq":716,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:10.720683+0000","last_change":"2024-09-12T18:12:10.720683+0000","last_active":"2024-09-12T18:12:10.720683+0000","last_peered":"2024-09-12T18:12:10.720683+0000","last_clean":"2024-09-12T18:12:10.720683+0000","last_became_active":"2024-09-12T17:10:48.539047+0000","last_became_peered":"2024-09-12T17:10:48.539047+0000","last_unstale":"2024-09-12T18:12:10.720683+0000","last_undegraded":"2024-09-12T18:12:10.720683+0000","last_fullsized":"2024-09-12T18:12:10.720683+0000","mapping_epoch":30,"log_start":"263'100","ondisk_log_start":"263'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'135","last_scrub_stamp":"2024-09-12T18:12:10.720566+0000","last_deep_scrub":"263'135","last_deep_scrub_stamp":"2024-09-12T18:12:10.720566+0000","last_clean_scrub_stamp":"2024-09-12T18:12:10.720566+0000","objects_scrubbed":4,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:38:55.106793+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5891,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":167,"num_read_kb":220,"num_write":88,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:06.695452+0000","last_change":"2024-09-12T18:12:06.695452+0000","last_active":"2024-09-12T18:12:06.695452+0000","last_peered":"2024-09-12T18:12:06.695452+0000","last_clean":"2024-09-12T18:12:06.695452+0000","last_became_active":"2024-09-12T17:10:50.555858+0000","last_became_peered":"2024-09-12T17:10:50.555858+0000","last_unstale":"2024-09-12T18:12:06.695452+0000","last_undegraded":"2024-09-12T18:12:06.695452+0000","last_fullsized":"2024-09-12T18:12:06.695452+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:06.695331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:06.695331+0000","last_clean_scrub_stamp":"2024-09-12T18:12:06.695331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:53:28.220067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"263'113","reported_seq":635,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:27.601203+0000","last_change":"2024-09-12T18:12:27.601203+0000","last_active":"2024-09-12T18:12:27.601203+0000","last_peered":"2024-09-12T18:12:27.601203+0000","last_clean":"2024-09-12T18:12:27.601203+0000","last_became_active":"2024-09-12T17:10:52.671139+0000","last_became_peered":"2024-09-12T17:10:52.671139+0000","last_unstale":"2024-09-12T18:12:27.601203+0000","last_undegraded":"2024-09-12T18:12:27.601203+0000","last_fullsized":"2024-09-12T18:12:27.601203+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'113","last_scrub_stamp":"2024-09-12T18:12:27.601114+0000","last_deep_scrub":"263'113","last_deep_scrub_stamp":"2024-09-12T18:12:27.601114+0000","last_clean_scrub_stamp":"2024-09-12T18:12:27.601114+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:04:28.884400+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":178,"num_read_kb":175,"num_write":256,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"263'787","reported_seq":2346,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:02.451406+0000","last_change":"2024-09-12T18:12:02.451406+0000","last_active":"2024-09-12T18:12:02.451406+0000","last_peered":"2024-09-12T18:12:02.451406+0000","last_clean":"2024-09-12T18:12:02.451406+0000","last_became_active":"2024-09-12T17:11:16.618723+0000","last_became_peered":"2024-09-12T17:11:16.618723+0000","last_unstale":"2024-09-12T18:12:02.451406+0000","last_undegraded":"2024-09-12T18:12:02.451406+0000","last_fullsized":"2024-09-12T18:12:02.451406+0000","mapping_epoch":37,"log_start":"263'700","ondisk_log_start":"263'700","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'787","last_scrub_stamp":"2024-09-12T18:12:02.451316+0000","last_deep_scrub":"263'787","last_deep_scrub_stamp":"2024-09-12T18:12:02.451316+0000","last_clean_scrub_stamp":"2024-09-12T18:12:02.451316+0000","objects_scrubbed":3,"log_size":87,"log_dups_size":700,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:25:44.064178+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4039,"num_read_kb":3670,"num_write":1050,"num_write_kb":387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":721,"num_omap_keys":3,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"263'172","reported_seq":842,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:51.566831+0000","last_change":"2024-09-12T18:11:51.566718+0000","last_active":"2024-09-12T18:11:51.566831+0000","last_peered":"2024-09-12T18:11:51.566831+0000","last_clean":"2024-09-12T18:11:51.566831+0000","last_became_active":"2024-09-12T17:10:42.534052+0000","last_became_peered":"2024-09-12T17:10:42.534052+0000","last_unstale":"2024-09-12T18:11:51.566831+0000","last_undegraded":"2024-09-12T18:11:51.566831+0000","last_fullsized":"2024-09-12T18:11:51.566831+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'172","last_scrub_stamp":"2024-09-12T18:11:51.566522+0000","last_deep_scrub":"263'172","last_deep_scrub_stamp":"2024-09-12T18:11:51.566522+0000","last_clean_scrub_stamp":"2024-09-12T18:11:51.566522+0000","objects_scrubbed":4,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:00:03.267177+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":311063,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":426,"num_read_kb":101566,"num_write":826,"num_write_kb":35642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7,2],"acting":[3,6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":510,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:07.339407+0000","last_change":"2024-09-12T18:12:07.339407+0000","last_active":"2024-09-12T18:12:07.339407+0000","last_peered":"2024-09-12T18:12:07.339407+0000","last_clean":"2024-09-12T18:12:07.339407+0000","last_became_active":"2024-09-12T17:10:46.530079+0000","last_became_peered":"2024-09-12T17:10:46.530079+0000","last_unstale":"2024-09-12T18:12:07.339407+0000","last_undegraded":"2024-09-12T18:12:07.339407+0000","last_fullsized":"2024-09-12T18:12:07.339407+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:07.339316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:07.339316+0000","last_clean_scrub_stamp":"2024-09-12T18:12:07.339316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:50:36.646747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"263'106","reported_seq":670,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:18.615653+0000","last_change":"2024-09-12T18:12:18.615653+0000","last_active":"2024-09-12T18:12:18.615653+0000","last_peered":"2024-09-12T18:12:18.615653+0000","last_clean":"2024-09-12T18:12:18.615653+0000","last_became_active":"2024-09-12T17:10:48.542918+0000","last_became_peered":"2024-09-12T17:10:48.542918+0000","last_unstale":"2024-09-12T18:12:18.615653+0000","last_undegraded":"2024-09-12T18:12:18.615653+0000","last_fullsized":"2024-09-12T18:12:18.615653+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'106","last_scrub_stamp":"2024-09-12T18:12:18.615561+0000","last_deep_scrub":"263'106","last_deep_scrub_stamp":"2024-09-12T18:12:18.615561+0000","last_clean_scrub_stamp":"2024-09-12T18:12:18.615561+0000","objects_scrubbed":2,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:13:33.347662+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7088,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":129,"num_read_kb":191,"num_write":60,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":501,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:17.332759+0000","last_change":"2024-09-12T18:12:17.332759+0000","last_active":"2024-09-12T18:12:17.332759+0000","last_peered":"2024-09-12T18:12:17.332759+0000","last_clean":"2024-09-12T18:12:17.332759+0000","last_became_active":"2024-09-12T17:10:50.558162+0000","last_became_peered":"2024-09-12T17:10:50.558162+0000","last_unstale":"2024-09-12T18:12:17.332759+0000","last_undegraded":"2024-09-12T18:12:17.332759+0000","last_fullsized":"2024-09-12T18:12:17.332759+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:17.332674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:17.332674+0000","last_clean_scrub_stamp":"2024-09-12T18:12:17.332674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:35:12.355855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"263'154","reported_seq":1257,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:20.511456+0000","last_change":"2024-09-12T18:12:20.511456+0000","last_active":"2024-09-12T18:12:20.511456+0000","last_peered":"2024-09-12T18:12:20.511456+0000","last_clean":"2024-09-12T18:12:20.511456+0000","last_became_active":"2024-09-12T17:10:52.584763+0000","last_became_peered":"2024-09-12T17:10:52.584763+0000","last_unstale":"2024-09-12T18:12:20.511456+0000","last_undegraded":"2024-09-12T18:12:20.511456+0000","last_fullsized":"2024-09-12T18:12:20.511456+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'154","last_scrub_stamp":"2024-09-12T18:12:20.511367+0000","last_deep_scrub":"263'154","last_deep_scrub_stamp":"2024-09-12T18:12:20.511367+0000","last_clean_scrub_stamp":"2024-09-12T18:12:20.511367+0000","objects_scrubbed":3,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:48:36.131028+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":215,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":802,"num_read_kb":800,"num_write":350,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"263'1274","reported_seq":2985,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:55.368952+0000","last_change":"2024-09-12T18:11:55.368952+0000","last_active":"2024-09-12T18:11:55.368952+0000","last_peered":"2024-09-12T18:11:55.368952+0000","last_clean":"2024-09-12T18:11:55.368952+0000","last_became_active":"2024-09-12T17:10:44.513047+0000","last_became_peered":"2024-09-12T17:10:44.513047+0000","last_unstale":"2024-09-12T18:11:55.368952+0000","last_undegraded":"2024-09-12T18:11:55.368952+0000","last_fullsized":"2024-09-12T18:11:55.368952+0000","mapping_epoch":26,"log_start":"263'1200","ondisk_log_start":"263'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1274","last_scrub_stamp":"2024-09-12T18:11:55.368862+0000","last_deep_scrub":"263'1274","last_deep_scrub_stamp":"2024-09-12T18:11:55.368862+0000","last_clean_scrub_stamp":"2024-09-12T18:11:55.368862+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":1200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:24:50.641775+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5916,"num_read_kb":5241,"num_write":1773,"num_write_kb":764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"263'270","reported_seq":946,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:49.700632+0000","last_change":"2024-09-12T18:11:49.700632+0000","last_active":"2024-09-12T18:11:49.700632+0000","last_peered":"2024-09-12T18:11:49.700632+0000","last_clean":"2024-09-12T18:11:49.700632+0000","last_became_active":"2024-09-12T17:11:16.862649+0000","last_became_peered":"2024-09-12T17:11:16.862649+0000","last_unstale":"2024-09-12T18:11:49.700632+0000","last_undegraded":"2024-09-12T18:11:49.700632+0000","last_fullsized":"2024-09-12T18:11:49.700632+0000","mapping_epoch":37,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'270","last_scrub_stamp":"2024-09-12T18:11:49.700437+0000","last_deep_scrub":"263'270","last_deep_scrub_stamp":"2024-09-12T18:11:49.700437+0000","last_clean_scrub_stamp":"2024-09-12T18:11:49.700437+0000","objects_scrubbed":5,"log_size":70,"log_dups_size":200,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:58:14.954108+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079905,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":591,"num_read_kb":13963,"num_write":1200,"num_write_kb":16858,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,7],"acting":[0,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"263'2","reported_seq":510,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:03.517735+0000","last_change":"2024-09-12T18:12:03.517735+0000","last_active":"2024-09-12T18:12:03.517735+0000","last_peered":"2024-09-12T18:12:03.517735+0000","last_clean":"2024-09-12T18:12:03.517735+0000","last_became_active":"2024-09-12T17:10:46.527422+0000","last_became_peered":"2024-09-12T17:10:46.527422+0000","last_unstale":"2024-09-12T18:12:03.517735+0000","last_undegraded":"2024-09-12T18:12:03.517735+0000","last_fullsized":"2024-09-12T18:12:03.517735+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T18:12:03.517615+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T18:12:03.517615+0000","last_clean_scrub_stamp":"2024-09-12T18:12:03.517615+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:57.076736+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"263'170","reported_seq":769,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:12.322398+0000","last_change":"2024-09-12T18:12:12.322398+0000","last_active":"2024-09-12T18:12:12.322398+0000","last_peered":"2024-09-12T18:12:12.322398+0000","last_clean":"2024-09-12T18:12:12.322398+0000","last_became_active":"2024-09-12T17:10:48.544572+0000","last_became_peered":"2024-09-12T17:10:48.544572+0000","last_unstale":"2024-09-12T18:12:12.322398+0000","last_undegraded":"2024-09-12T18:12:12.322398+0000","last_fullsized":"2024-09-12T18:12:12.322398+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'170","last_scrub_stamp":"2024-09-12T18:12:12.322280+0000","last_deep_scrub":"263'170","last_deep_scrub_stamp":"2024-09-12T18:12:12.322280+0000","last_clean_scrub_stamp":"2024-09-12T18:12:12.322280+0000","objects_scrubbed":5,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:27:13.540812+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6031,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":216,"num_read_kb":279,"num_write":122,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":498,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:17.660362+0000","last_change":"2024-09-12T18:12:17.660362+0000","last_active":"2024-09-12T18:12:17.660362+0000","last_peered":"2024-09-12T18:12:17.660362+0000","last_clean":"2024-09-12T18:12:17.660362+0000","last_became_active":"2024-09-12T17:10:50.560057+0000","last_became_peered":"2024-09-12T17:10:50.560057+0000","last_unstale":"2024-09-12T18:12:17.660362+0000","last_undegraded":"2024-09-12T18:12:17.660362+0000","last_fullsized":"2024-09-12T18:12:17.660362+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:12:17.660267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:12:17.660267+0000","last_clean_scrub_stamp":"2024-09-12T18:12:17.660267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:54:00.890287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"263'134","reported_seq":634,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:19.333865+0000","last_change":"2024-09-12T18:12:19.333865+0000","last_active":"2024-09-12T18:12:19.333865+0000","last_peered":"2024-09-12T18:12:19.333865+0000","last_clean":"2024-09-12T18:12:19.333865+0000","last_became_active":"2024-09-12T17:10:52.570480+0000","last_became_peered":"2024-09-12T17:10:52.570480+0000","last_unstale":"2024-09-12T18:12:19.333865+0000","last_undegraded":"2024-09-12T18:12:19.333865+0000","last_fullsized":"2024-09-12T18:12:19.333865+0000","mapping_epoch":34,"log_start":"263'100","ondisk_log_start":"263'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'134","last_scrub_stamp":"2024-09-12T18:12:19.333752+0000","last_deep_scrub":"263'134","last_deep_scrub_stamp":"2024-09-12T18:12:19.333752+0000","last_clean_scrub_stamp":"2024-09-12T18:12:19.333752+0000","objects_scrubbed":2,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:45:19.407409+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":203,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":138,"num_read_kb":137,"num_write":320,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"263'412","reported_seq":1803,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:01.560956+0000","last_change":"2024-09-12T18:12:01.560956+0000","last_active":"2024-09-12T18:12:01.560956+0000","last_peered":"2024-09-12T18:12:01.560956+0000","last_clean":"2024-09-12T18:12:01.560956+0000","last_became_active":"2024-09-12T17:10:44.509508+0000","last_became_peered":"2024-09-12T17:10:44.509508+0000","last_unstale":"2024-09-12T18:12:01.560956+0000","last_undegraded":"2024-09-12T18:12:01.560956+0000","last_fullsized":"2024-09-12T18:12:01.560956+0000","mapping_epoch":26,"log_start":"263'401","ondisk_log_start":"263'401","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'412","last_scrub_stamp":"2024-09-12T18:12:01.560858+0000","last_deep_scrub":"263'412","last_deep_scrub_stamp":"2024-09-12T18:12:01.560858+0000","last_clean_scrub_stamp":"2024-09-12T18:12:01.560858+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":401,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:20:20.291813+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2094,"num_read_kb":1953,"num_write":504,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"263'239","reported_seq":891,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:50.835781+0000","last_change":"2024-09-12T18:11:50.835781+0000","last_active":"2024-09-12T18:11:50.835781+0000","last_peered":"2024-09-12T18:11:50.835781+0000","last_clean":"2024-09-12T18:11:50.835781+0000","last_became_active":"2024-09-12T17:10:42.521435+0000","last_became_peered":"2024-09-12T17:10:42.521435+0000","last_unstale":"2024-09-12T18:11:50.835781+0000","last_undegraded":"2024-09-12T18:11:50.835781+0000","last_fullsized":"2024-09-12T18:11:50.835781+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'239","last_scrub_stamp":"2024-09-12T18:11:50.835643+0000","last_deep_scrub":"263'239","last_deep_scrub_stamp":"2024-09-12T18:11:50.835643+0000","last_clean_scrub_stamp":"2024-09-12T18:11:50.835643+0000","objects_scrubbed":2,"log_size":39,"log_dups_size":200,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:10:01.459513+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079890,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":525,"num_read_kb":7759,"num_write":1104,"num_write_kb":27695,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,5],"acting":[6,0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"263'496","reported_seq":2220,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:59.616995+0000","last_change":"2024-09-12T18:11:59.616995+0000","last_active":"2024-09-12T18:11:59.616995+0000","last_peered":"2024-09-12T18:11:59.616995+0000","last_clean":"2024-09-12T18:11:59.616995+0000","last_became_active":"2024-09-12T17:10:44.519236+0000","last_became_peered":"2024-09-12T17:10:44.519236+0000","last_unstale":"2024-09-12T18:11:59.616995+0000","last_undegraded":"2024-09-12T18:11:59.616995+0000","last_fullsized":"2024-09-12T18:11:59.616995+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'496","last_scrub_stamp":"2024-09-12T18:11:59.616900+0000","last_deep_scrub":"263'496","last_deep_scrub_stamp":"2024-09-12T18:11:59.616900+0000","last_clean_scrub_stamp":"2024-09-12T18:11:59.616900+0000","objects_scrubbed":4,"log_size":96,"log_dups_size":400,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:18:26.390822+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2628,"num_read_kb":2506,"num_write":587,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":959,"num_omap_keys":4,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"263'256","reported_seq":1028,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:46.841303+0000","last_change":"2024-09-12T18:11:46.841303+0000","last_active":"2024-09-12T18:11:46.841303+0000","last_peered":"2024-09-12T18:11:46.841303+0000","last_clean":"2024-09-12T18:11:46.841303+0000","last_became_active":"2024-09-12T17:10:42.519178+0000","last_became_peered":"2024-09-12T17:10:42.519178+0000","last_unstale":"2024-09-12T18:11:46.841303+0000","last_undegraded":"2024-09-12T18:11:46.841303+0000","last_fullsized":"2024-09-12T18:11:46.841303+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'256","last_scrub_stamp":"2024-09-12T18:11:46.841193+0000","last_deep_scrub":"263'256","last_deep_scrub_stamp":"2024-09-12T18:11:46.841193+0000","last_clean_scrub_stamp":"2024-09-12T18:11:46.841193+0000","objects_scrubbed":4,"log_size":56,"log_dups_size":200,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:18:03.918052+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1051,"num_read_kb":7502,"num_write":1184,"num_write_kb":38848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6,7],"acting":[2,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"263'393","reported_seq":1978,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:03.464560+0000","last_change":"2024-09-12T18:12:03.464560+0000","last_active":"2024-09-12T18:12:03.464560+0000","last_peered":"2024-09-12T18:12:03.464560+0000","last_clean":"2024-09-12T18:12:03.464560+0000","last_became_active":"2024-09-12T17:10:44.515474+0000","last_became_peered":"2024-09-12T17:10:44.515474+0000","last_unstale":"2024-09-12T18:12:03.464560+0000","last_undegraded":"2024-09-12T18:12:03.464560+0000","last_fullsized":"2024-09-12T18:12:03.464560+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'393","last_scrub_stamp":"2024-09-12T18:12:03.464469+0000","last_deep_scrub":"263'393","last_deep_scrub_stamp":"2024-09-12T18:12:03.464469+0000","last_clean_scrub_stamp":"2024-09-12T18:12:03.464469+0000","objects_scrubbed":2,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:20:00.913328+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2306,"num_read_kb":2212,"num_write":451,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2811,"num_omap_keys":11,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"263'194","reported_seq":821,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:49.831325+0000","last_change":"2024-09-12T18:11:49.831325+0000","last_active":"2024-09-12T18:11:49.831325+0000","last_peered":"2024-09-12T18:11:49.831325+0000","last_clean":"2024-09-12T18:11:49.831325+0000","last_became_active":"2024-09-12T17:11:16.617657+0000","last_became_peered":"2024-09-12T17:11:16.617657+0000","last_unstale":"2024-09-12T18:11:49.831325+0000","last_undegraded":"2024-09-12T18:11:49.831325+0000","last_fullsized":"2024-09-12T18:11:49.831325+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'194","last_scrub_stamp":"2024-09-12T18:11:49.831132+0000","last_deep_scrub":"263'194","last_deep_scrub_stamp":"2024-09-12T18:11:49.831132+0000","last_clean_scrub_stamp":"2024-09-12T18:11:49.831132+0000","objects_scrubbed":4,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:50:28.703505+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2421940,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":499,"num_read_kb":26759,"num_write":947,"num_write_kb":25619,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,6],"acting":[2,3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"263'796","reported_seq":2424,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:58.588172+0000","last_change":"2024-09-12T18:11:58.588172+0000","last_active":"2024-09-12T18:11:58.588172+0000","last_peered":"2024-09-12T18:11:58.588172+0000","last_clean":"2024-09-12T18:11:58.588172+0000","last_became_active":"2024-09-12T17:10:44.509845+0000","last_became_peered":"2024-09-12T17:10:44.509845+0000","last_unstale":"2024-09-12T18:11:58.588172+0000","last_undegraded":"2024-09-12T18:11:58.588172+0000","last_fullsized":"2024-09-12T18:11:58.588172+0000","mapping_epoch":26,"log_start":"263'700","ondisk_log_start":"263'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'796","last_scrub_stamp":"2024-09-12T18:11:58.588066+0000","last_deep_scrub":"263'796","last_deep_scrub_stamp":"2024-09-12T18:11:58.588066+0000","last_clean_scrub_stamp":"2024-09-12T18:11:58.588066+0000","objects_scrubbed":4,"log_size":96,"log_dups_size":700,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:21:17.530150+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3882,"num_read_kb":3524,"num_write":1030,"num_write_kb":369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1767,"num_omap_keys":7,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"263'227","reported_seq":866,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:48.683516+0000","last_change":"2024-09-12T18:11:48.683516+0000","last_active":"2024-09-12T18:11:48.683516+0000","last_peered":"2024-09-12T18:11:48.683516+0000","last_clean":"2024-09-12T18:11:48.683516+0000","last_became_active":"2024-09-12T17:10:42.519560+0000","last_became_peered":"2024-09-12T17:10:42.519560+0000","last_unstale":"2024-09-12T18:11:48.683516+0000","last_undegraded":"2024-09-12T18:11:48.683516+0000","last_fullsized":"2024-09-12T18:11:48.683516+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'227","last_scrub_stamp":"2024-09-12T18:11:48.683332+0000","last_deep_scrub":"263'227","last_deep_scrub_stamp":"2024-09-12T18:11:48.683332+0000","last_clean_scrub_stamp":"2024-09-12T18:11:48.683332+0000","objects_scrubbed":4,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:30:14.775998+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436858,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":420,"num_read_kb":2141,"num_write":1026,"num_write_kb":23963,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,1],"acting":[0,3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"263'775","reported_seq":2456,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:02.695598+0000","last_change":"2024-09-12T18:12:02.695598+0000","last_active":"2024-09-12T18:12:02.695598+0000","last_peered":"2024-09-12T18:12:02.695598+0000","last_clean":"2024-09-12T18:12:02.695598+0000","last_became_active":"2024-09-12T17:10:44.511893+0000","last_became_peered":"2024-09-12T17:10:44.511893+0000","last_unstale":"2024-09-12T18:12:02.695598+0000","last_undegraded":"2024-09-12T18:12:02.695598+0000","last_fullsized":"2024-09-12T18:12:02.695598+0000","mapping_epoch":26,"log_start":"263'700","ondisk_log_start":"263'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'775","last_scrub_stamp":"2024-09-12T18:12:02.695496+0000","last_deep_scrub":"263'775","last_deep_scrub_stamp":"2024-09-12T18:12:02.695496+0000","last_clean_scrub_stamp":"2024-09-12T18:12:02.695496+0000","objects_scrubbed":6,"log_size":75,"log_dups_size":700,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:46:44.854411+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":3826,"num_read_kb":3490,"num_write":982,"num_write_kb":336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":873,"num_omap_keys":4,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"263'223","reported_seq":1076,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:52.597345+0000","last_change":"2024-09-12T18:11:52.597345+0000","last_active":"2024-09-12T18:11:52.597345+0000","last_peered":"2024-09-12T18:11:52.597345+0000","last_clean":"2024-09-12T18:11:52.597345+0000","last_became_active":"2024-09-12T17:10:42.524018+0000","last_became_peered":"2024-09-12T17:10:42.524018+0000","last_unstale":"2024-09-12T18:11:52.597345+0000","last_undegraded":"2024-09-12T18:11:52.597345+0000","last_fullsized":"2024-09-12T18:11:52.597345+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'223","last_scrub_stamp":"2024-09-12T18:11:52.597221+0000","last_deep_scrub":"263'223","last_deep_scrub_stamp":"2024-09-12T18:11:52.597221+0000","last_clean_scrub_stamp":"2024-09-12T18:11:52.597221+0000","objects_scrubbed":7,"log_size":23,"log_dups_size":200,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:24:31.501834+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6860809,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1298,"num_read_kb":150766,"num_write":988,"num_write_kb":42134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0,7],"acting":[3,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"263'525","reported_seq":2028,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:00.344852+0000","last_change":"2024-09-12T18:12:00.344852+0000","last_active":"2024-09-12T18:12:00.344852+0000","last_peered":"2024-09-12T18:12:00.344852+0000","last_clean":"2024-09-12T18:12:00.344852+0000","last_became_active":"2024-09-12T17:10:44.509433+0000","last_became_peered":"2024-09-12T17:10:44.509433+0000","last_unstale":"2024-09-12T18:12:00.344852+0000","last_undegraded":"2024-09-12T18:12:00.344852+0000","last_fullsized":"2024-09-12T18:12:00.344852+0000","mapping_epoch":26,"log_start":"263'500","ondisk_log_start":"263'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'525","last_scrub_stamp":"2024-09-12T18:12:00.344754+0000","last_deep_scrub":"263'525","last_deep_scrub_stamp":"2024-09-12T18:12:00.344754+0000","last_clean_scrub_stamp":"2024-09-12T18:12:00.344754+0000","objects_scrubbed":1,"log_size":25,"log_dups_size":500,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:26:19.066537+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2637,"num_read_kb":2409,"num_write":664,"num_write_kb":195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"263'180","reported_seq":848,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:49.669048+0000","last_change":"2024-09-12T18:11:49.669048+0000","last_active":"2024-09-12T18:11:49.669048+0000","last_peered":"2024-09-12T18:11:49.669048+0000","last_clean":"2024-09-12T18:11:49.669048+0000","last_became_active":"2024-09-12T17:10:42.514593+0000","last_became_peered":"2024-09-12T17:10:42.514593+0000","last_unstale":"2024-09-12T18:11:49.669048+0000","last_undegraded":"2024-09-12T18:11:49.669048+0000","last_fullsized":"2024-09-12T18:11:49.669048+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'180","last_scrub_stamp":"2024-09-12T18:11:49.668940+0000","last_deep_scrub":"263'180","last_deep_scrub_stamp":"2024-09-12T18:11:49.668940+0000","last_clean_scrub_stamp":"2024-09-12T18:11:49.668940+0000","objects_scrubbed":3,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:25:30.505868+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262186,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":484,"num_read_kb":20980,"num_write":843,"num_write_kb":34024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,5],"acting":[1,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"263'1126","reported_seq":2702,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:59.649341+0000","last_change":"2024-09-12T18:11:59.649341+0000","last_active":"2024-09-12T18:11:59.649341+0000","last_peered":"2024-09-12T18:11:59.649341+0000","last_clean":"2024-09-12T18:11:59.649341+0000","last_became_active":"2024-09-12T17:10:44.522911+0000","last_became_peered":"2024-09-12T17:10:44.522911+0000","last_unstale":"2024-09-12T18:11:59.649341+0000","last_undegraded":"2024-09-12T18:11:59.649341+0000","last_fullsized":"2024-09-12T18:11:59.649341+0000","mapping_epoch":26,"log_start":"263'1100","ondisk_log_start":"263'1100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1126","last_scrub_stamp":"2024-09-12T18:11:59.649236+0000","last_deep_scrub":"263'1126","last_deep_scrub_stamp":"2024-09-12T18:11:59.649236+0000","last_clean_scrub_stamp":"2024-09-12T18:11:59.649236+0000","objects_scrubbed":2,"log_size":26,"log_dups_size":1100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:23:15.875406+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5182,"num_read_kb":4601,"num_write":1539,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"263'194","reported_seq":848,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:51.815496+0000","last_change":"2024-09-12T18:11:51.815496+0000","last_active":"2024-09-12T18:11:51.815496+0000","last_peered":"2024-09-12T18:11:51.815496+0000","last_clean":"2024-09-12T18:11:51.815496+0000","last_became_active":"2024-09-12T17:10:42.520304+0000","last_became_peered":"2024-09-12T17:10:42.520304+0000","last_unstale":"2024-09-12T18:11:51.815496+0000","last_undegraded":"2024-09-12T18:11:51.815496+0000","last_fullsized":"2024-09-12T18:11:51.815496+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'194","last_scrub_stamp":"2024-09-12T18:11:51.815318+0000","last_deep_scrub":"263'194","last_deep_scrub_stamp":"2024-09-12T18:11:51.815318+0000","last_clean_scrub_stamp":"2024-09-12T18:11:51.815318+0000","objects_scrubbed":2,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:18:33.880648+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1342049,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":493,"num_read_kb":8074,"num_write":952,"num_write_kb":20454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4,5],"acting":[6,7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"263'882","reported_seq":2590,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:57.696628+0000","last_change":"2024-09-12T18:11:57.696628+0000","last_active":"2024-09-12T18:11:57.696628+0000","last_peered":"2024-09-12T18:11:57.696628+0000","last_clean":"2024-09-12T18:11:57.696628+0000","last_became_active":"2024-09-12T17:10:44.517530+0000","last_became_peered":"2024-09-12T17:10:44.517530+0000","last_unstale":"2024-09-12T18:11:57.696628+0000","last_undegraded":"2024-09-12T18:11:57.696628+0000","last_fullsized":"2024-09-12T18:11:57.696628+0000","mapping_epoch":26,"log_start":"263'800","ondisk_log_start":"263'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'882","last_scrub_stamp":"2024-09-12T18:11:57.696541+0000","last_deep_scrub":"263'882","last_deep_scrub_stamp":"2024-09-12T18:11:57.696541+0000","last_clean_scrub_stamp":"2024-09-12T18:11:57.696541+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":800,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:06:13.761379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4395,"num_read_kb":3967,"num_write":1219,"num_write_kb":499,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"263'187","reported_seq":816,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:04.607590+0000","last_change":"2024-09-12T18:12:04.607590+0000","last_active":"2024-09-12T18:12:04.607590+0000","last_peered":"2024-09-12T18:12:04.607590+0000","last_clean":"2024-09-12T18:12:04.607590+0000","last_became_active":"2024-09-12T17:10:42.528899+0000","last_became_peered":"2024-09-12T17:10:42.528899+0000","last_unstale":"2024-09-12T18:12:04.607590+0000","last_undegraded":"2024-09-12T18:12:04.607590+0000","last_fullsized":"2024-09-12T18:12:04.607590+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'187","last_scrub_stamp":"2024-09-12T18:12:04.607432+0000","last_deep_scrub":"263'187","last_deep_scrub_stamp":"2024-09-12T18:12:04.607432+0000","last_clean_scrub_stamp":"2024-09-12T18:12:04.607432+0000","objects_scrubbed":5,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:45:28.481287+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7371399,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":389,"num_read_kb":42419,"num_write":869,"num_write_kb":46548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,5],"acting":[3,4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"263'388","reported_seq":1852,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:00.729788+0000","last_change":"2024-09-12T18:12:00.729788+0000","last_active":"2024-09-12T18:12:00.729788+0000","last_peered":"2024-09-12T18:12:00.729788+0000","last_clean":"2024-09-12T18:12:00.729788+0000","last_became_active":"2024-09-12T17:10:44.523173+0000","last_became_peered":"2024-09-12T17:10:44.523173+0000","last_unstale":"2024-09-12T18:12:00.729788+0000","last_undegraded":"2024-09-12T18:12:00.729788+0000","last_fullsized":"2024-09-12T18:12:00.729788+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'388","last_scrub_stamp":"2024-09-12T18:12:00.729701+0000","last_deep_scrub":"263'388","last_deep_scrub_stamp":"2024-09-12T18:12:00.729701+0000","last_clean_scrub_stamp":"2024-09-12T18:12:00.729701+0000","objects_scrubbed":3,"log_size":88,"log_dups_size":300,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:17:09.750351+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2006,"num_read_kb":1913,"num_write":441,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":236,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"263'150","reported_seq":852,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:50.263634+0000","last_change":"2024-09-12T18:11:50.263634+0000","last_active":"2024-09-12T18:11:50.263634+0000","last_peered":"2024-09-12T18:11:50.263634+0000","last_clean":"2024-09-12T18:11:50.263634+0000","last_became_active":"2024-09-12T17:10:42.521824+0000","last_became_peered":"2024-09-12T17:10:42.521824+0000","last_unstale":"2024-09-12T18:11:50.263634+0000","last_undegraded":"2024-09-12T18:11:50.263634+0000","last_fullsized":"2024-09-12T18:11:50.263634+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'150","last_scrub_stamp":"2024-09-12T18:11:50.263511+0000","last_deep_scrub":"263'150","last_deep_scrub_stamp":"2024-09-12T18:11:50.263511+0000","last_clean_scrub_stamp":"2024-09-12T18:11:50.263511+0000","objects_scrubbed":4,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:14:36.257295+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":605,"num_read_kb":135941,"num_write":774,"num_write_kb":15017,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"263'498","reported_seq":2146,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:01.300891+0000","last_change":"2024-09-12T18:12:01.300891+0000","last_active":"2024-09-12T18:12:01.300891+0000","last_peered":"2024-09-12T18:12:01.300891+0000","last_clean":"2024-09-12T18:12:01.300891+0000","last_became_active":"2024-09-12T17:10:44.517175+0000","last_became_peered":"2024-09-12T17:10:44.517175+0000","last_unstale":"2024-09-12T18:12:01.300891+0000","last_undegraded":"2024-09-12T18:12:01.300891+0000","last_fullsized":"2024-09-12T18:12:01.300891+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'498","last_scrub_stamp":"2024-09-12T18:12:01.300799+0000","last_deep_scrub":"263'498","last_deep_scrub_stamp":"2024-09-12T18:12:01.300799+0000","last_clean_scrub_stamp":"2024-09-12T18:12:01.300799+0000","objects_scrubbed":1,"log_size":98,"log_dups_size":400,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:10:17.438378+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2646,"num_read_kb":2487,"num_write":582,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2551,"num_omap_keys":10,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"263'171","reported_seq":793,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:53.554829+0000","last_change":"2024-09-12T18:11:53.554829+0000","last_active":"2024-09-12T18:11:53.554829+0000","last_peered":"2024-09-12T18:11:53.554829+0000","last_clean":"2024-09-12T18:11:53.554829+0000","last_became_active":"2024-09-12T17:10:42.524860+0000","last_became_peered":"2024-09-12T17:10:42.524860+0000","last_unstale":"2024-09-12T18:11:53.554829+0000","last_undegraded":"2024-09-12T18:11:53.554829+0000","last_fullsized":"2024-09-12T18:11:53.554829+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'171","last_scrub_stamp":"2024-09-12T18:11:53.554696+0000","last_deep_scrub":"263'171","last_deep_scrub_stamp":"2024-09-12T18:11:53.554696+0000","last_clean_scrub_stamp":"2024-09-12T18:11:53.554696+0000","objects_scrubbed":3,"log_size":71,"log_dups_size":100,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:32:08.383982+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":409,"num_read_kb":436,"num_write":844,"num_write_kb":16042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,1],"acting":[3,4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"263'740","reported_seq":2322,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:53.804065+0000","last_change":"2024-09-12T18:11:53.804065+0000","last_active":"2024-09-12T18:11:53.804065+0000","last_peered":"2024-09-12T18:11:53.804065+0000","last_clean":"2024-09-12T18:11:53.804065+0000","last_became_active":"2024-09-12T17:10:44.514847+0000","last_became_peered":"2024-09-12T17:10:44.514847+0000","last_unstale":"2024-09-12T18:11:53.804065+0000","last_undegraded":"2024-09-12T18:11:53.804065+0000","last_fullsized":"2024-09-12T18:11:53.804065+0000","mapping_epoch":26,"log_start":"263'700","ondisk_log_start":"263'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'740","last_scrub_stamp":"2024-09-12T18:11:53.803969+0000","last_deep_scrub":"263'740","last_deep_scrub_stamp":"2024-09-12T18:11:53.803969+0000","last_clean_scrub_stamp":"2024-09-12T18:11:53.803969+0000","objects_scrubbed":2,"log_size":40,"log_dups_size":700,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:10:16.440746+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3592,"num_read_kb":3279,"num_write":969,"num_write_kb":334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":432,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"263'232","reported_seq":897,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:51.259031+0000","last_change":"2024-09-12T18:11:51.259031+0000","last_active":"2024-09-12T18:11:51.259031+0000","last_peered":"2024-09-12T18:11:51.259031+0000","last_clean":"2024-09-12T18:11:51.259031+0000","last_became_active":"2024-09-12T17:10:42.519789+0000","last_became_peered":"2024-09-12T17:10:42.519789+0000","last_unstale":"2024-09-12T18:11:51.259031+0000","last_undegraded":"2024-09-12T18:11:51.259031+0000","last_fullsized":"2024-09-12T18:11:51.259031+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'232","last_scrub_stamp":"2024-09-12T18:11:51.258820+0000","last_deep_scrub":"263'232","last_deep_scrub_stamp":"2024-09-12T18:11:51.258820+0000","last_clean_scrub_stamp":"2024-09-12T18:11:51.258820+0000","objects_scrubbed":6,"log_size":32,"log_dups_size":200,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:06:47.531898+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079985,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":565,"num_read_kb":21140,"num_write":1106,"num_write_kb":33501,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,3],"acting":[5,7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"263'453","reported_seq":1955,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:59.367729+0000","last_change":"2024-09-12T18:11:59.367729+0000","last_active":"2024-09-12T18:11:59.367729+0000","last_peered":"2024-09-12T18:11:59.367729+0000","last_clean":"2024-09-12T18:11:59.367729+0000","last_became_active":"2024-09-12T17:10:44.510280+0000","last_became_peered":"2024-09-12T17:10:44.510280+0000","last_unstale":"2024-09-12T18:11:59.367729+0000","last_undegraded":"2024-09-12T18:11:59.367729+0000","last_fullsized":"2024-09-12T18:11:59.367729+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'453","last_scrub_stamp":"2024-09-12T18:11:59.367623+0000","last_deep_scrub":"263'453","last_deep_scrub_stamp":"2024-09-12T18:11:59.367623+0000","last_clean_scrub_stamp":"2024-09-12T18:11:59.367623+0000","objects_scrubbed":2,"log_size":53,"log_dups_size":400,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:42:33.011282+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2351,"num_read_kb":2195,"num_write":554,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"263'151","reported_seq":757,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:51.719192+0000","last_change":"2024-09-12T18:11:51.719192+0000","last_active":"2024-09-12T18:11:51.719192+0000","last_peered":"2024-09-12T18:11:51.719192+0000","last_clean":"2024-09-12T18:11:51.719192+0000","last_became_active":"2024-09-12T17:10:42.520020+0000","last_became_peered":"2024-09-12T17:10:42.520020+0000","last_unstale":"2024-09-12T18:11:51.719192+0000","last_undegraded":"2024-09-12T18:11:51.719192+0000","last_fullsized":"2024-09-12T18:11:51.719192+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'151","last_scrub_stamp":"2024-09-12T18:11:51.719074+0000","last_deep_scrub":"263'151","last_deep_scrub_stamp":"2024-09-12T18:11:51.719074+0000","last_clean_scrub_stamp":"2024-09-12T18:11:51.719074+0000","objects_scrubbed":5,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:00:04.688300+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399173,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":329,"num_read_kb":1191,"num_write":748,"num_write_kb":23442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,6],"acting":[0,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"263'360","reported_seq":1781,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:02.582515+0000","last_change":"2024-09-12T18:12:02.582515+0000","last_active":"2024-09-12T18:12:02.582515+0000","last_peered":"2024-09-12T18:12:02.582515+0000","last_clean":"2024-09-12T18:12:02.582515+0000","last_became_active":"2024-09-12T17:10:44.516697+0000","last_became_peered":"2024-09-12T17:10:44.516697+0000","last_unstale":"2024-09-12T18:12:02.582515+0000","last_undegraded":"2024-09-12T18:12:02.582515+0000","last_fullsized":"2024-09-12T18:12:02.582515+0000","mapping_epoch":26,"log_start":"263'300","ondisk_log_start":"263'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'360","last_scrub_stamp":"2024-09-12T18:12:02.582325+0000","last_deep_scrub":"263'360","last_deep_scrub_stamp":"2024-09-12T18:12:02.582325+0000","last_clean_scrub_stamp":"2024-09-12T18:12:02.582325+0000","objects_scrubbed":3,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:42:49.327952+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1919,"num_read_kb":1833,"num_write":391,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"263'209","reported_seq":878,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:50.859980+0000","last_change":"2024-09-12T18:11:50.859917+0000","last_active":"2024-09-12T18:11:50.859980+0000","last_peered":"2024-09-12T18:11:50.859980+0000","last_clean":"2024-09-12T18:11:50.859980+0000","last_became_active":"2024-09-12T17:11:16.862645+0000","last_became_peered":"2024-09-12T17:11:16.862645+0000","last_unstale":"2024-09-12T18:11:50.859980+0000","last_undegraded":"2024-09-12T18:11:50.859980+0000","last_fullsized":"2024-09-12T18:11:50.859980+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'209","last_scrub_stamp":"2024-09-12T18:11:50.859772+0000","last_deep_scrub":"263'209","last_deep_scrub_stamp":"2024-09-12T18:11:50.859772+0000","last_clean_scrub_stamp":"2024-09-12T18:11:50.859772+0000","objects_scrubbed":5,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:34:01.980997+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38716,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":577,"num_read_kb":84325,"num_write":975,"num_write_kb":27874,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,0,7],"acting":[2,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"263'820","reported_seq":2292,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:59.723232+0000","last_change":"2024-09-12T18:11:59.723232+0000","last_active":"2024-09-12T18:11:59.723232+0000","last_peered":"2024-09-12T18:11:59.723232+0000","last_clean":"2024-09-12T18:11:59.723232+0000","last_became_active":"2024-09-12T17:10:44.519253+0000","last_became_peered":"2024-09-12T17:10:44.519253+0000","last_unstale":"2024-09-12T18:11:59.723232+0000","last_undegraded":"2024-09-12T18:11:59.723232+0000","last_fullsized":"2024-09-12T18:11:59.723232+0000","mapping_epoch":26,"log_start":"263'800","ondisk_log_start":"263'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'820","last_scrub_stamp":"2024-09-12T18:11:59.723131+0000","last_deep_scrub":"263'820","last_deep_scrub_stamp":"2024-09-12T18:11:59.723131+0000","last_clean_scrub_stamp":"2024-09-12T18:11:59.723131+0000","objects_scrubbed":2,"log_size":20,"log_dups_size":800,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:31:46.831616+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3866,"num_read_kb":3440,"num_write":1124,"num_write_kb":450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"263'183","reported_seq":799,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:54.498363+0000","last_change":"2024-09-12T18:11:54.498363+0000","last_active":"2024-09-12T18:11:54.498363+0000","last_peered":"2024-09-12T18:11:54.498363+0000","last_clean":"2024-09-12T18:11:54.498363+0000","last_became_active":"2024-09-12T17:10:42.524098+0000","last_became_peered":"2024-09-12T17:10:42.524098+0000","last_unstale":"2024-09-12T18:11:54.498363+0000","last_undegraded":"2024-09-12T18:11:54.498363+0000","last_fullsized":"2024-09-12T18:11:54.498363+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'183","last_scrub_stamp":"2024-09-12T18:11:54.498278+0000","last_deep_scrub":"263'183","last_deep_scrub_stamp":"2024-09-12T18:11:54.498278+0000","last_clean_scrub_stamp":"2024-09-12T18:11:54.498278+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:41:02.476962+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":371,"num_read_kb":5543,"num_write":831,"num_write_kb":19602,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6,3],"acting":[7,2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"263'418","reported_seq":2013,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:06.626096+0000","last_change":"2024-09-12T18:12:06.626096+0000","last_active":"2024-09-12T18:12:06.626096+0000","last_peered":"2024-09-12T18:12:06.626096+0000","last_clean":"2024-09-12T18:12:06.626096+0000","last_became_active":"2024-09-12T17:10:44.514154+0000","last_became_peered":"2024-09-12T17:10:44.514154+0000","last_unstale":"2024-09-12T18:12:06.626096+0000","last_undegraded":"2024-09-12T18:12:06.626096+0000","last_fullsized":"2024-09-12T18:12:06.626096+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'418","last_scrub_stamp":"2024-09-12T18:12:06.625996+0000","last_deep_scrub":"263'418","last_deep_scrub_stamp":"2024-09-12T18:12:06.625996+0000","last_clean_scrub_stamp":"2024-09-12T18:12:06.625996+0000","objects_scrubbed":2,"log_size":18,"log_dups_size":400,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:51:07.252603+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2340,"num_read_kb":2233,"num_write":478,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":217,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"263'226","reported_seq":853,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:51.851968+0000","last_change":"2024-09-12T18:11:51.851968+0000","last_active":"2024-09-12T18:11:51.851968+0000","last_peered":"2024-09-12T18:11:51.851968+0000","last_clean":"2024-09-12T18:11:51.851968+0000","last_became_active":"2024-09-12T17:10:42.519316+0000","last_became_peered":"2024-09-12T17:10:42.519316+0000","last_unstale":"2024-09-12T18:11:51.851968+0000","last_undegraded":"2024-09-12T18:11:51.851968+0000","last_fullsized":"2024-09-12T18:11:51.851968+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'226","last_scrub_stamp":"2024-09-12T18:11:51.851860+0000","last_deep_scrub":"263'226","last_deep_scrub_stamp":"2024-09-12T18:11:51.851860+0000","last_clean_scrub_stamp":"2024-09-12T18:11:51.851860+0000","objects_scrubbed":3,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:35:21.884135+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470224,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":508,"num_read_kb":7212,"num_write":965,"num_write_kb":24573,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1,7],"acting":[2,6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"263'437","reported_seq":2045,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:01.592262+0000","last_change":"2024-09-12T18:12:01.592262+0000","last_active":"2024-09-12T18:12:01.592262+0000","last_peered":"2024-09-12T18:12:01.592262+0000","last_clean":"2024-09-12T18:12:01.592262+0000","last_became_active":"2024-09-12T17:10:44.513514+0000","last_became_peered":"2024-09-12T17:10:44.513514+0000","last_unstale":"2024-09-12T18:12:01.592262+0000","last_undegraded":"2024-09-12T18:12:01.592262+0000","last_fullsized":"2024-09-12T18:12:01.592262+0000","mapping_epoch":26,"log_start":"263'400","ondisk_log_start":"263'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'437","last_scrub_stamp":"2024-09-12T18:12:01.592155+0000","last_deep_scrub":"263'437","last_deep_scrub_stamp":"2024-09-12T18:12:01.592155+0000","last_clean_scrub_stamp":"2024-09-12T18:12:01.592155+0000","objects_scrubbed":3,"log_size":37,"log_dups_size":400,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:14:07.719792+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2337,"num_read_kb":2234,"num_write":490,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"263'146","reported_seq":770,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:00.383167+0000","last_change":"2024-09-12T18:12:00.383167+0000","last_active":"2024-09-12T18:12:00.383167+0000","last_peered":"2024-09-12T18:12:00.383167+0000","last_clean":"2024-09-12T18:12:00.383167+0000","last_became_active":"2024-09-12T17:10:42.527050+0000","last_became_peered":"2024-09-12T17:10:42.527050+0000","last_unstale":"2024-09-12T18:12:00.383167+0000","last_undegraded":"2024-09-12T18:12:00.383167+0000","last_fullsized":"2024-09-12T18:12:00.383167+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'146","last_scrub_stamp":"2024-09-12T18:12:00.383024+0000","last_deep_scrub":"263'146","last_deep_scrub_stamp":"2024-09-12T18:12:00.383024+0000","last_clean_scrub_stamp":"2024-09-12T18:12:00.383024+0000","objects_scrubbed":4,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:22:31.915728+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079896,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":321,"num_read_kb":34406,"num_write":732,"num_write_kb":29438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4,6],"acting":[5,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"263'196","reported_seq":841,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:54.283254+0000","last_change":"2024-09-12T18:11:54.283254+0000","last_active":"2024-09-12T18:11:54.283254+0000","last_peered":"2024-09-12T18:11:54.283254+0000","last_clean":"2024-09-12T18:11:54.283254+0000","last_became_active":"2024-09-12T17:10:42.523311+0000","last_became_peered":"2024-09-12T17:10:42.523311+0000","last_unstale":"2024-09-12T18:11:54.283254+0000","last_undegraded":"2024-09-12T18:11:54.283254+0000","last_fullsized":"2024-09-12T18:11:54.283254+0000","mapping_epoch":24,"log_start":"263'100","ondisk_log_start":"263'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'196","last_scrub_stamp":"2024-09-12T18:11:54.283131+0000","last_deep_scrub":"263'196","last_deep_scrub_stamp":"2024-09-12T18:11:54.283131+0000","last_clean_scrub_stamp":"2024-09-12T18:11:54.283131+0000","objects_scrubbed":2,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:27:10.864086+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":468,"num_read_kb":32297,"num_write":957,"num_write_kb":18657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,7],"acting":[5,1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"263'823","reported_seq":2274,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:02.655360+0000","last_change":"2024-09-12T18:12:02.655360+0000","last_active":"2024-09-12T18:12:02.655360+0000","last_peered":"2024-09-12T18:12:02.655360+0000","last_clean":"2024-09-12T18:12:02.655360+0000","last_became_active":"2024-09-12T17:10:44.523243+0000","last_became_peered":"2024-09-12T17:10:44.523243+0000","last_unstale":"2024-09-12T18:12:02.655360+0000","last_undegraded":"2024-09-12T18:12:02.655360+0000","last_fullsized":"2024-09-12T18:12:02.655360+0000","mapping_epoch":26,"log_start":"263'800","ondisk_log_start":"263'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'823","last_scrub_stamp":"2024-09-12T18:12:02.655272+0000","last_deep_scrub":"263'823","last_deep_scrub_stamp":"2024-09-12T18:12:02.655272+0000","last_clean_scrub_stamp":"2024-09-12T18:12:02.655272+0000","objects_scrubbed":2,"log_size":23,"log_dups_size":800,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:46:36.986649+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3977,"num_read_kb":3544,"num_write":1118,"num_write_kb":432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":220,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"263'239","reported_seq":892,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:11:52.620009+0000","last_change":"2024-09-12T18:11:52.620009+0000","last_active":"2024-09-12T18:11:52.620009+0000","last_peered":"2024-09-12T18:11:52.620009+0000","last_clean":"2024-09-12T18:11:52.620009+0000","last_became_active":"2024-09-12T17:10:42.519643+0000","last_became_peered":"2024-09-12T17:10:42.519643+0000","last_unstale":"2024-09-12T18:11:52.620009+0000","last_undegraded":"2024-09-12T18:11:52.620009+0000","last_fullsized":"2024-09-12T18:11:52.620009+0000","mapping_epoch":24,"log_start":"263'200","ondisk_log_start":"263'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'239","last_scrub_stamp":"2024-09-12T18:11:52.619898+0000","last_deep_scrub":"263'239","last_deep_scrub_stamp":"2024-09-12T18:11:52.619898+0000","last_clean_scrub_stamp":"2024-09-12T18:11:52.619898+0000","objects_scrubbed":3,"log_size":39,"log_dups_size":200,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:17:44.502362+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079919,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":418,"num_read_kb":42701,"num_write":983,"num_write_kb":42419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5,0],"acting":[1,4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"263'617","reported_seq":2316,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T18:12:04.482840+0000","last_change":"2024-09-12T18:12:04.482840+0000","last_active":"2024-09-12T18:12:04.482840+0000","last_peered":"2024-09-12T18:12:04.482840+0000","last_clean":"2024-09-12T18:12:04.482840+0000","last_became_active":"2024-09-12T17:10:44.512488+0000","last_became_peered":"2024-09-12T17:10:44.512488+0000","last_unstale":"2024-09-12T18:12:04.482840+0000","last_undegraded":"2024-09-12T18:12:04.482840+0000","last_fullsized":"2024-09-12T18:12:04.482840+0000","mapping_epoch":26,"log_start":"263'600","ondisk_log_start":"263'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'617","last_scrub_stamp":"2024-09-12T18:12:04.482707+0000","last_deep_scrub":"263'617","last_deep_scrub_stamp":"2024-09-12T18:12:04.482707+0000","last_clean_scrub_stamp":"2024-09-12T18:12:04.482707+0000","objects_scrubbed":5,"log_size":17,"log_dups_size":600,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:05:09.251938+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3240,"num_read_kb":2966,"num_write":800,"num_write_kb":244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2039,"num_omap_keys":8,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6085,"num_read_kb":4263,"num_write":1964,"num_write_kb":863,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6762,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1037,"ondisk_log_size":1037,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15869,"num_objects":86,"num_object_clones":0,"num_object_copies":172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":86,"num_whiteouts":0,"num_read":16199,"num_read_kb":15883,"num_write":16708,"num_write_kb":4876,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2797,"num_omap_keys":17,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":31738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1738,"ondisk_log_size":1738,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":575,"ondisk_log_size":575,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":271969,"num_objects":199,"num_object_clones":0,"num_object_copies":398,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":199,"num_whiteouts":0,"num_read":8822,"num_read_kb":10790,"num_write":6053,"num_write_kb":2795,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":676642,"num_omap_keys":1572,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1836,"ondisk_log_size":1836,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2393,"num_read_kb":2857,"num_write":20,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":165,"num_object_clones":0,"num_object_copies":330,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":165,"num_whiteouts":0,"num_read":212965,"num_read_kb":194286,"num_write":55441,"num_write_kb":18926,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":165,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":43286,"num_omap_keys":176,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3862,"ondisk_log_size":3862,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1128,"num_omap_keys":12,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":74416905,"num_objects":230,"num_object_clones":0,"num_object_copies":920,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":230,"num_whiteouts":0,"num_read":33088,"num_read_kb":2020320,"num_write":62843,"num_write_kb":2063190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":101629952,"data_stored":101629952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3869,"ondisk_log_size":3869,"up":256,"acting":256,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":141,"num_read_kb":196715,"num_write":158,"num_write_kb":127071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":137,"num_read_kb":189543,"num_write":158,"num_write_kb":127071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575607,"num_pgs":116,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":261372,"kb_used_data":17772,"kb_used_omap":1,"kb_used_meta":243582,"kb_avail":94110468,"statfs":{"total":96636764160,"available":96369119232,"internally_reserved":0,"allocated":18198528,"data_stored":16210424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":249428427},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575604,"num_pgs":107,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":273160,"kb_used_data":17080,"kb_used_omap":1,"kb_used_meta":256062,"kb_avail":94098680,"statfs":{"total":96636764160,"available":96357048320,"internally_reserved":0,"allocated":17489920,"data_stored":15541198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":262207942},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575609,"num_pgs":113,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":124372,"kb_used_data":12676,"kb_used_omap":1,"kb_used_meta":111678,"kb_avail":94247468,"statfs":{"total":96636764160,"available":96509407232,"internally_reserved":0,"allocated":12980224,"data_stored":10947706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":114358725},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575604,"num_pgs":113,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":133164,"kb_used_data":21468,"kb_used_omap":1,"kb_used_meta":111678,"kb_avail":94238676,"statfs":{"total":96636764160,"available":96500404224,"internally_reserved":0,"allocated":21983232,"data_stored":20058842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":114358725},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575606,"num_pgs":130,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":244300,"kb_used_data":18748,"kb_used_omap":1,"kb_used_meta":225534,"kb_avail":94127540,"statfs":{"total":96636764160,"available":96386600960,"internally_reserved":0,"allocated":19197952,"data_stored":17229442,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":230947271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575606,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":107112,"kb_used_data":13464,"kb_used_omap":1,"kb_used_meta":93630,"kb_avail":94264728,"statfs":{"total":96636764160,"available":96527081472,"internally_reserved":0,"allocated":13787136,"data_stored":11862866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":95877573},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575604,"num_pgs":120,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":151364,"kb_used_data":16116,"kb_used_omap":1,"kb_used_meta":135230,"kb_avail":94220476,"statfs":{"total":96636764160,"available":96481767424,"internally_reserved":0,"allocated":16502784,"data_stored":14528294,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":138475973},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575605,"num_pgs":116,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":254156,"kb_used_data":16124,"kb_used_omap":1,"kb_used_meta":238014,"kb_avail":94117684,"statfs":{"total":96636764160,"available":96376508416,"internally_reserved":0,"allocated":16510976,"data_stored":14534914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":243726789},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":11681792,"data_stored":11681792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12263424,"data_stored":12263424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":9601024,"data_stored":9601024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":14966784,"data_stored":14966784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":17797120,"data_stored":17797120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8683520,"data_stored":8683520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":13279232,"data_stored":13279232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":13357056,"data_stored":13357056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":4345,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":5119,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":3919,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":4996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3623,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":3527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T18:13:09.921 DEBUG:teuthology.orchestra.run.smithi037:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-12T18:13:10.269 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-12T18:13:10.269 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-12T18:13:10.270 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-12T18:13:10.270 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T18:13:10.312 INFO:tasks.ceph.osd.0:Stopped 2024-09-12T18:13:10.313 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-12T18:13:10.313 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T18:13:10.358 INFO:tasks.ceph.osd.1:Stopped 2024-09-12T18:13:10.358 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-12T18:13:10.358 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T18:13:10.400 INFO:tasks.ceph.osd.2:Stopped 2024-09-12T18:13:10.400 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-12T18:13:10.400 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T18:13:10.450 INFO:tasks.ceph.osd.3:Stopped 2024-09-12T18:13:10.450 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-12T18:13:10.450 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T18:13:10.491 INFO:tasks.ceph.osd.4:Stopped 2024-09-12T18:13:10.492 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-12T18:13:10.492 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T18:13:10.575 INFO:tasks.ceph.osd.5:Stopped 2024-09-12T18:13:10.576 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-12T18:13:10.576 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T18:13:10.628 INFO:tasks.ceph.osd.6:Stopped 2024-09-12T18:13:10.628 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-12T18:13:10.628 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T18:13:10.680 INFO:tasks.ceph.osd.7:Stopped 2024-09-12T18:13:10.680 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-12T18:13:10.680 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-12T18:13:10.681 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T18:13:10.706 INFO:tasks.ceph.mgr.y:Stopped 2024-09-12T18:13:10.707 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-12T18:13:10.707 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T18:13:10.736 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~0s 2024-09-12T18:13:10.737 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~0s 2024-09-12T18:13:10.737 INFO:tasks.ceph.mgr.x:Stopped 2024-09-12T18:13:10.737 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-12T18:13:10.737 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-12T18:13:10.737 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T18:13:10.763 INFO:tasks.ceph.mon.a:Stopped 2024-09-12T18:13:10.764 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-12T18:13:10.764 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T18:13:10.817 INFO:tasks.ceph.mon.c:Stopped 2024-09-12T18:13:10.817 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-12T18:13:10.818 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T18:13:10.831 INFO:tasks.ceph.mon.b:Stopped 2024-09-12T18:13:10.831 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-12T18:13:10.831 DEBUG:teuthology.orchestra.run.smithi037:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'not have an application enabled' | egrep -v '\(OSD_SLOW_PING_TIME' | head -n 1 2024-09-12T18:13:10.901 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi037.front.sepia.ceph.com 2024-09-12T18:13:10.902 DEBUG:teuthology.orchestra.run.smithi037:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-12T18:13:11.145 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi037.front.sepia.ceph.com 2024-09-12T18:13:11.451 DEBUG:teuthology.orchestra.run.smithi037:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-12T18:13:11.550 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi037.front.sepia.ceph.com 2024-09-12T18:13:11.550 DEBUG:teuthology.orchestra.run.smithi037:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-12T18:13:11.644 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi037.front.sepia.ceph.com 2024-09-12T18:13:11.645 DEBUG:teuthology.orchestra.run.smithi037:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-12T18:13:11.727 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi040.front.sepia.ceph.com 2024-09-12T18:13:11.727 DEBUG:teuthology.orchestra.run.smithi040:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-12T18:13:11.913 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi040.front.sepia.ceph.com 2024-09-12T18:13:11.914 DEBUG:teuthology.orchestra.run.smithi040:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-12T18:13:12.007 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi040.front.sepia.ceph.com 2024-09-12T18:13:12.007 DEBUG:teuthology.orchestra.run.smithi040:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-12T18:13:12.224 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi040.front.sepia.ceph.com 2024-09-12T18:13:12.224 DEBUG:teuthology.orchestra.run.smithi040:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-12T18:13:12.322 INFO:tasks.ceph:Archiving mon data... 2024-09-12T18:13:12.324 DEBUG:teuthology.misc:Transferring archived files from smithi037:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902711/data/mon.a.tgz 2024-09-12T18:13:12.324 DEBUG:teuthology.orchestra.run.smithi037:> mktemp 2024-09-12T18:13:12.358 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/tmp.P41T1fx0R1 2024-09-12T18:13:12.359 DEBUG:teuthology.orchestra.run.smithi037:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.P41T1fx0R1 2024-09-12T18:13:12.565 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 0666 /tmp/tmp.P41T1fx0R1 2024-09-12T18:13:12.678 DEBUG:teuthology.orchestra.remote:smithi037:/tmp/tmp.P41T1fx0R1 is 483KB 2024-09-12T18:13:12.763 DEBUG:teuthology.orchestra.run.smithi037:> rm -fr /tmp/tmp.P41T1fx0R1 2024-09-12T18:13:12.792 DEBUG:teuthology.misc:Transferring archived files from smithi037:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902711/data/mon.c.tgz 2024-09-12T18:13:12.792 DEBUG:teuthology.orchestra.run.smithi037:> mktemp 2024-09-12T18:13:12.861 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/tmp.EW8l59tNRi 2024-09-12T18:13:12.861 DEBUG:teuthology.orchestra.run.smithi037:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.EW8l59tNRi 2024-09-12T18:13:13.055 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 0666 /tmp/tmp.EW8l59tNRi 2024-09-12T18:13:13.168 DEBUG:teuthology.orchestra.remote:smithi037:/tmp/tmp.EW8l59tNRi is 495KB 2024-09-12T18:13:13.266 DEBUG:teuthology.orchestra.run.smithi037:> rm -fr /tmp/tmp.EW8l59tNRi 2024-09-12T18:13:13.295 DEBUG:teuthology.misc:Transferring archived files from smithi040:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902711/data/mon.b.tgz 2024-09-12T18:13:13.296 DEBUG:teuthology.orchestra.run.smithi040:> mktemp 2024-09-12T18:13:13.332 INFO:teuthology.orchestra.run.smithi040.stdout:/tmp/tmp.f5Bzqz1Kd1 2024-09-12T18:13:13.333 DEBUG:teuthology.orchestra.run.smithi040:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.f5Bzqz1Kd1 2024-09-12T18:13:13.549 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod 0666 /tmp/tmp.f5Bzqz1Kd1 2024-09-12T18:13:13.662 DEBUG:teuthology.orchestra.remote:smithi040:/tmp/tmp.f5Bzqz1Kd1 is 495KB 2024-09-12T18:13:13.758 DEBUG:teuthology.orchestra.run.smithi040:> rm -fr /tmp/tmp.f5Bzqz1Kd1 2024-09-12T18:13:13.787 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-12T18:13:13.788 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-12T18:13:13.790 DEBUG:teuthology.orchestra.run.smithi040:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-12T18:13:13.982 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-12T18:13:14.012 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-12T18:13:14.012 INFO:tasks.ceph:Archiving crash dumps... 2024-09-12T18:13:14.014 DEBUG:teuthology.misc:Transferring archived files from smithi037:/var/lib/ceph/crash to /home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902711/remote/smithi037/crash 2024-09-12T18:13:14.015 DEBUG:teuthology.orchestra.run.smithi037:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-12T18:13:14.056 DEBUG:teuthology.misc:Transferring archived files from smithi040:/var/lib/ceph/crash to /home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902711/remote/smithi040/crash 2024-09-12T18:13:14.057 DEBUG:teuthology.orchestra.run.smithi040:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-12T18:13:14.096 INFO:tasks.ceph:Compressing logs... 2024-09-12T18:13:14.096 DEBUG:teuthology.orchestra.run.smithi037:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T18:13:14.100 DEBUG:teuthology.orchestra.run.smithi040:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T18:13:14.138 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-12T18:13:14.138 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157929.log 2024-09-12T18:13:14.138 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43257.log 2024-09-12T18:13:14.138 INFO:teuthology.orchestra.run.smithi037.stderr:gzip/var/log/ceph/ceph-client.admin.157929.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.188392.log 2024-09-12T18:13:14.192 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32948.log 2024-09-12T18:13:14.193 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32728.log 2024-09-12T18:13:14.193 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-09-12T18:13:14.193 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.32948.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32948.log.gz 2024-09-12T18:13:14.193 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.32728.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32632.log 2024-09-12T18:13:14.193 INFO:teuthology.orchestra.run.smithi040.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32728.log.gz 2024-09-12T18:13:14.193 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32816.log 2024-09-12T18:13:14.193 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-osd.7.log: /var/log/ceph/ceph-client.admin.32632.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-09-12T18:13:14.193 INFO:teuthology.orchestra.run.smithi040.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32632.log.gz 2024-09-12T18:13:14.193 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.32816.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-12T18:13:14.194 INFO:teuthology.orchestra.run.smithi040.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32816.log.gz 2024-09-12T18:13:14.194 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32684.log 2024-09-12T18:13:14.194 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32904.log 2024-09-12T18:13:14.194 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.32684.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32684.log.gz 2024-09-12T18:13:14.194 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32772.log 2024-09-12T18:13:14.194 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.32904.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-09-12T18:13:14.194 INFO:teuthology.orchestra.run.smithi040.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32904.log.gz 2024-09-12T18:13:14.194 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.32772.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32772.log.gz 2024-09-12T18:13:14.194 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32860.log 2024-09-12T18:13:14.194 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-09-12T18:13:14.194 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-osd.6.log: 90.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-12T18:13:14.195 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.32860.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-12T18:13:14.195 INFO:teuthology.orchestra.run.smithi040.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32860.log.gz 2024-09-12T18:13:14.195 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-12T18:13:14.195 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-osd.5.log: /var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-09-12T18:13:14.195 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-mgr.x.log: /var/log/ceph/ceph-mon.b.log: 88.3% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-12T18:13:14.346 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.0.43257.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141435.log 2024-09-12T18:13:14.346 INFO:teuthology.orchestra.run.smithi037.stderr: 88.8% 43.5% -- replaced with /var/log/ceph/ceph-client.admin.157929.log.gz -- replaced with /var/log/ceph/ceph-client.0.43257.log.gz 2024-09-12T18:13:14.346 INFO:teuthology.orchestra.run.smithi037.stderr: 2024-09-12T18:13:14.346 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38483.log 2024-09-12T18:13:14.346 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.188392.log: /var/log/ceph/ceph-client.admin.141435.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168906.log 2024-09-12T18:13:14.346 INFO:teuthology.orchestra.run.smithi037.stderr: 83.9% -- replaced with /var/log/ceph/ceph-client.admin.188392.log.gz 2024-09-12T18:13:14.346 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.38483.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38917.log 2024-09-12T18:13:14.346 INFO:teuthology.orchestra.run.smithi037.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.141435.log.gz 2024-09-12T18:13:14.347 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38483.log.gz 2024-09-12T18:13:14.347 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.168906.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49490.log 2024-09-12T18:13:14.347 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.38917.log: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.168906.log.gz 2024-09-12T18:13:14.347 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38419.log 2024-09-12T18:13:14.347 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38917.log.gz 2024-09-12T18:13:14.347 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.49490.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97846.log 2024-09-12T18:13:14.347 INFO:teuthology.orchestra.run.smithi037.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.49490.log.gz 2024-09-12T18:13:14.347 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.38419.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111984.log 2024-09-12T18:13:14.347 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38419.log.gz 2024-09-12T18:13:14.347 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.97846.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191286.log 2024-09-12T18:13:14.347 INFO:teuthology.orchestra.run.smithi037.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.97846.log.gz 2024-09-12T18:13:14.347 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.111984.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39284.log 2024-09-12T18:13:14.347 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.191286.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.111984.log.gz 2024-09-12T18:13:14.347 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190596.log 2024-09-12T18:13:14.348 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191286.log.gz 2024-09-12T18:13:14.348 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.39284.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.42654.log 2024-09-12T18:13:14.348 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39284.log.gz 2024-09-12T18:13:14.348 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.190596.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50668.log 2024-09-12T18:13:14.348 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190596.log.gz 2024-09-12T18:13:14.348 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.0.42654.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87833.log 2024-09-12T18:13:14.348 INFO:teuthology.orchestra.run.smithi037.stderr: 43.5% -- replaced with /var/log/ceph/ceph-client.0.42654.log.gz 2024-09-12T18:13:14.348 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.50668.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149093.log 2024-09-12T18:13:14.348 INFO:teuthology.orchestra.run.smithi037.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.50668.log.gz 2024-09-12T18:13:14.349 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.87833.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191560.log 2024-09-12T18:13:14.349 INFO:teuthology.orchestra.run.smithi037.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.87833.log.gz 2024-09-12T18:13:14.349 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.149093.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40165.log 2024-09-12T18:13:14.349 INFO:teuthology.orchestra.run.smithi037.stderr: 85.2%/var/log/ceph/ceph-client.admin.191560.log: -- replaced with /var/log/ceph/ceph-client.admin.149093.log.gz 2024-09-12T18:13:14.349 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191240.log 2024-09-12T18:13:14.349 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191560.log.gz 2024-09-12T18:13:14.349 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.40165.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61426.log 2024-09-12T18:13:14.349 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40165.log.gz 2024-09-12T18:13:14.349 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.191240.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.189087.log 2024-09-12T18:13:14.349 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191240.log.gz 2024-09-12T18:13:14.349 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.61426.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136723.log 2024-09-12T18:13:14.349 INFO:teuthology.orchestra.run.smithi037.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.61426.log.gz 2024-09-12T18:13:14.349 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.0.189087.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80765.log 2024-09-12T18:13:14.349 INFO:teuthology.orchestra.run.smithi037.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.0.189087.log.gz 2024-09-12T18:13:14.350 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.136723.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57784.log 2024-09-12T18:13:14.350 INFO:teuthology.orchestra.run.smithi037.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.136723.log.gz 2024-09-12T18:13:14.350 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.80765.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75388.log 2024-09-12T18:13:14.350 INFO:teuthology.orchestra.run.smithi037.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.80765.log.gz 2024-09-12T18:13:14.350 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.57784.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38703.log 2024-09-12T18:13:14.350 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57784.log.gz 2024-09-12T18:13:14.350 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.75388.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39653.log 2024-09-12T18:13:14.350 INFO:teuthology.orchestra.run.smithi037.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.75388.log.gz 2024-09-12T18:13:14.350 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.38703.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39282.log 2024-09-12T18:13:14.350 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38703.log.gz 2024-09-12T18:13:14.350 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.39653.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187683.log 2024-09-12T18:13:14.350 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39653.log.gz 2024-09-12T18:13:14.350 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.39282.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129655.log 2024-09-12T18:13:14.351 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39282.log.gz 2024-09-12T18:13:14.351 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.187683.log: /var/log/ceph/ceph-client.0.184038.log 2024-09-12T18:13:14.351 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.129655.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163889.log 2024-09-12T18:13:14.351 INFO:teuthology.orchestra.run.smithi037.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.187683.log.gz 2024-09-12T18:13:14.351 INFO:teuthology.orchestra.run.smithi037.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.129655.log.gz 2024-09-12T18:13:14.351 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.0.184038.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191332.log 2024-09-12T18:13:14.351 INFO:teuthology.orchestra.run.smithi037.stderr: 83.9% -- replaced with /var/log/ceph/ceph-client.0.184038.log.gz 2024-09-12T18:13:14.351 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.163889.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89011.log 2024-09-12T18:13:14.351 INFO:teuthology.orchestra.run.smithi037.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.163889.log.gz 2024-09-12T18:13:14.351 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48264.log 2024-09-12T18:13:14.351 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.191332.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191332.log.gz 2024-09-12T18:13:14.351 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.89011.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40121.log 2024-09-12T18:13:14.351 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.48264.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.89011.log.gz 2024-09-12T18:13:14.351 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51846.log 2024-09-12T18:13:14.351 INFO:teuthology.orchestra.run.smithi037.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.48264.log.gz 2024-09-12T18:13:14.352 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.40121.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131422.log 2024-09-12T18:13:14.352 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40121.log.gz 2024-09-12T18:13:14.352 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.51846.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70657.log 2024-09-12T18:13:14.352 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51846.log.gz 2024-09-12T18:13:14.352 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.131422.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-12T18:13:14.352 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.70657.log: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.131422.log.gz 2024-09-12T18:13:14.352 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191378.log 2024-09-12T18:13:14.352 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.0.log 2024-09-12T18:13:14.352 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.191378.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107271.log 2024-09-12T18:13:14.352 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191378.log.gz 2024-09-12T18:13:14.352 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ops-log-ceph-client.0.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.70657.log.gz 2024-09-12T18:13:14.352 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119053.log 2024-09-12T18:13:14.352 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.107271.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120820.log 2024-09-12T18:13:14.353 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.119053.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190458.log 2024-09-12T18:13:14.353 INFO:teuthology.orchestra.run.smithi037.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.119053.log.gz 2024-09-12T18:13:14.353 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.120820.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39650.log 2024-09-12T18:13:14.353 INFO:teuthology.orchestra.run.smithi037.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.120820.log.gz 2024-09-12T18:13:14.353 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.190458.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190872.log 2024-09-12T18:13:14.353 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190458.log.gz 2024-09-12T18:13:14.353 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.39650.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.107271.log.gz 2024-09-12T18:13:14.353 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121998.log 2024-09-12T18:13:14.353 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39650.log.gz 2024-09-12T18:13:14.353 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.190872.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116697.log 2024-09-12T18:13:14.353 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190872.log.gz 2024-09-12T18:13:14.353 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.121998.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99024.log 2024-09-12T18:13:14.353 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.116697.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144969.log 2024-09-12T18:13:14.353 INFO:teuthology.orchestra.run.smithi037.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.116697.log.gz 2024-09-12T18:13:14.354 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.99024.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110217.log 2024-09-12T18:13:14.354 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.144969.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103148.log 2024-09-12T18:13:14.354 INFO:teuthology.orchestra.run.smithi037.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.144969.log.gz 2024-09-12T18:13:14.354 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.110217.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.121998.log.gz 2024-09-12T18:13:14.354 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66320.log 2024-09-12T18:13:14.354 INFO:teuthology.orchestra.run.smithi037.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.110217.log.gz 2024-09-12T18:13:14.354 INFO:teuthology.orchestra.run.smithi037.stderr:gzip/var/log/ceph/ceph-client.admin.103148.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.132600.log 2024-09-12T18:13:14.354 INFO:teuthology.orchestra.run.smithi037.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.99024.log.gz 2024-09-12T18:13:14.354 INFO:teuthology.orchestra.run.smithi037.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.103148.log.gz 2024-09-12T18:13:14.354 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.66320.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.177948.log 2024-09-12T18:13:14.354 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.132600.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.76148.log 2024-09-12T18:13:14.354 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.0.177948.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113162.log 2024-09-12T18:13:14.354 INFO:teuthology.orchestra.run.smithi037.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.132600.log.gz 2024-09-12T18:13:14.355 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.0.76148.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176091.log 2024-09-12T18:13:14.355 INFO:teuthology.orchestra.run.smithi037.stderr: 84.0% -- replaced with /var/log/ceph/ceph-client.0.177948.log.gz 2024-09-12T18:13:14.355 INFO:teuthology.orchestra.run.smithi037.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.0.76148.log.gz 2024-09-12T18:13:14.355 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115519.log 2024-09-12T18:13:14.355 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.113162.log: /var/log/ceph/ceph-client.admin.176091.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158518.log 2024-09-12T18:13:14.355 INFO:teuthology.orchestra.run.smithi037.stderr: 81.8%/var/log/ceph/ceph-client.admin.115519.log: gzip -5 92.3% -- replaced with /var/log/ceph/ceph-client.admin.176091.log.gz 2024-09-12T18:13:14.355 INFO:teuthology.orchestra.run.smithi037.stderr: --verbose -- /var/log/ceph/ceph-client.admin.162663.log 2024-09-12T18:13:14.355 INFO:teuthology.orchestra.run.smithi037.stderr: -- replaced with /var/log/ceph/ceph-client.admin.113162.log.gz/var/log/ceph/ceph-client.admin.158518.log: 2024-09-12T18:13:14.355 INFO:teuthology.orchestra.run.smithi037.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.115519.log.gz 2024-09-12T18:13:14.355 INFO:teuthology.orchestra.run.smithi037.stderr:gzip 81.8% -- replaced with /var/log/ceph/ceph-client.admin.158518.log.gz 2024-09-12T18:13:14.355 INFO:teuthology.orchestra.run.smithi037.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.75979.log 2024-09-12T18:13:14.355 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.162663.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53661.log 2024-09-12T18:13:14.355 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.75979.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.162663.log.gz 2024-09-12T18:13:14.355 INFO:teuthology.orchestra.run.smithi037.stderr: 24.4% -- replaced with /var/log/ceph/ceph-client.admin.75979.log.gz 2024-09-12T18:13:14.356 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.180384.log 2024-09-12T18:13:14.356 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.53661.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63161.log 2024-09-12T18:13:14.356 INFO:teuthology.orchestra.run.smithi037.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.53661.log.gz 2024-09-12T18:13:14.356 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.0.180384.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171869.log 2024-09-12T18:13:14.356 INFO:teuthology.orchestra.run.smithi037.stderr: 93.0% -- replaced with /var/log/ceph/ceph-client.admin.66320.log.gz 2024-09-12T18:13:14.356 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.63161.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172625.log 2024-09-12T18:13:14.356 INFO:teuthology.orchestra.run.smithi037.stderr: 84.0% -- replaced with /var/log/ceph/ceph-client.0.180384.log.gz 2024-09-12T18:13:14.356 INFO:teuthology.orchestra.run.smithi037.stderr: 91.9% -- replaced with /var/log/ceph/ceph-client.admin.63161.log.gz 2024-09-12T18:13:14.356 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146147.log 2024-09-12T18:13:14.356 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.171869.log: /var/log/ceph/ceph-client.admin.172625.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109628.log 2024-09-12T18:13:14.356 INFO:teuthology.orchestra.run.smithi037.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.171869.log.gz 2024-09-12T18:13:14.356 INFO:teuthology.orchestra.run.smithi037.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.172625.log.gz 2024-09-12T18:13:14.356 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.146147.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110806.log 2024-09-12T18:13:14.356 INFO:teuthology.orchestra.run.smithi037.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.146147.log.gz 2024-09-12T18:13:14.357 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144380.log 2024-09-12T18:13:14.357 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.109628.log: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.109628.log.gzgzip -5/var/log/ceph/ceph-client.admin.110806.log: --verbose -- /var/log/ceph/ceph-client.0.42051.log 2024-09-12T18:13:14.357 INFO:teuthology.orchestra.run.smithi037.stderr: 2024-09-12T18:13:14.357 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.144380.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107860.log 2024-09-12T18:13:14.357 INFO:teuthology.orchestra.run.smithi037.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.110806.log.gz 2024-09-12T18:13:14.357 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.0.42051.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.177339.log 2024-09-12T18:13:14.357 INFO:teuthology.orchestra.run.smithi037.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.144380.log.gz 2024-09-12T18:13:14.357 INFO:teuthology.orchestra.run.smithi037.stderr: 43.2% -- replaced with /var/log/ceph/ceph-client.0.42051.log.gz 2024-09-12T18:13:14.357 INFO:teuthology.orchestra.run.smithi037.stderr:gzip/var/log/ceph/ceph-client.admin.107860.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.85477.log 2024-09-12T18:13:14.357 INFO:teuthology.orchestra.run.smithi037.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.107860.log.gz 2024-09-12T18:13:14.357 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.0.177339.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38911.log 2024-09-12T18:13:14.357 INFO:teuthology.orchestra.run.smithi037.stderr: 80.0% -- replaced with /var/log/ceph/ceph-client.0.177339.log.gz 2024-09-12T18:13:14.357 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.85477.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150860.log 2024-09-12T18:13:14.357 INFO:teuthology.orchestra.run.smithi037.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.85477.log.gz 2024-09-12T18:13:14.358 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.38911.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60837.log 2024-09-12T18:13:14.358 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38911.log.gz 2024-09-12T18:13:14.358 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.150860.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58433.log 2024-09-12T18:13:14.358 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.60837.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39276.log 2024-09-12T18:13:14.358 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.58433.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160896.log 2024-09-12T18:13:14.358 INFO:teuthology.orchestra.run.smithi037.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.60837.log.gz 2024-09-12T18:13:14.358 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.39276.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161485.log 2024-09-12T18:13:14.358 INFO:teuthology.orchestra.run.smithi037.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.58433.log.gz 2024-09-12T18:13:14.358 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39276.log.gz 2024-09-12T18:13:14.358 INFO:teuthology.orchestra.run.smithi037.stderr:gzip 86.0% -- replaced with /var/log/ceph/ceph-client.admin.150860.log.gz -5 2024-09-12T18:13:14.358 INFO:teuthology.orchestra.run.smithi037.stderr: --verbose -- /var/log/ceph/ceph-client.0.78132.log 2024-09-12T18:13:14.358 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.160896.log: /var/log/ceph/ceph-client.admin.161485.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39989.log 2024-09-12T18:13:14.358 INFO:teuthology.orchestra.run.smithi037.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.160896.log.gz 80.5% 2024-09-12T18:13:14.358 INFO:teuthology.orchestra.run.smithi037.stderr: -- replaced with /var/log/ceph/ceph-client.admin.161485.log.gz 2024-09-12T18:13:14.359 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.0.78132.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165115.log 2024-09-12T18:13:14.359 INFO:teuthology.orchestra.run.smithi037.stderr: 80.1% -- replaced with /var/log/ceph/ceph-client.0.78132.log.gz 2024-09-12T18:13:14.359 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63099.log 2024-09-12T18:13:14.359 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.39989.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39989.log.gz 2024-09-12T18:13:14.359 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.165115.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82532.log 2024-09-12T18:13:14.359 INFO:teuthology.orchestra.run.smithi037.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.165115.log.gz 2024-09-12T18:13:14.359 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.63099.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38915.log 2024-09-12T18:13:14.359 INFO:teuthology.orchestra.run.smithi037.stderr: 57.0% -- replaced with /var/log/ceph/ceph-client.admin.63099.log.gz 2024-09-12T18:13:14.359 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117875.log 2024-09-12T18:13:14.359 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.82532.log: /var/log/ceph/ceph-client.admin.38915.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.82532.log.gz 2024-09-12T18:13:14.359 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38915.log.gz 2024-09-12T18:13:14.359 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91367.log 2024-09-12T18:13:14.359 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.26699.log 2024-09-12T18:13:14.359 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.117875.log: /var/log/ceph/ceph-client.admin.91367.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.117875.log.gz 2024-09-12T18:13:14.359 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102559.log 2024-09-12T18:13:14.360 INFO:teuthology.orchestra.run.smithi037.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.91367.log.gz 2024-09-12T18:13:14.360 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph.tmp-client.admin.26699.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71276.log 2024-09-12T18:13:14.360 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.26699.log.gz 2024-09-12T18:13:14.360 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38657.log 2024-09-12T18:13:14.360 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.102559.log: /var/log/ceph/ceph-client.admin.71276.log: 82.5% -- replaced with /var/log/ceph/ceph-client.admin.102559.log.gz 2024-09-12T18:13:14.360 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39278.log 2024-09-12T18:13:14.360 INFO:teuthology.orchestra.run.smithi037.stderr:gzip/var/log/ceph/ceph-client.admin.38657.log: -5 --verbose 0.0% -- -- replaced with /var/log/ceph/ceph-client.admin.38657.log.gz /var/log/ceph/ceph-client.admin.126710.log 2024-09-12T18:13:14.360 INFO:teuthology.orchestra.run.smithi037.stderr: 2024-09-12T18:13:14.360 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.39278.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39278.log.gz 2024-09-12T18:13:14.360 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63696.log 2024-09-12T18:13:14.360 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.126710.log: gzip -5 --verbose -- 81.8% -- replaced with /var/log/ceph/ceph-client.admin.126710.log.gz 2024-09-12T18:13:14.360 INFO:teuthology.orchestra.run.smithi037.stderr: /var/log/ceph/ceph-client.admin.165091.log 2024-09-12T18:13:14.360 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.63696.log: 21.6% -- replaced with /var/log/ceph/ceph-client.admin.63696.log.gz 2024-09-12T18:13:14.361 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65701.log 2024-09-12T18:13:14.361 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.165091.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.165091.log.gz 2024-09-12T18:13:14.361 INFO:teuthology.orchestra.run.smithi037.stderr: --verbose -- /var/log/ceph/ceph-client.0.179775.log 2024-09-12T18:13:14.361 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.65701.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51257.log 2024-09-12T18:13:14.361 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.0.179775.log: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.71276.log.gz 2024-09-12T18:13:14.361 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188295.log 2024-09-12T18:13:14.361 INFO:teuthology.orchestra.run.smithi037.stderr: 79.2% -- replaced with /var/log/ceph/ceph-client.0.179775.log.gz 2024-09-12T18:13:14.361 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.51257.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66940.log 2024-09-12T18:13:14.361 INFO:teuthology.orchestra.run.smithi037.stderr: 84.8% -- replaced with /var/log/ceph/ceph-client.admin.51257.log.gz 2024-09-12T18:13:14.361 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.188295.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.188295.log.gz 2024-09-12T18:13:14.361 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.182820.log 2024-09-12T18:13:14.361 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108449.log 2024-09-12T18:13:14.361 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.66940.log: /var/log/ceph/ceph-client.0.182820.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56017.log 2024-09-12T18:13:14.361 INFO:teuthology.orchestra.run.smithi037.stderr: 84.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62324.log 2024-09-12T18:13:14.362 INFO:teuthology.orchestra.run.smithi037.stderr: -- replaced with /var/log/ceph/ceph-client.0.182820.log.gz 2024-09-12T18:13:14.362 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.108449.log: /var/log/ceph/ceph-client.admin.56017.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64463.log 2024-09-12T18:13:14.362 INFO:teuthology.orchestra.run.smithi037.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.108449.log.gz 2024-09-12T18:13:14.362 INFO:teuthology.orchestra.run.smithi037.stderr: 85.1%/var/log/ceph/ceph-client.admin.62324.log: -- replaced with /var/log/ceph/ceph-client.admin.56017.log.gz 2024-09-12T18:13:14.362 INFO:teuthology.orchestra.run.smithi037.stderr: 59.6%gzip -- replaced with /var/log/ceph/ceph-client.admin.62324.log.gz -5 2024-09-12T18:13:14.362 INFO:teuthology.orchestra.run.smithi037.stderr: --verbose -- /var/log/ceph/ceph-client.admin.39279.log 2024-09-12T18:13:14.362 INFO:teuthology.orchestra.run.smithi037.stderr:gzip/var/log/ceph/ceph-client.admin.64463.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.163276.log 2024-09-12T18:13:14.362 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.39279.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39279.log.gzgzip 2024-09-12T18:13:14.362 INFO:teuthology.orchestra.run.smithi037.stderr: -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-12T18:13:14.362 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68799.log 2024-09-12T18:13:14.362 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph.audit.log: /var/log/ceph/ceph-client.admin.163276.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.163276.log.gz 2024-09-12T18:13:14.362 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143202.log 2024-09-12T18:13:14.362 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.68799.log: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.65701.log.gz 2024-09-12T18:13:14.362 INFO:teuthology.orchestra.run.smithi037.stderr: 92.9% -- replaced with /var/log/ceph/ceph-client.admin.66940.log.gz 2024-09-12T18:13:14.363 INFO:teuthology.orchestra.run.smithi037.stderr: 94.6% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-12T18:13:14.363 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48853.log 2024-09-12T18:13:14.363 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.143202.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46171.log 2024-09-12T18:13:14.363 INFO:teuthology.orchestra.run.smithi037.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.143202.log.gz 2024-09-12T18:13:14.363 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.48853.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65082.log 2024-09-12T18:13:14.363 INFO:teuthology.orchestra.run.smithi037.stderr: 84.0% -- replaced with /var/log/ceph/ceph-client.admin.48853.log.gz 2024-09-12T18:13:14.363 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.46171.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187613.log 2024-09-12T18:13:14.363 INFO:teuthology.orchestra.run.smithi037.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.46171.log.gz 2024-09-12T18:13:14.363 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38912.log 2024-09-12T18:13:14.363 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.65082.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38565.log 2024-09-12T18:13:14.363 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.38912.log: /var/log/ceph/ceph-client.admin.187613.log: 0.0% 86.0% -- replaced with /var/log/ceph/ceph-client.admin.65082.log.gz 2024-09-12T18:13:14.363 INFO:teuthology.orchestra.run.smithi037.stderr: -- replaced with /var/log/ceph/ceph-client.admin.38912.log.gz 2024-09-12T18:13:14.363 INFO:teuthology.orchestra.run.smithi037.stderr: 25.2% -- replaced with /var/log/ceph/ceph-client.admin.187613.log.gz 2024-09-12T18:13:14.363 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154394.log 2024-09-12T18:13:14.364 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.38565.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38565.log.gz 2024-09-12T18:13:14.364 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49466.log 2024-09-12T18:13:14.364 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.154394.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137312.log 2024-09-12T18:13:14.364 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.49466.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.49466.log.gz -5 --verbose -- /var/log/ceph/ceph-client.admin.73026.log 2024-09-12T18:13:14.364 INFO:teuthology.orchestra.run.smithi037.stderr: 2024-09-12T18:13:14.364 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39899.log 2024-09-12T18:13:14.364 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.137312.log: /var/log/ceph/ceph-client.admin.73026.log: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.154394.log.gz 81.1% -- replaced with /var/log/ceph/ceph-client.admin.73026.log.gz 2024-09-12T18:13:14.364 INFO:teuthology.orchestra.run.smithi037.stderr: 2024-09-12T18:13:14.364 INFO:teuthology.orchestra.run.smithi037.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.137312.log.gz 2024-09-12T18:13:14.364 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191056.log 2024-09-12T18:13:14.364 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.39899.log: gzip -5 --verbose -- 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39899.log.gz 2024-09-12T18:13:14.364 INFO:teuthology.orchestra.run.smithi037.stderr: /var/log/ceph/ceph-client.admin.84299.log 2024-09-12T18:13:14.364 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.191056.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191056.log.gz 2024-09-12T18:13:14.364 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56606.log 2024-09-12T18:13:14.365 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.84299.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62973.log 2024-09-12T18:13:14.365 INFO:teuthology.orchestra.run.smithi037.stderr: 89.9%/var/log/ceph/ceph-client.admin.56606.log: -- replaced with /var/log/ceph/ceph-client.admin.84299.log.gz 2024-09-12T18:13:14.365 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59022.log 2024-09-12T18:13:14.365 INFO:teuthology.orchestra.run.smithi037.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.56606.log.gz 2024-09-12T18:13:14.365 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190780.log 2024-09-12T18:13:14.365 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.62973.log: /var/log/ceph/ceph-client.admin.59022.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57195.log 2024-09-12T18:13:14.365 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62973.log.gz 2024-09-12T18:13:14.365 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.190780.log: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.59022.log.gz 2024-09-12T18:13:14.365 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190780.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152038.log 2024-09-12T18:13:14.365 INFO:teuthology.orchestra.run.smithi037.stderr: 2024-09-12T18:13:14.365 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5/var/log/ceph/ceph-client.admin.57195.log: --verbose -- /var/log/ceph/ceph-client.admin.39647.log 2024-09-12T18:13:14.365 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.152038.log: 84.0% -- replaced with /var/log/ceph/ceph-client.admin.57195.log.gz 2024-09-12T18:13:14.365 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170653.log 2024-09-12T18:13:14.365 INFO:teuthology.orchestra.run.smithi037.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.152038.log.gz 2024-09-12T18:13:14.366 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139079.log 2024-09-12T18:13:14.366 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.39647.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39647.log.gz 2024-09-12T18:13:14.366 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125532.log 2024-09-12T18:13:14.366 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.170653.log: /var/log/ceph/ceph-client.admin.139079.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191148.log 2024-09-12T18:13:14.366 INFO:teuthology.orchestra.run.smithi037.stderr: 93.8% -- replaced with /var/log/ceph/ceph-client.admin.64463.log.gz 2024-09-12T18:13:14.366 INFO:teuthology.orchestra.run.smithi037.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.139079.log.gz 2024-09-12T18:13:14.366 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.125532.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.125532.log.gz 2024-09-12T18:13:14.366 INFO:teuthology.orchestra.run.smithi037.stderr: 92.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38328.log 2024-09-12T18:13:14.366 INFO:teuthology.orchestra.run.smithi037.stderr: -- replaced with /var/log/ceph/ceph-client.admin.170653.log.gz 2024-09-12T18:13:14.366 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.191148.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191148.log.gz 2024-09-12T18:13:14.366 INFO:teuthology.orchestra.run.smithi037.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.39652.log 2024-09-12T18:13:14.366 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.38328.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38328.log.gz 2024-09-12T18:13:14.366 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101381.log 2024-09-12T18:13:14.366 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.39652.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87244.log 2024-09-12T18:13:14.366 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39652.log.gz 2024-09-12T18:13:14.367 INFO:teuthology.orchestra.run.smithi037.stderr:gzip/var/log/ceph/ceph-client.admin.101381.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.128477.log 2024-09-12T18:13:14.367 INFO:teuthology.orchestra.run.smithi037.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.101381.log.gz 2024-09-12T18:13:14.367 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.87244.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114340.log 2024-09-12T18:13:14.367 INFO:teuthology.orchestra.run.smithi037.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.87244.log.gz 2024-09-12T18:13:14.367 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.128477.log: gzip -5 --verbose -- 81.2% -- replaced with /var/log/ceph/ceph-client.admin.128477.log.gz 2024-09-12T18:13:14.367 INFO:teuthology.orchestra.run.smithi037.stderr: /var/log/ceph/ceph-client.admin.113751.log 2024-09-12T18:13:14.367 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.114340.log: gzip -5 --verbose 81.6% -- replaced with /var/log/ceph/ceph-client.admin.114340.log.gz 2024-09-12T18:13:14.367 INFO:teuthology.orchestra.run.smithi037.stderr: -- /var/log/ceph/ceph-client.admin.165704.log 2024-09-12T18:13:14.367 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.113751.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135545.log 2024-09-12T18:13:14.367 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.165704.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191194.log 2024-09-12T18:13:14.367 INFO:teuthology.orchestra.run.smithi037.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.165704.log.gz/var/log/ceph/ceph-client.admin.135545.log: 2024-09-12T18:13:14.367 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84888.log 2024-09-12T18:13:14.367 INFO:teuthology.orchestra.run.smithi037.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.135545.log.gz 2024-09-12T18:13:14.367 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96079.log 2024-09-12T18:13:14.368 INFO:teuthology.orchestra.run.smithi037.stderr: 87.0%/var/log/ceph/ceph-client.admin.191194.log: -- replaced with /var/log/ceph/ceph-client.admin.113751.log.gz 2024-09-12T18:13:14.368 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191194.log.gz 2024-09-12T18:13:14.368 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53072.log 2024-09-12T18:13:14.368 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.84888.log: /var/log/ceph/ceph-client.admin.96079.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.84888.log.gz 2024-09-12T18:13:14.368 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153805.log 2024-09-12T18:13:14.368 INFO:teuthology.orchestra.run.smithi037.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.96079.log.gz 2024-09-12T18:13:14.368 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188273.log 2024-09-12T18:13:14.368 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.53072.log: /var/log/ceph/ceph-client.admin.153805.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124943.log 2024-09-12T18:13:14.368 INFO:teuthology.orchestra.run.smithi037.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.153805.log.gz 2024-09-12T18:13:14.368 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.188273.log: gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.admin.log 2024-09-12T18:13:14.368 INFO:teuthology.orchestra.run.smithi037.stderr: 83.9% -- replaced with /var/log/ceph/ceph-client.admin.53072.log.gz 24.5% -- replaced with /var/log/ceph/ceph-client.admin.188273.log.gz 2024-09-12T18:13:14.368 INFO:teuthology.orchestra.run.smithi037.stderr: 2024-09-12T18:13:14.368 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.124943.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112573.log 2024-09-12T18:13:14.368 INFO:teuthology.orchestra.run.smithi037.stderr: 84.9%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166293.log 2024-09-12T18:13:14.369 INFO:teuthology.orchestra.run.smithi037.stderr: -- replaced with /var/log/ceph/ceph-client.admin.124943.log.gz 2024-09-12T18:13:14.369 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ops-log-ceph-client.admin.log: /var/log/ceph/ceph-client.admin.112573.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60200.log 2024-09-12T18:13:14.369 INFO:teuthology.orchestra.run.smithi037.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.112573.log.gz/var/log/ceph/ceph-client.admin.166293.log: 2024-09-12T18:13:14.369 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123765.log 2024-09-12T18:13:14.369 INFO:teuthology.orchestra.run.smithi037.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.166293.log.gz 2024-09-12T18:13:14.369 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.60200.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60200.log.gz 2024-09-12T18:13:14.369 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94901.log 2024-09-12T18:13:14.369 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.123765.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62577.log 2024-09-12T18:13:14.369 INFO:teuthology.orchestra.run.smithi037.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.123765.log.gz 2024-09-12T18:13:14.369 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.94901.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119642.log 2024-09-12T18:13:14.369 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.62577.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.94901.log.gz 2024-09-12T18:13:14.369 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103737.log 2024-09-12T18:13:14.369 INFO:teuthology.orchestra.run.smithi037.stderr: 57.0% -- replaced with /var/log/ceph/ceph-client.admin.62577.log.gz 2024-09-12T18:13:14.369 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.119642.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47086.log 2024-09-12T18:13:14.370 INFO:teuthology.orchestra.run.smithi037.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.119642.log.gz 2024-09-12T18:13:14.370 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.103737.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93723.log 2024-09-12T18:13:14.370 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.47086.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190826.log 2024-09-12T18:13:14.370 INFO:teuthology.orchestra.run.smithi037.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.103737.log.gz 2024-09-12T18:13:14.370 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.93723.log: 82.9% -- replaced with /var/log/ceph/ceph-client.admin.47086.log.gz 2024-09-12T18:13:14.370 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.40797.log 2024-09-12T18:13:14.370 INFO:teuthology.orchestra.run.smithi037.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.93723.log.gz/var/log/ceph/ceph-client.admin.190826.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92545.log 2024-09-12T18:13:14.370 INFO:teuthology.orchestra.run.smithi037.stderr: 2024-09-12T18:13:14.370 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190826.log.gz 2024-09-12T18:13:14.370 INFO:teuthology.orchestra.run.smithi037.stderr: 95.0% -- replaced with /var/log/ceph/ceph-client.admin.68799.log.gz 2024-09-12T18:13:14.370 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.0.40797.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49442.log 2024-09-12T18:13:14.370 INFO:teuthology.orchestra.run.smithi037.stderr: 44.2% -- replaced with /var/log/ceph/ceph-client.0.40797.log.gz 2024-09-12T18:13:14.370 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.92545.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79587.log 2024-09-12T18:13:14.370 INFO:teuthology.orchestra.run.smithi037.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.92545.log.gz/var/log/ceph/ceph-client.admin.49442.log: 2024-09-12T18:13:14.371 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174449.log 2024-09-12T18:13:14.371 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49442.log.gz 2024-09-12T18:13:14.371 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.79587.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98435.log 2024-09-12T18:13:14.371 INFO:teuthology.orchestra.run.smithi037.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.79587.log.gz 2024-09-12T18:13:14.371 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.174449.log: gzip -5 94.2% -- replaced with /var/log/ceph/ops-log-ceph-client.admin.log.gz 2024-09-12T18:13:14.371 INFO:teuthology.orchestra.run.smithi037.stderr: --verbose -- /var/log/ceph/ceph-client.admin.81943.log 2024-09-12T18:13:14.371 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.98435.log: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.174449.log.gz 2024-09-12T18:13:14.371 INFO:teuthology.orchestra.run.smithi037.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.98435.log.gz 2024-09-12T18:13:14.371 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38916.log 2024-09-12T18:13:14.371 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.81943.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124354.log 2024-09-12T18:13:14.371 INFO:teuthology.orchestra.run.smithi037.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.81943.log.gz 2024-09-12T18:13:14.371 INFO:teuthology.orchestra.run.smithi037.stderr:gzip/var/log/ceph/ceph-client.admin.38916.log: -5 --verbose -- 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38916.log.gz 2024-09-12T18:13:14.371 INFO:teuthology.orchestra.run.smithi037.stderr: /var/log/ceph/ceph-client.admin.190642.log 2024-09-12T18:13:14.371 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.124354.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173841.log 2024-09-12T18:13:14.372 INFO:teuthology.orchestra.run.smithi037.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.124354.log.gz 2024-09-12T18:13:14.372 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.190642.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-09-12T18:13:14.372 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190642.log.gz 2024-09-12T18:13:14.372 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78998.log 2024-09-12T18:13:14.372 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.173841.log: /var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57844.log 2024-09-12T18:13:14.372 INFO:teuthology.orchestra.run.smithi037.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.173841.log.gz 2024-09-12T18:13:14.372 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.78998.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57808.log 2024-09-12T18:13:14.372 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.57844.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.78998.log.gz 2024-09-12T18:13:14.372 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70038.log 2024-09-12T18:13:14.372 INFO:teuthology.orchestra.run.smithi037.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.57844.log.gz 2024-09-12T18:13:14.372 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.57808.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.179166.log 2024-09-12T18:13:14.372 INFO:teuthology.orchestra.run.smithi037.stderr: -- replaced with /var/log/ceph/ceph-client.admin.57808.log.gz 2024-09-12T18:13:14.372 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.70038.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121409.log 2024-09-12T18:13:14.373 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.0.179166.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139668.log 2024-09-12T18:13:14.373 INFO:teuthology.orchestra.run.smithi037.stderr: 83.9%/var/log/ceph/ceph-client.admin.121409.log: -- replaced with /var/log/ceph/ceph-client.0.179166.log.gz 2024-09-12T18:13:14.373 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173233.log 2024-09-12T18:13:14.373 INFO:teuthology.orchestra.run.smithi037.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.121409.log.gz 2024-09-12T18:13:14.373 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.139668.log: -- /var/log/ceph/ceph-client.admin.188368.log 2024-09-12T18:13:14.373 INFO:teuthology.orchestra.run.smithi037.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.70038.log.gz/var/log/ceph/ceph-client.admin.173233.log: 2024-09-12T18:13:14.373 INFO:teuthology.orchestra.run.smithi037.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.139668.log.gz 2024-09-12T18:13:14.373 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175483.log 2024-09-12T18:13:14.373 INFO:teuthology.orchestra.run.smithi037.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.173233.log.gz 2024-09-12T18:13:14.373 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.188368.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.188368.log.gz 2024-09-12T18:13:14.373 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39853.log 2024-09-12T18:13:14.373 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190964.log 2024-09-12T18:13:14.373 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.175483.log: /var/log/ceph/ceph-client.admin.39853.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74207.log 2024-09-12T18:13:14.374 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39853.log.gz 2024-09-12T18:13:14.374 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.190964.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106093.log 2024-09-12T18:13:14.374 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190964.log.gz 2024-09-12T18:13:14.374 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.74207.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86655.log 2024-09-12T18:13:14.374 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.106093.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190918.log 2024-09-12T18:13:14.374 INFO:teuthology.orchestra.run.smithi037.stderr: 91.1% 81.8% -- replaced with /var/log/ceph/ceph-client.admin.106093.log.gz 2024-09-12T18:13:14.374 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.86655.log: 92.9% -- replaced with /var/log/ceph/ceph-client.admin.175483.log.gz 2024-09-12T18:13:14.374 INFO:teuthology.orchestra.run.smithi037.stderr: -- replaced with /var/log/ceph/ceph-client.admin.74207.log.gz 2024-09-12T18:13:14.374 INFO:teuthology.orchestra.run.smithi037.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.86655.log.gz 2024-09-12T18:13:14.374 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190550.log 2024-09-12T18:13:14.374 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123176.log 2024-09-12T18:13:14.374 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.190918.log: gzip -5/var/log/ceph/ceph-client.admin.190550.log: --verbose -- /var/log/ceph/ceph-client.admin.168298.log 2024-09-12T18:13:14.374 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190550.log.gz 2024-09-12T18:13:14.374 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.123176.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190918.log.gz 2024-09-12T18:13:14.375 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134367.log 2024-09-12T18:13:14.375 INFO:teuthology.orchestra.run.smithi037.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.123176.log.gz 2024-09-12T18:13:14.375 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.168298.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159107.log 2024-09-12T18:13:14.375 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.134367.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156751.log 2024-09-12T18:13:14.375 INFO:teuthology.orchestra.run.smithi037.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.168298.log.gz 2024-09-12T18:13:14.375 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.159107.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96668.log 2024-09-12T18:13:14.375 INFO:teuthology.orchestra.run.smithi037.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.159107.log.gz 2024-09-12T18:13:14.375 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73615.log 2024-09-12T18:13:14.375 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.156751.log: /var/log/ceph/ceph-client.admin.96668.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38913.log 2024-09-12T18:13:14.375 INFO:teuthology.orchestra.run.smithi037.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.134367.log.gz 2024-09-12T18:13:14.375 INFO:teuthology.orchestra.run.smithi037.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.96668.log.gz 2024-09-12T18:13:14.375 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.73615.log: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.156751.log.gz 2024-09-12T18:13:14.375 INFO:teuthology.orchestra.run.smithi037.stderr: 83.9% -- replaced with /var/log/ceph/ceph-client.admin.73615.log.gz 2024-09-12T18:13:14.375 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163300.log 2024-09-12T18:13:14.375 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47675.log 2024-09-12T18:13:14.376 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.38913.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-12T18:13:14.376 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0%/var/log/ceph/ceph-client.admin.163300.log: -- replaced with /var/log/ceph/ceph-client.admin.38913.log.gz 2024-09-12T18:13:14.376 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.47675.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190504.log 2024-09-12T18:13:14.376 INFO:teuthology.orchestra.run.smithi037.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.163300.log.gz 2024-09-12T18:13:14.376 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-mon.a.log: 83.4% -- replaced with /var/log/ceph/ceph-client.admin.47675.log.gz 2024-09-12T18:13:14.376 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40077.log 2024-09-12T18:13:14.376 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163252.log 2024-09-12T18:13:14.376 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.190504.log: /var/log/ceph/ceph-client.admin.40077.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170045.log 2024-09-12T18:13:14.376 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190504.log.gz 2024-09-12T18:13:14.376 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40077.log.gz 2024-09-12T18:13:14.376 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.163252.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190688.log 2024-09-12T18:13:14.376 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.163252.log.gz 2024-09-12T18:13:14.376 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60248.log 2024-09-12T18:13:14.376 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.170045.log: /var/log/ceph/ceph-client.admin.190688.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138490.log 2024-09-12T18:13:14.377 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190688.log.gz 2024-09-12T18:13:14.377 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.60248.log: 83.3% -- replaced with /var/log/ceph/ceph-client.admin.60248.log.gz 2024-09-12T18:13:14.377 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122587.log 2024-09-12T18:13:14.377 INFO:teuthology.orchestra.run.smithi037.stderr: 93.4%/var/log/ceph/ceph-client.admin.138490.log: -- replaced with /var/log/ceph/ceph-client.admin.170045.log.gz 2024-09-12T18:13:14.377 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.76757.log 2024-09-12T18:13:14.377 INFO:teuthology.orchestra.run.smithi037.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.138490.log.gz 2024-09-12T18:13:14.377 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152627.log 2024-09-12T18:13:14.377 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.122587.log: /var/log/ceph/ceph-client.0.76757.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69418.log 2024-09-12T18:13:14.377 INFO:teuthology.orchestra.run.smithi037.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.122587.log.gz 2024-09-12T18:13:14.377 INFO:teuthology.orchestra.run.smithi037.stderr: 84.2%/var/log/ceph/ceph-client.admin.152627.log: -- replaced with /var/log/ceph/ceph-client.0.76757.log.gz 2024-09-12T18:13:14.377 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136134.log 2024-09-12T18:13:14.377 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.69418.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143791.log 2024-09-12T18:13:14.377 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.136134.log: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.152627.log.gz 2024-09-12T18:13:14.377 INFO:teuthology.orchestra.run.smithi037.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.136134.log.gz 2024-09-12T18:13:14.378 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164478.log 2024-09-12T18:13:14.378 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.143791.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63761.log 2024-09-12T18:13:14.378 INFO:teuthology.orchestra.run.smithi037.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.143791.log.gz 2024-09-12T18:13:14.378 INFO:teuthology.orchestra.run.smithi037.stderr: 92.4%/var/log/ceph/ceph-client.admin.164478.log: -- replaced with /var/log/ceph/ceph-client.admin.69418.log.gz 2024-09-12T18:13:14.378 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-12T18:13:14.378 INFO:teuthology.orchestra.run.smithi037.stderr: 86.8%/var/log/ceph/ceph-client.admin.63761.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.184647.log 2024-09-12T18:13:14.378 INFO:teuthology.orchestra.run.smithi037.stderr: -- replaced with /var/log/ceph/ceph-client.admin.164478.log.gz 2024-09-12T18:13:14.378 INFO:teuthology.orchestra.run.smithi037.stderr: 21.2% -- replaced with /var/log/ceph/ceph-client.admin.63761.log.gz 2024-09-12T18:13:14.378 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81354.log 2024-09-12T18:13:14.378 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-osd.2.log: /var/log/ceph/ceph-client.0.184647.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130833.log 2024-09-12T18:13:14.378 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.81354.log: 84.0% -- replaced with /var/log/ceph/ceph-client.0.184647.log.gz 2024-09-12T18:13:14.378 INFO:teuthology.orchestra.run.smithi037.stderr: 89.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.77523.log 2024-09-12T18:13:14.378 INFO:teuthology.orchestra.run.smithi037.stderr: -- replaced with /var/log/ceph/ceph-client.admin.81354.log.gz 2024-09-12T18:13:14.378 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.130833.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.130833.log.gz 2024-09-12T18:13:14.379 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147325.log 2024-09-12T18:13:14.379 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.0.77523.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86066.log 2024-09-12T18:13:14.379 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.147325.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.147325.log.gz 2024-09-12T18:13:14.379 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77468.log 2024-09-12T18:13:14.379 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.86066.log: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.86066.log.gz 2024-09-12T18:13:14.379 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/ceph.client.0.log 2024-09-12T18:13:14.379 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.77468.log: 91.7% -- replaced with /var/log/ceph/ceph-client.0.77523.log.gz 2024-09-12T18:13:14.379 INFO:teuthology.orchestra.run.smithi037.stderr: 49.7% -- replaced with /var/log/ceph/ceph-client.admin.77468.log.gz 2024-09-12T18:13:14.379 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100202.log 2024-09-12T18:13:14.379 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/valgrind/ceph.client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39648.log 2024-09-12T18:13:14.379 INFO:teuthology.orchestra.run.smithi037.stderr: 62.0% -- replaced with /var/log/ceph/valgrind/ceph.client.0.log.gz 2024-09-12T18:13:14.379 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.100202.log: 81.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45576.log 2024-09-12T18:13:14.379 INFO:teuthology.orchestra.run.smithi037.stderr: -- replaced with /var/log/ceph/ceph-client.admin.100202.log.gz 2024-09-12T18:13:14.379 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.39648.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140257.log 2024-09-12T18:13:14.380 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39648.log.gz 2024-09-12T18:13:14.380 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.45576.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120231.log 2024-09-12T18:13:14.380 INFO:teuthology.orchestra.run.smithi037.stderr: 82.6% -- replaced with /var/log/ceph/ceph-client.admin.45576.log.gz 2024-09-12T18:13:14.380 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.140257.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148504.log 2024-09-12T18:13:14.380 INFO:teuthology.orchestra.run.smithi037.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.140257.log.gz 2024-09-12T18:13:14.380 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.120231.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191424.log 2024-09-12T18:13:14.380 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.148504.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.120231.log.gz 2024-09-12T18:13:14.380 INFO:teuthology.orchestra.run.smithi037.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.148504.log.gz 2024-09-12T18:13:14.380 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33212.log 2024-09-12T18:13:14.380 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.191424.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191424.log.gz 2024-09-12T18:13:14.380 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40033.log 2024-09-12T18:13:14.380 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.33212.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68180.log 2024-09-12T18:13:14.380 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33212.log.gz 2024-09-12T18:13:14.380 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.40033.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40033.log.gz 2024-09-12T18:13:14.381 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100792.log 2024-09-12T18:13:14.381 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.68180.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151449.log 2024-09-12T18:13:14.381 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.100792.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.100792.log.gz 2024-09-12T18:13:14.381 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-09-12T18:13:14.381 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.151449.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.68180.log.gz 81.7% -- replaced with /var/log/ceph/ceph-client.admin.151449.log.gz 2024-09-12T18:13:14.381 INFO:teuthology.orchestra.run.smithi037.stderr: 2024-09-12T18:13:14.381 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94312.log 2024-09-12T18:13:14.381 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117286.log 2024-09-12T18:13:14.381 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.94312.log: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.94312.log.gz 2024-09-12T18:13:14.381 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39283.log 2024-09-12T18:13:14.381 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.117286.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.117286.log.gz 2024-09-12T18:13:14.381 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171261.log 2024-09-12T18:13:14.381 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.39283.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39283.log.gz 2024-09-12T18:13:14.382 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191470.log 2024-09-12T18:13:14.382 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.171261.log: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.171261.log.gz 2024-09-12T18:13:14.382 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97257.log 2024-09-12T18:13:14.382 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.191470.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191470.log.gz 2024-09-12T18:13:14.382 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62895.log 2024-09-12T18:13:14.382 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.97257.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.97257.log.gz 2024-09-12T18:13:14.382 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-12T18:13:14.382 INFO:teuthology.orchestra.run.smithi037.stderr: 94.4% -- replaced with /var/log/ceph/ops-log-ceph-client.0.log.gz 2024-09-12T18:13:14.382 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.62895.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38506.log 2024-09-12T18:13:14.382 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.62895.log.gz 2024-09-12T18:13:14.382 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155572.log 2024-09-12T18:13:14.382 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.38506.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38506.log.gz 2024-09-12T18:13:14.382 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.189780.log 2024-09-12T18:13:14.382 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.155572.log: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.155572.log.gz 2024-09-12T18:13:14.383 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127888.log 2024-09-12T18:13:14.383 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.0.189780.log: 90.5% -- replaced with /var/log/ceph/ceph-client.0.189780.log.gz 2024-09-12T18:13:14.383 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33121.log 2024-09-12T18:13:14.383 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.127888.log: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.127888.log.gz 2024-09-12T18:13:14.383 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111395.log 2024-09-12T18:13:14.383 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.33121.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33121.log.gz 2024-09-12T18:13:14.383 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104326.log 2024-09-12T18:13:14.383 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.111395.log: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.111395.log.gz 2024-09-12T18:13:14.383 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83710.log 2024-09-12T18:13:14.383 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.104326.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.104326.log.gz 2024-09-12T18:13:14.383 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95490.log 2024-09-12T18:13:14.383 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.83710.log: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.83710.log.gz 2024-09-12T18:13:14.383 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133778.log 2024-09-12T18:13:14.383 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.95490.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.95490.log.gz 2024-09-12T18:13:14.384 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104915.log 2024-09-12T18:13:14.384 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.133778.log: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.133778.log.gz 2024-09-12T18:13:14.384 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74797.log 2024-09-12T18:13:14.384 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.104915.log: 93.7% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-12T18:13:14.384 INFO:teuthology.orchestra.run.smithi037.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.104915.log.gz 2024-09-12T18:13:14.384 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160286.log 2024-09-12T18:13:14.384 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.74797.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39651.log 2024-09-12T18:13:14.384 INFO:teuthology.orchestra.run.smithi037.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.74797.log.gz 2024-09-12T18:13:14.384 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.160286.log: 95.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.181602.log 2024-09-12T18:13:14.384 INFO:teuthology.orchestra.run.smithi037.stderr: -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-09-12T18:13:14.384 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160286.log.gz 2024-09-12T18:13:14.384 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.39651.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39651.log.gz 2024-09-12T18:13:14.384 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51870.log 2024-09-12T18:13:14.384 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62687.log 2024-09-12T18:13:14.385 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.0.181602.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188343.log 2024-09-12T18:13:14.385 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.51870.log: 80.4% -- replaced with /var/log/ceph/ceph-client.0.181602.log.gz 2024-09-12T18:13:14.385 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51870.log.gz 2024-09-12T18:13:14.385 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.62687.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90189.log 2024-09-12T18:13:14.385 INFO:teuthology.orchestra.run.smithi037.stderr: 49.7% -- replaced with /var/log/ceph/ceph-client.admin.62687.log.gz 2024-09-12T18:13:14.385 INFO:teuthology.orchestra.run.smithi037.stderr:gzip/var/log/ceph/ceph-client.admin.188343.log: -5 --verbose -- 0.0% -- replaced with /var/log/ceph/ceph-client.admin.188343.log.gz 2024-09-12T18:13:14.385 INFO:teuthology.orchestra.run.smithi037.stderr: /var/log/ceph/ceph-client.admin.186434.log 2024-09-12T18:13:14.385 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.90189.log: gzip -5 81.7% -- replaced with /var/log/ceph/ceph-client.admin.90189.log.gz 2024-09-12T18:13:14.385 INFO:teuthology.orchestra.run.smithi037.stderr: --verbose -- /var/log/ceph/ceph-client.admin.160307.log 2024-09-12T18:13:14.385 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.186434.log: gzip -5 --verbose 82.6% -- replaced with /var/log/ceph/ceph-client.admin.186434.log.gz 2024-09-12T18:13:14.385 INFO:teuthology.orchestra.run.smithi037.stderr: -- /var/log/ceph/ceph-client.0.41442.log 2024-09-12T18:13:14.385 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.160307.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63035.log 86.8% -- replaced with /var/log/ceph/ceph-client.admin.160307.log.gz 2024-09-12T18:13:14.385 INFO:teuthology.orchestra.run.smithi037.stderr: 2024-09-12T18:13:14.385 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.0.41442.log: gzip 80.6% -5 --verbose -- /var/log/ceph/ceph-client.admin.187023.log 2024-09-12T18:13:14.386 INFO:teuthology.orchestra.run.smithi037.stderr: -- replaced with /var/log/ceph/ceph-client.0.41442.log.gz 2024-09-12T18:13:14.386 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.63035.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154983.log 2024-09-12T18:13:14.386 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134956.log 2024-09-12T18:13:14.386 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.187023.log: 85.3%/var/log/ceph/ceph-client.admin.154983.log: -- replaced with /var/log/ceph/ceph-client.admin.187023.log.gz 2024-09-12T18:13:14.386 INFO:teuthology.orchestra.run.smithi037.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.154983.log.gz 2024-09-12T18:13:14.386 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39494.log 2024-09-12T18:13:14.386 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.134956.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60224.log 2024-09-12T18:13:14.386 INFO:teuthology.orchestra.run.smithi037.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.134956.log.gz 2024-09-12T18:13:14.386 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.39494.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90778.log 2024-09-12T18:13:14.386 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.60224.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39494.log.gz 2024-09-12T18:13:14.386 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60224.log.gz 2024-09-12T18:13:14.386 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39945.log 2024-09-12T18:13:14.386 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.90778.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114929.log 2024-09-12T18:13:14.386 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.39945.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39945.log.gz 2024-09-12T18:13:14.387 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187659.log 2024-09-12T18:13:14.387 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.114929.log: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.114929.log.gz 2024-09-12T18:13:14.387 INFO:teuthology.orchestra.run.smithi037.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.90778.log.gz 2024-09-12T18:13:14.387 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130244.log 2024-09-12T18:13:14.387 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.187659.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.187659.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140846.log 2024-09-12T18:13:14.387 INFO:teuthology.orchestra.run.smithi037.stderr: 2024-09-12T18:13:14.387 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55428.log 2024-09-12T18:13:14.387 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.140846.log: /var/log/ceph/ceph-client.admin.130244.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.130244.log.gz 2024-09-12T18:13:14.387 INFO:teuthology.orchestra.run.smithi037.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.140846.log.gz 2024-09-12T18:13:14.387 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71940.log 2024-09-12T18:13:14.387 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39649.log 2024-09-12T18:13:14.387 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.71940.log: /var/log/ceph/ceph-client.admin.55428.log: 84.5% 84.0% -- replaced with /var/log/ceph/ceph-client.admin.55428.log.gz 2024-09-12T18:13:14.387 INFO:teuthology.orchestra.run.smithi037.stderr: -- replaced with /var/log/ceph/ceph-client.admin.71940.log.gz 2024-09-12T18:13:14.387 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.167649.log 2024-09-12T18:13:14.388 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.39649.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.39649.log.gz -5 --verbose -- /var/log/ceph/ceph-client.admin.109039.log 2024-09-12T18:13:14.388 INFO:teuthology.orchestra.run.smithi037.stderr: 2024-09-12T18:13:14.388 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191102.log 2024-09-12T18:13:14.388 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.109039.log: /var/log/ceph/ceph-client.0.167649.log: 84.1% -- replaced with /var/log/ceph/ceph-client.0.167649.log.gz 2024-09-12T18:13:14.388 INFO:teuthology.orchestra.run.smithi037.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.109039.log.gz 2024-09-12T18:13:14.388 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88422.log 2024-09-12T18:13:14.388 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.182211.log 2024-09-12T18:13:14.388 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.191102.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191102.log.gz 2024-09-12T18:13:14.388 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.88422.log: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.88422.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153216.log 2024-09-12T18:13:14.388 INFO:teuthology.orchestra.run.smithi037.stderr: 2024-09-12T18:13:14.388 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.0.182211.log: 83.6%gzip -- replaced with /var/log/ceph/ceph-client.0.182211.log.gz -5 --verbose -- /var/log/ceph/ceph-client.admin.39285.log 2024-09-12T18:13:14.388 INFO:teuthology.orchestra.run.smithi037.stderr: 2024-09-12T18:13:14.388 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157340.log 2024-09-12T18:13:14.388 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.39285.log: /var/log/ceph/ceph-client.admin.153216.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39285.log.gz 2024-09-12T18:13:14.389 INFO:teuthology.orchestra.run.smithi037.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.153216.log.gz 2024-09-12T18:13:14.389 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133189.log 2024-09-12T18:13:14.389 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.157340.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156162.log 2024-09-12T18:13:14.389 INFO:teuthology.orchestra.run.smithi037.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.157340.log.gz 2024-09-12T18:13:14.389 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.133189.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99613.log 2024-09-12T18:13:14.389 INFO:teuthology.orchestra.run.smithi037.stderr: 87.9% 81.2% -- replaced with /var/log/ceph/ceph-client.admin.133189.log.gz 2024-09-12T18:13:14.389 INFO:teuthology.orchestra.run.smithi037.stderr: -- replaced with /var/log/ceph/ceph-client.admin.63035.log.gz 2024-09-12T18:13:14.389 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.156162.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137901.log 2024-09-12T18:13:14.389 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.99613.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91956.log 2024-09-12T18:13:14.389 INFO:teuthology.orchestra.run.smithi037.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.156162.log.gz 2024-09-12T18:13:14.389 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.137901.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.99613.log.gz 2024-09-12T18:13:14.389 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190412.log 2024-09-12T18:13:14.389 INFO:teuthology.orchestra.run.smithi037.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.137901.log.gz/var/log/ceph/ceph-client.admin.91956.log: 2024-09-12T18:13:14.389 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- 81.1% -- replaced with /var/log/ceph/ceph-client.admin.91956.log.gz 2024-09-12T18:13:14.390 INFO:teuthology.orchestra.run.smithi037.stderr: /var/log/ceph/ceph-client.admin.126121.log 2024-09-12T18:13:14.390 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.190412.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190412.log.gz 2024-09-12T18:13:14.390 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.185256.log 2024-09-12T18:13:14.390 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.126121.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54839.log 2024-09-12T18:13:14.390 INFO:teuthology.orchestra.run.smithi037.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.126121.log.gz/var/log/ceph/ceph-client.0.185256.log: 2024-09-12T18:13:14.390 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83121.log 2024-09-12T18:13:14.390 INFO:teuthology.orchestra.run.smithi037.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.0.185256.log.gz 2024-09-12T18:13:14.390 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63874.log 2024-09-12T18:13:14.390 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.54839.log: /var/log/ceph/ceph-client.admin.83121.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51894.log 2024-09-12T18:13:14.390 INFO:teuthology.orchestra.run.smithi037.stderr: 84.1% 81.4% -- replaced with /var/log/ceph/ceph-client.admin.83121.log.gz 2024-09-12T18:13:14.390 INFO:teuthology.orchestra.run.smithi037.stderr: -- replaced with /var/log/ceph/ceph-client.admin.54839.log.gz/var/log/ceph/ceph-client.admin.63874.log: 2024-09-12T18:13:14.390 INFO:teuthology.orchestra.run.smithi037.stderr:gzip 84.2% -- replaced with /var/log/ceph/ceph-client.admin.63874.log.gz 2024-09-12T18:13:14.390 INFO:teuthology.orchestra.run.smithi037.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.105504.log 2024-09-12T18:13:14.390 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.51894.log: gzip -5 --verbose -- 84.0% -- replaced with /var/log/ceph/ceph-client.admin.51894.log.gz 2024-09-12T18:13:14.391 INFO:teuthology.orchestra.run.smithi037.stderr: /var/log/ceph/ceph-client.admin.191516.log 2024-09-12T18:13:14.391 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.105504.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116108.log 2024-09-12T18:13:14.391 INFO:teuthology.orchestra.run.smithi037.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.105504.log.gz 2024-09-12T18:13:14.391 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.191516.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191516.log.gz 2024-09-12T18:13:14.391 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/rgw.ceph.client.0.log 2024-09-12T18:13:14.391 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142024.log/var/log/ceph/ceph-client.admin.116108.log: 2024-09-12T18:13:14.391 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/rgw.ceph.client.0.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.116108.log.gz 2024-09-12T18:13:14.391 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149682.log 2024-09-12T18:13:14.391 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.142024.log: /var/log/ceph/ceph-client.admin.191010.log 2024-09-12T18:13:14.391 INFO:teuthology.orchestra.run.smithi037.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.142024.log.gz 2024-09-12T18:13:14.391 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.149682.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142613.log 2024-09-12T18:13:14.391 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.191010.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.149682.log.gz 2024-09-12T18:13:14.391 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191010.log.gz 2024-09-12T18:13:14.391 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188319.log 2024-09-12T18:13:14.392 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.142613.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54250.log 2024-09-12T18:13:14.392 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.188319.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.188319.log.gz 2024-09-12T18:13:14.392 INFO:teuthology.orchestra.run.smithi037.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.142613.log.gz 2024-09-12T18:13:14.392 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39280.log 2024-09-12T18:13:14.392 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.54250.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162074.log 2024-09-12T18:13:14.392 INFO:teuthology.orchestra.run.smithi037.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.54250.log.gz 2024-09-12T18:13:14.392 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.39280.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39280.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38914.log 2024-09-12T18:13:14.392 INFO:teuthology.orchestra.run.smithi037.stderr: 2024-09-12T18:13:14.392 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.162074.log: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.162074.log.gz 2024-09-12T18:13:14.392 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32783.log 2024-09-12T18:13:14.392 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.38914.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80176.log 2024-09-12T18:13:14.392 INFO:teuthology.orchestra.run.smithi037.stderr: -- replaced with /var/log/ceph/ceph-client.admin.38914.log.gz 2024-09-12T18:13:14.392 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38611.log 2024-09-12T18:13:14.392 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.32783.log: /var/log/ceph/ceph-client.admin.80176.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32783.log.gz 2024-09-12T18:13:14.393 INFO:teuthology.orchestra.run.smithi037.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.80176.log.gz 2024-09-12T18:13:14.393 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67560.log 2024-09-12T18:13:14.393 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.38611.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38909.log 2024-09-12T18:13:14.393 INFO:teuthology.orchestra.run.smithi037.stderr: -- replaced with /var/log/ceph/ceph-client.admin.38611.log.gz 2024-09-12T18:13:14.393 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187635.log 2024-09-12T18:13:14.393 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.67560.log: /var/log/ceph/ceph-client.admin.38909.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38909.log.gz 2024-09-12T18:13:14.393 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106682.log 2024-09-12T18:13:14.393 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.187635.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.187635.log.gz 2024-09-12T18:13:14.393 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.180993.log 2024-09-12T18:13:14.393 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.106682.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.67560.log.gz 2024-09-12T18:13:14.393 INFO:teuthology.orchestra.run.smithi037.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.106682.log.gz 2024-09-12T18:13:14.393 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145558.log 2024-09-12T18:13:14.393 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.183429.log 2024-09-12T18:13:14.394 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.0.180993.log: /var/log/ceph/ceph-client.admin.145558.log: 80.2% -- replaced with /var/log/ceph/ceph-client.0.180993.log.gz 2024-09-12T18:13:14.394 INFO:teuthology.orchestra.run.smithi037.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.145558.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93134.log 2024-09-12T18:13:14.394 INFO:teuthology.orchestra.run.smithi037.stderr: 2024-09-12T18:13:14.394 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52483.log 2024-09-12T18:13:14.394 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.93134.log: /var/log/ceph/ceph-client.0.183429.log: 80.0% -- replaced with /var/log/ceph/ceph-client.0.183429.log.gz 2024-09-12T18:13:14.394 INFO:teuthology.orchestra.run.smithi037.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.93134.log.gz 2024-09-12T18:13:14.394 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190734.log 2024-09-12T18:13:14.394 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147914.log 2024-09-12T18:13:14.394 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.52483.log: /var/log/ceph/ceph-client.admin.190734.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190734.log.gz 86.2% -- replaced with /var/log/ceph/ceph-client.admin.52483.log.gz 2024-09-12T18:13:14.394 INFO:teuthology.orchestra.run.smithi037.stderr: 2024-09-12T18:13:14.394 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43860.log 2024-09-12T18:13:14.394 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159696.log 2024-09-12T18:13:14.394 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.147914.log: /var/log/ceph/ceph-client.0.43860.log: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.147914.log.gz 2024-09-12T18:13:14.394 INFO:teuthology.orchestra.run.smithi037.stderr: 43.5% -- replaced with /var/log/ceph/ceph-client.0.43860.log.gz 2024-09-12T18:13:14.395 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127299.log 2024-09-12T18:13:14.395 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.178557.log 2024-09-12T18:13:14.395 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.159696.log: /var/log/ceph/ceph-client.admin.127299.log: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.159696.log.gz 2024-09-12T18:13:14.395 INFO:teuthology.orchestra.run.smithi037.stderr: 81.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89600.log 2024-09-12T18:13:14.395 INFO:teuthology.orchestra.run.smithi037.stderr: -- replaced with /var/log/ceph/ceph-client.admin.127299.log.gz 2024-09-12T18:13:14.395 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-12T18:13:14.395 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.0.178557.log: /var/log/ceph/ceph-client.admin.89600.log: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.89600.log.gz 2024-09-12T18:13:14.395 INFO:teuthology.orchestra.run.smithi037.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.0.178557.log.gz 2024-09-12T18:13:14.395 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.176730.log 2024-09-12T18:13:14.395 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132011.log 2024-09-12T18:13:14.395 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-osd.3.log: /var/log/ceph/ceph-client.0.176730.log: 84.0% -- replaced with /var/log/ceph/ceph-client.0.176730.log.gz 2024-09-12T18:13:14.395 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118464.log 2024-09-12T18:13:14.395 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.132011.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.132011.log.gz 2024-09-12T18:13:14.395 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129066.log 2024-09-12T18:13:14.396 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.118464.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.118464.log.gz 2024-09-12T18:13:14.396 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50079.log 2024-09-12T18:13:14.396 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.129066.log: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.129066.log.gz 2024-09-12T18:13:14.396 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.40188.log 2024-09-12T18:13:14.396 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.50079.log: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.50079.log.gz 2024-09-12T18:13:14.396 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101970.log 2024-09-12T18:13:14.396 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.0.40188.log: 95.8% -- replaced with /var/log/ceph/ceph-client.0.40188.log.gz 2024-09-12T18:13:14.396 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150271.log 2024-09-12T18:13:14.396 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.101970.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.101970.log.gz 2024-09-12T18:13:14.396 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59611.log 2024-09-12T18:13:14.396 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.150271.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.150271.log.gz 2024-09-12T18:13:14.396 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146736.log 2024-09-12T18:13:14.396 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.59611.log: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.59611.log.gz 2024-09-12T18:13:14.396 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165067.log 2024-09-12T18:13:14.398 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.146736.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.146736.log.gz 2024-09-12T18:13:14.398 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.165067.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.165067.log.gz 2024-09-12T18:13:14.590 INFO:teuthology.orchestra.run.smithi040.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-12T18:13:15.079 INFO:teuthology.orchestra.run.smithi040.stderr: 92.3% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-09-12T18:13:15.365 INFO:teuthology.orchestra.run.smithi037.stderr: 92.5% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-09-12T18:13:15.737 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y has been restored 2024-09-12T18:13:15.738 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x has been restored 2024-09-12T18:13:17.312 INFO:teuthology.orchestra.run.smithi037.stderr: 91.2% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-12T18:13:17.334 INFO:teuthology.orchestra.run.smithi037.stderr: 92.3% -- replaced with /var/log/ceph/rgw.ceph.client.0.log.gz 2024-09-12T18:13:21.994 INFO:teuthology.orchestra.run.smithi037.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-12T18:13:24.137 INFO:teuthology.orchestra.run.smithi040.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-09-12T18:13:24.222 INFO:teuthology.orchestra.run.smithi040.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-09-12T18:13:24.718 INFO:teuthology.orchestra.run.smithi037.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-12T18:13:25.252 INFO:teuthology.orchestra.run.smithi040.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-09-12T18:13:29.824 INFO:teuthology.orchestra.run.smithi037.stderr: 94.6% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-12T18:13:33.347 INFO:teuthology.orchestra.run.smithi040.stderr: 95.0% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-09-12T18:13:33.349 INFO:teuthology.orchestra.run.smithi040.stderr: 2024-09-12T18:13:33.349 INFO:teuthology.orchestra.run.smithi040.stderr:real 0m19.182s 2024-09-12T18:13:33.349 INFO:teuthology.orchestra.run.smithi040.stderr:user 0m49.801s 2024-09-12T18:13:33.349 INFO:teuthology.orchestra.run.smithi040.stderr:sys 0m1.689s 2024-09-12T18:13:36.657 INFO:teuthology.orchestra.run.smithi037.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-12T18:13:36.659 INFO:teuthology.orchestra.run.smithi037.stderr: 2024-09-12T18:13:36.659 INFO:teuthology.orchestra.run.smithi037.stderr:real 0m22.532s 2024-09-12T18:13:36.659 INFO:teuthology.orchestra.run.smithi037.stderr:user 1m1.887s 2024-09-12T18:13:36.659 INFO:teuthology.orchestra.run.smithi037.stderr:sys 0m2.246s 2024-09-12T18:13:36.660 INFO:tasks.ceph:Archiving logs... 2024-09-12T18:13:36.660 DEBUG:teuthology.misc:Transferring archived files from smithi037:/var/log/ceph to /home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902711/remote/smithi037/log 2024-09-12T18:13:36.661 DEBUG:teuthology.orchestra.run.smithi037:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T18:13:45.483 DEBUG:teuthology.misc:Transferring archived files from smithi040:/var/log/ceph to /home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902711/remote/smithi040/log 2024-09-12T18:13:45.484 DEBUG:teuthology.orchestra.run.smithi040:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T18:13:53.562 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-12T18:13:53.573 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-12T18:13:53.573 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T18:13:53.576 DEBUG:teuthology.orchestra.run.smithi040:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T18:13:53.682 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-12T18:13:53.692 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-12T18:13:53.693 DEBUG:teuthology.orchestra.run.smithi037:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T18:13:53.695 DEBUG:teuthology.orchestra.run.smithi040:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T18:13:53.726 INFO:teuthology.orchestra.run.smithi037.stderr:bash: line 1: ntpq: command not found 2024-09-12T18:13:53.728 INFO:teuthology.orchestra.run.smithi040.stderr:bash: line 1: ntpq: command not found 2024-09-12T18:13:53.730 INFO:teuthology.orchestra.run.smithi037.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T18:13:53.731 INFO:teuthology.orchestra.run.smithi037.stdout:=============================================================================== 2024-09-12T18:13:53.731 INFO:teuthology.orchestra.run.smithi037.stdout:^* hv01.front.sepia.ceph.com 3 6 377 32 +863us[ +824us] +/- 53ms 2024-09-12T18:13:53.731 INFO:teuthology.orchestra.run.smithi037.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 34 +156us[ +116us] +/- 66ms 2024-09-12T18:13:53.731 INFO:teuthology.orchestra.run.smithi037.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 34 -1270us[-1310us] +/- 65ms 2024-09-12T18:13:53.731 INFO:teuthology.orchestra.run.smithi037.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T18:13:53.733 INFO:teuthology.orchestra.run.smithi040.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T18:13:53.733 INFO:teuthology.orchestra.run.smithi040.stdout:=============================================================================== 2024-09-12T18:13:53.733 INFO:teuthology.orchestra.run.smithi040.stdout:^* hv01.front.sepia.ceph.com 3 6 377 29 +833us[ +828us] +/- 53ms 2024-09-12T18:13:53.733 INFO:teuthology.orchestra.run.smithi040.stdout:^+ hv02.front.sepia.ceph.com 3 7 377 93 +124us[ +118us] +/- 65ms 2024-09-12T18:13:53.733 INFO:teuthology.orchestra.run.smithi040.stdout:^+ hv03.front.sepia.ceph.com 3 8 377 97 -1290us[-1297us] +/- 64ms 2024-09-12T18:13:53.733 INFO:teuthology.orchestra.run.smithi040.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T18:13:53.733 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-12T18:13:53.745 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-12T18:13:53.746 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-12T18:13:53.770 DEBUG:teuthology.orchestra.run.smithi037:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-12T18:13:53.857 DEBUG:teuthology.orchestra.run.smithi040:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-12T18:13:53.940 DEBUG:teuthology.orchestra.run.smithi037:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-12T18:13:53.983 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T18:13:53.983 DEBUG:teuthology.orchestra.run.smithi040:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-12T18:13:54.026 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T18:13:54.027 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-12T18:13:54.038 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-12T18:13:54.078 INFO:teuthology.task.internal:Duration was 4284.300730 seconds 2024-09-12T18:13:54.078 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-12T18:13:54.119 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-12T18:13:54.119 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T18:13:54.122 DEBUG:teuthology.orchestra.run.smithi040:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T18:13:54.174 INFO:teuthology.orchestra.run.smithi037.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T18:13:54.177 INFO:teuthology.orchestra.run.smithi040.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T18:13:54.655 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-12T18:13:54.655 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi037.front.sepia.ceph.com 2024-09-12T18:13:54.655 DEBUG:teuthology.orchestra.run.smithi037:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T18:13:54.692 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi040.front.sepia.ceph.com 2024-09-12T18:13:54.692 DEBUG:teuthology.orchestra.run.smithi040:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T18:13:54.734 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-12T18:13:54.734 DEBUG:teuthology.orchestra.run.smithi037:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T18:13:54.737 DEBUG:teuthology.orchestra.run.smithi040:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T18:13:54.816 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-12T18:13:54.816 DEBUG:teuthology.orchestra.run.smithi037:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T18:13:54.820 DEBUG:teuthology.orchestra.run.smithi040:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T18:13:54.973 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-12T18:13:54.985 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-12T18:13:54.985 DEBUG:teuthology.orchestra.run.smithi037:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T18:13:55.029 DEBUG:teuthology.orchestra.run.smithi040:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T18:13:55.069 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-12T18:13:55.080 DEBUG:teuthology.orchestra.run.smithi037:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T18:13:55.083 DEBUG:teuthology.orchestra.run.smithi040:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T18:13:55.118 INFO:teuthology.orchestra.run.smithi037.stdout:kernel.core_pattern = core 2024-09-12T18:13:55.147 INFO:teuthology.orchestra.run.smithi040.stdout:kernel.core_pattern = core 2024-09-12T18:13:55.168 DEBUG:teuthology.orchestra.run.smithi037:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T18:13:55.204 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T18:13:55.205 DEBUG:teuthology.orchestra.run.smithi040:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T18:13:55.237 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T18:13:55.237 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-12T18:13:55.249 INFO:teuthology.task.internal:Transferring archived files... 2024-09-12T18:13:55.250 DEBUG:teuthology.misc:Transferring archived files from smithi037:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902711/remote/smithi037 2024-09-12T18:13:55.250 DEBUG:teuthology.orchestra.run.smithi037:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T18:13:55.301 DEBUG:teuthology.misc:Transferring archived files from smithi040:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902711/remote/smithi040 2024-09-12T18:13:55.301 DEBUG:teuthology.orchestra.run.smithi040:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T18:13:55.351 INFO:teuthology.task.internal:Removing archive directory... 2024-09-12T18:13:55.352 DEBUG:teuthology.orchestra.run.smithi037:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T18:13:55.355 DEBUG:teuthology.orchestra.run.smithi040:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T18:13:55.415 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-12T18:13:55.430 INFO:teuthology.task.internal:Not uploading archives. 2024-09-12T18:13:55.430 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-12T18:13:55.453 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-12T18:13:55.453 DEBUG:teuthology.orchestra.run.smithi037:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T18:13:55.456 DEBUG:teuthology.orchestra.run.smithi040:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T18:13:55.483 INFO:teuthology.orchestra.run.smithi037.stdout: 265324 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 18:13 /home/ubuntu/cephtest 2024-09-12T18:13:55.485 INFO:teuthology.orchestra.run.smithi040.stdout: 265336 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 18:13 /home/ubuntu/cephtest 2024-09-12T18:13:55.486 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-12T18:13:55.499 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-12T18:13:55.582 INFO:teuthology.run:Summary data: description: rgw/verify/{0-install accounts$/{none} clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec-profile s3tests-branch sharding$/{default} striping$/{stripe-greater-than-chunk} supported-random-distro$/{centos_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/valgrind} duration: 4284.300729513168 flavor: default owner: scheduled_cbodley@teuthology success: true 2024-09-12T18:13:55.582 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-12T18:13:55.693 INFO:teuthology.run:pass